2023-11-08T19:10:28.843 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-08T19:10:28.844 DEBUG:teuthology.run:Teuthology command: teuthology --name pdonnell-2023-11-08_19:01:12-fs:functional-main-distro-default-smithi --verbose --owner scheduled_pdonnell@teuthology --description fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snapshots} --archive /home/teuthworker/archive/pdonnell-2023-11-08_19:01:12-fs:functional-main-distro-default-smithi/7452102 -- /home/teuthworker/archive/pdonnell-2023-11-08_19:01:12-fs:functional-main-distro-default-smithi/7452102/orig.config.yaml 2023-11-08T19:10:28.891 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T19:10:28.978 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2023-11-08_19:01:12-fs:functional-main-distro-default-smithi/7452102 branch: main description: fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snapshots} email: pdonnell@redhat.com first_in_suite: false job_id: '7452102' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2023-11-08_19:01:12-fs:functional-main-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: main ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - evicting unresponsive client - RECENT_CRASH sha1: 7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs check-counter: dry_run: true install: ceph: flavor: default sha1: 7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4 kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-batrick-testing-20231108.185857 sha1: e797689ab88984658d73bbc928b2ed06c676d14a owner: scheduled_pdonnell@teuthology priority: 50 repo: https://github.com/ceph/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 3044 sha1: 7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4 sleep_before_teardown: 0 suite: fs:functional suite_branch: wip-batrick-testing-20231108.185857 suite_path: /home/teuthworker/src/github.com_batrick_ceph_e797689ab88984658d73bbc928b2ed06c676d14a/qa suite_relpath: qa suite_repo: https://github.com/batrick/ceph.git suite_sha1: e797689ab88984658d73bbc928b2ed06c676d14a syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi149.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi160.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - exec: mon.a: - ceph config set mgr mgr/crash/warn_recent_interval 0 - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_snapshots teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 6899cd26fceddb2fec83dc1a1349394b28c8998e timestamp: 2023-11-08_19:01:12 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3590714 2023-11-08T19:10:28.979 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_batrick_ceph_e797689ab88984658d73bbc928b2ed06c676d14a/qa; will attempt to use it 2023-11-08T19:10:28.980 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_batrick_ceph_e797689ab88984658d73bbc928b2ed06c676d14a/qa/tasks 2023-11-08T19:10:28.980 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-11-08T19:10:28.982 INFO:teuthology.task.internal:Checking packages... 2023-11-08T19:10:29.006 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4' 2023-11-08T19:10:29.007 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-11-08T19:10:29.007 INFO:teuthology.packaging:ref: None 2023-11-08T19:10:29.008 INFO:teuthology.packaging:tag: None 2023-11-08T19:10:29.008 INFO:teuthology.packaging:branch: main 2023-11-08T19:10:29.008 INFO:teuthology.packaging:sha1: 7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4 2023-11-08T19:10:29.009 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=main 2023-11-08T19:10:29.439 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-7224.g8858839c 2023-11-08T19:10:29.440 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-11-08T19:10:29.447 INFO:teuthology.task.internal:no buildpackages task found 2023-11-08T19:10:29.447 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-11-08T19:10:29.523 INFO:teuthology.task.internal:Saving configuration 2023-11-08T19:10:29.540 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-11-08T19:10:29.548 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-08T19:10:29.575 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi149.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-11-08_19:01:12-fs:functional-main-distro-default-smithi/7452102', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-08 19:05:12.021944', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-11-08T19:10:29.600 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi160.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-11-08_19:01:12-fs:functional-main-distro-default-smithi/7452102', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-08 19:05:12.023391', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-11-08T19:10:29.601 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-11-08T19:10:29.607 INFO:teuthology.task.internal:roles: ubuntu@smithi149.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-11-08T19:10:29.607 INFO:teuthology.task.internal:roles: ubuntu@smithi160.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-11-08T19:10:29.608 INFO:teuthology.run_tasks:Running task console_log... 2023-11-08T19:10:29.680 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd5568a9b80>, signals=[15]) 2023-11-08T19:10:29.681 INFO:teuthology.run_tasks:Running task internal.connect... 2023-11-08T19:10:29.688 INFO:teuthology.task.internal:Opening connections... 2023-11-08T19:10:29.688 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi149.front.sepia.ceph.com 2023-11-08T19:10:29.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T19:10:29.763 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi160.front.sepia.ceph.com 2023-11-08T19:10:29.764 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T19:10:29.835 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-11-08T19:10:29.842 DEBUG:teuthology.orchestra.run.smithi149:> uname -m 2023-11-08T19:10:29.863 INFO:teuthology.orchestra.run.smithi149.stdout:x86_64 2023-11-08T19:10:29.863 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release 2023-11-08T19:10:29.922 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="Red Hat Enterprise Linux" 2023-11-08T19:10:29.922 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="8.6 (Ootpa)" 2023-11-08T19:10:29.922 INFO:teuthology.orchestra.run.smithi149.stdout:ID="rhel" 2023-11-08T19:10:29.922 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE="fedora" 2023-11-08T19:10:29.923 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="8.6" 2023-11-08T19:10:29.923 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM_ID="platform:el8" 2023-11-08T19:10:29.923 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-08T19:10:29.923 INFO:teuthology.orchestra.run.smithi149.stdout:ANSI_COLOR="0;31" 2023-11-08T19:10:29.923 INFO:teuthology.orchestra.run.smithi149.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-08T19:10:29.924 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://www.redhat.com/" 2023-11-08T19:10:29.924 INFO:teuthology.orchestra.run.smithi149.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-08T19:10:29.924 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-08T19:10:29.924 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:10:29.924 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-08T19:10:29.925 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-08T19:10:29.925 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-08T19:10:29.925 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-08T19:10:29.926 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2023-11-08T19:10:29.952 DEBUG:teuthology.orchestra.run.smithi160:> uname -m 2023-11-08T19:10:29.972 INFO:teuthology.orchestra.run.smithi160.stdout:x86_64 2023-11-08T19:10:29.973 DEBUG:teuthology.orchestra.run.smithi160:> cat /etc/os-release 2023-11-08T19:10:30.034 INFO:teuthology.orchestra.run.smithi160.stdout:NAME="Red Hat Enterprise Linux" 2023-11-08T19:10:30.034 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION="8.6 (Ootpa)" 2023-11-08T19:10:30.034 INFO:teuthology.orchestra.run.smithi160.stdout:ID="rhel" 2023-11-08T19:10:30.035 INFO:teuthology.orchestra.run.smithi160.stdout:ID_LIKE="fedora" 2023-11-08T19:10:30.035 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_ID="8.6" 2023-11-08T19:10:30.035 INFO:teuthology.orchestra.run.smithi160.stdout:PLATFORM_ID="platform:el8" 2023-11-08T19:10:30.035 INFO:teuthology.orchestra.run.smithi160.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-08T19:10:30.035 INFO:teuthology.orchestra.run.smithi160.stdout:ANSI_COLOR="0;31" 2023-11-08T19:10:30.036 INFO:teuthology.orchestra.run.smithi160.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-08T19:10:30.036 INFO:teuthology.orchestra.run.smithi160.stdout:HOME_URL="https://www.redhat.com/" 2023-11-08T19:10:30.036 INFO:teuthology.orchestra.run.smithi160.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-08T19:10:30.036 INFO:teuthology.orchestra.run.smithi160.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-08T19:10:30.036 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:10:30.037 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-08T19:10:30.037 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-08T19:10:30.037 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-08T19:10:30.037 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-08T19:10:30.038 INFO:teuthology.lock.ops:Updating smithi160.front.sepia.ceph.com on lock server 2023-11-08T19:10:30.060 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-11-08T19:10:30.070 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-11-08T19:10:30.076 INFO:teuthology.task.internal:Checking for old test directory... 2023-11-08T19:10:30.077 DEBUG:teuthology.orchestra.run.smithi149:> test '!' -e /home/ubuntu/cephtest 2023-11-08T19:10:30.080 DEBUG:teuthology.orchestra.run.smithi160:> test '!' -e /home/ubuntu/cephtest 2023-11-08T19:10:30.100 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-11-08T19:10:30.107 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-11-08T19:10:30.107 DEBUG:teuthology.orchestra.run.smithi149:> test -z $(ls -A /var/lib/ceph) 2023-11-08T19:10:30.144 DEBUG:teuthology.orchestra.run.smithi160:> test -z $(ls -A /var/lib/ceph) 2023-11-08T19:10:30.179 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-11-08T19:10:30.234 INFO:teuthology.run_tasks:Running task kernel... 2023-11-08T19:10:30.249 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2023-11-08T19:10:30.250 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2023-11-08T19:10:30.251 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2023-11-08T19:10:30.251 DEBUG:teuthology.orchestra.run.smithi149:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-08T19:10:30.252 DEBUG:teuthology.orchestra.run.smithi160:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-08T19:10:30.270 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-08T19:10:30.271 DEBUG:teuthology.orchestra.run.smithi160:> uname -r 2023-11-08T19:10:30.271 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-08T19:10:30.272 DEBUG:teuthology.orchestra.run.smithi149:> uname -r 2023-11-08T19:10:30.331 INFO:teuthology.orchestra.run.smithi149.stdout:4.18.0-372.9.1.el8.x86_64 2023-11-08T19:10:30.331 INFO:teuthology.task.kernel:Running kernel on smithi149: 4.18.0-372.9.1.el8.x86_64 2023-11-08T19:10:30.332 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum install -y kernel 2023-11-08T19:10:30.333 INFO:teuthology.orchestra.run.smithi160.stdout:4.18.0-372.9.1.el8.x86_64 2023-11-08T19:10:30.333 INFO:teuthology.task.kernel:Running kernel on smithi160: 4.18.0-372.9.1.el8.x86_64 2023-11-08T19:10:30.333 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum install -y kernel 2023-11-08T19:10:31.539 INFO:teuthology.orchestra.run.smithi160.stdout:Updating Subscription Management repositories. 2023-11-08T19:10:31.540 INFO:teuthology.orchestra.run.smithi160.stdout:Unable to read consumer identity 2023-11-08T19:10:31.563 INFO:teuthology.orchestra.run.smithi149.stdout:Updating Subscription Management repositories. 2023-11-08T19:10:31.564 INFO:teuthology.orchestra.run.smithi149.stdout:Unable to read consumer identity 2023-11-08T19:10:32.963 INFO:teuthology.orchestra.run.smithi160.stdout:Copr repo for python3-asyncssh owned by ceph 25 kB/s | 3.5 kB 00:00 2023-11-08T19:10:33.017 INFO:teuthology.orchestra.run.smithi149.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2023-11-08T19:10:33.993 INFO:teuthology.orchestra.run.smithi149.stdout:Extra Packages for Enterprise Linux 17 MB/s | 16 MB 00:00 2023-11-08T19:10:34.063 INFO:teuthology.orchestra.run.smithi160.stdout:Extra Packages for Enterprise Linux 15 MB/s | 16 MB 00:01 2023-11-08T19:10:37.493 INFO:teuthology.orchestra.run.smithi149.stdout:lab-extras 328 kB/s | 24 kB 00:00 2023-11-08T19:10:37.580 INFO:teuthology.orchestra.run.smithi160.stdout:lab-extras 397 kB/s | 24 kB 00:00 2023-11-08T19:10:38.229 INFO:teuthology.orchestra.run.smithi149.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-11-08T19:10:38.278 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2023-11-08T19:10:38.279 INFO:teuthology.orchestra.run.smithi149.stdout:Nothing to do. 2023-11-08T19:10:38.279 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2023-11-08T19:10:38.316 INFO:teuthology.orchestra.run.smithi160.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-11-08T19:10:38.371 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2023-11-08T19:10:38.372 INFO:teuthology.orchestra.run.smithi160.stdout:Nothing to do. 2023-11-08T19:10:38.372 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2023-11-08T19:10:38.415 DEBUG:teuthology.orchestra.run.smithi149:> echo no | sudo yum reinstall kernel || true 2023-11-08T19:10:38.486 DEBUG:teuthology.orchestra.run.smithi160:> echo no | sudo yum reinstall kernel || true 2023-11-08T19:10:38.745 INFO:teuthology.orchestra.run.smithi149.stdout:Updating Subscription Management repositories. 2023-11-08T19:10:38.746 INFO:teuthology.orchestra.run.smithi149.stdout:Unable to read consumer identity 2023-11-08T19:10:38.819 INFO:teuthology.orchestra.run.smithi160.stdout:Updating Subscription Management repositories. 2023-11-08T19:10:38.819 INFO:teuthology.orchestra.run.smithi160.stdout:Unable to read consumer identity 2023-11-08T19:10:39.022 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:00:02 ago on Wed 08 Nov 2023 07:10:37 PM UTC. 2023-11-08T19:10:39.063 INFO:teuthology.orchestra.run.smithi149.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-11-08T19:10:39.087 INFO:teuthology.orchestra.run.smithi160.stdout:Last metadata expiration check: 0:00:02 ago on Wed 08 Nov 2023 07:10:37 PM UTC. 2023-11-08T19:10:39.123 INFO:teuthology.orchestra.run.smithi149.stderr:Error: No packages marked for reinstall. 2023-11-08T19:10:39.128 INFO:teuthology.orchestra.run.smithi160.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-11-08T19:10:39.171 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum reinstall -y kernel || true 2023-11-08T19:10:39.172 INFO:teuthology.orchestra.run.smithi160.stderr:Error: No packages marked for reinstall. 2023-11-08T19:10:39.218 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum reinstall -y kernel || true 2023-11-08T19:10:39.502 INFO:teuthology.orchestra.run.smithi149.stdout:Updating Subscription Management repositories. 2023-11-08T19:10:39.502 INFO:teuthology.orchestra.run.smithi149.stdout:Unable to read consumer identity 2023-11-08T19:10:39.548 INFO:teuthology.orchestra.run.smithi160.stdout:Updating Subscription Management repositories. 2023-11-08T19:10:39.549 INFO:teuthology.orchestra.run.smithi160.stdout:Unable to read consumer identity 2023-11-08T19:10:39.770 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:00:02 ago on Wed 08 Nov 2023 07:10:37 PM UTC. 2023-11-08T19:10:39.810 INFO:teuthology.orchestra.run.smithi149.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-11-08T19:10:39.812 INFO:teuthology.orchestra.run.smithi160.stdout:Last metadata expiration check: 0:00:02 ago on Wed 08 Nov 2023 07:10:37 PM UTC. 2023-11-08T19:10:39.853 INFO:teuthology.orchestra.run.smithi160.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-11-08T19:10:39.863 INFO:teuthology.orchestra.run.smithi149.stderr:Error: No packages marked for reinstall. 2023-11-08T19:10:39.876 INFO:teuthology.orchestra.run.smithi160.stderr:Error: No packages marked for reinstall. 2023-11-08T19:10:39.915 DEBUG:teuthology.orchestra.run.smithi149:> rpm -q kernel | sort -rV | head -n 1 2023-11-08T19:10:39.927 DEBUG:teuthology.orchestra.run.smithi160:> rpm -q kernel | sort -rV | head -n 1 2023-11-08T19:10:39.997 INFO:teuthology.orchestra.run.smithi149.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-11-08T19:10:39.998 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-11-08T19:10:39.998 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-11-08T19:10:39.998 DEBUG:teuthology.parallel:result is None 2023-11-08T19:10:40.009 INFO:teuthology.orchestra.run.smithi160.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-11-08T19:10:40.009 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-11-08T19:10:40.010 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-11-08T19:10:40.010 DEBUG:teuthology.parallel:result is None 2023-11-08T19:10:40.010 INFO:teuthology.run_tasks:Running task internal.base... 2023-11-08T19:10:40.020 INFO:teuthology.task.internal:Creating test directory... 2023-11-08T19:10:40.020 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-08T19:10:40.023 DEBUG:teuthology.orchestra.run.smithi160:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-08T19:10:40.039 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-11-08T19:10:40.046 INFO:teuthology.run_tasks:Running task internal.archive... 2023-11-08T19:10:40.053 INFO:teuthology.task.internal:Creating archive directory... 2023-11-08T19:10:40.053 DEBUG:teuthology.orchestra.run.smithi149:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-08T19:10:40.080 DEBUG:teuthology.orchestra.run.smithi160:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-08T19:10:40.111 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-11-08T19:10:40.118 INFO:teuthology.task.internal:Enabling coredump saving... 2023-11-08T19:10:40.118 DEBUG:teuthology.orchestra.run.smithi149:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-08T19:10:40.138 DEBUG:teuthology.orchestra.run.smithi160:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-08T19:10:40.180 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-08T19:10:40.181 INFO:teuthology.orchestra.run.smithi160.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-08T19:10:40.193 INFO:teuthology.orchestra.run.smithi160.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-08T19:10:40.197 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-08T19:10:40.199 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-11-08T19:10:40.206 INFO:teuthology.task.internal:Configuring sudo... 2023-11-08T19:10:40.207 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-08T19:10:40.241 DEBUG:teuthology.orchestra.run.smithi160:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-08T19:10:40.268 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-11-08T19:10:40.277 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-11-08T19:10:40.278 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-08T19:10:40.308 DEBUG:teuthology.orchestra.run.smithi160:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-08T19:10:40.326 DEBUG:teuthology.orchestra.run.smithi149:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-08T19:10:40.405 DEBUG:teuthology.orchestra.run.smithi149:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-08T19:10:40.458 DEBUG:teuthology.orchestra.run.smithi149:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-08T19:10:40.538 DEBUG:teuthology.orchestra.run.smithi149:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-08T19:10:40.582 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-11-08T19:10:40.583 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-08T19:10:40.651 DEBUG:teuthology.orchestra.run.smithi160:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-08T19:10:40.695 DEBUG:teuthology.orchestra.run.smithi160:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-08T19:10:40.748 DEBUG:teuthology.orchestra.run.smithi160:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-08T19:10:40.832 DEBUG:teuthology.orchestra.run.smithi160:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-08T19:10:40.875 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-11-08T19:10:40.875 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-08T19:10:40.943 DEBUG:teuthology.orchestra.run.smithi149:> sudo service rsyslog restart 2023-11-08T19:10:40.945 DEBUG:teuthology.orchestra.run.smithi160:> sudo service rsyslog restart 2023-11-08T19:10:41.007 INFO:teuthology.orchestra.run.smithi149.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-08T19:10:41.041 INFO:teuthology.orchestra.run.smithi160.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-08T19:10:41.297 INFO:teuthology.run_tasks:Running task internal.timer... 2023-11-08T19:10:41.308 INFO:teuthology.task.internal:Starting timer... 2023-11-08T19:10:41.309 INFO:teuthology.run_tasks:Running task pcp... 2023-11-08T19:10:41.333 INFO:teuthology.run_tasks:Running task selinux... 2023-11-08T19:10:41.342 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-11-08T19:10:41.343 DEBUG:teuthology.orchestra.run.smithi149:> sudo service auditd rotate 2023-11-08T19:10:41.403 INFO:teuthology.orchestra.run.smithi149.stdout:Rotating logs: 2023-11-08T19:10:41.404 DEBUG:teuthology.orchestra.run.smithi160:> sudo service auditd rotate 2023-11-08T19:10:41.469 INFO:teuthology.orchestra.run.smithi160.stdout:Rotating logs: 2023-11-08T19:10:41.471 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-11-08T19:10:41.471 DEBUG:teuthology.orchestra.run.smithi149:> /usr/sbin/getenforce 2023-11-08T19:10:41.492 INFO:teuthology.orchestra.run.smithi149.stdout:Permissive 2023-11-08T19:10:41.493 DEBUG:teuthology.orchestra.run.smithi160:> /usr/sbin/getenforce 2023-11-08T19:10:41.514 INFO:teuthology.orchestra.run.smithi160.stdout:Permissive 2023-11-08T19:10:41.515 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi149.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi160.front.sepia.ceph.com': 'permissive'} 2023-11-08T19:10:41.515 DEBUG:teuthology.orchestra.run.smithi149:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-08T19:10:41.559 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-08T19:10:41.561 DEBUG:teuthology.orchestra.run.smithi160:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-08T19:10:41.589 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-08T19:10:41.589 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-11-08T19:10:41.590 DEBUG:teuthology.orchestra.run.smithi149:> sudo /usr/sbin/setenforce permissive 2023-11-08T19:10:41.627 DEBUG:teuthology.orchestra.run.smithi160:> sudo /usr/sbin/setenforce permissive 2023-11-08T19:10:41.660 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-11-08T19:10:41.673 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-11-08T19:10:41.674 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-11-08T19:10:41.692 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-11-08T19:10:41.694 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi149.front.sepia.ceph.com,smithi160.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-11-08T19:19:50.246 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi149.front.sepia.ceph.com'), Remote(name='ubuntu@smithi160.front.sepia.ceph.com')] 2023-11-08T19:19:50.248 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2023-11-08T19:19:50.249 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T19:19:50.319 DEBUG:teuthology.orchestra.run.smithi149:> true 2023-11-08T19:19:50.344 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi149.front.sepia.ceph.com' 2023-11-08T19:19:50.345 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com' 2023-11-08T19:19:50.346 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T19:19:50.413 DEBUG:teuthology.orchestra.run.smithi160:> true 2023-11-08T19:19:50.479 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi160.front.sepia.ceph.com' 2023-11-08T19:19:50.479 INFO:teuthology.run_tasks:Running task clock... 2023-11-08T19:19:50.492 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-11-08T19:19:50.493 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-08T19:19:50.493 DEBUG:teuthology.orchestra.run.smithi149:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-08T19:19:50.496 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-08T19:19:50.496 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-08T19:19:50.526 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-08T19:19:50.541 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-08T19:19:50.550 INFO:teuthology.orchestra.run.smithi160.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-08T19:19:50.564 INFO:teuthology.orchestra.run.smithi160.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-08T19:19:50.608 INFO:teuthology.orchestra.run.smithi149.stderr:sudo: ntpd: command not found 2023-11-08T19:19:50.620 INFO:teuthology.orchestra.run.smithi149.stdout:506 Cannot talk to daemon 2023-11-08T19:19:50.634 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-08T19:19:50.642 INFO:teuthology.orchestra.run.smithi160.stderr:sudo: ntpd: command not found 2023-11-08T19:19:50.649 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-08T19:19:50.653 INFO:teuthology.orchestra.run.smithi160.stdout:506 Cannot talk to daemon 2023-11-08T19:19:50.668 INFO:teuthology.orchestra.run.smithi160.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-08T19:19:50.681 INFO:teuthology.orchestra.run.smithi160.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-08T19:19:50.724 INFO:teuthology.orchestra.run.smithi149.stderr:bash: ntpq: command not found 2023-11-08T19:19:50.728 INFO:teuthology.orchestra.run.smithi149.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-08T19:19:50.728 INFO:teuthology.orchestra.run.smithi149.stdout:=============================================================================== 2023-11-08T19:19:50.728 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-08T19:19:50.728 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-08T19:19:50.729 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-08T19:19:50.729 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-08T19:19:50.753 INFO:teuthology.orchestra.run.smithi160.stderr:bash: ntpq: command not found 2023-11-08T19:19:50.756 INFO:teuthology.orchestra.run.smithi160.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-08T19:19:50.756 INFO:teuthology.orchestra.run.smithi160.stdout:=============================================================================== 2023-11-08T19:19:50.756 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-08T19:19:50.757 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-08T19:19:50.757 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-08T19:19:50.757 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-08T19:19:50.758 INFO:teuthology.run_tasks:Running task install... 2023-11-08T19:19:50.768 DEBUG:teuthology.task.install:project ceph 2023-11-08T19:19:50.768 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4'}} 2023-11-08T19:19:50.768 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4'} 2023-11-08T19:19:50.769 INFO:teuthology.task.install:Using flavor: default 2023-11-08T19:19:50.774 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-11-08T19:19:50.775 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-11-08T19:19:50.775 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4', 'tag': None, 'wait_for_package': False} 2023-11-08T19:19:50.776 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4 2023-11-08T19:19:50.778 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4', 'tag': None, 'wait_for_package': False} 2023-11-08T19:19:50.778 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4 2023-11-08T19:19:50.923 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/centos/8/flavors/default/ 2023-11-08T19:19:50.923 INFO:teuthology.task.install.rpm:Package version is 18.0.0-7035.g7532011a 2023-11-08T19:19:50.928 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/centos/8/flavors/default/ 2023-11-08T19:19:50.929 INFO:teuthology.task.install.rpm:Package version is 18.0.0-7035.g7532011a 2023-11-08T19:19:51.039 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-08T19:19:51.039 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-11-08T19:19:51.039 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-08T19:19:51.067 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-11-08T19:19:51.068 DEBUG:teuthology.orchestra.run.smithi160:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-08T19:19:51.134 DEBUG:teuthology.orchestra.run.smithi160:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-08T19:19:51.152 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-08T19:19:51.153 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-11-08T19:19:51.153 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-08T19:19:51.181 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-11-08T19:19:51.182 DEBUG:teuthology.orchestra.run.smithi149:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-08T19:19:51.210 DEBUG:teuthology.orchestra.run.smithi160:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-08T19:19:51.250 DEBUG:teuthology.orchestra.run.smithi149:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-08T19:19:51.277 INFO:teuthology.orchestra.run.smithi160.stdout:check_obsoletes = 1 2023-11-08T19:19:51.278 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum clean all 2023-11-08T19:19:51.327 DEBUG:teuthology.orchestra.run.smithi149:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-08T19:19:51.392 INFO:teuthology.orchestra.run.smithi149.stdout:check_obsoletes = 1 2023-11-08T19:19:51.394 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum clean all 2023-11-08T19:19:51.650 INFO:teuthology.orchestra.run.smithi160.stdout:Updating Subscription Management repositories. 2023-11-08T19:19:51.767 INFO:teuthology.orchestra.run.smithi149.stdout:Updating Subscription Management repositories. 2023-11-08T19:19:51.958 INFO:teuthology.orchestra.run.smithi160.stdout:44 files removed 2023-11-08T19:19:52.004 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-11-08T19:19:52.076 INFO:teuthology.orchestra.run.smithi149.stdout:44 files removed 2023-11-08T19:19:52.125 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-11-08T19:19:52.335 INFO:teuthology.orchestra.run.smithi160.stdout:Updating Subscription Management repositories. 2023-11-08T19:19:52.455 INFO:teuthology.orchestra.run.smithi149.stdout:Updating Subscription Management repositories. 2023-11-08T19:19:53.165 INFO:teuthology.orchestra.run.smithi160.stdout:ceph packages for x86_64 185 kB/s | 81 kB 00:00 2023-11-08T19:19:53.232 INFO:teuthology.orchestra.run.smithi149.stdout:ceph packages for x86_64 223 kB/s | 81 kB 00:00 2023-11-08T19:19:53.549 INFO:teuthology.orchestra.run.smithi160.stdout:ceph noarch packages 27 kB/s | 9.4 kB 00:00 2023-11-08T19:19:53.724 INFO:teuthology.orchestra.run.smithi149.stdout:ceph noarch packages 20 kB/s | 9.4 kB 00:00 2023-11-08T19:19:53.958 INFO:teuthology.orchestra.run.smithi160.stdout:ceph source packages 3.9 kB/s | 1.5 kB 00:00 2023-11-08T19:19:54.134 INFO:teuthology.orchestra.run.smithi160.stdout:Copr repo for python3-asyncssh owned by ceph 22 kB/s | 3.5 kB 00:00 2023-11-08T19:19:54.258 INFO:teuthology.orchestra.run.smithi149.stdout:ceph source packages 2.9 kB/s | 1.5 kB 00:00 2023-11-08T19:19:54.426 INFO:teuthology.orchestra.run.smithi149.stdout:Copr repo for python3-asyncssh owned by ceph 24 kB/s | 3.5 kB 00:00 2023-11-08T19:19:55.085 INFO:teuthology.orchestra.run.smithi149.stdout:Extra Packages for Enterprise Linux 25 MB/s | 16 MB 00:00 2023-11-08T19:19:58.601 INFO:teuthology.orchestra.run.smithi149.stdout:lab-extras 386 kB/s | 24 kB 00:00 2023-11-08T19:19:58.770 INFO:teuthology.orchestra.run.smithi160.stdout:Extra Packages for Enterprise Linux 3.5 MB/s | 16 MB 00:04 2023-11-08T19:19:59.578 INFO:teuthology.orchestra.run.smithi149.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 59 MB/s | 53 MB 00:00 2023-11-08T19:20:02.321 INFO:teuthology.orchestra.run.smithi160.stdout:lab-extras 285 kB/s | 24 kB 00:00 2023-11-08T19:20:03.244 INFO:teuthology.orchestra.run.smithi160.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 62 MB/s | 53 MB 00:00 2023-11-08T19:20:07.858 INFO:teuthology.orchestra.run.smithi149.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 53 MB/s | 47 MB 00:00 2023-11-08T19:20:11.295 INFO:teuthology.orchestra.run.smithi160.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 62 MB/s | 47 MB 00:00 2023-11-08T19:20:18.760 INFO:teuthology.orchestra.run.smithi149.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-11-08T19:20:18.761 INFO:teuthology.orchestra.run.smithi149.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-11-08T19:20:18.775 INFO:teuthology.orchestra.run.smithi149.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-11-08T19:20:18.776 INFO:teuthology.orchestra.run.smithi149.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-11-08T19:20:18.777 INFO:teuthology.orchestra.run.smithi149.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-11-08T19:20:18.778 INFO:teuthology.orchestra.run.smithi149.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-11-08T19:20:18.780 INFO:teuthology.orchestra.run.smithi149.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-11-08T19:20:18.783 INFO:teuthology.orchestra.run.smithi149.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-11-08T19:20:18.784 INFO:teuthology.orchestra.run.smithi149.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-11-08T19:20:18.919 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2023-11-08T19:20:18.932 INFO:teuthology.orchestra.run.smithi149.stdout:=========================================================================================================================== 2023-11-08T19:20:18.933 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2023-11-08T19:20:18.933 INFO:teuthology.orchestra.run.smithi149.stdout:=========================================================================================================================== 2023-11-08T19:20:18.933 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2023-11-08T19:20:18.933 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-11-08T19:20:18.934 INFO:teuthology.orchestra.run.smithi149.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-11-08T19:20:18.934 INFO:teuthology.orchestra.run.smithi149.stdout: ceph x86_64 2:18.0.0-7035.g7532011a.el8 ceph 6.4 k 2023-11-08T19:20:18.934 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-base x86_64 2:18.0.0-7035.g7532011a.el8 ceph 5.4 M 2023-11-08T19:20:18.934 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-fuse x86_64 2:18.0.0-7035.g7532011a.el8 ceph 919 k 2023-11-08T19:20:18.934 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-7035.g7532011a.el8 ceph 171 k 2023-11-08T19:20:18.935 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr x86_64 2:18.0.0-7035.g7532011a.el8 ceph 1.6 M 2023-11-08T19:20:18.935 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-cephadm noarch 2:18.0.0-7035.g7532011a.el8 ceph-noarch 132 k 2023-11-08T19:20:18.935 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-dashboard noarch 2:18.0.0-7035.g7532011a.el8 ceph-noarch 1.8 M 2023-11-08T19:20:18.935 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-7035.g7532011a.el8 ceph-noarch 7.4 M 2023-11-08T19:20:18.935 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-rook noarch 2:18.0.0-7035.g7532011a.el8 ceph-noarch 48 k 2023-11-08T19:20:18.936 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-radosgw x86_64 2:18.0.0-7035.g7532011a.el8 ceph 14 M 2023-11-08T19:20:18.936 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-test x86_64 2:18.0.0-7035.g7532011a.el8 ceph 49 M 2023-11-08T19:20:18.936 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-volume noarch 2:18.0.0-7035.g7532011a.el8 ceph-noarch 261 k 2023-11-08T19:20:18.936 INFO:teuthology.orchestra.run.smithi149.stdout: cephadm noarch 2:18.0.0-7035.g7532011a.el8 ceph-noarch 191 k 2023-11-08T19:20:18.937 INFO:teuthology.orchestra.run.smithi149.stdout: cephfs-mirror x86_64 2:18.0.0-7035.g7532011a.el8 ceph 262 k 2023-11-08T19:20:18.937 INFO:teuthology.orchestra.run.smithi149.stdout: cephfs-top noarch 2:18.0.0-7035.g7532011a.el8 ceph-noarch 18 k 2023-11-08T19:20:18.937 INFO:teuthology.orchestra.run.smithi149.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-11-08T19:20:18.937 INFO:teuthology.orchestra.run.smithi149.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-11-08T19:20:18.937 INFO:teuthology.orchestra.run.smithi149.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-11-08T19:20:18.938 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs-devel x86_64 2:18.0.0-7035.g7532011a.el8 ceph 31 k 2023-11-08T19:20:18.938 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs2 x86_64 2:18.0.0-7035.g7532011a.el8 ceph 838 k 2023-11-08T19:20:18.938 INFO:teuthology.orchestra.run.smithi149.stdout: librados-devel x86_64 2:18.0.0-7035.g7532011a.el8 ceph 139 k 2023-11-08T19:20:18.938 INFO:teuthology.orchestra.run.smithi149.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-11-08T19:20:18.939 INFO:teuthology.orchestra.run.smithi149.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-11-08T19:20:18.939 INFO:teuthology.orchestra.run.smithi149.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-11-08T19:20:18.939 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-11-08T19:20:18.939 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-11-08T19:20:18.940 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-11-08T19:20:18.940 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cephfs x86_64 2:18.0.0-7035.g7532011a.el8 ceph 197 k 2023-11-08T19:20:18.940 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rados x86_64 2:18.0.0-7035.g7532011a.el8 ceph 371 k 2023-11-08T19:20:18.940 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rbd x86_64 2:18.0.0-7035.g7532011a.el8 ceph 364 k 2023-11-08T19:20:18.941 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rgw x86_64 2:18.0.0-7035.g7532011a.el8 ceph 107 k 2023-11-08T19:20:18.941 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-fuse x86_64 2:18.0.0-7035.g7532011a.el8 ceph 94 k 2023-11-08T19:20:18.941 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-mirror x86_64 2:18.0.0-7035.g7532011a.el8 ceph 3.6 M 2023-11-08T19:20:18.941 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-nbd x86_64 2:18.0.0-7035.g7532011a.el8 ceph 181 k 2023-11-08T19:20:18.942 INFO:teuthology.orchestra.run.smithi149.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-11-08T19:20:18.942 INFO:teuthology.orchestra.run.smithi149.stdout:Upgrading: 2023-11-08T19:20:18.942 INFO:teuthology.orchestra.run.smithi149.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-11-08T19:20:18.942 INFO:teuthology.orchestra.run.smithi149.stdout: librados2 x86_64 2:18.0.0-7035.g7532011a.el8 ceph 3.8 M 2023-11-08T19:20:18.943 INFO:teuthology.orchestra.run.smithi149.stdout: librbd1 x86_64 2:18.0.0-7035.g7532011a.el8 ceph 3.7 M 2023-11-08T19:20:18.943 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2023-11-08T19:20:18.943 INFO:teuthology.orchestra.run.smithi149.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-11-08T19:20:18.943 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-common x86_64 2:18.0.0-7035.g7532011a.el8 ceph 23 M 2023-11-08T19:20:18.943 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-grafana-dashboards noarch 2:18.0.0-7035.g7532011a.el8 ceph-noarch 23 k 2023-11-08T19:20:18.944 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mds x86_64 2:18.0.0-7035.g7532011a.el8 ceph 2.3 M 2023-11-08T19:20:18.944 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-modules-core noarch 2:18.0.0-7035.g7532011a.el8 ceph-noarch 242 k 2023-11-08T19:20:18.944 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mon x86_64 2:18.0.0-7035.g7532011a.el8 ceph 4.6 M 2023-11-08T19:20:18.944 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-osd x86_64 2:18.0.0-7035.g7532011a.el8 ceph 18 M 2023-11-08T19:20:18.945 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-prometheus-alerts noarch 2:18.0.0-7035.g7532011a.el8 ceph-noarch 15 k 2023-11-08T19:20:18.945 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-selinux x86_64 2:18.0.0-7035.g7532011a.el8 ceph 24 k 2023-11-08T19:20:18.945 INFO:teuthology.orchestra.run.smithi149.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-11-08T19:20:18.945 INFO:teuthology.orchestra.run.smithi149.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-11-08T19:20:18.945 INFO:teuthology.orchestra.run.smithi149.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-11-08T19:20:18.946 INFO:teuthology.orchestra.run.smithi149.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-11-08T19:20:18.946 INFO:teuthology.orchestra.run.smithi149.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-11-08T19:20:18.946 INFO:teuthology.orchestra.run.smithi149.stdout: libcephsqlite x86_64 2:18.0.0-7035.g7532011a.el8 ceph 182 k 2023-11-08T19:20:18.946 INFO:teuthology.orchestra.run.smithi149.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-11-08T19:20:18.946 INFO:teuthology.orchestra.run.smithi149.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-11-08T19:20:18.947 INFO:teuthology.orchestra.run.smithi149.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-11-08T19:20:18.947 INFO:teuthology.orchestra.run.smithi149.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-11-08T19:20:18.947 INFO:teuthology.orchestra.run.smithi149.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-11-08T19:20:18.948 INFO:teuthology.orchestra.run.smithi149.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-11-08T19:20:18.948 INFO:teuthology.orchestra.run.smithi149.stdout: libradosstriper1 x86_64 2:18.0.0-7035.g7532011a.el8 ceph 518 k 2023-11-08T19:20:18.948 INFO:teuthology.orchestra.run.smithi149.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-11-08T19:20:18.949 INFO:teuthology.orchestra.run.smithi149.stdout: librgw2 x86_64 2:18.0.0-7035.g7532011a.el8 ceph 6.9 M 2023-11-08T19:20:18.949 INFO:teuthology.orchestra.run.smithi149.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-11-08T19:20:18.950 INFO:teuthology.orchestra.run.smithi149.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-11-08T19:20:18.950 INFO:teuthology.orchestra.run.smithi149.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-11-08T19:20:18.950 INFO:teuthology.orchestra.run.smithi149.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-11-08T19:20:18.951 INFO:teuthology.orchestra.run.smithi149.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-11-08T19:20:18.951 INFO:teuthology.orchestra.run.smithi149.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-11-08T19:20:18.951 INFO:teuthology.orchestra.run.smithi149.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-11-08T19:20:18.951 INFO:teuthology.orchestra.run.smithi149.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-11-08T19:20:18.952 INFO:teuthology.orchestra.run.smithi149.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-11-08T19:20:18.952 INFO:teuthology.orchestra.run.smithi149.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-11-08T19:20:18.952 INFO:teuthology.orchestra.run.smithi149.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-11-08T19:20:18.953 INFO:teuthology.orchestra.run.smithi149.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-11-08T19:20:18.953 INFO:teuthology.orchestra.run.smithi149.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-11-08T19:20:18.953 INFO:teuthology.orchestra.run.smithi149.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-11-08T19:20:18.954 INFO:teuthology.orchestra.run.smithi149.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-11-08T19:20:18.954 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-11-08T19:20:18.954 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-argparse x86_64 2:18.0.0-7035.g7532011a.el8 ceph 45 k 2023-11-08T19:20:18.954 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-common x86_64 2:18.0.0-7035.g7532011a.el8 ceph 126 k 2023-11-08T19:20:18.955 INFO:teuthology.orchestra.run.smithi149.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-11-08T19:20:18.955 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-11-08T19:20:18.955 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-11-08T19:20:18.955 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-11-08T19:20:18.956 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-11-08T19:20:18.956 INFO:teuthology.orchestra.run.smithi149.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-11-08T19:20:18.957 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-11-08T19:20:18.957 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-11-08T19:20:18.957 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-11-08T19:20:18.957 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-11-08T19:20:18.958 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-11-08T19:20:18.958 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-11-08T19:20:18.959 INFO:teuthology.orchestra.run.smithi149.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-11-08T19:20:18.959 INFO:teuthology.orchestra.run.smithi149.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-11-08T19:20:18.959 INFO:teuthology.orchestra.run.smithi149.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-11-08T19:20:18.960 INFO:teuthology.orchestra.run.smithi149.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-11-08T19:20:18.960 INFO:teuthology.orchestra.run.smithi149.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-11-08T19:20:18.960 INFO:teuthology.orchestra.run.smithi149.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-11-08T19:20:18.961 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-11-08T19:20:18.961 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-11-08T19:20:18.961 INFO:teuthology.orchestra.run.smithi149.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-11-08T19:20:18.962 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-11-08T19:20:18.962 INFO:teuthology.orchestra.run.smithi149.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-11-08T19:20:18.962 INFO:teuthology.orchestra.run.smithi149.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-11-08T19:20:18.962 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-11-08T19:20:18.963 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-11-08T19:20:18.963 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-11-08T19:20:18.963 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-11-08T19:20:18.963 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-11-08T19:20:18.963 INFO:teuthology.orchestra.run.smithi149.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-11-08T19:20:18.963 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-11-08T19:20:18.964 INFO:teuthology.orchestra.run.smithi149.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-11-08T19:20:18.964 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-11-08T19:20:18.964 INFO:teuthology.orchestra.run.smithi149.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-11-08T19:20:18.964 INFO:teuthology.orchestra.run.smithi149.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-11-08T19:20:18.964 INFO:teuthology.orchestra.run.smithi149.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-11-08T19:20:18.965 INFO:teuthology.orchestra.run.smithi149.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-11-08T19:20:18.965 INFO:teuthology.orchestra.run.smithi149.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-11-08T19:20:18.965 INFO:teuthology.orchestra.run.smithi149.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-11-08T19:20:18.965 INFO:teuthology.orchestra.run.smithi149.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-11-08T19:20:18.966 INFO:teuthology.orchestra.run.smithi149.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-11-08T19:20:18.966 INFO:teuthology.orchestra.run.smithi149.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-11-08T19:20:18.966 INFO:teuthology.orchestra.run.smithi149.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-11-08T19:20:18.966 INFO:teuthology.orchestra.run.smithi149.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-11-08T19:20:18.966 INFO:teuthology.orchestra.run.smithi149.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-11-08T19:20:18.967 INFO:teuthology.orchestra.run.smithi149.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-11-08T19:20:18.967 INFO:teuthology.orchestra.run.smithi149.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-11-08T19:20:18.967 INFO:teuthology.orchestra.run.smithi149.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-11-08T19:20:18.967 INFO:teuthology.orchestra.run.smithi149.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-11-08T19:20:18.967 INFO:teuthology.orchestra.run.smithi149.stdout:Enabling module streams: 2023-11-08T19:20:18.968 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql 10 2023-11-08T19:20:18.968 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:20:18.968 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2023-11-08T19:20:18.968 INFO:teuthology.orchestra.run.smithi149.stdout:=========================================================================================================================== 2023-11-08T19:20:18.968 INFO:teuthology.orchestra.run.smithi149.stdout:Install 128 Packages 2023-11-08T19:20:18.969 INFO:teuthology.orchestra.run.smithi149.stdout:Upgrade 3 Packages 2023-11-08T19:20:18.969 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:20:18.970 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 209 M 2023-11-08T19:20:18.970 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2023-11-08T19:20:19.396 INFO:teuthology.orchestra.run.smithi149.stdout:(1/131): ceph-18.0.0-7035.g7532011a.el8.x86_64. 31 kB/s | 6.4 kB 00:00 2023-11-08T19:20:19.846 INFO:teuthology.orchestra.run.smithi149.stdout:(2/131): ceph-fuse-18.0.0-7035.g7532011a.el8.x8 2.0 MB/s | 919 kB 00:00 2023-11-08T19:20:19.980 INFO:teuthology.orchestra.run.smithi149.stdout:(3/131): ceph-immutable-object-cache-18.0.0-703 1.3 MB/s | 171 kB 00:00 2023-11-08T19:20:20.172 INFO:teuthology.orchestra.run.smithi149.stdout:(4/131): ceph-base-18.0.0-7035.g7532011a.el8.x8 5.5 MB/s | 5.4 MB 00:00 2023-11-08T19:20:20.247 INFO:teuthology.orchestra.run.smithi149.stdout:(5/131): ceph-mds-18.0.0-7035.g7532011a.el8.x86 8.7 MB/s | 2.3 MB 00:00 2023-11-08T19:20:20.339 INFO:teuthology.orchestra.run.smithi149.stdout:(6/131): ceph-mgr-18.0.0-7035.g7532011a.el8.x86 9.7 MB/s | 1.6 MB 00:00 2023-11-08T19:20:20.764 INFO:teuthology.orchestra.run.smithi149.stdout:(7/131): ceph-mon-18.0.0-7035.g7532011a.el8.x86 9.0 MB/s | 4.6 MB 00:00 2023-11-08T19:20:22.081 INFO:teuthology.orchestra.run.smithi149.stdout:(8/131): ceph-osd-18.0.0-7035.g7532011a.el8.x86 10 MB/s | 18 MB 00:01 2023-11-08T19:20:22.264 INFO:teuthology.orchestra.run.smithi149.stdout:(9/131): ceph-selinux-18.0.0-7035.g7532011a.el8 133 kB/s | 24 kB 00:00 2023-11-08T19:20:22.290 INFO:teuthology.orchestra.run.smithi160.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-11-08T19:20:22.291 INFO:teuthology.orchestra.run.smithi160.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-11-08T19:20:22.306 INFO:teuthology.orchestra.run.smithi160.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-11-08T19:20:22.308 INFO:teuthology.orchestra.run.smithi160.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-11-08T19:20:22.309 INFO:teuthology.orchestra.run.smithi160.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-11-08T19:20:22.310 INFO:teuthology.orchestra.run.smithi160.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-11-08T19:20:22.312 INFO:teuthology.orchestra.run.smithi160.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-11-08T19:20:22.316 INFO:teuthology.orchestra.run.smithi160.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-11-08T19:20:22.317 INFO:teuthology.orchestra.run.smithi160.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-11-08T19:20:22.451 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2023-11-08T19:20:22.463 INFO:teuthology.orchestra.run.smithi160.stdout:=========================================================================================================================== 2023-11-08T19:20:22.463 INFO:teuthology.orchestra.run.smithi160.stdout: Package Arch Version Repository Size 2023-11-08T19:20:22.463 INFO:teuthology.orchestra.run.smithi160.stdout:=========================================================================================================================== 2023-11-08T19:20:22.463 INFO:teuthology.orchestra.run.smithi160.stdout:Installing: 2023-11-08T19:20:22.464 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-11-08T19:20:22.464 INFO:teuthology.orchestra.run.smithi160.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-11-08T19:20:22.464 INFO:teuthology.orchestra.run.smithi160.stdout: ceph x86_64 2:18.0.0-7035.g7532011a.el8 ceph 6.4 k 2023-11-08T19:20:22.464 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-base x86_64 2:18.0.0-7035.g7532011a.el8 ceph 5.4 M 2023-11-08T19:20:22.464 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-fuse x86_64 2:18.0.0-7035.g7532011a.el8 ceph 919 k 2023-11-08T19:20:22.465 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-7035.g7532011a.el8 ceph 171 k 2023-11-08T19:20:22.465 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr x86_64 2:18.0.0-7035.g7532011a.el8 ceph 1.6 M 2023-11-08T19:20:22.465 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-cephadm noarch 2:18.0.0-7035.g7532011a.el8 ceph-noarch 132 k 2023-11-08T19:20:22.465 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-dashboard noarch 2:18.0.0-7035.g7532011a.el8 ceph-noarch 1.8 M 2023-11-08T19:20:22.465 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-7035.g7532011a.el8 ceph-noarch 7.4 M 2023-11-08T19:20:22.466 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-rook noarch 2:18.0.0-7035.g7532011a.el8 ceph-noarch 48 k 2023-11-08T19:20:22.466 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-radosgw x86_64 2:18.0.0-7035.g7532011a.el8 ceph 14 M 2023-11-08T19:20:22.466 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-test x86_64 2:18.0.0-7035.g7532011a.el8 ceph 49 M 2023-11-08T19:20:22.466 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-volume noarch 2:18.0.0-7035.g7532011a.el8 ceph-noarch 261 k 2023-11-08T19:20:22.466 INFO:teuthology.orchestra.run.smithi160.stdout: cephadm noarch 2:18.0.0-7035.g7532011a.el8 ceph-noarch 191 k 2023-11-08T19:20:22.467 INFO:teuthology.orchestra.run.smithi160.stdout: cephfs-mirror x86_64 2:18.0.0-7035.g7532011a.el8 ceph 262 k 2023-11-08T19:20:22.467 INFO:teuthology.orchestra.run.smithi160.stdout: cephfs-top noarch 2:18.0.0-7035.g7532011a.el8 ceph-noarch 18 k 2023-11-08T19:20:22.467 INFO:teuthology.orchestra.run.smithi160.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-11-08T19:20:22.467 INFO:teuthology.orchestra.run.smithi160.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-11-08T19:20:22.467 INFO:teuthology.orchestra.run.smithi160.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-11-08T19:20:22.468 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs-devel x86_64 2:18.0.0-7035.g7532011a.el8 ceph 31 k 2023-11-08T19:20:22.468 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs2 x86_64 2:18.0.0-7035.g7532011a.el8 ceph 838 k 2023-11-08T19:20:22.468 INFO:teuthology.orchestra.run.smithi160.stdout: librados-devel x86_64 2:18.0.0-7035.g7532011a.el8 ceph 139 k 2023-11-08T19:20:22.468 INFO:teuthology.orchestra.run.smithi160.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-11-08T19:20:22.468 INFO:teuthology.orchestra.run.smithi160.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-11-08T19:20:22.469 INFO:teuthology.orchestra.run.smithi160.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-11-08T19:20:22.469 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-11-08T19:20:22.469 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-11-08T19:20:22.469 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-11-08T19:20:22.469 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cephfs x86_64 2:18.0.0-7035.g7532011a.el8 ceph 197 k 2023-11-08T19:20:22.470 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rados x86_64 2:18.0.0-7035.g7532011a.el8 ceph 371 k 2023-11-08T19:20:22.470 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rbd x86_64 2:18.0.0-7035.g7532011a.el8 ceph 364 k 2023-11-08T19:20:22.470 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rgw x86_64 2:18.0.0-7035.g7532011a.el8 ceph 107 k 2023-11-08T19:20:22.470 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-fuse x86_64 2:18.0.0-7035.g7532011a.el8 ceph 94 k 2023-11-08T19:20:22.471 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-mirror x86_64 2:18.0.0-7035.g7532011a.el8 ceph 3.6 M 2023-11-08T19:20:22.471 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-nbd x86_64 2:18.0.0-7035.g7532011a.el8 ceph 181 k 2023-11-08T19:20:22.471 INFO:teuthology.orchestra.run.smithi160.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-11-08T19:20:22.471 INFO:teuthology.orchestra.run.smithi160.stdout:Upgrading: 2023-11-08T19:20:22.471 INFO:teuthology.orchestra.run.smithi160.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-11-08T19:20:22.472 INFO:teuthology.orchestra.run.smithi160.stdout: librados2 x86_64 2:18.0.0-7035.g7532011a.el8 ceph 3.8 M 2023-11-08T19:20:22.472 INFO:teuthology.orchestra.run.smithi160.stdout: librbd1 x86_64 2:18.0.0-7035.g7532011a.el8 ceph 3.7 M 2023-11-08T19:20:22.472 INFO:teuthology.orchestra.run.smithi160.stdout:Installing dependencies: 2023-11-08T19:20:22.472 INFO:teuthology.orchestra.run.smithi160.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-11-08T19:20:22.472 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-common x86_64 2:18.0.0-7035.g7532011a.el8 ceph 23 M 2023-11-08T19:20:22.473 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-grafana-dashboards noarch 2:18.0.0-7035.g7532011a.el8 ceph-noarch 23 k 2023-11-08T19:20:22.473 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mds x86_64 2:18.0.0-7035.g7532011a.el8 ceph 2.3 M 2023-11-08T19:20:22.473 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-modules-core noarch 2:18.0.0-7035.g7532011a.el8 ceph-noarch 242 k 2023-11-08T19:20:22.473 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mon x86_64 2:18.0.0-7035.g7532011a.el8 ceph 4.6 M 2023-11-08T19:20:22.473 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-osd x86_64 2:18.0.0-7035.g7532011a.el8 ceph 18 M 2023-11-08T19:20:22.474 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-prometheus-alerts noarch 2:18.0.0-7035.g7532011a.el8 ceph-noarch 15 k 2023-11-08T19:20:22.474 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-selinux x86_64 2:18.0.0-7035.g7532011a.el8 ceph 24 k 2023-11-08T19:20:22.474 INFO:teuthology.orchestra.run.smithi160.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-11-08T19:20:22.474 INFO:teuthology.orchestra.run.smithi160.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-11-08T19:20:22.474 INFO:teuthology.orchestra.run.smithi160.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-11-08T19:20:22.475 INFO:teuthology.orchestra.run.smithi160.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-11-08T19:20:22.475 INFO:teuthology.orchestra.run.smithi160.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-11-08T19:20:22.475 INFO:teuthology.orchestra.run.smithi160.stdout: libcephsqlite x86_64 2:18.0.0-7035.g7532011a.el8 ceph 182 k 2023-11-08T19:20:22.475 INFO:teuthology.orchestra.run.smithi160.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-11-08T19:20:22.476 INFO:teuthology.orchestra.run.smithi160.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-11-08T19:20:22.476 INFO:teuthology.orchestra.run.smithi160.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-11-08T19:20:22.476 INFO:teuthology.orchestra.run.smithi160.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-11-08T19:20:22.476 INFO:teuthology.orchestra.run.smithi160.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-11-08T19:20:22.476 INFO:teuthology.orchestra.run.smithi160.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-11-08T19:20:22.477 INFO:teuthology.orchestra.run.smithi160.stdout: libradosstriper1 x86_64 2:18.0.0-7035.g7532011a.el8 ceph 518 k 2023-11-08T19:20:22.477 INFO:teuthology.orchestra.run.smithi160.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-11-08T19:20:22.477 INFO:teuthology.orchestra.run.smithi160.stdout: librgw2 x86_64 2:18.0.0-7035.g7532011a.el8 ceph 6.9 M 2023-11-08T19:20:22.477 INFO:teuthology.orchestra.run.smithi160.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-11-08T19:20:22.477 INFO:teuthology.orchestra.run.smithi160.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-11-08T19:20:22.478 INFO:teuthology.orchestra.run.smithi160.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-11-08T19:20:22.478 INFO:teuthology.orchestra.run.smithi160.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-11-08T19:20:22.478 INFO:teuthology.orchestra.run.smithi160.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-11-08T19:20:22.478 INFO:teuthology.orchestra.run.smithi160.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-11-08T19:20:22.478 INFO:teuthology.orchestra.run.smithi160.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-11-08T19:20:22.479 INFO:teuthology.orchestra.run.smithi160.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-11-08T19:20:22.479 INFO:teuthology.orchestra.run.smithi160.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-11-08T19:20:22.479 INFO:teuthology.orchestra.run.smithi160.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-11-08T19:20:22.479 INFO:teuthology.orchestra.run.smithi160.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-11-08T19:20:22.479 INFO:teuthology.orchestra.run.smithi160.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-11-08T19:20:22.479 INFO:teuthology.orchestra.run.smithi160.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-11-08T19:20:22.480 INFO:teuthology.orchestra.run.smithi160.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-11-08T19:20:22.480 INFO:teuthology.orchestra.run.smithi160.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-11-08T19:20:22.480 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-11-08T19:20:22.480 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-argparse x86_64 2:18.0.0-7035.g7532011a.el8 ceph 45 k 2023-11-08T19:20:22.481 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-common x86_64 2:18.0.0-7035.g7532011a.el8 ceph 126 k 2023-11-08T19:20:22.481 INFO:teuthology.orchestra.run.smithi160.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-11-08T19:20:22.481 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-11-08T19:20:22.481 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-11-08T19:20:22.481 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-11-08T19:20:22.482 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-11-08T19:20:22.482 INFO:teuthology.orchestra.run.smithi160.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-11-08T19:20:22.482 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-11-08T19:20:22.482 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-11-08T19:20:22.482 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-11-08T19:20:22.483 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-11-08T19:20:22.483 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-11-08T19:20:22.483 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-11-08T19:20:22.483 INFO:teuthology.orchestra.run.smithi160.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-11-08T19:20:22.483 INFO:teuthology.orchestra.run.smithi160.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-11-08T19:20:22.484 INFO:teuthology.orchestra.run.smithi160.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-11-08T19:20:22.484 INFO:teuthology.orchestra.run.smithi160.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-11-08T19:20:22.484 INFO:teuthology.orchestra.run.smithi160.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-11-08T19:20:22.484 INFO:teuthology.orchestra.run.smithi160.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-11-08T19:20:22.484 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-11-08T19:20:22.485 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-11-08T19:20:22.485 INFO:teuthology.orchestra.run.smithi160.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-11-08T19:20:22.485 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-11-08T19:20:22.485 INFO:teuthology.orchestra.run.smithi160.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-11-08T19:20:22.485 INFO:teuthology.orchestra.run.smithi160.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-11-08T19:20:22.485 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-11-08T19:20:22.486 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-11-08T19:20:22.486 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-11-08T19:20:22.486 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-11-08T19:20:22.486 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-11-08T19:20:22.486 INFO:teuthology.orchestra.run.smithi160.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-11-08T19:20:22.487 INFO:teuthology.orchestra.run.smithi160.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-11-08T19:20:22.487 INFO:teuthology.orchestra.run.smithi160.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-11-08T19:20:22.487 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-11-08T19:20:22.487 INFO:teuthology.orchestra.run.smithi160.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-11-08T19:20:22.487 INFO:teuthology.orchestra.run.smithi160.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-11-08T19:20:22.488 INFO:teuthology.orchestra.run.smithi160.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-11-08T19:20:22.488 INFO:teuthology.orchestra.run.smithi160.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-11-08T19:20:22.488 INFO:teuthology.orchestra.run.smithi160.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-11-08T19:20:22.488 INFO:teuthology.orchestra.run.smithi160.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-11-08T19:20:22.488 INFO:teuthology.orchestra.run.smithi160.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-11-08T19:20:22.488 INFO:teuthology.orchestra.run.smithi160.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-11-08T19:20:22.489 INFO:teuthology.orchestra.run.smithi160.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-11-08T19:20:22.489 INFO:teuthology.orchestra.run.smithi160.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-11-08T19:20:22.489 INFO:teuthology.orchestra.run.smithi160.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-11-08T19:20:22.489 INFO:teuthology.orchestra.run.smithi160.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-11-08T19:20:22.489 INFO:teuthology.orchestra.run.smithi160.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-11-08T19:20:22.490 INFO:teuthology.orchestra.run.smithi160.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-11-08T19:20:22.490 INFO:teuthology.orchestra.run.smithi160.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-11-08T19:20:22.490 INFO:teuthology.orchestra.run.smithi160.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-11-08T19:20:22.490 INFO:teuthology.orchestra.run.smithi160.stdout:Enabling module streams: 2023-11-08T19:20:22.490 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql 10 2023-11-08T19:20:22.491 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:20:22.491 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction Summary 2023-11-08T19:20:22.491 INFO:teuthology.orchestra.run.smithi160.stdout:=========================================================================================================================== 2023-11-08T19:20:22.491 INFO:teuthology.orchestra.run.smithi160.stdout:Install 128 Packages 2023-11-08T19:20:22.491 INFO:teuthology.orchestra.run.smithi160.stdout:Upgrade 3 Packages 2023-11-08T19:20:22.492 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:20:22.492 INFO:teuthology.orchestra.run.smithi160.stdout:Total download size: 209 M 2023-11-08T19:20:22.493 INFO:teuthology.orchestra.run.smithi160.stdout:Downloading Packages: 2023-11-08T19:20:22.506 INFO:teuthology.orchestra.run.smithi149.stdout:(10/131): ceph-radosgw-18.0.0-7035.g7532011a.el 8.0 MB/s | 14 MB 00:01 2023-11-08T19:20:22.682 INFO:teuthology.orchestra.run.smithi149.stdout:(11/131): cephfs-mirror-18.0.0-7035.g7532011a.e 1.5 MB/s | 262 kB 00:00 2023-11-08T19:20:22.824 INFO:teuthology.orchestra.run.smithi149.stdout:(12/131): libcephfs-devel-18.0.0-7035.g7532011a 219 kB/s | 31 kB 00:00 2023-11-08T19:20:22.895 INFO:teuthology.orchestra.run.smithi160.stdout:(1/131): ceph-18.0.0-7035.g7532011a.el8.x86_64. 23 kB/s | 6.4 kB 00:00 2023-11-08T19:20:23.124 INFO:teuthology.orchestra.run.smithi149.stdout:(13/131): libcephfs2-18.0.0-7035.g7532011a.el8. 2.7 MB/s | 838 kB 00:00 2023-11-08T19:20:23.258 INFO:teuthology.orchestra.run.smithi149.stdout:(14/131): libcephsqlite-18.0.0-7035.g7532011a.e 1.3 MB/s | 182 kB 00:00 2023-11-08T19:20:23.375 INFO:teuthology.orchestra.run.smithi149.stdout:(15/131): librados-devel-18.0.0-7035.g7532011a. 1.2 MB/s | 139 kB 00:00 2023-11-08T19:20:23.575 INFO:teuthology.orchestra.run.smithi149.stdout:(16/131): libradosstriper1-18.0.0-7035.g7532011 2.5 MB/s | 518 kB 00:00 2023-11-08T19:20:23.945 INFO:teuthology.orchestra.run.smithi160.stdout:(2/131): ceph-fuse-18.0.0-7035.g7532011a.el8.x8 875 kB/s | 919 kB 00:01 2023-11-08T19:20:24.162 INFO:teuthology.orchestra.run.smithi160.stdout:(3/131): ceph-immutable-object-cache-18.0.0-703 789 kB/s | 171 kB 00:00 2023-11-08T19:20:24.992 INFO:teuthology.orchestra.run.smithi149.stdout:(17/131): librgw2-18.0.0-7035.g7532011a.el8.x86 4.9 MB/s | 6.9 MB 00:01 2023-11-08T19:20:25.004 INFO:teuthology.orchestra.run.smithi160.stdout:(4/131): ceph-base-18.0.0-7035.g7532011a.el8.x8 2.2 MB/s | 5.4 MB 00:02 2023-11-08T19:20:25.042 INFO:teuthology.orchestra.run.smithi149.stdout:(18/131): python3-ceph-argparse-18.0.0-7035.g75 897 kB/s | 45 kB 00:00 2023-11-08T19:20:25.135 INFO:teuthology.orchestra.run.smithi149.stdout:(19/131): python3-ceph-common-18.0.0-7035.g7532 1.3 MB/s | 126 kB 00:00 2023-11-08T19:20:25.226 INFO:teuthology.orchestra.run.smithi149.stdout:(20/131): python3-cephfs-18.0.0-7035.g7532011a. 2.1 MB/s | 197 kB 00:00 2023-11-08T19:20:25.343 INFO:teuthology.orchestra.run.smithi149.stdout:(21/131): python3-rados-18.0.0-7035.g7532011a.e 3.1 MB/s | 371 kB 00:00 2023-11-08T19:20:25.468 INFO:teuthology.orchestra.run.smithi149.stdout:(22/131): python3-rbd-18.0.0-7035.g7532011a.el8 2.8 MB/s | 364 kB 00:00 2023-11-08T19:20:25.521 INFO:teuthology.orchestra.run.smithi160.stdout:(5/131): ceph-mgr-18.0.0-7035.g7532011a.el8.x86 3.1 MB/s | 1.6 MB 00:00 2023-11-08T19:20:25.561 INFO:teuthology.orchestra.run.smithi149.stdout:(23/131): python3-rgw-18.0.0-7035.g7532011a.el8 1.1 MB/s | 107 kB 00:00 2023-11-08T19:20:25.653 INFO:teuthology.orchestra.run.smithi149.stdout:(24/131): rbd-fuse-18.0.0-7035.g7532011a.el8.x8 1.0 MB/s | 94 kB 00:00 2023-11-08T19:20:25.913 INFO:teuthology.orchestra.run.smithi160.stdout:(6/131): ceph-common-18.0.0-7035.g7532011a.el8. 6.8 MB/s | 23 MB 00:03 2023-11-08T19:20:26.054 INFO:teuthology.orchestra.run.smithi160.stdout:(7/131): ceph-mds-18.0.0-7035.g7532011a.el8.x86 1.2 MB/s | 2.3 MB 00:01 2023-11-08T19:20:26.461 INFO:teuthology.orchestra.run.smithi149.stdout:(25/131): ceph-test-18.0.0-7035.g7532011a.el8.x 12 MB/s | 49 MB 00:04 2023-11-08T19:20:26.520 INFO:teuthology.orchestra.run.smithi149.stdout:(26/131): rbd-mirror-18.0.0-7035.g7532011a.el8. 4.1 MB/s | 3.6 MB 00:00 2023-11-08T19:20:26.545 INFO:teuthology.orchestra.run.smithi149.stdout:(27/131): rbd-nbd-18.0.0-7035.g7532011a.el8.x86 2.1 MB/s | 181 kB 00:00 2023-11-08T19:20:26.546 INFO:teuthology.orchestra.run.smithi160.stdout:(8/131): ceph-mon-18.0.0-7035.g7532011a.el8.x86 4.5 MB/s | 4.6 MB 00:01 2023-11-08T19:20:26.562 INFO:teuthology.orchestra.run.smithi149.stdout:(28/131): ceph-grafana-dashboards-18.0.0-7035.g 553 kB/s | 23 kB 00:00 2023-11-08T19:20:26.622 INFO:teuthology.orchestra.run.smithi160.stdout:(9/131): ceph-selinux-18.0.0-7035.g7532011a.el8 324 kB/s | 24 kB 00:00 2023-11-08T19:20:26.637 INFO:teuthology.orchestra.run.smithi149.stdout:(29/131): ceph-mgr-cephadm-18.0.0-7035.g7532011 1.4 MB/s | 132 kB 00:00 2023-11-08T19:20:27.013 INFO:teuthology.orchestra.run.smithi149.stdout:(30/131): ceph-mgr-dashboard-18.0.0-7035.g75320 3.9 MB/s | 1.8 MB 00:00 2023-11-08T19:20:27.296 INFO:teuthology.orchestra.run.smithi149.stdout:(31/131): ceph-mgr-modules-core-18.0.0-7035.g75 857 kB/s | 242 kB 00:00 2023-11-08T19:20:27.347 INFO:teuthology.orchestra.run.smithi160.stdout:(10/131): ceph-osd-18.0.0-7035.g7532011a.el8.x8 13 MB/s | 18 MB 00:01 2023-11-08T19:20:27.449 INFO:teuthology.orchestra.run.smithi160.stdout:(11/131): cephfs-mirror-18.0.0-7035.g7532011a.e 2.5 MB/s | 262 kB 00:00 2023-11-08T19:20:27.471 INFO:teuthology.orchestra.run.smithi149.stdout:(32/131): ceph-mgr-rook-18.0.0-7035.g7532011a.e 272 kB/s | 48 kB 00:00 2023-11-08T19:20:27.531 INFO:teuthology.orchestra.run.smithi160.stdout:(12/131): libcephfs-devel-18.0.0-7035.g7532011a 380 kB/s | 31 kB 00:00 2023-11-08T19:20:27.572 INFO:teuthology.orchestra.run.smithi149.stdout:(33/131): ceph-mgr-diskprediction-local-18.0.0- 7.9 MB/s | 7.4 MB 00:00 2023-11-08T19:20:27.597 INFO:teuthology.orchestra.run.smithi149.stdout:(34/131): ceph-prometheus-alerts-18.0.0-7035.g7 120 kB/s | 15 kB 00:00 2023-11-08T19:20:27.630 INFO:teuthology.orchestra.run.smithi149.stdout:(35/131): ceph-volume-18.0.0-7035.g7532011a.el8 4.4 MB/s | 261 kB 00:00 2023-11-08T19:20:27.631 INFO:teuthology.orchestra.run.smithi160.stdout:(13/131): libcephfs2-18.0.0-7035.g7532011a.el8. 8.2 MB/s | 838 kB 00:00 2023-11-08T19:20:27.697 INFO:teuthology.orchestra.run.smithi149.stdout:(36/131): cephadm-18.0.0-7035.g7532011a.el8.noa 1.9 MB/s | 191 kB 00:00 2023-11-08T19:20:27.723 INFO:teuthology.orchestra.run.smithi149.stdout:(37/131): cephfs-top-18.0.0-7035.g7532011a.el8. 197 kB/s | 18 kB 00:00 2023-11-08T19:20:27.723 INFO:teuthology.orchestra.run.smithi160.stdout:(14/131): libcephsqlite-18.0.0-7035.g7532011a.e 1.9 MB/s | 182 kB 00:00 2023-11-08T19:20:27.799 INFO:teuthology.orchestra.run.smithi160.stdout:(15/131): librados-devel-18.0.0-7035.g7532011a. 1.8 MB/s | 139 kB 00:00 2023-11-08T19:20:27.873 INFO:teuthology.orchestra.run.smithi149.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 391 kB/s | 59 kB 00:00 2023-11-08T19:20:27.898 INFO:teuthology.orchestra.run.smithi149.stdout:(39/131): gperftools-libs-2.7-9.el8.x86_64.rpm 1.5 MB/s | 306 kB 00:00 2023-11-08T19:20:27.916 INFO:teuthology.orchestra.run.smithi160.stdout:(16/131): libradosstriper1-18.0.0-7035.g7532011 4.3 MB/s | 518 kB 00:00 2023-11-08T19:20:27.957 INFO:teuthology.orchestra.run.smithi149.stdout:(40/131): libunwind-1.3.1-3.el8.x86_64.rpm 899 kB/s | 75 kB 00:00 2023-11-08T19:20:27.991 INFO:teuthology.orchestra.run.smithi149.stdout:(41/131): python3-asyncssh-2.7.0-2.el8.noarch.r 5.1 MB/s | 476 kB 00:00 2023-11-08T19:20:28.016 INFO:teuthology.orchestra.run.smithi149.stdout:(42/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 747 kB/s | 44 kB 00:00 2023-11-08T19:20:28.033 INFO:teuthology.orchestra.run.smithi149.stdout:(43/131): python3-beautifulsoup4-4.6.3-2.el8.1. 4.3 MB/s | 185 kB 00:00 2023-11-08T19:20:28.092 INFO:teuthology.orchestra.run.smithi149.stdout:(44/131): python3-cachetools-3.1.1-4.el8.noarch 438 kB/s | 33 kB 00:00 2023-11-08T19:20:28.117 INFO:teuthology.orchestra.run.smithi149.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 195 kB/s | 16 kB 00:00 2023-11-08T19:20:28.167 INFO:teuthology.orchestra.run.smithi149.stdout:(46/131): python3-cherrypy-18.4.0-1.el8.noarch. 7.5 MB/s | 384 kB 00:00 2023-11-08T19:20:28.184 INFO:teuthology.orchestra.run.smithi149.stdout:(47/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.8 MB/s | 173 kB 00:00 2023-11-08T19:20:28.209 INFO:teuthology.orchestra.run.smithi149.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 1.9 MB/s | 81 kB 00:00 2023-11-08T19:20:28.235 INFO:teuthology.orchestra.run.smithi149.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 221 kB/s | 11 kB 00:00 2023-11-08T19:20:28.260 INFO:teuthology.orchestra.run.smithi149.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 350 kB/s | 18 kB 00:00 2023-11-08T19:20:28.310 INFO:teuthology.orchestra.run.smithi149.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 980 kB/s | 49 kB 00:00 2023-11-08T19:20:28.344 INFO:teuthology.orchestra.run.smithi149.stdout:(52/131): python3-kubernetes-11.0.0-6.el8.noarc 11 MB/s | 1.2 MB 00:00 2023-11-08T19:20:28.369 INFO:teuthology.orchestra.run.smithi149.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 1.0 MB/s | 59 kB 00:00 2023-11-08T19:20:28.394 INFO:teuthology.orchestra.run.smithi149.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 1.2 MB/s | 60 kB 00:00 2023-11-08T19:20:28.428 INFO:teuthology.orchestra.run.smithi149.stdout:(55/131): python3-pecan-1.3.2-9.el8.noarch.rpm 4.7 MB/s | 283 kB 00:00 2023-11-08T19:20:28.453 INFO:teuthology.orchestra.run.smithi149.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 267 kB/s | 16 kB 00:00 2023-11-08T19:20:28.466 INFO:teuthology.orchestra.run.smithi160.stdout:(17/131): librgw2-18.0.0-7035.g7532011a.el8.x86 13 MB/s | 6.9 MB 00:00 2023-11-08T19:20:28.479 INFO:teuthology.orchestra.run.smithi149.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 671 kB/s | 34 kB 00:00 2023-11-08T19:20:28.529 INFO:teuthology.orchestra.run.smithi149.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 2.5 MB/s | 196 kB 00:00 2023-11-08T19:20:28.546 INFO:teuthology.orchestra.run.smithi149.stdout:(59/131): python3-rsa-4.9-2.el8.noarch.rpm 961 kB/s | 64 kB 00:00 2023-11-08T19:20:28.566 INFO:teuthology.orchestra.run.smithi160.stdout:(18/131): python3-ceph-argparse-18.0.0-7035.g75 447 kB/s | 45 kB 00:00 2023-11-08T19:20:28.579 INFO:teuthology.orchestra.run.smithi149.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 374 kB/s | 19 kB 00:00 2023-11-08T19:20:28.596 INFO:teuthology.orchestra.run.smithi149.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 477 kB/s | 24 kB 00:00 2023-11-08T19:20:28.621 INFO:teuthology.orchestra.run.smithi149.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 697 kB/s | 29 kB 00:00 2023-11-08T19:20:28.639 INFO:teuthology.orchestra.run.smithi149.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 656 kB/s | 27 kB 00:00 2023-11-08T19:20:28.649 INFO:teuthology.orchestra.run.smithi160.stdout:(19/131): python3-ceph-common-18.0.0-7035.g7532 1.5 MB/s | 126 kB 00:00 2023-11-08T19:20:28.680 INFO:teuthology.orchestra.run.smithi149.stdout:(64/131): python3-waitress-1.4.3-1.el8.noarch.r 4.3 MB/s | 255 kB 00:00 2023-11-08T19:20:28.706 INFO:teuthology.orchestra.run.smithi149.stdout:(65/131): python3-webob-1.8.5-1.el8.1.noarch.rp 3.7 MB/s | 251 kB 00:00 2023-11-08T19:20:28.723 INFO:teuthology.orchestra.run.smithi149.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 1.4 MB/s | 61 kB 00:00 2023-11-08T19:20:28.748 INFO:teuthology.orchestra.run.smithi149.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 2.0 MB/s | 85 kB 00:00 2023-11-08T19:20:28.756 INFO:teuthology.orchestra.run.smithi160.stdout:(20/131): python3-cephfs-18.0.0-7035.g7532011a. 1.8 MB/s | 197 kB 00:00 2023-11-08T19:20:28.782 INFO:teuthology.orchestra.run.smithi149.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 390 kB/s | 23 kB 00:00 2023-11-08T19:20:28.807 INFO:teuthology.orchestra.run.smithi149.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.8 MB/s | 70 kB 00:00 2023-11-08T19:20:28.833 INFO:teuthology.orchestra.run.smithi160.stdout:(21/131): python3-rados-18.0.0-7035.g7532011a.e 4.7 MB/s | 371 kB 00:00 2023-11-08T19:20:28.874 INFO:teuthology.orchestra.run.smithi149.stdout:(70/131): thrift-0.13.0-2.el8.x86_64.rpm 14 MB/s | 1.7 MB 00:00 2023-11-08T19:20:28.891 INFO:teuthology.orchestra.run.smithi149.stdout:(71/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 560 kB/s | 47 kB 00:00 2023-11-08T19:20:28.942 INFO:teuthology.orchestra.run.smithi149.stdout:(72/131): python3-jwt-1.6.1-2.el8.noarch.rpm 958 kB/s | 43 kB 00:00 2023-11-08T19:20:28.942 INFO:teuthology.orchestra.run.smithi160.stdout:(22/131): python3-rbd-18.0.0-7035.g7532011a.el8 3.3 MB/s | 364 kB 00:00 2023-11-08T19:20:28.967 INFO:teuthology.orchestra.run.smithi149.stdout:(73/131): libselinux-devel-2.9-5.el8.x86_64.rpm 2.1 MB/s | 200 kB 00:00 2023-11-08T19:20:28.992 INFO:teuthology.orchestra.run.smithi149.stdout:(74/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-11-08T19:20:29.017 INFO:teuthology.orchestra.run.smithi149.stdout:(75/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 958 kB/s | 48 kB 00:00 2023-11-08T19:20:29.018 INFO:teuthology.orchestra.run.smithi160.stdout:(23/131): python3-rgw-18.0.0-7035.g7532011a.el8 1.4 MB/s | 107 kB 00:00 2023-11-08T19:20:29.042 INFO:teuthology.orchestra.run.smithi149.stdout:(76/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-11-08T19:20:29.068 INFO:teuthology.orchestra.run.smithi149.stdout:(77/131): python3-requests-oauthlib-1.0.0-1.el8 852 kB/s | 43 kB 00:00 2023-11-08T19:20:29.084 INFO:teuthology.orchestra.run.smithi160.stdout:(24/131): rbd-fuse-18.0.0-7035.g7532011a.el8.x8 1.4 MB/s | 94 kB 00:00 2023-11-08T19:20:29.093 INFO:teuthology.orchestra.run.smithi149.stdout:(78/131): python3-pycparser-2.14-14.el8.noarch. 2.1 MB/s | 109 kB 00:00 2023-11-08T19:20:29.118 INFO:teuthology.orchestra.run.smithi149.stdout:(79/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 4.4 MB/s | 229 kB 00:00 2023-11-08T19:20:29.152 INFO:teuthology.orchestra.run.smithi149.stdout:(80/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 9.4 MB/s | 560 kB 00:00 2023-11-08T19:20:29.177 INFO:teuthology.orchestra.run.smithi149.stdout:(81/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 320 kB/s | 19 kB 00:00 2023-11-08T19:20:29.202 INFO:teuthology.orchestra.run.smithi149.stdout:(82/131): python3-oauthlib-2.1.0-1.el8.noarch.r 3.0 MB/s | 155 kB 00:00 2023-11-08T19:20:29.236 INFO:teuthology.orchestra.run.smithi149.stdout:(83/131): python3-cryptography-3.2.1-5.el8.x86_ 9.4 MB/s | 559 kB 00:00 2023-11-08T19:20:29.262 INFO:teuthology.orchestra.run.smithi149.stdout:(84/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 305 kB/s | 18 kB 00:00 2023-11-08T19:20:29.295 INFO:teuthology.orchestra.run.smithi149.stdout:(85/131): pcre2-devel-10.32-2.el8.x86_64.rpm 10 MB/s | 605 kB 00:00 2023-11-08T19:20:29.312 INFO:teuthology.orchestra.run.smithi149.stdout:(86/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 4.6 MB/s | 238 kB 00:00 2023-11-08T19:20:29.371 INFO:teuthology.orchestra.run.smithi149.stdout:(87/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.2 MB/s | 72 kB 00:00 2023-11-08T19:20:29.385 INFO:teuthology.orchestra.run.smithi160.stdout:(25/131): rbd-mirror-18.0.0-7035.g7532011a.el8. 12 MB/s | 3.6 MB 00:00 2023-11-08T19:20:29.404 INFO:teuthology.orchestra.run.smithi149.stdout:(88/131): fuse-2.9.7-15.el8.x86_64.rpm 2.4 MB/s | 83 kB 00:00 2023-11-08T19:20:29.446 INFO:teuthology.orchestra.run.smithi149.stdout:(89/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 15 MB/s | 2.3 MB 00:00 2023-11-08T19:20:29.451 INFO:teuthology.orchestra.run.smithi160.stdout:(26/131): rbd-nbd-18.0.0-7035.g7532011a.el8.x86 2.7 MB/s | 181 kB 00:00 2023-11-08T19:20:29.472 INFO:teuthology.orchestra.run.smithi149.stdout:(90/131): elfutils-libelf-devel-0.186-1.el8.x86 895 kB/s | 60 kB 00:00 2023-11-08T19:20:29.497 INFO:teuthology.orchestra.run.smithi149.stdout:(91/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 1.9 MB/s | 98 kB 00:00 2023-11-08T19:20:29.510 INFO:teuthology.orchestra.run.smithi160.stdout:(27/131): ceph-grafana-dashboards-18.0.0-7035.g 395 kB/s | 23 kB 00:00 2023-11-08T19:20:29.522 INFO:teuthology.orchestra.run.smithi149.stdout:(92/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2023-11-08T19:20:29.547 INFO:teuthology.orchestra.run.smithi149.stdout:(93/131): libcom_err-devel-1.45.6-4.el8.x86_64. 769 kB/s | 39 kB 00:00 2023-11-08T19:20:29.577 INFO:teuthology.orchestra.run.smithi160.stdout:(28/131): ceph-mgr-cephadm-18.0.0-7035.g7532011 1.9 MB/s | 132 kB 00:00 2023-11-08T19:20:29.581 INFO:teuthology.orchestra.run.smithi149.stdout:(94/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 11 MB/s | 644 kB 00:00 2023-11-08T19:20:29.615 INFO:teuthology.orchestra.run.smithi149.stdout:(95/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 2.5 MB/s | 171 kB 00:00 2023-11-08T19:20:29.640 INFO:teuthology.orchestra.run.smithi149.stdout:(96/131): NetworkManager-initscripts-updown-1.3 2.3 MB/s | 138 kB 00:00 2023-11-08T19:20:29.682 INFO:teuthology.orchestra.run.smithi149.stdout:(97/131): python3-pyasn1-modules-0.3.7-6.el8.no 2.6 MB/s | 110 kB 00:00 2023-11-08T19:20:29.716 INFO:teuthology.orchestra.run.smithi149.stdout:(98/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.6 MB/s | 54 kB 00:00 2023-11-08T19:20:29.744 INFO:teuthology.orchestra.run.smithi160.stdout:(29/131): ceph-mgr-dashboard-18.0.0-7035.g75320 11 MB/s | 1.8 MB 00:00 2023-11-08T19:20:29.782 INFO:teuthology.orchestra.run.smithi149.stdout:(99/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 3.8 MB/s | 259 kB 00:00 2023-11-08T19:20:30.047 INFO:teuthology.orchestra.run.smithi160.stdout:(30/131): ceph-radosgw-18.0.0-7035.g7532011a.el 3.5 MB/s | 14 MB 00:03 2023-11-08T19:20:30.050 INFO:teuthology.orchestra.run.smithi149.stdout:(100/131): socat-1.7.4.1-1.el8.x86_64.rpm 1.2 MB/s | 323 kB 00:00 2023-11-08T19:20:30.083 INFO:teuthology.orchestra.run.smithi149.stdout:(101/131): python3-markupsafe-0.23-19.el8.x86_6 1.1 MB/s | 39 kB 00:00 2023-11-08T19:20:30.134 INFO:teuthology.orchestra.run.smithi149.stdout:(102/131): bison-3.0.4-10.el8.x86_64.rpm 13 MB/s | 688 kB 00:00 2023-11-08T19:20:30.145 INFO:teuthology.orchestra.run.smithi160.stdout:(31/131): ceph-mgr-modules-core-18.0.0-7035.g75 2.4 MB/s | 242 kB 00:00 2023-11-08T19:20:30.195 INFO:teuthology.orchestra.run.smithi160.stdout:(32/131): ceph-mgr-rook-18.0.0-7035.g7532011a.e 958 kB/s | 48 kB 00:00 2023-11-08T19:20:30.200 INFO:teuthology.orchestra.run.smithi149.stdout:(103/131): python3-jinja2-2.10.1-3.el8.noarch.r 7.9 MB/s | 538 kB 00:00 2023-11-08T19:20:30.228 INFO:teuthology.orchestra.run.smithi160.stdout:(33/131): ceph-prometheus-alerts-18.0.0-7035.g7 449 kB/s | 15 kB 00:00 2023-11-08T19:20:30.234 INFO:teuthology.orchestra.run.smithi149.stdout:(104/131): python3-mako-1.0.6-13.el8.noarch.rpm 4.6 MB/s | 157 kB 00:00 2023-11-08T19:20:30.276 INFO:teuthology.orchestra.run.smithi149.stdout:(105/131): oniguruma-6.8.2-2.el8.x86_64.rpm 4.4 MB/s | 187 kB 00:00 2023-11-08T19:20:30.304 INFO:teuthology.orchestra.run.smithi160.stdout:(34/131): ceph-mgr-diskprediction-local-18.0.0- 13 MB/s | 7.4 MB 00:00 2023-11-08T19:20:30.337 INFO:teuthology.orchestra.run.smithi160.stdout:(35/131): ceph-volume-18.0.0-7035.g7532011a.el8 2.4 MB/s | 261 kB 00:00 2023-11-08T19:20:30.371 INFO:teuthology.orchestra.run.smithi160.stdout:(36/131): cephfs-top-18.0.0-7035.g7532011a.el8. 543 kB/s | 18 kB 00:00 2023-11-08T19:20:30.388 INFO:teuthology.orchestra.run.smithi160.stdout:(37/131): cephadm-18.0.0-7035.g7532011a.el8.noa 2.2 MB/s | 191 kB 00:00 2023-11-08T19:20:30.426 INFO:teuthology.orchestra.run.smithi149.stdout:(106/131): python3-scipy-1.0.0-21.module+el8.5. 17 MB/s | 14 MB 00:00 2023-11-08T19:20:30.460 INFO:teuthology.orchestra.run.smithi149.stdout:(107/131): automake-1.16.1-7.el8.noarch.rpm 3.8 MB/s | 713 kB 00:00 2023-11-08T19:20:30.485 INFO:teuthology.orchestra.run.smithi149.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 1.0 MB/s | 27 kB 00:00 2023-11-08T19:20:30.527 INFO:teuthology.orchestra.run.smithi149.stdout:(109/131): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-11-08T19:20:30.561 INFO:teuthology.orchestra.run.smithi149.stdout:(110/131): python3-prettytable-0.7.2-14.el8.noa 1.3 MB/s | 44 kB 00:00 2023-11-08T19:20:30.636 INFO:teuthology.orchestra.run.smithi149.stdout:(111/131): python3-babel-2.5.1-7.el8.noarch.rpm 23 MB/s | 4.8 MB 00:00 2023-11-08T19:20:30.678 INFO:teuthology.orchestra.run.smithi149.stdout:(112/131): python3-werkzeug-0.12.2-4.el8.noarch 11 MB/s | 457 kB 00:00 2023-11-08T19:20:30.712 INFO:teuthology.orchestra.run.smithi149.stdout:(113/131): python3-numpy-f2py-1.14.3-10.el8.x86 6.6 MB/s | 225 kB 00:00 2023-11-08T19:20:30.778 INFO:teuthology.orchestra.run.smithi149.stdout:(114/131): python3-numpy-1.14.3-10.el8.x86_64.r 17 MB/s | 3.7 MB 00:00 2023-11-08T19:20:30.795 INFO:teuthology.orchestra.run.smithi149.stdout:(115/131): uuid-1.6.2-43.el8.x86_64.rpm 765 kB/s | 64 kB 00:00 2023-11-08T19:20:30.805 INFO:teuthology.orchestra.run.smithi160.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 141 kB/s | 59 kB 00:00 2023-11-08T19:20:30.821 INFO:teuthology.orchestra.run.smithi149.stdout:(116/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 2.9 MB/s | 126 kB 00:00 2023-11-08T19:20:30.838 INFO:teuthology.orchestra.run.smithi149.stdout:(117/131): python3-jsonpointer-1.10-11.el8.noar 477 kB/s | 20 kB 00:00 2023-11-08T19:20:30.863 INFO:teuthology.orchestra.run.smithi149.stdout:(118/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 2.4 MB/s | 103 kB 00:00 2023-11-08T19:20:30.897 INFO:teuthology.orchestra.run.smithi149.stdout:(119/131): libtool-2.4.6-25.el8.x86_64.rpm 12 MB/s | 709 kB 00:00 2023-11-08T19:20:30.938 INFO:teuthology.orchestra.run.smithi149.stdout:(120/131): libpq-13.5-1.el8.x86_64.rpm 4.7 MB/s | 198 kB 00:00 2023-11-08T19:20:30.980 INFO:teuthology.orchestra.run.smithi160.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 428 kB/s | 75 kB 00:00 2023-11-08T19:20:31.006 INFO:teuthology.orchestra.run.smithi160.stdout:(40/131): gperftools-libs-2.7-9.el8.x86_64.rpm 483 kB/s | 306 kB 00:00 2023-11-08T19:20:31.055 INFO:teuthology.orchestra.run.smithi149.stdout:(121/131): openblas-threads-0.3.15-3.el8.x86_64 25 MB/s | 4.9 MB 00:00 2023-11-08T19:20:31.089 INFO:teuthology.orchestra.run.smithi149.stdout:(122/131): jq-1.6-3.el8.x86_64.rpm 6.0 MB/s | 202 kB 00:00 2023-11-08T19:20:31.106 INFO:teuthology.orchestra.run.smithi160.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 435 kB/s | 44 kB 00:00 2023-11-08T19:20:31.164 INFO:teuthology.orchestra.run.smithi149.stdout:(123/131): openblas-0.3.15-3.el8.x86_64.rpm 21 MB/s | 4.7 MB 00:00 2023-11-08T19:20:31.190 INFO:teuthology.orchestra.run.smithi149.stdout:(124/131): librdkafka-0.11.4-3.el8.x86_64.rpm 3.4 MB/s | 354 kB 00:00 2023-11-08T19:20:31.249 INFO:teuthology.orchestra.run.smithi149.stdout:(125/131): postgresql-contrib-10.21-2.module+el 13 MB/s | 808 kB 00:00 2023-11-08T19:20:31.256 INFO:teuthology.orchestra.run.smithi160.stdout:(42/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.2 MB/s | 185 kB 00:00 2023-11-08T19:20:31.290 INFO:teuthology.orchestra.run.smithi160.stdout:(43/131): python3-asyncssh-2.7.0-2.el8.noarch.r 1.5 MB/s | 476 kB 00:00 2023-11-08T19:20:31.349 INFO:teuthology.orchestra.run.smithi149.stdout:(126/131): postgresql-server-10.21-2.module+el8 28 MB/s | 5.1 MB 00:00 2023-11-08T19:20:31.382 INFO:teuthology.orchestra.run.smithi160.stdout:(44/131): python3-cachetools-3.1.1-4.el8.noarch 263 kB/s | 33 kB 00:00 2023-11-08T19:20:31.382 INFO:teuthology.orchestra.run.smithi149.stdout:(127/131): postgresql-10.21-2.module+el8.6.0+15 11 MB/s | 1.5 MB 00:00 2023-11-08T19:20:31.407 INFO:teuthology.orchestra.run.smithi160.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 139 kB/s | 16 kB 00:00 2023-11-08T19:20:31.532 INFO:teuthology.orchestra.run.smithi160.stdout:(46/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.1 MB/s | 173 kB 00:00 2023-11-08T19:20:31.566 INFO:teuthology.orchestra.run.smithi160.stdout:(47/131): python3-cherrypy-18.4.0-1.el8.noarch. 2.4 MB/s | 384 kB 00:00 2023-11-08T19:20:31.658 INFO:teuthology.orchestra.run.smithi160.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 649 kB/s | 81 kB 00:00 2023-11-08T19:20:31.675 INFO:teuthology.orchestra.run.smithi160.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 102 kB/s | 11 kB 00:00 2023-11-08T19:20:31.758 INFO:teuthology.orchestra.run.smithi149.stdout:(128/131): librados2-18.0.0-7035.g7532011a.el8. 9.2 MB/s | 3.8 MB 00:00 2023-11-08T19:20:31.792 INFO:teuthology.orchestra.run.smithi160.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 132 kB/s | 18 kB 00:00 2023-11-08T19:20:31.808 INFO:teuthology.orchestra.run.smithi149.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 16 MB/s | 798 kB 00:00 2023-11-08T19:20:31.900 INFO:teuthology.orchestra.run.smithi160.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 450 kB/s | 49 kB 00:00 2023-11-08T19:20:31.976 INFO:teuthology.orchestra.run.smithi160.stdout:(52/131): python3-kubernetes-11.0.0-6.el8.noarc 3.9 MB/s | 1.2 MB 00:00 2023-11-08T19:20:31.993 INFO:teuthology.orchestra.run.smithi160.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 639 kB/s | 59 kB 00:00 2023-11-08T19:20:32.033 INFO:teuthology.orchestra.run.smithi149.stdout:(130/131): librbd1-18.0.0-7035.g7532011a.el8.x8 5.7 MB/s | 3.7 MB 00:00 2023-11-08T19:20:32.059 INFO:teuthology.orchestra.run.smithi160.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 723 kB/s | 60 kB 00:00 2023-11-08T19:20:32.126 INFO:teuthology.orchestra.run.smithi160.stdout:(55/131): python3-pecan-1.3.2-9.el8.noarch.rpm 2.1 MB/s | 283 kB 00:00 2023-11-08T19:20:32.144 INFO:teuthology.orchestra.run.smithi160.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 186 kB/s | 16 kB 00:00 2023-11-08T19:20:32.227 INFO:teuthology.orchestra.run.smithi160.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 335 kB/s | 34 kB 00:00 2023-11-08T19:20:32.252 INFO:teuthology.orchestra.run.smithi160.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 1.8 MB/s | 196 kB 00:00 2023-11-08T19:20:32.311 INFO:teuthology.orchestra.run.smithi160.stdout:(59/131): python3-rsa-4.9-2.el8.noarch.rpm 771 kB/s | 64 kB 00:00 2023-11-08T19:20:32.336 INFO:teuthology.orchestra.run.smithi160.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 224 kB/s | 19 kB 00:00 2023-11-08T19:20:32.387 INFO:teuthology.orchestra.run.smithi160.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 318 kB/s | 24 kB 00:00 2023-11-08T19:20:32.412 INFO:teuthology.orchestra.run.smithi160.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 389 kB/s | 29 kB 00:00 2023-11-08T19:20:32.462 INFO:teuthology.orchestra.run.smithi160.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 366 kB/s | 27 kB 00:00 2023-11-08T19:20:32.713 INFO:teuthology.orchestra.run.smithi160.stdout:(64/131): python3-waitress-1.4.3-1.el8.noarch.r 850 kB/s | 255 kB 00:00 2023-11-08T19:20:32.738 INFO:teuthology.orchestra.run.smithi160.stdout:(65/131): python3-webob-1.8.5-1.el8.1.noarch.rp 912 kB/s | 251 kB 00:00 2023-11-08T19:20:32.750 INFO:teuthology.orchestra.run.smithi149.stdout:(131/131): ceph-common-18.0.0-7035.g7532011a.el 1.7 MB/s | 23 MB 00:13 2023-11-08T19:20:32.753 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2023-11-08T19:20:32.754 INFO:teuthology.orchestra.run.smithi149.stdout:Total 15 MB/s | 209 MB 00:13 2023-11-08T19:20:32.788 INFO:teuthology.orchestra.run.smithi160.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 814 kB/s | 61 kB 00:00 2023-11-08T19:20:32.822 INFO:teuthology.orchestra.run.smithi160.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 1.0 MB/s | 85 kB 00:00 2023-11-08T19:20:32.872 INFO:teuthology.orchestra.run.smithi160.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 274 kB/s | 23 kB 00:00 2023-11-08T19:20:32.889 INFO:teuthology.orchestra.run.smithi160.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 4.2 MB/s | 70 kB 00:00 2023-11-08T19:20:32.948 INFO:teuthology.orchestra.run.smithi160.stdout:(70/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 804 kB/s | 47 kB 00:00 2023-11-08T19:20:32.990 INFO:teuthology.orchestra.run.smithi160.stdout:(71/131): libselinux-devel-2.9-5.el8.x86_64.rpm 4.7 MB/s | 200 kB 00:00 2023-11-08T19:20:33.032 INFO:teuthology.orchestra.run.smithi160.stdout:(72/131): python3-jwt-1.6.1-2.el8.noarch.rpm 1.0 MB/s | 43 kB 00:00 2023-11-08T19:20:33.100 INFO:teuthology.orchestra.run.smithi160.stdout:(73/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 3.2 MB/s | 220 kB 00:00 2023-11-08T19:20:33.141 INFO:teuthology.orchestra.run.smithi160.stdout:(74/131): thrift-0.13.0-2.el8.x86_64.rpm 5.4 MB/s | 1.7 MB 00:00 2023-11-08T19:20:33.166 INFO:teuthology.orchestra.run.smithi160.stdout:(75/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 737 kB/s | 48 kB 00:00 2023-11-08T19:20:33.208 INFO:teuthology.orchestra.run.smithi160.stdout:(76/131): python3-requests-oauthlib-1.0.0-1.el8 1.2 MB/s | 43 kB 00:00 2023-11-08T19:20:33.233 INFO:teuthology.orchestra.run.smithi160.stdout:(77/131): libsepol-devel-2.9-3.el8.x86_64.rpm 945 kB/s | 87 kB 00:00 2023-11-08T19:20:33.258 INFO:teuthology.orchestra.run.smithi160.stdout:(78/131): python3-pycparser-2.14-14.el8.noarch. 2.1 MB/s | 109 kB 00:00 2023-11-08T19:20:33.284 INFO:teuthology.orchestra.run.smithi160.stdout:(79/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 4.5 MB/s | 229 kB 00:00 2023-11-08T19:20:33.317 INFO:teuthology.orchestra.run.smithi160.stdout:(80/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 9.3 MB/s | 560 kB 00:00 2023-11-08T19:20:33.343 INFO:teuthology.orchestra.run.smithi160.stdout:(81/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 319 kB/s | 19 kB 00:00 2023-11-08T19:20:33.368 INFO:teuthology.orchestra.run.smithi160.stdout:(82/131): python3-oauthlib-2.1.0-1.el8.noarch.r 3.0 MB/s | 155 kB 00:00 2023-11-08T19:20:33.402 INFO:teuthology.orchestra.run.smithi160.stdout:(83/131): python3-cryptography-3.2.1-5.el8.x86_ 9.3 MB/s | 559 kB 00:00 2023-11-08T19:20:33.418 INFO:teuthology.orchestra.run.smithi160.stdout:(84/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 357 kB/s | 18 kB 00:00 2023-11-08T19:20:33.452 INFO:teuthology.orchestra.run.smithi160.stdout:(85/131): pcre2-devel-10.32-2.el8.x86_64.rpm 12 MB/s | 605 kB 00:00 2023-11-08T19:20:33.477 INFO:teuthology.orchestra.run.smithi160.stdout:(86/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 4.0 MB/s | 238 kB 00:00 2023-11-08T19:20:33.545 INFO:teuthology.orchestra.run.smithi160.stdout:(87/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.1 MB/s | 72 kB 00:00 2023-11-08T19:20:33.578 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2023-11-08T19:20:33.586 INFO:teuthology.orchestra.run.smithi160.stdout:(88/131): fuse-2.9.7-15.el8.x86_64.rpm 1.9 MB/s | 83 kB 00:00 2023-11-08T19:20:33.628 INFO:teuthology.orchestra.run.smithi160.stdout:(89/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 13 MB/s | 2.3 MB 00:00 2023-11-08T19:20:33.645 INFO:teuthology.orchestra.run.smithi160.stdout:(90/131): elfutils-libelf-devel-0.186-1.el8.x86 1.0 MB/s | 60 kB 00:00 2023-11-08T19:20:33.670 INFO:teuthology.orchestra.run.smithi160.stdout:(91/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 2.3 MB/s | 98 kB 00:00 2023-11-08T19:20:33.687 INFO:teuthology.orchestra.run.smithi160.stdout:(92/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 1.3 MB/s | 58 kB 00:00 2023-11-08T19:20:33.698 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2023-11-08T19:20:33.699 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2023-11-08T19:20:33.704 INFO:teuthology.orchestra.run.smithi160.stdout:(93/131): libcom_err-devel-1.45.6-4.el8.x86_64. 1.1 MB/s | 39 kB 00:00 2023-11-08T19:20:33.738 INFO:teuthology.orchestra.run.smithi160.stdout:(94/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 13 MB/s | 644 kB 00:00 2023-11-08T19:20:33.763 INFO:teuthology.orchestra.run.smithi160.stdout:(95/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 2.9 MB/s | 171 kB 00:00 2023-11-08T19:20:33.789 INFO:teuthology.orchestra.run.smithi160.stdout:(96/131): NetworkManager-initscripts-updown-1.3 2.7 MB/s | 138 kB 00:00 2023-11-08T19:20:33.831 INFO:teuthology.orchestra.run.smithi160.stdout:(97/131): python3-pyasn1-modules-0.3.7-6.el8.no 2.6 MB/s | 110 kB 00:00 2023-11-08T19:20:33.864 INFO:teuthology.orchestra.run.smithi160.stdout:(98/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.6 MB/s | 54 kB 00:00 2023-11-08T19:20:33.973 INFO:teuthology.orchestra.run.smithi160.stdout:(99/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.3 MB/s | 259 kB 00:00 2023-11-08T19:20:34.032 INFO:teuthology.orchestra.run.smithi160.stdout:(100/131): socat-1.7.4.1-1.el8.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2023-11-08T19:20:34.065 INFO:teuthology.orchestra.run.smithi160.stdout:(101/131): python3-markupsafe-0.23-19.el8.x86_6 1.1 MB/s | 39 kB 00:00 2023-11-08T19:20:34.115 INFO:teuthology.orchestra.run.smithi160.stdout:(102/131): bison-3.0.4-10.el8.x86_64.rpm 13 MB/s | 688 kB 00:00 2023-11-08T19:20:34.157 INFO:teuthology.orchestra.run.smithi160.stdout:(103/131): python3-jinja2-2.10.1-3.el8.noarch.r 13 MB/s | 538 kB 00:00 2023-11-08T19:20:34.199 INFO:teuthology.orchestra.run.smithi160.stdout:(104/131): python3-mako-1.0.6-13.el8.noarch.rpm 3.7 MB/s | 157 kB 00:00 2023-11-08T19:20:34.233 INFO:teuthology.orchestra.run.smithi160.stdout:(105/131): oniguruma-6.8.2-2.el8.x86_64.rpm 5.5 MB/s | 187 kB 00:00 2023-11-08T19:20:34.383 INFO:teuthology.orchestra.run.smithi160.stdout:(106/131): python3-scipy-1.0.0-21.module+el8.5. 22 MB/s | 14 MB 00:00 2023-11-08T19:20:34.449 INFO:teuthology.orchestra.run.smithi160.stdout:(107/131): automake-1.16.1-7.el8.noarch.rpm 3.2 MB/s | 713 kB 00:00 2023-11-08T19:20:34.492 INFO:teuthology.orchestra.run.smithi160.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 621 kB/s | 27 kB 00:00 2023-11-08T19:20:34.534 INFO:teuthology.orchestra.run.smithi160.stdout:(109/131): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-11-08T19:20:34.567 INFO:teuthology.orchestra.run.smithi160.stdout:(110/131): python3-prettytable-0.7.2-14.el8.noa 1.3 MB/s | 44 kB 00:00 2023-11-08T19:20:34.635 INFO:teuthology.orchestra.run.smithi160.stdout:(111/131): python3-babel-2.5.1-7.el8.noarch.rpm 19 MB/s | 4.8 MB 00:00 2023-11-08T19:20:34.676 INFO:teuthology.orchestra.run.smithi160.stdout:(112/131): python3-werkzeug-0.12.2-4.el8.noarch 11 MB/s | 457 kB 00:00 2023-11-08T19:20:34.718 INFO:teuthology.orchestra.run.smithi160.stdout:(113/131): python3-numpy-f2py-1.14.3-10.el8.x86 5.3 MB/s | 225 kB 00:00 2023-11-08T19:20:34.794 INFO:teuthology.orchestra.run.smithi160.stdout:(114/131): python3-numpy-1.14.3-10.el8.x86_64.r 17 MB/s | 3.7 MB 00:00 2023-11-08T19:20:34.819 INFO:teuthology.orchestra.run.smithi160.stdout:(115/131): uuid-1.6.2-43.el8.x86_64.rpm 639 kB/s | 64 kB 00:00 2023-11-08T19:20:34.837 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2023-11-08T19:20:34.841 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2023-11-08T19:20:35.236 INFO:teuthology.orchestra.run.smithi160.stdout:(116/131): ceph-test-18.0.0-7035.g7532011a.el8. 5.7 MB/s | 49 MB 00:08 2023-11-08T19:20:35.261 INFO:teuthology.orchestra.run.smithi160.stdout:(117/131): python3-jsonpointer-1.10-11.el8.noar 45 kB/s | 20 kB 00:00 2023-11-08T19:20:35.316 INFO:teuthology.orchestra.run.smithi160.stdout:(118/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 242 kB/s | 126 kB 00:00 2023-11-08T19:20:35.345 INFO:teuthology.orchestra.run.smithi160.stdout:(119/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 969 kB/s | 103 kB 00:00 2023-11-08T19:20:35.379 INFO:teuthology.orchestra.run.smithi160.stdout:(120/131): libtool-2.4.6-25.el8.x86_64.rpm 6.2 MB/s | 709 kB 00:00 2023-11-08T19:20:35.404 INFO:teuthology.orchestra.run.smithi160.stdout:(121/131): libpq-13.5-1.el8.x86_64.rpm 3.3 MB/s | 198 kB 00:00 2023-11-08T19:20:35.446 INFO:teuthology.orchestra.run.smithi160.stdout:(122/131): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-11-08T19:20:35.488 INFO:teuthology.orchestra.run.smithi160.stdout:(123/131): librdkafka-0.11.4-3.el8.x86_64.rpm 8.3 MB/s | 354 kB 00:00 2023-11-08T19:20:35.588 INFO:teuthology.orchestra.run.smithi160.stdout:(124/131): openblas-threads-0.3.15-3.el8.x86_64 18 MB/s | 4.9 MB 00:00 2023-11-08T19:20:35.663 INFO:teuthology.orchestra.run.smithi160.stdout:(125/131): openblas-0.3.15-3.el8.x86_64.rpm 17 MB/s | 4.7 MB 00:00 2023-11-08T19:20:35.722 INFO:teuthology.orchestra.run.smithi160.stdout:(126/131): postgresql-contrib-10.21-2.module+el 5.9 MB/s | 808 kB 00:00 2023-11-08T19:20:35.781 INFO:teuthology.orchestra.run.smithi160.stdout:(127/131): postgresql-10.21-2.module+el8.6.0+15 13 MB/s | 1.5 MB 00:00 2023-11-08T19:20:35.856 INFO:teuthology.orchestra.run.smithi160.stdout:(128/131): postgresql-server-10.21-2.module+el8 14 MB/s | 5.1 MB 00:00 2023-11-08T19:20:35.906 INFO:teuthology.orchestra.run.smithi160.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 16 MB/s | 798 kB 00:00 2023-11-08T19:20:36.382 INFO:teuthology.orchestra.run.smithi160.stdout:(130/131): librbd1-18.0.0-7035.g7532011a.el8.x8 6.2 MB/s | 3.7 MB 00:00 2023-11-08T19:20:36.432 INFO:teuthology.orchestra.run.smithi160.stdout:(131/131): librados2-18.0.0-7035.g7532011a.el8. 5.3 MB/s | 3.8 MB 00:00 2023-11-08T19:20:36.434 INFO:teuthology.orchestra.run.smithi160.stdout:-------------------------------------------------------------------------------- 2023-11-08T19:20:36.435 INFO:teuthology.orchestra.run.smithi160.stdout:Total 15 MB/s | 209 MB 00:13 2023-11-08T19:20:37.259 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction check 2023-11-08T19:20:37.378 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction check succeeded. 2023-11-08T19:20:37.379 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction test 2023-11-08T19:20:38.513 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction test succeeded. 2023-11-08T19:20:38.516 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction 2023-11-08T19:20:39.926 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2023-11-08T19:20:40.102 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-11-08T19:20:40.261 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-11-08T19:20:40.438 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-11-08T19:20:40.640 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-11-08T19:20:41.055 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-11-08T19:20:41.475 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-11-08T19:20:41.706 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : librados2-2:18.0.0-7035.g7532011a.el8.x86_64 5/134 2023-11-08T19:20:42.100 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librados2-2:18.0.0-7035.g7532011a.el8.x86_64 5/134 2023-11-08T19:20:42.280 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : librbd1-2:18.0.0-7035.g7532011a.el8.x86_64 6/134 2023-11-08T19:20:42.412 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librbd1-2:18.0.0-7035.g7532011a.el8.x86_64 6/134 2023-11-08T19:20:42.638 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libcephfs2-2:18.0.0-7035.g7532011a.el8.x86_64 7/134 2023-11-08T19:20:42.738 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libcephfs2-2:18.0.0-7035.g7532011a.el8.x86_64 7/134 2023-11-08T19:20:42.934 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rados-2:18.0.0-7035.g7532011a.el8.x86_64 8/134 2023-11-08T19:20:43.097 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-11-08T19:20:43.316 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-11-08T19:20:43.503 INFO:teuthology.orchestra.run.smithi160.stdout: Preparing : 1/1 2023-11-08T19:20:43.507 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-11-08T19:20:43.708 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-11-08T19:20:43.891 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-11-08T19:20:43.901 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-11-08T19:20:44.110 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-11-08T19:20:44.193 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-11-08T19:20:44.238 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-11-08T19:20:44.354 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libcephsqlite-2:18.0.0-7035.g7532011a.el8.x86_64 14/134 2023-11-08T19:20:44.457 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libcephsqlite-2:18.0.0-7035.g7532011a.el8.x86_64 14/134 2023-11-08T19:20:44.485 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-11-08T19:20:44.654 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libradosstriper1-2:18.0.0-7035.g7532011a.el8.x86 15/134 2023-11-08T19:20:44.803 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libradosstriper1-2:18.0.0-7035.g7532011a.el8.x86 15/134 2023-11-08T19:20:44.891 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-11-08T19:20:44.982 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-11-08T19:20:45.101 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : librados2-2:18.0.0-7035.g7532011a.el8.x86_64 5/134 2023-11-08T19:20:45.160 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-11-08T19:20:45.316 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-11-08T19:20:45.470 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-11-08T19:20:45.510 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librados2-2:18.0.0-7035.g7532011a.el8.x86_64 5/134 2023-11-08T19:20:45.605 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-11-08T19:20:45.735 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : librbd1-2:18.0.0-7035.g7532011a.el8.x86_64 6/134 2023-11-08T19:20:45.754 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-11-08T19:20:45.852 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librbd1-2:18.0.0-7035.g7532011a.el8.x86_64 6/134 2023-11-08T19:20:46.026 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libcephfs2-2:18.0.0-7035.g7532011a.el8.x86_64 7/134 2023-11-08T19:20:46.118 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libcephfs2-2:18.0.0-7035.g7532011a.el8.x86_64 7/134 2023-11-08T19:20:46.314 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rados-2:18.0.0-7035.g7532011a.el8.x86_64 8/134 2023-11-08T19:20:46.366 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-11-08T19:20:46.519 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-11-08T19:20:46.612 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-11-08T19:20:46.789 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-11-08T19:20:47.029 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-11-08T19:20:47.235 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-11-08T19:20:47.412 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-11-08T19:20:47.445 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-11-08T19:20:47.704 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-11-08T19:20:47.892 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libcephsqlite-2:18.0.0-7035.g7532011a.el8.x86_64 14/134 2023-11-08T19:20:47.988 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libcephsqlite-2:18.0.0-7035.g7532011a.el8.x86_64 14/134 2023-11-08T19:20:48.118 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-11-08T19:20:48.184 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libradosstriper1-2:18.0.0-7035.g7532011a.el8.x86 15/134 2023-11-08T19:20:48.319 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libradosstriper1-2:18.0.0-7035.g7532011a.el8.x86 15/134 2023-11-08T19:20:48.428 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-11-08T19:20:48.617 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-11-08T19:20:48.766 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-11-08T19:20:48.888 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-11-08T19:20:48.951 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-11-08T19:20:49.026 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-ceph-common-2:18.0.0-7035.g7532011a.el8. 26/134 2023-11-08T19:20:49.124 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-11-08T19:20:49.147 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-ceph-argparse-2:18.0.0-7035.g7532011a.el 27/134 2023-11-08T19:20:49.286 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-11-08T19:20:49.415 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cephfs-2:18.0.0-7035.g7532011a.el8.x86_6 28/134 2023-11-08T19:20:49.432 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-11-08T19:20:49.576 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-11-08T19:20:49.595 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-11-08T19:20:50.220 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-11-08T19:20:50.384 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-11-08T19:20:50.984 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-11-08T19:20:51.142 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-11-08T19:20:51.363 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-11-08T19:20:51.847 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-11-08T19:20:52.103 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-11-08T19:20:52.323 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-11-08T19:20:52.368 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-11-08T19:20:52.544 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-11-08T19:20:52.717 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-11-08T19:20:52.748 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-ceph-common-2:18.0.0-7035.g7532011a.el8. 26/134 2023-11-08T19:20:52.886 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-ceph-argparse-2:18.0.0-7035.g7532011a.el 27/134 2023-11-08T19:20:52.980 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-11-08T19:20:53.121 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cephfs-2:18.0.0-7035.g7532011a.el8.x86_6 28/134 2023-11-08T19:20:53.175 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-11-08T19:20:53.308 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-11-08T19:20:53.355 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-11-08T19:20:53.555 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-11-08T19:20:53.725 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rbd-2:18.0.0-7035.g7532011a.el8.x86_64 36/134 2023-11-08T19:20:53.909 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librados-devel-2:18.0.0-7035.g7532011a.el8.x86_6 37/134 2023-11-08T19:20:54.043 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-11-08T19:20:54.179 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-11-08T19:20:54.369 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-11-08T19:20:54.436 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-11-08T19:20:54.651 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-11-08T19:20:54.898 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-11-08T19:20:55.044 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-11-08T19:20:55.065 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-11-08T19:20:55.148 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-11-08T19:20:55.374 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-11-08T19:20:55.580 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-11-08T19:20:55.756 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-11-08T19:20:55.913 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-11-08T19:20:56.105 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-11-08T19:20:56.127 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-11-08T19:20:56.231 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-11-08T19:20:56.447 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-11-08T19:20:56.477 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-11-08T19:20:56.650 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-11-08T19:20:56.734 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-11-08T19:20:56.967 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-11-08T19:20:57.049 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-11-08T19:20:57.219 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-11-08T19:20:57.401 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-11-08T19:20:57.463 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-11-08T19:20:57.597 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rbd-2:18.0.0-7035.g7532011a.el8.x86_64 36/134 2023-11-08T19:20:57.647 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-11-08T19:20:57.755 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librados-devel-2:18.0.0-7035.g7532011a.el8.x86_6 37/134 2023-11-08T19:20:57.884 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-11-08T19:20:57.956 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-11-08T19:20:58.125 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-11-08T19:20:58.132 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-11-08T19:20:58.349 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-11-08T19:20:58.416 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-11-08T19:20:58.429 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-11-08T19:20:58.626 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-11-08T19:20:58.676 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-11-08T19:20:58.861 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-11-08T19:20:58.877 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-11-08T19:20:59.033 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-11-08T19:20:59.106 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-11-08T19:20:59.112 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-11-08T19:20:59.256 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-11-08T19:20:59.353 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-11-08T19:20:59.438 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-11-08T19:20:59.527 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-11-08T19:20:59.717 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-11-08T19:20:59.729 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-11-08T19:20:59.910 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-11-08T19:20:59.989 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-11-08T19:21:00.127 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-11-08T19:21:00.222 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-11-08T19:21:00.303 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-11-08T19:21:00.461 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-11-08T19:21:00.566 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-11-08T19:21:00.610 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-11-08T19:21:00.765 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-11-08T19:21:00.789 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-11-08T19:21:01.042 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-11-08T19:21:01.159 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-11-08T19:21:01.242 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-11-08T19:21:01.390 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-11-08T19:21:01.434 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-11-08T19:21:01.571 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-11-08T19:21:01.652 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-11-08T19:21:01.728 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-11-08T19:21:01.949 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-11-08T19:21:01.953 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-11-08T19:21:02.121 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-11-08T19:21:02.178 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-11-08T19:21:02.254 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-11-08T19:21:02.416 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-11-08T19:21:02.522 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-11-08T19:21:02.631 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-11-08T19:21:02.806 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-11-08T19:21:02.855 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-11-08T19:21:03.018 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-11-08T19:21:03.040 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-11-08T19:21:03.262 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-11-08T19:21:03.319 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-11-08T19:21:03.474 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-11-08T19:21:03.550 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-11-08T19:21:03.653 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-11-08T19:21:03.733 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-11-08T19:21:03.936 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-11-08T19:21:03.972 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-11-08T19:21:04.262 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-11-08T19:21:04.537 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-11-08T19:21:04.775 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-11-08T19:21:04.956 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-11-08T19:21:05.064 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-11-08T19:21:05.142 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-11-08T19:21:05.304 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-11-08T19:21:05.432 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-11-08T19:21:05.559 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-11-08T19:21:05.646 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-11-08T19:21:05.827 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-11-08T19:21:05.834 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-11-08T19:21:06.000 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-11-08T19:21:06.078 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-11-08T19:21:06.223 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-11-08T19:21:06.309 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-11-08T19:21:06.426 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-11-08T19:21:06.633 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-11-08T19:21:06.801 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-11-08T19:21:06.954 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-11-08T19:21:07.117 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-11-08T19:21:07.238 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-11-08T19:21:07.317 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librgw2-2:18.0.0-7035.g7532011a.el8.x86_64 92/134 2023-11-08T19:21:07.389 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librgw2-2:18.0.0-7035.g7532011a.el8.x86_64 92/134 2023-11-08T19:21:07.503 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-11-08T19:21:07.585 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rgw-2:18.0.0-7035.g7532011a.el8.x86_64 93/134 2023-11-08T19:21:07.704 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-11-08T19:21:07.953 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-11-08T19:21:08.189 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-11-08T19:21:08.398 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-11-08T19:21:08.625 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-11-08T19:21:09.722 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-11-08T19:21:10.002 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-11-08T19:21:10.264 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-11-08T19:21:10.540 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-11-08T19:21:10.826 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-11-08T19:21:11.045 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-11-08T19:21:11.393 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-common-2:18.0.0-7035.g7532011a.el8.x86_64 94/134 2023-11-08T19:21:11.609 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-common-2:18.0.0-7035.g7532011a.el8.x86_64 94/134 2023-11-08T19:21:11.853 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-11-08T19:21:12.047 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librgw2-2:18.0.0-7035.g7532011a.el8.x86_64 92/134 2023-11-08T19:21:12.125 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librgw2-2:18.0.0-7035.g7532011a.el8.x86_64 92/134 2023-11-08T19:21:12.208 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-common-2:18.0.0-7035.g7532011a.el8.x86_64 94/134 2023-11-08T19:21:12.348 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rgw-2:18.0.0-7035.g7532011a.el8.x86_64 93/134 2023-11-08T19:21:12.981 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-base-2:18.0.0-7035.g7532011a.el8.x86_64 95/134 2023-11-08T19:21:13.050 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-base-2:18.0.0-7035.g7532011a.el8.x86_64 95/134 2023-11-08T19:21:13.183 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-selinux-2:18.0.0-7035.g7532011a.el8.x86_64 96/134 2023-11-08T19:21:16.192 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-common-2:18.0.0-7035.g7532011a.el8.x86_64 94/134 2023-11-08T19:21:16.397 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-common-2:18.0.0-7035.g7532011a.el8.x86_64 94/134 2023-11-08T19:21:16.991 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-common-2:18.0.0-7035.g7532011a.el8.x86_64 94/134 2023-11-08T19:21:17.289 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-base-2:18.0.0-7035.g7532011a.el8.x86_64 95/134 2023-11-08T19:21:17.358 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-base-2:18.0.0-7035.g7532011a.el8.x86_64 95/134 2023-11-08T19:21:17.546 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-selinux-2:18.0.0-7035.g7532011a.el8.x86_64 96/134 2023-11-08T19:21:32.365 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-selinux-2:18.0.0-7035.g7532011a.el8.x86_64 96/134 2023-11-08T19:21:32.366 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /sys 2023-11-08T19:21:32.366 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /proc 2023-11-08T19:21:32.366 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /dev 2023-11-08T19:21:32.367 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /run 2023-11-08T19:21:32.367 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /mnt 2023-11-08T19:21:32.367 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /var/tmp 2023-11-08T19:21:32.367 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /home 2023-11-08T19:21:32.367 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /tmp 2023-11-08T19:21:32.368 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /dev 2023-11-08T19:21:32.368 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:21:32.697 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-volume-2:18.0.0-7035.g7532011a.el8.noarch 97/134 2023-11-08T19:21:34.303 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-volume-2:18.0.0-7035.g7532011a.el8.noarch 97/134 2023-11-08T19:21:34.461 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-osd-2:18.0.0-7035.g7532011a.el8.x86_64 98/134 2023-11-08T19:21:34.680 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-osd-2:18.0.0-7035.g7532011a.el8.x86_64 98/134 2023-11-08T19:21:34.830 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mds-2:18.0.0-7035.g7532011a.el8.x86_64 99/134 2023-11-08T19:21:35.296 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mds-2:18.0.0-7035.g7532011a.el8.x86_64 99/134 2023-11-08T19:21:35.505 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mon-2:18.0.0-7035.g7532011a.el8.x86_64 100/134 2023-11-08T19:21:35.522 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mon-2:18.0.0-7035.g7532011a.el8.x86_64 100/134 2023-11-08T19:21:36.418 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-selinux-2:18.0.0-7035.g7532011a.el8.x86_64 96/134 2023-11-08T19:21:36.418 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /sys 2023-11-08T19:21:36.419 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /proc 2023-11-08T19:21:36.419 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /dev 2023-11-08T19:21:36.419 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /run 2023-11-08T19:21:36.419 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /mnt 2023-11-08T19:21:36.419 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /var/tmp 2023-11-08T19:21:36.420 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /home 2023-11-08T19:21:36.420 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /tmp 2023-11-08T19:21:36.420 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /dev 2023-11-08T19:21:36.420 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:21:36.785 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-volume-2:18.0.0-7035.g7532011a.el8.noarch 97/134 2023-11-08T19:21:37.239 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: cephadm-2:18.0.0-7035.g7532011a.el8.noarch 101/134 2023-11-08T19:21:37.421 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : cephadm-2:18.0.0-7035.g7532011a.el8.noarch 101/134 2023-11-08T19:21:37.560 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-7035.g7532011a.e 102/134 2023-11-08T19:21:37.720 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-7035.g7532011a. 103/134 2023-11-08T19:21:37.879 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-7035.g7532011a.el8.noa 104/134 2023-11-08T19:21:38.101 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-7035.g7532011a.el8.noa 104/134 2023-11-08T19:21:38.387 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-volume-2:18.0.0-7035.g7532011a.el8.noarch 97/134 2023-11-08T19:21:38.443 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-7035.g7532011a.el8.n 105/134 2023-11-08T19:21:38.577 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-osd-2:18.0.0-7035.g7532011a.el8.x86_64 98/134 2023-11-08T19:21:38.797 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-osd-2:18.0.0-7035.g7532011a.el8.x86_64 98/134 2023-11-08T19:21:38.968 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mds-2:18.0.0-7035.g7532011a.el8.x86_64 99/134 2023-11-08T19:21:39.413 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-7035.g7532011a.el8.n 105/134 2023-11-08T19:21:39.429 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mds-2:18.0.0-7035.g7532011a.el8.x86_64 99/134 2023-11-08T19:21:39.554 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-7035.g753 106/134 2023-11-08T19:21:39.627 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mon-2:18.0.0-7035.g7532011a.el8.x86_64 100/134 2023-11-08T19:21:39.643 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mon-2:18.0.0-7035.g7532011a.el8.x86_64 100/134 2023-11-08T19:21:39.645 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-7035.g753 106/134 2023-11-08T19:21:40.028 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-7035.g7532011a.el 107/134 2023-11-08T19:21:40.211 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-2:18.0.0-7035.g7532011a.el8.x86_64 108/134 2023-11-08T19:21:40.245 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-2:18.0.0-7035.g7532011a.el8.x86_64 108/134 2023-11-08T19:21:40.446 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-rook-2:18.0.0-7035.g7532011a.el8.noarch 109/134 2023-11-08T19:21:40.457 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-7035.g7532011a.el8.noarch 109/134 2023-11-08T19:21:41.373 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: cephadm-2:18.0.0-7035.g7532011a.el8.noarch 101/134 2023-11-08T19:21:41.604 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : cephadm-2:18.0.0-7035.g7532011a.el8.noarch 101/134 2023-11-08T19:21:41.740 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-7035.g7532011a.e 102/134 2023-11-08T19:21:41.790 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-2:18.0.0-7035.g7532011a.el8.x86_64 110/134 2023-11-08T19:21:41.932 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-7035.g7532011a. 103/134 2023-11-08T19:21:41.985 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-radosgw-2:18.0.0-7035.g7532011a.el8.x86_64 111/134 2023-11-08T19:21:42.028 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-7035.g7532011a.el8.x86_64 111/134 2023-11-08T19:21:42.134 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-7035.g7532011a.el8.noa 104/134 2023-11-08T19:21:42.196 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-7035.g75320 112/134 2023-11-08T19:21:42.238 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-7035.g75320 112/134 2023-11-08T19:21:42.353 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-7035.g7532011a.el8.noa 104/134 2023-11-08T19:21:42.370 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : cephfs-mirror-2:18.0.0-7035.g7532011a.el8.x86_64 113/134 2023-11-08T19:21:42.659 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-7035.g7532011a.el8.n 105/134 2023-11-08T19:21:42.732 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-7035.g7532011a.el8.x86_64 113/134 2023-11-08T19:21:42.887 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : rbd-mirror-2:18.0.0-7035.g7532011a.el8.x86_64 114/134 2023-11-08T19:21:43.617 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-7035.g7532011a.el8.n 105/134 2023-11-08T19:21:43.818 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-7035.g753 106/134 2023-11-08T19:21:43.908 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-7035.g753 106/134 2023-11-08T19:21:44.285 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-7035.g7532011a.el 107/134 2023-11-08T19:21:44.468 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-2:18.0.0-7035.g7532011a.el8.x86_64 108/134 2023-11-08T19:21:44.503 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-2:18.0.0-7035.g7532011a.el8.x86_64 108/134 2023-11-08T19:21:44.717 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-rook-2:18.0.0-7035.g7532011a.el8.noarch 109/134 2023-11-08T19:21:44.728 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-7035.g7532011a.el8.noarch 109/134 2023-11-08T19:21:46.074 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-2:18.0.0-7035.g7532011a.el8.x86_64 110/134 2023-11-08T19:21:46.271 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-radosgw-2:18.0.0-7035.g7532011a.el8.x86_64 111/134 2023-11-08T19:21:46.315 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-7035.g7532011a.el8.x86_64 111/134 2023-11-08T19:21:46.467 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-7035.g75320 112/134 2023-11-08T19:21:46.509 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-7035.g75320 112/134 2023-11-08T19:21:46.659 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : cephfs-mirror-2:18.0.0-7035.g7532011a.el8.x86_64 113/134 2023-11-08T19:21:47.019 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-7035.g7532011a.el8.x86_64 113/134 2023-11-08T19:21:47.234 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : rbd-mirror-2:18.0.0-7035.g7532011a.el8.x86_64 114/134 2023-11-08T19:21:47.582 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: rbd-mirror-2:18.0.0-7035.g7532011a.el8.x86_64 114/134 2023-11-08T19:21:48.452 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-test-2:18.0.0-7035.g7532011a.el8.x86_64 115/134 2023-11-08T19:21:48.790 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-11-08T19:21:48.988 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-fuse-2:18.0.0-7035.g7532011a.el8.x86_64 117/134 2023-11-08T19:21:49.220 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-11-08T19:21:49.361 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-11-08T19:21:49.552 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-11-08T19:21:49.832 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-11-08T19:21:49.990 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libcephfs-devel-2:18.0.0-7035.g7532011a.el8.x86_ 121/134 2023-11-08T19:21:50.170 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-11-08T19:21:51.891 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: rbd-mirror-2:18.0.0-7035.g7532011a.el8.x86_64 114/134 2023-11-08T19:21:52.420 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-11-08T19:21:52.702 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-11-08T19:21:52.720 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-11-08T19:21:52.781 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-test-2:18.0.0-7035.g7532011a.el8.x86_64 115/134 2023-11-08T19:21:52.894 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : cephfs-top-2:18.0.0-7035.g7532011a.el8.noarch 124/134 2023-11-08T19:21:53.119 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-11-08T19:21:53.185 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : rbd-fuse-2:18.0.0-7035.g7532011a.el8.x86_64 125/134 2023-11-08T19:21:53.363 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-fuse-2:18.0.0-7035.g7532011a.el8.x86_64 117/134 2023-11-08T19:21:53.472 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : rbd-nbd-2:18.0.0-7035.g7532011a.el8.x86_64 126/134 2023-11-08T19:21:53.602 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-11-08T19:21:53.782 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-11-08T19:21:53.850 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-11-08T19:21:53.973 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-11-08T19:21:54.068 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-11-08T19:21:54.153 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-11-08T19:21:54.220 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-11-08T19:21:54.378 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libcephfs-devel-2:18.0.0-7035.g7532011a.el8.x86_ 121/134 2023-11-08T19:21:54.402 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-11-08T19:21:54.415 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-11-08T19:21:54.554 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-11-08T19:21:54.560 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-11-08T19:21:54.569 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-11-08T19:21:54.721 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-11-08T19:21:54.721 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-11-08T19:21:54.913 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-11-08T19:21:54.913 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-11-08T19:21:55.175 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-11-08T19:21:55.367 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-11-08T19:21:55.885 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-11-08T19:21:55.885 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-2:18.0.0-7035.g7532011a.el8.x86_64 1/134 2023-11-08T19:21:55.885 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-base-2:18.0.0-7035.g7532011a.el8.x86_64 2/134 2023-11-08T19:21:55.886 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-common-2:18.0.0-7035.g7532011a.el8.x86_64 3/134 2023-11-08T19:21:55.886 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-fuse-2:18.0.0-7035.g7532011a.el8.x86_64 4/134 2023-11-08T19:21:55.886 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-7035.g75320 5/134 2023-11-08T19:21:55.886 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mds-2:18.0.0-7035.g7532011a.el8.x86_64 6/134 2023-11-08T19:21:55.886 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-2:18.0.0-7035.g7532011a.el8.x86_64 7/134 2023-11-08T19:21:55.887 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mon-2:18.0.0-7035.g7532011a.el8.x86_64 8/134 2023-11-08T19:21:55.887 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-osd-2:18.0.0-7035.g7532011a.el8.x86_64 9/134 2023-11-08T19:21:55.887 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-radosgw-2:18.0.0-7035.g7532011a.el8.x86_64 10/134 2023-11-08T19:21:55.888 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-selinux-2:18.0.0-7035.g7532011a.el8.x86_64 11/134 2023-11-08T19:21:55.888 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-test-2:18.0.0-7035.g7532011a.el8.x86_64 12/134 2023-11-08T19:21:55.888 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : cephfs-mirror-2:18.0.0-7035.g7532011a.el8.x86_64 13/134 2023-11-08T19:21:55.888 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libcephfs-devel-2:18.0.0-7035.g7532011a.el8.x86_ 14/134 2023-11-08T19:21:55.888 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libcephfs2-2:18.0.0-7035.g7532011a.el8.x86_64 15/134 2023-11-08T19:21:55.889 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libcephsqlite-2:18.0.0-7035.g7532011a.el8.x86_64 16/134 2023-11-08T19:21:55.889 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librados-devel-2:18.0.0-7035.g7532011a.el8.x86_6 17/134 2023-11-08T19:21:55.889 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libradosstriper1-2:18.0.0-7035.g7532011a.el8.x86 18/134 2023-11-08T19:21:55.889 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librgw2-2:18.0.0-7035.g7532011a.el8.x86_64 19/134 2023-11-08T19:21:55.889 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-ceph-argparse-2:18.0.0-7035.g7532011a.el 20/134 2023-11-08T19:21:55.890 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-ceph-common-2:18.0.0-7035.g7532011a.el8. 21/134 2023-11-08T19:21:55.890 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cephfs-2:18.0.0-7035.g7532011a.el8.x86_6 22/134 2023-11-08T19:21:55.890 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rados-2:18.0.0-7035.g7532011a.el8.x86_64 23/134 2023-11-08T19:21:55.890 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rbd-2:18.0.0-7035.g7532011a.el8.x86_64 24/134 2023-11-08T19:21:55.890 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rgw-2:18.0.0-7035.g7532011a.el8.x86_64 25/134 2023-11-08T19:21:55.891 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : rbd-fuse-2:18.0.0-7035.g7532011a.el8.x86_64 26/134 2023-11-08T19:21:55.891 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : rbd-mirror-2:18.0.0-7035.g7532011a.el8.x86_64 27/134 2023-11-08T19:21:55.891 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : rbd-nbd-2:18.0.0-7035.g7532011a.el8.x86_64 28/134 2023-11-08T19:21:55.891 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-7035.g7532011a. 29/134 2023-11-08T19:21:55.901 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-7035.g7532011a.el8.noa 30/134 2023-11-08T19:21:55.901 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-7035.g7532011a.el8.n 31/134 2023-11-08T19:21:55.901 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-7035.g753 32/134 2023-11-08T19:21:55.901 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-7035.g7532011a.el 33/134 2023-11-08T19:21:55.901 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-rook-2:18.0.0-7035.g7532011a.el8.noarch 34/134 2023-11-08T19:21:55.902 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-7035.g7532011a.e 35/134 2023-11-08T19:21:55.902 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-volume-2:18.0.0-7035.g7532011a.el8.noarch 36/134 2023-11-08T19:21:55.902 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : cephadm-2:18.0.0-7035.g7532011a.el8.noarch 37/134 2023-11-08T19:21:55.902 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : cephfs-top-2:18.0.0-7035.g7532011a.el8.noarch 38/134 2023-11-08T19:21:55.902 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-11-08T19:21:55.903 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-11-08T19:21:55.903 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-11-08T19:21:55.903 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-11-08T19:21:55.903 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-11-08T19:21:55.903 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-11-08T19:21:55.904 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-11-08T19:21:55.904 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-11-08T19:21:55.904 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-11-08T19:21:55.904 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-11-08T19:21:55.904 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-11-08T19:21:55.904 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-11-08T19:21:55.905 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-11-08T19:21:55.905 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-11-08T19:21:55.905 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-11-08T19:21:55.905 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-11-08T19:21:55.905 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-11-08T19:21:55.905 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-11-08T19:21:55.906 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-11-08T19:21:55.906 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-11-08T19:21:55.906 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-11-08T19:21:55.906 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-11-08T19:21:55.907 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-11-08T19:21:55.907 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-11-08T19:21:55.907 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-11-08T19:21:55.907 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-11-08T19:21:55.907 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-11-08T19:21:55.908 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-11-08T19:21:55.908 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-11-08T19:21:55.908 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-11-08T19:21:55.908 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-11-08T19:21:55.908 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-11-08T19:21:55.909 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-11-08T19:21:55.909 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-11-08T19:21:55.909 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-11-08T19:21:55.909 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-11-08T19:21:55.910 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-11-08T19:21:55.910 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-11-08T19:21:55.910 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-11-08T19:21:55.910 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-11-08T19:21:55.911 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-11-08T19:21:55.911 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-11-08T19:21:55.911 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-11-08T19:21:55.911 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-11-08T19:21:55.911 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-11-08T19:21:55.912 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-11-08T19:21:55.912 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-11-08T19:21:55.912 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-11-08T19:21:55.912 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-11-08T19:21:55.912 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-11-08T19:21:55.913 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-11-08T19:21:55.913 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-11-08T19:21:55.913 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-11-08T19:21:55.913 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-11-08T19:21:55.913 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-11-08T19:21:55.914 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-11-08T19:21:55.914 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-11-08T19:21:55.914 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-11-08T19:21:55.914 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-11-08T19:21:55.914 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-11-08T19:21:55.915 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-11-08T19:21:55.915 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-11-08T19:21:55.915 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-11-08T19:21:55.915 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-11-08T19:21:55.916 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-11-08T19:21:55.916 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-11-08T19:21:55.916 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-11-08T19:21:55.916 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-11-08T19:21:55.916 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-11-08T19:21:55.917 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-11-08T19:21:55.917 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-11-08T19:21:55.917 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-11-08T19:21:55.917 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-11-08T19:21:55.917 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-11-08T19:21:55.918 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-11-08T19:21:55.918 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-11-08T19:21:55.918 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-11-08T19:21:55.918 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-11-08T19:21:55.919 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-11-08T19:21:55.919 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-11-08T19:21:55.919 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-11-08T19:21:55.919 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-11-08T19:21:55.920 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-11-08T19:21:55.920 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-11-08T19:21:55.920 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-11-08T19:21:55.920 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-11-08T19:21:55.920 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-11-08T19:21:55.921 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-11-08T19:21:55.921 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-11-08T19:21:55.921 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-11-08T19:21:55.921 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librados2-2:18.0.0-7035.g7532011a.el8.x86_64 129/134 2023-11-08T19:21:55.921 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-11-08T19:21:55.922 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librbd1-2:18.0.0-7035.g7532011a.el8.x86_64 131/134 2023-11-08T19:21:55.922 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-11-08T19:21:55.922 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-11-08T19:21:56.776 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-11-08T19:21:56.999 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-11-08T19:21:57.016 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-11-08T19:21:57.207 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : cephfs-top-2:18.0.0-7035.g7532011a.el8.noarch 124/134 2023-11-08T19:21:57.498 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : rbd-fuse-2:18.0.0-7035.g7532011a.el8.x86_64 125/134 2023-11-08T19:21:57.802 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : rbd-nbd-2:18.0.0-7035.g7532011a.el8.x86_64 126/134 2023-11-08T19:21:58.172 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-11-08T19:21:58.340 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-11-08T19:21:58.425 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-11-08T19:21:58.624 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-11-08T19:21:58.625 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:51 ago on Wed 08 Nov 2023 07:20:07 PM UTC. 2023-11-08T19:21:58.657 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-11-08T19:21:58.669 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-11-08T19:21:58.823 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-11-08T19:21:58.831 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-11-08T19:21:58.975 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-11-08T19:21:58.976 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-11-08T19:21:59.185 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-11-08T19:21:59.185 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-11-08T19:21:59.465 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-11-08T19:21:59.647 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-11-08T19:22:00.149 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-11-08T19:22:00.150 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-2:18.0.0-7035.g7532011a.el8.x86_64 1/134 2023-11-08T19:22:00.150 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-base-2:18.0.0-7035.g7532011a.el8.x86_64 2/134 2023-11-08T19:22:00.150 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-common-2:18.0.0-7035.g7532011a.el8.x86_64 3/134 2023-11-08T19:22:00.150 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-fuse-2:18.0.0-7035.g7532011a.el8.x86_64 4/134 2023-11-08T19:22:00.151 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-7035.g75320 5/134 2023-11-08T19:22:00.151 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mds-2:18.0.0-7035.g7532011a.el8.x86_64 6/134 2023-11-08T19:22:00.151 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-2:18.0.0-7035.g7532011a.el8.x86_64 7/134 2023-11-08T19:22:00.151 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mon-2:18.0.0-7035.g7532011a.el8.x86_64 8/134 2023-11-08T19:22:00.151 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-osd-2:18.0.0-7035.g7532011a.el8.x86_64 9/134 2023-11-08T19:22:00.152 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-radosgw-2:18.0.0-7035.g7532011a.el8.x86_64 10/134 2023-11-08T19:22:00.152 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-selinux-2:18.0.0-7035.g7532011a.el8.x86_64 11/134 2023-11-08T19:22:00.152 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-test-2:18.0.0-7035.g7532011a.el8.x86_64 12/134 2023-11-08T19:22:00.152 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : cephfs-mirror-2:18.0.0-7035.g7532011a.el8.x86_64 13/134 2023-11-08T19:22:00.152 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libcephfs-devel-2:18.0.0-7035.g7532011a.el8.x86_ 14/134 2023-11-08T19:22:00.152 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libcephfs2-2:18.0.0-7035.g7532011a.el8.x86_64 15/134 2023-11-08T19:22:00.153 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libcephsqlite-2:18.0.0-7035.g7532011a.el8.x86_64 16/134 2023-11-08T19:22:00.153 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librados-devel-2:18.0.0-7035.g7532011a.el8.x86_6 17/134 2023-11-08T19:22:00.153 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libradosstriper1-2:18.0.0-7035.g7532011a.el8.x86 18/134 2023-11-08T19:22:00.153 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librgw2-2:18.0.0-7035.g7532011a.el8.x86_64 19/134 2023-11-08T19:22:00.154 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-ceph-argparse-2:18.0.0-7035.g7532011a.el 20/134 2023-11-08T19:22:00.154 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-ceph-common-2:18.0.0-7035.g7532011a.el8. 21/134 2023-11-08T19:22:00.154 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cephfs-2:18.0.0-7035.g7532011a.el8.x86_6 22/134 2023-11-08T19:22:00.154 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rados-2:18.0.0-7035.g7532011a.el8.x86_64 23/134 2023-11-08T19:22:00.154 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rbd-2:18.0.0-7035.g7532011a.el8.x86_64 24/134 2023-11-08T19:22:00.155 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rgw-2:18.0.0-7035.g7532011a.el8.x86_64 25/134 2023-11-08T19:22:00.155 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : rbd-fuse-2:18.0.0-7035.g7532011a.el8.x86_64 26/134 2023-11-08T19:22:00.155 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : rbd-mirror-2:18.0.0-7035.g7532011a.el8.x86_64 27/134 2023-11-08T19:22:00.155 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : rbd-nbd-2:18.0.0-7035.g7532011a.el8.x86_64 28/134 2023-11-08T19:22:00.156 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-7035.g7532011a. 29/134 2023-11-08T19:22:00.156 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-7035.g7532011a.el8.noa 30/134 2023-11-08T19:22:00.164 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-7035.g7532011a.el8.n 31/134 2023-11-08T19:22:00.164 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-7035.g753 32/134 2023-11-08T19:22:00.165 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-7035.g7532011a.el 33/134 2023-11-08T19:22:00.165 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-rook-2:18.0.0-7035.g7532011a.el8.noarch 34/134 2023-11-08T19:22:00.165 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-7035.g7532011a.e 35/134 2023-11-08T19:22:00.165 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-volume-2:18.0.0-7035.g7532011a.el8.noarch 36/134 2023-11-08T19:22:00.165 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : cephadm-2:18.0.0-7035.g7532011a.el8.noarch 37/134 2023-11-08T19:22:00.166 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : cephfs-top-2:18.0.0-7035.g7532011a.el8.noarch 38/134 2023-11-08T19:22:00.166 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-11-08T19:22:00.166 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-11-08T19:22:00.166 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-11-08T19:22:00.167 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-11-08T19:22:00.167 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-11-08T19:22:00.167 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-11-08T19:22:00.167 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-11-08T19:22:00.167 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-11-08T19:22:00.168 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-11-08T19:22:00.168 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-11-08T19:22:00.168 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-11-08T19:22:00.168 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-11-08T19:22:00.168 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-11-08T19:22:00.169 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-11-08T19:22:00.169 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-11-08T19:22:00.169 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-11-08T19:22:00.169 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-11-08T19:22:00.169 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-11-08T19:22:00.169 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-11-08T19:22:00.170 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-11-08T19:22:00.170 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-11-08T19:22:00.170 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-11-08T19:22:00.170 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-11-08T19:22:00.171 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-11-08T19:22:00.171 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-11-08T19:22:00.171 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-11-08T19:22:00.171 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-11-08T19:22:00.171 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-11-08T19:22:00.172 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-11-08T19:22:00.172 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-11-08T19:22:00.172 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-11-08T19:22:00.172 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-11-08T19:22:00.173 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-11-08T19:22:00.173 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-11-08T19:22:00.173 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-11-08T19:22:00.173 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-11-08T19:22:00.173 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-11-08T19:22:00.173 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-11-08T19:22:00.174 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-11-08T19:22:00.174 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-11-08T19:22:00.174 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-11-08T19:22:00.174 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-11-08T19:22:00.175 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-11-08T19:22:00.175 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-11-08T19:22:00.175 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-11-08T19:22:00.175 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-11-08T19:22:00.175 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-11-08T19:22:00.176 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-11-08T19:22:00.176 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-11-08T19:22:00.176 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-11-08T19:22:00.176 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-11-08T19:22:00.176 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-11-08T19:22:00.177 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-11-08T19:22:00.177 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-11-08T19:22:00.177 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-11-08T19:22:00.177 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-11-08T19:22:00.177 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-11-08T19:22:00.177 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-11-08T19:22:00.178 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-11-08T19:22:00.178 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-11-08T19:22:00.178 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-11-08T19:22:00.178 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-11-08T19:22:00.178 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-11-08T19:22:00.179 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-11-08T19:22:00.179 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-11-08T19:22:00.179 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-11-08T19:22:00.179 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-11-08T19:22:00.179 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-11-08T19:22:00.180 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-11-08T19:22:00.180 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-11-08T19:22:00.180 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-11-08T19:22:00.180 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-11-08T19:22:00.180 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-11-08T19:22:00.181 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-11-08T19:22:00.181 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-11-08T19:22:00.181 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-11-08T19:22:00.181 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-11-08T19:22:00.181 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-11-08T19:22:00.181 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-11-08T19:22:00.182 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-11-08T19:22:00.182 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-11-08T19:22:00.182 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-11-08T19:22:00.182 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-11-08T19:22:00.182 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-11-08T19:22:00.183 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-11-08T19:22:00.183 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-11-08T19:22:00.183 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-11-08T19:22:00.183 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-11-08T19:22:00.184 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-11-08T19:22:00.184 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-11-08T19:22:00.184 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librados2-2:18.0.0-7035.g7532011a.el8.x86_64 129/134 2023-11-08T19:22:00.184 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-11-08T19:22:00.184 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librbd1-2:18.0.0-7035.g7532011a.el8.x86_64 131/134 2023-11-08T19:22:00.185 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-11-08T19:22:00.185 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-11-08T19:22:01.169 INFO:teuthology.orchestra.run.smithi149.stdout:Installed products updated. 2023-11-08T19:22:01.411 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:22:01.411 INFO:teuthology.orchestra.run.smithi149.stdout:Upgraded: 2023-11-08T19:22:01.412 INFO:teuthology.orchestra.run.smithi149.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-11-08T19:22:01.412 INFO:teuthology.orchestra.run.smithi149.stdout: librados2-2:18.0.0-7035.g7532011a.el8.x86_64 2023-11-08T19:22:01.412 INFO:teuthology.orchestra.run.smithi149.stdout: librbd1-2:18.0.0-7035.g7532011a.el8.x86_64 2023-11-08T19:22:01.412 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2023-11-08T19:22:01.412 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-11-08T19:22:01.413 INFO:teuthology.orchestra.run.smithi149.stdout: automake-1.16.1-7.el8.noarch 2023-11-08T19:22:01.413 INFO:teuthology.orchestra.run.smithi149.stdout: bison-3.0.4-10.el8.x86_64 2023-11-08T19:22:01.413 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-2:18.0.0-7035.g7532011a.el8.x86_64 2023-11-08T19:22:01.413 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-base-2:18.0.0-7035.g7532011a.el8.x86_64 2023-11-08T19:22:01.413 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-common-2:18.0.0-7035.g7532011a.el8.x86_64 2023-11-08T19:22:01.414 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-fuse-2:18.0.0-7035.g7532011a.el8.x86_64 2023-11-08T19:22:01.414 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-grafana-dashboards-2:18.0.0-7035.g7532011a.el8.noarch 2023-11-08T19:22:01.414 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-immutable-object-cache-2:18.0.0-7035.g7532011a.el8.x86_64 2023-11-08T19:22:01.414 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mds-2:18.0.0-7035.g7532011a.el8.x86_64 2023-11-08T19:22:01.414 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-2:18.0.0-7035.g7532011a.el8.x86_64 2023-11-08T19:22:01.415 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-cephadm-2:18.0.0-7035.g7532011a.el8.noarch 2023-11-08T19:22:01.415 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-dashboard-2:18.0.0-7035.g7532011a.el8.noarch 2023-11-08T19:22:01.415 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-diskprediction-local-2:18.0.0-7035.g7532011a.el8.noarch 2023-11-08T19:22:01.415 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-modules-core-2:18.0.0-7035.g7532011a.el8.noarch 2023-11-08T19:22:01.415 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-rook-2:18.0.0-7035.g7532011a.el8.noarch 2023-11-08T19:22:01.415 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mon-2:18.0.0-7035.g7532011a.el8.x86_64 2023-11-08T19:22:01.416 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-osd-2:18.0.0-7035.g7532011a.el8.x86_64 2023-11-08T19:22:01.416 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-prometheus-alerts-2:18.0.0-7035.g7532011a.el8.noarch 2023-11-08T19:22:01.416 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-radosgw-2:18.0.0-7035.g7532011a.el8.x86_64 2023-11-08T19:22:01.416 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-selinux-2:18.0.0-7035.g7532011a.el8.x86_64 2023-11-08T19:22:01.416 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-test-2:18.0.0-7035.g7532011a.el8.x86_64 2023-11-08T19:22:01.417 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-volume-2:18.0.0-7035.g7532011a.el8.noarch 2023-11-08T19:22:01.417 INFO:teuthology.orchestra.run.smithi149.stdout: cephadm-2:18.0.0-7035.g7532011a.el8.noarch 2023-11-08T19:22:01.417 INFO:teuthology.orchestra.run.smithi149.stdout: cephfs-mirror-2:18.0.0-7035.g7532011a.el8.x86_64 2023-11-08T19:22:01.417 INFO:teuthology.orchestra.run.smithi149.stdout: cephfs-top-2:18.0.0-7035.g7532011a.el8.noarch 2023-11-08T19:22:01.417 INFO:teuthology.orchestra.run.smithi149.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-11-08T19:22:01.418 INFO:teuthology.orchestra.run.smithi149.stdout: flex-2.6.1-9.el8.x86_64 2023-11-08T19:22:01.418 INFO:teuthology.orchestra.run.smithi149.stdout: fuse-2.9.7-15.el8.x86_64 2023-11-08T19:22:01.418 INFO:teuthology.orchestra.run.smithi149.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-11-08T19:22:01.418 INFO:teuthology.orchestra.run.smithi149.stdout: jq-1.6-3.el8.x86_64 2023-11-08T19:22:01.418 INFO:teuthology.orchestra.run.smithi149.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-11-08T19:22:01.419 INFO:teuthology.orchestra.run.smithi149.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-11-08T19:22:01.419 INFO:teuthology.orchestra.run.smithi149.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-11-08T19:22:01.419 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs-devel-2:18.0.0-7035.g7532011a.el8.x86_64 2023-11-08T19:22:01.419 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs2-2:18.0.0-7035.g7532011a.el8.x86_64 2023-11-08T19:22:01.419 INFO:teuthology.orchestra.run.smithi149.stdout: libcephsqlite-2:18.0.0-7035.g7532011a.el8.x86_64 2023-11-08T19:22:01.419 INFO:teuthology.orchestra.run.smithi149.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-11-08T19:22:01.420 INFO:teuthology.orchestra.run.smithi149.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-11-08T19:22:01.420 INFO:teuthology.orchestra.run.smithi149.stdout: liboath-2.6.2-3.el8.x86_64 2023-11-08T19:22:01.420 INFO:teuthology.orchestra.run.smithi149.stdout: libpq-13.5-1.el8.x86_64 2023-11-08T19:22:01.420 INFO:teuthology.orchestra.run.smithi149.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-11-08T19:22:01.420 INFO:teuthology.orchestra.run.smithi149.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-11-08T19:22:01.421 INFO:teuthology.orchestra.run.smithi149.stdout: librados-devel-2:18.0.0-7035.g7532011a.el8.x86_64 2023-11-08T19:22:01.421 INFO:teuthology.orchestra.run.smithi149.stdout: libradosstriper1-2:18.0.0-7035.g7532011a.el8.x86_64 2023-11-08T19:22:01.421 INFO:teuthology.orchestra.run.smithi149.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-11-08T19:22:01.421 INFO:teuthology.orchestra.run.smithi149.stdout: librgw2-2:18.0.0-7035.g7532011a.el8.x86_64 2023-11-08T19:22:01.421 INFO:teuthology.orchestra.run.smithi149.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-11-08T19:22:01.422 INFO:teuthology.orchestra.run.smithi149.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-11-08T19:22:01.422 INFO:teuthology.orchestra.run.smithi149.stdout: libtool-2.4.6-25.el8.x86_64 2023-11-08T19:22:01.422 INFO:teuthology.orchestra.run.smithi149.stdout: libunwind-1.3.1-3.el8.x86_64 2023-11-08T19:22:01.422 INFO:teuthology.orchestra.run.smithi149.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-11-08T19:22:01.423 INFO:teuthology.orchestra.run.smithi149.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-11-08T19:22:01.423 INFO:teuthology.orchestra.run.smithi149.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-11-08T19:22:01.423 INFO:teuthology.orchestra.run.smithi149.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-11-08T19:22:01.423 INFO:teuthology.orchestra.run.smithi149.stdout: openblas-0.3.15-3.el8.x86_64 2023-11-08T19:22:01.424 INFO:teuthology.orchestra.run.smithi149.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-11-08T19:22:01.424 INFO:teuthology.orchestra.run.smithi149.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-11-08T19:22:01.424 INFO:teuthology.orchestra.run.smithi149.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-11-08T19:22:01.424 INFO:teuthology.orchestra.run.smithi149.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-11-08T19:22:01.424 INFO:teuthology.orchestra.run.smithi149.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-11-08T19:22:01.424 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-11-08T19:22:01.425 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-11-08T19:22:01.425 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-11-08T19:22:01.425 INFO:teuthology.orchestra.run.smithi149.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-11-08T19:22:01.425 INFO:teuthology.orchestra.run.smithi149.stdout: python3-babel-2.5.1-7.el8.noarch 2023-11-08T19:22:01.425 INFO:teuthology.orchestra.run.smithi149.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-11-08T19:22:01.426 INFO:teuthology.orchestra.run.smithi149.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-11-08T19:22:01.426 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-11-08T19:22:01.426 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-argparse-2:18.0.0-7035.g7532011a.el8.x86_64 2023-11-08T19:22:01.426 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-common-2:18.0.0-7035.g7532011a.el8.x86_64 2023-11-08T19:22:01.426 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cephfs-2:18.0.0-7035.g7532011a.el8.x86_64 2023-11-08T19:22:01.427 INFO:teuthology.orchestra.run.smithi149.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-11-08T19:22:01.427 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-11-08T19:22:01.427 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-11-08T19:22:01.427 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-11-08T19:22:01.427 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-11-08T19:22:01.428 INFO:teuthology.orchestra.run.smithi149.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-11-08T19:22:01.428 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-6.2-6.el8.noarch 2023-11-08T19:22:01.428 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-11-08T19:22:01.428 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-11-08T19:22:01.428 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-11-08T19:22:01.429 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-11-08T19:22:01.429 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-11-08T19:22:01.429 INFO:teuthology.orchestra.run.smithi149.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-11-08T19:22:01.429 INFO:teuthology.orchestra.run.smithi149.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-11-08T19:22:01.429 INFO:teuthology.orchestra.run.smithi149.stdout: python3-mako-1.0.6-13.el8.noarch 2023-11-08T19:22:01.430 INFO:teuthology.orchestra.run.smithi149.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-11-08T19:22:01.430 INFO:teuthology.orchestra.run.smithi149.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-11-08T19:22:01.430 INFO:teuthology.orchestra.run.smithi149.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-11-08T19:22:01.430 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-11-08T19:22:01.430 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-11-08T19:22:01.431 INFO:teuthology.orchestra.run.smithi149.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-11-08T19:22:01.431 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-11-08T19:22:01.431 INFO:teuthology.orchestra.run.smithi149.stdout: python3-portend-2.6-1.el8.noarch 2023-11-08T19:22:01.431 INFO:teuthology.orchestra.run.smithi149.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-11-08T19:22:01.431 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-11-08T19:22:01.432 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-11-08T19:22:01.432 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-11-08T19:22:01.432 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pycparser-2.14-14.el8.noarch 2023-11-08T19:22:01.432 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pytz-2017.2-9.el8.noarch 2023-11-08T19:22:01.432 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rados-2:18.0.0-7035.g7532011a.el8.x86_64 2023-11-08T19:22:01.432 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rbd-2:18.0.0-7035.g7532011a.el8.x86_64 2023-11-08T19:22:01.433 INFO:teuthology.orchestra.run.smithi149.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-11-08T19:22:01.433 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-11-08T19:22:01.433 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rgw-2:18.0.0-7035.g7532011a.el8.x86_64 2023-11-08T19:22:01.433 INFO:teuthology.orchestra.run.smithi149.stdout: python3-routes-2.4.1-12.el8.noarch 2023-11-08T19:22:01.433 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rsa-4.9-2.el8.noarch 2023-11-08T19:22:01.434 INFO:teuthology.orchestra.run.smithi149.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-11-08T19:22:01.434 INFO:teuthology.orchestra.run.smithi149.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-11-08T19:22:01.434 INFO:teuthology.orchestra.run.smithi149.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-11-08T19:22:01.434 INFO:teuthology.orchestra.run.smithi149.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-11-08T19:22:01.434 INFO:teuthology.orchestra.run.smithi149.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-11-08T19:22:01.435 INFO:teuthology.orchestra.run.smithi149.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-11-08T19:22:01.435 INFO:teuthology.orchestra.run.smithi149.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-11-08T19:22:01.435 INFO:teuthology.orchestra.run.smithi149.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-11-08T19:22:01.435 INFO:teuthology.orchestra.run.smithi149.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-11-08T19:22:01.435 INFO:teuthology.orchestra.run.smithi149.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-11-08T19:22:01.436 INFO:teuthology.orchestra.run.smithi149.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-11-08T19:22:01.436 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-fuse-2:18.0.0-7035.g7532011a.el8.x86_64 2023-11-08T19:22:01.436 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-mirror-2:18.0.0-7035.g7532011a.el8.x86_64 2023-11-08T19:22:01.436 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-nbd-2:18.0.0-7035.g7532011a.el8.x86_64 2023-11-08T19:22:01.436 INFO:teuthology.orchestra.run.smithi149.stdout: socat-1.7.4.1-1.el8.x86_64 2023-11-08T19:22:01.437 INFO:teuthology.orchestra.run.smithi149.stdout: thrift-0.13.0-2.el8.x86_64 2023-11-08T19:22:01.437 INFO:teuthology.orchestra.run.smithi149.stdout: uuid-1.6.2-43.el8.x86_64 2023-11-08T19:22:01.437 INFO:teuthology.orchestra.run.smithi149.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-11-08T19:22:01.437 INFO:teuthology.orchestra.run.smithi149.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-11-08T19:22:01.438 INFO:teuthology.orchestra.run.smithi149.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-11-08T19:22:01.438 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:22:01.438 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2023-11-08T19:22:01.683 DEBUG:teuthology.parallel:result is None 2023-11-08T19:22:02.896 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-11-08T19:22:02.896 INFO:teuthology.orchestra.run.smithi160.stdout:Last metadata expiration check: 0:01:52 ago on Wed 08 Nov 2023 07:20:10 PM UTC. 2023-11-08T19:22:05.439 INFO:teuthology.orchestra.run.smithi160.stdout:Installed products updated. 2023-11-08T19:22:05.663 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:22:05.664 INFO:teuthology.orchestra.run.smithi160.stdout:Upgraded: 2023-11-08T19:22:05.664 INFO:teuthology.orchestra.run.smithi160.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-11-08T19:22:05.664 INFO:teuthology.orchestra.run.smithi160.stdout: librados2-2:18.0.0-7035.g7532011a.el8.x86_64 2023-11-08T19:22:05.664 INFO:teuthology.orchestra.run.smithi160.stdout: librbd1-2:18.0.0-7035.g7532011a.el8.x86_64 2023-11-08T19:22:05.665 INFO:teuthology.orchestra.run.smithi160.stdout:Installed: 2023-11-08T19:22:05.665 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-11-08T19:22:05.665 INFO:teuthology.orchestra.run.smithi160.stdout: automake-1.16.1-7.el8.noarch 2023-11-08T19:22:05.665 INFO:teuthology.orchestra.run.smithi160.stdout: bison-3.0.4-10.el8.x86_64 2023-11-08T19:22:05.665 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-2:18.0.0-7035.g7532011a.el8.x86_64 2023-11-08T19:22:05.666 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-base-2:18.0.0-7035.g7532011a.el8.x86_64 2023-11-08T19:22:05.666 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-common-2:18.0.0-7035.g7532011a.el8.x86_64 2023-11-08T19:22:05.666 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-fuse-2:18.0.0-7035.g7532011a.el8.x86_64 2023-11-08T19:22:05.666 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-grafana-dashboards-2:18.0.0-7035.g7532011a.el8.noarch 2023-11-08T19:22:05.667 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-immutable-object-cache-2:18.0.0-7035.g7532011a.el8.x86_64 2023-11-08T19:22:05.667 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mds-2:18.0.0-7035.g7532011a.el8.x86_64 2023-11-08T19:22:05.667 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-2:18.0.0-7035.g7532011a.el8.x86_64 2023-11-08T19:22:05.667 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-cephadm-2:18.0.0-7035.g7532011a.el8.noarch 2023-11-08T19:22:05.667 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-dashboard-2:18.0.0-7035.g7532011a.el8.noarch 2023-11-08T19:22:05.668 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-diskprediction-local-2:18.0.0-7035.g7532011a.el8.noarch 2023-11-08T19:22:05.668 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-modules-core-2:18.0.0-7035.g7532011a.el8.noarch 2023-11-08T19:22:05.668 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-rook-2:18.0.0-7035.g7532011a.el8.noarch 2023-11-08T19:22:05.668 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mon-2:18.0.0-7035.g7532011a.el8.x86_64 2023-11-08T19:22:05.668 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-osd-2:18.0.0-7035.g7532011a.el8.x86_64 2023-11-08T19:22:05.669 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-prometheus-alerts-2:18.0.0-7035.g7532011a.el8.noarch 2023-11-08T19:22:05.669 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-radosgw-2:18.0.0-7035.g7532011a.el8.x86_64 2023-11-08T19:22:05.669 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-selinux-2:18.0.0-7035.g7532011a.el8.x86_64 2023-11-08T19:22:05.669 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-test-2:18.0.0-7035.g7532011a.el8.x86_64 2023-11-08T19:22:05.669 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-volume-2:18.0.0-7035.g7532011a.el8.noarch 2023-11-08T19:22:05.669 INFO:teuthology.orchestra.run.smithi160.stdout: cephadm-2:18.0.0-7035.g7532011a.el8.noarch 2023-11-08T19:22:05.670 INFO:teuthology.orchestra.run.smithi160.stdout: cephfs-mirror-2:18.0.0-7035.g7532011a.el8.x86_64 2023-11-08T19:22:05.670 INFO:teuthology.orchestra.run.smithi160.stdout: cephfs-top-2:18.0.0-7035.g7532011a.el8.noarch 2023-11-08T19:22:05.670 INFO:teuthology.orchestra.run.smithi160.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-11-08T19:22:05.670 INFO:teuthology.orchestra.run.smithi160.stdout: flex-2.6.1-9.el8.x86_64 2023-11-08T19:22:05.670 INFO:teuthology.orchestra.run.smithi160.stdout: fuse-2.9.7-15.el8.x86_64 2023-11-08T19:22:05.671 INFO:teuthology.orchestra.run.smithi160.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-11-08T19:22:05.671 INFO:teuthology.orchestra.run.smithi160.stdout: jq-1.6-3.el8.x86_64 2023-11-08T19:22:05.671 INFO:teuthology.orchestra.run.smithi160.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-11-08T19:22:05.671 INFO:teuthology.orchestra.run.smithi160.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-11-08T19:22:05.671 INFO:teuthology.orchestra.run.smithi160.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-11-08T19:22:05.672 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs-devel-2:18.0.0-7035.g7532011a.el8.x86_64 2023-11-08T19:22:05.672 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs2-2:18.0.0-7035.g7532011a.el8.x86_64 2023-11-08T19:22:05.672 INFO:teuthology.orchestra.run.smithi160.stdout: libcephsqlite-2:18.0.0-7035.g7532011a.el8.x86_64 2023-11-08T19:22:05.672 INFO:teuthology.orchestra.run.smithi160.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-11-08T19:22:05.672 INFO:teuthology.orchestra.run.smithi160.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-11-08T19:22:05.673 INFO:teuthology.orchestra.run.smithi160.stdout: liboath-2.6.2-3.el8.x86_64 2023-11-08T19:22:05.673 INFO:teuthology.orchestra.run.smithi160.stdout: libpq-13.5-1.el8.x86_64 2023-11-08T19:22:05.673 INFO:teuthology.orchestra.run.smithi160.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-11-08T19:22:05.673 INFO:teuthology.orchestra.run.smithi160.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-11-08T19:22:05.673 INFO:teuthology.orchestra.run.smithi160.stdout: librados-devel-2:18.0.0-7035.g7532011a.el8.x86_64 2023-11-08T19:22:05.674 INFO:teuthology.orchestra.run.smithi160.stdout: libradosstriper1-2:18.0.0-7035.g7532011a.el8.x86_64 2023-11-08T19:22:05.674 INFO:teuthology.orchestra.run.smithi160.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-11-08T19:22:05.674 INFO:teuthology.orchestra.run.smithi160.stdout: librgw2-2:18.0.0-7035.g7532011a.el8.x86_64 2023-11-08T19:22:05.674 INFO:teuthology.orchestra.run.smithi160.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-11-08T19:22:05.674 INFO:teuthology.orchestra.run.smithi160.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-11-08T19:22:05.675 INFO:teuthology.orchestra.run.smithi160.stdout: libtool-2.4.6-25.el8.x86_64 2023-11-08T19:22:05.675 INFO:teuthology.orchestra.run.smithi160.stdout: libunwind-1.3.1-3.el8.x86_64 2023-11-08T19:22:05.675 INFO:teuthology.orchestra.run.smithi160.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-11-08T19:22:05.675 INFO:teuthology.orchestra.run.smithi160.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-11-08T19:22:05.675 INFO:teuthology.orchestra.run.smithi160.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-11-08T19:22:05.675 INFO:teuthology.orchestra.run.smithi160.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-11-08T19:22:05.676 INFO:teuthology.orchestra.run.smithi160.stdout: openblas-0.3.15-3.el8.x86_64 2023-11-08T19:22:05.676 INFO:teuthology.orchestra.run.smithi160.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-11-08T19:22:05.676 INFO:teuthology.orchestra.run.smithi160.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-11-08T19:22:05.676 INFO:teuthology.orchestra.run.smithi160.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-11-08T19:22:05.676 INFO:teuthology.orchestra.run.smithi160.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-11-08T19:22:05.677 INFO:teuthology.orchestra.run.smithi160.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-11-08T19:22:05.677 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-11-08T19:22:05.677 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-11-08T19:22:05.677 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-11-08T19:22:05.677 INFO:teuthology.orchestra.run.smithi160.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-11-08T19:22:05.678 INFO:teuthology.orchestra.run.smithi160.stdout: python3-babel-2.5.1-7.el8.noarch 2023-11-08T19:22:05.678 INFO:teuthology.orchestra.run.smithi160.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-11-08T19:22:05.678 INFO:teuthology.orchestra.run.smithi160.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-11-08T19:22:05.678 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-11-08T19:22:05.678 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-argparse-2:18.0.0-7035.g7532011a.el8.x86_64 2023-11-08T19:22:05.679 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-common-2:18.0.0-7035.g7532011a.el8.x86_64 2023-11-08T19:22:05.679 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cephfs-2:18.0.0-7035.g7532011a.el8.x86_64 2023-11-08T19:22:05.679 INFO:teuthology.orchestra.run.smithi160.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-11-08T19:22:05.679 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-11-08T19:22:05.679 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-11-08T19:22:05.679 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-11-08T19:22:05.680 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-11-08T19:22:05.680 INFO:teuthology.orchestra.run.smithi160.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-11-08T19:22:05.680 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-6.2-6.el8.noarch 2023-11-08T19:22:05.680 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-11-08T19:22:05.680 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-11-08T19:22:05.681 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-11-08T19:22:05.681 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-11-08T19:22:05.681 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-11-08T19:22:05.681 INFO:teuthology.orchestra.run.smithi160.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-11-08T19:22:05.681 INFO:teuthology.orchestra.run.smithi160.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-11-08T19:22:05.682 INFO:teuthology.orchestra.run.smithi160.stdout: python3-mako-1.0.6-13.el8.noarch 2023-11-08T19:22:05.682 INFO:teuthology.orchestra.run.smithi160.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-11-08T19:22:05.682 INFO:teuthology.orchestra.run.smithi160.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-11-08T19:22:05.682 INFO:teuthology.orchestra.run.smithi160.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-11-08T19:22:05.682 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-11-08T19:22:05.683 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-11-08T19:22:05.683 INFO:teuthology.orchestra.run.smithi160.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-11-08T19:22:05.683 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-11-08T19:22:05.683 INFO:teuthology.orchestra.run.smithi160.stdout: python3-portend-2.6-1.el8.noarch 2023-11-08T19:22:05.683 INFO:teuthology.orchestra.run.smithi160.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-11-08T19:22:05.683 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-11-08T19:22:05.684 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-11-08T19:22:05.684 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-11-08T19:22:05.684 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pycparser-2.14-14.el8.noarch 2023-11-08T19:22:05.684 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pytz-2017.2-9.el8.noarch 2023-11-08T19:22:05.684 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rados-2:18.0.0-7035.g7532011a.el8.x86_64 2023-11-08T19:22:05.685 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rbd-2:18.0.0-7035.g7532011a.el8.x86_64 2023-11-08T19:22:05.685 INFO:teuthology.orchestra.run.smithi160.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-11-08T19:22:05.685 INFO:teuthology.orchestra.run.smithi160.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-11-08T19:22:05.685 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rgw-2:18.0.0-7035.g7532011a.el8.x86_64 2023-11-08T19:22:05.685 INFO:teuthology.orchestra.run.smithi160.stdout: python3-routes-2.4.1-12.el8.noarch 2023-11-08T19:22:05.686 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rsa-4.9-2.el8.noarch 2023-11-08T19:22:05.686 INFO:teuthology.orchestra.run.smithi160.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-11-08T19:22:05.686 INFO:teuthology.orchestra.run.smithi160.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-11-08T19:22:05.686 INFO:teuthology.orchestra.run.smithi160.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-11-08T19:22:05.686 INFO:teuthology.orchestra.run.smithi160.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-11-08T19:22:05.687 INFO:teuthology.orchestra.run.smithi160.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-11-08T19:22:05.687 INFO:teuthology.orchestra.run.smithi160.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-11-08T19:22:05.687 INFO:teuthology.orchestra.run.smithi160.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-11-08T19:22:05.687 INFO:teuthology.orchestra.run.smithi160.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-11-08T19:22:05.687 INFO:teuthology.orchestra.run.smithi160.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-11-08T19:22:05.688 INFO:teuthology.orchestra.run.smithi160.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-11-08T19:22:05.688 INFO:teuthology.orchestra.run.smithi160.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-11-08T19:22:05.688 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-fuse-2:18.0.0-7035.g7532011a.el8.x86_64 2023-11-08T19:22:05.688 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-mirror-2:18.0.0-7035.g7532011a.el8.x86_64 2023-11-08T19:22:05.688 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-nbd-2:18.0.0-7035.g7532011a.el8.x86_64 2023-11-08T19:22:05.689 INFO:teuthology.orchestra.run.smithi160.stdout: socat-1.7.4.1-1.el8.x86_64 2023-11-08T19:22:05.689 INFO:teuthology.orchestra.run.smithi160.stdout: thrift-0.13.0-2.el8.x86_64 2023-11-08T19:22:05.689 INFO:teuthology.orchestra.run.smithi160.stdout: uuid-1.6.2-43.el8.x86_64 2023-11-08T19:22:05.689 INFO:teuthology.orchestra.run.smithi160.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-11-08T19:22:05.689 INFO:teuthology.orchestra.run.smithi160.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-11-08T19:22:05.690 INFO:teuthology.orchestra.run.smithi160.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-11-08T19:22:05.690 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:22:05.690 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2023-11-08T19:22:05.850 DEBUG:teuthology.parallel:result is None 2023-11-08T19:22:05.851 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4 2023-11-08T19:22:05.993 DEBUG:teuthology.orchestra.run.smithi149:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-08T19:22:06.024 INFO:teuthology.orchestra.run.smithi149.stdout:18.0.0-7035.g7532011a.el8 2023-11-08T19:22:06.025 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7035.g7532011a.el8 2023-11-08T19:22:06.025 INFO:teuthology.task.install:The correct ceph version 18.0.0-7035.g7532011a is installed. 2023-11-08T19:22:06.025 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4 2023-11-08T19:22:06.166 DEBUG:teuthology.orchestra.run.smithi160:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-08T19:22:06.190 INFO:teuthology.orchestra.run.smithi160.stdout:18.0.0-7035.g7532011a.el8 2023-11-08T19:22:06.191 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7035.g7532011a.el8 2023-11-08T19:22:06.191 INFO:teuthology.task.install:The correct ceph version 18.0.0-7035.g7532011a is installed. 2023-11-08T19:22:06.192 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-11-08T19:22:06.192 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-11-08T19:22:06.193 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-08T19:22:06.239 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-11-08T19:22:06.240 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-08T19:22:06.280 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-11-08T19:22:06.281 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-11-08T19:22:06.281 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/daemon-helper 2023-11-08T19:22:06.313 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-08T19:22:06.383 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-11-08T19:22:06.384 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/usr/bin/daemon-helper 2023-11-08T19:22:06.410 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-08T19:22:06.476 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-11-08T19:22:06.477 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-11-08T19:22:06.477 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-08T19:22:06.507 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-08T19:22:06.576 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-11-08T19:22:06.577 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-08T19:22:06.603 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-08T19:22:06.669 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-11-08T19:22:06.670 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-11-08T19:22:06.670 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/stdin-killer 2023-11-08T19:22:06.699 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-08T19:22:06.767 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-11-08T19:22:06.768 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/usr/bin/stdin-killer 2023-11-08T19:22:06.794 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-08T19:22:06.861 INFO:teuthology.run_tasks:Running task ceph... 2023-11-08T19:22:06.934 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-11-08T19:22:06.935 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 777 /var/log/ceph 2023-11-08T19:22:06.938 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod 777 /var/log/ceph 2023-11-08T19:22:06.964 INFO:tasks.ceph:Disabling ceph logrotate... 2023-11-08T19:22:06.965 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-08T19:22:07.005 DEBUG:teuthology.orchestra.run.smithi160:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-08T19:22:07.031 INFO:tasks.ceph:Creating extra log directories... 2023-11-08T19:22:07.031 DEBUG:teuthology.orchestra.run.smithi149:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-08T19:22:07.072 DEBUG:teuthology.orchestra.run.smithi160:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-08T19:22:07.104 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-11-08T19:22:07.105 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-11-08T19:22:07.105 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-11-08T19:22:07.105 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-11-08T19:22:07.106 DEBUG:teuthology.orchestra.run.smithi149:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-08T19:22:07.154 DEBUG:teuthology.orchestra.run.smithi149:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-08T19:22:07.287 DEBUG:teuthology.orchestra.run.smithi149:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-11-08T19:22:07.314 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-11-08T19:22:07.314 DEBUG:teuthology.orchestra.run.smithi160:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-08T19:22:07.331 DEBUG:teuthology.orchestra.run.smithi160:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-08T19:22:07.476 DEBUG:teuthology.orchestra.run.smithi160:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-11-08T19:22:07.508 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-11-08T19:22:07.509 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'evicting unresponsive client', 'RECENT_CRASH'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-11-08T19:22:07.509 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2023-11-08_19:01:12-fs:functional-main-distro-default-smithi/7452102', 'branch': 'main', 'description': 'fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snapshots}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7452102', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'pdonnell-2023-11-08_19:01:12-fs:functional-main-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'evicting unresponsive client', 'RECENT_CRASH'], 'sha1': '7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'check-counter': {'dry_run': True}, 'install': {'ceph': {'flavor': 'default', 'sha1': '7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-batrick-testing-20231108.185857', 'sha1': 'e797689ab88984658d73bbc928b2ed06c676d14a'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 50, 'repo': 'https://github.com/ceph/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 3044, 'sha1': '7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4', 'sleep_before_teardown': 0, 'suite': 'fs:functional', 'suite_branch': 'wip-batrick-testing-20231108.185857', 'suite_path': '/home/teuthworker/src/github.com_batrick_ceph_e797689ab88984658d73bbc928b2ed06c676d14a/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/batrick/ceph.git', 'suite_sha1': 'e797689ab88984658d73bbc928b2ed06c676d14a', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi149.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs=', 'smithi160.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'evicting unresponsive client', 'RECENT_CRASH'], 'sha1': '7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4', 'cluster': 'ceph'}}, {'kclient': None}, {'exec': {'mon.a': ['ceph config set mgr mgr/crash/warn_recent_interval 0']}}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_snapshots']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '6899cd26fceddb2fec83dc1a1349394b28c8998e', 'timestamp': '2023-11-08_19:01:12', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3590714'} 2023-11-08T19:22:07.510 DEBUG:teuthology.orchestra.run.smithi149:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-08T19:22:07.513 DEBUG:teuthology.orchestra.run.smithi160:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-08T19:22:07.560 DEBUG:teuthology.orchestra.run.smithi149:> sudo install -d -m0777 -- /var/run/ceph 2023-11-08T19:22:07.569 DEBUG:teuthology.orchestra.run.smithi160:> sudo install -d -m0777 -- /var/run/ceph 2023-11-08T19:22:07.627 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-11-08T19:22:07.627 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/scratch_devs of=/dev/stdout 2023-11-08T19:22:07.651 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-08T19:22:07.651 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_1 2023-11-08T19:22:07.708 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-08T19:22:07.708 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-08T19:22:07.708 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 6h/6d Inode: 386605 Links: 1 2023-11-08T19:22:07.708 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-08T19:22:07.708 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2023-11-08T19:22:07.709 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2023-11-08 19:21:55.578783461 +0000 2023-11-08T19:22:07.709 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2023-11-08 19:19:19.901019525 +0000 2023-11-08T19:22:07.709 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2023-11-08 19:19:19.901019525 +0000 2023-11-08T19:22:07.709 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: - 2023-11-08T19:22:07.710 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-08T19:22:07.772 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2023-11-08T19:22:07.773 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2023-11-08T19:22:07.773 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000246474 s, 2.1 MB/s 2023-11-08T19:22:07.774 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-08T19:22:07.831 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_2 2023-11-08T19:22:07.889 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-08T19:22:07.889 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-08T19:22:07.889 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 6h/6d Inode: 395314 Links: 1 2023-11-08T19:22:07.889 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-08T19:22:07.890 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2023-11-08T19:22:07.890 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2023-11-08 19:21:55.579783441 +0000 2023-11-08T19:22:07.890 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2023-11-08 19:19:20.410009405 +0000 2023-11-08T19:22:07.890 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2023-11-08 19:19:20.410009405 +0000 2023-11-08T19:22:07.891 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: - 2023-11-08T19:22:07.891 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-08T19:22:07.953 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2023-11-08T19:22:07.953 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2023-11-08T19:22:07.954 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000217657 s, 2.4 MB/s 2023-11-08T19:22:07.955 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-08T19:22:08.012 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_3 2023-11-08T19:22:08.069 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-08T19:22:08.070 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-08T19:22:08.070 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 6h/6d Inode: 397316 Links: 1 2023-11-08T19:22:08.070 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-08T19:22:08.070 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2023-11-08T19:22:08.070 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2023-11-08 19:21:55.579783441 +0000 2023-11-08T19:22:08.071 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2023-11-08 19:19:20.925999147 +0000 2023-11-08T19:22:08.071 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2023-11-08 19:19:20.925999147 +0000 2023-11-08T19:22:08.071 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: - 2023-11-08T19:22:08.071 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-08T19:22:08.134 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2023-11-08T19:22:08.134 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2023-11-08T19:22:08.134 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000224952 s, 2.3 MB/s 2023-11-08T19:22:08.135 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-08T19:22:08.192 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_4 2023-11-08T19:22:08.248 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-08T19:22:08.248 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-08T19:22:08.249 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 6h/6d Inode: 386745 Links: 1 2023-11-08T19:22:08.249 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-08T19:22:08.249 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2023-11-08T19:22:08.249 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2023-11-08 19:21:55.579783441 +0000 2023-11-08T19:22:08.250 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2023-11-08 19:19:21.431989087 +0000 2023-11-08T19:22:08.250 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2023-11-08 19:19:21.431989087 +0000 2023-11-08T19:22:08.250 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: - 2023-11-08T19:22:08.250 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-08T19:22:08.316 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2023-11-08T19:22:08.316 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2023-11-08T19:22:08.316 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000191735 s, 2.7 MB/s 2023-11-08T19:22:08.317 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-08T19:22:08.375 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-08T19:22:08.375 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-11-08T19:22:08.375 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/scratch_devs of=/dev/stdout 2023-11-08T19:22:08.396 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-08T19:22:08.396 DEBUG:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_1 2023-11-08T19:22:08.455 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-08T19:22:08.456 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-08T19:22:08.456 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 6h/6d Inode: 386812 Links: 1 2023-11-08T19:22:08.456 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-08T19:22:08.456 INFO:teuthology.orchestra.run.smithi160.stdout:Context: system_u:object_r:device_t:s0 2023-11-08T19:22:08.456 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2023-11-08 19:21:59.851128945 +0000 2023-11-08T19:22:08.457 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2023-11-08 19:19:22.348131129 +0000 2023-11-08T19:22:08.457 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2023-11-08 19:19:22.348131129 +0000 2023-11-08T19:22:08.457 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: - 2023-11-08T19:22:08.458 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-08T19:22:08.524 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2023-11-08T19:22:08.524 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2023-11-08T19:22:08.525 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.000277395 s, 1.8 MB/s 2023-11-08T19:22:08.526 DEBUG:teuthology.orchestra.run.smithi160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-08T19:22:08.586 DEBUG:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_2 2023-11-08T19:22:08.645 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-08T19:22:08.645 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-08T19:22:08.645 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 6h/6d Inode: 390695 Links: 1 2023-11-08T19:22:08.645 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-08T19:22:08.646 INFO:teuthology.orchestra.run.smithi160.stdout:Context: system_u:object_r:device_t:s0 2023-11-08T19:22:08.646 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2023-11-08 19:21:59.851128945 +0000 2023-11-08T19:22:08.646 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2023-11-08 19:19:22.856123705 +0000 2023-11-08T19:22:08.646 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2023-11-08 19:19:22.856123705 +0000 2023-11-08T19:22:08.646 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: - 2023-11-08T19:22:08.647 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-08T19:22:08.713 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2023-11-08T19:22:08.714 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2023-11-08T19:22:08.714 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.000227377 s, 2.3 MB/s 2023-11-08T19:22:08.715 DEBUG:teuthology.orchestra.run.smithi160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-08T19:22:08.774 DEBUG:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_3 2023-11-08T19:22:08.835 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-08T19:22:08.835 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-08T19:22:08.836 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 6h/6d Inode: 389552 Links: 1 2023-11-08T19:22:08.836 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-08T19:22:08.836 INFO:teuthology.orchestra.run.smithi160.stdout:Context: system_u:object_r:device_t:s0 2023-11-08T19:22:08.836 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2023-11-08 19:21:59.851128945 +0000 2023-11-08T19:22:08.836 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2023-11-08 19:19:23.370116194 +0000 2023-11-08T19:22:08.837 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2023-11-08 19:19:23.370116194 +0000 2023-11-08T19:22:08.837 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: - 2023-11-08T19:22:08.837 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-08T19:22:08.903 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2023-11-08T19:22:08.903 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2023-11-08T19:22:08.903 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.000231307 s, 2.2 MB/s 2023-11-08T19:22:08.904 DEBUG:teuthology.orchestra.run.smithi160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-08T19:22:08.963 DEBUG:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_4 2023-11-08T19:22:09.022 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-08T19:22:09.022 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-08T19:22:09.022 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 6h/6d Inode: 396438 Links: 1 2023-11-08T19:22:09.023 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-08T19:22:09.023 INFO:teuthology.orchestra.run.smithi160.stdout:Context: system_u:object_r:device_t:s0 2023-11-08T19:22:09.023 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2023-11-08 19:21:59.851128945 +0000 2023-11-08T19:22:09.023 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2023-11-08 19:19:23.906108361 +0000 2023-11-08T19:22:09.023 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2023-11-08 19:19:23.906108361 +0000 2023-11-08T19:22:09.024 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: - 2023-11-08T19:22:09.024 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-08T19:22:09.088 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2023-11-08T19:22:09.088 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2023-11-08T19:22:09.088 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.000210705 s, 2.4 MB/s 2023-11-08T19:22:09.089 DEBUG:teuthology.orchestra.run.smithi160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-08T19:22:09.147 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-08T19:22:09.147 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi149.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi160.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-08T19:22:09.148 INFO:tasks.ceph:Generating config... 2023-11-08T19:22:09.149 INFO:tasks.ceph:[client] client mount timeout = 600 2023-11-08T19:22:09.149 INFO:tasks.ceph:[client] debug client = 20 2023-11-08T19:22:09.150 INFO:tasks.ceph:[client] debug ms = 1 2023-11-08T19:22:09.150 INFO:tasks.ceph:[client] pid file = 2023-11-08T19:22:09.150 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-11-08T19:22:09.150 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-11-08T19:22:09.151 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-11-08T19:22:09.151 INFO:tasks.ceph:[mds] debug mds = 20 2023-11-08T19:22:09.151 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-11-08T19:22:09.151 INFO:tasks.ceph:[mds] debug ms = 1 2023-11-08T19:22:09.152 INFO:tasks.ceph:[mds] mds debug frag = True 2023-11-08T19:22:09.152 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-11-08T19:22:09.152 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-11-08T19:22:09.152 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-11-08T19:22:09.153 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-11-08T19:22:09.153 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-11-08T19:22:09.153 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-11-08T19:22:09.153 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-11-08T19:22:09.154 INFO:tasks.ceph:[mgr] debug ms = 1 2023-11-08T19:22:09.154 INFO:tasks.ceph:[mon] debug mon = 20 2023-11-08T19:22:09.154 INFO:tasks.ceph:[mon] debug ms = 1 2023-11-08T19:22:09.155 INFO:tasks.ceph:[mon] debug paxos = 20 2023-11-08T19:22:09.155 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-11-08T19:22:09.155 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-11-08T19:22:09.155 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-11-08T19:22:09.156 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-11-08T19:22:09.156 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-11-08T19:22:09.156 INFO:tasks.ceph:[osd] debug ms = 1 2023-11-08T19:22:09.156 INFO:tasks.ceph:[osd] debug osd = 20 2023-11-08T19:22:09.157 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-11-08T19:22:09.157 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-11-08T19:22:09.157 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-11-08T19:22:09.157 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-11-08T19:22:09.158 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-11-08T19:22:09.158 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-11-08T19:22:09.158 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-11-08T19:22:09.158 INFO:tasks.ceph:Setting up mon.a... 2023-11-08T19:22:09.159 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-11-08T19:22:09.541 INFO:teuthology.orchestra.run.smithi149.stdout:creating /etc/ceph/ceph.keyring 2023-11-08T19:22:09.545 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-11-08T19:22:09.597 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-08T19:22:09.629 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.149'), ('mon.b', '172.21.15.160'), ('mon.c', '[v2:172.21.15.160:3301,v1:172.21.15.160:6790]')] 2023-11-08T19:22:09.630 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.149,172.21.15.160,[v2:172.21.15.160:3301,v1:172.21.15.160:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-11-08T19:22:09.631 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-11-08T19:22:09.631 DEBUG:teuthology.orchestra.run.smithi149:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-11-08T19:22:09.692 DEBUG:teuthology.orchestra.run.smithi149:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.149 --add b 172.21.15.160 --addv c '[v2:172.21.15.160:3301,v1:172.21.15.160:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-11-08T19:22:09.782 INFO:teuthology.orchestra.run.smithi149.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-11-08T19:22:09.783 INFO:teuthology.orchestra.run.smithi149.stdout:monmaptool: generated fsid 0aba7c70-fe80-4446-a2f5-7502ac3adfb4 2023-11-08T19:22:09.783 INFO:teuthology.orchestra.run.smithi149.stdout:setting min_mon_release = pacific 2023-11-08T19:22:09.783 INFO:teuthology.orchestra.run.smithi149.stdout:epoch 0 2023-11-08T19:22:09.783 INFO:teuthology.orchestra.run.smithi149.stdout:fsid 0aba7c70-fe80-4446-a2f5-7502ac3adfb4 2023-11-08T19:22:09.784 INFO:teuthology.orchestra.run.smithi149.stdout:last_changed 2023-11-08T19:22:09.782444+0000 2023-11-08T19:22:09.784 INFO:teuthology.orchestra.run.smithi149.stdout:created 2023-11-08T19:22:09.782444+0000 2023-11-08T19:22:09.784 INFO:teuthology.orchestra.run.smithi149.stdout:min_mon_release 16 (pacific) 2023-11-08T19:22:09.784 INFO:teuthology.orchestra.run.smithi149.stdout:election_strategy: 1 2023-11-08T19:22:09.784 INFO:teuthology.orchestra.run.smithi149.stdout:0: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.a 2023-11-08T19:22:09.785 INFO:teuthology.orchestra.run.smithi149.stdout:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2023-11-08T19:22:09.785 INFO:teuthology.orchestra.run.smithi149.stdout:2: [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] mon.c 2023-11-08T19:22:09.785 INFO:teuthology.orchestra.run.smithi149.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-11-08T19:22:09.787 DEBUG:teuthology.orchestra.run.smithi149:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-11-08T19:22:09.804 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 0aba7c70-fe80-4446-a2f5-7502ac3adfb4... 2023-11-08T19:22:09.805 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-08T19:22:09.848 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-08T19:22:09.891 INFO:teuthology.orchestra.run.smithi149.stdout:[global] 2023-11-08T19:22:09.891 INFO:teuthology.orchestra.run.smithi149.stdout: chdir = "" 2023-11-08T19:22:09.891 INFO:teuthology.orchestra.run.smithi149.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-08T19:22:09.891 INFO:teuthology.orchestra.run.smithi149.stdout: auth supported = cephx 2023-11-08T19:22:09.892 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:22:09.892 INFO:teuthology.orchestra.run.smithi149.stdout: filestore xattr use omap = true 2023-11-08T19:22:09.892 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:22:09.892 INFO:teuthology.orchestra.run.smithi149.stdout: mon clock drift allowed = 1.000 2023-11-08T19:22:09.892 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:22:09.893 INFO:teuthology.orchestra.run.smithi149.stdout: osd crush chooseleaf type = 0 2023-11-08T19:22:09.893 INFO:teuthology.orchestra.run.smithi149.stdout: auth debug = true 2023-11-08T19:22:09.893 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:22:09.893 INFO:teuthology.orchestra.run.smithi149.stdout: ms die on old message = true 2023-11-08T19:22:09.894 INFO:teuthology.orchestra.run.smithi149.stdout: ms die on bug = true 2023-11-08T19:22:09.894 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:22:09.894 INFO:teuthology.orchestra.run.smithi149.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-08T19:22:09.894 INFO:teuthology.orchestra.run.smithi149.stdout: mon pg warn max object skew = 0 2023-11-08T19:22:09.895 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:22:09.895 INFO:teuthology.orchestra.run.smithi149.stdout: # disable pg_autoscaler by default for new pools 2023-11-08T19:22:09.895 INFO:teuthology.orchestra.run.smithi149.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-08T19:22:09.896 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:22:09.896 INFO:teuthology.orchestra.run.smithi149.stdout: osd pool default size = 2 2023-11-08T19:22:09.896 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:22:09.897 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd allow primary affinity = true 2023-11-08T19:22:09.897 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd allow pg remap = true 2023-11-08T19:22:09.897 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on legacy crush tunables = false 2023-11-08T19:22:09.897 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on crush straw calc version zero = false 2023-11-08T19:22:09.897 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on no sortbitwise = false 2023-11-08T19:22:09.898 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on osd down out interval zero = false 2023-11-08T19:22:09.898 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on too few osds = false 2023-11-08T19:22:09.898 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-08T19:22:09.898 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-08T19:22:09.898 INFO:teuthology.orchestra.run.smithi149.stdout: mon_allow_pool_size_one = true 2023-11-08T19:22:09.899 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:22:09.899 INFO:teuthology.orchestra.run.smithi149.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-08T19:22:09.899 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:22:09.899 INFO:teuthology.orchestra.run.smithi149.stdout: osd default data pool replay window = 5 2023-11-08T19:22:09.899 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:22:09.900 INFO:teuthology.orchestra.run.smithi149.stdout: mon allow pool delete = true 2023-11-08T19:22:09.900 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:22:09.900 INFO:teuthology.orchestra.run.smithi149.stdout: mon cluster log file level = debug 2023-11-08T19:22:09.900 INFO:teuthology.orchestra.run.smithi149.stdout: debug asserts on shutdown = true 2023-11-08T19:22:09.900 INFO:teuthology.orchestra.run.smithi149.stdout: mon health detail to clog = false 2023-11-08T19:22:09.900 INFO:teuthology.orchestra.run.smithi149.stdout: mon host = "172.21.15.149,172.21.15.160,[v2:172.21.15.160:3301,v1:172.21.15.160:6790]" 2023-11-08T19:22:09.901 INFO:teuthology.orchestra.run.smithi149.stdout: ms die on skipped message = False 2023-11-08T19:22:09.901 INFO:teuthology.orchestra.run.smithi149.stdout: fsid = 0aba7c70-fe80-4446-a2f5-7502ac3adfb4 2023-11-08T19:22:09.901 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:22:09.901 INFO:teuthology.orchestra.run.smithi149.stdout:[osd] 2023-11-08T19:22:09.901 INFO:teuthology.orchestra.run.smithi149.stdout: osd journal size = 100 2023-11-08T19:22:09.902 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:22:09.902 INFO:teuthology.orchestra.run.smithi149.stdout: osd scrub load threshold = 5.0 2023-11-08T19:22:09.902 INFO:teuthology.orchestra.run.smithi149.stdout: osd scrub max interval = 600 2023-11-08T19:22:09.902 INFO:teuthology.orchestra.run.smithi149.stdout: osd mclock profile = high_recovery_ops 2023-11-08T19:22:09.902 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:22:09.903 INFO:teuthology.orchestra.run.smithi149.stdout: osd recover clone overlap = true 2023-11-08T19:22:09.903 INFO:teuthology.orchestra.run.smithi149.stdout: osd recovery max chunk = 1048576 2023-11-08T19:22:09.903 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:22:09.903 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug shutdown = true 2023-11-08T19:22:09.903 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug op order = true 2023-11-08T19:22:09.903 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug verify stray on activate = true 2023-11-08T19:22:09.904 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug trim objects = true 2023-11-08T19:22:09.904 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:22:09.904 INFO:teuthology.orchestra.run.smithi149.stdout: osd open classes on start = true 2023-11-08T19:22:09.904 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug pg log writeout = true 2023-11-08T19:22:09.904 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:22:09.905 INFO:teuthology.orchestra.run.smithi149.stdout: osd deep scrub update digest min age = 30 2023-11-08T19:22:09.905 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:22:09.905 INFO:teuthology.orchestra.run.smithi149.stdout: osd map max advance = 10 2023-11-08T19:22:09.905 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:22:09.905 INFO:teuthology.orchestra.run.smithi149.stdout: journal zero on create = true 2023-11-08T19:22:09.906 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:22:09.906 INFO:teuthology.orchestra.run.smithi149.stdout: filestore ondisk finisher threads = 3 2023-11-08T19:22:09.906 INFO:teuthology.orchestra.run.smithi149.stdout: filestore apply finisher threads = 3 2023-11-08T19:22:09.906 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:22:09.906 INFO:teuthology.orchestra.run.smithi149.stdout: bdev debug aio = true 2023-11-08T19:22:09.907 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug misdirected ops = true 2023-11-08T19:22:09.907 INFO:teuthology.orchestra.run.smithi149.stdout: bluestore block size = 96636764160 2023-11-08T19:22:09.907 INFO:teuthology.orchestra.run.smithi149.stdout: bluestore fsck on mount = True 2023-11-08T19:22:09.907 INFO:teuthology.orchestra.run.smithi149.stdout: debug bluefs = 20 2023-11-08T19:22:09.907 INFO:teuthology.orchestra.run.smithi149.stdout: debug bluestore = 20 2023-11-08T19:22:09.908 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2023-11-08T19:22:09.908 INFO:teuthology.orchestra.run.smithi149.stdout: debug osd = 20 2023-11-08T19:22:09.908 INFO:teuthology.orchestra.run.smithi149.stdout: debug rocksdb = 10 2023-11-08T19:22:09.908 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd backfillfull_ratio = 0.85 2023-11-08T19:22:09.908 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd full ratio = 0.9 2023-11-08T19:22:09.909 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd nearfull ratio = 0.8 2023-11-08T19:22:09.909 INFO:teuthology.orchestra.run.smithi149.stdout: osd failsafe full ratio = 0.95 2023-11-08T19:22:09.909 INFO:teuthology.orchestra.run.smithi149.stdout: osd objectstore = bluestore 2023-11-08T19:22:09.909 INFO:teuthology.orchestra.run.smithi149.stdout: osd op complaint time = 180 2023-11-08T19:22:09.909 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:22:09.910 INFO:teuthology.orchestra.run.smithi149.stdout:[mgr] 2023-11-08T19:22:09.910 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2023-11-08T19:22:09.910 INFO:teuthology.orchestra.run.smithi149.stdout: debug mgr = 20 2023-11-08T19:22:09.910 INFO:teuthology.orchestra.run.smithi149.stdout: debug mon = 20 2023-11-08T19:22:09.910 INFO:teuthology.orchestra.run.smithi149.stdout: debug auth = 20 2023-11-08T19:22:09.911 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min pgs per osd = 4 2023-11-08T19:22:09.911 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min bytes per osd = 10 2023-11-08T19:22:09.911 INFO:teuthology.orchestra.run.smithi149.stdout: mgr/telemetry/nag = false 2023-11-08T19:22:09.911 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:22:09.911 INFO:teuthology.orchestra.run.smithi149.stdout:[mon] 2023-11-08T19:22:09.911 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2023-11-08T19:22:09.912 INFO:teuthology.orchestra.run.smithi149.stdout: debug mon = 20 2023-11-08T19:22:09.912 INFO:teuthology.orchestra.run.smithi149.stdout: debug paxos = 20 2023-11-08T19:22:09.912 INFO:teuthology.orchestra.run.smithi149.stdout: debug auth = 20 2023-11-08T19:22:09.912 INFO:teuthology.orchestra.run.smithi149.stdout: mon data avail warn = 5 2023-11-08T19:22:09.913 INFO:teuthology.orchestra.run.smithi149.stdout: mon mgr mkfs grace = 240 2023-11-08T19:22:09.913 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min pgs per osd = 4 2023-11-08T19:22:09.913 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd reporter subtree level = osd 2023-11-08T19:22:09.913 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd prime pg temp = true 2023-11-08T19:22:09.913 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min bytes per osd = 10 2023-11-08T19:22:09.914 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:22:09.914 INFO:teuthology.orchestra.run.smithi149.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-08T19:22:09.914 INFO:teuthology.orchestra.run.smithi149.stdout: auth mon ticket ttl = 660 # 11m 2023-11-08T19:22:09.914 INFO:teuthology.orchestra.run.smithi149.stdout: auth service ticket ttl = 240 # 4m 2023-11-08T19:22:09.914 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:22:09.915 INFO:teuthology.orchestra.run.smithi149.stdout: # don't complain about insecure global_id in the test suite 2023-11-08T19:22:09.915 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-08T19:22:09.915 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-08T19:22:09.915 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:22:09.915 INFO:teuthology.orchestra.run.smithi149.stdout: # 1m isn't quite enough 2023-11-08T19:22:09.915 INFO:teuthology.orchestra.run.smithi149.stdout: mon_down_mkfs_grace = 2m 2023-11-08T19:22:09.916 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:22:09.916 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_filestore_osds = false 2023-11-08T19:22:09.916 INFO:teuthology.orchestra.run.smithi149.stdout: mon op complaint time = 120 2023-11-08T19:22:09.917 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:22:09.917 INFO:teuthology.orchestra.run.smithi149.stdout:[client] 2023-11-08T19:22:09.917 INFO:teuthology.orchestra.run.smithi149.stdout: rgw cache enabled = true 2023-11-08T19:22:09.917 INFO:teuthology.orchestra.run.smithi149.stdout: rgw enable ops log = true 2023-11-08T19:22:09.917 INFO:teuthology.orchestra.run.smithi149.stdout: rgw enable usage log = true 2023-11-08T19:22:09.917 INFO:teuthology.orchestra.run.smithi149.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-08T19:22:09.918 INFO:teuthology.orchestra.run.smithi149.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-08T19:22:09.918 INFO:teuthology.orchestra.run.smithi149.stdout: client mount timeout = 600 2023-11-08T19:22:09.918 INFO:teuthology.orchestra.run.smithi149.stdout: debug client = 20 2023-11-08T19:22:09.918 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2023-11-08T19:22:09.918 INFO:teuthology.orchestra.run.smithi149.stdout: pid file = "" 2023-11-08T19:22:09.919 INFO:teuthology.orchestra.run.smithi149.stdout: rados mon op timeout = 900 2023-11-08T19:22:09.919 INFO:teuthology.orchestra.run.smithi149.stdout: rados osd op timeout = 900 2023-11-08T19:22:09.919 INFO:teuthology.orchestra.run.smithi149.stdout:[mon.a] 2023-11-08T19:22:09.919 INFO:teuthology.orchestra.run.smithi149.stdout:[mon.b] 2023-11-08T19:22:09.919 INFO:teuthology.orchestra.run.smithi149.stdout:[mon.c] 2023-11-08T19:22:09.920 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.a] 2023-11-08T19:22:09.920 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.c] 2023-11-08T19:22:09.920 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.b] 2023-11-08T19:22:09.920 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.d] 2023-11-08T19:22:09.920 INFO:teuthology.orchestra.run.smithi149.stdout:[mds] 2023-11-08T19:22:09.921 INFO:teuthology.orchestra.run.smithi149.stdout: debug mds = 20 2023-11-08T19:22:09.921 INFO:teuthology.orchestra.run.smithi149.stdout: debug mds balancer = 20 2023-11-08T19:22:09.921 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2023-11-08T19:22:09.921 INFO:teuthology.orchestra.run.smithi149.stdout: mds debug frag = True 2023-11-08T19:22:09.921 INFO:teuthology.orchestra.run.smithi149.stdout: mds debug scatterstat = True 2023-11-08T19:22:09.922 INFO:teuthology.orchestra.run.smithi149.stdout: mds op complaint time = 180 2023-11-08T19:22:09.922 INFO:teuthology.orchestra.run.smithi149.stdout: mds verify scatter = True 2023-11-08T19:22:09.922 INFO:teuthology.orchestra.run.smithi149.stdout: osd op complaint time = 180 2023-11-08T19:22:09.922 INFO:teuthology.orchestra.run.smithi149.stdout: rados mon op timeout = 900 2023-11-08T19:22:09.922 INFO:teuthology.orchestra.run.smithi149.stdout: rados osd op timeout = 900 2023-11-08T19:22:09.924 INFO:teuthology.orchestra.run.smithi160.stdout:[global] 2023-11-08T19:22:09.924 INFO:teuthology.orchestra.run.smithi160.stdout: chdir = "" 2023-11-08T19:22:09.925 INFO:teuthology.orchestra.run.smithi160.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-08T19:22:09.925 INFO:teuthology.orchestra.run.smithi160.stdout: auth supported = cephx 2023-11-08T19:22:09.925 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:22:09.925 INFO:teuthology.orchestra.run.smithi160.stdout: filestore xattr use omap = true 2023-11-08T19:22:09.925 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:22:09.926 INFO:teuthology.orchestra.run.smithi160.stdout: mon clock drift allowed = 1.000 2023-11-08T19:22:09.926 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:22:09.926 INFO:teuthology.orchestra.run.smithi160.stdout: osd crush chooseleaf type = 0 2023-11-08T19:22:09.926 INFO:teuthology.orchestra.run.smithi160.stdout: auth debug = true 2023-11-08T19:22:09.926 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:22:09.927 INFO:teuthology.orchestra.run.smithi160.stdout: ms die on old message = true 2023-11-08T19:22:09.927 INFO:teuthology.orchestra.run.smithi160.stdout: ms die on bug = true 2023-11-08T19:22:09.927 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:22:09.927 INFO:teuthology.orchestra.run.smithi160.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-08T19:22:09.927 INFO:teuthology.orchestra.run.smithi160.stdout: mon pg warn max object skew = 0 2023-11-08T19:22:09.928 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:22:09.928 INFO:teuthology.orchestra.run.smithi160.stdout: # disable pg_autoscaler by default for new pools 2023-11-08T19:22:09.928 INFO:teuthology.orchestra.run.smithi160.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-08T19:22:09.928 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:22:09.928 INFO:teuthology.orchestra.run.smithi160.stdout: osd pool default size = 2 2023-11-08T19:22:09.929 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:22:09.929 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd allow primary affinity = true 2023-11-08T19:22:09.929 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd allow pg remap = true 2023-11-08T19:22:09.929 INFO:teuthology.orchestra.run.smithi160.stdout: mon warn on legacy crush tunables = false 2023-11-08T19:22:09.929 INFO:teuthology.orchestra.run.smithi160.stdout: mon warn on crush straw calc version zero = false 2023-11-08T19:22:09.930 INFO:teuthology.orchestra.run.smithi160.stdout: mon warn on no sortbitwise = false 2023-11-08T19:22:09.930 INFO:teuthology.orchestra.run.smithi160.stdout: mon warn on osd down out interval zero = false 2023-11-08T19:22:09.930 INFO:teuthology.orchestra.run.smithi160.stdout: mon warn on too few osds = false 2023-11-08T19:22:09.930 INFO:teuthology.orchestra.run.smithi160.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-08T19:22:09.931 INFO:teuthology.orchestra.run.smithi160.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-08T19:22:09.931 INFO:teuthology.orchestra.run.smithi160.stdout: mon_allow_pool_size_one = true 2023-11-08T19:22:09.931 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:22:09.931 INFO:teuthology.orchestra.run.smithi160.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-08T19:22:09.931 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:22:09.931 INFO:teuthology.orchestra.run.smithi160.stdout: osd default data pool replay window = 5 2023-11-08T19:22:09.932 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:22:09.932 INFO:teuthology.orchestra.run.smithi160.stdout: mon allow pool delete = true 2023-11-08T19:22:09.932 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:22:09.933 INFO:teuthology.orchestra.run.smithi160.stdout: mon cluster log file level = debug 2023-11-08T19:22:09.933 INFO:teuthology.orchestra.run.smithi160.stdout: debug asserts on shutdown = true 2023-11-08T19:22:09.933 INFO:teuthology.orchestra.run.smithi160.stdout: mon health detail to clog = false 2023-11-08T19:22:09.933 INFO:teuthology.orchestra.run.smithi160.stdout: mon host = "172.21.15.149,172.21.15.160,[v2:172.21.15.160:3301,v1:172.21.15.160:6790]" 2023-11-08T19:22:09.933 INFO:teuthology.orchestra.run.smithi160.stdout: ms die on skipped message = False 2023-11-08T19:22:09.934 INFO:teuthology.orchestra.run.smithi160.stdout: fsid = 0aba7c70-fe80-4446-a2f5-7502ac3adfb4 2023-11-08T19:22:09.934 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:22:09.935 INFO:teuthology.orchestra.run.smithi160.stdout:[osd] 2023-11-08T19:22:09.935 INFO:teuthology.orchestra.run.smithi160.stdout: osd journal size = 100 2023-11-08T19:22:09.935 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:22:09.935 INFO:teuthology.orchestra.run.smithi160.stdout: osd scrub load threshold = 5.0 2023-11-08T19:22:09.936 INFO:teuthology.orchestra.run.smithi160.stdout: osd scrub max interval = 600 2023-11-08T19:22:09.936 INFO:teuthology.orchestra.run.smithi160.stdout: osd mclock profile = high_recovery_ops 2023-11-08T19:22:09.936 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:22:09.936 INFO:teuthology.orchestra.run.smithi160.stdout: osd recover clone overlap = true 2023-11-08T19:22:09.936 INFO:teuthology.orchestra.run.smithi160.stdout: osd recovery max chunk = 1048576 2023-11-08T19:22:09.937 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:22:09.937 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug shutdown = true 2023-11-08T19:22:09.937 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug op order = true 2023-11-08T19:22:09.937 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug verify stray on activate = true 2023-11-08T19:22:09.937 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug trim objects = true 2023-11-08T19:22:09.938 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:22:09.938 INFO:teuthology.orchestra.run.smithi160.stdout: osd open classes on start = true 2023-11-08T19:22:09.938 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug pg log writeout = true 2023-11-08T19:22:09.938 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:22:09.939 INFO:teuthology.orchestra.run.smithi160.stdout: osd deep scrub update digest min age = 30 2023-11-08T19:22:09.939 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:22:09.939 INFO:teuthology.orchestra.run.smithi160.stdout: osd map max advance = 10 2023-11-08T19:22:09.939 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:22:09.939 INFO:teuthology.orchestra.run.smithi160.stdout: journal zero on create = true 2023-11-08T19:22:09.939 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:22:09.940 INFO:teuthology.orchestra.run.smithi160.stdout: filestore ondisk finisher threads = 3 2023-11-08T19:22:09.940 INFO:teuthology.orchestra.run.smithi160.stdout: filestore apply finisher threads = 3 2023-11-08T19:22:09.940 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:22:09.940 INFO:teuthology.orchestra.run.smithi160.stdout: bdev debug aio = true 2023-11-08T19:22:09.941 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug misdirected ops = true 2023-11-08T19:22:09.941 INFO:teuthology.orchestra.run.smithi160.stdout: bluestore block size = 96636764160 2023-11-08T19:22:09.941 INFO:teuthology.orchestra.run.smithi160.stdout: bluestore fsck on mount = True 2023-11-08T19:22:09.941 INFO:teuthology.orchestra.run.smithi160.stdout: debug bluefs = 20 2023-11-08T19:22:09.941 INFO:teuthology.orchestra.run.smithi160.stdout: debug bluestore = 20 2023-11-08T19:22:09.942 INFO:teuthology.orchestra.run.smithi160.stdout: debug ms = 1 2023-11-08T19:22:09.942 INFO:teuthology.orchestra.run.smithi160.stdout: debug osd = 20 2023-11-08T19:22:09.942 INFO:teuthology.orchestra.run.smithi160.stdout: debug rocksdb = 10 2023-11-08T19:22:09.942 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd backfillfull_ratio = 0.85 2023-11-08T19:22:09.942 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd full ratio = 0.9 2023-11-08T19:22:09.943 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd nearfull ratio = 0.8 2023-11-08T19:22:09.943 INFO:teuthology.orchestra.run.smithi160.stdout: osd failsafe full ratio = 0.95 2023-11-08T19:22:09.943 INFO:teuthology.orchestra.run.smithi160.stdout: osd objectstore = bluestore 2023-11-08T19:22:09.943 INFO:teuthology.orchestra.run.smithi160.stdout: osd op complaint time = 180 2023-11-08T19:22:09.943 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:22:09.944 INFO:teuthology.orchestra.run.smithi160.stdout:[mgr] 2023-11-08T19:22:09.944 INFO:teuthology.orchestra.run.smithi160.stdout: debug ms = 1 2023-11-08T19:22:09.944 INFO:teuthology.orchestra.run.smithi160.stdout: debug mgr = 20 2023-11-08T19:22:09.944 INFO:teuthology.orchestra.run.smithi160.stdout: debug mon = 20 2023-11-08T19:22:09.944 INFO:teuthology.orchestra.run.smithi160.stdout: debug auth = 20 2023-11-08T19:22:09.945 INFO:teuthology.orchestra.run.smithi160.stdout: mon reweight min pgs per osd = 4 2023-11-08T19:22:09.945 INFO:teuthology.orchestra.run.smithi160.stdout: mon reweight min bytes per osd = 10 2023-11-08T19:22:09.945 INFO:teuthology.orchestra.run.smithi160.stdout: mgr/telemetry/nag = false 2023-11-08T19:22:09.945 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:22:09.945 INFO:teuthology.orchestra.run.smithi160.stdout:[mon] 2023-11-08T19:22:09.946 INFO:teuthology.orchestra.run.smithi160.stdout: debug ms = 1 2023-11-08T19:22:09.946 INFO:teuthology.orchestra.run.smithi160.stdout: debug mon = 20 2023-11-08T19:22:09.946 INFO:teuthology.orchestra.run.smithi160.stdout: debug paxos = 20 2023-11-08T19:22:09.946 INFO:teuthology.orchestra.run.smithi160.stdout: debug auth = 20 2023-11-08T19:22:09.946 INFO:teuthology.orchestra.run.smithi160.stdout: mon data avail warn = 5 2023-11-08T19:22:09.947 INFO:teuthology.orchestra.run.smithi160.stdout: mon mgr mkfs grace = 240 2023-11-08T19:22:09.947 INFO:teuthology.orchestra.run.smithi160.stdout: mon reweight min pgs per osd = 4 2023-11-08T19:22:09.947 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd reporter subtree level = osd 2023-11-08T19:22:09.947 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd prime pg temp = true 2023-11-08T19:22:09.947 INFO:teuthology.orchestra.run.smithi160.stdout: mon reweight min bytes per osd = 10 2023-11-08T19:22:09.948 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:22:09.948 INFO:teuthology.orchestra.run.smithi160.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-08T19:22:09.948 INFO:teuthology.orchestra.run.smithi160.stdout: auth mon ticket ttl = 660 # 11m 2023-11-08T19:22:09.948 INFO:teuthology.orchestra.run.smithi160.stdout: auth service ticket ttl = 240 # 4m 2023-11-08T19:22:09.948 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:22:09.949 INFO:teuthology.orchestra.run.smithi160.stdout: # don't complain about insecure global_id in the test suite 2023-11-08T19:22:09.949 INFO:teuthology.orchestra.run.smithi160.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-08T19:22:09.949 INFO:teuthology.orchestra.run.smithi160.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-08T19:22:09.949 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:22:09.949 INFO:teuthology.orchestra.run.smithi160.stdout: # 1m isn't quite enough 2023-11-08T19:22:09.950 INFO:teuthology.orchestra.run.smithi160.stdout: mon_down_mkfs_grace = 2m 2023-11-08T19:22:09.950 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:22:09.950 INFO:teuthology.orchestra.run.smithi160.stdout: mon_warn_on_filestore_osds = false 2023-11-08T19:22:09.950 INFO:teuthology.orchestra.run.smithi160.stdout: mon op complaint time = 120 2023-11-08T19:22:09.950 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:22:09.951 INFO:teuthology.orchestra.run.smithi160.stdout:[client] 2023-11-08T19:22:09.951 INFO:teuthology.orchestra.run.smithi160.stdout: rgw cache enabled = true 2023-11-08T19:22:09.951 INFO:teuthology.orchestra.run.smithi160.stdout: rgw enable ops log = true 2023-11-08T19:22:09.951 INFO:teuthology.orchestra.run.smithi160.stdout: rgw enable usage log = true 2023-11-08T19:22:09.951 INFO:teuthology.orchestra.run.smithi160.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-08T19:22:09.952 INFO:teuthology.orchestra.run.smithi160.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-08T19:22:09.952 INFO:teuthology.orchestra.run.smithi160.stdout: client mount timeout = 600 2023-11-08T19:22:09.952 INFO:teuthology.orchestra.run.smithi160.stdout: debug client = 20 2023-11-08T19:22:09.952 INFO:teuthology.orchestra.run.smithi160.stdout: debug ms = 1 2023-11-08T19:22:09.952 INFO:teuthology.orchestra.run.smithi160.stdout: pid file = "" 2023-11-08T19:22:09.953 INFO:teuthology.orchestra.run.smithi160.stdout: rados mon op timeout = 900 2023-11-08T19:22:09.953 INFO:teuthology.orchestra.run.smithi160.stdout: rados osd op timeout = 900 2023-11-08T19:22:09.953 INFO:teuthology.orchestra.run.smithi160.stdout:[mon.a] 2023-11-08T19:22:09.953 INFO:teuthology.orchestra.run.smithi160.stdout:[mon.b] 2023-11-08T19:22:09.953 INFO:teuthology.orchestra.run.smithi160.stdout:[mon.c] 2023-11-08T19:22:09.954 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.a] 2023-11-08T19:22:09.954 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.c] 2023-11-08T19:22:09.954 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.b] 2023-11-08T19:22:09.954 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.d] 2023-11-08T19:22:09.954 INFO:teuthology.orchestra.run.smithi160.stdout:[mds] 2023-11-08T19:22:09.955 INFO:teuthology.orchestra.run.smithi160.stdout: debug mds = 20 2023-11-08T19:22:09.955 INFO:teuthology.orchestra.run.smithi160.stdout: debug mds balancer = 20 2023-11-08T19:22:09.955 INFO:teuthology.orchestra.run.smithi160.stdout: debug ms = 1 2023-11-08T19:22:09.955 INFO:teuthology.orchestra.run.smithi160.stdout: mds debug frag = True 2023-11-08T19:22:09.955 INFO:teuthology.orchestra.run.smithi160.stdout: mds debug scatterstat = True 2023-11-08T19:22:09.956 INFO:teuthology.orchestra.run.smithi160.stdout: mds op complaint time = 180 2023-11-08T19:22:09.956 INFO:teuthology.orchestra.run.smithi160.stdout: mds verify scatter = True 2023-11-08T19:22:09.956 INFO:teuthology.orchestra.run.smithi160.stdout: osd op complaint time = 180 2023-11-08T19:22:09.956 INFO:teuthology.orchestra.run.smithi160.stdout: rados mon op timeout = 900 2023-11-08T19:22:09.956 INFO:teuthology.orchestra.run.smithi160.stdout: rados osd op timeout = 900 2023-11-08T19:22:09.957 INFO:tasks.ceph:Creating admin key on mon.a... 2023-11-08T19:22:09.957 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-11-08T19:22:10.020 INFO:tasks.ceph:Copying monmap to all nodes... 2023-11-08T19:22:10.021 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-11-08T19:22:10.021 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-11-08T19:22:10.038 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-11-08T19:22:10.038 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-11-08T19:22:10.094 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi149.front.sepia.ceph.com 2023-11-08T19:22:10.094 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-11-08T19:22:10.095 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-08T19:22:10.095 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-08T19:22:10.170 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-11-08T19:22:10.170 DEBUG:teuthology.orchestra.run.smithi149:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-08T19:22:10.226 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi160.front.sepia.ceph.com 2023-11-08T19:22:10.227 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-11-08T19:22:10.227 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-08T19:22:10.228 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-08T19:22:10.271 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-11-08T19:22:10.271 DEBUG:teuthology.orchestra.run.smithi160:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-08T19:22:10.330 INFO:tasks.ceph:Setting up mon nodes... 2023-11-08T19:22:10.330 INFO:tasks.ceph:Setting up mgr nodes... 2023-11-08T19:22:10.331 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-11-08T19:22:10.384 INFO:teuthology.orchestra.run.smithi149.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-11-08T19:22:10.387 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-11-08T19:22:10.465 INFO:teuthology.orchestra.run.smithi160.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-11-08T19:22:10.468 INFO:tasks.ceph:Setting up mds nodes... 2023-11-08T19:22:10.468 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-11-08T19:22:10.522 INFO:teuthology.orchestra.run.smithi149.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-11-08T19:22:10.525 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-11-08T19:22:10.551 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-11-08T19:22:10.644 INFO:teuthology.orchestra.run.smithi149.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-11-08T19:22:10.646 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-11-08T19:22:10.673 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-11-08T19:22:10.729 INFO:teuthology.orchestra.run.smithi160.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-11-08T19:22:10.732 DEBUG:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-11-08T19:22:10.759 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-11-08T19:22:10.853 INFO:teuthology.orchestra.run.smithi160.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-11-08T19:22:10.855 DEBUG:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-11-08T19:22:10.882 INFO:tasks.ceph_client:Setting up client nodes... 2023-11-08T19:22:10.882 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-11-08T19:22:10.925 INFO:teuthology.orchestra.run.smithi149.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-11-08T19:22:10.939 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-11-08T19:22:10.981 INFO:teuthology.orchestra.run.smithi149.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-11-08T19:22:10.994 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-11-08T19:22:11.037 INFO:teuthology.orchestra.run.smithi160.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-11-08T19:22:11.050 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-11-08T19:22:11.134 INFO:teuthology.orchestra.run.smithi160.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-11-08T19:22:11.147 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-11-08T19:22:11.147 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi149.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi160.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-08T19:22:11.148 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-11-08T19:22:11.174 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-08T19:22:11.174 INFO:tasks.ceph:role: osd.0 2023-11-08T19:22:11.175 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi149.front.sepia.ceph.com 2023-11-08T19:22:11.175 DEBUG:teuthology.orchestra.run.smithi149:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-08T19:22:11.248 INFO:teuthology.orchestra.run.smithi149.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-08T19:22:11.248 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-08T19:22:11.249 INFO:teuthology.orchestra.run.smithi149.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-08T19:22:11.249 INFO:teuthology.orchestra.run.smithi149.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-08T19:22:11.249 INFO:teuthology.orchestra.run.smithi149.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-08T19:22:11.249 INFO:teuthology.orchestra.run.smithi149.stdout: = sunit=0 swidth=0 blks 2023-11-08T19:22:11.249 INFO:teuthology.orchestra.run.smithi149.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-08T19:22:11.250 INFO:teuthology.orchestra.run.smithi149.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-08T19:22:11.250 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-08T19:22:11.250 INFO:teuthology.orchestra.run.smithi149.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-08T19:22:11.684 INFO:teuthology.orchestra.run.smithi149.stdout:Discarding blocks...Done. 2023-11-08T19:22:11.685 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi149.front.sepia.ceph.com -o noatime 2023-11-08T19:22:11.686 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-11-08T19:22:11.844 DEBUG:teuthology.orchestra.run.smithi149:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-11-08T19:22:11.877 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-11-08T19:22:11.944 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-08T19:22:11.944 INFO:tasks.ceph:role: osd.1 2023-11-08T19:22:11.944 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi149.front.sepia.ceph.com 2023-11-08T19:22:11.945 DEBUG:teuthology.orchestra.run.smithi149:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-08T19:22:12.018 INFO:teuthology.orchestra.run.smithi149.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-08T19:22:12.018 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-08T19:22:12.018 INFO:teuthology.orchestra.run.smithi149.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-08T19:22:12.018 INFO:teuthology.orchestra.run.smithi149.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-08T19:22:12.019 INFO:teuthology.orchestra.run.smithi149.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-08T19:22:12.019 INFO:teuthology.orchestra.run.smithi149.stdout: = sunit=0 swidth=0 blks 2023-11-08T19:22:12.019 INFO:teuthology.orchestra.run.smithi149.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-08T19:22:12.019 INFO:teuthology.orchestra.run.smithi149.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-08T19:22:12.019 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-08T19:22:12.020 INFO:teuthology.orchestra.run.smithi149.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-08T19:22:12.444 INFO:teuthology.orchestra.run.smithi149.stdout:Discarding blocks...Done. 2023-11-08T19:22:12.446 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi149.front.sepia.ceph.com -o noatime 2023-11-08T19:22:12.447 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-11-08T19:22:12.548 DEBUG:teuthology.orchestra.run.smithi149:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-11-08T19:22:12.580 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-11-08T19:22:12.647 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-08T19:22:12.647 INFO:tasks.ceph:role: osd.2 2023-11-08T19:22:12.648 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi149.front.sepia.ceph.com 2023-11-08T19:22:12.648 DEBUG:teuthology.orchestra.run.smithi149:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-08T19:22:12.722 INFO:teuthology.orchestra.run.smithi149.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-08T19:22:12.722 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-08T19:22:12.722 INFO:teuthology.orchestra.run.smithi149.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-08T19:22:12.723 INFO:teuthology.orchestra.run.smithi149.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-08T19:22:12.723 INFO:teuthology.orchestra.run.smithi149.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-08T19:22:12.723 INFO:teuthology.orchestra.run.smithi149.stdout: = sunit=0 swidth=0 blks 2023-11-08T19:22:12.723 INFO:teuthology.orchestra.run.smithi149.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-08T19:22:12.724 INFO:teuthology.orchestra.run.smithi149.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-08T19:22:12.724 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-08T19:22:12.724 INFO:teuthology.orchestra.run.smithi149.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-08T19:22:13.171 INFO:teuthology.orchestra.run.smithi149.stdout:Discarding blocks...Done. 2023-11-08T19:22:13.173 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi149.front.sepia.ceph.com -o noatime 2023-11-08T19:22:13.173 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-11-08T19:22:13.353 DEBUG:teuthology.orchestra.run.smithi149:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-11-08T19:22:13.388 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-11-08T19:22:13.455 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-08T19:22:13.455 INFO:tasks.ceph:role: osd.3 2023-11-08T19:22:13.456 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi149.front.sepia.ceph.com 2023-11-08T19:22:13.456 DEBUG:teuthology.orchestra.run.smithi149:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-08T19:22:13.529 INFO:teuthology.orchestra.run.smithi149.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-08T19:22:13.529 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-08T19:22:13.530 INFO:teuthology.orchestra.run.smithi149.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-08T19:22:13.530 INFO:teuthology.orchestra.run.smithi149.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-08T19:22:13.530 INFO:teuthology.orchestra.run.smithi149.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-08T19:22:13.530 INFO:teuthology.orchestra.run.smithi149.stdout: = sunit=0 swidth=0 blks 2023-11-08T19:22:13.530 INFO:teuthology.orchestra.run.smithi149.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-08T19:22:13.531 INFO:teuthology.orchestra.run.smithi149.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-08T19:22:13.531 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-08T19:22:13.531 INFO:teuthology.orchestra.run.smithi149.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-08T19:22:13.967 INFO:teuthology.orchestra.run.smithi149.stdout:Discarding blocks...Done. 2023-11-08T19:22:13.969 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi149.front.sepia.ceph.com -o noatime 2023-11-08T19:22:13.969 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-11-08T19:22:14.154 DEBUG:teuthology.orchestra.run.smithi149:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-11-08T19:22:14.185 DEBUG:teuthology.orchestra.run.smithi149:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-08T19:22:14.284 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:14.283+0000 7f0e735c0640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-11-08T19:22:14.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:14.283+0000 7f0e735c0640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-11-08T19:22:14.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:14.283+0000 7f0e735c0640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-08T19:22:14.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:14.283+0000 7f0e735c0640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-08T19:22:14.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:14.283+0000 7f0e735c0640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-08T19:22:14.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:14.284+0000 7f0e735c0640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-11-08T19:22:17.158 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-11-08T19:22:17.187 DEBUG:teuthology.orchestra.run.smithi149:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-08T19:22:17.277 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:17.276+0000 7f34dd655640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-11-08T19:22:17.278 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:17.276+0000 7f34dd655640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-11-08T19:22:17.278 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:17.276+0000 7f34dd655640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-08T19:22:17.278 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:17.276+0000 7f34dd655640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-08T19:22:17.278 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:17.276+0000 7f34dd655640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-08T19:22:17.279 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:17.277+0000 7f34dd655640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-11-08T19:22:20.140 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-11-08T19:22:20.170 DEBUG:teuthology.orchestra.run.smithi149:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-08T19:22:20.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:20.259+0000 7fae3c04b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-11-08T19:22:20.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:20.259+0000 7fae3c04b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-11-08T19:22:20.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:20.259+0000 7fae3c04b640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-08T19:22:20.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:20.259+0000 7fae3c04b640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-08T19:22:20.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:20.259+0000 7fae3c04b640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-08T19:22:20.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:20.260+0000 7fae3c04b640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-11-08T19:22:23.128 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-11-08T19:22:23.158 DEBUG:teuthology.orchestra.run.smithi149:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-08T19:22:23.247 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:23.246+0000 7f347dd42640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-11-08T19:22:23.247 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:23.246+0000 7f347dd42640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-11-08T19:22:23.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:23.246+0000 7f347dd42640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-08T19:22:23.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:23.246+0000 7f347dd42640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-08T19:22:23.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:23.246+0000 7f347dd42640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-08T19:22:23.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:23.247+0000 7f347dd42640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-11-08T19:22:26.110 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-11-08T19:22:26.141 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-11-08T19:22:26.175 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-08T19:22:26.175 INFO:tasks.ceph:role: osd.4 2023-11-08T19:22:26.176 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi160.front.sepia.ceph.com 2023-11-08T19:22:26.176 DEBUG:teuthology.orchestra.run.smithi160:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-08T19:22:26.252 INFO:teuthology.orchestra.run.smithi160.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-08T19:22:26.253 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-08T19:22:26.253 INFO:teuthology.orchestra.run.smithi160.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-08T19:22:26.253 INFO:teuthology.orchestra.run.smithi160.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-08T19:22:26.253 INFO:teuthology.orchestra.run.smithi160.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-08T19:22:26.254 INFO:teuthology.orchestra.run.smithi160.stdout: = sunit=0 swidth=0 blks 2023-11-08T19:22:26.254 INFO:teuthology.orchestra.run.smithi160.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-08T19:22:26.254 INFO:teuthology.orchestra.run.smithi160.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-08T19:22:26.254 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-08T19:22:26.254 INFO:teuthology.orchestra.run.smithi160.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-08T19:22:26.703 INFO:teuthology.orchestra.run.smithi160.stdout:Discarding blocks...Done. 2023-11-08T19:22:26.706 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi160.front.sepia.ceph.com -o noatime 2023-11-08T19:22:26.706 DEBUG:teuthology.orchestra.run.smithi160:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-11-08T19:22:26.893 DEBUG:teuthology.orchestra.run.smithi160:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-11-08T19:22:26.929 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-11-08T19:22:26.999 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-08T19:22:27.000 INFO:tasks.ceph:role: osd.5 2023-11-08T19:22:27.000 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi160.front.sepia.ceph.com 2023-11-08T19:22:27.000 DEBUG:teuthology.orchestra.run.smithi160:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-08T19:22:27.076 INFO:teuthology.orchestra.run.smithi160.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-08T19:22:27.076 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-08T19:22:27.076 INFO:teuthology.orchestra.run.smithi160.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-08T19:22:27.077 INFO:teuthology.orchestra.run.smithi160.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-08T19:22:27.077 INFO:teuthology.orchestra.run.smithi160.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-08T19:22:27.077 INFO:teuthology.orchestra.run.smithi160.stdout: = sunit=0 swidth=0 blks 2023-11-08T19:22:27.077 INFO:teuthology.orchestra.run.smithi160.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-08T19:22:27.077 INFO:teuthology.orchestra.run.smithi160.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-08T19:22:27.078 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-08T19:22:27.078 INFO:teuthology.orchestra.run.smithi160.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-08T19:22:27.482 INFO:teuthology.orchestra.run.smithi160.stdout:Discarding blocks...Done. 2023-11-08T19:22:27.484 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi160.front.sepia.ceph.com -o noatime 2023-11-08T19:22:27.485 DEBUG:teuthology.orchestra.run.smithi160:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-11-08T19:22:27.600 DEBUG:teuthology.orchestra.run.smithi160:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-11-08T19:22:27.634 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-11-08T19:22:27.703 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-08T19:22:27.703 INFO:tasks.ceph:role: osd.6 2023-11-08T19:22:27.704 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi160.front.sepia.ceph.com 2023-11-08T19:22:27.704 DEBUG:teuthology.orchestra.run.smithi160:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-08T19:22:27.779 INFO:teuthology.orchestra.run.smithi160.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-08T19:22:27.780 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-08T19:22:27.780 INFO:teuthology.orchestra.run.smithi160.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-08T19:22:27.781 INFO:teuthology.orchestra.run.smithi160.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-08T19:22:27.781 INFO:teuthology.orchestra.run.smithi160.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-08T19:22:27.781 INFO:teuthology.orchestra.run.smithi160.stdout: = sunit=0 swidth=0 blks 2023-11-08T19:22:27.781 INFO:teuthology.orchestra.run.smithi160.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-08T19:22:27.782 INFO:teuthology.orchestra.run.smithi160.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-08T19:22:27.782 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-08T19:22:27.782 INFO:teuthology.orchestra.run.smithi160.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-08T19:22:28.227 INFO:teuthology.orchestra.run.smithi160.stdout:Discarding blocks...Done. 2023-11-08T19:22:28.229 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi160.front.sepia.ceph.com -o noatime 2023-11-08T19:22:28.230 DEBUG:teuthology.orchestra.run.smithi160:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-11-08T19:22:28.407 DEBUG:teuthology.orchestra.run.smithi160:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-11-08T19:22:28.442 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-11-08T19:22:28.515 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-08T19:22:28.515 INFO:tasks.ceph:role: osd.7 2023-11-08T19:22:28.516 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi160.front.sepia.ceph.com 2023-11-08T19:22:28.516 DEBUG:teuthology.orchestra.run.smithi160:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-08T19:22:28.592 INFO:teuthology.orchestra.run.smithi160.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-08T19:22:28.592 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-08T19:22:28.593 INFO:teuthology.orchestra.run.smithi160.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-08T19:22:28.593 INFO:teuthology.orchestra.run.smithi160.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-08T19:22:28.593 INFO:teuthology.orchestra.run.smithi160.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-08T19:22:28.594 INFO:teuthology.orchestra.run.smithi160.stdout: = sunit=0 swidth=0 blks 2023-11-08T19:22:28.594 INFO:teuthology.orchestra.run.smithi160.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-08T19:22:28.594 INFO:teuthology.orchestra.run.smithi160.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-08T19:22:28.594 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-08T19:22:28.595 INFO:teuthology.orchestra.run.smithi160.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-08T19:22:29.027 INFO:teuthology.orchestra.run.smithi160.stdout:Discarding blocks...Done. 2023-11-08T19:22:29.029 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi160.front.sepia.ceph.com -o noatime 2023-11-08T19:22:29.029 DEBUG:teuthology.orchestra.run.smithi160:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-11-08T19:22:29.213 DEBUG:teuthology.orchestra.run.smithi160:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-11-08T19:22:29.250 DEBUG:teuthology.orchestra.run.smithi160:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-08T19:22:29.368 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:29.365+0000 7f554133d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-11-08T19:22:29.368 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:29.366+0000 7f554133d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-11-08T19:22:29.368 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:29.366+0000 7f554133d640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-08T19:22:29.369 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:29.366+0000 7f554133d640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-08T19:22:29.369 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:29.366+0000 7f554133d640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-08T19:22:29.369 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:29.366+0000 7f554133d640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-11-08T19:22:32.238 DEBUG:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-11-08T19:22:32.270 DEBUG:teuthology.orchestra.run.smithi160:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-08T19:22:32.362 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:32.360+0000 7fb6595c6640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-11-08T19:22:32.362 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:32.360+0000 7fb6595c6640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-11-08T19:22:32.363 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:32.360+0000 7fb6595c6640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-08T19:22:32.363 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:32.360+0000 7fb6595c6640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-08T19:22:32.363 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:32.360+0000 7fb6595c6640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-08T19:22:32.364 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:32.361+0000 7fb6595c6640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-11-08T19:22:35.226 DEBUG:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-11-08T19:22:35.257 DEBUG:teuthology.orchestra.run.smithi160:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-08T19:22:35.348 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:35.346+0000 7ff656d73640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-11-08T19:22:35.349 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:35.347+0000 7ff656d73640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-11-08T19:22:35.349 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:35.347+0000 7ff656d73640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-08T19:22:35.349 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:35.347+0000 7ff656d73640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-08T19:22:35.349 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:35.347+0000 7ff656d73640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-08T19:22:35.350 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:35.347+0000 7ff656d73640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-11-08T19:22:37.511 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T19:22:37.514 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T19:22:38.224 DEBUG:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-11-08T19:22:38.255 DEBUG:teuthology.orchestra.run.smithi160:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-08T19:22:38.348 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:38.345+0000 7f04b8e26640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-11-08T19:22:38.348 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:38.346+0000 7f04b8e26640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-11-08T19:22:38.348 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:38.346+0000 7f04b8e26640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-08T19:22:38.349 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:38.346+0000 7f04b8e26640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-08T19:22:38.349 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:38.346+0000 7f04b8e26640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-08T19:22:38.349 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:38.346+0000 7f04b8e26640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-11-08T19:22:41.222 DEBUG:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-11-08T19:22:41.252 INFO:tasks.ceph:Reading keys from all nodes... 2023-11-08T19:22:41.252 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-11-08T19:22:41.253 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-11-08T19:22:41.284 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-11-08T19:22:41.285 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-11-08T19:22:41.354 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-11-08T19:22:41.355 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-11-08T19:22:41.426 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-11-08T19:22:41.427 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-11-08T19:22:41.495 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-11-08T19:22:41.495 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-11-08T19:22:41.563 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-11-08T19:22:41.564 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-11-08T19:22:41.632 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-11-08T19:22:41.632 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-11-08T19:22:41.700 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-11-08T19:22:41.700 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-11-08T19:22:41.732 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-11-08T19:22:41.733 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-11-08T19:22:41.802 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-11-08T19:22:41.803 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-11-08T19:22:41.871 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-11-08T19:22:41.872 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-11-08T19:22:41.940 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-11-08T19:22:41.941 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-11-08T19:22:42.009 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-11-08T19:22:42.009 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-11-08T19:22:42.077 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-11-08T19:22:42.078 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-11-08T19:22:42.144 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-11-08T19:22:42.145 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-11-08T19:22:42.164 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-11-08T19:22:42.164 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-11-08T19:22:42.222 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-11-08T19:22:42.222 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-11-08T19:22:42.239 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-11-08T19:22:42.240 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-11-08T19:22:42.296 INFO:tasks.ceph:Adding keys to all mons... 2023-11-08T19:22:42.296 DEBUG:teuthology.orchestra.run.smithi149:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-08T19:22:42.299 DEBUG:teuthology.orchestra.run.smithi160:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-08T19:22:42.340 INFO:teuthology.orchestra.run.smithi149.stdout:[mgr.y] 2023-11-08T19:22:42.340 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDi30tlxwfmFhAAfauMRZmdBm6TQXw07oVQJw== 2023-11-08T19:22:42.340 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.a] 2023-11-08T19:22:42.341 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDi30tlcD8lHxAAxmvMr1hdJWLyJ0wOQhILow== 2023-11-08T19:22:42.341 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.c] 2023-11-08T19:22:42.341 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDi30tl+SliJhAAznNm6dtyajBE0T8WKqdhhw== 2023-11-08T19:22:42.341 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.0] 2023-11-08T19:22:42.341 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDm30tl1SLuEBAA8gYyfPfXV+rd7sXTr5NytA== 2023-11-08T19:22:42.342 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.1] 2023-11-08T19:22:42.342 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDp30tllvSCEBAAgyXiQm+ld9zVjv2Uo2UilA== 2023-11-08T19:22:42.342 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.2] 2023-11-08T19:22:42.342 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDs30tlGvZ9DxAAzOPbDXlbk+oxHvXhNfPnNQ== 2023-11-08T19:22:42.343 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.3] 2023-11-08T19:22:42.343 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDv30tlg0i3DhAAKEy9WQ+VBcJMuKALuYVTEg== 2023-11-08T19:22:42.343 INFO:teuthology.orchestra.run.smithi149.stdout:[mgr.x] 2023-11-08T19:22:42.343 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDi30tluyy2GxAATC2v0iOLVbRrea6w+2Cy8g== 2023-11-08T19:22:42.343 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.b] 2023-11-08T19:22:42.344 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDi30tl0d56KxAA42ebu7JWPHSW2Y+aUT9G8Q== 2023-11-08T19:22:42.344 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.d] 2023-11-08T19:22:42.344 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDi30tl9sLWMhAACaIzwVjIgVky9P6tAK9/rw== 2023-11-08T19:22:42.344 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.4] 2023-11-08T19:22:42.344 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQD130tlrd3gFRAA0IM+0Dr48SgjXRHcCzypfg== 2023-11-08T19:22:42.345 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.5] 2023-11-08T19:22:42.345 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQD430tlCMCRFRAAJwP6E9TRRNneQzL7TVU6jg== 2023-11-08T19:22:42.345 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.6] 2023-11-08T19:22:42.345 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQD730tl176/FBAADjNAIKgdn3bIRlN725KW7g== 2023-11-08T19:22:42.345 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.7] 2023-11-08T19:22:42.346 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQD+30tl6CCxFBAAcProM9OqTGE6LtReNxvljA== 2023-11-08T19:22:42.346 INFO:teuthology.orchestra.run.smithi149.stdout:[client.0] 2023-11-08T19:22:42.346 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDi30tlQEEsNxAAiPozrOREh+IJXoj7ZkhvLg== 2023-11-08T19:22:42.346 INFO:teuthology.orchestra.run.smithi149.stdout:[client.2] 2023-11-08T19:22:42.346 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDi30tlZfZ+OhAAak0bEZA4XzCWwYINh0SvGQ== 2023-11-08T19:22:42.347 INFO:teuthology.orchestra.run.smithi149.stdout:[client.1] 2023-11-08T19:22:42.347 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDj30tluO08AhAAKiNHfc6ETU6HU+0PSkRTdg== 2023-11-08T19:22:42.347 INFO:teuthology.orchestra.run.smithi149.stdout:[client.3] 2023-11-08T19:22:42.347 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDj30tlLMAICBAAApxzbDjmCxzR32Puyeov6A== 2023-11-08T19:22:42.361 INFO:teuthology.orchestra.run.smithi160.stdout:[mgr.y] 2023-11-08T19:22:42.362 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQDi30tlxwfmFhAAfauMRZmdBm6TQXw07oVQJw== 2023-11-08T19:22:42.362 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.a] 2023-11-08T19:22:42.362 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQDi30tlcD8lHxAAxmvMr1hdJWLyJ0wOQhILow== 2023-11-08T19:22:42.362 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.c] 2023-11-08T19:22:42.362 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQDi30tl+SliJhAAznNm6dtyajBE0T8WKqdhhw== 2023-11-08T19:22:42.363 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.0] 2023-11-08T19:22:42.363 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQDm30tl1SLuEBAA8gYyfPfXV+rd7sXTr5NytA== 2023-11-08T19:22:42.363 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.1] 2023-11-08T19:22:42.363 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQDp30tllvSCEBAAgyXiQm+ld9zVjv2Uo2UilA== 2023-11-08T19:22:42.363 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.2] 2023-11-08T19:22:42.364 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQDs30tlGvZ9DxAAzOPbDXlbk+oxHvXhNfPnNQ== 2023-11-08T19:22:42.364 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.3] 2023-11-08T19:22:42.364 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQDv30tlg0i3DhAAKEy9WQ+VBcJMuKALuYVTEg== 2023-11-08T19:22:42.364 INFO:teuthology.orchestra.run.smithi160.stdout:[mgr.x] 2023-11-08T19:22:42.364 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQDi30tluyy2GxAATC2v0iOLVbRrea6w+2Cy8g== 2023-11-08T19:22:42.365 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.b] 2023-11-08T19:22:42.365 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQDi30tl0d56KxAA42ebu7JWPHSW2Y+aUT9G8Q== 2023-11-08T19:22:42.365 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.d] 2023-11-08T19:22:42.365 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQDi30tl9sLWMhAACaIzwVjIgVky9P6tAK9/rw== 2023-11-08T19:22:42.365 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.4] 2023-11-08T19:22:42.366 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQD130tlrd3gFRAA0IM+0Dr48SgjXRHcCzypfg== 2023-11-08T19:22:42.366 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.5] 2023-11-08T19:22:42.366 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQD430tlCMCRFRAAJwP6E9TRRNneQzL7TVU6jg== 2023-11-08T19:22:42.366 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.6] 2023-11-08T19:22:42.366 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQD730tl176/FBAADjNAIKgdn3bIRlN725KW7g== 2023-11-08T19:22:42.367 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.7] 2023-11-08T19:22:42.367 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQD+30tl6CCxFBAAcProM9OqTGE6LtReNxvljA== 2023-11-08T19:22:42.367 INFO:teuthology.orchestra.run.smithi160.stdout:[client.0] 2023-11-08T19:22:42.367 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQDi30tlQEEsNxAAiPozrOREh+IJXoj7ZkhvLg== 2023-11-08T19:22:42.367 INFO:teuthology.orchestra.run.smithi160.stdout:[client.2] 2023-11-08T19:22:42.368 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQDi30tlZfZ+OhAAak0bEZA4XzCWwYINh0SvGQ== 2023-11-08T19:22:42.368 INFO:teuthology.orchestra.run.smithi160.stdout:[client.1] 2023-11-08T19:22:42.368 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQDj30tluO08AhAAKiNHfc6ETU6HU+0PSkRTdg== 2023-11-08T19:22:42.368 INFO:teuthology.orchestra.run.smithi160.stdout:[client.3] 2023-11-08T19:22:42.368 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQDj30tlLMAICBAAApxzbDjmCxzR32Puyeov6A== 2023-11-08T19:22:42.369 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-08T19:22:42.391 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-08T19:22:42.463 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-08T19:22:42.465 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-08T19:22:42.522 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-08T19:22:42.524 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-08T19:22:42.581 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-08T19:22:42.583 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-08T19:22:42.636 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-08T19:22:42.639 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-08T19:22:42.692 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-08T19:22:42.694 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-08T19:22:42.747 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-08T19:22:42.750 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-08T19:22:42.803 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-08T19:22:42.805 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-08T19:22:42.858 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-08T19:22:42.861 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-08T19:22:42.917 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-08T19:22:42.919 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-08T19:22:42.976 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-08T19:22:42.979 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-08T19:22:43.031 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-08T19:22:43.034 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-08T19:22:43.089 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-08T19:22:43.091 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-08T19:22:43.144 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-08T19:22:43.147 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-08T19:22:43.200 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-08T19:22:43.203 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-08T19:22:43.259 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-08T19:22:43.262 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-08T19:22:43.318 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-08T19:22:43.321 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-08T19:22:43.377 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-08T19:22:43.380 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-08T19:22:43.436 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-11-08T19:22:43.436 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-11-08T19:22:43.463 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-08T19:22:43.562 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-11-08T19:22:43.588 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-11-08T19:22:43.615 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-08T19:22:43.714 DEBUG:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-11-08T19:22:43.740 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-11-08T19:22:43.806 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-08T19:22:43.905 DEBUG:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-11-08T19:22:43.931 DEBUG:teuthology.orchestra.run.smithi149:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-08T19:22:43.934 DEBUG:teuthology.orchestra.run.smithi160:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-08T19:22:43.988 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-11-08T19:22:43.988 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-08T19:22:43.989 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-11-08T19:22:43.991 INFO:tasks.ceph.mon.a:Started 2023-11-08T19:22:43.992 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-08T19:22:43.992 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-11-08T19:22:44.030 INFO:tasks.ceph.mon.b:Started 2023-11-08T19:22:44.031 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-08T19:22:44.031 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-11-08T19:22:44.033 INFO:tasks.ceph.mon.c:Started 2023-11-08T19:22:44.033 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-11-08T19:22:44.034 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-11-08T19:22:44.034 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-11-08T19:22:44.036 INFO:tasks.ceph.mgr.y:Started 2023-11-08T19:22:44.036 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-11-08T19:22:44.037 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-11-08T19:22:44.039 INFO:tasks.ceph.mgr.x:Started 2023-11-08T19:22:44.039 INFO:tasks.ceph:Setting crush tunables to default 2023-11-08T19:22:44.039 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd crush tunables default 2023-11-08T19:22:44.162 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.159+0000 7f08c4adc700 1 Processor -- start 2023-11-08T19:22:44.162 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.160+0000 7f08c4adc700 1 -- start start 2023-11-08T19:22:44.163 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.161+0000 7f08c4adc700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f08c00d1130 0x7f08c00b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:44.164 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.161+0000 7f08c4adc700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08c00b6470 con 0x7f08c00cc870 2023-11-08T19:22:44.164 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.161+0000 7f08c4adc700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08c015afd0 con 0x7f08c015abf0 2023-11-08T19:22:44.164 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.161+0000 7f08c4adc700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08c00b66a0 con 0x7f08c00d1130 2023-11-08T19:22:44.164 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.161+0000 7f08bed9d700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f08c00cc870 0x7f08c006bc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:38140/0 (socket says 172.21.15.149:38140) 2023-11-08T19:22:44.165 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.161+0000 7f08bed9d700 1 -- 172.21.15.149:0/750337435 learned_addr learned my addr 172.21.15.149:0/750337435 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:22:44.165 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.161+0000 7f08bdd9b700 1 --2- 172.21.15.149:0/750337435 >> v2:172.21.15.160:3300/0 conn(0x7f08c00d1130 0x7f08c00b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:44.165 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.161+0000 7f08bdd9b700 1 -- 172.21.15.149:0/750337435 >> v2:172.21.15.160:3300/0 conn(0x7f08c00d1130 msgr2=0x7f08c00b5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-08T19:22:44.165 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.161+0000 7f08bdd9b700 1 -- 172.21.15.149:0/750337435 >> v2:172.21.15.160:3300/0 conn(0x7f08c00d1130 msgr2=0x7f08c00b5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-08T19:22:44.165 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.161+0000 7f08bdd9b700 1 --2- 172.21.15.149:0/750337435 >> v2:172.21.15.160:3300/0 conn(0x7f08c00d1130 0x7f08c00b5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-08T19:22:44.166 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.161+0000 7f08bdd9b700 1 --2- 172.21.15.149:0/750337435 >> v2:172.21.15.160:3300/0 conn(0x7f08c00d1130 0x7f08c00b5f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-08T19:22:44.344 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.339+0000 7f08bd59a700 1 -- 172.21.15.149:0/750337435 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 207135219 0 0) 0x7f08c00b6470 con 0x7f08c00cc870 2023-11-08T19:22:44.345 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.339+0000 7f08bd59a700 1 -- 172.21.15.149:0/750337435 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08a80035b0 con 0x7f08c00cc870 2023-11-08T19:22:44.345 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.340+0000 7f08bd59a700 1 -- 172.21.15.149:0/750337435 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3005172844 0 0) 0x7f08c015afd0 con 0x7f08c015abf0 2023-11-08T19:22:44.345 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.340+0000 7f08bd59a700 1 -- 172.21.15.149:0/750337435 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08c00b6470 con 0x7f08c015abf0 2023-11-08T19:22:44.345 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.340+0000 7f08bd59a700 1 -- 172.21.15.149:0/750337435 <== mon.1 v1:172.21.15.160:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3355505337 0 0) 0x7f08c00b6470 con 0x7f08c015abf0 2023-11-08T19:22:44.346 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.340+0000 7f08bd59a700 1 -- 172.21.15.149:0/750337435 >> v2:172.21.15.160:3300/0 conn(0x7f08c00d1130 msgr2=0x7f08c00b5f30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-08T19:22:44.346 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.340+0000 7f08bd59a700 1 --2- 172.21.15.149:0/750337435 >> v2:172.21.15.160:3300/0 conn(0x7f08c00d1130 0x7f08c00b5f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:44.346 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.340+0000 7f08bd59a700 1 -- 172.21.15.149:0/750337435 >> v1:172.21.15.149:6789/0 conn(0x7f08c00cc870 legacy=0x7f08c006bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:44.346 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.340+0000 7f08bd59a700 1 -- 172.21.15.149:0/750337435 --> v1:172.21.15.160:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c015e880 con 0x7f08c015abf0 2023-11-08T19:22:44.346 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.340+0000 7f08bd59a700 1 -- 172.21.15.149:0/750337435 <== mon.1 v1:172.21.15.160:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f08b0001670 con 0x7f08c015abf0 2023-11-08T19:22:44.347 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.340+0000 7f08bd59a700 1 -- 172.21.15.149:0/750337435 >> v1:172.21.15.160:6789/0 conn(0x7f08c015abf0 legacy=0x7f08c00cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:44.347 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.340+0000 7f08bd59a700 1 --2- 172.21.15.149:0/750337435 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08a8003c00 0x7f08a8004000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:44.347 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.340+0000 7f08bd59a700 1 --2- 172.21.15.149:0/750337435 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08a8004850 0x7f08a8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:44.347 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.340+0000 7f08bd59a700 1 --2- 172.21.15.149:0/750337435 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f08a8005330 0x7f08a800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:44.348 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.340+0000 7f08bd59a700 1 -- 172.21.15.149:0/750337435 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c00b66a0 con 0x7f08a8004850 2023-11-08T19:22:44.348 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.340+0000 7f08bd59a700 1 -- 172.21.15.149:0/750337435 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a800c250 con 0x7f08a8003c00 2023-11-08T19:22:44.348 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.340+0000 7f08bd59a700 1 -- 172.21.15.149:0/750337435 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08a800c410 con 0x7f08a8005330 2023-11-08T19:22:44.348 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.340+0000 7f08be59c700 1 --2- 172.21.15.149:0/750337435 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08a8003c00 0x7f08a8004000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:44.348 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.340+0000 7f08bdd9b700 1 --2- 172.21.15.149:0/750337435 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08a8004850 0x7f08a8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:44.349 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.340+0000 7f08bed9d700 1 --2- 172.21.15.149:0/750337435 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f08a8005330 0x7f08a800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:44.349 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.341+0000 7f08bdd9b700 1 -- 172.21.15.149:0/750337435 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f08a8005330 msgr2=0x7f08a800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:22:44.349 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.341+0000 7f08bdd9b700 1 --2- 172.21.15.149:0/750337435 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f08a8005330 0x7f08a800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:44.349 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.341+0000 7f08bdd9b700 1 -- 172.21.15.149:0/750337435 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08a8003c00 msgr2=0x7f08a8004000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:22:44.349 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.341+0000 7f08bdd9b700 1 --2- 172.21.15.149:0/750337435 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08a8003c00 0x7f08a8004000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:44.350 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.341+0000 7f08bdd9b700 1 -- 172.21.15.149:0/750337435 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c00b6470 con 0x7f08a8004850 2023-11-08T19:22:44.350 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.341+0000 7f08bed9d700 1 -- 172.21.15.149:0/750337435 reap_dead start 2023-11-08T19:22:44.350 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.341+0000 7f08be59c700 1 --2- 172.21.15.149:0/750337435 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08a8003c00 0x7f08a8004000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:22:44.350 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.341+0000 7f08bdd9b700 1 --2- 172.21.15.149:0/750337435 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08a8004850 0x7f08a8004cd0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f08b4009890 tx=0x7f08a8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46d64918a159f9d7 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:22:44.350 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.341+0000 7f08bd59a700 1 -- 172.21.15.149:0/750337435 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b400c070 con 0x7f08a8004850 2023-11-08T19:22:44.351 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.341+0000 7f08bd59a700 1 -- 172.21.15.149:0/750337435 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b4004020 con 0x7f08a8004850 2023-11-08T19:22:44.351 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.341+0000 7f08bd59a700 1 -- 172.21.15.149:0/750337435 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b40043d0 con 0x7f08a8004850 2023-11-08T19:22:44.351 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.342+0000 7f08c4adc700 1 -- 172.21.15.149:0/750337435 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08a8004850 msgr2=0x7f08a8004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:44.351 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.342+0000 7f08c4adc700 1 --2- 172.21.15.149:0/750337435 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08a8004850 0x7f08a8004cd0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f08b4009890 tx=0x7f08a8005880 comp rx=0 tx=0).stop 2023-11-08T19:22:44.351 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.342+0000 7f08c4adc700 1 -- 172.21.15.149:0/750337435 shutdown_connections 2023-11-08T19:22:44.352 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.342+0000 7f08c4adc700 1 --2- 172.21.15.149:0/750337435 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08a8004850 0x7f08a8004cd0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:44.352 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.342+0000 7f08c4adc700 1 -- 172.21.15.149:0/750337435 >> 172.21.15.149:0/750337435 conn(0x7f08c00d0640 msgr2=0x7f08c00d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:22:44.352 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.342+0000 7f08c4adc700 1 -- 172.21.15.149:0/750337435 shutdown_connections 2023-11-08T19:22:44.352 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.342+0000 7f08c4adc700 1 -- 172.21.15.149:0/750337435 wait complete. 2023-11-08T19:22:44.355 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.344+0000 7f08c4adc700 1 Processor -- start 2023-11-08T19:22:44.355 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.344+0000 7f08c4adc700 1 -- start start 2023-11-08T19:22:44.356 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.345+0000 7f08c4adc700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f08a8004850 0x7f08c015afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:44.356 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.345+0000 7f08c4adc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08c00b4e20 0x7f08c00ce740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:44.356 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.345+0000 7f08c4adc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08c01fc060 0x7f08c01fc510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:44.356 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.345+0000 7f08c4adc700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c015bf00 con 0x7f08c00b4e20 2023-11-08T19:22:44.356 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.345+0000 7f08c4adc700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c01fbbd0 con 0x7f08c01fc060 2023-11-08T19:22:44.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.345+0000 7f08c4adc700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08c015b660 con 0x7f08a8004850 2023-11-08T19:22:44.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.345+0000 7f08bdd9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08c00b4e20 0x7f08c00ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:44.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.345+0000 7f08bdd9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08c00b4e20 0x7f08c00ce740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36170/0 (socket says 172.21.15.149:36170) 2023-11-08T19:22:44.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.345+0000 7f08bdd9b700 1 -- 172.21.15.149:0/914213542 learned_addr learned my addr 172.21.15.149:0/914213542 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:22:44.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.345+0000 7f08be59c700 1 --2- 172.21.15.149:0/914213542 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f08a8004850 0x7f08c015afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:44.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.345+0000 7f08bed9d700 1 --2- 172.21.15.149:0/914213542 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08c01fc060 0x7f08c01fc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:44.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.345+0000 7f08bdd9b700 1 -- 172.21.15.149:0/914213542 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f08a8004850 msgr2=0x7f08c015afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:44.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.345+0000 7f08bdd9b700 1 --2- 172.21.15.149:0/914213542 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f08a8004850 0x7f08c015afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:44.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.345+0000 7f08bdd9b700 1 -- 172.21.15.149:0/914213542 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08c01fc060 msgr2=0x7f08c01fc510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:44.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.345+0000 7f08bdd9b700 1 --2- 172.21.15.149:0/914213542 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08c01fc060 0x7f08c01fc510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:44.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.345+0000 7f08bdd9b700 1 -- 172.21.15.149:0/914213542 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c015b940 con 0x7f08c00b4e20 2023-11-08T19:22:44.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.345+0000 7f08bdd9b700 1 --2- 172.21.15.149:0/914213542 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08c00b4e20 0x7f08c00ce740 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f08b40044c0 tx=0x7f08b40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:22:44.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.345+0000 7f08aeffd700 1 -- 172.21.15.149:0/914213542 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b4003970 con 0x7f08c00b4e20 2023-11-08T19:22:44.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.345+0000 7f08aeffd700 1 -- 172.21.15.149:0/914213542 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b4003af0 con 0x7f08c00b4e20 2023-11-08T19:22:44.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.346+0000 7f08aeffd700 1 -- 172.21.15.149:0/914213542 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b4003ea0 con 0x7f08c00b4e20 2023-11-08T19:22:44.360 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.346+0000 7f08c4adc700 1 -- 172.21.15.149:0/914213542 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08c015bc20 con 0x7f08c00b4e20 2023-11-08T19:22:44.360 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.346+0000 7f08c4adc700 1 -- 172.21.15.149:0/914213542 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08c00cec80 con 0x7f08c00b4e20 2023-11-08T19:22:44.360 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.346+0000 7f08aeffd700 1 -- 172.21.15.149:0/914213542 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f08b4027740 con 0x7f08c00b4e20 2023-11-08T19:22:44.360 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.346+0000 7f08aeffd700 1 -- 172.21.15.149:0/914213542 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f08b401c9a0 con 0x7f08c00b4e20 2023-11-08T19:22:44.360 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.347+0000 7f08c4adc700 1 -- 172.21.15.149:0/914213542 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08c01fb9a0 con 0x7f08c00b4e20 2023-11-08T19:22:44.361 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.349+0000 7f08aeffd700 1 -- 172.21.15.149:0/914213542 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f08b4046b40 con 0x7f08c00b4e20 2023-11-08T19:22:44.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.425+0000 7f08c4adc700 1 -- 172.21.15.149:0/914213542 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f08c00ceea0 con 0x7f08c00b4e20 2023-11-08T19:22:44.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.427+0000 7f08aeffd700 1 -- 172.21.15.149:0/914213542 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f08b4035020 con 0x7f08c00b4e20 2023-11-08T19:22:44.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.428+0000 7f08c4adc700 1 -- 172.21.15.149:0/914213542 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08c00b4e20 msgr2=0x7f08c00ce740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:44.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.428+0000 7f08c4adc700 1 --2- 172.21.15.149:0/914213542 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08c00b4e20 0x7f08c00ce740 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f08b40044c0 tx=0x7f08b40047c0 comp rx=0 tx=0).stop 2023-11-08T19:22:44.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.428+0000 7f08c4adc700 1 -- 172.21.15.149:0/914213542 shutdown_connections 2023-11-08T19:22:44.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.428+0000 7f08c4adc700 1 --2- 172.21.15.149:0/914213542 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08c01fc060 0x7f08c01fc510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:44.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.428+0000 7f08c4adc700 1 --2- 172.21.15.149:0/914213542 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f08a8004850 0x7f08c015afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:44.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.428+0000 7f08c4adc700 1 --2- 172.21.15.149:0/914213542 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08c00b4e20 0x7f08c00ce740 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:44.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.428+0000 7f08c4adc700 1 -- 172.21.15.149:0/914213542 >> 172.21.15.149:0/914213542 conn(0x7f08c00d0640 msgr2=0x7f08c00d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:22:44.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.428+0000 7f08c4adc700 1 -- 172.21.15.149:0/914213542 shutdown_connections 2023-11-08T19:22:44.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:44.428+0000 7f08c4adc700 1 -- 172.21.15.149:0/914213542 wait complete. 2023-11-08T19:22:44.433 INFO:teuthology.orchestra.run.smithi149.stderr:adjusted tunables profile to default 2023-11-08T19:22:44.443 INFO:tasks.ceph:check_enable_crimson: False 2023-11-08T19:22:44.443 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-11-08T19:22:44.443 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-11-08T19:22:44.444 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-11-08T19:22:44.460 INFO:tasks.ceph.mgr.x.smithi160.stderr:2023-11-08T19:22:44.458+0000 7f8dc02fb200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-08T19:22:44.461 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-11-08T19:22:44.460+0000 7fa4851e6200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-08T19:22:44.470 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-11-08T19:22:44.470 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-11-08T19:22:44.525 INFO:tasks.ceph.mgr.x.smithi160.stderr:2023-11-08T19:22:44.523+0000 7f8dc02fb200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-08T19:22:44.530 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-11-08T19:22:44.528+0000 7fa4851e6200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-08T19:22:44.536 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-11-08T19:22:44.537 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-11-08T19:22:44.601 INFO:tasks.ceph.mgr.x.smithi160.stderr:2023-11-08T19:22:44.599+0000 7f8dc02fb200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-08T19:22:44.603 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-11-08T19:22:44.603 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-11-08T19:22:44.610 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-11-08T19:22:44.608+0000 7fa4851e6200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-08T19:22:44.636 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-11-08T19:22:44.637 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-11-08T19:22:44.665 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-11-08T19:22:44.665 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-11-08T19:22:44.684 INFO:tasks.ceph.mgr.x.smithi160.stderr:2023-11-08T19:22:44.682+0000 7f8dc02fb200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-08T19:22:44.693 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-11-08T19:22:44.691+0000 7fa4851e6200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-08T19:22:44.710 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-11-08T19:22:44.711 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-11-08T19:22:44.776 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-11-08T19:22:44.777 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-11-08T19:22:44.834 INFO:tasks.ceph.mgr.x.smithi160.stderr:2023-11-08T19:22:44.833+0000 7f8dc02fb200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-08T19:22:44.836 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-11-08T19:22:44.835+0000 7fa4851e6200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-08T19:22:44.842 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new 11cd1da4-be4e-454c-9727-4747e428907c 0 2023-11-08T19:22:45.004 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.002+0000 7f2485456700 1 Processor -- start 2023-11-08T19:22:45.004 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.002+0000 7f2485456700 1 -- start start 2023-11-08T19:22:45.006 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.003+0000 7f2485456700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f24800d0a40 0x7f24800d3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:45.006 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.003+0000 7f2485456700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f248015dfc0 con 0x7f248015dbe0 2023-11-08T19:22:45.007 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.003+0000 7f2485456700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24800d2280 con 0x7f24800b9640 2023-11-08T19:22:45.007 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.003+0000 7f2485456700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24800d2090 con 0x7f24800d0a40 2023-11-08T19:22:45.007 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.003+0000 7f247f7fe700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f24800d0a40 0x7f24800d3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:45.007 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.003+0000 7f247f7fe700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f24800d0a40 0x7f24800d3320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:47544/0 (socket says 172.21.15.160:47544) 2023-11-08T19:22:45.007 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.003+0000 7f247f7fe700 1 -- 172.21.15.160:0/3308897839 learned_addr learned my addr 172.21.15.160:0/3308897839 (peer_addr_for_me v2:172.21.15.160:0/0) 2023-11-08T19:22:45.008 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.003+0000 7f247f7fe700 1 -- 172.21.15.160:0/3308897839 >> v1:172.21.15.160:6789/0 conn(0x7f24800b9640 legacy=0x7f24800d0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:45.008 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.003+0000 7f247f7fe700 1 -- 172.21.15.160:0/3308897839 >> v1:172.21.15.149:6789/0 conn(0x7f248015dbe0 legacy=0x7f24800d1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:45.008 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.003+0000 7f247f7fe700 1 -- 172.21.15.160:0/3308897839 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24800d2560 con 0x7f24800d0a40 2023-11-08T19:22:45.008 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.004+0000 7f247f7fe700 1 --2- 172.21.15.160:0/3308897839 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f24800d0a40 0x7f24800d3320 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2478009e50 tx=0x7f247800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=835b5445b487bba server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:22:45.008 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.004+0000 7f247dffb700 1 -- 172.21.15.160:0/3308897839 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247800e070 con 0x7f24800d0a40 2023-11-08T19:22:45.009 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.004+0000 7f247dffb700 1 -- 172.21.15.160:0/3308897839 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f247800b9c0 con 0x7f24800d0a40 2023-11-08T19:22:45.009 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.004+0000 7f247dffb700 1 -- 172.21.15.160:0/3308897839 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247800bd70 con 0x7f24800d0a40 2023-11-08T19:22:45.009 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.004+0000 7f2485456700 1 -- 172.21.15.160:0/3308897839 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f24800d0a40 msgr2=0x7f24800d3320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:45.009 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.004+0000 7f2485456700 1 --2- 172.21.15.160:0/3308897839 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f24800d0a40 0x7f24800d3320 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2478009e50 tx=0x7f247800b330 comp rx=0 tx=0).stop 2023-11-08T19:22:45.009 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.004+0000 7f2485456700 1 -- 172.21.15.160:0/3308897839 shutdown_connections 2023-11-08T19:22:45.010 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.004+0000 7f2485456700 1 --2- 172.21.15.160:0/3308897839 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f24800d0a40 0x7f24800d3320 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:45.010 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.004+0000 7f2485456700 1 -- 172.21.15.160:0/3308897839 >> 172.21.15.160:0/3308897839 conn(0x7f248006bd60 msgr2=0x7f248006c140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:22:45.010 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.004+0000 7f2485456700 1 -- 172.21.15.160:0/3308897839 shutdown_connections 2023-11-08T19:22:45.010 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.004+0000 7f2485456700 1 -- 172.21.15.160:0/3308897839 wait complete. 2023-11-08T19:22:45.013 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.006+0000 7f2485456700 1 Processor -- start 2023-11-08T19:22:45.013 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.006+0000 7f2485456700 1 -- start start 2023-11-08T19:22:45.013 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.006+0000 7f2485456700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24800b9640 0x7f24801f3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:45.013 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.006+0000 7f2485456700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f24800d0a40 0x7f24801f2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:45.013 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.006+0000 7f2485456700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f248015dbe0 0x7f24800c9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:45.014 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.006+0000 7f2485456700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24801f41f0 con 0x7f24800b9640 2023-11-08T19:22:45.014 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.006+0000 7f2485456700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24800b30a0 con 0x7f248015dbe0 2023-11-08T19:22:45.014 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.006+0000 7f2485456700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24801601c0 con 0x7f24800d0a40 2023-11-08T19:22:45.014 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.006+0000 7f247f7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f248015dbe0 0x7f24800c9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:45.015 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.006+0000 7f247e7fc700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f24800d0a40 0x7f24801f2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:45.015 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.007+0000 7f247e7fc700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f24800d0a40 0x7f24801f2ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.160:49502/0 (socket says 172.21.15.160:49502) 2023-11-08T19:22:45.015 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.007+0000 7f247f7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f248015dbe0 0x7f24800c9660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:47550/0 (socket says 172.21.15.160:47550) 2023-11-08T19:22:45.015 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.007+0000 7f247e7fc700 1 -- 172.21.15.160:0/3084614684 learned_addr learned my addr 172.21.15.160:0/3084614684 (peer_addr_for_me v2:172.21.15.160:0/0) 2023-11-08T19:22:45.015 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.007+0000 7f247effd700 1 --2- 172.21.15.160:0/3084614684 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24800b9640 0x7f24801f3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:45.016 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.007+0000 7f247e7fc700 1 -- 172.21.15.160:0/3084614684 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f248015dbe0 msgr2=0x7f24800c9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:45.016 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.007+0000 7f247e7fc700 1 --2- 172.21.15.160:0/3084614684 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f248015dbe0 0x7f24800c9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:45.016 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.007+0000 7f247e7fc700 1 -- 172.21.15.160:0/3084614684 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24800b9640 msgr2=0x7f24801f3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:45.016 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.007+0000 7f247e7fc700 1 --2- 172.21.15.160:0/3084614684 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24800b9640 0x7f24801f3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:45.016 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.007+0000 7f247e7fc700 1 -- 172.21.15.160:0/3084614684 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2478009b30 con 0x7f24800d0a40 2023-11-08T19:22:45.017 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.007+0000 7f247f7fe700 1 --2- 172.21.15.160:0/3084614684 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f248015dbe0 0x7f24800c9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:22:45.017 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.007+0000 7f247e7fc700 1 --2- 172.21.15.160:0/3084614684 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f24800d0a40 0x7f24801f2ad0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f247400c730 tx=0x7f247400ca40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:22:45.017 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.007+0000 7f24677fe700 1 -- 172.21.15.160:0/3084614684 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24740052d0 con 0x7f24800d0a40 2023-11-08T19:22:45.017 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.007+0000 7f24677fe700 1 -- 172.21.15.160:0/3084614684 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2474005430 con 0x7f24800d0a40 2023-11-08T19:22:45.017 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.007+0000 7f2485456700 1 -- 172.21.15.160:0/3084614684 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24801f6d70 con 0x7f24800d0a40 2023-11-08T19:22:45.018 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.007+0000 7f24677fe700 1 -- 172.21.15.160:0/3084614684 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24740038a0 con 0x7f24800d0a40 2023-11-08T19:22:45.018 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.007+0000 7f2485456700 1 -- 172.21.15.160:0/3084614684 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24801f7330 con 0x7f24800d0a40 2023-11-08T19:22:45.018 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.007+0000 7f24677fe700 1 -- 172.21.15.160:0/3084614684 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2474003d00 con 0x7f24800d0a40 2023-11-08T19:22:45.018 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.007+0000 7f24677fe700 1 -- 172.21.15.160:0/3084614684 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f247401c780 con 0x7f24800d0a40 2023-11-08T19:22:45.019 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.008+0000 7f2485456700 1 -- 172.21.15.160:0/3084614684 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24800b3270 con 0x7f24800d0a40 2023-11-08T19:22:45.019 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.012+0000 7f24677fe700 1 -- 172.21.15.160:0/3084614684 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f24800b3270 con 0x7f24800d0a40 2023-11-08T19:22:45.096 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.094+0000 7f2485456700 1 -- 172.21.15.160:0/3084614684 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "osd new", "uuid": "11cd1da4-be4e-454c-9727-4747e428907c", "id": 0} v 0) v1 -- 0x7f248004f730 con 0x7f24800d0a40 2023-11-08T19:22:45.099 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.098+0000 7f24677fe700 1 -- 172.21.15.160:0/3084614684 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "11cd1da4-be4e-454c-9727-4747e428907c", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2474017070 con 0x7f24800d0a40 2023-11-08T19:22:45.099 INFO:teuthology.orchestra.run.smithi160.stdout:0 2023-11-08T19:22:45.101 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.099+0000 7f2485456700 1 -- 172.21.15.160:0/3084614684 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f24800d0a40 msgr2=0x7f24801f2ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:45.101 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.099+0000 7f2485456700 1 --2- 172.21.15.160:0/3084614684 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f24800d0a40 0x7f24801f2ad0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f247400c730 tx=0x7f247400ca40 comp rx=0 tx=0).stop 2023-11-08T19:22:45.101 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.099+0000 7f2485456700 1 -- 172.21.15.160:0/3084614684 shutdown_connections 2023-11-08T19:22:45.101 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.099+0000 7f2485456700 1 --2- 172.21.15.160:0/3084614684 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f248015dbe0 0x7f24800c9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:45.102 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.099+0000 7f2485456700 1 --2- 172.21.15.160:0/3084614684 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24800b9640 0x7f24801f3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:45.102 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.099+0000 7f2485456700 1 --2- 172.21.15.160:0/3084614684 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f24800d0a40 0x7f24801f2ad0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:45.102 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.099+0000 7f2485456700 1 -- 172.21.15.160:0/3084614684 >> 172.21.15.160:0/3084614684 conn(0x7f248006bd60 msgr2=0x7f24800b8590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:22:45.102 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.099+0000 7f2485456700 1 -- 172.21.15.160:0/3084614684 shutdown_connections 2023-11-08T19:22:45.102 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.099+0000 7f2485456700 1 -- 172.21.15.160:0/3084614684 wait complete. 2023-11-08T19:22:45.112 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new 88cf49a1-c930-42c6-afdf-8b5baa8d5dc5 1 2023-11-08T19:22:45.229 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-11-08T19:22:45.227+0000 7fa4851e6200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-08T19:22:45.232 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.230+0000 7fc652b17700 1 Processor -- start 2023-11-08T19:22:45.233 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.230+0000 7fc652b17700 1 -- start start 2023-11-08T19:22:45.240 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.231+0000 7fc652b17700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fc64c15df40 0x7fc64c06c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:45.241 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.231+0000 7fc652b17700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc64c06ab80 0x7fc64c06c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:45.241 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.231+0000 7fc652b17700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc64c15e320 con 0x7fc64c0cf1c0 2023-11-08T19:22:45.242 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.231+0000 7fc652b17700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc64c06b020 con 0x7fc64c15df40 2023-11-08T19:22:45.242 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.231+0000 7fc652b17700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c06b2e0 con 0x7fc64c06ab80 2023-11-08T19:22:45.242 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.231+0000 7fc6508b3700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fc64c15df40 0x7fc64c06c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:45.243 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.231+0000 7fc64bfff700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc64c06ab80 0x7fc64c06c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:45.243 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.231+0000 7fc6508b3700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fc64c15df40 0x7fc64c06c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:47552/0 (socket says 172.21.15.160:47552) 2023-11-08T19:22:45.244 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.231+0000 7fc6508b3700 1 -- 172.21.15.160:0/1275108698 learned_addr learned my addr 172.21.15.160:0/1275108698 (peer_addr_for_me v2:172.21.15.160:0/0) 2023-11-08T19:22:45.244 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.231+0000 7fc64bfff700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc64c06ab80 0x7fc64c06c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.160:49508/0 (socket says 172.21.15.160:49508) 2023-11-08T19:22:45.244 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.232+0000 7fc6508b3700 1 -- 172.21.15.160:0/1275108698 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc64c06ab80 msgr2=0x7fc64c06c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:22:45.245 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.232+0000 7fc6508b3700 1 --2- 172.21.15.160:0/1275108698 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc64c06ab80 0x7fc64c06c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:45.245 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.232+0000 7fc6508b3700 1 -- 172.21.15.160:0/1275108698 >> v1:172.21.15.149:6789/0 conn(0x7fc64c0cf1c0 legacy=0x7fc64c0caf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:45.245 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.232+0000 7fc6508b3700 1 -- 172.21.15.160:0/1275108698 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc64c06b5c0 con 0x7fc64c15df40 2023-11-08T19:22:45.246 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.232+0000 7fc64bfff700 1 --2- 172.21.15.160:0/1275108698 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc64c06ab80 0x7fc64c06c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:22:45.246 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.232+0000 7fc6508b3700 1 --2- 172.21.15.160:0/1275108698 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc64c15df40 0x7fc64c06c0a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc6400098f0 tx=0x7fc640009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c052ad81e6d459b server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:22:45.247 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.232+0000 7fc64b7fe700 1 -- 172.21.15.160:0/1275108698 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc640011830 con 0x7fc64c15df40 2023-11-08T19:22:45.247 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.232+0000 7fc64b7fe700 1 -- 172.21.15.160:0/1275108698 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc640011990 con 0x7fc64c15df40 2023-11-08T19:22:45.247 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.232+0000 7fc64b7fe700 1 -- 172.21.15.160:0/1275108698 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc640011d20 con 0x7fc64c15df40 2023-11-08T19:22:45.248 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.232+0000 7fc652b17700 1 -- 172.21.15.160:0/1275108698 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc64c15df40 msgr2=0x7fc64c06c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:45.248 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.232+0000 7fc652b17700 1 --2- 172.21.15.160:0/1275108698 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc64c15df40 0x7fc64c06c0a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc6400098f0 tx=0x7fc640009c00 comp rx=0 tx=0).stop 2023-11-08T19:22:45.249 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.233+0000 7fc652b17700 1 -- 172.21.15.160:0/1275108698 shutdown_connections 2023-11-08T19:22:45.249 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.233+0000 7fc652b17700 1 --2- 172.21.15.160:0/1275108698 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc64c15df40 0x7fc64c06c0a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:45.249 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.233+0000 7fc652b17700 1 --2- 172.21.15.160:0/1275108698 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc64c06ab80 0x7fc64c06c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:45.250 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.233+0000 7fc652b17700 1 -- 172.21.15.160:0/1275108698 >> 172.21.15.160:0/1275108698 conn(0x7fc64c0d0640 msgr2=0x7fc64c0d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:22:45.250 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.233+0000 7fc652b17700 1 -- 172.21.15.160:0/1275108698 shutdown_connections 2023-11-08T19:22:45.251 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.233+0000 7fc652b17700 1 -- 172.21.15.160:0/1275108698 wait complete. 2023-11-08T19:22:45.251 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.234+0000 7fc652b17700 1 Processor -- start 2023-11-08T19:22:45.251 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.234+0000 7fc652b17700 1 -- start start 2023-11-08T19:22:45.252 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.235+0000 7fc652b17700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc64c06ab80 0x7fc64c14be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:45.252 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.235+0000 7fc652b17700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc64c0cf1c0 0x7fc64c15cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:45.253 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.235+0000 7fc652b17700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc64c15df40 0x7fc64c160340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:45.253 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.235+0000 7fc652b17700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c15d500 con 0x7fc64c0cf1c0 2023-11-08T19:22:45.253 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.235+0000 7fc652b17700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c1f7010 con 0x7fc64c15df40 2023-11-08T19:22:45.254 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.235+0000 7fc652b17700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c14cbd0 con 0x7fc64c06ab80 2023-11-08T19:22:45.254 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.235+0000 7fc6508b3700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc64c06ab80 0x7fc64c14be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:45.255 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.235+0000 7fc6508b3700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc64c06ab80 0x7fc64c14be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.160:49512/0 (socket says 172.21.15.160:49512) 2023-11-08T19:22:45.255 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.235+0000 7fc6510b4700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc64c15df40 0x7fc64c160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:45.255 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.235+0000 7fc6508b3700 1 -- 172.21.15.160:0/589099391 learned_addr learned my addr 172.21.15.160:0/589099391 (peer_addr_for_me v2:172.21.15.160:0/0) 2023-11-08T19:22:45.256 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.235+0000 7fc64bfff700 1 --2- 172.21.15.160:0/589099391 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc64c0cf1c0 0x7fc64c15cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:45.256 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.235+0000 7fc6508b3700 1 -- 172.21.15.160:0/589099391 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc64c15df40 msgr2=0x7fc64c160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:45.256 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.235+0000 7fc6508b3700 1 --2- 172.21.15.160:0/589099391 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc64c15df40 0x7fc64c160340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:45.257 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.235+0000 7fc6508b3700 1 -- 172.21.15.160:0/589099391 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc64c0cf1c0 msgr2=0x7fc64c15cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:45.257 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.235+0000 7fc6508b3700 1 --2- 172.21.15.160:0/589099391 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc64c0cf1c0 0x7fc64c15cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:45.257 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.235+0000 7fc6508b3700 1 -- 172.21.15.160:0/589099391 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6380094a0 con 0x7fc64c06ab80 2023-11-08T19:22:45.257 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.235+0000 7fc6510b4700 1 --2- 172.21.15.160:0/589099391 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc64c15df40 0x7fc64c160340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:22:45.258 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.235+0000 7fc6508b3700 1 --2- 172.21.15.160:0/589099391 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc64c06ab80 0x7fc64c14be20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc640000c00 tx=0x7fc640004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:22:45.258 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.235+0000 7fc6497fa700 1 -- 172.21.15.160:0/589099391 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc640004400 con 0x7fc64c06ab80 2023-11-08T19:22:45.258 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.235+0000 7fc6497fa700 1 -- 172.21.15.160:0/589099391 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc64001f070 con 0x7fc64c06ab80 2023-11-08T19:22:45.258 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.235+0000 7fc6497fa700 1 -- 172.21.15.160:0/589099391 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6400038e0 con 0x7fc64c06ab80 2023-11-08T19:22:45.258 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.236+0000 7fc652b17700 1 -- 172.21.15.160:0/589099391 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc640009550 con 0x7fc64c06ab80 2023-11-08T19:22:45.259 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.236+0000 7fc652b17700 1 -- 172.21.15.160:0/589099391 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc64c15f9b0 con 0x7fc64c06ab80 2023-11-08T19:22:45.259 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.236+0000 7fc6497fa700 1 -- 172.21.15.160:0/589099391 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc640021030 con 0x7fc64c06ab80 2023-11-08T19:22:45.259 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.236+0000 7fc6497fa700 1 -- 172.21.15.160:0/589099391 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fc64001a950 con 0x7fc64c06ab80 2023-11-08T19:22:45.259 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.236+0000 7fc652b17700 1 -- 172.21.15.160:0/589099391 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc64c04f730 con 0x7fc64c06ab80 2023-11-08T19:22:45.260 INFO:tasks.ceph.mgr.x.smithi160.stderr:2023-11-08T19:22:45.240+0000 7f8dc02fb200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-08T19:22:45.260 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.240+0000 7fc6497fa700 1 -- 172.21.15.160:0/589099391 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fc640015020 con 0x7fc64c06ab80 2023-11-08T19:22:45.326 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.324+0000 7fc652b17700 1 -- 172.21.15.160:0/589099391 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "osd new", "uuid": "88cf49a1-c930-42c6-afdf-8b5baa8d5dc5", "id": 1} v 0) v1 -- 0x7fc64c0b1990 con 0x7fc64c06ab80 2023-11-08T19:22:45.329 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.328+0000 7fc6497fa700 1 -- 172.21.15.160:0/589099391 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "88cf49a1-c930-42c6-afdf-8b5baa8d5dc5", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc64001a450 con 0x7fc64c06ab80 2023-11-08T19:22:45.330 INFO:teuthology.orchestra.run.smithi160.stdout:1 2023-11-08T19:22:45.331 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.329+0000 7fc652b17700 1 -- 172.21.15.160:0/589099391 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc64c06ab80 msgr2=0x7fc64c14be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:45.331 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.329+0000 7fc652b17700 1 --2- 172.21.15.160:0/589099391 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc64c06ab80 0x7fc64c14be20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc640000c00 tx=0x7fc640004750 comp rx=0 tx=0).stop 2023-11-08T19:22:45.331 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.329+0000 7fc652b17700 1 -- 172.21.15.160:0/589099391 shutdown_connections 2023-11-08T19:22:45.332 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.329+0000 7fc652b17700 1 --2- 172.21.15.160:0/589099391 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc64c15df40 0x7fc64c160340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:45.332 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.329+0000 7fc652b17700 1 --2- 172.21.15.160:0/589099391 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc64c06ab80 0x7fc64c14be20 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:45.332 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.329+0000 7fc652b17700 1 --2- 172.21.15.160:0/589099391 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc64c0cf1c0 0x7fc64c15cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:45.332 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.329+0000 7fc652b17700 1 -- 172.21.15.160:0/589099391 >> 172.21.15.160:0/589099391 conn(0x7fc64c0d0640 msgr2=0x7fc64c0cd0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:22:45.332 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.329+0000 7fc652b17700 1 -- 172.21.15.160:0/589099391 shutdown_connections 2023-11-08T19:22:45.333 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.329+0000 7fc652b17700 1 -- 172.21.15.160:0/589099391 wait complete. 2023-11-08T19:22:45.344 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new 7ff48e7a-ff8f-4254-8c33-407ffc04b060 2 2023-11-08T19:22:45.354 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-11-08T19:22:45.352+0000 7fa4851e6200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-08T19:22:45.366 INFO:tasks.ceph.mgr.x.smithi160.stderr:2023-11-08T19:22:45.364+0000 7f8dc02fb200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-08T19:22:45.442 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-11-08T19:22:45.440+0000 7fa4851e6200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-08T19:22:45.452 INFO:tasks.ceph.mgr.x.smithi160.stderr:2023-11-08T19:22:45.450+0000 7f8dc02fb200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-08T19:22:45.465 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.463+0000 7f2e0aa39700 1 Processor -- start 2023-11-08T19:22:45.465 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.463+0000 7f2e0aa39700 1 -- start start 2023-11-08T19:22:45.467 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.464+0000 7f2e0aa39700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2e0415df40 0x7f2e0406c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:45.468 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.464+0000 7f2e0aa39700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f2e0406ab80 0x7f2e0406c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:45.468 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.464+0000 7f2e0aa39700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2e040cf1c0 0x7f2e040caf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:45.468 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.464+0000 7f2e0aa39700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e0415e320 con 0x7f2e0415df40 2023-11-08T19:22:45.468 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.464+0000 7f2e0aa39700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e0406b020 con 0x7f2e0406ab80 2023-11-08T19:22:45.468 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.464+0000 7f2e0aa39700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0406b2e0 con 0x7f2e040cf1c0 2023-11-08T19:22:45.469 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.464+0000 7f2e037fe700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f2e0406ab80 0x7f2e0406c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:45.469 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.464+0000 7f2e08fd6700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2e040cf1c0 0x7f2e040caf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:45.469 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.464+0000 7f2e08fd6700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2e040cf1c0 0x7f2e040caf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.160:49522/0 (socket says 172.21.15.160:49522) 2023-11-08T19:22:45.469 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.464+0000 7f2e037fe700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f2e0406ab80 0x7f2e0406c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:47566/0 (socket says 172.21.15.160:47566) 2023-11-08T19:22:45.469 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.464+0000 7f2e08fd6700 1 -- 172.21.15.160:0/1660789577 learned_addr learned my addr 172.21.15.160:0/1660789577 (peer_addr_for_me v2:172.21.15.160:0/0) 2023-11-08T19:22:45.470 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.464+0000 7f2e03fff700 1 --2- 172.21.15.160:0/1660789577 >> v2:172.21.15.149:3300/0 conn(0x7f2e0415df40 0x7f2e0406c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:45.470 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.464+0000 7f2e037fe700 1 -- 172.21.15.160:0/1660789577 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2e040cf1c0 msgr2=0x7f2e040caf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:22:45.470 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.464+0000 7f2e037fe700 1 --2- 172.21.15.160:0/1660789577 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2e040cf1c0 0x7f2e040caf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:45.470 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.464+0000 7f2e037fe700 1 -- 172.21.15.160:0/1660789577 >> v2:172.21.15.149:3300/0 conn(0x7f2e0415df40 msgr2=0x7f2e0406c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:22:45.470 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.464+0000 7f2e037fe700 1 --2- 172.21.15.160:0/1660789577 >> v2:172.21.15.149:3300/0 conn(0x7f2e0415df40 0x7f2e0406c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:45.471 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.464+0000 7f2e037fe700 1 -- 172.21.15.160:0/1660789577 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e0406b5c0 con 0x7f2e0406ab80 2023-11-08T19:22:45.471 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.464+0000 7f2e03fff700 1 --2- 172.21.15.160:0/1660789577 >> v2:172.21.15.149:3300/0 conn(0x7f2e0415df40 0x7f2e0406c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:22:45.471 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.464+0000 7f2e08fd6700 1 --2- 172.21.15.160:0/1660789577 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2e040cf1c0 0x7f2e040caf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:22:45.471 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.465+0000 7f2e037fe700 1 --2- 172.21.15.160:0/1660789577 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2e0406ab80 0x7f2e0406c5e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2e0406d940 tx=0x7f2df8009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9219be51e7d75b1c server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:22:45.471 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.465+0000 7f2e02ffd700 1 -- 172.21.15.160:0/1660789577 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df8011830 con 0x7f2e0406ab80 2023-11-08T19:22:45.472 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.465+0000 7f2e02ffd700 1 -- 172.21.15.160:0/1660789577 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2df8011990 con 0x7f2e0406ab80 2023-11-08T19:22:45.472 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.465+0000 7f2e02ffd700 1 -- 172.21.15.160:0/1660789577 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df8011d20 con 0x7f2e0406ab80 2023-11-08T19:22:45.472 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.465+0000 7f2e0aa39700 1 -- 172.21.15.160:0/1660789577 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2e0406ab80 msgr2=0x7f2e0406c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:45.472 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.465+0000 7f2e0aa39700 1 --2- 172.21.15.160:0/1660789577 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2e0406ab80 0x7f2e0406c5e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2e0406d940 tx=0x7f2df8009b20 comp rx=0 tx=0).stop 2023-11-08T19:22:45.472 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.466+0000 7f2e0aa39700 1 -- 172.21.15.160:0/1660789577 shutdown_connections 2023-11-08T19:22:45.473 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.466+0000 7f2e0aa39700 1 --2- 172.21.15.160:0/1660789577 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2e040cf1c0 0x7f2e040caf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:45.473 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.466+0000 7f2e0aa39700 1 --2- 172.21.15.160:0/1660789577 >> v2:172.21.15.149:3300/0 conn(0x7f2e0415df40 0x7f2e0406c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:45.473 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.466+0000 7f2e0aa39700 1 --2- 172.21.15.160:0/1660789577 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2e0406ab80 0x7f2e0406c5e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:45.473 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.466+0000 7f2e0aa39700 1 -- 172.21.15.160:0/1660789577 >> 172.21.15.160:0/1660789577 conn(0x7f2e040d0640 msgr2=0x7f2e040d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:22:45.473 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.466+0000 7f2e0aa39700 1 -- 172.21.15.160:0/1660789577 shutdown_connections 2023-11-08T19:22:45.474 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.466+0000 7f2e0aa39700 1 -- 172.21.15.160:0/1660789577 wait complete. 2023-11-08T19:22:45.476 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.467+0000 7f2e0aa39700 1 Processor -- start 2023-11-08T19:22:45.476 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.468+0000 7f2e0aa39700 1 -- start start 2023-11-08T19:22:45.477 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.469+0000 7f2e0aa39700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e0406ab80 0x7f2e040ae430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:45.477 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.469+0000 7f2e0aa39700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2e040cf1c0 0x7f2e04158af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:45.477 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.469+0000 7f2e0aa39700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2e0415df40 0x7f2e041f6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:45.477 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.469+0000 7f2e0aa39700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e041f7b90 con 0x7f2e0406ab80 2023-11-08T19:22:45.477 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.469+0000 7f2e0aa39700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e040ae970 con 0x7f2e040cf1c0 2023-11-08T19:22:45.478 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.469+0000 7f2e0aa39700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e041610c0 con 0x7f2e0415df40 2023-11-08T19:22:45.478 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.469+0000 7f2e037fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2e040cf1c0 0x7f2e04158af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:45.478 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.469+0000 7f2e08fd6700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2e0415df40 0x7f2e041f6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:45.478 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.469+0000 7f2e08fd6700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2e0415df40 0x7f2e041f6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.160:49528/0 (socket says 172.21.15.160:49528) 2023-11-08T19:22:45.478 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.469+0000 7f2e08fd6700 1 -- 172.21.15.160:0/3970189249 learned_addr learned my addr 172.21.15.160:0/3970189249 (peer_addr_for_me v2:172.21.15.160:0/0) 2023-11-08T19:22:45.479 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.469+0000 7f2e037fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2e040cf1c0 0x7f2e04158af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:47572/0 (socket says 172.21.15.160:47572) 2023-11-08T19:22:45.479 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.469+0000 7f2e03fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e0406ab80 0x7f2e040ae430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:45.479 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.469+0000 7f2e08fd6700 1 -- 172.21.15.160:0/3970189249 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2e040cf1c0 msgr2=0x7f2e04158af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:45.479 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.469+0000 7f2e08fd6700 1 --2- 172.21.15.160:0/3970189249 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2e040cf1c0 0x7f2e04158af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:45.479 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.469+0000 7f2e08fd6700 1 -- 172.21.15.160:0/3970189249 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e0406ab80 msgr2=0x7f2e040ae430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:45.480 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.469+0000 7f2e08fd6700 1 --2- 172.21.15.160:0/3970189249 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e0406ab80 0x7f2e040ae430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:45.480 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.469+0000 7f2e08fd6700 1 -- 172.21.15.160:0/3970189249 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dfc009b30 con 0x7f2e0415df40 2023-11-08T19:22:45.480 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.469+0000 7f2e037fe700 1 --2- 172.21.15.160:0/3970189249 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2e040cf1c0 0x7f2e04158af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:22:45.480 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.469+0000 7f2e08fd6700 1 --2- 172.21.15.160:0/3970189249 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2e0415df40 0x7f2e041f6cc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc00eed0 tx=0x7f2dfc00b390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:22:45.480 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.470+0000 7f2e00ff9700 1 -- 172.21.15.160:0/3970189249 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc018070 con 0x7f2e0415df40 2023-11-08T19:22:45.481 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.470+0000 7f2e00ff9700 1 -- 172.21.15.160:0/3970189249 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dfc0092e0 con 0x7f2e0415df40 2023-11-08T19:22:45.481 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.470+0000 7f2e0aa39700 1 -- 172.21.15.160:0/3970189249 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2df80094a0 con 0x7f2e0415df40 2023-11-08T19:22:45.481 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.470+0000 7f2e00ff9700 1 -- 172.21.15.160:0/3970189249 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc010040 con 0x7f2e0415df40 2023-11-08T19:22:45.481 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.470+0000 7f2e0aa39700 1 -- 172.21.15.160:0/3970189249 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e040ad950 con 0x7f2e0415df40 2023-11-08T19:22:45.481 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.470+0000 7f2e00ff9700 1 -- 172.21.15.160:0/3970189249 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2dfc00b870 con 0x7f2e0415df40 2023-11-08T19:22:45.482 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.470+0000 7f2e00ff9700 1 -- 172.21.15.160:0/3970189249 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f2dfc004020 con 0x7f2e0415df40 2023-11-08T19:22:45.482 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.471+0000 7f2e0aa39700 1 -- 172.21.15.160:0/3970189249 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e0404f730 con 0x7f2e0415df40 2023-11-08T19:22:45.482 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.474+0000 7f2e00ff9700 1 -- 172.21.15.160:0/3970189249 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f2dfc00bb20 con 0x7f2e0415df40 2023-11-08T19:22:45.529 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-11-08T19:22:45.527+0000 7fa4851e6200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-08T19:22:45.540 INFO:tasks.ceph.mgr.x.smithi160.stderr:2023-11-08T19:22:45.538+0000 7f8dc02fb200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-08T19:22:45.559 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.557+0000 7f2e0aa39700 1 -- 172.21.15.160:0/3970189249 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7ff48e7a-ff8f-4254-8c33-407ffc04b060", "id": 2} v 0) v1 -- 0x7f2e040afe90 con 0x7f2e0415df40 2023-11-08T19:22:45.563 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.561+0000 7f2e00ff9700 1 -- 172.21.15.160:0/3970189249 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7ff48e7a-ff8f-4254-8c33-407ffc04b060", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2dfc02c0b0 con 0x7f2e0415df40 2023-11-08T19:22:45.563 INFO:teuthology.orchestra.run.smithi160.stdout:2 2023-11-08T19:22:45.564 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.562+0000 7f2e0aa39700 1 -- 172.21.15.160:0/3970189249 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2e0415df40 msgr2=0x7f2e041f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:45.565 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.562+0000 7f2e0aa39700 1 --2- 172.21.15.160:0/3970189249 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2e0415df40 0x7f2e041f6cc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc00eed0 tx=0x7f2dfc00b390 comp rx=0 tx=0).stop 2023-11-08T19:22:45.565 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.562+0000 7f2e0aa39700 1 -- 172.21.15.160:0/3970189249 shutdown_connections 2023-11-08T19:22:45.565 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.562+0000 7f2e0aa39700 1 --2- 172.21.15.160:0/3970189249 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2e0415df40 0x7f2e041f6cc0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:45.565 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.562+0000 7f2e0aa39700 1 --2- 172.21.15.160:0/3970189249 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e0406ab80 0x7f2e040ae430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:45.565 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.562+0000 7f2e0aa39700 1 --2- 172.21.15.160:0/3970189249 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2e040cf1c0 0x7f2e04158af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:45.566 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.562+0000 7f2e0aa39700 1 -- 172.21.15.160:0/3970189249 >> 172.21.15.160:0/3970189249 conn(0x7f2e040d0640 msgr2=0x7f2e040cb340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:22:45.566 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.562+0000 7f2e0aa39700 1 -- 172.21.15.160:0/3970189249 shutdown_connections 2023-11-08T19:22:45.566 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.562+0000 7f2e0aa39700 1 -- 172.21.15.160:0/3970189249 wait complete. 2023-11-08T19:22:45.576 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new 2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4 3 2023-11-08T19:22:45.739 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.737+0000 7f2dbb591700 1 Processor -- start 2023-11-08T19:22:45.739 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.737+0000 7f2dbb591700 1 -- start start 2023-11-08T19:22:45.742 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.738+0000 7f2dbb591700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2db40cdce0 0x7f2db406f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:45.742 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.738+0000 7f2dbb591700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2db40cae40 0x7f2db40ce0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:45.742 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.738+0000 7f2dbb591700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f2db406ab80 0x7f2db406e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:45.743 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.738+0000 7f2dbb591700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2db40cb2c0 con 0x7f2db40cdce0 2023-11-08T19:22:45.743 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.738+0000 7f2dbb591700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2db40af590 con 0x7f2db406ab80 2023-11-08T19:22:45.743 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.738+0000 7f2dbb591700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2db406d8b0 con 0x7f2db40cae40 2023-11-08T19:22:45.743 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.738+0000 7f2db9b2e700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f2db406ab80 0x7f2db406e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:45.743 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.738+0000 7f2db8b2c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2db40cae40 0x7f2db40ce0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:45.744 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.738+0000 7f2db9b2e700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f2db406ab80 0x7f2db406e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:47580/0 (socket says 172.21.15.160:47580) 2023-11-08T19:22:45.744 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.738+0000 7f2db8b2c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2db40cae40 0x7f2db40ce0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.160:49532/0 (socket says 172.21.15.160:49532) 2023-11-08T19:22:45.744 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.738+0000 7f2db9b2e700 1 -- 172.21.15.160:0/61076968 learned_addr learned my addr 172.21.15.160:0/61076968 (peer_addr_for_me v2:172.21.15.160:0/0) 2023-11-08T19:22:45.744 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.738+0000 7f2db932d700 1 --2- 172.21.15.160:0/61076968 >> v2:172.21.15.149:3300/0 conn(0x7f2db40cdce0 0x7f2db406f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:45.745 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.739+0000 7f2db9b2e700 1 -- 172.21.15.160:0/61076968 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2db40cae40 msgr2=0x7f2db40ce0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:22:45.745 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.739+0000 7f2db9b2e700 1 --2- 172.21.15.160:0/61076968 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2db40cae40 0x7f2db40ce0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:45.745 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.739+0000 7f2db9b2e700 1 -- 172.21.15.160:0/61076968 >> v2:172.21.15.149:3300/0 conn(0x7f2db40cdce0 msgr2=0x7f2db406f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:22:45.745 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.739+0000 7f2db9b2e700 1 --2- 172.21.15.160:0/61076968 >> v2:172.21.15.149:3300/0 conn(0x7f2db40cdce0 0x7f2db406f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:45.745 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.739+0000 7f2db9b2e700 1 -- 172.21.15.160:0/61076968 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db4066f40 con 0x7f2db406ab80 2023-11-08T19:22:45.746 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.739+0000 7f2db8b2c700 1 --2- 172.21.15.160:0/61076968 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2db40cae40 0x7f2db40ce0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:22:45.746 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.739+0000 7f2db9b2e700 1 --2- 172.21.15.160:0/61076968 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2db406ab80 0x7f2db406e300 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2db40af7f0 tx=0x7f2dac00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=547c15146aa8f2af server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:22:45.746 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.739+0000 7f2dabfff700 1 -- 172.21.15.160:0/61076968 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dac00e070 con 0x7f2db406ab80 2023-11-08T19:22:45.746 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.739+0000 7f2dabfff700 1 -- 172.21.15.160:0/61076968 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dac00b910 con 0x7f2db406ab80 2023-11-08T19:22:45.746 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.739+0000 7f2dabfff700 1 -- 172.21.15.160:0/61076968 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dac00bcc0 con 0x7f2db406ab80 2023-11-08T19:22:45.747 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.740+0000 7f2dbb591700 1 -- 172.21.15.160:0/61076968 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2db406ab80 msgr2=0x7f2db406e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:45.747 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.740+0000 7f2dbb591700 1 --2- 172.21.15.160:0/61076968 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2db406ab80 0x7f2db406e300 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2db40af7f0 tx=0x7f2dac00b330 comp rx=0 tx=0).stop 2023-11-08T19:22:45.747 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.740+0000 7f2dbb591700 1 -- 172.21.15.160:0/61076968 shutdown_connections 2023-11-08T19:22:45.747 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.740+0000 7f2dbb591700 1 --2- 172.21.15.160:0/61076968 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2db406ab80 0x7f2db406e300 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:45.747 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.740+0000 7f2dbb591700 1 --2- 172.21.15.160:0/61076968 >> v2:172.21.15.149:3300/0 conn(0x7f2db40cdce0 0x7f2db406f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:45.748 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.740+0000 7f2dbb591700 1 --2- 172.21.15.160:0/61076968 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2db40cae40 0x7f2db40ce0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:45.748 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.740+0000 7f2dbb591700 1 -- 172.21.15.160:0/61076968 >> 172.21.15.160:0/61076968 conn(0x7f2db40cc860 msgr2=0x7f2db40ccc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:22:45.748 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.740+0000 7f2dbb591700 1 -- 172.21.15.160:0/61076968 shutdown_connections 2023-11-08T19:22:45.748 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.740+0000 7f2dbb591700 1 -- 172.21.15.160:0/61076968 wait complete. 2023-11-08T19:22:45.751 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.741+0000 7f2dbb591700 1 Processor -- start 2023-11-08T19:22:45.751 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.741+0000 7f2dbb591700 1 -- start start 2023-11-08T19:22:45.751 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.742+0000 7f2dbb591700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2db406ab80 0x7f2db41f7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:45.751 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.742+0000 7f2dbb591700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2db40cae40 0x7f2db415d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:45.752 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.742+0000 7f2dbb591700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2db40cdce0 0x7f2db40c58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:45.752 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.742+0000 7f2dbb591700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db41f7050 con 0x7f2db406ab80 2023-11-08T19:22:45.752 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.742+0000 7f2dbb591700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db415d900 con 0x7f2db40cae40 2023-11-08T19:22:45.752 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.742+0000 7f2dbb591700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2db40c62b0 con 0x7f2db40cdce0 2023-11-08T19:22:45.752 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.742+0000 7f2db9b2e700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2db40cdce0 0x7f2db40c58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:45.753 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.742+0000 7f2db8b2c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2db40cae40 0x7f2db415d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:45.753 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.742+0000 7f2db9b2e700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2db40cdce0 0x7f2db40c58e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.160:49540/0 (socket says 172.21.15.160:49540) 2023-11-08T19:22:45.753 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.742+0000 7f2db9b2e700 1 -- 172.21.15.160:0/3281961715 learned_addr learned my addr 172.21.15.160:0/3281961715 (peer_addr_for_me v2:172.21.15.160:0/0) 2023-11-08T19:22:45.753 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.742+0000 7f2db932d700 1 --2- 172.21.15.160:0/3281961715 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2db406ab80 0x7f2db41f7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:45.753 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.743+0000 7f2db8b2c700 1 -- 172.21.15.160:0/3281961715 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2db40cdce0 msgr2=0x7f2db40c58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:45.754 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.743+0000 7f2db8b2c700 1 --2- 172.21.15.160:0/3281961715 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2db40cdce0 0x7f2db40c58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:45.754 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.743+0000 7f2db8b2c700 1 -- 172.21.15.160:0/3281961715 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2db406ab80 msgr2=0x7f2db41f7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:45.754 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.743+0000 7f2db8b2c700 1 --2- 172.21.15.160:0/3281961715 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2db406ab80 0x7f2db41f7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:45.754 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.743+0000 7f2db8b2c700 1 -- 172.21.15.160:0/3281961715 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da40094a0 con 0x7f2db40cae40 2023-11-08T19:22:45.754 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.743+0000 7f2db932d700 1 --2- 172.21.15.160:0/3281961715 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2db406ab80 0x7f2db41f7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:22:45.755 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.743+0000 7f2db8b2c700 1 --2- 172.21.15.160:0/3281961715 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2db40cae40 0x7f2db415d3c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2da400e980 tx=0x7f2da400ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:22:45.755 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.743+0000 7f2da9ffb700 1 -- 172.21.15.160:0/3281961715 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da4004030 con 0x7f2db40cae40 2023-11-08T19:22:45.755 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.743+0000 7f2da9ffb700 1 -- 172.21.15.160:0/3281961715 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2da40041b0 con 0x7f2db40cae40 2023-11-08T19:22:45.755 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.743+0000 7f2dbb591700 1 -- 172.21.15.160:0/3281961715 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dac009b30 con 0x7f2db40cae40 2023-11-08T19:22:45.755 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.743+0000 7f2da9ffb700 1 -- 172.21.15.160:0/3281961715 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da4004560 con 0x7f2db40cae40 2023-11-08T19:22:45.756 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.743+0000 7f2da9ffb700 1 -- 172.21.15.160:0/3281961715 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2da40039a0 con 0x7f2db40cae40 2023-11-08T19:22:45.756 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.743+0000 7f2dbb591700 1 -- 172.21.15.160:0/3281961715 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2db41f6990 con 0x7f2db40cae40 2023-11-08T19:22:45.756 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.744+0000 7f2da9ffb700 1 -- 172.21.15.160:0/3281961715 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f2da4003df0 con 0x7f2db40cae40 2023-11-08T19:22:45.756 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.744+0000 7f2dbb591700 1 -- 172.21.15.160:0/3281961715 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2db41f7190 con 0x7f2db40cae40 2023-11-08T19:22:45.756 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.746+0000 7f2da9ffb700 1 -- 172.21.15.160:0/3281961715 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f2db41f7190 con 0x7f2db40cae40 2023-11-08T19:22:45.831 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.829+0000 7f2dbb591700 1 -- 172.21.15.160:0/3281961715 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4", "id": 3} v 0) v1 -- 0x7f2db404f730 con 0x7f2db40cae40 2023-11-08T19:22:45.834 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.833+0000 7f2da9ffb700 1 -- 172.21.15.160:0/3281961715 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2da4020060 con 0x7f2db40cae40 2023-11-08T19:22:45.834 INFO:teuthology.orchestra.run.smithi160.stdout:3 2023-11-08T19:22:45.836 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.834+0000 7f2dbb591700 1 -- 172.21.15.160:0/3281961715 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2db40cae40 msgr2=0x7f2db415d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:45.836 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.834+0000 7f2dbb591700 1 --2- 172.21.15.160:0/3281961715 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2db40cae40 0x7f2db415d3c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2da400e980 tx=0x7f2da400ec90 comp rx=0 tx=0).stop 2023-11-08T19:22:45.836 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.834+0000 7f2dbb591700 1 -- 172.21.15.160:0/3281961715 shutdown_connections 2023-11-08T19:22:45.836 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.834+0000 7f2dbb591700 1 --2- 172.21.15.160:0/3281961715 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2db40cdce0 0x7f2db40c58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:45.836 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.834+0000 7f2dbb591700 1 --2- 172.21.15.160:0/3281961715 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2db406ab80 0x7f2db41f7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:45.837 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.834+0000 7f2dbb591700 1 --2- 172.21.15.160:0/3281961715 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2db40cae40 0x7f2db415d3c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:45.837 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.834+0000 7f2dbb591700 1 -- 172.21.15.160:0/3281961715 >> 172.21.15.160:0/3281961715 conn(0x7f2db40cc860 msgr2=0x7f2db40b10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:22:45.837 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.834+0000 7f2dbb591700 1 -- 172.21.15.160:0/3281961715 shutdown_connections 2023-11-08T19:22:45.837 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.834+0000 7f2dbb591700 1 -- 172.21.15.160:0/3281961715 wait complete. 2023-11-08T19:22:45.847 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new 7b9d5009-831c-4b7c-991d-78fa94ea6425 4 2023-11-08T19:22:45.977 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-11-08T19:22:45.975+0000 7fa4851e6200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-08T19:22:45.983 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.981+0000 7fae8e91f700 1 Processor -- start 2023-11-08T19:22:45.983 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.981+0000 7fae8e91f700 1 -- start start 2023-11-08T19:22:45.985 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.982+0000 7fae8e91f700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fae8815abf0 0x7fae880b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:45.985 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.982+0000 7fae8e91f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fae880d1130 0x7fae880cc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:45.986 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.982+0000 7fae8e91f700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae880b6470 con 0x7fae880cc6a0 2023-11-08T19:22:45.986 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.982+0000 7fae8e91f700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae880b66a0 con 0x7fae8815abf0 2023-11-08T19:22:45.986 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.982+0000 7fae8e91f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae880d04a0 con 0x7fae880d1130 2023-11-08T19:22:45.986 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.982+0000 7fae877fe700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fae880d1130 0x7fae880cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:45.986 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.982+0000 7fae87fff700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fae8815abf0 0x7fae880b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:45.987 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.982+0000 7fae877fe700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fae880d1130 0x7fae880cc160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.160:49542/0 (socket says 172.21.15.160:49542) 2023-11-08T19:22:45.987 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.982+0000 7fae87fff700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fae8815abf0 0x7fae880b5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:47588/0 (socket says 172.21.15.160:47588) 2023-11-08T19:22:45.987 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.982+0000 7fae877fe700 1 -- 172.21.15.160:0/3930114393 learned_addr learned my addr 172.21.15.160:0/3930114393 (peer_addr_for_me v2:172.21.15.160:0/0) 2023-11-08T19:22:45.987 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.982+0000 7fae877fe700 1 -- 172.21.15.160:0/3930114393 >> v2:172.21.15.160:3300/0 conn(0x7fae8815abf0 msgr2=0x7fae880b5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:22:45.987 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.982+0000 7fae877fe700 1 --2- 172.21.15.160:0/3930114393 >> v2:172.21.15.160:3300/0 conn(0x7fae8815abf0 0x7fae880b5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:45.987 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.982+0000 7fae877fe700 1 -- 172.21.15.160:0/3930114393 >> v1:172.21.15.160:6789/0 conn(0x7fae880cc6a0 legacy=0x7fae880ce210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:45.988 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.982+0000 7fae877fe700 1 -- 172.21.15.160:0/3930114393 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae8815afd0 con 0x7fae880d1130 2023-11-08T19:22:45.988 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.983+0000 7fae877fe700 1 --2- 172.21.15.160:0/3930114393 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fae880d1130 0x7fae880cc160 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fae7c0098f0 tx=0x7fae7c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f4768f8955c24b7 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:22:45.988 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.983+0000 7fae86ffd700 1 -- 172.21.15.160:0/3930114393 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7c011830 con 0x7fae880d1130 2023-11-08T19:22:45.988 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.983+0000 7fae86ffd700 1 -- 172.21.15.160:0/3930114393 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae7c011990 con 0x7fae880d1130 2023-11-08T19:22:45.988 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.983+0000 7fae86ffd700 1 -- 172.21.15.160:0/3930114393 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7c011d20 con 0x7fae880d1130 2023-11-08T19:22:45.989 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.983+0000 7fae8e91f700 1 -- 172.21.15.160:0/3930114393 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fae880d1130 msgr2=0x7fae880cc160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:45.989 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.983+0000 7fae8e91f700 1 --2- 172.21.15.160:0/3930114393 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fae880d1130 0x7fae880cc160 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fae7c0098f0 tx=0x7fae7c009c00 comp rx=0 tx=0).stop 2023-11-08T19:22:45.989 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.983+0000 7fae8e91f700 1 -- 172.21.15.160:0/3930114393 shutdown_connections 2023-11-08T19:22:45.989 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.983+0000 7fae8e91f700 1 --2- 172.21.15.160:0/3930114393 >> v2:172.21.15.160:3300/0 conn(0x7fae8815abf0 0x7fae880b5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:45.989 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.983+0000 7fae8e91f700 1 --2- 172.21.15.160:0/3930114393 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fae880d1130 0x7fae880cc160 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:45.990 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.983+0000 7fae8e91f700 1 -- 172.21.15.160:0/3930114393 >> 172.21.15.160:0/3930114393 conn(0x7fae880d0640 msgr2=0x7fae880d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:22:45.990 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.983+0000 7fae8e91f700 1 -- 172.21.15.160:0/3930114393 shutdown_connections 2023-11-08T19:22:45.990 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.983+0000 7fae8e91f700 1 -- 172.21.15.160:0/3930114393 wait complete. 2023-11-08T19:22:45.993 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.985+0000 7fae8e91f700 1 Processor -- start 2023-11-08T19:22:45.993 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.985+0000 7fae8e91f700 1 -- start start 2023-11-08T19:22:45.993 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.986+0000 7fae8e91f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae880cc6a0 0x7fae8814f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:45.993 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.986+0000 7fae8e91f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fae880d1130 0x7fae8815db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:45.994 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.986+0000 7fae8e91f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fae8815abf0 0x7fae88158eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:45.994 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.986+0000 7fae8e91f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae8814f970 con 0x7fae880cc6a0 2023-11-08T19:22:45.994 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.986+0000 7fae8e91f700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae881f60c0 con 0x7fae880d1130 2023-11-08T19:22:45.994 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.986+0000 7fae8e91f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae881f63a0 con 0x7fae8815abf0 2023-11-08T19:22:45.994 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.986+0000 7fae877fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fae880d1130 0x7fae8815db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:45.995 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.986+0000 7fae8cebc700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fae8815abf0 0x7fae88158eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:45.995 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.986+0000 7fae877fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fae880d1130 0x7fae8815db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:47594/0 (socket says 172.21.15.160:47594) 2023-11-08T19:22:45.995 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.986+0000 7fae877fe700 1 -- 172.21.15.160:0/3977188269 learned_addr learned my addr 172.21.15.160:0/3977188269 (peer_addr_for_me v2:172.21.15.160:0/0) 2023-11-08T19:22:45.995 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.986+0000 7fae87fff700 1 --2- 172.21.15.160:0/3977188269 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae880cc6a0 0x7fae8814f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:45.995 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.986+0000 7fae8cebc700 1 -- 172.21.15.160:0/3977188269 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fae880d1130 msgr2=0x7fae8815db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:45.996 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.986+0000 7fae8cebc700 1 --2- 172.21.15.160:0/3977188269 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fae880d1130 0x7fae8815db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:45.996 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.986+0000 7fae8cebc700 1 -- 172.21.15.160:0/3977188269 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae880cc6a0 msgr2=0x7fae8814f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:45.996 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.986+0000 7fae8cebc700 1 --2- 172.21.15.160:0/3977188269 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae880cc6a0 0x7fae8814f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:45.996 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.986+0000 7fae8cebc700 1 -- 172.21.15.160:0/3977188269 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae7c009550 con 0x7fae8815abf0 2023-11-08T19:22:45.996 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.986+0000 7fae877fe700 1 --2- 172.21.15.160:0/3977188269 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fae880d1130 0x7fae8815db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:22:45.997 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.986+0000 7fae8cebc700 1 --2- 172.21.15.160:0/3977188269 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fae8815abf0 0x7fae88158eb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fae8000cb90 tx=0x7fae8000cea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:22:45.997 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.986+0000 7fae84ff9700 1 -- 172.21.15.160:0/3977188269 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae80003c00 con 0x7fae8815abf0 2023-11-08T19:22:45.997 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.986+0000 7fae84ff9700 1 -- 172.21.15.160:0/3977188269 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae80003d60 con 0x7fae8815abf0 2023-11-08T19:22:45.997 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.986+0000 7fae8e91f700 1 -- 172.21.15.160:0/3977188269 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae881f6680 con 0x7fae8815abf0 2023-11-08T19:22:45.997 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.986+0000 7fae84ff9700 1 -- 172.21.15.160:0/3977188269 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae8000aa80 con 0x7fae8815abf0 2023-11-08T19:22:45.998 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.986+0000 7fae8e91f700 1 -- 172.21.15.160:0/3977188269 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae8815e060 con 0x7fae8815abf0 2023-11-08T19:22:45.998 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.987+0000 7fae84ff9700 1 -- 172.21.15.160:0/3977188269 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fae800050d0 con 0x7fae8815abf0 2023-11-08T19:22:45.998 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.987+0000 7fae84ff9700 1 -- 172.21.15.160:0/3977188269 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fae80012a20 con 0x7fae8815abf0 2023-11-08T19:22:45.998 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.987+0000 7fae8e91f700 1 -- 172.21.15.160:0/3977188269 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae881f6c70 con 0x7fae8815abf0 2023-11-08T19:22:45.998 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:45.989+0000 7fae84ff9700 1 -- 172.21.15.160:0/3977188269 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fae80012c80 con 0x7fae8815abf0 2023-11-08T19:22:46.019 INFO:tasks.ceph.mgr.x.smithi160.stderr:2023-11-08T19:22:46.017+0000 7f8dc02fb200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-08T19:22:46.075 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.073+0000 7fae8e91f700 1 -- 172.21.15.160:0/3977188269 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7b9d5009-831c-4b7c-991d-78fa94ea6425", "id": 4} v 0) v1 -- 0x7fae8804f730 con 0x7fae8815abf0 2023-11-08T19:22:46.078 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.077+0000 7fae84ff9700 1 -- 172.21.15.160:0/3977188269 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7b9d5009-831c-4b7c-991d-78fa94ea6425", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fae80012e20 con 0x7fae8815abf0 2023-11-08T19:22:46.078 INFO:teuthology.orchestra.run.smithi160.stdout:4 2023-11-08T19:22:46.079 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.078+0000 7fae8e91f700 1 -- 172.21.15.160:0/3977188269 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fae8815abf0 msgr2=0x7fae88158eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:46.080 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.078+0000 7fae8e91f700 1 --2- 172.21.15.160:0/3977188269 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fae8815abf0 0x7fae88158eb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fae8000cb90 tx=0x7fae8000cea0 comp rx=0 tx=0).stop 2023-11-08T19:22:46.080 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.078+0000 7fae8e91f700 1 -- 172.21.15.160:0/3977188269 shutdown_connections 2023-11-08T19:22:46.080 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.078+0000 7fae8e91f700 1 --2- 172.21.15.160:0/3977188269 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fae8815abf0 0x7fae88158eb0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:46.080 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.078+0000 7fae8e91f700 1 --2- 172.21.15.160:0/3977188269 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae880cc6a0 0x7fae8814f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:46.080 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.078+0000 7fae8e91f700 1 --2- 172.21.15.160:0/3977188269 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fae880d1130 0x7fae8815db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:46.081 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.078+0000 7fae8e91f700 1 -- 172.21.15.160:0/3977188269 >> 172.21.15.160:0/3977188269 conn(0x7fae880d0640 msgr2=0x7fae880cf440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:22:46.081 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.078+0000 7fae8e91f700 1 -- 172.21.15.160:0/3977188269 shutdown_connections 2023-11-08T19:22:46.081 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.078+0000 7fae8e91f700 1 -- 172.21.15.160:0/3977188269 wait complete. 2023-11-08T19:22:46.091 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new 58ab33fd-5b6e-465a-9f6a-76d713db83ea 5 2023-11-08T19:22:46.213 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.212+0000 7f43fe7eb700 1 Processor -- start 2023-11-08T19:22:46.214 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.212+0000 7f43fe7eb700 1 -- start start 2023-11-08T19:22:46.216 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.213+0000 7f43fe7eb700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f43f815abf0 0x7f43f80b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:46.217 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.213+0000 7f43fe7eb700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f43f80d1130 0x7f43f80cc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:46.217 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.213+0000 7f43fe7eb700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43f80b6470 con 0x7f43f80cc6a0 2023-11-08T19:22:46.217 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.213+0000 7f43fe7eb700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43f80b66a0 con 0x7f43f80d1130 2023-11-08T19:22:46.217 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.213+0000 7f43fe7eb700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43f80d04a0 con 0x7f43f815abf0 2023-11-08T19:22:46.217 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.213+0000 7f43f7fff700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f43f815abf0 0x7f43f80b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:46.218 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.213+0000 7f43f77fe700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f43f80d1130 0x7f43f80cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:46.218 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.213+0000 7f43f7fff700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f43f815abf0 0x7f43f80b5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.160:49552/0 (socket says 172.21.15.160:49552) 2023-11-08T19:22:46.218 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.213+0000 7f43f7fff700 1 -- 172.21.15.160:0/3553478152 learned_addr learned my addr 172.21.15.160:0/3553478152 (peer_addr_for_me v2:172.21.15.160:0/0) 2023-11-08T19:22:46.218 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.213+0000 7f43f7fff700 1 -- 172.21.15.160:0/3553478152 >> v2:172.21.15.160:3300/0 conn(0x7f43f80d1130 msgr2=0x7f43f80cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:22:46.218 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.213+0000 7f43f7fff700 1 --2- 172.21.15.160:0/3553478152 >> v2:172.21.15.160:3300/0 conn(0x7f43f80d1130 0x7f43f80cc160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:46.219 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.213+0000 7f43f7fff700 1 -- 172.21.15.160:0/3553478152 >> v1:172.21.15.160:6789/0 conn(0x7f43f80cc6a0 legacy=0x7f43f80ce210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:46.219 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.213+0000 7f43f7fff700 1 -- 172.21.15.160:0/3553478152 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43f815afd0 con 0x7f43f815abf0 2023-11-08T19:22:46.219 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.213+0000 7f43f77fe700 1 --2- 172.21.15.160:0/3553478152 >> v2:172.21.15.160:3300/0 conn(0x7f43f80d1130 0x7f43f80cc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:22:46.219 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.214+0000 7f43f7fff700 1 --2- 172.21.15.160:0/3553478152 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f43f815abf0 0x7f43f80b5f30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f43e80098f0 tx=0x7f43e8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cca0cd21ef771437 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:22:46.219 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.214+0000 7f43f6ffd700 1 -- 172.21.15.160:0/3553478152 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e8011830 con 0x7f43f815abf0 2023-11-08T19:22:46.220 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.214+0000 7f43f6ffd700 1 -- 172.21.15.160:0/3553478152 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43e8011990 con 0x7f43f815abf0 2023-11-08T19:22:46.220 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.214+0000 7f43f6ffd700 1 -- 172.21.15.160:0/3553478152 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e8011d20 con 0x7f43f815abf0 2023-11-08T19:22:46.220 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.215+0000 7f43fe7eb700 1 -- 172.21.15.160:0/3553478152 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f43f815abf0 msgr2=0x7f43f80b5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:46.220 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.215+0000 7f43fe7eb700 1 --2- 172.21.15.160:0/3553478152 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f43f815abf0 0x7f43f80b5f30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f43e80098f0 tx=0x7f43e8009c00 comp rx=0 tx=0).stop 2023-11-08T19:22:46.220 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.215+0000 7f43fe7eb700 1 -- 172.21.15.160:0/3553478152 shutdown_connections 2023-11-08T19:22:46.221 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.215+0000 7f43fe7eb700 1 --2- 172.21.15.160:0/3553478152 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f43f815abf0 0x7f43f80b5f30 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:46.221 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.215+0000 7f43fe7eb700 1 --2- 172.21.15.160:0/3553478152 >> v2:172.21.15.160:3300/0 conn(0x7f43f80d1130 0x7f43f80cc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:46.221 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.215+0000 7f43fe7eb700 1 -- 172.21.15.160:0/3553478152 >> 172.21.15.160:0/3553478152 conn(0x7f43f80d0640 msgr2=0x7f43f80d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:22:46.221 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.215+0000 7f43fe7eb700 1 -- 172.21.15.160:0/3553478152 shutdown_connections 2023-11-08T19:22:46.221 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.215+0000 7f43fe7eb700 1 -- 172.21.15.160:0/3553478152 wait complete. 2023-11-08T19:22:46.224 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.217+0000 7f43fe7eb700 1 Processor -- start 2023-11-08T19:22:46.224 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.217+0000 7f43fe7eb700 1 -- start start 2023-11-08T19:22:46.224 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.218+0000 7f43fe7eb700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f43f80cc6a0 0x7f43f80b5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:46.225 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.218+0000 7f43fe7eb700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43f80d1130 0x7f43f80c8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:46.225 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.218+0000 7f43fe7eb700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f43f815abf0 0x7f43f80c8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:46.225 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.218+0000 7f43fe7eb700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f80b5980 con 0x7f43f80d1130 2023-11-08T19:22:46.225 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.218+0000 7f43fe7eb700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f80b33f0 con 0x7f43f815abf0 2023-11-08T19:22:46.226 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.218+0000 7f43fe7eb700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43f80ca0b0 con 0x7f43f80cc6a0 2023-11-08T19:22:46.226 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.218+0000 7f43f7fff700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f43f80cc6a0 0x7f43f80b5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:46.226 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.218+0000 7f43f7fff700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f43f80cc6a0 0x7f43f80b5440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.160:49558/0 (socket says 172.21.15.160:49558) 2023-11-08T19:22:46.226 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.218+0000 7f43f7fff700 1 -- 172.21.15.160:0/4005671409 learned_addr learned my addr 172.21.15.160:0/4005671409 (peer_addr_for_me v2:172.21.15.160:0/0) 2023-11-08T19:22:46.226 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.218+0000 7f43fcd88700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f43f815abf0 0x7f43f80c8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:46.227 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.218+0000 7f43f77fe700 1 --2- 172.21.15.160:0/4005671409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43f80d1130 0x7f43f80c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:46.227 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.219+0000 7f43f7fff700 1 -- 172.21.15.160:0/4005671409 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f43f815abf0 msgr2=0x7f43f80c8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:46.227 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.219+0000 7f43f7fff700 1 --2- 172.21.15.160:0/4005671409 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f43f815abf0 0x7f43f80c8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:46.227 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.219+0000 7f43f7fff700 1 -- 172.21.15.160:0/4005671409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43f80d1130 msgr2=0x7f43f80c8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:46.227 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.219+0000 7f43f7fff700 1 --2- 172.21.15.160:0/4005671409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43f80d1130 0x7f43f80c8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:46.228 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.219+0000 7f43f7fff700 1 -- 172.21.15.160:0/4005671409 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43ec0094a0 con 0x7f43f80cc6a0 2023-11-08T19:22:46.228 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.219+0000 7f43f77fe700 1 --2- 172.21.15.160:0/4005671409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43f80d1130 0x7f43f80c8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:22:46.228 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.219+0000 7f43fcd88700 1 --2- 172.21.15.160:0/4005671409 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f43f815abf0 0x7f43f80c8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:22:46.228 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.219+0000 7f43f7fff700 1 --2- 172.21.15.160:0/4005671409 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f43f80cc6a0 0x7f43f80b5440 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f43e8009c40 tx=0x7f43e8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:22:46.228 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.219+0000 7f43f4ff9700 1 -- 172.21.15.160:0/4005671409 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e8004590 con 0x7f43f80cc6a0 2023-11-08T19:22:46.229 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.219+0000 7f43f4ff9700 1 -- 172.21.15.160:0/4005671409 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43e80036a0 con 0x7f43f80cc6a0 2023-11-08T19:22:46.229 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.219+0000 7f43fe7eb700 1 -- 172.21.15.160:0/4005671409 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43e8009550 con 0x7f43f80cc6a0 2023-11-08T19:22:46.229 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.219+0000 7f43f4ff9700 1 -- 172.21.15.160:0/4005671409 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e8003a30 con 0x7f43f80cc6a0 2023-11-08T19:22:46.229 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.219+0000 7f43fe7eb700 1 -- 172.21.15.160:0/4005671409 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43f80c9af0 con 0x7f43f80cc6a0 2023-11-08T19:22:46.230 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.219+0000 7f43f4ff9700 1 -- 172.21.15.160:0/4005671409 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f43e8022460 con 0x7f43f80cc6a0 2023-11-08T19:22:46.230 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.219+0000 7f43f4ff9700 1 -- 172.21.15.160:0/4005671409 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f43e801a9a0 con 0x7f43f80cc6a0 2023-11-08T19:22:46.230 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.220+0000 7f43fe7eb700 1 -- 172.21.15.160:0/4005671409 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43f804f730 con 0x7f43f80cc6a0 2023-11-08T19:22:46.230 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.222+0000 7f43f4ff9700 1 -- 172.21.15.160:0/4005671409 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f43e8026020 con 0x7f43f80cc6a0 2023-11-08T19:22:46.316 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.314+0000 7f43fe7eb700 1 -- 172.21.15.160:0/4005671409 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "osd new", "uuid": "58ab33fd-5b6e-465a-9f6a-76d713db83ea", "id": 5} v 0) v1 -- 0x7f43f80ca950 con 0x7f43f80cc6a0 2023-11-08T19:22:46.324 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.323+0000 7f43f4ff9700 1 -- 172.21.15.160:0/4005671409 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "58ab33fd-5b6e-465a-9f6a-76d713db83ea", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f43e8015020 con 0x7f43f80cc6a0 2023-11-08T19:22:46.325 INFO:teuthology.orchestra.run.smithi160.stdout:5 2023-11-08T19:22:46.326 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.324+0000 7f43fe7eb700 1 -- 172.21.15.160:0/4005671409 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f43f80cc6a0 msgr2=0x7f43f80b5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:46.326 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.324+0000 7f43fe7eb700 1 --2- 172.21.15.160:0/4005671409 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f43f80cc6a0 0x7f43f80b5440 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f43e8009c40 tx=0x7f43e8004750 comp rx=0 tx=0).stop 2023-11-08T19:22:46.326 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.324+0000 7f43fe7eb700 1 -- 172.21.15.160:0/4005671409 shutdown_connections 2023-11-08T19:22:46.327 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.324+0000 7f43fe7eb700 1 --2- 172.21.15.160:0/4005671409 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f43f815abf0 0x7f43f80c8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:46.327 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.324+0000 7f43fe7eb700 1 --2- 172.21.15.160:0/4005671409 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f43f80cc6a0 0x7f43f80b5440 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:46.327 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.324+0000 7f43fe7eb700 1 --2- 172.21.15.160:0/4005671409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43f80d1130 0x7f43f80c8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:46.327 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.324+0000 7f43fe7eb700 1 -- 172.21.15.160:0/4005671409 >> 172.21.15.160:0/4005671409 conn(0x7f43f80d0640 msgr2=0x7f43f80ccd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:22:46.327 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.324+0000 7f43fe7eb700 1 -- 172.21.15.160:0/4005671409 shutdown_connections 2023-11-08T19:22:46.327 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.324+0000 7f43fe7eb700 1 -- 172.21.15.160:0/4005671409 wait complete. 2023-11-08T19:22:46.338 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new 900eb7c4-8c4d-4e50-a2f9-30eded4e1158 6 2023-11-08T19:22:46.485 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.478+0000 7f272ebc3700 1 Processor -- start 2023-11-08T19:22:46.486 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.478+0000 7f272ebc3700 1 -- start start 2023-11-08T19:22:46.486 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.479+0000 7f272ebc3700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f27280cf660 0x7f27280cfa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:46.486 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.479+0000 7f272ebc3700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2728071a80 0x7f2728071f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:46.486 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.479+0000 7f272ebc3700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27280cdfb0 con 0x7f272816e330 2023-11-08T19:22:46.486 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.479+0000 7f272ebc3700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27280af1c0 con 0x7f2728071a80 2023-11-08T19:22:46.487 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.479+0000 7f272ebc3700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27280cd470 con 0x7f27280cf660 2023-11-08T19:22:46.487 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.479+0000 7f272c95f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f27280cf660 0x7f27280cfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:46.487 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.479+0000 7f2727fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2728071a80 0x7f2728071f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:46.487 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.479+0000 7f272c95f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f27280cf660 0x7f27280cfa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.160:49564/0 (socket says 172.21.15.160:49564) 2023-11-08T19:22:46.487 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.479+0000 7f2727fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2728071a80 0x7f2728071f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.160:36604/0 (socket says 172.21.15.160:36604) 2023-11-08T19:22:46.488 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.479+0000 7f272c95f700 1 -- 172.21.15.160:0/1064118353 learned_addr learned my addr 172.21.15.160:0/1064118353 (peer_addr_for_me v2:172.21.15.160:0/0) 2023-11-08T19:22:46.488 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.480+0000 7f272c95f700 1 -- 172.21.15.160:0/1064118353 >> v2:172.21.15.149:3300/0 conn(0x7f2728071a80 msgr2=0x7f2728071f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:22:46.488 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.480+0000 7f272c95f700 1 --2- 172.21.15.160:0/1064118353 >> v2:172.21.15.149:3300/0 conn(0x7f2728071a80 0x7f2728071f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:46.488 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.480+0000 7f272c95f700 1 -- 172.21.15.160:0/1064118353 >> v1:172.21.15.160:6789/0 conn(0x7f272816e330 legacy=0x7f272816e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:46.488 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.480+0000 7f27277fe700 1 -- 172.21.15.160:0/1064118353 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2013454421 0 0) 0x7f27280cdfb0 con 0x7f272816e330 2023-11-08T19:22:46.489 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.480+0000 7f272c95f700 1 -- 172.21.15.160:0/1064118353 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27280cff80 con 0x7f27280cf660 2023-11-08T19:22:46.489 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.481+0000 7f2727fff700 1 --2- 172.21.15.160:0/1064118353 >> v2:172.21.15.149:3300/0 conn(0x7f2728071a80 0x7f2728071f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:22:46.489 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.481+0000 7f272c95f700 1 --2- 172.21.15.160:0/1064118353 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f27280cf660 0x7f27280cfa40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f272000b090 tx=0x7f272000c670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25eb3e11d6c38fc0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:22:46.489 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.481+0000 7f27277fe700 1 -- 172.21.15.160:0/1064118353 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272000ce50 con 0x7f27280cf660 2023-11-08T19:22:46.490 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.481+0000 7f27277fe700 1 -- 172.21.15.160:0/1064118353 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f272000a170 con 0x7f27280cf660 2023-11-08T19:22:46.490 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.481+0000 7f27277fe700 1 -- 172.21.15.160:0/1064118353 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272000a500 con 0x7f27280cf660 2023-11-08T19:22:46.490 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.482+0000 7f272ebc3700 1 -- 172.21.15.160:0/1064118353 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f27280cf660 msgr2=0x7f27280cfa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:46.490 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.482+0000 7f272ebc3700 1 --2- 172.21.15.160:0/1064118353 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f27280cf660 0x7f27280cfa40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f272000b090 tx=0x7f272000c670 comp rx=0 tx=0).stop 2023-11-08T19:22:46.490 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.482+0000 7f272ebc3700 1 -- 172.21.15.160:0/1064118353 shutdown_connections 2023-11-08T19:22:46.491 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.482+0000 7f272ebc3700 1 --2- 172.21.15.160:0/1064118353 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f27280cf660 0x7f27280cfa40 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:46.491 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.482+0000 7f272ebc3700 1 --2- 172.21.15.160:0/1064118353 >> v2:172.21.15.149:3300/0 conn(0x7f2728071a80 0x7f2728071f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:46.491 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.482+0000 7f272ebc3700 1 -- 172.21.15.160:0/1064118353 >> 172.21.15.160:0/1064118353 conn(0x7f27280b13a0 msgr2=0x7f27280b1780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:22:46.491 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.482+0000 7f272ebc3700 1 -- 172.21.15.160:0/1064118353 shutdown_connections 2023-11-08T19:22:46.491 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.482+0000 7f272ebc3700 1 -- 172.21.15.160:0/1064118353 wait complete. 2023-11-08T19:22:46.492 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.484+0000 7f272ebc3700 1 Processor -- start 2023-11-08T19:22:46.493 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.484+0000 7f272ebc3700 1 -- start start 2023-11-08T19:22:46.494 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.485+0000 7f272ebc3700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2728071a80 0x7f272816da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:46.494 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.485+0000 7f272ebc3700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f27280cf660 0x7f27280c4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:46.494 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.485+0000 7f272ebc3700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f272816e330 0x7f27280cae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:46.494 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.485+0000 7f272ebc3700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2728157b40 con 0x7f27280cf660 2023-11-08T19:22:46.494 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.485+0000 7f272ebc3700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272808a7b0 con 0x7f2728071a80 2023-11-08T19:22:46.495 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.485+0000 7f272ebc3700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2728156ec0 con 0x7f272816e330 2023-11-08T19:22:46.495 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.486+0000 7f2727fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f27280cf660 0x7f27280c4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:46.495 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.486+0000 7f2727fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f27280cf660 0x7f27280c4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.160:36608/0 (socket says 172.21.15.160:36608) 2023-11-08T19:22:46.495 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.486+0000 7f2727fff700 1 -- 172.21.15.160:0/845547200 learned_addr learned my addr 172.21.15.160:0/845547200 (peer_addr_for_me v2:172.21.15.160:0/0) 2023-11-08T19:22:46.495 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.486+0000 7f2727fff700 1 -- 172.21.15.160:0/845547200 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f272816e330 msgr2=0x7f27280cae40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-08T19:22:46.496 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.486+0000 7f2727fff700 1 --2- 172.21.15.160:0/845547200 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f272816e330 0x7f27280cae40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:46.496 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.486+0000 7f2727fff700 1 -- 172.21.15.160:0/845547200 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2728071a80 msgr2=0x7f272816da70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-08T19:22:46.496 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.486+0000 7f2727fff700 1 --2- 172.21.15.160:0/845547200 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2728071a80 0x7f272816da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:46.496 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.486+0000 7f2727fff700 1 -- 172.21.15.160:0/845547200 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f271800d940 con 0x7f27280cf660 2023-11-08T19:22:46.497 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.486+0000 7f2727fff700 1 --2- 172.21.15.160:0/845547200 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f27280cf660 0x7f27280c4610 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2718012fc0 tx=0x7f27180103a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:22:46.497 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.486+0000 7f27257fa700 1 -- 172.21.15.160:0/845547200 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271800dc00 con 0x7f27280cf660 2023-11-08T19:22:46.497 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.486+0000 7f27257fa700 1 -- 172.21.15.160:0/845547200 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2718013040 con 0x7f27280cf660 2023-11-08T19:22:46.497 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.486+0000 7f27257fa700 1 -- 172.21.15.160:0/845547200 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2718010db0 con 0x7f27280cf660 2023-11-08T19:22:46.497 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.487+0000 7f272ebc3700 1 -- 172.21.15.160:0/845547200 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f272000aa90 con 0x7f27280cf660 2023-11-08T19:22:46.497 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.487+0000 7f272ebc3700 1 -- 172.21.15.160:0/845547200 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2728157480 con 0x7f27280cf660 2023-11-08T19:22:46.498 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.487+0000 7f27257fa700 1 -- 172.21.15.160:0/845547200 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2718005d20 con 0x7f27280cf660 2023-11-08T19:22:46.498 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.488+0000 7f27257fa700 1 -- 172.21.15.160:0/845547200 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f2718006930 con 0x7f27280cf660 2023-11-08T19:22:46.498 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.488+0000 7f272ebc3700 1 -- 172.21.15.160:0/845547200 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2728157db0 con 0x7f27280cf660 2023-11-08T19:22:46.498 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.490+0000 7f27257fa700 1 -- 172.21.15.160:0/845547200 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f2718018b00 con 0x7f27280cf660 2023-11-08T19:22:46.576 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.574+0000 7f272ebc3700 1 -- 172.21.15.160:0/845547200 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd new", "uuid": "900eb7c4-8c4d-4e50-a2f9-30eded4e1158", "id": 6} v 0) v1 -- 0x7f272804f730 con 0x7f27280cf660 2023-11-08T19:22:46.577 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.576+0000 7f27257fa700 1 -- 172.21.15.160:0/845547200 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "900eb7c4-8c4d-4e50-a2f9-30eded4e1158", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f271802f0b0 con 0x7f27280cf660 2023-11-08T19:22:46.578 INFO:teuthology.orchestra.run.smithi160.stdout:6 2023-11-08T19:22:46.579 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.577+0000 7f272ebc3700 1 -- 172.21.15.160:0/845547200 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f27280cf660 msgr2=0x7f27280c4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:46.579 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.577+0000 7f272ebc3700 1 --2- 172.21.15.160:0/845547200 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f27280cf660 0x7f27280c4610 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2718012fc0 tx=0x7f27180103a0 comp rx=0 tx=0).stop 2023-11-08T19:22:46.579 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.577+0000 7f272ebc3700 1 -- 172.21.15.160:0/845547200 shutdown_connections 2023-11-08T19:22:46.580 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.577+0000 7f272ebc3700 1 --2- 172.21.15.160:0/845547200 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2728071a80 0x7f272816da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:46.580 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.577+0000 7f272ebc3700 1 --2- 172.21.15.160:0/845547200 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f272816e330 0x7f27280cae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:46.580 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.577+0000 7f272ebc3700 1 --2- 172.21.15.160:0/845547200 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f27280cf660 0x7f27280c4610 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:46.580 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.577+0000 7f272ebc3700 1 -- 172.21.15.160:0/845547200 >> 172.21.15.160:0/845547200 conn(0x7f27280b13a0 msgr2=0x7f27280b3d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:22:46.581 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.577+0000 7f272ebc3700 1 -- 172.21.15.160:0/845547200 shutdown_connections 2023-11-08T19:22:46.581 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.577+0000 7f272ebc3700 1 -- 172.21.15.160:0/845547200 wait complete. 2023-11-08T19:22:46.592 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new 258a808f-eb6e-4f16-ab36-204c340f2515 7 2023-11-08T19:22:46.617 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-11-08T19:22:46.615+0000 7fa4851e6200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-08T19:22:46.685 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-11-08T19:22:46.683+0000 7fa4851e6200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-08T19:22:46.701 INFO:tasks.ceph.mgr.x.smithi160.stderr:2023-11-08T19:22:46.699+0000 7f8dc02fb200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-08T19:22:46.717 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.715+0000 7fa66a1e6700 1 Processor -- start 2023-11-08T19:22:46.717 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.715+0000 7fa66a1e6700 1 -- start start 2023-11-08T19:22:46.720 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.717+0000 7fa66a1e6700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa6640ceae0 0x7fa6640cb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:46.720 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.717+0000 7fa66a1e6700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6640cacd0 con 0x7fa66415dc90 2023-11-08T19:22:46.720 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.717+0000 7fa66a1e6700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa66406e300 con 0x7fa66415a0e0 2023-11-08T19:22:46.721 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.717+0000 7fa66a1e6700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa66406e5e0 con 0x7fa6640ceae0 2023-11-08T19:22:46.721 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.717+0000 7fa6637fe700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7fa66415a0e0 0x7fa6640ce3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:50450/0 (socket says 172.21.15.160:50450) 2023-11-08T19:22:46.721 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.717+0000 7fa6637fe700 1 -- 172.21.15.160:0/2940522092 learned_addr learned my addr 172.21.15.160:0/2940522092 (peer_addr_for_me v1:172.21.15.160:0/0) 2023-11-08T19:22:46.721 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.717+0000 7fa662ffd700 1 --2- 172.21.15.160:0/2940522092 >> v2:172.21.15.149:3300/0 conn(0x7fa6640ceae0 0x7fa6640cb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:46.721 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.717+0000 7fa6627fc700 1 -- 172.21.15.160:0/2940522092 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1000701820 0 0) 0x7fa66406e300 con 0x7fa66415a0e0 2023-11-08T19:22:46.722 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.717+0000 7fa6627fc700 1 -- 172.21.15.160:0/2940522092 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa64c0035b0 con 0x7fa66415a0e0 2023-11-08T19:22:46.722 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.717+0000 7fa6627fc700 1 -- 172.21.15.160:0/2940522092 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2591856917 0 0) 0x7fa6640cacd0 con 0x7fa66415dc90 2023-11-08T19:22:46.722 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.717+0000 7fa6627fc700 1 -- 172.21.15.160:0/2940522092 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa66406e300 con 0x7fa66415dc90 2023-11-08T19:22:46.722 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.717+0000 7fa6627fc700 1 -- 172.21.15.160:0/2940522092 <== mon.1 v1:172.21.15.160:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1640495754 0 0) 0x7fa64c0035b0 con 0x7fa66415a0e0 2023-11-08T19:22:46.722 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.717+0000 7fa662ffd700 1 -- 172.21.15.160:0/2940522092 >> v1:172.21.15.160:6789/0 conn(0x7fa66415a0e0 legacy=0x7fa6640ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:46.723 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.717+0000 7fa662ffd700 1 -- 172.21.15.160:0/2940522092 >> v1:172.21.15.149:6789/0 conn(0x7fa66415dc90 legacy=0x7fa6640cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:46.723 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.717+0000 7fa662ffd700 1 -- 172.21.15.160:0/2940522092 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa66406e8c0 con 0x7fa6640ceae0 2023-11-08T19:22:46.723 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.717+0000 7fa662ffd700 1 --2- 172.21.15.160:0/2940522092 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6640ceae0 0x7fa6640cb1b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa6580097c0 tx=0x7fa658009ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28533985be7e9dc0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:22:46.723 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.718+0000 7fa6627fc700 1 -- 172.21.15.160:0/2940522092 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa654001670 con 0x7fa6640ceae0 2023-11-08T19:22:46.723 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.718+0000 7fa6627fc700 1 -- 172.21.15.160:0/2940522092 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa658004030 con 0x7fa6640ceae0 2023-11-08T19:22:46.724 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.718+0000 7fa6627fc700 1 -- 172.21.15.160:0/2940522092 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6580043c0 con 0x7fa6640ceae0 2023-11-08T19:22:46.724 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.718+0000 7fa66a1e6700 1 -- 172.21.15.160:0/2940522092 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6640ceae0 msgr2=0x7fa6640cb1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:46.724 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.718+0000 7fa66a1e6700 1 --2- 172.21.15.160:0/2940522092 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6640ceae0 0x7fa6640cb1b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa6580097c0 tx=0x7fa658009ad0 comp rx=0 tx=0).stop 2023-11-08T19:22:46.724 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.718+0000 7fa66a1e6700 1 -- 172.21.15.160:0/2940522092 shutdown_connections 2023-11-08T19:22:46.724 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.718+0000 7fa66a1e6700 1 --2- 172.21.15.160:0/2940522092 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6640ceae0 0x7fa6640cb1b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:46.724 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.718+0000 7fa66a1e6700 1 -- 172.21.15.160:0/2940522092 >> 172.21.15.160:0/2940522092 conn(0x7fa6640cc860 msgr2=0x7fa6640ccc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:22:46.725 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.718+0000 7fa66a1e6700 1 -- 172.21.15.160:0/2940522092 shutdown_connections 2023-11-08T19:22:46.725 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.718+0000 7fa66a1e6700 1 -- 172.21.15.160:0/2940522092 wait complete. 2023-11-08T19:22:46.727 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.719+0000 7fa66a1e6700 1 Processor -- start 2023-11-08T19:22:46.728 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.720+0000 7fa66a1e6700 1 -- start start 2023-11-08T19:22:46.728 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.720+0000 7fa66a1e6700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa6640ceae0 0x7fa664159420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:46.728 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.720+0000 7fa66a1e6700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa66415a0e0 0x7fa664168050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:46.729 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.720+0000 7fa66a1e6700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa66415dc90 0x7fa664168590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:46.729 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.720+0000 7fa66a1e6700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6640b5260 con 0x7fa66415dc90 2023-11-08T19:22:46.729 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.720+0000 7fa66a1e6700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa66415c040 con 0x7fa66415a0e0 2023-11-08T19:22:46.730 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.720+0000 7fa66a1e6700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa66415b780 con 0x7fa6640ceae0 2023-11-08T19:22:46.730 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.721+0000 7fa6637fe700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa6640ceae0 0x7fa664159420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:46.730 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.721+0000 7fa6637fe700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa6640ceae0 0x7fa664159420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.160:49578/0 (socket says 172.21.15.160:49578) 2023-11-08T19:22:46.731 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.721+0000 7fa6637fe700 1 -- 172.21.15.160:0/1945600409 learned_addr learned my addr 172.21.15.160:0/1945600409 (peer_addr_for_me v2:172.21.15.160:0/0) 2023-11-08T19:22:46.731 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.721+0000 7fa662ffd700 1 --2- 172.21.15.160:0/1945600409 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa66415a0e0 0x7fa664168050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:46.731 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.721+0000 7fa663fff700 1 --2- 172.21.15.160:0/1945600409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa66415dc90 0x7fa664168590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:46.731 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.721+0000 7fa6637fe700 1 -- 172.21.15.160:0/1945600409 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa66415a0e0 msgr2=0x7fa664168050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:46.732 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.721+0000 7fa6637fe700 1 --2- 172.21.15.160:0/1945600409 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa66415a0e0 0x7fa664168050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:46.732 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.721+0000 7fa6637fe700 1 -- 172.21.15.160:0/1945600409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa66415dc90 msgr2=0x7fa664168590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:46.732 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.721+0000 7fa6637fe700 1 --2- 172.21.15.160:0/1945600409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa66415dc90 0x7fa664168590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:46.733 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.721+0000 7fa6637fe700 1 -- 172.21.15.160:0/1945600409 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6580094a0 con 0x7fa6640ceae0 2023-11-08T19:22:46.733 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.721+0000 7fa662ffd700 1 --2- 172.21.15.160:0/1945600409 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa66415a0e0 0x7fa664168050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:22:46.733 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.721+0000 7fa6637fe700 1 --2- 172.21.15.160:0/1945600409 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa6640ceae0 0x7fa664159420 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa65400c750 tx=0x7fa65400ca60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:22:46.733 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.721+0000 7fa64bfff700 1 -- 172.21.15.160:0/1945600409 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa654004d40 con 0x7fa6640ceae0 2023-11-08T19:22:46.734 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.721+0000 7fa64bfff700 1 -- 172.21.15.160:0/1945600409 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6540070d0 con 0x7fa6640ceae0 2023-11-08T19:22:46.734 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.721+0000 7fa64bfff700 1 -- 172.21.15.160:0/1945600409 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa654004ea0 con 0x7fa6640ceae0 2023-11-08T19:22:46.734 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.721+0000 7fa66a1e6700 1 -- 172.21.15.160:0/1945600409 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa66415b9f0 con 0x7fa6640ceae0 2023-11-08T19:22:46.734 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.721+0000 7fa66a1e6700 1 -- 172.21.15.160:0/1945600409 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa66415d9e0 con 0x7fa6640ceae0 2023-11-08T19:22:46.735 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.721+0000 7fa64bfff700 1 -- 172.21.15.160:0/1945600409 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa65401d3f0 con 0x7fa6640ceae0 2023-11-08T19:22:46.735 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.721+0000 7fa64bfff700 1 -- 172.21.15.160:0/1945600409 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fa654013a70 con 0x7fa6640ceae0 2023-11-08T19:22:46.735 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.722+0000 7fa66a1e6700 1 -- 172.21.15.160:0/1945600409 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6640ce070 con 0x7fa6640ceae0 2023-11-08T19:22:46.735 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.724+0000 7fa64bfff700 1 -- 172.21.15.160:0/1945600409 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fa654013e20 con 0x7fa6640ceae0 2023-11-08T19:22:46.774 INFO:tasks.ceph.mgr.x.smithi160.stderr:2023-11-08T19:22:46.772+0000 7f8dc02fb200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-08T19:22:46.809 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.808+0000 7fa66a1e6700 1 -- 172.21.15.160:0/1945600409 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "osd new", "uuid": "258a808f-eb6e-4f16-ab36-204c340f2515", "id": 7} v 0) v1 -- 0x7fa66404f730 con 0x7fa6640ceae0 2023-11-08T19:22:46.817 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.816+0000 7fa64bfff700 1 -- 172.21.15.160:0/1945600409 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "258a808f-eb6e-4f16-ab36-204c340f2515", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa654013470 con 0x7fa6640ceae0 2023-11-08T19:22:46.817 INFO:teuthology.orchestra.run.smithi160.stdout:7 2023-11-08T19:22:46.819 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.817+0000 7fa66a1e6700 1 -- 172.21.15.160:0/1945600409 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa6640ceae0 msgr2=0x7fa664159420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:46.819 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.817+0000 7fa66a1e6700 1 --2- 172.21.15.160:0/1945600409 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa6640ceae0 0x7fa664159420 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa65400c750 tx=0x7fa65400ca60 comp rx=0 tx=0).stop 2023-11-08T19:22:46.819 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.817+0000 7fa66a1e6700 1 -- 172.21.15.160:0/1945600409 shutdown_connections 2023-11-08T19:22:46.819 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.817+0000 7fa66a1e6700 1 --2- 172.21.15.160:0/1945600409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa66415dc90 0x7fa664168590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:46.820 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.817+0000 7fa66a1e6700 1 --2- 172.21.15.160:0/1945600409 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa6640ceae0 0x7fa664159420 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:46.820 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.817+0000 7fa66a1e6700 1 --2- 172.21.15.160:0/1945600409 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa66415a0e0 0x7fa664168050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:46.820 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.817+0000 7fa66a1e6700 1 -- 172.21.15.160:0/1945600409 >> 172.21.15.160:0/1945600409 conn(0x7fa6640cc860 msgr2=0x7fa6640cb0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:22:46.821 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.817+0000 7fa66a1e6700 1 -- 172.21.15.160:0/1945600409 shutdown_connections 2023-11-08T19:22:46.821 INFO:teuthology.orchestra.run.smithi160.stderr:2023-11-08T19:22:46.817+0000 7fa66a1e6700 1 -- 172.21.15.160:0/1945600409 wait complete. 2023-11-08T19:22:46.831 INFO:tasks.ceph.osd.0:Restarting daemon 2023-11-08T19:22:46.831 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-11-08T19:22:46.833 INFO:tasks.ceph.osd.0:Started 2023-11-08T19:22:46.833 INFO:tasks.ceph.osd.1:Restarting daemon 2023-11-08T19:22:46.834 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-11-08T19:22:46.836 INFO:tasks.ceph.osd.1:Started 2023-11-08T19:22:46.836 INFO:tasks.ceph.osd.2:Restarting daemon 2023-11-08T19:22:46.836 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-11-08T19:22:46.838 INFO:tasks.ceph.osd.2:Started 2023-11-08T19:22:46.839 INFO:tasks.ceph.osd.3:Restarting daemon 2023-11-08T19:22:46.839 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-11-08T19:22:46.841 INFO:tasks.ceph.osd.3:Started 2023-11-08T19:22:46.841 INFO:tasks.ceph.osd.4:Restarting daemon 2023-11-08T19:22:46.842 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-11-08T19:22:46.844 INFO:tasks.ceph.osd.4:Started 2023-11-08T19:22:46.844 INFO:tasks.ceph.osd.5:Restarting daemon 2023-11-08T19:22:46.845 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-11-08T19:22:46.847 INFO:tasks.ceph.osd.5:Started 2023-11-08T19:22:46.847 INFO:tasks.ceph.osd.6:Restarting daemon 2023-11-08T19:22:46.848 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-11-08T19:22:46.850 INFO:tasks.ceph.osd.6:Started 2023-11-08T19:22:46.850 INFO:tasks.ceph.osd.7:Restarting daemon 2023-11-08T19:22:46.850 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-11-08T19:22:46.852 INFO:tasks.ceph.osd.7:Started 2023-11-08T19:22:46.853 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:22:46.998 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:46.996+0000 7f107664b700 1 Processor -- start 2023-11-08T19:22:46.999 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:46.996+0000 7f107664b700 1 -- start start 2023-11-08T19:22:47.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:46.997+0000 7f107664b700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f107015abb0 0x7f107006e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:47.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:46.997+0000 7f107664b700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f107006e7e0 0x7f107006ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:47.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:46.997+0000 7f107664b700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f107006bb90 0x7f107006c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:47.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:46.997+0000 7f107664b700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f107006c580 con 0x7f107006bb90 2023-11-08T19:22:47.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:46.997+0000 7f107664b700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f107015af90 con 0x7f107006e7e0 2023-11-08T19:22:47.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:46.997+0000 7f107664b700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f107006f260 con 0x7f107015abb0 2023-11-08T19:22:47.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:46.997+0000 7f1074be8700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f107006bb90 0x7f107006c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:47.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:46.997+0000 7f1074be8700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f107006bb90 0x7f107006c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36202/0 (socket says 172.21.15.149:36202) 2023-11-08T19:22:47.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:46.997+0000 7f1074be8700 1 -- 172.21.15.149:0/3347850229 learned_addr learned my addr 172.21.15.149:0/3347850229 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:22:47.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:46.997+0000 7f106ffff700 1 --2- 172.21.15.149:0/3347850229 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f107015abb0 0x7f107006e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:47.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:46.997+0000 7f106f7fe700 1 --2- 172.21.15.149:0/3347850229 >> v2:172.21.15.160:3300/0 conn(0x7f107006e7e0 0x7f107006ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:47.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:46.997+0000 7f1074be8700 1 -- 172.21.15.149:0/3347850229 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f107015abb0 msgr2=0x7f107006e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:22:47.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:46.997+0000 7f1074be8700 1 --2- 172.21.15.149:0/3347850229 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f107015abb0 0x7f107006e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:47.004 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:46.997+0000 7f1074be8700 1 -- 172.21.15.149:0/3347850229 >> v2:172.21.15.160:3300/0 conn(0x7f107006e7e0 msgr2=0x7f107006ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:22:47.004 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:46.997+0000 7f1074be8700 1 --2- 172.21.15.149:0/3347850229 >> v2:172.21.15.160:3300/0 conn(0x7f107006e7e0 0x7f107006ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:47.004 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:46.997+0000 7f1074be8700 1 -- 172.21.15.149:0/3347850229 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f107006d540 con 0x7f107006bb90 2023-11-08T19:22:47.004 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:46.997+0000 7f1074be8700 1 --2- 172.21.15.149:0/3347850229 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f107006bb90 0x7f107006c040 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f107006d020 tx=0x7f106800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bb11ab661dee360 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:22:47.004 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:46.998+0000 7f106effd700 1 -- 172.21.15.149:0/3347850229 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106800e070 con 0x7f107006bb90 2023-11-08T19:22:47.004 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:46.998+0000 7f106effd700 1 -- 172.21.15.149:0/3347850229 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f106800b910 con 0x7f107006bb90 2023-11-08T19:22:47.005 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:46.998+0000 7f106effd700 1 -- 172.21.15.149:0/3347850229 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106800bcc0 con 0x7f107006bb90 2023-11-08T19:22:47.005 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:46.998+0000 7f107664b700 1 -- 172.21.15.149:0/3347850229 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f107006bb90 msgr2=0x7f107006c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:47.005 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:46.998+0000 7f107664b700 1 --2- 172.21.15.149:0/3347850229 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f107006bb90 0x7f107006c040 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f107006d020 tx=0x7f106800b330 comp rx=0 tx=0).stop 2023-11-08T19:22:47.005 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:46.998+0000 7f107664b700 1 -- 172.21.15.149:0/3347850229 shutdown_connections 2023-11-08T19:22:47.005 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:46.998+0000 7f107664b700 1 --2- 172.21.15.149:0/3347850229 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f107006bb90 0x7f107006c040 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:47.006 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:46.998+0000 7f107664b700 1 --2- 172.21.15.149:0/3347850229 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f107015abb0 0x7f107006e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:47.006 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:46.998+0000 7f107664b700 1 --2- 172.21.15.149:0/3347850229 >> v2:172.21.15.160:3300/0 conn(0x7f107006e7e0 0x7f107006ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:47.006 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:46.998+0000 7f107664b700 1 -- 172.21.15.149:0/3347850229 >> 172.21.15.149:0/3347850229 conn(0x7f1070071720 msgr2=0x7f1070071b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:22:47.006 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:46.998+0000 7f107664b700 1 -- 172.21.15.149:0/3347850229 shutdown_connections 2023-11-08T19:22:47.006 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:46.998+0000 7f107664b700 1 -- 172.21.15.149:0/3347850229 wait complete. 2023-11-08T19:22:47.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:47.000+0000 7f107664b700 1 Processor -- start 2023-11-08T19:22:47.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:47.000+0000 7f107664b700 1 -- start start 2023-11-08T19:22:47.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:47.000+0000 7f107664b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f107006bb90 0x7f10700b5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:47.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:47.000+0000 7f107664b700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f107006e7e0 0x7f10700c97f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:47.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:47.001+0000 7f107664b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f107015abb0 0x7f10700cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:47.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:47.001+0000 7f107664b700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10701f2890 con 0x7f107015abb0 2023-11-08T19:22:47.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:47.001+0000 7f107664b700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10700b59d0 con 0x7f107006bb90 2023-11-08T19:22:47.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:47.001+0000 7f107664b700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10701efe50 con 0x7f107006e7e0 2023-11-08T19:22:47.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:47.001+0000 7f1074be8700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f107015abb0 0x7f10700cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:47.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:47.001+0000 7f1074be8700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f107015abb0 0x7f10700cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36208/0 (socket says 172.21.15.149:36208) 2023-11-08T19:22:47.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:47.001+0000 7f1074be8700 1 -- 172.21.15.149:0/3982670817 learned_addr learned my addr 172.21.15.149:0/3982670817 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:22:47.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:47.001+0000 7f106f7fe700 1 --2- 172.21.15.149:0/3982670817 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f107006e7e0 0x7f10700c97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:47.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:47.001+0000 7f106ffff700 1 --2- 172.21.15.149:0/3982670817 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f107006bb90 0x7f10700b5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:47.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:47.001+0000 7f1074be8700 1 -- 172.21.15.149:0/3982670817 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f107006e7e0 msgr2=0x7f10700c97f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:47.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:47.001+0000 7f1074be8700 1 --2- 172.21.15.149:0/3982670817 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f107006e7e0 0x7f10700c97f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:47.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:47.001+0000 7f1074be8700 1 -- 172.21.15.149:0/3982670817 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f107006bb90 msgr2=0x7f10700b5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:47.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:47.001+0000 7f1074be8700 1 --2- 172.21.15.149:0/3982670817 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f107006bb90 0x7f10700b5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:47.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:47.001+0000 7f1074be8700 1 -- 172.21.15.149:0/3982670817 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1068009b30 con 0x7f107015abb0 2023-11-08T19:22:47.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:47.001+0000 7f1074be8700 1 --2- 172.21.15.149:0/3982670817 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f107015abb0 0x7f10700cb6f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f106800b680 tx=0x7f1068004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:22:47.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:47.001+0000 7f106cff9700 1 -- 172.21.15.149:0/3982670817 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10680099b0 con 0x7f107015abb0 2023-11-08T19:22:47.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:47.001+0000 7f106cff9700 1 -- 172.21.15.149:0/3982670817 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f106800ce80 con 0x7f107015abb0 2023-11-08T19:22:47.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:47.001+0000 7f107664b700 1 -- 172.21.15.149:0/3982670817 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10701efb70 con 0x7f107015abb0 2023-11-08T19:22:47.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:47.001+0000 7f106cff9700 1 -- 172.21.15.149:0/3982670817 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1068004490 con 0x7f107015abb0 2023-11-08T19:22:47.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:47.001+0000 7f107664b700 1 -- 172.21.15.149:0/3982670817 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10700c8ff0 con 0x7f107015abb0 2023-11-08T19:22:47.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:47.001+0000 7f106cff9700 1 -- 172.21.15.149:0/3982670817 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f106801c440 con 0x7f107015abb0 2023-11-08T19:22:47.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:47.002+0000 7f106cff9700 1 -- 172.21.15.149:0/3982670817 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f106801cdc0 con 0x7f107015abb0 2023-11-08T19:22:47.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:47.002+0000 7f107664b700 1 -- 172.21.15.149:0/3982670817 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10700745f0 con 0x7f107015abb0 2023-11-08T19:22:47.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:47.004+0000 7f106cff9700 1 -- 172.21.15.149:0/3982670817 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f1068020030 con 0x7f107015abb0 2023-11-08T19:22:47.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:47.074+0000 7f107664b700 1 -- 172.21.15.149:0/3982670817 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f10701548e0 con 0x7f107015abb0 2023-11-08T19:22:47.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:47.075+0000 7f106cff9700 1 -- 172.21.15.149:0/3982670817 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f106801c8b0 con 0x7f107015abb0 2023-11-08T19:22:47.078 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:22:47.078 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":10,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:22:46.810256+0000","last_up_change":"0.000000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:22:47.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:47.076+0000 7f107664b700 1 -- 172.21.15.149:0/3982670817 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f107015abb0 msgr2=0x7f10700cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:47.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:47.076+0000 7f107664b700 1 --2- 172.21.15.149:0/3982670817 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f107015abb0 0x7f10700cb6f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f106800b680 tx=0x7f1068004ad0 comp rx=0 tx=0).stop 2023-11-08T19:22:47.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:47.076+0000 7f107664b700 1 -- 172.21.15.149:0/3982670817 shutdown_connections 2023-11-08T19:22:47.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:47.076+0000 7f107664b700 1 --2- 172.21.15.149:0/3982670817 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f107006bb90 0x7f10700b5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:47.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:47.076+0000 7f107664b700 1 --2- 172.21.15.149:0/3982670817 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f107015abb0 0x7f10700cb6f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:47.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:47.076+0000 7f107664b700 1 --2- 172.21.15.149:0/3982670817 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f107006e7e0 0x7f10700c97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:47.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:47.076+0000 7f107664b700 1 -- 172.21.15.149:0/3982670817 >> 172.21.15.149:0/3982670817 conn(0x7f1070071720 msgr2=0x7f1070155200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:22:47.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:47.076+0000 7f107664b700 1 -- 172.21.15.149:0/3982670817 shutdown_connections 2023-11-08T19:22:47.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:47.076+0000 7f107664b700 1 -- 172.21.15.149:0/3982670817 wait complete. 2023-11-08T19:22:47.090 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-11-08T19:22:47.090 INFO:tasks.ceph:Waiting for OSDs to come up 2023-11-08T19:22:47.429 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-11-08T19:22:47.427+0000 7fa4851e6200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-08T19:22:47.463 INFO:tasks.ceph.osd.0.smithi149.stderr:2023-11-08T19:22:47.461+0000 7fd159b62640 -1 Falling back to public interface 2023-11-08T19:22:47.473 INFO:tasks.ceph.osd.5.smithi160.stderr:2023-11-08T19:22:47.471+0000 7f0f6e3e9640 -1 Falling back to public interface 2023-11-08T19:22:47.473 INFO:tasks.ceph.osd.6.smithi160.stderr:2023-11-08T19:22:47.471+0000 7f7eff5b8640 -1 Falling back to public interface 2023-11-08T19:22:47.474 INFO:tasks.ceph.osd.6.smithi160.stderr:2023-11-08T19:22:47.471+0000 7f7ef6976700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2023-11-08T19:22:47.474 INFO:tasks.ceph.osd.3.smithi149.stderr:2023-11-08T19:22:47.472+0000 7f6a9fbff640 -1 Falling back to public interface 2023-11-08T19:22:47.475 INFO:tasks.ceph.osd.7.smithi160.stderr:2023-11-08T19:22:47.473+0000 7fe9f7546640 -1 Falling back to public interface 2023-11-08T19:22:47.478 INFO:tasks.ceph.osd.2.smithi149.stderr:2023-11-08T19:22:47.476+0000 7f7ffb5cc640 -1 Falling back to public interface 2023-11-08T19:22:47.479 INFO:tasks.ceph.osd.1.smithi149.stderr:2023-11-08T19:22:47.476+0000 7fe6ab3f6640 -1 Falling back to public interface 2023-11-08T19:22:47.479 INFO:tasks.ceph.osd.4.smithi160.stderr:2023-11-08T19:22:47.477+0000 7f0b2a119640 -1 Falling back to public interface 2023-11-08T19:22:47.480 INFO:tasks.ceph.osd.1.smithi149.stderr:2023-11-08T19:22:47.478+0000 7fe6a27b4700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6821/0: (98) Address already in use 2023-11-08T19:22:47.510 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-11-08T19:22:47.508+0000 7fa4851e6200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-08T19:22:47.522 INFO:tasks.ceph.mgr.x.smithi160.stderr:2023-11-08T19:22:47.521+0000 7f8dc02fb200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-08T19:22:47.599 INFO:tasks.ceph.mgr.x.smithi160.stderr:2023-11-08T19:22:47.597+0000 7f8dc02fb200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-08T19:22:47.650 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-11-08T19:22:47.648+0000 7fa4851e6200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-08T19:22:47.740 INFO:tasks.ceph.mgr.x.smithi160.stderr:2023-11-08T19:22:47.738+0000 7f8dc02fb200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-08T19:22:47.884 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-11-08T19:22:47.882+0000 7fa4851e6200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-11-08T19:22:47.896 DEBUG:teuthology.orchestra.run.smithi149:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-08T19:22:47.977 INFO:tasks.ceph.mgr.x.smithi160.stderr:2023-11-08T19:22:47.976+0000 7f8dc02fb200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-11-08T19:22:48.013 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.011+0000 7f2bdc984700 1 Processor -- start 2023-11-08T19:22:48.014 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.011+0000 7f2bdc984700 1 -- start start 2023-11-08T19:22:48.016 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.012+0000 7f2bdc984700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2bd81610b0 0x7f2bd806baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:48.017 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.012+0000 7f2bdc984700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2bd806bfe0 0x7f2bd80cda90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:48.017 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.012+0000 7f2bdc984700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bd806c520 con 0x7f2bd80cdfd0 2023-11-08T19:22:48.017 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.012+0000 7f2bdc984700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bd8161490 con 0x7f2bd81610b0 2023-11-08T19:22:48.017 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.012+0000 7f2bdc984700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd80ce440 con 0x7f2bd806bfe0 2023-11-08T19:22:48.017 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.012+0000 7f2bd659c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2bd81610b0 0x7f2bd806baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:48.018 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.012+0000 7f2bd6d9d700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f2bd80cdfd0 0x7f2bd8161680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:38216/0 (socket says 172.21.15.149:38216) 2023-11-08T19:22:48.018 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.012+0000 7f2bd6d9d700 1 -- 172.21.15.149:0/2830883556 learned_addr learned my addr 172.21.15.149:0/2830883556 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:22:48.018 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.012+0000 7f2bd5d9b700 1 --2- 172.21.15.149:0/2830883556 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2bd806bfe0 0x7f2bd80cda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:48.018 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.013+0000 7f2bd659c700 1 -- 172.21.15.149:0/2830883556 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2bd806bfe0 msgr2=0x7f2bd80cda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:22:48.019 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.013+0000 7f2bd659c700 1 --2- 172.21.15.149:0/2830883556 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2bd806bfe0 0x7f2bd80cda90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:48.019 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.013+0000 7f2bd659c700 1 -- 172.21.15.149:0/2830883556 >> v1:172.21.15.149:6789/0 conn(0x7f2bd80cdfd0 legacy=0x7f2bd8161680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:48.019 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.013+0000 7f2bd659c700 1 -- 172.21.15.149:0/2830883556 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bd806d910 con 0x7f2bd81610b0 2023-11-08T19:22:48.019 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.013+0000 7f2bd559a700 1 -- 172.21.15.149:0/2830883556 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2216060375 0 0) 0x7f2bd806c520 con 0x7f2bd80cdfd0 2023-11-08T19:22:48.019 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.013+0000 7f2bd659c700 1 --2- 172.21.15.149:0/2830883556 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2bd81610b0 0x7f2bd806baa0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2bc8009870 tx=0x7f2bc8009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1629eaf0db57950d server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:22:48.020 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.013+0000 7f2bd559a700 1 -- 172.21.15.149:0/2830883556 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc8011830 con 0x7f2bd81610b0 2023-11-08T19:22:48.020 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.013+0000 7f2bd559a700 1 -- 172.21.15.149:0/2830883556 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bc8011990 con 0x7f2bd81610b0 2023-11-08T19:22:48.020 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.013+0000 7f2bd559a700 1 -- 172.21.15.149:0/2830883556 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc8011d20 con 0x7f2bd81610b0 2023-11-08T19:22:48.020 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.014+0000 7f2bdc984700 1 -- 172.21.15.149:0/2830883556 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2bd81610b0 msgr2=0x7f2bd806baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:48.020 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.014+0000 7f2bdc984700 1 --2- 172.21.15.149:0/2830883556 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2bd81610b0 0x7f2bd806baa0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2bc8009870 tx=0x7f2bc8009b80 comp rx=0 tx=0).stop 2023-11-08T19:22:48.021 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.014+0000 7f2bdc984700 1 -- 172.21.15.149:0/2830883556 shutdown_connections 2023-11-08T19:22:48.021 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.014+0000 7f2bdc984700 1 --2- 172.21.15.149:0/2830883556 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2bd81610b0 0x7f2bd806baa0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:48.021 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.014+0000 7f2bdc984700 1 --2- 172.21.15.149:0/2830883556 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2bd806bfe0 0x7f2bd80cda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:48.022 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.014+0000 7f2bdc984700 1 -- 172.21.15.149:0/2830883556 >> 172.21.15.149:0/2830883556 conn(0x7f2bd80b1890 msgr2=0x7f2bd80b1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:22:48.022 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.014+0000 7f2bdc984700 1 -- 172.21.15.149:0/2830883556 shutdown_connections 2023-11-08T19:22:48.022 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.014+0000 7f2bdc984700 1 -- 172.21.15.149:0/2830883556 wait complete. 2023-11-08T19:22:48.025 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.015+0000 7f2bdc984700 1 Processor -- start 2023-11-08T19:22:48.025 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.015+0000 7f2bdc984700 1 -- start start 2023-11-08T19:22:48.025 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.016+0000 7f2bdc984700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2bd806bfe0 0x7f2bd80c5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:48.026 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.016+0000 7f2bdc984700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2bd80cdfd0 0x7f2bd81583d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:48.026 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.016+0000 7f2bdc984700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2bd81610b0 0x7f2bd81f2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:48.026 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.016+0000 7f2bdc984700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd815cd00 con 0x7f2bd80cdfd0 2023-11-08T19:22:48.026 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.016+0000 7f2bdc984700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd815be10 con 0x7f2bd806bfe0 2023-11-08T19:22:48.026 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.016+0000 7f2bdc984700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd815c0f0 con 0x7f2bd81610b0 2023-11-08T19:22:48.027 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.016+0000 7f2bd5d9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2bd80cdfd0 0x7f2bd81583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:48.027 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.016+0000 7f2bd5d9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2bd80cdfd0 0x7f2bd81583d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36218/0 (socket says 172.21.15.149:36218) 2023-11-08T19:22:48.027 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.016+0000 7f2bd5d9b700 1 -- 172.21.15.149:0/2445477362 learned_addr learned my addr 172.21.15.149:0/2445477362 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:22:48.027 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.016+0000 7f2bd6d9d700 1 --2- 172.21.15.149:0/2445477362 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2bd81610b0 0x7f2bd81f2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:48.027 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.016+0000 7f2bd659c700 1 --2- 172.21.15.149:0/2445477362 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2bd806bfe0 0x7f2bd80c5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:48.028 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.017+0000 7f2bd5d9b700 1 -- 172.21.15.149:0/2445477362 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2bd81610b0 msgr2=0x7f2bd81f2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:48.028 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.017+0000 7f2bd5d9b700 1 --2- 172.21.15.149:0/2445477362 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2bd81610b0 0x7f2bd81f2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:48.028 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.017+0000 7f2bd5d9b700 1 -- 172.21.15.149:0/2445477362 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2bd806bfe0 msgr2=0x7f2bd80c5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:48.028 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.017+0000 7f2bd5d9b700 1 --2- 172.21.15.149:0/2445477362 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2bd806bfe0 0x7f2bd80c5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:48.028 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.017+0000 7f2bd5d9b700 1 -- 172.21.15.149:0/2445477362 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bc80094a0 con 0x7f2bd80cdfd0 2023-11-08T19:22:48.029 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.017+0000 7f2bd659c700 1 --2- 172.21.15.149:0/2445477362 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2bd806bfe0 0x7f2bd80c5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:22:48.029 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.017+0000 7f2bd5d9b700 1 --2- 172.21.15.149:0/2445477362 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2bd80cdfd0 0x7f2bd81583d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc00e870 tx=0x7f2bcc00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:22:48.029 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.017+0000 7f2bc6ffd700 1 -- 172.21.15.149:0/2445477362 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bcc009590 con 0x7f2bd80cdfd0 2023-11-08T19:22:48.029 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.017+0000 7f2bc6ffd700 1 -- 172.21.15.149:0/2445477362 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bcc013680 con 0x7f2bd80cdfd0 2023-11-08T19:22:48.029 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.017+0000 7f2bc6ffd700 1 -- 172.21.15.149:0/2445477362 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bcc0139f0 con 0x7f2bd80cdfd0 2023-11-08T19:22:48.030 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.017+0000 7f2bdc984700 1 -- 172.21.15.149:0/2445477362 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bd815c3d0 con 0x7f2bd80cdfd0 2023-11-08T19:22:48.030 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.017+0000 7f2bdc984700 1 -- 172.21.15.149:0/2445477362 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bd815c990 con 0x7f2bd80cdfd0 2023-11-08T19:22:48.030 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.017+0000 7f2bc6ffd700 1 -- 172.21.15.149:0/2445477362 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2bcc005a20 con 0x7f2bd80cdfd0 2023-11-08T19:22:48.030 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.017+0000 7f2bc6ffd700 1 -- 172.21.15.149:0/2445477362 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f2bcc006790 con 0x7f2bd80cdfd0 2023-11-08T19:22:48.030 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.018+0000 7f2bdc984700 1 -- 172.21.15.149:0/2445477362 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bd81f6790 con 0x7f2bd80cdfd0 2023-11-08T19:22:48.031 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.022+0000 7f2bc6ffd700 1 -- 172.21.15.149:0/2445477362 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f2bcc021060 con 0x7f2bd80cdfd0 2023-11-08T19:22:48.094 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.092+0000 7f2bdc984700 1 -- 172.21.15.149:0/2445477362 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2bd8068000 con 0x7f2bd80cdfd0 2023-11-08T19:22:48.095 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.093+0000 7f2bc6ffd700 1 -- 172.21.15.149:0/2445477362 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f2bcc017070 con 0x7f2bd80cdfd0 2023-11-08T19:22:48.095 INFO:teuthology.misc.health.smithi149.stdout: 2023-11-08T19:22:48.095 INFO:teuthology.misc.health.smithi149.stdout:{"epoch":10,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:22:46.810256+0000","last_up_change":"0.000000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:22:48.097 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.094+0000 7f2bdc984700 1 -- 172.21.15.149:0/2445477362 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2bd80cdfd0 msgr2=0x7f2bd81583d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:48.097 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.094+0000 7f2bdc984700 1 --2- 172.21.15.149:0/2445477362 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2bd80cdfd0 0x7f2bd81583d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc00e870 tx=0x7f2bcc00eb80 comp rx=0 tx=0).stop 2023-11-08T19:22:48.097 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.094+0000 7f2bdc984700 1 -- 172.21.15.149:0/2445477362 shutdown_connections 2023-11-08T19:22:48.097 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.094+0000 7f2bdc984700 1 --2- 172.21.15.149:0/2445477362 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2bd806bfe0 0x7f2bd80c5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:48.098 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.094+0000 7f2bdc984700 1 --2- 172.21.15.149:0/2445477362 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2bd81610b0 0x7f2bd81f2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:48.098 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.094+0000 7f2bdc984700 1 --2- 172.21.15.149:0/2445477362 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2bd80cdfd0 0x7f2bd81583d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:48.098 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.094+0000 7f2bdc984700 1 -- 172.21.15.149:0/2445477362 >> 172.21.15.149:0/2445477362 conn(0x7f2bd80b1890 msgr2=0x7f2bd806f070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:22:48.098 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.094+0000 7f2bdc984700 1 -- 172.21.15.149:0/2445477362 shutdown_connections 2023-11-08T19:22:48.098 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:48.094+0000 7f2bdc984700 1 -- 172.21.15.149:0/2445477362 wait complete. 2023-11-08T19:22:48.107 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-08T19:22:48.113 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-11-08T19:22:48.111+0000 7fa4851e6200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-08T19:22:48.192 INFO:tasks.ceph.mgr.x.smithi160.stderr:2023-11-08T19:22:48.191+0000 7f8dc02fb200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-08T19:22:48.244 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-11-08T19:22:48.242+0000 7fa4851e6200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-08T19:22:48.329 INFO:tasks.ceph.mgr.x.smithi160.stderr:2023-11-08T19:22:48.327+0000 7f8dc02fb200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-08T19:22:48.465 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-11-08T19:22:48.463+0000 7fa4851e6200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-08T19:22:48.550 INFO:tasks.ceph.mgr.x.smithi160.stderr:2023-11-08T19:22:48.548+0000 7f8dc02fb200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-08T19:22:48.622 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-11-08T19:22:48.620+0000 7fa4851e6200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-08T19:22:48.708 INFO:tasks.ceph.mgr.x.smithi160.stderr:2023-11-08T19:22:48.707+0000 7f8dc02fb200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-08T19:22:48.735 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-11-08T19:22:48.734+0000 7fa4851e6200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-08T19:22:48.824 INFO:tasks.ceph.mgr.x.smithi160.stderr:2023-11-08T19:22:48.822+0000 7f8dc02fb200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-08T19:22:49.064 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-11-08T19:22:49.061+0000 7fa4851e6200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-08T19:22:49.165 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-11-08T19:22:49.163+0000 7fa4851e6200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-08T19:22:49.177 INFO:tasks.ceph.mgr.x.smithi160.stderr:2023-11-08T19:22:49.175+0000 7f8dc02fb200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-08T19:22:49.276 INFO:tasks.ceph.mgr.x.smithi160.stderr:2023-11-08T19:22:49.274+0000 7f8dc02fb200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-08T19:22:49.349 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-11-08T19:22:49.347+0000 7fa4851e6200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-08T19:22:49.463 INFO:tasks.ceph.mgr.x.smithi160.stderr:2023-11-08T19:22:49.462+0000 7f8dc02fb200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-08T19:22:49.954 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-11-08T19:22:49.951+0000 7fa4851e6200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-08T19:22:50.072 INFO:tasks.ceph.mgr.x.smithi160.stderr:2023-11-08T19:22:50.070+0000 7f8dc02fb200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-08T19:22:50.741 INFO:tasks.ceph.osd.1.smithi149.stderr:2023-11-08T19:22:50.739+0000 7fe6ab3f6640 -1 osd.1 0 log_to_monitors true 2023-11-08T19:22:50.751 INFO:tasks.ceph.osd.3.smithi149.stderr:2023-11-08T19:22:50.749+0000 7f6a9fbff640 -1 osd.3 0 log_to_monitors true 2023-11-08T19:22:50.978 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-11-08T19:22:50.976+0000 7fa43d177700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-11-08T19:22:50.979 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-11-08T19:22:50.977+0000 7fa43d177700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-11-08T19:22:51.004 INFO:tasks.ceph.osd.0.smithi149.stderr:2023-11-08T19:22:51.002+0000 7fd159b62640 -1 osd.0 0 log_to_monitors true 2023-11-08T19:22:51.008 INFO:tasks.ceph.osd.2.smithi149.stderr:2023-11-08T19:22:51.006+0000 7f7ffb5cc640 -1 osd.2 0 log_to_monitors true 2023-11-08T19:22:51.018 INFO:tasks.ceph.osd.7.smithi160.stderr:2023-11-08T19:22:51.016+0000 7fe9f7546640 -1 osd.7 0 log_to_monitors true 2023-11-08T19:22:51.021 INFO:tasks.ceph.osd.6.smithi160.stderr:2023-11-08T19:22:51.020+0000 7f7eff5b8640 -1 osd.6 0 log_to_monitors true 2023-11-08T19:22:51.029 INFO:tasks.ceph.osd.5.smithi160.stderr:2023-11-08T19:22:51.028+0000 7f0f6e3e9640 -1 osd.5 0 log_to_monitors true 2023-11-08T19:22:51.036 INFO:tasks.ceph.osd.4.smithi160.stderr:2023-11-08T19:22:51.035+0000 7f0b2a119640 -1 osd.4 0 log_to_monitors true 2023-11-08T19:22:54.088 INFO:tasks.ceph.osd.7.smithi160.stderr:2023-11-08T19:22:54.086+0000 7fe9eb8fe700 -1 osd.7 0 waiting for initial osdmap 2023-11-08T19:22:54.105 INFO:tasks.ceph.osd.7.smithi160.stderr:2023-11-08T19:22:54.103+0000 7fe9e34dd700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-08T19:22:54.111 INFO:tasks.ceph.osd.5.smithi160.stderr:2023-11-08T19:22:54.110+0000 7f0f627a1700 -1 osd.5 0 waiting for initial osdmap 2023-11-08T19:22:54.116 INFO:tasks.ceph.osd.5.smithi160.stderr:2023-11-08T19:22:54.115+0000 7f0f5a380700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-08T19:22:54.126 INFO:tasks.ceph.osd.1.smithi149.stderr:2023-11-08T19:22:54.123+0000 7fe69f7ae700 -1 osd.1 0 waiting for initial osdmap 2023-11-08T19:22:54.135 INFO:tasks.ceph.osd.4.smithi160.stderr:2023-11-08T19:22:54.133+0000 7f0b1e4d1700 -1 osd.4 0 waiting for initial osdmap 2023-11-08T19:22:54.150 INFO:tasks.ceph.osd.3.smithi149.stderr:2023-11-08T19:22:54.146+0000 7f6a947b8700 -1 osd.3 0 waiting for initial osdmap 2023-11-08T19:22:54.153 INFO:tasks.ceph.osd.4.smithi160.stderr:2023-11-08T19:22:54.152+0000 7f0b160b0700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-08T19:22:54.161 INFO:tasks.ceph.osd.1.smithi149.stderr:2023-11-08T19:22:54.159+0000 7fe69738d700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-08T19:22:54.174 INFO:tasks.ceph.osd.0.smithi149.stderr:2023-11-08T19:22:54.172+0000 7fd14df1a700 -1 osd.0 0 waiting for initial osdmap 2023-11-08T19:22:54.175 INFO:tasks.ceph.osd.6.smithi160.stderr:2023-11-08T19:22:54.173+0000 7f7ef3970700 -1 osd.6 0 waiting for initial osdmap 2023-11-08T19:22:54.185 INFO:tasks.ceph.osd.3.smithi149.stderr:2023-11-08T19:22:54.183+0000 7f6a8bb96700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-08T19:22:54.194 INFO:tasks.ceph.osd.6.smithi160.stderr:2023-11-08T19:22:54.193+0000 7f7eeb54f700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-08T19:22:54.210 INFO:tasks.ceph.osd.0.smithi149.stderr:2023-11-08T19:22:54.208+0000 7fd145af9700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-08T19:22:54.477 INFO:tasks.ceph.osd.2.smithi149.stderr:2023-11-08T19:22:54.475+0000 7f7fef984700 -1 osd.2 0 waiting for initial osdmap 2023-11-08T19:22:54.486 INFO:tasks.ceph.osd.2.smithi149.stderr:2023-11-08T19:22:54.485+0000 7f7fe7563700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-08T19:22:54.913 DEBUG:teuthology.orchestra.run.smithi149:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-08T19:22:55.029 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.027+0000 7f1506f62700 1 Processor -- start 2023-11-08T19:22:55.029 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.027+0000 7f1506f62700 1 -- start start 2023-11-08T19:22:55.031 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.027+0000 7f1506f62700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1500161f20 0x7f150006ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:55.032 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.027+0000 7f1506f62700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f15000d00c0 0x7f150006b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:55.032 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.027+0000 7f1506f62700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f150015f3a0 con 0x7f1500162300 2023-11-08T19:22:55.032 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.027+0000 7f1506f62700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1500161410 con 0x7f15000d00c0 2023-11-08T19:22:55.032 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.027+0000 7f1506f62700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f150015f640 con 0x7f1500161f20 2023-11-08T19:22:55.032 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.028+0000 7f15054ff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f15000d00c0 0x7f150006b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:55.033 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.028+0000 7f15054ff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f15000d00c0 0x7f150006b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36318/0 (socket says 172.21.15.149:36318) 2023-11-08T19:22:55.033 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.028+0000 7f15054ff700 1 -- 172.21.15.149:0/2878371088 learned_addr learned my addr 172.21.15.149:0/2878371088 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:22:55.033 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.028+0000 7f1504cfe700 1 --2- 172.21.15.149:0/2878371088 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1500161f20 0x7f150006ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:55.033 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.028+0000 7f15054ff700 1 -- 172.21.15.149:0/2878371088 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1500161f20 msgr2=0x7f150006ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:22:55.033 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.028+0000 7f15054ff700 1 --2- 172.21.15.149:0/2878371088 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1500161f20 0x7f150006ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:55.034 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.028+0000 7f15054ff700 1 -- 172.21.15.149:0/2878371088 >> v1:172.21.15.160:6789/0 conn(0x7f1500162300 legacy=0x7f15000cf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:55.034 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.028+0000 7f15054ff700 1 -- 172.21.15.149:0/2878371088 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f150015f920 con 0x7f15000d00c0 2023-11-08T19:22:55.034 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.028+0000 7f15054ff700 1 --2- 172.21.15.149:0/2878371088 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15000d00c0 0x7f150006b0c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f14f8009e50 tx=0x7f14f800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26cde7f215368d0e server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:22:55.034 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.028+0000 7f14ff7fe700 1 -- 172.21.15.149:0/2878371088 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f800e070 con 0x7f15000d00c0 2023-11-08T19:22:55.034 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.028+0000 7f14ff7fe700 1 -- 172.21.15.149:0/2878371088 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14f800b910 con 0x7f15000d00c0 2023-11-08T19:22:55.035 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.028+0000 7f14ff7fe700 1 -- 172.21.15.149:0/2878371088 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f800bcc0 con 0x7f15000d00c0 2023-11-08T19:22:55.035 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.029+0000 7f1506f62700 1 -- 172.21.15.149:0/2878371088 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15000d00c0 msgr2=0x7f150006b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:55.035 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.029+0000 7f1506f62700 1 --2- 172.21.15.149:0/2878371088 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15000d00c0 0x7f150006b0c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f14f8009e50 tx=0x7f14f800b330 comp rx=0 tx=0).stop 2023-11-08T19:22:55.035 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.029+0000 7f1506f62700 1 -- 172.21.15.149:0/2878371088 shutdown_connections 2023-11-08T19:22:55.035 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.029+0000 7f1506f62700 1 --2- 172.21.15.149:0/2878371088 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15000d00c0 0x7f150006b0c0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:55.036 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.029+0000 7f1506f62700 1 --2- 172.21.15.149:0/2878371088 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1500161f20 0x7f150006ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:55.036 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.029+0000 7f1506f62700 1 -- 172.21.15.149:0/2878371088 >> 172.21.15.149:0/2878371088 conn(0x7f1500099a40 msgr2=0x7f15000d0690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:22:55.036 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.029+0000 7f1506f62700 1 -- 172.21.15.149:0/2878371088 shutdown_connections 2023-11-08T19:22:55.036 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.029+0000 7f1506f62700 1 -- 172.21.15.149:0/2878371088 wait complete. 2023-11-08T19:22:55.039 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.030+0000 7f1506f62700 1 Processor -- start 2023-11-08T19:22:55.039 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.030+0000 7f1506f62700 1 -- start start 2023-11-08T19:22:55.039 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.031+0000 7f1506f62700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15000d00c0 0x7f15000ca1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:55.040 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.031+0000 7f1506f62700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1500161f20 0x7f1500156360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:55.040 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.031+0000 7f1506f62700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1500162300 0x7f15000c7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:55.040 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.031+0000 7f1506f62700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1500156d20 con 0x7f15000d00c0 2023-11-08T19:22:55.040 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.031+0000 7f1506f62700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1500154120 con 0x7f1500162300 2023-11-08T19:22:55.040 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.031+0000 7f1506f62700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15000cc9a0 con 0x7f1500161f20 2023-11-08T19:22:55.041 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.031+0000 7f1504cfe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15000d00c0 0x7f15000ca1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:55.041 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.031+0000 7f1504cfe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15000d00c0 0x7f15000ca1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36320/0 (socket says 172.21.15.149:36320) 2023-11-08T19:22:55.041 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.031+0000 7f1504cfe700 1 -- 172.21.15.149:0/1742632323 learned_addr learned my addr 172.21.15.149:0/1742632323 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:22:55.041 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.031+0000 7f1504cfe700 1 -- 172.21.15.149:0/1742632323 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1500161f20 msgr2=0x7f1500156360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:55.041 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.031+0000 7f15054ff700 1 --2- 172.21.15.149:0/1742632323 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1500162300 0x7f15000c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:55.042 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.031+0000 7f14fffff700 1 --2- 172.21.15.149:0/1742632323 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1500161f20 0x7f1500156360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:55.042 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.031+0000 7f1504cfe700 1 --2- 172.21.15.149:0/1742632323 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1500161f20 0x7f1500156360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:55.042 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.031+0000 7f1504cfe700 1 -- 172.21.15.149:0/1742632323 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1500162300 msgr2=0x7f15000c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:55.042 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.031+0000 7f1504cfe700 1 --2- 172.21.15.149:0/1742632323 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1500162300 0x7f15000c7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:55.042 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.031+0000 7f1504cfe700 1 -- 172.21.15.149:0/1742632323 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14f8009b30 con 0x7f15000d00c0 2023-11-08T19:22:55.043 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.031+0000 7f1504cfe700 1 --2- 172.21.15.149:0/1742632323 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15000d00c0 0x7f15000ca1f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f14f400e9e0 tx=0x7f14f400eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:22:55.043 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.031+0000 7f14fd7fa700 1 -- 172.21.15.149:0/1742632323 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f4009710 con 0x7f15000d00c0 2023-11-08T19:22:55.043 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.031+0000 7f14fd7fa700 1 -- 172.21.15.149:0/1742632323 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14f400c850 con 0x7f15000d00c0 2023-11-08T19:22:55.044 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.031+0000 7f1506f62700 1 -- 172.21.15.149:0/1742632323 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1500156a40 con 0x7f15000d00c0 2023-11-08T19:22:55.044 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.032+0000 7f14fd7fa700 1 -- 172.21.15.149:0/1742632323 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f400cbc0 con 0x7f15000d00c0 2023-11-08T19:22:55.044 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.032+0000 7f1506f62700 1 -- 172.21.15.149:0/1742632323 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15000cb120 con 0x7f15000d00c0 2023-11-08T19:22:55.044 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.033+0000 7f1506f62700 1 -- 172.21.15.149:0/1742632323 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15000cb770 con 0x7f15000d00c0 2023-11-08T19:22:55.044 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.033+0000 7f14fd7fa700 1 -- 172.21.15.149:0/1742632323 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7f14f400cd20 con 0x7f15000d00c0 2023-11-08T19:22:55.045 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.033+0000 7f14fd7fa700 1 --2- 172.21.15.149:0/1742632323 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f14e406ae70 0x7f14e406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:55.045 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.033+0000 7f14fd7fa700 1 -- 172.21.15.149:0/1742632323 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f14f40887a0 con 0x7f15000d00c0 2023-11-08T19:22:55.045 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.033+0000 7f14fffff700 1 --2- 172.21.15.149:0/1742632323 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f14e406ae70 0x7f14e406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:55.045 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.034+0000 7f14fffff700 1 --2- 172.21.15.149:0/1742632323 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f14e406ae70 0x7f14e406d330 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f14ec007fd0 tx=0x7f14ec009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:22:55.046 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.039+0000 7f14fd7fa700 1 -- 172.21.15.149:0/1742632323 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f14f4054750 con 0x7f15000d00c0 2023-11-08T19:22:55.238 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.237+0000 7f1506f62700 1 -- 172.21.15.149:0/1742632323 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1500068000 con 0x7f15000d00c0 2023-11-08T19:22:55.239 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.238+0000 7f14fd7fa700 1 -- 172.21.15.149:0/1742632323 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10944 (secure 0 0 0) 0x7f14f4021090 con 0x7f15000d00c0 2023-11-08T19:22:55.239 INFO:teuthology.misc.health.smithi149.stdout: 2023-11-08T19:22:55.240 INFO:teuthology.misc.health.smithi149.stdout:{"epoch":13,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:22:55.108495+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:22:55.242 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.240+0000 7f1506f62700 1 -- 172.21.15.149:0/1742632323 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f14e406ae70 msgr2=0x7f14e406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:55.242 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.240+0000 7f1506f62700 1 --2- 172.21.15.149:0/1742632323 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f14e406ae70 0x7f14e406d330 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f14ec007fd0 tx=0x7f14ec009040 comp rx=0 tx=0).stop 2023-11-08T19:22:55.242 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.240+0000 7f1506f62700 1 -- 172.21.15.149:0/1742632323 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15000d00c0 msgr2=0x7f15000ca1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:55.242 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.240+0000 7f1506f62700 1 --2- 172.21.15.149:0/1742632323 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15000d00c0 0x7f15000ca1f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f14f400e9e0 tx=0x7f14f400eda0 comp rx=0 tx=0).stop 2023-11-08T19:22:55.243 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.240+0000 7f1506f62700 1 -- 172.21.15.149:0/1742632323 shutdown_connections 2023-11-08T19:22:55.243 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.240+0000 7f1506f62700 1 --2- 172.21.15.149:0/1742632323 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f14e406ae70 0x7f14e406d330 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:55.243 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.240+0000 7f1506f62700 1 --2- 172.21.15.149:0/1742632323 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1500162300 0x7f15000c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:55.243 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.240+0000 7f1506f62700 1 --2- 172.21.15.149:0/1742632323 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15000d00c0 0x7f15000ca1f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:55.243 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.240+0000 7f1506f62700 1 --2- 172.21.15.149:0/1742632323 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1500161f20 0x7f1500156360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:55.244 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.240+0000 7f1506f62700 1 -- 172.21.15.149:0/1742632323 >> 172.21.15.149:0/1742632323 conn(0x7f1500099a40 msgr2=0x7f15000cf9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:22:55.244 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.240+0000 7f1506f62700 1 -- 172.21.15.149:0/1742632323 shutdown_connections 2023-11-08T19:22:55.244 INFO:teuthology.misc.health.smithi149.stderr:2023-11-08T19:22:55.240+0000 7f1506f62700 1 -- 172.21.15.149:0/1742632323 wait complete. 2023-11-08T19:22:55.253 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-11-08T19:22:55.253 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-11-08T19:22:55.254 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-08T19:22:55.254 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-08T19:22:55.257 INFO:tasks.ceph.mds.a:Started 2023-11-08T19:22:55.257 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-08T19:22:55.258 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-08T19:22:55.260 INFO:tasks.ceph.mds.c:Started 2023-11-08T19:22:55.260 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-08T19:22:55.260 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-08T19:22:55.263 INFO:tasks.ceph.mds.b:Started 2023-11-08T19:22:55.264 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-08T19:22:55.264 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-08T19:22:55.266 INFO:tasks.ceph.mds.d:Started 2023-11-08T19:22:55.267 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-11-08T19:22:55.267 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:22:55.338 INFO:tasks.ceph.mds.a.smithi149.stdout:starting mds.a at 2023-11-08T19:22:55.339 INFO:tasks.ceph.mds.c.smithi149.stdout:starting mds.c at 2023-11-08T19:22:55.355 INFO:tasks.ceph.mds.d.smithi160.stdout:starting mds.d at 2023-11-08T19:22:55.356 INFO:tasks.ceph.mds.b.smithi160.stdout:starting mds.b at 2023-11-08T19:22:55.395 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.394+0000 7f9dbe2a6700 1 Processor -- start 2023-11-08T19:22:55.396 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.394+0000 7f9dbe2a6700 1 -- start start 2023-11-08T19:22:55.403 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.395+0000 7f9dbe2a6700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9db80cc140 0x7f9db80cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:55.403 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.395+0000 7f9dbe2a6700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9db80cce50 con 0x7f9db80b2cd0 2023-11-08T19:22:55.404 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.395+0000 7f9dbe2a6700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9db80cc520 con 0x7f9db80b2850 2023-11-08T19:22:55.404 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.395+0000 7f9dbe2a6700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9db80b2430 con 0x7f9db80cc140 2023-11-08T19:22:55.404 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.395+0000 7f9dbc843700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f9db80b2cd0 0x7f9db815d2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:38486/0 (socket says 172.21.15.149:38486) 2023-11-08T19:22:55.405 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.395+0000 7f9dbc843700 1 -- 172.21.15.149:0/658726797 learned_addr learned my addr 172.21.15.149:0/658726797 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:22:55.405 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.395+0000 7f9db7fff700 1 --2- 172.21.15.149:0/658726797 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9db80cc140 0x7f9db80cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:55.405 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.395+0000 7f9db6ffd700 1 -- 172.21.15.149:0/658726797 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 203025561 0 0) 0x7f9db80cce50 con 0x7f9db80b2cd0 2023-11-08T19:22:55.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.395+0000 7f9db6ffd700 1 -- 172.21.15.149:0/658726797 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9da00035b0 con 0x7f9db80b2cd0 2023-11-08T19:22:55.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.395+0000 7f9db6ffd700 1 -- 172.21.15.149:0/658726797 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 764799577 0 0) 0x7f9db80cc520 con 0x7f9db80b2850 2023-11-08T19:22:55.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.395+0000 7f9db6ffd700 1 -- 172.21.15.149:0/658726797 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9db80cce50 con 0x7f9db80b2850 2023-11-08T19:22:55.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.395+0000 7f9db7fff700 1 -- 172.21.15.149:0/658726797 >> v1:172.21.15.160:6789/0 conn(0x7f9db80b2850 legacy=0x7f9db80cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:55.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.395+0000 7f9db7fff700 1 -- 172.21.15.149:0/658726797 >> v1:172.21.15.149:6789/0 conn(0x7f9db80b2cd0 legacy=0x7f9db815d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:55.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.395+0000 7f9db7fff700 1 -- 172.21.15.149:0/658726797 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db80b17b0 con 0x7f9db80cc140 2023-11-08T19:22:55.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.395+0000 7f9db7fff700 1 --2- 172.21.15.149:0/658726797 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9db80cc140 0x7f9db80cc910 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9da8009850 tx=0x7f9da8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a458a234dca85c6 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:22:55.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.395+0000 7f9db6ffd700 1 -- 172.21.15.149:0/658726797 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da8005e30 con 0x7f9db80cc140 2023-11-08T19:22:55.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.395+0000 7f9db6ffd700 1 -- 172.21.15.149:0/658726797 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9da8006030 con 0x7f9db80cc140 2023-11-08T19:22:55.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.395+0000 7f9db6ffd700 1 -- 172.21.15.149:0/658726797 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da80063e0 con 0x7f9db80cc140 2023-11-08T19:22:55.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.396+0000 7f9dbe2a6700 1 -- 172.21.15.149:0/658726797 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9db80cc140 msgr2=0x7f9db80cc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:55.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.396+0000 7f9dbe2a6700 1 --2- 172.21.15.149:0/658726797 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9db80cc140 0x7f9db80cc910 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9da8009850 tx=0x7f9da8009b60 comp rx=0 tx=0).stop 2023-11-08T19:22:55.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.396+0000 7f9dbe2a6700 1 -- 172.21.15.149:0/658726797 shutdown_connections 2023-11-08T19:22:55.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.396+0000 7f9dbe2a6700 1 --2- 172.21.15.149:0/658726797 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9db80cc140 0x7f9db80cc910 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:55.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.396+0000 7f9dbe2a6700 1 -- 172.21.15.149:0/658726797 >> 172.21.15.149:0/658726797 conn(0x7f9db8099a40 msgr2=0x7f9db80d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:22:55.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.396+0000 7f9dbe2a6700 1 -- 172.21.15.149:0/658726797 shutdown_connections 2023-11-08T19:22:55.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.396+0000 7f9dbe2a6700 1 -- 172.21.15.149:0/658726797 wait complete. 2023-11-08T19:22:55.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.397+0000 7f9dbe2a6700 1 Processor -- start 2023-11-08T19:22:55.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.397+0000 7f9dbe2a6700 1 -- start start 2023-11-08T19:22:55.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.398+0000 7f9dbe2a6700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9db80b2850 0x7f9db809cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:55.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.398+0000 7f9dbe2a6700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9db80b2cd0 0x7f9db81f2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:55.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.398+0000 7f9dbe2a6700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9db80cc140 0x7f9db80ad1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:55.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.398+0000 7f9dbe2a6700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db80ae3d0 con 0x7f9db80b2cd0 2023-11-08T19:22:55.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.398+0000 7f9dbe2a6700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db80adb30 con 0x7f9db80b2850 2023-11-08T19:22:55.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.398+0000 7f9dbe2a6700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9db80ade10 con 0x7f9db80cc140 2023-11-08T19:22:55.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.398+0000 7f9db77fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9db80b2cd0 0x7f9db81f2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:55.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.398+0000 7f9db77fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9db80b2cd0 0x7f9db81f2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36490/0 (socket says 172.21.15.149:36490) 2023-11-08T19:22:55.414 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.398+0000 7f9dbc843700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9db80cc140 0x7f9db80ad1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:55.414 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.398+0000 7f9db77fe700 1 -- 172.21.15.149:0/326536306 learned_addr learned my addr 172.21.15.149:0/326536306 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:22:55.414 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.398+0000 7f9db7fff700 1 --2- 172.21.15.149:0/326536306 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9db80b2850 0x7f9db809cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:55.414 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.399+0000 7f9db77fe700 1 -- 172.21.15.149:0/326536306 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9db80cc140 msgr2=0x7f9db80ad1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:55.414 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.399+0000 7f9db77fe700 1 --2- 172.21.15.149:0/326536306 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9db80cc140 0x7f9db80ad1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:55.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.399+0000 7f9db77fe700 1 -- 172.21.15.149:0/326536306 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9db80b2850 msgr2=0x7f9db809cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:55.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.399+0000 7f9db77fe700 1 --2- 172.21.15.149:0/326536306 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9db80b2850 0x7f9db809cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:55.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.399+0000 7f9db77fe700 1 -- 172.21.15.149:0/326536306 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da8009430 con 0x7f9db80b2cd0 2023-11-08T19:22:55.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.399+0000 7f9db77fe700 1 --2- 172.21.15.149:0/326536306 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9db80b2cd0 0x7f9db81f2bb0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9dac00c520 tx=0x7f9dac00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:22:55.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.399+0000 7f9db4ff9700 1 -- 172.21.15.149:0/326536306 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dac0052d0 con 0x7f9db80b2cd0 2023-11-08T19:22:55.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.399+0000 7f9db4ff9700 1 -- 172.21.15.149:0/326536306 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dac005430 con 0x7f9db80b2cd0 2023-11-08T19:22:55.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.399+0000 7f9dbe2a6700 1 -- 172.21.15.149:0/326536306 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9db80ae0f0 con 0x7f9db80b2cd0 2023-11-08T19:22:55.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.399+0000 7f9db4ff9700 1 -- 172.21.15.149:0/326536306 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dac0038c0 con 0x7f9db80b2cd0 2023-11-08T19:22:55.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.399+0000 7f9dbe2a6700 1 -- 172.21.15.149:0/326536306 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9db80ad700 con 0x7f9db80b2cd0 2023-11-08T19:22:55.417 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.400+0000 7f9dbe2a6700 1 -- 172.21.15.149:0/326536306 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9db809a340 con 0x7f9db80b2cd0 2023-11-08T19:22:55.417 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.400+0000 7f9db4ff9700 1 -- 172.21.15.149:0/326536306 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7f9dac003a20 con 0x7f9db80b2cd0 2023-11-08T19:22:55.417 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.401+0000 7f9db4ff9700 1 --2- 172.21.15.149:0/326536306 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9da406ae70 0x7f9da406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:55.417 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.401+0000 7f9db4ff9700 1 -- 172.21.15.149:0/326536306 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f9dac0883b0 con 0x7f9db80b2cd0 2023-11-08T19:22:55.417 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.401+0000 7f9db7fff700 1 --2- 172.21.15.149:0/326536306 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9da406ae70 0x7f9da406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:55.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.401+0000 7f9db7fff700 1 --2- 172.21.15.149:0/326536306 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9da406ae70 0x7f9da406d330 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9da8000c00 tx=0x7f9da8008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:22:55.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.406+0000 7f9db4ff9700 1 -- 172.21.15.149:0/326536306 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9db809a340 con 0x7f9db80b2cd0 2023-11-08T19:22:55.601 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.600+0000 7f9dbe2a6700 1 -- 172.21.15.149:0/326536306 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9db809a340 con 0x7f9db80b2cd0 2023-11-08T19:22:55.602 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.600+0000 7f9db4ff9700 1 -- 172.21.15.149:0/326536306 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10944 (secure 0 0 0) 0x7f9db809a340 con 0x7f9db80b2cd0 2023-11-08T19:22:55.602 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:22:55.602 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":13,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:22:55.108495+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:22:55.604 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.603+0000 7f9dbe2a6700 1 -- 172.21.15.149:0/326536306 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9da406ae70 msgr2=0x7f9da406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:55.604 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.603+0000 7f9dbe2a6700 1 --2- 172.21.15.149:0/326536306 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9da406ae70 0x7f9da406d330 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9da8000c00 tx=0x7f9da8008070 comp rx=0 tx=0).stop 2023-11-08T19:22:55.605 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.603+0000 7f9dbe2a6700 1 -- 172.21.15.149:0/326536306 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9db80b2cd0 msgr2=0x7f9db81f2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:55.605 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.603+0000 7f9dbe2a6700 1 --2- 172.21.15.149:0/326536306 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9db80b2cd0 0x7f9db81f2bb0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9dac00c520 tx=0x7f9dac00c830 comp rx=0 tx=0).stop 2023-11-08T19:22:55.605 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.603+0000 7f9dbe2a6700 1 -- 172.21.15.149:0/326536306 shutdown_connections 2023-11-08T19:22:55.605 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.603+0000 7f9dbe2a6700 1 --2- 172.21.15.149:0/326536306 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9da406ae70 0x7f9da406d330 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:55.605 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.603+0000 7f9dbe2a6700 1 --2- 172.21.15.149:0/326536306 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9db80b2850 0x7f9db809cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:55.606 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.603+0000 7f9dbe2a6700 1 --2- 172.21.15.149:0/326536306 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9db80cc140 0x7f9db80ad1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:55.606 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.603+0000 7f9dbe2a6700 1 --2- 172.21.15.149:0/326536306 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9db80b2cd0 0x7f9db81f2bb0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:55.606 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.603+0000 7f9dbe2a6700 1 -- 172.21.15.149:0/326536306 >> 172.21.15.149:0/326536306 conn(0x7f9db8099a40 msgr2=0x7f9db80c7790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:22:55.606 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.603+0000 7f9dbe2a6700 1 -- 172.21.15.149:0/326536306 shutdown_connections 2023-11-08T19:22:55.606 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.603+0000 7f9dbe2a6700 1 -- 172.21.15.149:0/326536306 wait complete. 2023-11-08T19:22:55.617 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2023-11-08T19:22:55.617 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:22:55.738 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.737+0000 7fafa902f700 1 Processor -- start 2023-11-08T19:22:55.739 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.737+0000 7fafa902f700 1 -- start start 2023-11-08T19:22:55.741 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.738+0000 7fafa902f700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fafa40cc910 0x7fafa40cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:55.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.738+0000 7fafa902f700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fafa40cb130 0x7fafa415d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:55.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.738+0000 7fafa902f700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafa40b2f60 con 0x7fafa40cc140 2023-11-08T19:22:55.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.738+0000 7fafa902f700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafa40b2430 con 0x7fafa40cb130 2023-11-08T19:22:55.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.738+0000 7fafa902f700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafa40cc520 con 0x7fafa40cc910 2023-11-08T19:22:55.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.738+0000 7fafa2d9d700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fafa40cc140 0x7fafa40b2850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:38538/0 (socket says 172.21.15.149:38538) 2023-11-08T19:22:55.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.738+0000 7fafa2d9d700 1 -- 172.21.15.149:0/3252553386 learned_addr learned my addr 172.21.15.149:0/3252553386 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:22:55.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.738+0000 7fafa359e700 1 --2- 172.21.15.149:0/3252553386 >> v2:172.21.15.149:3300/0 conn(0x7fafa40cb130 0x7fafa415d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:55.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.738+0000 7fafa259c700 1 --2- 172.21.15.149:0/3252553386 >> v2:172.21.15.160:3300/0 conn(0x7fafa40cc910 0x7fafa40cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:55.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.738+0000 7fafa1d9b700 1 -- 172.21.15.149:0/3252553386 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3403962595 0 0) 0x7fafa40b2f60 con 0x7fafa40cc140 2023-11-08T19:22:55.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.739+0000 7fafa1d9b700 1 -- 172.21.15.149:0/3252553386 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf8c0035b0 con 0x7fafa40cc140 2023-11-08T19:22:55.744 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.739+0000 7fafa359e700 1 -- 172.21.15.149:0/3252553386 >> v2:172.21.15.160:3300/0 conn(0x7fafa40cc910 msgr2=0x7fafa40cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:22:55.744 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.739+0000 7fafa359e700 1 --2- 172.21.15.149:0/3252553386 >> v2:172.21.15.160:3300/0 conn(0x7fafa40cc910 0x7fafa40cabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:55.744 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.739+0000 7fafa359e700 1 -- 172.21.15.149:0/3252553386 >> v1:172.21.15.149:6789/0 conn(0x7fafa40cc140 legacy=0x7fafa40b2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:55.744 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.739+0000 7fafa359e700 1 -- 172.21.15.149:0/3252553386 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa40cb5e0 con 0x7fafa40cb130 2023-11-08T19:22:55.744 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.739+0000 7fafa359e700 1 --2- 172.21.15.149:0/3252553386 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafa40cb130 0x7fafa415d2b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fafa40b1330 tx=0x7faf9c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8a1a91f18488a89 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:22:55.745 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.739+0000 7fafa1d9b700 1 -- 172.21.15.149:0/3252553386 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9c00e070 con 0x7fafa40cb130 2023-11-08T19:22:55.745 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.739+0000 7fafa1d9b700 1 -- 172.21.15.149:0/3252553386 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf9c00bb20 con 0x7fafa40cb130 2023-11-08T19:22:55.745 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.739+0000 7fafa1d9b700 1 -- 172.21.15.149:0/3252553386 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9c012430 con 0x7fafa40cb130 2023-11-08T19:22:55.745 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.739+0000 7fafa902f700 1 -- 172.21.15.149:0/3252553386 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafa40cb130 msgr2=0x7fafa415d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:55.745 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.739+0000 7fafa902f700 1 --2- 172.21.15.149:0/3252553386 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafa40cb130 0x7fafa415d2b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fafa40b1330 tx=0x7faf9c00b330 comp rx=0 tx=0).stop 2023-11-08T19:22:55.746 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.739+0000 7fafa902f700 1 -- 172.21.15.149:0/3252553386 shutdown_connections 2023-11-08T19:22:55.746 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.739+0000 7fafa902f700 1 --2- 172.21.15.149:0/3252553386 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafa40cb130 0x7fafa415d2b0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:55.746 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.739+0000 7fafa902f700 1 --2- 172.21.15.149:0/3252553386 >> v2:172.21.15.160:3300/0 conn(0x7fafa40cc910 0x7fafa40cabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:55.746 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.739+0000 7fafa902f700 1 -- 172.21.15.149:0/3252553386 >> 172.21.15.149:0/3252553386 conn(0x7fafa4099a40 msgr2=0x7fafa40d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:22:55.746 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.739+0000 7fafa902f700 1 -- 172.21.15.149:0/3252553386 shutdown_connections 2023-11-08T19:22:55.747 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.739+0000 7fafa902f700 1 -- 172.21.15.149:0/3252553386 wait complete. 2023-11-08T19:22:55.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.741+0000 7fafa902f700 1 Processor -- start 2023-11-08T19:22:55.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.741+0000 7fafa902f700 1 -- start start 2023-11-08T19:22:55.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.742+0000 7fafa902f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fafa40cb130 0x7fafa409dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:55.751 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.742+0000 7fafa902f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fafa40cc140 0x7fafa40b3250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:55.751 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.742+0000 7fafa902f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafa40cc910 0x7fafa41e6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:55.751 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.742+0000 7fafa902f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa40ae4a0 con 0x7fafa40cc910 2023-11-08T19:22:55.751 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.742+0000 7fafa902f700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa40b3790 con 0x7fafa40cc140 2023-11-08T19:22:55.751 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.742+0000 7fafa902f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafa40b6360 con 0x7fafa40cb130 2023-11-08T19:22:55.752 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.742+0000 7fafa359e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafa40cc910 0x7fafa41e6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:55.752 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.742+0000 7fafa359e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafa40cc910 0x7fafa41e6400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36546/0 (socket says 172.21.15.149:36546) 2023-11-08T19:22:55.752 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.742+0000 7fafa359e700 1 -- 172.21.15.149:0/3157962931 learned_addr learned my addr 172.21.15.149:0/3157962931 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:22:55.752 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.742+0000 7fafa2d9d700 1 --2- 172.21.15.149:0/3157962931 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fafa40cb130 0x7fafa409dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:55.752 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.742+0000 7fafa259c700 1 --2- 172.21.15.149:0/3157962931 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fafa40cc140 0x7fafa40b3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:55.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.742+0000 7fafa359e700 1 -- 172.21.15.149:0/3157962931 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fafa40cb130 msgr2=0x7fafa409dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:55.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.742+0000 7fafa359e700 1 --2- 172.21.15.149:0/3157962931 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fafa40cb130 0x7fafa409dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:55.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.742+0000 7fafa359e700 1 -- 172.21.15.149:0/3157962931 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fafa40cc140 msgr2=0x7fafa40b3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:55.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.742+0000 7fafa359e700 1 --2- 172.21.15.149:0/3157962931 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fafa40cc140 0x7fafa40b3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:55.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.742+0000 7fafa359e700 1 -- 172.21.15.149:0/3157962931 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf9c009a70 con 0x7fafa40cc910 2023-11-08T19:22:55.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.742+0000 7fafa359e700 1 --2- 172.21.15.149:0/3157962931 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafa40cc910 0x7fafa41e6400 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7faf9c014040 tx=0x7faf9c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:22:55.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.742+0000 7faf8b7fe700 1 -- 172.21.15.149:0/3157962931 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9c012a70 con 0x7fafa40cc910 2023-11-08T19:22:55.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.742+0000 7faf8b7fe700 1 -- 172.21.15.149:0/3157962931 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf9c020070 con 0x7fafa40cc910 2023-11-08T19:22:55.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.742+0000 7fafa902f700 1 -- 172.21.15.149:0/3157962931 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafa40ae6b0 con 0x7fafa40cc910 2023-11-08T19:22:55.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.742+0000 7faf8b7fe700 1 -- 172.21.15.149:0/3157962931 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9c012e30 con 0x7fafa40cc910 2023-11-08T19:22:55.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.743+0000 7fafa902f700 1 -- 172.21.15.149:0/3157962931 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafa40aec70 con 0x7fafa40cc910 2023-11-08T19:22:55.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.743+0000 7fafa902f700 1 -- 172.21.15.149:0/3157962931 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafa40aee90 con 0x7fafa40cc910 2023-11-08T19:22:55.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.744+0000 7faf8b7fe700 1 -- 172.21.15.149:0/3157962931 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7faf9c004040 con 0x7fafa40cc910 2023-11-08T19:22:55.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.744+0000 7faf8b7fe700 1 --2- 172.21.15.149:0/3157962931 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7faf9006ae70 0x7faf9006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:55.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.744+0000 7faf8b7fe700 1 -- 172.21.15.149:0/3157962931 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7faf9c022070 con 0x7fafa40cc910 2023-11-08T19:22:55.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.744+0000 7fafa2d9d700 1 --2- 172.21.15.149:0/3157962931 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7faf9006ae70 0x7faf9006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:55.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.745+0000 7fafa2d9d700 1 --2- 172.21.15.149:0/3157962931 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7faf9006ae70 0x7faf9006d330 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7faf98007fd0 tx=0x7faf98009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:22:55.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.749+0000 7faf8b7fe700 1 -- 172.21.15.149:0/3157962931 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7faf9c056410 con 0x7fafa40cc910 2023-11-08T19:22:55.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.979+0000 7fafa902f700 1 -- 172.21.15.149:0/3157962931 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fafa40745f0 con 0x7fafa40cc910 2023-11-08T19:22:55.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.979+0000 7faf8b7fe700 1 -- 172.21.15.149:0/3157962931 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1327 (secure 0 0 0) 0x7faf9c02c090 con 0x7fafa40cc910 2023-11-08T19:22:55.981 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:22:55.981 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4252,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/2277605177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":2277605177},{"type":"v1","addr":"172.21.15.149:6837","nonce":2277605177}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-11-08T19:22:55.983 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.981+0000 7fafa902f700 1 -- 172.21.15.149:0/3157962931 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7faf9006ae70 msgr2=0x7faf9006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:55.983 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.981+0000 7fafa902f700 1 --2- 172.21.15.149:0/3157962931 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7faf9006ae70 0x7faf9006d330 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7faf98007fd0 tx=0x7faf98009040 comp rx=0 tx=0).stop 2023-11-08T19:22:55.983 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.981+0000 7fafa902f700 1 -- 172.21.15.149:0/3157962931 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafa40cc910 msgr2=0x7fafa41e6400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:55.983 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.981+0000 7fafa902f700 1 --2- 172.21.15.149:0/3157962931 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafa40cc910 0x7fafa41e6400 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7faf9c014040 tx=0x7faf9c004ad0 comp rx=0 tx=0).stop 2023-11-08T19:22:55.984 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.981+0000 7fafa902f700 1 -- 172.21.15.149:0/3157962931 shutdown_connections 2023-11-08T19:22:55.984 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.981+0000 7fafa902f700 1 --2- 172.21.15.149:0/3157962931 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7faf9006ae70 0x7faf9006d330 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:55.984 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.981+0000 7fafa902f700 1 --2- 172.21.15.149:0/3157962931 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafa40cc910 0x7fafa41e6400 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:55.984 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.981+0000 7fafa902f700 1 --2- 172.21.15.149:0/3157962931 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fafa40cb130 0x7fafa409dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:55.984 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.981+0000 7fafa902f700 1 --2- 172.21.15.149:0/3157962931 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fafa40cc140 0x7fafa40b3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:55.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.981+0000 7fafa902f700 1 -- 172.21.15.149:0/3157962931 >> 172.21.15.149:0/3157962931 conn(0x7fafa4099a40 msgr2=0x7fafa40ca200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:22:55.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.982+0000 7fafa902f700 1 -- 172.21.15.149:0/3157962931 shutdown_connections 2023-11-08T19:22:55.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:55.982+0000 7fafa902f700 1 -- 172.21.15.149:0/3157962931 wait complete. 2023-11-08T19:22:55.985 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 2 2023-11-08T19:22:57.995 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:22:58.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.135+0000 7f041751f700 1 Processor -- start 2023-11-08T19:22:58.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.135+0000 7f041751f700 1 -- start start 2023-11-08T19:22:58.138 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.136+0000 7f041751f700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f041015dc30 0x7f041006f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:58.138 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.136+0000 7f041751f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f04100d2060 0x7f041006f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:58.138 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.136+0000 7f041751f700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f041006bd50 con 0x7f041006fc70 2023-11-08T19:22:58.139 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.136+0000 7f041751f700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0410070100 con 0x7f041015dc30 2023-11-08T19:22:58.139 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.136+0000 7f041751f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04100d04b0 con 0x7f04100d2060 2023-11-08T19:22:58.139 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.136+0000 7f0414aba700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f04100d2060 0x7f041006f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:58.139 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.136+0000 7f04152bb700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f041015dc30 0x7f041006f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:58.139 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.136+0000 7f0414aba700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f04100d2060 0x7f041006f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.149:56856/0 (socket says 172.21.15.149:56856) 2023-11-08T19:22:58.140 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.136+0000 7f0414aba700 1 -- 172.21.15.149:0/361664105 learned_addr learned my addr 172.21.15.149:0/361664105 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:22:58.140 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.136+0000 7f0407fff700 1 -- 172.21.15.149:0/361664105 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2620395102 0 0) 0x7f041006bd50 con 0x7f041006fc70 2023-11-08T19:22:58.140 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.137+0000 7f0414aba700 1 -- 172.21.15.149:0/361664105 >> v2:172.21.15.160:3300/0 conn(0x7f041015dc30 msgr2=0x7f041006f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:22:58.140 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.137+0000 7f0414aba700 1 --2- 172.21.15.149:0/361664105 >> v2:172.21.15.160:3300/0 conn(0x7f041015dc30 0x7f041006f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:58.140 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.137+0000 7f0414aba700 1 -- 172.21.15.149:0/361664105 >> v1:172.21.15.160:6789/0 conn(0x7f041006fc70 legacy=0x7f0410161790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:58.141 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.137+0000 7f0414aba700 1 -- 172.21.15.149:0/361664105 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04100d0730 con 0x7f04100d2060 2023-11-08T19:22:58.141 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.137+0000 7f0414aba700 1 --2- 172.21.15.149:0/361664105 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f04100d2060 0x7f041006f730 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f04000098f0 tx=0x7f0400009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ebd51bf838f6382 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:22:58.141 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.137+0000 7f0407fff700 1 -- 172.21.15.149:0/361664105 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0400011830 con 0x7f04100d2060 2023-11-08T19:22:58.141 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.137+0000 7f0407fff700 1 -- 172.21.15.149:0/361664105 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0400011990 con 0x7f04100d2060 2023-11-08T19:22:58.141 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.137+0000 7f0407fff700 1 -- 172.21.15.149:0/361664105 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0400011d20 con 0x7f04100d2060 2023-11-08T19:22:58.145 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.138+0000 7f041751f700 1 -- 172.21.15.149:0/361664105 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f04100d2060 msgr2=0x7f041006f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:58.145 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.138+0000 7f041751f700 1 --2- 172.21.15.149:0/361664105 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f04100d2060 0x7f041006f730 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f04000098f0 tx=0x7f0400009c00 comp rx=0 tx=0).stop 2023-11-08T19:22:58.145 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.138+0000 7f041751f700 1 -- 172.21.15.149:0/361664105 shutdown_connections 2023-11-08T19:22:58.145 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.138+0000 7f041751f700 1 --2- 172.21.15.149:0/361664105 >> v2:172.21.15.160:3300/0 conn(0x7f041015dc30 0x7f041006f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:58.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.138+0000 7f041751f700 1 --2- 172.21.15.149:0/361664105 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f04100d2060 0x7f041006f730 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:58.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.138+0000 7f041751f700 1 -- 172.21.15.149:0/361664105 >> 172.21.15.149:0/361664105 conn(0x7f041008afd0 msgr2=0x7f04100d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:22:58.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.138+0000 7f041751f700 1 -- 172.21.15.149:0/361664105 shutdown_connections 2023-11-08T19:22:58.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.138+0000 7f041751f700 1 -- 172.21.15.149:0/361664105 wait complete. 2023-11-08T19:22:58.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.139+0000 7f041751f700 1 Processor -- start 2023-11-08T19:22:58.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.139+0000 7f041751f700 1 -- start start 2023-11-08T19:22:58.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.140+0000 7f041751f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f041006fc70 0x7f04100c9d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:58.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.140+0000 7f041751f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f04100d2060 0x7f04101f2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:58.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.140+0000 7f041751f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f041015dc30 0x7f04101f2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:58.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.140+0000 7f041751f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04100cc9b0 con 0x7f041015dc30 2023-11-08T19:22:58.148 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.140+0000 7f041751f700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04100ca250 con 0x7f041006fc70 2023-11-08T19:22:58.148 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.140+0000 7f041751f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04100cab30 con 0x7f04100d2060 2023-11-08T19:22:58.148 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.140+0000 7f04152bb700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f041006fc70 0x7f04100c9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:58.148 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.140+0000 7f0414aba700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f04100d2060 0x7f04101f2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:58.148 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.140+0000 7f0415abc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f041015dc30 0x7f04101f2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:58.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.140+0000 7f04152bb700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f041006fc70 0x7f04100c9d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.149:37564/0 (socket says 172.21.15.149:37564) 2023-11-08T19:22:58.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.140+0000 7f0414aba700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f04100d2060 0x7f04101f2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.149:56862/0 (socket says 172.21.15.149:56862) 2023-11-08T19:22:58.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.140+0000 7f04152bb700 1 -- 172.21.15.149:0/13805793 learned_addr learned my addr 172.21.15.149:0/13805793 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:22:58.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.140+0000 7f0415abc700 1 -- 172.21.15.149:0/13805793 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f04100d2060 msgr2=0x7f04101f2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:58.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.140+0000 7f0415abc700 1 --2- 172.21.15.149:0/13805793 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f04100d2060 0x7f04101f2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:58.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.141+0000 7f0415abc700 1 -- 172.21.15.149:0/13805793 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f041006fc70 msgr2=0x7f04100c9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:58.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.141+0000 7f0415abc700 1 --2- 172.21.15.149:0/13805793 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f041006fc70 0x7f04100c9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:58.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.141+0000 7f0415abc700 1 -- 172.21.15.149:0/13805793 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0400009550 con 0x7f041015dc30 2023-11-08T19:22:58.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.141+0000 7f04152bb700 1 --2- 172.21.15.149:0/13805793 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f041006fc70 0x7f04100c9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:22:58.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.141+0000 7f0415abc700 1 --2- 172.21.15.149:0/13805793 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f041015dc30 0x7f04101f2b80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f040800c780 tx=0x7f040800ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:22:58.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.141+0000 7f0405ffb700 1 -- 172.21.15.149:0/13805793 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0408003e30 con 0x7f041015dc30 2023-11-08T19:22:58.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.141+0000 7f0405ffb700 1 -- 172.21.15.149:0/13805793 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04080050d0 con 0x7f041015dc30 2023-11-08T19:22:58.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.141+0000 7f041751f700 1 -- 172.21.15.149:0/13805793 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04100cbda0 con 0x7f041015dc30 2023-11-08T19:22:58.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.141+0000 7f0405ffb700 1 -- 172.21.15.149:0/13805793 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0408005480 con 0x7f041015dc30 2023-11-08T19:22:58.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.141+0000 7f041751f700 1 -- 172.21.15.149:0/13805793 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04100cc360 con 0x7f041015dc30 2023-11-08T19:22:58.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.142+0000 7f041751f700 1 -- 172.21.15.149:0/13805793 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04100ccb20 con 0x7f041015dc30 2023-11-08T19:22:58.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.143+0000 7f0405ffb700 1 -- 172.21.15.149:0/13805793 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7f04080055e0 con 0x7f041015dc30 2023-11-08T19:22:58.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.143+0000 7f0405ffb700 1 --2- 172.21.15.149:0/13805793 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f03f406ae70 0x7f03f406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:58.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.143+0000 7f0405ffb700 1 -- 172.21.15.149:0/13805793 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0408088730 con 0x7f041015dc30 2023-11-08T19:22:58.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.143+0000 7f04152bb700 1 --2- 172.21.15.149:0/13805793 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f03f406ae70 0x7f03f406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:58.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.143+0000 7f04152bb700 1 --2- 172.21.15.149:0/13805793 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f03f406ae70 0x7f03f406d330 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f040c009fd0 tx=0x7f040c0091c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:22:58.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.149+0000 7f0405ffb700 1 -- 172.21.15.149:0/13805793 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0408053c10 con 0x7f041015dc30 2023-11-08T19:22:58.402 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.401+0000 7f041751f700 1 -- 172.21.15.149:0/13805793 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f04100745f0 con 0x7f041015dc30 2023-11-08T19:22:58.402 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.401+0000 7f0405ffb700 1 -- 172.21.15.149:0/13805793 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3706 (secure 0 0 0) 0x7f0408017020 con 0x7f041015dc30 2023-11-08T19:22:58.403 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:22:58.403 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4252,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/2277605177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":2277605177},{"type":"v1","addr":"172.21.15.149:6837","nonce":2277605177}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/2774257644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2774257644},{"type":"v1","addr":"172.21.15.149:6836","nonce":2774257644}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/2076428669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":2076428669},{"type":"v1","addr":"172.21.15.160:6835","nonce":2076428669}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/3847116435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3847116435},{"type":"v1","addr":"172.21.15.160:6834","nonce":3847116435}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-11-08T19:22:58.405 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.403+0000 7f041751f700 1 -- 172.21.15.149:0/13805793 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f03f406ae70 msgr2=0x7f03f406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:58.405 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.403+0000 7f041751f700 1 --2- 172.21.15.149:0/13805793 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f03f406ae70 0x7f03f406d330 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f040c009fd0 tx=0x7f040c0091c0 comp rx=0 tx=0).stop 2023-11-08T19:22:58.405 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.403+0000 7f041751f700 1 -- 172.21.15.149:0/13805793 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f041015dc30 msgr2=0x7f04101f2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:58.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.403+0000 7f041751f700 1 --2- 172.21.15.149:0/13805793 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f041015dc30 0x7f04101f2b80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f040800c780 tx=0x7f040800ca90 comp rx=0 tx=0).stop 2023-11-08T19:22:58.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.403+0000 7f041751f700 1 -- 172.21.15.149:0/13805793 shutdown_connections 2023-11-08T19:22:58.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.403+0000 7f041751f700 1 --2- 172.21.15.149:0/13805793 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f03f406ae70 0x7f03f406d330 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:58.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.403+0000 7f041751f700 1 --2- 172.21.15.149:0/13805793 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f041006fc70 0x7f04100c9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:58.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.403+0000 7f041751f700 1 --2- 172.21.15.149:0/13805793 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f041015dc30 0x7f04101f2b80 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:58.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.403+0000 7f041751f700 1 --2- 172.21.15.149:0/13805793 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f04100d2060 0x7f04101f2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:58.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.403+0000 7f041751f700 1 -- 172.21.15.149:0/13805793 >> 172.21.15.149:0/13805793 conn(0x7f041008afd0 msgr2=0x7f041006ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:22:58.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.404+0000 7f041751f700 1 -- 172.21.15.149:0/13805793 shutdown_connections 2023-11-08T19:22:58.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.404+0000 7f041751f700 1 -- 172.21.15.149:0/13805793 wait complete. 2023-11-08T19:22:58.408 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 3 2023-11-08T19:22:58.417 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:22:58.543 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.542+0000 7ff8d6ac6700 1 Processor -- start 2023-11-08T19:22:58.543 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.542+0000 7ff8d6ac6700 1 -- start start 2023-11-08T19:22:58.545 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.542+0000 7ff8d6ac6700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8d00d0fe0 0x7ff8d00c8680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:58.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.542+0000 7ff8d6ac6700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8d015bd30 con 0x7ff8d015b950 2023-11-08T19:22:58.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.542+0000 7ff8d6ac6700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8d00c7670 con 0x7ff8d00cc9a0 2023-11-08T19:22:58.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.542+0000 7ff8d6ac6700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d00caa90 con 0x7ff8d00d0fe0 2023-11-08T19:22:58.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.543+0000 7ff8d4862700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7ff8d015b950 0x7ff8d00cc290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:38608/0 (socket says 172.21.15.149:38608) 2023-11-08T19:22:58.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.543+0000 7ff8d4862700 1 -- 172.21.15.149:0/3422551261 learned_addr learned my addr 172.21.15.149:0/3422551261 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:22:58.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.543+0000 7ff8cffff700 1 --2- 172.21.15.149:0/3422551261 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8d00d0fe0 0x7ff8d00c8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:58.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.543+0000 7ff8cf7fe700 1 -- 172.21.15.149:0/3422551261 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3970158413 0 0) 0x7ff8d015bd30 con 0x7ff8d015b950 2023-11-08T19:22:58.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.543+0000 7ff8cf7fe700 1 -- 172.21.15.149:0/3422551261 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8c00035b0 con 0x7ff8d015b950 2023-11-08T19:22:58.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.543+0000 7ff8cffff700 1 -- 172.21.15.149:0/3422551261 >> v1:172.21.15.160:6789/0 conn(0x7ff8d00cc9a0 legacy=0x7ff8d00c8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:58.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.543+0000 7ff8cffff700 1 -- 172.21.15.149:0/3422551261 >> v1:172.21.15.149:6789/0 conn(0x7ff8d015b950 legacy=0x7ff8d00cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:58.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.543+0000 7ff8cffff700 1 -- 172.21.15.149:0/3422551261 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d00c81f0 con 0x7ff8d00d0fe0 2023-11-08T19:22:58.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.543+0000 7ff8cffff700 1 --2- 172.21.15.149:0/3422551261 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8d00d0fe0 0x7ff8d00c8680 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc009870 tx=0x7ff8bc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8226c4e7762d7f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:22:58.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.543+0000 7ff8cf7fe700 1 -- 172.21.15.149:0/3422551261 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc011830 con 0x7ff8d00d0fe0 2023-11-08T19:22:58.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.543+0000 7ff8cf7fe700 1 -- 172.21.15.149:0/3422551261 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8bc011990 con 0x7ff8d00d0fe0 2023-11-08T19:22:58.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.543+0000 7ff8cf7fe700 1 -- 172.21.15.149:0/3422551261 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc011d20 con 0x7ff8d00d0fe0 2023-11-08T19:22:58.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.544+0000 7ff8d6ac6700 1 -- 172.21.15.149:0/3422551261 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8d00d0fe0 msgr2=0x7ff8d00c8680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:58.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.544+0000 7ff8d6ac6700 1 --2- 172.21.15.149:0/3422551261 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8d00d0fe0 0x7ff8d00c8680 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc009870 tx=0x7ff8bc009b80 comp rx=0 tx=0).stop 2023-11-08T19:22:58.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.544+0000 7ff8d6ac6700 1 -- 172.21.15.149:0/3422551261 shutdown_connections 2023-11-08T19:22:58.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.544+0000 7ff8d6ac6700 1 --2- 172.21.15.149:0/3422551261 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8d00d0fe0 0x7ff8d00c8680 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:58.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.544+0000 7ff8d6ac6700 1 -- 172.21.15.149:0/3422551261 >> 172.21.15.149:0/3422551261 conn(0x7ff8d0099a40 msgr2=0x7ff8d00d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:22:58.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.544+0000 7ff8d6ac6700 1 -- 172.21.15.149:0/3422551261 shutdown_connections 2023-11-08T19:22:58.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.544+0000 7ff8d6ac6700 1 -- 172.21.15.149:0/3422551261 wait complete. 2023-11-08T19:22:58.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.545+0000 7ff8d6ac6700 1 Processor -- start 2023-11-08T19:22:58.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.545+0000 7ff8d6ac6700 1 -- start start 2023-11-08T19:22:58.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.546+0000 7ff8d6ac6700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff8d00cc9a0 0x7ff8d00c6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:58.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.546+0000 7ff8d6ac6700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8d00d0fe0 0x7ff8d01563b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:58.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.546+0000 7ff8d6ac6700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8d015b950 0x7ff8d00c8c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:58.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.546+0000 7ff8d6ac6700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d015df70 con 0x7ff8d00d0fe0 2023-11-08T19:22:58.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.546+0000 7ff8d6ac6700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d00d01d0 con 0x7ff8d00cc9a0 2023-11-08T19:22:58.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.546+0000 7ff8d6ac6700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d01568f0 con 0x7ff8d015b950 2023-11-08T19:22:58.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.546+0000 7ff8cffff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8d00d0fe0 0x7ff8d01563b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:58.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.546+0000 7ff8cffff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8d00d0fe0 0x7ff8d01563b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36614/0 (socket says 172.21.15.149:36614) 2023-11-08T19:22:58.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.546+0000 7ff8cffff700 1 -- 172.21.15.149:0/16503434 learned_addr learned my addr 172.21.15.149:0/16503434 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:22:58.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.546+0000 7ff8d5063700 1 --2- 172.21.15.149:0/16503434 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8d015b950 0x7ff8d00c8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:58.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.546+0000 7ff8d4862700 1 --2- 172.21.15.149:0/16503434 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff8d00cc9a0 0x7ff8d00c6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:58.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.547+0000 7ff8cffff700 1 -- 172.21.15.149:0/16503434 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8d015b950 msgr2=0x7ff8d00c8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:58.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.547+0000 7ff8cffff700 1 --2- 172.21.15.149:0/16503434 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8d015b950 0x7ff8d00c8c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:58.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.547+0000 7ff8cffff700 1 -- 172.21.15.149:0/16503434 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff8d00cc9a0 msgr2=0x7ff8d00c6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:58.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.547+0000 7ff8cffff700 1 --2- 172.21.15.149:0/16503434 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff8d00cc9a0 0x7ff8d00c6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:58.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.547+0000 7ff8cffff700 1 -- 172.21.15.149:0/16503434 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8bc0094a0 con 0x7ff8d00d0fe0 2023-11-08T19:22:58.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.547+0000 7ff8cffff700 1 --2- 172.21.15.149:0/16503434 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8d00d0fe0 0x7ff8d01563b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc0090b0 tx=0x7ff8bc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:22:58.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.547+0000 7ff8cd7fa700 1 -- 172.21.15.149:0/16503434 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc0036a0 con 0x7ff8d00d0fe0 2023-11-08T19:22:58.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.547+0000 7ff8cd7fa700 1 -- 172.21.15.149:0/16503434 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8bc01f070 con 0x7ff8d00d0fe0 2023-11-08T19:22:58.558 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.547+0000 7ff8d6ac6700 1 -- 172.21.15.149:0/16503434 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8d00c6560 con 0x7ff8d00d0fe0 2023-11-08T19:22:58.558 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.547+0000 7ff8cd7fa700 1 -- 172.21.15.149:0/16503434 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc003a60 con 0x7ff8d00d0fe0 2023-11-08T19:22:58.558 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.547+0000 7ff8d6ac6700 1 -- 172.21.15.149:0/16503434 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8d00cfef0 con 0x7ff8d00d0fe0 2023-11-08T19:22:58.558 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.548+0000 7ff8d6ac6700 1 -- 172.21.15.149:0/16503434 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8d00745f0 con 0x7ff8d00d0fe0 2023-11-08T19:22:58.558 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.548+0000 7ff8cd7fa700 1 -- 172.21.15.149:0/16503434 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7ff8bc003bc0 con 0x7ff8d00d0fe0 2023-11-08T19:22:58.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.549+0000 7ff8cd7fa700 1 --2- 172.21.15.149:0/16503434 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff8b406aea0 0x7ff8b406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:58.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.549+0000 7ff8cd7fa700 1 -- 172.21.15.149:0/16503434 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff8bc021070 con 0x7ff8d00d0fe0 2023-11-08T19:22:58.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.549+0000 7ff8d4862700 1 --2- 172.21.15.149:0/16503434 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff8b406aea0 0x7ff8b406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:58.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.549+0000 7ff8d4862700 1 --2- 172.21.15.149:0/16503434 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff8b406aea0 0x7ff8b406d360 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff8c40010e0 tx=0x7ff8c4007c70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:22:58.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.554+0000 7ff8cd7fa700 1 -- 172.21.15.149:0/16503434 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff8bc055df0 con 0x7ff8d00d0fe0 2023-11-08T19:22:58.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.751+0000 7ff8d6ac6700 1 -- 172.21.15.149:0/16503434 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff8d006eed0 con 0x7ff8d00d0fe0 2023-11-08T19:22:58.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.752+0000 7ff8cd7fa700 1 -- 172.21.15.149:0/16503434 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12886 (secure 0 0 0) 0x7ff8bc059410 con 0x7ff8d00d0fe0 2023-11-08T19:22:58.754 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:22:58.754 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":16,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:22:58.496087+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:22:58.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.754+0000 7ff8d6ac6700 1 -- 172.21.15.149:0/16503434 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff8b406aea0 msgr2=0x7ff8b406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:58.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.754+0000 7ff8d6ac6700 1 --2- 172.21.15.149:0/16503434 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff8b406aea0 0x7ff8b406d360 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff8c40010e0 tx=0x7ff8c4007c70 comp rx=0 tx=0).stop 2023-11-08T19:22:58.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.755+0000 7ff8d6ac6700 1 -- 172.21.15.149:0/16503434 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8d00d0fe0 msgr2=0x7ff8d01563b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:58.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.755+0000 7ff8d6ac6700 1 --2- 172.21.15.149:0/16503434 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8d00d0fe0 0x7ff8d01563b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc0090b0 tx=0x7ff8bc004750 comp rx=0 tx=0).stop 2023-11-08T19:22:58.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.755+0000 7ff8d6ac6700 1 -- 172.21.15.149:0/16503434 shutdown_connections 2023-11-08T19:22:58.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.755+0000 7ff8d6ac6700 1 --2- 172.21.15.149:0/16503434 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff8b406aea0 0x7ff8b406d360 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:58.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.755+0000 7ff8d6ac6700 1 --2- 172.21.15.149:0/16503434 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff8d00cc9a0 0x7ff8d00c6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:58.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.755+0000 7ff8d6ac6700 1 --2- 172.21.15.149:0/16503434 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8d015b950 0x7ff8d00c8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:58.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.755+0000 7ff8d6ac6700 1 --2- 172.21.15.149:0/16503434 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8d00d0fe0 0x7ff8d01563b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:58.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.755+0000 7ff8d6ac6700 1 -- 172.21.15.149:0/16503434 >> 172.21.15.149:0/16503434 conn(0x7ff8d0099a40 msgr2=0x7ff8d006e040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:22:58.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.755+0000 7ff8d6ac6700 1 -- 172.21.15.149:0/16503434 shutdown_connections 2023-11-08T19:22:58.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.755+0000 7ff8d6ac6700 1 -- 172.21.15.149:0/16503434 wait complete. 2023-11-08T19:22:58.768 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-08T19:22:56.023194+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-08T19:22:58.769 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-08T19:22:58.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.893+0000 7f867acd5700 1 Processor -- start 2023-11-08T19:22:58.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.893+0000 7f867acd5700 1 -- start start 2023-11-08T19:22:58.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.894+0000 7f867acd5700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f867406ab80 0x7f86740caf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:58.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.894+0000 7f867acd5700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f86740cf1c0 0x7f86740cb490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:58.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.894+0000 7f867acd5700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f867415e320 con 0x7f867415df40 2023-11-08T19:22:58.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.894+0000 7f867acd5700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f867406b020 con 0x7f86740cf1c0 2023-11-08T19:22:58.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.894+0000 7f867acd5700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f867406b2e0 con 0x7f867406ab80 2023-11-08T19:22:58.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.894+0000 7f8678a71700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f867415df40 0x7f867406c0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:38630/0 (socket says 172.21.15.149:38630) 2023-11-08T19:22:58.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.894+0000 7f8678a71700 1 -- 172.21.15.149:0/1063589223 learned_addr learned my addr 172.21.15.149:0/1063589223 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:22:58.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.894+0000 7f8679272700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f86740cf1c0 0x7f86740cb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:58.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.894+0000 7f8673fff700 1 --2- 172.21.15.149:0/1063589223 >> v2:172.21.15.160:3300/0 conn(0x7f867406ab80 0x7f86740caf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:58.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.894+0000 7f8679272700 1 -- 172.21.15.149:0/1063589223 >> v2:172.21.15.160:3300/0 conn(0x7f867406ab80 msgr2=0x7f86740caf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:22:58.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.894+0000 7f8679272700 1 --2- 172.21.15.149:0/1063589223 >> v2:172.21.15.160:3300/0 conn(0x7f867406ab80 0x7f86740caf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:58.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.894+0000 7f8679272700 1 -- 172.21.15.149:0/1063589223 >> v1:172.21.15.149:6789/0 conn(0x7f867415df40 legacy=0x7f867406c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:58.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.894+0000 7f8679272700 1 -- 172.21.15.149:0/1063589223 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f867406b5c0 con 0x7f86740cf1c0 2023-11-08T19:22:58.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.894+0000 7f8679272700 1 --2- 172.21.15.149:0/1063589223 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86740cf1c0 0x7f86740cb490 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f867406d940 tx=0x7f866c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c897cdc12a2e9b09 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:22:58.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.924+0000 7f86737fe700 1 -- 172.21.15.149:0/1063589223 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f866c00e070 con 0x7f86740cf1c0 2023-11-08T19:22:58.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.924+0000 7f86737fe700 1 -- 172.21.15.149:0/1063589223 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f866c00bb20 con 0x7f86740cf1c0 2023-11-08T19:22:58.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.924+0000 7f86737fe700 1 -- 172.21.15.149:0/1063589223 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f866c012430 con 0x7f86740cf1c0 2023-11-08T19:22:58.926 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.925+0000 7f867acd5700 1 -- 172.21.15.149:0/1063589223 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86740cf1c0 msgr2=0x7f86740cb490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:58.926 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.925+0000 7f867acd5700 1 --2- 172.21.15.149:0/1063589223 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86740cf1c0 0x7f86740cb490 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f867406d940 tx=0x7f866c00b330 comp rx=0 tx=0).stop 2023-11-08T19:22:58.926 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.925+0000 7f867acd5700 1 -- 172.21.15.149:0/1063589223 shutdown_connections 2023-11-08T19:22:58.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.925+0000 7f867acd5700 1 --2- 172.21.15.149:0/1063589223 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86740cf1c0 0x7f86740cb490 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:58.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.925+0000 7f867acd5700 1 --2- 172.21.15.149:0/1063589223 >> v2:172.21.15.160:3300/0 conn(0x7f867406ab80 0x7f86740caf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:58.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.925+0000 7f867acd5700 1 -- 172.21.15.149:0/1063589223 >> 172.21.15.149:0/1063589223 conn(0x7f86740d0640 msgr2=0x7f86740d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:22:58.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.925+0000 7f867acd5700 1 -- 172.21.15.149:0/1063589223 shutdown_connections 2023-11-08T19:22:58.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.925+0000 7f867acd5700 1 -- 172.21.15.149:0/1063589223 wait complete. 2023-11-08T19:22:58.930 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.926+0000 7f867acd5700 1 Processor -- start 2023-11-08T19:22:58.930 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.927+0000 7f867acd5700 1 -- start start 2023-11-08T19:22:58.930 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.927+0000 7f867acd5700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f867406ab80 0x7f86740c9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:58.930 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.927+0000 7f867acd5700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f86740cf1c0 0x7f86740c6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:58.931 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.927+0000 7f867acd5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f867415df40 0x7f86740cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:58.931 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.927+0000 7f867acd5700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86740ad160 con 0x7f867415df40 2023-11-08T19:22:58.931 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.927+0000 7f867acd5700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86740c9800 con 0x7f867406ab80 2023-11-08T19:22:58.931 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.927+0000 7f867acd5700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86740c9ae0 con 0x7f86740cf1c0 2023-11-08T19:22:58.932 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.928+0000 7f8679272700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f867415df40 0x7f86740cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:58.932 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.928+0000 7f8679272700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f867415df40 0x7f86740cd0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36640/0 (socket says 172.21.15.149:36640) 2023-11-08T19:22:58.932 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.928+0000 7f8679272700 1 -- 172.21.15.149:0/2135561059 learned_addr learned my addr 172.21.15.149:0/2135561059 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:22:58.932 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.928+0000 7f8673fff700 1 --2- 172.21.15.149:0/2135561059 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f86740cf1c0 0x7f86740c6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:58.932 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.928+0000 7f8678a71700 1 --2- 172.21.15.149:0/2135561059 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f867406ab80 0x7f86740c9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:58.932 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.928+0000 7f8679272700 1 -- 172.21.15.149:0/2135561059 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f86740cf1c0 msgr2=0x7f86740c6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:58.933 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.928+0000 7f8679272700 1 --2- 172.21.15.149:0/2135561059 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f86740cf1c0 0x7f86740c6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:58.933 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.928+0000 7f8679272700 1 -- 172.21.15.149:0/2135561059 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f867406ab80 msgr2=0x7f86740c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:58.933 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.928+0000 7f8679272700 1 --2- 172.21.15.149:0/2135561059 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f867406ab80 0x7f86740c9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:58.933 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.928+0000 7f8679272700 1 -- 172.21.15.149:0/2135561059 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f866c009a70 con 0x7f867415df40 2023-11-08T19:22:58.933 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.928+0000 7f8673fff700 1 --2- 172.21.15.149:0/2135561059 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f86740cf1c0 0x7f86740c6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:22:58.933 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.928+0000 7f8678a71700 1 --2- 172.21.15.149:0/2135561059 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f867406ab80 0x7f86740c9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:22:58.934 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.928+0000 7f8679272700 1 --2- 172.21.15.149:0/2135561059 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f867415df40 0x7f86740cd0c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f866c014040 tx=0x7f866c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:22:58.934 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.928+0000 7f86717fa700 1 -- 172.21.15.149:0/2135561059 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f866c012430 con 0x7f867415df40 2023-11-08T19:22:58.934 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.928+0000 7f86717fa700 1 -- 172.21.15.149:0/2135561059 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f866c020070 con 0x7f867415df40 2023-11-08T19:22:58.934 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.928+0000 7f867acd5700 1 -- 172.21.15.149:0/2135561059 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86740c9dc0 con 0x7f867415df40 2023-11-08T19:22:58.934 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.928+0000 7f86717fa700 1 -- 172.21.15.149:0/2135561059 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f866c004280 con 0x7f867415df40 2023-11-08T19:22:58.935 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.928+0000 7f867acd5700 1 -- 172.21.15.149:0/2135561059 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86740c65c0 con 0x7f867415df40 2023-11-08T19:22:58.936 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.929+0000 7f867acd5700 1 -- 172.21.15.149:0/2135561059 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f867404f730 con 0x7f867415df40 2023-11-08T19:22:58.936 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.930+0000 7f86717fa700 1 -- 172.21.15.149:0/2135561059 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7f866c0043e0 con 0x7f867415df40 2023-11-08T19:22:58.936 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.930+0000 7f86717fa700 1 --2- 172.21.15.149:0/2135561059 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f865806ae70 0x7f865806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:58.936 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.930+0000 7f86717fa700 1 -- 172.21.15.149:0/2135561059 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f866c022070 con 0x7f867415df40 2023-11-08T19:22:58.936 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.930+0000 7f8678a71700 1 --2- 172.21.15.149:0/2135561059 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f865806ae70 0x7f865806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:58.937 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.931+0000 7f8678a71700 1 --2- 172.21.15.149:0/2135561059 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f865806ae70 0x7f865806d330 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8668000f60 tx=0x7f8668009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:22:58.937 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:58.936+0000 7f86717fa700 1 -- 172.21.15.149:0/2135561059 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f866c0bdca0 con 0x7f867415df40 2023-11-08T19:22:59.131 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.129+0000 7f867acd5700 1 -- 172.21.15.149:0/2135561059 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f86740ca520 con 0x7f867415df40 2023-11-08T19:22:59.131 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.130+0000 7f86717fa700 1 -- 172.21.15.149:0/2135561059 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f866c089e60 con 0x7f867415df40 2023-11-08T19:22:59.131 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 1 2023-11-08T19:22:59.134 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.132+0000 7f867acd5700 1 -- 172.21.15.149:0/2135561059 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f865806ae70 msgr2=0x7f865806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:59.134 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.132+0000 7f867acd5700 1 --2- 172.21.15.149:0/2135561059 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f865806ae70 0x7f865806d330 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8668000f60 tx=0x7f8668009040 comp rx=0 tx=0).stop 2023-11-08T19:22:59.134 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.132+0000 7f867acd5700 1 -- 172.21.15.149:0/2135561059 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f867415df40 msgr2=0x7f86740cd0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:59.135 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.132+0000 7f867acd5700 1 --2- 172.21.15.149:0/2135561059 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f867415df40 0x7f86740cd0c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f866c014040 tx=0x7f866c004ad0 comp rx=0 tx=0).stop 2023-11-08T19:22:59.135 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.133+0000 7f867acd5700 1 -- 172.21.15.149:0/2135561059 shutdown_connections 2023-11-08T19:22:59.135 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.133+0000 7f867acd5700 1 --2- 172.21.15.149:0/2135561059 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f865806ae70 0x7f865806d330 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:59.135 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.133+0000 7f867acd5700 1 --2- 172.21.15.149:0/2135561059 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f867406ab80 0x7f86740c9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:59.135 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.133+0000 7f867acd5700 1 --2- 172.21.15.149:0/2135561059 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f867415df40 0x7f86740cd0c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:59.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.133+0000 7f867acd5700 1 --2- 172.21.15.149:0/2135561059 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f86740cf1c0 0x7f86740c6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:59.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.133+0000 7f867acd5700 1 -- 172.21.15.149:0/2135561059 >> 172.21.15.149:0/2135561059 conn(0x7f86740d0640 msgr2=0x7f86740d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:22:59.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.133+0000 7f867acd5700 1 -- 172.21.15.149:0/2135561059 shutdown_connections 2023-11-08T19:22:59.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.133+0000 7f867acd5700 1 -- 172.21.15.149:0/2135561059 wait complete. 2023-11-08T19:22:59.146 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-08T19:22:59.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.265+0000 7f569b781700 1 Processor -- start 2023-11-08T19:22:59.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.266+0000 7f569b781700 1 -- start start 2023-11-08T19:22:59.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.266+0000 7f569b781700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f569415b950 0x7f56940ce130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:59.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.266+0000 7f569b781700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f56940d0430 0x7f56940ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:59.270 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.266+0000 7f569b781700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56940cc2e0 con 0x7f56940cd5e0 2023-11-08T19:22:59.270 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.266+0000 7f569b781700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56940cc580 con 0x7f569415b950 2023-11-08T19:22:59.270 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.266+0000 7f569b781700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56940cc820 con 0x7f56940d0430 2023-11-08T19:22:59.270 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.266+0000 7f569951d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f569415b950 0x7f56940ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:59.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.267+0000 7f569951d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f569415b950 0x7f56940ce130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36646/0 (socket says 172.21.15.149:36646) 2023-11-08T19:22:59.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.267+0000 7f569951d700 1 -- 172.21.15.149:0/4046337823 learned_addr learned my addr 172.21.15.149:0/4046337823 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:22:59.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.267+0000 7f5699d1e700 1 --2- 172.21.15.149:0/4046337823 >> v2:172.21.15.160:3300/0 conn(0x7f56940d0430 0x7f56940ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:59.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.267+0000 7f569951d700 1 -- 172.21.15.149:0/4046337823 >> v2:172.21.15.160:3300/0 conn(0x7f56940d0430 msgr2=0x7f56940ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:22:59.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.267+0000 7f569951d700 1 --2- 172.21.15.149:0/4046337823 >> v2:172.21.15.160:3300/0 conn(0x7f56940d0430 0x7f56940ce670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:59.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.267+0000 7f569951d700 1 -- 172.21.15.149:0/4046337823 >> v1:172.21.15.149:6789/0 conn(0x7f56940cd5e0 legacy=0x7f56940cfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:59.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.267+0000 7f569951d700 1 -- 172.21.15.149:0/4046337823 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56940ccb00 con 0x7f569415b950 2023-11-08T19:22:59.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.267+0000 7f568bfff700 1 -- 172.21.15.149:0/4046337823 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2558615702 0 0) 0x7f56940cc2e0 con 0x7f56940cd5e0 2023-11-08T19:22:59.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.267+0000 7f5699d1e700 1 --2- 172.21.15.149:0/4046337823 >> v2:172.21.15.160:3300/0 conn(0x7f56940d0430 0x7f56940ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:22:59.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.267+0000 7f569951d700 1 --2- 172.21.15.149:0/4046337823 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f569415b950 0x7f56940ce130 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f56940cbd20 tx=0x7f5684009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ac6e5e2052383a2 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:22:59.273 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.267+0000 7f568bfff700 1 -- 172.21.15.149:0/4046337823 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5684005e30 con 0x7f569415b950 2023-11-08T19:22:59.273 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.267+0000 7f568bfff700 1 -- 172.21.15.149:0/4046337823 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5684004030 con 0x7f569415b950 2023-11-08T19:22:59.273 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.267+0000 7f568bfff700 1 -- 172.21.15.149:0/4046337823 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56840043e0 con 0x7f569415b950 2023-11-08T19:22:59.273 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.268+0000 7f569b781700 1 -- 172.21.15.149:0/4046337823 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f569415b950 msgr2=0x7f56940ce130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:59.273 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.268+0000 7f569b781700 1 --2- 172.21.15.149:0/4046337823 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f569415b950 0x7f56940ce130 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f56940cbd20 tx=0x7f5684009bd0 comp rx=0 tx=0).stop 2023-11-08T19:22:59.274 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.268+0000 7f569b781700 1 -- 172.21.15.149:0/4046337823 shutdown_connections 2023-11-08T19:22:59.274 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.268+0000 7f569b781700 1 --2- 172.21.15.149:0/4046337823 >> v2:172.21.15.160:3300/0 conn(0x7f56940d0430 0x7f56940ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:59.274 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.268+0000 7f569b781700 1 --2- 172.21.15.149:0/4046337823 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f569415b950 0x7f56940ce130 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:59.274 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.268+0000 7f569b781700 1 -- 172.21.15.149:0/4046337823 >> 172.21.15.149:0/4046337823 conn(0x7f569408afd0 msgr2=0x7f56940d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:22:59.275 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.268+0000 7f569b781700 1 -- 172.21.15.149:0/4046337823 shutdown_connections 2023-11-08T19:22:59.275 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.268+0000 7f569b781700 1 -- 172.21.15.149:0/4046337823 wait complete. 2023-11-08T19:22:59.277 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.269+0000 7f569b781700 1 Processor -- start 2023-11-08T19:22:59.277 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.269+0000 7f569b781700 1 -- start start 2023-11-08T19:22:59.278 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.270+0000 7f569b781700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f56940d0430 0x7f56941573a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:59.278 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.270+0000 7f569b781700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f569415b950 0x7f569406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:59.278 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.270+0000 7f569b781700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f569415e970 0x7f56941f6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:59.278 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.270+0000 7f569b781700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f569406d6e0 con 0x7f569415e970 2023-11-08T19:22:59.278 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.270+0000 7f569b781700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f569406c100 con 0x7f569415b950 2023-11-08T19:22:59.279 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.270+0000 7f569b781700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f569406c3e0 con 0x7f56940d0430 2023-11-08T19:22:59.279 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.270+0000 7f5699d1e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f569415e970 0x7f56941f6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:59.279 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.270+0000 7f5699d1e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f569415e970 0x7f56941f6e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36656/0 (socket says 172.21.15.149:36656) 2023-11-08T19:22:59.279 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.270+0000 7f5699d1e700 1 -- 172.21.15.149:0/2413308833 learned_addr learned my addr 172.21.15.149:0/2413308833 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:22:59.279 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.270+0000 7f569951d700 1 --2- 172.21.15.149:0/2413308833 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f56940d0430 0x7f56941573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:59.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.270+0000 7f5698d1c700 1 --2- 172.21.15.149:0/2413308833 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f569415b950 0x7f569406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:59.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.270+0000 7f5699d1e700 1 -- 172.21.15.149:0/2413308833 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f56940d0430 msgr2=0x7f56941573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:59.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.270+0000 7f5699d1e700 1 --2- 172.21.15.149:0/2413308833 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f56940d0430 0x7f56941573a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:59.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.270+0000 7f5699d1e700 1 -- 172.21.15.149:0/2413308833 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f569415b950 msgr2=0x7f569406d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:59.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.270+0000 7f5699d1e700 1 --2- 172.21.15.149:0/2413308833 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f569415b950 0x7f569406d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:59.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.270+0000 7f5699d1e700 1 -- 172.21.15.149:0/2413308833 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5684009500 con 0x7f569415e970 2023-11-08T19:22:59.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.270+0000 7f5699d1e700 1 --2- 172.21.15.149:0/2413308833 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f569415e970 0x7f56941f6e90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f568c009fa0 tx=0x7f568c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:22:59.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.270+0000 7f5689ffb700 1 -- 172.21.15.149:0/2413308833 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568c00ddb0 con 0x7f569415e970 2023-11-08T19:22:59.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.270+0000 7f5689ffb700 1 -- 172.21.15.149:0/2413308833 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f568c00f040 con 0x7f569415e970 2023-11-08T19:22:59.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.270+0000 7f569b781700 1 -- 172.21.15.149:0/2413308833 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f569406c6c0 con 0x7f569415e970 2023-11-08T19:22:59.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.270+0000 7f5689ffb700 1 -- 172.21.15.149:0/2413308833 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568c003c60 con 0x7f569415e970 2023-11-08T19:22:59.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.271+0000 7f569b781700 1 -- 172.21.15.149:0/2413308833 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f569406cc80 con 0x7f569415e970 2023-11-08T19:22:59.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.271+0000 7f569b781700 1 -- 172.21.15.149:0/2413308833 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f569406cea0 con 0x7f569415e970 2023-11-08T19:22:59.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.272+0000 7f5689ffb700 1 -- 172.21.15.149:0/2413308833 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7f568c004030 con 0x7f569415e970 2023-11-08T19:22:59.283 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.272+0000 7f5689ffb700 1 --2- 172.21.15.149:0/2413308833 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f567806ae70 0x7f567806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:59.283 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.272+0000 7f5689ffb700 1 -- 172.21.15.149:0/2413308833 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f568c089210 con 0x7f569415e970 2023-11-08T19:22:59.283 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.272+0000 7f569951d700 1 --2- 172.21.15.149:0/2413308833 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f567806ae70 0x7f567806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:59.283 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.273+0000 7f569951d700 1 --2- 172.21.15.149:0/2413308833 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f567806ae70 0x7f567806d330 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f56940cbd20 tx=0x7f5684008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:22:59.284 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.277+0000 7f5689ffb700 1 -- 172.21.15.149:0/2413308833 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f568c0546f0 con 0x7f569415e970 2023-11-08T19:22:59.473 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.472+0000 7f569b781700 1 -- 172.21.15.149:0/2413308833 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f56940745f0 con 0x7f569415e970 2023-11-08T19:22:59.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.472+0000 7f5689ffb700 1 -- 172.21.15.149:0/2413308833 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7f568c057d10 con 0x7f569415e970 2023-11-08T19:22:59.474 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:22:59.474 INFO:teuthology.orchestra.run.smithi149.stdout:[ 2023-11-08T19:22:59.474 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:22:59.475 INFO:teuthology.orchestra.run.smithi149.stdout: "poolnum": 1, 2023-11-08T19:22:59.475 INFO:teuthology.orchestra.run.smithi149.stdout: "poolname": ".mgr" 2023-11-08T19:22:59.475 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:22:59.475 INFO:teuthology.orchestra.run.smithi149.stdout:] 2023-11-08T19:22:59.476 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.474+0000 7f569b781700 1 -- 172.21.15.149:0/2413308833 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f567806ae70 msgr2=0x7f567806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:59.477 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.474+0000 7f569b781700 1 --2- 172.21.15.149:0/2413308833 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f567806ae70 0x7f567806d330 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f56940cbd20 tx=0x7f5684008070 comp rx=0 tx=0).stop 2023-11-08T19:22:59.477 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.474+0000 7f569b781700 1 -- 172.21.15.149:0/2413308833 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f569415e970 msgr2=0x7f56941f6e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:59.477 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.474+0000 7f569b781700 1 --2- 172.21.15.149:0/2413308833 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f569415e970 0x7f56941f6e90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f568c009fa0 tx=0x7f568c00d3b0 comp rx=0 tx=0).stop 2023-11-08T19:22:59.477 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.475+0000 7f569b781700 1 -- 172.21.15.149:0/2413308833 shutdown_connections 2023-11-08T19:22:59.477 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.475+0000 7f569b781700 1 --2- 172.21.15.149:0/2413308833 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f567806ae70 0x7f567806d330 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:59.478 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.475+0000 7f569b781700 1 --2- 172.21.15.149:0/2413308833 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f569415e970 0x7f56941f6e90 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:59.478 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.475+0000 7f569b781700 1 --2- 172.21.15.149:0/2413308833 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f56940d0430 0x7f56941573a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:59.478 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.475+0000 7f569b781700 1 --2- 172.21.15.149:0/2413308833 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f569415b950 0x7f569406d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:59.478 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.475+0000 7f569b781700 1 -- 172.21.15.149:0/2413308833 >> 172.21.15.149:0/2413308833 conn(0x7f569408afd0 msgr2=0x7f569415ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:22:59.478 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.475+0000 7f569b781700 1 -- 172.21.15.149:0/2413308833 shutdown_connections 2023-11-08T19:22:59.479 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.475+0000 7f569b781700 1 -- 172.21.15.149:0/2413308833 wait complete. 2023-11-08T19:22:59.488 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-08T19:22:59.488 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-08T19:22:59.612 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.611+0000 7fe5174e8700 1 Processor -- start 2023-11-08T19:22:59.613 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.611+0000 7fe5174e8700 1 -- start start 2023-11-08T19:22:59.615 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.612+0000 7fe5174e8700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe510072a40 0x7fe510072ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:59.615 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.612+0000 7fe5174e8700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe5100b20e0 0x7fe5100b2570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:59.615 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.612+0000 7fe5174e8700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe51015ac50 con 0x7fe51015a870 2023-11-08T19:22:59.616 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.612+0000 7fe5174e8700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5100d02b0 con 0x7fe5100b20e0 2023-11-08T19:22:59.616 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.612+0000 7fe5174e8700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5100cc450 con 0x7fe510072a40 2023-11-08T19:22:59.616 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.612+0000 7fe515a85700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe5100b20e0 0x7fe5100b2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:59.616 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.612+0000 7fe515a85700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe5100b20e0 0x7fe5100b2570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36664/0 (socket says 172.21.15.149:36664) 2023-11-08T19:22:59.616 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.612+0000 7fe515a85700 1 -- 172.21.15.149:0/687675349 learned_addr learned my addr 172.21.15.149:0/687675349 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:22:59.617 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.612+0000 7fe514a83700 1 --2- 172.21.15.149:0/687675349 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe510072a40 0x7fe510072ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:59.617 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.612+0000 7fe515a85700 1 -- 172.21.15.149:0/687675349 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe510072a40 msgr2=0x7fe510072ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:22:59.617 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.612+0000 7fe515a85700 1 --2- 172.21.15.149:0/687675349 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe510072a40 0x7fe510072ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:59.617 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.612+0000 7fe515a85700 1 -- 172.21.15.149:0/687675349 >> v1:172.21.15.160:6789/0 conn(0x7fe51015a870 legacy=0x7fe5100cbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:59.617 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.612+0000 7fe515a85700 1 -- 172.21.15.149:0/687675349 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe51006fe40 con 0x7fe5100b20e0 2023-11-08T19:22:59.618 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.612+0000 7fe514a83700 1 --2- 172.21.15.149:0/687675349 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe510072a40 0x7fe510072ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:22:59.618 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.613+0000 7fe515a85700 1 --2- 172.21.15.149:0/687675349 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5100b20e0 0x7fe5100b2570 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe50800d150 tx=0x7fe50800d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46851b2cff6330f1 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:22:59.618 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.613+0000 7fe507fff700 1 -- 172.21.15.149:0/687675349 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe508010070 con 0x7fe5100b20e0 2023-11-08T19:22:59.618 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.613+0000 7fe507fff700 1 -- 172.21.15.149:0/687675349 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe50800ddc0 con 0x7fe5100b20e0 2023-11-08T19:22:59.618 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.613+0000 7fe507fff700 1 -- 172.21.15.149:0/687675349 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50800b310 con 0x7fe5100b20e0 2023-11-08T19:22:59.619 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.613+0000 7fe5174e8700 1 -- 172.21.15.149:0/687675349 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5100b20e0 msgr2=0x7fe5100b2570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:59.619 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.613+0000 7fe5174e8700 1 --2- 172.21.15.149:0/687675349 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5100b20e0 0x7fe5100b2570 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe50800d150 tx=0x7fe50800d460 comp rx=0 tx=0).stop 2023-11-08T19:22:59.619 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.613+0000 7fe5174e8700 1 -- 172.21.15.149:0/687675349 shutdown_connections 2023-11-08T19:22:59.619 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.613+0000 7fe5174e8700 1 --2- 172.21.15.149:0/687675349 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5100b20e0 0x7fe5100b2570 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:59.619 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.613+0000 7fe5174e8700 1 --2- 172.21.15.149:0/687675349 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe510072a40 0x7fe510072ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:59.620 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.613+0000 7fe5174e8700 1 -- 172.21.15.149:0/687675349 >> 172.21.15.149:0/687675349 conn(0x7fe5100cd0e0 msgr2=0x7fe5100cd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:22:59.620 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.613+0000 7fe5174e8700 1 -- 172.21.15.149:0/687675349 shutdown_connections 2023-11-08T19:22:59.620 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.613+0000 7fe5174e8700 1 -- 172.21.15.149:0/687675349 wait complete. 2023-11-08T19:22:59.622 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.615+0000 7fe5174e8700 1 Processor -- start 2023-11-08T19:22:59.623 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.615+0000 7fe5174e8700 1 -- start start 2023-11-08T19:22:59.623 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.615+0000 7fe5174e8700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe510072a40 0x7fe5100c7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:59.623 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.615+0000 7fe5174e8700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5100b20e0 0x7fe51014eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:59.623 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.615+0000 7fe5174e8700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe51015a870 0x7fe5100c9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:59.624 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.615+0000 7fe5174e8700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5100c8d80 con 0x7fe5100b20e0 2023-11-08T19:22:59.624 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.615+0000 7fe5174e8700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5100c7ea0 con 0x7fe51015a870 2023-11-08T19:22:59.624 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.615+0000 7fe5174e8700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5100ac8c0 con 0x7fe510072a40 2023-11-08T19:22:59.624 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.615+0000 7fe514a83700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5100b20e0 0x7fe51014eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:59.624 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.615+0000 7fe514a83700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5100b20e0 0x7fe51014eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36668/0 (socket says 172.21.15.149:36668) 2023-11-08T19:22:59.625 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.615+0000 7fe515284700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe510072a40 0x7fe5100c7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:59.625 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.615+0000 7fe514a83700 1 -- 172.21.15.149:0/815852570 learned_addr learned my addr 172.21.15.149:0/815852570 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:22:59.625 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.615+0000 7fe515a85700 1 --2- 172.21.15.149:0/815852570 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe51015a870 0x7fe5100c9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:59.625 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.616+0000 7fe514a83700 1 -- 172.21.15.149:0/815852570 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe510072a40 msgr2=0x7fe5100c7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:59.625 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.616+0000 7fe514a83700 1 --2- 172.21.15.149:0/815852570 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe510072a40 0x7fe5100c7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:59.626 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.616+0000 7fe514a83700 1 -- 172.21.15.149:0/815852570 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe51015a870 msgr2=0x7fe5100c9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:22:59.626 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.616+0000 7fe514a83700 1 --2- 172.21.15.149:0/815852570 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe51015a870 0x7fe5100c9290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:22:59.626 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.616+0000 7fe514a83700 1 -- 172.21.15.149:0/815852570 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe50800bd40 con 0x7fe5100b20e0 2023-11-08T19:22:59.626 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.616+0000 7fe514a83700 1 --2- 172.21.15.149:0/815852570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5100b20e0 0x7fe51014eae0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe50c00e840 tx=0x7fe50c00eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:22:59.626 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.616+0000 7fe505ffb700 1 -- 172.21.15.149:0/815852570 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50c013610 con 0x7fe5100b20e0 2023-11-08T19:22:59.627 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.616+0000 7fe505ffb700 1 -- 172.21.15.149:0/815852570 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe50c013770 con 0x7fe5100b20e0 2023-11-08T19:22:59.627 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.616+0000 7fe5174e8700 1 -- 172.21.15.149:0/815852570 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe51014f020 con 0x7fe5100b20e0 2023-11-08T19:22:59.627 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.616+0000 7fe505ffb700 1 -- 172.21.15.149:0/815852570 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50c013b20 con 0x7fe5100b20e0 2023-11-08T19:22:59.627 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.616+0000 7fe5174e8700 1 -- 172.21.15.149:0/815852570 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5100acdf0 con 0x7fe5100b20e0 2023-11-08T19:22:59.627 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.617+0000 7fe5174e8700 1 -- 172.21.15.149:0/815852570 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5100b64e0 con 0x7fe5100b20e0 2023-11-08T19:22:59.628 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.618+0000 7fe505ffb700 1 -- 172.21.15.149:0/815852570 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7fe50c013c80 con 0x7fe5100b20e0 2023-11-08T19:22:59.628 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.618+0000 7fe505ffb700 1 --2- 172.21.15.149:0/815852570 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe4f406ae70 0x7fe4f406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:22:59.628 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.618+0000 7fe505ffb700 1 -- 172.21.15.149:0/815852570 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe50c088d00 con 0x7fe5100b20e0 2023-11-08T19:22:59.628 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.618+0000 7fe515284700 1 --2- 172.21.15.149:0/815852570 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe4f406ae70 0x7fe4f406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:22:59.628 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.618+0000 7fe515284700 1 --2- 172.21.15.149:0/815852570 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe4f406ae70 0x7fe4f406d330 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe500001800 tx=0x7fe500009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:22:59.629 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.623+0000 7fe505ffb700 1 -- 172.21.15.149:0/815852570 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe50c0541e0 con 0x7fe5100b20e0 2023-11-08T19:22:59.813 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:22:59.812+0000 7fe5174e8700 1 -- 172.21.15.149:0/815852570 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fe5100745f0 con 0x7fe5100b20e0 2023-11-08T19:23:00.511 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.510+0000 7fe505ffb700 1 -- 172.21.15.149:0/815852570 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7fe50c057800 con 0x7fe5100b20e0 2023-11-08T19:23:00.515 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.513+0000 7fe5174e8700 1 -- 172.21.15.149:0/815852570 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe4f406ae70 msgr2=0x7fe4f406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:00.515 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.513+0000 7fe5174e8700 1 --2- 172.21.15.149:0/815852570 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe4f406ae70 0x7fe4f406d330 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe500001800 tx=0x7fe500009040 comp rx=0 tx=0).stop 2023-11-08T19:23:00.515 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.513+0000 7fe5174e8700 1 -- 172.21.15.149:0/815852570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5100b20e0 msgr2=0x7fe51014eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:00.516 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.513+0000 7fe5174e8700 1 --2- 172.21.15.149:0/815852570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5100b20e0 0x7fe51014eae0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe50c00e840 tx=0x7fe50c00eb50 comp rx=0 tx=0).stop 2023-11-08T19:23:00.516 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.514+0000 7fe5174e8700 1 -- 172.21.15.149:0/815852570 shutdown_connections 2023-11-08T19:23:00.516 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.514+0000 7fe5174e8700 1 --2- 172.21.15.149:0/815852570 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe4f406ae70 0x7fe4f406d330 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:00.516 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.514+0000 7fe5174e8700 1 --2- 172.21.15.149:0/815852570 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe51015a870 0x7fe5100c9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:00.516 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.514+0000 7fe5174e8700 1 --2- 172.21.15.149:0/815852570 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe510072a40 0x7fe5100c7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:00.517 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.514+0000 7fe5174e8700 1 --2- 172.21.15.149:0/815852570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5100b20e0 0x7fe51014eae0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:00.517 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.514+0000 7fe5174e8700 1 -- 172.21.15.149:0/815852570 >> 172.21.15.149:0/815852570 conn(0x7fe5100cd0e0 msgr2=0x7fe5100af870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:00.517 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.514+0000 7fe5174e8700 1 -- 172.21.15.149:0/815852570 shutdown_connections 2023-11-08T19:23:00.517 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.514+0000 7fe5174e8700 1 -- 172.21.15.149:0/815852570 wait complete. 2023-11-08T19:23:00.520 INFO:teuthology.orchestra.run.smithi149.stderr:pool 'cephfs_metadata' created 2023-11-08T19:23:00.537 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-11-08T19:23:00.679 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.664+0000 7fa1340d7700 1 Processor -- start 2023-11-08T19:23:00.679 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.665+0000 7fa1340d7700 1 -- start start 2023-11-08T19:23:00.679 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.665+0000 7fa1340d7700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa12c15dc00 0x7fa12c0b27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:00.680 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.665+0000 7fa1340d7700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa12c15dfe0 con 0x7fa12c0cad20 2023-11-08T19:23:00.680 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.665+0000 7fa1340d7700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa12c0cb1e0 con 0x7fa12c06b290 2023-11-08T19:23:00.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.665+0000 7fa1340d7700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa12c0cbe60 con 0x7fa12c15dc00 2023-11-08T19:23:00.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.666+0000 7fa131672700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fa12c0cad20 0x7fa12c06ab80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:38678/0 (socket says 172.21.15.149:38678) 2023-11-08T19:23:00.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.666+0000 7fa131672700 1 -- 172.21.15.149:0/957930790 learned_addr learned my addr 172.21.15.149:0/957930790 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:23:00.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.666+0000 7fa131e73700 1 --2- 172.21.15.149:0/957930790 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa12c15dc00 0x7fa12c0b27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:00.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.666+0000 7fa130e71700 1 -- 172.21.15.149:0/957930790 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2648395766 0 0) 0x7fa12c15dfe0 con 0x7fa12c0cad20 2023-11-08T19:23:00.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.666+0000 7fa130e71700 1 -- 172.21.15.149:0/957930790 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1180035b0 con 0x7fa12c0cad20 2023-11-08T19:23:00.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.666+0000 7fa130e71700 1 -- 172.21.15.149:0/957930790 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4236324773 0 0) 0x7fa1180035b0 con 0x7fa12c0cad20 2023-11-08T19:23:00.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.666+0000 7fa130e71700 1 -- 172.21.15.149:0/957930790 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa12c15dc00 msgr2=0x7fa12c0b27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:00.684 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.666+0000 7fa130e71700 1 --2- 172.21.15.149:0/957930790 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa12c15dc00 0x7fa12c0b27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:00.684 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.666+0000 7fa130e71700 1 -- 172.21.15.149:0/957930790 >> v1:172.21.15.160:6789/0 conn(0x7fa12c06b290 legacy=0x7fa12c0cc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:00.684 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.666+0000 7fa130e71700 1 -- 172.21.15.149:0/957930790 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa12c0cb4c0 con 0x7fa12c0cad20 2023-11-08T19:23:00.685 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.666+0000 7fa130e71700 1 -- 172.21.15.149:0/957930790 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7fa128001670 con 0x7fa12c0cad20 2023-11-08T19:23:00.685 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.666+0000 7fa131e73700 1 --2- 172.21.15.149:0/957930790 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa12c15dc00 0x7fa12c0b27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:23:00.686 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.666+0000 7fa130e71700 1 -- 172.21.15.149:0/957930790 >> v1:172.21.15.149:6789/0 conn(0x7fa12c0cad20 legacy=0x7fa12c06ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:00.686 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.666+0000 7fa130e71700 1 --2- 172.21.15.149:0/957930790 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa118003a30 0x7fa118003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:00.686 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.666+0000 7fa130e71700 1 --2- 172.21.15.149:0/957930790 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa1180043e0 0x7fa1180048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:00.687 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.666+0000 7fa130e71700 1 --2- 172.21.15.149:0/957930790 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa12c15dc00 0x7fa1180050d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:00.687 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.666+0000 7fa130e71700 1 -- 172.21.15.149:0/957930790 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa12c0cbe60 con 0x7fa118003a30 2023-11-08T19:23:00.687 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.666+0000 7fa130e71700 1 -- 172.21.15.149:0/957930790 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa11800ba10 con 0x7fa1180043e0 2023-11-08T19:23:00.688 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.666+0000 7fa130e71700 1 -- 172.21.15.149:0/957930790 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa11800bb80 con 0x7fa12c15dc00 2023-11-08T19:23:00.688 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.666+0000 7fa131e73700 1 --2- 172.21.15.149:0/957930790 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa118003a30 0x7fa118003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:00.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.666+0000 7fa131672700 1 --2- 172.21.15.149:0/957930790 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa1180043e0 0x7fa1180048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:00.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.666+0000 7fa132674700 1 --2- 172.21.15.149:0/957930790 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa12c15dc00 0x7fa1180050d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:00.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.666+0000 7fa131e73700 1 -- 172.21.15.149:0/957930790 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa12c15dc00 msgr2=0x7fa1180050d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:00.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.666+0000 7fa131e73700 1 --2- 172.21.15.149:0/957930790 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa12c15dc00 0x7fa1180050d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:00.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.666+0000 7fa131e73700 1 -- 172.21.15.149:0/957930790 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa1180043e0 msgr2=0x7fa1180048b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:00.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.666+0000 7fa131e73700 1 --2- 172.21.15.149:0/957930790 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa1180043e0 0x7fa1180048b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:00.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.666+0000 7fa131e73700 1 -- 172.21.15.149:0/957930790 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa11c0094a0 con 0x7fa118003a30 2023-11-08T19:23:00.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.667+0000 7fa131e73700 1 --2- 172.21.15.149:0/957930790 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa118003a30 0x7fa118003e10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa11c009d30 tx=0x7fa118005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22ca04dfeee46e16 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:00.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.667+0000 7fa130e71700 1 -- 172.21.15.149:0/957930790 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11c009e80 con 0x7fa118003a30 2023-11-08T19:23:00.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.667+0000 7fa130e71700 1 -- 172.21.15.149:0/957930790 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa11c00e9a0 con 0x7fa118003a30 2023-11-08T19:23:00.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.667+0000 7fa130e71700 1 -- 172.21.15.149:0/957930790 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11c00ed10 con 0x7fa118003a30 2023-11-08T19:23:00.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.667+0000 7fa1340d7700 1 -- 172.21.15.149:0/957930790 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa118003a30 msgr2=0x7fa118003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:00.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.667+0000 7fa1340d7700 1 --2- 172.21.15.149:0/957930790 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa118003a30 0x7fa118003e10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa11c009d30 tx=0x7fa118005880 comp rx=0 tx=0).stop 2023-11-08T19:23:00.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.667+0000 7fa132674700 1 -- 172.21.15.149:0/957930790 reap_dead start 2023-11-08T19:23:00.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.667+0000 7fa1340d7700 1 -- 172.21.15.149:0/957930790 shutdown_connections 2023-11-08T19:23:00.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.667+0000 7fa1340d7700 1 -- 172.21.15.149:0/957930790 >> 172.21.15.149:0/957930790 conn(0x7fa12c06dfd0 msgr2=0x7fa12c06e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:00.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.667+0000 7fa1340d7700 1 -- 172.21.15.149:0/957930790 shutdown_connections 2023-11-08T19:23:00.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.667+0000 7fa1340d7700 1 -- 172.21.15.149:0/957930790 wait complete. 2023-11-08T19:23:00.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.669+0000 7fa1340d7700 1 Processor -- start 2023-11-08T19:23:00.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.669+0000 7fa1340d7700 1 -- start start 2023-11-08T19:23:00.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.669+0000 7fa1340d7700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa118003a30 0x7fa12c0c4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:00.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.669+0000 7fa1340d7700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa12c15b4d0 0x7fa12c0b1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:00.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.669+0000 7fa1340d7700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa12c1e72c0 0x7fa12c1e7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:00.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.669+0000 7fa1340d7700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa12c1e7c80 con 0x7fa12c15b4d0 2023-11-08T19:23:00.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.669+0000 7fa1340d7700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa12c15c100 con 0x7fa118003a30 2023-11-08T19:23:00.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.669+0000 7fa1340d7700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa12c15bc00 con 0x7fa12c1e72c0 2023-11-08T19:23:00.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.669+0000 7fa131672700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa12c15b4d0 0x7fa12c0b1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:00.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.669+0000 7fa131672700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa12c15b4d0 0x7fa12c0b1500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36688/0 (socket says 172.21.15.149:36688) 2023-11-08T19:23:00.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.669+0000 7fa131672700 1 -- 172.21.15.149:0/3521912287 learned_addr learned my addr 172.21.15.149:0/3521912287 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:00.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.669+0000 7fa131e73700 1 --2- 172.21.15.149:0/3521912287 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa118003a30 0x7fa12c0c4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:00.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.669+0000 7fa132674700 1 --2- 172.21.15.149:0/3521912287 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa12c1e72c0 0x7fa12c1e7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:00.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.670+0000 7fa131672700 1 -- 172.21.15.149:0/3521912287 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa12c1e72c0 msgr2=0x7fa12c1e7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:00.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.670+0000 7fa131672700 1 --2- 172.21.15.149:0/3521912287 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa12c1e72c0 0x7fa12c1e7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:00.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.670+0000 7fa131672700 1 -- 172.21.15.149:0/3521912287 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa118003a30 msgr2=0x7fa12c0c4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:00.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.670+0000 7fa131672700 1 --2- 172.21.15.149:0/3521912287 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa118003a30 0x7fa12c0c4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:00.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.670+0000 7fa131672700 1 -- 172.21.15.149:0/3521912287 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa12c0c4120 con 0x7fa12c15b4d0 2023-11-08T19:23:00.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.670+0000 7fa131672700 1 --2- 172.21.15.149:0/3521912287 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa12c15b4d0 0x7fa12c0b1500 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa1280017a0 tx=0x7fa128007570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:00.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.670+0000 7fa1227fc700 1 -- 172.21.15.149:0/3521912287 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa128011640 con 0x7fa12c15b4d0 2023-11-08T19:23:00.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.670+0000 7fa1227fc700 1 -- 172.21.15.149:0/3521912287 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1280117a0 con 0x7fa12c15b4d0 2023-11-08T19:23:00.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.670+0000 7fa1227fc700 1 -- 172.21.15.149:0/3521912287 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa128011b10 con 0x7fa12c15b4d0 2023-11-08T19:23:00.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.670+0000 7fa1340d7700 1 -- 172.21.15.149:0/3521912287 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa12c0c4400 con 0x7fa12c15b4d0 2023-11-08T19:23:00.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.670+0000 7fa1340d7700 1 -- 172.21.15.149:0/3521912287 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa12c0ca920 con 0x7fa12c15b4d0 2023-11-08T19:23:00.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.671+0000 7fa1340d7700 1 -- 172.21.15.149:0/3521912287 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa12c0c4610 con 0x7fa12c15b4d0 2023-11-08T19:23:00.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.671+0000 7fa1227fc700 1 -- 172.21.15.149:0/3521912287 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa128011c70 con 0x7fa12c15b4d0 2023-11-08T19:23:00.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.672+0000 7fa1227fc700 1 --2- 172.21.15.149:0/3521912287 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa11006af00 0x7fa11006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:00.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.672+0000 7fa131e73700 1 --2- 172.21.15.149:0/3521912287 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa11006af00 0x7fa11006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:00.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.672+0000 7fa1227fc700 1 -- 172.21.15.149:0/3521912287 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fa128089430 con 0x7fa12c15b4d0 2023-11-08T19:23:00.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.672+0000 7fa131e73700 1 --2- 172.21.15.149:0/3521912287 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa11006af00 0x7fa11006d3c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa11c0090b0 tx=0x7fa11c01f040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:00.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.677+0000 7fa1227fc700 1 -- 172.21.15.149:0/3521912287 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa1280546d0 con 0x7fa12c15b4d0 2023-11-08T19:23:00.870 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:00.868+0000 7fa1340d7700 1 -- 172.21.15.149:0/3521912287 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7fa12c04f730 con 0x7fa12c15b4d0 2023-11-08T19:23:01.519 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.518+0000 7fa1227fc700 1 -- 172.21.15.149:0/3521912287 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) v1 ==== 171+0+0 (secure 0 0 0) 0x7fa128057cf0 con 0x7fa12c15b4d0 2023-11-08T19:23:01.523 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.522+0000 7fa1340d7700 1 -- 172.21.15.149:0/3521912287 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa11006af00 msgr2=0x7fa11006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:01.523 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.522+0000 7fa1340d7700 1 --2- 172.21.15.149:0/3521912287 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa11006af00 0x7fa11006d3c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa11c0090b0 tx=0x7fa11c01f040 comp rx=0 tx=0).stop 2023-11-08T19:23:01.524 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.522+0000 7fa1340d7700 1 -- 172.21.15.149:0/3521912287 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa12c15b4d0 msgr2=0x7fa12c0b1500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:01.524 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.522+0000 7fa1340d7700 1 --2- 172.21.15.149:0/3521912287 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa12c15b4d0 0x7fa12c0b1500 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa1280017a0 tx=0x7fa128007570 comp rx=0 tx=0).stop 2023-11-08T19:23:01.525 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.523+0000 7fa1340d7700 1 -- 172.21.15.149:0/3521912287 shutdown_connections 2023-11-08T19:23:01.525 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.523+0000 7fa1340d7700 1 --2- 172.21.15.149:0/3521912287 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa11006af00 0x7fa11006d3c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:01.525 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.523+0000 7fa1340d7700 1 --2- 172.21.15.149:0/3521912287 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa118003a30 0x7fa12c0c4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:01.525 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.523+0000 7fa1340d7700 1 --2- 172.21.15.149:0/3521912287 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa12c1e72c0 0x7fa12c1e7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:01.526 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.523+0000 7fa1340d7700 1 --2- 172.21.15.149:0/3521912287 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa12c15b4d0 0x7fa12c0b1500 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:01.526 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.523+0000 7fa1340d7700 1 -- 172.21.15.149:0/3521912287 >> 172.21.15.149:0/3521912287 conn(0x7fa12c06dfd0 msgr2=0x7fa12c0b50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:01.526 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.523+0000 7fa1340d7700 1 -- 172.21.15.149:0/3521912287 shutdown_connections 2023-11-08T19:23:01.526 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.523+0000 7fa1340d7700 1 -- 172.21.15.149:0/3521912287 wait complete. 2023-11-08T19:23:01.527 INFO:teuthology.orchestra.run.smithi149.stderr:pool 'cephfs_data' created 2023-11-08T19:23:01.547 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-08T19:23:01.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.672+0000 7fb611703700 1 Processor -- start 2023-11-08T19:23:01.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.672+0000 7fb611703700 1 -- start start 2023-11-08T19:23:01.675 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.672+0000 7fb611703700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb60c15da50 0x7fb60c0d31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:01.675 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.672+0000 7fb611703700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb60c0d2110 con 0x7fb60c0ce600 2023-11-08T19:23:01.676 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.672+0000 7fb611703700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb60c0d23f0 con 0x7fb60c0d1c10 2023-11-08T19:23:01.676 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.672+0000 7fb611703700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb60c0d36f0 con 0x7fb60c15da50 2023-11-08T19:23:01.676 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.673+0000 7fb60affd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb60c15da50 0x7fb60c0d31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:01.676 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.673+0000 7fb60affd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb60c15da50 0x7fb60c0d31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36694/0 (socket says 172.21.15.149:36694) 2023-11-08T19:23:01.677 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.673+0000 7fb60affd700 1 -- 172.21.15.149:0/3869191524 learned_addr learned my addr 172.21.15.149:0/3869191524 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:01.677 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.673+0000 7fb60b7fe700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fb60c0ce600 0x7fb60c0cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:38698/0 (socket says 172.21.15.149:38698) 2023-11-08T19:23:01.677 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.673+0000 7fb60affd700 1 -- 172.21.15.149:0/3869191524 >> v1:172.21.15.160:6789/0 conn(0x7fb60c0d1c10 legacy=0x7fb60c0b9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:01.677 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.673+0000 7fb60affd700 1 -- 172.21.15.149:0/3869191524 >> v1:172.21.15.149:6789/0 conn(0x7fb60c0ce600 legacy=0x7fb60c0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:01.677 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.673+0000 7fb60affd700 1 -- 172.21.15.149:0/3869191524 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb60c0d26d0 con 0x7fb60c15da50 2023-11-08T19:23:01.678 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.673+0000 7fb60affd700 1 --2- 172.21.15.149:0/3869191524 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb60c15da50 0x7fb60c0d31b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc0098f0 tx=0x7fb5fc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2acb9cee9061bd6 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:01.678 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.673+0000 7fb609ffb700 1 -- 172.21.15.149:0/3869191524 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc004230 con 0x7fb60c15da50 2023-11-08T19:23:01.678 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.673+0000 7fb609ffb700 1 -- 172.21.15.149:0/3869191524 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5fc004390 con 0x7fb60c15da50 2023-11-08T19:23:01.678 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.673+0000 7fb609ffb700 1 -- 172.21.15.149:0/3869191524 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc0036a0 con 0x7fb60c15da50 2023-11-08T19:23:01.678 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.674+0000 7fb611703700 1 -- 172.21.15.149:0/3869191524 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb60c15da50 msgr2=0x7fb60c0d31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:01.679 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.674+0000 7fb611703700 1 --2- 172.21.15.149:0/3869191524 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb60c15da50 0x7fb60c0d31b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc0098f0 tx=0x7fb5fc009c00 comp rx=0 tx=0).stop 2023-11-08T19:23:01.679 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.674+0000 7fb611703700 1 -- 172.21.15.149:0/3869191524 shutdown_connections 2023-11-08T19:23:01.679 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.674+0000 7fb611703700 1 --2- 172.21.15.149:0/3869191524 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb60c15da50 0x7fb60c0d31b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:01.679 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.674+0000 7fb611703700 1 -- 172.21.15.149:0/3869191524 >> 172.21.15.149:0/3869191524 conn(0x7fb60c06bd60 msgr2=0x7fb60c06c140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:01.679 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.674+0000 7fb611703700 1 -- 172.21.15.149:0/3869191524 shutdown_connections 2023-11-08T19:23:01.679 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.674+0000 7fb611703700 1 -- 172.21.15.149:0/3869191524 wait complete. 2023-11-08T19:23:01.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.675+0000 7fb611703700 1 Processor -- start 2023-11-08T19:23:01.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.675+0000 7fb611703700 1 -- start start 2023-11-08T19:23:01.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.676+0000 7fb611703700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb60c0ce600 0x7fb60c15eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:01.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.676+0000 7fb611703700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb60c0d1c10 0x7fb60c0c6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:01.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.676+0000 7fb611703700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb60c15da50 0x7fb60c0c82e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:01.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.676+0000 7fb611703700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb60c15f5e0 con 0x7fb60c0d1c10 2023-11-08T19:23:01.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.676+0000 7fb611703700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb60c15f020 con 0x7fb60c15da50 2023-11-08T19:23:01.684 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.676+0000 7fb611703700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb60c0c69d0 con 0x7fb60c0ce600 2023-11-08T19:23:01.684 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.676+0000 7fb60a7fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb60c0d1c10 0x7fb60c0c6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:01.684 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.676+0000 7fb60a7fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb60c0d1c10 0x7fb60c0c6490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36702/0 (socket says 172.21.15.149:36702) 2023-11-08T19:23:01.684 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.676+0000 7fb60a7fc700 1 -- 172.21.15.149:0/2322437127 learned_addr learned my addr 172.21.15.149:0/2322437127 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:01.684 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.676+0000 7fb60affd700 1 --2- 172.21.15.149:0/2322437127 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb60c0ce600 0x7fb60c15eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:01.685 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.676+0000 7fb60b7fe700 1 --2- 172.21.15.149:0/2322437127 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb60c15da50 0x7fb60c0c82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:01.685 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.676+0000 7fb60a7fc700 1 -- 172.21.15.149:0/2322437127 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb60c0ce600 msgr2=0x7fb60c15eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:01.685 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.676+0000 7fb60a7fc700 1 --2- 172.21.15.149:0/2322437127 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb60c0ce600 0x7fb60c15eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:01.685 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.676+0000 7fb60a7fc700 1 -- 172.21.15.149:0/2322437127 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb60c15da50 msgr2=0x7fb60c0c82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:01.685 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.676+0000 7fb60a7fc700 1 --2- 172.21.15.149:0/2322437127 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb60c15da50 0x7fb60c0c82e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:01.686 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.676+0000 7fb60a7fc700 1 -- 172.21.15.149:0/2322437127 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5fc009550 con 0x7fb60c0d1c10 2023-11-08T19:23:01.686 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.676+0000 7fb60b7fe700 1 --2- 172.21.15.149:0/2322437127 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb60c15da50 0x7fb60c0c82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:23:01.686 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.676+0000 7fb60a7fc700 1 --2- 172.21.15.149:0/2322437127 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb60c0d1c10 0x7fb60c0c6490 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb60000c4a0 tx=0x7fb60000c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:01.686 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.676+0000 7fb5f37fe700 1 -- 172.21.15.149:0/2322437127 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb600011790 con 0x7fb60c0d1c10 2023-11-08T19:23:01.686 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.677+0000 7fb5f37fe700 1 -- 172.21.15.149:0/2322437127 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6000118f0 con 0x7fb60c0d1c10 2023-11-08T19:23:01.687 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.677+0000 7fb611703700 1 -- 172.21.15.149:0/2322437127 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb60c14e790 con 0x7fb60c0d1c10 2023-11-08T19:23:01.687 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.677+0000 7fb5f37fe700 1 -- 172.21.15.149:0/2322437127 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb600011ca0 con 0x7fb60c0d1c10 2023-11-08T19:23:01.687 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.677+0000 7fb611703700 1 -- 172.21.15.149:0/2322437127 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb60c1f7200 con 0x7fb60c0d1c10 2023-11-08T19:23:01.687 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.678+0000 7fb611703700 1 -- 172.21.15.149:0/2322437127 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb60c04f730 con 0x7fb60c0d1c10 2023-11-08T19:23:01.687 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.678+0000 7fb5f37fe700 1 -- 172.21.15.149:0/2322437127 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb60001c460 con 0x7fb60c0d1c10 2023-11-08T19:23:01.688 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.679+0000 7fb5f37fe700 1 --2- 172.21.15.149:0/2322437127 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb5f806af00 0x7fb5f806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:01.688 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.679+0000 7fb5f37fe700 1 -- 172.21.15.149:0/2322437127 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fb600089240 con 0x7fb60c0d1c10 2023-11-08T19:23:01.688 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.679+0000 7fb60affd700 1 --2- 172.21.15.149:0/2322437127 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb5f806af00 0x7fb5f806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:01.688 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.679+0000 7fb60affd700 1 --2- 172.21.15.149:0/2322437127 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb5f806af00 0x7fb5f806d3c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc009130 tx=0x7fb5fc008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:01.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.684+0000 7fb5f37fe700 1 -- 172.21.15.149:0/2322437127 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb6000543e0 con 0x7fb60c0d1c10 2023-11-08T19:23:01.917 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:01.916+0000 7fb611703700 1 -- 172.21.15.149:0/2322437127 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fb60c15f720 con 0x7fb60c0d1c10 2023-11-08T19:23:02.531 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.530+0000 7fb5f37fe700 1 -- 172.21.15.149:0/2322437127 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fb600057a00 con 0x7fb60c0d1c10 2023-11-08T19:23:02.535 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.534+0000 7fb611703700 1 -- 172.21.15.149:0/2322437127 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb5f806af00 msgr2=0x7fb5f806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:02.535 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.534+0000 7fb611703700 1 --2- 172.21.15.149:0/2322437127 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb5f806af00 0x7fb5f806d3c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc009130 tx=0x7fb5fc008030 comp rx=0 tx=0).stop 2023-11-08T19:23:02.535 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.534+0000 7fb611703700 1 -- 172.21.15.149:0/2322437127 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb60c0d1c10 msgr2=0x7fb60c0c6490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:02.535 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.534+0000 7fb611703700 1 --2- 172.21.15.149:0/2322437127 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb60c0d1c10 0x7fb60c0c6490 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb60000c4a0 tx=0x7fb60000c7b0 comp rx=0 tx=0).stop 2023-11-08T19:23:02.536 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.534+0000 7fb611703700 1 -- 172.21.15.149:0/2322437127 shutdown_connections 2023-11-08T19:23:02.536 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.534+0000 7fb611703700 1 --2- 172.21.15.149:0/2322437127 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb5f806af00 0x7fb5f806d3c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:02.537 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.534+0000 7fb611703700 1 --2- 172.21.15.149:0/2322437127 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb60c15da50 0x7fb60c0c82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:02.537 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.534+0000 7fb611703700 1 --2- 172.21.15.149:0/2322437127 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb60c0ce600 0x7fb60c15eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:02.537 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.534+0000 7fb611703700 1 --2- 172.21.15.149:0/2322437127 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb60c0d1c10 0x7fb60c0c6490 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:02.537 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.534+0000 7fb611703700 1 -- 172.21.15.149:0/2322437127 >> 172.21.15.149:0/2322437127 conn(0x7fb60c06bd60 msgr2=0x7fb60c0d00d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:02.537 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.535+0000 7fb611703700 1 -- 172.21.15.149:0/2322437127 shutdown_connections 2023-11-08T19:23:02.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.535+0000 7fb611703700 1 -- 172.21.15.149:0/2322437127 wait complete. 2023-11-08T19:23:02.541 INFO:teuthology.orchestra.run.smithi149.stderr:new fs with metadata pool 2 and data pool 3 2023-11-08T19:23:02.559 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-11-08T19:23:02.559 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-11-08T19:23:02.686 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.685+0000 7f6426ee1700 1 Processor -- start 2023-11-08T19:23:02.687 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.685+0000 7f6426ee1700 1 -- start start 2023-11-08T19:23:02.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.686+0000 7f6426ee1700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f642015dcd0 0x7f6420070470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:02.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.686+0000 7f6426ee1700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6420072cd0 0x7f642006ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:02.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.686+0000 7f6426ee1700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64200700d0 con 0x7f642006b0c0 2023-11-08T19:23:02.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.686+0000 7f6426ee1700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f642015e0b0 con 0x7f6420072cd0 2023-11-08T19:23:02.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.686+0000 7f6426ee1700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f642006b4f0 con 0x7f642015dcd0 2023-11-08T19:23:02.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.686+0000 7f641ffff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6420072cd0 0x7f642006ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:02.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.686+0000 7f641ffff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6420072cd0 0x7f642006ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36710/0 (socket says 172.21.15.149:36710) 2023-11-08T19:23:02.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.686+0000 7f641ffff700 1 -- 172.21.15.149:0/2757664297 learned_addr learned my addr 172.21.15.149:0/2757664297 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:02.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.686+0000 7f6424c7d700 1 --2- 172.21.15.149:0/2757664297 >> v2:172.21.15.160:3300/0 conn(0x7f642015dcd0 0x7f6420070470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:02.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.686+0000 7f641ffff700 1 -- 172.21.15.149:0/2757664297 >> v2:172.21.15.160:3300/0 conn(0x7f642015dcd0 msgr2=0x7f6420070470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:02.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.686+0000 7f641ffff700 1 --2- 172.21.15.149:0/2757664297 >> v2:172.21.15.160:3300/0 conn(0x7f642015dcd0 0x7f6420070470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:02.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.686+0000 7f641ffff700 1 -- 172.21.15.149:0/2757664297 >> v1:172.21.15.160:6789/0 conn(0x7f642006b0c0 legacy=0x7f64200b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:02.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.686+0000 7f641ffff700 1 -- 172.21.15.149:0/2757664297 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64200709b0 con 0x7f6420072cd0 2023-11-08T19:23:02.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.687+0000 7f641ffff700 1 --2- 172.21.15.149:0/2757664297 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6420072cd0 0x7f642006ab80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f64200cdd20 tx=0x7f640c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=721defea4e6e1696 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:02.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.687+0000 7f641f7fe700 1 -- 172.21.15.149:0/2757664297 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f640c004230 con 0x7f6420072cd0 2023-11-08T19:23:02.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.687+0000 7f641f7fe700 1 -- 172.21.15.149:0/2757664297 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f640c004390 con 0x7f6420072cd0 2023-11-08T19:23:02.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.687+0000 7f641f7fe700 1 -- 172.21.15.149:0/2757664297 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f640c0036a0 con 0x7f6420072cd0 2023-11-08T19:23:02.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.687+0000 7f6426ee1700 1 -- 172.21.15.149:0/2757664297 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6420072cd0 msgr2=0x7f642006ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:02.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.687+0000 7f6426ee1700 1 --2- 172.21.15.149:0/2757664297 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6420072cd0 0x7f642006ab80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f64200cdd20 tx=0x7f640c009bd0 comp rx=0 tx=0).stop 2023-11-08T19:23:02.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.687+0000 7f6426ee1700 1 -- 172.21.15.149:0/2757664297 shutdown_connections 2023-11-08T19:23:02.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.687+0000 7f6426ee1700 1 --2- 172.21.15.149:0/2757664297 >> v2:172.21.15.160:3300/0 conn(0x7f642015dcd0 0x7f6420070470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:02.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.687+0000 7f6426ee1700 1 --2- 172.21.15.149:0/2757664297 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6420072cd0 0x7f642006ab80 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:02.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.687+0000 7f6426ee1700 1 -- 172.21.15.149:0/2757664297 >> 172.21.15.149:0/2757664297 conn(0x7f64200cd0e0 msgr2=0x7f64200cd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:02.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.687+0000 7f6426ee1700 1 -- 172.21.15.149:0/2757664297 shutdown_connections 2023-11-08T19:23:02.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.687+0000 7f6426ee1700 1 -- 172.21.15.149:0/2757664297 wait complete. 2023-11-08T19:23:02.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.688+0000 7f6426ee1700 1 Processor -- start 2023-11-08T19:23:02.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.688+0000 7f6426ee1700 1 -- start start 2023-11-08T19:23:02.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.689+0000 7f6426ee1700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f642006b0c0 0x7f642014dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:02.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.689+0000 7f6426ee1700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6420072cd0 0x7f64200c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:02.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.689+0000 7f6426ee1700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f642015dcd0 0x7f64200d0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:02.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.689+0000 7f6426ee1700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64200b4da0 con 0x7f642015dcd0 2023-11-08T19:23:02.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.689+0000 7f6426ee1700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64200b4240 con 0x7f6420072cd0 2023-11-08T19:23:02.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.689+0000 7f6426ee1700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f642014e110 con 0x7f642006b0c0 2023-11-08T19:23:02.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.689+0000 7f642547e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f642015dcd0 0x7f64200d0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:02.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.689+0000 7f642547e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f642015dcd0 0x7f64200d0660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36718/0 (socket says 172.21.15.149:36718) 2023-11-08T19:23:02.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.689+0000 7f642547e700 1 -- 172.21.15.149:0/3426486748 learned_addr learned my addr 172.21.15.149:0/3426486748 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:02.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.690+0000 7f6424c7d700 1 --2- 172.21.15.149:0/3426486748 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f642006b0c0 0x7f642014dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:02.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.690+0000 7f641ffff700 1 --2- 172.21.15.149:0/3426486748 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6420072cd0 0x7f64200c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:02.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.690+0000 7f642547e700 1 -- 172.21.15.149:0/3426486748 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f642006b0c0 msgr2=0x7f642014dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:02.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.690+0000 7f642547e700 1 --2- 172.21.15.149:0/3426486748 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f642006b0c0 0x7f642014dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:02.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.690+0000 7f642547e700 1 -- 172.21.15.149:0/3426486748 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6420072cd0 msgr2=0x7f64200c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:02.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.690+0000 7f642547e700 1 --2- 172.21.15.149:0/3426486748 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6420072cd0 0x7f64200c9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:02.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.690+0000 7f642547e700 1 -- 172.21.15.149:0/3426486748 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f640c009550 con 0x7f642015dcd0 2023-11-08T19:23:02.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.690+0000 7f642547e700 1 --2- 172.21.15.149:0/3426486748 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f642015dcd0 0x7f64200d0660 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f641800cc10 tx=0x7f641800cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:02.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.690+0000 7f641d7fa700 1 -- 172.21.15.149:0/3426486748 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641800aa60 con 0x7f642015dcd0 2023-11-08T19:23:02.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.690+0000 7f641d7fa700 1 -- 172.21.15.149:0/3426486748 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f641800abc0 con 0x7f642015dcd0 2023-11-08T19:23:02.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.690+0000 7f6426ee1700 1 -- 172.21.15.149:0/3426486748 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64200b36c0 con 0x7f642015dcd0 2023-11-08T19:23:02.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.690+0000 7f641d7fa700 1 -- 172.21.15.149:0/3426486748 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6418012420 con 0x7f642015dcd0 2023-11-08T19:23:02.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.690+0000 7f6426ee1700 1 -- 172.21.15.149:0/3426486748 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64200b3c80 con 0x7f642015dcd0 2023-11-08T19:23:02.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.691+0000 7f6426ee1700 1 -- 172.21.15.149:0/3426486748 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64200b0af0 con 0x7f642015dcd0 2023-11-08T19:23:02.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.691+0000 7f641d7fa700 1 -- 172.21.15.149:0/3426486748 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6418012580 con 0x7f642015dcd0 2023-11-08T19:23:02.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.692+0000 7f641d7fa700 1 --2- 172.21.15.149:0/3426486748 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f640406af00 0x7f640406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:02.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.692+0000 7f641d7fa700 1 -- 172.21.15.149:0/3426486748 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6418089850 con 0x7f642015dcd0 2023-11-08T19:23:02.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.692+0000 7f6424c7d700 1 --2- 172.21.15.149:0/3426486748 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f640406af00 0x7f640406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:02.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.692+0000 7f6424c7d700 1 --2- 172.21.15.149:0/3426486748 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f640406af00 0x7f640406d3c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f64200b45b0 tx=0x7f6414008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:02.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.697+0000 7f641d7fa700 1 -- 172.21.15.149:0/3426486748 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6418054990 con 0x7f642015dcd0 2023-11-08T19:23:02.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:02.894+0000 7f6426ee1700 1 -- 172.21.15.149:0/3426486748 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f64200745f0 con 0x7f642015dcd0 2023-11-08T19:23:03.535 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.534+0000 7f641d7fa700 1 -- 172.21.15.149:0/3426486748 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) v1 ==== 157+0+0 (secure 0 0 0) 0x7f6418057fb0 con 0x7f642015dcd0 2023-11-08T19:23:03.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.537+0000 7f6426ee1700 1 -- 172.21.15.149:0/3426486748 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f640406af00 msgr2=0x7f640406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:03.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.537+0000 7f6426ee1700 1 --2- 172.21.15.149:0/3426486748 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f640406af00 0x7f640406d3c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f64200b45b0 tx=0x7f6414008040 comp rx=0 tx=0).stop 2023-11-08T19:23:03.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.537+0000 7f6426ee1700 1 -- 172.21.15.149:0/3426486748 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f642015dcd0 msgr2=0x7f64200d0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:03.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.537+0000 7f6426ee1700 1 --2- 172.21.15.149:0/3426486748 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f642015dcd0 0x7f64200d0660 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f641800cc10 tx=0x7f641800cf20 comp rx=0 tx=0).stop 2023-11-08T19:23:03.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.537+0000 7f6426ee1700 1 -- 172.21.15.149:0/3426486748 shutdown_connections 2023-11-08T19:23:03.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.537+0000 7f6426ee1700 1 --2- 172.21.15.149:0/3426486748 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f640406af00 0x7f640406d3c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:03.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.537+0000 7f6426ee1700 1 --2- 172.21.15.149:0/3426486748 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f642015dcd0 0x7f64200d0660 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:03.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.537+0000 7f6426ee1700 1 --2- 172.21.15.149:0/3426486748 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f642006b0c0 0x7f642014dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:03.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.537+0000 7f6426ee1700 1 --2- 172.21.15.149:0/3426486748 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6420072cd0 0x7f64200c9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:03.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.537+0000 7f6426ee1700 1 -- 172.21.15.149:0/3426486748 >> 172.21.15.149:0/3426486748 conn(0x7f64200cd0e0 msgr2=0x7f642015ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:03.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.537+0000 7f6426ee1700 1 -- 172.21.15.149:0/3426486748 shutdown_connections 2023-11-08T19:23:03.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.537+0000 7f6426ee1700 1 -- 172.21.15.149:0/3426486748 wait complete. 2023-11-08T19:23:03.553 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-11-08T19:23:03.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.682+0000 7fbe0ff0f700 1 Processor -- start 2023-11-08T19:23:03.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.682+0000 7fbe0ff0f700 1 -- start start 2023-11-08T19:23:03.687 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.683+0000 7fbe0ff0f700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fbe0815a710 0x7fbe080cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:03.688 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.683+0000 7fbe0ff0f700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe080b3470 con 0x7fbe08072ab0 2023-11-08T19:23:03.688 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.683+0000 7fbe0ff0f700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe080703c0 con 0x7fbe080b27b0 2023-11-08T19:23:03.688 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.683+0000 7fbe0ff0f700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe08073270 con 0x7fbe0815a710 2023-11-08T19:23:03.688 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.683+0000 7fbe0d4aa700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fbe08072ab0 0x7fbe080b20a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:38724/0 (socket says 172.21.15.149:38724) 2023-11-08T19:23:03.688 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.683+0000 7fbe0d4aa700 1 -- 172.21.15.149:0/1346603381 learned_addr learned my addr 172.21.15.149:0/1346603381 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:23:03.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.683+0000 7fbe0dcab700 1 --2- 172.21.15.149:0/1346603381 >> v2:172.21.15.160:3300/0 conn(0x7fbe0815a710 0x7fbe080cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:03.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.683+0000 7fbe0cca9700 1 -- 172.21.15.149:0/1346603381 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 550449065 0 0) 0x7fbe080b3470 con 0x7fbe08072ab0 2023-11-08T19:23:03.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.683+0000 7fbe0cca9700 1 -- 172.21.15.149:0/1346603381 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdf40035b0 con 0x7fbe08072ab0 2023-11-08T19:23:03.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.684+0000 7fbe0cca9700 1 -- 172.21.15.149:0/1346603381 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 529417729 0 0) 0x7fbdf40035b0 con 0x7fbe08072ab0 2023-11-08T19:23:03.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.684+0000 7fbe0cca9700 1 -- 172.21.15.149:0/1346603381 >> v2:172.21.15.160:3300/0 conn(0x7fbe0815a710 msgr2=0x7fbe080cfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:03.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.684+0000 7fbe0cca9700 1 --2- 172.21.15.149:0/1346603381 >> v2:172.21.15.160:3300/0 conn(0x7fbe0815a710 0x7fbe080cfe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:03.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.684+0000 7fbe0cca9700 1 -- 172.21.15.149:0/1346603381 >> v1:172.21.15.160:6789/0 conn(0x7fbe080b27b0 legacy=0x7fbe080cbd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:03.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.684+0000 7fbe0cca9700 1 -- 172.21.15.149:0/1346603381 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe0806fa90 con 0x7fbe08072ab0 2023-11-08T19:23:03.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.684+0000 7fbe0cca9700 1 -- 172.21.15.149:0/1346603381 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7fbe04001670 con 0x7fbe08072ab0 2023-11-08T19:23:03.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.684+0000 7fbe0cca9700 1 -- 172.21.15.149:0/1346603381 >> v1:172.21.15.149:6789/0 conn(0x7fbe08072ab0 legacy=0x7fbe080b20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:03.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.684+0000 7fbe0cca9700 1 --2- 172.21.15.149:0/1346603381 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbdf4003a00 0x7fbdf4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:03.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.684+0000 7fbe0cca9700 1 --2- 172.21.15.149:0/1346603381 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbdf4004850 0x7fbdf4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:03.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.684+0000 7fbe0cca9700 1 --2- 172.21.15.149:0/1346603381 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbdf4005210 0x7fbdf400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:03.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.684+0000 7fbe0cca9700 1 -- 172.21.15.149:0/1346603381 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe08073270 con 0x7fbdf4003a00 2023-11-08T19:23:03.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.684+0000 7fbe0cca9700 1 -- 172.21.15.149:0/1346603381 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf400c1b0 con 0x7fbdf4005210 2023-11-08T19:23:03.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.684+0000 7fbe0cca9700 1 -- 172.21.15.149:0/1346603381 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf400e580 con 0x7fbdf4004850 2023-11-08T19:23:03.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.684+0000 7fbe0dcab700 1 --2- 172.21.15.149:0/1346603381 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbdf4003a00 0x7fbdf4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:03.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.684+0000 7fbe0d4aa700 1 --2- 172.21.15.149:0/1346603381 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbdf4004850 0x7fbdf4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:03.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.684+0000 7fbe0e4ac700 1 --2- 172.21.15.149:0/1346603381 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbdf4005210 0x7fbdf400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:03.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.684+0000 7fbe0dcab700 1 -- 172.21.15.149:0/1346603381 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbdf4004850 msgr2=0x7fbdf4004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:03.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.684+0000 7fbe0dcab700 1 --2- 172.21.15.149:0/1346603381 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbdf4004850 0x7fbdf4004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:03.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.684+0000 7fbe0dcab700 1 -- 172.21.15.149:0/1346603381 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbdf4005210 msgr2=0x7fbdf400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:03.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.684+0000 7fbe0dcab700 1 --2- 172.21.15.149:0/1346603381 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbdf4005210 0x7fbdf400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:03.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.684+0000 7fbe0e4ac700 1 -- 172.21.15.149:0/1346603381 reap_dead start 2023-11-08T19:23:03.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.684+0000 7fbe0dcab700 1 -- 172.21.15.149:0/1346603381 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf40035b0 con 0x7fbdf4003a00 2023-11-08T19:23:03.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.684+0000 7fbe0dcab700 1 --2- 172.21.15.149:0/1346603381 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbdf4003a00 0x7fbdf4003e20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8009b60 tx=0x7fbdf4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ae00a1a49f09382 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:03.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.684+0000 7fbe0cca9700 1 -- 172.21.15.149:0/1346603381 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf800e6c0 con 0x7fbdf4003a00 2023-11-08T19:23:03.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.684+0000 7fbe0cca9700 1 -- 172.21.15.149:0/1346603381 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf800e820 con 0x7fbdf4003a00 2023-11-08T19:23:03.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.684+0000 7fbe0cca9700 1 -- 172.21.15.149:0/1346603381 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf800eb90 con 0x7fbdf4003a00 2023-11-08T19:23:03.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.685+0000 7fbe0ff0f700 1 -- 172.21.15.149:0/1346603381 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbdf4003a00 msgr2=0x7fbdf4003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:03.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.685+0000 7fbe0ff0f700 1 --2- 172.21.15.149:0/1346603381 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbdf4003a00 0x7fbdf4003e20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8009b60 tx=0x7fbdf4005880 comp rx=0 tx=0).stop 2023-11-08T19:23:03.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.685+0000 7fbe0ff0f700 1 -- 172.21.15.149:0/1346603381 shutdown_connections 2023-11-08T19:23:03.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.685+0000 7fbe0ff0f700 1 --2- 172.21.15.149:0/1346603381 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbdf4003a00 0x7fbdf4003e20 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:03.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.685+0000 7fbe0ff0f700 1 -- 172.21.15.149:0/1346603381 >> 172.21.15.149:0/1346603381 conn(0x7fbe080cd0a0 msgr2=0x7fbe080cd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:03.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.685+0000 7fbe0ff0f700 1 -- 172.21.15.149:0/1346603381 shutdown_connections 2023-11-08T19:23:03.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.685+0000 7fbe0ff0f700 1 -- 172.21.15.149:0/1346603381 wait complete. 2023-11-08T19:23:03.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.686+0000 7fbe0ff0f700 1 Processor -- start 2023-11-08T19:23:03.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.686+0000 7fbe0ff0f700 1 -- start start 2023-11-08T19:23:03.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.687+0000 7fbe0ff0f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbdf4003a00 0x7fbe08157ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:03.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.687+0000 7fbe0ff0f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe080c6cf0 0x7fbe081ef130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:03.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.687+0000 7fbe0ff0f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe0815d380 0x7fbe0815d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:03.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.687+0000 7fbe0ff0f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0815cef0 con 0x7fbe080c6cf0 2023-11-08T19:23:03.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.687+0000 7fbe0ff0f700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe081ef9f0 con 0x7fbe0815d380 2023-11-08T19:23:03.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.687+0000 7fbe0ff0f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe081efcd0 con 0x7fbdf4003a00 2023-11-08T19:23:03.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.687+0000 7fbe0d4aa700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe080c6cf0 0x7fbe081ef130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:03.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.687+0000 7fbe0d4aa700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe080c6cf0 0x7fbe081ef130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36734/0 (socket says 172.21.15.149:36734) 2023-11-08T19:23:03.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.687+0000 7fbe0d4aa700 1 -- 172.21.15.149:0/2797333934 learned_addr learned my addr 172.21.15.149:0/2797333934 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:03.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.687+0000 7fbe0dcab700 1 --2- 172.21.15.149:0/2797333934 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbdf4003a00 0x7fbe08157ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:03.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.687+0000 7fbe0e4ac700 1 --2- 172.21.15.149:0/2797333934 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe0815d380 0x7fbe0815d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:03.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.687+0000 7fbe0d4aa700 1 -- 172.21.15.149:0/2797333934 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbdf4003a00 msgr2=0x7fbe08157ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:03.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.687+0000 7fbe0d4aa700 1 --2- 172.21.15.149:0/2797333934 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbdf4003a00 0x7fbe08157ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:03.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.687+0000 7fbe0d4aa700 1 -- 172.21.15.149:0/2797333934 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe0815d380 msgr2=0x7fbe0815d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:03.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.687+0000 7fbe0d4aa700 1 --2- 172.21.15.149:0/2797333934 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe0815d380 0x7fbe0815d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:03.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.687+0000 7fbe0d4aa700 1 -- 172.21.15.149:0/2797333934 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe0815cb80 con 0x7fbe080c6cf0 2023-11-08T19:23:03.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.688+0000 7fbe0d4aa700 1 --2- 172.21.15.149:0/2797333934 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe080c6cf0 0x7fbe081ef130 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbe04007290 tx=0x7fbe040075a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:03.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.688+0000 7fbdfe7fc700 1 -- 172.21.15.149:0/2797333934 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0400f5e0 con 0x7fbe080c6cf0 2023-11-08T19:23:03.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.688+0000 7fbdfe7fc700 1 -- 172.21.15.149:0/2797333934 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe0400f780 con 0x7fbe080c6cf0 2023-11-08T19:23:03.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.688+0000 7fbe0ff0f700 1 -- 172.21.15.149:0/2797333934 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe08158000 con 0x7fbe080c6cf0 2023-11-08T19:23:03.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.688+0000 7fbdfe7fc700 1 -- 172.21.15.149:0/2797333934 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0400fb30 con 0x7fbe080c6cf0 2023-11-08T19:23:03.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.688+0000 7fbe0ff0f700 1 -- 172.21.15.149:0/2797333934 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe0815aaf0 con 0x7fbe080c6cf0 2023-11-08T19:23:03.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.689+0000 7fbe0ff0f700 1 -- 172.21.15.149:0/2797333934 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe080745f0 con 0x7fbe080c6cf0 2023-11-08T19:23:03.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.689+0000 7fbdfe7fc700 1 -- 172.21.15.149:0/2797333934 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbe0400fc90 con 0x7fbe080c6cf0 2023-11-08T19:23:03.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.690+0000 7fbdfe7fc700 1 --2- 172.21.15.149:0/2797333934 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fbdec06af00 0x7fbdec06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:03.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.690+0000 7fbe0dcab700 1 --2- 172.21.15.149:0/2797333934 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fbdec06af00 0x7fbdec06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:03.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.690+0000 7fbdfe7fc700 1 -- 172.21.15.149:0/2797333934 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5935+0+0 (secure 0 0 0) 0x7fbe040895e0 con 0x7fbe080c6cf0 2023-11-08T19:23:03.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.690+0000 7fbe0dcab700 1 --2- 172.21.15.149:0/2797333934 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fbdec06af00 0x7fbdec06d3c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbdf80090b0 tx=0x7fbdf801f040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:03.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.694+0000 7fbdfe7fc700 1 -- 172.21.15.149:0/2797333934 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbe040545b0 con 0x7fbe080c6cf0 2023-11-08T19:23:03.884 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:03.883+0000 7fbe0ff0f700 1 -- 172.21.15.149:0/2797333934 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fbe0806b1e0 con 0x7fbe080c6cf0 2023-11-08T19:23:05.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.556+0000 7fbdfe7fc700 1 -- 172.21.15.149:0/2797333934 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) v1 ==== 228+0+0 (secure 0 0 0) 0x7fbe04057bd0 con 0x7fbe080c6cf0 2023-11-08T19:23:05.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.561+0000 7fbe0ff0f700 1 -- 172.21.15.149:0/2797333934 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fbdec06af00 msgr2=0x7fbdec06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:05.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.561+0000 7fbe0ff0f700 1 --2- 172.21.15.149:0/2797333934 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fbdec06af00 0x7fbdec06d3c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbdf80090b0 tx=0x7fbdf801f040 comp rx=0 tx=0).stop 2023-11-08T19:23:05.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.561+0000 7fbe0ff0f700 1 -- 172.21.15.149:0/2797333934 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe080c6cf0 msgr2=0x7fbe081ef130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:05.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.561+0000 7fbe0ff0f700 1 --2- 172.21.15.149:0/2797333934 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe080c6cf0 0x7fbe081ef130 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbe04007290 tx=0x7fbe040075a0 comp rx=0 tx=0).stop 2023-11-08T19:23:05.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.561+0000 7fbe0ff0f700 1 -- 172.21.15.149:0/2797333934 shutdown_connections 2023-11-08T19:23:05.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.561+0000 7fbe0ff0f700 1 --2- 172.21.15.149:0/2797333934 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fbdec06af00 0x7fbdec06d3c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:05.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.561+0000 7fbe0ff0f700 1 --2- 172.21.15.149:0/2797333934 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe0815d380 0x7fbe0815d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:05.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.561+0000 7fbe0ff0f700 1 --2- 172.21.15.149:0/2797333934 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbdf4003a00 0x7fbe08157ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:05.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.561+0000 7fbe0ff0f700 1 --2- 172.21.15.149:0/2797333934 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe080c6cf0 0x7fbe081ef130 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:05.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.561+0000 7fbe0ff0f700 1 -- 172.21.15.149:0/2797333934 >> 172.21.15.149:0/2797333934 conn(0x7fbe080cd0a0 msgr2=0x7fbe080cd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:05.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.561+0000 7fbe0ff0f700 1 -- 172.21.15.149:0/2797333934 shutdown_connections 2023-11-08T19:23:05.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.561+0000 7fbe0ff0f700 1 -- 172.21.15.149:0/2797333934 wait complete. 2023-11-08T19:23:05.570 INFO:teuthology.orchestra.run.smithi149.stderr:pool 'cephfs_data_ec' created 2023-11-08T19:23:05.582 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-11-08T19:23:05.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.707+0000 7f05c33f9700 1 Processor -- start 2023-11-08T19:23:05.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.707+0000 7f05c33f9700 1 -- start start 2023-11-08T19:23:05.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.708+0000 7f05c33f9700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f05bc15b8e0 0x7f05bc15fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:05.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.708+0000 7f05c33f9700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f05bc0cbdb0 0x7f05bc0b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:05.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.708+0000 7f05c33f9700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05bc0b3720 0x7f05bc070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:05.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.708+0000 7f05c33f9700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05bc0b7290 con 0x7f05bc15b8e0 2023-11-08T19:23:05.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.708+0000 7f05c33f9700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05bc0cf330 con 0x7f05bc0cbdb0 2023-11-08T19:23:05.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.708+0000 7f05c33f9700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05bc0b3b50 con 0x7f05bc0b3720 2023-11-08T19:23:05.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.708+0000 7f05c1195700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f05bc15b8e0 0x7f05bc15fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:05.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.708+0000 7f05c1195700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f05bc15b8e0 0x7f05bc15fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36742/0 (socket says 172.21.15.149:36742) 2023-11-08T19:23:05.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.708+0000 7f05c1195700 1 -- 172.21.15.149:0/3198723489 learned_addr learned my addr 172.21.15.149:0/3198723489 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:05.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.708+0000 7f05c1195700 1 -- 172.21.15.149:0/3198723489 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05bc0b3720 msgr2=0x7f05bc070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:05.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.708+0000 7f05c1195700 1 --2- 172.21.15.149:0/3198723489 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05bc0b3720 0x7f05bc070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:05.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.708+0000 7f05c1195700 1 -- 172.21.15.149:0/3198723489 >> v2:172.21.15.160:3300/0 conn(0x7f05bc0cbdb0 msgr2=0x7f05bc0b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:05.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.708+0000 7f05c0994700 1 --2- 172.21.15.149:0/3198723489 >> v2:172.21.15.160:3300/0 conn(0x7f05bc0cbdb0 0x7f05bc0b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:05.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.708+0000 7f05c1195700 1 --2- 172.21.15.149:0/3198723489 >> v2:172.21.15.160:3300/0 conn(0x7f05bc0cbdb0 0x7f05bc0b31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:05.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.708+0000 7f05c1195700 1 -- 172.21.15.149:0/3198723489 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05bc1603d0 con 0x7f05bc15b8e0 2023-11-08T19:23:05.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.708+0000 7f05c1195700 1 --2- 172.21.15.149:0/3198723489 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05bc15b8e0 0x7f05bc15fe90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f05bc0b3ec0 tx=0x7f05b8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cc10005b2cd834b server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:05.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.708+0000 7f05b3fff700 1 -- 172.21.15.149:0/3198723489 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b800b870 con 0x7f05bc15b8e0 2023-11-08T19:23:05.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.709+0000 7f05b3fff700 1 -- 172.21.15.149:0/3198723489 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b800b9d0 con 0x7f05bc15b8e0 2023-11-08T19:23:05.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.709+0000 7f05b3fff700 1 -- 172.21.15.149:0/3198723489 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b800bd60 con 0x7f05bc15b8e0 2023-11-08T19:23:05.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.709+0000 7f05c33f9700 1 -- 172.21.15.149:0/3198723489 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05bc15b8e0 msgr2=0x7f05bc15fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:05.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.709+0000 7f05c33f9700 1 --2- 172.21.15.149:0/3198723489 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05bc15b8e0 0x7f05bc15fe90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f05bc0b3ec0 tx=0x7f05b8009bd0 comp rx=0 tx=0).stop 2023-11-08T19:23:05.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.709+0000 7f05c33f9700 1 -- 172.21.15.149:0/3198723489 shutdown_connections 2023-11-08T19:23:05.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.709+0000 7f05c33f9700 1 --2- 172.21.15.149:0/3198723489 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05bc0b3720 0x7f05bc070b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:05.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.709+0000 7f05c33f9700 1 --2- 172.21.15.149:0/3198723489 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05bc15b8e0 0x7f05bc15fe90 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:05.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.709+0000 7f05c33f9700 1 --2- 172.21.15.149:0/3198723489 >> v2:172.21.15.160:3300/0 conn(0x7f05bc0cbdb0 0x7f05bc0b31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:05.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.709+0000 7f05c33f9700 1 -- 172.21.15.149:0/3198723489 >> 172.21.15.149:0/3198723489 conn(0x7f05bc0ce1e0 msgr2=0x7f05bc0ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:05.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.709+0000 7f05c33f9700 1 -- 172.21.15.149:0/3198723489 shutdown_connections 2023-11-08T19:23:05.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.709+0000 7f05c33f9700 1 -- 172.21.15.149:0/3198723489 wait complete. 2023-11-08T19:23:05.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.710+0000 7f05c33f9700 1 Processor -- start 2023-11-08T19:23:05.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.710+0000 7f05c33f9700 1 -- start start 2023-11-08T19:23:05.722 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.711+0000 7f05c33f9700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05bc0b3720 0x7f05bc155ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:05.722 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.711+0000 7f05c33f9700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05bc0cbdb0 0x7f05bc0c91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:05.722 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.711+0000 7f05c33f9700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05bc15b8e0 0x7f05bc0b58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:05.723 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.711+0000 7f05c33f9700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05bc0c9e60 con 0x7f05bc0cbdb0 2023-11-08T19:23:05.723 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.711+0000 7f05c33f9700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05bc1f45d0 con 0x7f05bc15b8e0 2023-11-08T19:23:05.723 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.711+0000 7f05c33f9700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05bc0c9b80 con 0x7f05bc0b3720 2023-11-08T19:23:05.724 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.711+0000 7f05c0994700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05bc0cbdb0 0x7f05bc0c91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:05.725 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.711+0000 7f05c0994700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05bc0cbdb0 0x7f05bc0c91a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36750/0 (socket says 172.21.15.149:36750) 2023-11-08T19:23:05.725 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.711+0000 7f05c0994700 1 -- 172.21.15.149:0/492694107 learned_addr learned my addr 172.21.15.149:0/492694107 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:05.725 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.711+0000 7f05c1195700 1 --2- 172.21.15.149:0/492694107 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05bc0b3720 0x7f05bc155ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:05.726 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.711+0000 7f05c1996700 1 --2- 172.21.15.149:0/492694107 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05bc15b8e0 0x7f05bc0b58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:05.726 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.711+0000 7f05c0994700 1 -- 172.21.15.149:0/492694107 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05bc0b3720 msgr2=0x7f05bc155ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:05.726 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.711+0000 7f05c0994700 1 --2- 172.21.15.149:0/492694107 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05bc0b3720 0x7f05bc155ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:05.727 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.711+0000 7f05c0994700 1 -- 172.21.15.149:0/492694107 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05bc15b8e0 msgr2=0x7f05bc0b58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:05.727 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.711+0000 7f05c0994700 1 --2- 172.21.15.149:0/492694107 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05bc15b8e0 0x7f05bc0b58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:05.727 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.711+0000 7f05c0994700 1 -- 172.21.15.149:0/492694107 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b8009550 con 0x7f05bc0cbdb0 2023-11-08T19:23:05.727 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.711+0000 7f05c1996700 1 --2- 172.21.15.149:0/492694107 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05bc15b8e0 0x7f05bc0b58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:23:05.728 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.712+0000 7f05c0994700 1 --2- 172.21.15.149:0/492694107 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05bc0cbdb0 0x7f05bc0c91a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f05ac00c7f0 tx=0x7f05ac00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:05.728 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.712+0000 7f05b1ffb700 1 -- 172.21.15.149:0/492694107 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ac011800 con 0x7f05bc0cbdb0 2023-11-08T19:23:05.728 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.712+0000 7f05b1ffb700 1 -- 172.21.15.149:0/492694107 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05ac011960 con 0x7f05bc0cbdb0 2023-11-08T19:23:05.728 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.712+0000 7f05c33f9700 1 -- 172.21.15.149:0/492694107 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05bc1f47e0 con 0x7f05bc0cbdb0 2023-11-08T19:23:05.729 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.712+0000 7f05b1ffb700 1 -- 172.21.15.149:0/492694107 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ac011cf0 con 0x7f05bc0cbdb0 2023-11-08T19:23:05.729 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.712+0000 7f05c33f9700 1 -- 172.21.15.149:0/492694107 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05bc1f4da0 con 0x7f05bc0cbdb0 2023-11-08T19:23:05.729 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.713+0000 7f05c33f9700 1 -- 172.21.15.149:0/492694107 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05bc0745f0 con 0x7f05bc0cbdb0 2023-11-08T19:23:05.729 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.713+0000 7f05b1ffb700 1 -- 172.21.15.149:0/492694107 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f05ac018360 con 0x7f05bc0cbdb0 2023-11-08T19:23:05.730 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.714+0000 7f05b1ffb700 1 --2- 172.21.15.149:0/492694107 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f05a006af00 0x7f05a006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:05.730 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.714+0000 7f05b1ffb700 1 -- 172.21.15.149:0/492694107 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f05ac089890 con 0x7f05bc0cbdb0 2023-11-08T19:23:05.730 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.714+0000 7f05c1195700 1 --2- 172.21.15.149:0/492694107 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f05a006af00 0x7f05a006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:05.730 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.714+0000 7f05c1195700 1 --2- 172.21.15.149:0/492694107 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f05a006af00 0x7f05a006d3c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f05bc0b36f0 tx=0x7f05b8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:05.730 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.719+0000 7f05b1ffb700 1 -- 172.21.15.149:0/492694107 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f05ac054680 con 0x7f05bc0cbdb0 2023-11-08T19:23:05.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:05.908+0000 7f05c33f9700 1 -- 172.21.15.149:0/492694107 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f05bc0cef80 con 0x7f05bc0cbdb0 2023-11-08T19:23:06.352 INFO:tasks.ceph.mds.d.smithi160.stderr:2023-11-08T19:23:06.352+0000 7fcf93db2700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-08T19:23:06.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.561+0000 7f05b1ffb700 1 -- 172.21.15.149:0/492694107 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7f05ac057ca0 con 0x7f05bc0cbdb0 2023-11-08T19:23:06.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.565+0000 7f05c33f9700 1 -- 172.21.15.149:0/492694107 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f05a006af00 msgr2=0x7f05a006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:06.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.565+0000 7f05c33f9700 1 --2- 172.21.15.149:0/492694107 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f05a006af00 0x7f05a006d3c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f05bc0b36f0 tx=0x7f05b8008030 comp rx=0 tx=0).stop 2023-11-08T19:23:06.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.565+0000 7f05c33f9700 1 -- 172.21.15.149:0/492694107 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05bc0cbdb0 msgr2=0x7f05bc0c91a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:06.567 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.565+0000 7f05c33f9700 1 --2- 172.21.15.149:0/492694107 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05bc0cbdb0 0x7f05bc0c91a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f05ac00c7f0 tx=0x7f05ac00cbb0 comp rx=0 tx=0).stop 2023-11-08T19:23:06.567 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.565+0000 7f05c33f9700 1 -- 172.21.15.149:0/492694107 shutdown_connections 2023-11-08T19:23:06.568 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.565+0000 7f05c33f9700 1 --2- 172.21.15.149:0/492694107 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f05a006af00 0x7f05a006d3c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:06.568 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.565+0000 7f05c33f9700 1 --2- 172.21.15.149:0/492694107 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05bc15b8e0 0x7f05bc0b58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:06.568 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.565+0000 7f05c33f9700 1 --2- 172.21.15.149:0/492694107 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05bc0b3720 0x7f05bc155ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:06.568 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.565+0000 7f05c33f9700 1 --2- 172.21.15.149:0/492694107 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05bc0cbdb0 0x7f05bc0c91a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:06.568 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.565+0000 7f05c33f9700 1 -- 172.21.15.149:0/492694107 >> 172.21.15.149:0/492694107 conn(0x7f05bc0ce1e0 msgr2=0x7f05bc0b45b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:06.569 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.566+0000 7f05c33f9700 1 -- 172.21.15.149:0/492694107 shutdown_connections 2023-11-08T19:23:06.569 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.566+0000 7f05c33f9700 1 -- 172.21.15.149:0/492694107 wait complete. 2023-11-08T19:23:06.573 INFO:teuthology.orchestra.run.smithi149.stderr:set pool 4 allow_ec_overwrites to true 2023-11-08T19:23:06.590 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-11-08T19:23:06.720 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.719+0000 7f6158a04700 1 Processor -- start 2023-11-08T19:23:06.720 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.719+0000 7f6158a04700 1 -- start start 2023-11-08T19:23:06.723 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.720+0000 7f6158a04700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f615406ab80 0x7f61540caf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:06.723 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.720+0000 7f6158a04700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f61540cf1c0 0x7f61540cb490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:06.723 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.720+0000 7f6158a04700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f615415e320 con 0x7f615415df40 2023-11-08T19:23:06.724 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.720+0000 7f6158a04700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f615406b020 con 0x7f615406ab80 2023-11-08T19:23:06.724 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.720+0000 7f6158a04700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f615406b2e0 con 0x7f61540cf1c0 2023-11-08T19:23:06.724 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.720+0000 7f6152d9d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f61540cf1c0 0x7f61540cb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:06.724 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.720+0000 7f6151d9b700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f615406ab80 0x7f61540caf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:06.725 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.720+0000 7f6151d9b700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f615406ab80 0x7f61540caf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.149:37752/0 (socket says 172.21.15.149:37752) 2023-11-08T19:23:06.725 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.720+0000 7f6152d9d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f61540cf1c0 0x7f61540cb490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.149:57046/0 (socket says 172.21.15.149:57046) 2023-11-08T19:23:06.725 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.720+0000 7f6151d9b700 1 -- 172.21.15.149:0/3444943732 learned_addr learned my addr 172.21.15.149:0/3444943732 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:06.725 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.720+0000 7f615259c700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f615415df40 0x7f615406c0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.149:50424/0 (socket says 172.21.15.149:50424) 2023-11-08T19:23:06.725 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.721+0000 7f6151d9b700 1 -- 172.21.15.149:0/3444943732 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f61540cf1c0 msgr2=0x7f61540cb490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:06.726 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.721+0000 7f6151d9b700 1 --2- 172.21.15.149:0/3444943732 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f61540cf1c0 0x7f61540cb490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:06.726 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.721+0000 7f6151d9b700 1 -- 172.21.15.149:0/3444943732 >> v1:172.21.15.160:6789/0 conn(0x7f615415df40 legacy=0x7f615406c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:06.726 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.721+0000 7f6151d9b700 1 -- 172.21.15.149:0/3444943732 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f615406b5c0 con 0x7f615406ab80 2023-11-08T19:23:06.726 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.721+0000 7f615159a700 1 -- 172.21.15.149:0/3444943732 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 301721049 0 0) 0x7f615415e320 con 0x7f615415df40 2023-11-08T19:23:06.727 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.721+0000 7f6152d9d700 1 --2- 172.21.15.149:0/3444943732 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f61540cf1c0 0x7f61540cb490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:23:06.727 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.721+0000 7f6151d9b700 1 --2- 172.21.15.149:0/3444943732 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f615406ab80 0x7f61540caf50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f61440098f0 tx=0x7f6144009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ee66b0c17642187 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:06.727 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.721+0000 7f615159a700 1 -- 172.21.15.149:0/3444943732 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6144011830 con 0x7f615406ab80 2023-11-08T19:23:06.727 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.721+0000 7f615159a700 1 -- 172.21.15.149:0/3444943732 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6144011990 con 0x7f615406ab80 2023-11-08T19:23:06.727 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.721+0000 7f615159a700 1 -- 172.21.15.149:0/3444943732 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6144011d20 con 0x7f615406ab80 2023-11-08T19:23:06.728 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.721+0000 7f6158a04700 1 -- 172.21.15.149:0/3444943732 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f615406ab80 msgr2=0x7f61540caf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:06.728 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.721+0000 7f6158a04700 1 --2- 172.21.15.149:0/3444943732 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f615406ab80 0x7f61540caf50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f61440098f0 tx=0x7f6144009c00 comp rx=0 tx=0).stop 2023-11-08T19:23:06.728 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.721+0000 7f6158a04700 1 -- 172.21.15.149:0/3444943732 shutdown_connections 2023-11-08T19:23:06.728 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.721+0000 7f6158a04700 1 --2- 172.21.15.149:0/3444943732 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f61540cf1c0 0x7f61540cb490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:06.728 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.721+0000 7f6158a04700 1 --2- 172.21.15.149:0/3444943732 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f615406ab80 0x7f61540caf50 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:06.729 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.721+0000 7f6158a04700 1 -- 172.21.15.149:0/3444943732 >> 172.21.15.149:0/3444943732 conn(0x7f61540d0640 msgr2=0x7f61540d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:06.729 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.722+0000 7f6158a04700 1 -- 172.21.15.149:0/3444943732 shutdown_connections 2023-11-08T19:23:06.729 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.722+0000 7f6158a04700 1 -- 172.21.15.149:0/3444943732 wait complete. 2023-11-08T19:23:06.732 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.723+0000 7f6158a04700 1 Processor -- start 2023-11-08T19:23:06.732 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.723+0000 7f6158a04700 1 -- start start 2023-11-08T19:23:06.732 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.724+0000 7f6158a04700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f615406ab80 0x7f61540c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:06.732 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.724+0000 7f6158a04700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61540cf1c0 0x7f61541566f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:06.732 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.724+0000 7f6158a04700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f615415df40 0x7f61540c98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:06.733 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.724+0000 7f6158a04700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61540c8500 con 0x7f61540cf1c0 2023-11-08T19:23:06.733 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.724+0000 7f6158a04700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61540ca720 con 0x7f615415df40 2023-11-08T19:23:06.733 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.724+0000 7f6158a04700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6154156c30 con 0x7f615406ab80 2023-11-08T19:23:06.733 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.724+0000 7f6151d9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61540cf1c0 0x7f61541566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:06.733 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.724+0000 7f6151d9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61540cf1c0 0x7f61541566f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36764/0 (socket says 172.21.15.149:36764) 2023-11-08T19:23:06.734 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.724+0000 7f6151d9b700 1 -- 172.21.15.149:0/536788569 learned_addr learned my addr 172.21.15.149:0/536788569 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:06.734 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.724+0000 7f615259c700 1 --2- 172.21.15.149:0/536788569 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f615406ab80 0x7f61540c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:06.734 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.724+0000 7f6152d9d700 1 --2- 172.21.15.149:0/536788569 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f615415df40 0x7f61540c98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:06.734 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.724+0000 7f6151d9b700 1 -- 172.21.15.149:0/536788569 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f615406ab80 msgr2=0x7f61540c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:06.735 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.724+0000 7f6151d9b700 1 --2- 172.21.15.149:0/536788569 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f615406ab80 0x7f61540c6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:06.735 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.724+0000 7f6151d9b700 1 -- 172.21.15.149:0/536788569 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f615415df40 msgr2=0x7f61540c98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:06.735 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.724+0000 7f6151d9b700 1 --2- 172.21.15.149:0/536788569 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f615415df40 0x7f61540c98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:06.735 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.724+0000 7f6151d9b700 1 -- 172.21.15.149:0/536788569 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f614c009a70 con 0x7f61540cf1c0 2023-11-08T19:23:06.735 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.724+0000 7f615259c700 1 --2- 172.21.15.149:0/536788569 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f615406ab80 0x7f61540c6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:23:06.735 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.724+0000 7f6151d9b700 1 --2- 172.21.15.149:0/536788569 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61540cf1c0 0x7f61541566f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6144009c40 tx=0x7f6144004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:06.736 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.724+0000 7f6142ffd700 1 -- 172.21.15.149:0/536788569 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61440036a0 con 0x7f61540cf1c0 2023-11-08T19:23:06.736 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.724+0000 7f6142ffd700 1 -- 172.21.15.149:0/536788569 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f614401f070 con 0x7f61540cf1c0 2023-11-08T19:23:06.736 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.724+0000 7f6158a04700 1 -- 172.21.15.149:0/536788569 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6144009550 con 0x7f61540cf1c0 2023-11-08T19:23:06.736 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.724+0000 7f6142ffd700 1 -- 172.21.15.149:0/536788569 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6144003a40 con 0x7f61540cf1c0 2023-11-08T19:23:06.736 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.724+0000 7f6158a04700 1 -- 172.21.15.149:0/536788569 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61540ca440 con 0x7f61540cf1c0 2023-11-08T19:23:06.737 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.725+0000 7f6158a04700 1 -- 172.21.15.149:0/536788569 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f615404f730 con 0x7f61540cf1c0 2023-11-08T19:23:06.737 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.726+0000 7f6142ffd700 1 -- 172.21.15.149:0/536788569 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6144003ba0 con 0x7f61540cf1c0 2023-11-08T19:23:06.737 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.726+0000 7f6142ffd700 1 --2- 172.21.15.149:0/536788569 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f613406af00 0x7f613406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:06.737 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.726+0000 7f6142ffd700 1 -- 172.21.15.149:0/536788569 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f6144021070 con 0x7f61540cf1c0 2023-11-08T19:23:06.737 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.726+0000 7f615259c700 1 --2- 172.21.15.149:0/536788569 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f613406af00 0x7f613406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:06.738 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.727+0000 7f615259c700 1 --2- 172.21.15.149:0/536788569 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f613406af00 0x7f613406d3c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6148000f60 tx=0x7f6148007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:06.738 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.731+0000 7f6142ffd700 1 -- 172.21.15.149:0/536788569 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f61440560b0 con 0x7f61540cf1c0 2023-11-08T19:23:06.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:06.963+0000 7f6158a04700 1 -- 172.21.15.149:0/536788569 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f615415a570 con 0x7f61540cf1c0 2023-11-08T19:23:07.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.563+0000 7f6142ffd700 1 -- 172.21.15.149:0/536788569 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f61440596d0 con 0x7f61540cf1c0 2023-11-08T19:23:07.567 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.565+0000 7f6158a04700 1 -- 172.21.15.149:0/536788569 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f613406af00 msgr2=0x7f613406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:07.567 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.565+0000 7f6158a04700 1 --2- 172.21.15.149:0/536788569 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f613406af00 0x7f613406d3c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6148000f60 tx=0x7f6148007d30 comp rx=0 tx=0).stop 2023-11-08T19:23:07.567 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.565+0000 7f6158a04700 1 -- 172.21.15.149:0/536788569 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61540cf1c0 msgr2=0x7f61541566f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:07.567 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.566+0000 7f6158a04700 1 --2- 172.21.15.149:0/536788569 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61540cf1c0 0x7f61541566f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6144009c40 tx=0x7f6144004750 comp rx=0 tx=0).stop 2023-11-08T19:23:07.568 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.566+0000 7f6158a04700 1 -- 172.21.15.149:0/536788569 shutdown_connections 2023-11-08T19:23:07.568 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.566+0000 7f6158a04700 1 --2- 172.21.15.149:0/536788569 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f613406af00 0x7f613406d3c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:07.568 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.566+0000 7f6158a04700 1 --2- 172.21.15.149:0/536788569 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f615415df40 0x7f61540c98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:07.568 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.566+0000 7f6158a04700 1 --2- 172.21.15.149:0/536788569 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f615406ab80 0x7f61540c6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:07.569 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.566+0000 7f6158a04700 1 --2- 172.21.15.149:0/536788569 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61540cf1c0 0x7f61541566f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:07.569 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.566+0000 7f6158a04700 1 -- 172.21.15.149:0/536788569 >> 172.21.15.149:0/536788569 conn(0x7f61540d0640 msgr2=0x7f61540cc1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:07.569 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.566+0000 7f6158a04700 1 -- 172.21.15.149:0/536788569 shutdown_connections 2023-11-08T19:23:07.569 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.566+0000 7f6158a04700 1 -- 172.21.15.149:0/536788569 wait complete. 2023-11-08T19:23:07.570 INFO:teuthology.orchestra.run.smithi149.stderr:added data pool 4 to fsmap 2023-11-08T19:23:07.580 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:23:07.615 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T19:23:07.626 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T19:23:07.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.704+0000 7f6b1bb32700 1 Processor -- start 2023-11-08T19:23:07.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.704+0000 7f6b1bb32700 1 -- start start 2023-11-08T19:23:07.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.705+0000 7f6b1bb32700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6b1415efb0 0x7f6b140b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:07.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.705+0000 7f6b1bb32700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f6b1406c2a0 0x7f6b140cf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:07.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.705+0000 7f6b1bb32700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b1415f390 con 0x7f6b140668e0 2023-11-08T19:23:07.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.705+0000 7f6b1bb32700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b140ce0a0 con 0x7f6b1406c2a0 2023-11-08T19:23:07.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.705+0000 7f6b1bb32700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b140ce380 con 0x7f6b1415efb0 2023-11-08T19:23:07.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.705+0000 7f6b190cd700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f6b140668e0 0x7f6b1406bb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:38772/0 (socket says 172.21.15.149:38772) 2023-11-08T19:23:07.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.705+0000 7f6b190cd700 1 -- 172.21.15.149:0/3896839819 learned_addr learned my addr 172.21.15.149:0/3896839819 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:23:07.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.705+0000 7f6b188cc700 1 -- 172.21.15.149:0/3896839819 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3351890018 0 0) 0x7f6b04001110 con 0x7f6b140668e0 2023-11-08T19:23:07.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.705+0000 7f6b188cc700 1 -- 172.21.15.149:0/3896839819 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b000035b0 con 0x7f6b140668e0 2023-11-08T19:23:07.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.705+0000 7f6b198ce700 1 --2- 172.21.15.149:0/3896839819 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6b1415efb0 0x7f6b140b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:07.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.705+0000 7f6b1a0cf700 1 --2- 172.21.15.149:0/3896839819 >> v2:172.21.15.160:3300/0 conn(0x7f6b1406c2a0 0x7f6b140cf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:07.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.705+0000 7f6b188cc700 1 -- 172.21.15.149:0/3896839819 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4281030063 0 0) 0x7f6b000035b0 con 0x7f6b140668e0 2023-11-08T19:23:07.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.705+0000 7f6b188cc700 1 -- 172.21.15.149:0/3896839819 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6b1415efb0 msgr2=0x7f6b140b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:07.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.705+0000 7f6b188cc700 1 --2- 172.21.15.149:0/3896839819 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6b1415efb0 0x7f6b140b2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:07.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.705+0000 7f6b188cc700 1 -- 172.21.15.149:0/3896839819 >> v2:172.21.15.160:3300/0 conn(0x7f6b1406c2a0 msgr2=0x7f6b140cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:07.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.705+0000 7f6b188cc700 1 --2- 172.21.15.149:0/3896839819 >> v2:172.21.15.160:3300/0 conn(0x7f6b1406c2a0 0x7f6b140cf140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:07.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.705+0000 7f6b188cc700 1 -- 172.21.15.149:0/3896839819 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b140ce660 con 0x7f6b140668e0 2023-11-08T19:23:07.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.705+0000 7f6b188cc700 1 -- 172.21.15.149:0/3896839819 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f6b04001800 con 0x7f6b140668e0 2023-11-08T19:23:07.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.705+0000 7f6b188cc700 1 -- 172.21.15.149:0/3896839819 >> v1:172.21.15.149:6789/0 conn(0x7f6b140668e0 legacy=0x7f6b1406bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:07.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.705+0000 7f6b188cc700 1 --2- 172.21.15.149:0/3896839819 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b00003a00 0x7f6b00003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:07.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.705+0000 7f6b188cc700 1 --2- 172.21.15.149:0/3896839819 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6b1415efb0 0x7f6b00004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:07.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.705+0000 7f6b188cc700 1 --2- 172.21.15.149:0/3896839819 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6b00004d90 0x7f6b00005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:07.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.706+0000 7f6b188cc700 1 -- 172.21.15.149:0/3896839819 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b140ce0a0 con 0x7f6b00003a00 2023-11-08T19:23:07.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.706+0000 7f6b188cc700 1 -- 172.21.15.149:0/3896839819 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b140ce380 con 0x7f6b00004d90 2023-11-08T19:23:07.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.706+0000 7f6b188cc700 1 -- 172.21.15.149:0/3896839819 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0000bac0 con 0x7f6b1415efb0 2023-11-08T19:23:07.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.706+0000 7f6b198ce700 1 --2- 172.21.15.149:0/3896839819 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b00003a00 0x7f6b00003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:07.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.706+0000 7f6b190cd700 1 --2- 172.21.15.149:0/3896839819 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6b1415efb0 0x7f6b00004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:07.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.706+0000 7f6b1a0cf700 1 --2- 172.21.15.149:0/3896839819 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6b00004d90 0x7f6b00005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:07.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.706+0000 7f6b198ce700 1 -- 172.21.15.149:0/3896839819 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6b1415efb0 msgr2=0x7f6b00004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:07.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.706+0000 7f6b198ce700 1 --2- 172.21.15.149:0/3896839819 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6b1415efb0 0x7f6b00004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:07.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.706+0000 7f6b198ce700 1 -- 172.21.15.149:0/3896839819 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6b00004d90 msgr2=0x7f6b00005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:07.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.706+0000 7f6b198ce700 1 --2- 172.21.15.149:0/3896839819 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6b00004d90 0x7f6b00005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:07.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.706+0000 7f6b198ce700 1 -- 172.21.15.149:0/3896839819 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b000035b0 con 0x7f6b00003a00 2023-11-08T19:23:07.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.706+0000 7f6b198ce700 1 --2- 172.21.15.149:0/3896839819 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b00003a00 0x7f6b00003e20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6b100098c0 tx=0x7f6b00005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f368daf6045ef8ec server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:07.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.706+0000 7f6b188cc700 1 -- 172.21.15.149:0/3896839819 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1000c070 con 0x7f6b00003a00 2023-11-08T19:23:07.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.706+0000 7f6b188cc700 1 -- 172.21.15.149:0/3896839819 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b10013610 con 0x7f6b00003a00 2023-11-08T19:23:07.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.706+0000 7f6b188cc700 1 -- 172.21.15.149:0/3896839819 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b100139a0 con 0x7f6b00003a00 2023-11-08T19:23:07.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.707+0000 7f6b1bb32700 1 -- 172.21.15.149:0/3896839819 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b00003a00 msgr2=0x7f6b00003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:07.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.707+0000 7f6b1bb32700 1 --2- 172.21.15.149:0/3896839819 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b00003a00 0x7f6b00003e20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6b100098c0 tx=0x7f6b00005880 comp rx=0 tx=0).stop 2023-11-08T19:23:07.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.707+0000 7f6b1a0cf700 1 -- 172.21.15.149:0/3896839819 reap_dead start 2023-11-08T19:23:07.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.707+0000 7f6b1bb32700 1 -- 172.21.15.149:0/3896839819 shutdown_connections 2023-11-08T19:23:07.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.707+0000 7f6b1bb32700 1 -- 172.21.15.149:0/3896839819 >> 172.21.15.149:0/3896839819 conn(0x7f6b14071720 msgr2=0x7f6b14071b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:07.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.707+0000 7f6b1bb32700 1 -- 172.21.15.149:0/3896839819 shutdown_connections 2023-11-08T19:23:07.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.707+0000 7f6b1bb32700 1 -- 172.21.15.149:0/3896839819 wait complete. 2023-11-08T19:23:07.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.708+0000 7f6b1bb32700 1 Processor -- start 2023-11-08T19:23:07.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.708+0000 7f6b1bb32700 1 -- start start 2023-11-08T19:23:07.721 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.709+0000 7f6b1bb32700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b00003a00 0x7f6b1406e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:07.721 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.709+0000 7f6b1bb32700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6b140c64d0 0x7f6b141598f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:07.722 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.709+0000 7f6b1bb32700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6b140c7280 0x7f6b140c7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:07.722 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.709+0000 7f6b1bb32700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1406ee40 con 0x7f6b00003a00 2023-11-08T19:23:07.722 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.709+0000 7f6b1bb32700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1406e470 con 0x7f6b140c7280 2023-11-08T19:23:07.722 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.709+0000 7f6b1bb32700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1406de80 con 0x7f6b140c64d0 2023-11-08T19:23:07.723 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.709+0000 7f6b198ce700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b00003a00 0x7f6b1406e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:07.723 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.709+0000 7f6b198ce700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b00003a00 0x7f6b1406e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36782/0 (socket says 172.21.15.149:36782) 2023-11-08T19:23:07.723 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.709+0000 7f6b198ce700 1 -- 172.21.15.149:0/1430806989 learned_addr learned my addr 172.21.15.149:0/1430806989 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:07.723 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.709+0000 7f6b1a0cf700 1 --2- 172.21.15.149:0/1430806989 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6b140c7280 0x7f6b140c7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:07.723 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.709+0000 7f6b190cd700 1 --2- 172.21.15.149:0/1430806989 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6b140c64d0 0x7f6b141598f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:07.723 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.709+0000 7f6b198ce700 1 -- 172.21.15.149:0/1430806989 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6b140c64d0 msgr2=0x7f6b141598f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:07.724 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.709+0000 7f6b198ce700 1 --2- 172.21.15.149:0/1430806989 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6b140c64d0 0x7f6b141598f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:07.724 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.709+0000 7f6b198ce700 1 -- 172.21.15.149:0/1430806989 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6b140c7280 msgr2=0x7f6b140c7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:07.724 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.709+0000 7f6b198ce700 1 --2- 172.21.15.149:0/1430806989 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6b140c7280 0x7f6b140c7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:07.724 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.709+0000 7f6b198ce700 1 -- 172.21.15.149:0/1430806989 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b140c9db0 con 0x7f6b00003a00 2023-11-08T19:23:07.724 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.709+0000 7f6b1a0cf700 1 --2- 172.21.15.149:0/1430806989 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6b140c7280 0x7f6b140c7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:23:07.725 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.709+0000 7f6b198ce700 1 --2- 172.21.15.149:0/1430806989 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b00003a00 0x7f6b1406e900 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6b00005830 tx=0x7f6b100047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:07.725 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.709+0000 7f6b0a7fc700 1 -- 172.21.15.149:0/1430806989 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b10013b90 con 0x7f6b00003a00 2023-11-08T19:23:07.725 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.709+0000 7f6b0a7fc700 1 -- 172.21.15.149:0/1430806989 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b10013cf0 con 0x7f6b00003a00 2023-11-08T19:23:07.725 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.709+0000 7f6b1bb32700 1 -- 172.21.15.149:0/1430806989 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b140ca090 con 0x7f6b00003a00 2023-11-08T19:23:07.725 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.709+0000 7f6b0a7fc700 1 -- 172.21.15.149:0/1430806989 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b100038e0 con 0x7f6b00003a00 2023-11-08T19:23:07.725 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.709+0000 7f6b1bb32700 1 -- 172.21.15.149:0/1430806989 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b14159e30 con 0x7f6b00003a00 2023-11-08T19:23:07.726 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.710+0000 7f6b1bb32700 1 -- 172.21.15.149:0/1430806989 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b14159ff0 con 0x7f6b00003a00 2023-11-08T19:23:07.726 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.711+0000 7f6b0a7fc700 1 -- 172.21.15.149:0/1430806989 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6b10003a40 con 0x7f6b00003a00 2023-11-08T19:23:07.726 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.711+0000 7f6b0a7fc700 1 --2- 172.21.15.149:0/1430806989 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6af806af00 0x7f6af806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:07.726 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.711+0000 7f6b0a7fc700 1 -- 172.21.15.149:0/1430806989 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6b1008ac10 con 0x7f6b00003a00 2023-11-08T19:23:07.727 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.711+0000 7f6b190cd700 1 --2- 172.21.15.149:0/1430806989 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6af806af00 0x7f6af806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:07.727 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.711+0000 7f6b190cd700 1 --2- 172.21.15.149:0/1430806989 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6af806af00 0x7f6af806d3c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6b040012b0 tx=0x7f6b04009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:07.727 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.716+0000 7f6b0a7fc700 1 -- 172.21.15.149:0/1430806989 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6b10055a60 con 0x7f6b00003a00 2023-11-08T19:23:07.948 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.946+0000 7f6b1bb32700 1 -- 172.21.15.149:0/1430806989 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6b140745f0 con 0x7f6b00003a00 2023-11-08T19:23:07.948 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.947+0000 7f6b0a7fc700 1 -- 172.21.15.149:0/1430806989 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4921 (secure 0 0 0) 0x7f6b10013e60 con 0x7f6b00003a00 2023-11-08T19:23:07.949 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:23:07.949 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4252,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/2277605177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":2277605177},{"type":"v1","addr":"172.21.15.149:6837","nonce":2277605177}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/2774257644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2774257644},{"type":"v1","addr":"172.21.15.149:6836","nonce":2774257644}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/2076428669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":2076428669},{"type":"v1","addr":"172.21.15.160:6835","nonce":2076428669}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-08T19:23:01.918138+0000","modified":"2023-11-08T19:23:06.964670+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.160:6834/3847116435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3847116435},{"type":"v1","addr":"172.21.15.160:6834","nonce":3847116435}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-11-08T19:23:07.951 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.949+0000 7f6b1bb32700 1 -- 172.21.15.149:0/1430806989 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6af806af00 msgr2=0x7f6af806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:07.951 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.949+0000 7f6b1bb32700 1 --2- 172.21.15.149:0/1430806989 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6af806af00 0x7f6af806d3c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6b040012b0 tx=0x7f6b04009040 comp rx=0 tx=0).stop 2023-11-08T19:23:07.951 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.949+0000 7f6b1bb32700 1 -- 172.21.15.149:0/1430806989 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b00003a00 msgr2=0x7f6b1406e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:07.951 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.949+0000 7f6b1bb32700 1 --2- 172.21.15.149:0/1430806989 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b00003a00 0x7f6b1406e900 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6b00005830 tx=0x7f6b100047c0 comp rx=0 tx=0).stop 2023-11-08T19:23:07.952 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.950+0000 7f6b1bb32700 1 -- 172.21.15.149:0/1430806989 shutdown_connections 2023-11-08T19:23:07.952 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.950+0000 7f6b1bb32700 1 --2- 172.21.15.149:0/1430806989 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6af806af00 0x7f6af806d3c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:07.952 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.950+0000 7f6b1bb32700 1 --2- 172.21.15.149:0/1430806989 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6b140c7280 0x7f6b140c7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:07.952 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.950+0000 7f6b1bb32700 1 --2- 172.21.15.149:0/1430806989 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b00003a00 0x7f6b1406e900 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:07.952 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.950+0000 7f6b1bb32700 1 --2- 172.21.15.149:0/1430806989 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6b140c64d0 0x7f6b141598f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:07.953 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.950+0000 7f6b1bb32700 1 -- 172.21.15.149:0/1430806989 >> 172.21.15.149:0/1430806989 conn(0x7f6b14071720 msgr2=0x7f6b14071b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:07.953 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.950+0000 7f6b1bb32700 1 -- 172.21.15.149:0/1430806989 shutdown_connections 2023-11-08T19:23:07.953 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:07.950+0000 7f6b1bb32700 1 -- 172.21.15.149:0/1430806989 wait complete. 2023-11-08T19:23:07.954 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 7 2023-11-08T19:23:07.963 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:23:08.123 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.122+0000 7fe761b44700 1 Processor -- start 2023-11-08T19:23:08.123 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.122+0000 7fe761b44700 1 -- start start 2023-11-08T19:23:08.125 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.122+0000 7fe761b44700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe75c06e020 0x7fe75c06bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:08.125 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.122+0000 7fe761b44700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe75c15af90 con 0x7fe75c15abb0 2023-11-08T19:23:08.125 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.122+0000 7fe761b44700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe75c06f260 con 0x7fe75c06c0d0 2023-11-08T19:23:08.126 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.122+0000 7fe761b44700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe75c06e480 con 0x7fe75c06e020 2023-11-08T19:23:08.126 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.123+0000 7fe75affd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe75c06e020 0x7fe75c06bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:08.126 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.123+0000 7fe75affd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe75c06e020 0x7fe75c06bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36790/0 (socket says 172.21.15.149:36790) 2023-11-08T19:23:08.126 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.123+0000 7fe75affd700 1 -- 172.21.15.149:0/602250160 learned_addr learned my addr 172.21.15.149:0/602250160 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:08.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.123+0000 7fe75b7fe700 1 --1- 172.21.15.149:0/602250160 >> v1:172.21.15.149:6789/0 conn(0x7fe75c15abb0 0x7fe75c06e7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:38792/0 (socket says 172.21.15.149:38792) 2023-11-08T19:23:08.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.123+0000 7fe75affd700 1 -- 172.21.15.149:0/602250160 >> v1:172.21.15.160:6789/0 conn(0x7fe75c06c0d0 legacy=0x7fe75c0b2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:08.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.123+0000 7fe75affd700 1 -- 172.21.15.149:0/602250160 >> v1:172.21.15.149:6789/0 conn(0x7fe75c15abb0 legacy=0x7fe75c06e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:08.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.123+0000 7fe75affd700 1 -- 172.21.15.149:0/602250160 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe75c06d540 con 0x7fe75c06e020 2023-11-08T19:23:08.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.123+0000 7fe75affd700 1 --2- 172.21.15.149:0/602250160 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe75c06e020 0x7fe75c06bb90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe74c0098f0 tx=0x7fe74c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f248b2273c3a38a server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:08.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.123+0000 7fe75a7fc700 1 -- 172.21.15.149:0/602250160 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74c004230 con 0x7fe75c06e020 2023-11-08T19:23:08.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.123+0000 7fe75a7fc700 1 -- 172.21.15.149:0/602250160 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe74c004390 con 0x7fe75c06e020 2023-11-08T19:23:08.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.123+0000 7fe75a7fc700 1 -- 172.21.15.149:0/602250160 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74c0036a0 con 0x7fe75c06e020 2023-11-08T19:23:08.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.124+0000 7fe761b44700 1 -- 172.21.15.149:0/602250160 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe75c06e020 msgr2=0x7fe75c06bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:08.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.124+0000 7fe761b44700 1 --2- 172.21.15.149:0/602250160 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe75c06e020 0x7fe75c06bb90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe74c0098f0 tx=0x7fe74c009c00 comp rx=0 tx=0).stop 2023-11-08T19:23:08.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.124+0000 7fe761b44700 1 -- 172.21.15.149:0/602250160 shutdown_connections 2023-11-08T19:23:08.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.124+0000 7fe761b44700 1 --2- 172.21.15.149:0/602250160 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe75c06e020 0x7fe75c06bb90 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:08.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.124+0000 7fe761b44700 1 -- 172.21.15.149:0/602250160 >> 172.21.15.149:0/602250160 conn(0x7fe75c071720 msgr2=0x7fe75c071b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:08.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.124+0000 7fe761b44700 1 -- 172.21.15.149:0/602250160 shutdown_connections 2023-11-08T19:23:08.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.124+0000 7fe761b44700 1 -- 172.21.15.149:0/602250160 wait complete. 2023-11-08T19:23:08.132 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.125+0000 7fe761b44700 1 Processor -- start 2023-11-08T19:23:08.132 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.125+0000 7fe761b44700 1 -- start start 2023-11-08T19:23:08.132 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.126+0000 7fe761b44700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe75c06c0d0 0x7fe75c1f2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:08.133 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.126+0000 7fe761b44700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe75c06e020 0x7fe75c06b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:08.133 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.126+0000 7fe761b44700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe75c15abb0 0x7fe75c071b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:08.133 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.126+0000 7fe761b44700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe75c15bed0 con 0x7fe75c15abb0 2023-11-08T19:23:08.133 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.126+0000 7fe761b44700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe75c15b350 con 0x7fe75c06c0d0 2023-11-08T19:23:08.133 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.126+0000 7fe761b44700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe75c15b630 con 0x7fe75c06e020 2023-11-08T19:23:08.134 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.126+0000 7fe75bfff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe75c15abb0 0x7fe75c071b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:08.134 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.126+0000 7fe75bfff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe75c15abb0 0x7fe75c071b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36800/0 (socket says 172.21.15.149:36800) 2023-11-08T19:23:08.134 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.126+0000 7fe75bfff700 1 -- 172.21.15.149:0/666580467 learned_addr learned my addr 172.21.15.149:0/666580467 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:08.134 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.126+0000 7fe75b7fe700 1 --2- 172.21.15.149:0/666580467 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe75c06c0d0 0x7fe75c1f2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:08.135 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.126+0000 7fe75affd700 1 --2- 172.21.15.149:0/666580467 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe75c06e020 0x7fe75c06b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:08.135 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.126+0000 7fe75bfff700 1 -- 172.21.15.149:0/666580467 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe75c06e020 msgr2=0x7fe75c06b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:08.135 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.126+0000 7fe75bfff700 1 --2- 172.21.15.149:0/666580467 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe75c06e020 0x7fe75c06b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:08.135 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.126+0000 7fe75bfff700 1 -- 172.21.15.149:0/666580467 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe75c06c0d0 msgr2=0x7fe75c1f2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:08.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.126+0000 7fe75bfff700 1 --2- 172.21.15.149:0/666580467 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe75c06c0d0 0x7fe75c1f2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:08.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.126+0000 7fe75bfff700 1 -- 172.21.15.149:0/666580467 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe74c009550 con 0x7fe75c15abb0 2023-11-08T19:23:08.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.126+0000 7fe75bfff700 1 --2- 172.21.15.149:0/666580467 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe75c15abb0 0x7fe75c071b00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe75400b970 tx=0x7fe75400bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:08.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.126+0000 7fe753fff700 1 -- 172.21.15.149:0/666580467 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75400c9b0 con 0x7fe75c15abb0 2023-11-08T19:23:08.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.126+0000 7fe753fff700 1 -- 172.21.15.149:0/666580467 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe75400cb10 con 0x7fe75c15abb0 2023-11-08T19:23:08.137 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.126+0000 7fe761b44700 1 -- 172.21.15.149:0/666580467 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe75c15b910 con 0x7fe75c15abb0 2023-11-08T19:23:08.137 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.126+0000 7fe753fff700 1 -- 172.21.15.149:0/666580467 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe754014440 con 0x7fe75c15abb0 2023-11-08T19:23:08.137 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.127+0000 7fe761b44700 1 -- 172.21.15.149:0/666580467 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe75c1f3150 con 0x7fe75c15abb0 2023-11-08T19:23:08.137 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.128+0000 7fe761b44700 1 -- 172.21.15.149:0/666580467 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe75c0c7fb0 con 0x7fe75c15abb0 2023-11-08T19:23:08.137 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.128+0000 7fe753fff700 1 -- 172.21.15.149:0/666580467 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe75401d3b0 con 0x7fe75c15abb0 2023-11-08T19:23:08.138 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.128+0000 7fe753fff700 1 --2- 172.21.15.149:0/666580467 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe73c06af00 0x7fe73c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:08.138 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.128+0000 7fe753fff700 1 -- 172.21.15.149:0/666580467 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe7540894c0 con 0x7fe75c15abb0 2023-11-08T19:23:08.138 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.128+0000 7fe75b7fe700 1 --2- 172.21.15.149:0/666580467 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe73c06af00 0x7fe73c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:08.138 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.129+0000 7fe75b7fe700 1 --2- 172.21.15.149:0/666580467 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe73c06af00 0x7fe73c06d3c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe744000f60 tx=0x7fe744007d50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:08.139 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.133+0000 7fe753fff700 1 -- 172.21.15.149:0/666580467 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe75c0c7fb0 con 0x7fe75c15abb0 2023-11-08T19:23:08.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.323+0000 7fe761b44700 1 -- 172.21.15.149:0/666580467 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe75c0c7fb0 con 0x7fe75c15abb0 2023-11-08T19:23:08.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.324+0000 7fe753fff700 1 -- 172.21.15.149:0/666580467 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18382 (secure 0 0 0) 0x7fe75c0c7fb0 con 0x7fe75c15abb0 2023-11-08T19:23:08.325 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:23:08.326 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":24,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:23:06.964482+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-08T19:22:59.830928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-08T19:23:00.886589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-08T19:23:04.574033+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:23:08.328 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.326+0000 7fe761b44700 1 -- 172.21.15.149:0/666580467 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe73c06af00 msgr2=0x7fe73c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:08.328 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.326+0000 7fe761b44700 1 --2- 172.21.15.149:0/666580467 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe73c06af00 0x7fe73c06d3c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe744000f60 tx=0x7fe744007d50 comp rx=0 tx=0).stop 2023-11-08T19:23:08.328 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.326+0000 7fe761b44700 1 -- 172.21.15.149:0/666580467 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe75c15abb0 msgr2=0x7fe75c071b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:08.329 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.326+0000 7fe761b44700 1 --2- 172.21.15.149:0/666580467 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe75c15abb0 0x7fe75c071b00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe75400b970 tx=0x7fe75400bd30 comp rx=0 tx=0).stop 2023-11-08T19:23:08.329 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.326+0000 7fe761b44700 1 -- 172.21.15.149:0/666580467 shutdown_connections 2023-11-08T19:23:08.329 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.326+0000 7fe761b44700 1 --2- 172.21.15.149:0/666580467 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe73c06af00 0x7fe73c06d3c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:08.329 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.326+0000 7fe761b44700 1 --2- 172.21.15.149:0/666580467 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe75c06c0d0 0x7fe75c1f2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:08.330 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.326+0000 7fe761b44700 1 --2- 172.21.15.149:0/666580467 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe75c15abb0 0x7fe75c071b00 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:08.330 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.326+0000 7fe761b44700 1 --2- 172.21.15.149:0/666580467 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe75c06e020 0x7fe75c06b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:08.330 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.326+0000 7fe761b44700 1 -- 172.21.15.149:0/666580467 >> 172.21.15.149:0/666580467 conn(0x7fe75c071720 msgr2=0x7fe75c159a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:08.330 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.327+0000 7fe761b44700 1 -- 172.21.15.149:0/666580467 shutdown_connections 2023-11-08T19:23:08.331 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.327+0000 7fe761b44700 1 -- 172.21.15.149:0/666580467 wait complete. 2023-11-08T19:23:08.340 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:23:08.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.460+0000 7fb81affc700 1 Processor -- start 2023-11-08T19:23:08.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.460+0000 7fb81affc700 1 -- start start 2023-11-08T19:23:08.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.461+0000 7fb81affc700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb8140b16b0 0x7fb8140ce380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:08.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.461+0000 7fb81affc700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8140d1330 con 0x7fb8140afb30 2023-11-08T19:23:08.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.461+0000 7fb81affc700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8140cb490 con 0x7fb8140b20b0 2023-11-08T19:23:08.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.461+0000 7fb81affc700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8140cb770 con 0x7fb8140b16b0 2023-11-08T19:23:08.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.461+0000 7fb813fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb8140b16b0 0x7fb8140ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:08.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.461+0000 7fb813fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb8140b16b0 0x7fb8140ce380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36806/0 (socket says 172.21.15.149:36806) 2023-11-08T19:23:08.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.461+0000 7fb813fff700 1 -- 172.21.15.149:0/101763161 learned_addr learned my addr 172.21.15.149:0/101763161 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:08.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.461+0000 7fb818d98700 1 --1- 172.21.15.149:0/101763161 >> v1:172.21.15.149:6789/0 conn(0x7fb8140afb30 0x7fb8140cbf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:38806/0 (socket says 172.21.15.149:38806) 2023-11-08T19:23:08.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.461+0000 7fb813fff700 1 -- 172.21.15.149:0/101763161 >> v1:172.21.15.160:6789/0 conn(0x7fb8140b20b0 legacy=0x7fb8140aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:08.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.461+0000 7fb813fff700 1 -- 172.21.15.149:0/101763161 >> v1:172.21.15.149:6789/0 conn(0x7fb8140afb30 legacy=0x7fb8140cbf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:08.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.461+0000 7fb813fff700 1 -- 172.21.15.149:0/101763161 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8140cba50 con 0x7fb8140b16b0 2023-11-08T19:23:08.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.461+0000 7fb813fff700 1 --2- 172.21.15.149:0/101763161 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8140b16b0 0x7fb8140ce380 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb8000098f0 tx=0x7fb800009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3edc4d68674b9d7c server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:08.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.461+0000 7fb8137fe700 1 -- 172.21.15.149:0/101763161 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb800004230 con 0x7fb8140b16b0 2023-11-08T19:23:08.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.462+0000 7fb8137fe700 1 -- 172.21.15.149:0/101763161 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb800004390 con 0x7fb8140b16b0 2023-11-08T19:23:08.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.462+0000 7fb8137fe700 1 -- 172.21.15.149:0/101763161 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8000036a0 con 0x7fb8140b16b0 2023-11-08T19:23:08.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.462+0000 7fb81affc700 1 -- 172.21.15.149:0/101763161 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8140b16b0 msgr2=0x7fb8140ce380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:08.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.462+0000 7fb81affc700 1 --2- 172.21.15.149:0/101763161 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8140b16b0 0x7fb8140ce380 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb8000098f0 tx=0x7fb800009c00 comp rx=0 tx=0).stop 2023-11-08T19:23:08.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.462+0000 7fb81affc700 1 -- 172.21.15.149:0/101763161 shutdown_connections 2023-11-08T19:23:08.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.462+0000 7fb81affc700 1 --2- 172.21.15.149:0/101763161 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8140b16b0 0x7fb8140ce380 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:08.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.462+0000 7fb81affc700 1 -- 172.21.15.149:0/101763161 >> 172.21.15.149:0/101763161 conn(0x7fb814099a40 msgr2=0x7fb8140d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:08.468 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.462+0000 7fb81affc700 1 -- 172.21.15.149:0/101763161 shutdown_connections 2023-11-08T19:23:08.468 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.462+0000 7fb81affc700 1 -- 172.21.15.149:0/101763161 wait complete. 2023-11-08T19:23:08.471 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.464+0000 7fb81affc700 1 Processor -- start 2023-11-08T19:23:08.471 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.464+0000 7fb81affc700 1 -- start start 2023-11-08T19:23:08.471 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.465+0000 7fb81affc700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb8140afb30 0x7fb814153a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:08.471 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.465+0000 7fb81affc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8140b16b0 0x7fb8140c88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:08.471 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.465+0000 7fb81affc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8140b20b0 0x7fb8140b5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:08.472 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.465+0000 7fb81affc700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8140c8490 con 0x7fb8140b20b0 2023-11-08T19:23:08.472 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.465+0000 7fb81affc700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8140c7810 con 0x7fb8140b16b0 2023-11-08T19:23:08.472 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.465+0000 7fb81affc700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8140c7af0 con 0x7fb8140afb30 2023-11-08T19:23:08.472 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.465+0000 7fb819599700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8140b20b0 0x7fb8140b5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:08.472 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.465+0000 7fb819599700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8140b20b0 0x7fb8140b5460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36814/0 (socket says 172.21.15.149:36814) 2023-11-08T19:23:08.473 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.465+0000 7fb819599700 1 -- 172.21.15.149:0/2342400700 learned_addr learned my addr 172.21.15.149:0/2342400700 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:08.473 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.465+0000 7fb818d98700 1 --2- 172.21.15.149:0/2342400700 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb8140afb30 0x7fb814153a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:08.473 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.465+0000 7fb813fff700 1 --2- 172.21.15.149:0/2342400700 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8140b16b0 0x7fb8140c88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:08.473 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.465+0000 7fb819599700 1 -- 172.21.15.149:0/2342400700 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb8140afb30 msgr2=0x7fb814153a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:08.473 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.465+0000 7fb819599700 1 --2- 172.21.15.149:0/2342400700 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb8140afb30 0x7fb814153a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:08.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.465+0000 7fb819599700 1 -- 172.21.15.149:0/2342400700 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8140b16b0 msgr2=0x7fb8140c88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:08.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.465+0000 7fb819599700 1 --2- 172.21.15.149:0/2342400700 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8140b16b0 0x7fb8140c88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:08.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.465+0000 7fb819599700 1 -- 172.21.15.149:0/2342400700 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb800009550 con 0x7fb8140b20b0 2023-11-08T19:23:08.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.465+0000 7fb819599700 1 --2- 172.21.15.149:0/2342400700 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8140b20b0 0x7fb8140b5460 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb80c00b970 tx=0x7fb80c00bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:08.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.465+0000 7fb8117fa700 1 -- 172.21.15.149:0/2342400700 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80c00c9b0 con 0x7fb8140b20b0 2023-11-08T19:23:08.475 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.465+0000 7fb8117fa700 1 -- 172.21.15.149:0/2342400700 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb80c00cb10 con 0x7fb8140b20b0 2023-11-08T19:23:08.475 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.465+0000 7fb81affc700 1 -- 172.21.15.149:0/2342400700 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8140c7dd0 con 0x7fb8140b20b0 2023-11-08T19:23:08.475 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.465+0000 7fb8117fa700 1 -- 172.21.15.149:0/2342400700 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80c014440 con 0x7fb8140b20b0 2023-11-08T19:23:08.475 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.465+0000 7fb81affc700 1 -- 172.21.15.149:0/2342400700 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb814153fb0 con 0x7fb8140b20b0 2023-11-08T19:23:08.475 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.466+0000 7fb81affc700 1 -- 172.21.15.149:0/2342400700 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8140745f0 con 0x7fb8140b20b0 2023-11-08T19:23:08.476 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.467+0000 7fb8117fa700 1 -- 172.21.15.149:0/2342400700 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb80c01d3b0 con 0x7fb8140b20b0 2023-11-08T19:23:08.476 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.467+0000 7fb8117fa700 1 --2- 172.21.15.149:0/2342400700 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb7f806af00 0x7fb7f806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:08.476 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.467+0000 7fb8117fa700 1 -- 172.21.15.149:0/2342400700 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb80c089570 con 0x7fb8140b20b0 2023-11-08T19:23:08.476 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.467+0000 7fb818d98700 1 --2- 172.21.15.149:0/2342400700 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb7f806af00 0x7fb7f806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:08.476 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.468+0000 7fb818d98700 1 --2- 172.21.15.149:0/2342400700 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb7f806af00 0x7fb7f806d3c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb8140c3bc0 tx=0x7fb808009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:08.477 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.472+0000 7fb8117fa700 1 -- 172.21.15.149:0/2342400700 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb80c054320 con 0x7fb8140b20b0 2023-11-08T19:23:08.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.664+0000 7fb81affc700 1 -- 172.21.15.149:0/2342400700 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb8140c3eb0 con 0x7fb8140b20b0 2023-11-08T19:23:08.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.665+0000 7fb8117fa700 1 -- 172.21.15.149:0/2342400700 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18382 (secure 0 0 0) 0x7fb80c057940 con 0x7fb8140b20b0 2023-11-08T19:23:08.667 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:23:08.667 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":24,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:23:06.964482+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-08T19:22:59.830928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-08T19:23:00.886589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-08T19:23:04.574033+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:23:08.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.667+0000 7fb81affc700 1 -- 172.21.15.149:0/2342400700 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb7f806af00 msgr2=0x7fb7f806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:08.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.667+0000 7fb81affc700 1 --2- 172.21.15.149:0/2342400700 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb7f806af00 0x7fb7f806d3c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb8140c3bc0 tx=0x7fb808009040 comp rx=0 tx=0).stop 2023-11-08T19:23:08.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.667+0000 7fb81affc700 1 -- 172.21.15.149:0/2342400700 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8140b20b0 msgr2=0x7fb8140b5460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:08.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.667+0000 7fb81affc700 1 --2- 172.21.15.149:0/2342400700 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8140b20b0 0x7fb8140b5460 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb80c00b970 tx=0x7fb80c00bd30 comp rx=0 tx=0).stop 2023-11-08T19:23:08.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.667+0000 7fb81affc700 1 -- 172.21.15.149:0/2342400700 shutdown_connections 2023-11-08T19:23:08.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.667+0000 7fb81affc700 1 --2- 172.21.15.149:0/2342400700 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb7f806af00 0x7fb7f806d3c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:08.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.667+0000 7fb81affc700 1 --2- 172.21.15.149:0/2342400700 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8140b20b0 0x7fb8140b5460 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:08.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.667+0000 7fb81affc700 1 --2- 172.21.15.149:0/2342400700 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb8140afb30 0x7fb814153a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:08.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.667+0000 7fb81affc700 1 --2- 172.21.15.149:0/2342400700 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8140b16b0 0x7fb8140c88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:08.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.667+0000 7fb81affc700 1 -- 172.21.15.149:0/2342400700 >> 172.21.15.149:0/2342400700 conn(0x7fb814099a40 msgr2=0x7fb8140ad2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:08.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.668+0000 7fb81affc700 1 -- 172.21.15.149:0/2342400700 shutdown_connections 2023-11-08T19:23:08.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.668+0000 7fb81affc700 1 -- 172.21.15.149:0/2342400700 wait complete. 2023-11-08T19:23:08.696 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:23:08.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.816+0000 7f306d343700 1 Processor -- start 2023-11-08T19:23:08.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.817+0000 7f306d343700 1 -- start start 2023-11-08T19:23:08.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.817+0000 7f306d343700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3068161670 0x7f30680b5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:08.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.817+0000 7f306d343700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f30680ce500 0x7f30680ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:08.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.817+0000 7f306d343700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30680d1a10 con 0x7f3068161a50 2023-11-08T19:23:08.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.817+0000 7f306d343700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30680d1cf0 con 0x7f3068161670 2023-11-08T19:23:08.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.817+0000 7f306d343700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30680d1fd0 con 0x7f30680ce500 2023-11-08T19:23:08.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.817+0000 7f3066ffd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3068161670 0x7f30680b5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:08.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.818+0000 7f3066ffd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3068161670 0x7f30680b5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36818/0 (socket says 172.21.15.149:36818) 2023-11-08T19:23:08.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.818+0000 7f30667fc700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f3068161a50 0x7f3068161f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:38820/0 (socket says 172.21.15.149:38820) 2023-11-08T19:23:08.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.818+0000 7f3066ffd700 1 -- 172.21.15.149:0/642674298 learned_addr learned my addr 172.21.15.149:0/642674298 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:08.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.818+0000 7f30677fe700 1 --2- 172.21.15.149:0/642674298 >> v2:172.21.15.160:3300/0 conn(0x7f30680ce500 0x7f30680ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:08.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.818+0000 7f3066ffd700 1 -- 172.21.15.149:0/642674298 >> v2:172.21.15.160:3300/0 conn(0x7f30680ce500 msgr2=0x7f30680ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:08.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.818+0000 7f3066ffd700 1 --2- 172.21.15.149:0/642674298 >> v2:172.21.15.160:3300/0 conn(0x7f30680ce500 0x7f30680ce970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:08.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.818+0000 7f3066ffd700 1 -- 172.21.15.149:0/642674298 >> v1:172.21.15.149:6789/0 conn(0x7f3068161a50 legacy=0x7f3068161f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:08.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.818+0000 7f3066ffd700 1 -- 172.21.15.149:0/642674298 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30680d22b0 con 0x7f3068161670 2023-11-08T19:23:08.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.818+0000 7f30677fe700 1 --2- 172.21.15.149:0/642674298 >> v2:172.21.15.160:3300/0 conn(0x7f30680ce500 0x7f30680ce970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:23:08.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.818+0000 7f3066ffd700 1 --2- 172.21.15.149:0/642674298 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3068161670 0x7f30680b5e10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f306806b590 tx=0x7f305c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=309f1a6af883191a server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:08.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.818+0000 7f3065ffb700 1 -- 172.21.15.149:0/642674298 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305c005e30 con 0x7f3068161670 2023-11-08T19:23:08.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.818+0000 7f3065ffb700 1 -- 172.21.15.149:0/642674298 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f305c004030 con 0x7f3068161670 2023-11-08T19:23:08.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.818+0000 7f3065ffb700 1 -- 172.21.15.149:0/642674298 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305c0043e0 con 0x7f3068161670 2023-11-08T19:23:08.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.819+0000 7f306d343700 1 -- 172.21.15.149:0/642674298 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3068161670 msgr2=0x7f30680b5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:08.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.819+0000 7f306d343700 1 --2- 172.21.15.149:0/642674298 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3068161670 0x7f30680b5e10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f306806b590 tx=0x7f305c009bd0 comp rx=0 tx=0).stop 2023-11-08T19:23:08.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.819+0000 7f306d343700 1 -- 172.21.15.149:0/642674298 shutdown_connections 2023-11-08T19:23:08.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.819+0000 7f306d343700 1 --2- 172.21.15.149:0/642674298 >> v2:172.21.15.160:3300/0 conn(0x7f30680ce500 0x7f30680ce970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:08.826 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.819+0000 7f306d343700 1 --2- 172.21.15.149:0/642674298 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3068161670 0x7f30680b5e10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:08.826 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.819+0000 7f306d343700 1 -- 172.21.15.149:0/642674298 >> 172.21.15.149:0/642674298 conn(0x7f30680d3980 msgr2=0x7f30680d3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:08.826 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.819+0000 7f306d343700 1 -- 172.21.15.149:0/642674298 shutdown_connections 2023-11-08T19:23:08.826 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.819+0000 7f306d343700 1 -- 172.21.15.149:0/642674298 wait complete. 2023-11-08T19:23:08.826 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.820+0000 7f306d343700 1 Processor -- start 2023-11-08T19:23:08.827 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.820+0000 7f306d343700 1 -- start start 2023-11-08T19:23:08.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.821+0000 7f306d343700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30680ce500 0x7f30680c6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:08.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.821+0000 7f306d343700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3068161670 0x7f30680cd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:08.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.821+0000 7f306d343700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3068161a50 0x7f30681f6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:08.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.821+0000 7f306d343700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30681f7780 con 0x7f30680ce500 2023-11-08T19:23:08.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.821+0000 7f306d343700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30681f7a60 con 0x7f3068161a50 2023-11-08T19:23:08.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.821+0000 7f306d343700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30680ccba0 con 0x7f3068161670 2023-11-08T19:23:08.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.821+0000 7f3066ffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30680ce500 0x7f30680c6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:08.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.821+0000 7f3066ffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30680ce500 0x7f30680c6420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36824/0 (socket says 172.21.15.149:36824) 2023-11-08T19:23:08.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.821+0000 7f3066ffd700 1 -- 172.21.15.149:0/2638677999 learned_addr learned my addr 172.21.15.149:0/2638677999 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:08.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.821+0000 7f30667fc700 1 --2- 172.21.15.149:0/2638677999 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3068161670 0x7f30680cd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:08.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.821+0000 7f30677fe700 1 --2- 172.21.15.149:0/2638677999 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3068161a50 0x7f30681f6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:08.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.821+0000 7f3066ffd700 1 -- 172.21.15.149:0/2638677999 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3068161670 msgr2=0x7f30680cd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:08.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.821+0000 7f3066ffd700 1 --2- 172.21.15.149:0/2638677999 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3068161670 0x7f30680cd3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:08.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.821+0000 7f3066ffd700 1 -- 172.21.15.149:0/2638677999 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3068161a50 msgr2=0x7f30681f6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:08.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.821+0000 7f3066ffd700 1 --2- 172.21.15.149:0/2638677999 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3068161a50 0x7f30681f6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:08.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.821+0000 7f3066ffd700 1 -- 172.21.15.149:0/2638677999 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f305c009500 con 0x7f30680ce500 2023-11-08T19:23:08.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.821+0000 7f3066ffd700 1 --2- 172.21.15.149:0/2638677999 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30680ce500 0x7f30680c6420 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f305c009c10 tx=0x7f305c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:08.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.821+0000 7f304f7fe700 1 -- 172.21.15.149:0/2638677999 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305c003c70 con 0x7f30680ce500 2023-11-08T19:23:08.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.821+0000 7f304f7fe700 1 -- 172.21.15.149:0/2638677999 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f305c003dd0 con 0x7f30680ce500 2023-11-08T19:23:08.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.821+0000 7f306d343700 1 -- 172.21.15.149:0/2638677999 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30680cce80 con 0x7f30680ce500 2023-11-08T19:23:08.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.821+0000 7f304f7fe700 1 -- 172.21.15.149:0/2638677999 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305c011640 con 0x7f30680ce500 2023-11-08T19:23:08.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.822+0000 7f306d343700 1 -- 172.21.15.149:0/2638677999 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30681591d0 con 0x7f30680ce500 2023-11-08T19:23:08.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.822+0000 7f306d343700 1 -- 172.21.15.149:0/2638677999 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30680cd0c0 con 0x7f30680ce500 2023-11-08T19:23:08.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.823+0000 7f304f7fe700 1 -- 172.21.15.149:0/2638677999 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f305c0117a0 con 0x7f30680ce500 2023-11-08T19:23:08.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.823+0000 7f304f7fe700 1 --2- 172.21.15.149:0/2638677999 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f305406af00 0x7f305406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:08.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.823+0000 7f304f7fe700 1 -- 172.21.15.149:0/2638677999 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f305c08a8f0 con 0x7f30680ce500 2023-11-08T19:23:08.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.823+0000 7f30667fc700 1 --2- 172.21.15.149:0/2638677999 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f305406af00 0x7f305406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:08.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.824+0000 7f30667fc700 1 --2- 172.21.15.149:0/2638677999 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f305406af00 0x7f305406d3c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f306814a040 tx=0x7f3058007ed0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:08.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:08.828+0000 7f304f7fe700 1 -- 172.21.15.149:0/2638677999 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f30680cd0c0 con 0x7f30680ce500 2023-11-08T19:23:09.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.061+0000 7f306d343700 1 -- 172.21.15.149:0/2638677999 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f30680cd0c0 con 0x7f30680ce500 2023-11-08T19:23:09.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.062+0000 7f304f7fe700 1 -- 172.21.15.149:0/2638677999 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4921 (secure 0 0 0) 0x7f30680cd0c0 con 0x7f30680ce500 2023-11-08T19:23:09.064 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:23:09.064 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4252,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/2277605177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":2277605177},{"type":"v1","addr":"172.21.15.149:6837","nonce":2277605177}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/2774257644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2774257644},{"type":"v1","addr":"172.21.15.149:6836","nonce":2774257644}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/2076428669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":2076428669},{"type":"v1","addr":"172.21.15.160:6835","nonce":2076428669}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-08T19:23:01.918138+0000","modified":"2023-11-08T19:23:06.964670+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.160:6834/3847116435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3847116435},{"type":"v1","addr":"172.21.15.160:6834","nonce":3847116435}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-11-08T19:23:09.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.064+0000 7f306d343700 1 -- 172.21.15.149:0/2638677999 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f305406af00 msgr2=0x7f305406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:09.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.064+0000 7f306d343700 1 --2- 172.21.15.149:0/2638677999 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f305406af00 0x7f305406d3c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f306814a040 tx=0x7f3058007ed0 comp rx=0 tx=0).stop 2023-11-08T19:23:09.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.064+0000 7f306d343700 1 -- 172.21.15.149:0/2638677999 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30680ce500 msgr2=0x7f30680c6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:09.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.064+0000 7f306d343700 1 --2- 172.21.15.149:0/2638677999 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30680ce500 0x7f30680c6420 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f305c009c10 tx=0x7f305c004750 comp rx=0 tx=0).stop 2023-11-08T19:23:09.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.064+0000 7f306d343700 1 -- 172.21.15.149:0/2638677999 shutdown_connections 2023-11-08T19:23:09.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.064+0000 7f306d343700 1 --2- 172.21.15.149:0/2638677999 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f305406af00 0x7f305406d3c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:09.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.064+0000 7f306d343700 1 --2- 172.21.15.149:0/2638677999 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3068161a50 0x7f30681f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:09.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.064+0000 7f306d343700 1 --2- 172.21.15.149:0/2638677999 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30680ce500 0x7f30680c6420 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:09.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.064+0000 7f306d343700 1 --2- 172.21.15.149:0/2638677999 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3068161670 0x7f30680cd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:09.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.064+0000 7f306d343700 1 -- 172.21.15.149:0/2638677999 >> 172.21.15.149:0/2638677999 conn(0x7f30680d3980 msgr2=0x7f30680cf200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:09.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.064+0000 7f306d343700 1 -- 172.21.15.149:0/2638677999 shutdown_connections 2023-11-08T19:23:09.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.064+0000 7f306d343700 1 -- 172.21.15.149:0/2638677999 wait complete. 2023-11-08T19:23:09.068 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 7 2023-11-08T19:23:09.078 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:23:09.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.198+0000 7f676bd1d700 1 Processor -- start 2023-11-08T19:23:09.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.198+0000 7f676bd1d700 1 -- start start 2023-11-08T19:23:09.202 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.199+0000 7f676bd1d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f676415a1a0 0x7f676406e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:09.202 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.199+0000 7f676bd1d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f676406da50 0x7f676406bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:09.203 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.199+0000 7f676bd1d700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f676406c0d0 0x7f676415dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:09.203 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.199+0000 7f676bd1d700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f676415a580 con 0x7f676415a1a0 2023-11-08T19:23:09.203 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.199+0000 7f676bd1d700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f676406c560 con 0x7f676406c0d0 2023-11-08T19:23:09.203 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.199+0000 7f676bd1d700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67640725a0 con 0x7f676406da50 2023-11-08T19:23:09.203 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.199+0000 7f6769ab9700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f676415a1a0 0x7f676406e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:09.204 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.199+0000 7f6769ab9700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f676415a1a0 0x7f676406e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36832/0 (socket says 172.21.15.149:36832) 2023-11-08T19:23:09.204 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.199+0000 7f6769ab9700 1 -- 172.21.15.149:0/2150640748 learned_addr learned my addr 172.21.15.149:0/2150640748 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:09.204 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.199+0000 7f676a2ba700 1 --2- 172.21.15.149:0/2150640748 >> v2:172.21.15.160:3300/0 conn(0x7f676406c0d0 0x7f676415dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:09.204 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.199+0000 7f67692b8700 1 --2- 172.21.15.149:0/2150640748 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f676406da50 0x7f676406bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:09.204 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.199+0000 7f6769ab9700 1 -- 172.21.15.149:0/2150640748 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f676406da50 msgr2=0x7f676406bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:09.205 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.199+0000 7f6769ab9700 1 --2- 172.21.15.149:0/2150640748 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f676406da50 0x7f676406bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:09.205 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.199+0000 7f6769ab9700 1 -- 172.21.15.149:0/2150640748 >> v2:172.21.15.160:3300/0 conn(0x7f676406c0d0 msgr2=0x7f676415dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:09.205 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.199+0000 7f6769ab9700 1 --2- 172.21.15.149:0/2150640748 >> v2:172.21.15.160:3300/0 conn(0x7f676406c0d0 0x7f676415dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:09.205 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.199+0000 7f6769ab9700 1 -- 172.21.15.149:0/2150640748 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67640cb220 con 0x7f676415a1a0 2023-11-08T19:23:09.205 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.199+0000 7f6769ab9700 1 --2- 172.21.15.149:0/2150640748 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f676415a1a0 0x7f676406e940 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f67640b5d30 tx=0x7f6760009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad176236800705fe server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:09.206 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.199+0000 7f6768ab7700 1 -- 172.21.15.149:0/2150640748 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676000b870 con 0x7f676415a1a0 2023-11-08T19:23:09.206 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.199+0000 7f6768ab7700 1 -- 172.21.15.149:0/2150640748 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f676000b9d0 con 0x7f676415a1a0 2023-11-08T19:23:09.206 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.199+0000 7f6768ab7700 1 -- 172.21.15.149:0/2150640748 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676000bd60 con 0x7f676415a1a0 2023-11-08T19:23:09.206 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.200+0000 7f676bd1d700 1 -- 172.21.15.149:0/2150640748 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f676415a1a0 msgr2=0x7f676406e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:09.206 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.200+0000 7f676bd1d700 1 --2- 172.21.15.149:0/2150640748 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f676415a1a0 0x7f676406e940 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f67640b5d30 tx=0x7f6760009bd0 comp rx=0 tx=0).stop 2023-11-08T19:23:09.207 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.200+0000 7f676bd1d700 1 -- 172.21.15.149:0/2150640748 shutdown_connections 2023-11-08T19:23:09.207 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.200+0000 7f676bd1d700 1 --2- 172.21.15.149:0/2150640748 >> v2:172.21.15.160:3300/0 conn(0x7f676406c0d0 0x7f676415dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:09.207 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.200+0000 7f676bd1d700 1 --2- 172.21.15.149:0/2150640748 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f676415a1a0 0x7f676406e940 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:09.207 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.200+0000 7f676bd1d700 1 --2- 172.21.15.149:0/2150640748 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f676406da50 0x7f676406bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:09.207 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.200+0000 7f676bd1d700 1 -- 172.21.15.149:0/2150640748 >> 172.21.15.149:0/2150640748 conn(0x7f6764071720 msgr2=0x7f6764071b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:09.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.200+0000 7f676bd1d700 1 -- 172.21.15.149:0/2150640748 shutdown_connections 2023-11-08T19:23:09.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.200+0000 7f676bd1d700 1 -- 172.21.15.149:0/2150640748 wait complete. 2023-11-08T19:23:09.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.201+0000 7f676bd1d700 1 Processor -- start 2023-11-08T19:23:09.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.201+0000 7f676bd1d700 1 -- start start 2023-11-08T19:23:09.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.202+0000 7f676bd1d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f676406c0d0 0x7f6764154940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:09.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.202+0000 7f676bd1d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f676406da50 0x7f6764142190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:09.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.202+0000 7f676bd1d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f676415a1a0 0x7f6764152fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:09.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.202+0000 7f676bd1d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67640c64f0 con 0x7f676415a1a0 2023-11-08T19:23:09.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.202+0000 7f676bd1d700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67641426d0 con 0x7f676406c0d0 2023-11-08T19:23:09.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.202+0000 7f676bd1d700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67641538a0 con 0x7f676406da50 2023-11-08T19:23:09.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.202+0000 7f676a2ba700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f676415a1a0 0x7f6764152fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:09.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.202+0000 7f676a2ba700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f676415a1a0 0x7f6764152fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36842/0 (socket says 172.21.15.149:36842) 2023-11-08T19:23:09.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.202+0000 7f676a2ba700 1 -- 172.21.15.149:0/2113612310 learned_addr learned my addr 172.21.15.149:0/2113612310 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:09.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.202+0000 7f6769ab9700 1 --2- 172.21.15.149:0/2113612310 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f676406c0d0 0x7f6764154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:09.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.202+0000 7f67692b8700 1 --2- 172.21.15.149:0/2113612310 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f676406da50 0x7f6764142190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:09.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.202+0000 7f676a2ba700 1 -- 172.21.15.149:0/2113612310 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f676406da50 msgr2=0x7f6764142190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:09.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.202+0000 7f676a2ba700 1 --2- 172.21.15.149:0/2113612310 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f676406da50 0x7f6764142190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:09.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.202+0000 7f676a2ba700 1 -- 172.21.15.149:0/2113612310 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f676406c0d0 msgr2=0x7f6764154940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:09.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.202+0000 7f676a2ba700 1 --2- 172.21.15.149:0/2113612310 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f676406c0d0 0x7f6764154940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:09.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.202+0000 7f676a2ba700 1 -- 172.21.15.149:0/2113612310 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6760009550 con 0x7f676415a1a0 2023-11-08T19:23:09.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.202+0000 7f676a2ba700 1 --2- 172.21.15.149:0/2113612310 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f676415a1a0 0x7f6764152fc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f675c007e00 tx=0x7f675c00e330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:09.216 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.203+0000 7f675a7fc700 1 -- 172.21.15.149:0/2113612310 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675c011070 con 0x7f676415a1a0 2023-11-08T19:23:09.216 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.203+0000 7f675a7fc700 1 -- 172.21.15.149:0/2113612310 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f675c00c2e0 con 0x7f676415a1a0 2023-11-08T19:23:09.216 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.203+0000 7f676bd1d700 1 -- 172.21.15.149:0/2113612310 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6764153b80 con 0x7f676415a1a0 2023-11-08T19:23:09.216 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.203+0000 7f675a7fc700 1 -- 172.21.15.149:0/2113612310 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675c003c40 con 0x7f676415a1a0 2023-11-08T19:23:09.216 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.203+0000 7f676bd1d700 1 -- 172.21.15.149:0/2113612310 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6764154140 con 0x7f676415a1a0 2023-11-08T19:23:09.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.204+0000 7f676bd1d700 1 -- 172.21.15.149:0/2113612310 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67640745f0 con 0x7f676415a1a0 2023-11-08T19:23:09.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.204+0000 7f675a7fc700 1 -- 172.21.15.149:0/2113612310 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f675c00e8d0 con 0x7f676415a1a0 2023-11-08T19:23:09.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.204+0000 7f675a7fc700 1 --2- 172.21.15.149:0/2113612310 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f674806af00 0x7f674806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:09.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.205+0000 7f675a7fc700 1 -- 172.21.15.149:0/2113612310 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f675c08b510 con 0x7f676415a1a0 2023-11-08T19:23:09.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.205+0000 7f6769ab9700 1 --2- 172.21.15.149:0/2113612310 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f674806af00 0x7f674806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:09.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.205+0000 7f6769ab9700 1 --2- 172.21.15.149:0/2113612310 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f674806af00 0x7f674806d3c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6760014040 tx=0x7f6760008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:09.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.209+0000 7f675a7fc700 1 -- 172.21.15.149:0/2113612310 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f675c056360 con 0x7f676415a1a0 2023-11-08T19:23:09.403 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.402+0000 7f676bd1d700 1 -- 172.21.15.149:0/2113612310 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f67640b5d80 con 0x7f676415a1a0 2023-11-08T19:23:09.404 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.403+0000 7f675a7fc700 1 -- 172.21.15.149:0/2113612310 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18382 (secure 0 0 0) 0x7f675c059980 con 0x7f676415a1a0 2023-11-08T19:23:09.405 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:23:09.405 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":24,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:23:06.964482+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-08T19:22:59.830928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-08T19:23:00.886589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-08T19:23:04.574033+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:23:09.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.405+0000 7f676bd1d700 1 -- 172.21.15.149:0/2113612310 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f674806af00 msgr2=0x7f674806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:09.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.405+0000 7f676bd1d700 1 --2- 172.21.15.149:0/2113612310 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f674806af00 0x7f674806d3c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6760014040 tx=0x7f6760008030 comp rx=0 tx=0).stop 2023-11-08T19:23:09.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.405+0000 7f676bd1d700 1 -- 172.21.15.149:0/2113612310 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f676415a1a0 msgr2=0x7f6764152fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:09.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.405+0000 7f676bd1d700 1 --2- 172.21.15.149:0/2113612310 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f676415a1a0 0x7f6764152fc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f675c007e00 tx=0x7f675c00e330 comp rx=0 tx=0).stop 2023-11-08T19:23:09.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.405+0000 7f676bd1d700 1 -- 172.21.15.149:0/2113612310 shutdown_connections 2023-11-08T19:23:09.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.405+0000 7f676bd1d700 1 --2- 172.21.15.149:0/2113612310 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f674806af00 0x7f674806d3c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:09.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.405+0000 7f676bd1d700 1 --2- 172.21.15.149:0/2113612310 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f676406c0d0 0x7f6764154940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:09.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.405+0000 7f676bd1d700 1 --2- 172.21.15.149:0/2113612310 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f676415a1a0 0x7f6764152fc0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:09.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.405+0000 7f676bd1d700 1 --2- 172.21.15.149:0/2113612310 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f676406da50 0x7f6764142190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:09.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.405+0000 7f676bd1d700 1 -- 172.21.15.149:0/2113612310 >> 172.21.15.149:0/2113612310 conn(0x7f6764071720 msgr2=0x7f676406ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:09.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.405+0000 7f676bd1d700 1 -- 172.21.15.149:0/2113612310 shutdown_connections 2023-11-08T19:23:09.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.405+0000 7f676bd1d700 1 -- 172.21.15.149:0/2113612310 wait complete. 2023-11-08T19:23:09.822 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-08T19:23:01.918138+0000', 'modified': '2023-11-08T19:23:06.964670+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4264}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4264': {'gid': 4264, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.160:6834/3847116435', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6832', 'nonce': 3847116435}, {'type': 'v1', 'addr': '172.21.15.160:6834', 'nonce': 3847116435}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-11-08T19:23:09.823 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-08T19:23:09.823 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-11-08T19:23:09.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.943+0000 7f5b2c35c700 1 Processor -- start 2023-11-08T19:23:09.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.943+0000 7f5b2c35c700 1 -- start start 2023-11-08T19:23:09.947 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.944+0000 7f5b2c35c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f5b240ce840 0x7f5b240d0430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:09.947 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.944+0000 7f5b2c35c700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b240cc2e0 con 0x7f5b240cd5e0 2023-11-08T19:23:09.948 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.944+0000 7f5b2c35c700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b240cc580 con 0x7f5b2415b950 2023-11-08T19:23:09.948 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.944+0000 7f5b2c35c700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b240cc820 con 0x7f5b240ce840 2023-11-08T19:23:09.948 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.944+0000 7f5b2a8f9700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f5b240ce840 0x7f5b240d0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:09.948 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.945+0000 7f5b2a8f9700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f5b240ce840 0x7f5b240d0430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36850/0 (socket says 172.21.15.149:36850) 2023-11-08T19:23:09.948 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.945+0000 7f5b2a8f9700 1 -- 172.21.15.149:0/3749617501 learned_addr learned my addr 172.21.15.149:0/3749617501 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:09.949 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.945+0000 7f5b298f7700 1 --1- 172.21.15.149:0/3749617501 >> v1:172.21.15.149:6789/0 conn(0x7f5b240cd5e0 0x7f5b240cfd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:38850/0 (socket says 172.21.15.149:38850) 2023-11-08T19:23:09.949 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.945+0000 7f5b2a8f9700 1 -- 172.21.15.149:0/3749617501 >> v1:172.21.15.160:6789/0 conn(0x7f5b2415b950 legacy=0x7f5b240ce130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:09.949 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.945+0000 7f5b2a8f9700 1 -- 172.21.15.149:0/3749617501 >> v1:172.21.15.149:6789/0 conn(0x7f5b240cd5e0 legacy=0x7f5b240cfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:09.949 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.945+0000 7f5b2a8f9700 1 -- 172.21.15.149:0/3749617501 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b240ccb00 con 0x7f5b240ce840 2023-11-08T19:23:09.949 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.945+0000 7f5b2a8f9700 1 --2- 172.21.15.149:0/3749617501 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b240ce840 0x7f5b240d0430 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c009e50 tx=0x7f5b1c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efc6e2939572c139 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:09.950 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.945+0000 7f5b290f6700 1 -- 172.21.15.149:0/3749617501 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c00e070 con 0x7f5b240ce840 2023-11-08T19:23:09.950 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.945+0000 7f5b290f6700 1 -- 172.21.15.149:0/3749617501 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b1c003a20 con 0x7f5b240ce840 2023-11-08T19:23:09.950 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.945+0000 7f5b290f6700 1 -- 172.21.15.149:0/3749617501 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c003dd0 con 0x7f5b240ce840 2023-11-08T19:23:09.950 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.946+0000 7f5b2c35c700 1 -- 172.21.15.149:0/3749617501 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b240ce840 msgr2=0x7f5b240d0430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:09.950 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.946+0000 7f5b2c35c700 1 --2- 172.21.15.149:0/3749617501 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b240ce840 0x7f5b240d0430 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c009e50 tx=0x7f5b1c00b330 comp rx=0 tx=0).stop 2023-11-08T19:23:09.951 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.946+0000 7f5b2c35c700 1 -- 172.21.15.149:0/3749617501 shutdown_connections 2023-11-08T19:23:09.951 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.946+0000 7f5b2c35c700 1 --2- 172.21.15.149:0/3749617501 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b240ce840 0x7f5b240d0430 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:09.951 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.946+0000 7f5b2c35c700 1 -- 172.21.15.149:0/3749617501 >> 172.21.15.149:0/3749617501 conn(0x7f5b2408afd0 msgr2=0x7f5b240d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:09.951 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.946+0000 7f5b2c35c700 1 -- 172.21.15.149:0/3749617501 shutdown_connections 2023-11-08T19:23:09.951 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.946+0000 7f5b2c35c700 1 -- 172.21.15.149:0/3749617501 wait complete. 2023-11-08T19:23:09.956 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.947+0000 7f5b2c35c700 1 Processor -- start 2023-11-08T19:23:09.956 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.947+0000 7f5b2c35c700 1 -- start start 2023-11-08T19:23:09.956 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.948+0000 7f5b2c35c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b240ce840 0x7f5b24154f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:09.956 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.948+0000 7f5b2c35c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b2415b950 0x7f5b240cff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:09.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.948+0000 7f5b2c35c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b240d04d0 0x7f5b241e69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:09.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.948+0000 7f5b2c35c700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b240d0980 con 0x7f5b2415b950 2023-11-08T19:23:09.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.948+0000 7f5b2c35c700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b24155450 con 0x7f5b240d04d0 2023-11-08T19:23:09.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.948+0000 7f5b2c35c700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b241e7750 con 0x7f5b240ce840 2023-11-08T19:23:09.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.948+0000 7f5b298f7700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b2415b950 0x7f5b240cff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:09.958 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.948+0000 7f5b298f7700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b2415b950 0x7f5b240cff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36856/0 (socket says 172.21.15.149:36856) 2023-11-08T19:23:09.958 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.948+0000 7f5b298f7700 1 -- 172.21.15.149:0/3520975063 learned_addr learned my addr 172.21.15.149:0/3520975063 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:09.958 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.948+0000 7f5b2a8f9700 1 --2- 172.21.15.149:0/3520975063 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b240d04d0 0x7f5b241e69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:09.958 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.948+0000 7f5b298f7700 1 -- 172.21.15.149:0/3520975063 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b240ce840 msgr2=0x7f5b24154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:09.958 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.948+0000 7f5b298f7700 1 --2- 172.21.15.149:0/3520975063 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b240ce840 0x7f5b24154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:09.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.948+0000 7f5b298f7700 1 -- 172.21.15.149:0/3520975063 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b240d04d0 msgr2=0x7f5b241e69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:09.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.948+0000 7f5b298f7700 1 --2- 172.21.15.149:0/3520975063 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b240d04d0 0x7f5b241e69e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:09.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.948+0000 7f5b298f7700 1 -- 172.21.15.149:0/3520975063 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b1c009b30 con 0x7f5b2415b950 2023-11-08T19:23:09.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.948+0000 7f5b298f7700 1 --2- 172.21.15.149:0/3520975063 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b2415b950 0x7f5b240cff90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5b1400c500 tx=0x7f5b1400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:09.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.948+0000 7f5b1affd700 1 -- 172.21.15.149:0/3520975063 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b14005cb0 con 0x7f5b2415b950 2023-11-08T19:23:09.960 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.948+0000 7f5b1affd700 1 -- 172.21.15.149:0/3520975063 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b14005e10 con 0x7f5b2415b950 2023-11-08T19:23:09.960 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.948+0000 7f5b2c35c700 1 -- 172.21.15.149:0/3520975063 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b241e7a30 con 0x7f5b2415b950 2023-11-08T19:23:09.960 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.948+0000 7f5b2c35c700 1 -- 172.21.15.149:0/3520975063 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b2415c0d0 con 0x7f5b2415b950 2023-11-08T19:23:09.960 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.948+0000 7f5b1affd700 1 -- 172.21.15.149:0/3520975063 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b140072f0 con 0x7f5b2415b950 2023-11-08T19:23:09.960 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.950+0000 7f5b1affd700 1 -- 172.21.15.149:0/3520975063 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5b14007450 con 0x7f5b2415b950 2023-11-08T19:23:09.961 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.950+0000 7f5b1affd700 1 --2- 172.21.15.149:0/3520975063 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5b0806af00 0x7f5b0806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:09.961 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.950+0000 7f5b2a0f8700 1 --2- 172.21.15.149:0/3520975063 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5b0806af00 0x7f5b0806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:09.961 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.950+0000 7f5b1affd700 1 -- 172.21.15.149:0/3520975063 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5b14088e50 con 0x7f5b2415b950 2023-11-08T19:23:09.961 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.951+0000 7f5b2a0f8700 1 --2- 172.21.15.149:0/3520975063 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5b0806af00 0x7f5b0806d3c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5b200096f0 tx=0x7f5b20006c40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:09.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.952+0000 7f5b38555b80 1 Processor -- start 2023-11-08T19:23:09.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.952+0000 7f5b38555b80 1 -- start start 2023-11-08T19:23:09.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.953+0000 7f5b38555b80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c3f6f6b6f0 0x55c3f6f9b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:09.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.953+0000 7f5b38555b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c3f6f6dc30 0x55c3f6f9b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:09.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.953+0000 7f5b38555b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c3f6f6bad0 0x55c3f6f85f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:09.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.953+0000 7f5b38555b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3f6ed76e0 con 0x55c3f6f6bad0 2023-11-08T19:23:09.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.953+0000 7f5b38555b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3f6ecb3b0 con 0x55c3f6f6dc30 2023-11-08T19:23:09.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.953+0000 7f5b38555b80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c3f6ec8cd0 con 0x55c3f6f6b6f0 2023-11-08T19:23:09.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.953+0000 7f5b2a8f9700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c3f6f6bad0 0x55c3f6f85f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:09.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.953+0000 7f5b2a8f9700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c3f6f6bad0 0x55c3f6f85f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36864/0 (socket says 172.21.15.149:36864) 2023-11-08T19:23:09.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.953+0000 7f5b2a8f9700 1 -- 172.21.15.149:0/3155053817 learned_addr learned my addr 172.21.15.149:0/3155053817 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:09.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.953+0000 7f5b2a0f8700 1 --2- 172.21.15.149:0/3155053817 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c3f6f6b6f0 0x55c3f6f9b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:09.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.953+0000 7f5b298f7700 1 --2- 172.21.15.149:0/3155053817 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c3f6f6dc30 0x55c3f6f9b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:09.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.953+0000 7f5b2a8f9700 1 -- 172.21.15.149:0/3155053817 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c3f6f6b6f0 msgr2=0x55c3f6f9b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:09.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.953+0000 7f5b2a8f9700 1 --2- 172.21.15.149:0/3155053817 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c3f6f6b6f0 0x55c3f6f9b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:09.965 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.953+0000 7f5b2a8f9700 1 -- 172.21.15.149:0/3155053817 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c3f6f6dc30 msgr2=0x55c3f6f9b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:09.965 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.953+0000 7f5b2a8f9700 1 --2- 172.21.15.149:0/3155053817 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c3f6f6dc30 0x55c3f6f9b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:09.965 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.953+0000 7f5b2a8f9700 1 -- 172.21.15.149:0/3155053817 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c3f6d415e0 con 0x55c3f6f6bad0 2023-11-08T19:23:09.965 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.954+0000 7f5b2a0f8700 1 --2- 172.21.15.149:0/3155053817 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c3f6f6b6f0 0x55c3f6f9b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:23:09.965 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.954+0000 7f5b2a8f9700 1 --2- 172.21.15.149:0/3155053817 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c3f6f6bad0 0x55c3f6f85f90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c004000 tx=0x7f5b1c010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f06daa3a9dd2ed2a server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:09.965 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.954+0000 7f5b07fff700 1 -- 172.21.15.149:0/3155053817 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c003e90 con 0x55c3f6f6bad0 2023-11-08T19:23:09.966 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.954+0000 7f5b07fff700 1 -- 172.21.15.149:0/3155053817 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b1c00b980 con 0x55c3f6f6bad0 2023-11-08T19:23:09.966 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.954+0000 7f5b07fff700 1 -- 172.21.15.149:0/3155053817 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c00bd10 con 0x55c3f6f6bad0 2023-11-08T19:23:09.966 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.954+0000 7f5b38555b80 1 -- 172.21.15.149:0/3155053817 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c3f6f6bad0 msgr2=0x55c3f6f85f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:09.966 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.954+0000 7f5b38555b80 1 --2- 172.21.15.149:0/3155053817 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c3f6f6bad0 0x55c3f6f85f90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c004000 tx=0x7f5b1c010000 comp rx=0 tx=0).stop 2023-11-08T19:23:09.966 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.955+0000 7f5b38555b80 1 -- 172.21.15.149:0/3155053817 shutdown_connections 2023-11-08T19:23:09.967 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.955+0000 7f5b38555b80 1 --2- 172.21.15.149:0/3155053817 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c3f6f6bad0 0x55c3f6f85f90 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:09.967 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.955+0000 7f5b38555b80 1 --2- 172.21.15.149:0/3155053817 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c3f6f6b6f0 0x55c3f6f9b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:09.967 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.955+0000 7f5b38555b80 1 --2- 172.21.15.149:0/3155053817 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c3f6f6dc30 0x55c3f6f9b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:09.967 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.955+0000 7f5b38555b80 1 -- 172.21.15.149:0/3155053817 >> 172.21.15.149:0/3155053817 conn(0x55c3f6ee6660 msgr2=0x55c3f6f713c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:09.967 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.955+0000 7f5b38555b80 1 -- 172.21.15.149:0/3155053817 shutdown_connections 2023-11-08T19:23:09.968 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.955+0000 7f5b38555b80 1 -- 172.21.15.149:0/3155053817 wait complete. 2023-11-08T19:23:09.972 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.955+0000 7f5b38555b80 1 -- start start 2023-11-08T19:23:09.972 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.955+0000 7f5b38555b80 1 Processor -- start 2023-11-08T19:23:09.972 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.956+0000 7f5b38555b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c3f6f6b6f0 0x55c3f6fc9610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:09.973 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.956+0000 7f5b38555b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c3f6f6bad0 0x55c3f6f9b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:09.973 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.956+0000 7f5b38555b80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c3f6fb7dc0 0x55c3f6f9b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:09.973 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.956+0000 7f5b38555b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3f6ec45c0 con 0x55c3f6f6bad0 2023-11-08T19:23:09.973 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.956+0000 7f5b38555b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3f6e600d0 con 0x55c3f6f6b6f0 2023-11-08T19:23:09.973 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.956+0000 7f5b38555b80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c3f6e5fd70 con 0x55c3f6fb7dc0 2023-11-08T19:23:09.974 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.956+0000 7f5b38555b80 10 client.0 _ll_register_callbacks cb 0x55c3f6cbc7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-08T19:23:09.974 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.956+0000 7f5b298f7700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c3f6f6bad0 0x55c3f6f9b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:09.974 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.956+0000 7f5b298f7700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c3f6f6bad0 0x55c3f6f9b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36868/0 (socket says 172.21.15.149:36868) 2023-11-08T19:23:09.974 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.956+0000 7f5b298f7700 1 -- 172.21.15.149:0/3490296286 learned_addr learned my addr 172.21.15.149:0/3490296286 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:09.975 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.956+0000 7f5b2a0f8700 1 --2- 172.21.15.149:0/3490296286 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c3f6f6b6f0 0x55c3f6fc9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:09.975 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.956+0000 7f5b2a8f9700 1 --2- 172.21.15.149:0/3490296286 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c3f6fb7dc0 0x55c3f6f9b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:09.975 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.957+0000 7f5b298f7700 1 -- 172.21.15.149:0/3490296286 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c3f6fb7dc0 msgr2=0x55c3f6f9b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:09.975 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.957+0000 7f5b298f7700 1 --2- 172.21.15.149:0/3490296286 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c3f6fb7dc0 0x55c3f6f9b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:09.975 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.957+0000 7f5b298f7700 1 -- 172.21.15.149:0/3490296286 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c3f6f6b6f0 msgr2=0x55c3f6fc9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:09.976 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.957+0000 7f5b298f7700 1 --2- 172.21.15.149:0/3490296286 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c3f6f6b6f0 0x55c3f6fc9610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:09.976 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.957+0000 7f5b298f7700 1 -- 172.21.15.149:0/3490296286 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b240ccb00 con 0x55c3f6f6bad0 2023-11-08T19:23:09.976 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.957+0000 7f5b298f7700 1 --2- 172.21.15.149:0/3490296286 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c3f6f6bad0 0x55c3f6f9b440 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5b140574c0 tx=0x7f5b14076330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=103e7b67ab35f4bb server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:09.976 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.957+0000 7f5b057fa700 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2023-11-08T19:23:09.976 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.957+0000 7f5b057fa700 1 -- 172.21.15.149:0/3490296286 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b14056eb0 con 0x55c3f6f6bad0 2023-11-08T19:23:09.977 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.957+0000 7f5b057fa700 1 -- 172.21.15.149:0/3490296286 <== mon.0 v2:172.21.15.149:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5b1405b910 con 0x55c3f6f6bad0 2023-11-08T19:23:09.977 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.957+0000 7f5b38555b80 1 -- 172.21.15.149:0/3490296286 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c3f6f63880 con 0x55c3f6f6bad0 2023-11-08T19:23:09.977 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.957+0000 7f5b057fa700 1 -- 172.21.15.149:0/3490296286 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5b1406f180 con 0x55c3f6f6bad0 2023-11-08T19:23:09.977 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.957+0000 7f5b38555b80 10 client.4398 fetch_fsmap learned FSMap version 7 2023-11-08T19:23:09.977 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.957+0000 7f5b38555b80 1 -- 172.21.15.149:0/3490296286 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55c3f6cedd90 con 0x55c3f6f6bad0 2023-11-08T19:23:09.978 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.957+0000 7f5b057fa700 1 -- 172.21.15.149:0/3490296286 <== mon.0 v2:172.21.15.149:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b14084070 con 0x55c3f6f6bad0 2023-11-08T19:23:09.978 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.957+0000 7f5b057fa700 1 -- 172.21.15.149:0/3490296286 <== mon.0 v2:172.21.15.149:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f5b1405f6c0 con 0x55c3f6f6bad0 2023-11-08T19:23:09.978 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.957+0000 7f5b38555b80 10 client.4398 fetch_fsmap finished waiting for FSMap version 7 2023-11-08T19:23:09.978 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.957+0000 7f5b38555b80 10 client.4398 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-08T19:23:09.979 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.957+0000 7f5b38555b80 20 client.4398 populate_metadata read hostname 'smithi149' 2023-11-08T19:23:09.979 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.957+0000 7f5b38555b80 1 --2- 172.21.15.149:0/3490296286 >> [v2:172.21.15.160:6832/3847116435,v1:172.21.15.160:6834/3847116435] conn(0x55c3f6fafed0 0x55c3f6fc5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:09.979 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.957+0000 7f5b38555b80 4 client.4398 mds_command: new command op to 4264 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-08T19:23:09.979 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.957+0000 7f5b38555b80 1 -- 172.21.15.149:0/3490296286 --> [v2:172.21.15.160:6832/3847116435,v1:172.21.15.160:6834/3847116435] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c3f6f3fa30 con 0x55c3f6fafed0 2023-11-08T19:23:09.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.957+0000 7f5b2a0f8700 1 --2- 172.21.15.149:0/3490296286 >> [v2:172.21.15.160:6832/3847116435,v1:172.21.15.160:6834/3847116435] conn(0x55c3f6fafed0 0x55c3f6fc5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:09.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.958+0000 7f5b057fa700 10 client.4398 ms_handle_connect on v2:172.21.15.160:6832/3847116435 2023-11-08T19:23:09.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.958+0000 7f5b2a0f8700 1 --2- 172.21.15.149:0/3490296286 >> [v2:172.21.15.160:6832/3847116435,v1:172.21.15.160:6834/3847116435] conn(0x55c3f6fafed0 0x55c3f6fc5660 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6c61feb979e7b6d server_cookie=adec8c1552123e4f in_seq=0 out_seq=0 2023-11-08T19:23:09.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.959+0000 7f5b057fa700 1 -- 172.21.15.149:0/3490296286 <== mds.0 v2:172.21.15.160:6832/3847116435 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c3f6f3fa30 con 0x55c3f6fafed0 2023-11-08T19:23:09.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.959+0000 7f5b057fa700 10 client.4398 handle_command_reply: tid=0 2023-11-08T19:23:09.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.959+0000 7f5b38555b80 1 client.4398 shutdown 2023-11-08T19:23:09.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.959+0000 7f5b38555b80 1 -- 172.21.15.149:0/3490296286 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c3f6f6bad0 msgr2=0x55c3f6f9b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:09.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.959+0000 7f5b38555b80 1 --2- 172.21.15.149:0/3490296286 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c3f6f6bad0 0x55c3f6f9b440 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5b140574c0 tx=0x7f5b14076330 comp rx=0 tx=0).stop 2023-11-08T19:23:09.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.959+0000 7f5b38555b80 1 -- 172.21.15.149:0/3490296286 shutdown_connections 2023-11-08T19:23:09.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.959+0000 7f5b38555b80 1 --2- 172.21.15.149:0/3490296286 >> [v2:172.21.15.160:6832/3847116435,v1:172.21.15.160:6834/3847116435] conn(0x55c3f6fafed0 0x55c3f6fc5660 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:09.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.959+0000 7f5b38555b80 1 --2- 172.21.15.149:0/3490296286 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c3f6f6b6f0 0x55c3f6fc9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:09.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.959+0000 7f5b38555b80 1 --2- 172.21.15.149:0/3490296286 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c3f6fb7dc0 0x55c3f6f9b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:09.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.959+0000 7f5b38555b80 1 --2- 172.21.15.149:0/3490296286 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c3f6f6bad0 0x55c3f6f9b440 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:09.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.959+0000 7f5b057fa700 0 client.4398 ms_handle_reset on v2:172.21.15.160:6832/3847116435 2023-11-08T19:23:09.983 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.959+0000 7f5b38555b80 1 -- 172.21.15.149:0/3490296286 >> 172.21.15.149:0/3490296286 conn(0x55c3f6ee6660 msgr2=0x55c3f6f70bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:09.983 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.959+0000 7f5b38555b80 1 -- 172.21.15.149:0/3490296286 shutdown_connections 2023-11-08T19:23:09.983 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.959+0000 7f5b38555b80 1 -- 172.21.15.149:0/3490296286 wait complete. 2023-11-08T19:23:09.983 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.959+0000 7f5b38555b80 20 client.4398 trim_cache size 0 max 16384 2023-11-08T19:23:09.990 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.977+0000 7f5b38555b80 1 Processor -- start 2023-11-08T19:23:09.990 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.977+0000 7f5b38555b80 1 -- start start 2023-11-08T19:23:09.990 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.978+0000 7f5b38555b80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c3f6f6b6f0 0x55c3f6f86df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:09.990 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.978+0000 7f5b38555b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c3f6f6bad0 0x55c3f6f72a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:09.991 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.978+0000 7f5b38555b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c3f6fb7dc0 0x55c3f6f9b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:09.991 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.978+0000 7f5b38555b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3f6d438d0 con 0x55c3f6fb7dc0 2023-11-08T19:23:09.991 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.978+0000 7f5b38555b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3f6f9eb70 con 0x55c3f6f6bad0 2023-11-08T19:23:09.991 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.978+0000 7f5b38555b80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c3f6fb8cf0 con 0x55c3f6f6b6f0 2023-11-08T19:23:09.992 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.978+0000 7f5b2a8f9700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c3f6fb7dc0 0x55c3f6f9b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:09.992 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.978+0000 7f5b2a8f9700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c3f6fb7dc0 0x55c3f6f9b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36878/0 (socket says 172.21.15.149:36878) 2023-11-08T19:23:09.992 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.978+0000 7f5b2a8f9700 1 -- 172.21.15.149:0/2540697836 learned_addr learned my addr 172.21.15.149:0/2540697836 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:09.992 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.978+0000 7f5b2a0f8700 1 --2- 172.21.15.149:0/2540697836 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c3f6f6b6f0 0x55c3f6f86df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:09.992 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.978+0000 7f5b298f7700 1 --2- 172.21.15.149:0/2540697836 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c3f6f6bad0 0x55c3f6f72a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:09.993 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.978+0000 7f5b2a8f9700 1 -- 172.21.15.149:0/2540697836 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c3f6f6b6f0 msgr2=0x55c3f6f86df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:09.993 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.978+0000 7f5b2a8f9700 1 --2- 172.21.15.149:0/2540697836 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c3f6f6b6f0 0x55c3f6f86df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:09.993 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.978+0000 7f5b2a8f9700 1 -- 172.21.15.149:0/2540697836 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c3f6f6bad0 msgr2=0x55c3f6f72a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:09.993 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.978+0000 7f5b2a8f9700 1 --2- 172.21.15.149:0/2540697836 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c3f6f6bad0 0x55c3f6f72a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:09.993 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.978+0000 7f5b2a8f9700 1 -- 172.21.15.149:0/2540697836 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c3f6cd6c10 con 0x55c3f6fb7dc0 2023-11-08T19:23:09.993 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.978+0000 7f5b2a8f9700 1 --2- 172.21.15.149:0/2540697836 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c3f6fb7dc0 0x55c3f6f9b440 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c009eb0 tx=0x7f5b1c009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d07c6193e9f63d6 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:09.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.978+0000 7f5b18d83700 1 -- 172.21.15.149:0/2540697836 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c00bbb0 con 0x55c3f6fb7dc0 2023-11-08T19:23:09.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.978+0000 7f5b18d83700 1 -- 172.21.15.149:0/2540697836 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b1c00bd30 con 0x55c3f6fb7dc0 2023-11-08T19:23:09.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.978+0000 7f5b18d83700 1 -- 172.21.15.149:0/2540697836 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c00bea0 con 0x55c3f6fb7dc0 2023-11-08T19:23:09.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.979+0000 7f5b38555b80 1 -- 172.21.15.149:0/2540697836 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c3f6fb7dc0 msgr2=0x55c3f6f9b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:09.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.979+0000 7f5b38555b80 1 --2- 172.21.15.149:0/2540697836 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c3f6fb7dc0 0x55c3f6f9b440 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c009eb0 tx=0x7f5b1c009810 comp rx=0 tx=0).stop 2023-11-08T19:23:09.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.979+0000 7f5b38555b80 1 -- 172.21.15.149:0/2540697836 shutdown_connections 2023-11-08T19:23:09.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.979+0000 7f5b38555b80 1 --2- 172.21.15.149:0/2540697836 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c3f6fb7dc0 0x55c3f6f9b440 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:09.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.979+0000 7f5b38555b80 1 --2- 172.21.15.149:0/2540697836 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c3f6f6b6f0 0x55c3f6f86df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:09.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.979+0000 7f5b38555b80 1 --2- 172.21.15.149:0/2540697836 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c3f6f6bad0 0x55c3f6f72a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:09.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.979+0000 7f5b38555b80 1 -- 172.21.15.149:0/2540697836 >> 172.21.15.149:0/2540697836 conn(0x55c3f6ee6660 msgr2=0x55c3f6f71390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:09.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.979+0000 7f5b38555b80 1 -- 172.21.15.149:0/2540697836 shutdown_connections 2023-11-08T19:23:09.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.979+0000 7f5b38555b80 1 -- 172.21.15.149:0/2540697836 wait complete. 2023-11-08T19:23:09.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.979+0000 7f5b38555b80 1 -- start start 2023-11-08T19:23:09.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.980+0000 7f5b38555b80 1 Processor -- start 2023-11-08T19:23:09.997 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.980+0000 7f5b38555b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c3f6f6b6f0 0x55c3f7005250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:09.997 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.980+0000 7f5b38555b80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c3f6f6bad0 0x55c3f6fd05d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:09.997 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.980+0000 7f5b38555b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c3f6fb7dc0 0x55c3f6fac550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:09.997 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.980+0000 7f5b38555b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3f7005cd0 con 0x55c3f6f6b6f0 2023-11-08T19:23:09.997 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.980+0000 7f5b38555b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3f6f97ac0 con 0x55c3f6fb7dc0 2023-11-08T19:23:09.998 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.980+0000 7f5b38555b80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c3f6f985b0 con 0x55c3f6f6bad0 2023-11-08T19:23:09.998 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.980+0000 7f5b38555b80 10 client.0 _ll_register_callbacks cb 0x7f5b14007700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-08T19:23:09.998 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.981+0000 7f5b2a0f8700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c3f6f6b6f0 0x55c3f7005250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:09.998 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.981+0000 7f5b2a0f8700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c3f6f6b6f0 0x55c3f7005250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36880/0 (socket says 172.21.15.149:36880) 2023-11-08T19:23:09.998 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.981+0000 7f5b2a0f8700 1 -- 172.21.15.149:0/1367783579 learned_addr learned my addr 172.21.15.149:0/1367783579 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:09.999 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.981+0000 7f5b2a8f9700 1 --2- 172.21.15.149:0/1367783579 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c3f6fb7dc0 0x55c3f6fac550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:09.999 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.981+0000 7f5b298f7700 1 --2- 172.21.15.149:0/1367783579 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c3f6f6bad0 0x55c3f6fd05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:09.999 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.981+0000 7f5b2a0f8700 1 -- 172.21.15.149:0/1367783579 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c3f6f6bad0 msgr2=0x55c3f6fd05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:09.999 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.981+0000 7f5b2a0f8700 1 --2- 172.21.15.149:0/1367783579 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c3f6f6bad0 0x55c3f6fd05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:09.999 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.981+0000 7f5b2a0f8700 1 -- 172.21.15.149:0/1367783579 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c3f6fb7dc0 msgr2=0x55c3f6fac550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:10.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.981+0000 7f5b2a0f8700 1 --2- 172.21.15.149:0/1367783579 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c3f6fb7dc0 0x55c3f6fac550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:10.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.981+0000 7f5b2a0f8700 1 -- 172.21.15.149:0/1367783579 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c3f6d415e0 con 0x55c3f6f6b6f0 2023-11-08T19:23:10.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.981+0000 7f5b2a0f8700 1 --2- 172.21.15.149:0/1367783579 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c3f6f6b6f0 0x55c3f7005250 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5b20009e40 tx=0x7f5b20004840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d029e0fa1a3e5c47 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:10.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.981+0000 7f5b057fa700 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2023-11-08T19:23:10.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.981+0000 7f5b057fa700 1 -- 172.21.15.149:0/1367783579 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b20024110 con 0x55c3f6f6b6f0 2023-11-08T19:23:10.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.981+0000 7f5b057fa700 1 -- 172.21.15.149:0/1367783579 <== mon.0 v2:172.21.15.149:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5b20024270 con 0x55c3f6f6b6f0 2023-11-08T19:23:10.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.981+0000 7f5b38555b80 1 -- 172.21.15.149:0/1367783579 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5b1c00b980 con 0x55c3f6f6b6f0 2023-11-08T19:23:10.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.981+0000 7f5b057fa700 1 -- 172.21.15.149:0/1367783579 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5b20024430 con 0x55c3f6f6b6f0 2023-11-08T19:23:10.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.981+0000 7f5b38555b80 10 client.4404 fetch_fsmap learned FSMap version 7 2023-11-08T19:23:10.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.981+0000 7f5b38555b80 1 -- 172.21.15.149:0/1367783579 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55c3f6d14200 con 0x55c3f6f6b6f0 2023-11-08T19:23:10.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.981+0000 7f5b057fa700 1 -- 172.21.15.149:0/1367783579 <== mon.0 v2:172.21.15.149:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b1c00b980 con 0x55c3f6f6b6f0 2023-11-08T19:23:10.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.981+0000 7f5b057fa700 1 -- 172.21.15.149:0/1367783579 <== mon.0 v2:172.21.15.149:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f5b20024590 con 0x55c3f6f6b6f0 2023-11-08T19:23:10.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.981+0000 7f5b38555b80 10 client.4404 fetch_fsmap finished waiting for FSMap version 7 2023-11-08T19:23:10.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.981+0000 7f5b38555b80 10 client.4404 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-08T19:23:10.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.981+0000 7f5b38555b80 20 client.4404 populate_metadata read hostname 'smithi149' 2023-11-08T19:23:10.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.982+0000 7f5b38555b80 1 --2- 172.21.15.149:0/1367783579 >> [v2:172.21.15.160:6832/3847116435,v1:172.21.15.160:6834/3847116435] conn(0x55c3f6f86c30 0x55c3f6f87010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:10.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.982+0000 7f5b38555b80 4 client.4404 mds_command: new command op to 4264 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-08T19:23:10.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.982+0000 7f5b38555b80 1 -- 172.21.15.149:0/1367783579 --> [v2:172.21.15.160:6832/3847116435,v1:172.21.15.160:6834/3847116435] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c3f6ebd5a0 con 0x55c3f6f86c30 2023-11-08T19:23:10.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.982+0000 7f5b298f7700 1 --2- 172.21.15.149:0/1367783579 >> [v2:172.21.15.160:6832/3847116435,v1:172.21.15.160:6834/3847116435] conn(0x55c3f6f86c30 0x55c3f6f87010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:10.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.982+0000 7f5b057fa700 10 client.4404 ms_handle_connect on v2:172.21.15.160:6832/3847116435 2023-11-08T19:23:10.004 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.982+0000 7f5b298f7700 1 --2- 172.21.15.149:0/1367783579 >> [v2:172.21.15.160:6832/3847116435,v1:172.21.15.160:6834/3847116435] conn(0x55c3f6f86c30 0x55c3f6f87010 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ede582e93658d882 server_cookie=95495fb9b3343e71 in_seq=0 out_seq=0 2023-11-08T19:23:10.004 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.982+0000 7f5b057fa700 1 -- 172.21.15.149:0/1367783579 <== mds.0 v2:172.21.15.160:6832/3847116435 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55c3f6ebd5a0 con 0x55c3f6f86c30 2023-11-08T19:23:10.004 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.982+0000 7f5b057fa700 10 client.4404 handle_command_reply: tid=0 2023-11-08T19:23:10.004 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.982+0000 7f5b38555b80 1 client.4404 shutdown 2023-11-08T19:23:10.004 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.982+0000 7f5b38555b80 1 -- 172.21.15.149:0/1367783579 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c3f6f6b6f0 msgr2=0x55c3f7005250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:10.005 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.982+0000 7f5b38555b80 1 --2- 172.21.15.149:0/1367783579 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c3f6f6b6f0 0x55c3f7005250 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5b20009e40 tx=0x7f5b20004840 comp rx=0 tx=0).stop 2023-11-08T19:23:10.005 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.982+0000 7f5b38555b80 1 -- 172.21.15.149:0/1367783579 shutdown_connections 2023-11-08T19:23:10.005 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.982+0000 7f5b38555b80 1 --2- 172.21.15.149:0/1367783579 >> [v2:172.21.15.160:6832/3847116435,v1:172.21.15.160:6834/3847116435] conn(0x55c3f6f86c30 0x55c3f6f87010 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:10.005 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.982+0000 7f5b38555b80 1 --2- 172.21.15.149:0/1367783579 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c3f6fb7dc0 0x55c3f6fac550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:10.005 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.982+0000 7f5b38555b80 1 --2- 172.21.15.149:0/1367783579 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c3f6f6b6f0 0x55c3f7005250 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:10.006 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.982+0000 7f5b057fa700 0 client.4404 ms_handle_reset on v2:172.21.15.160:6832/3847116435 2023-11-08T19:23:10.006 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.982+0000 7f5b38555b80 1 --2- 172.21.15.149:0/1367783579 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c3f6f6bad0 0x55c3f6fd05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:10.006 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.982+0000 7f5b38555b80 1 -- 172.21.15.149:0/1367783579 >> 172.21.15.149:0/1367783579 conn(0x55c3f6ee6660 msgr2=0x55c3f6fd90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:10.006 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.982+0000 7f5b38555b80 1 -- 172.21.15.149:0/1367783579 shutdown_connections 2023-11-08T19:23:10.006 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.982+0000 7f5b38555b80 1 -- 172.21.15.149:0/1367783579 wait complete. 2023-11-08T19:23:10.007 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.983+0000 7f5b38555b80 20 client.4404 trim_cache size 0 max 16384 2023-11-08T19:23:10.007 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2023-11-08T19:23:10.007 INFO:teuthology.orchestra.run.smithi149.stdout: "cluster_fsid": "0aba7c70-fe80-4446-a2f5-7502ac3adfb4", 2023-11-08T19:23:10.007 INFO:teuthology.orchestra.run.smithi149.stdout: "whoami": 0, 2023-11-08T19:23:10.008 INFO:teuthology.orchestra.run.smithi149.stdout: "id": 4264, 2023-11-08T19:23:10.008 INFO:teuthology.orchestra.run.smithi149.stdout: "want_state": "up:active", 2023-11-08T19:23:10.008 INFO:teuthology.orchestra.run.smithi149.stdout: "state": "up:active", 2023-11-08T19:23:10.008 INFO:teuthology.orchestra.run.smithi149.stdout: "fs_name": "cephfs", 2023-11-08T19:23:10.008 INFO:teuthology.orchestra.run.smithi149.stdout: "rank_uptime": 7.4464249410000001, 2023-11-08T19:23:10.009 INFO:teuthology.orchestra.run.smithi149.stdout: "mdsmap_epoch": 7, 2023-11-08T19:23:10.009 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_epoch": 24, 2023-11-08T19:23:10.009 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_epoch_barrier": 23, 2023-11-08T19:23:10.009 INFO:teuthology.orchestra.run.smithi149.stdout: "uptime": 14.626744520000001 2023-11-08T19:23:10.009 INFO:teuthology.orchestra.run.smithi149.stdout:} 2023-11-08T19:23:10.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.983+0000 7f5b2c35c700 1 -- 172.21.15.149:0/3520975063 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5b0806af00 msgr2=0x7f5b0806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:10.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.983+0000 7f5b2c35c700 1 --2- 172.21.15.149:0/3520975063 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5b0806af00 0x7f5b0806d3c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5b200096f0 tx=0x7f5b20006c40 comp rx=0 tx=0).stop 2023-11-08T19:23:10.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.983+0000 7f5b2c35c700 1 -- 172.21.15.149:0/3520975063 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b2415b950 msgr2=0x7f5b240cff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:10.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.983+0000 7f5b2c35c700 1 --2- 172.21.15.149:0/3520975063 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b2415b950 0x7f5b240cff90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5b1400c500 tx=0x7f5b1400c8c0 comp rx=0 tx=0).stop 2023-11-08T19:23:10.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.983+0000 7f5b2c35c700 1 -- 172.21.15.149:0/3520975063 shutdown_connections 2023-11-08T19:23:10.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.983+0000 7f5b2c35c700 1 --2- 172.21.15.149:0/3520975063 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5b0806af00 0x7f5b0806d3c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:10.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.983+0000 7f5b2c35c700 1 --2- 172.21.15.149:0/3520975063 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b240d04d0 0x7f5b241e69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:10.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.983+0000 7f5b2c35c700 1 --2- 172.21.15.149:0/3520975063 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b240ce840 0x7f5b24154f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:10.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.983+0000 7f5b2c35c700 1 --2- 172.21.15.149:0/3520975063 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b2415b950 0x7f5b240cff90 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:10.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.983+0000 7f5b2c35c700 1 -- 172.21.15.149:0/3520975063 >> 172.21.15.149:0/3520975063 conn(0x7f5b2408afd0 msgr2=0x7f5b240b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:10.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.983+0000 7f5b2c35c700 1 -- 172.21.15.149:0/3520975063 shutdown_connections 2023-11-08T19:23:10.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:09.983+0000 7f5b2c35c700 1 -- 172.21.15.149:0/3520975063 wait complete. 2023-11-08T19:23:10.014 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-08T19:23:10.015 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-11-08T19:23:10.015 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-08T19:23:10.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.135+0000 7f16dc8eb700 1 Processor -- start 2023-11-08T19:23:10.137 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.135+0000 7f16dc8eb700 1 -- start start 2023-11-08T19:23:10.139 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.136+0000 7f16dc8eb700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f16d80cc910 0x7f16d80cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:10.139 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.136+0000 7f16dc8eb700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f16d80cb130 0x7f16d815d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:10.139 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.136+0000 7f16dc8eb700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16d80b2f60 con 0x7f16d80cc140 2023-11-08T19:23:10.140 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.136+0000 7f16dc8eb700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16d80b2430 con 0x7f16d80cc910 2023-11-08T19:23:10.140 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.136+0000 7f16dc8eb700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16d80cc520 con 0x7f16d80cb130 2023-11-08T19:23:10.140 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.136+0000 7f16d5d9b700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f16d80cc910 0x7f16d80cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:10.140 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.136+0000 7f16d5d9b700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f16d80cc910 0x7f16d80cabf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36888/0 (socket says 172.21.15.149:36888) 2023-11-08T19:23:10.140 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.136+0000 7f16d5d9b700 1 -- 172.21.15.149:0/3550594972 learned_addr learned my addr 172.21.15.149:0/3550594972 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:10.141 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.137+0000 7f16d6d9d700 1 --2- 172.21.15.149:0/3550594972 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f16d80cb130 0x7f16d815d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:10.141 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.137+0000 7f16d5d9b700 1 -- 172.21.15.149:0/3550594972 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f16d80cb130 msgr2=0x7f16d815d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:10.141 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.137+0000 7f16d5d9b700 1 --2- 172.21.15.149:0/3550594972 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f16d80cb130 0x7f16d815d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:10.141 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.137+0000 7f16d5d9b700 1 -- 172.21.15.149:0/3550594972 >> v1:172.21.15.149:6789/0 conn(0x7f16d80cc140 legacy=0x7f16d80b2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:10.141 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.137+0000 7f16d5d9b700 1 -- 172.21.15.149:0/3550594972 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16d80cb5e0 con 0x7f16d80cc910 2023-11-08T19:23:10.142 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.137+0000 7f16d5d9b700 1 --2- 172.21.15.149:0/3550594972 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16d80cc910 0x7f16d80cabf0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f16c80098f0 tx=0x7f16c8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=266d78572039f8dd server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:10.142 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.137+0000 7f16d559a700 1 -- 172.21.15.149:0/3550594972 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c800b8a0 con 0x7f16d80cc910 2023-11-08T19:23:10.142 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.137+0000 7f16d559a700 1 -- 172.21.15.149:0/3550594972 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16c800ba00 con 0x7f16d80cc910 2023-11-08T19:23:10.142 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.137+0000 7f16d559a700 1 -- 172.21.15.149:0/3550594972 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c800bd90 con 0x7f16d80cc910 2023-11-08T19:23:10.142 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.138+0000 7f16dc8eb700 1 -- 172.21.15.149:0/3550594972 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16d80cc910 msgr2=0x7f16d80cabf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:10.143 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.138+0000 7f16dc8eb700 1 --2- 172.21.15.149:0/3550594972 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16d80cc910 0x7f16d80cabf0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f16c80098f0 tx=0x7f16c8009c00 comp rx=0 tx=0).stop 2023-11-08T19:23:10.143 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.138+0000 7f16dc8eb700 1 -- 172.21.15.149:0/3550594972 shutdown_connections 2023-11-08T19:23:10.143 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.138+0000 7f16dc8eb700 1 --2- 172.21.15.149:0/3550594972 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f16d80cb130 0x7f16d815d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:10.143 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.138+0000 7f16dc8eb700 1 --2- 172.21.15.149:0/3550594972 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16d80cc910 0x7f16d80cabf0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:10.143 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.138+0000 7f16dc8eb700 1 -- 172.21.15.149:0/3550594972 >> 172.21.15.149:0/3550594972 conn(0x7f16d8099a40 msgr2=0x7f16d80d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:10.144 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.138+0000 7f16dc8eb700 1 -- 172.21.15.149:0/3550594972 shutdown_connections 2023-11-08T19:23:10.144 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.138+0000 7f16dc8eb700 1 -- 172.21.15.149:0/3550594972 wait complete. 2023-11-08T19:23:10.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.139+0000 7f16dc8eb700 1 Processor -- start 2023-11-08T19:23:10.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.139+0000 7f16dc8eb700 1 -- start start 2023-11-08T19:23:10.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.140+0000 7f16dc8eb700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16d80cb130 0x7f16d81f6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:10.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.140+0000 7f16dc8eb700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f16d80cc140 0x7f16d80aec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:10.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.140+0000 7f16dc8eb700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f16d80cc910 0x7f16d80af180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:10.148 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.140+0000 7f16dc8eb700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d80b4ae0 con 0x7f16d80cb130 2023-11-08T19:23:10.148 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.140+0000 7f16dc8eb700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d80b5ae0 con 0x7f16d80cc910 2023-11-08T19:23:10.148 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.140+0000 7f16dc8eb700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16d80b3e60 con 0x7f16d80cc140 2023-11-08T19:23:10.148 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.140+0000 7f16d659c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16d80cb130 0x7f16d81f6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:10.148 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.140+0000 7f16d659c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16d80cb130 0x7f16d81f6750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36894/0 (socket says 172.21.15.149:36894) 2023-11-08T19:23:10.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.140+0000 7f16d659c700 1 -- 172.21.15.149:0/3200752308 learned_addr learned my addr 172.21.15.149:0/3200752308 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:10.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.140+0000 7f16d659c700 1 -- 172.21.15.149:0/3200752308 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f16d80cc140 msgr2=0x7f16d80aec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:10.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.140+0000 7f16d6d9d700 1 --2- 172.21.15.149:0/3200752308 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f16d80cc910 0x7f16d80af180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:10.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.140+0000 7f16d5d9b700 1 --2- 172.21.15.149:0/3200752308 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f16d80cc140 0x7f16d80aec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:10.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.140+0000 7f16d659c700 1 --2- 172.21.15.149:0/3200752308 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f16d80cc140 0x7f16d80aec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:10.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.140+0000 7f16d659c700 1 -- 172.21.15.149:0/3200752308 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f16d80cc910 msgr2=0x7f16d80af180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:10.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.140+0000 7f16d659c700 1 --2- 172.21.15.149:0/3200752308 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f16d80cc910 0x7f16d80af180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:10.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.140+0000 7f16d659c700 1 -- 172.21.15.149:0/3200752308 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c8009550 con 0x7f16d80cb130 2023-11-08T19:23:10.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.140+0000 7f16d5d9b700 1 --2- 172.21.15.149:0/3200752308 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f16d80cc140 0x7f16d80aec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:23:10.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.140+0000 7f16d6d9d700 1 --2- 172.21.15.149:0/3200752308 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f16d80cc910 0x7f16d80af180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:23:10.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.140+0000 7f16d659c700 1 --2- 172.21.15.149:0/3200752308 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16d80cb130 0x7f16d81f6750 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f16cc00c4d0 tx=0x7f16cc00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:10.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.140+0000 7f16c6ffd700 1 -- 172.21.15.149:0/3200752308 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16cc0054e0 con 0x7f16d80cb130 2023-11-08T19:23:10.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.140+0000 7f16c6ffd700 1 -- 172.21.15.149:0/3200752308 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16cc003680 con 0x7f16d80cb130 2023-11-08T19:23:10.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.140+0000 7f16dc8eb700 1 -- 172.21.15.149:0/3200752308 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16d80b4140 con 0x7f16d80cb130 2023-11-08T19:23:10.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.140+0000 7f16c6ffd700 1 -- 172.21.15.149:0/3200752308 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16cc003a30 con 0x7f16d80cb130 2023-11-08T19:23:10.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.140+0000 7f16dc8eb700 1 -- 172.21.15.149:0/3200752308 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16d80b4700 con 0x7f16d80cb130 2023-11-08T19:23:10.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.141+0000 7f16dc8eb700 1 -- 172.21.15.149:0/3200752308 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16d8066cd0 con 0x7f16d80cb130 2023-11-08T19:23:10.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.142+0000 7f16c6ffd700 1 -- 172.21.15.149:0/3200752308 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f16cc003b90 con 0x7f16d80cb130 2023-11-08T19:23:10.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.142+0000 7f16c6ffd700 1 --2- 172.21.15.149:0/3200752308 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f16b806af00 0x7f16b806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:10.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.142+0000 7f16c6ffd700 1 -- 172.21.15.149:0/3200752308 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f16cc088d10 con 0x7f16d80cb130 2023-11-08T19:23:10.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.142+0000 7f16d5d9b700 1 --2- 172.21.15.149:0/3200752308 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f16b806af00 0x7f16b806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:10.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.143+0000 7f16d5d9b700 1 --2- 172.21.15.149:0/3200752308 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f16b806af00 0x7f16b806d3c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f16c80098f0 tx=0x7f16c8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:10.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.147+0000 7f16c6ffd700 1 -- 172.21.15.149:0/3200752308 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f16cc053b60 con 0x7f16d80cb130 2023-11-08T19:23:10.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.380+0000 7f16dc8eb700 1 -- 172.21.15.149:0/3200752308 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f16d80745f0 con 0x7f16d80cb130 2023-11-08T19:23:10.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.380+0000 7f16c6ffd700 1 -- 172.21.15.149:0/3200752308 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f16cc017020 con 0x7f16d80cb130 2023-11-08T19:23:10.382 INFO:teuthology.orchestra.run.smithi149.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-08T19:23:10.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.383+0000 7f16dc8eb700 1 -- 172.21.15.149:0/3200752308 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f16b806af00 msgr2=0x7f16b806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:10.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.383+0000 7f16dc8eb700 1 --2- 172.21.15.149:0/3200752308 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f16b806af00 0x7f16b806d3c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f16c80098f0 tx=0x7f16c8008030 comp rx=0 tx=0).stop 2023-11-08T19:23:10.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.383+0000 7f16dc8eb700 1 -- 172.21.15.149:0/3200752308 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16d80cb130 msgr2=0x7f16d81f6750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:10.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.383+0000 7f16dc8eb700 1 --2- 172.21.15.149:0/3200752308 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16d80cb130 0x7f16d81f6750 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f16cc00c4d0 tx=0x7f16cc00c890 comp rx=0 tx=0).stop 2023-11-08T19:23:10.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.383+0000 7f16dc8eb700 1 -- 172.21.15.149:0/3200752308 shutdown_connections 2023-11-08T19:23:10.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.383+0000 7f16dc8eb700 1 --2- 172.21.15.149:0/3200752308 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f16b806af00 0x7f16b806d3c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:10.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.383+0000 7f16dc8eb700 1 --2- 172.21.15.149:0/3200752308 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f16d80cc910 0x7f16d80af180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:10.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.383+0000 7f16dc8eb700 1 --2- 172.21.15.149:0/3200752308 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16d80cb130 0x7f16d81f6750 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:10.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.383+0000 7f16dc8eb700 1 --2- 172.21.15.149:0/3200752308 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f16d80cc140 0x7f16d80aec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:10.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.383+0000 7f16dc8eb700 1 -- 172.21.15.149:0/3200752308 >> 172.21.15.149:0/3200752308 conn(0x7f16d8099a40 msgr2=0x7f16d80c7670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:10.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.383+0000 7f16dc8eb700 1 -- 172.21.15.149:0/3200752308 shutdown_connections 2023-11-08T19:23:10.387 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:10.383+0000 7f16dc8eb700 1 -- 172.21.15.149:0/3200752308 wait complete. 2023-11-08T19:23:10.396 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-08T19:23:10.396 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-08T19:23:10.396 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi149.front.sepia.ceph.com 2023-11-08T19:23:10.397 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-11-08T19:23:10.397 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-11-08T19:23:10.397 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-08T19:23:10.398 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-08T19:23:10.398 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-08T19:23:10.398 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-11-08T19:23:10.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:10.399 DEBUG:teuthology.orchestra.run.smithi149:> ip addr 2023-11-08T19:23:10.416 INFO:teuthology.orchestra.run.smithi149.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-08T19:23:10.417 INFO:teuthology.orchestra.run.smithi149.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-08T19:23:10.417 INFO:teuthology.orchestra.run.smithi149.stdout: inet 127.0.0.1/8 scope host lo 2023-11-08T19:23:10.417 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:23:10.417 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 ::1/128 scope host 2023-11-08T19:23:10.418 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:23:10.418 INFO:teuthology.orchestra.run.smithi149.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-08T19:23:10.418 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a4 brd ff:ff:ff:ff:ff:ff 2023-11-08T19:23:10.418 INFO:teuthology.orchestra.run.smithi149.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-08T19:23:10.418 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a5 brd ff:ff:ff:ff:ff:ff 2023-11-08T19:23:10.419 INFO:teuthology.orchestra.run.smithi149.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-08T19:23:10.419 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:56 brd ff:ff:ff:ff:ff:ff 2023-11-08T19:23:10.419 INFO:teuthology.orchestra.run.smithi149.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-08T19:23:10.419 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:57 brd ff:ff:ff:ff:ff:ff 2023-11-08T19:23:10.419 INFO:teuthology.orchestra.run.smithi149.stdout: inet 172.21.15.149/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-08T19:23:10.420 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft 42403sec preferred_lft 42403sec 2023-11-08T19:23:10.420 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::a27d:6f0d:7890:36f/64 scope link noprefixroute 2023-11-08T19:23:10.420 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:23:10.421 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-08T19:23:10.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:10.422 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec bash -c ' 2023-11-08T19:23:10.422 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2023-11-08T19:23:10.422 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link add name ceph-brx type bridge 2023-11-08T19:23:10.423 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip addr flush dev ceph-brx 2023-11-08T19:23:10.423 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set ceph-brx up 2023-11-08T19:23:10.423 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-08T19:23:10.424 DEBUG:teuthology.orchestra.run.smithi149:> ') 2023-11-08T19:23:10.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:10.584 DEBUG:teuthology.orchestra.run.smithi149:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-08T19:23:10.611 INFO:teuthology.orchestra.run.smithi149.stdout:1 2023-11-08T19:23:10.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:10.613 DEBUG:teuthology.orchestra.run.smithi149:> route 2023-11-08T19:23:10.690 INFO:teuthology.orchestra.run.smithi149.stdout:Kernel IP routing table 2023-11-08T19:23:10.690 INFO:teuthology.orchestra.run.smithi149.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-08T19:23:10.690 INFO:teuthology.orchestra.run.smithi149.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-08T19:23:10.690 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-08T19:23:10.691 INFO:teuthology.orchestra.run.smithi149.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-08T19:23:10.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:10.692 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec bash -c ' 2023-11-08T19:23:10.692 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2023-11-08T19:23:10.692 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-08T19:23:10.693 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-08T19:23:10.693 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-08T19:23:10.693 DEBUG:teuthology.orchestra.run.smithi149:> ') 2023-11-08T19:23:10.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:10.950 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2023-11-08T19:23:10.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:10.968 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list-id 2023-11-08T19:23:11.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:11.024 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec bash -c ' 2023-11-08T19:23:11.024 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2023-11-08T19:23:11.025 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-08T19:23:11.025 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-11-08T19:23:11.025 DEBUG:teuthology.orchestra.run.smithi149:> ') 2023-11-08T19:23:11.121 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-11-08T19:23:11.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:11.122 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec bash -c ' 2023-11-08T19:23:11.122 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2023-11-08T19:23:11.123 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-11-08T19:23:11.123 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-08T19:23:11.123 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-11-08T19:23:11.124 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-11-08T19:23:11.124 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-11-08T19:23:11.124 DEBUG:teuthology.orchestra.run.smithi149:> ') 2023-11-08T19:23:11.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:11.360 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec bash -c ' 2023-11-08T19:23:11.360 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2023-11-08T19:23:11.361 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set brx.0 up 2023-11-08T19:23:11.361 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set dev brx.0 master ceph-brx 2023-11-08T19:23:11.361 DEBUG:teuthology.orchestra.run.smithi149:> ') 2023-11-08T19:23:11.463 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-11-08T19:23:11.463 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-08T19:23:11.464 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-11-08T19:23:11.485 INFO:teuthology.orchestra.run.smithi149.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-11-08T19:23:11.485 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-08T19:23:11.486 DEBUG:teuthology.orchestra.run.smithi149:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-11-08T19:23:11.541 DEBUG:teuthology.orchestra.run.smithi149:> cat /proc/self/mounts | awk '{print $2}' 2023-11-08T19:23:11.597 INFO:teuthology.orchestra.run.smithi149.stdout:/sys 2023-11-08T19:23:11.598 INFO:teuthology.orchestra.run.smithi149.stdout:/proc 2023-11-08T19:23:11.598 INFO:teuthology.orchestra.run.smithi149.stdout:/dev 2023-11-08T19:23:11.598 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/kernel/security 2023-11-08T19:23:11.599 INFO:teuthology.orchestra.run.smithi149.stdout:/dev/shm 2023-11-08T19:23:11.599 INFO:teuthology.orchestra.run.smithi149.stdout:/dev/pts 2023-11-08T19:23:11.599 INFO:teuthology.orchestra.run.smithi149.stdout:/run 2023-11-08T19:23:11.599 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/cgroup 2023-11-08T19:23:11.600 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/cgroup/systemd 2023-11-08T19:23:11.600 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/pstore 2023-11-08T19:23:11.600 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/bpf 2023-11-08T19:23:11.600 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/cgroup/blkio 2023-11-08T19:23:11.600 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-11-08T19:23:11.601 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-11-08T19:23:11.601 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/cgroup/pids 2023-11-08T19:23:11.601 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/cgroup/rdma 2023-11-08T19:23:11.601 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/cgroup/perf_event 2023-11-08T19:23:11.601 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/cgroup/freezer 2023-11-08T19:23:11.602 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/cgroup/hugetlb 2023-11-08T19:23:11.602 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/cgroup/devices 2023-11-08T19:23:11.602 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/cgroup/memory 2023-11-08T19:23:11.602 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/cgroup/cpuset 2023-11-08T19:23:11.603 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/kernel/tracing 2023-11-08T19:23:11.603 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/kernel/config 2023-11-08T19:23:11.603 INFO:teuthology.orchestra.run.smithi149.stdout:/ 2023-11-08T19:23:11.603 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/selinux 2023-11-08T19:23:11.603 INFO:teuthology.orchestra.run.smithi149.stdout:/dev/mqueue 2023-11-08T19:23:11.604 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/kernel/debug 2023-11-08T19:23:11.604 INFO:teuthology.orchestra.run.smithi149.stdout:/proc/sys/fs/binfmt_misc 2023-11-08T19:23:11.604 INFO:teuthology.orchestra.run.smithi149.stdout:/dev/hugepages 2023-11-08T19:23:11.604 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/fuse/connections 2023-11-08T19:23:11.605 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/nfs/rpc_pipefs 2023-11-08T19:23:11.605 INFO:teuthology.orchestra.run.smithi149.stdout:/run/user/1000 2023-11-08T19:23:11.605 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/ceph 2023-11-08T19:23:11.605 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/ceph/osd/ceph-0 2023-11-08T19:23:11.605 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/ceph/osd/ceph-1 2023-11-08T19:23:11.606 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/ceph/osd/ceph-2 2023-11-08T19:23:11.606 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/ceph/osd/ceph-3 2023-11-08T19:23:11.606 INFO:teuthology.orchestra.run.smithi149.stdout:/run/netns 2023-11-08T19:23:11.606 INFO:teuthology.orchestra.run.smithi149.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-08T19:23:11.606 INFO:teuthology.orchestra.run.smithi149.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-08T19:23:11.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:11.607 DEBUG:teuthology.orchestra.run.smithi149:> ls /sys/fs/fuse/connections 2023-11-08T19:23:11.654 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-08T19:23:11.655 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-11-08T19:23:11.696 DEBUG:teuthology.orchestra.run.smithi149:> cat /proc/self/mounts | awk '{print $2}' 2023-11-08T19:23:11.714 INFO:teuthology.orchestra.run.smithi149.stdout:/sys 2023-11-08T19:23:11.714 INFO:teuthology.orchestra.run.smithi149.stdout:/proc 2023-11-08T19:23:11.714 INFO:teuthology.orchestra.run.smithi149.stdout:/dev 2023-11-08T19:23:11.715 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/kernel/security 2023-11-08T19:23:11.715 INFO:teuthology.orchestra.run.smithi149.stdout:/dev/shm 2023-11-08T19:23:11.715 INFO:teuthology.orchestra.run.smithi149.stdout:/dev/pts 2023-11-08T19:23:11.715 INFO:teuthology.orchestra.run.smithi149.stdout:/run 2023-11-08T19:23:11.715 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/cgroup 2023-11-08T19:23:11.716 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/cgroup/systemd 2023-11-08T19:23:11.716 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/pstore 2023-11-08T19:23:11.716 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/bpf 2023-11-08T19:23:11.716 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/cgroup/blkio 2023-11-08T19:23:11.716 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-11-08T19:23:11.717 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-11-08T19:23:11.718 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/cgroup/pids 2023-11-08T19:23:11.718 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/cgroup/rdma 2023-11-08T19:23:11.718 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/cgroup/perf_event 2023-11-08T19:23:11.719 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/cgroup/freezer 2023-11-08T19:23:11.720 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/cgroup/hugetlb 2023-11-08T19:23:11.720 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/cgroup/devices 2023-11-08T19:23:11.721 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/cgroup/memory 2023-11-08T19:23:11.721 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/cgroup/cpuset 2023-11-08T19:23:11.721 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/kernel/tracing 2023-11-08T19:23:11.721 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/kernel/config 2023-11-08T19:23:11.721 INFO:teuthology.orchestra.run.smithi149.stdout:/ 2023-11-08T19:23:11.722 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/selinux 2023-11-08T19:23:11.722 INFO:teuthology.orchestra.run.smithi149.stdout:/dev/mqueue 2023-11-08T19:23:11.722 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/kernel/debug 2023-11-08T19:23:11.722 INFO:teuthology.orchestra.run.smithi149.stdout:/proc/sys/fs/binfmt_misc 2023-11-08T19:23:11.723 INFO:teuthology.orchestra.run.smithi149.stdout:/dev/hugepages 2023-11-08T19:23:11.723 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/fuse/connections 2023-11-08T19:23:11.723 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/nfs/rpc_pipefs 2023-11-08T19:23:11.723 INFO:teuthology.orchestra.run.smithi149.stdout:/run/user/1000 2023-11-08T19:23:11.724 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/ceph 2023-11-08T19:23:11.724 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/ceph/osd/ceph-0 2023-11-08T19:23:11.724 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/ceph/osd/ceph-1 2023-11-08T19:23:11.724 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/ceph/osd/ceph-2 2023-11-08T19:23:11.725 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/ceph/osd/ceph-3 2023-11-08T19:23:11.725 INFO:teuthology.orchestra.run.smithi149.stdout:/run/netns 2023-11-08T19:23:11.725 INFO:teuthology.orchestra.run.smithi149.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-08T19:23:11.725 INFO:teuthology.orchestra.run.smithi149.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-08T19:23:11.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:11.726 DEBUG:teuthology.orchestra.run.smithi149:> ls /sys/fs/fuse/connections 2023-11-08T19:23:11.801 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi149.stderr:2023-11-08T19:23:11.799+0000 7faba30925c0 -1 init, newargv = 0x563d8d3f5520 newargc=15 2023-11-08T19:23:11.802 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi149.stderr:ceph-fuse[111848]: starting ceph client 2023-11-08T19:23:11.807 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi149.stderr:ceph-fuse[111848]: starting fuse 2023-11-08T19:23:12.871 DEBUG:teuthology.orchestra.run.smithi149:> cat /proc/self/mounts | awk '{print $2}' 2023-11-08T19:23:12.892 INFO:teuthology.orchestra.run.smithi149.stdout:/sys 2023-11-08T19:23:12.892 INFO:teuthology.orchestra.run.smithi149.stdout:/proc 2023-11-08T19:23:12.893 INFO:teuthology.orchestra.run.smithi149.stdout:/dev 2023-11-08T19:23:12.893 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/kernel/security 2023-11-08T19:23:12.893 INFO:teuthology.orchestra.run.smithi149.stdout:/dev/shm 2023-11-08T19:23:12.893 INFO:teuthology.orchestra.run.smithi149.stdout:/dev/pts 2023-11-08T19:23:12.893 INFO:teuthology.orchestra.run.smithi149.stdout:/run 2023-11-08T19:23:12.894 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/cgroup 2023-11-08T19:23:12.894 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/cgroup/systemd 2023-11-08T19:23:12.894 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/pstore 2023-11-08T19:23:12.894 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/bpf 2023-11-08T19:23:12.894 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/cgroup/blkio 2023-11-08T19:23:12.895 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-11-08T19:23:12.895 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-11-08T19:23:12.895 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/cgroup/pids 2023-11-08T19:23:12.895 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/cgroup/rdma 2023-11-08T19:23:12.895 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/cgroup/perf_event 2023-11-08T19:23:12.896 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/cgroup/freezer 2023-11-08T19:23:12.896 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/cgroup/hugetlb 2023-11-08T19:23:12.896 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/cgroup/devices 2023-11-08T19:23:12.896 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/cgroup/memory 2023-11-08T19:23:12.896 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/cgroup/cpuset 2023-11-08T19:23:12.897 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/kernel/tracing 2023-11-08T19:23:12.897 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/kernel/config 2023-11-08T19:23:12.897 INFO:teuthology.orchestra.run.smithi149.stdout:/ 2023-11-08T19:23:12.897 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/selinux 2023-11-08T19:23:12.897 INFO:teuthology.orchestra.run.smithi149.stdout:/dev/mqueue 2023-11-08T19:23:12.898 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/kernel/debug 2023-11-08T19:23:12.898 INFO:teuthology.orchestra.run.smithi149.stdout:/proc/sys/fs/binfmt_misc 2023-11-08T19:23:12.898 INFO:teuthology.orchestra.run.smithi149.stdout:/dev/hugepages 2023-11-08T19:23:12.898 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/fuse/connections 2023-11-08T19:23:12.899 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/nfs/rpc_pipefs 2023-11-08T19:23:12.899 INFO:teuthology.orchestra.run.smithi149.stdout:/run/user/1000 2023-11-08T19:23:12.899 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/ceph 2023-11-08T19:23:12.899 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/ceph/osd/ceph-0 2023-11-08T19:23:12.899 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/ceph/osd/ceph-1 2023-11-08T19:23:12.900 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/ceph/osd/ceph-2 2023-11-08T19:23:12.900 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/ceph/osd/ceph-3 2023-11-08T19:23:12.900 INFO:teuthology.orchestra.run.smithi149.stdout:/run/netns 2023-11-08T19:23:12.900 INFO:teuthology.orchestra.run.smithi149.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-08T19:23:12.900 INFO:teuthology.orchestra.run.smithi149.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-08T19:23:12.901 INFO:teuthology.orchestra.run.smithi149.stdout:/home/ubuntu/cephtest/mnt.admin 2023-11-08T19:23:12.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:12.902 DEBUG:teuthology.orchestra.run.smithi149:> ls /sys/fs/fuse/connections 2023-11-08T19:23:12.961 INFO:teuthology.orchestra.run.smithi149.stdout:46 2023-11-08T19:23:12.962 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-11-08T19:23:12.962 DEBUG:teuthology.orchestra.run.smithi149:> sudo stdin-killer -- python3 -c ' 2023-11-08T19:23:12.963 DEBUG:teuthology.orchestra.run.smithi149:> import glob 2023-11-08T19:23:12.963 DEBUG:teuthology.orchestra.run.smithi149:> import re 2023-11-08T19:23:12.963 DEBUG:teuthology.orchestra.run.smithi149:> import os 2023-11-08T19:23:12.964 DEBUG:teuthology.orchestra.run.smithi149:> import subprocess 2023-11-08T19:23:12.964 DEBUG:teuthology.orchestra.run.smithi149:> 2023-11-08T19:23:12.964 DEBUG:teuthology.orchestra.run.smithi149:> def _find_admin_socket(client_name): 2023-11-08T19:23:12.965 DEBUG:teuthology.orchestra.run.smithi149:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-11-08T19:23:12.965 DEBUG:teuthology.orchestra.run.smithi149:> files = glob.glob(asok_path) 2023-11-08T19:23:12.965 DEBUG:teuthology.orchestra.run.smithi149:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-11-08T19:23:12.966 DEBUG:teuthology.orchestra.run.smithi149:> 2023-11-08T19:23:12.966 DEBUG:teuthology.orchestra.run.smithi149:> # Given a non-glob path, it better be there 2023-11-08T19:23:12.967 DEBUG:teuthology.orchestra.run.smithi149:> if "*" not in asok_path: 2023-11-08T19:23:12.967 DEBUG:teuthology.orchestra.run.smithi149:> assert(len(files) == 1) 2023-11-08T19:23:12.967 DEBUG:teuthology.orchestra.run.smithi149:> return files[0] 2023-11-08T19:23:12.968 DEBUG:teuthology.orchestra.run.smithi149:> 2023-11-08T19:23:12.968 DEBUG:teuthology.orchestra.run.smithi149:> for f in files: 2023-11-08T19:23:12.968 DEBUG:teuthology.orchestra.run.smithi149:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-08T19:23:12.969 DEBUG:teuthology.orchestra.run.smithi149:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-08T19:23:12.969 DEBUG:teuthology.orchestra.run.smithi149:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-08T19:23:12.969 DEBUG:teuthology.orchestra.run.smithi149:> contents = proc_f.read() 2023-11-08T19:23:12.970 DEBUG:teuthology.orchestra.run.smithi149:> if mountpoint in contents: 2023-11-08T19:23:12.970 DEBUG:teuthology.orchestra.run.smithi149:> return f 2023-11-08T19:23:12.970 DEBUG:teuthology.orchestra.run.smithi149:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-08T19:23:12.971 DEBUG:teuthology.orchestra.run.smithi149:> 2023-11-08T19:23:12.971 DEBUG:teuthology.orchestra.run.smithi149:> print(_find_admin_socket("client.admin")) 2023-11-08T19:23:12.971 DEBUG:teuthology.orchestra.run.smithi149:> ' 2023-11-08T19:23:13.098 INFO:teuthology.orchestra.run.smithi149.stdout:/var/run/ceph/ceph-client.admin.111848.asok 2023-11-08T19:23:13.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-08T19:23:13.108 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.111848.asok 2023-11-08T19:23:13.109 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-08T19:23:13.109 DEBUG:teuthology.orchestra.run.smithi149:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.admin.111848.asok status 2023-11-08T19:23:13.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-08T19:23:13.299 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2023-11-08T19:23:13.300 INFO:teuthology.orchestra.run.smithi149.stdout: "metadata": { 2023-11-08T19:23:13.300 INFO:teuthology.orchestra.run.smithi149.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-08T19:23:13.300 INFO:teuthology.orchestra.run.smithi149.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-08T19:23:13.300 INFO:teuthology.orchestra.run.smithi149.stdout: "entity_id": "admin", 2023-11-08T19:23:13.301 INFO:teuthology.orchestra.run.smithi149.stdout: "hostname": "smithi149", 2023-11-08T19:23:13.301 INFO:teuthology.orchestra.run.smithi149.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-11-08T19:23:13.301 INFO:teuthology.orchestra.run.smithi149.stdout: "pid": "111848", 2023-11-08T19:23:13.301 INFO:teuthology.orchestra.run.smithi149.stdout: "root": "/" 2023-11-08T19:23:13.301 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:23:13.302 INFO:teuthology.orchestra.run.smithi149.stdout: "dentry_count": 0, 2023-11-08T19:23:13.302 INFO:teuthology.orchestra.run.smithi149.stdout: "dentry_pinned_count": 0, 2023-11-08T19:23:13.302 INFO:teuthology.orchestra.run.smithi149.stdout: "id": 4419, 2023-11-08T19:23:13.302 INFO:teuthology.orchestra.run.smithi149.stdout: "inst": { 2023-11-08T19:23:13.303 INFO:teuthology.orchestra.run.smithi149.stdout: "name": { 2023-11-08T19:23:13.303 INFO:teuthology.orchestra.run.smithi149.stdout: "type": "client", 2023-11-08T19:23:13.303 INFO:teuthology.orchestra.run.smithi149.stdout: "num": 4419 2023-11-08T19:23:13.303 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:23:13.304 INFO:teuthology.orchestra.run.smithi149.stdout: "addr": { 2023-11-08T19:23:13.304 INFO:teuthology.orchestra.run.smithi149.stdout: "type": "v1", 2023-11-08T19:23:13.304 INFO:teuthology.orchestra.run.smithi149.stdout: "addr": "192.168.0.1:0", 2023-11-08T19:23:13.304 INFO:teuthology.orchestra.run.smithi149.stdout: "nonce": 2927608629 2023-11-08T19:23:13.304 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:23:13.305 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:23:13.305 INFO:teuthology.orchestra.run.smithi149.stdout: "addr": { 2023-11-08T19:23:13.305 INFO:teuthology.orchestra.run.smithi149.stdout: "type": "v1", 2023-11-08T19:23:13.305 INFO:teuthology.orchestra.run.smithi149.stdout: "addr": "192.168.0.1:0", 2023-11-08T19:23:13.306 INFO:teuthology.orchestra.run.smithi149.stdout: "nonce": 2927608629 2023-11-08T19:23:13.306 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:23:13.306 INFO:teuthology.orchestra.run.smithi149.stdout: "inst_str": "client.4419 192.168.0.1:0/2927608629", 2023-11-08T19:23:13.306 INFO:teuthology.orchestra.run.smithi149.stdout: "addr_str": "192.168.0.1:0/2927608629", 2023-11-08T19:23:13.306 INFO:teuthology.orchestra.run.smithi149.stdout: "inode_count": 1, 2023-11-08T19:23:13.307 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_epoch": 7, 2023-11-08T19:23:13.307 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_epoch": 24, 2023-11-08T19:23:13.307 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_epoch_barrier": 0, 2023-11-08T19:23:13.307 INFO:teuthology.orchestra.run.smithi149.stdout: "blocklisted": false, 2023-11-08T19:23:13.307 INFO:teuthology.orchestra.run.smithi149.stdout: "fs_name": "cephfs" 2023-11-08T19:23:13.308 INFO:teuthology.orchestra.run.smithi149.stdout:} 2023-11-08T19:23:13.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-08T19:23:13.315 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-08T19:23:13.316 DEBUG:teuthology.orchestra.run.smithi149:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-08T19:23:13.316 DEBUG:teuthology.orchestra.run.smithi149:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-11-08T19:23:13.375 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-08T19:23:13.376 INFO:teuthology.orchestra.run.smithi149.stdout:fuseblk 2023-11-08T19:23:13.376 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-08T19:23:13.381 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-11-08T19:23:13.382 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-08T19:23:13.382 DEBUG:teuthology.orchestra.run.smithi149:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-11-08T19:23:13.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-08T19:23:13.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-08T19:23:13.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:13.449 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-11-08T19:23:13.525 INFO:teuthology.orchestra.run.smithi149.stdout:# file: . 2023-11-08T19:23:13.526 INFO:teuthology.orchestra.run.smithi149.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-11-08T19:23:13.526 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:23:13.527 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-11-08T19:23:13.527 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:23:13.545 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:23:13.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.703+0000 7f2c0a6d5700 1 Processor -- start 2023-11-08T19:23:13.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.703+0000 7f2c0a6d5700 1 -- start start 2023-11-08T19:23:13.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.704+0000 7f2c0a6d5700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2c040cc910 0x7f2c040cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:13.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.704+0000 7f2c0a6d5700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c040b2f60 con 0x7f2c040cb130 2023-11-08T19:23:13.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.704+0000 7f2c0a6d5700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c040cc520 con 0x7f2c040cc140 2023-11-08T19:23:13.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.704+0000 7f2c0a6d5700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c040b2430 con 0x7f2c040cc910 2023-11-08T19:23:13.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.704+0000 7f2c08c72700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f2c040cb130 0x7f2c0415d2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:38922/0 (socket says 172.21.15.149:38922) 2023-11-08T19:23:13.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.704+0000 7f2c08c72700 1 -- 172.21.15.149:0/1147463604 learned_addr learned my addr 172.21.15.149:0/1147463604 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:23:13.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.704+0000 7f2c037fe700 1 --2- 172.21.15.149:0/1147463604 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2c040cc910 0x7f2c040cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:13.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.704+0000 7f2c02ffd700 1 -- 172.21.15.149:0/1147463604 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1283891473 0 0) 0x7f2c040b2f60 con 0x7f2c040cb130 2023-11-08T19:23:13.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.704+0000 7f2c02ffd700 1 -- 172.21.15.149:0/1147463604 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2bec0035b0 con 0x7f2c040cb130 2023-11-08T19:23:13.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.704+0000 7f2c02ffd700 1 -- 172.21.15.149:0/1147463604 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3582305392 0 0) 0x7f2bec0035b0 con 0x7f2c040cb130 2023-11-08T19:23:13.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.704+0000 7f2c02ffd700 1 -- 172.21.15.149:0/1147463604 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2c040cc910 msgr2=0x7f2c040cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:13.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.704+0000 7f2c02ffd700 1 --2- 172.21.15.149:0/1147463604 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2c040cc910 0x7f2c040cabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:13.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.704+0000 7f2c02ffd700 1 -- 172.21.15.149:0/1147463604 >> v1:172.21.15.160:6789/0 conn(0x7f2c040cc140 legacy=0x7f2c040b2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:13.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.704+0000 7f2c02ffd700 1 -- 172.21.15.149:0/1147463604 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c040cb5b0 con 0x7f2c040cb130 2023-11-08T19:23:13.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.704+0000 7f2c02ffd700 1 -- 172.21.15.149:0/1147463604 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f2bfc0019f0 con 0x7f2c040cb130 2023-11-08T19:23:13.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.705+0000 7f2c02ffd700 1 -- 172.21.15.149:0/1147463604 >> v1:172.21.15.149:6789/0 conn(0x7f2c040cb130 legacy=0x7f2c0415d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:13.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.705+0000 7f2c02ffd700 1 --2- 172.21.15.149:0/1147463604 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2bec003a30 0x7f2bec003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:13.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.705+0000 7f2c02ffd700 1 --2- 172.21.15.149:0/1147463604 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2c040cc910 0x7f2bec004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:13.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.705+0000 7f2c02ffd700 1 --2- 172.21.15.149:0/1147463604 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2bec004d90 0x7f2bec005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:13.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.705+0000 7f2c02ffd700 1 -- 172.21.15.149:0/1147463604 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c040b2430 con 0x7f2bec004d90 2023-11-08T19:23:13.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.705+0000 7f2c02ffd700 1 -- 172.21.15.149:0/1147463604 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bec00bac0 con 0x7f2bec003a30 2023-11-08T19:23:13.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.705+0000 7f2c02ffd700 1 -- 172.21.15.149:0/1147463604 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bec00bc80 con 0x7f2c040cc910 2023-11-08T19:23:13.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.705+0000 7f2c08c72700 1 --2- 172.21.15.149:0/1147463604 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2bec004d90 0x7f2bec005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:13.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.705+0000 7f2c03fff700 1 --2- 172.21.15.149:0/1147463604 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2bec003a30 0x7f2bec003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:13.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.705+0000 7f2c037fe700 1 --2- 172.21.15.149:0/1147463604 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2c040cc910 0x7f2bec004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:13.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.705+0000 7f2c08c72700 1 -- 172.21.15.149:0/1147463604 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2c040cc910 msgr2=0x7f2bec004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:13.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.705+0000 7f2c08c72700 1 --2- 172.21.15.149:0/1147463604 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2c040cc910 0x7f2bec004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:13.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.705+0000 7f2c08c72700 1 -- 172.21.15.149:0/1147463604 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2bec003a30 msgr2=0x7f2bec003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:13.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.705+0000 7f2c08c72700 1 --2- 172.21.15.149:0/1147463604 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2bec003a30 0x7f2bec003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:13.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.705+0000 7f2c08c72700 1 -- 172.21.15.149:0/1147463604 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bec0035b0 con 0x7f2bec004d90 2023-11-08T19:23:13.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.705+0000 7f2c08c72700 1 --2- 172.21.15.149:0/1147463604 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2bec004d90 0x7f2bec005210 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc00a800 tx=0x7f2bec005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e32223141fd4560 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:13.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.705+0000 7f2c02ffd700 1 -- 172.21.15.149:0/1147463604 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc00a2f0 con 0x7f2bec004d90 2023-11-08T19:23:13.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.705+0000 7f2c02ffd700 1 -- 172.21.15.149:0/1147463604 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bfc012600 con 0x7f2bec004d90 2023-11-08T19:23:13.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.705+0000 7f2c02ffd700 1 -- 172.21.15.149:0/1147463604 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc0129b0 con 0x7f2bec004d90 2023-11-08T19:23:13.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.706+0000 7f2c0a6d5700 1 -- 172.21.15.149:0/1147463604 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2bec004d90 msgr2=0x7f2bec005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:13.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.706+0000 7f2c0a6d5700 1 --2- 172.21.15.149:0/1147463604 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2bec004d90 0x7f2bec005210 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc00a800 tx=0x7f2bec005880 comp rx=0 tx=0).stop 2023-11-08T19:23:13.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.706+0000 7f2c08c72700 1 -- 172.21.15.149:0/1147463604 reap_dead start 2023-11-08T19:23:13.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.706+0000 7f2c0a6d5700 1 -- 172.21.15.149:0/1147463604 shutdown_connections 2023-11-08T19:23:13.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.706+0000 7f2c0a6d5700 1 -- 172.21.15.149:0/1147463604 >> 172.21.15.149:0/1147463604 conn(0x7f2c04099a40 msgr2=0x7f2c040d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:13.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.706+0000 7f2c0a6d5700 1 -- 172.21.15.149:0/1147463604 shutdown_connections 2023-11-08T19:23:13.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.706+0000 7f2c0a6d5700 1 -- 172.21.15.149:0/1147463604 wait complete. 2023-11-08T19:23:13.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.707+0000 7f2c0a6d5700 1 Processor -- start 2023-11-08T19:23:13.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.707+0000 7f2c0a6d5700 1 -- start start 2023-11-08T19:23:13.720 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.708+0000 7f2c0a6d5700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2c0409de10 0x7f2c040af1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:13.720 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.708+0000 7f2c0a6d5700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2c0409c2c0 0x7f2c040af710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:13.720 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.708+0000 7f2c0a6d5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c041f3500 0x7f2c041f3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:13.720 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.708+0000 7f2c0a6d5700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c041f4270 con 0x7f2c041f3500 2023-11-08T19:23:13.721 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.708+0000 7f2c0a6d5700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0414f7e0 con 0x7f2c0409de10 2023-11-08T19:23:13.721 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.708+0000 7f2c0a6d5700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0414fac0 con 0x7f2c0409c2c0 2023-11-08T19:23:13.721 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.708+0000 7f2c08c72700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c041f3500 0x7f2c041f3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:13.721 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.708+0000 7f2c08c72700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c041f3500 0x7f2c041f3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36932/0 (socket says 172.21.15.149:36932) 2023-11-08T19:23:13.721 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.708+0000 7f2c08c72700 1 -- 172.21.15.149:0/3594591460 learned_addr learned my addr 172.21.15.149:0/3594591460 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:13.721 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.708+0000 7f2c037fe700 1 --2- 172.21.15.149:0/3594591460 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2c0409c2c0 0x7f2c040af710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:13.722 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.708+0000 7f2c03fff700 1 --2- 172.21.15.149:0/3594591460 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2c0409de10 0x7f2c040af1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:13.722 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.708+0000 7f2c08c72700 1 -- 172.21.15.149:0/3594591460 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2c0409c2c0 msgr2=0x7f2c040af710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:13.722 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.708+0000 7f2c08c72700 1 --2- 172.21.15.149:0/3594591460 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2c0409c2c0 0x7f2c040af710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:13.722 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.708+0000 7f2c08c72700 1 -- 172.21.15.149:0/3594591460 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2c0409de10 msgr2=0x7f2c040af1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:13.722 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.708+0000 7f2c08c72700 1 --2- 172.21.15.149:0/3594591460 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2c0409de10 0x7f2c040af1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:13.723 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.708+0000 7f2c08c72700 1 -- 172.21.15.149:0/3594591460 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c0414fda0 con 0x7f2c041f3500 2023-11-08T19:23:13.723 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.709+0000 7f2c08c72700 1 --2- 172.21.15.149:0/3594591460 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c041f3500 0x7f2c041f3990 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc012000 tx=0x7f2bfc001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:13.723 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.709+0000 7f2c00ff9700 1 -- 172.21.15.149:0/3594591460 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc0011c0 con 0x7f2c041f3500 2023-11-08T19:23:13.723 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.709+0000 7f2c00ff9700 1 -- 172.21.15.149:0/3594591460 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bfc0017b0 con 0x7f2c041f3500 2023-11-08T19:23:13.723 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.709+0000 7f2c00ff9700 1 -- 172.21.15.149:0/3594591460 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc01e430 con 0x7f2c041f3500 2023-11-08T19:23:13.724 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.709+0000 7f2c0a6d5700 1 -- 172.21.15.149:0/3594591460 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c04150080 con 0x7f2c041f3500 2023-11-08T19:23:13.724 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.709+0000 7f2c0a6d5700 1 -- 172.21.15.149:0/3594591460 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c041f3ed0 con 0x7f2c041f3500 2023-11-08T19:23:13.724 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.710+0000 7f2c0a6d5700 1 -- 172.21.15.149:0/3594591460 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c041502a0 con 0x7f2c041f3500 2023-11-08T19:23:13.724 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.710+0000 7f2c00ff9700 1 -- 172.21.15.149:0/3594591460 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2bfc01e5b0 con 0x7f2c041f3500 2023-11-08T19:23:13.724 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.711+0000 7f2c00ff9700 1 --2- 172.21.15.149:0/3594591460 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2bf006af00 0x7f2bf006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:13.724 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.711+0000 7f2c00ff9700 1 -- 172.21.15.149:0/3594591460 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2bfc08b5b0 con 0x7f2c041f3500 2023-11-08T19:23:13.725 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.711+0000 7f2c03fff700 1 --2- 172.21.15.149:0/3594591460 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2bf006af00 0x7f2bf006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:13.725 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.711+0000 7f2c03fff700 1 --2- 172.21.15.149:0/3594591460 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2bf006af00 0x7f2bf006d3c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2bf80018b0 tx=0x7f2bf8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:13.725 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.716+0000 7f2c00ff9700 1 -- 172.21.15.149:0/3594591460 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2bfc0564c0 con 0x7f2c041f3500 2023-11-08T19:23:13.907 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.906+0000 7f2c0a6d5700 1 -- 172.21.15.149:0/3594591460 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2c040745f0 con 0x7f2c041f3500 2023-11-08T19:23:13.908 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.908+0000 7f2c00ff9700 1 -- 172.21.15.149:0/3594591460 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18382 (secure 0 0 0) 0x7f2bfc059ae0 con 0x7f2c041f3500 2023-11-08T19:23:13.909 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:23:13.910 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":24,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:23:06.964482+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-08T19:22:59.830928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-08T19:23:00.886589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-08T19:23:04.574033+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:23:13.912 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.910+0000 7f2c0a6d5700 1 -- 172.21.15.149:0/3594591460 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2bf006af00 msgr2=0x7f2bf006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:13.912 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.910+0000 7f2c0a6d5700 1 --2- 172.21.15.149:0/3594591460 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2bf006af00 0x7f2bf006d3c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2bf80018b0 tx=0x7f2bf8009040 comp rx=0 tx=0).stop 2023-11-08T19:23:13.912 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.910+0000 7f2c0a6d5700 1 -- 172.21.15.149:0/3594591460 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c041f3500 msgr2=0x7f2c041f3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:13.912 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.910+0000 7f2c0a6d5700 1 --2- 172.21.15.149:0/3594591460 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c041f3500 0x7f2c041f3990 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc012000 tx=0x7f2bfc001d80 comp rx=0 tx=0).stop 2023-11-08T19:23:13.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.910+0000 7f2c0a6d5700 1 -- 172.21.15.149:0/3594591460 shutdown_connections 2023-11-08T19:23:13.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.910+0000 7f2c0a6d5700 1 --2- 172.21.15.149:0/3594591460 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2bf006af00 0x7f2bf006d3c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:13.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.910+0000 7f2c0a6d5700 1 --2- 172.21.15.149:0/3594591460 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2c0409de10 0x7f2c040af1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:13.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.910+0000 7f2c0a6d5700 1 --2- 172.21.15.149:0/3594591460 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c041f3500 0x7f2c041f3990 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:13.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.910+0000 7f2c0a6d5700 1 --2- 172.21.15.149:0/3594591460 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2c0409c2c0 0x7f2c040af710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:13.914 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.910+0000 7f2c0a6d5700 1 -- 172.21.15.149:0/3594591460 >> 172.21.15.149:0/3594591460 conn(0x7f2c04099a40 msgr2=0x7f2c0406f640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:13.914 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.910+0000 7f2c0a6d5700 1 -- 172.21.15.149:0/3594591460 shutdown_connections 2023-11-08T19:23:13.914 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:13.910+0000 7f2c0a6d5700 1 -- 172.21.15.149:0/3594591460 wait complete. 2023-11-08T19:23:13.923 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-08T19:22:56.023194+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-08T19:22:59.830928+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-08T19:23:00.886589+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-08T19:23:04.574033+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-08T19:23:13.924 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-08T19:23:14.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.047+0000 7f219d3f6700 1 Processor -- start 2023-11-08T19:23:14.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.047+0000 7f219d3f6700 1 -- start start 2023-11-08T19:23:14.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.048+0000 7f219d3f6700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f219815d890 0x7f21980b94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:14.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.048+0000 7f219d3f6700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21980b68f0 con 0x7f21980d0a10 2023-11-08T19:23:14.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.048+0000 7f219d3f6700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2198161ca0 con 0x7f219815dc70 2023-11-08T19:23:14.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.048+0000 7f219d3f6700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2198161f80 con 0x7f219815d890 2023-11-08T19:23:14.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.048+0000 7f21977fe700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f21980d0a10 0x7f21980d22d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:38942/0 (socket says 172.21.15.149:38942) 2023-11-08T19:23:14.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.048+0000 7f21977fe700 1 -- 172.21.15.149:0/3374257735 learned_addr learned my addr 172.21.15.149:0/3374257735 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:23:14.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.048+0000 7f2196ffd700 1 --2- 172.21.15.149:0/3374257735 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f219815d890 0x7f21980b94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:14.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.048+0000 7f2196ffd700 1 -- 172.21.15.149:0/3374257735 >> v1:172.21.15.160:6789/0 conn(0x7f219815dc70 legacy=0x7f21980d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:14.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.048+0000 7f2196ffd700 1 -- 172.21.15.149:0/3374257735 >> v1:172.21.15.149:6789/0 conn(0x7f21980d0a10 legacy=0x7f21980d22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:14.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.048+0000 7f2196ffd700 1 -- 172.21.15.149:0/3374257735 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2198162260 con 0x7f219815d890 2023-11-08T19:23:14.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.049+0000 7f2196ffd700 1 --2- 172.21.15.149:0/3374257735 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f219815d890 0x7f21980b94c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2188009870 tx=0x7f2188009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bab19c175a39f1fc server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:14.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.052+0000 7f2195ffb700 1 -- 172.21.15.149:0/3374257735 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2188011830 con 0x7f219815d890 2023-11-08T19:23:14.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.052+0000 7f2195ffb700 1 -- 172.21.15.149:0/3374257735 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2188011990 con 0x7f219815d890 2023-11-08T19:23:14.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.052+0000 7f2195ffb700 1 -- 172.21.15.149:0/3374257735 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2188011d20 con 0x7f219815d890 2023-11-08T19:23:14.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.052+0000 7f219d3f6700 1 -- 172.21.15.149:0/3374257735 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f219815d890 msgr2=0x7f21980b94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:14.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.052+0000 7f219d3f6700 1 --2- 172.21.15.149:0/3374257735 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f219815d890 0x7f21980b94c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2188009870 tx=0x7f2188009b80 comp rx=0 tx=0).stop 2023-11-08T19:23:14.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.052+0000 7f219d3f6700 1 -- 172.21.15.149:0/3374257735 shutdown_connections 2023-11-08T19:23:14.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.052+0000 7f219d3f6700 1 --2- 172.21.15.149:0/3374257735 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f219815d890 0x7f21980b94c0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:14.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.052+0000 7f219d3f6700 1 -- 172.21.15.149:0/3374257735 >> 172.21.15.149:0/3374257735 conn(0x7f219806bd60 msgr2=0x7f219806c140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:14.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.052+0000 7f219d3f6700 1 -- 172.21.15.149:0/3374257735 shutdown_connections 2023-11-08T19:23:14.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.052+0000 7f219d3f6700 1 -- 172.21.15.149:0/3374257735 wait complete. 2023-11-08T19:23:14.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.054+0000 7f219d3f6700 1 Processor -- start 2023-11-08T19:23:14.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.054+0000 7f219d3f6700 1 -- start start 2023-11-08T19:23:14.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.055+0000 7f219d3f6700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f21980d0a10 0x7f21981f4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:14.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.055+0000 7f219d3f6700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f219815d890 0x7f21981601d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:14.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.055+0000 7f219d3f6700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f219815dc70 0x7f2198151910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:14.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.055+0000 7f219d3f6700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21980cd570 con 0x7f219815d890 2023-11-08T19:23:14.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.055+0000 7f219d3f6700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f219815f100 con 0x7f21980d0a10 2023-11-08T19:23:14.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.055+0000 7f219d3f6700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21981f45d0 con 0x7f219815dc70 2023-11-08T19:23:14.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.055+0000 7f21967fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f219815d890 0x7f21981601d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:14.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.055+0000 7f21967fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f219815d890 0x7f21981601d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36944/0 (socket says 172.21.15.149:36944) 2023-11-08T19:23:14.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.055+0000 7f21967fc700 1 -- 172.21.15.149:0/956239111 learned_addr learned my addr 172.21.15.149:0/956239111 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:14.061 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.055+0000 7f21977fe700 1 --2- 172.21.15.149:0/956239111 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f219815dc70 0x7f2198151910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:14.061 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.055+0000 7f2196ffd700 1 --2- 172.21.15.149:0/956239111 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f21980d0a10 0x7f21981f4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:14.061 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.055+0000 7f21967fc700 1 -- 172.21.15.149:0/956239111 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f219815dc70 msgr2=0x7f2198151910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:14.061 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.055+0000 7f21967fc700 1 --2- 172.21.15.149:0/956239111 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f219815dc70 0x7f2198151910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:14.061 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.055+0000 7f21967fc700 1 -- 172.21.15.149:0/956239111 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f21980d0a10 msgr2=0x7f21981f4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:14.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.055+0000 7f21967fc700 1 --2- 172.21.15.149:0/956239111 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f21980d0a10 0x7f21981f4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:14.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.055+0000 7f21967fc700 1 -- 172.21.15.149:0/956239111 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21880094a0 con 0x7f219815d890 2023-11-08T19:23:14.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.055+0000 7f21967fc700 1 --2- 172.21.15.149:0/956239111 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f219815d890 0x7f21981601d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f218c00c4d0 tx=0x7f218c00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:14.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.055+0000 7f217f7fe700 1 -- 172.21.15.149:0/956239111 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218c00cea0 con 0x7f219815d890 2023-11-08T19:23:14.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.055+0000 7f217f7fe700 1 -- 172.21.15.149:0/956239111 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f218c0052d0 con 0x7f219815d890 2023-11-08T19:23:14.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.055+0000 7f219d3f6700 1 -- 172.21.15.149:0/956239111 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f219815e4f0 con 0x7f219815d890 2023-11-08T19:23:14.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.055+0000 7f217f7fe700 1 -- 172.21.15.149:0/956239111 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218c003680 con 0x7f219815d890 2023-11-08T19:23:14.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.055+0000 7f219d3f6700 1 -- 172.21.15.149:0/956239111 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f219815eab0 con 0x7f219815d890 2023-11-08T19:23:14.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.056+0000 7f219d3f6700 1 -- 172.21.15.149:0/956239111 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2198068610 con 0x7f219815d890 2023-11-08T19:23:14.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.057+0000 7f217f7fe700 1 -- 172.21.15.149:0/956239111 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f218c0037e0 con 0x7f219815d890 2023-11-08T19:23:14.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.057+0000 7f217f7fe700 1 --2- 172.21.15.149:0/956239111 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f218406af00 0x7f218406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:14.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.057+0000 7f217f7fe700 1 -- 172.21.15.149:0/956239111 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f218c088b10 con 0x7f219815d890 2023-11-08T19:23:14.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.057+0000 7f2196ffd700 1 --2- 172.21.15.149:0/956239111 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f218406af00 0x7f218406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:14.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.058+0000 7f2196ffd700 1 --2- 172.21.15.149:0/956239111 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f218406af00 0x7f218406d3c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2188000c00 tx=0x7f2188008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:14.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.062+0000 7f217f7fe700 1 -- 172.21.15.149:0/956239111 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f218c053980 con 0x7f219815d890 2023-11-08T19:23:14.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.256+0000 7f219d3f6700 1 -- 172.21.15.149:0/956239111 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f219804f730 con 0x7f219815d890 2023-11-08T19:23:14.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.256+0000 7f217f7fe700 1 -- 172.21.15.149:0/956239111 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f218c0170a0 con 0x7f219815d890 2023-11-08T19:23:14.257 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 1 2023-11-08T19:23:14.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.258+0000 7f219d3f6700 1 -- 172.21.15.149:0/956239111 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f218406af00 msgr2=0x7f218406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:14.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.258+0000 7f219d3f6700 1 --2- 172.21.15.149:0/956239111 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f218406af00 0x7f218406d3c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2188000c00 tx=0x7f2188008030 comp rx=0 tx=0).stop 2023-11-08T19:23:14.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.258+0000 7f219d3f6700 1 -- 172.21.15.149:0/956239111 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f219815d890 msgr2=0x7f21981601d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:14.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.258+0000 7f219d3f6700 1 --2- 172.21.15.149:0/956239111 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f219815d890 0x7f21981601d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f218c00c4d0 tx=0x7f218c00c7e0 comp rx=0 tx=0).stop 2023-11-08T19:23:14.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.258+0000 7f219d3f6700 1 -- 172.21.15.149:0/956239111 shutdown_connections 2023-11-08T19:23:14.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.258+0000 7f219d3f6700 1 --2- 172.21.15.149:0/956239111 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f218406af00 0x7f218406d3c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:14.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.258+0000 7f219d3f6700 1 --2- 172.21.15.149:0/956239111 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f21980d0a10 0x7f21981f4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:14.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.258+0000 7f219d3f6700 1 --2- 172.21.15.149:0/956239111 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f219815dc70 0x7f2198151910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:14.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.258+0000 7f219d3f6700 1 --2- 172.21.15.149:0/956239111 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f219815d890 0x7f21981601d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:14.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.258+0000 7f219d3f6700 1 -- 172.21.15.149:0/956239111 >> 172.21.15.149:0/956239111 conn(0x7f219806bd60 msgr2=0x7f21980c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:14.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.258+0000 7f219d3f6700 1 -- 172.21.15.149:0/956239111 shutdown_connections 2023-11-08T19:23:14.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.258+0000 7f219d3f6700 1 -- 172.21.15.149:0/956239111 wait complete. 2023-11-08T19:23:14.272 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-08T19:23:14.395 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.394+0000 7f46ac213700 1 Processor -- start 2023-11-08T19:23:14.396 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.394+0000 7f46ac213700 1 -- start start 2023-11-08T19:23:14.398 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.395+0000 7f46ac213700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f46a415a0e0 0x7f46a40ce3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:14.398 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.395+0000 7f46ac213700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f46a415dc90 0x7f46a40ce910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:14.398 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.395+0000 7f46ac213700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46a40cacd0 con 0x7f46a406dd40 2023-11-08T19:23:14.399 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.395+0000 7f46ac213700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46a406e300 con 0x7f46a415dc90 2023-11-08T19:23:14.399 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.395+0000 7f46ac213700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46a406e5e0 con 0x7f46a415a0e0 2023-11-08T19:23:14.399 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.395+0000 7f46a97ae700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f46a415dc90 0x7f46a40ce910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:14.399 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.395+0000 7f46a97ae700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f46a415dc90 0x7f46a40ce910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36950/0 (socket says 172.21.15.149:36950) 2023-11-08T19:23:14.399 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.395+0000 7f46a97ae700 1 -- 172.21.15.149:0/3202858642 learned_addr learned my addr 172.21.15.149:0/3202858642 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:14.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.395+0000 7f46a9faf700 1 --2- 172.21.15.149:0/3202858642 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f46a415a0e0 0x7f46a40ce3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:14.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.396+0000 7f46a97ae700 1 -- 172.21.15.149:0/3202858642 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f46a415a0e0 msgr2=0x7f46a40ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:14.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.396+0000 7f46a97ae700 1 --2- 172.21.15.149:0/3202858642 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f46a415a0e0 0x7f46a40ce3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:14.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.396+0000 7f46a97ae700 1 -- 172.21.15.149:0/3202858642 >> v1:172.21.15.160:6789/0 conn(0x7f46a406dd40 legacy=0x7f46a415a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:14.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.396+0000 7f46a97ae700 1 -- 172.21.15.149:0/3202858642 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a406e8c0 con 0x7f46a415dc90 2023-11-08T19:23:14.401 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.396+0000 7f46a97ae700 1 --2- 172.21.15.149:0/3202858642 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46a415dc90 0x7f46a40ce910 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f46a00098f0 tx=0x7f46a0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e1eae1ee7fa9fb2 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:14.401 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.396+0000 7f46a8fad700 1 -- 172.21.15.149:0/3202858642 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a000b8a0 con 0x7f46a415dc90 2023-11-08T19:23:14.401 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.396+0000 7f46a8fad700 1 -- 172.21.15.149:0/3202858642 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46a000ba00 con 0x7f46a415dc90 2023-11-08T19:23:14.401 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.396+0000 7f46a8fad700 1 -- 172.21.15.149:0/3202858642 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a000bd90 con 0x7f46a415dc90 2023-11-08T19:23:14.401 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.396+0000 7f46ac213700 1 -- 172.21.15.149:0/3202858642 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46a415dc90 msgr2=0x7f46a40ce910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:14.402 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.396+0000 7f46ac213700 1 --2- 172.21.15.149:0/3202858642 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46a415dc90 0x7f46a40ce910 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f46a00098f0 tx=0x7f46a0009c00 comp rx=0 tx=0).stop 2023-11-08T19:23:14.402 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.396+0000 7f46ac213700 1 -- 172.21.15.149:0/3202858642 shutdown_connections 2023-11-08T19:23:14.402 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.396+0000 7f46ac213700 1 --2- 172.21.15.149:0/3202858642 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f46a415a0e0 0x7f46a40ce3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:14.402 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.396+0000 7f46ac213700 1 --2- 172.21.15.149:0/3202858642 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46a415dc90 0x7f46a40ce910 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:14.402 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.396+0000 7f46ac213700 1 -- 172.21.15.149:0/3202858642 >> 172.21.15.149:0/3202858642 conn(0x7f46a40cc860 msgr2=0x7f46a40ccc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:14.403 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.397+0000 7f46ac213700 1 -- 172.21.15.149:0/3202858642 shutdown_connections 2023-11-08T19:23:14.403 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.397+0000 7f46ac213700 1 -- 172.21.15.149:0/3202858642 wait complete. 2023-11-08T19:23:14.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.398+0000 7f46ac213700 1 Processor -- start 2023-11-08T19:23:14.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.398+0000 7f46ac213700 1 -- start start 2023-11-08T19:23:14.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.398+0000 7f46ac213700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f46a406dd40 0x7f46a415a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:14.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.398+0000 7f46ac213700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46a415a0e0 0x7f46a40c7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:14.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.398+0000 7f46ac213700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f46a415dc90 0x7f46a41531c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:14.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.398+0000 7f46ac213700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a4155600 con 0x7f46a415a0e0 2023-11-08T19:23:14.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.398+0000 7f46ac213700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a40c8330 con 0x7f46a415dc90 2023-11-08T19:23:14.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.398+0000 7f46ac213700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46a40c85f0 con 0x7f46a406dd40 2023-11-08T19:23:14.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.399+0000 7f46a97ae700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46a415a0e0 0x7f46a40c7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:14.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.399+0000 7f46a97ae700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46a415a0e0 0x7f46a40c7120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36958/0 (socket says 172.21.15.149:36958) 2023-11-08T19:23:14.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.399+0000 7f46a97ae700 1 -- 172.21.15.149:0/3563947311 learned_addr learned my addr 172.21.15.149:0/3563947311 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:14.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.399+0000 7f46a9faf700 1 --2- 172.21.15.149:0/3563947311 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f46a406dd40 0x7f46a415a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:14.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.399+0000 7f46aa7b0700 1 --2- 172.21.15.149:0/3563947311 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f46a415dc90 0x7f46a41531c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:14.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.399+0000 7f46a97ae700 1 -- 172.21.15.149:0/3563947311 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f46a406dd40 msgr2=0x7f46a415a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:14.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.399+0000 7f46a97ae700 1 --2- 172.21.15.149:0/3563947311 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f46a406dd40 0x7f46a415a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:14.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.399+0000 7f46a97ae700 1 -- 172.21.15.149:0/3563947311 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f46a415dc90 msgr2=0x7f46a41531c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:14.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.399+0000 7f46a97ae700 1 --2- 172.21.15.149:0/3563947311 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f46a415dc90 0x7f46a41531c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:14.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.399+0000 7f46a97ae700 1 -- 172.21.15.149:0/3563947311 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a0009550 con 0x7f46a415a0e0 2023-11-08T19:23:14.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.399+0000 7f46a9faf700 1 --2- 172.21.15.149:0/3563947311 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f46a406dd40 0x7f46a415a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:23:14.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.399+0000 7f46aa7b0700 1 --2- 172.21.15.149:0/3563947311 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f46a415dc90 0x7f46a41531c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:23:14.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.399+0000 7f46a97ae700 1 --2- 172.21.15.149:0/3563947311 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46a415a0e0 0x7f46a40c7120 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f46a0000c00 tx=0x7f46a0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:14.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.399+0000 7f469a7fc700 1 -- 172.21.15.149:0/3563947311 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a0004480 con 0x7f46a415a0e0 2023-11-08T19:23:14.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.399+0000 7f469a7fc700 1 -- 172.21.15.149:0/3563947311 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46a001f070 con 0x7f46a415a0e0 2023-11-08T19:23:14.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.399+0000 7f46ac213700 1 -- 172.21.15.149:0/3563947311 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46a40c88d0 con 0x7f46a415a0e0 2023-11-08T19:23:14.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.399+0000 7f469a7fc700 1 -- 172.21.15.149:0/3563947311 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a00038e0 con 0x7f46a415a0e0 2023-11-08T19:23:14.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.399+0000 7f46ac213700 1 -- 172.21.15.149:0/3563947311 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46a40c7660 con 0x7f46a415a0e0 2023-11-08T19:23:14.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.400+0000 7f46ac213700 1 -- 172.21.15.149:0/3563947311 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46a40c77f0 con 0x7f46a415a0e0 2023-11-08T19:23:14.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.401+0000 7f469a7fc700 1 -- 172.21.15.149:0/3563947311 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f46a0021030 con 0x7f46a415a0e0 2023-11-08T19:23:14.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.401+0000 7f469a7fc700 1 --2- 172.21.15.149:0/3563947311 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f468806af00 0x7f468806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:14.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.401+0000 7f46a9faf700 1 --2- 172.21.15.149:0/3563947311 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f468806af00 0x7f468806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:14.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.401+0000 7f469a7fc700 1 -- 172.21.15.149:0/3563947311 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f46a008ac00 con 0x7f46a415a0e0 2023-11-08T19:23:14.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.401+0000 7f46a9faf700 1 --2- 172.21.15.149:0/3563947311 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f468806af00 0x7f468806d3c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4694009a00 tx=0x7f4694008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:14.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.406+0000 7f469a7fc700 1 -- 172.21.15.149:0/3563947311 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f46a0091080 con 0x7f46a415a0e0 2023-11-08T19:23:14.600 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.599+0000 7f46ac213700 1 -- 172.21.15.149:0/3563947311 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f46a40c8d90 con 0x7f46a415a0e0 2023-11-08T19:23:14.601 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.599+0000 7f469a7fc700 1 -- 172.21.15.149:0/3563947311 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f46a0015020 con 0x7f46a415a0e0 2023-11-08T19:23:14.601 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:23:14.603 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.601+0000 7f46ac213700 1 -- 172.21.15.149:0/3563947311 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f468806af00 msgr2=0x7f468806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:14.603 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.601+0000 7f46ac213700 1 --2- 172.21.15.149:0/3563947311 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f468806af00 0x7f468806d3c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4694009a00 tx=0x7f4694008040 comp rx=0 tx=0).stop 2023-11-08T19:23:14.603 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.601+0000 7f46ac213700 1 -- 172.21.15.149:0/3563947311 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46a415a0e0 msgr2=0x7f46a40c7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:14.604 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.601+0000 7f46ac213700 1 --2- 172.21.15.149:0/3563947311 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46a415a0e0 0x7f46a40c7120 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f46a0000c00 tx=0x7f46a0004750 comp rx=0 tx=0).stop 2023-11-08T19:23:14.604 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.601+0000 7f46ac213700 1 -- 172.21.15.149:0/3563947311 shutdown_connections 2023-11-08T19:23:14.604 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.601+0000 7f46ac213700 1 --2- 172.21.15.149:0/3563947311 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f468806af00 0x7f468806d3c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:14.604 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.601+0000 7f46ac213700 1 --2- 172.21.15.149:0/3563947311 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f46a415dc90 0x7f46a41531c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:14.604 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.601+0000 7f46ac213700 1 --2- 172.21.15.149:0/3563947311 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f46a406dd40 0x7f46a415a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:14.605 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.601+0000 7f46ac213700 1 --2- 172.21.15.149:0/3563947311 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46a415a0e0 0x7f46a40c7120 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:14.605 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.601+0000 7f46ac213700 1 -- 172.21.15.149:0/3563947311 >> 172.21.15.149:0/3563947311 conn(0x7f46a40cc860 msgr2=0x7f46a40b0170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:14.605 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.602+0000 7f46ac213700 1 -- 172.21.15.149:0/3563947311 shutdown_connections 2023-11-08T19:23:14.605 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.602+0000 7f46ac213700 1 -- 172.21.15.149:0/3563947311 wait complete. 2023-11-08T19:23:14.614 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-08T19:23:14.739 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.738+0000 7fd87596e700 1 Processor -- start 2023-11-08T19:23:14.740 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.738+0000 7fd87596e700 1 -- start start 2023-11-08T19:23:14.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.739+0000 7fd87596e700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fd87015d890 0x7fd8700b94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:14.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.739+0000 7fd87596e700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd8700d0a10 0x7fd870161590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:14.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.739+0000 7fd87596e700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8700b68f0 con 0x7fd87015dc70 2023-11-08T19:23:14.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.739+0000 7fd87596e700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd870161ca0 con 0x7fd87015d890 2023-11-08T19:23:14.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.739+0000 7fd87596e700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd870161f80 con 0x7fd8700d0a10 2023-11-08T19:23:14.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.739+0000 7fd86f7fe700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd8700d0a10 0x7fd870161590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:14.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.739+0000 7fd86effd700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fd87015d890 0x7fd8700b94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:14.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.739+0000 7fd86e7fc700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7fd87015dc70 0x7fd8700d0300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.149:50634/0 (socket says 172.21.15.149:50634) 2023-11-08T19:23:14.744 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.739+0000 7fd86e7fc700 1 -- 172.21.15.149:0/1369849697 learned_addr learned my addr 172.21.15.149:0/1369849697 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:23:14.744 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.740+0000 7fd86effd700 1 -- 172.21.15.149:0/1369849697 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd8700d0a10 msgr2=0x7fd870161590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:14.744 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.740+0000 7fd86effd700 1 --2- 172.21.15.149:0/1369849697 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd8700d0a10 0x7fd870161590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:14.744 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.740+0000 7fd86effd700 1 -- 172.21.15.149:0/1369849697 >> v1:172.21.15.160:6789/0 conn(0x7fd87015dc70 legacy=0x7fd8700d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:14.744 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.740+0000 7fd86effd700 1 -- 172.21.15.149:0/1369849697 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd870162260 con 0x7fd87015d890 2023-11-08T19:23:14.745 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.740+0000 7fd86f7fe700 1 --2- 172.21.15.149:0/1369849697 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd8700d0a10 0x7fd870161590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:23:14.745 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.740+0000 7fd86dffb700 1 -- 172.21.15.149:0/1369849697 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3371414647 0 0) 0x7fd8700b68f0 con 0x7fd87015dc70 2023-11-08T19:23:14.745 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.740+0000 7fd86effd700 1 --2- 172.21.15.149:0/1369849697 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd87015d890 0x7fd8700b94c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd864009840 tx=0x7fd864009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62a8a33cd048d26e server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:14.745 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.740+0000 7fd86dffb700 1 -- 172.21.15.149:0/1369849697 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd864011830 con 0x7fd87015d890 2023-11-08T19:23:14.745 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.740+0000 7fd86dffb700 1 -- 172.21.15.149:0/1369849697 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd864011990 con 0x7fd87015d890 2023-11-08T19:23:14.746 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.740+0000 7fd86dffb700 1 -- 172.21.15.149:0/1369849697 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd864011d20 con 0x7fd87015d890 2023-11-08T19:23:14.746 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.740+0000 7fd87596e700 1 -- 172.21.15.149:0/1369849697 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd87015d890 msgr2=0x7fd8700b94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:14.746 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.740+0000 7fd87596e700 1 --2- 172.21.15.149:0/1369849697 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd87015d890 0x7fd8700b94c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd864009840 tx=0x7fd864009b50 comp rx=0 tx=0).stop 2023-11-08T19:23:14.746 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.740+0000 7fd87596e700 1 -- 172.21.15.149:0/1369849697 shutdown_connections 2023-11-08T19:23:14.746 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.740+0000 7fd87596e700 1 --2- 172.21.15.149:0/1369849697 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd8700d0a10 0x7fd870161590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:14.747 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.740+0000 7fd87596e700 1 --2- 172.21.15.149:0/1369849697 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd87015d890 0x7fd8700b94c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:14.747 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.740+0000 7fd87596e700 1 -- 172.21.15.149:0/1369849697 >> 172.21.15.149:0/1369849697 conn(0x7fd87006bd60 msgr2=0x7fd87006c140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:14.747 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.741+0000 7fd87596e700 1 -- 172.21.15.149:0/1369849697 shutdown_connections 2023-11-08T19:23:14.747 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.741+0000 7fd87596e700 1 -- 172.21.15.149:0/1369849697 wait complete. 2023-11-08T19:23:14.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.742+0000 7fd87596e700 1 Processor -- start 2023-11-08T19:23:14.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.742+0000 7fd87596e700 1 -- start start 2023-11-08T19:23:14.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.743+0000 7fd87596e700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd8700d0a10 0x7fd8700c6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:14.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.743+0000 7fd87596e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd87015dc70 0x7fd8700cb920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:14.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.743+0000 7fd87596e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8700cbe60 0x7fd8700c9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:14.751 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.743+0000 7fd87596e700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8700cc420 con 0x7fd8700cbe60 2023-11-08T19:23:14.751 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.743+0000 7fd87596e700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8700c7df0 con 0x7fd87015dc70 2023-11-08T19:23:14.751 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.743+0000 7fd87596e700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd87015aa60 con 0x7fd8700d0a10 2023-11-08T19:23:14.751 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.743+0000 7fd86f7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8700cbe60 0x7fd8700c9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:14.751 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.743+0000 7fd86f7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8700cbe60 0x7fd8700c9780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36974/0 (socket says 172.21.15.149:36974) 2023-11-08T19:23:14.752 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.743+0000 7fd86f7fe700 1 -- 172.21.15.149:0/3597148074 learned_addr learned my addr 172.21.15.149:0/3597148074 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:14.752 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.743+0000 7fd86effd700 1 --2- 172.21.15.149:0/3597148074 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd8700d0a10 0x7fd8700c6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:14.752 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.743+0000 7fd86e7fc700 1 --2- 172.21.15.149:0/3597148074 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd87015dc70 0x7fd8700cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:14.752 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.743+0000 7fd86f7fe700 1 -- 172.21.15.149:0/3597148074 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd8700d0a10 msgr2=0x7fd8700c6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:14.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.743+0000 7fd86f7fe700 1 --2- 172.21.15.149:0/3597148074 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd8700d0a10 0x7fd8700c6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:14.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.743+0000 7fd86f7fe700 1 -- 172.21.15.149:0/3597148074 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd87015dc70 msgr2=0x7fd8700cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:14.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.743+0000 7fd86f7fe700 1 --2- 172.21.15.149:0/3597148074 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd87015dc70 0x7fd8700cb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:14.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.743+0000 7fd86f7fe700 1 -- 172.21.15.149:0/3597148074 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd868009a70 con 0x7fd8700cbe60 2023-11-08T19:23:14.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.743+0000 7fd86f7fe700 1 --2- 172.21.15.149:0/3597148074 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8700cbe60 0x7fd8700c9780 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd86800efc0 tx=0x7fd86800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:14.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.743+0000 7fd857fff700 1 -- 172.21.15.149:0/3597148074 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd868009d70 con 0x7fd8700cbe60 2023-11-08T19:23:14.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.743+0000 7fd857fff700 1 -- 172.21.15.149:0/3597148074 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd86800f040 con 0x7fd8700cbe60 2023-11-08T19:23:14.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.743+0000 7fd87596e700 1 -- 172.21.15.149:0/3597148074 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8640094a0 con 0x7fd8700cbe60 2023-11-08T19:23:14.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.743+0000 7fd857fff700 1 -- 172.21.15.149:0/3597148074 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd86800ce00 con 0x7fd8700cbe60 2023-11-08T19:23:14.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.743+0000 7fd87596e700 1 -- 172.21.15.149:0/3597148074 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8700c7730 con 0x7fd8700cbe60 2023-11-08T19:23:14.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.744+0000 7fd87596e700 1 -- 172.21.15.149:0/3597148074 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8700c7f30 con 0x7fd8700cbe60 2023-11-08T19:23:14.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.745+0000 7fd857fff700 1 -- 172.21.15.149:0/3597148074 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd868014480 con 0x7fd8700cbe60 2023-11-08T19:23:14.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.745+0000 7fd857fff700 1 --2- 172.21.15.149:0/3597148074 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd85c06af00 0x7fd85c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:14.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.745+0000 7fd857fff700 1 -- 172.21.15.149:0/3597148074 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd86808a050 con 0x7fd8700cbe60 2023-11-08T19:23:14.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.745+0000 7fd86effd700 1 --2- 172.21.15.149:0/3597148074 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd85c06af00 0x7fd85c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:14.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.746+0000 7fd86effd700 1 --2- 172.21.15.149:0/3597148074 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd85c06af00 0x7fd85c06d3c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd8700d49e0 tx=0x7fd864008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:14.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.750+0000 7fd857fff700 1 -- 172.21.15.149:0/3597148074 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd8700c7f30 con 0x7fd8700cbe60 2023-11-08T19:23:14.940 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.939+0000 7fd87596e700 1 -- 172.21.15.149:0/3597148074 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd8700c7f30 con 0x7fd8700cbe60 2023-11-08T19:23:14.941 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.939+0000 7fd857fff700 1 -- 172.21.15.149:0/3597148074 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd8700c7f30 con 0x7fd8700cbe60 2023-11-08T19:23:14.941 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 64 2023-11-08T19:23:14.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.941+0000 7fd87596e700 1 -- 172.21.15.149:0/3597148074 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd85c06af00 msgr2=0x7fd85c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:14.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.941+0000 7fd87596e700 1 --2- 172.21.15.149:0/3597148074 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd85c06af00 0x7fd85c06d3c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd8700d49e0 tx=0x7fd864008030 comp rx=0 tx=0).stop 2023-11-08T19:23:14.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.941+0000 7fd87596e700 1 -- 172.21.15.149:0/3597148074 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8700cbe60 msgr2=0x7fd8700c9780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:14.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.941+0000 7fd87596e700 1 --2- 172.21.15.149:0/3597148074 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8700cbe60 0x7fd8700c9780 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd86800efc0 tx=0x7fd86800c3a0 comp rx=0 tx=0).stop 2023-11-08T19:23:14.944 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.941+0000 7fd87596e700 1 -- 172.21.15.149:0/3597148074 shutdown_connections 2023-11-08T19:23:14.944 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.941+0000 7fd87596e700 1 --2- 172.21.15.149:0/3597148074 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd85c06af00 0x7fd85c06d3c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:14.944 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.941+0000 7fd87596e700 1 --2- 172.21.15.149:0/3597148074 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8700cbe60 0x7fd8700c9780 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:14.944 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.941+0000 7fd87596e700 1 --2- 172.21.15.149:0/3597148074 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd8700d0a10 0x7fd8700c6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:14.944 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.941+0000 7fd87596e700 1 --2- 172.21.15.149:0/3597148074 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd87015dc70 0x7fd8700cb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:14.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.941+0000 7fd87596e700 1 -- 172.21.15.149:0/3597148074 >> 172.21.15.149:0/3597148074 conn(0x7fd87006bd60 msgr2=0x7fd87015e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:14.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.942+0000 7fd87596e700 1 -- 172.21.15.149:0/3597148074 shutdown_connections 2023-11-08T19:23:14.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:14.942+0000 7fd87596e700 1 -- 172.21.15.149:0/3597148074 wait complete. 2023-11-08T19:23:14.955 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-08T19:23:15.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.078+0000 7f8d463e4700 1 Processor -- start 2023-11-08T19:23:15.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.078+0000 7f8d463e4700 1 -- start start 2023-11-08T19:23:15.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.078+0000 7f8d463e4700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8d400722a0 0x7f8d4006ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:15.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.079+0000 7f8d463e4700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f8d400cb610 0x7f8d400b4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:15.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.079+0000 7f8d463e4700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d400b3710 con 0x7f8d400c7250 2023-11-08T19:23:15.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.079+0000 7f8d463e4700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d4006cc00 con 0x7f8d400cb610 2023-11-08T19:23:15.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.079+0000 7f8d463e4700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4006c640 con 0x7f8d400722a0 2023-11-08T19:23:15.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.079+0000 7f8d3f7fe700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f8d400c7250 0x7f8d4006b0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:38982/0 (socket says 172.21.15.149:38982) 2023-11-08T19:23:15.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.079+0000 7f8d3f7fe700 1 -- 172.21.15.149:0/870078106 learned_addr learned my addr 172.21.15.149:0/870078106 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:23:15.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.079+0000 7f8d3ffff700 1 --2- 172.21.15.149:0/870078106 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8d400722a0 0x7f8d4006ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:15.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.079+0000 7f8d44981700 1 --2- 172.21.15.149:0/870078106 >> v2:172.21.15.160:3300/0 conn(0x7f8d400cb610 0x7f8d400b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:15.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.079+0000 7f8d3effd700 1 -- 172.21.15.149:0/870078106 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 176563131 0 0) 0x7f8d400b3710 con 0x7f8d400c7250 2023-11-08T19:23:15.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.079+0000 7f8d3effd700 1 -- 172.21.15.149:0/870078106 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d280035b0 con 0x7f8d400c7250 2023-11-08T19:23:15.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.079+0000 7f8d3effd700 1 -- 172.21.15.149:0/870078106 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2019500394 0 0) 0x7f8d280035b0 con 0x7f8d400c7250 2023-11-08T19:23:15.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.079+0000 7f8d3effd700 1 -- 172.21.15.149:0/870078106 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8d400722a0 msgr2=0x7f8d4006ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:15.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.079+0000 7f8d3effd700 1 --2- 172.21.15.149:0/870078106 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8d400722a0 0x7f8d4006ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:15.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.079+0000 7f8d3effd700 1 -- 172.21.15.149:0/870078106 >> v2:172.21.15.160:3300/0 conn(0x7f8d400cb610 msgr2=0x7f8d400b4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:15.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.079+0000 7f8d3effd700 1 --2- 172.21.15.149:0/870078106 >> v2:172.21.15.160:3300/0 conn(0x7f8d400cb610 0x7f8d400b4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:15.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.079+0000 7f8d3effd700 1 -- 172.21.15.149:0/870078106 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d4006c920 con 0x7f8d400c7250 2023-11-08T19:23:15.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.079+0000 7f8d3effd700 1 -- 172.21.15.149:0/870078106 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f8d34001670 con 0x7f8d400c7250 2023-11-08T19:23:15.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.079+0000 7f8d3effd700 1 -- 172.21.15.149:0/870078106 >> v1:172.21.15.149:6789/0 conn(0x7f8d400c7250 legacy=0x7f8d4006b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:15.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.079+0000 7f8d3effd700 1 --2- 172.21.15.149:0/870078106 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d28003a70 0x7f8d28003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:15.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.079+0000 7f8d3effd700 1 --2- 172.21.15.149:0/870078106 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d28004850 0x7f8d28004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:15.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.079+0000 7f8d3effd700 1 --2- 172.21.15.149:0/870078106 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8d28005210 0x7f8d2800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:15.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.079+0000 7f8d3effd700 1 -- 172.21.15.149:0/870078106 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4006cc00 con 0x7f8d28004850 2023-11-08T19:23:15.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.079+0000 7f8d3effd700 1 -- 172.21.15.149:0/870078106 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4006c640 con 0x7f8d28003a70 2023-11-08T19:23:15.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.079+0000 7f8d3effd700 1 -- 172.21.15.149:0/870078106 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2800bf50 con 0x7f8d28005210 2023-11-08T19:23:15.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.079+0000 7f8d3ffff700 1 --2- 172.21.15.149:0/870078106 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8d400722a0 0x7f8d4006ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:23:15.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.079+0000 7f8d3f7fe700 1 --2- 172.21.15.149:0/870078106 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d28004850 0x7f8d28004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:15.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.079+0000 7f8d44981700 1 --2- 172.21.15.149:0/870078106 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8d28005210 0x7f8d2800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:15.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.080+0000 7f8d3ffff700 1 --2- 172.21.15.149:0/870078106 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d28003a70 0x7f8d28003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:15.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.080+0000 7f8d3f7fe700 1 -- 172.21.15.149:0/870078106 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8d28005210 msgr2=0x7f8d2800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:15.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.080+0000 7f8d3f7fe700 1 --2- 172.21.15.149:0/870078106 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8d28005210 0x7f8d2800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:15.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.080+0000 7f8d3f7fe700 1 -- 172.21.15.149:0/870078106 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d28003a70 msgr2=0x7f8d28003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:15.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.080+0000 7f8d3f7fe700 1 --2- 172.21.15.149:0/870078106 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d28003a70 0x7f8d28003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:15.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.080+0000 7f8d3f7fe700 1 -- 172.21.15.149:0/870078106 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d280035b0 con 0x7f8d28004850 2023-11-08T19:23:15.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.080+0000 7f8d3f7fe700 1 --2- 172.21.15.149:0/870078106 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d28004850 0x7f8d28004cd0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8d3400c2f0 tx=0x7f8d28005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32e0fb46559e6d5e server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:15.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.080+0000 7f8d3effd700 1 -- 172.21.15.149:0/870078106 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3400ce30 con 0x7f8d28004850 2023-11-08T19:23:15.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.080+0000 7f8d3effd700 1 -- 172.21.15.149:0/870078106 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d34005960 con 0x7f8d28004850 2023-11-08T19:23:15.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.080+0000 7f8d3effd700 1 -- 172.21.15.149:0/870078106 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d34005d10 con 0x7f8d28004850 2023-11-08T19:23:15.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.080+0000 7f8d463e4700 1 -- 172.21.15.149:0/870078106 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d28004850 msgr2=0x7f8d28004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:15.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.080+0000 7f8d463e4700 1 --2- 172.21.15.149:0/870078106 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d28004850 0x7f8d28004cd0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8d3400c2f0 tx=0x7f8d28005880 comp rx=0 tx=0).stop 2023-11-08T19:23:15.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.080+0000 7f8d44981700 1 -- 172.21.15.149:0/870078106 reap_dead start 2023-11-08T19:23:15.092 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.080+0000 7f8d463e4700 1 -- 172.21.15.149:0/870078106 shutdown_connections 2023-11-08T19:23:15.092 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.080+0000 7f8d463e4700 1 -- 172.21.15.149:0/870078106 >> 172.21.15.149:0/870078106 conn(0x7f8d400d0640 msgr2=0x7f8d400d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:15.092 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.081+0000 7f8d463e4700 1 -- 172.21.15.149:0/870078106 shutdown_connections 2023-11-08T19:23:15.092 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.081+0000 7f8d463e4700 1 -- 172.21.15.149:0/870078106 wait complete. 2023-11-08T19:23:15.092 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.082+0000 7f8d463e4700 1 Processor -- start 2023-11-08T19:23:15.093 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.082+0000 7f8d463e4700 1 -- start start 2023-11-08T19:23:15.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.083+0000 7f8d463e4700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8d28004850 0x7f8d400c7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:15.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.083+0000 7f8d463e4700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d400cec20 0x7f8d4014e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:15.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.083+0000 7f8d463e4700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d4014ecb0 0x7f8d4014f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:15.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.083+0000 7f8d463e4700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d400c7ff0 con 0x7f8d4014ecb0 2023-11-08T19:23:15.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.083+0000 7f8d463e4700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d400cf3e0 con 0x7f8d400cec20 2023-11-08T19:23:15.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.083+0000 7f8d463e4700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d400cf6c0 con 0x7f8d28004850 2023-11-08T19:23:15.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.083+0000 7f8d44981700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d4014ecb0 0x7f8d4014f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:15.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.083+0000 7f8d44981700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d4014ecb0 0x7f8d4014f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36994/0 (socket says 172.21.15.149:36994) 2023-11-08T19:23:15.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.083+0000 7f8d44981700 1 -- 172.21.15.149:0/756254206 learned_addr learned my addr 172.21.15.149:0/756254206 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:15.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.083+0000 7f8d3ffff700 1 --2- 172.21.15.149:0/756254206 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8d28004850 0x7f8d400c7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:15.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.083+0000 7f8d44981700 1 -- 172.21.15.149:0/756254206 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8d28004850 msgr2=0x7f8d400c7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:15.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.083+0000 7f8d3f7fe700 1 --2- 172.21.15.149:0/756254206 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d400cec20 0x7f8d4014e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:15.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.083+0000 7f8d44981700 1 --2- 172.21.15.149:0/756254206 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8d28004850 0x7f8d400c7ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:15.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.083+0000 7f8d44981700 1 -- 172.21.15.149:0/756254206 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d400cec20 msgr2=0x7f8d4014e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:15.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.083+0000 7f8d44981700 1 --2- 172.21.15.149:0/756254206 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d400cec20 0x7f8d4014e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:15.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.083+0000 7f8d44981700 1 -- 172.21.15.149:0/756254206 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d400cf9a0 con 0x7f8d4014ecb0 2023-11-08T19:23:15.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.083+0000 7f8d44981700 1 --2- 172.21.15.149:0/756254206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d4014ecb0 0x7f8d4014f160 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8d40071e80 tx=0x7f8d38011f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:15.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.083+0000 7f8d3cff9700 1 -- 172.21.15.149:0/756254206 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3800e040 con 0x7f8d4014ecb0 2023-11-08T19:23:15.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.083+0000 7f8d463e4700 1 -- 172.21.15.149:0/756254206 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d4014c8a0 con 0x7f8d4014ecb0 2023-11-08T19:23:15.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.083+0000 7f8d3cff9700 1 -- 172.21.15.149:0/756254206 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d3800f040 con 0x7f8d4014ecb0 2023-11-08T19:23:15.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.083+0000 7f8d3cff9700 1 -- 172.21.15.149:0/756254206 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3800fdb0 con 0x7f8d4014ecb0 2023-11-08T19:23:15.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.083+0000 7f8d463e4700 1 -- 172.21.15.149:0/756254206 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d401f3150 con 0x7f8d4014ecb0 2023-11-08T19:23:15.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.084+0000 7f8d463e4700 1 -- 172.21.15.149:0/756254206 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d4014ca90 con 0x7f8d4014ecb0 2023-11-08T19:23:15.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.085+0000 7f8d3cff9700 1 -- 172.21.15.149:0/756254206 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8d38022460 con 0x7f8d4014ecb0 2023-11-08T19:23:15.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.085+0000 7f8d3cff9700 1 --2- 172.21.15.149:0/756254206 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f8d2c06af00 0x7f8d2c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:15.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.085+0000 7f8d3cff9700 1 -- 172.21.15.149:0/756254206 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8d3808ab80 con 0x7f8d4014ecb0 2023-11-08T19:23:15.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.085+0000 7f8d3ffff700 1 --2- 172.21.15.149:0/756254206 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f8d2c06af00 0x7f8d2c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:15.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.086+0000 7f8d3ffff700 1 --2- 172.21.15.149:0/756254206 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f8d2c06af00 0x7f8d2c06d3c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8d4015a5a0 tx=0x7f8d30008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:15.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.090+0000 7f8d3cff9700 1 -- 172.21.15.149:0/756254206 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8d38055a20 con 0x7f8d4014ecb0 2023-11-08T19:23:15.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.281+0000 7f8d463e4700 1 -- 172.21.15.149:0/756254206 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f8d400cfb90 con 0x7f8d4014ecb0 2023-11-08T19:23:15.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.281+0000 7f8d3cff9700 1 -- 172.21.15.149:0/756254206 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8d38059040 con 0x7f8d4014ecb0 2023-11-08T19:23:15.283 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:23:15.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.283+0000 7f8d463e4700 1 -- 172.21.15.149:0/756254206 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f8d2c06af00 msgr2=0x7f8d2c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:15.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.283+0000 7f8d463e4700 1 --2- 172.21.15.149:0/756254206 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f8d2c06af00 0x7f8d2c06d3c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8d4015a5a0 tx=0x7f8d30008040 comp rx=0 tx=0).stop 2023-11-08T19:23:15.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.283+0000 7f8d463e4700 1 -- 172.21.15.149:0/756254206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d4014ecb0 msgr2=0x7f8d4014f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:15.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.283+0000 7f8d463e4700 1 --2- 172.21.15.149:0/756254206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d4014ecb0 0x7f8d4014f160 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8d40071e80 tx=0x7f8d38011f80 comp rx=0 tx=0).stop 2023-11-08T19:23:15.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.283+0000 7f8d463e4700 1 -- 172.21.15.149:0/756254206 shutdown_connections 2023-11-08T19:23:15.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.283+0000 7f8d463e4700 1 --2- 172.21.15.149:0/756254206 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f8d2c06af00 0x7f8d2c06d3c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:15.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.283+0000 7f8d463e4700 1 --2- 172.21.15.149:0/756254206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d4014ecb0 0x7f8d4014f160 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:15.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.283+0000 7f8d463e4700 1 --2- 172.21.15.149:0/756254206 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8d28004850 0x7f8d400c7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:15.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.283+0000 7f8d463e4700 1 --2- 172.21.15.149:0/756254206 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d400cec20 0x7f8d4014e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:15.287 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.283+0000 7f8d463e4700 1 -- 172.21.15.149:0/756254206 >> 172.21.15.149:0/756254206 conn(0x7f8d400d0640 msgr2=0x7f8d400af730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:15.287 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.283+0000 7f8d463e4700 1 -- 172.21.15.149:0/756254206 shutdown_connections 2023-11-08T19:23:15.287 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.283+0000 7f8d463e4700 1 -- 172.21.15.149:0/756254206 wait complete. 2023-11-08T19:23:15.297 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-08T19:23:15.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.417+0000 7f6eb42ef700 1 Processor -- start 2023-11-08T19:23:15.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.417+0000 7f6eb42ef700 1 -- start start 2023-11-08T19:23:15.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.418+0000 7f6eb42ef700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6eac0cc910 0x7f6eac0cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:15.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.418+0000 7f6eb42ef700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6eac0cb130 0x7f6eac15d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:15.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.418+0000 7f6eb42ef700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eac0b2f60 con 0x7f6eac0cc140 2023-11-08T19:23:15.422 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.418+0000 7f6eb42ef700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6eac0b2430 con 0x7f6eac0cb130 2023-11-08T19:23:15.422 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.418+0000 7f6eb42ef700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eac0cc520 con 0x7f6eac0cc910 2023-11-08T19:23:15.422 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.418+0000 7f6eb208b700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f6eac0cc140 0x7f6eac0b2850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:39000/0 (socket says 172.21.15.149:39000) 2023-11-08T19:23:15.422 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.418+0000 7f6eb208b700 1 -- 172.21.15.149:0/897340198 learned_addr learned my addr 172.21.15.149:0/897340198 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:23:15.422 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.418+0000 7f6eb288c700 1 --2- 172.21.15.149:0/897340198 >> v2:172.21.15.149:3300/0 conn(0x7f6eac0cb130 0x7f6eac15d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:15.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.418+0000 7f6eb188a700 1 --2- 172.21.15.149:0/897340198 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6eac0cc910 0x7f6eac0cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:15.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.418+0000 7f6eb1089700 1 -- 172.21.15.149:0/897340198 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 822760036 0 0) 0x7f6eac0b2f60 con 0x7f6eac0cc140 2023-11-08T19:23:15.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.418+0000 7f6eb1089700 1 -- 172.21.15.149:0/897340198 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e980035b0 con 0x7f6eac0cc140 2023-11-08T19:23:15.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.419+0000 7f6eb288c700 1 -- 172.21.15.149:0/897340198 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6eac0cc910 msgr2=0x7f6eac0cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:15.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.419+0000 7f6eb288c700 1 --2- 172.21.15.149:0/897340198 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6eac0cc910 0x7f6eac0cabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:15.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.419+0000 7f6eb288c700 1 -- 172.21.15.149:0/897340198 >> v1:172.21.15.149:6789/0 conn(0x7f6eac0cc140 legacy=0x7f6eac0b2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:15.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.419+0000 7f6eb288c700 1 -- 172.21.15.149:0/897340198 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eac0cb5b0 con 0x7f6eac0cb130 2023-11-08T19:23:15.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.419+0000 7f6eb288c700 1 --2- 172.21.15.149:0/897340198 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6eac0cb130 0x7f6eac15d2b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6ea4009d90 tx=0x7f6ea400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a530a857a638266d server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:15.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.419+0000 7f6eb1089700 1 -- 172.21.15.149:0/897340198 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea400e070 con 0x7f6eac0cb130 2023-11-08T19:23:15.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.419+0000 7f6eb1089700 1 -- 172.21.15.149:0/897340198 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ea400bb20 con 0x7f6eac0cb130 2023-11-08T19:23:15.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.419+0000 7f6eb1089700 1 -- 172.21.15.149:0/897340198 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea4012430 con 0x7f6eac0cb130 2023-11-08T19:23:15.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.419+0000 7f6eb42ef700 1 -- 172.21.15.149:0/897340198 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6eac0cb130 msgr2=0x7f6eac15d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:15.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.419+0000 7f6eb42ef700 1 --2- 172.21.15.149:0/897340198 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6eac0cb130 0x7f6eac15d2b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6ea4009d90 tx=0x7f6ea400b330 comp rx=0 tx=0).stop 2023-11-08T19:23:15.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.419+0000 7f6eb42ef700 1 -- 172.21.15.149:0/897340198 shutdown_connections 2023-11-08T19:23:15.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.419+0000 7f6eb42ef700 1 --2- 172.21.15.149:0/897340198 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6eac0cb130 0x7f6eac15d2b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:15.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.419+0000 7f6eb42ef700 1 --2- 172.21.15.149:0/897340198 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6eac0cc910 0x7f6eac0cabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:15.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.419+0000 7f6eb42ef700 1 -- 172.21.15.149:0/897340198 >> 172.21.15.149:0/897340198 conn(0x7f6eac099a40 msgr2=0x7f6eac0d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:15.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.420+0000 7f6eb42ef700 1 -- 172.21.15.149:0/897340198 shutdown_connections 2023-11-08T19:23:15.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.420+0000 7f6eb42ef700 1 -- 172.21.15.149:0/897340198 wait complete. 2023-11-08T19:23:15.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.421+0000 7f6eb42ef700 1 Processor -- start 2023-11-08T19:23:15.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.421+0000 7f6eb42ef700 1 -- start start 2023-11-08T19:23:15.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.421+0000 7f6eb42ef700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6eac0cb130 0x7f6eac15e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:15.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.421+0000 7f6eb42ef700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6eac0cc140 0x7f6eac15ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:15.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.421+0000 7f6eb42ef700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6eac0cc910 0x7f6eac0c9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:15.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.421+0000 7f6eb42ef700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eac0c6540 con 0x7f6eac0cb130 2023-11-08T19:23:15.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.421+0000 7f6eb42ef700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eac0c4ad0 con 0x7f6eac0cc910 2023-11-08T19:23:15.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.421+0000 7f6eb42ef700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eac0c4170 con 0x7f6eac0cc140 2023-11-08T19:23:15.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.421+0000 7f6eb208b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6eac0cb130 0x7f6eac15e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:15.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.422+0000 7f6eb208b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6eac0cb130 0x7f6eac15e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37004/0 (socket says 172.21.15.149:37004) 2023-11-08T19:23:15.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.422+0000 7f6eb208b700 1 -- 172.21.15.149:0/4117014493 learned_addr learned my addr 172.21.15.149:0/4117014493 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:15.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.422+0000 7f6eb188a700 1 --2- 172.21.15.149:0/4117014493 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6eac0cc140 0x7f6eac15ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:15.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.422+0000 7f6eb288c700 1 --2- 172.21.15.149:0/4117014493 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6eac0cc910 0x7f6eac0c9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:15.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.422+0000 7f6eb208b700 1 -- 172.21.15.149:0/4117014493 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6eac0cc140 msgr2=0x7f6eac15ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:15.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.422+0000 7f6eb208b700 1 --2- 172.21.15.149:0/4117014493 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6eac0cc140 0x7f6eac15ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:15.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.422+0000 7f6eb208b700 1 -- 172.21.15.149:0/4117014493 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6eac0cc910 msgr2=0x7f6eac0c9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:15.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.422+0000 7f6eb208b700 1 --2- 172.21.15.149:0/4117014493 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6eac0cc910 0x7f6eac0c9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:15.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.422+0000 7f6eb208b700 1 -- 172.21.15.149:0/4117014493 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ea4009a70 con 0x7f6eac0cb130 2023-11-08T19:23:15.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.422+0000 7f6eb188a700 1 --2- 172.21.15.149:0/4117014493 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6eac0cc140 0x7f6eac15ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:23:15.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.422+0000 7f6eb208b700 1 --2- 172.21.15.149:0/4117014493 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6eac0cb130 0x7f6eac15e500 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c001260 tx=0x7f6e9c00ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:15.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.422+0000 7f6ea2ffd700 1 -- 172.21.15.149:0/4117014493 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9c0074e0 con 0x7f6eac0cb130 2023-11-08T19:23:15.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.422+0000 7f6ea2ffd700 1 -- 172.21.15.149:0/4117014493 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e9c007640 con 0x7f6eac0cb130 2023-11-08T19:23:15.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.422+0000 7f6ea2ffd700 1 -- 172.21.15.149:0/4117014493 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9c005a50 con 0x7f6eac0cb130 2023-11-08T19:23:15.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.422+0000 7f6eb42ef700 1 -- 172.21.15.149:0/4117014493 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eac0c4410 con 0x7f6eac0cb130 2023-11-08T19:23:15.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.422+0000 7f6eb42ef700 1 -- 172.21.15.149:0/4117014493 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eac0ca6c0 con 0x7f6eac0cb130 2023-11-08T19:23:15.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.423+0000 7f6eb42ef700 1 -- 172.21.15.149:0/4117014493 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eac0cdf10 con 0x7f6eac0cb130 2023-11-08T19:23:15.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.424+0000 7f6ea2ffd700 1 -- 172.21.15.149:0/4117014493 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6e9c005bb0 con 0x7f6eac0cb130 2023-11-08T19:23:15.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.424+0000 7f6ea2ffd700 1 --2- 172.21.15.149:0/4117014493 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6e9006af00 0x7f6e9006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:15.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.424+0000 7f6ea2ffd700 1 -- 172.21.15.149:0/4117014493 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6e9c088dd0 con 0x7f6eac0cb130 2023-11-08T19:23:15.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.424+0000 7f6eb188a700 1 --2- 172.21.15.149:0/4117014493 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6e9006af00 0x7f6e9006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:15.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.424+0000 7f6eb188a700 1 --2- 172.21.15.149:0/4117014493 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6e9006af00 0x7f6e9006d3c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6eac0c9590 tx=0x7f6ea8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:15.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.429+0000 7f6ea2ffd700 1 -- 172.21.15.149:0/4117014493 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6e9c0576b0 con 0x7f6eac0cb130 2023-11-08T19:23:15.636 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.635+0000 7f6eb42ef700 1 -- 172.21.15.149:0/4117014493 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6eac0745f0 con 0x7f6eac0cb130 2023-11-08T19:23:15.636 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.635+0000 7f6ea2ffd700 1 -- 172.21.15.149:0/4117014493 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6e9c08a080 con 0x7f6eac0cb130 2023-11-08T19:23:15.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.637+0000 7f6eb42ef700 1 -- 172.21.15.149:0/4117014493 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6e9006af00 msgr2=0x7f6e9006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:15.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.637+0000 7f6eb42ef700 1 --2- 172.21.15.149:0/4117014493 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6e9006af00 0x7f6e9006d3c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6eac0c9590 tx=0x7f6ea8008040 comp rx=0 tx=0).stop 2023-11-08T19:23:15.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.637+0000 7f6eb42ef700 1 -- 172.21.15.149:0/4117014493 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6eac0cb130 msgr2=0x7f6eac15e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:15.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.637+0000 7f6eb42ef700 1 --2- 172.21.15.149:0/4117014493 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6eac0cb130 0x7f6eac15e500 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c001260 tx=0x7f6e9c00ca90 comp rx=0 tx=0).stop 2023-11-08T19:23:15.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.637+0000 7f6eb42ef700 1 -- 172.21.15.149:0/4117014493 shutdown_connections 2023-11-08T19:23:15.640 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.637+0000 7f6eb42ef700 1 --2- 172.21.15.149:0/4117014493 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6e9006af00 0x7f6e9006d3c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:15.640 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.637+0000 7f6eb42ef700 1 --2- 172.21.15.149:0/4117014493 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6eac0cc910 0x7f6eac0c9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:15.640 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.637+0000 7f6eb42ef700 1 --2- 172.21.15.149:0/4117014493 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6eac0cb130 0x7f6eac15e500 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:15.640 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.637+0000 7f6eb42ef700 1 --2- 172.21.15.149:0/4117014493 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6eac0cc140 0x7f6eac15ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:15.641 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.637+0000 7f6eb42ef700 1 -- 172.21.15.149:0/4117014493 >> 172.21.15.149:0/4117014493 conn(0x7f6eac099a40 msgr2=0x7f6eac06f870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:15.641 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.637+0000 7f6eb42ef700 1 -- 172.21.15.149:0/4117014493 shutdown_connections 2023-11-08T19:23:15.641 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.637+0000 7f6eb42ef700 1 -- 172.21.15.149:0/4117014493 wait complete. 2023-11-08T19:23:15.641 INFO:teuthology.orchestra.run.smithi149.stderr:listed 0 entries 2023-11-08T19:23:15.651 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-11-08T19:23:15.651 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:23:15.669 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:23:15.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.828+0000 7f53f149c700 1 Processor -- start 2023-11-08T19:23:15.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.828+0000 7f53f149c700 1 -- start start 2023-11-08T19:23:15.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.829+0000 7f53f149c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53ec161670 0x7f53ec0b5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:15.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.829+0000 7f53f149c700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53ec0d1a10 con 0x7f53ec161a50 2023-11-08T19:23:15.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.829+0000 7f53f149c700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53ec0d1cf0 con 0x7f53ec0ce500 2023-11-08T19:23:15.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.829+0000 7f53f149c700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53ec0d1fd0 con 0x7f53ec161670 2023-11-08T19:23:15.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.829+0000 7f53ea7fc700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f53ec161a50 0x7f53ec161ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:39016/0 (socket says 172.21.15.149:39016) 2023-11-08T19:23:15.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.829+0000 7f53ea7fc700 1 -- 172.21.15.149:0/3792451370 learned_addr learned my addr 172.21.15.149:0/3792451370 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:23:15.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.829+0000 7f53eaffd700 1 --2- 172.21.15.149:0/3792451370 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53ec161670 0x7f53ec0b5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:15.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.829+0000 7f53e9ffb700 1 -- 172.21.15.149:0/3792451370 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4060284688 0 0) 0x7f53ec0d1a10 con 0x7f53ec161a50 2023-11-08T19:23:15.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.829+0000 7f53e9ffb700 1 -- 172.21.15.149:0/3792451370 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53d40035b0 con 0x7f53ec161a50 2023-11-08T19:23:15.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.829+0000 7f53e9ffb700 1 -- 172.21.15.149:0/3792451370 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 847280269 0 0) 0x7f53d40035b0 con 0x7f53ec161a50 2023-11-08T19:23:15.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.829+0000 7f53e9ffb700 1 -- 172.21.15.149:0/3792451370 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53ec161670 msgr2=0x7f53ec0b5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:15.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.829+0000 7f53e9ffb700 1 --2- 172.21.15.149:0/3792451370 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53ec161670 0x7f53ec0b5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:15.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.829+0000 7f53e9ffb700 1 -- 172.21.15.149:0/3792451370 >> v1:172.21.15.160:6789/0 conn(0x7f53ec0ce500 legacy=0x7f53ec0ce990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:15.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.829+0000 7f53e9ffb700 1 -- 172.21.15.149:0/3792451370 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53ec0d22b0 con 0x7f53ec161a50 2023-11-08T19:23:15.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.829+0000 7f53e9ffb700 1 -- 172.21.15.149:0/3792451370 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f53e0001670 con 0x7f53ec161a50 2023-11-08T19:23:15.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.829+0000 7f53e9ffb700 1 -- 172.21.15.149:0/3792451370 >> v1:172.21.15.149:6789/0 conn(0x7f53ec161a50 legacy=0x7f53ec161ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:15.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.829+0000 7f53e9ffb700 1 --2- 172.21.15.149:0/3792451370 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53d4003a30 0x7f53d4003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:15.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.829+0000 7f53e9ffb700 1 --2- 172.21.15.149:0/3792451370 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53d4004420 0x7f53d40048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:15.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.829+0000 7f53e9ffb700 1 --2- 172.21.15.149:0/3792451370 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53d40050f0 0x7f53d400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:15.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.829+0000 7f53e9ffb700 1 -- 172.21.15.149:0/3792451370 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53ec0d1fd0 con 0x7f53d4004420 2023-11-08T19:23:15.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.829+0000 7f53e9ffb700 1 -- 172.21.15.149:0/3792451370 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d400c000 con 0x7f53d40050f0 2023-11-08T19:23:15.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.829+0000 7f53e9ffb700 1 -- 172.21.15.149:0/3792451370 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53d400c1c0 con 0x7f53d4003a30 2023-11-08T19:23:15.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.829+0000 7f53eaffd700 1 --2- 172.21.15.149:0/3792451370 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53ec161670 0x7f53ec0b5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:23:15.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.829+0000 7f53ea7fc700 1 --2- 172.21.15.149:0/3792451370 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53d4004420 0x7f53d40048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:15.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.829+0000 7f53eb7fe700 1 --2- 172.21.15.149:0/3792451370 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53d40050f0 0x7f53d400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:15.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.830+0000 7f53eaffd700 1 --2- 172.21.15.149:0/3792451370 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53d4003a30 0x7f53d4003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:15.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.830+0000 7f53ea7fc700 1 -- 172.21.15.149:0/3792451370 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53d4003a30 msgr2=0x7f53d4003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:15.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.830+0000 7f53ea7fc700 1 --2- 172.21.15.149:0/3792451370 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53d4003a30 0x7f53d4003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:15.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.830+0000 7f53ea7fc700 1 -- 172.21.15.149:0/3792451370 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53d40050f0 msgr2=0x7f53d400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:15.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.830+0000 7f53ea7fc700 1 --2- 172.21.15.149:0/3792451370 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53d40050f0 0x7f53d400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:15.842 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.830+0000 7f53ea7fc700 1 -- 172.21.15.149:0/3792451370 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d40035b0 con 0x7f53d4004420 2023-11-08T19:23:15.842 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.830+0000 7f53ea7fc700 1 --2- 172.21.15.149:0/3792451370 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53d4004420 0x7f53d40048f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f53e000c240 tx=0x7f53d4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d507eefaa3ae7b1 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:15.842 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.830+0000 7f53e9ffb700 1 -- 172.21.15.149:0/3792451370 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e0007c10 con 0x7f53d4004420 2023-11-08T19:23:15.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.830+0000 7f53e9ffb700 1 -- 172.21.15.149:0/3792451370 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53e000ce00 con 0x7f53d4004420 2023-11-08T19:23:15.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.830+0000 7f53e9ffb700 1 -- 172.21.15.149:0/3792451370 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e0005ba0 con 0x7f53d4004420 2023-11-08T19:23:15.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.830+0000 7f53f149c700 1 -- 172.21.15.149:0/3792451370 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53d4004420 msgr2=0x7f53d40048f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:15.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.830+0000 7f53f149c700 1 --2- 172.21.15.149:0/3792451370 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53d4004420 0x7f53d40048f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f53e000c240 tx=0x7f53d4005880 comp rx=0 tx=0).stop 2023-11-08T19:23:15.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.830+0000 7f53eb7fe700 1 -- 172.21.15.149:0/3792451370 reap_dead start 2023-11-08T19:23:15.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.831+0000 7f53f149c700 1 -- 172.21.15.149:0/3792451370 shutdown_connections 2023-11-08T19:23:15.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.831+0000 7f53f149c700 1 -- 172.21.15.149:0/3792451370 >> 172.21.15.149:0/3792451370 conn(0x7f53ec0d3980 msgr2=0x7f53ec0d3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:15.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.831+0000 7f53f149c700 1 -- 172.21.15.149:0/3792451370 shutdown_connections 2023-11-08T19:23:15.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.831+0000 7f53f149c700 1 -- 172.21.15.149:0/3792451370 wait complete. 2023-11-08T19:23:15.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.832+0000 7f53f149c700 1 Processor -- start 2023-11-08T19:23:15.845 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.832+0000 7f53f149c700 1 -- start start 2023-11-08T19:23:15.845 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.833+0000 7f53f149c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53d4004420 0x7f53ec14fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:15.845 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.833+0000 7f53f149c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53ec0ca9c0 0x7f53ec0cae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:15.845 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.833+0000 7f53f149c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53ec0cd000 0x7f53ec0cd480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:15.846 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.833+0000 7f53f149c700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53ec0cd9c0 con 0x7f53d4004420 2023-11-08T19:23:15.846 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.833+0000 7f53f149c700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53ec0cc4e0 con 0x7f53ec0ca9c0 2023-11-08T19:23:15.846 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.833+0000 7f53f149c700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53ec0cb440 con 0x7f53ec0cd000 2023-11-08T19:23:15.846 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.833+0000 7f53eaffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53d4004420 0x7f53ec14fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:15.846 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.833+0000 7f53eaffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53d4004420 0x7f53ec14fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37024/0 (socket says 172.21.15.149:37024) 2023-11-08T19:23:15.847 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.833+0000 7f53eaffd700 1 -- 172.21.15.149:0/4060076872 learned_addr learned my addr 172.21.15.149:0/4060076872 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:15.847 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.833+0000 7f53eb7fe700 1 --2- 172.21.15.149:0/4060076872 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53ec0cd000 0x7f53ec0cd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:15.847 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.833+0000 7f53ea7fc700 1 --2- 172.21.15.149:0/4060076872 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53ec0ca9c0 0x7f53ec0cae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:15.847 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.833+0000 7f53eaffd700 1 -- 172.21.15.149:0/4060076872 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53ec0cd000 msgr2=0x7f53ec0cd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:15.848 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.833+0000 7f53eaffd700 1 --2- 172.21.15.149:0/4060076872 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53ec0cd000 0x7f53ec0cd480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:15.848 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.833+0000 7f53eaffd700 1 -- 172.21.15.149:0/4060076872 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53ec0ca9c0 msgr2=0x7f53ec0cae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:15.848 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.833+0000 7f53eaffd700 1 --2- 172.21.15.149:0/4060076872 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53ec0ca9c0 0x7f53ec0cae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:15.848 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.833+0000 7f53eaffd700 1 -- 172.21.15.149:0/4060076872 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53ec0cb720 con 0x7f53d4004420 2023-11-08T19:23:15.848 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.833+0000 7f53eb7fe700 1 --2- 172.21.15.149:0/4060076872 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53ec0cd000 0x7f53ec0cd480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:23:15.849 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.833+0000 7f53eaffd700 1 --2- 172.21.15.149:0/4060076872 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53d4004420 0x7f53ec14fb40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f53dc011c00 tx=0x7f53dc009ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:15.849 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.833+0000 7f53d37fe700 1 -- 172.21.15.149:0/4060076872 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53dc00fa60 con 0x7f53d4004420 2023-11-08T19:23:15.849 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.833+0000 7f53d37fe700 1 -- 172.21.15.149:0/4060076872 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53dc00fbc0 con 0x7f53d4004420 2023-11-08T19:23:15.849 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.833+0000 7f53d37fe700 1 -- 172.21.15.149:0/4060076872 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53dc014440 con 0x7f53d4004420 2023-11-08T19:23:15.850 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.833+0000 7f53f149c700 1 -- 172.21.15.149:0/4060076872 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53ec0cba00 con 0x7f53d4004420 2023-11-08T19:23:15.850 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.833+0000 7f53f149c700 1 -- 172.21.15.149:0/4060076872 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53ec0cbfc0 con 0x7f53d4004420 2023-11-08T19:23:15.850 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.834+0000 7f53f149c700 1 -- 172.21.15.149:0/4060076872 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53ec0cc330 con 0x7f53d4004420 2023-11-08T19:23:15.851 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.835+0000 7f53d37fe700 1 -- 172.21.15.149:0/4060076872 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f53dc0145a0 con 0x7f53d4004420 2023-11-08T19:23:15.851 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.835+0000 7f53d37fe700 1 --2- 172.21.15.149:0/4060076872 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f53d806af00 0x7f53d806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:15.852 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.835+0000 7f53ea7fc700 1 --2- 172.21.15.149:0/4060076872 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f53d806af00 0x7f53d806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:15.852 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.835+0000 7f53d37fe700 1 -- 172.21.15.149:0/4060076872 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f53dc08a0f0 con 0x7f53d4004420 2023-11-08T19:23:15.852 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.836+0000 7f53ea7fc700 1 --2- 172.21.15.149:0/4060076872 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f53d806af00 0x7f53d806d3c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f53e0015040 tx=0x7f53e0007000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:15.852 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:15.840+0000 7f53d37fe700 1 -- 172.21.15.149:0/4060076872 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f53dc054eb0 con 0x7f53d4004420 2023-11-08T19:23:16.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.033+0000 7f53f149c700 1 -- 172.21.15.149:0/4060076872 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f53ec0745f0 con 0x7f53d4004420 2023-11-08T19:23:16.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.034+0000 7f53d37fe700 1 -- 172.21.15.149:0/4060076872 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18382 (secure 0 0 0) 0x7f53dc0584d0 con 0x7f53d4004420 2023-11-08T19:23:16.036 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:23:16.036 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":24,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:23:06.964482+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-08T19:22:59.830928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-08T19:23:00.886589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-08T19:23:04.574033+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:23:16.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.037+0000 7f53f149c700 1 -- 172.21.15.149:0/4060076872 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f53d806af00 msgr2=0x7f53d806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:16.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.037+0000 7f53f149c700 1 --2- 172.21.15.149:0/4060076872 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f53d806af00 0x7f53d806d3c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f53e0015040 tx=0x7f53e0007000 comp rx=0 tx=0).stop 2023-11-08T19:23:16.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.037+0000 7f53f149c700 1 -- 172.21.15.149:0/4060076872 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53d4004420 msgr2=0x7f53ec14fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:16.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.037+0000 7f53f149c700 1 --2- 172.21.15.149:0/4060076872 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53d4004420 0x7f53ec14fb40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f53dc011c00 tx=0x7f53dc009ea0 comp rx=0 tx=0).stop 2023-11-08T19:23:16.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.037+0000 7f53f149c700 1 -- 172.21.15.149:0/4060076872 shutdown_connections 2023-11-08T19:23:16.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.037+0000 7f53f149c700 1 --2- 172.21.15.149:0/4060076872 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f53d806af00 0x7f53d806d3c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:16.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.037+0000 7f53f149c700 1 --2- 172.21.15.149:0/4060076872 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53ec0cd000 0x7f53ec0cd480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:16.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.037+0000 7f53f149c700 1 --2- 172.21.15.149:0/4060076872 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53d4004420 0x7f53ec14fb40 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:16.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.037+0000 7f53f149c700 1 --2- 172.21.15.149:0/4060076872 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53ec0ca9c0 0x7f53ec0cae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:16.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.037+0000 7f53f149c700 1 -- 172.21.15.149:0/4060076872 >> 172.21.15.149:0/4060076872 conn(0x7f53ec0d3980 msgr2=0x7f53ec1e9360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:16.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.037+0000 7f53f149c700 1 -- 172.21.15.149:0/4060076872 shutdown_connections 2023-11-08T19:23:16.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.037+0000 7f53f149c700 1 -- 172.21.15.149:0/4060076872 wait complete. 2023-11-08T19:23:16.050 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-08T19:22:56.023194+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-08T19:22:59.830928+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-08T19:23:00.886589+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-08T19:23:04.574033+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-08T19:23:16.051 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-08T19:23:16.178 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.177+0000 7fa43a1d0700 1 Processor -- start 2023-11-08T19:23:16.179 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.177+0000 7fa43a1d0700 1 -- start start 2023-11-08T19:23:16.185 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.178+0000 7fa43a1d0700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fa43415abf0 0x7fa4340b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:16.185 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.178+0000 7fa43a1d0700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa4340d1130 0x7fa4340cc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:16.185 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.178+0000 7fa43a1d0700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4340b6470 con 0x7fa4340cc6a0 2023-11-08T19:23:16.186 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.178+0000 7fa43a1d0700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4340b66a0 con 0x7fa43415abf0 2023-11-08T19:23:16.186 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.178+0000 7fa43a1d0700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4340d04a0 con 0x7fa4340d1130 2023-11-08T19:23:16.186 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.178+0000 7fa433fff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fa4340cc6a0 0x7fa4340ce210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:39038/0 (socket says 172.21.15.149:39038) 2023-11-08T19:23:16.186 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.178+0000 7fa433fff700 1 -- 172.21.15.149:0/265698249 learned_addr learned my addr 172.21.15.149:0/265698249 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:23:16.187 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.179+0000 7fa42affd700 1 --2- 172.21.15.149:0/265698249 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa4340d1130 0x7fa4340cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:16.187 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.179+0000 7fa4337fe700 1 --2- 172.21.15.149:0/265698249 >> v2:172.21.15.160:3300/0 conn(0x7fa43415abf0 0x7fa4340b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:16.187 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.179+0000 7fa432ffd700 1 -- 172.21.15.149:0/265698249 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2759018651 0 0) 0x7fa4340b6470 con 0x7fa4340cc6a0 2023-11-08T19:23:16.187 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.179+0000 7fa432ffd700 1 -- 172.21.15.149:0/265698249 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4200035b0 con 0x7fa4340cc6a0 2023-11-08T19:23:16.187 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.179+0000 7fa432ffd700 1 -- 172.21.15.149:0/265698249 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1767191373 0 0) 0x7fa4200035b0 con 0x7fa4340cc6a0 2023-11-08T19:23:16.188 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.179+0000 7fa432ffd700 1 -- 172.21.15.149:0/265698249 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa4340d1130 msgr2=0x7fa4340cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:16.188 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.179+0000 7fa432ffd700 1 --2- 172.21.15.149:0/265698249 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa4340d1130 0x7fa4340cc160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:16.188 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.179+0000 7fa432ffd700 1 -- 172.21.15.149:0/265698249 >> v2:172.21.15.160:3300/0 conn(0x7fa43415abf0 msgr2=0x7fa4340b5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:16.188 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.179+0000 7fa432ffd700 1 --2- 172.21.15.149:0/265698249 >> v2:172.21.15.160:3300/0 conn(0x7fa43415abf0 0x7fa4340b5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:16.188 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.179+0000 7fa432ffd700 1 -- 172.21.15.149:0/265698249 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa43415afd0 con 0x7fa4340cc6a0 2023-11-08T19:23:16.189 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.179+0000 7fa432ffd700 1 -- 172.21.15.149:0/265698249 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7fa42c0019f0 con 0x7fa4340cc6a0 2023-11-08T19:23:16.189 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.179+0000 7fa4337fe700 1 --2- 172.21.15.149:0/265698249 >> v2:172.21.15.160:3300/0 conn(0x7fa43415abf0 0x7fa4340b5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:23:16.189 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.179+0000 7fa432ffd700 1 -- 172.21.15.149:0/265698249 >> v1:172.21.15.149:6789/0 conn(0x7fa4340cc6a0 legacy=0x7fa4340ce210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:16.189 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.179+0000 7fa432ffd700 1 --2- 172.21.15.149:0/265698249 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa420003a70 0x7fa420003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:16.189 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.179+0000 7fa432ffd700 1 --2- 172.21.15.149:0/265698249 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa420004850 0x7fa420004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:16.190 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.179+0000 7fa432ffd700 1 --2- 172.21.15.149:0/265698249 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa4340d1130 0x7fa420005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:16.190 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.179+0000 7fa432ffd700 1 -- 172.21.15.149:0/265698249 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4340b66a0 con 0x7fa420004850 2023-11-08T19:23:16.190 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.179+0000 7fa432ffd700 1 -- 172.21.15.149:0/265698249 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4340d04a0 con 0x7fa420003a70 2023-11-08T19:23:16.190 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.179+0000 7fa432ffd700 1 -- 172.21.15.149:0/265698249 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa42000ba10 con 0x7fa4340d1130 2023-11-08T19:23:16.191 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.179+0000 7fa42affd700 1 --2- 172.21.15.149:0/265698249 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa420004850 0x7fa420004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:16.191 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.179+0000 7fa4337fe700 1 --2- 172.21.15.149:0/265698249 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa420003a70 0x7fa420003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:16.191 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.179+0000 7fa433fff700 1 --2- 172.21.15.149:0/265698249 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa4340d1130 0x7fa420005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:16.191 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.179+0000 7fa42affd700 1 -- 172.21.15.149:0/265698249 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa4340d1130 msgr2=0x7fa420005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:16.191 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.179+0000 7fa42affd700 1 --2- 172.21.15.149:0/265698249 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa4340d1130 0x7fa420005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:16.192 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.179+0000 7fa42affd700 1 -- 172.21.15.149:0/265698249 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa420003a70 msgr2=0x7fa420003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:16.192 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.179+0000 7fa42affd700 1 --2- 172.21.15.149:0/265698249 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa420003a70 0x7fa420003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:16.192 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.179+0000 7fa42affd700 1 -- 172.21.15.149:0/265698249 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4200035b0 con 0x7fa420004850 2023-11-08T19:23:16.192 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.180+0000 7fa42affd700 1 --2- 172.21.15.149:0/265698249 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa420004850 0x7fa420004cd0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa41c009b90 tx=0x7fa420005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ac7fca6d41a4376 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:16.192 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.180+0000 7fa432ffd700 1 -- 172.21.15.149:0/265698249 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa41c00e6c0 con 0x7fa420004850 2023-11-08T19:23:16.192 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.180+0000 7fa432ffd700 1 -- 172.21.15.149:0/265698249 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa41c00e820 con 0x7fa420004850 2023-11-08T19:23:16.193 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.180+0000 7fa432ffd700 1 -- 172.21.15.149:0/265698249 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa41c00eb90 con 0x7fa420004850 2023-11-08T19:23:16.193 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.180+0000 7fa43a1d0700 1 -- 172.21.15.149:0/265698249 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa420004850 msgr2=0x7fa420004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:16.193 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.180+0000 7fa43a1d0700 1 --2- 172.21.15.149:0/265698249 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa420004850 0x7fa420004cd0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa41c009b90 tx=0x7fa420005880 comp rx=0 tx=0).stop 2023-11-08T19:23:16.193 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.180+0000 7fa433fff700 1 -- 172.21.15.149:0/265698249 reap_dead start 2023-11-08T19:23:16.193 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.180+0000 7fa43a1d0700 1 -- 172.21.15.149:0/265698249 shutdown_connections 2023-11-08T19:23:16.194 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.180+0000 7fa43a1d0700 1 -- 172.21.15.149:0/265698249 >> 172.21.15.149:0/265698249 conn(0x7fa4340d0640 msgr2=0x7fa4340d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:16.194 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.180+0000 7fa43a1d0700 1 -- 172.21.15.149:0/265698249 shutdown_connections 2023-11-08T19:23:16.194 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.180+0000 7fa43a1d0700 1 -- 172.21.15.149:0/265698249 wait complete. 2023-11-08T19:23:16.194 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.181+0000 7fa43a1d0700 1 Processor -- start 2023-11-08T19:23:16.194 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.182+0000 7fa43a1d0700 1 -- start start 2023-11-08T19:23:16.195 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.182+0000 7fa43a1d0700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa420004850 0x7fa434150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:16.195 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.182+0000 7fa43a1d0700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa434152660 0x7fa4340c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:16.195 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.182+0000 7fa43a1d0700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4340c9fc0 0x7fa4340c7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:16.195 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.182+0000 7fa43a1d0700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa434152ac0 con 0x7fa4340c9fc0 2023-11-08T19:23:16.195 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.182+0000 7fa43a1d0700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4341515c0 con 0x7fa434152660 2023-11-08T19:23:16.196 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.182+0000 7fa43a1d0700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4341518a0 con 0x7fa420004850 2023-11-08T19:23:16.196 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.183+0000 7fa433fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4340c9fc0 0x7fa4340c7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:16.196 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.183+0000 7fa433fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4340c9fc0 0x7fa4340c7a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37048/0 (socket says 172.21.15.149:37048) 2023-11-08T19:23:16.196 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.183+0000 7fa433fff700 1 -- 172.21.15.149:0/1092358859 learned_addr learned my addr 172.21.15.149:0/1092358859 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:16.196 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.183+0000 7fa42affd700 1 --2- 172.21.15.149:0/1092358859 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa434152660 0x7fa4340c9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:16.197 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.183+0000 7fa4337fe700 1 --2- 172.21.15.149:0/1092358859 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa420004850 0x7fa434150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:16.197 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.183+0000 7fa433fff700 1 -- 172.21.15.149:0/1092358859 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa420004850 msgr2=0x7fa434150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:16.197 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.183+0000 7fa433fff700 1 --2- 172.21.15.149:0/1092358859 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa420004850 0x7fa434150fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:16.197 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.183+0000 7fa433fff700 1 -- 172.21.15.149:0/1092358859 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa434152660 msgr2=0x7fa4340c9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:16.197 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.183+0000 7fa433fff700 1 --2- 172.21.15.149:0/1092358859 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa434152660 0x7fa4340c9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:16.198 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.183+0000 7fa433fff700 1 -- 172.21.15.149:0/1092358859 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa434151b80 con 0x7fa4340c9fc0 2023-11-08T19:23:16.198 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.183+0000 7fa42affd700 1 --2- 172.21.15.149:0/1092358859 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa434152660 0x7fa4340c9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:23:16.198 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.183+0000 7fa433fff700 1 --2- 172.21.15.149:0/1092358859 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4340c9fc0 0x7fa4340c7a70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa42c000f80 tx=0x7fa42c00a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:16.198 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.183+0000 7fa430ff9700 1 -- 172.21.15.149:0/1092358859 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42c00adb0 con 0x7fa4340c9fc0 2023-11-08T19:23:16.198 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.183+0000 7fa430ff9700 1 -- 172.21.15.149:0/1092358859 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa42c0133f0 con 0x7fa4340c9fc0 2023-11-08T19:23:16.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.183+0000 7fa430ff9700 1 -- 172.21.15.149:0/1092358859 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42c0137a0 con 0x7fa4340c9fc0 2023-11-08T19:23:16.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.183+0000 7fa43a1d0700 1 -- 172.21.15.149:0/1092358859 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa434151e60 con 0x7fa4340c9fc0 2023-11-08T19:23:16.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.183+0000 7fa43a1d0700 1 -- 172.21.15.149:0/1092358859 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4340ca440 con 0x7fa4340c9fc0 2023-11-08T19:23:16.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.184+0000 7fa43a1d0700 1 -- 172.21.15.149:0/1092358859 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa434152380 con 0x7fa4340c9fc0 2023-11-08T19:23:16.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.185+0000 7fa430ff9700 1 -- 172.21.15.149:0/1092358859 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa42c013900 con 0x7fa4340c9fc0 2023-11-08T19:23:16.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.185+0000 7fa430ff9700 1 --2- 172.21.15.149:0/1092358859 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa41406af00 0x7fa41406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:16.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.185+0000 7fa4337fe700 1 --2- 172.21.15.149:0/1092358859 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa41406af00 0x7fa41406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:16.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.186+0000 7fa430ff9700 1 -- 172.21.15.149:0/1092358859 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa42c08a120 con 0x7fa4340c9fc0 2023-11-08T19:23:16.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.186+0000 7fa4337fe700 1 --2- 172.21.15.149:0/1092358859 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa41406af00 0x7fa41406d3c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa42400bfd0 tx=0x7fa42400b420 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:16.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.190+0000 7fa430ff9700 1 -- 172.21.15.149:0/1092358859 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa434152380 con 0x7fa4340c9fc0 2023-11-08T19:23:16.380 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.379+0000 7fa43a1d0700 1 -- 172.21.15.149:0/1092358859 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa43404f730 con 0x7fa4340c9fc0 2023-11-08T19:23:16.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.380+0000 7fa430ff9700 1 -- 172.21.15.149:0/1092358859 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa42c054ee0 con 0x7fa4340c9fc0 2023-11-08T19:23:16.381 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 1 2023-11-08T19:23:16.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.382+0000 7fa43a1d0700 1 -- 172.21.15.149:0/1092358859 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa41406af00 msgr2=0x7fa41406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:16.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.382+0000 7fa43a1d0700 1 --2- 172.21.15.149:0/1092358859 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa41406af00 0x7fa41406d3c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa42400bfd0 tx=0x7fa42400b420 comp rx=0 tx=0).stop 2023-11-08T19:23:16.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.382+0000 7fa43a1d0700 1 -- 172.21.15.149:0/1092358859 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4340c9fc0 msgr2=0x7fa4340c7a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:16.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.382+0000 7fa43a1d0700 1 --2- 172.21.15.149:0/1092358859 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4340c9fc0 0x7fa4340c7a70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa42c000f80 tx=0x7fa42c00a640 comp rx=0 tx=0).stop 2023-11-08T19:23:16.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.382+0000 7fa43a1d0700 1 -- 172.21.15.149:0/1092358859 shutdown_connections 2023-11-08T19:23:16.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.382+0000 7fa43a1d0700 1 --2- 172.21.15.149:0/1092358859 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa41406af00 0x7fa41406d3c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:16.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.382+0000 7fa43a1d0700 1 --2- 172.21.15.149:0/1092358859 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4340c9fc0 0x7fa4340c7a70 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:16.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.382+0000 7fa43a1d0700 1 --2- 172.21.15.149:0/1092358859 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa420004850 0x7fa434150fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:16.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.382+0000 7fa43a1d0700 1 --2- 172.21.15.149:0/1092358859 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa434152660 0x7fa4340c9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:16.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.382+0000 7fa43a1d0700 1 -- 172.21.15.149:0/1092358859 >> 172.21.15.149:0/1092358859 conn(0x7fa4340d0640 msgr2=0x7fa434159db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:16.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.382+0000 7fa43a1d0700 1 -- 172.21.15.149:0/1092358859 shutdown_connections 2023-11-08T19:23:16.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.382+0000 7fa43a1d0700 1 -- 172.21.15.149:0/1092358859 wait complete. 2023-11-08T19:23:16.395 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-08T19:23:16.518 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.517+0000 7fb1b5940700 1 Processor -- start 2023-11-08T19:23:16.518 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.517+0000 7fb1b5940700 1 -- start start 2023-11-08T19:23:16.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.518+0000 7fb1b5940700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb1b00668e0 0x7fb1b006bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:16.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.518+0000 7fb1b5940700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb1b006c1d0 0x7fb1b006dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:16.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.518+0000 7fb1b5940700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1b006c620 con 0x7fb1b015aaf0 2023-11-08T19:23:16.522 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.518+0000 7fb1b5940700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1b006d8b0 con 0x7fb1b006c1d0 2023-11-08T19:23:16.522 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.518+0000 7fb1b5940700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b00cee60 con 0x7fb1b00668e0 2023-11-08T19:23:16.522 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.518+0000 7fb1af7fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb1b006c1d0 0x7fb1b006dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:16.522 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.518+0000 7fb1af7fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb1b006c1d0 0x7fb1b006dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37056/0 (socket says 172.21.15.149:37056) 2023-11-08T19:23:16.523 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.518+0000 7fb1af7fe700 1 -- 172.21.15.149:0/356035860 learned_addr learned my addr 172.21.15.149:0/356035860 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:16.523 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.518+0000 7fb1ae7fc700 1 --2- 172.21.15.149:0/356035860 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb1b00668e0 0x7fb1b006bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:16.523 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.518+0000 7fb1af7fe700 1 -- 172.21.15.149:0/356035860 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb1b00668e0 msgr2=0x7fb1b006bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:16.523 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.518+0000 7fb1af7fe700 1 --2- 172.21.15.149:0/356035860 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb1b00668e0 0x7fb1b006bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:16.523 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.518+0000 7fb1af7fe700 1 -- 172.21.15.149:0/356035860 >> v1:172.21.15.160:6789/0 conn(0x7fb1b015aaf0 legacy=0x7fb1b00ce6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:16.524 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.518+0000 7fb1af7fe700 1 -- 172.21.15.149:0/356035860 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b00cf140 con 0x7fb1b006c1d0 2023-11-08T19:23:16.524 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.518+0000 7fb1af7fe700 1 --2- 172.21.15.149:0/356035860 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1b006c1d0 0x7fb1b006dd40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb1a8009e50 tx=0x7fb1a800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7e5d8b28657690b server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:16.524 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.518+0000 7fb1adffb700 1 -- 172.21.15.149:0/356035860 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a800e070 con 0x7fb1b006c1d0 2023-11-08T19:23:16.524 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.518+0000 7fb1adffb700 1 -- 172.21.15.149:0/356035860 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1a800b9c0 con 0x7fb1b006c1d0 2023-11-08T19:23:16.525 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.518+0000 7fb1adffb700 1 -- 172.21.15.149:0/356035860 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a800bd70 con 0x7fb1b006c1d0 2023-11-08T19:23:16.525 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.519+0000 7fb1b5940700 1 -- 172.21.15.149:0/356035860 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1b006c1d0 msgr2=0x7fb1b006dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:16.525 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.519+0000 7fb1b5940700 1 --2- 172.21.15.149:0/356035860 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1b006c1d0 0x7fb1b006dd40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb1a8009e50 tx=0x7fb1a800b330 comp rx=0 tx=0).stop 2023-11-08T19:23:16.525 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.519+0000 7fb1b5940700 1 -- 172.21.15.149:0/356035860 shutdown_connections 2023-11-08T19:23:16.526 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.519+0000 7fb1b5940700 1 --2- 172.21.15.149:0/356035860 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1b006c1d0 0x7fb1b006dd40 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:16.526 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.519+0000 7fb1b5940700 1 --2- 172.21.15.149:0/356035860 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb1b00668e0 0x7fb1b006bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:16.526 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.519+0000 7fb1b5940700 1 -- 172.21.15.149:0/356035860 >> 172.21.15.149:0/356035860 conn(0x7fb1b00cc860 msgr2=0x7fb1b00ccc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:16.526 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.519+0000 7fb1b5940700 1 -- 172.21.15.149:0/356035860 shutdown_connections 2023-11-08T19:23:16.527 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.519+0000 7fb1b5940700 1 -- 172.21.15.149:0/356035860 wait complete. 2023-11-08T19:23:16.527 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.520+0000 7fb1b5940700 1 Processor -- start 2023-11-08T19:23:16.530 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.520+0000 7fb1b5940700 1 -- start start 2023-11-08T19:23:16.530 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.521+0000 7fb1b5940700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb1b00668e0 0x7fb1b015d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:16.530 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.521+0000 7fb1b5940700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1b006c1d0 0x7fb1b01f47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:16.531 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.521+0000 7fb1b5940700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb1b015aaf0 0x7fb1b01f4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:16.531 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.521+0000 7fb1b5940700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b00c87f0 con 0x7fb1b006c1d0 2023-11-08T19:23:16.531 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.521+0000 7fb1b5940700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b01f24c0 con 0x7fb1b00668e0 2023-11-08T19:23:16.531 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.521+0000 7fb1b5940700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b01f27a0 con 0x7fb1b015aaf0 2023-11-08T19:23:16.532 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.521+0000 7fb1ae7fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1b006c1d0 0x7fb1b01f47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:16.532 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.521+0000 7fb1ae7fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1b006c1d0 0x7fb1b01f47c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37060/0 (socket says 172.21.15.149:37060) 2023-11-08T19:23:16.532 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.521+0000 7fb1ae7fc700 1 -- 172.21.15.149:0/2570699205 learned_addr learned my addr 172.21.15.149:0/2570699205 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:16.532 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.521+0000 7fb1aeffd700 1 --2- 172.21.15.149:0/2570699205 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb1b00668e0 0x7fb1b015d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:16.532 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.521+0000 7fb1af7fe700 1 --2- 172.21.15.149:0/2570699205 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb1b015aaf0 0x7fb1b01f4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:16.533 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.521+0000 7fb1ae7fc700 1 -- 172.21.15.149:0/2570699205 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb1b015aaf0 msgr2=0x7fb1b01f4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:16.533 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.521+0000 7fb1ae7fc700 1 --2- 172.21.15.149:0/2570699205 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb1b015aaf0 0x7fb1b01f4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:16.533 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.521+0000 7fb1ae7fc700 1 -- 172.21.15.149:0/2570699205 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb1b00668e0 msgr2=0x7fb1b015d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:16.533 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.521+0000 7fb1ae7fc700 1 --2- 172.21.15.149:0/2570699205 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb1b00668e0 0x7fb1b015d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:16.534 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.521+0000 7fb1ae7fc700 1 -- 172.21.15.149:0/2570699205 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a8009b30 con 0x7fb1b006c1d0 2023-11-08T19:23:16.534 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.522+0000 7fb1ae7fc700 1 --2- 172.21.15.149:0/2570699205 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1b006c1d0 0x7fb1b01f47c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb1a400e810 tx=0x7fb1a400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:16.534 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.522+0000 7fb197fff700 1 -- 172.21.15.149:0/2570699205 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a400c070 con 0x7fb1b006c1d0 2023-11-08T19:23:16.534 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.522+0000 7fb197fff700 1 -- 172.21.15.149:0/2570699205 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1a4013610 con 0x7fb1b006c1d0 2023-11-08T19:23:16.535 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.522+0000 7fb1b5940700 1 -- 172.21.15.149:0/2570699205 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1b01f2a80 con 0x7fb1b006c1d0 2023-11-08T19:23:16.535 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.522+0000 7fb197fff700 1 -- 172.21.15.149:0/2570699205 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a40139c0 con 0x7fb1b006c1d0 2023-11-08T19:23:16.535 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.522+0000 7fb1b5940700 1 -- 172.21.15.149:0/2570699205 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1b00c7a50 con 0x7fb1b006c1d0 2023-11-08T19:23:16.535 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.523+0000 7fb1b5940700 1 -- 172.21.15.149:0/2570699205 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1b004f730 con 0x7fb1b006c1d0 2023-11-08T19:23:16.536 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.523+0000 7fb197fff700 1 -- 172.21.15.149:0/2570699205 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb1a4013b20 con 0x7fb1b006c1d0 2023-11-08T19:23:16.536 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.523+0000 7fb197fff700 1 --2- 172.21.15.149:0/2570699205 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb19c06af00 0x7fb19c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:16.536 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.524+0000 7fb197fff700 1 -- 172.21.15.149:0/2570699205 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb1a4089620 con 0x7fb1b006c1d0 2023-11-08T19:23:16.536 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.524+0000 7fb1aeffd700 1 --2- 172.21.15.149:0/2570699205 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb19c06af00 0x7fb19c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:16.536 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.524+0000 7fb1aeffd700 1 --2- 172.21.15.149:0/2570699205 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb19c06af00 0x7fb19c06d3c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb1b00c89c0 tx=0x7fb1a0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:16.537 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.528+0000 7fb197fff700 1 -- 172.21.15.149:0/2570699205 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb1a40543f0 con 0x7fb1b006c1d0 2023-11-08T19:23:16.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.716+0000 7fb1b5940700 1 -- 172.21.15.149:0/2570699205 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb1b00b1540 con 0x7fb1b006c1d0 2023-11-08T19:23:16.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.716+0000 7fb197fff700 1 -- 172.21.15.149:0/2570699205 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb1a4057a10 con 0x7fb1b006c1d0 2023-11-08T19:23:16.718 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:23:16.720 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.718+0000 7fb1b5940700 1 -- 172.21.15.149:0/2570699205 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb19c06af00 msgr2=0x7fb19c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:16.720 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.718+0000 7fb1b5940700 1 --2- 172.21.15.149:0/2570699205 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb19c06af00 0x7fb19c06d3c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb1b00c89c0 tx=0x7fb1a0009040 comp rx=0 tx=0).stop 2023-11-08T19:23:16.720 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.718+0000 7fb1b5940700 1 -- 172.21.15.149:0/2570699205 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1b006c1d0 msgr2=0x7fb1b01f47c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:16.720 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.718+0000 7fb1b5940700 1 --2- 172.21.15.149:0/2570699205 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1b006c1d0 0x7fb1b01f47c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb1a400e810 tx=0x7fb1a400eb20 comp rx=0 tx=0).stop 2023-11-08T19:23:16.721 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.718+0000 7fb1b5940700 1 -- 172.21.15.149:0/2570699205 shutdown_connections 2023-11-08T19:23:16.721 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.718+0000 7fb1b5940700 1 --2- 172.21.15.149:0/2570699205 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb19c06af00 0x7fb19c06d3c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:16.721 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.718+0000 7fb1b5940700 1 --2- 172.21.15.149:0/2570699205 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb1b00668e0 0x7fb1b015d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:16.721 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.718+0000 7fb1b5940700 1 --2- 172.21.15.149:0/2570699205 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb1b015aaf0 0x7fb1b01f4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:16.722 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.718+0000 7fb1b5940700 1 --2- 172.21.15.149:0/2570699205 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1b006c1d0 0x7fb1b01f47c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:16.722 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.718+0000 7fb1b5940700 1 -- 172.21.15.149:0/2570699205 >> 172.21.15.149:0/2570699205 conn(0x7fb1b00cc860 msgr2=0x7fb1b006ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:16.722 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.719+0000 7fb1b5940700 1 -- 172.21.15.149:0/2570699205 shutdown_connections 2023-11-08T19:23:16.722 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.719+0000 7fb1b5940700 1 -- 172.21.15.149:0/2570699205 wait complete. 2023-11-08T19:23:16.732 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-08T19:23:16.855 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.854+0000 7fdf12698700 1 Processor -- start 2023-11-08T19:23:16.856 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.854+0000 7fdf12698700 1 -- start start 2023-11-08T19:23:16.858 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.855+0000 7fdf12698700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fdf0c0cc0d0 0x7fdf0c15f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:16.859 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.855+0000 7fdf12698700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fdf0c0cc4b0 0x7fdf0c15c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:16.859 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.855+0000 7fdf12698700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdf0c15cb60 0x7fdf0c0cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:16.859 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.855+0000 7fdf12698700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf0c15f9b0 con 0x7fdf0c0cc4b0 2023-11-08T19:23:16.859 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.855+0000 7fdf12698700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf0c15be80 con 0x7fdf0c0cc0d0 2023-11-08T19:23:16.860 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.855+0000 7fdf12698700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0c15fba0 con 0x7fdf0c15cb60 2023-11-08T19:23:16.860 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.855+0000 7fdf0b7fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fdf0c0cc4b0 0x7fdf0c15c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:16.860 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.855+0000 7fdf0b7fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fdf0c0cc4b0 0x7fdf0c15c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37068/0 (socket says 172.21.15.149:37068) 2023-11-08T19:23:16.860 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.855+0000 7fdf0b7fe700 1 -- 172.21.15.149:0/1093982821 learned_addr learned my addr 172.21.15.149:0/1093982821 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:16.860 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.855+0000 7fdf0bfff700 1 --2- 172.21.15.149:0/1093982821 >> v2:172.21.15.160:3300/0 conn(0x7fdf0c0cc0d0 0x7fdf0c15f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:16.861 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.855+0000 7fdf10c35700 1 --2- 172.21.15.149:0/1093982821 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdf0c15cb60 0x7fdf0c0cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:16.861 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.855+0000 7fdf0b7fe700 1 -- 172.21.15.149:0/1093982821 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdf0c15cb60 msgr2=0x7fdf0c0cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:16.861 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.855+0000 7fdf0b7fe700 1 --2- 172.21.15.149:0/1093982821 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdf0c15cb60 0x7fdf0c0cf320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:16.861 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.855+0000 7fdf0b7fe700 1 -- 172.21.15.149:0/1093982821 >> v2:172.21.15.160:3300/0 conn(0x7fdf0c0cc0d0 msgr2=0x7fdf0c15f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:16.861 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.855+0000 7fdf0b7fe700 1 --2- 172.21.15.149:0/1093982821 >> v2:172.21.15.160:3300/0 conn(0x7fdf0c0cc0d0 0x7fdf0c15f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:16.861 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.855+0000 7fdf0b7fe700 1 -- 172.21.15.149:0/1093982821 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf0c15fe80 con 0x7fdf0c0cc4b0 2023-11-08T19:23:16.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.855+0000 7fdf0bfff700 1 --2- 172.21.15.149:0/1093982821 >> v2:172.21.15.160:3300/0 conn(0x7fdf0c0cc0d0 0x7fdf0c15f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:23:16.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.856+0000 7fdf0b7fe700 1 --2- 172.21.15.149:0/1093982821 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf0c0cc4b0 0x7fdf0c15c620 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c073370 tx=0x7fdf00009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6edbeb869519a256 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:16.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.856+0000 7fdf0affd700 1 -- 172.21.15.149:0/1093982821 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0000b870 con 0x7fdf0c0cc4b0 2023-11-08T19:23:16.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.856+0000 7fdf0affd700 1 -- 172.21.15.149:0/1093982821 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf0000b9d0 con 0x7fdf0c0cc4b0 2023-11-08T19:23:16.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.856+0000 7fdf0affd700 1 -- 172.21.15.149:0/1093982821 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0000bd60 con 0x7fdf0c0cc4b0 2023-11-08T19:23:16.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.856+0000 7fdf12698700 1 -- 172.21.15.149:0/1093982821 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf0c0cc4b0 msgr2=0x7fdf0c15c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:16.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.856+0000 7fdf12698700 1 --2- 172.21.15.149:0/1093982821 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf0c0cc4b0 0x7fdf0c15c620 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c073370 tx=0x7fdf00009bd0 comp rx=0 tx=0).stop 2023-11-08T19:23:16.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.856+0000 7fdf12698700 1 -- 172.21.15.149:0/1093982821 shutdown_connections 2023-11-08T19:23:16.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.856+0000 7fdf12698700 1 --2- 172.21.15.149:0/1093982821 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdf0c15cb60 0x7fdf0c0cf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:16.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.856+0000 7fdf12698700 1 --2- 172.21.15.149:0/1093982821 >> v2:172.21.15.160:3300/0 conn(0x7fdf0c0cc0d0 0x7fdf0c15f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:16.864 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.856+0000 7fdf12698700 1 --2- 172.21.15.149:0/1093982821 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf0c0cc4b0 0x7fdf0c15c620 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:16.864 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.856+0000 7fdf12698700 1 -- 172.21.15.149:0/1093982821 >> 172.21.15.149:0/1093982821 conn(0x7fdf0c06f120 msgr2=0x7fdf0c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:16.864 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.856+0000 7fdf12698700 1 -- 172.21.15.149:0/1093982821 shutdown_connections 2023-11-08T19:23:16.864 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.856+0000 7fdf12698700 1 -- 172.21.15.149:0/1093982821 wait complete. 2023-11-08T19:23:16.864 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.858+0000 7fdf12698700 1 Processor -- start 2023-11-08T19:23:16.865 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.858+0000 7fdf12698700 1 -- start start 2023-11-08T19:23:16.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.858+0000 7fdf12698700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf0c0cc0d0 0x7fdf0c0cfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:16.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.858+0000 7fdf12698700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdf0c0cc4b0 0x7fdf0c0d02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:16.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.859+0000 7fdf12698700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf0c15cb60 0x7fdf0c0afb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:16.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.859+0000 7fdf12698700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0c0c7ae0 con 0x7fdf0c15cb60 2023-11-08T19:23:16.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.859+0000 7fdf12698700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0c1f3230 con 0x7fdf0c0cc0d0 2023-11-08T19:23:16.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.859+0000 7fdf12698700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0c1f34e0 con 0x7fdf0c0cc4b0 2023-11-08T19:23:16.869 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.859+0000 7fdf10c35700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf0c15cb60 0x7fdf0c0afb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:16.869 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.859+0000 7fdf10c35700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf0c15cb60 0x7fdf0c0afb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37076/0 (socket says 172.21.15.149:37076) 2023-11-08T19:23:16.869 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.859+0000 7fdf10c35700 1 -- 172.21.15.149:0/342544588 learned_addr learned my addr 172.21.15.149:0/342544588 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:16.869 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.859+0000 7fdf0b7fe700 1 --2- 172.21.15.149:0/342544588 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdf0c0cc4b0 0x7fdf0c0d02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:16.869 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.859+0000 7fdf0bfff700 1 --2- 172.21.15.149:0/342544588 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf0c0cc0d0 0x7fdf0c0cfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:16.870 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.859+0000 7fdf10c35700 1 -- 172.21.15.149:0/342544588 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdf0c0cc4b0 msgr2=0x7fdf0c0d02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:16.870 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.859+0000 7fdf10c35700 1 --2- 172.21.15.149:0/342544588 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdf0c0cc4b0 0x7fdf0c0d02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:16.870 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.859+0000 7fdf10c35700 1 -- 172.21.15.149:0/342544588 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf0c0cc0d0 msgr2=0x7fdf0c0cfdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:16.870 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.859+0000 7fdf10c35700 1 --2- 172.21.15.149:0/342544588 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf0c0cc0d0 0x7fdf0c0cfdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:16.870 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.859+0000 7fdf10c35700 1 -- 172.21.15.149:0/342544588 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf00009550 con 0x7fdf0c15cb60 2023-11-08T19:23:16.871 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.859+0000 7fdf0b7fe700 1 --2- 172.21.15.149:0/342544588 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdf0c0cc4b0 0x7fdf0c0d02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:23:16.871 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.859+0000 7fdf0bfff700 1 --2- 172.21.15.149:0/342544588 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf0c0cc0d0 0x7fdf0c0cfdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:23:16.871 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.859+0000 7fdf10c35700 1 --2- 172.21.15.149:0/342544588 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf0c15cb60 0x7fdf0c0afb00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fdf04009fd0 tx=0x7fdf0400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:16.871 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.859+0000 7fdf08ff9700 1 -- 172.21.15.149:0/342544588 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0400ede0 con 0x7fdf0c15cb60 2023-11-08T19:23:16.871 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.859+0000 7fdf08ff9700 1 -- 172.21.15.149:0/342544588 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf04014420 con 0x7fdf0c15cb60 2023-11-08T19:23:16.872 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.859+0000 7fdf12698700 1 -- 172.21.15.149:0/342544588 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf0c1f37c0 con 0x7fdf0c15cb60 2023-11-08T19:23:16.872 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.859+0000 7fdf08ff9700 1 -- 172.21.15.149:0/342544588 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf040147d0 con 0x7fdf0c15cb60 2023-11-08T19:23:16.872 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.859+0000 7fdf12698700 1 -- 172.21.15.149:0/342544588 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf0c1f3d80 con 0x7fdf0c15cb60 2023-11-08T19:23:16.872 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.860+0000 7fdf12698700 1 -- 172.21.15.149:0/342544588 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf0c04f730 con 0x7fdf0c15cb60 2023-11-08T19:23:16.872 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.861+0000 7fdf08ff9700 1 -- 172.21.15.149:0/342544588 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdf04014930 con 0x7fdf0c15cb60 2023-11-08T19:23:16.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.861+0000 7fdf08ff9700 1 --2- 172.21.15.149:0/342544588 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fdef806af00 0x7fdef806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:16.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.861+0000 7fdf08ff9700 1 -- 172.21.15.149:0/342544588 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdf04089f00 con 0x7fdf0c15cb60 2023-11-08T19:23:16.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.861+0000 7fdf0bfff700 1 --2- 172.21.15.149:0/342544588 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fdef806af00 0x7fdef806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:16.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.861+0000 7fdf0bfff700 1 --2- 172.21.15.149:0/342544588 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fdef806af00 0x7fdef806d3c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c1593c0 tx=0x7fdefc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:16.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:16.866+0000 7fdf08ff9700 1 -- 172.21.15.149:0/342544588 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdf04054d50 con 0x7fdf0c15cb60 2023-11-08T19:23:17.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.057+0000 7fdf12698700 1 -- 172.21.15.149:0/342544588 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdf0c06ff20 con 0x7fdf0c15cb60 2023-11-08T19:23:17.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.058+0000 7fdf08ff9700 1 -- 172.21.15.149:0/342544588 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdf04058370 con 0x7fdf0c15cb60 2023-11-08T19:23:17.060 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 64 2023-11-08T19:23:17.061 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.060+0000 7fdf12698700 1 -- 172.21.15.149:0/342544588 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fdef806af00 msgr2=0x7fdef806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:17.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.060+0000 7fdf12698700 1 --2- 172.21.15.149:0/342544588 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fdef806af00 0x7fdef806d3c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c1593c0 tx=0x7fdefc008040 comp rx=0 tx=0).stop 2023-11-08T19:23:17.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.060+0000 7fdf12698700 1 -- 172.21.15.149:0/342544588 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf0c15cb60 msgr2=0x7fdf0c0afb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:17.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.060+0000 7fdf12698700 1 --2- 172.21.15.149:0/342544588 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf0c15cb60 0x7fdf0c0afb00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fdf04009fd0 tx=0x7fdf0400e3c0 comp rx=0 tx=0).stop 2023-11-08T19:23:17.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.060+0000 7fdf12698700 1 -- 172.21.15.149:0/342544588 shutdown_connections 2023-11-08T19:23:17.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.060+0000 7fdf12698700 1 --2- 172.21.15.149:0/342544588 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fdef806af00 0x7fdef806d3c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:17.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.060+0000 7fdf12698700 1 --2- 172.21.15.149:0/342544588 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf0c0cc0d0 0x7fdf0c0cfdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:17.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.060+0000 7fdf12698700 1 --2- 172.21.15.149:0/342544588 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf0c15cb60 0x7fdf0c0afb00 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:17.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.060+0000 7fdf12698700 1 --2- 172.21.15.149:0/342544588 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdf0c0cc4b0 0x7fdf0c0d02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:17.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.060+0000 7fdf12698700 1 -- 172.21.15.149:0/342544588 >> 172.21.15.149:0/342544588 conn(0x7fdf0c06f120 msgr2=0x7fdf0c15eb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:17.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.060+0000 7fdf12698700 1 -- 172.21.15.149:0/342544588 shutdown_connections 2023-11-08T19:23:17.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.060+0000 7fdf12698700 1 -- 172.21.15.149:0/342544588 wait complete. 2023-11-08T19:23:17.073 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-08T19:23:17.197 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.196+0000 7f97ffd79700 1 Processor -- start 2023-11-08T19:23:17.198 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.196+0000 7f97ffd79700 1 -- start start 2023-11-08T19:23:17.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.197+0000 7f97ffd79700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97f80b38e0 0x7f97f80cfd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:17.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.197+0000 7f97ffd79700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f97f806d5e0 0x7f97f806c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:17.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.197+0000 7f97ffd79700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97f80cdd30 con 0x7f97f815db10 2023-11-08T19:23:17.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.197+0000 7f97ffd79700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97f80ced40 con 0x7f97f806d5e0 2023-11-08T19:23:17.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.197+0000 7f97ffd79700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97f80cbe50 con 0x7f97f80b38e0 2023-11-08T19:23:17.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.197+0000 7f97fe316700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f97f806d5e0 0x7f97f806c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:17.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.197+0000 7f97fdb15700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f97f815db10 0x7f97f80b31d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:39082/0 (socket says 172.21.15.149:39082) 2023-11-08T19:23:17.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.197+0000 7f97fdb15700 1 -- 172.21.15.149:0/2567682427 learned_addr learned my addr 172.21.15.149:0/2567682427 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:23:17.202 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.198+0000 7f97fd314700 1 --2- 172.21.15.149:0/2567682427 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97f80b38e0 0x7f97f80cfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:17.202 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.198+0000 7f97fe316700 1 -- 172.21.15.149:0/2567682427 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97f80b38e0 msgr2=0x7f97f80cfd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:17.202 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.198+0000 7f97fe316700 1 --2- 172.21.15.149:0/2567682427 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97f80b38e0 0x7f97f80cfd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:17.202 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.198+0000 7f97fe316700 1 -- 172.21.15.149:0/2567682427 >> v1:172.21.15.149:6789/0 conn(0x7f97f815db10 legacy=0x7f97f80b31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:17.202 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.198+0000 7f97fe316700 1 -- 172.21.15.149:0/2567682427 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f806da70 con 0x7f97f806d5e0 2023-11-08T19:23:17.203 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.198+0000 7f97fcb13700 1 -- 172.21.15.149:0/2567682427 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 592885866 0 0) 0x7f97f80cdd30 con 0x7f97f815db10 2023-11-08T19:23:17.203 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.198+0000 7f97fd314700 1 --2- 172.21.15.149:0/2567682427 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97f80b38e0 0x7f97f80cfd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:23:17.203 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.198+0000 7f97fe316700 1 --2- 172.21.15.149:0/2567682427 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97f806d5e0 0x7f97f806c160 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f97f4009840 tx=0x7f97f4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=432560f7896df984 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:17.203 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.198+0000 7f97fcb13700 1 -- 172.21.15.149:0/2567682427 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f4011830 con 0x7f97f806d5e0 2023-11-08T19:23:17.203 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.198+0000 7f97fcb13700 1 -- 172.21.15.149:0/2567682427 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97f4011990 con 0x7f97f806d5e0 2023-11-08T19:23:17.204 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.198+0000 7f97fcb13700 1 -- 172.21.15.149:0/2567682427 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f4011d20 con 0x7f97f806d5e0 2023-11-08T19:23:17.204 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.198+0000 7f97ffd79700 1 -- 172.21.15.149:0/2567682427 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97f806d5e0 msgr2=0x7f97f806c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:17.204 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.198+0000 7f97ffd79700 1 --2- 172.21.15.149:0/2567682427 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97f806d5e0 0x7f97f806c160 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f97f4009840 tx=0x7f97f4009b50 comp rx=0 tx=0).stop 2023-11-08T19:23:17.204 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.198+0000 7f97ffd79700 1 -- 172.21.15.149:0/2567682427 shutdown_connections 2023-11-08T19:23:17.205 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.198+0000 7f97ffd79700 1 --2- 172.21.15.149:0/2567682427 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97f806d5e0 0x7f97f806c160 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:17.205 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.198+0000 7f97ffd79700 1 --2- 172.21.15.149:0/2567682427 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97f80b38e0 0x7f97f80cfd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:17.205 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.198+0000 7f97ffd79700 1 -- 172.21.15.149:0/2567682427 >> 172.21.15.149:0/2567682427 conn(0x7f97f806f120 msgr2=0x7f97f806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:17.205 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.199+0000 7f97ffd79700 1 -- 172.21.15.149:0/2567682427 shutdown_connections 2023-11-08T19:23:17.205 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.199+0000 7f97ffd79700 1 -- 172.21.15.149:0/2567682427 wait complete. 2023-11-08T19:23:17.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.200+0000 7f97ffd79700 1 Processor -- start 2023-11-08T19:23:17.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.200+0000 7f97ffd79700 1 -- start start 2023-11-08T19:23:17.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.200+0000 7f97ffd79700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97f806d5e0 0x7f97f80ad3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:17.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.200+0000 7f97ffd79700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97f80b38e0 0x7f97f80c9d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:17.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.200+0000 7f97ffd79700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97f815db10 0x7f97f815bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:17.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.200+0000 7f97ffd79700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f80cb120 con 0x7f97f815db10 2023-11-08T19:23:17.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.200+0000 7f97ffd79700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f80ad910 con 0x7f97f80b38e0 2023-11-08T19:23:17.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.200+0000 7f97ffd79700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97f80ca270 con 0x7f97f806d5e0 2023-11-08T19:23:17.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.201+0000 7f97fe316700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97f815db10 0x7f97f815bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:17.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.201+0000 7f97fe316700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97f815db10 0x7f97f815bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37090/0 (socket says 172.21.15.149:37090) 2023-11-08T19:23:17.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.201+0000 7f97fe316700 1 -- 172.21.15.149:0/4229222892 learned_addr learned my addr 172.21.15.149:0/4229222892 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:17.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.201+0000 7f97fdb15700 1 --2- 172.21.15.149:0/4229222892 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97f806d5e0 0x7f97f80ad3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:17.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.201+0000 7f97fe316700 1 -- 172.21.15.149:0/4229222892 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97f806d5e0 msgr2=0x7f97f80ad3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:17.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.201+0000 7f97fe316700 1 --2- 172.21.15.149:0/4229222892 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97f806d5e0 0x7f97f80ad3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:17.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.201+0000 7f97fd314700 1 --2- 172.21.15.149:0/4229222892 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97f80b38e0 0x7f97f80c9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:17.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.201+0000 7f97fe316700 1 -- 172.21.15.149:0/4229222892 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97f80b38e0 msgr2=0x7f97f80c9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:17.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.201+0000 7f97fe316700 1 --2- 172.21.15.149:0/4229222892 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97f80b38e0 0x7f97f80c9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:17.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.201+0000 7f97fe316700 1 -- 172.21.15.149:0/4229222892 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f40094a0 con 0x7f97f815db10 2023-11-08T19:23:17.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.201+0000 7f97fdb15700 1 --2- 172.21.15.149:0/4229222892 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97f806d5e0 0x7f97f80ad3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:23:17.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.201+0000 7f97fd314700 1 --2- 172.21.15.149:0/4229222892 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97f80b38e0 0x7f97f80c9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:23:17.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.201+0000 7f97fe316700 1 --2- 172.21.15.149:0/4229222892 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97f815db10 0x7f97f815bab0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f97f4014040 tx=0x7f97f4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:17.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.201+0000 7f97ee7fc700 1 -- 172.21.15.149:0/4229222892 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f40045f0 con 0x7f97f815db10 2023-11-08T19:23:17.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.201+0000 7f97ee7fc700 1 -- 172.21.15.149:0/4229222892 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97f401e070 con 0x7f97f815db10 2023-11-08T19:23:17.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.201+0000 7f97ffd79700 1 -- 172.21.15.149:0/4229222892 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97f80ca4a0 con 0x7f97f815db10 2023-11-08T19:23:17.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.201+0000 7f97ee7fc700 1 -- 172.21.15.149:0/4229222892 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f4003ae0 con 0x7f97f815db10 2023-11-08T19:23:17.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.201+0000 7f97ffd79700 1 -- 172.21.15.149:0/4229222892 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97f80caa60 con 0x7f97f815db10 2023-11-08T19:23:17.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.202+0000 7f97ffd79700 1 -- 172.21.15.149:0/4229222892 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97f80cb260 con 0x7f97f815db10 2023-11-08T19:23:17.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.203+0000 7f97ee7fc700 1 -- 172.21.15.149:0/4229222892 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f97f4003c40 con 0x7f97f815db10 2023-11-08T19:23:17.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.203+0000 7f97ee7fc700 1 --2- 172.21.15.149:0/4229222892 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f97dc06af00 0x7f97dc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:17.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.203+0000 7f97ee7fc700 1 -- 172.21.15.149:0/4229222892 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f97f408aa40 con 0x7f97f815db10 2023-11-08T19:23:17.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.203+0000 7f97fdb15700 1 --2- 172.21.15.149:0/4229222892 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f97dc06af00 0x7f97dc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:17.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.203+0000 7f97fdb15700 1 --2- 172.21.15.149:0/4229222892 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f97dc06af00 0x7f97dc06d3c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f97f00012e0 tx=0x7f97f0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:17.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.208+0000 7f97ee7fc700 1 -- 172.21.15.149:0/4229222892 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f97f80cb260 con 0x7f97f815db10 2023-11-08T19:23:17.399 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.398+0000 7f97ffd79700 1 -- 172.21.15.149:0/4229222892 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f97f80cb260 con 0x7f97f815db10 2023-11-08T19:23:17.399 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.398+0000 7f97ee7fc700 1 -- 172.21.15.149:0/4229222892 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f97f80cb260 con 0x7f97f815db10 2023-11-08T19:23:17.400 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:23:17.401 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.400+0000 7f97ffd79700 1 -- 172.21.15.149:0/4229222892 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f97dc06af00 msgr2=0x7f97dc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:17.402 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.400+0000 7f97ffd79700 1 --2- 172.21.15.149:0/4229222892 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f97dc06af00 0x7f97dc06d3c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f97f00012e0 tx=0x7f97f0009040 comp rx=0 tx=0).stop 2023-11-08T19:23:17.402 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.400+0000 7f97ffd79700 1 -- 172.21.15.149:0/4229222892 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97f815db10 msgr2=0x7f97f815bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:17.402 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.400+0000 7f97ffd79700 1 --2- 172.21.15.149:0/4229222892 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97f815db10 0x7f97f815bab0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f97f4014040 tx=0x7f97f4004750 comp rx=0 tx=0).stop 2023-11-08T19:23:17.403 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.400+0000 7f97ffd79700 1 -- 172.21.15.149:0/4229222892 shutdown_connections 2023-11-08T19:23:17.403 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.400+0000 7f97ffd79700 1 --2- 172.21.15.149:0/4229222892 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f97dc06af00 0x7f97dc06d3c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:17.403 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.400+0000 7f97ffd79700 1 --2- 172.21.15.149:0/4229222892 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97f815db10 0x7f97f815bab0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:17.403 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.400+0000 7f97ffd79700 1 --2- 172.21.15.149:0/4229222892 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97f806d5e0 0x7f97f80ad3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:17.403 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.400+0000 7f97ffd79700 1 --2- 172.21.15.149:0/4229222892 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97f80b38e0 0x7f97f80c9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:17.404 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.400+0000 7f97ffd79700 1 -- 172.21.15.149:0/4229222892 >> 172.21.15.149:0/4229222892 conn(0x7f97f806f120 msgr2=0x7f97f806c160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:17.404 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.400+0000 7f97ffd79700 1 -- 172.21.15.149:0/4229222892 shutdown_connections 2023-11-08T19:23:17.404 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.400+0000 7f97ffd79700 1 -- 172.21.15.149:0/4229222892 wait complete. 2023-11-08T19:23:17.413 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-08T19:23:17.534 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.533+0000 7ff3b5872700 1 Processor -- start 2023-11-08T19:23:17.535 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.533+0000 7ff3b5872700 1 -- start start 2023-11-08T19:23:17.537 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.534+0000 7ff3b5872700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff3b00afb30 0x7ff3b00ce380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:17.537 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.534+0000 7ff3b5872700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7ff3b00b20b0 0x7ff3b00b2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:17.537 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.534+0000 7ff3b5872700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3b00d1330 con 0x7ff3b00b16b0 2023-11-08T19:23:17.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.534+0000 7ff3b5872700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3b00b2a80 con 0x7ff3b00b20b0 2023-11-08T19:23:17.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.534+0000 7ff3b5872700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b00cb490 con 0x7ff3b00afb30 2023-11-08T19:23:17.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.534+0000 7ff3ae7fc700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7ff3b00b16b0 0x7ff3b00cbf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:39096/0 (socket says 172.21.15.149:39096) 2023-11-08T19:23:17.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.534+0000 7ff3ae7fc700 1 -- 172.21.15.149:0/2611556911 learned_addr learned my addr 172.21.15.149:0/2611556911 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:23:17.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.534+0000 7ff3aeffd700 1 --2- 172.21.15.149:0/2611556911 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff3b00afb30 0x7ff3b00ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:17.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.534+0000 7ff3af7fe700 1 --2- 172.21.15.149:0/2611556911 >> v2:172.21.15.160:3300/0 conn(0x7ff3b00b20b0 0x7ff3b00b2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:17.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.534+0000 7ff3adffb700 1 -- 172.21.15.149:0/2611556911 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 234057659 0 0) 0x7ff3b00d1330 con 0x7ff3b00b16b0 2023-11-08T19:23:17.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.534+0000 7ff3adffb700 1 -- 172.21.15.149:0/2611556911 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3980035b0 con 0x7ff3b00b16b0 2023-11-08T19:23:17.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.534+0000 7ff3aeffd700 1 -- 172.21.15.149:0/2611556911 >> v2:172.21.15.160:3300/0 conn(0x7ff3b00b20b0 msgr2=0x7ff3b00b2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:17.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.534+0000 7ff3aeffd700 1 --2- 172.21.15.149:0/2611556911 >> v2:172.21.15.160:3300/0 conn(0x7ff3b00b20b0 0x7ff3b00b2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:17.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.534+0000 7ff3aeffd700 1 -- 172.21.15.149:0/2611556911 >> v1:172.21.15.149:6789/0 conn(0x7ff3b00b16b0 legacy=0x7ff3b00cbf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:17.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.534+0000 7ff3adffb700 1 -- 172.21.15.149:0/2611556911 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 677916887 0 0) 0x7ff3980035b0 con 0x7ff3b00b16b0 2023-11-08T19:23:17.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.535+0000 7ff3aeffd700 1 -- 172.21.15.149:0/2611556911 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b00cb770 con 0x7ff3b00afb30 2023-11-08T19:23:17.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.535+0000 7ff3af7fe700 1 --2- 172.21.15.149:0/2611556911 >> v2:172.21.15.160:3300/0 conn(0x7ff3b00b20b0 0x7ff3b00b2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:23:17.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.535+0000 7ff3aeffd700 1 --2- 172.21.15.149:0/2611556911 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff3b00afb30 0x7ff3b00ce380 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff3a4009820 tx=0x7ff3a4009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=593e2b931c467547 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:17.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.535+0000 7ff3adffb700 1 -- 172.21.15.149:0/2611556911 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a0001670 con 0x7ff3b00afb30 2023-11-08T19:23:17.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.535+0000 7ff3adffb700 1 -- 172.21.15.149:0/2611556911 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3a4005c30 con 0x7ff3b00afb30 2023-11-08T19:23:17.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.535+0000 7ff3adffb700 1 -- 172.21.15.149:0/2611556911 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a4004030 con 0x7ff3b00afb30 2023-11-08T19:23:17.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.535+0000 7ff3b5872700 1 -- 172.21.15.149:0/2611556911 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff3b00afb30 msgr2=0x7ff3b00ce380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:17.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.535+0000 7ff3b5872700 1 --2- 172.21.15.149:0/2611556911 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff3b00afb30 0x7ff3b00ce380 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff3a4009820 tx=0x7ff3a4009b30 comp rx=0 tx=0).stop 2023-11-08T19:23:17.542 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.536+0000 7ff3b5872700 1 -- 172.21.15.149:0/2611556911 shutdown_connections 2023-11-08T19:23:17.542 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.536+0000 7ff3b5872700 1 --2- 172.21.15.149:0/2611556911 >> v2:172.21.15.160:3300/0 conn(0x7ff3b00b20b0 0x7ff3b00b2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:17.542 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.536+0000 7ff3b5872700 1 --2- 172.21.15.149:0/2611556911 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff3b00afb30 0x7ff3b00ce380 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:17.542 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.536+0000 7ff3b5872700 1 -- 172.21.15.149:0/2611556911 >> 172.21.15.149:0/2611556911 conn(0x7ff3b0099a40 msgr2=0x7ff3b00d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:17.542 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.536+0000 7ff3b5872700 1 -- 172.21.15.149:0/2611556911 shutdown_connections 2023-11-08T19:23:17.543 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.536+0000 7ff3b5872700 1 -- 172.21.15.149:0/2611556911 wait complete. 2023-11-08T19:23:17.545 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.537+0000 7ff3b5872700 1 Processor -- start 2023-11-08T19:23:17.545 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.537+0000 7ff3b5872700 1 -- start start 2023-11-08T19:23:17.545 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.538+0000 7ff3b5872700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3b00afb30 0x7ff3b00c8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:17.545 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.538+0000 7ff3b5872700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff3b00b16b0 0x7ff3b00b59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:17.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.538+0000 7ff3b5872700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff3b00b20b0 0x7ff3b00cd510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:17.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.538+0000 7ff3b5872700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b01f35e0 con 0x7ff3b00afb30 2023-11-08T19:23:17.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.538+0000 7ff3b5872700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b01f29d0 con 0x7ff3b00b20b0 2023-11-08T19:23:17.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.538+0000 7ff3b5872700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b01f2cb0 con 0x7ff3b00b16b0 2023-11-08T19:23:17.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.538+0000 7ff3aeffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3b00afb30 0x7ff3b00c8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:17.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.538+0000 7ff3aeffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3b00afb30 0x7ff3b00c8080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37100/0 (socket says 172.21.15.149:37100) 2023-11-08T19:23:17.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.538+0000 7ff3aeffd700 1 -- 172.21.15.149:0/2313131003 learned_addr learned my addr 172.21.15.149:0/2313131003 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:17.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.538+0000 7ff3ae7fc700 1 --2- 172.21.15.149:0/2313131003 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff3b00b16b0 0x7ff3b00b59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:17.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.538+0000 7ff3af7fe700 1 --2- 172.21.15.149:0/2313131003 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff3b00b20b0 0x7ff3b00cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:17.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.538+0000 7ff3aeffd700 1 -- 172.21.15.149:0/2313131003 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff3b00b16b0 msgr2=0x7ff3b00b59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:17.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.538+0000 7ff3aeffd700 1 --2- 172.21.15.149:0/2313131003 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff3b00b16b0 0x7ff3b00b59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:17.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.538+0000 7ff3aeffd700 1 -- 172.21.15.149:0/2313131003 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff3b00b20b0 msgr2=0x7ff3b00cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:17.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.538+0000 7ff3aeffd700 1 --2- 172.21.15.149:0/2313131003 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff3b00b20b0 0x7ff3b00cd510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:17.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.538+0000 7ff3aeffd700 1 -- 172.21.15.149:0/2313131003 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a80099e0 con 0x7ff3b00afb30 2023-11-08T19:23:17.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.538+0000 7ff3aeffd700 1 --2- 172.21.15.149:0/2313131003 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3b00afb30 0x7ff3b00c8080 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff3a4009b70 tx=0x7ff3a4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:17.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.539+0000 7ff397fff700 1 -- 172.21.15.149:0/2313131003 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a4003bb0 con 0x7ff3b00afb30 2023-11-08T19:23:17.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.539+0000 7ff3b5872700 1 -- 172.21.15.149:0/2313131003 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3a4009430 con 0x7ff3b00afb30 2023-11-08T19:23:17.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.539+0000 7ff397fff700 1 -- 172.21.15.149:0/2313131003 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3a4003d30 con 0x7ff3b00afb30 2023-11-08T19:23:17.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.539+0000 7ff397fff700 1 -- 172.21.15.149:0/2313131003 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a4003ea0 con 0x7ff3b00afb30 2023-11-08T19:23:17.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.539+0000 7ff3b5872700 1 -- 172.21.15.149:0/2313131003 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3b01f3270 con 0x7ff3b00afb30 2023-11-08T19:23:17.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.540+0000 7ff3b5872700 1 -- 172.21.15.149:0/2313131003 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3b01f3430 con 0x7ff3b00afb30 2023-11-08T19:23:17.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.540+0000 7ff397fff700 1 -- 172.21.15.149:0/2313131003 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff3a4018030 con 0x7ff3b00afb30 2023-11-08T19:23:17.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.541+0000 7ff397fff700 1 --2- 172.21.15.149:0/2313131003 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff39c06af00 0x7ff39c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:17.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.541+0000 7ff397fff700 1 -- 172.21.15.149:0/2313131003 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff3a408a7f0 con 0x7ff3b00afb30 2023-11-08T19:23:17.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.541+0000 7ff3ae7fc700 1 --2- 172.21.15.149:0/2313131003 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff39c06af00 0x7ff39c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:17.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.541+0000 7ff3ae7fc700 1 --2- 172.21.15.149:0/2313131003 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff39c06af00 0x7ff39c06d3c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff3b00c7e00 tx=0x7ff3a0000ed0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:17.551 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.545+0000 7ff397fff700 1 -- 172.21.15.149:0/2313131003 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff3a40555c0 con 0x7ff3b00afb30 2023-11-08T19:23:17.752 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.750+0000 7ff3b5872700 1 -- 172.21.15.149:0/2313131003 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff3b00745f0 con 0x7ff3b00afb30 2023-11-08T19:23:17.752 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.751+0000 7ff397fff700 1 -- 172.21.15.149:0/2313131003 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff3a4058be0 con 0x7ff3b00afb30 2023-11-08T19:23:17.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.753+0000 7ff3b5872700 1 -- 172.21.15.149:0/2313131003 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff39c06af00 msgr2=0x7ff39c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:17.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.753+0000 7ff3b5872700 1 --2- 172.21.15.149:0/2313131003 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff39c06af00 0x7ff39c06d3c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff3b00c7e00 tx=0x7ff3a0000ed0 comp rx=0 tx=0).stop 2023-11-08T19:23:17.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.753+0000 7ff3b5872700 1 -- 172.21.15.149:0/2313131003 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3b00afb30 msgr2=0x7ff3b00c8080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:17.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.753+0000 7ff3b5872700 1 --2- 172.21.15.149:0/2313131003 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3b00afb30 0x7ff3b00c8080 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff3a4009b70 tx=0x7ff3a4004750 comp rx=0 tx=0).stop 2023-11-08T19:23:17.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.753+0000 7ff3b5872700 1 -- 172.21.15.149:0/2313131003 shutdown_connections 2023-11-08T19:23:17.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.753+0000 7ff3b5872700 1 --2- 172.21.15.149:0/2313131003 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff39c06af00 0x7ff39c06d3c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:17.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.753+0000 7ff3b5872700 1 --2- 172.21.15.149:0/2313131003 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff3b00b20b0 0x7ff3b00cd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:17.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.753+0000 7ff3b5872700 1 --2- 172.21.15.149:0/2313131003 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3b00afb30 0x7ff3b00c8080 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:17.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.753+0000 7ff3b5872700 1 --2- 172.21.15.149:0/2313131003 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff3b00b16b0 0x7ff3b00b59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:17.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.753+0000 7ff3b5872700 1 -- 172.21.15.149:0/2313131003 >> 172.21.15.149:0/2313131003 conn(0x7ff3b0099a40 msgr2=0x7ff3b00cbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:17.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.753+0000 7ff3b5872700 1 -- 172.21.15.149:0/2313131003 shutdown_connections 2023-11-08T19:23:17.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17.753+0000 7ff3b5872700 1 -- 172.21.15.149:0/2313131003 wait complete. 2023-11-08T19:23:17.757 INFO:teuthology.orchestra.run.smithi149.stderr:listed 0 entries 2023-11-08T19:23:17.766 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi149.front.sepia.ceph.com... 2023-11-08T19:23:17.766 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-08T19:23:17.767 DEBUG:teuthology.orchestra.run.smithi149:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-11-08T19:23:17.826 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-08T19:23:17.835 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi149.stderr:ceph-fuse[111848]: fuse finished with error 0 and tester_r 0 2023-11-08T19:23:17.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-08T19:23:17.840 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi149.stderr:2023-11-08T19:23:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-08T19:23:17.841 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T19:23:17.848 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi149.front.sepia.ceph.com 2023-11-08T19:23:17.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:17.848 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-11-08T19:23:17.924 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:23:18.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.083+0000 7ff864e34700 1 Processor -- start 2023-11-08T19:23:18.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.083+0000 7ff864e34700 1 -- start start 2023-11-08T19:23:18.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.084+0000 7ff864e34700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff8600afb30 0x7ff8600ce380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:18.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.084+0000 7ff864e34700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7ff8600b16b0 0x7ff8600cbf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:18.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.084+0000 7ff864e34700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8600d1330 con 0x7ff8600b20b0 2023-11-08T19:23:18.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.084+0000 7ff864e34700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8600cb490 con 0x7ff8600afb30 2023-11-08T19:23:18.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.084+0000 7ff864e34700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8600cb770 con 0x7ff8600b16b0 2023-11-08T19:23:18.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.084+0000 7ff85e59c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff8600afb30 0x7ff8600ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:18.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.084+0000 7ff85e59c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff8600afb30 0x7ff8600ce380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37108/0 (socket says 172.21.15.149:37108) 2023-11-08T19:23:18.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.084+0000 7ff85e59c700 1 -- 172.21.15.149:0/3445392979 learned_addr learned my addr 172.21.15.149:0/3445392979 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:18.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.084+0000 7ff85dd9b700 1 --2- 172.21.15.149:0/3445392979 >> v2:172.21.15.160:3300/0 conn(0x7ff8600b16b0 0x7ff8600cbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:18.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.084+0000 7ff85e59c700 1 -- 172.21.15.149:0/3445392979 >> v2:172.21.15.160:3300/0 conn(0x7ff8600b16b0 msgr2=0x7ff8600cbf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:18.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.084+0000 7ff85e59c700 1 --2- 172.21.15.149:0/3445392979 >> v2:172.21.15.160:3300/0 conn(0x7ff8600b16b0 0x7ff8600cbf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:18.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.084+0000 7ff85e59c700 1 -- 172.21.15.149:0/3445392979 >> v1:172.21.15.149:6789/0 conn(0x7ff8600b20b0 legacy=0x7ff8600aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:18.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.084+0000 7ff85e59c700 1 -- 172.21.15.149:0/3445392979 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8600cba50 con 0x7ff8600afb30 2023-11-08T19:23:18.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.084+0000 7ff85dd9b700 1 --2- 172.21.15.149:0/3445392979 >> v2:172.21.15.160:3300/0 conn(0x7ff8600b16b0 0x7ff8600cbf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:23:18.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.084+0000 7ff85e59c700 1 --2- 172.21.15.149:0/3445392979 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8600afb30 0x7ff8600ce380 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff860071c00 tx=0x7ff854009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14b3a11fe7604a23 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:18.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.084+0000 7ff85d59a700 1 -- 172.21.15.149:0/3445392979 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff854005e30 con 0x7ff8600afb30 2023-11-08T19:23:18.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.085+0000 7ff85d59a700 1 -- 172.21.15.149:0/3445392979 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff854004030 con 0x7ff8600afb30 2023-11-08T19:23:18.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.085+0000 7ff85d59a700 1 -- 172.21.15.149:0/3445392979 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8540043e0 con 0x7ff8600afb30 2023-11-08T19:23:18.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.085+0000 7ff864e34700 1 -- 172.21.15.149:0/3445392979 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8600afb30 msgr2=0x7ff8600ce380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:18.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.085+0000 7ff864e34700 1 --2- 172.21.15.149:0/3445392979 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8600afb30 0x7ff8600ce380 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff860071c00 tx=0x7ff854009bd0 comp rx=0 tx=0).stop 2023-11-08T19:23:18.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.085+0000 7ff864e34700 1 -- 172.21.15.149:0/3445392979 shutdown_connections 2023-11-08T19:23:18.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.085+0000 7ff864e34700 1 --2- 172.21.15.149:0/3445392979 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8600afb30 0x7ff8600ce380 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:18.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.085+0000 7ff864e34700 1 --2- 172.21.15.149:0/3445392979 >> v2:172.21.15.160:3300/0 conn(0x7ff8600b16b0 0x7ff8600cbf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:18.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.085+0000 7ff864e34700 1 -- 172.21.15.149:0/3445392979 >> 172.21.15.149:0/3445392979 conn(0x7ff860099a40 msgr2=0x7ff8600d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:18.092 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.085+0000 7ff864e34700 1 -- 172.21.15.149:0/3445392979 shutdown_connections 2023-11-08T19:23:18.092 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.085+0000 7ff864e34700 1 -- 172.21.15.149:0/3445392979 wait complete. 2023-11-08T19:23:18.094 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.086+0000 7ff864e34700 1 Processor -- start 2023-11-08T19:23:18.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.087+0000 7ff864e34700 1 -- start start 2023-11-08T19:23:18.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.087+0000 7ff864e34700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff8600afb30 0x7ff8601e7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:18.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.087+0000 7ff864e34700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8600b16b0 0x7ff8600b3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:18.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.087+0000 7ff864e34700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8600b20b0 0x7ff86014f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:18.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.087+0000 7ff864e34700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8600b5260 con 0x7ff8600b16b0 2023-11-08T19:23:18.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.087+0000 7ff864e34700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8600b46e0 con 0x7ff8600afb30 2023-11-08T19:23:18.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.087+0000 7ff864e34700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8600b49c0 con 0x7ff8600b20b0 2023-11-08T19:23:18.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.087+0000 7ff85dd9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8600b16b0 0x7ff8600b3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:18.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.087+0000 7ff85dd9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8600b16b0 0x7ff8600b3c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37116/0 (socket says 172.21.15.149:37116) 2023-11-08T19:23:18.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.087+0000 7ff85dd9b700 1 -- 172.21.15.149:0/2068840781 learned_addr learned my addr 172.21.15.149:0/2068840781 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:18.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.087+0000 7ff85ed9d700 1 --2- 172.21.15.149:0/2068840781 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8600b20b0 0x7ff86014f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:18.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.088+0000 7ff85e59c700 1 --2- 172.21.15.149:0/2068840781 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff8600afb30 0x7ff8601e7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:18.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.088+0000 7ff85dd9b700 1 -- 172.21.15.149:0/2068840781 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8600b20b0 msgr2=0x7ff86014f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:18.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.088+0000 7ff85dd9b700 1 --2- 172.21.15.149:0/2068840781 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8600b20b0 0x7ff86014f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:18.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.088+0000 7ff85dd9b700 1 -- 172.21.15.149:0/2068840781 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff8600afb30 msgr2=0x7ff8601e7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:18.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.088+0000 7ff85dd9b700 1 --2- 172.21.15.149:0/2068840781 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff8600afb30 0x7ff8601e7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:18.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.088+0000 7ff85dd9b700 1 -- 172.21.15.149:0/2068840781 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff854009500 con 0x7ff8600b16b0 2023-11-08T19:23:18.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.088+0000 7ff85ed9d700 1 --2- 172.21.15.149:0/2068840781 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8600b20b0 0x7ff86014f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:23:18.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.088+0000 7ff85e59c700 1 --2- 172.21.15.149:0/2068840781 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff8600afb30 0x7ff8601e7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:23:18.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.088+0000 7ff85dd9b700 1 --2- 172.21.15.149:0/2068840781 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8600b16b0 0x7ff8600b3c10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff85000e7e0 tx=0x7ff85000eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:18.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.088+0000 7ff84effd700 1 -- 172.21.15.149:0/2068840781 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff850004230 con 0x7ff8600b16b0 2023-11-08T19:23:18.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.088+0000 7ff84effd700 1 -- 172.21.15.149:0/2068840781 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff850004390 con 0x7ff8600b16b0 2023-11-08T19:23:18.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.088+0000 7ff864e34700 1 -- 172.21.15.149:0/2068840781 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8600b4ca0 con 0x7ff8600b16b0 2023-11-08T19:23:18.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.088+0000 7ff84effd700 1 -- 172.21.15.149:0/2068840781 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8500036a0 con 0x7ff8600b16b0 2023-11-08T19:23:18.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.088+0000 7ff864e34700 1 -- 172.21.15.149:0/2068840781 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff86015c680 con 0x7ff8600b16b0 2023-11-08T19:23:18.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.089+0000 7ff864e34700 1 -- 172.21.15.149:0/2068840781 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8600745f0 con 0x7ff8600b16b0 2023-11-08T19:23:18.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.089+0000 7ff84effd700 1 -- 172.21.15.149:0/2068840781 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff850003800 con 0x7ff8600b16b0 2023-11-08T19:23:18.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.090+0000 7ff84effd700 1 --2- 172.21.15.149:0/2068840781 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff84006af00 0x7ff84006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:18.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.090+0000 7ff84effd700 1 -- 172.21.15.149:0/2068840781 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff850089350 con 0x7ff8600b16b0 2023-11-08T19:23:18.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.090+0000 7ff85e59c700 1 --2- 172.21.15.149:0/2068840781 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff84006af00 0x7ff84006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:18.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.090+0000 7ff85e59c700 1 --2- 172.21.15.149:0/2068840781 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff84006af00 0x7ff84006d3c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff860071c00 tx=0x7ff854008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:18.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.095+0000 7ff84effd700 1 -- 172.21.15.149:0/2068840781 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff850054110 con 0x7ff8600b16b0 2023-11-08T19:23:18.287 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.286+0000 7ff864e34700 1 -- 172.21.15.149:0/2068840781 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff8600c4590 con 0x7ff8600b16b0 2023-11-08T19:23:18.289 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.288+0000 7ff84effd700 1 -- 172.21.15.149:0/2068840781 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18382 (secure 0 0 0) 0x7ff850057730 con 0x7ff8600b16b0 2023-11-08T19:23:18.289 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:23:18.290 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":24,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:23:06.964482+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-08T19:22:59.830928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-08T19:23:00.886589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-08T19:23:04.574033+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:23:18.291 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.290+0000 7ff864e34700 1 -- 172.21.15.149:0/2068840781 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff84006af00 msgr2=0x7ff84006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:18.292 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.290+0000 7ff864e34700 1 --2- 172.21.15.149:0/2068840781 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff84006af00 0x7ff84006d3c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff860071c00 tx=0x7ff854008070 comp rx=0 tx=0).stop 2023-11-08T19:23:18.292 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.290+0000 7ff864e34700 1 -- 172.21.15.149:0/2068840781 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8600b16b0 msgr2=0x7ff8600b3c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:18.292 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.290+0000 7ff864e34700 1 --2- 172.21.15.149:0/2068840781 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8600b16b0 0x7ff8600b3c10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff85000e7e0 tx=0x7ff85000eba0 comp rx=0 tx=0).stop 2023-11-08T19:23:18.292 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.290+0000 7ff864e34700 1 -- 172.21.15.149:0/2068840781 shutdown_connections 2023-11-08T19:23:18.292 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.290+0000 7ff864e34700 1 --2- 172.21.15.149:0/2068840781 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff84006af00 0x7ff84006d3c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:18.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.290+0000 7ff864e34700 1 --2- 172.21.15.149:0/2068840781 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff8600afb30 0x7ff8601e7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:18.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.290+0000 7ff864e34700 1 --2- 172.21.15.149:0/2068840781 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8600b20b0 0x7ff86014f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:18.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.290+0000 7ff864e34700 1 --2- 172.21.15.149:0/2068840781 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8600b16b0 0x7ff8600b3c10 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:18.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.290+0000 7ff864e34700 1 -- 172.21.15.149:0/2068840781 >> 172.21.15.149:0/2068840781 conn(0x7ff860099a40 msgr2=0x7ff8600ad250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:18.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.290+0000 7ff864e34700 1 -- 172.21.15.149:0/2068840781 shutdown_connections 2023-11-08T19:23:18.294 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.290+0000 7ff864e34700 1 -- 172.21.15.149:0/2068840781 wait complete. 2023-11-08T19:23:18.304 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:23:18.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.423+0000 7fae53c1e700 1 Processor -- start 2023-11-08T19:23:18.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.424+0000 7fae53c1e700 1 -- start start 2023-11-08T19:23:18.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.424+0000 7fae53c1e700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fae4c0cc140 0x7fae4c0cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:18.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.425+0000 7fae53c1e700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fae4c0b2850 0x7fae4c0cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:18.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.425+0000 7fae53c1e700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae4c0cce50 con 0x7fae4c0b2cd0 2023-11-08T19:23:18.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.425+0000 7fae53c1e700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae4c0b2430 con 0x7fae4c0b2850 2023-11-08T19:23:18.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.425+0000 7fae53c1e700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae4c0cc520 con 0x7fae4c0cc140 2023-11-08T19:23:18.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.425+0000 7fae511b9700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fae4c0b2850 0x7fae4c0cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:18.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.425+0000 7fae511b9700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fae4c0b2850 0x7fae4c0cabf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37124/0 (socket says 172.21.15.149:37124) 2023-11-08T19:23:18.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.425+0000 7fae511b9700 1 -- 172.21.15.149:0/3684295152 learned_addr learned my addr 172.21.15.149:0/3684295152 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:18.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.425+0000 7fae519ba700 1 --2- 172.21.15.149:0/3684295152 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fae4c0cc140 0x7fae4c0cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:18.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.425+0000 7fae511b9700 1 -- 172.21.15.149:0/3684295152 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fae4c0cc140 msgr2=0x7fae4c0cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:18.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.425+0000 7fae511b9700 1 --2- 172.21.15.149:0/3684295152 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fae4c0cc140 0x7fae4c0cc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:18.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.425+0000 7fae511b9700 1 -- 172.21.15.149:0/3684295152 >> v1:172.21.15.149:6789/0 conn(0x7fae4c0b2cd0 legacy=0x7fae4c15d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:18.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.425+0000 7fae511b9700 1 -- 172.21.15.149:0/3684295152 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae4c0b17b0 con 0x7fae4c0b2850 2023-11-08T19:23:18.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.425+0000 7fae511b9700 1 --2- 172.21.15.149:0/3684295152 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae4c0b2850 0x7fae4c0cabf0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fae480098f0 tx=0x7fae48009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c63086a81f0a5b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:18.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.425+0000 7fae509b8700 1 -- 172.21.15.149:0/3684295152 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4800b8a0 con 0x7fae4c0b2850 2023-11-08T19:23:18.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.425+0000 7fae509b8700 1 -- 172.21.15.149:0/3684295152 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae4800ba00 con 0x7fae4c0b2850 2023-11-08T19:23:18.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.425+0000 7fae509b8700 1 -- 172.21.15.149:0/3684295152 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4800bd90 con 0x7fae4c0b2850 2023-11-08T19:23:18.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.426+0000 7fae53c1e700 1 -- 172.21.15.149:0/3684295152 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae4c0b2850 msgr2=0x7fae4c0cabf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:18.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.426+0000 7fae53c1e700 1 --2- 172.21.15.149:0/3684295152 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae4c0b2850 0x7fae4c0cabf0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fae480098f0 tx=0x7fae48009c00 comp rx=0 tx=0).stop 2023-11-08T19:23:18.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.426+0000 7fae53c1e700 1 -- 172.21.15.149:0/3684295152 shutdown_connections 2023-11-08T19:23:18.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.426+0000 7fae53c1e700 1 --2- 172.21.15.149:0/3684295152 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fae4c0cc140 0x7fae4c0cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:18.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.426+0000 7fae53c1e700 1 --2- 172.21.15.149:0/3684295152 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae4c0b2850 0x7fae4c0cabf0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:18.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.426+0000 7fae53c1e700 1 -- 172.21.15.149:0/3684295152 >> 172.21.15.149:0/3684295152 conn(0x7fae4c099a40 msgr2=0x7fae4c0d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:18.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.426+0000 7fae53c1e700 1 -- 172.21.15.149:0/3684295152 shutdown_connections 2023-11-08T19:23:18.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.426+0000 7fae53c1e700 1 -- 172.21.15.149:0/3684295152 wait complete. 2023-11-08T19:23:18.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.427+0000 7fae53c1e700 1 Processor -- start 2023-11-08T19:23:18.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.427+0000 7fae53c1e700 1 -- start start 2023-11-08T19:23:18.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.428+0000 7fae53c1e700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fae4c0b2850 0x7fae4c156a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:18.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.428+0000 7fae53c1e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fae4c0b2cd0 0x7fae4c09d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:18.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.428+0000 7fae53c1e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae4c0cc140 0x7fae4c09da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:18.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.428+0000 7fae53c1e700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae4c09a690 con 0x7fae4c0cc140 2023-11-08T19:23:18.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.428+0000 7fae53c1e700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae4c09be40 con 0x7fae4c0b2cd0 2023-11-08T19:23:18.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.428+0000 7fae53c1e700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae4c0ad1c0 con 0x7fae4c0b2850 2023-11-08T19:23:18.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.428+0000 7fae521bb700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae4c0cc140 0x7fae4c09da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:18.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.428+0000 7fae521bb700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae4c0cc140 0x7fae4c09da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37132/0 (socket says 172.21.15.149:37132) 2023-11-08T19:23:18.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.428+0000 7fae521bb700 1 -- 172.21.15.149:0/1884091083 learned_addr learned my addr 172.21.15.149:0/1884091083 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:18.438 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.428+0000 7fae519ba700 1 --2- 172.21.15.149:0/1884091083 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fae4c0b2850 0x7fae4c156a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:18.438 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.428+0000 7fae511b9700 1 --2- 172.21.15.149:0/1884091083 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fae4c0b2cd0 0x7fae4c09d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:18.438 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.428+0000 7fae521bb700 1 -- 172.21.15.149:0/1884091083 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fae4c0b2850 msgr2=0x7fae4c156a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:18.438 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.428+0000 7fae521bb700 1 --2- 172.21.15.149:0/1884091083 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fae4c0b2850 0x7fae4c156a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:18.438 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.428+0000 7fae521bb700 1 -- 172.21.15.149:0/1884091083 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fae4c0b2cd0 msgr2=0x7fae4c09d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:18.439 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.428+0000 7fae521bb700 1 --2- 172.21.15.149:0/1884091083 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fae4c0b2cd0 0x7fae4c09d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:18.439 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.428+0000 7fae521bb700 1 -- 172.21.15.149:0/1884091083 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae48009550 con 0x7fae4c0cc140 2023-11-08T19:23:18.439 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.429+0000 7fae521bb700 1 --2- 172.21.15.149:0/1884091083 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae4c0cc140 0x7fae4c09da70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fae4400cc50 tx=0x7fae4400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:18.439 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.429+0000 7fae427fc700 1 -- 172.21.15.149:0/1884091083 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4400ad80 con 0x7fae4c0cc140 2023-11-08T19:23:18.439 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.429+0000 7fae427fc700 1 -- 172.21.15.149:0/1884091083 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae4400ce50 con 0x7fae4c0cc140 2023-11-08T19:23:18.440 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.429+0000 7fae53c1e700 1 -- 172.21.15.149:0/1884091083 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae4c0ad4a0 con 0x7fae4c0cc140 2023-11-08T19:23:18.440 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.429+0000 7fae427fc700 1 -- 172.21.15.149:0/1884091083 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae44003c40 con 0x7fae4c0cc140 2023-11-08T19:23:18.440 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.429+0000 7fae53c1e700 1 -- 172.21.15.149:0/1884091083 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae4c0ada60 con 0x7fae4c0cc140 2023-11-08T19:23:18.440 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.430+0000 7fae53c1e700 1 -- 172.21.15.149:0/1884091083 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae4c0adc50 con 0x7fae4c0cc140 2023-11-08T19:23:18.440 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.430+0000 7fae427fc700 1 -- 172.21.15.149:0/1884091083 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fae440050d0 con 0x7fae4c0cc140 2023-11-08T19:23:18.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.430+0000 7fae427fc700 1 --2- 172.21.15.149:0/1884091083 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fae3006af00 0x7fae3006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:18.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.431+0000 7fae427fc700 1 -- 172.21.15.149:0/1884091083 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fae440899f0 con 0x7fae4c0cc140 2023-11-08T19:23:18.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.431+0000 7fae519ba700 1 --2- 172.21.15.149:0/1884091083 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fae3006af00 0x7fae3006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:18.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.431+0000 7fae519ba700 1 --2- 172.21.15.149:0/1884091083 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fae3006af00 0x7fae3006d3c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fae3c006fd0 tx=0x7fae3c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:18.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.435+0000 7fae427fc700 1 -- 172.21.15.149:0/1884091083 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fae440547b0 con 0x7fae4c0cc140 2023-11-08T19:23:18.632 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.631+0000 7fae53c1e700 1 -- 172.21.15.149:0/1884091083 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fae4c0745f0 con 0x7fae4c0cc140 2023-11-08T19:23:18.633 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.632+0000 7fae427fc700 1 -- 172.21.15.149:0/1884091083 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18382 (secure 0 0 0) 0x7fae44057dd0 con 0x7fae4c0cc140 2023-11-08T19:23:18.633 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:23:18.634 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":24,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:23:06.964482+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-08T19:22:59.830928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-08T19:23:00.886589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-08T19:23:04.574033+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:23:18.635 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.634+0000 7fae53c1e700 1 -- 172.21.15.149:0/1884091083 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fae3006af00 msgr2=0x7fae3006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:18.636 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.634+0000 7fae53c1e700 1 --2- 172.21.15.149:0/1884091083 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fae3006af00 0x7fae3006d3c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fae3c006fd0 tx=0x7fae3c008040 comp rx=0 tx=0).stop 2023-11-08T19:23:18.636 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.634+0000 7fae53c1e700 1 -- 172.21.15.149:0/1884091083 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae4c0cc140 msgr2=0x7fae4c09da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:18.636 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.634+0000 7fae53c1e700 1 --2- 172.21.15.149:0/1884091083 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae4c0cc140 0x7fae4c09da70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fae4400cc50 tx=0x7fae4400a340 comp rx=0 tx=0).stop 2023-11-08T19:23:18.636 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.634+0000 7fae53c1e700 1 -- 172.21.15.149:0/1884091083 shutdown_connections 2023-11-08T19:23:18.636 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.634+0000 7fae53c1e700 1 --2- 172.21.15.149:0/1884091083 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fae3006af00 0x7fae3006d3c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:18.637 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.634+0000 7fae53c1e700 1 --2- 172.21.15.149:0/1884091083 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae4c0cc140 0x7fae4c09da70 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:18.637 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.634+0000 7fae53c1e700 1 --2- 172.21.15.149:0/1884091083 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fae4c0b2850 0x7fae4c156a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:18.637 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.634+0000 7fae53c1e700 1 --2- 172.21.15.149:0/1884091083 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fae4c0b2cd0 0x7fae4c09d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:18.637 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.634+0000 7fae53c1e700 1 -- 172.21.15.149:0/1884091083 >> 172.21.15.149:0/1884091083 conn(0x7fae4c099a40 msgr2=0x7fae4c0c7670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:18.637 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.634+0000 7fae53c1e700 1 -- 172.21.15.149:0/1884091083 shutdown_connections 2023-11-08T19:23:18.638 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.634+0000 7fae53c1e700 1 -- 172.21.15.149:0/1884091083 wait complete. 2023-11-08T19:23:18.648 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-08T19:23:18.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.771+0000 7f5da3e46700 1 Processor -- start 2023-11-08T19:23:18.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.771+0000 7f5da3e46700 1 -- start start 2023-11-08T19:23:18.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.772+0000 7f5da3e46700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f5d9c15f470 0x7f5d9c15c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:18.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.772+0000 7f5da3e46700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f5d9c15cb60 0x7f5d9c0cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:18.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.772+0000 7f5da3e46700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d9c15be80 con 0x7f5d9c0cc0d0 2023-11-08T19:23:18.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.772+0000 7f5da3e46700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d9c0ccbc0 con 0x7f5d9c15f470 2023-11-08T19:23:18.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.772+0000 7f5da3e46700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d9c15f8d0 con 0x7f5d9c15cb60 2023-11-08T19:23:18.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.772+0000 7f5da13e1700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f5d9c15f470 0x7f5d9c15c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:18.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.772+0000 7f5da13e1700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f5d9c15f470 0x7f5d9c15c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37140/0 (socket says 172.21.15.149:37140) 2023-11-08T19:23:18.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.772+0000 7f5da13e1700 1 -- 172.21.15.149:0/2284368727 learned_addr learned my addr 172.21.15.149:0/2284368727 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:18.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.772+0000 7f5da23e3700 1 --2- 172.21.15.149:0/2284368727 >> v2:172.21.15.160:3300/0 conn(0x7f5d9c15cb60 0x7f5d9c0cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:18.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.772+0000 7f5da13e1700 1 -- 172.21.15.149:0/2284368727 >> v2:172.21.15.160:3300/0 conn(0x7f5d9c15cb60 msgr2=0x7f5d9c0cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:18.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.772+0000 7f5da13e1700 1 --2- 172.21.15.149:0/2284368727 >> v2:172.21.15.160:3300/0 conn(0x7f5d9c15cb60 0x7f5d9c0cf320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:18.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.772+0000 7f5da13e1700 1 -- 172.21.15.149:0/2284368727 >> v1:172.21.15.160:6789/0 conn(0x7f5d9c0cc0d0 legacy=0x7f5d9c0cc4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:18.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.772+0000 7f5da13e1700 1 -- 172.21.15.149:0/2284368727 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d9c15fba0 con 0x7f5d9c15f470 2023-11-08T19:23:18.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.772+0000 7f5da13e1700 1 --2- 172.21.15.149:0/2284368727 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d9c15f470 0x7f5d9c15c620 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c0d1600 tx=0x7f5d98009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de457380ca31dac6 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:18.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.772+0000 7f5da0be0700 1 -- 172.21.15.149:0/2284368727 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d98011830 con 0x7f5d9c15f470 2023-11-08T19:23:18.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.772+0000 7f5da0be0700 1 -- 172.21.15.149:0/2284368727 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d98011990 con 0x7f5d9c15f470 2023-11-08T19:23:18.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.772+0000 7f5da0be0700 1 -- 172.21.15.149:0/2284368727 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d98011d20 con 0x7f5d9c15f470 2023-11-08T19:23:18.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.773+0000 7f5da3e46700 1 -- 172.21.15.149:0/2284368727 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d9c15f470 msgr2=0x7f5d9c15c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:18.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.773+0000 7f5da3e46700 1 --2- 172.21.15.149:0/2284368727 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d9c15f470 0x7f5d9c15c620 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c0d1600 tx=0x7f5d98009bd0 comp rx=0 tx=0).stop 2023-11-08T19:23:18.779 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.773+0000 7f5da3e46700 1 -- 172.21.15.149:0/2284368727 shutdown_connections 2023-11-08T19:23:18.779 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.773+0000 7f5da3e46700 1 --2- 172.21.15.149:0/2284368727 >> v2:172.21.15.160:3300/0 conn(0x7f5d9c15cb60 0x7f5d9c0cf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:18.779 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.773+0000 7f5da3e46700 1 --2- 172.21.15.149:0/2284368727 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d9c15f470 0x7f5d9c15c620 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:18.779 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.773+0000 7f5da3e46700 1 -- 172.21.15.149:0/2284368727 >> 172.21.15.149:0/2284368727 conn(0x7f5d9c06f120 msgr2=0x7f5d9c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:18.780 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.773+0000 7f5da3e46700 1 -- 172.21.15.149:0/2284368727 shutdown_connections 2023-11-08T19:23:18.780 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.773+0000 7f5da3e46700 1 -- 172.21.15.149:0/2284368727 wait complete. 2023-11-08T19:23:18.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.774+0000 7f5da3e46700 1 Processor -- start 2023-11-08T19:23:18.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.774+0000 7f5da3e46700 1 -- start start 2023-11-08T19:23:18.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.775+0000 7f5da3e46700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5d9c0cc0d0 0x7f5d9c147ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:18.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.775+0000 7f5da3e46700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d9c15cb60 0x7f5d9c0b2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:18.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.775+0000 7f5da3e46700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d9c15f470 0x7f5d9c1481e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:18.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.775+0000 7f5da3e46700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9c0b2b60 con 0x7f5d9c15cb60 2023-11-08T19:23:18.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.775+0000 7f5da3e46700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9c0b1f50 con 0x7f5d9c15f470 2023-11-08T19:23:18.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.775+0000 7f5da3e46700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9c0b21c0 con 0x7f5d9c0cc0d0 2023-11-08T19:23:18.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.775+0000 7f5da13e1700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d9c15cb60 0x7f5d9c0b2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:18.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.775+0000 7f5da13e1700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d9c15cb60 0x7f5d9c0b2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37144/0 (socket says 172.21.15.149:37144) 2023-11-08T19:23:18.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.775+0000 7f5da13e1700 1 -- 172.21.15.149:0/3003510128 learned_addr learned my addr 172.21.15.149:0/3003510128 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:18.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.775+0000 7f5da1be2700 1 --2- 172.21.15.149:0/3003510128 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5d9c0cc0d0 0x7f5d9c147ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:18.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.775+0000 7f5da23e3700 1 --2- 172.21.15.149:0/3003510128 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d9c15f470 0x7f5d9c1481e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:18.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.775+0000 7f5da13e1700 1 -- 172.21.15.149:0/3003510128 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5d9c0cc0d0 msgr2=0x7f5d9c147ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:18.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.776+0000 7f5da13e1700 1 --2- 172.21.15.149:0/3003510128 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5d9c0cc0d0 0x7f5d9c147ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:18.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.776+0000 7f5da13e1700 1 -- 172.21.15.149:0/3003510128 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d9c15f470 msgr2=0x7f5d9c1481e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:18.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.776+0000 7f5da13e1700 1 --2- 172.21.15.149:0/3003510128 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d9c15f470 0x7f5d9c1481e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:18.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.776+0000 7f5da13e1700 1 -- 172.21.15.149:0/3003510128 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d98009550 con 0x7f5d9c15cb60 2023-11-08T19:23:18.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.776+0000 7f5da13e1700 1 --2- 172.21.15.149:0/3003510128 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d9c15cb60 0x7f5d9c0b2f80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5d98014040 tx=0x7f5d98004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:18.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.776+0000 7f5d927fc700 1 -- 172.21.15.149:0/3003510128 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d98004510 con 0x7f5d9c15cb60 2023-11-08T19:23:18.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.776+0000 7f5d927fc700 1 -- 172.21.15.149:0/3003510128 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d9801e070 con 0x7f5d9c15cb60 2023-11-08T19:23:18.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.776+0000 7f5da3e46700 1 -- 172.21.15.149:0/3003510128 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d9c0b24a0 con 0x7f5d9c15cb60 2023-11-08T19:23:18.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.776+0000 7f5d927fc700 1 -- 172.21.15.149:0/3003510128 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d980038e0 con 0x7f5d9c15cb60 2023-11-08T19:23:18.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.776+0000 7f5da3e46700 1 -- 172.21.15.149:0/3003510128 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d9c0b34c0 con 0x7f5d9c15cb60 2023-11-08T19:23:18.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.777+0000 7f5da3e46700 1 -- 172.21.15.149:0/3003510128 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d9c0b2ca0 con 0x7f5d9c15cb60 2023-11-08T19:23:18.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.777+0000 7f5d927fc700 1 -- 172.21.15.149:0/3003510128 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5d98003a40 con 0x7f5d9c15cb60 2023-11-08T19:23:18.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.778+0000 7f5d927fc700 1 --2- 172.21.15.149:0/3003510128 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5d8006af00 0x7f5d8006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:18.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.778+0000 7f5d927fc700 1 -- 172.21.15.149:0/3003510128 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5d9808a720 con 0x7f5d9c15cb60 2023-11-08T19:23:18.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.778+0000 7f5da1be2700 1 --2- 172.21.15.149:0/3003510128 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5d8006af00 0x7f5d8006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:18.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.778+0000 7f5da1be2700 1 --2- 172.21.15.149:0/3003510128 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5d8006af00 0x7f5d8006d3c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c007fd0 tx=0x7f5d8c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:18.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:18.782+0000 7f5d927fc700 1 -- 172.21.15.149:0/3003510128 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5d9c0b2ca0 con 0x7f5d9c15cb60 2023-11-08T19:23:19.018 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.016+0000 7f5da3e46700 1 -- 172.21.15.149:0/3003510128 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f5d9c0b2ca0 con 0x7f5d9c15cb60 2023-11-08T19:23:19.105 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.104+0000 7f5d927fc700 1 -- 172.21.15.149:0/3003510128 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7f5d9c0b2ca0 con 0x7f5d9c15cb60 2023-11-08T19:23:19.108 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.106+0000 7f5da3e46700 1 -- 172.21.15.149:0/3003510128 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5d8006af00 msgr2=0x7f5d8006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:19.108 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.106+0000 7f5da3e46700 1 --2- 172.21.15.149:0/3003510128 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5d8006af00 0x7f5d8006d3c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c007fd0 tx=0x7f5d8c009040 comp rx=0 tx=0).stop 2023-11-08T19:23:19.108 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.106+0000 7f5da3e46700 1 -- 172.21.15.149:0/3003510128 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d9c15cb60 msgr2=0x7f5d9c0b2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:19.108 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.106+0000 7f5da3e46700 1 --2- 172.21.15.149:0/3003510128 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d9c15cb60 0x7f5d9c0b2f80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5d98014040 tx=0x7f5d98004750 comp rx=0 tx=0).stop 2023-11-08T19:23:19.109 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.106+0000 7f5da3e46700 1 -- 172.21.15.149:0/3003510128 shutdown_connections 2023-11-08T19:23:19.109 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.106+0000 7f5da3e46700 1 --2- 172.21.15.149:0/3003510128 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5d8006af00 0x7f5d8006d3c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:19.109 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.106+0000 7f5da3e46700 1 --2- 172.21.15.149:0/3003510128 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d9c15f470 0x7f5d9c1481e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:19.109 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.106+0000 7f5da3e46700 1 --2- 172.21.15.149:0/3003510128 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5d9c0cc0d0 0x7f5d9c147ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:19.109 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.106+0000 7f5da3e46700 1 --2- 172.21.15.149:0/3003510128 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d9c15cb60 0x7f5d9c0b2f80 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:19.110 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.106+0000 7f5da3e46700 1 -- 172.21.15.149:0/3003510128 >> 172.21.15.149:0/3003510128 conn(0x7f5d9c06f120 msgr2=0x7f5d9c15dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:19.110 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.106+0000 7f5da3e46700 1 -- 172.21.15.149:0/3003510128 shutdown_connections 2023-11-08T19:23:19.110 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.106+0000 7f5da3e46700 1 -- 172.21.15.149:0/3003510128 wait complete. 2023-11-08T19:23:19.120 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-11-08T19:23:19.120 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-08T19:23:19.244 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.243+0000 7f2d2a6d5700 1 Processor -- start 2023-11-08T19:23:19.244 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.243+0000 7f2d2a6d5700 1 -- start start 2023-11-08T19:23:19.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.244+0000 7f2d2a6d5700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d2415df40 0x7f2d2406c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:19.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.244+0000 7f2d2a6d5700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d2415e320 con 0x7f2d2406ab80 2023-11-08T19:23:19.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.244+0000 7f2d2a6d5700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d2406b020 con 0x7f2d240cb660 2023-11-08T19:23:19.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.244+0000 7f2d2a6d5700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2406b2e0 con 0x7f2d2415df40 2023-11-08T19:23:19.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.244+0000 7f2d237fe700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f2d2406ab80 0x7f2d240caf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:39156/0 (socket says 172.21.15.149:39156) 2023-11-08T19:23:19.249 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.244+0000 7f2d237fe700 1 -- 172.21.15.149:0/3158812101 learned_addr learned my addr 172.21.15.149:0/3158812101 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:23:19.249 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.244+0000 7f2d23fff700 1 --2- 172.21.15.149:0/3158812101 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d2415df40 0x7f2d2406c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:19.249 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.244+0000 7f2d22ffd700 1 -- 172.21.15.149:0/3158812101 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3871170180 0 0) 0x7f2d2415e320 con 0x7f2d2406ab80 2023-11-08T19:23:19.249 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.244+0000 7f2d22ffd700 1 -- 172.21.15.149:0/3158812101 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d0c0035b0 con 0x7f2d2406ab80 2023-11-08T19:23:19.250 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.244+0000 7f2d22ffd700 1 -- 172.21.15.149:0/3158812101 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 923263715 0 0) 0x7f2d0c0035b0 con 0x7f2d2406ab80 2023-11-08T19:23:19.250 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.244+0000 7f2d22ffd700 1 -- 172.21.15.149:0/3158812101 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d2415df40 msgr2=0x7f2d2406c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:19.250 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.244+0000 7f2d22ffd700 1 --2- 172.21.15.149:0/3158812101 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d2415df40 0x7f2d2406c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:19.250 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.244+0000 7f2d22ffd700 1 -- 172.21.15.149:0/3158812101 >> v1:172.21.15.160:6789/0 conn(0x7f2d240cb660 legacy=0x7f2d240ce540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:19.250 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.244+0000 7f2d22ffd700 1 -- 172.21.15.149:0/3158812101 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d2406b5c0 con 0x7f2d2406ab80 2023-11-08T19:23:19.251 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.244+0000 7f2d22ffd700 1 -- 172.21.15.149:0/3158812101 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f2d18001670 con 0x7f2d2406ab80 2023-11-08T19:23:19.251 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.244+0000 7f2d22ffd700 1 -- 172.21.15.149:0/3158812101 >> v1:172.21.15.149:6789/0 conn(0x7f2d2406ab80 legacy=0x7f2d240caf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:19.251 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.244+0000 7f2d22ffd700 1 --2- 172.21.15.149:0/3158812101 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d2415df40 0x7f2d0c003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:19.251 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.244+0000 7f2d22ffd700 1 --2- 172.21.15.149:0/3158812101 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d0c004020 0x7f2d0c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:19.251 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.244+0000 7f2d22ffd700 1 --2- 172.21.15.149:0/3158812101 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2d0c004d90 0x7f2d0c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:19.252 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.244+0000 7f2d22ffd700 1 -- 172.21.15.149:0/3158812101 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2406b2e0 con 0x7f2d0c004020 2023-11-08T19:23:19.252 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.244+0000 7f2d22ffd700 1 -- 172.21.15.149:0/3158812101 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0c00bb70 con 0x7f2d0c004d90 2023-11-08T19:23:19.252 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.244+0000 7f2d22ffd700 1 -- 172.21.15.149:0/3158812101 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0c00bd30 con 0x7f2d2415df40 2023-11-08T19:23:19.252 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.244+0000 7f2d23fff700 1 --2- 172.21.15.149:0/3158812101 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d2415df40 0x7f2d0c003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:19.252 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.244+0000 7f2d237fe700 1 --2- 172.21.15.149:0/3158812101 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d0c004020 0x7f2d0c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:19.253 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.245+0000 7f2d28c72700 1 --2- 172.21.15.149:0/3158812101 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2d0c004d90 0x7f2d0c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:19.253 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.245+0000 7f2d23fff700 1 -- 172.21.15.149:0/3158812101 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2d0c004d90 msgr2=0x7f2d0c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:19.253 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.245+0000 7f2d23fff700 1 --2- 172.21.15.149:0/3158812101 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2d0c004d90 0x7f2d0c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:19.253 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.245+0000 7f2d23fff700 1 -- 172.21.15.149:0/3158812101 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d0c004020 msgr2=0x7f2d0c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:19.253 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.245+0000 7f2d23fff700 1 --2- 172.21.15.149:0/3158812101 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d0c004020 0x7f2d0c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:19.253 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.245+0000 7f2d23fff700 1 -- 172.21.15.149:0/3158812101 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d0c0035b0 con 0x7f2d2415df40 2023-11-08T19:23:19.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.245+0000 7f2d237fe700 1 --2- 172.21.15.149:0/3158812101 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d0c004020 0x7f2d0c004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:23:19.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.245+0000 7f2d23fff700 1 --2- 172.21.15.149:0/3158812101 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d2415df40 0x7f2d0c003aa0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2d14009b60 tx=0x7f2d0c005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f629fb8ea403519 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:19.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.245+0000 7f2d22ffd700 1 -- 172.21.15.149:0/3158812101 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1400e6c0 con 0x7f2d2415df40 2023-11-08T19:23:19.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.245+0000 7f2d22ffd700 1 -- 172.21.15.149:0/3158812101 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d1400e820 con 0x7f2d2415df40 2023-11-08T19:23:19.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.245+0000 7f2d22ffd700 1 -- 172.21.15.149:0/3158812101 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1400eb90 con 0x7f2d2415df40 2023-11-08T19:23:19.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.246+0000 7f2d2a6d5700 1 -- 172.21.15.149:0/3158812101 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d2415df40 msgr2=0x7f2d0c003aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:19.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.246+0000 7f2d2a6d5700 1 --2- 172.21.15.149:0/3158812101 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d2415df40 0x7f2d0c003aa0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2d14009b60 tx=0x7f2d0c005880 comp rx=0 tx=0).stop 2023-11-08T19:23:19.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.246+0000 7f2d28c72700 1 -- 172.21.15.149:0/3158812101 reap_dead start 2023-11-08T19:23:19.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.246+0000 7f2d2a6d5700 1 -- 172.21.15.149:0/3158812101 shutdown_connections 2023-11-08T19:23:19.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.246+0000 7f2d2a6d5700 1 -- 172.21.15.149:0/3158812101 >> 172.21.15.149:0/3158812101 conn(0x7f2d240d0640 msgr2=0x7f2d240d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:19.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.246+0000 7f2d2a6d5700 1 -- 172.21.15.149:0/3158812101 shutdown_connections 2023-11-08T19:23:19.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.246+0000 7f2d2a6d5700 1 -- 172.21.15.149:0/3158812101 wait complete. 2023-11-08T19:23:19.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.247+0000 7f2d2a6d5700 1 Processor -- start 2023-11-08T19:23:19.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.248+0000 7f2d2a6d5700 1 -- start start 2023-11-08T19:23:19.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.248+0000 7f2d2a6d5700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d2415df40 0x7f2d2415e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:19.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.248+0000 7f2d2a6d5700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2d241578c0 0x7f2d2415f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:19.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.248+0000 7f2d2a6d5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d240c94b0 0x7f2d24156cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:19.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.248+0000 7f2d2a6d5700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2415f5c0 con 0x7f2d240c94b0 2023-11-08T19:23:19.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.248+0000 7f2d2a6d5700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d241580a0 con 0x7f2d241578c0 2023-11-08T19:23:19.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.248+0000 7f2d2a6d5700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2415e940 con 0x7f2d2415df40 2023-11-08T19:23:19.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.248+0000 7f2d28c72700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d240c94b0 0x7f2d24156cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:19.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.248+0000 7f2d28c72700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d240c94b0 0x7f2d24156cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37168/0 (socket says 172.21.15.149:37168) 2023-11-08T19:23:19.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.248+0000 7f2d28c72700 1 -- 172.21.15.149:0/1661339775 learned_addr learned my addr 172.21.15.149:0/1661339775 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:19.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.249+0000 7f2d23fff700 1 --2- 172.21.15.149:0/1661339775 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d2415df40 0x7f2d2415e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:19.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.249+0000 7f2d237fe700 1 --2- 172.21.15.149:0/1661339775 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2d241578c0 0x7f2d2415f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:19.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.249+0000 7f2d28c72700 1 -- 172.21.15.149:0/1661339775 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d2415df40 msgr2=0x7f2d2415e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:19.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.249+0000 7f2d28c72700 1 --2- 172.21.15.149:0/1661339775 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d2415df40 0x7f2d2415e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:19.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.249+0000 7f2d28c72700 1 -- 172.21.15.149:0/1661339775 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2d241578c0 msgr2=0x7f2d2415f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:19.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.249+0000 7f2d28c72700 1 --2- 172.21.15.149:0/1661339775 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2d241578c0 0x7f2d2415f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:19.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.249+0000 7f2d28c72700 1 -- 172.21.15.149:0/1661339775 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d2415ec20 con 0x7f2d240c94b0 2023-11-08T19:23:19.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.249+0000 7f2d23fff700 1 --2- 172.21.15.149:0/1661339775 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d2415df40 0x7f2d2415e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:23:19.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.249+0000 7f2d28c72700 1 --2- 172.21.15.149:0/1661339775 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d240c94b0 0x7f2d24156cf0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2d240cad20 tx=0x7f2d1c00d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:19.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.249+0000 7f2d20ff9700 1 -- 172.21.15.149:0/1661339775 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1c003c10 con 0x7f2d240c94b0 2023-11-08T19:23:19.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.249+0000 7f2d20ff9700 1 -- 172.21.15.149:0/1661339775 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d1c003d90 con 0x7f2d240c94b0 2023-11-08T19:23:19.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.249+0000 7f2d2a6d5700 1 -- 172.21.15.149:0/1661339775 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d2415ef00 con 0x7f2d240c94b0 2023-11-08T19:23:19.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.249+0000 7f2d20ff9700 1 -- 172.21.15.149:0/1661339775 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1c00dbd0 con 0x7f2d240c94b0 2023-11-08T19:23:19.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.249+0000 7f2d2a6d5700 1 -- 172.21.15.149:0/1661339775 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d240c9930 con 0x7f2d240c94b0 2023-11-08T19:23:19.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.250+0000 7f2d2a6d5700 1 -- 172.21.15.149:0/1661339775 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d2415f700 con 0x7f2d240c94b0 2023-11-08T19:23:19.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.250+0000 7f2d20ff9700 1 -- 172.21.15.149:0/1661339775 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2d1c00dd30 con 0x7f2d240c94b0 2023-11-08T19:23:19.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.251+0000 7f2d20ff9700 1 --2- 172.21.15.149:0/1661339775 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2d1006af00 0x7f2d1006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:19.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.251+0000 7f2d20ff9700 1 -- 172.21.15.149:0/1661339775 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2d1c0898c0 con 0x7f2d240c94b0 2023-11-08T19:23:19.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.251+0000 7f2d23fff700 1 --2- 172.21.15.149:0/1661339775 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2d1006af00 0x7f2d1006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:19.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.251+0000 7f2d23fff700 1 --2- 172.21.15.149:0/1661339775 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2d1006af00 0x7f2d1006d3c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2d140090b0 tx=0x7f2d14008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:19.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.256+0000 7f2d20ff9700 1 -- 172.21.15.149:0/1661339775 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2d2415f700 con 0x7f2d240c94b0 2023-11-08T19:23:19.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:19.489+0000 7f2d2a6d5700 1 -- 172.21.15.149:0/1661339775 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f2d2404f730 con 0x7f2d240c94b0 2023-11-08T19:23:20.110 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.109+0000 7f2d20ff9700 1 -- 172.21.15.149:0/1661339775 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2d1c054710 con 0x7f2d240c94b0 2023-11-08T19:23:20.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.112+0000 7f2d2a6d5700 1 -- 172.21.15.149:0/1661339775 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2d1006af00 msgr2=0x7f2d1006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:20.114 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.112+0000 7f2d2a6d5700 1 --2- 172.21.15.149:0/1661339775 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2d1006af00 0x7f2d1006d3c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2d140090b0 tx=0x7f2d14008030 comp rx=0 tx=0).stop 2023-11-08T19:23:20.114 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.112+0000 7f2d2a6d5700 1 -- 172.21.15.149:0/1661339775 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d240c94b0 msgr2=0x7f2d24156cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:20.114 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.112+0000 7f2d2a6d5700 1 --2- 172.21.15.149:0/1661339775 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d240c94b0 0x7f2d24156cf0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2d240cad20 tx=0x7f2d1c00d430 comp rx=0 tx=0).stop 2023-11-08T19:23:20.114 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.112+0000 7f2d2a6d5700 1 -- 172.21.15.149:0/1661339775 shutdown_connections 2023-11-08T19:23:20.115 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.112+0000 7f2d2a6d5700 1 --2- 172.21.15.149:0/1661339775 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2d1006af00 0x7f2d1006d3c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:20.115 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.112+0000 7f2d2a6d5700 1 --2- 172.21.15.149:0/1661339775 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d240c94b0 0x7f2d24156cf0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:20.115 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.112+0000 7f2d2a6d5700 1 --2- 172.21.15.149:0/1661339775 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d2415df40 0x7f2d2415e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:20.115 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.112+0000 7f2d2a6d5700 1 --2- 172.21.15.149:0/1661339775 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2d241578c0 0x7f2d2415f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:20.116 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.112+0000 7f2d2a6d5700 1 -- 172.21.15.149:0/1661339775 >> 172.21.15.149:0/1661339775 conn(0x7f2d240d0640 msgr2=0x7f2d240ae8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:20.116 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.112+0000 7f2d2a6d5700 1 -- 172.21.15.149:0/1661339775 shutdown_connections 2023-11-08T19:23:20.116 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.112+0000 7f2d2a6d5700 1 -- 172.21.15.149:0/1661339775 wait complete. 2023-11-08T19:23:20.128 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-08T19:23:20.129 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:23:20.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.253+0000 7f051e026700 1 Processor -- start 2023-11-08T19:23:20.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.253+0000 7f051e026700 1 -- start start 2023-11-08T19:23:20.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.254+0000 7f051e026700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05180cc140 0x7f05180cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:20.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.254+0000 7f051e026700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f05180b2850 0x7f05180cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:20.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.254+0000 7f051e026700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f05180b2cd0 0x7f05180cb130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:20.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.254+0000 7f051e026700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05180b2430 con 0x7f05180b2cd0 2023-11-08T19:23:20.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.254+0000 7f051e026700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05180cb670 con 0x7f05180b2850 2023-11-08T19:23:20.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.254+0000 7f051e026700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05180cce50 con 0x7f05180cc140 2023-11-08T19:23:20.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.254+0000 7f0517fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f05180b2cd0 0x7f05180cb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:20.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.254+0000 7f0517fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f05180b2cd0 0x7f05180cb130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37174/0 (socket says 172.21.15.149:37174) 2023-11-08T19:23:20.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.254+0000 7f0517fff700 1 -- 172.21.15.149:0/958476443 learned_addr learned my addr 172.21.15.149:0/958476443 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:20.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.254+0000 7f0516ffd700 1 --2- 172.21.15.149:0/958476443 >> v2:172.21.15.160:3300/0 conn(0x7f05180b2850 0x7f05180cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:20.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.254+0000 7f05177fe700 1 --2- 172.21.15.149:0/958476443 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05180cc140 0x7f05180cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:20.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.254+0000 7f0517fff700 1 -- 172.21.15.149:0/958476443 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05180cc140 msgr2=0x7f05180cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:20.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.254+0000 7f0517fff700 1 --2- 172.21.15.149:0/958476443 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05180cc140 0x7f05180cc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:20.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.254+0000 7f0517fff700 1 -- 172.21.15.149:0/958476443 >> v2:172.21.15.160:3300/0 conn(0x7f05180b2850 msgr2=0x7f05180cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:20.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.254+0000 7f0517fff700 1 --2- 172.21.15.149:0/958476443 >> v2:172.21.15.160:3300/0 conn(0x7f05180b2850 0x7f05180cabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:20.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.254+0000 7f0517fff700 1 -- 172.21.15.149:0/958476443 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05180cc520 con 0x7f05180b2cd0 2023-11-08T19:23:20.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.254+0000 7f05177fe700 1 --2- 172.21.15.149:0/958476443 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05180cc140 0x7f05180cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:23:20.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.254+0000 7f0517fff700 1 --2- 172.21.15.149:0/958476443 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05180b2cd0 0x7f05180cb130 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0518073060 tx=0x7f051000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6b71486e070812b server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:20.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.255+0000 7f05167fc700 1 -- 172.21.15.149:0/958476443 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f051000e070 con 0x7f05180b2cd0 2023-11-08T19:23:20.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.255+0000 7f05167fc700 1 -- 172.21.15.149:0/958476443 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f051000b910 con 0x7f05180b2cd0 2023-11-08T19:23:20.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.255+0000 7f05167fc700 1 -- 172.21.15.149:0/958476443 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f051000bcc0 con 0x7f05180b2cd0 2023-11-08T19:23:20.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.255+0000 7f051e026700 1 -- 172.21.15.149:0/958476443 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05180b2cd0 msgr2=0x7f05180cb130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:20.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.255+0000 7f051e026700 1 --2- 172.21.15.149:0/958476443 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05180b2cd0 0x7f05180cb130 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0518073060 tx=0x7f051000b330 comp rx=0 tx=0).stop 2023-11-08T19:23:20.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.255+0000 7f051e026700 1 -- 172.21.15.149:0/958476443 shutdown_connections 2023-11-08T19:23:20.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.255+0000 7f051e026700 1 --2- 172.21.15.149:0/958476443 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05180b2cd0 0x7f05180cb130 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:20.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.255+0000 7f051e026700 1 --2- 172.21.15.149:0/958476443 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05180cc140 0x7f05180cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:20.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.255+0000 7f051e026700 1 --2- 172.21.15.149:0/958476443 >> v2:172.21.15.160:3300/0 conn(0x7f05180b2850 0x7f05180cabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:20.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.255+0000 7f051e026700 1 -- 172.21.15.149:0/958476443 >> 172.21.15.149:0/958476443 conn(0x7f0518099a40 msgr2=0x7f05180d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:20.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.255+0000 7f051e026700 1 -- 172.21.15.149:0/958476443 shutdown_connections 2023-11-08T19:23:20.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.255+0000 7f051e026700 1 -- 172.21.15.149:0/958476443 wait complete. 2023-11-08T19:23:20.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.256+0000 7f051e026700 1 Processor -- start 2023-11-08T19:23:20.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.257+0000 7f051e026700 1 -- start start 2023-11-08T19:23:20.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.257+0000 7f051e026700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05180b2850 0x7f051814d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:20.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.257+0000 7f051e026700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05180b2cd0 0x7f05180b3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:20.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.257+0000 7f051e026700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05180cc140 0x7f05180b5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:20.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.257+0000 7f051e026700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05181f4500 con 0x7f05180b2850 2023-11-08T19:23:20.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.257+0000 7f051e026700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f051814d960 con 0x7f05180cc140 2023-11-08T19:23:20.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.257+0000 7f051e026700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05180b44b0 con 0x7f05180b2cd0 2023-11-08T19:23:20.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.257+0000 7f05177fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05180b2850 0x7f051814d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:20.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.257+0000 7f05177fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05180b2850 0x7f051814d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37176/0 (socket says 172.21.15.149:37176) 2023-11-08T19:23:20.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.257+0000 7f05177fe700 1 -- 172.21.15.149:0/419370424 learned_addr learned my addr 172.21.15.149:0/419370424 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:20.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.258+0000 7f0516ffd700 1 --2- 172.21.15.149:0/419370424 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05180b2cd0 0x7f05180b3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:20.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.258+0000 7f0517fff700 1 --2- 172.21.15.149:0/419370424 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05180cc140 0x7f05180b5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:20.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.258+0000 7f05177fe700 1 -- 172.21.15.149:0/419370424 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05180b2cd0 msgr2=0x7f05180b3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:20.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.258+0000 7f05177fe700 1 --2- 172.21.15.149:0/419370424 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05180b2cd0 0x7f05180b3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:20.270 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.258+0000 7f05177fe700 1 -- 172.21.15.149:0/419370424 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05180cc140 msgr2=0x7f05180b5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:20.270 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.258+0000 7f05177fe700 1 --2- 172.21.15.149:0/419370424 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05180cc140 0x7f05180b5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:20.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.258+0000 7f05177fe700 1 -- 172.21.15.149:0/419370424 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0510009b30 con 0x7f05180b2850 2023-11-08T19:23:20.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.258+0000 7f05177fe700 1 --2- 172.21.15.149:0/419370424 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05180b2850 0x7f051814d420 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f050c00e810 tx=0x7f050c00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:20.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.258+0000 7f04fffff700 1 -- 172.21.15.149:0/419370424 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f050c005c20 con 0x7f05180b2850 2023-11-08T19:23:20.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.258+0000 7f04fffff700 1 -- 172.21.15.149:0/419370424 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f050c005d80 con 0x7f05180b2850 2023-11-08T19:23:20.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.258+0000 7f051e026700 1 -- 172.21.15.149:0/419370424 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05180b4790 con 0x7f05180b2850 2023-11-08T19:23:20.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.258+0000 7f04fffff700 1 -- 172.21.15.149:0/419370424 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f050c006250 con 0x7f05180b2850 2023-11-08T19:23:20.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.258+0000 7f051e026700 1 -- 172.21.15.149:0/419370424 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05180ad1c0 con 0x7f05180b2850 2023-11-08T19:23:20.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.259+0000 7f051e026700 1 -- 172.21.15.149:0/419370424 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05180ad810 con 0x7f05180b2850 2023-11-08T19:23:20.273 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.260+0000 7f04fffff700 1 -- 172.21.15.149:0/419370424 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f050c0063b0 con 0x7f05180b2850 2023-11-08T19:23:20.273 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.260+0000 7f04fffff700 1 --2- 172.21.15.149:0/419370424 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f050406af00 0x7f050406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:20.273 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.260+0000 7f04fffff700 1 -- 172.21.15.149:0/419370424 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f050c089250 con 0x7f05180b2850 2023-11-08T19:23:20.274 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.260+0000 7f0516ffd700 1 --2- 172.21.15.149:0/419370424 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f050406af00 0x7f050406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:20.274 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.260+0000 7f0516ffd700 1 --2- 172.21.15.149:0/419370424 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f050406af00 0x7f050406d3c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f05180c71b0 tx=0x7f0508009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:20.274 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.265+0000 7f04fffff700 1 -- 172.21.15.149:0/419370424 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f050c054010 con 0x7f05180b2850 2023-11-08T19:23:20.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.498+0000 7f051e026700 1 -- 172.21.15.149:0/419370424 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f05180745f0 con 0x7f05180b2850 2023-11-08T19:23:20.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.499+0000 7f04fffff700 1 -- 172.21.15.149:0/419370424 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4921 (secure 0 0 0) 0x7f050c00c450 con 0x7f05180b2850 2023-11-08T19:23:20.501 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:23:20.501 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4252,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/2277605177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":2277605177},{"type":"v1","addr":"172.21.15.149:6837","nonce":2277605177}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/2774257644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2774257644},{"type":"v1","addr":"172.21.15.149:6836","nonce":2774257644}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/2076428669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":2076428669},{"type":"v1","addr":"172.21.15.160:6835","nonce":2076428669}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-08T19:23:01.918138+0000","modified":"2023-11-08T19:23:19.490960+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.160:6834/3847116435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3847116435},{"type":"v1","addr":"172.21.15.160:6834","nonce":3847116435}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-08T19:23:20.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.501+0000 7f051e026700 1 -- 172.21.15.149:0/419370424 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f050406af00 msgr2=0x7f050406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:20.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.501+0000 7f051e026700 1 --2- 172.21.15.149:0/419370424 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f050406af00 0x7f050406d3c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f05180c71b0 tx=0x7f0508009210 comp rx=0 tx=0).stop 2023-11-08T19:23:20.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.501+0000 7f051e026700 1 -- 172.21.15.149:0/419370424 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05180b2850 msgr2=0x7f051814d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:20.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.501+0000 7f051e026700 1 --2- 172.21.15.149:0/419370424 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05180b2850 0x7f051814d420 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f050c00e810 tx=0x7f050c00eb20 comp rx=0 tx=0).stop 2023-11-08T19:23:20.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.501+0000 7f051e026700 1 -- 172.21.15.149:0/419370424 shutdown_connections 2023-11-08T19:23:20.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.501+0000 7f051e026700 1 --2- 172.21.15.149:0/419370424 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f050406af00 0x7f050406d3c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:20.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.501+0000 7f051e026700 1 --2- 172.21.15.149:0/419370424 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05180cc140 0x7f05180b5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:20.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.501+0000 7f051e026700 1 --2- 172.21.15.149:0/419370424 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05180b2850 0x7f051814d420 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:20.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.501+0000 7f051e026700 1 --2- 172.21.15.149:0/419370424 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05180b2cd0 0x7f05180b3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:20.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.501+0000 7f051e026700 1 -- 172.21.15.149:0/419370424 >> 172.21.15.149:0/419370424 conn(0x7f0518099a40 msgr2=0x7f05180c7670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:20.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.501+0000 7f051e026700 1 -- 172.21.15.149:0/419370424 shutdown_connections 2023-11-08T19:23:20.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.501+0000 7f051e026700 1 -- 172.21.15.149:0/419370424 wait complete. 2023-11-08T19:23:20.505 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 9 2023-11-08T19:23:20.515 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:23:20.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.637+0000 7f36d5e09700 1 Processor -- start 2023-11-08T19:23:20.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.637+0000 7f36d5e09700 1 -- start start 2023-11-08T19:23:20.641 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.638+0000 7f36d5e09700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f36d0161670 0x7f36d00b5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:20.641 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.638+0000 7f36d5e09700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f36d00ce500 0x7f36d00ce990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:20.641 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.638+0000 7f36d5e09700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36d00d1a10 con 0x7f36d0161a50 2023-11-08T19:23:20.642 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.638+0000 7f36d5e09700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36d00d1cf0 con 0x7f36d00ce500 2023-11-08T19:23:20.642 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.638+0000 7f36d5e09700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36d00d1fd0 con 0x7f36d0161670 2023-11-08T19:23:20.642 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.638+0000 7f36ceffd700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f36d0161a50 0x7f36d0161ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:39188/0 (socket says 172.21.15.149:39188) 2023-11-08T19:23:20.642 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.638+0000 7f36ceffd700 1 -- 172.21.15.149:0/2552757452 learned_addr learned my addr 172.21.15.149:0/2552757452 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:23:20.643 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.638+0000 7f36cffff700 1 --2- 172.21.15.149:0/2552757452 >> v2:172.21.15.160:3300/0 conn(0x7f36d00ce500 0x7f36d00ce990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:20.643 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.638+0000 7f36cf7fe700 1 --2- 172.21.15.149:0/2552757452 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f36d0161670 0x7f36d00b5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:20.643 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.639+0000 7f36ce7fc700 1 -- 172.21.15.149:0/2552757452 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 363135583 0 0) 0x7f36d00d1a10 con 0x7f36d0161a50 2023-11-08T19:23:20.643 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.639+0000 7f36ce7fc700 1 -- 172.21.15.149:0/2552757452 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36bc0035b0 con 0x7f36d0161a50 2023-11-08T19:23:20.643 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.639+0000 7f36cf7fe700 1 -- 172.21.15.149:0/2552757452 >> v2:172.21.15.160:3300/0 conn(0x7f36d00ce500 msgr2=0x7f36d00ce990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:20.643 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.639+0000 7f36cf7fe700 1 --2- 172.21.15.149:0/2552757452 >> v2:172.21.15.160:3300/0 conn(0x7f36d00ce500 0x7f36d00ce990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:20.644 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.639+0000 7f36cf7fe700 1 -- 172.21.15.149:0/2552757452 >> v1:172.21.15.149:6789/0 conn(0x7f36d0161a50 legacy=0x7f36d0161ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:20.644 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.639+0000 7f36cf7fe700 1 -- 172.21.15.149:0/2552757452 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d00d22b0 con 0x7f36d0161670 2023-11-08T19:23:20.644 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.639+0000 7f36cf7fe700 1 --2- 172.21.15.149:0/2552757452 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f36d0161670 0x7f36d00b5e10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f36b8009820 tx=0x7f36b8009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6dcf919af58420b0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:20.644 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.639+0000 7f36ce7fc700 1 -- 172.21.15.149:0/2552757452 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b8005e30 con 0x7f36d0161670 2023-11-08T19:23:20.644 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.639+0000 7f36ce7fc700 1 -- 172.21.15.149:0/2552757452 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36b8006030 con 0x7f36d0161670 2023-11-08T19:23:20.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.639+0000 7f36ce7fc700 1 -- 172.21.15.149:0/2552757452 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b80063c0 con 0x7f36d0161670 2023-11-08T19:23:20.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.640+0000 7f36d5e09700 1 -- 172.21.15.149:0/2552757452 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f36d0161670 msgr2=0x7f36d00b5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:20.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.640+0000 7f36d5e09700 1 --2- 172.21.15.149:0/2552757452 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f36d0161670 0x7f36d00b5e10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f36b8009820 tx=0x7f36b8009b30 comp rx=0 tx=0).stop 2023-11-08T19:23:20.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.640+0000 7f36d5e09700 1 -- 172.21.15.149:0/2552757452 shutdown_connections 2023-11-08T19:23:20.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.640+0000 7f36d5e09700 1 --2- 172.21.15.149:0/2552757452 >> v2:172.21.15.160:3300/0 conn(0x7f36d00ce500 0x7f36d00ce990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:20.646 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.640+0000 7f36d5e09700 1 --2- 172.21.15.149:0/2552757452 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f36d0161670 0x7f36d00b5e10 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:20.646 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.640+0000 7f36d5e09700 1 -- 172.21.15.149:0/2552757452 >> 172.21.15.149:0/2552757452 conn(0x7f36d00d3980 msgr2=0x7f36d00d3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:20.646 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.640+0000 7f36d5e09700 1 -- 172.21.15.149:0/2552757452 shutdown_connections 2023-11-08T19:23:20.646 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.640+0000 7f36d5e09700 1 -- 172.21.15.149:0/2552757452 wait complete. 2023-11-08T19:23:20.649 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.641+0000 7f36d5e09700 1 Processor -- start 2023-11-08T19:23:20.649 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.642+0000 7f36d5e09700 1 -- start start 2023-11-08T19:23:20.649 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.642+0000 7f36d5e09700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f36d00ce500 0x7f36d009fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:20.650 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.642+0000 7f36d5e09700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36d0161670 0x7f36d00b59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:20.650 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.642+0000 7f36d5e09700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f36d0161a50 0x7f36d00b86a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:20.650 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.642+0000 7f36d5e09700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d00a03b0 con 0x7f36d0161670 2023-11-08T19:23:20.650 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.642+0000 7f36d5e09700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d00a0690 con 0x7f36d0161a50 2023-11-08T19:23:20.650 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.642+0000 7f36d5e09700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36d00a0970 con 0x7f36d00ce500 2023-11-08T19:23:20.651 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.643+0000 7f36ceffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36d0161670 0x7f36d00b59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:20.651 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.643+0000 7f36ceffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36d0161670 0x7f36d00b59c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37188/0 (socket says 172.21.15.149:37188) 2023-11-08T19:23:20.651 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.643+0000 7f36ceffd700 1 -- 172.21.15.149:0/1439140979 learned_addr learned my addr 172.21.15.149:0/1439140979 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:20.651 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.643+0000 7f36cf7fe700 1 --2- 172.21.15.149:0/1439140979 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f36d00ce500 0x7f36d009fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:20.651 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.643+0000 7f36cffff700 1 --2- 172.21.15.149:0/1439140979 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f36d0161a50 0x7f36d00b86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:20.652 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.643+0000 7f36ceffd700 1 -- 172.21.15.149:0/1439140979 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f36d00ce500 msgr2=0x7f36d009fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:20.652 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.643+0000 7f36ceffd700 1 --2- 172.21.15.149:0/1439140979 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f36d00ce500 0x7f36d009fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:20.652 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.643+0000 7f36ceffd700 1 -- 172.21.15.149:0/1439140979 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f36d0161a50 msgr2=0x7f36d00b86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:20.652 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.643+0000 7f36ceffd700 1 --2- 172.21.15.149:0/1439140979 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f36d0161a50 0x7f36d00b86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:20.652 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.643+0000 7f36ceffd700 1 -- 172.21.15.149:0/1439140979 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36b8009430 con 0x7f36d0161670 2023-11-08T19:23:20.652 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.643+0000 7f36ceffd700 1 --2- 172.21.15.149:0/1439140979 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36d0161670 0x7f36d00b59c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f36c0001eb0 tx=0x7f36c000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:20.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.643+0000 7f36c7fff700 1 -- 172.21.15.149:0/1439140979 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c0005d70 con 0x7f36d0161670 2023-11-08T19:23:20.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.643+0000 7f36d5e09700 1 -- 172.21.15.149:0/1439140979 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36d00a0c50 con 0x7f36d0161670 2023-11-08T19:23:20.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.643+0000 7f36c7fff700 1 -- 172.21.15.149:0/1439140979 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36c00070d0 con 0x7f36d0161670 2023-11-08T19:23:20.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.643+0000 7f36c7fff700 1 -- 172.21.15.149:0/1439140979 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c0007460 con 0x7f36d0161670 2023-11-08T19:23:20.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.643+0000 7f36d5e09700 1 -- 172.21.15.149:0/1439140979 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36d015c8e0 con 0x7f36d0161670 2023-11-08T19:23:20.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.644+0000 7f36d5e09700 1 -- 172.21.15.149:0/1439140979 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36d00745f0 con 0x7f36d0161670 2023-11-08T19:23:20.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.644+0000 7f36c7fff700 1 -- 172.21.15.149:0/1439140979 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f36c00075c0 con 0x7f36d0161670 2023-11-08T19:23:20.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.645+0000 7f36c7fff700 1 --2- 172.21.15.149:0/1439140979 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f36b006af00 0x7f36b006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:20.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.645+0000 7f36cf7fe700 1 --2- 172.21.15.149:0/1439140979 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f36b006af00 0x7f36b006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:20.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.645+0000 7f36c7fff700 1 -- 172.21.15.149:0/1439140979 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f36c0088ea0 con 0x7f36d0161670 2023-11-08T19:23:20.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.645+0000 7f36cf7fe700 1 --2- 172.21.15.149:0/1439140979 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f36b006af00 0x7f36b006d3c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f36b8009b70 tx=0x7f36b8008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:20.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.650+0000 7f36c7fff700 1 -- 172.21.15.149:0/1439140979 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f36c0053be0 con 0x7f36d0161670 2023-11-08T19:23:20.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.842+0000 7f36d5e09700 1 -- 172.21.15.149:0/1439140979 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f36d008b060 con 0x7f36d0161670 2023-11-08T19:23:20.845 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.844+0000 7f36c7fff700 1 -- 172.21.15.149:0/1439140979 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18382 (secure 0 0 0) 0x7f36c0057200 con 0x7f36d0161670 2023-11-08T19:23:20.845 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:23:20.846 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":24,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:23:06.964482+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-08T19:22:59.830928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-08T19:23:00.886589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-08T19:23:04.574033+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:23:20.847 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.846+0000 7f36d5e09700 1 -- 172.21.15.149:0/1439140979 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f36b006af00 msgr2=0x7f36b006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:20.847 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.846+0000 7f36d5e09700 1 --2- 172.21.15.149:0/1439140979 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f36b006af00 0x7f36b006d3c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f36b8009b70 tx=0x7f36b8008070 comp rx=0 tx=0).stop 2023-11-08T19:23:20.848 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.846+0000 7f36d5e09700 1 -- 172.21.15.149:0/1439140979 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36d0161670 msgr2=0x7f36d00b59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:20.848 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.846+0000 7f36d5e09700 1 --2- 172.21.15.149:0/1439140979 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36d0161670 0x7f36d00b59c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f36c0001eb0 tx=0x7f36c000c860 comp rx=0 tx=0).stop 2023-11-08T19:23:20.848 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.846+0000 7f36d5e09700 1 -- 172.21.15.149:0/1439140979 shutdown_connections 2023-11-08T19:23:20.848 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.846+0000 7f36d5e09700 1 --2- 172.21.15.149:0/1439140979 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f36b006af00 0x7f36b006d3c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:20.849 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.846+0000 7f36d5e09700 1 --2- 172.21.15.149:0/1439140979 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f36d0161a50 0x7f36d00b86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:20.849 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.846+0000 7f36d5e09700 1 --2- 172.21.15.149:0/1439140979 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f36d00ce500 0x7f36d009fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:20.849 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.846+0000 7f36d5e09700 1 --2- 172.21.15.149:0/1439140979 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36d0161670 0x7f36d00b59c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:20.849 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.846+0000 7f36d5e09700 1 -- 172.21.15.149:0/1439140979 >> 172.21.15.149:0/1439140979 conn(0x7f36d00d3980 msgr2=0x7f36d01607b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:20.849 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.846+0000 7f36d5e09700 1 -- 172.21.15.149:0/1439140979 shutdown_connections 2023-11-08T19:23:20.850 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.846+0000 7f36d5e09700 1 -- 172.21.15.149:0/1439140979 wait complete. 2023-11-08T19:23:20.860 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-08T19:23:20.860 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:23:20.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.980+0000 7fcede512700 1 Processor -- start 2023-11-08T19:23:20.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.980+0000 7fcede512700 1 -- start start 2023-11-08T19:23:20.984 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.981+0000 7fcede512700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fced806d690 0x7fced80cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:20.984 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.981+0000 7fcede512700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fced80cee00 con 0x7fced8158450 2023-11-08T19:23:20.984 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.981+0000 7fcede512700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fced80cc570 con 0x7fced806bb90 2023-11-08T19:23:20.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.981+0000 7fcede512700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fced80cbfb0 con 0x7fced806d690 2023-11-08T19:23:20.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.981+0000 7fced77fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fced806d690 0x7fced80cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:20.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.981+0000 7fced77fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fced806d690 0x7fced80cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37198/0 (socket says 172.21.15.149:37198) 2023-11-08T19:23:20.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.981+0000 7fced77fe700 1 -- 172.21.15.149:0/1889666867 learned_addr learned my addr 172.21.15.149:0/1889666867 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:20.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.982+0000 7fced77fe700 1 -- 172.21.15.149:0/1889666867 >> v1:172.21.15.160:6789/0 conn(0x7fced806bb90 legacy=0x7fced806efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:20.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.982+0000 7fced77fe700 1 -- 172.21.15.149:0/1889666867 >> v1:172.21.15.149:6789/0 conn(0x7fced8158450 legacy=0x7fced815b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:20.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.982+0000 7fced77fe700 1 -- 172.21.15.149:0/1889666867 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced80cc290 con 0x7fced806d690 2023-11-08T19:23:20.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.982+0000 7fced77fe700 1 --2- 172.21.15.149:0/1889666867 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fced806d690 0x7fced80cf290 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fcecc0098f0 tx=0x7fcecc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24854254bf7712af server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:20.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.982+0000 7fced6ffd700 1 -- 172.21.15.149:0/1889666867 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc00b8a0 con 0x7fced806d690 2023-11-08T19:23:20.987 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.982+0000 7fced6ffd700 1 -- 172.21.15.149:0/1889666867 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcecc00ba00 con 0x7fced806d690 2023-11-08T19:23:20.987 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.982+0000 7fced6ffd700 1 -- 172.21.15.149:0/1889666867 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc00bd90 con 0x7fced806d690 2023-11-08T19:23:20.987 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.982+0000 7fcede512700 1 -- 172.21.15.149:0/1889666867 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fced806d690 msgr2=0x7fced80cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:20.987 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.982+0000 7fcede512700 1 --2- 172.21.15.149:0/1889666867 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fced806d690 0x7fced80cf290 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fcecc0098f0 tx=0x7fcecc009c00 comp rx=0 tx=0).stop 2023-11-08T19:23:20.987 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.982+0000 7fcede512700 1 -- 172.21.15.149:0/1889666867 shutdown_connections 2023-11-08T19:23:20.988 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.982+0000 7fcede512700 1 --2- 172.21.15.149:0/1889666867 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fced806d690 0x7fced80cf290 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:20.988 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.982+0000 7fcede512700 1 -- 172.21.15.149:0/1889666867 >> 172.21.15.149:0/1889666867 conn(0x7fced8071670 msgr2=0x7fced8071a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:20.988 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.982+0000 7fcede512700 1 -- 172.21.15.149:0/1889666867 shutdown_connections 2023-11-08T19:23:20.988 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.982+0000 7fcede512700 1 -- 172.21.15.149:0/1889666867 wait complete. 2023-11-08T19:23:20.991 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.984+0000 7fcede512700 1 Processor -- start 2023-11-08T19:23:20.991 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.984+0000 7fcede512700 1 -- start start 2023-11-08T19:23:20.992 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.984+0000 7fcede512700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fced806bb90 0x7fced81502b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:20.992 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.984+0000 7fcede512700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fced806d690 0x7fced80c3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:20.992 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.984+0000 7fcede512700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fced8158450 0x7fced80b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:20.992 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.985+0000 7fcede512700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced81507f0 con 0x7fced806bb90 2023-11-08T19:23:20.992 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.985+0000 7fcede512700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced80c4110 con 0x7fced806d690 2023-11-08T19:23:20.993 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.985+0000 7fcede512700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fced80c4360 con 0x7fced8158450 2023-11-08T19:23:20.993 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.985+0000 7fced7fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fced806bb90 0x7fced81502b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:20.993 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.985+0000 7fced7fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fced806bb90 0x7fced81502b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37202/0 (socket says 172.21.15.149:37202) 2023-11-08T19:23:20.993 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.985+0000 7fced7fff700 1 -- 172.21.15.149:0/793259925 learned_addr learned my addr 172.21.15.149:0/793259925 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:20.993 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.985+0000 7fcedcaaf700 1 --2- 172.21.15.149:0/793259925 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fced8158450 0x7fced80b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:20.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.985+0000 7fced77fe700 1 --2- 172.21.15.149:0/793259925 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fced806d690 0x7fced80c3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:20.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.985+0000 7fced7fff700 1 -- 172.21.15.149:0/793259925 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fced8158450 msgr2=0x7fced80b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:20.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.985+0000 7fced7fff700 1 --2- 172.21.15.149:0/793259925 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fced8158450 0x7fced80b36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:20.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.985+0000 7fced7fff700 1 -- 172.21.15.149:0/793259925 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fced806d690 msgr2=0x7fced80c3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:20.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.985+0000 7fced7fff700 1 --2- 172.21.15.149:0/793259925 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fced806d690 0x7fced80c3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:20.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.985+0000 7fced7fff700 1 -- 172.21.15.149:0/793259925 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcecc009550 con 0x7fced806bb90 2023-11-08T19:23:20.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.985+0000 7fced77fe700 1 --2- 172.21.15.149:0/793259925 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fced806d690 0x7fced80c3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:23:20.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.985+0000 7fcedcaaf700 1 --2- 172.21.15.149:0/793259925 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fced8158450 0x7fced80b36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:23:20.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.985+0000 7fced7fff700 1 --2- 172.21.15.149:0/793259925 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fced806bb90 0x7fced81502b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fcec800c450 tx=0x7fcec800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:20.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.985+0000 7fced4ff9700 1 -- 172.21.15.149:0/793259925 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec80052d0 con 0x7fced806bb90 2023-11-08T19:23:20.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.985+0000 7fced4ff9700 1 -- 172.21.15.149:0/793259925 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcec8005430 con 0x7fced806bb90 2023-11-08T19:23:20.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.985+0000 7fcede512700 1 -- 172.21.15.149:0/793259925 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fced80c4640 con 0x7fced806bb90 2023-11-08T19:23:20.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.985+0000 7fced4ff9700 1 -- 172.21.15.149:0/793259925 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec80038c0 con 0x7fced806bb90 2023-11-08T19:23:20.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.985+0000 7fcede512700 1 -- 172.21.15.149:0/793259925 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fced8151850 con 0x7fced806bb90 2023-11-08T19:23:20.997 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.986+0000 7fcede512700 1 -- 172.21.15.149:0/793259925 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fced8151a40 con 0x7fced806bb90 2023-11-08T19:23:20.997 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.987+0000 7fced4ff9700 1 -- 172.21.15.149:0/793259925 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcec8003a20 con 0x7fced806bb90 2023-11-08T19:23:20.997 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.987+0000 7fced4ff9700 1 --2- 172.21.15.149:0/793259925 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fcec406af50 0x7fcec406d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:20.997 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.987+0000 7fced4ff9700 1 -- 172.21.15.149:0/793259925 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcec8088b00 con 0x7fced806bb90 2023-11-08T19:23:20.997 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.987+0000 7fced77fe700 1 --2- 172.21.15.149:0/793259925 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fcec406af50 0x7fcec406d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:20.998 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.987+0000 7fced77fe700 1 --2- 172.21.15.149:0/793259925 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fcec406af50 0x7fcec406d410 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcecc009c40 tx=0x7fcecc008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:20.998 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:20.992+0000 7fced4ff9700 1 -- 172.21.15.149:0/793259925 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcec8053a30 con 0x7fced806bb90 2023-11-08T19:23:21.180 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.179+0000 7fcede512700 1 -- 172.21.15.149:0/793259925 --> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fced8158830 con 0x7fcec406af50 2023-11-08T19:23:21.190 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.189+0000 7fced4ff9700 1 -- 172.21.15.149:0/793259925 <== mgr.4104 v2:172.21.15.149:6832/1929837472 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345300 (secure 0 0 0) 0x7fcecc00bc70 con 0x7fcec406af50 2023-11-08T19:23:21.194 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:23:21.197 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.192+0000 7fcede512700 1 -- 172.21.15.149:0/793259925 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fcec406af50 msgr2=0x7fcec406d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:21.198 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.192+0000 7fcede512700 1 --2- 172.21.15.149:0/793259925 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fcec406af50 0x7fcec406d410 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcecc009c40 tx=0x7fcecc008030 comp rx=0 tx=0).stop 2023-11-08T19:23:21.198 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.192+0000 7fcede512700 1 -- 172.21.15.149:0/793259925 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fced806bb90 msgr2=0x7fced81502b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:21.198 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.192+0000 7fcede512700 1 --2- 172.21.15.149:0/793259925 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fced806bb90 0x7fced81502b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fcec800c450 tx=0x7fcec800c810 comp rx=0 tx=0).stop 2023-11-08T19:23:21.198 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.192+0000 7fcede512700 1 -- 172.21.15.149:0/793259925 shutdown_connections 2023-11-08T19:23:21.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.192+0000 7fcede512700 1 --2- 172.21.15.149:0/793259925 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fcec406af50 0x7fcec406d410 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:21.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.192+0000 7fcede512700 1 --2- 172.21.15.149:0/793259925 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fced8158450 0x7fced80b36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:21.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.192+0000 7fcede512700 1 --2- 172.21.15.149:0/793259925 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fced806bb90 0x7fced81502b0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:21.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.192+0000 7fcede512700 1 --2- 172.21.15.149:0/793259925 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fced806d690 0x7fced80c3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:21.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.192+0000 7fcede512700 1 -- 172.21.15.149:0/793259925 >> 172.21.15.149:0/793259925 conn(0x7fced8071670 msgr2=0x7fced806dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:21.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.192+0000 7fcede512700 1 -- 172.21.15.149:0/793259925 shutdown_connections 2023-11-08T19:23:21.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.192+0000 7fcede512700 1 -- 172.21.15.149:0/793259925 wait complete. 2023-11-08T19:23:21.200 INFO:teuthology.orchestra.run.smithi149.stderr:dumped all 2023-11-08T19:23:21.206 INFO:teuthology.orchestra.run.smithi149.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2023-11-08T19:23:19.988553+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594867,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219384,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755336,"statfs":{"total":773094113280,"available":772869464064,"internally_reserved":0,"allocated":3284992,"data_stored":1988070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2089,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002615"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.640463+0000","last_change":"2023-11-08T19:23:02.552058+0000","last_active":"2023-11-08T19:23:06.640463+0000","last_peered":"2023-11-08T19:23:06.640463+0000","last_clean":"2023-11-08T19:23:06.640463+0000","last_became_active":"2023-11-08T19:23:02.551489+0000","last_became_peered":"2023-11-08T19:23:02.551489+0000","last_unstale":"2023-11-08T19:23:06.640463+0000","last_undegraded":"2023-11-08T19:23:06.640463+0000","last_fullsized":"2023-11-08T19:23:06.640463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:22:41.593963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.564907+0000","last_change":"2023-11-08T19:23:02.538323+0000","last_active":"2023-11-08T19:23:06.564907+0000","last_peered":"2023-11-08T19:23:06.564907+0000","last_clean":"2023-11-08T19:23:06.564907+0000","last_became_active":"2023-11-08T19:23:02.537940+0000","last_became_peered":"2023-11-08T19:23:02.537940+0000","last_unstale":"2023-11-08T19:23:06.564907+0000","last_undegraded":"2023-11-08T19:23:06.564907+0000","last_fullsized":"2023-11-08T19:23:06.564907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:04:20.812993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.578295+0000","last_change":"2023-11-08T19:23:02.536079+0000","last_active":"2023-11-08T19:23:06.578295+0000","last_peered":"2023-11-08T19:23:06.578295+0000","last_clean":"2023-11-08T19:23:06.578295+0000","last_became_active":"2023-11-08T19:23:02.535824+0000","last_became_peered":"2023-11-08T19:23:02.535824+0000","last_unstale":"2023-11-08T19:23:06.578295+0000","last_undegraded":"2023-11-08T19:23:06.578295+0000","last_fullsized":"2023-11-08T19:23:06.578295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:29:40.895783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.575728+0000","last_change":"2023-11-08T19:23:02.540491+0000","last_active":"2023-11-08T19:23:06.575728+0000","last_peered":"2023-11-08T19:23:06.575728+0000","last_clean":"2023-11-08T19:23:06.575728+0000","last_became_active":"2023-11-08T19:23:02.540012+0000","last_became_peered":"2023-11-08T19:23:02.540012+0000","last_unstale":"2023-11-08T19:23:06.575728+0000","last_undegraded":"2023-11-08T19:23:06.575728+0000","last_fullsized":"2023-11-08T19:23:06.575728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:15:23.194339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.639456+0000","last_change":"2023-11-08T19:23:02.544395+0000","last_active":"2023-11-08T19:23:06.639456+0000","last_peered":"2023-11-08T19:23:06.639456+0000","last_clean":"2023-11-08T19:23:06.639456+0000","last_became_active":"2023-11-08T19:23:02.544103+0000","last_became_peered":"2023-11-08T19:23:02.544103+0000","last_unstale":"2023-11-08T19:23:06.639456+0000","last_undegraded":"2023-11-08T19:23:06.639456+0000","last_fullsized":"2023-11-08T19:23:06.639456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:47:36.694344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.575191+0000","last_change":"2023-11-08T19:23:02.545064+0000","last_active":"2023-11-08T19:23:06.575191+0000","last_peered":"2023-11-08T19:23:06.575191+0000","last_clean":"2023-11-08T19:23:06.575191+0000","last_became_active":"2023-11-08T19:23:02.544254+0000","last_became_peered":"2023-11-08T19:23:02.544254+0000","last_unstale":"2023-11-08T19:23:06.575191+0000","last_undegraded":"2023-11-08T19:23:06.575191+0000","last_fullsized":"2023-11-08T19:23:06.575191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:00:48.690189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.637334+0000","last_change":"2023-11-08T19:23:02.542877+0000","last_active":"2023-11-08T19:23:06.637334+0000","last_peered":"2023-11-08T19:23:06.637334+0000","last_clean":"2023-11-08T19:23:06.637334+0000","last_became_active":"2023-11-08T19:23:02.542587+0000","last_became_peered":"2023-11-08T19:23:02.542587+0000","last_unstale":"2023-11-08T19:23:06.637334+0000","last_undegraded":"2023-11-08T19:23:06.637334+0000","last_fullsized":"2023-11-08T19:23:06.637334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:15:23.194339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.571114+0000","last_change":"2023-11-08T19:23:02.537658+0000","last_active":"2023-11-08T19:23:06.571114+0000","last_peered":"2023-11-08T19:23:06.571114+0000","last_clean":"2023-11-08T19:23:06.571114+0000","last_became_active":"2023-11-08T19:23:02.537389+0000","last_became_peered":"2023-11-08T19:23:02.537389+0000","last_unstale":"2023-11-08T19:23:06.571114+0000","last_undegraded":"2023-11-08T19:23:06.571114+0000","last_fullsized":"2023-11-08T19:23:06.571114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:29:40.895783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.640351+0000","last_change":"2023-11-08T19:23:02.551031+0000","last_active":"2023-11-08T19:23:06.640351+0000","last_peered":"2023-11-08T19:23:06.640351+0000","last_clean":"2023-11-08T19:23:06.640351+0000","last_became_active":"2023-11-08T19:23:02.550631+0000","last_became_peered":"2023-11-08T19:23:02.550631+0000","last_unstale":"2023-11-08T19:23:06.640351+0000","last_undegraded":"2023-11-08T19:23:06.640351+0000","last_fullsized":"2023-11-08T19:23:06.640351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:02:18.865355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.566140+0000","last_change":"2023-11-08T19:23:02.539521+0000","last_active":"2023-11-08T19:23:06.566140+0000","last_peered":"2023-11-08T19:23:06.566140+0000","last_clean":"2023-11-08T19:23:06.566140+0000","last_became_active":"2023-11-08T19:23:02.539252+0000","last_became_peered":"2023-11-08T19:23:02.539252+0000","last_unstale":"2023-11-08T19:23:06.566140+0000","last_undegraded":"2023-11-08T19:23:06.566140+0000","last_fullsized":"2023-11-08T19:23:06.566140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:44:38.109774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.565944+0000","last_change":"2023-11-08T19:23:02.548230+0000","last_active":"2023-11-08T19:23:06.565944+0000","last_peered":"2023-11-08T19:23:06.565944+0000","last_clean":"2023-11-08T19:23:06.565944+0000","last_became_active":"2023-11-08T19:23:02.547980+0000","last_became_peered":"2023-11-08T19:23:02.547980+0000","last_unstale":"2023-11-08T19:23:06.565944+0000","last_undegraded":"2023-11-08T19:23:06.565944+0000","last_fullsized":"2023-11-08T19:23:06.565944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:24:27.669240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.569454+0000","last_change":"2023-11-08T19:23:02.550957+0000","last_active":"2023-11-08T19:23:06.569454+0000","last_peered":"2023-11-08T19:23:06.569454+0000","last_clean":"2023-11-08T19:23:06.569454+0000","last_became_active":"2023-11-08T19:23:02.550071+0000","last_became_peered":"2023-11-08T19:23:02.550071+0000","last_unstale":"2023-11-08T19:23:06.569454+0000","last_undegraded":"2023-11-08T19:23:06.569454+0000","last_fullsized":"2023-11-08T19:23:06.569454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:08:24.771220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.573212+0000","last_change":"2023-11-08T19:23:02.547356+0000","last_active":"2023-11-08T19:23:06.573212+0000","last_peered":"2023-11-08T19:23:06.573212+0000","last_clean":"2023-11-08T19:23:06.573212+0000","last_became_active":"2023-11-08T19:23:02.546568+0000","last_became_peered":"2023-11-08T19:23:02.546568+0000","last_unstale":"2023-11-08T19:23:06.573212+0000","last_undegraded":"2023-11-08T19:23:06.573212+0000","last_fullsized":"2023-11-08T19:23:06.573212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:49:46.796904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.580399+0000","last_change":"2023-11-08T19:23:02.538938+0000","last_active":"2023-11-08T19:23:06.580399+0000","last_peered":"2023-11-08T19:23:06.580399+0000","last_clean":"2023-11-08T19:23:06.580399+0000","last_became_active":"2023-11-08T19:23:02.538598+0000","last_became_peered":"2023-11-08T19:23:02.538598+0000","last_unstale":"2023-11-08T19:23:06.580399+0000","last_undegraded":"2023-11-08T19:23:06.580399+0000","last_fullsized":"2023-11-08T19:23:06.580399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:52:27.899698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.563911+0000","last_change":"2023-11-08T19:23:02.543136+0000","last_active":"2023-11-08T19:23:06.563911+0000","last_peered":"2023-11-08T19:23:06.563911+0000","last_clean":"2023-11-08T19:23:06.563911+0000","last_became_active":"2023-11-08T19:23:02.542868+0000","last_became_peered":"2023-11-08T19:23:02.542868+0000","last_unstale":"2023-11-08T19:23:06.563911+0000","last_undegraded":"2023-11-08T19:23:06.563911+0000","last_fullsized":"2023-11-08T19:23:06.563911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:49:46.796904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.574507+0000","last_change":"2023-11-08T19:23:02.541251+0000","last_active":"2023-11-08T19:23:06.574507+0000","last_peered":"2023-11-08T19:23:06.574507+0000","last_clean":"2023-11-08T19:23:06.574507+0000","last_became_active":"2023-11-08T19:23:02.540921+0000","last_became_peered":"2023-11-08T19:23:02.540921+0000","last_unstale":"2023-11-08T19:23:06.574507+0000","last_undegraded":"2023-11-08T19:23:06.574507+0000","last_fullsized":"2023-11-08T19:23:06.574507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:32:49.846143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.576611+0000","last_change":"2023-11-08T19:23:02.543682+0000","last_active":"2023-11-08T19:23:06.576611+0000","last_peered":"2023-11-08T19:23:06.576611+0000","last_clean":"2023-11-08T19:23:06.576611+0000","last_became_active":"2023-11-08T19:23:02.543385+0000","last_became_peered":"2023-11-08T19:23:02.543385+0000","last_unstale":"2023-11-08T19:23:06.576611+0000","last_undegraded":"2023-11-08T19:23:06.576611+0000","last_fullsized":"2023-11-08T19:23:06.576611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:47:36.694344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.575179+0000","last_change":"2023-11-08T19:23:02.547263+0000","last_active":"2023-11-08T19:23:06.575179+0000","last_peered":"2023-11-08T19:23:06.575179+0000","last_clean":"2023-11-08T19:23:06.575179+0000","last_became_active":"2023-11-08T19:23:02.546954+0000","last_became_peered":"2023-11-08T19:23:02.546954+0000","last_unstale":"2023-11-08T19:23:06.575179+0000","last_undegraded":"2023-11-08T19:23:06.575179+0000","last_fullsized":"2023-11-08T19:23:06.575179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:08:24.771220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.639865+0000","last_change":"2023-11-08T19:23:02.544942+0000","last_active":"2023-11-08T19:23:06.639865+0000","last_peered":"2023-11-08T19:23:06.639865+0000","last_clean":"2023-11-08T19:23:06.639865+0000","last_became_active":"2023-11-08T19:23:02.544398+0000","last_became_peered":"2023-11-08T19:23:02.544398+0000","last_unstale":"2023-11-08T19:23:06.639865+0000","last_undegraded":"2023-11-08T19:23:06.639865+0000","last_fullsized":"2023-11-08T19:23:06.639865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:11:14.699967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.015793+0000","last_change":"2023-11-08T19:23:06.643772+0000","last_active":"2023-11-08T19:23:09.015793+0000","last_peered":"2023-11-08T19:23:09.015793+0000","last_clean":"2023-11-08T19:23:09.015793+0000","last_became_active":"2023-11-08T19:23:06.643399+0000","last_became_peered":"2023-11-08T19:23:06.643399+0000","last_unstale":"2023-11-08T19:23:09.015793+0000","last_undegraded":"2023-11-08T19:23:09.015793+0000","last_fullsized":"2023-11-08T19:23:09.015793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:28:31.147987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.579108+0000","last_change":"2023-11-08T19:23:01.541807+0000","last_active":"2023-11-08T19:23:06.579108+0000","last_peered":"2023-11-08T19:23:06.579108+0000","last_clean":"2023-11-08T19:23:06.579108+0000","last_became_active":"2023-11-08T19:23:01.541518+0000","last_became_peered":"2023-11-08T19:23:01.541518+0000","last_unstale":"2023-11-08T19:23:06.579108+0000","last_undegraded":"2023-11-08T19:23:06.579108+0000","last_fullsized":"2023-11-08T19:23:06.579108+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:44:28.225190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.571988+0000","last_change":"2023-11-08T19:23:02.546804+0000","last_active":"2023-11-08T19:23:06.571988+0000","last_peered":"2023-11-08T19:23:06.571988+0000","last_clean":"2023-11-08T19:23:06.571988+0000","last_became_active":"2023-11-08T19:23:02.546539+0000","last_became_peered":"2023-11-08T19:23:02.546539+0000","last_unstale":"2023-11-08T19:23:06.571988+0000","last_undegraded":"2023-11-08T19:23:06.571988+0000","last_fullsized":"2023-11-08T19:23:06.571988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:11:14.699967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:07.567784+0000","last_change":"2023-11-08T19:23:06.590879+0000","last_active":"2023-11-08T19:23:07.567784+0000","last_peered":"2023-11-08T19:23:07.567784+0000","last_clean":"2023-11-08T19:23:07.567784+0000","last_became_active":"2023-11-08T19:23:06.590413+0000","last_became_peered":"2023-11-08T19:23:06.590413+0000","last_unstale":"2023-11-08T19:23:07.567784+0000","last_undegraded":"2023-11-08T19:23:07.567784+0000","last_fullsized":"2023-11-08T19:23:07.567784+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:07:43.895729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.572075+0000","last_change":"2023-11-08T19:23:01.539505+0000","last_active":"2023-11-08T19:23:06.572075+0000","last_peered":"2023-11-08T19:23:06.572075+0000","last_clean":"2023-11-08T19:23:06.572075+0000","last_became_active":"2023-11-08T19:23:01.539253+0000","last_became_peered":"2023-11-08T19:23:01.539253+0000","last_unstale":"2023-11-08T19:23:06.572075+0000","last_undegraded":"2023-11-08T19:23:06.572075+0000","last_fullsized":"2023-11-08T19:23:06.572075+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:43:54.669075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.578908+0000","last_change":"2023-11-08T19:23:02.541207+0000","last_active":"2023-11-08T19:23:06.578908+0000","last_peered":"2023-11-08T19:23:06.578908+0000","last_clean":"2023-11-08T19:23:06.578908+0000","last_became_active":"2023-11-08T19:23:02.541002+0000","last_became_peered":"2023-11-08T19:23:02.541002+0000","last_unstale":"2023-11-08T19:23:06.578908+0000","last_undegraded":"2023-11-08T19:23:06.578908+0000","last_fullsized":"2023-11-08T19:23:06.578908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:49:46.796904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:07.568103+0000","last_change":"2023-11-08T19:23:06.586229+0000","last_active":"2023-11-08T19:23:07.568103+0000","last_peered":"2023-11-08T19:23:07.568103+0000","last_clean":"2023-11-08T19:23:07.568103+0000","last_became_active":"2023-11-08T19:23:06.585784+0000","last_became_peered":"2023-11-08T19:23:06.585784+0000","last_unstale":"2023-11-08T19:23:07.568103+0000","last_undegraded":"2023-11-08T19:23:07.568103+0000","last_fullsized":"2023-11-08T19:23:07.568103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:47:40.737231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.639721+0000","last_change":"2023-11-08T19:23:01.541701+0000","last_active":"2023-11-08T19:23:06.639721+0000","last_peered":"2023-11-08T19:23:06.639721+0000","last_clean":"2023-11-08T19:23:06.639721+0000","last_became_active":"2023-11-08T19:23:01.541392+0000","last_became_peered":"2023-11-08T19:23:01.541392+0000","last_unstale":"2023-11-08T19:23:06.639721+0000","last_undegraded":"2023-11-08T19:23:06.639721+0000","last_fullsized":"2023-11-08T19:23:06.639721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:57:50.009215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.575956+0000","last_change":"2023-11-08T19:23:02.543734+0000","last_active":"2023-11-08T19:23:06.575956+0000","last_peered":"2023-11-08T19:23:06.575956+0000","last_clean":"2023-11-08T19:23:06.575956+0000","last_became_active":"2023-11-08T19:23:02.543300+0000","last_became_peered":"2023-11-08T19:23:02.543300+0000","last_unstale":"2023-11-08T19:23:06.575956+0000","last_undegraded":"2023-11-08T19:23:06.575956+0000","last_fullsized":"2023-11-08T19:23:06.575956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:50:33.507433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:07.566641+0000","last_change":"2023-11-08T19:23:06.590258+0000","last_active":"2023-11-08T19:23:07.566641+0000","last_peered":"2023-11-08T19:23:07.566641+0000","last_clean":"2023-11-08T19:23:07.566641+0000","last_became_active":"2023-11-08T19:23:06.589825+0000","last_became_peered":"2023-11-08T19:23:06.589825+0000","last_unstale":"2023-11-08T19:23:07.566641+0000","last_undegraded":"2023-11-08T19:23:07.566641+0000","last_fullsized":"2023-11-08T19:23:07.566641+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:56:06.637086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.640110+0000","last_change":"2023-11-08T19:23:01.543094+0000","last_active":"2023-11-08T19:23:06.640110+0000","last_peered":"2023-11-08T19:23:06.640110+0000","last_clean":"2023-11-08T19:23:06.640110+0000","last_became_active":"2023-11-08T19:23:01.542832+0000","last_became_peered":"2023-11-08T19:23:01.542832+0000","last_unstale":"2023-11-08T19:23:06.640110+0000","last_undegraded":"2023-11-08T19:23:06.640110+0000","last_fullsized":"2023-11-08T19:23:06.640110+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:08:23.765251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.575939+0000","last_change":"2023-11-08T19:23:02.543389+0000","last_active":"2023-11-08T19:23:06.575939+0000","last_peered":"2023-11-08T19:23:06.575939+0000","last_clean":"2023-11-08T19:23:06.575939+0000","last_became_active":"2023-11-08T19:23:02.543095+0000","last_became_peered":"2023-11-08T19:23:02.543095+0000","last_unstale":"2023-11-08T19:23:06.575939+0000","last_undegraded":"2023-11-08T19:23:06.575939+0000","last_fullsized":"2023-11-08T19:23:06.575939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:44:38.109774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.015608+0000","last_change":"2023-11-08T19:23:06.590901+0000","last_active":"2023-11-08T19:23:09.015608+0000","last_peered":"2023-11-08T19:23:09.015608+0000","last_clean":"2023-11-08T19:23:09.015608+0000","last_became_active":"2023-11-08T19:23:06.590468+0000","last_became_peered":"2023-11-08T19:23:06.590468+0000","last_unstale":"2023-11-08T19:23:09.015608+0000","last_undegraded":"2023-11-08T19:23:09.015608+0000","last_fullsized":"2023-11-08T19:23:09.015608+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:58:51.442881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.573313+0000","last_change":"2023-11-08T19:23:01.540429+0000","last_active":"2023-11-08T19:23:06.573313+0000","last_peered":"2023-11-08T19:23:06.573313+0000","last_clean":"2023-11-08T19:23:06.573313+0000","last_became_active":"2023-11-08T19:23:01.540170+0000","last_became_peered":"2023-11-08T19:23:01.540170+0000","last_unstale":"2023-11-08T19:23:06.573313+0000","last_undegraded":"2023-11-08T19:23:06.573313+0000","last_fullsized":"2023-11-08T19:23:06.573313+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:52:26.893730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.572037+0000","last_change":"2023-11-08T19:23:02.550930+0000","last_active":"2023-11-08T19:23:06.572037+0000","last_peered":"2023-11-08T19:23:06.572037+0000","last_clean":"2023-11-08T19:23:06.572037+0000","last_became_active":"2023-11-08T19:23:02.549412+0000","last_became_peered":"2023-11-08T19:23:02.549412+0000","last_unstale":"2023-11-08T19:23:06.572037+0000","last_undegraded":"2023-11-08T19:23:06.572037+0000","last_fullsized":"2023-11-08T19:23:06.572037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:07:17.652260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:07.565865+0000","last_change":"2023-11-08T19:23:06.593062+0000","last_active":"2023-11-08T19:23:07.565865+0000","last_peered":"2023-11-08T19:23:07.565865+0000","last_clean":"2023-11-08T19:23:07.565865+0000","last_became_active":"2023-11-08T19:23:06.592681+0000","last_became_peered":"2023-11-08T19:23:06.592681+0000","last_unstale":"2023-11-08T19:23:07.565865+0000","last_undegraded":"2023-11-08T19:23:07.565865+0000","last_fullsized":"2023-11-08T19:23:07.565865+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:43:59.717931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.565314+0000","last_change":"2023-11-08T19:23:01.532560+0000","last_active":"2023-11-08T19:23:06.565314+0000","last_peered":"2023-11-08T19:23:06.565314+0000","last_clean":"2023-11-08T19:23:06.565314+0000","last_became_active":"2023-11-08T19:23:01.532281+0000","last_became_peered":"2023-11-08T19:23:01.532281+0000","last_unstale":"2023-11-08T19:23:06.565314+0000","last_undegraded":"2023-11-08T19:23:06.565314+0000","last_fullsized":"2023-11-08T19:23:06.565314+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:43:54.669075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.579248+0000","last_change":"2023-11-08T19:23:02.536527+0000","last_active":"2023-11-08T19:23:06.579248+0000","last_peered":"2023-11-08T19:23:06.579248+0000","last_clean":"2023-11-08T19:23:06.579248+0000","last_became_active":"2023-11-08T19:23:02.535739+0000","last_became_peered":"2023-11-08T19:23:02.535739+0000","last_unstale":"2023-11-08T19:23:06.579248+0000","last_undegraded":"2023-11-08T19:23:06.579248+0000","last_fullsized":"2023-11-08T19:23:06.579248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:04:20.812993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:07.567254+0000","last_change":"2023-11-08T19:23:06.586558+0000","last_active":"2023-11-08T19:23:07.567254+0000","last_peered":"2023-11-08T19:23:07.567254+0000","last_clean":"2023-11-08T19:23:07.567254+0000","last_became_active":"2023-11-08T19:23:06.586151+0000","last_became_peered":"2023-11-08T19:23:06.586151+0000","last_unstale":"2023-11-08T19:23:07.567254+0000","last_undegraded":"2023-11-08T19:23:07.567254+0000","last_fullsized":"2023-11-08T19:23:07.567254+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:57:36.344289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.570862+0000","last_change":"2023-11-08T19:23:01.535020+0000","last_active":"2023-11-08T19:23:06.570862+0000","last_peered":"2023-11-08T19:23:06.570862+0000","last_clean":"2023-11-08T19:23:06.570862+0000","last_became_active":"2023-11-08T19:23:01.534728+0000","last_became_peered":"2023-11-08T19:23:01.534728+0000","last_unstale":"2023-11-08T19:23:06.570862+0000","last_undegraded":"2023-11-08T19:23:06.570862+0000","last_fullsized":"2023-11-08T19:23:06.570862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:08:23.765251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.570908+0000","last_change":"2023-11-08T19:23:02.531826+0000","last_active":"2023-11-08T19:23:06.570908+0000","last_peered":"2023-11-08T19:23:06.570908+0000","last_clean":"2023-11-08T19:23:06.570908+0000","last_became_active":"2023-11-08T19:23:02.530174+0000","last_became_peered":"2023-11-08T19:23:02.530174+0000","last_unstale":"2023-11-08T19:23:06.570908+0000","last_undegraded":"2023-11-08T19:23:06.570908+0000","last_fullsized":"2023-11-08T19:23:06.570908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:57:51.015184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.014696+0000","last_change":"2023-11-08T19:23:06.641030+0000","last_active":"2023-11-08T19:23:09.014696+0000","last_peered":"2023-11-08T19:23:09.014696+0000","last_clean":"2023-11-08T19:23:09.014696+0000","last_became_active":"2023-11-08T19:23:06.640656+0000","last_became_peered":"2023-11-08T19:23:06.640656+0000","last_unstale":"2023-11-08T19:23:09.014696+0000","last_undegraded":"2023-11-08T19:23:09.014696+0000","last_fullsized":"2023-11-08T19:23:09.014696+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:12:02.136296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.574607+0000","last_change":"2023-11-08T19:23:01.529713+0000","last_active":"2023-11-08T19:23:06.574607+0000","last_peered":"2023-11-08T19:23:06.574607+0000","last_clean":"2023-11-08T19:23:06.574607+0000","last_became_active":"2023-11-08T19:23:01.528648+0000","last_became_peered":"2023-11-08T19:23:01.528648+0000","last_unstale":"2023-11-08T19:23:06.574607+0000","last_undegraded":"2023-11-08T19:23:06.574607+0000","last_fullsized":"2023-11-08T19:23:06.574607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:01:16.688194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.564020+0000","last_change":"2023-11-08T19:23:02.535673+0000","last_active":"2023-11-08T19:23:06.564020+0000","last_peered":"2023-11-08T19:23:06.564020+0000","last_clean":"2023-11-08T19:23:06.564020+0000","last_became_active":"2023-11-08T19:23:02.535411+0000","last_became_peered":"2023-11-08T19:23:02.535411+0000","last_unstale":"2023-11-08T19:23:06.564020+0000","last_undegraded":"2023-11-08T19:23:06.564020+0000","last_fullsized":"2023-11-08T19:23:06.564020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:56:02.594198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.015406+0000","last_change":"2023-11-08T19:23:06.643953+0000","last_active":"2023-11-08T19:23:09.015406+0000","last_peered":"2023-11-08T19:23:09.015406+0000","last_clean":"2023-11-08T19:23:09.015406+0000","last_became_active":"2023-11-08T19:23:06.643457+0000","last_became_peered":"2023-11-08T19:23:06.643457+0000","last_unstale":"2023-11-08T19:23:09.015406+0000","last_undegraded":"2023-11-08T19:23:09.015406+0000","last_fullsized":"2023-11-08T19:23:09.015406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:04:23.883480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.569588+0000","last_change":"2023-11-08T19:23:01.535403+0000","last_active":"2023-11-08T19:23:06.569588+0000","last_peered":"2023-11-08T19:23:06.569588+0000","last_clean":"2023-11-08T19:23:06.569588+0000","last_became_active":"2023-11-08T19:23:01.535102+0000","last_became_peered":"2023-11-08T19:23:01.535102+0000","last_unstale":"2023-11-08T19:23:06.569588+0000","last_undegraded":"2023-11-08T19:23:06.569588+0000","last_fullsized":"2023-11-08T19:23:06.569588+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:55.765637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.575598+0000","last_change":"2023-11-08T19:23:02.543531+0000","last_active":"2023-11-08T19:23:06.575598+0000","last_peered":"2023-11-08T19:23:06.575598+0000","last_clean":"2023-11-08T19:23:06.575598+0000","last_became_active":"2023-11-08T19:23:02.543160+0000","last_became_peered":"2023-11-08T19:23:02.543160+0000","last_unstale":"2023-11-08T19:23:06.575598+0000","last_undegraded":"2023-11-08T19:23:06.575598+0000","last_fullsized":"2023-11-08T19:23:06.575598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:04:20.812993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.014869+0000","last_change":"2023-11-08T19:23:06.589913+0000","last_active":"2023-11-08T19:23:09.014869+0000","last_peered":"2023-11-08T19:23:09.014869+0000","last_clean":"2023-11-08T19:23:09.014869+0000","last_became_active":"2023-11-08T19:23:06.589510+0000","last_became_peered":"2023-11-08T19:23:06.589510+0000","last_unstale":"2023-11-08T19:23:09.014869+0000","last_undegraded":"2023-11-08T19:23:09.014869+0000","last_fullsized":"2023-11-08T19:23:09.014869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:14:35.302430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.575682+0000","last_change":"2023-11-08T19:23:01.533936+0000","last_active":"2023-11-08T19:23:06.575682+0000","last_peered":"2023-11-08T19:23:06.575682+0000","last_clean":"2023-11-08T19:23:06.575682+0000","last_became_active":"2023-11-08T19:23:01.533445+0000","last_became_peered":"2023-11-08T19:23:01.533445+0000","last_unstale":"2023-11-08T19:23:06.575682+0000","last_undegraded":"2023-11-08T19:23:06.575682+0000","last_fullsized":"2023-11-08T19:23:06.575682+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:24:26.663271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.579037+0000","last_change":"2023-11-08T19:23:02.541241+0000","last_active":"2023-11-08T19:23:06.579037+0000","last_peered":"2023-11-08T19:23:06.579037+0000","last_clean":"2023-11-08T19:23:06.579037+0000","last_became_active":"2023-11-08T19:23:02.540969+0000","last_became_peered":"2023-11-08T19:23:02.540969+0000","last_unstale":"2023-11-08T19:23:06.579037+0000","last_undegraded":"2023-11-08T19:23:06.579037+0000","last_fullsized":"2023-11-08T19:23:06.579037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:32:49.846143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:07.568360+0000","last_change":"2023-11-08T19:23:06.585996+0000","last_active":"2023-11-08T19:23:07.568360+0000","last_peered":"2023-11-08T19:23:07.568360+0000","last_clean":"2023-11-08T19:23:07.568360+0000","last_became_active":"2023-11-08T19:23:06.585579+0000","last_became_peered":"2023-11-08T19:23:06.585579+0000","last_unstale":"2023-11-08T19:23:07.568360+0000","last_undegraded":"2023-11-08T19:23:07.568360+0000","last_fullsized":"2023-11-08T19:23:07.568360+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:00:52.733076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.565054+0000","last_change":"2023-11-08T19:23:01.536963+0000","last_active":"2023-11-08T19:23:06.565054+0000","last_peered":"2023-11-08T19:23:06.565054+0000","last_clean":"2023-11-08T19:23:06.565054+0000","last_became_active":"2023-11-08T19:23:01.536702+0000","last_became_peered":"2023-11-08T19:23:01.536702+0000","last_unstale":"2023-11-08T19:23:06.565054+0000","last_undegraded":"2023-11-08T19:23:06.565054+0000","last_fullsized":"2023-11-08T19:23:06.565054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:08:23.765251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.569403+0000","last_change":"2023-11-08T19:23:02.544062+0000","last_active":"2023-11-08T19:23:06.569403+0000","last_peered":"2023-11-08T19:23:06.569403+0000","last_clean":"2023-11-08T19:23:06.569403+0000","last_became_active":"2023-11-08T19:23:02.543731+0000","last_became_peered":"2023-11-08T19:23:02.543731+0000","last_unstale":"2023-11-08T19:23:06.569403+0000","last_undegraded":"2023-11-08T19:23:06.569403+0000","last_fullsized":"2023-11-08T19:23:06.569403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:47:08.776316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.014631+0000","last_change":"2023-11-08T19:23:06.586643+0000","last_active":"2023-11-08T19:23:09.014631+0000","last_peered":"2023-11-08T19:23:09.014631+0000","last_clean":"2023-11-08T19:23:09.014631+0000","last_became_active":"2023-11-08T19:23:06.586257+0000","last_became_peered":"2023-11-08T19:23:06.586257+0000","last_unstale":"2023-11-08T19:23:09.014631+0000","last_undegraded":"2023-11-08T19:23:09.014631+0000","last_fullsized":"2023-11-08T19:23:09.014631+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:22:45.636851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"24'8","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:11.805804+0000","last_change":"2023-11-08T19:23:01.537108+0000","last_active":"2023-11-08T19:23:11.805804+0000","last_peered":"2023-11-08T19:23:11.805804+0000","last_clean":"2023-11-08T19:23:11.805804+0000","last_became_active":"2023-11-08T19:23:01.536695+0000","last_became_peered":"2023-11-08T19:23:01.536695+0000","last_unstale":"2023-11-08T19:23:11.805804+0000","last_undegraded":"2023-11-08T19:23:11.805804+0000","last_fullsized":"2023-11-08T19:23:11.805804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:49:45.790935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3701,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.639812+0000","last_change":"2023-11-08T19:23:02.544703+0000","last_active":"2023-11-08T19:23:06.639812+0000","last_peered":"2023-11-08T19:23:06.639812+0000","last_clean":"2023-11-08T19:23:06.639812+0000","last_became_active":"2023-11-08T19:23:02.543964+0000","last_became_peered":"2023-11-08T19:23:02.543964+0000","last_unstale":"2023-11-08T19:23:06.639812+0000","last_undegraded":"2023-11-08T19:23:06.639812+0000","last_fullsized":"2023-11-08T19:23:06.639812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:07:39.852842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.015350+0000","last_change":"2023-11-08T19:23:06.639882+0000","last_active":"2023-11-08T19:23:09.015350+0000","last_peered":"2023-11-08T19:23:09.015350+0000","last_clean":"2023-11-08T19:23:09.015350+0000","last_became_active":"2023-11-08T19:23:06.639513+0000","last_became_peered":"2023-11-08T19:23:06.639513+0000","last_unstale":"2023-11-08T19:23:09.015350+0000","last_undegraded":"2023-11-08T19:23:09.015350+0000","last_fullsized":"2023-11-08T19:23:09.015350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:04:23.883480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.579599+0000","last_change":"2023-11-08T19:23:01.542024+0000","last_active":"2023-11-08T19:23:06.579599+0000","last_peered":"2023-11-08T19:23:06.579599+0000","last_clean":"2023-11-08T19:23:06.579599+0000","last_became_active":"2023-11-08T19:23:01.541307+0000","last_became_peered":"2023-11-08T19:23:01.541307+0000","last_unstale":"2023-11-08T19:23:06.579599+0000","last_undegraded":"2023-11-08T19:23:06.579599+0000","last_fullsized":"2023-11-08T19:23:06.579599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:07:16.646292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.580444+0000","last_change":"2023-11-08T19:23:02.543049+0000","last_active":"2023-11-08T19:23:06.580444+0000","last_peered":"2023-11-08T19:23:06.580444+0000","last_clean":"2023-11-08T19:23:06.580444+0000","last_became_active":"2023-11-08T19:23:02.542652+0000","last_became_peered":"2023-11-08T19:23:02.542652+0000","last_unstale":"2023-11-08T19:23:06.580444+0000","last_undegraded":"2023-11-08T19:23:06.580444+0000","last_fullsized":"2023-11-08T19:23:06.580444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:43:55.675044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.015406+0000","last_change":"2023-11-08T19:23:06.640235+0000","last_active":"2023-11-08T19:23:09.015406+0000","last_peered":"2023-11-08T19:23:09.015406+0000","last_clean":"2023-11-08T19:23:09.015406+0000","last_became_active":"2023-11-08T19:23:06.639813+0000","last_became_peered":"2023-11-08T19:23:06.639813+0000","last_unstale":"2023-11-08T19:23:09.015406+0000","last_undegraded":"2023-11-08T19:23:09.015406+0000","last_fullsized":"2023-11-08T19:23:09.015406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:11:17.824585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.574994+0000","last_change":"2023-11-08T19:23:01.537071+0000","last_active":"2023-11-08T19:23:06.574994+0000","last_peered":"2023-11-08T19:23:06.574994+0000","last_clean":"2023-11-08T19:23:06.574994+0000","last_became_active":"2023-11-08T19:23:01.536098+0000","last_became_peered":"2023-11-08T19:23:01.536098+0000","last_unstale":"2023-11-08T19:23:06.574994+0000","last_undegraded":"2023-11-08T19:23:06.574994+0000","last_fullsized":"2023-11-08T19:23:06.574994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:57:50.009215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.640434+0000","last_change":"2023-11-08T19:23:02.543183+0000","last_active":"2023-11-08T19:23:06.640434+0000","last_peered":"2023-11-08T19:23:06.640434+0000","last_clean":"2023-11-08T19:23:06.640434+0000","last_became_active":"2023-11-08T19:23:02.542928+0000","last_became_peered":"2023-11-08T19:23:02.542928+0000","last_unstale":"2023-11-08T19:23:06.640434+0000","last_undegraded":"2023-11-08T19:23:06.640434+0000","last_fullsized":"2023-11-08T19:23:06.640434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:11:58.093408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.015907+0000","last_change":"2023-11-08T19:23:06.642851+0000","last_active":"2023-11-08T19:23:09.015907+0000","last_peered":"2023-11-08T19:23:09.015907+0000","last_clean":"2023-11-08T19:23:09.015907+0000","last_became_active":"2023-11-08T19:23:06.642494+0000","last_became_peered":"2023-11-08T19:23:06.642494+0000","last_unstale":"2023-11-08T19:23:09.015907+0000","last_undegraded":"2023-11-08T19:23:09.015907+0000","last_fullsized":"2023-11-08T19:23:09.015907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:56:41.083975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.565079+0000","last_change":"2023-11-08T19:23:01.531395+0000","last_active":"2023-11-08T19:23:06.565079+0000","last_peered":"2023-11-08T19:23:06.565079+0000","last_clean":"2023-11-08T19:23:06.565079+0000","last_became_active":"2023-11-08T19:23:01.531114+0000","last_became_peered":"2023-11-08T19:23:01.531114+0000","last_unstale":"2023-11-08T19:23:06.565079+0000","last_undegraded":"2023-11-08T19:23:06.565079+0000","last_fullsized":"2023-11-08T19:23:06.565079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:28:21.147246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.565518+0000","last_change":"2023-11-08T19:23:02.539528+0000","last_active":"2023-11-08T19:23:06.565518+0000","last_peered":"2023-11-08T19:23:06.565518+0000","last_clean":"2023-11-08T19:23:06.565518+0000","last_became_active":"2023-11-08T19:23:02.539287+0000","last_became_peered":"2023-11-08T19:23:02.539287+0000","last_unstale":"2023-11-08T19:23:06.565518+0000","last_undegraded":"2023-11-08T19:23:06.565518+0000","last_fullsized":"2023-11-08T19:23:06.565518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:57:51.015184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.014311+0000","last_change":"2023-11-08T19:23:06.592797+0000","last_active":"2023-11-08T19:23:09.014311+0000","last_peered":"2023-11-08T19:23:09.014311+0000","last_clean":"2023-11-08T19:23:09.014311+0000","last_became_active":"2023-11-08T19:23:06.592322+0000","last_became_peered":"2023-11-08T19:23:06.592322+0000","last_unstale":"2023-11-08T19:23:09.014311+0000","last_undegraded":"2023-11-08T19:23:09.014311+0000","last_fullsized":"2023-11-08T19:23:09.014311+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:00:52.733076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.571985+0000","last_change":"2023-11-08T19:23:01.534386+0000","last_active":"2023-11-08T19:23:06.571985+0000","last_peered":"2023-11-08T19:23:06.571985+0000","last_clean":"2023-11-08T19:23:06.571985+0000","last_became_active":"2023-11-08T19:23:01.534065+0000","last_became_peered":"2023-11-08T19:23:01.534065+0000","last_unstale":"2023-11-08T19:23:06.571985+0000","last_undegraded":"2023-11-08T19:23:06.571985+0000","last_fullsized":"2023-11-08T19:23:06.571985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:27:47.069795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.638816+0000","last_change":"2023-11-08T19:23:02.542014+0000","last_active":"2023-11-08T19:23:06.638816+0000","last_peered":"2023-11-08T19:23:06.638816+0000","last_clean":"2023-11-08T19:23:06.638816+0000","last_became_active":"2023-11-08T19:23:02.541699+0000","last_became_peered":"2023-11-08T19:23:02.541699+0000","last_unstale":"2023-11-08T19:23:06.638816+0000","last_undegraded":"2023-11-08T19:23:06.638816+0000","last_fullsized":"2023-11-08T19:23:06.638816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:58:59.199208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:07.567280+0000","last_change":"2023-11-08T19:23:06.581489+0000","last_active":"2023-11-08T19:23:07.567280+0000","last_peered":"2023-11-08T19:23:07.567280+0000","last_clean":"2023-11-08T19:23:07.567280+0000","last_became_active":"2023-11-08T19:23:06.581010+0000","last_became_peered":"2023-11-08T19:23:06.581010+0000","last_unstale":"2023-11-08T19:23:07.567280+0000","last_undegraded":"2023-11-08T19:23:07.567280+0000","last_fullsized":"2023-11-08T19:23:07.567280+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:44:42.152662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.572396+0000","last_change":"2023-11-08T19:23:01.539745+0000","last_active":"2023-11-08T19:23:06.572396+0000","last_peered":"2023-11-08T19:23:06.572396+0000","last_clean":"2023-11-08T19:23:06.572396+0000","last_became_active":"2023-11-08T19:23:01.539413+0000","last_became_peered":"2023-11-08T19:23:01.539413+0000","last_unstale":"2023-11-08T19:23:06.572396+0000","last_undegraded":"2023-11-08T19:23:06.572396+0000","last_fullsized":"2023-11-08T19:23:06.572396+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:29:59.299789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.640045+0000","last_change":"2023-11-08T19:23:02.551120+0000","last_active":"2023-11-08T19:23:06.640045+0000","last_peered":"2023-11-08T19:23:06.640045+0000","last_clean":"2023-11-08T19:23:06.640045+0000","last_became_active":"2023-11-08T19:23:02.550824+0000","last_became_peered":"2023-11-08T19:23:02.550824+0000","last_unstale":"2023-11-08T19:23:06.640045+0000","last_undegraded":"2023-11-08T19:23:06.640045+0000","last_fullsized":"2023-11-08T19:23:06.640045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:57:32.301401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.014492+0000","last_change":"2023-11-08T19:23:06.587021+0000","last_active":"2023-11-08T19:23:09.014492+0000","last_peered":"2023-11-08T19:23:09.014492+0000","last_clean":"2023-11-08T19:23:09.014492+0000","last_became_active":"2023-11-08T19:23:06.586659+0000","last_became_peered":"2023-11-08T19:23:06.586659+0000","last_unstale":"2023-11-08T19:23:09.014492+0000","last_undegraded":"2023-11-08T19:23:09.014492+0000","last_fullsized":"2023-11-08T19:23:09.014492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:57:36.344289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.564688+0000","last_change":"2023-11-08T19:23:01.539782+0000","last_active":"2023-11-08T19:23:06.564688+0000","last_peered":"2023-11-08T19:23:06.564688+0000","last_clean":"2023-11-08T19:23:06.564688+0000","last_became_active":"2023-11-08T19:23:01.539493+0000","last_became_peered":"2023-11-08T19:23:01.539493+0000","last_unstale":"2023-11-08T19:23:06.564688+0000","last_undegraded":"2023-11-08T19:23:06.564688+0000","last_fullsized":"2023-11-08T19:23:06.564688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:45:54.766612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.576303+0000","last_change":"2023-11-08T19:23:02.540720+0000","last_active":"2023-11-08T19:23:06.576303+0000","last_peered":"2023-11-08T19:23:06.576303+0000","last_clean":"2023-11-08T19:23:06.576303+0000","last_became_active":"2023-11-08T19:23:02.540438+0000","last_became_peered":"2023-11-08T19:23:02.540438+0000","last_unstale":"2023-11-08T19:23:06.576303+0000","last_undegraded":"2023-11-08T19:23:06.576303+0000","last_fullsized":"2023-11-08T19:23:06.576303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:07:39.852842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.014689+0000","last_change":"2023-11-08T19:23:06.590376+0000","last_active":"2023-11-08T19:23:09.014689+0000","last_peered":"2023-11-08T19:23:09.014689+0000","last_clean":"2023-11-08T19:23:09.014689+0000","last_became_active":"2023-11-08T19:23:06.590037+0000","last_became_peered":"2023-11-08T19:23:06.590037+0000","last_unstale":"2023-11-08T19:23:09.014689+0000","last_undegraded":"2023-11-08T19:23:09.014689+0000","last_fullsized":"2023-11-08T19:23:09.014689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:02:22.908243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.574893+0000","last_change":"2023-11-08T19:23:01.534469+0000","last_active":"2023-11-08T19:23:06.574893+0000","last_peered":"2023-11-08T19:23:06.574893+0000","last_clean":"2023-11-08T19:23:06.574893+0000","last_became_active":"2023-11-08T19:23:01.534138+0000","last_became_peered":"2023-11-08T19:23:01.534138+0000","last_unstale":"2023-11-08T19:23:06.574893+0000","last_undegraded":"2023-11-08T19:23:06.574893+0000","last_fullsized":"2023-11-08T19:23:06.574893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:49:45.790935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.572089+0000","last_change":"2023-11-08T19:23:02.542108+0000","last_active":"2023-11-08T19:23:06.572089+0000","last_peered":"2023-11-08T19:23:06.572089+0000","last_clean":"2023-11-08T19:23:06.572089+0000","last_became_active":"2023-11-08T19:23:02.541821+0000","last_became_peered":"2023-11-08T19:23:02.541821+0000","last_unstale":"2023-11-08T19:23:06.572089+0000","last_undegraded":"2023-11-08T19:23:06.572089+0000","last_fullsized":"2023-11-08T19:23:06.572089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:28:22.153214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.014620+0000","last_change":"2023-11-08T19:23:06.588541+0000","last_active":"2023-11-08T19:23:09.014620+0000","last_peered":"2023-11-08T19:23:09.014620+0000","last_clean":"2023-11-08T19:23:09.014620+0000","last_became_active":"2023-11-08T19:23:06.588061+0000","last_became_peered":"2023-11-08T19:23:06.588061+0000","last_unstale":"2023-11-08T19:23:09.014620+0000","last_undegraded":"2023-11-08T19:23:09.014620+0000","last_fullsized":"2023-11-08T19:23:09.014620+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:12:02.136296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.563850+0000","last_change":"2023-11-08T19:23:02.538424+0000","last_active":"2023-11-08T19:23:06.563850+0000","last_peered":"2023-11-08T19:23:06.563850+0000","last_clean":"2023-11-08T19:23:06.563850+0000","last_became_active":"2023-11-08T19:23:02.538207+0000","last_became_peered":"2023-11-08T19:23:02.538207+0000","last_unstale":"2023-11-08T19:23:06.563850+0000","last_undegraded":"2023-11-08T19:23:06.563850+0000","last_fullsized":"2023-11-08T19:23:06.563850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:57:51.015184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.572118+0000","last_change":"2023-11-08T19:23:01.537154+0000","last_active":"2023-11-08T19:23:06.572118+0000","last_peered":"2023-11-08T19:23:06.572118+0000","last_clean":"2023-11-08T19:23:06.572118+0000","last_became_active":"2023-11-08T19:23:01.536883+0000","last_became_peered":"2023-11-08T19:23:01.536883+0000","last_unstale":"2023-11-08T19:23:06.572118+0000","last_undegraded":"2023-11-08T19:23:06.572118+0000","last_fullsized":"2023-11-08T19:23:06.572118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:35:12.900048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:07.566888+0000","last_change":"2023-11-08T19:23:06.641281+0000","last_active":"2023-11-08T19:23:07.566888+0000","last_peered":"2023-11-08T19:23:07.566888+0000","last_clean":"2023-11-08T19:23:07.566888+0000","last_became_active":"2023-11-08T19:23:06.640919+0000","last_became_peered":"2023-11-08T19:23:06.640919+0000","last_unstale":"2023-11-08T19:23:07.566888+0000","last_undegraded":"2023-11-08T19:23:07.566888+0000","last_fullsized":"2023-11-08T19:23:07.566888+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:12:02.136296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.574338+0000","last_change":"2023-11-08T19:23:02.551226+0000","last_active":"2023-11-08T19:23:06.574338+0000","last_peered":"2023-11-08T19:23:06.574338+0000","last_clean":"2023-11-08T19:23:06.574338+0000","last_became_active":"2023-11-08T19:23:02.550970+0000","last_became_peered":"2023-11-08T19:23:02.550970+0000","last_unstale":"2023-11-08T19:23:06.574338+0000","last_undegraded":"2023-11-08T19:23:06.574338+0000","last_fullsized":"2023-11-08T19:23:06.574338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:32:49.846143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.576524+0000","last_change":"2023-11-08T19:23:01.533619+0000","last_active":"2023-11-08T19:23:06.576524+0000","last_peered":"2023-11-08T19:23:06.576524+0000","last_clean":"2023-11-08T19:23:06.576524+0000","last_became_active":"2023-11-08T19:23:01.532909+0000","last_became_peered":"2023-11-08T19:23:01.532909+0000","last_unstale":"2023-11-08T19:23:06.576524+0000","last_undegraded":"2023-11-08T19:23:06.576524+0000","last_fullsized":"2023-11-08T19:23:06.576524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:28:21.147246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.636980+0000","last_change":"2023-11-08T19:22:58.054283+0000","last_active":"2023-11-08T19:23:06.636980+0000","last_peered":"2023-11-08T19:23:06.636980+0000","last_clean":"2023-11-08T19:23:06.636980+0000","last_became_active":"2023-11-08T19:22:58.053337+0000","last_became_peered":"2023-11-08T19:22:58.053337+0000","last_unstale":"2023-11-08T19:23:06.636980+0000","last_undegraded":"2023-11-08T19:23:06.636980+0000","last_fullsized":"2023-11-08T19:23:06.636980+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:22:56.479654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:22:56.479654+0000","last_clean_scrub_stamp":"2023-11-08T19:22:56.479654+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:16:05.317001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.014474+0000","last_change":"2023-11-08T19:23:06.638413+0000","last_active":"2023-11-08T19:23:09.014474+0000","last_peered":"2023-11-08T19:23:09.014474+0000","last_clean":"2023-11-08T19:23:09.014474+0000","last_became_active":"2023-11-08T19:23:06.638031+0000","last_became_peered":"2023-11-08T19:23:06.638031+0000","last_unstale":"2023-11-08T19:23:09.014474+0000","last_undegraded":"2023-11-08T19:23:09.014474+0000","last_fullsized":"2023-11-08T19:23:09.014474+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:57:36.344289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.569505+0000","last_change":"2023-11-08T19:23:02.534618+0000","last_active":"2023-11-08T19:23:06.569505+0000","last_peered":"2023-11-08T19:23:06.569505+0000","last_clean":"2023-11-08T19:23:06.569505+0000","last_became_active":"2023-11-08T19:23:02.534330+0000","last_became_peered":"2023-11-08T19:23:02.534330+0000","last_unstale":"2023-11-08T19:23:06.569505+0000","last_undegraded":"2023-11-08T19:23:06.569505+0000","last_fullsized":"2023-11-08T19:23:06.569505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:45:55.772580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.637061+0000","last_change":"2023-11-08T19:23:01.540830+0000","last_active":"2023-11-08T19:23:06.637061+0000","last_peered":"2023-11-08T19:23:06.637061+0000","last_clean":"2023-11-08T19:23:06.637061+0000","last_became_active":"2023-11-08T19:23:01.540497+0000","last_became_peered":"2023-11-08T19:23:01.540497+0000","last_unstale":"2023-11-08T19:23:06.637061+0000","last_undegraded":"2023-11-08T19:23:06.637061+0000","last_fullsized":"2023-11-08T19:23:06.637061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:44:28.225190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.014795+0000","last_change":"2023-11-08T19:23:06.638492+0000","last_active":"2023-11-08T19:23:09.014795+0000","last_peered":"2023-11-08T19:23:09.014795+0000","last_clean":"2023-11-08T19:23:09.014795+0000","last_became_active":"2023-11-08T19:23:06.637973+0000","last_became_peered":"2023-11-08T19:23:06.637973+0000","last_unstale":"2023-11-08T19:23:09.014795+0000","last_undegraded":"2023-11-08T19:23:09.014795+0000","last_fullsized":"2023-11-08T19:23:09.014795+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:22:45.636851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.639665+0000","last_change":"2023-11-08T19:23:01.541030+0000","last_active":"2023-11-08T19:23:06.639665+0000","last_peered":"2023-11-08T19:23:06.639665+0000","last_clean":"2023-11-08T19:23:06.639665+0000","last_became_active":"2023-11-08T19:23:01.540713+0000","last_became_peered":"2023-11-08T19:23:01.540713+0000","last_unstale":"2023-11-08T19:23:06.639665+0000","last_undegraded":"2023-11-08T19:23:06.639665+0000","last_fullsized":"2023-11-08T19:23:06.639665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:49:45.790935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.564785+0000","last_change":"2023-11-08T19:23:02.534477+0000","last_active":"2023-11-08T19:23:06.564785+0000","last_peered":"2023-11-08T19:23:06.564785+0000","last_clean":"2023-11-08T19:23:06.564785+0000","last_became_active":"2023-11-08T19:23:02.534220+0000","last_became_peered":"2023-11-08T19:23:02.534220+0000","last_unstale":"2023-11-08T19:23:06.564785+0000","last_undegraded":"2023-11-08T19:23:06.564785+0000","last_fullsized":"2023-11-08T19:23:06.564785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:24:27.669240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.014669+0000","last_change":"2023-11-08T19:23:06.642788+0000","last_active":"2023-11-08T19:23:09.014669+0000","last_peered":"2023-11-08T19:23:09.014669+0000","last_clean":"2023-11-08T19:23:09.014669+0000","last_became_active":"2023-11-08T19:23:06.642353+0000","last_became_peered":"2023-11-08T19:23:06.642353+0000","last_unstale":"2023-11-08T19:23:09.014669+0000","last_undegraded":"2023-11-08T19:23:09.014669+0000","last_fullsized":"2023-11-08T19:23:09.014669+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:33:01.642232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.564741+0000","last_change":"2023-11-08T19:23:01.534206+0000","last_active":"2023-11-08T19:23:06.564741+0000","last_peered":"2023-11-08T19:23:06.564741+0000","last_clean":"2023-11-08T19:23:06.564741+0000","last_became_active":"2023-11-08T19:23:01.533951+0000","last_became_peered":"2023-11-08T19:23:01.533951+0000","last_unstale":"2023-11-08T19:23:06.564741+0000","last_undegraded":"2023-11-08T19:23:06.564741+0000","last_fullsized":"2023-11-08T19:23:06.564741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:52:26.893730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.572311+0000","last_change":"2023-11-08T19:23:02.543044+0000","last_active":"2023-11-08T19:23:06.572311+0000","last_peered":"2023-11-08T19:23:06.572311+0000","last_clean":"2023-11-08T19:23:06.572311+0000","last_became_active":"2023-11-08T19:23:02.542767+0000","last_became_peered":"2023-11-08T19:23:02.542767+0000","last_unstale":"2023-11-08T19:23:06.572311+0000","last_undegraded":"2023-11-08T19:23:06.572311+0000","last_fullsized":"2023-11-08T19:23:06.572311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:07:39.852842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:07.567464+0000","last_change":"2023-11-08T19:23:06.638770+0000","last_active":"2023-11-08T19:23:07.567464+0000","last_peered":"2023-11-08T19:23:07.567464+0000","last_clean":"2023-11-08T19:23:07.567464+0000","last_became_active":"2023-11-08T19:23:06.638045+0000","last_became_peered":"2023-11-08T19:23:06.638045+0000","last_unstale":"2023-11-08T19:23:07.567464+0000","last_undegraded":"2023-11-08T19:23:07.567464+0000","last_fullsized":"2023-11-08T19:23:07.567464+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:15:27.237227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.565881+0000","last_change":"2023-11-08T19:23:01.541938+0000","last_active":"2023-11-08T19:23:06.565881+0000","last_peered":"2023-11-08T19:23:06.565881+0000","last_clean":"2023-11-08T19:23:06.565881+0000","last_became_active":"2023-11-08T19:23:01.541534+0000","last_became_peered":"2023-11-08T19:23:01.541534+0000","last_unstale":"2023-11-08T19:23:06.565881+0000","last_undegraded":"2023-11-08T19:23:06.565881+0000","last_fullsized":"2023-11-08T19:23:06.565881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:47:07.770348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.578982+0000","last_change":"2023-11-08T19:23:02.538688+0000","last_active":"2023-11-08T19:23:06.578982+0000","last_peered":"2023-11-08T19:23:06.578982+0000","last_clean":"2023-11-08T19:23:06.578982+0000","last_became_active":"2023-11-08T19:23:02.538406+0000","last_became_peered":"2023-11-08T19:23:02.538406+0000","last_unstale":"2023-11-08T19:23:06.578982+0000","last_undegraded":"2023-11-08T19:23:06.578982+0000","last_fullsized":"2023-11-08T19:23:06.578982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:24:27.669240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:07.568066+0000","last_change":"2023-11-08T19:23:06.586884+0000","last_active":"2023-11-08T19:23:07.568066+0000","last_peered":"2023-11-08T19:23:07.568066+0000","last_clean":"2023-11-08T19:23:07.568066+0000","last_became_active":"2023-11-08T19:23:06.585724+0000","last_became_peered":"2023-11-08T19:23:06.585724+0000","last_unstale":"2023-11-08T19:23:07.568066+0000","last_undegraded":"2023-11-08T19:23:07.568066+0000","last_fullsized":"2023-11-08T19:23:07.568066+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:50:37.550320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.636980+0000","last_change":"2023-11-08T19:23:01.541119+0000","last_active":"2023-11-08T19:23:06.636980+0000","last_peered":"2023-11-08T19:23:06.636980+0000","last_clean":"2023-11-08T19:23:06.636980+0000","last_became_active":"2023-11-08T19:23:01.540784+0000","last_became_peered":"2023-11-08T19:23:01.540784+0000","last_unstale":"2023-11-08T19:23:06.636980+0000","last_undegraded":"2023-11-08T19:23:06.636980+0000","last_fullsized":"2023-11-08T19:23:06.636980+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:47:07.770348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.567795+0000","last_change":"2023-11-08T19:23:02.536086+0000","last_active":"2023-11-08T19:23:06.567795+0000","last_peered":"2023-11-08T19:23:06.567795+0000","last_clean":"2023-11-08T19:23:06.567795+0000","last_became_active":"2023-11-08T19:23:02.535129+0000","last_became_peered":"2023-11-08T19:23:02.535129+0000","last_unstale":"2023-11-08T19:23:06.567795+0000","last_undegraded":"2023-11-08T19:23:06.567795+0000","last_fullsized":"2023-11-08T19:23:06.567795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:01:17.694162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.014391+0000","last_change":"2023-11-08T19:23:06.639503+0000","last_active":"2023-11-08T19:23:09.014391+0000","last_peered":"2023-11-08T19:23:09.014391+0000","last_clean":"2023-11-08T19:23:09.014391+0000","last_became_active":"2023-11-08T19:23:06.639076+0000","last_became_peered":"2023-11-08T19:23:06.639076+0000","last_unstale":"2023-11-08T19:23:09.014391+0000","last_undegraded":"2023-11-08T19:23:09.014391+0000","last_fullsized":"2023-11-08T19:23:09.014391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:00:52.733076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.563944+0000","last_change":"2023-11-08T19:23:01.539723+0000","last_active":"2023-11-08T19:23:06.563944+0000","last_peered":"2023-11-08T19:23:06.563944+0000","last_clean":"2023-11-08T19:23:06.563944+0000","last_became_active":"2023-11-08T19:23:01.539435+0000","last_became_peered":"2023-11-08T19:23:01.539435+0000","last_unstale":"2023-11-08T19:23:06.563944+0000","last_undegraded":"2023-11-08T19:23:06.563944+0000","last_fullsized":"2023-11-08T19:23:06.563944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:01:16.688194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.571014+0000","last_change":"2023-11-08T19:23:02.539571+0000","last_active":"2023-11-08T19:23:06.571014+0000","last_peered":"2023-11-08T19:23:06.571014+0000","last_clean":"2023-11-08T19:23:06.571014+0000","last_became_active":"2023-11-08T19:23:02.539301+0000","last_became_peered":"2023-11-08T19:23:02.539301+0000","last_unstale":"2023-11-08T19:23:06.571014+0000","last_undegraded":"2023-11-08T19:23:06.571014+0000","last_fullsized":"2023-11-08T19:23:06.571014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:24:27.669240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:07.567147+0000","last_change":"2023-11-08T19:23:06.590255+0000","last_active":"2023-11-08T19:23:07.567147+0000","last_peered":"2023-11-08T19:23:07.567147+0000","last_clean":"2023-11-08T19:23:07.567147+0000","last_became_active":"2023-11-08T19:23:06.589834+0000","last_became_peered":"2023-11-08T19:23:06.589834+0000","last_unstale":"2023-11-08T19:23:07.567147+0000","last_undegraded":"2023-11-08T19:23:07.567147+0000","last_fullsized":"2023-11-08T19:23:07.567147+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:04:24.855880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.564072+0000","last_change":"2023-11-08T19:23:01.536694+0000","last_active":"2023-11-08T19:23:06.564072+0000","last_peered":"2023-11-08T19:23:06.564072+0000","last_clean":"2023-11-08T19:23:06.564072+0000","last_became_active":"2023-11-08T19:23:01.535913+0000","last_became_peered":"2023-11-08T19:23:01.535913+0000","last_unstale":"2023-11-08T19:23:06.564072+0000","last_undegraded":"2023-11-08T19:23:06.564072+0000","last_fullsized":"2023-11-08T19:23:06.564072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:43:54.669075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.573361+0000","last_change":"2023-11-08T19:23:02.533243+0000","last_active":"2023-11-08T19:23:06.573361+0000","last_peered":"2023-11-08T19:23:06.573361+0000","last_clean":"2023-11-08T19:23:06.573361+0000","last_became_active":"2023-11-08T19:23:02.532725+0000","last_became_peered":"2023-11-08T19:23:02.532725+0000","last_unstale":"2023-11-08T19:23:06.573361+0000","last_undegraded":"2023-11-08T19:23:06.573361+0000","last_fullsized":"2023-11-08T19:23:06.573361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:04:20.812993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:07.567627+0000","last_change":"2023-11-08T19:23:06.586805+0000","last_active":"2023-11-08T19:23:07.567627+0000","last_peered":"2023-11-08T19:23:07.567627+0000","last_clean":"2023-11-08T19:23:07.567627+0000","last_became_active":"2023-11-08T19:23:06.586388+0000","last_became_peered":"2023-11-08T19:23:06.586388+0000","last_unstale":"2023-11-08T19:23:07.567627+0000","last_undegraded":"2023-11-08T19:23:07.567627+0000","last_fullsized":"2023-11-08T19:23:07.567627+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:11:18.742854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.640533+0000","last_change":"2023-11-08T19:23:01.540491+0000","last_active":"2023-11-08T19:23:06.640533+0000","last_peered":"2023-11-08T19:23:06.640533+0000","last_clean":"2023-11-08T19:23:06.640533+0000","last_became_active":"2023-11-08T19:23:01.540175+0000","last_became_peered":"2023-11-08T19:23:01.540175+0000","last_unstale":"2023-11-08T19:23:06.640533+0000","last_undegraded":"2023-11-08T19:23:06.640533+0000","last_fullsized":"2023-11-08T19:23:06.640533+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:52:26.893730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.565419+0000","last_change":"2023-11-08T19:23:02.542218+0000","last_active":"2023-11-08T19:23:06.565419+0000","last_peered":"2023-11-08T19:23:06.565419+0000","last_clean":"2023-11-08T19:23:06.565419+0000","last_became_active":"2023-11-08T19:23:02.541912+0000","last_became_peered":"2023-11-08T19:23:02.541912+0000","last_unstale":"2023-11-08T19:23:06.565419+0000","last_undegraded":"2023-11-08T19:23:06.565419+0000","last_fullsized":"2023-11-08T19:23:06.565419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:04:20.812993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:07.567162+0000","last_change":"2023-11-08T19:23:06.641692+0000","last_active":"2023-11-08T19:23:07.567162+0000","last_peered":"2023-11-08T19:23:07.567162+0000","last_clean":"2023-11-08T19:23:07.567162+0000","last_became_active":"2023-11-08T19:23:06.640996+0000","last_became_peered":"2023-11-08T19:23:06.640996+0000","last_unstale":"2023-11-08T19:23:07.567162+0000","last_undegraded":"2023-11-08T19:23:07.567162+0000","last_fullsized":"2023-11-08T19:23:07.567162+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:00:52.733076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.574648+0000","last_change":"2023-11-08T19:23:01.538965+0000","last_active":"2023-11-08T19:23:06.574648+0000","last_peered":"2023-11-08T19:23:06.574648+0000","last_clean":"2023-11-08T19:23:06.574648+0000","last_became_active":"2023-11-08T19:23:01.538635+0000","last_became_peered":"2023-11-08T19:23:01.538635+0000","last_unstale":"2023-11-08T19:23:06.574648+0000","last_undegraded":"2023-11-08T19:23:06.574648+0000","last_fullsized":"2023-11-08T19:23:06.574648+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:33:16.511242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.639757+0000","last_change":"2023-11-08T19:23:02.549229+0000","last_active":"2023-11-08T19:23:06.639757+0000","last_peered":"2023-11-08T19:23:06.639757+0000","last_clean":"2023-11-08T19:23:06.639757+0000","last_became_active":"2023-11-08T19:23:02.548974+0000","last_became_peered":"2023-11-08T19:23:02.548974+0000","last_unstale":"2023-11-08T19:23:06.639757+0000","last_undegraded":"2023-11-08T19:23:06.639757+0000","last_fullsized":"2023-11-08T19:23:06.639757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:50:33.507433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.015704+0000","last_change":"2023-11-08T19:23:06.593697+0000","last_active":"2023-11-08T19:23:09.015704+0000","last_peered":"2023-11-08T19:23:09.015704+0000","last_clean":"2023-11-08T19:23:09.015704+0000","last_became_active":"2023-11-08T19:23:06.593382+0000","last_became_peered":"2023-11-08T19:23:06.593382+0000","last_unstale":"2023-11-08T19:23:09.015704+0000","last_undegraded":"2023-11-08T19:23:09.015704+0000","last_fullsized":"2023-11-08T19:23:09.015704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:02:22.908243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.564800+0000","last_change":"2023-11-08T19:23:01.530532+0000","last_active":"2023-11-08T19:23:06.564800+0000","last_peered":"2023-11-08T19:23:06.564800+0000","last_clean":"2023-11-08T19:23:06.564800+0000","last_became_active":"2023-11-08T19:23:01.530253+0000","last_became_peered":"2023-11-08T19:23:01.530253+0000","last_unstale":"2023-11-08T19:23:06.564800+0000","last_undegraded":"2023-11-08T19:23:06.564800+0000","last_fullsized":"2023-11-08T19:23:06.564800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:55.765637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.575825+0000","last_change":"2023-11-08T19:23:02.540301+0000","last_active":"2023-11-08T19:23:06.575825+0000","last_peered":"2023-11-08T19:23:06.575825+0000","last_clean":"2023-11-08T19:23:06.575825+0000","last_became_active":"2023-11-08T19:23:02.539679+0000","last_became_peered":"2023-11-08T19:23:02.539679+0000","last_unstale":"2023-11-08T19:23:06.575825+0000","last_undegraded":"2023-11-08T19:23:06.575825+0000","last_fullsized":"2023-11-08T19:23:06.575825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:11:14.699967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.014285+0000","last_change":"2023-11-08T19:23:06.638442+0000","last_active":"2023-11-08T19:23:09.014285+0000","last_peered":"2023-11-08T19:23:09.014285+0000","last_clean":"2023-11-08T19:23:09.014285+0000","last_became_active":"2023-11-08T19:23:06.638018+0000","last_became_peered":"2023-11-08T19:23:06.638018+0000","last_unstale":"2023-11-08T19:23:09.014285+0000","last_undegraded":"2023-11-08T19:23:09.014285+0000","last_fullsized":"2023-11-08T19:23:09.014285+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:14:35.302430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.575081+0000","last_change":"2023-11-08T19:23:01.537610+0000","last_active":"2023-11-08T19:23:06.575081+0000","last_peered":"2023-11-08T19:23:06.575081+0000","last_clean":"2023-11-08T19:23:06.575081+0000","last_became_active":"2023-11-08T19:23:01.537341+0000","last_became_peered":"2023-11-08T19:23:01.537341+0000","last_unstale":"2023-11-08T19:23:06.575081+0000","last_undegraded":"2023-11-08T19:23:06.575081+0000","last_fullsized":"2023-11-08T19:23:06.575081+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:01:16.688194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.640258+0000","last_change":"2023-11-08T19:23:02.551858+0000","last_active":"2023-11-08T19:23:06.640258+0000","last_peered":"2023-11-08T19:23:06.640258+0000","last_clean":"2023-11-08T19:23:06.640258+0000","last_became_active":"2023-11-08T19:23:02.551054+0000","last_became_peered":"2023-11-08T19:23:02.551054+0000","last_unstale":"2023-11-08T19:23:06.640258+0000","last_undegraded":"2023-11-08T19:23:06.640258+0000","last_fullsized":"2023-11-08T19:23:06.640258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:00:48.690189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.565678+0000","last_change":"2023-11-08T19:23:02.545805+0000","last_active":"2023-11-08T19:23:06.565678+0000","last_peered":"2023-11-08T19:23:06.565678+0000","last_clean":"2023-11-08T19:23:06.565678+0000","last_became_active":"2023-11-08T19:23:02.545540+0000","last_became_peered":"2023-11-08T19:23:02.545540+0000","last_unstale":"2023-11-08T19:23:06.565678+0000","last_undegraded":"2023-11-08T19:23:06.565678+0000","last_fullsized":"2023-11-08T19:23:06.565678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:15:23.194339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.572161+0000","last_change":"2023-11-08T19:23:02.537513+0000","last_active":"2023-11-08T19:23:06.572161+0000","last_peered":"2023-11-08T19:23:06.572161+0000","last_clean":"2023-11-08T19:23:06.572161+0000","last_became_active":"2023-11-08T19:23:02.537192+0000","last_became_peered":"2023-11-08T19:23:02.537192+0000","last_unstale":"2023-11-08T19:23:06.572161+0000","last_undegraded":"2023-11-08T19:23:06.572161+0000","last_fullsized":"2023-11-08T19:23:06.572161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:47:08.776316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.575099+0000","last_change":"2023-11-08T19:23:02.537846+0000","last_active":"2023-11-08T19:23:06.575099+0000","last_peered":"2023-11-08T19:23:06.575099+0000","last_clean":"2023-11-08T19:23:06.575099+0000","last_became_active":"2023-11-08T19:23:02.537585+0000","last_became_peered":"2023-11-08T19:23:02.537585+0000","last_unstale":"2023-11-08T19:23:06.575099+0000","last_undegraded":"2023-11-08T19:23:06.575099+0000","last_fullsized":"2023-11-08T19:23:06.575099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:11:58.093408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.579334+0000","last_change":"2023-11-08T19:23:02.536724+0000","last_active":"2023-11-08T19:23:06.579334+0000","last_peered":"2023-11-08T19:23:06.579334+0000","last_clean":"2023-11-08T19:23:06.579334+0000","last_became_active":"2023-11-08T19:23:02.536080+0000","last_became_peered":"2023-11-08T19:23:02.536080+0000","last_unstale":"2023-11-08T19:23:06.579334+0000","last_undegraded":"2023-11-08T19:23:06.579334+0000","last_fullsized":"2023-11-08T19:23:06.579334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:56:02.594198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.576167+0000","last_change":"2023-11-08T19:23:02.531764+0000","last_active":"2023-11-08T19:23:06.576167+0000","last_peered":"2023-11-08T19:23:06.576167+0000","last_clean":"2023-11-08T19:23:06.576167+0000","last_became_active":"2023-11-08T19:23:02.531498+0000","last_became_peered":"2023-11-08T19:23:02.531498+0000","last_unstale":"2023-11-08T19:23:06.576167+0000","last_undegraded":"2023-11-08T19:23:06.576167+0000","last_fullsized":"2023-11-08T19:23:06.576167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:15:23.194339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.564703+0000","last_change":"2023-11-08T19:23:02.536652+0000","last_active":"2023-11-08T19:23:06.564703+0000","last_peered":"2023-11-08T19:23:06.564703+0000","last_clean":"2023-11-08T19:23:06.564703+0000","last_became_active":"2023-11-08T19:23:02.536397+0000","last_became_peered":"2023-11-08T19:23:02.536397+0000","last_unstale":"2023-11-08T19:23:06.564703+0000","last_undegraded":"2023-11-08T19:23:06.564703+0000","last_fullsized":"2023-11-08T19:23:06.564703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:32:49.846143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.566386+0000","last_change":"2023-11-08T19:23:02.546101+0000","last_active":"2023-11-08T19:23:06.566386+0000","last_peered":"2023-11-08T19:23:06.566386+0000","last_clean":"2023-11-08T19:23:06.566386+0000","last_became_active":"2023-11-08T19:23:02.545740+0000","last_became_peered":"2023-11-08T19:23:02.545740+0000","last_unstale":"2023-11-08T19:23:06.566386+0000","last_undegraded":"2023-11-08T19:23:06.566386+0000","last_fullsized":"2023-11-08T19:23:06.566386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:56:02.594198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.572386+0000","last_change":"2023-11-08T19:23:02.534052+0000","last_active":"2023-11-08T19:23:06.572386+0000","last_peered":"2023-11-08T19:23:06.572386+0000","last_clean":"2023-11-08T19:23:06.572386+0000","last_became_active":"2023-11-08T19:23:02.533811+0000","last_became_peered":"2023-11-08T19:23:02.533811+0000","last_unstale":"2023-11-08T19:23:06.572386+0000","last_undegraded":"2023-11-08T19:23:06.572386+0000","last_fullsized":"2023-11-08T19:23:06.572386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:44:38.109774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.574607+0000","last_change":"2023-11-08T19:23:02.536926+0000","last_active":"2023-11-08T19:23:06.574607+0000","last_peered":"2023-11-08T19:23:06.574607+0000","last_clean":"2023-11-08T19:23:06.574607+0000","last_became_active":"2023-11-08T19:23:02.536648+0000","last_became_peered":"2023-11-08T19:23:02.536648+0000","last_unstale":"2023-11-08T19:23:06.574607+0000","last_undegraded":"2023-11-08T19:23:06.574607+0000","last_fullsized":"2023-11-08T19:23:06.574607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:56:02.594198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.570954+0000","last_change":"2023-11-08T19:23:02.533095+0000","last_active":"2023-11-08T19:23:06.570954+0000","last_peered":"2023-11-08T19:23:06.570954+0000","last_clean":"2023-11-08T19:23:06.570954+0000","last_became_active":"2023-11-08T19:23:02.532639+0000","last_became_peered":"2023-11-08T19:23:02.532639+0000","last_unstale":"2023-11-08T19:23:06.570954+0000","last_undegraded":"2023-11-08T19:23:06.570954+0000","last_fullsized":"2023-11-08T19:23:06.570954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:56:02.594198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.575154+0000","last_change":"2023-11-08T19:23:02.547407+0000","last_active":"2023-11-08T19:23:06.575154+0000","last_peered":"2023-11-08T19:23:06.575154+0000","last_clean":"2023-11-08T19:23:06.575154+0000","last_became_active":"2023-11-08T19:23:02.545080+0000","last_became_peered":"2023-11-08T19:23:02.545080+0000","last_unstale":"2023-11-08T19:23:06.575154+0000","last_undegraded":"2023-11-08T19:23:06.575154+0000","last_fullsized":"2023-11-08T19:23:06.575154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:57:32.301401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.579417+0000","last_change":"2023-11-08T19:23:02.543982+0000","last_active":"2023-11-08T19:23:06.579417+0000","last_peered":"2023-11-08T19:23:06.579417+0000","last_clean":"2023-11-08T19:23:06.579417+0000","last_became_active":"2023-11-08T19:23:02.543790+0000","last_became_peered":"2023-11-08T19:23:02.543790+0000","last_unstale":"2023-11-08T19:23:06.579417+0000","last_undegraded":"2023-11-08T19:23:06.579417+0000","last_fullsized":"2023-11-08T19:23:06.579417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:57:51.015184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.567500+0000","last_change":"2023-11-08T19:23:02.546682+0000","last_active":"2023-11-08T19:23:06.567500+0000","last_peered":"2023-11-08T19:23:06.567500+0000","last_clean":"2023-11-08T19:23:06.567500+0000","last_became_active":"2023-11-08T19:23:02.546356+0000","last_became_peered":"2023-11-08T19:23:02.546356+0000","last_unstale":"2023-11-08T19:23:06.567500+0000","last_undegraded":"2023-11-08T19:23:06.567500+0000","last_fullsized":"2023-11-08T19:23:06.567500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:32:49.846143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4499,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":851968,"data_stored":690742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":99952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":860160,"data_stored":690798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":99792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":99918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":99882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:23:21.213 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:23:21.367 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.365+0000 7f98322ca700 1 Processor -- start 2023-11-08T19:23:21.368 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.365+0000 7f98322ca700 1 -- start start 2023-11-08T19:23:21.368 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.366+0000 7f98322ca700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f982c06ab80 0x7f982c0ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:21.368 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.366+0000 7f98322ca700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f982c15f2f0 0x7f982c06af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:21.368 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.366+0000 7f98322ca700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f982c0706a0 con 0x7f982c161510 2023-11-08T19:23:21.368 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.366+0000 7f98322ca700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f982c071f30 con 0x7f982c15f2f0 2023-11-08T19:23:21.369 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.366+0000 7f98322ca700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f982c06b4a0 con 0x7f982c06ab80 2023-11-08T19:23:21.369 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.366+0000 7f982b7fe700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f982c15f2f0 0x7f982c06af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:21.369 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.366+0000 7f982bfff700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f982c06ab80 0x7f982c0ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:21.369 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.366+0000 7f982bfff700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f982c06ab80 0x7f982c0ceb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.149:57498/0 (socket says 172.21.15.149:57498) 2023-11-08T19:23:21.369 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.366+0000 7f982b7fe700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f982c15f2f0 0x7f982c06af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.149:38202/0 (socket says 172.21.15.149:38202) 2023-11-08T19:23:21.370 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.366+0000 7f982bfff700 1 -- 172.21.15.149:0/4218776047 learned_addr learned my addr 172.21.15.149:0/4218776047 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:21.373 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.367+0000 7f982b7fe700 1 -- 172.21.15.149:0/4218776047 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f982c06ab80 msgr2=0x7f982c0ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:21.374 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.367+0000 7f982b7fe700 1 --2- 172.21.15.149:0/4218776047 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f982c06ab80 0x7f982c0ceb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:21.374 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.367+0000 7f982b7fe700 1 -- 172.21.15.149:0/4218776047 >> v1:172.21.15.160:6789/0 conn(0x7f982c161510 legacy=0x7f982c0723c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:21.374 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.367+0000 7f982b7fe700 1 -- 172.21.15.149:0/4218776047 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f982c161ad0 con 0x7f982c15f2f0 2023-11-08T19:23:21.374 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.367+0000 7f982affd700 1 -- 172.21.15.149:0/4218776047 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3780838461 0 0) 0x7f982c0706a0 con 0x7f982c161510 2023-11-08T19:23:21.375 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.367+0000 7f982b7fe700 1 --2- 172.21.15.149:0/4218776047 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f982c15f2f0 0x7f982c06af60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f981c009840 tx=0x7f981c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9a280abb0d4b5dc server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:21.375 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.367+0000 7f982affd700 1 -- 172.21.15.149:0/4218776047 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981c011830 con 0x7f982c15f2f0 2023-11-08T19:23:21.375 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.367+0000 7f982affd700 1 -- 172.21.15.149:0/4218776047 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f981c011990 con 0x7f982c15f2f0 2023-11-08T19:23:21.375 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.367+0000 7f982affd700 1 -- 172.21.15.149:0/4218776047 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981c011d20 con 0x7f982c15f2f0 2023-11-08T19:23:21.375 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.368+0000 7f98322ca700 1 -- 172.21.15.149:0/4218776047 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f982c15f2f0 msgr2=0x7f982c06af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:21.376 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.368+0000 7f98322ca700 1 --2- 172.21.15.149:0/4218776047 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f982c15f2f0 0x7f982c06af60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f981c009840 tx=0x7f981c009b50 comp rx=0 tx=0).stop 2023-11-08T19:23:21.376 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.368+0000 7f98322ca700 1 -- 172.21.15.149:0/4218776047 shutdown_connections 2023-11-08T19:23:21.376 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.368+0000 7f98322ca700 1 --2- 172.21.15.149:0/4218776047 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f982c06ab80 0x7f982c0ceb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:21.376 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.368+0000 7f98322ca700 1 --2- 172.21.15.149:0/4218776047 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f982c15f2f0 0x7f982c06af60 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:21.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.368+0000 7f98322ca700 1 -- 172.21.15.149:0/4218776047 >> 172.21.15.149:0/4218776047 conn(0x7f982c06dea0 msgr2=0x7f982c06e280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:21.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.368+0000 7f98322ca700 1 -- 172.21.15.149:0/4218776047 shutdown_connections 2023-11-08T19:23:21.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.368+0000 7f98322ca700 1 -- 172.21.15.149:0/4218776047 wait complete. 2023-11-08T19:23:21.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.369+0000 7f98322ca700 1 Processor -- start 2023-11-08T19:23:21.378 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.369+0000 7f98322ca700 1 -- start start 2023-11-08T19:23:21.378 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.370+0000 7f98322ca700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f982c06ab80 0x7f982c0c3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:21.378 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.370+0000 7f98322ca700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f982c15f2f0 0x7f982c154d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:21.378 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.370+0000 7f98322ca700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f982c161510 0x7f982c0b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:21.378 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.370+0000 7f98322ca700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f982c0b4db0 con 0x7f982c15f2f0 2023-11-08T19:23:21.379 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.370+0000 7f98322ca700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f982c1f7790 con 0x7f982c161510 2023-11-08T19:23:21.379 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.370+0000 7f98322ca700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f982c1f7a70 con 0x7f982c06ab80 2023-11-08T19:23:21.379 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.370+0000 7f982b7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f982c15f2f0 0x7f982c154d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:21.379 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.370+0000 7f982b7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f982c15f2f0 0x7f982c154d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37216/0 (socket says 172.21.15.149:37216) 2023-11-08T19:23:21.379 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.370+0000 7f982b7fe700 1 -- 172.21.15.149:0/418458187 learned_addr learned my addr 172.21.15.149:0/418458187 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:21.380 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.370+0000 7f982bfff700 1 --2- 172.21.15.149:0/418458187 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f982c06ab80 0x7f982c0c3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:21.380 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.371+0000 7f9830867700 1 --2- 172.21.15.149:0/418458187 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f982c161510 0x7f982c0b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:21.380 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.371+0000 7f982b7fe700 1 -- 172.21.15.149:0/418458187 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f982c06ab80 msgr2=0x7f982c0c3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:21.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.371+0000 7f982b7fe700 1 --2- 172.21.15.149:0/418458187 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f982c06ab80 0x7f982c0c3f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:21.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.371+0000 7f982b7fe700 1 -- 172.21.15.149:0/418458187 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f982c161510 msgr2=0x7f982c0b4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:21.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.371+0000 7f982b7fe700 1 --2- 172.21.15.149:0/418458187 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f982c161510 0x7f982c0b4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:21.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.371+0000 7f982b7fe700 1 -- 172.21.15.149:0/418458187 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f981c0094a0 con 0x7f982c15f2f0 2023-11-08T19:23:21.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.371+0000 7f982b7fe700 1 --2- 172.21.15.149:0/418458187 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f982c15f2f0 0x7f982c154d60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f981c009fd0 tx=0x7f981c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:21.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.371+0000 7f9828ff9700 1 -- 172.21.15.149:0/418458187 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981c0036a0 con 0x7f982c15f2f0 2023-11-08T19:23:21.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.371+0000 7f9828ff9700 1 -- 172.21.15.149:0/418458187 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f981c01e070 con 0x7f982c15f2f0 2023-11-08T19:23:21.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.371+0000 7f98322ca700 1 -- 172.21.15.149:0/418458187 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f982c0ad8a0 con 0x7f982c15f2f0 2023-11-08T19:23:21.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.371+0000 7f9828ff9700 1 -- 172.21.15.149:0/418458187 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981c003a40 con 0x7f982c15f2f0 2023-11-08T19:23:21.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.371+0000 7f98322ca700 1 -- 172.21.15.149:0/418458187 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f982c0ade60 con 0x7f982c15f2f0 2023-11-08T19:23:21.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.372+0000 7f98322ca700 1 -- 172.21.15.149:0/418458187 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f982c0ad700 con 0x7f982c15f2f0 2023-11-08T19:23:21.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.372+0000 7f9828ff9700 1 -- 172.21.15.149:0/418458187 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f981c003ba0 con 0x7f982c15f2f0 2023-11-08T19:23:21.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.373+0000 7f9828ff9700 1 --2- 172.21.15.149:0/418458187 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f981806af30 0x7f981806d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:21.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.373+0000 7f9828ff9700 1 -- 172.21.15.149:0/418458187 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f981c08a8d0 con 0x7f982c15f2f0 2023-11-08T19:23:21.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.373+0000 7f982bfff700 1 --2- 172.21.15.149:0/418458187 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f981806af30 0x7f981806d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:21.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.373+0000 7f982bfff700 1 --2- 172.21.15.149:0/418458187 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f981806af30 0x7f981806d3f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9820006fd0 tx=0x7f9820008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:21.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.378+0000 7f9828ff9700 1 -- 172.21.15.149:0/418458187 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f982c0ad700 con 0x7f982c15f2f0 2023-11-08T19:23:21.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.562+0000 7f98322ca700 1 -- 172.21.15.149:0/418458187 --> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f982c162090 con 0x7f981806af30 2023-11-08T19:23:21.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.571+0000 7f9828ff9700 1 -- 172.21.15.149:0/418458187 <== mgr.4104 v2:172.21.15.149:6832/1929837472 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345300 (secure 0 0 0) 0x7f9820011750 con 0x7f981806af30 2023-11-08T19:23:21.577 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:23:21.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.575+0000 7f98322ca700 1 -- 172.21.15.149:0/418458187 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f981806af30 msgr2=0x7f981806d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:21.580 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.575+0000 7f98322ca700 1 --2- 172.21.15.149:0/418458187 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f981806af30 0x7f981806d3f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9820006fd0 tx=0x7f9820008040 comp rx=0 tx=0).stop 2023-11-08T19:23:21.580 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.575+0000 7f98322ca700 1 -- 172.21.15.149:0/418458187 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f982c15f2f0 msgr2=0x7f982c154d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:21.580 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.575+0000 7f98322ca700 1 --2- 172.21.15.149:0/418458187 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f982c15f2f0 0x7f982c154d60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f981c009fd0 tx=0x7f981c004750 comp rx=0 tx=0).stop 2023-11-08T19:23:21.580 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.575+0000 7f98322ca700 1 -- 172.21.15.149:0/418458187 shutdown_connections 2023-11-08T19:23:21.581 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.575+0000 7f98322ca700 1 --2- 172.21.15.149:0/418458187 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f981806af30 0x7f981806d3f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:21.581 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.575+0000 7f98322ca700 1 --2- 172.21.15.149:0/418458187 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f982c161510 0x7f982c0b4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:21.581 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.575+0000 7f98322ca700 1 --2- 172.21.15.149:0/418458187 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f982c06ab80 0x7f982c0c3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:21.581 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.575+0000 7f98322ca700 1 --2- 172.21.15.149:0/418458187 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f982c15f2f0 0x7f982c154d60 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:21.581 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.575+0000 7f98322ca700 1 -- 172.21.15.149:0/418458187 >> 172.21.15.149:0/418458187 conn(0x7f982c06dea0 msgr2=0x7f982c0b1880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:21.582 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.575+0000 7f98322ca700 1 -- 172.21.15.149:0/418458187 shutdown_connections 2023-11-08T19:23:21.582 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.575+0000 7f98322ca700 1 -- 172.21.15.149:0/418458187 wait complete. 2023-11-08T19:23:21.582 INFO:teuthology.orchestra.run.smithi149.stderr:dumped all 2023-11-08T19:23:21.588 INFO:teuthology.orchestra.run.smithi149.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2023-11-08T19:23:19.988553+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594867,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219384,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755336,"statfs":{"total":773094113280,"available":772869464064,"internally_reserved":0,"allocated":3284992,"data_stored":1988070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2089,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002615"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.640463+0000","last_change":"2023-11-08T19:23:02.552058+0000","last_active":"2023-11-08T19:23:06.640463+0000","last_peered":"2023-11-08T19:23:06.640463+0000","last_clean":"2023-11-08T19:23:06.640463+0000","last_became_active":"2023-11-08T19:23:02.551489+0000","last_became_peered":"2023-11-08T19:23:02.551489+0000","last_unstale":"2023-11-08T19:23:06.640463+0000","last_undegraded":"2023-11-08T19:23:06.640463+0000","last_fullsized":"2023-11-08T19:23:06.640463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:22:41.593963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.564907+0000","last_change":"2023-11-08T19:23:02.538323+0000","last_active":"2023-11-08T19:23:06.564907+0000","last_peered":"2023-11-08T19:23:06.564907+0000","last_clean":"2023-11-08T19:23:06.564907+0000","last_became_active":"2023-11-08T19:23:02.537940+0000","last_became_peered":"2023-11-08T19:23:02.537940+0000","last_unstale":"2023-11-08T19:23:06.564907+0000","last_undegraded":"2023-11-08T19:23:06.564907+0000","last_fullsized":"2023-11-08T19:23:06.564907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:04:20.812993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.578295+0000","last_change":"2023-11-08T19:23:02.536079+0000","last_active":"2023-11-08T19:23:06.578295+0000","last_peered":"2023-11-08T19:23:06.578295+0000","last_clean":"2023-11-08T19:23:06.578295+0000","last_became_active":"2023-11-08T19:23:02.535824+0000","last_became_peered":"2023-11-08T19:23:02.535824+0000","last_unstale":"2023-11-08T19:23:06.578295+0000","last_undegraded":"2023-11-08T19:23:06.578295+0000","last_fullsized":"2023-11-08T19:23:06.578295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:29:40.895783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.575728+0000","last_change":"2023-11-08T19:23:02.540491+0000","last_active":"2023-11-08T19:23:06.575728+0000","last_peered":"2023-11-08T19:23:06.575728+0000","last_clean":"2023-11-08T19:23:06.575728+0000","last_became_active":"2023-11-08T19:23:02.540012+0000","last_became_peered":"2023-11-08T19:23:02.540012+0000","last_unstale":"2023-11-08T19:23:06.575728+0000","last_undegraded":"2023-11-08T19:23:06.575728+0000","last_fullsized":"2023-11-08T19:23:06.575728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:15:23.194339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.639456+0000","last_change":"2023-11-08T19:23:02.544395+0000","last_active":"2023-11-08T19:23:06.639456+0000","last_peered":"2023-11-08T19:23:06.639456+0000","last_clean":"2023-11-08T19:23:06.639456+0000","last_became_active":"2023-11-08T19:23:02.544103+0000","last_became_peered":"2023-11-08T19:23:02.544103+0000","last_unstale":"2023-11-08T19:23:06.639456+0000","last_undegraded":"2023-11-08T19:23:06.639456+0000","last_fullsized":"2023-11-08T19:23:06.639456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:47:36.694344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.575191+0000","last_change":"2023-11-08T19:23:02.545064+0000","last_active":"2023-11-08T19:23:06.575191+0000","last_peered":"2023-11-08T19:23:06.575191+0000","last_clean":"2023-11-08T19:23:06.575191+0000","last_became_active":"2023-11-08T19:23:02.544254+0000","last_became_peered":"2023-11-08T19:23:02.544254+0000","last_unstale":"2023-11-08T19:23:06.575191+0000","last_undegraded":"2023-11-08T19:23:06.575191+0000","last_fullsized":"2023-11-08T19:23:06.575191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:00:48.690189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.637334+0000","last_change":"2023-11-08T19:23:02.542877+0000","last_active":"2023-11-08T19:23:06.637334+0000","last_peered":"2023-11-08T19:23:06.637334+0000","last_clean":"2023-11-08T19:23:06.637334+0000","last_became_active":"2023-11-08T19:23:02.542587+0000","last_became_peered":"2023-11-08T19:23:02.542587+0000","last_unstale":"2023-11-08T19:23:06.637334+0000","last_undegraded":"2023-11-08T19:23:06.637334+0000","last_fullsized":"2023-11-08T19:23:06.637334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:15:23.194339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.571114+0000","last_change":"2023-11-08T19:23:02.537658+0000","last_active":"2023-11-08T19:23:06.571114+0000","last_peered":"2023-11-08T19:23:06.571114+0000","last_clean":"2023-11-08T19:23:06.571114+0000","last_became_active":"2023-11-08T19:23:02.537389+0000","last_became_peered":"2023-11-08T19:23:02.537389+0000","last_unstale":"2023-11-08T19:23:06.571114+0000","last_undegraded":"2023-11-08T19:23:06.571114+0000","last_fullsized":"2023-11-08T19:23:06.571114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:29:40.895783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.640351+0000","last_change":"2023-11-08T19:23:02.551031+0000","last_active":"2023-11-08T19:23:06.640351+0000","last_peered":"2023-11-08T19:23:06.640351+0000","last_clean":"2023-11-08T19:23:06.640351+0000","last_became_active":"2023-11-08T19:23:02.550631+0000","last_became_peered":"2023-11-08T19:23:02.550631+0000","last_unstale":"2023-11-08T19:23:06.640351+0000","last_undegraded":"2023-11-08T19:23:06.640351+0000","last_fullsized":"2023-11-08T19:23:06.640351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:02:18.865355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.566140+0000","last_change":"2023-11-08T19:23:02.539521+0000","last_active":"2023-11-08T19:23:06.566140+0000","last_peered":"2023-11-08T19:23:06.566140+0000","last_clean":"2023-11-08T19:23:06.566140+0000","last_became_active":"2023-11-08T19:23:02.539252+0000","last_became_peered":"2023-11-08T19:23:02.539252+0000","last_unstale":"2023-11-08T19:23:06.566140+0000","last_undegraded":"2023-11-08T19:23:06.566140+0000","last_fullsized":"2023-11-08T19:23:06.566140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:44:38.109774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.565944+0000","last_change":"2023-11-08T19:23:02.548230+0000","last_active":"2023-11-08T19:23:06.565944+0000","last_peered":"2023-11-08T19:23:06.565944+0000","last_clean":"2023-11-08T19:23:06.565944+0000","last_became_active":"2023-11-08T19:23:02.547980+0000","last_became_peered":"2023-11-08T19:23:02.547980+0000","last_unstale":"2023-11-08T19:23:06.565944+0000","last_undegraded":"2023-11-08T19:23:06.565944+0000","last_fullsized":"2023-11-08T19:23:06.565944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:24:27.669240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.569454+0000","last_change":"2023-11-08T19:23:02.550957+0000","last_active":"2023-11-08T19:23:06.569454+0000","last_peered":"2023-11-08T19:23:06.569454+0000","last_clean":"2023-11-08T19:23:06.569454+0000","last_became_active":"2023-11-08T19:23:02.550071+0000","last_became_peered":"2023-11-08T19:23:02.550071+0000","last_unstale":"2023-11-08T19:23:06.569454+0000","last_undegraded":"2023-11-08T19:23:06.569454+0000","last_fullsized":"2023-11-08T19:23:06.569454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:08:24.771220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.573212+0000","last_change":"2023-11-08T19:23:02.547356+0000","last_active":"2023-11-08T19:23:06.573212+0000","last_peered":"2023-11-08T19:23:06.573212+0000","last_clean":"2023-11-08T19:23:06.573212+0000","last_became_active":"2023-11-08T19:23:02.546568+0000","last_became_peered":"2023-11-08T19:23:02.546568+0000","last_unstale":"2023-11-08T19:23:06.573212+0000","last_undegraded":"2023-11-08T19:23:06.573212+0000","last_fullsized":"2023-11-08T19:23:06.573212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:49:46.796904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.580399+0000","last_change":"2023-11-08T19:23:02.538938+0000","last_active":"2023-11-08T19:23:06.580399+0000","last_peered":"2023-11-08T19:23:06.580399+0000","last_clean":"2023-11-08T19:23:06.580399+0000","last_became_active":"2023-11-08T19:23:02.538598+0000","last_became_peered":"2023-11-08T19:23:02.538598+0000","last_unstale":"2023-11-08T19:23:06.580399+0000","last_undegraded":"2023-11-08T19:23:06.580399+0000","last_fullsized":"2023-11-08T19:23:06.580399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:52:27.899698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.563911+0000","last_change":"2023-11-08T19:23:02.543136+0000","last_active":"2023-11-08T19:23:06.563911+0000","last_peered":"2023-11-08T19:23:06.563911+0000","last_clean":"2023-11-08T19:23:06.563911+0000","last_became_active":"2023-11-08T19:23:02.542868+0000","last_became_peered":"2023-11-08T19:23:02.542868+0000","last_unstale":"2023-11-08T19:23:06.563911+0000","last_undegraded":"2023-11-08T19:23:06.563911+0000","last_fullsized":"2023-11-08T19:23:06.563911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:49:46.796904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.574507+0000","last_change":"2023-11-08T19:23:02.541251+0000","last_active":"2023-11-08T19:23:06.574507+0000","last_peered":"2023-11-08T19:23:06.574507+0000","last_clean":"2023-11-08T19:23:06.574507+0000","last_became_active":"2023-11-08T19:23:02.540921+0000","last_became_peered":"2023-11-08T19:23:02.540921+0000","last_unstale":"2023-11-08T19:23:06.574507+0000","last_undegraded":"2023-11-08T19:23:06.574507+0000","last_fullsized":"2023-11-08T19:23:06.574507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:32:49.846143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.576611+0000","last_change":"2023-11-08T19:23:02.543682+0000","last_active":"2023-11-08T19:23:06.576611+0000","last_peered":"2023-11-08T19:23:06.576611+0000","last_clean":"2023-11-08T19:23:06.576611+0000","last_became_active":"2023-11-08T19:23:02.543385+0000","last_became_peered":"2023-11-08T19:23:02.543385+0000","last_unstale":"2023-11-08T19:23:06.576611+0000","last_undegraded":"2023-11-08T19:23:06.576611+0000","last_fullsized":"2023-11-08T19:23:06.576611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:47:36.694344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.575179+0000","last_change":"2023-11-08T19:23:02.547263+0000","last_active":"2023-11-08T19:23:06.575179+0000","last_peered":"2023-11-08T19:23:06.575179+0000","last_clean":"2023-11-08T19:23:06.575179+0000","last_became_active":"2023-11-08T19:23:02.546954+0000","last_became_peered":"2023-11-08T19:23:02.546954+0000","last_unstale":"2023-11-08T19:23:06.575179+0000","last_undegraded":"2023-11-08T19:23:06.575179+0000","last_fullsized":"2023-11-08T19:23:06.575179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:08:24.771220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.639865+0000","last_change":"2023-11-08T19:23:02.544942+0000","last_active":"2023-11-08T19:23:06.639865+0000","last_peered":"2023-11-08T19:23:06.639865+0000","last_clean":"2023-11-08T19:23:06.639865+0000","last_became_active":"2023-11-08T19:23:02.544398+0000","last_became_peered":"2023-11-08T19:23:02.544398+0000","last_unstale":"2023-11-08T19:23:06.639865+0000","last_undegraded":"2023-11-08T19:23:06.639865+0000","last_fullsized":"2023-11-08T19:23:06.639865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:11:14.699967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.015793+0000","last_change":"2023-11-08T19:23:06.643772+0000","last_active":"2023-11-08T19:23:09.015793+0000","last_peered":"2023-11-08T19:23:09.015793+0000","last_clean":"2023-11-08T19:23:09.015793+0000","last_became_active":"2023-11-08T19:23:06.643399+0000","last_became_peered":"2023-11-08T19:23:06.643399+0000","last_unstale":"2023-11-08T19:23:09.015793+0000","last_undegraded":"2023-11-08T19:23:09.015793+0000","last_fullsized":"2023-11-08T19:23:09.015793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:28:31.147987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.579108+0000","last_change":"2023-11-08T19:23:01.541807+0000","last_active":"2023-11-08T19:23:06.579108+0000","last_peered":"2023-11-08T19:23:06.579108+0000","last_clean":"2023-11-08T19:23:06.579108+0000","last_became_active":"2023-11-08T19:23:01.541518+0000","last_became_peered":"2023-11-08T19:23:01.541518+0000","last_unstale":"2023-11-08T19:23:06.579108+0000","last_undegraded":"2023-11-08T19:23:06.579108+0000","last_fullsized":"2023-11-08T19:23:06.579108+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:44:28.225190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.571988+0000","last_change":"2023-11-08T19:23:02.546804+0000","last_active":"2023-11-08T19:23:06.571988+0000","last_peered":"2023-11-08T19:23:06.571988+0000","last_clean":"2023-11-08T19:23:06.571988+0000","last_became_active":"2023-11-08T19:23:02.546539+0000","last_became_peered":"2023-11-08T19:23:02.546539+0000","last_unstale":"2023-11-08T19:23:06.571988+0000","last_undegraded":"2023-11-08T19:23:06.571988+0000","last_fullsized":"2023-11-08T19:23:06.571988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:11:14.699967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:07.567784+0000","last_change":"2023-11-08T19:23:06.590879+0000","last_active":"2023-11-08T19:23:07.567784+0000","last_peered":"2023-11-08T19:23:07.567784+0000","last_clean":"2023-11-08T19:23:07.567784+0000","last_became_active":"2023-11-08T19:23:06.590413+0000","last_became_peered":"2023-11-08T19:23:06.590413+0000","last_unstale":"2023-11-08T19:23:07.567784+0000","last_undegraded":"2023-11-08T19:23:07.567784+0000","last_fullsized":"2023-11-08T19:23:07.567784+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:07:43.895729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.572075+0000","last_change":"2023-11-08T19:23:01.539505+0000","last_active":"2023-11-08T19:23:06.572075+0000","last_peered":"2023-11-08T19:23:06.572075+0000","last_clean":"2023-11-08T19:23:06.572075+0000","last_became_active":"2023-11-08T19:23:01.539253+0000","last_became_peered":"2023-11-08T19:23:01.539253+0000","last_unstale":"2023-11-08T19:23:06.572075+0000","last_undegraded":"2023-11-08T19:23:06.572075+0000","last_fullsized":"2023-11-08T19:23:06.572075+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:43:54.669075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.578908+0000","last_change":"2023-11-08T19:23:02.541207+0000","last_active":"2023-11-08T19:23:06.578908+0000","last_peered":"2023-11-08T19:23:06.578908+0000","last_clean":"2023-11-08T19:23:06.578908+0000","last_became_active":"2023-11-08T19:23:02.541002+0000","last_became_peered":"2023-11-08T19:23:02.541002+0000","last_unstale":"2023-11-08T19:23:06.578908+0000","last_undegraded":"2023-11-08T19:23:06.578908+0000","last_fullsized":"2023-11-08T19:23:06.578908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:49:46.796904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:07.568103+0000","last_change":"2023-11-08T19:23:06.586229+0000","last_active":"2023-11-08T19:23:07.568103+0000","last_peered":"2023-11-08T19:23:07.568103+0000","last_clean":"2023-11-08T19:23:07.568103+0000","last_became_active":"2023-11-08T19:23:06.585784+0000","last_became_peered":"2023-11-08T19:23:06.585784+0000","last_unstale":"2023-11-08T19:23:07.568103+0000","last_undegraded":"2023-11-08T19:23:07.568103+0000","last_fullsized":"2023-11-08T19:23:07.568103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:47:40.737231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.639721+0000","last_change":"2023-11-08T19:23:01.541701+0000","last_active":"2023-11-08T19:23:06.639721+0000","last_peered":"2023-11-08T19:23:06.639721+0000","last_clean":"2023-11-08T19:23:06.639721+0000","last_became_active":"2023-11-08T19:23:01.541392+0000","last_became_peered":"2023-11-08T19:23:01.541392+0000","last_unstale":"2023-11-08T19:23:06.639721+0000","last_undegraded":"2023-11-08T19:23:06.639721+0000","last_fullsized":"2023-11-08T19:23:06.639721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:57:50.009215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.575956+0000","last_change":"2023-11-08T19:23:02.543734+0000","last_active":"2023-11-08T19:23:06.575956+0000","last_peered":"2023-11-08T19:23:06.575956+0000","last_clean":"2023-11-08T19:23:06.575956+0000","last_became_active":"2023-11-08T19:23:02.543300+0000","last_became_peered":"2023-11-08T19:23:02.543300+0000","last_unstale":"2023-11-08T19:23:06.575956+0000","last_undegraded":"2023-11-08T19:23:06.575956+0000","last_fullsized":"2023-11-08T19:23:06.575956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:50:33.507433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:07.566641+0000","last_change":"2023-11-08T19:23:06.590258+0000","last_active":"2023-11-08T19:23:07.566641+0000","last_peered":"2023-11-08T19:23:07.566641+0000","last_clean":"2023-11-08T19:23:07.566641+0000","last_became_active":"2023-11-08T19:23:06.589825+0000","last_became_peered":"2023-11-08T19:23:06.589825+0000","last_unstale":"2023-11-08T19:23:07.566641+0000","last_undegraded":"2023-11-08T19:23:07.566641+0000","last_fullsized":"2023-11-08T19:23:07.566641+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:56:06.637086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.640110+0000","last_change":"2023-11-08T19:23:01.543094+0000","last_active":"2023-11-08T19:23:06.640110+0000","last_peered":"2023-11-08T19:23:06.640110+0000","last_clean":"2023-11-08T19:23:06.640110+0000","last_became_active":"2023-11-08T19:23:01.542832+0000","last_became_peered":"2023-11-08T19:23:01.542832+0000","last_unstale":"2023-11-08T19:23:06.640110+0000","last_undegraded":"2023-11-08T19:23:06.640110+0000","last_fullsized":"2023-11-08T19:23:06.640110+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:08:23.765251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.575939+0000","last_change":"2023-11-08T19:23:02.543389+0000","last_active":"2023-11-08T19:23:06.575939+0000","last_peered":"2023-11-08T19:23:06.575939+0000","last_clean":"2023-11-08T19:23:06.575939+0000","last_became_active":"2023-11-08T19:23:02.543095+0000","last_became_peered":"2023-11-08T19:23:02.543095+0000","last_unstale":"2023-11-08T19:23:06.575939+0000","last_undegraded":"2023-11-08T19:23:06.575939+0000","last_fullsized":"2023-11-08T19:23:06.575939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:44:38.109774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.015608+0000","last_change":"2023-11-08T19:23:06.590901+0000","last_active":"2023-11-08T19:23:09.015608+0000","last_peered":"2023-11-08T19:23:09.015608+0000","last_clean":"2023-11-08T19:23:09.015608+0000","last_became_active":"2023-11-08T19:23:06.590468+0000","last_became_peered":"2023-11-08T19:23:06.590468+0000","last_unstale":"2023-11-08T19:23:09.015608+0000","last_undegraded":"2023-11-08T19:23:09.015608+0000","last_fullsized":"2023-11-08T19:23:09.015608+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:58:51.442881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.573313+0000","last_change":"2023-11-08T19:23:01.540429+0000","last_active":"2023-11-08T19:23:06.573313+0000","last_peered":"2023-11-08T19:23:06.573313+0000","last_clean":"2023-11-08T19:23:06.573313+0000","last_became_active":"2023-11-08T19:23:01.540170+0000","last_became_peered":"2023-11-08T19:23:01.540170+0000","last_unstale":"2023-11-08T19:23:06.573313+0000","last_undegraded":"2023-11-08T19:23:06.573313+0000","last_fullsized":"2023-11-08T19:23:06.573313+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:52:26.893730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.572037+0000","last_change":"2023-11-08T19:23:02.550930+0000","last_active":"2023-11-08T19:23:06.572037+0000","last_peered":"2023-11-08T19:23:06.572037+0000","last_clean":"2023-11-08T19:23:06.572037+0000","last_became_active":"2023-11-08T19:23:02.549412+0000","last_became_peered":"2023-11-08T19:23:02.549412+0000","last_unstale":"2023-11-08T19:23:06.572037+0000","last_undegraded":"2023-11-08T19:23:06.572037+0000","last_fullsized":"2023-11-08T19:23:06.572037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:07:17.652260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:07.565865+0000","last_change":"2023-11-08T19:23:06.593062+0000","last_active":"2023-11-08T19:23:07.565865+0000","last_peered":"2023-11-08T19:23:07.565865+0000","last_clean":"2023-11-08T19:23:07.565865+0000","last_became_active":"2023-11-08T19:23:06.592681+0000","last_became_peered":"2023-11-08T19:23:06.592681+0000","last_unstale":"2023-11-08T19:23:07.565865+0000","last_undegraded":"2023-11-08T19:23:07.565865+0000","last_fullsized":"2023-11-08T19:23:07.565865+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:43:59.717931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.565314+0000","last_change":"2023-11-08T19:23:01.532560+0000","last_active":"2023-11-08T19:23:06.565314+0000","last_peered":"2023-11-08T19:23:06.565314+0000","last_clean":"2023-11-08T19:23:06.565314+0000","last_became_active":"2023-11-08T19:23:01.532281+0000","last_became_peered":"2023-11-08T19:23:01.532281+0000","last_unstale":"2023-11-08T19:23:06.565314+0000","last_undegraded":"2023-11-08T19:23:06.565314+0000","last_fullsized":"2023-11-08T19:23:06.565314+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:43:54.669075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.579248+0000","last_change":"2023-11-08T19:23:02.536527+0000","last_active":"2023-11-08T19:23:06.579248+0000","last_peered":"2023-11-08T19:23:06.579248+0000","last_clean":"2023-11-08T19:23:06.579248+0000","last_became_active":"2023-11-08T19:23:02.535739+0000","last_became_peered":"2023-11-08T19:23:02.535739+0000","last_unstale":"2023-11-08T19:23:06.579248+0000","last_undegraded":"2023-11-08T19:23:06.579248+0000","last_fullsized":"2023-11-08T19:23:06.579248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:04:20.812993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:07.567254+0000","last_change":"2023-11-08T19:23:06.586558+0000","last_active":"2023-11-08T19:23:07.567254+0000","last_peered":"2023-11-08T19:23:07.567254+0000","last_clean":"2023-11-08T19:23:07.567254+0000","last_became_active":"2023-11-08T19:23:06.586151+0000","last_became_peered":"2023-11-08T19:23:06.586151+0000","last_unstale":"2023-11-08T19:23:07.567254+0000","last_undegraded":"2023-11-08T19:23:07.567254+0000","last_fullsized":"2023-11-08T19:23:07.567254+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:57:36.344289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.570862+0000","last_change":"2023-11-08T19:23:01.535020+0000","last_active":"2023-11-08T19:23:06.570862+0000","last_peered":"2023-11-08T19:23:06.570862+0000","last_clean":"2023-11-08T19:23:06.570862+0000","last_became_active":"2023-11-08T19:23:01.534728+0000","last_became_peered":"2023-11-08T19:23:01.534728+0000","last_unstale":"2023-11-08T19:23:06.570862+0000","last_undegraded":"2023-11-08T19:23:06.570862+0000","last_fullsized":"2023-11-08T19:23:06.570862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:08:23.765251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.570908+0000","last_change":"2023-11-08T19:23:02.531826+0000","last_active":"2023-11-08T19:23:06.570908+0000","last_peered":"2023-11-08T19:23:06.570908+0000","last_clean":"2023-11-08T19:23:06.570908+0000","last_became_active":"2023-11-08T19:23:02.530174+0000","last_became_peered":"2023-11-08T19:23:02.530174+0000","last_unstale":"2023-11-08T19:23:06.570908+0000","last_undegraded":"2023-11-08T19:23:06.570908+0000","last_fullsized":"2023-11-08T19:23:06.570908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:57:51.015184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.014696+0000","last_change":"2023-11-08T19:23:06.641030+0000","last_active":"2023-11-08T19:23:09.014696+0000","last_peered":"2023-11-08T19:23:09.014696+0000","last_clean":"2023-11-08T19:23:09.014696+0000","last_became_active":"2023-11-08T19:23:06.640656+0000","last_became_peered":"2023-11-08T19:23:06.640656+0000","last_unstale":"2023-11-08T19:23:09.014696+0000","last_undegraded":"2023-11-08T19:23:09.014696+0000","last_fullsized":"2023-11-08T19:23:09.014696+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:12:02.136296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.574607+0000","last_change":"2023-11-08T19:23:01.529713+0000","last_active":"2023-11-08T19:23:06.574607+0000","last_peered":"2023-11-08T19:23:06.574607+0000","last_clean":"2023-11-08T19:23:06.574607+0000","last_became_active":"2023-11-08T19:23:01.528648+0000","last_became_peered":"2023-11-08T19:23:01.528648+0000","last_unstale":"2023-11-08T19:23:06.574607+0000","last_undegraded":"2023-11-08T19:23:06.574607+0000","last_fullsized":"2023-11-08T19:23:06.574607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:01:16.688194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.564020+0000","last_change":"2023-11-08T19:23:02.535673+0000","last_active":"2023-11-08T19:23:06.564020+0000","last_peered":"2023-11-08T19:23:06.564020+0000","last_clean":"2023-11-08T19:23:06.564020+0000","last_became_active":"2023-11-08T19:23:02.535411+0000","last_became_peered":"2023-11-08T19:23:02.535411+0000","last_unstale":"2023-11-08T19:23:06.564020+0000","last_undegraded":"2023-11-08T19:23:06.564020+0000","last_fullsized":"2023-11-08T19:23:06.564020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:56:02.594198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.015406+0000","last_change":"2023-11-08T19:23:06.643953+0000","last_active":"2023-11-08T19:23:09.015406+0000","last_peered":"2023-11-08T19:23:09.015406+0000","last_clean":"2023-11-08T19:23:09.015406+0000","last_became_active":"2023-11-08T19:23:06.643457+0000","last_became_peered":"2023-11-08T19:23:06.643457+0000","last_unstale":"2023-11-08T19:23:09.015406+0000","last_undegraded":"2023-11-08T19:23:09.015406+0000","last_fullsized":"2023-11-08T19:23:09.015406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:04:23.883480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.569588+0000","last_change":"2023-11-08T19:23:01.535403+0000","last_active":"2023-11-08T19:23:06.569588+0000","last_peered":"2023-11-08T19:23:06.569588+0000","last_clean":"2023-11-08T19:23:06.569588+0000","last_became_active":"2023-11-08T19:23:01.535102+0000","last_became_peered":"2023-11-08T19:23:01.535102+0000","last_unstale":"2023-11-08T19:23:06.569588+0000","last_undegraded":"2023-11-08T19:23:06.569588+0000","last_fullsized":"2023-11-08T19:23:06.569588+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:55.765637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.575598+0000","last_change":"2023-11-08T19:23:02.543531+0000","last_active":"2023-11-08T19:23:06.575598+0000","last_peered":"2023-11-08T19:23:06.575598+0000","last_clean":"2023-11-08T19:23:06.575598+0000","last_became_active":"2023-11-08T19:23:02.543160+0000","last_became_peered":"2023-11-08T19:23:02.543160+0000","last_unstale":"2023-11-08T19:23:06.575598+0000","last_undegraded":"2023-11-08T19:23:06.575598+0000","last_fullsized":"2023-11-08T19:23:06.575598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:04:20.812993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.014869+0000","last_change":"2023-11-08T19:23:06.589913+0000","last_active":"2023-11-08T19:23:09.014869+0000","last_peered":"2023-11-08T19:23:09.014869+0000","last_clean":"2023-11-08T19:23:09.014869+0000","last_became_active":"2023-11-08T19:23:06.589510+0000","last_became_peered":"2023-11-08T19:23:06.589510+0000","last_unstale":"2023-11-08T19:23:09.014869+0000","last_undegraded":"2023-11-08T19:23:09.014869+0000","last_fullsized":"2023-11-08T19:23:09.014869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:14:35.302430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.575682+0000","last_change":"2023-11-08T19:23:01.533936+0000","last_active":"2023-11-08T19:23:06.575682+0000","last_peered":"2023-11-08T19:23:06.575682+0000","last_clean":"2023-11-08T19:23:06.575682+0000","last_became_active":"2023-11-08T19:23:01.533445+0000","last_became_peered":"2023-11-08T19:23:01.533445+0000","last_unstale":"2023-11-08T19:23:06.575682+0000","last_undegraded":"2023-11-08T19:23:06.575682+0000","last_fullsized":"2023-11-08T19:23:06.575682+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:24:26.663271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.579037+0000","last_change":"2023-11-08T19:23:02.541241+0000","last_active":"2023-11-08T19:23:06.579037+0000","last_peered":"2023-11-08T19:23:06.579037+0000","last_clean":"2023-11-08T19:23:06.579037+0000","last_became_active":"2023-11-08T19:23:02.540969+0000","last_became_peered":"2023-11-08T19:23:02.540969+0000","last_unstale":"2023-11-08T19:23:06.579037+0000","last_undegraded":"2023-11-08T19:23:06.579037+0000","last_fullsized":"2023-11-08T19:23:06.579037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:32:49.846143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:07.568360+0000","last_change":"2023-11-08T19:23:06.585996+0000","last_active":"2023-11-08T19:23:07.568360+0000","last_peered":"2023-11-08T19:23:07.568360+0000","last_clean":"2023-11-08T19:23:07.568360+0000","last_became_active":"2023-11-08T19:23:06.585579+0000","last_became_peered":"2023-11-08T19:23:06.585579+0000","last_unstale":"2023-11-08T19:23:07.568360+0000","last_undegraded":"2023-11-08T19:23:07.568360+0000","last_fullsized":"2023-11-08T19:23:07.568360+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:00:52.733076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.565054+0000","last_change":"2023-11-08T19:23:01.536963+0000","last_active":"2023-11-08T19:23:06.565054+0000","last_peered":"2023-11-08T19:23:06.565054+0000","last_clean":"2023-11-08T19:23:06.565054+0000","last_became_active":"2023-11-08T19:23:01.536702+0000","last_became_peered":"2023-11-08T19:23:01.536702+0000","last_unstale":"2023-11-08T19:23:06.565054+0000","last_undegraded":"2023-11-08T19:23:06.565054+0000","last_fullsized":"2023-11-08T19:23:06.565054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:08:23.765251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.569403+0000","last_change":"2023-11-08T19:23:02.544062+0000","last_active":"2023-11-08T19:23:06.569403+0000","last_peered":"2023-11-08T19:23:06.569403+0000","last_clean":"2023-11-08T19:23:06.569403+0000","last_became_active":"2023-11-08T19:23:02.543731+0000","last_became_peered":"2023-11-08T19:23:02.543731+0000","last_unstale":"2023-11-08T19:23:06.569403+0000","last_undegraded":"2023-11-08T19:23:06.569403+0000","last_fullsized":"2023-11-08T19:23:06.569403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:47:08.776316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.014631+0000","last_change":"2023-11-08T19:23:06.586643+0000","last_active":"2023-11-08T19:23:09.014631+0000","last_peered":"2023-11-08T19:23:09.014631+0000","last_clean":"2023-11-08T19:23:09.014631+0000","last_became_active":"2023-11-08T19:23:06.586257+0000","last_became_peered":"2023-11-08T19:23:06.586257+0000","last_unstale":"2023-11-08T19:23:09.014631+0000","last_undegraded":"2023-11-08T19:23:09.014631+0000","last_fullsized":"2023-11-08T19:23:09.014631+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:22:45.636851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"24'8","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:11.805804+0000","last_change":"2023-11-08T19:23:01.537108+0000","last_active":"2023-11-08T19:23:11.805804+0000","last_peered":"2023-11-08T19:23:11.805804+0000","last_clean":"2023-11-08T19:23:11.805804+0000","last_became_active":"2023-11-08T19:23:01.536695+0000","last_became_peered":"2023-11-08T19:23:01.536695+0000","last_unstale":"2023-11-08T19:23:11.805804+0000","last_undegraded":"2023-11-08T19:23:11.805804+0000","last_fullsized":"2023-11-08T19:23:11.805804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:49:45.790935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3701,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.639812+0000","last_change":"2023-11-08T19:23:02.544703+0000","last_active":"2023-11-08T19:23:06.639812+0000","last_peered":"2023-11-08T19:23:06.639812+0000","last_clean":"2023-11-08T19:23:06.639812+0000","last_became_active":"2023-11-08T19:23:02.543964+0000","last_became_peered":"2023-11-08T19:23:02.543964+0000","last_unstale":"2023-11-08T19:23:06.639812+0000","last_undegraded":"2023-11-08T19:23:06.639812+0000","last_fullsized":"2023-11-08T19:23:06.639812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:07:39.852842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.015350+0000","last_change":"2023-11-08T19:23:06.639882+0000","last_active":"2023-11-08T19:23:09.015350+0000","last_peered":"2023-11-08T19:23:09.015350+0000","last_clean":"2023-11-08T19:23:09.015350+0000","last_became_active":"2023-11-08T19:23:06.639513+0000","last_became_peered":"2023-11-08T19:23:06.639513+0000","last_unstale":"2023-11-08T19:23:09.015350+0000","last_undegraded":"2023-11-08T19:23:09.015350+0000","last_fullsized":"2023-11-08T19:23:09.015350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:04:23.883480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.579599+0000","last_change":"2023-11-08T19:23:01.542024+0000","last_active":"2023-11-08T19:23:06.579599+0000","last_peered":"2023-11-08T19:23:06.579599+0000","last_clean":"2023-11-08T19:23:06.579599+0000","last_became_active":"2023-11-08T19:23:01.541307+0000","last_became_peered":"2023-11-08T19:23:01.541307+0000","last_unstale":"2023-11-08T19:23:06.579599+0000","last_undegraded":"2023-11-08T19:23:06.579599+0000","last_fullsized":"2023-11-08T19:23:06.579599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:07:16.646292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.580444+0000","last_change":"2023-11-08T19:23:02.543049+0000","last_active":"2023-11-08T19:23:06.580444+0000","last_peered":"2023-11-08T19:23:06.580444+0000","last_clean":"2023-11-08T19:23:06.580444+0000","last_became_active":"2023-11-08T19:23:02.542652+0000","last_became_peered":"2023-11-08T19:23:02.542652+0000","last_unstale":"2023-11-08T19:23:06.580444+0000","last_undegraded":"2023-11-08T19:23:06.580444+0000","last_fullsized":"2023-11-08T19:23:06.580444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:43:55.675044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.015406+0000","last_change":"2023-11-08T19:23:06.640235+0000","last_active":"2023-11-08T19:23:09.015406+0000","last_peered":"2023-11-08T19:23:09.015406+0000","last_clean":"2023-11-08T19:23:09.015406+0000","last_became_active":"2023-11-08T19:23:06.639813+0000","last_became_peered":"2023-11-08T19:23:06.639813+0000","last_unstale":"2023-11-08T19:23:09.015406+0000","last_undegraded":"2023-11-08T19:23:09.015406+0000","last_fullsized":"2023-11-08T19:23:09.015406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:11:17.824585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.574994+0000","last_change":"2023-11-08T19:23:01.537071+0000","last_active":"2023-11-08T19:23:06.574994+0000","last_peered":"2023-11-08T19:23:06.574994+0000","last_clean":"2023-11-08T19:23:06.574994+0000","last_became_active":"2023-11-08T19:23:01.536098+0000","last_became_peered":"2023-11-08T19:23:01.536098+0000","last_unstale":"2023-11-08T19:23:06.574994+0000","last_undegraded":"2023-11-08T19:23:06.574994+0000","last_fullsized":"2023-11-08T19:23:06.574994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:57:50.009215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.640434+0000","last_change":"2023-11-08T19:23:02.543183+0000","last_active":"2023-11-08T19:23:06.640434+0000","last_peered":"2023-11-08T19:23:06.640434+0000","last_clean":"2023-11-08T19:23:06.640434+0000","last_became_active":"2023-11-08T19:23:02.542928+0000","last_became_peered":"2023-11-08T19:23:02.542928+0000","last_unstale":"2023-11-08T19:23:06.640434+0000","last_undegraded":"2023-11-08T19:23:06.640434+0000","last_fullsized":"2023-11-08T19:23:06.640434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:11:58.093408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.015907+0000","last_change":"2023-11-08T19:23:06.642851+0000","last_active":"2023-11-08T19:23:09.015907+0000","last_peered":"2023-11-08T19:23:09.015907+0000","last_clean":"2023-11-08T19:23:09.015907+0000","last_became_active":"2023-11-08T19:23:06.642494+0000","last_became_peered":"2023-11-08T19:23:06.642494+0000","last_unstale":"2023-11-08T19:23:09.015907+0000","last_undegraded":"2023-11-08T19:23:09.015907+0000","last_fullsized":"2023-11-08T19:23:09.015907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:56:41.083975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.565079+0000","last_change":"2023-11-08T19:23:01.531395+0000","last_active":"2023-11-08T19:23:06.565079+0000","last_peered":"2023-11-08T19:23:06.565079+0000","last_clean":"2023-11-08T19:23:06.565079+0000","last_became_active":"2023-11-08T19:23:01.531114+0000","last_became_peered":"2023-11-08T19:23:01.531114+0000","last_unstale":"2023-11-08T19:23:06.565079+0000","last_undegraded":"2023-11-08T19:23:06.565079+0000","last_fullsized":"2023-11-08T19:23:06.565079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:28:21.147246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.565518+0000","last_change":"2023-11-08T19:23:02.539528+0000","last_active":"2023-11-08T19:23:06.565518+0000","last_peered":"2023-11-08T19:23:06.565518+0000","last_clean":"2023-11-08T19:23:06.565518+0000","last_became_active":"2023-11-08T19:23:02.539287+0000","last_became_peered":"2023-11-08T19:23:02.539287+0000","last_unstale":"2023-11-08T19:23:06.565518+0000","last_undegraded":"2023-11-08T19:23:06.565518+0000","last_fullsized":"2023-11-08T19:23:06.565518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:57:51.015184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.014311+0000","last_change":"2023-11-08T19:23:06.592797+0000","last_active":"2023-11-08T19:23:09.014311+0000","last_peered":"2023-11-08T19:23:09.014311+0000","last_clean":"2023-11-08T19:23:09.014311+0000","last_became_active":"2023-11-08T19:23:06.592322+0000","last_became_peered":"2023-11-08T19:23:06.592322+0000","last_unstale":"2023-11-08T19:23:09.014311+0000","last_undegraded":"2023-11-08T19:23:09.014311+0000","last_fullsized":"2023-11-08T19:23:09.014311+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:00:52.733076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.571985+0000","last_change":"2023-11-08T19:23:01.534386+0000","last_active":"2023-11-08T19:23:06.571985+0000","last_peered":"2023-11-08T19:23:06.571985+0000","last_clean":"2023-11-08T19:23:06.571985+0000","last_became_active":"2023-11-08T19:23:01.534065+0000","last_became_peered":"2023-11-08T19:23:01.534065+0000","last_unstale":"2023-11-08T19:23:06.571985+0000","last_undegraded":"2023-11-08T19:23:06.571985+0000","last_fullsized":"2023-11-08T19:23:06.571985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:27:47.069795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.638816+0000","last_change":"2023-11-08T19:23:02.542014+0000","last_active":"2023-11-08T19:23:06.638816+0000","last_peered":"2023-11-08T19:23:06.638816+0000","last_clean":"2023-11-08T19:23:06.638816+0000","last_became_active":"2023-11-08T19:23:02.541699+0000","last_became_peered":"2023-11-08T19:23:02.541699+0000","last_unstale":"2023-11-08T19:23:06.638816+0000","last_undegraded":"2023-11-08T19:23:06.638816+0000","last_fullsized":"2023-11-08T19:23:06.638816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:58:59.199208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:07.567280+0000","last_change":"2023-11-08T19:23:06.581489+0000","last_active":"2023-11-08T19:23:07.567280+0000","last_peered":"2023-11-08T19:23:07.567280+0000","last_clean":"2023-11-08T19:23:07.567280+0000","last_became_active":"2023-11-08T19:23:06.581010+0000","last_became_peered":"2023-11-08T19:23:06.581010+0000","last_unstale":"2023-11-08T19:23:07.567280+0000","last_undegraded":"2023-11-08T19:23:07.567280+0000","last_fullsized":"2023-11-08T19:23:07.567280+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:44:42.152662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.572396+0000","last_change":"2023-11-08T19:23:01.539745+0000","last_active":"2023-11-08T19:23:06.572396+0000","last_peered":"2023-11-08T19:23:06.572396+0000","last_clean":"2023-11-08T19:23:06.572396+0000","last_became_active":"2023-11-08T19:23:01.539413+0000","last_became_peered":"2023-11-08T19:23:01.539413+0000","last_unstale":"2023-11-08T19:23:06.572396+0000","last_undegraded":"2023-11-08T19:23:06.572396+0000","last_fullsized":"2023-11-08T19:23:06.572396+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:29:59.299789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.640045+0000","last_change":"2023-11-08T19:23:02.551120+0000","last_active":"2023-11-08T19:23:06.640045+0000","last_peered":"2023-11-08T19:23:06.640045+0000","last_clean":"2023-11-08T19:23:06.640045+0000","last_became_active":"2023-11-08T19:23:02.550824+0000","last_became_peered":"2023-11-08T19:23:02.550824+0000","last_unstale":"2023-11-08T19:23:06.640045+0000","last_undegraded":"2023-11-08T19:23:06.640045+0000","last_fullsized":"2023-11-08T19:23:06.640045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:57:32.301401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.014492+0000","last_change":"2023-11-08T19:23:06.587021+0000","last_active":"2023-11-08T19:23:09.014492+0000","last_peered":"2023-11-08T19:23:09.014492+0000","last_clean":"2023-11-08T19:23:09.014492+0000","last_became_active":"2023-11-08T19:23:06.586659+0000","last_became_peered":"2023-11-08T19:23:06.586659+0000","last_unstale":"2023-11-08T19:23:09.014492+0000","last_undegraded":"2023-11-08T19:23:09.014492+0000","last_fullsized":"2023-11-08T19:23:09.014492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:57:36.344289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.564688+0000","last_change":"2023-11-08T19:23:01.539782+0000","last_active":"2023-11-08T19:23:06.564688+0000","last_peered":"2023-11-08T19:23:06.564688+0000","last_clean":"2023-11-08T19:23:06.564688+0000","last_became_active":"2023-11-08T19:23:01.539493+0000","last_became_peered":"2023-11-08T19:23:01.539493+0000","last_unstale":"2023-11-08T19:23:06.564688+0000","last_undegraded":"2023-11-08T19:23:06.564688+0000","last_fullsized":"2023-11-08T19:23:06.564688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:45:54.766612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.576303+0000","last_change":"2023-11-08T19:23:02.540720+0000","last_active":"2023-11-08T19:23:06.576303+0000","last_peered":"2023-11-08T19:23:06.576303+0000","last_clean":"2023-11-08T19:23:06.576303+0000","last_became_active":"2023-11-08T19:23:02.540438+0000","last_became_peered":"2023-11-08T19:23:02.540438+0000","last_unstale":"2023-11-08T19:23:06.576303+0000","last_undegraded":"2023-11-08T19:23:06.576303+0000","last_fullsized":"2023-11-08T19:23:06.576303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:07:39.852842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.014689+0000","last_change":"2023-11-08T19:23:06.590376+0000","last_active":"2023-11-08T19:23:09.014689+0000","last_peered":"2023-11-08T19:23:09.014689+0000","last_clean":"2023-11-08T19:23:09.014689+0000","last_became_active":"2023-11-08T19:23:06.590037+0000","last_became_peered":"2023-11-08T19:23:06.590037+0000","last_unstale":"2023-11-08T19:23:09.014689+0000","last_undegraded":"2023-11-08T19:23:09.014689+0000","last_fullsized":"2023-11-08T19:23:09.014689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:02:22.908243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.574893+0000","last_change":"2023-11-08T19:23:01.534469+0000","last_active":"2023-11-08T19:23:06.574893+0000","last_peered":"2023-11-08T19:23:06.574893+0000","last_clean":"2023-11-08T19:23:06.574893+0000","last_became_active":"2023-11-08T19:23:01.534138+0000","last_became_peered":"2023-11-08T19:23:01.534138+0000","last_unstale":"2023-11-08T19:23:06.574893+0000","last_undegraded":"2023-11-08T19:23:06.574893+0000","last_fullsized":"2023-11-08T19:23:06.574893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:49:45.790935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.572089+0000","last_change":"2023-11-08T19:23:02.542108+0000","last_active":"2023-11-08T19:23:06.572089+0000","last_peered":"2023-11-08T19:23:06.572089+0000","last_clean":"2023-11-08T19:23:06.572089+0000","last_became_active":"2023-11-08T19:23:02.541821+0000","last_became_peered":"2023-11-08T19:23:02.541821+0000","last_unstale":"2023-11-08T19:23:06.572089+0000","last_undegraded":"2023-11-08T19:23:06.572089+0000","last_fullsized":"2023-11-08T19:23:06.572089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:28:22.153214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.014620+0000","last_change":"2023-11-08T19:23:06.588541+0000","last_active":"2023-11-08T19:23:09.014620+0000","last_peered":"2023-11-08T19:23:09.014620+0000","last_clean":"2023-11-08T19:23:09.014620+0000","last_became_active":"2023-11-08T19:23:06.588061+0000","last_became_peered":"2023-11-08T19:23:06.588061+0000","last_unstale":"2023-11-08T19:23:09.014620+0000","last_undegraded":"2023-11-08T19:23:09.014620+0000","last_fullsized":"2023-11-08T19:23:09.014620+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:12:02.136296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.563850+0000","last_change":"2023-11-08T19:23:02.538424+0000","last_active":"2023-11-08T19:23:06.563850+0000","last_peered":"2023-11-08T19:23:06.563850+0000","last_clean":"2023-11-08T19:23:06.563850+0000","last_became_active":"2023-11-08T19:23:02.538207+0000","last_became_peered":"2023-11-08T19:23:02.538207+0000","last_unstale":"2023-11-08T19:23:06.563850+0000","last_undegraded":"2023-11-08T19:23:06.563850+0000","last_fullsized":"2023-11-08T19:23:06.563850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:57:51.015184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.572118+0000","last_change":"2023-11-08T19:23:01.537154+0000","last_active":"2023-11-08T19:23:06.572118+0000","last_peered":"2023-11-08T19:23:06.572118+0000","last_clean":"2023-11-08T19:23:06.572118+0000","last_became_active":"2023-11-08T19:23:01.536883+0000","last_became_peered":"2023-11-08T19:23:01.536883+0000","last_unstale":"2023-11-08T19:23:06.572118+0000","last_undegraded":"2023-11-08T19:23:06.572118+0000","last_fullsized":"2023-11-08T19:23:06.572118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:35:12.900048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:07.566888+0000","last_change":"2023-11-08T19:23:06.641281+0000","last_active":"2023-11-08T19:23:07.566888+0000","last_peered":"2023-11-08T19:23:07.566888+0000","last_clean":"2023-11-08T19:23:07.566888+0000","last_became_active":"2023-11-08T19:23:06.640919+0000","last_became_peered":"2023-11-08T19:23:06.640919+0000","last_unstale":"2023-11-08T19:23:07.566888+0000","last_undegraded":"2023-11-08T19:23:07.566888+0000","last_fullsized":"2023-11-08T19:23:07.566888+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:12:02.136296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.574338+0000","last_change":"2023-11-08T19:23:02.551226+0000","last_active":"2023-11-08T19:23:06.574338+0000","last_peered":"2023-11-08T19:23:06.574338+0000","last_clean":"2023-11-08T19:23:06.574338+0000","last_became_active":"2023-11-08T19:23:02.550970+0000","last_became_peered":"2023-11-08T19:23:02.550970+0000","last_unstale":"2023-11-08T19:23:06.574338+0000","last_undegraded":"2023-11-08T19:23:06.574338+0000","last_fullsized":"2023-11-08T19:23:06.574338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:32:49.846143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.576524+0000","last_change":"2023-11-08T19:23:01.533619+0000","last_active":"2023-11-08T19:23:06.576524+0000","last_peered":"2023-11-08T19:23:06.576524+0000","last_clean":"2023-11-08T19:23:06.576524+0000","last_became_active":"2023-11-08T19:23:01.532909+0000","last_became_peered":"2023-11-08T19:23:01.532909+0000","last_unstale":"2023-11-08T19:23:06.576524+0000","last_undegraded":"2023-11-08T19:23:06.576524+0000","last_fullsized":"2023-11-08T19:23:06.576524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:28:21.147246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.636980+0000","last_change":"2023-11-08T19:22:58.054283+0000","last_active":"2023-11-08T19:23:06.636980+0000","last_peered":"2023-11-08T19:23:06.636980+0000","last_clean":"2023-11-08T19:23:06.636980+0000","last_became_active":"2023-11-08T19:22:58.053337+0000","last_became_peered":"2023-11-08T19:22:58.053337+0000","last_unstale":"2023-11-08T19:23:06.636980+0000","last_undegraded":"2023-11-08T19:23:06.636980+0000","last_fullsized":"2023-11-08T19:23:06.636980+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:22:56.479654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:22:56.479654+0000","last_clean_scrub_stamp":"2023-11-08T19:22:56.479654+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:16:05.317001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.014474+0000","last_change":"2023-11-08T19:23:06.638413+0000","last_active":"2023-11-08T19:23:09.014474+0000","last_peered":"2023-11-08T19:23:09.014474+0000","last_clean":"2023-11-08T19:23:09.014474+0000","last_became_active":"2023-11-08T19:23:06.638031+0000","last_became_peered":"2023-11-08T19:23:06.638031+0000","last_unstale":"2023-11-08T19:23:09.014474+0000","last_undegraded":"2023-11-08T19:23:09.014474+0000","last_fullsized":"2023-11-08T19:23:09.014474+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:57:36.344289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.569505+0000","last_change":"2023-11-08T19:23:02.534618+0000","last_active":"2023-11-08T19:23:06.569505+0000","last_peered":"2023-11-08T19:23:06.569505+0000","last_clean":"2023-11-08T19:23:06.569505+0000","last_became_active":"2023-11-08T19:23:02.534330+0000","last_became_peered":"2023-11-08T19:23:02.534330+0000","last_unstale":"2023-11-08T19:23:06.569505+0000","last_undegraded":"2023-11-08T19:23:06.569505+0000","last_fullsized":"2023-11-08T19:23:06.569505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:45:55.772580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.637061+0000","last_change":"2023-11-08T19:23:01.540830+0000","last_active":"2023-11-08T19:23:06.637061+0000","last_peered":"2023-11-08T19:23:06.637061+0000","last_clean":"2023-11-08T19:23:06.637061+0000","last_became_active":"2023-11-08T19:23:01.540497+0000","last_became_peered":"2023-11-08T19:23:01.540497+0000","last_unstale":"2023-11-08T19:23:06.637061+0000","last_undegraded":"2023-11-08T19:23:06.637061+0000","last_fullsized":"2023-11-08T19:23:06.637061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:44:28.225190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.014795+0000","last_change":"2023-11-08T19:23:06.638492+0000","last_active":"2023-11-08T19:23:09.014795+0000","last_peered":"2023-11-08T19:23:09.014795+0000","last_clean":"2023-11-08T19:23:09.014795+0000","last_became_active":"2023-11-08T19:23:06.637973+0000","last_became_peered":"2023-11-08T19:23:06.637973+0000","last_unstale":"2023-11-08T19:23:09.014795+0000","last_undegraded":"2023-11-08T19:23:09.014795+0000","last_fullsized":"2023-11-08T19:23:09.014795+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:22:45.636851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.639665+0000","last_change":"2023-11-08T19:23:01.541030+0000","last_active":"2023-11-08T19:23:06.639665+0000","last_peered":"2023-11-08T19:23:06.639665+0000","last_clean":"2023-11-08T19:23:06.639665+0000","last_became_active":"2023-11-08T19:23:01.540713+0000","last_became_peered":"2023-11-08T19:23:01.540713+0000","last_unstale":"2023-11-08T19:23:06.639665+0000","last_undegraded":"2023-11-08T19:23:06.639665+0000","last_fullsized":"2023-11-08T19:23:06.639665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:49:45.790935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.564785+0000","last_change":"2023-11-08T19:23:02.534477+0000","last_active":"2023-11-08T19:23:06.564785+0000","last_peered":"2023-11-08T19:23:06.564785+0000","last_clean":"2023-11-08T19:23:06.564785+0000","last_became_active":"2023-11-08T19:23:02.534220+0000","last_became_peered":"2023-11-08T19:23:02.534220+0000","last_unstale":"2023-11-08T19:23:06.564785+0000","last_undegraded":"2023-11-08T19:23:06.564785+0000","last_fullsized":"2023-11-08T19:23:06.564785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:24:27.669240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.014669+0000","last_change":"2023-11-08T19:23:06.642788+0000","last_active":"2023-11-08T19:23:09.014669+0000","last_peered":"2023-11-08T19:23:09.014669+0000","last_clean":"2023-11-08T19:23:09.014669+0000","last_became_active":"2023-11-08T19:23:06.642353+0000","last_became_peered":"2023-11-08T19:23:06.642353+0000","last_unstale":"2023-11-08T19:23:09.014669+0000","last_undegraded":"2023-11-08T19:23:09.014669+0000","last_fullsized":"2023-11-08T19:23:09.014669+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:33:01.642232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.564741+0000","last_change":"2023-11-08T19:23:01.534206+0000","last_active":"2023-11-08T19:23:06.564741+0000","last_peered":"2023-11-08T19:23:06.564741+0000","last_clean":"2023-11-08T19:23:06.564741+0000","last_became_active":"2023-11-08T19:23:01.533951+0000","last_became_peered":"2023-11-08T19:23:01.533951+0000","last_unstale":"2023-11-08T19:23:06.564741+0000","last_undegraded":"2023-11-08T19:23:06.564741+0000","last_fullsized":"2023-11-08T19:23:06.564741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:52:26.893730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.572311+0000","last_change":"2023-11-08T19:23:02.543044+0000","last_active":"2023-11-08T19:23:06.572311+0000","last_peered":"2023-11-08T19:23:06.572311+0000","last_clean":"2023-11-08T19:23:06.572311+0000","last_became_active":"2023-11-08T19:23:02.542767+0000","last_became_peered":"2023-11-08T19:23:02.542767+0000","last_unstale":"2023-11-08T19:23:06.572311+0000","last_undegraded":"2023-11-08T19:23:06.572311+0000","last_fullsized":"2023-11-08T19:23:06.572311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:07:39.852842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:07.567464+0000","last_change":"2023-11-08T19:23:06.638770+0000","last_active":"2023-11-08T19:23:07.567464+0000","last_peered":"2023-11-08T19:23:07.567464+0000","last_clean":"2023-11-08T19:23:07.567464+0000","last_became_active":"2023-11-08T19:23:06.638045+0000","last_became_peered":"2023-11-08T19:23:06.638045+0000","last_unstale":"2023-11-08T19:23:07.567464+0000","last_undegraded":"2023-11-08T19:23:07.567464+0000","last_fullsized":"2023-11-08T19:23:07.567464+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:15:27.237227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.565881+0000","last_change":"2023-11-08T19:23:01.541938+0000","last_active":"2023-11-08T19:23:06.565881+0000","last_peered":"2023-11-08T19:23:06.565881+0000","last_clean":"2023-11-08T19:23:06.565881+0000","last_became_active":"2023-11-08T19:23:01.541534+0000","last_became_peered":"2023-11-08T19:23:01.541534+0000","last_unstale":"2023-11-08T19:23:06.565881+0000","last_undegraded":"2023-11-08T19:23:06.565881+0000","last_fullsized":"2023-11-08T19:23:06.565881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:47:07.770348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.578982+0000","last_change":"2023-11-08T19:23:02.538688+0000","last_active":"2023-11-08T19:23:06.578982+0000","last_peered":"2023-11-08T19:23:06.578982+0000","last_clean":"2023-11-08T19:23:06.578982+0000","last_became_active":"2023-11-08T19:23:02.538406+0000","last_became_peered":"2023-11-08T19:23:02.538406+0000","last_unstale":"2023-11-08T19:23:06.578982+0000","last_undegraded":"2023-11-08T19:23:06.578982+0000","last_fullsized":"2023-11-08T19:23:06.578982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:24:27.669240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:07.568066+0000","last_change":"2023-11-08T19:23:06.586884+0000","last_active":"2023-11-08T19:23:07.568066+0000","last_peered":"2023-11-08T19:23:07.568066+0000","last_clean":"2023-11-08T19:23:07.568066+0000","last_became_active":"2023-11-08T19:23:06.585724+0000","last_became_peered":"2023-11-08T19:23:06.585724+0000","last_unstale":"2023-11-08T19:23:07.568066+0000","last_undegraded":"2023-11-08T19:23:07.568066+0000","last_fullsized":"2023-11-08T19:23:07.568066+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:50:37.550320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.636980+0000","last_change":"2023-11-08T19:23:01.541119+0000","last_active":"2023-11-08T19:23:06.636980+0000","last_peered":"2023-11-08T19:23:06.636980+0000","last_clean":"2023-11-08T19:23:06.636980+0000","last_became_active":"2023-11-08T19:23:01.540784+0000","last_became_peered":"2023-11-08T19:23:01.540784+0000","last_unstale":"2023-11-08T19:23:06.636980+0000","last_undegraded":"2023-11-08T19:23:06.636980+0000","last_fullsized":"2023-11-08T19:23:06.636980+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:47:07.770348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.567795+0000","last_change":"2023-11-08T19:23:02.536086+0000","last_active":"2023-11-08T19:23:06.567795+0000","last_peered":"2023-11-08T19:23:06.567795+0000","last_clean":"2023-11-08T19:23:06.567795+0000","last_became_active":"2023-11-08T19:23:02.535129+0000","last_became_peered":"2023-11-08T19:23:02.535129+0000","last_unstale":"2023-11-08T19:23:06.567795+0000","last_undegraded":"2023-11-08T19:23:06.567795+0000","last_fullsized":"2023-11-08T19:23:06.567795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:01:17.694162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.014391+0000","last_change":"2023-11-08T19:23:06.639503+0000","last_active":"2023-11-08T19:23:09.014391+0000","last_peered":"2023-11-08T19:23:09.014391+0000","last_clean":"2023-11-08T19:23:09.014391+0000","last_became_active":"2023-11-08T19:23:06.639076+0000","last_became_peered":"2023-11-08T19:23:06.639076+0000","last_unstale":"2023-11-08T19:23:09.014391+0000","last_undegraded":"2023-11-08T19:23:09.014391+0000","last_fullsized":"2023-11-08T19:23:09.014391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:00:52.733076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.563944+0000","last_change":"2023-11-08T19:23:01.539723+0000","last_active":"2023-11-08T19:23:06.563944+0000","last_peered":"2023-11-08T19:23:06.563944+0000","last_clean":"2023-11-08T19:23:06.563944+0000","last_became_active":"2023-11-08T19:23:01.539435+0000","last_became_peered":"2023-11-08T19:23:01.539435+0000","last_unstale":"2023-11-08T19:23:06.563944+0000","last_undegraded":"2023-11-08T19:23:06.563944+0000","last_fullsized":"2023-11-08T19:23:06.563944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:01:16.688194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.571014+0000","last_change":"2023-11-08T19:23:02.539571+0000","last_active":"2023-11-08T19:23:06.571014+0000","last_peered":"2023-11-08T19:23:06.571014+0000","last_clean":"2023-11-08T19:23:06.571014+0000","last_became_active":"2023-11-08T19:23:02.539301+0000","last_became_peered":"2023-11-08T19:23:02.539301+0000","last_unstale":"2023-11-08T19:23:06.571014+0000","last_undegraded":"2023-11-08T19:23:06.571014+0000","last_fullsized":"2023-11-08T19:23:06.571014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:24:27.669240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:07.567147+0000","last_change":"2023-11-08T19:23:06.590255+0000","last_active":"2023-11-08T19:23:07.567147+0000","last_peered":"2023-11-08T19:23:07.567147+0000","last_clean":"2023-11-08T19:23:07.567147+0000","last_became_active":"2023-11-08T19:23:06.589834+0000","last_became_peered":"2023-11-08T19:23:06.589834+0000","last_unstale":"2023-11-08T19:23:07.567147+0000","last_undegraded":"2023-11-08T19:23:07.567147+0000","last_fullsized":"2023-11-08T19:23:07.567147+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:04:24.855880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.564072+0000","last_change":"2023-11-08T19:23:01.536694+0000","last_active":"2023-11-08T19:23:06.564072+0000","last_peered":"2023-11-08T19:23:06.564072+0000","last_clean":"2023-11-08T19:23:06.564072+0000","last_became_active":"2023-11-08T19:23:01.535913+0000","last_became_peered":"2023-11-08T19:23:01.535913+0000","last_unstale":"2023-11-08T19:23:06.564072+0000","last_undegraded":"2023-11-08T19:23:06.564072+0000","last_fullsized":"2023-11-08T19:23:06.564072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:43:54.669075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.573361+0000","last_change":"2023-11-08T19:23:02.533243+0000","last_active":"2023-11-08T19:23:06.573361+0000","last_peered":"2023-11-08T19:23:06.573361+0000","last_clean":"2023-11-08T19:23:06.573361+0000","last_became_active":"2023-11-08T19:23:02.532725+0000","last_became_peered":"2023-11-08T19:23:02.532725+0000","last_unstale":"2023-11-08T19:23:06.573361+0000","last_undegraded":"2023-11-08T19:23:06.573361+0000","last_fullsized":"2023-11-08T19:23:06.573361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:04:20.812993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:07.567627+0000","last_change":"2023-11-08T19:23:06.586805+0000","last_active":"2023-11-08T19:23:07.567627+0000","last_peered":"2023-11-08T19:23:07.567627+0000","last_clean":"2023-11-08T19:23:07.567627+0000","last_became_active":"2023-11-08T19:23:06.586388+0000","last_became_peered":"2023-11-08T19:23:06.586388+0000","last_unstale":"2023-11-08T19:23:07.567627+0000","last_undegraded":"2023-11-08T19:23:07.567627+0000","last_fullsized":"2023-11-08T19:23:07.567627+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:11:18.742854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.640533+0000","last_change":"2023-11-08T19:23:01.540491+0000","last_active":"2023-11-08T19:23:06.640533+0000","last_peered":"2023-11-08T19:23:06.640533+0000","last_clean":"2023-11-08T19:23:06.640533+0000","last_became_active":"2023-11-08T19:23:01.540175+0000","last_became_peered":"2023-11-08T19:23:01.540175+0000","last_unstale":"2023-11-08T19:23:06.640533+0000","last_undegraded":"2023-11-08T19:23:06.640533+0000","last_fullsized":"2023-11-08T19:23:06.640533+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:52:26.893730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.565419+0000","last_change":"2023-11-08T19:23:02.542218+0000","last_active":"2023-11-08T19:23:06.565419+0000","last_peered":"2023-11-08T19:23:06.565419+0000","last_clean":"2023-11-08T19:23:06.565419+0000","last_became_active":"2023-11-08T19:23:02.541912+0000","last_became_peered":"2023-11-08T19:23:02.541912+0000","last_unstale":"2023-11-08T19:23:06.565419+0000","last_undegraded":"2023-11-08T19:23:06.565419+0000","last_fullsized":"2023-11-08T19:23:06.565419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:04:20.812993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:07.567162+0000","last_change":"2023-11-08T19:23:06.641692+0000","last_active":"2023-11-08T19:23:07.567162+0000","last_peered":"2023-11-08T19:23:07.567162+0000","last_clean":"2023-11-08T19:23:07.567162+0000","last_became_active":"2023-11-08T19:23:06.640996+0000","last_became_peered":"2023-11-08T19:23:06.640996+0000","last_unstale":"2023-11-08T19:23:07.567162+0000","last_undegraded":"2023-11-08T19:23:07.567162+0000","last_fullsized":"2023-11-08T19:23:07.567162+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:00:52.733076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.574648+0000","last_change":"2023-11-08T19:23:01.538965+0000","last_active":"2023-11-08T19:23:06.574648+0000","last_peered":"2023-11-08T19:23:06.574648+0000","last_clean":"2023-11-08T19:23:06.574648+0000","last_became_active":"2023-11-08T19:23:01.538635+0000","last_became_peered":"2023-11-08T19:23:01.538635+0000","last_unstale":"2023-11-08T19:23:06.574648+0000","last_undegraded":"2023-11-08T19:23:06.574648+0000","last_fullsized":"2023-11-08T19:23:06.574648+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:33:16.511242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.639757+0000","last_change":"2023-11-08T19:23:02.549229+0000","last_active":"2023-11-08T19:23:06.639757+0000","last_peered":"2023-11-08T19:23:06.639757+0000","last_clean":"2023-11-08T19:23:06.639757+0000","last_became_active":"2023-11-08T19:23:02.548974+0000","last_became_peered":"2023-11-08T19:23:02.548974+0000","last_unstale":"2023-11-08T19:23:06.639757+0000","last_undegraded":"2023-11-08T19:23:06.639757+0000","last_fullsized":"2023-11-08T19:23:06.639757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:50:33.507433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.015704+0000","last_change":"2023-11-08T19:23:06.593697+0000","last_active":"2023-11-08T19:23:09.015704+0000","last_peered":"2023-11-08T19:23:09.015704+0000","last_clean":"2023-11-08T19:23:09.015704+0000","last_became_active":"2023-11-08T19:23:06.593382+0000","last_became_peered":"2023-11-08T19:23:06.593382+0000","last_unstale":"2023-11-08T19:23:09.015704+0000","last_undegraded":"2023-11-08T19:23:09.015704+0000","last_fullsized":"2023-11-08T19:23:09.015704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:02:22.908243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.564800+0000","last_change":"2023-11-08T19:23:01.530532+0000","last_active":"2023-11-08T19:23:06.564800+0000","last_peered":"2023-11-08T19:23:06.564800+0000","last_clean":"2023-11-08T19:23:06.564800+0000","last_became_active":"2023-11-08T19:23:01.530253+0000","last_became_peered":"2023-11-08T19:23:01.530253+0000","last_unstale":"2023-11-08T19:23:06.564800+0000","last_undegraded":"2023-11-08T19:23:06.564800+0000","last_fullsized":"2023-11-08T19:23:06.564800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:55.765637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.575825+0000","last_change":"2023-11-08T19:23:02.540301+0000","last_active":"2023-11-08T19:23:06.575825+0000","last_peered":"2023-11-08T19:23:06.575825+0000","last_clean":"2023-11-08T19:23:06.575825+0000","last_became_active":"2023-11-08T19:23:02.539679+0000","last_became_peered":"2023-11-08T19:23:02.539679+0000","last_unstale":"2023-11-08T19:23:06.575825+0000","last_undegraded":"2023-11-08T19:23:06.575825+0000","last_fullsized":"2023-11-08T19:23:06.575825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:11:14.699967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.014285+0000","last_change":"2023-11-08T19:23:06.638442+0000","last_active":"2023-11-08T19:23:09.014285+0000","last_peered":"2023-11-08T19:23:09.014285+0000","last_clean":"2023-11-08T19:23:09.014285+0000","last_became_active":"2023-11-08T19:23:06.638018+0000","last_became_peered":"2023-11-08T19:23:06.638018+0000","last_unstale":"2023-11-08T19:23:09.014285+0000","last_undegraded":"2023-11-08T19:23:09.014285+0000","last_fullsized":"2023-11-08T19:23:09.014285+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:14:35.302430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.575081+0000","last_change":"2023-11-08T19:23:01.537610+0000","last_active":"2023-11-08T19:23:06.575081+0000","last_peered":"2023-11-08T19:23:06.575081+0000","last_clean":"2023-11-08T19:23:06.575081+0000","last_became_active":"2023-11-08T19:23:01.537341+0000","last_became_peered":"2023-11-08T19:23:01.537341+0000","last_unstale":"2023-11-08T19:23:06.575081+0000","last_undegraded":"2023-11-08T19:23:06.575081+0000","last_fullsized":"2023-11-08T19:23:06.575081+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:01:16.688194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.640258+0000","last_change":"2023-11-08T19:23:02.551858+0000","last_active":"2023-11-08T19:23:06.640258+0000","last_peered":"2023-11-08T19:23:06.640258+0000","last_clean":"2023-11-08T19:23:06.640258+0000","last_became_active":"2023-11-08T19:23:02.551054+0000","last_became_peered":"2023-11-08T19:23:02.551054+0000","last_unstale":"2023-11-08T19:23:06.640258+0000","last_undegraded":"2023-11-08T19:23:06.640258+0000","last_fullsized":"2023-11-08T19:23:06.640258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:00:48.690189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.565678+0000","last_change":"2023-11-08T19:23:02.545805+0000","last_active":"2023-11-08T19:23:06.565678+0000","last_peered":"2023-11-08T19:23:06.565678+0000","last_clean":"2023-11-08T19:23:06.565678+0000","last_became_active":"2023-11-08T19:23:02.545540+0000","last_became_peered":"2023-11-08T19:23:02.545540+0000","last_unstale":"2023-11-08T19:23:06.565678+0000","last_undegraded":"2023-11-08T19:23:06.565678+0000","last_fullsized":"2023-11-08T19:23:06.565678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:15:23.194339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.572161+0000","last_change":"2023-11-08T19:23:02.537513+0000","last_active":"2023-11-08T19:23:06.572161+0000","last_peered":"2023-11-08T19:23:06.572161+0000","last_clean":"2023-11-08T19:23:06.572161+0000","last_became_active":"2023-11-08T19:23:02.537192+0000","last_became_peered":"2023-11-08T19:23:02.537192+0000","last_unstale":"2023-11-08T19:23:06.572161+0000","last_undegraded":"2023-11-08T19:23:06.572161+0000","last_fullsized":"2023-11-08T19:23:06.572161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:47:08.776316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.575099+0000","last_change":"2023-11-08T19:23:02.537846+0000","last_active":"2023-11-08T19:23:06.575099+0000","last_peered":"2023-11-08T19:23:06.575099+0000","last_clean":"2023-11-08T19:23:06.575099+0000","last_became_active":"2023-11-08T19:23:02.537585+0000","last_became_peered":"2023-11-08T19:23:02.537585+0000","last_unstale":"2023-11-08T19:23:06.575099+0000","last_undegraded":"2023-11-08T19:23:06.575099+0000","last_fullsized":"2023-11-08T19:23:06.575099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:11:58.093408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.579334+0000","last_change":"2023-11-08T19:23:02.536724+0000","last_active":"2023-11-08T19:23:06.579334+0000","last_peered":"2023-11-08T19:23:06.579334+0000","last_clean":"2023-11-08T19:23:06.579334+0000","last_became_active":"2023-11-08T19:23:02.536080+0000","last_became_peered":"2023-11-08T19:23:02.536080+0000","last_unstale":"2023-11-08T19:23:06.579334+0000","last_undegraded":"2023-11-08T19:23:06.579334+0000","last_fullsized":"2023-11-08T19:23:06.579334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:56:02.594198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.576167+0000","last_change":"2023-11-08T19:23:02.531764+0000","last_active":"2023-11-08T19:23:06.576167+0000","last_peered":"2023-11-08T19:23:06.576167+0000","last_clean":"2023-11-08T19:23:06.576167+0000","last_became_active":"2023-11-08T19:23:02.531498+0000","last_became_peered":"2023-11-08T19:23:02.531498+0000","last_unstale":"2023-11-08T19:23:06.576167+0000","last_undegraded":"2023-11-08T19:23:06.576167+0000","last_fullsized":"2023-11-08T19:23:06.576167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:15:23.194339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.564703+0000","last_change":"2023-11-08T19:23:02.536652+0000","last_active":"2023-11-08T19:23:06.564703+0000","last_peered":"2023-11-08T19:23:06.564703+0000","last_clean":"2023-11-08T19:23:06.564703+0000","last_became_active":"2023-11-08T19:23:02.536397+0000","last_became_peered":"2023-11-08T19:23:02.536397+0000","last_unstale":"2023-11-08T19:23:06.564703+0000","last_undegraded":"2023-11-08T19:23:06.564703+0000","last_fullsized":"2023-11-08T19:23:06.564703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:32:49.846143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.566386+0000","last_change":"2023-11-08T19:23:02.546101+0000","last_active":"2023-11-08T19:23:06.566386+0000","last_peered":"2023-11-08T19:23:06.566386+0000","last_clean":"2023-11-08T19:23:06.566386+0000","last_became_active":"2023-11-08T19:23:02.545740+0000","last_became_peered":"2023-11-08T19:23:02.545740+0000","last_unstale":"2023-11-08T19:23:06.566386+0000","last_undegraded":"2023-11-08T19:23:06.566386+0000","last_fullsized":"2023-11-08T19:23:06.566386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:56:02.594198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.572386+0000","last_change":"2023-11-08T19:23:02.534052+0000","last_active":"2023-11-08T19:23:06.572386+0000","last_peered":"2023-11-08T19:23:06.572386+0000","last_clean":"2023-11-08T19:23:06.572386+0000","last_became_active":"2023-11-08T19:23:02.533811+0000","last_became_peered":"2023-11-08T19:23:02.533811+0000","last_unstale":"2023-11-08T19:23:06.572386+0000","last_undegraded":"2023-11-08T19:23:06.572386+0000","last_fullsized":"2023-11-08T19:23:06.572386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:44:38.109774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.574607+0000","last_change":"2023-11-08T19:23:02.536926+0000","last_active":"2023-11-08T19:23:06.574607+0000","last_peered":"2023-11-08T19:23:06.574607+0000","last_clean":"2023-11-08T19:23:06.574607+0000","last_became_active":"2023-11-08T19:23:02.536648+0000","last_became_peered":"2023-11-08T19:23:02.536648+0000","last_unstale":"2023-11-08T19:23:06.574607+0000","last_undegraded":"2023-11-08T19:23:06.574607+0000","last_fullsized":"2023-11-08T19:23:06.574607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:56:02.594198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.570954+0000","last_change":"2023-11-08T19:23:02.533095+0000","last_active":"2023-11-08T19:23:06.570954+0000","last_peered":"2023-11-08T19:23:06.570954+0000","last_clean":"2023-11-08T19:23:06.570954+0000","last_became_active":"2023-11-08T19:23:02.532639+0000","last_became_peered":"2023-11-08T19:23:02.532639+0000","last_unstale":"2023-11-08T19:23:06.570954+0000","last_undegraded":"2023-11-08T19:23:06.570954+0000","last_fullsized":"2023-11-08T19:23:06.570954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:56:02.594198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.575154+0000","last_change":"2023-11-08T19:23:02.547407+0000","last_active":"2023-11-08T19:23:06.575154+0000","last_peered":"2023-11-08T19:23:06.575154+0000","last_clean":"2023-11-08T19:23:06.575154+0000","last_became_active":"2023-11-08T19:23:02.545080+0000","last_became_peered":"2023-11-08T19:23:02.545080+0000","last_unstale":"2023-11-08T19:23:06.575154+0000","last_undegraded":"2023-11-08T19:23:06.575154+0000","last_fullsized":"2023-11-08T19:23:06.575154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:57:32.301401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.579417+0000","last_change":"2023-11-08T19:23:02.543982+0000","last_active":"2023-11-08T19:23:06.579417+0000","last_peered":"2023-11-08T19:23:06.579417+0000","last_clean":"2023-11-08T19:23:06.579417+0000","last_became_active":"2023-11-08T19:23:02.543790+0000","last_became_peered":"2023-11-08T19:23:02.543790+0000","last_unstale":"2023-11-08T19:23:06.579417+0000","last_undegraded":"2023-11-08T19:23:06.579417+0000","last_fullsized":"2023-11-08T19:23:06.579417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:57:51.015184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.567500+0000","last_change":"2023-11-08T19:23:02.546682+0000","last_active":"2023-11-08T19:23:06.567500+0000","last_peered":"2023-11-08T19:23:06.567500+0000","last_clean":"2023-11-08T19:23:06.567500+0000","last_became_active":"2023-11-08T19:23:02.546356+0000","last_became_peered":"2023-11-08T19:23:02.546356+0000","last_unstale":"2023-11-08T19:23:06.567500+0000","last_undegraded":"2023-11-08T19:23:06.567500+0000","last_fullsized":"2023-11-08T19:23:06.567500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:32:49.846143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4499,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":851968,"data_stored":690742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":99952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":860160,"data_stored":690798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":99792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":99918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":99882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:23:21.595 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-08T19:23:21.596 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-11-08T19:23:21.596 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-11-08T19:23:21.596 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-11-08T19:23:21.597 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-11-08T19:23:21.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.748+0000 7f8af6b9c700 1 Processor -- start 2023-11-08T19:23:21.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.748+0000 7f8af6b9c700 1 -- start start 2023-11-08T19:23:21.752 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.749+0000 7f8af6b9c700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f8af00cc140 0x7f8af00cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:21.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.749+0000 7f8af6b9c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f8af00b2850 0x7f8af00cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:21.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.749+0000 7f8af6b9c700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8af00cce50 con 0x7f8af00b2cd0 2023-11-08T19:23:21.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.749+0000 7f8af6b9c700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8af00b2430 con 0x7f8af00b2850 2023-11-08T19:23:21.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.749+0000 7f8af6b9c700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8af00cc520 con 0x7f8af00cc140 2023-11-08T19:23:21.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.749+0000 7f8aeffff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f8af00b2850 0x7f8af00cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:21.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.750+0000 7f8aeffff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f8af00b2850 0x7f8af00cabf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37222/0 (socket says 172.21.15.149:37222) 2023-11-08T19:23:21.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.750+0000 7f8aeffff700 1 -- 172.21.15.149:0/3553099503 learned_addr learned my addr 172.21.15.149:0/3553099503 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:21.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.750+0000 7f8af4938700 1 --2- 172.21.15.149:0/3553099503 >> v2:172.21.15.160:3300/0 conn(0x7f8af00cc140 0x7f8af00cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:21.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.750+0000 7f8aeffff700 1 -- 172.21.15.149:0/3553099503 >> v2:172.21.15.160:3300/0 conn(0x7f8af00cc140 msgr2=0x7f8af00cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:21.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.750+0000 7f8aeffff700 1 --2- 172.21.15.149:0/3553099503 >> v2:172.21.15.160:3300/0 conn(0x7f8af00cc140 0x7f8af00cc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:21.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.750+0000 7f8aeffff700 1 -- 172.21.15.149:0/3553099503 >> v1:172.21.15.160:6789/0 conn(0x7f8af00b2cd0 legacy=0x7f8af015d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:21.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.750+0000 7f8aeffff700 1 -- 172.21.15.149:0/3553099503 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8af00b17b0 con 0x7f8af00b2850 2023-11-08T19:23:21.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.750+0000 7f8aeffff700 1 --2- 172.21.15.149:0/3553099503 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8af00b2850 0x7f8af00cabf0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8af00ce120 tx=0x7f8adc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=341099630b4ab852 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:21.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.750+0000 7f8aef7fe700 1 -- 172.21.15.149:0/3553099503 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8adc011830 con 0x7f8af00b2850 2023-11-08T19:23:21.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.750+0000 7f8aef7fe700 1 -- 172.21.15.149:0/3553099503 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8adc011990 con 0x7f8af00b2850 2023-11-08T19:23:21.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.750+0000 7f8aef7fe700 1 -- 172.21.15.149:0/3553099503 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8adc011d20 con 0x7f8af00b2850 2023-11-08T19:23:21.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.751+0000 7f8af6b9c700 1 -- 172.21.15.149:0/3553099503 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8af00b2850 msgr2=0x7f8af00cabf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:21.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.751+0000 7f8af6b9c700 1 --2- 172.21.15.149:0/3553099503 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8af00b2850 0x7f8af00cabf0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8af00ce120 tx=0x7f8adc009bd0 comp rx=0 tx=0).stop 2023-11-08T19:23:21.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.751+0000 7f8af6b9c700 1 -- 172.21.15.149:0/3553099503 shutdown_connections 2023-11-08T19:23:21.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.751+0000 7f8af6b9c700 1 --2- 172.21.15.149:0/3553099503 >> v2:172.21.15.160:3300/0 conn(0x7f8af00cc140 0x7f8af00cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:21.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.751+0000 7f8af6b9c700 1 --2- 172.21.15.149:0/3553099503 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8af00b2850 0x7f8af00cabf0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:21.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.751+0000 7f8af6b9c700 1 -- 172.21.15.149:0/3553099503 >> 172.21.15.149:0/3553099503 conn(0x7f8af0099a40 msgr2=0x7f8af00d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:21.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.751+0000 7f8af6b9c700 1 -- 172.21.15.149:0/3553099503 shutdown_connections 2023-11-08T19:23:21.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.751+0000 7f8af6b9c700 1 -- 172.21.15.149:0/3553099503 wait complete. 2023-11-08T19:23:21.760 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.752+0000 7f8af6b9c700 1 Processor -- start 2023-11-08T19:23:21.760 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.752+0000 7f8af6b9c700 1 -- start start 2023-11-08T19:23:21.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.753+0000 7f8af6b9c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8af00b2850 0x7f8af0155b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:21.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.753+0000 7f8af6b9c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8af00b2cd0 0x7f8af00c85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:21.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.753+0000 7f8af6b9c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8af00cc140 0x7f8af00af8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:21.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.753+0000 7f8af6b9c700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af0156060 con 0x7f8af00b2850 2023-11-08T19:23:21.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.753+0000 7f8af6b9c700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af00c9000 con 0x7f8af00b2cd0 2023-11-08T19:23:21.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.753+0000 7f8af6b9c700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8af00c92e0 con 0x7f8af00cc140 2023-11-08T19:23:21.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.753+0000 7f8af4938700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8af00b2850 0x7f8af0155b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:21.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.753+0000 7f8af4938700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8af00b2850 0x7f8af0155b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37228/0 (socket says 172.21.15.149:37228) 2023-11-08T19:23:21.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.753+0000 7f8af4938700 1 -- 172.21.15.149:0/2623571104 learned_addr learned my addr 172.21.15.149:0/2623571104 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:21.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.753+0000 7f8aeffff700 1 --2- 172.21.15.149:0/2623571104 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8af00b2cd0 0x7f8af00c85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:21.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.753+0000 7f8af5139700 1 --2- 172.21.15.149:0/2623571104 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8af00cc140 0x7f8af00af8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:21.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.753+0000 7f8af4938700 1 -- 172.21.15.149:0/2623571104 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8af00cc140 msgr2=0x7f8af00af8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:21.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.753+0000 7f8af4938700 1 --2- 172.21.15.149:0/2623571104 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8af00cc140 0x7f8af00af8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:21.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.753+0000 7f8af4938700 1 -- 172.21.15.149:0/2623571104 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8af00b2cd0 msgr2=0x7f8af00c85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:21.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.753+0000 7f8af4938700 1 --2- 172.21.15.149:0/2623571104 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8af00b2cd0 0x7f8af00c85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:21.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.753+0000 7f8af4938700 1 -- 172.21.15.149:0/2623571104 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8adc009550 con 0x7f8af00b2850 2023-11-08T19:23:21.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.753+0000 7f8af5139700 1 --2- 172.21.15.149:0/2623571104 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8af00cc140 0x7f8af00af8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:23:21.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.753+0000 7f8aeffff700 1 --2- 172.21.15.149:0/2623571104 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8af00b2cd0 0x7f8af00c85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:23:21.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.754+0000 7f8af4938700 1 --2- 172.21.15.149:0/2623571104 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8af00b2850 0x7f8af0155b20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8ae400e900 tx=0x7f8ae400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:21.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.754+0000 7f8aed7fa700 1 -- 172.21.15.149:0/2623571104 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae4009650 con 0x7f8af00b2850 2023-11-08T19:23:21.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.754+0000 7f8aed7fa700 1 -- 172.21.15.149:0/2623571104 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ae400c850 con 0x7f8af00b2850 2023-11-08T19:23:21.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.754+0000 7f8af6b9c700 1 -- 172.21.15.149:0/2623571104 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8af015cff0 con 0x7f8af00b2850 2023-11-08T19:23:21.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.754+0000 7f8aed7fa700 1 -- 172.21.15.149:0/2623571104 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae400cbc0 con 0x7f8af00b2850 2023-11-08T19:23:21.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.754+0000 7f8af6b9c700 1 -- 172.21.15.149:0/2623571104 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8af015d5b0 con 0x7f8af00b2850 2023-11-08T19:23:21.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.755+0000 7f8af6b9c700 1 -- 172.21.15.149:0/2623571104 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8af00745f0 con 0x7f8af00b2850 2023-11-08T19:23:21.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.755+0000 7f8aed7fa700 1 -- 172.21.15.149:0/2623571104 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8ae400cd20 con 0x7f8af00b2850 2023-11-08T19:23:21.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.755+0000 7f8aed7fa700 1 --2- 172.21.15.149:0/2623571104 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f8ad406af00 0x7f8ad406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:21.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.756+0000 7f8aeffff700 1 --2- 172.21.15.149:0/2623571104 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f8ad406af00 0x7f8ad406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:21.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.756+0000 7f8aed7fa700 1 -- 172.21.15.149:0/2623571104 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8ae4089dc0 con 0x7f8af00b2850 2023-11-08T19:23:21.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.756+0000 7f8aeffff700 1 --2- 172.21.15.149:0/2623571104 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f8ad406af00 0x7f8ad406d3c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8adc009c10 tx=0x7f8adc008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:21.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:21.760+0000 7f8aed7fa700 1 -- 172.21.15.149:0/2623571104 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8ae4054b00 con 0x7f8af00b2850 2023-11-08T19:23:22.006 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.005+0000 7f8af6b9c700 1 -- 172.21.15.149:0/2623571104 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f8af00c3e80 con 0x7f8af00b2850 2023-11-08T19:23:22.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.009+0000 7f8aed7fa700 1 -- 172.21.15.149:0/2623571104 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171038 (secure 0 0 0) 0x7f8ae4058120 con 0x7f8af00b2850 2023-11-08T19:23:22.012 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:23:22.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.011+0000 7f8af6b9c700 1 -- 172.21.15.149:0/2623571104 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f8ad406af00 msgr2=0x7f8ad406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:22.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.011+0000 7f8af6b9c700 1 --2- 172.21.15.149:0/2623571104 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f8ad406af00 0x7f8ad406d3c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8adc009c10 tx=0x7f8adc008030 comp rx=0 tx=0).stop 2023-11-08T19:23:22.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.011+0000 7f8af6b9c700 1 -- 172.21.15.149:0/2623571104 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8af00b2850 msgr2=0x7f8af0155b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:22.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.011+0000 7f8af6b9c700 1 --2- 172.21.15.149:0/2623571104 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8af00b2850 0x7f8af0155b20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8ae400e900 tx=0x7f8ae400ecc0 comp rx=0 tx=0).stop 2023-11-08T19:23:22.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.012+0000 7f8af6b9c700 1 -- 172.21.15.149:0/2623571104 shutdown_connections 2023-11-08T19:23:22.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.012+0000 7f8af6b9c700 1 --2- 172.21.15.149:0/2623571104 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f8ad406af00 0x7f8ad406d3c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:22.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.012+0000 7f8af6b9c700 1 --2- 172.21.15.149:0/2623571104 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8af00cc140 0x7f8af00af8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:22.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.012+0000 7f8af6b9c700 1 --2- 172.21.15.149:0/2623571104 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8af00b2850 0x7f8af0155b20 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:22.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.012+0000 7f8af6b9c700 1 --2- 172.21.15.149:0/2623571104 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8af00b2cd0 0x7f8af00c85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:22.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.012+0000 7f8af6b9c700 1 -- 172.21.15.149:0/2623571104 >> 172.21.15.149:0/2623571104 conn(0x7f8af0099a40 msgr2=0x7f8af00cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:22.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.012+0000 7f8af6b9c700 1 -- 172.21.15.149:0/2623571104 shutdown_connections 2023-11-08T19:23:22.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.012+0000 7f8af6b9c700 1 -- 172.21.15.149:0/2623571104 wait complete. 2023-11-08T19:23:22.025 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":5,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1929837472},{"type":"v1","addr":"172.21.15.149:6833","nonce":1929837472}]},"active_addr":"172.21.15.149:6833/1929837472","active_change":"2023-11-08T19:22:49.966847+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4103,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:v0.0.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:v0.0.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.149:0","nonce":4100729852}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.149:0","nonce":379375476}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.149:0","nonce":2895237681}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.149:0","nonce":3311332152}]}]} 2023-11-08T19:23:22.029 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-11-08T19:23:22.030 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-11-08T19:23:22.030 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:23:22.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.151+0000 7fe252d76700 1 Processor -- start 2023-11-08T19:23:22.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.151+0000 7fe252d76700 1 -- start start 2023-11-08T19:23:22.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.152+0000 7fe252d76700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fe24c0cc140 0x7fe24c0cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:22.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.152+0000 7fe252d76700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe24c0b2850 0x7fe24c0cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:22.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.152+0000 7fe252d76700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe24c0cce50 con 0x7fe24c0b2cd0 2023-11-08T19:23:22.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.152+0000 7fe252d76700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe24c0b2430 con 0x7fe24c0b2850 2023-11-08T19:23:22.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.152+0000 7fe252d76700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe24c0cc520 con 0x7fe24c0cc140 2023-11-08T19:23:22.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.152+0000 7fe24bfff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe24c0b2850 0x7fe24c0cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:22.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.152+0000 7fe24bfff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe24c0b2850 0x7fe24c0cabf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37238/0 (socket says 172.21.15.149:37238) 2023-11-08T19:23:22.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.152+0000 7fe24bfff700 1 -- 172.21.15.149:0/717621924 learned_addr learned my addr 172.21.15.149:0/717621924 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:22.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.152+0000 7fe250b12700 1 --2- 172.21.15.149:0/717621924 >> v2:172.21.15.160:3300/0 conn(0x7fe24c0cc140 0x7fe24c0cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:22.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.152+0000 7fe24bfff700 1 -- 172.21.15.149:0/717621924 >> v2:172.21.15.160:3300/0 conn(0x7fe24c0cc140 msgr2=0x7fe24c0cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:22.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.152+0000 7fe24bfff700 1 --2- 172.21.15.149:0/717621924 >> v2:172.21.15.160:3300/0 conn(0x7fe24c0cc140 0x7fe24c0cc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:22.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.152+0000 7fe24bfff700 1 -- 172.21.15.149:0/717621924 >> v1:172.21.15.149:6789/0 conn(0x7fe24c0b2cd0 legacy=0x7fe24c15d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:22.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.152+0000 7fe24bfff700 1 -- 172.21.15.149:0/717621924 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe24c0b17b0 con 0x7fe24c0b2850 2023-11-08T19:23:22.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.152+0000 7fe24bfff700 1 --2- 172.21.15.149:0/717621924 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe24c0b2850 0x7fe24c0cabf0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe24c0ce120 tx=0x7fe238009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad30ae52f9499bd5 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:22.158 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.153+0000 7fe24b7fe700 1 -- 172.21.15.149:0/717621924 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23800b870 con 0x7fe24c0b2850 2023-11-08T19:23:22.158 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.153+0000 7fe24b7fe700 1 -- 172.21.15.149:0/717621924 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe23800b9d0 con 0x7fe24c0b2850 2023-11-08T19:23:22.158 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.153+0000 7fe24b7fe700 1 -- 172.21.15.149:0/717621924 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23800bd60 con 0x7fe24c0b2850 2023-11-08T19:23:22.158 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.153+0000 7fe252d76700 1 -- 172.21.15.149:0/717621924 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe24c0b2850 msgr2=0x7fe24c0cabf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:22.158 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.153+0000 7fe252d76700 1 --2- 172.21.15.149:0/717621924 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe24c0b2850 0x7fe24c0cabf0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe24c0ce120 tx=0x7fe238009bd0 comp rx=0 tx=0).stop 2023-11-08T19:23:22.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.153+0000 7fe252d76700 1 -- 172.21.15.149:0/717621924 shutdown_connections 2023-11-08T19:23:22.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.153+0000 7fe252d76700 1 --2- 172.21.15.149:0/717621924 >> v2:172.21.15.160:3300/0 conn(0x7fe24c0cc140 0x7fe24c0cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:22.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.153+0000 7fe252d76700 1 --2- 172.21.15.149:0/717621924 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe24c0b2850 0x7fe24c0cabf0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:22.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.153+0000 7fe252d76700 1 -- 172.21.15.149:0/717621924 >> 172.21.15.149:0/717621924 conn(0x7fe24c099a40 msgr2=0x7fe24c0d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:22.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.153+0000 7fe252d76700 1 -- 172.21.15.149:0/717621924 shutdown_connections 2023-11-08T19:23:22.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.153+0000 7fe252d76700 1 -- 172.21.15.149:0/717621924 wait complete. 2023-11-08T19:23:22.162 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.154+0000 7fe252d76700 1 Processor -- start 2023-11-08T19:23:22.163 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.154+0000 7fe252d76700 1 -- start start 2023-11-08T19:23:22.163 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.155+0000 7fe252d76700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe24c0b2850 0x7fe24c155b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:22.163 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.155+0000 7fe252d76700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe24c0b2cd0 0x7fe24c0c85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:22.163 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.155+0000 7fe252d76700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe24c0cc140 0x7fe24c0af8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:22.163 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.155+0000 7fe252d76700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe24c156060 con 0x7fe24c0b2cd0 2023-11-08T19:23:22.164 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.155+0000 7fe252d76700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe24c0c9000 con 0x7fe24c0cc140 2023-11-08T19:23:22.164 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.155+0000 7fe252d76700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe24c0c92e0 con 0x7fe24c0b2850 2023-11-08T19:23:22.164 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.155+0000 7fe24bfff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe24c0b2cd0 0x7fe24c0c85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:22.164 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.155+0000 7fe24bfff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe24c0b2cd0 0x7fe24c0c85b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37244/0 (socket says 172.21.15.149:37244) 2023-11-08T19:23:22.164 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.155+0000 7fe24bfff700 1 -- 172.21.15.149:0/2352452479 learned_addr learned my addr 172.21.15.149:0/2352452479 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:22.165 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.155+0000 7fe250b12700 1 --2- 172.21.15.149:0/2352452479 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe24c0b2850 0x7fe24c155b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:22.165 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.155+0000 7fe251313700 1 --2- 172.21.15.149:0/2352452479 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe24c0cc140 0x7fe24c0af8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:22.165 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.156+0000 7fe24bfff700 1 -- 172.21.15.149:0/2352452479 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe24c0b2850 msgr2=0x7fe24c155b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:22.165 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.156+0000 7fe24bfff700 1 --2- 172.21.15.149:0/2352452479 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe24c0b2850 0x7fe24c155b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:22.165 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.156+0000 7fe24bfff700 1 -- 172.21.15.149:0/2352452479 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe24c0cc140 msgr2=0x7fe24c0af8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:22.166 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.156+0000 7fe24bfff700 1 --2- 172.21.15.149:0/2352452479 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe24c0cc140 0x7fe24c0af8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:22.166 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.156+0000 7fe24bfff700 1 -- 172.21.15.149:0/2352452479 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe238009550 con 0x7fe24c0b2cd0 2023-11-08T19:23:22.166 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.156+0000 7fe24bfff700 1 --2- 172.21.15.149:0/2352452479 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe24c0b2cd0 0x7fe24c0c85b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe238000c00 tx=0x7fe238004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:22.166 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.156+0000 7fe2497fa700 1 -- 172.21.15.149:0/2352452479 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe238004540 con 0x7fe24c0b2cd0 2023-11-08T19:23:22.166 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.156+0000 7fe2497fa700 1 -- 172.21.15.149:0/2352452479 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2380036a0 con 0x7fe24c0b2cd0 2023-11-08T19:23:22.167 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.156+0000 7fe2497fa700 1 -- 172.21.15.149:0/2352452479 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe238003a50 con 0x7fe24c0b2cd0 2023-11-08T19:23:22.167 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.156+0000 7fe252d76700 1 -- 172.21.15.149:0/2352452479 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe24c15cff0 con 0x7fe24c0b2cd0 2023-11-08T19:23:22.167 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.156+0000 7fe252d76700 1 -- 172.21.15.149:0/2352452479 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe24c15d5b0 con 0x7fe24c0b2cd0 2023-11-08T19:23:22.167 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.157+0000 7fe252d76700 1 -- 172.21.15.149:0/2352452479 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe24c0745f0 con 0x7fe24c0b2cd0 2023-11-08T19:23:22.168 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.157+0000 7fe2497fa700 1 -- 172.21.15.149:0/2352452479 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe238021070 con 0x7fe24c0b2cd0 2023-11-08T19:23:22.168 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.158+0000 7fe2497fa700 1 --2- 172.21.15.149:0/2352452479 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe23006af00 0x7fe23006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:22.168 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.158+0000 7fe2497fa700 1 -- 172.21.15.149:0/2352452479 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe23808ae80 con 0x7fe24c0b2cd0 2023-11-08T19:23:22.168 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.158+0000 7fe250b12700 1 --2- 172.21.15.149:0/2352452479 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe23006af00 0x7fe23006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:22.168 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.158+0000 7fe250b12700 1 --2- 172.21.15.149:0/2352452479 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe23006af00 0x7fe23006d3c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe240006fd0 tx=0x7fe240008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:22.169 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.163+0000 7fe2497fa700 1 -- 172.21.15.149:0/2352452479 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe238055d80 con 0x7fe24c0b2cd0 2023-11-08T19:23:22.355 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.354+0000 7fe252d76700 1 -- 172.21.15.149:0/2352452479 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe24c0c3e80 con 0x7fe24c0b2cd0 2023-11-08T19:23:22.356 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.355+0000 7fe2497fa700 1 -- 172.21.15.149:0/2352452479 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18382 (secure 0 0 0) 0x7fe238029090 con 0x7fe24c0b2cd0 2023-11-08T19:23:22.357 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:23:22.357 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":24,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:23:06.964482+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-08T19:22:59.830928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-08T19:23:00.886589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-08T19:23:04.574033+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:23:22.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.357+0000 7fe252d76700 1 -- 172.21.15.149:0/2352452479 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe23006af00 msgr2=0x7fe23006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:22.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.357+0000 7fe252d76700 1 --2- 172.21.15.149:0/2352452479 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe23006af00 0x7fe23006d3c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe240006fd0 tx=0x7fe240008040 comp rx=0 tx=0).stop 2023-11-08T19:23:22.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.357+0000 7fe252d76700 1 -- 172.21.15.149:0/2352452479 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe24c0b2cd0 msgr2=0x7fe24c0c85b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:22.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.357+0000 7fe252d76700 1 --2- 172.21.15.149:0/2352452479 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe24c0b2cd0 0x7fe24c0c85b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe238000c00 tx=0x7fe238004750 comp rx=0 tx=0).stop 2023-11-08T19:23:22.360 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.357+0000 7fe252d76700 1 -- 172.21.15.149:0/2352452479 shutdown_connections 2023-11-08T19:23:22.360 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.357+0000 7fe252d76700 1 --2- 172.21.15.149:0/2352452479 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe23006af00 0x7fe23006d3c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:22.360 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.357+0000 7fe252d76700 1 --2- 172.21.15.149:0/2352452479 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe24c0cc140 0x7fe24c0af8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:22.360 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.357+0000 7fe252d76700 1 --2- 172.21.15.149:0/2352452479 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe24c0b2850 0x7fe24c155b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:22.360 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.357+0000 7fe252d76700 1 --2- 172.21.15.149:0/2352452479 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe24c0b2cd0 0x7fe24c0c85b0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:22.361 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.357+0000 7fe252d76700 1 -- 172.21.15.149:0/2352452479 >> 172.21.15.149:0/2352452479 conn(0x7fe24c099a40 msgr2=0x7fe24c0cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:22.361 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.357+0000 7fe252d76700 1 -- 172.21.15.149:0/2352452479 shutdown_connections 2023-11-08T19:23:22.361 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.357+0000 7fe252d76700 1 -- 172.21.15.149:0/2352452479 wait complete. 2023-11-08T19:23:22.371 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-11-08T19:23:22.372 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:23:22.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.491+0000 7f60eb771700 1 Processor -- start 2023-11-08T19:23:22.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.491+0000 7f60eb771700 1 -- start start 2023-11-08T19:23:22.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.492+0000 7f60eb771700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f60e40afb30 0x7f60e40ce380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:22.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.492+0000 7f60eb771700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f60e40b20b0 0x7f60e40b2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:22.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.492+0000 7f60eb771700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60e40d1330 con 0x7f60e40b16b0 2023-11-08T19:23:22.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.492+0000 7f60eb771700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60e40b2a80 con 0x7f60e40b20b0 2023-11-08T19:23:22.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.492+0000 7f60eb771700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e40cb490 con 0x7f60e40afb30 2023-11-08T19:23:22.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.492+0000 7f60e9d0e700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f60e40b20b0 0x7f60e40b2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:22.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.492+0000 7f60e9d0e700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f60e40b20b0 0x7f60e40b2540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37254/0 (socket says 172.21.15.149:37254) 2023-11-08T19:23:22.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.492+0000 7f60e9d0e700 1 -- 172.21.15.149:0/3413317575 learned_addr learned my addr 172.21.15.149:0/3413317575 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:22.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.492+0000 7f60e950d700 1 --2- 172.21.15.149:0/3413317575 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f60e40afb30 0x7f60e40ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:22.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.492+0000 7f60e9d0e700 1 -- 172.21.15.149:0/3413317575 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f60e40afb30 msgr2=0x7f60e40ce380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:22.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.492+0000 7f60e9d0e700 1 --2- 172.21.15.149:0/3413317575 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f60e40afb30 0x7f60e40ce380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:22.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.492+0000 7f60e9d0e700 1 -- 172.21.15.149:0/3413317575 >> v1:172.21.15.160:6789/0 conn(0x7f60e40b16b0 legacy=0x7f60e40cbf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:22.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.492+0000 7f60e9d0e700 1 -- 172.21.15.149:0/3413317575 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e40cb770 con 0x7f60e40b20b0 2023-11-08T19:23:22.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.492+0000 7f60e950d700 1 --2- 172.21.15.149:0/3413317575 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f60e40afb30 0x7f60e40ce380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:23:22.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.492+0000 7f60e9d0e700 1 --2- 172.21.15.149:0/3413317575 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60e40b20b0 0x7f60e40b2540 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f60dc009e50 tx=0x7f60dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7f18f790841d1f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:22.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.492+0000 7f60dbfff700 1 -- 172.21.15.149:0/3413317575 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60dc00e070 con 0x7f60e40b20b0 2023-11-08T19:23:22.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.493+0000 7f60dbfff700 1 -- 172.21.15.149:0/3413317575 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60dc00b9c0 con 0x7f60e40b20b0 2023-11-08T19:23:22.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.493+0000 7f60dbfff700 1 -- 172.21.15.149:0/3413317575 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60dc00bd70 con 0x7f60e40b20b0 2023-11-08T19:23:22.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.493+0000 7f60eb771700 1 -- 172.21.15.149:0/3413317575 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60e40b20b0 msgr2=0x7f60e40b2540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:22.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.493+0000 7f60eb771700 1 --2- 172.21.15.149:0/3413317575 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60e40b20b0 0x7f60e40b2540 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f60dc009e50 tx=0x7f60dc00b330 comp rx=0 tx=0).stop 2023-11-08T19:23:22.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.493+0000 7f60eb771700 1 -- 172.21.15.149:0/3413317575 shutdown_connections 2023-11-08T19:23:22.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.493+0000 7f60eb771700 1 --2- 172.21.15.149:0/3413317575 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60e40b20b0 0x7f60e40b2540 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:22.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.493+0000 7f60eb771700 1 --2- 172.21.15.149:0/3413317575 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f60e40afb30 0x7f60e40ce380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:22.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.493+0000 7f60eb771700 1 -- 172.21.15.149:0/3413317575 >> 172.21.15.149:0/3413317575 conn(0x7f60e4099a40 msgr2=0x7f60e40d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:22.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.493+0000 7f60eb771700 1 -- 172.21.15.149:0/3413317575 shutdown_connections 2023-11-08T19:23:22.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.493+0000 7f60eb771700 1 -- 172.21.15.149:0/3413317575 wait complete. 2023-11-08T19:23:22.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.494+0000 7f60eb771700 1 Processor -- start 2023-11-08T19:23:22.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.494+0000 7f60eb771700 1 -- start start 2023-11-08T19:23:22.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.495+0000 7f60eb771700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60e40afb30 0x7f60e41529a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:22.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.495+0000 7f60eb771700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f60e40b16b0 0x7f60e40c9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:22.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.495+0000 7f60eb771700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f60e40b20b0 0x7f60e40c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:22.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.495+0000 7f60eb771700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e40c6600 con 0x7f60e40afb30 2023-11-08T19:23:22.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.495+0000 7f60eb771700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e40c40d0 con 0x7f60e40b20b0 2023-11-08T19:23:22.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.495+0000 7f60eb771700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e40c50e0 con 0x7f60e40b16b0 2023-11-08T19:23:22.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.495+0000 7f60e950d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60e40afb30 0x7f60e41529a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:22.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.495+0000 7f60e950d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60e40afb30 0x7f60e41529a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37258/0 (socket says 172.21.15.149:37258) 2023-11-08T19:23:22.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.495+0000 7f60e950d700 1 -- 172.21.15.149:0/3602972184 learned_addr learned my addr 172.21.15.149:0/3602972184 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:22.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.495+0000 7f60e9d0e700 1 --2- 172.21.15.149:0/3602972184 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f60e40b20b0 0x7f60e40c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:22.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.495+0000 7f60e8d0c700 1 --2- 172.21.15.149:0/3602972184 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f60e40b16b0 0x7f60e40c9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:22.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.496+0000 7f60e950d700 1 -- 172.21.15.149:0/3602972184 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f60e40b16b0 msgr2=0x7f60e40c9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:22.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.496+0000 7f60e950d700 1 --2- 172.21.15.149:0/3602972184 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f60e40b16b0 0x7f60e40c9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:22.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.496+0000 7f60e950d700 1 -- 172.21.15.149:0/3602972184 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f60e40b20b0 msgr2=0x7f60e40c9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:22.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.496+0000 7f60e950d700 1 --2- 172.21.15.149:0/3602972184 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f60e40b20b0 0x7f60e40c9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:22.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.496+0000 7f60e950d700 1 -- 172.21.15.149:0/3602972184 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60dc009b30 con 0x7f60e40afb30 2023-11-08T19:23:22.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.496+0000 7f60e950d700 1 --2- 172.21.15.149:0/3602972184 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60e40afb30 0x7f60e41529a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f60e000e810 tx=0x7f60e000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:22.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.496+0000 7f60d9ffb700 1 -- 172.21.15.149:0/3602972184 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e0005c20 con 0x7f60e40afb30 2023-11-08T19:23:22.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.496+0000 7f60d9ffb700 1 -- 172.21.15.149:0/3602972184 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60e0005d80 con 0x7f60e40afb30 2023-11-08T19:23:22.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.496+0000 7f60eb771700 1 -- 172.21.15.149:0/3602972184 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60e40c4320 con 0x7f60e40afb30 2023-11-08T19:23:22.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.496+0000 7f60d9ffb700 1 -- 172.21.15.149:0/3602972184 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e0004260 con 0x7f60e40afb30 2023-11-08T19:23:22.509 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.496+0000 7f60eb771700 1 -- 172.21.15.149:0/3602972184 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60e40c48e0 con 0x7f60e40afb30 2023-11-08T19:23:22.509 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.497+0000 7f60eb771700 1 -- 172.21.15.149:0/3602972184 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60e40c4f30 con 0x7f60e40afb30 2023-11-08T19:23:22.509 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.497+0000 7f60d9ffb700 1 -- 172.21.15.149:0/3602972184 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f60e00043c0 con 0x7f60e40afb30 2023-11-08T19:23:22.509 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.498+0000 7f60d9ffb700 1 --2- 172.21.15.149:0/3602972184 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f60c806af00 0x7f60c806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:22.509 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.498+0000 7f60d9ffb700 1 -- 172.21.15.149:0/3602972184 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f60e0089610 con 0x7f60e40afb30 2023-11-08T19:23:22.510 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.498+0000 7f60e8d0c700 1 --2- 172.21.15.149:0/3602972184 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f60c806af00 0x7f60c806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:22.510 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.498+0000 7f60e8d0c700 1 --2- 172.21.15.149:0/3602972184 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f60c806af00 0x7f60c806d3c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f60e415e300 tx=0x7f60d4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:22.510 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.503+0000 7f60d9ffb700 1 -- 172.21.15.149:0/3602972184 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f60e00543c0 con 0x7f60e40afb30 2023-11-08T19:23:22.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.697+0000 7f60eb771700 1 -- 172.21.15.149:0/3602972184 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60e40745f0 con 0x7f60e40afb30 2023-11-08T19:23:22.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.698+0000 7f60d9ffb700 1 -- 172.21.15.149:0/3602972184 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18382 (secure 0 0 0) 0x7f60e00579e0 con 0x7f60e40afb30 2023-11-08T19:23:22.700 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:23:22.700 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":24,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:23:06.964482+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-08T19:22:59.830928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-08T19:23:00.886589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-08T19:23:04.574033+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:23:22.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.700+0000 7f60eb771700 1 -- 172.21.15.149:0/3602972184 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f60c806af00 msgr2=0x7f60c806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:22.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.700+0000 7f60eb771700 1 --2- 172.21.15.149:0/3602972184 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f60c806af00 0x7f60c806d3c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f60e415e300 tx=0x7f60d4009040 comp rx=0 tx=0).stop 2023-11-08T19:23:22.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.700+0000 7f60eb771700 1 -- 172.21.15.149:0/3602972184 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60e40afb30 msgr2=0x7f60e41529a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:22.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.700+0000 7f60eb771700 1 --2- 172.21.15.149:0/3602972184 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60e40afb30 0x7f60e41529a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f60e000e810 tx=0x7f60e000eb20 comp rx=0 tx=0).stop 2023-11-08T19:23:22.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.700+0000 7f60eb771700 1 -- 172.21.15.149:0/3602972184 shutdown_connections 2023-11-08T19:23:22.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.700+0000 7f60eb771700 1 --2- 172.21.15.149:0/3602972184 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f60c806af00 0x7f60c806d3c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:22.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.700+0000 7f60eb771700 1 --2- 172.21.15.149:0/3602972184 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f60e40b20b0 0x7f60e40c9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:22.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.700+0000 7f60eb771700 1 --2- 172.21.15.149:0/3602972184 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60e40afb30 0x7f60e41529a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:22.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.700+0000 7f60eb771700 1 --2- 172.21.15.149:0/3602972184 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f60e40b16b0 0x7f60e40c9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:22.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.700+0000 7f60eb771700 1 -- 172.21.15.149:0/3602972184 >> 172.21.15.149:0/3602972184 conn(0x7f60e4099a40 msgr2=0x7f60e40b0820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:22.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.701+0000 7f60eb771700 1 -- 172.21.15.149:0/3602972184 shutdown_connections 2023-11-08T19:23:22.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.701+0000 7f60eb771700 1 -- 172.21.15.149:0/3602972184 wait complete. 2023-11-08T19:23:22.714 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-11-08T19:23:22.715 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-11-08T19:23:22.716 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-11-08T19:23:22.716 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-11-08T19:23:22.717 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-11-08T19:23:22.717 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-11-08T19:23:22.718 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-11-08T19:23:22.718 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-11-08T19:23:22.930 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.929+0000 7f95b9879700 1 Processor -- start 2023-11-08T19:23:22.931 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.929+0000 7fda65f9f700 1 Processor -- start 2023-11-08T19:23:22.931 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.929+0000 7fda65f9f700 1 -- start start 2023-11-08T19:23:22.932 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.929+0000 7f5c80474700 1 Processor -- start 2023-11-08T19:23:22.932 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.929+0000 7f5c80474700 1 -- start start 2023-11-08T19:23:22.933 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.930+0000 7f95b9879700 1 -- start start 2023-11-08T19:23:22.933 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.931+0000 7f95b9879700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f95b40c2a70 0x7f95b40ce090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:22.933 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.931+0000 7f95b9879700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95b4072900 0x7f95b4070d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:22.934 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.931+0000 7f95b9879700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95b41669c0 con 0x7f95b40b0ee0 2023-11-08T19:23:22.934 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.931+0000 7f95b9879700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95b40712d0 con 0x7f95b40c2a70 2023-11-08T19:23:22.934 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.931+0000 7f95b9879700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95b4165aa0 con 0x7f95b4072900 2023-11-08T19:23:22.934 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.931+0000 7f95b2ffd700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f95b40c2a70 0x7f95b40ce090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:22.934 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.931+0000 7f95b2ffd700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f95b40c2a70 0x7f95b40ce090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.149:38258/0 (socket says 172.21.15.149:38258) 2023-11-08T19:23:22.935 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.931+0000 7f95b2ffd700 1 -- 172.21.15.149:0/1538130318 learned_addr learned my addr 172.21.15.149:0/1538130318 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:22.935 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.931+0000 7f5c80474700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5c7806d4f0 0x7f5c781776a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:22.936 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.931+0000 7f5c80474700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c780ce4f0 con 0x7f5c780ceac0 2023-11-08T19:23:22.936 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.931+0000 7f5c80474700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c7816e210 con 0x7f5c7808ab00 2023-11-08T19:23:22.936 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.931+0000 7f5c80474700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c780ca8d0 con 0x7f5c7806d4f0 2023-11-08T19:23:22.936 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.931+0000 7f5c7da0f700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f5c780ceac0 0x7f5c7806cde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:39266/0 (socket says 172.21.15.149:39266) 2023-11-08T19:23:22.936 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.931+0000 7f5c7da0f700 1 -- 172.21.15.149:0/845372624 learned_addr learned my addr 172.21.15.149:0/845372624 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:23:22.937 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.932+0000 7f5c7d20e700 1 -- 172.21.15.149:0/845372624 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3802751730 0 0) 0x7f5c780ce4f0 con 0x7f5c780ceac0 2023-11-08T19:23:22.937 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.932+0000 7f5c7d20e700 1 -- 172.21.15.149:0/845372624 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c640035b0 con 0x7f5c780ceac0 2023-11-08T19:23:22.937 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.932+0000 7f5c7ea11700 1 --2- 172.21.15.149:0/845372624 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5c7806d4f0 0x7f5c781776a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:22.937 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.932+0000 7f5c7d20e700 1 -- 172.21.15.149:0/845372624 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1430458585 0 0) 0x7f5c640035b0 con 0x7f5c780ceac0 2023-11-08T19:23:22.937 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.932+0000 7f5c7d20e700 1 -- 172.21.15.149:0/845372624 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5c7806d4f0 msgr2=0x7f5c781776a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:22.938 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.932+0000 7f5c7d20e700 1 --2- 172.21.15.149:0/845372624 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5c7806d4f0 0x7f5c781776a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:22.938 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.932+0000 7f5c7d20e700 1 -- 172.21.15.149:0/845372624 >> v1:172.21.15.160:6789/0 conn(0x7f5c7808ab00 legacy=0x7f5c780c9d30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-08T19:23:22.938 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.932+0000 7f5c7d20e700 1 -- 172.21.15.149:0/845372624 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c780cdea0 con 0x7f5c780ceac0 2023-11-08T19:23:22.938 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.932+0000 7f5c7d20e700 1 -- 172.21.15.149:0/845372624 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f5c700019f0 con 0x7f5c780ceac0 2023-11-08T19:23:22.938 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.932+0000 7f5c7d20e700 1 -- 172.21.15.149:0/845372624 >> v1:172.21.15.149:6789/0 conn(0x7f5c780ceac0 legacy=0x7f5c7806cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:22.939 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.932+0000 7f5c7d20e700 1 --2- 172.21.15.149:0/845372624 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5c64003a30 0x7f5c64003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:22.939 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.932+0000 7f5c7d20e700 1 --2- 172.21.15.149:0/845372624 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5c64004850 0x7f5c64004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:22.939 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.932+0000 7f5c7d20e700 1 --2- 172.21.15.149:0/845372624 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5c64005210 0x7f5c6400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:22.939 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.932+0000 7f5c7d20e700 1 -- 172.21.15.149:0/845372624 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c780ca8d0 con 0x7f5c64003a30 2023-11-08T19:23:22.939 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.932+0000 7f5c7d20e700 1 -- 172.21.15.149:0/845372624 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6400c0c0 con 0x7f5c64005210 2023-11-08T19:23:22.940 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.932+0000 7f5c7d20e700 1 -- 172.21.15.149:0/845372624 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6400c280 con 0x7f5c64004850 2023-11-08T19:23:22.940 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.933+0000 7f5c7da0f700 1 --2- 172.21.15.149:0/845372624 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5c64004850 0x7f5c64004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:22.940 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.932+0000 7f95b2ffd700 1 -- 172.21.15.149:0/1538130318 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95b4072900 msgr2=0x7f95b4070d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:22.940 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.932+0000 7f95b27fc700 1 --2- 172.21.15.149:0/1538130318 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95b4072900 0x7f95b4070d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:22.941 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.932+0000 7f167df1c700 1 Processor -- start 2023-11-08T19:23:22.941 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.932+0000 7f167df1c700 1 -- start start 2023-11-08T19:23:22.942 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.932+0000 7fda65f9f700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fda600ceac0 0x7fda60070f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:22.942 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.932+0000 7fda65f9f700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fda600cef50 0x7fda600714d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:22.942 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.933+0000 7f95b2ffd700 1 --2- 172.21.15.149:0/1538130318 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95b4072900 0x7f95b4070d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:22.942 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.933+0000 7f95b2ffd700 1 -- 172.21.15.149:0/1538130318 >> v1:172.21.15.149:6789/0 conn(0x7f95b40b0ee0 legacy=0x7f95b40c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:22.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.933+0000 7f95b2ffd700 1 -- 172.21.15.149:0/1538130318 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b4165d40 con 0x7f95b40c2a70 2023-11-08T19:23:22.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.932+0000 7fda65f9f700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda600ce4f0 con 0x7fda6006cde0 2023-11-08T19:23:22.944 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.932+0000 7fda65f9f700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda6016e210 con 0x7fda600ceac0 2023-11-08T19:23:22.944 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.932+0000 7fda65f9f700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda6008ad70 con 0x7fda600cef50 2023-11-08T19:23:22.944 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.932+0000 7fda5effd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fda600ceac0 0x7fda60070f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:22.944 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.932+0000 7fda5f7fe700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fda6006cde0 0x7fda6006d1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:39280/0 (socket says 172.21.15.149:39280) 2023-11-08T19:23:22.944 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.932+0000 7fda5f7fe700 1 -- 172.21.15.149:0/1228330751 learned_addr learned my addr 172.21.15.149:0/1228330751 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:23:22.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.933+0000 7fda5e7fc700 1 -- 172.21.15.149:0/1228330751 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3440991818 0 0) 0x7fda600ce4f0 con 0x7fda6006cde0 2023-11-08T19:23:22.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.933+0000 7fda5e7fc700 1 -- 172.21.15.149:0/1228330751 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda480035b0 con 0x7fda6006cde0 2023-11-08T19:23:22.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.933+0000 7fda5e7fc700 1 -- 172.21.15.149:0/1228330751 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2612547860 0 0) 0x7fda480035b0 con 0x7fda6006cde0 2023-11-08T19:23:22.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.933+0000 7fda5e7fc700 1 -- 172.21.15.149:0/1228330751 >> v2:172.21.15.160:3300/0 conn(0x7fda600cef50 msgr2=0x7fda600714d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:22.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.933+0000 7fda5e7fc700 1 --2- 172.21.15.149:0/1228330751 >> v2:172.21.15.160:3300/0 conn(0x7fda600cef50 0x7fda600714d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:22.946 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.933+0000 7fda5e7fc700 1 -- 172.21.15.149:0/1228330751 >> v2:172.21.15.149:3300/0 conn(0x7fda600ceac0 msgr2=0x7fda60070f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:22.946 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.933+0000 7fda5e7fc700 1 --2- 172.21.15.149:0/1228330751 >> v2:172.21.15.149:3300/0 conn(0x7fda600ceac0 0x7fda60070f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:22.946 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.933+0000 7fda5e7fc700 1 -- 172.21.15.149:0/1228330751 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda600ca5f0 con 0x7fda6006cde0 2023-11-08T19:23:22.946 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.933+0000 7fda5e7fc700 1 -- 172.21.15.149:0/1228330751 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7fda580019f0 con 0x7fda6006cde0 2023-11-08T19:23:22.947 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.933+0000 7f95b27fc700 1 --2- 172.21.15.149:0/1538130318 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95b4072900 0x7f95b4070d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:23:22.947 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.933+0000 7fda5e7fc700 1 -- 172.21.15.149:0/1228330751 >> v1:172.21.15.149:6789/0 conn(0x7fda6006cde0 legacy=0x7fda6006d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:22.947 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.933+0000 7fda5e7fc700 1 --2- 172.21.15.149:0/1228330751 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fda48003a00 0x7fda48003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:22.948 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.933+0000 7fda5e7fc700 1 --2- 172.21.15.149:0/1228330751 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fda48004850 0x7fda48004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:22.948 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.933+0000 7fda5e7fc700 1 --2- 172.21.15.149:0/1228330751 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda48005210 0x7fda4800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:22.948 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.933+0000 7fda5e7fc700 1 -- 172.21.15.149:0/1228330751 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda6016e210 con 0x7fda48005210 2023-11-08T19:23:22.948 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.933+0000 7fda5e7fc700 1 -- 172.21.15.149:0/1228330751 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda6008ad70 con 0x7fda48004850 2023-11-08T19:23:22.949 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.933+0000 7fda5e7fc700 1 -- 172.21.15.149:0/1228330751 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda4800c130 con 0x7fda48003a00 2023-11-08T19:23:22.949 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.933+0000 7fda5effd700 1 --2- 172.21.15.149:0/1228330751 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fda48004850 0x7fda48004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:22.949 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.933+0000 7f5c7da0f700 1 -- 172.21.15.149:0/845372624 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5c64005210 msgr2=0x7f5c6400ba10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-08T19:23:22.949 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.933+0000 7f5c7da0f700 1 --2- 172.21.15.149:0/845372624 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5c64005210 0x7f5c6400ba10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:22.950 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.933+0000 7f5c7da0f700 1 -- 172.21.15.149:0/845372624 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5c64003a30 msgr2=0x7f5c64003e30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-08T19:23:22.950 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.933+0000 7f167df1c700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f167815dcb0 0x7f1678161680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:22.951 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.933+0000 7f167df1c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f16780ce8a0 0x7f16780712c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:22.951 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.934+0000 7f167df1c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1678071800 0x7f167815e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:22.951 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.934+0000 7f167df1c700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1678071c90 con 0x7f16780ce8a0 2023-11-08T19:23:22.951 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.934+0000 7f167df1c700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1678161ed0 con 0x7f167815dcb0 2023-11-08T19:23:22.951 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.934+0000 7f167df1c700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16781621b0 con 0x7f1678071800 2023-11-08T19:23:22.952 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.934+0000 7f1676ffd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f16780ce8a0 0x7f16780712c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:22.952 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.934+0000 7f16777fe700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f167815dcb0 0x7f1678161680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:22.952 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.934+0000 7f1676ffd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f16780ce8a0 0x7f16780712c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37292/0 (socket says 172.21.15.149:37292) 2023-11-08T19:23:22.952 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.934+0000 7f1676ffd700 1 -- 172.21.15.149:0/1304108320 learned_addr learned my addr 172.21.15.149:0/1304108320 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:22.953 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.934+0000 7f5c7da0f700 1 --2- 172.21.15.149:0/845372624 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5c64003a30 0x7f5c64003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:22.953 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.934+0000 7f5c7da0f700 1 -- 172.21.15.149:0/845372624 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c780cdea0 con 0x7f5c64004850 2023-11-08T19:23:22.953 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.934+0000 7f1677fff700 1 --2- 172.21.15.149:0/1304108320 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1678071800 0x7f167815e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:22.954 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.934+0000 7f95b2ffd700 1 --2- 172.21.15.149:0/1538130318 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95b40c2a70 0x7f95b40ce090 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f95a40098f0 tx=0x7f95a4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9fb9a5d32b879905 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:22.954 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.934+0000 7fda5effd700 1 -- 172.21.15.149:0/1228330751 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fda48003a00 msgr2=0x7fda48003e20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-08T19:23:22.954 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.934+0000 7fda5effd700 1 --2- 172.21.15.149:0/1228330751 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fda48003a00 0x7fda48003e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:22.955 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.934+0000 7fda5effd700 1 -- 172.21.15.149:0/1228330751 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda48005210 msgr2=0x7fda4800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:22.955 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.934+0000 7fda5effd700 1 --2- 172.21.15.149:0/1228330751 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda48005210 0x7fda4800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:22.955 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.934+0000 7fda5effd700 1 -- 172.21.15.149:0/1228330751 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda600ca5f0 con 0x7fda48004850 2023-11-08T19:23:22.955 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.934+0000 7fda5ffff700 1 -- 172.21.15.149:0/1228330751 reap_dead start 2023-11-08T19:23:22.956 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.934+0000 7f1676ffd700 1 -- 172.21.15.149:0/1304108320 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1678071800 msgr2=0x7f167815e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:22.956 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.934+0000 7f1676ffd700 1 --2- 172.21.15.149:0/1304108320 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1678071800 0x7f167815e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:22.956 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.934+0000 7f5c7da0f700 1 --2- 172.21.15.149:0/845372624 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5c64004850 0x7f5c64004cd0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5c7000a8d0 tx=0x7f5c64005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed128ca2855793c9 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:22.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.934+0000 7f1676ffd700 1 -- 172.21.15.149:0/1304108320 >> v2:172.21.15.160:3300/0 conn(0x7f167815dcb0 msgr2=0x7f1678161680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:22.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.934+0000 7f1676ffd700 1 --2- 172.21.15.149:0/1304108320 >> v2:172.21.15.160:3300/0 conn(0x7f167815dcb0 0x7f1678161680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:22.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.934+0000 7f1676ffd700 1 -- 172.21.15.149:0/1304108320 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1678162490 con 0x7f16780ce8a0 2023-11-08T19:23:22.958 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.934+0000 7f95b1ffb700 1 -- 172.21.15.149:0/1538130318 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a4004230 con 0x7f95b40c2a70 2023-11-08T19:23:22.958 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.934+0000 7fda5effd700 1 --2- 172.21.15.149:0/1228330751 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fda48004850 0x7fda48004cd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fda540099c0 tx=0x7fda48005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35b90e31b9c26adc server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:22.958 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.934+0000 7f1676ffd700 1 --2- 172.21.15.149:0/1304108320 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16780ce8a0 0x7f16780712c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f16780d0630 tx=0x7f166c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c3f6db5df7ba04d server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:22.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.934+0000 7f95b1ffb700 1 -- 172.21.15.149:0/1538130318 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a4004390 con 0x7f95b40c2a70 2023-11-08T19:23:22.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.934+0000 7f95b1ffb700 1 -- 172.21.15.149:0/1538130318 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a40036a0 con 0x7f95b40c2a70 2023-11-08T19:23:22.960 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.934+0000 7fda5e7fc700 1 -- 172.21.15.149:0/1228330751 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda540118f0 con 0x7fda48004850 2023-11-08T19:23:22.960 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.934+0000 7fda5e7fc700 1 -- 172.21.15.149:0/1228330751 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda54011a50 con 0x7fda48004850 2023-11-08T19:23:22.960 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.934+0000 7fda5e7fc700 1 -- 172.21.15.149:0/1228330751 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda54011dc0 con 0x7fda48004850 2023-11-08T19:23:22.960 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.935+0000 7f16767fc700 1 -- 172.21.15.149:0/1304108320 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f166c00b870 con 0x7f16780ce8a0 2023-11-08T19:23:22.961 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.935+0000 7f16767fc700 1 -- 172.21.15.149:0/1304108320 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f166c00b9d0 con 0x7f16780ce8a0 2023-11-08T19:23:22.961 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.935+0000 7f16767fc700 1 -- 172.21.15.149:0/1304108320 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f166c00bd60 con 0x7f16780ce8a0 2023-11-08T19:23:22.961 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.934+0000 7f5c7d20e700 1 -- 172.21.15.149:0/845372624 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c70012600 con 0x7f5c64004850 2023-11-08T19:23:22.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.935+0000 7f5c7d20e700 1 -- 172.21.15.149:0/845372624 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c70012760 con 0x7f5c64004850 2023-11-08T19:23:22.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.935+0000 7f5c7d20e700 1 -- 172.21.15.149:0/845372624 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c70012b10 con 0x7f5c64004850 2023-11-08T19:23:22.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.936+0000 7f5c80474700 1 -- 172.21.15.149:0/845372624 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5c64004850 msgr2=0x7f5c64004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:22.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.936+0000 7f5c80474700 1 --2- 172.21.15.149:0/845372624 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5c64004850 0x7f5c64004cd0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5c7000a8d0 tx=0x7f5c64005880 comp rx=0 tx=0).stop 2023-11-08T19:23:22.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.935+0000 7fda65f9f700 1 -- 172.21.15.149:0/1228330751 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fda48004850 msgr2=0x7fda48004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:22.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.935+0000 7fda65f9f700 1 --2- 172.21.15.149:0/1228330751 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fda48004850 0x7fda48004cd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fda540099c0 tx=0x7fda48005880 comp rx=0 tx=0).stop 2023-11-08T19:23:22.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.936+0000 7f9f11d46700 1 Processor -- start 2023-11-08T19:23:22.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.936+0000 7f95b9879700 1 -- 172.21.15.149:0/1538130318 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95b40c2a70 msgr2=0x7f95b40ce090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:22.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.936+0000 7f95b9879700 1 --2- 172.21.15.149:0/1538130318 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95b40c2a70 0x7f95b40ce090 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f95a40098f0 tx=0x7f95a4009c00 comp rx=0 tx=0).stop 2023-11-08T19:23:22.965 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.936+0000 7f167df1c700 1 -- 172.21.15.149:0/1304108320 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16780ce8a0 msgr2=0x7f16780712c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:22.965 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.936+0000 7f167df1c700 1 --2- 172.21.15.149:0/1304108320 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16780ce8a0 0x7f16780712c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f16780d0630 tx=0x7f166c009bd0 comp rx=0 tx=0).stop 2023-11-08T19:23:22.965 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.936+0000 7f9f11d46700 1 -- start start 2023-11-08T19:23:22.966 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.936+0000 7f5c7ea11700 1 -- 172.21.15.149:0/845372624 reap_dead start 2023-11-08T19:23:22.966 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.936+0000 7f5c80474700 1 -- 172.21.15.149:0/845372624 shutdown_connections 2023-11-08T19:23:22.966 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.936+0000 7f5c80474700 1 -- 172.21.15.149:0/845372624 >> 172.21.15.149:0/845372624 conn(0x7f5c780cbee0 msgr2=0x7f5c780cc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:22.966 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.936+0000 7fda65f9f700 1 -- 172.21.15.149:0/1228330751 shutdown_connections 2023-11-08T19:23:22.967 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.936+0000 7fda65f9f700 1 --2- 172.21.15.149:0/1228330751 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fda48004850 0x7fda48004cd0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:22.967 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.936+0000 7fda65f9f700 1 -- 172.21.15.149:0/1228330751 >> 172.21.15.149:0/1228330751 conn(0x7fda600cbee0 msgr2=0x7fda600cc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:22.967 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.936+0000 7f167df1c700 1 -- 172.21.15.149:0/1304108320 shutdown_connections 2023-11-08T19:23:22.968 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.936+0000 7f167df1c700 1 --2- 172.21.15.149:0/1304108320 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1678071800 0x7f167815e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:22.968 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.936+0000 7f167df1c700 1 --2- 172.21.15.149:0/1304108320 >> v2:172.21.15.160:3300/0 conn(0x7f167815dcb0 0x7f1678161680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:22.968 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.936+0000 7f167df1c700 1 --2- 172.21.15.149:0/1304108320 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16780ce8a0 0x7f16780712c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:22.968 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.936+0000 7f167df1c700 1 -- 172.21.15.149:0/1304108320 >> 172.21.15.149:0/1304108320 conn(0x7f16780cf980 msgr2=0x7f16780cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:22.969 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.936+0000 7fda65f9f700 1 -- 172.21.15.149:0/1228330751 shutdown_connections 2023-11-08T19:23:22.969 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.936+0000 7fda65f9f700 1 -- 172.21.15.149:0/1228330751 wait complete. 2023-11-08T19:23:22.969 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.936+0000 7f3ae5b07700 1 Processor -- start 2023-11-08T19:23:22.970 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.937+0000 7f3ae5b07700 1 -- start start 2023-11-08T19:23:22.971 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.937+0000 7f9f11d46700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f9f0c0c9cc0 0x7f9f0c0ce030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:22.971 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.937+0000 7f9f11d46700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9f0c0ce570 0x7f9f0c0ca430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:22.971 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.937+0000 7f9f11d46700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f0c15dd10 con 0x7f9f0c159bc0 2023-11-08T19:23:22.971 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.937+0000 7f9f11d46700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f0c159fa0 con 0x7f9f0c0c9cc0 2023-11-08T19:23:22.971 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.937+0000 7f9f11d46700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0c15e530 con 0x7f9f0c0ce570 2023-11-08T19:23:22.972 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.937+0000 7f9f0b7fe700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f9f0c159bc0 0x7f9f0c15d600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:39302/0 (socket says 172.21.15.149:39302) 2023-11-08T19:23:22.972 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.937+0000 7f9f0b7fe700 1 -- 172.21.15.149:0/2162119741 learned_addr learned my addr 172.21.15.149:0/2162119741 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:23:22.972 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.938+0000 7f9f0a7fc700 1 -- 172.21.15.149:0/2162119741 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1103632724 0 0) 0x7f9f0c15dd10 con 0x7f9f0c159bc0 2023-11-08T19:23:22.972 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.938+0000 7f9f0a7fc700 1 -- 172.21.15.149:0/2162119741 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ef4003e40 con 0x7f9f0c159bc0 2023-11-08T19:23:22.973 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.938+0000 7fda65f9f700 1 Processor -- start 2023-11-08T19:23:22.973 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.936+0000 7f167df1c700 1 -- 172.21.15.149:0/1304108320 shutdown_connections 2023-11-08T19:23:22.973 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.936+0000 7f167df1c700 1 -- 172.21.15.149:0/1304108320 wait complete. 2023-11-08T19:23:22.974 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.938+0000 7f9f0affd700 1 --2- 172.21.15.149:0/2162119741 >> v2:172.21.15.149:3300/0 conn(0x7f9f0c0c9cc0 0x7f9f0c0ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:22.974 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.938+0000 7f9f0a7fc700 1 -- 172.21.15.149:0/2162119741 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2492429730 0 0) 0x7f9ef4003e40 con 0x7f9f0c159bc0 2023-11-08T19:23:22.974 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.938+0000 7f9f0a7fc700 1 -- 172.21.15.149:0/2162119741 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9f0c0ce570 msgr2=0x7f9f0c0ca430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:22.975 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.938+0000 7f9f0a7fc700 1 --2- 172.21.15.149:0/2162119741 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9f0c0ce570 0x7f9f0c0ca430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:22.975 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.938+0000 7f9f0a7fc700 1 -- 172.21.15.149:0/2162119741 >> v2:172.21.15.149:3300/0 conn(0x7f9f0c0c9cc0 msgr2=0x7f9f0c0ce030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:22.975 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.938+0000 7f9f0a7fc700 1 --2- 172.21.15.149:0/2162119741 >> v2:172.21.15.149:3300/0 conn(0x7f9f0c0c9cc0 0x7f9f0c0ce030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:22.975 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.938+0000 7f9f0a7fc700 1 -- 172.21.15.149:0/2162119741 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f0c15df70 con 0x7f9f0c159bc0 2023-11-08T19:23:22.976 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.938+0000 7f167df1c700 1 Processor -- start 2023-11-08T19:23:22.976 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.938+0000 7f5c80474700 1 -- 172.21.15.149:0/845372624 shutdown_connections 2023-11-08T19:23:22.977 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.938+0000 7f9f0affd700 1 --2- 172.21.15.149:0/2162119741 >> v2:172.21.15.149:3300/0 conn(0x7f9f0c0c9cc0 0x7f9f0c0ce030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:23:22.977 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.938+0000 7f9f0a7fc700 1 -- 172.21.15.149:0/2162119741 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f9efc001670 con 0x7f9f0c159bc0 2023-11-08T19:23:22.977 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.938+0000 7f9f0a7fc700 1 -- 172.21.15.149:0/2162119741 >> v1:172.21.15.149:6789/0 conn(0x7f9f0c159bc0 legacy=0x7f9f0c15d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:22.977 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.938+0000 7f9f0a7fc700 1 --2- 172.21.15.149:0/2162119741 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ef40034d0 0x7f9ef4004290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:22.978 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.938+0000 7f9f0a7fc700 1 --2- 172.21.15.149:0/2162119741 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9f0c0ce570 0x7f9ef40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:22.978 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.938+0000 7f9f0a7fc700 1 --2- 172.21.15.149:0/2162119741 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9ef40050e0 0x7f9ef4005560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:22.978 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.938+0000 7f9f0a7fc700 1 -- 172.21.15.149:0/2162119741 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0c159fa0 con 0x7f9ef40034d0 2023-11-08T19:23:22.978 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.938+0000 7f9f0a7fc700 1 -- 172.21.15.149:0/2162119741 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0c15e530 con 0x7f9ef40050e0 2023-11-08T19:23:22.978 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.938+0000 7f9f0a7fc700 1 -- 172.21.15.149:0/2162119741 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef4005b50 con 0x7f9f0c0ce570 2023-11-08T19:23:22.979 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.938+0000 7f5c80474700 1 -- 172.21.15.149:0/845372624 wait complete. 2023-11-08T19:23:22.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.939+0000 7f9f0bfff700 1 --2- 172.21.15.149:0/2162119741 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9ef40050e0 0x7f9ef4005560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:22.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.939+0000 7f9f0affd700 1 --2- 172.21.15.149:0/2162119741 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9f0c0ce570 0x7f9ef40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:22.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.939+0000 7f9f0b7fe700 1 --2- 172.21.15.149:0/2162119741 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ef40034d0 0x7f9ef4004290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:22.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.939+0000 7f9f0bfff700 1 -- 172.21.15.149:0/2162119741 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9f0c0ce570 msgr2=0x7f9ef40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:22.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.939+0000 7f9f0bfff700 1 --2- 172.21.15.149:0/2162119741 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9f0c0ce570 0x7f9ef40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:22.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.939+0000 7f9f0bfff700 1 -- 172.21.15.149:0/2162119741 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ef40034d0 msgr2=0x7f9ef4004290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:22.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.939+0000 7f9f0bfff700 1 --2- 172.21.15.149:0/2162119741 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ef40034d0 0x7f9ef4004290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:22.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.939+0000 7f9f0bfff700 1 -- 172.21.15.149:0/2162119741 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef4003e40 con 0x7f9ef40050e0 2023-11-08T19:23:22.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.939+0000 7f9f0affd700 1 --2- 172.21.15.149:0/2162119741 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9f0c0ce570 0x7f9ef40047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:23:22.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.939+0000 7f9f0bfff700 1 --2- 172.21.15.149:0/2162119741 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9ef40050e0 0x7f9ef4005560 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9f04009e40 tx=0x7f9ef4006110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94fe07cc8f6e4afc server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:22.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.940+0000 7f9f0a7fc700 1 -- 172.21.15.149:0/2162119741 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f040098b0 con 0x7f9ef40050e0 2023-11-08T19:23:22.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.940+0000 7f9f0a7fc700 1 -- 172.21.15.149:0/2162119741 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f04003c20 con 0x7f9ef40050e0 2023-11-08T19:23:22.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.940+0000 7f9f0a7fc700 1 -- 172.21.15.149:0/2162119741 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f0400b8a0 con 0x7f9ef40050e0 2023-11-08T19:23:22.983 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.940+0000 7f5c80474700 1 Processor -- start 2023-11-08T19:23:22.983 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.938+0000 7fda65f9f700 1 -- start start 2023-11-08T19:23:22.984 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.939+0000 7f167df1c700 1 -- start start 2023-11-08T19:23:22.984 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.940+0000 7f167df1c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1678071800 0x7f1678147ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:22.984 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.940+0000 7f167df1c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f16780ce8a0 0x7f16780c5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:22.984 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.940+0000 7f167df1c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f167815dcb0 0x7f16780c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:22.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.940+0000 7f167df1c700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16781e82b0 con 0x7f167815dcb0 2023-11-08T19:23:22.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.940+0000 7f167df1c700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16781e8590 con 0x7f16780ce8a0 2023-11-08T19:23:22.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.940+0000 7f167df1c700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16781e8870 con 0x7f1678071800 2023-11-08T19:23:22.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.940+0000 7f5c80474700 1 -- start start 2023-11-08T19:23:22.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.940+0000 7fda65f9f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda48004850 0x7fda60210a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:22.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.940+0000 7fda65f9f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fda60089a00 0x7fda6016d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:22.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.940+0000 7fda65f9f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fda601f8730 0x7fda601f8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:22.987 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.940+0000 7fda65f9f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda601f9100 con 0x7fda48004850 2023-11-08T19:23:22.987 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.940+0000 7fda65f9f700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda600c64a0 con 0x7fda60089a00 2023-11-08T19:23:22.987 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.940+0000 7fda65f9f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda6016dcf0 con 0x7fda601f8730 2023-11-08T19:23:22.987 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.940+0000 7f95b9879700 1 -- 172.21.15.149:0/1538130318 shutdown_connections 2023-11-08T19:23:22.988 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.941+0000 7f95b9879700 1 --2- 172.21.15.149:0/1538130318 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95b40c2a70 0x7f95b40ce090 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:22.988 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.941+0000 7f95b9879700 1 --2- 172.21.15.149:0/1538130318 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95b4072900 0x7f95b4070d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:22.988 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.941+0000 7f95b9879700 1 -- 172.21.15.149:0/1538130318 >> 172.21.15.149:0/1538130318 conn(0x7f95b406b3d0 msgr2=0x7f95b40cf460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:22.989 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.941+0000 7f1676ffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f16780ce8a0 0x7f16780c5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:22.989 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.941+0000 7f1676ffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f16780ce8a0 0x7f16780c5060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.149:38314/0 (socket says 172.21.15.149:38314) 2023-11-08T19:23:22.989 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.941+0000 7f1676ffd700 1 -- 172.21.15.149:0/2145690398 learned_addr learned my addr 172.21.15.149:0/2145690398 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:22.989 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.941+0000 7f16777fe700 1 --2- 172.21.15.149:0/2145690398 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1678071800 0x7f1678147ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:22.990 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.941+0000 7fda5effd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fda60089a00 0x7fda6016d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:22.990 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.941+0000 7fda5effd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fda60089a00 0x7fda6016d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.149:38318/0 (socket says 172.21.15.149:38318) 2023-11-08T19:23:22.990 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.941+0000 7fda5effd700 1 -- 172.21.15.149:0/3526343586 learned_addr learned my addr 172.21.15.149:0/3526343586 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:22.991 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.941+0000 7fda5ffff700 1 --2- 172.21.15.149:0/3526343586 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fda601f8730 0x7fda601f8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:22.993 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.941+0000 7f9f11d46700 1 -- 172.21.15.149:0/2162119741 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9ef40050e0 msgr2=0x7f9ef4005560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:22.993 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.941+0000 7f9f11d46700 1 --2- 172.21.15.149:0/2162119741 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9ef40050e0 0x7f9ef4005560 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9f04009e40 tx=0x7f9ef4006110 comp rx=0 tx=0).stop 2023-11-08T19:23:22.993 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.941+0000 7f9f0bfff700 1 -- 172.21.15.149:0/2162119741 reap_dead start 2023-11-08T19:23:22.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.941+0000 7f95b9879700 1 -- 172.21.15.149:0/1538130318 shutdown_connections 2023-11-08T19:23:22.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.941+0000 7fda5ffff700 1 -- 172.21.15.149:0/3526343586 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fda60089a00 msgr2=0x7fda6016d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:22.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.941+0000 7fda5ffff700 1 --2- 172.21.15.149:0/3526343586 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fda60089a00 0x7fda6016d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:22.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.941+0000 7fda5ffff700 1 -- 172.21.15.149:0/3526343586 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda48004850 msgr2=0x7fda60210a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:22.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.941+0000 7fda5ffff700 1 --2- 172.21.15.149:0/3526343586 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda48004850 0x7fda60210a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:22.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.941+0000 7fda5ffff700 1 -- 172.21.15.149:0/3526343586 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda600c66b0 con 0x7fda601f8730 2023-11-08T19:23:22.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.941+0000 7fda5effd700 1 --2- 172.21.15.149:0/3526343586 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fda60089a00 0x7fda6016d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:23:22.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.941+0000 7fda5ffff700 1 --2- 172.21.15.149:0/3526343586 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fda601f8730 0x7fda601f8bc0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fda600cb6c0 tx=0x7fda5000a3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:22.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.941+0000 7f5c80474700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5c7816bbb0 0x7f5c780c64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:22.997 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.941+0000 7f5c80474700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5c7816bf90 0x7f5c780c4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:22.997 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.941+0000 7f5c80474700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5c780a85f0 0x7f5c780c4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:22.997 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.941+0000 7f5c80474700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c780c6e10 con 0x7f5c780a85f0 2023-11-08T19:23:22.997 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.941+0000 7f5c80474700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c780c70f0 con 0x7f5c7816bf90 2023-11-08T19:23:22.998 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.941+0000 7f5c80474700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c780c73d0 con 0x7f5c7816bbb0 2023-11-08T19:23:22.998 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.942+0000 7f9f11d46700 1 -- 172.21.15.149:0/2162119741 shutdown_connections 2023-11-08T19:23:22.998 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.942+0000 7f9f11d46700 1 -- 172.21.15.149:0/2162119741 >> 172.21.15.149:0/2162119741 conn(0x7f9f0c0cbee0 msgr2=0x7f9f0c0cc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:22.999 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.942+0000 7f9f11d46700 1 -- 172.21.15.149:0/2162119741 shutdown_connections 2023-11-08T19:23:22.999 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.942+0000 7f5c7da0f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5c7816bf90 0x7f5c780c4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:22.999 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.942+0000 7f5c7ea11700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5c780a85f0 0x7f5c780c4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.942+0000 7f5c7e210700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5c7816bbb0 0x7f5c780c64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.942+0000 7f5c7ea11700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5c780a85f0 0x7f5c780c4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37334/0 (socket says 172.21.15.149:37334) 2023-11-08T19:23:23.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.942+0000 7f5c7ea11700 1 -- 172.21.15.149:0/3051939413 learned_addr learned my addr 172.21.15.149:0/3051939413 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:23.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.942+0000 7f5c7ea11700 1 -- 172.21.15.149:0/3051939413 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5c7816bbb0 msgr2=0x7f5c780c64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.942+0000 7f5c7ea11700 1 --2- 172.21.15.149:0/3051939413 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5c7816bbb0 0x7f5c780c64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.942+0000 7f5c7ea11700 1 -- 172.21.15.149:0/3051939413 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5c7816bf90 msgr2=0x7f5c780c4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.942+0000 7f5c7ea11700 1 --2- 172.21.15.149:0/3051939413 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5c7816bf90 0x7f5c780c4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.942+0000 7f5c7ea11700 1 -- 172.21.15.149:0/3051939413 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c780c76b0 con 0x7f5c780a85f0 2023-11-08T19:23:23.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.942+0000 7f5c7ea11700 1 --2- 172.21.15.149:0/3051939413 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5c780a85f0 0x7f5c780c4640 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5c780cb8f0 tx=0x7f5c7400e700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:23.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.941+0000 7f95b9879700 1 -- 172.21.15.149:0/1538130318 wait complete. 2023-11-08T19:23:23.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.941+0000 7f1677fff700 1 --2- 172.21.15.149:0/2145690398 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f167815dcb0 0x7f16780c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.941+0000 7f16777fe700 1 -- 172.21.15.149:0/2145690398 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f16780ce8a0 msgr2=0x7f16780c5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.941+0000 7f16777fe700 1 --2- 172.21.15.149:0/2145690398 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f16780ce8a0 0x7f16780c5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.943+0000 7f95b9879700 1 Processor -- start 2023-11-08T19:23:23.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.941+0000 7f16777fe700 1 -- 172.21.15.149:0/2145690398 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f167815dcb0 msgr2=0x7f16780c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.941+0000 7f16777fe700 1 --2- 172.21.15.149:0/2145690398 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f167815dcb0 0x7f16780c55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.004 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.941+0000 7f16777fe700 1 -- 172.21.15.149:0/2145690398 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f166c009550 con 0x7f1678071800 2023-11-08T19:23:23.004 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.942+0000 7f16777fe700 1 --2- 172.21.15.149:0/2145690398 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1678071800 0x7f1678147ca0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f166800d5c0 tx=0x7f166800d8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:23.004 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.943+0000 7fda47fff700 1 -- 172.21.15.149:0/3526343586 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5000aed0 con 0x7fda601f8730 2023-11-08T19:23:23.005 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.943+0000 7fda47fff700 1 -- 172.21.15.149:0/3526343586 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda50005a50 con 0x7fda601f8730 2023-11-08T19:23:23.005 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.943+0000 7fda65f9f700 1 -- 172.21.15.149:0/3526343586 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda600c6990 con 0x7fda601f8730 2023-11-08T19:23:23.005 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.943+0000 7fda47fff700 1 -- 172.21.15.149:0/3526343586 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda50005e20 con 0x7fda601f8730 2023-11-08T19:23:23.005 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.943+0000 7fda65f9f700 1 -- 172.21.15.149:0/3526343586 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda60210fb0 con 0x7fda601f8730 2023-11-08T19:23:23.006 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.943+0000 7f95b9879700 1 -- start start 2023-11-08T19:23:23.006 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.938+0000 7f3ae5b07700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f3ae00cc9d0 0x7f3ae0159950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.006 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.938+0000 7f3ae5b07700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ae00ce030 0x7f3ae00ce4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.007 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.938+0000 7f3ae5b07700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ae015dd10 con 0x7f3ae00c9cc0 2023-11-08T19:23:23.007 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.938+0000 7f3ae5b07700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ae015df70 con 0x7f3ae00cc9d0 2023-11-08T19:23:23.007 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.938+0000 7f3ae5b07700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae015e250 con 0x7f3ae00ce030 2023-11-08T19:23:23.007 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.939+0000 7f3adeffd700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f3ae00c9cc0 0x7f3ae015d600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:39316/0 (socket says 172.21.15.149:39316) 2023-11-08T19:23:23.007 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.939+0000 7f3adeffd700 1 -- 172.21.15.149:0/151008487 learned_addr learned my addr 172.21.15.149:0/151008487 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:23:23.008 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.939+0000 7f3adffff700 1 --2- 172.21.15.149:0/151008487 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ae00ce030 0x7f3ae00ce4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.008 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.940+0000 7f3adffff700 1 -- 172.21.15.149:0/151008487 >> v2:172.21.15.160:3300/0 conn(0x7f3ae00cc9d0 msgr2=0x7f3ae0159950 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-08T19:23:23.008 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.940+0000 7f3adffff700 1 --2- 172.21.15.149:0/151008487 >> v2:172.21.15.160:3300/0 conn(0x7f3ae00cc9d0 0x7f3ae0159950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.008 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.940+0000 7f3adffff700 1 -- 172.21.15.149:0/151008487 >> v1:172.21.15.149:6789/0 conn(0x7f3ae00c9cc0 legacy=0x7f3ae015d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.008 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.940+0000 7f3adffff700 1 -- 172.21.15.149:0/151008487 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ae00cd830 con 0x7f3ae00ce030 2023-11-08T19:23:23.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.942+0000 7f9f11d46700 1 -- 172.21.15.149:0/2162119741 wait complete. 2023-11-08T19:23:23.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.944+0000 7f9f11d46700 1 Processor -- start 2023-11-08T19:23:23.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.944+0000 7f5c6effd700 1 -- 172.21.15.149:0/3051939413 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c74018070 con 0x7f5c780a85f0 2023-11-08T19:23:23.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.944+0000 7f5c6effd700 1 -- 172.21.15.149:0/3051939413 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c7400ec90 con 0x7f5c780a85f0 2023-11-08T19:23:23.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.944+0000 7f5c6effd700 1 -- 172.21.15.149:0/3051939413 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c7400c070 con 0x7f5c780a85f0 2023-11-08T19:23:23.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.945+0000 7f5c80474700 1 -- 172.21.15.149:0/3051939413 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c780c7990 con 0x7f5c780a85f0 2023-11-08T19:23:23.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.945+0000 7f5c80474700 1 -- 172.21.15.149:0/3051939413 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c780c6bc0 con 0x7f5c780a85f0 2023-11-08T19:23:23.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.944+0000 7f95b9879700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95b4072900 0x7f95b40c5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.944+0000 7f95b9879700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95b40b0ee0 0x7f95b40c3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.944+0000 7f95b9879700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95b40c2a70 0x7f95b4159b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.944+0000 7f95b9879700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b415a5a0 con 0x7f95b40c2a70 2023-11-08T19:23:23.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.944+0000 7f95b9879700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b415a880 con 0x7f95b4072900 2023-11-08T19:23:23.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.944+0000 7f95b9879700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95b40c5310 con 0x7f95b40b0ee0 2023-11-08T19:23:23.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.944+0000 7f95b27fc700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95b40b0ee0 0x7f95b40c3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.944+0000 7f95b27fc700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95b40b0ee0 0x7f95b40c3460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.149:57626/0 (socket says 172.21.15.149:57626) 2023-11-08T19:23:23.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.944+0000 7f95b27fc700 1 -- 172.21.15.149:0/426662856 learned_addr learned my addr 172.21.15.149:0/426662856 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:23.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.945+0000 7f95b2ffd700 1 --2- 172.21.15.149:0/426662856 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95b4072900 0x7f95b40c5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.945+0000 7f95b37fe700 1 --2- 172.21.15.149:0/426662856 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95b40c2a70 0x7f95b4159b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.945+0000 7f95b2ffd700 1 -- 172.21.15.149:0/426662856 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95b40b0ee0 msgr2=0x7f95b40c3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.945+0000 7f95b2ffd700 1 --2- 172.21.15.149:0/426662856 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95b40b0ee0 0x7f95b40c3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.945+0000 7f95b2ffd700 1 -- 172.21.15.149:0/426662856 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95b40c2a70 msgr2=0x7f95b4159b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.945+0000 7f95b2ffd700 1 --2- 172.21.15.149:0/426662856 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95b40c2a70 0x7f95b4159b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.945+0000 7f95b2ffd700 1 -- 172.21.15.149:0/426662856 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a4009550 con 0x7f95b4072900 2023-11-08T19:23:23.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.946+0000 7f95b2ffd700 1 --2- 172.21.15.149:0/426662856 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95b4072900 0x7f95b40c5b10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f95a4015000 tx=0x7f95a4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:23.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.944+0000 7f165ffff700 1 -- 172.21.15.149:0/2145690398 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1668016be0 con 0x7f1678071800 2023-11-08T19:23:23.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.944+0000 7f165ffff700 1 -- 172.21.15.149:0/2145690398 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f166801a070 con 0x7f1678071800 2023-11-08T19:23:23.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.944+0000 7f165ffff700 1 -- 172.21.15.149:0/2145690398 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f166801f430 con 0x7f1678071800 2023-11-08T19:23:23.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.944+0000 7f167df1c700 1 -- 172.21.15.149:0/2145690398 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16781e8b50 con 0x7f1678071800 2023-11-08T19:23:23.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.944+0000 7f167df1c700 1 -- 172.21.15.149:0/2145690398 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16781481e0 con 0x7f1678071800 2023-11-08T19:23:23.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.945+0000 7f167df1c700 1 -- 172.21.15.149:0/2145690398 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f16781e8700 con 0x7f1678071800 2023-11-08T19:23:23.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.945+0000 7fda47fff700 1 -- 172.21.15.149:0/3526343586 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fda50007110 con 0x7fda601f8730 2023-11-08T19:23:23.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.945+0000 7fda47fff700 1 --2- 172.21.15.149:0/3526343586 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fda4806c830 0x7fda4806ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.946+0000 7fda47fff700 1 -- 172.21.15.149:0/3526343586 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fda50088d10 con 0x7fda601f8730 2023-11-08T19:23:23.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.946+0000 7f959bfff700 1 -- 172.21.15.149:0/426662856 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a4003d10 con 0x7f95b4072900 2023-11-08T19:23:23.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.946+0000 7f959bfff700 1 -- 172.21.15.149:0/426662856 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a401f070 con 0x7f95b4072900 2023-11-08T19:23:23.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.946+0000 7f5c80474700 1 -- 172.21.15.149:0/3051939413 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5c780ce180 con 0x7f5c780a85f0 2023-11-08T19:23:23.018 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.946+0000 7f95b9879700 1 -- 172.21.15.149:0/426662856 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95b40c55f0 con 0x7f95b4072900 2023-11-08T19:23:23.018 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.946+0000 7f95b9879700 1 -- 172.21.15.149:0/426662856 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95b415dcc0 con 0x7f95b4072900 2023-11-08T19:23:23.018 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.947+0000 7f3adffff700 1 --2- 172.21.15.149:0/151008487 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ae00ce030 0x7f3ae00ce4c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3ad0009840 tx=0x7f3ad0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5624893f98cc89d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:23.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.946+0000 7f959bfff700 1 -- 172.21.15.149:0/426662856 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a400b8a0 con 0x7f95b4072900 2023-11-08T19:23:23.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.946+0000 7f165ffff700 1 -- 172.21.15.149:0/2145690398 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f166801c030 con 0x7f1678071800 2023-11-08T19:23:23.020 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.947+0000 7f165ffff700 1 --2- 172.21.15.149:0/2145690398 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f166006b080 0x7f166006d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.020 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.947+0000 7f165ffff700 1 -- 172.21.15.149:0/2145690398 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1668091570 con 0x7f1678071800 2023-11-08T19:23:23.020 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.947+0000 7f165ffff700 1 --2- 172.21.15.149:0/2145690398 >> [v2:172.21.15.160:6800/3633365507,v1:172.21.15.160:6802/3633365507] conn(0x7f16600746c0 0x7f1660076b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.020 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.947+0000 7f165ffff700 1 -- 172.21.15.149:0/2145690398 --> [v2:172.21.15.160:6800/3633365507,v1:172.21.15.160:6802/3633365507] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f16600771d0 con 0x7f16600746c0 2023-11-08T19:23:23.020 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.947+0000 7f165ffff700 1 -- 172.21.15.149:0/2145690398 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1668093b90 con 0x7f1678071800 2023-11-08T19:23:23.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.947+0000 7f95b9879700 1 -- 172.21.15.149:0/426662856 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9594000fc0 con 0x7f95b4072900 2023-11-08T19:23:23.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.947+0000 7fda65f9f700 1 --2- 172.21.15.149:0/3526343586 >> [v2:172.21.15.149:6808/856914938,v1:172.21.15.149:6809/856914938] conn(0x7fda400015e0 0x7fda40003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.947+0000 7fda65f9f700 1 -- 172.21.15.149:0/3526343586 --> [v2:172.21.15.149:6808/856914938,v1:172.21.15.149:6809/856914938] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fda40006bd0 con 0x7fda400015e0 2023-11-08T19:23:23.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.947+0000 7f1676ffd700 1 --2- 172.21.15.149:0/2145690398 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f166006b080 0x7f166006d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.947+0000 7fda5f7fe700 1 --2- 172.21.15.149:0/3526343586 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fda4806c830 0x7fda4806ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.947+0000 7f3ade7fc700 1 -- 172.21.15.149:0/151008487 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad0022640 con 0x7f3ae00ce030 2023-11-08T19:23:23.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.944+0000 7f9f11d46700 1 -- start start 2023-11-08T19:23:23.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.945+0000 7f9f11d46700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9ef40050e0 0x7f9f0c2033b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.945+0000 7f9f11d46700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f0c200af0 0x7f9f0c072670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.945+0000 7f9f11d46700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9f0c1f3140 0x7f9f0c1f35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.025 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.945+0000 7f9f11d46700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0c1f51f0 con 0x7f9f0c200af0 2023-11-08T19:23:23.025 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.945+0000 7f9f11d46700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0c203cc0 con 0x7f9ef40050e0 2023-11-08T19:23:23.025 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.945+0000 7f9f11d46700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0c203fa0 con 0x7f9f0c1f3140 2023-11-08T19:23:23.025 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.945+0000 7f9f0b7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9ef40050e0 0x7f9f0c2033b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.945+0000 7f9f0b7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9ef40050e0 0x7f9f0c2033b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.149:38334/0 (socket says 172.21.15.149:38334) 2023-11-08T19:23:23.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.945+0000 7f9f0b7fe700 1 -- 172.21.15.149:0/4223012793 learned_addr learned my addr 172.21.15.149:0/4223012793 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:23.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.946+0000 7f9f0b7fe700 1 -- 172.21.15.149:0/4223012793 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9f0c1f3140 msgr2=0x7f9f0c1f35f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-08T19:23:23.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.946+0000 7f9f0b7fe700 1 --2- 172.21.15.149:0/4223012793 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9f0c1f3140 0x7f9f0c1f35f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.946+0000 7f9f0b7fe700 1 -- 172.21.15.149:0/4223012793 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f0c200af0 msgr2=0x7f9f0c072670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-08T19:23:23.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.946+0000 7f9f0b7fe700 1 --2- 172.21.15.149:0/4223012793 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f0c200af0 0x7f9f0c072670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.946+0000 7f9f0b7fe700 1 -- 172.21.15.149:0/4223012793 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f0c1f5490 con 0x7f9ef40050e0 2023-11-08T19:23:23.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.947+0000 7f9f0b7fe700 1 --2- 172.21.15.149:0/4223012793 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9ef40050e0 0x7f9f0c2033b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9efc000c00 tx=0x7f9efc00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:23.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.947+0000 7f9ef3fff700 1 -- 172.21.15.149:0/4223012793 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9efc00c780 con 0x7f9ef40050e0 2023-11-08T19:23:23.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.947+0000 7f9ef3fff700 1 -- 172.21.15.149:0/4223012793 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9efc00c8e0 con 0x7f9ef40050e0 2023-11-08T19:23:23.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.947+0000 7f9ef3fff700 1 -- 172.21.15.149:0/4223012793 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9efc00cc90 con 0x7f9ef40050e0 2023-11-08T19:23:23.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.947+0000 7f3ade7fc700 1 -- 172.21.15.149:0/151008487 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ad00227a0 con 0x7f3ae00ce030 2023-11-08T19:23:23.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.947+0000 7f3ade7fc700 1 -- 172.21.15.149:0/151008487 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad0022b30 con 0x7f3ae00ce030 2023-11-08T19:23:23.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.948+0000 7f1676ffd700 1 --2- 172.21.15.149:0/2145690398 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f166006b080 0x7f166006d540 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f167815b8f0 tx=0x7f166c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:23.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.948+0000 7fda5f7fe700 1 --2- 172.21.15.149:0/3526343586 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fda4806c830 0x7fda4806ecf0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fda58001b20 tx=0x7fda580019f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:23.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.948+0000 7f959bfff700 1 -- 172.21.15.149:0/426662856 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f95a4021030 con 0x7f95b4072900 2023-11-08T19:23:23.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.948+0000 7f959bfff700 1 --2- 172.21.15.149:0/426662856 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f95a006afd0 0x7f95a006d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.948+0000 7f959bfff700 1 -- 172.21.15.149:0/426662856 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f95a408af20 con 0x7f95b4072900 2023-11-08T19:23:23.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.949+0000 7f959bfff700 1 --2- 172.21.15.149:0/426662856 >> [v2:172.21.15.149:6816/3407229782,v1:172.21.15.149:6818/3407229782] conn(0x7f95a0074610 0x7f95a0076a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.949+0000 7f959bfff700 1 -- 172.21.15.149:0/426662856 --> [v2:172.21.15.149:6816/3407229782,v1:172.21.15.149:6818/3407229782] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f95a0077120 con 0x7f95a0074610 2023-11-08T19:23:23.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.949+0000 7f959bfff700 1 -- 172.21.15.149:0/426662856 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f95a408d540 con 0x7f95b4072900 2023-11-08T19:23:23.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.949+0000 7f95b27fc700 1 --2- 172.21.15.149:0/426662856 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f95a006afd0 0x7f95a006d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.949+0000 7f5c6effd700 1 -- 172.21.15.149:0/3051939413 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5c7401d410 con 0x7f5c780a85f0 2023-11-08T19:23:23.032 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.949+0000 7f5c6effd700 1 --2- 172.21.15.149:0/3051939413 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5c5c06afc0 0x7f5c5c06d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.032 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.950+0000 7f5c6effd700 1 -- 172.21.15.149:0/3051939413 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5c74089220 con 0x7f5c780a85f0 2023-11-08T19:23:23.032 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.950+0000 7f5c6effd700 1 --2- 172.21.15.149:0/3051939413 >> [v2:172.21.15.149:6800/1925115369,v1:172.21.15.149:6801/1925115369] conn(0x7f5c5c074600 0x7f5c5c076a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.032 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.950+0000 7f5c6effd700 1 -- 172.21.15.149:0/3051939413 --> [v2:172.21.15.149:6800/1925115369,v1:172.21.15.149:6801/1925115369] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5c5c077110 con 0x7f5c5c074600 2023-11-08T19:23:23.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.950+0000 7f5c6effd700 1 -- 172.21.15.149:0/3051939413 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5c740895d0 con 0x7f5c780a85f0 2023-11-08T19:23:23.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.950+0000 7f5c7da0f700 1 --2- 172.21.15.149:0/3051939413 >> [v2:172.21.15.149:6800/1925115369,v1:172.21.15.149:6801/1925115369] conn(0x7f5c5c074600 0x7f5c5c076a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.950+0000 7f5c7e210700 1 --2- 172.21.15.149:0/3051939413 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5c5c06afc0 0x7f5c5c06d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.949+0000 7f3ae5b07700 1 -- 172.21.15.149:0/151008487 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ae00ce030 msgr2=0x7f3ae00ce4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.949+0000 7f3ae5b07700 1 --2- 172.21.15.149:0/151008487 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ae00ce030 0x7f3ae00ce4c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3ad0009840 tx=0x7f3ad0009b50 comp rx=0 tx=0).stop 2023-11-08T19:23:23.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.949+0000 7f3ae5b07700 1 -- 172.21.15.149:0/151008487 shutdown_connections 2023-11-08T19:23:23.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.949+0000 7f3ae5b07700 1 --2- 172.21.15.149:0/151008487 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ae00ce030 0x7f3ae00ce4c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.949+0000 7f3ae5b07700 1 --2- 172.21.15.149:0/151008487 >> v2:172.21.15.160:3300/0 conn(0x7f3ae00cc9d0 0x7f3ae0159950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.949+0000 7f3ae5b07700 1 -- 172.21.15.149:0/151008487 >> 172.21.15.149:0/151008487 conn(0x7f3ae00cbee0 msgr2=0x7f3ae00cc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:23.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.949+0000 7f95b37fe700 1 --2- 172.21.15.149:0/426662856 >> [v2:172.21.15.149:6816/3407229782,v1:172.21.15.149:6818/3407229782] conn(0x7f95a0074610 0x7f95a0076a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.949+0000 7f95b27fc700 1 --2- 172.21.15.149:0/426662856 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f95a006afd0 0x7f95a006d490 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f95b40cf250 tx=0x7f95ac007800 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:23.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.949+0000 7f95b37fe700 1 --2- 172.21.15.149:0/426662856 >> [v2:172.21.15.149:6816/3407229782,v1:172.21.15.149:6818/3407229782] conn(0x7f95a0074610 0x7f95a0076a50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:23.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.950+0000 7fda5effd700 1 --2- 172.21.15.149:0/3526343586 >> [v2:172.21.15.149:6808/856914938,v1:172.21.15.149:6809/856914938] conn(0x7fda400015e0 0x7fda40003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.948+0000 7f9f11d46700 1 -- 172.21.15.149:0/4223012793 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f0c204280 con 0x7f9ef40050e0 2023-11-08T19:23:23.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.948+0000 7f9f11d46700 1 -- 172.21.15.149:0/4223012793 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f0c1f3b30 con 0x7f9ef40050e0 2023-11-08T19:23:23.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.949+0000 7f9f11d46700 1 -- 172.21.15.149:0/4223012793 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9f0c0cd830 con 0x7f9ef40050e0 2023-11-08T19:23:23.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.950+0000 7f9ef3fff700 1 -- 172.21.15.149:0/4223012793 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9efc01d460 con 0x7f9ef40050e0 2023-11-08T19:23:23.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.950+0000 7f5c7da0f700 1 --2- 172.21.15.149:0/3051939413 >> [v2:172.21.15.149:6800/1925115369,v1:172.21.15.149:6801/1925115369] conn(0x7f5c5c074600 0x7f5c5c076a40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:23.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.950+0000 7f9ef3fff700 1 --2- 172.21.15.149:0/4223012793 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9ef806afd0 0x7f9ef806d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.950+0000 7f1677fff700 1 --2- 172.21.15.149:0/2145690398 >> [v2:172.21.15.160:6800/3633365507,v1:172.21.15.160:6802/3633365507] conn(0x7f16600746c0 0x7f1660076b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.950+0000 7f959bfff700 1 -- 172.21.15.149:0/426662856 <== osd.2 v2:172.21.15.149:6816/3407229782 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7f95a0077120 con 0x7f95a0074610 2023-11-08T19:23:23.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.951+0000 7f9ef3fff700 1 -- 172.21.15.149:0/4223012793 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9efc0896a0 con 0x7f9ef40050e0 2023-11-08T19:23:23.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.951+0000 7fda5effd700 1 --2- 172.21.15.149:0/3526343586 >> [v2:172.21.15.149:6808/856914938,v1:172.21.15.149:6809/856914938] conn(0x7fda400015e0 0x7fda40003aa0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:23.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.951+0000 7f3ae5b07700 1 -- 172.21.15.149:0/151008487 shutdown_connections 2023-11-08T19:23:23.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.951+0000 7f9ef3fff700 1 --2- 172.21.15.149:0/4223012793 >> [v2:172.21.15.160:6824/2064905524,v1:172.21.15.160:6825/2064905524] conn(0x7f9ef8074610 0x7f9ef8076a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.951+0000 7f9ef3fff700 1 -- 172.21.15.149:0/4223012793 --> [v2:172.21.15.160:6824/2064905524,v1:172.21.15.160:6825/2064905524] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9ef8077120 con 0x7f9ef8074610 2023-11-08T19:23:23.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.951+0000 7f9ef3fff700 1 -- 172.21.15.149:0/4223012793 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9efc08bcc0 con 0x7f9ef40050e0 2023-11-08T19:23:23.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.951+0000 7f9f0affd700 1 --2- 172.21.15.149:0/4223012793 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9ef806afd0 0x7f9ef806d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.951+0000 7f5c7e210700 1 --2- 172.21.15.149:0/3051939413 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5c5c06afc0 0x7f5c5c06d480 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5c68009990 tx=0x7f5c68009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:23.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.951+0000 7f3ae5b07700 1 -- 172.21.15.149:0/151008487 wait complete. 2023-11-08T19:23:23.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.951+0000 7f9f0bfff700 1 --2- 172.21.15.149:0/4223012793 >> [v2:172.21.15.160:6824/2064905524,v1:172.21.15.160:6825/2064905524] conn(0x7f9ef8074610 0x7f9ef8076a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.951+0000 7f1677fff700 1 --2- 172.21.15.149:0/2145690398 >> [v2:172.21.15.160:6800/3633365507,v1:172.21.15.160:6802/3633365507] conn(0x7f16600746c0 0x7f1660076b00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:23.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.951+0000 7f9f0affd700 1 --2- 172.21.15.149:0/4223012793 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9ef806afd0 0x7f9ef806d490 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c0c5390 tx=0x7f9f00008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:23.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.952+0000 7f9f0bfff700 1 --2- 172.21.15.149:0/4223012793 >> [v2:172.21.15.160:6824/2064905524,v1:172.21.15.160:6825/2064905524] conn(0x7f9ef8074610 0x7f9ef8076a50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:23.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.949+0000 7f94060f8700 1 Processor -- start 2023-11-08T19:23:23.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.949+0000 7f94060f8700 1 -- start start 2023-11-08T19:23:23.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.952+0000 7f5c6effd700 1 -- 172.21.15.149:0/3051939413 <== osd.0 v2:172.21.15.149:6800/1925115369 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7f5c5c077110 con 0x7f5c5c074600 2023-11-08T19:23:23.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.952+0000 7fda47fff700 1 -- 172.21.15.149:0/3526343586 <== osd.3 v2:172.21.15.149:6808/856914938 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7fda40006bd0 con 0x7fda400015e0 2023-11-08T19:23:23.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.952+0000 7f94060f8700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f94000cea70 0x7f940006cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.952+0000 7f94060f8700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f940006d140 0x7f940016eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.952+0000 7f94060f8700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f940006f2a0 con 0x7f94000cee50 2023-11-08T19:23:23.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.952+0000 7f94060f8700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f940006d5d0 con 0x7f94000cea70 2023-11-08T19:23:23.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.952+0000 7f94060f8700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f940016f030 con 0x7f940006d140 2023-11-08T19:23:23.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.952+0000 7f94050f6700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f94000cea70 0x7f940006cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.952+0000 7f94048f5700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f94000cee50 0x7f940016e3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.149:51034/0 (socket says 172.21.15.149:51034) 2023-11-08T19:23:23.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.952+0000 7f94048f5700 1 -- 172.21.15.149:0/2899655715 learned_addr learned my addr 172.21.15.149:0/2899655715 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:23:23.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.952+0000 7f94058f7700 1 --2- 172.21.15.149:0/2899655715 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f940006d140 0x7f940016eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.952+0000 7f165ffff700 1 -- 172.21.15.149:0/2145690398 <== osd.5 v2:172.21.15.160:6800/3633365507 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7f16600771d0 con 0x7f16600746c0 2023-11-08T19:23:23.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.953+0000 7f9ef3fff700 1 -- 172.21.15.149:0/4223012793 <== osd.4 v2:172.21.15.160:6824/2064905524 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7f9ef8077120 con 0x7f9ef8074610 2023-11-08T19:23:23.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.953+0000 7f94058f7700 1 -- 172.21.15.149:0/2899655715 >> v2:172.21.15.160:3300/0 conn(0x7f94000cea70 msgr2=0x7f940006cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:23.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.953+0000 7f94058f7700 1 --2- 172.21.15.149:0/2899655715 >> v2:172.21.15.160:3300/0 conn(0x7f94000cea70 0x7f940006cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.953+0000 7f94058f7700 1 -- 172.21.15.149:0/2899655715 >> v1:172.21.15.160:6789/0 conn(0x7f94000cee50 legacy=0x7f940016e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.953+0000 7f94058f7700 1 -- 172.21.15.149:0/2899655715 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f940008ad00 con 0x7f940006d140 2023-11-08T19:23:23.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.953+0000 7f94058f7700 1 --2- 172.21.15.149:0/2899655715 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f940006d140 0x7f940016eaf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f93f8009d90 tx=0x7f93f800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8edd9880b11a34bb server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:23.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.953+0000 7f3ae5b07700 1 Processor -- start 2023-11-08T19:23:23.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.953+0000 7f93f7fff700 1 -- 172.21.15.149:0/2899655715 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f800e070 con 0x7f940006d140 2023-11-08T19:23:23.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.953+0000 7f93f7fff700 1 -- 172.21.15.149:0/2899655715 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93f800bbd0 con 0x7f940006d140 2023-11-08T19:23:23.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.953+0000 7f93f7fff700 1 -- 172.21.15.149:0/2899655715 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f8012430 con 0x7f940006d140 2023-11-08T19:23:23.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.954+0000 7f94060f8700 1 -- 172.21.15.149:0/2899655715 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f940006d140 msgr2=0x7f940016eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.954+0000 7f94060f8700 1 --2- 172.21.15.149:0/2899655715 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f940006d140 0x7f940016eaf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f93f8009d90 tx=0x7f93f800b330 comp rx=0 tx=0).stop 2023-11-08T19:23:23.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.954+0000 7f94060f8700 1 -- 172.21.15.149:0/2899655715 shutdown_connections 2023-11-08T19:23:23.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.954+0000 7f94060f8700 1 --2- 172.21.15.149:0/2899655715 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f940006d140 0x7f940016eaf0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.954+0000 7f94060f8700 1 --2- 172.21.15.149:0/2899655715 >> v2:172.21.15.160:3300/0 conn(0x7f94000cea70 0x7f940006cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.955+0000 7f94060f8700 1 -- 172.21.15.149:0/2899655715 >> 172.21.15.149:0/2899655715 conn(0x7f94000cf320 msgr2=0x7f94000cf700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:23.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.953+0000 7f3ae5b07700 1 -- start start 2023-11-08T19:23:23.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.955+0000 7f3ae5b07700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ae00c9cc0 0x7f3ae015ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.955+0000 7f3ae5b07700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ae00cc9d0 0x7f3ae0151cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.955+0000 7f3ae5b07700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ae00ce030 0x7f3ae01553a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.955+0000 7f3ae5b07700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae00c4e70 con 0x7f3ae00c9cc0 2023-11-08T19:23:23.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.955+0000 7f3ae5b07700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae015a800 con 0x7f3ae00cc9d0 2023-11-08T19:23:23.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.955+0000 7f3ae5b07700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae00c4b90 con 0x7f3ae00ce030 2023-11-08T19:23:23.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.955+0000 7f3adeffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ae00cc9d0 0x7f3ae0151cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.955+0000 7f3adffff700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ae00ce030 0x7f3ae01553a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.955+0000 7f3adeffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ae00cc9d0 0x7f3ae0151cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.149:38362/0 (socket says 172.21.15.149:38362) 2023-11-08T19:23:23.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.955+0000 7f3adeffd700 1 -- 172.21.15.149:0/3545388781 learned_addr learned my addr 172.21.15.149:0/3545388781 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:23.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.955+0000 7f3adffff700 1 -- 172.21.15.149:0/3545388781 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ae00cc9d0 msgr2=0x7f3ae0151cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.955+0000 7f3adffff700 1 --2- 172.21.15.149:0/3545388781 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ae00cc9d0 0x7f3ae0151cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.955+0000 7f3adffff700 1 -- 172.21.15.149:0/3545388781 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ae00c9cc0 msgr2=0x7f3ae015ac90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-08T19:23:23.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.955+0000 7f3adffff700 1 --2- 172.21.15.149:0/3545388781 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ae00c9cc0 0x7f3ae015ac90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.955+0000 7f3adffff700 1 -- 172.21.15.149:0/3545388781 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ad00094a0 con 0x7f3ae00ce030 2023-11-08T19:23:23.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.955+0000 7f3adeffd700 1 --2- 172.21.15.149:0/3545388781 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ae00cc9d0 0x7f3ae0151cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:23:23.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.956+0000 7f3adffff700 1 --2- 172.21.15.149:0/3545388781 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ae00ce030 0x7f3ae01553a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3ad0027000 tx=0x7f3ad0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:23.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.956+0000 7fe08174e700 1 Processor -- start 2023-11-08T19:23:23.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.956+0000 7f3ac7fff700 1 -- 172.21.15.149:0/3545388781 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad0003ab0 con 0x7f3ae00ce030 2023-11-08T19:23:23.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.956+0000 7f3ae5b07700 1 -- 172.21.15.149:0/3545388781 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ae015a1b0 con 0x7f3ae00ce030 2023-11-08T19:23:23.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.956+0000 7f3ae5b07700 1 -- 172.21.15.149:0/3545388781 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ae01521f0 con 0x7f3ae00ce030 2023-11-08T19:23:23.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.957+0000 7f3ae5b07700 1 -- 172.21.15.149:0/3545388781 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3ae00cbba0 con 0x7f3ae00ce030 2023-11-08T19:23:23.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.958+0000 7f3ac7fff700 1 -- 172.21.15.149:0/3545388781 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ad0030070 con 0x7f3ae00ce030 2023-11-08T19:23:23.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.958+0000 7f3ac7fff700 1 -- 172.21.15.149:0/3545388781 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad0003e10 con 0x7f3ae00ce030 2023-11-08T19:23:23.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.958+0000 7fe08174e700 1 -- start start 2023-11-08T19:23:23.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.959+0000 7fe08174e700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe07c161670 0x7fe07c0b5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.959+0000 7fe08174e700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe07c161a50 0x7fe07c161ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.959+0000 7fe08174e700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe07c0d1a10 con 0x7fe07c15dd90 2023-11-08T19:23:23.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.959+0000 7fe08174e700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe07c0d1cf0 con 0x7fe07c161a50 2023-11-08T19:23:23.061 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.959+0000 7fe08174e700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe07c0d1fd0 con 0x7fe07c161670 2023-11-08T19:23:23.061 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.959+0000 7fe07affd700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe07c161670 0x7fe07c0b5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.061 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.959+0000 7fe07affd700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe07c161670 0x7fe07c0b5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.149:57662/0 (socket says 172.21.15.149:57662) 2023-11-08T19:23:23.061 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.959+0000 7fe07affd700 1 -- 172.21.15.149:0/2897931327 learned_addr learned my addr 172.21.15.149:0/2897931327 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:23.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.960+0000 7f3ac7fff700 1 -- 172.21.15.149:0/3545388781 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3ad0037480 con 0x7f3ae00ce030 2023-11-08T19:23:23.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.960+0000 7f3ac7fff700 1 --2- 172.21.15.149:0/3545388781 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3acc06af30 0x7f3acc06d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.960+0000 7f3ac7fff700 1 -- 172.21.15.149:0/3545388781 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3ad0032070 con 0x7f3ae00ce030 2023-11-08T19:23:23.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.960+0000 7f3adf7fe700 1 --2- 172.21.15.149:0/3545388781 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3acc06af30 0x7f3acc06d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.961+0000 7f3ac7fff700 1 --2- 172.21.15.149:0/3545388781 >> [v2:172.21.15.149:6817/696424905,v1:172.21.15.149:6819/696424905] conn(0x7f3acc074470 0x7f3acc0768b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.961+0000 7f3ac7fff700 1 -- 172.21.15.149:0/3545388781 --> [v2:172.21.15.149:6817/696424905,v1:172.21.15.149:6819/696424905] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3acc076f80 con 0x7f3acc074470 2023-11-08T19:23:23.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.961+0000 7f3ac7fff700 1 -- 172.21.15.149:0/3545388781 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ad009c640 con 0x7f3ae00ce030 2023-11-08T19:23:23.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.961+0000 7f3adeffd700 1 --2- 172.21.15.149:0/3545388781 >> [v2:172.21.15.149:6817/696424905,v1:172.21.15.149:6819/696424905] conn(0x7f3acc074470 0x7f3acc0768b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.961+0000 7f3adeffd700 1 --2- 172.21.15.149:0/3545388781 >> [v2:172.21.15.149:6817/696424905,v1:172.21.15.149:6819/696424905] conn(0x7f3acc074470 0x7f3acc0768b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:23.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.961+0000 7f3adf7fe700 1 --2- 172.21.15.149:0/3545388781 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3acc06af30 0x7f3acc06d3f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3ad800abb0 tx=0x7f3ad8009250 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:23.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.962+0000 7fe07affd700 1 -- 172.21.15.149:0/2897931327 >> v2:172.21.15.149:3300/0 conn(0x7fe07c161a50 msgr2=0x7fe07c161ed0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-08T19:23:23.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.962+0000 7fe07affd700 1 --2- 172.21.15.149:0/2897931327 >> v2:172.21.15.149:3300/0 conn(0x7fe07c161a50 0x7fe07c161ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.962+0000 7fe07affd700 1 -- 172.21.15.149:0/2897931327 >> v1:172.21.15.149:6789/0 conn(0x7fe07c15dd90 legacy=0x7fe07c15e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:23.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.962+0000 7fe07affd700 1 -- 172.21.15.149:0/2897931327 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe07c0d22b0 con 0x7fe07c161670 2023-11-08T19:23:23.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.963+0000 7f3ac7fff700 1 -- 172.21.15.149:0/3545388781 <== osd.1 v2:172.21.15.149:6817/696424905 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7f3acc076f80 con 0x7f3acc074470 2023-11-08T19:23:23.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.964+0000 7f94060f8700 1 -- 172.21.15.149:0/2899655715 shutdown_connections 2023-11-08T19:23:23.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.964+0000 7f94060f8700 1 -- 172.21.15.149:0/2899655715 wait complete. 2023-11-08T19:23:23.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.965+0000 7f94060f8700 1 Processor -- start 2023-11-08T19:23:23.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.966+0000 7f94060f8700 1 -- start start 2023-11-08T19:23:23.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.967+0000 7f94060f8700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f940006d140 0x7f9400086d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.967+0000 7f94060f8700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f94000cee50 0x7f94000c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.967+0000 7f94060f8700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9400072b20 0x7f94000c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.967+0000 7f94060f8700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9400089e50 con 0x7f9400072b20 2023-11-08T19:23:23.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.967+0000 7f94060f8700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94000c6f30 con 0x7f940006d140 2023-11-08T19:23:23.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.967+0000 7f94060f8700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94000c6590 con 0x7f94000cee50 2023-11-08T19:23:23.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.967+0000 7f94058f7700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9400072b20 0x7f94000c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.967+0000 7f94050f6700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f940006d140 0x7f9400086d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.967+0000 7f94050f6700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f940006d140 0x7f9400086d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.149:38374/0 (socket says 172.21.15.149:38374) 2023-11-08T19:23:23.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.967+0000 7f94050f6700 1 -- 172.21.15.149:0/2416311055 learned_addr learned my addr 172.21.15.149:0/2416311055 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:23.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.967+0000 7f94048f5700 1 --2- 172.21.15.149:0/2416311055 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f94000cee50 0x7f94000c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.070 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.968+0000 7f94058f7700 1 -- 172.21.15.149:0/2416311055 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f94000cee50 msgr2=0x7f94000c7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.070 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.968+0000 7f94058f7700 1 --2- 172.21.15.149:0/2416311055 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f94000cee50 0x7f94000c7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.070 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.968+0000 7f94058f7700 1 -- 172.21.15.149:0/2416311055 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f940006d140 msgr2=0x7f9400086d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.070 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.968+0000 7f94058f7700 1 --2- 172.21.15.149:0/2416311055 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f940006d140 0x7f9400086d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.070 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.968+0000 7f94058f7700 1 -- 172.21.15.149:0/2416311055 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f8009a70 con 0x7f9400072b20 2023-11-08T19:23:23.071 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.968+0000 7f94048f5700 1 --2- 172.21.15.149:0/2416311055 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f94000cee50 0x7f94000c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:23:23.071 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.968+0000 7f94058f7700 1 --2- 172.21.15.149:0/2416311055 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9400072b20 0x7f94000c84f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f93f8016000 tx=0x7f93f8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:23.071 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.972+0000 7f93f5ffb700 1 -- 172.21.15.149:0/2416311055 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f8012430 con 0x7f9400072b20 2023-11-08T19:23:23.071 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.972+0000 7f93f5ffb700 1 -- 172.21.15.149:0/2416311055 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93f8004280 con 0x7f9400072b20 2023-11-08T19:23:23.071 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.972+0000 7f93f5ffb700 1 -- 172.21.15.149:0/2416311055 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f8012ea0 con 0x7f9400072b20 2023-11-08T19:23:23.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.973+0000 7fe07affd700 1 --2- 172.21.15.149:0/2897931327 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe07c161670 0x7fe07c0b5e10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe06c006fd0 tx=0x7fe06c013480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59fe3fc31e20dbec server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:23.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.972+0000 7f94060f8700 1 -- 172.21.15.149:0/2416311055 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94000c6870 con 0x7f9400072b20 2023-11-08T19:23:23.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.972+0000 7f94060f8700 1 -- 172.21.15.149:0/2416311055 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94000872d0 con 0x7f9400072b20 2023-11-08T19:23:23.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.974+0000 7f94060f8700 1 -- 172.21.15.149:0/2416311055 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f940006e970 con 0x7f9400072b20 2023-11-08T19:23:23.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.974+0000 7f5c80474700 1 -- 172.21.15.149:0/3051939413 --> [v2:172.21.15.149:6800/1925115369,v1:172.21.15.149:6801/1925115369] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5c780745f0 con 0x7f5c5c074600 2023-11-08T19:23:23.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.975+0000 7f93f5ffb700 1 -- 172.21.15.149:0/2416311055 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f93f8004610 con 0x7f9400072b20 2023-11-08T19:23:23.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.975+0000 7f93f5ffb700 1 --2- 172.21.15.149:0/2416311055 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f93ec06b060 0x7f93ec06d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.975+0000 7f93f5ffb700 1 -- 172.21.15.149:0/2416311055 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f93f808abf0 con 0x7f9400072b20 2023-11-08T19:23:23.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.976+0000 7f93f5ffb700 1 --2- 172.21.15.149:0/2416311055 >> [v2:172.21.15.160:6801/3344903775,v1:172.21.15.160:6803/3344903775] conn(0x7f93ec0746a0 0x7f93ec076ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.976+0000 7f93f5ffb700 1 -- 172.21.15.149:0/2416311055 --> [v2:172.21.15.160:6801/3344903775,v1:172.21.15.160:6803/3344903775] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f93ec0771b0 con 0x7f93ec0746a0 2023-11-08T19:23:23.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.976+0000 7f93f5ffb700 1 -- 172.21.15.149:0/2416311055 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f93f808af70 con 0x7f9400072b20 2023-11-08T19:23:23.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.976+0000 7f94050f6700 1 --2- 172.21.15.149:0/2416311055 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f93ec06b060 0x7f93ec06d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.976+0000 7f94048f5700 1 --2- 172.21.15.149:0/2416311055 >> [v2:172.21.15.160:6801/3344903775,v1:172.21.15.160:6803/3344903775] conn(0x7f93ec0746a0 0x7f93ec076ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.976+0000 7f94050f6700 1 --2- 172.21.15.149:0/2416311055 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f93ec06b060 0x7f93ec06d520 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f940020be20 tx=0x7f93f0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:23.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.977+0000 7f94048f5700 1 --2- 172.21.15.149:0/2416311055 >> [v2:172.21.15.160:6801/3344903775,v1:172.21.15.160:6803/3344903775] conn(0x7f93ec0746a0 0x7f93ec076ae0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:23.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.977+0000 7f93f5ffb700 1 -- 172.21.15.149:0/2416311055 <== osd.6 v2:172.21.15.160:6801/3344903775 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7f93ec0771b0 con 0x7f93ec0746a0 2023-11-08T19:23:23.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.978+0000 7f9f11d46700 1 -- 172.21.15.149:0/4223012793 --> [v2:172.21.15.160:6824/2064905524,v1:172.21.15.160:6825/2064905524] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9f0c15e250 con 0x7f9ef8074610 2023-11-08T19:23:23.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.979+0000 7f9ef3fff700 1 -- 172.21.15.149:0/4223012793 <== osd.4 v2:172.21.15.160:6824/2064905524 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9f04003a00 con 0x7f9ef8074610 2023-11-08T19:23:23.078 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.979+0000 7f9f11d46700 1 -- 172.21.15.149:0/4223012793 >> [v2:172.21.15.160:6824/2064905524,v1:172.21.15.160:6825/2064905524] conn(0x7f9ef8074610 msgr2=0x7f9ef8076a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.078 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.979+0000 7f9f11d46700 1 --2- 172.21.15.149:0/4223012793 >> [v2:172.21.15.160:6824/2064905524,v1:172.21.15.160:6825/2064905524] conn(0x7f9ef8074610 0x7f9ef8076a50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.078 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.979+0000 7f9f11d46700 1 -- 172.21.15.149:0/4223012793 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9ef806afd0 msgr2=0x7f9ef806d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.979+0000 7f9f11d46700 1 --2- 172.21.15.149:0/4223012793 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9ef806afd0 0x7f9ef806d490 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c0c5390 tx=0x7f9f00008040 comp rx=0 tx=0).stop 2023-11-08T19:23:23.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.979+0000 7f9f11d46700 1 -- 172.21.15.149:0/4223012793 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9ef40050e0 msgr2=0x7f9f0c2033b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.979+0000 7f9f11d46700 1 --2- 172.21.15.149:0/4223012793 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9ef40050e0 0x7f9f0c2033b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9efc000c00 tx=0x7f9efc00ee80 comp rx=0 tx=0).stop 2023-11-08T19:23:23.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.979+0000 7f9f0bfff700 1 -- 172.21.15.149:0/4223012793 reap_dead start 2023-11-08T19:23:23.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.979+0000 7f9f11d46700 1 -- 172.21.15.149:0/4223012793 shutdown_connections 2023-11-08T19:23:23.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.979+0000 7f9f11d46700 1 -- 172.21.15.149:0/4223012793 >> 172.21.15.149:0/4223012793 conn(0x7f9f0c0cbee0 msgr2=0x7f9f0c15d790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:23.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.979+0000 7f9f11d46700 1 -- 172.21.15.149:0/4223012793 shutdown_connections 2023-11-08T19:23:23.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.979+0000 7f9f11d46700 1 -- 172.21.15.149:0/4223012793 wait complete. 2023-11-08T19:23:23.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.981+0000 7f95b9879700 1 -- 172.21.15.149:0/426662856 --> [v2:172.21.15.149:6816/3407229782,v1:172.21.15.149:6818/3407229782] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9594002d40 con 0x7f95a0074610 2023-11-08T19:23:23.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.983+0000 7f5c6effd700 1 -- 172.21.15.149:0/3051939413 <== osd.0 v2:172.21.15.149:6800/1925115369 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5c780745f0 con 0x7f5c5c074600 2023-11-08T19:23:23.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.981+0000 7f959bfff700 1 -- 172.21.15.149:0/426662856 <== osd.2 v2:172.21.15.149:6816/3407229782 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9594002d40 con 0x7f95a0074610 2023-11-08T19:23:23.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.982+0000 7f95b9879700 1 -- 172.21.15.149:0/426662856 >> [v2:172.21.15.149:6816/3407229782,v1:172.21.15.149:6818/3407229782] conn(0x7f95a0074610 msgr2=0x7f95a0076a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.982+0000 7f95b9879700 1 --2- 172.21.15.149:0/426662856 >> [v2:172.21.15.149:6816/3407229782,v1:172.21.15.149:6818/3407229782] conn(0x7f95a0074610 0x7f95a0076a50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.981+0000 7fe079ffb700 1 -- 172.21.15.149:0/2897931327 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe06c016070 con 0x7fe07c161670 2023-11-08T19:23:23.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.981+0000 7fe079ffb700 1 -- 172.21.15.149:0/2897931327 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe06c013dc0 con 0x7fe07c161670 2023-11-08T19:23:23.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.981+0000 7fe079ffb700 1 -- 172.21.15.149:0/2897931327 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe06c005c60 con 0x7fe07c161670 2023-11-08T19:23:23.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.982+0000 7fe08174e700 1 -- 172.21.15.149:0/2897931327 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe07c161670 msgr2=0x7fe07c0b5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.982+0000 7fe08174e700 1 --2- 172.21.15.149:0/2897931327 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe07c161670 0x7fe07c0b5e10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe06c006fd0 tx=0x7fe06c013480 comp rx=0 tx=0).stop 2023-11-08T19:23:23.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.983+0000 7fe08174e700 1 -- 172.21.15.149:0/2897931327 shutdown_connections 2023-11-08T19:23:23.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.983+0000 7fe08174e700 1 --2- 172.21.15.149:0/2897931327 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe07c161670 0x7fe07c0b5e10 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.983+0000 7fe08174e700 1 --2- 172.21.15.149:0/2897931327 >> v2:172.21.15.149:3300/0 conn(0x7fe07c161a50 0x7fe07c161ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.983+0000 7fe08174e700 1 -- 172.21.15.149:0/2897931327 >> 172.21.15.149:0/2897931327 conn(0x7fe07c0d3980 msgr2=0x7fe07c0d3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:23.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.983+0000 7fe08174e700 1 -- 172.21.15.149:0/2897931327 shutdown_connections 2023-11-08T19:23:23.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.983+0000 7fe08174e700 1 -- 172.21.15.149:0/2897931327 wait complete. 2023-11-08T19:23:23.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.985+0000 7fe08174e700 1 Processor -- start 2023-11-08T19:23:23.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.985+0000 7f95b9879700 1 -- 172.21.15.149:0/426662856 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f95a006afd0 msgr2=0x7f95a006d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.985+0000 7f95b9879700 1 --2- 172.21.15.149:0/426662856 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f95a006afd0 0x7f95a006d490 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f95b40cf250 tx=0x7f95ac007800 comp rx=0 tx=0).stop 2023-11-08T19:23:23.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.985+0000 7f95b9879700 1 -- 172.21.15.149:0/426662856 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95b4072900 msgr2=0x7f95b40c5b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.985+0000 7f95b9879700 1 --2- 172.21.15.149:0/426662856 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95b4072900 0x7f95b40c5b10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f95a4015000 tx=0x7f95a4004750 comp rx=0 tx=0).stop 2023-11-08T19:23:23.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.986+0000 7f95b37fe700 1 -- 172.21.15.149:0/426662856 reap_dead start 2023-11-08T19:23:23.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.986+0000 7f95b9879700 1 -- 172.21.15.149:0/426662856 shutdown_connections 2023-11-08T19:23:23.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.986+0000 7f95b9879700 1 -- 172.21.15.149:0/426662856 >> 172.21.15.149:0/426662856 conn(0x7f95b406b3d0 msgr2=0x7f95b4161930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:23.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.986+0000 7f95b9879700 1 -- 172.21.15.149:0/426662856 shutdown_connections 2023-11-08T19:23:23.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.986+0000 7f95b9879700 1 -- 172.21.15.149:0/426662856 wait complete. 2023-11-08T19:23:23.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.986+0000 7fe08174e700 1 -- start start 2023-11-08T19:23:23.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.987+0000 7fe08174e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe07c15dd90 0x7fe07c06d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.987+0000 7fe08174e700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe07c161670 0x7fe07c0c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.987+0000 7fe08174e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe07c161a50 0x7fe07c0c8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.987+0000 7fe08174e700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe07c0b6f80 con 0x7fe07c161a50 2023-11-08T19:23:23.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.987+0000 7fe08174e700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe07c0c87c0 con 0x7fe07c15dd90 2023-11-08T19:23:23.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.987+0000 7fe08174e700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe07c156120 con 0x7fe07c161670 2023-11-08T19:23:23.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.987+0000 7fda65f9f700 1 -- 172.21.15.149:0/3526343586 --> [v2:172.21.15.149:6808/856914938,v1:172.21.15.149:6809/856914938] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fda40005c50 con 0x7fda400015e0 2023-11-08T19:23:23.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.987+0000 7fe07affd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe07c15dd90 0x7fe07c06d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.987+0000 7fe07a7fc700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe07c161670 0x7fe07c0c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.987+0000 7fe07a7fc700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe07c161670 0x7fe07c0c8f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.149:57682/0 (socket says 172.21.15.149:57682) 2023-11-08T19:23:23.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.987+0000 7fe07a7fc700 1 -- 172.21.15.149:0/72657319 learned_addr learned my addr 172.21.15.149:0/72657319 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:23.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.987+0000 7fe07a7fc700 1 -- 172.21.15.149:0/72657319 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe07c15dd90 msgr2=0x7fe07c06d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.987+0000 7fe07a7fc700 1 --2- 172.21.15.149:0/72657319 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe07c15dd90 0x7fe07c06d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.092 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.988+0000 7fe07a7fc700 1 -- 172.21.15.149:0/72657319 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe07c161a50 msgr2=0x7fe07c0c8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.092 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.988+0000 7fe07a7fc700 1 --2- 172.21.15.149:0/72657319 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe07c161a50 0x7fe07c0c8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.092 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.988+0000 7fe07a7fc700 1 -- 172.21.15.149:0/72657319 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe06c011da0 con 0x7fe07c161670 2023-11-08T19:23:23.092 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.988+0000 7fda47fff700 1 -- 172.21.15.149:0/3526343586 <== osd.3 v2:172.21.15.149:6808/856914938 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fda40005c50 con 0x7fda400015e0 2023-11-08T19:23:23.093 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.988+0000 7fe07a7fc700 1 --2- 172.21.15.149:0/72657319 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe07c161670 0x7fe07c0c8f10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe07000b480 tx=0x7fe07000b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:23.093 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.988+0000 7f167df1c700 1 -- 172.21.15.149:0/2145690398 --> [v2:172.21.15.160:6800/3633365507,v1:172.21.15.160:6802/3633365507] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f16781e9070 con 0x7f16600746c0 2023-11-08T19:23:23.094 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.988+0000 7f5c80474700 1 -- 172.21.15.149:0/3051939413 >> [v2:172.21.15.149:6800/1925115369,v1:172.21.15.149:6801/1925115369] conn(0x7f5c5c074600 msgr2=0x7f5c5c076a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.094 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.988+0000 7f5c80474700 1 --2- 172.21.15.149:0/3051939413 >> [v2:172.21.15.149:6800/1925115369,v1:172.21.15.149:6801/1925115369] conn(0x7f5c5c074600 0x7f5c5c076a40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.988+0000 7f5c80474700 1 -- 172.21.15.149:0/3051939413 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5c5c06afc0 msgr2=0x7f5c5c06d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.988+0000 7f5c80474700 1 --2- 172.21.15.149:0/3051939413 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5c5c06afc0 0x7f5c5c06d480 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5c68009990 tx=0x7f5c68009190 comp rx=0 tx=0).stop 2023-11-08T19:23:23.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.988+0000 7f5c80474700 1 -- 172.21.15.149:0/3051939413 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5c780a85f0 msgr2=0x7f5c780c4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.988+0000 7f5c80474700 1 --2- 172.21.15.149:0/3051939413 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5c780a85f0 0x7f5c780c4640 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5c780cb8f0 tx=0x7f5c7400e700 comp rx=0 tx=0).stop 2023-11-08T19:23:23.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.989+0000 7f5c7ea11700 1 -- 172.21.15.149:0/3051939413 reap_dead start 2023-11-08T19:23:23.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.989+0000 7f5c80474700 1 -- 172.21.15.149:0/3051939413 shutdown_connections 2023-11-08T19:23:23.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.989+0000 7f5c80474700 1 -- 172.21.15.149:0/3051939413 >> 172.21.15.149:0/3051939413 conn(0x7f5c780cbee0 msgr2=0x7f5c780cc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:23.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.989+0000 7fda65f9f700 1 -- 172.21.15.149:0/3526343586 >> [v2:172.21.15.149:6808/856914938,v1:172.21.15.149:6809/856914938] conn(0x7fda400015e0 msgr2=0x7fda40003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.989+0000 7fda65f9f700 1 --2- 172.21.15.149:0/3526343586 >> [v2:172.21.15.149:6808/856914938,v1:172.21.15.149:6809/856914938] conn(0x7fda400015e0 0x7fda40003aa0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.989+0000 7fda65f9f700 1 -- 172.21.15.149:0/3526343586 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fda4806c830 msgr2=0x7fda4806ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.989+0000 7fda65f9f700 1 --2- 172.21.15.149:0/3526343586 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fda4806c830 0x7fda4806ecf0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fda58001b20 tx=0x7fda580019f0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.989+0000 7fda65f9f700 1 -- 172.21.15.149:0/3526343586 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fda601f8730 msgr2=0x7fda601f8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.989+0000 7fda65f9f700 1 --2- 172.21.15.149:0/3526343586 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fda601f8730 0x7fda601f8bc0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fda600cb6c0 tx=0x7fda5000a3c0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.989+0000 7fda5ffff700 1 -- 172.21.15.149:0/3526343586 reap_dead start 2023-11-08T19:23:23.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.989+0000 7fda65f9f700 1 -- 172.21.15.149:0/3526343586 shutdown_connections 2023-11-08T19:23:23.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.989+0000 7fda65f9f700 1 -- 172.21.15.149:0/3526343586 >> 172.21.15.149:0/3526343586 conn(0x7fda600cbee0 msgr2=0x7fda600cc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:23.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.989+0000 7f5c80474700 1 -- 172.21.15.149:0/3051939413 shutdown_connections 2023-11-08T19:23:23.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.989+0000 7f5c80474700 1 -- 172.21.15.149:0/3051939413 wait complete. 2023-11-08T19:23:23.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.989+0000 7fda65f9f700 1 -- 172.21.15.149:0/3526343586 shutdown_connections 2023-11-08T19:23:23.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.989+0000 7f165ffff700 1 -- 172.21.15.149:0/2145690398 <== osd.5 v2:172.21.15.160:6800/3633365507 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f16781e9070 con 0x7f16600746c0 2023-11-08T19:23:23.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.989+0000 7fda65f9f700 1 -- 172.21.15.149:0/3526343586 wait complete. 2023-11-08T19:23:23.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.990+0000 7f167df1c700 1 -- 172.21.15.149:0/2145690398 >> [v2:172.21.15.160:6800/3633365507,v1:172.21.15.160:6802/3633365507] conn(0x7f16600746c0 msgr2=0x7f1660076b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.990+0000 7f167df1c700 1 --2- 172.21.15.149:0/2145690398 >> [v2:172.21.15.160:6800/3633365507,v1:172.21.15.160:6802/3633365507] conn(0x7f16600746c0 0x7f1660076b00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.990+0000 7fe0637fe700 1 -- 172.21.15.149:0/72657319 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe070011830 con 0x7fe07c161670 2023-11-08T19:23:23.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.990+0000 7fe0637fe700 1 -- 172.21.15.149:0/72657319 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0700119b0 con 0x7fe07c161670 2023-11-08T19:23:23.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.990+0000 7fe0637fe700 1 -- 172.21.15.149:0/72657319 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe070011d60 con 0x7fe07c161670 2023-11-08T19:23:23.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.990+0000 7fe08174e700 1 -- 172.21.15.149:0/72657319 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe07c0c7df0 con 0x7fe07c161670 2023-11-08T19:23:23.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.990+0000 7fe08174e700 1 -- 172.21.15.149:0/72657319 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe07c0c77a0 con 0x7fe07c161670 2023-11-08T19:23:23.103 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.992+0000 7f167df1c700 1 -- 172.21.15.149:0/2145690398 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f166006b080 msgr2=0x7f166006d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.103 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.992+0000 7f167df1c700 1 --2- 172.21.15.149:0/2145690398 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f166006b080 0x7f166006d540 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f167815b8f0 tx=0x7f166c008030 comp rx=0 tx=0).stop 2023-11-08T19:23:23.103 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.992+0000 7f167df1c700 1 -- 172.21.15.149:0/2145690398 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1678071800 msgr2=0x7f1678147ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.992+0000 7f167df1c700 1 --2- 172.21.15.149:0/2145690398 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1678071800 0x7f1678147ca0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f166800d5c0 tx=0x7f166800d8d0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.992+0000 7f1677fff700 1 -- 172.21.15.149:0/2145690398 reap_dead start 2023-11-08T19:23:23.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.992+0000 7f167df1c700 1 -- 172.21.15.149:0/2145690398 shutdown_connections 2023-11-08T19:23:23.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.992+0000 7f167df1c700 1 -- 172.21.15.149:0/2145690398 >> 172.21.15.149:0/2145690398 conn(0x7f16780cf980 msgr2=0x7f167815fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:23.105 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.993+0000 7fe0637fe700 1 -- 172.21.15.149:0/72657319 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe07001a400 con 0x7fe07c161670 2023-11-08T19:23:23.105 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.993+0000 7fe0637fe700 1 --2- 172.21.15.149:0/72657319 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe06806af50 0x7fe06806d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.105 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.994+0000 7fe0637fe700 1 -- 172.21.15.149:0/72657319 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe070057d10 con 0x7fe07c161670 2023-11-08T19:23:23.105 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.994+0000 7fe07affd700 1 --2- 172.21.15.149:0/72657319 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe06806af50 0x7fe06806d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.106 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.995+0000 7f167df1c700 1 -- 172.21.15.149:0/2145690398 shutdown_connections 2023-11-08T19:23:23.106 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.995+0000 7fe07affd700 1 --2- 172.21.15.149:0/72657319 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe06806af50 0x7fe06806d410 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe07c15d510 tx=0x7fe06c010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:23.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.995+0000 7fe08174e700 1 --2- 172.21.15.149:0/72657319 >> [v2:172.21.15.160:6816/3363831222,v1:172.21.15.160:6817/3363831222] conn(0x7fe05c0015e0 0x7fe05c003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.995+0000 7fe08174e700 1 -- 172.21.15.149:0/72657319 --> [v2:172.21.15.160:6816/3363831222,v1:172.21.15.160:6817/3363831222] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe05c006bd0 con 0x7fe05c0015e0 2023-11-08T19:23:23.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.996+0000 7f167df1c700 1 -- 172.21.15.149:0/2145690398 wait complete. 2023-11-08T19:23:23.108 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.996+0000 7fe07b7fe700 1 --2- 172.21.15.149:0/72657319 >> [v2:172.21.15.160:6816/3363831222,v1:172.21.15.160:6817/3363831222] conn(0x7fe05c0015e0 0x7fe05c003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.108 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.996+0000 7f3ae5b07700 1 -- 172.21.15.149:0/3545388781 --> [v2:172.21.15.149:6817/696424905,v1:172.21.15.149:6819/696424905] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3ae00cdb10 con 0x7f3acc074470 2023-11-08T19:23:23.108 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.996+0000 7fe07b7fe700 1 --2- 172.21.15.149:0/72657319 >> [v2:172.21.15.160:6816/3363831222,v1:172.21.15.160:6817/3363831222] conn(0x7fe05c0015e0 0x7fe05c003aa0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:23.109 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.998+0000 7f3ac7fff700 1 -- 172.21.15.149:0/3545388781 <== osd.1 v2:172.21.15.149:6817/696424905 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3ad4001a20 con 0x7f3acc074470 2023-11-08T19:23:23.109 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.998+0000 7f3ae5b07700 1 -- 172.21.15.149:0/3545388781 >> [v2:172.21.15.149:6817/696424905,v1:172.21.15.149:6819/696424905] conn(0x7f3acc074470 msgr2=0x7f3acc0768b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.110 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.998+0000 7f3ae5b07700 1 --2- 172.21.15.149:0/3545388781 >> [v2:172.21.15.149:6817/696424905,v1:172.21.15.149:6819/696424905] conn(0x7f3acc074470 0x7f3acc0768b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.110 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.999+0000 7f3ae5b07700 1 -- 172.21.15.149:0/3545388781 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3acc06af30 msgr2=0x7f3acc06d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.110 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.999+0000 7f3ae5b07700 1 --2- 172.21.15.149:0/3545388781 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3acc06af30 0x7f3acc06d3f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3ad800abb0 tx=0x7f3ad8009250 comp rx=0 tx=0).stop 2023-11-08T19:23:23.110 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.999+0000 7f3ae5b07700 1 -- 172.21.15.149:0/3545388781 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ae00ce030 msgr2=0x7f3ae01553a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.110 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.999+0000 7f3ae5b07700 1 --2- 172.21.15.149:0/3545388781 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ae00ce030 0x7f3ae01553a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3ad0027000 tx=0x7f3ad0004750 comp rx=0 tx=0).stop 2023-11-08T19:23:23.111 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.000+0000 7f3adffff700 1 -- 172.21.15.149:0/3545388781 reap_dead start 2023-11-08T19:23:23.111 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.000+0000 7f3ae5b07700 1 -- 172.21.15.149:0/3545388781 shutdown_connections 2023-11-08T19:23:23.111 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.000+0000 7f3ae5b07700 1 -- 172.21.15.149:0/3545388781 >> 172.21.15.149:0/3545388781 conn(0x7f3ae00cbee0 msgr2=0x7f3ae00cc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:23.111 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.003+0000 7f3ae5b07700 1 -- 172.21.15.149:0/3545388781 shutdown_connections 2023-11-08T19:23:23.111 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.003+0000 7f3ae5b07700 1 -- 172.21.15.149:0/3545388781 wait complete. 2023-11-08T19:23:23.112 INFO:teuthology.orchestra.run.smithi149.stdout:55834574857 2023-11-08T19:23:23.112 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:22.997+0000 7fe0637fe700 1 -- 172.21.15.149:0/72657319 <== osd.7 v2:172.21.15.160:6816/3363831222 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7fe05c006bd0 con 0x7fe05c0015e0 2023-11-08T19:23:23.113 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-08T19:23:23.114 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.013+0000 7f94060f8700 1 -- 172.21.15.149:0/2416311055 --> [v2:172.21.15.160:6801/3344903775,v1:172.21.15.160:6803/3344903775] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f940006e690 con 0x7f93ec0746a0 2023-11-08T19:23:23.114 INFO:teuthology.orchestra.run.smithi149.stdout:55834574857 2023-11-08T19:23:23.115 INFO:teuthology.orchestra.run.smithi149.stdout:55834574857 2023-11-08T19:23:23.116 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-08T19:23:23.116 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-08T19:23:23.117 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.015+0000 7f93f5ffb700 1 -- 172.21.15.149:0/2416311055 <== osd.6 v2:172.21.15.160:6801/3344903775 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f93fc001970 con 0x7f93ec0746a0 2023-11-08T19:23:23.118 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.016+0000 7f94060f8700 1 -- 172.21.15.149:0/2416311055 >> [v2:172.21.15.160:6801/3344903775,v1:172.21.15.160:6803/3344903775] conn(0x7f93ec0746a0 msgr2=0x7f93ec076ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.118 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.016+0000 7f94060f8700 1 --2- 172.21.15.149:0/2416311055 >> [v2:172.21.15.160:6801/3344903775,v1:172.21.15.160:6803/3344903775] conn(0x7f93ec0746a0 0x7f93ec076ae0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.118 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.016+0000 7f94060f8700 1 -- 172.21.15.149:0/2416311055 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f93ec06b060 msgr2=0x7f93ec06d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.118 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.016+0000 7f94060f8700 1 --2- 172.21.15.149:0/2416311055 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f93ec06b060 0x7f93ec06d520 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f940020be20 tx=0x7f93f0008040 comp rx=0 tx=0).stop 2023-11-08T19:23:23.119 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.016+0000 7f94060f8700 1 -- 172.21.15.149:0/2416311055 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9400072b20 msgr2=0x7f94000c84f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.119 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.016+0000 7f94060f8700 1 --2- 172.21.15.149:0/2416311055 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9400072b20 0x7f94000c84f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f93f8016000 tx=0x7f93f8004ad0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.119 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.016+0000 7f94058f7700 1 -- 172.21.15.149:0/2416311055 reap_dead start 2023-11-08T19:23:23.120 INFO:teuthology.orchestra.run.smithi149.stdout:55834574857 2023-11-08T19:23:23.120 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-08T19:23:23.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.018+0000 7f94060f8700 1 -- 172.21.15.149:0/2416311055 shutdown_connections 2023-11-08T19:23:23.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.018+0000 7f94060f8700 1 -- 172.21.15.149:0/2416311055 >> 172.21.15.149:0/2416311055 conn(0x7f94000cf320 msgr2=0x7f9400160e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:23.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.018+0000 7f94060f8700 1 -- 172.21.15.149:0/2416311055 shutdown_connections 2023-11-08T19:23:23.122 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.018+0000 7f94060f8700 1 -- 172.21.15.149:0/2416311055 wait complete. 2023-11-08T19:23:23.122 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.020+0000 7fe08174e700 1 -- 172.21.15.149:0/72657319 --> [v2:172.21.15.160:6816/3363831222,v1:172.21.15.160:6817/3363831222] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe05c005cb0 con 0x7fe05c0015e0 2023-11-08T19:23:23.122 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.021+0000 7fe0637fe700 1 -- 172.21.15.149:0/72657319 <== osd.7 v2:172.21.15.160:6816/3363831222 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe05c005cb0 con 0x7fe05c0015e0 2023-11-08T19:23:23.123 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.021+0000 7fe08174e700 1 -- 172.21.15.149:0/72657319 >> [v2:172.21.15.160:6816/3363831222,v1:172.21.15.160:6817/3363831222] conn(0x7fe05c0015e0 msgr2=0x7fe05c003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.123 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.021+0000 7fe08174e700 1 --2- 172.21.15.149:0/72657319 >> [v2:172.21.15.160:6816/3363831222,v1:172.21.15.160:6817/3363831222] conn(0x7fe05c0015e0 0x7fe05c003aa0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.124 INFO:teuthology.orchestra.run.smithi149.stdout:55834574857 2023-11-08T19:23:23.125 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-08T19:23:23.126 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.021+0000 7fe08174e700 1 -- 172.21.15.149:0/72657319 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe06806af50 msgr2=0x7fe06806d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.126 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.021+0000 7fe08174e700 1 --2- 172.21.15.149:0/72657319 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe06806af50 0x7fe06806d410 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe07c15d510 tx=0x7fe06c010000 comp rx=0 tx=0).stop 2023-11-08T19:23:23.126 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.021+0000 7fe08174e700 1 -- 172.21.15.149:0/72657319 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe07c161670 msgr2=0x7fe07c0c8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.126 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.021+0000 7fe08174e700 1 --2- 172.21.15.149:0/72657319 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe07c161670 0x7fe07c0c8f10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe07000b480 tx=0x7fe07000b840 comp rx=0 tx=0).stop 2023-11-08T19:23:23.126 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.021+0000 7fe07b7fe700 1 -- 172.21.15.149:0/72657319 reap_dead start 2023-11-08T19:23:23.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.021+0000 7fe08174e700 1 -- 172.21.15.149:0/72657319 shutdown_connections 2023-11-08T19:23:23.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.021+0000 7fe08174e700 1 -- 172.21.15.149:0/72657319 >> 172.21.15.149:0/72657319 conn(0x7fe07c0d3980 msgr2=0x7fe07c15bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:23.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.021+0000 7fe08174e700 1 -- 172.21.15.149:0/72657319 shutdown_connections 2023-11-08T19:23:23.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.021+0000 7fe08174e700 1 -- 172.21.15.149:0/72657319 wait complete. 2023-11-08T19:23:23.128 INFO:teuthology.orchestra.run.smithi149.stdout:55834574857 2023-11-08T19:23:23.128 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-08T19:23:23.129 INFO:teuthology.orchestra.run.smithi149.stdout:55834574858 2023-11-08T19:23:23.130 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-08T19:23:23.131 INFO:teuthology.orchestra.run.smithi149.stdout:55834574857 2023-11-08T19:23:23.131 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-08T19:23:23.367 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.366+0000 7f4c18f47700 1 Processor -- start 2023-11-08T19:23:23.368 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.366+0000 7f4c18f47700 1 -- start start 2023-11-08T19:23:23.368 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.367+0000 7f4c18f47700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f4c14165780 0x7f4c140c2d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.368 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.367+0000 7f4c18f47700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4c1406bb90 0x7f4c1406c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.369 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.367+0000 7f4c18f47700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c140c35d0 con 0x7f4c14072240 2023-11-08T19:23:23.369 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.367+0000 7f4c18f47700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c1406e530 con 0x7f4c14165780 2023-11-08T19:23:23.369 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.367+0000 7f4c18f47700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1406c540 con 0x7f4c1406bb90 2023-11-08T19:23:23.370 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.368+0000 7f4c12d9d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4c1406bb90 0x7f4c1406c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.370 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.368+0000 7f4c12d9d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4c1406bb90 0x7f4c1406c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.149:57690/0 (socket says 172.21.15.149:57690) 2023-11-08T19:23:23.370 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.368+0000 7f4c12d9d700 1 -- 172.21.15.149:0/1048786255 learned_addr learned my addr 172.21.15.149:0/1048786255 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:23.370 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.368+0000 7f4c12d9d700 1 -- 172.21.15.149:0/1048786255 >> v2:172.21.15.149:3300/0 conn(0x7f4c14165780 msgr2=0x7f4c140c2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:23.371 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.368+0000 7f4c12d9d700 1 --2- 172.21.15.149:0/1048786255 >> v2:172.21.15.149:3300/0 conn(0x7f4c14165780 0x7f4c140c2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.371 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.368+0000 7f4c12d9d700 1 -- 172.21.15.149:0/1048786255 >> v1:172.21.15.149:6789/0 conn(0x7f4c14072240 legacy=0x7f4c140ca630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:23.371 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.368+0000 7f4c12d9d700 1 -- 172.21.15.149:0/1048786255 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c140ce6c0 con 0x7f4c1406bb90 2023-11-08T19:23:23.371 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.369+0000 7f4c12d9d700 1 --2- 172.21.15.149:0/1048786255 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4c1406bb90 0x7f4c1406c000 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c009e50 tx=0x7f4c0c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b4b0fc84cc8944b server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:23.372 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.368+0000 7fe10f09f700 1 Processor -- start 2023-11-08T19:23:23.372 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.368+0000 7fe10f09f700 1 -- start start 2023-11-08T19:23:23.372 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.369+0000 7fe10f09f700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fe10806d4f0 0x7fe108175d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.373 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.369+0000 7fe10f09f700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1080ce030 con 0x7fe1080ce4c0 2023-11-08T19:23:23.373 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.369+0000 7fe10f09f700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe10816e210 con 0x7fe1080ceac0 2023-11-08T19:23:23.373 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.369+0000 7fe10f09f700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1080cd490 con 0x7fe10806d4f0 2023-11-08T19:23:23.373 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.369+0000 7fe10ce3b700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fe1080ce4c0 0x7fe10808a7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:39410/0 (socket says 172.21.15.149:39410) 2023-11-08T19:23:23.373 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.369+0000 7fe10ce3b700 1 -- 172.21.15.149:0/2685613492 learned_addr learned my addr 172.21.15.149:0/2685613492 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:23:23.374 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.370+0000 7f4c1159a700 1 -- 172.21.15.149:0/1048786255 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c00e070 con 0x7f4c1406bb90 2023-11-08T19:23:23.374 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.370+0000 7f4c1159a700 1 -- 172.21.15.149:0/1048786255 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c0c003a20 con 0x7f4c1406bb90 2023-11-08T19:23:23.374 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.370+0000 7f4c1159a700 1 -- 172.21.15.149:0/1048786255 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c003dd0 con 0x7f4c1406bb90 2023-11-08T19:23:23.375 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.370+0000 7fe10d63c700 1 --2- 172.21.15.149:0/2685613492 >> v2:172.21.15.160:3300/0 conn(0x7fe10806d4f0 0x7fe108175d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.375 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.370+0000 7fe1077fe700 1 -- 172.21.15.149:0/2685613492 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2731839707 0 0) 0x7fe1080ce030 con 0x7fe1080ce4c0 2023-11-08T19:23:23.376 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.370+0000 7fe1077fe700 1 -- 172.21.15.149:0/2685613492 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0f00035b0 con 0x7fe1080ce4c0 2023-11-08T19:23:23.376 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.370+0000 7fe1077fe700 1 -- 172.21.15.149:0/2685613492 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1253315811 0 0) 0x7fe10816e210 con 0x7fe1080ceac0 2023-11-08T19:23:23.376 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.370+0000 7fe1077fe700 1 -- 172.21.15.149:0/2685613492 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1080ce030 con 0x7fe1080ceac0 2023-11-08T19:23:23.376 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.370+0000 7fe1077fe700 1 -- 172.21.15.149:0/2685613492 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3548424963 0 0) 0x7fe0f00035b0 con 0x7fe1080ce4c0 2023-11-08T19:23:23.376 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.370+0000 7fe1077fe700 1 -- 172.21.15.149:0/2685613492 >> v2:172.21.15.160:3300/0 conn(0x7fe10806d4f0 msgr2=0x7fe108175d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:23.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.370+0000 7fe1077fe700 1 --2- 172.21.15.149:0/2685613492 >> v2:172.21.15.160:3300/0 conn(0x7fe10806d4f0 0x7fe108175d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.370+0000 7fe1077fe700 1 -- 172.21.15.149:0/2685613492 >> v1:172.21.15.160:6789/0 conn(0x7fe1080ceac0 legacy=0x7fe10806cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.370+0000 7fe1077fe700 1 -- 172.21.15.149:0/2685613492 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe108071d70 con 0x7fe1080ce4c0 2023-11-08T19:23:23.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.370+0000 7fe1077fe700 1 -- 172.21.15.149:0/2685613492 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7fe1000019f0 con 0x7fe1080ce4c0 2023-11-08T19:23:23.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.370+0000 7fe1077fe700 1 -- 172.21.15.149:0/2685613492 >> v1:172.21.15.149:6789/0 conn(0x7fe1080ce4c0 legacy=0x7fe10808a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.378 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.371+0000 7f4c18f47700 1 -- 172.21.15.149:0/1048786255 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4c1406bb90 msgr2=0x7f4c1406c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.378 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.371+0000 7f4c18f47700 1 --2- 172.21.15.149:0/1048786255 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4c1406bb90 0x7f4c1406c000 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c009e50 tx=0x7f4c0c00b330 comp rx=0 tx=0).stop 2023-11-08T19:23:23.379 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.370+0000 7fe1077fe700 1 --2- 172.21.15.149:0/2685613492 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0f0004bf0 0x7fe0f0004ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.379 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.371+0000 7fe1077fe700 1 --2- 172.21.15.149:0/2685613492 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe0f00037f0 0x7fe0f0003c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.379 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.371+0000 7fe1077fe700 1 --2- 172.21.15.149:0/2685613492 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe0f00041b0 0x7fe0f000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.380 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.371+0000 7fe1077fe700 1 -- 172.21.15.149:0/2685613492 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1080cd490 con 0x7fe0f0004bf0 2023-11-08T19:23:23.380 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.371+0000 7fe1077fe700 1 -- 172.21.15.149:0/2685613492 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f000c090 con 0x7fe0f00041b0 2023-11-08T19:23:23.380 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.371+0000 7fe1077fe700 1 -- 172.21.15.149:0/2685613492 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f000c250 con 0x7fe0f00037f0 2023-11-08T19:23:23.380 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.371+0000 7fe10ce3b700 1 --2- 172.21.15.149:0/2685613492 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0f0004bf0 0x7fe0f0004ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.380 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.371+0000 7fe107fff700 1 --2- 172.21.15.149:0/2685613492 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe0f00037f0 0x7fe0f0003c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.371+0000 7f4c18f47700 1 -- 172.21.15.149:0/1048786255 shutdown_connections 2023-11-08T19:23:23.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.371+0000 7f4c18f47700 1 --2- 172.21.15.149:0/1048786255 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4c1406bb90 0x7f4c1406c000 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.371+0000 7f4c18f47700 1 --2- 172.21.15.149:0/1048786255 >> v2:172.21.15.149:3300/0 conn(0x7f4c14165780 0x7f4c140c2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.371+0000 7f4c18f47700 1 -- 172.21.15.149:0/1048786255 >> 172.21.15.149:0/1048786255 conn(0x7f4c14071720 msgr2=0x7f4c14071b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:23.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.371+0000 7fe10d63c700 1 --2- 172.21.15.149:0/2685613492 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe0f00041b0 0x7fe0f000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.371+0000 7f4c18f47700 1 -- 172.21.15.149:0/1048786255 shutdown_connections 2023-11-08T19:23:23.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.371+0000 7f4c18f47700 1 -- 172.21.15.149:0/1048786255 wait complete. 2023-11-08T19:23:23.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.371+0000 7fe10ce3b700 1 -- 172.21.15.149:0/2685613492 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe0f00037f0 msgr2=0x7fe0f0003c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:23.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.371+0000 7fe10ce3b700 1 --2- 172.21.15.149:0/2685613492 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe0f00037f0 0x7fe0f0003c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.371+0000 7fe10ce3b700 1 -- 172.21.15.149:0/2685613492 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe0f00041b0 msgr2=0x7fe0f000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:23.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.371+0000 7fe10ce3b700 1 --2- 172.21.15.149:0/2685613492 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe0f00041b0 0x7fe0f000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.371+0000 7fe10ce3b700 1 -- 172.21.15.149:0/2685613492 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe108071d70 con 0x7fe0f0004bf0 2023-11-08T19:23:23.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.371+0000 7fe10d63c700 1 -- 172.21.15.149:0/2685613492 reap_dead start 2023-11-08T19:23:23.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.371+0000 7fe10ce3b700 1 --2- 172.21.15.149:0/2685613492 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0f0004bf0 0x7fe0f0004ff0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe10000a890 tx=0x7fe0f0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fec728718f68f32 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:23.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.372+0000 7fe1077fe700 1 -- 172.21.15.149:0/2685613492 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe100012600 con 0x7fe0f0004bf0 2023-11-08T19:23:23.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.372+0000 7fe1077fe700 1 -- 172.21.15.149:0/2685613492 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe100012760 con 0x7fe0f0004bf0 2023-11-08T19:23:23.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.372+0000 7fe1077fe700 1 -- 172.21.15.149:0/2685613492 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe100012b10 con 0x7fe0f0004bf0 2023-11-08T19:23:23.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.372+0000 7f2e5df8a700 1 Processor -- start 2023-11-08T19:23:23.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.373+0000 7fe10f09f700 1 -- 172.21.15.149:0/2685613492 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0f0004bf0 msgr2=0x7fe0f0004ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.387 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.373+0000 7fe10f09f700 1 --2- 172.21.15.149:0/2685613492 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0f0004bf0 0x7fe0f0004ff0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe10000a890 tx=0x7fe0f0005880 comp rx=0 tx=0).stop 2023-11-08T19:23:23.387 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.373+0000 7f4c18f47700 1 Processor -- start 2023-11-08T19:23:23.387 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.373+0000 7fe10f09f700 1 -- 172.21.15.149:0/2685613492 shutdown_connections 2023-11-08T19:23:23.388 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.373+0000 7fe10f09f700 1 --2- 172.21.15.149:0/2685613492 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0f0004bf0 0x7fe0f0004ff0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.388 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.373+0000 7fe10f09f700 1 -- 172.21.15.149:0/2685613492 >> 172.21.15.149:0/2685613492 conn(0x7fe1080cbee0 msgr2=0x7fe1080cc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:23.388 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.373+0000 7f4c18f47700 1 -- start start 2023-11-08T19:23:23.389 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.373+0000 7fe10f09f700 1 -- 172.21.15.149:0/2685613492 shutdown_connections 2023-11-08T19:23:23.389 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.374+0000 7fd710e56700 1 Processor -- start 2023-11-08T19:23:23.389 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.374+0000 7fd710e56700 1 -- start start 2023-11-08T19:23:23.390 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.373+0000 7f2e5df8a700 1 -- start start 2023-11-08T19:23:23.390 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.374+0000 7f2e5df8a700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f2e580c2a70 0x7f2e580ce090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.390 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.374+0000 7f2e5df8a700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2e58072900 0x7f2e58070d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.391 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.374+0000 7f2e5df8a700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e581669c0 con 0x7f2e580b0ee0 2023-11-08T19:23:23.391 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.374+0000 7f2e5df8a700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e580712d0 con 0x7f2e580c2a70 2023-11-08T19:23:23.391 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.374+0000 7f2e5df8a700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e58165aa0 con 0x7f2e58072900 2023-11-08T19:23:23.391 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.374+0000 7f2e57fff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f2e580b0ee0 0x7f2e580c9d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:39424/0 (socket says 172.21.15.149:39424) 2023-11-08T19:23:23.391 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.374+0000 7f2e57fff700 1 -- 172.21.15.149:0/649610190 learned_addr learned my addr 172.21.15.149:0/649610190 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:23:23.392 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.374+0000 7fe10f09f700 1 -- 172.21.15.149:0/2685613492 wait complete. 2023-11-08T19:23:23.392 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.375+0000 7fe10f09f700 1 Processor -- start 2023-11-08T19:23:23.392 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.373+0000 7f422cfec700 1 Processor -- start 2023-11-08T19:23:23.393 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.374+0000 7f4c18f47700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4c1406bb90 0x7f4c14160330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.393 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.374+0000 7f4c18f47700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4c14072240 0x7f4c140b4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.393 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.374+0000 7f4c18f47700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4c14165780 0x7f4c140b4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.393 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.374+0000 7f4c18f47700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c140c3ad0 con 0x7f4c14165780 2023-11-08T19:23:23.394 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.374+0000 7f4c18f47700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c140c3d70 con 0x7f4c1406bb90 2023-11-08T19:23:23.394 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.374+0000 7f4c18f47700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c140c4050 con 0x7f4c14072240 2023-11-08T19:23:23.394 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.375+0000 7f4c12d9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4c14165780 0x7f4c140b4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.394 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.375+0000 7f4c12d9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4c14165780 0x7f4c140b4f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37428/0 (socket says 172.21.15.149:37428) 2023-11-08T19:23:23.395 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.375+0000 7f4c12d9d700 1 -- 172.21.15.149:0/3986119024 learned_addr learned my addr 172.21.15.149:0/3986119024 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:23.395 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.375+0000 7f4c1259c700 1 --2- 172.21.15.149:0/3986119024 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4c1406bb90 0x7f4c14160330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.395 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.375+0000 7f4c11d9b700 1 --2- 172.21.15.149:0/3986119024 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4c14072240 0x7f4c140b4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.395 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.375+0000 7f4c1259c700 1 -- 172.21.15.149:0/3986119024 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4c14072240 msgr2=0x7f4c140b4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.395 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.375+0000 7f4c1259c700 1 --2- 172.21.15.149:0/3986119024 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4c14072240 0x7f4c140b4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.396 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.375+0000 7f4c1259c700 1 -- 172.21.15.149:0/3986119024 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4c14165780 msgr2=0x7f4c140b4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.396 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.375+0000 7f4c1259c700 1 --2- 172.21.15.149:0/3986119024 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4c14165780 0x7f4c140b4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.396 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.375+0000 7f4c1259c700 1 -- 172.21.15.149:0/3986119024 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c0c009b30 con 0x7f4c1406bb90 2023-11-08T19:23:23.397 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.376+0000 7fd710e56700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd70c0cc9d0 0x7fd70c159bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.397 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.376+0000 7fd710e56700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd70c15dd10 con 0x7fd70c0ce030 2023-11-08T19:23:23.397 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.376+0000 7fd710e56700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd70c15e530 con 0x7fd70c0c9cc0 2023-11-08T19:23:23.397 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.376+0000 7fd710e56700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c15df70 con 0x7fd70c0cc9d0 2023-11-08T19:23:23.397 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.376+0000 7fd70a59c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd70c0cc9d0 0x7fd70c159bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.398 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.376+0000 7fd70ad9d700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fd70c0ce030 0x7fd70c0ca430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:39436/0 (socket says 172.21.15.149:39436) 2023-11-08T19:23:23.398 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.376+0000 7fd70a59c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd70c0cc9d0 0x7fd70c159bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.149:57718/0 (socket says 172.21.15.149:57718) 2023-11-08T19:23:23.398 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.376+0000 7fd70ad9d700 1 -- 172.21.15.149:0/1659952891 learned_addr learned my addr 172.21.15.149:0/1659952891 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:23:23.398 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.375+0000 7f422cfec700 1 -- start start 2023-11-08T19:23:23.399 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.376+0000 7f422cfec700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f42280c9cc0 0x7f42280ce030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.399 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.376+0000 7f422cfec700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f422815dd10 con 0x7f4228159bc0 2023-11-08T19:23:23.399 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.376+0000 7f4c1259c700 1 --2- 172.21.15.149:0/3986119024 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4c1406bb90 0x7f4c14160330 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4c0800b410 tx=0x7f4c0800b720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:23.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.376+0000 7f422cfec700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f422815e530 con 0x7f42280ce570 2023-11-08T19:23:23.401 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.376+0000 7f422cfec700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4228159fa0 con 0x7f42280c9cc0 2023-11-08T19:23:23.402 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.376+0000 7fd70a59c700 1 -- 172.21.15.149:0/1659952891 >> v1:172.21.15.160:6789/0 conn(0x7fd70c0c9cc0 legacy=0x7fd70c15d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.402 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.376+0000 7fd70a59c700 1 -- 172.21.15.149:0/1659952891 >> v1:172.21.15.149:6789/0 conn(0x7fd70c0ce030 legacy=0x7fd70c0ca430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.402 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.376+0000 7fd70a59c700 1 -- 172.21.15.149:0/1659952891 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd70c15e250 con 0x7fd70c0cc9d0 2023-11-08T19:23:23.403 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.376+0000 7f2e567fc700 1 -- 172.21.15.149:0/649610190 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3364227402 0 0) 0x7f2e581669c0 con 0x7f2e580b0ee0 2023-11-08T19:23:23.403 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.376+0000 7f2e567fc700 1 -- 172.21.15.149:0/649610190 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e400035b0 con 0x7f2e580b0ee0 2023-11-08T19:23:23.403 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.376+0000 7f4c02ffd700 1 -- 172.21.15.149:0/3986119024 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c08011620 con 0x7f4c1406bb90 2023-11-08T19:23:23.404 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.376+0000 7f4c02ffd700 1 -- 172.21.15.149:0/3986119024 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c08011780 con 0x7f4c1406bb90 2023-11-08T19:23:23.404 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.376+0000 7f4c02ffd700 1 -- 172.21.15.149:0/3986119024 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c08011b30 con 0x7f4c1406bb90 2023-11-08T19:23:23.404 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.377+0000 7f4c18f47700 1 -- 172.21.15.149:0/3986119024 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c140c4330 con 0x7f4c1406bb90 2023-11-08T19:23:23.404 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.377+0000 7f4c18f47700 1 -- 172.21.15.149:0/3986119024 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c14160870 con 0x7f4c1406bb90 2023-11-08T19:23:23.405 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.377+0000 7f18746d5700 1 Processor -- start 2023-11-08T19:23:23.405 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.377+0000 7fd70a59c700 1 --2- 172.21.15.149:0/1659952891 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd70c0cc9d0 0x7fd70c159bc0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc009820 tx=0x7fd6fc009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b61322076bf4749f server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:23.405 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.377+0000 7f2e567fc700 1 -- 172.21.15.149:0/649610190 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1371951621 0 0) 0x7f2e400035b0 con 0x7f2e580b0ee0 2023-11-08T19:23:23.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.377+0000 7f2e567fc700 1 -- 172.21.15.149:0/649610190 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2e58072900 msgr2=0x7f2e58070d90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-08T19:23:23.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.377+0000 7f2e567fc700 1 --2- 172.21.15.149:0/649610190 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2e58072900 0x7f2e58070d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.377+0000 7f2e567fc700 1 -- 172.21.15.149:0/649610190 >> v2:172.21.15.160:3300/0 conn(0x7f2e580c2a70 msgr2=0x7f2e580ce090 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-08T19:23:23.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.377+0000 7f2e567fc700 1 --2- 172.21.15.149:0/649610190 >> v2:172.21.15.160:3300/0 conn(0x7f2e580c2a70 0x7f2e580ce090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.377+0000 7f2e567fc700 1 -- 172.21.15.149:0/649610190 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e58165d40 con 0x7f2e580b0ee0 2023-11-08T19:23:23.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.377+0000 7f2e567fc700 1 -- 172.21.15.149:0/649610190 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f2e500019f0 con 0x7f2e580b0ee0 2023-11-08T19:23:23.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.377+0000 7f2e567fc700 1 -- 172.21.15.149:0/649610190 >> v1:172.21.15.149:6789/0 conn(0x7f2e580b0ee0 legacy=0x7f2e580c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.377+0000 7f2e567fc700 1 --2- 172.21.15.149:0/649610190 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2e40003a00 0x7f2e40003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.377+0000 7f2e567fc700 1 --2- 172.21.15.149:0/649610190 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e40004850 0x7f2e40004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.377+0000 7f2e567fc700 1 --2- 172.21.15.149:0/649610190 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2e40005260 0x7f2e4000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.377+0000 7f2e567fc700 1 -- 172.21.15.149:0/649610190 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e580712d0 con 0x7f2e40004850 2023-11-08T19:23:23.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.377+0000 7f2e567fc700 1 -- 172.21.15.149:0/649610190 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e58165aa0 con 0x7f2e40005260 2023-11-08T19:23:23.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.377+0000 7f2e567fc700 1 -- 172.21.15.149:0/649610190 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4000c1f0 con 0x7f2e40003a00 2023-11-08T19:23:23.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.376+0000 7fe10f09f700 1 -- start start 2023-11-08T19:23:23.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.377+0000 7fe10f09f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe0f0004bf0 0x7fe1080c56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.377+0000 7fe10f09f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe108071230 0x7fe1080716b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.377+0000 7fe10f09f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe10817d620 0x7fe10817dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.377+0000 7fe10f09f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe108071bf0 con 0x7fe10817d620 2023-11-08T19:23:23.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.377+0000 7fe10f09f700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1080c3a70 con 0x7fe108071230 2023-11-08T19:23:23.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.377+0000 7fe10f09f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe10817e450 con 0x7fe0f0004bf0 2023-11-08T19:23:23.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.378+0000 7fd70959a700 1 -- 172.21.15.149:0/1659952891 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc004230 con 0x7fd70c0cc9d0 2023-11-08T19:23:23.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.378+0000 7fd70959a700 1 -- 172.21.15.149:0/1659952891 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6fc004390 con 0x7fd70c0cc9d0 2023-11-08T19:23:23.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.378+0000 7fd70959a700 1 -- 172.21.15.149:0/1659952891 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc0036a0 con 0x7fd70c0cc9d0 2023-11-08T19:23:23.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.378+0000 7f2e57fff700 1 --2- 172.21.15.149:0/649610190 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2e40005260 0x7f2e4000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.377+0000 7fe10ce3b700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe0f0004bf0 0x7fe1080c56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.377+0000 7fe10d63c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe10817d620 0x7fe10817dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.378+0000 7fe10d63c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe10817d620 0x7fe10817dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37446/0 (socket says 172.21.15.149:37446) 2023-11-08T19:23:23.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.378+0000 7fe10d63c700 1 -- 172.21.15.149:0/3489126285 learned_addr learned my addr 172.21.15.149:0/3489126285 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:23.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.378+0000 7fe10d63c700 1 -- 172.21.15.149:0/3489126285 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe0f0004bf0 msgr2=0x7fe1080c56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.378+0000 7fe10d63c700 1 --2- 172.21.15.149:0/3489126285 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe0f0004bf0 0x7fe1080c56e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.378+0000 7fe10d63c700 1 -- 172.21.15.149:0/3489126285 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe108071230 msgr2=0x7fe1080716b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.378+0000 7fe10d63c700 1 --2- 172.21.15.149:0/3489126285 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe108071230 0x7fe1080716b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.378+0000 7fe10d63c700 1 -- 172.21.15.149:0/3489126285 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe10817e730 con 0x7fe10817d620 2023-11-08T19:23:23.414 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.377+0000 7f422659c700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f4228159bc0 0x7f422815d600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:39442/0 (socket says 172.21.15.149:39442) 2023-11-08T19:23:23.414 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.377+0000 7f422659c700 1 -- 172.21.15.149:0/3516862034 learned_addr learned my addr 172.21.15.149:0/3516862034 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:23:23.414 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.378+0000 7f4225d9b700 1 --2- 172.21.15.149:0/3516862034 >> v2:172.21.15.149:3300/0 conn(0x7f42280c9cc0 0x7f42280ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.414 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.378+0000 7f4225d9b700 1 -- 172.21.15.149:0/3516862034 >> v1:172.21.15.160:6789/0 conn(0x7f42280ce570 legacy=0x7f42280ca430 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-08T19:23:23.414 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.378+0000 7f4225d9b700 1 -- 172.21.15.149:0/3516862034 >> v1:172.21.15.149:6789/0 conn(0x7f4228159bc0 legacy=0x7f422815d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.378+0000 7f4225d9b700 1 -- 172.21.15.149:0/3516862034 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f422815df70 con 0x7f42280c9cc0 2023-11-08T19:23:23.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.379+0000 7f4225d9b700 1 --2- 172.21.15.149:0/3516862034 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42280c9cc0 0x7f42280ce030 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4218009840 tx=0x7f4218009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccc71e1795f81bd5 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:23.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.377+0000 7f18746d5700 1 -- start start 2023-11-08T19:23:23.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.378+0000 7f18746d5700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f186c159bc0 0x7f186c15d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.379+0000 7f18746d5700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f186c0c9cc0 0x7f186c0ce030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.379+0000 7f18746d5700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f186c0ce570 0x7f186c0ca430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.379+0000 7f18746d5700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f186c159fa0 con 0x7f186c0ce570 2023-11-08T19:23:23.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.379+0000 7f18746d5700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f186c15e530 con 0x7f186c159bc0 2023-11-08T19:23:23.417 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.379+0000 7f18746d5700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f186c15df70 con 0x7f186c0c9cc0 2023-11-08T19:23:23.417 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.379+0000 7f1871c70700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f186c0c9cc0 0x7f186c0ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.417 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.379+0000 7f1871c70700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f186c0c9cc0 0x7f186c0ce030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.149:57742/0 (socket says 172.21.15.149:57742) 2023-11-08T19:23:23.417 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.379+0000 7f1871c70700 1 -- 172.21.15.149:0/2175975379 learned_addr learned my addr 172.21.15.149:0/2175975379 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:23.417 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.379+0000 7f1872471700 1 --2- 172.21.15.149:0/2175975379 >> v2:172.21.15.160:3300/0 conn(0x7f186c159bc0 0x7f186c15d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.378+0000 7f2e577fe700 1 --2- 172.21.15.149:0/649610190 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2e40003a00 0x7f2e40003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.379+0000 7f2e56ffd700 1 --2- 172.21.15.149:0/649610190 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e40004850 0x7f2e40004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.379+0000 7f2e577fe700 1 -- 172.21.15.149:0/649610190 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2e40005260 msgr2=0x7f2e4000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:23.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.379+0000 7fe10d63c700 1 --2- 172.21.15.149:0/3489126285 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe10817d620 0x7fe10817dab0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe0f0005830 tx=0x7fe0f8011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:23.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.379+0000 7f2e577fe700 1 --2- 172.21.15.149:0/649610190 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2e40005260 0x7f2e4000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.379+0000 7f2e577fe700 1 -- 172.21.15.149:0/649610190 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e40004850 msgr2=0x7f2e40004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:23.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.379+0000 7f2e577fe700 1 --2- 172.21.15.149:0/649610190 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e40004850 0x7f2e40004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.379+0000 7f2e577fe700 1 -- 172.21.15.149:0/649610190 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e58165d40 con 0x7f2e40003a00 2023-11-08T19:23:23.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.379+0000 7fd710e56700 1 -- 172.21.15.149:0/1659952891 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd70c0cc9d0 msgr2=0x7fd70c159bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.379+0000 7fd710e56700 1 --2- 172.21.15.149:0/1659952891 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd70c0cc9d0 0x7fd70c159bc0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc009820 tx=0x7fd6fc009b30 comp rx=0 tx=0).stop 2023-11-08T19:23:23.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.379+0000 7f4c02ffd700 1 -- 172.21.15.149:0/3986119024 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4c08011c90 con 0x7f4c1406bb90 2023-11-08T19:23:23.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.379+0000 7f2e577fe700 1 --2- 172.21.15.149:0/649610190 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2e40003a00 0x7f2e40003e20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2e48009860 tx=0x7f2e40005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab511da787a205d6 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:23.422 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.379+0000 7fd710e56700 1 -- 172.21.15.149:0/1659952891 shutdown_connections 2023-11-08T19:23:23.422 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.379+0000 7fd710e56700 1 --2- 172.21.15.149:0/1659952891 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd70c0cc9d0 0x7fd70c159bc0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.422 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.379+0000 7fd710e56700 1 -- 172.21.15.149:0/1659952891 >> 172.21.15.149:0/1659952891 conn(0x7fd70c0cbee0 msgr2=0x7fd70c0cc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:23.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.379+0000 7f422559a700 1 -- 172.21.15.149:0/3516862034 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4218004230 con 0x7f42280c9cc0 2023-11-08T19:23:23.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.379+0000 7f422559a700 1 -- 172.21.15.149:0/3516862034 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4218004390 con 0x7f42280c9cc0 2023-11-08T19:23:23.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.379+0000 7f422559a700 1 -- 172.21.15.149:0/3516862034 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421800c700 con 0x7f42280c9cc0 2023-11-08T19:23:23.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.379+0000 7fd710e56700 1 -- 172.21.15.149:0/1659952891 shutdown_connections 2023-11-08T19:23:23.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.380+0000 7f2e567fc700 1 -- 172.21.15.149:0/649610190 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e480092d0 con 0x7f2e40003a00 2023-11-08T19:23:23.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.380+0000 7f2e567fc700 1 -- 172.21.15.149:0/649610190 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e48011620 con 0x7f2e40003a00 2023-11-08T19:23:23.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.380+0000 7f2e567fc700 1 -- 172.21.15.149:0/649610190 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e480119d0 con 0x7f2e40003a00 2023-11-08T19:23:23.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.380+0000 7f422cfec700 1 -- 172.21.15.149:0/3516862034 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42280c9cc0 msgr2=0x7f42280ce030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.380+0000 7f422cfec700 1 --2- 172.21.15.149:0/3516862034 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42280c9cc0 0x7f42280ce030 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4218009840 tx=0x7f4218009b50 comp rx=0 tx=0).stop 2023-11-08T19:23:23.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.379+0000 7f4c18f47700 1 -- 172.21.15.149:0/3986119024 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c140c4850 con 0x7f4c1406bb90 2023-11-08T19:23:23.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.379+0000 7f4c02ffd700 1 --2- 172.21.15.149:0/3986119024 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4bf406afd0 0x7f4bf406d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.380+0000 7f4c02ffd700 1 -- 172.21.15.149:0/3986119024 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4c08089700 con 0x7f4c1406bb90 2023-11-08T19:23:23.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.380+0000 7f4c11d9b700 1 --2- 172.21.15.149:0/3986119024 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4bf406afd0 0x7f4bf406d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.379+0000 7f1871c70700 1 -- 172.21.15.149:0/2175975379 >> v2:172.21.15.160:3300/0 conn(0x7f186c159bc0 msgr2=0x7f186c15d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:23.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.379+0000 7f1871c70700 1 --2- 172.21.15.149:0/2175975379 >> v2:172.21.15.160:3300/0 conn(0x7f186c159bc0 0x7f186c15d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.379+0000 7f1871c70700 1 -- 172.21.15.149:0/2175975379 >> v2:172.21.15.149:3300/0 conn(0x7f186c0ce570 msgr2=0x7f186c0ca430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:23.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.379+0000 7f1871c70700 1 --2- 172.21.15.149:0/2175975379 >> v2:172.21.15.149:3300/0 conn(0x7f186c0ce570 0x7f186c0ca430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.379+0000 7f1871c70700 1 -- 172.21.15.149:0/2175975379 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f186c15e250 con 0x7f186c0c9cc0 2023-11-08T19:23:23.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.380+0000 7f1871c70700 1 --2- 172.21.15.149:0/2175975379 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f186c0c9cc0 0x7f186c0ce030 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f18680088f0 tx=0x7f1868008c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a9ee60581a5b83c server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:23.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.380+0000 7f187146f700 1 -- 172.21.15.149:0/2175975379 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186800b760 con 0x7f186c0c9cc0 2023-11-08T19:23:23.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.380+0000 7f187146f700 1 -- 172.21.15.149:0/2175975379 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f186800b8c0 con 0x7f186c0c9cc0 2023-11-08T19:23:23.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.380+0000 7f187146f700 1 -- 172.21.15.149:0/2175975379 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18680126f0 con 0x7f186c0c9cc0 2023-11-08T19:23:23.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.381+0000 7f2e5df8a700 1 -- 172.21.15.149:0/649610190 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2e40003a00 msgr2=0x7f2e40003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.381+0000 7f2e5df8a700 1 --2- 172.21.15.149:0/649610190 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2e40003a00 0x7f2e40003e20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2e48009860 tx=0x7f2e40005880 comp rx=0 tx=0).stop 2023-11-08T19:23:23.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.381+0000 7f4c11d9b700 1 --2- 172.21.15.149:0/3986119024 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4bf406afd0 0x7f4bf406d490 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4c04007fd0 tx=0x7f4c04009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:23.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.380+0000 7fe1057fa700 1 -- 172.21.15.149:0/3489126285 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f8004020 con 0x7fe10817d620 2023-11-08T19:23:23.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.380+0000 7fe1057fa700 1 -- 172.21.15.149:0/3489126285 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0f8004180 con 0x7fe10817d620 2023-11-08T19:23:23.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.380+0000 7fe1057fa700 1 -- 172.21.15.149:0/3489126285 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f8004550 con 0x7fe10817d620 2023-11-08T19:23:23.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.381+0000 7f18746d5700 1 -- 172.21.15.149:0/2175975379 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f186c0c9cc0 msgr2=0x7f186c0ce030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.381+0000 7f18746d5700 1 --2- 172.21.15.149:0/2175975379 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f186c0c9cc0 0x7f186c0ce030 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f18680088f0 tx=0x7f1868008c00 comp rx=0 tx=0).stop 2023-11-08T19:23:23.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.381+0000 7f2e57fff700 1 -- 172.21.15.149:0/649610190 reap_dead start 2023-11-08T19:23:23.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.381+0000 7f2e5df8a700 1 -- 172.21.15.149:0/649610190 shutdown_connections 2023-11-08T19:23:23.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.381+0000 7f2e5df8a700 1 -- 172.21.15.149:0/649610190 >> 172.21.15.149:0/649610190 conn(0x7f2e5806b3d0 msgr2=0x7f2e580cf460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:23.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.379+0000 7fd710e56700 1 -- 172.21.15.149:0/1659952891 wait complete. 2023-11-08T19:23:23.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.381+0000 7f422cfec700 1 -- 172.21.15.149:0/3516862034 shutdown_connections 2023-11-08T19:23:23.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.381+0000 7f422cfec700 1 --2- 172.21.15.149:0/3516862034 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42280c9cc0 0x7f42280ce030 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.381+0000 7f422cfec700 1 -- 172.21.15.149:0/3516862034 >> 172.21.15.149:0/3516862034 conn(0x7f42280cbee0 msgr2=0x7f42280cc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:23.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.381+0000 7f30ec287700 1 Processor -- start 2023-11-08T19:23:23.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.381+0000 7f18746d5700 1 -- 172.21.15.149:0/2175975379 shutdown_connections 2023-11-08T19:23:23.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.381+0000 7f18746d5700 1 --2- 172.21.15.149:0/2175975379 >> v2:172.21.15.149:3300/0 conn(0x7f186c0ce570 0x7f186c0ca430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.381+0000 7f18746d5700 1 --2- 172.21.15.149:0/2175975379 >> v2:172.21.15.160:3300/0 conn(0x7f186c159bc0 0x7f186c15d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.381+0000 7f18746d5700 1 --2- 172.21.15.149:0/2175975379 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f186c0c9cc0 0x7f186c0ce030 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.381+0000 7f18746d5700 1 -- 172.21.15.149:0/2175975379 >> 172.21.15.149:0/2175975379 conn(0x7f186c0cbee0 msgr2=0x7f186c0cc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:23.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.381+0000 7fd710e56700 1 Processor -- start 2023-11-08T19:23:23.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.381+0000 7f18746d5700 1 -- 172.21.15.149:0/2175975379 shutdown_connections 2023-11-08T19:23:23.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.381+0000 7f30ec287700 1 -- start start 2023-11-08T19:23:23.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.382+0000 7f2e5df8a700 1 -- 172.21.15.149:0/649610190 shutdown_connections 2023-11-08T19:23:23.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.382+0000 7f18746d5700 1 -- 172.21.15.149:0/2175975379 wait complete. 2023-11-08T19:23:23.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.381+0000 7fe10f09f700 1 -- 172.21.15.149:0/3489126285 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1080c3420 con 0x7fe10817d620 2023-11-08T19:23:23.438 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.381+0000 7fe10f09f700 1 -- 172.21.15.149:0/3489126285 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1080c5c20 con 0x7fe10817d620 2023-11-08T19:23:23.438 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.382+0000 7f422cfec700 1 -- 172.21.15.149:0/3516862034 shutdown_connections 2023-11-08T19:23:23.439 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.382+0000 7f422cfec700 1 -- 172.21.15.149:0/3516862034 wait complete. 2023-11-08T19:23:23.439 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.382+0000 7fd710e56700 1 -- start start 2023-11-08T19:23:23.439 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.383+0000 7fd710e56700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd70c0c9cc0 0x7fd70c14ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.439 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.383+0000 7fd710e56700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd70c0cc9d0 0x7fd70c0b3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.440 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.383+0000 7fd710e56700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd70c0ce030 0x7fd70c0c8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.440 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.383+0000 7f30ec287700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f30e40c2a70 0x7f30e40ce090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.440 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.383+0000 7f30ec287700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f30e4072900 0x7f30e4070d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.383+0000 7f30ec287700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30e41669c0 con 0x7f30e40b0ee0 2023-11-08T19:23:23.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.383+0000 7f30ec287700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30e40712d0 con 0x7f30e4072900 2023-11-08T19:23:23.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.383+0000 7f30ec287700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30e4165aa0 con 0x7f30e40c2a70 2023-11-08T19:23:23.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.383+0000 7fd710e56700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c0c9300 con 0x7fd70c0cc9d0 2023-11-08T19:23:23.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.383+0000 7fd710e56700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c0c6c90 con 0x7fd70c0ce030 2023-11-08T19:23:23.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.383+0000 7fd710e56700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c0c8d80 con 0x7fd70c0c9cc0 2023-11-08T19:23:23.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.383+0000 7fd70a59c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd70c0c9cc0 0x7fd70c14ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.443 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.383+0000 7fd70ad9d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd70c0ce030 0x7fd70c0c8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.443 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.383+0000 7fd70ad9d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd70c0ce030 0x7fd70c0c8840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.149:38462/0 (socket says 172.21.15.149:38462) 2023-11-08T19:23:23.443 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.383+0000 7fd70ad9d700 1 -- 172.21.15.149:0/1644577142 learned_addr learned my addr 172.21.15.149:0/1644577142 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:23.443 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.383+0000 7f30ea023700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f30e40c2a70 0x7f30e40ce090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.444 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.383+0000 7f30ea023700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f30e40c2a70 0x7f30e40ce090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.149:57752/0 (socket says 172.21.15.149:57752) 2023-11-08T19:23:23.444 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.383+0000 7f30ea023700 1 -- 172.21.15.149:0/3158361929 learned_addr learned my addr 172.21.15.149:0/3158361929 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:23.444 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.383+0000 7f18746d5700 1 Processor -- start 2023-11-08T19:23:23.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.382+0000 7f2e5df8a700 1 -- 172.21.15.149:0/649610190 wait complete. 2023-11-08T19:23:23.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.384+0000 7fd70ad9d700 1 -- 172.21.15.149:0/1644577142 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd70c0c9cc0 msgr2=0x7fd70c14ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.384+0000 7fd70ad9d700 1 --2- 172.21.15.149:0/1644577142 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd70c0c9cc0 0x7fd70c14ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.384+0000 7fd70ad9d700 1 -- 172.21.15.149:0/1644577142 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd70c0cc9d0 msgr2=0x7fd70c0b3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.384+0000 7fd70ad9d700 1 --2- 172.21.15.149:0/1644577142 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd70c0cc9d0 0x7fd70c0b3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.384+0000 7fd70ad9d700 1 -- 172.21.15.149:0/1644577142 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6fc0094a0 con 0x7fd70c0ce030 2023-11-08T19:23:23.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.384+0000 7fe10f09f700 1 -- 172.21.15.149:0/3489126285 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1080c3c00 con 0x7fe10817d620 2023-11-08T19:23:23.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.384+0000 7f30ea023700 1 -- 172.21.15.149:0/3158361929 >> v2:172.21.15.149:3300/0 conn(0x7f30e4072900 msgr2=0x7f30e4070d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:23.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.384+0000 7f30ea023700 1 --2- 172.21.15.149:0/3158361929 >> v2:172.21.15.149:3300/0 conn(0x7f30e4072900 0x7f30e4070d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.384+0000 7f30ea023700 1 -- 172.21.15.149:0/3158361929 >> v1:172.21.15.149:6789/0 conn(0x7f30e40b0ee0 legacy=0x7f30e40c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:23.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.384+0000 7f30ea023700 1 -- 172.21.15.149:0/3158361929 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e4165d40 con 0x7f30e40c2a70 2023-11-08T19:23:23.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.384+0000 7fd70ad9d700 1 --2- 172.21.15.149:0/1644577142 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd70c0ce030 0x7fd70c0c8840 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd70400ca20 tx=0x7fd70400cd30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:23.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.384+0000 7f2e5df8a700 1 Processor -- start 2023-11-08T19:23:23.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.384+0000 7f18746d5700 1 -- start start 2023-11-08T19:23:23.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.384+0000 7f30ea023700 1 --2- 172.21.15.149:0/3158361929 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f30e40c2a70 0x7f30e40ce090 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f30dc009e50 tx=0x7f30dc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f02afa856aa28394 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:23.450 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.384+0000 7f422cfec700 1 Processor -- start 2023-11-08T19:23:23.450 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.384+0000 7f422cfec700 1 -- start start 2023-11-08T19:23:23.450 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.385+0000 7f30e9021700 1 -- 172.21.15.149:0/3158361929 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30dc00e070 con 0x7f30e40c2a70 2023-11-08T19:23:23.451 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.385+0000 7f30e9021700 1 -- 172.21.15.149:0/3158361929 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30dc00b9c0 con 0x7f30e40c2a70 2023-11-08T19:23:23.451 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.385+0000 7f30e9021700 1 -- 172.21.15.149:0/3158361929 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30dc00bd70 con 0x7f30e40c2a70 2023-11-08T19:23:23.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.384+0000 7f2e5df8a700 1 -- start start 2023-11-08T19:23:23.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.385+0000 7f2e5df8a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2e58146f90 0x7f2e5814f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.385+0000 7f2e5df8a700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2e580c7cf0 0x7f2e5814fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.385+0000 7f2e5df8a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e58147370 0x7f2e5814e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.385+0000 7f2e5df8a700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e581517f0 con 0x7f2e58147370 2023-11-08T19:23:23.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.385+0000 7f2e5df8a700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5814f0d0 con 0x7f2e58146f90 2023-11-08T19:23:23.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.385+0000 7f2e5df8a700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5814f3b0 con 0x7f2e580c7cf0 2023-11-08T19:23:23.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.386+0000 7f2e577fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2e58146f90 0x7f2e5814f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.386+0000 7f2e577fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2e58146f90 0x7f2e5814f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.149:38472/0 (socket says 172.21.15.149:38472) 2023-11-08T19:23:23.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.386+0000 7f2e577fe700 1 -- 172.21.15.149:0/869550733 learned_addr learned my addr 172.21.15.149:0/869550733 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:23.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.385+0000 7f422cfec700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f42280c9cc0 0x7f4228200350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.385+0000 7f422cfec700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f42280ce570 0x7f4228158d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.385+0000 7f422cfec700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4228159bc0 0x7f42280ad710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.385+0000 7f422cfec700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4228157c60 con 0x7f4228159bc0 2023-11-08T19:23:23.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.386+0000 7f422cfec700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4228157f40 con 0x7f42280c9cc0 2023-11-08T19:23:23.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.386+0000 7f422cfec700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4228158220 con 0x7f42280ce570 2023-11-08T19:23:23.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.385+0000 7fe1057fa700 1 -- 172.21.15.149:0/3489126285 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe0f80036a0 con 0x7fe10817d620 2023-11-08T19:23:23.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.385+0000 7f18746d5700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f186c0c9cc0 0x7f186c1ef330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.385+0000 7f18746d5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f186c0ce570 0x7f186c1f3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.385+0000 7f18746d5700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f186c159bc0 0x7f186c0c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.385+0000 7f18746d5700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f186c1f3870 con 0x7f186c0ce570 2023-11-08T19:23:23.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.385+0000 7f18746d5700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f186c1ef960 con 0x7f186c0c9cc0 2023-11-08T19:23:23.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.385+0000 7f18746d5700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f186c1efc40 con 0x7f186c159bc0 2023-11-08T19:23:23.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.385+0000 7f1872c72700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f186c159bc0 0x7f186c0c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.385+0000 7f30ec287700 1 -- 172.21.15.149:0/3158361929 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f30e40c2a70 msgr2=0x7f30e40ce090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.385+0000 7f30ec287700 1 --2- 172.21.15.149:0/3158361929 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f30e40c2a70 0x7f30e40ce090 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f30dc009e50 tx=0x7f30dc00b330 comp rx=0 tx=0).stop 2023-11-08T19:23:23.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.385+0000 7f1872471700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f186c0c9cc0 0x7f186c1ef330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.385+0000 7f1872c72700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f186c159bc0 0x7f186c0c91d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.149:57764/0 (socket says 172.21.15.149:57764) 2023-11-08T19:23:23.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.385+0000 7f1872c72700 1 -- 172.21.15.149:0/1678690800 learned_addr learned my addr 172.21.15.149:0/1678690800 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:23.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.386+0000 7f1872c72700 1 -- 172.21.15.149:0/1678690800 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f186c0c9cc0 msgr2=0x7f186c1ef330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.386+0000 7f1872c72700 1 --2- 172.21.15.149:0/1678690800 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f186c0c9cc0 0x7f186c1ef330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.386+0000 7f1872c72700 1 -- 172.21.15.149:0/1678690800 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f186c0ce570 msgr2=0x7f186c1f3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.386+0000 7f1872c72700 1 --2- 172.21.15.149:0/1678690800 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f186c0ce570 0x7f186c1f3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.386+0000 7f1872c72700 1 -- 172.21.15.149:0/1678690800 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18680085d0 con 0x7f186c159bc0 2023-11-08T19:23:23.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.386+0000 7f4225d9b700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f42280ce570 0x7f4228158d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.386+0000 7f4225d9b700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f42280ce570 0x7f4228158d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.149:57776/0 (socket says 172.21.15.149:57776) 2023-11-08T19:23:23.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.386+0000 7f4225d9b700 1 -- 172.21.15.149:0/1583931097 learned_addr learned my addr 172.21.15.149:0/1583931097 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:23.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.386+0000 7f30ec287700 1 -- 172.21.15.149:0/3158361929 shutdown_connections 2023-11-08T19:23:23.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.386+0000 7f30ec287700 1 --2- 172.21.15.149:0/3158361929 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f30e40c2a70 0x7f30e40ce090 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.386+0000 7f30ec287700 1 --2- 172.21.15.149:0/3158361929 >> v2:172.21.15.149:3300/0 conn(0x7f30e4072900 0x7f30e4070d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.386+0000 7f30ec287700 1 -- 172.21.15.149:0/3158361929 >> 172.21.15.149:0/3158361929 conn(0x7f30e406b3d0 msgr2=0x7f30e40cf460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:23.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.386+0000 7f2e56ffd700 1 --2- 172.21.15.149:0/869550733 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2e580c7cf0 0x7f2e5814fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.385+0000 7fe1057fa700 1 --2- 172.21.15.149:0/3489126285 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe0f406af50 0x7fe0f406d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.386+0000 7fe1057fa700 1 -- 172.21.15.149:0/3489126285 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe0f8018030 con 0x7fe10817d620 2023-11-08T19:23:23.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.386+0000 7f422659c700 1 --2- 172.21.15.149:0/1583931097 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f42280c9cc0 0x7f4228200350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.386+0000 7f30ec287700 1 -- 172.21.15.149:0/3158361929 shutdown_connections 2023-11-08T19:23:23.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.386+0000 7fe10ce3b700 1 --2- 172.21.15.149:0/3489126285 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe0f406af50 0x7fe0f406d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.386+0000 7f30ec287700 1 -- 172.21.15.149:0/3158361929 wait complete. 2023-11-08T19:23:23.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.386+0000 7f1872c72700 1 --2- 172.21.15.149:0/1678690800 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f186c159bc0 0x7f186c0c91d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f185c00b550 tx=0x7f185c00b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:23.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.387+0000 7fd6faffd700 1 -- 172.21.15.149:0/1644577142 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70400a9e0 con 0x7fd70c0ce030 2023-11-08T19:23:23.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.387+0000 7fd6faffd700 1 -- 172.21.15.149:0/1644577142 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd70400ab40 con 0x7fd70c0ce030 2023-11-08T19:23:23.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.387+0000 7fd710e56700 1 -- 172.21.15.149:0/1644577142 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd70c0c9020 con 0x7fd70c0ce030 2023-11-08T19:23:23.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.387+0000 7fd6faffd700 1 -- 172.21.15.149:0/1644577142 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd704012400 con 0x7fd70c0ce030 2023-11-08T19:23:23.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.387+0000 7fd710e56700 1 -- 172.21.15.149:0/1644577142 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd70c0c6920 con 0x7fd70c0ce030 2023-11-08T19:23:23.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.386+0000 7f2e56ffd700 1 -- 172.21.15.149:0/869550733 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2e58146f90 msgr2=0x7f2e5814f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.386+0000 7f2e56ffd700 1 --2- 172.21.15.149:0/869550733 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2e58146f90 0x7f2e5814f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.386+0000 7f2e56ffd700 1 -- 172.21.15.149:0/869550733 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e58147370 msgr2=0x7f2e5814e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.386+0000 7f2e56ffd700 1 --2- 172.21.15.149:0/869550733 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e58147370 0x7f2e5814e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.468 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.386+0000 7f2e56ffd700 1 -- 172.21.15.149:0/869550733 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e58151a40 con 0x7f2e580c7cf0 2023-11-08T19:23:23.468 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.387+0000 7f2e56ffd700 1 --2- 172.21.15.149:0/869550733 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2e580c7cf0 0x7f2e5814fe40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2e5806f060 tx=0x7f2e4c00d830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:23.468 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.387+0000 7f2e3ffff700 1 -- 172.21.15.149:0/869550733 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c0125f0 con 0x7f2e580c7cf0 2023-11-08T19:23:23.468 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.387+0000 7f2e3ffff700 1 -- 172.21.15.149:0/869550733 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e4c012750 con 0x7f2e580c7cf0 2023-11-08T19:23:23.468 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.387+0000 7f2e5df8a700 1 -- 172.21.15.149:0/869550733 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e58151d20 con 0x7f2e580c7cf0 2023-11-08T19:23:23.469 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.387+0000 7f2e5df8a700 1 -- 172.21.15.149:0/869550733 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e5814eac0 con 0x7f2e580c7cf0 2023-11-08T19:23:23.469 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.387+0000 7fe10ce3b700 1 --2- 172.21.15.149:0/3489126285 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe0f406af50 0x7fe0f406d410 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe100000f80 tx=0x7fe100007000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:23.469 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.386+0000 7f4225d9b700 1 -- 172.21.15.149:0/1583931097 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f42280c9cc0 msgr2=0x7f4228200350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.470 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.386+0000 7f4225d9b700 1 --2- 172.21.15.149:0/1583931097 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f42280c9cc0 0x7f4228200350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.470 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.386+0000 7f4225d9b700 1 -- 172.21.15.149:0/1583931097 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4228159bc0 msgr2=0x7f42280ad710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.470 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.386+0000 7f4225d9b700 1 --2- 172.21.15.149:0/1583931097 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4228159bc0 0x7f42280ad710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.470 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.386+0000 7f4225d9b700 1 -- 172.21.15.149:0/1583931097 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42180094a0 con 0x7f42280ce570 2023-11-08T19:23:23.471 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.388+0000 7f30ec287700 1 Processor -- start 2023-11-08T19:23:23.471 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.388+0000 7f4c02ffd700 1 -- 172.21.15.149:0/3986119024 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4c140c4850 con 0x7f4c1406bb90 2023-11-08T19:23:23.472 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.388+0000 7fd710e56700 1 -- 172.21.15.149:0/1644577142 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd70c0c64a0 con 0x7fd70c0ce030 2023-11-08T19:23:23.472 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.388+0000 7f4225d9b700 1 --2- 172.21.15.149:0/1583931097 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f42280ce570 0x7f4228158d00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4218004000 tx=0x7f4218004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:23.472 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.388+0000 7f30ec287700 1 -- start start 2023-11-08T19:23:23.473 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.389+0000 7f4216ffd700 1 -- 172.21.15.149:0/1583931097 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421801e070 con 0x7f42280ce570 2023-11-08T19:23:23.473 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.389+0000 7f30ec287700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f30e4072900 0x7f30e415fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.473 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.389+0000 7f30ec287700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30e40b0ee0 0x7f30e40c84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.389+0000 7f30ec287700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f30e40c2a70 0x7f30e40c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.389+0000 7f30ec287700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e4160040 con 0x7f30e40b0ee0 2023-11-08T19:23:23.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.389+0000 7f30ec287700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e41f8230 con 0x7f30e4072900 2023-11-08T19:23:23.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.389+0000 7f30ec287700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30e41f7940 con 0x7f30e40c2a70 2023-11-08T19:23:23.475 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.389+0000 7f4216ffd700 1 -- 172.21.15.149:0/1583931097 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f421800c050 con 0x7f42280ce570 2023-11-08T19:23:23.475 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.389+0000 7f4216ffd700 1 -- 172.21.15.149:0/1583931097 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4218003b10 con 0x7f42280ce570 2023-11-08T19:23:23.475 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.389+0000 7f422cfec700 1 -- 172.21.15.149:0/1583931097 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4228158500 con 0x7f42280ce570 2023-11-08T19:23:23.475 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.389+0000 7f422cfec700 1 -- 172.21.15.149:0/1583931097 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4228200890 con 0x7f42280ce570 2023-11-08T19:23:23.476 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.391+0000 7f4216ffd700 1 -- 172.21.15.149:0/1583931097 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4218003c70 con 0x7f42280ce570 2023-11-08T19:23:23.476 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.391+0000 7f4216ffd700 1 --2- 172.21.15.149:0/1583931097 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f421006b0b0 0x7f421006d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.476 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.391+0000 7f4216ffd700 1 -- 172.21.15.149:0/1583931097 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f421808a860 con 0x7f42280ce570 2023-11-08T19:23:23.476 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.390+0000 7f1862ffd700 1 -- 172.21.15.149:0/1678690800 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185c011830 con 0x7f186c159bc0 2023-11-08T19:23:23.477 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.390+0000 7f1862ffd700 1 -- 172.21.15.149:0/1678690800 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f185c011990 con 0x7f186c159bc0 2023-11-08T19:23:23.477 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.390+0000 7f1862ffd700 1 -- 172.21.15.149:0/1678690800 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185c011d40 con 0x7f186c159bc0 2023-11-08T19:23:23.477 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.390+0000 7f18746d5700 1 -- 172.21.15.149:0/1678690800 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f186c1eff20 con 0x7f186c159bc0 2023-11-08T19:23:23.477 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.390+0000 7f18746d5700 1 -- 172.21.15.149:0/1678690800 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f186c0c9710 con 0x7f186c159bc0 2023-11-08T19:23:23.478 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.390+0000 7f30ea023700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f30e4072900 0x7f30e415fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.478 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.390+0000 7f30ea023700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f30e4072900 0x7f30e415fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.149:38486/0 (socket says 172.21.15.149:38486) 2023-11-08T19:23:23.478 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.390+0000 7f30ea023700 1 -- 172.21.15.149:0/1511303844 learned_addr learned my addr 172.21.15.149:0/1511303844 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:23.479 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.390+0000 7f2e3ffff700 1 -- 172.21.15.149:0/869550733 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c012b00 con 0x7f2e580c7cf0 2023-11-08T19:23:23.479 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.390+0000 7f2e3ffff700 1 -- 172.21.15.149:0/869550733 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2e4c012d20 con 0x7f2e580c7cf0 2023-11-08T19:23:23.479 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.391+0000 7f2e3ffff700 1 --2- 172.21.15.149:0/869550733 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2e4006cad0 0x7f2e4006ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.479 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.391+0000 7f2e3ffff700 1 -- 172.21.15.149:0/869550733 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2e4c089ac0 con 0x7f2e580c7cf0 2023-11-08T19:23:23.480 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.392+0000 7f2e5df8a700 1 -- 172.21.15.149:0/869550733 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e380052f0 con 0x7f2e580c7cf0 2023-11-08T19:23:23.480 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.392+0000 7f2e577fe700 1 --2- 172.21.15.149:0/869550733 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2e4006cad0 0x7f2e4006ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.480 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.392+0000 7f422659c700 1 --2- 172.21.15.149:0/1583931097 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f421006b0b0 0x7f421006d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.481 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.392+0000 7f30ea824700 1 --2- 172.21.15.149:0/1511303844 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f30e40c2a70 0x7f30e40c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.481 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.392+0000 7fd6faffd700 1 -- 172.21.15.149:0/1644577142 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd70401b3b0 con 0x7fd70c0ce030 2023-11-08T19:23:23.482 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.392+0000 7fd6faffd700 1 --2- 172.21.15.149:0/1644577142 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd6ec06af00 0x7fd6ec06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.482 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.392+0000 7fd6faffd700 1 -- 172.21.15.149:0/1644577142 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd7040894a0 con 0x7fd70c0ce030 2023-11-08T19:23:23.482 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.392+0000 7fd70a59c700 1 --2- 172.21.15.149:0/1644577142 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd6ec06af00 0x7fd6ec06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.482 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.393+0000 7f1862ffd700 1 -- 172.21.15.149:0/1678690800 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f185c01a400 con 0x7f186c159bc0 2023-11-08T19:23:23.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.393+0000 7f422659c700 1 --2- 172.21.15.149:0/1583931097 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f421006b0b0 0x7f421006d570 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f42200012e0 tx=0x7f4220006320 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:23.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.393+0000 7f30ea824700 1 -- 172.21.15.149:0/1511303844 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f30e4072900 msgr2=0x7f30e415fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.484 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.393+0000 7f30ea824700 1 --2- 172.21.15.149:0/1511303844 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f30e4072900 0x7f30e415fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.484 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.393+0000 7f30ea824700 1 -- 172.21.15.149:0/1511303844 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30e40b0ee0 msgr2=0x7f30e40c84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.484 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.393+0000 7f30ea824700 1 --2- 172.21.15.149:0/1511303844 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30e40b0ee0 0x7f30e40c84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.484 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.393+0000 7f30ea824700 1 -- 172.21.15.149:0/1511303844 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30dc009b30 con 0x7f30e40c2a70 2023-11-08T19:23:23.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.393+0000 7f30ea824700 1 --2- 172.21.15.149:0/1511303844 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f30e40c2a70 0x7f30e40c89f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f30e000c3f0 tx=0x7f30e000c700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:23.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.393+0000 7fd70a59c700 1 --2- 172.21.15.149:0/1644577142 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd6ec06af00 0x7fd6ec06d3c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc0097c0 tx=0x7fd6fc008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:23.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.393+0000 7f18746d5700 1 -- 172.21.15.149:0/1678690800 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18540052f0 con 0x7f186c159bc0 2023-11-08T19:23:23.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.393+0000 7f422cfec700 1 -- 172.21.15.149:0/1583931097 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f420c0052f0 con 0x7f42280ce570 2023-11-08T19:23:23.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.394+0000 7f2e577fe700 1 --2- 172.21.15.149:0/869550733 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2e4006cad0 0x7f2e4006ef90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2e48000c00 tx=0x7f2e4801d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:23.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.394+0000 7f1862ffd700 1 --2- 172.21.15.149:0/1678690800 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f185006afd0 0x7f185006d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.394+0000 7f1872471700 1 --2- 172.21.15.149:0/1678690800 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f185006afd0 0x7f185006d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.394+0000 7f1862ffd700 1 -- 172.21.15.149:0/1678690800 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f185c0897d0 con 0x7f186c159bc0 2023-11-08T19:23:23.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.394+0000 7f1872471700 1 --2- 172.21.15.149:0/1678690800 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f185006afd0 0x7f185006d490 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f186c0b3290 tx=0x7f186400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:23.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.394+0000 7fe1057fa700 1 -- 172.21.15.149:0/3489126285 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe0f8054990 con 0x7fe10817d620 2023-11-08T19:23:23.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.394+0000 7fd6faffd700 1 -- 172.21.15.149:0/1644577142 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd70c0c64a0 con 0x7fd70c0ce030 2023-11-08T19:23:23.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.397+0000 7f30daffd700 1 -- 172.21.15.149:0/1511303844 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e00052d0 con 0x7f30e40c2a70 2023-11-08T19:23:23.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.397+0000 7f30ec287700 1 -- 172.21.15.149:0/1511303844 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30e41f7be0 con 0x7f30e40c2a70 2023-11-08T19:23:23.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.397+0000 7f30ec287700 1 -- 172.21.15.149:0/1511303844 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30e40b4f30 con 0x7f30e40c2a70 2023-11-08T19:23:23.490 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.397+0000 7f2e3ffff700 1 -- 172.21.15.149:0/869550733 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2e4c054860 con 0x7f2e580c7cf0 2023-11-08T19:23:23.490 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.399+0000 7f30ec287700 1 -- 172.21.15.149:0/1511303844 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30e41f83c0 con 0x7f30e40c2a70 2023-11-08T19:23:23.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.401+0000 7f89fe60f700 1 Processor -- start 2023-11-08T19:23:23.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.402+0000 7f1862ffd700 1 -- 172.21.15.149:0/1678690800 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f185c054600 con 0x7f186c159bc0 2023-11-08T19:23:23.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.402+0000 7f89fe60f700 1 -- start start 2023-11-08T19:23:23.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.402+0000 7f89fe60f700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f89f806c2a0 0x7f89f806e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.402+0000 7f89fe60f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f89f806da50 0x7f89f80cdd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.402+0000 7f89fe60f700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89f80cb220 con 0x7f89f815a1a0 2023-11-08T19:23:23.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.402+0000 7f89fe60f700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89f815a580 con 0x7f89f806c2a0 2023-11-08T19:23:23.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.402+0000 7f89fe60f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89f80725a0 con 0x7f89f806da50 2023-11-08T19:23:23.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.403+0000 7f89f7fff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f89f815a1a0 0x7f89f806bb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:39510/0 (socket says 172.21.15.149:39510) 2023-11-08T19:23:23.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.403+0000 7f89f7fff700 1 -- 172.21.15.149:0/2549070162 learned_addr learned my addr 172.21.15.149:0/2549070162 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:23:23.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.403+0000 7f89f77fe700 1 --2- 172.21.15.149:0/2549070162 >> v2:172.21.15.160:3300/0 conn(0x7f89f806c2a0 0x7f89f806e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.403+0000 7f89fcbac700 1 --2- 172.21.15.149:0/2549070162 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f89f806da50 0x7f89f80cdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.403+0000 7f89fcbac700 1 -- 172.21.15.149:0/2549070162 >> v2:172.21.15.160:3300/0 conn(0x7f89f806c2a0 msgr2=0x7f89f806e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:23.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.403+0000 7f89fcbac700 1 --2- 172.21.15.149:0/2549070162 >> v2:172.21.15.160:3300/0 conn(0x7f89f806c2a0 0x7f89f806e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.403+0000 7f89fcbac700 1 -- 172.21.15.149:0/2549070162 >> v1:172.21.15.149:6789/0 conn(0x7f89f815a1a0 legacy=0x7f89f806bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.403+0000 7f89fcbac700 1 -- 172.21.15.149:0/2549070162 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f80cb500 con 0x7f89f806da50 2023-11-08T19:23:23.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.403+0000 7f89f77fe700 1 --2- 172.21.15.149:0/2549070162 >> v2:172.21.15.160:3300/0 conn(0x7f89f806c2a0 0x7f89f806e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:23:23.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.403+0000 7f89fcbac700 1 --2- 172.21.15.149:0/2549070162 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f89f806da50 0x7f89f80cdd00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f89f0009d90 tx=0x7f89f000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d29b8a5cf8c6fe67 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:23.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.406+0000 7f4216ffd700 1 -- 172.21.15.149:0/1583931097 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4218055790 con 0x7f42280ce570 2023-11-08T19:23:23.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.406+0000 7f30daffd700 1 -- 172.21.15.149:0/1511303844 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e000ce10 con 0x7f30e40c2a70 2023-11-08T19:23:23.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.406+0000 7f30daffd700 1 -- 172.21.15.149:0/1511303844 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e0006860 con 0x7f30e40c2a70 2023-11-08T19:23:23.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.406+0000 7f89f6ffd700 1 -- 172.21.15.149:0/2549070162 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f000e070 con 0x7f89f806da50 2023-11-08T19:23:23.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.408+0000 7f30daffd700 1 -- 172.21.15.149:0/1511303844 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f30e00069c0 con 0x7f30e40c2a70 2023-11-08T19:23:23.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.409+0000 7f30daffd700 1 --2- 172.21.15.149:0/1511303844 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f30c806af00 0x7f30c806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.409+0000 7f30daffd700 1 -- 172.21.15.149:0/1511303844 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f30e0089180 con 0x7f30e40c2a70 2023-11-08T19:23:23.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.409+0000 7f30ea023700 1 --2- 172.21.15.149:0/1511303844 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f30c806af00 0x7f30c806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.410+0000 7f30ea023700 1 --2- 172.21.15.149:0/1511303844 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f30c806af00 0x7f30c806d3c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f30e40b0ba0 tx=0x7f30dc009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:23.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.411+0000 7f30daffd700 1 -- 172.21.15.149:0/1511303844 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f30e0053fa0 con 0x7f30e40c2a70 2023-11-08T19:23:23.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.418+0000 7f89f6ffd700 1 -- 172.21.15.149:0/2549070162 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89f000bac0 con 0x7f89f806da50 2023-11-08T19:23:23.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.418+0000 7f89f6ffd700 1 -- 172.21.15.149:0/2549070162 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f000be70 con 0x7f89f806da50 2023-11-08T19:23:23.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.422+0000 7f89fe60f700 1 -- 172.21.15.149:0/2549070162 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f89f806da50 msgr2=0x7f89f80cdd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.422+0000 7f89fe60f700 1 --2- 172.21.15.149:0/2549070162 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f89f806da50 0x7f89f80cdd00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f89f0009d90 tx=0x7f89f000b330 comp rx=0 tx=0).stop 2023-11-08T19:23:23.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.423+0000 7f89fe60f700 1 -- 172.21.15.149:0/2549070162 shutdown_connections 2023-11-08T19:23:23.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.423+0000 7f89fe60f700 1 --2- 172.21.15.149:0/2549070162 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f89f806da50 0x7f89f80cdd00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.423+0000 7f89fe60f700 1 --2- 172.21.15.149:0/2549070162 >> v2:172.21.15.160:3300/0 conn(0x7f89f806c2a0 0x7f89f806e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.423+0000 7f89fe60f700 1 -- 172.21.15.149:0/2549070162 >> 172.21.15.149:0/2549070162 conn(0x7f89f8071720 msgr2=0x7f89f8071b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:23.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.423+0000 7f89fe60f700 1 -- 172.21.15.149:0/2549070162 shutdown_connections 2023-11-08T19:23:23.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.423+0000 7f89fe60f700 1 -- 172.21.15.149:0/2549070162 wait complete. 2023-11-08T19:23:23.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.425+0000 7f89fe60f700 1 Processor -- start 2023-11-08T19:23:23.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.426+0000 7f89fe60f700 1 -- start start 2023-11-08T19:23:23.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.427+0000 7f89fe60f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f89f806c2a0 0x7f89f814a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.427+0000 7f89fe60f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f89f806da50 0x7f89f815c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.427+0000 7f89fe60f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f89f815a1a0 0x7f89f80c96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.427+0000 7f89fe60f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f815d9d0 con 0x7f89f806da50 2023-11-08T19:23:23.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.427+0000 7f89fe60f700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f815ce50 con 0x7f89f815a1a0 2023-11-08T19:23:23.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.427+0000 7f89fe60f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89f815d130 con 0x7f89f806c2a0 2023-11-08T19:23:23.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.428+0000 7f89fcbac700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f89f815a1a0 0x7f89f80c96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.428+0000 7f89f77fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f89f806da50 0x7f89f815c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.428+0000 7f89f77fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f89f806da50 0x7f89f815c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37518/0 (socket says 172.21.15.149:37518) 2023-11-08T19:23:23.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.428+0000 7f89f77fe700 1 -- 172.21.15.149:0/3316884918 learned_addr learned my addr 172.21.15.149:0/3316884918 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:23.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.428+0000 7f89f7fff700 1 --2- 172.21.15.149:0/3316884918 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f89f806c2a0 0x7f89f814a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.429+0000 7f89f77fe700 1 -- 172.21.15.149:0/3316884918 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f89f806c2a0 msgr2=0x7f89f814a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.429+0000 7f89f77fe700 1 --2- 172.21.15.149:0/3316884918 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f89f806c2a0 0x7f89f814a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.429+0000 7f89f77fe700 1 -- 172.21.15.149:0/3316884918 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f89f815a1a0 msgr2=0x7f89f80c96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.429+0000 7f89f77fe700 1 --2- 172.21.15.149:0/3316884918 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f89f815a1a0 0x7f89f80c96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.429+0000 7f89f77fe700 1 -- 172.21.15.149:0/3316884918 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89ec00a640 con 0x7f89f806da50 2023-11-08T19:23:23.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.429+0000 7f89f77fe700 1 --2- 172.21.15.149:0/3316884918 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f89f806da50 0x7f89f815c450 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f89ec00e9a0 tx=0x7f89ec00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:23.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.440+0000 7f89f4ff9700 1 -- 172.21.15.149:0/3316884918 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ec00cb50 con 0x7f89f806da50 2023-11-08T19:23:23.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.440+0000 7f89f4ff9700 1 -- 172.21.15.149:0/3316884918 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89ec00ccb0 con 0x7f89f806da50 2023-11-08T19:23:23.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.440+0000 7f89f4ff9700 1 -- 172.21.15.149:0/3316884918 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ec011610 con 0x7f89f806da50 2023-11-08T19:23:23.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.440+0000 7f89fe60f700 1 -- 172.21.15.149:0/3316884918 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89f0009a70 con 0x7f89f806da50 2023-11-08T19:23:23.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.440+0000 7f89fe60f700 1 -- 172.21.15.149:0/3316884918 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89f815d6f0 con 0x7f89f806da50 2023-11-08T19:23:23.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.443+0000 7f89f4ff9700 1 -- 172.21.15.149:0/3316884918 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f89ec011770 con 0x7f89f806da50 2023-11-08T19:23:23.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.444+0000 7f89f4ff9700 1 --2- 172.21.15.149:0/3316884918 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f89e406afd0 0x7f89e406d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:23.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.444+0000 7f89f4ff9700 1 -- 172.21.15.149:0/3316884918 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f89ec089500 con 0x7f89f806da50 2023-11-08T19:23:23.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.445+0000 7f89f7fff700 1 --2- 172.21.15.149:0/3316884918 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f89e406afd0 0x7f89e406d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:23.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.445+0000 7f89f7fff700 1 --2- 172.21.15.149:0/3316884918 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f89e406afd0 0x7f89e406d490 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f89e8005910 tx=0x7f89e8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:23.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.446+0000 7f89fe60f700 1 -- 172.21.15.149:0/3316884918 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89d80052f0 con 0x7f89f806da50 2023-11-08T19:23:23.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.456+0000 7f89f4ff9700 1 -- 172.21.15.149:0/3316884918 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f89ec054330 con 0x7f89f806da50 2023-11-08T19:23:23.776 INFO:teuthology.orchestra.run.smithi149.stdout:55834574856 2023-11-08T19:23:23.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.771+0000 7f2e5df8a700 1 -- 172.21.15.149:0/869550733 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f2e380055a0 con 0x7f2e580c7cf0 2023-11-08T19:23:23.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.772+0000 7f2e3ffff700 1 -- 172.21.15.149:0/869550733 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2e4c057e80 con 0x7f2e580c7cf0 2023-11-08T19:23:23.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.784+0000 7f2e5df8a700 1 -- 172.21.15.149:0/869550733 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2e4006cad0 msgr2=0x7f2e4006ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.784+0000 7f2e5df8a700 1 --2- 172.21.15.149:0/869550733 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2e4006cad0 0x7f2e4006ef90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2e48000c00 tx=0x7f2e4801d040 comp rx=0 tx=0).stop 2023-11-08T19:23:23.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.784+0000 7f2e5df8a700 1 -- 172.21.15.149:0/869550733 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2e580c7cf0 msgr2=0x7f2e5814fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.784+0000 7f2e5df8a700 1 --2- 172.21.15.149:0/869550733 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2e580c7cf0 0x7f2e5814fe40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2e5806f060 tx=0x7f2e4c00d830 comp rx=0 tx=0).stop 2023-11-08T19:23:23.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.784+0000 7f2e5df8a700 1 -- 172.21.15.149:0/869550733 shutdown_connections 2023-11-08T19:23:23.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.784+0000 7f2e5df8a700 1 --2- 172.21.15.149:0/869550733 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2e4006cad0 0x7f2e4006ef90 secure :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2e48000c00 tx=0x7f2e4801d040 comp rx=0 tx=0).stop 2023-11-08T19:23:23.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.784+0000 7f2e5df8a700 1 --2- 172.21.15.149:0/869550733 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2e58146f90 0x7f2e5814f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.784+0000 7f2e5df8a700 1 --2- 172.21.15.149:0/869550733 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e58147370 0x7f2e5814e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.784+0000 7f2e5df8a700 1 --2- 172.21.15.149:0/869550733 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2e580c7cf0 0x7f2e5814fe40 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.784+0000 7f2e5df8a700 1 -- 172.21.15.149:0/869550733 >> 172.21.15.149:0/869550733 conn(0x7f2e5806b3d0 msgr2=0x7f2e58073720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:23.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.786+0000 7f2e5df8a700 1 -- 172.21.15.149:0/869550733 shutdown_connections 2023-11-08T19:23:23.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.786+0000 7f2e5df8a700 1 -- 172.21.15.149:0/869550733 wait complete. 2023-11-08T19:23:23.793 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.792+0000 7fd710e56700 1 -- 172.21.15.149:0/1644577142 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd70c0c64a0 con 0x7fd70c0ce030 2023-11-08T19:23:23.794 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.793+0000 7fd6faffd700 1 -- 172.21.15.149:0/1644577142 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd70c0c64a0 con 0x7fd70c0ce030 2023-11-08T19:23:23.794 INFO:teuthology.orchestra.run.smithi149.stdout:55834574856 2023-11-08T19:23:23.795 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.794+0000 7fe10f09f700 1 -- 172.21.15.149:0/3489126285 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe1080745f0 con 0x7fe10817d620 2023-11-08T19:23:23.796 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.795+0000 7fe1057fa700 1 -- 172.21.15.149:0/3489126285 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe0f8057fb0 con 0x7fe10817d620 2023-11-08T19:23:23.796 INFO:teuthology.orchestra.run.smithi149.stdout:55834574856 2023-11-08T19:23:23.798 INFO:teuthology.orchestra.run.smithi149.stdout:55834574857 2023-11-08T19:23:23.800 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.799+0000 7fd710e56700 1 -- 172.21.15.149:0/1644577142 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd6ec06af00 msgr2=0x7fd6ec06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.800 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.799+0000 7fd710e56700 1 --2- 172.21.15.149:0/1644577142 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd6ec06af00 0x7fd6ec06d3c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc0097c0 tx=0x7fd6fc008030 comp rx=0 tx=0).stop 2023-11-08T19:23:23.800 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.799+0000 7fd710e56700 1 -- 172.21.15.149:0/1644577142 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd70c0ce030 msgr2=0x7fd70c0c8840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.800 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.799+0000 7fd710e56700 1 --2- 172.21.15.149:0/1644577142 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd70c0ce030 0x7fd70c0c8840 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd70400ca20 tx=0x7fd70400cd30 comp rx=0 tx=0).stop 2023-11-08T19:23:23.801 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.799+0000 7fe10f09f700 1 -- 172.21.15.149:0/3489126285 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe0f406af50 msgr2=0x7fe0f406d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.801 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.799+0000 7fe10f09f700 1 --2- 172.21.15.149:0/3489126285 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe0f406af50 0x7fe0f406d410 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe100000f80 tx=0x7fe100007000 comp rx=0 tx=0).stop 2023-11-08T19:23:23.802 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.799+0000 7fe10f09f700 1 -- 172.21.15.149:0/3489126285 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe10817d620 msgr2=0x7fe10817dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.802 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.799+0000 7fe10f09f700 1 --2- 172.21.15.149:0/3489126285 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe10817d620 0x7fe10817dab0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe0f0005830 tx=0x7fe0f8011b40 comp rx=0 tx=0).stop 2023-11-08T19:23:23.802 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.799+0000 7fe10f09f700 1 -- 172.21.15.149:0/3489126285 shutdown_connections 2023-11-08T19:23:23.802 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.799+0000 7fe10f09f700 1 --2- 172.21.15.149:0/3489126285 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe0f406af50 0x7fe0f406d410 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.803 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.799+0000 7fe10f09f700 1 --2- 172.21.15.149:0/3489126285 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe10817d620 0x7fe10817dab0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.803 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.799+0000 7fe10f09f700 1 --2- 172.21.15.149:0/3489126285 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe0f0004bf0 0x7fe1080c56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.803 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.799+0000 7fe10f09f700 1 --2- 172.21.15.149:0/3489126285 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe108071230 0x7fe1080716b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.803 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.799+0000 7fe10f09f700 1 -- 172.21.15.149:0/3489126285 >> 172.21.15.149:0/3489126285 conn(0x7fe1080cbee0 msgr2=0x7fe10806cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:23.803 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.799+0000 7fd710e56700 1 -- 172.21.15.149:0/1644577142 shutdown_connections 2023-11-08T19:23:23.804 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.799+0000 7fd710e56700 1 --2- 172.21.15.149:0/1644577142 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd6ec06af00 0x7fd6ec06d3c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.804 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.799+0000 7fd710e56700 1 --2- 172.21.15.149:0/1644577142 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd70c0ce030 0x7fd70c0c8840 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.804 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.799+0000 7fd710e56700 1 --2- 172.21.15.149:0/1644577142 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd70c0c9cc0 0x7fd70c14ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.804 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.799+0000 7fd710e56700 1 --2- 172.21.15.149:0/1644577142 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd70c0cc9d0 0x7fd70c0b3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.804 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.799+0000 7fd710e56700 1 -- 172.21.15.149:0/1644577142 >> 172.21.15.149:0/1644577142 conn(0x7fd70c0cbee0 msgr2=0x7fd70c14c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:23.805 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.799+0000 7fe10f09f700 1 -- 172.21.15.149:0/3489126285 shutdown_connections 2023-11-08T19:23:23.805 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.799+0000 7fe10f09f700 1 -- 172.21.15.149:0/3489126285 wait complete. 2023-11-08T19:23:23.806 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.800+0000 7fd710e56700 1 -- 172.21.15.149:0/1644577142 shutdown_connections 2023-11-08T19:23:23.806 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.800+0000 7fd710e56700 1 -- 172.21.15.149:0/1644577142 wait complete. 2023-11-08T19:23:23.806 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.794+0000 7f4c18f47700 1 -- 172.21.15.149:0/3986119024 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f4c140c4850 con 0x7f4c1406bb90 2023-11-08T19:23:23.807 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.797+0000 7f4c02ffd700 1 -- 172.21.15.149:0/3986119024 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4c140c4850 con 0x7f4c1406bb90 2023-11-08T19:23:23.807 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.800+0000 7f4c18f47700 1 -- 172.21.15.149:0/3986119024 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4bf406afd0 msgr2=0x7f4bf406d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.807 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.800+0000 7f4c18f47700 1 --2- 172.21.15.149:0/3986119024 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4bf406afd0 0x7f4bf406d490 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4c04007fd0 tx=0x7f4c04009040 comp rx=0 tx=0).stop 2023-11-08T19:23:23.807 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.800+0000 7f4c18f47700 1 -- 172.21.15.149:0/3986119024 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4c1406bb90 msgr2=0x7f4c14160330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.807 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.800+0000 7f4c18f47700 1 --2- 172.21.15.149:0/3986119024 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4c1406bb90 0x7f4c14160330 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4c0800b410 tx=0x7f4c0800b720 comp rx=0 tx=0).stop 2023-11-08T19:23:23.808 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.806+0000 7f4c18f47700 1 -- 172.21.15.149:0/3986119024 shutdown_connections 2023-11-08T19:23:23.808 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.806+0000 7f4c18f47700 1 --2- 172.21.15.149:0/3986119024 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4bf406afd0 0x7f4bf406d490 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.808 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.806+0000 7f4c18f47700 1 --2- 172.21.15.149:0/3986119024 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4c1406bb90 0x7f4c14160330 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.809 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.806+0000 7f4c18f47700 1 --2- 172.21.15.149:0/3986119024 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4c14165780 0x7f4c140b4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.809 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.806+0000 7f4c18f47700 1 --2- 172.21.15.149:0/3986119024 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4c14072240 0x7f4c140b4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.809 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.806+0000 7f4c18f47700 1 -- 172.21.15.149:0/3986119024 >> 172.21.15.149:0/3986119024 conn(0x7f4c14071720 msgr2=0x7f4c14161330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:23.810 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.4 2023-11-08T19:23:23.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.807+0000 7f4c18f47700 1 -- 172.21.15.149:0/3986119024 shutdown_connections 2023-11-08T19:23:23.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.807+0000 7f4c18f47700 1 -- 172.21.15.149:0/3986119024 wait complete. 2023-11-08T19:23:23.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.807+0000 7f18746d5700 1 -- 172.21.15.149:0/1678690800 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f18540055a0 con 0x7f186c159bc0 2023-11-08T19:23:23.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.808+0000 7f1862ffd700 1 -- 172.21.15.149:0/1678690800 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f185c057c20 con 0x7f186c159bc0 2023-11-08T19:23:23.812 INFO:teuthology.orchestra.run.smithi149.stdout:55834574856 2023-11-08T19:23:23.812 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.810+0000 7f30ec287700 1 -- 172.21.15.149:0/1511303844 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f30e40745f0 con 0x7f30e40c2a70 2023-11-08T19:23:23.813 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.811+0000 7f30daffd700 1 -- 172.21.15.149:0/1511303844 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f30e00575c0 con 0x7f30e40c2a70 2023-11-08T19:23:23.813 INFO:teuthology.orchestra.run.smithi149.stdout:55834574856 2023-11-08T19:23:23.813 INFO:teuthology.orchestra.run.smithi149.stdout:55834574856 2023-11-08T19:23:23.814 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.811+0000 7f422cfec700 1 -- 172.21.15.149:0/1583931097 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f420c005870 con 0x7f42280ce570 2023-11-08T19:23:23.815 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.811+0000 7f4216ffd700 1 -- 172.21.15.149:0/1583931097 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4218027090 con 0x7f42280ce570 2023-11-08T19:23:23.815 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.814+0000 7f30ec287700 1 -- 172.21.15.149:0/1511303844 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f30c806af00 msgr2=0x7f30c806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.814+0000 7f30ec287700 1 --2- 172.21.15.149:0/1511303844 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f30c806af00 0x7f30c806d3c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f30e40b0ba0 tx=0x7f30dc009000 comp rx=0 tx=0).stop 2023-11-08T19:23:23.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.814+0000 7f30ec287700 1 -- 172.21.15.149:0/1511303844 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f30e40c2a70 msgr2=0x7f30e40c89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.814+0000 7f30ec287700 1 --2- 172.21.15.149:0/1511303844 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f30e40c2a70 0x7f30e40c89f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f30e000c3f0 tx=0x7f30e000c700 comp rx=0 tx=0).stop 2023-11-08T19:23:23.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.814+0000 7f30ec287700 1 -- 172.21.15.149:0/1511303844 shutdown_connections 2023-11-08T19:23:23.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.814+0000 7f30ec287700 1 --2- 172.21.15.149:0/1511303844 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f30c806af00 0x7f30c806d3c0 secure :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f30e40b0ba0 tx=0x7f30dc009000 comp rx=0 tx=0).stop 2023-11-08T19:23:23.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.814+0000 7f30ec287700 1 --2- 172.21.15.149:0/1511303844 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f30e4072900 0x7f30e415fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.814+0000 7f30ec287700 1 --2- 172.21.15.149:0/1511303844 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f30e40c2a70 0x7f30e40c89f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.814+0000 7f30ec287700 1 --2- 172.21.15.149:0/1511303844 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30e40b0ee0 0x7f30e40c84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.814+0000 7f30ec287700 1 -- 172.21.15.149:0/1511303844 >> 172.21.15.149:0/1511303844 conn(0x7f30e406b3d0 msgr2=0x7f30e4161a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:23.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.815+0000 7f30ec287700 1 -- 172.21.15.149:0/1511303844 shutdown_connections 2023-11-08T19:23:23.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.816+0000 7f30ec287700 1 -- 172.21.15.149:0/1511303844 wait complete. 2023-11-08T19:23:23.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.816+0000 7f422cfec700 1 -- 172.21.15.149:0/1583931097 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f421006b0b0 msgr2=0x7f421006d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.816+0000 7f422cfec700 1 --2- 172.21.15.149:0/1583931097 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f421006b0b0 0x7f421006d570 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f42200012e0 tx=0x7f4220006320 comp rx=0 tx=0).stop 2023-11-08T19:23:23.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.816+0000 7f422cfec700 1 -- 172.21.15.149:0/1583931097 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f42280ce570 msgr2=0x7f4228158d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.816+0000 7f422cfec700 1 --2- 172.21.15.149:0/1583931097 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f42280ce570 0x7f4228158d00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4218004000 tx=0x7f4218004750 comp rx=0 tx=0).stop 2023-11-08T19:23:23.820 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.816+0000 7f18746d5700 1 -- 172.21.15.149:0/1678690800 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f185006afd0 msgr2=0x7f185006d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.820 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.816+0000 7f18746d5700 1 --2- 172.21.15.149:0/1678690800 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f185006afd0 0x7f185006d490 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f186c0b3290 tx=0x7f186400b040 comp rx=0 tx=0).stop 2023-11-08T19:23:23.820 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.816+0000 7f18746d5700 1 -- 172.21.15.149:0/1678690800 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f186c159bc0 msgr2=0x7f186c0c91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.820 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.816+0000 7f18746d5700 1 --2- 172.21.15.149:0/1678690800 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f186c159bc0 0x7f186c0c91d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f185c00b550 tx=0x7f185c00b860 comp rx=0 tx=0).stop 2023-11-08T19:23:23.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.817+0000 7f422cfec700 1 -- 172.21.15.149:0/1583931097 shutdown_connections 2023-11-08T19:23:23.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.817+0000 7f422cfec700 1 --2- 172.21.15.149:0/1583931097 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f421006b0b0 0x7f421006d570 secure :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f42200012e0 tx=0x7f4220006320 comp rx=0 tx=0).stop 2023-11-08T19:23:23.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.817+0000 7f422cfec700 1 --2- 172.21.15.149:0/1583931097 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f42280c9cc0 0x7f4228200350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.817+0000 7f422cfec700 1 --2- 172.21.15.149:0/1583931097 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4228159bc0 0x7f42280ad710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.817+0000 7f422cfec700 1 --2- 172.21.15.149:0/1583931097 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f42280ce570 0x7f4228158d00 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.817+0000 7f422cfec700 1 -- 172.21.15.149:0/1583931097 >> 172.21.15.149:0/1583931097 conn(0x7f42280cbee0 msgr2=0x7f42280b03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:23.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.818+0000 7f18746d5700 1 -- 172.21.15.149:0/1678690800 shutdown_connections 2023-11-08T19:23:23.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.818+0000 7f18746d5700 1 --2- 172.21.15.149:0/1678690800 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f185006afd0 0x7f185006d490 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.818+0000 7f18746d5700 1 --2- 172.21.15.149:0/1678690800 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f186c0c9cc0 0x7f186c1ef330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.818+0000 7f18746d5700 1 --2- 172.21.15.149:0/1678690800 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f186c159bc0 0x7f186c0c91d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.818+0000 7f18746d5700 1 --2- 172.21.15.149:0/1678690800 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f186c0ce570 0x7f186c1f3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.818+0000 7f18746d5700 1 -- 172.21.15.149:0/1678690800 >> 172.21.15.149:0/1678690800 conn(0x7f186c0cbee0 msgr2=0x7f186c0712c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:23.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.820+0000 7f18746d5700 1 -- 172.21.15.149:0/1678690800 shutdown_connections 2023-11-08T19:23:23.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.820+0000 7f18746d5700 1 -- 172.21.15.149:0/1678690800 wait complete. 2023-11-08T19:23:23.829 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.3 2023-11-08T19:23:23.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.828+0000 7f422cfec700 1 -- 172.21.15.149:0/1583931097 shutdown_connections 2023-11-08T19:23:23.830 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.2 2023-11-08T19:23:23.832 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.6 2023-11-08T19:23:23.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.832+0000 7f422cfec700 1 -- 172.21.15.149:0/1583931097 wait complete. 2023-11-08T19:23:23.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.836+0000 7f89fe60f700 1 -- 172.21.15.149:0/3316884918 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f89d80055a0 con 0x7f89f806da50 2023-11-08T19:23:23.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.837+0000 7f89f4ff9700 1 -- 172.21.15.149:0/3316884918 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f89ec016020 con 0x7f89f806da50 2023-11-08T19:23:23.838 INFO:teuthology.orchestra.run.smithi149.stdout:55834574856 2023-11-08T19:23:23.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.839+0000 7f89fe60f700 1 -- 172.21.15.149:0/3316884918 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f89e406afd0 msgr2=0x7f89e406d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.839+0000 7f89fe60f700 1 --2- 172.21.15.149:0/3316884918 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f89e406afd0 0x7f89e406d490 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f89e8005910 tx=0x7f89e8009040 comp rx=0 tx=0).stop 2023-11-08T19:23:23.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.839+0000 7f89fe60f700 1 -- 172.21.15.149:0/3316884918 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f89f806da50 msgr2=0x7f89f815c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:23.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.839+0000 7f89fe60f700 1 --2- 172.21.15.149:0/3316884918 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f89f806da50 0x7f89f815c450 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f89ec00e9a0 tx=0x7f89ec00ecb0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.842 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.840+0000 7f89fe60f700 1 -- 172.21.15.149:0/3316884918 shutdown_connections 2023-11-08T19:23:23.842 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.840+0000 7f89fe60f700 1 --2- 172.21.15.149:0/3316884918 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f89e406afd0 0x7f89e406d490 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.842 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.840+0000 7f89fe60f700 1 --2- 172.21.15.149:0/3316884918 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f89f815a1a0 0x7f89f80c96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.842 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.840+0000 7f89fe60f700 1 --2- 172.21.15.149:0/3316884918 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f89f806c2a0 0x7f89f814a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.842 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.840+0000 7f89fe60f700 1 --2- 172.21.15.149:0/3316884918 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f89f806da50 0x7f89f815c450 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:23.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.840+0000 7f89fe60f700 1 -- 172.21.15.149:0/3316884918 >> 172.21.15.149:0/3316884918 conn(0x7f89f8071720 msgr2=0x7f89f80b3430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:23.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.840+0000 7f89fe60f700 1 -- 172.21.15.149:0/3316884918 shutdown_connections 2023-11-08T19:23:23.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:23.840+0000 7f89fe60f700 1 -- 172.21.15.149:0/3316884918 wait complete. 2023-11-08T19:23:23.844 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.1 2023-11-08T19:23:23.845 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.5 2023-11-08T19:23:23.850 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.0 2023-11-08T19:23:23.855 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.7 2023-11-08T19:23:24.811 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-08T19:23:24.830 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-08T19:23:24.831 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-08T19:23:24.832 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-08T19:23:24.845 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-08T19:23:24.845 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-08T19:23:24.851 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-08T19:23:24.857 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-08T19:23:25.018 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.016+0000 7f193157a700 1 Processor -- start 2023-11-08T19:23:25.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.016+0000 7f193157a700 1 -- start start 2023-11-08T19:23:25.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.018+0000 7f193157a700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f192c159bc0 0x7f192c15d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:25.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.018+0000 7f193157a700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f192c0c9cc0 0x7f192c0ce030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:25.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.018+0000 7f193157a700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f192c15e530 con 0x7f192c0ce570 2023-11-08T19:23:25.020 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.018+0000 7f193157a700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f192c159fa0 con 0x7f192c159bc0 2023-11-08T19:23:25.020 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.018+0000 7f193157a700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f192c15df70 con 0x7f192c0c9cc0 2023-11-08T19:23:25.020 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.019+0000 7f192b7fe700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f192c0ce570 0x7f192c0ca430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.149:51192/0 (socket says 172.21.15.149:51192) 2023-11-08T19:23:25.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.019+0000 7f192b7fe700 1 -- 172.21.15.149:0/2675467318 learned_addr learned my addr 172.21.15.149:0/2675467318 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:23:25.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.019+0000 7f192a7fc700 1 --2- 172.21.15.149:0/2675467318 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f192c0c9cc0 0x7f192c0ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:25.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.019+0000 7f192affd700 1 --2- 172.21.15.149:0/2675467318 >> v2:172.21.15.160:3300/0 conn(0x7f192c159bc0 0x7f192c15d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:25.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.019+0000 7f192affd700 1 -- 172.21.15.149:0/2675467318 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f192c0c9cc0 msgr2=0x7f192c0ce030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:25.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.019+0000 7f192affd700 1 --2- 172.21.15.149:0/2675467318 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f192c0c9cc0 0x7f192c0ce030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.019+0000 7f192affd700 1 -- 172.21.15.149:0/2675467318 >> v1:172.21.15.160:6789/0 conn(0x7f192c0ce570 legacy=0x7f192c0ca430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:25.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.019+0000 7f192affd700 1 -- 172.21.15.149:0/2675467318 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f192c15e250 con 0x7f192c159bc0 2023-11-08T19:23:25.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.020+0000 7f192affd700 1 --2- 172.21.15.149:0/2675467318 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f192c159bc0 0x7f192c15d600 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1920009870 tx=0x7f1920009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f479c4b4faf8ab7 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:25.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.020+0000 7f1929ffb700 1 -- 172.21.15.149:0/2675467318 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1920011830 con 0x7f192c159bc0 2023-11-08T19:23:25.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.020+0000 7f1929ffb700 1 -- 172.21.15.149:0/2675467318 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1920011990 con 0x7f192c159bc0 2023-11-08T19:23:25.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.020+0000 7f1929ffb700 1 -- 172.21.15.149:0/2675467318 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1920011d20 con 0x7f192c159bc0 2023-11-08T19:23:25.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.021+0000 7f193157a700 1 -- 172.21.15.149:0/2675467318 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f192c159bc0 msgr2=0x7f192c15d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:25.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.021+0000 7f193157a700 1 --2- 172.21.15.149:0/2675467318 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f192c159bc0 0x7f192c15d600 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1920009870 tx=0x7f1920009b80 comp rx=0 tx=0).stop 2023-11-08T19:23:25.025 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.022+0000 7f193157a700 1 -- 172.21.15.149:0/2675467318 shutdown_connections 2023-11-08T19:23:25.025 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.022+0000 7f193157a700 1 --2- 172.21.15.149:0/2675467318 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f192c159bc0 0x7f192c15d600 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.025 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.022+0000 7f193157a700 1 --2- 172.21.15.149:0/2675467318 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f192c0c9cc0 0x7f192c0ce030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.025 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.022+0000 7f193157a700 1 -- 172.21.15.149:0/2675467318 >> 172.21.15.149:0/2675467318 conn(0x7f192c0cbee0 msgr2=0x7f192c0cc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:25.025 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.022+0000 7f193157a700 1 -- 172.21.15.149:0/2675467318 shutdown_connections 2023-11-08T19:23:25.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.022+0000 7f193157a700 1 -- 172.21.15.149:0/2675467318 wait complete. 2023-11-08T19:23:25.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.024+0000 7f193157a700 1 Processor -- start 2023-11-08T19:23:25.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.024+0000 7f193157a700 1 -- start start 2023-11-08T19:23:25.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.025+0000 7f193157a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f192c0c9cc0 0x7f192c15b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:25.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.025+0000 7f193157a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f192c0ce570 0x7f192c1f75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:25.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.025+0000 7f193157a700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f192c159bc0 0x7f192c0c9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:25.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.025+0000 7f193157a700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f192c15be10 con 0x7f192c0ce570 2023-11-08T19:23:25.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.025+0000 7f193157a700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f192c15b440 con 0x7f192c0c9cc0 2023-11-08T19:23:25.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.025+0000 7f193157a700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f192c1f7ae0 con 0x7f192c159bc0 2023-11-08T19:23:25.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.026+0000 7f192a7fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f192c0ce570 0x7f192c1f75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:25.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.026+0000 7f192a7fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f192c0ce570 0x7f192c1f75a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37532/0 (socket says 172.21.15.149:37532) 2023-11-08T19:23:25.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.026+0000 7f192a7fc700 1 -- 172.21.15.149:0/3854365599 learned_addr learned my addr 172.21.15.149:0/3854365599 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:25.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.026+0000 7f192b7fe700 1 --2- 172.21.15.149:0/3854365599 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f192c159bc0 0x7f192c0c9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:25.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.026+0000 7f192a7fc700 1 -- 172.21.15.149:0/3854365599 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f192c159bc0 msgr2=0x7f192c0c9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:25.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.026+0000 7f192a7fc700 1 --2- 172.21.15.149:0/3854365599 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f192c159bc0 0x7f192c0c9060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.026+0000 7f192a7fc700 1 -- 172.21.15.149:0/3854365599 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f192c0c9cc0 msgr2=0x7f192c15b8d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-08T19:23:25.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.026+0000 7f192a7fc700 1 --2- 172.21.15.149:0/3854365599 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f192c0c9cc0 0x7f192c15b8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.026+0000 7f192a7fc700 1 -- 172.21.15.149:0/3854365599 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19200094a0 con 0x7f192c0ce570 2023-11-08T19:23:25.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.027+0000 7f192a7fc700 1 --2- 172.21.15.149:0/3854365599 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f192c0ce570 0x7f192c1f75a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f191c00e9b0 tx=0x7f191c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:25.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.034+0000 7f19137fe700 1 -- 172.21.15.149:0/3854365599 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191c009710 con 0x7f192c0ce570 2023-11-08T19:23:25.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.034+0000 7f19137fe700 1 -- 172.21.15.149:0/3854365599 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f191c00c7f0 con 0x7f192c0ce570 2023-11-08T19:23:25.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.034+0000 7f19137fe700 1 -- 172.21.15.149:0/3854365599 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191c00cb80 con 0x7f192c0ce570 2023-11-08T19:23:25.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.034+0000 7f193157a700 1 -- 172.21.15.149:0/3854365599 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f192c15a830 con 0x7f192c0ce570 2023-11-08T19:23:25.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.035+0000 7f193157a700 1 -- 172.21.15.149:0/3854365599 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f192c15adf0 con 0x7f192c0ce570 2023-11-08T19:23:25.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.037+0000 7f19137fe700 1 -- 172.21.15.149:0/3854365599 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f191c00cce0 con 0x7f192c0ce570 2023-11-08T19:23:25.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.038+0000 7f19137fe700 1 --2- 172.21.15.149:0/3854365599 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f191806af50 0x7f191806d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:25.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.038+0000 7f19137fe700 1 -- 172.21.15.149:0/3854365599 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f191c089d40 con 0x7f192c0ce570 2023-11-08T19:23:25.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.039+0000 7f192affd700 1 --2- 172.21.15.149:0/3854365599 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f191806af50 0x7f191806d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:25.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.039+0000 7f192affd700 1 --2- 172.21.15.149:0/3854365599 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f191806af50 0x7f191806d410 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f19200090b0 tx=0x7f1920008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:25.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.041+0000 7f193157a700 1 -- 172.21.15.149:0/3854365599 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f190c0052f0 con 0x7f192c0ce570 2023-11-08T19:23:25.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.059+0000 7f19137fe700 1 -- 172.21.15.149:0/3854365599 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f191c017080 con 0x7f192c0ce570 2023-11-08T19:23:25.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.063+0000 7f355db63700 1 Processor -- start 2023-11-08T19:23:25.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.063+0000 7f355db63700 1 -- start start 2023-11-08T19:23:25.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.064+0000 7f355db63700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f355806b290 0x7f35580cfa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:25.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.064+0000 7f355db63700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f355806bae0 con 0x7f35580c3ac0 2023-11-08T19:23:25.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.064+0000 7f355db63700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35580d0410 con 0x7f35581620c0 2023-11-08T19:23:25.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.064+0000 7f355db63700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35580d0130 con 0x7f355806b290 2023-11-08T19:23:25.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.064+0000 7f3557fff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f35580c3ac0 0x7f35580b0770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:39540/0 (socket says 172.21.15.149:39540) 2023-11-08T19:23:25.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.064+0000 7f3557fff700 1 -- 172.21.15.149:0/3031404527 learned_addr learned my addr 172.21.15.149:0/3031404527 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:23:25.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.064+0000 7f3556ffd700 1 --2- 172.21.15.149:0/3031404527 >> v2:172.21.15.149:3300/0 conn(0x7f355806b290 0x7f35580cfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:25.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.064+0000 7f3556ffd700 1 -- 172.21.15.149:0/3031404527 >> v1:172.21.15.160:6789/0 conn(0x7f35581620c0 legacy=0x7f355806ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:25.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.064+0000 7f3556ffd700 1 -- 172.21.15.149:0/3031404527 >> v1:172.21.15.149:6789/0 conn(0x7f35580c3ac0 legacy=0x7f35580b0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:25.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.065+0000 7f3556ffd700 1 -- 172.21.15.149:0/3031404527 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35580afc90 con 0x7f355806b290 2023-11-08T19:23:25.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.065+0000 7f3556ffd700 1 --2- 172.21.15.149:0/3031404527 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f355806b290 0x7f35580cfa40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3548009840 tx=0x7f3548009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67b476e2d301f797 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:25.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.068+0000 7f35567fc700 1 -- 172.21.15.149:0/3031404527 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3548004230 con 0x7f355806b290 2023-11-08T19:23:25.070 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.069+0000 7f35567fc700 1 -- 172.21.15.149:0/3031404527 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3548004390 con 0x7f355806b290 2023-11-08T19:23:25.070 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.069+0000 7f35567fc700 1 -- 172.21.15.149:0/3031404527 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35480036a0 con 0x7f355806b290 2023-11-08T19:23:25.070 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.070+0000 7f355db63700 1 -- 172.21.15.149:0/3031404527 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f355806b290 msgr2=0x7f35580cfa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:25.071 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.070+0000 7f355db63700 1 --2- 172.21.15.149:0/3031404527 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f355806b290 0x7f35580cfa40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3548009840 tx=0x7f3548009b50 comp rx=0 tx=0).stop 2023-11-08T19:23:25.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.072+0000 7efe08cbe700 1 Processor -- start 2023-11-08T19:23:25.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.072+0000 7efe08cbe700 1 -- start start 2023-11-08T19:23:25.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.072+0000 7fde1dbf0700 1 Processor -- start 2023-11-08T19:23:25.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.072+0000 7fde1dbf0700 1 -- start start 2023-11-08T19:23:25.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.073+0000 7fde1dbf0700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fde1806c2a0 0x7fde1806e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:25.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.073+0000 7fde1dbf0700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde180cb220 con 0x7fde1806da50 2023-11-08T19:23:25.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.073+0000 7fde1dbf0700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde180cb500 con 0x7fde1815a1a0 2023-11-08T19:23:25.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.073+0000 7fde1dbf0700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde1815a580 con 0x7fde1806c2a0 2023-11-08T19:23:25.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.073+0000 7efe08cbe700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efe040cc140 0x7efe040cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:25.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.073+0000 7efe08cbe700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7efe040b2cd0 0x7efe0415d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:25.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.073+0000 7efe08cbe700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe040cce50 con 0x7efe040b2850 2023-11-08T19:23:25.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.073+0000 7efe08cbe700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe040b2430 con 0x7efe040b2cd0 2023-11-08T19:23:25.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.073+0000 7efe08cbe700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe040cc520 con 0x7efe040cc140 2023-11-08T19:23:25.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.073+0000 7efe0259c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efe040cc140 0x7efe040cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:25.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.073+0000 7efe0259c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efe040cc140 0x7efe040cc910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.149:57838/0 (socket says 172.21.15.149:57838) 2023-11-08T19:23:25.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.073+0000 7efe0259c700 1 -- 172.21.15.149:0/2728309850 learned_addr learned my addr 172.21.15.149:0/2728309850 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:25.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.073+0000 7efe02d9d700 1 --2- 172.21.15.149:0/2728309850 >> v2:172.21.15.160:3300/0 conn(0x7efe040b2cd0 0x7efe0415d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:25.078 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.073+0000 7fde16ffd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fde1806c2a0 0x7fde1806e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:25.078 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.073+0000 7fde16ffd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fde1806c2a0 0x7fde1806e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37546/0 (socket says 172.21.15.149:37546) 2023-11-08T19:23:25.078 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.073+0000 7fde16ffd700 1 -- 172.21.15.149:0/1855557586 learned_addr learned my addr 172.21.15.149:0/1855557586 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:25.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.074+0000 7efe0259c700 1 -- 172.21.15.149:0/2728309850 >> v2:172.21.15.160:3300/0 conn(0x7efe040b2cd0 msgr2=0x7efe0415d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:25.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.074+0000 7efe0259c700 1 --2- 172.21.15.149:0/2728309850 >> v2:172.21.15.160:3300/0 conn(0x7efe040b2cd0 0x7efe0415d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.074+0000 7efe0259c700 1 -- 172.21.15.149:0/2728309850 >> v1:172.21.15.149:6789/0 conn(0x7efe040b2850 legacy=0x7efe040cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:25.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.074+0000 7efe0159a700 1 -- 172.21.15.149:0/2728309850 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 976679941 0 0) 0x7efe040cce50 con 0x7efe040b2850 2023-11-08T19:23:25.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.074+0000 7fde167fc700 1 -- 172.21.15.149:0/1855557586 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1716171116 0 0) 0x7fde180cb500 con 0x7fde1815a1a0 2023-11-08T19:23:25.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.074+0000 7fde167fc700 1 -- 172.21.15.149:0/1855557586 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde000035b0 con 0x7fde1815a1a0 2023-11-08T19:23:25.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.074+0000 7fde16ffd700 1 -- 172.21.15.149:0/1855557586 >> v1:172.21.15.160:6789/0 conn(0x7fde1815a1a0 legacy=0x7fde1806bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:25.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.074+0000 7fde16ffd700 1 -- 172.21.15.149:0/1855557586 >> v1:172.21.15.149:6789/0 conn(0x7fde1806da50 legacy=0x7fde180cdd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:25.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.074+0000 7fde167fc700 1 -- 172.21.15.149:0/1855557586 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3836012010 0 0) 0x7fde180cb220 con 0x7fde1806da50 2023-11-08T19:23:25.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.074+0000 7fde16ffd700 1 -- 172.21.15.149:0/1855557586 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde180cb7e0 con 0x7fde1806c2a0 2023-11-08T19:23:25.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.074+0000 7efe0259c700 1 -- 172.21.15.149:0/2728309850 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe040b17b0 con 0x7efe040cc140 2023-11-08T19:23:25.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.074+0000 7efe0259c700 1 --2- 172.21.15.149:0/2728309850 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efe040cc140 0x7efe040cc910 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efdf4006fd0 tx=0x7efdf4009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e56805960af11ccf server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:25.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.074+0000 7fde16ffd700 1 --2- 172.21.15.149:0/1855557586 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde1806c2a0 0x7fde1806e940 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fde0c0098f0 tx=0x7fde0c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7687afaab21f0a42 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:25.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.075+0000 7efe0159a700 1 -- 172.21.15.149:0/2728309850 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf4005e30 con 0x7efe040cc140 2023-11-08T19:23:25.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.075+0000 7efe0159a700 1 -- 172.21.15.149:0/2728309850 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf4004030 con 0x7efe040cc140 2023-11-08T19:23:25.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.075+0000 7efe0159a700 1 -- 172.21.15.149:0/2728309850 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf40043e0 con 0x7efe040cc140 2023-11-08T19:23:25.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.075+0000 7fde167fc700 1 -- 172.21.15.149:0/1855557586 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde0c011830 con 0x7fde1806c2a0 2023-11-08T19:23:25.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.075+0000 7fde167fc700 1 -- 172.21.15.149:0/1855557586 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde0c011990 con 0x7fde1806c2a0 2023-11-08T19:23:25.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.075+0000 7fde167fc700 1 -- 172.21.15.149:0/1855557586 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde0c011d00 con 0x7fde1806c2a0 2023-11-08T19:23:25.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.075+0000 7f355db63700 1 -- 172.21.15.149:0/3031404527 shutdown_connections 2023-11-08T19:23:25.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.075+0000 7f355db63700 1 --2- 172.21.15.149:0/3031404527 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f355806b290 0x7f35580cfa40 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.075+0000 7f355db63700 1 -- 172.21.15.149:0/3031404527 >> 172.21.15.149:0/3031404527 conn(0x7f3558099a40 msgr2=0x7f35580d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:25.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.075+0000 7f355db63700 1 -- 172.21.15.149:0/3031404527 shutdown_connections 2023-11-08T19:23:25.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.075+0000 7f355db63700 1 -- 172.21.15.149:0/3031404527 wait complete. 2023-11-08T19:23:25.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.076+0000 7fde1dbf0700 1 -- 172.21.15.149:0/1855557586 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde1806c2a0 msgr2=0x7fde1806e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:25.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.076+0000 7fde1dbf0700 1 --2- 172.21.15.149:0/1855557586 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde1806c2a0 0x7fde1806e940 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fde0c0098f0 tx=0x7fde0c009c00 comp rx=0 tx=0).stop 2023-11-08T19:23:25.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.076+0000 7fde1dbf0700 1 -- 172.21.15.149:0/1855557586 shutdown_connections 2023-11-08T19:23:25.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.076+0000 7fde1dbf0700 1 --2- 172.21.15.149:0/1855557586 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde1806c2a0 0x7fde1806e940 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.076+0000 7fde1dbf0700 1 -- 172.21.15.149:0/1855557586 >> 172.21.15.149:0/1855557586 conn(0x7fde18071720 msgr2=0x7fde18071b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:25.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.076+0000 7fde1dbf0700 1 -- 172.21.15.149:0/1855557586 shutdown_connections 2023-11-08T19:23:25.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.076+0000 7fde1dbf0700 1 -- 172.21.15.149:0/1855557586 wait complete. 2023-11-08T19:23:25.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.076+0000 7f66e314f700 1 Processor -- start 2023-11-08T19:23:25.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.076+0000 7efe08cbe700 1 -- 172.21.15.149:0/2728309850 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efe040cc140 msgr2=0x7efe040cc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:25.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.076+0000 7efe08cbe700 1 --2- 172.21.15.149:0/2728309850 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efe040cc140 0x7efe040cc910 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efdf4006fd0 tx=0x7efdf4009bd0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.076+0000 7f2b6d750700 1 Processor -- start 2023-11-08T19:23:25.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.077+0000 7f355db63700 1 Processor -- start 2023-11-08T19:23:25.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.078+0000 7fde1dbf0700 1 Processor -- start 2023-11-08T19:23:25.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.077+0000 7f2b6d750700 1 -- start start 2023-11-08T19:23:25.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.078+0000 7f2b6d750700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2b60006a00 0x7f2b60006e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:25.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.078+0000 7f2b6d750700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f2b600073c0 0x7f2b600e8df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:25.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.078+0000 7f2b6d750700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b600531b0 con 0x7f2b60006620 2023-11-08T19:23:25.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.078+0000 7f2b6d750700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b6003afd0 con 0x7f2b600073c0 2023-11-08T19:23:25.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.078+0000 7f2b6d750700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b60007850 con 0x7f2b60006a00 2023-11-08T19:23:25.092 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.078+0000 7f2b677fe700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2b60006a00 0x7f2b60006e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:25.092 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.078+0000 7f2b677fe700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2b60006a00 0x7f2b60006e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.149:57850/0 (socket says 172.21.15.149:57850) 2023-11-08T19:23:25.092 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.078+0000 7f2b677fe700 1 -- 172.21.15.149:0/3767470718 learned_addr learned my addr 172.21.15.149:0/3767470718 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:25.093 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.076+0000 7f66e314f700 1 -- start start 2023-11-08T19:23:25.093 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.077+0000 7f66e314f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f66dc162c50 0x7f66dc165a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:25.093 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.077+0000 7f66e314f700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f66dc163030 0x7f66dc06d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:25.093 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.077+0000 7f66e314f700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f66dc09c7e0 0x7f66dc09cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:25.094 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.077+0000 7f66e314f700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66dc09d1b0 con 0x7f66dc163030 2023-11-08T19:23:25.094 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.077+0000 7f66e314f700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66dc06d170 con 0x7f66dc09c7e0 2023-11-08T19:23:25.094 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.077+0000 7f66e314f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66dc1662f0 con 0x7f66dc162c50 2023-11-08T19:23:25.094 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.078+0000 7f66e0eeb700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f66dc162c50 0x7f66dc165a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:25.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.078+0000 7f66dbfff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f66dc163030 0x7f66dc06d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:25.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.078+0000 7f66e0eeb700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f66dc162c50 0x7f66dc165a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.149:57844/0 (socket says 172.21.15.149:57844) 2023-11-08T19:23:25.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.078+0000 7f66e0eeb700 1 -- 172.21.15.149:0/2159419204 learned_addr learned my addr 172.21.15.149:0/2159419204 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:25.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.078+0000 7f2b6cf4f700 1 --2- 172.21.15.149:0/3767470718 >> v2:172.21.15.160:3300/0 conn(0x7f2b600073c0 0x7f2b600e8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:25.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.078+0000 7f66e16ec700 1 --2- 172.21.15.149:0/2159419204 >> v2:172.21.15.160:3300/0 conn(0x7f66dc09c7e0 0x7f66dc09cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:25.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.078+0000 7f66dbfff700 1 -- 172.21.15.149:0/2159419204 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f66dc162c50 msgr2=0x7f66dc165a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:25.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.078+0000 7f66dbfff700 1 --2- 172.21.15.149:0/2159419204 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f66dc162c50 0x7f66dc165a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.078+0000 7f66dbfff700 1 -- 172.21.15.149:0/2159419204 >> v2:172.21.15.160:3300/0 conn(0x7f66dc09c7e0 msgr2=0x7f66dc09cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:25.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.078+0000 7f66dbfff700 1 --2- 172.21.15.149:0/2159419204 >> v2:172.21.15.160:3300/0 conn(0x7f66dc09c7e0 0x7f66dc09cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.078+0000 7f66dbfff700 1 -- 172.21.15.149:0/2159419204 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66dc1665d0 con 0x7f66dc163030 2023-11-08T19:23:25.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.079+0000 7f2b66ffd700 1 -- 172.21.15.149:0/3767470718 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3847418158 0 0) 0x7f2b600531b0 con 0x7f2b60006620 2023-11-08T19:23:25.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.079+0000 7f2b66ffd700 1 -- 172.21.15.149:0/3767470718 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b580035b0 con 0x7f2b60006620 2023-11-08T19:23:25.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.079+0000 7f2b6cf4f700 1 -- 172.21.15.149:0/3767470718 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2b60006a00 msgr2=0x7f2b60006e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:25.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.079+0000 7f2b6cf4f700 1 --2- 172.21.15.149:0/3767470718 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2b60006a00 0x7f2b60006e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.079+0000 7f2b6cf4f700 1 -- 172.21.15.149:0/3767470718 >> v1:172.21.15.160:6789/0 conn(0x7f2b60006620 legacy=0x7f2b6003a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:25.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.079+0000 7f2b6cf4f700 1 -- 172.21.15.149:0/3767470718 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b60007b30 con 0x7f2b600073c0 2023-11-08T19:23:25.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.079+0000 7f66dbfff700 1 --2- 172.21.15.149:0/2159419204 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66dc163030 0x7f66dc06d600 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f66dc0a17d0 tx=0x7f66d4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de6e058898a62940 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:25.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.077+0000 7f355db63700 1 -- start start 2023-11-08T19:23:25.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.079+0000 7f355db63700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f355806b290 0x7f355815e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:25.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.079+0000 7f355db63700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f35580c3ac0 0x7f355815f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:25.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.079+0000 7f355db63700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35581620c0 0x7f355815f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:25.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.079+0000 7f355db63700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35580c5d90 con 0x7f35581620c0 2023-11-08T19:23:25.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.079+0000 7f355db63700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35580c5180 con 0x7f35580c3ac0 2023-11-08T19:23:25.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.079+0000 7f355db63700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35580c5460 con 0x7f355806b290 2023-11-08T19:23:25.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.079+0000 7f3556ffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f35580c3ac0 0x7f355815f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:25.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.079+0000 7f2b6cf4f700 1 --2- 172.21.15.149:0/3767470718 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2b600073c0 0x7f2b600e8df0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2b68000eb0 tx=0x7f2b68062640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32b2f290b9db0838 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:25.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.079+0000 7f3556ffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f35580c3ac0 0x7f355815f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.149:38560/0 (socket says 172.21.15.149:38560) 2023-11-08T19:23:25.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.079+0000 7f3557fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35581620c0 0x7f355815f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:25.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.079+0000 7f3556ffd700 1 -- 172.21.15.149:0/1568160923 learned_addr learned my addr 172.21.15.149:0/1568160923 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:25.103 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.079+0000 7f35577fe700 1 --2- 172.21.15.149:0/1568160923 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f355806b290 0x7f355815e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:25.103 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.078+0000 7fde1dbf0700 1 -- start start 2023-11-08T19:23:25.103 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.079+0000 7fde1dbf0700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde1806c2a0 0x7fde1816a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:25.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.079+0000 7fde1dbf0700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fde1806da50 0x7fde180c5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:25.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.079+0000 7fde1dbf0700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fde1815a1a0 0x7fde180b0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:25.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.079+0000 7fde1dbf0700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde181512a0 con 0x7fde1806c2a0 2023-11-08T19:23:25.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.079+0000 7fde1dbf0700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde1816aa20 con 0x7fde1806da50 2023-11-08T19:23:25.105 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.079+0000 7f2b66ffd700 1 -- 172.21.15.149:0/3767470718 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b68074ef0 con 0x7f2b600073c0 2023-11-08T19:23:25.105 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.079+0000 7f2b66ffd700 1 -- 172.21.15.149:0/3767470718 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b68067bb0 con 0x7f2b600073c0 2023-11-08T19:23:25.105 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.079+0000 7f2b66ffd700 1 -- 172.21.15.149:0/3767470718 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b68075050 con 0x7f2b600073c0 2023-11-08T19:23:25.105 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.079+0000 7fde1dbf0700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde181516c0 con 0x7fde1815a1a0 2023-11-08T19:23:25.106 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.080+0000 7efe08cbe700 1 -- 172.21.15.149:0/2728309850 shutdown_connections 2023-11-08T19:23:25.106 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.080+0000 7efe08cbe700 1 --2- 172.21.15.149:0/2728309850 >> v2:172.21.15.160:3300/0 conn(0x7efe040b2cd0 0x7efe0415d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.106 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.080+0000 7efe08cbe700 1 --2- 172.21.15.149:0/2728309850 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efe040cc140 0x7efe040cc910 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.106 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.080+0000 7efe08cbe700 1 -- 172.21.15.149:0/2728309850 >> 172.21.15.149:0/2728309850 conn(0x7efe04099a40 msgr2=0x7efe040d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:25.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.080+0000 7f3556ffd700 1 -- 172.21.15.149:0/1568160923 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f355806b290 msgr2=0x7f355815e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:25.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.080+0000 7f3556ffd700 1 --2- 172.21.15.149:0/1568160923 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f355806b290 0x7f355815e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.080+0000 7f3556ffd700 1 -- 172.21.15.149:0/1568160923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35581620c0 msgr2=0x7f355815f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:25.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.080+0000 7f3556ffd700 1 --2- 172.21.15.149:0/1568160923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35581620c0 0x7f355815f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.108 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.080+0000 7f3556ffd700 1 -- 172.21.15.149:0/1568160923 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35480094a0 con 0x7f35580c3ac0 2023-11-08T19:23:25.108 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.080+0000 7efe08cbe700 1 -- 172.21.15.149:0/2728309850 shutdown_connections 2023-11-08T19:23:25.108 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.080+0000 7fde16ffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fde1806da50 0x7fde180c5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:25.109 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.080+0000 7fde17fff700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fde1815a1a0 0x7fde180b0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:25.109 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.080+0000 7fde17fff700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fde1815a1a0 0x7fde180b0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.149:57866/0 (socket says 172.21.15.149:57866) 2023-11-08T19:23:25.109 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.080+0000 7fde17fff700 1 -- 172.21.15.149:0/187552949 learned_addr learned my addr 172.21.15.149:0/187552949 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:25.110 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.080+0000 7f3556ffd700 1 --2- 172.21.15.149:0/1568160923 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f35580c3ac0 0x7f355815f460 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3548009f50 tx=0x7f3548004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:25.110 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.080+0000 7efe08cbe700 1 -- 172.21.15.149:0/2728309850 wait complete. 2023-11-08T19:23:25.110 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.082+0000 7efe08cbe700 1 Processor -- start 2023-11-08T19:23:25.111 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.079+0000 7f66db7fe700 1 -- 172.21.15.149:0/2159419204 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d4033640 con 0x7f66dc163030 2023-11-08T19:23:25.111 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.079+0000 7f66db7fe700 1 -- 172.21.15.149:0/2159419204 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d40337a0 con 0x7f66dc163030 2023-11-08T19:23:25.111 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.079+0000 7f66db7fe700 1 -- 172.21.15.149:0/2159419204 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d4033b30 con 0x7f66dc163030 2023-11-08T19:23:25.111 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.080+0000 7f66e314f700 1 -- 172.21.15.149:0/2159419204 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66dc163030 msgr2=0x7f66dc06d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:25.111 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.080+0000 7f66e314f700 1 --2- 172.21.15.149:0/2159419204 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66dc163030 0x7f66dc06d600 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f66dc0a17d0 tx=0x7f66d4009b20 comp rx=0 tx=0).stop 2023-11-08T19:23:25.112 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.081+0000 7f66e314f700 1 -- 172.21.15.149:0/2159419204 shutdown_connections 2023-11-08T19:23:25.112 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.081+0000 7f66e314f700 1 --2- 172.21.15.149:0/2159419204 >> v2:172.21.15.160:3300/0 conn(0x7f66dc09c7e0 0x7f66dc09cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.112 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.081+0000 7f66e314f700 1 --2- 172.21.15.149:0/2159419204 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f66dc162c50 0x7f66dc165a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.112 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.081+0000 7f66e314f700 1 --2- 172.21.15.149:0/2159419204 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66dc163030 0x7f66dc06d600 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.112 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.081+0000 7f66e314f700 1 -- 172.21.15.149:0/2159419204 >> 172.21.15.149:0/2159419204 conn(0x7f66dc0b5470 msgr2=0x7f66dc0b5880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:25.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.081+0000 7f66e314f700 1 -- 172.21.15.149:0/2159419204 shutdown_connections 2023-11-08T19:23:25.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.081+0000 7f66e314f700 1 -- 172.21.15.149:0/2159419204 wait complete. 2023-11-08T19:23:25.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.083+0000 7f66e314f700 1 Processor -- start 2023-11-08T19:23:25.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.083+0000 7f66e314f700 1 -- start start 2023-11-08T19:23:25.114 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.080+0000 7fde177fe700 1 --2- 172.21.15.149:0/187552949 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde1806c2a0 0x7fde1816a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:25.114 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.081+0000 7fde177fe700 1 -- 172.21.15.149:0/187552949 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fde1815a1a0 msgr2=0x7fde180b0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:25.114 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.081+0000 7fde177fe700 1 --2- 172.21.15.149:0/187552949 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fde1815a1a0 0x7fde180b0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.115 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.081+0000 7fde177fe700 1 -- 172.21.15.149:0/187552949 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fde1806da50 msgr2=0x7fde180c5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:25.115 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.081+0000 7fde177fe700 1 --2- 172.21.15.149:0/187552949 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fde1806da50 0x7fde180c5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.115 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.081+0000 7fde177fe700 1 -- 172.21.15.149:0/187552949 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde0c009550 con 0x7fde1806c2a0 2023-11-08T19:23:25.115 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.081+0000 7fde177fe700 1 --2- 172.21.15.149:0/187552949 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde1806c2a0 0x7fde1816a4e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fde0800c3c0 tx=0x7fde08001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:25.115 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.081+0000 7fddfffff700 1 -- 172.21.15.149:0/187552949 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde080052d0 con 0x7fde1806c2a0 2023-11-08T19:23:25.116 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.081+0000 7fddfffff700 1 -- 172.21.15.149:0/187552949 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde08005450 con 0x7fde1806c2a0 2023-11-08T19:23:25.116 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.081+0000 7fddfffff700 1 -- 172.21.15.149:0/187552949 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde080038c0 con 0x7fde1806c2a0 2023-11-08T19:23:25.116 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.082+0000 7fde1dbf0700 1 -- 172.21.15.149:0/187552949 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde18150340 con 0x7fde1806c2a0 2023-11-08T19:23:25.116 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.082+0000 7fde1dbf0700 1 -- 172.21.15.149:0/187552949 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde18150900 con 0x7fde1806c2a0 2023-11-08T19:23:25.117 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.080+0000 7f353ffff700 1 -- 172.21.15.149:0/1568160923 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3548003e50 con 0x7f35580c3ac0 2023-11-08T19:23:25.117 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.080+0000 7f353ffff700 1 -- 172.21.15.149:0/1568160923 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3548011630 con 0x7f35580c3ac0 2023-11-08T19:23:25.117 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.080+0000 7f353ffff700 1 -- 172.21.15.149:0/1568160923 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35480119a0 con 0x7f35580c3ac0 2023-11-08T19:23:25.117 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.082+0000 7f355db63700 1 -- 172.21.15.149:0/1568160923 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35580c5740 con 0x7f35580c3ac0 2023-11-08T19:23:25.118 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.082+0000 7f355db63700 1 -- 172.21.15.149:0/1568160923 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f355815eba0 con 0x7f35580c3ac0 2023-11-08T19:23:25.118 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.083+0000 7f355db63700 1 -- 172.21.15.149:0/1568160923 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35580745f0 con 0x7f35580c3ac0 2023-11-08T19:23:25.118 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.081+0000 7f2b6d750700 1 -- 172.21.15.149:0/3767470718 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2b600073c0 msgr2=0x7f2b600e8df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:25.118 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.081+0000 7f2b6d750700 1 --2- 172.21.15.149:0/3767470718 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2b600073c0 0x7f2b600e8df0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2b68000eb0 tx=0x7f2b68062640 comp rx=0 tx=0).stop 2023-11-08T19:23:25.119 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.081+0000 7f2b6d750700 1 -- 172.21.15.149:0/3767470718 shutdown_connections 2023-11-08T19:23:25.119 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.081+0000 7f2b6d750700 1 --2- 172.21.15.149:0/3767470718 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2b600073c0 0x7f2b600e8df0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.119 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.081+0000 7f2b6d750700 1 --2- 172.21.15.149:0/3767470718 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2b60006a00 0x7f2b60006e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.119 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.081+0000 7f2b6d750700 1 -- 172.21.15.149:0/3767470718 >> 172.21.15.149:0/3767470718 conn(0x7f2b6000a4d0 msgr2=0x7f2b6000a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:25.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.084+0000 7f2b6d750700 1 -- 172.21.15.149:0/3767470718 shutdown_connections 2023-11-08T19:23:25.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.084+0000 7f66e314f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66dc09c7e0 0x7f66dc0c8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:25.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.084+0000 7f66e314f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f66dc162c50 0x7f66dc0a09e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:25.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.084+0000 7f66e314f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f66dc163030 0x7f66dc09ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:25.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.084+0000 7f66e314f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66dc0c8a70 con 0x7f66dc09c7e0 2023-11-08T19:23:25.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.084+0000 7f66e314f700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66dc0a14e0 con 0x7f66dc162c50 2023-11-08T19:23:25.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.084+0000 7f66e314f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66dc0b33c0 con 0x7f66dc163030 2023-11-08T19:23:25.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.084+0000 7f353ffff700 1 -- 172.21.15.149:0/1568160923 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3548021070 con 0x7f35580c3ac0 2023-11-08T19:23:25.122 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.084+0000 7f66dbfff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f66dc162c50 0x7f66dc0a09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:25.122 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.084+0000 7f66dbfff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f66dc162c50 0x7f66dc0a09e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.149:38576/0 (socket says 172.21.15.149:38576) 2023-11-08T19:23:25.122 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.085+0000 7f66dbfff700 1 -- 172.21.15.149:0/3992022318 learned_addr learned my addr 172.21.15.149:0/3992022318 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:25.123 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.085+0000 7f2b6d750700 1 -- 172.21.15.149:0/3767470718 wait complete. 2023-11-08T19:23:25.123 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.085+0000 7f66dbfff700 1 -- 172.21.15.149:0/3992022318 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f66dc163030 msgr2=0x7f66dc09ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:25.124 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.085+0000 7f66dbfff700 1 --2- 172.21.15.149:0/3992022318 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f66dc163030 0x7f66dc09ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.124 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.085+0000 7f66dbfff700 1 -- 172.21.15.149:0/3992022318 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66dc09c7e0 msgr2=0x7f66dc0c8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:25.124 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.085+0000 7f66dbfff700 1 --2- 172.21.15.149:0/3992022318 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66dc09c7e0 0x7f66dc0c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.124 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.085+0000 7f66dbfff700 1 -- 172.21.15.149:0/3992022318 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66d40094a0 con 0x7f66dc162c50 2023-11-08T19:23:25.124 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.085+0000 7f66dbfff700 1 --2- 172.21.15.149:0/3992022318 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f66dc162c50 0x7f66dc0a09e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f66d40090b0 tx=0x7f66d4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:25.125 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.084+0000 7efe08cbe700 1 -- start start 2023-11-08T19:23:25.125 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.085+0000 7efe08cbe700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efe040b2850 0x7efe041523e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:25.125 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.085+0000 7efe08cbe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efe040b2cd0 0x7efe040b4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:25.126 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.085+0000 7efe08cbe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe040cc140 0x7efe040b47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:25.126 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.085+0000 7efe08cbe700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe040b0320 con 0x7efe040cc140 2023-11-08T19:23:25.126 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.085+0000 7efe08cbe700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe04152d60 con 0x7efe040b2cd0 2023-11-08T19:23:25.126 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.085+0000 7efe08cbe700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe04153040 con 0x7efe040b2850 2023-11-08T19:23:25.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.085+0000 7f353ffff700 1 --2- 172.21.15.149:0/1568160923 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f354406af00 0x7f354406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:25.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.085+0000 7f353ffff700 1 -- 172.21.15.149:0/1568160923 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f354808b050 con 0x7f35580c3ac0 2023-11-08T19:23:25.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.085+0000 7efe01d9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efe040b2cd0 0x7efe040b4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:25.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.086+0000 7efe01d9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efe040b2cd0 0x7efe040b4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.149:38582/0 (socket says 172.21.15.149:38582) 2023-11-08T19:23:25.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.086+0000 7efe01d9b700 1 -- 172.21.15.149:0/2603373376 learned_addr learned my addr 172.21.15.149:0/2603373376 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:25.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.086+0000 7efe0259c700 1 --2- 172.21.15.149:0/2603373376 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efe040b2850 0x7efe041523e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:25.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.086+0000 7f35577fe700 1 --2- 172.21.15.149:0/1568160923 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f354406af00 0x7f354406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:25.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.084+0000 7fde1dbf0700 1 -- 172.21.15.149:0/187552949 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde180745f0 con 0x7fde1806c2a0 2023-11-08T19:23:25.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.086+0000 7f8f7ca66700 1 Processor -- start 2023-11-08T19:23:25.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.086+0000 7efe0259c700 1 -- 172.21.15.149:0/2603373376 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efe040b2cd0 msgr2=0x7efe040b4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:25.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.086+0000 7efe0259c700 1 --2- 172.21.15.149:0/2603373376 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efe040b2cd0 0x7efe040b4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.086+0000 7efe0259c700 1 -- 172.21.15.149:0/2603373376 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe040cc140 msgr2=0x7efe040b47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:25.131 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.086+0000 7efe0259c700 1 --2- 172.21.15.149:0/2603373376 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe040cc140 0x7efe040b47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.131 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.086+0000 7efe0259c700 1 -- 172.21.15.149:0/2603373376 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf4009500 con 0x7efe040b2850 2023-11-08T19:23:25.131 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.086+0000 7f2b6d750700 1 Processor -- start 2023-11-08T19:23:25.132 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.086+0000 7f35577fe700 1 --2- 172.21.15.149:0/1568160923 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f354406af00 0x7f354406d3c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f354c007fd0 tx=0x7f354c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:25.132 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.087+0000 7f2b6d750700 1 -- start start 2023-11-08T19:23:25.132 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.087+0000 7fddfffff700 1 -- 172.21.15.149:0/187552949 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fde08003a20 con 0x7fde1806c2a0 2023-11-08T19:23:25.133 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.086+0000 7efe0259c700 1 --2- 172.21.15.149:0/2603373376 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efe040b2850 0x7efe041523e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efdf4009fd0 tx=0x7efdf4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:25.133 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.087+0000 7efdf2ffd700 1 -- 172.21.15.149:0/2603373376 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf4003ab0 con 0x7efe040b2850 2023-11-08T19:23:25.133 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.087+0000 7efdf2ffd700 1 -- 172.21.15.149:0/2603373376 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf4003c10 con 0x7efe040b2850 2023-11-08T19:23:25.133 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.087+0000 7efe08cbe700 1 -- 172.21.15.149:0/2603373376 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe04153320 con 0x7efe040b2850 2023-11-08T19:23:25.134 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.087+0000 7efdf2ffd700 1 -- 172.21.15.149:0/2603373376 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf4006030 con 0x7efe040b2850 2023-11-08T19:23:25.134 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.087+0000 7efe08cbe700 1 -- 172.21.15.149:0/2603373376 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe04152920 con 0x7efe040b2850 2023-11-08T19:23:25.134 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.088+0000 7fddfffff700 1 --2- 172.21.15.149:0/187552949 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fde0406af00 0x7fde0406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:25.135 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.088+0000 7fddfffff700 1 -- 172.21.15.149:0/187552949 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fde08088ab0 con 0x7fde1806c2a0 2023-11-08T19:23:25.135 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.088+0000 7f2b6d750700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2b60006620 0x7f2b6004b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:25.135 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.088+0000 7f2b6d750700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2b60006a00 0x7f2b600dd060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:25.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.088+0000 7f2b6d750700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b6017cd60 0x7f2b600dd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:25.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.088+0000 7f2b6d750700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b60179a90 con 0x7f2b6017cd60 2023-11-08T19:23:25.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.088+0000 7f2b6d750700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b60034cb0 con 0x7f2b60006620 2023-11-08T19:23:25.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.088+0000 7f2b6d750700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b601797b0 con 0x7f2b60006a00 2023-11-08T19:23:25.137 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.088+0000 7fde16ffd700 1 --2- 172.21.15.149:0/187552949 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fde0406af00 0x7fde0406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:25.137 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.089+0000 7fde16ffd700 1 --2- 172.21.15.149:0/187552949 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fde0406af00 0x7fde0406d3c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fde0c009130 tx=0x7fde0c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:25.138 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.088+0000 7f8f7ca66700 1 -- start start 2023-11-08T19:23:25.138 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.089+0000 7f8f7ca66700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f8f780c9cc0 0x7f8f780ce030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:25.138 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.089+0000 7f8f7ca66700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8f780ce570 0x7f8f780ca430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:25.138 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.089+0000 7f8f7ca66700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f7815dd10 con 0x7f8f78159bc0 2023-11-08T19:23:25.138 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.089+0000 7f8f7ca66700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f78159fa0 con 0x7f8f780c9cc0 2023-11-08T19:23:25.139 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.089+0000 7f8f7ca66700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7815e530 con 0x7f8f780ce570 2023-11-08T19:23:25.139 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.089+0000 7f8f76d9d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8f780ce570 0x7f8f780ca430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:25.139 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.089+0000 7f8f75d9b700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f8f780c9cc0 0x7f8f780ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:25.139 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.089+0000 7f8f76d9d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8f780ce570 0x7f8f780ca430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.149:57892/0 (socket says 172.21.15.149:57892) 2023-11-08T19:23:25.140 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.089+0000 7f8f76d9d700 1 -- 172.21.15.149:0/3543180581 learned_addr learned my addr 172.21.15.149:0/3543180581 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:25.140 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.089+0000 7f2b6cf4f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b6017cd60 0x7f2b600dd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:25.140 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.089+0000 7f2b67fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2b60006620 0x7f2b6004b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:25.140 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.089+0000 7f2b6cf4f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b6017cd60 0x7f2b600dd5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37594/0 (socket says 172.21.15.149:37594) 2023-11-08T19:23:25.141 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.089+0000 7f2b6cf4f700 1 -- 172.21.15.149:0/431883091 learned_addr learned my addr 172.21.15.149:0/431883091 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:25.141 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.089+0000 7efdf2ffd700 1 -- 172.21.15.149:0/2603373376 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efdf4006190 con 0x7efe040b2850 2023-11-08T19:23:25.141 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.089+0000 7efdf2ffd700 1 --2- 172.21.15.149:0/2603373376 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7efde406af20 0x7efde406d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:25.142 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.089+0000 7efdf2ffd700 1 -- 172.21.15.149:0/2603373376 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efdf408a410 con 0x7efe040b2850 2023-11-08T19:23:25.142 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.089+0000 7efe01d9b700 1 --2- 172.21.15.149:0/2603373376 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7efde406af20 0x7efde406d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:25.142 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.090+0000 7f8f75d9b700 1 -- 172.21.15.149:0/3543180581 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8f780ce570 msgr2=0x7f8f780ca430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:25.142 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.090+0000 7f8f75d9b700 1 --2- 172.21.15.149:0/3543180581 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8f780ce570 0x7f8f780ca430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.143 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.090+0000 7f8f75d9b700 1 -- 172.21.15.149:0/3543180581 >> v1:172.21.15.160:6789/0 conn(0x7f8f78159bc0 legacy=0x7f8f7815d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:25.143 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.090+0000 7f8f75d9b700 1 -- 172.21.15.149:0/3543180581 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f7815df70 con 0x7f8f780c9cc0 2023-11-08T19:23:25.143 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.090+0000 7f2b6cf4f700 1 -- 172.21.15.149:0/431883091 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2b60006a00 msgr2=0x7f2b600dd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:25.143 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.090+0000 7f2b6cf4f700 1 --2- 172.21.15.149:0/431883091 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2b60006a00 0x7f2b600dd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.144 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.090+0000 7f2b6cf4f700 1 -- 172.21.15.149:0/431883091 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2b60006620 msgr2=0x7f2b6004b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:25.144 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.090+0000 7f2b6cf4f700 1 --2- 172.21.15.149:0/431883091 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2b60006620 0x7f2b6004b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.144 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.090+0000 7f2b6cf4f700 1 -- 172.21.15.149:0/431883091 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b680743d0 con 0x7f2b6017cd60 2023-11-08T19:23:25.145 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.090+0000 7f8f75d9b700 1 --2- 172.21.15.149:0/3543180581 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8f780c9cc0 0x7f8f780ce030 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8f6800ebe0 tx=0x7f8f6800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d8956f831366869 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:25.145 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.090+0000 7efe08cbe700 1 -- 172.21.15.149:0/2603373376 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe04152ea0 con 0x7efe040b2850 2023-11-08T19:23:25.145 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.090+0000 7f2b6cf4f700 1 --2- 172.21.15.149:0/431883091 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b6017cd60 0x7f2b600dd5a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2b680688d0 tx=0x7f2b68069f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:25.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.091+0000 7efe01d9b700 1 --2- 172.21.15.149:0/2603373376 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7efde406af20 0x7efde406d3e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7efe040d1000 tx=0x7efdf8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:25.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.090+0000 7f66d97fa700 1 -- 172.21.15.149:0/3992022318 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d4003ab0 con 0x7f66dc162c50 2023-11-08T19:23:25.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.090+0000 7f66d97fa700 1 -- 172.21.15.149:0/3992022318 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d4041070 con 0x7f66dc162c50 2023-11-08T19:23:25.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.090+0000 7f66d97fa700 1 -- 172.21.15.149:0/3992022318 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d4003e10 con 0x7f66dc162c50 2023-11-08T19:23:25.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.091+0000 7f2b67fff700 1 --2- 172.21.15.149:0/431883091 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2b60006620 0x7f2b6004b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:23:25.148 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.091+0000 7f66e314f700 1 -- 172.21.15.149:0/3992022318 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66dc0b36a0 con 0x7f66dc162c50 2023-11-08T19:23:25.148 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.091+0000 7f66e314f700 1 -- 172.21.15.149:0/3992022318 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66dc0b3c60 con 0x7f66dc162c50 2023-11-08T19:23:25.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.090+0000 7f8f7559a700 1 -- 172.21.15.149:0/3543180581 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f68013070 con 0x7f8f780c9cc0 2023-11-08T19:23:25.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.090+0000 7f8f7559a700 1 -- 172.21.15.149:0/3543180581 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f68007d90 con 0x7f8f780c9cc0 2023-11-08T19:23:25.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.090+0000 7f8f7559a700 1 -- 172.21.15.149:0/3543180581 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6800e2f0 con 0x7f8f780c9cc0 2023-11-08T19:23:25.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.091+0000 7f8f7ca66700 1 -- 172.21.15.149:0/3543180581 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8f780c9cc0 msgr2=0x7f8f780ce030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:25.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.091+0000 7f8f7ca66700 1 --2- 172.21.15.149:0/3543180581 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8f780c9cc0 0x7f8f780ce030 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8f6800ebe0 tx=0x7f8f6800eef0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.090+0000 7f353ffff700 1 -- 172.21.15.149:0/1568160923 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3548055e00 con 0x7f35580c3ac0 2023-11-08T19:23:25.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.092+0000 7f8f7ca66700 1 -- 172.21.15.149:0/3543180581 shutdown_connections 2023-11-08T19:23:25.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.092+0000 7f8f7ca66700 1 --2- 172.21.15.149:0/3543180581 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8f780ce570 0x7f8f780ca430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.092+0000 7f8f7ca66700 1 --2- 172.21.15.149:0/3543180581 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8f780c9cc0 0x7f8f780ce030 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.092+0000 7f8f7ca66700 1 -- 172.21.15.149:0/3543180581 >> 172.21.15.149:0/3543180581 conn(0x7f8f780cbee0 msgr2=0x7f8f780cc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:25.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.092+0000 7f8f7ca66700 1 -- 172.21.15.149:0/3543180581 shutdown_connections 2023-11-08T19:23:25.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.093+0000 7f66d97fa700 1 -- 172.21.15.149:0/3992022318 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f66d403c430 con 0x7f66dc162c50 2023-11-08T19:23:25.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.094+0000 7f66d97fa700 1 --2- 172.21.15.149:0/3992022318 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f66bc06af00 0x7f66bc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:25.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.094+0000 7f66d97fa700 1 -- 172.21.15.149:0/3992022318 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f66d4043070 con 0x7f66dc162c50 2023-11-08T19:23:25.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.094+0000 7f66e0eeb700 1 --2- 172.21.15.149:0/3992022318 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f66bc06af00 0x7f66bc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:25.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.092+0000 7f8f7ca66700 1 -- 172.21.15.149:0/3543180581 wait complete. 2023-11-08T19:23:25.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.094+0000 7f8f7ca66700 1 Processor -- start 2023-11-08T19:23:25.154 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.094+0000 7f8f7ca66700 1 -- start start 2023-11-08T19:23:25.154 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.094+0000 7f66e314f700 1 -- 172.21.15.149:0/3992022318 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66dc0ca750 con 0x7f66dc162c50 2023-11-08T19:23:25.154 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.095+0000 7f66e0eeb700 1 --2- 172.21.15.149:0/3992022318 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f66bc06af00 0x7f66bc06d3c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f66cc0072e0 tx=0x7f66cc0071f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:25.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.096+0000 7f8f7ca66700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8f780c9cc0 0x7f8f780b3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:25.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.096+0000 7f8f7ca66700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8f780ce570 0x7f8f78154950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:25.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.096+0000 7f8f7ca66700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f78159bc0 0x7f8f7815c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:25.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.096+0000 7f8f7ca66700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f780b3000 con 0x7f8f78159bc0 2023-11-08T19:23:25.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.096+0000 7f8f7ca66700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f780b39d0 con 0x7f8f780c9cc0 2023-11-08T19:23:25.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.096+0000 7f8f7ca66700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f780b23f0 con 0x7f8f780ce570 2023-11-08T19:23:25.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.096+0000 7fddfffff700 1 -- 172.21.15.149:0/187552949 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fde08053900 con 0x7fde1806c2a0 2023-11-08T19:23:25.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.096+0000 7f8f75d9b700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8f780ce570 0x7f8f78154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:25.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.096+0000 7f8f75d9b700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8f780ce570 0x7f8f78154950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.149:57904/0 (socket says 172.21.15.149:57904) 2023-11-08T19:23:25.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.096+0000 7f8f75d9b700 1 -- 172.21.15.149:0/456238862 learned_addr learned my addr 172.21.15.149:0/456238862 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:25.158 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.096+0000 7efdf2ffd700 1 -- 172.21.15.149:0/2603373376 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efe04152ea0 con 0x7efe040b2850 2023-11-08T19:23:25.158 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.096+0000 7f2b64ff9700 1 -- 172.21.15.149:0/431883091 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b68099070 con 0x7f2b6017cd60 2023-11-08T19:23:25.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.096+0000 7f2b64ff9700 1 -- 172.21.15.149:0/431883091 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b68062440 con 0x7f2b6017cd60 2023-11-08T19:23:25.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.096+0000 7f2b6d750700 1 -- 172.21.15.149:0/431883091 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b6017c280 con 0x7f2b6017cd60 2023-11-08T19:23:25.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.096+0000 7f2b64ff9700 1 -- 172.21.15.149:0/431883091 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b68073940 con 0x7f2b6017cd60 2023-11-08T19:23:25.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.097+0000 7f8f75d9b700 1 -- 172.21.15.149:0/456238862 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8f780c9cc0 msgr2=0x7f8f780b3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:25.161 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.097+0000 7f8f75d9b700 1 --2- 172.21.15.149:0/456238862 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8f780c9cc0 0x7f8f780b3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.161 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.097+0000 7f8f75d9b700 1 -- 172.21.15.149:0/456238862 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f78159bc0 msgr2=0x7f8f7815c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:25.161 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.097+0000 7f8f75d9b700 1 --2- 172.21.15.149:0/456238862 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f78159bc0 0x7f8f7815c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.161 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.097+0000 7f8f75d9b700 1 -- 172.21.15.149:0/456238862 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f6800e8c0 con 0x7f8f780ce570 2023-11-08T19:23:25.161 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.097+0000 7f8f75d9b700 1 --2- 172.21.15.149:0/456238862 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8f780ce570 0x7f8f78154950 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8f7806f680 tx=0x7f8f68004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:25.162 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.097+0000 7f8f66ffd700 1 -- 172.21.15.149:0/456238862 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f68004230 con 0x7f8f780ce570 2023-11-08T19:23:25.162 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.097+0000 7f8f66ffd700 1 -- 172.21.15.149:0/456238862 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f68004390 con 0x7f8f780ce570 2023-11-08T19:23:25.162 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.097+0000 7f8f66ffd700 1 -- 172.21.15.149:0/456238862 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6800b910 con 0x7f8f780ce570 2023-11-08T19:23:25.162 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.098+0000 7f8f7ca66700 1 -- 172.21.15.149:0/456238862 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f780b26d0 con 0x7f8f780ce570 2023-11-08T19:23:25.162 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.098+0000 7f8f7ca66700 1 -- 172.21.15.149:0/456238862 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f780b2c90 con 0x7f8f780ce570 2023-11-08T19:23:25.163 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.099+0000 7f8f7ca66700 1 -- 172.21.15.149:0/456238862 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f780745f0 con 0x7f8f780ce570 2023-11-08T19:23:25.163 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.100+0000 7f8f66ffd700 1 -- 172.21.15.149:0/456238862 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8f6800ba70 con 0x7f8f780ce570 2023-11-08T19:23:25.163 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.101+0000 7f8f66ffd700 1 --2- 172.21.15.149:0/456238862 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f8f5806aed0 0x7f8f5806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:25.163 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.101+0000 7f8f66ffd700 1 -- 172.21.15.149:0/456238862 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8f6808a610 con 0x7f8f780ce570 2023-11-08T19:23:25.163 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.104+0000 7f66d97fa700 1 -- 172.21.15.149:0/3992022318 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f66d40781d0 con 0x7f66dc162c50 2023-11-08T19:23:25.164 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.097+0000 7f2b6d750700 1 -- 172.21.15.149:0/431883091 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b6017c840 con 0x7f2b6017cd60 2023-11-08T19:23:25.164 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.098+0000 7f2b6d750700 1 -- 172.21.15.149:0/431883091 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b6017c0e0 con 0x7f2b6017cd60 2023-11-08T19:23:25.164 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.103+0000 7f2b64ff9700 1 -- 172.21.15.149:0/431883091 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2b68073aa0 con 0x7f2b6017cd60 2023-11-08T19:23:25.165 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.103+0000 7f2b64ff9700 1 --2- 172.21.15.149:0/431883091 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2b4c06af00 0x7f2b4c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:25.165 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.103+0000 7f2b64ff9700 1 -- 172.21.15.149:0/431883091 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2b68104ba0 con 0x7f2b6017cd60 2023-11-08T19:23:25.165 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.105+0000 7f2b67fff700 1 --2- 172.21.15.149:0/431883091 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2b4c06af00 0x7f2b4c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:25.165 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.106+0000 7f2b67fff700 1 --2- 172.21.15.149:0/431883091 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2b4c06af00 0x7f2b4c06d3c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c007fd0 tx=0x7f2b5c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:25.166 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.106+0000 7f8f7659c700 1 --2- 172.21.15.149:0/456238862 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f8f5806aed0 0x7f8f5806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:25.166 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.107+0000 7f8f7659c700 1 --2- 172.21.15.149:0/456238862 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f8f5806aed0 0x7f8f5806d390 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8f700012e0 tx=0x7f8f70001780 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:25.167 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.108+0000 7f2b64ff9700 1 -- 172.21.15.149:0/431883091 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2b680cf940 con 0x7f2b6017cd60 2023-11-08T19:23:25.167 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.112+0000 7f8f66ffd700 1 -- 172.21.15.149:0/456238862 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8f680554e0 con 0x7f8f780ce570 2023-11-08T19:23:25.171 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.165+0000 7fdf5833e700 1 Processor -- start 2023-11-08T19:23:25.171 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.165+0000 7fdf5833e700 1 -- start start 2023-11-08T19:23:25.171 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.166+0000 7fdf5833e700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdf5008aa20 0x7fdf500ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:25.172 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.166+0000 7fdf5833e700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf5008ae00 con 0x7fdf500ce4c0 2023-11-08T19:23:25.172 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.166+0000 7fdf5833e700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf500ce030 con 0x7fdf5006d4f0 2023-11-08T19:23:25.172 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.166+0000 7fdf5833e700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5016e210 con 0x7fdf5008aa20 2023-11-08T19:23:25.172 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.168+0000 7fdf560da700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdf5008aa20 0x7fdf500ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:25.172 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.168+0000 7fdf568db700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7fdf5006d4f0 0x7fdf50070d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.149:51294/0 (socket says 172.21.15.149:51294) 2023-11-08T19:23:25.173 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.168+0000 7fdf568db700 1 -- 172.21.15.149:0/2212540509 learned_addr learned my addr 172.21.15.149:0/2212540509 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:23:25.173 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.168+0000 7fdf550d8700 1 -- 172.21.15.149:0/2212540509 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3409702820 0 0) 0x7fdf5008ae00 con 0x7fdf500ce4c0 2023-11-08T19:23:25.173 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.169+0000 7fdf550d8700 1 -- 172.21.15.149:0/2212540509 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf3c003590 con 0x7fdf500ce4c0 2023-11-08T19:23:25.173 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.169+0000 7fdf550d8700 1 -- 172.21.15.149:0/2212540509 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2103361280 0 0) 0x7fdf500ce030 con 0x7fdf5006d4f0 2023-11-08T19:23:25.173 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.169+0000 7fdf550d8700 1 -- 172.21.15.149:0/2212540509 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf5008ae00 con 0x7fdf5006d4f0 2023-11-08T19:23:25.174 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.169+0000 7fdf550d8700 1 -- 172.21.15.149:0/2212540509 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2666759509 0 0) 0x7fdf3c003590 con 0x7fdf500ce4c0 2023-11-08T19:23:25.174 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.169+0000 7fdf550d8700 1 -- 172.21.15.149:0/2212540509 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdf5008aa20 msgr2=0x7fdf500ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:25.174 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.169+0000 7fdf550d8700 1 --2- 172.21.15.149:0/2212540509 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdf5008aa20 0x7fdf500ceac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.174 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.169+0000 7fdf550d8700 1 -- 172.21.15.149:0/2212540509 >> v1:172.21.15.160:6789/0 conn(0x7fdf5006d4f0 legacy=0x7fdf50070d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:25.174 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.169+0000 7fdf550d8700 1 -- 172.21.15.149:0/2212540509 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf500cd490 con 0x7fdf500ce4c0 2023-11-08T19:23:25.175 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.169+0000 7fdf550d8700 1 -- 172.21.15.149:0/2212540509 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7fdf480019f0 con 0x7fdf500ce4c0 2023-11-08T19:23:25.175 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.169+0000 7fdf550d8700 1 -- 172.21.15.149:0/2212540509 >> v1:172.21.15.149:6789/0 conn(0x7fdf500ce4c0 legacy=0x7fdf5006cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:25.175 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.169+0000 7fdf550d8700 1 --2- 172.21.15.149:0/2212540509 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdf3c003d60 0x7fdf3c004160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:25.175 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.169+0000 7fdf550d8700 1 --2- 172.21.15.149:0/2212540509 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf3c0046a0 0x7fdf3c008e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:25.175 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.169+0000 7fdf550d8700 1 --2- 172.21.15.149:0/2212540509 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf3c0093d0 0x7fdf3c00b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:25.176 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.169+0000 7fdf550d8700 1 -- 172.21.15.149:0/2212540509 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5016e210 con 0x7fdf3c0093d0 2023-11-08T19:23:25.176 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.169+0000 7fdf550d8700 1 -- 172.21.15.149:0/2212540509 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3c00c0a0 con 0x7fdf3c0046a0 2023-11-08T19:23:25.176 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.169+0000 7fdf550d8700 1 -- 172.21.15.149:0/2212540509 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3c00c260 con 0x7fdf3c003d60 2023-11-08T19:23:25.176 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.170+0000 7fdf568db700 1 --2- 172.21.15.149:0/2212540509 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf3c0093d0 0x7fdf3c00b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:25.177 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.171+0000 7fdf568db700 1 -- 172.21.15.149:0/2212540509 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdf3c003d60 msgr2=0x7fdf3c004160 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-08T19:23:25.177 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.171+0000 7fdf568db700 1 --2- 172.21.15.149:0/2212540509 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdf3c003d60 0x7fdf3c004160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.177 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.171+0000 7fdf568db700 1 -- 172.21.15.149:0/2212540509 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf3c0046a0 msgr2=0x7fdf3c008e90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-08T19:23:25.177 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.171+0000 7fdf568db700 1 --2- 172.21.15.149:0/2212540509 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf3c0046a0 0x7fdf3c008e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.177 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.171+0000 7fdf568db700 1 -- 172.21.15.149:0/2212540509 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf500cd490 con 0x7fdf3c0093d0 2023-11-08T19:23:25.178 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.171+0000 7fdf568db700 1 --2- 172.21.15.149:0/2212540509 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf3c0093d0 0x7fdf3c00b860 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fdf40001a60 tx=0x7fdf3c004de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b44c31d51ba45b7 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:25.178 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.171+0000 7fdf550d8700 1 -- 172.21.15.149:0/2212540509 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf40004b30 con 0x7fdf3c0093d0 2023-11-08T19:23:25.178 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.171+0000 7fdf550d8700 1 -- 172.21.15.149:0/2212540509 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf40004c90 con 0x7fdf3c0093d0 2023-11-08T19:23:25.178 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.171+0000 7fdf550d8700 1 -- 172.21.15.149:0/2212540509 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf400070d0 con 0x7fdf3c0093d0 2023-11-08T19:23:25.179 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.172+0000 7fdf5833e700 1 -- 172.21.15.149:0/2212540509 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf3c0093d0 msgr2=0x7fdf3c00b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:25.179 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.172+0000 7fdf5833e700 1 --2- 172.21.15.149:0/2212540509 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf3c0093d0 0x7fdf3c00b860 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fdf40001a60 tx=0x7fdf3c004de0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.179 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.172+0000 7fdf568db700 1 -- 172.21.15.149:0/2212540509 reap_dead start 2023-11-08T19:23:25.179 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.173+0000 7fdf5833e700 1 -- 172.21.15.149:0/2212540509 shutdown_connections 2023-11-08T19:23:25.179 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.173+0000 7fdf5833e700 1 -- 172.21.15.149:0/2212540509 >> 172.21.15.149:0/2212540509 conn(0x7fdf500cbee0 msgr2=0x7fdf500cc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:25.180 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.173+0000 7fdf5833e700 1 -- 172.21.15.149:0/2212540509 shutdown_connections 2023-11-08T19:23:25.180 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.173+0000 7fdf5833e700 1 -- 172.21.15.149:0/2212540509 wait complete. 2023-11-08T19:23:25.181 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.175+0000 7fdf5833e700 1 Processor -- start 2023-11-08T19:23:25.181 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.176+0000 7fdf5833e700 1 -- start start 2023-11-08T19:23:25.181 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.177+0000 7fdf5833e700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdf3c0093d0 0x7fdf500b2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:25.181 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.177+0000 7fdf5833e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf500b1a90 0x7fdf501678e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:25.181 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.177+0000 7fdf5833e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf500b3f10 0x7fdf500b4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:25.182 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.177+0000 7fdf5833e700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf500b48d0 con 0x7fdf500b1a90 2023-11-08T19:23:25.182 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.177+0000 7fdf5833e700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf500aeec0 con 0x7fdf500b3f10 2023-11-08T19:23:25.182 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.177+0000 7fdf5833e700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf500b32a0 con 0x7fdf3c0093d0 2023-11-08T19:23:25.182 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.177+0000 7fdf558d9700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf500b1a90 0x7fdf501678e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:25.182 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.177+0000 7fdf558d9700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf500b1a90 0x7fdf501678e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37636/0 (socket says 172.21.15.149:37636) 2023-11-08T19:23:25.183 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.177+0000 7fdf558d9700 1 -- 172.21.15.149:0/4092442086 learned_addr learned my addr 172.21.15.149:0/4092442086 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:25.183 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.178+0000 7fdf558d9700 1 -- 172.21.15.149:0/4092442086 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdf3c0093d0 msgr2=0x7fdf500b2a40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-08T19:23:25.183 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.178+0000 7fdf558d9700 1 --2- 172.21.15.149:0/4092442086 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdf3c0093d0 0x7fdf500b2a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.183 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.178+0000 7fdf558d9700 1 -- 172.21.15.149:0/4092442086 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf500b3f10 msgr2=0x7fdf500b4390 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-08T19:23:25.183 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.178+0000 7fdf558d9700 1 --2- 172.21.15.149:0/4092442086 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf500b3f10 0x7fdf500b4390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.184 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.178+0000 7fdf558d9700 1 -- 172.21.15.149:0/4092442086 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf500b3580 con 0x7fdf500b1a90 2023-11-08T19:23:25.184 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.178+0000 7fdf558d9700 1 --2- 172.21.15.149:0/4092442086 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf500b1a90 0x7fdf501678e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fdf4800cb10 tx=0x7fdf4800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:25.184 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.180+0000 7fdf46ffd700 1 -- 172.21.15.149:0/4092442086 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf48005070 con 0x7fdf500b1a90 2023-11-08T19:23:25.184 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.180+0000 7fdf46ffd700 1 -- 172.21.15.149:0/4092442086 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf480051d0 con 0x7fdf500b1a90 2023-11-08T19:23:25.185 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.180+0000 7fdf46ffd700 1 -- 172.21.15.149:0/4092442086 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf48005580 con 0x7fdf500b1a90 2023-11-08T19:23:25.185 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.180+0000 7fdf5833e700 1 -- 172.21.15.149:0/4092442086 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf500b3860 con 0x7fdf500b1a90 2023-11-08T19:23:25.185 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.180+0000 7fdf5833e700 1 -- 172.21.15.149:0/4092442086 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf500b2f80 con 0x7fdf500b1a90 2023-11-08T19:23:25.187 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.186+0000 7fdf46ffd700 1 -- 172.21.15.149:0/4092442086 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdf480056e0 con 0x7fdf500b1a90 2023-11-08T19:23:25.187 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.186+0000 7fdf46ffd700 1 --2- 172.21.15.149:0/4092442086 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fdf3406b000 0x7fdf3406d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:25.188 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.186+0000 7fdf46ffd700 1 -- 172.21.15.149:0/4092442086 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdf48089240 con 0x7fdf500b1a90 2023-11-08T19:23:25.188 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.187+0000 7fdf5833e700 1 -- 172.21.15.149:0/4092442086 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf380052f0 con 0x7fdf500b1a90 2023-11-08T19:23:25.189 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.188+0000 7fdf560da700 1 --2- 172.21.15.149:0/4092442086 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fdf3406b000 0x7fdf3406d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:25.190 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.189+0000 7fdf560da700 1 --2- 172.21.15.149:0/4092442086 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fdf3406b000 0x7fdf3406d4c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c006f10 tx=0x7fdf4c006ea0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:25.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.197+0000 7fdf46ffd700 1 -- 172.21.15.149:0/4092442086 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdf48053fe0 con 0x7fdf500b1a90 2023-11-08T19:23:25.470 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.469+0000 7f193157a700 1 -- 172.21.15.149:0/3854365599 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f190c0055a0 con 0x7f192c0ce570 2023-11-08T19:23:25.471 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.469+0000 7f19137fe700 1 -- 172.21.15.149:0/3854365599 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f191c021030 con 0x7f192c0ce570 2023-11-08T19:23:25.474 INFO:teuthology.orchestra.run.smithi149.stdout:55834574857 2023-11-08T19:23:25.475 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.473+0000 7f193157a700 1 -- 172.21.15.149:0/3854365599 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f191806af50 msgr2=0x7f191806d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:25.475 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.473+0000 7f193157a700 1 --2- 172.21.15.149:0/3854365599 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f191806af50 0x7f191806d410 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f19200090b0 tx=0x7f1920008030 comp rx=0 tx=0).stop 2023-11-08T19:23:25.475 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.473+0000 7f193157a700 1 -- 172.21.15.149:0/3854365599 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f192c0ce570 msgr2=0x7f192c1f75a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:25.476 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.473+0000 7f193157a700 1 --2- 172.21.15.149:0/3854365599 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f192c0ce570 0x7f192c1f75a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f191c00e9b0 tx=0x7f191c00ed70 comp rx=0 tx=0).stop 2023-11-08T19:23:25.476 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.474+0000 7f193157a700 1 -- 172.21.15.149:0/3854365599 shutdown_connections 2023-11-08T19:23:25.477 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.474+0000 7f193157a700 1 --2- 172.21.15.149:0/3854365599 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f191806af50 0x7f191806d410 secure :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f19200090b0 tx=0x7f1920008030 comp rx=0 tx=0).stop 2023-11-08T19:23:25.478 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.474+0000 7f193157a700 1 --2- 172.21.15.149:0/3854365599 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f192c0c9cc0 0x7f192c15b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.478 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.474+0000 7f193157a700 1 --2- 172.21.15.149:0/3854365599 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f192c159bc0 0x7f192c0c9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.479 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.474+0000 7f193157a700 1 --2- 172.21.15.149:0/3854365599 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f192c0ce570 0x7f192c1f75a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.479 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.474+0000 7f193157a700 1 -- 172.21.15.149:0/3854365599 >> 172.21.15.149:0/3854365599 conn(0x7f192c0cbee0 msgr2=0x7f192c0b1750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:25.480 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.479+0000 7f193157a700 1 -- 172.21.15.149:0/3854365599 shutdown_connections 2023-11-08T19:23:25.480 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.479+0000 7f193157a700 1 -- 172.21.15.149:0/3854365599 wait complete. 2023-11-08T19:23:25.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.484+0000 7fde1dbf0700 1 -- 172.21.15.149:0/187552949 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fde180b5d80 con 0x7fde1806c2a0 2023-11-08T19:23:25.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.484+0000 7fddfffff700 1 -- 172.21.15.149:0/187552949 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fde08017090 con 0x7fde1806c2a0 2023-11-08T19:23:25.489 INFO:teuthology.orchestra.run.smithi149.stdout:55834574857 2023-11-08T19:23:25.490 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.488+0000 7fde1dbf0700 1 -- 172.21.15.149:0/187552949 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fde0406af00 msgr2=0x7fde0406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:25.490 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.488+0000 7fde1dbf0700 1 --2- 172.21.15.149:0/187552949 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fde0406af00 0x7fde0406d3c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fde0c009130 tx=0x7fde0c008030 comp rx=0 tx=0).stop 2023-11-08T19:23:25.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.488+0000 7fde1dbf0700 1 -- 172.21.15.149:0/187552949 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde1806c2a0 msgr2=0x7fde1816a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:25.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.488+0000 7fde1dbf0700 1 --2- 172.21.15.149:0/187552949 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde1806c2a0 0x7fde1816a4e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fde0800c3c0 tx=0x7fde08001e70 comp rx=0 tx=0).stop 2023-11-08T19:23:25.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.488+0000 7fde1dbf0700 1 -- 172.21.15.149:0/187552949 shutdown_connections 2023-11-08T19:23:25.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.488+0000 7fde1dbf0700 1 --2- 172.21.15.149:0/187552949 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fde0406af00 0x7fde0406d3c0 secure :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fde0c009130 tx=0x7fde0c008030 comp rx=0 tx=0).stop 2023-11-08T19:23:25.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.488+0000 7fde1dbf0700 1 --2- 172.21.15.149:0/187552949 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fde1815a1a0 0x7fde180b0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.488+0000 7fde1dbf0700 1 --2- 172.21.15.149:0/187552949 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde1806c2a0 0x7fde1816a4e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.488+0000 7fde1dbf0700 1 --2- 172.21.15.149:0/187552949 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fde1806da50 0x7fde180c5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.488+0000 7fde1dbf0700 1 -- 172.21.15.149:0/187552949 >> 172.21.15.149:0/187552949 conn(0x7fde18071720 msgr2=0x7fde180b3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:25.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.488+0000 7f355db63700 1 -- 172.21.15.149:0/1568160923 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f35580745f0 con 0x7f35580c3ac0 2023-11-08T19:23:25.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.489+0000 7fde1dbf0700 1 -- 172.21.15.149:0/187552949 shutdown_connections 2023-11-08T19:23:25.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.489+0000 7fde1dbf0700 1 -- 172.21.15.149:0/187552949 wait complete. 2023-11-08T19:23:25.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.489+0000 7f353ffff700 1 -- 172.21.15.149:0/1568160923 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f354802de60 con 0x7f35580c3ac0 2023-11-08T19:23:25.497 INFO:teuthology.orchestra.run.smithi149.stdout:55834574857 2023-11-08T19:23:25.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.494+0000 7f355db63700 1 -- 172.21.15.149:0/1568160923 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f354406af00 msgr2=0x7f354406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:25.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.494+0000 7f355db63700 1 --2- 172.21.15.149:0/1568160923 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f354406af00 0x7f354406d3c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f354c007fd0 tx=0x7f354c009040 comp rx=0 tx=0).stop 2023-11-08T19:23:25.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.494+0000 7f355db63700 1 -- 172.21.15.149:0/1568160923 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f35580c3ac0 msgr2=0x7f355815f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:25.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.494+0000 7f355db63700 1 --2- 172.21.15.149:0/1568160923 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f35580c3ac0 0x7f355815f460 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3548009f50 tx=0x7f3548004750 comp rx=0 tx=0).stop 2023-11-08T19:23:25.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.497+0000 7efe08cbe700 1 -- 172.21.15.149:0/2603373376 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7efe04153560 con 0x7efe040b2850 2023-11-08T19:23:25.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.498+0000 7f355db63700 1 -- 172.21.15.149:0/1568160923 shutdown_connections 2023-11-08T19:23:25.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.498+0000 7f355db63700 1 --2- 172.21.15.149:0/1568160923 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f354406af00 0x7f354406d3c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.498+0000 7f355db63700 1 --2- 172.21.15.149:0/1568160923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35581620c0 0x7f355815f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.498+0000 7f355db63700 1 --2- 172.21.15.149:0/1568160923 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f355806b290 0x7f355815e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.498+0000 7f355db63700 1 --2- 172.21.15.149:0/1568160923 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f35580c3ac0 0x7f355815f460 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.498+0000 7f355db63700 1 -- 172.21.15.149:0/1568160923 >> 172.21.15.149:0/1568160923 conn(0x7f3558099a40 msgr2=0x7f35580b1320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:25.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.498+0000 7f355db63700 1 -- 172.21.15.149:0/1568160923 shutdown_connections 2023-11-08T19:23:25.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.499+0000 7f355db63700 1 -- 172.21.15.149:0/1568160923 wait complete. 2023-11-08T19:23:25.503 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.4 2023-11-08T19:23:25.504 DEBUG:teuthology.parallel:result is None 2023-11-08T19:23:25.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.501+0000 7f8f7ca66700 1 -- 172.21.15.149:0/456238862 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8f78070d60 con 0x7f8f780ce570 2023-11-08T19:23:25.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.502+0000 7f8f66ffd700 1 -- 172.21.15.149:0/456238862 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8f68058b00 con 0x7f8f780ce570 2023-11-08T19:23:25.504 INFO:teuthology.orchestra.run.smithi149.stdout:55834574857 2023-11-08T19:23:25.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.505+0000 7f8f7ca66700 1 -- 172.21.15.149:0/456238862 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f8f5806aed0 msgr2=0x7f8f5806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:25.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.505+0000 7f8f7ca66700 1 --2- 172.21.15.149:0/456238862 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f8f5806aed0 0x7f8f5806d390 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8f700012e0 tx=0x7f8f70001780 comp rx=0 tx=0).stop 2023-11-08T19:23:25.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.505+0000 7f8f7ca66700 1 -- 172.21.15.149:0/456238862 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8f780ce570 msgr2=0x7f8f78154950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:25.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.505+0000 7f8f7ca66700 1 --2- 172.21.15.149:0/456238862 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8f780ce570 0x7f8f78154950 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8f7806f680 tx=0x7f8f68004750 comp rx=0 tx=0).stop 2023-11-08T19:23:25.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.505+0000 7f8f7ca66700 1 -- 172.21.15.149:0/456238862 shutdown_connections 2023-11-08T19:23:25.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.505+0000 7f8f7ca66700 1 --2- 172.21.15.149:0/456238862 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f8f5806aed0 0x7f8f5806d390 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.505+0000 7f8f7ca66700 1 --2- 172.21.15.149:0/456238862 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8f780c9cc0 0x7f8f780b3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.505+0000 7f8f7ca66700 1 --2- 172.21.15.149:0/456238862 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f78159bc0 0x7f8f7815c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.505+0000 7f8f7ca66700 1 --2- 172.21.15.149:0/456238862 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8f780ce570 0x7f8f78154950 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.505+0000 7f8f7ca66700 1 -- 172.21.15.149:0/456238862 >> 172.21.15.149:0/456238862 conn(0x7f8f780cbee0 msgr2=0x7f8f780b0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:25.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.505+0000 7f8f7ca66700 1 -- 172.21.15.149:0/456238862 shutdown_connections 2023-11-08T19:23:25.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.505+0000 7f8f7ca66700 1 -- 172.21.15.149:0/456238862 wait complete. 2023-11-08T19:23:25.509 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.509+0000 7efdf2ffd700 1 -- 172.21.15.149:0/2603373376 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efdf4029020 con 0x7efe040b2850 2023-11-08T19:23:25.511 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.510+0000 7f66e314f700 1 -- 172.21.15.149:0/3992022318 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f66dc0745f0 con 0x7f66dc162c50 2023-11-08T19:23:25.511 INFO:teuthology.orchestra.run.smithi149.stdout:55834574857 2023-11-08T19:23:25.512 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.511+0000 7f2b6d750700 1 -- 172.21.15.149:0/431883091 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2b6017c0e0 con 0x7f2b6017cd60 2023-11-08T19:23:25.513 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.1 2023-11-08T19:23:25.513 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.511+0000 7f2b64ff9700 1 -- 172.21.15.149:0/431883091 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2b6017c0e0 con 0x7f2b6017cd60 2023-11-08T19:23:25.513 INFO:teuthology.orchestra.run.smithi149.stdout:55834574857 2023-11-08T19:23:25.514 DEBUG:teuthology.parallel:result is None 2023-11-08T19:23:25.514 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.512+0000 7f66d97fa700 1 -- 172.21.15.149:0/3992022318 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f66d404d020 con 0x7f66dc162c50 2023-11-08T19:23:25.515 INFO:teuthology.orchestra.run.smithi149.stdout:55834574858 2023-11-08T19:23:25.515 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.515+0000 7efe08cbe700 1 -- 172.21.15.149:0/2603373376 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7efde406af20 msgr2=0x7efde406d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:25.516 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.515+0000 7efe08cbe700 1 --2- 172.21.15.149:0/2603373376 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7efde406af20 0x7efde406d3e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7efe040d1000 tx=0x7efdf8009040 comp rx=0 tx=0).stop 2023-11-08T19:23:25.516 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.515+0000 7efe08cbe700 1 -- 172.21.15.149:0/2603373376 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efe040b2850 msgr2=0x7efe041523e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:25.516 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.515+0000 7efe08cbe700 1 --2- 172.21.15.149:0/2603373376 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efe040b2850 0x7efe041523e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efdf4009fd0 tx=0x7efdf4004750 comp rx=0 tx=0).stop 2023-11-08T19:23:25.517 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.516+0000 7efe08cbe700 1 -- 172.21.15.149:0/2603373376 shutdown_connections 2023-11-08T19:23:25.517 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.516+0000 7efe08cbe700 1 --2- 172.21.15.149:0/2603373376 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7efde406af20 0x7efde406d3e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.517 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.516+0000 7efe08cbe700 1 --2- 172.21.15.149:0/2603373376 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe040cc140 0x7efe040b47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.518 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.516+0000 7efe08cbe700 1 --2- 172.21.15.149:0/2603373376 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efe040b2850 0x7efe041523e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.518 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.516+0000 7efe08cbe700 1 --2- 172.21.15.149:0/2603373376 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efe040b2cd0 0x7efe040b4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.518 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.516+0000 7efe08cbe700 1 -- 172.21.15.149:0/2603373376 >> 172.21.15.149:0/2603373376 conn(0x7efe04099a40 msgr2=0x7efe0406ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:25.518 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.516+0000 7efe08cbe700 1 -- 172.21.15.149:0/2603373376 shutdown_connections 2023-11-08T19:23:25.519 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.516+0000 7f66e314f700 1 -- 172.21.15.149:0/3992022318 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f66bc06af00 msgr2=0x7f66bc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:25.519 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.516+0000 7f66e314f700 1 --2- 172.21.15.149:0/3992022318 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f66bc06af00 0x7f66bc06d3c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f66cc0072e0 tx=0x7f66cc0071f0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.519 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.516+0000 7f66e314f700 1 -- 172.21.15.149:0/3992022318 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f66dc162c50 msgr2=0x7f66dc0a09e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:25.519 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.516+0000 7f66e314f700 1 --2- 172.21.15.149:0/3992022318 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f66dc162c50 0x7f66dc0a09e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f66d40090b0 tx=0x7f66d4004750 comp rx=0 tx=0).stop 2023-11-08T19:23:25.520 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.516+0000 7efe08cbe700 1 -- 172.21.15.149:0/2603373376 wait complete. 2023-11-08T19:23:25.520 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.517+0000 7f2b6d750700 1 -- 172.21.15.149:0/431883091 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2b4c06af00 msgr2=0x7f2b4c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:25.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.517+0000 7f2b6d750700 1 --2- 172.21.15.149:0/431883091 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2b4c06af00 0x7f2b4c06d3c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c007fd0 tx=0x7f2b5c009040 comp rx=0 tx=0).stop 2023-11-08T19:23:25.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.517+0000 7f2b6d750700 1 -- 172.21.15.149:0/431883091 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b6017cd60 msgr2=0x7f2b600dd5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:25.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.517+0000 7f2b6d750700 1 --2- 172.21.15.149:0/431883091 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b6017cd60 0x7f2b600dd5a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2b680688d0 tx=0x7f2b68069f50 comp rx=0 tx=0).stop 2023-11-08T19:23:25.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.517+0000 7f2b6d750700 1 -- 172.21.15.149:0/431883091 shutdown_connections 2023-11-08T19:23:25.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.517+0000 7f2b6d750700 1 --2- 172.21.15.149:0/431883091 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2b4c06af00 0x7f2b4c06d3c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.522 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.517+0000 7f2b6d750700 1 --2- 172.21.15.149:0/431883091 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2b60006620 0x7f2b6004b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.522 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.517+0000 7f2b6d750700 1 --2- 172.21.15.149:0/431883091 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b6017cd60 0x7f2b600dd5a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.522 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.517+0000 7f2b6d750700 1 --2- 172.21.15.149:0/431883091 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2b60006a00 0x7f2b600dd060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.522 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.517+0000 7f2b6d750700 1 -- 172.21.15.149:0/431883091 >> 172.21.15.149:0/431883091 conn(0x7f2b6000a4d0 msgr2=0x7f2b60038bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:25.522 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.517+0000 7f2b6d750700 1 -- 172.21.15.149:0/431883091 shutdown_connections 2023-11-08T19:23:25.523 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.517+0000 7f2b6d750700 1 -- 172.21.15.149:0/431883091 wait complete. 2023-11-08T19:23:25.523 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.518+0000 7f66e314f700 1 -- 172.21.15.149:0/3992022318 shutdown_connections 2023-11-08T19:23:25.523 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.518+0000 7f66e314f700 1 --2- 172.21.15.149:0/3992022318 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f66bc06af00 0x7f66bc06d3c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.524 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.518+0000 7f66e314f700 1 --2- 172.21.15.149:0/3992022318 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f66dc163030 0x7f66dc09ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.524 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.518+0000 7f66e314f700 1 --2- 172.21.15.149:0/3992022318 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66dc09c7e0 0x7f66dc0c8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.524 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.518+0000 7f66e314f700 1 --2- 172.21.15.149:0/3992022318 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f66dc162c50 0x7f66dc0a09e0 secure :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f66d40090b0 tx=0x7f66d4004750 comp rx=0 tx=0).stop 2023-11-08T19:23:25.524 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.518+0000 7f66e314f700 1 -- 172.21.15.149:0/3992022318 >> 172.21.15.149:0/3992022318 conn(0x7f66dc0b5470 msgr2=0x7f66dc0d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:25.525 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.523+0000 7f66e314f700 1 -- 172.21.15.149:0/3992022318 shutdown_connections 2023-11-08T19:23:25.525 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.523+0000 7f66e314f700 1 -- 172.21.15.149:0/3992022318 wait complete. 2023-11-08T19:23:25.528 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.5 2023-11-08T19:23:25.528 DEBUG:teuthology.parallel:result is None 2023-11-08T19:23:25.530 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.3 2023-11-08T19:23:25.530 DEBUG:teuthology.parallel:result is None 2023-11-08T19:23:25.542 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.2 2023-11-08T19:23:25.543 DEBUG:teuthology.parallel:result is None 2023-11-08T19:23:25.543 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.6 2023-11-08T19:23:25.544 DEBUG:teuthology.parallel:result is None 2023-11-08T19:23:25.544 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.0 2023-11-08T19:23:25.545 DEBUG:teuthology.parallel:result is None 2023-11-08T19:23:25.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.561+0000 7fdf5833e700 1 -- 172.21.15.149:0/4092442086 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fdf380055a0 con 0x7fdf500b1a90 2023-11-08T19:23:25.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.562+0000 7fdf46ffd700 1 -- 172.21.15.149:0/4092442086 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdf48017070 con 0x7fdf500b1a90 2023-11-08T19:23:25.563 INFO:teuthology.orchestra.run.smithi149.stdout:55834574857 2023-11-08T19:23:25.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.564+0000 7fdf5833e700 1 -- 172.21.15.149:0/4092442086 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fdf3406b000 msgr2=0x7fdf3406d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:25.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.564+0000 7fdf5833e700 1 --2- 172.21.15.149:0/4092442086 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fdf3406b000 0x7fdf3406d4c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c006f10 tx=0x7fdf4c006ea0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.564+0000 7fdf5833e700 1 -- 172.21.15.149:0/4092442086 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf500b1a90 msgr2=0x7fdf501678e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:25.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.564+0000 7fdf5833e700 1 --2- 172.21.15.149:0/4092442086 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf500b1a90 0x7fdf501678e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fdf4800cb10 tx=0x7fdf4800ced0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.564+0000 7fdf5833e700 1 -- 172.21.15.149:0/4092442086 shutdown_connections 2023-11-08T19:23:25.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.564+0000 7fdf5833e700 1 --2- 172.21.15.149:0/4092442086 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fdf3406b000 0x7fdf3406d4c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.564+0000 7fdf5833e700 1 --2- 172.21.15.149:0/4092442086 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf500b3f10 0x7fdf500b4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.567 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.564+0000 7fdf5833e700 1 --2- 172.21.15.149:0/4092442086 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdf3c0093d0 0x7fdf500b2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.567 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.564+0000 7fdf5833e700 1 --2- 172.21.15.149:0/4092442086 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf500b1a90 0x7fdf501678e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.567 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.564+0000 7fdf5833e700 1 -- 172.21.15.149:0/4092442086 >> 172.21.15.149:0/4092442086 conn(0x7fdf500cbee0 msgr2=0x7fdf500c4f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:25.567 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.564+0000 7fdf5833e700 1 -- 172.21.15.149:0/4092442086 shutdown_connections 2023-11-08T19:23:25.568 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.564+0000 7fdf5833e700 1 -- 172.21.15.149:0/4092442086 wait complete. 2023-11-08T19:23:25.577 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.7 2023-11-08T19:23:25.577 DEBUG:teuthology.parallel:result is None 2023-11-08T19:23:25.578 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-08T19:23:25.578 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:23:25.739 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.738+0000 7f3d51208700 1 Processor -- start 2023-11-08T19:23:25.739 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.738+0000 7f3d51208700 1 -- start start 2023-11-08T19:23:25.741 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.739+0000 7f3d51208700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3d4c0ce840 0x7f3d4c0d0430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:25.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.739+0000 7f3d51208700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d4c0cc2e0 con 0x7f3d4c0cd5e0 2023-11-08T19:23:25.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.739+0000 7f3d51208700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d4c0cc580 con 0x7f3d4c15b950 2023-11-08T19:23:25.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.739+0000 7f3d51208700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4c0cc820 con 0x7f3d4c0ce840 2023-11-08T19:23:25.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.739+0000 7f3d4a59c700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f3d4c0cd5e0 0x7f3d4c0cfd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:39646/0 (socket says 172.21.15.149:39646) 2023-11-08T19:23:25.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.739+0000 7f3d4a59c700 1 -- 172.21.15.149:0/3899333030 learned_addr learned my addr 172.21.15.149:0/3899333030 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:23:25.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.739+0000 7f3d4b59e700 1 --2- 172.21.15.149:0/3899333030 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3d4c0ce840 0x7f3d4c0d0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:25.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.739+0000 7f3d49d9b700 1 -- 172.21.15.149:0/3899333030 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 847734692 0 0) 0x7f3d4c0cc2e0 con 0x7f3d4c0cd5e0 2023-11-08T19:23:25.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.739+0000 7f3d49d9b700 1 -- 172.21.15.149:0/3899333030 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d340035b0 con 0x7f3d4c0cd5e0 2023-11-08T19:23:25.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.739+0000 7f3d49d9b700 1 -- 172.21.15.149:0/3899333030 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 976442617 0 0) 0x7f3d4c0cc580 con 0x7f3d4c15b950 2023-11-08T19:23:25.744 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.739+0000 7f3d49d9b700 1 -- 172.21.15.149:0/3899333030 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d4c0cc2e0 con 0x7f3d4c15b950 2023-11-08T19:23:25.744 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.739+0000 7f3d4b59e700 1 -- 172.21.15.149:0/3899333030 >> v1:172.21.15.160:6789/0 conn(0x7f3d4c15b950 legacy=0x7f3d4c0ce130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:25.744 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.739+0000 7f3d49d9b700 1 -- 172.21.15.149:0/3899333030 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4169378890 0 0) 0x7f3d340035b0 con 0x7f3d4c0cd5e0 2023-11-08T19:23:25.744 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.739+0000 7f3d4b59e700 1 -- 172.21.15.149:0/3899333030 >> v1:172.21.15.149:6789/0 conn(0x7f3d4c0cd5e0 legacy=0x7f3d4c0cfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:25.744 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.739+0000 7f3d4b59e700 1 -- 172.21.15.149:0/3899333030 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d4c0ccb00 con 0x7f3d4c0ce840 2023-11-08T19:23:25.745 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.739+0000 7f3d4b59e700 1 --2- 172.21.15.149:0/3899333030 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3d4c0ce840 0x7f3d4c0d0430 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3d44009dc0 tx=0x7f3d4400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1f6d654410afc42 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:25.745 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.740+0000 7f3d49d9b700 1 -- 172.21.15.149:0/3899333030 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4400e070 con 0x7f3d4c0ce840 2023-11-08T19:23:25.745 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.740+0000 7f3d49d9b700 1 -- 172.21.15.149:0/3899333030 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d44003a20 con 0x7f3d4c0ce840 2023-11-08T19:23:25.745 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.740+0000 7f3d49d9b700 1 -- 172.21.15.149:0/3899333030 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d40001670 con 0x7f3d4c0ce840 2023-11-08T19:23:25.745 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.740+0000 7f3d51208700 1 -- 172.21.15.149:0/3899333030 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3d4c0ce840 msgr2=0x7f3d4c0d0430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:25.746 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.740+0000 7f3d51208700 1 --2- 172.21.15.149:0/3899333030 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3d4c0ce840 0x7f3d4c0d0430 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3d44009dc0 tx=0x7f3d4400b330 comp rx=0 tx=0).stop 2023-11-08T19:23:25.746 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.740+0000 7f3d51208700 1 -- 172.21.15.149:0/3899333030 shutdown_connections 2023-11-08T19:23:25.746 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.740+0000 7f3d51208700 1 --2- 172.21.15.149:0/3899333030 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3d4c0ce840 0x7f3d4c0d0430 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.746 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.740+0000 7f3d51208700 1 -- 172.21.15.149:0/3899333030 >> 172.21.15.149:0/3899333030 conn(0x7f3d4c08afd0 msgr2=0x7f3d4c0d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:25.746 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.740+0000 7f3d51208700 1 -- 172.21.15.149:0/3899333030 shutdown_connections 2023-11-08T19:23:25.747 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.740+0000 7f3d51208700 1 -- 172.21.15.149:0/3899333030 wait complete. 2023-11-08T19:23:25.751 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.742+0000 7f3d51208700 1 Processor -- start 2023-11-08T19:23:25.752 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.742+0000 7f3d51208700 1 -- start start 2023-11-08T19:23:25.752 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.742+0000 7f3d51208700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d4c0ce840 0x7f3d4c1f66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:25.752 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.742+0000 7f3d51208700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3d4c15b950 0x7f3d4c1f4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:25.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.742+0000 7f3d51208700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3d4c0c93c0 0x7f3d4c0c9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:25.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.742+0000 7f3d51208700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4c0c9d80 con 0x7f3d4c0ce840 2023-11-08T19:23:25.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.742+0000 7f3d51208700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4c06c000 con 0x7f3d4c0c93c0 2023-11-08T19:23:25.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.742+0000 7f3d51208700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4c15c830 con 0x7f3d4c15b950 2023-11-08T19:23:25.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.742+0000 7f3d4ad9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d4c0ce840 0x7f3d4c1f66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:25.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.742+0000 7f3d4ad9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d4c0ce840 0x7f3d4c1f66a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37648/0 (socket says 172.21.15.149:37648) 2023-11-08T19:23:25.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.742+0000 7f3d4ad9d700 1 -- 172.21.15.149:0/455415140 learned_addr learned my addr 172.21.15.149:0/455415140 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:25.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.743+0000 7f3d4a59c700 1 --2- 172.21.15.149:0/455415140 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3d4c15b950 0x7f3d4c1f4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:25.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.743+0000 7f3d4b59e700 1 --2- 172.21.15.149:0/455415140 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3d4c0c93c0 0x7f3d4c0c9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:25.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.743+0000 7f3d4ad9d700 1 -- 172.21.15.149:0/455415140 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3d4c15b950 msgr2=0x7f3d4c1f4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:25.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.743+0000 7f3d4ad9d700 1 --2- 172.21.15.149:0/455415140 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3d4c15b950 0x7f3d4c1f4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.743+0000 7f3d4ad9d700 1 -- 172.21.15.149:0/455415140 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3d4c0c93c0 msgr2=0x7f3d4c0c9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:25.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.743+0000 7f3d4ad9d700 1 --2- 172.21.15.149:0/455415140 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3d4c0c93c0 0x7f3d4c0c9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.743+0000 7f3d4ad9d700 1 -- 172.21.15.149:0/455415140 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d44009a70 con 0x7f3d4c0ce840 2023-11-08T19:23:25.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.743+0000 7f3d4ad9d700 1 --2- 172.21.15.149:0/455415140 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d4c0ce840 0x7f3d4c1f66a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c001f00 tx=0x7f3d3c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:25.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.743+0000 7f3d337fe700 1 -- 172.21.15.149:0/455415140 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3c0052d0 con 0x7f3d4c0ce840 2023-11-08T19:23:25.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.743+0000 7f3d337fe700 1 -- 172.21.15.149:0/455415140 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d3c005430 con 0x7f3d4c0ce840 2023-11-08T19:23:25.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.743+0000 7f3d51208700 1 -- 172.21.15.149:0/455415140 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d4c15ca80 con 0x7f3d4c0ce840 2023-11-08T19:23:25.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.743+0000 7f3d337fe700 1 -- 172.21.15.149:0/455415140 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3c0038f0 con 0x7f3d4c0ce840 2023-11-08T19:23:25.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.743+0000 7f3d51208700 1 -- 172.21.15.149:0/455415140 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d4c15d040 con 0x7f3d4c0ce840 2023-11-08T19:23:25.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.744+0000 7f3d51208700 1 -- 172.21.15.149:0/455415140 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d4c0745f0 con 0x7f3d4c0ce840 2023-11-08T19:23:25.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.744+0000 7f3d337fe700 1 -- 172.21.15.149:0/455415140 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3d3c003a50 con 0x7f3d4c0ce840 2023-11-08T19:23:25.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.745+0000 7f3d337fe700 1 --2- 172.21.15.149:0/455415140 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3d3806af00 0x7f3d3806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:25.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.745+0000 7f3d337fe700 1 -- 172.21.15.149:0/455415140 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3d3c088cc0 con 0x7f3d4c0ce840 2023-11-08T19:23:25.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.745+0000 7f3d4a59c700 1 --2- 172.21.15.149:0/455415140 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3d3806af00 0x7f3d3806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:25.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.745+0000 7f3d4a59c700 1 --2- 172.21.15.149:0/455415140 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3d3806af00 0x7f3d3806d3c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c1f7df0 tx=0x7f3d40001ba0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:25.760 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.750+0000 7f3d337fe700 1 -- 172.21.15.149:0/455415140 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3d3c053b10 con 0x7f3d4c0ce840 2023-11-08T19:23:25.937 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.936+0000 7f3d51208700 1 -- 172.21.15.149:0/455415140 --> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3d4c0c85d0 con 0x7f3d3806af00 2023-11-08T19:23:25.946 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.945+0000 7f3d337fe700 1 -- 172.21.15.149:0/455415140 <== mgr.4104 v2:172.21.15.149:6832/1929837472 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345271 (secure 0 0 0) 0x7f3d4c0c85d0 con 0x7f3d3806af00 2023-11-08T19:23:25.950 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:23:25.953 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.948+0000 7f3d51208700 1 -- 172.21.15.149:0/455415140 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3d3806af00 msgr2=0x7f3d3806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:25.953 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.948+0000 7f3d51208700 1 --2- 172.21.15.149:0/455415140 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3d3806af00 0x7f3d3806d3c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c1f7df0 tx=0x7f3d40001ba0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.953 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.948+0000 7f3d51208700 1 -- 172.21.15.149:0/455415140 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d4c0ce840 msgr2=0x7f3d4c1f66a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:25.953 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.948+0000 7f3d51208700 1 --2- 172.21.15.149:0/455415140 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d4c0ce840 0x7f3d4c1f66a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c001f00 tx=0x7f3d3c00c860 comp rx=0 tx=0).stop 2023-11-08T19:23:25.954 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.948+0000 7f3d51208700 1 -- 172.21.15.149:0/455415140 shutdown_connections 2023-11-08T19:23:25.954 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.948+0000 7f3d51208700 1 --2- 172.21.15.149:0/455415140 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3d3806af00 0x7f3d3806d3c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.954 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.948+0000 7f3d51208700 1 --2- 172.21.15.149:0/455415140 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3d4c0c93c0 0x7f3d4c0c9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.954 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.948+0000 7f3d51208700 1 --2- 172.21.15.149:0/455415140 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d4c0ce840 0x7f3d4c1f66a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.955 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.948+0000 7f3d51208700 1 --2- 172.21.15.149:0/455415140 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3d4c15b950 0x7f3d4c1f4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:25.955 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.948+0000 7f3d51208700 1 -- 172.21.15.149:0/455415140 >> 172.21.15.149:0/455415140 conn(0x7f3d4c08afd0 msgr2=0x7f3d4c1594e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:25.955 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.948+0000 7f3d51208700 1 -- 172.21.15.149:0/455415140 shutdown_connections 2023-11-08T19:23:25.955 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:25.948+0000 7f3d51208700 1 -- 172.21.15.149:0/455415140 wait complete. 2023-11-08T19:23:25.955 INFO:teuthology.orchestra.run.smithi149.stderr:dumped all 2023-11-08T19:23:25.962 INFO:teuthology.orchestra.run.smithi149.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2023-11-08T19:23:23.989799+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219384,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755336,"statfs":{"total":773094113280,"available":772869464064,"internally_reserved":0,"allocated":3284992,"data_stored":1988352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003085"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.640463+0000","last_change":"2023-11-08T19:23:02.552058+0000","last_active":"2023-11-08T19:23:06.640463+0000","last_peered":"2023-11-08T19:23:06.640463+0000","last_clean":"2023-11-08T19:23:06.640463+0000","last_became_active":"2023-11-08T19:23:02.551489+0000","last_became_peered":"2023-11-08T19:23:02.551489+0000","last_unstale":"2023-11-08T19:23:06.640463+0000","last_undegraded":"2023-11-08T19:23:06.640463+0000","last_fullsized":"2023-11-08T19:23:06.640463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:22:41.593963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.564907+0000","last_change":"2023-11-08T19:23:02.538323+0000","last_active":"2023-11-08T19:23:06.564907+0000","last_peered":"2023-11-08T19:23:06.564907+0000","last_clean":"2023-11-08T19:23:06.564907+0000","last_became_active":"2023-11-08T19:23:02.537940+0000","last_became_peered":"2023-11-08T19:23:02.537940+0000","last_unstale":"2023-11-08T19:23:06.564907+0000","last_undegraded":"2023-11-08T19:23:06.564907+0000","last_fullsized":"2023-11-08T19:23:06.564907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:04:20.812993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.578295+0000","last_change":"2023-11-08T19:23:02.536079+0000","last_active":"2023-11-08T19:23:06.578295+0000","last_peered":"2023-11-08T19:23:06.578295+0000","last_clean":"2023-11-08T19:23:06.578295+0000","last_became_active":"2023-11-08T19:23:02.535824+0000","last_became_peered":"2023-11-08T19:23:02.535824+0000","last_unstale":"2023-11-08T19:23:06.578295+0000","last_undegraded":"2023-11-08T19:23:06.578295+0000","last_fullsized":"2023-11-08T19:23:06.578295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:29:40.895783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.575728+0000","last_change":"2023-11-08T19:23:02.540491+0000","last_active":"2023-11-08T19:23:06.575728+0000","last_peered":"2023-11-08T19:23:06.575728+0000","last_clean":"2023-11-08T19:23:06.575728+0000","last_became_active":"2023-11-08T19:23:02.540012+0000","last_became_peered":"2023-11-08T19:23:02.540012+0000","last_unstale":"2023-11-08T19:23:06.575728+0000","last_undegraded":"2023-11-08T19:23:06.575728+0000","last_fullsized":"2023-11-08T19:23:06.575728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:15:23.194339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.639456+0000","last_change":"2023-11-08T19:23:02.544395+0000","last_active":"2023-11-08T19:23:06.639456+0000","last_peered":"2023-11-08T19:23:06.639456+0000","last_clean":"2023-11-08T19:23:06.639456+0000","last_became_active":"2023-11-08T19:23:02.544103+0000","last_became_peered":"2023-11-08T19:23:02.544103+0000","last_unstale":"2023-11-08T19:23:06.639456+0000","last_undegraded":"2023-11-08T19:23:06.639456+0000","last_fullsized":"2023-11-08T19:23:06.639456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:47:36.694344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.575191+0000","last_change":"2023-11-08T19:23:02.545064+0000","last_active":"2023-11-08T19:23:06.575191+0000","last_peered":"2023-11-08T19:23:06.575191+0000","last_clean":"2023-11-08T19:23:06.575191+0000","last_became_active":"2023-11-08T19:23:02.544254+0000","last_became_peered":"2023-11-08T19:23:02.544254+0000","last_unstale":"2023-11-08T19:23:06.575191+0000","last_undegraded":"2023-11-08T19:23:06.575191+0000","last_fullsized":"2023-11-08T19:23:06.575191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:00:48.690189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.637334+0000","last_change":"2023-11-08T19:23:02.542877+0000","last_active":"2023-11-08T19:23:06.637334+0000","last_peered":"2023-11-08T19:23:06.637334+0000","last_clean":"2023-11-08T19:23:06.637334+0000","last_became_active":"2023-11-08T19:23:02.542587+0000","last_became_peered":"2023-11-08T19:23:02.542587+0000","last_unstale":"2023-11-08T19:23:06.637334+0000","last_undegraded":"2023-11-08T19:23:06.637334+0000","last_fullsized":"2023-11-08T19:23:06.637334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:15:23.194339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.571114+0000","last_change":"2023-11-08T19:23:02.537658+0000","last_active":"2023-11-08T19:23:06.571114+0000","last_peered":"2023-11-08T19:23:06.571114+0000","last_clean":"2023-11-08T19:23:06.571114+0000","last_became_active":"2023-11-08T19:23:02.537389+0000","last_became_peered":"2023-11-08T19:23:02.537389+0000","last_unstale":"2023-11-08T19:23:06.571114+0000","last_undegraded":"2023-11-08T19:23:06.571114+0000","last_fullsized":"2023-11-08T19:23:06.571114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:29:40.895783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.640351+0000","last_change":"2023-11-08T19:23:02.551031+0000","last_active":"2023-11-08T19:23:06.640351+0000","last_peered":"2023-11-08T19:23:06.640351+0000","last_clean":"2023-11-08T19:23:06.640351+0000","last_became_active":"2023-11-08T19:23:02.550631+0000","last_became_peered":"2023-11-08T19:23:02.550631+0000","last_unstale":"2023-11-08T19:23:06.640351+0000","last_undegraded":"2023-11-08T19:23:06.640351+0000","last_fullsized":"2023-11-08T19:23:06.640351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:02:18.865355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.566140+0000","last_change":"2023-11-08T19:23:02.539521+0000","last_active":"2023-11-08T19:23:06.566140+0000","last_peered":"2023-11-08T19:23:06.566140+0000","last_clean":"2023-11-08T19:23:06.566140+0000","last_became_active":"2023-11-08T19:23:02.539252+0000","last_became_peered":"2023-11-08T19:23:02.539252+0000","last_unstale":"2023-11-08T19:23:06.566140+0000","last_undegraded":"2023-11-08T19:23:06.566140+0000","last_fullsized":"2023-11-08T19:23:06.566140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:44:38.109774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.565944+0000","last_change":"2023-11-08T19:23:02.548230+0000","last_active":"2023-11-08T19:23:06.565944+0000","last_peered":"2023-11-08T19:23:06.565944+0000","last_clean":"2023-11-08T19:23:06.565944+0000","last_became_active":"2023-11-08T19:23:02.547980+0000","last_became_peered":"2023-11-08T19:23:02.547980+0000","last_unstale":"2023-11-08T19:23:06.565944+0000","last_undegraded":"2023-11-08T19:23:06.565944+0000","last_fullsized":"2023-11-08T19:23:06.565944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:24:27.669240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.569454+0000","last_change":"2023-11-08T19:23:02.550957+0000","last_active":"2023-11-08T19:23:06.569454+0000","last_peered":"2023-11-08T19:23:06.569454+0000","last_clean":"2023-11-08T19:23:06.569454+0000","last_became_active":"2023-11-08T19:23:02.550071+0000","last_became_peered":"2023-11-08T19:23:02.550071+0000","last_unstale":"2023-11-08T19:23:06.569454+0000","last_undegraded":"2023-11-08T19:23:06.569454+0000","last_fullsized":"2023-11-08T19:23:06.569454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:08:24.771220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.573212+0000","last_change":"2023-11-08T19:23:02.547356+0000","last_active":"2023-11-08T19:23:06.573212+0000","last_peered":"2023-11-08T19:23:06.573212+0000","last_clean":"2023-11-08T19:23:06.573212+0000","last_became_active":"2023-11-08T19:23:02.546568+0000","last_became_peered":"2023-11-08T19:23:02.546568+0000","last_unstale":"2023-11-08T19:23:06.573212+0000","last_undegraded":"2023-11-08T19:23:06.573212+0000","last_fullsized":"2023-11-08T19:23:06.573212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:49:46.796904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.580399+0000","last_change":"2023-11-08T19:23:02.538938+0000","last_active":"2023-11-08T19:23:06.580399+0000","last_peered":"2023-11-08T19:23:06.580399+0000","last_clean":"2023-11-08T19:23:06.580399+0000","last_became_active":"2023-11-08T19:23:02.538598+0000","last_became_peered":"2023-11-08T19:23:02.538598+0000","last_unstale":"2023-11-08T19:23:06.580399+0000","last_undegraded":"2023-11-08T19:23:06.580399+0000","last_fullsized":"2023-11-08T19:23:06.580399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:52:27.899698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.563911+0000","last_change":"2023-11-08T19:23:02.543136+0000","last_active":"2023-11-08T19:23:06.563911+0000","last_peered":"2023-11-08T19:23:06.563911+0000","last_clean":"2023-11-08T19:23:06.563911+0000","last_became_active":"2023-11-08T19:23:02.542868+0000","last_became_peered":"2023-11-08T19:23:02.542868+0000","last_unstale":"2023-11-08T19:23:06.563911+0000","last_undegraded":"2023-11-08T19:23:06.563911+0000","last_fullsized":"2023-11-08T19:23:06.563911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:49:46.796904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.574507+0000","last_change":"2023-11-08T19:23:02.541251+0000","last_active":"2023-11-08T19:23:06.574507+0000","last_peered":"2023-11-08T19:23:06.574507+0000","last_clean":"2023-11-08T19:23:06.574507+0000","last_became_active":"2023-11-08T19:23:02.540921+0000","last_became_peered":"2023-11-08T19:23:02.540921+0000","last_unstale":"2023-11-08T19:23:06.574507+0000","last_undegraded":"2023-11-08T19:23:06.574507+0000","last_fullsized":"2023-11-08T19:23:06.574507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:32:49.846143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.576611+0000","last_change":"2023-11-08T19:23:02.543682+0000","last_active":"2023-11-08T19:23:06.576611+0000","last_peered":"2023-11-08T19:23:06.576611+0000","last_clean":"2023-11-08T19:23:06.576611+0000","last_became_active":"2023-11-08T19:23:02.543385+0000","last_became_peered":"2023-11-08T19:23:02.543385+0000","last_unstale":"2023-11-08T19:23:06.576611+0000","last_undegraded":"2023-11-08T19:23:06.576611+0000","last_fullsized":"2023-11-08T19:23:06.576611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:47:36.694344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.575179+0000","last_change":"2023-11-08T19:23:02.547263+0000","last_active":"2023-11-08T19:23:06.575179+0000","last_peered":"2023-11-08T19:23:06.575179+0000","last_clean":"2023-11-08T19:23:06.575179+0000","last_became_active":"2023-11-08T19:23:02.546954+0000","last_became_peered":"2023-11-08T19:23:02.546954+0000","last_unstale":"2023-11-08T19:23:06.575179+0000","last_undegraded":"2023-11-08T19:23:06.575179+0000","last_fullsized":"2023-11-08T19:23:06.575179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:08:24.771220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.639865+0000","last_change":"2023-11-08T19:23:02.544942+0000","last_active":"2023-11-08T19:23:06.639865+0000","last_peered":"2023-11-08T19:23:06.639865+0000","last_clean":"2023-11-08T19:23:06.639865+0000","last_became_active":"2023-11-08T19:23:02.544398+0000","last_became_peered":"2023-11-08T19:23:02.544398+0000","last_unstale":"2023-11-08T19:23:06.639865+0000","last_undegraded":"2023-11-08T19:23:06.639865+0000","last_fullsized":"2023-11-08T19:23:06.639865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:11:14.699967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.015793+0000","last_change":"2023-11-08T19:23:06.643772+0000","last_active":"2023-11-08T19:23:09.015793+0000","last_peered":"2023-11-08T19:23:09.015793+0000","last_clean":"2023-11-08T19:23:09.015793+0000","last_became_active":"2023-11-08T19:23:06.643399+0000","last_became_peered":"2023-11-08T19:23:06.643399+0000","last_unstale":"2023-11-08T19:23:09.015793+0000","last_undegraded":"2023-11-08T19:23:09.015793+0000","last_fullsized":"2023-11-08T19:23:09.015793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:28:31.147987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.579108+0000","last_change":"2023-11-08T19:23:01.541807+0000","last_active":"2023-11-08T19:23:06.579108+0000","last_peered":"2023-11-08T19:23:06.579108+0000","last_clean":"2023-11-08T19:23:06.579108+0000","last_became_active":"2023-11-08T19:23:01.541518+0000","last_became_peered":"2023-11-08T19:23:01.541518+0000","last_unstale":"2023-11-08T19:23:06.579108+0000","last_undegraded":"2023-11-08T19:23:06.579108+0000","last_fullsized":"2023-11-08T19:23:06.579108+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:44:28.225190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.571988+0000","last_change":"2023-11-08T19:23:02.546804+0000","last_active":"2023-11-08T19:23:06.571988+0000","last_peered":"2023-11-08T19:23:06.571988+0000","last_clean":"2023-11-08T19:23:06.571988+0000","last_became_active":"2023-11-08T19:23:02.546539+0000","last_became_peered":"2023-11-08T19:23:02.546539+0000","last_unstale":"2023-11-08T19:23:06.571988+0000","last_undegraded":"2023-11-08T19:23:06.571988+0000","last_fullsized":"2023-11-08T19:23:06.571988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:11:14.699967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:07.567784+0000","last_change":"2023-11-08T19:23:06.590879+0000","last_active":"2023-11-08T19:23:07.567784+0000","last_peered":"2023-11-08T19:23:07.567784+0000","last_clean":"2023-11-08T19:23:07.567784+0000","last_became_active":"2023-11-08T19:23:06.590413+0000","last_became_peered":"2023-11-08T19:23:06.590413+0000","last_unstale":"2023-11-08T19:23:07.567784+0000","last_undegraded":"2023-11-08T19:23:07.567784+0000","last_fullsized":"2023-11-08T19:23:07.567784+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:07:43.895729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.572075+0000","last_change":"2023-11-08T19:23:01.539505+0000","last_active":"2023-11-08T19:23:06.572075+0000","last_peered":"2023-11-08T19:23:06.572075+0000","last_clean":"2023-11-08T19:23:06.572075+0000","last_became_active":"2023-11-08T19:23:01.539253+0000","last_became_peered":"2023-11-08T19:23:01.539253+0000","last_unstale":"2023-11-08T19:23:06.572075+0000","last_undegraded":"2023-11-08T19:23:06.572075+0000","last_fullsized":"2023-11-08T19:23:06.572075+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:43:54.669075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.578908+0000","last_change":"2023-11-08T19:23:02.541207+0000","last_active":"2023-11-08T19:23:06.578908+0000","last_peered":"2023-11-08T19:23:06.578908+0000","last_clean":"2023-11-08T19:23:06.578908+0000","last_became_active":"2023-11-08T19:23:02.541002+0000","last_became_peered":"2023-11-08T19:23:02.541002+0000","last_unstale":"2023-11-08T19:23:06.578908+0000","last_undegraded":"2023-11-08T19:23:06.578908+0000","last_fullsized":"2023-11-08T19:23:06.578908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:49:46.796904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:07.568103+0000","last_change":"2023-11-08T19:23:06.586229+0000","last_active":"2023-11-08T19:23:07.568103+0000","last_peered":"2023-11-08T19:23:07.568103+0000","last_clean":"2023-11-08T19:23:07.568103+0000","last_became_active":"2023-11-08T19:23:06.585784+0000","last_became_peered":"2023-11-08T19:23:06.585784+0000","last_unstale":"2023-11-08T19:23:07.568103+0000","last_undegraded":"2023-11-08T19:23:07.568103+0000","last_fullsized":"2023-11-08T19:23:07.568103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:47:40.737231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.639721+0000","last_change":"2023-11-08T19:23:01.541701+0000","last_active":"2023-11-08T19:23:06.639721+0000","last_peered":"2023-11-08T19:23:06.639721+0000","last_clean":"2023-11-08T19:23:06.639721+0000","last_became_active":"2023-11-08T19:23:01.541392+0000","last_became_peered":"2023-11-08T19:23:01.541392+0000","last_unstale":"2023-11-08T19:23:06.639721+0000","last_undegraded":"2023-11-08T19:23:06.639721+0000","last_fullsized":"2023-11-08T19:23:06.639721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:57:50.009215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.575956+0000","last_change":"2023-11-08T19:23:02.543734+0000","last_active":"2023-11-08T19:23:06.575956+0000","last_peered":"2023-11-08T19:23:06.575956+0000","last_clean":"2023-11-08T19:23:06.575956+0000","last_became_active":"2023-11-08T19:23:02.543300+0000","last_became_peered":"2023-11-08T19:23:02.543300+0000","last_unstale":"2023-11-08T19:23:06.575956+0000","last_undegraded":"2023-11-08T19:23:06.575956+0000","last_fullsized":"2023-11-08T19:23:06.575956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:50:33.507433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:07.566641+0000","last_change":"2023-11-08T19:23:06.590258+0000","last_active":"2023-11-08T19:23:07.566641+0000","last_peered":"2023-11-08T19:23:07.566641+0000","last_clean":"2023-11-08T19:23:07.566641+0000","last_became_active":"2023-11-08T19:23:06.589825+0000","last_became_peered":"2023-11-08T19:23:06.589825+0000","last_unstale":"2023-11-08T19:23:07.566641+0000","last_undegraded":"2023-11-08T19:23:07.566641+0000","last_fullsized":"2023-11-08T19:23:07.566641+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:56:06.637086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.640110+0000","last_change":"2023-11-08T19:23:01.543094+0000","last_active":"2023-11-08T19:23:06.640110+0000","last_peered":"2023-11-08T19:23:06.640110+0000","last_clean":"2023-11-08T19:23:06.640110+0000","last_became_active":"2023-11-08T19:23:01.542832+0000","last_became_peered":"2023-11-08T19:23:01.542832+0000","last_unstale":"2023-11-08T19:23:06.640110+0000","last_undegraded":"2023-11-08T19:23:06.640110+0000","last_fullsized":"2023-11-08T19:23:06.640110+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:08:23.765251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.575939+0000","last_change":"2023-11-08T19:23:02.543389+0000","last_active":"2023-11-08T19:23:06.575939+0000","last_peered":"2023-11-08T19:23:06.575939+0000","last_clean":"2023-11-08T19:23:06.575939+0000","last_became_active":"2023-11-08T19:23:02.543095+0000","last_became_peered":"2023-11-08T19:23:02.543095+0000","last_unstale":"2023-11-08T19:23:06.575939+0000","last_undegraded":"2023-11-08T19:23:06.575939+0000","last_fullsized":"2023-11-08T19:23:06.575939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:44:38.109774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.015608+0000","last_change":"2023-11-08T19:23:06.590901+0000","last_active":"2023-11-08T19:23:09.015608+0000","last_peered":"2023-11-08T19:23:09.015608+0000","last_clean":"2023-11-08T19:23:09.015608+0000","last_became_active":"2023-11-08T19:23:06.590468+0000","last_became_peered":"2023-11-08T19:23:06.590468+0000","last_unstale":"2023-11-08T19:23:09.015608+0000","last_undegraded":"2023-11-08T19:23:09.015608+0000","last_fullsized":"2023-11-08T19:23:09.015608+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:58:51.442881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.573313+0000","last_change":"2023-11-08T19:23:01.540429+0000","last_active":"2023-11-08T19:23:06.573313+0000","last_peered":"2023-11-08T19:23:06.573313+0000","last_clean":"2023-11-08T19:23:06.573313+0000","last_became_active":"2023-11-08T19:23:01.540170+0000","last_became_peered":"2023-11-08T19:23:01.540170+0000","last_unstale":"2023-11-08T19:23:06.573313+0000","last_undegraded":"2023-11-08T19:23:06.573313+0000","last_fullsized":"2023-11-08T19:23:06.573313+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:52:26.893730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.572037+0000","last_change":"2023-11-08T19:23:02.550930+0000","last_active":"2023-11-08T19:23:06.572037+0000","last_peered":"2023-11-08T19:23:06.572037+0000","last_clean":"2023-11-08T19:23:06.572037+0000","last_became_active":"2023-11-08T19:23:02.549412+0000","last_became_peered":"2023-11-08T19:23:02.549412+0000","last_unstale":"2023-11-08T19:23:06.572037+0000","last_undegraded":"2023-11-08T19:23:06.572037+0000","last_fullsized":"2023-11-08T19:23:06.572037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:07:17.652260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:07.565865+0000","last_change":"2023-11-08T19:23:06.593062+0000","last_active":"2023-11-08T19:23:07.565865+0000","last_peered":"2023-11-08T19:23:07.565865+0000","last_clean":"2023-11-08T19:23:07.565865+0000","last_became_active":"2023-11-08T19:23:06.592681+0000","last_became_peered":"2023-11-08T19:23:06.592681+0000","last_unstale":"2023-11-08T19:23:07.565865+0000","last_undegraded":"2023-11-08T19:23:07.565865+0000","last_fullsized":"2023-11-08T19:23:07.565865+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:43:59.717931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.565314+0000","last_change":"2023-11-08T19:23:01.532560+0000","last_active":"2023-11-08T19:23:06.565314+0000","last_peered":"2023-11-08T19:23:06.565314+0000","last_clean":"2023-11-08T19:23:06.565314+0000","last_became_active":"2023-11-08T19:23:01.532281+0000","last_became_peered":"2023-11-08T19:23:01.532281+0000","last_unstale":"2023-11-08T19:23:06.565314+0000","last_undegraded":"2023-11-08T19:23:06.565314+0000","last_fullsized":"2023-11-08T19:23:06.565314+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:43:54.669075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.579248+0000","last_change":"2023-11-08T19:23:02.536527+0000","last_active":"2023-11-08T19:23:06.579248+0000","last_peered":"2023-11-08T19:23:06.579248+0000","last_clean":"2023-11-08T19:23:06.579248+0000","last_became_active":"2023-11-08T19:23:02.535739+0000","last_became_peered":"2023-11-08T19:23:02.535739+0000","last_unstale":"2023-11-08T19:23:06.579248+0000","last_undegraded":"2023-11-08T19:23:06.579248+0000","last_fullsized":"2023-11-08T19:23:06.579248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:04:20.812993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:07.567254+0000","last_change":"2023-11-08T19:23:06.586558+0000","last_active":"2023-11-08T19:23:07.567254+0000","last_peered":"2023-11-08T19:23:07.567254+0000","last_clean":"2023-11-08T19:23:07.567254+0000","last_became_active":"2023-11-08T19:23:06.586151+0000","last_became_peered":"2023-11-08T19:23:06.586151+0000","last_unstale":"2023-11-08T19:23:07.567254+0000","last_undegraded":"2023-11-08T19:23:07.567254+0000","last_fullsized":"2023-11-08T19:23:07.567254+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:57:36.344289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.570862+0000","last_change":"2023-11-08T19:23:01.535020+0000","last_active":"2023-11-08T19:23:06.570862+0000","last_peered":"2023-11-08T19:23:06.570862+0000","last_clean":"2023-11-08T19:23:06.570862+0000","last_became_active":"2023-11-08T19:23:01.534728+0000","last_became_peered":"2023-11-08T19:23:01.534728+0000","last_unstale":"2023-11-08T19:23:06.570862+0000","last_undegraded":"2023-11-08T19:23:06.570862+0000","last_fullsized":"2023-11-08T19:23:06.570862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:08:23.765251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.570908+0000","last_change":"2023-11-08T19:23:02.531826+0000","last_active":"2023-11-08T19:23:06.570908+0000","last_peered":"2023-11-08T19:23:06.570908+0000","last_clean":"2023-11-08T19:23:06.570908+0000","last_became_active":"2023-11-08T19:23:02.530174+0000","last_became_peered":"2023-11-08T19:23:02.530174+0000","last_unstale":"2023-11-08T19:23:06.570908+0000","last_undegraded":"2023-11-08T19:23:06.570908+0000","last_fullsized":"2023-11-08T19:23:06.570908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:57:51.015184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.014696+0000","last_change":"2023-11-08T19:23:06.641030+0000","last_active":"2023-11-08T19:23:09.014696+0000","last_peered":"2023-11-08T19:23:09.014696+0000","last_clean":"2023-11-08T19:23:09.014696+0000","last_became_active":"2023-11-08T19:23:06.640656+0000","last_became_peered":"2023-11-08T19:23:06.640656+0000","last_unstale":"2023-11-08T19:23:09.014696+0000","last_undegraded":"2023-11-08T19:23:09.014696+0000","last_fullsized":"2023-11-08T19:23:09.014696+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:12:02.136296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.574607+0000","last_change":"2023-11-08T19:23:01.529713+0000","last_active":"2023-11-08T19:23:06.574607+0000","last_peered":"2023-11-08T19:23:06.574607+0000","last_clean":"2023-11-08T19:23:06.574607+0000","last_became_active":"2023-11-08T19:23:01.528648+0000","last_became_peered":"2023-11-08T19:23:01.528648+0000","last_unstale":"2023-11-08T19:23:06.574607+0000","last_undegraded":"2023-11-08T19:23:06.574607+0000","last_fullsized":"2023-11-08T19:23:06.574607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:01:16.688194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.564020+0000","last_change":"2023-11-08T19:23:02.535673+0000","last_active":"2023-11-08T19:23:06.564020+0000","last_peered":"2023-11-08T19:23:06.564020+0000","last_clean":"2023-11-08T19:23:06.564020+0000","last_became_active":"2023-11-08T19:23:02.535411+0000","last_became_peered":"2023-11-08T19:23:02.535411+0000","last_unstale":"2023-11-08T19:23:06.564020+0000","last_undegraded":"2023-11-08T19:23:06.564020+0000","last_fullsized":"2023-11-08T19:23:06.564020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:56:02.594198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.015406+0000","last_change":"2023-11-08T19:23:06.643953+0000","last_active":"2023-11-08T19:23:09.015406+0000","last_peered":"2023-11-08T19:23:09.015406+0000","last_clean":"2023-11-08T19:23:09.015406+0000","last_became_active":"2023-11-08T19:23:06.643457+0000","last_became_peered":"2023-11-08T19:23:06.643457+0000","last_unstale":"2023-11-08T19:23:09.015406+0000","last_undegraded":"2023-11-08T19:23:09.015406+0000","last_fullsized":"2023-11-08T19:23:09.015406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:04:23.883480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.569588+0000","last_change":"2023-11-08T19:23:01.535403+0000","last_active":"2023-11-08T19:23:06.569588+0000","last_peered":"2023-11-08T19:23:06.569588+0000","last_clean":"2023-11-08T19:23:06.569588+0000","last_became_active":"2023-11-08T19:23:01.535102+0000","last_became_peered":"2023-11-08T19:23:01.535102+0000","last_unstale":"2023-11-08T19:23:06.569588+0000","last_undegraded":"2023-11-08T19:23:06.569588+0000","last_fullsized":"2023-11-08T19:23:06.569588+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:55.765637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.575598+0000","last_change":"2023-11-08T19:23:02.543531+0000","last_active":"2023-11-08T19:23:06.575598+0000","last_peered":"2023-11-08T19:23:06.575598+0000","last_clean":"2023-11-08T19:23:06.575598+0000","last_became_active":"2023-11-08T19:23:02.543160+0000","last_became_peered":"2023-11-08T19:23:02.543160+0000","last_unstale":"2023-11-08T19:23:06.575598+0000","last_undegraded":"2023-11-08T19:23:06.575598+0000","last_fullsized":"2023-11-08T19:23:06.575598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:04:20.812993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.014869+0000","last_change":"2023-11-08T19:23:06.589913+0000","last_active":"2023-11-08T19:23:09.014869+0000","last_peered":"2023-11-08T19:23:09.014869+0000","last_clean":"2023-11-08T19:23:09.014869+0000","last_became_active":"2023-11-08T19:23:06.589510+0000","last_became_peered":"2023-11-08T19:23:06.589510+0000","last_unstale":"2023-11-08T19:23:09.014869+0000","last_undegraded":"2023-11-08T19:23:09.014869+0000","last_fullsized":"2023-11-08T19:23:09.014869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:14:35.302430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.575682+0000","last_change":"2023-11-08T19:23:01.533936+0000","last_active":"2023-11-08T19:23:06.575682+0000","last_peered":"2023-11-08T19:23:06.575682+0000","last_clean":"2023-11-08T19:23:06.575682+0000","last_became_active":"2023-11-08T19:23:01.533445+0000","last_became_peered":"2023-11-08T19:23:01.533445+0000","last_unstale":"2023-11-08T19:23:06.575682+0000","last_undegraded":"2023-11-08T19:23:06.575682+0000","last_fullsized":"2023-11-08T19:23:06.575682+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:24:26.663271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.579037+0000","last_change":"2023-11-08T19:23:02.541241+0000","last_active":"2023-11-08T19:23:06.579037+0000","last_peered":"2023-11-08T19:23:06.579037+0000","last_clean":"2023-11-08T19:23:06.579037+0000","last_became_active":"2023-11-08T19:23:02.540969+0000","last_became_peered":"2023-11-08T19:23:02.540969+0000","last_unstale":"2023-11-08T19:23:06.579037+0000","last_undegraded":"2023-11-08T19:23:06.579037+0000","last_fullsized":"2023-11-08T19:23:06.579037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:32:49.846143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:07.568360+0000","last_change":"2023-11-08T19:23:06.585996+0000","last_active":"2023-11-08T19:23:07.568360+0000","last_peered":"2023-11-08T19:23:07.568360+0000","last_clean":"2023-11-08T19:23:07.568360+0000","last_became_active":"2023-11-08T19:23:06.585579+0000","last_became_peered":"2023-11-08T19:23:06.585579+0000","last_unstale":"2023-11-08T19:23:07.568360+0000","last_undegraded":"2023-11-08T19:23:07.568360+0000","last_fullsized":"2023-11-08T19:23:07.568360+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:00:52.733076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.565054+0000","last_change":"2023-11-08T19:23:01.536963+0000","last_active":"2023-11-08T19:23:06.565054+0000","last_peered":"2023-11-08T19:23:06.565054+0000","last_clean":"2023-11-08T19:23:06.565054+0000","last_became_active":"2023-11-08T19:23:01.536702+0000","last_became_peered":"2023-11-08T19:23:01.536702+0000","last_unstale":"2023-11-08T19:23:06.565054+0000","last_undegraded":"2023-11-08T19:23:06.565054+0000","last_fullsized":"2023-11-08T19:23:06.565054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:08:23.765251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.569403+0000","last_change":"2023-11-08T19:23:02.544062+0000","last_active":"2023-11-08T19:23:06.569403+0000","last_peered":"2023-11-08T19:23:06.569403+0000","last_clean":"2023-11-08T19:23:06.569403+0000","last_became_active":"2023-11-08T19:23:02.543731+0000","last_became_peered":"2023-11-08T19:23:02.543731+0000","last_unstale":"2023-11-08T19:23:06.569403+0000","last_undegraded":"2023-11-08T19:23:06.569403+0000","last_fullsized":"2023-11-08T19:23:06.569403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:47:08.776316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.014631+0000","last_change":"2023-11-08T19:23:06.586643+0000","last_active":"2023-11-08T19:23:09.014631+0000","last_peered":"2023-11-08T19:23:09.014631+0000","last_clean":"2023-11-08T19:23:09.014631+0000","last_became_active":"2023-11-08T19:23:06.586257+0000","last_became_peered":"2023-11-08T19:23:06.586257+0000","last_unstale":"2023-11-08T19:23:09.014631+0000","last_undegraded":"2023-11-08T19:23:09.014631+0000","last_fullsized":"2023-11-08T19:23:09.014631+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:22:45.636851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"24'10","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:17.837099+0000","last_change":"2023-11-08T19:23:01.537108+0000","last_active":"2023-11-08T19:23:17.837099+0000","last_peered":"2023-11-08T19:23:17.837099+0000","last_clean":"2023-11-08T19:23:17.837099+0000","last_became_active":"2023-11-08T19:23:01.536695+0000","last_became_peered":"2023-11-08T19:23:01.536695+0000","last_unstale":"2023-11-08T19:23:17.837099+0000","last_undegraded":"2023-11-08T19:23:17.837099+0000","last_fullsized":"2023-11-08T19:23:17.837099+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:49:45.790935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.639812+0000","last_change":"2023-11-08T19:23:02.544703+0000","last_active":"2023-11-08T19:23:06.639812+0000","last_peered":"2023-11-08T19:23:06.639812+0000","last_clean":"2023-11-08T19:23:06.639812+0000","last_became_active":"2023-11-08T19:23:02.543964+0000","last_became_peered":"2023-11-08T19:23:02.543964+0000","last_unstale":"2023-11-08T19:23:06.639812+0000","last_undegraded":"2023-11-08T19:23:06.639812+0000","last_fullsized":"2023-11-08T19:23:06.639812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:07:39.852842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.015350+0000","last_change":"2023-11-08T19:23:06.639882+0000","last_active":"2023-11-08T19:23:09.015350+0000","last_peered":"2023-11-08T19:23:09.015350+0000","last_clean":"2023-11-08T19:23:09.015350+0000","last_became_active":"2023-11-08T19:23:06.639513+0000","last_became_peered":"2023-11-08T19:23:06.639513+0000","last_unstale":"2023-11-08T19:23:09.015350+0000","last_undegraded":"2023-11-08T19:23:09.015350+0000","last_fullsized":"2023-11-08T19:23:09.015350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:04:23.883480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.579599+0000","last_change":"2023-11-08T19:23:01.542024+0000","last_active":"2023-11-08T19:23:06.579599+0000","last_peered":"2023-11-08T19:23:06.579599+0000","last_clean":"2023-11-08T19:23:06.579599+0000","last_became_active":"2023-11-08T19:23:01.541307+0000","last_became_peered":"2023-11-08T19:23:01.541307+0000","last_unstale":"2023-11-08T19:23:06.579599+0000","last_undegraded":"2023-11-08T19:23:06.579599+0000","last_fullsized":"2023-11-08T19:23:06.579599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:07:16.646292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.580444+0000","last_change":"2023-11-08T19:23:02.543049+0000","last_active":"2023-11-08T19:23:06.580444+0000","last_peered":"2023-11-08T19:23:06.580444+0000","last_clean":"2023-11-08T19:23:06.580444+0000","last_became_active":"2023-11-08T19:23:02.542652+0000","last_became_peered":"2023-11-08T19:23:02.542652+0000","last_unstale":"2023-11-08T19:23:06.580444+0000","last_undegraded":"2023-11-08T19:23:06.580444+0000","last_fullsized":"2023-11-08T19:23:06.580444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:43:55.675044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.015406+0000","last_change":"2023-11-08T19:23:06.640235+0000","last_active":"2023-11-08T19:23:09.015406+0000","last_peered":"2023-11-08T19:23:09.015406+0000","last_clean":"2023-11-08T19:23:09.015406+0000","last_became_active":"2023-11-08T19:23:06.639813+0000","last_became_peered":"2023-11-08T19:23:06.639813+0000","last_unstale":"2023-11-08T19:23:09.015406+0000","last_undegraded":"2023-11-08T19:23:09.015406+0000","last_fullsized":"2023-11-08T19:23:09.015406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:11:17.824585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.574994+0000","last_change":"2023-11-08T19:23:01.537071+0000","last_active":"2023-11-08T19:23:06.574994+0000","last_peered":"2023-11-08T19:23:06.574994+0000","last_clean":"2023-11-08T19:23:06.574994+0000","last_became_active":"2023-11-08T19:23:01.536098+0000","last_became_peered":"2023-11-08T19:23:01.536098+0000","last_unstale":"2023-11-08T19:23:06.574994+0000","last_undegraded":"2023-11-08T19:23:06.574994+0000","last_fullsized":"2023-11-08T19:23:06.574994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:57:50.009215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.640434+0000","last_change":"2023-11-08T19:23:02.543183+0000","last_active":"2023-11-08T19:23:06.640434+0000","last_peered":"2023-11-08T19:23:06.640434+0000","last_clean":"2023-11-08T19:23:06.640434+0000","last_became_active":"2023-11-08T19:23:02.542928+0000","last_became_peered":"2023-11-08T19:23:02.542928+0000","last_unstale":"2023-11-08T19:23:06.640434+0000","last_undegraded":"2023-11-08T19:23:06.640434+0000","last_fullsized":"2023-11-08T19:23:06.640434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:11:58.093408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.015907+0000","last_change":"2023-11-08T19:23:06.642851+0000","last_active":"2023-11-08T19:23:09.015907+0000","last_peered":"2023-11-08T19:23:09.015907+0000","last_clean":"2023-11-08T19:23:09.015907+0000","last_became_active":"2023-11-08T19:23:06.642494+0000","last_became_peered":"2023-11-08T19:23:06.642494+0000","last_unstale":"2023-11-08T19:23:09.015907+0000","last_undegraded":"2023-11-08T19:23:09.015907+0000","last_fullsized":"2023-11-08T19:23:09.015907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:56:41.083975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.565079+0000","last_change":"2023-11-08T19:23:01.531395+0000","last_active":"2023-11-08T19:23:06.565079+0000","last_peered":"2023-11-08T19:23:06.565079+0000","last_clean":"2023-11-08T19:23:06.565079+0000","last_became_active":"2023-11-08T19:23:01.531114+0000","last_became_peered":"2023-11-08T19:23:01.531114+0000","last_unstale":"2023-11-08T19:23:06.565079+0000","last_undegraded":"2023-11-08T19:23:06.565079+0000","last_fullsized":"2023-11-08T19:23:06.565079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:28:21.147246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.565518+0000","last_change":"2023-11-08T19:23:02.539528+0000","last_active":"2023-11-08T19:23:06.565518+0000","last_peered":"2023-11-08T19:23:06.565518+0000","last_clean":"2023-11-08T19:23:06.565518+0000","last_became_active":"2023-11-08T19:23:02.539287+0000","last_became_peered":"2023-11-08T19:23:02.539287+0000","last_unstale":"2023-11-08T19:23:06.565518+0000","last_undegraded":"2023-11-08T19:23:06.565518+0000","last_fullsized":"2023-11-08T19:23:06.565518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:57:51.015184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.014311+0000","last_change":"2023-11-08T19:23:06.592797+0000","last_active":"2023-11-08T19:23:09.014311+0000","last_peered":"2023-11-08T19:23:09.014311+0000","last_clean":"2023-11-08T19:23:09.014311+0000","last_became_active":"2023-11-08T19:23:06.592322+0000","last_became_peered":"2023-11-08T19:23:06.592322+0000","last_unstale":"2023-11-08T19:23:09.014311+0000","last_undegraded":"2023-11-08T19:23:09.014311+0000","last_fullsized":"2023-11-08T19:23:09.014311+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:00:52.733076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.571985+0000","last_change":"2023-11-08T19:23:01.534386+0000","last_active":"2023-11-08T19:23:06.571985+0000","last_peered":"2023-11-08T19:23:06.571985+0000","last_clean":"2023-11-08T19:23:06.571985+0000","last_became_active":"2023-11-08T19:23:01.534065+0000","last_became_peered":"2023-11-08T19:23:01.534065+0000","last_unstale":"2023-11-08T19:23:06.571985+0000","last_undegraded":"2023-11-08T19:23:06.571985+0000","last_fullsized":"2023-11-08T19:23:06.571985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:27:47.069795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.638816+0000","last_change":"2023-11-08T19:23:02.542014+0000","last_active":"2023-11-08T19:23:06.638816+0000","last_peered":"2023-11-08T19:23:06.638816+0000","last_clean":"2023-11-08T19:23:06.638816+0000","last_became_active":"2023-11-08T19:23:02.541699+0000","last_became_peered":"2023-11-08T19:23:02.541699+0000","last_unstale":"2023-11-08T19:23:06.638816+0000","last_undegraded":"2023-11-08T19:23:06.638816+0000","last_fullsized":"2023-11-08T19:23:06.638816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:58:59.199208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:07.567280+0000","last_change":"2023-11-08T19:23:06.581489+0000","last_active":"2023-11-08T19:23:07.567280+0000","last_peered":"2023-11-08T19:23:07.567280+0000","last_clean":"2023-11-08T19:23:07.567280+0000","last_became_active":"2023-11-08T19:23:06.581010+0000","last_became_peered":"2023-11-08T19:23:06.581010+0000","last_unstale":"2023-11-08T19:23:07.567280+0000","last_undegraded":"2023-11-08T19:23:07.567280+0000","last_fullsized":"2023-11-08T19:23:07.567280+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:44:42.152662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.572396+0000","last_change":"2023-11-08T19:23:01.539745+0000","last_active":"2023-11-08T19:23:06.572396+0000","last_peered":"2023-11-08T19:23:06.572396+0000","last_clean":"2023-11-08T19:23:06.572396+0000","last_became_active":"2023-11-08T19:23:01.539413+0000","last_became_peered":"2023-11-08T19:23:01.539413+0000","last_unstale":"2023-11-08T19:23:06.572396+0000","last_undegraded":"2023-11-08T19:23:06.572396+0000","last_fullsized":"2023-11-08T19:23:06.572396+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:29:59.299789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.640045+0000","last_change":"2023-11-08T19:23:02.551120+0000","last_active":"2023-11-08T19:23:06.640045+0000","last_peered":"2023-11-08T19:23:06.640045+0000","last_clean":"2023-11-08T19:23:06.640045+0000","last_became_active":"2023-11-08T19:23:02.550824+0000","last_became_peered":"2023-11-08T19:23:02.550824+0000","last_unstale":"2023-11-08T19:23:06.640045+0000","last_undegraded":"2023-11-08T19:23:06.640045+0000","last_fullsized":"2023-11-08T19:23:06.640045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:57:32.301401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.014492+0000","last_change":"2023-11-08T19:23:06.587021+0000","last_active":"2023-11-08T19:23:09.014492+0000","last_peered":"2023-11-08T19:23:09.014492+0000","last_clean":"2023-11-08T19:23:09.014492+0000","last_became_active":"2023-11-08T19:23:06.586659+0000","last_became_peered":"2023-11-08T19:23:06.586659+0000","last_unstale":"2023-11-08T19:23:09.014492+0000","last_undegraded":"2023-11-08T19:23:09.014492+0000","last_fullsized":"2023-11-08T19:23:09.014492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:57:36.344289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.564688+0000","last_change":"2023-11-08T19:23:01.539782+0000","last_active":"2023-11-08T19:23:06.564688+0000","last_peered":"2023-11-08T19:23:06.564688+0000","last_clean":"2023-11-08T19:23:06.564688+0000","last_became_active":"2023-11-08T19:23:01.539493+0000","last_became_peered":"2023-11-08T19:23:01.539493+0000","last_unstale":"2023-11-08T19:23:06.564688+0000","last_undegraded":"2023-11-08T19:23:06.564688+0000","last_fullsized":"2023-11-08T19:23:06.564688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:45:54.766612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.576303+0000","last_change":"2023-11-08T19:23:02.540720+0000","last_active":"2023-11-08T19:23:06.576303+0000","last_peered":"2023-11-08T19:23:06.576303+0000","last_clean":"2023-11-08T19:23:06.576303+0000","last_became_active":"2023-11-08T19:23:02.540438+0000","last_became_peered":"2023-11-08T19:23:02.540438+0000","last_unstale":"2023-11-08T19:23:06.576303+0000","last_undegraded":"2023-11-08T19:23:06.576303+0000","last_fullsized":"2023-11-08T19:23:06.576303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:07:39.852842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.014689+0000","last_change":"2023-11-08T19:23:06.590376+0000","last_active":"2023-11-08T19:23:09.014689+0000","last_peered":"2023-11-08T19:23:09.014689+0000","last_clean":"2023-11-08T19:23:09.014689+0000","last_became_active":"2023-11-08T19:23:06.590037+0000","last_became_peered":"2023-11-08T19:23:06.590037+0000","last_unstale":"2023-11-08T19:23:09.014689+0000","last_undegraded":"2023-11-08T19:23:09.014689+0000","last_fullsized":"2023-11-08T19:23:09.014689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:02:22.908243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.574893+0000","last_change":"2023-11-08T19:23:01.534469+0000","last_active":"2023-11-08T19:23:06.574893+0000","last_peered":"2023-11-08T19:23:06.574893+0000","last_clean":"2023-11-08T19:23:06.574893+0000","last_became_active":"2023-11-08T19:23:01.534138+0000","last_became_peered":"2023-11-08T19:23:01.534138+0000","last_unstale":"2023-11-08T19:23:06.574893+0000","last_undegraded":"2023-11-08T19:23:06.574893+0000","last_fullsized":"2023-11-08T19:23:06.574893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:49:45.790935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.572089+0000","last_change":"2023-11-08T19:23:02.542108+0000","last_active":"2023-11-08T19:23:06.572089+0000","last_peered":"2023-11-08T19:23:06.572089+0000","last_clean":"2023-11-08T19:23:06.572089+0000","last_became_active":"2023-11-08T19:23:02.541821+0000","last_became_peered":"2023-11-08T19:23:02.541821+0000","last_unstale":"2023-11-08T19:23:06.572089+0000","last_undegraded":"2023-11-08T19:23:06.572089+0000","last_fullsized":"2023-11-08T19:23:06.572089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:28:22.153214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.014620+0000","last_change":"2023-11-08T19:23:06.588541+0000","last_active":"2023-11-08T19:23:09.014620+0000","last_peered":"2023-11-08T19:23:09.014620+0000","last_clean":"2023-11-08T19:23:09.014620+0000","last_became_active":"2023-11-08T19:23:06.588061+0000","last_became_peered":"2023-11-08T19:23:06.588061+0000","last_unstale":"2023-11-08T19:23:09.014620+0000","last_undegraded":"2023-11-08T19:23:09.014620+0000","last_fullsized":"2023-11-08T19:23:09.014620+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:12:02.136296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.563850+0000","last_change":"2023-11-08T19:23:02.538424+0000","last_active":"2023-11-08T19:23:06.563850+0000","last_peered":"2023-11-08T19:23:06.563850+0000","last_clean":"2023-11-08T19:23:06.563850+0000","last_became_active":"2023-11-08T19:23:02.538207+0000","last_became_peered":"2023-11-08T19:23:02.538207+0000","last_unstale":"2023-11-08T19:23:06.563850+0000","last_undegraded":"2023-11-08T19:23:06.563850+0000","last_fullsized":"2023-11-08T19:23:06.563850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:57:51.015184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.572118+0000","last_change":"2023-11-08T19:23:01.537154+0000","last_active":"2023-11-08T19:23:06.572118+0000","last_peered":"2023-11-08T19:23:06.572118+0000","last_clean":"2023-11-08T19:23:06.572118+0000","last_became_active":"2023-11-08T19:23:01.536883+0000","last_became_peered":"2023-11-08T19:23:01.536883+0000","last_unstale":"2023-11-08T19:23:06.572118+0000","last_undegraded":"2023-11-08T19:23:06.572118+0000","last_fullsized":"2023-11-08T19:23:06.572118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:35:12.900048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:07.566888+0000","last_change":"2023-11-08T19:23:06.641281+0000","last_active":"2023-11-08T19:23:07.566888+0000","last_peered":"2023-11-08T19:23:07.566888+0000","last_clean":"2023-11-08T19:23:07.566888+0000","last_became_active":"2023-11-08T19:23:06.640919+0000","last_became_peered":"2023-11-08T19:23:06.640919+0000","last_unstale":"2023-11-08T19:23:07.566888+0000","last_undegraded":"2023-11-08T19:23:07.566888+0000","last_fullsized":"2023-11-08T19:23:07.566888+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:12:02.136296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.574338+0000","last_change":"2023-11-08T19:23:02.551226+0000","last_active":"2023-11-08T19:23:06.574338+0000","last_peered":"2023-11-08T19:23:06.574338+0000","last_clean":"2023-11-08T19:23:06.574338+0000","last_became_active":"2023-11-08T19:23:02.550970+0000","last_became_peered":"2023-11-08T19:23:02.550970+0000","last_unstale":"2023-11-08T19:23:06.574338+0000","last_undegraded":"2023-11-08T19:23:06.574338+0000","last_fullsized":"2023-11-08T19:23:06.574338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:32:49.846143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.576524+0000","last_change":"2023-11-08T19:23:01.533619+0000","last_active":"2023-11-08T19:23:06.576524+0000","last_peered":"2023-11-08T19:23:06.576524+0000","last_clean":"2023-11-08T19:23:06.576524+0000","last_became_active":"2023-11-08T19:23:01.532909+0000","last_became_peered":"2023-11-08T19:23:01.532909+0000","last_unstale":"2023-11-08T19:23:06.576524+0000","last_undegraded":"2023-11-08T19:23:06.576524+0000","last_fullsized":"2023-11-08T19:23:06.576524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:28:21.147246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.636980+0000","last_change":"2023-11-08T19:22:58.054283+0000","last_active":"2023-11-08T19:23:06.636980+0000","last_peered":"2023-11-08T19:23:06.636980+0000","last_clean":"2023-11-08T19:23:06.636980+0000","last_became_active":"2023-11-08T19:22:58.053337+0000","last_became_peered":"2023-11-08T19:22:58.053337+0000","last_unstale":"2023-11-08T19:23:06.636980+0000","last_undegraded":"2023-11-08T19:23:06.636980+0000","last_fullsized":"2023-11-08T19:23:06.636980+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:22:56.479654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:22:56.479654+0000","last_clean_scrub_stamp":"2023-11-08T19:22:56.479654+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:16:05.317001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.014474+0000","last_change":"2023-11-08T19:23:06.638413+0000","last_active":"2023-11-08T19:23:09.014474+0000","last_peered":"2023-11-08T19:23:09.014474+0000","last_clean":"2023-11-08T19:23:09.014474+0000","last_became_active":"2023-11-08T19:23:06.638031+0000","last_became_peered":"2023-11-08T19:23:06.638031+0000","last_unstale":"2023-11-08T19:23:09.014474+0000","last_undegraded":"2023-11-08T19:23:09.014474+0000","last_fullsized":"2023-11-08T19:23:09.014474+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:57:36.344289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.569505+0000","last_change":"2023-11-08T19:23:02.534618+0000","last_active":"2023-11-08T19:23:06.569505+0000","last_peered":"2023-11-08T19:23:06.569505+0000","last_clean":"2023-11-08T19:23:06.569505+0000","last_became_active":"2023-11-08T19:23:02.534330+0000","last_became_peered":"2023-11-08T19:23:02.534330+0000","last_unstale":"2023-11-08T19:23:06.569505+0000","last_undegraded":"2023-11-08T19:23:06.569505+0000","last_fullsized":"2023-11-08T19:23:06.569505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:45:55.772580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.637061+0000","last_change":"2023-11-08T19:23:01.540830+0000","last_active":"2023-11-08T19:23:06.637061+0000","last_peered":"2023-11-08T19:23:06.637061+0000","last_clean":"2023-11-08T19:23:06.637061+0000","last_became_active":"2023-11-08T19:23:01.540497+0000","last_became_peered":"2023-11-08T19:23:01.540497+0000","last_unstale":"2023-11-08T19:23:06.637061+0000","last_undegraded":"2023-11-08T19:23:06.637061+0000","last_fullsized":"2023-11-08T19:23:06.637061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:44:28.225190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.014795+0000","last_change":"2023-11-08T19:23:06.638492+0000","last_active":"2023-11-08T19:23:09.014795+0000","last_peered":"2023-11-08T19:23:09.014795+0000","last_clean":"2023-11-08T19:23:09.014795+0000","last_became_active":"2023-11-08T19:23:06.637973+0000","last_became_peered":"2023-11-08T19:23:06.637973+0000","last_unstale":"2023-11-08T19:23:09.014795+0000","last_undegraded":"2023-11-08T19:23:09.014795+0000","last_fullsized":"2023-11-08T19:23:09.014795+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:22:45.636851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.639665+0000","last_change":"2023-11-08T19:23:01.541030+0000","last_active":"2023-11-08T19:23:06.639665+0000","last_peered":"2023-11-08T19:23:06.639665+0000","last_clean":"2023-11-08T19:23:06.639665+0000","last_became_active":"2023-11-08T19:23:01.540713+0000","last_became_peered":"2023-11-08T19:23:01.540713+0000","last_unstale":"2023-11-08T19:23:06.639665+0000","last_undegraded":"2023-11-08T19:23:06.639665+0000","last_fullsized":"2023-11-08T19:23:06.639665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:49:45.790935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.564785+0000","last_change":"2023-11-08T19:23:02.534477+0000","last_active":"2023-11-08T19:23:06.564785+0000","last_peered":"2023-11-08T19:23:06.564785+0000","last_clean":"2023-11-08T19:23:06.564785+0000","last_became_active":"2023-11-08T19:23:02.534220+0000","last_became_peered":"2023-11-08T19:23:02.534220+0000","last_unstale":"2023-11-08T19:23:06.564785+0000","last_undegraded":"2023-11-08T19:23:06.564785+0000","last_fullsized":"2023-11-08T19:23:06.564785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:24:27.669240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.014669+0000","last_change":"2023-11-08T19:23:06.642788+0000","last_active":"2023-11-08T19:23:09.014669+0000","last_peered":"2023-11-08T19:23:09.014669+0000","last_clean":"2023-11-08T19:23:09.014669+0000","last_became_active":"2023-11-08T19:23:06.642353+0000","last_became_peered":"2023-11-08T19:23:06.642353+0000","last_unstale":"2023-11-08T19:23:09.014669+0000","last_undegraded":"2023-11-08T19:23:09.014669+0000","last_fullsized":"2023-11-08T19:23:09.014669+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:33:01.642232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.564741+0000","last_change":"2023-11-08T19:23:01.534206+0000","last_active":"2023-11-08T19:23:06.564741+0000","last_peered":"2023-11-08T19:23:06.564741+0000","last_clean":"2023-11-08T19:23:06.564741+0000","last_became_active":"2023-11-08T19:23:01.533951+0000","last_became_peered":"2023-11-08T19:23:01.533951+0000","last_unstale":"2023-11-08T19:23:06.564741+0000","last_undegraded":"2023-11-08T19:23:06.564741+0000","last_fullsized":"2023-11-08T19:23:06.564741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:52:26.893730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.572311+0000","last_change":"2023-11-08T19:23:02.543044+0000","last_active":"2023-11-08T19:23:06.572311+0000","last_peered":"2023-11-08T19:23:06.572311+0000","last_clean":"2023-11-08T19:23:06.572311+0000","last_became_active":"2023-11-08T19:23:02.542767+0000","last_became_peered":"2023-11-08T19:23:02.542767+0000","last_unstale":"2023-11-08T19:23:06.572311+0000","last_undegraded":"2023-11-08T19:23:06.572311+0000","last_fullsized":"2023-11-08T19:23:06.572311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:07:39.852842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:07.567464+0000","last_change":"2023-11-08T19:23:06.638770+0000","last_active":"2023-11-08T19:23:07.567464+0000","last_peered":"2023-11-08T19:23:07.567464+0000","last_clean":"2023-11-08T19:23:07.567464+0000","last_became_active":"2023-11-08T19:23:06.638045+0000","last_became_peered":"2023-11-08T19:23:06.638045+0000","last_unstale":"2023-11-08T19:23:07.567464+0000","last_undegraded":"2023-11-08T19:23:07.567464+0000","last_fullsized":"2023-11-08T19:23:07.567464+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:15:27.237227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.565881+0000","last_change":"2023-11-08T19:23:01.541938+0000","last_active":"2023-11-08T19:23:06.565881+0000","last_peered":"2023-11-08T19:23:06.565881+0000","last_clean":"2023-11-08T19:23:06.565881+0000","last_became_active":"2023-11-08T19:23:01.541534+0000","last_became_peered":"2023-11-08T19:23:01.541534+0000","last_unstale":"2023-11-08T19:23:06.565881+0000","last_undegraded":"2023-11-08T19:23:06.565881+0000","last_fullsized":"2023-11-08T19:23:06.565881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:47:07.770348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.578982+0000","last_change":"2023-11-08T19:23:02.538688+0000","last_active":"2023-11-08T19:23:06.578982+0000","last_peered":"2023-11-08T19:23:06.578982+0000","last_clean":"2023-11-08T19:23:06.578982+0000","last_became_active":"2023-11-08T19:23:02.538406+0000","last_became_peered":"2023-11-08T19:23:02.538406+0000","last_unstale":"2023-11-08T19:23:06.578982+0000","last_undegraded":"2023-11-08T19:23:06.578982+0000","last_fullsized":"2023-11-08T19:23:06.578982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:24:27.669240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:07.568066+0000","last_change":"2023-11-08T19:23:06.586884+0000","last_active":"2023-11-08T19:23:07.568066+0000","last_peered":"2023-11-08T19:23:07.568066+0000","last_clean":"2023-11-08T19:23:07.568066+0000","last_became_active":"2023-11-08T19:23:06.585724+0000","last_became_peered":"2023-11-08T19:23:06.585724+0000","last_unstale":"2023-11-08T19:23:07.568066+0000","last_undegraded":"2023-11-08T19:23:07.568066+0000","last_fullsized":"2023-11-08T19:23:07.568066+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:50:37.550320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.636980+0000","last_change":"2023-11-08T19:23:01.541119+0000","last_active":"2023-11-08T19:23:06.636980+0000","last_peered":"2023-11-08T19:23:06.636980+0000","last_clean":"2023-11-08T19:23:06.636980+0000","last_became_active":"2023-11-08T19:23:01.540784+0000","last_became_peered":"2023-11-08T19:23:01.540784+0000","last_unstale":"2023-11-08T19:23:06.636980+0000","last_undegraded":"2023-11-08T19:23:06.636980+0000","last_fullsized":"2023-11-08T19:23:06.636980+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:47:07.770348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.567795+0000","last_change":"2023-11-08T19:23:02.536086+0000","last_active":"2023-11-08T19:23:06.567795+0000","last_peered":"2023-11-08T19:23:06.567795+0000","last_clean":"2023-11-08T19:23:06.567795+0000","last_became_active":"2023-11-08T19:23:02.535129+0000","last_became_peered":"2023-11-08T19:23:02.535129+0000","last_unstale":"2023-11-08T19:23:06.567795+0000","last_undegraded":"2023-11-08T19:23:06.567795+0000","last_fullsized":"2023-11-08T19:23:06.567795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:01:17.694162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.014391+0000","last_change":"2023-11-08T19:23:06.639503+0000","last_active":"2023-11-08T19:23:09.014391+0000","last_peered":"2023-11-08T19:23:09.014391+0000","last_clean":"2023-11-08T19:23:09.014391+0000","last_became_active":"2023-11-08T19:23:06.639076+0000","last_became_peered":"2023-11-08T19:23:06.639076+0000","last_unstale":"2023-11-08T19:23:09.014391+0000","last_undegraded":"2023-11-08T19:23:09.014391+0000","last_fullsized":"2023-11-08T19:23:09.014391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:00:52.733076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.563944+0000","last_change":"2023-11-08T19:23:01.539723+0000","last_active":"2023-11-08T19:23:06.563944+0000","last_peered":"2023-11-08T19:23:06.563944+0000","last_clean":"2023-11-08T19:23:06.563944+0000","last_became_active":"2023-11-08T19:23:01.539435+0000","last_became_peered":"2023-11-08T19:23:01.539435+0000","last_unstale":"2023-11-08T19:23:06.563944+0000","last_undegraded":"2023-11-08T19:23:06.563944+0000","last_fullsized":"2023-11-08T19:23:06.563944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:01:16.688194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.571014+0000","last_change":"2023-11-08T19:23:02.539571+0000","last_active":"2023-11-08T19:23:06.571014+0000","last_peered":"2023-11-08T19:23:06.571014+0000","last_clean":"2023-11-08T19:23:06.571014+0000","last_became_active":"2023-11-08T19:23:02.539301+0000","last_became_peered":"2023-11-08T19:23:02.539301+0000","last_unstale":"2023-11-08T19:23:06.571014+0000","last_undegraded":"2023-11-08T19:23:06.571014+0000","last_fullsized":"2023-11-08T19:23:06.571014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:24:27.669240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:07.567147+0000","last_change":"2023-11-08T19:23:06.590255+0000","last_active":"2023-11-08T19:23:07.567147+0000","last_peered":"2023-11-08T19:23:07.567147+0000","last_clean":"2023-11-08T19:23:07.567147+0000","last_became_active":"2023-11-08T19:23:06.589834+0000","last_became_peered":"2023-11-08T19:23:06.589834+0000","last_unstale":"2023-11-08T19:23:07.567147+0000","last_undegraded":"2023-11-08T19:23:07.567147+0000","last_fullsized":"2023-11-08T19:23:07.567147+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:04:24.855880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.564072+0000","last_change":"2023-11-08T19:23:01.536694+0000","last_active":"2023-11-08T19:23:06.564072+0000","last_peered":"2023-11-08T19:23:06.564072+0000","last_clean":"2023-11-08T19:23:06.564072+0000","last_became_active":"2023-11-08T19:23:01.535913+0000","last_became_peered":"2023-11-08T19:23:01.535913+0000","last_unstale":"2023-11-08T19:23:06.564072+0000","last_undegraded":"2023-11-08T19:23:06.564072+0000","last_fullsized":"2023-11-08T19:23:06.564072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:43:54.669075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.573361+0000","last_change":"2023-11-08T19:23:02.533243+0000","last_active":"2023-11-08T19:23:06.573361+0000","last_peered":"2023-11-08T19:23:06.573361+0000","last_clean":"2023-11-08T19:23:06.573361+0000","last_became_active":"2023-11-08T19:23:02.532725+0000","last_became_peered":"2023-11-08T19:23:02.532725+0000","last_unstale":"2023-11-08T19:23:06.573361+0000","last_undegraded":"2023-11-08T19:23:06.573361+0000","last_fullsized":"2023-11-08T19:23:06.573361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:04:20.812993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:07.567627+0000","last_change":"2023-11-08T19:23:06.586805+0000","last_active":"2023-11-08T19:23:07.567627+0000","last_peered":"2023-11-08T19:23:07.567627+0000","last_clean":"2023-11-08T19:23:07.567627+0000","last_became_active":"2023-11-08T19:23:06.586388+0000","last_became_peered":"2023-11-08T19:23:06.586388+0000","last_unstale":"2023-11-08T19:23:07.567627+0000","last_undegraded":"2023-11-08T19:23:07.567627+0000","last_fullsized":"2023-11-08T19:23:07.567627+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:11:18.742854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.640533+0000","last_change":"2023-11-08T19:23:01.540491+0000","last_active":"2023-11-08T19:23:06.640533+0000","last_peered":"2023-11-08T19:23:06.640533+0000","last_clean":"2023-11-08T19:23:06.640533+0000","last_became_active":"2023-11-08T19:23:01.540175+0000","last_became_peered":"2023-11-08T19:23:01.540175+0000","last_unstale":"2023-11-08T19:23:06.640533+0000","last_undegraded":"2023-11-08T19:23:06.640533+0000","last_fullsized":"2023-11-08T19:23:06.640533+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:52:26.893730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.565419+0000","last_change":"2023-11-08T19:23:02.542218+0000","last_active":"2023-11-08T19:23:06.565419+0000","last_peered":"2023-11-08T19:23:06.565419+0000","last_clean":"2023-11-08T19:23:06.565419+0000","last_became_active":"2023-11-08T19:23:02.541912+0000","last_became_peered":"2023-11-08T19:23:02.541912+0000","last_unstale":"2023-11-08T19:23:06.565419+0000","last_undegraded":"2023-11-08T19:23:06.565419+0000","last_fullsized":"2023-11-08T19:23:06.565419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:04:20.812993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:07.567162+0000","last_change":"2023-11-08T19:23:06.641692+0000","last_active":"2023-11-08T19:23:07.567162+0000","last_peered":"2023-11-08T19:23:07.567162+0000","last_clean":"2023-11-08T19:23:07.567162+0000","last_became_active":"2023-11-08T19:23:06.640996+0000","last_became_peered":"2023-11-08T19:23:06.640996+0000","last_unstale":"2023-11-08T19:23:07.567162+0000","last_undegraded":"2023-11-08T19:23:07.567162+0000","last_fullsized":"2023-11-08T19:23:07.567162+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:00:52.733076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.574648+0000","last_change":"2023-11-08T19:23:01.538965+0000","last_active":"2023-11-08T19:23:06.574648+0000","last_peered":"2023-11-08T19:23:06.574648+0000","last_clean":"2023-11-08T19:23:06.574648+0000","last_became_active":"2023-11-08T19:23:01.538635+0000","last_became_peered":"2023-11-08T19:23:01.538635+0000","last_unstale":"2023-11-08T19:23:06.574648+0000","last_undegraded":"2023-11-08T19:23:06.574648+0000","last_fullsized":"2023-11-08T19:23:06.574648+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:33:16.511242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.639757+0000","last_change":"2023-11-08T19:23:02.549229+0000","last_active":"2023-11-08T19:23:06.639757+0000","last_peered":"2023-11-08T19:23:06.639757+0000","last_clean":"2023-11-08T19:23:06.639757+0000","last_became_active":"2023-11-08T19:23:02.548974+0000","last_became_peered":"2023-11-08T19:23:02.548974+0000","last_unstale":"2023-11-08T19:23:06.639757+0000","last_undegraded":"2023-11-08T19:23:06.639757+0000","last_fullsized":"2023-11-08T19:23:06.639757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:50:33.507433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.015704+0000","last_change":"2023-11-08T19:23:06.593697+0000","last_active":"2023-11-08T19:23:09.015704+0000","last_peered":"2023-11-08T19:23:09.015704+0000","last_clean":"2023-11-08T19:23:09.015704+0000","last_became_active":"2023-11-08T19:23:06.593382+0000","last_became_peered":"2023-11-08T19:23:06.593382+0000","last_unstale":"2023-11-08T19:23:09.015704+0000","last_undegraded":"2023-11-08T19:23:09.015704+0000","last_fullsized":"2023-11-08T19:23:09.015704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:02:22.908243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.564800+0000","last_change":"2023-11-08T19:23:01.530532+0000","last_active":"2023-11-08T19:23:06.564800+0000","last_peered":"2023-11-08T19:23:06.564800+0000","last_clean":"2023-11-08T19:23:06.564800+0000","last_became_active":"2023-11-08T19:23:01.530253+0000","last_became_peered":"2023-11-08T19:23:01.530253+0000","last_unstale":"2023-11-08T19:23:06.564800+0000","last_undegraded":"2023-11-08T19:23:06.564800+0000","last_fullsized":"2023-11-08T19:23:06.564800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:55.765637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.575825+0000","last_change":"2023-11-08T19:23:02.540301+0000","last_active":"2023-11-08T19:23:06.575825+0000","last_peered":"2023-11-08T19:23:06.575825+0000","last_clean":"2023-11-08T19:23:06.575825+0000","last_became_active":"2023-11-08T19:23:02.539679+0000","last_became_peered":"2023-11-08T19:23:02.539679+0000","last_unstale":"2023-11-08T19:23:06.575825+0000","last_undegraded":"2023-11-08T19:23:06.575825+0000","last_fullsized":"2023-11-08T19:23:06.575825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:11:14.699967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.014285+0000","last_change":"2023-11-08T19:23:06.638442+0000","last_active":"2023-11-08T19:23:09.014285+0000","last_peered":"2023-11-08T19:23:09.014285+0000","last_clean":"2023-11-08T19:23:09.014285+0000","last_became_active":"2023-11-08T19:23:06.638018+0000","last_became_peered":"2023-11-08T19:23:06.638018+0000","last_unstale":"2023-11-08T19:23:09.014285+0000","last_undegraded":"2023-11-08T19:23:09.014285+0000","last_fullsized":"2023-11-08T19:23:09.014285+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:14:35.302430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.575081+0000","last_change":"2023-11-08T19:23:01.537610+0000","last_active":"2023-11-08T19:23:06.575081+0000","last_peered":"2023-11-08T19:23:06.575081+0000","last_clean":"2023-11-08T19:23:06.575081+0000","last_became_active":"2023-11-08T19:23:01.537341+0000","last_became_peered":"2023-11-08T19:23:01.537341+0000","last_unstale":"2023-11-08T19:23:06.575081+0000","last_undegraded":"2023-11-08T19:23:06.575081+0000","last_fullsized":"2023-11-08T19:23:06.575081+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:01:16.688194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.640258+0000","last_change":"2023-11-08T19:23:02.551858+0000","last_active":"2023-11-08T19:23:06.640258+0000","last_peered":"2023-11-08T19:23:06.640258+0000","last_clean":"2023-11-08T19:23:06.640258+0000","last_became_active":"2023-11-08T19:23:02.551054+0000","last_became_peered":"2023-11-08T19:23:02.551054+0000","last_unstale":"2023-11-08T19:23:06.640258+0000","last_undegraded":"2023-11-08T19:23:06.640258+0000","last_fullsized":"2023-11-08T19:23:06.640258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:00:48.690189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.565678+0000","last_change":"2023-11-08T19:23:02.545805+0000","last_active":"2023-11-08T19:23:06.565678+0000","last_peered":"2023-11-08T19:23:06.565678+0000","last_clean":"2023-11-08T19:23:06.565678+0000","last_became_active":"2023-11-08T19:23:02.545540+0000","last_became_peered":"2023-11-08T19:23:02.545540+0000","last_unstale":"2023-11-08T19:23:06.565678+0000","last_undegraded":"2023-11-08T19:23:06.565678+0000","last_fullsized":"2023-11-08T19:23:06.565678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:15:23.194339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.572161+0000","last_change":"2023-11-08T19:23:02.537513+0000","last_active":"2023-11-08T19:23:06.572161+0000","last_peered":"2023-11-08T19:23:06.572161+0000","last_clean":"2023-11-08T19:23:06.572161+0000","last_became_active":"2023-11-08T19:23:02.537192+0000","last_became_peered":"2023-11-08T19:23:02.537192+0000","last_unstale":"2023-11-08T19:23:06.572161+0000","last_undegraded":"2023-11-08T19:23:06.572161+0000","last_fullsized":"2023-11-08T19:23:06.572161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:47:08.776316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.575099+0000","last_change":"2023-11-08T19:23:02.537846+0000","last_active":"2023-11-08T19:23:06.575099+0000","last_peered":"2023-11-08T19:23:06.575099+0000","last_clean":"2023-11-08T19:23:06.575099+0000","last_became_active":"2023-11-08T19:23:02.537585+0000","last_became_peered":"2023-11-08T19:23:02.537585+0000","last_unstale":"2023-11-08T19:23:06.575099+0000","last_undegraded":"2023-11-08T19:23:06.575099+0000","last_fullsized":"2023-11-08T19:23:06.575099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:11:58.093408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.579334+0000","last_change":"2023-11-08T19:23:02.536724+0000","last_active":"2023-11-08T19:23:06.579334+0000","last_peered":"2023-11-08T19:23:06.579334+0000","last_clean":"2023-11-08T19:23:06.579334+0000","last_became_active":"2023-11-08T19:23:02.536080+0000","last_became_peered":"2023-11-08T19:23:02.536080+0000","last_unstale":"2023-11-08T19:23:06.579334+0000","last_undegraded":"2023-11-08T19:23:06.579334+0000","last_fullsized":"2023-11-08T19:23:06.579334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:56:02.594198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.576167+0000","last_change":"2023-11-08T19:23:02.531764+0000","last_active":"2023-11-08T19:23:06.576167+0000","last_peered":"2023-11-08T19:23:06.576167+0000","last_clean":"2023-11-08T19:23:06.576167+0000","last_became_active":"2023-11-08T19:23:02.531498+0000","last_became_peered":"2023-11-08T19:23:02.531498+0000","last_unstale":"2023-11-08T19:23:06.576167+0000","last_undegraded":"2023-11-08T19:23:06.576167+0000","last_fullsized":"2023-11-08T19:23:06.576167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:15:23.194339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.564703+0000","last_change":"2023-11-08T19:23:02.536652+0000","last_active":"2023-11-08T19:23:06.564703+0000","last_peered":"2023-11-08T19:23:06.564703+0000","last_clean":"2023-11-08T19:23:06.564703+0000","last_became_active":"2023-11-08T19:23:02.536397+0000","last_became_peered":"2023-11-08T19:23:02.536397+0000","last_unstale":"2023-11-08T19:23:06.564703+0000","last_undegraded":"2023-11-08T19:23:06.564703+0000","last_fullsized":"2023-11-08T19:23:06.564703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:32:49.846143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.566386+0000","last_change":"2023-11-08T19:23:02.546101+0000","last_active":"2023-11-08T19:23:06.566386+0000","last_peered":"2023-11-08T19:23:06.566386+0000","last_clean":"2023-11-08T19:23:06.566386+0000","last_became_active":"2023-11-08T19:23:02.545740+0000","last_became_peered":"2023-11-08T19:23:02.545740+0000","last_unstale":"2023-11-08T19:23:06.566386+0000","last_undegraded":"2023-11-08T19:23:06.566386+0000","last_fullsized":"2023-11-08T19:23:06.566386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:56:02.594198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.572386+0000","last_change":"2023-11-08T19:23:02.534052+0000","last_active":"2023-11-08T19:23:06.572386+0000","last_peered":"2023-11-08T19:23:06.572386+0000","last_clean":"2023-11-08T19:23:06.572386+0000","last_became_active":"2023-11-08T19:23:02.533811+0000","last_became_peered":"2023-11-08T19:23:02.533811+0000","last_unstale":"2023-11-08T19:23:06.572386+0000","last_undegraded":"2023-11-08T19:23:06.572386+0000","last_fullsized":"2023-11-08T19:23:06.572386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:44:38.109774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.574607+0000","last_change":"2023-11-08T19:23:02.536926+0000","last_active":"2023-11-08T19:23:06.574607+0000","last_peered":"2023-11-08T19:23:06.574607+0000","last_clean":"2023-11-08T19:23:06.574607+0000","last_became_active":"2023-11-08T19:23:02.536648+0000","last_became_peered":"2023-11-08T19:23:02.536648+0000","last_unstale":"2023-11-08T19:23:06.574607+0000","last_undegraded":"2023-11-08T19:23:06.574607+0000","last_fullsized":"2023-11-08T19:23:06.574607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:56:02.594198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.570954+0000","last_change":"2023-11-08T19:23:02.533095+0000","last_active":"2023-11-08T19:23:06.570954+0000","last_peered":"2023-11-08T19:23:06.570954+0000","last_clean":"2023-11-08T19:23:06.570954+0000","last_became_active":"2023-11-08T19:23:02.532639+0000","last_became_peered":"2023-11-08T19:23:02.532639+0000","last_unstale":"2023-11-08T19:23:06.570954+0000","last_undegraded":"2023-11-08T19:23:06.570954+0000","last_fullsized":"2023-11-08T19:23:06.570954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:56:02.594198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.575154+0000","last_change":"2023-11-08T19:23:02.547407+0000","last_active":"2023-11-08T19:23:06.575154+0000","last_peered":"2023-11-08T19:23:06.575154+0000","last_clean":"2023-11-08T19:23:06.575154+0000","last_became_active":"2023-11-08T19:23:02.545080+0000","last_became_peered":"2023-11-08T19:23:02.545080+0000","last_unstale":"2023-11-08T19:23:06.575154+0000","last_undegraded":"2023-11-08T19:23:06.575154+0000","last_fullsized":"2023-11-08T19:23:06.575154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:57:32.301401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.579417+0000","last_change":"2023-11-08T19:23:02.543982+0000","last_active":"2023-11-08T19:23:06.579417+0000","last_peered":"2023-11-08T19:23:06.579417+0000","last_clean":"2023-11-08T19:23:06.579417+0000","last_became_active":"2023-11-08T19:23:02.543790+0000","last_became_peered":"2023-11-08T19:23:02.543790+0000","last_unstale":"2023-11-08T19:23:06.579417+0000","last_undegraded":"2023-11-08T19:23:06.579417+0000","last_fullsized":"2023-11-08T19:23:06.579417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:57:51.015184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.567500+0000","last_change":"2023-11-08T19:23:02.546682+0000","last_active":"2023-11-08T19:23:06.567500+0000","last_peered":"2023-11-08T19:23:06.567500+0000","last_clean":"2023-11-08T19:23:06.567500+0000","last_became_active":"2023-11-08T19:23:02.546356+0000","last_became_peered":"2023-11-08T19:23:02.546356+0000","last_unstale":"2023-11-08T19:23:06.567500+0000","last_undegraded":"2023-11-08T19:23:06.567500+0000","last_fullsized":"2023-11-08T19:23:06.567500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:32:49.846143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":851968,"data_stored":690742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":99952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":860160,"data_stored":690798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":19.295999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.524}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":14.324}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":17.056000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.0590000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":17.146000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":99792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":99918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":99882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:23:25.969 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:23:26.122 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.121+0000 7fa4151a8700 1 Processor -- start 2023-11-08T19:23:26.123 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.121+0000 7fa4151a8700 1 -- start start 2023-11-08T19:23:26.126 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.122+0000 7fa4151a8700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fa41015b950 0x7fa4100ce130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:26.126 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.122+0000 7fa4151a8700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa4100cd5e0 0x7fa4100ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:26.126 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.122+0000 7fa4151a8700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4100cc2e0 con 0x7fa4100cfd20 2023-11-08T19:23:26.126 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.122+0000 7fa4151a8700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4100cc580 con 0x7fa41015b950 2023-11-08T19:23:26.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.122+0000 7fa4151a8700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4100cc820 con 0x7fa4100cd5e0 2023-11-08T19:23:26.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.122+0000 7fa40f59e700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fa4100cfd20 0x7fa4100d01b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:39662/0 (socket says 172.21.15.149:39662) 2023-11-08T19:23:26.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.122+0000 7fa40f59e700 1 -- 172.21.15.149:0/3441615037 learned_addr learned my addr 172.21.15.149:0/3441615037 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:23:26.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.122+0000 7fa40e59c700 1 --2- 172.21.15.149:0/3441615037 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa4100cd5e0 0x7fa4100ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:26.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.122+0000 7fa40ed9d700 1 --2- 172.21.15.149:0/3441615037 >> v2:172.21.15.160:3300/0 conn(0x7fa41015b950 0x7fa4100ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:26.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.122+0000 7fa40dd9b700 1 -- 172.21.15.149:0/3441615037 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4000603904 0 0) 0x7fa4100cc2e0 con 0x7fa4100cfd20 2023-11-08T19:23:26.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.123+0000 7fa40dd9b700 1 -- 172.21.15.149:0/3441615037 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3f80035b0 con 0x7fa4100cfd20 2023-11-08T19:23:26.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.123+0000 7fa40dd9b700 1 -- 172.21.15.149:0/3441615037 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3981780305 0 0) 0x7fa3f80035b0 con 0x7fa4100cfd20 2023-11-08T19:23:26.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.123+0000 7fa40dd9b700 1 -- 172.21.15.149:0/3441615037 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa4100cd5e0 msgr2=0x7fa4100ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:26.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.123+0000 7fa40dd9b700 1 --2- 172.21.15.149:0/3441615037 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa4100cd5e0 0x7fa4100ce670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:26.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.123+0000 7fa40dd9b700 1 -- 172.21.15.149:0/3441615037 >> v2:172.21.15.160:3300/0 conn(0x7fa41015b950 msgr2=0x7fa4100ce130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:26.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.123+0000 7fa40dd9b700 1 --2- 172.21.15.149:0/3441615037 >> v2:172.21.15.160:3300/0 conn(0x7fa41015b950 0x7fa4100ce130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:26.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.123+0000 7fa40dd9b700 1 -- 172.21.15.149:0/3441615037 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4100ccb00 con 0x7fa4100cfd20 2023-11-08T19:23:26.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.123+0000 7fa40dd9b700 1 -- 172.21.15.149:0/3441615037 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7fa4080019f0 con 0x7fa4100cfd20 2023-11-08T19:23:26.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.123+0000 7fa40dd9b700 1 -- 172.21.15.149:0/3441615037 >> v1:172.21.15.149:6789/0 conn(0x7fa4100cfd20 legacy=0x7fa4100d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:26.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.123+0000 7fa40dd9b700 1 --2- 172.21.15.149:0/3441615037 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa3f8003a00 0x7fa3f8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:26.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.123+0000 7fa40dd9b700 1 --2- 172.21.15.149:0/3441615037 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3f8004850 0x7fa3f8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:26.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.123+0000 7fa40dd9b700 1 --2- 172.21.15.149:0/3441615037 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa3f8005210 0x7fa3f800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:26.131 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.123+0000 7fa40dd9b700 1 -- 172.21.15.149:0/3441615037 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4100cc580 con 0x7fa3f8004850 2023-11-08T19:23:26.131 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.123+0000 7fa40dd9b700 1 -- 172.21.15.149:0/3441615037 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4100cc820 con 0x7fa3f8003a00 2023-11-08T19:23:26.131 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.123+0000 7fa40dd9b700 1 -- 172.21.15.149:0/3441615037 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f800bf50 con 0x7fa3f8005210 2023-11-08T19:23:26.131 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.123+0000 7fa40e59c700 1 --2- 172.21.15.149:0/3441615037 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa4100cd5e0 0x7fa4100ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:23:26.131 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.123+0000 7fa40ed9d700 1 --2- 172.21.15.149:0/3441615037 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa3f8003a00 0x7fa3f8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:26.132 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.123+0000 7fa40e59c700 1 --2- 172.21.15.149:0/3441615037 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3f8004850 0x7fa3f8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:26.132 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.123+0000 7fa40f59e700 1 --2- 172.21.15.149:0/3441615037 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa3f8005210 0x7fa3f800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:26.132 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.123+0000 7fa40e59c700 1 -- 172.21.15.149:0/3441615037 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa3f8005210 msgr2=0x7fa3f800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:26.132 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.123+0000 7fa40e59c700 1 --2- 172.21.15.149:0/3441615037 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa3f8005210 0x7fa3f800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:26.132 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.123+0000 7fa40e59c700 1 -- 172.21.15.149:0/3441615037 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa3f8003a00 msgr2=0x7fa3f8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:26.133 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.123+0000 7fa40e59c700 1 --2- 172.21.15.149:0/3441615037 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa3f8003a00 0x7fa3f8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:26.133 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.123+0000 7fa40e59c700 1 -- 172.21.15.149:0/3441615037 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f80035b0 con 0x7fa3f8004850 2023-11-08T19:23:26.133 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.123+0000 7fa40e59c700 1 --2- 172.21.15.149:0/3441615037 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3f8004850 0x7fa3f8004cd0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa4100cdef0 tx=0x7fa3f8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62e139dbd5b7b99e server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:26.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.126+0000 7fa40dd9b700 1 -- 172.21.15.149:0/3441615037 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa400004030 con 0x7fa3f8004850 2023-11-08T19:23:26.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.126+0000 7fa40dd9b700 1 -- 172.21.15.149:0/3441615037 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa400004190 con 0x7fa3f8004850 2023-11-08T19:23:26.137 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.126+0000 7fa40dd9b700 1 -- 172.21.15.149:0/3441615037 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa400004540 con 0x7fa3f8004850 2023-11-08T19:23:26.137 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.126+0000 7fa4151a8700 1 -- 172.21.15.149:0/3441615037 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3f8004850 msgr2=0x7fa3f8004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:26.137 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.126+0000 7fa4151a8700 1 --2- 172.21.15.149:0/3441615037 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3f8004850 0x7fa3f8004cd0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa4100cdef0 tx=0x7fa3f8005880 comp rx=0 tx=0).stop 2023-11-08T19:23:26.137 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.126+0000 7fa40f59e700 1 -- 172.21.15.149:0/3441615037 reap_dead start 2023-11-08T19:23:26.137 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.126+0000 7fa4151a8700 1 -- 172.21.15.149:0/3441615037 shutdown_connections 2023-11-08T19:23:26.138 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.126+0000 7fa4151a8700 1 -- 172.21.15.149:0/3441615037 >> 172.21.15.149:0/3441615037 conn(0x7fa41008afd0 msgr2=0x7fa4100d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:26.138 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.126+0000 7fa4151a8700 1 -- 172.21.15.149:0/3441615037 shutdown_connections 2023-11-08T19:23:26.138 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.126+0000 7fa4151a8700 1 -- 172.21.15.149:0/3441615037 wait complete. 2023-11-08T19:23:26.138 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.128+0000 7fa4151a8700 1 Processor -- start 2023-11-08T19:23:26.139 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.128+0000 7fa4151a8700 1 -- start start 2023-11-08T19:23:26.139 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.129+0000 7fa4151a8700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa3f8004850 0x7fa4100b2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:26.139 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.129+0000 7fa4151a8700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa41015eed0 0x7fa4100b6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:26.139 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.129+0000 7fa4151a8700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa4100b6c80 0x7fa4101f6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:26.139 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.129+0000 7fa4151a8700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa41015ea40 con 0x7fa41015eed0 2023-11-08T19:23:26.140 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.129+0000 7fa4151a8700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa41015de30 con 0x7fa3f8004850 2023-11-08T19:23:26.140 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.129+0000 7fa4151a8700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa41015e110 con 0x7fa4100b6c80 2023-11-08T19:23:26.140 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.129+0000 7fa40e59c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa41015eed0 0x7fa4100b6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:26.140 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.129+0000 7fa40e59c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa41015eed0 0x7fa4100b6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37670/0 (socket says 172.21.15.149:37670) 2023-11-08T19:23:26.140 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.129+0000 7fa40e59c700 1 -- 172.21.15.149:0/3799542606 learned_addr learned my addr 172.21.15.149:0/3799542606 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:26.141 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.129+0000 7fa40ed9d700 1 --2- 172.21.15.149:0/3799542606 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa3f8004850 0x7fa4100b2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:26.141 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.129+0000 7fa40f59e700 1 --2- 172.21.15.149:0/3799542606 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa4100b6c80 0x7fa4101f6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:26.141 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.129+0000 7fa40e59c700 1 -- 172.21.15.149:0/3799542606 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa4100b6c80 msgr2=0x7fa4101f6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:26.141 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.129+0000 7fa40e59c700 1 --2- 172.21.15.149:0/3799542606 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa4100b6c80 0x7fa4101f6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:26.141 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.129+0000 7fa40e59c700 1 -- 172.21.15.149:0/3799542606 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa3f8004850 msgr2=0x7fa4100b2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:26.142 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.129+0000 7fa40e59c700 1 --2- 172.21.15.149:0/3799542606 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa3f8004850 0x7fa4100b2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:26.142 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.129+0000 7fa40e59c700 1 -- 172.21.15.149:0/3799542606 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa41015e3f0 con 0x7fa41015eed0 2023-11-08T19:23:26.142 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.130+0000 7fa40e59c700 1 --2- 172.21.15.149:0/3799542606 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa41015eed0 0x7fa4100b6740 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa3f8004700 tx=0x7fa4000047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:26.142 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.133+0000 7fa3f77fe700 1 -- 172.21.15.149:0/3799542606 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa400004030 con 0x7fa41015eed0 2023-11-08T19:23:26.142 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.133+0000 7fa3f77fe700 1 -- 172.21.15.149:0/3799542606 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa400003ab0 con 0x7fa41015eed0 2023-11-08T19:23:26.143 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.133+0000 7fa4151a8700 1 -- 172.21.15.149:0/3799542606 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa41015e6d0 con 0x7fa41015eed0 2023-11-08T19:23:26.143 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.133+0000 7fa3f77fe700 1 -- 172.21.15.149:0/3799542606 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa400003e60 con 0x7fa41015eed0 2023-11-08T19:23:26.143 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.133+0000 7fa4151a8700 1 -- 172.21.15.149:0/3799542606 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4101f7170 con 0x7fa41015eed0 2023-11-08T19:23:26.143 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.134+0000 7fa4151a8700 1 -- 172.21.15.149:0/3799542606 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa41015ebf0 con 0x7fa41015eed0 2023-11-08T19:23:26.143 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.134+0000 7fa3f77fe700 1 -- 172.21.15.149:0/3799542606 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa400013470 con 0x7fa41015eed0 2023-11-08T19:23:26.144 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.134+0000 7fa3f77fe700 1 --2- 172.21.15.149:0/3799542606 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa3fc06af00 0x7fa3fc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:26.144 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.135+0000 7fa3f77fe700 1 -- 172.21.15.149:0/3799542606 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa40008af50 con 0x7fa41015eed0 2023-11-08T19:23:26.144 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.135+0000 7fa40ed9d700 1 --2- 172.21.15.149:0/3799542606 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa3fc06af00 0x7fa3fc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:26.144 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.135+0000 7fa40ed9d700 1 --2- 172.21.15.149:0/3799542606 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa3fc06af00 0x7fa3fc06d3c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa404009c40 tx=0x7fa4040091c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:26.145 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.139+0000 7fa3f77fe700 1 -- 172.21.15.149:0/3799542606 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa41015ebf0 con 0x7fa41015eed0 2023-11-08T19:23:26.328 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.327+0000 7fa4151a8700 1 -- 172.21.15.149:0/3799542606 --> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa41015e280 con 0x7fa3fc06af00 2023-11-08T19:23:26.337 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.336+0000 7fa3f77fe700 1 -- 172.21.15.149:0/3799542606 <== mgr.4104 v2:172.21.15.149:6832/1929837472 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345271 (secure 0 0 0) 0x7fa41015e280 con 0x7fa3fc06af00 2023-11-08T19:23:26.342 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:23:26.345 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.340+0000 7fa4151a8700 1 -- 172.21.15.149:0/3799542606 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa3fc06af00 msgr2=0x7fa3fc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:26.345 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.340+0000 7fa4151a8700 1 --2- 172.21.15.149:0/3799542606 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa3fc06af00 0x7fa3fc06d3c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa404009c40 tx=0x7fa4040091c0 comp rx=0 tx=0).stop 2023-11-08T19:23:26.345 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.340+0000 7fa4151a8700 1 -- 172.21.15.149:0/3799542606 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa41015eed0 msgr2=0x7fa4100b6740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:26.345 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.340+0000 7fa4151a8700 1 --2- 172.21.15.149:0/3799542606 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa41015eed0 0x7fa4100b6740 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa3f8004700 tx=0x7fa4000047c0 comp rx=0 tx=0).stop 2023-11-08T19:23:26.346 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.340+0000 7fa4151a8700 1 -- 172.21.15.149:0/3799542606 shutdown_connections 2023-11-08T19:23:26.346 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.340+0000 7fa4151a8700 1 --2- 172.21.15.149:0/3799542606 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa3fc06af00 0x7fa3fc06d3c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:26.346 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.340+0000 7fa4151a8700 1 --2- 172.21.15.149:0/3799542606 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa3f8004850 0x7fa4100b2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:26.346 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.340+0000 7fa4151a8700 1 --2- 172.21.15.149:0/3799542606 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa4100b6c80 0x7fa4101f6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:26.346 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.340+0000 7fa4151a8700 1 --2- 172.21.15.149:0/3799542606 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa41015eed0 0x7fa4100b6740 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:26.347 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.340+0000 7fa4151a8700 1 -- 172.21.15.149:0/3799542606 >> 172.21.15.149:0/3799542606 conn(0x7fa41008afd0 msgr2=0x7fa41006d740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:26.347 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.340+0000 7fa4151a8700 1 -- 172.21.15.149:0/3799542606 shutdown_connections 2023-11-08T19:23:26.347 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.340+0000 7fa4151a8700 1 -- 172.21.15.149:0/3799542606 wait complete. 2023-11-08T19:23:26.347 INFO:teuthology.orchestra.run.smithi149.stderr:dumped all 2023-11-08T19:23:26.353 INFO:teuthology.orchestra.run.smithi149.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2023-11-08T19:23:25.990461+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219384,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755336,"statfs":{"total":773094113280,"available":772869464064,"internally_reserved":0,"allocated":3284992,"data_stored":1988352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003177"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.640463+0000","last_change":"2023-11-08T19:23:02.552058+0000","last_active":"2023-11-08T19:23:06.640463+0000","last_peered":"2023-11-08T19:23:06.640463+0000","last_clean":"2023-11-08T19:23:06.640463+0000","last_became_active":"2023-11-08T19:23:02.551489+0000","last_became_peered":"2023-11-08T19:23:02.551489+0000","last_unstale":"2023-11-08T19:23:06.640463+0000","last_undegraded":"2023-11-08T19:23:06.640463+0000","last_fullsized":"2023-11-08T19:23:06.640463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:22:41.593963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.564907+0000","last_change":"2023-11-08T19:23:02.538323+0000","last_active":"2023-11-08T19:23:06.564907+0000","last_peered":"2023-11-08T19:23:06.564907+0000","last_clean":"2023-11-08T19:23:06.564907+0000","last_became_active":"2023-11-08T19:23:02.537940+0000","last_became_peered":"2023-11-08T19:23:02.537940+0000","last_unstale":"2023-11-08T19:23:06.564907+0000","last_undegraded":"2023-11-08T19:23:06.564907+0000","last_fullsized":"2023-11-08T19:23:06.564907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:04:20.812993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.578295+0000","last_change":"2023-11-08T19:23:02.536079+0000","last_active":"2023-11-08T19:23:06.578295+0000","last_peered":"2023-11-08T19:23:06.578295+0000","last_clean":"2023-11-08T19:23:06.578295+0000","last_became_active":"2023-11-08T19:23:02.535824+0000","last_became_peered":"2023-11-08T19:23:02.535824+0000","last_unstale":"2023-11-08T19:23:06.578295+0000","last_undegraded":"2023-11-08T19:23:06.578295+0000","last_fullsized":"2023-11-08T19:23:06.578295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:29:40.895783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.575728+0000","last_change":"2023-11-08T19:23:02.540491+0000","last_active":"2023-11-08T19:23:06.575728+0000","last_peered":"2023-11-08T19:23:06.575728+0000","last_clean":"2023-11-08T19:23:06.575728+0000","last_became_active":"2023-11-08T19:23:02.540012+0000","last_became_peered":"2023-11-08T19:23:02.540012+0000","last_unstale":"2023-11-08T19:23:06.575728+0000","last_undegraded":"2023-11-08T19:23:06.575728+0000","last_fullsized":"2023-11-08T19:23:06.575728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:15:23.194339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.639456+0000","last_change":"2023-11-08T19:23:02.544395+0000","last_active":"2023-11-08T19:23:06.639456+0000","last_peered":"2023-11-08T19:23:06.639456+0000","last_clean":"2023-11-08T19:23:06.639456+0000","last_became_active":"2023-11-08T19:23:02.544103+0000","last_became_peered":"2023-11-08T19:23:02.544103+0000","last_unstale":"2023-11-08T19:23:06.639456+0000","last_undegraded":"2023-11-08T19:23:06.639456+0000","last_fullsized":"2023-11-08T19:23:06.639456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:47:36.694344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.575191+0000","last_change":"2023-11-08T19:23:02.545064+0000","last_active":"2023-11-08T19:23:06.575191+0000","last_peered":"2023-11-08T19:23:06.575191+0000","last_clean":"2023-11-08T19:23:06.575191+0000","last_became_active":"2023-11-08T19:23:02.544254+0000","last_became_peered":"2023-11-08T19:23:02.544254+0000","last_unstale":"2023-11-08T19:23:06.575191+0000","last_undegraded":"2023-11-08T19:23:06.575191+0000","last_fullsized":"2023-11-08T19:23:06.575191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:00:48.690189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.637334+0000","last_change":"2023-11-08T19:23:02.542877+0000","last_active":"2023-11-08T19:23:06.637334+0000","last_peered":"2023-11-08T19:23:06.637334+0000","last_clean":"2023-11-08T19:23:06.637334+0000","last_became_active":"2023-11-08T19:23:02.542587+0000","last_became_peered":"2023-11-08T19:23:02.542587+0000","last_unstale":"2023-11-08T19:23:06.637334+0000","last_undegraded":"2023-11-08T19:23:06.637334+0000","last_fullsized":"2023-11-08T19:23:06.637334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:15:23.194339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.571114+0000","last_change":"2023-11-08T19:23:02.537658+0000","last_active":"2023-11-08T19:23:06.571114+0000","last_peered":"2023-11-08T19:23:06.571114+0000","last_clean":"2023-11-08T19:23:06.571114+0000","last_became_active":"2023-11-08T19:23:02.537389+0000","last_became_peered":"2023-11-08T19:23:02.537389+0000","last_unstale":"2023-11-08T19:23:06.571114+0000","last_undegraded":"2023-11-08T19:23:06.571114+0000","last_fullsized":"2023-11-08T19:23:06.571114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:29:40.895783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.640351+0000","last_change":"2023-11-08T19:23:02.551031+0000","last_active":"2023-11-08T19:23:06.640351+0000","last_peered":"2023-11-08T19:23:06.640351+0000","last_clean":"2023-11-08T19:23:06.640351+0000","last_became_active":"2023-11-08T19:23:02.550631+0000","last_became_peered":"2023-11-08T19:23:02.550631+0000","last_unstale":"2023-11-08T19:23:06.640351+0000","last_undegraded":"2023-11-08T19:23:06.640351+0000","last_fullsized":"2023-11-08T19:23:06.640351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:02:18.865355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.566140+0000","last_change":"2023-11-08T19:23:02.539521+0000","last_active":"2023-11-08T19:23:06.566140+0000","last_peered":"2023-11-08T19:23:06.566140+0000","last_clean":"2023-11-08T19:23:06.566140+0000","last_became_active":"2023-11-08T19:23:02.539252+0000","last_became_peered":"2023-11-08T19:23:02.539252+0000","last_unstale":"2023-11-08T19:23:06.566140+0000","last_undegraded":"2023-11-08T19:23:06.566140+0000","last_fullsized":"2023-11-08T19:23:06.566140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:44:38.109774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.565944+0000","last_change":"2023-11-08T19:23:02.548230+0000","last_active":"2023-11-08T19:23:06.565944+0000","last_peered":"2023-11-08T19:23:06.565944+0000","last_clean":"2023-11-08T19:23:06.565944+0000","last_became_active":"2023-11-08T19:23:02.547980+0000","last_became_peered":"2023-11-08T19:23:02.547980+0000","last_unstale":"2023-11-08T19:23:06.565944+0000","last_undegraded":"2023-11-08T19:23:06.565944+0000","last_fullsized":"2023-11-08T19:23:06.565944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:24:27.669240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.569454+0000","last_change":"2023-11-08T19:23:02.550957+0000","last_active":"2023-11-08T19:23:06.569454+0000","last_peered":"2023-11-08T19:23:06.569454+0000","last_clean":"2023-11-08T19:23:06.569454+0000","last_became_active":"2023-11-08T19:23:02.550071+0000","last_became_peered":"2023-11-08T19:23:02.550071+0000","last_unstale":"2023-11-08T19:23:06.569454+0000","last_undegraded":"2023-11-08T19:23:06.569454+0000","last_fullsized":"2023-11-08T19:23:06.569454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:08:24.771220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.573212+0000","last_change":"2023-11-08T19:23:02.547356+0000","last_active":"2023-11-08T19:23:06.573212+0000","last_peered":"2023-11-08T19:23:06.573212+0000","last_clean":"2023-11-08T19:23:06.573212+0000","last_became_active":"2023-11-08T19:23:02.546568+0000","last_became_peered":"2023-11-08T19:23:02.546568+0000","last_unstale":"2023-11-08T19:23:06.573212+0000","last_undegraded":"2023-11-08T19:23:06.573212+0000","last_fullsized":"2023-11-08T19:23:06.573212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:49:46.796904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.580399+0000","last_change":"2023-11-08T19:23:02.538938+0000","last_active":"2023-11-08T19:23:06.580399+0000","last_peered":"2023-11-08T19:23:06.580399+0000","last_clean":"2023-11-08T19:23:06.580399+0000","last_became_active":"2023-11-08T19:23:02.538598+0000","last_became_peered":"2023-11-08T19:23:02.538598+0000","last_unstale":"2023-11-08T19:23:06.580399+0000","last_undegraded":"2023-11-08T19:23:06.580399+0000","last_fullsized":"2023-11-08T19:23:06.580399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:52:27.899698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.563911+0000","last_change":"2023-11-08T19:23:02.543136+0000","last_active":"2023-11-08T19:23:06.563911+0000","last_peered":"2023-11-08T19:23:06.563911+0000","last_clean":"2023-11-08T19:23:06.563911+0000","last_became_active":"2023-11-08T19:23:02.542868+0000","last_became_peered":"2023-11-08T19:23:02.542868+0000","last_unstale":"2023-11-08T19:23:06.563911+0000","last_undegraded":"2023-11-08T19:23:06.563911+0000","last_fullsized":"2023-11-08T19:23:06.563911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:49:46.796904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.574507+0000","last_change":"2023-11-08T19:23:02.541251+0000","last_active":"2023-11-08T19:23:06.574507+0000","last_peered":"2023-11-08T19:23:06.574507+0000","last_clean":"2023-11-08T19:23:06.574507+0000","last_became_active":"2023-11-08T19:23:02.540921+0000","last_became_peered":"2023-11-08T19:23:02.540921+0000","last_unstale":"2023-11-08T19:23:06.574507+0000","last_undegraded":"2023-11-08T19:23:06.574507+0000","last_fullsized":"2023-11-08T19:23:06.574507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:32:49.846143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.576611+0000","last_change":"2023-11-08T19:23:02.543682+0000","last_active":"2023-11-08T19:23:06.576611+0000","last_peered":"2023-11-08T19:23:06.576611+0000","last_clean":"2023-11-08T19:23:06.576611+0000","last_became_active":"2023-11-08T19:23:02.543385+0000","last_became_peered":"2023-11-08T19:23:02.543385+0000","last_unstale":"2023-11-08T19:23:06.576611+0000","last_undegraded":"2023-11-08T19:23:06.576611+0000","last_fullsized":"2023-11-08T19:23:06.576611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:47:36.694344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.575179+0000","last_change":"2023-11-08T19:23:02.547263+0000","last_active":"2023-11-08T19:23:06.575179+0000","last_peered":"2023-11-08T19:23:06.575179+0000","last_clean":"2023-11-08T19:23:06.575179+0000","last_became_active":"2023-11-08T19:23:02.546954+0000","last_became_peered":"2023-11-08T19:23:02.546954+0000","last_unstale":"2023-11-08T19:23:06.575179+0000","last_undegraded":"2023-11-08T19:23:06.575179+0000","last_fullsized":"2023-11-08T19:23:06.575179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:08:24.771220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.639865+0000","last_change":"2023-11-08T19:23:02.544942+0000","last_active":"2023-11-08T19:23:06.639865+0000","last_peered":"2023-11-08T19:23:06.639865+0000","last_clean":"2023-11-08T19:23:06.639865+0000","last_became_active":"2023-11-08T19:23:02.544398+0000","last_became_peered":"2023-11-08T19:23:02.544398+0000","last_unstale":"2023-11-08T19:23:06.639865+0000","last_undegraded":"2023-11-08T19:23:06.639865+0000","last_fullsized":"2023-11-08T19:23:06.639865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:11:14.699967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.015793+0000","last_change":"2023-11-08T19:23:06.643772+0000","last_active":"2023-11-08T19:23:09.015793+0000","last_peered":"2023-11-08T19:23:09.015793+0000","last_clean":"2023-11-08T19:23:09.015793+0000","last_became_active":"2023-11-08T19:23:06.643399+0000","last_became_peered":"2023-11-08T19:23:06.643399+0000","last_unstale":"2023-11-08T19:23:09.015793+0000","last_undegraded":"2023-11-08T19:23:09.015793+0000","last_fullsized":"2023-11-08T19:23:09.015793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:28:31.147987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.579108+0000","last_change":"2023-11-08T19:23:01.541807+0000","last_active":"2023-11-08T19:23:06.579108+0000","last_peered":"2023-11-08T19:23:06.579108+0000","last_clean":"2023-11-08T19:23:06.579108+0000","last_became_active":"2023-11-08T19:23:01.541518+0000","last_became_peered":"2023-11-08T19:23:01.541518+0000","last_unstale":"2023-11-08T19:23:06.579108+0000","last_undegraded":"2023-11-08T19:23:06.579108+0000","last_fullsized":"2023-11-08T19:23:06.579108+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:44:28.225190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.571988+0000","last_change":"2023-11-08T19:23:02.546804+0000","last_active":"2023-11-08T19:23:06.571988+0000","last_peered":"2023-11-08T19:23:06.571988+0000","last_clean":"2023-11-08T19:23:06.571988+0000","last_became_active":"2023-11-08T19:23:02.546539+0000","last_became_peered":"2023-11-08T19:23:02.546539+0000","last_unstale":"2023-11-08T19:23:06.571988+0000","last_undegraded":"2023-11-08T19:23:06.571988+0000","last_fullsized":"2023-11-08T19:23:06.571988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:11:14.699967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:07.567784+0000","last_change":"2023-11-08T19:23:06.590879+0000","last_active":"2023-11-08T19:23:07.567784+0000","last_peered":"2023-11-08T19:23:07.567784+0000","last_clean":"2023-11-08T19:23:07.567784+0000","last_became_active":"2023-11-08T19:23:06.590413+0000","last_became_peered":"2023-11-08T19:23:06.590413+0000","last_unstale":"2023-11-08T19:23:07.567784+0000","last_undegraded":"2023-11-08T19:23:07.567784+0000","last_fullsized":"2023-11-08T19:23:07.567784+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:07:43.895729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.572075+0000","last_change":"2023-11-08T19:23:01.539505+0000","last_active":"2023-11-08T19:23:06.572075+0000","last_peered":"2023-11-08T19:23:06.572075+0000","last_clean":"2023-11-08T19:23:06.572075+0000","last_became_active":"2023-11-08T19:23:01.539253+0000","last_became_peered":"2023-11-08T19:23:01.539253+0000","last_unstale":"2023-11-08T19:23:06.572075+0000","last_undegraded":"2023-11-08T19:23:06.572075+0000","last_fullsized":"2023-11-08T19:23:06.572075+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:43:54.669075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.578908+0000","last_change":"2023-11-08T19:23:02.541207+0000","last_active":"2023-11-08T19:23:06.578908+0000","last_peered":"2023-11-08T19:23:06.578908+0000","last_clean":"2023-11-08T19:23:06.578908+0000","last_became_active":"2023-11-08T19:23:02.541002+0000","last_became_peered":"2023-11-08T19:23:02.541002+0000","last_unstale":"2023-11-08T19:23:06.578908+0000","last_undegraded":"2023-11-08T19:23:06.578908+0000","last_fullsized":"2023-11-08T19:23:06.578908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:49:46.796904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:07.568103+0000","last_change":"2023-11-08T19:23:06.586229+0000","last_active":"2023-11-08T19:23:07.568103+0000","last_peered":"2023-11-08T19:23:07.568103+0000","last_clean":"2023-11-08T19:23:07.568103+0000","last_became_active":"2023-11-08T19:23:06.585784+0000","last_became_peered":"2023-11-08T19:23:06.585784+0000","last_unstale":"2023-11-08T19:23:07.568103+0000","last_undegraded":"2023-11-08T19:23:07.568103+0000","last_fullsized":"2023-11-08T19:23:07.568103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:47:40.737231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.639721+0000","last_change":"2023-11-08T19:23:01.541701+0000","last_active":"2023-11-08T19:23:06.639721+0000","last_peered":"2023-11-08T19:23:06.639721+0000","last_clean":"2023-11-08T19:23:06.639721+0000","last_became_active":"2023-11-08T19:23:01.541392+0000","last_became_peered":"2023-11-08T19:23:01.541392+0000","last_unstale":"2023-11-08T19:23:06.639721+0000","last_undegraded":"2023-11-08T19:23:06.639721+0000","last_fullsized":"2023-11-08T19:23:06.639721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:57:50.009215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.575956+0000","last_change":"2023-11-08T19:23:02.543734+0000","last_active":"2023-11-08T19:23:06.575956+0000","last_peered":"2023-11-08T19:23:06.575956+0000","last_clean":"2023-11-08T19:23:06.575956+0000","last_became_active":"2023-11-08T19:23:02.543300+0000","last_became_peered":"2023-11-08T19:23:02.543300+0000","last_unstale":"2023-11-08T19:23:06.575956+0000","last_undegraded":"2023-11-08T19:23:06.575956+0000","last_fullsized":"2023-11-08T19:23:06.575956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:50:33.507433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:07.566641+0000","last_change":"2023-11-08T19:23:06.590258+0000","last_active":"2023-11-08T19:23:07.566641+0000","last_peered":"2023-11-08T19:23:07.566641+0000","last_clean":"2023-11-08T19:23:07.566641+0000","last_became_active":"2023-11-08T19:23:06.589825+0000","last_became_peered":"2023-11-08T19:23:06.589825+0000","last_unstale":"2023-11-08T19:23:07.566641+0000","last_undegraded":"2023-11-08T19:23:07.566641+0000","last_fullsized":"2023-11-08T19:23:07.566641+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:56:06.637086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.640110+0000","last_change":"2023-11-08T19:23:01.543094+0000","last_active":"2023-11-08T19:23:06.640110+0000","last_peered":"2023-11-08T19:23:06.640110+0000","last_clean":"2023-11-08T19:23:06.640110+0000","last_became_active":"2023-11-08T19:23:01.542832+0000","last_became_peered":"2023-11-08T19:23:01.542832+0000","last_unstale":"2023-11-08T19:23:06.640110+0000","last_undegraded":"2023-11-08T19:23:06.640110+0000","last_fullsized":"2023-11-08T19:23:06.640110+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:08:23.765251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.575939+0000","last_change":"2023-11-08T19:23:02.543389+0000","last_active":"2023-11-08T19:23:06.575939+0000","last_peered":"2023-11-08T19:23:06.575939+0000","last_clean":"2023-11-08T19:23:06.575939+0000","last_became_active":"2023-11-08T19:23:02.543095+0000","last_became_peered":"2023-11-08T19:23:02.543095+0000","last_unstale":"2023-11-08T19:23:06.575939+0000","last_undegraded":"2023-11-08T19:23:06.575939+0000","last_fullsized":"2023-11-08T19:23:06.575939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:44:38.109774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.015608+0000","last_change":"2023-11-08T19:23:06.590901+0000","last_active":"2023-11-08T19:23:09.015608+0000","last_peered":"2023-11-08T19:23:09.015608+0000","last_clean":"2023-11-08T19:23:09.015608+0000","last_became_active":"2023-11-08T19:23:06.590468+0000","last_became_peered":"2023-11-08T19:23:06.590468+0000","last_unstale":"2023-11-08T19:23:09.015608+0000","last_undegraded":"2023-11-08T19:23:09.015608+0000","last_fullsized":"2023-11-08T19:23:09.015608+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:58:51.442881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.573313+0000","last_change":"2023-11-08T19:23:01.540429+0000","last_active":"2023-11-08T19:23:06.573313+0000","last_peered":"2023-11-08T19:23:06.573313+0000","last_clean":"2023-11-08T19:23:06.573313+0000","last_became_active":"2023-11-08T19:23:01.540170+0000","last_became_peered":"2023-11-08T19:23:01.540170+0000","last_unstale":"2023-11-08T19:23:06.573313+0000","last_undegraded":"2023-11-08T19:23:06.573313+0000","last_fullsized":"2023-11-08T19:23:06.573313+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:52:26.893730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.572037+0000","last_change":"2023-11-08T19:23:02.550930+0000","last_active":"2023-11-08T19:23:06.572037+0000","last_peered":"2023-11-08T19:23:06.572037+0000","last_clean":"2023-11-08T19:23:06.572037+0000","last_became_active":"2023-11-08T19:23:02.549412+0000","last_became_peered":"2023-11-08T19:23:02.549412+0000","last_unstale":"2023-11-08T19:23:06.572037+0000","last_undegraded":"2023-11-08T19:23:06.572037+0000","last_fullsized":"2023-11-08T19:23:06.572037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:07:17.652260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:07.565865+0000","last_change":"2023-11-08T19:23:06.593062+0000","last_active":"2023-11-08T19:23:07.565865+0000","last_peered":"2023-11-08T19:23:07.565865+0000","last_clean":"2023-11-08T19:23:07.565865+0000","last_became_active":"2023-11-08T19:23:06.592681+0000","last_became_peered":"2023-11-08T19:23:06.592681+0000","last_unstale":"2023-11-08T19:23:07.565865+0000","last_undegraded":"2023-11-08T19:23:07.565865+0000","last_fullsized":"2023-11-08T19:23:07.565865+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:43:59.717931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.565314+0000","last_change":"2023-11-08T19:23:01.532560+0000","last_active":"2023-11-08T19:23:06.565314+0000","last_peered":"2023-11-08T19:23:06.565314+0000","last_clean":"2023-11-08T19:23:06.565314+0000","last_became_active":"2023-11-08T19:23:01.532281+0000","last_became_peered":"2023-11-08T19:23:01.532281+0000","last_unstale":"2023-11-08T19:23:06.565314+0000","last_undegraded":"2023-11-08T19:23:06.565314+0000","last_fullsized":"2023-11-08T19:23:06.565314+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:43:54.669075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.579248+0000","last_change":"2023-11-08T19:23:02.536527+0000","last_active":"2023-11-08T19:23:06.579248+0000","last_peered":"2023-11-08T19:23:06.579248+0000","last_clean":"2023-11-08T19:23:06.579248+0000","last_became_active":"2023-11-08T19:23:02.535739+0000","last_became_peered":"2023-11-08T19:23:02.535739+0000","last_unstale":"2023-11-08T19:23:06.579248+0000","last_undegraded":"2023-11-08T19:23:06.579248+0000","last_fullsized":"2023-11-08T19:23:06.579248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:04:20.812993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:07.567254+0000","last_change":"2023-11-08T19:23:06.586558+0000","last_active":"2023-11-08T19:23:07.567254+0000","last_peered":"2023-11-08T19:23:07.567254+0000","last_clean":"2023-11-08T19:23:07.567254+0000","last_became_active":"2023-11-08T19:23:06.586151+0000","last_became_peered":"2023-11-08T19:23:06.586151+0000","last_unstale":"2023-11-08T19:23:07.567254+0000","last_undegraded":"2023-11-08T19:23:07.567254+0000","last_fullsized":"2023-11-08T19:23:07.567254+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:57:36.344289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.570862+0000","last_change":"2023-11-08T19:23:01.535020+0000","last_active":"2023-11-08T19:23:06.570862+0000","last_peered":"2023-11-08T19:23:06.570862+0000","last_clean":"2023-11-08T19:23:06.570862+0000","last_became_active":"2023-11-08T19:23:01.534728+0000","last_became_peered":"2023-11-08T19:23:01.534728+0000","last_unstale":"2023-11-08T19:23:06.570862+0000","last_undegraded":"2023-11-08T19:23:06.570862+0000","last_fullsized":"2023-11-08T19:23:06.570862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:08:23.765251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.570908+0000","last_change":"2023-11-08T19:23:02.531826+0000","last_active":"2023-11-08T19:23:06.570908+0000","last_peered":"2023-11-08T19:23:06.570908+0000","last_clean":"2023-11-08T19:23:06.570908+0000","last_became_active":"2023-11-08T19:23:02.530174+0000","last_became_peered":"2023-11-08T19:23:02.530174+0000","last_unstale":"2023-11-08T19:23:06.570908+0000","last_undegraded":"2023-11-08T19:23:06.570908+0000","last_fullsized":"2023-11-08T19:23:06.570908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:57:51.015184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.014696+0000","last_change":"2023-11-08T19:23:06.641030+0000","last_active":"2023-11-08T19:23:09.014696+0000","last_peered":"2023-11-08T19:23:09.014696+0000","last_clean":"2023-11-08T19:23:09.014696+0000","last_became_active":"2023-11-08T19:23:06.640656+0000","last_became_peered":"2023-11-08T19:23:06.640656+0000","last_unstale":"2023-11-08T19:23:09.014696+0000","last_undegraded":"2023-11-08T19:23:09.014696+0000","last_fullsized":"2023-11-08T19:23:09.014696+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:12:02.136296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.574607+0000","last_change":"2023-11-08T19:23:01.529713+0000","last_active":"2023-11-08T19:23:06.574607+0000","last_peered":"2023-11-08T19:23:06.574607+0000","last_clean":"2023-11-08T19:23:06.574607+0000","last_became_active":"2023-11-08T19:23:01.528648+0000","last_became_peered":"2023-11-08T19:23:01.528648+0000","last_unstale":"2023-11-08T19:23:06.574607+0000","last_undegraded":"2023-11-08T19:23:06.574607+0000","last_fullsized":"2023-11-08T19:23:06.574607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:01:16.688194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.564020+0000","last_change":"2023-11-08T19:23:02.535673+0000","last_active":"2023-11-08T19:23:06.564020+0000","last_peered":"2023-11-08T19:23:06.564020+0000","last_clean":"2023-11-08T19:23:06.564020+0000","last_became_active":"2023-11-08T19:23:02.535411+0000","last_became_peered":"2023-11-08T19:23:02.535411+0000","last_unstale":"2023-11-08T19:23:06.564020+0000","last_undegraded":"2023-11-08T19:23:06.564020+0000","last_fullsized":"2023-11-08T19:23:06.564020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:56:02.594198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.015406+0000","last_change":"2023-11-08T19:23:06.643953+0000","last_active":"2023-11-08T19:23:09.015406+0000","last_peered":"2023-11-08T19:23:09.015406+0000","last_clean":"2023-11-08T19:23:09.015406+0000","last_became_active":"2023-11-08T19:23:06.643457+0000","last_became_peered":"2023-11-08T19:23:06.643457+0000","last_unstale":"2023-11-08T19:23:09.015406+0000","last_undegraded":"2023-11-08T19:23:09.015406+0000","last_fullsized":"2023-11-08T19:23:09.015406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:04:23.883480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.569588+0000","last_change":"2023-11-08T19:23:01.535403+0000","last_active":"2023-11-08T19:23:06.569588+0000","last_peered":"2023-11-08T19:23:06.569588+0000","last_clean":"2023-11-08T19:23:06.569588+0000","last_became_active":"2023-11-08T19:23:01.535102+0000","last_became_peered":"2023-11-08T19:23:01.535102+0000","last_unstale":"2023-11-08T19:23:06.569588+0000","last_undegraded":"2023-11-08T19:23:06.569588+0000","last_fullsized":"2023-11-08T19:23:06.569588+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:55.765637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.575598+0000","last_change":"2023-11-08T19:23:02.543531+0000","last_active":"2023-11-08T19:23:06.575598+0000","last_peered":"2023-11-08T19:23:06.575598+0000","last_clean":"2023-11-08T19:23:06.575598+0000","last_became_active":"2023-11-08T19:23:02.543160+0000","last_became_peered":"2023-11-08T19:23:02.543160+0000","last_unstale":"2023-11-08T19:23:06.575598+0000","last_undegraded":"2023-11-08T19:23:06.575598+0000","last_fullsized":"2023-11-08T19:23:06.575598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:04:20.812993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.014869+0000","last_change":"2023-11-08T19:23:06.589913+0000","last_active":"2023-11-08T19:23:09.014869+0000","last_peered":"2023-11-08T19:23:09.014869+0000","last_clean":"2023-11-08T19:23:09.014869+0000","last_became_active":"2023-11-08T19:23:06.589510+0000","last_became_peered":"2023-11-08T19:23:06.589510+0000","last_unstale":"2023-11-08T19:23:09.014869+0000","last_undegraded":"2023-11-08T19:23:09.014869+0000","last_fullsized":"2023-11-08T19:23:09.014869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:14:35.302430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.575682+0000","last_change":"2023-11-08T19:23:01.533936+0000","last_active":"2023-11-08T19:23:06.575682+0000","last_peered":"2023-11-08T19:23:06.575682+0000","last_clean":"2023-11-08T19:23:06.575682+0000","last_became_active":"2023-11-08T19:23:01.533445+0000","last_became_peered":"2023-11-08T19:23:01.533445+0000","last_unstale":"2023-11-08T19:23:06.575682+0000","last_undegraded":"2023-11-08T19:23:06.575682+0000","last_fullsized":"2023-11-08T19:23:06.575682+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:24:26.663271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.579037+0000","last_change":"2023-11-08T19:23:02.541241+0000","last_active":"2023-11-08T19:23:06.579037+0000","last_peered":"2023-11-08T19:23:06.579037+0000","last_clean":"2023-11-08T19:23:06.579037+0000","last_became_active":"2023-11-08T19:23:02.540969+0000","last_became_peered":"2023-11-08T19:23:02.540969+0000","last_unstale":"2023-11-08T19:23:06.579037+0000","last_undegraded":"2023-11-08T19:23:06.579037+0000","last_fullsized":"2023-11-08T19:23:06.579037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:32:49.846143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:07.568360+0000","last_change":"2023-11-08T19:23:06.585996+0000","last_active":"2023-11-08T19:23:07.568360+0000","last_peered":"2023-11-08T19:23:07.568360+0000","last_clean":"2023-11-08T19:23:07.568360+0000","last_became_active":"2023-11-08T19:23:06.585579+0000","last_became_peered":"2023-11-08T19:23:06.585579+0000","last_unstale":"2023-11-08T19:23:07.568360+0000","last_undegraded":"2023-11-08T19:23:07.568360+0000","last_fullsized":"2023-11-08T19:23:07.568360+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:00:52.733076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.565054+0000","last_change":"2023-11-08T19:23:01.536963+0000","last_active":"2023-11-08T19:23:06.565054+0000","last_peered":"2023-11-08T19:23:06.565054+0000","last_clean":"2023-11-08T19:23:06.565054+0000","last_became_active":"2023-11-08T19:23:01.536702+0000","last_became_peered":"2023-11-08T19:23:01.536702+0000","last_unstale":"2023-11-08T19:23:06.565054+0000","last_undegraded":"2023-11-08T19:23:06.565054+0000","last_fullsized":"2023-11-08T19:23:06.565054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:08:23.765251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.569403+0000","last_change":"2023-11-08T19:23:02.544062+0000","last_active":"2023-11-08T19:23:06.569403+0000","last_peered":"2023-11-08T19:23:06.569403+0000","last_clean":"2023-11-08T19:23:06.569403+0000","last_became_active":"2023-11-08T19:23:02.543731+0000","last_became_peered":"2023-11-08T19:23:02.543731+0000","last_unstale":"2023-11-08T19:23:06.569403+0000","last_undegraded":"2023-11-08T19:23:06.569403+0000","last_fullsized":"2023-11-08T19:23:06.569403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:47:08.776316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.014631+0000","last_change":"2023-11-08T19:23:06.586643+0000","last_active":"2023-11-08T19:23:09.014631+0000","last_peered":"2023-11-08T19:23:09.014631+0000","last_clean":"2023-11-08T19:23:09.014631+0000","last_became_active":"2023-11-08T19:23:06.586257+0000","last_became_peered":"2023-11-08T19:23:06.586257+0000","last_unstale":"2023-11-08T19:23:09.014631+0000","last_undegraded":"2023-11-08T19:23:09.014631+0000","last_fullsized":"2023-11-08T19:23:09.014631+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:22:45.636851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"24'10","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:17.837099+0000","last_change":"2023-11-08T19:23:01.537108+0000","last_active":"2023-11-08T19:23:17.837099+0000","last_peered":"2023-11-08T19:23:17.837099+0000","last_clean":"2023-11-08T19:23:17.837099+0000","last_became_active":"2023-11-08T19:23:01.536695+0000","last_became_peered":"2023-11-08T19:23:01.536695+0000","last_unstale":"2023-11-08T19:23:17.837099+0000","last_undegraded":"2023-11-08T19:23:17.837099+0000","last_fullsized":"2023-11-08T19:23:17.837099+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:49:45.790935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.639812+0000","last_change":"2023-11-08T19:23:02.544703+0000","last_active":"2023-11-08T19:23:06.639812+0000","last_peered":"2023-11-08T19:23:06.639812+0000","last_clean":"2023-11-08T19:23:06.639812+0000","last_became_active":"2023-11-08T19:23:02.543964+0000","last_became_peered":"2023-11-08T19:23:02.543964+0000","last_unstale":"2023-11-08T19:23:06.639812+0000","last_undegraded":"2023-11-08T19:23:06.639812+0000","last_fullsized":"2023-11-08T19:23:06.639812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:07:39.852842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.015350+0000","last_change":"2023-11-08T19:23:06.639882+0000","last_active":"2023-11-08T19:23:09.015350+0000","last_peered":"2023-11-08T19:23:09.015350+0000","last_clean":"2023-11-08T19:23:09.015350+0000","last_became_active":"2023-11-08T19:23:06.639513+0000","last_became_peered":"2023-11-08T19:23:06.639513+0000","last_unstale":"2023-11-08T19:23:09.015350+0000","last_undegraded":"2023-11-08T19:23:09.015350+0000","last_fullsized":"2023-11-08T19:23:09.015350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:04:23.883480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.579599+0000","last_change":"2023-11-08T19:23:01.542024+0000","last_active":"2023-11-08T19:23:06.579599+0000","last_peered":"2023-11-08T19:23:06.579599+0000","last_clean":"2023-11-08T19:23:06.579599+0000","last_became_active":"2023-11-08T19:23:01.541307+0000","last_became_peered":"2023-11-08T19:23:01.541307+0000","last_unstale":"2023-11-08T19:23:06.579599+0000","last_undegraded":"2023-11-08T19:23:06.579599+0000","last_fullsized":"2023-11-08T19:23:06.579599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:07:16.646292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.580444+0000","last_change":"2023-11-08T19:23:02.543049+0000","last_active":"2023-11-08T19:23:06.580444+0000","last_peered":"2023-11-08T19:23:06.580444+0000","last_clean":"2023-11-08T19:23:06.580444+0000","last_became_active":"2023-11-08T19:23:02.542652+0000","last_became_peered":"2023-11-08T19:23:02.542652+0000","last_unstale":"2023-11-08T19:23:06.580444+0000","last_undegraded":"2023-11-08T19:23:06.580444+0000","last_fullsized":"2023-11-08T19:23:06.580444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:43:55.675044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.015406+0000","last_change":"2023-11-08T19:23:06.640235+0000","last_active":"2023-11-08T19:23:09.015406+0000","last_peered":"2023-11-08T19:23:09.015406+0000","last_clean":"2023-11-08T19:23:09.015406+0000","last_became_active":"2023-11-08T19:23:06.639813+0000","last_became_peered":"2023-11-08T19:23:06.639813+0000","last_unstale":"2023-11-08T19:23:09.015406+0000","last_undegraded":"2023-11-08T19:23:09.015406+0000","last_fullsized":"2023-11-08T19:23:09.015406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:11:17.824585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.574994+0000","last_change":"2023-11-08T19:23:01.537071+0000","last_active":"2023-11-08T19:23:06.574994+0000","last_peered":"2023-11-08T19:23:06.574994+0000","last_clean":"2023-11-08T19:23:06.574994+0000","last_became_active":"2023-11-08T19:23:01.536098+0000","last_became_peered":"2023-11-08T19:23:01.536098+0000","last_unstale":"2023-11-08T19:23:06.574994+0000","last_undegraded":"2023-11-08T19:23:06.574994+0000","last_fullsized":"2023-11-08T19:23:06.574994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:57:50.009215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.640434+0000","last_change":"2023-11-08T19:23:02.543183+0000","last_active":"2023-11-08T19:23:06.640434+0000","last_peered":"2023-11-08T19:23:06.640434+0000","last_clean":"2023-11-08T19:23:06.640434+0000","last_became_active":"2023-11-08T19:23:02.542928+0000","last_became_peered":"2023-11-08T19:23:02.542928+0000","last_unstale":"2023-11-08T19:23:06.640434+0000","last_undegraded":"2023-11-08T19:23:06.640434+0000","last_fullsized":"2023-11-08T19:23:06.640434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:11:58.093408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.015907+0000","last_change":"2023-11-08T19:23:06.642851+0000","last_active":"2023-11-08T19:23:09.015907+0000","last_peered":"2023-11-08T19:23:09.015907+0000","last_clean":"2023-11-08T19:23:09.015907+0000","last_became_active":"2023-11-08T19:23:06.642494+0000","last_became_peered":"2023-11-08T19:23:06.642494+0000","last_unstale":"2023-11-08T19:23:09.015907+0000","last_undegraded":"2023-11-08T19:23:09.015907+0000","last_fullsized":"2023-11-08T19:23:09.015907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:56:41.083975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.565079+0000","last_change":"2023-11-08T19:23:01.531395+0000","last_active":"2023-11-08T19:23:06.565079+0000","last_peered":"2023-11-08T19:23:06.565079+0000","last_clean":"2023-11-08T19:23:06.565079+0000","last_became_active":"2023-11-08T19:23:01.531114+0000","last_became_peered":"2023-11-08T19:23:01.531114+0000","last_unstale":"2023-11-08T19:23:06.565079+0000","last_undegraded":"2023-11-08T19:23:06.565079+0000","last_fullsized":"2023-11-08T19:23:06.565079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:28:21.147246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.565518+0000","last_change":"2023-11-08T19:23:02.539528+0000","last_active":"2023-11-08T19:23:06.565518+0000","last_peered":"2023-11-08T19:23:06.565518+0000","last_clean":"2023-11-08T19:23:06.565518+0000","last_became_active":"2023-11-08T19:23:02.539287+0000","last_became_peered":"2023-11-08T19:23:02.539287+0000","last_unstale":"2023-11-08T19:23:06.565518+0000","last_undegraded":"2023-11-08T19:23:06.565518+0000","last_fullsized":"2023-11-08T19:23:06.565518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:57:51.015184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.014311+0000","last_change":"2023-11-08T19:23:06.592797+0000","last_active":"2023-11-08T19:23:09.014311+0000","last_peered":"2023-11-08T19:23:09.014311+0000","last_clean":"2023-11-08T19:23:09.014311+0000","last_became_active":"2023-11-08T19:23:06.592322+0000","last_became_peered":"2023-11-08T19:23:06.592322+0000","last_unstale":"2023-11-08T19:23:09.014311+0000","last_undegraded":"2023-11-08T19:23:09.014311+0000","last_fullsized":"2023-11-08T19:23:09.014311+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:00:52.733076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.571985+0000","last_change":"2023-11-08T19:23:01.534386+0000","last_active":"2023-11-08T19:23:06.571985+0000","last_peered":"2023-11-08T19:23:06.571985+0000","last_clean":"2023-11-08T19:23:06.571985+0000","last_became_active":"2023-11-08T19:23:01.534065+0000","last_became_peered":"2023-11-08T19:23:01.534065+0000","last_unstale":"2023-11-08T19:23:06.571985+0000","last_undegraded":"2023-11-08T19:23:06.571985+0000","last_fullsized":"2023-11-08T19:23:06.571985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:27:47.069795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.638816+0000","last_change":"2023-11-08T19:23:02.542014+0000","last_active":"2023-11-08T19:23:06.638816+0000","last_peered":"2023-11-08T19:23:06.638816+0000","last_clean":"2023-11-08T19:23:06.638816+0000","last_became_active":"2023-11-08T19:23:02.541699+0000","last_became_peered":"2023-11-08T19:23:02.541699+0000","last_unstale":"2023-11-08T19:23:06.638816+0000","last_undegraded":"2023-11-08T19:23:06.638816+0000","last_fullsized":"2023-11-08T19:23:06.638816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:58:59.199208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:07.567280+0000","last_change":"2023-11-08T19:23:06.581489+0000","last_active":"2023-11-08T19:23:07.567280+0000","last_peered":"2023-11-08T19:23:07.567280+0000","last_clean":"2023-11-08T19:23:07.567280+0000","last_became_active":"2023-11-08T19:23:06.581010+0000","last_became_peered":"2023-11-08T19:23:06.581010+0000","last_unstale":"2023-11-08T19:23:07.567280+0000","last_undegraded":"2023-11-08T19:23:07.567280+0000","last_fullsized":"2023-11-08T19:23:07.567280+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:44:42.152662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.572396+0000","last_change":"2023-11-08T19:23:01.539745+0000","last_active":"2023-11-08T19:23:06.572396+0000","last_peered":"2023-11-08T19:23:06.572396+0000","last_clean":"2023-11-08T19:23:06.572396+0000","last_became_active":"2023-11-08T19:23:01.539413+0000","last_became_peered":"2023-11-08T19:23:01.539413+0000","last_unstale":"2023-11-08T19:23:06.572396+0000","last_undegraded":"2023-11-08T19:23:06.572396+0000","last_fullsized":"2023-11-08T19:23:06.572396+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:29:59.299789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.640045+0000","last_change":"2023-11-08T19:23:02.551120+0000","last_active":"2023-11-08T19:23:06.640045+0000","last_peered":"2023-11-08T19:23:06.640045+0000","last_clean":"2023-11-08T19:23:06.640045+0000","last_became_active":"2023-11-08T19:23:02.550824+0000","last_became_peered":"2023-11-08T19:23:02.550824+0000","last_unstale":"2023-11-08T19:23:06.640045+0000","last_undegraded":"2023-11-08T19:23:06.640045+0000","last_fullsized":"2023-11-08T19:23:06.640045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:57:32.301401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.014492+0000","last_change":"2023-11-08T19:23:06.587021+0000","last_active":"2023-11-08T19:23:09.014492+0000","last_peered":"2023-11-08T19:23:09.014492+0000","last_clean":"2023-11-08T19:23:09.014492+0000","last_became_active":"2023-11-08T19:23:06.586659+0000","last_became_peered":"2023-11-08T19:23:06.586659+0000","last_unstale":"2023-11-08T19:23:09.014492+0000","last_undegraded":"2023-11-08T19:23:09.014492+0000","last_fullsized":"2023-11-08T19:23:09.014492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:57:36.344289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.564688+0000","last_change":"2023-11-08T19:23:01.539782+0000","last_active":"2023-11-08T19:23:06.564688+0000","last_peered":"2023-11-08T19:23:06.564688+0000","last_clean":"2023-11-08T19:23:06.564688+0000","last_became_active":"2023-11-08T19:23:01.539493+0000","last_became_peered":"2023-11-08T19:23:01.539493+0000","last_unstale":"2023-11-08T19:23:06.564688+0000","last_undegraded":"2023-11-08T19:23:06.564688+0000","last_fullsized":"2023-11-08T19:23:06.564688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:45:54.766612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.576303+0000","last_change":"2023-11-08T19:23:02.540720+0000","last_active":"2023-11-08T19:23:06.576303+0000","last_peered":"2023-11-08T19:23:06.576303+0000","last_clean":"2023-11-08T19:23:06.576303+0000","last_became_active":"2023-11-08T19:23:02.540438+0000","last_became_peered":"2023-11-08T19:23:02.540438+0000","last_unstale":"2023-11-08T19:23:06.576303+0000","last_undegraded":"2023-11-08T19:23:06.576303+0000","last_fullsized":"2023-11-08T19:23:06.576303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:07:39.852842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.014689+0000","last_change":"2023-11-08T19:23:06.590376+0000","last_active":"2023-11-08T19:23:09.014689+0000","last_peered":"2023-11-08T19:23:09.014689+0000","last_clean":"2023-11-08T19:23:09.014689+0000","last_became_active":"2023-11-08T19:23:06.590037+0000","last_became_peered":"2023-11-08T19:23:06.590037+0000","last_unstale":"2023-11-08T19:23:09.014689+0000","last_undegraded":"2023-11-08T19:23:09.014689+0000","last_fullsized":"2023-11-08T19:23:09.014689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:02:22.908243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.574893+0000","last_change":"2023-11-08T19:23:01.534469+0000","last_active":"2023-11-08T19:23:06.574893+0000","last_peered":"2023-11-08T19:23:06.574893+0000","last_clean":"2023-11-08T19:23:06.574893+0000","last_became_active":"2023-11-08T19:23:01.534138+0000","last_became_peered":"2023-11-08T19:23:01.534138+0000","last_unstale":"2023-11-08T19:23:06.574893+0000","last_undegraded":"2023-11-08T19:23:06.574893+0000","last_fullsized":"2023-11-08T19:23:06.574893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:49:45.790935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.572089+0000","last_change":"2023-11-08T19:23:02.542108+0000","last_active":"2023-11-08T19:23:06.572089+0000","last_peered":"2023-11-08T19:23:06.572089+0000","last_clean":"2023-11-08T19:23:06.572089+0000","last_became_active":"2023-11-08T19:23:02.541821+0000","last_became_peered":"2023-11-08T19:23:02.541821+0000","last_unstale":"2023-11-08T19:23:06.572089+0000","last_undegraded":"2023-11-08T19:23:06.572089+0000","last_fullsized":"2023-11-08T19:23:06.572089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:28:22.153214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.014620+0000","last_change":"2023-11-08T19:23:06.588541+0000","last_active":"2023-11-08T19:23:09.014620+0000","last_peered":"2023-11-08T19:23:09.014620+0000","last_clean":"2023-11-08T19:23:09.014620+0000","last_became_active":"2023-11-08T19:23:06.588061+0000","last_became_peered":"2023-11-08T19:23:06.588061+0000","last_unstale":"2023-11-08T19:23:09.014620+0000","last_undegraded":"2023-11-08T19:23:09.014620+0000","last_fullsized":"2023-11-08T19:23:09.014620+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:12:02.136296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.563850+0000","last_change":"2023-11-08T19:23:02.538424+0000","last_active":"2023-11-08T19:23:06.563850+0000","last_peered":"2023-11-08T19:23:06.563850+0000","last_clean":"2023-11-08T19:23:06.563850+0000","last_became_active":"2023-11-08T19:23:02.538207+0000","last_became_peered":"2023-11-08T19:23:02.538207+0000","last_unstale":"2023-11-08T19:23:06.563850+0000","last_undegraded":"2023-11-08T19:23:06.563850+0000","last_fullsized":"2023-11-08T19:23:06.563850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:57:51.015184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.572118+0000","last_change":"2023-11-08T19:23:01.537154+0000","last_active":"2023-11-08T19:23:06.572118+0000","last_peered":"2023-11-08T19:23:06.572118+0000","last_clean":"2023-11-08T19:23:06.572118+0000","last_became_active":"2023-11-08T19:23:01.536883+0000","last_became_peered":"2023-11-08T19:23:01.536883+0000","last_unstale":"2023-11-08T19:23:06.572118+0000","last_undegraded":"2023-11-08T19:23:06.572118+0000","last_fullsized":"2023-11-08T19:23:06.572118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:35:12.900048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:07.566888+0000","last_change":"2023-11-08T19:23:06.641281+0000","last_active":"2023-11-08T19:23:07.566888+0000","last_peered":"2023-11-08T19:23:07.566888+0000","last_clean":"2023-11-08T19:23:07.566888+0000","last_became_active":"2023-11-08T19:23:06.640919+0000","last_became_peered":"2023-11-08T19:23:06.640919+0000","last_unstale":"2023-11-08T19:23:07.566888+0000","last_undegraded":"2023-11-08T19:23:07.566888+0000","last_fullsized":"2023-11-08T19:23:07.566888+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:12:02.136296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.574338+0000","last_change":"2023-11-08T19:23:02.551226+0000","last_active":"2023-11-08T19:23:06.574338+0000","last_peered":"2023-11-08T19:23:06.574338+0000","last_clean":"2023-11-08T19:23:06.574338+0000","last_became_active":"2023-11-08T19:23:02.550970+0000","last_became_peered":"2023-11-08T19:23:02.550970+0000","last_unstale":"2023-11-08T19:23:06.574338+0000","last_undegraded":"2023-11-08T19:23:06.574338+0000","last_fullsized":"2023-11-08T19:23:06.574338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:32:49.846143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.576524+0000","last_change":"2023-11-08T19:23:01.533619+0000","last_active":"2023-11-08T19:23:06.576524+0000","last_peered":"2023-11-08T19:23:06.576524+0000","last_clean":"2023-11-08T19:23:06.576524+0000","last_became_active":"2023-11-08T19:23:01.532909+0000","last_became_peered":"2023-11-08T19:23:01.532909+0000","last_unstale":"2023-11-08T19:23:06.576524+0000","last_undegraded":"2023-11-08T19:23:06.576524+0000","last_fullsized":"2023-11-08T19:23:06.576524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:28:21.147246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.636980+0000","last_change":"2023-11-08T19:22:58.054283+0000","last_active":"2023-11-08T19:23:06.636980+0000","last_peered":"2023-11-08T19:23:06.636980+0000","last_clean":"2023-11-08T19:23:06.636980+0000","last_became_active":"2023-11-08T19:22:58.053337+0000","last_became_peered":"2023-11-08T19:22:58.053337+0000","last_unstale":"2023-11-08T19:23:06.636980+0000","last_undegraded":"2023-11-08T19:23:06.636980+0000","last_fullsized":"2023-11-08T19:23:06.636980+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:22:56.479654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:22:56.479654+0000","last_clean_scrub_stamp":"2023-11-08T19:22:56.479654+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:16:05.317001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.014474+0000","last_change":"2023-11-08T19:23:06.638413+0000","last_active":"2023-11-08T19:23:09.014474+0000","last_peered":"2023-11-08T19:23:09.014474+0000","last_clean":"2023-11-08T19:23:09.014474+0000","last_became_active":"2023-11-08T19:23:06.638031+0000","last_became_peered":"2023-11-08T19:23:06.638031+0000","last_unstale":"2023-11-08T19:23:09.014474+0000","last_undegraded":"2023-11-08T19:23:09.014474+0000","last_fullsized":"2023-11-08T19:23:09.014474+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:57:36.344289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.569505+0000","last_change":"2023-11-08T19:23:02.534618+0000","last_active":"2023-11-08T19:23:06.569505+0000","last_peered":"2023-11-08T19:23:06.569505+0000","last_clean":"2023-11-08T19:23:06.569505+0000","last_became_active":"2023-11-08T19:23:02.534330+0000","last_became_peered":"2023-11-08T19:23:02.534330+0000","last_unstale":"2023-11-08T19:23:06.569505+0000","last_undegraded":"2023-11-08T19:23:06.569505+0000","last_fullsized":"2023-11-08T19:23:06.569505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:45:55.772580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.637061+0000","last_change":"2023-11-08T19:23:01.540830+0000","last_active":"2023-11-08T19:23:06.637061+0000","last_peered":"2023-11-08T19:23:06.637061+0000","last_clean":"2023-11-08T19:23:06.637061+0000","last_became_active":"2023-11-08T19:23:01.540497+0000","last_became_peered":"2023-11-08T19:23:01.540497+0000","last_unstale":"2023-11-08T19:23:06.637061+0000","last_undegraded":"2023-11-08T19:23:06.637061+0000","last_fullsized":"2023-11-08T19:23:06.637061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:44:28.225190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.014795+0000","last_change":"2023-11-08T19:23:06.638492+0000","last_active":"2023-11-08T19:23:09.014795+0000","last_peered":"2023-11-08T19:23:09.014795+0000","last_clean":"2023-11-08T19:23:09.014795+0000","last_became_active":"2023-11-08T19:23:06.637973+0000","last_became_peered":"2023-11-08T19:23:06.637973+0000","last_unstale":"2023-11-08T19:23:09.014795+0000","last_undegraded":"2023-11-08T19:23:09.014795+0000","last_fullsized":"2023-11-08T19:23:09.014795+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:22:45.636851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.639665+0000","last_change":"2023-11-08T19:23:01.541030+0000","last_active":"2023-11-08T19:23:06.639665+0000","last_peered":"2023-11-08T19:23:06.639665+0000","last_clean":"2023-11-08T19:23:06.639665+0000","last_became_active":"2023-11-08T19:23:01.540713+0000","last_became_peered":"2023-11-08T19:23:01.540713+0000","last_unstale":"2023-11-08T19:23:06.639665+0000","last_undegraded":"2023-11-08T19:23:06.639665+0000","last_fullsized":"2023-11-08T19:23:06.639665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:49:45.790935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.564785+0000","last_change":"2023-11-08T19:23:02.534477+0000","last_active":"2023-11-08T19:23:06.564785+0000","last_peered":"2023-11-08T19:23:06.564785+0000","last_clean":"2023-11-08T19:23:06.564785+0000","last_became_active":"2023-11-08T19:23:02.534220+0000","last_became_peered":"2023-11-08T19:23:02.534220+0000","last_unstale":"2023-11-08T19:23:06.564785+0000","last_undegraded":"2023-11-08T19:23:06.564785+0000","last_fullsized":"2023-11-08T19:23:06.564785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:24:27.669240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.014669+0000","last_change":"2023-11-08T19:23:06.642788+0000","last_active":"2023-11-08T19:23:09.014669+0000","last_peered":"2023-11-08T19:23:09.014669+0000","last_clean":"2023-11-08T19:23:09.014669+0000","last_became_active":"2023-11-08T19:23:06.642353+0000","last_became_peered":"2023-11-08T19:23:06.642353+0000","last_unstale":"2023-11-08T19:23:09.014669+0000","last_undegraded":"2023-11-08T19:23:09.014669+0000","last_fullsized":"2023-11-08T19:23:09.014669+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:33:01.642232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.564741+0000","last_change":"2023-11-08T19:23:01.534206+0000","last_active":"2023-11-08T19:23:06.564741+0000","last_peered":"2023-11-08T19:23:06.564741+0000","last_clean":"2023-11-08T19:23:06.564741+0000","last_became_active":"2023-11-08T19:23:01.533951+0000","last_became_peered":"2023-11-08T19:23:01.533951+0000","last_unstale":"2023-11-08T19:23:06.564741+0000","last_undegraded":"2023-11-08T19:23:06.564741+0000","last_fullsized":"2023-11-08T19:23:06.564741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:52:26.893730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.572311+0000","last_change":"2023-11-08T19:23:02.543044+0000","last_active":"2023-11-08T19:23:06.572311+0000","last_peered":"2023-11-08T19:23:06.572311+0000","last_clean":"2023-11-08T19:23:06.572311+0000","last_became_active":"2023-11-08T19:23:02.542767+0000","last_became_peered":"2023-11-08T19:23:02.542767+0000","last_unstale":"2023-11-08T19:23:06.572311+0000","last_undegraded":"2023-11-08T19:23:06.572311+0000","last_fullsized":"2023-11-08T19:23:06.572311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:07:39.852842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:07.567464+0000","last_change":"2023-11-08T19:23:06.638770+0000","last_active":"2023-11-08T19:23:07.567464+0000","last_peered":"2023-11-08T19:23:07.567464+0000","last_clean":"2023-11-08T19:23:07.567464+0000","last_became_active":"2023-11-08T19:23:06.638045+0000","last_became_peered":"2023-11-08T19:23:06.638045+0000","last_unstale":"2023-11-08T19:23:07.567464+0000","last_undegraded":"2023-11-08T19:23:07.567464+0000","last_fullsized":"2023-11-08T19:23:07.567464+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:15:27.237227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.565881+0000","last_change":"2023-11-08T19:23:01.541938+0000","last_active":"2023-11-08T19:23:06.565881+0000","last_peered":"2023-11-08T19:23:06.565881+0000","last_clean":"2023-11-08T19:23:06.565881+0000","last_became_active":"2023-11-08T19:23:01.541534+0000","last_became_peered":"2023-11-08T19:23:01.541534+0000","last_unstale":"2023-11-08T19:23:06.565881+0000","last_undegraded":"2023-11-08T19:23:06.565881+0000","last_fullsized":"2023-11-08T19:23:06.565881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:47:07.770348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.578982+0000","last_change":"2023-11-08T19:23:02.538688+0000","last_active":"2023-11-08T19:23:06.578982+0000","last_peered":"2023-11-08T19:23:06.578982+0000","last_clean":"2023-11-08T19:23:06.578982+0000","last_became_active":"2023-11-08T19:23:02.538406+0000","last_became_peered":"2023-11-08T19:23:02.538406+0000","last_unstale":"2023-11-08T19:23:06.578982+0000","last_undegraded":"2023-11-08T19:23:06.578982+0000","last_fullsized":"2023-11-08T19:23:06.578982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:24:27.669240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:07.568066+0000","last_change":"2023-11-08T19:23:06.586884+0000","last_active":"2023-11-08T19:23:07.568066+0000","last_peered":"2023-11-08T19:23:07.568066+0000","last_clean":"2023-11-08T19:23:07.568066+0000","last_became_active":"2023-11-08T19:23:06.585724+0000","last_became_peered":"2023-11-08T19:23:06.585724+0000","last_unstale":"2023-11-08T19:23:07.568066+0000","last_undegraded":"2023-11-08T19:23:07.568066+0000","last_fullsized":"2023-11-08T19:23:07.568066+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:50:37.550320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.636980+0000","last_change":"2023-11-08T19:23:01.541119+0000","last_active":"2023-11-08T19:23:06.636980+0000","last_peered":"2023-11-08T19:23:06.636980+0000","last_clean":"2023-11-08T19:23:06.636980+0000","last_became_active":"2023-11-08T19:23:01.540784+0000","last_became_peered":"2023-11-08T19:23:01.540784+0000","last_unstale":"2023-11-08T19:23:06.636980+0000","last_undegraded":"2023-11-08T19:23:06.636980+0000","last_fullsized":"2023-11-08T19:23:06.636980+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:47:07.770348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.567795+0000","last_change":"2023-11-08T19:23:02.536086+0000","last_active":"2023-11-08T19:23:06.567795+0000","last_peered":"2023-11-08T19:23:06.567795+0000","last_clean":"2023-11-08T19:23:06.567795+0000","last_became_active":"2023-11-08T19:23:02.535129+0000","last_became_peered":"2023-11-08T19:23:02.535129+0000","last_unstale":"2023-11-08T19:23:06.567795+0000","last_undegraded":"2023-11-08T19:23:06.567795+0000","last_fullsized":"2023-11-08T19:23:06.567795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:01:17.694162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.014391+0000","last_change":"2023-11-08T19:23:06.639503+0000","last_active":"2023-11-08T19:23:09.014391+0000","last_peered":"2023-11-08T19:23:09.014391+0000","last_clean":"2023-11-08T19:23:09.014391+0000","last_became_active":"2023-11-08T19:23:06.639076+0000","last_became_peered":"2023-11-08T19:23:06.639076+0000","last_unstale":"2023-11-08T19:23:09.014391+0000","last_undegraded":"2023-11-08T19:23:09.014391+0000","last_fullsized":"2023-11-08T19:23:09.014391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:00:52.733076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.563944+0000","last_change":"2023-11-08T19:23:01.539723+0000","last_active":"2023-11-08T19:23:06.563944+0000","last_peered":"2023-11-08T19:23:06.563944+0000","last_clean":"2023-11-08T19:23:06.563944+0000","last_became_active":"2023-11-08T19:23:01.539435+0000","last_became_peered":"2023-11-08T19:23:01.539435+0000","last_unstale":"2023-11-08T19:23:06.563944+0000","last_undegraded":"2023-11-08T19:23:06.563944+0000","last_fullsized":"2023-11-08T19:23:06.563944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:01:16.688194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.571014+0000","last_change":"2023-11-08T19:23:02.539571+0000","last_active":"2023-11-08T19:23:06.571014+0000","last_peered":"2023-11-08T19:23:06.571014+0000","last_clean":"2023-11-08T19:23:06.571014+0000","last_became_active":"2023-11-08T19:23:02.539301+0000","last_became_peered":"2023-11-08T19:23:02.539301+0000","last_unstale":"2023-11-08T19:23:06.571014+0000","last_undegraded":"2023-11-08T19:23:06.571014+0000","last_fullsized":"2023-11-08T19:23:06.571014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:24:27.669240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:07.567147+0000","last_change":"2023-11-08T19:23:06.590255+0000","last_active":"2023-11-08T19:23:07.567147+0000","last_peered":"2023-11-08T19:23:07.567147+0000","last_clean":"2023-11-08T19:23:07.567147+0000","last_became_active":"2023-11-08T19:23:06.589834+0000","last_became_peered":"2023-11-08T19:23:06.589834+0000","last_unstale":"2023-11-08T19:23:07.567147+0000","last_undegraded":"2023-11-08T19:23:07.567147+0000","last_fullsized":"2023-11-08T19:23:07.567147+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:04:24.855880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.564072+0000","last_change":"2023-11-08T19:23:01.536694+0000","last_active":"2023-11-08T19:23:06.564072+0000","last_peered":"2023-11-08T19:23:06.564072+0000","last_clean":"2023-11-08T19:23:06.564072+0000","last_became_active":"2023-11-08T19:23:01.535913+0000","last_became_peered":"2023-11-08T19:23:01.535913+0000","last_unstale":"2023-11-08T19:23:06.564072+0000","last_undegraded":"2023-11-08T19:23:06.564072+0000","last_fullsized":"2023-11-08T19:23:06.564072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:43:54.669075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.573361+0000","last_change":"2023-11-08T19:23:02.533243+0000","last_active":"2023-11-08T19:23:06.573361+0000","last_peered":"2023-11-08T19:23:06.573361+0000","last_clean":"2023-11-08T19:23:06.573361+0000","last_became_active":"2023-11-08T19:23:02.532725+0000","last_became_peered":"2023-11-08T19:23:02.532725+0000","last_unstale":"2023-11-08T19:23:06.573361+0000","last_undegraded":"2023-11-08T19:23:06.573361+0000","last_fullsized":"2023-11-08T19:23:06.573361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:04:20.812993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:07.567627+0000","last_change":"2023-11-08T19:23:06.586805+0000","last_active":"2023-11-08T19:23:07.567627+0000","last_peered":"2023-11-08T19:23:07.567627+0000","last_clean":"2023-11-08T19:23:07.567627+0000","last_became_active":"2023-11-08T19:23:06.586388+0000","last_became_peered":"2023-11-08T19:23:06.586388+0000","last_unstale":"2023-11-08T19:23:07.567627+0000","last_undegraded":"2023-11-08T19:23:07.567627+0000","last_fullsized":"2023-11-08T19:23:07.567627+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:11:18.742854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.640533+0000","last_change":"2023-11-08T19:23:01.540491+0000","last_active":"2023-11-08T19:23:06.640533+0000","last_peered":"2023-11-08T19:23:06.640533+0000","last_clean":"2023-11-08T19:23:06.640533+0000","last_became_active":"2023-11-08T19:23:01.540175+0000","last_became_peered":"2023-11-08T19:23:01.540175+0000","last_unstale":"2023-11-08T19:23:06.640533+0000","last_undegraded":"2023-11-08T19:23:06.640533+0000","last_fullsized":"2023-11-08T19:23:06.640533+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:52:26.893730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.565419+0000","last_change":"2023-11-08T19:23:02.542218+0000","last_active":"2023-11-08T19:23:06.565419+0000","last_peered":"2023-11-08T19:23:06.565419+0000","last_clean":"2023-11-08T19:23:06.565419+0000","last_became_active":"2023-11-08T19:23:02.541912+0000","last_became_peered":"2023-11-08T19:23:02.541912+0000","last_unstale":"2023-11-08T19:23:06.565419+0000","last_undegraded":"2023-11-08T19:23:06.565419+0000","last_fullsized":"2023-11-08T19:23:06.565419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:04:20.812993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:07.567162+0000","last_change":"2023-11-08T19:23:06.641692+0000","last_active":"2023-11-08T19:23:07.567162+0000","last_peered":"2023-11-08T19:23:07.567162+0000","last_clean":"2023-11-08T19:23:07.567162+0000","last_became_active":"2023-11-08T19:23:06.640996+0000","last_became_peered":"2023-11-08T19:23:06.640996+0000","last_unstale":"2023-11-08T19:23:07.567162+0000","last_undegraded":"2023-11-08T19:23:07.567162+0000","last_fullsized":"2023-11-08T19:23:07.567162+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:00:52.733076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.574648+0000","last_change":"2023-11-08T19:23:01.538965+0000","last_active":"2023-11-08T19:23:06.574648+0000","last_peered":"2023-11-08T19:23:06.574648+0000","last_clean":"2023-11-08T19:23:06.574648+0000","last_became_active":"2023-11-08T19:23:01.538635+0000","last_became_peered":"2023-11-08T19:23:01.538635+0000","last_unstale":"2023-11-08T19:23:06.574648+0000","last_undegraded":"2023-11-08T19:23:06.574648+0000","last_fullsized":"2023-11-08T19:23:06.574648+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:33:16.511242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.639757+0000","last_change":"2023-11-08T19:23:02.549229+0000","last_active":"2023-11-08T19:23:06.639757+0000","last_peered":"2023-11-08T19:23:06.639757+0000","last_clean":"2023-11-08T19:23:06.639757+0000","last_became_active":"2023-11-08T19:23:02.548974+0000","last_became_peered":"2023-11-08T19:23:02.548974+0000","last_unstale":"2023-11-08T19:23:06.639757+0000","last_undegraded":"2023-11-08T19:23:06.639757+0000","last_fullsized":"2023-11-08T19:23:06.639757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:50:33.507433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.015704+0000","last_change":"2023-11-08T19:23:06.593697+0000","last_active":"2023-11-08T19:23:09.015704+0000","last_peered":"2023-11-08T19:23:09.015704+0000","last_clean":"2023-11-08T19:23:09.015704+0000","last_became_active":"2023-11-08T19:23:06.593382+0000","last_became_peered":"2023-11-08T19:23:06.593382+0000","last_unstale":"2023-11-08T19:23:09.015704+0000","last_undegraded":"2023-11-08T19:23:09.015704+0000","last_fullsized":"2023-11-08T19:23:09.015704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:02:22.908243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.564800+0000","last_change":"2023-11-08T19:23:01.530532+0000","last_active":"2023-11-08T19:23:06.564800+0000","last_peered":"2023-11-08T19:23:06.564800+0000","last_clean":"2023-11-08T19:23:06.564800+0000","last_became_active":"2023-11-08T19:23:01.530253+0000","last_became_peered":"2023-11-08T19:23:01.530253+0000","last_unstale":"2023-11-08T19:23:06.564800+0000","last_undegraded":"2023-11-08T19:23:06.564800+0000","last_fullsized":"2023-11-08T19:23:06.564800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:55.765637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.575825+0000","last_change":"2023-11-08T19:23:02.540301+0000","last_active":"2023-11-08T19:23:06.575825+0000","last_peered":"2023-11-08T19:23:06.575825+0000","last_clean":"2023-11-08T19:23:06.575825+0000","last_became_active":"2023-11-08T19:23:02.539679+0000","last_became_peered":"2023-11-08T19:23:02.539679+0000","last_unstale":"2023-11-08T19:23:06.575825+0000","last_undegraded":"2023-11-08T19:23:06.575825+0000","last_fullsized":"2023-11-08T19:23:06.575825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:11:14.699967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-08T19:23:09.014285+0000","last_change":"2023-11-08T19:23:06.638442+0000","last_active":"2023-11-08T19:23:09.014285+0000","last_peered":"2023-11-08T19:23:09.014285+0000","last_clean":"2023-11-08T19:23:09.014285+0000","last_became_active":"2023-11-08T19:23:06.638018+0000","last_became_peered":"2023-11-08T19:23:06.638018+0000","last_unstale":"2023-11-08T19:23:09.014285+0000","last_undegraded":"2023-11-08T19:23:09.014285+0000","last_fullsized":"2023-11-08T19:23:09.014285+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:05.554697+0000","last_clean_scrub_stamp":"2023-11-08T19:23:05.554697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:14:35.302430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.575081+0000","last_change":"2023-11-08T19:23:01.537610+0000","last_active":"2023-11-08T19:23:06.575081+0000","last_peered":"2023-11-08T19:23:06.575081+0000","last_clean":"2023-11-08T19:23:06.575081+0000","last_became_active":"2023-11-08T19:23:01.537341+0000","last_became_peered":"2023-11-08T19:23:01.537341+0000","last_unstale":"2023-11-08T19:23:06.575081+0000","last_undegraded":"2023-11-08T19:23:06.575081+0000","last_fullsized":"2023-11-08T19:23:06.575081+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:00.505841+0000","last_clean_scrub_stamp":"2023-11-08T19:23:00.505841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:01:16.688194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.640258+0000","last_change":"2023-11-08T19:23:02.551858+0000","last_active":"2023-11-08T19:23:06.640258+0000","last_peered":"2023-11-08T19:23:06.640258+0000","last_clean":"2023-11-08T19:23:06.640258+0000","last_became_active":"2023-11-08T19:23:02.551054+0000","last_became_peered":"2023-11-08T19:23:02.551054+0000","last_unstale":"2023-11-08T19:23:06.640258+0000","last_undegraded":"2023-11-08T19:23:06.640258+0000","last_fullsized":"2023-11-08T19:23:06.640258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:00:48.690189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.565678+0000","last_change":"2023-11-08T19:23:02.545805+0000","last_active":"2023-11-08T19:23:06.565678+0000","last_peered":"2023-11-08T19:23:06.565678+0000","last_clean":"2023-11-08T19:23:06.565678+0000","last_became_active":"2023-11-08T19:23:02.545540+0000","last_became_peered":"2023-11-08T19:23:02.545540+0000","last_unstale":"2023-11-08T19:23:06.565678+0000","last_undegraded":"2023-11-08T19:23:06.565678+0000","last_fullsized":"2023-11-08T19:23:06.565678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:15:23.194339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.572161+0000","last_change":"2023-11-08T19:23:02.537513+0000","last_active":"2023-11-08T19:23:06.572161+0000","last_peered":"2023-11-08T19:23:06.572161+0000","last_clean":"2023-11-08T19:23:06.572161+0000","last_became_active":"2023-11-08T19:23:02.537192+0000","last_became_peered":"2023-11-08T19:23:02.537192+0000","last_unstale":"2023-11-08T19:23:06.572161+0000","last_undegraded":"2023-11-08T19:23:06.572161+0000","last_fullsized":"2023-11-08T19:23:06.572161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:47:08.776316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.575099+0000","last_change":"2023-11-08T19:23:02.537846+0000","last_active":"2023-11-08T19:23:06.575099+0000","last_peered":"2023-11-08T19:23:06.575099+0000","last_clean":"2023-11-08T19:23:06.575099+0000","last_became_active":"2023-11-08T19:23:02.537585+0000","last_became_peered":"2023-11-08T19:23:02.537585+0000","last_unstale":"2023-11-08T19:23:06.575099+0000","last_undegraded":"2023-11-08T19:23:06.575099+0000","last_fullsized":"2023-11-08T19:23:06.575099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:11:58.093408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.579334+0000","last_change":"2023-11-08T19:23:02.536724+0000","last_active":"2023-11-08T19:23:06.579334+0000","last_peered":"2023-11-08T19:23:06.579334+0000","last_clean":"2023-11-08T19:23:06.579334+0000","last_became_active":"2023-11-08T19:23:02.536080+0000","last_became_peered":"2023-11-08T19:23:02.536080+0000","last_unstale":"2023-11-08T19:23:06.579334+0000","last_undegraded":"2023-11-08T19:23:06.579334+0000","last_fullsized":"2023-11-08T19:23:06.579334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:56:02.594198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.576167+0000","last_change":"2023-11-08T19:23:02.531764+0000","last_active":"2023-11-08T19:23:06.576167+0000","last_peered":"2023-11-08T19:23:06.576167+0000","last_clean":"2023-11-08T19:23:06.576167+0000","last_became_active":"2023-11-08T19:23:02.531498+0000","last_became_peered":"2023-11-08T19:23:02.531498+0000","last_unstale":"2023-11-08T19:23:06.576167+0000","last_undegraded":"2023-11-08T19:23:06.576167+0000","last_fullsized":"2023-11-08T19:23:06.576167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:15:23.194339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.564703+0000","last_change":"2023-11-08T19:23:02.536652+0000","last_active":"2023-11-08T19:23:06.564703+0000","last_peered":"2023-11-08T19:23:06.564703+0000","last_clean":"2023-11-08T19:23:06.564703+0000","last_became_active":"2023-11-08T19:23:02.536397+0000","last_became_peered":"2023-11-08T19:23:02.536397+0000","last_unstale":"2023-11-08T19:23:06.564703+0000","last_undegraded":"2023-11-08T19:23:06.564703+0000","last_fullsized":"2023-11-08T19:23:06.564703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:32:49.846143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.566386+0000","last_change":"2023-11-08T19:23:02.546101+0000","last_active":"2023-11-08T19:23:06.566386+0000","last_peered":"2023-11-08T19:23:06.566386+0000","last_clean":"2023-11-08T19:23:06.566386+0000","last_became_active":"2023-11-08T19:23:02.545740+0000","last_became_peered":"2023-11-08T19:23:02.545740+0000","last_unstale":"2023-11-08T19:23:06.566386+0000","last_undegraded":"2023-11-08T19:23:06.566386+0000","last_fullsized":"2023-11-08T19:23:06.566386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:56:02.594198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.572386+0000","last_change":"2023-11-08T19:23:02.534052+0000","last_active":"2023-11-08T19:23:06.572386+0000","last_peered":"2023-11-08T19:23:06.572386+0000","last_clean":"2023-11-08T19:23:06.572386+0000","last_became_active":"2023-11-08T19:23:02.533811+0000","last_became_peered":"2023-11-08T19:23:02.533811+0000","last_unstale":"2023-11-08T19:23:06.572386+0000","last_undegraded":"2023-11-08T19:23:06.572386+0000","last_fullsized":"2023-11-08T19:23:06.572386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:44:38.109774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.574607+0000","last_change":"2023-11-08T19:23:02.536926+0000","last_active":"2023-11-08T19:23:06.574607+0000","last_peered":"2023-11-08T19:23:06.574607+0000","last_clean":"2023-11-08T19:23:06.574607+0000","last_became_active":"2023-11-08T19:23:02.536648+0000","last_became_peered":"2023-11-08T19:23:02.536648+0000","last_unstale":"2023-11-08T19:23:06.574607+0000","last_undegraded":"2023-11-08T19:23:06.574607+0000","last_fullsized":"2023-11-08T19:23:06.574607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:56:02.594198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.570954+0000","last_change":"2023-11-08T19:23:02.533095+0000","last_active":"2023-11-08T19:23:06.570954+0000","last_peered":"2023-11-08T19:23:06.570954+0000","last_clean":"2023-11-08T19:23:06.570954+0000","last_became_active":"2023-11-08T19:23:02.532639+0000","last_became_peered":"2023-11-08T19:23:02.532639+0000","last_unstale":"2023-11-08T19:23:06.570954+0000","last_undegraded":"2023-11-08T19:23:06.570954+0000","last_fullsized":"2023-11-08T19:23:06.570954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:56:02.594198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.575154+0000","last_change":"2023-11-08T19:23:02.547407+0000","last_active":"2023-11-08T19:23:06.575154+0000","last_peered":"2023-11-08T19:23:06.575154+0000","last_clean":"2023-11-08T19:23:06.575154+0000","last_became_active":"2023-11-08T19:23:02.545080+0000","last_became_peered":"2023-11-08T19:23:02.545080+0000","last_unstale":"2023-11-08T19:23:06.575154+0000","last_undegraded":"2023-11-08T19:23:06.575154+0000","last_fullsized":"2023-11-08T19:23:06.575154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:57:32.301401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.579417+0000","last_change":"2023-11-08T19:23:02.543982+0000","last_active":"2023-11-08T19:23:06.579417+0000","last_peered":"2023-11-08T19:23:06.579417+0000","last_clean":"2023-11-08T19:23:06.579417+0000","last_became_active":"2023-11-08T19:23:02.543790+0000","last_became_peered":"2023-11-08T19:23:02.543790+0000","last_unstale":"2023-11-08T19:23:06.579417+0000","last_undegraded":"2023-11-08T19:23:06.579417+0000","last_fullsized":"2023-11-08T19:23:06.579417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:57:51.015184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-08T19:23:06.567500+0000","last_change":"2023-11-08T19:23:02.546682+0000","last_active":"2023-11-08T19:23:06.567500+0000","last_peered":"2023-11-08T19:23:06.567500+0000","last_clean":"2023-11-08T19:23:06.567500+0000","last_became_active":"2023-11-08T19:23:02.546356+0000","last_became_peered":"2023-11-08T19:23:02.546356+0000","last_unstale":"2023-11-08T19:23:06.567500+0000","last_undegraded":"2023-11-08T19:23:06.567500+0000","last_fullsized":"2023-11-08T19:23:06.567500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:23:01.511809+0000","last_clean_scrub_stamp":"2023-11-08T19:23:01.511809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:32:49.846143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":851968,"data_stored":690742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":99952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":860160,"data_stored":690798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":19.295999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.524}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":14.324}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":17.056000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.0590000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":17.146000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":99792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":99918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":99882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:23:26.361 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-08T19:23:26.361 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-11-08T19:23:26.361 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-11-08T19:23:26.362 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-08T19:23:26.514 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.513+0000 7fdc51c44700 1 Processor -- start 2023-11-08T19:23:26.514 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.513+0000 7fdc51c44700 1 -- start start 2023-11-08T19:23:26.517 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.513+0000 7fdc51c44700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fdc4c0d0050 0x7fdc4c0cc280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:26.517 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.513+0000 7fdc51c44700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc4c0cbdf0 con 0x7fdc4c0cac70 2023-11-08T19:23:26.517 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.513+0000 7fdc51c44700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc4c0cb1e0 con 0x7fdc4c15dc90 2023-11-08T19:23:26.518 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.513+0000 7fdc51c44700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc4c0ccdd0 con 0x7fdc4c0d0050 2023-11-08T19:23:26.518 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.514+0000 7fdc4affd700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fdc4c0cac70 0x7fdc4c0cf940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:39680/0 (socket says 172.21.15.149:39680) 2023-11-08T19:23:26.518 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.514+0000 7fdc4affd700 1 -- 172.21.15.149:0/1779566895 learned_addr learned my addr 172.21.15.149:0/1779566895 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:23:26.518 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.514+0000 7fdc4a7fc700 1 -- 172.21.15.149:0/1779566895 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4128119163 0 0) 0x7fdc4c0cbdf0 con 0x7fdc4c0cac70 2023-11-08T19:23:26.518 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.514+0000 7fdc4bfff700 1 --2- 172.21.15.149:0/1779566895 >> v2:172.21.15.160:3300/0 conn(0x7fdc4c0d0050 0x7fdc4c0cc280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:26.519 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.514+0000 7fdc4a7fc700 1 -- 172.21.15.149:0/1779566895 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc340035b0 con 0x7fdc4c0cac70 2023-11-08T19:23:26.519 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.514+0000 7fdc4a7fc700 1 -- 172.21.15.149:0/1779566895 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2520011101 0 0) 0x7fdc340035b0 con 0x7fdc4c0cac70 2023-11-08T19:23:26.519 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.514+0000 7fdc4a7fc700 1 -- 172.21.15.149:0/1779566895 >> v2:172.21.15.160:3300/0 conn(0x7fdc4c0d0050 msgr2=0x7fdc4c0cc280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:26.519 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.514+0000 7fdc4a7fc700 1 --2- 172.21.15.149:0/1779566895 >> v2:172.21.15.160:3300/0 conn(0x7fdc4c0d0050 0x7fdc4c0cc280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:26.519 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.514+0000 7fdc4a7fc700 1 -- 172.21.15.149:0/1779566895 >> v1:172.21.15.160:6789/0 conn(0x7fdc4c15dc90 legacy=0x7fdc4c06b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:26.520 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.514+0000 7fdc4a7fc700 1 -- 172.21.15.149:0/1779566895 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc4c0cb4c0 con 0x7fdc4c0cac70 2023-11-08T19:23:26.520 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.514+0000 7fdc4a7fc700 1 -- 172.21.15.149:0/1779566895 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7fdc40001670 con 0x7fdc4c0cac70 2023-11-08T19:23:26.520 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.514+0000 7fdc4a7fc700 1 -- 172.21.15.149:0/1779566895 >> v1:172.21.15.149:6789/0 conn(0x7fdc4c0cac70 legacy=0x7fdc4c0cf940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:26.520 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.514+0000 7fdc4a7fc700 1 --2- 172.21.15.149:0/1779566895 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdc34003a00 0x7fdc34003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:26.520 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.514+0000 7fdc4a7fc700 1 --2- 172.21.15.149:0/1779566895 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc34004850 0x7fdc34004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:26.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.514+0000 7fdc4a7fc700 1 --2- 172.21.15.149:0/1779566895 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdc34005210 0x7fdc34014220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:26.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.514+0000 7fdc4a7fc700 1 -- 172.21.15.149:0/1779566895 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4c0ccdd0 con 0x7fdc34004850 2023-11-08T19:23:26.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.514+0000 7fdc4a7fc700 1 -- 172.21.15.149:0/1779566895 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc340148c0 con 0x7fdc34005210 2023-11-08T19:23:26.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.514+0000 7fdc4a7fc700 1 -- 172.21.15.149:0/1779566895 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc34014a80 con 0x7fdc34003a00 2023-11-08T19:23:26.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.514+0000 7fdc4affd700 1 --2- 172.21.15.149:0/1779566895 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc34004850 0x7fdc34004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:26.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.514+0000 7fdc4bfff700 1 --2- 172.21.15.149:0/1779566895 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdc34005210 0x7fdc34014220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:26.522 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.514+0000 7fdc4b7fe700 1 --2- 172.21.15.149:0/1779566895 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdc34003a00 0x7fdc34003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:26.522 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.515+0000 7fdc4affd700 1 -- 172.21.15.149:0/1779566895 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdc34003a00 msgr2=0x7fdc34003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:26.522 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.515+0000 7fdc4affd700 1 --2- 172.21.15.149:0/1779566895 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdc34003a00 0x7fdc34003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:26.522 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.515+0000 7fdc4affd700 1 -- 172.21.15.149:0/1779566895 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdc34005210 msgr2=0x7fdc34014220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:26.523 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.515+0000 7fdc4affd700 1 --2- 172.21.15.149:0/1779566895 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdc34005210 0x7fdc34014220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:26.523 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.515+0000 7fdc4affd700 1 -- 172.21.15.149:0/1779566895 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc340035b0 con 0x7fdc34004850 2023-11-08T19:23:26.523 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.515+0000 7fdc4bfff700 1 -- 172.21.15.149:0/1779566895 reap_dead start 2023-11-08T19:23:26.523 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.515+0000 7fdc4affd700 1 --2- 172.21.15.149:0/1779566895 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc34004850 0x7fdc34004cd0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fdc4000c2a0 tx=0x7fdc34005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cbbd45f6bfaae6b server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:26.523 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.515+0000 7fdc4a7fc700 1 -- 172.21.15.149:0/1779566895 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc40007c10 con 0x7fdc34004850 2023-11-08T19:23:26.524 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.515+0000 7fdc4a7fc700 1 -- 172.21.15.149:0/1779566895 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc4000cd40 con 0x7fdc34004850 2023-11-08T19:23:26.524 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.515+0000 7fdc4a7fc700 1 -- 172.21.15.149:0/1779566895 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc40005ba0 con 0x7fdc34004850 2023-11-08T19:23:26.524 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.515+0000 7fdc51c44700 1 -- 172.21.15.149:0/1779566895 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc34004850 msgr2=0x7fdc34004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:26.524 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.515+0000 7fdc51c44700 1 --2- 172.21.15.149:0/1779566895 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc34004850 0x7fdc34004cd0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fdc4000c2a0 tx=0x7fdc34005880 comp rx=0 tx=0).stop 2023-11-08T19:23:26.524 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.515+0000 7fdc51c44700 1 -- 172.21.15.149:0/1779566895 shutdown_connections 2023-11-08T19:23:26.525 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.515+0000 7fdc51c44700 1 --2- 172.21.15.149:0/1779566895 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc34004850 0x7fdc34004cd0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:26.525 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.515+0000 7fdc51c44700 1 -- 172.21.15.149:0/1779566895 >> 172.21.15.149:0/1779566895 conn(0x7fdc4c0d0620 msgr2=0x7fdc4c0d0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:26.525 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.515+0000 7fdc51c44700 1 -- 172.21.15.149:0/1779566895 shutdown_connections 2023-11-08T19:23:26.525 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.515+0000 7fdc51c44700 1 -- 172.21.15.149:0/1779566895 wait complete. 2023-11-08T19:23:26.528 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.517+0000 7fdc51c44700 1 Processor -- start 2023-11-08T19:23:26.528 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.517+0000 7fdc51c44700 1 -- start start 2023-11-08T19:23:26.528 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.518+0000 7fdc51c44700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdc34004850 0x7fdc4c09cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:26.529 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.518+0000 7fdc51c44700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc4c09a3b0 0x7fdc4c0b54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:26.529 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.518+0000 7fdc51c44700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdc4c0c8740 0x7fdc4c0c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:26.529 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.518+0000 7fdc51c44700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4c15c420 con 0x7fdc4c09a3b0 2023-11-08T19:23:26.529 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.518+0000 7fdc51c44700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4c09a830 con 0x7fdc4c0c8740 2023-11-08T19:23:26.529 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.518+0000 7fdc51c44700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4c09bb30 con 0x7fdc34004850 2023-11-08T19:23:26.530 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.518+0000 7fdc4affd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc4c09a3b0 0x7fdc4c0b54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:26.530 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.518+0000 7fdc4affd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc4c09a3b0 0x7fdc4c0b54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37690/0 (socket says 172.21.15.149:37690) 2023-11-08T19:23:26.530 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.518+0000 7fdc4affd700 1 -- 172.21.15.149:0/2809949164 learned_addr learned my addr 172.21.15.149:0/2809949164 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:26.530 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.518+0000 7fdc4b7fe700 1 --2- 172.21.15.149:0/2809949164 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdc34004850 0x7fdc4c09cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:26.530 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.518+0000 7fdc4bfff700 1 --2- 172.21.15.149:0/2809949164 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdc4c0c8740 0x7fdc4c0c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:26.531 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.518+0000 7fdc4affd700 1 -- 172.21.15.149:0/2809949164 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdc34004850 msgr2=0x7fdc4c09cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:26.531 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.518+0000 7fdc4affd700 1 --2- 172.21.15.149:0/2809949164 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdc34004850 0x7fdc4c09cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:26.531 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.518+0000 7fdc4affd700 1 -- 172.21.15.149:0/2809949164 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdc4c0c8740 msgr2=0x7fdc4c0c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:26.531 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.518+0000 7fdc4affd700 1 --2- 172.21.15.149:0/2809949164 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdc4c0c8740 0x7fdc4c0c8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:26.531 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.518+0000 7fdc4affd700 1 -- 172.21.15.149:0/2809949164 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc4c09aa90 con 0x7fdc4c09a3b0 2023-11-08T19:23:26.532 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.518+0000 7fdc4bfff700 1 --2- 172.21.15.149:0/2809949164 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdc4c0c8740 0x7fdc4c0c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:23:26.532 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.519+0000 7fdc4affd700 1 --2- 172.21.15.149:0/2809949164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc4c09a3b0 0x7fdc4c0b54c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdc4000c890 tx=0x7fdc4c0cbd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:26.532 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.519+0000 7fdc33fff700 1 -- 172.21.15.149:0/2809949164 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc40001640 con 0x7fdc4c09a3b0 2023-11-08T19:23:26.532 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.519+0000 7fdc33fff700 1 -- 172.21.15.149:0/2809949164 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc400070d0 con 0x7fdc4c09a3b0 2023-11-08T19:23:26.532 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.519+0000 7fdc51c44700 1 -- 172.21.15.149:0/2809949164 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc4c09ad70 con 0x7fdc4c09a3b0 2023-11-08T19:23:26.533 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.519+0000 7fdc33fff700 1 -- 172.21.15.149:0/2809949164 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc400074a0 con 0x7fdc4c09a3b0 2023-11-08T19:23:26.533 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.519+0000 7fdc51c44700 1 -- 172.21.15.149:0/2809949164 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc4c09b330 con 0x7fdc4c09a3b0 2023-11-08T19:23:26.533 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.520+0000 7fdc51c44700 1 -- 172.21.15.149:0/2809949164 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc4c0745f0 con 0x7fdc4c09a3b0 2023-11-08T19:23:26.533 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.520+0000 7fdc33fff700 1 -- 172.21.15.149:0/2809949164 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdc40007600 con 0x7fdc4c09a3b0 2023-11-08T19:23:26.533 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.521+0000 7fdc33fff700 1 --2- 172.21.15.149:0/2809949164 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fdc3806af00 0x7fdc3806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:26.534 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.521+0000 7fdc33fff700 1 -- 172.21.15.149:0/2809949164 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdc4008ab50 con 0x7fdc4c09a3b0 2023-11-08T19:23:26.534 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.521+0000 7fdc4b7fe700 1 --2- 172.21.15.149:0/2809949164 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fdc3806af00 0x7fdc3806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:26.534 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.521+0000 7fdc4b7fe700 1 --2- 172.21.15.149:0/2809949164 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fdc3806af00 0x7fdc3806d3c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c000c00 tx=0x7fdc3c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:26.534 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.525+0000 7fdc33fff700 1 -- 172.21.15.149:0/2809949164 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdc40055920 con 0x7fdc4c09a3b0 2023-11-08T19:23:26.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.761+0000 7fdc51c44700 1 -- 172.21.15.149:0/2809949164 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fdc4c15c420 con 0x7fdc4c09a3b0 2023-11-08T19:23:26.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.761+0000 7fdc33fff700 1 -- 172.21.15.149:0/2809949164 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fdc40058f40 con 0x7fdc4c09a3b0 2023-11-08T19:23:26.763 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:23:26.763 INFO:teuthology.orchestra.run.smithi149.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-11-08T19:23:26.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.763+0000 7fdc51c44700 1 -- 172.21.15.149:0/2809949164 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fdc3806af00 msgr2=0x7fdc3806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:26.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.763+0000 7fdc51c44700 1 --2- 172.21.15.149:0/2809949164 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fdc3806af00 0x7fdc3806d3c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c000c00 tx=0x7fdc3c009040 comp rx=0 tx=0).stop 2023-11-08T19:23:26.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.763+0000 7fdc51c44700 1 -- 172.21.15.149:0/2809949164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc4c09a3b0 msgr2=0x7fdc4c0b54c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:26.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.763+0000 7fdc51c44700 1 --2- 172.21.15.149:0/2809949164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc4c09a3b0 0x7fdc4c0b54c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdc4000c890 tx=0x7fdc4c0cbd60 comp rx=0 tx=0).stop 2023-11-08T19:23:26.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.763+0000 7fdc51c44700 1 -- 172.21.15.149:0/2809949164 shutdown_connections 2023-11-08T19:23:26.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.763+0000 7fdc51c44700 1 --2- 172.21.15.149:0/2809949164 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fdc3806af00 0x7fdc3806d3c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:26.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.763+0000 7fdc51c44700 1 --2- 172.21.15.149:0/2809949164 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdc4c0c8740 0x7fdc4c0c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:26.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.763+0000 7fdc51c44700 1 --2- 172.21.15.149:0/2809949164 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdc34004850 0x7fdc4c09cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:26.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.763+0000 7fdc51c44700 1 --2- 172.21.15.149:0/2809949164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc4c09a3b0 0x7fdc4c0b54c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:26.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.763+0000 7fdc51c44700 1 -- 172.21.15.149:0/2809949164 >> 172.21.15.149:0/2809949164 conn(0x7fdc4c0d0620 msgr2=0x7fdc4c0c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:26.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.764+0000 7fdc51c44700 1 -- 172.21.15.149:0/2809949164 shutdown_connections 2023-11-08T19:23:26.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.764+0000 7fdc51c44700 1 -- 172.21.15.149:0/2809949164 wait complete. 2023-11-08T19:23:26.777 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-11-08T19:23:26.778 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:23:26.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.897+0000 7fba3f38d700 1 Processor -- start 2023-11-08T19:23:26.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.898+0000 7fba3f38d700 1 -- start start 2023-11-08T19:23:26.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.898+0000 7fba3f38d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fba380cc140 0x7fba380cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:26.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.898+0000 7fba3f38d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fba380b2850 0x7fba380cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:26.902 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.898+0000 7fba3f38d700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba380cce50 con 0x7fba380b2cd0 2023-11-08T19:23:26.902 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.898+0000 7fba3f38d700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba380b2430 con 0x7fba380b2850 2023-11-08T19:23:26.902 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.898+0000 7fba3f38d700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba380cc520 con 0x7fba380cc140 2023-11-08T19:23:26.902 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.899+0000 7fba3c928700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fba380b2850 0x7fba380cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:26.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.899+0000 7fba3c928700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fba380b2850 0x7fba380cabf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37696/0 (socket says 172.21.15.149:37696) 2023-11-08T19:23:26.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.899+0000 7fba3c928700 1 -- 172.21.15.149:0/1664508706 learned_addr learned my addr 172.21.15.149:0/1664508706 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:26.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.899+0000 7fba3d129700 1 --2- 172.21.15.149:0/1664508706 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fba380cc140 0x7fba380cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:26.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.899+0000 7fba3c928700 1 -- 172.21.15.149:0/1664508706 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fba380cc140 msgr2=0x7fba380cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:26.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.899+0000 7fba3c928700 1 --2- 172.21.15.149:0/1664508706 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fba380cc140 0x7fba380cc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:26.904 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.899+0000 7fba3c928700 1 -- 172.21.15.149:0/1664508706 >> v1:172.21.15.160:6789/0 conn(0x7fba380b2cd0 legacy=0x7fba3815d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:26.904 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.899+0000 7fba3c928700 1 -- 172.21.15.149:0/1664508706 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba380b17b0 con 0x7fba380b2850 2023-11-08T19:23:26.904 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.899+0000 7fba3c928700 1 --2- 172.21.15.149:0/1664508706 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba380b2850 0x7fba380cabf0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fba340098f0 tx=0x7fba34009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e92c773727df5c36 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:26.904 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.899+0000 7fba2ffff700 1 -- 172.21.15.149:0/1664508706 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba34011830 con 0x7fba380b2850 2023-11-08T19:23:26.904 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.899+0000 7fba2ffff700 1 -- 172.21.15.149:0/1664508706 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba34011990 con 0x7fba380b2850 2023-11-08T19:23:26.905 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.899+0000 7fba2ffff700 1 -- 172.21.15.149:0/1664508706 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba34011d20 con 0x7fba380b2850 2023-11-08T19:23:26.905 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.900+0000 7fba3f38d700 1 -- 172.21.15.149:0/1664508706 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba380b2850 msgr2=0x7fba380cabf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:26.905 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.900+0000 7fba3f38d700 1 --2- 172.21.15.149:0/1664508706 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba380b2850 0x7fba380cabf0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fba340098f0 tx=0x7fba34009c00 comp rx=0 tx=0).stop 2023-11-08T19:23:26.905 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.900+0000 7fba3f38d700 1 -- 172.21.15.149:0/1664508706 shutdown_connections 2023-11-08T19:23:26.905 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.900+0000 7fba3f38d700 1 --2- 172.21.15.149:0/1664508706 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fba380cc140 0x7fba380cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:26.906 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.900+0000 7fba3f38d700 1 --2- 172.21.15.149:0/1664508706 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba380b2850 0x7fba380cabf0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:26.906 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.900+0000 7fba3f38d700 1 -- 172.21.15.149:0/1664508706 >> 172.21.15.149:0/1664508706 conn(0x7fba38099a40 msgr2=0x7fba380d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:26.906 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.900+0000 7fba3f38d700 1 -- 172.21.15.149:0/1664508706 shutdown_connections 2023-11-08T19:23:26.906 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.900+0000 7fba3f38d700 1 -- 172.21.15.149:0/1664508706 wait complete. 2023-11-08T19:23:26.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.901+0000 7fba3f38d700 1 Processor -- start 2023-11-08T19:23:26.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.901+0000 7fba3f38d700 1 -- start start 2023-11-08T19:23:26.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.902+0000 7fba3f38d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba380b2850 0x7fba3815e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:26.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.902+0000 7fba3f38d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba380b2cd0 0x7fba38158c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:26.910 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.902+0000 7fba3f38d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fba380cc140 0x7fba3815dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:26.910 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.902+0000 7fba3f38d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba3815c450 con 0x7fba380b2cd0 2023-11-08T19:23:26.910 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.902+0000 7fba3f38d700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba3815c6a0 con 0x7fba380b2850 2023-11-08T19:23:26.910 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.902+0000 7fba3f38d700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba3815c980 con 0x7fba380cc140 2023-11-08T19:23:26.910 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.902+0000 7fba3c928700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba380b2cd0 0x7fba38158c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:26.911 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.902+0000 7fba3c928700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba380b2cd0 0x7fba38158c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37704/0 (socket says 172.21.15.149:37704) 2023-11-08T19:23:26.911 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.902+0000 7fba3c928700 1 -- 172.21.15.149:0/3301787500 learned_addr learned my addr 172.21.15.149:0/3301787500 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:26.911 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.902+0000 7fba3d129700 1 --2- 172.21.15.149:0/3301787500 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba380b2850 0x7fba3815e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:26.911 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.902+0000 7fba3d92a700 1 --2- 172.21.15.149:0/3301787500 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fba380cc140 0x7fba3815dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:26.911 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.902+0000 7fba3c928700 1 -- 172.21.15.149:0/3301787500 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fba380cc140 msgr2=0x7fba3815dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:26.911 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.902+0000 7fba3c928700 1 --2- 172.21.15.149:0/3301787500 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fba380cc140 0x7fba3815dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:26.912 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.902+0000 7fba3c928700 1 -- 172.21.15.149:0/3301787500 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba380b2850 msgr2=0x7fba3815e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:26.912 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.902+0000 7fba3c928700 1 --2- 172.21.15.149:0/3301787500 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba380b2850 0x7fba3815e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:26.912 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.902+0000 7fba3c928700 1 -- 172.21.15.149:0/3301787500 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba34009550 con 0x7fba380b2cd0 2023-11-08T19:23:26.912 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.902+0000 7fba3c928700 1 --2- 172.21.15.149:0/3301787500 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba380b2cd0 0x7fba38158c30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fba34000c00 tx=0x7fba34004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:26.912 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.902+0000 7fba2dffb700 1 -- 172.21.15.149:0/3301787500 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba34004400 con 0x7fba380b2cd0 2023-11-08T19:23:26.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.902+0000 7fba2dffb700 1 -- 172.21.15.149:0/3301787500 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba3401f070 con 0x7fba380b2cd0 2023-11-08T19:23:26.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.902+0000 7fba3f38d700 1 -- 172.21.15.149:0/3301787500 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba3815cc60 con 0x7fba380b2cd0 2023-11-08T19:23:26.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.903+0000 7fba2dffb700 1 -- 172.21.15.149:0/3301787500 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba340038c0 con 0x7fba380b2cd0 2023-11-08T19:23:26.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.903+0000 7fba3f38d700 1 -- 172.21.15.149:0/3301787500 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba3815d220 con 0x7fba380b2cd0 2023-11-08T19:23:26.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.904+0000 7fba3f38d700 1 -- 172.21.15.149:0/3301787500 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba381f6ed0 con 0x7fba380b2cd0 2023-11-08T19:23:26.914 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.904+0000 7fba2dffb700 1 -- 172.21.15.149:0/3301787500 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fba34021030 con 0x7fba380b2cd0 2023-11-08T19:23:26.914 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.904+0000 7fba2dffb700 1 --2- 172.21.15.149:0/3301787500 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fba1c06af00 0x7fba1c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:26.914 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.904+0000 7fba2dffb700 1 -- 172.21.15.149:0/3301787500 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fba3408ab80 con 0x7fba380b2cd0 2023-11-08T19:23:26.914 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.905+0000 7fba3d129700 1 --2- 172.21.15.149:0/3301787500 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fba1c06af00 0x7fba1c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:26.914 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.905+0000 7fba3d129700 1 --2- 172.21.15.149:0/3301787500 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fba1c06af00 0x7fba1c06d3c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fba28009b20 tx=0x7fba280091c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:26.915 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:26.909+0000 7fba2dffb700 1 -- 172.21.15.149:0/3301787500 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fba34055a70 con 0x7fba380b2cd0 2023-11-08T19:23:27.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.100+0000 7fba3f38d700 1 -- 172.21.15.149:0/3301787500 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fba380745f0 con 0x7fba380b2cd0 2023-11-08T19:23:27.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.102+0000 7fba2dffb700 1 -- 172.21.15.149:0/3301787500 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18382 (secure 0 0 0) 0x7fba34015020 con 0x7fba380b2cd0 2023-11-08T19:23:27.103 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:23:27.103 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":24,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:23:06.964482+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-08T19:22:59.830928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-08T19:23:00.886589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-08T19:23:04.574033+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:23:27.106 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.104+0000 7fba3f38d700 1 -- 172.21.15.149:0/3301787500 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fba1c06af00 msgr2=0x7fba1c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:27.106 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.104+0000 7fba3f38d700 1 --2- 172.21.15.149:0/3301787500 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fba1c06af00 0x7fba1c06d3c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fba28009b20 tx=0x7fba280091c0 comp rx=0 tx=0).stop 2023-11-08T19:23:27.106 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.104+0000 7fba3f38d700 1 -- 172.21.15.149:0/3301787500 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba380b2cd0 msgr2=0x7fba38158c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:27.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.104+0000 7fba3f38d700 1 --2- 172.21.15.149:0/3301787500 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba380b2cd0 0x7fba38158c30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fba34000c00 tx=0x7fba34004750 comp rx=0 tx=0).stop 2023-11-08T19:23:27.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.104+0000 7fba3f38d700 1 -- 172.21.15.149:0/3301787500 shutdown_connections 2023-11-08T19:23:27.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.104+0000 7fba3f38d700 1 --2- 172.21.15.149:0/3301787500 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fba1c06af00 0x7fba1c06d3c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:27.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.104+0000 7fba3f38d700 1 --2- 172.21.15.149:0/3301787500 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba380b2850 0x7fba3815e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:27.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.104+0000 7fba3f38d700 1 --2- 172.21.15.149:0/3301787500 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fba380cc140 0x7fba3815dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:27.108 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.104+0000 7fba3f38d700 1 --2- 172.21.15.149:0/3301787500 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba380b2cd0 0x7fba38158c30 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:27.108 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.104+0000 7fba3f38d700 1 -- 172.21.15.149:0/3301787500 >> 172.21.15.149:0/3301787500 conn(0x7fba38099a40 msgr2=0x7fba3806ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:27.108 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.104+0000 7fba3f38d700 1 -- 172.21.15.149:0/3301787500 shutdown_connections 2023-11-08T19:23:27.109 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.104+0000 7fba3f38d700 1 -- 172.21.15.149:0/3301787500 wait complete. 2023-11-08T19:23:27.118 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-08T19:22:56.023194+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-08T19:22:59.830928+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-08T19:23:00.886589+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-08T19:23:04.574033+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-08T19:23:27.118 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-08T19:23:27.245 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.241+0000 7f2eba92f700 1 Processor -- start 2023-11-08T19:23:27.245 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.241+0000 7f2eba92f700 1 -- start start 2023-11-08T19:23:27.245 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.242+0000 7f2eba92f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2eb415df40 0x7f2eb406c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:27.245 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.242+0000 7f2eba92f700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2eb406ab80 0x7f2eb406c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:27.246 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.242+0000 7f2eba92f700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f2eb40cf1c0 0x7f2eb40caf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:27.246 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.242+0000 7f2eba92f700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2eb415e320 con 0x7f2eb406ab80 2023-11-08T19:23:27.246 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.242+0000 7f2eba92f700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2eb406b020 con 0x7f2eb40cf1c0 2023-11-08T19:23:27.246 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.242+0000 7f2eba92f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb406b2e0 con 0x7f2eb415df40 2023-11-08T19:23:27.247 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.242+0000 7f2eb37fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2eb406ab80 0x7f2eb406c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:27.247 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.242+0000 7f2eb37fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2eb406ab80 0x7f2eb406c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37710/0 (socket says 172.21.15.149:37710) 2023-11-08T19:23:27.247 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.242+0000 7f2eb37fe700 1 -- 172.21.15.149:0/3066649427 learned_addr learned my addr 172.21.15.149:0/3066649427 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:27.247 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.242+0000 7f2eb3fff700 1 --2- 172.21.15.149:0/3066649427 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2eb415df40 0x7f2eb406c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:27.247 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.242+0000 7f2eb8ecc700 1 --2- 172.21.15.149:0/3066649427 >> v2:172.21.15.160:3300/0 conn(0x7f2eb40cf1c0 0x7f2eb40caf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:27.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.243+0000 7f2eb37fe700 1 -- 172.21.15.149:0/3066649427 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2eb415df40 msgr2=0x7f2eb406c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:27.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.243+0000 7f2eb37fe700 1 --2- 172.21.15.149:0/3066649427 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2eb415df40 0x7f2eb406c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:27.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.243+0000 7f2eb37fe700 1 -- 172.21.15.149:0/3066649427 >> v2:172.21.15.160:3300/0 conn(0x7f2eb40cf1c0 msgr2=0x7f2eb40caf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:27.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.243+0000 7f2eb37fe700 1 --2- 172.21.15.149:0/3066649427 >> v2:172.21.15.160:3300/0 conn(0x7f2eb40cf1c0 0x7f2eb40caf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:27.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.243+0000 7f2eb37fe700 1 -- 172.21.15.149:0/3066649427 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb406b5c0 con 0x7f2eb406ab80 2023-11-08T19:23:27.249 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.243+0000 7f2eb37fe700 1 --2- 172.21.15.149:0/3066649427 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2eb406ab80 0x7f2eb406c5e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2eb406cb20 tx=0x7f2ea4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95d72c28ebce2418 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:27.249 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.243+0000 7f2eb2ffd700 1 -- 172.21.15.149:0/3066649427 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea4011830 con 0x7f2eb406ab80 2023-11-08T19:23:27.249 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.243+0000 7f2eb2ffd700 1 -- 172.21.15.149:0/3066649427 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea4011990 con 0x7f2eb406ab80 2023-11-08T19:23:27.249 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.243+0000 7f2eb2ffd700 1 -- 172.21.15.149:0/3066649427 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea4011d20 con 0x7f2eb406ab80 2023-11-08T19:23:27.249 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.243+0000 7f2eba92f700 1 -- 172.21.15.149:0/3066649427 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2eb406ab80 msgr2=0x7f2eb406c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:27.250 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.243+0000 7f2eba92f700 1 --2- 172.21.15.149:0/3066649427 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2eb406ab80 0x7f2eb406c5e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2eb406cb20 tx=0x7f2ea4009bd0 comp rx=0 tx=0).stop 2023-11-08T19:23:27.250 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.243+0000 7f2eba92f700 1 -- 172.21.15.149:0/3066649427 shutdown_connections 2023-11-08T19:23:27.250 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.243+0000 7f2eba92f700 1 --2- 172.21.15.149:0/3066649427 >> v2:172.21.15.160:3300/0 conn(0x7f2eb40cf1c0 0x7f2eb40caf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:27.250 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.243+0000 7f2eba92f700 1 --2- 172.21.15.149:0/3066649427 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2eb415df40 0x7f2eb406c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:27.250 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.243+0000 7f2eba92f700 1 --2- 172.21.15.149:0/3066649427 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2eb406ab80 0x7f2eb406c5e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:27.251 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.244+0000 7f2eba92f700 1 -- 172.21.15.149:0/3066649427 >> 172.21.15.149:0/3066649427 conn(0x7f2eb40d0640 msgr2=0x7f2eb40d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:27.251 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.244+0000 7f2eba92f700 1 -- 172.21.15.149:0/3066649427 shutdown_connections 2023-11-08T19:23:27.251 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.244+0000 7f2eba92f700 1 -- 172.21.15.149:0/3066649427 wait complete. 2023-11-08T19:23:27.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.245+0000 7f2eba92f700 1 Processor -- start 2023-11-08T19:23:27.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.245+0000 7f2eba92f700 1 -- start start 2023-11-08T19:23:27.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.246+0000 7f2eba92f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2eb406ab80 0x7f2eb40af0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:27.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.246+0000 7f2eba92f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2eb40cf1c0 0x7f2eb4155770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:27.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.246+0000 7f2eba92f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2eb415df40 0x7f2eb40c9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:27.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.246+0000 7f2eba92f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb40c9a30 con 0x7f2eb406ab80 2023-11-08T19:23:27.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.246+0000 7f2eba92f700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb41561c0 con 0x7f2eb415df40 2023-11-08T19:23:27.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.246+0000 7f2eba92f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb40c8e20 con 0x7f2eb40cf1c0 2023-11-08T19:23:27.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.246+0000 7f2eb3fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2eb406ab80 0x7f2eb40af0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:27.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.246+0000 7f2eb3fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2eb406ab80 0x7f2eb40af0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37716/0 (socket says 172.21.15.149:37716) 2023-11-08T19:23:27.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.246+0000 7f2eb3fff700 1 -- 172.21.15.149:0/2749391464 learned_addr learned my addr 172.21.15.149:0/2749391464 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:27.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.246+0000 7f2eb8ecc700 1 --2- 172.21.15.149:0/2749391464 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2eb415df40 0x7f2eb40c9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:27.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.246+0000 7f2eb37fe700 1 --2- 172.21.15.149:0/2749391464 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2eb40cf1c0 0x7f2eb4155770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:27.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.246+0000 7f2eb3fff700 1 -- 172.21.15.149:0/2749391464 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2eb40cf1c0 msgr2=0x7f2eb4155770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:27.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.246+0000 7f2eb3fff700 1 --2- 172.21.15.149:0/2749391464 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2eb40cf1c0 0x7f2eb4155770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:27.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.246+0000 7f2eb3fff700 1 -- 172.21.15.149:0/2749391464 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2eb415df40 msgr2=0x7f2eb40c9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:27.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.246+0000 7f2eb3fff700 1 --2- 172.21.15.149:0/2749391464 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2eb415df40 0x7f2eb40c9ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:27.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.246+0000 7f2eb3fff700 1 -- 172.21.15.149:0/2749391464 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea4009550 con 0x7f2eb406ab80 2023-11-08T19:23:27.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.246+0000 7f2eb8ecc700 1 --2- 172.21.15.149:0/2749391464 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2eb415df40 0x7f2eb40c9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:23:27.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.246+0000 7f2eb37fe700 1 --2- 172.21.15.149:0/2749391464 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2eb40cf1c0 0x7f2eb4155770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:23:27.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.246+0000 7f2eb3fff700 1 --2- 172.21.15.149:0/2749391464 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2eb406ab80 0x7f2eb40af0d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2ea800e870 tx=0x7f2ea800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:27.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.246+0000 7f2eb0ff9700 1 -- 172.21.15.149:0/2749391464 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea8009590 con 0x7f2eb406ab80 2023-11-08T19:23:27.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.246+0000 7f2eb0ff9700 1 -- 172.21.15.149:0/2749391464 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea800ee70 con 0x7f2eb406ab80 2023-11-08T19:23:27.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.246+0000 7f2eba92f700 1 -- 172.21.15.149:0/2749391464 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eb40c9100 con 0x7f2eb406ab80 2023-11-08T19:23:27.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.246+0000 7f2eb0ff9700 1 -- 172.21.15.149:0/2749391464 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea800ca50 con 0x7f2eb406ab80 2023-11-08T19:23:27.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.246+0000 7f2eba92f700 1 -- 172.21.15.149:0/2749391464 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eb40c96c0 con 0x7f2eb406ab80 2023-11-08T19:23:27.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.247+0000 7f2eba92f700 1 -- 172.21.15.149:0/2749391464 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2eb404f730 con 0x7f2eb406ab80 2023-11-08T19:23:27.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.248+0000 7f2eb0ff9700 1 -- 172.21.15.149:0/2749391464 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2ea800cbb0 con 0x7f2eb406ab80 2023-11-08T19:23:27.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.248+0000 7f2eb0ff9700 1 --2- 172.21.15.149:0/2749391464 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2ea006af00 0x7f2ea006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:27.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.248+0000 7f2eb0ff9700 1 -- 172.21.15.149:0/2749391464 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2ea80897e0 con 0x7f2eb406ab80 2023-11-08T19:23:27.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.248+0000 7f2eb37fe700 1 --2- 172.21.15.149:0/2749391464 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2ea006af00 0x7f2ea006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:27.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.249+0000 7f2eb37fe700 1 --2- 172.21.15.149:0/2749391464 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2ea006af00 0x7f2ea006d3c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4009c10 tx=0x7f2ea4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:27.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.253+0000 7f2eb0ff9700 1 -- 172.21.15.149:0/2749391464 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2ea80545a0 con 0x7f2eb406ab80 2023-11-08T19:23:27.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.446+0000 7f2eba92f700 1 -- 172.21.15.149:0/2749391464 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2eb40c9850 con 0x7f2eb406ab80 2023-11-08T19:23:27.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.446+0000 7f2eb0ff9700 1 -- 172.21.15.149:0/2749391464 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2ea800ce60 con 0x7f2eb406ab80 2023-11-08T19:23:27.448 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 1 2023-11-08T19:23:27.450 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.449+0000 7f2eba92f700 1 -- 172.21.15.149:0/2749391464 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2ea006af00 msgr2=0x7f2ea006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:27.450 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.449+0000 7f2eba92f700 1 --2- 172.21.15.149:0/2749391464 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2ea006af00 0x7f2ea006d3c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4009c10 tx=0x7f2ea4008030 comp rx=0 tx=0).stop 2023-11-08T19:23:27.450 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.449+0000 7f2eba92f700 1 -- 172.21.15.149:0/2749391464 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2eb406ab80 msgr2=0x7f2eb40af0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:27.451 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.449+0000 7f2eba92f700 1 --2- 172.21.15.149:0/2749391464 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2eb406ab80 0x7f2eb40af0d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2ea800e870 tx=0x7f2ea800ec30 comp rx=0 tx=0).stop 2023-11-08T19:23:27.451 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.449+0000 7f2eba92f700 1 -- 172.21.15.149:0/2749391464 shutdown_connections 2023-11-08T19:23:27.451 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.449+0000 7f2eba92f700 1 --2- 172.21.15.149:0/2749391464 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2ea006af00 0x7f2ea006d3c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:27.451 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.449+0000 7f2eba92f700 1 --2- 172.21.15.149:0/2749391464 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2eb415df40 0x7f2eb40c9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:27.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.449+0000 7f2eba92f700 1 --2- 172.21.15.149:0/2749391464 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2eb406ab80 0x7f2eb40af0d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:27.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.449+0000 7f2eba92f700 1 --2- 172.21.15.149:0/2749391464 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2eb40cf1c0 0x7f2eb4155770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:27.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.449+0000 7f2eba92f700 1 -- 172.21.15.149:0/2749391464 >> 172.21.15.149:0/2749391464 conn(0x7f2eb40d0640 msgr2=0x7f2eb4073960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:27.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.449+0000 7f2eba92f700 1 -- 172.21.15.149:0/2749391464 shutdown_connections 2023-11-08T19:23:27.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.449+0000 7f2eba92f700 1 -- 172.21.15.149:0/2749391464 wait complete. 2023-11-08T19:23:27.462 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-08T19:23:27.586 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.584+0000 7f7dc14f7700 1 Processor -- start 2023-11-08T19:23:27.587 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.584+0000 7f7dc14f7700 1 -- start start 2023-11-08T19:23:27.590 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.585+0000 7f7dc14f7700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7dbc0cfd50 0x7f7dbc06bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:27.590 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.585+0000 7f7dc14f7700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f7dbc06d700 0x7f7dbc0b3210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:27.591 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.585+0000 7f7dc14f7700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dbc06c3e0 con 0x7f7dbc0b3750 2023-11-08T19:23:27.591 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.585+0000 7f7dc14f7700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dbc0b3be0 con 0x7f7dbc06d700 2023-11-08T19:23:27.591 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.585+0000 7f7dc14f7700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dbc162560 con 0x7f7dbc0cfd50 2023-11-08T19:23:27.591 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.585+0000 7f7dbb7fe700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f7dbc0b3750 0x7f7dbc15d400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:39730/0 (socket says 172.21.15.149:39730) 2023-11-08T19:23:27.592 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.585+0000 7f7dbb7fe700 1 -- 172.21.15.149:0/3730062486 learned_addr learned my addr 172.21.15.149:0/3730062486 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:23:27.592 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.585+0000 7f7dbaffd700 1 --2- 172.21.15.149:0/3730062486 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7dbc0cfd50 0x7f7dbc06bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:27.592 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.585+0000 7f7dba7fc700 1 --2- 172.21.15.149:0/3730062486 >> v2:172.21.15.160:3300/0 conn(0x7f7dbc06d700 0x7f7dbc0b3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:27.592 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.585+0000 7f7db9ffb700 1 -- 172.21.15.149:0/3730062486 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3096952837 0 0) 0x7f7dbc06c3e0 con 0x7f7dbc0b3750 2023-11-08T19:23:27.592 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.585+0000 7f7db9ffb700 1 -- 172.21.15.149:0/3730062486 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7da40035b0 con 0x7f7dbc0b3750 2023-11-08T19:23:27.593 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.586+0000 7f7dba7fc700 1 -- 172.21.15.149:0/3730062486 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7dbc0cfd50 msgr2=0x7f7dbc06bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:27.593 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.586+0000 7f7dba7fc700 1 --2- 172.21.15.149:0/3730062486 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7dbc0cfd50 0x7f7dbc06bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:27.593 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.586+0000 7f7dba7fc700 1 -- 172.21.15.149:0/3730062486 >> v1:172.21.15.149:6789/0 conn(0x7f7dbc0b3750 legacy=0x7f7dbc15d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:27.593 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.586+0000 7f7db9ffb700 1 -- 172.21.15.149:0/3730062486 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 193222628 0 0) 0x7f7da40035b0 con 0x7f7dbc0b3750 2023-11-08T19:23:27.594 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.586+0000 7f7dba7fc700 1 -- 172.21.15.149:0/3730062486 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dbc1619e0 con 0x7f7dbc06d700 2023-11-08T19:23:27.594 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.586+0000 7f7dba7fc700 1 --2- 172.21.15.149:0/3730062486 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7dbc06d700 0x7f7dbc0b3210 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7dac009840 tx=0x7f7dac009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45749070b99c9fdc server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:27.594 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.586+0000 7f7db9ffb700 1 -- 172.21.15.149:0/3730062486 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db40019f0 con 0x7f7dbc06d700 2023-11-08T19:23:27.594 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.586+0000 7f7db9ffb700 1 -- 172.21.15.149:0/3730062486 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dac004030 con 0x7f7dbc06d700 2023-11-08T19:23:27.595 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.586+0000 7f7db9ffb700 1 -- 172.21.15.149:0/3730062486 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dac0043c0 con 0x7f7dbc06d700 2023-11-08T19:23:27.595 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.586+0000 7f7dc14f7700 1 -- 172.21.15.149:0/3730062486 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7dbc06d700 msgr2=0x7f7dbc0b3210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:27.595 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.586+0000 7f7dc14f7700 1 --2- 172.21.15.149:0/3730062486 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7dbc06d700 0x7f7dbc0b3210 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7dac009840 tx=0x7f7dac009b50 comp rx=0 tx=0).stop 2023-11-08T19:23:27.595 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.586+0000 7f7dc14f7700 1 -- 172.21.15.149:0/3730062486 shutdown_connections 2023-11-08T19:23:27.595 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.586+0000 7f7dc14f7700 1 --2- 172.21.15.149:0/3730062486 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7dbc0cfd50 0x7f7dbc06bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:27.596 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.586+0000 7f7dc14f7700 1 --2- 172.21.15.149:0/3730062486 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7dbc06d700 0x7f7dbc0b3210 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:27.596 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.586+0000 7f7dc14f7700 1 -- 172.21.15.149:0/3730062486 >> 172.21.15.149:0/3730062486 conn(0x7f7dbc0ce210 msgr2=0x7f7dbc0ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:27.596 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.587+0000 7f7dc14f7700 1 -- 172.21.15.149:0/3730062486 shutdown_connections 2023-11-08T19:23:27.596 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.587+0000 7f7dc14f7700 1 -- 172.21.15.149:0/3730062486 wait complete. 2023-11-08T19:23:27.596 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.588+0000 7f7dc14f7700 1 Processor -- start 2023-11-08T19:23:27.597 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.588+0000 7f7dc14f7700 1 -- start start 2023-11-08T19:23:27.599 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.589+0000 7f7dc14f7700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7dbc06d700 0x7f7dbc15b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:27.599 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.589+0000 7f7dc14f7700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7dbc0b3750 0x7f7dbc0b58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:27.600 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.589+0000 7f7dc14f7700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7dbc0cfd50 0x7f7dbc0b5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:27.600 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.589+0000 7f7dc14f7700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dbc0b7080 con 0x7f7dbc0cfd50 2023-11-08T19:23:27.600 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.589+0000 7f7dc14f7700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dbc0b7510 con 0x7f7dbc06d700 2023-11-08T19:23:27.600 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.589+0000 7f7dc14f7700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dbc0b6470 con 0x7f7dbc0b3750 2023-11-08T19:23:27.600 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.589+0000 7f7dbb7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7dbc0cfd50 0x7f7dbc0b5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:27.601 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.589+0000 7f7dbb7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7dbc0cfd50 0x7f7dbc0b5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37734/0 (socket says 172.21.15.149:37734) 2023-11-08T19:23:27.601 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.589+0000 7f7dbb7fe700 1 -- 172.21.15.149:0/4215858534 learned_addr learned my addr 172.21.15.149:0/4215858534 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:27.601 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.589+0000 7f7dba7fc700 1 --2- 172.21.15.149:0/4215858534 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7dbc0b3750 0x7f7dbc0b58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:27.601 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.589+0000 7f7dbaffd700 1 --2- 172.21.15.149:0/4215858534 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7dbc06d700 0x7f7dbc15b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:27.602 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.589+0000 7f7dbb7fe700 1 -- 172.21.15.149:0/4215858534 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7dbc0b3750 msgr2=0x7f7dbc0b58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:27.602 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.589+0000 7f7dbb7fe700 1 --2- 172.21.15.149:0/4215858534 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7dbc0b3750 0x7f7dbc0b58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:27.602 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.589+0000 7f7dbb7fe700 1 -- 172.21.15.149:0/4215858534 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7dbc06d700 msgr2=0x7f7dbc15b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:27.602 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.589+0000 7f7dbb7fe700 1 --2- 172.21.15.149:0/4215858534 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7dbc06d700 0x7f7dbc15b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:27.602 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.589+0000 7f7dbb7fe700 1 -- 172.21.15.149:0/4215858534 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dac0094a0 con 0x7f7dbc0cfd50 2023-11-08T19:23:27.603 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.589+0000 7f7dbb7fe700 1 --2- 172.21.15.149:0/4215858534 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7dbc0cfd50 0x7f7dbc0b5e10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7db400cbe0 tx=0x7f7db400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:27.603 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.589+0000 7f7da37fe700 1 -- 172.21.15.149:0/4215858534 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db400ab80 con 0x7f7dbc0cfd50 2023-11-08T19:23:27.603 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.589+0000 7f7da37fe700 1 -- 172.21.15.149:0/4215858534 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7db400ad00 con 0x7f7dbc0cfd50 2023-11-08T19:23:27.603 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.589+0000 7f7dc14f7700 1 -- 172.21.15.149:0/4215858534 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dbc0b6750 con 0x7f7dbc0cfd50 2023-11-08T19:23:27.603 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.589+0000 7f7da37fe700 1 -- 172.21.15.149:0/4215858534 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db4007310 con 0x7f7dbc0cfd50 2023-11-08T19:23:27.604 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.589+0000 7f7dc14f7700 1 -- 172.21.15.149:0/4215858534 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dbc0b6d10 con 0x7f7dbc0cfd50 2023-11-08T19:23:27.604 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.590+0000 7f7dc14f7700 1 -- 172.21.15.149:0/4215858534 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dbc0cde80 con 0x7f7dbc0cfd50 2023-11-08T19:23:27.604 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.591+0000 7f7da37fe700 1 -- 172.21.15.149:0/4215858534 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7db4007470 con 0x7f7dbc0cfd50 2023-11-08T19:23:27.604 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.591+0000 7f7da37fe700 1 --2- 172.21.15.149:0/4215858534 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f7da806af00 0x7f7da806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:27.604 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.591+0000 7f7da37fe700 1 -- 172.21.15.149:0/4215858534 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7db4089710 con 0x7f7dbc0cfd50 2023-11-08T19:23:27.604 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.591+0000 7f7dbaffd700 1 --2- 172.21.15.149:0/4215858534 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f7da806af00 0x7f7da806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:27.605 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.592+0000 7f7dbaffd700 1 --2- 172.21.15.149:0/4215858534 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f7da806af00 0x7f7da806d3c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc1f6f90 tx=0x7f7db0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:27.605 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.596+0000 7f7da37fe700 1 -- 172.21.15.149:0/4215858534 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7db4054560 con 0x7f7dbc0cfd50 2023-11-08T19:23:27.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.787+0000 7f7dc14f7700 1 -- 172.21.15.149:0/4215858534 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7dbc04f730 con 0x7f7dbc0cfd50 2023-11-08T19:23:27.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.787+0000 7f7da37fe700 1 -- 172.21.15.149:0/4215858534 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7db4057b80 con 0x7f7dbc0cfd50 2023-11-08T19:23:27.790 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:23:27.792 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.789+0000 7f7dc14f7700 1 -- 172.21.15.149:0/4215858534 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f7da806af00 msgr2=0x7f7da806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:27.792 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.789+0000 7f7dc14f7700 1 --2- 172.21.15.149:0/4215858534 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f7da806af00 0x7f7da806d3c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc1f6f90 tx=0x7f7db0008040 comp rx=0 tx=0).stop 2023-11-08T19:23:27.792 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.789+0000 7f7dc14f7700 1 -- 172.21.15.149:0/4215858534 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7dbc0cfd50 msgr2=0x7f7dbc0b5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:27.793 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.789+0000 7f7dc14f7700 1 --2- 172.21.15.149:0/4215858534 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7dbc0cfd50 0x7f7dbc0b5e10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7db400cbe0 tx=0x7f7db400a060 comp rx=0 tx=0).stop 2023-11-08T19:23:27.793 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.789+0000 7f7dc14f7700 1 -- 172.21.15.149:0/4215858534 shutdown_connections 2023-11-08T19:23:27.793 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.790+0000 7f7dc14f7700 1 --2- 172.21.15.149:0/4215858534 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f7da806af00 0x7f7da806d3c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:27.793 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.790+0000 7f7dc14f7700 1 --2- 172.21.15.149:0/4215858534 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7dbc06d700 0x7f7dbc15b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:27.793 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.790+0000 7f7dc14f7700 1 --2- 172.21.15.149:0/4215858534 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7dbc0cfd50 0x7f7dbc0b5e10 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:27.794 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.790+0000 7f7dc14f7700 1 --2- 172.21.15.149:0/4215858534 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7dbc0b3750 0x7f7dbc0b58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:27.794 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.790+0000 7f7dc14f7700 1 -- 172.21.15.149:0/4215858534 >> 172.21.15.149:0/4215858534 conn(0x7f7dbc0ce210 msgr2=0x7f7dbc0d1700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:27.794 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.790+0000 7f7dc14f7700 1 -- 172.21.15.149:0/4215858534 shutdown_connections 2023-11-08T19:23:27.794 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.790+0000 7f7dc14f7700 1 -- 172.21.15.149:0/4215858534 wait complete. 2023-11-08T19:23:27.804 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-08T19:23:27.928 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.925+0000 7f970ce77700 1 Processor -- start 2023-11-08T19:23:27.928 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.925+0000 7f970ce77700 1 -- start start 2023-11-08T19:23:27.930 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.926+0000 7f970ce77700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f970815df40 0x7f970806c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:27.930 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.926+0000 7f970ce77700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f970806ab80 0x7f970806c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:27.931 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.926+0000 7f970ce77700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f97080cf1c0 0x7f97080caf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:27.931 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.926+0000 7f970ce77700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f970815e320 con 0x7f97080cf1c0 2023-11-08T19:23:27.931 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.926+0000 7f970ce77700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f970806b020 con 0x7f970815df40 2023-11-08T19:23:27.931 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.926+0000 7f970ce77700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f970806b2e0 con 0x7f970806ab80 2023-11-08T19:23:27.932 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.927+0000 7f9706d9d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f97080cf1c0 0x7f97080caf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:27.932 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.927+0000 7f9706d9d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f97080cf1c0 0x7f97080caf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37738/0 (socket says 172.21.15.149:37738) 2023-11-08T19:23:27.932 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.927+0000 7f9706d9d700 1 -- 172.21.15.149:0/1398102668 learned_addr learned my addr 172.21.15.149:0/1398102668 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:27.932 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.927+0000 7f970659c700 1 --2- 172.21.15.149:0/1398102668 >> v2:172.21.15.160:3300/0 conn(0x7f970815df40 0x7f970806c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:27.933 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.927+0000 7f9705d9b700 1 --2- 172.21.15.149:0/1398102668 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f970806ab80 0x7f970806c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:27.933 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.927+0000 7f9706d9d700 1 -- 172.21.15.149:0/1398102668 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f970806ab80 msgr2=0x7f970806c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:27.933 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.927+0000 7f9706d9d700 1 --2- 172.21.15.149:0/1398102668 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f970806ab80 0x7f970806c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:27.933 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.927+0000 7f9706d9d700 1 -- 172.21.15.149:0/1398102668 >> v2:172.21.15.160:3300/0 conn(0x7f970815df40 msgr2=0x7f970806c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:27.934 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.927+0000 7f9706d9d700 1 --2- 172.21.15.149:0/1398102668 >> v2:172.21.15.160:3300/0 conn(0x7f970815df40 0x7f970806c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:27.934 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.927+0000 7f9706d9d700 1 -- 172.21.15.149:0/1398102668 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f970806b5c0 con 0x7f97080cf1c0 2023-11-08T19:23:27.934 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.927+0000 7f9706d9d700 1 --2- 172.21.15.149:0/1398102668 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97080cf1c0 0x7f97080caf50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f97080ce190 tx=0x7f970000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7727cade4e524249 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:27.934 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.927+0000 7f970559a700 1 -- 172.21.15.149:0/1398102668 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f970000e070 con 0x7f97080cf1c0 2023-11-08T19:23:27.934 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.927+0000 7f970559a700 1 -- 172.21.15.149:0/1398102668 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f970000b9c0 con 0x7f97080cf1c0 2023-11-08T19:23:27.935 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.927+0000 7f970559a700 1 -- 172.21.15.149:0/1398102668 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f970000bd70 con 0x7f97080cf1c0 2023-11-08T19:23:27.935 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.928+0000 7f970ce77700 1 -- 172.21.15.149:0/1398102668 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97080cf1c0 msgr2=0x7f97080caf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:27.935 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.928+0000 7f970ce77700 1 --2- 172.21.15.149:0/1398102668 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97080cf1c0 0x7f97080caf50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f97080ce190 tx=0x7f970000b330 comp rx=0 tx=0).stop 2023-11-08T19:23:27.935 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.928+0000 7f970ce77700 1 -- 172.21.15.149:0/1398102668 shutdown_connections 2023-11-08T19:23:27.935 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.928+0000 7f970ce77700 1 --2- 172.21.15.149:0/1398102668 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97080cf1c0 0x7f97080caf50 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:27.936 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.928+0000 7f970ce77700 1 --2- 172.21.15.149:0/1398102668 >> v2:172.21.15.160:3300/0 conn(0x7f970815df40 0x7f970806c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:27.936 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.928+0000 7f970ce77700 1 --2- 172.21.15.149:0/1398102668 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f970806ab80 0x7f970806c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:27.936 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.928+0000 7f970ce77700 1 -- 172.21.15.149:0/1398102668 >> 172.21.15.149:0/1398102668 conn(0x7f97080d0640 msgr2=0x7f97080d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:27.936 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.928+0000 7f970ce77700 1 -- 172.21.15.149:0/1398102668 shutdown_connections 2023-11-08T19:23:27.936 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.928+0000 7f970ce77700 1 -- 172.21.15.149:0/1398102668 wait complete. 2023-11-08T19:23:27.939 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.929+0000 7f970ce77700 1 Processor -- start 2023-11-08T19:23:27.939 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.929+0000 7f970ce77700 1 -- start start 2023-11-08T19:23:27.940 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.930+0000 7f970ce77700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f970806ab80 0x7f97080ca0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:27.940 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.930+0000 7f970ce77700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97080cf1c0 0x7f9708152040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:27.940 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.930+0000 7f970ce77700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f970815df40 0x7f97080aeca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:27.940 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.930+0000 7f970ce77700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97080c88b0 con 0x7f97080cf1c0 2023-11-08T19:23:27.941 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.930+0000 7f970ce77700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97080ca5e0 con 0x7f970815df40 2023-11-08T19:23:27.941 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.930+0000 7f970ce77700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97080ad1b0 con 0x7f970806ab80 2023-11-08T19:23:27.941 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.930+0000 7f9705d9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97080cf1c0 0x7f9708152040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:27.941 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.930+0000 7f9705d9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97080cf1c0 0x7f9708152040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37744/0 (socket says 172.21.15.149:37744) 2023-11-08T19:23:27.941 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.930+0000 7f9705d9b700 1 -- 172.21.15.149:0/3541328537 learned_addr learned my addr 172.21.15.149:0/3541328537 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:27.942 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.930+0000 7f970659c700 1 --2- 172.21.15.149:0/3541328537 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f970806ab80 0x7f97080ca0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:27.942 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.930+0000 7f9706d9d700 1 --2- 172.21.15.149:0/3541328537 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f970815df40 0x7f97080aeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:27.942 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.930+0000 7f9705d9b700 1 -- 172.21.15.149:0/3541328537 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f970806ab80 msgr2=0x7f97080ca0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:27.942 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.930+0000 7f9705d9b700 1 --2- 172.21.15.149:0/3541328537 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f970806ab80 0x7f97080ca0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:27.942 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.930+0000 7f9705d9b700 1 -- 172.21.15.149:0/3541328537 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f970815df40 msgr2=0x7f97080aeca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:27.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.930+0000 7f9705d9b700 1 --2- 172.21.15.149:0/3541328537 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f970815df40 0x7f97080aeca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:27.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.930+0000 7f9705d9b700 1 -- 172.21.15.149:0/3541328537 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9700009b30 con 0x7f97080cf1c0 2023-11-08T19:23:27.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.931+0000 7f9705d9b700 1 --2- 172.21.15.149:0/3541328537 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97080cf1c0 0x7f9708152040 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f96f800e810 tx=0x7f96f800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:27.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.931+0000 7f96f6ffd700 1 -- 172.21.15.149:0/3541328537 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f800c070 con 0x7f97080cf1c0 2023-11-08T19:23:27.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.931+0000 7f96f6ffd700 1 -- 172.21.15.149:0/3541328537 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96f8013610 con 0x7f97080cf1c0 2023-11-08T19:23:27.944 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.931+0000 7f970ce77700 1 -- 172.21.15.149:0/3541328537 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f970815e4b0 con 0x7f97080cf1c0 2023-11-08T19:23:27.944 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.931+0000 7f96f6ffd700 1 -- 172.21.15.149:0/3541328537 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f80139c0 con 0x7f97080cf1c0 2023-11-08T19:23:27.944 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.931+0000 7f970ce77700 1 -- 172.21.15.149:0/3541328537 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97080c81f0 con 0x7f97080cf1c0 2023-11-08T19:23:27.944 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.932+0000 7f970ce77700 1 -- 172.21.15.149:0/3541328537 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f970815b2d0 con 0x7f97080cf1c0 2023-11-08T19:23:27.944 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.932+0000 7f96f6ffd700 1 -- 172.21.15.149:0/3541328537 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f96f8013b20 con 0x7f97080cf1c0 2023-11-08T19:23:27.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.933+0000 7f96f6ffd700 1 --2- 172.21.15.149:0/3541328537 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f96e806af00 0x7f96e806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:27.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.933+0000 7f970659c700 1 --2- 172.21.15.149:0/3541328537 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f96e806af00 0x7f96e806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:27.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.933+0000 7f96f6ffd700 1 -- 172.21.15.149:0/3541328537 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f96f8089670 con 0x7f97080cf1c0 2023-11-08T19:23:27.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.933+0000 7f970659c700 1 --2- 172.21.15.149:0/3541328537 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f96e806af00 0x7f96e806d3c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f96fc006b20 tx=0x7f96fc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:27.946 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:27.938+0000 7f96f6ffd700 1 -- 172.21.15.149:0/3541328537 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f96f80543a0 con 0x7f97080cf1c0 2023-11-08T19:23:28.131 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.129+0000 7f970ce77700 1 -- 172.21.15.149:0/3541328537 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f970804f730 con 0x7f97080cf1c0 2023-11-08T19:23:28.132 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.129+0000 7f96f6ffd700 1 -- 172.21.15.149:0/3541328537 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f96f80579c0 con 0x7f97080cf1c0 2023-11-08T19:23:28.132 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 64 2023-11-08T19:23:28.134 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.132+0000 7f970ce77700 1 -- 172.21.15.149:0/3541328537 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f96e806af00 msgr2=0x7f96e806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:28.135 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.132+0000 7f970ce77700 1 --2- 172.21.15.149:0/3541328537 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f96e806af00 0x7f96e806d3c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f96fc006b20 tx=0x7f96fc008040 comp rx=0 tx=0).stop 2023-11-08T19:23:28.135 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.132+0000 7f970ce77700 1 -- 172.21.15.149:0/3541328537 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97080cf1c0 msgr2=0x7f9708152040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:28.135 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.132+0000 7f970ce77700 1 --2- 172.21.15.149:0/3541328537 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97080cf1c0 0x7f9708152040 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f96f800e810 tx=0x7f96f800eb20 comp rx=0 tx=0).stop 2023-11-08T19:23:28.135 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.132+0000 7f970ce77700 1 -- 172.21.15.149:0/3541328537 shutdown_connections 2023-11-08T19:23:28.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.132+0000 7f970ce77700 1 --2- 172.21.15.149:0/3541328537 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f96e806af00 0x7f96e806d3c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:28.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.132+0000 7f970ce77700 1 --2- 172.21.15.149:0/3541328537 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f970815df40 0x7f97080aeca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:28.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.132+0000 7f970ce77700 1 --2- 172.21.15.149:0/3541328537 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f970806ab80 0x7f97080ca0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:28.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.132+0000 7f970ce77700 1 --2- 172.21.15.149:0/3541328537 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97080cf1c0 0x7f9708152040 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:28.137 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.132+0000 7f970ce77700 1 -- 172.21.15.149:0/3541328537 >> 172.21.15.149:0/3541328537 conn(0x7f97080d0640 msgr2=0x7f970815abc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:28.137 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.132+0000 7f970ce77700 1 -- 172.21.15.149:0/3541328537 shutdown_connections 2023-11-08T19:23:28.137 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.132+0000 7f970ce77700 1 -- 172.21.15.149:0/3541328537 wait complete. 2023-11-08T19:23:28.147 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-08T19:23:28.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.269+0000 7f9f11bd7700 1 Processor -- start 2023-11-08T19:23:28.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.269+0000 7f9f11bd7700 1 -- start start 2023-11-08T19:23:28.273 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.269+0000 7f9f11bd7700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f9f0c15f470 0x7f9f0c15c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:28.274 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.269+0000 7f9f11bd7700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f9f0c15cb60 0x7f9f0c0cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:28.274 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.269+0000 7f9f11bd7700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f0c15be80 con 0x7f9f0c0cc0d0 2023-11-08T19:23:28.274 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.269+0000 7f9f11bd7700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f0c0ccbc0 con 0x7f9f0c15cb60 2023-11-08T19:23:28.274 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.269+0000 7f9f11bd7700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f0c15f8d0 con 0x7f9f0c15f470 2023-11-08T19:23:28.275 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.270+0000 7f9f0bfff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f9f0c15cb60 0x7f9f0c0cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:28.275 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.270+0000 7f9f0bfff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f9f0c15cb60 0x7f9f0c0cf320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37754/0 (socket says 172.21.15.149:37754) 2023-11-08T19:23:28.275 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.270+0000 7f9f0b7fe700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f9f0c0cc0d0 0x7f9f0c0cc4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:39752/0 (socket says 172.21.15.149:39752) 2023-11-08T19:23:28.275 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.270+0000 7f9f0bfff700 1 -- 172.21.15.149:0/3672454482 learned_addr learned my addr 172.21.15.149:0/3672454482 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:28.276 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.270+0000 7f9f0affd700 1 --2- 172.21.15.149:0/3672454482 >> v2:172.21.15.160:3300/0 conn(0x7f9f0c15f470 0x7f9f0c15c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:28.276 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.270+0000 7f9f0bfff700 1 -- 172.21.15.149:0/3672454482 >> v2:172.21.15.160:3300/0 conn(0x7f9f0c15f470 msgr2=0x7f9f0c15c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:28.276 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.270+0000 7f9f0bfff700 1 --2- 172.21.15.149:0/3672454482 >> v2:172.21.15.160:3300/0 conn(0x7f9f0c15f470 0x7f9f0c15c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:28.276 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.270+0000 7f9f0bfff700 1 -- 172.21.15.149:0/3672454482 >> v1:172.21.15.149:6789/0 conn(0x7f9f0c0cc0d0 legacy=0x7f9f0c0cc4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:28.276 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.270+0000 7f9f0bfff700 1 -- 172.21.15.149:0/3672454482 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f0c15fba0 con 0x7f9f0c15cb60 2023-11-08T19:23:28.277 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.270+0000 7f9f0bfff700 1 --2- 172.21.15.149:0/3672454482 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f0c15cb60 0x7f9f0c0cf320 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c04f150 tx=0x7f9f0400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=793c5a726dbc8133 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:28.277 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.270+0000 7f9f0a7fc700 1 -- 172.21.15.149:0/3672454482 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f0400e070 con 0x7f9f0c15cb60 2023-11-08T19:23:28.277 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.270+0000 7f9f0a7fc700 1 -- 172.21.15.149:0/3672454482 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f0400b9c0 con 0x7f9f0c15cb60 2023-11-08T19:23:28.277 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.270+0000 7f9f0a7fc700 1 -- 172.21.15.149:0/3672454482 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f0400bd70 con 0x7f9f0c15cb60 2023-11-08T19:23:28.278 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.271+0000 7f9f11bd7700 1 -- 172.21.15.149:0/3672454482 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f0c15cb60 msgr2=0x7f9f0c0cf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:28.278 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.271+0000 7f9f11bd7700 1 --2- 172.21.15.149:0/3672454482 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f0c15cb60 0x7f9f0c0cf320 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c04f150 tx=0x7f9f0400b330 comp rx=0 tx=0).stop 2023-11-08T19:23:28.278 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.271+0000 7f9f11bd7700 1 -- 172.21.15.149:0/3672454482 shutdown_connections 2023-11-08T19:23:28.278 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.271+0000 7f9f11bd7700 1 --2- 172.21.15.149:0/3672454482 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f0c15cb60 0x7f9f0c0cf320 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:28.278 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.271+0000 7f9f11bd7700 1 --2- 172.21.15.149:0/3672454482 >> v2:172.21.15.160:3300/0 conn(0x7f9f0c15f470 0x7f9f0c15c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:28.279 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.271+0000 7f9f11bd7700 1 -- 172.21.15.149:0/3672454482 >> 172.21.15.149:0/3672454482 conn(0x7f9f0c06f120 msgr2=0x7f9f0c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:28.279 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.271+0000 7f9f11bd7700 1 -- 172.21.15.149:0/3672454482 shutdown_connections 2023-11-08T19:23:28.279 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.271+0000 7f9f11bd7700 1 -- 172.21.15.149:0/3672454482 wait complete. 2023-11-08T19:23:28.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.272+0000 7f9f11bd7700 1 Processor -- start 2023-11-08T19:23:28.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.272+0000 7f9f11bd7700 1 -- start start 2023-11-08T19:23:28.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.273+0000 7f9f11bd7700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f0c0cc0d0 0x7f9f0c1f0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:28.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.273+0000 7f9f11bd7700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9f0c15cb60 0x7f9f0c0b38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:28.283 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.273+0000 7f9f11bd7700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9f0c15f470 0x7f9f0c0b17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:28.283 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.273+0000 7f9f11bd7700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0c0c91e0 con 0x7f9f0c0cc0d0 2023-11-08T19:23:28.283 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.273+0000 7f9f11bd7700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0c0b1630 con 0x7f9f0c15cb60 2023-11-08T19:23:28.283 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.273+0000 7f9f11bd7700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0c0b0e60 con 0x7f9f0c15f470 2023-11-08T19:23:28.283 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.273+0000 7f9f0b7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f0c0cc0d0 0x7f9f0c1f0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:28.284 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.273+0000 7f9f0b7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f0c0cc0d0 0x7f9f0c1f0a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37756/0 (socket says 172.21.15.149:37756) 2023-11-08T19:23:28.284 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.273+0000 7f9f0b7fe700 1 -- 172.21.15.149:0/3354692950 learned_addr learned my addr 172.21.15.149:0/3354692950 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:28.284 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.273+0000 7f9f0affd700 1 --2- 172.21.15.149:0/3354692950 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9f0c15cb60 0x7f9f0c0b38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:28.284 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.273+0000 7f9f0bfff700 1 --2- 172.21.15.149:0/3354692950 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9f0c15f470 0x7f9f0c0b17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:28.284 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.273+0000 7f9f0b7fe700 1 -- 172.21.15.149:0/3354692950 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9f0c15f470 msgr2=0x7f9f0c0b17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:28.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.273+0000 7f9f0b7fe700 1 --2- 172.21.15.149:0/3354692950 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9f0c15f470 0x7f9f0c0b17f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:28.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.273+0000 7f9f0b7fe700 1 -- 172.21.15.149:0/3354692950 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9f0c15cb60 msgr2=0x7f9f0c0b38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:28.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.273+0000 7f9f0b7fe700 1 --2- 172.21.15.149:0/3354692950 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9f0c15cb60 0x7f9f0c0b38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:28.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.273+0000 7f9f0b7fe700 1 -- 172.21.15.149:0/3354692950 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f04009b30 con 0x7f9f0c0cc0d0 2023-11-08T19:23:28.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.273+0000 7f9f0affd700 1 --2- 172.21.15.149:0/3354692950 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9f0c15cb60 0x7f9f0c0b38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:23:28.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.273+0000 7f9f0b7fe700 1 --2- 172.21.15.149:0/3354692950 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f0c0cc0d0 0x7f9f0c1f0a90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9efc00c520 tx=0x7f9efc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:28.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.274+0000 7f9ef3fff700 1 -- 172.21.15.149:0/3354692950 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9efc005cb0 con 0x7f9f0c0cc0d0 2023-11-08T19:23:28.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.274+0000 7f9ef3fff700 1 -- 172.21.15.149:0/3354692950 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9efc005e10 con 0x7f9f0c0cc0d0 2023-11-08T19:23:28.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.274+0000 7f9f11bd7700 1 -- 172.21.15.149:0/3354692950 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f0c0b10d0 con 0x7f9f0c0cc0d0 2023-11-08T19:23:28.287 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.274+0000 7f9ef3fff700 1 -- 172.21.15.149:0/3354692950 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9efc0072d0 con 0x7f9f0c0cc0d0 2023-11-08T19:23:28.287 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.274+0000 7f9f11bd7700 1 -- 172.21.15.149:0/3354692950 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f0c0c96b0 con 0x7f9f0c0cc0d0 2023-11-08T19:23:28.287 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.275+0000 7f9f11bd7700 1 -- 172.21.15.149:0/3354692950 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f0c04f730 con 0x7f9f0c0cc0d0 2023-11-08T19:23:28.287 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.275+0000 7f9ef3fff700 1 -- 172.21.15.149:0/3354692950 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9efc007430 con 0x7f9f0c0cc0d0 2023-11-08T19:23:28.287 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.275+0000 7f9ef3fff700 1 --2- 172.21.15.149:0/3354692950 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9ef806af00 0x7f9ef806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:28.288 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.275+0000 7f9ef3fff700 1 -- 172.21.15.149:0/3354692950 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9efc088cd0 con 0x7f9f0c0cc0d0 2023-11-08T19:23:28.288 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.275+0000 7f9f0affd700 1 --2- 172.21.15.149:0/3354692950 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9ef806af00 0x7f9ef806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:28.288 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.276+0000 7f9f0affd700 1 --2- 172.21.15.149:0/3354692950 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9ef806af00 0x7f9ef806d3c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c0d1220 tx=0x7f9f00008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:28.288 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.280+0000 7f9ef3fff700 1 -- 172.21.15.149:0/3354692950 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9efc053b40 con 0x7f9f0c0cc0d0 2023-11-08T19:23:28.471 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.469+0000 7f9f11bd7700 1 -- 172.21.15.149:0/3354692950 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f9f0c06ff20 con 0x7f9f0c0cc0d0 2023-11-08T19:23:28.472 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.470+0000 7f9ef3fff700 1 -- 172.21.15.149:0/3354692950 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9efc017020 con 0x7f9f0c0cc0d0 2023-11-08T19:23:28.472 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:23:28.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.472+0000 7f9f11bd7700 1 -- 172.21.15.149:0/3354692950 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9ef806af00 msgr2=0x7f9ef806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:28.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.472+0000 7f9f11bd7700 1 --2- 172.21.15.149:0/3354692950 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9ef806af00 0x7f9ef806d3c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c0d1220 tx=0x7f9f00008040 comp rx=0 tx=0).stop 2023-11-08T19:23:28.475 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.472+0000 7f9f11bd7700 1 -- 172.21.15.149:0/3354692950 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f0c0cc0d0 msgr2=0x7f9f0c1f0a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:28.475 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.472+0000 7f9f11bd7700 1 --2- 172.21.15.149:0/3354692950 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f0c0cc0d0 0x7f9f0c1f0a90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9efc00c520 tx=0x7f9efc00c8e0 comp rx=0 tx=0).stop 2023-11-08T19:23:28.475 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.472+0000 7f9f11bd7700 1 -- 172.21.15.149:0/3354692950 shutdown_connections 2023-11-08T19:23:28.475 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.472+0000 7f9f11bd7700 1 --2- 172.21.15.149:0/3354692950 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9ef806af00 0x7f9ef806d3c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:28.475 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.472+0000 7f9f11bd7700 1 --2- 172.21.15.149:0/3354692950 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9f0c15f470 0x7f9f0c0b17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:28.476 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.472+0000 7f9f11bd7700 1 --2- 172.21.15.149:0/3354692950 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f0c0cc0d0 0x7f9f0c1f0a90 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:28.476 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.472+0000 7f9f11bd7700 1 --2- 172.21.15.149:0/3354692950 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9f0c15cb60 0x7f9f0c0b38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:28.476 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.472+0000 7f9f11bd7700 1 -- 172.21.15.149:0/3354692950 >> 172.21.15.149:0/3354692950 conn(0x7f9f0c06f120 msgr2=0x7f9f0c15e500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:28.476 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.472+0000 7f9f11bd7700 1 -- 172.21.15.149:0/3354692950 shutdown_connections 2023-11-08T19:23:28.476 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.472+0000 7f9f11bd7700 1 -- 172.21.15.149:0/3354692950 wait complete. 2023-11-08T19:23:28.486 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:23:28.607 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.605+0000 7f1735e76700 1 Processor -- start 2023-11-08T19:23:28.607 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.605+0000 7f1735e76700 1 -- start start 2023-11-08T19:23:28.610 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.605+0000 7f1735e76700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f173015b950 0x7f17300cc290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:28.610 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.606+0000 7f1735e76700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f17300d0fe0 0x7f17300cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:28.610 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.606+0000 7f1735e76700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f173015f440 0x7f173015f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:28.610 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.606+0000 7f1735e76700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17300caa90 con 0x7f173015f440 2023-11-08T19:23:28.611 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.606+0000 7f1735e76700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f173015bd30 con 0x7f173015b950 2023-11-08T19:23:28.611 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.606+0000 7f1735e76700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17300c7670 con 0x7f17300d0fe0 2023-11-08T19:23:28.611 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.606+0000 7f172ffff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f173015f440 0x7f173015f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:28.611 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.606+0000 7f172ffff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f173015f440 0x7f173015f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37768/0 (socket says 172.21.15.149:37768) 2023-11-08T19:23:28.612 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.606+0000 7f172ffff700 1 -- 172.21.15.149:0/3616822766 learned_addr learned my addr 172.21.15.149:0/3616822766 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:28.612 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.606+0000 7f172effd700 1 --2- 172.21.15.149:0/3616822766 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f17300d0fe0 0x7f17300cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:28.612 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.606+0000 7f172f7fe700 1 --2- 172.21.15.149:0/3616822766 >> v2:172.21.15.160:3300/0 conn(0x7f173015b950 0x7f17300cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:28.612 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.606+0000 7f172ffff700 1 -- 172.21.15.149:0/3616822766 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f17300d0fe0 msgr2=0x7f17300cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:28.613 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.606+0000 7f172ffff700 1 --2- 172.21.15.149:0/3616822766 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f17300d0fe0 0x7f17300cc7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:28.613 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.606+0000 7f172ffff700 1 -- 172.21.15.149:0/3616822766 >> v2:172.21.15.160:3300/0 conn(0x7f173015b950 msgr2=0x7f17300cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:28.613 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.606+0000 7f172ffff700 1 --2- 172.21.15.149:0/3616822766 >> v2:172.21.15.160:3300/0 conn(0x7f173015b950 0x7f17300cc290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:28.613 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.606+0000 7f172ffff700 1 -- 172.21.15.149:0/3616822766 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17300c81f0 con 0x7f173015f440 2023-11-08T19:23:28.614 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.606+0000 7f172ffff700 1 --2- 172.21.15.149:0/3616822766 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f173015f440 0x7f173015f8f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f17300ce120 tx=0x7f172800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9397e0c661eeefd1 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:28.614 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.606+0000 7f172e7fc700 1 -- 172.21.15.149:0/3616822766 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f172800e070 con 0x7f173015f440 2023-11-08T19:23:28.614 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.606+0000 7f172e7fc700 1 -- 172.21.15.149:0/3616822766 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f172800b910 con 0x7f173015f440 2023-11-08T19:23:28.614 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.606+0000 7f172e7fc700 1 -- 172.21.15.149:0/3616822766 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f172800bcc0 con 0x7f173015f440 2023-11-08T19:23:28.615 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.607+0000 7f1735e76700 1 -- 172.21.15.149:0/3616822766 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f173015f440 msgr2=0x7f173015f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:28.615 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.607+0000 7f1735e76700 1 --2- 172.21.15.149:0/3616822766 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f173015f440 0x7f173015f8f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f17300ce120 tx=0x7f172800b330 comp rx=0 tx=0).stop 2023-11-08T19:23:28.615 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.607+0000 7f1735e76700 1 -- 172.21.15.149:0/3616822766 shutdown_connections 2023-11-08T19:23:28.615 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.607+0000 7f1735e76700 1 --2- 172.21.15.149:0/3616822766 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f173015f440 0x7f173015f8f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:28.615 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.607+0000 7f1735e76700 1 --2- 172.21.15.149:0/3616822766 >> v2:172.21.15.160:3300/0 conn(0x7f173015b950 0x7f17300cc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:28.616 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.607+0000 7f1735e76700 1 --2- 172.21.15.149:0/3616822766 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f17300d0fe0 0x7f17300cc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:28.616 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.607+0000 7f1735e76700 1 -- 172.21.15.149:0/3616822766 >> 172.21.15.149:0/3616822766 conn(0x7f1730099a40 msgr2=0x7f17300d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:28.616 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.607+0000 7f1735e76700 1 -- 172.21.15.149:0/3616822766 shutdown_connections 2023-11-08T19:23:28.616 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.607+0000 7f1735e76700 1 -- 172.21.15.149:0/3616822766 wait complete. 2023-11-08T19:23:28.619 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.608+0000 7f1735e76700 1 Processor -- start 2023-11-08T19:23:28.619 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.608+0000 7f1735e76700 1 -- start start 2023-11-08T19:23:28.620 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.609+0000 7f1735e76700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f17300d0fe0 0x7f1730152b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:28.620 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.609+0000 7f1735e76700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f173015b950 0x7f173015bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:28.620 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.609+0000 7f1735e76700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f173015f440 0x7f17300c6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:28.620 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.609+0000 7f1735e76700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17300c4550 con 0x7f173015b950 2023-11-08T19:23:28.620 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.609+0000 7f1735e76700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17300b4c90 con 0x7f173015f440 2023-11-08T19:23:28.621 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.609+0000 7f1735e76700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17300b4f70 con 0x7f17300d0fe0 2023-11-08T19:23:28.621 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.609+0000 7f172effd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f173015b950 0x7f173015bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:28.621 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.609+0000 7f172f7fe700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f17300d0fe0 0x7f1730152b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:28.621 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.609+0000 7f172effd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f173015b950 0x7f173015bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37772/0 (socket says 172.21.15.149:37772) 2023-11-08T19:23:28.621 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.609+0000 7f172effd700 1 -- 172.21.15.149:0/245033743 learned_addr learned my addr 172.21.15.149:0/245033743 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:28.622 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.609+0000 7f172ffff700 1 --2- 172.21.15.149:0/245033743 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f173015f440 0x7f17300c6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:28.622 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.610+0000 7f172effd700 1 -- 172.21.15.149:0/245033743 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f17300d0fe0 msgr2=0x7f1730152b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:28.622 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.610+0000 7f172effd700 1 --2- 172.21.15.149:0/245033743 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f17300d0fe0 0x7f1730152b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:28.622 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.610+0000 7f172effd700 1 -- 172.21.15.149:0/245033743 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f173015f440 msgr2=0x7f17300c6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:28.622 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.610+0000 7f172effd700 1 --2- 172.21.15.149:0/245033743 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f173015f440 0x7f17300c6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:28.623 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.610+0000 7f172effd700 1 -- 172.21.15.149:0/245033743 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1728009b30 con 0x7f173015b950 2023-11-08T19:23:28.623 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.610+0000 7f172f7fe700 1 --2- 172.21.15.149:0/245033743 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f17300d0fe0 0x7f1730152b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:23:28.623 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.610+0000 7f172effd700 1 --2- 172.21.15.149:0/245033743 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f173015b950 0x7f173015bec0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f172400e900 tx=0x7f172400ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:28.623 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.610+0000 7f1717fff700 1 -- 172.21.15.149:0/245033743 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1724013680 con 0x7f173015b950 2023-11-08T19:23:28.624 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.610+0000 7f1717fff700 1 -- 172.21.15.149:0/245033743 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17240137e0 con 0x7f173015b950 2023-11-08T19:23:28.624 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.610+0000 7f1717fff700 1 -- 172.21.15.149:0/245033743 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1724013b70 con 0x7f173015b950 2023-11-08T19:23:28.624 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.610+0000 7f1735e76700 1 -- 172.21.15.149:0/245033743 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17300b5250 con 0x7f173015b950 2023-11-08T19:23:28.624 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.610+0000 7f1735e76700 1 -- 172.21.15.149:0/245033743 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17300b4840 con 0x7f173015b950 2023-11-08T19:23:28.624 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.611+0000 7f1735e76700 1 -- 172.21.15.149:0/245033743 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17300c4690 con 0x7f173015b950 2023-11-08T19:23:28.625 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.612+0000 7f1717fff700 1 -- 172.21.15.149:0/245033743 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1724013cd0 con 0x7f173015b950 2023-11-08T19:23:28.625 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.612+0000 7f1717fff700 1 --2- 172.21.15.149:0/245033743 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f171c06af00 0x7f171c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:28.625 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.612+0000 7f1717fff700 1 -- 172.21.15.149:0/245033743 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f17240898a0 con 0x7f173015b950 2023-11-08T19:23:28.625 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.612+0000 7f172f7fe700 1 --2- 172.21.15.149:0/245033743 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f171c06af00 0x7f171c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:28.625 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.613+0000 7f172f7fe700 1 --2- 172.21.15.149:0/245033743 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f171c06af00 0x7f171c06d3c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1720009fb0 tx=0x7f17200091c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:28.626 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.617+0000 7f1717fff700 1 -- 172.21.15.149:0/245033743 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f17300c4690 con 0x7f173015b950 2023-11-08T19:23:28.852 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.849+0000 7f1735e76700 1 -- 172.21.15.149:0/245033743 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f17300c4690 con 0x7f173015b950 2023-11-08T19:23:28.852 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.850+0000 7f1717fff700 1 -- 172.21.15.149:0/245033743 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4921 (secure 0 0 0) 0x7f17300c4690 con 0x7f173015b950 2023-11-08T19:23:28.853 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:23:28.853 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4252,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/2277605177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":2277605177},{"type":"v1","addr":"172.21.15.149:6837","nonce":2277605177}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/2774257644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2774257644},{"type":"v1","addr":"172.21.15.149:6836","nonce":2774257644}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/2076428669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":2076428669},{"type":"v1","addr":"172.21.15.160:6835","nonce":2076428669}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-08T19:23:01.918138+0000","modified":"2023-11-08T19:23:19.490960+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.160:6834/3847116435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3847116435},{"type":"v1","addr":"172.21.15.160:6834","nonce":3847116435}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-08T19:23:28.855 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.852+0000 7f1735e76700 1 -- 172.21.15.149:0/245033743 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f171c06af00 msgr2=0x7f171c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:28.855 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.852+0000 7f1735e76700 1 --2- 172.21.15.149:0/245033743 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f171c06af00 0x7f171c06d3c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1720009fb0 tx=0x7f17200091c0 comp rx=0 tx=0).stop 2023-11-08T19:23:28.855 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.853+0000 7f1735e76700 1 -- 172.21.15.149:0/245033743 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f173015b950 msgr2=0x7f173015bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:28.855 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.853+0000 7f1735e76700 1 --2- 172.21.15.149:0/245033743 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f173015b950 0x7f173015bec0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f172400e900 tx=0x7f172400ec10 comp rx=0 tx=0).stop 2023-11-08T19:23:28.856 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.853+0000 7f1735e76700 1 -- 172.21.15.149:0/245033743 shutdown_connections 2023-11-08T19:23:28.856 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.853+0000 7f1735e76700 1 --2- 172.21.15.149:0/245033743 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f171c06af00 0x7f171c06d3c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:28.856 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.853+0000 7f1735e76700 1 --2- 172.21.15.149:0/245033743 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f173015f440 0x7f17300c6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:28.856 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.853+0000 7f1735e76700 1 --2- 172.21.15.149:0/245033743 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f17300d0fe0 0x7f1730152b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:28.856 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.853+0000 7f1735e76700 1 --2- 172.21.15.149:0/245033743 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f173015b950 0x7f173015bec0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:28.857 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.853+0000 7f1735e76700 1 -- 172.21.15.149:0/245033743 >> 172.21.15.149:0/245033743 conn(0x7f1730099a40 msgr2=0x7f173006aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:28.857 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.853+0000 7f1735e76700 1 -- 172.21.15.149:0/245033743 shutdown_connections 2023-11-08T19:23:28.857 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.853+0000 7f1735e76700 1 -- 172.21.15.149:0/245033743 wait complete. 2023-11-08T19:23:28.857 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 9 2023-11-08T19:23:28.867 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:23:28.988 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.986+0000 7f23b1d41700 1 Processor -- start 2023-11-08T19:23:28.989 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.986+0000 7f23b1d41700 1 -- start start 2023-11-08T19:23:28.991 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.987+0000 7f23b1d41700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f23ac0cc140 0x7f23ac0cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:28.991 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.987+0000 7f23b1d41700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f23ac0b2cd0 0x7f23ac15d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:28.991 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.987+0000 7f23b1d41700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23ac0cce50 con 0x7f23ac0b2850 2023-11-08T19:23:28.992 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.987+0000 7f23b1d41700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23ac0b2430 con 0x7f23ac0b2cd0 2023-11-08T19:23:28.992 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.987+0000 7f23b1d41700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23ac0cc520 con 0x7f23ac0cc140 2023-11-08T19:23:28.992 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.987+0000 7f23abfff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f23ac0b2cd0 0x7f23ac15d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:28.993 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.987+0000 7f23abfff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f23ac0b2cd0 0x7f23ac15d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37780/0 (socket says 172.21.15.149:37780) 2023-11-08T19:23:28.993 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.987+0000 7f23abfff700 1 -- 172.21.15.149:0/2698479208 learned_addr learned my addr 172.21.15.149:0/2698479208 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:28.993 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.988+0000 7f23ab7fe700 1 --2- 172.21.15.149:0/2698479208 >> v2:172.21.15.160:3300/0 conn(0x7f23ac0cc140 0x7f23ac0cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:28.993 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.988+0000 7f23abfff700 1 -- 172.21.15.149:0/2698479208 >> v2:172.21.15.160:3300/0 conn(0x7f23ac0cc140 msgr2=0x7f23ac0cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:28.993 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.988+0000 7f23abfff700 1 --2- 172.21.15.149:0/2698479208 >> v2:172.21.15.160:3300/0 conn(0x7f23ac0cc140 0x7f23ac0cc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:28.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.988+0000 7f23abfff700 1 -- 172.21.15.149:0/2698479208 >> v1:172.21.15.160:6789/0 conn(0x7f23ac0b2850 legacy=0x7f23ac0cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:28.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.988+0000 7f23abfff700 1 -- 172.21.15.149:0/2698479208 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23ac0b17b0 con 0x7f23ac0b2cd0 2023-11-08T19:23:28.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.988+0000 7f23abfff700 1 --2- 172.21.15.149:0/2698479208 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23ac0b2cd0 0x7f23ac15d2b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f23ac0ce120 tx=0x7f23a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecdf45cbb945146e server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:28.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.988+0000 7f23aa7fc700 1 -- 172.21.15.149:0/2698479208 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a400e070 con 0x7f23ac0b2cd0 2023-11-08T19:23:28.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.988+0000 7f23aa7fc700 1 -- 172.21.15.149:0/2698479208 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23a4003a20 con 0x7f23ac0b2cd0 2023-11-08T19:23:28.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.988+0000 7f23aa7fc700 1 -- 172.21.15.149:0/2698479208 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a4003dd0 con 0x7f23ac0b2cd0 2023-11-08T19:23:28.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.989+0000 7f23b1d41700 1 -- 172.21.15.149:0/2698479208 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23ac0b2cd0 msgr2=0x7f23ac15d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:28.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.989+0000 7f23b1d41700 1 --2- 172.21.15.149:0/2698479208 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23ac0b2cd0 0x7f23ac15d2b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f23ac0ce120 tx=0x7f23a400b330 comp rx=0 tx=0).stop 2023-11-08T19:23:28.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.989+0000 7f23b1d41700 1 -- 172.21.15.149:0/2698479208 shutdown_connections 2023-11-08T19:23:28.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.989+0000 7f23b1d41700 1 --2- 172.21.15.149:0/2698479208 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23ac0b2cd0 0x7f23ac15d2b0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:28.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.989+0000 7f23b1d41700 1 --2- 172.21.15.149:0/2698479208 >> v2:172.21.15.160:3300/0 conn(0x7f23ac0cc140 0x7f23ac0cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:28.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.989+0000 7f23b1d41700 1 -- 172.21.15.149:0/2698479208 >> 172.21.15.149:0/2698479208 conn(0x7f23ac099a40 msgr2=0x7f23ac0d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:28.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.989+0000 7f23b1d41700 1 -- 172.21.15.149:0/2698479208 shutdown_connections 2023-11-08T19:23:28.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.989+0000 7f23b1d41700 1 -- 172.21.15.149:0/2698479208 wait complete. 2023-11-08T19:23:28.999 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.990+0000 7f23b1d41700 1 Processor -- start 2023-11-08T19:23:29.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.990+0000 7f23b1d41700 1 -- start start 2023-11-08T19:23:29.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.991+0000 7f23b1d41700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f23ac0b2850 0x7f23ac0afe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:29.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.991+0000 7f23b1d41700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f23ac0b2cd0 0x7f23ac1f6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:29.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.991+0000 7f23b1d41700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23ac0cc140 0x7f23ac1f6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:29.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.991+0000 7f23b1d41700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23ac0b03a0 con 0x7f23ac0cc140 2023-11-08T19:23:29.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.991+0000 7f23b1d41700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23ac0b5070 con 0x7f23ac0b2850 2023-11-08T19:23:29.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.991+0000 7f23b1d41700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23ac0b5350 con 0x7f23ac0b2cd0 2023-11-08T19:23:29.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.991+0000 7f23abfff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23ac0cc140 0x7f23ac1f6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:29.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.991+0000 7f23abfff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23ac0cc140 0x7f23ac1f6b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37786/0 (socket says 172.21.15.149:37786) 2023-11-08T19:23:29.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.991+0000 7f23abfff700 1 -- 172.21.15.149:0/805342449 learned_addr learned my addr 172.21.15.149:0/805342449 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:29.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.991+0000 7f23aaffd700 1 --2- 172.21.15.149:0/805342449 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f23ac0b2cd0 0x7f23ac1f6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:29.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.991+0000 7f23abfff700 1 -- 172.21.15.149:0/805342449 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f23ac0b2cd0 msgr2=0x7f23ac1f6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:29.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.991+0000 7f23abfff700 1 --2- 172.21.15.149:0/805342449 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f23ac0b2cd0 0x7f23ac1f6620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:29.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.991+0000 7f23abfff700 1 -- 172.21.15.149:0/805342449 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f23ac0b2850 msgr2=0x7f23ac0afe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:29.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.991+0000 7f23abfff700 1 --2- 172.21.15.149:0/805342449 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f23ac0b2850 0x7f23ac0afe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:29.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.991+0000 7f23abfff700 1 -- 172.21.15.149:0/805342449 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a4009b30 con 0x7f23ac0cc140 2023-11-08T19:23:29.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.991+0000 7f23abfff700 1 --2- 172.21.15.149:0/805342449 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23ac0cc140 0x7f23ac1f6b60 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f23a400b370 tx=0x7f23a4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:29.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.991+0000 7f2393fff700 1 -- 172.21.15.149:0/805342449 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a4004240 con 0x7f23ac0cc140 2023-11-08T19:23:29.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.991+0000 7f2393fff700 1 -- 172.21.15.149:0/805342449 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23a40043a0 con 0x7f23ac0cc140 2023-11-08T19:23:29.004 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.991+0000 7f23b1d41700 1 -- 172.21.15.149:0/805342449 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23ac0b5630 con 0x7f23ac0cc140 2023-11-08T19:23:29.004 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.991+0000 7f2393fff700 1 -- 172.21.15.149:0/805342449 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a4004750 con 0x7f23ac0cc140 2023-11-08T19:23:29.004 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.991+0000 7f23b1d41700 1 -- 172.21.15.149:0/805342449 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23ac0b5bf0 con 0x7f23ac0cc140 2023-11-08T19:23:29.004 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.992+0000 7f23b1d41700 1 -- 172.21.15.149:0/805342449 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23ac0c7e40 con 0x7f23ac0cc140 2023-11-08T19:23:29.004 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.993+0000 7f2393fff700 1 -- 172.21.15.149:0/805342449 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f23a4019070 con 0x7f23ac0cc140 2023-11-08T19:23:29.005 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.993+0000 7f2393fff700 1 --2- 172.21.15.149:0/805342449 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f239806af00 0x7f239806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:29.005 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.993+0000 7f2393fff700 1 -- 172.21.15.149:0/805342449 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f23a408a730 con 0x7f23ac0cc140 2023-11-08T19:23:29.005 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.993+0000 7f23ab7fe700 1 --2- 172.21.15.149:0/805342449 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f239806af00 0x7f239806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:29.005 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.994+0000 7f23ab7fe700 1 --2- 172.21.15.149:0/805342449 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f239806af00 0x7f239806d3c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f23a0006eb0 tx=0x7f23a0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:29.006 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:28.998+0000 7f2393fff700 1 -- 172.21.15.149:0/805342449 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f23a4055580 con 0x7f23ac0cc140 2023-11-08T19:23:29.196 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.194+0000 7f23b1d41700 1 -- 172.21.15.149:0/805342449 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f23ac0745f0 con 0x7f23ac0cc140 2023-11-08T19:23:29.197 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.195+0000 7f2393fff700 1 -- 172.21.15.149:0/805342449 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18382 (secure 0 0 0) 0x7f23a4058ba0 con 0x7f23ac0cc140 2023-11-08T19:23:29.198 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:23:29.198 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":24,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:23:06.964482+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-08T19:22:59.830928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-08T19:23:00.886589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-08T19:23:04.574033+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:23:29.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.197+0000 7f23b1d41700 1 -- 172.21.15.149:0/805342449 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f239806af00 msgr2=0x7f239806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:29.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.198+0000 7f23b1d41700 1 --2- 172.21.15.149:0/805342449 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f239806af00 0x7f239806d3c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f23a0006eb0 tx=0x7f23a0008040 comp rx=0 tx=0).stop 2023-11-08T19:23:29.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.198+0000 7f23b1d41700 1 -- 172.21.15.149:0/805342449 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23ac0cc140 msgr2=0x7f23ac1f6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:29.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.198+0000 7f23b1d41700 1 --2- 172.21.15.149:0/805342449 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23ac0cc140 0x7f23ac1f6b60 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f23a400b370 tx=0x7f23a4004ad0 comp rx=0 tx=0).stop 2023-11-08T19:23:29.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.198+0000 7f23b1d41700 1 -- 172.21.15.149:0/805342449 shutdown_connections 2023-11-08T19:23:29.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.198+0000 7f23b1d41700 1 --2- 172.21.15.149:0/805342449 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f239806af00 0x7f239806d3c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:29.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.198+0000 7f23b1d41700 1 --2- 172.21.15.149:0/805342449 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f23ac0b2850 0x7f23ac0afe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:29.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.198+0000 7f23b1d41700 1 --2- 172.21.15.149:0/805342449 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23ac0cc140 0x7f23ac1f6b60 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:29.202 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.198+0000 7f23b1d41700 1 --2- 172.21.15.149:0/805342449 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f23ac0b2cd0 0x7f23ac1f6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:29.202 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.198+0000 7f23b1d41700 1 -- 172.21.15.149:0/805342449 >> 172.21.15.149:0/805342449 conn(0x7f23ac099a40 msgr2=0x7f23ac06f940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:29.202 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.198+0000 7f23b1d41700 1 -- 172.21.15.149:0/805342449 shutdown_connections 2023-11-08T19:23:29.202 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.198+0000 7f23b1d41700 1 -- 172.21.15.149:0/805342449 wait complete. 2023-11-08T19:23:29.212 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-08T19:22:56.023194+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-08T19:22:59.830928+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-08T19:23:00.886589+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-08T19:23:04.574033+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-08T19:23:29.213 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-08T19:23:29.337 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.335+0000 7f59c29a5700 1 Processor -- start 2023-11-08T19:23:29.338 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.335+0000 7f59c29a5700 1 -- start start 2023-11-08T19:23:29.345 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.336+0000 7f59c29a5700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f59bc0cc0d0 0x7f59bc15f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:29.345 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.336+0000 7f59c29a5700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f59bc0cc4b0 0x7f59bc15c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:29.345 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.336+0000 7f59c29a5700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59bc15be80 con 0x7f59bc15cb60 2023-11-08T19:23:29.346 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.336+0000 7f59c29a5700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59bc15f9b0 con 0x7f59bc0cc4b0 2023-11-08T19:23:29.346 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.336+0000 7f59c29a5700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59bc15fba0 con 0x7f59bc0cc0d0 2023-11-08T19:23:29.346 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.336+0000 7f59bb7fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f59bc0cc4b0 0x7f59bc15c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:29.346 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.336+0000 7f59bb7fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f59bc0cc4b0 0x7f59bc15c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37792/0 (socket says 172.21.15.149:37792) 2023-11-08T19:23:29.346 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.336+0000 7f59bb7fe700 1 -- 172.21.15.149:0/1611809887 learned_addr learned my addr 172.21.15.149:0/1611809887 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:29.347 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.336+0000 7f59bbfff700 1 --2- 172.21.15.149:0/1611809887 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f59bc0cc0d0 0x7f59bc15f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:29.347 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.336+0000 7f59bb7fe700 1 -- 172.21.15.149:0/1611809887 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f59bc0cc0d0 msgr2=0x7f59bc15f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:29.347 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.336+0000 7f59bb7fe700 1 --2- 172.21.15.149:0/1611809887 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f59bc0cc0d0 0x7f59bc15f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:29.347 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.336+0000 7f59bb7fe700 1 -- 172.21.15.149:0/1611809887 >> v1:172.21.15.160:6789/0 conn(0x7f59bc15cb60 legacy=0x7f59bc0cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:29.348 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.336+0000 7f59bb7fe700 1 -- 172.21.15.149:0/1611809887 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59bc15fe80 con 0x7f59bc0cc4b0 2023-11-08T19:23:29.348 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.337+0000 7f59bb7fe700 1 --2- 172.21.15.149:0/1611809887 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59bc0cc4b0 0x7f59bc15c620 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f59ac0098f0 tx=0x7f59ac009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dbb1532d3efa714 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:29.348 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.337+0000 7f59baffd700 1 -- 172.21.15.149:0/1611809887 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ac00b8a0 con 0x7f59bc0cc4b0 2023-11-08T19:23:29.348 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.337+0000 7f59baffd700 1 -- 172.21.15.149:0/1611809887 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59ac00ba00 con 0x7f59bc0cc4b0 2023-11-08T19:23:29.348 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.337+0000 7f59baffd700 1 -- 172.21.15.149:0/1611809887 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ac00bd90 con 0x7f59bc0cc4b0 2023-11-08T19:23:29.349 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.337+0000 7f59c29a5700 1 -- 172.21.15.149:0/1611809887 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59bc0cc4b0 msgr2=0x7f59bc15c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:29.349 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.337+0000 7f59c29a5700 1 --2- 172.21.15.149:0/1611809887 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59bc0cc4b0 0x7f59bc15c620 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f59ac0098f0 tx=0x7f59ac009c00 comp rx=0 tx=0).stop 2023-11-08T19:23:29.349 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.337+0000 7f59c29a5700 1 -- 172.21.15.149:0/1611809887 shutdown_connections 2023-11-08T19:23:29.349 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.337+0000 7f59c29a5700 1 --2- 172.21.15.149:0/1611809887 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f59bc0cc0d0 0x7f59bc15f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:29.350 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.337+0000 7f59c29a5700 1 --2- 172.21.15.149:0/1611809887 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59bc0cc4b0 0x7f59bc15c620 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:29.350 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.337+0000 7f59c29a5700 1 -- 172.21.15.149:0/1611809887 >> 172.21.15.149:0/1611809887 conn(0x7f59bc06f120 msgr2=0x7f59bc06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:29.350 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.337+0000 7f59c29a5700 1 -- 172.21.15.149:0/1611809887 shutdown_connections 2023-11-08T19:23:29.350 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.337+0000 7f59c29a5700 1 -- 172.21.15.149:0/1611809887 wait complete. 2023-11-08T19:23:29.350 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.338+0000 7f59c29a5700 1 Processor -- start 2023-11-08T19:23:29.351 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.339+0000 7f59c29a5700 1 -- start start 2023-11-08T19:23:29.351 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.339+0000 7f59c29a5700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59bc0cc0d0 0x7f59bc1f52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:29.351 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.339+0000 7f59c29a5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59bc0cc4b0 0x7f59bc14a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:29.351 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.339+0000 7f59c29a5700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f59bc15cb60 0x7f59bc147260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:29.351 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.339+0000 7f59c29a5700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59bc1f4810 con 0x7f59bc0cc4b0 2023-11-08T19:23:29.352 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.339+0000 7f59c29a5700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59bc0b1200 con 0x7f59bc0cc0d0 2023-11-08T19:23:29.352 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.339+0000 7f59c29a5700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59bc1f4ab0 con 0x7f59bc15cb60 2023-11-08T19:23:29.352 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.340+0000 7f59bb7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59bc0cc4b0 0x7f59bc14a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:29.352 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.340+0000 7f59bb7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59bc0cc4b0 0x7f59bc14a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37800/0 (socket says 172.21.15.149:37800) 2023-11-08T19:23:29.352 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.340+0000 7f59bb7fe700 1 -- 172.21.15.149:0/3687141667 learned_addr learned my addr 172.21.15.149:0/3687141667 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:29.353 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.340+0000 7f59bbfff700 1 --2- 172.21.15.149:0/3687141667 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59bc0cc0d0 0x7f59bc1f52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:29.353 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.340+0000 7f59c0f42700 1 --2- 172.21.15.149:0/3687141667 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f59bc15cb60 0x7f59bc147260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:29.353 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.340+0000 7f59bb7fe700 1 -- 172.21.15.149:0/3687141667 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f59bc15cb60 msgr2=0x7f59bc147260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:29.353 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.340+0000 7f59bb7fe700 1 --2- 172.21.15.149:0/3687141667 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f59bc15cb60 0x7f59bc147260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:29.353 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.340+0000 7f59bb7fe700 1 -- 172.21.15.149:0/3687141667 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59bc0cc0d0 msgr2=0x7f59bc1f52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:29.354 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.340+0000 7f59bb7fe700 1 --2- 172.21.15.149:0/3687141667 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59bc0cc0d0 0x7f59bc1f52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:29.354 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.340+0000 7f59bb7fe700 1 -- 172.21.15.149:0/3687141667 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59ac009550 con 0x7f59bc0cc4b0 2023-11-08T19:23:29.354 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.340+0000 7f59bb7fe700 1 --2- 172.21.15.149:0/3687141667 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59bc0cc4b0 0x7f59bc14a6c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f59ac000c00 tx=0x7f59ac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:29.354 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.340+0000 7f59b8ff9700 1 -- 172.21.15.149:0/3687141667 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ac004300 con 0x7f59bc0cc4b0 2023-11-08T19:23:29.354 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.340+0000 7f59b8ff9700 1 -- 172.21.15.149:0/3687141667 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59ac01f070 con 0x7f59bc0cc4b0 2023-11-08T19:23:29.355 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.340+0000 7f59c29a5700 1 -- 172.21.15.149:0/3687141667 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59bc1f4d90 con 0x7f59bc0cc4b0 2023-11-08T19:23:29.355 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.340+0000 7f59b8ff9700 1 -- 172.21.15.149:0/3687141667 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ac0036a0 con 0x7f59bc0cc4b0 2023-11-08T19:23:29.355 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.341+0000 7f59c29a5700 1 -- 172.21.15.149:0/3687141667 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59bc14df00 con 0x7f59bc0cc4b0 2023-11-08T19:23:29.355 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.342+0000 7f59c29a5700 1 -- 172.21.15.149:0/3687141667 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59bc1f4f80 con 0x7f59bc0cc4b0 2023-11-08T19:23:29.355 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.342+0000 7f59b8ff9700 1 -- 172.21.15.149:0/3687141667 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f59ac021030 con 0x7f59bc0cc4b0 2023-11-08T19:23:29.355 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.342+0000 7f59b8ff9700 1 --2- 172.21.15.149:0/3687141667 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f59a806af00 0x7f59a806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:29.356 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.342+0000 7f59b8ff9700 1 -- 172.21.15.149:0/3687141667 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f59ac08ab50 con 0x7f59bc0cc4b0 2023-11-08T19:23:29.356 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.342+0000 7f59bbfff700 1 --2- 172.21.15.149:0/3687141667 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f59a806af00 0x7f59a806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:29.356 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.342+0000 7f59bbfff700 1 --2- 172.21.15.149:0/3687141667 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f59a806af00 0x7f59a806d3c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f59b00099d0 tx=0x7f59b0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:29.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.347+0000 7f59b8ff9700 1 -- 172.21.15.149:0/3687141667 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f59ac055a40 con 0x7f59bc0cc4b0 2023-11-08T19:23:29.536 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.534+0000 7f59c29a5700 1 -- 172.21.15.149:0/3687141667 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f59bc04f730 con 0x7f59bc0cc4b0 2023-11-08T19:23:29.537 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.534+0000 7f59b8ff9700 1 -- 172.21.15.149:0/3687141667 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f59ac015020 con 0x7f59bc0cc4b0 2023-11-08T19:23:29.537 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 1 2023-11-08T19:23:29.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.536+0000 7f59c29a5700 1 -- 172.21.15.149:0/3687141667 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f59a806af00 msgr2=0x7f59a806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:29.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.536+0000 7f59c29a5700 1 --2- 172.21.15.149:0/3687141667 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f59a806af00 0x7f59a806d3c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f59b00099d0 tx=0x7f59b0008040 comp rx=0 tx=0).stop 2023-11-08T19:23:29.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.536+0000 7f59c29a5700 1 -- 172.21.15.149:0/3687141667 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59bc0cc4b0 msgr2=0x7f59bc14a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:29.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.536+0000 7f59c29a5700 1 --2- 172.21.15.149:0/3687141667 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59bc0cc4b0 0x7f59bc14a6c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f59ac000c00 tx=0x7f59ac004750 comp rx=0 tx=0).stop 2023-11-08T19:23:29.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.536+0000 7f59c29a5700 1 -- 172.21.15.149:0/3687141667 shutdown_connections 2023-11-08T19:23:29.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.536+0000 7f59c29a5700 1 --2- 172.21.15.149:0/3687141667 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f59a806af00 0x7f59a806d3c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:29.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.536+0000 7f59c29a5700 1 --2- 172.21.15.149:0/3687141667 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59bc0cc0d0 0x7f59bc1f52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:29.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.536+0000 7f59c29a5700 1 --2- 172.21.15.149:0/3687141667 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f59bc15cb60 0x7f59bc147260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:29.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.536+0000 7f59c29a5700 1 --2- 172.21.15.149:0/3687141667 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59bc0cc4b0 0x7f59bc14a6c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:29.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.537+0000 7f59c29a5700 1 -- 172.21.15.149:0/3687141667 >> 172.21.15.149:0/3687141667 conn(0x7f59bc06f120 msgr2=0x7f59bc15b6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:29.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.537+0000 7f59c29a5700 1 -- 172.21.15.149:0/3687141667 shutdown_connections 2023-11-08T19:23:29.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.537+0000 7f59c29a5700 1 -- 172.21.15.149:0/3687141667 wait complete. 2023-11-08T19:23:29.551 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-08T19:23:29.675 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.673+0000 7feeb8efc700 1 Processor -- start 2023-11-08T19:23:29.676 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.673+0000 7feeb8efc700 1 -- start start 2023-11-08T19:23:29.678 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.674+0000 7feeb8efc700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7feeb40c7250 0x7feeb406b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:29.678 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.674+0000 7feeb8efc700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7feeb40cb610 0x7feeb40b4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:29.679 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.674+0000 7feeb8efc700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeb40b3710 con 0x7feeb40722a0 2023-11-08T19:23:29.679 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.674+0000 7feeb8efc700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeb406cc00 con 0x7feeb40cb610 2023-11-08T19:23:29.679 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.674+0000 7feeb8efc700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeb406c640 con 0x7feeb40c7250 2023-11-08T19:23:29.679 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.674+0000 7feeb2d9d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7feeb40cb610 0x7feeb40b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:29.679 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.674+0000 7feeb2d9d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7feeb40cb610 0x7feeb40b4140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37808/0 (socket says 172.21.15.149:37808) 2023-11-08T19:23:29.680 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.674+0000 7feeb2d9d700 1 -- 172.21.15.149:0/1463327760 learned_addr learned my addr 172.21.15.149:0/1463327760 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:29.680 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.675+0000 7feeb1d9b700 1 --2- 172.21.15.149:0/1463327760 >> v2:172.21.15.160:3300/0 conn(0x7feeb40c7250 0x7feeb406b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:29.680 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.675+0000 7feeb2d9d700 1 -- 172.21.15.149:0/1463327760 >> v2:172.21.15.160:3300/0 conn(0x7feeb40c7250 msgr2=0x7feeb406b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:29.680 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.675+0000 7feeb2d9d700 1 --2- 172.21.15.149:0/1463327760 >> v2:172.21.15.160:3300/0 conn(0x7feeb40c7250 0x7feeb406b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:29.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.675+0000 7feeb2d9d700 1 -- 172.21.15.149:0/1463327760 >> v1:172.21.15.160:6789/0 conn(0x7feeb40722a0 legacy=0x7feeb406ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:29.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.675+0000 7feeb2d9d700 1 -- 172.21.15.149:0/1463327760 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb406c920 con 0x7feeb40cb610 2023-11-08T19:23:29.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.675+0000 7feeb1d9b700 1 --2- 172.21.15.149:0/1463327760 >> v2:172.21.15.160:3300/0 conn(0x7feeb40c7250 0x7feeb406b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:23:29.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.675+0000 7feeb2d9d700 1 --2- 172.21.15.149:0/1463327760 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feeb40cb610 0x7feeb40b4140 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7feeb4067970 tx=0x7feeac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29d56118c85e48ca server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:29.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.675+0000 7feeb159a700 1 -- 172.21.15.149:0/1463327760 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeac00e070 con 0x7feeb40cb610 2023-11-08T19:23:29.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.675+0000 7feeb159a700 1 -- 172.21.15.149:0/1463327760 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeac003a20 con 0x7feeb40cb610 2023-11-08T19:23:29.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.675+0000 7feeb159a700 1 -- 172.21.15.149:0/1463327760 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeac003dd0 con 0x7feeb40cb610 2023-11-08T19:23:29.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.675+0000 7feeb8efc700 1 -- 172.21.15.149:0/1463327760 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feeb40cb610 msgr2=0x7feeb40b4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:29.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.675+0000 7feeb8efc700 1 --2- 172.21.15.149:0/1463327760 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feeb40cb610 0x7feeb40b4140 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7feeb4067970 tx=0x7feeac00b330 comp rx=0 tx=0).stop 2023-11-08T19:23:29.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.676+0000 7feeb8efc700 1 -- 172.21.15.149:0/1463327760 shutdown_connections 2023-11-08T19:23:29.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.676+0000 7feeb8efc700 1 --2- 172.21.15.149:0/1463327760 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feeb40cb610 0x7feeb40b4140 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:29.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.676+0000 7feeb8efc700 1 --2- 172.21.15.149:0/1463327760 >> v2:172.21.15.160:3300/0 conn(0x7feeb40c7250 0x7feeb406b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:29.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.676+0000 7feeb8efc700 1 -- 172.21.15.149:0/1463327760 >> 172.21.15.149:0/1463327760 conn(0x7feeb40d0640 msgr2=0x7feeb40d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:29.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.676+0000 7feeb8efc700 1 -- 172.21.15.149:0/1463327760 shutdown_connections 2023-11-08T19:23:29.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.676+0000 7feeb8efc700 1 -- 172.21.15.149:0/1463327760 wait complete. 2023-11-08T19:23:29.686 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.677+0000 7feeb8efc700 1 Processor -- start 2023-11-08T19:23:29.687 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.677+0000 7feeb8efc700 1 -- start start 2023-11-08T19:23:29.687 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.678+0000 7feeb8efc700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feeb40722a0 0x7feeb41f1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:29.687 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.678+0000 7feeb8efc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feeb40c7250 0x7feeb40aedc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:29.687 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.678+0000 7feeb8efc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feeb40cb610 0x7feeb4159e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:29.687 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.678+0000 7feeb8efc700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb40c7840 con 0x7feeb40c7250 2023-11-08T19:23:29.688 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.678+0000 7feeb8efc700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb41f1960 con 0x7feeb40cb610 2023-11-08T19:23:29.688 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.678+0000 7feeb8efc700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb41f1c40 con 0x7feeb40722a0 2023-11-08T19:23:29.688 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.678+0000 7feeb1d9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feeb40c7250 0x7feeb40aedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:29.688 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.678+0000 7feeb1d9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feeb40c7250 0x7feeb40aedc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37812/0 (socket says 172.21.15.149:37812) 2023-11-08T19:23:29.688 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.678+0000 7feeb1d9b700 1 -- 172.21.15.149:0/33679071 learned_addr learned my addr 172.21.15.149:0/33679071 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:29.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.678+0000 7feeb259c700 1 --2- 172.21.15.149:0/33679071 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feeb40722a0 0x7feeb41f1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:29.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.678+0000 7feeb2d9d700 1 --2- 172.21.15.149:0/33679071 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feeb40cb610 0x7feeb4159e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:29.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.678+0000 7feeb1d9b700 1 -- 172.21.15.149:0/33679071 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feeb40722a0 msgr2=0x7feeb41f1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:29.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.678+0000 7feeb1d9b700 1 --2- 172.21.15.149:0/33679071 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feeb40722a0 0x7feeb41f1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:29.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.678+0000 7feeb1d9b700 1 -- 172.21.15.149:0/33679071 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feeb40cb610 msgr2=0x7feeb4159e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:29.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.678+0000 7feeb1d9b700 1 --2- 172.21.15.149:0/33679071 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feeb40cb610 0x7feeb4159e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:29.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.678+0000 7feeb1d9b700 1 -- 172.21.15.149:0/33679071 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeac009b30 con 0x7feeb40c7250 2023-11-08T19:23:29.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.678+0000 7feeb2d9d700 1 --2- 172.21.15.149:0/33679071 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feeb40cb610 0x7feeb4159e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:23:29.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.678+0000 7feeb1d9b700 1 --2- 172.21.15.149:0/33679071 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feeb40c7250 0x7feeb40aedc0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7feea400c750 tx=0x7feea400ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:29.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.678+0000 7feea2ffd700 1 -- 172.21.15.149:0/33679071 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea4011800 con 0x7feeb40c7250 2023-11-08T19:23:29.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.678+0000 7feea2ffd700 1 -- 172.21.15.149:0/33679071 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea4011960 con 0x7feeb40c7250 2023-11-08T19:23:29.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.678+0000 7feeb8efc700 1 -- 172.21.15.149:0/33679071 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeb41f1f20 con 0x7feeb40c7250 2023-11-08T19:23:29.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.678+0000 7feea2ffd700 1 -- 172.21.15.149:0/33679071 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea4011cd0 con 0x7feeb40c7250 2023-11-08T19:23:29.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.678+0000 7feeb8efc700 1 -- 172.21.15.149:0/33679071 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeb415a340 con 0x7feeb40c7250 2023-11-08T19:23:29.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.679+0000 7feeb8efc700 1 -- 172.21.15.149:0/33679071 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeb404f730 con 0x7feeb40c7250 2023-11-08T19:23:29.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.680+0000 7feea2ffd700 1 -- 172.21.15.149:0/33679071 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7feea4021350 con 0x7feeb40c7250 2023-11-08T19:23:29.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.680+0000 7feea2ffd700 1 --2- 172.21.15.149:0/33679071 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fee9406af00 0x7fee9406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:29.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.680+0000 7feea2ffd700 1 -- 172.21.15.149:0/33679071 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7feea40897b0 con 0x7feeb40c7250 2023-11-08T19:23:29.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.680+0000 7feeb259c700 1 --2- 172.21.15.149:0/33679071 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fee9406af00 0x7fee9406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:29.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.681+0000 7feeb259c700 1 --2- 172.21.15.149:0/33679071 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fee9406af00 0x7fee9406d3c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7feea8007fd0 tx=0x7feea8007ec0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:29.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.685+0000 7feea2ffd700 1 -- 172.21.15.149:0/33679071 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7feea4054570 con 0x7feeb40c7250 2023-11-08T19:23:29.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.873+0000 7feeb8efc700 1 -- 172.21.15.149:0/33679071 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7feeb40d0420 con 0x7feeb40c7250 2023-11-08T19:23:29.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.874+0000 7feea2ffd700 1 -- 172.21.15.149:0/33679071 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7feea4057b90 con 0x7feeb40c7250 2023-11-08T19:23:29.876 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:23:29.878 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.876+0000 7feeb8efc700 1 -- 172.21.15.149:0/33679071 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fee9406af00 msgr2=0x7fee9406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:29.879 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.876+0000 7feeb8efc700 1 --2- 172.21.15.149:0/33679071 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fee9406af00 0x7fee9406d3c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7feea8007fd0 tx=0x7feea8007ec0 comp rx=0 tx=0).stop 2023-11-08T19:23:29.879 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.876+0000 7feeb8efc700 1 -- 172.21.15.149:0/33679071 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feeb40c7250 msgr2=0x7feeb40aedc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:29.879 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.876+0000 7feeb8efc700 1 --2- 172.21.15.149:0/33679071 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feeb40c7250 0x7feeb40aedc0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7feea400c750 tx=0x7feea400ca60 comp rx=0 tx=0).stop 2023-11-08T19:23:29.879 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.876+0000 7feeb8efc700 1 -- 172.21.15.149:0/33679071 shutdown_connections 2023-11-08T19:23:29.879 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.876+0000 7feeb8efc700 1 --2- 172.21.15.149:0/33679071 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fee9406af00 0x7fee9406d3c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:29.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.876+0000 7feeb8efc700 1 --2- 172.21.15.149:0/33679071 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feeb40cb610 0x7feeb4159e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:29.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.876+0000 7feeb8efc700 1 --2- 172.21.15.149:0/33679071 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feeb40722a0 0x7feeb41f1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:29.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.876+0000 7feeb8efc700 1 --2- 172.21.15.149:0/33679071 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feeb40c7250 0x7feeb40aedc0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:29.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.876+0000 7feeb8efc700 1 -- 172.21.15.149:0/33679071 >> 172.21.15.149:0/33679071 conn(0x7feeb40d0640 msgr2=0x7feeb415e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:29.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.876+0000 7feeb8efc700 1 -- 172.21.15.149:0/33679071 shutdown_connections 2023-11-08T19:23:29.881 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:29.876+0000 7feeb8efc700 1 -- 172.21.15.149:0/33679071 wait complete. 2023-11-08T19:23:29.891 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-08T19:23:30.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.012+0000 7f96f50a0700 1 Processor -- start 2023-11-08T19:23:30.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.012+0000 7f96f50a0700 1 -- start start 2023-11-08T19:23:30.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.013+0000 7f96f50a0700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f96f00cc0d0 0x7f96f015f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:30.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.013+0000 7f96f50a0700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96f015be80 con 0x7f96f00cc4b0 2023-11-08T19:23:30.018 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.013+0000 7f96f50a0700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96f015fba0 con 0x7f96f00cc910 2023-11-08T19:23:30.018 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.013+0000 7f96f50a0700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96f015f9b0 con 0x7f96f00cc0d0 2023-11-08T19:23:30.018 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.013+0000 7f96ee59c700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f96f00cc4b0 0x7f96f015c620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:39820/0 (socket says 172.21.15.149:39820) 2023-11-08T19:23:30.018 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.013+0000 7f96ee59c700 1 -- 172.21.15.149:0/694494308 learned_addr learned my addr 172.21.15.149:0/694494308 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:23:30.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.013+0000 7f96eed9d700 1 --2- 172.21.15.149:0/694494308 >> v2:172.21.15.160:3300/0 conn(0x7f96f00cc0d0 0x7f96f015f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:30.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.014+0000 7f96edd9b700 1 -- 172.21.15.149:0/694494308 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3762447314 0 0) 0x7f96f015be80 con 0x7f96f00cc4b0 2023-11-08T19:23:30.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.014+0000 7f96edd9b700 1 -- 172.21.15.149:0/694494308 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96d80035b0 con 0x7f96f00cc4b0 2023-11-08T19:23:30.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.014+0000 7f96eed9d700 1 -- 172.21.15.149:0/694494308 >> v1:172.21.15.160:6789/0 conn(0x7f96f00cc910 legacy=0x7f96f00cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:30.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.014+0000 7f96edd9b700 1 -- 172.21.15.149:0/694494308 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3773377650 0 0) 0x7f96f015fba0 con 0x7f96f00cc910 2023-11-08T19:23:30.020 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.014+0000 7f96eed9d700 1 -- 172.21.15.149:0/694494308 >> v1:172.21.15.149:6789/0 conn(0x7f96f00cc4b0 legacy=0x7f96f015c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:30.020 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.014+0000 7f96eed9d700 1 -- 172.21.15.149:0/694494308 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96f015fe80 con 0x7f96f00cc0d0 2023-11-08T19:23:30.020 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.014+0000 7f96eed9d700 1 --2- 172.21.15.149:0/694494308 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f96f00cc0d0 0x7f96f015f470 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f96e0009840 tx=0x7f96e0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5a72cf96e5a6a53 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:30.020 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.014+0000 7f96edd9b700 1 -- 172.21.15.149:0/694494308 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e0011830 con 0x7f96f00cc0d0 2023-11-08T19:23:30.020 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.014+0000 7f96edd9b700 1 -- 172.21.15.149:0/694494308 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e0011990 con 0x7f96f00cc0d0 2023-11-08T19:23:30.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.014+0000 7f96edd9b700 1 -- 172.21.15.149:0/694494308 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e0011d00 con 0x7f96f00cc0d0 2023-11-08T19:23:30.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.015+0000 7f96f50a0700 1 -- 172.21.15.149:0/694494308 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f96f00cc0d0 msgr2=0x7f96f015f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:30.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.015+0000 7f96f50a0700 1 --2- 172.21.15.149:0/694494308 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f96f00cc0d0 0x7f96f015f470 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f96e0009840 tx=0x7f96e0009b50 comp rx=0 tx=0).stop 2023-11-08T19:23:30.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.015+0000 7f96f50a0700 1 -- 172.21.15.149:0/694494308 shutdown_connections 2023-11-08T19:23:30.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.015+0000 7f96f50a0700 1 --2- 172.21.15.149:0/694494308 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f96f00cc0d0 0x7f96f015f470 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:30.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.015+0000 7f96f50a0700 1 -- 172.21.15.149:0/694494308 >> 172.21.15.149:0/694494308 conn(0x7f96f006f120 msgr2=0x7f96f006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:30.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.015+0000 7f96f50a0700 1 -- 172.21.15.149:0/694494308 shutdown_connections 2023-11-08T19:23:30.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.015+0000 7f96f50a0700 1 -- 172.21.15.149:0/694494308 wait complete. 2023-11-08T19:23:30.025 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.017+0000 7f96f50a0700 1 Processor -- start 2023-11-08T19:23:30.025 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.017+0000 7f96f50a0700 1 -- start start 2023-11-08T19:23:30.025 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.018+0000 7f96f50a0700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f96f00cc0d0 0x7f96f01575d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:30.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.018+0000 7f96f50a0700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f96f00cc4b0 0x7f96f00b0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:30.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.018+0000 7f96f50a0700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96f00cc910 0x7f96f00b13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:30.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.018+0000 7f96f50a0700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f0157b10 con 0x7f96f00cc910 2023-11-08T19:23:30.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.018+0000 7f96f50a0700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f01f0de0 con 0x7f96f00cc4b0 2023-11-08T19:23:30.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.018+0000 7f96f50a0700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96f00b33c0 con 0x7f96f00cc0d0 2023-11-08T19:23:30.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.018+0000 7f96ef59e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96f00cc910 0x7f96f00b13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:30.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.018+0000 7f96ef59e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96f00cc910 0x7f96f00b13a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37828/0 (socket says 172.21.15.149:37828) 2023-11-08T19:23:30.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.018+0000 7f96ef59e700 1 -- 172.21.15.149:0/3919854971 learned_addr learned my addr 172.21.15.149:0/3919854971 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:30.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.018+0000 7f96eed9d700 1 --2- 172.21.15.149:0/3919854971 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f96f00cc0d0 0x7f96f01575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:30.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.018+0000 7f96ee59c700 1 --2- 172.21.15.149:0/3919854971 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f96f00cc4b0 0x7f96f00b0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:30.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.018+0000 7f96ef59e700 1 -- 172.21.15.149:0/3919854971 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f96f00cc0d0 msgr2=0x7f96f01575d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:30.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.018+0000 7f96ef59e700 1 --2- 172.21.15.149:0/3919854971 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f96f00cc0d0 0x7f96f01575d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:30.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.018+0000 7f96ef59e700 1 -- 172.21.15.149:0/3919854971 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f96f00cc4b0 msgr2=0x7f96f00b0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:30.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.018+0000 7f96ef59e700 1 --2- 172.21.15.149:0/3919854971 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f96f00cc4b0 0x7f96f00b0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:30.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.018+0000 7f96ef59e700 1 -- 172.21.15.149:0/3919854971 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e00094a0 con 0x7f96f00cc910 2023-11-08T19:23:30.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.018+0000 7f96ef59e700 1 --2- 172.21.15.149:0/3919854971 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96f00cc910 0x7f96f00b13a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f96e800c870 tx=0x7f96e800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:30.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.018+0000 7f96d77fe700 1 -- 172.21.15.149:0/3919854971 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e8003e30 con 0x7f96f00cc910 2023-11-08T19:23:30.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.018+0000 7f96d77fe700 1 -- 172.21.15.149:0/3919854971 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e800ce10 con 0x7f96f00cc910 2023-11-08T19:23:30.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.018+0000 7f96f50a0700 1 -- 172.21.15.149:0/3919854971 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96f00c8820 con 0x7f96f00cc910 2023-11-08T19:23:30.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.018+0000 7f96d77fe700 1 -- 172.21.15.149:0/3919854971 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e8005290 con 0x7f96f00cc910 2023-11-08T19:23:30.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.019+0000 7f96f50a0700 1 -- 172.21.15.149:0/3919854971 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96f00b3920 con 0x7f96f00cc910 2023-11-08T19:23:30.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.019+0000 7f96f50a0700 1 -- 172.21.15.149:0/3919854971 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96f00c8a40 con 0x7f96f00cc910 2023-11-08T19:23:30.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.020+0000 7f96d77fe700 1 -- 172.21.15.149:0/3919854971 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f96e80053f0 con 0x7f96f00cc910 2023-11-08T19:23:30.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.021+0000 7f96d77fe700 1 --2- 172.21.15.149:0/3919854971 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f96dc06af00 0x7f96dc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:30.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.021+0000 7f96d77fe700 1 -- 172.21.15.149:0/3919854971 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f96e8089dd0 con 0x7f96f00cc910 2023-11-08T19:23:30.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.021+0000 7f96eed9d700 1 --2- 172.21.15.149:0/3919854971 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f96dc06af00 0x7f96dc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:30.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.021+0000 7f96eed9d700 1 --2- 172.21.15.149:0/3919854971 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f96dc06af00 0x7f96dc06d3c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f96e00090b0 tx=0x7f96e001c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:30.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.025+0000 7f96d77fe700 1 -- 172.21.15.149:0/3919854971 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f96e8054d00 con 0x7f96f00cc910 2023-11-08T19:23:30.221 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.218+0000 7f96f50a0700 1 -- 172.21.15.149:0/3919854971 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f96f00c8a10 con 0x7f96f00cc910 2023-11-08T19:23:30.221 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.219+0000 7f96d77fe700 1 -- 172.21.15.149:0/3919854971 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f96e8058320 con 0x7f96f00cc910 2023-11-08T19:23:30.221 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 64 2023-11-08T19:23:30.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.221+0000 7f96f50a0700 1 -- 172.21.15.149:0/3919854971 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f96dc06af00 msgr2=0x7f96dc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:30.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.221+0000 7f96f50a0700 1 --2- 172.21.15.149:0/3919854971 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f96dc06af00 0x7f96dc06d3c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f96e00090b0 tx=0x7f96e001c040 comp rx=0 tx=0).stop 2023-11-08T19:23:30.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.221+0000 7f96f50a0700 1 -- 172.21.15.149:0/3919854971 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96f00cc910 msgr2=0x7f96f00b13a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:30.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.221+0000 7f96f50a0700 1 --2- 172.21.15.149:0/3919854971 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96f00cc910 0x7f96f00b13a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f96e800c870 tx=0x7f96e800cc30 comp rx=0 tx=0).stop 2023-11-08T19:23:30.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.221+0000 7f96f50a0700 1 -- 172.21.15.149:0/3919854971 shutdown_connections 2023-11-08T19:23:30.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.221+0000 7f96f50a0700 1 --2- 172.21.15.149:0/3919854971 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f96dc06af00 0x7f96dc06d3c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:30.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.221+0000 7f96f50a0700 1 --2- 172.21.15.149:0/3919854971 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96f00cc910 0x7f96f00b13a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:30.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.221+0000 7f96f50a0700 1 --2- 172.21.15.149:0/3919854971 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f96f00cc0d0 0x7f96f01575d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:30.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.221+0000 7f96f50a0700 1 --2- 172.21.15.149:0/3919854971 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f96f00cc4b0 0x7f96f00b0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:30.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.221+0000 7f96f50a0700 1 -- 172.21.15.149:0/3919854971 >> 172.21.15.149:0/3919854971 conn(0x7f96f006f120 msgr2=0x7f96f00b6380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:30.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.221+0000 7f96f50a0700 1 -- 172.21.15.149:0/3919854971 shutdown_connections 2023-11-08T19:23:30.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.221+0000 7f96f50a0700 1 -- 172.21.15.149:0/3919854971 wait complete. 2023-11-08T19:23:30.235 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-08T19:23:30.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.357+0000 7f2d19a78700 1 Processor -- start 2023-11-08T19:23:30.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.357+0000 7f2d19a78700 1 -- start start 2023-11-08T19:23:30.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.358+0000 7f2d19a78700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d1415df40 0x7f2d1406c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:30.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.358+0000 7f2d19a78700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f2d1406ab80 0x7f2d1406c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:30.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.358+0000 7f2d19a78700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2d140cf1c0 0x7f2d140caf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:30.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.358+0000 7f2d19a78700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d1415e320 con 0x7f2d140cf1c0 2023-11-08T19:23:30.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.358+0000 7f2d19a78700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d1406b020 con 0x7f2d1406ab80 2023-11-08T19:23:30.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.358+0000 7f2d19a78700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1406b2e0 con 0x7f2d1415df40 2023-11-08T19:23:30.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.358+0000 7f2d13fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2d140cf1c0 0x7f2d140caf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:30.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.358+0000 7f2d13fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2d140cf1c0 0x7f2d140caf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37836/0 (socket says 172.21.15.149:37836) 2023-11-08T19:23:30.364 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.358+0000 7f2d13fff700 1 -- 172.21.15.149:0/2212886681 learned_addr learned my addr 172.21.15.149:0/2212886681 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:30.364 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.358+0000 7f2d137fe700 1 --2- 172.21.15.149:0/2212886681 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d1415df40 0x7f2d1406c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:30.364 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.358+0000 7f2d12ffd700 1 --2- 172.21.15.149:0/2212886681 >> v2:172.21.15.160:3300/0 conn(0x7f2d1406ab80 0x7f2d1406c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:30.364 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.358+0000 7f2d13fff700 1 -- 172.21.15.149:0/2212886681 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d1415df40 msgr2=0x7f2d1406c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:30.364 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.358+0000 7f2d13fff700 1 --2- 172.21.15.149:0/2212886681 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d1415df40 0x7f2d1406c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:30.365 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.358+0000 7f2d13fff700 1 -- 172.21.15.149:0/2212886681 >> v2:172.21.15.160:3300/0 conn(0x7f2d1406ab80 msgr2=0x7f2d1406c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:30.365 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.358+0000 7f2d13fff700 1 --2- 172.21.15.149:0/2212886681 >> v2:172.21.15.160:3300/0 conn(0x7f2d1406ab80 0x7f2d1406c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:30.365 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.358+0000 7f2d13fff700 1 -- 172.21.15.149:0/2212886681 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d1406b5c0 con 0x7f2d140cf1c0 2023-11-08T19:23:30.365 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.358+0000 7f2d137fe700 1 --2- 172.21.15.149:0/2212886681 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d1415df40 0x7f2d1406c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:23:30.365 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.358+0000 7f2d12ffd700 1 --2- 172.21.15.149:0/2212886681 >> v2:172.21.15.160:3300/0 conn(0x7f2d1406ab80 0x7f2d1406c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:23:30.366 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.358+0000 7f2d13fff700 1 --2- 172.21.15.149:0/2212886681 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d140cf1c0 0x7f2d140caf50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2d1406d9a0 tx=0x7f2d0c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eda3e5328facddfe server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:30.366 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.359+0000 7f2d127fc700 1 -- 172.21.15.149:0/2212886681 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c00b870 con 0x7f2d140cf1c0 2023-11-08T19:23:30.366 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.359+0000 7f2d127fc700 1 -- 172.21.15.149:0/2212886681 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d0c00b9d0 con 0x7f2d140cf1c0 2023-11-08T19:23:30.366 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.359+0000 7f2d127fc700 1 -- 172.21.15.149:0/2212886681 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c00bd60 con 0x7f2d140cf1c0 2023-11-08T19:23:30.366 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.359+0000 7f2d19a78700 1 -- 172.21.15.149:0/2212886681 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d140cf1c0 msgr2=0x7f2d140caf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:30.367 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.359+0000 7f2d19a78700 1 --2- 172.21.15.149:0/2212886681 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d140cf1c0 0x7f2d140caf50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2d1406d9a0 tx=0x7f2d0c009bd0 comp rx=0 tx=0).stop 2023-11-08T19:23:30.367 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.359+0000 7f2d19a78700 1 -- 172.21.15.149:0/2212886681 shutdown_connections 2023-11-08T19:23:30.367 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.359+0000 7f2d19a78700 1 --2- 172.21.15.149:0/2212886681 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d140cf1c0 0x7f2d140caf50 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:30.367 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.359+0000 7f2d19a78700 1 --2- 172.21.15.149:0/2212886681 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d1415df40 0x7f2d1406c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:30.367 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.359+0000 7f2d19a78700 1 --2- 172.21.15.149:0/2212886681 >> v2:172.21.15.160:3300/0 conn(0x7f2d1406ab80 0x7f2d1406c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:30.368 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.359+0000 7f2d19a78700 1 -- 172.21.15.149:0/2212886681 >> 172.21.15.149:0/2212886681 conn(0x7f2d140d0640 msgr2=0x7f2d140d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:30.368 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.359+0000 7f2d19a78700 1 -- 172.21.15.149:0/2212886681 shutdown_connections 2023-11-08T19:23:30.368 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.359+0000 7f2d19a78700 1 -- 172.21.15.149:0/2212886681 wait complete. 2023-11-08T19:23:30.371 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.360+0000 7f2d19a78700 1 Processor -- start 2023-11-08T19:23:30.371 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.361+0000 7f2d19a78700 1 -- start start 2023-11-08T19:23:30.371 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.361+0000 7f2d19a78700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d1406ab80 0x7f2d140c9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:30.371 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.361+0000 7f2d19a78700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2d140cf1c0 0x7f2d1414ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:30.371 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.361+0000 7f2d19a78700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d1415df40 0x7f2d14160900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:30.372 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.361+0000 7f2d19a78700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d140c8b60 con 0x7f2d1415df40 2023-11-08T19:23:30.372 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.361+0000 7f2d19a78700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d140c8e40 con 0x7f2d140cf1c0 2023-11-08T19:23:30.372 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.361+0000 7f2d19a78700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d140c9120 con 0x7f2d1406ab80 2023-11-08T19:23:30.372 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.361+0000 7f2d13fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d1415df40 0x7f2d14160900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:30.373 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.361+0000 7f2d13fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d1415df40 0x7f2d14160900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37842/0 (socket says 172.21.15.149:37842) 2023-11-08T19:23:30.373 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.361+0000 7f2d13fff700 1 -- 172.21.15.149:0/2242983929 learned_addr learned my addr 172.21.15.149:0/2242983929 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:30.373 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.362+0000 7f2d137fe700 1 --2- 172.21.15.149:0/2242983929 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d1406ab80 0x7f2d140c9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:30.373 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.362+0000 7f2d12ffd700 1 --2- 172.21.15.149:0/2242983929 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2d140cf1c0 0x7f2d1414ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:30.373 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.362+0000 7f2d13fff700 1 -- 172.21.15.149:0/2242983929 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d1406ab80 msgr2=0x7f2d140c9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:30.374 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.362+0000 7f2d13fff700 1 --2- 172.21.15.149:0/2242983929 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d1406ab80 0x7f2d140c9c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:30.374 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.362+0000 7f2d13fff700 1 -- 172.21.15.149:0/2242983929 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2d140cf1c0 msgr2=0x7f2d1414ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:30.374 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.362+0000 7f2d13fff700 1 --2- 172.21.15.149:0/2242983929 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2d140cf1c0 0x7f2d1414ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:30.374 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.362+0000 7f2d13fff700 1 -- 172.21.15.149:0/2242983929 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d0c009550 con 0x7f2d1415df40 2023-11-08T19:23:30.374 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.362+0000 7f2d13fff700 1 --2- 172.21.15.149:0/2242983929 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d1415df40 0x7f2d14160900 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c009c10 tx=0x7f2d0c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:30.375 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.362+0000 7f2cfbfff700 1 -- 172.21.15.149:0/2242983929 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c004460 con 0x7f2d1415df40 2023-11-08T19:23:30.375 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.362+0000 7f2cfbfff700 1 -- 172.21.15.149:0/2242983929 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d0c0045c0 con 0x7f2d1415df40 2023-11-08T19:23:30.375 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.362+0000 7f2d19a78700 1 -- 172.21.15.149:0/2242983929 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d140c9400 con 0x7f2d1415df40 2023-11-08T19:23:30.375 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.362+0000 7f2cfbfff700 1 -- 172.21.15.149:0/2242983929 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c0038a0 con 0x7f2d1415df40 2023-11-08T19:23:30.376 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.362+0000 7f2d19a78700 1 -- 172.21.15.149:0/2242983929 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d14160e40 con 0x7f2d1415df40 2023-11-08T19:23:30.376 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.363+0000 7f2d19a78700 1 -- 172.21.15.149:0/2242983929 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d140c9920 con 0x7f2d1415df40 2023-11-08T19:23:30.376 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.363+0000 7f2cfbfff700 1 -- 172.21.15.149:0/2242983929 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2d0c021070 con 0x7f2d1415df40 2023-11-08T19:23:30.376 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.364+0000 7f2cfbfff700 1 --2- 172.21.15.149:0/2242983929 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2d0006af00 0x7f2d0006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:30.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.364+0000 7f2cfbfff700 1 -- 172.21.15.149:0/2242983929 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2d0c08af80 con 0x7f2d1415df40 2023-11-08T19:23:30.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.364+0000 7f2d137fe700 1 --2- 172.21.15.149:0/2242983929 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2d0006af00 0x7f2d0006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:30.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.364+0000 7f2d137fe700 1 --2- 172.21.15.149:0/2242983929 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2d0006af00 0x7f2d0006d3c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2d0400f3f0 tx=0x7f2d04007770 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:30.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.369+0000 7f2cfbfff700 1 -- 172.21.15.149:0/2242983929 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2d0c0bdca0 con 0x7f2d1415df40 2023-11-08T19:23:30.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.558+0000 7f2d19a78700 1 -- 172.21.15.149:0/2242983929 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f2d14160fd0 con 0x7f2d1415df40 2023-11-08T19:23:30.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.559+0000 7f2cfbfff700 1 -- 172.21.15.149:0/2242983929 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2d0c015020 con 0x7f2d1415df40 2023-11-08T19:23:30.561 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:23:30.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.561+0000 7f2d19a78700 1 -- 172.21.15.149:0/2242983929 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2d0006af00 msgr2=0x7f2d0006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:30.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.561+0000 7f2d19a78700 1 --2- 172.21.15.149:0/2242983929 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2d0006af00 0x7f2d0006d3c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2d0400f3f0 tx=0x7f2d04007770 comp rx=0 tx=0).stop 2023-11-08T19:23:30.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.561+0000 7f2d19a78700 1 -- 172.21.15.149:0/2242983929 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d1415df40 msgr2=0x7f2d14160900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:30.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.561+0000 7f2d19a78700 1 --2- 172.21.15.149:0/2242983929 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d1415df40 0x7f2d14160900 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c009c10 tx=0x7f2d0c004750 comp rx=0 tx=0).stop 2023-11-08T19:23:30.567 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.561+0000 7f2d19a78700 1 -- 172.21.15.149:0/2242983929 shutdown_connections 2023-11-08T19:23:30.567 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.561+0000 7f2d19a78700 1 --2- 172.21.15.149:0/2242983929 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2d0006af00 0x7f2d0006d3c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:30.567 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.561+0000 7f2d19a78700 1 --2- 172.21.15.149:0/2242983929 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d1415df40 0x7f2d14160900 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:30.567 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.561+0000 7f2d19a78700 1 --2- 172.21.15.149:0/2242983929 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d1406ab80 0x7f2d140c9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:30.567 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.561+0000 7f2d19a78700 1 --2- 172.21.15.149:0/2242983929 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2d140cf1c0 0x7f2d1414ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:30.568 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.561+0000 7f2d19a78700 1 -- 172.21.15.149:0/2242983929 >> 172.21.15.149:0/2242983929 conn(0x7f2d140d0640 msgr2=0x7f2d140cb030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:30.568 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.561+0000 7f2d19a78700 1 -- 172.21.15.149:0/2242983929 shutdown_connections 2023-11-08T19:23:30.568 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.561+0000 7f2d19a78700 1 -- 172.21.15.149:0/2242983929 wait complete. 2023-11-08T19:23:30.576 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:23:30.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.696+0000 7f0b3d17a700 1 Processor -- start 2023-11-08T19:23:30.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.696+0000 7f0b3d17a700 1 -- start start 2023-11-08T19:23:30.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.697+0000 7f0b3d17a700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0b380cc140 0x7f0b380cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:30.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.697+0000 7f0b3d17a700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f0b380b2cd0 0x7f0b3815d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:30.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.697+0000 7f0b3d17a700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b380cce50 con 0x7f0b380b2850 2023-11-08T19:23:30.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.697+0000 7f0b3d17a700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b380b2430 con 0x7f0b380cc140 2023-11-08T19:23:30.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.697+0000 7f0b3d17a700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b380cc520 con 0x7f0b380b2cd0 2023-11-08T19:23:30.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.697+0000 7f0b36d9d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0b380cc140 0x7f0b380cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:30.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.697+0000 7f0b36d9d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0b380cc140 0x7f0b380cc910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37846/0 (socket says 172.21.15.149:37846) 2023-11-08T19:23:30.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.697+0000 7f0b36d9d700 1 -- 172.21.15.149:0/2614645258 learned_addr learned my addr 172.21.15.149:0/2614645258 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:30.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.697+0000 7f0b3659c700 1 --1- 172.21.15.149:0/2614645258 >> v1:172.21.15.149:6789/0 conn(0x7f0b380b2850 0x7f0b380cabf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:39848/0 (socket says 172.21.15.149:39848) 2023-11-08T19:23:30.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.698+0000 7f0b3759e700 1 --2- 172.21.15.149:0/2614645258 >> v2:172.21.15.160:3300/0 conn(0x7f0b380b2cd0 0x7f0b3815d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:30.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.698+0000 7f0b36d9d700 1 -- 172.21.15.149:0/2614645258 >> v2:172.21.15.160:3300/0 conn(0x7f0b380b2cd0 msgr2=0x7f0b3815d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:30.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.698+0000 7f0b36d9d700 1 --2- 172.21.15.149:0/2614645258 >> v2:172.21.15.160:3300/0 conn(0x7f0b380b2cd0 0x7f0b3815d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:30.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.698+0000 7f0b36d9d700 1 -- 172.21.15.149:0/2614645258 >> v1:172.21.15.149:6789/0 conn(0x7f0b380b2850 legacy=0x7f0b380cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:30.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.698+0000 7f0b35d9b700 1 -- 172.21.15.149:0/2614645258 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 50813400 0 0) 0x7f0b380cce50 con 0x7f0b380b2850 2023-11-08T19:23:30.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.698+0000 7f0b36d9d700 1 -- 172.21.15.149:0/2614645258 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b380b17b0 con 0x7f0b380cc140 2023-11-08T19:23:30.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.698+0000 7f0b36d9d700 1 --2- 172.21.15.149:0/2614645258 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b380cc140 0x7f0b380cc910 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0b380c7600 tx=0x7f0b2c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e39506010b50b3d server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:30.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.698+0000 7f0b35d9b700 1 -- 172.21.15.149:0/2614645258 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b2c005e30 con 0x7f0b380cc140 2023-11-08T19:23:30.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.698+0000 7f0b35d9b700 1 -- 172.21.15.149:0/2614645258 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b2c004030 con 0x7f0b380cc140 2023-11-08T19:23:30.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.698+0000 7f0b35d9b700 1 -- 172.21.15.149:0/2614645258 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b2c0043e0 con 0x7f0b380cc140 2023-11-08T19:23:30.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.699+0000 7f0b3d17a700 1 -- 172.21.15.149:0/2614645258 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b380cc140 msgr2=0x7f0b380cc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:30.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.699+0000 7f0b3d17a700 1 --2- 172.21.15.149:0/2614645258 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b380cc140 0x7f0b380cc910 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0b380c7600 tx=0x7f0b2c009bd0 comp rx=0 tx=0).stop 2023-11-08T19:23:30.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.699+0000 7f0b3d17a700 1 -- 172.21.15.149:0/2614645258 shutdown_connections 2023-11-08T19:23:30.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.699+0000 7f0b3d17a700 1 --2- 172.21.15.149:0/2614645258 >> v2:172.21.15.160:3300/0 conn(0x7f0b380b2cd0 0x7f0b3815d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:30.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.699+0000 7f0b3d17a700 1 --2- 172.21.15.149:0/2614645258 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b380cc140 0x7f0b380cc910 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:30.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.699+0000 7f0b3d17a700 1 -- 172.21.15.149:0/2614645258 >> 172.21.15.149:0/2614645258 conn(0x7f0b38099a40 msgr2=0x7f0b380d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:30.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.699+0000 7f0b3d17a700 1 -- 172.21.15.149:0/2614645258 shutdown_connections 2023-11-08T19:23:30.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.699+0000 7f0b3d17a700 1 -- 172.21.15.149:0/2614645258 wait complete. 2023-11-08T19:23:30.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.700+0000 7f0b3d17a700 1 Processor -- start 2023-11-08T19:23:30.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.700+0000 7f0b3d17a700 1 -- start start 2023-11-08T19:23:30.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.701+0000 7f0b3d17a700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0b380b2850 0x7f0b3815ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:30.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.701+0000 7f0b3d17a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b380b2cd0 0x7f0b381f45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:30.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.701+0000 7f0b3d17a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b380cc140 0x7f0b380c9340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:30.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.701+0000 7f0b3d17a700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3815f140 con 0x7f0b380cc140 2023-11-08T19:23:30.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.701+0000 7f0b3d17a700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3809a3e0 con 0x7f0b380b2cd0 2023-11-08T19:23:30.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.701+0000 7f0b3d17a700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3809a6c0 con 0x7f0b380b2850 2023-11-08T19:23:30.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.701+0000 7f0b3759e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b380cc140 0x7f0b380c9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:30.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.701+0000 7f0b3759e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b380cc140 0x7f0b380c9340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37856/0 (socket says 172.21.15.149:37856) 2023-11-08T19:23:30.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.701+0000 7f0b3759e700 1 -- 172.21.15.149:0/3332815602 learned_addr learned my addr 172.21.15.149:0/3332815602 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:30.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.701+0000 7f0b36d9d700 1 --2- 172.21.15.149:0/3332815602 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0b380b2850 0x7f0b3815ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:30.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.701+0000 7f0b3759e700 1 -- 172.21.15.149:0/3332815602 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0b380b2850 msgr2=0x7f0b3815ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:30.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.701+0000 7f0b3659c700 1 --2- 172.21.15.149:0/3332815602 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b380b2cd0 0x7f0b381f45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:30.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.701+0000 7f0b3759e700 1 --2- 172.21.15.149:0/3332815602 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0b380b2850 0x7f0b3815ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:30.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.701+0000 7f0b3759e700 1 -- 172.21.15.149:0/3332815602 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b380b2cd0 msgr2=0x7f0b381f45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:30.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.701+0000 7f0b3759e700 1 --2- 172.21.15.149:0/3332815602 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b380b2cd0 0x7f0b381f45b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:30.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.701+0000 7f0b3759e700 1 -- 172.21.15.149:0/3332815602 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b2c009500 con 0x7f0b380cc140 2023-11-08T19:23:30.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.701+0000 7f0b3759e700 1 --2- 172.21.15.149:0/3332815602 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b380cc140 0x7f0b380c9340 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0b3000efc0 tx=0x7f0b3000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:30.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.702+0000 7f0b1f7fe700 1 -- 172.21.15.149:0/3332815602 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b30009ca0 con 0x7f0b380cc140 2023-11-08T19:23:30.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.702+0000 7f0b1f7fe700 1 -- 172.21.15.149:0/3332815602 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b3000f040 con 0x7f0b380cc140 2023-11-08T19:23:30.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.702+0000 7f0b3d17a700 1 -- 172.21.15.149:0/3332815602 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b3809a9a0 con 0x7f0b380cc140 2023-11-08T19:23:30.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.702+0000 7f0b1f7fe700 1 -- 172.21.15.149:0/3332815602 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b30014480 con 0x7f0b380cc140 2023-11-08T19:23:30.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.702+0000 7f0b3d17a700 1 -- 172.21.15.149:0/3332815602 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b381f4af0 con 0x7f0b380cc140 2023-11-08T19:23:30.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.703+0000 7f0b3d17a700 1 -- 172.21.15.149:0/3332815602 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b3809c5c0 con 0x7f0b380cc140 2023-11-08T19:23:30.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.703+0000 7f0b1f7fe700 1 -- 172.21.15.149:0/3332815602 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0b300145e0 con 0x7f0b380cc140 2023-11-08T19:23:30.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.703+0000 7f0b1f7fe700 1 --2- 172.21.15.149:0/3332815602 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0b2406af00 0x7f0b2406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:30.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.704+0000 7f0b1f7fe700 1 -- 172.21.15.149:0/3332815602 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0b3008a570 con 0x7f0b380cc140 2023-11-08T19:23:30.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.704+0000 7f0b36d9d700 1 --2- 172.21.15.149:0/3332815602 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0b2406af00 0x7f0b2406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:30.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.704+0000 7f0b36d9d700 1 --2- 172.21.15.149:0/3332815602 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0b2406af00 0x7f0b2406d3c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c014040 tx=0x7f0b2c008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:30.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.708+0000 7f0b1f7fe700 1 -- 172.21.15.149:0/3332815602 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0b3809c5c0 con 0x7f0b380cc140 2023-11-08T19:23:30.942 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.940+0000 7f0b3d17a700 1 -- 172.21.15.149:0/3332815602 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0b3809c5c0 con 0x7f0b380cc140 2023-11-08T19:23:30.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.940+0000 7f0b1f7fe700 1 -- 172.21.15.149:0/3332815602 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4921 (secure 0 0 0) 0x7f0b3809c5c0 con 0x7f0b380cc140 2023-11-08T19:23:30.943 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:23:30.943 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4252,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/2277605177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":2277605177},{"type":"v1","addr":"172.21.15.149:6837","nonce":2277605177}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/2774257644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2774257644},{"type":"v1","addr":"172.21.15.149:6836","nonce":2774257644}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/2076428669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":2076428669},{"type":"v1","addr":"172.21.15.160:6835","nonce":2076428669}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-08T19:23:01.918138+0000","modified":"2023-11-08T19:23:19.490960+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.160:6834/3847116435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3847116435},{"type":"v1","addr":"172.21.15.160:6834","nonce":3847116435}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-08T19:23:30.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.943+0000 7f0b3d17a700 1 -- 172.21.15.149:0/3332815602 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0b2406af00 msgr2=0x7f0b2406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:30.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.943+0000 7f0b3d17a700 1 --2- 172.21.15.149:0/3332815602 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0b2406af00 0x7f0b2406d3c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c014040 tx=0x7f0b2c008070 comp rx=0 tx=0).stop 2023-11-08T19:23:30.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.943+0000 7f0b3d17a700 1 -- 172.21.15.149:0/3332815602 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b380cc140 msgr2=0x7f0b380c9340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:30.946 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.943+0000 7f0b3d17a700 1 --2- 172.21.15.149:0/3332815602 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b380cc140 0x7f0b380c9340 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0b3000efc0 tx=0x7f0b3000c3a0 comp rx=0 tx=0).stop 2023-11-08T19:23:30.946 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.943+0000 7f0b3d17a700 1 -- 172.21.15.149:0/3332815602 shutdown_connections 2023-11-08T19:23:30.946 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.943+0000 7f0b3d17a700 1 --2- 172.21.15.149:0/3332815602 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0b2406af00 0x7f0b2406d3c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:30.946 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.943+0000 7f0b3d17a700 1 --2- 172.21.15.149:0/3332815602 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b380cc140 0x7f0b380c9340 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:30.946 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.943+0000 7f0b3d17a700 1 --2- 172.21.15.149:0/3332815602 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0b380b2850 0x7f0b3815ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:30.947 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.943+0000 7f0b3d17a700 1 --2- 172.21.15.149:0/3332815602 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b380b2cd0 0x7f0b381f45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:30.947 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.943+0000 7f0b3d17a700 1 -- 172.21.15.149:0/3332815602 >> 172.21.15.149:0/3332815602 conn(0x7f0b38099a40 msgr2=0x7f0b380c7670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:30.947 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.943+0000 7f0b3d17a700 1 -- 172.21.15.149:0/3332815602 shutdown_connections 2023-11-08T19:23:30.947 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:30.943+0000 7f0b3d17a700 1 -- 172.21.15.149:0/3332815602 wait complete. 2023-11-08T19:23:30.948 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 9 2023-11-08T19:23:30.959 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:23:31.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.078+0000 7f1300bf5700 1 Processor -- start 2023-11-08T19:23:31.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.078+0000 7f1300bf5700 1 -- start start 2023-11-08T19:23:31.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.079+0000 7f1300bf5700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f12fc0cc910 0x7f12fc0cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:31.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.079+0000 7f1300bf5700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12fc0b2f60 con 0x7f12fc0cb130 2023-11-08T19:23:31.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.079+0000 7f1300bf5700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12fc0cc520 con 0x7f12fc0cc140 2023-11-08T19:23:31.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.079+0000 7f1300bf5700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12fc0b2430 con 0x7f12fc0cc910 2023-11-08T19:23:31.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.079+0000 7f12fad9d700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f12fc0cb130 0x7f12fc15d2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:39866/0 (socket says 172.21.15.149:39866) 2023-11-08T19:23:31.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.080+0000 7f12fad9d700 1 -- 172.21.15.149:0/518135975 learned_addr learned my addr 172.21.15.149:0/518135975 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:23:31.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.080+0000 7f12f9d9b700 1 --2- 172.21.15.149:0/518135975 >> v2:172.21.15.160:3300/0 conn(0x7f12fc0cc910 0x7f12fc0cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:31.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.080+0000 7f12f959a700 1 -- 172.21.15.149:0/518135975 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 828467531 0 0) 0x7f12fc0b2f60 con 0x7f12fc0cb130 2023-11-08T19:23:31.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.080+0000 7f12f959a700 1 -- 172.21.15.149:0/518135975 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12e40035b0 con 0x7f12fc0cb130 2023-11-08T19:23:31.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.080+0000 7f12f9d9b700 1 -- 172.21.15.149:0/518135975 >> v1:172.21.15.160:6789/0 conn(0x7f12fc0cc140 legacy=0x7f12fc0b2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:31.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.080+0000 7f12f9d9b700 1 -- 172.21.15.149:0/518135975 >> v1:172.21.15.149:6789/0 conn(0x7f12fc0cb130 legacy=0x7f12fc15d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:31.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.080+0000 7f12f9d9b700 1 -- 172.21.15.149:0/518135975 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12fc0cb5e0 con 0x7f12fc0cc910 2023-11-08T19:23:31.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.080+0000 7f12f9d9b700 1 --2- 172.21.15.149:0/518135975 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f12fc0cc910 0x7f12fc0cabf0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f12ec009840 tx=0x7f12ec009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6837c3a9293fbcff server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:31.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.080+0000 7f12f959a700 1 -- 172.21.15.149:0/518135975 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12ec011830 con 0x7f12fc0cc910 2023-11-08T19:23:31.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.080+0000 7f12f959a700 1 -- 172.21.15.149:0/518135975 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12ec011990 con 0x7f12fc0cc910 2023-11-08T19:23:31.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.080+0000 7f12f959a700 1 -- 172.21.15.149:0/518135975 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12ec011d20 con 0x7f12fc0cc910 2023-11-08T19:23:31.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.081+0000 7f1300bf5700 1 -- 172.21.15.149:0/518135975 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f12fc0cc910 msgr2=0x7f12fc0cabf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:31.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.081+0000 7f1300bf5700 1 --2- 172.21.15.149:0/518135975 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f12fc0cc910 0x7f12fc0cabf0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f12ec009840 tx=0x7f12ec009b50 comp rx=0 tx=0).stop 2023-11-08T19:23:31.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.081+0000 7f1300bf5700 1 -- 172.21.15.149:0/518135975 shutdown_connections 2023-11-08T19:23:31.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.081+0000 7f1300bf5700 1 --2- 172.21.15.149:0/518135975 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f12fc0cc910 0x7f12fc0cabf0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:31.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.081+0000 7f1300bf5700 1 -- 172.21.15.149:0/518135975 >> 172.21.15.149:0/518135975 conn(0x7f12fc099a40 msgr2=0x7f12fc0d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:31.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.081+0000 7f1300bf5700 1 -- 172.21.15.149:0/518135975 shutdown_connections 2023-11-08T19:23:31.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.081+0000 7f1300bf5700 1 -- 172.21.15.149:0/518135975 wait complete. 2023-11-08T19:23:31.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.082+0000 7f1300bf5700 1 Processor -- start 2023-11-08T19:23:31.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.082+0000 7f1300bf5700 1 -- start start 2023-11-08T19:23:31.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.083+0000 7f1300bf5700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f12fc0cb130 0x7f12fc14f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:31.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.083+0000 7f1300bf5700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f12fc0cc140 0x7f12fc1f7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:31.092 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.083+0000 7f1300bf5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f12fc0cc910 0x7f12fc09a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:31.092 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.083+0000 7f1300bf5700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12fc1f7670 con 0x7f12fc0cc910 2023-11-08T19:23:31.092 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.083+0000 7f1300bf5700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12fc09c530 con 0x7f12fc0cc140 2023-11-08T19:23:31.092 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.083+0000 7f1300bf5700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12fc1f3020 con 0x7f12fc0cb130 2023-11-08T19:23:31.093 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.083+0000 7f12fad9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f12fc0cc910 0x7f12fc09a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:31.093 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.083+0000 7f12fad9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f12fc0cc910 0x7f12fc09a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37870/0 (socket says 172.21.15.149:37870) 2023-11-08T19:23:31.093 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.083+0000 7f12fad9d700 1 -- 172.21.15.149:0/3238069251 learned_addr learned my addr 172.21.15.149:0/3238069251 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:31.093 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.083+0000 7f12f9d9b700 1 --2- 172.21.15.149:0/3238069251 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f12fc0cc140 0x7f12fc1f7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:31.093 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.083+0000 7f12fa59c700 1 --2- 172.21.15.149:0/3238069251 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f12fc0cb130 0x7f12fc14f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:31.094 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.084+0000 7f12fad9d700 1 -- 172.21.15.149:0/3238069251 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f12fc0cb130 msgr2=0x7f12fc14f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:31.094 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.084+0000 7f12fad9d700 1 --2- 172.21.15.149:0/3238069251 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f12fc0cb130 0x7f12fc14f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:31.094 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.084+0000 7f12fad9d700 1 -- 172.21.15.149:0/3238069251 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f12fc0cc140 msgr2=0x7f12fc1f7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:31.094 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.084+0000 7f12fad9d700 1 --2- 172.21.15.149:0/3238069251 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f12fc0cc140 0x7f12fc1f7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:31.094 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.084+0000 7f12fad9d700 1 -- 172.21.15.149:0/3238069251 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12ec0094a0 con 0x7f12fc0cc910 2023-11-08T19:23:31.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.084+0000 7f12f9d9b700 1 --2- 172.21.15.149:0/3238069251 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f12fc0cc140 0x7f12fc1f7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:23:31.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.084+0000 7f12fad9d700 1 --2- 172.21.15.149:0/3238069251 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f12fc0cc910 0x7f12fc09a500 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f12f400cb40 tx=0x7f12f400cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:31.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.084+0000 7f12eaffd700 1 -- 172.21.15.149:0/3238069251 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f400ab50 con 0x7f12fc0cc910 2023-11-08T19:23:31.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.084+0000 7f1300bf5700 1 -- 172.21.15.149:0/3238069251 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12fc152000 con 0x7f12fc0cc910 2023-11-08T19:23:31.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.084+0000 7f12eaffd700 1 -- 172.21.15.149:0/3238069251 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f400acb0 con 0x7f12fc0cc910 2023-11-08T19:23:31.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.084+0000 7f12eaffd700 1 -- 172.21.15.149:0/3238069251 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f4012620 con 0x7f12fc0cc910 2023-11-08T19:23:31.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.084+0000 7f1300bf5700 1 -- 172.21.15.149:0/3238069251 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12fc1525c0 con 0x7f12fc0cc910 2023-11-08T19:23:31.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.085+0000 7f1300bf5700 1 -- 172.21.15.149:0/3238069251 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12fc09c6f0 con 0x7f12fc0cc910 2023-11-08T19:23:31.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.085+0000 7f12eaffd700 1 -- 172.21.15.149:0/3238069251 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f12f401b3b0 con 0x7f12fc0cc910 2023-11-08T19:23:31.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.086+0000 7f12eaffd700 1 --2- 172.21.15.149:0/3238069251 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f12dc06af00 0x7f12dc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:31.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.086+0000 7f12eaffd700 1 -- 172.21.15.149:0/3238069251 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f12f4089780 con 0x7f12fc0cc910 2023-11-08T19:23:31.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.086+0000 7f12fa59c700 1 --2- 172.21.15.149:0/3238069251 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f12dc06af00 0x7f12dc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:31.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.086+0000 7f12fa59c700 1 --2- 172.21.15.149:0/3238069251 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f12dc06af00 0x7f12dc06d3c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f12fc1f66b0 tx=0x7f12f0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:31.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.091+0000 7f12eaffd700 1 -- 172.21.15.149:0/3238069251 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f12f40544c0 con 0x7f12fc0cc910 2023-11-08T19:23:31.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.283+0000 7f1300bf5700 1 -- 172.21.15.149:0/3238069251 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f12fc0745f0 con 0x7f12fc0cc910 2023-11-08T19:23:31.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.284+0000 7f12eaffd700 1 -- 172.21.15.149:0/3238069251 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18382 (secure 0 0 0) 0x7f12f4057ae0 con 0x7f12fc0cc910 2023-11-08T19:23:31.287 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:23:31.287 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":24,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:23:06.964482+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-08T19:22:59.830928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-08T19:23:00.886589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-08T19:23:04.574033+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:23:31.289 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.286+0000 7f1300bf5700 1 -- 172.21.15.149:0/3238069251 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f12dc06af00 msgr2=0x7f12dc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:31.289 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.286+0000 7f1300bf5700 1 --2- 172.21.15.149:0/3238069251 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f12dc06af00 0x7f12dc06d3c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f12fc1f66b0 tx=0x7f12f0009040 comp rx=0 tx=0).stop 2023-11-08T19:23:31.289 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.286+0000 7f1300bf5700 1 -- 172.21.15.149:0/3238069251 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f12fc0cc910 msgr2=0x7f12fc09a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:31.289 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.286+0000 7f1300bf5700 1 --2- 172.21.15.149:0/3238069251 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f12fc0cc910 0x7f12fc09a500 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f12f400cb40 tx=0x7f12f400cf00 comp rx=0 tx=0).stop 2023-11-08T19:23:31.290 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.286+0000 7f1300bf5700 1 -- 172.21.15.149:0/3238069251 shutdown_connections 2023-11-08T19:23:31.290 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.286+0000 7f1300bf5700 1 --2- 172.21.15.149:0/3238069251 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f12dc06af00 0x7f12dc06d3c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:31.290 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.286+0000 7f1300bf5700 1 --2- 172.21.15.149:0/3238069251 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f12fc0cc910 0x7f12fc09a500 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:31.290 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.286+0000 7f1300bf5700 1 --2- 172.21.15.149:0/3238069251 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f12fc0cb130 0x7f12fc14f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:31.290 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.286+0000 7f1300bf5700 1 --2- 172.21.15.149:0/3238069251 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f12fc0cc140 0x7f12fc1f7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:31.291 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.286+0000 7f1300bf5700 1 -- 172.21.15.149:0/3238069251 >> 172.21.15.149:0/3238069251 conn(0x7f12fc099a40 msgr2=0x7f12fc06ec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:31.291 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.286+0000 7f1300bf5700 1 -- 172.21.15.149:0/3238069251 shutdown_connections 2023-11-08T19:23:31.291 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.287+0000 7f1300bf5700 1 -- 172.21.15.149:0/3238069251 wait complete. 2023-11-08T19:23:31.301 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:23:31.422 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.420+0000 7fc7b0660700 1 Processor -- start 2023-11-08T19:23:31.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.420+0000 7fc7b0660700 1 -- start start 2023-11-08T19:23:31.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.421+0000 7fc7b0660700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc7a8161670 0x7fc7a80b5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:31.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.421+0000 7fc7b0660700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fc7a80ce500 0x7fc7a80ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:31.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.421+0000 7fc7b0660700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7a80d1a10 con 0x7fc7a8161a50 2023-11-08T19:23:31.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.421+0000 7fc7b0660700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7a80d1cf0 con 0x7fc7a8161670 2023-11-08T19:23:31.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.421+0000 7fc7b0660700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7a80d1fd0 con 0x7fc7a80ce500 2023-11-08T19:23:31.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.422+0000 7fc7ae3fc700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc7a8161670 0x7fc7a80b5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:31.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.422+0000 7fc7ae3fc700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc7a8161670 0x7fc7a80b5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37874/0 (socket says 172.21.15.149:37874) 2023-11-08T19:23:31.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.422+0000 7fc7ae3fc700 1 -- 172.21.15.149:0/4151699693 learned_addr learned my addr 172.21.15.149:0/4151699693 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:31.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.422+0000 7fc7aebfd700 1 --2- 172.21.15.149:0/4151699693 >> v2:172.21.15.160:3300/0 conn(0x7fc7a80ce500 0x7fc7a80ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:31.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.422+0000 7fc7ae3fc700 1 -- 172.21.15.149:0/4151699693 >> v2:172.21.15.160:3300/0 conn(0x7fc7a80ce500 msgr2=0x7fc7a80ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:31.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.422+0000 7fc7ae3fc700 1 --2- 172.21.15.149:0/4151699693 >> v2:172.21.15.160:3300/0 conn(0x7fc7a80ce500 0x7fc7a80ce970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:31.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.422+0000 7fc7ae3fc700 1 -- 172.21.15.149:0/4151699693 >> v1:172.21.15.149:6789/0 conn(0x7fc7a8161a50 legacy=0x7fc7a8161f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:31.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.422+0000 7fc7ae3fc700 1 -- 172.21.15.149:0/4151699693 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7a80d22b0 con 0x7fc7a8161670 2023-11-08T19:23:31.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.422+0000 7fc7aebfd700 1 --2- 172.21.15.149:0/4151699693 >> v2:172.21.15.160:3300/0 conn(0x7fc7a80ce500 0x7fc7a80ce970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:23:31.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.422+0000 7fc7ae3fc700 1 --2- 172.21.15.149:0/4151699693 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc7a8161670 0x7fc7a80b5e10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc7a806b590 tx=0x7fc798009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfef468eec486467 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:31.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.422+0000 7fc7ad3fa700 1 -- 172.21.15.149:0/4151699693 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc798005e30 con 0x7fc7a8161670 2023-11-08T19:23:31.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.422+0000 7fc7ad3fa700 1 -- 172.21.15.149:0/4151699693 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc798004030 con 0x7fc7a8161670 2023-11-08T19:23:31.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.422+0000 7fc7ad3fa700 1 -- 172.21.15.149:0/4151699693 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7980043e0 con 0x7fc7a8161670 2023-11-08T19:23:31.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.423+0000 7fc7b0660700 1 -- 172.21.15.149:0/4151699693 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc7a8161670 msgr2=0x7fc7a80b5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:31.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.423+0000 7fc7b0660700 1 --2- 172.21.15.149:0/4151699693 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc7a8161670 0x7fc7a80b5e10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc7a806b590 tx=0x7fc798009bd0 comp rx=0 tx=0).stop 2023-11-08T19:23:31.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.423+0000 7fc7b0660700 1 -- 172.21.15.149:0/4151699693 shutdown_connections 2023-11-08T19:23:31.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.423+0000 7fc7b0660700 1 --2- 172.21.15.149:0/4151699693 >> v2:172.21.15.160:3300/0 conn(0x7fc7a80ce500 0x7fc7a80ce970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:31.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.423+0000 7fc7b0660700 1 --2- 172.21.15.149:0/4151699693 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc7a8161670 0x7fc7a80b5e10 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:31.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.423+0000 7fc7b0660700 1 -- 172.21.15.149:0/4151699693 >> 172.21.15.149:0/4151699693 conn(0x7fc7a80d3980 msgr2=0x7fc7a80d3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:31.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.423+0000 7fc7b0660700 1 -- 172.21.15.149:0/4151699693 shutdown_connections 2023-11-08T19:23:31.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.423+0000 7fc7b0660700 1 -- 172.21.15.149:0/4151699693 wait complete. 2023-11-08T19:23:31.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.424+0000 7fc7b0660700 1 Processor -- start 2023-11-08T19:23:31.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.424+0000 7fc7b0660700 1 -- start start 2023-11-08T19:23:31.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.425+0000 7fc7b0660700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc7a80ce500 0x7fc7a8158dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:31.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.425+0000 7fc7b0660700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7a8161670 0x7fc7a815a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:31.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.425+0000 7fc7b0660700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc7a8161a50 0x7fc7a815abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:31.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.425+0000 7fc7b0660700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a80cb3b0 con 0x7fc7a80ce500 2023-11-08T19:23:31.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.425+0000 7fc7b0660700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a8149e30 con 0x7fc7a8161670 2023-11-08T19:23:31.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.425+0000 7fc7b0660700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a8146fc0 con 0x7fc7a8161a50 2023-11-08T19:23:31.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.425+0000 7fc7ae3fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc7a80ce500 0x7fc7a8158dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:31.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.425+0000 7fc7ae3fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc7a80ce500 0x7fc7a8158dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37880/0 (socket says 172.21.15.149:37880) 2023-11-08T19:23:31.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.425+0000 7fc7ae3fc700 1 -- 172.21.15.149:0/1830097821 learned_addr learned my addr 172.21.15.149:0/1830097821 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:31.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.425+0000 7fc7aebfd700 1 --2- 172.21.15.149:0/1830097821 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc7a8161a50 0x7fc7a815abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:31.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.425+0000 7fc7adbfb700 1 --2- 172.21.15.149:0/1830097821 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7a8161670 0x7fc7a815a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:31.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.425+0000 7fc7ae3fc700 1 -- 172.21.15.149:0/1830097821 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc7a8161a50 msgr2=0x7fc7a815abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:31.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.425+0000 7fc7ae3fc700 1 --2- 172.21.15.149:0/1830097821 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc7a8161a50 0x7fc7a815abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:31.438 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.425+0000 7fc7ae3fc700 1 -- 172.21.15.149:0/1830097821 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7a8161670 msgr2=0x7fc7a815a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:31.438 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.425+0000 7fc7ae3fc700 1 --2- 172.21.15.149:0/1830097821 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7a8161670 0x7fc7a815a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:31.438 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.425+0000 7fc7ae3fc700 1 -- 172.21.15.149:0/1830097821 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc798009500 con 0x7fc7a80ce500 2023-11-08T19:23:31.438 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.425+0000 7fc7aebfd700 1 --2- 172.21.15.149:0/1830097821 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc7a8161a50 0x7fc7a815abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:23:31.438 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.425+0000 7fc7adbfb700 1 --2- 172.21.15.149:0/1830097821 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7a8161670 0x7fc7a815a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:23:31.439 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.425+0000 7fc7ae3fc700 1 --2- 172.21.15.149:0/1830097821 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc7a80ce500 0x7fc7a8158dc0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc798009c10 tx=0x7fc798004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:31.439 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.425+0000 7fc79effd700 1 -- 172.21.15.149:0/1830097821 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc798011620 con 0x7fc7a80ce500 2023-11-08T19:23:31.439 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.425+0000 7fc79effd700 1 -- 172.21.15.149:0/1830097821 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc798011780 con 0x7fc7a80ce500 2023-11-08T19:23:31.439 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.425+0000 7fc7b0660700 1 -- 172.21.15.149:0/1830097821 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7a815b230 con 0x7fc7a80ce500 2023-11-08T19:23:31.439 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.425+0000 7fc79effd700 1 -- 172.21.15.149:0/1830097821 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc798011b10 con 0x7fc7a80ce500 2023-11-08T19:23:31.440 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.425+0000 7fc7b0660700 1 -- 172.21.15.149:0/1830097821 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7a8147260 con 0x7fc7a80ce500 2023-11-08T19:23:31.440 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.426+0000 7fc7b0660700 1 -- 172.21.15.149:0/1830097821 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7a8147480 con 0x7fc7a80ce500 2023-11-08T19:23:31.440 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.427+0000 7fc79effd700 1 -- 172.21.15.149:0/1830097821 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc798011c70 con 0x7fc7a80ce500 2023-11-08T19:23:31.440 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.427+0000 7fc79effd700 1 --2- 172.21.15.149:0/1830097821 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc78c06af00 0x7fc78c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:31.440 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.427+0000 7fc79effd700 1 -- 172.21.15.149:0/1830097821 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc79808a8e0 con 0x7fc7a80ce500 2023-11-08T19:23:31.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.427+0000 7fc7adbfb700 1 --2- 172.21.15.149:0/1830097821 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc78c06af00 0x7fc78c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:31.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.428+0000 7fc7adbfb700 1 --2- 172.21.15.149:0/1830097821 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc78c06af00 0x7fc78c06d3c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc7a80d0180 tx=0x7fc7a4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:31.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.432+0000 7fc79effd700 1 -- 172.21.15.149:0/1830097821 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc798055730 con 0x7fc7a80ce500 2023-11-08T19:23:31.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.665+0000 7fc7b0660700 1 -- 172.21.15.149:0/1830097821 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc7a8159360 con 0x7fc7a80ce500 2023-11-08T19:23:31.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.666+0000 7fc79effd700 1 -- 172.21.15.149:0/1830097821 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4921 (secure 0 0 0) 0x7fc798058d50 con 0x7fc7a80ce500 2023-11-08T19:23:31.669 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:23:31.669 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4252,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/2277605177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":2277605177},{"type":"v1","addr":"172.21.15.149:6837","nonce":2277605177}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/2774257644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2774257644},{"type":"v1","addr":"172.21.15.149:6836","nonce":2774257644}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/2076428669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":2076428669},{"type":"v1","addr":"172.21.15.160:6835","nonce":2076428669}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-08T19:23:01.918138+0000","modified":"2023-11-08T19:23:19.490960+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.160:6834/3847116435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3847116435},{"type":"v1","addr":"172.21.15.160:6834","nonce":3847116435}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-08T19:23:31.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.668+0000 7fc7b0660700 1 -- 172.21.15.149:0/1830097821 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc78c06af00 msgr2=0x7fc78c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:31.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.668+0000 7fc7b0660700 1 --2- 172.21.15.149:0/1830097821 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc78c06af00 0x7fc78c06d3c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc7a80d0180 tx=0x7fc7a4009040 comp rx=0 tx=0).stop 2023-11-08T19:23:31.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.668+0000 7fc7b0660700 1 -- 172.21.15.149:0/1830097821 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc7a80ce500 msgr2=0x7fc7a8158dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:31.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.668+0000 7fc7b0660700 1 --2- 172.21.15.149:0/1830097821 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc7a80ce500 0x7fc7a8158dc0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc798009c10 tx=0x7fc798004750 comp rx=0 tx=0).stop 2023-11-08T19:23:31.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.668+0000 7fc7b0660700 1 -- 172.21.15.149:0/1830097821 shutdown_connections 2023-11-08T19:23:31.672 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.668+0000 7fc7b0660700 1 --2- 172.21.15.149:0/1830097821 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc78c06af00 0x7fc78c06d3c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:31.672 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.668+0000 7fc7b0660700 1 --2- 172.21.15.149:0/1830097821 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc7a8161a50 0x7fc7a815abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:31.672 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.668+0000 7fc7b0660700 1 --2- 172.21.15.149:0/1830097821 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc7a80ce500 0x7fc7a8158dc0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:31.672 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.668+0000 7fc7b0660700 1 --2- 172.21.15.149:0/1830097821 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7a8161670 0x7fc7a815a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:31.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.668+0000 7fc7b0660700 1 -- 172.21.15.149:0/1830097821 >> 172.21.15.149:0/1830097821 conn(0x7fc7a80d3980 msgr2=0x7fc7a80cf200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:31.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.668+0000 7fc7b0660700 1 -- 172.21.15.149:0/1830097821 shutdown_connections 2023-11-08T19:23:31.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:31.668+0000 7fc7b0660700 1 -- 172.21.15.149:0/1830097821 wait complete. 2023-11-08T19:23:31.673 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 9 2023-11-08T19:23:32.085 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-08T19:23:01.918138+0000', 'modified': '2023-11-08T19:23:19.490960+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4264}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4264': {'gid': 4264, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.160:6834/3847116435', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6832', 'nonce': 3847116435}, {'type': 'v1', 'addr': '172.21.15.160:6834', 'nonce': 3847116435}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-08T19:23:32.085 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-08T19:23:32.086 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-11-08T19:23:32.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.208+0000 7fed1776f700 1 Processor -- start 2023-11-08T19:23:32.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.208+0000 7fed1776f700 1 -- start start 2023-11-08T19:23:32.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.209+0000 7fed1776f700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fed1006fe40 0x7fed1006f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:32.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.209+0000 7fed1776f700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fed100d2060 0x7fed1006c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:32.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.209+0000 7fed1776f700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed1006bd50 con 0x7fed1015dc30 2023-11-08T19:23:32.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.209+0000 7fed1776f700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed100d04b0 con 0x7fed100d2060 2023-11-08T19:23:32.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.209+0000 7fed1776f700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed100d0730 con 0x7fed1006fe40 2023-11-08T19:23:32.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.209+0000 7fed15d0c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fed100d2060 0x7fed1006c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:32.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.209+0000 7fed15d0c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fed100d2060 0x7fed1006c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37892/0 (socket says 172.21.15.149:37892) 2023-11-08T19:23:32.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.209+0000 7fed15d0c700 1 -- 172.21.15.149:0/4107810683 learned_addr learned my addr 172.21.15.149:0/4107810683 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:32.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.209+0000 7fed14d0a700 1 --2- 172.21.15.149:0/4107810683 >> v2:172.21.15.160:3300/0 conn(0x7fed1006fe40 0x7fed1006f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:32.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.209+0000 7fed15d0c700 1 -- 172.21.15.149:0/4107810683 >> v2:172.21.15.160:3300/0 conn(0x7fed1006fe40 msgr2=0x7fed1006f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:32.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.209+0000 7fed15d0c700 1 --2- 172.21.15.149:0/4107810683 >> v2:172.21.15.160:3300/0 conn(0x7fed1006fe40 0x7fed1006f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:32.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.209+0000 7fed15d0c700 1 -- 172.21.15.149:0/4107810683 >> v1:172.21.15.149:6789/0 conn(0x7fed1015dc30 legacy=0x7fed1006f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:32.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.209+0000 7fed15d0c700 1 -- 172.21.15.149:0/4107810683 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed100d0a10 con 0x7fed100d2060 2023-11-08T19:23:32.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.209+0000 7fed07fff700 1 -- 172.21.15.149:0/4107810683 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3214828796 0 0) 0x7fed1006bd50 con 0x7fed1015dc30 2023-11-08T19:23:32.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.209+0000 7fed15d0c700 1 --2- 172.21.15.149:0/4107810683 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed100d2060 0x7fed1006c1e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fed1006eb20 tx=0x7fed0800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94e6fc9b3e0afbbb server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:32.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.209+0000 7fed07fff700 1 -- 172.21.15.149:0/4107810683 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0800e070 con 0x7fed100d2060 2023-11-08T19:23:32.216 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.210+0000 7fed07fff700 1 -- 172.21.15.149:0/4107810683 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed0800b9c0 con 0x7fed100d2060 2023-11-08T19:23:32.216 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.210+0000 7fed07fff700 1 -- 172.21.15.149:0/4107810683 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0800bd70 con 0x7fed100d2060 2023-11-08T19:23:32.216 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.210+0000 7fed1776f700 1 -- 172.21.15.149:0/4107810683 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed100d2060 msgr2=0x7fed1006c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:32.216 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.210+0000 7fed1776f700 1 --2- 172.21.15.149:0/4107810683 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed100d2060 0x7fed1006c1e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fed1006eb20 tx=0x7fed0800b330 comp rx=0 tx=0).stop 2023-11-08T19:23:32.216 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.210+0000 7fed1776f700 1 -- 172.21.15.149:0/4107810683 shutdown_connections 2023-11-08T19:23:32.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.210+0000 7fed1776f700 1 --2- 172.21.15.149:0/4107810683 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed100d2060 0x7fed1006c1e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:32.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.210+0000 7fed1776f700 1 --2- 172.21.15.149:0/4107810683 >> v2:172.21.15.160:3300/0 conn(0x7fed1006fe40 0x7fed1006f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:32.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.210+0000 7fed1776f700 1 -- 172.21.15.149:0/4107810683 >> 172.21.15.149:0/4107810683 conn(0x7fed1008afd0 msgr2=0x7fed100d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:32.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.210+0000 7fed1776f700 1 -- 172.21.15.149:0/4107810683 shutdown_connections 2023-11-08T19:23:32.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.210+0000 7fed1776f700 1 -- 172.21.15.149:0/4107810683 wait complete. 2023-11-08T19:23:32.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.211+0000 7fed1776f700 1 Processor -- start 2023-11-08T19:23:32.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.211+0000 7fed1776f700 1 -- start start 2023-11-08T19:23:32.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.212+0000 7fed1776f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed1006fe40 0x7fed100cd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:32.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.212+0000 7fed1776f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fed100d2060 0x7fed10154a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:32.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.212+0000 7fed1776f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fed1015dc30 0x7fed100cb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:32.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.212+0000 7fed1776f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed100ccf40 con 0x7fed1006fe40 2023-11-08T19:23:32.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.212+0000 7fed1776f700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed10154f90 con 0x7fed1015dc30 2023-11-08T19:23:32.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.212+0000 7fed1776f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed100cc330 con 0x7fed100d2060 2023-11-08T19:23:32.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.212+0000 7fed1550b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed1006fe40 0x7fed100cd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:32.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.212+0000 7fed1550b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed1006fe40 0x7fed100cd3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37894/0 (socket says 172.21.15.149:37894) 2023-11-08T19:23:32.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.212+0000 7fed1550b700 1 -- 172.21.15.149:0/3483203909 learned_addr learned my addr 172.21.15.149:0/3483203909 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:32.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.212+0000 7fed15d0c700 1 --2- 172.21.15.149:0/3483203909 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fed1015dc30 0x7fed100cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:32.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.212+0000 7fed14d0a700 1 --2- 172.21.15.149:0/3483203909 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fed100d2060 0x7fed10154a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:32.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.212+0000 7fed1550b700 1 -- 172.21.15.149:0/3483203909 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fed100d2060 msgr2=0x7fed10154a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:32.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.212+0000 7fed1550b700 1 --2- 172.21.15.149:0/3483203909 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fed100d2060 0x7fed10154a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:32.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.212+0000 7fed1550b700 1 -- 172.21.15.149:0/3483203909 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fed1015dc30 msgr2=0x7fed100cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:32.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.212+0000 7fed1550b700 1 --2- 172.21.15.149:0/3483203909 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fed1015dc30 0x7fed100cb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:32.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.212+0000 7fed1550b700 1 -- 172.21.15.149:0/3483203909 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed08009b30 con 0x7fed1006fe40 2023-11-08T19:23:32.226 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.212+0000 7fed14d0a700 1 --2- 172.21.15.149:0/3483203909 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fed100d2060 0x7fed10154a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:23:32.226 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.213+0000 7fed1550b700 1 --2- 172.21.15.149:0/3483203909 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed1006fe40 0x7fed100cd3d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fed0c00c480 tx=0x7fed0c00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:32.226 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.213+0000 7fed05ffb700 1 -- 172.21.15.149:0/3483203909 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0c0054e0 con 0x7fed1006fe40 2023-11-08T19:23:32.226 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.213+0000 7fed05ffb700 1 -- 172.21.15.149:0/3483203909 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed0c003680 con 0x7fed1006fe40 2023-11-08T19:23:32.226 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.213+0000 7fed1776f700 1 -- 172.21.15.149:0/3483203909 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed100cc610 con 0x7fed1006fe40 2023-11-08T19:23:32.227 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.213+0000 7fed05ffb700 1 -- 172.21.15.149:0/3483203909 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0c003a30 con 0x7fed1006fe40 2023-11-08T19:23:32.227 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.213+0000 7fed1776f700 1 -- 172.21.15.149:0/3483203909 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed100ccbd0 con 0x7fed1006fe40 2023-11-08T19:23:32.227 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.214+0000 7fed05ffb700 1 -- 172.21.15.149:0/3483203909 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fed0c003b90 con 0x7fed1006fe40 2023-11-08T19:23:32.227 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.215+0000 7fed05ffb700 1 --2- 172.21.15.149:0/3483203909 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fecf406af30 0x7fecf406d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:32.227 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.215+0000 7fed05ffb700 1 -- 172.21.15.149:0/3483203909 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fed0c088d20 con 0x7fed1006fe40 2023-11-08T19:23:32.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.215+0000 7fed14d0a700 1 --2- 172.21.15.149:0/3483203909 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fecf406af30 0x7fecf406d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:32.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.215+0000 7fed14d0a700 1 --2- 172.21.15.149:0/3483203909 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fecf406af30 0x7fecf406d3f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fed00006fd0 tx=0x7fed00008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:32.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.217+0000 7fed23968b80 1 Processor -- start 2023-11-08T19:23:32.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.217+0000 7fed23968b80 1 -- start start 2023-11-08T19:23:32.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.218+0000 7fed23968b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c35dc626f0 0x55c35dc92450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:32.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.218+0000 7fed23968b80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c35dc64c30 0x55c35dc92990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:32.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.218+0000 7fed23968b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c35dc62ad0 0x55c35dc7cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:32.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.218+0000 7fed23968b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c35dbce6e0 con 0x55c35dc62ad0 2023-11-08T19:23:32.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.218+0000 7fed23968b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c35dbc23b0 con 0x55c35dc626f0 2023-11-08T19:23:32.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.218+0000 7fed23968b80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c35dbbfcd0 con 0x55c35dc64c30 2023-11-08T19:23:32.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.218+0000 7fed15d0c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c35dc62ad0 0x55c35dc7cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:32.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.218+0000 7fed15d0c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c35dc62ad0 0x55c35dc7cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37906/0 (socket says 172.21.15.149:37906) 2023-11-08T19:23:32.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.218+0000 7fed15d0c700 1 -- 172.21.15.149:0/1129572878 learned_addr learned my addr 172.21.15.149:0/1129572878 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:32.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.218+0000 7fed14d0a700 1 --2- 172.21.15.149:0/1129572878 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c35dc64c30 0x55c35dc92990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:32.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.218+0000 7fed1550b700 1 --2- 172.21.15.149:0/1129572878 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c35dc626f0 0x55c35dc92450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:32.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.218+0000 7fed15d0c700 1 -- 172.21.15.149:0/1129572878 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c35dc64c30 msgr2=0x55c35dc92990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:32.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.218+0000 7fed15d0c700 1 --2- 172.21.15.149:0/1129572878 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c35dc64c30 0x55c35dc92990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:32.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.218+0000 7fed15d0c700 1 -- 172.21.15.149:0/1129572878 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c35dc626f0 msgr2=0x55c35dc92450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:32.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.218+0000 7fed15d0c700 1 --2- 172.21.15.149:0/1129572878 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c35dc626f0 0x55c35dc92450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:32.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.218+0000 7fed15d0c700 1 -- 172.21.15.149:0/1129572878 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c35da385e0 con 0x55c35dc62ad0 2023-11-08T19:23:32.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.218+0000 7fed15d0c700 1 --2- 172.21.15.149:0/1129572878 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c35dc62ad0 0x55c35dc7cf90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fed1008bb60 tx=0x7fed08010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7e942cb869e3b29 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:32.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.218+0000 7fecfaffd700 1 -- 172.21.15.149:0/1129572878 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0800bd30 con 0x55c35dc62ad0 2023-11-08T19:23:32.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.218+0000 7fecfaffd700 1 -- 172.21.15.149:0/1129572878 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed08003a20 con 0x55c35dc62ad0 2023-11-08T19:23:32.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.218+0000 7fecfaffd700 1 -- 172.21.15.149:0/1129572878 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed08003db0 con 0x55c35dc62ad0 2023-11-08T19:23:32.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.219+0000 7fed23968b80 1 -- 172.21.15.149:0/1129572878 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c35dc62ad0 msgr2=0x55c35dc7cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:32.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.219+0000 7fed23968b80 1 --2- 172.21.15.149:0/1129572878 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c35dc62ad0 0x55c35dc7cf90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fed1008bb60 tx=0x7fed08010000 comp rx=0 tx=0).stop 2023-11-08T19:23:32.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.219+0000 7fed23968b80 1 -- 172.21.15.149:0/1129572878 shutdown_connections 2023-11-08T19:23:32.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.219+0000 7fed23968b80 1 --2- 172.21.15.149:0/1129572878 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c35dc626f0 0x55c35dc92450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:32.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.219+0000 7fed23968b80 1 --2- 172.21.15.149:0/1129572878 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c35dc62ad0 0x55c35dc7cf90 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:32.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.219+0000 7fed23968b80 1 --2- 172.21.15.149:0/1129572878 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c35dc64c30 0x55c35dc92990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:32.234 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.219+0000 7fed23968b80 1 -- 172.21.15.149:0/1129572878 >> 172.21.15.149:0/1129572878 conn(0x55c35dbdd660 msgr2=0x55c35dc683c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:32.234 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.219+0000 7fed23968b80 1 -- 172.21.15.149:0/1129572878 shutdown_connections 2023-11-08T19:23:32.234 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.219+0000 7fed23968b80 1 -- 172.21.15.149:0/1129572878 wait complete. 2023-11-08T19:23:32.234 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.220+0000 7fed23968b80 1 -- start start 2023-11-08T19:23:32.234 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.220+0000 7fed23968b80 1 Processor -- start 2023-11-08T19:23:32.238 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.221+0000 7fed23968b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c35dc626f0 0x55c35dc96070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:32.239 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.221+0000 7fed23968b80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c35dc62ad0 0x55c35dcbc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:32.239 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.221+0000 7fed23968b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c35dcaf710 0x55c35dc91700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:32.239 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.221+0000 7fed23968b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c35dbbb5c0 con 0x55c35dc626f0 2023-11-08T19:23:32.239 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.221+0000 7fed23968b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c35db570d0 con 0x55c35dcaf710 2023-11-08T19:23:32.239 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.221+0000 7fed23968b80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c35db56d70 con 0x55c35dc62ad0 2023-11-08T19:23:32.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.221+0000 7fed23968b80 10 client.0 _ll_register_callbacks cb 0x55c35d9b37b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-08T19:23:32.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.221+0000 7fed1550b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c35dc626f0 0x55c35dc96070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:32.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.221+0000 7fed1550b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c35dc626f0 0x55c35dc96070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37908/0 (socket says 172.21.15.149:37908) 2023-11-08T19:23:32.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.221+0000 7fed1550b700 1 -- 172.21.15.149:0/3963151982 learned_addr learned my addr 172.21.15.149:0/3963151982 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:32.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.221+0000 7fed14d0a700 1 --2- 172.21.15.149:0/3963151982 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c35dc62ad0 0x55c35dcbc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:32.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.221+0000 7fed15d0c700 1 --2- 172.21.15.149:0/3963151982 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c35dcaf710 0x55c35dc91700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:32.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.221+0000 7fed1550b700 1 -- 172.21.15.149:0/3963151982 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c35dc62ad0 msgr2=0x55c35dcbc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:32.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.221+0000 7fed1550b700 1 --2- 172.21.15.149:0/3963151982 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c35dc62ad0 0x55c35dcbc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:32.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.221+0000 7fed1550b700 1 -- 172.21.15.149:0/3963151982 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c35dcaf710 msgr2=0x55c35dc91700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:32.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.221+0000 7fed1550b700 1 --2- 172.21.15.149:0/3963151982 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c35dcaf710 0x55c35dc91700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:32.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.221+0000 7fed1550b700 1 -- 172.21.15.149:0/3963151982 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed100d0a10 con 0x55c35dc626f0 2023-11-08T19:23:32.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.221+0000 7fed1550b700 1 --2- 172.21.15.149:0/3963151982 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c35dc626f0 0x55c35dc96070 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fed0c00cfd0 tx=0x7fed0c057ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2322e0290104e61 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:32.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.221+0000 7feceffff700 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2023-11-08T19:23:32.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.221+0000 7feceffff700 1 -- 172.21.15.149:0/3963151982 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0c05f810 con 0x55c35dc626f0 2023-11-08T19:23:32.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.221+0000 7feceffff700 1 -- 172.21.15.149:0/3963151982 <== mon.0 v2:172.21.15.149:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fed0c05b8f0 con 0x55c35dc626f0 2023-11-08T19:23:32.243 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.221+0000 7fed23968b80 1 -- 172.21.15.149:0/3963151982 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c35dc5a880 con 0x55c35dc626f0 2023-11-08T19:23:32.243 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.222+0000 7feceffff700 1 -- 172.21.15.149:0/3963151982 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7fed0c05faa0 con 0x55c35dc626f0 2023-11-08T19:23:32.243 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.222+0000 7fed23968b80 10 client.4779 fetch_fsmap learned FSMap version 9 2023-11-08T19:23:32.243 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.222+0000 7fed23968b80 1 -- 172.21.15.149:0/3963151982 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55c35d9e4d90 con 0x55c35dc626f0 2023-11-08T19:23:32.244 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.222+0000 7feceffff700 1 -- 172.21.15.149:0/3963151982 <== mon.0 v2:172.21.15.149:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c35dc5a880 con 0x55c35dc626f0 2023-11-08T19:23:32.244 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.222+0000 7feceffff700 1 -- 172.21.15.149:0/3963151982 <== mon.0 v2:172.21.15.149:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7fed0c053590 con 0x55c35dc626f0 2023-11-08T19:23:32.244 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.222+0000 7fed23968b80 10 client.4779 fetch_fsmap finished waiting for FSMap version 9 2023-11-08T19:23:32.244 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.222+0000 7fed23968b80 10 client.4779 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-08T19:23:32.244 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.222+0000 7fed23968b80 20 client.4779 populate_metadata read hostname 'smithi149' 2023-11-08T19:23:32.245 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.222+0000 7fed23968b80 1 --2- 172.21.15.149:0/3963151982 >> [v2:172.21.15.160:6832/3847116435,v1:172.21.15.160:6834/3847116435] conn(0x55c35dc935f0 0x55c35dc939d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:32.245 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.222+0000 7fed23968b80 4 client.4779 mds_command: new command op to 4264 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-08T19:23:32.245 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.222+0000 7fed23968b80 1 -- 172.21.15.149:0/3963151982 --> [v2:172.21.15.160:6832/3847116435,v1:172.21.15.160:6834/3847116435] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c35dc36a30 con 0x55c35dc935f0 2023-11-08T19:23:32.245 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.222+0000 7fed14d0a700 1 --2- 172.21.15.149:0/3963151982 >> [v2:172.21.15.160:6832/3847116435,v1:172.21.15.160:6834/3847116435] conn(0x55c35dc935f0 0x55c35dc939d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:32.245 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.222+0000 7feceffff700 10 client.4779 ms_handle_connect on v2:172.21.15.160:6832/3847116435 2023-11-08T19:23:32.246 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.222+0000 7fed14d0a700 1 --2- 172.21.15.149:0/3963151982 >> [v2:172.21.15.160:6832/3847116435,v1:172.21.15.160:6834/3847116435] conn(0x55c35dc935f0 0x55c35dc939d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ed4f4282281178d server_cookie=cc21eeb55ef942d8 in_seq=0 out_seq=0 2023-11-08T19:23:32.246 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.223+0000 7feceffff700 1 -- 172.21.15.149:0/3963151982 <== mds.0 v2:172.21.15.160:6832/3847116435 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c35dc36a30 con 0x55c35dc935f0 2023-11-08T19:23:32.246 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.223+0000 7feceffff700 10 client.4779 handle_command_reply: tid=0 2023-11-08T19:23:32.246 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.223+0000 7fed23968b80 1 client.4779 shutdown 2023-11-08T19:23:32.246 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.223+0000 7fed23968b80 1 -- 172.21.15.149:0/3963151982 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c35dc626f0 msgr2=0x55c35dc96070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:32.247 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.223+0000 7fed23968b80 1 --2- 172.21.15.149:0/3963151982 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c35dc626f0 0x55c35dc96070 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fed0c00cfd0 tx=0x7fed0c057ce0 comp rx=0 tx=0).stop 2023-11-08T19:23:32.247 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.223+0000 7fed23968b80 1 -- 172.21.15.149:0/3963151982 shutdown_connections 2023-11-08T19:23:32.247 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.223+0000 7fed23968b80 1 --2- 172.21.15.149:0/3963151982 >> [v2:172.21.15.160:6832/3847116435,v1:172.21.15.160:6834/3847116435] conn(0x55c35dc935f0 0x55c35dc939d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:32.247 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.223+0000 7fed23968b80 1 --2- 172.21.15.149:0/3963151982 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c35dcaf710 0x55c35dc91700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:32.247 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.223+0000 7fed23968b80 1 --2- 172.21.15.149:0/3963151982 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c35dc626f0 0x55c35dc96070 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:32.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.223+0000 7feceffff700 0 client.4779 ms_handle_reset on v2:172.21.15.160:6832/3847116435 2023-11-08T19:23:32.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.223+0000 7fed23968b80 1 --2- 172.21.15.149:0/3963151982 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c35dc62ad0 0x55c35dcbc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:32.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.223+0000 7fed23968b80 1 -- 172.21.15.149:0/3963151982 >> 172.21.15.149:0/3963151982 conn(0x55c35dbdd660 msgr2=0x55c35dc658a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:32.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.223+0000 7fed23968b80 1 -- 172.21.15.149:0/3963151982 shutdown_connections 2023-11-08T19:23:32.249 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.223+0000 7fed23968b80 1 -- 172.21.15.149:0/3963151982 wait complete. 2023-11-08T19:23:32.249 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.223+0000 7fed23968b80 20 client.4779 trim_cache size 0 max 16384 2023-11-08T19:23:32.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.241+0000 7fed23968b80 1 Processor -- start 2023-11-08T19:23:32.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.241+0000 7fed23968b80 1 -- start start 2023-11-08T19:23:32.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.242+0000 7fed23968b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c35dc626f0 0x55c35dcaf1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:32.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.242+0000 7fed23968b80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c35dc62ad0 0x55c35dc7dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:32.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.242+0000 7fed23968b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c35dcaf710 0x55c35dca7160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:32.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.242+0000 7fed23968b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c35da3a8d0 con 0x55c35dc626f0 2023-11-08T19:23:32.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.242+0000 7fed23968b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c35dc8fd70 con 0x55c35dcaf710 2023-11-08T19:23:32.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.242+0000 7fed23968b80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c35dccfc90 con 0x55c35dc62ad0 2023-11-08T19:23:32.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.242+0000 7fed1550b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c35dc626f0 0x55c35dcaf1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:32.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.242+0000 7fed1550b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c35dc626f0 0x55c35dcaf1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37920/0 (socket says 172.21.15.149:37920) 2023-11-08T19:23:32.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.242+0000 7fed1550b700 1 -- 172.21.15.149:0/2576401985 learned_addr learned my addr 172.21.15.149:0/2576401985 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:32.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.242+0000 7fed15d0c700 1 --2- 172.21.15.149:0/2576401985 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c35dcaf710 0x55c35dca7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:32.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.243+0000 7fed14d0a700 1 --2- 172.21.15.149:0/2576401985 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c35dc62ad0 0x55c35dc7dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:32.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.243+0000 7fed1550b700 1 -- 172.21.15.149:0/2576401985 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c35dc62ad0 msgr2=0x55c35dc7dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:32.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.243+0000 7fed1550b700 1 --2- 172.21.15.149:0/2576401985 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c35dc62ad0 0x55c35dc7dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:32.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.243+0000 7fed1550b700 1 -- 172.21.15.149:0/2576401985 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c35dcaf710 msgr2=0x55c35dca7160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:32.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.243+0000 7fed1550b700 1 --2- 172.21.15.149:0/2576401985 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c35dcaf710 0x55c35dca7160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:32.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.243+0000 7fed1550b700 1 -- 172.21.15.149:0/2576401985 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c35d9cdc10 con 0x55c35dc626f0 2023-11-08T19:23:32.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.243+0000 7fed15d0c700 1 --2- 172.21.15.149:0/2576401985 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c35dcaf710 0x55c35dca7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:23:32.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.243+0000 7fed1550b700 1 --2- 172.21.15.149:0/2576401985 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c35dc626f0 0x55c35dcaf1a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fed0c053ca0 tx=0x7fed0c059000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=981ddd4640df7175 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:32.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.243+0000 7fecfb7fe700 1 -- 172.21.15.149:0/2576401985 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0c057100 con 0x55c35dc626f0 2023-11-08T19:23:32.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.243+0000 7fecfb7fe700 1 -- 172.21.15.149:0/2576401985 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed0c0572e0 con 0x55c35dc626f0 2023-11-08T19:23:32.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.243+0000 7fecfb7fe700 1 -- 172.21.15.149:0/2576401985 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0c05b8f0 con 0x55c35dc626f0 2023-11-08T19:23:32.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.243+0000 7fed23968b80 1 -- 172.21.15.149:0/2576401985 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c35dc626f0 msgr2=0x55c35dcaf1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:32.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.243+0000 7fed23968b80 1 --2- 172.21.15.149:0/2576401985 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c35dc626f0 0x55c35dcaf1a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fed0c053ca0 tx=0x7fed0c059000 comp rx=0 tx=0).stop 2023-11-08T19:23:32.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.244+0000 7fed23968b80 1 -- 172.21.15.149:0/2576401985 shutdown_connections 2023-11-08T19:23:32.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.244+0000 7fed23968b80 1 --2- 172.21.15.149:0/2576401985 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c35dcaf710 0x55c35dca7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:32.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.244+0000 7fed23968b80 1 --2- 172.21.15.149:0/2576401985 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c35dc626f0 0x55c35dcaf1a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:32.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.244+0000 7fed23968b80 1 --2- 172.21.15.149:0/2576401985 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c35dc62ad0 0x55c35dc7dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:32.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.244+0000 7fed23968b80 1 -- 172.21.15.149:0/2576401985 >> 172.21.15.149:0/2576401985 conn(0x55c35dbdd660 msgr2=0x55c35dc5e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:32.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.244+0000 7fed23968b80 1 -- 172.21.15.149:0/2576401985 shutdown_connections 2023-11-08T19:23:32.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.244+0000 7fed23968b80 1 -- 172.21.15.149:0/2576401985 wait complete. 2023-11-08T19:23:32.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.244+0000 7fed23968b80 1 -- start start 2023-11-08T19:23:32.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.244+0000 7fed23968b80 1 Processor -- start 2023-11-08T19:23:32.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.245+0000 7fed23968b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c35dc626f0 0x55c35dca2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:32.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.245+0000 7fed23968b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c35dc62ad0 0x55c35dca3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:32.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.245+0000 7fed23968b80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c35dcaf710 0x55c35dd174c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:32.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.245+0000 7fed23968b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c35dd187e0 con 0x55c35dc626f0 2023-11-08T19:23:32.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.245+0000 7fed23968b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c35dca4430 con 0x55c35dc62ad0 2023-11-08T19:23:32.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.245+0000 7fed23968b80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c35dc92c10 con 0x55c35dcaf710 2023-11-08T19:23:32.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.245+0000 7fed23968b80 10 client.0 _ll_register_callbacks cb 0x7fed0c003e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-08T19:23:32.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.245+0000 7fed1550b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c35dc626f0 0x55c35dca2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:32.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.245+0000 7fed1550b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c35dc626f0 0x55c35dca2de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37922/0 (socket says 172.21.15.149:37922) 2023-11-08T19:23:32.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.245+0000 7fed1550b700 1 -- 172.21.15.149:0/1917479560 learned_addr learned my addr 172.21.15.149:0/1917479560 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:32.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.246+0000 7fed15d0c700 1 --2- 172.21.15.149:0/1917479560 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c35dcaf710 0x55c35dd174c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:32.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.246+0000 7fed14d0a700 1 --2- 172.21.15.149:0/1917479560 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c35dc62ad0 0x55c35dca3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:32.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.246+0000 7fed1550b700 1 -- 172.21.15.149:0/1917479560 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c35dcaf710 msgr2=0x55c35dd174c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:32.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.246+0000 7fed1550b700 1 --2- 172.21.15.149:0/1917479560 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c35dcaf710 0x55c35dd174c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:32.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.246+0000 7fed1550b700 1 -- 172.21.15.149:0/1917479560 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c35dc62ad0 msgr2=0x55c35dca3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:32.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.246+0000 7fed1550b700 1 --2- 172.21.15.149:0/1917479560 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c35dc62ad0 0x55c35dca3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:32.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.246+0000 7fed1550b700 1 -- 172.21.15.149:0/1917479560 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c35d9e4d90 con 0x55c35dc626f0 2023-11-08T19:23:32.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.246+0000 7fed15d0c700 1 --2- 172.21.15.149:0/1917479560 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c35dcaf710 0x55c35dd174c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:23:32.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.246+0000 7fed14d0a700 1 --2- 172.21.15.149:0/1917479560 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c35dc62ad0 0x55c35dca3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:23:32.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.246+0000 7fed1550b700 1 --2- 172.21.15.149:0/1917479560 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c35dc626f0 0x55c35dca2de0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fed0c057450 tx=0x7fed0c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eed0939843d53909 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:32.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.246+0000 7feceffff700 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2023-11-08T19:23:32.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.246+0000 7feceffff700 1 -- 172.21.15.149:0/1917479560 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0c057100 con 0x55c35dc626f0 2023-11-08T19:23:32.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.246+0000 7feceffff700 1 -- 172.21.15.149:0/1917479560 <== mon.0 v2:172.21.15.149:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fed0c05faa0 con 0x55c35dc626f0 2023-11-08T19:23:32.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.246+0000 7fed23968b80 1 -- 172.21.15.149:0/1917479560 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fed08003a20 con 0x55c35dc626f0 2023-11-08T19:23:32.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.246+0000 7feceffff700 1 -- 172.21.15.149:0/1917479560 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7fed0c05b8f0 con 0x55c35dc626f0 2023-11-08T19:23:32.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.246+0000 7fed23968b80 10 client.4785 fetch_fsmap learned FSMap version 9 2023-11-08T19:23:32.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.246+0000 7fed23968b80 1 -- 172.21.15.149:0/1917479560 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55c35da0b200 con 0x55c35dc626f0 2023-11-08T19:23:32.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.246+0000 7feceffff700 1 -- 172.21.15.149:0/1917479560 <== mon.0 v2:172.21.15.149:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed08003a20 con 0x55c35dc626f0 2023-11-08T19:23:32.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.246+0000 7feceffff700 1 -- 172.21.15.149:0/1917479560 <== mon.0 v2:172.21.15.149:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7fed0c07c030 con 0x55c35dc626f0 2023-11-08T19:23:32.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.246+0000 7fed23968b80 10 client.4785 fetch_fsmap finished waiting for FSMap version 9 2023-11-08T19:23:32.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.246+0000 7fed23968b80 10 client.4785 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-08T19:23:32.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.246+0000 7fed23968b80 20 client.4785 populate_metadata read hostname 'smithi149' 2023-11-08T19:23:32.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.246+0000 7fed23968b80 1 --2- 172.21.15.149:0/1917479560 >> [v2:172.21.15.160:6832/3847116435,v1:172.21.15.160:6834/3847116435] conn(0x55c35dca59a0 0x55c35dd17a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:32.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.246+0000 7fed23968b80 4 client.4785 mds_command: new command op to 4264 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-08T19:23:32.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.246+0000 7fed23968b80 1 -- 172.21.15.149:0/1917479560 --> [v2:172.21.15.160:6832/3847116435,v1:172.21.15.160:6834/3847116435] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c35dbb45a0 con 0x55c35dca59a0 2023-11-08T19:23:32.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.247+0000 7fed14d0a700 1 --2- 172.21.15.149:0/1917479560 >> [v2:172.21.15.160:6832/3847116435,v1:172.21.15.160:6834/3847116435] conn(0x55c35dca59a0 0x55c35dd17a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:32.270 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.247+0000 7feceffff700 10 client.4785 ms_handle_connect on v2:172.21.15.160:6832/3847116435 2023-11-08T19:23:32.270 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.247+0000 7fed14d0a700 1 --2- 172.21.15.149:0/1917479560 >> [v2:172.21.15.160:6832/3847116435,v1:172.21.15.160:6834/3847116435] conn(0x55c35dca59a0 0x55c35dd17a00 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2122934d455fa08b server_cookie=c6b889485f9ae323 in_seq=0 out_seq=0 2023-11-08T19:23:32.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.247+0000 7feceffff700 1 -- 172.21.15.149:0/1917479560 <== mds.0 v2:172.21.15.160:6832/3847116435 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55c35dbb45a0 con 0x55c35dca59a0 2023-11-08T19:23:32.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.247+0000 7feceffff700 10 client.4785 handle_command_reply: tid=0 2023-11-08T19:23:32.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.247+0000 7fed23968b80 1 client.4785 shutdown 2023-11-08T19:23:32.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.247+0000 7fed23968b80 1 -- 172.21.15.149:0/1917479560 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c35dc626f0 msgr2=0x55c35dca2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:32.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.247+0000 7fed23968b80 1 --2- 172.21.15.149:0/1917479560 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c35dc626f0 0x55c35dca2de0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fed0c057450 tx=0x7fed0c000ed0 comp rx=0 tx=0).stop 2023-11-08T19:23:32.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.247+0000 7fed23968b80 1 -- 172.21.15.149:0/1917479560 shutdown_connections 2023-11-08T19:23:32.273 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.247+0000 7fed23968b80 1 --2- 172.21.15.149:0/1917479560 >> [v2:172.21.15.160:6832/3847116435,v1:172.21.15.160:6834/3847116435] conn(0x55c35dca59a0 0x55c35dd17a00 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:32.273 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.247+0000 7fed23968b80 1 --2- 172.21.15.149:0/1917479560 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c35dcaf710 0x55c35dd174c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:32.273 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.247+0000 7fed23968b80 1 --2- 172.21.15.149:0/1917479560 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c35dc626f0 0x55c35dca2de0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:32.274 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.247+0000 7feceffff700 0 client.4785 ms_handle_reset on v2:172.21.15.160:6832/3847116435 2023-11-08T19:23:32.274 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.247+0000 7fed23968b80 1 --2- 172.21.15.149:0/1917479560 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c35dc62ad0 0x55c35dca3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:32.274 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.247+0000 7fed23968b80 1 -- 172.21.15.149:0/1917479560 >> 172.21.15.149:0/1917479560 conn(0x55c35dbdd660 msgr2=0x55c35dc5e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:32.275 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.247+0000 7fed23968b80 1 -- 172.21.15.149:0/1917479560 shutdown_connections 2023-11-08T19:23:32.275 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.247+0000 7fed23968b80 1 -- 172.21.15.149:0/1917479560 wait complete. 2023-11-08T19:23:32.276 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.247+0000 7fed23968b80 20 client.4785 trim_cache size 0 max 16384 2023-11-08T19:23:32.276 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2023-11-08T19:23:32.277 INFO:teuthology.orchestra.run.smithi149.stdout: "cluster_fsid": "0aba7c70-fe80-4446-a2f5-7502ac3adfb4", 2023-11-08T19:23:32.277 INFO:teuthology.orchestra.run.smithi149.stdout: "whoami": 0, 2023-11-08T19:23:32.277 INFO:teuthology.orchestra.run.smithi149.stdout: "id": 4264, 2023-11-08T19:23:32.278 INFO:teuthology.orchestra.run.smithi149.stdout: "want_state": "up:active", 2023-11-08T19:23:32.278 INFO:teuthology.orchestra.run.smithi149.stdout: "state": "up:active", 2023-11-08T19:23:32.278 INFO:teuthology.orchestra.run.smithi149.stdout: "fs_name": "cephfs", 2023-11-08T19:23:32.278 INFO:teuthology.orchestra.run.smithi149.stdout: "rank_uptime": 29.712298456999999, 2023-11-08T19:23:32.278 INFO:teuthology.orchestra.run.smithi149.stdout: "mdsmap_epoch": 9, 2023-11-08T19:23:32.279 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_epoch": 24, 2023-11-08T19:23:32.279 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_epoch_barrier": 24, 2023-11-08T19:23:32.279 INFO:teuthology.orchestra.run.smithi149.stdout: "uptime": 36.892622732 2023-11-08T19:23:32.279 INFO:teuthology.orchestra.run.smithi149.stdout:} 2023-11-08T19:23:32.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.248+0000 7fed1776f700 1 -- 172.21.15.149:0/3483203909 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fecf406af30 msgr2=0x7fecf406d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:32.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.248+0000 7fed1776f700 1 --2- 172.21.15.149:0/3483203909 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fecf406af30 0x7fecf406d3f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fed00006fd0 tx=0x7fed00008040 comp rx=0 tx=0).stop 2023-11-08T19:23:32.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.248+0000 7fed1776f700 1 -- 172.21.15.149:0/3483203909 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed1006fe40 msgr2=0x7fed100cd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:32.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.248+0000 7fed1776f700 1 --2- 172.21.15.149:0/3483203909 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed1006fe40 0x7fed100cd3d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fed0c00c480 tx=0x7fed0c00c840 comp rx=0 tx=0).stop 2023-11-08T19:23:32.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.248+0000 7fed1776f700 1 -- 172.21.15.149:0/3483203909 shutdown_connections 2023-11-08T19:23:32.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.248+0000 7fed1776f700 1 --2- 172.21.15.149:0/3483203909 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fecf406af30 0x7fecf406d3f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:32.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.248+0000 7fed1776f700 1 --2- 172.21.15.149:0/3483203909 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fed1015dc30 0x7fed100cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:32.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.248+0000 7fed1776f700 1 --2- 172.21.15.149:0/3483203909 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed1006fe40 0x7fed100cd3d0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:32.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.248+0000 7fed1776f700 1 --2- 172.21.15.149:0/3483203909 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fed100d2060 0x7fed10154a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:32.283 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.248+0000 7fed1776f700 1 -- 172.21.15.149:0/3483203909 >> 172.21.15.149:0/3483203909 conn(0x7fed1008afd0 msgr2=0x7fed100aeed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:32.283 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.248+0000 7fed1776f700 1 -- 172.21.15.149:0/3483203909 shutdown_connections 2023-11-08T19:23:32.283 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.248+0000 7fed1776f700 1 -- 172.21.15.149:0/3483203909 wait complete. 2023-11-08T19:23:32.284 INFO:teuthology.run_tasks:Running task kclient... 2023-11-08T19:23:32.297 INFO:tasks.kclient:Mounting kernel clients... 2023-11-08T19:23:32.297 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-11-08T19:23:32.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:32.298 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2023-11-08T19:23:32.315 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-11-08T19:23:32.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:32.316 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-08T19:23:32.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:32.392 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link delete ceph-brx 2023-11-08T19:23:32.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:32.508 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2023-11-08T19:23:32.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:32.526 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link delete ceph-brx 2023-11-08T19:23:32.595 INFO:teuthology.orchestra.run.smithi149.stderr:Cannot find device "ceph-brx" 2023-11-08T19:23:32.596 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-08T19:23:32.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:32.597 DEBUG:teuthology.orchestra.run.smithi160:> ip netns list 2023-11-08T19:23:32.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:32.620 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip link delete ceph-brx 2023-11-08T19:23:32.695 INFO:teuthology.orchestra.run.smithi160.stderr:Cannot find device "ceph-brx" 2023-11-08T19:23:32.696 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-08T19:23:32.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:32.697 DEBUG:teuthology.orchestra.run.smithi160:> ip netns list 2023-11-08T19:23:32.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:32.757 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip link delete ceph-brx 2023-11-08T19:23:32.827 INFO:teuthology.orchestra.run.smithi160.stderr:Cannot find device "ceph-brx" 2023-11-08T19:23:32.828 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-08T19:23:32.828 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-11-08T19:23:32.829 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-08T19:23:32.829 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-08T19:23:32.830 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-08T19:23:32.952 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.949+0000 7f2cc57b6700 1 Processor -- start 2023-11-08T19:23:32.952 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.949+0000 7f2cc57b6700 1 -- start start 2023-11-08T19:23:32.954 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.950+0000 7f2cc57b6700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2cc006cde0 0x7f2cc006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:32.955 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.950+0000 7f2cc57b6700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2cc00c9a90 0x7f2cc00c9f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:32.955 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.950+0000 7f2cc57b6700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cc006d700 con 0x7f2cc0071610 2023-11-08T19:23:32.955 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.950+0000 7f2cc57b6700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cc0072830 con 0x7f2cc006cde0 2023-11-08T19:23:32.955 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.950+0000 7f2cc57b6700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc00b1d70 con 0x7f2cc00c9a90 2023-11-08T19:23:32.955 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.950+0000 7f2cbeffd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2cc006cde0 0x7f2cc006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:32.956 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.950+0000 7f2cbeffd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2cc006cde0 0x7f2cc006d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37930/0 (socket says 172.21.15.149:37930) 2023-11-08T19:23:32.956 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.950+0000 7f2cbe7fc700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f2cc0071610 0x7f2cc015add0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:39932/0 (socket says 172.21.15.149:39932) 2023-11-08T19:23:32.956 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.950+0000 7f2cbeffd700 1 -- 172.21.15.149:0/1786672393 learned_addr learned my addr 172.21.15.149:0/1786672393 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:32.956 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.951+0000 7f2cbf7fe700 1 --2- 172.21.15.149:0/1786672393 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2cc00c9a90 0x7f2cc00c9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:32.956 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.951+0000 7f2cbeffd700 1 -- 172.21.15.149:0/1786672393 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2cc00c9a90 msgr2=0x7f2cc00c9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:32.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.951+0000 7f2cbeffd700 1 --2- 172.21.15.149:0/1786672393 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2cc00c9a90 0x7f2cc00c9f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:32.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.951+0000 7f2cbeffd700 1 -- 172.21.15.149:0/1786672393 >> v1:172.21.15.149:6789/0 conn(0x7f2cc0071610 legacy=0x7f2cc015add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:32.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.951+0000 7f2cbeffd700 1 -- 172.21.15.149:0/1786672393 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc0071bb0 con 0x7f2cc006cde0 2023-11-08T19:23:32.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.951+0000 7f2cbeffd700 1 --2- 172.21.15.149:0/1786672393 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2cc006cde0 0x7f2cc006d1c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2cb400aa90 tx=0x7f2cb400ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51b2603be4cfdfbe server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:32.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.951+0000 7f2cbdffb700 1 -- 172.21.15.149:0/1786672393 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb400cb70 con 0x7f2cc006cde0 2023-11-08T19:23:32.958 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.951+0000 7f2cbdffb700 1 -- 172.21.15.149:0/1786672393 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cb400ccd0 con 0x7f2cc006cde0 2023-11-08T19:23:32.958 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.951+0000 7f2cbdffb700 1 -- 172.21.15.149:0/1786672393 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb4018620 con 0x7f2cc006cde0 2023-11-08T19:23:32.958 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.952+0000 7f2cc57b6700 1 -- 172.21.15.149:0/1786672393 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2cc006cde0 msgr2=0x7f2cc006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:32.958 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.952+0000 7f2cc57b6700 1 --2- 172.21.15.149:0/1786672393 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2cc006cde0 0x7f2cc006d1c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2cb400aa90 tx=0x7f2cb400ada0 comp rx=0 tx=0).stop 2023-11-08T19:23:32.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.952+0000 7f2cc57b6700 1 -- 172.21.15.149:0/1786672393 shutdown_connections 2023-11-08T19:23:32.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.952+0000 7f2cc57b6700 1 --2- 172.21.15.149:0/1786672393 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2cc00c9a90 0x7f2cc00c9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:32.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.952+0000 7f2cc57b6700 1 --2- 172.21.15.149:0/1786672393 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2cc006cde0 0x7f2cc006d1c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:32.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.952+0000 7f2cc57b6700 1 -- 172.21.15.149:0/1786672393 >> 172.21.15.149:0/1786672393 conn(0x7f2cc006b3d0 msgr2=0x7f2cc00cf460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:32.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.952+0000 7f2cc57b6700 1 -- 172.21.15.149:0/1786672393 shutdown_connections 2023-11-08T19:23:32.960 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.952+0000 7f2cc57b6700 1 -- 172.21.15.149:0/1786672393 wait complete. 2023-11-08T19:23:32.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.953+0000 7f2cc57b6700 1 Processor -- start 2023-11-08T19:23:32.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.953+0000 7f2cc57b6700 1 -- start start 2023-11-08T19:23:32.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.954+0000 7f2cc57b6700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2cc006cde0 0x7f2cc0150770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:32.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.954+0000 7f2cc57b6700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2cc0071610 0x7f2cc00c64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:32.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.954+0000 7f2cc57b6700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2cc00c9a90 0x7f2cc00ca430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:32.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.954+0000 7f2cc57b6700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc00c7a70 con 0x7f2cc00c9a90 2023-11-08T19:23:32.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.954+0000 7f2cc57b6700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc00c6ef0 con 0x7f2cc0071610 2023-11-08T19:23:32.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.954+0000 7f2cc57b6700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc00c71d0 con 0x7f2cc006cde0 2023-11-08T19:23:32.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.954+0000 7f2cbf7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2cc00c9a90 0x7f2cc00ca430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:32.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.954+0000 7f2cbf7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2cc00c9a90 0x7f2cc00ca430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37940/0 (socket says 172.21.15.149:37940) 2023-11-08T19:23:32.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.954+0000 7f2cbf7fe700 1 -- 172.21.15.149:0/3990191029 learned_addr learned my addr 172.21.15.149:0/3990191029 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:32.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.954+0000 7f2cbeffd700 1 --2- 172.21.15.149:0/3990191029 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2cc006cde0 0x7f2cc0150770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:32.965 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.954+0000 7f2cbe7fc700 1 --2- 172.21.15.149:0/3990191029 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2cc0071610 0x7f2cc00c64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:32.965 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.954+0000 7f2cbf7fe700 1 -- 172.21.15.149:0/3990191029 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2cc006cde0 msgr2=0x7f2cc0150770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:32.965 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.954+0000 7f2cbf7fe700 1 --2- 172.21.15.149:0/3990191029 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2cc006cde0 0x7f2cc0150770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:32.965 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.954+0000 7f2cbf7fe700 1 -- 172.21.15.149:0/3990191029 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2cc0071610 msgr2=0x7f2cc00c64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:32.965 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.954+0000 7f2cbf7fe700 1 --2- 172.21.15.149:0/3990191029 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2cc0071610 0x7f2cc00c64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:32.966 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.954+0000 7f2cbf7fe700 1 -- 172.21.15.149:0/3990191029 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb400a6f0 con 0x7f2cc00c9a90 2023-11-08T19:23:32.966 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.954+0000 7f2cbeffd700 1 --2- 172.21.15.149:0/3990191029 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2cc006cde0 0x7f2cc0150770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:23:32.966 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.954+0000 7f2cbf7fe700 1 --2- 172.21.15.149:0/3990191029 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2cc00c9a90 0x7f2cc00ca430 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2cb8007e60 tx=0x7f2cb800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:32.966 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.954+0000 7f2ca77fe700 1 -- 172.21.15.149:0/3990191029 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb800ede0 con 0x7f2cc00c9a90 2023-11-08T19:23:32.966 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.954+0000 7f2ca77fe700 1 -- 172.21.15.149:0/3990191029 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cb8014420 con 0x7f2cc00c9a90 2023-11-08T19:23:32.967 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.954+0000 7f2cc57b6700 1 -- 172.21.15.149:0/3990191029 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cc00c74b0 con 0x7f2cc00c9a90 2023-11-08T19:23:32.967 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.955+0000 7f2ca77fe700 1 -- 172.21.15.149:0/3990191029 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb80147d0 con 0x7f2cc00c9a90 2023-11-08T19:23:32.967 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.955+0000 7f2cc57b6700 1 -- 172.21.15.149:0/3990191029 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cc015ced0 con 0x7f2cc00c9a90 2023-11-08T19:23:32.967 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.955+0000 7f2cc57b6700 1 -- 172.21.15.149:0/3990191029 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cc00745f0 con 0x7f2cc00c9a90 2023-11-08T19:23:32.967 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.956+0000 7f2ca77fe700 1 -- 172.21.15.149:0/3990191029 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2cb8014930 con 0x7f2cc00c9a90 2023-11-08T19:23:32.968 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.956+0000 7f2ca77fe700 1 --2- 172.21.15.149:0/3990191029 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2cac06af00 0x7f2cac06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:32.968 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.956+0000 7f2cbeffd700 1 --2- 172.21.15.149:0/3990191029 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2cac06af00 0x7f2cac06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:32.968 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.956+0000 7f2ca77fe700 1 -- 172.21.15.149:0/3990191029 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2cb808a020 con 0x7f2cc00c9a90 2023-11-08T19:23:32.968 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.957+0000 7f2cbeffd700 1 --2- 172.21.15.149:0/3990191029 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2cac06af00 0x7f2cac06d3c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2cb4000c00 tx=0x7f2cb4012000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:32.969 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:32.961+0000 7f2ca77fe700 1 -- 172.21.15.149:0/3990191029 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2cb8054de0 con 0x7f2cc00c9a90 2023-11-08T19:23:33.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:33.197+0000 7f2cc57b6700 1 -- 172.21.15.149:0/3990191029 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2cc015e450 con 0x7f2cc00c9a90 2023-11-08T19:23:33.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:33.197+0000 7f2ca77fe700 1 -- 172.21.15.149:0/3990191029 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f2cb8058400 con 0x7f2cc00c9a90 2023-11-08T19:23:33.200 INFO:teuthology.orchestra.run.smithi149.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-08T19:23:33.202 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:33.199+0000 7f2cc57b6700 1 -- 172.21.15.149:0/3990191029 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2cac06af00 msgr2=0x7f2cac06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:33.202 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:33.199+0000 7f2cc57b6700 1 --2- 172.21.15.149:0/3990191029 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2cac06af00 0x7f2cac06d3c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2cb4000c00 tx=0x7f2cb4012000 comp rx=0 tx=0).stop 2023-11-08T19:23:33.202 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:33.199+0000 7f2cc57b6700 1 -- 172.21.15.149:0/3990191029 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2cc00c9a90 msgr2=0x7f2cc00ca430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:33.202 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:33.199+0000 7f2cc57b6700 1 --2- 172.21.15.149:0/3990191029 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2cc00c9a90 0x7f2cc00ca430 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2cb8007e60 tx=0x7f2cb800e3c0 comp rx=0 tx=0).stop 2023-11-08T19:23:33.203 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:33.199+0000 7f2cc57b6700 1 -- 172.21.15.149:0/3990191029 shutdown_connections 2023-11-08T19:23:33.203 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:33.199+0000 7f2cc57b6700 1 --2- 172.21.15.149:0/3990191029 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2cac06af00 0x7f2cac06d3c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:33.203 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:33.199+0000 7f2cc57b6700 1 --2- 172.21.15.149:0/3990191029 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2cc00c9a90 0x7f2cc00ca430 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:33.203 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:33.199+0000 7f2cc57b6700 1 --2- 172.21.15.149:0/3990191029 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2cc006cde0 0x7f2cc0150770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:33.203 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:33.199+0000 7f2cc57b6700 1 --2- 172.21.15.149:0/3990191029 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2cc0071610 0x7f2cc00c64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:33.204 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:33.199+0000 7f2cc57b6700 1 -- 172.21.15.149:0/3990191029 >> 172.21.15.149:0/3990191029 conn(0x7f2cc006b3d0 msgr2=0x7f2cc00ccfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:33.204 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:33.200+0000 7f2cc57b6700 1 -- 172.21.15.149:0/3990191029 shutdown_connections 2023-11-08T19:23:33.204 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:33.200+0000 7f2cc57b6700 1 -- 172.21.15.149:0/3990191029 wait complete. 2023-11-08T19:23:33.214 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-08T19:23:33.214 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-08T19:23:33.215 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi149.front.sepia.ceph.com 2023-11-08T19:23:33.215 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-08T19:23:33.215 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-08T19:23:33.215 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-08T19:23:33.216 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-08T19:23:33.216 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-08T19:23:33.216 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-08T19:23:33.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:33.217 DEBUG:teuthology.orchestra.run.smithi149:> ip addr 2023-11-08T19:23:33.233 INFO:teuthology.orchestra.run.smithi149.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-08T19:23:33.234 INFO:teuthology.orchestra.run.smithi149.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-08T19:23:33.234 INFO:teuthology.orchestra.run.smithi149.stdout: inet 127.0.0.1/8 scope host lo 2023-11-08T19:23:33.234 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:23:33.234 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 ::1/128 scope host 2023-11-08T19:23:33.235 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:23:33.235 INFO:teuthology.orchestra.run.smithi149.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-08T19:23:33.235 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a4 brd ff:ff:ff:ff:ff:ff 2023-11-08T19:23:33.235 INFO:teuthology.orchestra.run.smithi149.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-08T19:23:33.235 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a5 brd ff:ff:ff:ff:ff:ff 2023-11-08T19:23:33.236 INFO:teuthology.orchestra.run.smithi149.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-08T19:23:33.236 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:56 brd ff:ff:ff:ff:ff:ff 2023-11-08T19:23:33.236 INFO:teuthology.orchestra.run.smithi149.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-08T19:23:33.236 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:57 brd ff:ff:ff:ff:ff:ff 2023-11-08T19:23:33.236 INFO:teuthology.orchestra.run.smithi149.stdout: inet 172.21.15.149/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-08T19:23:33.237 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft 42380sec preferred_lft 42380sec 2023-11-08T19:23:33.237 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::a27d:6f0d:7890:36f/64 scope link noprefixroute 2023-11-08T19:23:33.237 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:23:33.237 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-08T19:23:33.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:33.238 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec bash -c ' 2023-11-08T19:23:33.238 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2023-11-08T19:23:33.239 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link add name ceph-brx type bridge 2023-11-08T19:23:33.239 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip addr flush dev ceph-brx 2023-11-08T19:23:33.239 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set ceph-brx up 2023-11-08T19:23:33.240 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-08T19:23:33.240 DEBUG:teuthology.orchestra.run.smithi149:> ') 2023-11-08T19:23:33.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:33.350 DEBUG:teuthology.orchestra.run.smithi149:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-08T19:23:33.376 INFO:teuthology.orchestra.run.smithi149.stdout:1 2023-11-08T19:23:33.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:33.377 DEBUG:teuthology.orchestra.run.smithi149:> route 2023-11-08T19:23:33.436 INFO:teuthology.orchestra.run.smithi149.stdout:Kernel IP routing table 2023-11-08T19:23:33.436 INFO:teuthology.orchestra.run.smithi149.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-08T19:23:33.436 INFO:teuthology.orchestra.run.smithi149.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-08T19:23:33.437 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-08T19:23:33.437 INFO:teuthology.orchestra.run.smithi149.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-08T19:23:33.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:33.438 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec bash -c ' 2023-11-08T19:23:33.438 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2023-11-08T19:23:33.438 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-08T19:23:33.439 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-08T19:23:33.439 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-08T19:23:33.439 DEBUG:teuthology.orchestra.run.smithi149:> ') 2023-11-08T19:23:33.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:33.542 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2023-11-08T19:23:33.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:33.559 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list-id 2023-11-08T19:23:33.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:33.616 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec bash -c ' 2023-11-08T19:23:33.616 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2023-11-08T19:23:33.617 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-08T19:23:33.617 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-11-08T19:23:33.617 DEBUG:teuthology.orchestra.run.smithi149:> ') 2023-11-08T19:23:33.709 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-11-08T19:23:33.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:33.710 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec bash -c ' 2023-11-08T19:23:33.710 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2023-11-08T19:23:33.711 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-11-08T19:23:33.711 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-08T19:23:33.711 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-11-08T19:23:33.712 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-11-08T19:23:33.712 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-11-08T19:23:33.712 DEBUG:teuthology.orchestra.run.smithi149:> ') 2023-11-08T19:23:33.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:33.943 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec bash -c ' 2023-11-08T19:23:33.943 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2023-11-08T19:23:33.944 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set brx.0 up 2023-11-08T19:23:33.944 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set dev brx.0 master ceph-brx 2023-11-08T19:23:33.944 DEBUG:teuthology.orchestra.run.smithi149:> ') 2023-11-08T19:23:34.055 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-08T19:23:34.055 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-08T19:23:34.079 INFO:teuthology.orchestra.run.smithi149.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-08T19:23:34.079 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-08T19:23:34.080 DEBUG:teuthology.orchestra.run.smithi149:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-08T19:23:34.135 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-08T19:23:34.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:34.136 DEBUG:teuthology.orchestra.run.smithi149:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-08T19:23:34.221 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-08T19:23:34.222 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-08T19:23:34.222 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2023-11-08T19:23:34.333 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-08T19:23:34.333 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-08T19:23:34.334 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2023-11-08T19:23:34.334 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.149:3300,172.21.15.160:3300,172.21.15.160:3301" 2023-11-08T19:23:34.334 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-08T19:23:34.407 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-08T19:23:34.408 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-08T19:23:34.408 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2023-11-08T19:23:34.408 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.149:3300,172.21.15.160:3300,172.21.15.160:3301" 2023-11-08T19:23:34.408 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-08T19:23:34.409 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.149:6789,172.21.15.160:6789,172.21.15.160:6790" 2023-11-08T19:23:34.409 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.149:6789,172.21.15.160:6789,172.21.15.160:6790:/ 2023-11-08T19:23:34.409 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=0aba7c70-fe80-4446-a2f5-7502ac3adfb4" will pass to kernel 2023-11-08T19:23:34.411 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-08T19:23:34.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:34.412 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-08T19:23:34.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:34.439 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-08T19:23:34.511 INFO:teuthology.orchestra.run.smithi149.stdout:client4711 2023-11-08T19:23:34.511 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-11-08T19:23:34.512 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:23:34.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:34.570 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-08T19:23:34.642 INFO:teuthology.orchestra.run.smithi149.stdout:client4711 2023-11-08T19:23:34.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:34.643 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-08T19:23:34.714 INFO:teuthology.orchestra.run.smithi149.stdout:client4711 2023-11-08T19:23:34.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:34.715 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/0aba7c70-fe80-4446-a2f5-7502ac3adfb4.client4711/status') 2023-11-08T19:23:34.794 INFO:teuthology.orchestra.run.smithi149.stdout:instance: client.4711 (3)172.21.15.149:0/275599691 2023-11-08T19:23:34.794 INFO:teuthology.orchestra.run.smithi149.stdout:blocklisted: false 2023-11-08T19:23:34.795 INFO:teuthology.orchestra.run.smithi149.stderr:0+1 records in 2023-11-08T19:23:34.796 INFO:teuthology.orchestra.run.smithi149.stderr:0+1 records out 2023-11-08T19:23:34.796 INFO:teuthology.orchestra.run.smithi149.stderr:70 bytes copied, 2.1465e-05 s, 3.3 MB/s 2023-11-08T19:23:34.797 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2023-11-08T19:23:34.797 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-08T19:23:34.798 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-08T19:23:34.798 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-08T19:23:34.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:34.954+0000 7fa562c5d700 1 Processor -- start 2023-11-08T19:23:34.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:34.955+0000 7fa562c5d700 1 -- start start 2023-11-08T19:23:34.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:34.955+0000 7fa562c5d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa55c161670 0x7fa55c0b5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:34.960 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:34.955+0000 7fa562c5d700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fa55c161a50 0x7fa55c161f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:34.960 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:34.955+0000 7fa562c5d700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa55c0d1a10 con 0x7fa55c15dd90 2023-11-08T19:23:34.960 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:34.955+0000 7fa562c5d700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa55c0d1cf0 con 0x7fa55c161670 2023-11-08T19:23:34.960 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:34.955+0000 7fa562c5d700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa55c0d1fd0 con 0x7fa55c161a50 2023-11-08T19:23:34.960 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:34.955+0000 7fa5609f9700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa55c161670 0x7fa55c0b5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:34.961 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:34.956+0000 7fa5609f9700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa55c161670 0x7fa55c0b5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37948/0 (socket says 172.21.15.149:37948) 2023-11-08T19:23:34.961 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:34.956+0000 7fa5609f9700 1 -- 172.21.15.149:0/93689849 learned_addr learned my addr 172.21.15.149:0/93689849 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:34.961 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:34.956+0000 7fa5611fa700 1 --1- 172.21.15.149:0/93689849 >> v1:172.21.15.149:6789/0 conn(0x7fa55c15dd90 0x7fa55c15e200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:39950/0 (socket says 172.21.15.149:39950) 2023-11-08T19:23:34.961 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:34.956+0000 7fa55bfff700 1 --2- 172.21.15.149:0/93689849 >> v2:172.21.15.160:3300/0 conn(0x7fa55c161a50 0x7fa55c161f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:34.961 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:34.956+0000 7fa5609f9700 1 -- 172.21.15.149:0/93689849 >> v2:172.21.15.160:3300/0 conn(0x7fa55c161a50 msgr2=0x7fa55c161f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:34.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:34.956+0000 7fa5609f9700 1 --2- 172.21.15.149:0/93689849 >> v2:172.21.15.160:3300/0 conn(0x7fa55c161a50 0x7fa55c161f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:34.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:34.956+0000 7fa5609f9700 1 -- 172.21.15.149:0/93689849 >> v1:172.21.15.149:6789/0 conn(0x7fa55c15dd90 legacy=0x7fa55c15e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:34.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:34.956+0000 7fa5609f9700 1 -- 172.21.15.149:0/93689849 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa55c0d22b0 con 0x7fa55c161670 2023-11-08T19:23:34.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:34.956+0000 7fa55bfff700 1 --2- 172.21.15.149:0/93689849 >> v2:172.21.15.160:3300/0 conn(0x7fa55c161a50 0x7fa55c161f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:23:34.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:34.956+0000 7fa5609f9700 1 --2- 172.21.15.149:0/93689849 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa55c161670 0x7fa55c0b5e10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa55c0d1470 tx=0x7fa550009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52b30a1905ed11a7 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:34.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:34.956+0000 7fa55b7fe700 1 -- 172.21.15.149:0/93689849 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa550005e30 con 0x7fa55c161670 2023-11-08T19:23:34.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:34.956+0000 7fa55b7fe700 1 -- 172.21.15.149:0/93689849 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa550004030 con 0x7fa55c161670 2023-11-08T19:23:34.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:34.956+0000 7fa55b7fe700 1 -- 172.21.15.149:0/93689849 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5500043e0 con 0x7fa55c161670 2023-11-08T19:23:34.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:34.957+0000 7fa562c5d700 1 -- 172.21.15.149:0/93689849 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa55c161670 msgr2=0x7fa55c0b5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:34.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:34.957+0000 7fa562c5d700 1 --2- 172.21.15.149:0/93689849 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa55c161670 0x7fa55c0b5e10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa55c0d1470 tx=0x7fa550009bd0 comp rx=0 tx=0).stop 2023-11-08T19:23:34.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:34.957+0000 7fa562c5d700 1 -- 172.21.15.149:0/93689849 shutdown_connections 2023-11-08T19:23:34.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:34.957+0000 7fa562c5d700 1 --2- 172.21.15.149:0/93689849 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa55c161670 0x7fa55c0b5e10 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:34.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:34.957+0000 7fa562c5d700 1 --2- 172.21.15.149:0/93689849 >> v2:172.21.15.160:3300/0 conn(0x7fa55c161a50 0x7fa55c161f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:34.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:34.957+0000 7fa562c5d700 1 -- 172.21.15.149:0/93689849 >> 172.21.15.149:0/93689849 conn(0x7fa55c0d3980 msgr2=0x7fa55c0d3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:34.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:34.957+0000 7fa562c5d700 1 -- 172.21.15.149:0/93689849 shutdown_connections 2023-11-08T19:23:34.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:34.957+0000 7fa562c5d700 1 -- 172.21.15.149:0/93689849 wait complete. 2023-11-08T19:23:34.967 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:34.958+0000 7fa562c5d700 1 Processor -- start 2023-11-08T19:23:34.967 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:34.958+0000 7fa562c5d700 1 -- start start 2023-11-08T19:23:34.968 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:34.959+0000 7fa562c5d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa55c15dd90 0x7fa55c0cc290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:34.968 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:34.959+0000 7fa562c5d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa55c161670 0x7fa55c0ca9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:34.968 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:34.959+0000 7fa562c5d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa55c161a50 0x7fa55c0b1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:34.968 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:34.959+0000 7fa562c5d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa55c0cc7d0 con 0x7fa55c15dd90 2023-11-08T19:23:34.968 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:34.959+0000 7fa562c5d700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa55c0cb1f0 con 0x7fa55c161a50 2023-11-08T19:23:34.969 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:34.959+0000 7fa562c5d700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa55c0cb4d0 con 0x7fa55c161670 2023-11-08T19:23:34.969 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:34.959+0000 7fa5609f9700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa55c15dd90 0x7fa55c0cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:34.969 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:34.959+0000 7fa5609f9700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa55c15dd90 0x7fa55c0cc290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37950/0 (socket says 172.21.15.149:37950) 2023-11-08T19:23:34.969 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:34.959+0000 7fa5609f9700 1 -- 172.21.15.149:0/4212449170 learned_addr learned my addr 172.21.15.149:0/4212449170 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:34.969 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:34.959+0000 7fa5611fa700 1 --2- 172.21.15.149:0/4212449170 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa55c161a50 0x7fa55c0b1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:34.970 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:34.959+0000 7fa55bfff700 1 --2- 172.21.15.149:0/4212449170 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa55c161670 0x7fa55c0ca9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:34.970 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:34.959+0000 7fa5609f9700 1 -- 172.21.15.149:0/4212449170 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa55c161670 msgr2=0x7fa55c0ca9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:34.970 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:34.959+0000 7fa5609f9700 1 --2- 172.21.15.149:0/4212449170 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa55c161670 0x7fa55c0ca9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:34.970 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:34.959+0000 7fa5609f9700 1 -- 172.21.15.149:0/4212449170 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa55c161a50 msgr2=0x7fa55c0b1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:34.970 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:34.959+0000 7fa5609f9700 1 --2- 172.21.15.149:0/4212449170 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa55c161a50 0x7fa55c0b1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:34.971 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:34.959+0000 7fa5609f9700 1 -- 172.21.15.149:0/4212449170 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa550009500 con 0x7fa55c15dd90 2023-11-08T19:23:34.971 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:34.959+0000 7fa5611fa700 1 --2- 172.21.15.149:0/4212449170 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa55c161a50 0x7fa55c0b1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:23:34.971 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:34.959+0000 7fa55bfff700 1 --2- 172.21.15.149:0/4212449170 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa55c161670 0x7fa55c0ca9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:23:34.971 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:34.959+0000 7fa5609f9700 1 --2- 172.21.15.149:0/4212449170 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa55c15dd90 0x7fa55c0cc290 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa550009c10 tx=0x7fa550004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:34.971 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:34.960+0000 7fa5597fa700 1 -- 172.21.15.149:0/4212449170 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa550011620 con 0x7fa55c15dd90 2023-11-08T19:23:34.972 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:34.960+0000 7fa562c5d700 1 -- 172.21.15.149:0/4212449170 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa55c0cb7b0 con 0x7fa55c15dd90 2023-11-08T19:23:34.972 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:34.960+0000 7fa5597fa700 1 -- 172.21.15.149:0/4212449170 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5500117a0 con 0x7fa55c15dd90 2023-11-08T19:23:34.972 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:34.960+0000 7fa5597fa700 1 -- 172.21.15.149:0/4212449170 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa550011b50 con 0x7fa55c15dd90 2023-11-08T19:23:34.972 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:34.960+0000 7fa562c5d700 1 -- 172.21.15.149:0/4212449170 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa55c0cbd70 con 0x7fa55c15dd90 2023-11-08T19:23:34.972 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:34.961+0000 7fa562c5d700 1 -- 172.21.15.149:0/4212449170 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa55c0745f0 con 0x7fa55c15dd90 2023-11-08T19:23:34.973 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:34.961+0000 7fa5597fa700 1 -- 172.21.15.149:0/4212449170 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa550011cb0 con 0x7fa55c15dd90 2023-11-08T19:23:34.973 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:34.961+0000 7fa5597fa700 1 --2- 172.21.15.149:0/4212449170 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa54006af00 0x7fa54006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:34.973 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:34.962+0000 7fa5597fa700 1 -- 172.21.15.149:0/4212449170 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa55008ac50 con 0x7fa55c15dd90 2023-11-08T19:23:34.973 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:34.962+0000 7fa55bfff700 1 --2- 172.21.15.149:0/4212449170 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa54006af00 0x7fa54006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:34.973 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:34.962+0000 7fa55bfff700 1 --2- 172.21.15.149:0/4212449170 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa54006af00 0x7fa54006d3c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa55c156570 tx=0x7fa548008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:34.974 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:34.966+0000 7fa5597fa700 1 -- 172.21.15.149:0/4212449170 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa550090020 con 0x7fa55c15dd90 2023-11-08T19:23:35.205 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:35.203+0000 7fa562c5d700 1 -- 172.21.15.149:0/4212449170 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa55c08b060 con 0x7fa55c15dd90 2023-11-08T19:23:35.205 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:35.203+0000 7fa5597fa700 1 -- 172.21.15.149:0/4212449170 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fa550055a20 con 0x7fa55c15dd90 2023-11-08T19:23:35.206 INFO:teuthology.orchestra.run.smithi149.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-08T19:23:35.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:35.205+0000 7fa562c5d700 1 -- 172.21.15.149:0/4212449170 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa54006af00 msgr2=0x7fa54006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:35.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:35.205+0000 7fa562c5d700 1 --2- 172.21.15.149:0/4212449170 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa54006af00 0x7fa54006d3c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa55c156570 tx=0x7fa548008040 comp rx=0 tx=0).stop 2023-11-08T19:23:35.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:35.205+0000 7fa562c5d700 1 -- 172.21.15.149:0/4212449170 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa55c15dd90 msgr2=0x7fa55c0cc290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:35.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:35.205+0000 7fa562c5d700 1 --2- 172.21.15.149:0/4212449170 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa55c15dd90 0x7fa55c0cc290 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa550009c10 tx=0x7fa550004750 comp rx=0 tx=0).stop 2023-11-08T19:23:35.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:35.205+0000 7fa562c5d700 1 -- 172.21.15.149:0/4212449170 shutdown_connections 2023-11-08T19:23:35.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:35.205+0000 7fa562c5d700 1 --2- 172.21.15.149:0/4212449170 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa54006af00 0x7fa54006d3c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:35.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:35.205+0000 7fa562c5d700 1 --2- 172.21.15.149:0/4212449170 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa55c161a50 0x7fa55c0b1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:35.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:35.205+0000 7fa562c5d700 1 --2- 172.21.15.149:0/4212449170 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa55c15dd90 0x7fa55c0cc290 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:35.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:35.205+0000 7fa562c5d700 1 --2- 172.21.15.149:0/4212449170 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa55c161670 0x7fa55c0ca9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:35.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:35.205+0000 7fa562c5d700 1 -- 172.21.15.149:0/4212449170 >> 172.21.15.149:0/4212449170 conn(0x7fa55c0d3980 msgr2=0x7fa55c160a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:35.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:35.205+0000 7fa562c5d700 1 -- 172.21.15.149:0/4212449170 shutdown_connections 2023-11-08T19:23:35.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:35.205+0000 7fa562c5d700 1 -- 172.21.15.149:0/4212449170 wait complete. 2023-11-08T19:23:35.220 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-08T19:23:35.220 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-08T19:23:35.220 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi149.front.sepia.ceph.com 2023-11-08T19:23:35.220 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-11-08T19:23:35.221 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-08T19:23:35.221 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-08T19:23:35.221 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-08T19:23:35.221 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-08T19:23:35.222 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-11-08T19:23:35.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:35.222 DEBUG:teuthology.orchestra.run.smithi149:> ip addr 2023-11-08T19:23:35.239 INFO:teuthology.orchestra.run.smithi149.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-08T19:23:35.239 INFO:teuthology.orchestra.run.smithi149.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-08T19:23:35.239 INFO:teuthology.orchestra.run.smithi149.stdout: inet 127.0.0.1/8 scope host lo 2023-11-08T19:23:35.239 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:23:35.240 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 ::1/128 scope host 2023-11-08T19:23:35.240 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:23:35.240 INFO:teuthology.orchestra.run.smithi149.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-08T19:23:35.240 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a4 brd ff:ff:ff:ff:ff:ff 2023-11-08T19:23:35.240 INFO:teuthology.orchestra.run.smithi149.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-08T19:23:35.241 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a5 brd ff:ff:ff:ff:ff:ff 2023-11-08T19:23:35.241 INFO:teuthology.orchestra.run.smithi149.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-08T19:23:35.241 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:56 brd ff:ff:ff:ff:ff:ff 2023-11-08T19:23:35.241 INFO:teuthology.orchestra.run.smithi149.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-08T19:23:35.241 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:57 brd ff:ff:ff:ff:ff:ff 2023-11-08T19:23:35.242 INFO:teuthology.orchestra.run.smithi149.stdout: inet 172.21.15.149/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-08T19:23:35.242 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft 42378sec preferred_lft 42378sec 2023-11-08T19:23:35.242 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::a27d:6f0d:7890:36f/64 scope link noprefixroute 2023-11-08T19:23:35.242 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:23:35.242 INFO:teuthology.orchestra.run.smithi149.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-08T19:23:35.243 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether e6:a6:23:51:6c:ef brd ff:ff:ff:ff:ff:ff 2023-11-08T19:23:35.243 INFO:teuthology.orchestra.run.smithi149.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-08T19:23:35.243 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:23:35.243 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::4c22:cdff:fed4:d829/64 scope link 2023-11-08T19:23:35.243 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:23:35.243 INFO:teuthology.orchestra.run.smithi149.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-08T19:23:35.244 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether e6:a6:23:51:6c:ef brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-08T19:23:35.244 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::e4a6:23ff:fe51:6cef/64 scope link tentative 2023-11-08T19:23:35.244 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:23:35.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:35.245 DEBUG:teuthology.orchestra.run.smithi149:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-08T19:23:35.306 INFO:teuthology.orchestra.run.smithi149.stdout:1 2023-11-08T19:23:35.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:35.307 DEBUG:teuthology.orchestra.run.smithi149:> route 2023-11-08T19:23:35.365 INFO:teuthology.orchestra.run.smithi149.stdout:Kernel IP routing table 2023-11-08T19:23:35.365 INFO:teuthology.orchestra.run.smithi149.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-08T19:23:35.366 INFO:teuthology.orchestra.run.smithi149.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-08T19:23:35.366 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-08T19:23:35.366 INFO:teuthology.orchestra.run.smithi149.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-08T19:23:35.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:35.367 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec bash -c ' 2023-11-08T19:23:35.367 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2023-11-08T19:23:35.367 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-08T19:23:35.368 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-08T19:23:35.368 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-08T19:23:35.368 DEBUG:teuthology.orchestra.run.smithi149:> ') 2023-11-08T19:23:35.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:35.471 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2023-11-08T19:23:35.487 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-08T19:23:35.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:35.488 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list-id 2023-11-08T19:23:35.543 INFO:teuthology.orchestra.run.smithi149.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-11-08T19:23:35.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:35.544 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec bash -c ' 2023-11-08T19:23:35.544 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2023-11-08T19:23:35.544 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-08T19:23:35.545 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-11-08T19:23:35.545 DEBUG:teuthology.orchestra.run.smithi149:> ') 2023-11-08T19:23:35.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:35.637 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-08T19:23:35.674 INFO:teuthology.orchestra.run.smithi149.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-08T19:23:35.674 INFO:teuthology.orchestra.run.smithi149.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-08T19:23:35.674 INFO:teuthology.orchestra.run.smithi149.stdout: inet 127.0.0.1/8 scope host lo 2023-11-08T19:23:35.675 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:23:35.675 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 ::1/128 scope host 2023-11-08T19:23:35.675 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:23:35.675 INFO:teuthology.orchestra.run.smithi149.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-08T19:23:35.676 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 8a:6b:cf:d8:6d:79 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-08T19:23:35.676 INFO:teuthology.orchestra.run.smithi149.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-08T19:23:35.676 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:23:35.676 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::886b:cfff:fed8:6d79/64 scope link 2023-11-08T19:23:35.676 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:23:35.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:35.690 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-08T19:23:35.765 INFO:teuthology.orchestra.run.smithi149.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-08T19:23:35.766 INFO:teuthology.orchestra.run.smithi149.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-08T19:23:35.766 INFO:teuthology.orchestra.run.smithi149.stdout: inet 127.0.0.1/8 scope host lo 2023-11-08T19:23:35.766 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:23:35.766 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 ::1/128 scope host 2023-11-08T19:23:35.767 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:23:35.767 INFO:teuthology.orchestra.run.smithi149.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-08T19:23:35.767 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 8a:6b:cf:d8:6d:79 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-08T19:23:35.767 INFO:teuthology.orchestra.run.smithi149.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-08T19:23:35.768 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:23:35.768 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::886b:cfff:fed8:6d79/64 scope link 2023-11-08T19:23:35.768 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:23:35.778 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-11-08T19:23:35.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:35.779 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec bash -c ' 2023-11-08T19:23:35.779 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2023-11-08T19:23:35.779 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-11-08T19:23:35.780 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-08T19:23:35.780 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-11-08T19:23:35.780 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-11-08T19:23:35.781 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-11-08T19:23:35.781 DEBUG:teuthology.orchestra.run.smithi149:> ') 2023-11-08T19:23:36.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:36.027 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec bash -c ' 2023-11-08T19:23:36.027 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2023-11-08T19:23:36.028 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set brx.1 up 2023-11-08T19:23:36.028 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set dev brx.1 master ceph-brx 2023-11-08T19:23:36.028 DEBUG:teuthology.orchestra.run.smithi149:> ') 2023-11-08T19:23:36.139 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-08T19:23:36.140 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-11-08T19:23:36.159 INFO:teuthology.orchestra.run.smithi149.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-11-08T19:23:36.159 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-08T19:23:36.159 DEBUG:teuthology.orchestra.run.smithi149:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-11-08T19:23:36.215 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-08T19:23:36.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:36.216 DEBUG:teuthology.orchestra.run.smithi149:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-11-08T19:23:36.301 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-11-08T19:23:36.301 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-11-08T19:23:36.301 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2023-11-08T19:23:36.310 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-11-08T19:23:36.310 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-11-08T19:23:36.310 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2023-11-08T19:23:36.310 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.149:3300,172.21.15.160:3300,172.21.15.160:3301" 2023-11-08T19:23:36.311 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-08T19:23:36.384 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-11-08T19:23:36.384 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-11-08T19:23:36.385 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2023-11-08T19:23:36.385 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.149:3300,172.21.15.160:3300,172.21.15.160:3301" 2023-11-08T19:23:36.385 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-08T19:23:36.385 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.149:6789,172.21.15.160:6789,172.21.15.160:6790" 2023-11-08T19:23:36.385 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.149:6789,172.21.15.160:6789,172.21.15.160:6790:/ 2023-11-08T19:23:36.386 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=0aba7c70-fe80-4446-a2f5-7502ac3adfb4" will pass to kernel 2023-11-08T19:23:36.387 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-08T19:23:36.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:36.387 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-11-08T19:23:36.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:36.413 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-08T19:23:36.485 INFO:teuthology.orchestra.run.smithi149.stdout:client4714 2023-11-08T19:23:36.485 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-11-08T19:23:36.486 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:23:36.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:36.542 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-08T19:23:36.613 INFO:teuthology.orchestra.run.smithi149.stdout:client4714 2023-11-08T19:23:36.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:36.614 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-08T19:23:36.685 INFO:teuthology.orchestra.run.smithi149.stdout:client4714 2023-11-08T19:23:36.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:36.686 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/0aba7c70-fe80-4446-a2f5-7502ac3adfb4.client4714/status') 2023-11-08T19:23:36.766 INFO:teuthology.orchestra.run.smithi149.stdout:instance: client.4714 (3)172.21.15.149:0/864178101 2023-11-08T19:23:36.766 INFO:teuthology.orchestra.run.smithi149.stdout:blocklisted: false 2023-11-08T19:23:36.767 INFO:teuthology.orchestra.run.smithi149.stderr:0+1 records in 2023-11-08T19:23:36.767 INFO:teuthology.orchestra.run.smithi149.stderr:0+1 records out 2023-11-08T19:23:36.768 INFO:teuthology.orchestra.run.smithi149.stderr:70 bytes copied, 2.351e-05 s, 3.0 MB/s 2023-11-08T19:23:36.768 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-11-08T19:23:36.768 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-08T19:23:36.769 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-08T19:23:36.769 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-08T19:23:36.929 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:36.927+0000 7fb83935d700 1 Processor -- start 2023-11-08T19:23:36.930 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:36.927+0000 7fb83935d700 1 -- start start 2023-11-08T19:23:36.932 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:36.928+0000 7fb83935d700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fb8340afb30 0x7fb8340ce380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:36.932 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:36.928+0000 7fb83935d700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8340d1330 con 0x7fb8340b16b0 2023-11-08T19:23:36.933 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:36.928+0000 7fb83935d700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8340cb490 con 0x7fb8340b20b0 2023-11-08T19:23:36.933 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:36.928+0000 7fb83935d700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8340cb770 con 0x7fb8340afb30 2023-11-08T19:23:36.933 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:36.928+0000 7fb8327fc700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fb8340b16b0 0x7fb8340cbf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:39964/0 (socket says 172.21.15.149:39964) 2023-11-08T19:23:36.933 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:36.928+0000 7fb8327fc700 1 -- 172.21.15.149:0/3902209290 learned_addr learned my addr 172.21.15.149:0/3902209290 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:23:36.933 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:36.928+0000 7fb832ffd700 1 --2- 172.21.15.149:0/3902209290 >> v2:172.21.15.160:3300/0 conn(0x7fb8340afb30 0x7fb8340ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:36.934 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:36.929+0000 7fb831ffb700 1 -- 172.21.15.149:0/3902209290 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1594195902 0 0) 0x7fb8340d1330 con 0x7fb8340b16b0 2023-11-08T19:23:36.934 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:36.929+0000 7fb831ffb700 1 -- 172.21.15.149:0/3902209290 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb81c0035b0 con 0x7fb8340b16b0 2023-11-08T19:23:36.934 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:36.929+0000 7fb832ffd700 1 -- 172.21.15.149:0/3902209290 >> v1:172.21.15.160:6789/0 conn(0x7fb8340b20b0 legacy=0x7fb8340aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:36.934 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:36.929+0000 7fb832ffd700 1 -- 172.21.15.149:0/3902209290 >> v1:172.21.15.149:6789/0 conn(0x7fb8340b16b0 legacy=0x7fb8340cbf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:36.935 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:36.929+0000 7fb832ffd700 1 -- 172.21.15.149:0/3902209290 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8340cba50 con 0x7fb8340afb30 2023-11-08T19:23:36.935 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:36.929+0000 7fb832ffd700 1 --2- 172.21.15.149:0/3902209290 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8340afb30 0x7fb8340ce380 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb824009820 tx=0x7fb824009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c30fdf3981d510b server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:36.935 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:36.929+0000 7fb831ffb700 1 -- 172.21.15.149:0/3902209290 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb824005e30 con 0x7fb8340afb30 2023-11-08T19:23:36.935 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:36.929+0000 7fb831ffb700 1 -- 172.21.15.149:0/3902209290 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb824006030 con 0x7fb8340afb30 2023-11-08T19:23:36.935 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:36.929+0000 7fb831ffb700 1 -- 172.21.15.149:0/3902209290 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8240063c0 con 0x7fb8340afb30 2023-11-08T19:23:36.935 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:36.930+0000 7fb83935d700 1 -- 172.21.15.149:0/3902209290 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8340afb30 msgr2=0x7fb8340ce380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:36.936 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:36.930+0000 7fb83935d700 1 --2- 172.21.15.149:0/3902209290 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8340afb30 0x7fb8340ce380 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb824009820 tx=0x7fb824009b30 comp rx=0 tx=0).stop 2023-11-08T19:23:36.936 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:36.930+0000 7fb83935d700 1 -- 172.21.15.149:0/3902209290 shutdown_connections 2023-11-08T19:23:36.936 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:36.930+0000 7fb83935d700 1 --2- 172.21.15.149:0/3902209290 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8340afb30 0x7fb8340ce380 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:36.936 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:36.930+0000 7fb83935d700 1 -- 172.21.15.149:0/3902209290 >> 172.21.15.149:0/3902209290 conn(0x7fb834099a40 msgr2=0x7fb8340d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:36.936 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:36.930+0000 7fb83935d700 1 -- 172.21.15.149:0/3902209290 shutdown_connections 2023-11-08T19:23:36.937 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:36.930+0000 7fb83935d700 1 -- 172.21.15.149:0/3902209290 wait complete. 2023-11-08T19:23:36.939 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:36.931+0000 7fb83935d700 1 Processor -- start 2023-11-08T19:23:36.939 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:36.931+0000 7fb83935d700 1 -- start start 2023-11-08T19:23:36.940 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:36.932+0000 7fb83935d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8340afb30 0x7fb834158560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:36.940 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:36.932+0000 7fb83935d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8340b16b0 0x7fb834154450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:36.940 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:36.932+0000 7fb83935d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb8340b20b0 0x7fb834154990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:36.940 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:36.932+0000 7fb83935d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8340c6be0 con 0x7fb8340afb30 2023-11-08T19:23:36.940 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:36.932+0000 7fb83935d700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8340c6ec0 con 0x7fb8340b16b0 2023-11-08T19:23:36.941 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:36.932+0000 7fb83935d700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb834157a80 con 0x7fb8340b20b0 2023-11-08T19:23:36.941 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:36.932+0000 7fb832ffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8340afb30 0x7fb834158560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:36.941 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:36.932+0000 7fb832ffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8340afb30 0x7fb834158560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37966/0 (socket says 172.21.15.149:37966) 2023-11-08T19:23:36.941 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:36.932+0000 7fb832ffd700 1 -- 172.21.15.149:0/1188985666 learned_addr learned my addr 172.21.15.149:0/1188985666 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:36.941 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:36.932+0000 7fb8327fc700 1 --2- 172.21.15.149:0/1188985666 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8340b16b0 0x7fb834154450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:36.942 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:36.932+0000 7fb8337fe700 1 --2- 172.21.15.149:0/1188985666 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb8340b20b0 0x7fb834154990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:36.942 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:36.932+0000 7fb832ffd700 1 -- 172.21.15.149:0/1188985666 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb8340b20b0 msgr2=0x7fb834154990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:36.942 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:36.932+0000 7fb832ffd700 1 --2- 172.21.15.149:0/1188985666 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb8340b20b0 0x7fb834154990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:36.942 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:36.932+0000 7fb832ffd700 1 -- 172.21.15.149:0/1188985666 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8340b16b0 msgr2=0x7fb834154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:36.942 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:36.932+0000 7fb832ffd700 1 --2- 172.21.15.149:0/1188985666 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8340b16b0 0x7fb834154450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:36.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:36.932+0000 7fb832ffd700 1 -- 172.21.15.149:0/1188985666 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb824009430 con 0x7fb8340afb30 2023-11-08T19:23:36.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:36.932+0000 7fb8327fc700 1 --2- 172.21.15.149:0/1188985666 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8340b16b0 0x7fb834154450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:23:36.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:36.932+0000 7fb832ffd700 1 --2- 172.21.15.149:0/1188985666 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8340afb30 0x7fb834158560 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb824000c00 tx=0x7fb824004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:36.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:36.933+0000 7fb81b7fe700 1 -- 172.21.15.149:0/1188985666 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb824004240 con 0x7fb8340afb30 2023-11-08T19:23:36.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:36.933+0000 7fb81b7fe700 1 -- 172.21.15.149:0/1188985666 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8240043a0 con 0x7fb8340afb30 2023-11-08T19:23:36.944 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:36.933+0000 7fb83935d700 1 -- 172.21.15.149:0/1188985666 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb834157d60 con 0x7fb8340afb30 2023-11-08T19:23:36.944 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:36.933+0000 7fb81b7fe700 1 -- 172.21.15.149:0/1188985666 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8240036a0 con 0x7fb8340afb30 2023-11-08T19:23:36.944 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:36.933+0000 7fb83935d700 1 -- 172.21.15.149:0/1188985666 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb834155070 con 0x7fb8340afb30 2023-11-08T19:23:36.944 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:36.934+0000 7fb83935d700 1 -- 172.21.15.149:0/1188985666 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8340ce380 con 0x7fb8340afb30 2023-11-08T19:23:36.944 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:36.934+0000 7fb81b7fe700 1 -- 172.21.15.149:0/1188985666 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb824022070 con 0x7fb8340afb30 2023-11-08T19:23:36.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:36.934+0000 7fb81b7fe700 1 --2- 172.21.15.149:0/1188985666 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb82006af00 0x7fb82006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:36.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:36.935+0000 7fb81b7fe700 1 -- 172.21.15.149:0/1188985666 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb82408b220 con 0x7fb8340afb30 2023-11-08T19:23:36.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:36.935+0000 7fb8327fc700 1 --2- 172.21.15.149:0/1188985666 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb82006af00 0x7fb82006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:36.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:36.935+0000 7fb8327fc700 1 --2- 172.21.15.149:0/1188985666 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb82006af00 0x7fb82006d3c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb8340cffc0 tx=0x7fb828009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:36.946 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:36.939+0000 7fb81b7fe700 1 -- 172.21.15.149:0/1188985666 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb824055ff0 con 0x7fb8340afb30 2023-11-08T19:23:37.174 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:37.172+0000 7fb83935d700 1 -- 172.21.15.149:0/1188985666 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb8340745f0 con 0x7fb8340afb30 2023-11-08T19:23:37.175 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:37.172+0000 7fb81b7fe700 1 -- 172.21.15.149:0/1188985666 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fb824059610 con 0x7fb8340afb30 2023-11-08T19:23:37.175 INFO:teuthology.orchestra.run.smithi149.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-08T19:23:37.177 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:37.175+0000 7fb83935d700 1 -- 172.21.15.149:0/1188985666 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb82006af00 msgr2=0x7fb82006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:37.177 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:37.175+0000 7fb83935d700 1 --2- 172.21.15.149:0/1188985666 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb82006af00 0x7fb82006d3c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb8340cffc0 tx=0x7fb828009040 comp rx=0 tx=0).stop 2023-11-08T19:23:37.178 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:37.175+0000 7fb83935d700 1 -- 172.21.15.149:0/1188985666 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8340afb30 msgr2=0x7fb834158560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:37.178 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:37.175+0000 7fb83935d700 1 --2- 172.21.15.149:0/1188985666 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8340afb30 0x7fb834158560 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb824000c00 tx=0x7fb824004750 comp rx=0 tx=0).stop 2023-11-08T19:23:37.178 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:37.175+0000 7fb83935d700 1 -- 172.21.15.149:0/1188985666 shutdown_connections 2023-11-08T19:23:37.178 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:37.175+0000 7fb83935d700 1 --2- 172.21.15.149:0/1188985666 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb82006af00 0x7fb82006d3c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:37.178 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:37.175+0000 7fb83935d700 1 --2- 172.21.15.149:0/1188985666 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb8340b20b0 0x7fb834154990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:37.179 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:37.175+0000 7fb83935d700 1 --2- 172.21.15.149:0/1188985666 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8340afb30 0x7fb834158560 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:37.179 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:37.175+0000 7fb83935d700 1 --2- 172.21.15.149:0/1188985666 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8340b16b0 0x7fb834154450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:37.179 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:37.175+0000 7fb83935d700 1 -- 172.21.15.149:0/1188985666 >> 172.21.15.149:0/1188985666 conn(0x7fb834099a40 msgr2=0x7fb8340b5460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:37.179 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:37.175+0000 7fb83935d700 1 -- 172.21.15.149:0/1188985666 shutdown_connections 2023-11-08T19:23:37.179 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:37.175+0000 7fb83935d700 1 -- 172.21.15.149:0/1188985666 wait complete. 2023-11-08T19:23:37.189 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-08T19:23:37.190 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-08T19:23:37.190 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi160.front.sepia.ceph.com 2023-11-08T19:23:37.190 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-08T19:23:37.191 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-08T19:23:37.191 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-08T19:23:37.191 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-08T19:23:37.191 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-08T19:23:37.192 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-08T19:23:37.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:37.193 DEBUG:teuthology.orchestra.run.smithi160:> ip addr 2023-11-08T19:23:37.214 INFO:teuthology.orchestra.run.smithi160.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-08T19:23:37.214 INFO:teuthology.orchestra.run.smithi160.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-08T19:23:37.215 INFO:teuthology.orchestra.run.smithi160.stdout: inet 127.0.0.1/8 scope host lo 2023-11-08T19:23:37.215 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:23:37.215 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 ::1/128 scope host 2023-11-08T19:23:37.215 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:23:37.215 INFO:teuthology.orchestra.run.smithi160.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-08T19:23:37.216 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:d9:82:80 brd ff:ff:ff:ff:ff:ff 2023-11-08T19:23:37.216 INFO:teuthology.orchestra.run.smithi160.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-08T19:23:37.216 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:d9:82:81 brd ff:ff:ff:ff:ff:ff 2023-11-08T19:23:37.216 INFO:teuthology.orchestra.run.smithi160.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-08T19:23:37.216 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:88:7f:5a brd ff:ff:ff:ff:ff:ff 2023-11-08T19:23:37.216 INFO:teuthology.orchestra.run.smithi160.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-08T19:23:37.217 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:88:7f:5b brd ff:ff:ff:ff:ff:ff 2023-11-08T19:23:37.217 INFO:teuthology.orchestra.run.smithi160.stdout: inet 172.21.15.160/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-08T19:23:37.217 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft 42380sec preferred_lft 42380sec 2023-11-08T19:23:37.217 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 fe80::e47c:6a23:db24:aa59/64 scope link noprefixroute 2023-11-08T19:23:37.218 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:23:37.218 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-08T19:23:37.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:37.219 DEBUG:teuthology.orchestra.run.smithi160:> (cd / && exec bash -c ' 2023-11-08T19:23:37.219 DEBUG:teuthology.orchestra.run.smithi160:> set -e 2023-11-08T19:23:37.219 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip link add name ceph-brx type bridge 2023-11-08T19:23:37.220 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip addr flush dev ceph-brx 2023-11-08T19:23:37.220 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip link set ceph-brx up 2023-11-08T19:23:37.220 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-08T19:23:37.220 DEBUG:teuthology.orchestra.run.smithi160:> ') 2023-11-08T19:23:37.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:37.400 DEBUG:teuthology.orchestra.run.smithi160:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-08T19:23:37.428 INFO:teuthology.orchestra.run.smithi160.stdout:1 2023-11-08T19:23:37.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:37.430 DEBUG:teuthology.orchestra.run.smithi160:> route 2023-11-08T19:23:37.501 INFO:teuthology.orchestra.run.smithi160.stdout:Kernel IP routing table 2023-11-08T19:23:37.501 INFO:teuthology.orchestra.run.smithi160.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-08T19:23:37.501 INFO:teuthology.orchestra.run.smithi160.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-08T19:23:37.502 INFO:teuthology.orchestra.run.smithi160.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-08T19:23:37.502 INFO:teuthology.orchestra.run.smithi160.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-08T19:23:37.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:37.503 DEBUG:teuthology.orchestra.run.smithi160:> (cd / && exec bash -c ' 2023-11-08T19:23:37.503 DEBUG:teuthology.orchestra.run.smithi160:> set -e 2023-11-08T19:23:37.503 DEBUG:teuthology.orchestra.run.smithi160:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-08T19:23:37.504 DEBUG:teuthology.orchestra.run.smithi160:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-08T19:23:37.504 DEBUG:teuthology.orchestra.run.smithi160:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-08T19:23:37.504 DEBUG:teuthology.orchestra.run.smithi160:> ') 2023-11-08T19:23:37.685 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T19:23:37.688 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T19:23:37.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:37.755 DEBUG:teuthology.orchestra.run.smithi160:> ip netns list 2023-11-08T19:23:37.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:37.812 DEBUG:teuthology.orchestra.run.smithi160:> ip netns list-id 2023-11-08T19:23:37.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:37.869 DEBUG:teuthology.orchestra.run.smithi160:> (cd / && exec bash -c ' 2023-11-08T19:23:37.869 DEBUG:teuthology.orchestra.run.smithi160:> set -e 2023-11-08T19:23:37.869 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-08T19:23:37.869 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-11-08T19:23:37.870 DEBUG:teuthology.orchestra.run.smithi160:> ') 2023-11-08T19:23:37.964 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-11-08T19:23:37.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:37.964 DEBUG:teuthology.orchestra.run.smithi160:> (cd / && exec bash -c ' 2023-11-08T19:23:37.965 DEBUG:teuthology.orchestra.run.smithi160:> set -e 2023-11-08T19:23:37.965 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-11-08T19:23:37.965 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-08T19:23:37.966 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-11-08T19:23:37.966 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-11-08T19:23:37.966 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-11-08T19:23:37.967 DEBUG:teuthology.orchestra.run.smithi160:> ') 2023-11-08T19:23:38.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:38.172 DEBUG:teuthology.orchestra.run.smithi160:> (cd / && exec bash -c ' 2023-11-08T19:23:38.172 DEBUG:teuthology.orchestra.run.smithi160:> set -e 2023-11-08T19:23:38.172 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip link set brx.0 up 2023-11-08T19:23:38.173 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip link set dev brx.0 master ceph-brx 2023-11-08T19:23:38.173 DEBUG:teuthology.orchestra.run.smithi160:> ') 2023-11-08T19:23:38.274 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-08T19:23:38.275 DEBUG:teuthology.orchestra.run.smithi160:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-08T19:23:38.294 INFO:teuthology.orchestra.run.smithi160.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-08T19:23:38.294 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-08T19:23:38.295 DEBUG:teuthology.orchestra.run.smithi160:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-08T19:23:38.350 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-08T19:23:38.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:38.351 DEBUG:teuthology.orchestra.run.smithi160:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-08T19:23:38.449 INFO:teuthology.orchestra.run.smithi160.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-08T19:23:38.449 INFO:teuthology.orchestra.run.smithi160.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-08T19:23:38.449 INFO:teuthology.orchestra.run.smithi160.stdout:invalid new device string format 2023-11-08T19:23:38.555 INFO:teuthology.orchestra.run.smithi160.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-08T19:23:38.555 INFO:teuthology.orchestra.run.smithi160.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-08T19:23:38.556 INFO:teuthology.orchestra.run.smithi160.stdout:invalid new device string format 2023-11-08T19:23:38.556 INFO:teuthology.orchestra.run.smithi160.stdout:mount.ceph: resolved to: "172.21.15.149:3300,172.21.15.160:3300,172.21.15.160:3301" 2023-11-08T19:23:38.556 INFO:teuthology.orchestra.run.smithi160.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-08T19:23:38.630 INFO:teuthology.orchestra.run.smithi160.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-08T19:23:38.630 INFO:teuthology.orchestra.run.smithi160.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-08T19:23:38.630 INFO:teuthology.orchestra.run.smithi160.stdout:invalid new device string format 2023-11-08T19:23:38.631 INFO:teuthology.orchestra.run.smithi160.stdout:mount.ceph: resolved to: "172.21.15.149:3300,172.21.15.160:3300,172.21.15.160:3301" 2023-11-08T19:23:38.631 INFO:teuthology.orchestra.run.smithi160.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-08T19:23:38.631 INFO:teuthology.orchestra.run.smithi160.stdout:mount.ceph: resolved to: "172.21.15.149:6789,172.21.15.160:6789,172.21.15.160:6790" 2023-11-08T19:23:38.631 INFO:teuthology.orchestra.run.smithi160.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.149:6789,172.21.15.160:6789,172.21.15.160:6790:/ 2023-11-08T19:23:38.631 INFO:teuthology.orchestra.run.smithi160.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=0aba7c70-fe80-4446-a2f5-7502ac3adfb4" will pass to kernel 2023-11-08T19:23:38.632 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-08T19:23:38.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:38.633 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-08T19:23:38.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:38.660 DEBUG:teuthology.orchestra.run.smithi160:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-08T19:23:38.732 INFO:teuthology.orchestra.run.smithi160.stdout:client4809 2023-11-08T19:23:38.733 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-11-08T19:23:38.733 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:23:38.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:38.790 DEBUG:teuthology.orchestra.run.smithi160:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-08T19:23:38.862 INFO:teuthology.orchestra.run.smithi160.stdout:client4809 2023-11-08T19:23:38.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:38.863 DEBUG:teuthology.orchestra.run.smithi160:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-08T19:23:38.934 INFO:teuthology.orchestra.run.smithi160.stdout:client4809 2023-11-08T19:23:38.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:38.935 DEBUG:teuthology.orchestra.run.smithi160:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/0aba7c70-fe80-4446-a2f5-7502ac3adfb4.client4809/status') 2023-11-08T19:23:39.014 INFO:teuthology.orchestra.run.smithi160.stdout:instance: client.4809 (3)172.21.15.160:0/1023321775 2023-11-08T19:23:39.015 INFO:teuthology.orchestra.run.smithi160.stdout:blocklisted: false 2023-11-08T19:23:39.015 INFO:teuthology.orchestra.run.smithi160.stderr:0+1 records in 2023-11-08T19:23:39.016 INFO:teuthology.orchestra.run.smithi160.stderr:0+1 records out 2023-11-08T19:23:39.016 INFO:teuthology.orchestra.run.smithi160.stderr:71 bytes copied, 2.0626e-05 s, 3.4 MB/s 2023-11-08T19:23:39.016 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2023-11-08T19:23:39.017 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-08T19:23:39.017 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-08T19:23:39.017 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-08T19:23:39.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.150+0000 7f4c64acb700 1 Processor -- start 2023-11-08T19:23:39.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.150+0000 7f4c64acb700 1 -- start start 2023-11-08T19:23:39.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.151+0000 7f4c64acb700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f4c600afb30 0x7f4c600ce380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:39.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.151+0000 7f4c64acb700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4c600b16b0 0x7f4c600cbf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:39.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.151+0000 7f4c64acb700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c600d1330 con 0x7f4c600b20b0 2023-11-08T19:23:39.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.151+0000 7f4c64acb700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c600cb490 con 0x7f4c600afb30 2023-11-08T19:23:39.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.151+0000 7f4c64acb700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c600cb770 con 0x7f4c600b16b0 2023-11-08T19:23:39.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.151+0000 7f4c5dd9b700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4c600b16b0 0x7f4c600cbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:39.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.151+0000 7f4c5e59c700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f4c600afb30 0x7f4c600ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:39.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.152+0000 7f4c5ed9d700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f4c600b20b0 0x7f4c600aff90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.149:51646/0 (socket says 172.21.15.149:51646) 2023-11-08T19:23:39.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.152+0000 7f4c5ed9d700 1 -- 172.21.15.149:0/2818237182 learned_addr learned my addr 172.21.15.149:0/2818237182 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:23:39.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.152+0000 7f4c5e59c700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f4c600afb30 0x7f4c600ce380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.149:38966/0 (socket says 172.21.15.149:38966) 2023-11-08T19:23:39.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.152+0000 7f4c5dd9b700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4c600b16b0 0x7f4c600cbf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.149:58262/0 (socket says 172.21.15.149:58262) 2023-11-08T19:23:39.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.152+0000 7f4c5dd9b700 1 -- 172.21.15.149:0/2818237182 >> v2:172.21.15.160:3300/0 conn(0x7f4c600afb30 msgr2=0x7f4c600ce380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:39.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.152+0000 7f4c5dd9b700 1 --2- 172.21.15.149:0/2818237182 >> v2:172.21.15.160:3300/0 conn(0x7f4c600afb30 0x7f4c600ce380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:39.158 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.152+0000 7f4c5dd9b700 1 -- 172.21.15.149:0/2818237182 >> v1:172.21.15.160:6789/0 conn(0x7f4c600b20b0 legacy=0x7f4c600aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:39.158 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.152+0000 7f4c5dd9b700 1 -- 172.21.15.149:0/2818237182 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c600cba50 con 0x7f4c600b16b0 2023-11-08T19:23:39.158 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.152+0000 7f4c5d59a700 1 -- 172.21.15.149:0/2818237182 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1389260680 0 0) 0x7f4c600d1330 con 0x7f4c600b20b0 2023-11-08T19:23:39.158 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.152+0000 7f4c5e59c700 1 --2- 172.21.15.149:0/2818237182 >> v2:172.21.15.160:3300/0 conn(0x7f4c600afb30 0x7f4c600ce380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:23:39.158 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.152+0000 7f4c5dd9b700 1 --2- 172.21.15.149:0/2818237182 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4c600b16b0 0x7f4c600cbf70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4c50009840 tx=0x7f4c50009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d675e38251c7f4 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:39.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.152+0000 7f4c5d59a700 1 -- 172.21.15.149:0/2818237182 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c50011830 con 0x7f4c600b16b0 2023-11-08T19:23:39.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.152+0000 7f4c5d59a700 1 -- 172.21.15.149:0/2818237182 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c50011990 con 0x7f4c600b16b0 2023-11-08T19:23:39.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.152+0000 7f4c5d59a700 1 -- 172.21.15.149:0/2818237182 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c50011d20 con 0x7f4c600b16b0 2023-11-08T19:23:39.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.153+0000 7f4c64acb700 1 -- 172.21.15.149:0/2818237182 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4c600b16b0 msgr2=0x7f4c600cbf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:39.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.153+0000 7f4c64acb700 1 --2- 172.21.15.149:0/2818237182 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4c600b16b0 0x7f4c600cbf70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4c50009840 tx=0x7f4c50009b50 comp rx=0 tx=0).stop 2023-11-08T19:23:39.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.153+0000 7f4c64acb700 1 -- 172.21.15.149:0/2818237182 shutdown_connections 2023-11-08T19:23:39.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.153+0000 7f4c64acb700 1 --2- 172.21.15.149:0/2818237182 >> v2:172.21.15.160:3300/0 conn(0x7f4c600afb30 0x7f4c600ce380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:39.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.153+0000 7f4c64acb700 1 --2- 172.21.15.149:0/2818237182 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4c600b16b0 0x7f4c600cbf70 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:39.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.153+0000 7f4c64acb700 1 -- 172.21.15.149:0/2818237182 >> 172.21.15.149:0/2818237182 conn(0x7f4c60099a40 msgr2=0x7f4c600d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:39.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.153+0000 7f4c64acb700 1 -- 172.21.15.149:0/2818237182 shutdown_connections 2023-11-08T19:23:39.161 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.153+0000 7f4c64acb700 1 -- 172.21.15.149:0/2818237182 wait complete. 2023-11-08T19:23:39.163 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.154+0000 7f4c64acb700 1 Processor -- start 2023-11-08T19:23:39.164 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.154+0000 7f4c64acb700 1 -- start start 2023-11-08T19:23:39.164 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.155+0000 7f4c64acb700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4c600afb30 0x7f4c6015beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:39.164 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.155+0000 7f4c64acb700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4c600b16b0 0x7f4c601f3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:39.164 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.155+0000 7f4c64acb700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4c600b20b0 0x7f4c600b4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:39.164 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.155+0000 7f4c64acb700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c600b42a0 con 0x7f4c600afb30 2023-11-08T19:23:39.165 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.155+0000 7f4c64acb700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c600b4b00 con 0x7f4c600b16b0 2023-11-08T19:23:39.165 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.155+0000 7f4c64acb700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c600c89a0 con 0x7f4c600b20b0 2023-11-08T19:23:39.165 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.155+0000 7f4c5e59c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4c600afb30 0x7f4c6015beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:39.165 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.155+0000 7f4c5dd9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4c600b16b0 0x7f4c601f3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:39.165 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.155+0000 7f4c5ed9d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4c600b20b0 0x7f4c600b4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:39.166 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.155+0000 7f4c5dd9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4c600b16b0 0x7f4c601f3ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.149:38972/0 (socket says 172.21.15.149:38972) 2023-11-08T19:23:39.166 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.155+0000 7f4c5dd9b700 1 -- 172.21.15.149:0/3040669033 learned_addr learned my addr 172.21.15.149:0/3040669033 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:39.166 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.156+0000 7f4c5dd9b700 1 -- 172.21.15.149:0/3040669033 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4c600b20b0 msgr2=0x7f4c600b4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:39.166 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.156+0000 7f4c5dd9b700 1 --2- 172.21.15.149:0/3040669033 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4c600b20b0 0x7f4c600b4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:39.166 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.156+0000 7f4c5dd9b700 1 -- 172.21.15.149:0/3040669033 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4c600afb30 msgr2=0x7f4c6015beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:39.167 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.156+0000 7f4c5dd9b700 1 --2- 172.21.15.149:0/3040669033 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4c600afb30 0x7f4c6015beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:39.167 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.156+0000 7f4c5dd9b700 1 -- 172.21.15.149:0/3040669033 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c54009430 con 0x7f4c600b16b0 2023-11-08T19:23:39.167 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.156+0000 7f4c5dd9b700 1 --2- 172.21.15.149:0/3040669033 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4c600b16b0 0x7f4c601f3ad0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4c50009fd0 tx=0x7f4c50004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:39.167 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.156+0000 7f4c4effd700 1 -- 172.21.15.149:0/3040669033 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c500036a0 con 0x7f4c600b16b0 2023-11-08T19:23:39.167 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.156+0000 7f4c4effd700 1 -- 172.21.15.149:0/3040669033 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c5001f070 con 0x7f4c600b16b0 2023-11-08T19:23:39.168 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.156+0000 7f4c64acb700 1 -- 172.21.15.149:0/3040669033 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c500094a0 con 0x7f4c600b16b0 2023-11-08T19:23:39.168 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.156+0000 7f4c4effd700 1 -- 172.21.15.149:0/3040669033 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c50003a60 con 0x7f4c600b16b0 2023-11-08T19:23:39.168 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.156+0000 7f4c64acb700 1 -- 172.21.15.149:0/3040669033 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c600b44b0 con 0x7f4c600b16b0 2023-11-08T19:23:39.168 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.157+0000 7f4c64acb700 1 -- 172.21.15.149:0/3040669033 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c600745f0 con 0x7f4c600b16b0 2023-11-08T19:23:39.168 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.157+0000 7f4c4effd700 1 -- 172.21.15.149:0/3040669033 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4c50003bc0 con 0x7f4c600b16b0 2023-11-08T19:23:39.168 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.158+0000 7f4c4effd700 1 --2- 172.21.15.149:0/3040669033 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4c4006af00 0x7f4c4006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:39.169 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.158+0000 7f4c4effd700 1 -- 172.21.15.149:0/3040669033 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4c50021070 con 0x7f4c600b16b0 2023-11-08T19:23:39.169 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.158+0000 7f4c5e59c700 1 --2- 172.21.15.149:0/3040669033 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4c4006af00 0x7f4c4006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:39.169 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.158+0000 7f4c5e59c700 1 --2- 172.21.15.149:0/3040669033 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4c4006af00 0x7f4c4006d3c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4c54009cb0 tx=0x7f4c540091c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:39.170 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.163+0000 7f4c4effd700 1 -- 172.21.15.149:0/3040669033 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4c50055e60 con 0x7f4c600b16b0 2023-11-08T19:23:39.402 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.399+0000 7f4c64acb700 1 -- 172.21.15.149:0/3040669033 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4c601e7350 con 0x7f4c600b16b0 2023-11-08T19:23:39.402 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.400+0000 7f4c4effd700 1 -- 172.21.15.149:0/3040669033 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f4c50015070 con 0x7f4c600b16b0 2023-11-08T19:23:39.402 INFO:teuthology.orchestra.run.smithi149.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-08T19:23:39.404 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.402+0000 7f4c64acb700 1 -- 172.21.15.149:0/3040669033 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4c4006af00 msgr2=0x7f4c4006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:39.404 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.402+0000 7f4c64acb700 1 --2- 172.21.15.149:0/3040669033 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4c4006af00 0x7f4c4006d3c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4c54009cb0 tx=0x7f4c540091c0 comp rx=0 tx=0).stop 2023-11-08T19:23:39.405 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.402+0000 7f4c64acb700 1 -- 172.21.15.149:0/3040669033 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4c600b16b0 msgr2=0x7f4c601f3ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:39.405 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.402+0000 7f4c64acb700 1 --2- 172.21.15.149:0/3040669033 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4c600b16b0 0x7f4c601f3ad0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4c50009fd0 tx=0x7f4c50004750 comp rx=0 tx=0).stop 2023-11-08T19:23:39.405 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.402+0000 7f4c64acb700 1 -- 172.21.15.149:0/3040669033 shutdown_connections 2023-11-08T19:23:39.405 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.402+0000 7f4c64acb700 1 --2- 172.21.15.149:0/3040669033 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4c4006af00 0x7f4c4006d3c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:39.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.402+0000 7f4c64acb700 1 --2- 172.21.15.149:0/3040669033 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4c600b20b0 0x7f4c600b4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:39.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.402+0000 7f4c64acb700 1 --2- 172.21.15.149:0/3040669033 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4c600afb30 0x7f4c6015beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:39.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.402+0000 7f4c64acb700 1 --2- 172.21.15.149:0/3040669033 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4c600b16b0 0x7f4c601f3ad0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:39.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.402+0000 7f4c64acb700 1 -- 172.21.15.149:0/3040669033 >> 172.21.15.149:0/3040669033 conn(0x7f4c60099a40 msgr2=0x7f4c6006f690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:39.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.402+0000 7f4c64acb700 1 -- 172.21.15.149:0/3040669033 shutdown_connections 2023-11-08T19:23:39.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:39.402+0000 7f4c64acb700 1 -- 172.21.15.149:0/3040669033 wait complete. 2023-11-08T19:23:39.416 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-08T19:23:39.417 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-08T19:23:39.417 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi160.front.sepia.ceph.com 2023-11-08T19:23:39.417 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-11-08T19:23:39.417 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-08T19:23:39.418 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-08T19:23:39.418 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-08T19:23:39.418 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-08T19:23:39.418 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-11-08T19:23:39.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:39.419 DEBUG:teuthology.orchestra.run.smithi160:> ip addr 2023-11-08T19:23:39.437 INFO:teuthology.orchestra.run.smithi160.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-08T19:23:39.437 INFO:teuthology.orchestra.run.smithi160.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-08T19:23:39.437 INFO:teuthology.orchestra.run.smithi160.stdout: inet 127.0.0.1/8 scope host lo 2023-11-08T19:23:39.438 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:23:39.438 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 ::1/128 scope host 2023-11-08T19:23:39.438 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:23:39.438 INFO:teuthology.orchestra.run.smithi160.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-08T19:23:39.439 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:d9:82:80 brd ff:ff:ff:ff:ff:ff 2023-11-08T19:23:39.439 INFO:teuthology.orchestra.run.smithi160.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-08T19:23:39.439 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:d9:82:81 brd ff:ff:ff:ff:ff:ff 2023-11-08T19:23:39.439 INFO:teuthology.orchestra.run.smithi160.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-08T19:23:39.440 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:88:7f:5a brd ff:ff:ff:ff:ff:ff 2023-11-08T19:23:39.440 INFO:teuthology.orchestra.run.smithi160.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-08T19:23:39.440 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:88:7f:5b brd ff:ff:ff:ff:ff:ff 2023-11-08T19:23:39.440 INFO:teuthology.orchestra.run.smithi160.stdout: inet 172.21.15.160/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-08T19:23:39.440 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft 42378sec preferred_lft 42378sec 2023-11-08T19:23:39.441 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 fe80::e47c:6a23:db24:aa59/64 scope link noprefixroute 2023-11-08T19:23:39.441 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:23:39.441 INFO:teuthology.orchestra.run.smithi160.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-08T19:23:39.441 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 52:62:d7:d8:61:23 brd ff:ff:ff:ff:ff:ff 2023-11-08T19:23:39.441 INFO:teuthology.orchestra.run.smithi160.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-08T19:23:39.441 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:23:39.442 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 fe80::383e:1fff:fe52:d5c3/64 scope link 2023-11-08T19:23:39.442 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:23:39.442 INFO:teuthology.orchestra.run.smithi160.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-08T19:23:39.443 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 52:62:d7:d8:61:23 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-08T19:23:39.443 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 fe80::5062:d7ff:fed8:6123/64 scope link 2023-11-08T19:23:39.443 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:23:39.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:39.444 DEBUG:teuthology.orchestra.run.smithi160:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-08T19:23:39.503 INFO:teuthology.orchestra.run.smithi160.stdout:1 2023-11-08T19:23:39.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:39.505 DEBUG:teuthology.orchestra.run.smithi160:> route 2023-11-08T19:23:39.563 INFO:teuthology.orchestra.run.smithi160.stdout:Kernel IP routing table 2023-11-08T19:23:39.564 INFO:teuthology.orchestra.run.smithi160.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-08T19:23:39.564 INFO:teuthology.orchestra.run.smithi160.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-08T19:23:39.564 INFO:teuthology.orchestra.run.smithi160.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-08T19:23:39.564 INFO:teuthology.orchestra.run.smithi160.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-08T19:23:39.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:39.565 DEBUG:teuthology.orchestra.run.smithi160:> (cd / && exec bash -c ' 2023-11-08T19:23:39.565 DEBUG:teuthology.orchestra.run.smithi160:> set -e 2023-11-08T19:23:39.566 DEBUG:teuthology.orchestra.run.smithi160:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-08T19:23:39.566 DEBUG:teuthology.orchestra.run.smithi160:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-08T19:23:39.566 DEBUG:teuthology.orchestra.run.smithi160:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-08T19:23:39.567 DEBUG:teuthology.orchestra.run.smithi160:> ') 2023-11-08T19:23:39.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:39.669 DEBUG:teuthology.orchestra.run.smithi160:> ip netns list 2023-11-08T19:23:39.685 INFO:teuthology.orchestra.run.smithi160.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-08T19:23:39.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:39.686 DEBUG:teuthology.orchestra.run.smithi160:> ip netns list-id 2023-11-08T19:23:39.742 INFO:teuthology.orchestra.run.smithi160.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-11-08T19:23:39.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:39.743 DEBUG:teuthology.orchestra.run.smithi160:> (cd / && exec bash -c ' 2023-11-08T19:23:39.743 DEBUG:teuthology.orchestra.run.smithi160:> set -e 2023-11-08T19:23:39.743 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-08T19:23:39.744 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-11-08T19:23:39.744 DEBUG:teuthology.orchestra.run.smithi160:> ') 2023-11-08T19:23:39.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:39.836 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-08T19:23:39.877 INFO:teuthology.orchestra.run.smithi160.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-08T19:23:39.878 INFO:teuthology.orchestra.run.smithi160.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-08T19:23:39.878 INFO:teuthology.orchestra.run.smithi160.stdout: inet 127.0.0.1/8 scope host lo 2023-11-08T19:23:39.878 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:23:39.878 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 ::1/128 scope host 2023-11-08T19:23:39.879 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:23:39.879 INFO:teuthology.orchestra.run.smithi160.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-08T19:23:39.879 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0a:43:47:3a:ce:35 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-08T19:23:39.879 INFO:teuthology.orchestra.run.smithi160.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-08T19:23:39.879 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:23:39.880 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 fe80::843:47ff:fe3a:ce35/64 scope link tentative 2023-11-08T19:23:39.880 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:23:39.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:39.891 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-08T19:23:39.964 INFO:teuthology.orchestra.run.smithi160.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-08T19:23:39.965 INFO:teuthology.orchestra.run.smithi160.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-08T19:23:39.965 INFO:teuthology.orchestra.run.smithi160.stdout: inet 127.0.0.1/8 scope host lo 2023-11-08T19:23:39.965 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:23:39.965 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 ::1/128 scope host 2023-11-08T19:23:39.966 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:23:39.966 INFO:teuthology.orchestra.run.smithi160.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-08T19:23:39.966 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0a:43:47:3a:ce:35 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-08T19:23:39.966 INFO:teuthology.orchestra.run.smithi160.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-08T19:23:39.966 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:23:39.967 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 fe80::843:47ff:fe3a:ce35/64 scope link tentative 2023-11-08T19:23:39.967 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:23:39.977 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-11-08T19:23:39.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:39.977 DEBUG:teuthology.orchestra.run.smithi160:> (cd / && exec bash -c ' 2023-11-08T19:23:39.978 DEBUG:teuthology.orchestra.run.smithi160:> set -e 2023-11-08T19:23:39.978 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-11-08T19:23:39.978 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-08T19:23:39.979 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-11-08T19:23:39.979 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-11-08T19:23:39.979 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-11-08T19:23:39.979 DEBUG:teuthology.orchestra.run.smithi160:> ') 2023-11-08T19:23:40.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:40.238 DEBUG:teuthology.orchestra.run.smithi160:> (cd / && exec bash -c ' 2023-11-08T19:23:40.239 DEBUG:teuthology.orchestra.run.smithi160:> set -e 2023-11-08T19:23:40.239 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip link set brx.1 up 2023-11-08T19:23:40.239 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip link set dev brx.1 master ceph-brx 2023-11-08T19:23:40.240 DEBUG:teuthology.orchestra.run.smithi160:> ') 2023-11-08T19:23:40.348 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-08T19:23:40.348 DEBUG:teuthology.orchestra.run.smithi160:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-11-08T19:23:40.368 INFO:teuthology.orchestra.run.smithi160.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-11-08T19:23:40.368 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-08T19:23:40.369 DEBUG:teuthology.orchestra.run.smithi160:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-11-08T19:23:40.425 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-08T19:23:40.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:40.426 DEBUG:teuthology.orchestra.run.smithi160:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-11-08T19:23:40.512 INFO:teuthology.orchestra.run.smithi160.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-11-08T19:23:40.512 INFO:teuthology.orchestra.run.smithi160.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-11-08T19:23:40.512 INFO:teuthology.orchestra.run.smithi160.stdout:invalid new device string format 2023-11-08T19:23:40.520 INFO:teuthology.orchestra.run.smithi160.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-11-08T19:23:40.521 INFO:teuthology.orchestra.run.smithi160.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-11-08T19:23:40.521 INFO:teuthology.orchestra.run.smithi160.stdout:invalid new device string format 2023-11-08T19:23:40.521 INFO:teuthology.orchestra.run.smithi160.stdout:mount.ceph: resolved to: "172.21.15.149:3300,172.21.15.160:3300,172.21.15.160:3301" 2023-11-08T19:23:40.521 INFO:teuthology.orchestra.run.smithi160.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-08T19:23:40.595 INFO:teuthology.orchestra.run.smithi160.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-11-08T19:23:40.595 INFO:teuthology.orchestra.run.smithi160.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-11-08T19:23:40.595 INFO:teuthology.orchestra.run.smithi160.stdout:invalid new device string format 2023-11-08T19:23:40.595 INFO:teuthology.orchestra.run.smithi160.stdout:mount.ceph: resolved to: "172.21.15.149:3300,172.21.15.160:3300,172.21.15.160:3301" 2023-11-08T19:23:40.596 INFO:teuthology.orchestra.run.smithi160.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-08T19:23:40.596 INFO:teuthology.orchestra.run.smithi160.stdout:mount.ceph: resolved to: "172.21.15.149:6789,172.21.15.160:6789,172.21.15.160:6790" 2023-11-08T19:23:40.596 INFO:teuthology.orchestra.run.smithi160.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.149:6789,172.21.15.160:6789,172.21.15.160:6790:/ 2023-11-08T19:23:40.596 INFO:teuthology.orchestra.run.smithi160.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=0aba7c70-fe80-4446-a2f5-7502ac3adfb4" will pass to kernel 2023-11-08T19:23:40.597 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-08T19:23:40.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:40.598 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-11-08T19:23:40.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:40.625 DEBUG:teuthology.orchestra.run.smithi160:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-08T19:23:40.697 INFO:teuthology.orchestra.run.smithi160.stdout:client4815 2023-11-08T19:23:40.698 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-11-08T19:23:40.698 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:23:40.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:40.755 DEBUG:teuthology.orchestra.run.smithi160:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-08T19:23:40.827 INFO:teuthology.orchestra.run.smithi160.stdout:client4815 2023-11-08T19:23:40.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:40.828 DEBUG:teuthology.orchestra.run.smithi160:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-08T19:23:40.899 INFO:teuthology.orchestra.run.smithi160.stdout:client4815 2023-11-08T19:23:40.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:40.900 DEBUG:teuthology.orchestra.run.smithi160:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/0aba7c70-fe80-4446-a2f5-7502ac3adfb4.client4815/status') 2023-11-08T19:23:40.980 INFO:teuthology.orchestra.run.smithi160.stdout:instance: client.4815 (3)172.21.15.160:0/2312498079 2023-11-08T19:23:40.980 INFO:teuthology.orchestra.run.smithi160.stdout:blocklisted: false 2023-11-08T19:23:40.981 INFO:teuthology.orchestra.run.smithi160.stderr:0+1 records in 2023-11-08T19:23:40.981 INFO:teuthology.orchestra.run.smithi160.stderr:0+1 records out 2023-11-08T19:23:40.981 INFO:teuthology.orchestra.run.smithi160.stderr:71 bytes copied, 3.5667e-05 s, 2.0 MB/s 2023-11-08T19:23:40.982 INFO:teuthology.run_tasks:Running task exec... 2023-11-08T19:23:40.992 INFO:teuthology.task.exec:Executing custom commands... 2023-11-08T19:23:40.993 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi149.front.sepia.ceph.com 2023-11-08T19:23:40.993 DEBUG:teuthology.orchestra.run.smithi149:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/crash/warn_recent_interval 0' 2023-11-08T19:23:41.124 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.122+0000 7ffbbe595700 1 Processor -- start 2023-11-08T19:23:41.124 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.122+0000 7ffbbe595700 1 -- start start 2023-11-08T19:23:41.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.122+0000 7ffbbe595700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffbb815bdc0 0x7ffbb80d13d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:41.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.122+0000 7ffbbe595700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7ffbb80cc9a0 0x7ffbb80d1910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:41.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.122+0000 7ffbbe595700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbb80d1e50 con 0x7ffbb815b9e0 2023-11-08T19:23:41.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.122+0000 7ffbbe595700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbb80cd760 con 0x7ffbb80cc9a0 2023-11-08T19:23:41.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.122+0000 7ffbbe595700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb80cf660 con 0x7ffbb815bdc0 2023-11-08T19:23:41.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.123+0000 7ffbb77fe700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffbb815bdc0 0x7ffbb80d13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:41.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.123+0000 7ffbbcb32700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7ffbb80cc9a0 0x7ffbb80d1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:41.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.123+0000 7ffbb77fe700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffbb815bdc0 0x7ffbb80d13d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.149:58276/0 (socket says 172.21.15.149:58276) 2023-11-08T19:23:41.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.123+0000 7ffbb77fe700 1 -- 172.21.15.149:0/4288000390 learned_addr learned my addr 172.21.15.149:0/4288000390 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:41.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.123+0000 7ffbb7fff700 1 --1- 172.21.15.149:0/4288000390 >> v1:172.21.15.160:6789/0 conn(0x7ffbb815b9e0 0x7ffbb80cc290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.149:51654/0 (socket says 172.21.15.149:51654) 2023-11-08T19:23:41.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.123+0000 7ffbb77fe700 1 -- 172.21.15.149:0/4288000390 >> v2:172.21.15.160:3300/0 conn(0x7ffbb80cc9a0 msgr2=0x7ffbb80d1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:41.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.123+0000 7ffbb77fe700 1 --2- 172.21.15.149:0/4288000390 >> v2:172.21.15.160:3300/0 conn(0x7ffbb80cc9a0 0x7ffbb80d1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:41.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.123+0000 7ffbb77fe700 1 -- 172.21.15.149:0/4288000390 >> v1:172.21.15.160:6789/0 conn(0x7ffbb815b9e0 legacy=0x7ffbb80cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:41.131 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.123+0000 7ffbb77fe700 1 -- 172.21.15.149:0/4288000390 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbb80ccec0 con 0x7ffbb815bdc0 2023-11-08T19:23:41.131 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.123+0000 7ffbbcb32700 1 --2- 172.21.15.149:0/4288000390 >> v2:172.21.15.160:3300/0 conn(0x7ffbb80cc9a0 0x7ffbb80d1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:23:41.131 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.123+0000 7ffbb77fe700 1 --2- 172.21.15.149:0/4288000390 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffbb815bdc0 0x7ffbb80d13d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ffbac0098f0 tx=0x7ffbac009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41b006d110603564 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:41.131 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.123+0000 7ffbb6ffd700 1 -- 172.21.15.149:0/4288000390 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbac011830 con 0x7ffbb815bdc0 2023-11-08T19:23:41.131 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.123+0000 7ffbb6ffd700 1 -- 172.21.15.149:0/4288000390 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbac011990 con 0x7ffbb815bdc0 2023-11-08T19:23:41.132 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.123+0000 7ffbb6ffd700 1 -- 172.21.15.149:0/4288000390 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbac011d20 con 0x7ffbb815bdc0 2023-11-08T19:23:41.132 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.124+0000 7ffbbe595700 1 -- 172.21.15.149:0/4288000390 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffbb815bdc0 msgr2=0x7ffbb80d13d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:41.132 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.124+0000 7ffbbe595700 1 --2- 172.21.15.149:0/4288000390 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffbb815bdc0 0x7ffbb80d13d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ffbac0098f0 tx=0x7ffbac009c00 comp rx=0 tx=0).stop 2023-11-08T19:23:41.132 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.124+0000 7ffbbe595700 1 -- 172.21.15.149:0/4288000390 shutdown_connections 2023-11-08T19:23:41.133 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.124+0000 7ffbbe595700 1 --2- 172.21.15.149:0/4288000390 >> v2:172.21.15.160:3300/0 conn(0x7ffbb80cc9a0 0x7ffbb80d1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:41.133 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.124+0000 7ffbbe595700 1 --2- 172.21.15.149:0/4288000390 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffbb815bdc0 0x7ffbb80d13d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:41.133 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.124+0000 7ffbbe595700 1 -- 172.21.15.149:0/4288000390 >> 172.21.15.149:0/4288000390 conn(0x7ffbb808afe0 msgr2=0x7ffbb808b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:41.133 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.124+0000 7ffbbe595700 1 -- 172.21.15.149:0/4288000390 shutdown_connections 2023-11-08T19:23:41.133 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.124+0000 7ffbbe595700 1 -- 172.21.15.149:0/4288000390 wait complete. 2023-11-08T19:23:41.134 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.125+0000 7ffbbe595700 1 Processor -- start 2023-11-08T19:23:41.134 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.125+0000 7ffbbe595700 1 -- start start 2023-11-08T19:23:41.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.126+0000 7ffbbe595700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffbb80cc9a0 0x7ffbb80c9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:41.137 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.126+0000 7ffbbe595700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffbb815b9e0 0x7ffbb81444a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:41.137 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.126+0000 7ffbbe595700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffbb815bdc0 0x7ffbb80b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:41.137 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.126+0000 7ffbbe595700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb81f4740 con 0x7ffbb80cc9a0 2023-11-08T19:23:41.137 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.126+0000 7ffbbe595700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb81449e0 con 0x7ffbb815bdc0 2023-11-08T19:23:41.138 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.126+0000 7ffbbe595700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb80c9fa0 con 0x7ffbb815b9e0 2023-11-08T19:23:41.138 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.126+0000 7ffbb7fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffbb80cc9a0 0x7ffbb80c9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:41.138 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.126+0000 7ffbb7fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffbb80cc9a0 0x7ffbb80c9910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37992/0 (socket says 172.21.15.149:37992) 2023-11-08T19:23:41.138 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.126+0000 7ffbb7fff700 1 -- 172.21.15.149:0/2557898419 learned_addr learned my addr 172.21.15.149:0/2557898419 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:41.139 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.126+0000 7ffbb77fe700 1 --2- 172.21.15.149:0/2557898419 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffbb815b9e0 0x7ffbb81444a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:41.139 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.126+0000 7ffbbcb32700 1 --2- 172.21.15.149:0/2557898419 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffbb815bdc0 0x7ffbb80b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:41.139 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.126+0000 7ffbb7fff700 1 -- 172.21.15.149:0/2557898419 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffbb815b9e0 msgr2=0x7ffbb81444a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:41.139 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.126+0000 7ffbb7fff700 1 --2- 172.21.15.149:0/2557898419 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffbb815b9e0 0x7ffbb81444a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:41.140 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.126+0000 7ffbb7fff700 1 -- 172.21.15.149:0/2557898419 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffbb815bdc0 msgr2=0x7ffbb80b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:41.140 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.126+0000 7ffbb7fff700 1 --2- 172.21.15.149:0/2557898419 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffbb815bdc0 0x7ffbb80b6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:41.140 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.126+0000 7ffbb7fff700 1 -- 172.21.15.149:0/2557898419 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbb0009a70 con 0x7ffbb80cc9a0 2023-11-08T19:23:41.140 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.127+0000 7ffbb7fff700 1 --2- 172.21.15.149:0/2557898419 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffbb80cc9a0 0x7ffbb80c9910 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ffba800c520 tx=0x7ffba800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:41.140 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.127+0000 7ffbb4ff9700 1 -- 172.21.15.149:0/2557898419 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba8005cb0 con 0x7ffbb80cc9a0 2023-11-08T19:23:41.141 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.127+0000 7ffbb4ff9700 1 -- 172.21.15.149:0/2557898419 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffba8005e10 con 0x7ffbb80cc9a0 2023-11-08T19:23:41.141 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.127+0000 7ffbbe595700 1 -- 172.21.15.149:0/2557898419 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbac009550 con 0x7ffbb80cc9a0 2023-11-08T19:23:41.141 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.127+0000 7ffbb4ff9700 1 -- 172.21.15.149:0/2557898419 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba80072d0 con 0x7ffbb80cc9a0 2023-11-08T19:23:41.141 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.127+0000 7ffbbe595700 1 -- 172.21.15.149:0/2557898419 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbb80ca840 con 0x7ffbb80cc9a0 2023-11-08T19:23:41.142 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.128+0000 7ffbbe595700 1 -- 172.21.15.149:0/2557898419 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbb80ca390 con 0x7ffbb80cc9a0 2023-11-08T19:23:41.142 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.128+0000 7ffbb4ff9700 1 -- 172.21.15.149:0/2557898419 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ffba8007430 con 0x7ffbb80cc9a0 2023-11-08T19:23:41.142 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.129+0000 7ffbb4ff9700 1 --2- 172.21.15.149:0/2557898419 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ffba406af00 0x7ffba406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:41.142 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.129+0000 7ffbb4ff9700 1 -- 172.21.15.149:0/2557898419 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ffba8088bc0 con 0x7ffbb80cc9a0 2023-11-08T19:23:41.142 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.129+0000 7ffbb77fe700 1 --2- 172.21.15.149:0/2557898419 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ffba406af00 0x7ffba406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:41.143 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.129+0000 7ffbb77fe700 1 --2- 172.21.15.149:0/2557898419 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ffba406af00 0x7ffba406d3c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ffbb815c1a0 tx=0x7ffbac01f040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:41.143 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.133+0000 7ffbb4ff9700 1 -- 172.21.15.149:0/2557898419 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ffba80539b0 con 0x7ffbb80cc9a0 2023-11-08T19:23:41.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.323+0000 7ffbbe595700 1 -- 172.21.15.149:0/2557898419 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command([{prefix=config set, name=mgr/crash/warn_recent_interval}] v 0) v1 -- 0x7ffbb80751d0 con 0x7ffbb80cc9a0 2023-11-08T19:23:41.328 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.326+0000 7ffbb4ff9700 1 -- 172.21.15.149:0/2557898419 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/crash/warn_recent_interval}]=0 v10)=0 v10) v1 ==== 128+0+0 (secure 0 0 0) 0x7ffba800ce60 con 0x7ffbb80cc9a0 2023-11-08T19:23:41.331 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.329+0000 7ffbbe595700 1 -- 172.21.15.149:0/2557898419 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ffba406af00 msgr2=0x7ffba406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:41.331 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.329+0000 7ffbbe595700 1 --2- 172.21.15.149:0/2557898419 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ffba406af00 0x7ffba406d3c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ffbb815c1a0 tx=0x7ffbac01f040 comp rx=0 tx=0).stop 2023-11-08T19:23:41.332 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.329+0000 7ffbbe595700 1 -- 172.21.15.149:0/2557898419 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffbb80cc9a0 msgr2=0x7ffbb80c9910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:41.332 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.329+0000 7ffbbe595700 1 --2- 172.21.15.149:0/2557898419 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffbb80cc9a0 0x7ffbb80c9910 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ffba800c520 tx=0x7ffba800c830 comp rx=0 tx=0).stop 2023-11-08T19:23:41.332 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.329+0000 7ffbbe595700 1 -- 172.21.15.149:0/2557898419 shutdown_connections 2023-11-08T19:23:41.332 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.329+0000 7ffbbe595700 1 --2- 172.21.15.149:0/2557898419 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ffba406af00 0x7ffba406d3c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:41.333 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.329+0000 7ffbbe595700 1 --2- 172.21.15.149:0/2557898419 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffbb815bdc0 0x7ffbb80b6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:41.333 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.329+0000 7ffbbe595700 1 --2- 172.21.15.149:0/2557898419 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffbb80cc9a0 0x7ffbb80c9910 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:41.333 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.329+0000 7ffbbe595700 1 --2- 172.21.15.149:0/2557898419 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffbb815b9e0 0x7ffbb81444a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:41.333 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.329+0000 7ffbbe595700 1 -- 172.21.15.149:0/2557898419 >> 172.21.15.149:0/2557898419 conn(0x7ffbb808afe0 msgr2=0x7ffbb80c5800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:41.334 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.329+0000 7ffbbe595700 1 -- 172.21.15.149:0/2557898419 shutdown_connections 2023-11-08T19:23:41.334 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.329+0000 7ffbbe595700 1 -- 172.21.15.149:0/2557898419 wait complete. 2023-11-08T19:23:41.343 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-11-08T19:23:41.359 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:23:41.481 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.479+0000 7fa4e140b700 1 Processor -- start 2023-11-08T19:23:41.482 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.479+0000 7fa4e140b700 1 -- start start 2023-11-08T19:23:41.484 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.480+0000 7fa4e140b700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa4dc0cc140 0x7fa4dc0cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:41.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.480+0000 7fa4e140b700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa4dc0b2850 0x7fa4dc0cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:41.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.480+0000 7fa4e140b700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4dc0cce50 con 0x7fa4dc0b2cd0 2023-11-08T19:23:41.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.480+0000 7fa4e140b700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4dc0b2430 con 0x7fa4dc0cc140 2023-11-08T19:23:41.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.480+0000 7fa4e140b700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4dc0cc520 con 0x7fa4dc0b2850 2023-11-08T19:23:41.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.480+0000 7fa4daffd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa4dc0cc140 0x7fa4dc0cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:41.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.480+0000 7fa4daffd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa4dc0cc140 0x7fa4dc0cc910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38000/0 (socket says 172.21.15.149:38000) 2023-11-08T19:23:41.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.480+0000 7fa4daffd700 1 -- 172.21.15.149:0/1824928188 learned_addr learned my addr 172.21.15.149:0/1824928188 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:41.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.480+0000 7fa4da7fc700 1 --2- 172.21.15.149:0/1824928188 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa4dc0b2850 0x7fa4dc0cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:41.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.481+0000 7fa4daffd700 1 -- 172.21.15.149:0/1824928188 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa4dc0b2850 msgr2=0x7fa4dc0cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:41.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.481+0000 7fa4daffd700 1 --2- 172.21.15.149:0/1824928188 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa4dc0b2850 0x7fa4dc0cabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:41.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.481+0000 7fa4daffd700 1 -- 172.21.15.149:0/1824928188 >> v1:172.21.15.160:6789/0 conn(0x7fa4dc0b2cd0 legacy=0x7fa4dc15d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:41.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.481+0000 7fa4daffd700 1 -- 172.21.15.149:0/1824928188 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4dc0b17b0 con 0x7fa4dc0cc140 2023-11-08T19:23:41.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.481+0000 7fa4da7fc700 1 --2- 172.21.15.149:0/1824928188 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa4dc0b2850 0x7fa4dc0cabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:23:41.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.481+0000 7fa4daffd700 1 --2- 172.21.15.149:0/1824928188 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4dc0cc140 0x7fa4dc0cc910 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0006fd0 tx=0x7fa4d0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f355526c7fdb2499 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:41.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.481+0000 7fa4d9ffb700 1 -- 172.21.15.149:0/1824928188 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d0005e30 con 0x7fa4dc0cc140 2023-11-08T19:23:41.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.481+0000 7fa4d9ffb700 1 -- 172.21.15.149:0/1824928188 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d0004030 con 0x7fa4dc0cc140 2023-11-08T19:23:41.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.481+0000 7fa4d9ffb700 1 -- 172.21.15.149:0/1824928188 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d00043e0 con 0x7fa4dc0cc140 2023-11-08T19:23:41.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.481+0000 7fa4e140b700 1 -- 172.21.15.149:0/1824928188 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4dc0cc140 msgr2=0x7fa4dc0cc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:41.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.481+0000 7fa4e140b700 1 --2- 172.21.15.149:0/1824928188 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4dc0cc140 0x7fa4dc0cc910 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0006fd0 tx=0x7fa4d0009bd0 comp rx=0 tx=0).stop 2023-11-08T19:23:41.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.481+0000 7fa4e140b700 1 -- 172.21.15.149:0/1824928188 shutdown_connections 2023-11-08T19:23:41.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.481+0000 7fa4e140b700 1 --2- 172.21.15.149:0/1824928188 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4dc0cc140 0x7fa4dc0cc910 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:41.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.481+0000 7fa4e140b700 1 --2- 172.21.15.149:0/1824928188 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa4dc0b2850 0x7fa4dc0cabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:41.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.481+0000 7fa4e140b700 1 -- 172.21.15.149:0/1824928188 >> 172.21.15.149:0/1824928188 conn(0x7fa4dc099a40 msgr2=0x7fa4dc0d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:41.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.481+0000 7fa4e140b700 1 -- 172.21.15.149:0/1824928188 shutdown_connections 2023-11-08T19:23:41.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.481+0000 7fa4e140b700 1 -- 172.21.15.149:0/1824928188 wait complete. 2023-11-08T19:23:41.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.483+0000 7fa4e140b700 1 Processor -- start 2023-11-08T19:23:41.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.483+0000 7fa4e140b700 1 -- start start 2023-11-08T19:23:41.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.484+0000 7fa4e140b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa4dc0b2850 0x7fa4dc0afe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:41.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.484+0000 7fa4e140b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4dc0b2cd0 0x7fa4dc09b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:41.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.484+0000 7fa4e140b700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa4dc0cc140 0x7fa4dc09b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:41.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.484+0000 7fa4e140b700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4dc0b0380 con 0x7fa4dc0b2cd0 2023-11-08T19:23:41.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.484+0000 7fa4e140b700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4dc0ad1c0 con 0x7fa4dc0b2850 2023-11-08T19:23:41.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.484+0000 7fa4e140b700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4dc0ad3f0 con 0x7fa4dc0cc140 2023-11-08T19:23:41.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.484+0000 7fa4da7fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4dc0b2cd0 0x7fa4dc09b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:41.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.484+0000 7fa4da7fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4dc0b2cd0 0x7fa4dc09b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38008/0 (socket says 172.21.15.149:38008) 2023-11-08T19:23:41.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.484+0000 7fa4da7fc700 1 -- 172.21.15.149:0/354076301 learned_addr learned my addr 172.21.15.149:0/354076301 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:41.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.484+0000 7fa4daffd700 1 --2- 172.21.15.149:0/354076301 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa4dc0b2850 0x7fa4dc0afe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:41.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.484+0000 7fa4db7fe700 1 --2- 172.21.15.149:0/354076301 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa4dc0cc140 0x7fa4dc09b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:41.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.484+0000 7fa4da7fc700 1 -- 172.21.15.149:0/354076301 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa4dc0cc140 msgr2=0x7fa4dc09b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:41.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.484+0000 7fa4da7fc700 1 --2- 172.21.15.149:0/354076301 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa4dc0cc140 0x7fa4dc09b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:41.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.484+0000 7fa4da7fc700 1 -- 172.21.15.149:0/354076301 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa4dc0b2850 msgr2=0x7fa4dc0afe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:41.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.484+0000 7fa4da7fc700 1 --2- 172.21.15.149:0/354076301 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa4dc0b2850 0x7fa4dc0afe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:41.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.484+0000 7fa4da7fc700 1 -- 172.21.15.149:0/354076301 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d0009500 con 0x7fa4dc0b2cd0 2023-11-08T19:23:41.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.484+0000 7fa4daffd700 1 --2- 172.21.15.149:0/354076301 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa4dc0b2850 0x7fa4dc0afe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:23:41.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.484+0000 7fa4db7fe700 1 --2- 172.21.15.149:0/354076301 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa4dc0cc140 0x7fa4dc09b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:23:41.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.484+0000 7fa4da7fc700 1 --2- 172.21.15.149:0/354076301 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4dc0b2cd0 0x7fa4dc09b120 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc00c750 tx=0x7fa4cc00cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:41.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.484+0000 7fa4c37fe700 1 -- 172.21.15.149:0/354076301 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc011800 con 0x7fa4dc0b2cd0 2023-11-08T19:23:41.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.484+0000 7fa4c37fe700 1 -- 172.21.15.149:0/354076301 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4cc011960 con 0x7fa4dc0b2cd0 2023-11-08T19:23:41.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.484+0000 7fa4c37fe700 1 -- 172.21.15.149:0/354076301 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc011cd0 con 0x7fa4dc0b2cd0 2023-11-08T19:23:41.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.484+0000 7fa4e140b700 1 -- 172.21.15.149:0/354076301 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4dc15e000 con 0x7fa4dc0b2cd0 2023-11-08T19:23:41.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.484+0000 7fa4e140b700 1 -- 172.21.15.149:0/354076301 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4dc15e5c0 con 0x7fa4dc0b2cd0 2023-11-08T19:23:41.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.485+0000 7fa4e140b700 1 -- 172.21.15.149:0/354076301 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4dc0745f0 con 0x7fa4dc0b2cd0 2023-11-08T19:23:41.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.486+0000 7fa4c37fe700 1 -- 172.21.15.149:0/354076301 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa4cc021350 con 0x7fa4dc0b2cd0 2023-11-08T19:23:41.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.486+0000 7fa4c37fe700 1 --2- 172.21.15.149:0/354076301 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa4c806af30 0x7fa4c806d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:41.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.486+0000 7fa4c37fe700 1 -- 172.21.15.149:0/354076301 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa4cc0898a0 con 0x7fa4dc0b2cd0 2023-11-08T19:23:41.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.486+0000 7fa4daffd700 1 --2- 172.21.15.149:0/354076301 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa4c806af30 0x7fa4c806d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:41.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.487+0000 7fa4daffd700 1 --2- 172.21.15.149:0/354076301 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa4c806af30 0x7fa4c806d3f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0009c10 tx=0x7fa4d0008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:41.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.491+0000 7fa4c37fe700 1 -- 172.21.15.149:0/354076301 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa4cc0545d0 con 0x7fa4dc0b2cd0 2023-11-08T19:23:41.684 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.682+0000 7fa4e140b700 1 -- 172.21.15.149:0/354076301 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa4dc0d0f20 con 0x7fa4dc0b2cd0 2023-11-08T19:23:41.685 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.683+0000 7fa4c37fe700 1 -- 172.21.15.149:0/354076301 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18382 (secure 0 0 0) 0x7fa4cc087e60 con 0x7fa4dc0b2cd0 2023-11-08T19:23:41.686 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:23:41.686 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":24,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:23:06.964482+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-08T19:22:59.830928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-08T19:23:00.886589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-08T19:23:04.574033+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:23:41.688 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.685+0000 7fa4e140b700 1 -- 172.21.15.149:0/354076301 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa4c806af30 msgr2=0x7fa4c806d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:41.688 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.685+0000 7fa4e140b700 1 --2- 172.21.15.149:0/354076301 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa4c806af30 0x7fa4c806d3f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0009c10 tx=0x7fa4d0008070 comp rx=0 tx=0).stop 2023-11-08T19:23:41.688 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.685+0000 7fa4e140b700 1 -- 172.21.15.149:0/354076301 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4dc0b2cd0 msgr2=0x7fa4dc09b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:41.688 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.685+0000 7fa4e140b700 1 --2- 172.21.15.149:0/354076301 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4dc0b2cd0 0x7fa4dc09b120 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc00c750 tx=0x7fa4cc00cb10 comp rx=0 tx=0).stop 2023-11-08T19:23:41.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.685+0000 7fa4e140b700 1 -- 172.21.15.149:0/354076301 shutdown_connections 2023-11-08T19:23:41.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.685+0000 7fa4e140b700 1 --2- 172.21.15.149:0/354076301 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa4c806af30 0x7fa4c806d3f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:41.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.685+0000 7fa4e140b700 1 --2- 172.21.15.149:0/354076301 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa4dc0b2850 0x7fa4dc0afe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:41.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.685+0000 7fa4e140b700 1 --2- 172.21.15.149:0/354076301 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa4dc0cc140 0x7fa4dc09b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:41.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.685+0000 7fa4e140b700 1 --2- 172.21.15.149:0/354076301 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4dc0b2cd0 0x7fa4dc09b120 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:41.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.685+0000 7fa4e140b700 1 -- 172.21.15.149:0/354076301 >> 172.21.15.149:0/354076301 conn(0x7fa4dc099a40 msgr2=0x7fa4dc06ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:41.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.685+0000 7fa4e140b700 1 -- 172.21.15.149:0/354076301 shutdown_connections 2023-11-08T19:23:41.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.685+0000 7fa4e140b700 1 -- 172.21.15.149:0/354076301 wait complete. 2023-11-08T19:23:41.700 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-08T19:22:56.023194+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-08T19:22:59.830928+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-08T19:23:00.886589+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-08T19:23:04.574033+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-08T19:23:41.701 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-08T19:23:41.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.822+0000 7f0326d0f700 1 Processor -- start 2023-11-08T19:23:41.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.822+0000 7f0326d0f700 1 -- start start 2023-11-08T19:23:41.827 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.823+0000 7f0326d0f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f032006ab80 0x7f03200caf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:41.827 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.823+0000 7f0326d0f700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f03200cf1c0 0x7f03200cb490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:41.827 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.823+0000 7f0326d0f700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f032015e320 con 0x7f032015df40 2023-11-08T19:23:41.828 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.823+0000 7f0326d0f700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f032006b020 con 0x7f03200cf1c0 2023-11-08T19:23:41.828 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.823+0000 7f0326d0f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f032006b2e0 con 0x7f032006ab80 2023-11-08T19:23:41.828 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.823+0000 7f03252ac700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f03200cf1c0 0x7f03200cb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:41.828 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.823+0000 7f03252ac700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f03200cf1c0 0x7f03200cb490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38018/0 (socket says 172.21.15.149:38018) 2023-11-08T19:23:41.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.823+0000 7f03252ac700 1 -- 172.21.15.149:0/183124443 learned_addr learned my addr 172.21.15.149:0/183124443 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:41.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.823+0000 7f0324aab700 1 --1- 172.21.15.149:0/183124443 >> v1:172.21.15.149:6789/0 conn(0x7f032015df40 0x7f032006c0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:40016/0 (socket says 172.21.15.149:40016) 2023-11-08T19:23:41.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.823+0000 7f031ffff700 1 --2- 172.21.15.149:0/183124443 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f032006ab80 0x7f03200caf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:41.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.823+0000 7f03252ac700 1 -- 172.21.15.149:0/183124443 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f032006ab80 msgr2=0x7f03200caf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:41.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.823+0000 7f03252ac700 1 --2- 172.21.15.149:0/183124443 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f032006ab80 0x7f03200caf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:41.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.823+0000 7f03252ac700 1 -- 172.21.15.149:0/183124443 >> v1:172.21.15.149:6789/0 conn(0x7f032015df40 legacy=0x7f032006c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:41.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.824+0000 7f03252ac700 1 -- 172.21.15.149:0/183124443 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f032006b5c0 con 0x7f03200cf1c0 2023-11-08T19:23:41.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.824+0000 7f031f7fe700 1 -- 172.21.15.149:0/183124443 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3567538508 0 0) 0x7f032015e320 con 0x7f032015df40 2023-11-08T19:23:41.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.824+0000 7f03252ac700 1 --2- 172.21.15.149:0/183124443 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03200cf1c0 0x7f03200cb490 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0318009e50 tx=0x7f031800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41028872168f103c server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:41.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.824+0000 7f031f7fe700 1 -- 172.21.15.149:0/183124443 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031800e070 con 0x7f03200cf1c0 2023-11-08T19:23:41.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.824+0000 7f031f7fe700 1 -- 172.21.15.149:0/183124443 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f031800b910 con 0x7f03200cf1c0 2023-11-08T19:23:41.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.824+0000 7f031f7fe700 1 -- 172.21.15.149:0/183124443 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031800bcc0 con 0x7f03200cf1c0 2023-11-08T19:23:41.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.824+0000 7f0326d0f700 1 -- 172.21.15.149:0/183124443 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03200cf1c0 msgr2=0x7f03200cb490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:41.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.824+0000 7f0326d0f700 1 --2- 172.21.15.149:0/183124443 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03200cf1c0 0x7f03200cb490 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0318009e50 tx=0x7f031800b330 comp rx=0 tx=0).stop 2023-11-08T19:23:41.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.824+0000 7f0326d0f700 1 -- 172.21.15.149:0/183124443 shutdown_connections 2023-11-08T19:23:41.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.824+0000 7f0326d0f700 1 --2- 172.21.15.149:0/183124443 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03200cf1c0 0x7f03200cb490 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:41.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.824+0000 7f0326d0f700 1 --2- 172.21.15.149:0/183124443 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f032006ab80 0x7f03200caf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:41.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.824+0000 7f0326d0f700 1 -- 172.21.15.149:0/183124443 >> 172.21.15.149:0/183124443 conn(0x7f03200d0640 msgr2=0x7f03200d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:41.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.824+0000 7f0326d0f700 1 -- 172.21.15.149:0/183124443 shutdown_connections 2023-11-08T19:23:41.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.824+0000 7f0326d0f700 1 -- 172.21.15.149:0/183124443 wait complete. 2023-11-08T19:23:41.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.826+0000 7f0326d0f700 1 Processor -- start 2023-11-08T19:23:41.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.826+0000 7f0326d0f700 1 -- start start 2023-11-08T19:23:41.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.826+0000 7f0326d0f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f032006ab80 0x7f032014ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:41.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.826+0000 7f0326d0f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03200cf1c0 0x7f03201606a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:41.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.826+0000 7f0326d0f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f032015df40 0x7f032015f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:41.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.826+0000 7f0326d0f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f032015edf0 con 0x7f032015df40 2023-11-08T19:23:41.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.826+0000 7f0326d0f700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f032014bfb0 con 0x7f03200cf1c0 2023-11-08T19:23:41.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.826+0000 7f0326d0f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0320161140 con 0x7f032006ab80 2023-11-08T19:23:41.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.827+0000 7f03252ac700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f032015df40 0x7f032015f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:41.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.827+0000 7f03252ac700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f032015df40 0x7f032015f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38024/0 (socket says 172.21.15.149:38024) 2023-11-08T19:23:41.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.827+0000 7f03252ac700 1 -- 172.21.15.149:0/474956954 learned_addr learned my addr 172.21.15.149:0/474956954 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:41.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.827+0000 7f031ffff700 1 --2- 172.21.15.149:0/474956954 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03200cf1c0 0x7f03201606a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:41.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.827+0000 7f0324aab700 1 --2- 172.21.15.149:0/474956954 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f032006ab80 0x7f032014ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:41.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.827+0000 7f03252ac700 1 -- 172.21.15.149:0/474956954 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f032006ab80 msgr2=0x7f032014ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:41.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.827+0000 7f03252ac700 1 --2- 172.21.15.149:0/474956954 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f032006ab80 0x7f032014ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:41.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.827+0000 7f03252ac700 1 -- 172.21.15.149:0/474956954 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03200cf1c0 msgr2=0x7f03201606a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:41.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.827+0000 7f03252ac700 1 --2- 172.21.15.149:0/474956954 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03200cf1c0 0x7f03201606a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:41.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.827+0000 7f03252ac700 1 -- 172.21.15.149:0/474956954 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0318009b30 con 0x7f032015df40 2023-11-08T19:23:41.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.827+0000 7f0324aab700 1 --2- 172.21.15.149:0/474956954 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f032006ab80 0x7f032014ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:23:41.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.827+0000 7f03252ac700 1 --2- 172.21.15.149:0/474956954 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f032015df40 0x7f032015f210 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f031800b680 tx=0x7f0318004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:41.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.827+0000 7f031d7fa700 1 -- 172.21.15.149:0/474956954 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03180099b0 con 0x7f032015df40 2023-11-08T19:23:41.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.827+0000 7f031d7fa700 1 -- 172.21.15.149:0/474956954 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03180092e0 con 0x7f032015df40 2023-11-08T19:23:41.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.827+0000 7f031d7fa700 1 -- 172.21.15.149:0/474956954 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031801c660 con 0x7f032015df40 2023-11-08T19:23:41.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.827+0000 7f0326d0f700 1 -- 172.21.15.149:0/474956954 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f032015e450 con 0x7f032015df40 2023-11-08T19:23:41.842 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.827+0000 7f0326d0f700 1 -- 172.21.15.149:0/474956954 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f032015ea10 con 0x7f032015df40 2023-11-08T19:23:41.842 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.828+0000 7f0326d0f700 1 -- 172.21.15.149:0/474956954 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f032015ef30 con 0x7f032015df40 2023-11-08T19:23:41.842 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.829+0000 7f031d7fa700 1 -- 172.21.15.149:0/474956954 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f031801c7c0 con 0x7f032015df40 2023-11-08T19:23:41.842 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.829+0000 7f031d7fa700 1 --2- 172.21.15.149:0/474956954 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f030406af00 0x7f030406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:41.842 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.829+0000 7f031d7fa700 1 -- 172.21.15.149:0/474956954 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f031808b640 con 0x7f032015df40 2023-11-08T19:23:41.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.829+0000 7f0324aab700 1 --2- 172.21.15.149:0/474956954 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f030406af00 0x7f030406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:41.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.829+0000 7f0324aab700 1 --2- 172.21.15.149:0/474956954 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f030406af00 0x7f030406d3c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0314007fd0 tx=0x7f0314009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:41.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:41.834+0000 7f031d7fa700 1 -- 172.21.15.149:0/474956954 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0318056490 con 0x7f032015df40 2023-11-08T19:23:42.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.021+0000 7f0326d0f700 1 -- 172.21.15.149:0/474956954 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f032004f730 con 0x7f032015df40 2023-11-08T19:23:42.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.022+0000 7f031d7fa700 1 -- 172.21.15.149:0/474956954 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0318059ab0 con 0x7f032015df40 2023-11-08T19:23:42.024 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 1 2023-11-08T19:23:42.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.024+0000 7f0326d0f700 1 -- 172.21.15.149:0/474956954 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f030406af00 msgr2=0x7f030406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:42.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.024+0000 7f0326d0f700 1 --2- 172.21.15.149:0/474956954 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f030406af00 0x7f030406d3c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0314007fd0 tx=0x7f0314009040 comp rx=0 tx=0).stop 2023-11-08T19:23:42.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.024+0000 7f0326d0f700 1 -- 172.21.15.149:0/474956954 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f032015df40 msgr2=0x7f032015f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:42.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.024+0000 7f0326d0f700 1 --2- 172.21.15.149:0/474956954 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f032015df40 0x7f032015f210 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f031800b680 tx=0x7f0318004ad0 comp rx=0 tx=0).stop 2023-11-08T19:23:42.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.024+0000 7f0326d0f700 1 -- 172.21.15.149:0/474956954 shutdown_connections 2023-11-08T19:23:42.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.024+0000 7f0326d0f700 1 --2- 172.21.15.149:0/474956954 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f030406af00 0x7f030406d3c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:42.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.024+0000 7f0326d0f700 1 --2- 172.21.15.149:0/474956954 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f032015df40 0x7f032015f210 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:42.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.024+0000 7f0326d0f700 1 --2- 172.21.15.149:0/474956954 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f032006ab80 0x7f032014ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:42.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.024+0000 7f0326d0f700 1 --2- 172.21.15.149:0/474956954 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03200cf1c0 0x7f03201606a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:42.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.024+0000 7f0326d0f700 1 -- 172.21.15.149:0/474956954 >> 172.21.15.149:0/474956954 conn(0x7f03200d0640 msgr2=0x7f03200cd0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:42.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.024+0000 7f0326d0f700 1 -- 172.21.15.149:0/474956954 shutdown_connections 2023-11-08T19:23:42.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.024+0000 7f0326d0f700 1 -- 172.21.15.149:0/474956954 wait complete. 2023-11-08T19:23:42.038 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-08T19:23:42.162 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.160+0000 7f5b4a225700 1 Processor -- start 2023-11-08T19:23:42.163 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.160+0000 7f5b4a225700 1 -- start start 2023-11-08T19:23:42.165 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.161+0000 7f5b4a225700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b4415df40 0x7f5b4406c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:42.165 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.161+0000 7f5b4a225700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f5b4406ab80 0x7f5b4406c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:42.165 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.161+0000 7f5b4a225700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b4415e320 con 0x7f5b440cf1c0 2023-11-08T19:23:42.166 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.161+0000 7f5b4a225700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b4406b020 con 0x7f5b4406ab80 2023-11-08T19:23:42.166 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.161+0000 7f5b4a225700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4406b2e0 con 0x7f5b4415df40 2023-11-08T19:23:42.166 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.161+0000 7f5b437fe700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b4415df40 0x7f5b4406c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:42.166 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.161+0000 7f5b42ffd700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f5b4406ab80 0x7f5b4406c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:42.167 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.161+0000 7f5b437fe700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b4415df40 0x7f5b4406c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.149:58316/0 (socket says 172.21.15.149:58316) 2023-11-08T19:23:42.167 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.161+0000 7f5b43fff700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f5b440cf1c0 0x7f5b440caf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.149:51698/0 (socket says 172.21.15.149:51698) 2023-11-08T19:23:42.167 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.161+0000 7f5b437fe700 1 -- 172.21.15.149:0/1447746653 learned_addr learned my addr 172.21.15.149:0/1447746653 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:42.167 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.161+0000 7f5b42ffd700 1 -- 172.21.15.149:0/1447746653 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b4415df40 msgr2=0x7f5b4406c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:42.167 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.161+0000 7f5b42ffd700 1 --2- 172.21.15.149:0/1447746653 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b4415df40 0x7f5b4406c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:42.168 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.161+0000 7f5b42ffd700 1 -- 172.21.15.149:0/1447746653 >> v1:172.21.15.160:6789/0 conn(0x7f5b440cf1c0 legacy=0x7f5b440caf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:42.168 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.161+0000 7f5b42ffd700 1 -- 172.21.15.149:0/1447746653 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b4406b5c0 con 0x7f5b4406ab80 2023-11-08T19:23:42.168 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.161+0000 7f5b427fc700 1 -- 172.21.15.149:0/1447746653 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 398062857 0 0) 0x7f5b4415e320 con 0x7f5b440cf1c0 2023-11-08T19:23:42.168 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.162+0000 7f5b42ffd700 1 --2- 172.21.15.149:0/1447746653 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b4406ab80 0x7f5b4406c5e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5b34009840 tx=0x7f5b34009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5ced6cde5b8493a server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:42.168 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.162+0000 7f5b427fc700 1 -- 172.21.15.149:0/1447746653 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b34011830 con 0x7f5b4406ab80 2023-11-08T19:23:42.169 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.162+0000 7f5b427fc700 1 -- 172.21.15.149:0/1447746653 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b34011990 con 0x7f5b4406ab80 2023-11-08T19:23:42.169 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.162+0000 7f5b427fc700 1 -- 172.21.15.149:0/1447746653 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b34011d20 con 0x7f5b4406ab80 2023-11-08T19:23:42.169 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.162+0000 7f5b4a225700 1 -- 172.21.15.149:0/1447746653 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b4406ab80 msgr2=0x7f5b4406c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:42.169 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.162+0000 7f5b4a225700 1 --2- 172.21.15.149:0/1447746653 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b4406ab80 0x7f5b4406c5e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5b34009840 tx=0x7f5b34009b50 comp rx=0 tx=0).stop 2023-11-08T19:23:42.169 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.162+0000 7f5b4a225700 1 -- 172.21.15.149:0/1447746653 shutdown_connections 2023-11-08T19:23:42.170 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.162+0000 7f5b4a225700 1 --2- 172.21.15.149:0/1447746653 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b4415df40 0x7f5b4406c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:42.170 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.162+0000 7f5b4a225700 1 --2- 172.21.15.149:0/1447746653 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b4406ab80 0x7f5b4406c5e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:42.170 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.162+0000 7f5b4a225700 1 -- 172.21.15.149:0/1447746653 >> 172.21.15.149:0/1447746653 conn(0x7f5b440d0640 msgr2=0x7f5b440d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:42.170 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.162+0000 7f5b4a225700 1 -- 172.21.15.149:0/1447746653 shutdown_connections 2023-11-08T19:23:42.170 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.162+0000 7f5b4a225700 1 -- 172.21.15.149:0/1447746653 wait complete. 2023-11-08T19:23:42.173 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.164+0000 7f5b4a225700 1 Processor -- start 2023-11-08T19:23:42.173 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.164+0000 7f5b4a225700 1 -- start start 2023-11-08T19:23:42.174 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.164+0000 7f5b4a225700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b4406ab80 0x7f5b440af170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:42.174 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.164+0000 7f5b4a225700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b440cf1c0 0x7f5b441f6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:42.174 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.164+0000 7f5b4a225700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b4415df40 0x7f5b4415a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:42.174 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.164+0000 7f5b4a225700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4414a8e0 con 0x7f5b4415df40 2023-11-08T19:23:42.174 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.164+0000 7f5b4a225700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4414abc0 con 0x7f5b440cf1c0 2023-11-08T19:23:42.175 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.164+0000 7f5b4a225700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4414aea0 con 0x7f5b4406ab80 2023-11-08T19:23:42.175 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.165+0000 7f5b43fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b4415df40 0x7f5b4415a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:42.175 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.165+0000 7f5b43fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b4415df40 0x7f5b4415a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38036/0 (socket says 172.21.15.149:38036) 2023-11-08T19:23:42.175 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.165+0000 7f5b43fff700 1 -- 172.21.15.149:0/3619874298 learned_addr learned my addr 172.21.15.149:0/3619874298 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:42.175 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.165+0000 7f5b42ffd700 1 --2- 172.21.15.149:0/3619874298 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b440cf1c0 0x7f5b441f6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:42.176 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.165+0000 7f5b437fe700 1 --2- 172.21.15.149:0/3619874298 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b4406ab80 0x7f5b440af170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:42.176 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.165+0000 7f5b43fff700 1 -- 172.21.15.149:0/3619874298 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b4406ab80 msgr2=0x7f5b440af170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:42.176 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.165+0000 7f5b43fff700 1 --2- 172.21.15.149:0/3619874298 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b4406ab80 0x7f5b440af170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:42.176 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.165+0000 7f5b43fff700 1 -- 172.21.15.149:0/3619874298 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b440cf1c0 msgr2=0x7f5b441f6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:42.176 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.165+0000 7f5b43fff700 1 --2- 172.21.15.149:0/3619874298 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b440cf1c0 0x7f5b441f6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:42.177 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.165+0000 7f5b43fff700 1 -- 172.21.15.149:0/3619874298 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b340094a0 con 0x7f5b4415df40 2023-11-08T19:23:42.177 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.165+0000 7f5b437fe700 1 --2- 172.21.15.149:0/3619874298 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b4406ab80 0x7f5b440af170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:23:42.177 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.165+0000 7f5b43fff700 1 --2- 172.21.15.149:0/3619874298 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b4415df40 0x7f5b4415a7c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c002230 tx=0x7f5b3c00cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:42.177 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.165+0000 7f5b2bfff700 1 -- 172.21.15.149:0/3619874298 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3c00ab70 con 0x7f5b4415df40 2023-11-08T19:23:42.177 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.165+0000 7f5b2bfff700 1 -- 172.21.15.149:0/3619874298 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b3c00acf0 con 0x7f5b4415df40 2023-11-08T19:23:42.178 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.165+0000 7f5b2bfff700 1 -- 172.21.15.149:0/3619874298 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3c007310 con 0x7f5b4415df40 2023-11-08T19:23:42.178 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.165+0000 7f5b4a225700 1 -- 172.21.15.149:0/3619874298 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b4414b180 con 0x7f5b4415df40 2023-11-08T19:23:42.178 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.165+0000 7f5b4a225700 1 -- 172.21.15.149:0/3619874298 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b4414b740 con 0x7f5b4415df40 2023-11-08T19:23:42.178 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.166+0000 7f5b4a225700 1 -- 172.21.15.149:0/3619874298 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b4404f730 con 0x7f5b4415df40 2023-11-08T19:23:42.178 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.167+0000 7f5b2bfff700 1 -- 172.21.15.149:0/3619874298 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5b3c007470 con 0x7f5b4415df40 2023-11-08T19:23:42.179 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.167+0000 7f5b2bfff700 1 --2- 172.21.15.149:0/3619874298 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5b3006af00 0x7f5b3006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:42.179 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.167+0000 7f5b2bfff700 1 -- 172.21.15.149:0/3619874298 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5b3c089350 con 0x7f5b4415df40 2023-11-08T19:23:42.179 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.167+0000 7f5b437fe700 1 --2- 172.21.15.149:0/3619874298 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5b3006af00 0x7f5b3006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:42.179 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.167+0000 7f5b437fe700 1 --2- 172.21.15.149:0/3619874298 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5b3006af00 0x7f5b3006d3c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5b38009c20 tx=0x7f5b38008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:42.180 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.172+0000 7f5b2bfff700 1 -- 172.21.15.149:0/3619874298 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5b3c054110 con 0x7f5b4415df40 2023-11-08T19:23:42.366 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.363+0000 7f5b4a225700 1 -- 172.21.15.149:0/3619874298 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5b440cd1f0 con 0x7f5b4415df40 2023-11-08T19:23:42.366 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.364+0000 7f5b2bfff700 1 -- 172.21.15.149:0/3619874298 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5b3c00ae60 con 0x7f5b4415df40 2023-11-08T19:23:42.367 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:23:42.369 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.366+0000 7f5b4a225700 1 -- 172.21.15.149:0/3619874298 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5b3006af00 msgr2=0x7f5b3006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:42.369 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.366+0000 7f5b4a225700 1 --2- 172.21.15.149:0/3619874298 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5b3006af00 0x7f5b3006d3c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5b38009c20 tx=0x7f5b38008040 comp rx=0 tx=0).stop 2023-11-08T19:23:42.369 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.366+0000 7f5b4a225700 1 -- 172.21.15.149:0/3619874298 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b4415df40 msgr2=0x7f5b4415a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:42.369 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.366+0000 7f5b4a225700 1 --2- 172.21.15.149:0/3619874298 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b4415df40 0x7f5b4415a7c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c002230 tx=0x7f5b3c00cf50 comp rx=0 tx=0).stop 2023-11-08T19:23:42.370 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.366+0000 7f5b4a225700 1 -- 172.21.15.149:0/3619874298 shutdown_connections 2023-11-08T19:23:42.370 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.366+0000 7f5b4a225700 1 --2- 172.21.15.149:0/3619874298 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5b3006af00 0x7f5b3006d3c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:42.370 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.366+0000 7f5b4a225700 1 --2- 172.21.15.149:0/3619874298 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b4415df40 0x7f5b4415a7c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:42.370 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.366+0000 7f5b4a225700 1 --2- 172.21.15.149:0/3619874298 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b4406ab80 0x7f5b440af170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:42.371 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.366+0000 7f5b4a225700 1 --2- 172.21.15.149:0/3619874298 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b440cf1c0 0x7f5b441f6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:42.371 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.366+0000 7f5b4a225700 1 -- 172.21.15.149:0/3619874298 >> 172.21.15.149:0/3619874298 conn(0x7f5b440d0640 msgr2=0x7f5b440cd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:42.371 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.367+0000 7f5b4a225700 1 -- 172.21.15.149:0/3619874298 shutdown_connections 2023-11-08T19:23:42.371 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.367+0000 7f5b4a225700 1 -- 172.21.15.149:0/3619874298 wait complete. 2023-11-08T19:23:42.381 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-08T19:23:42.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.502+0000 7fb87f59e700 1 Processor -- start 2023-11-08T19:23:42.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.502+0000 7fb87f59e700 1 -- start start 2023-11-08T19:23:42.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.503+0000 7fb87f59e700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb88015d790 0x7fb8800ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:42.509 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.503+0000 7fb87f59e700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb880162460 con 0x7fb88006e930 2023-11-08T19:23:42.509 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.503+0000 7fb87f59e700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8801618e0 con 0x7fb8800cab10 2023-11-08T19:23:42.509 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.503+0000 7fb87f59e700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb880161bc0 con 0x7fb88015d790 2023-11-08T19:23:42.509 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.503+0000 7fb87ed9d700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fb88006e930 0x7fb8800720e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:40046/0 (socket says 172.21.15.149:40046) 2023-11-08T19:23:42.510 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.503+0000 7fb87ed9d700 1 -- 172.21.15.149:0/219834254 learned_addr learned my addr 172.21.15.149:0/219834254 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:23:42.510 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.503+0000 7fb87e59c700 1 --2- 172.21.15.149:0/219834254 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb88015d790 0x7fb8800ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:42.510 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.503+0000 7fb87d59a700 1 -- 172.21.15.149:0/219834254 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1808893323 0 0) 0x7fb880162460 con 0x7fb88006e930 2023-11-08T19:23:42.510 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.503+0000 7fb87d59a700 1 -- 172.21.15.149:0/219834254 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8680035b0 con 0x7fb88006e930 2023-11-08T19:23:42.511 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.504+0000 7fb87d59a700 1 -- 172.21.15.149:0/219834254 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1324930829 0 0) 0x7fb8680035b0 con 0x7fb88006e930 2023-11-08T19:23:42.511 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.504+0000 7fb87d59a700 1 -- 172.21.15.149:0/219834254 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb88015d790 msgr2=0x7fb8800ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:42.511 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.504+0000 7fb87d59a700 1 --2- 172.21.15.149:0/219834254 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb88015d790 0x7fb8800ceaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:42.511 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.504+0000 7fb87d59a700 1 -- 172.21.15.149:0/219834254 >> v1:172.21.15.160:6789/0 conn(0x7fb8800cab10 legacy=0x7fb88006e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:42.511 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.504+0000 7fb87d59a700 1 -- 172.21.15.149:0/219834254 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb880161ea0 con 0x7fb88006e930 2023-11-08T19:23:42.512 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.504+0000 7fb87d59a700 1 -- 172.21.15.149:0/219834254 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7fb8780019f0 con 0x7fb88006e930 2023-11-08T19:23:42.512 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.504+0000 7fb87d59a700 1 -- 172.21.15.149:0/219834254 >> v1:172.21.15.149:6789/0 conn(0x7fb88006e930 legacy=0x7fb8800720e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:42.512 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.504+0000 7fb87d59a700 1 --2- 172.21.15.149:0/219834254 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb868003aa0 0x7fb868003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:42.512 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.504+0000 7fb87d59a700 1 --2- 172.21.15.149:0/219834254 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb868004850 0x7fb868004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:42.512 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.504+0000 7fb87d59a700 1 --2- 172.21.15.149:0/219834254 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb88015d790 0x7fb868005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:42.513 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.504+0000 7fb87d59a700 1 -- 172.21.15.149:0/219834254 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb880161bc0 con 0x7fb868003aa0 2023-11-08T19:23:42.513 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.504+0000 7fb87d59a700 1 -- 172.21.15.149:0/219834254 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb86800bb20 con 0x7fb868004850 2023-11-08T19:23:42.513 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.504+0000 7fb87d59a700 1 -- 172.21.15.149:0/219834254 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb86800bce0 con 0x7fb88015d790 2023-11-08T19:23:42.513 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.504+0000 7fb87e59c700 1 --2- 172.21.15.149:0/219834254 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb868003aa0 0x7fb868003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:42.513 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.504+0000 7fb87dd9b700 1 --2- 172.21.15.149:0/219834254 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb868004850 0x7fb868004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:42.513 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.504+0000 7fb87ed9d700 1 --2- 172.21.15.149:0/219834254 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb88015d790 0x7fb868005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:42.514 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.504+0000 7fb87e59c700 1 -- 172.21.15.149:0/219834254 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb88015d790 msgr2=0x7fb868005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:42.514 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.504+0000 7fb87e59c700 1 --2- 172.21.15.149:0/219834254 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb88015d790 0x7fb868005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:42.514 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.504+0000 7fb87e59c700 1 -- 172.21.15.149:0/219834254 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb868004850 msgr2=0x7fb868004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:42.514 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.504+0000 7fb87e59c700 1 --2- 172.21.15.149:0/219834254 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb868004850 0x7fb868004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:42.515 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.504+0000 7fb87e59c700 1 -- 172.21.15.149:0/219834254 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8680035b0 con 0x7fb868003aa0 2023-11-08T19:23:42.515 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.504+0000 7fb87ed9d700 1 --2- 172.21.15.149:0/219834254 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb88015d790 0x7fb868005230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:23:42.515 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.504+0000 7fb87e59c700 1 --2- 172.21.15.149:0/219834254 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb868003aa0 0x7fb868003e80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb874009b60 tx=0x7fb868005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e93cf5379d1e09ec server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:42.515 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.504+0000 7fb87d59a700 1 -- 172.21.15.149:0/219834254 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb87400e6c0 con 0x7fb868003aa0 2023-11-08T19:23:42.515 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.504+0000 7fb87d59a700 1 -- 172.21.15.149:0/219834254 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb87400e820 con 0x7fb868003aa0 2023-11-08T19:23:42.515 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.504+0000 7fb87d59a700 1 -- 172.21.15.149:0/219834254 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb87400eb90 con 0x7fb868003aa0 2023-11-08T19:23:42.516 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.505+0000 7fb87f59e700 1 -- 172.21.15.149:0/219834254 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb868003aa0 msgr2=0x7fb868003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:42.516 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.505+0000 7fb87f59e700 1 --2- 172.21.15.149:0/219834254 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb868003aa0 0x7fb868003e80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb874009b60 tx=0x7fb868005880 comp rx=0 tx=0).stop 2023-11-08T19:23:42.516 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.505+0000 7fb87ed9d700 1 -- 172.21.15.149:0/219834254 reap_dead start 2023-11-08T19:23:42.516 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.505+0000 7fb87f59e700 1 -- 172.21.15.149:0/219834254 shutdown_connections 2023-11-08T19:23:42.517 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.505+0000 7fb87f59e700 1 -- 172.21.15.149:0/219834254 >> 172.21.15.149:0/219834254 conn(0x7fb88006c080 msgr2=0x7fb88006c490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:42.517 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.505+0000 7fb87f59e700 1 -- 172.21.15.149:0/219834254 shutdown_connections 2023-11-08T19:23:42.517 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.505+0000 7fb87f59e700 1 -- 172.21.15.149:0/219834254 wait complete. 2023-11-08T19:23:42.517 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.506+0000 7fb87f59e700 1 Processor -- start 2023-11-08T19:23:42.517 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.506+0000 7fb87f59e700 1 -- start start 2023-11-08T19:23:42.520 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.507+0000 7fb87f59e700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb868003aa0 0x7fb88015a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:42.520 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.507+0000 7fb87f59e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8800adf60 0x7fb8800ae3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:42.520 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.507+0000 7fb87f59e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8800b0c50 0x7fb8800b10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:42.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.507+0000 7fb87f59e700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8800b1610 con 0x7fb8800b0c50 2023-11-08T19:23:42.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.507+0000 7fb87f59e700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8801f4020 con 0x7fb8800adf60 2023-11-08T19:23:42.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.507+0000 7fb87f59e700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8801f3450 con 0x7fb868003aa0 2023-11-08T19:23:42.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.507+0000 7fb87ed9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8800b0c50 0x7fb8800b10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:42.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.507+0000 7fb87ed9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8800b0c50 0x7fb8800b10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38056/0 (socket says 172.21.15.149:38056) 2023-11-08T19:23:42.522 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.507+0000 7fb87ed9d700 1 -- 172.21.15.149:0/1170696767 learned_addr learned my addr 172.21.15.149:0/1170696767 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:42.522 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.507+0000 7fb87dd9b700 1 --2- 172.21.15.149:0/1170696767 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8800adf60 0x7fb8800ae3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:42.522 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.507+0000 7fb87e59c700 1 --2- 172.21.15.149:0/1170696767 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb868003aa0 0x7fb88015a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:42.522 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.508+0000 7fb87ed9d700 1 -- 172.21.15.149:0/1170696767 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb868003aa0 msgr2=0x7fb88015a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:42.522 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.508+0000 7fb87ed9d700 1 --2- 172.21.15.149:0/1170696767 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb868003aa0 0x7fb88015a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:42.523 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.508+0000 7fb87ed9d700 1 -- 172.21.15.149:0/1170696767 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8800adf60 msgr2=0x7fb8800ae3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:42.523 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.508+0000 7fb87ed9d700 1 --2- 172.21.15.149:0/1170696767 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8800adf60 0x7fb8800ae3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:42.523 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.508+0000 7fb87ed9d700 1 -- 172.21.15.149:0/1170696767 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8801f36f0 con 0x7fb8800b0c50 2023-11-08T19:23:42.523 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.508+0000 7fb87ed9d700 1 --2- 172.21.15.149:0/1170696767 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8800b0c50 0x7fb8800b10d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb8800ccf60 tx=0x7fb87800e440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:42.523 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.508+0000 7fb86effd700 1 -- 172.21.15.149:0/1170696767 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb878017070 con 0x7fb8800b0c50 2023-11-08T19:23:42.524 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.508+0000 7fb86effd700 1 -- 172.21.15.149:0/1170696767 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb87800eb60 con 0x7fb8800b0c50 2023-11-08T19:23:42.524 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.508+0000 7fb87f59e700 1 -- 172.21.15.149:0/1170696767 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8801f39d0 con 0x7fb8800b0c50 2023-11-08T19:23:42.524 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.508+0000 7fb86effd700 1 -- 172.21.15.149:0/1170696767 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb87800ecf0 con 0x7fb8800b0c50 2023-11-08T19:23:42.524 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.508+0000 7fb87f59e700 1 -- 172.21.15.149:0/1170696767 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8801f4500 con 0x7fb8800b0c50 2023-11-08T19:23:42.524 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.509+0000 7fb87f59e700 1 -- 172.21.15.149:0/1170696767 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8800c3f20 con 0x7fb8800b0c50 2023-11-08T19:23:42.525 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.509+0000 7fb86effd700 1 -- 172.21.15.149:0/1170696767 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb878013420 con 0x7fb8800b0c50 2023-11-08T19:23:42.525 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.510+0000 7fb86effd700 1 --2- 172.21.15.149:0/1170696767 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb86006af00 0x7fb86006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:42.525 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.510+0000 7fb86effd700 1 -- 172.21.15.149:0/1170696767 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb8780894c0 con 0x7fb8800b0c50 2023-11-08T19:23:42.525 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.510+0000 7fb87e59c700 1 --2- 172.21.15.149:0/1170696767 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb86006af00 0x7fb86006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:42.525 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.510+0000 7fb87e59c700 1 --2- 172.21.15.149:0/1170696767 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb86006af00 0x7fb86006d3c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb8740090b0 tx=0x7fb87401f040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:42.526 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.515+0000 7fb86effd700 1 -- 172.21.15.149:0/1170696767 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb878054280 con 0x7fb8800b0c50 2023-11-08T19:23:42.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.709+0000 7fb87f59e700 1 -- 172.21.15.149:0/1170696767 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb8800682c0 con 0x7fb8800b0c50 2023-11-08T19:23:42.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.709+0000 7fb86effd700 1 -- 172.21.15.149:0/1170696767 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb8780578a0 con 0x7fb8800b0c50 2023-11-08T19:23:42.712 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 64 2023-11-08T19:23:42.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.711+0000 7fb87f59e700 1 -- 172.21.15.149:0/1170696767 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb86006af00 msgr2=0x7fb86006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:42.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.711+0000 7fb87f59e700 1 --2- 172.21.15.149:0/1170696767 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb86006af00 0x7fb86006d3c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb8740090b0 tx=0x7fb87401f040 comp rx=0 tx=0).stop 2023-11-08T19:23:42.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.711+0000 7fb87f59e700 1 -- 172.21.15.149:0/1170696767 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8800b0c50 msgr2=0x7fb8800b10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:42.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.711+0000 7fb87f59e700 1 --2- 172.21.15.149:0/1170696767 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8800b0c50 0x7fb8800b10d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb8800ccf60 tx=0x7fb87800e440 comp rx=0 tx=0).stop 2023-11-08T19:23:42.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.711+0000 7fb87f59e700 1 -- 172.21.15.149:0/1170696767 shutdown_connections 2023-11-08T19:23:42.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.711+0000 7fb87f59e700 1 --2- 172.21.15.149:0/1170696767 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb86006af00 0x7fb86006d3c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:42.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.711+0000 7fb87f59e700 1 --2- 172.21.15.149:0/1170696767 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8800b0c50 0x7fb8800b10d0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:42.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.711+0000 7fb87f59e700 1 --2- 172.21.15.149:0/1170696767 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb868003aa0 0x7fb88015a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:42.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.711+0000 7fb87f59e700 1 --2- 172.21.15.149:0/1170696767 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8800adf60 0x7fb8800ae3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:42.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.711+0000 7fb87f59e700 1 -- 172.21.15.149:0/1170696767 >> 172.21.15.149:0/1170696767 conn(0x7fb88006c080 msgr2=0x7fb8800aff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:42.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.712+0000 7fb87f59e700 1 -- 172.21.15.149:0/1170696767 shutdown_connections 2023-11-08T19:23:42.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.712+0000 7fb87f59e700 1 -- 172.21.15.149:0/1170696767 wait complete. 2023-11-08T19:23:42.726 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-08T19:23:42.849 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.847+0000 7f0811d02700 1 Processor -- start 2023-11-08T19:23:42.850 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.847+0000 7f0811d02700 1 -- start start 2023-11-08T19:23:42.854 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.848+0000 7f0811d02700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f080c06ab80 0x7f080c0caf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:42.854 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.848+0000 7f0811d02700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f080c15e320 con 0x7f080c0cf1c0 2023-11-08T19:23:42.854 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.848+0000 7f0811d02700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f080c06b020 con 0x7f080c15df40 2023-11-08T19:23:42.854 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.848+0000 7f0811d02700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f080c06b2e0 con 0x7f080c06ab80 2023-11-08T19:23:42.855 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.848+0000 7f080bfff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f080c0cf1c0 0x7f080c0ce540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:40064/0 (socket says 172.21.15.149:40064) 2023-11-08T19:23:42.855 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.848+0000 7f080bfff700 1 -- 172.21.15.149:0/3446482098 learned_addr learned my addr 172.21.15.149:0/3446482098 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:23:42.855 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.848+0000 7f080affd700 1 --2- 172.21.15.149:0/3446482098 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f080c06ab80 0x7f080c0caf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:42.855 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.849+0000 7f080a7fc700 1 -- 172.21.15.149:0/3446482098 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1189013804 0 0) 0x7f080c15e320 con 0x7f080c0cf1c0 2023-11-08T19:23:42.856 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.849+0000 7f080a7fc700 1 -- 172.21.15.149:0/3446482098 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07f80035b0 con 0x7f080c0cf1c0 2023-11-08T19:23:42.856 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.849+0000 7f080a7fc700 1 -- 172.21.15.149:0/3446482098 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1750640984 0 0) 0x7f07f80035b0 con 0x7f080c0cf1c0 2023-11-08T19:23:42.856 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.849+0000 7f080a7fc700 1 -- 172.21.15.149:0/3446482098 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f080c06ab80 msgr2=0x7f080c0caf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:42.856 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.849+0000 7f080a7fc700 1 --2- 172.21.15.149:0/3446482098 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f080c06ab80 0x7f080c0caf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:42.856 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.849+0000 7f080a7fc700 1 -- 172.21.15.149:0/3446482098 >> v1:172.21.15.160:6789/0 conn(0x7f080c15df40 legacy=0x7f080c06c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:42.857 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.849+0000 7f080a7fc700 1 -- 172.21.15.149:0/3446482098 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f080c06b5c0 con 0x7f080c0cf1c0 2023-11-08T19:23:42.857 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.849+0000 7f080a7fc700 1 -- 172.21.15.149:0/3446482098 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f08040019f0 con 0x7f080c0cf1c0 2023-11-08T19:23:42.857 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.849+0000 7f080a7fc700 1 -- 172.21.15.149:0/3446482098 >> v1:172.21.15.149:6789/0 conn(0x7f080c0cf1c0 legacy=0x7f080c0ce540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:42.857 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.849+0000 7f080a7fc700 1 --2- 172.21.15.149:0/3446482098 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07f8003aa0 0x7f07f8003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:42.857 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.849+0000 7f080a7fc700 1 --2- 172.21.15.149:0/3446482098 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f080c06ab80 0x7f07f8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:42.858 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.849+0000 7f080a7fc700 1 --2- 172.21.15.149:0/3446482098 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f07f8004d90 0x7f07f8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:42.858 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.849+0000 7f080a7fc700 1 -- 172.21.15.149:0/3446482098 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f080c06b2e0 con 0x7f07f8003aa0 2023-11-08T19:23:42.858 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.849+0000 7f080a7fc700 1 -- 172.21.15.149:0/3446482098 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f800bac0 con 0x7f07f8004d90 2023-11-08T19:23:42.858 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.849+0000 7f080a7fc700 1 -- 172.21.15.149:0/3446482098 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07f800bc30 con 0x7f080c06ab80 2023-11-08T19:23:42.858 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.849+0000 7f080b7fe700 1 --2- 172.21.15.149:0/3446482098 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07f8003aa0 0x7f07f8003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:42.859 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.849+0000 7f080affd700 1 --2- 172.21.15.149:0/3446482098 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f080c06ab80 0x7f07f8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:42.859 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.849+0000 7f080bfff700 1 --2- 172.21.15.149:0/3446482098 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f07f8004d90 0x7f07f8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:42.859 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.849+0000 7f080b7fe700 1 -- 172.21.15.149:0/3446482098 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f080c06ab80 msgr2=0x7f07f8004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:42.859 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.849+0000 7f080b7fe700 1 --2- 172.21.15.149:0/3446482098 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f080c06ab80 0x7f07f8004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:42.859 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.849+0000 7f080b7fe700 1 -- 172.21.15.149:0/3446482098 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f07f8004d90 msgr2=0x7f07f8005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:42.860 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.849+0000 7f080b7fe700 1 --2- 172.21.15.149:0/3446482098 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f07f8004d90 0x7f07f8005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:42.860 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.849+0000 7f080b7fe700 1 -- 172.21.15.149:0/3446482098 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f80035b0 con 0x7f07f8003aa0 2023-11-08T19:23:42.860 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.849+0000 7f080b7fe700 1 --2- 172.21.15.149:0/3446482098 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07f8003aa0 0x7f07f8003e80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f07f40018d0 tx=0x7f07f8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74e328a2077664f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:42.860 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.850+0000 7f080a7fc700 1 -- 172.21.15.149:0/3446482098 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f400c690 con 0x7f07f8003aa0 2023-11-08T19:23:42.860 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.850+0000 7f080a7fc700 1 -- 172.21.15.149:0/3446482098 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f400c810 con 0x7f07f8003aa0 2023-11-08T19:23:42.861 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.850+0000 7f080a7fc700 1 -- 172.21.15.149:0/3446482098 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f400cbc0 con 0x7f07f8003aa0 2023-11-08T19:23:42.861 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.850+0000 7f0811d02700 1 -- 172.21.15.149:0/3446482098 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07f8003aa0 msgr2=0x7f07f8003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:42.861 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.850+0000 7f0811d02700 1 --2- 172.21.15.149:0/3446482098 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07f8003aa0 0x7f07f8003e80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f07f40018d0 tx=0x7f07f8005880 comp rx=0 tx=0).stop 2023-11-08T19:23:42.861 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.850+0000 7f080bfff700 1 -- 172.21.15.149:0/3446482098 reap_dead start 2023-11-08T19:23:42.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.850+0000 7f0811d02700 1 -- 172.21.15.149:0/3446482098 shutdown_connections 2023-11-08T19:23:42.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.850+0000 7f0811d02700 1 -- 172.21.15.149:0/3446482098 >> 172.21.15.149:0/3446482098 conn(0x7f080c0d0640 msgr2=0x7f080c0d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:42.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.850+0000 7f0811d02700 1 -- 172.21.15.149:0/3446482098 shutdown_connections 2023-11-08T19:23:42.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.850+0000 7f0811d02700 1 -- 172.21.15.149:0/3446482098 wait complete. 2023-11-08T19:23:42.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.851+0000 7f0811d02700 1 Processor -- start 2023-11-08T19:23:42.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.852+0000 7f0811d02700 1 -- start start 2023-11-08T19:23:42.865 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.852+0000 7f0811d02700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07f8003aa0 0x7f080c0c6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:42.865 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.852+0000 7f0811d02700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f080c14d1c0 0x7f080c14d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:42.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.852+0000 7f0811d02700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f080c0c7c90 0x7f080c0c80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:42.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.852+0000 7f0811d02700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f080c14db80 con 0x7f07f8003aa0 2023-11-08T19:23:42.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.852+0000 7f0811d02700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f080c15e3c0 con 0x7f080c14d1c0 2023-11-08T19:23:42.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.852+0000 7f0811d02700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f080c0c8630 con 0x7f080c0c7c90 2023-11-08T19:23:42.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.852+0000 7f080b7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07f8003aa0 0x7f080c0c6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:42.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.852+0000 7f080b7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07f8003aa0 0x7f080c0c6470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38070/0 (socket says 172.21.15.149:38070) 2023-11-08T19:23:42.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.852+0000 7f080b7fe700 1 -- 172.21.15.149:0/1738316775 learned_addr learned my addr 172.21.15.149:0/1738316775 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:42.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.853+0000 7f080bfff700 1 --2- 172.21.15.149:0/1738316775 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f080c0c7c90 0x7f080c0c80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:42.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.853+0000 7f080affd700 1 --2- 172.21.15.149:0/1738316775 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f080c14d1c0 0x7f080c14d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:42.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.853+0000 7f080b7fe700 1 -- 172.21.15.149:0/1738316775 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f080c0c7c90 msgr2=0x7f080c0c80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:42.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.853+0000 7f080b7fe700 1 --2- 172.21.15.149:0/1738316775 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f080c0c7c90 0x7f080c0c80f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:42.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.853+0000 7f080b7fe700 1 -- 172.21.15.149:0/1738316775 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f080c14d1c0 msgr2=0x7f080c14d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:42.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.853+0000 7f080b7fe700 1 --2- 172.21.15.149:0/1738316775 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f080c14d1c0 0x7f080c14d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:42.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.853+0000 7f080b7fe700 1 -- 172.21.15.149:0/1738316775 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f080c15e660 con 0x7f07f8003aa0 2023-11-08T19:23:42.869 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.853+0000 7f080b7fe700 1 --2- 172.21.15.149:0/1738316775 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07f8003aa0 0x7f080c0c6470 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f07f8005830 tx=0x7f07f4001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:42.869 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.853+0000 7f0803fff700 1 -- 172.21.15.149:0/1738316775 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f400cb80 con 0x7f07f8003aa0 2023-11-08T19:23:42.869 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.853+0000 7f0803fff700 1 -- 172.21.15.149:0/1738316775 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f4021070 con 0x7f07f8003aa0 2023-11-08T19:23:42.869 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.853+0000 7f0811d02700 1 -- 172.21.15.149:0/1738316775 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f080c0c5c70 con 0x7f07f8003aa0 2023-11-08T19:23:42.869 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.853+0000 7f0803fff700 1 -- 172.21.15.149:0/1738316775 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f400cee0 con 0x7f07f8003aa0 2023-11-08T19:23:42.870 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.853+0000 7f0811d02700 1 -- 172.21.15.149:0/1738316775 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f080c0c69b0 con 0x7f07f8003aa0 2023-11-08T19:23:42.870 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.854+0000 7f0811d02700 1 -- 172.21.15.149:0/1738316775 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f080c0c62c0 con 0x7f07f8003aa0 2023-11-08T19:23:42.870 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.855+0000 7f0803fff700 1 -- 172.21.15.149:0/1738316775 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f07f4023030 con 0x7f07f8003aa0 2023-11-08T19:23:42.870 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.855+0000 7f0803fff700 1 --2- 172.21.15.149:0/1738316775 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f07ec06af00 0x7f07ec06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:42.870 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.855+0000 7f0803fff700 1 -- 172.21.15.149:0/1738316775 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f07f408aa60 con 0x7f07f8003aa0 2023-11-08T19:23:42.871 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.855+0000 7f080affd700 1 --2- 172.21.15.149:0/1738316775 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f07ec06af00 0x7f07ec06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:42.871 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.855+0000 7f080affd700 1 --2- 172.21.15.149:0/1738316775 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f07ec06af00 0x7f07ec06d3c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f080c0c6de0 tx=0x7f07fc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:42.871 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:42.860+0000 7f0803fff700 1 -- 172.21.15.149:0/1738316775 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f07f40558b0 con 0x7f07f8003aa0 2023-11-08T19:23:43.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.047+0000 7f0811d02700 1 -- 172.21.15.149:0/1738316775 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f080c04f730 con 0x7f07f8003aa0 2023-11-08T19:23:43.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.048+0000 7f0803fff700 1 -- 172.21.15.149:0/1738316775 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f07f4058ed0 con 0x7f07f8003aa0 2023-11-08T19:23:43.050 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:23:43.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.050+0000 7f0811d02700 1 -- 172.21.15.149:0/1738316775 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f07ec06af00 msgr2=0x7f07ec06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:43.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.050+0000 7f0811d02700 1 --2- 172.21.15.149:0/1738316775 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f07ec06af00 0x7f07ec06d3c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f080c0c6de0 tx=0x7f07fc008040 comp rx=0 tx=0).stop 2023-11-08T19:23:43.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.050+0000 7f0811d02700 1 -- 172.21.15.149:0/1738316775 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07f8003aa0 msgr2=0x7f080c0c6470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:43.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.050+0000 7f0811d02700 1 --2- 172.21.15.149:0/1738316775 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07f8003aa0 0x7f080c0c6470 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f07f8005830 tx=0x7f07f4001230 comp rx=0 tx=0).stop 2023-11-08T19:23:43.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.050+0000 7f0811d02700 1 -- 172.21.15.149:0/1738316775 shutdown_connections 2023-11-08T19:23:43.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.050+0000 7f0811d02700 1 --2- 172.21.15.149:0/1738316775 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f07ec06af00 0x7f07ec06d3c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:43.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.050+0000 7f0811d02700 1 --2- 172.21.15.149:0/1738316775 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f080c0c7c90 0x7f080c0c80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:43.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.050+0000 7f0811d02700 1 --2- 172.21.15.149:0/1738316775 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07f8003aa0 0x7f080c0c6470 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:43.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.050+0000 7f0811d02700 1 --2- 172.21.15.149:0/1738316775 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f080c14d1c0 0x7f080c14d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:43.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.050+0000 7f0811d02700 1 -- 172.21.15.149:0/1738316775 >> 172.21.15.149:0/1738316775 conn(0x7f080c0d0640 msgr2=0x7f080c073950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:43.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.050+0000 7f0811d02700 1 -- 172.21.15.149:0/1738316775 shutdown_connections 2023-11-08T19:23:43.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.050+0000 7f0811d02700 1 -- 172.21.15.149:0/1738316775 wait complete. 2023-11-08T19:23:43.065 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:23:43.189 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.186+0000 7f0caa5ee700 1 Processor -- start 2023-11-08T19:23:43.189 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.187+0000 7f0caa5ee700 1 -- start start 2023-11-08T19:23:43.192 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.187+0000 7f0caa5ee700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f0ca415b790 0x7f0ca415fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:43.192 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.187+0000 7f0caa5ee700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0ca40b15f0 0x7f0ca40c9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:43.192 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.187+0000 7f0caa5ee700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ca40716c0 con 0x7f0ca41600b0 2023-11-08T19:23:43.192 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.187+0000 7f0caa5ee700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ca415f440 con 0x7f0ca40b15f0 2023-11-08T19:23:43.193 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.187+0000 7f0caa5ee700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ca4071910 con 0x7f0ca415b790 2023-11-08T19:23:43.193 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.188+0000 7f0ca8b8b700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0ca40b15f0 0x7f0ca40c9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:43.193 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.188+0000 7f0ca8b8b700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0ca40b15f0 0x7f0ca40c9f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38080/0 (socket says 172.21.15.149:38080) 2023-11-08T19:23:43.193 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.188+0000 7f0ca8b8b700 1 -- 172.21.15.149:0/3953033518 learned_addr learned my addr 172.21.15.149:0/3953033518 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:43.194 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.188+0000 7f0ca3fff700 1 --2- 172.21.15.149:0/3953033518 >> v2:172.21.15.160:3300/0 conn(0x7f0ca415b790 0x7f0ca415fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:43.194 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.188+0000 7f0ca8b8b700 1 -- 172.21.15.149:0/3953033518 >> v2:172.21.15.160:3300/0 conn(0x7f0ca415b790 msgr2=0x7f0ca415fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:43.194 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.188+0000 7f0ca8b8b700 1 --2- 172.21.15.149:0/3953033518 >> v2:172.21.15.160:3300/0 conn(0x7f0ca415b790 0x7f0ca415fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:43.194 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.188+0000 7f0ca8b8b700 1 -- 172.21.15.149:0/3953033518 >> v1:172.21.15.160:6789/0 conn(0x7f0ca41600b0 legacy=0x7f0ca40b0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:43.194 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.188+0000 7f0ca8b8b700 1 -- 172.21.15.149:0/3953033518 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca40cb7c0 con 0x7f0ca40b15f0 2023-11-08T19:23:43.195 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.188+0000 7f0ca8b8b700 1 --2- 172.21.15.149:0/3953033518 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ca40b15f0 0x7f0ca40c9f30 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0ca406de60 tx=0x7f0c9c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b705cab4de697d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:43.195 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.188+0000 7f0ca2ffd700 1 -- 172.21.15.149:0/3953033518 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c00e070 con 0x7f0ca40b15f0 2023-11-08T19:23:43.195 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.188+0000 7f0ca2ffd700 1 -- 172.21.15.149:0/3953033518 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c9c003a20 con 0x7f0ca40b15f0 2023-11-08T19:23:43.195 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.188+0000 7f0ca2ffd700 1 -- 172.21.15.149:0/3953033518 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c003dd0 con 0x7f0ca40b15f0 2023-11-08T19:23:43.196 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.189+0000 7f0caa5ee700 1 -- 172.21.15.149:0/3953033518 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ca40b15f0 msgr2=0x7f0ca40c9f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:43.196 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.189+0000 7f0caa5ee700 1 --2- 172.21.15.149:0/3953033518 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ca40b15f0 0x7f0ca40c9f30 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0ca406de60 tx=0x7f0c9c00b330 comp rx=0 tx=0).stop 2023-11-08T19:23:43.196 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.189+0000 7f0caa5ee700 1 -- 172.21.15.149:0/3953033518 shutdown_connections 2023-11-08T19:23:43.196 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.189+0000 7f0caa5ee700 1 --2- 172.21.15.149:0/3953033518 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ca40b15f0 0x7f0ca40c9f30 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:43.197 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.189+0000 7f0caa5ee700 1 --2- 172.21.15.149:0/3953033518 >> v2:172.21.15.160:3300/0 conn(0x7f0ca415b790 0x7f0ca415fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:43.197 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.189+0000 7f0caa5ee700 1 -- 172.21.15.149:0/3953033518 >> 172.21.15.149:0/3953033518 conn(0x7f0ca406b3d0 msgr2=0x7f0ca40cf460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:43.197 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.189+0000 7f0caa5ee700 1 -- 172.21.15.149:0/3953033518 shutdown_connections 2023-11-08T19:23:43.197 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.189+0000 7f0caa5ee700 1 -- 172.21.15.149:0/3953033518 wait complete. 2023-11-08T19:23:43.197 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.190+0000 7f0caa5ee700 1 Processor -- start 2023-11-08T19:23:43.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.190+0000 7f0caa5ee700 1 -- start start 2023-11-08T19:23:43.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.191+0000 7f0caa5ee700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ca40b15f0 0x7f0ca4152a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:43.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.191+0000 7f0caa5ee700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0ca415b790 0x7f0ca415bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:43.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.191+0000 7f0caa5ee700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ca415c410 0x7f0ca4159850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:43.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.191+0000 7f0caa5ee700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca415d090 con 0x7f0ca40b15f0 2023-11-08T19:23:43.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.191+0000 7f0caa5ee700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca415d650 con 0x7f0ca415c410 2023-11-08T19:23:43.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.191+0000 7f0caa5ee700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca415ca40 con 0x7f0ca415b790 2023-11-08T19:23:43.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.191+0000 7f0ca3fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ca40b15f0 0x7f0ca4152a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:43.202 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.191+0000 7f0ca3fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ca40b15f0 0x7f0ca4152a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38084/0 (socket says 172.21.15.149:38084) 2023-11-08T19:23:43.202 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.191+0000 7f0ca3fff700 1 -- 172.21.15.149:0/1989580312 learned_addr learned my addr 172.21.15.149:0/1989580312 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:43.202 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.191+0000 7f0ca3fff700 1 -- 172.21.15.149:0/1989580312 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0ca415b790 msgr2=0x7f0ca415bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:43.202 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.191+0000 7f0ca3fff700 1 --2- 172.21.15.149:0/1989580312 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0ca415b790 0x7f0ca415bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:43.203 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.191+0000 7f0ca3fff700 1 -- 172.21.15.149:0/1989580312 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ca415c410 msgr2=0x7f0ca4159850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:43.203 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.191+0000 7f0ca8b8b700 1 --2- 172.21.15.149:0/1989580312 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ca415c410 0x7f0ca4159850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:43.203 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.191+0000 7f0ca3fff700 1 --2- 172.21.15.149:0/1989580312 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ca415c410 0x7f0ca4159850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:43.203 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.191+0000 7f0ca3fff700 1 -- 172.21.15.149:0/1989580312 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c9c009b30 con 0x7f0ca40b15f0 2023-11-08T19:23:43.203 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.191+0000 7f0ca3fff700 1 --2- 172.21.15.149:0/1989580312 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ca40b15f0 0x7f0ca4152a30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0c9400e810 tx=0x7f0c9400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:43.204 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.192+0000 7f0ca0ff9700 1 -- 172.21.15.149:0/1989580312 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c94013610 con 0x7f0ca40b15f0 2023-11-08T19:23:43.204 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.192+0000 7f0ca0ff9700 1 -- 172.21.15.149:0/1989580312 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c94013770 con 0x7f0ca40b15f0 2023-11-08T19:23:43.204 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.192+0000 7f0caa5ee700 1 -- 172.21.15.149:0/1989580312 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ca415cd20 con 0x7f0ca40b15f0 2023-11-08T19:23:43.204 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.192+0000 7f0ca0ff9700 1 -- 172.21.15.149:0/1989580312 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c94013b20 con 0x7f0ca40b15f0 2023-11-08T19:23:43.204 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.192+0000 7f0caa5ee700 1 -- 172.21.15.149:0/1989580312 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ca40c9230 con 0x7f0ca40b15f0 2023-11-08T19:23:43.205 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.193+0000 7f0caa5ee700 1 -- 172.21.15.149:0/1989580312 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ca40745f0 con 0x7f0ca40b15f0 2023-11-08T19:23:43.205 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.193+0000 7f0ca0ff9700 1 -- 172.21.15.149:0/1989580312 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0c94013c80 con 0x7f0ca40b15f0 2023-11-08T19:23:43.205 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.194+0000 7f0ca0ff9700 1 --2- 172.21.15.149:0/1989580312 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0c9006af00 0x7f0c9006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:43.205 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.194+0000 7f0ca37fe700 1 --2- 172.21.15.149:0/1989580312 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0c9006af00 0x7f0c9006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:43.205 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.194+0000 7f0ca0ff9700 1 -- 172.21.15.149:0/1989580312 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0c94089610 con 0x7f0ca40b15f0 2023-11-08T19:23:43.206 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.194+0000 7f0ca37fe700 1 --2- 172.21.15.149:0/1989580312 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0c9006af00 0x7f0c9006d3c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0ca41f4920 tx=0x7f0c98006c50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:43.206 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.198+0000 7f0ca0ff9700 1 -- 172.21.15.149:0/1989580312 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0c940543e0 con 0x7f0ca40b15f0 2023-11-08T19:23:43.395 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.393+0000 7f0caa5ee700 1 -- 172.21.15.149:0/1989580312 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ca40d0250 con 0x7f0ca40b15f0 2023-11-08T19:23:43.396 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.394+0000 7f0ca0ff9700 1 -- 172.21.15.149:0/1989580312 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18382 (secure 0 0 0) 0x7f0c94057a00 con 0x7f0ca40b15f0 2023-11-08T19:23:43.397 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:23:43.397 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":24,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:23:06.964482+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-08T19:22:59.830928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-08T19:23:00.886589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-08T19:23:04.574033+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:23:43.399 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.397+0000 7f0caa5ee700 1 -- 172.21.15.149:0/1989580312 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0c9006af00 msgr2=0x7f0c9006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:43.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.397+0000 7f0caa5ee700 1 --2- 172.21.15.149:0/1989580312 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0c9006af00 0x7f0c9006d3c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0ca41f4920 tx=0x7f0c98006c50 comp rx=0 tx=0).stop 2023-11-08T19:23:43.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.397+0000 7f0caa5ee700 1 -- 172.21.15.149:0/1989580312 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ca40b15f0 msgr2=0x7f0ca4152a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:43.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.397+0000 7f0caa5ee700 1 --2- 172.21.15.149:0/1989580312 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ca40b15f0 0x7f0ca4152a30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0c9400e810 tx=0x7f0c9400ebd0 comp rx=0 tx=0).stop 2023-11-08T19:23:43.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.397+0000 7f0caa5ee700 1 -- 172.21.15.149:0/1989580312 shutdown_connections 2023-11-08T19:23:43.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.397+0000 7f0caa5ee700 1 --2- 172.21.15.149:0/1989580312 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0c9006af00 0x7f0c9006d3c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:43.401 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.397+0000 7f0caa5ee700 1 --2- 172.21.15.149:0/1989580312 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ca415c410 0x7f0ca4159850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:43.401 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.397+0000 7f0caa5ee700 1 --2- 172.21.15.149:0/1989580312 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ca40b15f0 0x7f0ca4152a30 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:43.401 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.397+0000 7f0caa5ee700 1 --2- 172.21.15.149:0/1989580312 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0ca415b790 0x7f0ca415bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:43.401 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.397+0000 7f0caa5ee700 1 -- 172.21.15.149:0/1989580312 >> 172.21.15.149:0/1989580312 conn(0x7f0ca406b3d0 msgr2=0x7f0ca40b46b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:43.402 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.397+0000 7f0caa5ee700 1 -- 172.21.15.149:0/1989580312 shutdown_connections 2023-11-08T19:23:43.402 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.397+0000 7f0caa5ee700 1 -- 172.21.15.149:0/1989580312 wait complete. 2023-11-08T19:23:43.412 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-08T19:22:56.023194+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-08T19:22:59.830928+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-08T19:23:00.886589+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-08T19:23:04.574033+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-08T19:23:43.413 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-08T19:23:43.537 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.535+0000 7f0376b8a700 1 Processor -- start 2023-11-08T19:23:43.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.535+0000 7f0376b8a700 1 -- start start 2023-11-08T19:23:43.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.536+0000 7f0376b8a700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f037015b880 0x7f037015f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:43.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.536+0000 7f0376b8a700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f03700b38b0 0x7f03700b6d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:43.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.536+0000 7f0376b8a700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03700b3d60 con 0x7f03700b7290 2023-11-08T19:23:43.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.536+0000 7f0376b8a700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03700ccba0 con 0x7f03700b38b0 2023-11-08T19:23:43.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.536+0000 7f0376b8a700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03700b7720 con 0x7f037015b880 2023-11-08T19:23:43.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.536+0000 7f036ffff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f03700b38b0 0x7f03700b6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:43.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.536+0000 7f036ffff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f03700b38b0 0x7f03700b6d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38094/0 (socket says 172.21.15.149:38094) 2023-11-08T19:23:43.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.536+0000 7f036ffff700 1 -- 172.21.15.149:0/3988164049 learned_addr learned my addr 172.21.15.149:0/3988164049 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:43.542 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.536+0000 7f0374926700 1 --2- 172.21.15.149:0/3988164049 >> v2:172.21.15.160:3300/0 conn(0x7f037015b880 0x7f037015f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:43.542 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.536+0000 7f036ffff700 1 -- 172.21.15.149:0/3988164049 >> v2:172.21.15.160:3300/0 conn(0x7f037015b880 msgr2=0x7f037015f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:43.542 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.536+0000 7f036ffff700 1 --2- 172.21.15.149:0/3988164049 >> v2:172.21.15.160:3300/0 conn(0x7f037015b880 0x7f037015f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:43.542 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.537+0000 7f036ffff700 1 -- 172.21.15.149:0/3988164049 >> v1:172.21.15.160:6789/0 conn(0x7f03700b7290 legacy=0x7f0370070b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:43.542 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.537+0000 7f036ffff700 1 -- 172.21.15.149:0/3988164049 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f037015bc60 con 0x7f03700b38b0 2023-11-08T19:23:43.543 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.537+0000 7f036ffff700 1 --2- 172.21.15.149:0/3988164049 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03700b38b0 0x7f03700b6d50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f03700b4360 tx=0x7f035c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bd2502bc9d42c9 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:43.543 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.537+0000 7f036f7fe700 1 -- 172.21.15.149:0/3988164049 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f035c011830 con 0x7f03700b38b0 2023-11-08T19:23:43.543 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.537+0000 7f036f7fe700 1 -- 172.21.15.149:0/3988164049 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f035c011990 con 0x7f03700b38b0 2023-11-08T19:23:43.543 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.537+0000 7f036f7fe700 1 -- 172.21.15.149:0/3988164049 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f035c011d20 con 0x7f03700b38b0 2023-11-08T19:23:43.543 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.537+0000 7f0376b8a700 1 -- 172.21.15.149:0/3988164049 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03700b38b0 msgr2=0x7f03700b6d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:43.544 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.537+0000 7f0376b8a700 1 --2- 172.21.15.149:0/3988164049 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03700b38b0 0x7f03700b6d50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f03700b4360 tx=0x7f035c009bd0 comp rx=0 tx=0).stop 2023-11-08T19:23:43.544 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.537+0000 7f0376b8a700 1 -- 172.21.15.149:0/3988164049 shutdown_connections 2023-11-08T19:23:43.544 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.537+0000 7f0376b8a700 1 --2- 172.21.15.149:0/3988164049 >> v2:172.21.15.160:3300/0 conn(0x7f037015b880 0x7f037015f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:43.544 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.537+0000 7f0376b8a700 1 --2- 172.21.15.149:0/3988164049 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03700b38b0 0x7f03700b6d50 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:43.545 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.537+0000 7f0376b8a700 1 -- 172.21.15.149:0/3988164049 >> 172.21.15.149:0/3988164049 conn(0x7f03700ce210 msgr2=0x7f03700ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:43.545 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.537+0000 7f0376b8a700 1 -- 172.21.15.149:0/3988164049 shutdown_connections 2023-11-08T19:23:43.545 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.537+0000 7f0376b8a700 1 -- 172.21.15.149:0/3988164049 wait complete. 2023-11-08T19:23:43.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.539+0000 7f0376b8a700 1 Processor -- start 2023-11-08T19:23:43.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.539+0000 7f0376b8a700 1 -- start start 2023-11-08T19:23:43.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.540+0000 7f0376b8a700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03700b38b0 0x7f03700c8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:43.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.540+0000 7f0376b8a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03700b7290 0x7f03700c8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:43.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.540+0000 7f0376b8a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f037015b880 0x7f03700caa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:43.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.540+0000 7f0376b8a700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037015ce70 con 0x7f037015b880 2023-11-08T19:23:43.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.540+0000 7f0376b8a700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037015d150 con 0x7f03700b7290 2023-11-08T19:23:43.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.540+0000 7f0376b8a700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03700cb750 con 0x7f03700b38b0 2023-11-08T19:23:43.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.541+0000 7f0375127700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f037015b880 0x7f03700caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:43.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.541+0000 7f0375127700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f037015b880 0x7f03700caa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38102/0 (socket says 172.21.15.149:38102) 2023-11-08T19:23:43.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.541+0000 7f0375127700 1 -- 172.21.15.149:0/3438533923 learned_addr learned my addr 172.21.15.149:0/3438533923 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:43.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.541+0000 7f036ffff700 1 --2- 172.21.15.149:0/3438533923 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03700b7290 0x7f03700c8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:43.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.541+0000 7f0374926700 1 --2- 172.21.15.149:0/3438533923 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03700b38b0 0x7f03700c8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:43.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.541+0000 7f0375127700 1 -- 172.21.15.149:0/3438533923 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03700b38b0 msgr2=0x7f03700c8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:43.551 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.541+0000 7f0375127700 1 --2- 172.21.15.149:0/3438533923 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03700b38b0 0x7f03700c8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:43.551 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.541+0000 7f0375127700 1 -- 172.21.15.149:0/3438533923 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03700b7290 msgr2=0x7f03700c8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:43.551 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.541+0000 7f0375127700 1 --2- 172.21.15.149:0/3438533923 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03700b7290 0x7f03700c8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:43.551 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.541+0000 7f0375127700 1 -- 172.21.15.149:0/3438533923 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f035c009550 con 0x7f037015b880 2023-11-08T19:23:43.551 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.541+0000 7f0374926700 1 --2- 172.21.15.149:0/3438533923 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03700b38b0 0x7f03700c8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:23:43.552 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.541+0000 7f0375127700 1 --2- 172.21.15.149:0/3438533923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f037015b880 0x7f03700caa00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f036800cc50 tx=0x7f036800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:43.552 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.541+0000 7f036d7fa700 1 -- 172.21.15.149:0/3438533923 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f036800ad80 con 0x7f037015b880 2023-11-08T19:23:43.552 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.541+0000 7f036d7fa700 1 -- 172.21.15.149:0/3438533923 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f036800ce50 con 0x7f037015b880 2023-11-08T19:23:43.552 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.541+0000 7f0376b8a700 1 -- 172.21.15.149:0/3438533923 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03700cba30 con 0x7f037015b880 2023-11-08T19:23:43.552 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.541+0000 7f036d7fa700 1 -- 172.21.15.149:0/3438533923 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0368003c40 con 0x7f037015b880 2023-11-08T19:23:43.552 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.541+0000 7f0376b8a700 1 -- 172.21.15.149:0/3438533923 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03701f24f0 con 0x7f037015b880 2023-11-08T19:23:43.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.542+0000 7f0376b8a700 1 -- 172.21.15.149:0/3438533923 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03700cbf50 con 0x7f037015b880 2023-11-08T19:23:43.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.543+0000 7f036d7fa700 1 -- 172.21.15.149:0/3438533923 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f03680050d0 con 0x7f037015b880 2023-11-08T19:23:43.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.543+0000 7f036d7fa700 1 --2- 172.21.15.149:0/3438533923 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f035406af00 0x7f035406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:43.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.543+0000 7f036d7fa700 1 -- 172.21.15.149:0/3438533923 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0368089950 con 0x7f037015b880 2023-11-08T19:23:43.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.543+0000 7f0374926700 1 --2- 172.21.15.149:0/3438533923 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f035406af00 0x7f035406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:43.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.543+0000 7f0374926700 1 --2- 172.21.15.149:0/3438533923 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f035406af00 0x7f035406d3c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0364009ac0 tx=0x7f0364008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:43.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.548+0000 7f036d7fa700 1 -- 172.21.15.149:0/3438533923 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f03680547a0 con 0x7f037015b880 2023-11-08T19:23:43.738 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.735+0000 7f0376b8a700 1 -- 172.21.15.149:0/3438533923 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f037015d2c0 con 0x7f037015b880 2023-11-08T19:23:43.738 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.736+0000 7f036d7fa700 1 -- 172.21.15.149:0/3438533923 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0368057dc0 con 0x7f037015b880 2023-11-08T19:23:43.739 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 1 2023-11-08T19:23:43.740 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.738+0000 7f0376b8a700 1 -- 172.21.15.149:0/3438533923 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f035406af00 msgr2=0x7f035406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:43.741 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.738+0000 7f0376b8a700 1 --2- 172.21.15.149:0/3438533923 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f035406af00 0x7f035406d3c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0364009ac0 tx=0x7f0364008040 comp rx=0 tx=0).stop 2023-11-08T19:23:43.741 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.738+0000 7f0376b8a700 1 -- 172.21.15.149:0/3438533923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f037015b880 msgr2=0x7f03700caa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:43.741 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.738+0000 7f0376b8a700 1 --2- 172.21.15.149:0/3438533923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f037015b880 0x7f03700caa00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f036800cc50 tx=0x7f036800a340 comp rx=0 tx=0).stop 2023-11-08T19:23:43.741 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.738+0000 7f0376b8a700 1 -- 172.21.15.149:0/3438533923 shutdown_connections 2023-11-08T19:23:43.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.738+0000 7f0376b8a700 1 --2- 172.21.15.149:0/3438533923 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f035406af00 0x7f035406d3c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:43.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.738+0000 7f0376b8a700 1 --2- 172.21.15.149:0/3438533923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f037015b880 0x7f03700caa00 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:43.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.738+0000 7f0376b8a700 1 --2- 172.21.15.149:0/3438533923 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03700b38b0 0x7f03700c8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:43.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.738+0000 7f0376b8a700 1 --2- 172.21.15.149:0/3438533923 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03700b7290 0x7f03700c8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:43.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.738+0000 7f0376b8a700 1 -- 172.21.15.149:0/3438533923 >> 172.21.15.149:0/3438533923 conn(0x7f03700ce210 msgr2=0x7f03700d1700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:43.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.738+0000 7f0376b8a700 1 -- 172.21.15.149:0/3438533923 shutdown_connections 2023-11-08T19:23:43.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.738+0000 7f0376b8a700 1 -- 172.21.15.149:0/3438533923 wait complete. 2023-11-08T19:23:43.753 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-08T19:23:43.889 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.874+0000 7fce9a163700 1 Processor -- start 2023-11-08T19:23:43.889 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.874+0000 7fce9a163700 1 -- start start 2023-11-08T19:23:43.889 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.875+0000 7fce9a163700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fce940d1130 0x7fce940b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:43.890 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.875+0000 7fce9a163700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce940cc870 0x7fce9406bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:43.890 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.875+0000 7fce9a163700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce940b6470 con 0x7fce9415abf0 2023-11-08T19:23:43.890 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.875+0000 7fce9a163700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce940b66a0 con 0x7fce940d1130 2023-11-08T19:23:43.890 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.875+0000 7fce9a163700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce940d04a0 con 0x7fce940cc870 2023-11-08T19:23:43.890 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.875+0000 7fce937fe700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fce9415abf0 0x7fce940cc160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:40108/0 (socket says 172.21.15.149:40108) 2023-11-08T19:23:43.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.875+0000 7fce937fe700 1 -- 172.21.15.149:0/195497544 learned_addr learned my addr 172.21.15.149:0/195497544 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:23:43.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.875+0000 7fce93fff700 1 --2- 172.21.15.149:0/195497544 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce940cc870 0x7fce9406bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:43.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.875+0000 7fce92ffd700 1 --2- 172.21.15.149:0/195497544 >> v2:172.21.15.160:3300/0 conn(0x7fce940d1130 0x7fce940b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:43.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.876+0000 7fce927fc700 1 -- 172.21.15.149:0/195497544 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2514734104 0 0) 0x7fce940b6470 con 0x7fce9415abf0 2023-11-08T19:23:43.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.876+0000 7fce927fc700 1 -- 172.21.15.149:0/195497544 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce800035b0 con 0x7fce9415abf0 2023-11-08T19:23:43.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.876+0000 7fce92ffd700 1 -- 172.21.15.149:0/195497544 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce940cc870 msgr2=0x7fce9406bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:43.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.876+0000 7fce92ffd700 1 --2- 172.21.15.149:0/195497544 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce940cc870 0x7fce9406bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:43.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.876+0000 7fce927fc700 1 -- 172.21.15.149:0/195497544 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1620769840 0 0) 0x7fce800035b0 con 0x7fce9415abf0 2023-11-08T19:23:43.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.876+0000 7fce92ffd700 1 -- 172.21.15.149:0/195497544 >> v1:172.21.15.149:6789/0 conn(0x7fce9415abf0 legacy=0x7fce940cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:43.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.876+0000 7fce92ffd700 1 -- 172.21.15.149:0/195497544 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce9415afd0 con 0x7fce940d1130 2023-11-08T19:23:43.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.876+0000 7fce93fff700 1 --2- 172.21.15.149:0/195497544 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce940cc870 0x7fce9406bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:23:43.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.876+0000 7fce92ffd700 1 --2- 172.21.15.149:0/195497544 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce940d1130 0x7fce940b5f30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fce84009840 tx=0x7fce84009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b332415603f8a9dc server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:43.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.876+0000 7fce927fc700 1 -- 172.21.15.149:0/195497544 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7c001670 con 0x7fce940d1130 2023-11-08T19:23:43.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.876+0000 7fce927fc700 1 -- 172.21.15.149:0/195497544 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce84004030 con 0x7fce940d1130 2023-11-08T19:23:43.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.876+0000 7fce927fc700 1 -- 172.21.15.149:0/195497544 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce840043c0 con 0x7fce940d1130 2023-11-08T19:23:43.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.877+0000 7fce9a163700 1 -- 172.21.15.149:0/195497544 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce940d1130 msgr2=0x7fce940b5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:43.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.877+0000 7fce9a163700 1 --2- 172.21.15.149:0/195497544 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce940d1130 0x7fce940b5f30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fce84009840 tx=0x7fce84009b50 comp rx=0 tx=0).stop 2023-11-08T19:23:43.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.877+0000 7fce9a163700 1 -- 172.21.15.149:0/195497544 shutdown_connections 2023-11-08T19:23:43.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.877+0000 7fce9a163700 1 --2- 172.21.15.149:0/195497544 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce940cc870 0x7fce9406bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:43.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.877+0000 7fce9a163700 1 --2- 172.21.15.149:0/195497544 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce940d1130 0x7fce940b5f30 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:43.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.877+0000 7fce9a163700 1 -- 172.21.15.149:0/195497544 >> 172.21.15.149:0/195497544 conn(0x7fce940d0640 msgr2=0x7fce940d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:43.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.877+0000 7fce9a163700 1 -- 172.21.15.149:0/195497544 shutdown_connections 2023-11-08T19:23:43.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.877+0000 7fce9a163700 1 -- 172.21.15.149:0/195497544 wait complete. 2023-11-08T19:23:43.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.878+0000 7fce9a163700 1 Processor -- start 2023-11-08T19:23:43.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.878+0000 7fce9a163700 1 -- start start 2023-11-08T19:23:43.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.879+0000 7fce9a163700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce940cc870 0x7fce941f7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:43.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.879+0000 7fce9a163700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce940d1130 0x7fce940ce380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:43.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.879+0000 7fce9a163700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce9415abf0 0x7fce940ce8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:43.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.879+0000 7fce9a163700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce941f3b60 con 0x7fce940cc870 2023-11-08T19:23:43.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.879+0000 7fce9a163700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce941f3e40 con 0x7fce940d1130 2023-11-08T19:23:43.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.879+0000 7fce9a163700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce941f4120 con 0x7fce9415abf0 2023-11-08T19:23:43.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.879+0000 7fce937fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce940cc870 0x7fce941f7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:43.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.879+0000 7fce937fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce940cc870 0x7fce941f7830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38112/0 (socket says 172.21.15.149:38112) 2023-11-08T19:23:43.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.879+0000 7fce937fe700 1 -- 172.21.15.149:0/2665329092 learned_addr learned my addr 172.21.15.149:0/2665329092 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:43.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.879+0000 7fce937fe700 1 -- 172.21.15.149:0/2665329092 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce9415abf0 msgr2=0x7fce940ce8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:43.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.879+0000 7fce937fe700 1 --2- 172.21.15.149:0/2665329092 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce9415abf0 0x7fce940ce8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:43.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.879+0000 7fce937fe700 1 -- 172.21.15.149:0/2665329092 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce940d1130 msgr2=0x7fce940ce380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:43.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.879+0000 7fce937fe700 1 --2- 172.21.15.149:0/2665329092 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce940d1130 0x7fce940ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:43.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.879+0000 7fce937fe700 1 -- 172.21.15.149:0/2665329092 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce8c009a70 con 0x7fce940cc870 2023-11-08T19:23:43.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.879+0000 7fce937fe700 1 --2- 172.21.15.149:0/2665329092 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce940cc870 0x7fce941f7830 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fce7c00c750 tx=0x7fce7c00cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:43.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.879+0000 7fce8bfff700 1 -- 172.21.15.149:0/2665329092 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7c004c80 con 0x7fce940cc870 2023-11-08T19:23:43.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.880+0000 7fce8bfff700 1 -- 172.21.15.149:0/2665329092 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce7c004de0 con 0x7fce940cc870 2023-11-08T19:23:43.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.880+0000 7fce9a163700 1 -- 172.21.15.149:0/2665329092 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce840094a0 con 0x7fce940cc870 2023-11-08T19:23:43.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.880+0000 7fce8bfff700 1 -- 172.21.15.149:0/2665329092 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7c0072d0 con 0x7fce940cc870 2023-11-08T19:23:43.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.880+0000 7fce9a163700 1 -- 172.21.15.149:0/2665329092 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce941f46e0 con 0x7fce940cc870 2023-11-08T19:23:43.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.880+0000 7fce9a163700 1 -- 172.21.15.149:0/2665329092 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce9404f730 con 0x7fce940cc870 2023-11-08T19:23:43.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.881+0000 7fce8bfff700 1 -- 172.21.15.149:0/2665329092 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fce7c007430 con 0x7fce940cc870 2023-11-08T19:23:43.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.881+0000 7fce8bfff700 1 --2- 172.21.15.149:0/2665329092 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fce7406af00 0x7fce7406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:43.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.881+0000 7fce8bfff700 1 -- 172.21.15.149:0/2665329092 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fce7c0897d0 con 0x7fce940cc870 2023-11-08T19:23:43.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.882+0000 7fce92ffd700 1 --2- 172.21.15.149:0/2665329092 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fce7406af00 0x7fce7406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:43.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.882+0000 7fce92ffd700 1 --2- 172.21.15.149:0/2665329092 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fce7406af00 0x7fce7406d3c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fce940ca5e0 tx=0x7fce84010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:43.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:43.886+0000 7fce8bfff700 1 -- 172.21.15.149:0/2665329092 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fce7c054460 con 0x7fce940cc870 2023-11-08T19:23:44.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.075+0000 7fce9a163700 1 -- 172.21.15.149:0/2665329092 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fce9415f110 con 0x7fce940cc870 2023-11-08T19:23:44.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.075+0000 7fce8bfff700 1 -- 172.21.15.149:0/2665329092 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fce7c057a80 con 0x7fce940cc870 2023-11-08T19:23:44.078 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:23:44.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.077+0000 7fce9a163700 1 -- 172.21.15.149:0/2665329092 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fce7406af00 msgr2=0x7fce7406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:44.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.077+0000 7fce9a163700 1 --2- 172.21.15.149:0/2665329092 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fce7406af00 0x7fce7406d3c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fce940ca5e0 tx=0x7fce84010000 comp rx=0 tx=0).stop 2023-11-08T19:23:44.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.077+0000 7fce9a163700 1 -- 172.21.15.149:0/2665329092 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce940cc870 msgr2=0x7fce941f7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:44.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.077+0000 7fce9a163700 1 --2- 172.21.15.149:0/2665329092 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce940cc870 0x7fce941f7830 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fce7c00c750 tx=0x7fce7c00cb10 comp rx=0 tx=0).stop 2023-11-08T19:23:44.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.077+0000 7fce9a163700 1 -- 172.21.15.149:0/2665329092 shutdown_connections 2023-11-08T19:23:44.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.077+0000 7fce9a163700 1 --2- 172.21.15.149:0/2665329092 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fce7406af00 0x7fce7406d3c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:44.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.077+0000 7fce9a163700 1 --2- 172.21.15.149:0/2665329092 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce9415abf0 0x7fce940ce8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:44.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.077+0000 7fce9a163700 1 --2- 172.21.15.149:0/2665329092 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce940cc870 0x7fce941f7830 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:44.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.077+0000 7fce9a163700 1 --2- 172.21.15.149:0/2665329092 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce940d1130 0x7fce940ce380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:44.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.077+0000 7fce9a163700 1 -- 172.21.15.149:0/2665329092 >> 172.21.15.149:0/2665329092 conn(0x7fce940d0640 msgr2=0x7fce94073800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:44.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.077+0000 7fce9a163700 1 -- 172.21.15.149:0/2665329092 shutdown_connections 2023-11-08T19:23:44.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.077+0000 7fce9a163700 1 -- 172.21.15.149:0/2665329092 wait complete. 2023-11-08T19:23:44.092 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-08T19:23:44.216 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.214+0000 7fe2dc190700 1 Processor -- start 2023-11-08T19:23:44.216 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.214+0000 7fe2dc190700 1 -- start start 2023-11-08T19:23:44.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.215+0000 7fe2dc190700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe2d40c9fc0 0x7fe2d40ca3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:44.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.215+0000 7fe2dc190700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2d40ae310 con 0x7fe2d40ad0b0 2023-11-08T19:23:44.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.215+0000 7fe2dc190700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2d40ca910 con 0x7fe2d415db30 2023-11-08T19:23:44.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.215+0000 7fe2dc190700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2d415df10 con 0x7fe2d40c9fc0 2023-11-08T19:23:44.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.215+0000 7fe2da72d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe2d40c9fc0 0x7fe2d40ca3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:44.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.215+0000 7fe2d972b700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fe2d40ad0b0 0x7fe2d40ae7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:40122/0 (socket says 172.21.15.149:40122) 2023-11-08T19:23:44.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.215+0000 7fe2da72d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe2d40c9fc0 0x7fe2d40ca3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38124/0 (socket says 172.21.15.149:38124) 2023-11-08T19:23:44.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.215+0000 7fe2d972b700 1 -- 172.21.15.149:0/2860242591 learned_addr learned my addr 172.21.15.149:0/2860242591 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:23:44.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.215+0000 7fe2da72d700 1 -- 172.21.15.149:0/2860242591 >> v1:172.21.15.160:6789/0 conn(0x7fe2d415db30 legacy=0x7fe2d4072000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:44.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.215+0000 7fe2da72d700 1 -- 172.21.15.149:0/2860242591 >> v1:172.21.15.149:6789/0 conn(0x7fe2d40ad0b0 legacy=0x7fe2d40ae7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:44.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.215+0000 7fe2da72d700 1 -- 172.21.15.149:0/2860242591 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d40ad700 con 0x7fe2d40c9fc0 2023-11-08T19:23:44.221 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.215+0000 7fe2da72d700 1 --2- 172.21.15.149:0/2860242591 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe2d40c9fc0 0x7fe2d40ca3d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc009d90 tx=0x7fe2cc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4d683b78b6cc6d2 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:44.221 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.215+0000 7fe2d8f2a700 1 -- 172.21.15.149:0/2860242591 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc00e070 con 0x7fe2d40c9fc0 2023-11-08T19:23:44.221 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.215+0000 7fe2d8f2a700 1 -- 172.21.15.149:0/2860242591 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2cc00bbd0 con 0x7fe2d40c9fc0 2023-11-08T19:23:44.221 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.215+0000 7fe2d8f2a700 1 -- 172.21.15.149:0/2860242591 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc003a20 con 0x7fe2d40c9fc0 2023-11-08T19:23:44.221 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.216+0000 7fe2dc190700 1 -- 172.21.15.149:0/2860242591 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe2d40c9fc0 msgr2=0x7fe2d40ca3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:44.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.216+0000 7fe2dc190700 1 --2- 172.21.15.149:0/2860242591 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe2d40c9fc0 0x7fe2d40ca3d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc009d90 tx=0x7fe2cc00b330 comp rx=0 tx=0).stop 2023-11-08T19:23:44.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.216+0000 7fe2dc190700 1 -- 172.21.15.149:0/2860242591 shutdown_connections 2023-11-08T19:23:44.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.216+0000 7fe2dc190700 1 --2- 172.21.15.149:0/2860242591 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe2d40c9fc0 0x7fe2d40ca3d0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:44.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.216+0000 7fe2dc190700 1 -- 172.21.15.149:0/2860242591 >> 172.21.15.149:0/2860242591 conn(0x7fe2d40b1460 msgr2=0x7fe2d40b1870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:44.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.216+0000 7fe2dc190700 1 -- 172.21.15.149:0/2860242591 shutdown_connections 2023-11-08T19:23:44.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.216+0000 7fe2dc190700 1 -- 172.21.15.149:0/2860242591 wait complete. 2023-11-08T19:23:44.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.217+0000 7fe2dc190700 1 Processor -- start 2023-11-08T19:23:44.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.217+0000 7fe2dc190700 1 -- start start 2023-11-08T19:23:44.226 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.218+0000 7fe2dc190700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe2d40ad0b0 0x7fe2d40c6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:44.226 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.218+0000 7fe2dc190700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe2d40c9fc0 0x7fe2d4154dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:44.226 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.218+0000 7fe2dc190700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe2d415db30 0x7fe2d40c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:44.226 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.218+0000 7fe2dc190700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d40b52f0 con 0x7fe2d415db30 2023-11-08T19:23:44.227 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.218+0000 7fe2dc190700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d40b2660 con 0x7fe2d40ad0b0 2023-11-08T19:23:44.227 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.218+0000 7fe2dc190700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d40c8910 con 0x7fe2d40c9fc0 2023-11-08T19:23:44.227 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.218+0000 7fe2da72d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe2d415db30 0x7fe2d40c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:44.227 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.218+0000 7fe2da72d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe2d415db30 0x7fe2d40c83d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38130/0 (socket says 172.21.15.149:38130) 2023-11-08T19:23:44.227 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.218+0000 7fe2da72d700 1 -- 172.21.15.149:0/1731568389 learned_addr learned my addr 172.21.15.149:0/1731568389 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:44.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.218+0000 7fe2d972b700 1 --2- 172.21.15.149:0/1731568389 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe2d40c9fc0 0x7fe2d4154dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:44.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.218+0000 7fe2d9f2c700 1 --2- 172.21.15.149:0/1731568389 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe2d40ad0b0 0x7fe2d40c6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:44.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.218+0000 7fe2da72d700 1 -- 172.21.15.149:0/1731568389 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe2d40c9fc0 msgr2=0x7fe2d4154dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:44.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.218+0000 7fe2da72d700 1 --2- 172.21.15.149:0/1731568389 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe2d40c9fc0 0x7fe2d4154dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:44.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.218+0000 7fe2da72d700 1 -- 172.21.15.149:0/1731568389 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe2d40ad0b0 msgr2=0x7fe2d40c6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:44.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.218+0000 7fe2da72d700 1 --2- 172.21.15.149:0/1731568389 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe2d40ad0b0 0x7fe2d40c6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:44.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.218+0000 7fe2da72d700 1 -- 172.21.15.149:0/1731568389 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2cc009a70 con 0x7fe2d415db30 2023-11-08T19:23:44.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.218+0000 7fe2d9f2c700 1 --2- 172.21.15.149:0/1731568389 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe2d40ad0b0 0x7fe2d40c6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:23:44.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.218+0000 7fe2d972b700 1 --2- 172.21.15.149:0/1731568389 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe2d40c9fc0 0x7fe2d4154dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:23:44.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.219+0000 7fe2da72d700 1 --2- 172.21.15.149:0/1731568389 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe2d415db30 0x7fe2d40c83d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc00b730 tx=0x7fe2cc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:44.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.219+0000 7fe2ca7fc700 1 -- 172.21.15.149:0/1731568389 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc003a20 con 0x7fe2d415db30 2023-11-08T19:23:44.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.219+0000 7fe2ca7fc700 1 -- 172.21.15.149:0/1731568389 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2cc012650 con 0x7fe2d415db30 2023-11-08T19:23:44.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.219+0000 7fe2dc190700 1 -- 172.21.15.149:0/1731568389 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2d40c7020 con 0x7fe2d415db30 2023-11-08T19:23:44.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.219+0000 7fe2ca7fc700 1 -- 172.21.15.149:0/1731568389 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc012a00 con 0x7fe2d415db30 2023-11-08T19:23:44.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.219+0000 7fe2dc190700 1 -- 172.21.15.149:0/1731568389 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2d40c75e0 con 0x7fe2d415db30 2023-11-08T19:23:44.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.220+0000 7fe2dc190700 1 -- 172.21.15.149:0/1731568389 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2d40b27a0 con 0x7fe2d415db30 2023-11-08T19:23:44.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.220+0000 7fe2ca7fc700 1 -- 172.21.15.149:0/1731568389 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe2cc012b60 con 0x7fe2d415db30 2023-11-08T19:23:44.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.221+0000 7fe2ca7fc700 1 --2- 172.21.15.149:0/1731568389 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe2b806af30 0x7fe2b806d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:44.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.221+0000 7fe2ca7fc700 1 -- 172.21.15.149:0/1731568389 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe2cc08b3e0 con 0x7fe2d415db30 2023-11-08T19:23:44.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.221+0000 7fe2d9f2c700 1 --2- 172.21.15.149:0/1731568389 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe2b806af30 0x7fe2b806d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:44.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.221+0000 7fe2d9f2c700 1 --2- 172.21.15.149:0/1731568389 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe2b806af30 0x7fe2b806d3f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe2d0003fc0 tx=0x7fe2d0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:44.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.226+0000 7fe2ca7fc700 1 -- 172.21.15.149:0/1731568389 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe2d40b27a0 con 0x7fe2d415db30 2023-11-08T19:23:44.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.418+0000 7fe2dc190700 1 -- 172.21.15.149:0/1731568389 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe2d40b27a0 con 0x7fe2d415db30 2023-11-08T19:23:44.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.419+0000 7fe2ca7fc700 1 -- 172.21.15.149:0/1731568389 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe2d40b27a0 con 0x7fe2d415db30 2023-11-08T19:23:44.421 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 64 2023-11-08T19:23:44.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.421+0000 7fe2dc190700 1 -- 172.21.15.149:0/1731568389 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe2b806af30 msgr2=0x7fe2b806d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:44.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.421+0000 7fe2dc190700 1 --2- 172.21.15.149:0/1731568389 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe2b806af30 0x7fe2b806d3f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe2d0003fc0 tx=0x7fe2d0009040 comp rx=0 tx=0).stop 2023-11-08T19:23:44.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.421+0000 7fe2dc190700 1 -- 172.21.15.149:0/1731568389 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe2d415db30 msgr2=0x7fe2d40c83d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:44.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.421+0000 7fe2dc190700 1 --2- 172.21.15.149:0/1731568389 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe2d415db30 0x7fe2d40c83d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc00b730 tx=0x7fe2cc004ad0 comp rx=0 tx=0).stop 2023-11-08T19:23:44.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.421+0000 7fe2dc190700 1 -- 172.21.15.149:0/1731568389 shutdown_connections 2023-11-08T19:23:44.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.421+0000 7fe2dc190700 1 --2- 172.21.15.149:0/1731568389 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe2b806af30 0x7fe2b806d3f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:44.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.421+0000 7fe2dc190700 1 --2- 172.21.15.149:0/1731568389 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe2d40ad0b0 0x7fe2d40c6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:44.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.421+0000 7fe2dc190700 1 --2- 172.21.15.149:0/1731568389 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe2d415db30 0x7fe2d40c83d0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:44.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.421+0000 7fe2dc190700 1 --2- 172.21.15.149:0/1731568389 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe2d40c9fc0 0x7fe2d4154dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:44.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.421+0000 7fe2dc190700 1 -- 172.21.15.149:0/1731568389 >> 172.21.15.149:0/1731568389 conn(0x7fe2d40b1460 msgr2=0x7fe2d40b1840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:44.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.421+0000 7fe2dc190700 1 -- 172.21.15.149:0/1731568389 shutdown_connections 2023-11-08T19:23:44.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.421+0000 7fe2dc190700 1 -- 172.21.15.149:0/1731568389 wait complete. 2023-11-08T19:23:44.435 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-08T19:23:44.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.557+0000 7f0e9e3ce700 1 Processor -- start 2023-11-08T19:23:44.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.557+0000 7f0e9e3ce700 1 -- start start 2023-11-08T19:23:44.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.557+0000 7f0e9e3ce700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0e980cfdb0 0x7f0e98166720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:44.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.557+0000 7f0e9e3ce700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e980cc8c0 con 0x7f0e980ccd50 2023-11-08T19:23:44.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.557+0000 7f0e9e3ce700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e980ca8b0 con 0x7f0e9815c760 2023-11-08T19:23:44.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.557+0000 7f0e9e3ce700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e980cc270 con 0x7f0e980cfdb0 2023-11-08T19:23:44.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.558+0000 7f0e977fe700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f0e980ccd50 0x7f0e980cf6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:40136/0 (socket says 172.21.15.149:40136) 2023-11-08T19:23:44.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.558+0000 7f0e977fe700 1 -- 172.21.15.149:0/2689980859 learned_addr learned my addr 172.21.15.149:0/2689980859 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:23:44.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.558+0000 7f0e9c96b700 1 --2- 172.21.15.149:0/2689980859 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0e980cfdb0 0x7f0e98166720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:44.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.558+0000 7f0e96ffd700 1 -- 172.21.15.149:0/2689980859 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3954116275 0 0) 0x7f0e980cc8c0 con 0x7f0e980ccd50 2023-11-08T19:23:44.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.558+0000 7f0e96ffd700 1 -- 172.21.15.149:0/2689980859 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e800035b0 con 0x7f0e980ccd50 2023-11-08T19:23:44.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.558+0000 7f0e96ffd700 1 -- 172.21.15.149:0/2689980859 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1127788879 0 0) 0x7f0e980ca8b0 con 0x7f0e9815c760 2023-11-08T19:23:44.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.558+0000 7f0e96ffd700 1 -- 172.21.15.149:0/2689980859 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e980cc8c0 con 0x7f0e9815c760 2023-11-08T19:23:44.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.558+0000 7f0e96ffd700 1 -- 172.21.15.149:0/2689980859 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3195416160 0 0) 0x7f0e800035b0 con 0x7f0e980ccd50 2023-11-08T19:23:44.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.558+0000 7f0e96ffd700 1 -- 172.21.15.149:0/2689980859 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0e980cfdb0 msgr2=0x7f0e98166720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:44.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.558+0000 7f0e96ffd700 1 --2- 172.21.15.149:0/2689980859 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0e980cfdb0 0x7f0e98166720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:44.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.558+0000 7f0e96ffd700 1 -- 172.21.15.149:0/2689980859 >> v1:172.21.15.160:6789/0 conn(0x7f0e9815c760 legacy=0x7f0e980c9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:44.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.558+0000 7f0e96ffd700 1 -- 172.21.15.149:0/2689980859 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e980cc550 con 0x7f0e980ccd50 2023-11-08T19:23:44.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.558+0000 7f0e96ffd700 1 -- 172.21.15.149:0/2689980859 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f0e8c001670 con 0x7f0e980ccd50 2023-11-08T19:23:44.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.558+0000 7f0e9c96b700 1 --2- 172.21.15.149:0/2689980859 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0e980cfdb0 0x7f0e98166720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:23:44.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.558+0000 7f0e96ffd700 1 -- 172.21.15.149:0/2689980859 >> v1:172.21.15.149:6789/0 conn(0x7f0e980ccd50 legacy=0x7f0e980cf6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:44.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.558+0000 7f0e96ffd700 1 --2- 172.21.15.149:0/2689980859 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e80003c30 0x7f0e80004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:44.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.558+0000 7f0e96ffd700 1 --2- 172.21.15.149:0/2689980859 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0e80004850 0x7f0e80004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:44.567 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.558+0000 7f0e96ffd700 1 --2- 172.21.15.149:0/2689980859 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0e980cfdb0 0x7f0e80005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:44.567 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.558+0000 7f0e96ffd700 1 -- 172.21.15.149:0/2689980859 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e980cc270 con 0x7f0e80003c30 2023-11-08T19:23:44.567 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.558+0000 7f0e96ffd700 1 -- 172.21.15.149:0/2689980859 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e8000baf0 con 0x7f0e80004850 2023-11-08T19:23:44.567 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.558+0000 7f0e96ffd700 1 -- 172.21.15.149:0/2689980859 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e8000bcb0 con 0x7f0e980cfdb0 2023-11-08T19:23:44.568 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.558+0000 7f0e97fff700 1 --2- 172.21.15.149:0/2689980859 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e80003c30 0x7f0e80004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:44.568 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.558+0000 7f0e977fe700 1 --2- 172.21.15.149:0/2689980859 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0e80004850 0x7f0e80004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:44.568 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.558+0000 7f0e9c96b700 1 --2- 172.21.15.149:0/2689980859 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0e980cfdb0 0x7f0e80005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:44.568 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.559+0000 7f0e97fff700 1 -- 172.21.15.149:0/2689980859 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0e980cfdb0 msgr2=0x7f0e80005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:44.568 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.559+0000 7f0e97fff700 1 --2- 172.21.15.149:0/2689980859 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0e980cfdb0 0x7f0e80005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:44.569 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.559+0000 7f0e97fff700 1 -- 172.21.15.149:0/2689980859 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0e80004850 msgr2=0x7f0e80004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:44.569 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.559+0000 7f0e97fff700 1 --2- 172.21.15.149:0/2689980859 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0e80004850 0x7f0e80004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:44.569 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.559+0000 7f0e97fff700 1 -- 172.21.15.149:0/2689980859 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e90009a70 con 0x7f0e80003c30 2023-11-08T19:23:44.569 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.559+0000 7f0e97fff700 1 --2- 172.21.15.149:0/2689980859 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e80003c30 0x7f0e80004030 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0e88007fd0 tx=0x7f0e80005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c01cbc183c948d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:44.569 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.559+0000 7f0e96ffd700 1 -- 172.21.15.149:0/2689980859 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e88001430 con 0x7f0e80003c30 2023-11-08T19:23:44.570 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.559+0000 7f0e96ffd700 1 -- 172.21.15.149:0/2689980859 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e880052d0 con 0x7f0e80003c30 2023-11-08T19:23:44.570 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.559+0000 7f0e96ffd700 1 -- 172.21.15.149:0/2689980859 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e88001d40 con 0x7f0e80003c30 2023-11-08T19:23:44.570 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.559+0000 7f0e9e3ce700 1 -- 172.21.15.149:0/2689980859 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e80003c30 msgr2=0x7f0e80004030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:44.570 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.559+0000 7f0e9e3ce700 1 --2- 172.21.15.149:0/2689980859 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e80003c30 0x7f0e80004030 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0e88007fd0 tx=0x7f0e80005880 comp rx=0 tx=0).stop 2023-11-08T19:23:44.570 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.559+0000 7f0e9c96b700 1 -- 172.21.15.149:0/2689980859 reap_dead start 2023-11-08T19:23:44.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.559+0000 7f0e9e3ce700 1 -- 172.21.15.149:0/2689980859 shutdown_connections 2023-11-08T19:23:44.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.559+0000 7f0e9e3ce700 1 -- 172.21.15.149:0/2689980859 >> 172.21.15.149:0/2689980859 conn(0x7f0e9806b1b0 msgr2=0x7f0e980b13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:44.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.559+0000 7f0e9e3ce700 1 -- 172.21.15.149:0/2689980859 shutdown_connections 2023-11-08T19:23:44.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.559+0000 7f0e9e3ce700 1 -- 172.21.15.149:0/2689980859 wait complete. 2023-11-08T19:23:44.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.561+0000 7f0e9e3ce700 1 Processor -- start 2023-11-08T19:23:44.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.561+0000 7f0e9e3ce700 1 -- start start 2023-11-08T19:23:44.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.561+0000 7f0e9e3ce700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e98149240 0x7f0e980c6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:44.575 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.562+0000 7f0e9e3ce700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0e980c6750 0x7f0e980c4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:44.575 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.562+0000 7f0e9e3ce700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0e980c4b50 0x7f0e981f4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:44.575 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.562+0000 7f0e9e3ce700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e98153c70 con 0x7f0e98149240 2023-11-08T19:23:44.575 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.562+0000 7f0e9e3ce700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e98153060 con 0x7f0e980c4b50 2023-11-08T19:23:44.576 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.562+0000 7f0e9e3ce700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e98153340 con 0x7f0e980c6750 2023-11-08T19:23:44.576 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.562+0000 7f0e97fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e98149240 0x7f0e980c6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:44.576 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.562+0000 7f0e97fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e98149240 0x7f0e980c6210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38146/0 (socket says 172.21.15.149:38146) 2023-11-08T19:23:44.576 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.562+0000 7f0e97fff700 1 -- 172.21.15.149:0/3605423190 learned_addr learned my addr 172.21.15.149:0/3605423190 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:44.576 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.562+0000 7f0e977fe700 1 --2- 172.21.15.149:0/3605423190 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0e980c6750 0x7f0e980c4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:44.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.562+0000 7f0e9c96b700 1 --2- 172.21.15.149:0/3605423190 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0e980c4b50 0x7f0e981f4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:44.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.562+0000 7f0e97fff700 1 -- 172.21.15.149:0/3605423190 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0e980c6750 msgr2=0x7f0e980c4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:44.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.562+0000 7f0e97fff700 1 --2- 172.21.15.149:0/3605423190 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0e980c6750 0x7f0e980c4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:44.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.562+0000 7f0e97fff700 1 -- 172.21.15.149:0/3605423190 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0e980c4b50 msgr2=0x7f0e981f4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:44.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.562+0000 7f0e97fff700 1 --2- 172.21.15.149:0/3605423190 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0e980c4b50 0x7f0e981f4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:44.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.562+0000 7f0e97fff700 1 -- 172.21.15.149:0/3605423190 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e98153620 con 0x7f0e98149240 2023-11-08T19:23:44.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.562+0000 7f0e9c96b700 1 --2- 172.21.15.149:0/3605423190 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0e980c4b50 0x7f0e981f4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:23:44.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.562+0000 7f0e97fff700 1 --2- 172.21.15.149:0/3605423190 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e98149240 0x7f0e980c6210 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0e88005040 tx=0x7f0e880012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:44.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.562+0000 7f0e94ff9700 1 -- 172.21.15.149:0/3605423190 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e88001d40 con 0x7f0e98149240 2023-11-08T19:23:44.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.562+0000 7f0e94ff9700 1 -- 172.21.15.149:0/3605423190 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e880013d0 con 0x7f0e98149240 2023-11-08T19:23:44.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.562+0000 7f0e94ff9700 1 -- 172.21.15.149:0/3605423190 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e88007040 con 0x7f0e98149240 2023-11-08T19:23:44.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.562+0000 7f0e9e3ce700 1 -- 172.21.15.149:0/3605423190 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e98153900 con 0x7f0e98149240 2023-11-08T19:23:44.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.562+0000 7f0e9e3ce700 1 -- 172.21.15.149:0/3605423190 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e981f58f0 con 0x7f0e98149240 2023-11-08T19:23:44.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.563+0000 7f0e9e3ce700 1 -- 172.21.15.149:0/3605423190 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e9804f730 con 0x7f0e98149240 2023-11-08T19:23:44.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.564+0000 7f0e94ff9700 1 -- 172.21.15.149:0/3605423190 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0e880071c0 con 0x7f0e98149240 2023-11-08T19:23:44.580 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.564+0000 7f0e94ff9700 1 --2- 172.21.15.149:0/3605423190 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0e8406af00 0x7f0e8406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:44.580 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.564+0000 7f0e94ff9700 1 -- 172.21.15.149:0/3605423190 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0e8808a710 con 0x7f0e98149240 2023-11-08T19:23:44.580 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.564+0000 7f0e977fe700 1 --2- 172.21.15.149:0/3605423190 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0e8406af00 0x7f0e8406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:44.580 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.564+0000 7f0e977fe700 1 --2- 172.21.15.149:0/3605423190 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0e8406af00 0x7f0e8406d3c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c0048d0 tx=0x7f0e8c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:44.580 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.569+0000 7f0e94ff9700 1 -- 172.21.15.149:0/3605423190 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0e88055680 con 0x7f0e98149240 2023-11-08T19:23:44.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.759+0000 7f0e9e3ce700 1 -- 172.21.15.149:0/3605423190 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f0e9815b650 con 0x7f0e98149240 2023-11-08T19:23:44.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.759+0000 7f0e94ff9700 1 -- 172.21.15.149:0/3605423190 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f0e88021020 con 0x7f0e98149240 2023-11-08T19:23:44.762 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:23:44.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.761+0000 7f0e9e3ce700 1 -- 172.21.15.149:0/3605423190 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0e8406af00 msgr2=0x7f0e8406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:44.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.761+0000 7f0e9e3ce700 1 --2- 172.21.15.149:0/3605423190 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0e8406af00 0x7f0e8406d3c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c0048d0 tx=0x7f0e8c009040 comp rx=0 tx=0).stop 2023-11-08T19:23:44.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.761+0000 7f0e9e3ce700 1 -- 172.21.15.149:0/3605423190 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e98149240 msgr2=0x7f0e980c6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:44.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.761+0000 7f0e9e3ce700 1 --2- 172.21.15.149:0/3605423190 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e98149240 0x7f0e980c6210 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0e88005040 tx=0x7f0e880012d0 comp rx=0 tx=0).stop 2023-11-08T19:23:44.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.761+0000 7f0e9e3ce700 1 -- 172.21.15.149:0/3605423190 shutdown_connections 2023-11-08T19:23:44.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.761+0000 7f0e9e3ce700 1 --2- 172.21.15.149:0/3605423190 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0e8406af00 0x7f0e8406d3c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:44.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.761+0000 7f0e9e3ce700 1 --2- 172.21.15.149:0/3605423190 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0e980c4b50 0x7f0e981f4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:44.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.761+0000 7f0e9e3ce700 1 --2- 172.21.15.149:0/3605423190 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e98149240 0x7f0e980c6210 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:44.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.761+0000 7f0e9e3ce700 1 --2- 172.21.15.149:0/3605423190 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0e980c6750 0x7f0e980c4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:44.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.761+0000 7f0e9e3ce700 1 -- 172.21.15.149:0/3605423190 >> 172.21.15.149:0/3605423190 conn(0x7f0e9806b1b0 msgr2=0x7f0e9815fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:44.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.761+0000 7f0e9e3ce700 1 -- 172.21.15.149:0/3605423190 shutdown_connections 2023-11-08T19:23:44.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.761+0000 7f0e9e3ce700 1 -- 172.21.15.149:0/3605423190 wait complete. 2023-11-08T19:23:44.776 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:23:44.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.894+0000 7faa52802700 1 Processor -- start 2023-11-08T19:23:44.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.894+0000 7faa52802700 1 -- start start 2023-11-08T19:23:44.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.895+0000 7faa52802700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7faa4c0cc910 0x7faa4c0cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:44.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.895+0000 7faa52802700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7faa4c0cb130 0x7faa4c15d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:44.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.895+0000 7faa52802700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa4c0b2f60 con 0x7faa4c0cc140 2023-11-08T19:23:44.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.895+0000 7faa52802700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa4c0b2430 con 0x7faa4c0cc910 2023-11-08T19:23:44.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.895+0000 7faa52802700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa4c0cc520 con 0x7faa4c0cb130 2023-11-08T19:23:44.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.895+0000 7faa4b7fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7faa4c0cc910 0x7faa4c0cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:44.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.895+0000 7faa4b7fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7faa4c0cc910 0x7faa4c0cabf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38156/0 (socket says 172.21.15.149:38156) 2023-11-08T19:23:44.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.895+0000 7faa4b7fe700 1 -- 172.21.15.149:0/3341752767 learned_addr learned my addr 172.21.15.149:0/3341752767 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:44.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.895+0000 7faa4bfff700 1 --1- 172.21.15.149:0/3341752767 >> v1:172.21.15.149:6789/0 conn(0x7faa4c0cc140 0x7faa4c0b2850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:40156/0 (socket says 172.21.15.149:40156) 2023-11-08T19:23:44.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.895+0000 7faa50d9f700 1 --2- 172.21.15.149:0/3341752767 >> v2:172.21.15.160:3300/0 conn(0x7faa4c0cb130 0x7faa4c15d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:44.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.895+0000 7faa4b7fe700 1 -- 172.21.15.149:0/3341752767 >> v2:172.21.15.160:3300/0 conn(0x7faa4c0cb130 msgr2=0x7faa4c15d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:44.902 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.895+0000 7faa4b7fe700 1 --2- 172.21.15.149:0/3341752767 >> v2:172.21.15.160:3300/0 conn(0x7faa4c0cb130 0x7faa4c15d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:44.902 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.895+0000 7faa4b7fe700 1 -- 172.21.15.149:0/3341752767 >> v1:172.21.15.149:6789/0 conn(0x7faa4c0cc140 legacy=0x7faa4c0b2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:44.902 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.895+0000 7faa4affd700 1 -- 172.21.15.149:0/3341752767 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1513002739 0 0) 0x7faa4c0b2f60 con 0x7faa4c0cc140 2023-11-08T19:23:44.902 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.895+0000 7faa4b7fe700 1 -- 172.21.15.149:0/3341752767 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa4c0cb5e0 con 0x7faa4c0cc910 2023-11-08T19:23:44.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.895+0000 7faa50d9f700 1 --2- 172.21.15.149:0/3341752767 >> v2:172.21.15.160:3300/0 conn(0x7faa4c0cb130 0x7faa4c15d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:23:44.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.896+0000 7faa4b7fe700 1 --2- 172.21.15.149:0/3341752767 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa4c0cc910 0x7faa4c0cabf0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7faa4c071df0 tx=0x7faa3c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80e71483024d46a2 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:44.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.896+0000 7faa4affd700 1 -- 172.21.15.149:0/3341752767 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3c00b870 con 0x7faa4c0cc910 2023-11-08T19:23:44.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.896+0000 7faa4affd700 1 -- 172.21.15.149:0/3341752767 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa3c00b9d0 con 0x7faa4c0cc910 2023-11-08T19:23:44.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.896+0000 7faa4affd700 1 -- 172.21.15.149:0/3341752767 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3c00bd60 con 0x7faa4c0cc910 2023-11-08T19:23:44.904 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.896+0000 7faa52802700 1 -- 172.21.15.149:0/3341752767 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa4c0cc910 msgr2=0x7faa4c0cabf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:44.904 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.896+0000 7faa52802700 1 --2- 172.21.15.149:0/3341752767 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa4c0cc910 0x7faa4c0cabf0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7faa4c071df0 tx=0x7faa3c009bd0 comp rx=0 tx=0).stop 2023-11-08T19:23:44.904 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.896+0000 7faa52802700 1 -- 172.21.15.149:0/3341752767 shutdown_connections 2023-11-08T19:23:44.904 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.896+0000 7faa52802700 1 --2- 172.21.15.149:0/3341752767 >> v2:172.21.15.160:3300/0 conn(0x7faa4c0cb130 0x7faa4c15d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:44.904 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.896+0000 7faa52802700 1 --2- 172.21.15.149:0/3341752767 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa4c0cc910 0x7faa4c0cabf0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:44.905 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.896+0000 7faa52802700 1 -- 172.21.15.149:0/3341752767 >> 172.21.15.149:0/3341752767 conn(0x7faa4c099a40 msgr2=0x7faa4c0d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:44.905 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.896+0000 7faa52802700 1 -- 172.21.15.149:0/3341752767 shutdown_connections 2023-11-08T19:23:44.905 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.896+0000 7faa52802700 1 -- 172.21.15.149:0/3341752767 wait complete. 2023-11-08T19:23:44.905 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.897+0000 7faa52802700 1 Processor -- start 2023-11-08T19:23:44.908 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.898+0000 7faa52802700 1 -- start start 2023-11-08T19:23:44.908 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.898+0000 7faa52802700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faa4c0cb130 0x7faa4c09dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:44.908 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.898+0000 7faa52802700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faa4c0cc140 0x7faa4c0af310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:44.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.898+0000 7faa52802700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa4c0cc910 0x7faa4c0b5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:44.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.899+0000 7faa52802700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c0aeef0 con 0x7faa4c0cc910 2023-11-08T19:23:44.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.899+0000 7faa52802700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c09e110 con 0x7faa4c0cc140 2023-11-08T19:23:44.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.899+0000 7faa52802700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c0ae270 con 0x7faa4c0cb130 2023-11-08T19:23:44.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.899+0000 7faa50d9f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa4c0cc910 0x7faa4c0b5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:44.910 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.899+0000 7faa50d9f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa4c0cc910 0x7faa4c0b5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38164/0 (socket says 172.21.15.149:38164) 2023-11-08T19:23:44.910 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.899+0000 7faa50d9f700 1 -- 172.21.15.149:0/4114453141 learned_addr learned my addr 172.21.15.149:0/4114453141 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:44.911 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.899+0000 7faa4b7fe700 1 --2- 172.21.15.149:0/4114453141 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faa4c0cc140 0x7faa4c0af310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:44.911 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.899+0000 7faa4bfff700 1 --2- 172.21.15.149:0/4114453141 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faa4c0cb130 0x7faa4c09dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:44.911 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.899+0000 7faa50d9f700 1 -- 172.21.15.149:0/4114453141 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faa4c0cb130 msgr2=0x7faa4c09dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:44.911 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.899+0000 7faa50d9f700 1 --2- 172.21.15.149:0/4114453141 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faa4c0cb130 0x7faa4c09dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:44.911 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.899+0000 7faa50d9f700 1 -- 172.21.15.149:0/4114453141 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faa4c0cc140 msgr2=0x7faa4c0af310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:44.912 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.899+0000 7faa50d9f700 1 --2- 172.21.15.149:0/4114453141 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faa4c0cc140 0x7faa4c0af310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:44.912 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.899+0000 7faa50d9f700 1 -- 172.21.15.149:0/4114453141 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa3c009550 con 0x7faa4c0cc910 2023-11-08T19:23:44.912 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.899+0000 7faa4bfff700 1 --2- 172.21.15.149:0/4114453141 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faa4c0cb130 0x7faa4c09dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:23:44.912 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.899+0000 7faa50d9f700 1 --2- 172.21.15.149:0/4114453141 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa4c0cc910 0x7faa4c0b5420 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7faa4400cef0 tx=0x7faa4400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:44.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.899+0000 7faa48ff9700 1 -- 172.21.15.149:0/4114453141 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4400ae50 con 0x7faa4c0cc910 2023-11-08T19:23:44.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.899+0000 7faa48ff9700 1 -- 172.21.15.149:0/4114453141 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa44015440 con 0x7faa4c0cc910 2023-11-08T19:23:44.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.899+0000 7faa52802700 1 -- 172.21.15.149:0/4114453141 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa4c0ae550 con 0x7faa4c0cc910 2023-11-08T19:23:44.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.899+0000 7faa48ff9700 1 -- 172.21.15.149:0/4114453141 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa440157f0 con 0x7faa4c0cc910 2023-11-08T19:23:44.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.899+0000 7faa52802700 1 -- 172.21.15.149:0/4114453141 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa4c0aeb10 con 0x7faa4c0cc910 2023-11-08T19:23:44.914 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.900+0000 7faa52802700 1 -- 172.21.15.149:0/4114453141 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa4c0b1790 con 0x7faa4c0cc910 2023-11-08T19:23:44.914 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.901+0000 7faa48ff9700 1 -- 172.21.15.149:0/4114453141 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faa4400d430 con 0x7faa4c0cc910 2023-11-08T19:23:44.914 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.901+0000 7faa48ff9700 1 --2- 172.21.15.149:0/4114453141 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7faa2c06af00 0x7faa2c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:44.914 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.901+0000 7faa48ff9700 1 -- 172.21.15.149:0/4114453141 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7faa44089ea0 con 0x7faa4c0cc910 2023-11-08T19:23:44.914 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.901+0000 7faa4bfff700 1 --2- 172.21.15.149:0/4114453141 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7faa2c06af00 0x7faa2c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:44.915 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.901+0000 7faa4bfff700 1 --2- 172.21.15.149:0/4114453141 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7faa2c06af00 0x7faa2c06d3c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7faa340017e0 tx=0x7faa34009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:44.915 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:44.906+0000 7faa48ff9700 1 -- 172.21.15.149:0/4114453141 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7faa4c0b1790 con 0x7faa4c0cc910 2023-11-08T19:23:45.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.096+0000 7faa52802700 1 -- 172.21.15.149:0/4114453141 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faa4c0b1790 con 0x7faa4c0cc910 2023-11-08T19:23:45.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.097+0000 7faa48ff9700 1 -- 172.21.15.149:0/4114453141 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18382 (secure 0 0 0) 0x7faa4c0b1790 con 0x7faa4c0cc910 2023-11-08T19:23:45.100 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:23:45.100 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":24,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:23:06.964482+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-08T19:22:59.830928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-08T19:23:00.886589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-08T19:23:04.574033+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:23:45.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.099+0000 7faa52802700 1 -- 172.21.15.149:0/4114453141 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7faa2c06af00 msgr2=0x7faa2c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:45.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.099+0000 7faa52802700 1 --2- 172.21.15.149:0/4114453141 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7faa2c06af00 0x7faa2c06d3c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7faa340017e0 tx=0x7faa34009040 comp rx=0 tx=0).stop 2023-11-08T19:23:45.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.099+0000 7faa52802700 1 -- 172.21.15.149:0/4114453141 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa4c0cc910 msgr2=0x7faa4c0b5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:45.103 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.099+0000 7faa52802700 1 --2- 172.21.15.149:0/4114453141 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa4c0cc910 0x7faa4c0b5420 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7faa4400cef0 tx=0x7faa4400a340 comp rx=0 tx=0).stop 2023-11-08T19:23:45.103 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.099+0000 7faa52802700 1 -- 172.21.15.149:0/4114453141 shutdown_connections 2023-11-08T19:23:45.103 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.099+0000 7faa52802700 1 --2- 172.21.15.149:0/4114453141 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7faa2c06af00 0x7faa2c06d3c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:45.103 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.100+0000 7faa52802700 1 --2- 172.21.15.149:0/4114453141 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa4c0cc910 0x7faa4c0b5420 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:45.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.100+0000 7faa52802700 1 --2- 172.21.15.149:0/4114453141 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faa4c0cb130 0x7faa4c09dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:45.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.100+0000 7faa52802700 1 --2- 172.21.15.149:0/4114453141 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faa4c0cc140 0x7faa4c0af310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:45.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.100+0000 7faa52802700 1 -- 172.21.15.149:0/4114453141 >> 172.21.15.149:0/4114453141 conn(0x7faa4c099a40 msgr2=0x7faa4c06ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:45.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.100+0000 7faa52802700 1 -- 172.21.15.149:0/4114453141 shutdown_connections 2023-11-08T19:23:45.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.100+0000 7faa52802700 1 -- 172.21.15.149:0/4114453141 wait complete. 2023-11-08T19:23:45.114 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-08T19:22:56.023194+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-08T19:22:59.830928+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-08T19:23:00.886589+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-08T19:23:04.574033+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-08T19:23:45.115 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-08T19:23:45.238 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.236+0000 7fb7f1f75700 1 Processor -- start 2023-11-08T19:23:45.239 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.236+0000 7fb7f1f75700 1 -- start start 2023-11-08T19:23:45.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.237+0000 7fb7f1f75700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb7ec15df40 0x7fb7ec06c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:45.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.237+0000 7fb7f1f75700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb7ec0cb660 0x7fb7ec06c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:45.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.237+0000 7fb7f1f75700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7ec15e320 con 0x7fb7ec06ab80 2023-11-08T19:23:45.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.237+0000 7fb7f1f75700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7ec06b020 con 0x7fb7ec15df40 2023-11-08T19:23:45.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.237+0000 7fb7f1f75700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ec06b2e0 con 0x7fb7ec0cb660 2023-11-08T19:23:45.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.237+0000 7fb7eb7fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb7ec15df40 0x7fb7ec06c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:45.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.237+0000 7fb7eb7fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb7ec15df40 0x7fb7ec06c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38168/0 (socket says 172.21.15.149:38168) 2023-11-08T19:23:45.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.237+0000 7fb7eb7fe700 1 -- 172.21.15.149:0/3843666470 learned_addr learned my addr 172.21.15.149:0/3843666470 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:45.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.237+0000 7fb7ebfff700 1 --2- 172.21.15.149:0/3843666470 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb7ec0cb660 0x7fb7ec06c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:45.243 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.237+0000 7fb7eb7fe700 1 -- 172.21.15.149:0/3843666470 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb7ec0cb660 msgr2=0x7fb7ec06c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:45.243 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.237+0000 7fb7eb7fe700 1 --2- 172.21.15.149:0/3843666470 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb7ec0cb660 0x7fb7ec06c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:45.243 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.237+0000 7fb7eb7fe700 1 -- 172.21.15.149:0/3843666470 >> v1:172.21.15.160:6789/0 conn(0x7fb7ec06ab80 legacy=0x7fb7ec0caf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:45.243 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.238+0000 7fb7eb7fe700 1 -- 172.21.15.149:0/3843666470 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7ec06b5c0 con 0x7fb7ec15df40 2023-11-08T19:23:45.243 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.238+0000 7fb7ebfff700 1 --2- 172.21.15.149:0/3843666470 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb7ec0cb660 0x7fb7ec06c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:23:45.244 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.238+0000 7fb7eb7fe700 1 --2- 172.21.15.149:0/3843666470 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7ec15df40 0x7fb7ec06c0a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb7d40098f0 tx=0x7fb7d4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8d8cbfebf10ed73 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:45.244 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.238+0000 7fb7ea7fc700 1 -- 172.21.15.149:0/3843666470 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d4004230 con 0x7fb7ec15df40 2023-11-08T19:23:45.244 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.238+0000 7fb7ea7fc700 1 -- 172.21.15.149:0/3843666470 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d4004390 con 0x7fb7ec15df40 2023-11-08T19:23:45.244 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.238+0000 7fb7ea7fc700 1 -- 172.21.15.149:0/3843666470 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d40036a0 con 0x7fb7ec15df40 2023-11-08T19:23:45.244 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.238+0000 7fb7f1f75700 1 -- 172.21.15.149:0/3843666470 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7ec15df40 msgr2=0x7fb7ec06c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:45.244 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.238+0000 7fb7f1f75700 1 --2- 172.21.15.149:0/3843666470 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7ec15df40 0x7fb7ec06c0a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb7d40098f0 tx=0x7fb7d4009c00 comp rx=0 tx=0).stop 2023-11-08T19:23:45.245 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.238+0000 7fb7f1f75700 1 -- 172.21.15.149:0/3843666470 shutdown_connections 2023-11-08T19:23:45.245 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.238+0000 7fb7f1f75700 1 --2- 172.21.15.149:0/3843666470 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb7ec0cb660 0x7fb7ec06c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:45.245 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.238+0000 7fb7f1f75700 1 --2- 172.21.15.149:0/3843666470 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7ec15df40 0x7fb7ec06c0a0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:45.245 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.238+0000 7fb7f1f75700 1 -- 172.21.15.149:0/3843666470 >> 172.21.15.149:0/3843666470 conn(0x7fb7ec0d0640 msgr2=0x7fb7ec0d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:45.245 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.238+0000 7fb7f1f75700 1 -- 172.21.15.149:0/3843666470 shutdown_connections 2023-11-08T19:23:45.246 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.238+0000 7fb7f1f75700 1 -- 172.21.15.149:0/3843666470 wait complete. 2023-11-08T19:23:45.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.239+0000 7fb7f1f75700 1 Processor -- start 2023-11-08T19:23:45.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.240+0000 7fb7f1f75700 1 -- start start 2023-11-08T19:23:45.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.240+0000 7fb7f1f75700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb7ec06ab80 0x7fb7ec1536c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:45.249 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.240+0000 7fb7f1f75700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7ec0cb660 0x7fb7ec0c7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:45.249 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.240+0000 7fb7f1f75700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb7ec15df40 0x7fb7ec0adeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:45.249 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.240+0000 7fb7f1f75700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ec0c47a0 con 0x7fb7ec0cb660 2023-11-08T19:23:45.249 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.240+0000 7fb7f1f75700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ec1f3520 con 0x7fb7ec15df40 2023-11-08T19:23:45.249 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.240+0000 7fb7f1f75700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ec0c4170 con 0x7fb7ec06ab80 2023-11-08T19:23:45.250 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.241+0000 7fb7eaffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7ec0cb660 0x7fb7ec0c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:45.250 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.241+0000 7fb7eaffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7ec0cb660 0x7fb7ec0c7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38176/0 (socket says 172.21.15.149:38176) 2023-11-08T19:23:45.250 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.241+0000 7fb7eaffd700 1 -- 172.21.15.149:0/1205343318 learned_addr learned my addr 172.21.15.149:0/1205343318 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:45.250 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.241+0000 7fb7eb7fe700 1 --2- 172.21.15.149:0/1205343318 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb7ec06ab80 0x7fb7ec1536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:45.250 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.241+0000 7fb7ebfff700 1 --2- 172.21.15.149:0/1205343318 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb7ec15df40 0x7fb7ec0adeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:45.251 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.241+0000 7fb7eaffd700 1 -- 172.21.15.149:0/1205343318 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb7ec06ab80 msgr2=0x7fb7ec1536c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:45.251 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.241+0000 7fb7eaffd700 1 --2- 172.21.15.149:0/1205343318 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb7ec06ab80 0x7fb7ec1536c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:45.251 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.241+0000 7fb7eaffd700 1 -- 172.21.15.149:0/1205343318 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb7ec15df40 msgr2=0x7fb7ec0adeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:45.251 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.241+0000 7fb7eaffd700 1 --2- 172.21.15.149:0/1205343318 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb7ec15df40 0x7fb7ec0adeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:45.251 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.241+0000 7fb7eaffd700 1 -- 172.21.15.149:0/1205343318 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d4009550 con 0x7fb7ec0cb660 2023-11-08T19:23:45.252 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.241+0000 7fb7ebfff700 1 --2- 172.21.15.149:0/1205343318 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb7ec15df40 0x7fb7ec0adeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:23:45.252 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.241+0000 7fb7eb7fe700 1 --2- 172.21.15.149:0/1205343318 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb7ec06ab80 0x7fb7ec1536c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:23:45.252 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.241+0000 7fb7eaffd700 1 --2- 172.21.15.149:0/1205343318 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7ec0cb660 0x7fb7ec0c7710 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc00c4d0 tx=0x7fb7dc00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:45.252 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.241+0000 7fb7e3fff700 1 -- 172.21.15.149:0/1205343318 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7dc011790 con 0x7fb7ec0cb660 2023-11-08T19:23:45.252 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.241+0000 7fb7e3fff700 1 -- 172.21.15.149:0/1205343318 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7dc0118f0 con 0x7fb7ec0cb660 2023-11-08T19:23:45.252 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.241+0000 7fb7f1f75700 1 -- 172.21.15.149:0/1205343318 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7ec0c6ef0 con 0x7fb7ec0cb660 2023-11-08T19:23:45.253 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.241+0000 7fb7e3fff700 1 -- 172.21.15.149:0/1205343318 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7dc011ca0 con 0x7fb7ec0cb660 2023-11-08T19:23:45.253 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.241+0000 7fb7f1f75700 1 -- 172.21.15.149:0/1205343318 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7ec0c8400 con 0x7fb7ec0cb660 2023-11-08T19:23:45.253 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.242+0000 7fb7f1f75700 1 -- 172.21.15.149:0/1205343318 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7ec04f730 con 0x7fb7ec0cb660 2023-11-08T19:23:45.253 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.243+0000 7fb7e3fff700 1 -- 172.21.15.149:0/1205343318 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb7dc01c460 con 0x7fb7ec0cb660 2023-11-08T19:23:45.253 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.243+0000 7fb7e3fff700 1 --2- 172.21.15.149:0/1205343318 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb7cc06af00 0x7fb7cc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:45.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.243+0000 7fb7e3fff700 1 -- 172.21.15.149:0/1205343318 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb7dc089770 con 0x7fb7ec0cb660 2023-11-08T19:23:45.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.243+0000 7fb7eb7fe700 1 --2- 172.21.15.149:0/1205343318 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb7cc06af00 0x7fb7cc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:45.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.243+0000 7fb7eb7fe700 1 --2- 172.21.15.149:0/1205343318 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb7cc06af00 0x7fb7cc06d3c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb7d4009c40 tx=0x7fb7d4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:45.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.248+0000 7fb7e3fff700 1 -- 172.21.15.149:0/1205343318 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb7dc0544b0 con 0x7fb7ec0cb660 2023-11-08T19:23:45.439 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.437+0000 7fb7f1f75700 1 -- 172.21.15.149:0/1205343318 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb7ec0c3ae0 con 0x7fb7ec0cb660 2023-11-08T19:23:45.439 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.437+0000 7fb7e3fff700 1 -- 172.21.15.149:0/1205343318 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb7dc057ad0 con 0x7fb7ec0cb660 2023-11-08T19:23:45.439 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 1 2023-11-08T19:23:45.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.439+0000 7fb7f1f75700 1 -- 172.21.15.149:0/1205343318 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb7cc06af00 msgr2=0x7fb7cc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:45.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.439+0000 7fb7f1f75700 1 --2- 172.21.15.149:0/1205343318 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb7cc06af00 0x7fb7cc06d3c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb7d4009c40 tx=0x7fb7d4008030 comp rx=0 tx=0).stop 2023-11-08T19:23:45.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.439+0000 7fb7f1f75700 1 -- 172.21.15.149:0/1205343318 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7ec0cb660 msgr2=0x7fb7ec0c7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:45.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.439+0000 7fb7f1f75700 1 --2- 172.21.15.149:0/1205343318 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7ec0cb660 0x7fb7ec0c7710 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc00c4d0 tx=0x7fb7dc00c890 comp rx=0 tx=0).stop 2023-11-08T19:23:45.443 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.439+0000 7fb7f1f75700 1 -- 172.21.15.149:0/1205343318 shutdown_connections 2023-11-08T19:23:45.443 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.439+0000 7fb7f1f75700 1 --2- 172.21.15.149:0/1205343318 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb7cc06af00 0x7fb7cc06d3c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:45.443 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.439+0000 7fb7f1f75700 1 --2- 172.21.15.149:0/1205343318 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb7ec15df40 0x7fb7ec0adeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:45.443 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.439+0000 7fb7f1f75700 1 --2- 172.21.15.149:0/1205343318 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb7ec06ab80 0x7fb7ec1536c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:45.443 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.439+0000 7fb7f1f75700 1 --2- 172.21.15.149:0/1205343318 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7ec0cb660 0x7fb7ec0c7710 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:45.443 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.439+0000 7fb7f1f75700 1 -- 172.21.15.149:0/1205343318 >> 172.21.15.149:0/1205343318 conn(0x7fb7ec0d0640 msgr2=0x7fb7ec0b0240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:45.444 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.439+0000 7fb7f1f75700 1 -- 172.21.15.149:0/1205343318 shutdown_connections 2023-11-08T19:23:45.444 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.440+0000 7fb7f1f75700 1 -- 172.21.15.149:0/1205343318 wait complete. 2023-11-08T19:23:45.454 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-08T19:23:45.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.577+0000 7f6ed2665700 1 Processor -- start 2023-11-08T19:23:45.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.577+0000 7f6ed2665700 1 -- start start 2023-11-08T19:23:45.582 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.577+0000 7f6ed2665700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f6ecc15df40 0x7f6ecc06c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:45.582 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.577+0000 7f6ed2665700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6ecc06ab80 0x7f6ecc06c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:45.582 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.577+0000 7f6ed2665700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6ecc0cf1c0 0x7f6ecc0caf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:45.582 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.577+0000 7f6ed2665700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ecc15e320 con 0x7f6ecc0cf1c0 2023-11-08T19:23:45.583 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.577+0000 7f6ed2665700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ecc06b020 con 0x7f6ecc15df40 2023-11-08T19:23:45.583 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.577+0000 7f6ed2665700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc06b2e0 con 0x7f6ecc06ab80 2023-11-08T19:23:45.583 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.578+0000 7f6ecbfff700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f6ecc15df40 0x7f6ecc06c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:45.583 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.578+0000 7f6ecb7fe700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6ecc06ab80 0x7f6ecc06c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:45.583 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.578+0000 7f6ed0c02700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6ecc0cf1c0 0x7f6ecc0caf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:45.584 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.578+0000 7f6ecbfff700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f6ecc15df40 0x7f6ecc06c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.149:39174/0 (socket says 172.21.15.149:39174) 2023-11-08T19:23:45.584 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.578+0000 7f6ecb7fe700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6ecc06ab80 0x7f6ecc06c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.149:58470/0 (socket says 172.21.15.149:58470) 2023-11-08T19:23:45.584 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.578+0000 7f6ecbfff700 1 -- 172.21.15.149:0/1675149888 learned_addr learned my addr 172.21.15.149:0/1675149888 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:45.584 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.578+0000 7f6ed0c02700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6ecc0cf1c0 0x7f6ecc0caf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38186/0 (socket says 172.21.15.149:38186) 2023-11-08T19:23:45.584 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.578+0000 7f6ed0c02700 1 -- 172.21.15.149:0/1675149888 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6ecc06ab80 msgr2=0x7f6ecc06c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:45.585 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.578+0000 7f6ed0c02700 1 --2- 172.21.15.149:0/1675149888 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6ecc06ab80 0x7f6ecc06c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:45.585 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.578+0000 7f6ed0c02700 1 -- 172.21.15.149:0/1675149888 >> v2:172.21.15.160:3300/0 conn(0x7f6ecc15df40 msgr2=0x7f6ecc06c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:45.585 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.578+0000 7f6ed0c02700 1 --2- 172.21.15.149:0/1675149888 >> v2:172.21.15.160:3300/0 conn(0x7f6ecc15df40 0x7f6ecc06c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:45.585 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.578+0000 7f6ed0c02700 1 -- 172.21.15.149:0/1675149888 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ecc06b5c0 con 0x7f6ecc0cf1c0 2023-11-08T19:23:45.586 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.578+0000 7f6ed0c02700 1 --2- 172.21.15.149:0/1675149888 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ecc0cf1c0 0x7f6ecc0caf50 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc0ce190 tx=0x7f6ec400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4323b29dacb9857e server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:45.586 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.578+0000 7f6ecaffd700 1 -- 172.21.15.149:0/1675149888 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec400e070 con 0x7f6ecc0cf1c0 2023-11-08T19:23:45.586 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.578+0000 7f6ecaffd700 1 -- 172.21.15.149:0/1675149888 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec400bb20 con 0x7f6ecc0cf1c0 2023-11-08T19:23:45.586 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.578+0000 7f6ecaffd700 1 -- 172.21.15.149:0/1675149888 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec4012430 con 0x7f6ecc0cf1c0 2023-11-08T19:23:45.586 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.579+0000 7f6ed2665700 1 -- 172.21.15.149:0/1675149888 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ecc0cf1c0 msgr2=0x7f6ecc0caf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:45.587 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.579+0000 7f6ed2665700 1 --2- 172.21.15.149:0/1675149888 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ecc0cf1c0 0x7f6ecc0caf50 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc0ce190 tx=0x7f6ec400b330 comp rx=0 tx=0).stop 2023-11-08T19:23:45.587 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.579+0000 7f6ed2665700 1 -- 172.21.15.149:0/1675149888 shutdown_connections 2023-11-08T19:23:45.587 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.579+0000 7f6ed2665700 1 --2- 172.21.15.149:0/1675149888 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ecc0cf1c0 0x7f6ecc0caf50 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:45.587 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.579+0000 7f6ed2665700 1 --2- 172.21.15.149:0/1675149888 >> v2:172.21.15.160:3300/0 conn(0x7f6ecc15df40 0x7f6ecc06c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:45.587 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.579+0000 7f6ed2665700 1 --2- 172.21.15.149:0/1675149888 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6ecc06ab80 0x7f6ecc06c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:45.588 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.579+0000 7f6ed2665700 1 -- 172.21.15.149:0/1675149888 >> 172.21.15.149:0/1675149888 conn(0x7f6ecc0d0640 msgr2=0x7f6ecc0d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:45.588 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.579+0000 7f6ed2665700 1 -- 172.21.15.149:0/1675149888 shutdown_connections 2023-11-08T19:23:45.588 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.579+0000 7f6ed2665700 1 -- 172.21.15.149:0/1675149888 wait complete. 2023-11-08T19:23:45.590 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.580+0000 7f6ed2665700 1 Processor -- start 2023-11-08T19:23:45.590 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.580+0000 7f6ed2665700 1 -- start start 2023-11-08T19:23:45.591 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.581+0000 7f6ed2665700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6ecc06ab80 0x7f6ecc0ca0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:45.591 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.581+0000 7f6ed2665700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ecc0cf1c0 0x7f6ecc152040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:45.591 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.581+0000 7f6ed2665700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6ecc15df40 0x7f6ecc0aeca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:45.591 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.581+0000 7f6ed2665700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc0c88b0 con 0x7f6ecc0cf1c0 2023-11-08T19:23:45.591 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.581+0000 7f6ed2665700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc0ca5e0 con 0x7f6ecc15df40 2023-11-08T19:23:45.592 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.581+0000 7f6ed2665700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc0ad1b0 con 0x7f6ecc06ab80 2023-11-08T19:23:45.592 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.581+0000 7f6ecb7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ecc0cf1c0 0x7f6ecc152040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:45.592 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.581+0000 7f6ecb7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ecc0cf1c0 0x7f6ecc152040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38190/0 (socket says 172.21.15.149:38190) 2023-11-08T19:23:45.592 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.581+0000 7f6ecb7fe700 1 -- 172.21.15.149:0/2772746292 learned_addr learned my addr 172.21.15.149:0/2772746292 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:45.592 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.581+0000 7f6ed0c02700 1 --2- 172.21.15.149:0/2772746292 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6ecc15df40 0x7f6ecc0aeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:45.593 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.581+0000 7f6ecbfff700 1 --2- 172.21.15.149:0/2772746292 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6ecc06ab80 0x7f6ecc0ca0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:45.593 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.582+0000 7f6ecb7fe700 1 -- 172.21.15.149:0/2772746292 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6ecc06ab80 msgr2=0x7f6ecc0ca0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:45.593 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.582+0000 7f6ecb7fe700 1 --2- 172.21.15.149:0/2772746292 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6ecc06ab80 0x7f6ecc0ca0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:45.593 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.582+0000 7f6ecb7fe700 1 -- 172.21.15.149:0/2772746292 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6ecc15df40 msgr2=0x7f6ecc0aeca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:45.593 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.582+0000 7f6ecb7fe700 1 --2- 172.21.15.149:0/2772746292 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6ecc15df40 0x7f6ecc0aeca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:45.594 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.582+0000 7f6ecb7fe700 1 -- 172.21.15.149:0/2772746292 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec4009a70 con 0x7f6ecc0cf1c0 2023-11-08T19:23:45.594 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.582+0000 7f6ecb7fe700 1 --2- 172.21.15.149:0/2772746292 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ecc0cf1c0 0x7f6ecc152040 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6ec000e9b0 tx=0x7f6ec000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:45.594 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.582+0000 7f6ec8ff9700 1 -- 172.21.15.149:0/2772746292 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec0009710 con 0x7f6ecc0cf1c0 2023-11-08T19:23:45.594 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.582+0000 7f6ec8ff9700 1 -- 172.21.15.149:0/2772746292 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec000ee50 con 0x7f6ecc0cf1c0 2023-11-08T19:23:45.594 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.582+0000 7f6ec8ff9700 1 -- 172.21.15.149:0/2772746292 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec000ca50 con 0x7f6ecc0cf1c0 2023-11-08T19:23:45.595 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.582+0000 7f6ed2665700 1 -- 172.21.15.149:0/2772746292 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ecc15e4b0 con 0x7f6ecc0cf1c0 2023-11-08T19:23:45.595 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.582+0000 7f6ed2665700 1 -- 172.21.15.149:0/2772746292 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ecc0c81f0 con 0x7f6ecc0cf1c0 2023-11-08T19:23:45.595 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.583+0000 7f6ed2665700 1 -- 172.21.15.149:0/2772746292 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ecc15b2d0 con 0x7f6ecc0cf1c0 2023-11-08T19:23:45.595 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.583+0000 7f6ec8ff9700 1 -- 172.21.15.149:0/2772746292 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6ec000cbb0 con 0x7f6ecc0cf1c0 2023-11-08T19:23:45.596 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.584+0000 7f6ec8ff9700 1 --2- 172.21.15.149:0/2772746292 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6eb806af00 0x7f6eb806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:45.596 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.584+0000 7f6ecbfff700 1 --2- 172.21.15.149:0/2772746292 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6eb806af00 0x7f6eb806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:45.596 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.584+0000 7f6ec8ff9700 1 -- 172.21.15.149:0/2772746292 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6ec0089810 con 0x7f6ecc0cf1c0 2023-11-08T19:23:45.596 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.584+0000 7f6ecbfff700 1 --2- 172.21.15.149:0/2772746292 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6eb806af00 0x7f6eb806d3c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc009ab0 tx=0x7f6ebc0092c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:45.597 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.589+0000 7f6ec8ff9700 1 -- 172.21.15.149:0/2772746292 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6ec0054660 con 0x7f6ecc0cf1c0 2023-11-08T19:23:45.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.779+0000 7f6ed2665700 1 -- 172.21.15.149:0/2772746292 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6ecc04f730 con 0x7f6ecc0cf1c0 2023-11-08T19:23:45.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.780+0000 7f6ec8ff9700 1 -- 172.21.15.149:0/2772746292 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6ec000ce60 con 0x7f6ecc0cf1c0 2023-11-08T19:23:45.783 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:23:45.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.782+0000 7f6ed2665700 1 -- 172.21.15.149:0/2772746292 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6eb806af00 msgr2=0x7f6eb806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:45.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.782+0000 7f6ed2665700 1 --2- 172.21.15.149:0/2772746292 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6eb806af00 0x7f6eb806d3c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc009ab0 tx=0x7f6ebc0092c0 comp rx=0 tx=0).stop 2023-11-08T19:23:45.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.782+0000 7f6ed2665700 1 -- 172.21.15.149:0/2772746292 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ecc0cf1c0 msgr2=0x7f6ecc152040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:45.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.782+0000 7f6ed2665700 1 --2- 172.21.15.149:0/2772746292 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ecc0cf1c0 0x7f6ecc152040 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6ec000e9b0 tx=0x7f6ec000ecc0 comp rx=0 tx=0).stop 2023-11-08T19:23:45.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.782+0000 7f6ed2665700 1 -- 172.21.15.149:0/2772746292 shutdown_connections 2023-11-08T19:23:45.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.782+0000 7f6ed2665700 1 --2- 172.21.15.149:0/2772746292 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6eb806af00 0x7f6eb806d3c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:45.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.782+0000 7f6ed2665700 1 --2- 172.21.15.149:0/2772746292 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6ecc15df40 0x7f6ecc0aeca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:45.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.782+0000 7f6ed2665700 1 --2- 172.21.15.149:0/2772746292 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6ecc06ab80 0x7f6ecc0ca0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:45.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.782+0000 7f6ed2665700 1 --2- 172.21.15.149:0/2772746292 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ecc0cf1c0 0x7f6ecc152040 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:45.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.782+0000 7f6ed2665700 1 -- 172.21.15.149:0/2772746292 >> 172.21.15.149:0/2772746292 conn(0x7f6ecc0d0640 msgr2=0x7f6ecc15abc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:45.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.782+0000 7f6ed2665700 1 -- 172.21.15.149:0/2772746292 shutdown_connections 2023-11-08T19:23:45.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.782+0000 7f6ed2665700 1 -- 172.21.15.149:0/2772746292 wait complete. 2023-11-08T19:23:45.797 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-08T19:23:45.921 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.920+0000 7f77a353b700 1 Processor -- start 2023-11-08T19:23:45.921 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.920+0000 7f77a353b700 1 -- start start 2023-11-08T19:23:45.923 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.920+0000 7f77a353b700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f779c15dc90 0x7f779c0cb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:45.923 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.920+0000 7f77a353b700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f779c0cacd0 con 0x7f779c15a0e0 2023-11-08T19:23:45.924 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.920+0000 7f77a353b700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f779c06e300 con 0x7f779c0ceae0 2023-11-08T19:23:45.924 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.920+0000 7f77a353b700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f779c06e5e0 con 0x7f779c15dc90 2023-11-08T19:23:45.924 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.920+0000 7f77a1ad8700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f779c15dc90 0x7f779c0cb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:45.924 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.920+0000 7f77a12d7700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f779c15a0e0 0x7f779c0ce3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:40198/0 (socket says 172.21.15.149:40198) 2023-11-08T19:23:45.924 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.920+0000 7f77a12d7700 1 -- 172.21.15.149:0/3001444326 learned_addr learned my addr 172.21.15.149:0/3001444326 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:23:45.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.920+0000 7f77a1ad8700 1 -- 172.21.15.149:0/3001444326 >> v1:172.21.15.160:6789/0 conn(0x7f779c0ceae0 legacy=0x7f779c0cb1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:45.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.920+0000 7f77a1ad8700 1 -- 172.21.15.149:0/3001444326 >> v1:172.21.15.149:6789/0 conn(0x7f779c15a0e0 legacy=0x7f779c0ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:45.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.920+0000 7f7793fff700 1 -- 172.21.15.149:0/3001444326 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2728406380 0 0) 0x7f779c0cacd0 con 0x7f779c15a0e0 2023-11-08T19:23:45.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.920+0000 7f77a1ad8700 1 -- 172.21.15.149:0/3001444326 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f779c06e8c0 con 0x7f779c15dc90 2023-11-08T19:23:45.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.920+0000 7f77a1ad8700 1 --2- 172.21.15.149:0/3001444326 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f779c15dc90 0x7f779c0cb8c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f7794009d90 tx=0x7f779400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf7b91acb546c6ad server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:45.926 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.920+0000 7f7793fff700 1 -- 172.21.15.149:0/3001444326 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779400e070 con 0x7f779c15dc90 2023-11-08T19:23:45.926 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.920+0000 7f7793fff700 1 -- 172.21.15.149:0/3001444326 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f779400bbd0 con 0x7f779c15dc90 2023-11-08T19:23:45.926 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.920+0000 7f7793fff700 1 -- 172.21.15.149:0/3001444326 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7794012430 con 0x7f779c15dc90 2023-11-08T19:23:45.926 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.921+0000 7f77a353b700 1 -- 172.21.15.149:0/3001444326 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f779c15dc90 msgr2=0x7f779c0cb8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:45.926 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.921+0000 7f77a353b700 1 --2- 172.21.15.149:0/3001444326 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f779c15dc90 0x7f779c0cb8c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f7794009d90 tx=0x7f779400b330 comp rx=0 tx=0).stop 2023-11-08T19:23:45.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.921+0000 7f77a353b700 1 -- 172.21.15.149:0/3001444326 shutdown_connections 2023-11-08T19:23:45.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.921+0000 7f77a353b700 1 --2- 172.21.15.149:0/3001444326 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f779c15dc90 0x7f779c0cb8c0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:45.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.921+0000 7f77a353b700 1 -- 172.21.15.149:0/3001444326 >> 172.21.15.149:0/3001444326 conn(0x7f779c0cc860 msgr2=0x7f779c0ccc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:45.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.921+0000 7f77a353b700 1 -- 172.21.15.149:0/3001444326 shutdown_connections 2023-11-08T19:23:45.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.921+0000 7f77a353b700 1 -- 172.21.15.149:0/3001444326 wait complete. 2023-11-08T19:23:45.930 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.922+0000 7f77a353b700 1 Processor -- start 2023-11-08T19:23:45.930 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.922+0000 7f77a353b700 1 -- start start 2023-11-08T19:23:45.930 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.923+0000 7f77a353b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f779c0ceae0 0x7f779c157240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:45.931 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.923+0000 7f77a353b700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f779c15a0e0 0x7f779c1555d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:45.931 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.923+0000 7f77a353b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f779c15dc90 0x7f779c1f0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:45.931 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.923+0000 7f77a353b700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f779c157780 con 0x7f779c15dc90 2023-11-08T19:23:45.931 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.923+0000 7f77a353b700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f779c156db0 con 0x7f779c0ceae0 2023-11-08T19:23:45.931 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.923+0000 7f77a353b700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f779c156780 con 0x7f779c15a0e0 2023-11-08T19:23:45.932 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.923+0000 7f77a1ad8700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f779c15dc90 0x7f779c1f0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:45.932 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.923+0000 7f77a1ad8700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f779c15dc90 0x7f779c1f0600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38204/0 (socket says 172.21.15.149:38204) 2023-11-08T19:23:45.932 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.923+0000 7f77a1ad8700 1 -- 172.21.15.149:0/2046212125 learned_addr learned my addr 172.21.15.149:0/2046212125 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:45.932 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.923+0000 7f77a12d7700 1 --2- 172.21.15.149:0/2046212125 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f779c0ceae0 0x7f779c157240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:45.932 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.923+0000 7f77a0ad6700 1 --2- 172.21.15.149:0/2046212125 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f779c15a0e0 0x7f779c1555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:45.933 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.923+0000 7f77a1ad8700 1 -- 172.21.15.149:0/2046212125 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f779c15a0e0 msgr2=0x7f779c1555d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:45.933 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.923+0000 7f77a1ad8700 1 --2- 172.21.15.149:0/2046212125 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f779c15a0e0 0x7f779c1555d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:45.933 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.923+0000 7f77a1ad8700 1 -- 172.21.15.149:0/2046212125 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f779c0ceae0 msgr2=0x7f779c157240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:45.933 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.923+0000 7f77a1ad8700 1 --2- 172.21.15.149:0/2046212125 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f779c0ceae0 0x7f779c157240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:45.933 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.923+0000 7f77a1ad8700 1 -- 172.21.15.149:0/2046212125 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7794009a70 con 0x7f779c15dc90 2023-11-08T19:23:45.934 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.923+0000 7f77a1ad8700 1 --2- 172.21.15.149:0/2046212125 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f779c15dc90 0x7f779c1f0600 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7794014040 tx=0x7f7794004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:45.934 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.924+0000 7f7791ffb700 1 -- 172.21.15.149:0/2046212125 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7794020070 con 0x7f779c15dc90 2023-11-08T19:23:45.934 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.924+0000 7f7791ffb700 1 -- 172.21.15.149:0/2046212125 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f779401b520 con 0x7f779c15dc90 2023-11-08T19:23:45.934 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.924+0000 7f77a353b700 1 -- 172.21.15.149:0/2046212125 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f779c1f1130 con 0x7f779c15dc90 2023-11-08T19:23:45.935 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.924+0000 7f7791ffb700 1 -- 172.21.15.149:0/2046212125 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779401b8d0 con 0x7f779c15dc90 2023-11-08T19:23:45.935 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.924+0000 7f77a353b700 1 -- 172.21.15.149:0/2046212125 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f779c156a40 con 0x7f779c15dc90 2023-11-08T19:23:45.935 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.925+0000 7f77a353b700 1 -- 172.21.15.149:0/2046212125 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f779c04f730 con 0x7f779c15dc90 2023-11-08T19:23:45.935 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.925+0000 7f7791ffb700 1 -- 172.21.15.149:0/2046212125 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7794024070 con 0x7f779c15dc90 2023-11-08T19:23:45.935 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.926+0000 7f7791ffb700 1 --2- 172.21.15.149:0/2046212125 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f778006af30 0x7f778006d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:45.936 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.926+0000 7f77a12d7700 1 --2- 172.21.15.149:0/2046212125 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f778006af30 0x7f778006d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:45.936 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.926+0000 7f7791ffb700 1 -- 172.21.15.149:0/2046212125 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f779408ccc0 con 0x7f779c15dc90 2023-11-08T19:23:45.936 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.926+0000 7f77a12d7700 1 --2- 172.21.15.149:0/2046212125 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f778006af30 0x7f778006d3f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7798007b10 tx=0x7f7798007a60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:45.936 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:45.931+0000 7f7791ffb700 1 -- 172.21.15.149:0/2046212125 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7794057c30 con 0x7f779c15dc90 2023-11-08T19:23:46.123 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.121+0000 7f77a353b700 1 -- 172.21.15.149:0/2046212125 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f779c156ef0 con 0x7f779c15dc90 2023-11-08T19:23:46.124 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.121+0000 7f7791ffb700 1 -- 172.21.15.149:0/2046212125 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f779405b250 con 0x7f779c15dc90 2023-11-08T19:23:46.124 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 64 2023-11-08T19:23:46.126 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.124+0000 7f77a353b700 1 -- 172.21.15.149:0/2046212125 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f778006af30 msgr2=0x7f778006d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:46.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.124+0000 7f77a353b700 1 --2- 172.21.15.149:0/2046212125 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f778006af30 0x7f778006d3f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7798007b10 tx=0x7f7798007a60 comp rx=0 tx=0).stop 2023-11-08T19:23:46.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.124+0000 7f77a353b700 1 -- 172.21.15.149:0/2046212125 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f779c15dc90 msgr2=0x7f779c1f0600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:46.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.124+0000 7f77a353b700 1 --2- 172.21.15.149:0/2046212125 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f779c15dc90 0x7f779c1f0600 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7794014040 tx=0x7f7794004ad0 comp rx=0 tx=0).stop 2023-11-08T19:23:46.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.124+0000 7f77a353b700 1 -- 172.21.15.149:0/2046212125 shutdown_connections 2023-11-08T19:23:46.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.124+0000 7f77a353b700 1 --2- 172.21.15.149:0/2046212125 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f778006af30 0x7f778006d3f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:46.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.124+0000 7f77a353b700 1 --2- 172.21.15.149:0/2046212125 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f779c0ceae0 0x7f779c157240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:46.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.124+0000 7f77a353b700 1 --2- 172.21.15.149:0/2046212125 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f779c15dc90 0x7f779c1f0600 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:46.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.124+0000 7f77a353b700 1 --2- 172.21.15.149:0/2046212125 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f779c15a0e0 0x7f779c1555d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:46.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.124+0000 7f77a353b700 1 -- 172.21.15.149:0/2046212125 >> 172.21.15.149:0/2046212125 conn(0x7f779c0cc860 msgr2=0x7f779c1593f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:46.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.124+0000 7f77a353b700 1 -- 172.21.15.149:0/2046212125 shutdown_connections 2023-11-08T19:23:46.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.124+0000 7f77a353b700 1 -- 172.21.15.149:0/2046212125 wait complete. 2023-11-08T19:23:46.138 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-08T19:23:46.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.260+0000 7fc01076d700 1 Processor -- start 2023-11-08T19:23:46.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.260+0000 7fc01076d700 1 -- start start 2023-11-08T19:23:46.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.261+0000 7fc01076d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc00815df40 0x7fc00806c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:46.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.261+0000 7fc01076d700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fc0080cb660 0x7fc00806c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:46.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.261+0000 7fc01076d700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc00815e320 con 0x7fc00806ab80 2023-11-08T19:23:46.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.261+0000 7fc01076d700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc00806b020 con 0x7fc0080cb660 2023-11-08T19:23:46.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.261+0000 7fc01076d700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc00806b2e0 con 0x7fc00815df40 2023-11-08T19:23:46.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.261+0000 7fc00dd08700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fc00806ab80 0x7fc0080caf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:40214/0 (socket says 172.21.15.149:40214) 2023-11-08T19:23:46.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.261+0000 7fc00dd08700 1 -- 172.21.15.149:0/3460845537 learned_addr learned my addr 172.21.15.149:0/3460845537 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:23:46.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.262+0000 7fc00ed0a700 1 --2- 172.21.15.149:0/3460845537 >> v2:172.21.15.160:3300/0 conn(0x7fc0080cb660 0x7fc00806c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:46.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.262+0000 7fc00d507700 1 -- 172.21.15.149:0/3460845537 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1165510556 0 0) 0x7fc00815e320 con 0x7fc00806ab80 2023-11-08T19:23:46.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.262+0000 7fc00e509700 1 --2- 172.21.15.149:0/3460845537 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc00815df40 0x7fc00806c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:46.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.262+0000 7fc00d507700 1 -- 172.21.15.149:0/3460845537 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbff40035b0 con 0x7fc00806ab80 2023-11-08T19:23:46.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.262+0000 7fc00d507700 1 -- 172.21.15.149:0/3460845537 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2813954500 0 0) 0x7fbff40035b0 con 0x7fc00806ab80 2023-11-08T19:23:46.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.262+0000 7fc00d507700 1 -- 172.21.15.149:0/3460845537 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc00815df40 msgr2=0x7fc00806c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:46.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.262+0000 7fc00d507700 1 --2- 172.21.15.149:0/3460845537 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc00815df40 0x7fc00806c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:46.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.262+0000 7fc00d507700 1 -- 172.21.15.149:0/3460845537 >> v2:172.21.15.160:3300/0 conn(0x7fc0080cb660 msgr2=0x7fc00806c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:46.270 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.262+0000 7fc00d507700 1 --2- 172.21.15.149:0/3460845537 >> v2:172.21.15.160:3300/0 conn(0x7fc0080cb660 0x7fc00806c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:46.270 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.262+0000 7fc00d507700 1 -- 172.21.15.149:0/3460845537 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc00806b5c0 con 0x7fc00806ab80 2023-11-08T19:23:46.270 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.262+0000 7fc00d507700 1 -- 172.21.15.149:0/3460845537 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7fc004001670 con 0x7fc00806ab80 2023-11-08T19:23:46.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.262+0000 7fc00d507700 1 -- 172.21.15.149:0/3460845537 >> v1:172.21.15.149:6789/0 conn(0x7fc00806ab80 legacy=0x7fc0080caf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:46.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.262+0000 7fc00d507700 1 --2- 172.21.15.149:0/3460845537 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc00815df40 0x7fbff4003a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:46.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.262+0000 7fc00d507700 1 --2- 172.21.15.149:0/3460845537 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbff4003ff0 0x7fbff4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:46.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.262+0000 7fc00d507700 1 --2- 172.21.15.149:0/3460845537 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbff4004d90 0x7fbff4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:46.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.262+0000 7fc00d507700 1 -- 172.21.15.149:0/3460845537 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc00806b020 con 0x7fbff4004d90 2023-11-08T19:23:46.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.262+0000 7fc00d507700 1 -- 172.21.15.149:0/3460845537 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc00806b2e0 con 0x7fbff4003ff0 2023-11-08T19:23:46.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.262+0000 7fc00d507700 1 -- 172.21.15.149:0/3460845537 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbff400ba40 con 0x7fc00815df40 2023-11-08T19:23:46.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.262+0000 7fc00ed0a700 1 --2- 172.21.15.149:0/3460845537 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbff4004d90 0x7fbff4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:46.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.263+0000 7fc00e509700 1 --2- 172.21.15.149:0/3460845537 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc00815df40 0x7fbff4003a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:46.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.263+0000 7fc00dd08700 1 --2- 172.21.15.149:0/3460845537 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbff4003ff0 0x7fbff4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:46.273 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.263+0000 7fc00ed0a700 1 -- 172.21.15.149:0/3460845537 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc00815df40 msgr2=0x7fbff4003a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:46.273 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.263+0000 7fc00ed0a700 1 --2- 172.21.15.149:0/3460845537 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc00815df40 0x7fbff4003a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:46.273 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.263+0000 7fc00ed0a700 1 -- 172.21.15.149:0/3460845537 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbff4003ff0 msgr2=0x7fbff4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:46.273 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.263+0000 7fc00ed0a700 1 --2- 172.21.15.149:0/3460845537 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbff4003ff0 0x7fbff4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:46.273 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.263+0000 7fc00ed0a700 1 -- 172.21.15.149:0/3460845537 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff40035b0 con 0x7fbff4004d90 2023-11-08T19:23:46.274 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.263+0000 7fc00ed0a700 1 --2- 172.21.15.149:0/3460845537 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbff4004d90 0x7fbff4005210 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc000009f90 tx=0x7fbff4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3589dff907b25b1 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:46.274 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.263+0000 7fc00d507700 1 -- 172.21.15.149:0/3460845537 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00000ec30 con 0x7fbff4004d90 2023-11-08T19:23:46.274 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.263+0000 7fc00d507700 1 -- 172.21.15.149:0/3460845537 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc00000f040 con 0x7fbff4004d90 2023-11-08T19:23:46.274 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.263+0000 7fc00d507700 1 -- 172.21.15.149:0/3460845537 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc000014480 con 0x7fbff4004d90 2023-11-08T19:23:46.274 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.264+0000 7fc01076d700 1 -- 172.21.15.149:0/3460845537 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbff4004d90 msgr2=0x7fbff4005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:46.275 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.264+0000 7fc01076d700 1 --2- 172.21.15.149:0/3460845537 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbff4004d90 0x7fbff4005210 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc000009f90 tx=0x7fbff4005880 comp rx=0 tx=0).stop 2023-11-08T19:23:46.275 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.264+0000 7fc00ed0a700 1 -- 172.21.15.149:0/3460845537 reap_dead start 2023-11-08T19:23:46.275 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.264+0000 7fc01076d700 1 -- 172.21.15.149:0/3460845537 shutdown_connections 2023-11-08T19:23:46.275 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.264+0000 7fc01076d700 1 -- 172.21.15.149:0/3460845537 >> 172.21.15.149:0/3460845537 conn(0x7fc0080d0640 msgr2=0x7fc0080d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:46.275 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.264+0000 7fc01076d700 1 -- 172.21.15.149:0/3460845537 shutdown_connections 2023-11-08T19:23:46.276 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.264+0000 7fc01076d700 1 -- 172.21.15.149:0/3460845537 wait complete. 2023-11-08T19:23:46.278 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.265+0000 7fc01076d700 1 Processor -- start 2023-11-08T19:23:46.278 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.265+0000 7fc01076d700 1 -- start start 2023-11-08T19:23:46.279 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.267+0000 7fc01076d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbff4004d90 0x7fc00814fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:46.279 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.267+0000 7fc01076d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc0081f3830 0x7fc0081f3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:46.279 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.267+0000 7fc01076d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0081e6650 0x7fc0081e6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:46.279 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.267+0000 7fc01076d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0080c58d0 con 0x7fc0081e6650 2023-11-08T19:23:46.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.267+0000 7fc01076d700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0081e7010 con 0x7fbff4004d90 2023-11-08T19:23:46.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.267+0000 7fc01076d700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0080c52a0 con 0x7fc0081f3830 2023-11-08T19:23:46.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.267+0000 7fc00ed0a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0081e6650 0x7fc0081e6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:46.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.267+0000 7fc00ed0a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0081e6650 0x7fc0081e6ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38224/0 (socket says 172.21.15.149:38224) 2023-11-08T19:23:46.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.267+0000 7fc00ed0a700 1 -- 172.21.15.149:0/3212795676 learned_addr learned my addr 172.21.15.149:0/3212795676 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:46.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.267+0000 7fc00e509700 1 --2- 172.21.15.149:0/3212795676 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbff4004d90 0x7fc00814fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:46.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.267+0000 7fc00dd08700 1 --2- 172.21.15.149:0/3212795676 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc0081f3830 0x7fc0081f3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:46.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.267+0000 7fc00ed0a700 1 -- 172.21.15.149:0/3212795676 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc0081f3830 msgr2=0x7fc0081f3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:46.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.267+0000 7fc00ed0a700 1 --2- 172.21.15.149:0/3212795676 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc0081f3830 0x7fc0081f3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:46.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.267+0000 7fc00ed0a700 1 -- 172.21.15.149:0/3212795676 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbff4004d90 msgr2=0x7fc00814fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:46.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.267+0000 7fc00ed0a700 1 --2- 172.21.15.149:0/3212795676 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbff4004d90 0x7fc00814fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:46.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.267+0000 7fc00ed0a700 1 -- 172.21.15.149:0/3212795676 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0081f4380 con 0x7fc0081e6650 2023-11-08T19:23:46.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.267+0000 7fc00ed0a700 1 --2- 172.21.15.149:0/3212795676 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0081e6650 0x7fc0081e6ad0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc000002230 tx=0x7fc000009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:46.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.267+0000 7fbffeffd700 1 -- 172.21.15.149:0/3212795676 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc000007000 con 0x7fc0081e6650 2023-11-08T19:23:46.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.267+0000 7fbffeffd700 1 -- 172.21.15.149:0/3212795676 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc000003e10 con 0x7fc0081e6650 2023-11-08T19:23:46.283 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.267+0000 7fbffeffd700 1 -- 172.21.15.149:0/3212795676 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc000004490 con 0x7fc0081e6650 2023-11-08T19:23:46.283 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.267+0000 7fc01076d700 1 -- 172.21.15.149:0/3212795676 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0081f4660 con 0x7fc0081e6650 2023-11-08T19:23:46.283 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.267+0000 7fc01076d700 1 -- 172.21.15.149:0/3212795676 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc008161090 con 0x7fc0081e6650 2023-11-08T19:23:46.283 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.268+0000 7fc01076d700 1 -- 172.21.15.149:0/3212795676 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0080c5a10 con 0x7fc0081e6650 2023-11-08T19:23:46.284 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.268+0000 7fbffeffd700 1 -- 172.21.15.149:0/3212795676 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc0000045f0 con 0x7fc0081e6650 2023-11-08T19:23:46.284 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.268+0000 7fbffeffd700 1 --2- 172.21.15.149:0/3212795676 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fbfec06af30 0x7fbfec06d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:46.284 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.268+0000 7fc00e509700 1 --2- 172.21.15.149:0/3212795676 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fbfec06af30 0x7fbfec06d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:46.284 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.268+0000 7fbffeffd700 1 -- 172.21.15.149:0/3212795676 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc00008a9e0 con 0x7fc0081e6650 2023-11-08T19:23:46.284 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.269+0000 7fc00e509700 1 --2- 172.21.15.149:0/3212795676 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fbfec06af30 0x7fbfec06d3f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbff8009c60 tx=0x7fbff8009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:46.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.273+0000 7fbffeffd700 1 -- 172.21.15.149:0/3212795676 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc0080c5a10 con 0x7fc0081e6650 2023-11-08T19:23:46.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.464+0000 7fc01076d700 1 -- 172.21.15.149:0/3212795676 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc0080c5a10 con 0x7fc0081e6650 2023-11-08T19:23:46.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.465+0000 7fbffeffd700 1 -- 172.21.15.149:0/3212795676 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc0080c5a10 con 0x7fc0081e6650 2023-11-08T19:23:46.467 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:23:46.469 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.467+0000 7fc01076d700 1 -- 172.21.15.149:0/3212795676 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fbfec06af30 msgr2=0x7fbfec06d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:46.469 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.467+0000 7fc01076d700 1 --2- 172.21.15.149:0/3212795676 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fbfec06af30 0x7fbfec06d3f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbff8009c60 tx=0x7fbff8009210 comp rx=0 tx=0).stop 2023-11-08T19:23:46.470 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.467+0000 7fc01076d700 1 -- 172.21.15.149:0/3212795676 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0081e6650 msgr2=0x7fc0081e6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:46.470 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.467+0000 7fc01076d700 1 --2- 172.21.15.149:0/3212795676 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0081e6650 0x7fc0081e6ad0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc000002230 tx=0x7fc000009750 comp rx=0 tx=0).stop 2023-11-08T19:23:46.470 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.467+0000 7fc01076d700 1 -- 172.21.15.149:0/3212795676 shutdown_connections 2023-11-08T19:23:46.470 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.467+0000 7fc01076d700 1 --2- 172.21.15.149:0/3212795676 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fbfec06af30 0x7fbfec06d3f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:46.471 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.467+0000 7fc01076d700 1 --2- 172.21.15.149:0/3212795676 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbff4004d90 0x7fc00814fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:46.471 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.467+0000 7fc01076d700 1 --2- 172.21.15.149:0/3212795676 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0081e6650 0x7fc0081e6ad0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:46.471 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.467+0000 7fc01076d700 1 --2- 172.21.15.149:0/3212795676 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc0081f3830 0x7fc0081f3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:46.471 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.467+0000 7fc01076d700 1 -- 172.21.15.149:0/3212795676 >> 172.21.15.149:0/3212795676 conn(0x7fc0080d0640 msgr2=0x7fc0081e7e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:46.471 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.467+0000 7fc01076d700 1 -- 172.21.15.149:0/3212795676 shutdown_connections 2023-11-08T19:23:46.471 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.467+0000 7fc01076d700 1 -- 172.21.15.149:0/3212795676 wait complete. 2023-11-08T19:23:46.482 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:23:46.605 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.603+0000 7f9497558700 1 Processor -- start 2023-11-08T19:23:46.605 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.603+0000 7f9497558700 1 -- start start 2023-11-08T19:23:46.612 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.603+0000 7f9497558700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f94900cd5e0 0x7f94900cfd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:46.612 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.603+0000 7f9497558700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f94900ce840 0x7f94900d0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:46.612 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.603+0000 7f9497558700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94900d07a0 con 0x7f949015b950 2023-11-08T19:23:46.612 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.604+0000 7f9497558700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94900cc2e0 con 0x7f94900cd5e0 2023-11-08T19:23:46.613 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.604+0000 7f9497558700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94900cc580 con 0x7f94900ce840 2023-11-08T19:23:46.613 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.604+0000 7f9495af5700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f94900ce840 0x7f94900d0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:46.613 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.604+0000 7f9494af3700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f94900cd5e0 0x7f94900cfd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:46.613 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.604+0000 7f9495af5700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f94900ce840 0x7f94900d0260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.149:58520/0 (socket says 172.21.15.149:58520) 2023-11-08T19:23:46.613 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.604+0000 7f9495af5700 1 -- 172.21.15.149:0/4283667534 learned_addr learned my addr 172.21.15.149:0/4283667534 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:46.614 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.604+0000 7f9495af5700 1 -- 172.21.15.149:0/4283667534 >> v2:172.21.15.160:3300/0 conn(0x7f94900cd5e0 msgr2=0x7f94900cfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:46.614 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.604+0000 7f9495af5700 1 --2- 172.21.15.149:0/4283667534 >> v2:172.21.15.160:3300/0 conn(0x7f94900cd5e0 0x7f94900cfd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:46.614 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.604+0000 7f9495af5700 1 -- 172.21.15.149:0/4283667534 >> v1:172.21.15.160:6789/0 conn(0x7f949015b950 legacy=0x7f94900ce130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:46.614 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.604+0000 7f9487fff700 1 -- 172.21.15.149:0/4283667534 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 114361256 0 0) 0x7f94900d07a0 con 0x7f949015b950 2023-11-08T19:23:46.614 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.604+0000 7f9495af5700 1 -- 172.21.15.149:0/4283667534 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94900cc820 con 0x7f94900ce840 2023-11-08T19:23:46.615 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.604+0000 7f9494af3700 1 --2- 172.21.15.149:0/4283667534 >> v2:172.21.15.160:3300/0 conn(0x7f94900cd5e0 0x7f94900cfd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:23:46.615 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.605+0000 7f9495af5700 1 --2- 172.21.15.149:0/4283667534 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f94900ce840 0x7f94900d0260 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9488009e50 tx=0x7f948800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2abd1d8620c6c9df server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:46.615 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.605+0000 7f9487fff700 1 -- 172.21.15.149:0/4283667534 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948800e070 con 0x7f94900ce840 2023-11-08T19:23:46.615 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.605+0000 7f9487fff700 1 -- 172.21.15.149:0/4283667534 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f948800b910 con 0x7f94900ce840 2023-11-08T19:23:46.615 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.605+0000 7f9487fff700 1 -- 172.21.15.149:0/4283667534 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948800bcc0 con 0x7f94900ce840 2023-11-08T19:23:46.616 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.605+0000 7f9497558700 1 -- 172.21.15.149:0/4283667534 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f94900ce840 msgr2=0x7f94900d0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:46.616 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.605+0000 7f9497558700 1 --2- 172.21.15.149:0/4283667534 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f94900ce840 0x7f94900d0260 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9488009e50 tx=0x7f948800b330 comp rx=0 tx=0).stop 2023-11-08T19:23:46.616 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.605+0000 7f9497558700 1 -- 172.21.15.149:0/4283667534 shutdown_connections 2023-11-08T19:23:46.616 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.605+0000 7f9497558700 1 --2- 172.21.15.149:0/4283667534 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f94900ce840 0x7f94900d0260 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:46.616 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.605+0000 7f9497558700 1 --2- 172.21.15.149:0/4283667534 >> v2:172.21.15.160:3300/0 conn(0x7f94900cd5e0 0x7f94900cfd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:46.617 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.605+0000 7f9497558700 1 -- 172.21.15.149:0/4283667534 >> 172.21.15.149:0/4283667534 conn(0x7f949008afd0 msgr2=0x7f94900d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:46.617 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.605+0000 7f9497558700 1 -- 172.21.15.149:0/4283667534 shutdown_connections 2023-11-08T19:23:46.617 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.605+0000 7f9497558700 1 -- 172.21.15.149:0/4283667534 wait complete. 2023-11-08T19:23:46.617 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.606+0000 7f9497558700 1 Processor -- start 2023-11-08T19:23:46.617 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.607+0000 7f9497558700 1 -- start start 2023-11-08T19:23:46.617 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.607+0000 7f9497558700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f94900ce840 0x7f94901f1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:46.618 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.607+0000 7f9497558700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f949015b950 0x7f9490158c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:46.618 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.607+0000 7f9497558700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9490159160 0x7f94900b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:46.618 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.607+0000 7f9497558700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94901f5780 con 0x7f9490159160 2023-11-08T19:23:46.618 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.607+0000 7f9497558700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94901595f0 con 0x7f949015b950 2023-11-08T19:23:46.618 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.607+0000 7f9497558700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94901f4b70 con 0x7f94900ce840 2023-11-08T19:23:46.619 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.607+0000 7f9495af5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9490159160 0x7f94900b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:46.619 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.607+0000 7f9494af3700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f949015b950 0x7f9490158c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:46.619 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.607+0000 7f9495af5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9490159160 0x7f94900b60e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38238/0 (socket says 172.21.15.149:38238) 2023-11-08T19:23:46.619 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.607+0000 7f9495af5700 1 -- 172.21.15.149:0/4016639725 learned_addr learned my addr 172.21.15.149:0/4016639725 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:46.619 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.607+0000 7f94952f4700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f94900ce840 0x7f94901f1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:46.620 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.608+0000 7f9494af3700 1 -- 172.21.15.149:0/4016639725 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f94900ce840 msgr2=0x7f94901f1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:46.620 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.608+0000 7f9494af3700 1 --2- 172.21.15.149:0/4016639725 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f94900ce840 0x7f94901f1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:46.620 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.608+0000 7f9494af3700 1 -- 172.21.15.149:0/4016639725 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9490159160 msgr2=0x7f94900b60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:46.620 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.608+0000 7f9494af3700 1 --2- 172.21.15.149:0/4016639725 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9490159160 0x7f94900b60e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:46.620 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.608+0000 7f9494af3700 1 -- 172.21.15.149:0/4016639725 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f948c0094a0 con 0x7f949015b950 2023-11-08T19:23:46.620 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.608+0000 7f9495af5700 1 --2- 172.21.15.149:0/4016639725 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9490159160 0x7f94900b60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:23:46.621 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.608+0000 7f9494af3700 1 --2- 172.21.15.149:0/4016639725 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f949015b950 0x7f9490158c20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f948c00e9b0 tx=0x7f948c00ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:46.621 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.608+0000 7f9485ffb700 1 -- 172.21.15.149:0/4016639725 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948c00ee50 con 0x7f949015b950 2023-11-08T19:23:46.621 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.608+0000 7f9485ffb700 1 -- 172.21.15.149:0/4016639725 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f948c00c850 con 0x7f949015b950 2023-11-08T19:23:46.621 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.608+0000 7f9497558700 1 -- 172.21.15.149:0/4016639725 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9488009b30 con 0x7f949015b950 2023-11-08T19:23:46.621 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.608+0000 7f9485ffb700 1 -- 172.21.15.149:0/4016639725 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948c00cc00 con 0x7f949015b950 2023-11-08T19:23:46.622 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.608+0000 7f9497558700 1 -- 172.21.15.149:0/4016639725 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94901f50c0 con 0x7f949015b950 2023-11-08T19:23:46.622 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.609+0000 7f9497558700 1 -- 172.21.15.149:0/4016639725 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94900745f0 con 0x7f949015b950 2023-11-08T19:23:46.622 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.610+0000 7f9485ffb700 1 -- 172.21.15.149:0/4016639725 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f948c00cd60 con 0x7f949015b950 2023-11-08T19:23:46.623 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.610+0000 7f9485ffb700 1 --2- 172.21.15.149:0/4016639725 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f947406af00 0x7f947406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:46.623 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.610+0000 7f9485ffb700 1 -- 172.21.15.149:0/4016639725 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f948c089860 con 0x7f949015b950 2023-11-08T19:23:46.623 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.610+0000 7f94952f4700 1 --2- 172.21.15.149:0/4016639725 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f947406af00 0x7f947406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:46.623 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.611+0000 7f94952f4700 1 --2- 172.21.15.149:0/4016639725 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f947406af00 0x7f947406d3c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9480000fb0 tx=0x7f9480009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:46.624 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.616+0000 7f9485ffb700 1 -- 172.21.15.149:0/4016639725 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f948c054610 con 0x7f949015b950 2023-11-08T19:23:46.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.810+0000 7f9497558700 1 -- 172.21.15.149:0/4016639725 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f949008b760 con 0x7f949015b950 2023-11-08T19:23:46.813 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.812+0000 7f9485ffb700 1 -- 172.21.15.149:0/4016639725 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18382 (secure 0 0 0) 0x7f948c057c30 con 0x7f949015b950 2023-11-08T19:23:46.813 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:23:46.813 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":24,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:23:06.964482+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-08T19:22:59.830928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-08T19:23:00.886589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-08T19:23:04.574033+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:23:46.815 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.814+0000 7f9497558700 1 -- 172.21.15.149:0/4016639725 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f947406af00 msgr2=0x7f947406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:46.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.814+0000 7f9497558700 1 --2- 172.21.15.149:0/4016639725 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f947406af00 0x7f947406d3c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9480000fb0 tx=0x7f9480009040 comp rx=0 tx=0).stop 2023-11-08T19:23:46.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.814+0000 7f9497558700 1 -- 172.21.15.149:0/4016639725 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f949015b950 msgr2=0x7f9490158c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:46.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.814+0000 7f9497558700 1 --2- 172.21.15.149:0/4016639725 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f949015b950 0x7f9490158c20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f948c00e9b0 tx=0x7f948c00ecc0 comp rx=0 tx=0).stop 2023-11-08T19:23:46.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.814+0000 7f9497558700 1 -- 172.21.15.149:0/4016639725 shutdown_connections 2023-11-08T19:23:46.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.814+0000 7f9497558700 1 --2- 172.21.15.149:0/4016639725 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f947406af00 0x7f947406d3c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:46.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.814+0000 7f9497558700 1 --2- 172.21.15.149:0/4016639725 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9490159160 0x7f94900b60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:46.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.814+0000 7f9497558700 1 --2- 172.21.15.149:0/4016639725 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f94900ce840 0x7f94901f1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:46.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.814+0000 7f9497558700 1 --2- 172.21.15.149:0/4016639725 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f949015b950 0x7f9490158c20 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:46.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.814+0000 7f9497558700 1 -- 172.21.15.149:0/4016639725 >> 172.21.15.149:0/4016639725 conn(0x7f949008afd0 msgr2=0x7f94900af5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:46.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.814+0000 7f9497558700 1 -- 172.21.15.149:0/4016639725 shutdown_connections 2023-11-08T19:23:46.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.814+0000 7f9497558700 1 -- 172.21.15.149:0/4016639725 wait complete. 2023-11-08T19:23:46.827 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-08T19:22:56.023194+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-08T19:22:59.830928+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-08T19:23:00.886589+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-08T19:23:04.574033+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-08T19:23:46.828 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-08T19:23:46.951 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.950+0000 7f1e3348c700 1 Processor -- start 2023-11-08T19:23:46.952 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.950+0000 7f1e3348c700 1 -- start start 2023-11-08T19:23:46.954 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.951+0000 7f1e3348c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f1e2c0cc0d0 0x7f1e2c15f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:46.954 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.951+0000 7f1e3348c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1e2c0cc910 0x7f1e2c0cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:46.955 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.951+0000 7f1e3348c700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e2c15be80 con 0x7f1e2c0cc4b0 2023-11-08T19:23:46.955 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.951+0000 7f1e3348c700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e2c15f9b0 con 0x7f1e2c0cc0d0 2023-11-08T19:23:46.955 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.951+0000 7f1e3348c700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2c15fba0 con 0x7f1e2c0cc910 2023-11-08T19:23:46.955 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.951+0000 7f1e31228700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f1e2c0cc0d0 0x7f1e2c15f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:46.955 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.951+0000 7f1e30a27700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f1e2c0cc4b0 0x7f1e2c15c620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:40246/0 (socket says 172.21.15.149:40246) 2023-11-08T19:23:46.956 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.951+0000 7f1e30a27700 1 -- 172.21.15.149:0/2544272850 learned_addr learned my addr 172.21.15.149:0/2544272850 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:23:46.956 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.952+0000 7f1e31a29700 1 --2- 172.21.15.149:0/2544272850 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1e2c0cc910 0x7f1e2c0cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:46.956 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.952+0000 7f1e31228700 1 -- 172.21.15.149:0/2544272850 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1e2c0cc910 msgr2=0x7f1e2c0cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:46.956 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.952+0000 7f1e31228700 1 --2- 172.21.15.149:0/2544272850 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1e2c0cc910 0x7f1e2c0cf320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:46.956 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.952+0000 7f1e31228700 1 -- 172.21.15.149:0/2544272850 >> v1:172.21.15.149:6789/0 conn(0x7f1e2c0cc4b0 legacy=0x7f1e2c15c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:46.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.952+0000 7f1e1ffff700 1 -- 172.21.15.149:0/2544272850 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1933343333 0 0) 0x7f1e2c15be80 con 0x7f1e2c0cc4b0 2023-11-08T19:23:46.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.952+0000 7f1e31228700 1 -- 172.21.15.149:0/2544272850 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e2c15fe80 con 0x7f1e2c0cc0d0 2023-11-08T19:23:46.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.952+0000 7f1e31228700 1 --2- 172.21.15.149:0/2544272850 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e2c0cc0d0 0x7f1e2c15f470 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1e20009840 tx=0x7f1e20009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c23d5b298b6cdac server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:46.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.952+0000 7f1e1ffff700 1 -- 172.21.15.149:0/2544272850 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e20011830 con 0x7f1e2c0cc0d0 2023-11-08T19:23:46.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.952+0000 7f1e1ffff700 1 -- 172.21.15.149:0/2544272850 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e20011990 con 0x7f1e2c0cc0d0 2023-11-08T19:23:46.958 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.952+0000 7f1e1ffff700 1 -- 172.21.15.149:0/2544272850 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e20011d20 con 0x7f1e2c0cc0d0 2023-11-08T19:23:46.958 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.952+0000 7f1e3348c700 1 -- 172.21.15.149:0/2544272850 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e2c0cc0d0 msgr2=0x7f1e2c15f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:46.958 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.952+0000 7f1e3348c700 1 --2- 172.21.15.149:0/2544272850 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e2c0cc0d0 0x7f1e2c15f470 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1e20009840 tx=0x7f1e20009b50 comp rx=0 tx=0).stop 2023-11-08T19:23:46.958 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.953+0000 7f1e3348c700 1 -- 172.21.15.149:0/2544272850 shutdown_connections 2023-11-08T19:23:46.958 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.953+0000 7f1e3348c700 1 --2- 172.21.15.149:0/2544272850 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1e2c0cc910 0x7f1e2c0cf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:46.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.953+0000 7f1e3348c700 1 --2- 172.21.15.149:0/2544272850 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e2c0cc0d0 0x7f1e2c15f470 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:46.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.953+0000 7f1e3348c700 1 -- 172.21.15.149:0/2544272850 >> 172.21.15.149:0/2544272850 conn(0x7f1e2c06f120 msgr2=0x7f1e2c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:46.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.953+0000 7f1e3348c700 1 -- 172.21.15.149:0/2544272850 shutdown_connections 2023-11-08T19:23:46.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.953+0000 7f1e3348c700 1 -- 172.21.15.149:0/2544272850 wait complete. 2023-11-08T19:23:46.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.954+0000 7f1e3348c700 1 Processor -- start 2023-11-08T19:23:46.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.954+0000 7f1e3348c700 1 -- start start 2023-11-08T19:23:46.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.954+0000 7f1e3348c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e2c0cc0d0 0x7f1e2c0c7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:46.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.954+0000 7f1e3348c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1e2c0cc4b0 0x7f1e2c0ca670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:46.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.954+0000 7f1e3348c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e2c0cc910 0x7f1e2c0cabb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:46.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.955+0000 7f1e3348c700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2c0cb0f0 con 0x7f1e2c0cc0d0 2023-11-08T19:23:46.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.955+0000 7f1e3348c700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2c1f5350 con 0x7f1e2c0cc910 2023-11-08T19:23:46.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.955+0000 7f1e3348c700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2c1f1020 con 0x7f1e2c0cc4b0 2023-11-08T19:23:46.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.955+0000 7f1e31228700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e2c0cc0d0 0x7f1e2c0c7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:46.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.955+0000 7f1e31228700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e2c0cc0d0 0x7f1e2c0c7800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38248/0 (socket says 172.21.15.149:38248) 2023-11-08T19:23:46.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.955+0000 7f1e31228700 1 -- 172.21.15.149:0/43534273 learned_addr learned my addr 172.21.15.149:0/43534273 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:46.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.955+0000 7f1e31228700 1 -- 172.21.15.149:0/43534273 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1e2c0cc4b0 msgr2=0x7f1e2c0ca670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:46.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.955+0000 7f1e31228700 1 --2- 172.21.15.149:0/43534273 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1e2c0cc4b0 0x7f1e2c0ca670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:46.965 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.955+0000 7f1e31228700 1 -- 172.21.15.149:0/43534273 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e2c0cc910 msgr2=0x7f1e2c0cabb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:46.965 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.955+0000 7f1e31228700 1 --2- 172.21.15.149:0/43534273 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e2c0cc910 0x7f1e2c0cabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:46.965 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.955+0000 7f1e31228700 1 -- 172.21.15.149:0/43534273 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e200094a0 con 0x7f1e2c0cc0d0 2023-11-08T19:23:46.965 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.955+0000 7f1e31228700 1 --2- 172.21.15.149:0/43534273 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e2c0cc0d0 0x7f1e2c0c7800 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1e200090b0 tx=0x7f1e20004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:46.966 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.955+0000 7f1e1dffb700 1 -- 172.21.15.149:0/43534273 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e200038a0 con 0x7f1e2c0cc0d0 2023-11-08T19:23:46.966 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.955+0000 7f1e1dffb700 1 -- 172.21.15.149:0/43534273 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e2001f070 con 0x7f1e2c0cc0d0 2023-11-08T19:23:46.966 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.955+0000 7f1e3348c700 1 -- 172.21.15.149:0/43534273 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e2c1f1300 con 0x7f1e2c0cc0d0 2023-11-08T19:23:46.966 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.955+0000 7f1e1dffb700 1 -- 172.21.15.149:0/43534273 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e20003c00 con 0x7f1e2c0cc0d0 2023-11-08T19:23:46.966 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.955+0000 7f1e3348c700 1 -- 172.21.15.149:0/43534273 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e2c1f18c0 con 0x7f1e2c0cc0d0 2023-11-08T19:23:46.967 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.956+0000 7f1e3348c700 1 -- 172.21.15.149:0/43534273 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e2c1f1ab0 con 0x7f1e2c0cc0d0 2023-11-08T19:23:46.967 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.957+0000 7f1e1dffb700 1 -- 172.21.15.149:0/43534273 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1e20026480 con 0x7f1e2c0cc0d0 2023-11-08T19:23:46.967 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.957+0000 7f1e1dffb700 1 --2- 172.21.15.149:0/43534273 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1e1006af00 0x7f1e1006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:46.967 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.957+0000 7f1e1dffb700 1 -- 172.21.15.149:0/43534273 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1e20021070 con 0x7f1e2c0cc0d0 2023-11-08T19:23:46.967 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.957+0000 7f1e30a27700 1 --2- 172.21.15.149:0/43534273 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1e1006af00 0x7f1e1006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:46.967 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.958+0000 7f1e30a27700 1 --2- 172.21.15.149:0/43534273 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1e1006af00 0x7f1e1006d3c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1e280011e0 tx=0x7f1e280079b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:46.968 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:46.962+0000 7f1e1dffb700 1 -- 172.21.15.149:0/43534273 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1e20056080 con 0x7f1e2c0cc0d0 2023-11-08T19:23:47.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.151+0000 7f1e3348c700 1 -- 172.21.15.149:0/43534273 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1e2c04f730 con 0x7f1e2c0cc0d0 2023-11-08T19:23:47.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.151+0000 7f1e1dffb700 1 -- 172.21.15.149:0/43534273 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1e200596a0 con 0x7f1e2c0cc0d0 2023-11-08T19:23:47.153 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 1 2023-11-08T19:23:47.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.153+0000 7f1e3348c700 1 -- 172.21.15.149:0/43534273 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1e1006af00 msgr2=0x7f1e1006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:47.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.153+0000 7f1e3348c700 1 --2- 172.21.15.149:0/43534273 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1e1006af00 0x7f1e1006d3c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1e280011e0 tx=0x7f1e280079b0 comp rx=0 tx=0).stop 2023-11-08T19:23:47.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.153+0000 7f1e3348c700 1 -- 172.21.15.149:0/43534273 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e2c0cc0d0 msgr2=0x7f1e2c0c7800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:47.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.153+0000 7f1e3348c700 1 --2- 172.21.15.149:0/43534273 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e2c0cc0d0 0x7f1e2c0c7800 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1e200090b0 tx=0x7f1e20004750 comp rx=0 tx=0).stop 2023-11-08T19:23:47.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.153+0000 7f1e3348c700 1 -- 172.21.15.149:0/43534273 shutdown_connections 2023-11-08T19:23:47.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.153+0000 7f1e3348c700 1 --2- 172.21.15.149:0/43534273 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1e1006af00 0x7f1e1006d3c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:47.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.153+0000 7f1e3348c700 1 --2- 172.21.15.149:0/43534273 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e2c0cc910 0x7f1e2c0cabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:47.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.153+0000 7f1e3348c700 1 --2- 172.21.15.149:0/43534273 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e2c0cc0d0 0x7f1e2c0c7800 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:47.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.153+0000 7f1e3348c700 1 --2- 172.21.15.149:0/43534273 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1e2c0cc4b0 0x7f1e2c0ca670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:47.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.153+0000 7f1e3348c700 1 -- 172.21.15.149:0/43534273 >> 172.21.15.149:0/43534273 conn(0x7f1e2c06f120 msgr2=0x7f1e2c15cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:47.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.153+0000 7f1e3348c700 1 -- 172.21.15.149:0/43534273 shutdown_connections 2023-11-08T19:23:47.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.153+0000 7f1e3348c700 1 -- 172.21.15.149:0/43534273 wait complete. 2023-11-08T19:23:47.169 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-08T19:23:47.294 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.293+0000 7f7a9bde9700 1 Processor -- start 2023-11-08T19:23:47.294 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.293+0000 7f7a9bde9700 1 -- start start 2023-11-08T19:23:47.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.294+0000 7f7a9bde9700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f7a940cc0d0 0x7f7a9415f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:47.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.294+0000 7f7a9bde9700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7a940cc910 0x7f7a940cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:47.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.294+0000 7f7a9bde9700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a9415be80 con 0x7f7a940cc4b0 2023-11-08T19:23:47.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.294+0000 7f7a9bde9700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a9415f9b0 con 0x7f7a940cc0d0 2023-11-08T19:23:47.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.294+0000 7f7a9bde9700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a9415fba0 con 0x7f7a940cc910 2023-11-08T19:23:47.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.294+0000 7f7a99384700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f7a940cc4b0 0x7f7a9415c620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:40258/0 (socket says 172.21.15.149:40258) 2023-11-08T19:23:47.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.294+0000 7f7a99384700 1 -- 172.21.15.149:0/1379616446 learned_addr learned my addr 172.21.15.149:0/1379616446 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:23:47.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.294+0000 7f7a9a386700 1 --2- 172.21.15.149:0/1379616446 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7a940cc910 0x7f7a940cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:47.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.294+0000 7f7a99b85700 1 --2- 172.21.15.149:0/1379616446 >> v2:172.21.15.160:3300/0 conn(0x7f7a940cc0d0 0x7f7a9415f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:47.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.294+0000 7f7a98b83700 1 -- 172.21.15.149:0/1379616446 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4114921604 0 0) 0x7f7a9415be80 con 0x7f7a940cc4b0 2023-11-08T19:23:47.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.294+0000 7f7a98b83700 1 -- 172.21.15.149:0/1379616446 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a800035b0 con 0x7f7a940cc4b0 2023-11-08T19:23:47.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.294+0000 7f7a99b85700 1 -- 172.21.15.149:0/1379616446 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7a940cc910 msgr2=0x7f7a940cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:47.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.294+0000 7f7a99b85700 1 --2- 172.21.15.149:0/1379616446 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7a940cc910 0x7f7a940cf320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:47.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.294+0000 7f7a99b85700 1 -- 172.21.15.149:0/1379616446 >> v1:172.21.15.149:6789/0 conn(0x7f7a940cc4b0 legacy=0x7f7a9415c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:47.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.294+0000 7f7a99b85700 1 -- 172.21.15.149:0/1379616446 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a9415fe80 con 0x7f7a940cc0d0 2023-11-08T19:23:47.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.294+0000 7f7a9a386700 1 --2- 172.21.15.149:0/1379616446 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7a940cc910 0x7f7a940cf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:23:47.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.295+0000 7f7a99b85700 1 --2- 172.21.15.149:0/1379616446 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7a940cc0d0 0x7f7a9415f470 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7a90009840 tx=0x7f7a90009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7e32423632a6d2b server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:47.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.295+0000 7f7a98b83700 1 -- 172.21.15.149:0/1379616446 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a90011830 con 0x7f7a940cc0d0 2023-11-08T19:23:47.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.295+0000 7f7a98b83700 1 -- 172.21.15.149:0/1379616446 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a90011990 con 0x7f7a940cc0d0 2023-11-08T19:23:47.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.295+0000 7f7a98b83700 1 -- 172.21.15.149:0/1379616446 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a90011d20 con 0x7f7a940cc0d0 2023-11-08T19:23:47.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.295+0000 7f7a9bde9700 1 -- 172.21.15.149:0/1379616446 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7a940cc0d0 msgr2=0x7f7a9415f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:47.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.295+0000 7f7a9bde9700 1 --2- 172.21.15.149:0/1379616446 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7a940cc0d0 0x7f7a9415f470 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7a90009840 tx=0x7f7a90009b50 comp rx=0 tx=0).stop 2023-11-08T19:23:47.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.295+0000 7f7a9bde9700 1 -- 172.21.15.149:0/1379616446 shutdown_connections 2023-11-08T19:23:47.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.295+0000 7f7a9bde9700 1 --2- 172.21.15.149:0/1379616446 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7a940cc910 0x7f7a940cf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:47.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.295+0000 7f7a9bde9700 1 --2- 172.21.15.149:0/1379616446 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7a940cc0d0 0x7f7a9415f470 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:47.302 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.295+0000 7f7a9bde9700 1 -- 172.21.15.149:0/1379616446 >> 172.21.15.149:0/1379616446 conn(0x7f7a9406f120 msgr2=0x7f7a9406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:47.302 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.295+0000 7f7a9bde9700 1 -- 172.21.15.149:0/1379616446 shutdown_connections 2023-11-08T19:23:47.302 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.295+0000 7f7a9bde9700 1 -- 172.21.15.149:0/1379616446 wait complete. 2023-11-08T19:23:47.305 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.297+0000 7f7a9bde9700 1 Processor -- start 2023-11-08T19:23:47.305 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.297+0000 7f7a9bde9700 1 -- start start 2023-11-08T19:23:47.305 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.297+0000 7f7a9bde9700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a940cc0d0 0x7f7a941f2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:47.305 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.297+0000 7f7a9bde9700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7a940cc4b0 0x7f7a941561f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:47.306 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.297+0000 7f7a9bde9700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7a940cc910 0x7f7a940b53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:47.306 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.297+0000 7f7a9bde9700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a94156730 con 0x7f7a940cc0d0 2023-11-08T19:23:47.306 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.297+0000 7f7a9bde9700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a941f1470 con 0x7f7a940cc4b0 2023-11-08T19:23:47.306 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.297+0000 7f7a9bde9700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a940b1420 con 0x7f7a940cc910 2023-11-08T19:23:47.306 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.297+0000 7f7a99b85700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a940cc0d0 0x7f7a941f2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:47.307 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.298+0000 7f7a99b85700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a940cc0d0 0x7f7a941f2970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38262/0 (socket says 172.21.15.149:38262) 2023-11-08T19:23:47.307 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.298+0000 7f7a99b85700 1 -- 172.21.15.149:0/3450839052 learned_addr learned my addr 172.21.15.149:0/3450839052 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:47.307 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.298+0000 7f7a99384700 1 --2- 172.21.15.149:0/3450839052 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7a940cc4b0 0x7f7a941561f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:47.307 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.298+0000 7f7a9a386700 1 --2- 172.21.15.149:0/3450839052 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7a940cc910 0x7f7a940b53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:47.307 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.298+0000 7f7a99b85700 1 -- 172.21.15.149:0/3450839052 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7a940cc910 msgr2=0x7f7a940b53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:47.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.298+0000 7f7a99b85700 1 --2- 172.21.15.149:0/3450839052 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7a940cc910 0x7f7a940b53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:47.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.298+0000 7f7a99b85700 1 -- 172.21.15.149:0/3450839052 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7a940cc4b0 msgr2=0x7f7a941561f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:47.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.298+0000 7f7a99b85700 1 --2- 172.21.15.149:0/3450839052 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7a940cc4b0 0x7f7a941561f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:47.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.298+0000 7f7a99b85700 1 -- 172.21.15.149:0/3450839052 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a8c009a70 con 0x7f7a940cc0d0 2023-11-08T19:23:47.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.298+0000 7f7a99384700 1 --2- 172.21.15.149:0/3450839052 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7a940cc4b0 0x7f7a941561f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:23:47.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.298+0000 7f7a99b85700 1 --2- 172.21.15.149:0/3450839052 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a940cc0d0 0x7f7a941f2970 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7a900090b0 tx=0x7f7a90004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:47.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.298+0000 7f7a8a7fc700 1 -- 172.21.15.149:0/3450839052 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a900036a0 con 0x7f7a940cc0d0 2023-11-08T19:23:47.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.298+0000 7f7a8a7fc700 1 -- 172.21.15.149:0/3450839052 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a9001f070 con 0x7f7a940cc0d0 2023-11-08T19:23:47.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.298+0000 7f7a9bde9700 1 -- 172.21.15.149:0/3450839052 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a900094a0 con 0x7f7a940cc0d0 2023-11-08T19:23:47.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.298+0000 7f7a8a7fc700 1 -- 172.21.15.149:0/3450839052 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a90003a40 con 0x7f7a940cc0d0 2023-11-08T19:23:47.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.298+0000 7f7a9bde9700 1 -- 172.21.15.149:0/3450839052 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a940b19e0 con 0x7f7a940cc0d0 2023-11-08T19:23:47.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.299+0000 7f7a9bde9700 1 -- 172.21.15.149:0/3450839052 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a941f1610 con 0x7f7a940cc0d0 2023-11-08T19:23:47.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.299+0000 7f7a8a7fc700 1 -- 172.21.15.149:0/3450839052 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7a90003ba0 con 0x7f7a940cc0d0 2023-11-08T19:23:47.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.300+0000 7f7a8a7fc700 1 --2- 172.21.15.149:0/3450839052 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f7a7806af00 0x7f7a7806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:47.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.300+0000 7f7a8a7fc700 1 -- 172.21.15.149:0/3450839052 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7a90021070 con 0x7f7a940cc0d0 2023-11-08T19:23:47.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.300+0000 7f7a99384700 1 --2- 172.21.15.149:0/3450839052 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f7a7806af00 0x7f7a7806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:47.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.300+0000 7f7a99384700 1 --2- 172.21.15.149:0/3450839052 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f7a7806af00 0x7f7a7806d3c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7a9415ed80 tx=0x7f7a84009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:47.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.305+0000 7f7a8a7fc700 1 -- 172.21.15.149:0/3450839052 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7a941f1610 con 0x7f7a940cc0d0 2023-11-08T19:23:47.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.495+0000 7f7a9bde9700 1 -- 172.21.15.149:0/3450839052 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7a941f1610 con 0x7f7a940cc0d0 2023-11-08T19:23:47.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.496+0000 7f7a8a7fc700 1 -- 172.21.15.149:0/3450839052 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7a90015020 con 0x7f7a940cc0d0 2023-11-08T19:23:47.498 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:23:47.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.497+0000 7f7a9bde9700 1 -- 172.21.15.149:0/3450839052 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f7a7806af00 msgr2=0x7f7a7806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:47.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.497+0000 7f7a9bde9700 1 --2- 172.21.15.149:0/3450839052 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f7a7806af00 0x7f7a7806d3c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7a9415ed80 tx=0x7f7a84009040 comp rx=0 tx=0).stop 2023-11-08T19:23:47.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.497+0000 7f7a9bde9700 1 -- 172.21.15.149:0/3450839052 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a940cc0d0 msgr2=0x7f7a941f2970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:47.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.498+0000 7f7a9bde9700 1 --2- 172.21.15.149:0/3450839052 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a940cc0d0 0x7f7a941f2970 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7a900090b0 tx=0x7f7a90004750 comp rx=0 tx=0).stop 2023-11-08T19:23:47.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.498+0000 7f7a9bde9700 1 -- 172.21.15.149:0/3450839052 shutdown_connections 2023-11-08T19:23:47.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.498+0000 7f7a9bde9700 1 --2- 172.21.15.149:0/3450839052 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f7a7806af00 0x7f7a7806d3c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:47.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.498+0000 7f7a9bde9700 1 --2- 172.21.15.149:0/3450839052 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7a940cc910 0x7f7a940b53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:47.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.498+0000 7f7a9bde9700 1 --2- 172.21.15.149:0/3450839052 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a940cc0d0 0x7f7a941f2970 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:47.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.498+0000 7f7a9bde9700 1 --2- 172.21.15.149:0/3450839052 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7a940cc4b0 0x7f7a941561f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:47.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.498+0000 7f7a9bde9700 1 -- 172.21.15.149:0/3450839052 >> 172.21.15.149:0/3450839052 conn(0x7f7a9406f120 msgr2=0x7f7a9406f590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:47.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.498+0000 7f7a9bde9700 1 -- 172.21.15.149:0/3450839052 shutdown_connections 2023-11-08T19:23:47.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.498+0000 7f7a9bde9700 1 -- 172.21.15.149:0/3450839052 wait complete. 2023-11-08T19:23:47.511 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-08T19:23:47.634 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.633+0000 7f799a4fa700 1 Processor -- start 2023-11-08T19:23:47.635 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.633+0000 7f799a4fa700 1 -- start start 2023-11-08T19:23:47.638 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.634+0000 7f799a4fa700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f799415abf0 0x7f79940b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:47.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.634+0000 7f799a4fa700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f79940cc870 0x7f799406bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:47.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.634+0000 7f799a4fa700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79940b6470 con 0x7f79940d1130 2023-11-08T19:23:47.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.634+0000 7f799a4fa700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79940b66a0 con 0x7f799415abf0 2023-11-08T19:23:47.640 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.634+0000 7f799a4fa700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79940d04a0 con 0x7f79940cc870 2023-11-08T19:23:47.640 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.634+0000 7f79937fe700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f79940d1130 0x7f79940cc160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:40272/0 (socket says 172.21.15.149:40272) 2023-11-08T19:23:47.640 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.634+0000 7f79937fe700 1 -- 172.21.15.149:0/2334596616 learned_addr learned my addr 172.21.15.149:0/2334596616 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:23:47.640 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.634+0000 7f7992ffd700 1 -- 172.21.15.149:0/2334596616 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4023012635 0 0) 0x7f79940b6470 con 0x7f79940d1130 2023-11-08T19:23:47.640 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.635+0000 7f7998a97700 1 --2- 172.21.15.149:0/2334596616 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f79940cc870 0x7f799406bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:47.641 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.635+0000 7f7993fff700 1 --2- 172.21.15.149:0/2334596616 >> v2:172.21.15.160:3300/0 conn(0x7f799415abf0 0x7f79940b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:47.641 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.635+0000 7f7992ffd700 1 -- 172.21.15.149:0/2334596616 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f797c0035b0 con 0x7f79940d1130 2023-11-08T19:23:47.641 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.635+0000 7f7992ffd700 1 -- 172.21.15.149:0/2334596616 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 332814327 0 0) 0x7f797c0035b0 con 0x7f79940d1130 2023-11-08T19:23:47.641 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.635+0000 7f7992ffd700 1 -- 172.21.15.149:0/2334596616 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f79940cc870 msgr2=0x7f799406bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:47.641 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.635+0000 7f7992ffd700 1 --2- 172.21.15.149:0/2334596616 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f79940cc870 0x7f799406bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:47.642 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.635+0000 7f7992ffd700 1 -- 172.21.15.149:0/2334596616 >> v2:172.21.15.160:3300/0 conn(0x7f799415abf0 msgr2=0x7f79940b5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:47.642 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.635+0000 7f7992ffd700 1 --2- 172.21.15.149:0/2334596616 >> v2:172.21.15.160:3300/0 conn(0x7f799415abf0 0x7f79940b5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:47.642 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.635+0000 7f7992ffd700 1 -- 172.21.15.149:0/2334596616 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f799415afd0 con 0x7f79940d1130 2023-11-08T19:23:47.642 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.635+0000 7f7992ffd700 1 -- 172.21.15.149:0/2334596616 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f7984001670 con 0x7f79940d1130 2023-11-08T19:23:47.642 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.635+0000 7f7992ffd700 1 -- 172.21.15.149:0/2334596616 >> v1:172.21.15.149:6789/0 conn(0x7f79940d1130 legacy=0x7f79940cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:47.643 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.635+0000 7f7992ffd700 1 --2- 172.21.15.149:0/2334596616 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f797c003a70 0x7f797c003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:47.643 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.635+0000 7f7992ffd700 1 --2- 172.21.15.149:0/2334596616 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f79940cc870 0x7f797c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:47.643 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.635+0000 7f7992ffd700 1 --2- 172.21.15.149:0/2334596616 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f797c004d90 0x7f797c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:47.643 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.635+0000 7f7992ffd700 1 -- 172.21.15.149:0/2334596616 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79940b66a0 con 0x7f797c004d90 2023-11-08T19:23:47.643 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.635+0000 7f7992ffd700 1 -- 172.21.15.149:0/2334596616 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79940d04a0 con 0x7f797c003a70 2023-11-08T19:23:47.644 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.635+0000 7f7992ffd700 1 -- 172.21.15.149:0/2334596616 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f797c00ba90 con 0x7f79940cc870 2023-11-08T19:23:47.644 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.635+0000 7f7998a97700 1 --2- 172.21.15.149:0/2334596616 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f797c004d90 0x7f797c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:47.644 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.635+0000 7f7993fff700 1 --2- 172.21.15.149:0/2334596616 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f797c003a70 0x7f797c003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:47.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.635+0000 7f79937fe700 1 --2- 172.21.15.149:0/2334596616 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f79940cc870 0x7f797c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:47.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.635+0000 7f7998a97700 1 -- 172.21.15.149:0/2334596616 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f79940cc870 msgr2=0x7f797c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:47.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.635+0000 7f7998a97700 1 --2- 172.21.15.149:0/2334596616 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f79940cc870 0x7f797c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:47.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.635+0000 7f7998a97700 1 -- 172.21.15.149:0/2334596616 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f797c003a70 msgr2=0x7f797c003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:47.646 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.635+0000 7f7998a97700 1 --2- 172.21.15.149:0/2334596616 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f797c003a70 0x7f797c003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:47.646 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.635+0000 7f7998a97700 1 -- 172.21.15.149:0/2334596616 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f797c0035b0 con 0x7f797c004d90 2023-11-08T19:23:47.647 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.635+0000 7f7998a97700 1 --2- 172.21.15.149:0/2334596616 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f797c004d90 0x7f797c005210 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f798c009fc0 tx=0x7f797c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52e74739504e5ec2 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:47.647 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.636+0000 7f7992ffd700 1 -- 172.21.15.149:0/2334596616 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798c00ec30 con 0x7f797c004d90 2023-11-08T19:23:47.647 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.636+0000 7f7992ffd700 1 -- 172.21.15.149:0/2334596616 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f798c00f040 con 0x7f797c004d90 2023-11-08T19:23:47.648 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.636+0000 7f7992ffd700 1 -- 172.21.15.149:0/2334596616 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798c014480 con 0x7f797c004d90 2023-11-08T19:23:47.648 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.636+0000 7f799a4fa700 1 -- 172.21.15.149:0/2334596616 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f797c004d90 msgr2=0x7f797c005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:47.648 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.636+0000 7f799a4fa700 1 --2- 172.21.15.149:0/2334596616 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f797c004d90 0x7f797c005210 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f798c009fc0 tx=0x7f797c005880 comp rx=0 tx=0).stop 2023-11-08T19:23:47.649 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.636+0000 7f7998a97700 1 -- 172.21.15.149:0/2334596616 reap_dead start 2023-11-08T19:23:47.649 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.636+0000 7f799a4fa700 1 -- 172.21.15.149:0/2334596616 shutdown_connections 2023-11-08T19:23:47.649 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.636+0000 7f799a4fa700 1 -- 172.21.15.149:0/2334596616 >> 172.21.15.149:0/2334596616 conn(0x7f79940d0640 msgr2=0x7f79940d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:47.650 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.636+0000 7f799a4fa700 1 -- 172.21.15.149:0/2334596616 shutdown_connections 2023-11-08T19:23:47.650 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.636+0000 7f799a4fa700 1 -- 172.21.15.149:0/2334596616 wait complete. 2023-11-08T19:23:47.651 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.638+0000 7f799a4fa700 1 Processor -- start 2023-11-08T19:23:47.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.638+0000 7f799a4fa700 1 -- start start 2023-11-08T19:23:47.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.639+0000 7f799a4fa700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79941566f0 0x7f79940b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:47.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.639+0000 7f799a4fa700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f799415cf10 0x7f7994158850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:47.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.639+0000 7f799a4fa700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7994158d90 0x7f79940c9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:47.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.639+0000 7f799a4fa700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79940b4f50 con 0x7f799415cf10 2023-11-08T19:23:47.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.639+0000 7f799a4fa700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7994156ad0 con 0x7f79941566f0 2023-11-08T19:23:47.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.639+0000 7f799a4fa700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7994159220 con 0x7f7994158d90 2023-11-08T19:23:47.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.639+0000 7f79937fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f799415cf10 0x7f7994158850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:47.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.639+0000 7f79937fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f799415cf10 0x7f7994158850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38284/0 (socket says 172.21.15.149:38284) 2023-11-08T19:23:47.657 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.639+0000 7f79937fe700 1 -- 172.21.15.149:0/2064372377 learned_addr learned my addr 172.21.15.149:0/2064372377 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:47.657 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.639+0000 7f7993fff700 1 --2- 172.21.15.149:0/2064372377 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79941566f0 0x7f79940b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:47.657 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.639+0000 7f79937fe700 1 -- 172.21.15.149:0/2064372377 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7994158d90 msgr2=0x7f79940c9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:47.657 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.639+0000 7f79937fe700 1 --2- 172.21.15.149:0/2064372377 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7994158d90 0x7f79940c9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:47.657 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.639+0000 7f79937fe700 1 -- 172.21.15.149:0/2064372377 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79941566f0 msgr2=0x7f79940b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:47.658 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.639+0000 7f79937fe700 1 --2- 172.21.15.149:0/2064372377 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79941566f0 0x7f79940b3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:47.658 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.639+0000 7f79937fe700 1 -- 172.21.15.149:0/2064372377 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79940b42d0 con 0x7f799415cf10 2023-11-08T19:23:47.658 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.639+0000 7f79937fe700 1 --2- 172.21.15.149:0/2064372377 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f799415cf10 0x7f7994158850 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7984000fb0 tx=0x7f79840075f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:47.658 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.640+0000 7f7990ff9700 1 -- 172.21.15.149:0/2064372377 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79840077d0 con 0x7f799415cf10 2023-11-08T19:23:47.658 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.640+0000 7f7990ff9700 1 -- 172.21.15.149:0/2064372377 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f798400f820 con 0x7f799415cf10 2023-11-08T19:23:47.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.640+0000 7f799a4fa700 1 -- 172.21.15.149:0/2064372377 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79940b45b0 con 0x7f799415cf10 2023-11-08T19:23:47.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.640+0000 7f7990ff9700 1 -- 172.21.15.149:0/2064372377 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798400fbd0 con 0x7f799415cf10 2023-11-08T19:23:47.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.640+0000 7f799a4fa700 1 -- 172.21.15.149:0/2064372377 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79940b4b70 con 0x7f799415cf10 2023-11-08T19:23:47.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.641+0000 7f799a4fa700 1 -- 172.21.15.149:0/2064372377 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79940b5090 con 0x7f799415cf10 2023-11-08T19:23:47.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.641+0000 7f7990ff9700 1 -- 172.21.15.149:0/2064372377 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f798400fd30 con 0x7f799415cf10 2023-11-08T19:23:47.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.641+0000 7f7990ff9700 1 --2- 172.21.15.149:0/2064372377 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f798006af00 0x7f798006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:47.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.642+0000 7f7990ff9700 1 -- 172.21.15.149:0/2064372377 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7984089810 con 0x7f799415cf10 2023-11-08T19:23:47.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.642+0000 7f7993fff700 1 --2- 172.21.15.149:0/2064372377 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f798006af00 0x7f798006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:47.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.642+0000 7f7993fff700 1 --2- 172.21.15.149:0/2064372377 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f798006af00 0x7f798006d3c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7988009440 tx=0x7f798800d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:47.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.646+0000 7f7990ff9700 1 -- 172.21.15.149:0/2064372377 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f79940b5090 con 0x7f799415cf10 2023-11-08T19:23:47.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.832+0000 7f799a4fa700 1 -- 172.21.15.149:0/2064372377 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f79940b5090 con 0x7f799415cf10 2023-11-08T19:23:47.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.833+0000 7f7990ff9700 1 -- 172.21.15.149:0/2064372377 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f79940b5090 con 0x7f799415cf10 2023-11-08T19:23:47.834 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 64 2023-11-08T19:23:47.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.835+0000 7f799a4fa700 1 -- 172.21.15.149:0/2064372377 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f798006af00 msgr2=0x7f798006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:47.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.835+0000 7f799a4fa700 1 --2- 172.21.15.149:0/2064372377 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f798006af00 0x7f798006d3c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7988009440 tx=0x7f798800d040 comp rx=0 tx=0).stop 2023-11-08T19:23:47.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.835+0000 7f799a4fa700 1 -- 172.21.15.149:0/2064372377 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f799415cf10 msgr2=0x7f7994158850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:47.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.835+0000 7f799a4fa700 1 --2- 172.21.15.149:0/2064372377 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f799415cf10 0x7f7994158850 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7984000fb0 tx=0x7f79840075f0 comp rx=0 tx=0).stop 2023-11-08T19:23:47.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.835+0000 7f799a4fa700 1 -- 172.21.15.149:0/2064372377 shutdown_connections 2023-11-08T19:23:47.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.835+0000 7f799a4fa700 1 --2- 172.21.15.149:0/2064372377 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f798006af00 0x7f798006d3c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:47.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.835+0000 7f799a4fa700 1 --2- 172.21.15.149:0/2064372377 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79941566f0 0x7f79940b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:47.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.835+0000 7f799a4fa700 1 --2- 172.21.15.149:0/2064372377 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7994158d90 0x7f79940c9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:47.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.835+0000 7f799a4fa700 1 --2- 172.21.15.149:0/2064372377 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f799415cf10 0x7f7994158850 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:47.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.835+0000 7f799a4fa700 1 -- 172.21.15.149:0/2064372377 >> 172.21.15.149:0/2064372377 conn(0x7f79940d0640 msgr2=0x7f799406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:47.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.835+0000 7f799a4fa700 1 -- 172.21.15.149:0/2064372377 shutdown_connections 2023-11-08T19:23:47.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.835+0000 7f799a4fa700 1 -- 172.21.15.149:0/2064372377 wait complete. 2023-11-08T19:23:47.848 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-08T19:23:47.972 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.970+0000 7fa9ecc2f700 1 Processor -- start 2023-11-08T19:23:47.972 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.970+0000 7fa9ecc2f700 1 -- start start 2023-11-08T19:23:47.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.971+0000 7fa9ecc2f700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fa9e815df40 0x7fa9e806c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:47.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.971+0000 7fa9ecc2f700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa9e806ab80 0x7fa9e806c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:47.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.971+0000 7fa9ecc2f700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9e815e320 con 0x7fa9e80cf1c0 2023-11-08T19:23:47.983 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.971+0000 7fa9ecc2f700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9e806b020 con 0x7fa9e806ab80 2023-11-08T19:23:47.983 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.971+0000 7fa9ecc2f700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9e806b2e0 con 0x7fa9e815df40 2023-11-08T19:23:47.983 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.971+0000 7fa9e5d9b700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa9e806ab80 0x7fa9e806c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:47.984 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.971+0000 7fa9e5d9b700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa9e806ab80 0x7fa9e806c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38290/0 (socket says 172.21.15.149:38290) 2023-11-08T19:23:47.984 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.971+0000 7fa9e5d9b700 1 -- 172.21.15.149:0/2022446581 learned_addr learned my addr 172.21.15.149:0/2022446581 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:47.984 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.972+0000 7fa9e659c700 1 --2- 172.21.15.149:0/2022446581 >> v2:172.21.15.160:3300/0 conn(0x7fa9e815df40 0x7fa9e806c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:47.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.972+0000 7fa9e5d9b700 1 -- 172.21.15.149:0/2022446581 >> v2:172.21.15.160:3300/0 conn(0x7fa9e815df40 msgr2=0x7fa9e806c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:47.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.972+0000 7fa9e5d9b700 1 --2- 172.21.15.149:0/2022446581 >> v2:172.21.15.160:3300/0 conn(0x7fa9e815df40 0x7fa9e806c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:47.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.972+0000 7fa9e5d9b700 1 -- 172.21.15.149:0/2022446581 >> v1:172.21.15.160:6789/0 conn(0x7fa9e80cf1c0 legacy=0x7fa9e80caf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:47.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.972+0000 7fa9e5d9b700 1 -- 172.21.15.149:0/2022446581 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9e806b5c0 con 0x7fa9e806ab80 2023-11-08T19:23:47.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.972+0000 7fa9e659c700 1 --2- 172.21.15.149:0/2022446581 >> v2:172.21.15.160:3300/0 conn(0x7fa9e815df40 0x7fa9e806c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:23:47.987 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.972+0000 7fa9e5d9b700 1 --2- 172.21.15.149:0/2022446581 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9e806ab80 0x7fa9e806c5e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa9e80ce190 tx=0x7fa9d8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63c2b4fef8e87d49 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:47.987 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.972+0000 7fa9e559a700 1 -- 172.21.15.149:0/2022446581 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d800b870 con 0x7fa9e806ab80 2023-11-08T19:23:47.987 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.972+0000 7fa9e559a700 1 -- 172.21.15.149:0/2022446581 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9d800b9d0 con 0x7fa9e806ab80 2023-11-08T19:23:47.988 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.972+0000 7fa9e559a700 1 -- 172.21.15.149:0/2022446581 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d800bd60 con 0x7fa9e806ab80 2023-11-08T19:23:47.988 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.973+0000 7fa9ecc2f700 1 -- 172.21.15.149:0/2022446581 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9e806ab80 msgr2=0x7fa9e806c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:47.988 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.973+0000 7fa9ecc2f700 1 --2- 172.21.15.149:0/2022446581 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9e806ab80 0x7fa9e806c5e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa9e80ce190 tx=0x7fa9d8009bd0 comp rx=0 tx=0).stop 2023-11-08T19:23:47.989 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.973+0000 7fa9ecc2f700 1 -- 172.21.15.149:0/2022446581 shutdown_connections 2023-11-08T19:23:47.989 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.973+0000 7fa9ecc2f700 1 --2- 172.21.15.149:0/2022446581 >> v2:172.21.15.160:3300/0 conn(0x7fa9e815df40 0x7fa9e806c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:47.990 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.973+0000 7fa9ecc2f700 1 --2- 172.21.15.149:0/2022446581 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9e806ab80 0x7fa9e806c5e0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:47.990 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.973+0000 7fa9ecc2f700 1 -- 172.21.15.149:0/2022446581 >> 172.21.15.149:0/2022446581 conn(0x7fa9e80d0640 msgr2=0x7fa9e80d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:47.990 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.973+0000 7fa9ecc2f700 1 -- 172.21.15.149:0/2022446581 shutdown_connections 2023-11-08T19:23:47.991 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.973+0000 7fa9ecc2f700 1 -- 172.21.15.149:0/2022446581 wait complete. 2023-11-08T19:23:47.991 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.974+0000 7fa9ecc2f700 1 Processor -- start 2023-11-08T19:23:47.991 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.974+0000 7fa9ecc2f700 1 -- start start 2023-11-08T19:23:47.992 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.975+0000 7fa9ecc2f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9e806ab80 0x7fa9e80c9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:47.992 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.975+0000 7fa9ecc2f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa9e80cf1c0 0x7fa9e81f7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:47.993 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.975+0000 7fa9ecc2f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa9e815df40 0x7fa9e80c7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:47.993 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.975+0000 7fa9ecc2f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e80ca8b0 con 0x7fa9e806ab80 2023-11-08T19:23:47.993 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.975+0000 7fa9ecc2f700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e81f7cd0 con 0x7fa9e80cf1c0 2023-11-08T19:23:47.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.975+0000 7fa9ecc2f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e80c9d30 con 0x7fa9e815df40 2023-11-08T19:23:47.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.975+0000 7fa9e659c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9e806ab80 0x7fa9e80c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:47.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.975+0000 7fa9e659c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9e806ab80 0x7fa9e80c9650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38296/0 (socket says 172.21.15.149:38296) 2023-11-08T19:23:47.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.975+0000 7fa9e659c700 1 -- 172.21.15.149:0/2511505995 learned_addr learned my addr 172.21.15.149:0/2511505995 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:47.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.975+0000 7fa9e5d9b700 1 --2- 172.21.15.149:0/2511505995 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa9e80cf1c0 0x7fa9e81f7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:47.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.975+0000 7fa9e6d9d700 1 --2- 172.21.15.149:0/2511505995 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa9e815df40 0x7fa9e80c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:47.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.975+0000 7fa9e659c700 1 -- 172.21.15.149:0/2511505995 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa9e815df40 msgr2=0x7fa9e80c7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:47.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.975+0000 7fa9e659c700 1 --2- 172.21.15.149:0/2511505995 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa9e815df40 0x7fa9e80c7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:47.997 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.975+0000 7fa9e659c700 1 -- 172.21.15.149:0/2511505995 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa9e80cf1c0 msgr2=0x7fa9e81f7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:47.997 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.975+0000 7fa9e659c700 1 --2- 172.21.15.149:0/2511505995 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa9e80cf1c0 0x7fa9e81f7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:47.998 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.975+0000 7fa9e659c700 1 -- 172.21.15.149:0/2511505995 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d8009550 con 0x7fa9e806ab80 2023-11-08T19:23:47.998 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.975+0000 7fa9e659c700 1 --2- 172.21.15.149:0/2511505995 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9e806ab80 0x7fa9e80c9650 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc00e760 tx=0x7fa9dc00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:47.998 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.975+0000 7fa9d6ffd700 1 -- 172.21.15.149:0/2511505995 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9dc013610 con 0x7fa9e806ab80 2023-11-08T19:23:47.999 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.976+0000 7fa9d6ffd700 1 -- 172.21.15.149:0/2511505995 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9dc013770 con 0x7fa9e806ab80 2023-11-08T19:23:47.999 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.976+0000 7fa9ecc2f700 1 -- 172.21.15.149:0/2511505995 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9e80ca010 con 0x7fa9e806ab80 2023-11-08T19:23:47.999 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.976+0000 7fa9d6ffd700 1 -- 172.21.15.149:0/2511505995 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9dc013b20 con 0x7fa9e806ab80 2023-11-08T19:23:48.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.976+0000 7fa9ecc2f700 1 -- 172.21.15.149:0/2511505995 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9e80ca5d0 con 0x7fa9e806ab80 2023-11-08T19:23:48.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.977+0000 7fa9ecc2f700 1 -- 172.21.15.149:0/2511505995 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9e815f6c0 con 0x7fa9e806ab80 2023-11-08T19:23:48.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.977+0000 7fa9d6ffd700 1 -- 172.21.15.149:0/2511505995 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa9dc013c80 con 0x7fa9e806ab80 2023-11-08T19:23:48.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.977+0000 7fa9d6ffd700 1 --2- 172.21.15.149:0/2511505995 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa9c806af00 0x7fa9c806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:48.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.977+0000 7fa9d6ffd700 1 -- 172.21.15.149:0/2511505995 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa9dc089470 con 0x7fa9e806ab80 2023-11-08T19:23:48.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.977+0000 7fa9e5d9b700 1 --2- 172.21.15.149:0/2511505995 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa9c806af00 0x7fa9c806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:48.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.978+0000 7fa9e5d9b700 1 --2- 172.21.15.149:0/2511505995 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa9c806af00 0x7fa9c806d3c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa9d8000c00 tx=0x7fa9d8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:48.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:47.982+0000 7fa9d6ffd700 1 -- 172.21.15.149:0/2511505995 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa9dc0542c0 con 0x7fa9e806ab80 2023-11-08T19:23:48.170 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.170+0000 7fa9ecc2f700 1 -- 172.21.15.149:0/2511505995 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa9e804f730 con 0x7fa9e806ab80 2023-11-08T19:23:48.171 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.170+0000 7fa9d6ffd700 1 -- 172.21.15.149:0/2511505995 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa9dc0578e0 con 0x7fa9e806ab80 2023-11-08T19:23:48.172 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:23:48.174 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.172+0000 7fa9ecc2f700 1 -- 172.21.15.149:0/2511505995 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa9c806af00 msgr2=0x7fa9c806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:48.174 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.172+0000 7fa9ecc2f700 1 --2- 172.21.15.149:0/2511505995 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa9c806af00 0x7fa9c806d3c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa9d8000c00 tx=0x7fa9d8008030 comp rx=0 tx=0).stop 2023-11-08T19:23:48.174 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.172+0000 7fa9ecc2f700 1 -- 172.21.15.149:0/2511505995 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9e806ab80 msgr2=0x7fa9e80c9650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:48.174 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.172+0000 7fa9ecc2f700 1 --2- 172.21.15.149:0/2511505995 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9e806ab80 0x7fa9e80c9650 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc00e760 tx=0x7fa9dc00eb20 comp rx=0 tx=0).stop 2023-11-08T19:23:48.174 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.172+0000 7fa9ecc2f700 1 -- 172.21.15.149:0/2511505995 shutdown_connections 2023-11-08T19:23:48.175 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.172+0000 7fa9ecc2f700 1 --2- 172.21.15.149:0/2511505995 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa9c806af00 0x7fa9c806d3c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:48.175 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.172+0000 7fa9ecc2f700 1 --2- 172.21.15.149:0/2511505995 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa9e815df40 0x7fa9e80c7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:48.175 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.172+0000 7fa9ecc2f700 1 --2- 172.21.15.149:0/2511505995 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9e806ab80 0x7fa9e80c9650 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:48.175 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.172+0000 7fa9ecc2f700 1 --2- 172.21.15.149:0/2511505995 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa9e80cf1c0 0x7fa9e81f7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:48.175 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.172+0000 7fa9ecc2f700 1 -- 172.21.15.149:0/2511505995 >> 172.21.15.149:0/2511505995 conn(0x7fa9e80d0640 msgr2=0x7fa9e80cbe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:48.176 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.172+0000 7fa9ecc2f700 1 -- 172.21.15.149:0/2511505995 shutdown_connections 2023-11-08T19:23:48.176 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.172+0000 7fa9ecc2f700 1 -- 172.21.15.149:0/2511505995 wait complete. 2023-11-08T19:23:48.197 INFO:tasks.cephfs_test_runner:Starting test: test_attaching_pools_with_snaps_to_fs_fails (tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools) Test that attempt to attach pool with snapshots to an fs fails 2023-11-08T19:23:48.198 INFO:tasks.cephfs_test_runner:test_attaching_pools_with_snaps_to_fs_fails (tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools) 2023-11-08T19:23:48.198 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:23:48.320 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.318+0000 7f1f4a219700 1 Processor -- start 2023-11-08T19:23:48.320 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.319+0000 7f1f4a219700 1 -- start start 2023-11-08T19:23:48.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.319+0000 7f1f4a219700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f1f4415dc30 0x7f1f4406f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:48.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.319+0000 7f1f4a219700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f1f4406fe40 0x7f1f4406c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:48.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.319+0000 7f1f4a219700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f4406bd50 con 0x7f1f440d2060 2023-11-08T19:23:48.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.319+0000 7f1f4a219700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f440d04b0 con 0x7f1f4406fe40 2023-11-08T19:23:48.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.319+0000 7f1f4a219700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f440d24f0 con 0x7f1f4415dc30 2023-11-08T19:23:48.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.319+0000 7f1f42ffd700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f1f440d2060 0x7f1f4406f730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:40306/0 (socket says 172.21.15.149:40306) 2023-11-08T19:23:48.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.319+0000 7f1f42ffd700 1 -- 172.21.15.149:0/2008956407 learned_addr learned my addr 172.21.15.149:0/2008956407 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:23:48.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.319+0000 7f1f43fff700 1 --2- 172.21.15.149:0/2008956407 >> v2:172.21.15.149:3300/0 conn(0x7f1f4406fe40 0x7f1f4406c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:48.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.320+0000 7f1f437fe700 1 --2- 172.21.15.149:0/2008956407 >> v2:172.21.15.160:3300/0 conn(0x7f1f4415dc30 0x7f1f4406f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:48.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.320+0000 7f1f427fc700 1 -- 172.21.15.149:0/2008956407 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3975405854 0 0) 0x7f1f4406bd50 con 0x7f1f440d2060 2023-11-08T19:23:48.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.320+0000 7f1f427fc700 1 -- 172.21.15.149:0/2008956407 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f300035b0 con 0x7f1f440d2060 2023-11-08T19:23:48.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.320+0000 7f1f43fff700 1 -- 172.21.15.149:0/2008956407 >> v2:172.21.15.160:3300/0 conn(0x7f1f4415dc30 msgr2=0x7f1f4406f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:48.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.320+0000 7f1f43fff700 1 --2- 172.21.15.149:0/2008956407 >> v2:172.21.15.160:3300/0 conn(0x7f1f4415dc30 0x7f1f4406f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:48.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.320+0000 7f1f43fff700 1 -- 172.21.15.149:0/2008956407 >> v1:172.21.15.149:6789/0 conn(0x7f1f440d2060 legacy=0x7f1f4406f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:48.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.320+0000 7f1f43fff700 1 -- 172.21.15.149:0/2008956407 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f440d0730 con 0x7f1f4406fe40 2023-11-08T19:23:48.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.320+0000 7f1f43fff700 1 --2- 172.21.15.149:0/2008956407 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f4406fe40 0x7f1f4406c1e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c009d90 tx=0x7f1f3c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9addceb8c4e8d6e0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:48.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.320+0000 7f1f427fc700 1 -- 172.21.15.149:0/2008956407 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c00e070 con 0x7f1f4406fe40 2023-11-08T19:23:48.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.320+0000 7f1f427fc700 1 -- 172.21.15.149:0/2008956407 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f3c00bae0 con 0x7f1f4406fe40 2023-11-08T19:23:48.328 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.320+0000 7f1f427fc700 1 -- 172.21.15.149:0/2008956407 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c00be90 con 0x7f1f4406fe40 2023-11-08T19:23:48.328 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.321+0000 7f1f4a219700 1 -- 172.21.15.149:0/2008956407 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f4406fe40 msgr2=0x7f1f4406c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:48.328 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.321+0000 7f1f4a219700 1 --2- 172.21.15.149:0/2008956407 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f4406fe40 0x7f1f4406c1e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c009d90 tx=0x7f1f3c00b330 comp rx=0 tx=0).stop 2023-11-08T19:23:48.328 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.321+0000 7f1f4a219700 1 -- 172.21.15.149:0/2008956407 shutdown_connections 2023-11-08T19:23:48.329 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.321+0000 7f1f4a219700 1 --2- 172.21.15.149:0/2008956407 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f4406fe40 0x7f1f4406c1e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:48.329 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.321+0000 7f1f4a219700 1 --2- 172.21.15.149:0/2008956407 >> v2:172.21.15.160:3300/0 conn(0x7f1f4415dc30 0x7f1f4406f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:48.329 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.321+0000 7f1f4a219700 1 -- 172.21.15.149:0/2008956407 >> 172.21.15.149:0/2008956407 conn(0x7f1f4408afd0 msgr2=0x7f1f440d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:48.329 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.321+0000 7f1f4a219700 1 -- 172.21.15.149:0/2008956407 shutdown_connections 2023-11-08T19:23:48.329 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.321+0000 7f1f4a219700 1 -- 172.21.15.149:0/2008956407 wait complete. 2023-11-08T19:23:48.330 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.322+0000 7f1f4a219700 1 Processor -- start 2023-11-08T19:23:48.330 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.322+0000 7f1f4a219700 1 -- start start 2023-11-08T19:23:48.333 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.323+0000 7f1f4a219700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1f4406fe40 0x7f1f440cd070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:48.333 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.323+0000 7f1f4a219700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f440d2060 0x7f1f440cd5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:48.333 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.323+0000 7f1f4a219700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1f4415dc30 0x7f1f4415c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:48.333 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.323+0000 7f1f4a219700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f440cc740 con 0x7f1f440d2060 2023-11-08T19:23:48.334 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.323+0000 7f1f4a219700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f441f34a0 con 0x7f1f4406fe40 2023-11-08T19:23:48.334 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.323+0000 7f1f4a219700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f440c6ff0 con 0x7f1f4415dc30 2023-11-08T19:23:48.334 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.323+0000 7f1f42ffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f440d2060 0x7f1f440cd5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:48.334 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.323+0000 7f1f42ffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f440d2060 0x7f1f440cd5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38312/0 (socket says 172.21.15.149:38312) 2023-11-08T19:23:48.334 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.323+0000 7f1f42ffd700 1 -- 172.21.15.149:0/3093591392 learned_addr learned my addr 172.21.15.149:0/3093591392 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:48.335 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.323+0000 7f1f43fff700 1 --2- 172.21.15.149:0/3093591392 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1f4415dc30 0x7f1f4415c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:48.335 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.323+0000 7f1f437fe700 1 --2- 172.21.15.149:0/3093591392 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1f4406fe40 0x7f1f440cd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:48.335 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.323+0000 7f1f42ffd700 1 -- 172.21.15.149:0/3093591392 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1f4415dc30 msgr2=0x7f1f4415c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:48.335 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.323+0000 7f1f42ffd700 1 --2- 172.21.15.149:0/3093591392 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1f4415dc30 0x7f1f4415c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:48.336 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.323+0000 7f1f42ffd700 1 -- 172.21.15.149:0/3093591392 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1f4406fe40 msgr2=0x7f1f440cd070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:48.336 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.323+0000 7f1f42ffd700 1 --2- 172.21.15.149:0/3093591392 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1f4406fe40 0x7f1f440cd070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:48.336 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.323+0000 7f1f42ffd700 1 -- 172.21.15.149:0/3093591392 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f3c009a70 con 0x7f1f440d2060 2023-11-08T19:23:48.336 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.323+0000 7f1f437fe700 1 --2- 172.21.15.149:0/3093591392 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1f4406fe40 0x7f1f440cd070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:23:48.336 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.323+0000 7f1f42ffd700 1 --2- 172.21.15.149:0/3093591392 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f440d2060 0x7f1f440cd5b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1f3400c4d0 tx=0x7f1f3400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:48.337 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.323+0000 7f1f3bfff700 1 -- 172.21.15.149:0/3093591392 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f34005d70 con 0x7f1f440d2060 2023-11-08T19:23:48.337 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.324+0000 7f1f3bfff700 1 -- 172.21.15.149:0/3093591392 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f340070d0 con 0x7f1f440d2060 2023-11-08T19:23:48.337 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.324+0000 7f1f3bfff700 1 -- 172.21.15.149:0/3093591392 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f34007460 con 0x7f1f440d2060 2023-11-08T19:23:48.337 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.324+0000 7f1f4a219700 1 -- 172.21.15.149:0/3093591392 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f440cdbe0 con 0x7f1f440d2060 2023-11-08T19:23:48.338 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.324+0000 7f1f4a219700 1 -- 172.21.15.149:0/3093591392 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f440cc080 con 0x7f1f440d2060 2023-11-08T19:23:48.338 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.324+0000 7f1f4a219700 1 -- 172.21.15.149:0/3093591392 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f440cc880 con 0x7f1f440d2060 2023-11-08T19:23:48.338 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.325+0000 7f1f3bfff700 1 -- 172.21.15.149:0/3093591392 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1f340075c0 con 0x7f1f440d2060 2023-11-08T19:23:48.338 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.326+0000 7f1f3bfff700 1 --2- 172.21.15.149:0/3093591392 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1f2406af00 0x7f1f2406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:48.338 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.326+0000 7f1f437fe700 1 --2- 172.21.15.149:0/3093591392 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1f2406af00 0x7f1f2406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:48.339 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.326+0000 7f1f3bfff700 1 -- 172.21.15.149:0/3093591392 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1f34088cb0 con 0x7f1f440d2060 2023-11-08T19:23:48.339 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.326+0000 7f1f437fe700 1 --2- 172.21.15.149:0/3093591392 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1f2406af00 0x7f1f2406d3c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1f441f6a80 tx=0x7f1f2c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:48.339 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.331+0000 7f1f3bfff700 1 -- 172.21.15.149:0/3093591392 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1f440cc880 con 0x7f1f440d2060 2023-11-08T19:23:48.525 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.524+0000 7f1f4a219700 1 -- 172.21.15.149:0/3093591392 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1f440cc880 con 0x7f1f440d2060 2023-11-08T19:23:48.526 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.525+0000 7f1f3bfff700 1 -- 172.21.15.149:0/3093591392 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18382 (secure 0 0 0) 0x7f1f440cc880 con 0x7f1f440d2060 2023-11-08T19:23:48.526 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:23:48.527 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":24,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:23:06.964482+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-08T19:22:59.830928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-08T19:23:00.886589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-08T19:23:04.574033+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:23:48.528 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.527+0000 7f1f4a219700 1 -- 172.21.15.149:0/3093591392 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1f2406af00 msgr2=0x7f1f2406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:48.529 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.527+0000 7f1f4a219700 1 --2- 172.21.15.149:0/3093591392 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1f2406af00 0x7f1f2406d3c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1f441f6a80 tx=0x7f1f2c008040 comp rx=0 tx=0).stop 2023-11-08T19:23:48.529 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.527+0000 7f1f4a219700 1 -- 172.21.15.149:0/3093591392 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f440d2060 msgr2=0x7f1f440cd5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:48.529 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.527+0000 7f1f4a219700 1 --2- 172.21.15.149:0/3093591392 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f440d2060 0x7f1f440cd5b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1f3400c4d0 tx=0x7f1f3400c7e0 comp rx=0 tx=0).stop 2023-11-08T19:23:48.529 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.527+0000 7f1f4a219700 1 -- 172.21.15.149:0/3093591392 shutdown_connections 2023-11-08T19:23:48.530 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.527+0000 7f1f4a219700 1 --2- 172.21.15.149:0/3093591392 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1f2406af00 0x7f1f2406d3c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:48.530 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.527+0000 7f1f4a219700 1 --2- 172.21.15.149:0/3093591392 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1f4406fe40 0x7f1f440cd070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:48.530 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.527+0000 7f1f4a219700 1 --2- 172.21.15.149:0/3093591392 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1f4415dc30 0x7f1f4415c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:48.531 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.527+0000 7f1f4a219700 1 --2- 172.21.15.149:0/3093591392 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f440d2060 0x7f1f440cd5b0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:48.531 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.527+0000 7f1f4a219700 1 -- 172.21.15.149:0/3093591392 >> 172.21.15.149:0/3093591392 conn(0x7f1f4408afd0 msgr2=0x7f1f4406f5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:48.531 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.527+0000 7f1f4a219700 1 -- 172.21.15.149:0/3093591392 shutdown_connections 2023-11-08T19:23:48.531 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.527+0000 7f1f4a219700 1 -- 172.21.15.149:0/3093591392 wait complete. 2023-11-08T19:23:48.541 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-08T19:22:56.023194+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-08T19:22:59.830928+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-08T19:23:00.886589+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-08T19:23:04.574033+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-08T19:23:48.542 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-08T19:23:48.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.664+0000 7fbe0ffe4700 1 Processor -- start 2023-11-08T19:23:48.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.664+0000 7fbe0ffe4700 1 -- start start 2023-11-08T19:23:48.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.665+0000 7fbe0ffe4700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fbe080cc0d0 0x7fbe0815f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:48.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.665+0000 7fbe0ffe4700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe080cc4b0 0x7fbe0815c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:48.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.665+0000 7fbe0ffe4700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe0815be80 con 0x7fbe0815cb60 2023-11-08T19:23:48.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.665+0000 7fbe0ffe4700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe0815f9b0 con 0x7fbe080cc0d0 2023-11-08T19:23:48.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.665+0000 7fbe0ffe4700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0815fba0 con 0x7fbe080cc4b0 2023-11-08T19:23:48.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.665+0000 7fbe0d57f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe080cc4b0 0x7fbe0815c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:48.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.665+0000 7fbe0d57f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe080cc4b0 0x7fbe0815c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.149:58606/0 (socket says 172.21.15.149:58606) 2023-11-08T19:23:48.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.665+0000 7fbe0d57f700 1 -- 172.21.15.149:0/678592357 learned_addr learned my addr 172.21.15.149:0/678592357 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:48.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.666+0000 7fbe0dd80700 1 --2- 172.21.15.149:0/678592357 >> v2:172.21.15.160:3300/0 conn(0x7fbe080cc0d0 0x7fbe0815f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:48.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.666+0000 7fbe0d57f700 1 -- 172.21.15.149:0/678592357 >> v2:172.21.15.160:3300/0 conn(0x7fbe080cc0d0 msgr2=0x7fbe0815f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:48.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.666+0000 7fbe0d57f700 1 --2- 172.21.15.149:0/678592357 >> v2:172.21.15.160:3300/0 conn(0x7fbe080cc0d0 0x7fbe0815f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:48.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.666+0000 7fbe0d57f700 1 -- 172.21.15.149:0/678592357 >> v1:172.21.15.160:6789/0 conn(0x7fbe0815cb60 legacy=0x7fbe080cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:48.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.666+0000 7fbe0d57f700 1 -- 172.21.15.149:0/678592357 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe0815fe80 con 0x7fbe080cc4b0 2023-11-08T19:23:48.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.666+0000 7fbe0d57f700 1 --2- 172.21.15.149:0/678592357 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe080cc4b0 0x7fbe0815c620 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbe040098f0 tx=0x7fbe04009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfdfffad9698c44e server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:48.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.666+0000 7fbe0cd7e700 1 -- 172.21.15.149:0/678592357 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe04011830 con 0x7fbe080cc4b0 2023-11-08T19:23:48.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.666+0000 7fbe0cd7e700 1 -- 172.21.15.149:0/678592357 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe04011990 con 0x7fbe080cc4b0 2023-11-08T19:23:48.672 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.666+0000 7fbe0cd7e700 1 -- 172.21.15.149:0/678592357 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe04011d20 con 0x7fbe080cc4b0 2023-11-08T19:23:48.672 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.667+0000 7fbe0ffe4700 1 -- 172.21.15.149:0/678592357 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe080cc4b0 msgr2=0x7fbe0815c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:48.672 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.667+0000 7fbe0ffe4700 1 --2- 172.21.15.149:0/678592357 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe080cc4b0 0x7fbe0815c620 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbe040098f0 tx=0x7fbe04009c00 comp rx=0 tx=0).stop 2023-11-08T19:23:48.672 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.667+0000 7fbe0ffe4700 1 -- 172.21.15.149:0/678592357 shutdown_connections 2023-11-08T19:23:48.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.667+0000 7fbe0ffe4700 1 --2- 172.21.15.149:0/678592357 >> v2:172.21.15.160:3300/0 conn(0x7fbe080cc0d0 0x7fbe0815f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:48.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.667+0000 7fbe0ffe4700 1 --2- 172.21.15.149:0/678592357 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe080cc4b0 0x7fbe0815c620 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:48.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.667+0000 7fbe0ffe4700 1 -- 172.21.15.149:0/678592357 >> 172.21.15.149:0/678592357 conn(0x7fbe0806f120 msgr2=0x7fbe0806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:48.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.667+0000 7fbe0ffe4700 1 -- 172.21.15.149:0/678592357 shutdown_connections 2023-11-08T19:23:48.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.667+0000 7fbe0ffe4700 1 -- 172.21.15.149:0/678592357 wait complete. 2023-11-08T19:23:48.676 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.668+0000 7fbe0ffe4700 1 Processor -- start 2023-11-08T19:23:48.677 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.668+0000 7fbe0ffe4700 1 -- start start 2023-11-08T19:23:48.677 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.669+0000 7fbe0ffe4700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe080cc0d0 0x7fbe081f45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:48.677 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.669+0000 7fbe0ffe4700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe080cc4b0 0x7fbe081f3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:48.677 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.669+0000 7fbe0ffe4700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe0815cb60 0x7fbe081f73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:48.677 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.669+0000 7fbe0ffe4700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe080c6ec0 con 0x7fbe080cc4b0 2023-11-08T19:23:48.678 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.669+0000 7fbe0ffe4700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe081f7920 con 0x7fbe080cc0d0 2023-11-08T19:23:48.678 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.669+0000 7fbe0ffe4700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe081f3a10 con 0x7fbe0815cb60 2023-11-08T19:23:48.678 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.669+0000 7fbe0d57f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe080cc4b0 0x7fbe081f3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:48.678 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.669+0000 7fbe0d57f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe080cc4b0 0x7fbe081f3390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38326/0 (socket says 172.21.15.149:38326) 2023-11-08T19:23:48.679 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.669+0000 7fbe0d57f700 1 -- 172.21.15.149:0/511989031 learned_addr learned my addr 172.21.15.149:0/511989031 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:48.679 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.669+0000 7fbe0dd80700 1 --2- 172.21.15.149:0/511989031 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe080cc0d0 0x7fbe081f45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:48.679 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.669+0000 7fbe0e581700 1 --2- 172.21.15.149:0/511989031 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe0815cb60 0x7fbe081f73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:48.679 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.669+0000 7fbe0d57f700 1 -- 172.21.15.149:0/511989031 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe0815cb60 msgr2=0x7fbe081f73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:48.680 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.669+0000 7fbe0d57f700 1 --2- 172.21.15.149:0/511989031 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe0815cb60 0x7fbe081f73e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:48.680 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.669+0000 7fbe0d57f700 1 -- 172.21.15.149:0/511989031 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe080cc0d0 msgr2=0x7fbe081f45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:48.680 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.669+0000 7fbe0d57f700 1 --2- 172.21.15.149:0/511989031 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe080cc0d0 0x7fbe081f45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:48.680 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.669+0000 7fbe0d57f700 1 -- 172.21.15.149:0/511989031 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe04009550 con 0x7fbe080cc4b0 2023-11-08T19:23:48.680 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.669+0000 7fbe0d57f700 1 --2- 172.21.15.149:0/511989031 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe080cc4b0 0x7fbe081f3390 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fbe0815c030 tx=0x7fbe04004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:48.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.669+0000 7fbdfe7fc700 1 -- 172.21.15.149:0/511989031 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe04004340 con 0x7fbe080cc4b0 2023-11-08T19:23:48.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.669+0000 7fbdfe7fc700 1 -- 172.21.15.149:0/511989031 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe0401f070 con 0x7fbe080cc4b0 2023-11-08T19:23:48.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.669+0000 7fbe0ffe4700 1 -- 172.21.15.149:0/511989031 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe081f3cf0 con 0x7fbe080cc4b0 2023-11-08T19:23:48.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.669+0000 7fbdfe7fc700 1 -- 172.21.15.149:0/511989031 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe040036a0 con 0x7fbe080cc4b0 2023-11-08T19:23:48.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.670+0000 7fbe0ffe4700 1 -- 172.21.15.149:0/511989031 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe081f42b0 con 0x7fbe080cc4b0 2023-11-08T19:23:48.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.670+0000 7fbe0ffe4700 1 -- 172.21.15.149:0/511989031 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe080c7070 con 0x7fbe080cc4b0 2023-11-08T19:23:48.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.671+0000 7fbdfe7fc700 1 -- 172.21.15.149:0/511989031 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbe04021030 con 0x7fbe080cc4b0 2023-11-08T19:23:48.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.671+0000 7fbdfe7fc700 1 --2- 172.21.15.149:0/511989031 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fbdec06af00 0x7fbdec06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:48.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.671+0000 7fbe0dd80700 1 --2- 172.21.15.149:0/511989031 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fbdec06af00 0x7fbdec06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:48.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.671+0000 7fbdfe7fc700 1 -- 172.21.15.149:0/511989031 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbe0408ab70 con 0x7fbe080cc4b0 2023-11-08T19:23:48.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.672+0000 7fbe0dd80700 1 --2- 172.21.15.149:0/511989031 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fbdec06af00 0x7fbdec06d3c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8009be0 tx=0x7fbdf8009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:48.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.676+0000 7fbdfe7fc700 1 -- 172.21.15.149:0/511989031 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbe080c7070 con 0x7fbe080cc4b0 2023-11-08T19:23:48.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.865+0000 7fbe0ffe4700 1 -- 172.21.15.149:0/511989031 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbe080c7070 con 0x7fbe080cc4b0 2023-11-08T19:23:48.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.865+0000 7fbdfe7fc700 1 -- 172.21.15.149:0/511989031 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbe080c7070 con 0x7fbe080cc4b0 2023-11-08T19:23:48.867 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 1 2023-11-08T19:23:48.869 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.867+0000 7fbe0ffe4700 1 -- 172.21.15.149:0/511989031 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fbdec06af00 msgr2=0x7fbdec06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:48.869 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.867+0000 7fbe0ffe4700 1 --2- 172.21.15.149:0/511989031 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fbdec06af00 0x7fbdec06d3c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8009be0 tx=0x7fbdf8009210 comp rx=0 tx=0).stop 2023-11-08T19:23:48.869 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.867+0000 7fbe0ffe4700 1 -- 172.21.15.149:0/511989031 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe080cc4b0 msgr2=0x7fbe081f3390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:48.870 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.867+0000 7fbe0ffe4700 1 --2- 172.21.15.149:0/511989031 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe080cc4b0 0x7fbe081f3390 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fbe0815c030 tx=0x7fbe04004750 comp rx=0 tx=0).stop 2023-11-08T19:23:48.870 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.867+0000 7fbe0ffe4700 1 -- 172.21.15.149:0/511989031 shutdown_connections 2023-11-08T19:23:48.870 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.867+0000 7fbe0ffe4700 1 --2- 172.21.15.149:0/511989031 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fbdec06af00 0x7fbdec06d3c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:48.870 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.867+0000 7fbe0ffe4700 1 --2- 172.21.15.149:0/511989031 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe080cc0d0 0x7fbe081f45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:48.870 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.867+0000 7fbe0ffe4700 1 --2- 172.21.15.149:0/511989031 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe0815cb60 0x7fbe081f73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:48.871 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.867+0000 7fbe0ffe4700 1 --2- 172.21.15.149:0/511989031 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe080cc4b0 0x7fbe081f3390 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:48.871 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.867+0000 7fbe0ffe4700 1 -- 172.21.15.149:0/511989031 >> 172.21.15.149:0/511989031 conn(0x7fbe0806f120 msgr2=0x7fbe080b4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:48.871 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.867+0000 7fbe0ffe4700 1 -- 172.21.15.149:0/511989031 shutdown_connections 2023-11-08T19:23:48.871 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:48.868+0000 7fbe0ffe4700 1 -- 172.21.15.149:0/511989031 wait complete. 2023-11-08T19:23:48.881 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-08T19:23:49.005 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.004+0000 7f3f49ffe700 1 Processor -- start 2023-11-08T19:23:49.006 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.004+0000 7f3f49ffe700 1 -- start start 2023-11-08T19:23:49.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.005+0000 7f3f49ffe700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f3f4406ab80 0x7f3f440caf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:49.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.005+0000 7f3f49ffe700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f4415e320 con 0x7f3f4415df40 2023-11-08T19:23:49.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.005+0000 7f3f49ffe700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f4406b020 con 0x7f3f440cf1c0 2023-11-08T19:23:49.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.005+0000 7f3f49ffe700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f4406b2e0 con 0x7f3f4406ab80 2023-11-08T19:23:49.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.005+0000 7f3f437fe700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f3f4415df40 0x7f3f4406c0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:40334/0 (socket says 172.21.15.149:40334) 2023-11-08T19:23:49.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.005+0000 7f3f437fe700 1 -- 172.21.15.149:0/1269516160 learned_addr learned my addr 172.21.15.149:0/1269516160 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:23:49.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.005+0000 7f3f42ffd700 1 --2- 172.21.15.149:0/1269516160 >> v2:172.21.15.160:3300/0 conn(0x7f3f4406ab80 0x7f3f440caf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:49.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.005+0000 7f3f427fc700 1 -- 172.21.15.149:0/1269516160 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1165851230 0 0) 0x7f3f4415e320 con 0x7f3f4415df40 2023-11-08T19:23:49.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.005+0000 7f3f427fc700 1 -- 172.21.15.149:0/1269516160 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f2c0035b0 con 0x7f3f4415df40 2023-11-08T19:23:49.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.006+0000 7f3f427fc700 1 -- 172.21.15.149:0/1269516160 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3229068273 0 0) 0x7f3f2c0035b0 con 0x7f3f4415df40 2023-11-08T19:23:49.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.006+0000 7f3f427fc700 1 -- 172.21.15.149:0/1269516160 >> v2:172.21.15.160:3300/0 conn(0x7f3f4406ab80 msgr2=0x7f3f440caf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:49.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.006+0000 7f3f427fc700 1 --2- 172.21.15.149:0/1269516160 >> v2:172.21.15.160:3300/0 conn(0x7f3f4406ab80 0x7f3f440caf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:49.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.006+0000 7f3f427fc700 1 -- 172.21.15.149:0/1269516160 >> v1:172.21.15.160:6789/0 conn(0x7f3f440cf1c0 legacy=0x7f3f440ce540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:49.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.006+0000 7f3f427fc700 1 -- 172.21.15.149:0/1269516160 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f4406b5c0 con 0x7f3f4415df40 2023-11-08T19:23:49.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.006+0000 7f3f427fc700 1 -- 172.21.15.149:0/1269516160 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f3f38001670 con 0x7f3f4415df40 2023-11-08T19:23:49.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.006+0000 7f3f427fc700 1 -- 172.21.15.149:0/1269516160 >> v1:172.21.15.149:6789/0 conn(0x7f3f4415df40 legacy=0x7f3f4406c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:49.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.006+0000 7f3f427fc700 1 --2- 172.21.15.149:0/1269516160 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f2c003a70 0x7f3f2c003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:49.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.006+0000 7f3f427fc700 1 --2- 172.21.15.149:0/1269516160 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f2c004850 0x7f3f2c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:49.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.006+0000 7f3f427fc700 1 --2- 172.21.15.149:0/1269516160 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3f2c005210 0x7f3f2c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:49.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.006+0000 7f3f427fc700 1 -- 172.21.15.149:0/1269516160 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4406b2e0 con 0x7f3f2c003a70 2023-11-08T19:23:49.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.006+0000 7f3f427fc700 1 -- 172.21.15.149:0/1269516160 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2c00c140 con 0x7f3f2c004850 2023-11-08T19:23:49.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.006+0000 7f3f427fc700 1 -- 172.21.15.149:0/1269516160 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2c00c300 con 0x7f3f2c005210 2023-11-08T19:23:49.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.006+0000 7f3f437fe700 1 --2- 172.21.15.149:0/1269516160 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f2c003a70 0x7f3f2c003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:49.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.006+0000 7f3f42ffd700 1 --2- 172.21.15.149:0/1269516160 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f2c004850 0x7f3f2c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:49.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.006+0000 7f3f43fff700 1 --2- 172.21.15.149:0/1269516160 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3f2c005210 0x7f3f2c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:49.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.006+0000 7f3f437fe700 1 -- 172.21.15.149:0/1269516160 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3f2c005210 msgr2=0x7f3f2c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:49.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.006+0000 7f3f437fe700 1 --2- 172.21.15.149:0/1269516160 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3f2c005210 0x7f3f2c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:49.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.006+0000 7f3f437fe700 1 -- 172.21.15.149:0/1269516160 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f2c004850 msgr2=0x7f3f2c004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:49.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.006+0000 7f3f437fe700 1 --2- 172.21.15.149:0/1269516160 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f2c004850 0x7f3f2c004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:49.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.006+0000 7f3f437fe700 1 -- 172.21.15.149:0/1269516160 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f2c0035b0 con 0x7f3f2c003a70 2023-11-08T19:23:49.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.006+0000 7f3f43fff700 1 -- 172.21.15.149:0/1269516160 reap_dead start 2023-11-08T19:23:49.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.006+0000 7f3f42ffd700 1 --2- 172.21.15.149:0/1269516160 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f2c004850 0x7f3f2c004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:23:49.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.006+0000 7f3f437fe700 1 --2- 172.21.15.149:0/1269516160 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f2c003a70 0x7f3f2c003e90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3f3800c240 tx=0x7f3f2c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40c95027be36aaf8 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:49.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.006+0000 7f3f427fc700 1 -- 172.21.15.149:0/1269516160 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f38007c10 con 0x7f3f2c003a70 2023-11-08T19:23:49.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.006+0000 7f3f427fc700 1 -- 172.21.15.149:0/1269516160 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f3800cde0 con 0x7f3f2c003a70 2023-11-08T19:23:49.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.006+0000 7f3f427fc700 1 -- 172.21.15.149:0/1269516160 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f38005ba0 con 0x7f3f2c003a70 2023-11-08T19:23:49.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.007+0000 7f3f49ffe700 1 -- 172.21.15.149:0/1269516160 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f2c003a70 msgr2=0x7f3f2c003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:49.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.007+0000 7f3f49ffe700 1 --2- 172.21.15.149:0/1269516160 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f2c003a70 0x7f3f2c003e90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3f3800c240 tx=0x7f3f2c005880 comp rx=0 tx=0).stop 2023-11-08T19:23:49.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.007+0000 7f3f49ffe700 1 -- 172.21.15.149:0/1269516160 shutdown_connections 2023-11-08T19:23:49.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.007+0000 7f3f49ffe700 1 --2- 172.21.15.149:0/1269516160 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f2c003a70 0x7f3f2c003e90 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:49.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.007+0000 7f3f49ffe700 1 -- 172.21.15.149:0/1269516160 >> 172.21.15.149:0/1269516160 conn(0x7f3f440d0640 msgr2=0x7f3f440d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:49.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.007+0000 7f3f49ffe700 1 -- 172.21.15.149:0/1269516160 shutdown_connections 2023-11-08T19:23:49.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.007+0000 7f3f49ffe700 1 -- 172.21.15.149:0/1269516160 wait complete. 2023-11-08T19:23:49.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.008+0000 7f3f49ffe700 1 Processor -- start 2023-11-08T19:23:49.018 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.008+0000 7f3f49ffe700 1 -- start start 2023-11-08T19:23:49.020 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.009+0000 7f3f49ffe700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3f2c003a70 0x7f3f441f6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:49.020 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.009+0000 7f3f49ffe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f440c9960 0x7f3f440cc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:49.020 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.009+0000 7f3f49ffe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f440acdf0 0x7f3f441576b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:49.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.009+0000 7f3f49ffe700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f441f7ce0 con 0x7f3f440acdf0 2023-11-08T19:23:49.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.009+0000 7f3f49ffe700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f441f7440 con 0x7f3f440c9960 2023-11-08T19:23:49.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.009+0000 7f3f49ffe700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f441f7720 con 0x7f3f2c003a70 2023-11-08T19:23:49.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.009+0000 7f3f43fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f440acdf0 0x7f3f441576b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:49.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.009+0000 7f3f43fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f440acdf0 0x7f3f441576b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38348/0 (socket says 172.21.15.149:38348) 2023-11-08T19:23:49.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.009+0000 7f3f43fff700 1 -- 172.21.15.149:0/3430370429 learned_addr learned my addr 172.21.15.149:0/3430370429 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:49.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.009+0000 7f3f437fe700 1 --2- 172.21.15.149:0/3430370429 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3f2c003a70 0x7f3f441f6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:49.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.009+0000 7f3f42ffd700 1 --2- 172.21.15.149:0/3430370429 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f440c9960 0x7f3f440cc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:49.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.009+0000 7f3f43fff700 1 -- 172.21.15.149:0/3430370429 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3f2c003a70 msgr2=0x7f3f441f6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:49.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.009+0000 7f3f43fff700 1 --2- 172.21.15.149:0/3430370429 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3f2c003a70 0x7f3f441f6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:49.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.009+0000 7f3f43fff700 1 -- 172.21.15.149:0/3430370429 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f440c9960 msgr2=0x7f3f440cc3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:49.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.009+0000 7f3f43fff700 1 --2- 172.21.15.149:0/3430370429 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f440c9960 0x7f3f440cc3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:49.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.009+0000 7f3f43fff700 1 -- 172.21.15.149:0/3430370429 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f441f7a00 con 0x7f3f440acdf0 2023-11-08T19:23:49.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.010+0000 7f3f43fff700 1 --2- 172.21.15.149:0/3430370429 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f440acdf0 0x7f3f441576b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3f44075090 tx=0x7f3f3c00edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:49.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.010+0000 7f3f2bfff700 1 -- 172.21.15.149:0/3430370429 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c003c10 con 0x7f3f440acdf0 2023-11-08T19:23:49.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.010+0000 7f3f2bfff700 1 -- 172.21.15.149:0/3430370429 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f3c003d70 con 0x7f3f440acdf0 2023-11-08T19:23:49.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.010+0000 7f3f49ffe700 1 -- 172.21.15.149:0/3430370429 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f44159a20 con 0x7f3f440acdf0 2023-11-08T19:23:49.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.010+0000 7f3f2bfff700 1 -- 172.21.15.149:0/3430370429 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c005310 con 0x7f3f440acdf0 2023-11-08T19:23:49.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.010+0000 7f3f49ffe700 1 -- 172.21.15.149:0/3430370429 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f440cc8e0 con 0x7f3f440acdf0 2023-11-08T19:23:49.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.011+0000 7f3f49ffe700 1 -- 172.21.15.149:0/3430370429 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f4404f730 con 0x7f3f440acdf0 2023-11-08T19:23:49.025 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.011+0000 7f3f2bfff700 1 -- 172.21.15.149:0/3430370429 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3f3c005470 con 0x7f3f440acdf0 2023-11-08T19:23:49.025 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.012+0000 7f3f2bfff700 1 --2- 172.21.15.149:0/3430370429 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3f3006af00 0x7f3f3006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:49.025 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.012+0000 7f3f437fe700 1 --2- 172.21.15.149:0/3430370429 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3f3006af00 0x7f3f3006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:49.025 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.012+0000 7f3f2bfff700 1 -- 172.21.15.149:0/3430370429 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3f3c089700 con 0x7f3f440acdf0 2023-11-08T19:23:49.025 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.012+0000 7f3f437fe700 1 --2- 172.21.15.149:0/3430370429 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3f3006af00 0x7f3f3006d3c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3f38000c00 tx=0x7f3f38007000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:49.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.017+0000 7f3f2bfff700 1 -- 172.21.15.149:0/3430370429 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3f3c054550 con 0x7f3f440acdf0 2023-11-08T19:23:49.207 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.206+0000 7f3f49ffe700 1 -- 172.21.15.149:0/3430370429 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3f441589d0 con 0x7f3f440acdf0 2023-11-08T19:23:49.207 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.206+0000 7f3f2bfff700 1 -- 172.21.15.149:0/3430370429 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3f3c057b70 con 0x7f3f440acdf0 2023-11-08T19:23:49.208 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:23:49.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.208+0000 7f3f49ffe700 1 -- 172.21.15.149:0/3430370429 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3f3006af00 msgr2=0x7f3f3006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:49.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.208+0000 7f3f49ffe700 1 --2- 172.21.15.149:0/3430370429 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3f3006af00 0x7f3f3006d3c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3f38000c00 tx=0x7f3f38007000 comp rx=0 tx=0).stop 2023-11-08T19:23:49.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.208+0000 7f3f49ffe700 1 -- 172.21.15.149:0/3430370429 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f440acdf0 msgr2=0x7f3f441576b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:49.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.208+0000 7f3f49ffe700 1 --2- 172.21.15.149:0/3430370429 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f440acdf0 0x7f3f441576b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3f44075090 tx=0x7f3f3c00edd0 comp rx=0 tx=0).stop 2023-11-08T19:23:49.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.208+0000 7f3f49ffe700 1 -- 172.21.15.149:0/3430370429 shutdown_connections 2023-11-08T19:23:49.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.208+0000 7f3f49ffe700 1 --2- 172.21.15.149:0/3430370429 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3f3006af00 0x7f3f3006d3c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:49.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.208+0000 7f3f49ffe700 1 --2- 172.21.15.149:0/3430370429 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f440acdf0 0x7f3f441576b0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:49.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.208+0000 7f3f49ffe700 1 --2- 172.21.15.149:0/3430370429 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3f2c003a70 0x7f3f441f6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:49.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.208+0000 7f3f49ffe700 1 --2- 172.21.15.149:0/3430370429 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f440c9960 0x7f3f440cc3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:49.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.208+0000 7f3f49ffe700 1 -- 172.21.15.149:0/3430370429 >> 172.21.15.149:0/3430370429 conn(0x7f3f440d0640 msgr2=0x7f3f440cb1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:49.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.208+0000 7f3f49ffe700 1 -- 172.21.15.149:0/3430370429 shutdown_connections 2023-11-08T19:23:49.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.208+0000 7f3f49ffe700 1 -- 172.21.15.149:0/3430370429 wait complete. 2023-11-08T19:23:49.222 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-08T19:23:49.346 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.345+0000 7f295e2f1700 1 Processor -- start 2023-11-08T19:23:49.347 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.345+0000 7f295e2f1700 1 -- start start 2023-11-08T19:23:49.350 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.346+0000 7f295e2f1700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f29580cb660 0x7f29580ce540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:49.351 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.346+0000 7f295e2f1700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f295815e320 con 0x7f295815df40 2023-11-08T19:23:49.351 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.346+0000 7f295e2f1700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f295806b020 con 0x7f295806ab80 2023-11-08T19:23:49.351 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.346+0000 7f295e2f1700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f295806b2e0 con 0x7f29580cb660 2023-11-08T19:23:49.351 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.346+0000 7f2957fff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f295815df40 0x7f295806c0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:40354/0 (socket says 172.21.15.149:40354) 2023-11-08T19:23:49.351 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.346+0000 7f2957fff700 1 -- 172.21.15.149:0/3318748914 learned_addr learned my addr 172.21.15.149:0/3318748914 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:23:49.352 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.346+0000 7f295c88e700 1 --2- 172.21.15.149:0/3318748914 >> v2:172.21.15.160:3300/0 conn(0x7f29580cb660 0x7f29580ce540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:49.352 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.346+0000 7f29577fe700 1 -- 172.21.15.149:0/3318748914 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1351264835 0 0) 0x7f295815e320 con 0x7f295815df40 2023-11-08T19:23:49.352 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.346+0000 7f29577fe700 1 -- 172.21.15.149:0/3318748914 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29440035b0 con 0x7f295815df40 2023-11-08T19:23:49.352 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.347+0000 7f29577fe700 1 -- 172.21.15.149:0/3318748914 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2303840729 0 0) 0x7f29440035b0 con 0x7f295815df40 2023-11-08T19:23:49.352 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.347+0000 7f29577fe700 1 -- 172.21.15.149:0/3318748914 >> v2:172.21.15.160:3300/0 conn(0x7f29580cb660 msgr2=0x7f29580ce540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:49.353 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.347+0000 7f29577fe700 1 --2- 172.21.15.149:0/3318748914 >> v2:172.21.15.160:3300/0 conn(0x7f29580cb660 0x7f29580ce540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:49.353 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.347+0000 7f29577fe700 1 -- 172.21.15.149:0/3318748914 >> v1:172.21.15.160:6789/0 conn(0x7f295806ab80 legacy=0x7f29580caf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:49.353 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.347+0000 7f29577fe700 1 -- 172.21.15.149:0/3318748914 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f295806b5c0 con 0x7f295815df40 2023-11-08T19:23:49.353 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.347+0000 7f29577fe700 1 -- 172.21.15.149:0/3318748914 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f2948001670 con 0x7f295815df40 2023-11-08T19:23:49.353 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.347+0000 7f29577fe700 1 -- 172.21.15.149:0/3318748914 >> v1:172.21.15.149:6789/0 conn(0x7f295815df40 legacy=0x7f295806c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:49.354 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.347+0000 7f29577fe700 1 --2- 172.21.15.149:0/3318748914 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2944003a70 0x7f2944003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:49.354 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.347+0000 7f29577fe700 1 --2- 172.21.15.149:0/3318748914 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2944004850 0x7f2944004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:49.354 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.347+0000 7f29577fe700 1 --2- 172.21.15.149:0/3318748914 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2944005210 0x7f294400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:49.354 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.347+0000 7f29577fe700 1 -- 172.21.15.149:0/3318748914 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f295806b2e0 con 0x7f2944003a70 2023-11-08T19:23:49.354 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.347+0000 7f29577fe700 1 -- 172.21.15.149:0/3318748914 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f294400c090 con 0x7f2944004850 2023-11-08T19:23:49.355 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.347+0000 7f29577fe700 1 -- 172.21.15.149:0/3318748914 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f294400c250 con 0x7f2944005210 2023-11-08T19:23:49.355 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.347+0000 7f2957fff700 1 --2- 172.21.15.149:0/3318748914 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2944003a70 0x7f2944003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:49.355 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.347+0000 7f295c88e700 1 --2- 172.21.15.149:0/3318748914 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2944005210 0x7f294400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:49.355 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.347+0000 7f294ffff700 1 --2- 172.21.15.149:0/3318748914 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2944004850 0x7f2944004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:49.355 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.347+0000 7f2957fff700 1 -- 172.21.15.149:0/3318748914 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2944005210 msgr2=0x7f294400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:49.356 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.347+0000 7f2957fff700 1 --2- 172.21.15.149:0/3318748914 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2944005210 0x7f294400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:49.356 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.347+0000 7f2957fff700 1 -- 172.21.15.149:0/3318748914 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2944004850 msgr2=0x7f2944004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:49.356 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.347+0000 7f2957fff700 1 --2- 172.21.15.149:0/3318748914 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2944004850 0x7f2944004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:49.356 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.347+0000 7f2957fff700 1 -- 172.21.15.149:0/3318748914 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29440035b0 con 0x7f2944003a70 2023-11-08T19:23:49.356 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.347+0000 7f295c88e700 1 --2- 172.21.15.149:0/3318748914 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2944005210 0x7f294400ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:23:49.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.347+0000 7f294ffff700 1 --2- 172.21.15.149:0/3318748914 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2944004850 0x7f2944004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:23:49.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.347+0000 7f295c88e700 1 -- 172.21.15.149:0/3318748914 reap_dead start 2023-11-08T19:23:49.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.347+0000 7f2957fff700 1 --2- 172.21.15.149:0/3318748914 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2944003a70 0x7f2944003e50 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f294800c2f0 tx=0x7f2944005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2365354105b7a65 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:49.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.347+0000 7f29577fe700 1 -- 172.21.15.149:0/3318748914 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f294800ce30 con 0x7f2944003a70 2023-11-08T19:23:49.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.347+0000 7f29577fe700 1 -- 172.21.15.149:0/3318748914 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2948005960 con 0x7f2944003a70 2023-11-08T19:23:49.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.347+0000 7f29577fe700 1 -- 172.21.15.149:0/3318748914 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2948005cf0 con 0x7f2944003a70 2023-11-08T19:23:49.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.348+0000 7f295e2f1700 1 -- 172.21.15.149:0/3318748914 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2944003a70 msgr2=0x7f2944003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:49.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.348+0000 7f295e2f1700 1 --2- 172.21.15.149:0/3318748914 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2944003a70 0x7f2944003e50 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f294800c2f0 tx=0x7f2944005880 comp rx=0 tx=0).stop 2023-11-08T19:23:49.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.348+0000 7f295e2f1700 1 -- 172.21.15.149:0/3318748914 shutdown_connections 2023-11-08T19:23:49.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.348+0000 7f295e2f1700 1 --2- 172.21.15.149:0/3318748914 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2944003a70 0x7f2944003e50 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:49.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.348+0000 7f295e2f1700 1 -- 172.21.15.149:0/3318748914 >> 172.21.15.149:0/3318748914 conn(0x7f29580d0640 msgr2=0x7f29580d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:49.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.348+0000 7f295e2f1700 1 -- 172.21.15.149:0/3318748914 shutdown_connections 2023-11-08T19:23:49.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.348+0000 7f295e2f1700 1 -- 172.21.15.149:0/3318748914 wait complete. 2023-11-08T19:23:49.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.349+0000 7f295e2f1700 1 Processor -- start 2023-11-08T19:23:49.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.349+0000 7f295e2f1700 1 -- start start 2023-11-08T19:23:49.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.350+0000 7f295e2f1700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2944003a70 0x7f29580aeec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:49.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.350+0000 7f295e2f1700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f29581603d0 0x7f2958155b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:49.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.350+0000 7f295e2f1700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2958160850 0x7f29581560b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:49.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.350+0000 7f295e2f1700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29580ad700 con 0x7f2944003a70 2023-11-08T19:23:49.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.350+0000 7f295e2f1700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f295815f610 con 0x7f2958160850 2023-11-08T19:23:49.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.350+0000 7f295e2f1700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f295815f8f0 con 0x7f29581603d0 2023-11-08T19:23:49.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.350+0000 7f2957fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2944003a70 0x7f29580aeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:49.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.350+0000 7f2957fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2944003a70 0x7f29580aeec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38362/0 (socket says 172.21.15.149:38362) 2023-11-08T19:23:49.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.350+0000 7f2957fff700 1 -- 172.21.15.149:0/2438957478 learned_addr learned my addr 172.21.15.149:0/2438957478 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:49.364 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.350+0000 7f295c88e700 1 --2- 172.21.15.149:0/2438957478 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2958160850 0x7f29581560b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:49.364 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.350+0000 7f294ffff700 1 --2- 172.21.15.149:0/2438957478 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f29581603d0 0x7f2958155b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:49.364 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.350+0000 7f2957fff700 1 -- 172.21.15.149:0/2438957478 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f29581603d0 msgr2=0x7f2958155b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:49.364 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.350+0000 7f2957fff700 1 --2- 172.21.15.149:0/2438957478 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f29581603d0 0x7f2958155b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:49.364 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.350+0000 7f2957fff700 1 -- 172.21.15.149:0/2438957478 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2958160850 msgr2=0x7f29581560b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:49.365 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.350+0000 7f2957fff700 1 --2- 172.21.15.149:0/2438957478 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2958160850 0x7f29581560b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:49.365 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.351+0000 7f2957fff700 1 -- 172.21.15.149:0/2438957478 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f295815fbd0 con 0x7f2944003a70 2023-11-08T19:23:49.365 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.351+0000 7f294ffff700 1 --2- 172.21.15.149:0/2438957478 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f29581603d0 0x7f2958155b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:23:49.365 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.351+0000 7f2957fff700 1 --2- 172.21.15.149:0/2438957478 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2944003a70 0x7f29580aeec0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2948000c00 tx=0x7f2948001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:49.366 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.352+0000 7f29557fa700 1 -- 172.21.15.149:0/2438957478 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2948007ba0 con 0x7f2944003a70 2023-11-08T19:23:49.366 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.352+0000 7f29557fa700 1 -- 172.21.15.149:0/2438957478 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2948001640 con 0x7f2944003a70 2023-11-08T19:23:49.366 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.352+0000 7f295e2f1700 1 -- 172.21.15.149:0/2438957478 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f295815feb0 con 0x7f2944003a70 2023-11-08T19:23:49.366 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.352+0000 7f29557fa700 1 -- 172.21.15.149:0/2438957478 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2948004ab0 con 0x7f2944003a70 2023-11-08T19:23:49.366 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.352+0000 7f295e2f1700 1 -- 172.21.15.149:0/2438957478 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29580af5e0 con 0x7f2944003a70 2023-11-08T19:23:49.367 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.353+0000 7f295e2f1700 1 -- 172.21.15.149:0/2438957478 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2958160220 con 0x7f2944003a70 2023-11-08T19:23:49.367 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.354+0000 7f29557fa700 1 -- 172.21.15.149:0/2438957478 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2948004c10 con 0x7f2944003a70 2023-11-08T19:23:49.367 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.354+0000 7f29557fa700 1 --2- 172.21.15.149:0/2438957478 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f293806af00 0x7f293806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:49.367 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.354+0000 7f29557fa700 1 -- 172.21.15.149:0/2438957478 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f294808a570 con 0x7f2944003a70 2023-11-08T19:23:49.367 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.354+0000 7f294ffff700 1 --2- 172.21.15.149:0/2438957478 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f293806af00 0x7f293806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:49.368 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.354+0000 7f294ffff700 1 --2- 172.21.15.149:0/2438957478 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f293806af00 0x7f293806d3c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f29580af930 tx=0x7f2940009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:49.368 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.359+0000 7f29557fa700 1 -- 172.21.15.149:0/2438957478 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f29480553c0 con 0x7f2944003a70 2023-11-08T19:23:49.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.549+0000 7f295e2f1700 1 -- 172.21.15.149:0/2438957478 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f29580c3e00 con 0x7f2944003a70 2023-11-08T19:23:49.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.549+0000 7f29557fa700 1 -- 172.21.15.149:0/2438957478 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2948028ed0 con 0x7f2944003a70 2023-11-08T19:23:49.551 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 64 2023-11-08T19:23:49.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.551+0000 7f295e2f1700 1 -- 172.21.15.149:0/2438957478 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f293806af00 msgr2=0x7f293806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:49.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.551+0000 7f295e2f1700 1 --2- 172.21.15.149:0/2438957478 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f293806af00 0x7f293806d3c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f29580af930 tx=0x7f2940009040 comp rx=0 tx=0).stop 2023-11-08T19:23:49.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.551+0000 7f295e2f1700 1 -- 172.21.15.149:0/2438957478 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2944003a70 msgr2=0x7f29580aeec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:49.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.551+0000 7f295e2f1700 1 --2- 172.21.15.149:0/2438957478 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2944003a70 0x7f29580aeec0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2948000c00 tx=0x7f2948001a00 comp rx=0 tx=0).stop 2023-11-08T19:23:49.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.552+0000 7f295e2f1700 1 -- 172.21.15.149:0/2438957478 shutdown_connections 2023-11-08T19:23:49.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.552+0000 7f295e2f1700 1 --2- 172.21.15.149:0/2438957478 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f293806af00 0x7f293806d3c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:49.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.552+0000 7f295e2f1700 1 --2- 172.21.15.149:0/2438957478 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2958160850 0x7f29581560b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:49.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.552+0000 7f295e2f1700 1 --2- 172.21.15.149:0/2438957478 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2944003a70 0x7f29580aeec0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:49.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.552+0000 7f295e2f1700 1 --2- 172.21.15.149:0/2438957478 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f29581603d0 0x7f2958155b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:49.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.552+0000 7f295e2f1700 1 -- 172.21.15.149:0/2438957478 >> 172.21.15.149:0/2438957478 conn(0x7f29580d0640 msgr2=0x7f29580b0350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:49.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.552+0000 7f295e2f1700 1 -- 172.21.15.149:0/2438957478 shutdown_connections 2023-11-08T19:23:49.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.552+0000 7f295e2f1700 1 -- 172.21.15.149:0/2438957478 wait complete. 2023-11-08T19:23:49.565 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-08T19:23:49.688 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.687+0000 7ff07f278700 1 Processor -- start 2023-11-08T19:23:49.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.687+0000 7ff07f278700 1 -- start start 2023-11-08T19:23:49.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.688+0000 7ff07f278700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff07815df40 0x7ff07806c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:49.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.688+0000 7ff07f278700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7ff0780cb660 0x7ff07806c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:49.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.688+0000 7ff07f278700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff07815e320 con 0x7ff07806ab80 2023-11-08T19:23:49.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.688+0000 7ff07f278700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff07806b020 con 0x7ff07815df40 2023-11-08T19:23:49.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.688+0000 7ff07f278700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff07806b2e0 con 0x7ff0780cb660 2023-11-08T19:23:49.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.688+0000 7ff07d014700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff07815df40 0x7ff07806c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:49.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.688+0000 7ff07c813700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7ff07806ab80 0x7ff0780caf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:40372/0 (socket says 172.21.15.149:40372) 2023-11-08T19:23:49.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.688+0000 7ff07c813700 1 -- 172.21.15.149:0/3527159796 learned_addr learned my addr 172.21.15.149:0/3527159796 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:23:49.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.688+0000 7ff07d815700 1 --2- 172.21.15.149:0/3527159796 >> v2:172.21.15.160:3300/0 conn(0x7ff0780cb660 0x7ff07806c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:49.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.688+0000 7ff07d014700 1 -- 172.21.15.149:0/3527159796 >> v2:172.21.15.160:3300/0 conn(0x7ff0780cb660 msgr2=0x7ff07806c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:49.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.688+0000 7ff07d014700 1 --2- 172.21.15.149:0/3527159796 >> v2:172.21.15.160:3300/0 conn(0x7ff0780cb660 0x7ff07806c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:49.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.688+0000 7ff07d014700 1 -- 172.21.15.149:0/3527159796 >> v1:172.21.15.149:6789/0 conn(0x7ff07806ab80 legacy=0x7ff0780caf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:49.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.688+0000 7ff07d014700 1 -- 172.21.15.149:0/3527159796 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff07806b5c0 con 0x7ff07815df40 2023-11-08T19:23:49.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.688+0000 7ff06ffff700 1 -- 172.21.15.149:0/3527159796 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1356633367 0 0) 0x7ff07815e320 con 0x7ff07806ab80 2023-11-08T19:23:49.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.689+0000 7ff07d014700 1 --2- 172.21.15.149:0/3527159796 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff07815df40 0x7ff07806c0a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff0780b2180 tx=0x7ff068009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d313912106ef3f8a server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:49.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.689+0000 7ff06ffff700 1 -- 172.21.15.149:0/3527159796 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff068011830 con 0x7ff07815df40 2023-11-08T19:23:49.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.689+0000 7ff06ffff700 1 -- 172.21.15.149:0/3527159796 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff068011990 con 0x7ff07815df40 2023-11-08T19:23:49.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.689+0000 7ff06ffff700 1 -- 172.21.15.149:0/3527159796 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff068011d20 con 0x7ff07815df40 2023-11-08T19:23:49.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.689+0000 7ff07f278700 1 -- 172.21.15.149:0/3527159796 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff07815df40 msgr2=0x7ff07806c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:49.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.689+0000 7ff07f278700 1 --2- 172.21.15.149:0/3527159796 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff07815df40 0x7ff07806c0a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff0780b2180 tx=0x7ff068009b20 comp rx=0 tx=0).stop 2023-11-08T19:23:49.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.689+0000 7ff07f278700 1 -- 172.21.15.149:0/3527159796 shutdown_connections 2023-11-08T19:23:49.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.689+0000 7ff07f278700 1 --2- 172.21.15.149:0/3527159796 >> v2:172.21.15.160:3300/0 conn(0x7ff0780cb660 0x7ff07806c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:49.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.689+0000 7ff07f278700 1 --2- 172.21.15.149:0/3527159796 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff07815df40 0x7ff07806c0a0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:49.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.689+0000 7ff07f278700 1 -- 172.21.15.149:0/3527159796 >> 172.21.15.149:0/3527159796 conn(0x7ff0780d0640 msgr2=0x7ff0780d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:49.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.689+0000 7ff07f278700 1 -- 172.21.15.149:0/3527159796 shutdown_connections 2023-11-08T19:23:49.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.689+0000 7ff07f278700 1 -- 172.21.15.149:0/3527159796 wait complete. 2023-11-08T19:23:49.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.691+0000 7ff07f278700 1 Processor -- start 2023-11-08T19:23:49.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.691+0000 7ff07f278700 1 -- start start 2023-11-08T19:23:49.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.691+0000 7ff07f278700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff07806ab80 0x7ff0780adb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:49.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.691+0000 7ff07f278700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0780cb660 0x7ff07815a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:49.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.691+0000 7ff07f278700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff07815df40 0x7ff0781569d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:49.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.691+0000 7ff07f278700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0780c42f0 con 0x7ff0780cb660 2023-11-08T19:23:49.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.691+0000 7ff07f278700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0780c45d0 con 0x7ff07806ab80 2023-11-08T19:23:49.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.691+0000 7ff07f278700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0780c48b0 con 0x7ff07815df40 2023-11-08T19:23:49.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.691+0000 7ff07c813700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0780cb660 0x7ff07815a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:49.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.691+0000 7ff07c813700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0780cb660 0x7ff07815a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38378/0 (socket says 172.21.15.149:38378) 2023-11-08T19:23:49.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.691+0000 7ff07c813700 1 -- 172.21.15.149:0/3362424126 learned_addr learned my addr 172.21.15.149:0/3362424126 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:49.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.692+0000 7ff07d014700 1 --2- 172.21.15.149:0/3362424126 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff07806ab80 0x7ff0780adb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:49.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.692+0000 7ff07d815700 1 --2- 172.21.15.149:0/3362424126 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff07815df40 0x7ff0781569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:49.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.692+0000 7ff07c813700 1 -- 172.21.15.149:0/3362424126 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff07815df40 msgr2=0x7ff0781569d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:49.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.692+0000 7ff07c813700 1 --2- 172.21.15.149:0/3362424126 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff07815df40 0x7ff0781569d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:49.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.692+0000 7ff07c813700 1 -- 172.21.15.149:0/3362424126 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff07806ab80 msgr2=0x7ff0780adb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:49.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.692+0000 7ff07c813700 1 --2- 172.21.15.149:0/3362424126 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff07806ab80 0x7ff0780adb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:49.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.692+0000 7ff07c813700 1 -- 172.21.15.149:0/3362424126 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0680094a0 con 0x7ff0780cb660 2023-11-08T19:23:49.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.692+0000 7ff07c813700 1 --2- 172.21.15.149:0/3362424126 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0780cb660 0x7ff07815a320 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff0740011e0 tx=0x7ff07400ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:49.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.692+0000 7ff06dffb700 1 -- 172.21.15.149:0/3362424126 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff074004c80 con 0x7ff0780cb660 2023-11-08T19:23:49.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.692+0000 7ff06dffb700 1 -- 172.21.15.149:0/3362424126 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff074004e00 con 0x7ff0780cb660 2023-11-08T19:23:49.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.692+0000 7ff07f278700 1 -- 172.21.15.149:0/3362424126 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0780c4b90 con 0x7ff0780cb660 2023-11-08T19:23:49.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.692+0000 7ff06dffb700 1 -- 172.21.15.149:0/3362424126 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff074007310 con 0x7ff0780cb660 2023-11-08T19:23:49.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.692+0000 7ff07f278700 1 -- 172.21.15.149:0/3362424126 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0780ae0c0 con 0x7ff0780cb660 2023-11-08T19:23:49.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.693+0000 7ff07f278700 1 -- 172.21.15.149:0/3362424126 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff07804f730 con 0x7ff0780cb660 2023-11-08T19:23:49.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.693+0000 7ff06dffb700 1 -- 172.21.15.149:0/3362424126 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff074007470 con 0x7ff0780cb660 2023-11-08T19:23:49.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.694+0000 7ff06dffb700 1 --2- 172.21.15.149:0/3362424126 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff05c06af00 0x7ff05c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:49.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.694+0000 7ff07d014700 1 --2- 172.21.15.149:0/3362424126 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff05c06af00 0x7ff05c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:49.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.694+0000 7ff06dffb700 1 -- 172.21.15.149:0/3362424126 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff074089470 con 0x7ff0780cb660 2023-11-08T19:23:49.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.694+0000 7ff07d014700 1 --2- 172.21.15.149:0/3362424126 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff05c06af00 0x7ff05c06d3c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff0680090b0 tx=0x7ff06801c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:49.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.699+0000 7ff06dffb700 1 -- 172.21.15.149:0/3362424126 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff0740542c0 con 0x7ff0780cb660 2023-11-08T19:23:49.889 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.888+0000 7ff07f278700 1 -- 172.21.15.149:0/3362424126 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7ff07806bb80 con 0x7ff0780cb660 2023-11-08T19:23:49.889 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.888+0000 7ff06dffb700 1 -- 172.21.15.149:0/3362424126 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7ff0740578e0 con 0x7ff0780cb660 2023-11-08T19:23:49.889 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:23:49.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.890+0000 7ff07f278700 1 -- 172.21.15.149:0/3362424126 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff05c06af00 msgr2=0x7ff05c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:49.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.890+0000 7ff07f278700 1 --2- 172.21.15.149:0/3362424126 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff05c06af00 0x7ff05c06d3c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff0680090b0 tx=0x7ff06801c040 comp rx=0 tx=0).stop 2023-11-08T19:23:49.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.890+0000 7ff07f278700 1 -- 172.21.15.149:0/3362424126 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0780cb660 msgr2=0x7ff07815a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:49.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.890+0000 7ff07f278700 1 --2- 172.21.15.149:0/3362424126 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0780cb660 0x7ff07815a320 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff0740011e0 tx=0x7ff07400ca30 comp rx=0 tx=0).stop 2023-11-08T19:23:49.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.890+0000 7ff07f278700 1 -- 172.21.15.149:0/3362424126 shutdown_connections 2023-11-08T19:23:49.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.890+0000 7ff07f278700 1 --2- 172.21.15.149:0/3362424126 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff05c06af00 0x7ff05c06d3c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:49.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.890+0000 7ff07f278700 1 --2- 172.21.15.149:0/3362424126 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff07806ab80 0x7ff0780adb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:49.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.890+0000 7ff07f278700 1 --2- 172.21.15.149:0/3362424126 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff07815df40 0x7ff0781569d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:49.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.890+0000 7ff07f278700 1 --2- 172.21.15.149:0/3362424126 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0780cb660 0x7ff07815a320 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:49.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.890+0000 7ff07f278700 1 -- 172.21.15.149:0/3362424126 >> 172.21.15.149:0/3362424126 conn(0x7ff0780d0640 msgr2=0x7ff0780b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:49.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.890+0000 7ff07f278700 1 -- 172.21.15.149:0/3362424126 shutdown_connections 2023-11-08T19:23:49.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:49.890+0000 7ff07f278700 1 -- 172.21.15.149:0/3362424126 wait complete. 2023-11-08T19:23:49.904 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_attaching_pools_with_snaps_to_fs_fails' 2023-11-08T19:23:50.025 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.024+0000 7fca1f479700 1 Processor -- start 2023-11-08T19:23:50.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.024+0000 7fca1f479700 1 -- start start 2023-11-08T19:23:50.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.025+0000 7fca1f479700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fca180b16b0 0x7fca180ce380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:50.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.025+0000 7fca1f479700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fca180b20b0 0x7fca180b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:50.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.025+0000 7fca1f479700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca180d1330 con 0x7fca180afb30 2023-11-08T19:23:50.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.025+0000 7fca1f479700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca180b2aa0 con 0x7fca180b20b0 2023-11-08T19:23:50.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.025+0000 7fca1f479700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca180cb490 con 0x7fca180b16b0 2023-11-08T19:23:50.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.025+0000 7fca1d215700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fca180afb30 0x7fca180cbf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:40386/0 (socket says 172.21.15.149:40386) 2023-11-08T19:23:50.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.026+0000 7fca1d215700 1 -- 172.21.15.149:0/2275368816 learned_addr learned my addr 172.21.15.149:0/2275368816 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:23:50.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.026+0000 7fca1ca14700 1 --2- 172.21.15.149:0/2275368816 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fca180b16b0 0x7fca180ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:50.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.026+0000 7fca1da16700 1 --2- 172.21.15.149:0/2275368816 >> v2:172.21.15.160:3300/0 conn(0x7fca180b20b0 0x7fca180b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:50.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.026+0000 7fca0ffff700 1 -- 172.21.15.149:0/2275368816 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 585132553 0 0) 0x7fca180d1330 con 0x7fca180afb30 2023-11-08T19:23:50.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.026+0000 7fca0ffff700 1 -- 172.21.15.149:0/2275368816 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca040035b0 con 0x7fca180afb30 2023-11-08T19:23:50.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.026+0000 7fca1ca14700 1 -- 172.21.15.149:0/2275368816 >> v2:172.21.15.160:3300/0 conn(0x7fca180b20b0 msgr2=0x7fca180b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:50.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.026+0000 7fca1ca14700 1 --2- 172.21.15.149:0/2275368816 >> v2:172.21.15.160:3300/0 conn(0x7fca180b20b0 0x7fca180b2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:50.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.026+0000 7fca1ca14700 1 -- 172.21.15.149:0/2275368816 >> v1:172.21.15.149:6789/0 conn(0x7fca180afb30 legacy=0x7fca180cbf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:50.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.026+0000 7fca1ca14700 1 -- 172.21.15.149:0/2275368816 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca180cb770 con 0x7fca180b16b0 2023-11-08T19:23:50.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.026+0000 7fca1ca14700 1 --2- 172.21.15.149:0/2275368816 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fca180b16b0 0x7fca180ce380 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fca08009840 tx=0x7fca08009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e640e1dc42589be9 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:50.032 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.026+0000 7fca0ffff700 1 -- 172.21.15.149:0/2275368816 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca08011830 con 0x7fca180b16b0 2023-11-08T19:23:50.032 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.026+0000 7fca0ffff700 1 -- 172.21.15.149:0/2275368816 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca08011990 con 0x7fca180b16b0 2023-11-08T19:23:50.032 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.026+0000 7fca0ffff700 1 -- 172.21.15.149:0/2275368816 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca08011d00 con 0x7fca180b16b0 2023-11-08T19:23:50.032 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.027+0000 7fca1f479700 1 -- 172.21.15.149:0/2275368816 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fca180b16b0 msgr2=0x7fca180ce380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:50.032 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.027+0000 7fca1f479700 1 --2- 172.21.15.149:0/2275368816 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fca180b16b0 0x7fca180ce380 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fca08009840 tx=0x7fca08009b50 comp rx=0 tx=0).stop 2023-11-08T19:23:50.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.027+0000 7fca1f479700 1 -- 172.21.15.149:0/2275368816 shutdown_connections 2023-11-08T19:23:50.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.027+0000 7fca1f479700 1 --2- 172.21.15.149:0/2275368816 >> v2:172.21.15.160:3300/0 conn(0x7fca180b20b0 0x7fca180b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:50.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.027+0000 7fca1f479700 1 --2- 172.21.15.149:0/2275368816 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fca180b16b0 0x7fca180ce380 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:50.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.027+0000 7fca1f479700 1 -- 172.21.15.149:0/2275368816 >> 172.21.15.149:0/2275368816 conn(0x7fca18099a40 msgr2=0x7fca180d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:50.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.027+0000 7fca1f479700 1 -- 172.21.15.149:0/2275368816 shutdown_connections 2023-11-08T19:23:50.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.027+0000 7fca1f479700 1 -- 172.21.15.149:0/2275368816 wait complete. 2023-11-08T19:23:50.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.028+0000 7fca1f479700 1 Processor -- start 2023-11-08T19:23:50.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.028+0000 7fca1f479700 1 -- start start 2023-11-08T19:23:50.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.029+0000 7fca1f479700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fca180afb30 0x7fca181576f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:50.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.029+0000 7fca1f479700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca180b16b0 0x7fca1815af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:50.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.029+0000 7fca1f479700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca180b20b0 0x7fca180c5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:50.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.029+0000 7fca1f479700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca18158460 con 0x7fca180b20b0 2023-11-08T19:23:50.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.029+0000 7fca1f479700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca18157c30 con 0x7fca180b16b0 2023-11-08T19:23:50.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.029+0000 7fca1f479700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca181f4250 con 0x7fca180afb30 2023-11-08T19:23:50.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.029+0000 7fca1da16700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca180b20b0 0x7fca180c5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:50.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.029+0000 7fca1da16700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca180b20b0 0x7fca180c5bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38394/0 (socket says 172.21.15.149:38394) 2023-11-08T19:23:50.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.029+0000 7fca1da16700 1 -- 172.21.15.149:0/1702051191 learned_addr learned my addr 172.21.15.149:0/1702051191 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:50.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.029+0000 7fca1d215700 1 --2- 172.21.15.149:0/1702051191 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fca180afb30 0x7fca181576f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:50.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.029+0000 7fca1ca14700 1 --2- 172.21.15.149:0/1702051191 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca180b16b0 0x7fca1815af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:50.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.029+0000 7fca1da16700 1 -- 172.21.15.149:0/1702051191 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fca180afb30 msgr2=0x7fca181576f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:50.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.029+0000 7fca1da16700 1 --2- 172.21.15.149:0/1702051191 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fca180afb30 0x7fca181576f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:50.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.029+0000 7fca1da16700 1 -- 172.21.15.149:0/1702051191 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca180b16b0 msgr2=0x7fca1815af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:50.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.029+0000 7fca1da16700 1 --2- 172.21.15.149:0/1702051191 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca180b16b0 0x7fca1815af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:50.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.029+0000 7fca1da16700 1 -- 172.21.15.149:0/1702051191 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca080094a0 con 0x7fca180b20b0 2023-11-08T19:23:50.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.029+0000 7fca1ca14700 1 --2- 172.21.15.149:0/1702051191 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca180b16b0 0x7fca1815af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:23:50.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.030+0000 7fca1da16700 1 --2- 172.21.15.149:0/1702051191 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca180b20b0 0x7fca180c5bd0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fca1000efc0 tx=0x7fca1000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:50.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.030+0000 7fca0dffb700 1 -- 172.21.15.149:0/1702051191 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1000cd40 con 0x7fca180b20b0 2023-11-08T19:23:50.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.030+0000 7fca0dffb700 1 -- 172.21.15.149:0/1702051191 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca1000f040 con 0x7fca180b20b0 2023-11-08T19:23:50.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.030+0000 7fca0dffb700 1 -- 172.21.15.149:0/1702051191 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca100146c0 con 0x7fca180b20b0 2023-11-08T19:23:50.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.030+0000 7fca1f479700 1 -- 172.21.15.149:0/1702051191 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca181f4530 con 0x7fca180b20b0 2023-11-08T19:23:50.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.030+0000 7fca1f479700 1 -- 172.21.15.149:0/1702051191 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca181f4af0 con 0x7fca180b20b0 2023-11-08T19:23:50.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.031+0000 7fca1f479700 1 -- 172.21.15.149:0/1702051191 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca180cff20 con 0x7fca180b20b0 2023-11-08T19:23:50.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.031+0000 7fca0dffb700 1 -- 172.21.15.149:0/1702051191 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fca10014820 con 0x7fca180b20b0 2023-11-08T19:23:50.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.032+0000 7fca0dffb700 1 --2- 172.21.15.149:0/1702051191 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc9fc06af00 0x7fc9fc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:50.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.032+0000 7fca0dffb700 1 -- 172.21.15.149:0/1702051191 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fca1008a290 con 0x7fca180b20b0 2023-11-08T19:23:50.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.032+0000 7fca1d215700 1 --2- 172.21.15.149:0/1702051191 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc9fc06af00 0x7fc9fc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:50.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.032+0000 7fca1d215700 1 --2- 172.21.15.149:0/1702051191 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc9fc06af00 0x7fc9fc06d3c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fca14007fd0 tx=0x7fca14009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:50.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.037+0000 7fca0dffb700 1 -- 172.21.15.149:0/1702051191 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fca10054fc0 con 0x7fca180b20b0 2023-11-08T19:23:50.306 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.305+0000 7fca1f479700 1 -- 172.21.15.149:0/1702051191 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_attaching_pools_with_snaps_to_fs_fails"]} v 0) v1 -- 0x7fca180745f0 con 0x7fca180b20b0 2023-11-08T19:23:50.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.356+0000 7fca0dffb700 1 -- 172.21.15.149:0/1702051191 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_attaching_pools_with_snaps_to_fs_fails"]}]=0 v65) v1 ==== 176+0+0 (secure 0 0 0) 0x7fca100180f0 con 0x7fca180b20b0 2023-11-08T19:23:50.361 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.359+0000 7fca1f479700 1 -- 172.21.15.149:0/1702051191 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc9fc06af00 msgr2=0x7fc9fc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:50.361 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.359+0000 7fca1f479700 1 --2- 172.21.15.149:0/1702051191 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc9fc06af00 0x7fc9fc06d3c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fca14007fd0 tx=0x7fca14009040 comp rx=0 tx=0).stop 2023-11-08T19:23:50.361 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.359+0000 7fca1f479700 1 -- 172.21.15.149:0/1702051191 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca180b20b0 msgr2=0x7fca180c5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:50.361 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.359+0000 7fca1f479700 1 --2- 172.21.15.149:0/1702051191 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca180b20b0 0x7fca180c5bd0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fca1000efc0 tx=0x7fca1000c3a0 comp rx=0 tx=0).stop 2023-11-08T19:23:50.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.360+0000 7fca1f479700 1 -- 172.21.15.149:0/1702051191 shutdown_connections 2023-11-08T19:23:50.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.360+0000 7fca1f479700 1 --2- 172.21.15.149:0/1702051191 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc9fc06af00 0x7fc9fc06d3c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:50.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.360+0000 7fca1f479700 1 --2- 172.21.15.149:0/1702051191 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca180b20b0 0x7fca180c5bd0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:50.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.360+0000 7fca1f479700 1 --2- 172.21.15.149:0/1702051191 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fca180afb30 0x7fca181576f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:50.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.360+0000 7fca1f479700 1 --2- 172.21.15.149:0/1702051191 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca180b16b0 0x7fca1815af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:50.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.360+0000 7fca1f479700 1 -- 172.21.15.149:0/1702051191 >> 172.21.15.149:0/1702051191 conn(0x7fca18099a40 msgr2=0x7fca180cf810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:50.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.360+0000 7fca1f479700 1 -- 172.21.15.149:0/1702051191 shutdown_connections 2023-11-08T19:23:50.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.360+0000 7fca1f479700 1 -- 172.21.15.149:0/1702051191 wait complete. 2023-11-08T19:23:50.376 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-08T19:23:50.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.499+0000 7f8c9ce0f700 1 Processor -- start 2023-11-08T19:23:50.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.499+0000 7f8c9ce0f700 1 -- start start 2023-11-08T19:23:50.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.500+0000 7f8c9ce0f700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f8c9815abf0 0x7f8c980b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:50.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.500+0000 7f8c9ce0f700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f8c980d1130 0x7f8c980cc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:50.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.500+0000 7f8c9ce0f700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c980b6470 con 0x7f8c980cc6a0 2023-11-08T19:23:50.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.500+0000 7f8c9ce0f700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c980b66a0 con 0x7f8c980d1130 2023-11-08T19:23:50.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.500+0000 7f8c9ce0f700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c980d04a0 con 0x7f8c9815abf0 2023-11-08T19:23:50.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.500+0000 7f8c95d9b700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f8c980d1130 0x7f8c980cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:50.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.500+0000 7f8c95d9b700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f8c980d1130 0x7f8c980cc160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38398/0 (socket says 172.21.15.149:38398) 2023-11-08T19:23:50.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.500+0000 7f8c95d9b700 1 -- 172.21.15.149:0/360219166 learned_addr learned my addr 172.21.15.149:0/360219166 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:50.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.500+0000 7f8c9659c700 1 --2- 172.21.15.149:0/360219166 >> v2:172.21.15.160:3300/0 conn(0x7f8c9815abf0 0x7f8c980b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:50.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.500+0000 7f8c95d9b700 1 -- 172.21.15.149:0/360219166 >> v2:172.21.15.160:3300/0 conn(0x7f8c9815abf0 msgr2=0x7f8c980b5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:50.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.500+0000 7f8c95d9b700 1 --2- 172.21.15.149:0/360219166 >> v2:172.21.15.160:3300/0 conn(0x7f8c9815abf0 0x7f8c980b5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:50.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.500+0000 7f8c95d9b700 1 -- 172.21.15.149:0/360219166 >> v1:172.21.15.149:6789/0 conn(0x7f8c980cc6a0 legacy=0x7f8c980ce210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:50.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.500+0000 7f8c9559a700 1 -- 172.21.15.149:0/360219166 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1653065185 0 0) 0x7f8c980b6470 con 0x7f8c980cc6a0 2023-11-08T19:23:50.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.500+0000 7f8c95d9b700 1 -- 172.21.15.149:0/360219166 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c9815afd0 con 0x7f8c980d1130 2023-11-08T19:23:50.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.500+0000 7f8c95d9b700 1 --2- 172.21.15.149:0/360219166 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c980d1130 0x7f8c980cc160 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8c98067970 tx=0x7f8c8c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61aaf487368d7073 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:50.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.501+0000 7f8c9559a700 1 -- 172.21.15.149:0/360219166 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c00b870 con 0x7f8c980d1130 2023-11-08T19:23:50.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.501+0000 7f8c9559a700 1 -- 172.21.15.149:0/360219166 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c8c00b9d0 con 0x7f8c980d1130 2023-11-08T19:23:50.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.501+0000 7f8c9559a700 1 -- 172.21.15.149:0/360219166 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c00bd60 con 0x7f8c980d1130 2023-11-08T19:23:50.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.501+0000 7f8c9ce0f700 1 -- 172.21.15.149:0/360219166 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c980d1130 msgr2=0x7f8c980cc160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:50.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.501+0000 7f8c9ce0f700 1 --2- 172.21.15.149:0/360219166 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c980d1130 0x7f8c980cc160 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8c98067970 tx=0x7f8c8c009bd0 comp rx=0 tx=0).stop 2023-11-08T19:23:50.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.501+0000 7f8c9ce0f700 1 -- 172.21.15.149:0/360219166 shutdown_connections 2023-11-08T19:23:50.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.501+0000 7f8c9ce0f700 1 --2- 172.21.15.149:0/360219166 >> v2:172.21.15.160:3300/0 conn(0x7f8c9815abf0 0x7f8c980b5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:50.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.501+0000 7f8c9ce0f700 1 --2- 172.21.15.149:0/360219166 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c980d1130 0x7f8c980cc160 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:50.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.501+0000 7f8c9ce0f700 1 -- 172.21.15.149:0/360219166 >> 172.21.15.149:0/360219166 conn(0x7f8c980d0640 msgr2=0x7f8c980d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:50.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.501+0000 7f8c9ce0f700 1 -- 172.21.15.149:0/360219166 shutdown_connections 2023-11-08T19:23:50.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.501+0000 7f8c9ce0f700 1 -- 172.21.15.149:0/360219166 wait complete. 2023-11-08T19:23:50.511 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.503+0000 7f8c9ce0f700 1 Processor -- start 2023-11-08T19:23:50.511 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.503+0000 7f8c9ce0f700 1 -- start start 2023-11-08T19:23:50.511 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.503+0000 7f8c9ce0f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8c980cc6a0 0x7f8c9814fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:50.511 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.503+0000 7f8c9ce0f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8c980d1130 0x7f8c9815b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:50.512 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.503+0000 7f8c9ce0f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c9815abf0 0x7f8c980c91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:50.512 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.503+0000 7f8c9ce0f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c980cd8d0 con 0x7f8c9815abf0 2023-11-08T19:23:50.512 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.503+0000 7f8c9ce0f700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c980c8120 con 0x7f8c980cc6a0 2023-11-08T19:23:50.512 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.503+0000 7f8c9ce0f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c980c8400 con 0x7f8c980d1130 2023-11-08T19:23:50.512 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.503+0000 7f8c96d9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c9815abf0 0x7f8c980c91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:50.513 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.504+0000 7f8c96d9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c9815abf0 0x7f8c980c91c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38408/0 (socket says 172.21.15.149:38408) 2023-11-08T19:23:50.513 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.504+0000 7f8c96d9d700 1 -- 172.21.15.149:0/2594653206 learned_addr learned my addr 172.21.15.149:0/2594653206 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:50.513 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.504+0000 7f8c95d9b700 1 --2- 172.21.15.149:0/2594653206 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8c980d1130 0x7f8c9815b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:50.513 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.504+0000 7f8c9659c700 1 --2- 172.21.15.149:0/2594653206 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8c980cc6a0 0x7f8c9814fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:50.513 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.504+0000 7f8c96d9d700 1 -- 172.21.15.149:0/2594653206 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8c980d1130 msgr2=0x7f8c9815b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:50.514 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.504+0000 7f8c96d9d700 1 --2- 172.21.15.149:0/2594653206 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8c980d1130 0x7f8c9815b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:50.514 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.504+0000 7f8c96d9d700 1 -- 172.21.15.149:0/2594653206 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8c980cc6a0 msgr2=0x7f8c9814fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:50.514 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.504+0000 7f8c96d9d700 1 --2- 172.21.15.149:0/2594653206 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8c980cc6a0 0x7f8c9814fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:50.514 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.504+0000 7f8c96d9d700 1 -- 172.21.15.149:0/2594653206 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c8c009550 con 0x7f8c9815abf0 2023-11-08T19:23:50.514 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.504+0000 7f8c9659c700 1 --2- 172.21.15.149:0/2594653206 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8c980cc6a0 0x7f8c9814fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:23:50.515 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.504+0000 7f8c95d9b700 1 --2- 172.21.15.149:0/2594653206 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8c980d1130 0x7f8c9815b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:23:50.515 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.504+0000 7f8c96d9d700 1 --2- 172.21.15.149:0/2594653206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c9815abf0 0x7f8c980c91c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8c9000c7a0 tx=0x7f8c9000cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:50.515 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.504+0000 7f8c86ffd700 1 -- 172.21.15.149:0/2594653206 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c90003e30 con 0x7f8c9815abf0 2023-11-08T19:23:50.515 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.504+0000 7f8c86ffd700 1 -- 172.21.15.149:0/2594653206 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c90005070 con 0x7f8c9815abf0 2023-11-08T19:23:50.515 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.504+0000 7f8c9ce0f700 1 -- 172.21.15.149:0/2594653206 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c980c86e0 con 0x7f8c9815abf0 2023-11-08T19:23:50.516 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.504+0000 7f8c86ffd700 1 -- 172.21.15.149:0/2594653206 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c90005420 con 0x7f8c9815abf0 2023-11-08T19:23:50.516 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.504+0000 7f8c9ce0f700 1 -- 172.21.15.149:0/2594653206 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c980c8ca0 con 0x7f8c9815abf0 2023-11-08T19:23:50.516 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.505+0000 7f8c9ce0f700 1 -- 172.21.15.149:0/2594653206 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c980c8e90 con 0x7f8c9815abf0 2023-11-08T19:23:50.516 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.506+0000 7f8c86ffd700 1 -- 172.21.15.149:0/2594653206 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8c90005580 con 0x7f8c9815abf0 2023-11-08T19:23:50.516 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.506+0000 7f8c86ffd700 1 --2- 172.21.15.149:0/2594653206 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f8c7806af00 0x7f8c7806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:50.517 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.506+0000 7f8c86ffd700 1 -- 172.21.15.149:0/2594653206 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8c90089010 con 0x7f8c9815abf0 2023-11-08T19:23:50.517 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.506+0000 7f8c9659c700 1 --2- 172.21.15.149:0/2594653206 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f8c7806af00 0x7f8c7806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:50.517 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.506+0000 7f8c9659c700 1 --2- 172.21.15.149:0/2594653206 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f8c7806af00 0x7f8c7806d3c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8c880099f0 tx=0x7f8c88008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:50.517 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.511+0000 7f8c86ffd700 1 -- 172.21.15.149:0/2594653206 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8c90053d90 con 0x7f8c9815abf0 2023-11-08T19:23:50.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.705+0000 7f8c9ce0f700 1 -- 172.21.15.149:0/2594653206 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f8c9804f730 con 0x7f8c9815abf0 2023-11-08T19:23:50.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.708+0000 7f8c86ffd700 1 -- 172.21.15.149:0/2594653206 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v11)=0 v11) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8c90017020 con 0x7f8c9815abf0 2023-11-08T19:23:50.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.710+0000 7f8c9ce0f700 1 -- 172.21.15.149:0/2594653206 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f8c7806af00 msgr2=0x7f8c7806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:50.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.710+0000 7f8c9ce0f700 1 --2- 172.21.15.149:0/2594653206 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f8c7806af00 0x7f8c7806d3c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8c880099f0 tx=0x7f8c88008040 comp rx=0 tx=0).stop 2023-11-08T19:23:50.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.710+0000 7f8c9ce0f700 1 -- 172.21.15.149:0/2594653206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c9815abf0 msgr2=0x7f8c980c91c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:50.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.710+0000 7f8c9ce0f700 1 --2- 172.21.15.149:0/2594653206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c9815abf0 0x7f8c980c91c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8c9000c7a0 tx=0x7f8c9000cb60 comp rx=0 tx=0).stop 2023-11-08T19:23:50.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.710+0000 7f8c9ce0f700 1 -- 172.21.15.149:0/2594653206 shutdown_connections 2023-11-08T19:23:50.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.710+0000 7f8c9ce0f700 1 --2- 172.21.15.149:0/2594653206 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f8c7806af00 0x7f8c7806d3c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:50.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.710+0000 7f8c9ce0f700 1 --2- 172.21.15.149:0/2594653206 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8c980cc6a0 0x7f8c9814fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:50.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.710+0000 7f8c9ce0f700 1 --2- 172.21.15.149:0/2594653206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c9815abf0 0x7f8c980c91c0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:50.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.710+0000 7f8c9ce0f700 1 --2- 172.21.15.149:0/2594653206 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8c980d1130 0x7f8c9815b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:50.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.710+0000 7f8c9ce0f700 1 -- 172.21.15.149:0/2594653206 >> 172.21.15.149:0/2594653206 conn(0x7f8c980d0640 msgr2=0x7f8c980b0240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:50.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.710+0000 7f8c9ce0f700 1 -- 172.21.15.149:0/2594653206 shutdown_connections 2023-11-08T19:23:50.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:50.710+0000 7f8c9ce0f700 1 -- 172.21.15.149:0/2594653206 wait complete. 2023-11-08T19:23:50.724 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-08T19:23:50.724 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-08T19:23:50.762 DEBUG:teuthology.orchestra.run.smithi160:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-08T19:23:50.808 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-08T19:23:50.808 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-11-08T19:23:50.809 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:23:50.826 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-11-08T19:23:50.827 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:23:50.883 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-11-08T19:23:50.884 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:23:50.940 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:23:51.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.101+0000 7f4716708700 1 Processor -- start 2023-11-08T19:23:51.103 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.101+0000 7f4716708700 1 -- start start 2023-11-08T19:23:51.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.102+0000 7f4716708700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f47100b16b0 0x7f47100ce380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:51.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.102+0000 7f4716708700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f47100b20b0 0x7f47100b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:51.105 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.102+0000 7f4716708700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47100d1330 con 0x7f47100afb30 2023-11-08T19:23:51.105 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.102+0000 7f4716708700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47100b2aa0 con 0x7f47100b16b0 2023-11-08T19:23:51.105 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.102+0000 7f4716708700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47100cb490 con 0x7f47100b20b0 2023-11-08T19:23:51.105 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.103+0000 7f4714ca5700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f47100b20b0 0x7f47100b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:51.106 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.103+0000 7f470f7fe700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f47100b16b0 0x7f47100ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:51.106 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.103+0000 7f4714ca5700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f47100b20b0 0x7f47100b2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.149:58704/0 (socket says 172.21.15.149:58704) 2023-11-08T19:23:51.106 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.103+0000 7f4714ca5700 1 -- 172.21.15.149:0/3601790525 learned_addr learned my addr 172.21.15.149:0/3601790525 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:51.106 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.103+0000 7f4714ca5700 1 -- 172.21.15.149:0/3601790525 >> v2:172.21.15.160:3300/0 conn(0x7f47100b16b0 msgr2=0x7f47100ce380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:51.106 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.103+0000 7f4714ca5700 1 --2- 172.21.15.149:0/3601790525 >> v2:172.21.15.160:3300/0 conn(0x7f47100b16b0 0x7f47100ce380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:51.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.103+0000 7f4714ca5700 1 -- 172.21.15.149:0/3601790525 >> v1:172.21.15.160:6789/0 conn(0x7f47100afb30 legacy=0x7f47100cbf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:51.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.103+0000 7f4714ca5700 1 -- 172.21.15.149:0/3601790525 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47100cb770 con 0x7f47100b20b0 2023-11-08T19:23:51.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.103+0000 7f4714ca5700 1 --2- 172.21.15.149:0/3601790525 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f47100b20b0 0x7f47100b2560 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4708009e50 tx=0x7f470800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a75f53ad29626fe1 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:51.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.103+0000 7f470effd700 1 -- 172.21.15.149:0/3601790525 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470800e070 con 0x7f47100b20b0 2023-11-08T19:23:51.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.103+0000 7f470effd700 1 -- 172.21.15.149:0/3601790525 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f470800b910 con 0x7f47100b20b0 2023-11-08T19:23:51.108 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.103+0000 7f470effd700 1 -- 172.21.15.149:0/3601790525 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470800bcc0 con 0x7f47100b20b0 2023-11-08T19:23:51.111 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.104+0000 7f4716708700 1 -- 172.21.15.149:0/3601790525 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f47100b20b0 msgr2=0x7f47100b2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:51.111 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.104+0000 7f4716708700 1 --2- 172.21.15.149:0/3601790525 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f47100b20b0 0x7f47100b2560 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4708009e50 tx=0x7f470800b330 comp rx=0 tx=0).stop 2023-11-08T19:23:51.111 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.104+0000 7f4716708700 1 -- 172.21.15.149:0/3601790525 shutdown_connections 2023-11-08T19:23:51.111 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.104+0000 7f4716708700 1 --2- 172.21.15.149:0/3601790525 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f47100b20b0 0x7f47100b2560 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:51.112 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.104+0000 7f4716708700 1 --2- 172.21.15.149:0/3601790525 >> v2:172.21.15.160:3300/0 conn(0x7f47100b16b0 0x7f47100ce380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:51.112 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.104+0000 7f4716708700 1 -- 172.21.15.149:0/3601790525 >> 172.21.15.149:0/3601790525 conn(0x7f4710099a40 msgr2=0x7f47100d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:51.112 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.104+0000 7f4716708700 1 -- 172.21.15.149:0/3601790525 shutdown_connections 2023-11-08T19:23:51.112 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.104+0000 7f4716708700 1 -- 172.21.15.149:0/3601790525 wait complete. 2023-11-08T19:23:51.112 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.105+0000 7f4716708700 1 Processor -- start 2023-11-08T19:23:51.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.106+0000 7f4716708700 1 -- start start 2023-11-08T19:23:51.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.107+0000 7f4716708700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f47100afb30 0x7f471014b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:51.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.107+0000 7f4716708700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47100b16b0 0x7f47100b5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:51.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.107+0000 7f4716708700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f47100b20b0 0x7f47100b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:51.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.107+0000 7f4716708700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47100ca8f0 con 0x7f47100b16b0 2023-11-08T19:23:51.114 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.107+0000 7f4716708700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47101f4930 con 0x7f47100afb30 2023-11-08T19:23:51.114 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.107+0000 7f4716708700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47101f4b80 con 0x7f47100b20b0 2023-11-08T19:23:51.114 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.107+0000 7f470f7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47100b16b0 0x7f47100b5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:51.115 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.107+0000 7f470f7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47100b16b0 0x7f47100b5460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38420/0 (socket says 172.21.15.149:38420) 2023-11-08T19:23:51.115 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.107+0000 7f470f7fe700 1 -- 172.21.15.149:0/1691278778 learned_addr learned my addr 172.21.15.149:0/1691278778 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:51.115 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.107+0000 7f4714ca5700 1 --2- 172.21.15.149:0/1691278778 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f47100b20b0 0x7f47100b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:51.115 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.107+0000 7f470ffff700 1 --2- 172.21.15.149:0/1691278778 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f47100afb30 0x7f471014b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:51.115 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.107+0000 7f470f7fe700 1 -- 172.21.15.149:0/1691278778 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f47100b20b0 msgr2=0x7f47100b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:51.116 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.107+0000 7f470f7fe700 1 --2- 172.21.15.149:0/1691278778 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f47100b20b0 0x7f47100b59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:51.116 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.107+0000 7f470f7fe700 1 -- 172.21.15.149:0/1691278778 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f47100afb30 msgr2=0x7f471014b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:51.116 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.107+0000 7f470f7fe700 1 --2- 172.21.15.149:0/1691278778 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f47100afb30 0x7f471014b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:51.116 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.107+0000 7f470f7fe700 1 -- 172.21.15.149:0/1691278778 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4708009b30 con 0x7f47100b16b0 2023-11-08T19:23:51.116 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.107+0000 7f470f7fe700 1 --2- 172.21.15.149:0/1691278778 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47100b16b0 0x7f47100b5460 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f470400e9b0 tx=0x7f470400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:51.117 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.107+0000 7f470cff9700 1 -- 172.21.15.149:0/1691278778 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4704009710 con 0x7f47100b16b0 2023-11-08T19:23:51.117 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.107+0000 7f470cff9700 1 -- 172.21.15.149:0/1691278778 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f470400ee50 con 0x7f47100b16b0 2023-11-08T19:23:51.117 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.107+0000 7f4716708700 1 -- 172.21.15.149:0/1691278778 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47101f4e60 con 0x7f47100b16b0 2023-11-08T19:23:51.117 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.107+0000 7f470cff9700 1 -- 172.21.15.149:0/1691278778 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470400ca90 con 0x7f47100b16b0 2023-11-08T19:23:51.117 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.107+0000 7f4716708700 1 -- 172.21.15.149:0/1691278778 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47101f5420 con 0x7f47100b16b0 2023-11-08T19:23:51.118 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.108+0000 7f4716708700 1 -- 172.21.15.149:0/1691278778 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47101f55e0 con 0x7f47100b16b0 2023-11-08T19:23:51.118 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.109+0000 7f470cff9700 1 -- 172.21.15.149:0/1691278778 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f470400cbf0 con 0x7f47100b16b0 2023-11-08T19:23:51.118 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.109+0000 7f470cff9700 1 --2- 172.21.15.149:0/1691278778 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f46fc06af00 0x7f46fc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:51.118 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.109+0000 7f470cff9700 1 -- 172.21.15.149:0/1691278778 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4704089840 con 0x7f47100b16b0 2023-11-08T19:23:51.118 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.109+0000 7f470ffff700 1 --2- 172.21.15.149:0/1691278778 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f46fc06af00 0x7f46fc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:51.119 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.110+0000 7f470ffff700 1 --2- 172.21.15.149:0/1691278778 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f46fc06af00 0x7f46fc06d3c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4700000fb0 tx=0x7f4700009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:51.119 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.114+0000 7f470cff9700 1 -- 172.21.15.149:0/1691278778 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f47040545c0 con 0x7f47100b16b0 2023-11-08T19:23:51.305 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.304+0000 7f4716708700 1 -- 172.21.15.149:0/1691278778 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47101f5790 con 0x7f47100b16b0 2023-11-08T19:23:51.306 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.305+0000 7f470cff9700 1 -- 172.21.15.149:0/1691278778 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18770 (secure 0 0 0) 0x7f470400cea0 con 0x7f47100b16b0 2023-11-08T19:23:51.307 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:23:51.307 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":25,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:23:50.351234+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-08T19:22:59.830928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-08T19:23:00.886589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-08T19:23:04.574033+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":1}]},{"pgid":"3.14","mappings":[{"from":4,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:23:51.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.307+0000 7f4716708700 1 -- 172.21.15.149:0/1691278778 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f46fc06af00 msgr2=0x7f46fc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:51.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.307+0000 7f4716708700 1 --2- 172.21.15.149:0/1691278778 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f46fc06af00 0x7f46fc06d3c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4700000fb0 tx=0x7f4700009040 comp rx=0 tx=0).stop 2023-11-08T19:23:51.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.307+0000 7f4716708700 1 -- 172.21.15.149:0/1691278778 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47100b16b0 msgr2=0x7f47100b5460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:51.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.307+0000 7f4716708700 1 --2- 172.21.15.149:0/1691278778 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47100b16b0 0x7f47100b5460 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f470400e9b0 tx=0x7f470400ecc0 comp rx=0 tx=0).stop 2023-11-08T19:23:51.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.307+0000 7f4716708700 1 -- 172.21.15.149:0/1691278778 shutdown_connections 2023-11-08T19:23:51.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.308+0000 7f4716708700 1 --2- 172.21.15.149:0/1691278778 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f46fc06af00 0x7f46fc06d3c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:51.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.308+0000 7f4716708700 1 --2- 172.21.15.149:0/1691278778 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f47100afb30 0x7f471014b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:51.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.308+0000 7f4716708700 1 --2- 172.21.15.149:0/1691278778 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f47100b20b0 0x7f47100b59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:51.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.308+0000 7f4716708700 1 --2- 172.21.15.149:0/1691278778 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47100b16b0 0x7f47100b5460 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:51.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.308+0000 7f4716708700 1 -- 172.21.15.149:0/1691278778 >> 172.21.15.149:0/1691278778 conn(0x7f4710099a40 msgr2=0x7f47100cbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:51.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.308+0000 7f4716708700 1 -- 172.21.15.149:0/1691278778 shutdown_connections 2023-11-08T19:23:51.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.308+0000 7f4716708700 1 -- 172.21.15.149:0/1691278778 wait complete. 2023-11-08T19:23:51.321 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-08T19:22:56.023194+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-08T19:22:59.830928+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-08T19:23:00.886589+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-08T19:23:04.574033+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-08T19:23:51.322 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-08T19:23:51.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.448+0000 7fed820af700 1 Processor -- start 2023-11-08T19:23:51.450 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.448+0000 7fed820af700 1 -- start start 2023-11-08T19:23:51.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.449+0000 7fed820af700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fed7c0cc0d0 0x7fed7c15f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:51.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.449+0000 7fed820af700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fed7c0cc910 0x7fed7c0cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:51.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.449+0000 7fed820af700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed7c15be80 con 0x7fed7c0cc4b0 2023-11-08T19:23:51.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.449+0000 7fed820af700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed7c15f9b0 con 0x7fed7c0cc0d0 2023-11-08T19:23:51.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.449+0000 7fed820af700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed7c15fba0 con 0x7fed7c0cc910 2023-11-08T19:23:51.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.449+0000 7fed7b7fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fed7c0cc0d0 0x7fed7c15f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:51.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.449+0000 7fed7b7fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fed7c0cc0d0 0x7fed7c15f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38426/0 (socket says 172.21.15.149:38426) 2023-11-08T19:23:51.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.449+0000 7fed7affd700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fed7c0cc4b0 0x7fed7c15c620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:40428/0 (socket says 172.21.15.149:40428) 2023-11-08T19:23:51.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.449+0000 7fed7b7fe700 1 -- 172.21.15.149:0/2600380697 learned_addr learned my addr 172.21.15.149:0/2600380697 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:51.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.449+0000 7fed7bfff700 1 --2- 172.21.15.149:0/2600380697 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fed7c0cc910 0x7fed7c0cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:51.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.449+0000 7fed7b7fe700 1 -- 172.21.15.149:0/2600380697 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fed7c0cc910 msgr2=0x7fed7c0cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:51.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.449+0000 7fed7b7fe700 1 --2- 172.21.15.149:0/2600380697 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fed7c0cc910 0x7fed7c0cf320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:51.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.449+0000 7fed7b7fe700 1 -- 172.21.15.149:0/2600380697 >> v1:172.21.15.149:6789/0 conn(0x7fed7c0cc4b0 legacy=0x7fed7c15c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:51.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.449+0000 7fed7b7fe700 1 -- 172.21.15.149:0/2600380697 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed7c15fe80 con 0x7fed7c0cc0d0 2023-11-08T19:23:51.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.449+0000 7fed7a7fc700 1 -- 172.21.15.149:0/2600380697 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1207481899 0 0) 0x7fed7c15be80 con 0x7fed7c0cc4b0 2023-11-08T19:23:51.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.449+0000 7fed7b7fe700 1 --2- 172.21.15.149:0/2600380697 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed7c0cc0d0 0x7fed7c15f470 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fed700098f0 tx=0x7fed70009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dabcfad26efda935 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:51.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.450+0000 7fed7a7fc700 1 -- 172.21.15.149:0/2600380697 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed70011830 con 0x7fed7c0cc0d0 2023-11-08T19:23:51.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.450+0000 7fed7a7fc700 1 -- 172.21.15.149:0/2600380697 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed70011990 con 0x7fed7c0cc0d0 2023-11-08T19:23:51.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.450+0000 7fed7a7fc700 1 -- 172.21.15.149:0/2600380697 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed70011d20 con 0x7fed7c0cc0d0 2023-11-08T19:23:51.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.450+0000 7fed820af700 1 -- 172.21.15.149:0/2600380697 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed7c0cc0d0 msgr2=0x7fed7c15f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:51.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.450+0000 7fed820af700 1 --2- 172.21.15.149:0/2600380697 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed7c0cc0d0 0x7fed7c15f470 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fed700098f0 tx=0x7fed70009c00 comp rx=0 tx=0).stop 2023-11-08T19:23:51.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.450+0000 7fed820af700 1 -- 172.21.15.149:0/2600380697 shutdown_connections 2023-11-08T19:23:51.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.450+0000 7fed820af700 1 --2- 172.21.15.149:0/2600380697 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fed7c0cc910 0x7fed7c0cf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:51.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.450+0000 7fed820af700 1 --2- 172.21.15.149:0/2600380697 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed7c0cc0d0 0x7fed7c15f470 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:51.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.450+0000 7fed820af700 1 -- 172.21.15.149:0/2600380697 >> 172.21.15.149:0/2600380697 conn(0x7fed7c06f120 msgr2=0x7fed7c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:51.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.450+0000 7fed820af700 1 -- 172.21.15.149:0/2600380697 shutdown_connections 2023-11-08T19:23:51.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.450+0000 7fed820af700 1 -- 172.21.15.149:0/2600380697 wait complete. 2023-11-08T19:23:51.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.451+0000 7fed820af700 1 Processor -- start 2023-11-08T19:23:51.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.452+0000 7fed820af700 1 -- start start 2023-11-08T19:23:51.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.452+0000 7fed820af700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed7c0cc0d0 0x7fed7c0cb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:51.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.452+0000 7fed820af700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fed7c0cc4b0 0x7fed7c1567c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:51.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.452+0000 7fed820af700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fed7c0cc910 0x7fed7c156d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:51.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.452+0000 7fed820af700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed7c0b1c80 con 0x7fed7c0cc0d0 2023-11-08T19:23:51.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.452+0000 7fed820af700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed7c157240 con 0x7fed7c0cc4b0 2023-11-08T19:23:51.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.452+0000 7fed820af700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed7c0b1000 con 0x7fed7c0cc910 2023-11-08T19:23:51.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.452+0000 7fed7b7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed7c0cc0d0 0x7fed7c0cb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:51.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.452+0000 7fed7b7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed7c0cc0d0 0x7fed7c0cb1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38432/0 (socket says 172.21.15.149:38432) 2023-11-08T19:23:51.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.452+0000 7fed7b7fe700 1 -- 172.21.15.149:0/2259904935 learned_addr learned my addr 172.21.15.149:0/2259904935 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:51.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.453+0000 7fed7affd700 1 --2- 172.21.15.149:0/2259904935 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fed7c0cc4b0 0x7fed7c1567c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:51.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.453+0000 7fed7bfff700 1 --2- 172.21.15.149:0/2259904935 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fed7c0cc910 0x7fed7c156d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:51.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.453+0000 7fed7b7fe700 1 -- 172.21.15.149:0/2259904935 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fed7c0cc910 msgr2=0x7fed7c156d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:51.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.453+0000 7fed7b7fe700 1 --2- 172.21.15.149:0/2259904935 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fed7c0cc910 0x7fed7c156d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:51.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.453+0000 7fed7b7fe700 1 -- 172.21.15.149:0/2259904935 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fed7c0cc4b0 msgr2=0x7fed7c1567c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:51.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.453+0000 7fed7b7fe700 1 --2- 172.21.15.149:0/2259904935 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fed7c0cc4b0 0x7fed7c1567c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:51.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.453+0000 7fed7b7fe700 1 -- 172.21.15.149:0/2259904935 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed70009550 con 0x7fed7c0cc0d0 2023-11-08T19:23:51.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.453+0000 7fed7b7fe700 1 --2- 172.21.15.149:0/2259904935 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed7c0cc0d0 0x7fed7c0cb1a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fed70009c40 tx=0x7fed70004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:51.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.453+0000 7fed63fff700 1 -- 172.21.15.149:0/2259904935 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed70004480 con 0x7fed7c0cc0d0 2023-11-08T19:23:51.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.453+0000 7fed63fff700 1 -- 172.21.15.149:0/2259904935 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed7001f070 con 0x7fed7c0cc0d0 2023-11-08T19:23:51.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.453+0000 7fed820af700 1 -- 172.21.15.149:0/2259904935 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed7c0b12e0 con 0x7fed7c0cc0d0 2023-11-08T19:23:51.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.453+0000 7fed63fff700 1 -- 172.21.15.149:0/2259904935 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed700038c0 con 0x7fed7c0cc0d0 2023-11-08T19:23:51.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.453+0000 7fed820af700 1 -- 172.21.15.149:0/2259904935 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed7c0b18a0 con 0x7fed7c0cc0d0 2023-11-08T19:23:51.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.454+0000 7fed820af700 1 -- 172.21.15.149:0/2259904935 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed7c04f730 con 0x7fed7c0cc0d0 2023-11-08T19:23:51.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.454+0000 7fed63fff700 1 -- 172.21.15.149:0/2259904935 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fed70021030 con 0x7fed7c0cc0d0 2023-11-08T19:23:51.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.455+0000 7fed63fff700 1 --2- 172.21.15.149:0/2259904935 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fed6806af00 0x7fed6806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:51.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.455+0000 7fed63fff700 1 -- 172.21.15.149:0/2259904935 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fed7008ae20 con 0x7fed7c0cc0d0 2023-11-08T19:23:51.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.455+0000 7fed7affd700 1 --2- 172.21.15.149:0/2259904935 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fed6806af00 0x7fed6806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:51.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.455+0000 7fed7affd700 1 --2- 172.21.15.149:0/2259904935 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fed6806af00 0x7fed6806d3c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fed7c15b050 tx=0x7fed6c007be0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:51.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.460+0000 7fed63fff700 1 -- 172.21.15.149:0/2259904935 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fed70055cc0 con 0x7fed7c0cc0d0 2023-11-08T19:23:51.649 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.648+0000 7fed820af700 1 -- 172.21.15.149:0/2259904935 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fed7c06ff20 con 0x7fed7c0cc0d0 2023-11-08T19:23:51.650 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.649+0000 7fed63fff700 1 -- 172.21.15.149:0/2259904935 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fed70015020 con 0x7fed7c0cc0d0 2023-11-08T19:23:51.651 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 1 2023-11-08T19:23:51.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.651+0000 7fed820af700 1 -- 172.21.15.149:0/2259904935 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fed6806af00 msgr2=0x7fed6806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:51.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.651+0000 7fed820af700 1 --2- 172.21.15.149:0/2259904935 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fed6806af00 0x7fed6806d3c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fed7c15b050 tx=0x7fed6c007be0 comp rx=0 tx=0).stop 2023-11-08T19:23:51.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.651+0000 7fed820af700 1 -- 172.21.15.149:0/2259904935 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed7c0cc0d0 msgr2=0x7fed7c0cb1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:51.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.651+0000 7fed820af700 1 --2- 172.21.15.149:0/2259904935 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed7c0cc0d0 0x7fed7c0cb1a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fed70009c40 tx=0x7fed70004750 comp rx=0 tx=0).stop 2023-11-08T19:23:51.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.651+0000 7fed820af700 1 -- 172.21.15.149:0/2259904935 shutdown_connections 2023-11-08T19:23:51.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.651+0000 7fed820af700 1 --2- 172.21.15.149:0/2259904935 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fed6806af00 0x7fed6806d3c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:51.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.651+0000 7fed820af700 1 --2- 172.21.15.149:0/2259904935 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fed7c0cc910 0x7fed7c156d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:51.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.651+0000 7fed820af700 1 --2- 172.21.15.149:0/2259904935 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed7c0cc0d0 0x7fed7c0cb1a0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:51.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.651+0000 7fed820af700 1 --2- 172.21.15.149:0/2259904935 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fed7c0cc4b0 0x7fed7c1567c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:51.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.651+0000 7fed820af700 1 -- 172.21.15.149:0/2259904935 >> 172.21.15.149:0/2259904935 conn(0x7fed7c06f120 msgr2=0x7fed7c15cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:51.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.651+0000 7fed820af700 1 -- 172.21.15.149:0/2259904935 shutdown_connections 2023-11-08T19:23:51.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.651+0000 7fed820af700 1 -- 172.21.15.149:0/2259904935 wait complete. 2023-11-08T19:23:51.665 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-08T19:23:51.792 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.791+0000 7f537b90c700 1 Processor -- start 2023-11-08T19:23:51.792 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.791+0000 7f537b90c700 1 -- start start 2023-11-08T19:23:51.794 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.792+0000 7f537b90c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f537406ee60 0x7f5374066bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:51.795 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.792+0000 7f537b90c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f53740cdce0 0x7f53740ce170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:51.795 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.792+0000 7f537b90c700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f537415ced0 con 0x7f537406c2d0 2023-11-08T19:23:51.795 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.792+0000 7f537b90c700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f537406f710 con 0x7f53740cdce0 2023-11-08T19:23:51.795 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.792+0000 7f537b90c700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53740ce6b0 con 0x7f537406ee60 2023-11-08T19:23:51.795 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.792+0000 7f5379ea9700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f53740cdce0 0x7f53740ce170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:51.796 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.792+0000 7f5379ea9700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f53740cdce0 0x7f53740ce170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38444/0 (socket says 172.21.15.149:38444) 2023-11-08T19:23:51.796 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.792+0000 7f5379ea9700 1 -- 172.21.15.149:0/3941250893 learned_addr learned my addr 172.21.15.149:0/3941250893 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:51.796 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.792+0000 7f5378ea7700 1 --2- 172.21.15.149:0/3941250893 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f537406ee60 0x7f5374066bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:51.796 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.792+0000 7f5379ea9700 1 -- 172.21.15.149:0/3941250893 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f537406ee60 msgr2=0x7f5374066bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:51.797 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.792+0000 7f5379ea9700 1 --2- 172.21.15.149:0/3941250893 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f537406ee60 0x7f5374066bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:51.797 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.792+0000 7f5379ea9700 1 -- 172.21.15.149:0/3941250893 >> v1:172.21.15.160:6789/0 conn(0x7f537406c2d0 legacy=0x7f537406e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:51.797 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.792+0000 7f5379ea9700 1 -- 172.21.15.149:0/3941250893 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f537406dfa0 con 0x7f53740cdce0 2023-11-08T19:23:51.797 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.792+0000 7f5379ea9700 1 --2- 172.21.15.149:0/3941250893 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53740cdce0 0x7f53740ce170 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f536c009e80 tx=0x7f536c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b2d19d12f4171a7 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:51.797 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.793+0000 7f536bfff700 1 -- 172.21.15.149:0/3941250893 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f536c00e070 con 0x7f53740cdce0 2023-11-08T19:23:51.798 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.793+0000 7f536bfff700 1 -- 172.21.15.149:0/3941250893 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f536c003a20 con 0x7f53740cdce0 2023-11-08T19:23:51.798 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.793+0000 7f536bfff700 1 -- 172.21.15.149:0/3941250893 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f536c003dd0 con 0x7f53740cdce0 2023-11-08T19:23:51.798 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.793+0000 7f537b90c700 1 -- 172.21.15.149:0/3941250893 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53740cdce0 msgr2=0x7f53740ce170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:51.798 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.793+0000 7f537b90c700 1 --2- 172.21.15.149:0/3941250893 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53740cdce0 0x7f53740ce170 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f536c009e80 tx=0x7f536c00b330 comp rx=0 tx=0).stop 2023-11-08T19:23:51.798 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.793+0000 7f537b90c700 1 -- 172.21.15.149:0/3941250893 shutdown_connections 2023-11-08T19:23:51.799 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.793+0000 7f537b90c700 1 --2- 172.21.15.149:0/3941250893 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53740cdce0 0x7f53740ce170 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:51.799 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.793+0000 7f537b90c700 1 --2- 172.21.15.149:0/3941250893 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f537406ee60 0x7f5374066bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:51.799 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.793+0000 7f537b90c700 1 -- 172.21.15.149:0/3941250893 >> 172.21.15.149:0/3941250893 conn(0x7f53740cc860 msgr2=0x7f53740ccc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:51.799 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.793+0000 7f537b90c700 1 -- 172.21.15.149:0/3941250893 shutdown_connections 2023-11-08T19:23:51.799 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.793+0000 7f537b90c700 1 -- 172.21.15.149:0/3941250893 wait complete. 2023-11-08T19:23:51.802 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.794+0000 7f537b90c700 1 Processor -- start 2023-11-08T19:23:51.802 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.794+0000 7f537b90c700 1 -- start start 2023-11-08T19:23:51.802 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.795+0000 7f537b90c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f537406ee60 0x7f53740a8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:51.803 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.795+0000 7f537b90c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53740cdce0 0x7f53740af040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:51.803 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.795+0000 7f537b90c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f537415e890 0x7f53740b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:51.803 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.795+0000 7f537b90c700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53741f2230 con 0x7f53740cdce0 2023-11-08T19:23:51.803 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.795+0000 7f537b90c700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53741f16b0 con 0x7f537406ee60 2023-11-08T19:23:51.803 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.795+0000 7f537b90c700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53741f1990 con 0x7f537415e890 2023-11-08T19:23:51.804 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.795+0000 7f5378ea7700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53740cdce0 0x7f53740af040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:51.804 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.795+0000 7f5378ea7700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53740cdce0 0x7f53740af040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38448/0 (socket says 172.21.15.149:38448) 2023-11-08T19:23:51.804 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.795+0000 7f5378ea7700 1 -- 172.21.15.149:0/3366159525 learned_addr learned my addr 172.21.15.149:0/3366159525 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:51.804 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.795+0000 7f5379ea9700 1 --2- 172.21.15.149:0/3366159525 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f537415e890 0x7f53740b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:51.805 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.795+0000 7f53796a8700 1 --2- 172.21.15.149:0/3366159525 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f537406ee60 0x7f53740a8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:51.805 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.796+0000 7f5378ea7700 1 -- 172.21.15.149:0/3366159525 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f537415e890 msgr2=0x7f53740b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:51.805 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.796+0000 7f5378ea7700 1 --2- 172.21.15.149:0/3366159525 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f537415e890 0x7f53740b3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:51.805 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.796+0000 7f5378ea7700 1 -- 172.21.15.149:0/3366159525 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f537406ee60 msgr2=0x7f53740a8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:51.806 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.796+0000 7f5378ea7700 1 --2- 172.21.15.149:0/3366159525 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f537406ee60 0x7f53740a8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:51.806 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.796+0000 7f5378ea7700 1 -- 172.21.15.149:0/3366159525 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f536c009b30 con 0x7f53740cdce0 2023-11-08T19:23:51.806 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.796+0000 7f5378ea7700 1 --2- 172.21.15.149:0/3366159525 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53740cdce0 0x7f53740af040 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f536400c7f0 tx=0x7f536400cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:51.806 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.796+0000 7f5369ffb700 1 -- 172.21.15.149:0/3366159525 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5364004220 con 0x7f53740cdce0 2023-11-08T19:23:51.806 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.796+0000 7f5369ffb700 1 -- 172.21.15.149:0/3366159525 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5364004380 con 0x7f53740cdce0 2023-11-08T19:23:51.807 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.796+0000 7f537b90c700 1 -- 172.21.15.149:0/3366159525 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53741f1c70 con 0x7f53740cdce0 2023-11-08T19:23:51.807 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.796+0000 7f5369ffb700 1 -- 172.21.15.149:0/3366159525 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53640036a0 con 0x7f53740cdce0 2023-11-08T19:23:51.807 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.796+0000 7f537b90c700 1 -- 172.21.15.149:0/3366159525 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53740af580 con 0x7f53740cdce0 2023-11-08T19:23:51.807 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.797+0000 7f537b90c700 1 -- 172.21.15.149:0/3366159525 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f537415bdd0 con 0x7f53740cdce0 2023-11-08T19:23:51.807 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.797+0000 7f5369ffb700 1 -- 172.21.15.149:0/3366159525 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5364003800 con 0x7f53740cdce0 2023-11-08T19:23:51.808 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.798+0000 7f5369ffb700 1 --2- 172.21.15.149:0/3366159525 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f535806af00 0x7f535806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:51.808 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.798+0000 7f5369ffb700 1 -- 172.21.15.149:0/3366159525 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f53640893e0 con 0x7f53740cdce0 2023-11-08T19:23:51.808 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.798+0000 7f53796a8700 1 --2- 172.21.15.149:0/3366159525 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f535806af00 0x7f535806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:51.808 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.798+0000 7f53796a8700 1 --2- 172.21.15.149:0/3366159525 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f535806af00 0x7f535806d3c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5374157c20 tx=0x7f5370007ec0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:51.809 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.803+0000 7f5369ffb700 1 -- 172.21.15.149:0/3366159525 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f537415bdd0 con 0x7f53740cdce0 2023-11-08T19:23:51.997 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.996+0000 7f537b90c700 1 -- 172.21.15.149:0/3366159525 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f53741f24f0 con 0x7f53740cdce0 2023-11-08T19:23:51.998 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.997+0000 7f5369ffb700 1 -- 172.21.15.149:0/3366159525 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f53741f24f0 con 0x7f53740cdce0 2023-11-08T19:23:51.998 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:23:52.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.999+0000 7f537b90c700 1 -- 172.21.15.149:0/3366159525 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f535806af00 msgr2=0x7f535806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:52.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.999+0000 7f537b90c700 1 --2- 172.21.15.149:0/3366159525 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f535806af00 0x7f535806d3c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5374157c20 tx=0x7f5370007ec0 comp rx=0 tx=0).stop 2023-11-08T19:23:52.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.999+0000 7f537b90c700 1 -- 172.21.15.149:0/3366159525 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53740cdce0 msgr2=0x7f53740af040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:52.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.999+0000 7f537b90c700 1 --2- 172.21.15.149:0/3366159525 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53740cdce0 0x7f53740af040 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f536400c7f0 tx=0x7f536400cb00 comp rx=0 tx=0).stop 2023-11-08T19:23:52.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.999+0000 7f537b90c700 1 -- 172.21.15.149:0/3366159525 shutdown_connections 2023-11-08T19:23:52.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.999+0000 7f537b90c700 1 --2- 172.21.15.149:0/3366159525 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f535806af00 0x7f535806d3c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:52.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.999+0000 7f537b90c700 1 --2- 172.21.15.149:0/3366159525 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f537406ee60 0x7f53740a8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:52.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.999+0000 7f537b90c700 1 --2- 172.21.15.149:0/3366159525 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f537415e890 0x7f53740b3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:52.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.999+0000 7f537b90c700 1 --2- 172.21.15.149:0/3366159525 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53740cdce0 0x7f53740af040 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:52.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.999+0000 7f537b90c700 1 -- 172.21.15.149:0/3366159525 >> 172.21.15.149:0/3366159525 conn(0x7f53740cc860 msgr2=0x7f537415b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:52.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.999+0000 7f537b90c700 1 -- 172.21.15.149:0/3366159525 shutdown_connections 2023-11-08T19:23:52.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:51.999+0000 7f537b90c700 1 -- 172.21.15.149:0/3366159525 wait complete. 2023-11-08T19:23:52.012 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-08T19:23:52.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.135+0000 7f27f5b0d700 1 Processor -- start 2023-11-08T19:23:52.137 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.135+0000 7f27f5b0d700 1 -- start start 2023-11-08T19:23:52.140 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.136+0000 7f27f5b0d700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f27f00d1130 0x7f27f00b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:52.141 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.136+0000 7f27f5b0d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f27f00cc870 0x7f27f006bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:52.141 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.136+0000 7f27f5b0d700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27f00b6470 con 0x7f27f015abf0 2023-11-08T19:23:52.141 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.136+0000 7f27f5b0d700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27f00b66a0 con 0x7f27f00d1130 2023-11-08T19:23:52.142 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.136+0000 7f27f5b0d700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27f00d04a0 con 0x7f27f00cc870 2023-11-08T19:23:52.142 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.136+0000 7f27ef7fe700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f27f015abf0 0x7f27f00cc160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:40456/0 (socket says 172.21.15.149:40456) 2023-11-08T19:23:52.142 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.136+0000 7f27ef7fe700 1 -- 172.21.15.149:0/124263126 learned_addr learned my addr 172.21.15.149:0/124263126 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:23:52.142 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.136+0000 7f27ee7fc700 1 -- 172.21.15.149:0/124263126 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4228913293 0 0) 0x7f27f00b6470 con 0x7f27f015abf0 2023-11-08T19:23:52.142 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.136+0000 7f27eeffd700 1 --2- 172.21.15.149:0/124263126 >> v2:172.21.15.160:3300/0 conn(0x7f27f00d1130 0x7f27f00b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:52.143 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.136+0000 7f27ee7fc700 1 -- 172.21.15.149:0/124263126 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27d80057c0 con 0x7f27f015abf0 2023-11-08T19:23:52.143 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.136+0000 7f27effff700 1 --2- 172.21.15.149:0/124263126 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f27f00cc870 0x7f27f006bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:52.143 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.137+0000 7f27ee7fc700 1 -- 172.21.15.149:0/124263126 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1892224534 0 0) 0x7f27d80057c0 con 0x7f27f015abf0 2023-11-08T19:23:52.143 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.137+0000 7f27ee7fc700 1 -- 172.21.15.149:0/124263126 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f27f00cc870 msgr2=0x7f27f006bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:52.144 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.137+0000 7f27ee7fc700 1 --2- 172.21.15.149:0/124263126 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f27f00cc870 0x7f27f006bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:52.144 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.137+0000 7f27ee7fc700 1 -- 172.21.15.149:0/124263126 >> v2:172.21.15.160:3300/0 conn(0x7f27f00d1130 msgr2=0x7f27f00b5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:52.144 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.137+0000 7f27ee7fc700 1 --2- 172.21.15.149:0/124263126 >> v2:172.21.15.160:3300/0 conn(0x7f27f00d1130 0x7f27f00b5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:52.144 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.137+0000 7f27ee7fc700 1 -- 172.21.15.149:0/124263126 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f015afd0 con 0x7f27f015abf0 2023-11-08T19:23:52.144 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.137+0000 7f27ee7fc700 1 -- 172.21.15.149:0/124263126 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f27e4001670 con 0x7f27f015abf0 2023-11-08T19:23:52.145 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.137+0000 7f27ee7fc700 1 -- 172.21.15.149:0/124263126 >> v1:172.21.15.149:6789/0 conn(0x7f27f015abf0 legacy=0x7f27f00cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:52.145 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.137+0000 7f27ee7fc700 1 --2- 172.21.15.149:0/124263126 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f27f00cc870 0x7f27d8005c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:52.145 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.137+0000 7f27ee7fc700 1 --2- 172.21.15.149:0/124263126 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f27d8006200 0x7f27d8006a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:52.145 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.137+0000 7f27ee7fc700 1 --2- 172.21.15.149:0/124263126 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f27d8006fa0 0x7f27d8007420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:52.145 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.137+0000 7f27ee7fc700 1 -- 172.21.15.149:0/124263126 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f00b66a0 con 0x7f27d8006fa0 2023-11-08T19:23:52.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.137+0000 7f27ee7fc700 1 -- 172.21.15.149:0/124263126 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f00d04a0 con 0x7f27d8006200 2023-11-08T19:23:52.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.137+0000 7f27ee7fc700 1 -- 172.21.15.149:0/124263126 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d800dcd0 con 0x7f27f00cc870 2023-11-08T19:23:52.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.137+0000 7f27effff700 1 --2- 172.21.15.149:0/124263126 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f27d8006fa0 0x7f27d8007420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:52.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.137+0000 7f27ef7fe700 1 --2- 172.21.15.149:0/124263126 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f27f00cc870 0x7f27d8005c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:52.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.137+0000 7f27eeffd700 1 --2- 172.21.15.149:0/124263126 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f27d8006200 0x7f27d8006a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:52.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.137+0000 7f27effff700 1 -- 172.21.15.149:0/124263126 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f27f00cc870 msgr2=0x7f27d8005c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:52.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.137+0000 7f27effff700 1 --2- 172.21.15.149:0/124263126 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f27f00cc870 0x7f27d8005c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:52.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.137+0000 7f27effff700 1 -- 172.21.15.149:0/124263126 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f27d8006200 msgr2=0x7f27d8006a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:52.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.137+0000 7f27effff700 1 --2- 172.21.15.149:0/124263126 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f27d8006200 0x7f27d8006a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:52.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.137+0000 7f27effff700 1 -- 172.21.15.149:0/124263126 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d80057c0 con 0x7f27d8006fa0 2023-11-08T19:23:52.148 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.137+0000 7f27effff700 1 --2- 172.21.15.149:0/124263126 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f27d8006fa0 0x7f27d8007420 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f27e8009fc0 tx=0x7f27d8007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d66a0abe3e2a02fe server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:52.148 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.138+0000 7f27ee7fc700 1 -- 172.21.15.149:0/124263126 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e800ec30 con 0x7f27d8006fa0 2023-11-08T19:23:52.148 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.138+0000 7f27ee7fc700 1 -- 172.21.15.149:0/124263126 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e800f040 con 0x7f27d8006fa0 2023-11-08T19:23:52.148 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.138+0000 7f27ee7fc700 1 -- 172.21.15.149:0/124263126 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e8014480 con 0x7f27d8006fa0 2023-11-08T19:23:52.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.138+0000 7f27f5b0d700 1 -- 172.21.15.149:0/124263126 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f27d8006fa0 msgr2=0x7f27d8007420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:52.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.138+0000 7f27f5b0d700 1 --2- 172.21.15.149:0/124263126 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f27d8006fa0 0x7f27d8007420 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f27e8009fc0 tx=0x7f27d8007a90 comp rx=0 tx=0).stop 2023-11-08T19:23:52.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.138+0000 7f27effff700 1 -- 172.21.15.149:0/124263126 reap_dead start 2023-11-08T19:23:52.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.138+0000 7f27f5b0d700 1 -- 172.21.15.149:0/124263126 shutdown_connections 2023-11-08T19:23:52.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.138+0000 7f27f5b0d700 1 -- 172.21.15.149:0/124263126 >> 172.21.15.149:0/124263126 conn(0x7f27f00d0640 msgr2=0x7f27f00d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:52.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.138+0000 7f27f5b0d700 1 -- 172.21.15.149:0/124263126 shutdown_connections 2023-11-08T19:23:52.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.138+0000 7f27f5b0d700 1 -- 172.21.15.149:0/124263126 wait complete. 2023-11-08T19:23:52.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.139+0000 7f27f5b0d700 1 Processor -- start 2023-11-08T19:23:52.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.140+0000 7f27f5b0d700 1 -- start start 2023-11-08T19:23:52.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.140+0000 7f27f5b0d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f27d8006fa0 0x7f27f00b4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:52.154 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.140+0000 7f27f5b0d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f27f015c460 0x7f27f00b5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:52.154 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.140+0000 7f27f5b0d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f27f01563a0 0x7f27f01599f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:52.154 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.140+0000 7f27f5b0d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f015d7f0 con 0x7f27d8006fa0 2023-11-08T19:23:52.154 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.140+0000 7f27f5b0d700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f015c8e0 con 0x7f27f015c460 2023-11-08T19:23:52.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.140+0000 7f27f5b0d700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27f0156f80 con 0x7f27f01563a0 2023-11-08T19:23:52.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.140+0000 7f27ef7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f27d8006fa0 0x7f27f00b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:52.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.140+0000 7f27ef7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f27d8006fa0 0x7f27f00b4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38466/0 (socket says 172.21.15.149:38466) 2023-11-08T19:23:52.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.140+0000 7f27ef7fe700 1 -- 172.21.15.149:0/3966362291 learned_addr learned my addr 172.21.15.149:0/3966362291 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:52.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.141+0000 7f27effff700 1 --2- 172.21.15.149:0/3966362291 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f27f01563a0 0x7f27f01599f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:52.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.141+0000 7f27eeffd700 1 --2- 172.21.15.149:0/3966362291 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f27f015c460 0x7f27f00b5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:52.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.141+0000 7f27ef7fe700 1 -- 172.21.15.149:0/3966362291 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f27f01563a0 msgr2=0x7f27f01599f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:52.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.141+0000 7f27ef7fe700 1 --2- 172.21.15.149:0/3966362291 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f27f01563a0 0x7f27f01599f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:52.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.141+0000 7f27ef7fe700 1 -- 172.21.15.149:0/3966362291 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f27f015c460 msgr2=0x7f27f00b5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:52.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.141+0000 7f27ef7fe700 1 --2- 172.21.15.149:0/3966362291 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f27f015c460 0x7f27f00b5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:52.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.141+0000 7f27ef7fe700 1 -- 172.21.15.149:0/3966362291 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f00b4af0 con 0x7f27d8006fa0 2023-11-08T19:23:52.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.141+0000 7f27ef7fe700 1 --2- 172.21.15.149:0/3966362291 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f27d8006fa0 0x7f27f00b4480 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f27e40017a0 tx=0x7f27e40076a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:52.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.141+0000 7f27d7fff700 1 -- 172.21.15.149:0/3966362291 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e400f8d0 con 0x7f27d8006fa0 2023-11-08T19:23:52.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.141+0000 7f27d7fff700 1 -- 172.21.15.149:0/3966362291 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e400fa50 con 0x7f27d8006fa0 2023-11-08T19:23:52.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.141+0000 7f27f5b0d700 1 -- 172.21.15.149:0/3966362291 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27f00b4dd0 con 0x7f27d8006fa0 2023-11-08T19:23:52.158 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.141+0000 7f27d7fff700 1 -- 172.21.15.149:0/3966362291 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e400fe00 con 0x7f27d8006fa0 2023-11-08T19:23:52.158 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.141+0000 7f27f5b0d700 1 -- 172.21.15.149:0/3966362291 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27f00b5390 con 0x7f27d8006fa0 2023-11-08T19:23:52.158 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.142+0000 7f27f5b0d700 1 -- 172.21.15.149:0/3966362291 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27f004f730 con 0x7f27d8006fa0 2023-11-08T19:23:52.158 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.142+0000 7f27d7fff700 1 -- 172.21.15.149:0/3966362291 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f27e401d460 con 0x7f27d8006fa0 2023-11-08T19:23:52.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.143+0000 7f27d7fff700 1 --2- 172.21.15.149:0/3966362291 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f27dc06af00 0x7f27dc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:52.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.143+0000 7f27d7fff700 1 -- 172.21.15.149:0/3966362291 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f27e4089ab0 con 0x7f27d8006fa0 2023-11-08T19:23:52.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.143+0000 7f27eeffd700 1 --2- 172.21.15.149:0/3966362291 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f27dc06af00 0x7f27dc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:52.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.143+0000 7f27eeffd700 1 --2- 172.21.15.149:0/3966362291 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f27dc06af00 0x7f27dc06d3c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f27f0159810 tx=0x7f27e0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:52.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.148+0000 7f27d7fff700 1 -- 172.21.15.149:0/3966362291 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f27e40547b0 con 0x7f27d8006fa0 2023-11-08T19:23:52.340 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.338+0000 7f27f5b0d700 1 -- 172.21.15.149:0/3966362291 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f27f00cee60 con 0x7f27d8006fa0 2023-11-08T19:23:52.340 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.339+0000 7f27d7fff700 1 -- 172.21.15.149:0/3966362291 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f27e4057dd0 con 0x7f27d8006fa0 2023-11-08T19:23:52.341 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 64 2023-11-08T19:23:52.343 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.341+0000 7f27f5b0d700 1 -- 172.21.15.149:0/3966362291 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f27dc06af00 msgr2=0x7f27dc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:52.343 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.341+0000 7f27f5b0d700 1 --2- 172.21.15.149:0/3966362291 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f27dc06af00 0x7f27dc06d3c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f27f0159810 tx=0x7f27e0008040 comp rx=0 tx=0).stop 2023-11-08T19:23:52.343 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.341+0000 7f27f5b0d700 1 -- 172.21.15.149:0/3966362291 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f27d8006fa0 msgr2=0x7f27f00b4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:52.343 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.341+0000 7f27f5b0d700 1 --2- 172.21.15.149:0/3966362291 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f27d8006fa0 0x7f27f00b4480 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f27e40017a0 tx=0x7f27e40076a0 comp rx=0 tx=0).stop 2023-11-08T19:23:52.343 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.341+0000 7f27f5b0d700 1 -- 172.21.15.149:0/3966362291 shutdown_connections 2023-11-08T19:23:52.344 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.341+0000 7f27f5b0d700 1 --2- 172.21.15.149:0/3966362291 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f27dc06af00 0x7f27dc06d3c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:52.344 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.341+0000 7f27f5b0d700 1 --2- 172.21.15.149:0/3966362291 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f27f01563a0 0x7f27f01599f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:52.344 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.341+0000 7f27f5b0d700 1 --2- 172.21.15.149:0/3966362291 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f27d8006fa0 0x7f27f00b4480 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:52.344 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.341+0000 7f27f5b0d700 1 --2- 172.21.15.149:0/3966362291 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f27f015c460 0x7f27f00b5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:52.345 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.341+0000 7f27f5b0d700 1 -- 172.21.15.149:0/3966362291 >> 172.21.15.149:0/3966362291 conn(0x7f27f00d0640 msgr2=0x7f27f006ac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:52.345 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.341+0000 7f27f5b0d700 1 -- 172.21.15.149:0/3966362291 shutdown_connections 2023-11-08T19:23:52.345 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.341+0000 7f27f5b0d700 1 -- 172.21.15.149:0/3966362291 wait complete. 2023-11-08T19:23:52.355 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-08T19:23:52.480 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.479+0000 7fd3332f6700 1 Processor -- start 2023-11-08T19:23:52.480 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.479+0000 7fd3332f6700 1 -- start start 2023-11-08T19:23:52.482 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.480+0000 7fd3332f6700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd32c15df40 0x7fd32c06c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:52.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.480+0000 7fd3332f6700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fd32c06ab80 0x7fd32c06c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:52.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.480+0000 7fd3332f6700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd32c15e320 con 0x7fd32c0cf1c0 2023-11-08T19:23:52.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.480+0000 7fd3332f6700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd32c06b020 con 0x7fd32c06ab80 2023-11-08T19:23:52.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.480+0000 7fd3332f6700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd32c06b2e0 con 0x7fd32c15df40 2023-11-08T19:23:52.484 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.480+0000 7fd331092700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd32c15df40 0x7fd32c06c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:52.484 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.480+0000 7fd330891700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fd32c06ab80 0x7fd32c06c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:52.484 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.480+0000 7fd331092700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd32c15df40 0x7fd32c06c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.149:58762/0 (socket says 172.21.15.149:58762) 2023-11-08T19:23:52.484 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.480+0000 7fd331092700 1 -- 172.21.15.149:0/846122918 learned_addr learned my addr 172.21.15.149:0/846122918 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:52.484 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.480+0000 7fd331893700 1 --1- 172.21.15.149:0/846122918 >> v1:172.21.15.160:6789/0 conn(0x7fd32c0cf1c0 0x7fd32c0caf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.149:52144/0 (socket says 172.21.15.149:52144) 2023-11-08T19:23:52.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.480+0000 7fd331092700 1 -- 172.21.15.149:0/846122918 >> v2:172.21.15.160:3300/0 conn(0x7fd32c06ab80 msgr2=0x7fd32c06c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:52.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.480+0000 7fd331092700 1 --2- 172.21.15.149:0/846122918 >> v2:172.21.15.160:3300/0 conn(0x7fd32c06ab80 0x7fd32c06c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:52.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.480+0000 7fd331092700 1 -- 172.21.15.149:0/846122918 >> v1:172.21.15.160:6789/0 conn(0x7fd32c0cf1c0 legacy=0x7fd32c0caf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:52.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.480+0000 7fd331092700 1 -- 172.21.15.149:0/846122918 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd32c06b5c0 con 0x7fd32c15df40 2023-11-08T19:23:52.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.480+0000 7fd330891700 1 --2- 172.21.15.149:0/846122918 >> v2:172.21.15.160:3300/0 conn(0x7fd32c06ab80 0x7fd32c06c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:23:52.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.481+0000 7fd331092700 1 --2- 172.21.15.149:0/846122918 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd32c15df40 0x7fd32c06c0a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd3280098f0 tx=0x7fd328009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=371a094940480791 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:52.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.481+0000 7fd323fff700 1 -- 172.21.15.149:0/846122918 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd328011830 con 0x7fd32c15df40 2023-11-08T19:23:52.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.481+0000 7fd323fff700 1 -- 172.21.15.149:0/846122918 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd328011990 con 0x7fd32c15df40 2023-11-08T19:23:52.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.481+0000 7fd323fff700 1 -- 172.21.15.149:0/846122918 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd328011d20 con 0x7fd32c15df40 2023-11-08T19:23:52.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.481+0000 7fd3332f6700 1 -- 172.21.15.149:0/846122918 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd32c15df40 msgr2=0x7fd32c06c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:52.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.481+0000 7fd3332f6700 1 --2- 172.21.15.149:0/846122918 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd32c15df40 0x7fd32c06c0a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd3280098f0 tx=0x7fd328009c00 comp rx=0 tx=0).stop 2023-11-08T19:23:52.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.481+0000 7fd3332f6700 1 -- 172.21.15.149:0/846122918 shutdown_connections 2023-11-08T19:23:52.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.481+0000 7fd3332f6700 1 --2- 172.21.15.149:0/846122918 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd32c15df40 0x7fd32c06c0a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:52.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.481+0000 7fd3332f6700 1 --2- 172.21.15.149:0/846122918 >> v2:172.21.15.160:3300/0 conn(0x7fd32c06ab80 0x7fd32c06c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:52.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.481+0000 7fd3332f6700 1 -- 172.21.15.149:0/846122918 >> 172.21.15.149:0/846122918 conn(0x7fd32c0d0640 msgr2=0x7fd32c0d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:52.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.481+0000 7fd3332f6700 1 -- 172.21.15.149:0/846122918 shutdown_connections 2023-11-08T19:23:52.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.481+0000 7fd3332f6700 1 -- 172.21.15.149:0/846122918 wait complete. 2023-11-08T19:23:52.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.483+0000 7fd3332f6700 1 Processor -- start 2023-11-08T19:23:52.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.483+0000 7fd3332f6700 1 -- start start 2023-11-08T19:23:52.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.483+0000 7fd3332f6700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd32c06ab80 0x7fd32c0c8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:52.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.483+0000 7fd3332f6700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd32c0cf1c0 0x7fd32c156e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:52.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.483+0000 7fd3332f6700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd32c15df40 0x7fd32c0c6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:52.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.483+0000 7fd3332f6700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd32c1573a0 con 0x7fd32c06ab80 2023-11-08T19:23:52.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.483+0000 7fd3332f6700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd32c0c9a30 con 0x7fd32c15df40 2023-11-08T19:23:52.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.483+0000 7fd3332f6700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd32c0c8e20 con 0x7fd32c0cf1c0 2023-11-08T19:23:52.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.483+0000 7fd331092700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd32c06ab80 0x7fd32c0c8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:52.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.483+0000 7fd331092700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd32c06ab80 0x7fd32c0c8840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38478/0 (socket says 172.21.15.149:38478) 2023-11-08T19:23:52.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.484+0000 7fd331092700 1 -- 172.21.15.149:0/3351751763 learned_addr learned my addr 172.21.15.149:0/3351751763 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:52.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.484+0000 7fd330891700 1 --2- 172.21.15.149:0/3351751763 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd32c0cf1c0 0x7fd32c156e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:52.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.484+0000 7fd331893700 1 --2- 172.21.15.149:0/3351751763 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd32c15df40 0x7fd32c0c6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:52.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.484+0000 7fd331092700 1 -- 172.21.15.149:0/3351751763 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd32c0cf1c0 msgr2=0x7fd32c156e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:52.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.484+0000 7fd331092700 1 --2- 172.21.15.149:0/3351751763 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd32c0cf1c0 0x7fd32c156e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:52.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.484+0000 7fd331092700 1 -- 172.21.15.149:0/3351751763 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd32c15df40 msgr2=0x7fd32c0c6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:52.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.484+0000 7fd331092700 1 --2- 172.21.15.149:0/3351751763 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd32c15df40 0x7fd32c0c6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:52.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.484+0000 7fd331092700 1 -- 172.21.15.149:0/3351751763 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd31c0094a0 con 0x7fd32c06ab80 2023-11-08T19:23:52.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.484+0000 7fd331893700 1 --2- 172.21.15.149:0/3351751763 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd32c15df40 0x7fd32c0c6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:23:52.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.484+0000 7fd331092700 1 --2- 172.21.15.149:0/3351751763 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd32c06ab80 0x7fd32c0c8840 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd328000c00 tx=0x7fd328004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:52.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.484+0000 7fd321ffb700 1 -- 172.21.15.149:0/3351751763 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd328004480 con 0x7fd32c06ab80 2023-11-08T19:23:52.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.484+0000 7fd321ffb700 1 -- 172.21.15.149:0/3351751763 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd32801f070 con 0x7fd32c06ab80 2023-11-08T19:23:52.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.484+0000 7fd3332f6700 1 -- 172.21.15.149:0/3351751763 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd328009550 con 0x7fd32c06ab80 2023-11-08T19:23:52.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.484+0000 7fd321ffb700 1 -- 172.21.15.149:0/3351751763 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3280038c0 con 0x7fd32c06ab80 2023-11-08T19:23:52.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.484+0000 7fd3332f6700 1 -- 172.21.15.149:0/3351751763 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd32c0c93e0 con 0x7fd32c06ab80 2023-11-08T19:23:52.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.485+0000 7fd3332f6700 1 -- 172.21.15.149:0/3351751763 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd32c04f730 con 0x7fd32c06ab80 2023-11-08T19:23:52.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.486+0000 7fd321ffb700 1 -- 172.21.15.149:0/3351751763 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd328021030 con 0x7fd32c06ab80 2023-11-08T19:23:52.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.486+0000 7fd321ffb700 1 --2- 172.21.15.149:0/3351751763 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd31006af00 0x7fd31006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:52.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.486+0000 7fd330891700 1 --2- 172.21.15.149:0/3351751763 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd31006af00 0x7fd31006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:52.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.486+0000 7fd321ffb700 1 -- 172.21.15.149:0/3351751763 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd32808adb0 con 0x7fd32c06ab80 2023-11-08T19:23:52.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.487+0000 7fd330891700 1 --2- 172.21.15.149:0/3351751763 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd31006af00 0x7fd31006d3c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd32c0c7330 tx=0x7fd31c009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:52.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.491+0000 7fd321ffb700 1 -- 172.21.15.149:0/3351751763 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd328055bd0 con 0x7fd32c06ab80 2023-11-08T19:23:52.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.679+0000 7fd3332f6700 1 -- 172.21.15.149:0/3351751763 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd32c072370 con 0x7fd32c06ab80 2023-11-08T19:23:52.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.680+0000 7fd321ffb700 1 -- 172.21.15.149:0/3351751763 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd328015020 con 0x7fd32c06ab80 2023-11-08T19:23:52.681 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:23:52.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.682+0000 7fd3332f6700 1 -- 172.21.15.149:0/3351751763 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd31006af00 msgr2=0x7fd31006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:52.684 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.682+0000 7fd3332f6700 1 --2- 172.21.15.149:0/3351751763 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd31006af00 0x7fd31006d3c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd32c0c7330 tx=0x7fd31c009210 comp rx=0 tx=0).stop 2023-11-08T19:23:52.684 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.682+0000 7fd3332f6700 1 -- 172.21.15.149:0/3351751763 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd32c06ab80 msgr2=0x7fd32c0c8840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:52.684 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.682+0000 7fd3332f6700 1 --2- 172.21.15.149:0/3351751763 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd32c06ab80 0x7fd32c0c8840 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd328000c00 tx=0x7fd328004750 comp rx=0 tx=0).stop 2023-11-08T19:23:52.684 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.682+0000 7fd3332f6700 1 -- 172.21.15.149:0/3351751763 shutdown_connections 2023-11-08T19:23:52.685 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.682+0000 7fd3332f6700 1 --2- 172.21.15.149:0/3351751763 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd31006af00 0x7fd31006d3c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:52.685 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.682+0000 7fd3332f6700 1 --2- 172.21.15.149:0/3351751763 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd32c15df40 0x7fd32c0c6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:52.685 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.682+0000 7fd3332f6700 1 --2- 172.21.15.149:0/3351751763 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd32c06ab80 0x7fd32c0c8840 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:52.685 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.682+0000 7fd3332f6700 1 --2- 172.21.15.149:0/3351751763 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd32c0cf1c0 0x7fd32c156e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:52.685 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.682+0000 7fd3332f6700 1 -- 172.21.15.149:0/3351751763 >> 172.21.15.149:0/3351751763 conn(0x7fd32c0d0640 msgr2=0x7fd32c0b0160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:52.686 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.682+0000 7fd3332f6700 1 -- 172.21.15.149:0/3351751763 shutdown_connections 2023-11-08T19:23:52.686 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.682+0000 7fd3332f6700 1 -- 172.21.15.149:0/3351751763 wait complete. 2023-11-08T19:23:52.695 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-08T19:23:52.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.816+0000 7f1646931700 1 Processor -- start 2023-11-08T19:23:52.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.816+0000 7f1646931700 1 -- start start 2023-11-08T19:23:52.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.817+0000 7f1646931700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f164015bc70 0x7f16400cde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:52.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.817+0000 7f1646931700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f164015c050 0x7f16400ce3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:52.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.817+0000 7f1646931700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16400b4990 con 0x7f16400ce8e0 2023-11-08T19:23:52.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.817+0000 7f1646931700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16400ced10 con 0x7f164015c050 2023-11-08T19:23:52.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.817+0000 7f1646931700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16400b2b60 con 0x7f164015bc70 2023-11-08T19:23:52.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.817+0000 7f163f7fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f164015c050 0x7f16400ce3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:52.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.817+0000 7f163f7fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f164015c050 0x7f16400ce3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38488/0 (socket says 172.21.15.149:38488) 2023-11-08T19:23:52.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.817+0000 7f163f7fe700 1 -- 172.21.15.149:0/3798196166 learned_addr learned my addr 172.21.15.149:0/3798196166 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:52.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.818+0000 7f163ffff700 1 --2- 172.21.15.149:0/3798196166 >> v2:172.21.15.160:3300/0 conn(0x7f164015bc70 0x7f16400cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:52.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.818+0000 7f163f7fe700 1 -- 172.21.15.149:0/3798196166 >> v2:172.21.15.160:3300/0 conn(0x7f164015bc70 msgr2=0x7f16400cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:52.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.818+0000 7f163f7fe700 1 --2- 172.21.15.149:0/3798196166 >> v2:172.21.15.160:3300/0 conn(0x7f164015bc70 0x7f16400cde60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:52.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.818+0000 7f163f7fe700 1 -- 172.21.15.149:0/3798196166 >> v1:172.21.15.160:6789/0 conn(0x7f16400ce8e0 legacy=0x7f16400cf510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:52.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.818+0000 7f163f7fe700 1 -- 172.21.15.149:0/3798196166 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16400cd680 con 0x7f164015c050 2023-11-08T19:23:52.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.818+0000 7f163f7fe700 1 --2- 172.21.15.149:0/3798196166 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f164015c050 0x7f16400ce3a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1640072cc0 tx=0x7f1630009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0aac2af92ff6b59 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:52.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.818+0000 7f163effd700 1 -- 172.21.15.149:0/3798196166 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1630004230 con 0x7f164015c050 2023-11-08T19:23:52.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.818+0000 7f163effd700 1 -- 172.21.15.149:0/3798196166 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1630004390 con 0x7f164015c050 2023-11-08T19:23:52.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.818+0000 7f163effd700 1 -- 172.21.15.149:0/3798196166 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16300036a0 con 0x7f164015c050 2023-11-08T19:23:52.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.819+0000 7f1646931700 1 -- 172.21.15.149:0/3798196166 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f164015c050 msgr2=0x7f16400ce3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:52.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.819+0000 7f1646931700 1 --2- 172.21.15.149:0/3798196166 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f164015c050 0x7f16400ce3a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1640072cc0 tx=0x7f1630009bd0 comp rx=0 tx=0).stop 2023-11-08T19:23:52.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.819+0000 7f1646931700 1 -- 172.21.15.149:0/3798196166 shutdown_connections 2023-11-08T19:23:52.826 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.819+0000 7f1646931700 1 --2- 172.21.15.149:0/3798196166 >> v2:172.21.15.160:3300/0 conn(0x7f164015bc70 0x7f16400cde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:52.826 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.819+0000 7f1646931700 1 --2- 172.21.15.149:0/3798196166 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f164015c050 0x7f16400ce3a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:52.826 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.819+0000 7f1646931700 1 -- 172.21.15.149:0/3798196166 >> 172.21.15.149:0/3798196166 conn(0x7f16400d1730 msgr2=0x7f16400d1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:52.826 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.819+0000 7f1646931700 1 -- 172.21.15.149:0/3798196166 shutdown_connections 2023-11-08T19:23:52.826 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.819+0000 7f1646931700 1 -- 172.21.15.149:0/3798196166 wait complete. 2023-11-08T19:23:52.827 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.820+0000 7f1646931700 1 Processor -- start 2023-11-08T19:23:52.827 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.820+0000 7f1646931700 1 -- start start 2023-11-08T19:23:52.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.821+0000 7f1646931700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f16400ce8e0 0x7f16401f3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:52.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.821+0000 7f1646931700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f164015bc70 0x7f16400cafd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:52.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.821+0000 7f1646931700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f164015c050 0x7f164006cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:52.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.821+0000 7f1646931700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16400c9d40 con 0x7f164015c050 2023-11-08T19:23:52.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.821+0000 7f1646931700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16400c9f70 con 0x7f164015bc70 2023-11-08T19:23:52.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.821+0000 7f1646931700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16400ca210 con 0x7f16400ce8e0 2023-11-08T19:23:52.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.821+0000 7f1644ece700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f164015c050 0x7f164006cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:52.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.821+0000 7f1644ece700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f164015c050 0x7f164006cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38496/0 (socket says 172.21.15.149:38496) 2023-11-08T19:23:52.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.821+0000 7f1644ece700 1 -- 172.21.15.149:0/2396819490 learned_addr learned my addr 172.21.15.149:0/2396819490 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:52.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.821+0000 7f163f7fe700 1 --2- 172.21.15.149:0/2396819490 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f164015bc70 0x7f16400cafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:52.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.821+0000 7f163ffff700 1 --2- 172.21.15.149:0/2396819490 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f16400ce8e0 0x7f16401f3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:52.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.821+0000 7f1644ece700 1 -- 172.21.15.149:0/2396819490 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f16400ce8e0 msgr2=0x7f16401f3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:52.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.821+0000 7f1644ece700 1 --2- 172.21.15.149:0/2396819490 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f16400ce8e0 0x7f16401f3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:52.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.821+0000 7f1644ece700 1 -- 172.21.15.149:0/2396819490 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f164015bc70 msgr2=0x7f16400cafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:52.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.821+0000 7f1644ece700 1 --2- 172.21.15.149:0/2396819490 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f164015bc70 0x7f16400cafd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:52.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.821+0000 7f1644ece700 1 -- 172.21.15.149:0/2396819490 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1630009550 con 0x7f164015c050 2023-11-08T19:23:52.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.821+0000 7f163ffff700 1 --2- 172.21.15.149:0/2396819490 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f16400ce8e0 0x7f16401f3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:23:52.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.821+0000 7f1644ece700 1 --2- 172.21.15.149:0/2396819490 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f164015c050 0x7f164006cdc0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f163800cc10 tx=0x7f163800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:52.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.821+0000 7f163cff9700 1 -- 172.21.15.149:0/2396819490 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f163800abb0 con 0x7f164015c050 2023-11-08T19:23:52.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.822+0000 7f163cff9700 1 -- 172.21.15.149:0/2396819490 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f163800ad10 con 0x7f164015c050 2023-11-08T19:23:52.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.822+0000 7f1646931700 1 -- 172.21.15.149:0/2396819490 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16400ca4f0 con 0x7f164015c050 2023-11-08T19:23:52.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.822+0000 7f163cff9700 1 -- 172.21.15.149:0/2396819490 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1638012660 con 0x7f164015c050 2023-11-08T19:23:52.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.822+0000 7f1646931700 1 -- 172.21.15.149:0/2396819490 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16400caab0 con 0x7f164015c050 2023-11-08T19:23:52.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.823+0000 7f1646931700 1 -- 172.21.15.149:0/2396819490 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16400b3020 con 0x7f164015c050 2023-11-08T19:23:52.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.823+0000 7f163cff9700 1 -- 172.21.15.149:0/2396819490 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f16380127c0 con 0x7f164015c050 2023-11-08T19:23:52.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.823+0000 7f163cff9700 1 --2- 172.21.15.149:0/2396819490 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f162c06af00 0x7f162c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:52.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.824+0000 7f163cff9700 1 -- 172.21.15.149:0/2396819490 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f163808a100 con 0x7f164015c050 2023-11-08T19:23:52.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.824+0000 7f163ffff700 1 --2- 172.21.15.149:0/2396819490 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f162c06af00 0x7f162c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:52.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.824+0000 7f163ffff700 1 --2- 172.21.15.149:0/2396819490 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f162c06af00 0x7f162c06d3c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f16400c8760 tx=0x7f1634008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:52.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:52.828+0000 7f163cff9700 1 -- 172.21.15.149:0/2396819490 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1638054df0 con 0x7f164015c050 2023-11-08T19:23:53.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.035+0000 7f1646931700 1 -- 172.21.15.149:0/2396819490 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f16400745f0 con 0x7f164015c050 2023-11-08T19:23:53.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.035+0000 7f163cff9700 1 -- 172.21.15.149:0/2396819490 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1638016080 con 0x7f164015c050 2023-11-08T19:23:53.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.037+0000 7f1646931700 1 -- 172.21.15.149:0/2396819490 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f162c06af00 msgr2=0x7f162c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:53.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.037+0000 7f1646931700 1 --2- 172.21.15.149:0/2396819490 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f162c06af00 0x7f162c06d3c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f16400c8760 tx=0x7f1634008040 comp rx=0 tx=0).stop 2023-11-08T19:23:53.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.037+0000 7f1646931700 1 -- 172.21.15.149:0/2396819490 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f164015c050 msgr2=0x7f164006cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:53.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.037+0000 7f1646931700 1 --2- 172.21.15.149:0/2396819490 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f164015c050 0x7f164006cdc0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f163800cc10 tx=0x7f163800a060 comp rx=0 tx=0).stop 2023-11-08T19:23:53.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.037+0000 7f1646931700 1 -- 172.21.15.149:0/2396819490 shutdown_connections 2023-11-08T19:23:53.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.037+0000 7f1646931700 1 --2- 172.21.15.149:0/2396819490 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f162c06af00 0x7f162c06d3c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:53.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.037+0000 7f1646931700 1 --2- 172.21.15.149:0/2396819490 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f164015c050 0x7f164006cdc0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:53.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.037+0000 7f1646931700 1 --2- 172.21.15.149:0/2396819490 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f16400ce8e0 0x7f16401f3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:53.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.037+0000 7f1646931700 1 --2- 172.21.15.149:0/2396819490 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f164015bc70 0x7f16400cafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:53.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.037+0000 7f1646931700 1 -- 172.21.15.149:0/2396819490 >> 172.21.15.149:0/2396819490 conn(0x7f16400d1730 msgr2=0x7f1640150c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:53.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.037+0000 7f1646931700 1 -- 172.21.15.149:0/2396819490 shutdown_connections 2023-11-08T19:23:53.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.037+0000 7f1646931700 1 -- 172.21.15.149:0/2396819490 wait complete. 2023-11-08T19:23:53.042 INFO:teuthology.orchestra.run.smithi149.stderr:listed 0 entries 2023-11-08T19:23:53.051 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-08T19:23:53.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:53.051 DEBUG:teuthology.orchestra.run.smithi149:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-11-08T19:23:53.113 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi149.front.sepia.ceph.com 2023-11-08T19:23:53.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:53.114 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-08T19:23:53.131 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-11-08T19:23:53.131 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:23:53.153 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-11-08T19:23:53.153 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:23:53.213 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-11-08T19:23:53.214 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:23:53.273 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:23:53.396 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.394+0000 7f6dc3211700 1 Processor -- start 2023-11-08T19:23:53.396 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.395+0000 7f6dc3211700 1 -- start start 2023-11-08T19:23:53.399 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.395+0000 7f6dc3211700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6dbc0ce840 0x7f6dbc0d0430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:53.399 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.395+0000 7f6dc3211700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dbc0cc2e0 con 0x7f6dbc0cd5e0 2023-11-08T19:23:53.399 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.395+0000 7f6dc3211700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dbc0cc580 con 0x7f6dbc15b950 2023-11-08T19:23:53.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.395+0000 7f6dc3211700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dbc0cc820 con 0x7f6dbc0ce840 2023-11-08T19:23:53.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.396+0000 7f6dbbfff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f6dbc0cd5e0 0x7f6dbc0cfd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:40504/0 (socket says 172.21.15.149:40504) 2023-11-08T19:23:53.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.396+0000 7f6dbbfff700 1 -- 172.21.15.149:0/2387090378 learned_addr learned my addr 172.21.15.149:0/2387090378 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:23:53.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.396+0000 7f6dc17ae700 1 --2- 172.21.15.149:0/2387090378 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6dbc0ce840 0x7f6dbc0d0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:53.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.396+0000 7f6dbb7fe700 1 -- 172.21.15.149:0/2387090378 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 881976191 0 0) 0x7f6dbc0cc2e0 con 0x7f6dbc0cd5e0 2023-11-08T19:23:53.401 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.396+0000 7f6dbb7fe700 1 -- 172.21.15.149:0/2387090378 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6dac0035b0 con 0x7f6dbc0cd5e0 2023-11-08T19:23:53.401 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.396+0000 7f6dbb7fe700 1 -- 172.21.15.149:0/2387090378 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2114628535 0 0) 0x7f6dbc0cc580 con 0x7f6dbc15b950 2023-11-08T19:23:53.401 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.396+0000 7f6dbb7fe700 1 -- 172.21.15.149:0/2387090378 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6dbc0cc2e0 con 0x7f6dbc15b950 2023-11-08T19:23:53.401 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.396+0000 7f6dbb7fe700 1 -- 172.21.15.149:0/2387090378 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 729061921 0 0) 0x7f6dac0035b0 con 0x7f6dbc0cd5e0 2023-11-08T19:23:53.401 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.396+0000 7f6dc17ae700 1 -- 172.21.15.149:0/2387090378 >> v1:172.21.15.160:6789/0 conn(0x7f6dbc15b950 legacy=0x7f6dbc0ce130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:53.402 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.396+0000 7f6dc17ae700 1 -- 172.21.15.149:0/2387090378 >> v1:172.21.15.149:6789/0 conn(0x7f6dbc0cd5e0 legacy=0x7f6dbc0cfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:53.402 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.396+0000 7f6dc17ae700 1 -- 172.21.15.149:0/2387090378 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dbc0ccb00 con 0x7f6dbc0ce840 2023-11-08T19:23:53.402 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.396+0000 7f6dc17ae700 1 --2- 172.21.15.149:0/2387090378 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6dbc0ce840 0x7f6dbc0d0430 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6db4009dc0 tx=0x7f6db400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54d6fde20a1166f3 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:53.402 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.396+0000 7f6dbb7fe700 1 -- 172.21.15.149:0/2387090378 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db400e070 con 0x7f6dbc0ce840 2023-11-08T19:23:53.403 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.396+0000 7f6dbb7fe700 1 -- 172.21.15.149:0/2387090378 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6db4003a20 con 0x7f6dbc0ce840 2023-11-08T19:23:53.403 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.396+0000 7f6dbb7fe700 1 -- 172.21.15.149:0/2387090378 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da8001670 con 0x7f6dbc0ce840 2023-11-08T19:23:53.403 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.397+0000 7f6dc3211700 1 -- 172.21.15.149:0/2387090378 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6dbc0ce840 msgr2=0x7f6dbc0d0430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:53.403 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.397+0000 7f6dc3211700 1 --2- 172.21.15.149:0/2387090378 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6dbc0ce840 0x7f6dbc0d0430 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6db4009dc0 tx=0x7f6db400b330 comp rx=0 tx=0).stop 2023-11-08T19:23:53.403 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.397+0000 7f6dc3211700 1 -- 172.21.15.149:0/2387090378 shutdown_connections 2023-11-08T19:23:53.403 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.397+0000 7f6dc3211700 1 --2- 172.21.15.149:0/2387090378 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6dbc0ce840 0x7f6dbc0d0430 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:53.404 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.397+0000 7f6dc3211700 1 -- 172.21.15.149:0/2387090378 >> 172.21.15.149:0/2387090378 conn(0x7f6dbc08afd0 msgr2=0x7f6dbc0d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:53.404 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.397+0000 7f6dc3211700 1 -- 172.21.15.149:0/2387090378 shutdown_connections 2023-11-08T19:23:53.404 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.397+0000 7f6dc3211700 1 -- 172.21.15.149:0/2387090378 wait complete. 2023-11-08T19:23:53.404 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.398+0000 7f6dc3211700 1 Processor -- start 2023-11-08T19:23:53.404 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.398+0000 7f6dc3211700 1 -- start start 2023-11-08T19:23:53.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.399+0000 7f6dc3211700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6dbc0ce840 0x7f6dbc158de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:53.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.399+0000 7f6dc3211700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6dbc15b950 0x7f6dbc15e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:53.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.399+0000 7f6dc3211700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6dbc15ea50 0x7f6dbc06bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:53.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.399+0000 7f6dc3211700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dbc15ef00 con 0x7f6dbc15ea50 2023-11-08T19:23:53.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.399+0000 7f6dc3211700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dbc06ca00 con 0x7f6dbc15b950 2023-11-08T19:23:53.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.399+0000 7f6dc3211700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dbc06cce0 con 0x7f6dbc0ce840 2023-11-08T19:23:53.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.399+0000 7f6dc17ae700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6dbc15ea50 0x7f6dbc06bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:53.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.399+0000 7f6dc17ae700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6dbc15ea50 0x7f6dbc06bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38510/0 (socket says 172.21.15.149:38510) 2023-11-08T19:23:53.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.399+0000 7f6dc17ae700 1 -- 172.21.15.149:0/4006549758 learned_addr learned my addr 172.21.15.149:0/4006549758 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:53.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.399+0000 7f6dbbfff700 1 --2- 172.21.15.149:0/4006549758 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6dbc15b950 0x7f6dbc15e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:53.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.399+0000 7f6dc0fad700 1 --2- 172.21.15.149:0/4006549758 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6dbc0ce840 0x7f6dbc158de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:53.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.400+0000 7f6dc17ae700 1 -- 172.21.15.149:0/4006549758 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6dbc0ce840 msgr2=0x7f6dbc158de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:53.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.400+0000 7f6dc17ae700 1 --2- 172.21.15.149:0/4006549758 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6dbc0ce840 0x7f6dbc158de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:53.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.400+0000 7f6dc17ae700 1 -- 172.21.15.149:0/4006549758 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6dbc15b950 msgr2=0x7f6dbc15e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:53.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.400+0000 7f6dc17ae700 1 --2- 172.21.15.149:0/4006549758 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6dbc15b950 0x7f6dbc15e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:53.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.400+0000 7f6dc17ae700 1 -- 172.21.15.149:0/4006549758 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db4009a70 con 0x7f6dbc15ea50 2023-11-08T19:23:53.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.400+0000 7f6dc17ae700 1 --2- 172.21.15.149:0/4006549758 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6dbc15ea50 0x7f6dbc06bd40 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6db4009d90 tx=0x7f6db4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:53.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.400+0000 7f6db97fa700 1 -- 172.21.15.149:0/4006549758 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db40044c0 con 0x7f6dbc15ea50 2023-11-08T19:23:53.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.400+0000 7f6db97fa700 1 -- 172.21.15.149:0/4006549758 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6db4004620 con 0x7f6dbc15ea50 2023-11-08T19:23:53.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.400+0000 7f6dc3211700 1 -- 172.21.15.149:0/4006549758 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dbc06cfc0 con 0x7f6dbc15ea50 2023-11-08T19:23:53.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.400+0000 7f6db97fa700 1 -- 172.21.15.149:0/4006549758 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db401d470 con 0x7f6dbc15ea50 2023-11-08T19:23:53.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.400+0000 7f6dc3211700 1 -- 172.21.15.149:0/4006549758 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dbc06d580 con 0x7f6dbc15ea50 2023-11-08T19:23:53.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.401+0000 7f6dc3211700 1 -- 172.21.15.149:0/4006549758 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dbc0745f0 con 0x7f6dbc15ea50 2023-11-08T19:23:53.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.401+0000 7f6db97fa700 1 -- 172.21.15.149:0/4006549758 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6db401d5d0 con 0x7f6dbc15ea50 2023-11-08T19:23:53.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.402+0000 7f6db97fa700 1 --2- 172.21.15.149:0/4006549758 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6da006af00 0x7f6da006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:53.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.402+0000 7f6db97fa700 1 -- 172.21.15.149:0/4006549758 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6db408b5a0 con 0x7f6dbc15ea50 2023-11-08T19:23:53.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.402+0000 7f6dc0fad700 1 --2- 172.21.15.149:0/4006549758 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6da006af00 0x7f6da006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:53.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.402+0000 7f6dc0fad700 1 --2- 172.21.15.149:0/4006549758 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6da006af00 0x7f6da006d3c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6db0007fd0 tx=0x7f6db0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:53.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.406+0000 7f6db97fa700 1 -- 172.21.15.149:0/4006549758 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6db4056320 con 0x7f6dbc15ea50 2023-11-08T19:23:53.601 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.600+0000 7f6dc3211700 1 -- 172.21.15.149:0/4006549758 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6dbc08b760 con 0x7f6dbc15ea50 2023-11-08T19:23:53.602 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.601+0000 7f6db97fa700 1 -- 172.21.15.149:0/4006549758 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18770 (secure 0 0 0) 0x7f6db4059940 con 0x7f6dbc15ea50 2023-11-08T19:23:53.602 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:23:53.603 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":26,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:23:51.355959+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-08T19:22:59.830928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-08T19:23:00.886589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-08T19:23:04.574033+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":1}]},{"pgid":"3.14","mappings":[{"from":4,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:23:53.604 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.603+0000 7f6dc3211700 1 -- 172.21.15.149:0/4006549758 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6da006af00 msgr2=0x7f6da006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:53.604 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.603+0000 7f6dc3211700 1 --2- 172.21.15.149:0/4006549758 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6da006af00 0x7f6da006d3c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6db0007fd0 tx=0x7f6db0009040 comp rx=0 tx=0).stop 2023-11-08T19:23:53.605 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.603+0000 7f6dc3211700 1 -- 172.21.15.149:0/4006549758 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6dbc15ea50 msgr2=0x7f6dbc06bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:53.605 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.603+0000 7f6dc3211700 1 --2- 172.21.15.149:0/4006549758 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6dbc15ea50 0x7f6dbc06bd40 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6db4009d90 tx=0x7f6db4004ad0 comp rx=0 tx=0).stop 2023-11-08T19:23:53.605 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.603+0000 7f6dc3211700 1 -- 172.21.15.149:0/4006549758 shutdown_connections 2023-11-08T19:23:53.605 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.603+0000 7f6dc3211700 1 --2- 172.21.15.149:0/4006549758 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6da006af00 0x7f6da006d3c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:53.605 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.603+0000 7f6dc3211700 1 --2- 172.21.15.149:0/4006549758 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6dbc15ea50 0x7f6dbc06bd40 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:53.606 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.603+0000 7f6dc3211700 1 --2- 172.21.15.149:0/4006549758 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6dbc0ce840 0x7f6dbc158de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:53.606 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.603+0000 7f6dc3211700 1 --2- 172.21.15.149:0/4006549758 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6dbc15b950 0x7f6dbc15e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:53.606 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.603+0000 7f6dc3211700 1 -- 172.21.15.149:0/4006549758 >> 172.21.15.149:0/4006549758 conn(0x7f6dbc08afd0 msgr2=0x7f6dbc0ae480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:53.606 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.603+0000 7f6dc3211700 1 -- 172.21.15.149:0/4006549758 shutdown_connections 2023-11-08T19:23:53.607 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.603+0000 7f6dc3211700 1 -- 172.21.15.149:0/4006549758 wait complete. 2023-11-08T19:23:53.616 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-08T19:22:56.023194+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-08T19:22:59.830928+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-08T19:23:00.886589+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-08T19:23:04.574033+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-08T19:23:53.617 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-08T19:23:53.741 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.740+0000 7f2c6367d700 1 Processor -- start 2023-11-08T19:23:53.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.740+0000 7f2c6367d700 1 -- start start 2023-11-08T19:23:53.746 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.741+0000 7f2c6367d700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f2c5c15abf0 0x7f2c5c0b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:53.746 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.741+0000 7f2c6367d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2c5c0cc870 0x7f2c5c06bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:53.746 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.741+0000 7f2c6367d700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c5c0b6470 con 0x7f2c5c0d1130 2023-11-08T19:23:53.746 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.741+0000 7f2c6367d700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c5c0b66a0 con 0x7f2c5c15abf0 2023-11-08T19:23:53.747 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.741+0000 7f2c6367d700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c5c0d04a0 con 0x7f2c5c0cc870 2023-11-08T19:23:53.747 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.741+0000 7f2c60c18700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f2c5c0d1130 0x7f2c5c0cc160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:40516/0 (socket says 172.21.15.149:40516) 2023-11-08T19:23:53.747 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.741+0000 7f2c60c18700 1 -- 172.21.15.149:0/3725310896 learned_addr learned my addr 172.21.15.149:0/3725310896 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:23:53.747 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.742+0000 7f2c61419700 1 --2- 172.21.15.149:0/3725310896 >> v2:172.21.15.160:3300/0 conn(0x7f2c5c15abf0 0x7f2c5c0b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:53.747 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.742+0000 7f2c61c1a700 1 --2- 172.21.15.149:0/3725310896 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2c5c0cc870 0x7f2c5c06bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:53.748 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.742+0000 7f2c53fff700 1 -- 172.21.15.149:0/3725310896 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1572146063 0 0) 0x7f2c5c0b6470 con 0x7f2c5c0d1130 2023-11-08T19:23:53.748 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.742+0000 7f2c53fff700 1 -- 172.21.15.149:0/3725310896 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c480035b0 con 0x7f2c5c0d1130 2023-11-08T19:23:53.748 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.742+0000 7f2c53fff700 1 -- 172.21.15.149:0/3725310896 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2099020541 0 0) 0x7f2c480035b0 con 0x7f2c5c0d1130 2023-11-08T19:23:53.748 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.742+0000 7f2c53fff700 1 -- 172.21.15.149:0/3725310896 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2c5c0cc870 msgr2=0x7f2c5c06bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:53.748 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.742+0000 7f2c53fff700 1 --2- 172.21.15.149:0/3725310896 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2c5c0cc870 0x7f2c5c06bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:53.749 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.742+0000 7f2c53fff700 1 -- 172.21.15.149:0/3725310896 >> v2:172.21.15.160:3300/0 conn(0x7f2c5c15abf0 msgr2=0x7f2c5c0b5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:53.749 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.742+0000 7f2c53fff700 1 --2- 172.21.15.149:0/3725310896 >> v2:172.21.15.160:3300/0 conn(0x7f2c5c15abf0 0x7f2c5c0b5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:53.749 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.742+0000 7f2c53fff700 1 -- 172.21.15.149:0/3725310896 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c5c15afd0 con 0x7f2c5c0d1130 2023-11-08T19:23:53.749 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.742+0000 7f2c53fff700 1 -- 172.21.15.149:0/3725310896 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f2c58001670 con 0x7f2c5c0d1130 2023-11-08T19:23:53.749 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.742+0000 7f2c53fff700 1 -- 172.21.15.149:0/3725310896 >> v1:172.21.15.149:6789/0 conn(0x7f2c5c0d1130 legacy=0x7f2c5c0cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:53.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.742+0000 7f2c53fff700 1 --2- 172.21.15.149:0/3725310896 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c48003a70 0x7f2c48003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:53.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.742+0000 7f2c53fff700 1 --2- 172.21.15.149:0/3725310896 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2c48004850 0x7f2c48004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:53.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.742+0000 7f2c53fff700 1 --2- 172.21.15.149:0/3725310896 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2c48005210 0x7f2c4800dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:53.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.742+0000 7f2c53fff700 1 -- 172.21.15.149:0/3725310896 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c5c0b66a0 con 0x7f2c48003a70 2023-11-08T19:23:53.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.742+0000 7f2c53fff700 1 -- 172.21.15.149:0/3725310896 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c5c0d04a0 con 0x7f2c48004850 2023-11-08T19:23:53.751 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.742+0000 7f2c53fff700 1 -- 172.21.15.149:0/3725310896 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4800e210 con 0x7f2c48005210 2023-11-08T19:23:53.751 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.742+0000 7f2c61c1a700 1 --2- 172.21.15.149:0/3725310896 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2c5c0cc870 0x7f2c5c06bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:23:53.751 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.742+0000 7f2c61419700 1 --2- 172.21.15.149:0/3725310896 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c48003a70 0x7f2c48003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:53.751 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.742+0000 7f2c60c18700 1 --2- 172.21.15.149:0/3725310896 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2c48004850 0x7f2c48004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:53.752 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.742+0000 7f2c61c1a700 1 --2- 172.21.15.149:0/3725310896 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2c48005210 0x7f2c4800dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:53.752 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.742+0000 7f2c61419700 1 -- 172.21.15.149:0/3725310896 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2c48005210 msgr2=0x7f2c4800dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:53.752 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.742+0000 7f2c61419700 1 --2- 172.21.15.149:0/3725310896 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2c48005210 0x7f2c4800dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:53.752 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.742+0000 7f2c61419700 1 -- 172.21.15.149:0/3725310896 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2c48004850 msgr2=0x7f2c48004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:53.752 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.742+0000 7f2c61419700 1 --2- 172.21.15.149:0/3725310896 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2c48004850 0x7f2c48004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:53.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.742+0000 7f2c61419700 1 -- 172.21.15.149:0/3725310896 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c480035b0 con 0x7f2c48003a70 2023-11-08T19:23:53.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.743+0000 7f2c61419700 1 --2- 172.21.15.149:0/3725310896 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c48003a70 0x7f2c48003e90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c009b60 tx=0x7f2c48005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65c7d4a82d972135 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:53.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.743+0000 7f2c53fff700 1 -- 172.21.15.149:0/3725310896 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4c00e6c0 con 0x7f2c48003a70 2023-11-08T19:23:53.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.743+0000 7f2c53fff700 1 -- 172.21.15.149:0/3725310896 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c4c00e820 con 0x7f2c48003a70 2023-11-08T19:23:53.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.743+0000 7f2c53fff700 1 -- 172.21.15.149:0/3725310896 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4c00eb90 con 0x7f2c48003a70 2023-11-08T19:23:53.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.743+0000 7f2c6367d700 1 -- 172.21.15.149:0/3725310896 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c48003a70 msgr2=0x7f2c48003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:53.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.743+0000 7f2c6367d700 1 --2- 172.21.15.149:0/3725310896 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c48003a70 0x7f2c48003e90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c009b60 tx=0x7f2c48005880 comp rx=0 tx=0).stop 2023-11-08T19:23:53.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.743+0000 7f2c61c1a700 1 -- 172.21.15.149:0/3725310896 reap_dead start 2023-11-08T19:23:53.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.743+0000 7f2c6367d700 1 -- 172.21.15.149:0/3725310896 shutdown_connections 2023-11-08T19:23:53.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.743+0000 7f2c6367d700 1 -- 172.21.15.149:0/3725310896 >> 172.21.15.149:0/3725310896 conn(0x7f2c5c0d0640 msgr2=0x7f2c5c0d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:53.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.743+0000 7f2c6367d700 1 -- 172.21.15.149:0/3725310896 shutdown_connections 2023-11-08T19:23:53.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.743+0000 7f2c6367d700 1 -- 172.21.15.149:0/3725310896 wait complete. 2023-11-08T19:23:53.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.745+0000 7f2c6367d700 1 Processor -- start 2023-11-08T19:23:53.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.745+0000 7f2c6367d700 1 -- start start 2023-11-08T19:23:53.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.745+0000 7f2c6367d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2c48003a70 0x7f2c5c1587f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:53.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.745+0000 7f2c6367d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2c5c0c9940 0x7f2c5c0c7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:53.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.745+0000 7f2c6367d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c5c0c7c50 0x7f2c5c0c80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:53.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.745+0000 7f2c6367d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c5c0acf80 con 0x7f2c5c0c7c50 2023-11-08T19:23:53.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.745+0000 7f2c6367d700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c5c15cef0 con 0x7f2c5c0c9940 2023-11-08T19:23:53.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.745+0000 7f2c6367d700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c5c15d1d0 con 0x7f2c48003a70 2023-11-08T19:23:53.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.745+0000 7f2c61c1a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c5c0c7c50 0x7f2c5c0c80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:53.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.745+0000 7f2c61c1a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c5c0c7c50 0x7f2c5c0c80d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38528/0 (socket says 172.21.15.149:38528) 2023-11-08T19:23:53.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.745+0000 7f2c61c1a700 1 -- 172.21.15.149:0/3922006578 learned_addr learned my addr 172.21.15.149:0/3922006578 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:53.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.746+0000 7f2c60c18700 1 --2- 172.21.15.149:0/3922006578 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2c5c0c9940 0x7f2c5c0c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:53.760 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.746+0000 7f2c61419700 1 --2- 172.21.15.149:0/3922006578 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2c48003a70 0x7f2c5c1587f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:53.760 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.746+0000 7f2c61c1a700 1 -- 172.21.15.149:0/3922006578 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2c48003a70 msgr2=0x7f2c5c1587f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:53.760 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.746+0000 7f2c61c1a700 1 --2- 172.21.15.149:0/3922006578 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2c48003a70 0x7f2c5c1587f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:53.760 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.746+0000 7f2c61c1a700 1 -- 172.21.15.149:0/3922006578 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2c5c0c9940 msgr2=0x7f2c5c0c7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:53.760 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.746+0000 7f2c61c1a700 1 --2- 172.21.15.149:0/3922006578 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2c5c0c9940 0x7f2c5c0c7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:53.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.746+0000 7f2c61c1a700 1 -- 172.21.15.149:0/3922006578 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c5c0ac8c0 con 0x7f2c5c0c7c50 2023-11-08T19:23:53.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.746+0000 7f2c61c1a700 1 --2- 172.21.15.149:0/3922006578 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c5c0c7c50 0x7f2c5c0c80d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c0cabf0 tx=0x7f2c5400f6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:53.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.746+0000 7f2c51ffb700 1 -- 172.21.15.149:0/3922006578 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c5400e040 con 0x7f2c5c0c7c50 2023-11-08T19:23:53.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.746+0000 7f2c51ffb700 1 -- 172.21.15.149:0/3922006578 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c5400f040 con 0x7f2c5c0c7c50 2023-11-08T19:23:53.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.746+0000 7f2c6367d700 1 -- 172.21.15.149:0/3922006578 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c5c0acba0 con 0x7f2c5c0c7c50 2023-11-08T19:23:53.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.746+0000 7f2c51ffb700 1 -- 172.21.15.149:0/3922006578 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c54015430 con 0x7f2c5c0c7c50 2023-11-08T19:23:53.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.746+0000 7f2c6367d700 1 -- 172.21.15.149:0/3922006578 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c5c158d30 con 0x7f2c5c0c7c50 2023-11-08T19:23:53.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.747+0000 7f2c6367d700 1 -- 172.21.15.149:0/3922006578 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c5c0afed0 con 0x7f2c5c0c7c50 2023-11-08T19:23:53.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.748+0000 7f2c51ffb700 1 -- 172.21.15.149:0/3922006578 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2c54015590 con 0x7f2c5c0c7c50 2023-11-08T19:23:53.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.748+0000 7f2c51ffb700 1 --2- 172.21.15.149:0/3922006578 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2c4006af00 0x7f2c4006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:53.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.748+0000 7f2c51ffb700 1 -- 172.21.15.149:0/3922006578 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2c5408a270 con 0x7f2c5c0c7c50 2023-11-08T19:23:53.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.748+0000 7f2c61419700 1 --2- 172.21.15.149:0/3922006578 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2c4006af00 0x7f2c4006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:53.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.749+0000 7f2c61419700 1 --2- 172.21.15.149:0/3922006578 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2c4006af00 0x7f2c4006d3c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c0090b0 tx=0x7f2c4c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:53.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.753+0000 7f2c51ffb700 1 -- 172.21.15.149:0/3922006578 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2c540550a0 con 0x7f2c5c0c7c50 2023-11-08T19:23:53.940 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.939+0000 7f2c6367d700 1 -- 172.21.15.149:0/3922006578 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2c5c04f730 con 0x7f2c5c0c7c50 2023-11-08T19:23:53.940 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.939+0000 7f2c51ffb700 1 -- 172.21.15.149:0/3922006578 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2c540586c0 con 0x7f2c5c0c7c50 2023-11-08T19:23:53.941 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 1 2023-11-08T19:23:53.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.941+0000 7f2c6367d700 1 -- 172.21.15.149:0/3922006578 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2c4006af00 msgr2=0x7f2c4006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:53.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.941+0000 7f2c6367d700 1 --2- 172.21.15.149:0/3922006578 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2c4006af00 0x7f2c4006d3c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c0090b0 tx=0x7f2c4c008030 comp rx=0 tx=0).stop 2023-11-08T19:23:53.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.941+0000 7f2c6367d700 1 -- 172.21.15.149:0/3922006578 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c5c0c7c50 msgr2=0x7f2c5c0c80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:53.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.941+0000 7f2c6367d700 1 --2- 172.21.15.149:0/3922006578 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c5c0c7c50 0x7f2c5c0c80d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c0cabf0 tx=0x7f2c5400f6c0 comp rx=0 tx=0).stop 2023-11-08T19:23:53.944 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.941+0000 7f2c6367d700 1 -- 172.21.15.149:0/3922006578 shutdown_connections 2023-11-08T19:23:53.944 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.941+0000 7f2c6367d700 1 --2- 172.21.15.149:0/3922006578 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2c4006af00 0x7f2c4006d3c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:53.944 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.941+0000 7f2c6367d700 1 --2- 172.21.15.149:0/3922006578 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c5c0c7c50 0x7f2c5c0c80d0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:53.944 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.941+0000 7f2c6367d700 1 --2- 172.21.15.149:0/3922006578 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2c48003a70 0x7f2c5c1587f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:53.944 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.941+0000 7f2c6367d700 1 --2- 172.21.15.149:0/3922006578 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2c5c0c9940 0x7f2c5c0c7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:53.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.941+0000 7f2c6367d700 1 -- 172.21.15.149:0/3922006578 >> 172.21.15.149:0/3922006578 conn(0x7f2c5c0d0640 msgr2=0x7f2c5c072a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:53.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.941+0000 7f2c6367d700 1 -- 172.21.15.149:0/3922006578 shutdown_connections 2023-11-08T19:23:53.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:53.941+0000 7f2c6367d700 1 -- 172.21.15.149:0/3922006578 wait complete. 2023-11-08T19:23:53.955 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-08T19:23:54.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.078+0000 7f069c3b9700 1 Processor -- start 2023-11-08T19:23:54.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.078+0000 7f069c3b9700 1 -- start start 2023-11-08T19:23:54.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.079+0000 7f069c3b9700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f069406ab80 0x7f06940caf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:54.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.079+0000 7f069c3b9700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f06940cf1c0 0x7f06940cb490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:54.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.079+0000 7f069c3b9700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f069415e320 con 0x7f069415df40 2023-11-08T19:23:54.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.079+0000 7f069c3b9700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f069406b020 con 0x7f069406ab80 2023-11-08T19:23:54.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.079+0000 7f069c3b9700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f069406b2e0 con 0x7f06940cf1c0 2023-11-08T19:23:54.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.080+0000 7f0699954700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f069406ab80 0x7f06940caf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:54.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.080+0000 7f0699954700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f069406ab80 0x7f06940caf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38532/0 (socket says 172.21.15.149:38532) 2023-11-08T19:23:54.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.080+0000 7f0699954700 1 -- 172.21.15.149:0/2836380618 learned_addr learned my addr 172.21.15.149:0/2836380618 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:54.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.080+0000 7f069a956700 1 --2- 172.21.15.149:0/2836380618 >> v2:172.21.15.160:3300/0 conn(0x7f06940cf1c0 0x7f06940cb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:54.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.080+0000 7f0699954700 1 -- 172.21.15.149:0/2836380618 >> v2:172.21.15.160:3300/0 conn(0x7f06940cf1c0 msgr2=0x7f06940cb490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:54.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.080+0000 7f0699954700 1 --2- 172.21.15.149:0/2836380618 >> v2:172.21.15.160:3300/0 conn(0x7f06940cf1c0 0x7f06940cb490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:54.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.080+0000 7f0699954700 1 -- 172.21.15.149:0/2836380618 >> v1:172.21.15.160:6789/0 conn(0x7f069415df40 legacy=0x7f069406c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:54.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.080+0000 7f0699954700 1 -- 172.21.15.149:0/2836380618 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f069406b5c0 con 0x7f069406ab80 2023-11-08T19:23:54.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.080+0000 7f069a956700 1 --2- 172.21.15.149:0/2836380618 >> v2:172.21.15.160:3300/0 conn(0x7f06940cf1c0 0x7f06940cb490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:23:54.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.080+0000 7f0699954700 1 --2- 172.21.15.149:0/2836380618 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f069406ab80 0x7f06940caf50 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f06940b2180 tx=0x7f0690009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eae0f01f000cae3 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:54.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.080+0000 7f0699153700 1 -- 172.21.15.149:0/2836380618 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0690004230 con 0x7f069406ab80 2023-11-08T19:23:54.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.080+0000 7f0699153700 1 -- 172.21.15.149:0/2836380618 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0690004390 con 0x7f069406ab80 2023-11-08T19:23:54.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.080+0000 7f0699153700 1 -- 172.21.15.149:0/2836380618 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06900036a0 con 0x7f069406ab80 2023-11-08T19:23:54.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.081+0000 7f069c3b9700 1 -- 172.21.15.149:0/2836380618 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f069406ab80 msgr2=0x7f06940caf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:54.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.081+0000 7f069c3b9700 1 --2- 172.21.15.149:0/2836380618 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f069406ab80 0x7f06940caf50 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f06940b2180 tx=0x7f0690009bd0 comp rx=0 tx=0).stop 2023-11-08T19:23:54.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.081+0000 7f069c3b9700 1 -- 172.21.15.149:0/2836380618 shutdown_connections 2023-11-08T19:23:54.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.081+0000 7f069c3b9700 1 --2- 172.21.15.149:0/2836380618 >> v2:172.21.15.160:3300/0 conn(0x7f06940cf1c0 0x7f06940cb490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:54.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.081+0000 7f069c3b9700 1 --2- 172.21.15.149:0/2836380618 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f069406ab80 0x7f06940caf50 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:54.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.081+0000 7f069c3b9700 1 -- 172.21.15.149:0/2836380618 >> 172.21.15.149:0/2836380618 conn(0x7f06940d0640 msgr2=0x7f06940d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:54.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.081+0000 7f069c3b9700 1 -- 172.21.15.149:0/2836380618 shutdown_connections 2023-11-08T19:23:54.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.081+0000 7f069c3b9700 1 -- 172.21.15.149:0/2836380618 wait complete. 2023-11-08T19:23:54.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.082+0000 7f069c3b9700 1 Processor -- start 2023-11-08T19:23:54.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.082+0000 7f069c3b9700 1 -- start start 2023-11-08T19:23:54.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.083+0000 7f069c3b9700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f069406ab80 0x7f06940ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:54.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.083+0000 7f069c3b9700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06940cf1c0 0x7f06940c7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:54.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.083+0000 7f069c3b9700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f069415df40 0x7f0694149a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:54.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.083+0000 7f069c3b9700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06940ace00 con 0x7f06940cf1c0 2023-11-08T19:23:54.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.083+0000 7f069c3b9700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06940c7c50 con 0x7f069415df40 2023-11-08T19:23:54.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.083+0000 7f069c3b9700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0694157820 con 0x7f069406ab80 2023-11-08T19:23:54.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.083+0000 7f0699954700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06940cf1c0 0x7f06940c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:54.092 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.083+0000 7f0699954700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06940cf1c0 0x7f06940c7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38538/0 (socket says 172.21.15.149:38538) 2023-11-08T19:23:54.092 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.083+0000 7f0699954700 1 -- 172.21.15.149:0/3574215094 learned_addr learned my addr 172.21.15.149:0/3574215094 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:54.092 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.083+0000 7f0699954700 1 -- 172.21.15.149:0/3574215094 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f069406ab80 msgr2=0x7f06940ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:54.092 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.083+0000 7f0699954700 1 --2- 172.21.15.149:0/3574215094 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f069406ab80 0x7f06940ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:54.093 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.083+0000 7f0699954700 1 -- 172.21.15.149:0/3574215094 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f069415df40 msgr2=0x7f0694149a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:54.093 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.083+0000 7f0699954700 1 --2- 172.21.15.149:0/3574215094 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f069415df40 0x7f0694149a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:54.093 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.083+0000 7f0699954700 1 -- 172.21.15.149:0/3574215094 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0690009550 con 0x7f06940cf1c0 2023-11-08T19:23:54.093 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.083+0000 7f0699954700 1 --2- 172.21.15.149:0/3574215094 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06940cf1c0 0x7f06940c7710 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f0690009fd0 tx=0x7f0690004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:54.093 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.083+0000 7f068affd700 1 -- 172.21.15.149:0/3574215094 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0690003d70 con 0x7f06940cf1c0 2023-11-08T19:23:54.094 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.083+0000 7f068affd700 1 -- 172.21.15.149:0/3574215094 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f069001f070 con 0x7f06940cf1c0 2023-11-08T19:23:54.094 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.083+0000 7f069c3b9700 1 -- 172.21.15.149:0/3574215094 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f069415f680 con 0x7f06940cf1c0 2023-11-08T19:23:54.094 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.083+0000 7f068affd700 1 -- 172.21.15.149:0/3574215094 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0690011870 con 0x7f06940cf1c0 2023-11-08T19:23:54.094 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.083+0000 7f069c3b9700 1 -- 172.21.15.149:0/3574215094 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f069415fc00 con 0x7f06940cf1c0 2023-11-08T19:23:54.094 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.084+0000 7f069c3b9700 1 -- 172.21.15.149:0/3574215094 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f069404f730 con 0x7f06940cf1c0 2023-11-08T19:23:54.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.085+0000 7f068affd700 1 -- 172.21.15.149:0/3574215094 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0690021030 con 0x7f06940cf1c0 2023-11-08T19:23:54.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.085+0000 7f068affd700 1 --2- 172.21.15.149:0/3574215094 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f067806af00 0x7f067806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:54.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.085+0000 7f068affd700 1 -- 172.21.15.149:0/3574215094 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f069008af70 con 0x7f06940cf1c0 2023-11-08T19:23:54.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.085+0000 7f069a155700 1 --2- 172.21.15.149:0/3574215094 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f067806af00 0x7f067806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:54.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.086+0000 7f069a155700 1 --2- 172.21.15.149:0/3574215094 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f067806af00 0x7f067806d3c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f06940af930 tx=0x7f0684006c50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:54.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.090+0000 7f068affd700 1 -- 172.21.15.149:0/3574215094 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f06900bdca0 con 0x7f06940cf1c0 2023-11-08T19:23:54.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.279+0000 7f069c3b9700 1 -- 172.21.15.149:0/3574215094 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0694158150 con 0x7f06940cf1c0 2023-11-08T19:23:54.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.279+0000 7f068affd700 1 -- 172.21.15.149:0/3574215094 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0690055cf0 con 0x7f06940cf1c0 2023-11-08T19:23:54.281 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:23:54.283 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.282+0000 7f069c3b9700 1 -- 172.21.15.149:0/3574215094 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f067806af00 msgr2=0x7f067806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:54.284 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.282+0000 7f069c3b9700 1 --2- 172.21.15.149:0/3574215094 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f067806af00 0x7f067806d3c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f06940af930 tx=0x7f0684006c50 comp rx=0 tx=0).stop 2023-11-08T19:23:54.284 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.282+0000 7f069c3b9700 1 -- 172.21.15.149:0/3574215094 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06940cf1c0 msgr2=0x7f06940c7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:54.284 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.282+0000 7f069c3b9700 1 --2- 172.21.15.149:0/3574215094 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06940cf1c0 0x7f06940c7710 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f0690009fd0 tx=0x7f0690004750 comp rx=0 tx=0).stop 2023-11-08T19:23:54.284 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.282+0000 7f069c3b9700 1 -- 172.21.15.149:0/3574215094 shutdown_connections 2023-11-08T19:23:54.284 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.282+0000 7f069c3b9700 1 --2- 172.21.15.149:0/3574215094 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f067806af00 0x7f067806d3c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:54.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.282+0000 7f069c3b9700 1 --2- 172.21.15.149:0/3574215094 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f069415df40 0x7f0694149a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:54.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.282+0000 7f069c3b9700 1 --2- 172.21.15.149:0/3574215094 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f069406ab80 0x7f06940ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:54.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.282+0000 7f069c3b9700 1 --2- 172.21.15.149:0/3574215094 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06940cf1c0 0x7f06940c7710 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:54.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.282+0000 7f069c3b9700 1 -- 172.21.15.149:0/3574215094 >> 172.21.15.149:0/3574215094 conn(0x7f06940d0640 msgr2=0x7f069406bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:54.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.282+0000 7f069c3b9700 1 -- 172.21.15.149:0/3574215094 shutdown_connections 2023-11-08T19:23:54.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.282+0000 7f069c3b9700 1 -- 172.21.15.149:0/3574215094 wait complete. 2023-11-08T19:23:54.295 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-08T19:23:54.422 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.421+0000 7f1c33754700 1 Processor -- start 2023-11-08T19:23:54.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.421+0000 7f1c33754700 1 -- start start 2023-11-08T19:23:54.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.422+0000 7f1c33754700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f1c2c0cf320 0x7f1c2c0cf740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:54.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.422+0000 7f1c33754700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c2c15be80 con 0x7f1c2c0cc0d0 2023-11-08T19:23:54.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.422+0000 7f1c33754700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c2c0cfc80 con 0x7f1c2c15f470 2023-11-08T19:23:54.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.422+0000 7f1c33754700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c2c0ccbc0 con 0x7f1c2c0cf320 2023-11-08T19:23:54.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.422+0000 7f1c314f0700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f1c2c0cc0d0 0x7f1c2c0cc4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:40546/0 (socket says 172.21.15.149:40546) 2023-11-08T19:23:54.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.422+0000 7f1c314f0700 1 -- 172.21.15.149:0/527640078 learned_addr learned my addr 172.21.15.149:0/527640078 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:23:54.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.422+0000 7f1c23fff700 1 -- 172.21.15.149:0/527640078 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3406023900 0 0) 0x7f1c2c15be80 con 0x7f1c2c0cc0d0 2023-11-08T19:23:54.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.422+0000 7f1c31cf1700 1 --2- 172.21.15.149:0/527640078 >> v2:172.21.15.160:3300/0 conn(0x7f1c2c0cf320 0x7f1c2c0cf740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:54.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.422+0000 7f1c23fff700 1 -- 172.21.15.149:0/527640078 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c180035b0 con 0x7f1c2c0cc0d0 2023-11-08T19:23:54.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.422+0000 7f1c23fff700 1 -- 172.21.15.149:0/527640078 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1445356767 0 0) 0x7f1c180035b0 con 0x7f1c2c0cc0d0 2023-11-08T19:23:54.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.422+0000 7f1c23fff700 1 -- 172.21.15.149:0/527640078 >> v2:172.21.15.160:3300/0 conn(0x7f1c2c0cf320 msgr2=0x7f1c2c0cf740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:54.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.422+0000 7f1c23fff700 1 --2- 172.21.15.149:0/527640078 >> v2:172.21.15.160:3300/0 conn(0x7f1c2c0cf320 0x7f1c2c0cf740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:54.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.422+0000 7f1c23fff700 1 -- 172.21.15.149:0/527640078 >> v1:172.21.15.160:6789/0 conn(0x7f1c2c15f470 legacy=0x7f1c2c15c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:54.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.422+0000 7f1c23fff700 1 -- 172.21.15.149:0/527640078 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c2c15f8d0 con 0x7f1c2c0cc0d0 2023-11-08T19:23:54.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.422+0000 7f1c23fff700 1 -- 172.21.15.149:0/527640078 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f1c28001670 con 0x7f1c2c0cc0d0 2023-11-08T19:23:54.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.423+0000 7f1c23fff700 1 -- 172.21.15.149:0/527640078 >> v1:172.21.15.149:6789/0 conn(0x7f1c2c0cc0d0 legacy=0x7f1c2c0cc4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:54.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.423+0000 7f1c23fff700 1 --2- 172.21.15.149:0/527640078 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1c18003a70 0x7f1c18003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:54.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.423+0000 7f1c23fff700 1 --2- 172.21.15.149:0/527640078 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1c18004850 0x7f1c18004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:54.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.423+0000 7f1c23fff700 1 --2- 172.21.15.149:0/527640078 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1c18005210 0x7f1c1800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:54.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.423+0000 7f1c23fff700 1 -- 172.21.15.149:0/527640078 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2c0ccbc0 con 0x7f1c18004850 2023-11-08T19:23:54.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.423+0000 7f1c23fff700 1 -- 172.21.15.149:0/527640078 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1800c140 con 0x7f1c18005210 2023-11-08T19:23:54.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.423+0000 7f1c23fff700 1 -- 172.21.15.149:0/527640078 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1800c300 con 0x7f1c18003a70 2023-11-08T19:23:54.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.423+0000 7f1c30cef700 1 --2- 172.21.15.149:0/527640078 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1c18004850 0x7f1c18004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:54.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.423+0000 7f1c314f0700 1 --2- 172.21.15.149:0/527640078 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1c18003a70 0x7f1c18003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:54.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.423+0000 7f1c31cf1700 1 --2- 172.21.15.149:0/527640078 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1c18005210 0x7f1c1800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:54.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.423+0000 7f1c30cef700 1 -- 172.21.15.149:0/527640078 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1c18003a70 msgr2=0x7f1c18003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:54.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.423+0000 7f1c30cef700 1 --2- 172.21.15.149:0/527640078 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1c18003a70 0x7f1c18003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:54.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.423+0000 7f1c30cef700 1 -- 172.21.15.149:0/527640078 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1c18005210 msgr2=0x7f1c1800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:54.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.423+0000 7f1c30cef700 1 --2- 172.21.15.149:0/527640078 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1c18005210 0x7f1c1800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:54.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.423+0000 7f1c30cef700 1 -- 172.21.15.149:0/527640078 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c180035b0 con 0x7f1c18004850 2023-11-08T19:23:54.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.423+0000 7f1c31cf1700 1 --2- 172.21.15.149:0/527640078 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1c18005210 0x7f1c1800ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:23:54.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.423+0000 7f1c31cf1700 1 -- 172.21.15.149:0/527640078 reap_dead start 2023-11-08T19:23:54.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.423+0000 7f1c30cef700 1 --2- 172.21.15.149:0/527640078 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1c18004850 0x7f1c18004cd0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c001800 tx=0x7f1c18005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fad614b80e7ff89e server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:54.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.423+0000 7f1c23fff700 1 -- 172.21.15.149:0/527640078 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c0012f0 con 0x7f1c18004850 2023-11-08T19:23:54.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.423+0000 7f1c23fff700 1 -- 172.21.15.149:0/527640078 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c1c005310 con 0x7f1c18004850 2023-11-08T19:23:54.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.423+0000 7f1c23fff700 1 -- 172.21.15.149:0/527640078 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c006860 con 0x7f1c18004850 2023-11-08T19:23:54.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.424+0000 7f1c33754700 1 -- 172.21.15.149:0/527640078 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1c18004850 msgr2=0x7f1c18004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:54.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.424+0000 7f1c33754700 1 --2- 172.21.15.149:0/527640078 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1c18004850 0x7f1c18004cd0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c001800 tx=0x7f1c18005880 comp rx=0 tx=0).stop 2023-11-08T19:23:54.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.424+0000 7f1c33754700 1 -- 172.21.15.149:0/527640078 shutdown_connections 2023-11-08T19:23:54.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.424+0000 7f1c33754700 1 --2- 172.21.15.149:0/527640078 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1c18004850 0x7f1c18004cd0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:54.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.424+0000 7f1c33754700 1 -- 172.21.15.149:0/527640078 >> 172.21.15.149:0/527640078 conn(0x7f1c2c06f120 msgr2=0x7f1c2c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:54.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.424+0000 7f1c33754700 1 -- 172.21.15.149:0/527640078 shutdown_connections 2023-11-08T19:23:54.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.424+0000 7f1c33754700 1 -- 172.21.15.149:0/527640078 wait complete. 2023-11-08T19:23:54.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.425+0000 7f1c33754700 1 Processor -- start 2023-11-08T19:23:54.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.425+0000 7f1c33754700 1 -- start start 2023-11-08T19:23:54.438 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.426+0000 7f1c33754700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1c18004850 0x7f1c2c0c5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:54.439 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.426+0000 7f1c33754700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1c2c0b0050 0x7f1c2c0c5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:54.439 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.426+0000 7f1c33754700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1c2c0c60b0 0x7f1c2c1f6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:54.439 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.426+0000 7f1c33754700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2c0c6560 con 0x7f1c2c0c60b0 2023-11-08T19:23:54.439 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.426+0000 7f1c33754700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2c06c570 con 0x7f1c18004850 2023-11-08T19:23:54.440 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.426+0000 7f1c33754700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2c06bfb0 con 0x7f1c2c0b0050 2023-11-08T19:23:54.440 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.426+0000 7f1c31cf1700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1c2c0c60b0 0x7f1c2c1f6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:54.440 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.426+0000 7f1c31cf1700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1c2c0c60b0 0x7f1c2c1f6990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38558/0 (socket says 172.21.15.149:38558) 2023-11-08T19:23:54.440 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.426+0000 7f1c31cf1700 1 -- 172.21.15.149:0/3237112690 learned_addr learned my addr 172.21.15.149:0/3237112690 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:54.440 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.426+0000 7f1c30cef700 1 --2- 172.21.15.149:0/3237112690 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1c2c0b0050 0x7f1c2c0c5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:54.440 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.426+0000 7f1c314f0700 1 --2- 172.21.15.149:0/3237112690 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1c18004850 0x7f1c2c0c5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:54.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.426+0000 7f1c31cf1700 1 -- 172.21.15.149:0/3237112690 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1c2c0b0050 msgr2=0x7f1c2c0c5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:54.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.426+0000 7f1c31cf1700 1 --2- 172.21.15.149:0/3237112690 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1c2c0b0050 0x7f1c2c0c5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:54.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.426+0000 7f1c31cf1700 1 -- 172.21.15.149:0/3237112690 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1c18004850 msgr2=0x7f1c2c0c5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:54.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.426+0000 7f1c31cf1700 1 --2- 172.21.15.149:0/3237112690 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1c18004850 0x7f1c2c0c5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:54.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.426+0000 7f1c31cf1700 1 -- 172.21.15.149:0/3237112690 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c2c06c290 con 0x7f1c2c0c60b0 2023-11-08T19:23:54.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.426+0000 7f1c31cf1700 1 --2- 172.21.15.149:0/3237112690 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1c2c0c60b0 0x7f1c2c1f6990 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c0b7890 tx=0x7f1c240104a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:54.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.427+0000 7f1c21ffb700 1 -- 172.21.15.149:0/3237112690 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c2401b070 con 0x7f1c2c0c60b0 2023-11-08T19:23:54.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.427+0000 7f1c21ffb700 1 -- 172.21.15.149:0/3237112690 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c2400f040 con 0x7f1c2c0c60b0 2023-11-08T19:23:54.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.427+0000 7f1c33754700 1 -- 172.21.15.149:0/3237112690 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c2c1582d0 con 0x7f1c2c0c60b0 2023-11-08T19:23:54.443 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.427+0000 7f1c21ffb700 1 -- 172.21.15.149:0/3237112690 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c2400e050 con 0x7f1c2c0c60b0 2023-11-08T19:23:54.443 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.427+0000 7f1c33754700 1 -- 172.21.15.149:0/3237112690 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c2c0c57a0 con 0x7f1c2c0c60b0 2023-11-08T19:23:54.443 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.428+0000 7f1c33754700 1 -- 172.21.15.149:0/3237112690 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c2c0684f0 con 0x7f1c2c0c60b0 2023-11-08T19:23:54.443 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.428+0000 7f1c21ffb700 1 -- 172.21.15.149:0/3237112690 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1c24015440 con 0x7f1c2c0c60b0 2023-11-08T19:23:54.443 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.429+0000 7f1c21ffb700 1 --2- 172.21.15.149:0/3237112690 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1c1006af00 0x7f1c1006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:54.444 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.429+0000 7f1c21ffb700 1 -- 172.21.15.149:0/3237112690 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1c24089b40 con 0x7f1c2c0c60b0 2023-11-08T19:23:54.444 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.429+0000 7f1c314f0700 1 --2- 172.21.15.149:0/3237112690 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1c1006af00 0x7f1c1006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:54.444 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.429+0000 7f1c314f0700 1 --2- 172.21.15.149:0/3237112690 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1c1006af00 0x7f1c1006d3c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1c28007db0 tx=0x7f1c28009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:54.444 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.434+0000 7f1c21ffb700 1 -- 172.21.15.149:0/3237112690 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1c24054790 con 0x7f1c2c0c60b0 2023-11-08T19:23:54.625 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.624+0000 7f1c33754700 1 -- 172.21.15.149:0/3237112690 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1c2c04f730 con 0x7f1c2c0c60b0 2023-11-08T19:23:54.626 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.625+0000 7f1c21ffb700 1 -- 172.21.15.149:0/3237112690 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1c24057db0 con 0x7f1c2c0c60b0 2023-11-08T19:23:54.626 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 64 2023-11-08T19:23:54.628 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.627+0000 7f1c33754700 1 -- 172.21.15.149:0/3237112690 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1c1006af00 msgr2=0x7f1c1006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:54.629 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.627+0000 7f1c33754700 1 --2- 172.21.15.149:0/3237112690 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1c1006af00 0x7f1c1006d3c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1c28007db0 tx=0x7f1c28009040 comp rx=0 tx=0).stop 2023-11-08T19:23:54.629 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.627+0000 7f1c33754700 1 -- 172.21.15.149:0/3237112690 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1c2c0c60b0 msgr2=0x7f1c2c1f6990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:54.629 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.627+0000 7f1c33754700 1 --2- 172.21.15.149:0/3237112690 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1c2c0c60b0 0x7f1c2c1f6990 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c0b7890 tx=0x7f1c240104a0 comp rx=0 tx=0).stop 2023-11-08T19:23:54.629 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.627+0000 7f1c33754700 1 -- 172.21.15.149:0/3237112690 shutdown_connections 2023-11-08T19:23:54.630 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.627+0000 7f1c33754700 1 --2- 172.21.15.149:0/3237112690 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1c1006af00 0x7f1c1006d3c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:54.630 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.627+0000 7f1c33754700 1 --2- 172.21.15.149:0/3237112690 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1c18004850 0x7f1c2c0c5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:54.630 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.627+0000 7f1c33754700 1 --2- 172.21.15.149:0/3237112690 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1c2c0c60b0 0x7f1c2c1f6990 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:54.631 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.627+0000 7f1c33754700 1 --2- 172.21.15.149:0/3237112690 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1c2c0b0050 0x7f1c2c0c5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:54.631 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.627+0000 7f1c33754700 1 -- 172.21.15.149:0/3237112690 >> 172.21.15.149:0/3237112690 conn(0x7f1c2c06f120 msgr2=0x7f1c2c15ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:54.631 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.627+0000 7f1c33754700 1 -- 172.21.15.149:0/3237112690 shutdown_connections 2023-11-08T19:23:54.631 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.627+0000 7f1c33754700 1 -- 172.21.15.149:0/3237112690 wait complete. 2023-11-08T19:23:54.641 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-08T19:23:54.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.764+0000 7fa52c654700 1 Processor -- start 2023-11-08T19:23:54.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.764+0000 7fa52c654700 1 -- start start 2023-11-08T19:23:54.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.765+0000 7fa52c654700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fa52406c3a0 0x7fa524165660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:54.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.765+0000 7fa52c654700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa52406d8b0 con 0x7fa5240668e0 2023-11-08T19:23:54.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.765+0000 7fa52c654700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5240cee60 con 0x7fa52415aaf0 2023-11-08T19:23:54.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.765+0000 7fa52c654700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5240cf140 con 0x7fa52406c3a0 2023-11-08T19:23:54.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.765+0000 7fa529bef700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fa5240668e0 0x7fa52406bc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:40564/0 (socket says 172.21.15.149:40564) 2023-11-08T19:23:54.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.765+0000 7fa529bef700 1 -- 172.21.15.149:0/1549238850 learned_addr learned my addr 172.21.15.149:0/1549238850 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:23:54.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.765+0000 7fa52abf1700 1 --2- 172.21.15.149:0/1549238850 >> v2:172.21.15.160:3300/0 conn(0x7fa52406c3a0 0x7fa524165660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:54.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.765+0000 7fa5293ee700 1 -- 172.21.15.149:0/1549238850 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4082347705 0 0) 0x7fa52406d8b0 con 0x7fa5240668e0 2023-11-08T19:23:54.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.765+0000 7fa5293ee700 1 -- 172.21.15.149:0/1549238850 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5100035b0 con 0x7fa5240668e0 2023-11-08T19:23:54.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.765+0000 7fa5293ee700 1 -- 172.21.15.149:0/1549238850 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2894624821 0 0) 0x7fa5100035b0 con 0x7fa5240668e0 2023-11-08T19:23:54.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.765+0000 7fa5293ee700 1 -- 172.21.15.149:0/1549238850 >> v2:172.21.15.160:3300/0 conn(0x7fa52406c3a0 msgr2=0x7fa524165660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:54.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.765+0000 7fa5293ee700 1 --2- 172.21.15.149:0/1549238850 >> v2:172.21.15.160:3300/0 conn(0x7fa52406c3a0 0x7fa524165660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:54.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.765+0000 7fa5293ee700 1 -- 172.21.15.149:0/1549238850 >> v1:172.21.15.160:6789/0 conn(0x7fa52415aaf0 legacy=0x7fa5240ce6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:54.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.765+0000 7fa5293ee700 1 -- 172.21.15.149:0/1549238850 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5240cf420 con 0x7fa5240668e0 2023-11-08T19:23:54.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.765+0000 7fa5293ee700 1 -- 172.21.15.149:0/1549238850 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7fa514001670 con 0x7fa5240668e0 2023-11-08T19:23:54.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.765+0000 7fa5293ee700 1 -- 172.21.15.149:0/1549238850 >> v1:172.21.15.149:6789/0 conn(0x7fa5240668e0 legacy=0x7fa52406bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:54.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.765+0000 7fa5293ee700 1 --2- 172.21.15.149:0/1549238850 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa510003a70 0x7fa510003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:54.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.765+0000 7fa5293ee700 1 --2- 172.21.15.149:0/1549238850 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa510004850 0x7fa510004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:54.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.765+0000 7fa5293ee700 1 --2- 172.21.15.149:0/1549238850 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa510005210 0x7fa51000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:54.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.765+0000 7fa5293ee700 1 -- 172.21.15.149:0/1549238850 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5240cf140 con 0x7fa510005210 2023-11-08T19:23:54.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.765+0000 7fa5293ee700 1 -- 172.21.15.149:0/1549238850 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa51000c140 con 0x7fa510003a70 2023-11-08T19:23:54.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.765+0000 7fa5293ee700 1 -- 172.21.15.149:0/1549238850 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa51000c300 con 0x7fa510004850 2023-11-08T19:23:54.779 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.766+0000 7fa52abf1700 1 --2- 172.21.15.149:0/1549238850 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa510005210 0x7fa51000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:54.779 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.766+0000 7fa52a3f0700 1 --2- 172.21.15.149:0/1549238850 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa510003a70 0x7fa510003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:54.779 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.766+0000 7fa529bef700 1 --2- 172.21.15.149:0/1549238850 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa510004850 0x7fa510004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:54.779 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.766+0000 7fa52abf1700 1 -- 172.21.15.149:0/1549238850 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa510004850 msgr2=0x7fa510004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:54.779 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.766+0000 7fa52abf1700 1 --2- 172.21.15.149:0/1549238850 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa510004850 0x7fa510004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:54.780 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.766+0000 7fa52abf1700 1 -- 172.21.15.149:0/1549238850 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa510003a70 msgr2=0x7fa510003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:54.780 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.766+0000 7fa52abf1700 1 --2- 172.21.15.149:0/1549238850 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa510003a70 0x7fa510003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:54.780 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.766+0000 7fa52abf1700 1 -- 172.21.15.149:0/1549238850 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5100035b0 con 0x7fa510005210 2023-11-08T19:23:54.780 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.766+0000 7fa529bef700 1 --2- 172.21.15.149:0/1549238850 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa510004850 0x7fa510004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:23:54.780 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.766+0000 7fa52abf1700 1 -- 172.21.15.149:0/1549238850 reap_dead start 2023-11-08T19:23:54.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.766+0000 7fa52abf1700 1 --2- 172.21.15.149:0/1549238850 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa510005210 0x7fa51000ba10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa51c009fc0 tx=0x7fa510005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2c836a821dc966 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:54.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.766+0000 7fa5293ee700 1 -- 172.21.15.149:0/1549238850 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51c003a20 con 0x7fa510005210 2023-11-08T19:23:54.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.766+0000 7fa5293ee700 1 -- 172.21.15.149:0/1549238850 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa51c00f040 con 0x7fa510005210 2023-11-08T19:23:54.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.766+0000 7fa5293ee700 1 -- 172.21.15.149:0/1549238850 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51c003de0 con 0x7fa510005210 2023-11-08T19:23:54.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.767+0000 7fa52c654700 1 -- 172.21.15.149:0/1549238850 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa510005210 msgr2=0x7fa51000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:54.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.767+0000 7fa52c654700 1 --2- 172.21.15.149:0/1549238850 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa510005210 0x7fa51000ba10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa51c009fc0 tx=0x7fa510005880 comp rx=0 tx=0).stop 2023-11-08T19:23:54.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.767+0000 7fa52c654700 1 -- 172.21.15.149:0/1549238850 shutdown_connections 2023-11-08T19:23:54.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.767+0000 7fa52c654700 1 --2- 172.21.15.149:0/1549238850 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa510005210 0x7fa51000ba10 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:54.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.767+0000 7fa52c654700 1 -- 172.21.15.149:0/1549238850 >> 172.21.15.149:0/1549238850 conn(0x7fa5240cc860 msgr2=0x7fa5240ccc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:54.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.767+0000 7fa52c654700 1 -- 172.21.15.149:0/1549238850 shutdown_connections 2023-11-08T19:23:54.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.767+0000 7fa52c654700 1 -- 172.21.15.149:0/1549238850 wait complete. 2023-11-08T19:23:54.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.768+0000 7fa52c654700 1 Processor -- start 2023-11-08T19:23:54.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.768+0000 7fa52c654700 1 -- start start 2023-11-08T19:23:54.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.769+0000 7fa52c654700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa510005210 0x7fa5241e0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:54.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.769+0000 7fa52c654700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa5241e16c0 0x7fa5240c93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:54.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.769+0000 7fa52c654700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa5240c98f0 0x7fa5240c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:54.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.769+0000 7fa52c654700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5240c9da0 con 0x7fa510005210 2023-11-08T19:23:54.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.769+0000 7fa52c654700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa524151d50 con 0x7fa5241e16c0 2023-11-08T19:23:54.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.769+0000 7fa52c654700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5241e1230 con 0x7fa5240c98f0 2023-11-08T19:23:54.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.769+0000 7fa52a3f0700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa510005210 0x7fa5241e0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:54.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.769+0000 7fa52a3f0700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa510005210 0x7fa5241e0040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38574/0 (socket says 172.21.15.149:38574) 2023-11-08T19:23:54.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.769+0000 7fa52a3f0700 1 -- 172.21.15.149:0/3935990164 learned_addr learned my addr 172.21.15.149:0/3935990164 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:54.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.769+0000 7fa529bef700 1 --2- 172.21.15.149:0/3935990164 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa5241e16c0 0x7fa5240c93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:54.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.769+0000 7fa52a3f0700 1 -- 172.21.15.149:0/3935990164 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa5240c98f0 msgr2=0x7fa5240c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:54.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.769+0000 7fa52abf1700 1 --2- 172.21.15.149:0/3935990164 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa5240c98f0 0x7fa5240c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:54.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.769+0000 7fa52a3f0700 1 --2- 172.21.15.149:0/3935990164 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa5240c98f0 0x7fa5240c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:54.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.769+0000 7fa52a3f0700 1 -- 172.21.15.149:0/3935990164 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa5241e16c0 msgr2=0x7fa5240c93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:54.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.769+0000 7fa52a3f0700 1 --2- 172.21.15.149:0/3935990164 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa5241e16c0 0x7fa5240c93b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:54.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.769+0000 7fa52a3f0700 1 -- 172.21.15.149:0/3935990164 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5241e0620 con 0x7fa510005210 2023-11-08T19:23:54.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.769+0000 7fa529bef700 1 --2- 172.21.15.149:0/3935990164 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa5241e16c0 0x7fa5240c93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:23:54.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.769+0000 7fa52abf1700 1 --2- 172.21.15.149:0/3935990164 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa5240c98f0 0x7fa5240c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:23:54.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.769+0000 7fa52a3f0700 1 --2- 172.21.15.149:0/3935990164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa510005210 0x7fa5241e0040 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa52000e500 tx=0x7fa52000e8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:54.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.769+0000 7fa51affd700 1 -- 172.21.15.149:0/3935990164 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5200052e0 con 0x7fa510005210 2023-11-08T19:23:54.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.769+0000 7fa51affd700 1 -- 172.21.15.149:0/3935990164 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa520005440 con 0x7fa510005210 2023-11-08T19:23:54.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.769+0000 7fa52c654700 1 -- 172.21.15.149:0/3935990164 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5241e0900 con 0x7fa510005210 2023-11-08T19:23:54.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.769+0000 7fa51affd700 1 -- 172.21.15.149:0/3935990164 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5200038a0 con 0x7fa510005210 2023-11-08T19:23:54.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.769+0000 7fa52c654700 1 -- 172.21.15.149:0/3935990164 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5241e0ec0 con 0x7fa510005210 2023-11-08T19:23:54.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.770+0000 7fa52c654700 1 -- 172.21.15.149:0/3935990164 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5241e1aa0 con 0x7fa510005210 2023-11-08T19:23:54.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.771+0000 7fa51affd700 1 -- 172.21.15.149:0/3935990164 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa520003a00 con 0x7fa510005210 2023-11-08T19:23:54.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.771+0000 7fa51affd700 1 --2- 172.21.15.149:0/3935990164 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa50806af00 0x7fa50806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:54.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.771+0000 7fa51affd700 1 -- 172.21.15.149:0/3935990164 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa520088f90 con 0x7fa510005210 2023-11-08T19:23:54.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.771+0000 7fa529bef700 1 --2- 172.21.15.149:0/3935990164 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa50806af00 0x7fa50806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:54.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.772+0000 7fa529bef700 1 --2- 172.21.15.149:0/3935990164 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa50806af00 0x7fa50806d3c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa514001eb0 tx=0x7fa514000f30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:54.791 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.776+0000 7fa51affd700 1 -- 172.21.15.149:0/3935990164 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa5200bbca0 con 0x7fa510005210 2023-11-08T19:23:54.965 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.964+0000 7fa52c654700 1 -- 172.21.15.149:0/3935990164 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa52404f730 con 0x7fa510005210 2023-11-08T19:23:54.966 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.965+0000 7fa51affd700 1 -- 172.21.15.149:0/3935990164 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa520019020 con 0x7fa510005210 2023-11-08T19:23:54.967 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:23:54.968 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.967+0000 7fa52c654700 1 -- 172.21.15.149:0/3935990164 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa50806af00 msgr2=0x7fa50806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:54.969 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.967+0000 7fa52c654700 1 --2- 172.21.15.149:0/3935990164 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa50806af00 0x7fa50806d3c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa514001eb0 tx=0x7fa514000f30 comp rx=0 tx=0).stop 2023-11-08T19:23:54.969 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.967+0000 7fa52c654700 1 -- 172.21.15.149:0/3935990164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa510005210 msgr2=0x7fa5241e0040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:54.969 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.967+0000 7fa52c654700 1 --2- 172.21.15.149:0/3935990164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa510005210 0x7fa5241e0040 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa52000e500 tx=0x7fa52000e8c0 comp rx=0 tx=0).stop 2023-11-08T19:23:54.969 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.967+0000 7fa52c654700 1 -- 172.21.15.149:0/3935990164 shutdown_connections 2023-11-08T19:23:54.970 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.967+0000 7fa52c654700 1 --2- 172.21.15.149:0/3935990164 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa50806af00 0x7fa50806d3c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:54.970 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.967+0000 7fa52c654700 1 --2- 172.21.15.149:0/3935990164 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa5240c98f0 0x7fa5240c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:54.970 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.967+0000 7fa52c654700 1 --2- 172.21.15.149:0/3935990164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa510005210 0x7fa5241e0040 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:54.970 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.967+0000 7fa52c654700 1 --2- 172.21.15.149:0/3935990164 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa5241e16c0 0x7fa5240c93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:54.971 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.967+0000 7fa52c654700 1 -- 172.21.15.149:0/3935990164 >> 172.21.15.149:0/3935990164 conn(0x7fa5240cc860 msgr2=0x7fa524071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:54.971 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.967+0000 7fa52c654700 1 -- 172.21.15.149:0/3935990164 shutdown_connections 2023-11-08T19:23:54.971 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:54.967+0000 7fa52c654700 1 -- 172.21.15.149:0/3935990164 wait complete. 2023-11-08T19:23:54.980 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-08T19:23:55.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.101+0000 7f3e4564f700 1 Processor -- start 2023-11-08T19:23:55.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.101+0000 7f3e4564f700 1 -- start start 2023-11-08T19:23:55.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.102+0000 7f3e4564f700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3e40161a50 0x7f3e40161f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:55.105 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.102+0000 7f3e4564f700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e400d1a10 con 0x7f3e400ce500 2023-11-08T19:23:55.105 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.102+0000 7f3e4564f700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e400d1cf0 con 0x7f3e40161670 2023-11-08T19:23:55.105 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.102+0000 7f3e4564f700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e400d1fd0 con 0x7f3e40161a50 2023-11-08T19:23:55.105 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.102+0000 7f3e3e7fc700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3e40161a50 0x7f3e40161f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:55.105 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.102+0000 7f3e3e7fc700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3e40161a50 0x7f3e40161f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38584/0 (socket says 172.21.15.149:38584) 2023-11-08T19:23:55.106 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.102+0000 7f3e3e7fc700 1 -- 172.21.15.149:0/4251149575 learned_addr learned my addr 172.21.15.149:0/4251149575 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:55.106 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.102+0000 7f3e3e7fc700 1 -- 172.21.15.149:0/4251149575 >> v1:172.21.15.160:6789/0 conn(0x7f3e40161670 legacy=0x7f3e400b5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:55.106 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.102+0000 7f3e3e7fc700 1 -- 172.21.15.149:0/4251149575 >> v1:172.21.15.149:6789/0 conn(0x7f3e400ce500 legacy=0x7f3e400ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:55.106 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.102+0000 7f3e3dffb700 1 -- 172.21.15.149:0/4251149575 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2115804816 0 0) 0x7f3e400d1a10 con 0x7f3e400ce500 2023-11-08T19:23:55.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.102+0000 7f3e3e7fc700 1 -- 172.21.15.149:0/4251149575 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e400d22b0 con 0x7f3e40161a50 2023-11-08T19:23:55.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.102+0000 7f3e3e7fc700 1 --2- 172.21.15.149:0/4251149575 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e40161a50 0x7f3e40161f00 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3e300098f0 tx=0x7f3e30009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e45d326bb3cc173 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:55.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.103+0000 7f3e3dffb700 1 -- 172.21.15.149:0/4251149575 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3000b8a0 con 0x7f3e40161a50 2023-11-08T19:23:55.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.103+0000 7f3e3dffb700 1 -- 172.21.15.149:0/4251149575 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e3000ba00 con 0x7f3e40161a50 2023-11-08T19:23:55.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.103+0000 7f3e3dffb700 1 -- 172.21.15.149:0/4251149575 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3000bd90 con 0x7f3e40161a50 2023-11-08T19:23:55.108 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.103+0000 7f3e4564f700 1 -- 172.21.15.149:0/4251149575 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e40161a50 msgr2=0x7f3e40161f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:55.108 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.103+0000 7f3e4564f700 1 --2- 172.21.15.149:0/4251149575 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e40161a50 0x7f3e40161f00 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3e300098f0 tx=0x7f3e30009c00 comp rx=0 tx=0).stop 2023-11-08T19:23:55.108 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.103+0000 7f3e4564f700 1 -- 172.21.15.149:0/4251149575 shutdown_connections 2023-11-08T19:23:55.108 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.103+0000 7f3e4564f700 1 --2- 172.21.15.149:0/4251149575 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e40161a50 0x7f3e40161f00 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:55.109 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.103+0000 7f3e4564f700 1 -- 172.21.15.149:0/4251149575 >> 172.21.15.149:0/4251149575 conn(0x7f3e400d3980 msgr2=0x7f3e400d3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:55.109 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.103+0000 7f3e4564f700 1 -- 172.21.15.149:0/4251149575 shutdown_connections 2023-11-08T19:23:55.109 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.103+0000 7f3e4564f700 1 -- 172.21.15.149:0/4251149575 wait complete. 2023-11-08T19:23:55.112 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.104+0000 7f3e4564f700 1 Processor -- start 2023-11-08T19:23:55.112 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.105+0000 7f3e4564f700 1 -- start start 2023-11-08T19:23:55.112 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.105+0000 7f3e4564f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e400ce500 0x7f3e40157270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:55.112 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.105+0000 7f3e4564f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3e40161670 0x7f3e400b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:55.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.105+0000 7f3e4564f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3e40161a50 0x7f3e400b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:55.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.105+0000 7f3e4564f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e400cd860 con 0x7f3e400ce500 2023-11-08T19:23:55.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.105+0000 7f3e4564f700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e400b4730 con 0x7f3e40161670 2023-11-08T19:23:55.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.105+0000 7f3e4564f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e400c9250 con 0x7f3e40161a50 2023-11-08T19:23:55.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.105+0000 7f3e3effd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e400ce500 0x7f3e40157270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:55.114 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.105+0000 7f3e3effd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e400ce500 0x7f3e40157270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38588/0 (socket says 172.21.15.149:38588) 2023-11-08T19:23:55.114 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.105+0000 7f3e3effd700 1 -- 172.21.15.149:0/2780416414 learned_addr learned my addr 172.21.15.149:0/2780416414 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:55.114 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.106+0000 7f3e3e7fc700 1 --2- 172.21.15.149:0/2780416414 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3e40161670 0x7f3e400b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:55.114 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.106+0000 7f3e3f7fe700 1 --2- 172.21.15.149:0/2780416414 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3e40161a50 0x7f3e400b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:55.115 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.106+0000 7f3e3effd700 1 -- 172.21.15.149:0/2780416414 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3e40161a50 msgr2=0x7f3e400b38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:55.115 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.106+0000 7f3e3effd700 1 --2- 172.21.15.149:0/2780416414 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3e40161a50 0x7f3e400b38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:55.115 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.106+0000 7f3e3effd700 1 -- 172.21.15.149:0/2780416414 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3e40161670 msgr2=0x7f3e400b3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:55.115 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.106+0000 7f3e3effd700 1 --2- 172.21.15.149:0/2780416414 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3e40161670 0x7f3e400b3370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:55.115 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.106+0000 7f3e3effd700 1 -- 172.21.15.149:0/2780416414 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e30009550 con 0x7f3e400ce500 2023-11-08T19:23:55.116 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.106+0000 7f3e3f7fe700 1 --2- 172.21.15.149:0/2780416414 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3e40161a50 0x7f3e400b38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:23:55.116 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.106+0000 7f3e3effd700 1 --2- 172.21.15.149:0/2780416414 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e400ce500 0x7f3e40157270 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f3e3400c4d0 tx=0x7f3e3400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:55.116 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.106+0000 7f3e277fe700 1 -- 172.21.15.149:0/2780416414 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e340052d0 con 0x7f3e400ce500 2023-11-08T19:23:55.116 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.106+0000 7f3e277fe700 1 -- 172.21.15.149:0/2780416414 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e34005430 con 0x7f3e400ce500 2023-11-08T19:23:55.116 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.106+0000 7f3e4564f700 1 -- 172.21.15.149:0/2780416414 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e400c9530 con 0x7f3e400ce500 2023-11-08T19:23:55.117 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.106+0000 7f3e277fe700 1 -- 172.21.15.149:0/2780416414 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e340038f0 con 0x7f3e400ce500 2023-11-08T19:23:55.117 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.106+0000 7f3e4564f700 1 -- 172.21.15.149:0/2780416414 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e400c9af0 con 0x7f3e400ce500 2023-11-08T19:23:55.117 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.107+0000 7f3e4564f700 1 -- 172.21.15.149:0/2780416414 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e400745f0 con 0x7f3e400ce500 2023-11-08T19:23:55.117 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.107+0000 7f3e277fe700 1 -- 172.21.15.149:0/2780416414 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3e34003a50 con 0x7f3e400ce500 2023-11-08T19:23:55.117 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.108+0000 7f3e277fe700 1 --2- 172.21.15.149:0/2780416414 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3e2c06af00 0x7f3e2c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:55.118 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.108+0000 7f3e277fe700 1 -- 172.21.15.149:0/2780416414 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3e34088e00 con 0x7f3e400ce500 2023-11-08T19:23:55.118 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.108+0000 7f3e3e7fc700 1 --2- 172.21.15.149:0/2780416414 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3e2c06af00 0x7f3e2c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:55.118 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.108+0000 7f3e3e7fc700 1 --2- 172.21.15.149:0/2780416414 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3e2c06af00 0x7f3e2c06d3c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3e30014040 tx=0x7f3e30008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:55.119 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.113+0000 7f3e277fe700 1 -- 172.21.15.149:0/2780416414 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3e34053af0 con 0x7f3e400ce500 2023-11-08T19:23:55.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.320+0000 7f3e4564f700 1 -- 172.21.15.149:0/2780416414 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3e4008b060 con 0x7f3e400ce500 2023-11-08T19:23:55.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.320+0000 7f3e277fe700 1 -- 172.21.15.149:0/2780416414 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3e34017080 con 0x7f3e400ce500 2023-11-08T19:23:55.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.322+0000 7f3e4564f700 1 -- 172.21.15.149:0/2780416414 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3e2c06af00 msgr2=0x7f3e2c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:55.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.322+0000 7f3e4564f700 1 --2- 172.21.15.149:0/2780416414 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3e2c06af00 0x7f3e2c06d3c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3e30014040 tx=0x7f3e30008030 comp rx=0 tx=0).stop 2023-11-08T19:23:55.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.322+0000 7f3e4564f700 1 -- 172.21.15.149:0/2780416414 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e400ce500 msgr2=0x7f3e40157270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:55.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.322+0000 7f3e4564f700 1 --2- 172.21.15.149:0/2780416414 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e400ce500 0x7f3e40157270 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f3e3400c4d0 tx=0x7f3e3400c7e0 comp rx=0 tx=0).stop 2023-11-08T19:23:55.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.322+0000 7f3e4564f700 1 -- 172.21.15.149:0/2780416414 shutdown_connections 2023-11-08T19:23:55.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.322+0000 7f3e4564f700 1 --2- 172.21.15.149:0/2780416414 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3e2c06af00 0x7f3e2c06d3c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:55.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.322+0000 7f3e4564f700 1 --2- 172.21.15.149:0/2780416414 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3e40161a50 0x7f3e400b38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:55.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.322+0000 7f3e4564f700 1 --2- 172.21.15.149:0/2780416414 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e400ce500 0x7f3e40157270 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:55.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.322+0000 7f3e4564f700 1 --2- 172.21.15.149:0/2780416414 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3e40161670 0x7f3e400b3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:55.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.322+0000 7f3e4564f700 1 -- 172.21.15.149:0/2780416414 >> 172.21.15.149:0/2780416414 conn(0x7f3e400d3980 msgr2=0x7f3e40160d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:55.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.322+0000 7f3e4564f700 1 -- 172.21.15.149:0/2780416414 shutdown_connections 2023-11-08T19:23:55.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.322+0000 7f3e4564f700 1 -- 172.21.15.149:0/2780416414 wait complete. 2023-11-08T19:23:55.326 INFO:teuthology.orchestra.run.smithi149.stderr:listed 0 entries 2023-11-08T19:23:55.336 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-08T19:23:55.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:55.336 DEBUG:teuthology.orchestra.run.smithi160:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-11-08T19:23:55.403 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi160.front.sepia.ceph.com 2023-11-08T19:23:55.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:55.404 DEBUG:teuthology.orchestra.run.smithi160:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-08T19:23:55.466 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-11-08T19:23:55.467 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:23:55.485 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-11-08T19:23:55.485 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:23:55.542 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-11-08T19:23:55.542 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:23:55.599 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:23:55.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.758+0000 7f0422a3b700 1 Processor -- start 2023-11-08T19:23:55.760 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.758+0000 7f0422a3b700 1 -- start start 2023-11-08T19:23:55.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.758+0000 7f0422a3b700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f041c0cc910 0x7f041c0cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:55.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.758+0000 7f0422a3b700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f041c0cb130 0x7f041c15d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:55.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.759+0000 7f0422a3b700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f041c0b2f60 con 0x7f041c0cc140 2023-11-08T19:23:55.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.759+0000 7f0422a3b700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f041c0b2430 con 0x7f041c0cb130 2023-11-08T19:23:55.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.759+0000 7f0422a3b700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f041c0cc520 con 0x7f041c0cc910 2023-11-08T19:23:55.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.759+0000 7f0420fd8700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f041c0cb130 0x7f041c15d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:55.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.759+0000 7f0420fd8700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f041c0cb130 0x7f041c15d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38598/0 (socket says 172.21.15.149:38598) 2023-11-08T19:23:55.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.759+0000 7f0420fd8700 1 -- 172.21.15.149:0/2719276701 learned_addr learned my addr 172.21.15.149:0/2719276701 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:55.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.759+0000 7f041b7fe700 1 --2- 172.21.15.149:0/2719276701 >> v2:172.21.15.160:3300/0 conn(0x7f041c0cc910 0x7f041c0cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:55.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.759+0000 7f0420fd8700 1 -- 172.21.15.149:0/2719276701 >> v2:172.21.15.160:3300/0 conn(0x7f041c0cc910 msgr2=0x7f041c0cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:55.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.759+0000 7f0420fd8700 1 --2- 172.21.15.149:0/2719276701 >> v2:172.21.15.160:3300/0 conn(0x7f041c0cc910 0x7f041c0cabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:55.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.759+0000 7f0420fd8700 1 -- 172.21.15.149:0/2719276701 >> v1:172.21.15.160:6789/0 conn(0x7f041c0cc140 legacy=0x7f041c0b2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:55.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.759+0000 7f0420fd8700 1 -- 172.21.15.149:0/2719276701 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f041c0cb5e0 con 0x7f041c0cb130 2023-11-08T19:23:55.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.759+0000 7f041b7fe700 1 --2- 172.21.15.149:0/2719276701 >> v2:172.21.15.160:3300/0 conn(0x7f041c0cc910 0x7f041c0cabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:23:55.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.759+0000 7f0420fd8700 1 --2- 172.21.15.149:0/2719276701 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f041c0cb130 0x7f041c15d2b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f041c0b1330 tx=0x7f041400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e19b686cbd5f6e6a server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:55.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.759+0000 7f041affd700 1 -- 172.21.15.149:0/2719276701 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041400e070 con 0x7f041c0cb130 2023-11-08T19:23:55.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.759+0000 7f041affd700 1 -- 172.21.15.149:0/2719276701 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0414003a20 con 0x7f041c0cb130 2023-11-08T19:23:55.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.759+0000 7f041affd700 1 -- 172.21.15.149:0/2719276701 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0414003dd0 con 0x7f041c0cb130 2023-11-08T19:23:55.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.760+0000 7f0422a3b700 1 -- 172.21.15.149:0/2719276701 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f041c0cb130 msgr2=0x7f041c15d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:55.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.760+0000 7f0422a3b700 1 --2- 172.21.15.149:0/2719276701 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f041c0cb130 0x7f041c15d2b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f041c0b1330 tx=0x7f041400b330 comp rx=0 tx=0).stop 2023-11-08T19:23:55.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.760+0000 7f0422a3b700 1 -- 172.21.15.149:0/2719276701 shutdown_connections 2023-11-08T19:23:55.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.760+0000 7f0422a3b700 1 --2- 172.21.15.149:0/2719276701 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f041c0cb130 0x7f041c15d2b0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:55.770 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.760+0000 7f0422a3b700 1 --2- 172.21.15.149:0/2719276701 >> v2:172.21.15.160:3300/0 conn(0x7f041c0cc910 0x7f041c0cabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:55.770 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.760+0000 7f0422a3b700 1 -- 172.21.15.149:0/2719276701 >> 172.21.15.149:0/2719276701 conn(0x7f041c099a40 msgr2=0x7f041c0d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:55.770 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.760+0000 7f0422a3b700 1 -- 172.21.15.149:0/2719276701 shutdown_connections 2023-11-08T19:23:55.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.760+0000 7f0422a3b700 1 -- 172.21.15.149:0/2719276701 wait complete. 2023-11-08T19:23:55.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.761+0000 7f0422a3b700 1 Processor -- start 2023-11-08T19:23:55.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.762+0000 7f0422a3b700 1 -- start start 2023-11-08T19:23:55.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.762+0000 7f0422a3b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f041c0cb130 0x7f041c15dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:55.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.762+0000 7f0422a3b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f041c0cc140 0x7f041c0d0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:55.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.762+0000 7f0422a3b700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f041c0cc910 0x7f041c0af200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:55.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.763+0000 7f0422a3b700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041c0c8e50 con 0x7f041c0cc140 2023-11-08T19:23:55.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.763+0000 7f0422a3b700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041c0c90f0 con 0x7f041c0cb130 2023-11-08T19:23:55.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.763+0000 7f0422a3b700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f041c0c93d0 con 0x7f041c0cc910 2023-11-08T19:23:55.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.763+0000 7f041b7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f041c0cc140 0x7f041c0d0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:55.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.763+0000 7f041b7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f041c0cc140 0x7f041c0d0cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38602/0 (socket says 172.21.15.149:38602) 2023-11-08T19:23:55.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.763+0000 7f041b7fe700 1 -- 172.21.15.149:0/468317922 learned_addr learned my addr 172.21.15.149:0/468317922 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:55.779 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.763+0000 7f041bfff700 1 --2- 172.21.15.149:0/468317922 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f041c0cb130 0x7f041c15dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:55.779 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.763+0000 7f0420fd8700 1 --2- 172.21.15.149:0/468317922 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f041c0cc910 0x7f041c0af200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:55.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.763+0000 7f041b7fe700 1 -- 172.21.15.149:0/468317922 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f041c0cc910 msgr2=0x7f041c0af200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:55.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.763+0000 7f041b7fe700 1 --2- 172.21.15.149:0/468317922 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f041c0cc910 0x7f041c0af200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:55.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.763+0000 7f041b7fe700 1 -- 172.21.15.149:0/468317922 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f041c0cb130 msgr2=0x7f041c15dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:55.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.763+0000 7f041b7fe700 1 --2- 172.21.15.149:0/468317922 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f041c0cb130 0x7f041c15dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:55.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.763+0000 7f041b7fe700 1 -- 172.21.15.149:0/468317922 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0414009b30 con 0x7f041c0cc140 2023-11-08T19:23:55.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.763+0000 7f041b7fe700 1 --2- 172.21.15.149:0/468317922 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f041c0cc140 0x7f041c0d0cb0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f041000c7f0 tx=0x7f041000cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:55.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.763+0000 7f0418ff9700 1 -- 172.21.15.149:0/468317922 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0410004220 con 0x7f041c0cc140 2023-11-08T19:23:55.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.763+0000 7f0418ff9700 1 -- 172.21.15.149:0/468317922 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04100043a0 con 0x7f041c0cc140 2023-11-08T19:23:55.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.763+0000 7f0422a3b700 1 -- 172.21.15.149:0/468317922 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f041c0c96b0 con 0x7f041c0cc140 2023-11-08T19:23:55.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.763+0000 7f0418ff9700 1 -- 172.21.15.149:0/468317922 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04100038e0 con 0x7f041c0cc140 2023-11-08T19:23:55.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.763+0000 7f0422a3b700 1 -- 172.21.15.149:0/468317922 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f041c0d11f0 con 0x7f041c0cc140 2023-11-08T19:23:55.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.764+0000 7f0422a3b700 1 -- 172.21.15.149:0/468317922 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f041c0c9d00 con 0x7f041c0cc140 2023-11-08T19:23:55.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.765+0000 7f0418ff9700 1 -- 172.21.15.149:0/468317922 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0410003a40 con 0x7f041c0cc140 2023-11-08T19:23:55.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.765+0000 7f0418ff9700 1 --2- 172.21.15.149:0/468317922 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f040806af00 0x7f040806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:55.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.765+0000 7f0418ff9700 1 -- 172.21.15.149:0/468317922 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0410089610 con 0x7f041c0cc140 2023-11-08T19:23:55.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.765+0000 7f041bfff700 1 --2- 172.21.15.149:0/468317922 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f040806af00 0x7f040806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:55.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.765+0000 7f041bfff700 1 --2- 172.21.15.149:0/468317922 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f040806af00 0x7f040806d3c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f040c004f80 tx=0x7f040c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:55.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.770+0000 7f0418ff9700 1 -- 172.21.15.149:0/468317922 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0410054300 con 0x7f041c0cc140 2023-11-08T19:23:55.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.961+0000 7f0422a3b700 1 -- 172.21.15.149:0/468317922 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f041c0745f0 con 0x7f041c0cc140 2023-11-08T19:23:55.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.963+0000 7f0418ff9700 1 -- 172.21.15.149:0/468317922 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18770 (secure 0 0 0) 0x7f0410057920 con 0x7f041c0cc140 2023-11-08T19:23:55.964 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:23:55.964 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":26,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:23:51.355959+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-08T19:22:59.830928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-08T19:23:00.886589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-08T19:23:04.574033+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":1}]},{"pgid":"3.14","mappings":[{"from":4,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:23:55.966 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.965+0000 7f0422a3b700 1 -- 172.21.15.149:0/468317922 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f040806af00 msgr2=0x7f040806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:55.967 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.965+0000 7f0422a3b700 1 --2- 172.21.15.149:0/468317922 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f040806af00 0x7f040806d3c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f040c004f80 tx=0x7f040c009040 comp rx=0 tx=0).stop 2023-11-08T19:23:55.967 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.965+0000 7f0422a3b700 1 -- 172.21.15.149:0/468317922 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f041c0cc140 msgr2=0x7f041c0d0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:55.967 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.965+0000 7f0422a3b700 1 --2- 172.21.15.149:0/468317922 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f041c0cc140 0x7f041c0d0cb0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f041000c7f0 tx=0x7f041000cbb0 comp rx=0 tx=0).stop 2023-11-08T19:23:55.967 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.965+0000 7f0422a3b700 1 -- 172.21.15.149:0/468317922 shutdown_connections 2023-11-08T19:23:55.968 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.965+0000 7f0422a3b700 1 --2- 172.21.15.149:0/468317922 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f040806af00 0x7f040806d3c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:55.968 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.965+0000 7f0422a3b700 1 --2- 172.21.15.149:0/468317922 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f041c0cb130 0x7f041c15dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:55.968 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.965+0000 7f0422a3b700 1 --2- 172.21.15.149:0/468317922 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f041c0cc910 0x7f041c0af200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:55.968 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.965+0000 7f0422a3b700 1 --2- 172.21.15.149:0/468317922 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f041c0cc140 0x7f041c0d0cb0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:55.968 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.965+0000 7f0422a3b700 1 -- 172.21.15.149:0/468317922 >> 172.21.15.149:0/468317922 conn(0x7f041c099a40 msgr2=0x7f041c0ca1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:55.969 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.965+0000 7f0422a3b700 1 -- 172.21.15.149:0/468317922 shutdown_connections 2023-11-08T19:23:55.969 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:55.965+0000 7f0422a3b700 1 -- 172.21.15.149:0/468317922 wait complete. 2023-11-08T19:23:55.979 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-08T19:22:56.023194+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-08T19:22:59.830928+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-08T19:23:00.886589+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-08T19:23:04.574033+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-08T19:23:55.980 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-08T19:23:56.103 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.102+0000 7f046a316700 1 Processor -- start 2023-11-08T19:23:56.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.102+0000 7f046a316700 1 -- start start 2023-11-08T19:23:56.106 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.103+0000 7f046a316700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f04640cfd30 0x7f046406d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:56.106 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.103+0000 7f046a316700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04640cdd30 con 0x7f04640b38e0 2023-11-08T19:23:56.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.103+0000 7f046a316700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04640d0150 con 0x7f046415db10 2023-11-08T19:23:56.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.103+0000 7f046a316700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04640ced40 con 0x7f04640cfd30 2023-11-08T19:23:56.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.103+0000 7f04688b3700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f04640cfd30 0x7f046406d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:56.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.103+0000 7f04637fe700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f04640b38e0 0x7f046406c160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:40610/0 (socket says 172.21.15.149:40610) 2023-11-08T19:23:56.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.103+0000 7f04637fe700 1 -- 172.21.15.149:0/1651087546 learned_addr learned my addr 172.21.15.149:0/1651087546 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:23:56.108 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.104+0000 7f04688b3700 1 -- 172.21.15.149:0/1651087546 >> v1:172.21.15.160:6789/0 conn(0x7f046415db10 legacy=0x7f04640b31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:56.108 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.104+0000 7f04688b3700 1 -- 172.21.15.149:0/1651087546 >> v1:172.21.15.149:6789/0 conn(0x7f04640b38e0 legacy=0x7f046406c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:56.108 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.104+0000 7f0462ffd700 1 -- 172.21.15.149:0/1651087546 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 171671106 0 0) 0x7f04640cdd30 con 0x7f04640b38e0 2023-11-08T19:23:56.108 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.104+0000 7f04688b3700 1 -- 172.21.15.149:0/1651087546 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04640cbe50 con 0x7f04640cfd30 2023-11-08T19:23:56.108 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.104+0000 7f04688b3700 1 --2- 172.21.15.149:0/1651087546 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04640cfd30 0x7f046406d5e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f045c009d90 tx=0x7f045c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98bc5bf00980cb96 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:56.109 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.104+0000 7f0462ffd700 1 -- 172.21.15.149:0/1651087546 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f045c00e070 con 0x7f04640cfd30 2023-11-08T19:23:56.109 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.104+0000 7f0462ffd700 1 -- 172.21.15.149:0/1651087546 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f045c00bbd0 con 0x7f04640cfd30 2023-11-08T19:23:56.109 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.104+0000 7f0462ffd700 1 -- 172.21.15.149:0/1651087546 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f045c012430 con 0x7f04640cfd30 2023-11-08T19:23:56.109 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.104+0000 7f046a316700 1 -- 172.21.15.149:0/1651087546 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04640cfd30 msgr2=0x7f046406d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:56.109 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.104+0000 7f046a316700 1 --2- 172.21.15.149:0/1651087546 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04640cfd30 0x7f046406d5e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f045c009d90 tx=0x7f045c00b330 comp rx=0 tx=0).stop 2023-11-08T19:23:56.110 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.104+0000 7f046a316700 1 -- 172.21.15.149:0/1651087546 shutdown_connections 2023-11-08T19:23:56.110 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.104+0000 7f046a316700 1 --2- 172.21.15.149:0/1651087546 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04640cfd30 0x7f046406d5e0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:56.110 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.104+0000 7f046a316700 1 -- 172.21.15.149:0/1651087546 >> 172.21.15.149:0/1651087546 conn(0x7f046406f120 msgr2=0x7f046406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:56.110 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.105+0000 7f046a316700 1 -- 172.21.15.149:0/1651087546 shutdown_connections 2023-11-08T19:23:56.110 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.105+0000 7f046a316700 1 -- 172.21.15.149:0/1651087546 wait complete. 2023-11-08T19:23:56.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.106+0000 7f046a316700 1 Processor -- start 2023-11-08T19:23:56.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.106+0000 7f046a316700 1 -- start start 2023-11-08T19:23:56.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.107+0000 7f046a316700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04640b38e0 0x7f04640c9f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:56.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.107+0000 7f046a316700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04640cfd30 0x7f046415def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:56.114 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.107+0000 7f046a316700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f046415db10 0x7f04641f6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:56.114 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.107+0000 7f046a316700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0464160e60 con 0x7f04640cfd30 2023-11-08T19:23:56.114 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.107+0000 7f046a316700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04641605c0 con 0x7f04640b38e0 2023-11-08T19:23:56.114 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.107+0000 7f046a316700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04641608a0 con 0x7f046415db10 2023-11-08T19:23:56.114 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.107+0000 7f04637fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04640cfd30 0x7f046415def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:56.115 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.107+0000 7f04637fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04640cfd30 0x7f046415def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38616/0 (socket says 172.21.15.149:38616) 2023-11-08T19:23:56.115 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.107+0000 7f04637fe700 1 -- 172.21.15.149:0/1789835102 learned_addr learned my addr 172.21.15.149:0/1789835102 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:56.115 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.107+0000 7f04688b3700 1 --2- 172.21.15.149:0/1789835102 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f046415db10 0x7f04641f6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:56.115 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.107+0000 7f0463fff700 1 --2- 172.21.15.149:0/1789835102 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04640b38e0 0x7f04640c9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:56.115 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.107+0000 7f04637fe700 1 -- 172.21.15.149:0/1789835102 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f046415db10 msgr2=0x7f04641f6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:56.116 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.107+0000 7f04637fe700 1 --2- 172.21.15.149:0/1789835102 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f046415db10 0x7f04641f6990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:56.116 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.107+0000 7f04637fe700 1 -- 172.21.15.149:0/1789835102 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04640b38e0 msgr2=0x7f04640c9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:56.116 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.107+0000 7f04637fe700 1 --2- 172.21.15.149:0/1789835102 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04640b38e0 0x7f04640c9f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:56.116 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.107+0000 7f04637fe700 1 -- 172.21.15.149:0/1789835102 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f045c009a70 con 0x7f04640cfd30 2023-11-08T19:23:56.116 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.107+0000 7f04637fe700 1 --2- 172.21.15.149:0/1789835102 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04640cfd30 0x7f046415def0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f044c00c520 tx=0x7f044c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:56.117 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.107+0000 7f0460ff9700 1 -- 172.21.15.149:0/1789835102 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044c004c80 con 0x7f04640cfd30 2023-11-08T19:23:56.117 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.107+0000 7f0460ff9700 1 -- 172.21.15.149:0/1789835102 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f044c004e20 con 0x7f04640cfd30 2023-11-08T19:23:56.117 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.107+0000 7f046a316700 1 -- 172.21.15.149:0/1789835102 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0464160b80 con 0x7f04640cfd30 2023-11-08T19:23:56.117 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.107+0000 7f0460ff9700 1 -- 172.21.15.149:0/1789835102 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044c007310 con 0x7f04640cfd30 2023-11-08T19:23:56.117 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.108+0000 7f046a316700 1 -- 172.21.15.149:0/1789835102 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04640ca470 con 0x7f04640cfd30 2023-11-08T19:23:56.117 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.108+0000 7f046a316700 1 -- 172.21.15.149:0/1789835102 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04640c6640 con 0x7f04640cfd30 2023-11-08T19:23:56.118 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.109+0000 7f0460ff9700 1 -- 172.21.15.149:0/1789835102 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f044c007470 con 0x7f04640cfd30 2023-11-08T19:23:56.118 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.109+0000 7f0460ff9700 1 --2- 172.21.15.149:0/1789835102 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f044406af30 0x7f044406d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:56.118 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.109+0000 7f0460ff9700 1 -- 172.21.15.149:0/1789835102 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f044c089560 con 0x7f04640cfd30 2023-11-08T19:23:56.118 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.109+0000 7f0463fff700 1 --2- 172.21.15.149:0/1789835102 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f044406af30 0x7f044406d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:56.119 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.110+0000 7f0463fff700 1 --2- 172.21.15.149:0/1789835102 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f044406af30 0x7f044406d3f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0454000f60 tx=0x7f0454009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:56.119 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.114+0000 7f0460ff9700 1 -- 172.21.15.149:0/1789835102 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f04640c6640 con 0x7f04640cfd30 2023-11-08T19:23:56.304 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.303+0000 7f046a316700 1 -- 172.21.15.149:0/1789835102 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f04640c6640 con 0x7f04640cfd30 2023-11-08T19:23:56.305 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.304+0000 7f0460ff9700 1 -- 172.21.15.149:0/1789835102 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f04640c6640 con 0x7f04640cfd30 2023-11-08T19:23:56.305 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 1 2023-11-08T19:23:56.307 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.306+0000 7f046a316700 1 -- 172.21.15.149:0/1789835102 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f044406af30 msgr2=0x7f044406d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:56.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.306+0000 7f046a316700 1 --2- 172.21.15.149:0/1789835102 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f044406af30 0x7f044406d3f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0454000f60 tx=0x7f0454009040 comp rx=0 tx=0).stop 2023-11-08T19:23:56.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.306+0000 7f046a316700 1 -- 172.21.15.149:0/1789835102 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04640cfd30 msgr2=0x7f046415def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:56.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.306+0000 7f046a316700 1 --2- 172.21.15.149:0/1789835102 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04640cfd30 0x7f046415def0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f044c00c520 tx=0x7f044c00c8e0 comp rx=0 tx=0).stop 2023-11-08T19:23:56.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.306+0000 7f046a316700 1 -- 172.21.15.149:0/1789835102 shutdown_connections 2023-11-08T19:23:56.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.306+0000 7f046a316700 1 --2- 172.21.15.149:0/1789835102 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f044406af30 0x7f044406d3f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:56.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.306+0000 7f046a316700 1 --2- 172.21.15.149:0/1789835102 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04640b38e0 0x7f04640c9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:56.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.306+0000 7f046a316700 1 --2- 172.21.15.149:0/1789835102 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f046415db10 0x7f04641f6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:56.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.306+0000 7f046a316700 1 --2- 172.21.15.149:0/1789835102 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04640cfd30 0x7f046415def0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:56.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.306+0000 7f046a316700 1 -- 172.21.15.149:0/1789835102 >> 172.21.15.149:0/1789835102 conn(0x7f046406f120 msgr2=0x7f046406c160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:56.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.306+0000 7f046a316700 1 -- 172.21.15.149:0/1789835102 shutdown_connections 2023-11-08T19:23:56.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.306+0000 7f046a316700 1 -- 172.21.15.149:0/1789835102 wait complete. 2023-11-08T19:23:56.320 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-08T19:23:56.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.444+0000 7fe414b81700 1 Processor -- start 2023-11-08T19:23:56.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.444+0000 7fe414b81700 1 -- start start 2023-11-08T19:23:56.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.445+0000 7fe414b81700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe41015f470 0x7fe41015c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:56.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.445+0000 7fe414b81700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fe41015cb60 0x7fe4100cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:56.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.445+0000 7fe414b81700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe41015be80 con 0x7fe4100cc0d0 2023-11-08T19:23:56.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.445+0000 7fe414b81700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4100ccbc0 con 0x7fe41015cb60 2023-11-08T19:23:56.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.445+0000 7fe414b81700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe41015f8d0 con 0x7fe41015f470 2023-11-08T19:23:56.450 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.445+0000 7fe40dd9b700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe41015f470 0x7fe41015c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:56.450 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.445+0000 7fe40ed9d700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fe41015cb60 0x7fe4100cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:56.450 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.445+0000 7fe40ed9d700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fe41015cb60 0x7fe4100cf320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.149:39614/0 (socket says 172.21.15.149:39614) 2023-11-08T19:23:56.450 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.445+0000 7fe40dd9b700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe41015f470 0x7fe41015c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.149:58910/0 (socket says 172.21.15.149:58910) 2023-11-08T19:23:56.451 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.446+0000 7fe40ed9d700 1 -- 172.21.15.149:0/1580234564 learned_addr learned my addr 172.21.15.149:0/1580234564 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:56.451 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.445+0000 7fe40e59c700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7fe4100cc0d0 0x7fe4100cc4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.149:52290/0 (socket says 172.21.15.149:52290) 2023-11-08T19:23:56.451 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.446+0000 7fe40ed9d700 1 -- 172.21.15.149:0/1580234564 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe41015f470 msgr2=0x7fe41015c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:56.451 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.446+0000 7fe40ed9d700 1 --2- 172.21.15.149:0/1580234564 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe41015f470 0x7fe41015c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:56.451 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.446+0000 7fe40ed9d700 1 -- 172.21.15.149:0/1580234564 >> v1:172.21.15.160:6789/0 conn(0x7fe4100cc0d0 legacy=0x7fe4100cc4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:56.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.446+0000 7fe40ed9d700 1 -- 172.21.15.149:0/1580234564 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe41015fba0 con 0x7fe41015cb60 2023-11-08T19:23:56.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.446+0000 7fe40dd9b700 1 --2- 172.21.15.149:0/1580234564 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe41015f470 0x7fe41015c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:23:56.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.446+0000 7fe40ed9d700 1 --2- 172.21.15.149:0/1580234564 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe41015cb60 0x7fe4100cf320 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe408009e50 tx=0x7fe40800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c4138104a8c6df8 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:56.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.446+0000 7fe40d59a700 1 -- 172.21.15.149:0/1580234564 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40800e070 con 0x7fe41015cb60 2023-11-08T19:23:56.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.446+0000 7fe40d59a700 1 -- 172.21.15.149:0/1580234564 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe40800b910 con 0x7fe41015cb60 2023-11-08T19:23:56.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.446+0000 7fe40d59a700 1 -- 172.21.15.149:0/1580234564 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40800bcc0 con 0x7fe41015cb60 2023-11-08T19:23:56.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.447+0000 7fe414b81700 1 -- 172.21.15.149:0/1580234564 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe41015cb60 msgr2=0x7fe4100cf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:56.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.447+0000 7fe414b81700 1 --2- 172.21.15.149:0/1580234564 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe41015cb60 0x7fe4100cf320 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe408009e50 tx=0x7fe40800b330 comp rx=0 tx=0).stop 2023-11-08T19:23:56.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.447+0000 7fe414b81700 1 -- 172.21.15.149:0/1580234564 shutdown_connections 2023-11-08T19:23:56.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.447+0000 7fe414b81700 1 --2- 172.21.15.149:0/1580234564 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe41015cb60 0x7fe4100cf320 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:56.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.447+0000 7fe414b81700 1 --2- 172.21.15.149:0/1580234564 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe41015f470 0x7fe41015c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:56.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.447+0000 7fe414b81700 1 -- 172.21.15.149:0/1580234564 >> 172.21.15.149:0/1580234564 conn(0x7fe41006f120 msgr2=0x7fe41006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:56.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.447+0000 7fe414b81700 1 -- 172.21.15.149:0/1580234564 shutdown_connections 2023-11-08T19:23:56.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.447+0000 7fe414b81700 1 -- 172.21.15.149:0/1580234564 wait complete. 2023-11-08T19:23:56.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.448+0000 7fe414b81700 1 Processor -- start 2023-11-08T19:23:56.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.448+0000 7fe414b81700 1 -- start start 2023-11-08T19:23:56.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.449+0000 7fe414b81700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe4100cc0d0 0x7fe410152fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:56.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.449+0000 7fe414b81700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe41015cb60 0x7fe4100c4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:56.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.449+0000 7fe414b81700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe41015f470 0x7fe4100b5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:56.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.449+0000 7fe414b81700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4100c6010 con 0x7fe41015cb60 2023-11-08T19:23:56.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.449+0000 7fe414b81700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4100c5a50 con 0x7fe41015f470 2023-11-08T19:23:56.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.449+0000 7fe414b81700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4100c5d30 con 0x7fe4100cc0d0 2023-11-08T19:23:56.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.449+0000 7fe40dd9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe41015cb60 0x7fe4100c4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:56.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.449+0000 7fe40dd9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe41015cb60 0x7fe4100c4f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38628/0 (socket says 172.21.15.149:38628) 2023-11-08T19:23:56.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.449+0000 7fe40dd9b700 1 -- 172.21.15.149:0/3860813422 learned_addr learned my addr 172.21.15.149:0/3860813422 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:56.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.449+0000 7fe40e59c700 1 --2- 172.21.15.149:0/3860813422 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe4100cc0d0 0x7fe410152fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:56.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.449+0000 7fe40ed9d700 1 --2- 172.21.15.149:0/3860813422 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe41015f470 0x7fe4100b5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:56.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.450+0000 7fe40dd9b700 1 -- 172.21.15.149:0/3860813422 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe4100cc0d0 msgr2=0x7fe410152fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:56.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.450+0000 7fe40dd9b700 1 --2- 172.21.15.149:0/3860813422 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe4100cc0d0 0x7fe410152fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:56.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.450+0000 7fe40dd9b700 1 -- 172.21.15.149:0/3860813422 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe41015f470 msgr2=0x7fe4100b5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:56.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.450+0000 7fe40dd9b700 1 --2- 172.21.15.149:0/3860813422 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe41015f470 0x7fe4100b5620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:56.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.450+0000 7fe40dd9b700 1 -- 172.21.15.149:0/3860813422 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4000094a0 con 0x7fe41015cb60 2023-11-08T19:23:56.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.450+0000 7fe40dd9b700 1 --2- 172.21.15.149:0/3860813422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe41015cb60 0x7fe4100c4f90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe40000ebe0 tx=0x7fe40000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:56.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.450+0000 7fe3feffd700 1 -- 172.21.15.149:0/3860813422 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe400009760 con 0x7fe41015cb60 2023-11-08T19:23:56.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.450+0000 7fe3feffd700 1 -- 172.21.15.149:0/3860813422 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe40000c850 con 0x7fe41015cb60 2023-11-08T19:23:56.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.450+0000 7fe414b81700 1 -- 172.21.15.149:0/3860813422 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe408009b30 con 0x7fe41015cb60 2023-11-08T19:23:56.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.450+0000 7fe3feffd700 1 -- 172.21.15.149:0/3860813422 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40000cbe0 con 0x7fe41015cb60 2023-11-08T19:23:56.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.450+0000 7fe414b81700 1 -- 172.21.15.149:0/3860813422 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4100c6a60 con 0x7fe41015cb60 2023-11-08T19:23:56.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.451+0000 7fe414b81700 1 -- 172.21.15.149:0/3860813422 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4100c6dd0 con 0x7fe41015cb60 2023-11-08T19:23:56.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.451+0000 7fe3feffd700 1 -- 172.21.15.149:0/3860813422 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe40000cd40 con 0x7fe41015cb60 2023-11-08T19:23:56.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.452+0000 7fe3feffd700 1 --2- 172.21.15.149:0/3860813422 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe3f006af00 0x7fe3f006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:56.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.452+0000 7fe40e59c700 1 --2- 172.21.15.149:0/3860813422 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe3f006af00 0x7fe3f006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:56.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.452+0000 7fe3feffd700 1 -- 172.21.15.149:0/3860813422 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe4000898e0 con 0x7fe41015cb60 2023-11-08T19:23:56.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.452+0000 7fe40e59c700 1 --2- 172.21.15.149:0/3860813422 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe3f006af00 0x7fe3f006d3c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe404000f60 tx=0x7fe404007ed0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:56.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.457+0000 7fe3feffd700 1 -- 172.21.15.149:0/3860813422 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe400054660 con 0x7fe41015cb60 2023-11-08T19:23:56.646 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.645+0000 7fe414b81700 1 -- 172.21.15.149:0/3860813422 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe41004f730 con 0x7fe41015cb60 2023-11-08T19:23:56.646 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.645+0000 7fe3feffd700 1 -- 172.21.15.149:0/3860813422 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe400057c80 con 0x7fe41015cb60 2023-11-08T19:23:56.647 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:23:56.649 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.647+0000 7fe414b81700 1 -- 172.21.15.149:0/3860813422 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe3f006af00 msgr2=0x7fe3f006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:56.649 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.647+0000 7fe414b81700 1 --2- 172.21.15.149:0/3860813422 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe3f006af00 0x7fe3f006d3c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe404000f60 tx=0x7fe404007ed0 comp rx=0 tx=0).stop 2023-11-08T19:23:56.649 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.647+0000 7fe414b81700 1 -- 172.21.15.149:0/3860813422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe41015cb60 msgr2=0x7fe4100c4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:56.650 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.647+0000 7fe414b81700 1 --2- 172.21.15.149:0/3860813422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe41015cb60 0x7fe4100c4f90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe40000ebe0 tx=0x7fe40000eef0 comp rx=0 tx=0).stop 2023-11-08T19:23:56.650 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.648+0000 7fe414b81700 1 -- 172.21.15.149:0/3860813422 shutdown_connections 2023-11-08T19:23:56.650 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.648+0000 7fe414b81700 1 --2- 172.21.15.149:0/3860813422 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe3f006af00 0x7fe3f006d3c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:56.650 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.648+0000 7fe414b81700 1 --2- 172.21.15.149:0/3860813422 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe41015f470 0x7fe4100b5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:56.650 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.648+0000 7fe414b81700 1 --2- 172.21.15.149:0/3860813422 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe4100cc0d0 0x7fe410152fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:56.651 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.648+0000 7fe414b81700 1 --2- 172.21.15.149:0/3860813422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe41015cb60 0x7fe4100c4f90 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:56.651 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.648+0000 7fe414b81700 1 -- 172.21.15.149:0/3860813422 >> 172.21.15.149:0/3860813422 conn(0x7fe41006f120 msgr2=0x7fe410159a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:56.651 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.648+0000 7fe414b81700 1 -- 172.21.15.149:0/3860813422 shutdown_connections 2023-11-08T19:23:56.651 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.648+0000 7fe414b81700 1 -- 172.21.15.149:0/3860813422 wait complete. 2023-11-08T19:23:56.661 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-08T19:23:56.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.783+0000 7f08f8b4d700 1 Processor -- start 2023-11-08T19:23:56.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.783+0000 7f08f8b4d700 1 -- start start 2023-11-08T19:23:56.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.784+0000 7f08f8b4d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f08f40cc0d0 0x7f08f415f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:56.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.784+0000 7f08f8b4d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f08f40cc4b0 0x7f08f415c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:56.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.784+0000 7f08f8b4d700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08f415be80 con 0x7f08f415cb60 2023-11-08T19:23:56.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.784+0000 7f08f8b4d700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08f415f9b0 con 0x7f08f40cc4b0 2023-11-08T19:23:56.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.784+0000 7f08f8b4d700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08f415fba0 con 0x7f08f40cc0d0 2023-11-08T19:23:56.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.784+0000 7f08f1d9b700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f08f40cc4b0 0x7f08f415c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:56.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.784+0000 7f08f1d9b700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f08f40cc4b0 0x7f08f415c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38636/0 (socket says 172.21.15.149:38636) 2023-11-08T19:23:56.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.784+0000 7f08f1d9b700 1 -- 172.21.15.149:0/271038888 learned_addr learned my addr 172.21.15.149:0/271038888 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:56.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.784+0000 7f08f259c700 1 --2- 172.21.15.149:0/271038888 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f08f40cc0d0 0x7f08f415f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:56.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.784+0000 7f08f1d9b700 1 -- 172.21.15.149:0/271038888 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f08f40cc0d0 msgr2=0x7f08f415f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:56.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.784+0000 7f08f1d9b700 1 --2- 172.21.15.149:0/271038888 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f08f40cc0d0 0x7f08f415f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:56.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.784+0000 7f08f1d9b700 1 -- 172.21.15.149:0/271038888 >> v1:172.21.15.160:6789/0 conn(0x7f08f415cb60 legacy=0x7f08f40cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:56.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.784+0000 7f08f1d9b700 1 -- 172.21.15.149:0/271038888 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f415fe80 con 0x7f08f40cc4b0 2023-11-08T19:23:56.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.785+0000 7f08f1d9b700 1 --2- 172.21.15.149:0/271038888 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08f40cc4b0 0x7f08f415c620 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f08e40098f0 tx=0x7f08e4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f42a97d76006f762 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:56.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.785+0000 7f08f159a700 1 -- 172.21.15.149:0/271038888 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e4004230 con 0x7f08f40cc4b0 2023-11-08T19:23:56.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.785+0000 7f08f159a700 1 -- 172.21.15.149:0/271038888 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e4004390 con 0x7f08f40cc4b0 2023-11-08T19:23:56.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.785+0000 7f08f159a700 1 -- 172.21.15.149:0/271038888 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e40036a0 con 0x7f08f40cc4b0 2023-11-08T19:23:56.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.785+0000 7f08f8b4d700 1 -- 172.21.15.149:0/271038888 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08f40cc4b0 msgr2=0x7f08f415c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:56.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.785+0000 7f08f8b4d700 1 --2- 172.21.15.149:0/271038888 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08f40cc4b0 0x7f08f415c620 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f08e40098f0 tx=0x7f08e4009c00 comp rx=0 tx=0).stop 2023-11-08T19:23:56.791 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.785+0000 7f08f8b4d700 1 -- 172.21.15.149:0/271038888 shutdown_connections 2023-11-08T19:23:56.791 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.785+0000 7f08f8b4d700 1 --2- 172.21.15.149:0/271038888 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f08f40cc0d0 0x7f08f415f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:56.791 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.785+0000 7f08f8b4d700 1 --2- 172.21.15.149:0/271038888 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08f40cc4b0 0x7f08f415c620 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:56.791 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.785+0000 7f08f8b4d700 1 -- 172.21.15.149:0/271038888 >> 172.21.15.149:0/271038888 conn(0x7f08f406f120 msgr2=0x7f08f406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:56.791 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.785+0000 7f08f8b4d700 1 -- 172.21.15.149:0/271038888 shutdown_connections 2023-11-08T19:23:56.792 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.785+0000 7f08f8b4d700 1 -- 172.21.15.149:0/271038888 wait complete. 2023-11-08T19:23:56.794 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.787+0000 7f08f8b4d700 1 Processor -- start 2023-11-08T19:23:56.794 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.787+0000 7f08f8b4d700 1 -- start start 2023-11-08T19:23:56.794 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.787+0000 7f08f8b4d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f08f40cc0d0 0x7f08f41f2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:56.795 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.787+0000 7f08f8b4d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08f40cc4b0 0x7f08f415b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:56.795 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.787+0000 7f08f8b4d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08f415cb60 0x7f08f40d0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:56.795 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.787+0000 7f08f8b4d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f414b640 con 0x7f08f415cb60 2023-11-08T19:23:56.795 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.787+0000 7f08f8b4d700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f41f7330 con 0x7f08f40cc4b0 2023-11-08T19:23:56.795 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.787+0000 7f08f8b4d700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08f41f6a00 con 0x7f08f40cc0d0 2023-11-08T19:23:56.796 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.788+0000 7f08f2d9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08f415cb60 0x7f08f40d0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:56.796 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.788+0000 7f08f2d9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08f415cb60 0x7f08f40d0050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38644/0 (socket says 172.21.15.149:38644) 2023-11-08T19:23:56.796 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.788+0000 7f08f2d9d700 1 -- 172.21.15.149:0/2713031992 learned_addr learned my addr 172.21.15.149:0/2713031992 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:56.796 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.788+0000 7f08f259c700 1 --2- 172.21.15.149:0/2713031992 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f08f40cc0d0 0x7f08f41f2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:56.796 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.788+0000 7f08f1d9b700 1 --2- 172.21.15.149:0/2713031992 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08f40cc4b0 0x7f08f415b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:56.797 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.788+0000 7f08f2d9d700 1 -- 172.21.15.149:0/2713031992 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f08f40cc0d0 msgr2=0x7f08f41f2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:56.797 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.788+0000 7f08f2d9d700 1 --2- 172.21.15.149:0/2713031992 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f08f40cc0d0 0x7f08f41f2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:56.797 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.788+0000 7f08f2d9d700 1 -- 172.21.15.149:0/2713031992 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08f40cc4b0 msgr2=0x7f08f415b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:56.797 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.788+0000 7f08f2d9d700 1 --2- 172.21.15.149:0/2713031992 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08f40cc4b0 0x7f08f415b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:56.797 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.788+0000 7f08f2d9d700 1 -- 172.21.15.149:0/2713031992 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e4009550 con 0x7f08f415cb60 2023-11-08T19:23:56.798 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.788+0000 7f08f2d9d700 1 --2- 172.21.15.149:0/2713031992 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08f415cb60 0x7f08f40d0050 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f08ec00b970 tx=0x7f08ec00bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:56.798 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.788+0000 7f08e2ffd700 1 -- 172.21.15.149:0/2713031992 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ec00c9b0 con 0x7f08f415cb60 2023-11-08T19:23:56.798 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.788+0000 7f08e2ffd700 1 -- 172.21.15.149:0/2713031992 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08ec00cb10 con 0x7f08f415cb60 2023-11-08T19:23:56.798 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.788+0000 7f08f8b4d700 1 -- 172.21.15.149:0/2713031992 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08f41f6ce0 con 0x7f08f415cb60 2023-11-08T19:23:56.798 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.788+0000 7f08e2ffd700 1 -- 172.21.15.149:0/2713031992 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ec014440 con 0x7f08f415cb60 2023-11-08T19:23:56.799 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.788+0000 7f08f8b4d700 1 -- 172.21.15.149:0/2713031992 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08f41f7070 con 0x7f08f415cb60 2023-11-08T19:23:56.799 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.789+0000 7f08f8b4d700 1 -- 172.21.15.149:0/2713031992 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08f41f6e70 con 0x7f08f415cb60 2023-11-08T19:23:56.799 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.790+0000 7f08e2ffd700 1 -- 172.21.15.149:0/2713031992 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f08ec01d3b0 con 0x7f08f415cb60 2023-11-08T19:23:56.799 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.790+0000 7f08e2ffd700 1 --2- 172.21.15.149:0/2713031992 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f08d406af00 0x7f08d406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:56.799 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.790+0000 7f08e2ffd700 1 -- 172.21.15.149:0/2713031992 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f08ec089620 con 0x7f08f415cb60 2023-11-08T19:23:56.800 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.790+0000 7f08f259c700 1 --2- 172.21.15.149:0/2713031992 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f08d406af00 0x7f08d406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:56.800 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.790+0000 7f08f259c700 1 --2- 172.21.15.149:0/2713031992 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f08d406af00 0x7f08d406d3c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f08e8009930 tx=0x7f08e8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:56.800 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.795+0000 7f08e2ffd700 1 -- 172.21.15.149:0/2713031992 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f08ec054310 con 0x7f08f415cb60 2023-11-08T19:23:56.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.984+0000 7f08f8b4d700 1 -- 172.21.15.149:0/2713031992 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f08f414b790 con 0x7f08f415cb60 2023-11-08T19:23:56.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.985+0000 7f08e2ffd700 1 -- 172.21.15.149:0/2713031992 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f08ec05ce60 con 0x7f08f415cb60 2023-11-08T19:23:56.986 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 64 2023-11-08T19:23:56.988 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.987+0000 7f08f8b4d700 1 -- 172.21.15.149:0/2713031992 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f08d406af00 msgr2=0x7f08d406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:56.988 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.987+0000 7f08f8b4d700 1 --2- 172.21.15.149:0/2713031992 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f08d406af00 0x7f08d406d3c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f08e8009930 tx=0x7f08e8008040 comp rx=0 tx=0).stop 2023-11-08T19:23:56.989 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.987+0000 7f08f8b4d700 1 -- 172.21.15.149:0/2713031992 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08f415cb60 msgr2=0x7f08f40d0050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:56.989 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.987+0000 7f08f8b4d700 1 --2- 172.21.15.149:0/2713031992 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08f415cb60 0x7f08f40d0050 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f08ec00b970 tx=0x7f08ec00bd30 comp rx=0 tx=0).stop 2023-11-08T19:23:56.989 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.987+0000 7f08f8b4d700 1 -- 172.21.15.149:0/2713031992 shutdown_connections 2023-11-08T19:23:56.989 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.987+0000 7f08f8b4d700 1 --2- 172.21.15.149:0/2713031992 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f08d406af00 0x7f08d406d3c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:56.989 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.987+0000 7f08f8b4d700 1 --2- 172.21.15.149:0/2713031992 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08f415cb60 0x7f08f40d0050 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:56.989 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.987+0000 7f08f8b4d700 1 --2- 172.21.15.149:0/2713031992 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f08f40cc0d0 0x7f08f41f2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:56.990 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.987+0000 7f08f8b4d700 1 --2- 172.21.15.149:0/2713031992 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08f40cc4b0 0x7f08f415b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:56.990 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.987+0000 7f08f8b4d700 1 -- 172.21.15.149:0/2713031992 >> 172.21.15.149:0/2713031992 conn(0x7f08f406f120 msgr2=0x7f08f40cf300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:56.990 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.987+0000 7f08f8b4d700 1 -- 172.21.15.149:0/2713031992 shutdown_connections 2023-11-08T19:23:56.990 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:56.987+0000 7f08f8b4d700 1 -- 172.21.15.149:0/2713031992 wait complete. 2023-11-08T19:23:57.000 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-08T19:23:57.123 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.122+0000 7f23506a3700 1 Processor -- start 2023-11-08T19:23:57.124 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.122+0000 7f23506a3700 1 -- start start 2023-11-08T19:23:57.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.123+0000 7f23506a3700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f234806ab80 0x7f23480caf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:57.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.123+0000 7f23506a3700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f234815e320 con 0x7f23480cf1c0 2023-11-08T19:23:57.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.123+0000 7f23506a3700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f234806b020 con 0x7f234815df40 2023-11-08T19:23:57.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.123+0000 7f23506a3700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f234806b2e0 con 0x7f234806ab80 2023-11-08T19:23:57.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.123+0000 7f234ec40700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f23480cf1c0 0x7f23480ce540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:40654/0 (socket says 172.21.15.149:40654) 2023-11-08T19:23:57.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.123+0000 7f234ec40700 1 -- 172.21.15.149:0/3803107233 learned_addr learned my addr 172.21.15.149:0/3803107233 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:23:57.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.124+0000 7f234dc3e700 1 --2- 172.21.15.149:0/3803107233 >> v2:172.21.15.160:3300/0 conn(0x7f234806ab80 0x7f23480caf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:57.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.124+0000 7f234d43d700 1 -- 172.21.15.149:0/3803107233 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2883195211 0 0) 0x7f234815e320 con 0x7f23480cf1c0 2023-11-08T19:23:57.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.124+0000 7f234d43d700 1 -- 172.21.15.149:0/3803107233 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23340035b0 con 0x7f23480cf1c0 2023-11-08T19:23:57.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.124+0000 7f234d43d700 1 -- 172.21.15.149:0/3803107233 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3715622 0 0) 0x7f23340035b0 con 0x7f23480cf1c0 2023-11-08T19:23:57.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.124+0000 7f234d43d700 1 -- 172.21.15.149:0/3803107233 >> v2:172.21.15.160:3300/0 conn(0x7f234806ab80 msgr2=0x7f23480caf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:57.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.124+0000 7f234d43d700 1 --2- 172.21.15.149:0/3803107233 >> v2:172.21.15.160:3300/0 conn(0x7f234806ab80 0x7f23480caf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:57.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.124+0000 7f234d43d700 1 -- 172.21.15.149:0/3803107233 >> v1:172.21.15.160:6789/0 conn(0x7f234815df40 legacy=0x7f234806c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:57.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.124+0000 7f234d43d700 1 -- 172.21.15.149:0/3803107233 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f234806b5c0 con 0x7f23480cf1c0 2023-11-08T19:23:57.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.124+0000 7f234d43d700 1 -- 172.21.15.149:0/3803107233 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f23400019f0 con 0x7f23480cf1c0 2023-11-08T19:23:57.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.124+0000 7f234d43d700 1 -- 172.21.15.149:0/3803107233 >> v1:172.21.15.149:6789/0 conn(0x7f23480cf1c0 legacy=0x7f23480ce540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:57.131 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.124+0000 7f234d43d700 1 --2- 172.21.15.149:0/3803107233 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2334003a70 0x7f2334003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:57.131 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.124+0000 7f234d43d700 1 --2- 172.21.15.149:0/3803107233 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2334004850 0x7f2334004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:57.131 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.124+0000 7f234d43d700 1 --2- 172.21.15.149:0/3803107233 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2334005210 0x7f233400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:57.131 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.124+0000 7f234d43d700 1 -- 172.21.15.149:0/3803107233 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f234806b2e0 con 0x7f2334003a70 2023-11-08T19:23:57.131 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.124+0000 7f234d43d700 1 -- 172.21.15.149:0/3803107233 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f233400c140 con 0x7f2334005210 2023-11-08T19:23:57.132 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.124+0000 7f234d43d700 1 -- 172.21.15.149:0/3803107233 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f233400c300 con 0x7f2334004850 2023-11-08T19:23:57.132 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.124+0000 7f234e43f700 1 --2- 172.21.15.149:0/3803107233 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2334003a70 0x7f2334003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:57.132 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.124+0000 7f234dc3e700 1 --2- 172.21.15.149:0/3803107233 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2334004850 0x7f2334004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:57.132 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.124+0000 7f234ec40700 1 --2- 172.21.15.149:0/3803107233 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2334005210 0x7f233400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:57.133 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.124+0000 7f234e43f700 1 -- 172.21.15.149:0/3803107233 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2334004850 msgr2=0x7f2334004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:57.133 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.124+0000 7f234e43f700 1 --2- 172.21.15.149:0/3803107233 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2334004850 0x7f2334004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:57.133 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.124+0000 7f234e43f700 1 -- 172.21.15.149:0/3803107233 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2334005210 msgr2=0x7f233400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:57.133 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.124+0000 7f234e43f700 1 --2- 172.21.15.149:0/3803107233 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2334005210 0x7f233400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:57.133 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.124+0000 7f234e43f700 1 -- 172.21.15.149:0/3803107233 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23340035b0 con 0x7f2334003a70 2023-11-08T19:23:57.134 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.125+0000 7f234ec40700 1 --2- 172.21.15.149:0/3803107233 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2334005210 0x7f233400ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:23:57.134 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.125+0000 7f234ec40700 1 -- 172.21.15.149:0/3803107233 reap_dead start 2023-11-08T19:23:57.134 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.125+0000 7f234e43f700 1 --2- 172.21.15.149:0/3803107233 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2334003a70 0x7f2334003e90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f23440017c0 tx=0x7f2334005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=521bfe378f2f3d5d server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:57.134 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.125+0000 7f234d43d700 1 -- 172.21.15.149:0/3803107233 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23440052d0 con 0x7f2334003a70 2023-11-08T19:23:57.134 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.125+0000 7f234d43d700 1 -- 172.21.15.149:0/3803107233 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2344005430 con 0x7f2334003a70 2023-11-08T19:23:57.135 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.125+0000 7f234d43d700 1 -- 172.21.15.149:0/3803107233 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23440038c0 con 0x7f2334003a70 2023-11-08T19:23:57.135 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.125+0000 7f23506a3700 1 -- 172.21.15.149:0/3803107233 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2334003a70 msgr2=0x7f2334003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:57.135 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.125+0000 7f23506a3700 1 --2- 172.21.15.149:0/3803107233 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2334003a70 0x7f2334003e90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f23440017c0 tx=0x7f2334005880 comp rx=0 tx=0).stop 2023-11-08T19:23:57.135 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.125+0000 7f23506a3700 1 -- 172.21.15.149:0/3803107233 shutdown_connections 2023-11-08T19:23:57.135 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.125+0000 7f23506a3700 1 --2- 172.21.15.149:0/3803107233 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2334003a70 0x7f2334003e90 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:57.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.125+0000 7f23506a3700 1 -- 172.21.15.149:0/3803107233 >> 172.21.15.149:0/3803107233 conn(0x7f23480d0640 msgr2=0x7f23480d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:57.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.125+0000 7f23506a3700 1 -- 172.21.15.149:0/3803107233 shutdown_connections 2023-11-08T19:23:57.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.125+0000 7f23506a3700 1 -- 172.21.15.149:0/3803107233 wait complete. 2023-11-08T19:23:57.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.127+0000 7f23506a3700 1 Processor -- start 2023-11-08T19:23:57.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.127+0000 7f23506a3700 1 -- start start 2023-11-08T19:23:57.139 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.127+0000 7f23506a3700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2334003a70 0x7f23480ae130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:57.139 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.127+0000 7f23506a3700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f23480c97d0 0x7f234815c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:57.140 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.127+0000 7f23506a3700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f234815cc10 0x7f234815d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:57.140 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.127+0000 7f23506a3700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f234815d5d0 con 0x7f234815cc10 2023-11-08T19:23:57.140 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.127+0000 7f23506a3700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23480ca570 con 0x7f23480c97d0 2023-11-08T19:23:57.140 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.127+0000 7f23506a3700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23481599d0 con 0x7f2334003a70 2023-11-08T19:23:57.140 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.127+0000 7f234ec40700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f234815cc10 0x7f234815d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:57.141 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.127+0000 7f234ec40700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f234815cc10 0x7f234815d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38662/0 (socket says 172.21.15.149:38662) 2023-11-08T19:23:57.141 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.127+0000 7f234ec40700 1 -- 172.21.15.149:0/2337286262 learned_addr learned my addr 172.21.15.149:0/2337286262 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:57.141 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.128+0000 7f234dc3e700 1 --2- 172.21.15.149:0/2337286262 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f23480c97d0 0x7f234815c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:57.141 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.128+0000 7f234e43f700 1 --2- 172.21.15.149:0/2337286262 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2334003a70 0x7f23480ae130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:57.141 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.128+0000 7f234ec40700 1 -- 172.21.15.149:0/2337286262 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2334003a70 msgr2=0x7f23480ae130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:57.142 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.128+0000 7f234ec40700 1 --2- 172.21.15.149:0/2337286262 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2334003a70 0x7f23480ae130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:57.142 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.128+0000 7f234ec40700 1 -- 172.21.15.149:0/2337286262 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f23480c97d0 msgr2=0x7f234815c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:57.142 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.128+0000 7f234ec40700 1 --2- 172.21.15.149:0/2337286262 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f23480c97d0 0x7f234815c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:57.142 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.128+0000 7f234ec40700 1 -- 172.21.15.149:0/2337286262 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23480c9fb0 con 0x7f234815cc10 2023-11-08T19:23:57.142 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.128+0000 7f234e43f700 1 --2- 172.21.15.149:0/2337286262 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2334003a70 0x7f23480ae130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:23:57.143 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.128+0000 7f234dc3e700 1 --2- 172.21.15.149:0/2337286262 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f23480c97d0 0x7f234815c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:23:57.143 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.128+0000 7f234ec40700 1 --2- 172.21.15.149:0/2337286262 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f234815cc10 0x7f234815d090 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f23480c76a0 tx=0x7f234000e440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:57.143 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.128+0000 7f233effd700 1 -- 172.21.15.149:0/2337286262 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2340017070 con 0x7f234815cc10 2023-11-08T19:23:57.143 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.128+0000 7f233effd700 1 -- 172.21.15.149:0/2337286262 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f234000ecd0 con 0x7f234815cc10 2023-11-08T19:23:57.143 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.128+0000 7f23506a3700 1 -- 172.21.15.149:0/2337286262 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23480ca290 con 0x7f234815cc10 2023-11-08T19:23:57.144 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.128+0000 7f233effd700 1 -- 172.21.15.149:0/2337286262 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f234000ee60 con 0x7f234815cc10 2023-11-08T19:23:57.144 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.128+0000 7f23506a3700 1 -- 172.21.15.149:0/2337286262 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23480c4560 con 0x7f234815cc10 2023-11-08T19:23:57.144 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.129+0000 7f23506a3700 1 -- 172.21.15.149:0/2337286262 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f234804f730 con 0x7f234815cc10 2023-11-08T19:23:57.144 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.129+0000 7f233effd700 1 -- 172.21.15.149:0/2337286262 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2340013420 con 0x7f234815cc10 2023-11-08T19:23:57.144 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.130+0000 7f233effd700 1 --2- 172.21.15.149:0/2337286262 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f232c06af30 0x7f232c06d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:57.145 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.130+0000 7f233effd700 1 -- 172.21.15.149:0/2337286262 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f23400897d0 con 0x7f234815cc10 2023-11-08T19:23:57.145 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.130+0000 7f234e43f700 1 --2- 172.21.15.149:0/2337286262 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f232c06af30 0x7f232c06d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:57.145 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.130+0000 7f234e43f700 1 --2- 172.21.15.149:0/2337286262 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f232c06af30 0x7f232c06d3f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2344000c00 tx=0x7f2344009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:57.145 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.135+0000 7f233effd700 1 -- 172.21.15.149:0/2337286262 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f23400544c0 con 0x7f234815cc10 2023-11-08T19:23:57.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.323+0000 7f23506a3700 1 -- 172.21.15.149:0/2337286262 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f234806bb80 con 0x7f234815cc10 2023-11-08T19:23:57.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.323+0000 7f233effd700 1 -- 172.21.15.149:0/2337286262 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2340057ae0 con 0x7f234815cc10 2023-11-08T19:23:57.325 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:23:57.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.325+0000 7f23506a3700 1 -- 172.21.15.149:0/2337286262 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f232c06af30 msgr2=0x7f232c06d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:57.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.325+0000 7f23506a3700 1 --2- 172.21.15.149:0/2337286262 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f232c06af30 0x7f232c06d3f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2344000c00 tx=0x7f2344009030 comp rx=0 tx=0).stop 2023-11-08T19:23:57.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.325+0000 7f23506a3700 1 -- 172.21.15.149:0/2337286262 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f234815cc10 msgr2=0x7f234815d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:57.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.325+0000 7f23506a3700 1 --2- 172.21.15.149:0/2337286262 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f234815cc10 0x7f234815d090 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f23480c76a0 tx=0x7f234000e440 comp rx=0 tx=0).stop 2023-11-08T19:23:57.328 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.326+0000 7f23506a3700 1 -- 172.21.15.149:0/2337286262 shutdown_connections 2023-11-08T19:23:57.328 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.326+0000 7f23506a3700 1 --2- 172.21.15.149:0/2337286262 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f232c06af30 0x7f232c06d3f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:57.328 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.326+0000 7f23506a3700 1 --2- 172.21.15.149:0/2337286262 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f234815cc10 0x7f234815d090 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:57.328 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.326+0000 7f23506a3700 1 --2- 172.21.15.149:0/2337286262 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2334003a70 0x7f23480ae130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:57.328 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.326+0000 7f23506a3700 1 --2- 172.21.15.149:0/2337286262 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f23480c97d0 0x7f234815c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:57.329 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.326+0000 7f23506a3700 1 -- 172.21.15.149:0/2337286262 >> 172.21.15.149:0/2337286262 conn(0x7f23480d0640 msgr2=0x7f23480b18f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:57.329 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.326+0000 7f23506a3700 1 -- 172.21.15.149:0/2337286262 shutdown_connections 2023-11-08T19:23:57.329 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.326+0000 7f23506a3700 1 -- 172.21.15.149:0/2337286262 wait complete. 2023-11-08T19:23:57.339 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-08T19:23:57.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.460+0000 7f1abfddf700 1 Processor -- start 2023-11-08T19:23:57.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.461+0000 7f1abfddf700 1 -- start start 2023-11-08T19:23:57.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.461+0000 7f1abfddf700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f1ab80cc140 0x7f1ab80cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:57.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.461+0000 7f1abfddf700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f1ab80b2850 0x7f1ab80cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:57.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.461+0000 7f1abfddf700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1ab80b2cd0 0x7f1ab80cb130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:57.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.461+0000 7f1abfddf700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ab80b2430 con 0x7f1ab80cc140 2023-11-08T19:23:57.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.461+0000 7f1abfddf700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ab80cb670 con 0x7f1ab80b2850 2023-11-08T19:23:57.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.461+0000 7f1abfddf700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab80cce50 con 0x7f1ab80b2cd0 2023-11-08T19:23:57.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.462+0000 7f1abdb7b700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f1ab80cc140 0x7f1ab80cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:57.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.462+0000 7f1abdb7b700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f1ab80cc140 0x7f1ab80cc910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38668/0 (socket says 172.21.15.149:38668) 2023-11-08T19:23:57.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.462+0000 7f1abdb7b700 1 -- 172.21.15.149:0/886535102 learned_addr learned my addr 172.21.15.149:0/886535102 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:57.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.462+0000 7f1abe37c700 1 --2- 172.21.15.149:0/886535102 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1ab80b2cd0 0x7f1ab80cb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:57.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.462+0000 7f1abd37a700 1 --2- 172.21.15.149:0/886535102 >> v2:172.21.15.160:3300/0 conn(0x7f1ab80b2850 0x7f1ab80cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:57.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.462+0000 7f1abdb7b700 1 -- 172.21.15.149:0/886535102 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1ab80b2cd0 msgr2=0x7f1ab80cb130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:57.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.462+0000 7f1abdb7b700 1 --2- 172.21.15.149:0/886535102 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1ab80b2cd0 0x7f1ab80cb130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:57.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.462+0000 7f1abdb7b700 1 -- 172.21.15.149:0/886535102 >> v2:172.21.15.160:3300/0 conn(0x7f1ab80b2850 msgr2=0x7f1ab80cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:57.468 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.462+0000 7f1abdb7b700 1 --2- 172.21.15.149:0/886535102 >> v2:172.21.15.160:3300/0 conn(0x7f1ab80b2850 0x7f1ab80cabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:57.468 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.462+0000 7f1abdb7b700 1 -- 172.21.15.149:0/886535102 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab80cc520 con 0x7f1ab80cc140 2023-11-08T19:23:57.468 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.462+0000 7f1abd37a700 1 --2- 172.21.15.149:0/886535102 >> v2:172.21.15.160:3300/0 conn(0x7f1ab80b2850 0x7f1ab80cabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:23:57.468 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.462+0000 7f1abdb7b700 1 --2- 172.21.15.149:0/886535102 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ab80cc140 0x7f1ab80cc910 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1ab80b1330 tx=0x7f1aa8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1f20f226dba1d41 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:57.468 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.462+0000 7f1abcb79700 1 -- 172.21.15.149:0/886535102 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa8005e30 con 0x7f1ab80cc140 2023-11-08T19:23:57.469 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.462+0000 7f1abcb79700 1 -- 172.21.15.149:0/886535102 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa8004030 con 0x7f1ab80cc140 2023-11-08T19:23:57.469 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.462+0000 7f1abcb79700 1 -- 172.21.15.149:0/886535102 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa80043e0 con 0x7f1ab80cc140 2023-11-08T19:23:57.469 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.463+0000 7f1abfddf700 1 -- 172.21.15.149:0/886535102 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ab80cc140 msgr2=0x7f1ab80cc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:57.469 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.463+0000 7f1abfddf700 1 --2- 172.21.15.149:0/886535102 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ab80cc140 0x7f1ab80cc910 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1ab80b1330 tx=0x7f1aa8009bd0 comp rx=0 tx=0).stop 2023-11-08T19:23:57.469 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.463+0000 7f1abfddf700 1 -- 172.21.15.149:0/886535102 shutdown_connections 2023-11-08T19:23:57.470 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.463+0000 7f1abfddf700 1 --2- 172.21.15.149:0/886535102 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1ab80b2cd0 0x7f1ab80cb130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:57.470 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.463+0000 7f1abfddf700 1 --2- 172.21.15.149:0/886535102 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ab80cc140 0x7f1ab80cc910 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:57.470 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.463+0000 7f1abfddf700 1 --2- 172.21.15.149:0/886535102 >> v2:172.21.15.160:3300/0 conn(0x7f1ab80b2850 0x7f1ab80cabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:57.471 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.463+0000 7f1abfddf700 1 -- 172.21.15.149:0/886535102 >> 172.21.15.149:0/886535102 conn(0x7f1ab8099a40 msgr2=0x7f1ab80d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:57.471 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.463+0000 7f1abfddf700 1 -- 172.21.15.149:0/886535102 shutdown_connections 2023-11-08T19:23:57.471 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.463+0000 7f1abfddf700 1 -- 172.21.15.149:0/886535102 wait complete. 2023-11-08T19:23:57.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.464+0000 7f1abfddf700 1 Processor -- start 2023-11-08T19:23:57.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.464+0000 7f1abfddf700 1 -- start start 2023-11-08T19:23:57.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.465+0000 7f1abfddf700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ab80b2850 0x7f1ab80ad1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:57.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.465+0000 7f1abfddf700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ab80b2cd0 0x7f1ab815ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:57.475 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.465+0000 7f1abfddf700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1ab80cc140 0x7f1ab80c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:57.475 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.465+0000 7f1abfddf700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab80b03e0 con 0x7f1ab80b2850 2023-11-08T19:23:57.475 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.465+0000 7f1abfddf700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab80af7d0 con 0x7f1ab80b2cd0 2023-11-08T19:23:57.475 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.465+0000 7f1abfddf700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab80afab0 con 0x7f1ab80cc140 2023-11-08T19:23:57.475 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.465+0000 7f1abdb7b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ab80b2850 0x7f1ab80ad1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:57.476 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.465+0000 7f1abdb7b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ab80b2850 0x7f1ab80ad1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38674/0 (socket says 172.21.15.149:38674) 2023-11-08T19:23:57.476 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.465+0000 7f1abdb7b700 1 -- 172.21.15.149:0/1825972522 learned_addr learned my addr 172.21.15.149:0/1825972522 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:57.476 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.465+0000 7f1abd37a700 1 --2- 172.21.15.149:0/1825972522 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ab80b2cd0 0x7f1ab815ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:57.476 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.465+0000 7f1abdb7b700 1 -- 172.21.15.149:0/1825972522 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1ab80cc140 msgr2=0x7f1ab80c84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:57.477 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.465+0000 7f1abe37c700 1 --2- 172.21.15.149:0/1825972522 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1ab80cc140 0x7f1ab80c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:57.477 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.465+0000 7f1abdb7b700 1 --2- 172.21.15.149:0/1825972522 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1ab80cc140 0x7f1ab80c84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:57.477 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.465+0000 7f1abdb7b700 1 -- 172.21.15.149:0/1825972522 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ab80b2cd0 msgr2=0x7f1ab815ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:57.477 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.465+0000 7f1abdb7b700 1 --2- 172.21.15.149:0/1825972522 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ab80b2cd0 0x7f1ab815ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:57.477 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.465+0000 7f1abdb7b700 1 -- 172.21.15.149:0/1825972522 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa8009500 con 0x7f1ab80b2850 2023-11-08T19:23:57.478 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.465+0000 7f1abdb7b700 1 --2- 172.21.15.149:0/1825972522 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ab80b2850 0x7f1ab80ad1c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f1aa8009130 tx=0x7f1aa8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:57.478 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.465+0000 7f1aae7fc700 1 -- 172.21.15.149:0/1825972522 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa8003dd0 con 0x7f1ab80b2850 2023-11-08T19:23:57.478 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.465+0000 7f1aae7fc700 1 -- 172.21.15.149:0/1825972522 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa8011420 con 0x7f1ab80b2850 2023-11-08T19:23:57.478 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.465+0000 7f1abfddf700 1 -- 172.21.15.149:0/1825972522 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ab80afd90 con 0x7f1ab80b2850 2023-11-08T19:23:57.478 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.465+0000 7f1aae7fc700 1 -- 172.21.15.149:0/1825972522 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa80117d0 con 0x7f1ab80b2850 2023-11-08T19:23:57.479 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.466+0000 7f1abfddf700 1 -- 172.21.15.149:0/1825972522 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ab80ad700 con 0x7f1ab80b2850 2023-11-08T19:23:57.479 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.466+0000 7f1abfddf700 1 -- 172.21.15.149:0/1825972522 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ab80745f0 con 0x7f1ab80b2850 2023-11-08T19:23:57.479 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.467+0000 7f1aae7fc700 1 -- 172.21.15.149:0/1825972522 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1aa8011930 con 0x7f1ab80b2850 2023-11-08T19:23:57.479 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.467+0000 7f1aae7fc700 1 --2- 172.21.15.149:0/1825972522 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1a9c06af00 0x7f1a9c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:57.479 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.467+0000 7f1aae7fc700 1 -- 172.21.15.149:0/1825972522 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1aa808ab50 con 0x7f1ab80b2850 2023-11-08T19:23:57.480 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.467+0000 7f1abd37a700 1 --2- 172.21.15.149:0/1825972522 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1a9c06af00 0x7f1a9c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:57.480 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.468+0000 7f1abd37a700 1 --2- 172.21.15.149:0/1825972522 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1a9c06af00 0x7f1a9c06d3c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1ab81f7bb0 tx=0x7f1ab4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:57.480 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.472+0000 7f1aae7fc700 1 -- 172.21.15.149:0/1825972522 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1aa80559f0 con 0x7f1ab80b2850 2023-11-08T19:23:57.680 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.679+0000 7f1abfddf700 1 -- 172.21.15.149:0/1825972522 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f1ab80d0b00 con 0x7f1ab80b2850 2023-11-08T19:23:57.680 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.679+0000 7f1aae7fc700 1 -- 172.21.15.149:0/1825972522 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1aa8059010 con 0x7f1ab80b2850 2023-11-08T19:23:57.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.681+0000 7f1abfddf700 1 -- 172.21.15.149:0/1825972522 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1a9c06af00 msgr2=0x7f1a9c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:57.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.681+0000 7f1abfddf700 1 --2- 172.21.15.149:0/1825972522 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1a9c06af00 0x7f1a9c06d3c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1ab81f7bb0 tx=0x7f1ab4008040 comp rx=0 tx=0).stop 2023-11-08T19:23:57.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.681+0000 7f1abfddf700 1 -- 172.21.15.149:0/1825972522 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ab80b2850 msgr2=0x7f1ab80ad1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:57.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.681+0000 7f1abfddf700 1 --2- 172.21.15.149:0/1825972522 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ab80b2850 0x7f1ab80ad1c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f1aa8009130 tx=0x7f1aa8004750 comp rx=0 tx=0).stop 2023-11-08T19:23:57.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.681+0000 7f1abfddf700 1 -- 172.21.15.149:0/1825972522 shutdown_connections 2023-11-08T19:23:57.684 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.681+0000 7f1abfddf700 1 --2- 172.21.15.149:0/1825972522 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1a9c06af00 0x7f1a9c06d3c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:57.684 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.681+0000 7f1abfddf700 1 --2- 172.21.15.149:0/1825972522 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1ab80cc140 0x7f1ab80c84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:57.684 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.681+0000 7f1abfddf700 1 --2- 172.21.15.149:0/1825972522 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ab80b2850 0x7f1ab80ad1c0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:57.684 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.681+0000 7f1abfddf700 1 --2- 172.21.15.149:0/1825972522 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ab80b2cd0 0x7f1ab815ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:57.684 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.681+0000 7f1abfddf700 1 -- 172.21.15.149:0/1825972522 >> 172.21.15.149:0/1825972522 conn(0x7f1ab8099a40 msgr2=0x7f1ab80cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:57.685 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.681+0000 7f1abfddf700 1 -- 172.21.15.149:0/1825972522 shutdown_connections 2023-11-08T19:23:57.685 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:57.681+0000 7f1abfddf700 1 -- 172.21.15.149:0/1825972522 wait complete. 2023-11-08T19:23:57.685 INFO:teuthology.orchestra.run.smithi149.stderr:listed 0 entries 2023-11-08T19:23:57.695 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-11-08T19:23:57.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:57.695 DEBUG:teuthology.orchestra.run.smithi149:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-11-08T19:23:57.729 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi149.front.sepia.ceph.com 2023-11-08T19:23:57.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:57.730 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-08T19:23:57.786 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-11-08T19:23:57.786 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:23:57.808 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-11-08T19:23:57.808 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:23:57.869 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-11-08T19:23:57.869 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:23:57.929 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:23:58.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.050+0000 7f7a23beb700 1 Processor -- start 2023-11-08T19:23:58.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.051+0000 7f7a23beb700 1 -- start start 2023-11-08T19:23:58.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.051+0000 7f7a23beb700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7a1c0cc140 0x7f7a1c0cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:58.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.051+0000 7f7a23beb700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f7a1c0b2cd0 0x7f7a1c15d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:58.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.051+0000 7f7a23beb700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a1c0cce50 con 0x7f7a1c0b2850 2023-11-08T19:23:58.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.051+0000 7f7a23beb700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a1c0b2430 con 0x7f7a1c0b2cd0 2023-11-08T19:23:58.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.051+0000 7f7a23beb700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c0cc520 con 0x7f7a1c0cc140 2023-11-08T19:23:58.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.052+0000 7f7a21987700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7a1c0cc140 0x7f7a1c0cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:58.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.052+0000 7f7a22188700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f7a1c0b2cd0 0x7f7a1c15d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:58.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.052+0000 7f7a22188700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f7a1c0b2cd0 0x7f7a1c15d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.149:39678/0 (socket says 172.21.15.149:39678) 2023-11-08T19:23:58.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.052+0000 7f7a21987700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7a1c0cc140 0x7f7a1c0cc910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.149:58970/0 (socket says 172.21.15.149:58970) 2023-11-08T19:23:58.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.052+0000 7f7a22188700 1 -- 172.21.15.149:0/2352227613 learned_addr learned my addr 172.21.15.149:0/2352227613 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:58.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.052+0000 7f7a22188700 1 -- 172.21.15.149:0/2352227613 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7a1c0cc140 msgr2=0x7f7a1c0cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:58.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.052+0000 7f7a22188700 1 --2- 172.21.15.149:0/2352227613 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7a1c0cc140 0x7f7a1c0cc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:58.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.052+0000 7f7a22188700 1 -- 172.21.15.149:0/2352227613 >> v1:172.21.15.160:6789/0 conn(0x7f7a1c0b2850 legacy=0x7f7a1c0cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:58.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.052+0000 7f7a22188700 1 -- 172.21.15.149:0/2352227613 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a1c0b17b0 con 0x7f7a1c0b2cd0 2023-11-08T19:23:58.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.052+0000 7f7a22188700 1 --2- 172.21.15.149:0/2352227613 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7a1c0b2cd0 0x7f7a1c15d2b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7a14009e50 tx=0x7f7a1400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=232c22bc4088e5b8 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:58.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.052+0000 7f7a20985700 1 -- 172.21.15.149:0/2352227613 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1400e070 con 0x7f7a1c0b2cd0 2023-11-08T19:23:58.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.052+0000 7f7a20985700 1 -- 172.21.15.149:0/2352227613 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a1400b910 con 0x7f7a1c0b2cd0 2023-11-08T19:23:58.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.052+0000 7f7a20985700 1 -- 172.21.15.149:0/2352227613 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1400bcc0 con 0x7f7a1c0b2cd0 2023-11-08T19:23:58.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.053+0000 7f7a23beb700 1 -- 172.21.15.149:0/2352227613 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7a1c0b2cd0 msgr2=0x7f7a1c15d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:58.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.053+0000 7f7a23beb700 1 --2- 172.21.15.149:0/2352227613 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7a1c0b2cd0 0x7f7a1c15d2b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7a14009e50 tx=0x7f7a1400b330 comp rx=0 tx=0).stop 2023-11-08T19:23:58.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.053+0000 7f7a23beb700 1 -- 172.21.15.149:0/2352227613 shutdown_connections 2023-11-08T19:23:58.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.053+0000 7f7a23beb700 1 --2- 172.21.15.149:0/2352227613 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7a1c0b2cd0 0x7f7a1c15d2b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:58.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.053+0000 7f7a23beb700 1 --2- 172.21.15.149:0/2352227613 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7a1c0cc140 0x7f7a1c0cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:58.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.053+0000 7f7a23beb700 1 -- 172.21.15.149:0/2352227613 >> 172.21.15.149:0/2352227613 conn(0x7f7a1c099a40 msgr2=0x7f7a1c0d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:58.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.053+0000 7f7a23beb700 1 -- 172.21.15.149:0/2352227613 shutdown_connections 2023-11-08T19:23:58.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.053+0000 7f7a23beb700 1 -- 172.21.15.149:0/2352227613 wait complete. 2023-11-08T19:23:58.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.054+0000 7f7a23beb700 1 Processor -- start 2023-11-08T19:23:58.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.054+0000 7f7a23beb700 1 -- start start 2023-11-08T19:23:58.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.055+0000 7f7a23beb700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7a1c0b2850 0x7f7a1c1f72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:58.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.055+0000 7f7a23beb700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7a1c0b2cd0 0x7f7a1c0c88f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:58.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.055+0000 7f7a23beb700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a1c0cc140 0x7f7a1c0af070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:58.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.055+0000 7f7a23beb700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c0b04e0 con 0x7f7a1c0cc140 2023-11-08T19:23:58.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.055+0000 7f7a23beb700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c0aec50 con 0x7f7a1c0b2cd0 2023-11-08T19:23:58.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.055+0000 7f7a23beb700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c1f7820 con 0x7f7a1c0b2850 2023-11-08T19:23:58.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.055+0000 7f7a22188700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a1c0cc140 0x7f7a1c0af070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:58.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.055+0000 7f7a22188700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a1c0cc140 0x7f7a1c0af070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38692/0 (socket says 172.21.15.149:38692) 2023-11-08T19:23:58.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.055+0000 7f7a22188700 1 -- 172.21.15.149:0/1757596017 learned_addr learned my addr 172.21.15.149:0/1757596017 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:58.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.055+0000 7f7a21186700 1 --2- 172.21.15.149:0/1757596017 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7a1c0b2cd0 0x7f7a1c0c88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:58.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.055+0000 7f7a21987700 1 --2- 172.21.15.149:0/1757596017 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7a1c0b2850 0x7f7a1c1f72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:58.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.055+0000 7f7a22188700 1 -- 172.21.15.149:0/1757596017 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7a1c0b2850 msgr2=0x7f7a1c1f72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:58.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.055+0000 7f7a22188700 1 --2- 172.21.15.149:0/1757596017 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7a1c0b2850 0x7f7a1c1f72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:58.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.055+0000 7f7a22188700 1 -- 172.21.15.149:0/1757596017 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7a1c0b2cd0 msgr2=0x7f7a1c0c88f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:58.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.055+0000 7f7a22188700 1 --2- 172.21.15.149:0/1757596017 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7a1c0b2cd0 0x7f7a1c0c88f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:58.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.055+0000 7f7a22188700 1 -- 172.21.15.149:0/1757596017 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a14009b30 con 0x7f7a1c0cc140 2023-11-08T19:23:58.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.056+0000 7f7a22188700 1 --2- 172.21.15.149:0/1757596017 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a1c0cc140 0x7f7a1c0af070 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7a14012000 tx=0x7f7a14004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:58.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.056+0000 7f7a127fc700 1 -- 172.21.15.149:0/1757596017 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a14004800 con 0x7f7a1c0cc140 2023-11-08T19:23:58.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.056+0000 7f7a127fc700 1 -- 172.21.15.149:0/1757596017 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a14004960 con 0x7f7a1c0cc140 2023-11-08T19:23:58.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.056+0000 7f7a23beb700 1 -- 172.21.15.149:0/1757596017 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a1c09ab40 con 0x7f7a1c0cc140 2023-11-08T19:23:58.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.056+0000 7f7a127fc700 1 -- 172.21.15.149:0/1757596017 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1401c680 con 0x7f7a1c0cc140 2023-11-08T19:23:58.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.056+0000 7f7a23beb700 1 -- 172.21.15.149:0/1757596017 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a1c0ae870 con 0x7f7a1c0cc140 2023-11-08T19:23:58.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.057+0000 7f7a23beb700 1 -- 172.21.15.149:0/1757596017 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a1c0aed90 con 0x7f7a1c0cc140 2023-11-08T19:23:58.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.057+0000 7f7a127fc700 1 -- 172.21.15.149:0/1757596017 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7a1401c7e0 con 0x7f7a1c0cc140 2023-11-08T19:23:58.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.058+0000 7f7a127fc700 1 --2- 172.21.15.149:0/1757596017 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f7a0006af00 0x7f7a0006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:58.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.058+0000 7f7a21987700 1 --2- 172.21.15.149:0/1757596017 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f7a0006af00 0x7f7a0006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:58.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.058+0000 7f7a127fc700 1 -- 172.21.15.149:0/1757596017 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7a1408b4f0 con 0x7f7a1c0cc140 2023-11-08T19:23:58.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.058+0000 7f7a21987700 1 --2- 172.21.15.149:0/1757596017 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f7a0006af00 0x7f7a0006d3c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c009b20 tx=0x7f7a0c0091c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:58.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.063+0000 7f7a127fc700 1 -- 172.21.15.149:0/1757596017 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7a1c0aed90 con 0x7f7a1c0cc140 2023-11-08T19:23:58.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.256+0000 7f7a23beb700 1 -- 172.21.15.149:0/1757596017 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7a1c0aed90 con 0x7f7a1c0cc140 2023-11-08T19:23:58.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.257+0000 7f7a127fc700 1 -- 172.21.15.149:0/1757596017 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18770 (secure 0 0 0) 0x7f7a1c0aed90 con 0x7f7a1c0cc140 2023-11-08T19:23:58.259 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:23:58.259 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":26,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:23:51.355959+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-08T19:22:59.830928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-08T19:23:00.886589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-08T19:23:04.574033+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":1}]},{"pgid":"3.14","mappings":[{"from":4,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:23:58.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.260+0000 7f7a23beb700 1 -- 172.21.15.149:0/1757596017 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f7a0006af00 msgr2=0x7f7a0006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:58.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.260+0000 7f7a23beb700 1 --2- 172.21.15.149:0/1757596017 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f7a0006af00 0x7f7a0006d3c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c009b20 tx=0x7f7a0c0091c0 comp rx=0 tx=0).stop 2023-11-08T19:23:58.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.260+0000 7f7a23beb700 1 -- 172.21.15.149:0/1757596017 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a1c0cc140 msgr2=0x7f7a1c0af070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:58.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.260+0000 7f7a23beb700 1 --2- 172.21.15.149:0/1757596017 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a1c0cc140 0x7f7a1c0af070 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7a14012000 tx=0x7f7a14004ad0 comp rx=0 tx=0).stop 2023-11-08T19:23:58.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.260+0000 7f7a23beb700 1 -- 172.21.15.149:0/1757596017 shutdown_connections 2023-11-08T19:23:58.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.260+0000 7f7a23beb700 1 --2- 172.21.15.149:0/1757596017 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f7a0006af00 0x7f7a0006d3c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:58.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.260+0000 7f7a23beb700 1 --2- 172.21.15.149:0/1757596017 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a1c0cc140 0x7f7a1c0af070 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:58.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.260+0000 7f7a23beb700 1 --2- 172.21.15.149:0/1757596017 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7a1c0b2850 0x7f7a1c1f72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:58.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.260+0000 7f7a23beb700 1 --2- 172.21.15.149:0/1757596017 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7a1c0b2cd0 0x7f7a1c0c88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:58.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.260+0000 7f7a23beb700 1 -- 172.21.15.149:0/1757596017 >> 172.21.15.149:0/1757596017 conn(0x7f7a1c099a40 msgr2=0x7f7a1c0c7670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:58.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.260+0000 7f7a23beb700 1 -- 172.21.15.149:0/1757596017 shutdown_connections 2023-11-08T19:23:58.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.260+0000 7f7a23beb700 1 -- 172.21.15.149:0/1757596017 wait complete. 2023-11-08T19:23:58.273 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-08T19:22:56.023194+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-08T19:22:59.830928+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-08T19:23:00.886589+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-08T19:23:04.574033+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-08T19:23:58.274 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-08T19:23:58.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.399+0000 7f47c17ba700 1 Processor -- start 2023-11-08T19:23:58.401 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.399+0000 7f47c17ba700 1 -- start start 2023-11-08T19:23:58.403 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.400+0000 7f47c17ba700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f47bc0cc0d0 0x7f47bc15f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:58.404 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.400+0000 7f47c17ba700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f47bc0cc4b0 0x7f47bc15c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:58.404 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.400+0000 7f47c17ba700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47bc15be80 con 0x7f47bc15cb60 2023-11-08T19:23:58.404 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.400+0000 7f47c17ba700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47bc15f9b0 con 0x7f47bc0cc0d0 2023-11-08T19:23:58.404 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.400+0000 7f47c17ba700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47bc15fba0 con 0x7f47bc0cc4b0 2023-11-08T19:23:58.405 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.400+0000 7f47baffd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f47bc0cc0d0 0x7f47bc15f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:58.405 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.400+0000 7f47baffd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f47bc0cc0d0 0x7f47bc15f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38696/0 (socket says 172.21.15.149:38696) 2023-11-08T19:23:58.405 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.400+0000 7f47baffd700 1 -- 172.21.15.149:0/4170515692 learned_addr learned my addr 172.21.15.149:0/4170515692 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:58.405 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.400+0000 7f47baffd700 1 -- 172.21.15.149:0/4170515692 >> v2:172.21.15.160:3300/0 conn(0x7f47bc0cc4b0 msgr2=0x7f47bc15c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:58.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.400+0000 7f47ba7fc700 1 --2- 172.21.15.149:0/4170515692 >> v2:172.21.15.160:3300/0 conn(0x7f47bc0cc4b0 0x7f47bc15c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:58.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.400+0000 7f47baffd700 1 --2- 172.21.15.149:0/4170515692 >> v2:172.21.15.160:3300/0 conn(0x7f47bc0cc4b0 0x7f47bc15c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:58.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.400+0000 7f47baffd700 1 -- 172.21.15.149:0/4170515692 >> v1:172.21.15.160:6789/0 conn(0x7f47bc15cb60 legacy=0x7f47bc0cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:58.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.400+0000 7f47baffd700 1 -- 172.21.15.149:0/4170515692 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47bc15fe80 con 0x7f47bc0cc0d0 2023-11-08T19:23:58.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.400+0000 7f47baffd700 1 --2- 172.21.15.149:0/4170515692 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47bc0cc0d0 0x7f47bc15f470 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f47bc04f150 tx=0x7f47b0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee6e13d9bffdd013 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:58.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.400+0000 7f47b9ffb700 1 -- 172.21.15.149:0/4170515692 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b0004230 con 0x7f47bc0cc0d0 2023-11-08T19:23:58.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.401+0000 7f47b9ffb700 1 -- 172.21.15.149:0/4170515692 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b0004390 con 0x7f47bc0cc0d0 2023-11-08T19:23:58.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.401+0000 7f47b9ffb700 1 -- 172.21.15.149:0/4170515692 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b00036a0 con 0x7f47bc0cc0d0 2023-11-08T19:23:58.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.401+0000 7f47c17ba700 1 -- 172.21.15.149:0/4170515692 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47bc0cc0d0 msgr2=0x7f47bc15f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:58.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.401+0000 7f47c17ba700 1 --2- 172.21.15.149:0/4170515692 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47bc0cc0d0 0x7f47bc15f470 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f47bc04f150 tx=0x7f47b0009bd0 comp rx=0 tx=0).stop 2023-11-08T19:23:58.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.401+0000 7f47c17ba700 1 -- 172.21.15.149:0/4170515692 shutdown_connections 2023-11-08T19:23:58.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.401+0000 7f47c17ba700 1 --2- 172.21.15.149:0/4170515692 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47bc0cc0d0 0x7f47bc15f470 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:58.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.401+0000 7f47c17ba700 1 --2- 172.21.15.149:0/4170515692 >> v2:172.21.15.160:3300/0 conn(0x7f47bc0cc4b0 0x7f47bc15c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:58.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.401+0000 7f47c17ba700 1 -- 172.21.15.149:0/4170515692 >> 172.21.15.149:0/4170515692 conn(0x7f47bc06f120 msgr2=0x7f47bc06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:58.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.401+0000 7f47c17ba700 1 -- 172.21.15.149:0/4170515692 shutdown_connections 2023-11-08T19:23:58.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.401+0000 7f47c17ba700 1 -- 172.21.15.149:0/4170515692 wait complete. 2023-11-08T19:23:58.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.402+0000 7f47c17ba700 1 Processor -- start 2023-11-08T19:23:58.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.403+0000 7f47c17ba700 1 -- start start 2023-11-08T19:23:58.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.403+0000 7f47c17ba700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f47bc0cc0d0 0x7f47bc1f34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:58.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.403+0000 7f47c17ba700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f47bc0cc4b0 0x7f47bc0c6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:58.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.403+0000 7f47c17ba700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47bc15cb60 0x7f47bc1f7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:58.414 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.403+0000 7f47c17ba700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47bc1f4400 con 0x7f47bc15cb60 2023-11-08T19:23:58.414 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.403+0000 7f47c17ba700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47bc1f3b60 con 0x7f47bc0cc4b0 2023-11-08T19:23:58.414 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.403+0000 7f47c17ba700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47bc1f3e40 con 0x7f47bc0cc0d0 2023-11-08T19:23:58.414 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.403+0000 7f47bb7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47bc15cb60 0x7f47bc1f7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:58.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.403+0000 7f47bb7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47bc15cb60 0x7f47bc1f7130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38704/0 (socket says 172.21.15.149:38704) 2023-11-08T19:23:58.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.403+0000 7f47bb7fe700 1 -- 172.21.15.149:0/179136235 learned_addr learned my addr 172.21.15.149:0/179136235 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:58.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.404+0000 7f47ba7fc700 1 --2- 172.21.15.149:0/179136235 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f47bc0cc4b0 0x7f47bc0c6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:58.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.404+0000 7f47baffd700 1 --2- 172.21.15.149:0/179136235 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f47bc0cc0d0 0x7f47bc1f34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:58.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.404+0000 7f47bb7fe700 1 -- 172.21.15.149:0/179136235 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f47bc0cc0d0 msgr2=0x7f47bc1f34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:58.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.404+0000 7f47bb7fe700 1 --2- 172.21.15.149:0/179136235 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f47bc0cc0d0 0x7f47bc1f34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:58.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.404+0000 7f47bb7fe700 1 -- 172.21.15.149:0/179136235 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f47bc0cc4b0 msgr2=0x7f47bc0c6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:58.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.404+0000 7f47bb7fe700 1 --2- 172.21.15.149:0/179136235 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f47bc0cc4b0 0x7f47bc0c6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:58.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.404+0000 7f47bb7fe700 1 -- 172.21.15.149:0/179136235 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b0009550 con 0x7f47bc15cb60 2023-11-08T19:23:58.417 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.404+0000 7f47bb7fe700 1 --2- 172.21.15.149:0/179136235 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47bc15cb60 0x7f47bc1f7130 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f47b400b9e0 tx=0x7f47b400bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:58.417 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.404+0000 7f47a37fe700 1 -- 172.21.15.149:0/179136235 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b400c9b0 con 0x7f47bc15cb60 2023-11-08T19:23:58.417 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.404+0000 7f47a37fe700 1 -- 172.21.15.149:0/179136235 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b400cb10 con 0x7f47bc15cb60 2023-11-08T19:23:58.417 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.404+0000 7f47c17ba700 1 -- 172.21.15.149:0/179136235 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47bc1f4120 con 0x7f47bc15cb60 2023-11-08T19:23:58.417 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.404+0000 7f47a37fe700 1 -- 172.21.15.149:0/179136235 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b4014440 con 0x7f47bc15cb60 2023-11-08T19:23:58.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.404+0000 7f47c17ba700 1 -- 172.21.15.149:0/179136235 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47bc0c7410 con 0x7f47bc15cb60 2023-11-08T19:23:58.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.405+0000 7f47c17ba700 1 -- 172.21.15.149:0/179136235 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47bc1f6e50 con 0x7f47bc15cb60 2023-11-08T19:23:58.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.405+0000 7f47a37fe700 1 -- 172.21.15.149:0/179136235 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f47b4006d50 con 0x7f47bc15cb60 2023-11-08T19:23:58.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.406+0000 7f47a37fe700 1 --2- 172.21.15.149:0/179136235 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f47a806af00 0x7f47a806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:58.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.406+0000 7f47a37fe700 1 -- 172.21.15.149:0/179136235 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f47b4089420 con 0x7f47bc15cb60 2023-11-08T19:23:58.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.406+0000 7f47baffd700 1 --2- 172.21.15.149:0/179136235 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f47a806af00 0x7f47a806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:58.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.406+0000 7f47baffd700 1 --2- 172.21.15.149:0/179136235 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f47a806af00 0x7f47a806d3c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f47b0009130 tx=0x7f47b0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:58.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.411+0000 7f47a37fe700 1 -- 172.21.15.149:0/179136235 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f47bc1f6e50 con 0x7f47bc15cb60 2023-11-08T19:23:58.604 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.602+0000 7f47c17ba700 1 -- 172.21.15.149:0/179136235 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f47bc1f6e50 con 0x7f47bc15cb60 2023-11-08T19:23:58.604 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.603+0000 7f47a37fe700 1 -- 172.21.15.149:0/179136235 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f47bc1f6e50 con 0x7f47bc15cb60 2023-11-08T19:23:58.604 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 1 2023-11-08T19:23:58.607 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.605+0000 7f47c17ba700 1 -- 172.21.15.149:0/179136235 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f47a806af00 msgr2=0x7f47a806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:58.607 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.605+0000 7f47c17ba700 1 --2- 172.21.15.149:0/179136235 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f47a806af00 0x7f47a806d3c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f47b0009130 tx=0x7f47b0008030 comp rx=0 tx=0).stop 2023-11-08T19:23:58.607 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.605+0000 7f47c17ba700 1 -- 172.21.15.149:0/179136235 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47bc15cb60 msgr2=0x7f47bc1f7130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:58.608 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.605+0000 7f47c17ba700 1 --2- 172.21.15.149:0/179136235 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47bc15cb60 0x7f47bc1f7130 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f47b400b9e0 tx=0x7f47b400bda0 comp rx=0 tx=0).stop 2023-11-08T19:23:58.608 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.605+0000 7f47c17ba700 1 -- 172.21.15.149:0/179136235 shutdown_connections 2023-11-08T19:23:58.608 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.605+0000 7f47c17ba700 1 --2- 172.21.15.149:0/179136235 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f47a806af00 0x7f47a806d3c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:58.608 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.605+0000 7f47c17ba700 1 --2- 172.21.15.149:0/179136235 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47bc15cb60 0x7f47bc1f7130 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:58.608 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.605+0000 7f47c17ba700 1 --2- 172.21.15.149:0/179136235 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f47bc0cc0d0 0x7f47bc1f34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:58.609 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.605+0000 7f47c17ba700 1 --2- 172.21.15.149:0/179136235 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f47bc0cc4b0 0x7f47bc0c6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:58.609 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.605+0000 7f47c17ba700 1 -- 172.21.15.149:0/179136235 >> 172.21.15.149:0/179136235 conn(0x7f47bc06f120 msgr2=0x7f47bc1599b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:58.609 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.605+0000 7f47c17ba700 1 -- 172.21.15.149:0/179136235 shutdown_connections 2023-11-08T19:23:58.609 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.605+0000 7f47c17ba700 1 -- 172.21.15.149:0/179136235 wait complete. 2023-11-08T19:23:58.618 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-08T19:23:58.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.741+0000 7f6c73208700 1 Processor -- start 2023-11-08T19:23:58.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.741+0000 7f6c73208700 1 -- start start 2023-11-08T19:23:58.745 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.742+0000 7f6c73208700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f6c6c15df40 0x7f6c6c06c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:58.745 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.742+0000 7f6c73208700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c6c15e320 con 0x7f6c6c0cb660 2023-11-08T19:23:58.746 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.742+0000 7f6c73208700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c6c06b020 con 0x7f6c6c06ab80 2023-11-08T19:23:58.746 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.742+0000 7f6c73208700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c6c06b2e0 con 0x7f6c6c15df40 2023-11-08T19:23:58.746 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.742+0000 7f6c717a5700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f6c6c0cb660 0x7f6c6c0ce540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:40712/0 (socket says 172.21.15.149:40712) 2023-11-08T19:23:58.746 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.742+0000 7f6c717a5700 1 -- 172.21.15.149:0/2993132673 learned_addr learned my addr 172.21.15.149:0/2993132673 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:23:58.747 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.742+0000 7f6c70fa4700 1 --2- 172.21.15.149:0/2993132673 >> v2:172.21.15.160:3300/0 conn(0x7f6c6c15df40 0x7f6c6c06c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:58.747 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.742+0000 7f6c6b7fe700 1 -- 172.21.15.149:0/2993132673 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3764523192 0 0) 0x7f6c6c15e320 con 0x7f6c6c0cb660 2023-11-08T19:23:58.747 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.742+0000 7f6c6b7fe700 1 -- 172.21.15.149:0/2993132673 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c5c0035b0 con 0x7f6c6c0cb660 2023-11-08T19:23:58.747 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.742+0000 7f6c70fa4700 1 -- 172.21.15.149:0/2993132673 >> v1:172.21.15.160:6789/0 conn(0x7f6c6c06ab80 legacy=0x7f6c6c0caf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:58.748 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.742+0000 7f6c70fa4700 1 -- 172.21.15.149:0/2993132673 >> v1:172.21.15.149:6789/0 conn(0x7f6c6c0cb660 legacy=0x7f6c6c0ce540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:58.748 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.742+0000 7f6c6b7fe700 1 -- 172.21.15.149:0/2993132673 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1192021537 0 0) 0x7f6c5c0035b0 con 0x7f6c6c0cb660 2023-11-08T19:23:58.748 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.742+0000 7f6c70fa4700 1 -- 172.21.15.149:0/2993132673 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c6c06b5c0 con 0x7f6c6c15df40 2023-11-08T19:23:58.748 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.743+0000 7f6c70fa4700 1 --2- 172.21.15.149:0/2993132673 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6c6c15df40 0x7f6c6c06c0a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6c60009840 tx=0x7f6c60009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9da0fc84f20c0e server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:58.748 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.743+0000 7f6c6b7fe700 1 -- 172.21.15.149:0/2993132673 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c640019f0 con 0x7f6c6c15df40 2023-11-08T19:23:58.749 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.743+0000 7f6c6b7fe700 1 -- 172.21.15.149:0/2993132673 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c60004030 con 0x7f6c6c15df40 2023-11-08T19:23:58.749 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.743+0000 7f6c6b7fe700 1 -- 172.21.15.149:0/2993132673 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c600043a0 con 0x7f6c6c15df40 2023-11-08T19:23:58.749 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.743+0000 7f6c73208700 1 -- 172.21.15.149:0/2993132673 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6c6c15df40 msgr2=0x7f6c6c06c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:58.749 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.743+0000 7f6c73208700 1 --2- 172.21.15.149:0/2993132673 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6c6c15df40 0x7f6c6c06c0a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6c60009840 tx=0x7f6c60009b50 comp rx=0 tx=0).stop 2023-11-08T19:23:58.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.743+0000 7f6c73208700 1 -- 172.21.15.149:0/2993132673 shutdown_connections 2023-11-08T19:23:58.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.743+0000 7f6c73208700 1 --2- 172.21.15.149:0/2993132673 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6c6c15df40 0x7f6c6c06c0a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:58.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.743+0000 7f6c73208700 1 -- 172.21.15.149:0/2993132673 >> 172.21.15.149:0/2993132673 conn(0x7f6c6c0d0640 msgr2=0x7f6c6c0d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:58.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.743+0000 7f6c73208700 1 -- 172.21.15.149:0/2993132673 shutdown_connections 2023-11-08T19:23:58.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.743+0000 7f6c73208700 1 -- 172.21.15.149:0/2993132673 wait complete. 2023-11-08T19:23:58.751 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.744+0000 7f6c73208700 1 Processor -- start 2023-11-08T19:23:58.751 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.744+0000 7f6c73208700 1 -- start start 2023-11-08T19:23:58.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.745+0000 7f6c73208700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6c6c06ab80 0x7f6c6c15c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:58.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.745+0000 7f6c73208700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6c6c0cb660 0x7f6c6c14b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:58.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.745+0000 7f6c73208700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c6c15df40 0x7f6c6c147e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:58.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.745+0000 7f6c73208700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6c14b730 con 0x7f6c6c15df40 2023-11-08T19:23:58.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.745+0000 7f6c73208700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6c15b3a0 con 0x7f6c6c0cb660 2023-11-08T19:23:58.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.745+0000 7f6c73208700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6c15b680 con 0x7f6c6c06ab80 2023-11-08T19:23:58.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.745+0000 7f6c717a5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c6c15df40 0x7f6c6c147e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:58.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.745+0000 7f6c717a5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c6c15df40 0x7f6c6c147e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38714/0 (socket says 172.21.15.149:38714) 2023-11-08T19:23:58.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.745+0000 7f6c717a5700 1 -- 172.21.15.149:0/522773520 learned_addr learned my addr 172.21.15.149:0/522773520 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:58.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.746+0000 7f6c6bfff700 1 --2- 172.21.15.149:0/522773520 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6c6c0cb660 0x7f6c6c14b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:58.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.746+0000 7f6c70fa4700 1 --2- 172.21.15.149:0/522773520 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6c6c06ab80 0x7f6c6c15c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:58.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.746+0000 7f6c717a5700 1 -- 172.21.15.149:0/522773520 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6c6c06ab80 msgr2=0x7f6c6c15c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:58.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.746+0000 7f6c717a5700 1 --2- 172.21.15.149:0/522773520 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6c6c06ab80 0x7f6c6c15c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:58.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.746+0000 7f6c717a5700 1 -- 172.21.15.149:0/522773520 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6c6c0cb660 msgr2=0x7f6c6c14b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:58.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.746+0000 7f6c717a5700 1 --2- 172.21.15.149:0/522773520 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6c6c0cb660 0x7f6c6c14b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:58.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.746+0000 7f6c717a5700 1 -- 172.21.15.149:0/522773520 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c600094a0 con 0x7f6c6c15df40 2023-11-08T19:23:58.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.746+0000 7f6c717a5700 1 --2- 172.21.15.149:0/522773520 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c6c15df40 0x7f6c6c147e00 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f6c6400cbf0 tx=0x7f6c6400cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:58.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.746+0000 7f6c697fa700 1 -- 172.21.15.149:0/522773520 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6400aaa0 con 0x7f6c6c15df40 2023-11-08T19:23:58.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.746+0000 7f6c697fa700 1 -- 172.21.15.149:0/522773520 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c6400ac00 con 0x7f6c6c15df40 2023-11-08T19:23:58.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.746+0000 7f6c73208700 1 -- 172.21.15.149:0/522773520 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c6c15b960 con 0x7f6c6c15df40 2023-11-08T19:23:58.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.746+0000 7f6c697fa700 1 -- 172.21.15.149:0/522773520 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c640070d0 con 0x7f6c6c15df40 2023-11-08T19:23:58.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.746+0000 7f6c73208700 1 -- 172.21.15.149:0/522773520 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c6c15bf20 con 0x7f6c6c15df40 2023-11-08T19:23:58.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.747+0000 7f6c73208700 1 -- 172.21.15.149:0/522773520 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c6c15c140 con 0x7f6c6c15df40 2023-11-08T19:23:58.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.747+0000 7f6c697fa700 1 -- 172.21.15.149:0/522773520 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6c64007230 con 0x7f6c6c15df40 2023-11-08T19:23:58.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.748+0000 7f6c697fa700 1 --2- 172.21.15.149:0/522773520 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6c5006af00 0x7f6c5006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:58.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.748+0000 7f6c70fa4700 1 --2- 172.21.15.149:0/522773520 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6c5006af00 0x7f6c5006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:58.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.748+0000 7f6c697fa700 1 -- 172.21.15.149:0/522773520 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6c64089790 con 0x7f6c6c15df40 2023-11-08T19:23:58.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.748+0000 7f6c70fa4700 1 --2- 172.21.15.149:0/522773520 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6c5006af00 0x7f6c5006d3c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6c600090b0 tx=0x7f6c60008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:58.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.753+0000 7f6c697fa700 1 -- 172.21.15.149:0/522773520 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6c64054480 con 0x7f6c6c15df40 2023-11-08T19:23:58.942 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.941+0000 7f6c73208700 1 -- 172.21.15.149:0/522773520 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6c6c04f730 con 0x7f6c6c15df40 2023-11-08T19:23:58.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.942+0000 7f6c697fa700 1 -- 172.21.15.149:0/522773520 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6c64057aa0 con 0x7f6c6c15df40 2023-11-08T19:23:58.944 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:23:58.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.944+0000 7f6c73208700 1 -- 172.21.15.149:0/522773520 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6c5006af00 msgr2=0x7f6c5006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:58.946 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.944+0000 7f6c73208700 1 --2- 172.21.15.149:0/522773520 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6c5006af00 0x7f6c5006d3c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6c600090b0 tx=0x7f6c60008030 comp rx=0 tx=0).stop 2023-11-08T19:23:58.946 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.944+0000 7f6c73208700 1 -- 172.21.15.149:0/522773520 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c6c15df40 msgr2=0x7f6c6c147e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:58.946 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.944+0000 7f6c73208700 1 --2- 172.21.15.149:0/522773520 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c6c15df40 0x7f6c6c147e00 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f6c6400cbf0 tx=0x7f6c6400cf00 comp rx=0 tx=0).stop 2023-11-08T19:23:58.946 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.944+0000 7f6c73208700 1 -- 172.21.15.149:0/522773520 shutdown_connections 2023-11-08T19:23:58.946 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.944+0000 7f6c73208700 1 --2- 172.21.15.149:0/522773520 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6c5006af00 0x7f6c5006d3c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:58.947 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.944+0000 7f6c73208700 1 --2- 172.21.15.149:0/522773520 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c6c15df40 0x7f6c6c147e00 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:58.947 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.944+0000 7f6c73208700 1 --2- 172.21.15.149:0/522773520 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6c6c06ab80 0x7f6c6c15c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:58.947 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.944+0000 7f6c73208700 1 --2- 172.21.15.149:0/522773520 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6c6c0cb660 0x7f6c6c14b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:58.947 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.944+0000 7f6c73208700 1 -- 172.21.15.149:0/522773520 >> 172.21.15.149:0/522773520 conn(0x7f6c6c0d0640 msgr2=0x7f6c6c0b0670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:58.948 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.944+0000 7f6c73208700 1 -- 172.21.15.149:0/522773520 shutdown_connections 2023-11-08T19:23:58.948 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:58.944+0000 7f6c73208700 1 -- 172.21.15.149:0/522773520 wait complete. 2023-11-08T19:23:58.957 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-08T19:23:59.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.079+0000 7fac7ba4a700 1 Processor -- start 2023-11-08T19:23:59.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.080+0000 7fac7ba4a700 1 -- start start 2023-11-08T19:23:59.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.080+0000 7fac7ba4a700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fac7415dce0 0x7fac740cacc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:59.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.080+0000 7fac7ba4a700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fac740cee50 0x7fac740b20f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:59.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.080+0000 7fac7ba4a700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac740cde10 con 0x7fac7406ab80 2023-11-08T19:23:59.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.081+0000 7fac7ba4a700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac740ccff0 con 0x7fac7415dce0 2023-11-08T19:23:59.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.081+0000 7fac79fe7700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fac7406ab80 0x7fac74161810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:40726/0 (socket says 172.21.15.149:40726) 2023-11-08T19:23:59.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.081+0000 7fac79fe7700 1 -- 172.21.15.149:0/1747980155 learned_addr learned my addr 172.21.15.149:0/1747980155 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:23:59.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.081+0000 7fac7ba4a700 1 -- 172.21.15.149:0/1747980155 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac740cd200 con 0x7fac740cee50 2023-11-08T19:23:59.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.081+0000 7fac78fe5700 1 --2- 172.21.15.149:0/1747980155 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fac740cee50 0x7fac740b20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:59.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.081+0000 7fac797e6700 1 --2- 172.21.15.149:0/1747980155 >> v2:172.21.15.160:3300/0 conn(0x7fac7415dce0 0x7fac740cacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:59.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.081+0000 7fac6bfff700 1 -- 172.21.15.149:0/1747980155 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 912148578 0 0) 0x7fac740cde10 con 0x7fac7406ab80 2023-11-08T19:23:59.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.081+0000 7fac6bfff700 1 -- 172.21.15.149:0/1747980155 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac600035b0 con 0x7fac7406ab80 2023-11-08T19:23:59.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.081+0000 7fac6bfff700 1 -- 172.21.15.149:0/1747980155 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3825490166 0 0) 0x7fac600035b0 con 0x7fac7406ab80 2023-11-08T19:23:59.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.081+0000 7fac6bfff700 1 -- 172.21.15.149:0/1747980155 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fac740cee50 msgr2=0x7fac740b20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:59.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.081+0000 7fac6bfff700 1 --2- 172.21.15.149:0/1747980155 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fac740cee50 0x7fac740b20f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:59.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.081+0000 7fac6bfff700 1 -- 172.21.15.149:0/1747980155 >> v2:172.21.15.160:3300/0 conn(0x7fac7415dce0 msgr2=0x7fac740cacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:59.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.081+0000 7fac6bfff700 1 --2- 172.21.15.149:0/1747980155 >> v2:172.21.15.160:3300/0 conn(0x7fac7415dce0 0x7fac740cacc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:59.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.081+0000 7fac6bfff700 1 -- 172.21.15.149:0/1747980155 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac740cb200 con 0x7fac7406ab80 2023-11-08T19:23:59.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.081+0000 7fac6bfff700 1 -- 172.21.15.149:0/1747980155 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7fac6c0019f0 con 0x7fac7406ab80 2023-11-08T19:23:59.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.081+0000 7fac6bfff700 1 -- 172.21.15.149:0/1747980155 >> v1:172.21.15.149:6789/0 conn(0x7fac7406ab80 legacy=0x7fac74161810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:59.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.081+0000 7fac6bfff700 1 --2- 172.21.15.149:0/1747980155 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fac60003a70 0x7fac60003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:59.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.081+0000 7fac6bfff700 1 --2- 172.21.15.149:0/1747980155 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fac740cee50 0x7fac60004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:59.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.081+0000 7fac6bfff700 1 --2- 172.21.15.149:0/1747980155 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac60004d90 0x7fac60005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:59.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.081+0000 7fac6bfff700 1 -- 172.21.15.149:0/1747980155 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac740ccff0 con 0x7fac60004d90 2023-11-08T19:23:59.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.081+0000 7fac6bfff700 1 -- 172.21.15.149:0/1747980155 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac740cd200 con 0x7fac60003a70 2023-11-08T19:23:59.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.081+0000 7fac6bfff700 1 -- 172.21.15.149:0/1747980155 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac6000ba60 con 0x7fac740cee50 2023-11-08T19:23:59.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.081+0000 7fac79fe7700 1 --2- 172.21.15.149:0/1747980155 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac60004d90 0x7fac60005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:59.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.081+0000 7fac797e6700 1 --2- 172.21.15.149:0/1747980155 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fac60003a70 0x7fac60003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:59.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.081+0000 7fac78fe5700 1 --2- 172.21.15.149:0/1747980155 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fac740cee50 0x7fac60004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:59.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.082+0000 7fac79fe7700 1 -- 172.21.15.149:0/1747980155 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fac740cee50 msgr2=0x7fac60004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:59.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.082+0000 7fac79fe7700 1 --2- 172.21.15.149:0/1747980155 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fac740cee50 0x7fac60004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:59.092 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.082+0000 7fac79fe7700 1 -- 172.21.15.149:0/1747980155 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fac60003a70 msgr2=0x7fac60003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:59.092 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.082+0000 7fac79fe7700 1 --2- 172.21.15.149:0/1747980155 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fac60003a70 0x7fac60003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:59.092 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.082+0000 7fac79fe7700 1 -- 172.21.15.149:0/1747980155 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac600035b0 con 0x7fac60004d90 2023-11-08T19:23:59.093 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.082+0000 7fac797e6700 1 --2- 172.21.15.149:0/1747980155 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fac60003a70 0x7fac60003e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:23:59.093 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.082+0000 7fac79fe7700 1 --2- 172.21.15.149:0/1747980155 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac60004d90 0x7fac60005210 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fac6c00a8d0 tx=0x7fac60005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=911e98929aed723f server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:59.093 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.082+0000 7fac6bfff700 1 -- 172.21.15.149:0/1747980155 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac6c00a340 con 0x7fac60004d90 2023-11-08T19:23:59.093 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.082+0000 7fac6bfff700 1 -- 172.21.15.149:0/1747980155 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac6c012600 con 0x7fac60004d90 2023-11-08T19:23:59.093 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.082+0000 7fac6bfff700 1 -- 172.21.15.149:0/1747980155 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac6c0129b0 con 0x7fac60004d90 2023-11-08T19:23:59.094 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.082+0000 7fac7ba4a700 1 -- 172.21.15.149:0/1747980155 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac60004d90 msgr2=0x7fac60005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:59.094 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.082+0000 7fac7ba4a700 1 --2- 172.21.15.149:0/1747980155 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac60004d90 0x7fac60005210 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fac6c00a8d0 tx=0x7fac60005880 comp rx=0 tx=0).stop 2023-11-08T19:23:59.094 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.082+0000 7fac79fe7700 1 -- 172.21.15.149:0/1747980155 reap_dead start 2023-11-08T19:23:59.094 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.082+0000 7fac7ba4a700 1 -- 172.21.15.149:0/1747980155 shutdown_connections 2023-11-08T19:23:59.094 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.082+0000 7fac7ba4a700 1 -- 172.21.15.149:0/1747980155 >> 172.21.15.149:0/1747980155 conn(0x7fac7406df50 msgr2=0x7fac7406e330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:59.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.082+0000 7fac7ba4a700 1 -- 172.21.15.149:0/1747980155 shutdown_connections 2023-11-08T19:23:59.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.082+0000 7fac7ba4a700 1 -- 172.21.15.149:0/1747980155 wait complete. 2023-11-08T19:23:59.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.084+0000 7fac7ba4a700 1 Processor -- start 2023-11-08T19:23:59.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.084+0000 7fac7ba4a700 1 -- start start 2023-11-08T19:23:59.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.084+0000 7fac7ba4a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac740b4860 0x7fac7415fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:59.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.084+0000 7fac7ba4a700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fac740b4c40 0x7fac741f78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:59.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.084+0000 7fac7ba4a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fac74158e20 0x7fac741592d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:59.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.084+0000 7fac7ba4a700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac74159810 con 0x7fac740b4860 2023-11-08T19:23:59.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.084+0000 7fac7ba4a700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac74160ec0 con 0x7fac74158e20 2023-11-08T19:23:59.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.084+0000 7fac7ba4a700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac741f7e10 con 0x7fac740b4c40 2023-11-08T19:23:59.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.084+0000 7fac797e6700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac740b4860 0x7fac7415fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:59.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.084+0000 7fac797e6700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac740b4860 0x7fac7415fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38732/0 (socket says 172.21.15.149:38732) 2023-11-08T19:23:59.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.085+0000 7fac797e6700 1 -- 172.21.15.149:0/2023967171 learned_addr learned my addr 172.21.15.149:0/2023967171 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:59.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.085+0000 7fac797e6700 1 -- 172.21.15.149:0/2023967171 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fac740b4c40 msgr2=0x7fac741f78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:59.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.085+0000 7fac797e6700 1 --2- 172.21.15.149:0/2023967171 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fac740b4c40 0x7fac741f78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:59.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.085+0000 7fac797e6700 1 -- 172.21.15.149:0/2023967171 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fac74158e20 msgr2=0x7fac741592d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:59.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.085+0000 7fac797e6700 1 --2- 172.21.15.149:0/2023967171 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fac74158e20 0x7fac741592d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:59.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.085+0000 7fac797e6700 1 -- 172.21.15.149:0/2023967171 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac74160340 con 0x7fac740b4860 2023-11-08T19:23:59.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.085+0000 7fac797e6700 1 --2- 172.21.15.149:0/2023967171 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac740b4860 0x7fac7415fca0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fac64011d00 tx=0x7fac6400f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:59.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.085+0000 7fac69ffb700 1 -- 172.21.15.149:0/2023967171 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac64011ea0 con 0x7fac740b4860 2023-11-08T19:23:59.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.085+0000 7fac69ffb700 1 -- 172.21.15.149:0/2023967171 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac6400fcc0 con 0x7fac740b4860 2023-11-08T19:23:59.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.085+0000 7fac7ba4a700 1 -- 172.21.15.149:0/2023967171 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac74160620 con 0x7fac740b4860 2023-11-08T19:23:59.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.085+0000 7fac69ffb700 1 -- 172.21.15.149:0/2023967171 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac64004020 con 0x7fac740b4860 2023-11-08T19:23:59.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.085+0000 7fac7ba4a700 1 -- 172.21.15.149:0/2023967171 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac74160be0 con 0x7fac740b4860 2023-11-08T19:23:59.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.086+0000 7fac7ba4a700 1 -- 172.21.15.149:0/2023967171 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac7415d490 con 0x7fac740b4860 2023-11-08T19:23:59.103 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.087+0000 7fac69ffb700 1 -- 172.21.15.149:0/2023967171 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fac64004180 con 0x7fac740b4860 2023-11-08T19:23:59.103 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.087+0000 7fac69ffb700 1 --2- 172.21.15.149:0/2023967171 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fac5806af00 0x7fac5806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:59.103 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.087+0000 7fac69ffb700 1 -- 172.21.15.149:0/2023967171 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fac64089ea0 con 0x7fac740b4860 2023-11-08T19:23:59.103 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.087+0000 7fac78fe5700 1 --2- 172.21.15.149:0/2023967171 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fac5806af00 0x7fac5806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:59.103 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.087+0000 7fac78fe5700 1 --2- 172.21.15.149:0/2023967171 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fac5806af00 0x7fac5806d3c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fac740b2390 tx=0x7fac70009670 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:59.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.092+0000 7fac69ffb700 1 -- 172.21.15.149:0/2023967171 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fac64054c20 con 0x7fac740b4860 2023-11-08T19:23:59.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.280+0000 7fac7ba4a700 1 -- 172.21.15.149:0/2023967171 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fac7404f730 con 0x7fac740b4860 2023-11-08T19:23:59.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.280+0000 7fac69ffb700 1 -- 172.21.15.149:0/2023967171 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fac64022070 con 0x7fac740b4860 2023-11-08T19:23:59.282 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 64 2023-11-08T19:23:59.284 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.282+0000 7fac7ba4a700 1 -- 172.21.15.149:0/2023967171 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fac5806af00 msgr2=0x7fac5806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:59.284 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.282+0000 7fac7ba4a700 1 --2- 172.21.15.149:0/2023967171 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fac5806af00 0x7fac5806d3c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fac740b2390 tx=0x7fac70009670 comp rx=0 tx=0).stop 2023-11-08T19:23:59.284 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.282+0000 7fac7ba4a700 1 -- 172.21.15.149:0/2023967171 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac740b4860 msgr2=0x7fac7415fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:59.284 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.282+0000 7fac7ba4a700 1 --2- 172.21.15.149:0/2023967171 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac740b4860 0x7fac7415fca0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fac64011d00 tx=0x7fac6400f520 comp rx=0 tx=0).stop 2023-11-08T19:23:59.284 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.282+0000 7fac7ba4a700 1 -- 172.21.15.149:0/2023967171 shutdown_connections 2023-11-08T19:23:59.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.282+0000 7fac7ba4a700 1 --2- 172.21.15.149:0/2023967171 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fac5806af00 0x7fac5806d3c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:59.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.282+0000 7fac7ba4a700 1 --2- 172.21.15.149:0/2023967171 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fac74158e20 0x7fac741592d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:59.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.282+0000 7fac7ba4a700 1 --2- 172.21.15.149:0/2023967171 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac740b4860 0x7fac7415fca0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:59.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.282+0000 7fac7ba4a700 1 --2- 172.21.15.149:0/2023967171 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fac740b4c40 0x7fac741f78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:59.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.282+0000 7fac7ba4a700 1 -- 172.21.15.149:0/2023967171 >> 172.21.15.149:0/2023967171 conn(0x7fac7406df50 msgr2=0x7fac7415b600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:59.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.282+0000 7fac7ba4a700 1 -- 172.21.15.149:0/2023967171 shutdown_connections 2023-11-08T19:23:59.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.282+0000 7fac7ba4a700 1 -- 172.21.15.149:0/2023967171 wait complete. 2023-11-08T19:23:59.296 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-08T19:23:59.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.420+0000 7f86e8067700 1 Processor -- start 2023-11-08T19:23:59.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.420+0000 7f86e8067700 1 -- start start 2023-11-08T19:23:59.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.421+0000 7f86e8067700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f86e015abf0 0x7f86e00b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:59.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.421+0000 7f86e8067700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f86e00d1130 0x7f86e00cc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:59.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.421+0000 7f86e8067700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86e00b6470 con 0x7f86e00cc6a0 2023-11-08T19:23:59.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.421+0000 7f86e8067700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86e00b66a0 con 0x7f86e015abf0 2023-11-08T19:23:59.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.421+0000 7f86e8067700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86e00d04a0 con 0x7f86e00d1130 2023-11-08T19:23:59.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.421+0000 7f86e5e03700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f86e015abf0 0x7f86e00b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:59.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.421+0000 7f86e5e03700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f86e015abf0 0x7f86e00b5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38740/0 (socket says 172.21.15.149:38740) 2023-11-08T19:23:59.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.421+0000 7f86e5e03700 1 -- 172.21.15.149:0/2584853497 learned_addr learned my addr 172.21.15.149:0/2584853497 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:59.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.421+0000 7f86e5602700 1 --2- 172.21.15.149:0/2584853497 >> v2:172.21.15.160:3300/0 conn(0x7f86e00d1130 0x7f86e00cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:59.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.421+0000 7f86e5e03700 1 -- 172.21.15.149:0/2584853497 >> v2:172.21.15.160:3300/0 conn(0x7f86e00d1130 msgr2=0x7f86e00cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:59.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.421+0000 7f86e5e03700 1 --2- 172.21.15.149:0/2584853497 >> v2:172.21.15.160:3300/0 conn(0x7f86e00d1130 0x7f86e00cc160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:59.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.421+0000 7f86e5e03700 1 -- 172.21.15.149:0/2584853497 >> v1:172.21.15.160:6789/0 conn(0x7f86e00cc6a0 legacy=0x7f86e00ce210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:59.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.421+0000 7f86e5e03700 1 -- 172.21.15.149:0/2584853497 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e015afd0 con 0x7f86e015abf0 2023-11-08T19:23:59.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.422+0000 7f86e5e03700 1 --2- 172.21.15.149:0/2584853497 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86e015abf0 0x7f86e00b5f30 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f86e006d910 tx=0x7f86dc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf15e0238e0859ab server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:59.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.422+0000 7f86e4e01700 1 -- 172.21.15.149:0/2584853497 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86dc00b870 con 0x7f86e015abf0 2023-11-08T19:23:59.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.422+0000 7f86e4e01700 1 -- 172.21.15.149:0/2584853497 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86dc00b9d0 con 0x7f86e015abf0 2023-11-08T19:23:59.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.422+0000 7f86e4e01700 1 -- 172.21.15.149:0/2584853497 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86dc00bd60 con 0x7f86e015abf0 2023-11-08T19:23:59.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.423+0000 7f86e8067700 1 -- 172.21.15.149:0/2584853497 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86e015abf0 msgr2=0x7f86e00b5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:59.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.423+0000 7f86e8067700 1 --2- 172.21.15.149:0/2584853497 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86e015abf0 0x7f86e00b5f30 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f86e006d910 tx=0x7f86dc009bd0 comp rx=0 tx=0).stop 2023-11-08T19:23:59.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.423+0000 7f86e8067700 1 -- 172.21.15.149:0/2584853497 shutdown_connections 2023-11-08T19:23:59.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.423+0000 7f86e8067700 1 --2- 172.21.15.149:0/2584853497 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86e015abf0 0x7f86e00b5f30 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:59.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.423+0000 7f86e8067700 1 --2- 172.21.15.149:0/2584853497 >> v2:172.21.15.160:3300/0 conn(0x7f86e00d1130 0x7f86e00cc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:59.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.423+0000 7f86e8067700 1 -- 172.21.15.149:0/2584853497 >> 172.21.15.149:0/2584853497 conn(0x7f86e00d0640 msgr2=0x7f86e00d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:59.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.423+0000 7f86e8067700 1 -- 172.21.15.149:0/2584853497 shutdown_connections 2023-11-08T19:23:59.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.423+0000 7f86e8067700 1 -- 172.21.15.149:0/2584853497 wait complete. 2023-11-08T19:23:59.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.424+0000 7f86e8067700 1 Processor -- start 2023-11-08T19:23:59.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.424+0000 7f86e8067700 1 -- start start 2023-11-08T19:23:59.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.425+0000 7f86e8067700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f86e00cc6a0 0x7f86e00b0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:59.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.425+0000 7f86e8067700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f86e00d1130 0x7f86e01f4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:59.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.425+0000 7f86e8067700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86e015abf0 0x7f86e01f5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:59.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.425+0000 7f86e8067700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e015bf20 con 0x7f86e015abf0 2023-11-08T19:23:59.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.425+0000 7f86e8067700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e015c4e0 con 0x7f86e00d1130 2023-11-08T19:23:59.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.425+0000 7f86e8067700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e00b0270 con 0x7f86e00cc6a0 2023-11-08T19:23:59.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.425+0000 7f86e6604700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86e015abf0 0x7f86e01f5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:59.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.425+0000 7f86e6604700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86e015abf0 0x7f86e01f5140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38750/0 (socket says 172.21.15.149:38750) 2023-11-08T19:23:59.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.425+0000 7f86e6604700 1 -- 172.21.15.149:0/3971059854 learned_addr learned my addr 172.21.15.149:0/3971059854 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:59.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.425+0000 7f86e5e03700 1 --2- 172.21.15.149:0/3971059854 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f86e00cc6a0 0x7f86e00b0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:59.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.425+0000 7f86e5602700 1 --2- 172.21.15.149:0/3971059854 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f86e00d1130 0x7f86e01f4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:59.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.425+0000 7f86e6604700 1 -- 172.21.15.149:0/3971059854 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f86e00cc6a0 msgr2=0x7f86e00b0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:59.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.425+0000 7f86e6604700 1 --2- 172.21.15.149:0/3971059854 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f86e00cc6a0 0x7f86e00b0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:59.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.425+0000 7f86e6604700 1 -- 172.21.15.149:0/3971059854 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f86e00d1130 msgr2=0x7f86e01f4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:59.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.425+0000 7f86e6604700 1 --2- 172.21.15.149:0/3971059854 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f86e00d1130 0x7f86e01f4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:59.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.425+0000 7f86e6604700 1 -- 172.21.15.149:0/3971059854 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86dc009550 con 0x7f86e015abf0 2023-11-08T19:23:59.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.425+0000 7f86e6604700 1 --2- 172.21.15.149:0/3971059854 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86e015abf0 0x7f86e01f5140 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f86d800cb50 tx=0x7f86d800ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:59.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.425+0000 7f86d67fc700 1 -- 172.21.15.149:0/3971059854 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d8003c00 con 0x7f86e015abf0 2023-11-08T19:23:59.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.426+0000 7f86d67fc700 1 -- 172.21.15.149:0/3971059854 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d8003d60 con 0x7f86e015abf0 2023-11-08T19:23:59.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.426+0000 7f86d67fc700 1 -- 172.21.15.149:0/3971059854 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d800aa20 con 0x7f86e015abf0 2023-11-08T19:23:59.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.426+0000 7f86e8067700 1 -- 172.21.15.149:0/3971059854 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86e00b0550 con 0x7f86e015abf0 2023-11-08T19:23:59.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.426+0000 7f86e8067700 1 -- 172.21.15.149:0/3971059854 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86e015c970 con 0x7f86e015abf0 2023-11-08T19:23:59.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.427+0000 7f86e8067700 1 -- 172.21.15.149:0/3971059854 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86e0067760 con 0x7f86e015abf0 2023-11-08T19:23:59.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.427+0000 7f86d67fc700 1 -- 172.21.15.149:0/3971059854 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f86d800ab80 con 0x7f86e015abf0 2023-11-08T19:23:59.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.427+0000 7f86d67fc700 1 --2- 172.21.15.149:0/3971059854 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f86c406af00 0x7f86c406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:59.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.427+0000 7f86d67fc700 1 -- 172.21.15.149:0/3971059854 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f86d80898b0 con 0x7f86e015abf0 2023-11-08T19:23:59.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.427+0000 7f86e5e03700 1 --2- 172.21.15.149:0/3971059854 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f86c406af00 0x7f86c406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:59.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.428+0000 7f86e5e03700 1 --2- 172.21.15.149:0/3971059854 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f86c406af00 0x7f86c406d3c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f86dc000c00 tx=0x7f86dc008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:59.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.432+0000 7f86d67fc700 1 -- 172.21.15.149:0/3971059854 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f86d8054630 con 0x7f86e015abf0 2023-11-08T19:23:59.622 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.621+0000 7f86e8067700 1 -- 172.21.15.149:0/3971059854 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f86e004f730 con 0x7f86e015abf0 2023-11-08T19:23:59.622 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.621+0000 7f86d67fc700 1 -- 172.21.15.149:0/3971059854 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f86d8057c50 con 0x7f86e015abf0 2023-11-08T19:23:59.623 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:23:59.625 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.623+0000 7f86e8067700 1 -- 172.21.15.149:0/3971059854 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f86c406af00 msgr2=0x7f86c406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:59.625 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.623+0000 7f86e8067700 1 --2- 172.21.15.149:0/3971059854 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f86c406af00 0x7f86c406d3c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f86dc000c00 tx=0x7f86dc008030 comp rx=0 tx=0).stop 2023-11-08T19:23:59.625 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.623+0000 7f86e8067700 1 -- 172.21.15.149:0/3971059854 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86e015abf0 msgr2=0x7f86e01f5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:59.625 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.623+0000 7f86e8067700 1 --2- 172.21.15.149:0/3971059854 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86e015abf0 0x7f86e01f5140 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f86d800cb50 tx=0x7f86d800ce60 comp rx=0 tx=0).stop 2023-11-08T19:23:59.626 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.623+0000 7f86e8067700 1 -- 172.21.15.149:0/3971059854 shutdown_connections 2023-11-08T19:23:59.626 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.623+0000 7f86e8067700 1 --2- 172.21.15.149:0/3971059854 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f86c406af00 0x7f86c406d3c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:59.626 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.623+0000 7f86e8067700 1 --2- 172.21.15.149:0/3971059854 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86e015abf0 0x7f86e01f5140 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:59.626 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.623+0000 7f86e8067700 1 --2- 172.21.15.149:0/3971059854 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f86e00cc6a0 0x7f86e00b0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:59.626 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.623+0000 7f86e8067700 1 --2- 172.21.15.149:0/3971059854 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f86e00d1130 0x7f86e01f4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:59.627 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.623+0000 7f86e8067700 1 -- 172.21.15.149:0/3971059854 >> 172.21.15.149:0/3971059854 conn(0x7f86e00d0640 msgr2=0x7f86e01502f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:59.627 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.623+0000 7f86e8067700 1 -- 172.21.15.149:0/3971059854 shutdown_connections 2023-11-08T19:23:59.627 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.624+0000 7f86e8067700 1 -- 172.21.15.149:0/3971059854 wait complete. 2023-11-08T19:23:59.637 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-08T19:23:59.760 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.759+0000 7f774a497700 1 Processor -- start 2023-11-08T19:23:59.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.759+0000 7f774a497700 1 -- start start 2023-11-08T19:23:59.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.760+0000 7f774a497700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f77440668e0 0x7f774406bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:59.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.760+0000 7f774a497700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f77440b5840 0x7f774406c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:59.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.760+0000 7f774a497700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f774415f390 con 0x7f774415efb0 2023-11-08T19:23:59.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.760+0000 7f774a497700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77440b3460 con 0x7f77440668e0 2023-11-08T19:23:59.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.760+0000 7f774a497700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77440ce0a0 con 0x7f77440b5840 2023-11-08T19:23:59.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.760+0000 7f77437fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f77440668e0 0x7f774406bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:59.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.760+0000 7f77437fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f77440668e0 0x7f774406bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38754/0 (socket says 172.21.15.149:38754) 2023-11-08T19:23:59.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.760+0000 7f77437fe700 1 -- 172.21.15.149:0/920578988 learned_addr learned my addr 172.21.15.149:0/920578988 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:59.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.760+0000 7f7748a34700 1 --2- 172.21.15.149:0/920578988 >> v2:172.21.15.160:3300/0 conn(0x7f77440b5840 0x7f774406c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:59.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.760+0000 7f77437fe700 1 -- 172.21.15.149:0/920578988 >> v2:172.21.15.160:3300/0 conn(0x7f77440b5840 msgr2=0x7f774406c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:59.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.760+0000 7f77437fe700 1 --2- 172.21.15.149:0/920578988 >> v2:172.21.15.160:3300/0 conn(0x7f77440b5840 0x7f774406c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:59.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.760+0000 7f77437fe700 1 -- 172.21.15.149:0/920578988 >> v1:172.21.15.160:6789/0 conn(0x7f774415efb0 legacy=0x7f77440b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:23:59.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.760+0000 7f77437fe700 1 -- 172.21.15.149:0/920578988 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77440ce380 con 0x7f77440668e0 2023-11-08T19:23:59.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.760+0000 7f7748a34700 1 --2- 172.21.15.149:0/920578988 >> v2:172.21.15.160:3300/0 conn(0x7f77440b5840 0x7f774406c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:23:59.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.760+0000 7f77437fe700 1 --2- 172.21.15.149:0/920578988 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f77440668e0 0x7f774406bb90 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7744067120 tx=0x7f7734009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=774e51ad1070e5a1 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:59.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.760+0000 7f7742ffd700 1 -- 172.21.15.149:0/920578988 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7734004230 con 0x7f77440668e0 2023-11-08T19:23:59.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.761+0000 7f7742ffd700 1 -- 172.21.15.149:0/920578988 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7734004390 con 0x7f77440668e0 2023-11-08T19:23:59.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.761+0000 7f7742ffd700 1 -- 172.21.15.149:0/920578988 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77340036a0 con 0x7f77440668e0 2023-11-08T19:23:59.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.761+0000 7f774a497700 1 -- 172.21.15.149:0/920578988 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f77440668e0 msgr2=0x7f774406bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:59.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.761+0000 7f774a497700 1 --2- 172.21.15.149:0/920578988 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f77440668e0 0x7f774406bb90 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7744067120 tx=0x7f7734009bd0 comp rx=0 tx=0).stop 2023-11-08T19:23:59.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.761+0000 7f774a497700 1 -- 172.21.15.149:0/920578988 shutdown_connections 2023-11-08T19:23:59.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.761+0000 7f774a497700 1 --2- 172.21.15.149:0/920578988 >> v2:172.21.15.160:3300/0 conn(0x7f77440b5840 0x7f774406c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:59.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.761+0000 7f774a497700 1 --2- 172.21.15.149:0/920578988 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f77440668e0 0x7f774406bb90 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:59.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.761+0000 7f774a497700 1 -- 172.21.15.149:0/920578988 >> 172.21.15.149:0/920578988 conn(0x7f7744071720 msgr2=0x7f7744071b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:59.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.761+0000 7f774a497700 1 -- 172.21.15.149:0/920578988 shutdown_connections 2023-11-08T19:23:59.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.761+0000 7f774a497700 1 -- 172.21.15.149:0/920578988 wait complete. 2023-11-08T19:23:59.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.762+0000 7f774a497700 1 Processor -- start 2023-11-08T19:23:59.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.763+0000 7f774a497700 1 -- start start 2023-11-08T19:23:59.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.763+0000 7f774a497700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f77440668e0 0x7f774415a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:59.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.763+0000 7f774a497700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f77440b5840 0x7f7744155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:59.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.763+0000 7f774a497700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f774415efb0 0x7f7744155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:59.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.763+0000 7f774a497700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77440c3910 con 0x7f774415efb0 2023-11-08T19:23:59.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.763+0000 7f774a497700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7744157290 con 0x7f77440b5840 2023-11-08T19:23:59.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.763+0000 7f774a497700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77440c9b00 con 0x7f77440668e0 2023-11-08T19:23:59.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.763+0000 7f7748a34700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f774415efb0 0x7f7744155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:59.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.763+0000 7f7748a34700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f774415efb0 0x7f7744155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38762/0 (socket says 172.21.15.149:38762) 2023-11-08T19:23:59.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.763+0000 7f7748a34700 1 -- 172.21.15.149:0/3220447646 learned_addr learned my addr 172.21.15.149:0/3220447646 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:23:59.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.764+0000 7f7743fff700 1 --2- 172.21.15.149:0/3220447646 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f77440668e0 0x7f774415a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:59.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.764+0000 7f77437fe700 1 --2- 172.21.15.149:0/3220447646 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f77440b5840 0x7f7744155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:59.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.764+0000 7f7748a34700 1 -- 172.21.15.149:0/3220447646 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f77440668e0 msgr2=0x7f774415a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:59.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.764+0000 7f7748a34700 1 --2- 172.21.15.149:0/3220447646 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f77440668e0 0x7f774415a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:59.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.764+0000 7f7748a34700 1 -- 172.21.15.149:0/3220447646 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f77440b5840 msgr2=0x7f7744155aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:59.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.764+0000 7f7748a34700 1 --2- 172.21.15.149:0/3220447646 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f77440b5840 0x7f7744155aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:59.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.764+0000 7f7748a34700 1 -- 172.21.15.149:0/3220447646 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7734009550 con 0x7f774415efb0 2023-11-08T19:23:59.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.764+0000 7f77437fe700 1 --2- 172.21.15.149:0/3220447646 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f77440b5840 0x7f7744155aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:23:59.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.764+0000 7f7748a34700 1 --2- 172.21.15.149:0/3220447646 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f774415efb0 0x7f7744155fe0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f773c00cef0 tx=0x7f773c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:59.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.764+0000 7f7740ff9700 1 -- 172.21.15.149:0/3220447646 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f773c00ae50 con 0x7f774415efb0 2023-11-08T19:23:59.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.764+0000 7f7740ff9700 1 -- 172.21.15.149:0/3220447646 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f773c015440 con 0x7f774415efb0 2023-11-08T19:23:59.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.764+0000 7f774a497700 1 -- 172.21.15.149:0/3220447646 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7744156c20 con 0x7f774415efb0 2023-11-08T19:23:59.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.764+0000 7f7740ff9700 1 -- 172.21.15.149:0/3220447646 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f773c0157f0 con 0x7f774415efb0 2023-11-08T19:23:59.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.764+0000 7f774a497700 1 -- 172.21.15.149:0/3220447646 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7744156940 con 0x7f774415efb0 2023-11-08T19:23:59.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.765+0000 7f774a497700 1 -- 172.21.15.149:0/3220447646 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77440745f0 con 0x7f774415efb0 2023-11-08T19:23:59.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.765+0000 7f7740ff9700 1 -- 172.21.15.149:0/3220447646 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f773c00d430 con 0x7f774415efb0 2023-11-08T19:23:59.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.766+0000 7f7740ff9700 1 --2- 172.21.15.149:0/3220447646 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f773006af00 0x7f773006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:23:59.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.766+0000 7f7740ff9700 1 -- 172.21.15.149:0/3220447646 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f773c089f70 con 0x7f774415efb0 2023-11-08T19:23:59.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.766+0000 7f7743fff700 1 --2- 172.21.15.149:0/3220447646 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f773006af00 0x7f773006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:23:59.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.766+0000 7f7743fff700 1 --2- 172.21.15.149:0/3220447646 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f773006af00 0x7f773006d3c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7738009870 tx=0x7f7738008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:23:59.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.770+0000 7f7740ff9700 1 -- 172.21.15.149:0/3220447646 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f773c0bcca0 con 0x7f774415efb0 2023-11-08T19:23:59.976 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.975+0000 7f774a497700 1 -- 172.21.15.149:0/3220447646 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7744072460 con 0x7f774415efb0 2023-11-08T19:23:59.976 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.975+0000 7f7740ff9700 1 -- 172.21.15.149:0/3220447646 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f773c01a020 con 0x7f774415efb0 2023-11-08T19:23:59.979 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.977+0000 7f774a497700 1 -- 172.21.15.149:0/3220447646 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f773006af00 msgr2=0x7f773006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:59.979 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.977+0000 7f774a497700 1 --2- 172.21.15.149:0/3220447646 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f773006af00 0x7f773006d3c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7738009870 tx=0x7f7738008040 comp rx=0 tx=0).stop 2023-11-08T19:23:59.979 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.977+0000 7f774a497700 1 -- 172.21.15.149:0/3220447646 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f774415efb0 msgr2=0x7f7744155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:23:59.979 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.977+0000 7f774a497700 1 --2- 172.21.15.149:0/3220447646 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f774415efb0 0x7f7744155fe0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f773c00cef0 tx=0x7f773c00a340 comp rx=0 tx=0).stop 2023-11-08T19:23:59.979 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.977+0000 7f774a497700 1 -- 172.21.15.149:0/3220447646 shutdown_connections 2023-11-08T19:23:59.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.977+0000 7f774a497700 1 --2- 172.21.15.149:0/3220447646 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f773006af00 0x7f773006d3c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:59.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.977+0000 7f774a497700 1 --2- 172.21.15.149:0/3220447646 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f774415efb0 0x7f7744155fe0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:59.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.977+0000 7f774a497700 1 --2- 172.21.15.149:0/3220447646 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f77440668e0 0x7f774415a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:59.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.977+0000 7f774a497700 1 --2- 172.21.15.149:0/3220447646 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f77440b5840 0x7f7744155aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:23:59.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.977+0000 7f774a497700 1 -- 172.21.15.149:0/3220447646 >> 172.21.15.149:0/3220447646 conn(0x7f7744071720 msgr2=0x7f7744155270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:23:59.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.978+0000 7f774a497700 1 -- 172.21.15.149:0/3220447646 shutdown_connections 2023-11-08T19:23:59.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:23:59.978+0000 7f774a497700 1 -- 172.21.15.149:0/3220447646 wait complete. 2023-11-08T19:23:59.981 INFO:teuthology.orchestra.run.smithi149.stderr:listed 0 entries 2023-11-08T19:23:59.991 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-11-08T19:23:59.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:23:59.992 DEBUG:teuthology.orchestra.run.smithi160:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-11-08T19:24:00.035 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi160.front.sepia.ceph.com 2023-11-08T19:24:00.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:24:00.036 DEBUG:teuthology.orchestra.run.smithi160:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-08T19:24:00.098 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-08T19:24:00.098 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:24:00.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.218+0000 7f535cd76700 1 Processor -- start 2023-11-08T19:24:00.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.218+0000 7f535cd76700 1 -- start start 2023-11-08T19:24:00.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.219+0000 7f535cd76700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f53580cc140 0x7f53580cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:00.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.219+0000 7f535cd76700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f53580b2850 0x7f53580cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:00.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.219+0000 7f535cd76700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53580cce50 con 0x7f53580b2cd0 2023-11-08T19:24:00.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.219+0000 7f535cd76700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53580b2430 con 0x7f53580cc140 2023-11-08T19:24:00.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.219+0000 7f535cd76700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53580cc520 con 0x7f53580b2850 2023-11-08T19:24:00.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.219+0000 7f535659c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f53580cc140 0x7f53580cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:00.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.219+0000 7f535659c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f53580cc140 0x7f53580cc910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38766/0 (socket says 172.21.15.149:38766) 2023-11-08T19:24:00.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.219+0000 7f535659c700 1 -- 172.21.15.149:0/444137150 learned_addr learned my addr 172.21.15.149:0/444137150 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:00.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.219+0000 7f535659c700 1 -- 172.21.15.149:0/444137150 >> v2:172.21.15.160:3300/0 conn(0x7f53580b2850 msgr2=0x7f53580cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:00.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.219+0000 7f535659c700 1 --2- 172.21.15.149:0/444137150 >> v2:172.21.15.160:3300/0 conn(0x7f53580b2850 0x7f53580cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:00.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.219+0000 7f535659c700 1 -- 172.21.15.149:0/444137150 >> v1:172.21.15.160:6789/0 conn(0x7f53580b2cd0 legacy=0x7f535815d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:00.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.219+0000 7f535659c700 1 -- 172.21.15.149:0/444137150 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53580b17b0 con 0x7f53580cc140 2023-11-08T19:24:00.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.220+0000 7f535659c700 1 --2- 172.21.15.149:0/444137150 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53580cc140 0x7f53580cc910 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f53580b1330 tx=0x7f534c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4a0e2deaa9cc9ff server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:00.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.220+0000 7f535559a700 1 -- 172.21.15.149:0/444137150 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534c005e30 con 0x7f53580cc140 2023-11-08T19:24:00.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.220+0000 7f535559a700 1 -- 172.21.15.149:0/444137150 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f534c006030 con 0x7f53580cc140 2023-11-08T19:24:00.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.220+0000 7f535559a700 1 -- 172.21.15.149:0/444137150 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534c0063e0 con 0x7f53580cc140 2023-11-08T19:24:00.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.220+0000 7f535cd76700 1 -- 172.21.15.149:0/444137150 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53580cc140 msgr2=0x7f53580cc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:00.226 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.220+0000 7f535cd76700 1 --2- 172.21.15.149:0/444137150 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53580cc140 0x7f53580cc910 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f53580b1330 tx=0x7f534c009bd0 comp rx=0 tx=0).stop 2023-11-08T19:24:00.226 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.220+0000 7f535cd76700 1 -- 172.21.15.149:0/444137150 shutdown_connections 2023-11-08T19:24:00.226 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.220+0000 7f535cd76700 1 --2- 172.21.15.149:0/444137150 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53580cc140 0x7f53580cc910 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:00.226 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.220+0000 7f535cd76700 1 --2- 172.21.15.149:0/444137150 >> v2:172.21.15.160:3300/0 conn(0x7f53580b2850 0x7f53580cabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:00.226 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.220+0000 7f535cd76700 1 -- 172.21.15.149:0/444137150 >> 172.21.15.149:0/444137150 conn(0x7f5358099a40 msgr2=0x7f53580d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:00.226 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.220+0000 7f535cd76700 1 -- 172.21.15.149:0/444137150 shutdown_connections 2023-11-08T19:24:00.227 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.220+0000 7f535cd76700 1 -- 172.21.15.149:0/444137150 wait complete. 2023-11-08T19:24:00.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.222+0000 7f535cd76700 1 Processor -- start 2023-11-08T19:24:00.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.222+0000 7f535cd76700 1 -- start start 2023-11-08T19:24:00.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.223+0000 7f535cd76700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53580b2850 0x7f53581f2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:00.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.223+0000 7f535cd76700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53580b2cd0 0x7f535809af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:00.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.223+0000 7f535cd76700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53580cc140 0x7f53580c7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:00.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.223+0000 7f535cd76700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f535809b9d0 con 0x7f53580b2850 2023-11-08T19:24:00.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.223+0000 7f535cd76700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53581f7160 con 0x7f53580cc140 2023-11-08T19:24:00.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.223+0000 7f535cd76700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53581f75f0 con 0x7f53580b2cd0 2023-11-08T19:24:00.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.223+0000 7f535659c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53580b2850 0x7f53581f2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:00.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.223+0000 7f535659c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53580b2850 0x7f53581f2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38772/0 (socket says 172.21.15.149:38772) 2023-11-08T19:24:00.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.223+0000 7f535659c700 1 -- 172.21.15.149:0/3894081842 learned_addr learned my addr 172.21.15.149:0/3894081842 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:00.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.223+0000 7f5356d9d700 1 --2- 172.21.15.149:0/3894081842 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53580cc140 0x7f53580c7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:00.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.223+0000 7f535659c700 1 -- 172.21.15.149:0/3894081842 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53580b2cd0 msgr2=0x7f535809af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:00.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.223+0000 7f5355d9b700 1 --2- 172.21.15.149:0/3894081842 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53580b2cd0 0x7f535809af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:00.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.223+0000 7f535659c700 1 --2- 172.21.15.149:0/3894081842 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53580b2cd0 0x7f535809af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:00.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.223+0000 7f535659c700 1 -- 172.21.15.149:0/3894081842 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53580cc140 msgr2=0x7f53580c7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:00.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.223+0000 7f535659c700 1 --2- 172.21.15.149:0/3894081842 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53580cc140 0x7f53580c7670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:00.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.223+0000 7f535659c700 1 -- 172.21.15.149:0/3894081842 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f534c009500 con 0x7f53580b2850 2023-11-08T19:24:00.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.223+0000 7f5356d9d700 1 --2- 172.21.15.149:0/3894081842 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53580cc140 0x7f53580c7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:24:00.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.223+0000 7f535659c700 1 --2- 172.21.15.149:0/3894081842 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53580b2850 0x7f53581f2d40 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f534c013040 tx=0x7f534c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:00.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.223+0000 7f5346ffd700 1 -- 172.21.15.149:0/3894081842 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534c025430 con 0x7f53580b2850 2023-11-08T19:24:00.234 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.223+0000 7f5346ffd700 1 -- 172.21.15.149:0/3894081842 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f534c020070 con 0x7f53580b2850 2023-11-08T19:24:00.234 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.223+0000 7f535cd76700 1 -- 172.21.15.149:0/3894081842 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53581f6830 con 0x7f53580b2850 2023-11-08T19:24:00.234 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.223+0000 7f5346ffd700 1 -- 172.21.15.149:0/3894081842 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534c0257f0 con 0x7f53580b2850 2023-11-08T19:24:00.234 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.224+0000 7f535cd76700 1 -- 172.21.15.149:0/3894081842 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53581f6df0 con 0x7f53580b2850 2023-11-08T19:24:00.234 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.225+0000 7f535cd76700 1 -- 172.21.15.149:0/3894081842 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53581f7440 con 0x7f53580b2850 2023-11-08T19:24:00.235 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.225+0000 7f5346ffd700 1 -- 172.21.15.149:0/3894081842 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f534c022030 con 0x7f53580b2850 2023-11-08T19:24:00.235 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.225+0000 7f5346ffd700 1 --2- 172.21.15.149:0/3894081842 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f533806af00 0x7f533806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:00.235 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.226+0000 7f5355d9b700 1 --2- 172.21.15.149:0/3894081842 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f533806af00 0x7f533806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:00.235 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.226+0000 7f5346ffd700 1 -- 172.21.15.149:0/3894081842 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f534c08b0e0 con 0x7f53580b2850 2023-11-08T19:24:00.235 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.226+0000 7f5355d9b700 1 --2- 172.21.15.149:0/3894081842 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f533806af00 0x7f533806d3c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5348006fd0 tx=0x7f5348008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:00.236 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.230+0000 7f5346ffd700 1 -- 172.21.15.149:0/3894081842 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f534c055e60 con 0x7f53580b2850 2023-11-08T19:24:00.468 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.466+0000 7f535cd76700 1 -- 172.21.15.149:0/3894081842 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f53581f6f80 con 0x7f53580b2850 2023-11-08T19:24:00.468 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.467+0000 7f5346ffd700 1 -- 172.21.15.149:0/3894081842 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4921 (secure 0 0 0) 0x7f534c059480 con 0x7f53580b2850 2023-11-08T19:24:00.469 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:24:00.469 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4252,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/2277605177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":2277605177},{"type":"v1","addr":"172.21.15.149:6837","nonce":2277605177}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/2774257644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2774257644},{"type":"v1","addr":"172.21.15.149:6836","nonce":2774257644}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/2076428669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":2076428669},{"type":"v1","addr":"172.21.15.160:6835","nonce":2076428669}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-08T19:23:01.918138+0000","modified":"2023-11-08T19:23:19.490960+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.160:6834/3847116435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3847116435},{"type":"v1","addr":"172.21.15.160:6834","nonce":3847116435}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-08T19:24:00.471 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.469+0000 7f535cd76700 1 -- 172.21.15.149:0/3894081842 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f533806af00 msgr2=0x7f533806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:00.471 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.469+0000 7f535cd76700 1 --2- 172.21.15.149:0/3894081842 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f533806af00 0x7f533806d3c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5348006fd0 tx=0x7f5348008040 comp rx=0 tx=0).stop 2023-11-08T19:24:00.471 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.469+0000 7f535cd76700 1 -- 172.21.15.149:0/3894081842 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53580b2850 msgr2=0x7f53581f2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:00.471 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.469+0000 7f535cd76700 1 --2- 172.21.15.149:0/3894081842 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53580b2850 0x7f53581f2d40 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f534c013040 tx=0x7f534c004750 comp rx=0 tx=0).stop 2023-11-08T19:24:00.472 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.469+0000 7f535cd76700 1 -- 172.21.15.149:0/3894081842 shutdown_connections 2023-11-08T19:24:00.472 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.469+0000 7f535cd76700 1 --2- 172.21.15.149:0/3894081842 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f533806af00 0x7f533806d3c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:00.472 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.469+0000 7f535cd76700 1 --2- 172.21.15.149:0/3894081842 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53580cc140 0x7f53580c7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:00.473 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.469+0000 7f535cd76700 1 --2- 172.21.15.149:0/3894081842 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53580b2850 0x7f53581f2d40 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:00.473 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.469+0000 7f535cd76700 1 --2- 172.21.15.149:0/3894081842 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53580b2cd0 0x7f535809af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:00.473 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.469+0000 7f535cd76700 1 -- 172.21.15.149:0/3894081842 >> 172.21.15.149:0/3894081842 conn(0x7f5358099a40 msgr2=0x7f535806f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:00.473 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.469+0000 7f535cd76700 1 -- 172.21.15.149:0/3894081842 shutdown_connections 2023-11-08T19:24:00.473 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.469+0000 7f535cd76700 1 -- 172.21.15.149:0/3894081842 wait complete. 2023-11-08T19:24:00.474 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 9 2023-11-08T19:24:00.483 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:24:00.603 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.602+0000 7f7ea262c700 1 Processor -- start 2023-11-08T19:24:00.604 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.602+0000 7f7ea262c700 1 -- start start 2023-11-08T19:24:00.606 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.603+0000 7f7ea262c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f7e9c15b950 0x7f7e9c0ce130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:00.606 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.603+0000 7f7ea262c700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f7e9c0cd5e0 0x7f7e9c0ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:00.606 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.603+0000 7f7ea262c700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e9c0cc2e0 con 0x7f7e9c0cfd20 2023-11-08T19:24:00.607 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.603+0000 7f7ea262c700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e9c0cc580 con 0x7f7e9c15b950 2023-11-08T19:24:00.607 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.603+0000 7f7ea262c700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e9c0cc820 con 0x7f7e9c0cd5e0 2023-11-08T19:24:00.607 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.603+0000 7f7e9bfff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f7e9c15b950 0x7f7e9c0ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:00.607 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.603+0000 7f7e9bfff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f7e9c15b950 0x7f7e9c0ce130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38780/0 (socket says 172.21.15.149:38780) 2023-11-08T19:24:00.607 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.603+0000 7f7e9bfff700 1 -- 172.21.15.149:0/2775873419 learned_addr learned my addr 172.21.15.149:0/2775873419 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:00.607 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.603+0000 7f7e9bfff700 1 -- 172.21.15.149:0/2775873419 >> v2:172.21.15.160:3300/0 conn(0x7f7e9c0cd5e0 msgr2=0x7f7e9c0ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:00.608 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.603+0000 7f7e9b7fe700 1 --2- 172.21.15.149:0/2775873419 >> v2:172.21.15.160:3300/0 conn(0x7f7e9c0cd5e0 0x7f7e9c0ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:00.608 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.603+0000 7f7e9bfff700 1 --2- 172.21.15.149:0/2775873419 >> v2:172.21.15.160:3300/0 conn(0x7f7e9c0cd5e0 0x7f7e9c0ce670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:00.608 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.603+0000 7f7e9bfff700 1 -- 172.21.15.149:0/2775873419 >> v1:172.21.15.160:6789/0 conn(0x7f7e9c0cfd20 legacy=0x7f7e9c0d0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:00.608 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.603+0000 7f7e9bfff700 1 -- 172.21.15.149:0/2775873419 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e9c0ccb00 con 0x7f7e9c15b950 2023-11-08T19:24:00.608 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.604+0000 7f7e9bfff700 1 --2- 172.21.15.149:0/2775873419 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e9c15b950 0x7f7e9c0ce130 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c08bca0 tx=0x7f7e8c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd97f9f352d94ead server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:00.609 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.604+0000 7f7e9affd700 1 -- 172.21.15.149:0/2775873419 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c005e30 con 0x7f7e9c15b950 2023-11-08T19:24:00.609 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.604+0000 7f7e9affd700 1 -- 172.21.15.149:0/2775873419 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e8c006030 con 0x7f7e9c15b950 2023-11-08T19:24:00.609 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.604+0000 7f7e9affd700 1 -- 172.21.15.149:0/2775873419 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c0063e0 con 0x7f7e9c15b950 2023-11-08T19:24:00.609 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.604+0000 7f7ea262c700 1 -- 172.21.15.149:0/2775873419 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e9c15b950 msgr2=0x7f7e9c0ce130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:00.609 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.604+0000 7f7ea262c700 1 --2- 172.21.15.149:0/2775873419 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e9c15b950 0x7f7e9c0ce130 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c08bca0 tx=0x7f7e8c009bd0 comp rx=0 tx=0).stop 2023-11-08T19:24:00.610 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.604+0000 7f7ea262c700 1 -- 172.21.15.149:0/2775873419 shutdown_connections 2023-11-08T19:24:00.610 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.604+0000 7f7ea262c700 1 --2- 172.21.15.149:0/2775873419 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e9c15b950 0x7f7e9c0ce130 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:00.610 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.604+0000 7f7ea262c700 1 --2- 172.21.15.149:0/2775873419 >> v2:172.21.15.160:3300/0 conn(0x7f7e9c0cd5e0 0x7f7e9c0ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:00.610 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.604+0000 7f7ea262c700 1 -- 172.21.15.149:0/2775873419 >> 172.21.15.149:0/2775873419 conn(0x7f7e9c08afd0 msgr2=0x7f7e9c0d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:00.610 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.604+0000 7f7ea262c700 1 -- 172.21.15.149:0/2775873419 shutdown_connections 2023-11-08T19:24:00.611 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.604+0000 7f7ea262c700 1 -- 172.21.15.149:0/2775873419 wait complete. 2023-11-08T19:24:00.613 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.606+0000 7f7ea262c700 1 Processor -- start 2023-11-08T19:24:00.614 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.606+0000 7f7ea262c700 1 -- start start 2023-11-08T19:24:00.614 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.606+0000 7f7ea262c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7e9c0cfd20 0x7f7e9c0cb350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:00.614 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.606+0000 7f7ea262c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7e9c15b950 0x7f7e9c1f3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:00.614 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.606+0000 7f7ea262c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e9c0c8810 0x7f7e9c0ae330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:00.615 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.606+0000 7f7ea262c700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9c155550 con 0x7f7e9c0c8810 2023-11-08T19:24:00.615 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.606+0000 7f7ea262c700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9c1f35e0 con 0x7f7e9c15b950 2023-11-08T19:24:00.615 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.606+0000 7f7ea262c700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9c0c9600 con 0x7f7e9c0cfd20 2023-11-08T19:24:00.615 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.607+0000 7f7ea0bc9700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e9c0c8810 0x7f7e9c0ae330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:00.615 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.607+0000 7f7ea0bc9700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e9c0c8810 0x7f7e9c0ae330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38786/0 (socket says 172.21.15.149:38786) 2023-11-08T19:24:00.616 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.607+0000 7f7ea0bc9700 1 -- 172.21.15.149:0/4014307296 learned_addr learned my addr 172.21.15.149:0/4014307296 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:00.616 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.607+0000 7f7e9b7fe700 1 --2- 172.21.15.149:0/4014307296 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7e9c15b950 0x7f7e9c1f3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:00.616 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.607+0000 7f7e9bfff700 1 --2- 172.21.15.149:0/4014307296 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7e9c0cfd20 0x7f7e9c0cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:00.616 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.607+0000 7f7ea0bc9700 1 -- 172.21.15.149:0/4014307296 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7e9c0cfd20 msgr2=0x7f7e9c0cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:00.616 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.607+0000 7f7ea0bc9700 1 --2- 172.21.15.149:0/4014307296 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7e9c0cfd20 0x7f7e9c0cb350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:00.617 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.607+0000 7f7ea0bc9700 1 -- 172.21.15.149:0/4014307296 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7e9c15b950 msgr2=0x7f7e9c1f3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:00.617 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.607+0000 7f7ea0bc9700 1 --2- 172.21.15.149:0/4014307296 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7e9c15b950 0x7f7e9c1f3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:00.617 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.607+0000 7f7ea0bc9700 1 -- 172.21.15.149:0/4014307296 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e8c009500 con 0x7f7e9c0c8810 2023-11-08T19:24:00.617 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.607+0000 7f7e9bfff700 1 --2- 172.21.15.149:0/4014307296 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7e9c0cfd20 0x7f7e9c0cb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:24:00.617 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.607+0000 7f7e9b7fe700 1 --2- 172.21.15.149:0/4014307296 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7e9c15b950 0x7f7e9c1f3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:24:00.618 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.607+0000 7f7ea0bc9700 1 --2- 172.21.15.149:0/4014307296 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e9c0c8810 0x7f7e9c0ae330 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7e9400c7a0 tx=0x7f7e9400cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:00.618 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.607+0000 7f7e98ff9700 1 -- 172.21.15.149:0/4014307296 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e94003e10 con 0x7f7e9c0c8810 2023-11-08T19:24:00.618 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.607+0000 7f7e98ff9700 1 -- 172.21.15.149:0/4014307296 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e94005070 con 0x7f7e9c0c8810 2023-11-08T19:24:00.618 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.607+0000 7f7ea262c700 1 -- 172.21.15.149:0/4014307296 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e9c0c8d60 con 0x7f7e9c0c8810 2023-11-08T19:24:00.618 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.607+0000 7f7e98ff9700 1 -- 172.21.15.149:0/4014307296 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e94005420 con 0x7f7e9c0c8810 2023-11-08T19:24:00.619 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.607+0000 7f7ea262c700 1 -- 172.21.15.149:0/4014307296 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e9c0c9320 con 0x7f7e9c0c8810 2023-11-08T19:24:00.619 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.608+0000 7f7ea262c700 1 -- 172.21.15.149:0/4014307296 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e9c0745f0 con 0x7f7e9c0c8810 2023-11-08T19:24:00.619 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.609+0000 7f7e98ff9700 1 -- 172.21.15.149:0/4014307296 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7e94005580 con 0x7f7e9c0c8810 2023-11-08T19:24:00.619 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.609+0000 7f7e98ff9700 1 --2- 172.21.15.149:0/4014307296 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f7e8806af00 0x7f7e8806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:00.619 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.609+0000 7f7e98ff9700 1 -- 172.21.15.149:0/4014307296 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7e940890c0 con 0x7f7e9c0c8810 2023-11-08T19:24:00.620 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.609+0000 7f7e9bfff700 1 --2- 172.21.15.149:0/4014307296 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f7e8806af00 0x7f7e8806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:00.620 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.610+0000 7f7e9bfff700 1 --2- 172.21.15.149:0/4014307296 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f7e8806af00 0x7f7e8806d3c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c08bca0 tx=0x7f7e8c008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:00.620 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.614+0000 7f7e98ff9700 1 -- 172.21.15.149:0/4014307296 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7e94053db0 con 0x7f7e9c0c8810 2023-11-08T19:24:00.806 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.805+0000 7f7ea262c700 1 -- 172.21.15.149:0/4014307296 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e9c0b00e0 con 0x7f7e9c0c8810 2023-11-08T19:24:00.807 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.806+0000 7f7e98ff9700 1 -- 172.21.15.149:0/4014307296 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18770 (secure 0 0 0) 0x7f7e94017090 con 0x7f7e9c0c8810 2023-11-08T19:24:00.807 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:24:00.808 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":26,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:23:51.355959+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-08T19:22:59.830928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-08T19:23:00.886589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-08T19:23:04.574033+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":1}]},{"pgid":"3.14","mappings":[{"from":4,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:24:00.809 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.808+0000 7f7ea262c700 1 -- 172.21.15.149:0/4014307296 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f7e8806af00 msgr2=0x7f7e8806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:00.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.808+0000 7f7ea262c700 1 --2- 172.21.15.149:0/4014307296 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f7e8806af00 0x7f7e8806d3c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c08bca0 tx=0x7f7e8c008070 comp rx=0 tx=0).stop 2023-11-08T19:24:00.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.808+0000 7f7ea262c700 1 -- 172.21.15.149:0/4014307296 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e9c0c8810 msgr2=0x7f7e9c0ae330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:00.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.808+0000 7f7ea262c700 1 --2- 172.21.15.149:0/4014307296 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e9c0c8810 0x7f7e9c0ae330 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7e9400c7a0 tx=0x7f7e9400cb60 comp rx=0 tx=0).stop 2023-11-08T19:24:00.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.808+0000 7f7ea262c700 1 -- 172.21.15.149:0/4014307296 shutdown_connections 2023-11-08T19:24:00.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.808+0000 7f7ea262c700 1 --2- 172.21.15.149:0/4014307296 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f7e8806af00 0x7f7e8806d3c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:00.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.808+0000 7f7ea262c700 1 --2- 172.21.15.149:0/4014307296 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e9c0c8810 0x7f7e9c0ae330 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:00.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.808+0000 7f7ea262c700 1 --2- 172.21.15.149:0/4014307296 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7e9c0cfd20 0x7f7e9c0cb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:00.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.808+0000 7f7ea262c700 1 --2- 172.21.15.149:0/4014307296 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7e9c15b950 0x7f7e9c1f3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:00.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.808+0000 7f7ea262c700 1 -- 172.21.15.149:0/4014307296 >> 172.21.15.149:0/4014307296 conn(0x7f7e9c08afd0 msgr2=0x7f7e9c0b1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:00.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.808+0000 7f7ea262c700 1 -- 172.21.15.149:0/4014307296 shutdown_connections 2023-11-08T19:24:00.812 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.808+0000 7f7ea262c700 1 -- 172.21.15.149:0/4014307296 wait complete. 2023-11-08T19:24:00.822 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-08T19:22:56.023194+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-08T19:22:59.830928+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-08T19:23:00.886589+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-08T19:23:04.574033+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-08T19:24:00.823 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-08T19:24:00.946 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.945+0000 7fd626813700 1 Processor -- start 2023-11-08T19:24:00.947 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.945+0000 7fd626813700 1 -- start start 2023-11-08T19:24:00.949 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.946+0000 7fd626813700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd62015df40 0x7fd62006c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:00.949 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.946+0000 7fd626813700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fd6200cb660 0x7fd62006c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:00.949 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.946+0000 7fd626813700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd62015e320 con 0x7fd62006ab80 2023-11-08T19:24:00.950 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.946+0000 7fd626813700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd62006b020 con 0x7fd62015df40 2023-11-08T19:24:00.950 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.946+0000 7fd626813700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd62006b2e0 con 0x7fd6200cb660 2023-11-08T19:24:00.950 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.946+0000 7fd61ffff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd62015df40 0x7fd62006c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:00.950 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.946+0000 7fd61ffff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd62015df40 0x7fd62006c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38792/0 (socket says 172.21.15.149:38792) 2023-11-08T19:24:00.950 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.946+0000 7fd61ffff700 1 -- 172.21.15.149:0/3729156324 learned_addr learned my addr 172.21.15.149:0/3729156324 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:00.951 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.946+0000 7fd61f7fe700 1 --1- 172.21.15.149:0/3729156324 >> v1:172.21.15.149:6789/0 conn(0x7fd62006ab80 0x7fd6200caf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:40794/0 (socket says 172.21.15.149:40794) 2023-11-08T19:24:00.951 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.946+0000 7fd624db0700 1 --2- 172.21.15.149:0/3729156324 >> v2:172.21.15.160:3300/0 conn(0x7fd6200cb660 0x7fd62006c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:00.951 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.946+0000 7fd61ffff700 1 -- 172.21.15.149:0/3729156324 >> v2:172.21.15.160:3300/0 conn(0x7fd6200cb660 msgr2=0x7fd62006c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:00.951 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.946+0000 7fd61ffff700 1 --2- 172.21.15.149:0/3729156324 >> v2:172.21.15.160:3300/0 conn(0x7fd6200cb660 0x7fd62006c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:00.951 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.946+0000 7fd61ffff700 1 -- 172.21.15.149:0/3729156324 >> v1:172.21.15.149:6789/0 conn(0x7fd62006ab80 legacy=0x7fd6200caf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:00.952 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.947+0000 7fd61ffff700 1 -- 172.21.15.149:0/3729156324 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd62006b5c0 con 0x7fd62015df40 2023-11-08T19:24:00.952 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.947+0000 7fd61ffff700 1 --2- 172.21.15.149:0/3729156324 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd62015df40 0x7fd62006c0a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd6200b2180 tx=0x7fd614009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf8c09f387958e34 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:00.952 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.947+0000 7fd61effd700 1 -- 172.21.15.149:0/3729156324 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd614011830 con 0x7fd62015df40 2023-11-08T19:24:00.952 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.947+0000 7fd61effd700 1 -- 172.21.15.149:0/3729156324 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd614011990 con 0x7fd62015df40 2023-11-08T19:24:00.952 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.947+0000 7fd61effd700 1 -- 172.21.15.149:0/3729156324 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd614011d20 con 0x7fd62015df40 2023-11-08T19:24:00.953 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.947+0000 7fd626813700 1 -- 172.21.15.149:0/3729156324 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd62015df40 msgr2=0x7fd62006c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:00.953 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.947+0000 7fd626813700 1 --2- 172.21.15.149:0/3729156324 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd62015df40 0x7fd62006c0a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd6200b2180 tx=0x7fd614009bd0 comp rx=0 tx=0).stop 2023-11-08T19:24:00.953 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.947+0000 7fd626813700 1 -- 172.21.15.149:0/3729156324 shutdown_connections 2023-11-08T19:24:00.953 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.947+0000 7fd626813700 1 --2- 172.21.15.149:0/3729156324 >> v2:172.21.15.160:3300/0 conn(0x7fd6200cb660 0x7fd62006c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:00.953 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.947+0000 7fd626813700 1 --2- 172.21.15.149:0/3729156324 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd62015df40 0x7fd62006c0a0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:00.954 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.947+0000 7fd626813700 1 -- 172.21.15.149:0/3729156324 >> 172.21.15.149:0/3729156324 conn(0x7fd6200d0640 msgr2=0x7fd6200d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:00.954 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.947+0000 7fd626813700 1 -- 172.21.15.149:0/3729156324 shutdown_connections 2023-11-08T19:24:00.954 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.947+0000 7fd626813700 1 -- 172.21.15.149:0/3729156324 wait complete. 2023-11-08T19:24:00.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.949+0000 7fd626813700 1 Processor -- start 2023-11-08T19:24:00.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.949+0000 7fd626813700 1 -- start start 2023-11-08T19:24:00.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.949+0000 7fd626813700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd62006ab80 0x7fd62014cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:00.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.949+0000 7fd626813700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd6200cb660 0x7fd6200c8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:00.958 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.950+0000 7fd626813700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd62015df40 0x7fd62015eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:00.958 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.950+0000 7fd626813700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6200c9ea0 con 0x7fd62015df40 2023-11-08T19:24:00.958 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.950+0000 7fd626813700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd620160d90 con 0x7fd62006ab80 2023-11-08T19:24:00.958 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.950+0000 7fd626813700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd620161030 con 0x7fd6200cb660 2023-11-08T19:24:00.958 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.950+0000 7fd624db0700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd62015df40 0x7fd62015eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:00.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.950+0000 7fd624db0700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd62015df40 0x7fd62015eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38802/0 (socket says 172.21.15.149:38802) 2023-11-08T19:24:00.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.950+0000 7fd624db0700 1 -- 172.21.15.149:0/1383842445 learned_addr learned my addr 172.21.15.149:0/1383842445 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:00.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.950+0000 7fd61ffff700 1 --2- 172.21.15.149:0/1383842445 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd62006ab80 0x7fd62014cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:00.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.950+0000 7fd61f7fe700 1 --2- 172.21.15.149:0/1383842445 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd6200cb660 0x7fd6200c8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:00.960 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.950+0000 7fd624db0700 1 -- 172.21.15.149:0/1383842445 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd6200cb660 msgr2=0x7fd6200c8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:00.960 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.950+0000 7fd624db0700 1 --2- 172.21.15.149:0/1383842445 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd6200cb660 0x7fd6200c8710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:00.960 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.950+0000 7fd624db0700 1 -- 172.21.15.149:0/1383842445 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd62006ab80 msgr2=0x7fd62014cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:00.960 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.950+0000 7fd624db0700 1 --2- 172.21.15.149:0/1383842445 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd62006ab80 0x7fd62014cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:00.960 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.950+0000 7fd624db0700 1 -- 172.21.15.149:0/1383842445 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd614009550 con 0x7fd62015df40 2023-11-08T19:24:00.961 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.950+0000 7fd61ffff700 1 --2- 172.21.15.149:0/1383842445 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd62006ab80 0x7fd62014cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:24:00.961 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.950+0000 7fd624db0700 1 --2- 172.21.15.149:0/1383842445 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd62015df40 0x7fd62015eaa0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fd61800efc0 tx=0x7fd61800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:00.961 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.950+0000 7fd61cff9700 1 -- 172.21.15.149:0/1383842445 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61800cd40 con 0x7fd62015df40 2023-11-08T19:24:00.961 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.950+0000 7fd61cff9700 1 -- 172.21.15.149:0/1383842445 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd61800f040 con 0x7fd62015df40 2023-11-08T19:24:00.961 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.950+0000 7fd626813700 1 -- 172.21.15.149:0/1383842445 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd620161310 con 0x7fd62015df40 2023-11-08T19:24:00.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.950+0000 7fd61cff9700 1 -- 172.21.15.149:0/1383842445 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61800cea0 con 0x7fd62015df40 2023-11-08T19:24:00.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.950+0000 7fd626813700 1 -- 172.21.15.149:0/1383842445 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6200ca330 con 0x7fd62015df40 2023-11-08T19:24:00.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.951+0000 7fd626813700 1 -- 172.21.15.149:0/1383842445 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6200c9990 con 0x7fd62015df40 2023-11-08T19:24:00.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.952+0000 7fd61cff9700 1 -- 172.21.15.149:0/1383842445 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd6180146c0 con 0x7fd62015df40 2023-11-08T19:24:00.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.952+0000 7fd61cff9700 1 --2- 172.21.15.149:0/1383842445 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd60c06af00 0x7fd60c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:00.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.952+0000 7fd61cff9700 1 -- 172.21.15.149:0/1383842445 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd61808a590 con 0x7fd62015df40 2023-11-08T19:24:00.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.952+0000 7fd61ffff700 1 --2- 172.21.15.149:0/1383842445 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd60c06af00 0x7fd60c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:00.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.953+0000 7fd61ffff700 1 --2- 172.21.15.149:0/1383842445 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd60c06af00 0x7fd60c06d3c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd614014040 tx=0x7fd614008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:00.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:00.957+0000 7fd61cff9700 1 -- 172.21.15.149:0/1383842445 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd6200c9990 con 0x7fd62015df40 2023-11-08T19:24:01.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.145+0000 7fd626813700 1 -- 172.21.15.149:0/1383842445 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd6200c9990 con 0x7fd62015df40 2023-11-08T19:24:01.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.146+0000 7fd61cff9700 1 -- 172.21.15.149:0/1383842445 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd6200c9990 con 0x7fd62015df40 2023-11-08T19:24:01.147 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 1 2023-11-08T19:24:01.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.148+0000 7fd626813700 1 -- 172.21.15.149:0/1383842445 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd60c06af00 msgr2=0x7fd60c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:01.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.148+0000 7fd626813700 1 --2- 172.21.15.149:0/1383842445 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd60c06af00 0x7fd60c06d3c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd614014040 tx=0x7fd614008030 comp rx=0 tx=0).stop 2023-11-08T19:24:01.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.148+0000 7fd626813700 1 -- 172.21.15.149:0/1383842445 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd62015df40 msgr2=0x7fd62015eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:01.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.148+0000 7fd626813700 1 --2- 172.21.15.149:0/1383842445 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd62015df40 0x7fd62015eaa0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fd61800efc0 tx=0x7fd61800c3a0 comp rx=0 tx=0).stop 2023-11-08T19:24:01.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.148+0000 7fd626813700 1 -- 172.21.15.149:0/1383842445 shutdown_connections 2023-11-08T19:24:01.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.148+0000 7fd626813700 1 --2- 172.21.15.149:0/1383842445 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd60c06af00 0x7fd60c06d3c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:01.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.148+0000 7fd626813700 1 --2- 172.21.15.149:0/1383842445 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd62006ab80 0x7fd62014cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:01.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.148+0000 7fd626813700 1 --2- 172.21.15.149:0/1383842445 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd62015df40 0x7fd62015eaa0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:01.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.148+0000 7fd626813700 1 --2- 172.21.15.149:0/1383842445 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd6200cb660 0x7fd6200c8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:01.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.148+0000 7fd626813700 1 -- 172.21.15.149:0/1383842445 >> 172.21.15.149:0/1383842445 conn(0x7fd6200d0640 msgr2=0x7fd6200b02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:01.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.148+0000 7fd626813700 1 -- 172.21.15.149:0/1383842445 shutdown_connections 2023-11-08T19:24:01.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.148+0000 7fd626813700 1 -- 172.21.15.149:0/1383842445 wait complete. 2023-11-08T19:24:01.161 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-08T19:24:01.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.284+0000 7f53c9fd8700 1 Processor -- start 2023-11-08T19:24:01.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.285+0000 7f53c9fd8700 1 -- start start 2023-11-08T19:24:01.288 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.285+0000 7f53c9fd8700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53c40ceae0 0x7f53c40cb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:01.288 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.285+0000 7f53c9fd8700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f53c415dc90 0x7f53c40cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:01.289 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.285+0000 7f53c9fd8700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53c40cacd0 con 0x7f53c415a0e0 2023-11-08T19:24:01.289 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.285+0000 7f53c9fd8700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53c406e300 con 0x7f53c415dc90 2023-11-08T19:24:01.289 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.285+0000 7f53c9fd8700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53c406e5e0 con 0x7f53c40ceae0 2023-11-08T19:24:01.289 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.285+0000 7f53c3fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f53c415dc90 0x7f53c40cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:01.289 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.285+0000 7f53c3fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f53c415dc90 0x7f53c40cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38810/0 (socket says 172.21.15.149:38810) 2023-11-08T19:24:01.290 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.285+0000 7f53c3fff700 1 -- 172.21.15.149:0/97724770 learned_addr learned my addr 172.21.15.149:0/97724770 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:01.290 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.286+0000 7f53c2ffd700 1 --2- 172.21.15.149:0/97724770 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53c40ceae0 0x7f53c40cb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:01.290 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.286+0000 7f53c3fff700 1 -- 172.21.15.149:0/97724770 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53c40ceae0 msgr2=0x7f53c40cb1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:01.290 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.286+0000 7f53c3fff700 1 --2- 172.21.15.149:0/97724770 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53c40ceae0 0x7f53c40cb1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:01.290 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.286+0000 7f53c3fff700 1 -- 172.21.15.149:0/97724770 >> v1:172.21.15.160:6789/0 conn(0x7f53c415a0e0 legacy=0x7f53c40ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:01.291 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.286+0000 7f53c3fff700 1 -- 172.21.15.149:0/97724770 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c406e8c0 con 0x7f53c415dc90 2023-11-08T19:24:01.291 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.286+0000 7f53c3fff700 1 --2- 172.21.15.149:0/97724770 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53c415dc90 0x7f53c40cb6f0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f53bc009e50 tx=0x7f53bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c1726f0979f038b server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:01.291 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.286+0000 7f53c27fc700 1 -- 172.21.15.149:0/97724770 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53bc00e070 con 0x7f53c415dc90 2023-11-08T19:24:01.291 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.286+0000 7f53c27fc700 1 -- 172.21.15.149:0/97724770 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53bc00b9c0 con 0x7f53c415dc90 2023-11-08T19:24:01.291 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.286+0000 7f53c27fc700 1 -- 172.21.15.149:0/97724770 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53bc00bd70 con 0x7f53c415dc90 2023-11-08T19:24:01.292 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.287+0000 7f53c9fd8700 1 -- 172.21.15.149:0/97724770 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53c415dc90 msgr2=0x7f53c40cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:01.292 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.287+0000 7f53c9fd8700 1 --2- 172.21.15.149:0/97724770 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53c415dc90 0x7f53c40cb6f0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f53bc009e50 tx=0x7f53bc00b330 comp rx=0 tx=0).stop 2023-11-08T19:24:01.292 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.287+0000 7f53c9fd8700 1 -- 172.21.15.149:0/97724770 shutdown_connections 2023-11-08T19:24:01.292 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.287+0000 7f53c9fd8700 1 --2- 172.21.15.149:0/97724770 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53c415dc90 0x7f53c40cb6f0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:01.292 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.287+0000 7f53c9fd8700 1 --2- 172.21.15.149:0/97724770 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53c40ceae0 0x7f53c40cb1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:01.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.287+0000 7f53c9fd8700 1 -- 172.21.15.149:0/97724770 >> 172.21.15.149:0/97724770 conn(0x7f53c40cc860 msgr2=0x7f53c40ccc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:01.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.287+0000 7f53c9fd8700 1 -- 172.21.15.149:0/97724770 shutdown_connections 2023-11-08T19:24:01.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.287+0000 7f53c9fd8700 1 -- 172.21.15.149:0/97724770 wait complete. 2023-11-08T19:24:01.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.288+0000 7f53c9fd8700 1 Processor -- start 2023-11-08T19:24:01.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.288+0000 7f53c9fd8700 1 -- start start 2023-11-08T19:24:01.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.289+0000 7f53c9fd8700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53c40ceae0 0x7f53c41f4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:01.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.289+0000 7f53c9fd8700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53c415a0e0 0x7f53c41f1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:01.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.289+0000 7f53c9fd8700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53c415dc90 0x7f53c41f2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:01.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.289+0000 7f53c9fd8700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c41f5ba0 con 0x7f53c415dc90 2023-11-08T19:24:01.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.289+0000 7f53c9fd8700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c41f1650 con 0x7f53c415a0e0 2023-11-08T19:24:01.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.289+0000 7f53c9fd8700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53c41f5300 con 0x7f53c40ceae0 2023-11-08T19:24:01.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.289+0000 7f53c3fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53c415dc90 0x7f53c41f2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:01.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.289+0000 7f53c3fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53c415dc90 0x7f53c41f2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38816/0 (socket says 172.21.15.149:38816) 2023-11-08T19:24:01.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.289+0000 7f53c3fff700 1 -- 172.21.15.149:0/1216936466 learned_addr learned my addr 172.21.15.149:0/1216936466 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:01.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.289+0000 7f53c37fe700 1 --2- 172.21.15.149:0/1216936466 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53c40ceae0 0x7f53c41f4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:01.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.289+0000 7f53c2ffd700 1 --2- 172.21.15.149:0/1216936466 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53c415a0e0 0x7f53c41f1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:01.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.289+0000 7f53c3fff700 1 -- 172.21.15.149:0/1216936466 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53c40ceae0 msgr2=0x7f53c41f4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:01.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.289+0000 7f53c3fff700 1 --2- 172.21.15.149:0/1216936466 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53c40ceae0 0x7f53c41f4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:01.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.289+0000 7f53c3fff700 1 -- 172.21.15.149:0/1216936466 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53c415a0e0 msgr2=0x7f53c41f1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:01.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.289+0000 7f53c3fff700 1 --2- 172.21.15.149:0/1216936466 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53c415a0e0 0x7f53c41f1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:01.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.289+0000 7f53c3fff700 1 -- 172.21.15.149:0/1216936466 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53bc009b30 con 0x7f53c415dc90 2023-11-08T19:24:01.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.289+0000 7f53c3fff700 1 --2- 172.21.15.149:0/1216936466 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53c415dc90 0x7f53c41f2760 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f53c406d0b0 tx=0x7f53bc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:01.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.289+0000 7f53abfff700 1 -- 172.21.15.149:0/1216936466 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53bc004800 con 0x7f53c415dc90 2023-11-08T19:24:01.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.289+0000 7f53abfff700 1 -- 172.21.15.149:0/1216936466 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53bc004960 con 0x7f53c415dc90 2023-11-08T19:24:01.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.289+0000 7f53abfff700 1 -- 172.21.15.149:0/1216936466 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53bc01b670 con 0x7f53c415dc90 2023-11-08T19:24:01.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.289+0000 7f53c9fd8700 1 -- 172.21.15.149:0/1216936466 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53c41f55e0 con 0x7f53c415dc90 2023-11-08T19:24:01.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.290+0000 7f53c9fd8700 1 -- 172.21.15.149:0/1216936466 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53c41f1860 con 0x7f53c415dc90 2023-11-08T19:24:01.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.291+0000 7f53abfff700 1 -- 172.21.15.149:0/1216936466 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f53bc01b7d0 con 0x7f53c415dc90 2023-11-08T19:24:01.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.291+0000 7f53c9fd8700 1 -- 172.21.15.149:0/1216936466 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53c41f1a20 con 0x7f53c415dc90 2023-11-08T19:24:01.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.291+0000 7f53abfff700 1 --2- 172.21.15.149:0/1216936466 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f53b006af00 0x7f53b006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:01.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.291+0000 7f53abfff700 1 -- 172.21.15.149:0/1216936466 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f53bc08b150 con 0x7f53c415dc90 2023-11-08T19:24:01.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.291+0000 7f53c37fe700 1 --2- 172.21.15.149:0/1216936466 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f53b006af00 0x7f53b006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:01.302 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.292+0000 7f53c37fe700 1 --2- 172.21.15.149:0/1216936466 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f53b006af00 0x7f53b006d3c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f53b8007fd0 tx=0x7f53b8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:01.302 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.296+0000 7f53abfff700 1 -- 172.21.15.149:0/1216936466 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f53bc055ed0 con 0x7f53c415dc90 2023-11-08T19:24:01.490 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.489+0000 7f53c9fd8700 1 -- 172.21.15.149:0/1216936466 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f53c41f1bd0 con 0x7f53c415dc90 2023-11-08T19:24:01.490 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.489+0000 7f53abfff700 1 -- 172.21.15.149:0/1216936466 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f53bc0594f0 con 0x7f53c415dc90 2023-11-08T19:24:01.491 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:24:01.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.491+0000 7f53c9fd8700 1 -- 172.21.15.149:0/1216936466 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f53b006af00 msgr2=0x7f53b006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:01.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.491+0000 7f53c9fd8700 1 --2- 172.21.15.149:0/1216936466 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f53b006af00 0x7f53b006d3c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f53b8007fd0 tx=0x7f53b8009040 comp rx=0 tx=0).stop 2023-11-08T19:24:01.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.491+0000 7f53c9fd8700 1 -- 172.21.15.149:0/1216936466 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53c415dc90 msgr2=0x7f53c41f2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:01.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.491+0000 7f53c9fd8700 1 --2- 172.21.15.149:0/1216936466 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53c415dc90 0x7f53c41f2760 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f53c406d0b0 tx=0x7f53bc004ad0 comp rx=0 tx=0).stop 2023-11-08T19:24:01.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.491+0000 7f53c9fd8700 1 -- 172.21.15.149:0/1216936466 shutdown_connections 2023-11-08T19:24:01.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.491+0000 7f53c9fd8700 1 --2- 172.21.15.149:0/1216936466 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f53b006af00 0x7f53b006d3c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:01.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.491+0000 7f53c9fd8700 1 --2- 172.21.15.149:0/1216936466 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53c415dc90 0x7f53c41f2760 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:01.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.491+0000 7f53c9fd8700 1 --2- 172.21.15.149:0/1216936466 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53c40ceae0 0x7f53c41f4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:01.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.491+0000 7f53c9fd8700 1 --2- 172.21.15.149:0/1216936466 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53c415a0e0 0x7f53c41f1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:01.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.491+0000 7f53c9fd8700 1 -- 172.21.15.149:0/1216936466 >> 172.21.15.149:0/1216936466 conn(0x7f53c40cc860 msgr2=0x7f53c40716e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:01.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.492+0000 7f53c9fd8700 1 -- 172.21.15.149:0/1216936466 shutdown_connections 2023-11-08T19:24:01.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.492+0000 7f53c9fd8700 1 -- 172.21.15.149:0/1216936466 wait complete. 2023-11-08T19:24:01.505 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-08T19:24:01.629 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.628+0000 7f3e386d7700 1 Processor -- start 2023-11-08T19:24:01.630 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.628+0000 7f3e386d7700 1 -- start start 2023-11-08T19:24:01.632 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.629+0000 7f3e386d7700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f3e3006ab80 0x7f3e300caf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:01.632 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.629+0000 7f3e386d7700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3e300cf1c0 0x7f3e300cb490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:01.633 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.629+0000 7f3e386d7700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e3015e320 con 0x7f3e3015df40 2023-11-08T19:24:01.633 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.629+0000 7f3e386d7700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e3006b020 con 0x7f3e300cf1c0 2023-11-08T19:24:01.633 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.629+0000 7f3e386d7700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e3006b2e0 con 0x7f3e3006ab80 2023-11-08T19:24:01.633 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.629+0000 7f3e36c74700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3e300cf1c0 0x7f3e300cb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:01.634 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.629+0000 7f3e36c74700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3e300cf1c0 0x7f3e300cb490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38824/0 (socket says 172.21.15.149:38824) 2023-11-08T19:24:01.634 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.629+0000 7f3e36c74700 1 -- 172.21.15.149:0/1434880708 learned_addr learned my addr 172.21.15.149:0/1434880708 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:01.634 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.629+0000 7f3e35c72700 1 --2- 172.21.15.149:0/1434880708 >> v2:172.21.15.160:3300/0 conn(0x7f3e3006ab80 0x7f3e300caf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:01.634 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.629+0000 7f3e36c74700 1 -- 172.21.15.149:0/1434880708 >> v2:172.21.15.160:3300/0 conn(0x7f3e3006ab80 msgr2=0x7f3e300caf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:01.634 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.629+0000 7f3e36c74700 1 --2- 172.21.15.149:0/1434880708 >> v2:172.21.15.160:3300/0 conn(0x7f3e3006ab80 0x7f3e300caf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:01.635 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.629+0000 7f3e36c74700 1 -- 172.21.15.149:0/1434880708 >> v1:172.21.15.160:6789/0 conn(0x7f3e3015df40 legacy=0x7f3e3006c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:01.635 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.629+0000 7f3e36c74700 1 -- 172.21.15.149:0/1434880708 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e3006b5c0 con 0x7f3e300cf1c0 2023-11-08T19:24:01.635 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.630+0000 7f3e36c74700 1 --2- 172.21.15.149:0/1434880708 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e300cf1c0 0x7f3e300cb490 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3e3006d940 tx=0x7f3e2800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b819ece1fbb8e95c server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:01.635 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.630+0000 7f3e35471700 1 -- 172.21.15.149:0/1434880708 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2800e070 con 0x7f3e300cf1c0 2023-11-08T19:24:01.636 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.630+0000 7f3e35471700 1 -- 172.21.15.149:0/1434880708 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e28003a20 con 0x7f3e300cf1c0 2023-11-08T19:24:01.636 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.630+0000 7f3e35471700 1 -- 172.21.15.149:0/1434880708 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e28003dd0 con 0x7f3e300cf1c0 2023-11-08T19:24:01.636 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.630+0000 7f3e386d7700 1 -- 172.21.15.149:0/1434880708 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e300cf1c0 msgr2=0x7f3e300cb490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:01.636 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.630+0000 7f3e386d7700 1 --2- 172.21.15.149:0/1434880708 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e300cf1c0 0x7f3e300cb490 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3e3006d940 tx=0x7f3e2800b330 comp rx=0 tx=0).stop 2023-11-08T19:24:01.636 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.630+0000 7f3e386d7700 1 -- 172.21.15.149:0/1434880708 shutdown_connections 2023-11-08T19:24:01.637 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.630+0000 7f3e386d7700 1 --2- 172.21.15.149:0/1434880708 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e300cf1c0 0x7f3e300cb490 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:01.637 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.630+0000 7f3e386d7700 1 --2- 172.21.15.149:0/1434880708 >> v2:172.21.15.160:3300/0 conn(0x7f3e3006ab80 0x7f3e300caf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:01.637 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.630+0000 7f3e386d7700 1 -- 172.21.15.149:0/1434880708 >> 172.21.15.149:0/1434880708 conn(0x7f3e300d0640 msgr2=0x7f3e300d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:01.637 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.630+0000 7f3e386d7700 1 -- 172.21.15.149:0/1434880708 shutdown_connections 2023-11-08T19:24:01.637 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.631+0000 7f3e386d7700 1 -- 172.21.15.149:0/1434880708 wait complete. 2023-11-08T19:24:01.640 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.632+0000 7f3e386d7700 1 Processor -- start 2023-11-08T19:24:01.640 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.632+0000 7f3e386d7700 1 -- start start 2023-11-08T19:24:01.640 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.632+0000 7f3e386d7700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3e3006ab80 0x7f3e30156cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:01.641 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.632+0000 7f3e386d7700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e300cf1c0 0x7f3e3015eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:01.641 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.632+0000 7f3e386d7700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3e3015df40 0x7f3e3015f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:01.641 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.632+0000 7f3e386d7700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e300c9060 con 0x7f3e300cf1c0 2023-11-08T19:24:01.641 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.632+0000 7f3e386d7700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e301f48a0 con 0x7f3e3015df40 2023-11-08T19:24:01.641 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.632+0000 7f3e386d7700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e300c86c0 con 0x7f3e3006ab80 2023-11-08T19:24:01.642 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.632+0000 7f3e35c72700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e300cf1c0 0x7f3e3015eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:01.642 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.633+0000 7f3e35c72700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e300cf1c0 0x7f3e3015eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38828/0 (socket says 172.21.15.149:38828) 2023-11-08T19:24:01.642 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.633+0000 7f3e35c72700 1 -- 172.21.15.149:0/838678570 learned_addr learned my addr 172.21.15.149:0/838678570 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:01.642 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.633+0000 7f3e35c72700 1 -- 172.21.15.149:0/838678570 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3e3006ab80 msgr2=0x7f3e30156cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:01.642 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.633+0000 7f3e35c72700 1 --2- 172.21.15.149:0/838678570 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3e3006ab80 0x7f3e30156cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:01.643 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.633+0000 7f3e35c72700 1 -- 172.21.15.149:0/838678570 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3e3015df40 msgr2=0x7f3e3015f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:01.643 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.633+0000 7f3e35c72700 1 --2- 172.21.15.149:0/838678570 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3e3015df40 0x7f3e3015f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:01.643 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.633+0000 7f3e35c72700 1 -- 172.21.15.149:0/838678570 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e28009b30 con 0x7f3e300cf1c0 2023-11-08T19:24:01.643 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.633+0000 7f3e35c72700 1 --2- 172.21.15.149:0/838678570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e300cf1c0 0x7f3e3015eea0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c00e810 tx=0x7f3e2c00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:01.643 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.633+0000 7f3e26ffd700 1 -- 172.21.15.149:0/838678570 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2c013610 con 0x7f3e300cf1c0 2023-11-08T19:24:01.644 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.633+0000 7f3e26ffd700 1 -- 172.21.15.149:0/838678570 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e2c013770 con 0x7f3e300cf1c0 2023-11-08T19:24:01.644 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.633+0000 7f3e386d7700 1 -- 172.21.15.149:0/838678570 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e300c89a0 con 0x7f3e300cf1c0 2023-11-08T19:24:01.644 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.633+0000 7f3e26ffd700 1 -- 172.21.15.149:0/838678570 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2c013b20 con 0x7f3e300cf1c0 2023-11-08T19:24:01.644 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.633+0000 7f3e386d7700 1 -- 172.21.15.149:0/838678570 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e301571f0 con 0x7f3e300cf1c0 2023-11-08T19:24:01.644 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.634+0000 7f3e386d7700 1 -- 172.21.15.149:0/838678570 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e3004f730 con 0x7f3e300cf1c0 2023-11-08T19:24:01.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.634+0000 7f3e26ffd700 1 -- 172.21.15.149:0/838678570 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3e2c013c80 con 0x7f3e300cf1c0 2023-11-08T19:24:01.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.635+0000 7f3e26ffd700 1 --2- 172.21.15.149:0/838678570 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3e1406af00 0x7f3e1406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:01.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.635+0000 7f3e26ffd700 1 -- 172.21.15.149:0/838678570 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3e2c0896d0 con 0x7f3e300cf1c0 2023-11-08T19:24:01.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.635+0000 7f3e36473700 1 --2- 172.21.15.149:0/838678570 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3e1406af00 0x7f3e1406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:01.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.635+0000 7f3e36473700 1 --2- 172.21.15.149:0/838678570 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3e1406af00 0x7f3e1406d3c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3e200096f0 tx=0x7f3e20006c50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:01.646 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.640+0000 7f3e26ffd700 1 -- 172.21.15.149:0/838678570 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3e2c0543d0 con 0x7f3e300cf1c0 2023-11-08T19:24:01.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.829+0000 7f3e386d7700 1 -- 172.21.15.149:0/838678570 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3e300720c0 con 0x7f3e300cf1c0 2023-11-08T19:24:01.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.830+0000 7f3e26ffd700 1 -- 172.21.15.149:0/838678570 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3e2c0579f0 con 0x7f3e300cf1c0 2023-11-08T19:24:01.832 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 64 2023-11-08T19:24:01.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.832+0000 7f3e386d7700 1 -- 172.21.15.149:0/838678570 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3e1406af00 msgr2=0x7f3e1406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:01.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.832+0000 7f3e386d7700 1 --2- 172.21.15.149:0/838678570 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3e1406af00 0x7f3e1406d3c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3e200096f0 tx=0x7f3e20006c50 comp rx=0 tx=0).stop 2023-11-08T19:24:01.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.832+0000 7f3e386d7700 1 -- 172.21.15.149:0/838678570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e300cf1c0 msgr2=0x7f3e3015eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:01.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.832+0000 7f3e386d7700 1 --2- 172.21.15.149:0/838678570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e300cf1c0 0x7f3e3015eea0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c00e810 tx=0x7f3e2c00ebd0 comp rx=0 tx=0).stop 2023-11-08T19:24:01.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.832+0000 7f3e386d7700 1 -- 172.21.15.149:0/838678570 shutdown_connections 2023-11-08T19:24:01.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.832+0000 7f3e386d7700 1 --2- 172.21.15.149:0/838678570 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3e1406af00 0x7f3e1406d3c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:01.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.832+0000 7f3e386d7700 1 --2- 172.21.15.149:0/838678570 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3e3015df40 0x7f3e3015f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:01.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.832+0000 7f3e386d7700 1 --2- 172.21.15.149:0/838678570 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3e3006ab80 0x7f3e30156cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:01.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.832+0000 7f3e386d7700 1 --2- 172.21.15.149:0/838678570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e300cf1c0 0x7f3e3015eea0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:01.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.832+0000 7f3e386d7700 1 -- 172.21.15.149:0/838678570 >> 172.21.15.149:0/838678570 conn(0x7f3e300d0640 msgr2=0x7f3e300c38a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:01.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.832+0000 7f3e386d7700 1 -- 172.21.15.149:0/838678570 shutdown_connections 2023-11-08T19:24:01.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.832+0000 7f3e386d7700 1 -- 172.21.15.149:0/838678570 wait complete. 2023-11-08T19:24:01.846 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-08T19:24:01.969 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.968+0000 7fd49a41d700 1 Processor -- start 2023-11-08T19:24:01.970 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.968+0000 7fd49a41d700 1 -- start start 2023-11-08T19:24:01.972 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.969+0000 7fd49a41d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd4940cc0d0 0x7fd49415f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:01.973 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.969+0000 7fd49a41d700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd49415be80 con 0x7fd4940cc4b0 2023-11-08T19:24:01.973 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.969+0000 7fd49a41d700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd49415fba0 con 0x7fd4940cc910 2023-11-08T19:24:01.973 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.969+0000 7fd49a41d700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd49415f9b0 con 0x7fd4940cc0d0 2023-11-08T19:24:01.973 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.969+0000 7fd493fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd4940cc0d0 0x7fd49415f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:01.974 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.969+0000 7fd493fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd4940cc0d0 0x7fd49415f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38834/0 (socket says 172.21.15.149:38834) 2023-11-08T19:24:01.974 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.969+0000 7fd493fff700 1 -- 172.21.15.149:0/735194931 learned_addr learned my addr 172.21.15.149:0/735194931 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:01.974 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.969+0000 7fd4937fe700 1 --1- 172.21.15.149:0/735194931 >> v1:172.21.15.149:6789/0 conn(0x7fd4940cc4b0 0x7fd49415c620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:40836/0 (socket says 172.21.15.149:40836) 2023-11-08T19:24:01.974 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.969+0000 7fd493fff700 1 -- 172.21.15.149:0/735194931 >> v1:172.21.15.160:6789/0 conn(0x7fd4940cc910 legacy=0x7fd4940cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:01.975 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.969+0000 7fd493fff700 1 -- 172.21.15.149:0/735194931 >> v1:172.21.15.149:6789/0 conn(0x7fd4940cc4b0 legacy=0x7fd49415c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:01.975 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.969+0000 7fd493fff700 1 -- 172.21.15.149:0/735194931 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd49415fe80 con 0x7fd4940cc0d0 2023-11-08T19:24:01.975 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.969+0000 7fd493fff700 1 --2- 172.21.15.149:0/735194931 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4940cc0d0 0x7fd49415f470 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd4880098f0 tx=0x7fd488009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9777439750127734 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:01.975 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.969+0000 7fd492ffd700 1 -- 172.21.15.149:0/735194931 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd488004230 con 0x7fd4940cc0d0 2023-11-08T19:24:01.975 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.970+0000 7fd492ffd700 1 -- 172.21.15.149:0/735194931 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd488004390 con 0x7fd4940cc0d0 2023-11-08T19:24:01.976 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.970+0000 7fd492ffd700 1 -- 172.21.15.149:0/735194931 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4880036a0 con 0x7fd4940cc0d0 2023-11-08T19:24:01.976 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.970+0000 7fd49a41d700 1 -- 172.21.15.149:0/735194931 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4940cc0d0 msgr2=0x7fd49415f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:01.976 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.970+0000 7fd49a41d700 1 --2- 172.21.15.149:0/735194931 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4940cc0d0 0x7fd49415f470 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd4880098f0 tx=0x7fd488009c00 comp rx=0 tx=0).stop 2023-11-08T19:24:01.976 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.970+0000 7fd49a41d700 1 -- 172.21.15.149:0/735194931 shutdown_connections 2023-11-08T19:24:01.977 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.970+0000 7fd49a41d700 1 --2- 172.21.15.149:0/735194931 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4940cc0d0 0x7fd49415f470 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:01.977 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.970+0000 7fd49a41d700 1 -- 172.21.15.149:0/735194931 >> 172.21.15.149:0/735194931 conn(0x7fd49406f120 msgr2=0x7fd49406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:01.977 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.970+0000 7fd49a41d700 1 -- 172.21.15.149:0/735194931 shutdown_connections 2023-11-08T19:24:01.977 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.970+0000 7fd49a41d700 1 -- 172.21.15.149:0/735194931 wait complete. 2023-11-08T19:24:01.977 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.971+0000 7fd49a41d700 1 Processor -- start 2023-11-08T19:24:01.977 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.971+0000 7fd49a41d700 1 -- start start 2023-11-08T19:24:01.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.972+0000 7fd49a41d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd4940cc0d0 0x7fd4940c5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:01.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.972+0000 7fd49a41d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4940cc4b0 0x7fd4940b5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:01.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.972+0000 7fd49a41d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd4940cc910 0x7fd4940c5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:01.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.972+0000 7fd49a41d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4941f1700 con 0x7fd4940cc4b0 2023-11-08T19:24:01.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.972+0000 7fd49a41d700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4941f19e0 con 0x7fd4940cc910 2023-11-08T19:24:01.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.972+0000 7fd49a41d700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4941f1cc0 con 0x7fd4940cc0d0 2023-11-08T19:24:01.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.972+0000 7fd4937fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4940cc4b0 0x7fd4940b5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:01.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.972+0000 7fd4937fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4940cc4b0 0x7fd4940b5630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38840/0 (socket says 172.21.15.149:38840) 2023-11-08T19:24:01.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.972+0000 7fd4937fe700 1 -- 172.21.15.149:0/2439403379 learned_addr learned my addr 172.21.15.149:0/2439403379 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:01.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.972+0000 7fd493fff700 1 --2- 172.21.15.149:0/2439403379 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd4940cc0d0 0x7fd4940c5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:01.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.972+0000 7fd4989ba700 1 --2- 172.21.15.149:0/2439403379 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd4940cc910 0x7fd4940c5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:01.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.973+0000 7fd4937fe700 1 -- 172.21.15.149:0/2439403379 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd4940cc0d0 msgr2=0x7fd4940c5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:01.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.973+0000 7fd4937fe700 1 --2- 172.21.15.149:0/2439403379 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd4940cc0d0 0x7fd4940c5280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:01.983 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.973+0000 7fd4937fe700 1 -- 172.21.15.149:0/2439403379 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd4940cc910 msgr2=0x7fd4940c5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:01.983 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.973+0000 7fd4937fe700 1 --2- 172.21.15.149:0/2439403379 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd4940cc910 0x7fd4940c5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:01.983 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.973+0000 7fd4937fe700 1 -- 172.21.15.149:0/2439403379 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd488009550 con 0x7fd4940cc4b0 2023-11-08T19:24:01.983 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.973+0000 7fd4937fe700 1 --2- 172.21.15.149:0/2439403379 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4940cc4b0 0x7fd4940b5630 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd48400c520 tx=0x7fd48400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:01.983 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.973+0000 7fd490ff9700 1 -- 172.21.15.149:0/2439403379 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd484005cb0 con 0x7fd4940cc4b0 2023-11-08T19:24:01.984 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.973+0000 7fd490ff9700 1 -- 172.21.15.149:0/2439403379 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd484005e10 con 0x7fd4940cc4b0 2023-11-08T19:24:01.984 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.973+0000 7fd490ff9700 1 -- 172.21.15.149:0/2439403379 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4840072d0 con 0x7fd4940cc4b0 2023-11-08T19:24:01.984 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.973+0000 7fd49a41d700 1 -- 172.21.15.149:0/2439403379 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4941f1fa0 con 0x7fd4940cc4b0 2023-11-08T19:24:01.984 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.973+0000 7fd49a41d700 1 -- 172.21.15.149:0/2439403379 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4940b3b30 con 0x7fd4940cc4b0 2023-11-08T19:24:01.984 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.974+0000 7fd49a41d700 1 -- 172.21.15.149:0/2439403379 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4940b3cf0 con 0x7fd4940cc4b0 2023-11-08T19:24:01.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.974+0000 7fd490ff9700 1 -- 172.21.15.149:0/2439403379 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd484007430 con 0x7fd4940cc4b0 2023-11-08T19:24:01.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.975+0000 7fd490ff9700 1 --2- 172.21.15.149:0/2439403379 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd48006af00 0x7fd48006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:01.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.975+0000 7fd490ff9700 1 -- 172.21.15.149:0/2439403379 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd484088c30 con 0x7fd4940cc4b0 2023-11-08T19:24:01.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.975+0000 7fd493fff700 1 --2- 172.21.15.149:0/2439403379 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd48006af00 0x7fd48006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:01.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.975+0000 7fd493fff700 1 --2- 172.21.15.149:0/2439403379 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd48006af00 0x7fd48006d3c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd488009130 tx=0x7fd488008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:01.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:01.980+0000 7fd490ff9700 1 -- 172.21.15.149:0/2439403379 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd4940b3cf0 con 0x7fd4940cc4b0 2023-11-08T19:24:02.169 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.168+0000 7fd49a41d700 1 -- 172.21.15.149:0/2439403379 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd4940b3cf0 con 0x7fd4940cc4b0 2023-11-08T19:24:02.170 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.168+0000 7fd490ff9700 1 -- 172.21.15.149:0/2439403379 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd4940b3cf0 con 0x7fd4940cc4b0 2023-11-08T19:24:02.170 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:24:02.172 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.171+0000 7fd49a41d700 1 -- 172.21.15.149:0/2439403379 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd48006af00 msgr2=0x7fd48006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:02.172 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.171+0000 7fd49a41d700 1 --2- 172.21.15.149:0/2439403379 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd48006af00 0x7fd48006d3c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd488009130 tx=0x7fd488008030 comp rx=0 tx=0).stop 2023-11-08T19:24:02.173 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.171+0000 7fd49a41d700 1 -- 172.21.15.149:0/2439403379 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4940cc4b0 msgr2=0x7fd4940b5630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:02.173 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.171+0000 7fd49a41d700 1 --2- 172.21.15.149:0/2439403379 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4940cc4b0 0x7fd4940b5630 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd48400c520 tx=0x7fd48400c830 comp rx=0 tx=0).stop 2023-11-08T19:24:02.173 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.171+0000 7fd49a41d700 1 -- 172.21.15.149:0/2439403379 shutdown_connections 2023-11-08T19:24:02.173 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.171+0000 7fd49a41d700 1 --2- 172.21.15.149:0/2439403379 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd48006af00 0x7fd48006d3c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:02.173 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.171+0000 7fd49a41d700 1 --2- 172.21.15.149:0/2439403379 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd4940cc910 0x7fd4940c5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:02.174 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.171+0000 7fd49a41d700 1 --2- 172.21.15.149:0/2439403379 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd4940cc0d0 0x7fd4940c5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:02.174 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.171+0000 7fd49a41d700 1 --2- 172.21.15.149:0/2439403379 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4940cc4b0 0x7fd4940b5630 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:02.174 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.171+0000 7fd49a41d700 1 -- 172.21.15.149:0/2439403379 >> 172.21.15.149:0/2439403379 conn(0x7fd49406f120 msgr2=0x7fd49415a950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:02.174 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.171+0000 7fd49a41d700 1 -- 172.21.15.149:0/2439403379 shutdown_connections 2023-11-08T19:24:02.174 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.171+0000 7fd49a41d700 1 -- 172.21.15.149:0/2439403379 wait complete. 2023-11-08T19:24:02.184 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:24:02.304 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.303+0000 7ff94cad0700 1 Processor -- start 2023-11-08T19:24:02.305 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.303+0000 7ff94cad0700 1 -- start start 2023-11-08T19:24:02.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.304+0000 7ff94cad0700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff94815b150 0x7ff9480ccfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:02.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.304+0000 7ff94cad0700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff9480b0ee0 0x7ff9480b1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:02.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.304+0000 7ff94cad0700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9480b1880 con 0x7ff94815b530 2023-11-08T19:24:02.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.304+0000 7ff94cad0700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9480ce3b0 con 0x7ff9480b0ee0 2023-11-08T19:24:02.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.304+0000 7ff94cad0700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9480cd5f0 con 0x7ff94815b150 2023-11-08T19:24:02.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.304+0000 7ff946d9d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff9480b0ee0 0x7ff9480b1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:02.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.304+0000 7ff946d9d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff9480b0ee0 0x7ff9480b1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38850/0 (socket says 172.21.15.149:38850) 2023-11-08T19:24:02.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.304+0000 7ff946d9d700 1 -- 172.21.15.149:0/3530530065 learned_addr learned my addr 172.21.15.149:0/3530530065 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:02.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.304+0000 7ff94659c700 1 --2- 172.21.15.149:0/3530530065 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff94815b150 0x7ff9480ccfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:02.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.305+0000 7ff946d9d700 1 -- 172.21.15.149:0/3530530065 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff94815b150 msgr2=0x7ff9480ccfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:02.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.305+0000 7ff946d9d700 1 --2- 172.21.15.149:0/3530530065 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff94815b150 0x7ff9480ccfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:02.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.305+0000 7ff946d9d700 1 -- 172.21.15.149:0/3530530065 >> v1:172.21.15.160:6789/0 conn(0x7ff94815b530 legacy=0x7ff948071f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:02.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.305+0000 7ff946d9d700 1 -- 172.21.15.149:0/3530530065 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9480cd8d0 con 0x7ff9480b0ee0 2023-11-08T19:24:02.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.305+0000 7ff946d9d700 1 --2- 172.21.15.149:0/3530530065 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9480b0ee0 0x7ff9480b1340 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ff94000d150 tx=0x7ff94000d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c014bcac22a2ea7 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:02.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.305+0000 7ff94559a700 1 -- 172.21.15.149:0/3530530065 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff940010070 con 0x7ff9480b0ee0 2023-11-08T19:24:02.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.305+0000 7ff94559a700 1 -- 172.21.15.149:0/3530530065 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff94000dd10 con 0x7ff9480b0ee0 2023-11-08T19:24:02.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.305+0000 7ff94559a700 1 -- 172.21.15.149:0/3530530065 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94000b310 con 0x7ff9480b0ee0 2023-11-08T19:24:02.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.305+0000 7ff94cad0700 1 -- 172.21.15.149:0/3530530065 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9480b0ee0 msgr2=0x7ff9480b1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:02.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.305+0000 7ff94cad0700 1 --2- 172.21.15.149:0/3530530065 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9480b0ee0 0x7ff9480b1340 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ff94000d150 tx=0x7ff94000d460 comp rx=0 tx=0).stop 2023-11-08T19:24:02.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.306+0000 7ff94cad0700 1 -- 172.21.15.149:0/3530530065 shutdown_connections 2023-11-08T19:24:02.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.306+0000 7ff94cad0700 1 --2- 172.21.15.149:0/3530530065 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9480b0ee0 0x7ff9480b1340 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:02.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.306+0000 7ff94cad0700 1 --2- 172.21.15.149:0/3530530065 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff94815b150 0x7ff9480ccfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:02.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.306+0000 7ff94cad0700 1 -- 172.21.15.149:0/3530530065 >> 172.21.15.149:0/3530530065 conn(0x7ff94806b3d0 msgr2=0x7ff9480cf460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:02.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.306+0000 7ff94cad0700 1 -- 172.21.15.149:0/3530530065 shutdown_connections 2023-11-08T19:24:02.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.306+0000 7ff94cad0700 1 -- 172.21.15.149:0/3530530065 wait complete. 2023-11-08T19:24:02.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.307+0000 7ff94cad0700 1 Processor -- start 2023-11-08T19:24:02.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.307+0000 7ff94cad0700 1 -- start start 2023-11-08T19:24:02.317 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.308+0000 7ff94cad0700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9480b0ee0 0x7ff9481599e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:02.317 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.308+0000 7ff94cad0700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff94815b150 0x7ff94815e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:02.317 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.308+0000 7ff94cad0700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff94815b530 0x7ff94815e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:02.317 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.308+0000 7ff94cad0700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9481472d0 con 0x7ff9480b0ee0 2023-11-08T19:24:02.317 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.308+0000 7ff94cad0700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff948146700 con 0x7ff94815b150 2023-11-08T19:24:02.318 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.308+0000 7ff94cad0700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff94815ed90 con 0x7ff94815b530 2023-11-08T19:24:02.318 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.308+0000 7ff94659c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9480b0ee0 0x7ff9481599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:02.318 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.308+0000 7ff94659c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9480b0ee0 0x7ff9481599e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38852/0 (socket says 172.21.15.149:38852) 2023-11-08T19:24:02.318 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.308+0000 7ff94659c700 1 -- 172.21.15.149:0/2183476848 learned_addr learned my addr 172.21.15.149:0/2183476848 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:02.319 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.308+0000 7ff946d9d700 1 --2- 172.21.15.149:0/2183476848 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff94815b530 0x7ff94815e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:02.319 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.308+0000 7ff945d9b700 1 --2- 172.21.15.149:0/2183476848 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff94815b150 0x7ff94815e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:02.319 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.308+0000 7ff94659c700 1 -- 172.21.15.149:0/2183476848 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff94815b530 msgr2=0x7ff94815e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:02.319 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.308+0000 7ff94659c700 1 --2- 172.21.15.149:0/2183476848 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff94815b530 0x7ff94815e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:02.320 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.308+0000 7ff94659c700 1 -- 172.21.15.149:0/2183476848 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff94815b150 msgr2=0x7ff94815e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:02.320 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.308+0000 7ff94659c700 1 --2- 172.21.15.149:0/2183476848 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff94815b150 0x7ff94815e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:02.320 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.308+0000 7ff94659c700 1 -- 172.21.15.149:0/2183476848 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff94000bd40 con 0x7ff9480b0ee0 2023-11-08T19:24:02.320 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.308+0000 7ff946d9d700 1 --2- 172.21.15.149:0/2183476848 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff94815b530 0x7ff94815e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:24:02.320 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.308+0000 7ff945d9b700 1 --2- 172.21.15.149:0/2183476848 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff94815b150 0x7ff94815e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:24:02.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.308+0000 7ff94659c700 1 --2- 172.21.15.149:0/2183476848 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9480b0ee0 0x7ff9481599e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff93c00e9b0 tx=0x7ff93c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:02.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.308+0000 7ff936ffd700 1 -- 172.21.15.149:0/2183476848 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93c009710 con 0x7ff9480b0ee0 2023-11-08T19:24:02.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.308+0000 7ff936ffd700 1 -- 172.21.15.149:0/2183476848 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff93c00c850 con 0x7ff9480b0ee0 2023-11-08T19:24:02.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.308+0000 7ff94cad0700 1 -- 172.21.15.149:0/2183476848 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9481469a0 con 0x7ff9480b0ee0 2023-11-08T19:24:02.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.308+0000 7ff936ffd700 1 -- 172.21.15.149:0/2183476848 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93c00cbc0 con 0x7ff9480b0ee0 2023-11-08T19:24:02.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.308+0000 7ff94cad0700 1 -- 172.21.15.149:0/2183476848 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff948146f60 con 0x7ff9480b0ee0 2023-11-08T19:24:02.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.309+0000 7ff94cad0700 1 -- 172.21.15.149:0/2183476848 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9480745f0 con 0x7ff9480b0ee0 2023-11-08T19:24:02.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.310+0000 7ff936ffd700 1 -- 172.21.15.149:0/2183476848 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff93c00cd20 con 0x7ff9480b0ee0 2023-11-08T19:24:02.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.310+0000 7ff936ffd700 1 --2- 172.21.15.149:0/2183476848 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff92806af00 0x7ff92806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:02.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.310+0000 7ff945d9b700 1 --2- 172.21.15.149:0/2183476848 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff92806af00 0x7ff92806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:02.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.310+0000 7ff936ffd700 1 -- 172.21.15.149:0/2183476848 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff93c089a70 con 0x7ff9480b0ee0 2023-11-08T19:24:02.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.311+0000 7ff945d9b700 1 --2- 172.21.15.149:0/2183476848 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff92806af00 0x7ff92806d3c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff9480af200 tx=0x7ff938009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:02.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.315+0000 7ff936ffd700 1 -- 172.21.15.149:0/2183476848 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff93c0547f0 con 0x7ff9480b0ee0 2023-11-08T19:24:02.551 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.550+0000 7ff94cad0700 1 -- 172.21.15.149:0/2183476848 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff9480c2ce0 con 0x7ff9480b0ee0 2023-11-08T19:24:02.551 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.550+0000 7ff936ffd700 1 -- 172.21.15.149:0/2183476848 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4921 (secure 0 0 0) 0x7ff93c057e10 con 0x7ff9480b0ee0 2023-11-08T19:24:02.552 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:24:02.552 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4252,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/2277605177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":2277605177},{"type":"v1","addr":"172.21.15.149:6837","nonce":2277605177}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/2774257644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2774257644},{"type":"v1","addr":"172.21.15.149:6836","nonce":2774257644}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/2076428669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":2076428669},{"type":"v1","addr":"172.21.15.160:6835","nonce":2076428669}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-08T19:23:01.918138+0000","modified":"2023-11-08T19:23:19.490960+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.160:6834/3847116435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3847116435},{"type":"v1","addr":"172.21.15.160:6834","nonce":3847116435}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-08T19:24:02.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.552+0000 7ff94cad0700 1 -- 172.21.15.149:0/2183476848 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff92806af00 msgr2=0x7ff92806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:02.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.552+0000 7ff94cad0700 1 --2- 172.21.15.149:0/2183476848 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff92806af00 0x7ff92806d3c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff9480af200 tx=0x7ff938009040 comp rx=0 tx=0).stop 2023-11-08T19:24:02.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.552+0000 7ff94cad0700 1 -- 172.21.15.149:0/2183476848 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9480b0ee0 msgr2=0x7ff9481599e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:02.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.552+0000 7ff94cad0700 1 --2- 172.21.15.149:0/2183476848 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9480b0ee0 0x7ff9481599e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff93c00e9b0 tx=0x7ff93c00ed70 comp rx=0 tx=0).stop 2023-11-08T19:24:02.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.552+0000 7ff94cad0700 1 -- 172.21.15.149:0/2183476848 shutdown_connections 2023-11-08T19:24:02.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.552+0000 7ff94cad0700 1 --2- 172.21.15.149:0/2183476848 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff92806af00 0x7ff92806d3c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:02.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.552+0000 7ff94cad0700 1 --2- 172.21.15.149:0/2183476848 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff94815b530 0x7ff94815e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:02.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.552+0000 7ff94cad0700 1 --2- 172.21.15.149:0/2183476848 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9480b0ee0 0x7ff9481599e0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:02.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.552+0000 7ff94cad0700 1 --2- 172.21.15.149:0/2183476848 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff94815b150 0x7ff94815e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:02.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.552+0000 7ff94cad0700 1 -- 172.21.15.149:0/2183476848 >> 172.21.15.149:0/2183476848 conn(0x7ff94806b3d0 msgr2=0x7ff9480b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:02.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.552+0000 7ff94cad0700 1 -- 172.21.15.149:0/2183476848 shutdown_connections 2023-11-08T19:24:02.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.552+0000 7ff94cad0700 1 -- 172.21.15.149:0/2183476848 wait complete. 2023-11-08T19:24:02.556 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 9 2023-11-08T19:24:02.566 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:24:02.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.689+0000 7f7d6e177700 1 Processor -- start 2023-11-08T19:24:02.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.689+0000 7f7d6e177700 1 -- start start 2023-11-08T19:24:02.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.689+0000 7f7d6e177700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f7d680cc910 0x7f7d680cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:02.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.689+0000 7f7d6e177700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f7d680cb130 0x7f7d6815d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:02.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.689+0000 7f7d6e177700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d680b2f60 con 0x7f7d680cc140 2023-11-08T19:24:02.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.689+0000 7f7d6e177700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d680b2430 con 0x7f7d680cb130 2023-11-08T19:24:02.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.689+0000 7f7d6e177700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d680cc520 con 0x7f7d680cc910 2023-11-08T19:24:02.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.690+0000 7f7d67fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f7d680cb130 0x7f7d6815d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:02.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.690+0000 7f7d67fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f7d680cb130 0x7f7d6815d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38862/0 (socket says 172.21.15.149:38862) 2023-11-08T19:24:02.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.690+0000 7f7d67fff700 1 -- 172.21.15.149:0/3177918906 learned_addr learned my addr 172.21.15.149:0/3177918906 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:02.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.690+0000 7f7d66ffd700 1 --2- 172.21.15.149:0/3177918906 >> v2:172.21.15.160:3300/0 conn(0x7f7d680cc910 0x7f7d680cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:02.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.690+0000 7f7d67fff700 1 -- 172.21.15.149:0/3177918906 >> v2:172.21.15.160:3300/0 conn(0x7f7d680cc910 msgr2=0x7f7d680cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:02.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.690+0000 7f7d67fff700 1 --2- 172.21.15.149:0/3177918906 >> v2:172.21.15.160:3300/0 conn(0x7f7d680cc910 0x7f7d680cabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:02.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.690+0000 7f7d67fff700 1 -- 172.21.15.149:0/3177918906 >> v1:172.21.15.160:6789/0 conn(0x7f7d680cc140 legacy=0x7f7d680b2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:02.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.690+0000 7f7d67fff700 1 -- 172.21.15.149:0/3177918906 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d680cb5e0 con 0x7f7d680cb130 2023-11-08T19:24:02.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.690+0000 7f7d67fff700 1 --2- 172.21.15.149:0/3177918906 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d680cb130 0x7f7d6815d2b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7d680b1330 tx=0x7f7d6000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ea22c1c97745aee server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:02.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.690+0000 7f7d667fc700 1 -- 172.21.15.149:0/3177918906 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6000e070 con 0x7f7d680cb130 2023-11-08T19:24:02.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.690+0000 7f7d667fc700 1 -- 172.21.15.149:0/3177918906 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d60003a20 con 0x7f7d680cb130 2023-11-08T19:24:02.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.690+0000 7f7d667fc700 1 -- 172.21.15.149:0/3177918906 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d60003dd0 con 0x7f7d680cb130 2023-11-08T19:24:02.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.691+0000 7f7d6e177700 1 -- 172.21.15.149:0/3177918906 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d680cb130 msgr2=0x7f7d6815d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:02.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.691+0000 7f7d6e177700 1 --2- 172.21.15.149:0/3177918906 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d680cb130 0x7f7d6815d2b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7d680b1330 tx=0x7f7d6000b330 comp rx=0 tx=0).stop 2023-11-08T19:24:02.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.691+0000 7f7d6e177700 1 -- 172.21.15.149:0/3177918906 shutdown_connections 2023-11-08T19:24:02.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.691+0000 7f7d6e177700 1 --2- 172.21.15.149:0/3177918906 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d680cb130 0x7f7d6815d2b0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:02.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.691+0000 7f7d6e177700 1 --2- 172.21.15.149:0/3177918906 >> v2:172.21.15.160:3300/0 conn(0x7f7d680cc910 0x7f7d680cabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:02.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.691+0000 7f7d6e177700 1 -- 172.21.15.149:0/3177918906 >> 172.21.15.149:0/3177918906 conn(0x7f7d68099a40 msgr2=0x7f7d680d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:02.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.691+0000 7f7d6e177700 1 -- 172.21.15.149:0/3177918906 shutdown_connections 2023-11-08T19:24:02.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.691+0000 7f7d6e177700 1 -- 172.21.15.149:0/3177918906 wait complete. 2023-11-08T19:24:02.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.692+0000 7f7d6e177700 1 Processor -- start 2023-11-08T19:24:02.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.693+0000 7f7d6e177700 1 -- start start 2023-11-08T19:24:02.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.693+0000 7f7d6e177700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7d680cb130 0x7f7d6806fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:02.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.693+0000 7f7d6e177700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7d680cc140 0x7f7d6809c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:02.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.693+0000 7f7d6e177700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d680cc910 0x7f7d6809dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:02.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.693+0000 7f7d6e177700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d68155da0 con 0x7f7d680cc910 2023-11-08T19:24:02.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.693+0000 7f7d6e177700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6809cc80 con 0x7f7d680cc140 2023-11-08T19:24:02.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.693+0000 7f7d6e177700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6809cf60 con 0x7f7d680cb130 2023-11-08T19:24:02.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.694+0000 7f7d67fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d680cc910 0x7f7d6809dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:02.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.694+0000 7f7d67fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d680cc910 0x7f7d6809dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38868/0 (socket says 172.21.15.149:38868) 2023-11-08T19:24:02.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.694+0000 7f7d67fff700 1 -- 172.21.15.149:0/3411450135 learned_addr learned my addr 172.21.15.149:0/3411450135 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:02.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.694+0000 7f7d677fe700 1 --2- 172.21.15.149:0/3411450135 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7d680cb130 0x7f7d6806fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:02.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.694+0000 7f7d66ffd700 1 --2- 172.21.15.149:0/3411450135 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7d680cc140 0x7f7d6809c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:02.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.694+0000 7f7d67fff700 1 -- 172.21.15.149:0/3411450135 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7d680cb130 msgr2=0x7f7d6806fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:02.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.694+0000 7f7d67fff700 1 --2- 172.21.15.149:0/3411450135 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7d680cb130 0x7f7d6806fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:02.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.694+0000 7f7d67fff700 1 -- 172.21.15.149:0/3411450135 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7d680cc140 msgr2=0x7f7d6809c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:02.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.694+0000 7f7d67fff700 1 --2- 172.21.15.149:0/3411450135 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7d680cc140 0x7f7d6809c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:02.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.694+0000 7f7d67fff700 1 -- 172.21.15.149:0/3411450135 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d60009b30 con 0x7f7d680cc910 2023-11-08T19:24:02.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.694+0000 7f7d677fe700 1 --2- 172.21.15.149:0/3411450135 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7d680cb130 0x7f7d6806fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:24:02.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.694+0000 7f7d67fff700 1 --2- 172.21.15.149:0/3411450135 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d680cc910 0x7f7d6809dd20 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f7d6000b370 tx=0x7f7d60004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:02.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.694+0000 7f7d4ffff700 1 -- 172.21.15.149:0/3411450135 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d60004240 con 0x7f7d680cc910 2023-11-08T19:24:02.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.694+0000 7f7d4ffff700 1 -- 172.21.15.149:0/3411450135 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d600043a0 con 0x7f7d680cc910 2023-11-08T19:24:02.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.694+0000 7f7d6e177700 1 -- 172.21.15.149:0/3411450135 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d6809d240 con 0x7f7d680cc910 2023-11-08T19:24:02.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.694+0000 7f7d4ffff700 1 -- 172.21.15.149:0/3411450135 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d60004750 con 0x7f7d680cc910 2023-11-08T19:24:02.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.694+0000 7f7d6e177700 1 -- 172.21.15.149:0/3411450135 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d6809d800 con 0x7f7d680cc910 2023-11-08T19:24:02.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.695+0000 7f7d6e177700 1 -- 172.21.15.149:0/3411450135 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d680745f0 con 0x7f7d680cc910 2023-11-08T19:24:02.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.696+0000 7f7d4ffff700 1 -- 172.21.15.149:0/3411450135 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7d60019070 con 0x7f7d680cc910 2023-11-08T19:24:02.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.696+0000 7f7d4ffff700 1 --2- 172.21.15.149:0/3411450135 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f7d5406af00 0x7f7d5406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:02.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.696+0000 7f7d4ffff700 1 -- 172.21.15.149:0/3411450135 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7d6008a880 con 0x7f7d680cc910 2023-11-08T19:24:02.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.696+0000 7f7d677fe700 1 --2- 172.21.15.149:0/3411450135 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f7d5406af00 0x7f7d5406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:02.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.696+0000 7f7d677fe700 1 --2- 172.21.15.149:0/3411450135 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f7d5406af00 0x7f7d5406d3c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7d58003f80 tx=0x7f7d58009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:02.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.701+0000 7f7d4ffff700 1 -- 172.21.15.149:0/3411450135 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7d60055600 con 0x7f7d680cc910 2023-11-08T19:24:02.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.892+0000 7f7d6e177700 1 -- 172.21.15.149:0/3411450135 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7d680b1790 con 0x7f7d680cc910 2023-11-08T19:24:02.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.893+0000 7f7d4ffff700 1 -- 172.21.15.149:0/3411450135 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18770 (secure 0 0 0) 0x7f7d680b1790 con 0x7f7d680cc910 2023-11-08T19:24:02.895 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:24:02.895 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":26,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:23:51.355959+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-08T19:22:59.830928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-08T19:23:00.886589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-08T19:23:04.574033+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":1}]},{"pgid":"3.14","mappings":[{"from":4,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:24:02.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.895+0000 7f7d6e177700 1 -- 172.21.15.149:0/3411450135 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f7d5406af00 msgr2=0x7f7d5406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:02.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.895+0000 7f7d6e177700 1 --2- 172.21.15.149:0/3411450135 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f7d5406af00 0x7f7d5406d3c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7d58003f80 tx=0x7f7d58009040 comp rx=0 tx=0).stop 2023-11-08T19:24:02.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.895+0000 7f7d6e177700 1 -- 172.21.15.149:0/3411450135 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d680cc910 msgr2=0x7f7d6809dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:02.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.895+0000 7f7d6e177700 1 --2- 172.21.15.149:0/3411450135 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d680cc910 0x7f7d6809dd20 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f7d6000b370 tx=0x7f7d60004ad0 comp rx=0 tx=0).stop 2023-11-08T19:24:02.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.895+0000 7f7d6e177700 1 -- 172.21.15.149:0/3411450135 shutdown_connections 2023-11-08T19:24:02.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.895+0000 7f7d6e177700 1 --2- 172.21.15.149:0/3411450135 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f7d5406af00 0x7f7d5406d3c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:02.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.895+0000 7f7d6e177700 1 --2- 172.21.15.149:0/3411450135 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d680cc910 0x7f7d6809dd20 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:02.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.895+0000 7f7d6e177700 1 --2- 172.21.15.149:0/3411450135 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7d680cb130 0x7f7d6806fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:02.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.895+0000 7f7d6e177700 1 --2- 172.21.15.149:0/3411450135 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7d680cc140 0x7f7d6809c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:02.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.895+0000 7f7d6e177700 1 -- 172.21.15.149:0/3411450135 >> 172.21.15.149:0/3411450135 conn(0x7f7d68099a40 msgr2=0x7f7d680c7670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:02.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.896+0000 7f7d6e177700 1 -- 172.21.15.149:0/3411450135 shutdown_connections 2023-11-08T19:24:02.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:02.896+0000 7f7d6e177700 1 -- 172.21.15.149:0/3411450135 wait complete. 2023-11-08T19:24:02.909 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-08T19:24:02.910 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:24:03.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.030+0000 7f24c5460700 1 Processor -- start 2023-11-08T19:24:03.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.030+0000 7f24c5460700 1 -- start start 2023-11-08T19:24:03.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.030+0000 7f24c5460700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f24c00b4730 0x7f24c00b0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:03.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.030+0000 7f24c5460700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24c00716c0 con 0x7f24c00b4c80 2023-11-08T19:24:03.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.030+0000 7f24c5460700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24c0160280 con 0x7f24c015b790 2023-11-08T19:24:03.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.030+0000 7f24c5460700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24c015f440 con 0x7f24c00b4730 2023-11-08T19:24:03.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.031+0000 7f24bf7fe700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f24c00b4c80 0x7f24c00c9f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:40878/0 (socket says 172.21.15.149:40878) 2023-11-08T19:24:03.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.031+0000 7f24bf7fe700 1 -- 172.21.15.149:0/558290063 learned_addr learned my addr 172.21.15.149:0/558290063 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:24:03.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.031+0000 7f24be7fc700 1 --2- 172.21.15.149:0/558290063 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f24c00b4730 0x7f24c00b0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:03.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.031+0000 7f24bdffb700 1 -- 172.21.15.149:0/558290063 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2506651403 0 0) 0x7f24c00716c0 con 0x7f24c00b4c80 2023-11-08T19:24:03.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.031+0000 7f24bdffb700 1 -- 172.21.15.149:0/558290063 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24ac0035b0 con 0x7f24c00b4c80 2023-11-08T19:24:03.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.031+0000 7f24bdffb700 1 -- 172.21.15.149:0/558290063 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 924912107 0 0) 0x7f24ac0035b0 con 0x7f24c00b4c80 2023-11-08T19:24:03.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.031+0000 7f24bdffb700 1 -- 172.21.15.149:0/558290063 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f24c00b4730 msgr2=0x7f24c00b0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:03.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.031+0000 7f24bdffb700 1 --2- 172.21.15.149:0/558290063 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f24c00b4730 0x7f24c00b0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:03.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.031+0000 7f24bdffb700 1 -- 172.21.15.149:0/558290063 >> v1:172.21.15.160:6789/0 conn(0x7f24c015b790 legacy=0x7f24c015fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:03.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.031+0000 7f24bdffb700 1 -- 172.21.15.149:0/558290063 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c0071910 con 0x7f24c00b4c80 2023-11-08T19:24:03.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.031+0000 7f24bdffb700 1 -- 172.21.15.149:0/558290063 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f24b80019f0 con 0x7f24c00b4c80 2023-11-08T19:24:03.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.031+0000 7f24bdffb700 1 -- 172.21.15.149:0/558290063 >> v1:172.21.15.149:6789/0 conn(0x7f24c00b4c80 legacy=0x7f24c00c9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:03.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.031+0000 7f24bdffb700 1 --2- 172.21.15.149:0/558290063 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f24ac003a30 0x7f24ac003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:03.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.031+0000 7f24bdffb700 1 --2- 172.21.15.149:0/558290063 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f24c00b4730 0x7f24ac004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:03.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.031+0000 7f24bdffb700 1 --2- 172.21.15.149:0/558290063 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24ac004d90 0x7f24ac005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:03.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.031+0000 7f24bdffb700 1 -- 172.21.15.149:0/558290063 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c015f440 con 0x7f24ac004d90 2023-11-08T19:24:03.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.031+0000 7f24bdffb700 1 -- 172.21.15.149:0/558290063 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24ac00bac0 con 0x7f24ac003a30 2023-11-08T19:24:03.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.031+0000 7f24bdffb700 1 -- 172.21.15.149:0/558290063 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24ac00bc80 con 0x7f24c00b4730 2023-11-08T19:24:03.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.031+0000 7f24bf7fe700 1 --2- 172.21.15.149:0/558290063 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24ac004d90 0x7f24ac005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:03.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.031+0000 7f24be7fc700 1 --2- 172.21.15.149:0/558290063 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f24c00b4730 0x7f24ac004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:03.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.031+0000 7f24beffd700 1 --2- 172.21.15.149:0/558290063 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f24ac003a30 0x7f24ac003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:03.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.032+0000 7f24bf7fe700 1 -- 172.21.15.149:0/558290063 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f24c00b4730 msgr2=0x7f24ac004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:03.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.032+0000 7f24bf7fe700 1 --2- 172.21.15.149:0/558290063 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f24c00b4730 0x7f24ac004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:03.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.032+0000 7f24bf7fe700 1 -- 172.21.15.149:0/558290063 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f24ac003a30 msgr2=0x7f24ac003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:03.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.032+0000 7f24bf7fe700 1 --2- 172.21.15.149:0/558290063 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f24ac003a30 0x7f24ac003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:03.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.032+0000 7f24bf7fe700 1 -- 172.21.15.149:0/558290063 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24ac0035b0 con 0x7f24ac004d90 2023-11-08T19:24:03.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.032+0000 7f24bf7fe700 1 --2- 172.21.15.149:0/558290063 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24ac004d90 0x7f24ac005210 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f24b800a7f0 tx=0x7f24ac005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64fe3659474cf090 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:03.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.032+0000 7f24bdffb700 1 -- 172.21.15.149:0/558290063 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b800a2f0 con 0x7f24ac004d90 2023-11-08T19:24:03.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.032+0000 7f24bdffb700 1 -- 172.21.15.149:0/558290063 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24b8012620 con 0x7f24ac004d90 2023-11-08T19:24:03.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.032+0000 7f24bdffb700 1 -- 172.21.15.149:0/558290063 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b80129d0 con 0x7f24ac004d90 2023-11-08T19:24:03.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.032+0000 7f24c5460700 1 -- 172.21.15.149:0/558290063 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24ac004d90 msgr2=0x7f24ac005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:03.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.032+0000 7f24c5460700 1 --2- 172.21.15.149:0/558290063 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24ac004d90 0x7f24ac005210 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f24b800a7f0 tx=0x7f24ac005880 comp rx=0 tx=0).stop 2023-11-08T19:24:03.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.032+0000 7f24bf7fe700 1 -- 172.21.15.149:0/558290063 reap_dead start 2023-11-08T19:24:03.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.033+0000 7f24c5460700 1 -- 172.21.15.149:0/558290063 shutdown_connections 2023-11-08T19:24:03.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.033+0000 7f24c5460700 1 -- 172.21.15.149:0/558290063 >> 172.21.15.149:0/558290063 conn(0x7f24c006b3d0 msgr2=0x7f24c00cf460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:03.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.033+0000 7f24c5460700 1 -- 172.21.15.149:0/558290063 shutdown_connections 2023-11-08T19:24:03.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.033+0000 7f24c5460700 1 -- 172.21.15.149:0/558290063 wait complete. 2023-11-08T19:24:03.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.034+0000 7f24c5460700 1 Processor -- start 2023-11-08T19:24:03.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.034+0000 7f24c5460700 1 -- start start 2023-11-08T19:24:03.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.035+0000 7f24c5460700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24ac004d90 0x7f24c014f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:03.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.035+0000 7f24c5460700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f24c00c79d0 0x7f24c00b05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:03.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.035+0000 7f24c5460700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f24c00c7e50 0x7f24c00b0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:03.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.035+0000 7f24c5460700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c014fcf0 con 0x7f24ac004d90 2023-11-08T19:24:03.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.035+0000 7f24c5460700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c00c6910 con 0x7f24c00c7e50 2023-11-08T19:24:03.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.035+0000 7f24c5460700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24c00c6bf0 con 0x7f24c00c79d0 2023-11-08T19:24:03.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.035+0000 7f24beffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24ac004d90 0x7f24c014f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:03.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.035+0000 7f24beffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24ac004d90 0x7f24c014f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38884/0 (socket says 172.21.15.149:38884) 2023-11-08T19:24:03.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.035+0000 7f24beffd700 1 -- 172.21.15.149:0/2905386230 learned_addr learned my addr 172.21.15.149:0/2905386230 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:03.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.035+0000 7f24be7fc700 1 --2- 172.21.15.149:0/2905386230 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f24c00c79d0 0x7f24c00b05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:03.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.035+0000 7f24bf7fe700 1 --2- 172.21.15.149:0/2905386230 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f24c00c7e50 0x7f24c00b0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:03.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.035+0000 7f24beffd700 1 -- 172.21.15.149:0/2905386230 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f24c00c79d0 msgr2=0x7f24c00b05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:03.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.035+0000 7f24beffd700 1 --2- 172.21.15.149:0/2905386230 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f24c00c79d0 0x7f24c00b05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:03.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.035+0000 7f24beffd700 1 -- 172.21.15.149:0/2905386230 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f24c00c7e50 msgr2=0x7f24c00b0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:03.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.035+0000 7f24beffd700 1 --2- 172.21.15.149:0/2905386230 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f24c00c7e50 0x7f24c00b0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:03.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.035+0000 7f24beffd700 1 -- 172.21.15.149:0/2905386230 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c00c6ed0 con 0x7f24ac004d90 2023-11-08T19:24:03.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.035+0000 7f24beffd700 1 --2- 172.21.15.149:0/2905386230 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24ac004d90 0x7f24c014f7b0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f24b000f7f0 tx=0x7f24b000fbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:03.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.035+0000 7f24b77fe700 1 -- 172.21.15.149:0/2905386230 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b00052e0 con 0x7f24ac004d90 2023-11-08T19:24:03.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.035+0000 7f24b77fe700 1 -- 172.21.15.149:0/2905386230 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24b0005440 con 0x7f24ac004d90 2023-11-08T19:24:03.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.035+0000 7f24c5460700 1 -- 172.21.15.149:0/2905386230 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24c00c71b0 con 0x7f24ac004d90 2023-11-08T19:24:03.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.035+0000 7f24b77fe700 1 -- 172.21.15.149:0/2905386230 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b00038c0 con 0x7f24ac004d90 2023-11-08T19:24:03.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.035+0000 7f24c5460700 1 -- 172.21.15.149:0/2905386230 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24c0150340 con 0x7f24ac004d90 2023-11-08T19:24:03.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.036+0000 7f24c5460700 1 -- 172.21.15.149:0/2905386230 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24c00c8230 con 0x7f24ac004d90 2023-11-08T19:24:03.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.037+0000 7f24b77fe700 1 -- 172.21.15.149:0/2905386230 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f24b0003a20 con 0x7f24ac004d90 2023-11-08T19:24:03.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.037+0000 7f24b77fe700 1 --2- 172.21.15.149:0/2905386230 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f24a006af00 0x7f24a006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:03.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.037+0000 7f24be7fc700 1 --2- 172.21.15.149:0/2905386230 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f24a006af00 0x7f24a006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:03.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.037+0000 7f24b77fe700 1 -- 172.21.15.149:0/2905386230 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f24b0089780 con 0x7f24ac004d90 2023-11-08T19:24:03.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.038+0000 7f24be7fc700 1 --2- 172.21.15.149:0/2905386230 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f24a006af00 0x7f24a006d3c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f24a8009ba0 tx=0x7f24a8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:03.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.042+0000 7f24b77fe700 1 -- 172.21.15.149:0/2905386230 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f24c00c8230 con 0x7f24ac004d90 2023-11-08T19:24:03.276 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.275+0000 7f24c5460700 1 -- 172.21.15.149:0/2905386230 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f24c00c8230 con 0x7f24ac004d90 2023-11-08T19:24:03.277 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.275+0000 7f24b77fe700 1 -- 172.21.15.149:0/2905386230 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4921 (secure 0 0 0) 0x7f24c00c8230 con 0x7f24ac004d90 2023-11-08T19:24:03.277 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:24:03.277 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4252,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/2277605177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":2277605177},{"type":"v1","addr":"172.21.15.149:6837","nonce":2277605177}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/2774257644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2774257644},{"type":"v1","addr":"172.21.15.149:6836","nonce":2774257644}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/2076428669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":2076428669},{"type":"v1","addr":"172.21.15.160:6835","nonce":2076428669}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-08T19:23:01.918138+0000","modified":"2023-11-08T19:23:19.490960+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.160:6834/3847116435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3847116435},{"type":"v1","addr":"172.21.15.160:6834","nonce":3847116435}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-08T19:24:03.279 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.278+0000 7f24c5460700 1 -- 172.21.15.149:0/2905386230 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f24a006af00 msgr2=0x7f24a006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:03.279 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.278+0000 7f24c5460700 1 --2- 172.21.15.149:0/2905386230 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f24a006af00 0x7f24a006d3c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f24a8009ba0 tx=0x7f24a8008040 comp rx=0 tx=0).stop 2023-11-08T19:24:03.279 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.278+0000 7f24c5460700 1 -- 172.21.15.149:0/2905386230 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24ac004d90 msgr2=0x7f24c014f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:03.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.278+0000 7f24c5460700 1 --2- 172.21.15.149:0/2905386230 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24ac004d90 0x7f24c014f7b0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f24b000f7f0 tx=0x7f24b000fbb0 comp rx=0 tx=0).stop 2023-11-08T19:24:03.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.278+0000 7f24c5460700 1 -- 172.21.15.149:0/2905386230 shutdown_connections 2023-11-08T19:24:03.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.278+0000 7f24c5460700 1 --2- 172.21.15.149:0/2905386230 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f24a006af00 0x7f24a006d3c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:03.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.278+0000 7f24c5460700 1 --2- 172.21.15.149:0/2905386230 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f24c00c7e50 0x7f24c00b0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:03.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.278+0000 7f24c5460700 1 --2- 172.21.15.149:0/2905386230 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24ac004d90 0x7f24c014f7b0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:03.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.278+0000 7f24c5460700 1 --2- 172.21.15.149:0/2905386230 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f24c00c79d0 0x7f24c00b05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:03.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.278+0000 7f24c5460700 1 -- 172.21.15.149:0/2905386230 >> 172.21.15.149:0/2905386230 conn(0x7f24c006b3d0 msgr2=0x7f24c00ae830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:03.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.278+0000 7f24c5460700 1 -- 172.21.15.149:0/2905386230 shutdown_connections 2023-11-08T19:24:03.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.278+0000 7f24c5460700 1 -- 172.21.15.149:0/2905386230 wait complete. 2023-11-08T19:24:03.282 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 9 2023-11-08T19:24:03.291 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:24:03.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.412+0000 7f9f5dc2d700 1 Processor -- start 2023-11-08T19:24:03.414 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.412+0000 7f9f5dc2d700 1 -- start start 2023-11-08T19:24:03.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.413+0000 7f9f5dc2d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9f580cd5e0 0x7f9f580cfd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:03.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.413+0000 7f9f5dc2d700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f9f580ce840 0x7f9f580d0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:03.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.413+0000 7f9f5dc2d700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f580d07a0 con 0x7f9f5815b950 2023-11-08T19:24:03.417 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.413+0000 7f9f5dc2d700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f580cc2e0 con 0x7f9f580ce840 2023-11-08T19:24:03.417 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.413+0000 7f9f5dc2d700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f580cc580 con 0x7f9f580cd5e0 2023-11-08T19:24:03.417 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.413+0000 7f9f56ffd700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9f580cd5e0 0x7f9f580cfd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:03.417 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.413+0000 7f9f57fff700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f9f580ce840 0x7f9f580d0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:03.417 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.413+0000 7f9f56ffd700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9f580cd5e0 0x7f9f580cfd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.149:59182/0 (socket says 172.21.15.149:59182) 2023-11-08T19:24:03.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.413+0000 7f9f56ffd700 1 -- 172.21.15.149:0/1047026363 learned_addr learned my addr 172.21.15.149:0/1047026363 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:03.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.413+0000 7f9f57fff700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f9f580ce840 0x7f9f580d0260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.149:39888/0 (socket says 172.21.15.149:39888) 2023-11-08T19:24:03.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.413+0000 7f9f56ffd700 1 -- 172.21.15.149:0/1047026363 >> v2:172.21.15.160:3300/0 conn(0x7f9f580ce840 msgr2=0x7f9f580d0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:03.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.413+0000 7f9f56ffd700 1 --2- 172.21.15.149:0/1047026363 >> v2:172.21.15.160:3300/0 conn(0x7f9f580ce840 0x7f9f580d0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:03.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.413+0000 7f9f56ffd700 1 -- 172.21.15.149:0/1047026363 >> v1:172.21.15.160:6789/0 conn(0x7f9f5815b950 legacy=0x7f9f580ce130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:03.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.413+0000 7f9f56ffd700 1 -- 172.21.15.149:0/1047026363 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f580cc820 con 0x7f9f580cd5e0 2023-11-08T19:24:03.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.413+0000 7f9f57fff700 1 --2- 172.21.15.149:0/1047026363 >> v2:172.21.15.160:3300/0 conn(0x7f9f580ce840 0x7f9f580d0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:24:03.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.414+0000 7f9f56ffd700 1 --2- 172.21.15.149:0/1047026363 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9f580cd5e0 0x7f9f580cfd20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9f480098f0 tx=0x7f9f48009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1512cd65368aa71c server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:03.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.414+0000 7f9f567fc700 1 -- 172.21.15.149:0/1047026363 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f48011830 con 0x7f9f580cd5e0 2023-11-08T19:24:03.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.414+0000 7f9f567fc700 1 -- 172.21.15.149:0/1047026363 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f48011990 con 0x7f9f580cd5e0 2023-11-08T19:24:03.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.414+0000 7f9f567fc700 1 -- 172.21.15.149:0/1047026363 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f48011d20 con 0x7f9f580cd5e0 2023-11-08T19:24:03.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.414+0000 7f9f5dc2d700 1 -- 172.21.15.149:0/1047026363 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9f580cd5e0 msgr2=0x7f9f580cfd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:03.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.414+0000 7f9f5dc2d700 1 --2- 172.21.15.149:0/1047026363 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9f580cd5e0 0x7f9f580cfd20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9f480098f0 tx=0x7f9f48009c00 comp rx=0 tx=0).stop 2023-11-08T19:24:03.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.414+0000 7f9f5dc2d700 1 -- 172.21.15.149:0/1047026363 shutdown_connections 2023-11-08T19:24:03.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.414+0000 7f9f5dc2d700 1 --2- 172.21.15.149:0/1047026363 >> v2:172.21.15.160:3300/0 conn(0x7f9f580ce840 0x7f9f580d0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:03.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.414+0000 7f9f5dc2d700 1 --2- 172.21.15.149:0/1047026363 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9f580cd5e0 0x7f9f580cfd20 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:03.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.414+0000 7f9f5dc2d700 1 -- 172.21.15.149:0/1047026363 >> 172.21.15.149:0/1047026363 conn(0x7f9f5808afd0 msgr2=0x7f9f580d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:03.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.414+0000 7f9f5dc2d700 1 -- 172.21.15.149:0/1047026363 shutdown_connections 2023-11-08T19:24:03.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.415+0000 7f9f5dc2d700 1 -- 172.21.15.149:0/1047026363 wait complete. 2023-11-08T19:24:03.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.416+0000 7f9f5dc2d700 1 Processor -- start 2023-11-08T19:24:03.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.416+0000 7f9f5dc2d700 1 -- start start 2023-11-08T19:24:03.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.417+0000 7f9f5dc2d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f580ce840 0x7f9f580b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:03.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.417+0000 7f9f5dc2d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9f5815b950 0x7f9f580cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:03.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.417+0000 7f9f5dc2d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9f580ae5d0 0x7f9f580aea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:03.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.417+0000 7f9f5dc2d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f580aefa0 con 0x7f9f580ce840 2023-11-08T19:24:03.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.417+0000 7f9f5dc2d700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f580b75b0 con 0x7f9f580ae5d0 2023-11-08T19:24:03.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.417+0000 7f9f5dc2d700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f580b5aa0 con 0x7f9f5815b950 2023-11-08T19:24:03.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.417+0000 7f9f577fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f580ce840 0x7f9f580b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:03.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.417+0000 7f9f577fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f580ce840 0x7f9f580b5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38898/0 (socket says 172.21.15.149:38898) 2023-11-08T19:24:03.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.417+0000 7f9f577fe700 1 -- 172.21.15.149:0/2350405507 learned_addr learned my addr 172.21.15.149:0/2350405507 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:03.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.417+0000 7f9f56ffd700 1 --2- 172.21.15.149:0/2350405507 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9f5815b950 0x7f9f580cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:03.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.417+0000 7f9f57fff700 1 --2- 172.21.15.149:0/2350405507 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9f580ae5d0 0x7f9f580aea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:03.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.417+0000 7f9f577fe700 1 -- 172.21.15.149:0/2350405507 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9f5815b950 msgr2=0x7f9f580cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:03.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.417+0000 7f9f577fe700 1 --2- 172.21.15.149:0/2350405507 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9f5815b950 0x7f9f580cabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:03.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.417+0000 7f9f577fe700 1 -- 172.21.15.149:0/2350405507 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9f580ae5d0 msgr2=0x7f9f580aea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:03.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.417+0000 7f9f577fe700 1 --2- 172.21.15.149:0/2350405507 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9f580ae5d0 0x7f9f580aea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:03.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.417+0000 7f9f577fe700 1 -- 172.21.15.149:0/2350405507 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f50009a70 con 0x7f9f580ce840 2023-11-08T19:24:03.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.417+0000 7f9f56ffd700 1 --2- 172.21.15.149:0/2350405507 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9f5815b950 0x7f9f580cabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:24:03.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.417+0000 7f9f57fff700 1 --2- 172.21.15.149:0/2350405507 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9f580ae5d0 0x7f9f580aea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:24:03.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.417+0000 7f9f577fe700 1 --2- 172.21.15.149:0/2350405507 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f580ce840 0x7f9f580b5f30 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c00c430 tx=0x7f9f4c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:03.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.417+0000 7f9f3ffff700 1 -- 172.21.15.149:0/2350405507 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c0052d0 con 0x7f9f580ce840 2023-11-08T19:24:03.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.417+0000 7f9f3ffff700 1 -- 172.21.15.149:0/2350405507 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f4c005450 con 0x7f9f580ce840 2023-11-08T19:24:03.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.417+0000 7f9f5dc2d700 1 -- 172.21.15.149:0/2350405507 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f48009550 con 0x7f9f580ce840 2023-11-08T19:24:03.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.417+0000 7f9f3ffff700 1 -- 172.21.15.149:0/2350405507 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c006af0 con 0x7f9f580ce840 2023-11-08T19:24:03.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.417+0000 7f9f5dc2d700 1 -- 172.21.15.149:0/2350405507 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f5814a940 con 0x7f9f580ce840 2023-11-08T19:24:03.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.418+0000 7f9f5dc2d700 1 -- 172.21.15.149:0/2350405507 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f580745f0 con 0x7f9f580ce840 2023-11-08T19:24:03.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.419+0000 7f9f3ffff700 1 -- 172.21.15.149:0/2350405507 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9f4c0036d0 con 0x7f9f580ce840 2023-11-08T19:24:03.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.419+0000 7f9f3ffff700 1 --2- 172.21.15.149:0/2350405507 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9f4406af00 0x7f9f4406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:03.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.419+0000 7f9f3ffff700 1 -- 172.21.15.149:0/2350405507 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9f4c088c70 con 0x7f9f580ce840 2023-11-08T19:24:03.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.419+0000 7f9f56ffd700 1 --2- 172.21.15.149:0/2350405507 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9f4406af00 0x7f9f4406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:03.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.420+0000 7f9f56ffd700 1 --2- 172.21.15.149:0/2350405507 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9f4406af00 0x7f9f4406d3c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9f58160590 tx=0x7f9f48008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:03.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.424+0000 7f9f3ffff700 1 -- 172.21.15.149:0/2350405507 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9f4c0538e0 con 0x7f9f580ce840 2023-11-08T19:24:03.658 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.657+0000 7f9f5dc2d700 1 -- 172.21.15.149:0/2350405507 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9f5808b760 con 0x7f9f580ce840 2023-11-08T19:24:03.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.657+0000 7f9f3ffff700 1 -- 172.21.15.149:0/2350405507 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4921 (secure 0 0 0) 0x7f9f4c056f00 con 0x7f9f580ce840 2023-11-08T19:24:03.659 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:24:03.659 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4252,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/2277605177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":2277605177},{"type":"v1","addr":"172.21.15.149:6837","nonce":2277605177}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/2774257644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2774257644},{"type":"v1","addr":"172.21.15.149:6836","nonce":2774257644}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/2076428669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":2076428669},{"type":"v1","addr":"172.21.15.160:6835","nonce":2076428669}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-08T19:23:01.918138+0000","modified":"2023-11-08T19:23:19.490960+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.160:6834/3847116435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3847116435},{"type":"v1","addr":"172.21.15.160:6834","nonce":3847116435}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-08T19:24:03.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.659+0000 7f9f5dc2d700 1 -- 172.21.15.149:0/2350405507 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9f4406af00 msgr2=0x7f9f4406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:03.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.659+0000 7f9f5dc2d700 1 --2- 172.21.15.149:0/2350405507 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9f4406af00 0x7f9f4406d3c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9f58160590 tx=0x7f9f48008030 comp rx=0 tx=0).stop 2023-11-08T19:24:03.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.659+0000 7f9f5dc2d700 1 -- 172.21.15.149:0/2350405507 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f580ce840 msgr2=0x7f9f580b5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:03.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.659+0000 7f9f5dc2d700 1 --2- 172.21.15.149:0/2350405507 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f580ce840 0x7f9f580b5f30 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c00c430 tx=0x7f9f4c00c7f0 comp rx=0 tx=0).stop 2023-11-08T19:24:03.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.660+0000 7f9f5dc2d700 1 -- 172.21.15.149:0/2350405507 shutdown_connections 2023-11-08T19:24:03.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.660+0000 7f9f5dc2d700 1 --2- 172.21.15.149:0/2350405507 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9f4406af00 0x7f9f4406d3c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:03.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.660+0000 7f9f5dc2d700 1 --2- 172.21.15.149:0/2350405507 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9f580ae5d0 0x7f9f580aea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:03.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.660+0000 7f9f5dc2d700 1 --2- 172.21.15.149:0/2350405507 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f580ce840 0x7f9f580b5f30 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:03.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.660+0000 7f9f5dc2d700 1 --2- 172.21.15.149:0/2350405507 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9f5815b950 0x7f9f580cabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:03.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.660+0000 7f9f5dc2d700 1 -- 172.21.15.149:0/2350405507 >> 172.21.15.149:0/2350405507 conn(0x7f9f5808afd0 msgr2=0x7f9f580700f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:03.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.660+0000 7f9f5dc2d700 1 -- 172.21.15.149:0/2350405507 shutdown_connections 2023-11-08T19:24:03.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.660+0000 7f9f5dc2d700 1 -- 172.21.15.149:0/2350405507 wait complete. 2023-11-08T19:24:03.664 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 9 2023-11-08T19:24:03.673 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:24:03.794 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.793+0000 7fae3429c700 1 Processor -- start 2023-11-08T19:24:03.795 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.793+0000 7fae3429c700 1 -- start start 2023-11-08T19:24:03.797 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.794+0000 7fae3429c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fae2c15b950 0x7fae2c0ce130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:03.797 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.794+0000 7fae3429c700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fae2c0d0430 0x7fae2c0ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:03.797 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.794+0000 7fae3429c700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae2c0cc2e0 con 0x7fae2c0cd5e0 2023-11-08T19:24:03.797 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.794+0000 7fae3429c700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae2c0cc580 con 0x7fae2c15b950 2023-11-08T19:24:03.797 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.794+0000 7fae3429c700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae2c0cc820 con 0x7fae2c0d0430 2023-11-08T19:24:03.798 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.794+0000 7fae32038700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fae2c15b950 0x7fae2c0ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:03.798 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.794+0000 7fae32038700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fae2c15b950 0x7fae2c0ce130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38906/0 (socket says 172.21.15.149:38906) 2023-11-08T19:24:03.798 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.794+0000 7fae31837700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fae2c0cd5e0 0x7fae2c0cfd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:40908/0 (socket says 172.21.15.149:40908) 2023-11-08T19:24:03.798 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.794+0000 7fae32038700 1 -- 172.21.15.149:0/2059489258 learned_addr learned my addr 172.21.15.149:0/2059489258 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:03.798 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.794+0000 7fae32038700 1 -- 172.21.15.149:0/2059489258 >> v2:172.21.15.160:3300/0 conn(0x7fae2c0d0430 msgr2=0x7fae2c0ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:03.799 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.794+0000 7fae32038700 1 --2- 172.21.15.149:0/2059489258 >> v2:172.21.15.160:3300/0 conn(0x7fae2c0d0430 0x7fae2c0ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:03.799 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.794+0000 7fae32038700 1 -- 172.21.15.149:0/2059489258 >> v1:172.21.15.149:6789/0 conn(0x7fae2c0cd5e0 legacy=0x7fae2c0cfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:03.799 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.794+0000 7fae32038700 1 -- 172.21.15.149:0/2059489258 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae2c0ccb00 con 0x7fae2c15b950 2023-11-08T19:24:03.799 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.795+0000 7fae32038700 1 --2- 172.21.15.149:0/2059489258 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae2c15b950 0x7fae2c0ce130 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fae2c0cbd20 tx=0x7fae1c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64d7cc6b93fdc942 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:03.799 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.795+0000 7fae31036700 1 -- 172.21.15.149:0/2059489258 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae1c005e30 con 0x7fae2c15b950 2023-11-08T19:24:03.800 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.795+0000 7fae31036700 1 -- 172.21.15.149:0/2059489258 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae1c004030 con 0x7fae2c15b950 2023-11-08T19:24:03.800 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.795+0000 7fae31036700 1 -- 172.21.15.149:0/2059489258 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae1c0043e0 con 0x7fae2c15b950 2023-11-08T19:24:03.800 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.795+0000 7fae3429c700 1 -- 172.21.15.149:0/2059489258 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae2c15b950 msgr2=0x7fae2c0ce130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:03.800 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.795+0000 7fae3429c700 1 --2- 172.21.15.149:0/2059489258 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae2c15b950 0x7fae2c0ce130 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fae2c0cbd20 tx=0x7fae1c009bd0 comp rx=0 tx=0).stop 2023-11-08T19:24:03.800 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.795+0000 7fae3429c700 1 -- 172.21.15.149:0/2059489258 shutdown_connections 2023-11-08T19:24:03.801 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.795+0000 7fae3429c700 1 --2- 172.21.15.149:0/2059489258 >> v2:172.21.15.160:3300/0 conn(0x7fae2c0d0430 0x7fae2c0ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:03.801 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.795+0000 7fae3429c700 1 --2- 172.21.15.149:0/2059489258 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae2c15b950 0x7fae2c0ce130 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:03.801 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.795+0000 7fae3429c700 1 -- 172.21.15.149:0/2059489258 >> 172.21.15.149:0/2059489258 conn(0x7fae2c08afd0 msgr2=0x7fae2c0d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:03.801 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.795+0000 7fae3429c700 1 -- 172.21.15.149:0/2059489258 shutdown_connections 2023-11-08T19:24:03.801 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.795+0000 7fae3429c700 1 -- 172.21.15.149:0/2059489258 wait complete. 2023-11-08T19:24:03.804 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.797+0000 7fae3429c700 1 Processor -- start 2023-11-08T19:24:03.805 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.797+0000 7fae3429c700 1 -- start start 2023-11-08T19:24:03.805 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.797+0000 7fae3429c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fae2c0d0430 0x7fae2c14aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:03.805 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.797+0000 7fae3429c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fae2c15b950 0x7fae2c15e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:03.805 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.797+0000 7fae3429c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae2c15edf0 0x7fae2c0c7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:03.805 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.797+0000 7fae3429c700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae2c0c6900 con 0x7fae2c15edf0 2023-11-08T19:24:03.806 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.797+0000 7fae3429c700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae2c0c6ba0 con 0x7fae2c0d0430 2023-11-08T19:24:03.806 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.797+0000 7fae3429c700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae2c0c6e80 con 0x7fae2c15b950 2023-11-08T19:24:03.806 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.797+0000 7fae32839700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae2c15edf0 0x7fae2c0c7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:03.806 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.797+0000 7fae32839700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae2c15edf0 0x7fae2c0c7960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38916/0 (socket says 172.21.15.149:38916) 2023-11-08T19:24:03.807 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.797+0000 7fae32839700 1 -- 172.21.15.149:0/1749486174 learned_addr learned my addr 172.21.15.149:0/1749486174 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:03.807 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.798+0000 7fae32038700 1 --2- 172.21.15.149:0/1749486174 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fae2c0d0430 0x7fae2c14aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:03.807 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.798+0000 7fae31837700 1 --2- 172.21.15.149:0/1749486174 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fae2c15b950 0x7fae2c15e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:03.807 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.798+0000 7fae32839700 1 -- 172.21.15.149:0/1749486174 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fae2c15b950 msgr2=0x7fae2c15e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:03.807 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.798+0000 7fae32839700 1 --2- 172.21.15.149:0/1749486174 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fae2c15b950 0x7fae2c15e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:03.807 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.798+0000 7fae32839700 1 -- 172.21.15.149:0/1749486174 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fae2c0d0430 msgr2=0x7fae2c14aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:03.808 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.798+0000 7fae32839700 1 --2- 172.21.15.149:0/1749486174 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fae2c0d0430 0x7fae2c14aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:03.808 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.798+0000 7fae32839700 1 -- 172.21.15.149:0/1749486174 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae1c009500 con 0x7fae2c15edf0 2023-11-08T19:24:03.808 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.798+0000 7fae31837700 1 --2- 172.21.15.149:0/1749486174 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fae2c15b950 0x7fae2c15e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:24:03.808 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.798+0000 7fae32839700 1 --2- 172.21.15.149:0/1749486174 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae2c15edf0 0x7fae2c0c7960 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fae2400b970 tx=0x7fae2400bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:03.808 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.798+0000 7fae22ffd700 1 -- 172.21.15.149:0/1749486174 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2400c9b0 con 0x7fae2c15edf0 2023-11-08T19:24:03.809 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.798+0000 7fae22ffd700 1 -- 172.21.15.149:0/1749486174 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae2400cb30 con 0x7fae2c15edf0 2023-11-08T19:24:03.809 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.798+0000 7fae3429c700 1 -- 172.21.15.149:0/1749486174 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae2c0c7160 con 0x7fae2c15edf0 2023-11-08T19:24:03.809 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.798+0000 7fae22ffd700 1 -- 172.21.15.149:0/1749486174 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae24014440 con 0x7fae2c15edf0 2023-11-08T19:24:03.809 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.798+0000 7fae3429c700 1 -- 172.21.15.149:0/1749486174 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae2c14b500 con 0x7fae2c15edf0 2023-11-08T19:24:03.809 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.799+0000 7fae3429c700 1 -- 172.21.15.149:0/1749486174 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae2c0c7680 con 0x7fae2c15edf0 2023-11-08T19:24:03.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.799+0000 7fae22ffd700 1 -- 172.21.15.149:0/1749486174 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fae2401d3b0 con 0x7fae2c15edf0 2023-11-08T19:24:03.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.800+0000 7fae22ffd700 1 --2- 172.21.15.149:0/1749486174 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fae1006af00 0x7fae1006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:03.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.800+0000 7fae22ffd700 1 -- 172.21.15.149:0/1749486174 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fae24006e40 con 0x7fae2c15edf0 2023-11-08T19:24:03.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.800+0000 7fae32038700 1 --2- 172.21.15.149:0/1749486174 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fae1006af00 0x7fae1006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:03.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.800+0000 7fae32038700 1 --2- 172.21.15.149:0/1749486174 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fae1006af00 0x7fae1006d3c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fae2c0cbd20 tx=0x7fae1c008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:03.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.805+0000 7fae22ffd700 1 -- 172.21.15.149:0/1749486174 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fae2c0c7680 con 0x7fae2c15edf0 2023-11-08T19:24:03.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.995+0000 7fae3429c700 1 -- 172.21.15.149:0/1749486174 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fae2c0c7680 con 0x7fae2c15edf0 2023-11-08T19:24:03.998 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.997+0000 7fae22ffd700 1 -- 172.21.15.149:0/1749486174 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18770 (secure 0 0 0) 0x7fae2c0c7680 con 0x7fae2c15edf0 2023-11-08T19:24:03.998 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:24:03.998 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":26,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:23:51.355959+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-08T19:22:59.830928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-08T19:23:00.886589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-08T19:23:04.574033+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":1}]},{"pgid":"3.14","mappings":[{"from":4,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:24:04.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.999+0000 7fae3429c700 1 -- 172.21.15.149:0/1749486174 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fae1006af00 msgr2=0x7fae1006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:04.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.999+0000 7fae3429c700 1 --2- 172.21.15.149:0/1749486174 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fae1006af00 0x7fae1006d3c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fae2c0cbd20 tx=0x7fae1c008070 comp rx=0 tx=0).stop 2023-11-08T19:24:04.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.999+0000 7fae3429c700 1 -- 172.21.15.149:0/1749486174 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae2c15edf0 msgr2=0x7fae2c0c7960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:04.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.999+0000 7fae3429c700 1 --2- 172.21.15.149:0/1749486174 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae2c15edf0 0x7fae2c0c7960 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fae2400b970 tx=0x7fae2400bd30 comp rx=0 tx=0).stop 2023-11-08T19:24:04.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.999+0000 7fae3429c700 1 -- 172.21.15.149:0/1749486174 shutdown_connections 2023-11-08T19:24:04.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.999+0000 7fae3429c700 1 --2- 172.21.15.149:0/1749486174 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fae1006af00 0x7fae1006d3c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:04.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.999+0000 7fae3429c700 1 --2- 172.21.15.149:0/1749486174 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fae2c0d0430 0x7fae2c14aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:04.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.999+0000 7fae3429c700 1 --2- 172.21.15.149:0/1749486174 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae2c15edf0 0x7fae2c0c7960 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:04.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.999+0000 7fae3429c700 1 --2- 172.21.15.149:0/1749486174 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fae2c15b950 0x7fae2c15e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:04.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.999+0000 7fae3429c700 1 -- 172.21.15.149:0/1749486174 >> 172.21.15.149:0/1749486174 conn(0x7fae2c08afd0 msgr2=0x7fae2c0b30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:04.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.999+0000 7fae3429c700 1 -- 172.21.15.149:0/1749486174 shutdown_connections 2023-11-08T19:24:04.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:03.999+0000 7fae3429c700 1 -- 172.21.15.149:0/1749486174 wait complete. 2023-11-08T19:24:04.013 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-08T19:24:04.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.134+0000 7f0f2411d700 1 Processor -- start 2023-11-08T19:24:04.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.135+0000 7f0f2411d700 1 -- start start 2023-11-08T19:24:04.138 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.135+0000 7f0f2411d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0f1c0cd5e0 0x7f0f1c0cfd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:04.138 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.135+0000 7f0f2411d700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f0f1c0ce840 0x7f0f1c0d0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:04.139 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.135+0000 7f0f2411d700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f1c0d07a0 con 0x7f0f1c15b950 2023-11-08T19:24:04.139 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.135+0000 7f0f2411d700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f1c0cc2e0 con 0x7f0f1c0ce840 2023-11-08T19:24:04.139 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.135+0000 7f0f2411d700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1c0cc580 con 0x7f0f1c0cd5e0 2023-11-08T19:24:04.139 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.136+0000 7f0f226ba700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f0f1c0ce840 0x7f0f1c0d0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:04.139 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.136+0000 7f0f216b8700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0f1c0cd5e0 0x7f0f1c0cfd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:04.140 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.136+0000 7f0f226ba700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f0f1c0ce840 0x7f0f1c0d0260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.149:39916/0 (socket says 172.21.15.149:39916) 2023-11-08T19:24:04.140 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.136+0000 7f0f226ba700 1 -- 172.21.15.149:0/3958576593 learned_addr learned my addr 172.21.15.149:0/3958576593 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:04.140 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.136+0000 7f0f216b8700 1 -- 172.21.15.149:0/3958576593 >> v2:172.21.15.160:3300/0 conn(0x7f0f1c0ce840 msgr2=0x7f0f1c0d0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:04.140 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.136+0000 7f0f216b8700 1 --2- 172.21.15.149:0/3958576593 >> v2:172.21.15.160:3300/0 conn(0x7f0f1c0ce840 0x7f0f1c0d0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:04.140 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.136+0000 7f0f216b8700 1 -- 172.21.15.149:0/3958576593 >> v1:172.21.15.160:6789/0 conn(0x7f0f1c15b950 legacy=0x7f0f1c0ce130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:04.141 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.136+0000 7f0f216b8700 1 -- 172.21.15.149:0/3958576593 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f1c0cc820 con 0x7f0f1c0cd5e0 2023-11-08T19:24:04.141 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.136+0000 7f0f226ba700 1 --2- 172.21.15.149:0/3958576593 >> v2:172.21.15.160:3300/0 conn(0x7f0f1c0ce840 0x7f0f1c0d0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:24:04.142 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.136+0000 7f0f216b8700 1 --2- 172.21.15.149:0/3958576593 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0f1c0cd5e0 0x7f0f1c0cfd20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c009840 tx=0x7f0f0c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a5d850c7a1f3e67 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:04.142 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.136+0000 7f0f20eb7700 1 -- 172.21.15.149:0/3958576593 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f0c011830 con 0x7f0f1c0cd5e0 2023-11-08T19:24:04.143 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.137+0000 7f0f20eb7700 1 -- 172.21.15.149:0/3958576593 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f0c011990 con 0x7f0f1c0cd5e0 2023-11-08T19:24:04.143 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.137+0000 7f0f20eb7700 1 -- 172.21.15.149:0/3958576593 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f0c011d20 con 0x7f0f1c0cd5e0 2023-11-08T19:24:04.143 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.137+0000 7f0f2411d700 1 -- 172.21.15.149:0/3958576593 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0f1c0cd5e0 msgr2=0x7f0f1c0cfd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:04.144 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.137+0000 7f0f2411d700 1 --2- 172.21.15.149:0/3958576593 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0f1c0cd5e0 0x7f0f1c0cfd20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c009840 tx=0x7f0f0c009b50 comp rx=0 tx=0).stop 2023-11-08T19:24:04.144 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.137+0000 7f0f2411d700 1 -- 172.21.15.149:0/3958576593 shutdown_connections 2023-11-08T19:24:04.145 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.137+0000 7f0f2411d700 1 --2- 172.21.15.149:0/3958576593 >> v2:172.21.15.160:3300/0 conn(0x7f0f1c0ce840 0x7f0f1c0d0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:04.145 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.137+0000 7f0f2411d700 1 --2- 172.21.15.149:0/3958576593 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0f1c0cd5e0 0x7f0f1c0cfd20 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:04.145 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.137+0000 7f0f2411d700 1 -- 172.21.15.149:0/3958576593 >> 172.21.15.149:0/3958576593 conn(0x7f0f1c08afd0 msgr2=0x7f0f1c0d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:04.145 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.137+0000 7f0f2411d700 1 -- 172.21.15.149:0/3958576593 shutdown_connections 2023-11-08T19:24:04.145 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.137+0000 7f0f2411d700 1 -- 172.21.15.149:0/3958576593 wait complete. 2023-11-08T19:24:04.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.138+0000 7f0f2411d700 1 Processor -- start 2023-11-08T19:24:04.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.138+0000 7f0f2411d700 1 -- start start 2023-11-08T19:24:04.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.139+0000 7f0f2411d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0f1c0ce840 0x7f0f1c1e6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:04.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.139+0000 7f0f2411d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0f1c15b950 0x7f0f1c0c44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:04.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.139+0000 7f0f2411d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f1c0b45d0 0x7f0f1c0b28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:04.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.139+0000 7f0f2411d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1c06be30 con 0x7f0f1c0b45d0 2023-11-08T19:24:04.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.139+0000 7f0f2411d700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1c1e6900 con 0x7f0f1c15b950 2023-11-08T19:24:04.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.139+0000 7f0f2411d700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1c1e6be0 con 0x7f0f1c0ce840 2023-11-08T19:24:04.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.139+0000 7f0f226ba700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f1c0b45d0 0x7f0f1c0b28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:04.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.139+0000 7f0f216b8700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0f1c15b950 0x7f0f1c0c44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:04.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.139+0000 7f0f226ba700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f1c0b45d0 0x7f0f1c0b28b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38930/0 (socket says 172.21.15.149:38930) 2023-11-08T19:24:04.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.139+0000 7f0f226ba700 1 -- 172.21.15.149:0/3019400720 learned_addr learned my addr 172.21.15.149:0/3019400720 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:04.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.139+0000 7f0f21eb9700 1 --2- 172.21.15.149:0/3019400720 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0f1c0ce840 0x7f0f1c1e6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:04.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.140+0000 7f0f226ba700 1 -- 172.21.15.149:0/3019400720 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0f1c0ce840 msgr2=0x7f0f1c1e6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:04.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.140+0000 7f0f226ba700 1 --2- 172.21.15.149:0/3019400720 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0f1c0ce840 0x7f0f1c1e6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:04.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.140+0000 7f0f226ba700 1 -- 172.21.15.149:0/3019400720 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0f1c15b950 msgr2=0x7f0f1c0c44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:04.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.140+0000 7f0f226ba700 1 --2- 172.21.15.149:0/3019400720 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0f1c15b950 0x7f0f1c0c44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:04.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.140+0000 7f0f226ba700 1 -- 172.21.15.149:0/3019400720 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f18009b30 con 0x7f0f1c0b45d0 2023-11-08T19:24:04.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.140+0000 7f0f226ba700 1 --2- 172.21.15.149:0/3019400720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f1c0b45d0 0x7f0f1c0b28b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f0f1800efc0 tx=0x7f0f1800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:04.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.140+0000 7f0f127fc700 1 -- 172.21.15.149:0/3019400720 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f1800ca80 con 0x7f0f1c0b45d0 2023-11-08T19:24:04.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.140+0000 7f0f127fc700 1 -- 172.21.15.149:0/3019400720 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f1800f040 con 0x7f0f1c0b45d0 2023-11-08T19:24:04.154 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.140+0000 7f0f127fc700 1 -- 172.21.15.149:0/3019400720 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f1800ce20 con 0x7f0f1c0b45d0 2023-11-08T19:24:04.154 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.140+0000 7f0f2411d700 1 -- 172.21.15.149:0/3019400720 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f0c0094a0 con 0x7f0f1c0b45d0 2023-11-08T19:24:04.154 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.140+0000 7f0f2411d700 1 -- 172.21.15.149:0/3019400720 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f1c1e71a0 con 0x7f0f1c0b45d0 2023-11-08T19:24:04.154 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.141+0000 7f0f2411d700 1 -- 172.21.15.149:0/3019400720 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f1c06bf70 con 0x7f0f1c0b45d0 2023-11-08T19:24:04.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.141+0000 7f0f127fc700 1 -- 172.21.15.149:0/3019400720 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0f18014480 con 0x7f0f1c0b45d0 2023-11-08T19:24:04.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.142+0000 7f0f127fc700 1 --2- 172.21.15.149:0/3019400720 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0f0006af00 0x7f0f0006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:04.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.142+0000 7f0f127fc700 1 -- 172.21.15.149:0/3019400720 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0f18089e70 con 0x7f0f1c0b45d0 2023-11-08T19:24:04.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.142+0000 7f0f21eb9700 1 --2- 172.21.15.149:0/3019400720 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0f0006af00 0x7f0f0006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:04.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.142+0000 7f0f21eb9700 1 --2- 172.21.15.149:0/3019400720 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0f0006af00 0x7f0f0006d3c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0f14000fb0 tx=0x7f0f14009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:04.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.147+0000 7f0f127fc700 1 -- 172.21.15.149:0/3019400720 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0f1c06bf70 con 0x7f0f1c0b45d0 2023-11-08T19:24:04.380 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.379+0000 7f0f2411d700 1 -- 172.21.15.149:0/3019400720 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f0f1c06bf70 con 0x7f0f1c0b45d0 2023-11-08T19:24:04.381 INFO:tasks.ceph.mon.a.smithi149.stderr:2023-11-08T19:24:04.380+0000 7f2b592f2700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-08T19:24:04.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.383+0000 7f0f127fc700 1 -- 172.21.15.149:0/3019400720 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7f0f1c06bf70 con 0x7f0f1c0b45d0 2023-11-08T19:24:04.387 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.385+0000 7f0f2411d700 1 -- 172.21.15.149:0/3019400720 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0f0006af00 msgr2=0x7f0f0006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:04.387 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.385+0000 7f0f2411d700 1 --2- 172.21.15.149:0/3019400720 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0f0006af00 0x7f0f0006d3c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0f14000fb0 tx=0x7f0f14009040 comp rx=0 tx=0).stop 2023-11-08T19:24:04.387 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.385+0000 7f0f2411d700 1 -- 172.21.15.149:0/3019400720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f1c0b45d0 msgr2=0x7f0f1c0b28b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:04.388 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.385+0000 7f0f2411d700 1 --2- 172.21.15.149:0/3019400720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f1c0b45d0 0x7f0f1c0b28b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f0f1800efc0 tx=0x7f0f1800c3a0 comp rx=0 tx=0).stop 2023-11-08T19:24:04.388 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.385+0000 7f0f2411d700 1 -- 172.21.15.149:0/3019400720 shutdown_connections 2023-11-08T19:24:04.388 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.385+0000 7f0f2411d700 1 --2- 172.21.15.149:0/3019400720 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0f0006af00 0x7f0f0006d3c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:04.388 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.385+0000 7f0f2411d700 1 --2- 172.21.15.149:0/3019400720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f1c0b45d0 0x7f0f1c0b28b0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:04.388 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.385+0000 7f0f2411d700 1 --2- 172.21.15.149:0/3019400720 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0f1c0ce840 0x7f0f1c1e6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:04.389 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.385+0000 7f0f2411d700 1 --2- 172.21.15.149:0/3019400720 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0f1c15b950 0x7f0f1c0c44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:04.389 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.385+0000 7f0f2411d700 1 -- 172.21.15.149:0/3019400720 >> 172.21.15.149:0/3019400720 conn(0x7f0f1c08afd0 msgr2=0x7f0f1c0ae540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:04.389 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.386+0000 7f0f2411d700 1 -- 172.21.15.149:0/3019400720 shutdown_connections 2023-11-08T19:24:04.389 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.386+0000 7f0f2411d700 1 -- 172.21.15.149:0/3019400720 wait complete. 2023-11-08T19:24:04.390 INFO:teuthology.orchestra.run.smithi149.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-08T19:24:04.392 INFO:tasks.ceph.mds.d.smithi160.stderr: -5705> 2023-11-08T19:23:06.352+0000 7fcf93db2700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-08T19:24:04.399 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-08T19:24:04.423 INFO:tasks.ceph.mds.d.smithi160.stdout:starting mds.d at 2023-11-08T19:24:04.523 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.522+0000 7fc77c4f5700 1 Processor -- start 2023-11-08T19:24:04.524 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.522+0000 7fc77c4f5700 1 -- start start 2023-11-08T19:24:04.526 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.523+0000 7fc77c4f5700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc77415df40 0x7fc77406c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:04.526 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.523+0000 7fc77c4f5700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fc77406ab80 0x7fc77406c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:04.527 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.523+0000 7fc77c4f5700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc7740cf1c0 0x7fc7740caf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:04.527 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.523+0000 7fc77c4f5700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc77415e320 con 0x7fc77415df40 2023-11-08T19:24:04.527 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.523+0000 7fc77c4f5700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc77406b020 con 0x7fc77406ab80 2023-11-08T19:24:04.527 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.523+0000 7fc77c4f5700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc77406b2e0 con 0x7fc7740cf1c0 2023-11-08T19:24:04.527 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.523+0000 7fc77a291700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc77415df40 0x7fc77406c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:04.528 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.523+0000 7fc77a291700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc77415df40 0x7fc77406c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38934/0 (socket says 172.21.15.149:38934) 2023-11-08T19:24:04.528 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.523+0000 7fc77a291700 1 -- 172.21.15.149:0/2891805176 learned_addr learned my addr 172.21.15.149:0/2891805176 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:04.528 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.523+0000 7fc77aa92700 1 --2- 172.21.15.149:0/2891805176 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc7740cf1c0 0x7fc7740caf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:04.528 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.523+0000 7fc779a90700 1 --2- 172.21.15.149:0/2891805176 >> v2:172.21.15.160:3300/0 conn(0x7fc77406ab80 0x7fc77406c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:04.528 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.523+0000 7fc77a291700 1 -- 172.21.15.149:0/2891805176 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc7740cf1c0 msgr2=0x7fc7740caf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:04.529 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.523+0000 7fc77a291700 1 --2- 172.21.15.149:0/2891805176 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc7740cf1c0 0x7fc7740caf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:04.529 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.523+0000 7fc77a291700 1 -- 172.21.15.149:0/2891805176 >> v2:172.21.15.160:3300/0 conn(0x7fc77406ab80 msgr2=0x7fc77406c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:04.529 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.524+0000 7fc77a291700 1 --2- 172.21.15.149:0/2891805176 >> v2:172.21.15.160:3300/0 conn(0x7fc77406ab80 0x7fc77406c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:04.529 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.524+0000 7fc77a291700 1 -- 172.21.15.149:0/2891805176 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc77406b5c0 con 0x7fc77415df40 2023-11-08T19:24:04.529 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.524+0000 7fc77a291700 1 --2- 172.21.15.149:0/2891805176 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc77415df40 0x7fc77406c0a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc77406d940 tx=0x7fc764009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccf99dd97bf1501d server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:04.530 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.524+0000 7fc77928f700 1 -- 172.21.15.149:0/2891805176 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76400b870 con 0x7fc77415df40 2023-11-08T19:24:04.530 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.524+0000 7fc77928f700 1 -- 172.21.15.149:0/2891805176 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc76400b9d0 con 0x7fc77415df40 2023-11-08T19:24:04.530 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.524+0000 7fc77928f700 1 -- 172.21.15.149:0/2891805176 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76400bd60 con 0x7fc77415df40 2023-11-08T19:24:04.530 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.524+0000 7fc77c4f5700 1 -- 172.21.15.149:0/2891805176 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc77415df40 msgr2=0x7fc77406c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:04.530 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.524+0000 7fc77c4f5700 1 --2- 172.21.15.149:0/2891805176 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc77415df40 0x7fc77406c0a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc77406d940 tx=0x7fc764009bd0 comp rx=0 tx=0).stop 2023-11-08T19:24:04.531 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.524+0000 7fc77c4f5700 1 -- 172.21.15.149:0/2891805176 shutdown_connections 2023-11-08T19:24:04.531 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.524+0000 7fc77c4f5700 1 --2- 172.21.15.149:0/2891805176 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc7740cf1c0 0x7fc7740caf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:04.531 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.524+0000 7fc77c4f5700 1 --2- 172.21.15.149:0/2891805176 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc77415df40 0x7fc77406c0a0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:04.531 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.524+0000 7fc77c4f5700 1 --2- 172.21.15.149:0/2891805176 >> v2:172.21.15.160:3300/0 conn(0x7fc77406ab80 0x7fc77406c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:04.531 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.524+0000 7fc77c4f5700 1 -- 172.21.15.149:0/2891805176 >> 172.21.15.149:0/2891805176 conn(0x7fc7740d0640 msgr2=0x7fc7740d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:04.532 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.524+0000 7fc77c4f5700 1 -- 172.21.15.149:0/2891805176 shutdown_connections 2023-11-08T19:24:04.532 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.525+0000 7fc77c4f5700 1 -- 172.21.15.149:0/2891805176 wait complete. 2023-11-08T19:24:04.535 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.526+0000 7fc77c4f5700 1 Processor -- start 2023-11-08T19:24:04.535 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.526+0000 7fc77c4f5700 1 -- start start 2023-11-08T19:24:04.535 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.526+0000 7fc77c4f5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc77406ab80 0x7fc7740ad460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:04.535 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.526+0000 7fc77c4f5700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc7740cf1c0 0x7fc77415e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:04.536 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.526+0000 7fc77c4f5700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc77415df40 0x7fc7740cd660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:04.536 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.526+0000 7fc77c4f5700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc77415e9f0 con 0x7fc77406ab80 2023-11-08T19:24:04.536 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.526+0000 7fc77c4f5700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc77415ec20 con 0x7fc77415df40 2023-11-08T19:24:04.536 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.526+0000 7fc77c4f5700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc77415ef00 con 0x7fc7740cf1c0 2023-11-08T19:24:04.536 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.527+0000 7fc77a291700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc77406ab80 0x7fc7740ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:04.537 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.527+0000 7fc77a291700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc77406ab80 0x7fc7740ad460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38940/0 (socket says 172.21.15.149:38940) 2023-11-08T19:24:04.537 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.527+0000 7fc77a291700 1 -- 172.21.15.149:0/3156648073 learned_addr learned my addr 172.21.15.149:0/3156648073 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:04.537 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.527+0000 7fc779a90700 1 --2- 172.21.15.149:0/3156648073 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc7740cf1c0 0x7fc77415e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:04.537 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.527+0000 7fc77aa92700 1 --2- 172.21.15.149:0/3156648073 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc77415df40 0x7fc7740cd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:04.537 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.527+0000 7fc77a291700 1 -- 172.21.15.149:0/3156648073 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc7740cf1c0 msgr2=0x7fc77415e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:04.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.527+0000 7fc77a291700 1 --2- 172.21.15.149:0/3156648073 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc7740cf1c0 0x7fc77415e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:04.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.527+0000 7fc77a291700 1 -- 172.21.15.149:0/3156648073 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc77415df40 msgr2=0x7fc7740cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:04.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.527+0000 7fc77a291700 1 --2- 172.21.15.149:0/3156648073 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc77415df40 0x7fc7740cd660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:04.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.527+0000 7fc77a291700 1 -- 172.21.15.149:0/3156648073 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc764009550 con 0x7fc77406ab80 2023-11-08T19:24:04.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.527+0000 7fc77aa92700 1 --2- 172.21.15.149:0/3156648073 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc77415df40 0x7fc7740cd660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:24:04.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.527+0000 7fc779a90700 1 --2- 172.21.15.149:0/3156648073 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc7740cf1c0 0x7fc77415e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:24:04.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.527+0000 7fc77a291700 1 --2- 172.21.15.149:0/3156648073 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc77406ab80 0x7fc7740ad460 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fc764000c00 tx=0x7fc764004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:04.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.527+0000 7fc76affd700 1 -- 172.21.15.149:0/3156648073 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc764004520 con 0x7fc77406ab80 2023-11-08T19:24:04.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.527+0000 7fc76affd700 1 -- 172.21.15.149:0/3156648073 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc76401e070 con 0x7fc77406ab80 2023-11-08T19:24:04.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.527+0000 7fc77c4f5700 1 -- 172.21.15.149:0/3156648073 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc77415f1e0 con 0x7fc77406ab80 2023-11-08T19:24:04.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.527+0000 7fc76affd700 1 -- 172.21.15.149:0/3156648073 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7640038c0 con 0x7fc77406ab80 2023-11-08T19:24:04.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.527+0000 7fc77c4f5700 1 -- 172.21.15.149:0/3156648073 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7741601a0 con 0x7fc77406ab80 2023-11-08T19:24:04.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.528+0000 7fc77c4f5700 1 -- 172.21.15.149:0/3156648073 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc77404f730 con 0x7fc77406ab80 2023-11-08T19:24:04.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.529+0000 7fc76affd700 1 -- 172.21.15.149:0/3156648073 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc764003a20 con 0x7fc77406ab80 2023-11-08T19:24:04.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.529+0000 7fc76affd700 1 --2- 172.21.15.149:0/3156648073 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc75806af00 0x7fc75806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:04.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.529+0000 7fc779a90700 1 --2- 172.21.15.149:0/3156648073 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc75806af00 0x7fc75806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:04.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.529+0000 7fc76affd700 1 -- 172.21.15.149:0/3156648073 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6749+0+0 (secure 0 0 0) 0x7fc764020070 con 0x7fc77406ab80 2023-11-08T19:24:04.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.530+0000 7fc779a90700 1 --2- 172.21.15.149:0/3156648073 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc75806af00 0x7fc75806d3c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc774073840 tx=0x7fc770008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:04.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.534+0000 7fc76affd700 1 -- 172.21.15.149:0/3156648073 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc764055c50 con 0x7fc77406ab80 2023-11-08T19:24:04.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:04.767+0000 7fc77c4f5700 1 -- 172.21.15.149:0/3156648073 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc77406c8a0 con 0x7fc77406ab80 2023-11-08T19:24:05.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.425+0000 7fc76affd700 1 -- 172.21.15.149:0/3156648073 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc7640150a0 con 0x7fc77406ab80 2023-11-08T19:24:05.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.428+0000 7fc77c4f5700 1 -- 172.21.15.149:0/3156648073 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc75806af00 msgr2=0x7fc75806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:05.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.428+0000 7fc77c4f5700 1 --2- 172.21.15.149:0/3156648073 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc75806af00 0x7fc75806d3c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc774073840 tx=0x7fc770008040 comp rx=0 tx=0).stop 2023-11-08T19:24:05.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.428+0000 7fc77c4f5700 1 -- 172.21.15.149:0/3156648073 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc77406ab80 msgr2=0x7fc7740ad460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:05.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.428+0000 7fc77c4f5700 1 --2- 172.21.15.149:0/3156648073 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc77406ab80 0x7fc7740ad460 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fc764000c00 tx=0x7fc764004750 comp rx=0 tx=0).stop 2023-11-08T19:24:05.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.428+0000 7fc77c4f5700 1 -- 172.21.15.149:0/3156648073 shutdown_connections 2023-11-08T19:24:05.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.428+0000 7fc77c4f5700 1 --2- 172.21.15.149:0/3156648073 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc75806af00 0x7fc75806d3c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:05.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.428+0000 7fc77c4f5700 1 --2- 172.21.15.149:0/3156648073 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc77415df40 0x7fc7740cd660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:05.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.428+0000 7fc77c4f5700 1 --2- 172.21.15.149:0/3156648073 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc77406ab80 0x7fc7740ad460 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:05.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.428+0000 7fc77c4f5700 1 --2- 172.21.15.149:0/3156648073 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc7740cf1c0 0x7fc77415e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:05.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.428+0000 7fc77c4f5700 1 -- 172.21.15.149:0/3156648073 >> 172.21.15.149:0/3156648073 conn(0x7fc7740d0640 msgr2=0x7fc77415cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:05.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.428+0000 7fc77c4f5700 1 -- 172.21.15.149:0/3156648073 shutdown_connections 2023-11-08T19:24:05.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.428+0000 7fc77c4f5700 1 -- 172.21.15.149:0/3156648073 wait complete. 2023-11-08T19:24:05.445 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-08T19:24:05.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.577+0000 7f3ba2ff1700 1 Processor -- start 2023-11-08T19:24:05.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.577+0000 7f3ba2ff1700 1 -- start start 2023-11-08T19:24:05.581 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.577+0000 7f3ba2ff1700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f3b9c0ceb40 0x7f3b9c0d22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:05.581 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.577+0000 7f3ba2ff1700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b9c0d2800 0x7f3b9c0d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:05.581 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.577+0000 7f3ba2ff1700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b9c0d1520 con 0x7f3b9c15da40 2023-11-08T19:24:05.581 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.577+0000 7f3ba2ff1700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b9c0cefa0 con 0x7f3b9c0ceb40 2023-11-08T19:24:05.582 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.577+0000 7f3ba2ff1700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9c0d3650 con 0x7f3b9c0d2800 2023-11-08T19:24:05.582 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.577+0000 7f3ba0d8d700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f3b9c15da40 0x7f3b9c0d2e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:40948/0 (socket says 172.21.15.149:40948) 2023-11-08T19:24:05.582 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.578+0000 7f3ba0d8d700 1 -- 172.21.15.149:0/813519529 learned_addr learned my addr 172.21.15.149:0/813519529 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:24:05.582 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.578+0000 7f3b9bfff700 1 --2- 172.21.15.149:0/813519529 >> v2:172.21.15.160:3300/0 conn(0x7f3b9c0ceb40 0x7f3b9c0d22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:05.582 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.578+0000 7f3ba158e700 1 --2- 172.21.15.149:0/813519529 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b9c0d2800 0x7f3b9c0d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:05.583 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.578+0000 7f3b9b7fe700 1 -- 172.21.15.149:0/813519529 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1175982273 0 0) 0x7f3b9c0d1520 con 0x7f3b9c15da40 2023-11-08T19:24:05.583 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.578+0000 7f3b9b7fe700 1 -- 172.21.15.149:0/813519529 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b8c0035b0 con 0x7f3b9c15da40 2023-11-08T19:24:05.583 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.578+0000 7f3b9bfff700 1 -- 172.21.15.149:0/813519529 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b9c0d2800 msgr2=0x7f3b9c0d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:05.583 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.578+0000 7f3b9bfff700 1 --2- 172.21.15.149:0/813519529 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b9c0d2800 0x7f3b9c0d0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:05.583 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.578+0000 7f3b9bfff700 1 -- 172.21.15.149:0/813519529 >> v1:172.21.15.149:6789/0 conn(0x7f3b9c15da40 legacy=0x7f3b9c0d2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:05.584 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.578+0000 7f3b9bfff700 1 -- 172.21.15.149:0/813519529 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b9c0d17e0 con 0x7f3b9c0ceb40 2023-11-08T19:24:05.584 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.578+0000 7f3ba158e700 1 --2- 172.21.15.149:0/813519529 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b9c0d2800 0x7f3b9c0d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:24:05.584 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.578+0000 7f3b9bfff700 1 --2- 172.21.15.149:0/813519529 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3b9c0ceb40 0x7f3b9c0d22c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3b88009840 tx=0x7f3b88009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50491244997a734 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:05.584 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.578+0000 7f3b9b7fe700 1 -- 172.21.15.149:0/813519529 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b88011830 con 0x7f3b9c0ceb40 2023-11-08T19:24:05.584 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.578+0000 7f3b9b7fe700 1 -- 172.21.15.149:0/813519529 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b88011990 con 0x7f3b9c0ceb40 2023-11-08T19:24:05.585 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.578+0000 7f3b9b7fe700 1 -- 172.21.15.149:0/813519529 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b88011d20 con 0x7f3b9c0ceb40 2023-11-08T19:24:05.585 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.579+0000 7f3ba2ff1700 1 -- 172.21.15.149:0/813519529 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3b9c0ceb40 msgr2=0x7f3b9c0d22c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:05.585 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.579+0000 7f3ba2ff1700 1 --2- 172.21.15.149:0/813519529 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3b9c0ceb40 0x7f3b9c0d22c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3b88009840 tx=0x7f3b88009b50 comp rx=0 tx=0).stop 2023-11-08T19:24:05.585 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.579+0000 7f3ba2ff1700 1 -- 172.21.15.149:0/813519529 shutdown_connections 2023-11-08T19:24:05.585 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.579+0000 7f3ba2ff1700 1 --2- 172.21.15.149:0/813519529 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b9c0d2800 0x7f3b9c0d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:05.586 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.579+0000 7f3ba2ff1700 1 --2- 172.21.15.149:0/813519529 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3b9c0ceb40 0x7f3b9c0d22c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:05.586 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.579+0000 7f3ba2ff1700 1 -- 172.21.15.149:0/813519529 >> 172.21.15.149:0/813519529 conn(0x7f3b9c06bd80 msgr2=0x7f3b9c06c190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:05.586 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.579+0000 7f3ba2ff1700 1 -- 172.21.15.149:0/813519529 shutdown_connections 2023-11-08T19:24:05.586 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.579+0000 7f3ba2ff1700 1 -- 172.21.15.149:0/813519529 wait complete. 2023-11-08T19:24:05.589 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.580+0000 7f3ba2ff1700 1 Processor -- start 2023-11-08T19:24:05.589 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.580+0000 7f3ba2ff1700 1 -- start start 2023-11-08T19:24:05.589 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.581+0000 7f3ba2ff1700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b9c0ceb40 0x7f3b9c0c9f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:05.590 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.581+0000 7f3ba2ff1700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3b9c0d2800 0x7f3b9c0c6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:05.590 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.581+0000 7f3ba2ff1700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b9c15da40 0x7f3b9c0b57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:05.590 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.581+0000 7f3ba2ff1700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9c0ca490 con 0x7f3b9c0ceb40 2023-11-08T19:24:05.590 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.581+0000 7f3ba2ff1700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9c0c9ac0 con 0x7f3b9c0d2800 2023-11-08T19:24:05.590 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.581+0000 7f3ba2ff1700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9c146730 con 0x7f3b9c15da40 2023-11-08T19:24:05.591 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.581+0000 7f3ba0d8d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b9c0ceb40 0x7f3b9c0c9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:05.591 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.581+0000 7f3ba0d8d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b9c0ceb40 0x7f3b9c0c9f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38952/0 (socket says 172.21.15.149:38952) 2023-11-08T19:24:05.591 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.581+0000 7f3ba0d8d700 1 -- 172.21.15.149:0/3438965227 learned_addr learned my addr 172.21.15.149:0/3438965227 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:05.591 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.581+0000 7f3b9bfff700 1 --2- 172.21.15.149:0/3438965227 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3b9c0d2800 0x7f3b9c0c6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:05.591 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.581+0000 7f3ba158e700 1 --2- 172.21.15.149:0/3438965227 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b9c15da40 0x7f3b9c0b57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:05.592 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.582+0000 7f3ba0d8d700 1 -- 172.21.15.149:0/3438965227 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b9c15da40 msgr2=0x7f3b9c0b57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:05.592 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.582+0000 7f3ba0d8d700 1 --2- 172.21.15.149:0/3438965227 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b9c15da40 0x7f3b9c0b57e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:05.592 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.582+0000 7f3ba0d8d700 1 -- 172.21.15.149:0/3438965227 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3b9c0d2800 msgr2=0x7f3b9c0c6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:05.592 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.582+0000 7f3ba0d8d700 1 --2- 172.21.15.149:0/3438965227 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3b9c0d2800 0x7f3b9c0c6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:05.592 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.582+0000 7f3ba0d8d700 1 -- 172.21.15.149:0/3438965227 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b94009a70 con 0x7f3b9c0ceb40 2023-11-08T19:24:05.593 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.582+0000 7f3ba158e700 1 --2- 172.21.15.149:0/3438965227 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b9c15da40 0x7f3b9c0b57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:24:05.593 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.582+0000 7f3ba0d8d700 1 --2- 172.21.15.149:0/3438965227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b9c0ceb40 0x7f3b9c0c9f50 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f3b9000c700 tx=0x7f3b9000cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:05.593 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.582+0000 7f3b997fa700 1 -- 172.21.15.149:0/3438965227 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b90005d70 con 0x7f3b9c0ceb40 2023-11-08T19:24:05.593 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.582+0000 7f3b997fa700 1 -- 172.21.15.149:0/3438965227 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b900070d0 con 0x7f3b9c0ceb40 2023-11-08T19:24:05.593 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.582+0000 7f3ba2ff1700 1 -- 172.21.15.149:0/3438965227 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b880094a0 con 0x7f3b9c0ceb40 2023-11-08T19:24:05.594 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.582+0000 7f3b997fa700 1 -- 172.21.15.149:0/3438965227 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b90007460 con 0x7f3b9c0ceb40 2023-11-08T19:24:05.594 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.582+0000 7f3ba2ff1700 1 -- 172.21.15.149:0/3438965227 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b9c0c9750 con 0x7f3b9c0ceb40 2023-11-08T19:24:05.594 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.583+0000 7f3ba2ff1700 1 -- 172.21.15.149:0/3438965227 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b9c0745f0 con 0x7f3b9c0ceb40 2023-11-08T19:24:05.594 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.583+0000 7f3b997fa700 1 -- 172.21.15.149:0/3438965227 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3b900075c0 con 0x7f3b9c0ceb40 2023-11-08T19:24:05.594 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.584+0000 7f3b997fa700 1 --2- 172.21.15.149:0/3438965227 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3b8006af00 0x7f3b8006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:05.595 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.584+0000 7f3b997fa700 1 -- 172.21.15.149:0/3438965227 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f3b90088ff0 con 0x7f3b9c0ceb40 2023-11-08T19:24:05.595 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.584+0000 7f3b9bfff700 1 --2- 172.21.15.149:0/3438965227 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3b8006af00 0x7f3b8006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:05.595 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.584+0000 7f3b9bfff700 1 --2- 172.21.15.149:0/3438965227 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3b8006af00 0x7f3b8006d3c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3b88000c00 tx=0x7f3b8801c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:05.595 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.589+0000 7f3b997fa700 1 -- 172.21.15.149:0/3438965227 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3b900bbca0 con 0x7f3b9c0ceb40 2023-11-08T19:24:05.780 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:05.779+0000 7f3ba2ff1700 1 -- 172.21.15.149:0/3438965227 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3b9c0c67d0 con 0x7f3b9c0ceb40 2023-11-08T19:24:06.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.431+0000 7f3b997fa700 1 -- 172.21.15.149:0/3438965227 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v28) v1 ==== 181+0+0 (secure 0 0 0) 0x7f3b90053c20 con 0x7f3b9c0ceb40 2023-11-08T19:24:06.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.435+0000 7f3ba2ff1700 1 -- 172.21.15.149:0/3438965227 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3b8006af00 msgr2=0x7f3b8006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:06.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.435+0000 7f3ba2ff1700 1 --2- 172.21.15.149:0/3438965227 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3b8006af00 0x7f3b8006d3c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3b88000c00 tx=0x7f3b8801c040 comp rx=0 tx=0).stop 2023-11-08T19:24:06.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.435+0000 7f3ba2ff1700 1 -- 172.21.15.149:0/3438965227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b9c0ceb40 msgr2=0x7f3b9c0c9f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:06.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.435+0000 7f3ba2ff1700 1 --2- 172.21.15.149:0/3438965227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b9c0ceb40 0x7f3b9c0c9f50 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f3b9000c700 tx=0x7f3b9000cac0 comp rx=0 tx=0).stop 2023-11-08T19:24:06.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.435+0000 7f3ba2ff1700 1 -- 172.21.15.149:0/3438965227 shutdown_connections 2023-11-08T19:24:06.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.435+0000 7f3ba2ff1700 1 --2- 172.21.15.149:0/3438965227 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3b8006af00 0x7f3b8006d3c0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:06.438 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.435+0000 7f3ba2ff1700 1 --2- 172.21.15.149:0/3438965227 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b9c15da40 0x7f3b9c0b57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:06.438 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.435+0000 7f3ba2ff1700 1 --2- 172.21.15.149:0/3438965227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b9c0ceb40 0x7f3b9c0c9f50 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:06.438 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.435+0000 7f3ba2ff1700 1 --2- 172.21.15.149:0/3438965227 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3b9c0d2800 0x7f3b9c0c6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:06.438 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.435+0000 7f3ba2ff1700 1 -- 172.21.15.149:0/3438965227 >> 172.21.15.149:0/3438965227 conn(0x7f3b9c06bd80 msgr2=0x7f3b9c0cddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:06.438 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.435+0000 7f3ba2ff1700 1 -- 172.21.15.149:0/3438965227 shutdown_connections 2023-11-08T19:24:06.439 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.436+0000 7f3ba2ff1700 1 -- 172.21.15.149:0/3438965227 wait complete. 2023-11-08T19:24:06.439 INFO:teuthology.orchestra.run.smithi149.stderr:pool 'cephfs_metadata' removed 2023-11-08T19:24:06.451 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-08T19:24:06.585 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.583+0000 7fd35bacb700 1 Processor -- start 2023-11-08T19:24:06.585 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.584+0000 7fd35bacb700 1 -- start start 2023-11-08T19:24:06.589 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.585+0000 7fd35bacb700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd35415dcd0 0x7fd354070470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:06.589 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.585+0000 7fd35bacb700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fd354072cd0 0x7fd35406ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:06.589 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.585+0000 7fd35bacb700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3540700d0 con 0x7fd35406b0c0 2023-11-08T19:24:06.590 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.585+0000 7fd35bacb700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd35415e0b0 con 0x7fd354072cd0 2023-11-08T19:24:06.590 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.585+0000 7fd35bacb700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd35406b510 con 0x7fd35415dcd0 2023-11-08T19:24:06.590 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.585+0000 7fd35a068700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fd35406b0c0 0x7fd3540b20e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:40966/0 (socket says 172.21.15.149:40966) 2023-11-08T19:24:06.590 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.585+0000 7fd35a068700 1 -- 172.21.15.149:0/1776542274 learned_addr learned my addr 172.21.15.149:0/1776542274 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:24:06.590 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.585+0000 7fd359066700 1 --2- 172.21.15.149:0/1776542274 >> v2:172.21.15.160:3300/0 conn(0x7fd354072cd0 0x7fd35406ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:06.591 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.585+0000 7fd359867700 1 --2- 172.21.15.149:0/1776542274 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd35415dcd0 0x7fd354070470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:06.591 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.585+0000 7fd358865700 1 -- 172.21.15.149:0/1776542274 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1188461220 0 0) 0x7fd3540700d0 con 0x7fd35406b0c0 2023-11-08T19:24:06.591 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.585+0000 7fd358865700 1 -- 172.21.15.149:0/1776542274 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3400035b0 con 0x7fd35406b0c0 2023-11-08T19:24:06.591 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.585+0000 7fd358865700 1 -- 172.21.15.149:0/1776542274 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 350934535 0 0) 0x7fd3400035b0 con 0x7fd35406b0c0 2023-11-08T19:24:06.591 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.585+0000 7fd358865700 1 -- 172.21.15.149:0/1776542274 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd35415dcd0 msgr2=0x7fd354070470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:06.592 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.585+0000 7fd358865700 1 --2- 172.21.15.149:0/1776542274 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd35415dcd0 0x7fd354070470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:06.592 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.585+0000 7fd358865700 1 -- 172.21.15.149:0/1776542274 >> v2:172.21.15.160:3300/0 conn(0x7fd354072cd0 msgr2=0x7fd35406ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:06.592 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.585+0000 7fd358865700 1 --2- 172.21.15.149:0/1776542274 >> v2:172.21.15.160:3300/0 conn(0x7fd354072cd0 0x7fd35406ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:06.592 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.585+0000 7fd358865700 1 -- 172.21.15.149:0/1776542274 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3540709b0 con 0x7fd35406b0c0 2023-11-08T19:24:06.592 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.585+0000 7fd358865700 1 -- 172.21.15.149:0/1776542274 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7fd34c0019f0 con 0x7fd35406b0c0 2023-11-08T19:24:06.592 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.585+0000 7fd358865700 1 -- 172.21.15.149:0/1776542274 >> v1:172.21.15.149:6789/0 conn(0x7fd35406b0c0 legacy=0x7fd3540b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:06.593 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.585+0000 7fd358865700 1 --2- 172.21.15.149:0/1776542274 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd340003a00 0x7fd340003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:06.593 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.585+0000 7fd358865700 1 --2- 172.21.15.149:0/1776542274 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd340004850 0x7fd340004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:06.593 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.585+0000 7fd358865700 1 --2- 172.21.15.149:0/1776542274 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd35415dcd0 0x7fd340005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:06.593 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.585+0000 7fd358865700 1 -- 172.21.15.149:0/1776542274 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd35415e0b0 con 0x7fd340003a00 2023-11-08T19:24:06.593 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.585+0000 7fd358865700 1 -- 172.21.15.149:0/1776542274 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd35406b510 con 0x7fd340004850 2023-11-08T19:24:06.594 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.585+0000 7fd358865700 1 -- 172.21.15.149:0/1776542274 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd34000ba10 con 0x7fd35415dcd0 2023-11-08T19:24:06.594 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.585+0000 7fd359066700 1 --2- 172.21.15.149:0/1776542274 >> v2:172.21.15.160:3300/0 conn(0x7fd354072cd0 0x7fd35406ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:24:06.594 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.585+0000 7fd359867700 1 --2- 172.21.15.149:0/1776542274 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd340003a00 0x7fd340003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:06.594 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.586+0000 7fd35a068700 1 --2- 172.21.15.149:0/1776542274 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd35415dcd0 0x7fd340005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:06.594 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.586+0000 7fd359066700 1 --2- 172.21.15.149:0/1776542274 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd340004850 0x7fd340004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:06.595 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.586+0000 7fd359867700 1 -- 172.21.15.149:0/1776542274 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd35415dcd0 msgr2=0x7fd340005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:06.595 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.586+0000 7fd359867700 1 --2- 172.21.15.149:0/1776542274 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd35415dcd0 0x7fd340005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:06.595 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.586+0000 7fd359867700 1 -- 172.21.15.149:0/1776542274 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd340004850 msgr2=0x7fd340004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:06.595 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.586+0000 7fd359867700 1 --2- 172.21.15.149:0/1776542274 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd340004850 0x7fd340004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:06.595 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.586+0000 7fd359867700 1 -- 172.21.15.149:0/1776542274 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3400035b0 con 0x7fd340003a00 2023-11-08T19:24:06.595 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.586+0000 7fd359867700 1 --2- 172.21.15.149:0/1776542274 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd340003a00 0x7fd340003e20 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fd344009b60 tx=0x7fd340005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8792719520766aad server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:06.596 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.586+0000 7fd358865700 1 -- 172.21.15.149:0/1776542274 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34400e6c0 con 0x7fd340003a00 2023-11-08T19:24:06.596 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.586+0000 7fd358865700 1 -- 172.21.15.149:0/1776542274 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd34400e820 con 0x7fd340003a00 2023-11-08T19:24:06.596 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.586+0000 7fd358865700 1 -- 172.21.15.149:0/1776542274 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34400eb90 con 0x7fd340003a00 2023-11-08T19:24:06.596 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.587+0000 7fd35bacb700 1 -- 172.21.15.149:0/1776542274 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd340003a00 msgr2=0x7fd340003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:06.596 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.587+0000 7fd35bacb700 1 --2- 172.21.15.149:0/1776542274 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd340003a00 0x7fd340003e20 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fd344009b60 tx=0x7fd340005880 comp rx=0 tx=0).stop 2023-11-08T19:24:06.597 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.587+0000 7fd35a068700 1 -- 172.21.15.149:0/1776542274 reap_dead start 2023-11-08T19:24:06.597 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.587+0000 7fd35bacb700 1 -- 172.21.15.149:0/1776542274 shutdown_connections 2023-11-08T19:24:06.597 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.587+0000 7fd35bacb700 1 -- 172.21.15.149:0/1776542274 >> 172.21.15.149:0/1776542274 conn(0x7fd3540cd0e0 msgr2=0x7fd3540cd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:06.597 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.587+0000 7fd35bacb700 1 -- 172.21.15.149:0/1776542274 shutdown_connections 2023-11-08T19:24:06.597 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.587+0000 7fd35bacb700 1 -- 172.21.15.149:0/1776542274 wait complete. 2023-11-08T19:24:06.597 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.588+0000 7fd35bacb700 1 Processor -- start 2023-11-08T19:24:06.598 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.588+0000 7fd35bacb700 1 -- start start 2023-11-08T19:24:06.600 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.589+0000 7fd35bacb700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd340003a00 0x7fd3541f0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:06.601 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.589+0000 7fd35bacb700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3540c6dc0 0x7fd35415ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:06.601 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.589+0000 7fd35bacb700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3541f6c70 0x7fd354160510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:06.601 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.589+0000 7fd35bacb700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3540adbe0 con 0x7fd3540c6dc0 2023-11-08T19:24:06.601 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.589+0000 7fd35bacb700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3541f4610 con 0x7fd3541f6c70 2023-11-08T19:24:06.602 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.589+0000 7fd35bacb700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3541f3a00 con 0x7fd340003a00 2023-11-08T19:24:06.602 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.589+0000 7fd359066700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3540c6dc0 0x7fd35415ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:06.602 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.589+0000 7fd359066700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3540c6dc0 0x7fd35415ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38974/0 (socket says 172.21.15.149:38974) 2023-11-08T19:24:06.602 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.589+0000 7fd359066700 1 -- 172.21.15.149:0/58429717 learned_addr learned my addr 172.21.15.149:0/58429717 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:06.602 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.589+0000 7fd35a068700 1 --2- 172.21.15.149:0/58429717 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3541f6c70 0x7fd354160510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:06.603 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.589+0000 7fd359867700 1 --2- 172.21.15.149:0/58429717 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd340003a00 0x7fd3541f0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:06.603 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.589+0000 7fd359066700 1 -- 172.21.15.149:0/58429717 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd340003a00 msgr2=0x7fd3541f0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:06.603 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.589+0000 7fd359066700 1 --2- 172.21.15.149:0/58429717 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd340003a00 0x7fd3541f0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:06.603 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.589+0000 7fd359066700 1 -- 172.21.15.149:0/58429717 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3541f6c70 msgr2=0x7fd354160510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:06.603 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.589+0000 7fd359066700 1 --2- 172.21.15.149:0/58429717 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3541f6c70 0x7fd354160510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:06.604 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.589+0000 7fd359066700 1 -- 172.21.15.149:0/58429717 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3541f3ce0 con 0x7fd3540c6dc0 2023-11-08T19:24:06.604 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.589+0000 7fd359867700 1 --2- 172.21.15.149:0/58429717 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd340003a00 0x7fd3541f0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:24:06.604 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.589+0000 7fd359066700 1 --2- 172.21.15.149:0/58429717 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3540c6dc0 0x7fd35415ffd0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fd350011d00 tx=0x7fd35000f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:06.604 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.589+0000 7fd34a7fc700 1 -- 172.21.15.149:0/58429717 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd35000fad0 con 0x7fd3540c6dc0 2023-11-08T19:24:06.604 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.589+0000 7fd34a7fc700 1 -- 172.21.15.149:0/58429717 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd35000fc30 con 0x7fd3540c6dc0 2023-11-08T19:24:06.605 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.589+0000 7fd35bacb700 1 -- 172.21.15.149:0/58429717 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3541f3fc0 con 0x7fd3540c6dc0 2023-11-08T19:24:06.605 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.589+0000 7fd34a7fc700 1 -- 172.21.15.149:0/58429717 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd350004030 con 0x7fd3540c6dc0 2023-11-08T19:24:06.605 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.589+0000 7fd35bacb700 1 -- 172.21.15.149:0/58429717 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3541f0f60 con 0x7fd3540c6dc0 2023-11-08T19:24:06.605 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.590+0000 7fd35bacb700 1 -- 172.21.15.149:0/58429717 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3540745f0 con 0x7fd3540c6dc0 2023-11-08T19:24:06.605 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.591+0000 7fd34a7fc700 1 -- 172.21.15.149:0/58429717 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd350004190 con 0x7fd3540c6dc0 2023-11-08T19:24:06.606 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.591+0000 7fd34a7fc700 1 --2- 172.21.15.149:0/58429717 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd33806af00 0x7fd33806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:06.606 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.591+0000 7fd34a7fc700 1 -- 172.21.15.149:0/58429717 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6311+0+0 (secure 0 0 0) 0x7fd350089cf0 con 0x7fd3540c6dc0 2023-11-08T19:24:06.606 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.591+0000 7fd359867700 1 --2- 172.21.15.149:0/58429717 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd33806af00 0x7fd33806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:06.606 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.592+0000 7fd359867700 1 --2- 172.21.15.149:0/58429717 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd33806af00 0x7fd33806d3c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd3540b3100 tx=0x7fd344008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:06.606 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.596+0000 7fd34a7fc700 1 -- 172.21.15.149:0/58429717 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd35008e070 con 0x7fd3540c6dc0 2023-11-08T19:24:06.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:06.784+0000 7fd35bacb700 1 -- 172.21.15.149:0/58429717 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd3540b65e0 con 0x7fd3540c6dc0 2023-11-08T19:24:07.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.440+0000 7fd34a7fc700 1 -- 172.21.15.149:0/58429717 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v29) v1 ==== 169+0+0 (secure 0 0 0) 0x7fd350022070 con 0x7fd3540c6dc0 2023-11-08T19:24:07.444 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.443+0000 7fd35bacb700 1 -- 172.21.15.149:0/58429717 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd33806af00 msgr2=0x7fd33806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:07.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.443+0000 7fd35bacb700 1 --2- 172.21.15.149:0/58429717 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd33806af00 0x7fd33806d3c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd3540b3100 tx=0x7fd344008030 comp rx=0 tx=0).stop 2023-11-08T19:24:07.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.443+0000 7fd35bacb700 1 -- 172.21.15.149:0/58429717 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3540c6dc0 msgr2=0x7fd35415ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:07.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.443+0000 7fd35bacb700 1 --2- 172.21.15.149:0/58429717 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3540c6dc0 0x7fd35415ffd0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fd350011d00 tx=0x7fd35000f520 comp rx=0 tx=0).stop 2023-11-08T19:24:07.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.443+0000 7fd35bacb700 1 -- 172.21.15.149:0/58429717 shutdown_connections 2023-11-08T19:24:07.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.443+0000 7fd35bacb700 1 --2- 172.21.15.149:0/58429717 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd33806af00 0x7fd33806d3c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:07.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.443+0000 7fd35bacb700 1 --2- 172.21.15.149:0/58429717 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3541f6c70 0x7fd354160510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:07.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.443+0000 7fd35bacb700 1 --2- 172.21.15.149:0/58429717 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd340003a00 0x7fd3541f0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:07.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.443+0000 7fd35bacb700 1 --2- 172.21.15.149:0/58429717 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3540c6dc0 0x7fd35415ffd0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:07.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.443+0000 7fd35bacb700 1 -- 172.21.15.149:0/58429717 >> 172.21.15.149:0/58429717 conn(0x7fd3540cd0e0 msgr2=0x7fd3540ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:07.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.443+0000 7fd35bacb700 1 -- 172.21.15.149:0/58429717 shutdown_connections 2023-11-08T19:24:07.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.444+0000 7fd35bacb700 1 -- 172.21.15.149:0/58429717 wait complete. 2023-11-08T19:24:07.447 INFO:teuthology.orchestra.run.smithi149.stderr:pool 'cephfs_data' removed 2023-11-08T19:24:07.462 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-11-08T19:24:07.599 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.598+0000 7f5916225700 1 Processor -- start 2023-11-08T19:24:07.599 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.598+0000 7f5916225700 1 -- start start 2023-11-08T19:24:07.602 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.599+0000 7f5916225700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f59100cbe10 0x7f59100cadc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:07.602 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.599+0000 7f5916225700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f591006c2a0 0x7f591015aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:07.602 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.599+0000 7f5916225700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f591015b090 con 0x7f591015a640 2023-11-08T19:24:07.602 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.599+0000 7f5916225700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f591015b370 con 0x7f591006c2a0 2023-11-08T19:24:07.603 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.599+0000 7f5916225700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59100ca5c0 con 0x7f59100cbe10 2023-11-08T19:24:07.603 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.599+0000 7f590ffff700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f591006c2a0 0x7f591015aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:07.603 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.599+0000 7f590f7fe700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f59100cbe10 0x7f59100cadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:07.603 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.599+0000 7f590f7fe700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f59100cbe10 0x7f59100cadc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.149:59268/0 (socket says 172.21.15.149:59268) 2023-11-08T19:24:07.603 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.599+0000 7f590effd700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f591015a640 0x7f591006bb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.149:52650/0 (socket says 172.21.15.149:52650) 2023-11-08T19:24:07.604 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.599+0000 7f590ffff700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f591006c2a0 0x7f591015aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.149:39976/0 (socket says 172.21.15.149:39976) 2023-11-08T19:24:07.604 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.599+0000 7f590f7fe700 1 -- 172.21.15.149:0/2014677234 learned_addr learned my addr 172.21.15.149:0/2014677234 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:07.604 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.599+0000 7f590ffff700 1 -- 172.21.15.149:0/2014677234 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f59100cbe10 msgr2=0x7f59100cadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:07.604 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.599+0000 7f590ffff700 1 --2- 172.21.15.149:0/2014677234 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f59100cbe10 0x7f59100cadc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:07.604 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.599+0000 7f590ffff700 1 -- 172.21.15.149:0/2014677234 >> v1:172.21.15.160:6789/0 conn(0x7f591015a640 legacy=0x7f591006bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:07.605 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.599+0000 7f590ffff700 1 -- 172.21.15.149:0/2014677234 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59100ca8a0 con 0x7f591006c2a0 2023-11-08T19:24:07.605 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.600+0000 7f590ffff700 1 --2- 172.21.15.149:0/2014677234 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f591006c2a0 0x7f591015aaa0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5908009d90 tx=0x7f590800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fcbe6d5d01060945 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:07.605 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.600+0000 7f590e7fc700 1 -- 172.21.15.149:0/2014677234 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f590800e070 con 0x7f591006c2a0 2023-11-08T19:24:07.605 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.600+0000 7f590e7fc700 1 -- 172.21.15.149:0/2014677234 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f590800bb20 con 0x7f591006c2a0 2023-11-08T19:24:07.605 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.600+0000 7f590e7fc700 1 -- 172.21.15.149:0/2014677234 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5908012430 con 0x7f591006c2a0 2023-11-08T19:24:07.606 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.600+0000 7f5916225700 1 -- 172.21.15.149:0/2014677234 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f591006c2a0 msgr2=0x7f591015aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:07.606 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.600+0000 7f5916225700 1 --2- 172.21.15.149:0/2014677234 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f591006c2a0 0x7f591015aaa0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5908009d90 tx=0x7f590800b330 comp rx=0 tx=0).stop 2023-11-08T19:24:07.606 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.600+0000 7f5916225700 1 -- 172.21.15.149:0/2014677234 shutdown_connections 2023-11-08T19:24:07.607 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.600+0000 7f5916225700 1 --2- 172.21.15.149:0/2014677234 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f591006c2a0 0x7f591015aaa0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:07.607 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.600+0000 7f5916225700 1 --2- 172.21.15.149:0/2014677234 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f59100cbe10 0x7f59100cadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:07.607 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.600+0000 7f5916225700 1 -- 172.21.15.149:0/2014677234 >> 172.21.15.149:0/2014677234 conn(0x7f5910071800 msgr2=0x7f5910071c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:07.607 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.600+0000 7f5916225700 1 -- 172.21.15.149:0/2014677234 shutdown_connections 2023-11-08T19:24:07.607 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.600+0000 7f5916225700 1 -- 172.21.15.149:0/2014677234 wait complete. 2023-11-08T19:24:07.610 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.601+0000 7f5916225700 1 Processor -- start 2023-11-08T19:24:07.610 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.602+0000 7f5916225700 1 -- start start 2023-11-08T19:24:07.610 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.602+0000 7f5916225700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f591006c2a0 0x7f59100b52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:07.611 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.602+0000 7f5916225700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59100cbe10 0x7f59100c3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:07.611 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.602+0000 7f5916225700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f591015a640 0x7f59100b33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:07.611 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.602+0000 7f5916225700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59100c47e0 con 0x7f591006c2a0 2023-11-08T19:24:07.611 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.602+0000 7f5916225700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59100c4220 con 0x7f59100cbe10 2023-11-08T19:24:07.611 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.602+0000 7f5916225700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59100c4500 con 0x7f591015a640 2023-11-08T19:24:07.612 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.602+0000 7f590f7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f591006c2a0 0x7f59100b52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:07.612 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.603+0000 7f590f7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f591006c2a0 0x7f59100b52f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38986/0 (socket says 172.21.15.149:38986) 2023-11-08T19:24:07.612 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.603+0000 7f590f7fe700 1 -- 172.21.15.149:0/486042340 learned_addr learned my addr 172.21.15.149:0/486042340 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:07.612 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.603+0000 7f590effd700 1 --2- 172.21.15.149:0/486042340 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59100cbe10 0x7f59100c3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:07.612 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.603+0000 7f590ffff700 1 --2- 172.21.15.149:0/486042340 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f591015a640 0x7f59100b33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:07.613 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.603+0000 7f590f7fe700 1 -- 172.21.15.149:0/486042340 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f591015a640 msgr2=0x7f59100b33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:07.613 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.603+0000 7f590f7fe700 1 --2- 172.21.15.149:0/486042340 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f591015a640 0x7f59100b33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:07.613 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.603+0000 7f590f7fe700 1 -- 172.21.15.149:0/486042340 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59100cbe10 msgr2=0x7f59100c3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:07.613 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.603+0000 7f590f7fe700 1 --2- 172.21.15.149:0/486042340 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59100cbe10 0x7f59100c3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:07.613 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.603+0000 7f590f7fe700 1 -- 172.21.15.149:0/486042340 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5908009a70 con 0x7f591006c2a0 2023-11-08T19:24:07.614 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.603+0000 7f590effd700 1 --2- 172.21.15.149:0/486042340 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59100cbe10 0x7f59100c3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:24:07.614 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.603+0000 7f590f7fe700 1 --2- 172.21.15.149:0/486042340 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f591006c2a0 0x7f59100b52f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f590000dd10 tx=0x7f59000103a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:07.614 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.603+0000 7f58f7fff700 1 -- 172.21.15.149:0/486042340 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5900012040 con 0x7f591006c2a0 2023-11-08T19:24:07.614 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.603+0000 7f58f7fff700 1 -- 172.21.15.149:0/486042340 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5900010dc0 con 0x7f591006c2a0 2023-11-08T19:24:07.614 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.603+0000 7f5916225700 1 -- 172.21.15.149:0/486042340 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5910155210 con 0x7f591006c2a0 2023-11-08T19:24:07.615 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.603+0000 7f58f7fff700 1 -- 172.21.15.149:0/486042340 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f590000b960 con 0x7f591006c2a0 2023-11-08T19:24:07.615 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.603+0000 7f5916225700 1 -- 172.21.15.149:0/486042340 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59100b5830 con 0x7f591006c2a0 2023-11-08T19:24:07.615 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.604+0000 7f5916225700 1 -- 172.21.15.149:0/486042340 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5910155860 con 0x7f591006c2a0 2023-11-08T19:24:07.615 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.605+0000 7f58f7fff700 1 -- 172.21.15.149:0/486042340 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5900018650 con 0x7f591006c2a0 2023-11-08T19:24:07.615 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.605+0000 7f58f7fff700 1 --2- 172.21.15.149:0/486042340 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f58fc06af00 0x7f58fc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:07.615 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.605+0000 7f58f7fff700 1 -- 172.21.15.149:0/486042340 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5781+0+0 (secure 0 0 0) 0x7f590008b8c0 con 0x7f591006c2a0 2023-11-08T19:24:07.616 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.605+0000 7f590effd700 1 --2- 172.21.15.149:0/486042340 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f58fc06af00 0x7f58fc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:07.616 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.605+0000 7f590effd700 1 --2- 172.21.15.149:0/486042340 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f58fc06af00 0x7f58fc06d3c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f59100c59b0 tx=0x7f5904007df0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:07.616 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.610+0000 7f58f7fff700 1 -- 172.21.15.149:0/486042340 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5900056920 con 0x7f591006c2a0 2023-11-08T19:24:07.785 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T19:24:07.788 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T19:24:07.801 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:07.800+0000 7f5916225700 1 -- 172.21.15.149:0/486042340 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5910155050 con 0x7f591006c2a0 2023-11-08T19:24:08.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.447+0000 7f58f7fff700 1 -- 172.21.15.149:0/486042340 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v30) v1 ==== 178+0+0 (secure 0 0 0) 0x7f5900059f40 con 0x7f591006c2a0 2023-11-08T19:24:08.451 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.449+0000 7f5916225700 1 -- 172.21.15.149:0/486042340 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f58fc06af00 msgr2=0x7f58fc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:08.451 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.449+0000 7f5916225700 1 --2- 172.21.15.149:0/486042340 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f58fc06af00 0x7f58fc06d3c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f59100c59b0 tx=0x7f5904007df0 comp rx=0 tx=0).stop 2023-11-08T19:24:08.451 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.449+0000 7f5916225700 1 -- 172.21.15.149:0/486042340 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f591006c2a0 msgr2=0x7f59100b52f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:08.451 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.449+0000 7f5916225700 1 --2- 172.21.15.149:0/486042340 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f591006c2a0 0x7f59100b52f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f590000dd10 tx=0x7f59000103a0 comp rx=0 tx=0).stop 2023-11-08T19:24:08.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.449+0000 7f5916225700 1 -- 172.21.15.149:0/486042340 shutdown_connections 2023-11-08T19:24:08.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.449+0000 7f5916225700 1 --2- 172.21.15.149:0/486042340 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f58fc06af00 0x7f58fc06d3c0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:08.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.450+0000 7f5916225700 1 --2- 172.21.15.149:0/486042340 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f591015a640 0x7f59100b33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:08.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.450+0000 7f5916225700 1 --2- 172.21.15.149:0/486042340 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f591006c2a0 0x7f59100b52f0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:08.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.450+0000 7f5916225700 1 --2- 172.21.15.149:0/486042340 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59100cbe10 0x7f59100c3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:08.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.450+0000 7f5916225700 1 -- 172.21.15.149:0/486042340 >> 172.21.15.149:0/486042340 conn(0x7f5910071800 msgr2=0x7f59100b0450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:08.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.450+0000 7f5916225700 1 -- 172.21.15.149:0/486042340 shutdown_connections 2023-11-08T19:24:08.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.450+0000 7f5916225700 1 -- 172.21.15.149:0/486042340 wait complete. 2023-11-08T19:24:08.453 INFO:teuthology.orchestra.run.smithi149.stderr:pool 'cephfs_data_ec' removed 2023-11-08T19:24:08.464 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-08T19:24:08.464 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-08T19:24:08.465 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-08T19:24:08.465 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T19:24:08.465 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-08T19:24:08.466 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-08T19:24:08.466 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-08T19:24:08.466 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T19:24:08.467 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-08T19:24:08.467 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-08T19:24:08.467 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-08T19:24:08.467 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T19:24:08.468 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-08T19:24:08.468 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-08T19:24:08.468 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-08T19:24:08.469 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T19:24:08.474 INFO:tasks.ceph.mds.a:Stopped 2023-11-08T19:24:08.474 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-08T19:24:08.475 INFO:tasks.ceph.mds.c:Stopped 2023-11-08T19:24:08.476 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-08T19:24:08.478 INFO:tasks.ceph.mds.b:Stopped 2023-11-08T19:24:08.479 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-08T19:24:08.480 INFO:tasks.ceph.mds.d:Stopped 2023-11-08T19:24:08.480 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-08T19:24:08.518 INFO:tasks.ceph.mds.a:Started 2023-11-08T19:24:08.519 DEBUG:teuthology.parallel:result is None 2023-11-08T19:24:08.520 INFO:tasks.ceph.mds.c:Started 2023-11-08T19:24:08.520 DEBUG:teuthology.parallel:result is None 2023-11-08T19:24:08.521 INFO:tasks.ceph.mds.b:Started 2023-11-08T19:24:08.521 DEBUG:teuthology.parallel:result is None 2023-11-08T19:24:08.522 INFO:tasks.ceph.mds.d:Started 2023-11-08T19:24:08.523 DEBUG:teuthology.parallel:result is None 2023-11-08T19:24:08.523 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-08T19:24:08.610 INFO:tasks.ceph.mds.b.smithi160.stdout:starting mds.b at 2023-11-08T19:24:08.610 INFO:tasks.ceph.mds.d.smithi160.stdout:starting mds.d at 2023-11-08T19:24:08.611 INFO:tasks.ceph.mds.b.smithi160.stderr:2023-11-08T19:24:08.609+0000 7f693a824700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2023-11-08T19:24:08.621 INFO:tasks.ceph.mds.a.smithi149.stdout:starting mds.a at 2023-11-08T19:24:08.622 INFO:tasks.ceph.mds.c.smithi149.stdout:starting mds.c at 2023-11-08T19:24:08.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.665+0000 7f3884bf1700 1 Processor -- start 2023-11-08T19:24:08.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.665+0000 7f3884bf1700 1 -- start start 2023-11-08T19:24:08.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.666+0000 7f3884bf1700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3880161a50 0x7f3880161f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:08.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.666+0000 7f3884bf1700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f38800ce500 0x7f38800ce990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:08.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.666+0000 7f3884bf1700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38800d1a10 con 0x7f3880161670 2023-11-08T19:24:08.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.666+0000 7f3884bf1700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38800d1cf0 con 0x7f3880161a50 2023-11-08T19:24:08.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.666+0000 7f3884bf1700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38800d1fd0 con 0x7f38800ce500 2023-11-08T19:24:08.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.666+0000 7f387dd9b700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3880161a50 0x7f3880161f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:08.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.666+0000 7f387dd9b700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3880161a50 0x7f3880161f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39020/0 (socket says 172.21.15.149:39020) 2023-11-08T19:24:08.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.666+0000 7f387dd9b700 1 -- 172.21.15.149:0/1450678467 learned_addr learned my addr 172.21.15.149:0/1450678467 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:08.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.667+0000 7f387ed9d700 1 --2- 172.21.15.149:0/1450678467 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f38800ce500 0x7f38800ce990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:08.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.667+0000 7f387dd9b700 1 -- 172.21.15.149:0/1450678467 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f38800ce500 msgr2=0x7f38800ce990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:08.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.667+0000 7f387d59a700 1 -- 172.21.15.149:0/1450678467 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3005080364 0 0) 0x7f38800d1a10 con 0x7f3880161670 2023-11-08T19:24:08.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.667+0000 7f387dd9b700 1 --2- 172.21.15.149:0/1450678467 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f38800ce500 0x7f38800ce990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:08.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.667+0000 7f387dd9b700 1 -- 172.21.15.149:0/1450678467 >> v1:172.21.15.160:6789/0 conn(0x7f3880161670 legacy=0x7f38800b5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:08.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.667+0000 7f387dd9b700 1 -- 172.21.15.149:0/1450678467 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38800d22b0 con 0x7f3880161a50 2023-11-08T19:24:08.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.667+0000 7f387ed9d700 1 --2- 172.21.15.149:0/1450678467 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f38800ce500 0x7f38800ce990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:24:08.672 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.667+0000 7f387dd9b700 1 --2- 172.21.15.149:0/1450678467 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3880161a50 0x7f3880161f00 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f38740098f0 tx=0x7f3874009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1582c35fa1c6afd2 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:08.672 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.667+0000 7f387d59a700 1 -- 172.21.15.149:0/1450678467 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3874011830 con 0x7f3880161a50 2023-11-08T19:24:08.672 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.667+0000 7f387d59a700 1 -- 172.21.15.149:0/1450678467 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3874011990 con 0x7f3880161a50 2023-11-08T19:24:08.672 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.667+0000 7f387d59a700 1 -- 172.21.15.149:0/1450678467 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3874011d20 con 0x7f3880161a50 2023-11-08T19:24:08.672 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.668+0000 7f3884bf1700 1 -- 172.21.15.149:0/1450678467 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3880161a50 msgr2=0x7f3880161f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:08.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.668+0000 7f3884bf1700 1 --2- 172.21.15.149:0/1450678467 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3880161a50 0x7f3880161f00 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f38740098f0 tx=0x7f3874009c00 comp rx=0 tx=0).stop 2023-11-08T19:24:08.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.668+0000 7f3884bf1700 1 -- 172.21.15.149:0/1450678467 shutdown_connections 2023-11-08T19:24:08.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.668+0000 7f3884bf1700 1 --2- 172.21.15.149:0/1450678467 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f38800ce500 0x7f38800ce990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:08.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.668+0000 7f3884bf1700 1 --2- 172.21.15.149:0/1450678467 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3880161a50 0x7f3880161f00 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:08.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.668+0000 7f3884bf1700 1 -- 172.21.15.149:0/1450678467 >> 172.21.15.149:0/1450678467 conn(0x7f38800d3980 msgr2=0x7f38800d3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:08.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.668+0000 7f3884bf1700 1 -- 172.21.15.149:0/1450678467 shutdown_connections 2023-11-08T19:24:08.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.668+0000 7f3884bf1700 1 -- 172.21.15.149:0/1450678467 wait complete. 2023-11-08T19:24:08.676 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.669+0000 7f3884bf1700 1 Processor -- start 2023-11-08T19:24:08.677 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.670+0000 7f3884bf1700 1 -- start start 2023-11-08T19:24:08.677 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.670+0000 7f3884bf1700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38800ce500 0x7f388014fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:08.677 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.670+0000 7f3884bf1700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3880161670 0x7f38800cd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:08.677 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.670+0000 7f3884bf1700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3880161a50 0x7f3880152d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:08.677 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.670+0000 7f3884bf1700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38800b45b0 con 0x7f3880161a50 2023-11-08T19:24:08.678 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.670+0000 7f3884bf1700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38800b4890 con 0x7f38800ce500 2023-11-08T19:24:08.678 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.670+0000 7f3884bf1700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38800b4b70 con 0x7f3880161670 2023-11-08T19:24:08.678 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.671+0000 7f387ed9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3880161a50 0x7f3880152d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:08.678 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.671+0000 7f387ed9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3880161a50 0x7f3880152d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39028/0 (socket says 172.21.15.149:39028) 2023-11-08T19:24:08.678 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.671+0000 7f387ed9d700 1 -- 172.21.15.149:0/316267084 learned_addr learned my addr 172.21.15.149:0/316267084 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:08.679 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.671+0000 7f387e59c700 1 --2- 172.21.15.149:0/316267084 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38800ce500 0x7f388014fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:08.679 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.671+0000 7f387dd9b700 1 --2- 172.21.15.149:0/316267084 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3880161670 0x7f38800cd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:08.679 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.671+0000 7f387ed9d700 1 -- 172.21.15.149:0/316267084 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3880161670 msgr2=0x7f38800cd0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:08.679 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.671+0000 7f387ed9d700 1 --2- 172.21.15.149:0/316267084 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3880161670 0x7f38800cd0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:08.679 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.671+0000 7f387ed9d700 1 -- 172.21.15.149:0/316267084 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38800ce500 msgr2=0x7f388014fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:08.679 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.671+0000 7f387ed9d700 1 --2- 172.21.15.149:0/316267084 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38800ce500 0x7f388014fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:08.680 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.671+0000 7f387ed9d700 1 -- 172.21.15.149:0/316267084 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38700094a0 con 0x7f3880161a50 2023-11-08T19:24:08.680 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.671+0000 7f387ed9d700 1 --2- 172.21.15.149:0/316267084 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3880161a50 0x7f3880152d90 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f387000eb60 tx=0x7f387000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:08.680 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.671+0000 7f386effd700 1 -- 172.21.15.149:0/316267084 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38700097a0 con 0x7f3880161a50 2023-11-08T19:24:08.680 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.671+0000 7f386effd700 1 -- 172.21.15.149:0/316267084 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3870009e60 con 0x7f3880161a50 2023-11-08T19:24:08.680 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.671+0000 7f3884bf1700 1 -- 172.21.15.149:0/316267084 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3874009550 con 0x7f3880161a50 2023-11-08T19:24:08.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.671+0000 7f386effd700 1 -- 172.21.15.149:0/316267084 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3870004240 con 0x7f3880161a50 2023-11-08T19:24:08.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.671+0000 7f3884bf1700 1 -- 172.21.15.149:0/316267084 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38800b5130 con 0x7f3880161a50 2023-11-08T19:24:08.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.672+0000 7f3884bf1700 1 -- 172.21.15.149:0/316267084 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38800d2570 con 0x7f3880161a50 2023-11-08T19:24:08.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.673+0000 7f386effd700 1 -- 172.21.15.149:0/316267084 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f38700043c0 con 0x7f3880161a50 2023-11-08T19:24:08.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.673+0000 7f386effd700 1 --2- 172.21.15.149:0/316267084 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f386006af00 0x7f386006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:08.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.673+0000 7f386effd700 1 -- 172.21.15.149:0/316267084 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f3870089090 con 0x7f3880161a50 2023-11-08T19:24:08.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.673+0000 7f387e59c700 1 --2- 172.21.15.149:0/316267084 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f386006af00 0x7f386006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:08.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.674+0000 7f387e59c700 1 --2- 172.21.15.149:0/316267084 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f386006af00 0x7f386006d3c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3878001330 tx=0x7f3878009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:08.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.678+0000 7f386effd700 1 -- 172.21.15.149:0/316267084 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f38800d2570 con 0x7f3880161a50 2023-11-08T19:24:08.882 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:08.881+0000 7f3884bf1700 1 -- 172.21.15.149:0/316267084 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f38800d2570 con 0x7f3880161a50 2023-11-08T19:24:10.109 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.108+0000 7f386effd700 1 -- 172.21.15.149:0/316267084 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v35) v1 ==== 97+0+0 (secure 0 0 0) 0x7f38800d2570 con 0x7f3880161a50 2023-11-08T19:24:10.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.111+0000 7f3884bf1700 1 -- 172.21.15.149:0/316267084 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f386006af00 msgr2=0x7f386006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:10.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.111+0000 7f3884bf1700 1 --2- 172.21.15.149:0/316267084 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f386006af00 0x7f386006d3c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3878001330 tx=0x7f3878009040 comp rx=0 tx=0).stop 2023-11-08T19:24:10.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.111+0000 7f3884bf1700 1 -- 172.21.15.149:0/316267084 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3880161a50 msgr2=0x7f3880152d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:10.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.111+0000 7f3884bf1700 1 --2- 172.21.15.149:0/316267084 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3880161a50 0x7f3880152d90 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f387000eb60 tx=0x7f387000ee70 comp rx=0 tx=0).stop 2023-11-08T19:24:10.114 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.111+0000 7f3884bf1700 1 -- 172.21.15.149:0/316267084 shutdown_connections 2023-11-08T19:24:10.114 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.111+0000 7f3884bf1700 1 --2- 172.21.15.149:0/316267084 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f386006af00 0x7f386006d3c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:10.114 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.111+0000 7f3884bf1700 1 --2- 172.21.15.149:0/316267084 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38800ce500 0x7f388014fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:10.114 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.111+0000 7f3884bf1700 1 --2- 172.21.15.149:0/316267084 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3880161a50 0x7f3880152d90 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:10.114 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.111+0000 7f3884bf1700 1 --2- 172.21.15.149:0/316267084 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3880161670 0x7f38800cd0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:10.115 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.111+0000 7f3884bf1700 1 -- 172.21.15.149:0/316267084 >> 172.21.15.149:0/316267084 conn(0x7f38800d3980 msgr2=0x7f38800d3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:10.115 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.111+0000 7f3884bf1700 1 -- 172.21.15.149:0/316267084 shutdown_connections 2023-11-08T19:24:10.115 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.111+0000 7f3884bf1700 1 -- 172.21.15.149:0/316267084 wait complete. 2023-11-08T19:24:10.115 INFO:teuthology.orchestra.run.smithi149.stderr: removed all blocklist entries 2023-11-08T19:24:10.126 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-08T19:24:10.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.247+0000 7f908e328700 1 Processor -- start 2023-11-08T19:24:10.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.247+0000 7f908e328700 1 -- start start 2023-11-08T19:24:10.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.248+0000 7f908e328700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f90880cc140 0x7f90880cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:10.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.248+0000 7f908e328700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f90880b2850 0x7f90880cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:10.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.248+0000 7f908e328700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90880cce50 con 0x7f90880b2cd0 2023-11-08T19:24:10.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.248+0000 7f908e328700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90880b2430 con 0x7f90880b2850 2023-11-08T19:24:10.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.248+0000 7f908e328700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90880cc520 con 0x7f90880cc140 2023-11-08T19:24:10.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.248+0000 7f90877fe700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f90880b2850 0x7f90880cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:10.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.248+0000 7f9087fff700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f90880cc140 0x7f90880cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:10.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.248+0000 7f9087fff700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f90880cc140 0x7f90880cc910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.149:59324/0 (socket says 172.21.15.149:59324) 2023-11-08T19:24:10.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.248+0000 7f9087fff700 1 -- 172.21.15.149:0/1616530993 learned_addr learned my addr 172.21.15.149:0/1616530993 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:10.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.249+0000 7f9087fff700 1 -- 172.21.15.149:0/1616530993 >> v2:172.21.15.160:3300/0 conn(0x7f90880b2850 msgr2=0x7f90880cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:10.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.249+0000 7f9087fff700 1 --2- 172.21.15.149:0/1616530993 >> v2:172.21.15.160:3300/0 conn(0x7f90880b2850 0x7f90880cabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:10.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.249+0000 7f9087fff700 1 -- 172.21.15.149:0/1616530993 >> v1:172.21.15.160:6789/0 conn(0x7f90880b2cd0 legacy=0x7f908815d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:10.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.249+0000 7f9087fff700 1 -- 172.21.15.149:0/1616530993 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90880b17b0 con 0x7f90880cc140 2023-11-08T19:24:10.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.249+0000 7f9087fff700 1 --2- 172.21.15.149:0/1616530993 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f90880cc140 0x7f90880cc910 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f907c006fd0 tx=0x7f907c009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b139648019074ffa server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:10.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.249+0000 7f9086ffd700 1 -- 172.21.15.149:0/1616530993 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907c005e30 con 0x7f90880cc140 2023-11-08T19:24:10.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.249+0000 7f9086ffd700 1 -- 172.21.15.149:0/1616530993 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f907c004030 con 0x7f90880cc140 2023-11-08T19:24:10.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.249+0000 7f9086ffd700 1 -- 172.21.15.149:0/1616530993 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907c0043e0 con 0x7f90880cc140 2023-11-08T19:24:10.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.249+0000 7f908e328700 1 -- 172.21.15.149:0/1616530993 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f90880cc140 msgr2=0x7f90880cc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:10.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.249+0000 7f908e328700 1 --2- 172.21.15.149:0/1616530993 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f90880cc140 0x7f90880cc910 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f907c006fd0 tx=0x7f907c009bd0 comp rx=0 tx=0).stop 2023-11-08T19:24:10.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.249+0000 7f908e328700 1 -- 172.21.15.149:0/1616530993 shutdown_connections 2023-11-08T19:24:10.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.249+0000 7f908e328700 1 --2- 172.21.15.149:0/1616530993 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f90880cc140 0x7f90880cc910 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:10.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.249+0000 7f908e328700 1 --2- 172.21.15.149:0/1616530993 >> v2:172.21.15.160:3300/0 conn(0x7f90880b2850 0x7f90880cabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:10.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.249+0000 7f908e328700 1 -- 172.21.15.149:0/1616530993 >> 172.21.15.149:0/1616530993 conn(0x7f9088099a40 msgr2=0x7f90880d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:10.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.250+0000 7f908e328700 1 -- 172.21.15.149:0/1616530993 shutdown_connections 2023-11-08T19:24:10.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.250+0000 7f908e328700 1 -- 172.21.15.149:0/1616530993 wait complete. 2023-11-08T19:24:10.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.251+0000 7f908e328700 1 Processor -- start 2023-11-08T19:24:10.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.251+0000 7f908e328700 1 -- start start 2023-11-08T19:24:10.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.252+0000 7f908e328700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90880b2850 0x7f90881f38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:10.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.252+0000 7f908e328700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f90880b2cd0 0x7f90881559f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:10.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.252+0000 7f908e328700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90880cc140 0x7f90880c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:10.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.252+0000 7f908e328700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f908815f4c0 con 0x7f90880cc140 2023-11-08T19:24:10.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.252+0000 7f908e328700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90881f4ca0 con 0x7f90880b2850 2023-11-08T19:24:10.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.252+0000 7f908e328700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90881f3e00 con 0x7f90880b2cd0 2023-11-08T19:24:10.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.252+0000 7f908c8c5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90880cc140 0x7f90880c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:10.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.252+0000 7f908c8c5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90880cc140 0x7f90880c84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39046/0 (socket says 172.21.15.149:39046) 2023-11-08T19:24:10.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.252+0000 7f908c8c5700 1 -- 172.21.15.149:0/532508915 learned_addr learned my addr 172.21.15.149:0/532508915 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:10.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.252+0000 7f9087fff700 1 --2- 172.21.15.149:0/532508915 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90880b2850 0x7f90881f38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:10.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.252+0000 7f90877fe700 1 --2- 172.21.15.149:0/532508915 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f90880b2cd0 0x7f90881559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:10.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.252+0000 7f908c8c5700 1 -- 172.21.15.149:0/532508915 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f90880b2cd0 msgr2=0x7f90881559f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:10.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.252+0000 7f908c8c5700 1 --2- 172.21.15.149:0/532508915 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f90880b2cd0 0x7f90881559f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:10.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.252+0000 7f908c8c5700 1 -- 172.21.15.149:0/532508915 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90880b2850 msgr2=0x7f90881f38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:10.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.252+0000 7f908c8c5700 1 --2- 172.21.15.149:0/532508915 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90880b2850 0x7f90881f38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:10.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.252+0000 7f908c8c5700 1 -- 172.21.15.149:0/532508915 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f907c009500 con 0x7f90880cc140 2023-11-08T19:24:10.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.252+0000 7f908c8c5700 1 --2- 172.21.15.149:0/532508915 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90880cc140 0x7f90880c84d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f908000cc80 tx=0x7f908000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:10.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.252+0000 7f9084ff9700 1 -- 172.21.15.149:0/532508915 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9080003c00 con 0x7f90880cc140 2023-11-08T19:24:10.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.252+0000 7f9084ff9700 1 -- 172.21.15.149:0/532508915 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9080003d60 con 0x7f90880cc140 2023-11-08T19:24:10.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.252+0000 7f908e328700 1 -- 172.21.15.149:0/532508915 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9088155f30 con 0x7f90880cc140 2023-11-08T19:24:10.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.252+0000 7f9084ff9700 1 -- 172.21.15.149:0/532508915 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908000aaa0 con 0x7f90880cc140 2023-11-08T19:24:10.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.252+0000 7f908e328700 1 -- 172.21.15.149:0/532508915 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90881f4370 con 0x7f90880cc140 2023-11-08T19:24:10.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.253+0000 7f908e328700 1 -- 172.21.15.149:0/532508915 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90881f4e30 con 0x7f90880cc140 2023-11-08T19:24:10.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.254+0000 7f9084ff9700 1 -- 172.21.15.149:0/532508915 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f908000ac00 con 0x7f90880cc140 2023-11-08T19:24:10.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.254+0000 7f9084ff9700 1 --2- 172.21.15.149:0/532508915 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f907406af30 0x7f907406d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:10.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.254+0000 7f9084ff9700 1 -- 172.21.15.149:0/532508915 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f90800893a0 con 0x7f90880cc140 2023-11-08T19:24:10.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.254+0000 7f9087fff700 1 --2- 172.21.15.149:0/532508915 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f907406af30 0x7f907406d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:10.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.255+0000 7f9087fff700 1 --2- 172.21.15.149:0/532508915 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f907406af30 0x7f907406d3f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f907c006fd0 tx=0x7f907c008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:10.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.259+0000 7f9084ff9700 1 -- 172.21.15.149:0/532508915 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9080054660 con 0x7f90880cc140 2023-11-08T19:24:10.528 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.527+0000 7f908e328700 1 -- 172.21.15.149:0/532508915 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f90880ced60 con 0x7f90880cc140 2023-11-08T19:24:10.529 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.528+0000 7f9084ff9700 1 -- 172.21.15.149:0/532508915 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f9080057c80 con 0x7f90880cc140 2023-11-08T19:24:10.529 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:24:10.529 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2023-11-08T19:24:10.530 INFO:teuthology.orchestra.run.smithi149.stdout: "auth_dump": [ 2023-11-08T19:24:10.530 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:24:10.530 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "mds.a", 2023-11-08T19:24:10.530 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDi30tlcD8lHxAAxmvMr1hdJWLyJ0wOQhILow==", 2023-11-08T19:24:10.531 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:24:10.531 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow", 2023-11-08T19:24:10.531 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow *", 2023-11-08T19:24:10.531 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow *", 2023-11-08T19:24:10.531 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:24:10.532 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:24:10.532 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:24:10.532 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:24:10.532 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "mds.b", 2023-11-08T19:24:10.532 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDi30tl0d56KxAA42ebu7JWPHSW2Y+aUT9G8Q==", 2023-11-08T19:24:10.533 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:24:10.533 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow", 2023-11-08T19:24:10.533 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow *", 2023-11-08T19:24:10.533 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow *", 2023-11-08T19:24:10.533 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:24:10.533 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:24:10.534 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:24:10.534 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:24:10.534 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "mds.c", 2023-11-08T19:24:10.534 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDi30tl+SliJhAAznNm6dtyajBE0T8WKqdhhw==", 2023-11-08T19:24:10.534 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:24:10.535 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow", 2023-11-08T19:24:10.535 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow *", 2023-11-08T19:24:10.535 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow *", 2023-11-08T19:24:10.535 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:24:10.535 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:24:10.536 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:24:10.536 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:24:10.536 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "mds.d", 2023-11-08T19:24:10.536 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDi30tl9sLWMhAACaIzwVjIgVky9P6tAK9/rw==", 2023-11-08T19:24:10.536 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:24:10.536 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow", 2023-11-08T19:24:10.537 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow *", 2023-11-08T19:24:10.537 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow *", 2023-11-08T19:24:10.537 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:24:10.537 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:24:10.537 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:24:10.538 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:24:10.538 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "osd.0", 2023-11-08T19:24:10.538 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDm30tl1SLuEBAA8gYyfPfXV+rd7sXTr5NytA==", 2023-11-08T19:24:10.538 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:24:10.538 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow profile osd", 2023-11-08T19:24:10.539 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile osd", 2023-11-08T19:24:10.539 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:24:10.539 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:24:10.539 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:24:10.539 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:24:10.540 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "osd.1", 2023-11-08T19:24:10.540 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDp30tllvSCEBAAgyXiQm+ld9zVjv2Uo2UilA==", 2023-11-08T19:24:10.540 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:24:10.540 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow profile osd", 2023-11-08T19:24:10.540 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile osd", 2023-11-08T19:24:10.541 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:24:10.541 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:24:10.541 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:24:10.541 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:24:10.541 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "osd.2", 2023-11-08T19:24:10.542 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDs30tlGvZ9DxAAzOPbDXlbk+oxHvXhNfPnNQ==", 2023-11-08T19:24:10.542 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:24:10.542 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow profile osd", 2023-11-08T19:24:10.542 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile osd", 2023-11-08T19:24:10.543 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:24:10.543 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:24:10.543 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:24:10.543 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:24:10.543 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "osd.3", 2023-11-08T19:24:10.543 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDv30tlg0i3DhAAKEy9WQ+VBcJMuKALuYVTEg==", 2023-11-08T19:24:10.544 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:24:10.544 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow profile osd", 2023-11-08T19:24:10.544 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile osd", 2023-11-08T19:24:10.544 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:24:10.544 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:24:10.545 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:24:10.545 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:24:10.545 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "osd.4", 2023-11-08T19:24:10.545 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQD130tlrd3gFRAA0IM+0Dr48SgjXRHcCzypfg==", 2023-11-08T19:24:10.545 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:24:10.546 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow profile osd", 2023-11-08T19:24:10.546 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile osd", 2023-11-08T19:24:10.546 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:24:10.546 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:24:10.546 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:24:10.547 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:24:10.547 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "osd.5", 2023-11-08T19:24:10.547 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQD430tlCMCRFRAAJwP6E9TRRNneQzL7TVU6jg==", 2023-11-08T19:24:10.547 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:24:10.547 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow profile osd", 2023-11-08T19:24:10.548 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile osd", 2023-11-08T19:24:10.548 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:24:10.548 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:24:10.548 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:24:10.548 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:24:10.549 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "osd.6", 2023-11-08T19:24:10.549 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQD730tl176/FBAADjNAIKgdn3bIRlN725KW7g==", 2023-11-08T19:24:10.549 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:24:10.549 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow profile osd", 2023-11-08T19:24:10.549 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile osd", 2023-11-08T19:24:10.550 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:24:10.550 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:24:10.550 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:24:10.550 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:24:10.550 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "osd.7", 2023-11-08T19:24:10.551 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQD+30tl6CCxFBAAcProM9OqTGE6LtReNxvljA==", 2023-11-08T19:24:10.551 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:24:10.551 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow profile osd", 2023-11-08T19:24:10.551 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile osd", 2023-11-08T19:24:10.551 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:24:10.552 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:24:10.552 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:24:10.552 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:24:10.552 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "client.0", 2023-11-08T19:24:10.552 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDi30tlQEEsNxAAiPozrOREh+IJXoj7ZkhvLg==", 2023-11-08T19:24:10.553 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:24:10.553 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow", 2023-11-08T19:24:10.553 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow r", 2023-11-08T19:24:10.553 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow rw", 2023-11-08T19:24:10.553 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow rwx" 2023-11-08T19:24:10.553 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:24:10.554 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:24:10.554 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:24:10.554 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "client.1", 2023-11-08T19:24:10.554 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDj30tluO08AhAAKiNHfc6ETU6HU+0PSkRTdg==", 2023-11-08T19:24:10.554 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:24:10.557 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow", 2023-11-08T19:24:10.557 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow r", 2023-11-08T19:24:10.557 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow rw", 2023-11-08T19:24:10.558 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow rwx" 2023-11-08T19:24:10.558 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:24:10.558 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:24:10.558 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:24:10.558 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "client.2", 2023-11-08T19:24:10.559 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDi30tlZfZ+OhAAak0bEZA4XzCWwYINh0SvGQ==", 2023-11-08T19:24:10.559 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:24:10.559 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow", 2023-11-08T19:24:10.559 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow r", 2023-11-08T19:24:10.559 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow rw", 2023-11-08T19:24:10.560 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow rwx" 2023-11-08T19:24:10.560 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:24:10.560 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:24:10.560 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:24:10.560 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "client.3", 2023-11-08T19:24:10.561 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDj30tlLMAICBAAApxzbDjmCxzR32Puyeov6A==", 2023-11-08T19:24:10.561 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:24:10.561 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow", 2023-11-08T19:24:10.561 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow r", 2023-11-08T19:24:10.561 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow rw", 2023-11-08T19:24:10.562 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow rwx" 2023-11-08T19:24:10.562 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:24:10.562 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:24:10.562 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:24:10.562 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "client.admin", 2023-11-08T19:24:10.563 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDi30tltpwRARAAZZQDTm7CIC4J4HH6G378+w==", 2023-11-08T19:24:10.563 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:24:10.563 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow *", 2023-11-08T19:24:10.563 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow *", 2023-11-08T19:24:10.563 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow *", 2023-11-08T19:24:10.563 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:24:10.564 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:24:10.564 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:24:10.564 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:24:10.564 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "client.bootstrap-mds", 2023-11-08T19:24:10.564 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQAE4EtlgzLWEhAAlo8WoDWDnJaXlzNP6AxJUg==", 2023-11-08T19:24:10.565 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:24:10.565 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile bootstrap-mds" 2023-11-08T19:24:10.565 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:24:10.565 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:24:10.565 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:24:10.565 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "client.bootstrap-mgr", 2023-11-08T19:24:10.566 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQAE4Etl3TrWEhAALQ9+eXH9WmC6ug3vPzVVjA==", 2023-11-08T19:24:10.566 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:24:10.566 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile bootstrap-mgr" 2023-11-08T19:24:10.566 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:24:10.567 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:24:10.567 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:24:10.567 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "client.bootstrap-osd", 2023-11-08T19:24:10.567 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQAE4EtlL0LWEhAANJUX6PYJ+q6l7iiyWhxjog==", 2023-11-08T19:24:10.567 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:24:10.567 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile bootstrap-osd" 2023-11-08T19:24:10.568 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:24:10.568 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:24:10.568 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:24:10.568 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "client.bootstrap-rbd", 2023-11-08T19:24:10.568 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQAE4EtlQ0nWEhAAxQDYOtvTBb2jjhTKS/qOog==", 2023-11-08T19:24:10.569 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:24:10.569 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile bootstrap-rbd" 2023-11-08T19:24:10.569 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:24:10.569 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:24:10.569 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:24:10.570 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-11-08T19:24:10.570 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQAE4EtlAVTWEhAAKBUxyzDYFxqmcTOlTNZlYw==", 2023-11-08T19:24:10.570 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:24:10.570 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-11-08T19:24:10.570 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:24:10.571 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:24:10.571 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:24:10.571 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "client.bootstrap-rgw", 2023-11-08T19:24:10.571 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQAE4EtlulvWEhAAkZTEPLR9xosKkl3GTe6yGQ==", 2023-11-08T19:24:10.571 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:24:10.572 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile bootstrap-rgw" 2023-11-08T19:24:10.572 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:24:10.572 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:24:10.572 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:24:10.572 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "mgr.x", 2023-11-08T19:24:10.572 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDi30tluyy2GxAATC2v0iOLVbRrea6w+2Cy8g==", 2023-11-08T19:24:10.573 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:24:10.573 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow *", 2023-11-08T19:24:10.573 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile mgr", 2023-11-08T19:24:10.573 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:24:10.573 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:24:10.574 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:24:10.574 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:24:10.574 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "mgr.y", 2023-11-08T19:24:10.574 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDi30tlxwfmFhAAfauMRZmdBm6TQXw07oVQJw==", 2023-11-08T19:24:10.574 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:24:10.575 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow *", 2023-11-08T19:24:10.575 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile mgr", 2023-11-08T19:24:10.575 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:24:10.575 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:24:10.575 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:24:10.576 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2023-11-08T19:24:10.576 INFO:teuthology.orchestra.run.smithi149.stdout:} 2023-11-08T19:24:10.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.530+0000 7f908e328700 1 -- 172.21.15.149:0/532508915 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f907406af30 msgr2=0x7f907406d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:10.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.530+0000 7f908e328700 1 --2- 172.21.15.149:0/532508915 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f907406af30 0x7f907406d3f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f907c006fd0 tx=0x7f907c008070 comp rx=0 tx=0).stop 2023-11-08T19:24:10.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.530+0000 7f908e328700 1 -- 172.21.15.149:0/532508915 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90880cc140 msgr2=0x7f90880c84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:10.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.530+0000 7f908e328700 1 --2- 172.21.15.149:0/532508915 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90880cc140 0x7f90880c84d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f908000cc80 tx=0x7f908000cf90 comp rx=0 tx=0).stop 2023-11-08T19:24:10.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.530+0000 7f908e328700 1 -- 172.21.15.149:0/532508915 shutdown_connections 2023-11-08T19:24:10.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.530+0000 7f908e328700 1 --2- 172.21.15.149:0/532508915 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f907406af30 0x7f907406d3f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:10.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.530+0000 7f908e328700 1 --2- 172.21.15.149:0/532508915 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90880b2850 0x7f90881f38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:10.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.530+0000 7f908e328700 1 --2- 172.21.15.149:0/532508915 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90880cc140 0x7f90880c84d0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:10.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.530+0000 7f908e328700 1 --2- 172.21.15.149:0/532508915 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f90880b2cd0 0x7f90881559f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:10.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.530+0000 7f908e328700 1 -- 172.21.15.149:0/532508915 >> 172.21.15.149:0/532508915 conn(0x7f9088099a40 msgr2=0x7f90880c7670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:10.580 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.530+0000 7f908e328700 1 -- 172.21.15.149:0/532508915 shutdown_connections 2023-11-08T19:24:10.580 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.530+0000 7f908e328700 1 -- 172.21.15.149:0/532508915 wait complete. 2023-11-08T19:24:10.580 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-11-08T19:24:10.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.700+0000 7f519b9ca700 1 Processor -- start 2023-11-08T19:24:10.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.700+0000 7f519b9ca700 1 -- start start 2023-11-08T19:24:10.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.701+0000 7f519b9ca700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f5194161670 0x7f51940b5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:10.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.701+0000 7f519b9ca700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f51940ce500 0x7f51940ce990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:10.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.701+0000 7f519b9ca700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51940d1a10 con 0x7f5194161a50 2023-11-08T19:24:10.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.701+0000 7f519b9ca700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51940d1cf0 con 0x7f5194161670 2023-11-08T19:24:10.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.701+0000 7f519b9ca700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51940d1fd0 con 0x7f51940ce500 2023-11-08T19:24:10.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.701+0000 7f5198f65700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f5194161a50 0x7f5194161f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:41054/0 (socket says 172.21.15.149:41054) 2023-11-08T19:24:10.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.701+0000 7f5198f65700 1 -- 172.21.15.149:0/1548883561 learned_addr learned my addr 172.21.15.149:0/1548883561 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:24:10.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.702+0000 7f5193fff700 1 -- 172.21.15.149:0/1548883561 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4204046732 0 0) 0x7f51940d1a10 con 0x7f5194161a50 2023-11-08T19:24:10.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.702+0000 7f5193fff700 1 -- 172.21.15.149:0/1548883561 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f517c0035b0 con 0x7f5194161a50 2023-11-08T19:24:10.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.702+0000 7f5199f67700 1 --2- 172.21.15.149:0/1548883561 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f51940ce500 0x7f51940ce990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:10.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.702+0000 7f5199766700 1 --2- 172.21.15.149:0/1548883561 >> v2:172.21.15.160:3300/0 conn(0x7f5194161670 0x7f51940b5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:10.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.702+0000 7f5193fff700 1 -- 172.21.15.149:0/1548883561 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1714880743 0 0) 0x7f517c0035b0 con 0x7f5194161a50 2023-11-08T19:24:10.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.702+0000 7f5193fff700 1 -- 172.21.15.149:0/1548883561 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f51940ce500 msgr2=0x7f51940ce990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:10.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.702+0000 7f5193fff700 1 --2- 172.21.15.149:0/1548883561 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f51940ce500 0x7f51940ce990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:10.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.702+0000 7f5193fff700 1 -- 172.21.15.149:0/1548883561 >> v2:172.21.15.160:3300/0 conn(0x7f5194161670 msgr2=0x7f51940b5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:10.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.702+0000 7f5193fff700 1 --2- 172.21.15.149:0/1548883561 >> v2:172.21.15.160:3300/0 conn(0x7f5194161670 0x7f51940b5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:10.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.702+0000 7f5193fff700 1 -- 172.21.15.149:0/1548883561 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51940d22b0 con 0x7f5194161a50 2023-11-08T19:24:10.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.702+0000 7f5193fff700 1 -- 172.21.15.149:0/1548883561 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f5188001670 con 0x7f5194161a50 2023-11-08T19:24:10.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.702+0000 7f5193fff700 1 -- 172.21.15.149:0/1548883561 >> v1:172.21.15.149:6789/0 conn(0x7f5194161a50 legacy=0x7f5194161f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:10.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.702+0000 7f5193fff700 1 --2- 172.21.15.149:0/1548883561 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f51940ce500 0x7f517c003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:10.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.702+0000 7f5193fff700 1 --2- 172.21.15.149:0/1548883561 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f517c003f80 0x7f517c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:10.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.702+0000 7f5193fff700 1 --2- 172.21.15.149:0/1548883561 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f517c004d90 0x7f517c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:10.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.702+0000 7f5193fff700 1 -- 172.21.15.149:0/1548883561 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51940d1cf0 con 0x7f517c003f80 2023-11-08T19:24:10.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.702+0000 7f5193fff700 1 -- 172.21.15.149:0/1548883561 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51940d1fd0 con 0x7f517c004d90 2023-11-08T19:24:10.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.702+0000 7f5193fff700 1 -- 172.21.15.149:0/1548883561 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f517c00ba10 con 0x7f51940ce500 2023-11-08T19:24:10.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.702+0000 7f5198f65700 1 --2- 172.21.15.149:0/1548883561 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f517c003f80 0x7f517c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:10.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.702+0000 7f5199f67700 1 --2- 172.21.15.149:0/1548883561 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f517c004d90 0x7f517c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:10.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.702+0000 7f5199766700 1 --2- 172.21.15.149:0/1548883561 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f51940ce500 0x7f517c003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:10.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.702+0000 7f5198f65700 1 -- 172.21.15.149:0/1548883561 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f51940ce500 msgr2=0x7f517c003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:10.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.702+0000 7f5198f65700 1 --2- 172.21.15.149:0/1548883561 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f51940ce500 0x7f517c003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:10.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.702+0000 7f5198f65700 1 -- 172.21.15.149:0/1548883561 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f517c004d90 msgr2=0x7f517c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:10.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.702+0000 7f5198f65700 1 --2- 172.21.15.149:0/1548883561 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f517c004d90 0x7f517c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:10.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.702+0000 7f5198f65700 1 -- 172.21.15.149:0/1548883561 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f517c0035b0 con 0x7f517c003f80 2023-11-08T19:24:10.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.703+0000 7f5198f65700 1 --2- 172.21.15.149:0/1548883561 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f517c003f80 0x7f517c004850 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f518800c2f0 tx=0x7f517c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed93d21951418db4 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:10.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.703+0000 7f5193fff700 1 -- 172.21.15.149:0/1548883561 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5188007c40 con 0x7f517c003f80 2023-11-08T19:24:10.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.703+0000 7f5193fff700 1 -- 172.21.15.149:0/1548883561 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f518800cdd0 con 0x7f517c003f80 2023-11-08T19:24:10.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.703+0000 7f5193fff700 1 -- 172.21.15.149:0/1548883561 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5188005ba0 con 0x7f517c003f80 2023-11-08T19:24:10.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.703+0000 7f519b9ca700 1 -- 172.21.15.149:0/1548883561 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f517c003f80 msgr2=0x7f517c004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:10.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.703+0000 7f519b9ca700 1 --2- 172.21.15.149:0/1548883561 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f517c003f80 0x7f517c004850 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f518800c2f0 tx=0x7f517c005880 comp rx=0 tx=0).stop 2023-11-08T19:24:10.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.703+0000 7f5199f67700 1 -- 172.21.15.149:0/1548883561 reap_dead start 2023-11-08T19:24:10.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.703+0000 7f519b9ca700 1 -- 172.21.15.149:0/1548883561 shutdown_connections 2023-11-08T19:24:10.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.703+0000 7f519b9ca700 1 -- 172.21.15.149:0/1548883561 >> 172.21.15.149:0/1548883561 conn(0x7f51940d3980 msgr2=0x7f51940d3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:10.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.703+0000 7f519b9ca700 1 -- 172.21.15.149:0/1548883561 shutdown_connections 2023-11-08T19:24:10.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.703+0000 7f519b9ca700 1 -- 172.21.15.149:0/1548883561 wait complete. 2023-11-08T19:24:10.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.704+0000 7f519b9ca700 1 Processor -- start 2023-11-08T19:24:10.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.704+0000 7f519b9ca700 1 -- start start 2023-11-08T19:24:10.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.705+0000 7f519b9ca700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f517c003f80 0x7f51940c83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:10.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.705+0000 7f519b9ca700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f519414ee40 0x7f51940b9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:10.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.705+0000 7f519b9ca700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f51940b6dc0 0x7f51940b7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:10.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.705+0000 7f519b9ca700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51940cb010 con 0x7f519414ee40 2023-11-08T19:24:10.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.705+0000 7f519b9ca700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51940b69a0 con 0x7f51940b6dc0 2023-11-08T19:24:10.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.705+0000 7f519b9ca700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f519414f2c0 con 0x7f517c003f80 2023-11-08T19:24:10.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.705+0000 7f5198f65700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f519414ee40 0x7f51940b9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:10.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.705+0000 7f5198f65700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f519414ee40 0x7f51940b9150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39064/0 (socket says 172.21.15.149:39064) 2023-11-08T19:24:10.719 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.705+0000 7f5198f65700 1 -- 172.21.15.149:0/1279776095 learned_addr learned my addr 172.21.15.149:0/1279776095 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:10.719 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.705+0000 7f5199766700 1 --2- 172.21.15.149:0/1279776095 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f517c003f80 0x7f51940c83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:10.719 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.705+0000 7f5199f67700 1 --2- 172.21.15.149:0/1279776095 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f51940b6dc0 0x7f51940b7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:10.719 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.706+0000 7f5198f65700 1 -- 172.21.15.149:0/1279776095 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f517c003f80 msgr2=0x7f51940c83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:10.719 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.706+0000 7f5198f65700 1 --2- 172.21.15.149:0/1279776095 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f517c003f80 0x7f51940c83a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:10.720 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.706+0000 7f5198f65700 1 -- 172.21.15.149:0/1279776095 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f51940b6dc0 msgr2=0x7f51940b7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:10.720 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.706+0000 7f5198f65700 1 --2- 172.21.15.149:0/1279776095 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f51940b6dc0 0x7f51940b7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:10.720 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.706+0000 7f5198f65700 1 -- 172.21.15.149:0/1279776095 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51940b9690 con 0x7f519414ee40 2023-11-08T19:24:10.720 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.706+0000 7f5198f65700 1 --2- 172.21.15.149:0/1279776095 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f519414ee40 0x7f51940b9150 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f5188011000 tx=0x7f5194162610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:10.720 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.706+0000 7f5191ffb700 1 -- 172.21.15.149:0/1279776095 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51880070d0 con 0x7f519414ee40 2023-11-08T19:24:10.721 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.706+0000 7f5191ffb700 1 -- 172.21.15.149:0/1279776095 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5188007270 con 0x7f519414ee40 2023-11-08T19:24:10.721 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.706+0000 7f5191ffb700 1 -- 172.21.15.149:0/1279776095 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5188007620 con 0x7f519414ee40 2023-11-08T19:24:10.721 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.706+0000 7f519b9ca700 1 -- 172.21.15.149:0/1279776095 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51940c89d0 con 0x7f519414ee40 2023-11-08T19:24:10.721 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.706+0000 7f519b9ca700 1 -- 172.21.15.149:0/1279776095 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51940c8f90 con 0x7f519414ee40 2023-11-08T19:24:10.721 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.707+0000 7f519b9ca700 1 -- 172.21.15.149:0/1279776095 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51940b6ae0 con 0x7f519414ee40 2023-11-08T19:24:10.722 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.708+0000 7f5191ffb700 1 -- 172.21.15.149:0/1279776095 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f518801e430 con 0x7f519414ee40 2023-11-08T19:24:10.722 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.708+0000 7f5191ffb700 1 --2- 172.21.15.149:0/1279776095 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f518006af00 0x7f518006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:10.722 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.708+0000 7f5191ffb700 1 -- 172.21.15.149:0/1279776095 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f5188089a20 con 0x7f519414ee40 2023-11-08T19:24:10.722 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.708+0000 7f5199766700 1 --2- 172.21.15.149:0/1279776095 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f518006af00 0x7f518006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:10.722 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.708+0000 7f5199766700 1 --2- 172.21.15.149:0/1279776095 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f518006af00 0x7f518006d3c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f518c009c40 tx=0x7f518c0091c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:10.722 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.713+0000 7f5191ffb700 1 -- 172.21.15.149:0/1279776095 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f51940b6ae0 con 0x7f519414ee40 2023-11-08T19:24:10.979 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.978+0000 7f519b9ca700 1 -- 172.21.15.149:0/1279776095 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f51940b6ae0 con 0x7f519414ee40 2023-11-08T19:24:10.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.980+0000 7f5191ffb700 1 -- 172.21.15.149:0/1279776095 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f5188054e30 con 0x7f519414ee40 2023-11-08T19:24:10.983 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.982+0000 7f519b9ca700 1 -- 172.21.15.149:0/1279776095 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f518006af00 msgr2=0x7f518006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:10.984 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.982+0000 7f519b9ca700 1 --2- 172.21.15.149:0/1279776095 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f518006af00 0x7f518006d3c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f518c009c40 tx=0x7f518c0091c0 comp rx=0 tx=0).stop 2023-11-08T19:24:10.984 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.982+0000 7f519b9ca700 1 -- 172.21.15.149:0/1279776095 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f519414ee40 msgr2=0x7f51940b9150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:10.984 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.982+0000 7f519b9ca700 1 --2- 172.21.15.149:0/1279776095 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f519414ee40 0x7f51940b9150 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f5188011000 tx=0x7f5194162610 comp rx=0 tx=0).stop 2023-11-08T19:24:10.984 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.982+0000 7f519b9ca700 1 -- 172.21.15.149:0/1279776095 shutdown_connections 2023-11-08T19:24:10.984 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.982+0000 7f519b9ca700 1 --2- 172.21.15.149:0/1279776095 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f518006af00 0x7f518006d3c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:10.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.982+0000 7f519b9ca700 1 --2- 172.21.15.149:0/1279776095 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f51940b6dc0 0x7f51940b7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:10.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.982+0000 7f519b9ca700 1 --2- 172.21.15.149:0/1279776095 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f517c003f80 0x7f51940c83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:10.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.982+0000 7f519b9ca700 1 --2- 172.21.15.149:0/1279776095 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f519414ee40 0x7f51940b9150 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:10.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.982+0000 7f519b9ca700 1 -- 172.21.15.149:0/1279776095 >> 172.21.15.149:0/1279776095 conn(0x7f51940d3980 msgr2=0x7f519415f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:10.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.982+0000 7f519b9ca700 1 -- 172.21.15.149:0/1279776095 shutdown_connections 2023-11-08T19:24:10.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:10.982+0000 7f519b9ca700 1 -- 172.21.15.149:0/1279776095 wait complete. 2023-11-08T19:24:10.996 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-11-08T19:24:11.117 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.116+0000 7f8d6d3ce700 1 Processor -- start 2023-11-08T19:24:11.118 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.116+0000 7f8d6d3ce700 1 -- start start 2023-11-08T19:24:11.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.117+0000 7f8d6d3ce700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f8d68161670 0x7f8d680b5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:11.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.117+0000 7f8d6d3ce700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f8d680ce500 0x7f8d680ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:11.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.117+0000 7f8d6d3ce700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d680d1a10 con 0x7f8d68161a50 2023-11-08T19:24:11.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.117+0000 7f8d6d3ce700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d680d1cf0 con 0x7f8d680ce500 2023-11-08T19:24:11.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.117+0000 7f8d6d3ce700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d680d1fd0 con 0x7f8d68161670 2023-11-08T19:24:11.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.117+0000 7f8d677fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f8d680ce500 0x7f8d680ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:11.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.117+0000 7f8d677fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f8d680ce500 0x7f8d680ce970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39074/0 (socket says 172.21.15.149:39074) 2023-11-08T19:24:11.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.117+0000 7f8d677fe700 1 -- 172.21.15.149:0/4040162909 learned_addr learned my addr 172.21.15.149:0/4040162909 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:11.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.118+0000 7f8d66ffd700 1 --2- 172.21.15.149:0/4040162909 >> v2:172.21.15.160:3300/0 conn(0x7f8d68161670 0x7f8d680b5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:11.122 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.118+0000 7f8d677fe700 1 -- 172.21.15.149:0/4040162909 >> v2:172.21.15.160:3300/0 conn(0x7f8d68161670 msgr2=0x7f8d680b5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:11.122 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.118+0000 7f8d677fe700 1 --2- 172.21.15.149:0/4040162909 >> v2:172.21.15.160:3300/0 conn(0x7f8d68161670 0x7f8d680b5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:11.122 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.118+0000 7f8d677fe700 1 -- 172.21.15.149:0/4040162909 >> v1:172.21.15.160:6789/0 conn(0x7f8d68161a50 legacy=0x7f8d68161f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:11.122 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.118+0000 7f8d677fe700 1 -- 172.21.15.149:0/4040162909 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d680d22b0 con 0x7f8d680ce500 2023-11-08T19:24:11.122 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.118+0000 7f8d677fe700 1 --2- 172.21.15.149:0/4040162909 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d680ce500 0x7f8d680ce970 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f8d680a1820 tx=0x7f8d5800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b2a1001205a24ec server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:11.123 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.118+0000 7f8d65ffb700 1 -- 172.21.15.149:0/4040162909 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d5800e070 con 0x7f8d680ce500 2023-11-08T19:24:11.123 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.118+0000 7f8d65ffb700 1 -- 172.21.15.149:0/4040162909 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d58003a20 con 0x7f8d680ce500 2023-11-08T19:24:11.123 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.118+0000 7f8d65ffb700 1 -- 172.21.15.149:0/4040162909 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d58003dd0 con 0x7f8d680ce500 2023-11-08T19:24:11.123 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.118+0000 7f8d6d3ce700 1 -- 172.21.15.149:0/4040162909 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d680ce500 msgr2=0x7f8d680ce970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:11.123 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.118+0000 7f8d6d3ce700 1 --2- 172.21.15.149:0/4040162909 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d680ce500 0x7f8d680ce970 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f8d680a1820 tx=0x7f8d5800b330 comp rx=0 tx=0).stop 2023-11-08T19:24:11.123 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.119+0000 7f8d6d3ce700 1 -- 172.21.15.149:0/4040162909 shutdown_connections 2023-11-08T19:24:11.124 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.119+0000 7f8d6d3ce700 1 --2- 172.21.15.149:0/4040162909 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d680ce500 0x7f8d680ce970 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:11.124 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.119+0000 7f8d6d3ce700 1 --2- 172.21.15.149:0/4040162909 >> v2:172.21.15.160:3300/0 conn(0x7f8d68161670 0x7f8d680b5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:11.124 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.119+0000 7f8d6d3ce700 1 -- 172.21.15.149:0/4040162909 >> 172.21.15.149:0/4040162909 conn(0x7f8d680d3980 msgr2=0x7f8d680d3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:11.124 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.119+0000 7f8d6d3ce700 1 -- 172.21.15.149:0/4040162909 shutdown_connections 2023-11-08T19:24:11.124 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.119+0000 7f8d6d3ce700 1 -- 172.21.15.149:0/4040162909 wait complete. 2023-11-08T19:24:11.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.120+0000 7f8d6d3ce700 1 Processor -- start 2023-11-08T19:24:11.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.120+0000 7f8d6d3ce700 1 -- start start 2023-11-08T19:24:11.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.121+0000 7f8d6d3ce700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d680ce500 0x7f8d681f33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:11.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.121+0000 7f8d6d3ce700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d68161670 0x7f8d680ce8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:11.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.121+0000 7f8d6d3ce700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8d68161a50 0x7f8d680cee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:11.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.121+0000 7f8d6d3ce700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d680cc170 con 0x7f8d680ce500 2023-11-08T19:24:11.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.121+0000 7f8d6d3ce700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d680cb840 con 0x7f8d68161670 2023-11-08T19:24:11.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.121+0000 7f8d6d3ce700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d680cbb20 con 0x7f8d68161a50 2023-11-08T19:24:11.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.121+0000 7f8d66ffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d680ce500 0x7f8d681f33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:11.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.121+0000 7f8d66ffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d680ce500 0x7f8d681f33a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39076/0 (socket says 172.21.15.149:39076) 2023-11-08T19:24:11.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.121+0000 7f8d66ffd700 1 -- 172.21.15.149:0/3823489775 learned_addr learned my addr 172.21.15.149:0/3823489775 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:11.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.121+0000 7f8d677fe700 1 --2- 172.21.15.149:0/3823489775 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8d68161a50 0x7f8d680cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:11.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.121+0000 7f8d667fc700 1 --2- 172.21.15.149:0/3823489775 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d68161670 0x7f8d680ce8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:11.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.121+0000 7f8d66ffd700 1 -- 172.21.15.149:0/3823489775 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8d68161a50 msgr2=0x7f8d680cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:11.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.121+0000 7f8d66ffd700 1 --2- 172.21.15.149:0/3823489775 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8d68161a50 0x7f8d680cee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:11.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.121+0000 7f8d66ffd700 1 -- 172.21.15.149:0/3823489775 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d68161670 msgr2=0x7f8d680ce8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:11.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.121+0000 7f8d66ffd700 1 --2- 172.21.15.149:0/3823489775 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d68161670 0x7f8d680ce8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:11.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.121+0000 7f8d66ffd700 1 -- 172.21.15.149:0/3823489775 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d58009b30 con 0x7f8d680ce500 2023-11-08T19:24:11.131 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.121+0000 7f8d66ffd700 1 --2- 172.21.15.149:0/3823489775 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d680ce500 0x7f8d681f33a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f8d6000e760 tx=0x7f8d6000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:11.131 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.121+0000 7f8d5f7fe700 1 -- 172.21.15.149:0/3823489775 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d60005c20 con 0x7f8d680ce500 2023-11-08T19:24:11.131 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.121+0000 7f8d5f7fe700 1 -- 172.21.15.149:0/3823489775 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d60005da0 con 0x7f8d680ce500 2023-11-08T19:24:11.131 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.121+0000 7f8d6d3ce700 1 -- 172.21.15.149:0/3823489775 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d680cbe00 con 0x7f8d680ce500 2023-11-08T19:24:11.131 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.121+0000 7f8d5f7fe700 1 -- 172.21.15.149:0/3823489775 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d60006260 con 0x7f8d680ce500 2023-11-08T19:24:11.132 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.121+0000 7f8d6d3ce700 1 -- 172.21.15.149:0/3823489775 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d680c98f0 con 0x7f8d680ce500 2023-11-08T19:24:11.132 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.122+0000 7f8d6d3ce700 1 -- 172.21.15.149:0/3823489775 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d680745f0 con 0x7f8d680ce500 2023-11-08T19:24:11.132 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.123+0000 7f8d5f7fe700 1 -- 172.21.15.149:0/3823489775 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8d600063c0 con 0x7f8d680ce500 2023-11-08T19:24:11.132 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.123+0000 7f8d5f7fe700 1 --2- 172.21.15.149:0/3823489775 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f8d4806af30 0x7f8d4806d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:11.132 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.123+0000 7f8d5f7fe700 1 -- 172.21.15.149:0/3823489775 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f8d600890b0 con 0x7f8d680ce500 2023-11-08T19:24:11.132 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.123+0000 7f8d667fc700 1 --2- 172.21.15.149:0/3823489775 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f8d4806af30 0x7f8d4806d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:11.133 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.124+0000 7f8d667fc700 1 --2- 172.21.15.149:0/3823489775 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f8d4806af30 0x7f8d4806d3f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8d68144640 tx=0x7f8d50009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:11.133 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.128+0000 7f8d5f7fe700 1 -- 172.21.15.149:0/3823489775 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8d60054450 con 0x7f8d680ce500 2023-11-08T19:24:11.397 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.396+0000 7f8d6d3ce700 1 -- 172.21.15.149:0/3823489775 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f8d6815b120 con 0x7f8d680ce500 2023-11-08T19:24:11.399 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.398+0000 7f8d5f7fe700 1 -- 172.21.15.149:0/3823489775 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f8d600200a0 con 0x7f8d680ce500 2023-11-08T19:24:11.402 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.400+0000 7f8d6d3ce700 1 -- 172.21.15.149:0/3823489775 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f8d4806af30 msgr2=0x7f8d4806d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:11.402 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.400+0000 7f8d6d3ce700 1 --2- 172.21.15.149:0/3823489775 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f8d4806af30 0x7f8d4806d3f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8d68144640 tx=0x7f8d50009040 comp rx=0 tx=0).stop 2023-11-08T19:24:11.402 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.400+0000 7f8d6d3ce700 1 -- 172.21.15.149:0/3823489775 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d680ce500 msgr2=0x7f8d681f33a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:11.402 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.400+0000 7f8d6d3ce700 1 --2- 172.21.15.149:0/3823489775 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d680ce500 0x7f8d681f33a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f8d6000e760 tx=0x7f8d6000eb20 comp rx=0 tx=0).stop 2023-11-08T19:24:11.403 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.401+0000 7f8d6d3ce700 1 -- 172.21.15.149:0/3823489775 shutdown_connections 2023-11-08T19:24:11.403 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.401+0000 7f8d6d3ce700 1 --2- 172.21.15.149:0/3823489775 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f8d4806af30 0x7f8d4806d3f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:11.403 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.401+0000 7f8d6d3ce700 1 --2- 172.21.15.149:0/3823489775 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8d68161a50 0x7f8d680cee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:11.403 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.401+0000 7f8d6d3ce700 1 --2- 172.21.15.149:0/3823489775 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d680ce500 0x7f8d681f33a0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:11.403 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.401+0000 7f8d6d3ce700 1 --2- 172.21.15.149:0/3823489775 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d68161670 0x7f8d680ce8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:11.404 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.401+0000 7f8d6d3ce700 1 -- 172.21.15.149:0/3823489775 >> 172.21.15.149:0/3823489775 conn(0x7f8d680d3980 msgr2=0x7f8d6815ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:11.404 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.401+0000 7f8d6d3ce700 1 -- 172.21.15.149:0/3823489775 shutdown_connections 2023-11-08T19:24:11.404 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.401+0000 7f8d6d3ce700 1 -- 172.21.15.149:0/3823489775 wait complete. 2023-11-08T19:24:11.414 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-11-08T19:24:11.536 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.535+0000 7f03ffe03700 1 Processor -- start 2023-11-08T19:24:11.536 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.535+0000 7f03ffe03700 1 -- start start 2023-11-08T19:24:11.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.536+0000 7f03ffe03700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f03f815abb0 0x7f03f806e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:11.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.536+0000 7f03ffe03700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03f815af90 con 0x7f03f806c2a0 2023-11-08T19:24:11.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.536+0000 7f03ffe03700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03f806f260 con 0x7f03f806e7e0 2023-11-08T19:24:11.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.536+0000 7f03ffe03700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03f806d540 con 0x7f03f815abb0 2023-11-08T19:24:11.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.536+0000 7f03fdb9f700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f03f815abb0 0x7f03f806e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:11.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.536+0000 7f03fdb9f700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f03f815abb0 0x7f03f806e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39084/0 (socket says 172.21.15.149:39084) 2023-11-08T19:24:11.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.536+0000 7f03fdb9f700 1 -- 172.21.15.149:0/122133115 learned_addr learned my addr 172.21.15.149:0/122133115 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:11.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.536+0000 7f03fe3a0700 1 --1- 172.21.15.149:0/122133115 >> v1:172.21.15.149:6789/0 conn(0x7f03f806c2a0 0x7f03f80b2c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:41088/0 (socket says 172.21.15.149:41088) 2023-11-08T19:24:11.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.536+0000 7f03fdb9f700 1 -- 172.21.15.149:0/122133115 >> v1:172.21.15.160:6789/0 conn(0x7f03f806e7e0 legacy=0x7f03f806bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:11.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.536+0000 7f03fdb9f700 1 -- 172.21.15.149:0/122133115 >> v1:172.21.15.149:6789/0 conn(0x7f03f806c2a0 legacy=0x7f03f80b2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:11.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.536+0000 7f03fdb9f700 1 -- 172.21.15.149:0/122133115 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f806d820 con 0x7f03f815abb0 2023-11-08T19:24:11.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.536+0000 7f03fcb9d700 1 -- 172.21.15.149:0/122133115 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3846381855 0 0) 0x7f03f815af90 con 0x7f03f806c2a0 2023-11-08T19:24:11.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.537+0000 7f03fdb9f700 1 --2- 172.21.15.149:0/122133115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03f815abb0 0x7f03f806e020 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f03f400bb90 tx=0x7f03f400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd177c1e4d50df2e server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:11.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.537+0000 7f03fcb9d700 1 -- 172.21.15.149:0/122133115 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f400dd10 con 0x7f03f815abb0 2023-11-08T19:24:11.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.537+0000 7f03fcb9d700 1 -- 172.21.15.149:0/122133115 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03f400de70 con 0x7f03f815abb0 2023-11-08T19:24:11.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.537+0000 7f03fcb9d700 1 -- 172.21.15.149:0/122133115 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f4004230 con 0x7f03f815abb0 2023-11-08T19:24:11.542 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.537+0000 7f03ffe03700 1 -- 172.21.15.149:0/122133115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03f815abb0 msgr2=0x7f03f806e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:11.542 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.537+0000 7f03ffe03700 1 --2- 172.21.15.149:0/122133115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03f815abb0 0x7f03f806e020 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f03f400bb90 tx=0x7f03f400bea0 comp rx=0 tx=0).stop 2023-11-08T19:24:11.542 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.537+0000 7f03ffe03700 1 -- 172.21.15.149:0/122133115 shutdown_connections 2023-11-08T19:24:11.542 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.537+0000 7f03ffe03700 1 --2- 172.21.15.149:0/122133115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03f815abb0 0x7f03f806e020 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:11.542 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.537+0000 7f03ffe03700 1 -- 172.21.15.149:0/122133115 >> 172.21.15.149:0/122133115 conn(0x7f03f8071720 msgr2=0x7f03f8071b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:11.543 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.537+0000 7f03ffe03700 1 -- 172.21.15.149:0/122133115 shutdown_connections 2023-11-08T19:24:11.543 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.537+0000 7f03ffe03700 1 -- 172.21.15.149:0/122133115 wait complete. 2023-11-08T19:24:11.545 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.538+0000 7f03ffe03700 1 Processor -- start 2023-11-08T19:24:11.545 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.538+0000 7f03ffe03700 1 -- start start 2023-11-08T19:24:11.545 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.539+0000 7f03ffe03700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03f806c2a0 0x7f03f8158af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:11.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.539+0000 7f03ffe03700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03f806e7e0 0x7f03f8156370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:11.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.539+0000 7f03ffe03700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03f815abb0 0x7f03f80b3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:11.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.539+0000 7f03ffe03700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f8157de0 con 0x7f03f815abb0 2023-11-08T19:24:11.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.539+0000 7f03ffe03700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f81eff70 con 0x7f03f806e7e0 2023-11-08T19:24:11.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.539+0000 7f03ffe03700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f8158030 con 0x7f03f806c2a0 2023-11-08T19:24:11.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.539+0000 7f03fe3a0700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03f815abb0 0x7f03f80b3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:11.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.539+0000 7f03fe3a0700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03f815abb0 0x7f03f80b3ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39092/0 (socket says 172.21.15.149:39092) 2023-11-08T19:24:11.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.539+0000 7f03fe3a0700 1 -- 172.21.15.149:0/2034569809 learned_addr learned my addr 172.21.15.149:0/2034569809 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:11.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.539+0000 7f03fd39e700 1 --2- 172.21.15.149:0/2034569809 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03f806e7e0 0x7f03f8156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:11.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.539+0000 7f03fdb9f700 1 --2- 172.21.15.149:0/2034569809 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03f806c2a0 0x7f03f8158af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:11.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.540+0000 7f03fe3a0700 1 -- 172.21.15.149:0/2034569809 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03f806c2a0 msgr2=0x7f03f8158af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:11.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.540+0000 7f03fe3a0700 1 --2- 172.21.15.149:0/2034569809 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03f806c2a0 0x7f03f8158af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:11.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.540+0000 7f03fe3a0700 1 -- 172.21.15.149:0/2034569809 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03f806e7e0 msgr2=0x7f03f8156370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:11.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.540+0000 7f03fe3a0700 1 --2- 172.21.15.149:0/2034569809 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03f806e7e0 0x7f03f8156370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:11.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.540+0000 7f03fe3a0700 1 -- 172.21.15.149:0/2034569809 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f400b7f0 con 0x7f03f815abb0 2023-11-08T19:24:11.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.540+0000 7f03fe3a0700 1 --2- 172.21.15.149:0/2034569809 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03f815abb0 0x7f03f80b3ed0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f03f000cba0 tx=0x7f03f000ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:11.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.540+0000 7f03ee7fc700 1 -- 172.21.15.149:0/2034569809 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f000aaa0 con 0x7f03f815abb0 2023-11-08T19:24:11.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.540+0000 7f03ee7fc700 1 -- 172.21.15.149:0/2034569809 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03f000ac00 con 0x7f03f815abb0 2023-11-08T19:24:11.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.540+0000 7f03ffe03700 1 -- 172.21.15.149:0/2034569809 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03f8158310 con 0x7f03f815abb0 2023-11-08T19:24:11.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.540+0000 7f03ee7fc700 1 -- 172.21.15.149:0/2034569809 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f00070d0 con 0x7f03f815abb0 2023-11-08T19:24:11.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.540+0000 7f03ffe03700 1 -- 172.21.15.149:0/2034569809 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03f81568b0 con 0x7f03f815abb0 2023-11-08T19:24:11.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.541+0000 7f03ffe03700 1 -- 172.21.15.149:0/2034569809 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03f8158960 con 0x7f03f815abb0 2023-11-08T19:24:11.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.541+0000 7f03ee7fc700 1 -- 172.21.15.149:0/2034569809 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f03f0007230 con 0x7f03f815abb0 2023-11-08T19:24:11.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.542+0000 7f03ee7fc700 1 --2- 172.21.15.149:0/2034569809 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f03dc06af00 0x7f03dc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:11.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.542+0000 7f03ee7fc700 1 -- 172.21.15.149:0/2034569809 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f03f0088fd0 con 0x7f03f815abb0 2023-11-08T19:24:11.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.542+0000 7f03fdb9f700 1 --2- 172.21.15.149:0/2034569809 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f03dc06af00 0x7f03dc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:11.551 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.542+0000 7f03fdb9f700 1 --2- 172.21.15.149:0/2034569809 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f03dc06af00 0x7f03dc06d3c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f03f400b340 tx=0x7f03f401d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:11.551 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.546+0000 7f03ee7fc700 1 -- 172.21.15.149:0/2034569809 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f03f0054320 con 0x7f03f815abb0 2023-11-08T19:24:11.814 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.813+0000 7f03ffe03700 1 -- 172.21.15.149:0/2034569809 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f03f80745f0 con 0x7f03f815abb0 2023-11-08T19:24:11.815 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.815+0000 7f03ee7fc700 1 -- 172.21.15.149:0/2034569809 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) v1 ==== 90+0+0 (secure 0 0 0) 0x7f03f0057940 con 0x7f03f815abb0 2023-11-08T19:24:11.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.817+0000 7f03ffe03700 1 -- 172.21.15.149:0/2034569809 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f03dc06af00 msgr2=0x7f03dc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:11.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.817+0000 7f03ffe03700 1 --2- 172.21.15.149:0/2034569809 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f03dc06af00 0x7f03dc06d3c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f03f400b340 tx=0x7f03f401d040 comp rx=0 tx=0).stop 2023-11-08T19:24:11.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.817+0000 7f03ffe03700 1 -- 172.21.15.149:0/2034569809 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03f815abb0 msgr2=0x7f03f80b3ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:11.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.817+0000 7f03ffe03700 1 --2- 172.21.15.149:0/2034569809 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03f815abb0 0x7f03f80b3ed0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f03f000cba0 tx=0x7f03f000ceb0 comp rx=0 tx=0).stop 2023-11-08T19:24:11.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.817+0000 7f03ffe03700 1 -- 172.21.15.149:0/2034569809 shutdown_connections 2023-11-08T19:24:11.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.817+0000 7f03ffe03700 1 --2- 172.21.15.149:0/2034569809 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f03dc06af00 0x7f03dc06d3c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:11.820 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.817+0000 7f03ffe03700 1 --2- 172.21.15.149:0/2034569809 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03f815abb0 0x7f03f80b3ed0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:11.820 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.817+0000 7f03ffe03700 1 --2- 172.21.15.149:0/2034569809 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03f806c2a0 0x7f03f8158af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:11.820 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.817+0000 7f03ffe03700 1 --2- 172.21.15.149:0/2034569809 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03f806e7e0 0x7f03f8156370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:11.820 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.817+0000 7f03ffe03700 1 -- 172.21.15.149:0/2034569809 >> 172.21.15.149:0/2034569809 conn(0x7f03f8071720 msgr2=0x7f03f815d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:11.820 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.817+0000 7f03ffe03700 1 -- 172.21.15.149:0/2034569809 shutdown_connections 2023-11-08T19:24:11.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.817+0000 7f03ffe03700 1 -- 172.21.15.149:0/2034569809 wait complete. 2023-11-08T19:24:11.830 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-11-08T19:24:11.953 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.951+0000 7fcd32756700 1 Processor -- start 2023-11-08T19:24:11.953 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.951+0000 7fcd32756700 1 -- start start 2023-11-08T19:24:11.955 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.952+0000 7fcd32756700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd2c0cb300 0x7fcd2c15d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:11.956 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.952+0000 7fcd32756700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd2c0b2f60 con 0x7fcd2c0cc140 2023-11-08T19:24:11.956 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.952+0000 7fcd32756700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd2c0cc520 con 0x7fcd2c0cc910 2023-11-08T19:24:11.956 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.952+0000 7fcd32756700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2c0b2430 con 0x7fcd2c0cb300 2023-11-08T19:24:11.956 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.952+0000 7fcd2bfff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fcd2c0cc140 0x7fcd2c0b2850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:41098/0 (socket says 172.21.15.149:41098) 2023-11-08T19:24:11.956 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.952+0000 7fcd2bfff700 1 -- 172.21.15.149:0/900620025 learned_addr learned my addr 172.21.15.149:0/900620025 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:24:11.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.952+0000 7fcd30cf3700 1 --2- 172.21.15.149:0/900620025 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd2c0cb300 0x7fcd2c15d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:11.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.953+0000 7fcd2affd700 1 -- 172.21.15.149:0/900620025 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1713728510 0 0) 0x7fcd2c0b2f60 con 0x7fcd2c0cc140 2023-11-08T19:24:11.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.953+0000 7fcd2affd700 1 -- 172.21.15.149:0/900620025 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd140035b0 con 0x7fcd2c0cc140 2023-11-08T19:24:11.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.953+0000 7fcd2affd700 1 -- 172.21.15.149:0/900620025 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2841050104 0 0) 0x7fcd2c0cc520 con 0x7fcd2c0cc910 2023-11-08T19:24:11.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.953+0000 7fcd2affd700 1 -- 172.21.15.149:0/900620025 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd2c0b2f60 con 0x7fcd2c0cc910 2023-11-08T19:24:11.958 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.953+0000 7fcd2affd700 1 -- 172.21.15.149:0/900620025 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 237031323 0 0) 0x7fcd140035b0 con 0x7fcd2c0cc140 2023-11-08T19:24:11.958 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.953+0000 7fcd30cf3700 1 -- 172.21.15.149:0/900620025 >> v1:172.21.15.160:6789/0 conn(0x7fcd2c0cc910 legacy=0x7fcd2c0cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:11.958 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.953+0000 7fcd30cf3700 1 -- 172.21.15.149:0/900620025 >> v1:172.21.15.149:6789/0 conn(0x7fcd2c0cc140 legacy=0x7fcd2c0b2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:11.958 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.953+0000 7fcd30cf3700 1 -- 172.21.15.149:0/900620025 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd2c0b17b0 con 0x7fcd2c0cb300 2023-11-08T19:24:11.958 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.953+0000 7fcd30cf3700 1 --2- 172.21.15.149:0/900620025 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd2c0cb300 0x7fcd2c15d2b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcd24009dc0 tx=0x7fcd2400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f388db0a6da97c7a server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:11.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.953+0000 7fcd2affd700 1 -- 172.21.15.149:0/900620025 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2400e070 con 0x7fcd2c0cb300 2023-11-08T19:24:11.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.953+0000 7fcd2affd700 1 -- 172.21.15.149:0/900620025 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd24003a20 con 0x7fcd2c0cb300 2023-11-08T19:24:11.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.953+0000 7fcd2affd700 1 -- 172.21.15.149:0/900620025 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd200017f0 con 0x7fcd2c0cb300 2023-11-08T19:24:11.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.954+0000 7fcd32756700 1 -- 172.21.15.149:0/900620025 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd2c0cb300 msgr2=0x7fcd2c15d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:11.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.954+0000 7fcd32756700 1 --2- 172.21.15.149:0/900620025 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd2c0cb300 0x7fcd2c15d2b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcd24009dc0 tx=0x7fcd2400b330 comp rx=0 tx=0).stop 2023-11-08T19:24:11.960 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.954+0000 7fcd32756700 1 -- 172.21.15.149:0/900620025 shutdown_connections 2023-11-08T19:24:11.960 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.954+0000 7fcd32756700 1 --2- 172.21.15.149:0/900620025 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd2c0cb300 0x7fcd2c15d2b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:11.960 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.954+0000 7fcd32756700 1 -- 172.21.15.149:0/900620025 >> 172.21.15.149:0/900620025 conn(0x7fcd2c099a40 msgr2=0x7fcd2c0d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:11.960 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.954+0000 7fcd32756700 1 -- 172.21.15.149:0/900620025 shutdown_connections 2023-11-08T19:24:11.960 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.954+0000 7fcd32756700 1 -- 172.21.15.149:0/900620025 wait complete. 2023-11-08T19:24:11.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.955+0000 7fcd32756700 1 Processor -- start 2023-11-08T19:24:11.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.955+0000 7fcd32756700 1 -- start start 2023-11-08T19:24:11.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.956+0000 7fcd32756700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd2c0cb300 0x7fcd2c0b3250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:11.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.956+0000 7fcd32756700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd2c0cc140 0x7fcd2c15fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:11.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.956+0000 7fcd32756700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcd2c0cc910 0x7fcd2c0aec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:11.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.956+0000 7fcd32756700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2c0b3790 con 0x7fcd2c0cb300 2023-11-08T19:24:11.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.956+0000 7fcd32756700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2c160100 con 0x7fcd2c0cc910 2023-11-08T19:24:11.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.956+0000 7fcd32756700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2c1f3f50 con 0x7fcd2c0cc140 2023-11-08T19:24:11.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.956+0000 7fcd2bfff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd2c0cb300 0x7fcd2c0b3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:11.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.956+0000 7fcd2bfff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd2c0cb300 0x7fcd2c0b3250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39102/0 (socket says 172.21.15.149:39102) 2023-11-08T19:24:11.965 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.956+0000 7fcd2bfff700 1 -- 172.21.15.149:0/1260464182 learned_addr learned my addr 172.21.15.149:0/1260464182 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:11.965 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.956+0000 7fcd2b7fe700 1 --2- 172.21.15.149:0/1260464182 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd2c0cc140 0x7fcd2c15fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:11.965 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.956+0000 7fcd30cf3700 1 --2- 172.21.15.149:0/1260464182 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcd2c0cc910 0x7fcd2c0aec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:11.965 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.956+0000 7fcd2bfff700 1 -- 172.21.15.149:0/1260464182 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd2c0cc140 msgr2=0x7fcd2c15fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:11.965 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.956+0000 7fcd2bfff700 1 --2- 172.21.15.149:0/1260464182 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd2c0cc140 0x7fcd2c15fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:11.966 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.956+0000 7fcd2bfff700 1 -- 172.21.15.149:0/1260464182 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcd2c0cc910 msgr2=0x7fcd2c0aec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:11.966 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.956+0000 7fcd2bfff700 1 --2- 172.21.15.149:0/1260464182 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcd2c0cc910 0x7fcd2c0aec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:11.966 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.956+0000 7fcd2bfff700 1 -- 172.21.15.149:0/1260464182 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd24009a70 con 0x7fcd2c0cb300 2023-11-08T19:24:11.966 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.956+0000 7fcd2b7fe700 1 --2- 172.21.15.149:0/1260464182 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd2c0cc140 0x7fcd2c15fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:24:11.966 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.956+0000 7fcd2bfff700 1 --2- 172.21.15.149:0/1260464182 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd2c0cb300 0x7fcd2c0b3250 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fcd2000c750 tx=0x7fcd2000cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:11.967 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.957+0000 7fcd28ff9700 1 -- 172.21.15.149:0/1260464182 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd200074e0 con 0x7fcd2c0cb300 2023-11-08T19:24:11.967 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.957+0000 7fcd28ff9700 1 -- 172.21.15.149:0/1260464182 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd20007640 con 0x7fcd2c0cb300 2023-11-08T19:24:11.967 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.957+0000 7fcd32756700 1 -- 172.21.15.149:0/1260464182 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd2c0ad260 con 0x7fcd2c0cb300 2023-11-08T19:24:11.967 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.957+0000 7fcd28ff9700 1 -- 172.21.15.149:0/1260464182 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd20005a70 con 0x7fcd2c0cb300 2023-11-08T19:24:11.967 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.957+0000 7fcd32756700 1 -- 172.21.15.149:0/1260464182 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd2c0ad820 con 0x7fcd2c0cb300 2023-11-08T19:24:11.968 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.958+0000 7fcd32756700 1 -- 172.21.15.149:0/1260464182 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd2c0745f0 con 0x7fcd2c0cb300 2023-11-08T19:24:11.968 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.959+0000 7fcd28ff9700 1 -- 172.21.15.149:0/1260464182 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcd20005bd0 con 0x7fcd2c0cb300 2023-11-08T19:24:11.968 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.959+0000 7fcd28ff9700 1 --2- 172.21.15.149:0/1260464182 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fcd1806af00 0x7fcd1806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:11.968 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.959+0000 7fcd28ff9700 1 -- 172.21.15.149:0/1260464182 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fcd20088cd0 con 0x7fcd2c0cb300 2023-11-08T19:24:11.968 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.959+0000 7fcd2b7fe700 1 --2- 172.21.15.149:0/1260464182 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fcd1806af00 0x7fcd1806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:11.968 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.960+0000 7fcd2b7fe700 1 --2- 172.21.15.149:0/1260464182 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fcd1806af00 0x7fcd1806d3c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c09dcd0 tx=0x7fcd1c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:11.969 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:11.964+0000 7fcd28ff9700 1 -- 172.21.15.149:0/1260464182 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcd20054100 con 0x7fcd2c0cb300 2023-11-08T19:24:12.235 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.234+0000 7fcd32756700 1 -- 172.21.15.149:0/1260464182 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fcd2c0b28f0 con 0x7fcd2c0cb300 2023-11-08T19:24:12.237 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.236+0000 7fcd28ff9700 1 -- 172.21.15.149:0/1260464182 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7fcd20017020 con 0x7fcd2c0cb300 2023-11-08T19:24:12.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.239+0000 7fcd32756700 1 -- 172.21.15.149:0/1260464182 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fcd1806af00 msgr2=0x7fcd1806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:12.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.239+0000 7fcd32756700 1 --2- 172.21.15.149:0/1260464182 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fcd1806af00 0x7fcd1806d3c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c09dcd0 tx=0x7fcd1c009040 comp rx=0 tx=0).stop 2023-11-08T19:24:12.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.239+0000 7fcd32756700 1 -- 172.21.15.149:0/1260464182 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd2c0cb300 msgr2=0x7fcd2c0b3250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:12.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.239+0000 7fcd32756700 1 --2- 172.21.15.149:0/1260464182 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd2c0cb300 0x7fcd2c0b3250 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fcd2000c750 tx=0x7fcd2000cb10 comp rx=0 tx=0).stop 2023-11-08T19:24:12.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.239+0000 7fcd32756700 1 -- 172.21.15.149:0/1260464182 shutdown_connections 2023-11-08T19:24:12.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.239+0000 7fcd32756700 1 --2- 172.21.15.149:0/1260464182 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fcd1806af00 0x7fcd1806d3c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:12.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.239+0000 7fcd32756700 1 --2- 172.21.15.149:0/1260464182 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcd2c0cc910 0x7fcd2c0aec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:12.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.239+0000 7fcd32756700 1 --2- 172.21.15.149:0/1260464182 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd2c0cb300 0x7fcd2c0b3250 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:12.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.239+0000 7fcd32756700 1 --2- 172.21.15.149:0/1260464182 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd2c0cc140 0x7fcd2c15fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:12.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.239+0000 7fcd32756700 1 -- 172.21.15.149:0/1260464182 >> 172.21.15.149:0/1260464182 conn(0x7fcd2c099a40 msgr2=0x7fcd2c0c78e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:12.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.239+0000 7fcd32756700 1 -- 172.21.15.149:0/1260464182 shutdown_connections 2023-11-08T19:24:12.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.239+0000 7fcd32756700 1 -- 172.21.15.149:0/1260464182 wait complete. 2023-11-08T19:24:12.252 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-11-08T19:24:12.374 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.373+0000 7f6ab8462700 1 Processor -- start 2023-11-08T19:24:12.374 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.373+0000 7f6ab8462700 1 -- start start 2023-11-08T19:24:12.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.373+0000 7f6ab8462700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f6ab015df40 0x7f6ab00ce140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:12.378 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.374+0000 7f6ab8462700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6ab00d2250 0x7f6ab00ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:12.378 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.374+0000 7f6ab8462700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ab00d04f0 con 0x7f6ab00b2b60 2023-11-08T19:24:12.378 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.374+0000 7f6ab8462700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ab00cbeb0 con 0x7f6ab015df40 2023-11-08T19:24:12.378 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.374+0000 7f6ab8462700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab00d0740 con 0x7f6ab00d2250 2023-11-08T19:24:12.379 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.374+0000 7f6ab59fd700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f6ab00b2b60 0x7f6ab006bfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:41114/0 (socket says 172.21.15.149:41114) 2023-11-08T19:24:12.379 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.374+0000 7f6ab59fd700 1 -- 172.21.15.149:0/1535934238 learned_addr learned my addr 172.21.15.149:0/1535934238 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:24:12.379 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.374+0000 7f6ab51fc700 1 -- 172.21.15.149:0/1535934238 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1459625132 0 0) 0x7f6ab00d04f0 con 0x7f6ab00b2b60 2023-11-08T19:24:12.379 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.374+0000 7f6ab69ff700 1 --2- 172.21.15.149:0/1535934238 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6ab00d2250 0x7f6ab00ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:12.380 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.374+0000 7f6ab61fe700 1 --2- 172.21.15.149:0/1535934238 >> v2:172.21.15.160:3300/0 conn(0x7f6ab015df40 0x7f6ab00ce140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:12.380 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.374+0000 7f6ab51fc700 1 -- 172.21.15.149:0/1535934238 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a9c0035b0 con 0x7f6ab00b2b60 2023-11-08T19:24:12.380 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.374+0000 7f6ab51fc700 1 -- 172.21.15.149:0/1535934238 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1153642553 0 0) 0x7f6a9c0035b0 con 0x7f6ab00b2b60 2023-11-08T19:24:12.380 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.374+0000 7f6ab51fc700 1 -- 172.21.15.149:0/1535934238 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6ab00d2250 msgr2=0x7f6ab00ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:12.380 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.374+0000 7f6ab51fc700 1 --2- 172.21.15.149:0/1535934238 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6ab00d2250 0x7f6ab00ce680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:12.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.374+0000 7f6ab51fc700 1 -- 172.21.15.149:0/1535934238 >> v2:172.21.15.160:3300/0 conn(0x7f6ab015df40 msgr2=0x7f6ab00ce140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:12.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.374+0000 7f6ab51fc700 1 --2- 172.21.15.149:0/1535934238 >> v2:172.21.15.160:3300/0 conn(0x7f6ab015df40 0x7f6ab00ce140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:12.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.374+0000 7f6ab51fc700 1 -- 172.21.15.149:0/1535934238 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab00d0a20 con 0x7f6ab00b2b60 2023-11-08T19:24:12.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.374+0000 7f6ab51fc700 1 -- 172.21.15.149:0/1535934238 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f6aac001670 con 0x7f6ab00b2b60 2023-11-08T19:24:12.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.374+0000 7f6ab51fc700 1 -- 172.21.15.149:0/1535934238 >> v1:172.21.15.149:6789/0 conn(0x7f6ab00b2b60 legacy=0x7f6ab006bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:12.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.374+0000 7f6ab51fc700 1 --2- 172.21.15.149:0/1535934238 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a9c003a00 0x7f6a9c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:12.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.374+0000 7f6ab51fc700 1 --2- 172.21.15.149:0/1535934238 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6ab00d2250 0x7f6a9c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:12.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.374+0000 7f6ab51fc700 1 --2- 172.21.15.149:0/1535934238 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6a9c004d90 0x7f6a9c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:12.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.374+0000 7f6ab51fc700 1 -- 172.21.15.149:0/1535934238 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab00cbeb0 con 0x7f6a9c003a00 2023-11-08T19:24:12.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.374+0000 7f6ab51fc700 1 -- 172.21.15.149:0/1535934238 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab00d0740 con 0x7f6a9c004d90 2023-11-08T19:24:12.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.374+0000 7f6ab51fc700 1 -- 172.21.15.149:0/1535934238 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9c00ba40 con 0x7f6ab00d2250 2023-11-08T19:24:12.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.374+0000 7f6ab61fe700 1 --2- 172.21.15.149:0/1535934238 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a9c003a00 0x7f6a9c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:12.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.375+0000 7f6ab59fd700 1 --2- 172.21.15.149:0/1535934238 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6ab00d2250 0x7f6a9c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:12.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.375+0000 7f6ab69ff700 1 --2- 172.21.15.149:0/1535934238 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6a9c004d90 0x7f6a9c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:12.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.375+0000 7f6ab61fe700 1 -- 172.21.15.149:0/1535934238 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6ab00d2250 msgr2=0x7f6a9c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:12.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.375+0000 7f6ab61fe700 1 --2- 172.21.15.149:0/1535934238 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6ab00d2250 0x7f6a9c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:12.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.375+0000 7f6ab61fe700 1 -- 172.21.15.149:0/1535934238 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6a9c004d90 msgr2=0x7f6a9c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:12.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.375+0000 7f6ab61fe700 1 --2- 172.21.15.149:0/1535934238 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6a9c004d90 0x7f6a9c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:12.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.375+0000 7f6ab61fe700 1 -- 172.21.15.149:0/1535934238 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a9c0035b0 con 0x7f6a9c003a00 2023-11-08T19:24:12.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.375+0000 7f6ab59fd700 1 --2- 172.21.15.149:0/1535934238 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6ab00d2250 0x7f6a9c004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:24:12.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.375+0000 7f6ab61fe700 1 --2- 172.21.15.149:0/1535934238 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a9c003a00 0x7f6a9c003e20 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f6aa0009b40 tx=0x7f6a9c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a038f04d7394ff8 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:12.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.375+0000 7f6ab51fc700 1 -- 172.21.15.149:0/1535934238 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa0005a20 con 0x7f6a9c003a00 2023-11-08T19:24:12.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.375+0000 7f6ab51fc700 1 -- 172.21.15.149:0/1535934238 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aa0005b80 con 0x7f6a9c003a00 2023-11-08T19:24:12.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.375+0000 7f6ab51fc700 1 -- 172.21.15.149:0/1535934238 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa000e6c0 con 0x7f6a9c003a00 2023-11-08T19:24:12.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.376+0000 7f6ab8462700 1 -- 172.21.15.149:0/1535934238 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a9c003a00 msgr2=0x7f6a9c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:12.387 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.376+0000 7f6ab8462700 1 --2- 172.21.15.149:0/1535934238 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a9c003a00 0x7f6a9c003e20 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f6aa0009b40 tx=0x7f6a9c005880 comp rx=0 tx=0).stop 2023-11-08T19:24:12.387 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.376+0000 7f6ab69ff700 1 -- 172.21.15.149:0/1535934238 reap_dead start 2023-11-08T19:24:12.387 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.376+0000 7f6ab8462700 1 -- 172.21.15.149:0/1535934238 shutdown_connections 2023-11-08T19:24:12.387 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.376+0000 7f6ab8462700 1 -- 172.21.15.149:0/1535934238 >> 172.21.15.149:0/1535934238 conn(0x7f6ab00d1730 msgr2=0x7f6ab00d1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:12.387 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.376+0000 7f6ab8462700 1 -- 172.21.15.149:0/1535934238 shutdown_connections 2023-11-08T19:24:12.388 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.376+0000 7f6ab8462700 1 -- 172.21.15.149:0/1535934238 wait complete. 2023-11-08T19:24:12.390 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.377+0000 7f6ab8462700 1 Processor -- start 2023-11-08T19:24:12.391 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.377+0000 7f6ab8462700 1 -- start start 2023-11-08T19:24:12.391 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.378+0000 7f6ab8462700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6a9c003a00 0x7f6ab01604a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:12.391 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.378+0000 7f6ab8462700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6ab015e630 0x7f6ab015eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:12.391 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.378+0000 7f6ab8462700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ab0144ae0 0x7f6ab0144f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:12.392 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.378+0000 7f6ab8462700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab015eff0 con 0x7f6ab0144ae0 2023-11-08T19:24:12.392 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.378+0000 7f6ab8462700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab01454b0 con 0x7f6a9c003a00 2023-11-08T19:24:12.392 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.378+0000 7f6ab8462700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab0160df0 con 0x7f6ab015e630 2023-11-08T19:24:12.392 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.378+0000 7f6ab69ff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ab0144ae0 0x7f6ab0144f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:12.392 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.378+0000 7f6ab69ff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ab0144ae0 0x7f6ab0144f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39126/0 (socket says 172.21.15.149:39126) 2023-11-08T19:24:12.393 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.378+0000 7f6ab69ff700 1 -- 172.21.15.149:0/3141155061 learned_addr learned my addr 172.21.15.149:0/3141155061 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:12.393 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.379+0000 7f6ab61fe700 1 --2- 172.21.15.149:0/3141155061 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6a9c003a00 0x7f6ab01604a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:12.393 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.379+0000 7f6ab59fd700 1 --2- 172.21.15.149:0/3141155061 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6ab015e630 0x7f6ab015eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:12.393 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.379+0000 7f6ab69ff700 1 -- 172.21.15.149:0/3141155061 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6ab015e630 msgr2=0x7f6ab015eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:12.393 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.379+0000 7f6ab69ff700 1 --2- 172.21.15.149:0/3141155061 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6ab015e630 0x7f6ab015eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:12.394 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.379+0000 7f6ab69ff700 1 -- 172.21.15.149:0/3141155061 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6a9c003a00 msgr2=0x7f6ab01604a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:12.394 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.379+0000 7f6ab69ff700 1 --2- 172.21.15.149:0/3141155061 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6a9c003a00 0x7f6ab01604a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:12.394 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.379+0000 7f6ab69ff700 1 -- 172.21.15.149:0/3141155061 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab015e4a0 con 0x7f6ab0144ae0 2023-11-08T19:24:12.394 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.379+0000 7f6ab69ff700 1 --2- 172.21.15.149:0/3141155061 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ab0144ae0 0x7f6ab0144f70 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0072cf0 tx=0x7f6aa8011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:12.394 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.379+0000 7f6aa6ffd700 1 -- 172.21.15.149:0/3141155061 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa800e040 con 0x7f6ab0144ae0 2023-11-08T19:24:12.395 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.379+0000 7f6aa6ffd700 1 -- 172.21.15.149:0/3141155061 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aa800f040 con 0x7f6ab0144ae0 2023-11-08T19:24:12.395 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.379+0000 7f6ab8462700 1 -- 172.21.15.149:0/3141155061 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ab01610d0 con 0x7f6ab0144ae0 2023-11-08T19:24:12.395 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.379+0000 7f6aa6ffd700 1 -- 172.21.15.149:0/3141155061 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa800fc40 con 0x7f6ab0144ae0 2023-11-08T19:24:12.395 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.379+0000 7f6ab8462700 1 -- 172.21.15.149:0/3141155061 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ab0161690 con 0x7f6ab0144ae0 2023-11-08T19:24:12.395 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.380+0000 7f6ab8462700 1 -- 172.21.15.149:0/3141155061 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ab0157cb0 con 0x7f6ab0144ae0 2023-11-08T19:24:12.396 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.381+0000 7f6aa6ffd700 1 -- 172.21.15.149:0/3141155061 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6aa8015430 con 0x7f6ab0144ae0 2023-11-08T19:24:12.396 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.381+0000 7f6aa6ffd700 1 --2- 172.21.15.149:0/3141155061 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6a9406af00 0x7f6a9406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:12.396 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.381+0000 7f6aa6ffd700 1 -- 172.21.15.149:0/3141155061 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f6aa8089ab0 con 0x7f6ab0144ae0 2023-11-08T19:24:12.396 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.381+0000 7f6ab61fe700 1 --2- 172.21.15.149:0/3141155061 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6a9406af00 0x7f6a9406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:12.396 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.381+0000 7f6ab61fe700 1 --2- 172.21.15.149:0/3141155061 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6a9406af00 0x7f6a9406d3c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6aa0000c00 tx=0x7f6aa0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:12.397 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.386+0000 7f6aa6ffd700 1 -- 172.21.15.149:0/3141155061 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6ab0157cb0 con 0x7f6ab0144ae0 2023-11-08T19:24:12.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.660+0000 7f6ab8462700 1 -- 172.21.15.149:0/3141155061 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f6ab0157cb0 con 0x7f6ab0144ae0 2023-11-08T19:24:12.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.662+0000 7f6aa6ffd700 1 -- 172.21.15.149:0/3141155061 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) v1 ==== 97+0+0 (secure 0 0 0) 0x7f6ab0157cb0 con 0x7f6ab0144ae0 2023-11-08T19:24:12.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.664+0000 7f6ab8462700 1 -- 172.21.15.149:0/3141155061 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6a9406af00 msgr2=0x7f6a9406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:12.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.664+0000 7f6ab8462700 1 --2- 172.21.15.149:0/3141155061 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6a9406af00 0x7f6a9406d3c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6aa0000c00 tx=0x7f6aa0008030 comp rx=0 tx=0).stop 2023-11-08T19:24:12.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.664+0000 7f6ab8462700 1 -- 172.21.15.149:0/3141155061 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ab0144ae0 msgr2=0x7f6ab0144f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:12.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.664+0000 7f6ab8462700 1 --2- 172.21.15.149:0/3141155061 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ab0144ae0 0x7f6ab0144f70 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0072cf0 tx=0x7f6aa8011ed0 comp rx=0 tx=0).stop 2023-11-08T19:24:12.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.664+0000 7f6ab8462700 1 -- 172.21.15.149:0/3141155061 shutdown_connections 2023-11-08T19:24:12.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.664+0000 7f6ab8462700 1 --2- 172.21.15.149:0/3141155061 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6a9406af00 0x7f6a9406d3c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:12.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.664+0000 7f6ab8462700 1 --2- 172.21.15.149:0/3141155061 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6a9c003a00 0x7f6ab01604a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:12.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.664+0000 7f6ab8462700 1 --2- 172.21.15.149:0/3141155061 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ab0144ae0 0x7f6ab0144f70 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:12.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.664+0000 7f6ab8462700 1 --2- 172.21.15.149:0/3141155061 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6ab015e630 0x7f6ab015eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:12.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.664+0000 7f6ab8462700 1 -- 172.21.15.149:0/3141155061 >> 172.21.15.149:0/3141155061 conn(0x7f6ab00d1730 msgr2=0x7f6ab006f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:12.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.664+0000 7f6ab8462700 1 -- 172.21.15.149:0/3141155061 shutdown_connections 2023-11-08T19:24:12.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.664+0000 7f6ab8462700 1 -- 172.21.15.149:0/3141155061 wait complete. 2023-11-08T19:24:12.678 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-11-08T19:24:12.800 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.798+0000 7f6e7ff17700 1 Processor -- start 2023-11-08T19:24:12.800 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.799+0000 7f6e7ff17700 1 -- start start 2023-11-08T19:24:12.802 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.799+0000 7f6e7ff17700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6e780cc140 0x7f6e780cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:12.802 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.799+0000 7f6e7ff17700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e780cce50 con 0x7f6e780b2850 2023-11-08T19:24:12.802 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.799+0000 7f6e7ff17700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e780cc520 con 0x7f6e780b2cd0 2023-11-08T19:24:12.803 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.799+0000 7f6e7ff17700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e780b2430 con 0x7f6e780cc140 2023-11-08T19:24:12.803 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.800+0000 7f6e7dcb3700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6e780cc140 0x7f6e780cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:12.803 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.800+0000 7f6e7d4b2700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f6e780b2850 0x7f6e780cabf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:41132/0 (socket says 172.21.15.149:41132) 2023-11-08T19:24:12.803 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.800+0000 7f6e7d4b2700 1 -- 172.21.15.149:0/3847756629 learned_addr learned my addr 172.21.15.149:0/3847756629 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:24:12.803 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.800+0000 7f6e7dcb3700 1 -- 172.21.15.149:0/3847756629 >> v1:172.21.15.160:6789/0 conn(0x7f6e780b2cd0 legacy=0x7f6e7815d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:12.804 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.800+0000 7f6e7dcb3700 1 -- 172.21.15.149:0/3847756629 >> v1:172.21.15.149:6789/0 conn(0x7f6e780b2850 legacy=0x7f6e780cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:12.804 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.800+0000 7f6e7dcb3700 1 -- 172.21.15.149:0/3847756629 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e780b17b0 con 0x7f6e780cc140 2023-11-08T19:24:12.804 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.800+0000 7f6e7dcb3700 1 --2- 172.21.15.149:0/3847756629 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e780cc140 0x7f6e780cc910 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f6e68009820 tx=0x7f6e68009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71b6425422a1e52a server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:12.804 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.800+0000 7f6e7ccb1700 1 -- 172.21.15.149:0/3847756629 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e68005e30 con 0x7f6e780cc140 2023-11-08T19:24:12.804 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.800+0000 7f6e7ccb1700 1 -- 172.21.15.149:0/3847756629 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e68006030 con 0x7f6e780cc140 2023-11-08T19:24:12.805 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.800+0000 7f6e7ccb1700 1 -- 172.21.15.149:0/3847756629 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e680063e0 con 0x7f6e780cc140 2023-11-08T19:24:12.805 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.801+0000 7f6e7ff17700 1 -- 172.21.15.149:0/3847756629 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e780cc140 msgr2=0x7f6e780cc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:12.805 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.801+0000 7f6e7ff17700 1 --2- 172.21.15.149:0/3847756629 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e780cc140 0x7f6e780cc910 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f6e68009820 tx=0x7f6e68009b30 comp rx=0 tx=0).stop 2023-11-08T19:24:12.805 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.801+0000 7f6e7ff17700 1 -- 172.21.15.149:0/3847756629 shutdown_connections 2023-11-08T19:24:12.805 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.801+0000 7f6e7ff17700 1 --2- 172.21.15.149:0/3847756629 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e780cc140 0x7f6e780cc910 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:12.805 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.801+0000 7f6e7ff17700 1 -- 172.21.15.149:0/3847756629 >> 172.21.15.149:0/3847756629 conn(0x7f6e78099a40 msgr2=0x7f6e780d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:12.806 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.801+0000 7f6e7ff17700 1 -- 172.21.15.149:0/3847756629 shutdown_connections 2023-11-08T19:24:12.806 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.801+0000 7f6e7ff17700 1 -- 172.21.15.149:0/3847756629 wait complete. 2023-11-08T19:24:12.809 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.802+0000 7f6e7ff17700 1 Processor -- start 2023-11-08T19:24:12.809 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.802+0000 7f6e7ff17700 1 -- start start 2023-11-08T19:24:12.809 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.803+0000 7f6e7ff17700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6e780b2850 0x7f6e781576f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:12.809 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.803+0000 7f6e7ff17700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e780b2cd0 0x7f6e7815dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:12.809 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.803+0000 7f6e7ff17700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6e780cc140 0x7f6e7815c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:12.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.803+0000 7f6e7ff17700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e780b40b0 con 0x7f6e780b2cd0 2023-11-08T19:24:12.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.803+0000 7f6e7ff17700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e780b4390 con 0x7f6e780b2850 2023-11-08T19:24:12.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.803+0000 7f6e7ff17700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7815e450 con 0x7f6e780cc140 2023-11-08T19:24:12.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.803+0000 7f6e7d4b2700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e780b2cd0 0x7f6e7815dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:12.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.803+0000 7f6e7d4b2700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e780b2cd0 0x7f6e7815dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39136/0 (socket says 172.21.15.149:39136) 2023-11-08T19:24:12.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.803+0000 7f6e7d4b2700 1 -- 172.21.15.149:0/2398318253 learned_addr learned my addr 172.21.15.149:0/2398318253 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:12.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.804+0000 7f6e7dcb3700 1 --2- 172.21.15.149:0/2398318253 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6e780b2850 0x7f6e781576f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:12.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.804+0000 7f6e7e4b4700 1 --2- 172.21.15.149:0/2398318253 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6e780cc140 0x7f6e7815c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:12.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.804+0000 7f6e7d4b2700 1 -- 172.21.15.149:0/2398318253 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6e780cc140 msgr2=0x7f6e7815c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:12.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.804+0000 7f6e7d4b2700 1 --2- 172.21.15.149:0/2398318253 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6e780cc140 0x7f6e7815c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:12.812 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.804+0000 7f6e7d4b2700 1 -- 172.21.15.149:0/2398318253 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6e780b2850 msgr2=0x7f6e781576f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:12.812 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.804+0000 7f6e7d4b2700 1 --2- 172.21.15.149:0/2398318253 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6e780b2850 0x7f6e781576f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:12.812 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.804+0000 7f6e7d4b2700 1 -- 172.21.15.149:0/2398318253 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e68009430 con 0x7f6e780b2cd0 2023-11-08T19:24:12.812 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.804+0000 7f6e7e4b4700 1 --2- 172.21.15.149:0/2398318253 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6e780cc140 0x7f6e7815c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:24:12.812 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.804+0000 7f6e7dcb3700 1 --2- 172.21.15.149:0/2398318253 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6e780b2850 0x7f6e781576f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:24:12.813 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.804+0000 7f6e7d4b2700 1 --2- 172.21.15.149:0/2398318253 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e780b2cd0 0x7f6e7815dd70 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f6e7400c4b0 tx=0x7f6e7400c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:12.813 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.804+0000 7f6e6e7fc700 1 -- 172.21.15.149:0/2398318253 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e74005d70 con 0x7f6e780b2cd0 2023-11-08T19:24:12.813 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.804+0000 7f6e6e7fc700 1 -- 172.21.15.149:0/2398318253 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e740070d0 con 0x7f6e780b2cd0 2023-11-08T19:24:12.813 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.804+0000 7f6e7ff17700 1 -- 172.21.15.149:0/2398318253 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e7815e730 con 0x7f6e780b2cd0 2023-11-08T19:24:12.813 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.804+0000 7f6e6e7fc700 1 -- 172.21.15.149:0/2398318253 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e74007440 con 0x7f6e780b2cd0 2023-11-08T19:24:12.814 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.804+0000 7f6e7ff17700 1 -- 172.21.15.149:0/2398318253 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e7815c750 con 0x7f6e780b2cd0 2023-11-08T19:24:12.814 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.805+0000 7f6e7ff17700 1 -- 172.21.15.149:0/2398318253 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e7815c940 con 0x7f6e780b2cd0 2023-11-08T19:24:12.814 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.805+0000 7f6e6e7fc700 1 -- 172.21.15.149:0/2398318253 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6e740075a0 con 0x7f6e780b2cd0 2023-11-08T19:24:12.814 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.806+0000 7f6e6e7fc700 1 --2- 172.21.15.149:0/2398318253 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6e5c06af00 0x7f6e5c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:12.814 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.806+0000 7f6e6e7fc700 1 -- 172.21.15.149:0/2398318253 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f6e74088670 con 0x7f6e780b2cd0 2023-11-08T19:24:12.815 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.806+0000 7f6e7dcb3700 1 --2- 172.21.15.149:0/2398318253 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6e5c06af00 0x7f6e5c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:12.815 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.806+0000 7f6e7dcb3700 1 --2- 172.21.15.149:0/2398318253 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6e5c06af00 0x7f6e5c06d3c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6e68013040 tx=0x7f6e68008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:12.815 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:12.811+0000 7f6e6e7fc700 1 -- 172.21.15.149:0/2398318253 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6e74053a70 con 0x7f6e780b2cd0 2023-11-08T19:24:13.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.081+0000 7f6e7ff17700 1 -- 172.21.15.149:0/2398318253 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f6e780745f0 con 0x7f6e780b2cd0 2023-11-08T19:24:13.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.083+0000 7f6e6e7fc700 1 -- 172.21.15.149:0/2398318253 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) v1 ==== 90+0+0 (secure 0 0 0) 0x7f6e74057090 con 0x7f6e780b2cd0 2023-11-08T19:24:13.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.086+0000 7f6e7ff17700 1 -- 172.21.15.149:0/2398318253 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6e5c06af00 msgr2=0x7f6e5c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:13.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.086+0000 7f6e7ff17700 1 --2- 172.21.15.149:0/2398318253 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6e5c06af00 0x7f6e5c06d3c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6e68013040 tx=0x7f6e68008070 comp rx=0 tx=0).stop 2023-11-08T19:24:13.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.086+0000 7f6e7ff17700 1 -- 172.21.15.149:0/2398318253 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e780b2cd0 msgr2=0x7f6e7815dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:13.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.086+0000 7f6e7ff17700 1 --2- 172.21.15.149:0/2398318253 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e780b2cd0 0x7f6e7815dd70 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f6e7400c4b0 tx=0x7f6e7400c870 comp rx=0 tx=0).stop 2023-11-08T19:24:13.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.086+0000 7f6e7ff17700 1 -- 172.21.15.149:0/2398318253 shutdown_connections 2023-11-08T19:24:13.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.086+0000 7f6e7ff17700 1 --2- 172.21.15.149:0/2398318253 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6e5c06af00 0x7f6e5c06d3c0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:13.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.086+0000 7f6e7ff17700 1 --2- 172.21.15.149:0/2398318253 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6e780b2850 0x7f6e781576f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:13.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.086+0000 7f6e7ff17700 1 --2- 172.21.15.149:0/2398318253 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6e780cc140 0x7f6e7815c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:13.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.086+0000 7f6e7ff17700 1 --2- 172.21.15.149:0/2398318253 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e780b2cd0 0x7f6e7815dd70 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:13.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.086+0000 7f6e7ff17700 1 -- 172.21.15.149:0/2398318253 >> 172.21.15.149:0/2398318253 conn(0x7f6e78099a40 msgr2=0x7f6e780d0380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:13.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.086+0000 7f6e7ff17700 1 -- 172.21.15.149:0/2398318253 shutdown_connections 2023-11-08T19:24:13.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.086+0000 7f6e7ff17700 1 -- 172.21.15.149:0/2398318253 wait complete. 2023-11-08T19:24:13.099 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:24:13.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.218+0000 7f48841ef700 1 Processor -- start 2023-11-08T19:24:13.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.219+0000 7f48841ef700 1 -- start start 2023-11-08T19:24:13.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.219+0000 7f48841ef700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f487c0cc140 0x7f487c0cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:13.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.219+0000 7f48841ef700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f487c0cce50 con 0x7f487c0b2850 2023-11-08T19:24:13.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.219+0000 7f48841ef700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f487c0cc520 con 0x7f487c0b2cd0 2023-11-08T19:24:13.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.219+0000 7f48841ef700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f487c0b2430 con 0x7f487c0cc140 2023-11-08T19:24:13.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.219+0000 7f488178a700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f487c0b2850 0x7f487c0cabf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:41146/0 (socket says 172.21.15.149:41146) 2023-11-08T19:24:13.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.220+0000 7f488178a700 1 -- 172.21.15.149:0/3238660344 learned_addr learned my addr 172.21.15.149:0/3238660344 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:24:13.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.220+0000 7f4881f8b700 1 --2- 172.21.15.149:0/3238660344 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f487c0cc140 0x7f487c0cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:13.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.220+0000 7f4880f89700 1 -- 172.21.15.149:0/3238660344 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4132074967 0 0) 0x7f487c0cce50 con 0x7f487c0b2850 2023-11-08T19:24:13.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.220+0000 7f4880f89700 1 -- 172.21.15.149:0/3238660344 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48680035b0 con 0x7f487c0b2850 2023-11-08T19:24:13.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.220+0000 7f4880f89700 1 -- 172.21.15.149:0/3238660344 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2564748827 0 0) 0x7f48680035b0 con 0x7f487c0b2850 2023-11-08T19:24:13.226 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.220+0000 7f4880f89700 1 -- 172.21.15.149:0/3238660344 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f487c0cc140 msgr2=0x7f487c0cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:13.226 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.220+0000 7f4880f89700 1 --2- 172.21.15.149:0/3238660344 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f487c0cc140 0x7f487c0cc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:13.226 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.220+0000 7f4880f89700 1 -- 172.21.15.149:0/3238660344 >> v1:172.21.15.160:6789/0 conn(0x7f487c0b2cd0 legacy=0x7f487c15d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:13.226 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.220+0000 7f4880f89700 1 -- 172.21.15.149:0/3238660344 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f487c0b17b0 con 0x7f487c0b2850 2023-11-08T19:24:13.226 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.220+0000 7f4880f89700 1 -- 172.21.15.149:0/3238660344 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f4878001670 con 0x7f487c0b2850 2023-11-08T19:24:13.227 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.220+0000 7f4880f89700 1 -- 172.21.15.149:0/3238660344 >> v1:172.21.15.149:6789/0 conn(0x7f487c0b2850 legacy=0x7f487c0cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:13.227 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.220+0000 7f4880f89700 1 --2- 172.21.15.149:0/3238660344 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4868003a30 0x7f4868003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:13.227 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.220+0000 7f4880f89700 1 --2- 172.21.15.149:0/3238660344 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f487c0cc140 0x7f4868004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:13.227 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.220+0000 7f4880f89700 1 --2- 172.21.15.149:0/3238660344 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4868004d90 0x7f4868005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:13.227 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.220+0000 7f4880f89700 1 -- 172.21.15.149:0/3238660344 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487c0b2430 con 0x7f4868003a30 2023-11-08T19:24:13.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.220+0000 7f4880f89700 1 -- 172.21.15.149:0/3238660344 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f486800bac0 con 0x7f4868004d90 2023-11-08T19:24:13.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.220+0000 7f4880f89700 1 -- 172.21.15.149:0/3238660344 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f486800bc80 con 0x7f487c0cc140 2023-11-08T19:24:13.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.220+0000 7f4881f8b700 1 --2- 172.21.15.149:0/3238660344 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4868003a30 0x7f4868003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:13.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.220+0000 7f488178a700 1 --2- 172.21.15.149:0/3238660344 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f487c0cc140 0x7f4868004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:13.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.220+0000 7f488278c700 1 --2- 172.21.15.149:0/3238660344 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4868004d90 0x7f4868005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:13.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.220+0000 7f4881f8b700 1 -- 172.21.15.149:0/3238660344 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f487c0cc140 msgr2=0x7f4868004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:13.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.220+0000 7f4881f8b700 1 --2- 172.21.15.149:0/3238660344 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f487c0cc140 0x7f4868004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:13.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.220+0000 7f4881f8b700 1 -- 172.21.15.149:0/3238660344 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4868004d90 msgr2=0x7f4868005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:13.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.220+0000 7f4881f8b700 1 --2- 172.21.15.149:0/3238660344 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4868004d90 0x7f4868005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:13.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.220+0000 7f4881f8b700 1 -- 172.21.15.149:0/3238660344 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48680035b0 con 0x7f4868003a30 2023-11-08T19:24:13.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.220+0000 7f488178a700 1 --2- 172.21.15.149:0/3238660344 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f487c0cc140 0x7f4868004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:24:13.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.221+0000 7f4881f8b700 1 --2- 172.21.15.149:0/3238660344 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4868003a30 0x7f4868003e50 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f486c009b10 tx=0x7f4868005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc81fe6c22c8317b server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:13.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.221+0000 7f4880f89700 1 -- 172.21.15.149:0/3238660344 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486c005a20 con 0x7f4868003a30 2023-11-08T19:24:13.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.221+0000 7f4880f89700 1 -- 172.21.15.149:0/3238660344 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f486c005b80 con 0x7f4868003a30 2023-11-08T19:24:13.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.221+0000 7f4880f89700 1 -- 172.21.15.149:0/3238660344 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486c00e6c0 con 0x7f4868003a30 2023-11-08T19:24:13.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.221+0000 7f48841ef700 1 -- 172.21.15.149:0/3238660344 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4868003a30 msgr2=0x7f4868003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:13.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.221+0000 7f48841ef700 1 --2- 172.21.15.149:0/3238660344 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4868003a30 0x7f4868003e50 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f486c009b10 tx=0x7f4868005880 comp rx=0 tx=0).stop 2023-11-08T19:24:13.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.221+0000 7f488278c700 1 -- 172.21.15.149:0/3238660344 reap_dead start 2023-11-08T19:24:13.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.221+0000 7f48841ef700 1 -- 172.21.15.149:0/3238660344 shutdown_connections 2023-11-08T19:24:13.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.221+0000 7f48841ef700 1 -- 172.21.15.149:0/3238660344 >> 172.21.15.149:0/3238660344 conn(0x7f487c099a40 msgr2=0x7f487c0d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:13.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.221+0000 7f48841ef700 1 -- 172.21.15.149:0/3238660344 shutdown_connections 2023-11-08T19:24:13.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.221+0000 7f48841ef700 1 -- 172.21.15.149:0/3238660344 wait complete. 2023-11-08T19:24:13.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.223+0000 7f48841ef700 1 Processor -- start 2023-11-08T19:24:13.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.223+0000 7f48841ef700 1 -- start start 2023-11-08T19:24:13.235 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.223+0000 7f48841ef700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4868003a30 0x7f487c09dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:13.235 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.223+0000 7f48841ef700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f487c153b00 0x7f487c09a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:13.235 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.223+0000 7f48841ef700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f487c09a880 0x7f487c06f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:13.235 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.223+0000 7f48841ef700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487c09e280 con 0x7f4868003a30 2023-11-08T19:24:13.236 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.223+0000 7f48841ef700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487c0b0400 con 0x7f487c153b00 2023-11-08T19:24:13.236 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.223+0000 7f48841ef700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f487c0b06e0 con 0x7f487c09a880 2023-11-08T19:24:13.236 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.223+0000 7f4881f8b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4868003a30 0x7f487c09dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:13.236 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.223+0000 7f4881f8b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4868003a30 0x7f487c09dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39156/0 (socket says 172.21.15.149:39156) 2023-11-08T19:24:13.236 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.223+0000 7f4881f8b700 1 -- 172.21.15.149:0/3572456243 learned_addr learned my addr 172.21.15.149:0/3572456243 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:13.237 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.224+0000 7f488278c700 1 --2- 172.21.15.149:0/3572456243 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f487c09a880 0x7f487c06f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:13.237 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.224+0000 7f488178a700 1 --2- 172.21.15.149:0/3572456243 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f487c153b00 0x7f487c09a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:13.237 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.224+0000 7f4881f8b700 1 -- 172.21.15.149:0/3572456243 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f487c09a880 msgr2=0x7f487c06f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:13.237 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.224+0000 7f4881f8b700 1 --2- 172.21.15.149:0/3572456243 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f487c09a880 0x7f487c06f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:13.237 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.224+0000 7f4881f8b700 1 -- 172.21.15.149:0/3572456243 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f487c153b00 msgr2=0x7f487c09a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:13.238 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.224+0000 7f4881f8b700 1 --2- 172.21.15.149:0/3572456243 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f487c153b00 0x7f487c09a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:13.238 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.224+0000 7f4881f8b700 1 -- 172.21.15.149:0/3572456243 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f487c0b09c0 con 0x7f4868003a30 2023-11-08T19:24:13.238 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.224+0000 7f4881f8b700 1 --2- 172.21.15.149:0/3572456243 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4868003a30 0x7f487c09dd40 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f48680047b0 tx=0x7f486c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:13.238 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.224+0000 7f48727fc700 1 -- 172.21.15.149:0/3572456243 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486c020070 con 0x7f4868003a30 2023-11-08T19:24:13.238 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.224+0000 7f48727fc700 1 -- 172.21.15.149:0/3572456243 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f486c004240 con 0x7f4868003a30 2023-11-08T19:24:13.239 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.224+0000 7f48841ef700 1 -- 172.21.15.149:0/3572456243 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f487c09e280 con 0x7f4868003a30 2023-11-08T19:24:13.239 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.224+0000 7f48727fc700 1 -- 172.21.15.149:0/3572456243 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486c004410 con 0x7f4868003a30 2023-11-08T19:24:13.239 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.224+0000 7f48841ef700 1 -- 172.21.15.149:0/3572456243 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f487c1f6bb0 con 0x7f4868003a30 2023-11-08T19:24:13.239 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.225+0000 7f48841ef700 1 -- 172.21.15.149:0/3572456243 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f487c1f6d70 con 0x7f4868003a30 2023-11-08T19:24:13.239 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.225+0000 7f48727fc700 1 -- 172.21.15.149:0/3572456243 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f486c0036a0 con 0x7f4868003a30 2023-11-08T19:24:13.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.226+0000 7f48727fc700 1 --2- 172.21.15.149:0/3572456243 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f486006af00 0x7f486006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:13.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.226+0000 7f48727fc700 1 -- 172.21.15.149:0/3572456243 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f486c08a510 con 0x7f4868003a30 2023-11-08T19:24:13.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.226+0000 7f488178a700 1 --2- 172.21.15.149:0/3572456243 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f486006af00 0x7f486006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:13.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.226+0000 7f488178a700 1 --2- 172.21.15.149:0/3572456243 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f486006af00 0x7f486006d3c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f487c157890 tx=0x7f4878009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:13.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.231+0000 7f48727fc700 1 -- 172.21.15.149:0/3572456243 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f486c055980 con 0x7f4868003a30 2023-11-08T19:24:13.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.422+0000 7f48841ef700 1 -- 172.21.15.149:0/3572456243 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f487c0745f0 con 0x7f4868003a30 2023-11-08T19:24:13.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.423+0000 7f48727fc700 1 -- 172.21.15.149:0/3572456243 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+13098 (secure 0 0 0) 0x7f486c058fa0 con 0x7f4868003a30 2023-11-08T19:24:13.424 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:24:13.424 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":35,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:24:10.107251+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:24:13.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.425+0000 7f48841ef700 1 -- 172.21.15.149:0/3572456243 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f486006af00 msgr2=0x7f486006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:13.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.425+0000 7f48841ef700 1 --2- 172.21.15.149:0/3572456243 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f486006af00 0x7f486006d3c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f487c157890 tx=0x7f4878009040 comp rx=0 tx=0).stop 2023-11-08T19:24:13.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.425+0000 7f48841ef700 1 -- 172.21.15.149:0/3572456243 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4868003a30 msgr2=0x7f487c09dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:13.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.425+0000 7f48841ef700 1 --2- 172.21.15.149:0/3572456243 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4868003a30 0x7f487c09dd40 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f48680047b0 tx=0x7f486c0047c0 comp rx=0 tx=0).stop 2023-11-08T19:24:13.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.425+0000 7f48841ef700 1 -- 172.21.15.149:0/3572456243 shutdown_connections 2023-11-08T19:24:13.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.425+0000 7f48841ef700 1 --2- 172.21.15.149:0/3572456243 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f486006af00 0x7f486006d3c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:13.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.425+0000 7f48841ef700 1 --2- 172.21.15.149:0/3572456243 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f487c09a880 0x7f487c06f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:13.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.425+0000 7f48841ef700 1 --2- 172.21.15.149:0/3572456243 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4868003a30 0x7f487c09dd40 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:13.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.425+0000 7f48841ef700 1 --2- 172.21.15.149:0/3572456243 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f487c153b00 0x7f487c09a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:13.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.425+0000 7f48841ef700 1 -- 172.21.15.149:0/3572456243 >> 172.21.15.149:0/3572456243 conn(0x7f487c099a40 msgr2=0x7f487c0cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:13.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.425+0000 7f48841ef700 1 -- 172.21.15.149:0/3572456243 shutdown_connections 2023-11-08T19:24:13.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.425+0000 7f48841ef700 1 -- 172.21.15.149:0/3572456243 wait complete. 2023-11-08T19:24:13.439 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-08T19:22:56.023194+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-08T19:24:13.440 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-08T19:24:13.567 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.566+0000 7ff213e28700 1 Processor -- start 2023-11-08T19:24:13.567 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.566+0000 7ff213e28700 1 -- start start 2023-11-08T19:24:13.570 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.567+0000 7ff213e28700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff20c0cc0d0 0x7ff20c15f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:13.570 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.567+0000 7ff213e28700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff20c0cc4b0 0x7ff20c15c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:13.570 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.567+0000 7ff213e28700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff20c15be80 con 0x7ff20c15cb60 2023-11-08T19:24:13.570 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.567+0000 7ff213e28700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff20c15f9b0 con 0x7ff20c0cc4b0 2023-11-08T19:24:13.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.567+0000 7ff213e28700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff20c15fba0 con 0x7ff20c0cc0d0 2023-11-08T19:24:13.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.567+0000 7ff2113c3700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff20c0cc4b0 0x7ff20c15c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:13.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.567+0000 7ff2123c5700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7ff20c15cb60 0x7ff20c0cf320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:41170/0 (socket says 172.21.15.149:41170) 2023-11-08T19:24:13.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.567+0000 7ff2123c5700 1 -- 172.21.15.149:0/62345616 learned_addr learned my addr 172.21.15.149:0/62345616 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:24:13.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.567+0000 7ff211bc4700 1 --2- 172.21.15.149:0/62345616 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff20c0cc0d0 0x7ff20c15f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:13.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.567+0000 7ff2113c3700 1 -- 172.21.15.149:0/62345616 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff20c0cc0d0 msgr2=0x7ff20c15f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:13.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.567+0000 7ff2113c3700 1 --2- 172.21.15.149:0/62345616 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff20c0cc0d0 0x7ff20c15f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:13.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.567+0000 7ff2113c3700 1 -- 172.21.15.149:0/62345616 >> v1:172.21.15.149:6789/0 conn(0x7ff20c15cb60 legacy=0x7ff20c0cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:13.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.567+0000 7ff210bc2700 1 -- 172.21.15.149:0/62345616 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2671174724 0 0) 0x7ff20c15be80 con 0x7ff20c15cb60 2023-11-08T19:24:13.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.567+0000 7ff2113c3700 1 -- 172.21.15.149:0/62345616 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff20c15fe80 con 0x7ff20c0cc4b0 2023-11-08T19:24:13.573 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.568+0000 7ff2113c3700 1 --2- 172.21.15.149:0/62345616 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff20c0cc4b0 0x7ff20c15c620 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc009840 tx=0x7ff1fc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df28e6c86feec4da server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:13.573 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.568+0000 7ff210bc2700 1 -- 172.21.15.149:0/62345616 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc011830 con 0x7ff20c0cc4b0 2023-11-08T19:24:13.573 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.568+0000 7ff210bc2700 1 -- 172.21.15.149:0/62345616 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1fc011990 con 0x7ff20c0cc4b0 2023-11-08T19:24:13.573 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.568+0000 7ff210bc2700 1 -- 172.21.15.149:0/62345616 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc011d20 con 0x7ff20c0cc4b0 2023-11-08T19:24:13.573 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.568+0000 7ff213e28700 1 -- 172.21.15.149:0/62345616 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff20c0cc4b0 msgr2=0x7ff20c15c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:13.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.568+0000 7ff213e28700 1 --2- 172.21.15.149:0/62345616 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff20c0cc4b0 0x7ff20c15c620 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc009840 tx=0x7ff1fc009b50 comp rx=0 tx=0).stop 2023-11-08T19:24:13.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.568+0000 7ff213e28700 1 -- 172.21.15.149:0/62345616 shutdown_connections 2023-11-08T19:24:13.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.568+0000 7ff213e28700 1 --2- 172.21.15.149:0/62345616 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff20c0cc0d0 0x7ff20c15f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:13.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.568+0000 7ff213e28700 1 --2- 172.21.15.149:0/62345616 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff20c0cc4b0 0x7ff20c15c620 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:13.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.568+0000 7ff213e28700 1 -- 172.21.15.149:0/62345616 >> 172.21.15.149:0/62345616 conn(0x7ff20c06f120 msgr2=0x7ff20c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:13.575 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.568+0000 7ff213e28700 1 -- 172.21.15.149:0/62345616 shutdown_connections 2023-11-08T19:24:13.575 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.568+0000 7ff213e28700 1 -- 172.21.15.149:0/62345616 wait complete. 2023-11-08T19:24:13.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.569+0000 7ff213e28700 1 Processor -- start 2023-11-08T19:24:13.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.570+0000 7ff213e28700 1 -- start start 2023-11-08T19:24:13.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.570+0000 7ff213e28700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff20c0cc0d0 0x7ff20c14ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:13.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.570+0000 7ff213e28700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff20c0cc4b0 0x7ff20c0b2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:13.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.570+0000 7ff213e28700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff20c15cb60 0x7ff20c0b2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:13.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.570+0000 7ff213e28700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff20c0c8e90 con 0x7ff20c0cc4b0 2023-11-08T19:24:13.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.570+0000 7ff213e28700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff20c0c6ac0 con 0x7ff20c0cc0d0 2023-11-08T19:24:13.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.570+0000 7ff213e28700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff20c0c6da0 con 0x7ff20c15cb60 2023-11-08T19:24:13.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.570+0000 7ff2113c3700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff20c0cc4b0 0x7ff20c0b2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:13.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.570+0000 7ff2113c3700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff20c0cc4b0 0x7ff20c0b2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39172/0 (socket says 172.21.15.149:39172) 2023-11-08T19:24:13.580 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.570+0000 7ff2113c3700 1 -- 172.21.15.149:0/997892529 learned_addr learned my addr 172.21.15.149:0/997892529 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:13.580 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.571+0000 7ff211bc4700 1 --2- 172.21.15.149:0/997892529 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff20c0cc0d0 0x7ff20c14ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:13.580 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.571+0000 7ff2123c5700 1 --2- 172.21.15.149:0/997892529 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff20c15cb60 0x7ff20c0b2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:13.580 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.571+0000 7ff2113c3700 1 -- 172.21.15.149:0/997892529 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff20c15cb60 msgr2=0x7ff20c0b2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:13.580 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.571+0000 7ff2113c3700 1 --2- 172.21.15.149:0/997892529 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff20c15cb60 0x7ff20c0b2db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:13.581 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.571+0000 7ff2113c3700 1 -- 172.21.15.149:0/997892529 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff20c0cc0d0 msgr2=0x7ff20c14ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:13.581 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.571+0000 7ff2113c3700 1 --2- 172.21.15.149:0/997892529 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff20c0cc0d0 0x7ff20c14ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:13.581 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.571+0000 7ff2113c3700 1 -- 172.21.15.149:0/997892529 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1fc0094a0 con 0x7ff20c0cc4b0 2023-11-08T19:24:13.581 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.571+0000 7ff211bc4700 1 --2- 172.21.15.149:0/997892529 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff20c0cc0d0 0x7ff20c14ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:24:13.581 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.571+0000 7ff2113c3700 1 --2- 172.21.15.149:0/997892529 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff20c0cc4b0 0x7ff20c0b2870 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc009b90 tx=0x7ff1fc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:13.582 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.571+0000 7ff2027fc700 1 -- 172.21.15.149:0/997892529 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc0036a0 con 0x7ff20c0cc4b0 2023-11-08T19:24:13.582 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.571+0000 7ff2027fc700 1 -- 172.21.15.149:0/997892529 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1fc01f070 con 0x7ff20c0cc4b0 2023-11-08T19:24:13.582 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.571+0000 7ff213e28700 1 -- 172.21.15.149:0/997892529 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff20c0c7080 con 0x7ff20c0cc4b0 2023-11-08T19:24:13.582 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.571+0000 7ff2027fc700 1 -- 172.21.15.149:0/997892529 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc003a00 con 0x7ff20c0cc4b0 2023-11-08T19:24:13.582 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.571+0000 7ff213e28700 1 -- 172.21.15.149:0/997892529 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff20c157510 con 0x7ff20c0cc4b0 2023-11-08T19:24:13.583 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.572+0000 7ff213e28700 1 -- 172.21.15.149:0/997892529 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff20c04f730 con 0x7ff20c0cc4b0 2023-11-08T19:24:13.583 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.573+0000 7ff2027fc700 1 -- 172.21.15.149:0/997892529 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff1fc003b60 con 0x7ff20c0cc4b0 2023-11-08T19:24:13.583 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.573+0000 7ff2027fc700 1 --2- 172.21.15.149:0/997892529 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff1f006af00 0x7ff1f006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:13.583 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.573+0000 7ff211bc4700 1 --2- 172.21.15.149:0/997892529 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff1f006af00 0x7ff1f006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:13.583 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.573+0000 7ff2027fc700 1 -- 172.21.15.149:0/997892529 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7ff1fc021070 con 0x7ff20c0cc4b0 2023-11-08T19:24:13.584 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.574+0000 7ff211bc4700 1 --2- 172.21.15.149:0/997892529 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff1f006af00 0x7ff1f006d3c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff20c15ba40 tx=0x7ff208008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:13.584 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.578+0000 7ff2027fc700 1 -- 172.21.15.149:0/997892529 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff1fc0562c0 con 0x7ff20c0cc4b0 2023-11-08T19:24:13.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.767+0000 7ff213e28700 1 -- 172.21.15.149:0/997892529 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff20c06ff20 con 0x7ff20c0cc4b0 2023-11-08T19:24:13.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.767+0000 7ff2027fc700 1 -- 172.21.15.149:0/997892529 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff1fc0598e0 con 0x7ff20c0cc4b0 2023-11-08T19:24:13.769 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 1 2023-11-08T19:24:13.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.769+0000 7ff213e28700 1 -- 172.21.15.149:0/997892529 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff1f006af00 msgr2=0x7ff1f006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:13.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.769+0000 7ff213e28700 1 --2- 172.21.15.149:0/997892529 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff1f006af00 0x7ff1f006d3c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff20c15ba40 tx=0x7ff208008040 comp rx=0 tx=0).stop 2023-11-08T19:24:13.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.769+0000 7ff213e28700 1 -- 172.21.15.149:0/997892529 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff20c0cc4b0 msgr2=0x7ff20c0b2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:13.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.769+0000 7ff213e28700 1 --2- 172.21.15.149:0/997892529 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff20c0cc4b0 0x7ff20c0b2870 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc009b90 tx=0x7ff1fc004750 comp rx=0 tx=0).stop 2023-11-08T19:24:13.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.769+0000 7ff213e28700 1 -- 172.21.15.149:0/997892529 shutdown_connections 2023-11-08T19:24:13.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.769+0000 7ff213e28700 1 --2- 172.21.15.149:0/997892529 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff1f006af00 0x7ff1f006d3c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:13.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.769+0000 7ff213e28700 1 --2- 172.21.15.149:0/997892529 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff20c0cc0d0 0x7ff20c14ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:13.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.769+0000 7ff213e28700 1 --2- 172.21.15.149:0/997892529 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff20c15cb60 0x7ff20c0b2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:13.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.769+0000 7ff213e28700 1 --2- 172.21.15.149:0/997892529 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff20c0cc4b0 0x7ff20c0b2870 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:13.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.769+0000 7ff213e28700 1 -- 172.21.15.149:0/997892529 >> 172.21.15.149:0/997892529 conn(0x7ff20c06f120 msgr2=0x7ff20c158950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:13.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.769+0000 7ff213e28700 1 -- 172.21.15.149:0/997892529 shutdown_connections 2023-11-08T19:24:13.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.769+0000 7ff213e28700 1 -- 172.21.15.149:0/997892529 wait complete. 2023-11-08T19:24:13.783 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-08T19:24:13.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.902+0000 7fb40c0e3700 1 Processor -- start 2023-11-08T19:24:13.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.902+0000 7fb40c0e3700 1 -- start start 2023-11-08T19:24:13.905 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.903+0000 7fb40c0e3700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb40415b950 0x7fb4040ce130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:13.905 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.903+0000 7fb40c0e3700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fb4040cd5e0 0x7fb4040ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:13.906 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.903+0000 7fb40c0e3700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4040cc2e0 con 0x7fb4040cfd20 2023-11-08T19:24:13.906 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.903+0000 7fb40c0e3700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4040cc580 con 0x7fb40415b950 2023-11-08T19:24:13.906 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.903+0000 7fb40c0e3700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4040cc820 con 0x7fb4040cd5e0 2023-11-08T19:24:13.906 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.903+0000 7fb409e7f700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb40415b950 0x7fb4040ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:13.907 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.903+0000 7fb409e7f700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb40415b950 0x7fb4040ce130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39178/0 (socket says 172.21.15.149:39178) 2023-11-08T19:24:13.907 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.903+0000 7fb409e7f700 1 -- 172.21.15.149:0/1405952891 learned_addr learned my addr 172.21.15.149:0/1405952891 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:13.907 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.903+0000 7fb40967e700 1 --2- 172.21.15.149:0/1405952891 >> v2:172.21.15.160:3300/0 conn(0x7fb4040cd5e0 0x7fb4040ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:13.907 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.903+0000 7fb409e7f700 1 -- 172.21.15.149:0/1405952891 >> v2:172.21.15.160:3300/0 conn(0x7fb4040cd5e0 msgr2=0x7fb4040ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:13.907 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.903+0000 7fb409e7f700 1 --2- 172.21.15.149:0/1405952891 >> v2:172.21.15.160:3300/0 conn(0x7fb4040cd5e0 0x7fb4040ce670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:13.908 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.903+0000 7fb409e7f700 1 -- 172.21.15.149:0/1405952891 >> v1:172.21.15.160:6789/0 conn(0x7fb4040cfd20 legacy=0x7fb4040d0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:13.908 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.903+0000 7fb409e7f700 1 -- 172.21.15.149:0/1405952891 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4040ccb00 con 0x7fb40415b950 2023-11-08T19:24:13.908 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.903+0000 7fb409e7f700 1 --2- 172.21.15.149:0/1405952891 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb40415b950 0x7fb4040ce130 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb40408bca0 tx=0x7fb3f8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a935104b90b01314 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:13.908 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.903+0000 7fb408e7d700 1 -- 172.21.15.149:0/1405952891 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f8005e30 con 0x7fb40415b950 2023-11-08T19:24:13.908 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.903+0000 7fb408e7d700 1 -- 172.21.15.149:0/1405952891 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3f8006030 con 0x7fb40415b950 2023-11-08T19:24:13.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.903+0000 7fb408e7d700 1 -- 172.21.15.149:0/1405952891 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f80063e0 con 0x7fb40415b950 2023-11-08T19:24:13.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.904+0000 7fb40c0e3700 1 -- 172.21.15.149:0/1405952891 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb40415b950 msgr2=0x7fb4040ce130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:13.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.904+0000 7fb40c0e3700 1 --2- 172.21.15.149:0/1405952891 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb40415b950 0x7fb4040ce130 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb40408bca0 tx=0x7fb3f8009bd0 comp rx=0 tx=0).stop 2023-11-08T19:24:13.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.904+0000 7fb40c0e3700 1 -- 172.21.15.149:0/1405952891 shutdown_connections 2023-11-08T19:24:13.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.904+0000 7fb40c0e3700 1 --2- 172.21.15.149:0/1405952891 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb40415b950 0x7fb4040ce130 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:13.910 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.904+0000 7fb40c0e3700 1 --2- 172.21.15.149:0/1405952891 >> v2:172.21.15.160:3300/0 conn(0x7fb4040cd5e0 0x7fb4040ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:13.910 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.904+0000 7fb40c0e3700 1 -- 172.21.15.149:0/1405952891 >> 172.21.15.149:0/1405952891 conn(0x7fb40408afd0 msgr2=0x7fb4040d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:13.910 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.904+0000 7fb40c0e3700 1 -- 172.21.15.149:0/1405952891 shutdown_connections 2023-11-08T19:24:13.910 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.904+0000 7fb40c0e3700 1 -- 172.21.15.149:0/1405952891 wait complete. 2023-11-08T19:24:13.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.905+0000 7fb40c0e3700 1 Processor -- start 2023-11-08T19:24:13.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.905+0000 7fb40c0e3700 1 -- start start 2023-11-08T19:24:13.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.906+0000 7fb40c0e3700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb4040cfd20 0x7fb404150ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:13.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.906+0000 7fb40c0e3700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb40415b950 0x7fb4041f6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:13.914 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.906+0000 7fb40c0e3700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4040b5c20 0x7fb4041f7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:13.914 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.906+0000 7fb40c0e3700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb40406bec0 con 0x7fb4040b5c20 2023-11-08T19:24:13.914 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.906+0000 7fb40c0e3700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4040b69a0 con 0x7fb40415b950 2023-11-08T19:24:13.914 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.906+0000 7fb40c0e3700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4040b6100 con 0x7fb4040cfd20 2023-11-08T19:24:13.914 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.906+0000 7fb40a680700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4040b5c20 0x7fb4041f7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:13.915 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.906+0000 7fb40a680700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4040b5c20 0x7fb4041f7150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39188/0 (socket says 172.21.15.149:39188) 2023-11-08T19:24:13.915 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.906+0000 7fb40a680700 1 -- 172.21.15.149:0/4044645636 learned_addr learned my addr 172.21.15.149:0/4044645636 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:13.915 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.906+0000 7fb409e7f700 1 --2- 172.21.15.149:0/4044645636 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb4040cfd20 0x7fb404150ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:13.915 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.906+0000 7fb40967e700 1 --2- 172.21.15.149:0/4044645636 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb40415b950 0x7fb4041f6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:13.915 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.906+0000 7fb40a680700 1 -- 172.21.15.149:0/4044645636 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb4040cfd20 msgr2=0x7fb404150ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:13.916 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.906+0000 7fb40a680700 1 --2- 172.21.15.149:0/4044645636 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb4040cfd20 0x7fb404150ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:13.916 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.906+0000 7fb40a680700 1 -- 172.21.15.149:0/4044645636 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb40415b950 msgr2=0x7fb4041f6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:13.916 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.906+0000 7fb40a680700 1 --2- 172.21.15.149:0/4044645636 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb40415b950 0x7fb4041f6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:13.916 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.906+0000 7fb40a680700 1 -- 172.21.15.149:0/4044645636 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3f8009500 con 0x7fb4040b5c20 2023-11-08T19:24:13.916 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.907+0000 7fb40a680700 1 --2- 172.21.15.149:0/4044645636 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4040b5c20 0x7fb4041f7150 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc00cc10 tx=0x7fb3fc00cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:13.917 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.907+0000 7fb3f67fc700 1 -- 172.21.15.149:0/4044645636 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc00aa60 con 0x7fb4040b5c20 2023-11-08T19:24:13.917 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.907+0000 7fb3f67fc700 1 -- 172.21.15.149:0/4044645636 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3fc00abc0 con 0x7fb4040b5c20 2023-11-08T19:24:13.917 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.907+0000 7fb40c0e3700 1 -- 172.21.15.149:0/4044645636 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4040b63e0 con 0x7fb4040b5c20 2023-11-08T19:24:13.917 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.907+0000 7fb3f67fc700 1 -- 172.21.15.149:0/4044645636 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc012420 con 0x7fb4040b5c20 2023-11-08T19:24:13.917 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.907+0000 7fb40c0e3700 1 -- 172.21.15.149:0/4044645636 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb404151430 con 0x7fb4040b5c20 2023-11-08T19:24:13.918 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.908+0000 7fb40c0e3700 1 -- 172.21.15.149:0/4044645636 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb40406c000 con 0x7fb4040b5c20 2023-11-08T19:24:13.918 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.908+0000 7fb3f67fc700 1 -- 172.21.15.149:0/4044645636 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb3fc012580 con 0x7fb4040b5c20 2023-11-08T19:24:13.918 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.908+0000 7fb3f67fc700 1 --2- 172.21.15.149:0/4044645636 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb3e806af00 0x7fb3e806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:13.918 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.909+0000 7fb3f67fc700 1 -- 172.21.15.149:0/4044645636 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fb3fc089640 con 0x7fb4040b5c20 2023-11-08T19:24:13.918 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.909+0000 7fb409e7f700 1 --2- 172.21.15.149:0/4044645636 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb3e806af00 0x7fb3e806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:13.919 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.909+0000 7fb409e7f700 1 --2- 172.21.15.149:0/4044645636 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb3e806af00 0x7fb3e806d3c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb40408bca0 tx=0x7fb3f8008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:13.919 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:13.913+0000 7fb3f67fc700 1 -- 172.21.15.149:0/4044645636 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb40406c000 con 0x7fb4040b5c20 2023-11-08T19:24:14.108 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.106+0000 7fb40c0e3700 1 -- 172.21.15.149:0/4044645636 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb40406c000 con 0x7fb4040b5c20 2023-11-08T19:24:14.108 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.107+0000 7fb3f67fc700 1 -- 172.21.15.149:0/4044645636 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v35) v1 ==== 84+0+65 (secure 0 0 0) 0x7fb40406c000 con 0x7fb4040b5c20 2023-11-08T19:24:14.109 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:24:14.109 INFO:teuthology.orchestra.run.smithi149.stdout:[ 2023-11-08T19:24:14.109 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:24:14.109 INFO:teuthology.orchestra.run.smithi149.stdout: "poolnum": 1, 2023-11-08T19:24:14.110 INFO:teuthology.orchestra.run.smithi149.stdout: "poolname": ".mgr" 2023-11-08T19:24:14.110 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:24:14.110 INFO:teuthology.orchestra.run.smithi149.stdout:] 2023-11-08T19:24:14.111 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.109+0000 7fb40c0e3700 1 -- 172.21.15.149:0/4044645636 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb3e806af00 msgr2=0x7fb3e806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:14.111 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.109+0000 7fb40c0e3700 1 --2- 172.21.15.149:0/4044645636 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb3e806af00 0x7fb3e806d3c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb40408bca0 tx=0x7fb3f8008070 comp rx=0 tx=0).stop 2023-11-08T19:24:14.111 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.109+0000 7fb40c0e3700 1 -- 172.21.15.149:0/4044645636 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4040b5c20 msgr2=0x7fb4041f7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:14.112 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.109+0000 7fb40c0e3700 1 --2- 172.21.15.149:0/4044645636 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4040b5c20 0x7fb4041f7150 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc00cc10 tx=0x7fb3fc00cf20 comp rx=0 tx=0).stop 2023-11-08T19:24:14.112 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.109+0000 7fb40c0e3700 1 -- 172.21.15.149:0/4044645636 shutdown_connections 2023-11-08T19:24:14.112 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.109+0000 7fb40c0e3700 1 --2- 172.21.15.149:0/4044645636 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb3e806af00 0x7fb3e806d3c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:14.112 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.109+0000 7fb40c0e3700 1 --2- 172.21.15.149:0/4044645636 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4040b5c20 0x7fb4041f7150 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:14.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.109+0000 7fb40c0e3700 1 --2- 172.21.15.149:0/4044645636 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb4040cfd20 0x7fb404150ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:14.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.109+0000 7fb40c0e3700 1 --2- 172.21.15.149:0/4044645636 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb40415b950 0x7fb4041f6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:14.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.109+0000 7fb40c0e3700 1 -- 172.21.15.149:0/4044645636 >> 172.21.15.149:0/4044645636 conn(0x7fb40408afd0 msgr2=0x7fb40406ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:14.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.109+0000 7fb40c0e3700 1 -- 172.21.15.149:0/4044645636 shutdown_connections 2023-11-08T19:24:14.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.109+0000 7fb40c0e3700 1 -- 172.21.15.149:0/4044645636 wait complete. 2023-11-08T19:24:14.123 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-08T19:24:14.123 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-08T19:24:14.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.247+0000 7f2f3d725700 1 Processor -- start 2023-11-08T19:24:14.249 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.247+0000 7f2f3d725700 1 -- start start 2023-11-08T19:24:14.252 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.248+0000 7f2f3d725700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2f380d0360 0x7f2f380d07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:14.253 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.248+0000 7f2f3d725700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f380d0cf0 con 0x7f2f3815da40 2023-11-08T19:24:14.253 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.248+0000 7f2f3d725700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f380d1520 con 0x7f2f380ceb40 2023-11-08T19:24:14.253 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.248+0000 7f2f3d725700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f380cefa0 con 0x7f2f380d0360 2023-11-08T19:24:14.253 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.248+0000 7f2f36ffd700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f2f3815da40 0x7f2f380d2e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:41196/0 (socket says 172.21.15.149:41196) 2023-11-08T19:24:14.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.248+0000 7f2f36ffd700 1 -- 172.21.15.149:0/281269266 learned_addr learned my addr 172.21.15.149:0/281269266 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:24:14.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.248+0000 7f2f35ffb700 1 -- 172.21.15.149:0/281269266 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3866166660 0 0) 0x7f2f2c001110 con 0x7f2f3815da40 2023-11-08T19:24:14.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.248+0000 7f2f377fe700 1 --2- 172.21.15.149:0/281269266 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2f380d0360 0x7f2f380d07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:14.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.248+0000 7f2f35ffb700 1 -- 172.21.15.149:0/281269266 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f200035b0 con 0x7f2f3815da40 2023-11-08T19:24:14.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.248+0000 7f2f35ffb700 1 -- 172.21.15.149:0/281269266 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3316441095 0 0) 0x7f2f200035b0 con 0x7f2f3815da40 2023-11-08T19:24:14.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.248+0000 7f2f35ffb700 1 -- 172.21.15.149:0/281269266 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2f380d0360 msgr2=0x7f2f380d07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:14.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.248+0000 7f2f35ffb700 1 --2- 172.21.15.149:0/281269266 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2f380d0360 0x7f2f380d07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:14.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.248+0000 7f2f35ffb700 1 -- 172.21.15.149:0/281269266 >> v1:172.21.15.160:6789/0 conn(0x7f2f380ceb40 legacy=0x7f2f380d22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:14.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.248+0000 7f2f35ffb700 1 -- 172.21.15.149:0/281269266 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f380d3650 con 0x7f2f3815da40 2023-11-08T19:24:14.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.248+0000 7f2f35ffb700 1 -- 172.21.15.149:0/281269266 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f2f2c001800 con 0x7f2f3815da40 2023-11-08T19:24:14.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.249+0000 7f2f35ffb700 1 -- 172.21.15.149:0/281269266 >> v1:172.21.15.149:6789/0 conn(0x7f2f3815da40 legacy=0x7f2f380d2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:14.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.249+0000 7f2f35ffb700 1 --2- 172.21.15.149:0/281269266 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f20003a30 0x7f2f20003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:14.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.249+0000 7f2f35ffb700 1 --2- 172.21.15.149:0/281269266 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2f20004850 0x7f2f20004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:14.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.249+0000 7f2f35ffb700 1 --2- 172.21.15.149:0/281269266 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2f380d0360 0x7f2f20005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:14.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.249+0000 7f2f35ffb700 1 -- 172.21.15.149:0/281269266 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f380cefa0 con 0x7f2f20003a30 2023-11-08T19:24:14.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.249+0000 7f2f35ffb700 1 -- 172.21.15.149:0/281269266 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2000bac0 con 0x7f2f20004850 2023-11-08T19:24:14.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.249+0000 7f2f35ffb700 1 -- 172.21.15.149:0/281269266 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2000bc80 con 0x7f2f380d0360 2023-11-08T19:24:14.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.249+0000 7f2f36ffd700 1 --2- 172.21.15.149:0/281269266 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f20003a30 0x7f2f20003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:14.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.249+0000 7f2f377fe700 1 --2- 172.21.15.149:0/281269266 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2f380d0360 0x7f2f20005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:14.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.249+0000 7f2f367fc700 1 --2- 172.21.15.149:0/281269266 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2f20004850 0x7f2f20004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:14.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.249+0000 7f2f36ffd700 1 -- 172.21.15.149:0/281269266 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2f380d0360 msgr2=0x7f2f20005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:14.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.249+0000 7f2f36ffd700 1 --2- 172.21.15.149:0/281269266 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2f380d0360 0x7f2f20005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:14.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.249+0000 7f2f36ffd700 1 -- 172.21.15.149:0/281269266 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2f20004850 msgr2=0x7f2f20004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:14.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.249+0000 7f2f36ffd700 1 --2- 172.21.15.149:0/281269266 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2f20004850 0x7f2f20004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:14.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.249+0000 7f2f36ffd700 1 -- 172.21.15.149:0/281269266 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f200035b0 con 0x7f2f20003a30 2023-11-08T19:24:14.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.249+0000 7f2f36ffd700 1 --2- 172.21.15.149:0/281269266 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f20003a30 0x7f2f20003e50 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c00c210 tx=0x7f2f20005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=166125ba2e63b005 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:14.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.249+0000 7f2f35ffb700 1 -- 172.21.15.149:0/281269266 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f2c007db0 con 0x7f2f20003a30 2023-11-08T19:24:14.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.249+0000 7f2f35ffb700 1 -- 172.21.15.149:0/281269266 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f2c00cdb0 con 0x7f2f20003a30 2023-11-08T19:24:14.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.249+0000 7f2f35ffb700 1 -- 172.21.15.149:0/281269266 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f2c005b80 con 0x7f2f20003a30 2023-11-08T19:24:14.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.250+0000 7f2f3d725700 1 -- 172.21.15.149:0/281269266 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f20003a30 msgr2=0x7f2f20003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:14.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.250+0000 7f2f3d725700 1 --2- 172.21.15.149:0/281269266 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f20003a30 0x7f2f20003e50 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c00c210 tx=0x7f2f20005880 comp rx=0 tx=0).stop 2023-11-08T19:24:14.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.250+0000 7f2f377fe700 1 -- 172.21.15.149:0/281269266 reap_dead start 2023-11-08T19:24:14.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.250+0000 7f2f3d725700 1 -- 172.21.15.149:0/281269266 shutdown_connections 2023-11-08T19:24:14.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.250+0000 7f2f3d725700 1 -- 172.21.15.149:0/281269266 >> 172.21.15.149:0/281269266 conn(0x7f2f3806bd80 msgr2=0x7f2f3806c190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:14.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.250+0000 7f2f3d725700 1 -- 172.21.15.149:0/281269266 shutdown_connections 2023-11-08T19:24:14.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.250+0000 7f2f3d725700 1 -- 172.21.15.149:0/281269266 wait complete. 2023-11-08T19:24:14.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.251+0000 7f2f3d725700 1 Processor -- start 2023-11-08T19:24:14.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.251+0000 7f2f3d725700 1 -- start start 2023-11-08T19:24:14.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.252+0000 7f2f3d725700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f380c8b40 0x7f2f3815e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:14.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.252+0000 7f2f3d725700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2f3815f6a0 0x7f2f380b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:14.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.252+0000 7f2f3d725700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2f380b4ee0 0x7f2f381419c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:14.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.252+0000 7f2f3d725700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f380b5360 con 0x7f2f380c8b40 2023-11-08T19:24:14.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.252+0000 7f2f3d725700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f38160820 con 0x7f2f3815f6a0 2023-11-08T19:24:14.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.252+0000 7f2f3d725700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3815fc10 con 0x7f2f380b4ee0 2023-11-08T19:24:14.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.252+0000 7f2f36ffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f380c8b40 0x7f2f3815e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:14.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.252+0000 7f2f36ffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f380c8b40 0x7f2f3815e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39204/0 (socket says 172.21.15.149:39204) 2023-11-08T19:24:14.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.252+0000 7f2f36ffd700 1 -- 172.21.15.149:0/3477130688 learned_addr learned my addr 172.21.15.149:0/3477130688 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:14.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.252+0000 7f2f377fe700 1 --2- 172.21.15.149:0/3477130688 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2f380b4ee0 0x7f2f381419c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:14.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.252+0000 7f2f367fc700 1 --2- 172.21.15.149:0/3477130688 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2f3815f6a0 0x7f2f380b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:14.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.252+0000 7f2f36ffd700 1 -- 172.21.15.149:0/3477130688 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2f380b4ee0 msgr2=0x7f2f381419c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:14.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.252+0000 7f2f36ffd700 1 --2- 172.21.15.149:0/3477130688 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2f380b4ee0 0x7f2f381419c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:14.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.252+0000 7f2f36ffd700 1 -- 172.21.15.149:0/3477130688 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2f3815f6a0 msgr2=0x7f2f380b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:14.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.252+0000 7f2f36ffd700 1 --2- 172.21.15.149:0/3477130688 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2f3815f6a0 0x7f2f380b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:14.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.252+0000 7f2f36ffd700 1 -- 172.21.15.149:0/3477130688 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f3815fef0 con 0x7f2f380c8b40 2023-11-08T19:24:14.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.253+0000 7f2f36ffd700 1 --2- 172.21.15.149:0/3477130688 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f380c8b40 0x7f2f3815e930 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c015040 tx=0x7f2f2c001b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:14.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.253+0000 7f2f1f7fe700 1 -- 172.21.15.149:0/3477130688 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f2c001c00 con 0x7f2f380c8b40 2023-11-08T19:24:14.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.253+0000 7f2f1f7fe700 1 -- 172.21.15.149:0/3477130688 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f2c0015c0 con 0x7f2f380c8b40 2023-11-08T19:24:14.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.253+0000 7f2f3d725700 1 -- 172.21.15.149:0/3477130688 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f381601d0 con 0x7f2f380c8b40 2023-11-08T19:24:14.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.253+0000 7f2f1f7fe700 1 -- 172.21.15.149:0/3477130688 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f2c0070d0 con 0x7f2f380c8b40 2023-11-08T19:24:14.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.253+0000 7f2f3d725700 1 -- 172.21.15.149:0/3477130688 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f380c8f20 con 0x7f2f380c8b40 2023-11-08T19:24:14.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.254+0000 7f2f3d725700 1 -- 172.21.15.149:0/3477130688 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f38160b00 con 0x7f2f380c8b40 2023-11-08T19:24:14.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.254+0000 7f2f1f7fe700 1 -- 172.21.15.149:0/3477130688 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2f2c007250 con 0x7f2f380c8b40 2023-11-08T19:24:14.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.255+0000 7f2f1f7fe700 1 --2- 172.21.15.149:0/3477130688 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2f2406af00 0x7f2f2406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:14.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.255+0000 7f2f367fc700 1 --2- 172.21.15.149:0/3477130688 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2f2406af00 0x7f2f2406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:14.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.255+0000 7f2f1f7fe700 1 -- 172.21.15.149:0/3477130688 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f2f2c08a510 con 0x7f2f380c8b40 2023-11-08T19:24:14.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.255+0000 7f2f367fc700 1 --2- 172.21.15.149:0/3477130688 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2f2406af00 0x7f2f2406d3c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2f380b7200 tx=0x7f2f28009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:14.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.260+0000 7f2f1f7fe700 1 -- 172.21.15.149:0/3477130688 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2f2c055960 con 0x7f2f380c8b40 2023-11-08T19:24:14.450 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:14.449+0000 7f2f3d725700 1 -- 172.21.15.149:0/3477130688 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f2f380d0cf0 con 0x7f2f380c8b40 2023-11-08T19:24:15.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.097+0000 7f2f1f7fe700 1 -- 172.21.15.149:0/3477130688 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v36) v1 ==== 138+0+0 (secure 0 0 0) 0x7f2f380d0cf0 con 0x7f2f380c8b40 2023-11-08T19:24:15.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.100+0000 7f2f3d725700 1 -- 172.21.15.149:0/3477130688 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2f2406af00 msgr2=0x7f2f2406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:15.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.100+0000 7f2f3d725700 1 --2- 172.21.15.149:0/3477130688 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2f2406af00 0x7f2f2406d3c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2f380b7200 tx=0x7f2f28009040 comp rx=0 tx=0).stop 2023-11-08T19:24:15.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.100+0000 7f2f3d725700 1 -- 172.21.15.149:0/3477130688 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f380c8b40 msgr2=0x7f2f3815e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:15.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.100+0000 7f2f3d725700 1 --2- 172.21.15.149:0/3477130688 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f380c8b40 0x7f2f3815e930 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c015040 tx=0x7f2f2c001b90 comp rx=0 tx=0).stop 2023-11-08T19:24:15.103 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.100+0000 7f2f3d725700 1 -- 172.21.15.149:0/3477130688 shutdown_connections 2023-11-08T19:24:15.103 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.100+0000 7f2f3d725700 1 --2- 172.21.15.149:0/3477130688 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2f2406af00 0x7f2f2406d3c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:15.103 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.100+0000 7f2f3d725700 1 --2- 172.21.15.149:0/3477130688 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2f380b4ee0 0x7f2f381419c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:15.103 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.100+0000 7f2f3d725700 1 --2- 172.21.15.149:0/3477130688 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f380c8b40 0x7f2f3815e930 secure :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c015040 tx=0x7f2f2c001b90 comp rx=0 tx=0).stop 2023-11-08T19:24:15.103 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.100+0000 7f2f3d725700 1 --2- 172.21.15.149:0/3477130688 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2f3815f6a0 0x7f2f380b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:15.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.100+0000 7f2f3d725700 1 -- 172.21.15.149:0/3477130688 >> 172.21.15.149:0/3477130688 conn(0x7f2f3806bd80 msgr2=0x7f2f380caa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:15.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.101+0000 7f2f3d725700 1 -- 172.21.15.149:0/3477130688 shutdown_connections 2023-11-08T19:24:15.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.101+0000 7f2f3d725700 1 -- 172.21.15.149:0/3477130688 wait complete. 2023-11-08T19:24:15.104 INFO:teuthology.orchestra.run.smithi149.stderr:pool 'cephfs_metadata' created 2023-11-08T19:24:15.119 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-08T19:24:15.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.247+0000 7faf6a5af700 1 Processor -- start 2023-11-08T19:24:15.249 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.247+0000 7faf6a5af700 1 -- start start 2023-11-08T19:24:15.252 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.248+0000 7faf6a5af700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faf6415b8e0 0x7faf640c5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:15.252 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.248+0000 7faf6a5af700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7faf640b3150 0x7faf640b3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:15.252 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.248+0000 7faf6a5af700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf640b3ac0 con 0x7faf6415bcc0 2023-11-08T19:24:15.253 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.248+0000 7faf6a5af700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf640d14a0 con 0x7faf640b3150 2023-11-08T19:24:15.253 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.248+0000 7faf6a5af700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf64070cb0 con 0x7faf6415b8e0 2023-11-08T19:24:15.253 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.248+0000 7faf637fe700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7faf6415bcc0 0x7faf640d0d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:41214/0 (socket says 172.21.15.149:41214) 2023-11-08T19:24:15.253 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.248+0000 7faf637fe700 1 -- 172.21.15.149:0/2701370489 learned_addr learned my addr 172.21.15.149:0/2701370489 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:24:15.253 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.248+0000 7faf63fff700 1 --2- 172.21.15.149:0/2701370489 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faf6415b8e0 0x7faf640c5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:15.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.248+0000 7faf62ffd700 1 -- 172.21.15.149:0/2701370489 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2285632309 0 0) 0x7faf640b3ac0 con 0x7faf6415bcc0 2023-11-08T19:24:15.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.248+0000 7faf68b4c700 1 --2- 172.21.15.149:0/2701370489 >> v2:172.21.15.160:3300/0 conn(0x7faf640b3150 0x7faf640b3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:15.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.248+0000 7faf62ffd700 1 -- 172.21.15.149:0/2701370489 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf4c0035b0 con 0x7faf6415bcc0 2023-11-08T19:24:15.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.249+0000 7faf62ffd700 1 -- 172.21.15.149:0/2701370489 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2480944679 0 0) 0x7faf4c0035b0 con 0x7faf6415bcc0 2023-11-08T19:24:15.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.249+0000 7faf62ffd700 1 -- 172.21.15.149:0/2701370489 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faf6415b8e0 msgr2=0x7faf640c5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:15.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.249+0000 7faf62ffd700 1 --2- 172.21.15.149:0/2701370489 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faf6415b8e0 0x7faf640c5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:15.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.249+0000 7faf62ffd700 1 -- 172.21.15.149:0/2701370489 >> v2:172.21.15.160:3300/0 conn(0x7faf640b3150 msgr2=0x7faf640b3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:15.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.249+0000 7faf62ffd700 1 --2- 172.21.15.149:0/2701370489 >> v2:172.21.15.160:3300/0 conn(0x7faf640b3150 0x7faf640b3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:15.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.249+0000 7faf62ffd700 1 -- 172.21.15.149:0/2701370489 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf64070f90 con 0x7faf6415bcc0 2023-11-08T19:24:15.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.249+0000 7faf62ffd700 1 -- 172.21.15.149:0/2701370489 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7faf54001670 con 0x7faf6415bcc0 2023-11-08T19:24:15.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.249+0000 7faf62ffd700 1 -- 172.21.15.149:0/2701370489 >> v1:172.21.15.149:6789/0 conn(0x7faf6415bcc0 legacy=0x7faf640d0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:15.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.249+0000 7faf62ffd700 1 --2- 172.21.15.149:0/2701370489 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf4c003a00 0x7faf4c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:15.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.249+0000 7faf62ffd700 1 --2- 172.21.15.149:0/2701370489 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faf6415b8e0 0x7faf4c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:15.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.249+0000 7faf62ffd700 1 --2- 172.21.15.149:0/2701370489 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faf4c004d90 0x7faf4c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:15.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.249+0000 7faf62ffd700 1 -- 172.21.15.149:0/2701370489 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf640d14a0 con 0x7faf4c003a00 2023-11-08T19:24:15.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.249+0000 7faf62ffd700 1 -- 172.21.15.149:0/2701370489 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf64070cb0 con 0x7faf4c004d90 2023-11-08T19:24:15.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.249+0000 7faf62ffd700 1 -- 172.21.15.149:0/2701370489 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf4c00ba10 con 0x7faf6415b8e0 2023-11-08T19:24:15.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.249+0000 7faf63fff700 1 --2- 172.21.15.149:0/2701370489 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf4c003a00 0x7faf4c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:15.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.249+0000 7faf637fe700 1 --2- 172.21.15.149:0/2701370489 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faf6415b8e0 0x7faf4c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:15.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.249+0000 7faf68b4c700 1 --2- 172.21.15.149:0/2701370489 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faf4c004d90 0x7faf4c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:15.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.249+0000 7faf63fff700 1 -- 172.21.15.149:0/2701370489 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faf6415b8e0 msgr2=0x7faf4c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:15.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.249+0000 7faf63fff700 1 --2- 172.21.15.149:0/2701370489 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faf6415b8e0 0x7faf4c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:15.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.249+0000 7faf63fff700 1 -- 172.21.15.149:0/2701370489 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faf4c004d90 msgr2=0x7faf4c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:15.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.249+0000 7faf63fff700 1 --2- 172.21.15.149:0/2701370489 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faf4c004d90 0x7faf4c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:15.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.249+0000 7faf63fff700 1 -- 172.21.15.149:0/2701370489 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf4c0035b0 con 0x7faf4c003a00 2023-11-08T19:24:15.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.249+0000 7faf63fff700 1 --2- 172.21.15.149:0/2701370489 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf4c003a00 0x7faf4c003e20 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7faf58009b40 tx=0x7faf4c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bc43ba0f13e0444 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:15.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.249+0000 7faf62ffd700 1 -- 172.21.15.149:0/2701370489 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf58005a20 con 0x7faf4c003a00 2023-11-08T19:24:15.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.250+0000 7faf62ffd700 1 -- 172.21.15.149:0/2701370489 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf58005b80 con 0x7faf4c003a00 2023-11-08T19:24:15.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.250+0000 7faf62ffd700 1 -- 172.21.15.149:0/2701370489 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5800e6c0 con 0x7faf4c003a00 2023-11-08T19:24:15.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.250+0000 7faf6a5af700 1 -- 172.21.15.149:0/2701370489 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf4c003a00 msgr2=0x7faf4c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:15.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.250+0000 7faf6a5af700 1 --2- 172.21.15.149:0/2701370489 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf4c003a00 0x7faf4c003e20 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7faf58009b40 tx=0x7faf4c005880 comp rx=0 tx=0).stop 2023-11-08T19:24:15.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.250+0000 7faf68b4c700 1 -- 172.21.15.149:0/2701370489 reap_dead start 2023-11-08T19:24:15.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.250+0000 7faf6a5af700 1 -- 172.21.15.149:0/2701370489 shutdown_connections 2023-11-08T19:24:15.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.250+0000 7faf6a5af700 1 -- 172.21.15.149:0/2701370489 >> 172.21.15.149:0/2701370489 conn(0x7faf640ce150 msgr2=0x7faf640ce560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:15.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.250+0000 7faf6a5af700 1 -- 172.21.15.149:0/2701370489 shutdown_connections 2023-11-08T19:24:15.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.250+0000 7faf6a5af700 1 -- 172.21.15.149:0/2701370489 wait complete. 2023-11-08T19:24:15.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.251+0000 7faf6a5af700 1 Processor -- start 2023-11-08T19:24:15.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.252+0000 7faf6a5af700 1 -- start start 2023-11-08T19:24:15.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.252+0000 7faf6a5af700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faf4c003a00 0x7faf641f2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:15.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.252+0000 7faf6a5af700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faf641f43c0 0x7faf640b1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:15.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.252+0000 7faf6a5af700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf640b1c60 0x7faf6406bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:15.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.252+0000 7faf6a5af700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf6406cbf0 con 0x7faf640b1c60 2023-11-08T19:24:15.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.252+0000 7faf6a5af700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf640c7cf0 con 0x7faf4c003a00 2023-11-08T19:24:15.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.252+0000 7faf6a5af700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf640b2110 con 0x7faf641f43c0 2023-11-08T19:24:15.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.252+0000 7faf68b4c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf640b1c60 0x7faf6406bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:15.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.252+0000 7faf68b4c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf640b1c60 0x7faf6406bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39228/0 (socket says 172.21.15.149:39228) 2023-11-08T19:24:15.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.252+0000 7faf68b4c700 1 -- 172.21.15.149:0/1698339700 learned_addr learned my addr 172.21.15.149:0/1698339700 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:15.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.252+0000 7faf63fff700 1 --2- 172.21.15.149:0/1698339700 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faf4c003a00 0x7faf641f2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:15.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.252+0000 7faf637fe700 1 --2- 172.21.15.149:0/1698339700 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faf641f43c0 0x7faf640b1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:15.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.253+0000 7faf68b4c700 1 -- 172.21.15.149:0/1698339700 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faf641f43c0 msgr2=0x7faf640b1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:15.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.253+0000 7faf68b4c700 1 --2- 172.21.15.149:0/1698339700 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faf641f43c0 0x7faf640b1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:15.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.253+0000 7faf68b4c700 1 -- 172.21.15.149:0/1698339700 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faf4c003a00 msgr2=0x7faf641f2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:15.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.253+0000 7faf68b4c700 1 --2- 172.21.15.149:0/1698339700 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faf4c003a00 0x7faf641f2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:15.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.253+0000 7faf68b4c700 1 -- 172.21.15.149:0/1698339700 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf6406c910 con 0x7faf640b1c60 2023-11-08T19:24:15.270 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.253+0000 7faf637fe700 1 --2- 172.21.15.149:0/1698339700 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faf641f43c0 0x7faf640b1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:24:15.270 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.253+0000 7faf68b4c700 1 --2- 172.21.15.149:0/1698339700 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf640b1c60 0x7faf6406bc90 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7faf640cd130 tx=0x7faf5c011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:15.270 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.253+0000 7faf60ff9700 1 -- 172.21.15.149:0/1698339700 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c00e040 con 0x7faf640b1c60 2023-11-08T19:24:15.270 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.253+0000 7faf60ff9700 1 -- 172.21.15.149:0/1698339700 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf5c00f040 con 0x7faf640b1c60 2023-11-08T19:24:15.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.253+0000 7faf6a5af700 1 -- 172.21.15.149:0/1698339700 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf641f38e0 con 0x7faf640b1c60 2023-11-08T19:24:15.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.253+0000 7faf60ff9700 1 -- 172.21.15.149:0/1698339700 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c00fd30 con 0x7faf640b1c60 2023-11-08T19:24:15.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.253+0000 7faf6a5af700 1 -- 172.21.15.149:0/1698339700 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf641f3ea0 con 0x7faf640b1c60 2023-11-08T19:24:15.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.254+0000 7faf6a5af700 1 -- 172.21.15.149:0/1698339700 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf6404f730 con 0x7faf640b1c60 2023-11-08T19:24:15.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.254+0000 7faf60ff9700 1 -- 172.21.15.149:0/1698339700 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faf5c022460 con 0x7faf640b1c60 2023-11-08T19:24:15.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.255+0000 7faf60ff9700 1 --2- 172.21.15.149:0/1698339700 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7faf5006af00 0x7faf5006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:15.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.255+0000 7faf60ff9700 1 -- 172.21.15.149:0/1698339700 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5547+0+0 (secure 0 0 0) 0x7faf5c089970 con 0x7faf640b1c60 2023-11-08T19:24:15.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.255+0000 7faf63fff700 1 --2- 172.21.15.149:0/1698339700 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7faf5006af00 0x7faf5006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:15.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.255+0000 7faf63fff700 1 --2- 172.21.15.149:0/1698339700 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7faf5006af00 0x7faf5006d3c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7faf58000c00 tx=0x7faf58008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:15.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.260+0000 7faf60ff9700 1 -- 172.21.15.149:0/1698339700 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7faf5c054ac0 con 0x7faf640b1c60 2023-11-08T19:24:15.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:15.451+0000 7faf6a5af700 1 -- 172.21.15.149:0/1698339700 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7faf640ceeb0 con 0x7faf640b1c60 2023-11-08T19:24:16.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.100+0000 7faf60ff9700 1 -- 172.21.15.149:0/1698339700 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v37) v1 ==== 170+0+0 (secure 0 0 0) 0x7faf5c0580e0 con 0x7faf640b1c60 2023-11-08T19:24:16.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.103+0000 7faf6a5af700 1 -- 172.21.15.149:0/1698339700 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7faf5006af00 msgr2=0x7faf5006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:16.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.103+0000 7faf6a5af700 1 --2- 172.21.15.149:0/1698339700 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7faf5006af00 0x7faf5006d3c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7faf58000c00 tx=0x7faf58008030 comp rx=0 tx=0).stop 2023-11-08T19:24:16.105 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.103+0000 7faf6a5af700 1 -- 172.21.15.149:0/1698339700 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf640b1c60 msgr2=0x7faf6406bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:16.105 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.103+0000 7faf6a5af700 1 --2- 172.21.15.149:0/1698339700 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf640b1c60 0x7faf6406bc90 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7faf640cd130 tx=0x7faf5c011ed0 comp rx=0 tx=0).stop 2023-11-08T19:24:16.105 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.103+0000 7faf6a5af700 1 -- 172.21.15.149:0/1698339700 shutdown_connections 2023-11-08T19:24:16.105 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.103+0000 7faf6a5af700 1 --2- 172.21.15.149:0/1698339700 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7faf5006af00 0x7faf5006d3c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:16.105 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.103+0000 7faf6a5af700 1 --2- 172.21.15.149:0/1698339700 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faf4c003a00 0x7faf641f2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:16.106 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.103+0000 7faf6a5af700 1 --2- 172.21.15.149:0/1698339700 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf640b1c60 0x7faf6406bc90 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:16.106 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.103+0000 7faf6a5af700 1 --2- 172.21.15.149:0/1698339700 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faf641f43c0 0x7faf640b1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:16.106 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.103+0000 7faf6a5af700 1 -- 172.21.15.149:0/1698339700 >> 172.21.15.149:0/1698339700 conn(0x7faf640ce150 msgr2=0x7faf64159b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:16.106 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.103+0000 7faf6a5af700 1 -- 172.21.15.149:0/1698339700 shutdown_connections 2023-11-08T19:24:16.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.103+0000 7faf6a5af700 1 -- 172.21.15.149:0/1698339700 wait complete. 2023-11-08T19:24:16.107 INFO:teuthology.orchestra.run.smithi149.stderr:pool 'cephfs_data' created 2023-11-08T19:24:16.129 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-08T19:24:16.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.254+0000 7f1f8a95f700 1 Processor -- start 2023-11-08T19:24:16.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.254+0000 7f1f8a95f700 1 -- start start 2023-11-08T19:24:16.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.255+0000 7f1f8a95f700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f1f8406ab80 0x7f1f840caf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:16.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.255+0000 7f1f8a95f700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f1f840cf1c0 0x7f1f840cb490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:16.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.255+0000 7f1f8a95f700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f8415e320 con 0x7f1f8415df40 2023-11-08T19:24:16.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.255+0000 7f1f8a95f700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f8406b020 con 0x7f1f8406ab80 2023-11-08T19:24:16.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.255+0000 7f1f8a95f700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f8406b2e0 con 0x7f1f840cf1c0 2023-11-08T19:24:16.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.255+0000 7f1f837fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f1f8406ab80 0x7f1f840caf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:16.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.255+0000 7f1f83fff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f1f8415df40 0x7f1f8406c0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:41234/0 (socket says 172.21.15.149:41234) 2023-11-08T19:24:16.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.255+0000 7f1f83fff700 1 -- 172.21.15.149:0/672355093 learned_addr learned my addr 172.21.15.149:0/672355093 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:24:16.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.255+0000 7f1f88efc700 1 --2- 172.21.15.149:0/672355093 >> v2:172.21.15.160:3300/0 conn(0x7f1f840cf1c0 0x7f1f840cb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:16.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.256+0000 7f1f837fe700 1 -- 172.21.15.149:0/672355093 >> v2:172.21.15.160:3300/0 conn(0x7f1f840cf1c0 msgr2=0x7f1f840cb490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:16.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.256+0000 7f1f837fe700 1 --2- 172.21.15.149:0/672355093 >> v2:172.21.15.160:3300/0 conn(0x7f1f840cf1c0 0x7f1f840cb490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:16.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.256+0000 7f1f837fe700 1 -- 172.21.15.149:0/672355093 >> v1:172.21.15.149:6789/0 conn(0x7f1f8415df40 legacy=0x7f1f8406c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:16.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.256+0000 7f1f82ffd700 1 -- 172.21.15.149:0/672355093 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3878747666 0 0) 0x7f1f8415e320 con 0x7f1f8415df40 2023-11-08T19:24:16.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.256+0000 7f1f837fe700 1 -- 172.21.15.149:0/672355093 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f8406b5c0 con 0x7f1f8406ab80 2023-11-08T19:24:16.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.256+0000 7f1f837fe700 1 --2- 172.21.15.149:0/672355093 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f8406ab80 0x7f1f840caf50 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f1f840b2180 tx=0x7f1f74009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fcd54010358d846 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:16.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.256+0000 7f1f82ffd700 1 -- 172.21.15.149:0/672355093 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f74011830 con 0x7f1f8406ab80 2023-11-08T19:24:16.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.256+0000 7f1f82ffd700 1 -- 172.21.15.149:0/672355093 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f74011990 con 0x7f1f8406ab80 2023-11-08T19:24:16.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.256+0000 7f1f82ffd700 1 -- 172.21.15.149:0/672355093 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f74011d20 con 0x7f1f8406ab80 2023-11-08T19:24:16.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.256+0000 7f1f8a95f700 1 -- 172.21.15.149:0/672355093 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f8406ab80 msgr2=0x7f1f840caf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:16.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.256+0000 7f1f8a95f700 1 --2- 172.21.15.149:0/672355093 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f8406ab80 0x7f1f840caf50 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f1f840b2180 tx=0x7f1f74009b20 comp rx=0 tx=0).stop 2023-11-08T19:24:16.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.257+0000 7f1f8a95f700 1 -- 172.21.15.149:0/672355093 shutdown_connections 2023-11-08T19:24:16.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.257+0000 7f1f8a95f700 1 --2- 172.21.15.149:0/672355093 >> v2:172.21.15.160:3300/0 conn(0x7f1f840cf1c0 0x7f1f840cb490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:16.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.257+0000 7f1f8a95f700 1 --2- 172.21.15.149:0/672355093 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f8406ab80 0x7f1f840caf50 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:16.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.257+0000 7f1f8a95f700 1 -- 172.21.15.149:0/672355093 >> 172.21.15.149:0/672355093 conn(0x7f1f840d0640 msgr2=0x7f1f840d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:16.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.257+0000 7f1f8a95f700 1 -- 172.21.15.149:0/672355093 shutdown_connections 2023-11-08T19:24:16.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.257+0000 7f1f8a95f700 1 -- 172.21.15.149:0/672355093 wait complete. 2023-11-08T19:24:16.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.258+0000 7f1f8a95f700 1 Processor -- start 2023-11-08T19:24:16.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.258+0000 7f1f8a95f700 1 -- start start 2023-11-08T19:24:16.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.259+0000 7f1f8a95f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1f8406ab80 0x7f1f8414fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:16.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.259+0000 7f1f8a95f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1f840cf1c0 0x7f1f840adde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:16.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.259+0000 7f1f8a95f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f8415df40 0x7f1f84160330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:16.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.259+0000 7f1f8a95f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f84150080 con 0x7f1f8415df40 2023-11-08T19:24:16.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.259+0000 7f1f8a95f700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f840af360 con 0x7f1f840cf1c0 2023-11-08T19:24:16.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.259+0000 7f1f8a95f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f840ae750 con 0x7f1f8406ab80 2023-11-08T19:24:16.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.259+0000 7f1f88efc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f8415df40 0x7f1f84160330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:16.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.259+0000 7f1f88efc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f8415df40 0x7f1f84160330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39242/0 (socket says 172.21.15.149:39242) 2023-11-08T19:24:16.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.259+0000 7f1f88efc700 1 -- 172.21.15.149:0/4133572911 learned_addr learned my addr 172.21.15.149:0/4133572911 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:16.270 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.259+0000 7f1f83fff700 1 --2- 172.21.15.149:0/4133572911 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1f8406ab80 0x7f1f8414fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:16.270 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.259+0000 7f1f837fe700 1 --2- 172.21.15.149:0/4133572911 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1f840cf1c0 0x7f1f840adde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:16.270 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.259+0000 7f1f88efc700 1 -- 172.21.15.149:0/4133572911 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1f8406ab80 msgr2=0x7f1f8414fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:16.270 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.259+0000 7f1f88efc700 1 --2- 172.21.15.149:0/4133572911 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1f8406ab80 0x7f1f8414fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:16.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.259+0000 7f1f88efc700 1 -- 172.21.15.149:0/4133572911 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1f840cf1c0 msgr2=0x7f1f840adde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:16.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.259+0000 7f1f88efc700 1 --2- 172.21.15.149:0/4133572911 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1f840cf1c0 0x7f1f840adde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:16.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.259+0000 7f1f88efc700 1 -- 172.21.15.149:0/4133572911 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f740094a0 con 0x7f1f8415df40 2023-11-08T19:24:16.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.259+0000 7f1f837fe700 1 --2- 172.21.15.149:0/4133572911 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1f840cf1c0 0x7f1f840adde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:24:16.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.259+0000 7f1f88efc700 1 --2- 172.21.15.149:0/4133572911 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f8415df40 0x7f1f84160330 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c007e30 tx=0x7f1f7c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:16.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.259+0000 7f1f80ff9700 1 -- 172.21.15.149:0/4133572911 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f7c00eea0 con 0x7f1f8415df40 2023-11-08T19:24:16.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.259+0000 7f1f80ff9700 1 -- 172.21.15.149:0/4133572911 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f7c014420 con 0x7f1f8415df40 2023-11-08T19:24:16.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.259+0000 7f1f8a95f700 1 -- 172.21.15.149:0/4133572911 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f840aea30 con 0x7f1f8415df40 2023-11-08T19:24:16.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.259+0000 7f1f80ff9700 1 -- 172.21.15.149:0/4133572911 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f7c0147d0 con 0x7f1f8415df40 2023-11-08T19:24:16.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.259+0000 7f1f8a95f700 1 -- 172.21.15.149:0/4133572911 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f840aeff0 con 0x7f1f8415df40 2023-11-08T19:24:16.273 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.260+0000 7f1f8a95f700 1 -- 172.21.15.149:0/4133572911 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f8404f730 con 0x7f1f8415df40 2023-11-08T19:24:16.273 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.261+0000 7f1f80ff9700 1 -- 172.21.15.149:0/4133572911 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1f7c014930 con 0x7f1f8415df40 2023-11-08T19:24:16.273 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.261+0000 7f1f80ff9700 1 --2- 172.21.15.149:0/4133572911 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1f7006af30 0x7f1f7006d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:16.273 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.261+0000 7f1f80ff9700 1 -- 172.21.15.149:0/4133572911 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5929+0+0 (secure 0 0 0) 0x7f1f7c089e20 con 0x7f1f8415df40 2023-11-08T19:24:16.273 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.261+0000 7f1f83fff700 1 --2- 172.21.15.149:0/4133572911 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1f7006af30 0x7f1f7006d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:16.274 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.262+0000 7f1f83fff700 1 --2- 172.21.15.149:0/4133572911 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1f7006af30 0x7f1f7006d3f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1f78000f60 tx=0x7f1f78009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:16.274 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.266+0000 7f1f80ff9700 1 -- 172.21.15.149:0/4133572911 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1f7c054de0 con 0x7f1f8415df40 2023-11-08T19:24:16.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:16.500+0000 7f1f8a95f700 1 -- 172.21.15.149:0/4133572911 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f1f840af4a0 con 0x7f1f8415df40 2023-11-08T19:24:17.481 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.479+0000 7f1f80ff9700 1 -- 172.21.15.149:0/4133572911 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f1f7c058400 con 0x7f1f8415df40 2023-11-08T19:24:17.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.483+0000 7f1f8a95f700 1 -- 172.21.15.149:0/4133572911 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1f7006af30 msgr2=0x7f1f7006d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:17.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.483+0000 7f1f8a95f700 1 --2- 172.21.15.149:0/4133572911 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1f7006af30 0x7f1f7006d3f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1f78000f60 tx=0x7f1f78009040 comp rx=0 tx=0).stop 2023-11-08T19:24:17.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.484+0000 7f1f8a95f700 1 -- 172.21.15.149:0/4133572911 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f8415df40 msgr2=0x7f1f84160330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:17.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.484+0000 7f1f8a95f700 1 --2- 172.21.15.149:0/4133572911 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f8415df40 0x7f1f84160330 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c007e30 tx=0x7f1f7c00e3c0 comp rx=0 tx=0).stop 2023-11-08T19:24:17.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.484+0000 7f1f8a95f700 1 -- 172.21.15.149:0/4133572911 shutdown_connections 2023-11-08T19:24:17.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.484+0000 7f1f8a95f700 1 --2- 172.21.15.149:0/4133572911 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1f7006af30 0x7f1f7006d3f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:17.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.484+0000 7f1f8a95f700 1 --2- 172.21.15.149:0/4133572911 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f8415df40 0x7f1f84160330 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:17.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.484+0000 7f1f8a95f700 1 --2- 172.21.15.149:0/4133572911 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1f8406ab80 0x7f1f8414fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:17.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.484+0000 7f1f8a95f700 1 --2- 172.21.15.149:0/4133572911 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1f840cf1c0 0x7f1f840adde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:17.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.484+0000 7f1f8a95f700 1 -- 172.21.15.149:0/4133572911 >> 172.21.15.149:0/4133572911 conn(0x7f1f840d0640 msgr2=0x7f1f840c39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:17.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.484+0000 7f1f8a95f700 1 -- 172.21.15.149:0/4133572911 shutdown_connections 2023-11-08T19:24:17.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.484+0000 7f1f8a95f700 1 -- 172.21.15.149:0/4133572911 wait complete. 2023-11-08T19:24:17.489 INFO:teuthology.orchestra.run.smithi149.stderr:new fs with metadata pool 5 and data pool 6 2023-11-08T19:24:17.502 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:24:17.624 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.623+0000 7f4a4c2ed700 1 Processor -- start 2023-11-08T19:24:17.625 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.623+0000 7f4a4c2ed700 1 -- start start 2023-11-08T19:24:17.626 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.624+0000 7f4a4c2ed700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4a440cc910 0x7f4a440cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:17.627 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.624+0000 7f4a4c2ed700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f4a440cb130 0x7f4a4415d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:17.627 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.624+0000 7f4a4c2ed700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a440b2f60 con 0x7f4a440cc140 2023-11-08T19:24:17.627 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.624+0000 7f4a4c2ed700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a440b2430 con 0x7f4a440cb130 2023-11-08T19:24:17.627 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.624+0000 7f4a4c2ed700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a440cc520 con 0x7f4a440cc910 2023-11-08T19:24:17.628 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.625+0000 7f4a49888700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4a440cc910 0x7f4a440cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:17.628 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.625+0000 7f4a4a88a700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f4a440cb130 0x7f4a4415d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:17.628 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.625+0000 7f4a49888700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4a440cc910 0x7f4a440cabf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.149:59550/0 (socket says 172.21.15.149:59550) 2023-11-08T19:24:17.628 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.625+0000 7f4a49888700 1 -- 172.21.15.149:0/824463514 learned_addr learned my addr 172.21.15.149:0/824463514 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:17.628 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.625+0000 7f4a4a88a700 1 -- 172.21.15.149:0/824463514 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4a440cc910 msgr2=0x7f4a440cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:17.629 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.625+0000 7f4a4a88a700 1 --2- 172.21.15.149:0/824463514 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4a440cc910 0x7f4a440cabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:17.629 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.625+0000 7f4a4a88a700 1 -- 172.21.15.149:0/824463514 >> v1:172.21.15.160:6789/0 conn(0x7f4a440cc140 legacy=0x7f4a440b2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:17.629 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.625+0000 7f4a4a88a700 1 -- 172.21.15.149:0/824463514 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a440cb5b0 con 0x7f4a440cb130 2023-11-08T19:24:17.629 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.625+0000 7f4a49888700 1 --2- 172.21.15.149:0/824463514 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4a440cc910 0x7f4a440cabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:24:17.629 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.625+0000 7f4a4a88a700 1 --2- 172.21.15.149:0/824463514 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4a440cb130 0x7f4a4415d2b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c009d90 tx=0x7f4a3c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f40b2e0943cdf7b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:17.630 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.625+0000 7f4a49087700 1 -- 172.21.15.149:0/824463514 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a3c00e070 con 0x7f4a440cb130 2023-11-08T19:24:17.630 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.625+0000 7f4a49087700 1 -- 172.21.15.149:0/824463514 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a3c00bb20 con 0x7f4a440cb130 2023-11-08T19:24:17.630 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.625+0000 7f4a49087700 1 -- 172.21.15.149:0/824463514 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a3c012430 con 0x7f4a440cb130 2023-11-08T19:24:17.633 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.626+0000 7f4a4c2ed700 1 -- 172.21.15.149:0/824463514 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4a440cb130 msgr2=0x7f4a4415d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:17.633 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.626+0000 7f4a4c2ed700 1 --2- 172.21.15.149:0/824463514 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4a440cb130 0x7f4a4415d2b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c009d90 tx=0x7f4a3c00b330 comp rx=0 tx=0).stop 2023-11-08T19:24:17.634 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.626+0000 7f4a4c2ed700 1 -- 172.21.15.149:0/824463514 shutdown_connections 2023-11-08T19:24:17.634 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.626+0000 7f4a4c2ed700 1 --2- 172.21.15.149:0/824463514 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4a440cb130 0x7f4a4415d2b0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:17.634 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.626+0000 7f4a4c2ed700 1 --2- 172.21.15.149:0/824463514 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4a440cc910 0x7f4a440cabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:17.634 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.626+0000 7f4a4c2ed700 1 -- 172.21.15.149:0/824463514 >> 172.21.15.149:0/824463514 conn(0x7f4a44099a40 msgr2=0x7f4a440d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:17.634 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.626+0000 7f4a4c2ed700 1 -- 172.21.15.149:0/824463514 shutdown_connections 2023-11-08T19:24:17.635 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.626+0000 7f4a4c2ed700 1 -- 172.21.15.149:0/824463514 wait complete. 2023-11-08T19:24:17.635 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.627+0000 7f4a4c2ed700 1 Processor -- start 2023-11-08T19:24:17.635 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.627+0000 7f4a4c2ed700 1 -- start start 2023-11-08T19:24:17.635 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.628+0000 7f4a4c2ed700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4a440cb130 0x7f4a440b3250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:17.635 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.628+0000 7f4a4c2ed700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a440cc140 0x7f4a441f7620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:17.636 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.628+0000 7f4a4c2ed700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4a440cc910 0x7f4a4415bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:17.636 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.628+0000 7f4a4c2ed700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a441f7b60 con 0x7f4a440cc140 2023-11-08T19:24:17.636 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.628+0000 7f4a4c2ed700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4415c4f0 con 0x7f4a440cc910 2023-11-08T19:24:17.636 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.628+0000 7f4a4c2ed700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a440b4160 con 0x7f4a440cb130 2023-11-08T19:24:17.636 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.628+0000 7f4a49888700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a440cc140 0x7f4a441f7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:17.637 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.628+0000 7f4a49888700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a440cc140 0x7f4a441f7620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39270/0 (socket says 172.21.15.149:39270) 2023-11-08T19:24:17.637 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.628+0000 7f4a49888700 1 -- 172.21.15.149:0/3436805688 learned_addr learned my addr 172.21.15.149:0/3436805688 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:17.637 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.628+0000 7f4a4a88a700 1 --2- 172.21.15.149:0/3436805688 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4a440cc910 0x7f4a4415bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:17.637 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.628+0000 7f4a4a089700 1 --2- 172.21.15.149:0/3436805688 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4a440cb130 0x7f4a440b3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:17.637 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.629+0000 7f4a49888700 1 -- 172.21.15.149:0/3436805688 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4a440cb130 msgr2=0x7f4a440b3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:17.638 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.629+0000 7f4a49888700 1 --2- 172.21.15.149:0/3436805688 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4a440cb130 0x7f4a440b3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:17.638 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.629+0000 7f4a49888700 1 -- 172.21.15.149:0/3436805688 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4a440cc910 msgr2=0x7f4a4415bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:17.638 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.629+0000 7f4a49888700 1 --2- 172.21.15.149:0/3436805688 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4a440cc910 0x7f4a4415bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:17.638 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.629+0000 7f4a49888700 1 -- 172.21.15.149:0/3436805688 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a40009550 con 0x7f4a440cc140 2023-11-08T19:24:17.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.629+0000 7f4a49888700 1 --2- 172.21.15.149:0/3436805688 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a440cc140 0x7f4a441f7620 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f4a4000e990 tx=0x7f4a4000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:17.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.629+0000 7f4a3affd700 1 -- 172.21.15.149:0/3436805688 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4000c690 con 0x7f4a440cc140 2023-11-08T19:24:17.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.629+0000 7f4a3affd700 1 -- 172.21.15.149:0/3436805688 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a4000c7f0 con 0x7f4a440cc140 2023-11-08T19:24:17.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.629+0000 7f4a4c2ed700 1 -- 172.21.15.149:0/3436805688 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a3c009a70 con 0x7f4a440cc140 2023-11-08T19:24:17.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.629+0000 7f4a3affd700 1 -- 172.21.15.149:0/3436805688 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4000cba0 con 0x7f4a440cc140 2023-11-08T19:24:17.640 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.629+0000 7f4a4c2ed700 1 -- 172.21.15.149:0/3436805688 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a440b3ba0 con 0x7f4a440cc140 2023-11-08T19:24:17.640 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.630+0000 7f4a4c2ed700 1 -- 172.21.15.149:0/3436805688 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a44068560 con 0x7f4a440cc140 2023-11-08T19:24:17.640 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.630+0000 7f4a3affd700 1 -- 172.21.15.149:0/3436805688 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4a4000cd00 con 0x7f4a440cc140 2023-11-08T19:24:17.640 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.631+0000 7f4a3affd700 1 --2- 172.21.15.149:0/3436805688 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4a2806af00 0x7f4a2806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:17.640 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.631+0000 7f4a4a089700 1 --2- 172.21.15.149:0/3436805688 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4a2806af00 0x7f4a2806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:17.641 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.631+0000 7f4a3affd700 1 -- 172.21.15.149:0/3436805688 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4a40089660 con 0x7f4a440cc140 2023-11-08T19:24:17.641 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.631+0000 7f4a4a089700 1 --2- 172.21.15.149:0/3436805688 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4a2806af00 0x7f4a2806d3c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4a34000fb0 tx=0x7f4a34009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:17.641 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.636+0000 7f4a3affd700 1 -- 172.21.15.149:0/3436805688 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4a40054660 con 0x7f4a440cc140 2023-11-08T19:24:17.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.824+0000 7f4a4c2ed700 1 -- 172.21.15.149:0/3436805688 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4a440745f0 con 0x7f4a440cc140 2023-11-08T19:24:17.826 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.826+0000 7f4a3affd700 1 -- 172.21.15.149:0/3436805688 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16823 (secure 0 0 0) 0x7f4a40057c80 con 0x7f4a440cc140 2023-11-08T19:24:17.827 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:24:17.827 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":38,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:24:16.501873+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-08T19:24:14.467859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-08T19:24:15.470328+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:24:17.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.828+0000 7f4a4c2ed700 1 -- 172.21.15.149:0/3436805688 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4a2806af00 msgr2=0x7f4a2806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:17.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.828+0000 7f4a4c2ed700 1 --2- 172.21.15.149:0/3436805688 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4a2806af00 0x7f4a2806d3c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4a34000fb0 tx=0x7f4a34009040 comp rx=0 tx=0).stop 2023-11-08T19:24:17.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.828+0000 7f4a4c2ed700 1 -- 172.21.15.149:0/3436805688 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a440cc140 msgr2=0x7f4a441f7620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:17.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.828+0000 7f4a4c2ed700 1 --2- 172.21.15.149:0/3436805688 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a440cc140 0x7f4a441f7620 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f4a4000e990 tx=0x7f4a4000eca0 comp rx=0 tx=0).stop 2023-11-08T19:24:17.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.828+0000 7f4a4c2ed700 1 -- 172.21.15.149:0/3436805688 shutdown_connections 2023-11-08T19:24:17.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.828+0000 7f4a4c2ed700 1 --2- 172.21.15.149:0/3436805688 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4a2806af00 0x7f4a2806d3c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:17.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.828+0000 7f4a4c2ed700 1 --2- 172.21.15.149:0/3436805688 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4a440cc910 0x7f4a4415bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:17.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.828+0000 7f4a4c2ed700 1 --2- 172.21.15.149:0/3436805688 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4a440cb130 0x7f4a440b3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:17.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.828+0000 7f4a4c2ed700 1 --2- 172.21.15.149:0/3436805688 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a440cc140 0x7f4a441f7620 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:17.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.828+0000 7f4a4c2ed700 1 -- 172.21.15.149:0/3436805688 >> 172.21.15.149:0/3436805688 conn(0x7f4a44099a40 msgr2=0x7f4a4406f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:17.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.828+0000 7f4a4c2ed700 1 -- 172.21.15.149:0/3436805688 shutdown_connections 2023-11-08T19:24:17.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.828+0000 7f4a4c2ed700 1 -- 172.21.15.149:0/3436805688 wait complete. 2023-11-08T19:24:17.841 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:24:17.961 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.960+0000 7f25ca63e700 1 Processor -- start 2023-11-08T19:24:17.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.960+0000 7f25ca63e700 1 -- start start 2023-11-08T19:24:17.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.961+0000 7f25ca63e700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f25c41624c0 0x7f25c406bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:17.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.961+0000 7f25ca63e700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f25c4066c80 0x7f25c406c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:17.965 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.961+0000 7f25ca63e700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25c406e2a0 con 0x7f25c40ca630 2023-11-08T19:24:17.965 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.961+0000 7f25ca63e700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25c40cc5c0 con 0x7f25c41624c0 2023-11-08T19:24:17.965 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.961+0000 7f25ca63e700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25c406d970 con 0x7f25c4066c80 2023-11-08T19:24:17.965 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.961+0000 7f25c3fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f25c41624c0 0x7f25c406bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:17.965 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.961+0000 7f25c8bdb700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f25c40ca630 0x7f25c40caac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:41282/0 (socket says 172.21.15.149:41282) 2023-11-08T19:24:17.966 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.961+0000 7f25c8bdb700 1 -- 172.21.15.149:0/1630610901 learned_addr learned my addr 172.21.15.149:0/1630610901 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:24:17.966 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.961+0000 7f25c37fe700 1 --2- 172.21.15.149:0/1630610901 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f25c4066c80 0x7f25c406c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:17.966 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.961+0000 7f25c3fff700 1 -- 172.21.15.149:0/1630610901 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f25c4066c80 msgr2=0x7f25c406c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:17.966 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.961+0000 7f25c3fff700 1 --2- 172.21.15.149:0/1630610901 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f25c4066c80 0x7f25c406c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:17.966 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.961+0000 7f25c3fff700 1 -- 172.21.15.149:0/1630610901 >> v1:172.21.15.149:6789/0 conn(0x7f25c40ca630 legacy=0x7f25c40caac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:17.967 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.962+0000 7f25c3fff700 1 -- 172.21.15.149:0/1630610901 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c406dc50 con 0x7f25c41624c0 2023-11-08T19:24:17.967 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.961+0000 7f25c2ffd700 1 -- 172.21.15.149:0/1630610901 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 296584289 0 0) 0x7f25c406e2a0 con 0x7f25c40ca630 2023-11-08T19:24:17.967 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.962+0000 7f25c3fff700 1 --2- 172.21.15.149:0/1630610901 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25c41624c0 0x7f25c406bb90 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f25b8009840 tx=0x7f25b8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82efde1c1800d9f2 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:17.967 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.962+0000 7f25c2ffd700 1 -- 172.21.15.149:0/1630610901 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b8011830 con 0x7f25c41624c0 2023-11-08T19:24:17.968 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.962+0000 7f25c2ffd700 1 -- 172.21.15.149:0/1630610901 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b8011990 con 0x7f25c41624c0 2023-11-08T19:24:17.968 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.962+0000 7f25c2ffd700 1 -- 172.21.15.149:0/1630610901 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b8011d20 con 0x7f25c41624c0 2023-11-08T19:24:17.968 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.962+0000 7f25ca63e700 1 -- 172.21.15.149:0/1630610901 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25c41624c0 msgr2=0x7f25c406bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:17.968 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.962+0000 7f25ca63e700 1 --2- 172.21.15.149:0/1630610901 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25c41624c0 0x7f25c406bb90 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f25b8009840 tx=0x7f25b8009b50 comp rx=0 tx=0).stop 2023-11-08T19:24:17.968 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.962+0000 7f25ca63e700 1 -- 172.21.15.149:0/1630610901 shutdown_connections 2023-11-08T19:24:17.969 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.962+0000 7f25ca63e700 1 --2- 172.21.15.149:0/1630610901 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25c41624c0 0x7f25c406bb90 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:17.969 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.962+0000 7f25ca63e700 1 --2- 172.21.15.149:0/1630610901 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f25c4066c80 0x7f25c406c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:17.969 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.962+0000 7f25ca63e700 1 -- 172.21.15.149:0/1630610901 >> 172.21.15.149:0/1630610901 conn(0x7f25c4071720 msgr2=0x7f25c4071b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:17.969 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.962+0000 7f25ca63e700 1 -- 172.21.15.149:0/1630610901 shutdown_connections 2023-11-08T19:24:17.969 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.962+0000 7f25ca63e700 1 -- 172.21.15.149:0/1630610901 wait complete. 2023-11-08T19:24:17.972 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.964+0000 7f25ca63e700 1 Processor -- start 2023-11-08T19:24:17.972 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.964+0000 7f25ca63e700 1 -- start start 2023-11-08T19:24:17.973 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.965+0000 7f25ca63e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25c4066c80 0x7f25c41f76e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:17.973 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.965+0000 7f25ca63e700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f25c40ca630 0x7f25c4156390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:17.973 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.965+0000 7f25ca63e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25c41624c0 0x7f25c40afb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:17.973 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.965+0000 7f25ca63e700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c40c48a0 con 0x7f25c41624c0 2023-11-08T19:24:17.973 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.965+0000 7f25ca63e700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c41f7c20 con 0x7f25c4066c80 2023-11-08T19:24:17.974 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.965+0000 7f25ca63e700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25c40c3c20 con 0x7f25c40ca630 2023-11-08T19:24:17.974 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.965+0000 7f25c8bdb700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25c41624c0 0x7f25c40afb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:17.974 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.965+0000 7f25c8bdb700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25c41624c0 0x7f25c40afb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39286/0 (socket says 172.21.15.149:39286) 2023-11-08T19:24:17.974 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.965+0000 7f25c8bdb700 1 -- 172.21.15.149:0/3915581538 learned_addr learned my addr 172.21.15.149:0/3915581538 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:17.975 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.965+0000 7f25c37fe700 1 --2- 172.21.15.149:0/3915581538 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f25c40ca630 0x7f25c4156390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:17.975 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.965+0000 7f25c3fff700 1 --2- 172.21.15.149:0/3915581538 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25c4066c80 0x7f25c41f76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:17.975 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.966+0000 7f25c8bdb700 1 -- 172.21.15.149:0/3915581538 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f25c40ca630 msgr2=0x7f25c4156390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:17.975 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.966+0000 7f25c8bdb700 1 --2- 172.21.15.149:0/3915581538 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f25c40ca630 0x7f25c4156390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:17.975 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.966+0000 7f25c8bdb700 1 -- 172.21.15.149:0/3915581538 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25c4066c80 msgr2=0x7f25c41f76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:17.976 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.966+0000 7f25c8bdb700 1 --2- 172.21.15.149:0/3915581538 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25c4066c80 0x7f25c41f76e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:17.976 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.966+0000 7f25c8bdb700 1 -- 172.21.15.149:0/3915581538 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b80094a0 con 0x7f25c41624c0 2023-11-08T19:24:17.976 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.966+0000 7f25c37fe700 1 --2- 172.21.15.149:0/3915581538 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f25c40ca630 0x7f25c4156390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:24:17.976 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.966+0000 7f25c3fff700 1 --2- 172.21.15.149:0/3915581538 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25c4066c80 0x7f25c41f76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:24:17.977 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.966+0000 7f25c8bdb700 1 --2- 172.21.15.149:0/3915581538 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25c41624c0 0x7f25c40afb00 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f25bc00cc70 tx=0x7f25bc00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:17.977 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.966+0000 7f25c0ff9700 1 -- 172.21.15.149:0/3915581538 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25bc00ada0 con 0x7f25c41624c0 2023-11-08T19:24:17.977 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.966+0000 7f25c0ff9700 1 -- 172.21.15.149:0/3915581538 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25bc00ce70 con 0x7f25c41624c0 2023-11-08T19:24:17.977 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.966+0000 7f25c0ff9700 1 -- 172.21.15.149:0/3915581538 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25bc0072f0 con 0x7f25c41624c0 2023-11-08T19:24:17.977 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.966+0000 7f25ca63e700 1 -- 172.21.15.149:0/3915581538 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25c40c3f00 con 0x7f25c41624c0 2023-11-08T19:24:17.978 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.966+0000 7f25ca63e700 1 -- 172.21.15.149:0/3915581538 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25c40c44c0 con 0x7f25c41624c0 2023-11-08T19:24:17.978 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.967+0000 7f25ca63e700 1 -- 172.21.15.149:0/3915581538 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25c40745f0 con 0x7f25c41624c0 2023-11-08T19:24:17.978 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.967+0000 7f25c0ff9700 1 -- 172.21.15.149:0/3915581538 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f25bc007450 con 0x7f25c41624c0 2023-11-08T19:24:17.978 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.968+0000 7f25c0ff9700 1 --2- 172.21.15.149:0/3915581538 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f25b006af00 0x7f25b006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:17.979 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.968+0000 7f25c0ff9700 1 -- 172.21.15.149:0/3915581538 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f25bc089260 con 0x7f25c41624c0 2023-11-08T19:24:17.979 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.968+0000 7f25c3fff700 1 --2- 172.21.15.149:0/3915581538 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f25b006af00 0x7f25b006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:17.979 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.968+0000 7f25c3fff700 1 --2- 172.21.15.149:0/3915581538 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f25b006af00 0x7f25b006d3c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f25b80090b0 tx=0x7f25b8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:17.979 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:17.973+0000 7f25c0ff9700 1 -- 172.21.15.149:0/3915581538 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f25bc0541e0 con 0x7f25c41624c0 2023-11-08T19:24:18.166 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.165+0000 7f25ca63e700 1 -- 172.21.15.149:0/3915581538 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f25c40b5d80 con 0x7f25c41624c0 2023-11-08T19:24:18.167 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.166+0000 7f25c0ff9700 1 -- 172.21.15.149:0/3915581538 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16810 (secure 0 0 0) 0x7f25bc057800 con 0x7f25c41624c0 2023-11-08T19:24:18.167 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:24:18.168 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":39,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:24:18.102391+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-08T19:24:14.467859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-08T19:24:15.470328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:24:18.169 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.168+0000 7f25ca63e700 1 -- 172.21.15.149:0/3915581538 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f25b006af00 msgr2=0x7f25b006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:18.169 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.168+0000 7f25ca63e700 1 --2- 172.21.15.149:0/3915581538 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f25b006af00 0x7f25b006d3c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f25b80090b0 tx=0x7f25b8008030 comp rx=0 tx=0).stop 2023-11-08T19:24:18.170 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.168+0000 7f25ca63e700 1 -- 172.21.15.149:0/3915581538 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25c41624c0 msgr2=0x7f25c40afb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:18.170 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.168+0000 7f25ca63e700 1 --2- 172.21.15.149:0/3915581538 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25c41624c0 0x7f25c40afb00 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f25bc00cc70 tx=0x7f25bc00a340 comp rx=0 tx=0).stop 2023-11-08T19:24:18.170 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.168+0000 7f25ca63e700 1 -- 172.21.15.149:0/3915581538 shutdown_connections 2023-11-08T19:24:18.170 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.168+0000 7f25ca63e700 1 --2- 172.21.15.149:0/3915581538 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f25b006af00 0x7f25b006d3c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:18.170 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.168+0000 7f25ca63e700 1 --2- 172.21.15.149:0/3915581538 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25c4066c80 0x7f25c41f76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:18.171 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.168+0000 7f25ca63e700 1 --2- 172.21.15.149:0/3915581538 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25c41624c0 0x7f25c40afb00 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:18.171 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.168+0000 7f25ca63e700 1 --2- 172.21.15.149:0/3915581538 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f25c40ca630 0x7f25c4156390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:18.171 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.168+0000 7f25ca63e700 1 -- 172.21.15.149:0/3915581538 >> 172.21.15.149:0/3915581538 conn(0x7f25c4071720 msgr2=0x7f25c40cbae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:18.171 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.168+0000 7f25ca63e700 1 -- 172.21.15.149:0/3915581538 shutdown_connections 2023-11-08T19:24:18.172 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.168+0000 7f25ca63e700 1 -- 172.21.15.149:0/3915581538 wait complete. 2023-11-08T19:24:18.182 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-08T19:24:18.307 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.306+0000 7f93de802700 1 Processor -- start 2023-11-08T19:24:18.307 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.306+0000 7f93de802700 1 -- start start 2023-11-08T19:24:18.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.306+0000 7f93de802700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f93d80cc0d0 0x7f93d815f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:18.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.306+0000 7f93de802700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f93d80cc4b0 0x7f93d815c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:18.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.306+0000 7f93de802700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93d815be80 con 0x7f93d815cb60 2023-11-08T19:24:18.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.306+0000 7f93de802700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93d815f9b0 con 0x7f93d80cc4b0 2023-11-08T19:24:18.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.306+0000 7f93de802700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93d815fba0 con 0x7f93d80cc0d0 2023-11-08T19:24:18.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.307+0000 7f93d7fff700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f93d80cc0d0 0x7f93d815f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:18.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.307+0000 7f93d77fe700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f93d80cc4b0 0x7f93d815c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:18.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.307+0000 7f93d77fe700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f93d80cc4b0 0x7f93d815c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.149:40284/0 (socket says 172.21.15.149:40284) 2023-11-08T19:24:18.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.307+0000 7f93d77fe700 1 -- 172.21.15.149:0/2493547718 learned_addr learned my addr 172.21.15.149:0/2493547718 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:18.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.307+0000 7f93d7fff700 1 --2- 172.21.15.149:0/2493547718 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f93d80cc0d0 0x7f93d815f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.149:59578/0 (socket says 172.21.15.149:59578) 2023-11-08T19:24:18.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.307+0000 7f93d77fe700 1 -- 172.21.15.149:0/2493547718 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f93d80cc0d0 msgr2=0x7f93d815f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:18.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.307+0000 7f93d77fe700 1 --2- 172.21.15.149:0/2493547718 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f93d80cc0d0 0x7f93d815f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:18.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.307+0000 7f93d77fe700 1 -- 172.21.15.149:0/2493547718 >> v1:172.21.15.160:6789/0 conn(0x7f93d815cb60 legacy=0x7f93d80cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:18.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.307+0000 7f93d77fe700 1 -- 172.21.15.149:0/2493547718 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d815fe80 con 0x7f93d80cc4b0 2023-11-08T19:24:18.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.307+0000 7f93d7fff700 1 --2- 172.21.15.149:0/2493547718 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f93d80cc0d0 0x7f93d815f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:24:18.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.307+0000 7f93d77fe700 1 --2- 172.21.15.149:0/2493547718 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f93d80cc4b0 0x7f93d815c620 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f93cc0098f0 tx=0x7f93cc009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65dedd5a7db2fc66 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:18.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.308+0000 7f93d6ffd700 1 -- 172.21.15.149:0/2493547718 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93cc011830 con 0x7f93d80cc4b0 2023-11-08T19:24:18.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.308+0000 7f93d6ffd700 1 -- 172.21.15.149:0/2493547718 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93cc011990 con 0x7f93d80cc4b0 2023-11-08T19:24:18.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.308+0000 7f93d6ffd700 1 -- 172.21.15.149:0/2493547718 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93cc011d20 con 0x7f93d80cc4b0 2023-11-08T19:24:18.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.308+0000 7f93de802700 1 -- 172.21.15.149:0/2493547718 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f93d80cc4b0 msgr2=0x7f93d815c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:18.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.308+0000 7f93de802700 1 --2- 172.21.15.149:0/2493547718 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f93d80cc4b0 0x7f93d815c620 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f93cc0098f0 tx=0x7f93cc009c00 comp rx=0 tx=0).stop 2023-11-08T19:24:18.314 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.308+0000 7f93de802700 1 -- 172.21.15.149:0/2493547718 shutdown_connections 2023-11-08T19:24:18.314 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.308+0000 7f93de802700 1 --2- 172.21.15.149:0/2493547718 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f93d80cc0d0 0x7f93d815f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:18.314 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.308+0000 7f93de802700 1 --2- 172.21.15.149:0/2493547718 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f93d80cc4b0 0x7f93d815c620 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:18.314 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.308+0000 7f93de802700 1 -- 172.21.15.149:0/2493547718 >> 172.21.15.149:0/2493547718 conn(0x7f93d806f120 msgr2=0x7f93d806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:18.315 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.308+0000 7f93de802700 1 -- 172.21.15.149:0/2493547718 shutdown_connections 2023-11-08T19:24:18.315 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.308+0000 7f93de802700 1 -- 172.21.15.149:0/2493547718 wait complete. 2023-11-08T19:24:18.317 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.309+0000 7f93de802700 1 Processor -- start 2023-11-08T19:24:18.317 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.310+0000 7f93de802700 1 -- start start 2023-11-08T19:24:18.317 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.310+0000 7f93de802700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f93d80cc0d0 0x7f93d80c66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:18.318 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.310+0000 7f93de802700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f93d80cc4b0 0x7f93d8158880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:18.318 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.310+0000 7f93de802700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93d815cb60 0x7f93d806d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:18.318 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.310+0000 7f93de802700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d80b2410 con 0x7f93d815cb60 2023-11-08T19:24:18.318 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.310+0000 7f93de802700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d80c72e0 con 0x7f93d80cc4b0 2023-11-08T19:24:18.319 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.310+0000 7f93de802700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93d806dc80 con 0x7f93d80cc0d0 2023-11-08T19:24:18.319 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.310+0000 7f93dcd9f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93d815cb60 0x7f93d806d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:18.319 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.311+0000 7f93d7fff700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f93d80cc0d0 0x7f93d80c66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:18.319 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.311+0000 7f93dcd9f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93d815cb60 0x7f93d806d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39300/0 (socket says 172.21.15.149:39300) 2023-11-08T19:24:18.319 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.311+0000 7f93dcd9f700 1 -- 172.21.15.149:0/3438688026 learned_addr learned my addr 172.21.15.149:0/3438688026 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:18.320 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.311+0000 7f93d77fe700 1 --2- 172.21.15.149:0/3438688026 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f93d80cc4b0 0x7f93d8158880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:18.320 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.311+0000 7f93dcd9f700 1 -- 172.21.15.149:0/3438688026 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f93d80cc0d0 msgr2=0x7f93d80c66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:18.320 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.311+0000 7f93dcd9f700 1 --2- 172.21.15.149:0/3438688026 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f93d80cc0d0 0x7f93d80c66d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:18.320 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.311+0000 7f93dcd9f700 1 -- 172.21.15.149:0/3438688026 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f93d80cc4b0 msgr2=0x7f93d8158880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:18.320 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.311+0000 7f93dcd9f700 1 --2- 172.21.15.149:0/3438688026 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f93d80cc4b0 0x7f93d8158880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:18.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.311+0000 7f93dcd9f700 1 -- 172.21.15.149:0/3438688026 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c80094a0 con 0x7f93d815cb60 2023-11-08T19:24:18.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.311+0000 7f93dcd9f700 1 --2- 172.21.15.149:0/3438688026 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93d815cb60 0x7f93d806d740 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f93d000cb50 tx=0x7f93d000ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:18.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.311+0000 7f93d4ff9700 1 -- 172.21.15.149:0/3438688026 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d0003c00 con 0x7f93d815cb60 2023-11-08T19:24:18.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.311+0000 7f93d4ff9700 1 -- 172.21.15.149:0/3438688026 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d0003d60 con 0x7f93d815cb60 2023-11-08T19:24:18.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.311+0000 7f93d4ff9700 1 -- 172.21.15.149:0/3438688026 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d000a9c0 con 0x7f93d815cb60 2023-11-08T19:24:18.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.311+0000 7f93de802700 1 -- 172.21.15.149:0/3438688026 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93cc009550 con 0x7f93d815cb60 2023-11-08T19:24:18.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.311+0000 7f93de802700 1 -- 172.21.15.149:0/3438688026 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93d80c7000 con 0x7f93d815cb60 2023-11-08T19:24:18.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.312+0000 7f93de802700 1 -- 172.21.15.149:0/3438688026 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93d804f730 con 0x7f93d815cb60 2023-11-08T19:24:18.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.313+0000 7f93d4ff9700 1 -- 172.21.15.149:0/3438688026 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f93d000ab20 con 0x7f93d815cb60 2023-11-08T19:24:18.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.313+0000 7f93d4ff9700 1 --2- 172.21.15.149:0/3438688026 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f93c406af00 0x7f93c406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:18.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.313+0000 7f93d4ff9700 1 -- 172.21.15.149:0/3438688026 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f93d00895b0 con 0x7f93d815cb60 2023-11-08T19:24:18.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.313+0000 7f93d7fff700 1 --2- 172.21.15.149:0/3438688026 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f93c406af00 0x7f93c406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:18.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.314+0000 7f93d7fff700 1 --2- 172.21.15.149:0/3438688026 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f93c406af00 0x7f93c406d3c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f93c8009d70 tx=0x7f93c8009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:18.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.318+0000 7f93d4ff9700 1 -- 172.21.15.149:0/3438688026 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f93d00545b0 con 0x7f93d815cb60 2023-11-08T19:24:18.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:18.553+0000 7f93de802700 1 -- 172.21.15.149:0/3438688026 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f93d80c64b0 con 0x7f93d815cb60 2023-11-08T19:24:19.459 INFO:tasks.ceph.mds.a.smithi149.stderr:2023-11-08T19:24:19.457+0000 7f2e53188700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-08T19:24:19.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.494+0000 7f93d4ff9700 1 -- 172.21.15.149:0/3438688026 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f93d0057bd0 con 0x7f93d815cb60 2023-11-08T19:24:19.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.497+0000 7f93de802700 1 -- 172.21.15.149:0/3438688026 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f93c406af00 msgr2=0x7f93c406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:19.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.497+0000 7f93de802700 1 --2- 172.21.15.149:0/3438688026 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f93c406af00 0x7f93c406d3c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f93c8009d70 tx=0x7f93c8009210 comp rx=0 tx=0).stop 2023-11-08T19:24:19.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.497+0000 7f93de802700 1 -- 172.21.15.149:0/3438688026 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93d815cb60 msgr2=0x7f93d806d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:19.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.497+0000 7f93de802700 1 --2- 172.21.15.149:0/3438688026 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93d815cb60 0x7f93d806d740 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f93d000cb50 tx=0x7f93d000ce60 comp rx=0 tx=0).stop 2023-11-08T19:24:19.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.497+0000 7f93de802700 1 -- 172.21.15.149:0/3438688026 shutdown_connections 2023-11-08T19:24:19.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.497+0000 7f93de802700 1 --2- 172.21.15.149:0/3438688026 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f93c406af00 0x7f93c406d3c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:19.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.497+0000 7f93de802700 1 --2- 172.21.15.149:0/3438688026 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93d815cb60 0x7f93d806d740 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:19.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.497+0000 7f93de802700 1 --2- 172.21.15.149:0/3438688026 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f93d80cc0d0 0x7f93d80c66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:19.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.497+0000 7f93de802700 1 --2- 172.21.15.149:0/3438688026 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f93d80cc4b0 0x7f93d8158880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:19.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.497+0000 7f93de802700 1 -- 172.21.15.149:0/3438688026 >> 172.21.15.149:0/3438688026 conn(0x7f93d806f120 msgr2=0x7f93d815efc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:19.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.497+0000 7f93de802700 1 -- 172.21.15.149:0/3438688026 shutdown_connections 2023-11-08T19:24:19.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.497+0000 7f93de802700 1 -- 172.21.15.149:0/3438688026 wait complete. 2023-11-08T19:24:19.513 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-08T19:24:19.513 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-08T19:24:19.640 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.637+0000 7fce81234700 1 Processor -- start 2023-11-08T19:24:19.640 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.637+0000 7fce81234700 1 -- start start 2023-11-08T19:24:19.642 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.638+0000 7fce81234700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fce7c0c7250 0x7fce7c06b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:19.642 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.638+0000 7fce81234700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce7c0b3710 con 0x7fce7c0722a0 2023-11-08T19:24:19.642 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.638+0000 7fce81234700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce7c06c640 con 0x7fce7c0cb610 2023-11-08T19:24:19.643 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.638+0000 7fce81234700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce7c06cc00 con 0x7fce7c0c7250 2023-11-08T19:24:19.643 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.638+0000 7fce7a59c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fce7c0c7250 0x7fce7c06b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:19.643 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.638+0000 7fce7ad9d700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fce7c0722a0 0x7fce7c06ab80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:41306/0 (socket says 172.21.15.149:41306) 2023-11-08T19:24:19.644 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.638+0000 7fce7ad9d700 1 -- 172.21.15.149:0/3280025702 learned_addr learned my addr 172.21.15.149:0/3280025702 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:24:19.644 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.639+0000 7fce7a59c700 1 -- 172.21.15.149:0/3280025702 >> v1:172.21.15.160:6789/0 conn(0x7fce7c0cb610 legacy=0x7fce7c0b4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:19.644 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.639+0000 7fce7a59c700 1 -- 172.21.15.149:0/3280025702 >> v1:172.21.15.149:6789/0 conn(0x7fce7c0722a0 legacy=0x7fce7c06ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:19.644 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.639+0000 7fce7a59c700 1 -- 172.21.15.149:0/3280025702 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce7c06c920 con 0x7fce7c0c7250 2023-11-08T19:24:19.644 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.639+0000 7fce79d9b700 1 -- 172.21.15.149:0/3280025702 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 40479465 0 0) 0x7fce7c0b3710 con 0x7fce7c0722a0 2023-11-08T19:24:19.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.639+0000 7fce7a59c700 1 --2- 172.21.15.149:0/3280025702 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce7c0c7250 0x7fce7c06b290 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fce70009840 tx=0x7fce70009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc64f082bc43f11 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:19.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.639+0000 7fce79d9b700 1 -- 172.21.15.149:0/3280025702 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce70011830 con 0x7fce7c0c7250 2023-11-08T19:24:19.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.639+0000 7fce79d9b700 1 -- 172.21.15.149:0/3280025702 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce70011990 con 0x7fce7c0c7250 2023-11-08T19:24:19.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.639+0000 7fce79d9b700 1 -- 172.21.15.149:0/3280025702 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce70011d20 con 0x7fce7c0c7250 2023-11-08T19:24:19.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.639+0000 7fce81234700 1 -- 172.21.15.149:0/3280025702 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce7c0c7250 msgr2=0x7fce7c06b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:19.646 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.639+0000 7fce81234700 1 --2- 172.21.15.149:0/3280025702 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce7c0c7250 0x7fce7c06b290 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fce70009840 tx=0x7fce70009b50 comp rx=0 tx=0).stop 2023-11-08T19:24:19.646 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.640+0000 7fce81234700 1 -- 172.21.15.149:0/3280025702 shutdown_connections 2023-11-08T19:24:19.646 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.640+0000 7fce81234700 1 --2- 172.21.15.149:0/3280025702 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce7c0c7250 0x7fce7c06b290 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:19.646 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.640+0000 7fce81234700 1 -- 172.21.15.149:0/3280025702 >> 172.21.15.149:0/3280025702 conn(0x7fce7c0d0640 msgr2=0x7fce7c0d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:19.647 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.640+0000 7fce81234700 1 -- 172.21.15.149:0/3280025702 shutdown_connections 2023-11-08T19:24:19.647 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.640+0000 7fce81234700 1 -- 172.21.15.149:0/3280025702 wait complete. 2023-11-08T19:24:19.650 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.641+0000 7fce81234700 1 Processor -- start 2023-11-08T19:24:19.650 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.641+0000 7fce81234700 1 -- start start 2023-11-08T19:24:19.651 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.642+0000 7fce81234700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce7c0722a0 0x7fce7c153270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:19.651 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.642+0000 7fce81234700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce7c0c7250 0x7fce7c0cf730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:19.651 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.642+0000 7fce81234700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce7c0cb610 0x7fce7c15e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:19.651 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.642+0000 7fce81234700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce7c1537b0 con 0x7fce7c0cb610 2023-11-08T19:24:19.651 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.642+0000 7fce81234700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce7c0d0030 con 0x7fce7c0c7250 2023-11-08T19:24:19.652 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.642+0000 7fce81234700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce7c0aca60 con 0x7fce7c0722a0 2023-11-08T19:24:19.652 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.642+0000 7fce7b59e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce7c0cb610 0x7fce7c15e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:19.652 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.642+0000 7fce7b59e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce7c0cb610 0x7fce7c15e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39310/0 (socket says 172.21.15.149:39310) 2023-11-08T19:24:19.652 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.642+0000 7fce7b59e700 1 -- 172.21.15.149:0/3842332577 learned_addr learned my addr 172.21.15.149:0/3842332577 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:19.652 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.642+0000 7fce7a59c700 1 --2- 172.21.15.149:0/3842332577 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce7c0c7250 0x7fce7c0cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:19.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.642+0000 7fce7ad9d700 1 --2- 172.21.15.149:0/3842332577 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce7c0722a0 0x7fce7c153270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:19.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.642+0000 7fce7b59e700 1 -- 172.21.15.149:0/3842332577 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce7c0722a0 msgr2=0x7fce7c153270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:19.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.642+0000 7fce7b59e700 1 --2- 172.21.15.149:0/3842332577 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce7c0722a0 0x7fce7c153270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:19.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.642+0000 7fce7b59e700 1 -- 172.21.15.149:0/3842332577 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce7c0c7250 msgr2=0x7fce7c0cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:19.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.642+0000 7fce7b59e700 1 --2- 172.21.15.149:0/3842332577 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce7c0c7250 0x7fce7c0cf730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:19.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.642+0000 7fce7b59e700 1 -- 172.21.15.149:0/3842332577 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce700094a0 con 0x7fce7c0cb610 2023-11-08T19:24:19.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.642+0000 7fce7ad9d700 1 --2- 172.21.15.149:0/3842332577 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce7c0722a0 0x7fce7c153270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:24:19.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.643+0000 7fce7b59e700 1 --2- 172.21.15.149:0/3842332577 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce7c0cb610 0x7fce7c15e720 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fce7400cb50 tx=0x7fce7400ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:19.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.643+0000 7fce637fe700 1 -- 172.21.15.149:0/3842332577 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce74003c00 con 0x7fce7c0cb610 2023-11-08T19:24:19.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.643+0000 7fce637fe700 1 -- 172.21.15.149:0/3842332577 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce74003d60 con 0x7fce7c0cb610 2023-11-08T19:24:19.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.643+0000 7fce81234700 1 -- 172.21.15.149:0/3842332577 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce7c0acd40 con 0x7fce7c0cb610 2023-11-08T19:24:19.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.643+0000 7fce637fe700 1 -- 172.21.15.149:0/3842332577 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7400aac0 con 0x7fce7c0cb610 2023-11-08T19:24:19.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.643+0000 7fce81234700 1 -- 172.21.15.149:0/3842332577 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce7c0cfc70 con 0x7fce7c0cb610 2023-11-08T19:24:19.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.644+0000 7fce81234700 1 -- 172.21.15.149:0/3842332577 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce7c0ac8c0 con 0x7fce7c0cb610 2023-11-08T19:24:19.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.644+0000 7fce637fe700 1 -- 172.21.15.149:0/3842332577 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fce7400ac20 con 0x7fce7c0cb610 2023-11-08T19:24:19.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.644+0000 7fce637fe700 1 --2- 172.21.15.149:0/3842332577 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fce6806af00 0x7fce6806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:19.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.645+0000 7fce637fe700 1 -- 172.21.15.149:0/3842332577 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fce74089730 con 0x7fce7c0cb610 2023-11-08T19:24:19.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.645+0000 7fce7ad9d700 1 --2- 172.21.15.149:0/3842332577 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fce6806af00 0x7fce6806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:19.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.645+0000 7fce7ad9d700 1 --2- 172.21.15.149:0/3842332577 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fce6806af00 0x7fce6806d3c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fce6c000f60 tx=0x7fce6c007ce0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:19.657 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.649+0000 7fce637fe700 1 -- 172.21.15.149:0/3842332577 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fce7c0ac8c0 con 0x7fce7c0cb610 2023-11-08T19:24:19.886 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:19.884+0000 7fce81234700 1 -- 172.21.15.149:0/3842332577 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fce7c0ad260 con 0x7fce7c0cb610 2023-11-08T19:24:20.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.501+0000 7fce637fe700 1 -- 172.21.15.149:0/3842332577 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7fce7c0ad260 con 0x7fce7c0cb610 2023-11-08T19:24:20.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.504+0000 7fce81234700 1 -- 172.21.15.149:0/3842332577 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fce6806af00 msgr2=0x7fce6806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:20.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.504+0000 7fce81234700 1 --2- 172.21.15.149:0/3842332577 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fce6806af00 0x7fce6806d3c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fce6c000f60 tx=0x7fce6c007ce0 comp rx=0 tx=0).stop 2023-11-08T19:24:20.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.504+0000 7fce81234700 1 -- 172.21.15.149:0/3842332577 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce7c0cb610 msgr2=0x7fce7c15e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:20.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.504+0000 7fce81234700 1 --2- 172.21.15.149:0/3842332577 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce7c0cb610 0x7fce7c15e720 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fce7400cb50 tx=0x7fce7400ce60 comp rx=0 tx=0).stop 2023-11-08T19:24:20.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.504+0000 7fce81234700 1 -- 172.21.15.149:0/3842332577 shutdown_connections 2023-11-08T19:24:20.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.504+0000 7fce81234700 1 --2- 172.21.15.149:0/3842332577 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fce6806af00 0x7fce6806d3c0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:20.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.504+0000 7fce81234700 1 --2- 172.21.15.149:0/3842332577 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce7c0cb610 0x7fce7c15e720 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:20.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.504+0000 7fce81234700 1 --2- 172.21.15.149:0/3842332577 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce7c0722a0 0x7fce7c153270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:20.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.504+0000 7fce81234700 1 --2- 172.21.15.149:0/3842332577 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce7c0c7250 0x7fce7c0cf730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:20.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.504+0000 7fce81234700 1 -- 172.21.15.149:0/3842332577 >> 172.21.15.149:0/3842332577 conn(0x7fce7c0d0640 msgr2=0x7fce7c0ca8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:20.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.504+0000 7fce81234700 1 -- 172.21.15.149:0/3842332577 shutdown_connections 2023-11-08T19:24:20.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.504+0000 7fce81234700 1 -- 172.21.15.149:0/3842332577 wait complete. 2023-11-08T19:24:20.521 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-08T19:24:20.522 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:24:20.651 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.648+0000 7f460dd0f700 1 Processor -- start 2023-11-08T19:24:20.651 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.648+0000 7f460dd0f700 1 -- start start 2023-11-08T19:24:20.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.649+0000 7f460dd0f700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f46080cb300 0x7f460815d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:20.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.649+0000 7f460dd0f700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46080b2f60 con 0x7f46080cc140 2023-11-08T19:24:20.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.649+0000 7f460dd0f700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46080cc520 con 0x7f46080cc910 2023-11-08T19:24:20.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.649+0000 7f460dd0f700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46080b2430 con 0x7f46080cb300 2023-11-08T19:24:20.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.649+0000 7f46077fe700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f46080cc140 0x7f46080b2850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:41316/0 (socket says 172.21.15.149:41316) 2023-11-08T19:24:20.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.649+0000 7f46077fe700 1 -- 172.21.15.149:0/3733503459 learned_addr learned my addr 172.21.15.149:0/3733503459 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:24:20.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.650+0000 7f4607fff700 1 --2- 172.21.15.149:0/3733503459 >> v2:172.21.15.160:3300/0 conn(0x7f46080cb300 0x7f460815d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:20.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.650+0000 7f46067fc700 1 -- 172.21.15.149:0/3733503459 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4239583534 0 0) 0x7f46080b2f60 con 0x7f46080cc140 2023-11-08T19:24:20.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.650+0000 7f46067fc700 1 -- 172.21.15.149:0/3733503459 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45f00035b0 con 0x7f46080cc140 2023-11-08T19:24:20.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.650+0000 7f46067fc700 1 -- 172.21.15.149:0/3733503459 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3373617478 0 0) 0x7f45f00035b0 con 0x7f46080cc140 2023-11-08T19:24:20.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.650+0000 7f4607fff700 1 -- 172.21.15.149:0/3733503459 >> v1:172.21.15.160:6789/0 conn(0x7f46080cc910 legacy=0x7f46080cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:20.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.650+0000 7f4607fff700 1 -- 172.21.15.149:0/3733503459 >> v1:172.21.15.149:6789/0 conn(0x7f46080cc140 legacy=0x7f46080b2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:20.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.650+0000 7f4607fff700 1 -- 172.21.15.149:0/3733503459 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46080b17b0 con 0x7f46080cb300 2023-11-08T19:24:20.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.650+0000 7f4607fff700 1 --2- 172.21.15.149:0/3733503459 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f46080cb300 0x7f460815d2b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4600009d90 tx=0x7f460000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78b4151c8add73cb server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:20.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.650+0000 7f46067fc700 1 -- 172.21.15.149:0/3733503459 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460000e070 con 0x7f46080cb300 2023-11-08T19:24:20.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.650+0000 7f46067fc700 1 -- 172.21.15.149:0/3733503459 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4600003a20 con 0x7f46080cb300 2023-11-08T19:24:20.657 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.650+0000 7f46067fc700 1 -- 172.21.15.149:0/3733503459 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45fc0017f0 con 0x7f46080cb300 2023-11-08T19:24:20.657 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.651+0000 7f460dd0f700 1 -- 172.21.15.149:0/3733503459 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f46080cb300 msgr2=0x7f460815d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:20.657 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.651+0000 7f460dd0f700 1 --2- 172.21.15.149:0/3733503459 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f46080cb300 0x7f460815d2b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4600009d90 tx=0x7f460000b330 comp rx=0 tx=0).stop 2023-11-08T19:24:20.657 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.651+0000 7f460dd0f700 1 -- 172.21.15.149:0/3733503459 shutdown_connections 2023-11-08T19:24:20.657 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.651+0000 7f460dd0f700 1 --2- 172.21.15.149:0/3733503459 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f46080cb300 0x7f460815d2b0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:20.658 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.651+0000 7f460dd0f700 1 -- 172.21.15.149:0/3733503459 >> 172.21.15.149:0/3733503459 conn(0x7f4608099a40 msgr2=0x7f46080d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:20.658 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.651+0000 7f460dd0f700 1 -- 172.21.15.149:0/3733503459 shutdown_connections 2023-11-08T19:24:20.658 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.651+0000 7f460dd0f700 1 -- 172.21.15.149:0/3733503459 wait complete. 2023-11-08T19:24:20.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.652+0000 7f460dd0f700 1 Processor -- start 2023-11-08T19:24:20.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.652+0000 7f460dd0f700 1 -- start start 2023-11-08T19:24:20.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.653+0000 7f460dd0f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f46080cb300 0x7f46080ae260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:20.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.653+0000 7f460dd0f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46080cc140 0x7f46080c6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:20.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.653+0000 7f460dd0f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f46080cc910 0x7f46080c4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:20.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.653+0000 7f460dd0f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46080c73b0 con 0x7f46080cc140 2023-11-08T19:24:20.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.653+0000 7f460dd0f700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46080ae940 con 0x7f46080cb300 2023-11-08T19:24:20.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.653+0000 7f460dd0f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46080aec20 con 0x7f46080cc910 2023-11-08T19:24:20.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.653+0000 7f4606ffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46080cc140 0x7f46080c6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:20.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.653+0000 7f4606ffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46080cc140 0x7f46080c6e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39322/0 (socket says 172.21.15.149:39322) 2023-11-08T19:24:20.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.653+0000 7f4606ffd700 1 -- 172.21.15.149:0/1545943835 learned_addr learned my addr 172.21.15.149:0/1545943835 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:20.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.653+0000 7f46077fe700 1 --2- 172.21.15.149:0/1545943835 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f46080cb300 0x7f46080ae260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:20.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.653+0000 7f4607fff700 1 --2- 172.21.15.149:0/1545943835 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f46080cc910 0x7f46080c4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:20.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.654+0000 7f4606ffd700 1 -- 172.21.15.149:0/1545943835 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f46080cc910 msgr2=0x7f46080c4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:20.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.654+0000 7f4606ffd700 1 --2- 172.21.15.149:0/1545943835 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f46080cc910 0x7f46080c4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:20.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.654+0000 7f4606ffd700 1 -- 172.21.15.149:0/1545943835 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f46080cb300 msgr2=0x7f46080ae260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:20.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.654+0000 7f4606ffd700 1 --2- 172.21.15.149:0/1545943835 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f46080cb300 0x7f46080ae260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:20.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.654+0000 7f4606ffd700 1 -- 172.21.15.149:0/1545943835 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4600009a70 con 0x7f46080cc140 2023-11-08T19:24:20.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.654+0000 7f4606ffd700 1 --2- 172.21.15.149:0/1545943835 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46080cc140 0x7f46080c6e70 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f45f800c420 tx=0x7f45f800c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:20.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.654+0000 7f45effff700 1 -- 172.21.15.149:0/1545943835 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f80052d0 con 0x7f46080cc140 2023-11-08T19:24:20.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.654+0000 7f460dd0f700 1 -- 172.21.15.149:0/1545943835 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46080aef00 con 0x7f46080cc140 2023-11-08T19:24:20.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.654+0000 7f45effff700 1 -- 172.21.15.149:0/1545943835 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45f8005430 con 0x7f46080cc140 2023-11-08T19:24:20.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.654+0000 7f45effff700 1 -- 172.21.15.149:0/1545943835 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f80038c0 con 0x7f46080cc140 2023-11-08T19:24:20.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.654+0000 7f460dd0f700 1 -- 172.21.15.149:0/1545943835 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46080af4c0 con 0x7f46080cc140 2023-11-08T19:24:20.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.655+0000 7f460dd0f700 1 -- 172.21.15.149:0/1545943835 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46080745f0 con 0x7f46080cc140 2023-11-08T19:24:20.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.655+0000 7f45effff700 1 -- 172.21.15.149:0/1545943835 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f45f8003a20 con 0x7f46080cc140 2023-11-08T19:24:20.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.656+0000 7f45effff700 1 --2- 172.21.15.149:0/1545943835 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f45f406af00 0x7f45f406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:20.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.656+0000 7f45effff700 1 -- 172.21.15.149:0/1545943835 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f45f8088ad0 con 0x7f46080cc140 2023-11-08T19:24:20.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.656+0000 7f46077fe700 1 --2- 172.21.15.149:0/1545943835 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f45f406af00 0x7f45f406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:20.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.656+0000 7f46077fe700 1 --2- 172.21.15.149:0/1545943835 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f45f406af00 0x7f45f406d3c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f45fc000ef0 tx=0x7f45fc0012f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:20.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.661+0000 7f45effff700 1 -- 172.21.15.149:0/1545943835 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f45f80539c0 con 0x7f46080cc140 2023-11-08T19:24:20.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.891+0000 7f460dd0f700 1 -- 172.21.15.149:0/1545943835 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f46080cf640 con 0x7f46080cc140 2023-11-08T19:24:20.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.892+0000 7f45effff700 1 -- 172.21.15.149:0/1545943835 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4922 (secure 0 0 0) 0x7f45f8056fe0 con 0x7f46080cc140 2023-11-08T19:24:20.895 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:24:20.895 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4877,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/3602590195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3602590195},{"type":"v1","addr":"172.21.15.160:6834","nonce":3602590195}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5107,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/1432406788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":1432406788},{"type":"v1","addr":"172.21.15.160:6835","nonce":1432406788}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5125,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/3066975859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3066975859},{"type":"v1","addr":"172.21.15.149:6837","nonce":3066975859}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-08T19:24:16.502193+0000","modified":"2023-11-08T19:24:19.886052+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5259":{"gid":5259,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.149:6836/746083826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":746083826},{"type":"v1","addr":"172.21.15.149:6836","nonce":746083826}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-08T19:24:20.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.894+0000 7f460dd0f700 1 -- 172.21.15.149:0/1545943835 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f45f406af00 msgr2=0x7f45f406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:20.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.894+0000 7f460dd0f700 1 --2- 172.21.15.149:0/1545943835 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f45f406af00 0x7f45f406d3c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f45fc000ef0 tx=0x7f45fc0012f0 comp rx=0 tx=0).stop 2023-11-08T19:24:20.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.894+0000 7f460dd0f700 1 -- 172.21.15.149:0/1545943835 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46080cc140 msgr2=0x7f46080c6e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:20.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.894+0000 7f460dd0f700 1 --2- 172.21.15.149:0/1545943835 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46080cc140 0x7f46080c6e70 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f45f800c420 tx=0x7f45f800c730 comp rx=0 tx=0).stop 2023-11-08T19:24:20.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.894+0000 7f460dd0f700 1 -- 172.21.15.149:0/1545943835 shutdown_connections 2023-11-08T19:24:20.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.894+0000 7f460dd0f700 1 --2- 172.21.15.149:0/1545943835 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f45f406af00 0x7f45f406d3c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:20.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.895+0000 7f460dd0f700 1 --2- 172.21.15.149:0/1545943835 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f46080cb300 0x7f46080ae260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:20.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.895+0000 7f460dd0f700 1 --2- 172.21.15.149:0/1545943835 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f46080cc910 0x7f46080c4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:20.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.895+0000 7f460dd0f700 1 --2- 172.21.15.149:0/1545943835 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46080cc140 0x7f46080c6e70 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:20.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.895+0000 7f460dd0f700 1 -- 172.21.15.149:0/1545943835 >> 172.21.15.149:0/1545943835 conn(0x7f4608099a40 msgr2=0x7f460806ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:20.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.895+0000 7f460dd0f700 1 -- 172.21.15.149:0/1545943835 shutdown_connections 2023-11-08T19:24:20.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:20.895+0000 7f460dd0f700 1 -- 172.21.15.149:0/1545943835 wait complete. 2023-11-08T19:24:20.900 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 17 2023-11-08T19:24:20.909 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:24:21.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.028+0000 7f11787f7700 1 Processor -- start 2023-11-08T19:24:21.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.028+0000 7f11787f7700 1 -- start start 2023-11-08T19:24:21.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.029+0000 7f11787f7700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f11700cc140 0x7f11700cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:21.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.029+0000 7f11787f7700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f11700b2850 0x7f11700cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:21.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.029+0000 7f11787f7700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11700cce50 con 0x7f11700b2cd0 2023-11-08T19:24:21.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.029+0000 7f11787f7700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11700b2430 con 0x7f11700cc140 2023-11-08T19:24:21.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.029+0000 7f11787f7700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11700cc520 con 0x7f11700b2850 2023-11-08T19:24:21.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.029+0000 7f1176593700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f11700cc140 0x7f11700cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:21.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.029+0000 7f1176d94700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f11700b2cd0 0x7f117015d2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:41334/0 (socket says 172.21.15.149:41334) 2023-11-08T19:24:21.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.029+0000 7f1176d94700 1 -- 172.21.15.149:0/3039978087 learned_addr learned my addr 172.21.15.149:0/3039978087 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:24:21.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.029+0000 7f1175d92700 1 --2- 172.21.15.149:0/3039978087 >> v2:172.21.15.160:3300/0 conn(0x7f11700b2850 0x7f11700cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:21.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.029+0000 7f1176593700 1 -- 172.21.15.149:0/3039978087 >> v2:172.21.15.160:3300/0 conn(0x7f11700b2850 msgr2=0x7f11700cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:21.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.029+0000 7f1176593700 1 --2- 172.21.15.149:0/3039978087 >> v2:172.21.15.160:3300/0 conn(0x7f11700b2850 0x7f11700cabf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:21.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.029+0000 7f1176593700 1 -- 172.21.15.149:0/3039978087 >> v1:172.21.15.149:6789/0 conn(0x7f11700b2cd0 legacy=0x7f117015d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:21.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.029+0000 7f1176593700 1 -- 172.21.15.149:0/3039978087 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11700b17b0 con 0x7f11700cc140 2023-11-08T19:24:21.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.029+0000 7f1175591700 1 -- 172.21.15.149:0/3039978087 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3326934985 0 0) 0x7f11700cce50 con 0x7f11700b2cd0 2023-11-08T19:24:21.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.030+0000 7f1176593700 1 --2- 172.21.15.149:0/3039978087 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11700cc140 0x7f11700cc910 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f11700b1330 tx=0x7f1160009b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b795cceb392c8814 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:21.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.030+0000 7f1175591700 1 -- 172.21.15.149:0/3039978087 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1160005e30 con 0x7f11700cc140 2023-11-08T19:24:21.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.030+0000 7f1175591700 1 -- 172.21.15.149:0/3039978087 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1160006030 con 0x7f11700cc140 2023-11-08T19:24:21.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.030+0000 7f1175591700 1 -- 172.21.15.149:0/3039978087 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11600063c0 con 0x7f11700cc140 2023-11-08T19:24:21.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.030+0000 7f11787f7700 1 -- 172.21.15.149:0/3039978087 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11700cc140 msgr2=0x7f11700cc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:21.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.030+0000 7f11787f7700 1 --2- 172.21.15.149:0/3039978087 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11700cc140 0x7f11700cc910 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f11700b1330 tx=0x7f1160009b00 comp rx=0 tx=0).stop 2023-11-08T19:24:21.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.030+0000 7f11787f7700 1 -- 172.21.15.149:0/3039978087 shutdown_connections 2023-11-08T19:24:21.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.030+0000 7f11787f7700 1 --2- 172.21.15.149:0/3039978087 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11700cc140 0x7f11700cc910 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:21.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.030+0000 7f11787f7700 1 --2- 172.21.15.149:0/3039978087 >> v2:172.21.15.160:3300/0 conn(0x7f11700b2850 0x7f11700cabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:21.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.030+0000 7f11787f7700 1 -- 172.21.15.149:0/3039978087 >> 172.21.15.149:0/3039978087 conn(0x7f1170099a40 msgr2=0x7f11700d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:21.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.030+0000 7f11787f7700 1 -- 172.21.15.149:0/3039978087 shutdown_connections 2023-11-08T19:24:21.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.030+0000 7f11787f7700 1 -- 172.21.15.149:0/3039978087 wait complete. 2023-11-08T19:24:21.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.031+0000 7f11787f7700 1 Processor -- start 2023-11-08T19:24:21.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.032+0000 7f11787f7700 1 -- start start 2023-11-08T19:24:21.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.032+0000 7f11787f7700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11700b2850 0x7f117015dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:21.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.032+0000 7f11787f7700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f11700b2cd0 0x7f11700af810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:21.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.032+0000 7f11787f7700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f11700cc140 0x7f117009b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:21.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.032+0000 7f11787f7700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11700ad1c0 con 0x7f11700b2850 2023-11-08T19:24:21.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.032+0000 7f11787f7700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11700ada40 con 0x7f11700b2cd0 2023-11-08T19:24:21.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.032+0000 7f11787f7700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11700b0060 con 0x7f11700cc140 2023-11-08T19:24:21.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.032+0000 7f1176593700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11700b2850 0x7f117015dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:21.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.032+0000 7f1176593700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11700b2850 0x7f117015dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39334/0 (socket says 172.21.15.149:39334) 2023-11-08T19:24:21.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.032+0000 7f1176593700 1 -- 172.21.15.149:0/1201293589 learned_addr learned my addr 172.21.15.149:0/1201293589 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:21.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.032+0000 7f1175d92700 1 --2- 172.21.15.149:0/1201293589 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f11700b2cd0 0x7f11700af810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:21.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.032+0000 7f1176d94700 1 --2- 172.21.15.149:0/1201293589 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f11700cc140 0x7f117009b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:21.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.033+0000 7f1176593700 1 -- 172.21.15.149:0/1201293589 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f11700cc140 msgr2=0x7f117009b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:21.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.033+0000 7f1176593700 1 --2- 172.21.15.149:0/1201293589 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f11700cc140 0x7f117009b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:21.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.033+0000 7f1176593700 1 -- 172.21.15.149:0/1201293589 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f11700b2cd0 msgr2=0x7f11700af810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:21.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.033+0000 7f1176593700 1 --2- 172.21.15.149:0/1201293589 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f11700b2cd0 0x7f11700af810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:21.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.033+0000 7f1176593700 1 -- 172.21.15.149:0/1201293589 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1160009430 con 0x7f11700b2850 2023-11-08T19:24:21.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.033+0000 7f1176593700 1 --2- 172.21.15.149:0/1201293589 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11700b2850 0x7f117015dfc0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f1160009b40 tx=0x7f1160004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:21.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.033+0000 7f1166ffd700 1 -- 172.21.15.149:0/1201293589 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11600068f0 con 0x7f11700b2850 2023-11-08T19:24:21.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.033+0000 7f1166ffd700 1 -- 172.21.15.149:0/1201293589 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1160020070 con 0x7f11700b2850 2023-11-08T19:24:21.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.033+0000 7f11787f7700 1 -- 172.21.15.149:0/1201293589 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11700ad3f0 con 0x7f11700b2850 2023-11-08T19:24:21.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.033+0000 7f1166ffd700 1 -- 172.21.15.149:0/1201293589 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1160004280 con 0x7f11700b2850 2023-11-08T19:24:21.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.033+0000 7f11787f7700 1 -- 172.21.15.149:0/1201293589 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11700afd50 con 0x7f11700b2850 2023-11-08T19:24:21.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.034+0000 7f11787f7700 1 -- 172.21.15.149:0/1201293589 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11700745f0 con 0x7f11700b2850 2023-11-08T19:24:21.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.035+0000 7f1166ffd700 1 -- 172.21.15.149:0/1201293589 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1160022030 con 0x7f11700b2850 2023-11-08T19:24:21.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.035+0000 7f1166ffd700 1 --2- 172.21.15.149:0/1201293589 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f115406af00 0x7f115406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:21.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.035+0000 7f1166ffd700 1 -- 172.21.15.149:0/1201293589 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f116008acf0 con 0x7f11700b2850 2023-11-08T19:24:21.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.035+0000 7f1175d92700 1 --2- 172.21.15.149:0/1201293589 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f115406af00 0x7f115406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:21.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.035+0000 7f1175d92700 1 --2- 172.21.15.149:0/1201293589 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f115406af00 0x7f115406d3c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f116c00ab60 tx=0x7f116c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:21.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.040+0000 7f1166ffd700 1 -- 172.21.15.149:0/1201293589 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f116008f070 con 0x7f11700b2850 2023-11-08T19:24:21.236 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.234+0000 7f11787f7700 1 -- 172.21.15.149:0/1201293589 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f11700d0730 con 0x7f11700b2850 2023-11-08T19:24:21.237 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.235+0000 7f1166ffd700 1 -- 172.21.15.149:0/1201293589 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16810 (secure 0 0 0) 0x7f1160055cf0 con 0x7f11700b2850 2023-11-08T19:24:21.238 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:24:21.238 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":39,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:24:18.102391+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-08T19:24:14.467859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-08T19:24:15.470328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:24:21.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.238+0000 7f11787f7700 1 -- 172.21.15.149:0/1201293589 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f115406af00 msgr2=0x7f115406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:21.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.238+0000 7f11787f7700 1 --2- 172.21.15.149:0/1201293589 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f115406af00 0x7f115406d3c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f116c00ab60 tx=0x7f116c008040 comp rx=0 tx=0).stop 2023-11-08T19:24:21.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.238+0000 7f11787f7700 1 -- 172.21.15.149:0/1201293589 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11700b2850 msgr2=0x7f117015dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:21.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.238+0000 7f11787f7700 1 --2- 172.21.15.149:0/1201293589 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11700b2850 0x7f117015dfc0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f1160009b40 tx=0x7f1160004750 comp rx=0 tx=0).stop 2023-11-08T19:24:21.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.238+0000 7f11787f7700 1 -- 172.21.15.149:0/1201293589 shutdown_connections 2023-11-08T19:24:21.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.238+0000 7f11787f7700 1 --2- 172.21.15.149:0/1201293589 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f115406af00 0x7f115406d3c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:21.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.238+0000 7f11787f7700 1 --2- 172.21.15.149:0/1201293589 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f11700cc140 0x7f117009b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:21.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.238+0000 7f11787f7700 1 --2- 172.21.15.149:0/1201293589 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11700b2850 0x7f117015dfc0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:21.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.238+0000 7f11787f7700 1 --2- 172.21.15.149:0/1201293589 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f11700b2cd0 0x7f11700af810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:21.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.238+0000 7f11787f7700 1 -- 172.21.15.149:0/1201293589 >> 172.21.15.149:0/1201293589 conn(0x7f1170099a40 msgr2=0x7f11700d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:21.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.238+0000 7f11787f7700 1 -- 172.21.15.149:0/1201293589 shutdown_connections 2023-11-08T19:24:21.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.238+0000 7f11787f7700 1 -- 172.21.15.149:0/1201293589 wait complete. 2023-11-08T19:24:21.253 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-08T19:24:21.253 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:24:21.375 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.373+0000 7fb51e14d700 1 Processor -- start 2023-11-08T19:24:21.376 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.373+0000 7fb51e14d700 1 -- start start 2023-11-08T19:24:21.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.374+0000 7fb51e14d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb5180cc140 0x7fb5180cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:21.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.374+0000 7fb51e14d700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fb5180b2cd0 0x7fb51815d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:21.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.374+0000 7fb51e14d700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5180cce50 con 0x7fb5180b2850 2023-11-08T19:24:21.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.374+0000 7fb51e14d700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5180b2430 con 0x7fb5180cc140 2023-11-08T19:24:21.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.374+0000 7fb51e14d700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5180cc520 con 0x7fb5180b2cd0 2023-11-08T19:24:21.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.374+0000 7fb5177fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb5180cc140 0x7fb5180cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:21.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.374+0000 7fb5177fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb5180cc140 0x7fb5180cc910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39342/0 (socket says 172.21.15.149:39342) 2023-11-08T19:24:21.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.374+0000 7fb5177fe700 1 -- 172.21.15.149:0/1298766162 learned_addr learned my addr 172.21.15.149:0/1298766162 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:21.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.374+0000 7fb517fff700 1 --2- 172.21.15.149:0/1298766162 >> v2:172.21.15.160:3300/0 conn(0x7fb5180b2cd0 0x7fb51815d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:21.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.374+0000 7fb5177fe700 1 -- 172.21.15.149:0/1298766162 >> v2:172.21.15.160:3300/0 conn(0x7fb5180b2cd0 msgr2=0x7fb51815d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:21.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.374+0000 7fb5177fe700 1 --2- 172.21.15.149:0/1298766162 >> v2:172.21.15.160:3300/0 conn(0x7fb5180b2cd0 0x7fb51815d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:21.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.374+0000 7fb5177fe700 1 -- 172.21.15.149:0/1298766162 >> v1:172.21.15.160:6789/0 conn(0x7fb5180b2850 legacy=0x7fb5180cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:21.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.374+0000 7fb5177fe700 1 -- 172.21.15.149:0/1298766162 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5180b17b0 con 0x7fb5180cc140 2023-11-08T19:24:21.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.374+0000 7fb517fff700 1 --2- 172.21.15.149:0/1298766162 >> v2:172.21.15.160:3300/0 conn(0x7fb5180b2cd0 0x7fb51815d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:24:21.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.375+0000 7fb5177fe700 1 --2- 172.21.15.149:0/1298766162 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb5180cc140 0x7fb5180cc910 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fb5180c7600 tx=0x7fb50c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=460ec9ff51a52f2b server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:21.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.375+0000 7fb5167fc700 1 -- 172.21.15.149:0/1298766162 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50c005e30 con 0x7fb5180cc140 2023-11-08T19:24:21.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.375+0000 7fb5167fc700 1 -- 172.21.15.149:0/1298766162 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb50c004030 con 0x7fb5180cc140 2023-11-08T19:24:21.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.375+0000 7fb5167fc700 1 -- 172.21.15.149:0/1298766162 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50c0043e0 con 0x7fb5180cc140 2023-11-08T19:24:21.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.375+0000 7fb51e14d700 1 -- 172.21.15.149:0/1298766162 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb5180cc140 msgr2=0x7fb5180cc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:21.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.375+0000 7fb51e14d700 1 --2- 172.21.15.149:0/1298766162 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb5180cc140 0x7fb5180cc910 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fb5180c7600 tx=0x7fb50c009bd0 comp rx=0 tx=0).stop 2023-11-08T19:24:21.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.375+0000 7fb51e14d700 1 -- 172.21.15.149:0/1298766162 shutdown_connections 2023-11-08T19:24:21.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.375+0000 7fb51e14d700 1 --2- 172.21.15.149:0/1298766162 >> v2:172.21.15.160:3300/0 conn(0x7fb5180b2cd0 0x7fb51815d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:21.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.375+0000 7fb51e14d700 1 --2- 172.21.15.149:0/1298766162 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb5180cc140 0x7fb5180cc910 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:21.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.375+0000 7fb51e14d700 1 -- 172.21.15.149:0/1298766162 >> 172.21.15.149:0/1298766162 conn(0x7fb518099a40 msgr2=0x7fb5180d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:21.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.375+0000 7fb51e14d700 1 -- 172.21.15.149:0/1298766162 shutdown_connections 2023-11-08T19:24:21.387 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.375+0000 7fb51e14d700 1 -- 172.21.15.149:0/1298766162 wait complete. 2023-11-08T19:24:21.387 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.376+0000 7fb51e14d700 1 Processor -- start 2023-11-08T19:24:21.387 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.377+0000 7fb51e14d700 1 -- start start 2023-11-08T19:24:21.387 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.377+0000 7fb51e14d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb5180b2850 0x7fb51814e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:21.387 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.377+0000 7fb51e14d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb5180b2cd0 0x7fb5180c7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:21.388 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.377+0000 7fb51e14d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb5180cc140 0x7fb51815c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:21.388 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.377+0000 7fb51e14d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb51814e5c0 con 0x7fb5180b2850 2023-11-08T19:24:21.388 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.377+0000 7fb51e14d700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb51814b9c0 con 0x7fb5180b2cd0 2023-11-08T19:24:21.388 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.377+0000 7fb51e14d700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb51814bca0 con 0x7fb5180cc140 2023-11-08T19:24:21.389 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.378+0000 7fb5177fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb5180b2850 0x7fb51814e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:21.389 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.378+0000 7fb5177fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb5180b2850 0x7fb51814e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39348/0 (socket says 172.21.15.149:39348) 2023-11-08T19:24:21.389 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.378+0000 7fb5177fe700 1 -- 172.21.15.149:0/1632913901 learned_addr learned my addr 172.21.15.149:0/1632913901 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:21.389 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.378+0000 7fb517fff700 1 --2- 172.21.15.149:0/1632913901 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb5180cc140 0x7fb51815c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:21.390 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.378+0000 7fb516ffd700 1 --2- 172.21.15.149:0/1632913901 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb5180b2cd0 0x7fb5180c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:21.390 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.378+0000 7fb5177fe700 1 -- 172.21.15.149:0/1632913901 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb5180cc140 msgr2=0x7fb51815c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:21.390 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.378+0000 7fb5177fe700 1 --2- 172.21.15.149:0/1632913901 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb5180cc140 0x7fb51815c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:21.390 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.378+0000 7fb5177fe700 1 -- 172.21.15.149:0/1632913901 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb5180b2cd0 msgr2=0x7fb5180c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:21.390 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.378+0000 7fb5177fe700 1 --2- 172.21.15.149:0/1632913901 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb5180b2cd0 0x7fb5180c7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:21.391 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.378+0000 7fb5177fe700 1 -- 172.21.15.149:0/1632913901 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb50c009500 con 0x7fb5180b2850 2023-11-08T19:24:21.391 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.378+0000 7fb517fff700 1 --2- 172.21.15.149:0/1632913901 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb5180cc140 0x7fb51815c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:24:21.391 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.378+0000 7fb5177fe700 1 --2- 172.21.15.149:0/1632913901 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb5180b2850 0x7fb51814e080 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fb50c009c10 tx=0x7fb50c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:21.391 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.378+0000 7fb4fffff700 1 -- 172.21.15.149:0/1632913901 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50c003e10 con 0x7fb5180b2850 2023-11-08T19:24:21.392 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.378+0000 7fb4fffff700 1 -- 172.21.15.149:0/1632913901 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb50c01d430 con 0x7fb5180b2850 2023-11-08T19:24:21.392 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.378+0000 7fb51e14d700 1 -- 172.21.15.149:0/1632913901 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb51814bf80 con 0x7fb5180b2850 2023-11-08T19:24:21.392 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.379+0000 7fb4fffff700 1 -- 172.21.15.149:0/1632913901 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50c01d7e0 con 0x7fb5180b2850 2023-11-08T19:24:21.392 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.379+0000 7fb51e14d700 1 -- 172.21.15.149:0/1632913901 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb51814c540 con 0x7fb5180b2850 2023-11-08T19:24:21.393 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.380+0000 7fb51e14d700 1 -- 172.21.15.149:0/1632913901 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5180745f0 con 0x7fb5180b2850 2023-11-08T19:24:21.394 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.380+0000 7fb4fffff700 1 -- 172.21.15.149:0/1632913901 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb50c01d940 con 0x7fb5180b2850 2023-11-08T19:24:21.394 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.380+0000 7fb4fffff700 1 --2- 172.21.15.149:0/1632913901 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb50406af00 0x7fb50406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:21.394 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.381+0000 7fb516ffd700 1 --2- 172.21.15.149:0/1632913901 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb50406af00 0x7fb50406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:21.394 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.381+0000 7fb4fffff700 1 -- 172.21.15.149:0/1632913901 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb50c08ac80 con 0x7fb5180b2850 2023-11-08T19:24:21.395 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.381+0000 7fb516ffd700 1 --2- 172.21.15.149:0/1632913901 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb50406af00 0x7fb50406d3c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb5180cbab0 tx=0x7fb508009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:21.395 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.385+0000 7fb4fffff700 1 -- 172.21.15.149:0/1632913901 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb50c055da0 con 0x7fb5180b2850 2023-11-08T19:24:21.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.572+0000 7fb51e14d700 1 -- 172.21.15.149:0/1632913901 --> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb5180b1d70 con 0x7fb50406af00 2023-11-08T19:24:21.581 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.580+0000 7fb4fffff700 1 -- 172.21.15.149:0/1632913901 <== mgr.4104 v2:172.21.15.149:6832/1929837472 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282604 (secure 0 0 0) 0x7fb5080050d0 con 0x7fb50406af00 2023-11-08T19:24:21.585 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:24:21.588 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.583+0000 7fb51e14d700 1 -- 172.21.15.149:0/1632913901 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb50406af00 msgr2=0x7fb50406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:21.588 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.583+0000 7fb51e14d700 1 --2- 172.21.15.149:0/1632913901 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb50406af00 0x7fb50406d3c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb5180cbab0 tx=0x7fb508009040 comp rx=0 tx=0).stop 2023-11-08T19:24:21.589 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.583+0000 7fb51e14d700 1 -- 172.21.15.149:0/1632913901 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb5180b2850 msgr2=0x7fb51814e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:21.589 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.583+0000 7fb51e14d700 1 --2- 172.21.15.149:0/1632913901 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb5180b2850 0x7fb51814e080 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fb50c009c10 tx=0x7fb50c004750 comp rx=0 tx=0).stop 2023-11-08T19:24:21.589 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.583+0000 7fb51e14d700 1 -- 172.21.15.149:0/1632913901 shutdown_connections 2023-11-08T19:24:21.589 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.583+0000 7fb51e14d700 1 --2- 172.21.15.149:0/1632913901 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb50406af00 0x7fb50406d3c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:21.589 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.583+0000 7fb51e14d700 1 --2- 172.21.15.149:0/1632913901 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb5180cc140 0x7fb51815c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:21.590 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.583+0000 7fb51e14d700 1 --2- 172.21.15.149:0/1632913901 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb5180b2850 0x7fb51814e080 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:21.590 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.583+0000 7fb51e14d700 1 --2- 172.21.15.149:0/1632913901 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb5180b2cd0 0x7fb5180c7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:21.590 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.583+0000 7fb51e14d700 1 -- 172.21.15.149:0/1632913901 >> 172.21.15.149:0/1632913901 conn(0x7fb518099a40 msgr2=0x7fb51806f750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:21.590 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.583+0000 7fb51e14d700 1 -- 172.21.15.149:0/1632913901 shutdown_connections 2023-11-08T19:24:21.591 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.583+0000 7fb51e14d700 1 -- 172.21.15.149:0/1632913901 wait complete. 2023-11-08T19:24:21.591 INFO:teuthology.orchestra.run.smithi149.stderr:dumped all 2023-11-08T19:24:21.598 INFO:teuthology.orchestra.run.smithi149.stdout:{"pg_ready":true,"pg_map":{"version":74,"stamp":"2023-11-08T19:24:20.002165+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":172,"acting":172,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220540,"kb_used_data":4380,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754180,"statfs":{"total":773094113280,"available":772868280320,"internally_reserved":0,"allocated":4485120,"data_stored":2565007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.903214"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.118577+0000","last_change":"2023-11-08T19:24:16.118577+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.118577+0000","last_undegraded":"2023-11-08T19:24:16.118577+0000","last_fullsized":"2023-11-08T19:24:16.118577+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.111933+0000","last_change":"2023-11-08T19:24:16.111933+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.111933+0000","last_undegraded":"2023-11-08T19:24:16.111933+0000","last_fullsized":"2023-11-08T19:24:16.111933+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.113940+0000","last_change":"2023-11-08T19:24:16.113940+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.113940+0000","last_undegraded":"2023-11-08T19:24:16.113940+0000","last_fullsized":"2023-11-08T19:24:16.113940+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.109530+0000","last_change":"2023-11-08T19:24:16.109530+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.109530+0000","last_undegraded":"2023-11-08T19:24:16.109530+0000","last_fullsized":"2023-11-08T19:24:16.109530+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.108591+0000","last_change":"2023-11-08T19:24:16.108591+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.108591+0000","last_undegraded":"2023-11-08T19:24:16.108591+0000","last_fullsized":"2023-11-08T19:24:16.108591+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.112894+0000","last_change":"2023-11-08T19:24:16.112894+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.112894+0000","last_undegraded":"2023-11-08T19:24:16.112894+0000","last_fullsized":"2023-11-08T19:24:16.112894+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:16.098411+0000","last_change":"2023-11-08T19:24:16.098411+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.098411+0000","last_undegraded":"2023-11-08T19:24:16.098411+0000","last_fullsized":"2023-11-08T19:24:16.098411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.111044+0000","last_change":"2023-11-08T19:24:16.111044+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.111044+0000","last_undegraded":"2023-11-08T19:24:16.111044+0000","last_fullsized":"2023-11-08T19:24:16.111044+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.109913+0000","last_change":"2023-11-08T19:24:16.109913+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.109913+0000","last_undegraded":"2023-11-08T19:24:16.109913+0000","last_fullsized":"2023-11-08T19:24:16.109913+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.111499+0000","last_change":"2023-11-08T19:24:16.111499+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.111499+0000","last_undegraded":"2023-11-08T19:24:16.111499+0000","last_fullsized":"2023-11-08T19:24:16.111499+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.111486+0000","last_change":"2023-11-08T19:24:16.111486+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.111486+0000","last_undegraded":"2023-11-08T19:24:16.111486+0000","last_fullsized":"2023-11-08T19:24:16.111486+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.111509+0000","last_change":"2023-11-08T19:24:16.111509+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.111509+0000","last_undegraded":"2023-11-08T19:24:16.111509+0000","last_fullsized":"2023-11-08T19:24:16.111509+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.112364+0000","last_change":"2023-11-08T19:24:16.112364+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.112364+0000","last_undegraded":"2023-11-08T19:24:16.112364+0000","last_fullsized":"2023-11-08T19:24:16.112364+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.104403+0000","last_change":"2023-11-08T19:24:16.104403+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.104403+0000","last_undegraded":"2023-11-08T19:24:16.104403+0000","last_fullsized":"2023-11-08T19:24:16.104403+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.111419+0000","last_change":"2023-11-08T19:24:16.111419+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.111419+0000","last_undegraded":"2023-11-08T19:24:16.111419+0000","last_fullsized":"2023-11-08T19:24:16.111419+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:16.098411+0000","last_change":"2023-11-08T19:24:16.098411+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.098411+0000","last_undegraded":"2023-11-08T19:24:16.098411+0000","last_fullsized":"2023-11-08T19:24:16.098411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:16.098411+0000","last_change":"2023-11-08T19:24:16.098411+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.098411+0000","last_undegraded":"2023-11-08T19:24:16.098411+0000","last_fullsized":"2023-11-08T19:24:16.098411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.105600+0000","last_change":"2023-11-08T19:24:16.105600+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.105600+0000","last_undegraded":"2023-11-08T19:24:16.105600+0000","last_fullsized":"2023-11-08T19:24:16.105600+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.108578+0000","last_change":"2023-11-08T19:24:16.108578+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.108578+0000","last_undegraded":"2023-11-08T19:24:16.108578+0000","last_fullsized":"2023-11-08T19:24:16.108578+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.105046+0000","last_change":"2023-11-08T19:24:16.105046+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.105046+0000","last_undegraded":"2023-11-08T19:24:16.105046+0000","last_fullsized":"2023-11-08T19:24:16.105046+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.111936+0000","last_change":"2023-11-08T19:24:16.111936+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.111936+0000","last_undegraded":"2023-11-08T19:24:16.111936+0000","last_fullsized":"2023-11-08T19:24:16.111936+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.105864+0000","last_change":"2023-11-08T19:24:16.105864+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.105864+0000","last_undegraded":"2023-11-08T19:24:16.105864+0000","last_fullsized":"2023-11-08T19:24:16.105864+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:16.098411+0000","last_change":"2023-11-08T19:24:16.098411+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.098411+0000","last_undegraded":"2023-11-08T19:24:16.098411+0000","last_fullsized":"2023-11-08T19:24:16.098411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.108583+0000","last_change":"2023-11-08T19:24:16.108583+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.108583+0000","last_undegraded":"2023-11-08T19:24:16.108583+0000","last_fullsized":"2023-11-08T19:24:16.108583+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.104642+0000","last_change":"2023-11-08T19:24:16.104642+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.104642+0000","last_undegraded":"2023-11-08T19:24:16.104642+0000","last_fullsized":"2023-11-08T19:24:16.104642+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.111443+0000","last_change":"2023-11-08T19:24:16.111443+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.111443+0000","last_undegraded":"2023-11-08T19:24:16.111443+0000","last_fullsized":"2023-11-08T19:24:16.111443+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.104157+0000","last_change":"2023-11-08T19:24:16.104157+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.104157+0000","last_undegraded":"2023-11-08T19:24:16.104157+0000","last_fullsized":"2023-11-08T19:24:16.104157+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.110920+0000","last_change":"2023-11-08T19:24:16.110920+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.110920+0000","last_undegraded":"2023-11-08T19:24:16.110920+0000","last_fullsized":"2023-11-08T19:24:16.110920+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.105829+0000","last_change":"2023-11-08T19:24:16.105829+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.105829+0000","last_undegraded":"2023-11-08T19:24:16.105829+0000","last_fullsized":"2023-11-08T19:24:16.105829+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.105116+0000","last_change":"2023-11-08T19:24:16.105116+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.105116+0000","last_undegraded":"2023-11-08T19:24:16.105116+0000","last_fullsized":"2023-11-08T19:24:16.105116+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:16.098411+0000","last_change":"2023-11-08T19:24:16.098411+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.098411+0000","last_undegraded":"2023-11-08T19:24:16.098411+0000","last_fullsized":"2023-11-08T19:24:16.098411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.113340+0000","last_change":"2023-11-08T19:24:16.113340+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.113340+0000","last_undegraded":"2023-11-08T19:24:16.113340+0000","last_fullsized":"2023-11-08T19:24:16.113340+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:16.098411+0000","last_change":"2023-11-08T19:24:16.098411+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.098411+0000","last_undegraded":"2023-11-08T19:24:16.098411+0000","last_fullsized":"2023-11-08T19:24:16.098411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":3,"reported_epoch":37,"state":"creating+activating","last_fresh":"2023-11-08T19:24:16.104218+0000","last_change":"2023-11-08T19:24:16.104218+0000","last_active":"2023-11-08T19:24:15.096674+0000","last_peered":"2023-11-08T19:24:15.096674+0000","last_clean":"2023-11-08T19:24:15.096674+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.104218+0000","last_undegraded":"2023-11-08T19:24:16.104218+0000","last_fullsized":"2023-11-08T19:24:16.104218+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:20:58.002466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":["6","4"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.114932+0000","last_change":"2023-11-08T19:24:16.114932+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.114932+0000","last_undegraded":"2023-11-08T19:24:16.114932+0000","last_fullsized":"2023-11-08T19:24:16.114932+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":3,"reported_epoch":37,"state":"creating+activating","last_fresh":"2023-11-08T19:24:16.110243+0000","last_change":"2023-11-08T19:24:16.110243+0000","last_active":"2023-11-08T19:24:15.096674+0000","last_peered":"2023-11-08T19:24:15.096674+0000","last_clean":"2023-11-08T19:24:15.096674+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.110243+0000","last_undegraded":"2023-11-08T19:24:16.110243+0000","last_fullsized":"2023-11-08T19:24:16.110243+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:11:30.828881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":["0","7"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.105329+0000","last_change":"2023-11-08T19:24:16.105329+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.105329+0000","last_undegraded":"2023-11-08T19:24:16.105329+0000","last_fullsized":"2023-11-08T19:24:16.105329+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-08T19:24:16.124256+0000","last_change":"2023-11-08T19:24:16.124256+0000","last_active":"2023-11-08T19:24:16.124256+0000","last_peered":"2023-11-08T19:24:16.124256+0000","last_clean":"2023-11-08T19:24:16.124256+0000","last_became_active":"2023-11-08T19:24:16.121912+0000","last_became_peered":"2023-11-08T19:24:16.121912+0000","last_unstale":"2023-11-08T19:24:16.124256+0000","last_undegraded":"2023-11-08T19:24:16.124256+0000","last_fullsized":"2023-11-08T19:24:16.124256+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:09:54.584065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.118036+0000","last_change":"2023-11-08T19:24:16.118036+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.118036+0000","last_undegraded":"2023-11-08T19:24:16.118036+0000","last_fullsized":"2023-11-08T19:24:16.118036+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":3,"reported_epoch":37,"state":"creating+activating","last_fresh":"2023-11-08T19:24:16.104592+0000","last_change":"2023-11-08T19:24:16.104592+0000","last_active":"2023-11-08T19:24:15.096674+0000","last_peered":"2023-11-08T19:24:15.096674+0000","last_clean":"2023-11-08T19:24:15.096674+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.104592+0000","last_undegraded":"2023-11-08T19:24:16.104592+0000","last_fullsized":"2023-11-08T19:24:16.104592+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:27:42.478804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":["4","3"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.112418+0000","last_change":"2023-11-08T19:24:16.112418+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.112418+0000","last_undegraded":"2023-11-08T19:24:16.112418+0000","last_fullsized":"2023-11-08T19:24:16.112418+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":3,"reported_epoch":37,"state":"creating+activating","last_fresh":"2023-11-08T19:24:16.108195+0000","last_change":"2023-11-08T19:24:16.108195+0000","last_active":"2023-11-08T19:24:15.096674+0000","last_peered":"2023-11-08T19:24:15.096674+0000","last_clean":"2023-11-08T19:24:15.096674+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.108195+0000","last_undegraded":"2023-11-08T19:24:16.108195+0000","last_fullsized":"2023-11-08T19:24:16.108195+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:11:30.828881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":["5","0"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.110575+0000","last_change":"2023-11-08T19:24:16.110575+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.110575+0000","last_undegraded":"2023-11-08T19:24:16.110575+0000","last_fullsized":"2023-11-08T19:24:16.110575+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-11-08T19:24:15.105771+0000","last_change":"2023-11-08T19:24:15.105771+0000","last_active":"2023-11-08T19:24:15.096674+0000","last_peered":"2023-11-08T19:24:15.096674+0000","last_clean":"2023-11-08T19:24:15.096674+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:15.105771+0000","last_undegraded":"2023-11-08T19:24:15.105771+0000","last_fullsized":"2023-11-08T19:24:15.105771+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.105388+0000","last_change":"2023-11-08T19:24:16.105388+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.105388+0000","last_undegraded":"2023-11-08T19:24:16.105388+0000","last_fullsized":"2023-11-08T19:24:16.105388+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-08T19:24:16.123153+0000","last_change":"2023-11-08T19:24:16.123153+0000","last_active":"2023-11-08T19:24:16.123153+0000","last_peered":"2023-11-08T19:24:16.123153+0000","last_clean":"2023-11-08T19:24:16.123153+0000","last_became_active":"2023-11-08T19:24:16.122837+0000","last_became_peered":"2023-11-08T19:24:16.122837+0000","last_unstale":"2023-11-08T19:24:16.123153+0000","last_undegraded":"2023-11-08T19:24:16.123153+0000","last_fullsized":"2023-11-08T19:24:16.123153+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:20:58.002466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.110672+0000","last_change":"2023-11-08T19:24:16.110672+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.110672+0000","last_undegraded":"2023-11-08T19:24:16.110672+0000","last_fullsized":"2023-11-08T19:24:16.110672+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-08T19:24:16.116788+0000","last_change":"2023-11-08T19:24:16.115097+0000","last_active":"2023-11-08T19:24:16.116788+0000","last_peered":"2023-11-08T19:24:16.116788+0000","last_clean":"2023-11-08T19:24:16.116788+0000","last_became_active":"2023-11-08T19:24:16.114776+0000","last_became_peered":"2023-11-08T19:24:16.114776+0000","last_unstale":"2023-11-08T19:24:16.116788+0000","last_undegraded":"2023-11-08T19:24:16.116788+0000","last_fullsized":"2023-11-08T19:24:16.116788+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:56:22.819911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.109118+0000","last_change":"2023-11-08T19:24:16.109118+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.109118+0000","last_undegraded":"2023-11-08T19:24:16.109118+0000","last_fullsized":"2023-11-08T19:24:16.109118+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":3,"reported_epoch":37,"state":"creating+activating","last_fresh":"2023-11-08T19:24:16.117622+0000","last_change":"2023-11-08T19:24:16.117622+0000","last_active":"2023-11-08T19:24:15.096674+0000","last_peered":"2023-11-08T19:24:15.096674+0000","last_clean":"2023-11-08T19:24:15.096674+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.117622+0000","last_undegraded":"2023-11-08T19:24:16.117622+0000","last_fullsized":"2023-11-08T19:24:16.117622+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:45:52.271444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:16.098411+0000","last_change":"2023-11-08T19:24:16.098411+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.098411+0000","last_undegraded":"2023-11-08T19:24:16.098411+0000","last_fullsized":"2023-11-08T19:24:16.098411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":3,"reported_epoch":37,"state":"creating+activating","last_fresh":"2023-11-08T19:24:16.109849+0000","last_change":"2023-11-08T19:24:16.109849+0000","last_active":"2023-11-08T19:24:15.096674+0000","last_peered":"2023-11-08T19:24:15.096674+0000","last_clean":"2023-11-08T19:24:15.096674+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.109849+0000","last_undegraded":"2023-11-08T19:24:16.109849+0000","last_fullsized":"2023-11-08T19:24:16.109849+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:09:02.617546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":["5","3"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.110635+0000","last_change":"2023-11-08T19:24:16.110635+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.110635+0000","last_undegraded":"2023-11-08T19:24:16.110635+0000","last_fullsized":"2023-11-08T19:24:16.110635+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":3,"reported_epoch":37,"state":"creating+activating","last_fresh":"2023-11-08T19:24:16.108353+0000","last_change":"2023-11-08T19:24:16.108353+0000","last_active":"2023-11-08T19:24:15.096674+0000","last_peered":"2023-11-08T19:24:15.096674+0000","last_clean":"2023-11-08T19:24:15.096674+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.108353+0000","last_undegraded":"2023-11-08T19:24:16.108353+0000","last_fullsized":"2023-11-08T19:24:16.108353+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:09:54.584065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":["5","1"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.105522+0000","last_change":"2023-11-08T19:24:16.105522+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.105522+0000","last_undegraded":"2023-11-08T19:24:16.105522+0000","last_fullsized":"2023-11-08T19:24:16.105522+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":3,"reported_epoch":37,"state":"creating+activating","last_fresh":"2023-11-08T19:24:16.118395+0000","last_change":"2023-11-08T19:24:16.118395+0000","last_active":"2023-11-08T19:24:15.096674+0000","last_peered":"2023-11-08T19:24:15.096674+0000","last_clean":"2023-11-08T19:24:15.096674+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.118395+0000","last_undegraded":"2023-11-08T19:24:16.118395+0000","last_fullsized":"2023-11-08T19:24:16.118395+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:21:06.998550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.113169+0000","last_change":"2023-11-08T19:24:16.113169+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.113169+0000","last_undegraded":"2023-11-08T19:24:16.113169+0000","last_fullsized":"2023-11-08T19:24:16.113169+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":4,"reported_epoch":37,"state":"creating+activating","last_fresh":"2023-11-08T19:24:16.119864+0000","last_change":"2023-11-08T19:24:16.111647+0000","last_active":"2023-11-08T19:24:15.096674+0000","last_peered":"2023-11-08T19:24:15.096674+0000","last_clean":"2023-11-08T19:24:15.096674+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.119864+0000","last_undegraded":"2023-11-08T19:24:16.119864+0000","last_fullsized":"2023-11-08T19:24:16.119864+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:09:02.617546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":["3","0"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.110978+0000","last_change":"2023-11-08T19:24:16.110978+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.110978+0000","last_undegraded":"2023-11-08T19:24:16.110978+0000","last_fullsized":"2023-11-08T19:24:16.110978+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-08T19:24:16.123874+0000","last_change":"2023-11-08T19:24:16.123874+0000","last_active":"2023-11-08T19:24:16.123874+0000","last_peered":"2023-11-08T19:24:16.123874+0000","last_clean":"2023-11-08T19:24:16.123874+0000","last_became_active":"2023-11-08T19:24:16.123508+0000","last_became_peered":"2023-11-08T19:24:16.123508+0000","last_unstale":"2023-11-08T19:24:16.123874+0000","last_undegraded":"2023-11-08T19:24:16.123874+0000","last_fullsized":"2023-11-08T19:24:16.123874+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:29:45.264000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:16.098411+0000","last_change":"2023-11-08T19:24:16.098411+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.098411+0000","last_undegraded":"2023-11-08T19:24:16.098411+0000","last_fullsized":"2023-11-08T19:24:16.098411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-08T19:24:16.109232+0000","last_change":"2023-11-08T19:24:16.109232+0000","last_active":"2023-11-08T19:24:16.109232+0000","last_peered":"2023-11-08T19:24:16.109232+0000","last_clean":"2023-11-08T19:24:16.109232+0000","last_became_active":"2023-11-08T19:24:16.108931+0000","last_became_peered":"2023-11-08T19:24:16.108931+0000","last_unstale":"2023-11-08T19:24:16.109232+0000","last_undegraded":"2023-11-08T19:24:16.109232+0000","last_fullsized":"2023-11-08T19:24:16.109232+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:11:30.828881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.118968+0000","last_change":"2023-11-08T19:24:16.118968+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.118968+0000","last_undegraded":"2023-11-08T19:24:16.118968+0000","last_fullsized":"2023-11-08T19:24:16.118968+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-11-08T19:24:15.105548+0000","last_change":"2023-11-08T19:24:15.105548+0000","last_active":"2023-11-08T19:24:15.096674+0000","last_peered":"2023-11-08T19:24:15.096674+0000","last_clean":"2023-11-08T19:24:15.096674+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:15.105548+0000","last_undegraded":"2023-11-08T19:24:15.105548+0000","last_fullsized":"2023-11-08T19:24:15.105548+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.118506+0000","last_change":"2023-11-08T19:24:16.118506+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.118506+0000","last_undegraded":"2023-11-08T19:24:16.118506+0000","last_fullsized":"2023-11-08T19:24:16.118506+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":3,"reported_epoch":37,"state":"creating+activating","last_fresh":"2023-11-08T19:24:16.108462+0000","last_change":"2023-11-08T19:24:16.108462+0000","last_active":"2023-11-08T19:24:15.096674+0000","last_peered":"2023-11-08T19:24:15.096674+0000","last_clean":"2023-11-08T19:24:15.096674+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.108462+0000","last_undegraded":"2023-11-08T19:24:16.108462+0000","last_fullsized":"2023-11-08T19:24:16.108462+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:11:10.911014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":["5","4"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.111051+0000","last_change":"2023-11-08T19:24:16.111051+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.111051+0000","last_undegraded":"2023-11-08T19:24:16.111051+0000","last_fullsized":"2023-11-08T19:24:16.111051+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-08T19:24:16.119926+0000","last_change":"2023-11-08T19:24:16.117967+0000","last_active":"2023-11-08T19:24:16.119926+0000","last_peered":"2023-11-08T19:24:16.119926+0000","last_clean":"2023-11-08T19:24:16.119926+0000","last_became_active":"2023-11-08T19:24:16.117675+0000","last_became_peered":"2023-11-08T19:24:16.117675+0000","last_unstale":"2023-11-08T19:24:16.119926+0000","last_undegraded":"2023-11-08T19:24:16.119926+0000","last_fullsized":"2023-11-08T19:24:16.119926+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:55:14.474408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.104722+0000","last_change":"2023-11-08T19:24:16.104722+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.104722+0000","last_undegraded":"2023-11-08T19:24:16.104722+0000","last_fullsized":"2023-11-08T19:24:16.104722+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":3,"reported_epoch":37,"state":"creating+activating","last_fresh":"2023-11-08T19:24:16.105728+0000","last_change":"2023-11-08T19:24:16.105728+0000","last_active":"2023-11-08T19:24:15.096674+0000","last_peered":"2023-11-08T19:24:15.096674+0000","last_clean":"2023-11-08T19:24:15.096674+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.105728+0000","last_undegraded":"2023-11-08T19:24:16.105728+0000","last_fullsized":"2023-11-08T19:24:16.105728+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:29:40.689965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":["2","7"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.108756+0000","last_change":"2023-11-08T19:24:16.108756+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.108756+0000","last_undegraded":"2023-11-08T19:24:16.108756+0000","last_fullsized":"2023-11-08T19:24:16.108756+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-08T19:24:16.124598+0000","last_change":"2023-11-08T19:24:16.120284+0000","last_active":"2023-11-08T19:24:16.124598+0000","last_peered":"2023-11-08T19:24:16.124598+0000","last_clean":"2023-11-08T19:24:16.124598+0000","last_became_active":"2023-11-08T19:24:16.119983+0000","last_became_peered":"2023-11-08T19:24:16.119983+0000","last_unstale":"2023-11-08T19:24:16.124598+0000","last_undegraded":"2023-11-08T19:24:16.124598+0000","last_fullsized":"2023-11-08T19:24:16.124598+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:11:30.828881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:16.098411+0000","last_change":"2023-11-08T19:24:16.098411+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.098411+0000","last_undegraded":"2023-11-08T19:24:16.098411+0000","last_fullsized":"2023-11-08T19:24:16.098411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":3,"reported_epoch":37,"state":"creating+activating","last_fresh":"2023-11-08T19:24:16.105274+0000","last_change":"2023-11-08T19:24:16.105274+0000","last_active":"2023-11-08T19:24:15.096674+0000","last_peered":"2023-11-08T19:24:15.096674+0000","last_clean":"2023-11-08T19:24:15.096674+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.105274+0000","last_undegraded":"2023-11-08T19:24:16.105274+0000","last_fullsized":"2023-11-08T19:24:16.105274+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:12:27.366563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.111075+0000","last_change":"2023-11-08T19:24:16.111075+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.111075+0000","last_undegraded":"2023-11-08T19:24:16.111075+0000","last_fullsized":"2023-11-08T19:24:16.111075+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":3,"reported_epoch":37,"state":"creating+activating","last_fresh":"2023-11-08T19:24:16.105285+0000","last_change":"2023-11-08T19:24:16.105285+0000","last_active":"2023-11-08T19:24:15.096674+0000","last_peered":"2023-11-08T19:24:15.096674+0000","last_clean":"2023-11-08T19:24:15.096674+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.105285+0000","last_undegraded":"2023-11-08T19:24:16.105285+0000","last_fullsized":"2023-11-08T19:24:16.105285+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:00:00.984858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":["2","4"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.110601+0000","last_change":"2023-11-08T19:24:16.110601+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.110601+0000","last_undegraded":"2023-11-08T19:24:16.110601+0000","last_fullsized":"2023-11-08T19:24:16.110601+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-11-08T19:24:15.105379+0000","last_change":"2023-11-08T19:24:15.105379+0000","last_active":"2023-11-08T19:24:15.096674+0000","last_peered":"2023-11-08T19:24:15.096674+0000","last_clean":"2023-11-08T19:24:15.096674+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:15.105379+0000","last_undegraded":"2023-11-08T19:24:15.105379+0000","last_fullsized":"2023-11-08T19:24:15.105379+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.118531+0000","last_change":"2023-11-08T19:24:16.118531+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.118531+0000","last_undegraded":"2023-11-08T19:24:16.118531+0000","last_fullsized":"2023-11-08T19:24:16.118531+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":3,"reported_epoch":37,"state":"creating+activating","last_fresh":"2023-11-08T19:24:16.106636+0000","last_change":"2023-11-08T19:24:16.106636+0000","last_active":"2023-11-08T19:24:15.096674+0000","last_peered":"2023-11-08T19:24:15.096674+0000","last_clean":"2023-11-08T19:24:15.096674+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.106636+0000","last_undegraded":"2023-11-08T19:24:16.106636+0000","last_fullsized":"2023-11-08T19:24:16.106636+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:21:28.704207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.112087+0000","last_change":"2023-11-08T19:24:16.112087+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.112087+0000","last_undegraded":"2023-11-08T19:24:16.112087+0000","last_fullsized":"2023-11-08T19:24:16.112087+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":3,"reported_epoch":37,"state":"creating+activating","last_fresh":"2023-11-08T19:24:16.108247+0000","last_change":"2023-11-08T19:24:16.108247+0000","last_active":"2023-11-08T19:24:15.096674+0000","last_peered":"2023-11-08T19:24:15.096674+0000","last_clean":"2023-11-08T19:24:15.096674+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.108247+0000","last_undegraded":"2023-11-08T19:24:16.108247+0000","last_fullsized":"2023-11-08T19:24:16.108247+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:29:45.264000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":["5","1"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:16.098411+0000","last_change":"2023-11-08T19:24:16.098411+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.098411+0000","last_undegraded":"2023-11-08T19:24:16.098411+0000","last_fullsized":"2023-11-08T19:24:16.098411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":3,"reported_epoch":37,"state":"creating+activating","last_fresh":"2023-11-08T19:24:16.105795+0000","last_change":"2023-11-08T19:24:16.105795+0000","last_active":"2023-11-08T19:24:15.096674+0000","last_peered":"2023-11-08T19:24:15.096674+0000","last_clean":"2023-11-08T19:24:15.096674+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.105795+0000","last_undegraded":"2023-11-08T19:24:16.105795+0000","last_fullsized":"2023-11-08T19:24:16.105795+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:57:50.625953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":["2","5"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.111509+0000","last_change":"2023-11-08T19:24:16.111509+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.111509+0000","last_undegraded":"2023-11-08T19:24:16.111509+0000","last_fullsized":"2023-11-08T19:24:16.111509+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":3,"reported_epoch":37,"state":"creating+activating","last_fresh":"2023-11-08T19:24:16.109823+0000","last_change":"2023-11-08T19:24:16.109823+0000","last_active":"2023-11-08T19:24:15.096674+0000","last_peered":"2023-11-08T19:24:15.096674+0000","last_clean":"2023-11-08T19:24:15.096674+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.109823+0000","last_undegraded":"2023-11-08T19:24:16.109823+0000","last_fullsized":"2023-11-08T19:24:16.109823+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:55:14.474408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.112822+0000","last_change":"2023-11-08T19:24:16.112822+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.112822+0000","last_undegraded":"2023-11-08T19:24:16.112822+0000","last_fullsized":"2023-11-08T19:24:16.112822+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":3,"reported_epoch":37,"state":"creating+activating","last_fresh":"2023-11-08T19:24:16.109981+0000","last_change":"2023-11-08T19:24:16.109981+0000","last_active":"2023-11-08T19:24:15.096674+0000","last_peered":"2023-11-08T19:24:15.096674+0000","last_clean":"2023-11-08T19:24:15.096674+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.109981+0000","last_undegraded":"2023-11-08T19:24:16.109981+0000","last_fullsized":"2023-11-08T19:24:16.109981+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:20:58.002466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.110942+0000","last_change":"2023-11-08T19:24:16.110942+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.110942+0000","last_undegraded":"2023-11-08T19:24:16.110942+0000","last_fullsized":"2023-11-08T19:24:16.110942+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":3,"reported_epoch":37,"state":"creating+activating","last_fresh":"2023-11-08T19:24:16.106153+0000","last_change":"2023-11-08T19:24:16.106153+0000","last_active":"2023-11-08T19:24:15.096674+0000","last_peered":"2023-11-08T19:24:15.096674+0000","last_clean":"2023-11-08T19:24:15.096674+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.106153+0000","last_undegraded":"2023-11-08T19:24:16.106153+0000","last_fullsized":"2023-11-08T19:24:16.106153+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:29:45.264000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":["6","0"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.104903+0000","last_change":"2023-11-08T19:24:16.104903+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.104903+0000","last_undegraded":"2023-11-08T19:24:16.104903+0000","last_fullsized":"2023-11-08T19:24:16.104903+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-08T19:24:16.124372+0000","last_change":"2023-11-08T19:24:16.124372+0000","last_active":"2023-11-08T19:24:16.124372+0000","last_peered":"2023-11-08T19:24:16.124372+0000","last_clean":"2023-11-08T19:24:16.124372+0000","last_became_active":"2023-11-08T19:24:16.124097+0000","last_became_peered":"2023-11-08T19:24:16.124097+0000","last_unstale":"2023-11-08T19:24:16.124372+0000","last_undegraded":"2023-11-08T19:24:16.124372+0000","last_fullsized":"2023-11-08T19:24:16.124372+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:33:43.650501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:16.098411+0000","last_change":"2023-11-08T19:24:16.098411+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.098411+0000","last_undegraded":"2023-11-08T19:24:16.098411+0000","last_fullsized":"2023-11-08T19:24:16.098411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":3,"reported_epoch":37,"state":"creating+activating","last_fresh":"2023-11-08T19:24:16.110922+0000","last_change":"2023-11-08T19:24:16.110922+0000","last_active":"2023-11-08T19:24:15.096674+0000","last_peered":"2023-11-08T19:24:15.096674+0000","last_clean":"2023-11-08T19:24:15.096674+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.110922+0000","last_undegraded":"2023-11-08T19:24:16.110922+0000","last_fullsized":"2023-11-08T19:24:16.110922+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:11:10.911014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.110534+0000","last_change":"2023-11-08T19:24:16.110534+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.110534+0000","last_undegraded":"2023-11-08T19:24:16.110534+0000","last_fullsized":"2023-11-08T19:24:16.110534+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-11-08T19:24:15.106050+0000","last_change":"2023-11-08T19:24:15.106050+0000","last_active":"2023-11-08T19:24:15.096674+0000","last_peered":"2023-11-08T19:24:15.096674+0000","last_clean":"2023-11-08T19:24:15.096674+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:15.106050+0000","last_undegraded":"2023-11-08T19:24:15.106050+0000","last_fullsized":"2023-11-08T19:24:15.106050+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":177,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-08T19:24:10.353372+0000","last_change":"2023-11-08T19:22:58.054283+0000","last_active":"2023-11-08T19:24:10.353372+0000","last_peered":"2023-11-08T19:24:10.353372+0000","last_clean":"2023-11-08T19:24:10.353372+0000","last_became_active":"2023-11-08T19:22:58.053337+0000","last_became_peered":"2023-11-08T19:22:58.053337+0000","last_unstale":"2023-11-08T19:24:10.353372+0000","last_undegraded":"2023-11-08T19:24:10.353372+0000","last_fullsized":"2023-11-08T19:24:10.353372+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:22:56.479654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:22:56.479654+0000","last_clean_scrub_stamp":"2023-11-08T19:22:56.479654+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:16:05.317001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":106,"acting":106,"num_store_stats":7},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":995328,"data_stored":758032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.70199999999999996}]},{"osd":1,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.626}]},{"osd":2,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.67700000000000005}]},{"osd":3,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.72199999999999998}]},{"osd":4,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.753},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.73899999999999999}]},{"osd":5,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.91100000000000003}]},{"osd":6,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.80100000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":173801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.62},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.436}]},{"osd":1,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.57899999999999996}]},{"osd":2,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.65200000000000002}]},{"osd":3,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":0.54500000000000004}]},{"osd":4,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.66400000000000003}]},{"osd":5,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.495},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.51500000000000001}]},{"osd":7,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.63700000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":173801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":2.1850000000000001,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":0.39900000000000002}]},{"osd":2,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.29799999999999999}]},{"osd":3,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":2.2120000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.434}]},{"osd":4,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.66600000000000004}]},{"osd":5,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.57499999999999996}]},{"osd":6,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":2.093,"5min":2.093,"15min":2.093},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.59599999999999997}]},{"osd":7,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":2.1299999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.65300000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":1007616,"data_stored":764169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":19.295999999999999,"5min":19.295999999999999,"15min":19.295999999999999},"last":0.34499999999999997},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":17.204000000000001,"5min":17.204000000000001,"15min":17.204000000000001},"last":0.252}]},{"osd":2,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":6.524,"5min":6.524,"15min":6.524},"last":0.316},{"interface":"front","average":{"1min":1.169,"5min":1.169,"15min":1.169},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":17.175000000000001,"5min":17.175000000000001,"15min":17.175000000000001},"last":0.35699999999999998}]},{"osd":3,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":14.324,"5min":14.324,"15min":14.324},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.40200000000000002}]},{"osd":4,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.304,"15min":1.304},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":17.056000000000001,"5min":17.056000000000001,"15min":17.056000000000001},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":5.0289999999999999,"5min":5.0289999999999999,"15min":5.0289999999999999},"last":0.56299999999999994}]},{"osd":5,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":5.0590000000000002,"5min":5.0590000000000002,"15min":5.0590000000000002},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.47199999999999998}]},{"osd":6,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.49299999999999999},{"interface":"front","average":{"1min":1.357,"5min":1.357,"15min":1.357},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":17.111999999999998,"5min":17.111999999999998,"15min":17.111999999999998},"last":0.55500000000000005}]},{"osd":7,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.371,"15min":1.371},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":17.146000000000001,"5min":17.146000000000001,"15min":17.146000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":4.9829999999999997,"5min":4.9829999999999997,"15min":4.9829999999999997},"last":0.52400000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":173801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":3.4100000000000001,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":0.20899999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":3.4369999999999998,"5min":3.4369999999999998,"15min":3.4369999999999998},"last":0.29599999999999999}]},{"osd":1,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":4.0679999999999996,"5min":4.0679999999999996,"15min":4.0679999999999996},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":4.3499999999999996,"5min":4.3499999999999996,"15min":4.3499999999999996},"last":0.36099999999999999}]},{"osd":3,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":3.8580000000000001,"5min":3.8580000000000001,"15min":3.8580000000000001},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":3.476,"5min":3.476,"15min":3.476},"last":0.28599999999999998}]},{"osd":4,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":4.0090000000000003,"5min":4.0090000000000003,"15min":4.0090000000000003},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":4.1040000000000001,"5min":4.1040000000000001,"15min":4.1040000000000001},"last":0.46000000000000002}]},{"osd":5,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":4.0869999999999997,"5min":4.0869999999999997,"15min":4.0869999999999997},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":3.843,"5min":3.843,"15min":3.843},"last":0.443}]},{"osd":6,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":4.1399999999999997,"5min":4.1399999999999997,"15min":4.1399999999999997},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":4.0499999999999998,"5min":4.0499999999999998,"15min":4.0499999999999998},"last":0.503}]},{"osd":7,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":4.157,"5min":4.157,"15min":4.157},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":4.1710000000000003,"5min":4.1710000000000003,"15min":4.1710000000000003},"last":0.61499999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":173801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.36099999999999999}]},{"osd":1,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":0.37},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.33300000000000002}]},{"osd":2,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.315}]},{"osd":4,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.57099999999999995}]},{"osd":5,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.53100000000000003}]},{"osd":6,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.46400000000000002}]},{"osd":7,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.60999999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":173801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":2.2090000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.503}]},{"osd":1,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.627},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.45100000000000001}]},{"osd":2,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":2.8490000000000002,"5min":2.8490000000000002,"15min":2.8490000000000002},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.47999999999999998}]},{"osd":3,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":3.4849999999999999,"5min":3.4849999999999999,"15min":3.4849999999999999},"last":0.65400000000000003}]},{"osd":5,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.54400000000000004}]},{"osd":6,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":4.1529999999999996,"5min":4.1529999999999996,"15min":4.1529999999999996},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.69699999999999995}]},{"osd":7,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":5.5359999999999996,"5min":5.5359999999999996,"15min":5.5359999999999996},"last":0.70999999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":173801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.61499999999999999}]},{"osd":1,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":2.2919999999999998,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":0.47699999999999998}]},{"osd":2,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.495}]},{"osd":3,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.56799999999999995}]},{"osd":4,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":2.3300000000000001,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.70799999999999996}]},{"osd":6,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":2.3650000000000002,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":0.433}]},{"osd":7,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.66700000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:24:21.605 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:24:21.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.756+0000 7f846b67e700 1 Processor -- start 2023-11-08T19:24:21.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.756+0000 7f846b67e700 1 -- start start 2023-11-08T19:24:21.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.757+0000 7f846b67e700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f84640b16b0 0x7f84640ce380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:21.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.757+0000 7f846b67e700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84640d1330 con 0x7f84640b20b0 2023-11-08T19:24:21.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.757+0000 7f846b67e700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84640cb490 con 0x7f84640afb30 2023-11-08T19:24:21.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.757+0000 7f846b67e700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84640cb770 con 0x7f84640b16b0 2023-11-08T19:24:21.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.757+0000 7f8469c1b700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f84640b20b0 0x7f84640aff90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:41362/0 (socket says 172.21.15.149:41362) 2023-11-08T19:24:21.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.757+0000 7f8469c1b700 1 -- 172.21.15.149:0/503210218 learned_addr learned my addr 172.21.15.149:0/503210218 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:24:21.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.757+0000 7f8468c19700 1 --2- 172.21.15.149:0/503210218 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f84640b16b0 0x7f84640ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:21.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.757+0000 7f845bfff700 1 -- 172.21.15.149:0/503210218 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3029544859 0 0) 0x7f84640d1330 con 0x7f84640b20b0 2023-11-08T19:24:21.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.757+0000 7f845bfff700 1 -- 172.21.15.149:0/503210218 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84500035b0 con 0x7f84640b20b0 2023-11-08T19:24:21.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.757+0000 7f845bfff700 1 -- 172.21.15.149:0/503210218 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4236760704 0 0) 0x7f84500035b0 con 0x7f84640b20b0 2023-11-08T19:24:21.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.757+0000 7f845bfff700 1 -- 172.21.15.149:0/503210218 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f84640b16b0 msgr2=0x7f84640ce380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:21.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.757+0000 7f845bfff700 1 --2- 172.21.15.149:0/503210218 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f84640b16b0 0x7f84640ce380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:21.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.757+0000 7f845bfff700 1 -- 172.21.15.149:0/503210218 >> v1:172.21.15.160:6789/0 conn(0x7f84640afb30 legacy=0x7f84640cbf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:21.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.757+0000 7f845bfff700 1 -- 172.21.15.149:0/503210218 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84640cba50 con 0x7f84640b20b0 2023-11-08T19:24:21.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.757+0000 7f845bfff700 1 -- 172.21.15.149:0/503210218 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f845c0019f0 con 0x7f84640b20b0 2023-11-08T19:24:21.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.757+0000 7f845bfff700 1 -- 172.21.15.149:0/503210218 >> v1:172.21.15.149:6789/0 conn(0x7f84640b20b0 legacy=0x7f84640aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:21.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.757+0000 7f845bfff700 1 --2- 172.21.15.149:0/503210218 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8450003a30 0x7f8450003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:21.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.757+0000 7f845bfff700 1 --2- 172.21.15.149:0/503210218 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f84640b16b0 0x7f8450004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:21.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.757+0000 7f845bfff700 1 --2- 172.21.15.149:0/503210218 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8450004d90 0x7f8450005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:21.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.757+0000 7f845bfff700 1 -- 172.21.15.149:0/503210218 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84640cb770 con 0x7f8450004d90 2023-11-08T19:24:21.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.757+0000 7f845bfff700 1 -- 172.21.15.149:0/503210218 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845000bba0 con 0x7f8450003a30 2023-11-08T19:24:21.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.757+0000 7f845bfff700 1 -- 172.21.15.149:0/503210218 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f845000bd30 con 0x7f84640b16b0 2023-11-08T19:24:21.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.758+0000 7f8469c1b700 1 --2- 172.21.15.149:0/503210218 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8450004d90 0x7f8450005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:21.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.758+0000 7f846941a700 1 --2- 172.21.15.149:0/503210218 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8450003a30 0x7f8450003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:21.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.758+0000 7f8468c19700 1 --2- 172.21.15.149:0/503210218 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f84640b16b0 0x7f8450004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:21.770 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.758+0000 7f8469c1b700 1 -- 172.21.15.149:0/503210218 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f84640b16b0 msgr2=0x7f8450004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:21.770 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.758+0000 7f8469c1b700 1 --2- 172.21.15.149:0/503210218 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f84640b16b0 0x7f8450004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:21.770 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.758+0000 7f8469c1b700 1 -- 172.21.15.149:0/503210218 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8450003a30 msgr2=0x7f8450003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:21.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.758+0000 7f8469c1b700 1 --2- 172.21.15.149:0/503210218 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8450003a30 0x7f8450003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:21.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.758+0000 7f8469c1b700 1 -- 172.21.15.149:0/503210218 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84500035b0 con 0x7f8450004d90 2023-11-08T19:24:21.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.758+0000 7f8469c1b700 1 --2- 172.21.15.149:0/503210218 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8450004d90 0x7f8450005210 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f845c00a860 tx=0x7f8450005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8ae149116db8340 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:21.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.758+0000 7f845bfff700 1 -- 172.21.15.149:0/503210218 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845c010690 con 0x7f8450004d90 2023-11-08T19:24:21.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.758+0000 7f845bfff700 1 -- 172.21.15.149:0/503210218 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f845c010810 con 0x7f8450004d90 2023-11-08T19:24:21.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.758+0000 7f845bfff700 1 -- 172.21.15.149:0/503210218 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845c010bc0 con 0x7f8450004d90 2023-11-08T19:24:21.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.759+0000 7f846b67e700 1 -- 172.21.15.149:0/503210218 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8450004d90 msgr2=0x7f8450005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:21.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.759+0000 7f846b67e700 1 --2- 172.21.15.149:0/503210218 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8450004d90 0x7f8450005210 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f845c00a860 tx=0x7f8450005880 comp rx=0 tx=0).stop 2023-11-08T19:24:21.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.759+0000 7f8469c1b700 1 -- 172.21.15.149:0/503210218 reap_dead start 2023-11-08T19:24:21.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.759+0000 7f846b67e700 1 -- 172.21.15.149:0/503210218 shutdown_connections 2023-11-08T19:24:21.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.759+0000 7f846b67e700 1 -- 172.21.15.149:0/503210218 >> 172.21.15.149:0/503210218 conn(0x7f8464099a40 msgr2=0x7f84640d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:21.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.759+0000 7f846b67e700 1 -- 172.21.15.149:0/503210218 shutdown_connections 2023-11-08T19:24:21.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.759+0000 7f846b67e700 1 -- 172.21.15.149:0/503210218 wait complete. 2023-11-08T19:24:21.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.760+0000 7f846b67e700 1 Processor -- start 2023-11-08T19:24:21.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.760+0000 7f846b67e700 1 -- start start 2023-11-08T19:24:21.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.761+0000 7f846b67e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8464158e60 0x7f84640c9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:21.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.761+0000 7f846b67e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8464159720 0x7f84640ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:21.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.761+0000 7f846b67e700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f84640cd4b0 0x7f846406e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:21.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.761+0000 7f846b67e700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84640cd960 con 0x7f8464158e60 2023-11-08T19:24:21.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.761+0000 7f846b67e700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84640b40a0 con 0x7f8464159720 2023-11-08T19:24:21.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.761+0000 7f846b67e700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84640b37e0 con 0x7f84640cd4b0 2023-11-08T19:24:21.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.761+0000 7f846941a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8464158e60 0x7f84640c9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:21.779 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.761+0000 7f846941a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8464158e60 0x7f84640c9e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39368/0 (socket says 172.21.15.149:39368) 2023-11-08T19:24:21.779 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.761+0000 7f846941a700 1 -- 172.21.15.149:0/1271448556 learned_addr learned my addr 172.21.15.149:0/1271448556 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:21.779 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.761+0000 7f8469c1b700 1 --2- 172.21.15.149:0/1271448556 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f84640cd4b0 0x7f846406e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:21.779 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.761+0000 7f8468c19700 1 --2- 172.21.15.149:0/1271448556 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8464159720 0x7f84640ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:21.779 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.761+0000 7f846941a700 1 -- 172.21.15.149:0/1271448556 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f84640cd4b0 msgr2=0x7f846406e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:21.780 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.761+0000 7f846941a700 1 --2- 172.21.15.149:0/1271448556 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f84640cd4b0 0x7f846406e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:21.780 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.761+0000 7f846941a700 1 -- 172.21.15.149:0/1271448556 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8464159720 msgr2=0x7f84640ccf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:21.780 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.761+0000 7f846941a700 1 --2- 172.21.15.149:0/1271448556 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8464159720 0x7f84640ccf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:21.780 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.761+0000 7f846941a700 1 -- 172.21.15.149:0/1271448556 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84640b3a50 con 0x7f8464158e60 2023-11-08T19:24:21.780 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.761+0000 7f8468c19700 1 --2- 172.21.15.149:0/1271448556 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8464159720 0x7f84640ccf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:24:21.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.761+0000 7f846941a700 1 --2- 172.21.15.149:0/1271448556 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8464158e60 0x7f84640c9e60 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f846000f820 tx=0x7f846000fbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:21.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.761+0000 7f8459ffb700 1 -- 172.21.15.149:0/1271448556 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84600052e0 con 0x7f8464158e60 2023-11-08T19:24:21.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.761+0000 7f8459ffb700 1 -- 172.21.15.149:0/1271448556 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8460005460 con 0x7f8464158e60 2023-11-08T19:24:21.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.761+0000 7f846b67e700 1 -- 172.21.15.149:0/1271448556 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84640b3d30 con 0x7f8464158e60 2023-11-08T19:24:21.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.761+0000 7f8459ffb700 1 -- 172.21.15.149:0/1271448556 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8460003910 con 0x7f8464158e60 2023-11-08T19:24:21.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.762+0000 7f846b67e700 1 -- 172.21.15.149:0/1271448556 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84640ca3a0 con 0x7f8464158e60 2023-11-08T19:24:21.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.763+0000 7f846b67e700 1 -- 172.21.15.149:0/1271448556 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84640745f0 con 0x7f8464158e60 2023-11-08T19:24:21.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.763+0000 7f8459ffb700 1 -- 172.21.15.149:0/1271448556 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8460003a70 con 0x7f8464158e60 2023-11-08T19:24:21.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.763+0000 7f8459ffb700 1 --2- 172.21.15.149:0/1271448556 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f844806af00 0x7f844806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:21.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.764+0000 7f8468c19700 1 --2- 172.21.15.149:0/1271448556 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f844806af00 0x7f844806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:21.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.764+0000 7f8459ffb700 1 -- 172.21.15.149:0/1271448556 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f8460089690 con 0x7f8464158e60 2023-11-08T19:24:21.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.764+0000 7f8468c19700 1 --2- 172.21.15.149:0/1271448556 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f844806af00 0x7f844806d3c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f84640b0e00 tx=0x7f8454008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:21.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.768+0000 7f8459ffb700 1 -- 172.21.15.149:0/1271448556 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8460054600 con 0x7f8464158e60 2023-11-08T19:24:21.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.955+0000 7f846b67e700 1 -- 172.21.15.149:0/1271448556 --> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f84640ca5c0 con 0x7f844806af00 2023-11-08T19:24:21.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.962+0000 7f8459ffb700 1 -- 172.21.15.149:0/1271448556 <== mgr.4104 v2:172.21.15.149:6832/1929837472 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282604 (secure 0 0 0) 0x7f84640ca5c0 con 0x7f844806af00 2023-11-08T19:24:21.968 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:24:21.970 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.966+0000 7f846b67e700 1 -- 172.21.15.149:0/1271448556 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f844806af00 msgr2=0x7f844806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:21.971 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.966+0000 7f846b67e700 1 --2- 172.21.15.149:0/1271448556 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f844806af00 0x7f844806d3c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f84640b0e00 tx=0x7f8454008040 comp rx=0 tx=0).stop 2023-11-08T19:24:21.971 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.966+0000 7f846b67e700 1 -- 172.21.15.149:0/1271448556 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8464158e60 msgr2=0x7f84640c9e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:21.971 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.966+0000 7f846b67e700 1 --2- 172.21.15.149:0/1271448556 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8464158e60 0x7f84640c9e60 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f846000f820 tx=0x7f846000fbe0 comp rx=0 tx=0).stop 2023-11-08T19:24:21.971 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.966+0000 7f846b67e700 1 -- 172.21.15.149:0/1271448556 shutdown_connections 2023-11-08T19:24:21.972 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.966+0000 7f846b67e700 1 --2- 172.21.15.149:0/1271448556 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f844806af00 0x7f844806d3c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:21.972 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.966+0000 7f846b67e700 1 --2- 172.21.15.149:0/1271448556 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f84640cd4b0 0x7f846406e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:21.972 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.966+0000 7f846b67e700 1 --2- 172.21.15.149:0/1271448556 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8464158e60 0x7f84640c9e60 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:21.972 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.966+0000 7f846b67e700 1 --2- 172.21.15.149:0/1271448556 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8464159720 0x7f84640ccf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:21.972 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.966+0000 7f846b67e700 1 -- 172.21.15.149:0/1271448556 >> 172.21.15.149:0/1271448556 conn(0x7f8464099a40 msgr2=0x7f84640b0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:21.973 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.966+0000 7f846b67e700 1 -- 172.21.15.149:0/1271448556 shutdown_connections 2023-11-08T19:24:21.973 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:21.966+0000 7f846b67e700 1 -- 172.21.15.149:0/1271448556 wait complete. 2023-11-08T19:24:21.973 INFO:teuthology.orchestra.run.smithi149.stderr:dumped all 2023-11-08T19:24:21.980 INFO:teuthology.orchestra.run.smithi149.stdout:{"pg_ready":true,"pg_map":{"version":74,"stamp":"2023-11-08T19:24:20.002165+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":172,"acting":172,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220540,"kb_used_data":4380,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754180,"statfs":{"total":773094113280,"available":772868280320,"internally_reserved":0,"allocated":4485120,"data_stored":2565007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.903214"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.118577+0000","last_change":"2023-11-08T19:24:16.118577+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.118577+0000","last_undegraded":"2023-11-08T19:24:16.118577+0000","last_fullsized":"2023-11-08T19:24:16.118577+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.111933+0000","last_change":"2023-11-08T19:24:16.111933+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.111933+0000","last_undegraded":"2023-11-08T19:24:16.111933+0000","last_fullsized":"2023-11-08T19:24:16.111933+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.113940+0000","last_change":"2023-11-08T19:24:16.113940+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.113940+0000","last_undegraded":"2023-11-08T19:24:16.113940+0000","last_fullsized":"2023-11-08T19:24:16.113940+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.109530+0000","last_change":"2023-11-08T19:24:16.109530+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.109530+0000","last_undegraded":"2023-11-08T19:24:16.109530+0000","last_fullsized":"2023-11-08T19:24:16.109530+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.108591+0000","last_change":"2023-11-08T19:24:16.108591+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.108591+0000","last_undegraded":"2023-11-08T19:24:16.108591+0000","last_fullsized":"2023-11-08T19:24:16.108591+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.112894+0000","last_change":"2023-11-08T19:24:16.112894+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.112894+0000","last_undegraded":"2023-11-08T19:24:16.112894+0000","last_fullsized":"2023-11-08T19:24:16.112894+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:16.098411+0000","last_change":"2023-11-08T19:24:16.098411+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.098411+0000","last_undegraded":"2023-11-08T19:24:16.098411+0000","last_fullsized":"2023-11-08T19:24:16.098411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.111044+0000","last_change":"2023-11-08T19:24:16.111044+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.111044+0000","last_undegraded":"2023-11-08T19:24:16.111044+0000","last_fullsized":"2023-11-08T19:24:16.111044+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.109913+0000","last_change":"2023-11-08T19:24:16.109913+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.109913+0000","last_undegraded":"2023-11-08T19:24:16.109913+0000","last_fullsized":"2023-11-08T19:24:16.109913+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.111499+0000","last_change":"2023-11-08T19:24:16.111499+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.111499+0000","last_undegraded":"2023-11-08T19:24:16.111499+0000","last_fullsized":"2023-11-08T19:24:16.111499+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.111486+0000","last_change":"2023-11-08T19:24:16.111486+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.111486+0000","last_undegraded":"2023-11-08T19:24:16.111486+0000","last_fullsized":"2023-11-08T19:24:16.111486+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.111509+0000","last_change":"2023-11-08T19:24:16.111509+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.111509+0000","last_undegraded":"2023-11-08T19:24:16.111509+0000","last_fullsized":"2023-11-08T19:24:16.111509+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.112364+0000","last_change":"2023-11-08T19:24:16.112364+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.112364+0000","last_undegraded":"2023-11-08T19:24:16.112364+0000","last_fullsized":"2023-11-08T19:24:16.112364+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.104403+0000","last_change":"2023-11-08T19:24:16.104403+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.104403+0000","last_undegraded":"2023-11-08T19:24:16.104403+0000","last_fullsized":"2023-11-08T19:24:16.104403+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.111419+0000","last_change":"2023-11-08T19:24:16.111419+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.111419+0000","last_undegraded":"2023-11-08T19:24:16.111419+0000","last_fullsized":"2023-11-08T19:24:16.111419+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:16.098411+0000","last_change":"2023-11-08T19:24:16.098411+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.098411+0000","last_undegraded":"2023-11-08T19:24:16.098411+0000","last_fullsized":"2023-11-08T19:24:16.098411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:16.098411+0000","last_change":"2023-11-08T19:24:16.098411+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.098411+0000","last_undegraded":"2023-11-08T19:24:16.098411+0000","last_fullsized":"2023-11-08T19:24:16.098411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.105600+0000","last_change":"2023-11-08T19:24:16.105600+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.105600+0000","last_undegraded":"2023-11-08T19:24:16.105600+0000","last_fullsized":"2023-11-08T19:24:16.105600+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.108578+0000","last_change":"2023-11-08T19:24:16.108578+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.108578+0000","last_undegraded":"2023-11-08T19:24:16.108578+0000","last_fullsized":"2023-11-08T19:24:16.108578+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.105046+0000","last_change":"2023-11-08T19:24:16.105046+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.105046+0000","last_undegraded":"2023-11-08T19:24:16.105046+0000","last_fullsized":"2023-11-08T19:24:16.105046+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.111936+0000","last_change":"2023-11-08T19:24:16.111936+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.111936+0000","last_undegraded":"2023-11-08T19:24:16.111936+0000","last_fullsized":"2023-11-08T19:24:16.111936+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.105864+0000","last_change":"2023-11-08T19:24:16.105864+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.105864+0000","last_undegraded":"2023-11-08T19:24:16.105864+0000","last_fullsized":"2023-11-08T19:24:16.105864+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:16.098411+0000","last_change":"2023-11-08T19:24:16.098411+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.098411+0000","last_undegraded":"2023-11-08T19:24:16.098411+0000","last_fullsized":"2023-11-08T19:24:16.098411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.108583+0000","last_change":"2023-11-08T19:24:16.108583+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.108583+0000","last_undegraded":"2023-11-08T19:24:16.108583+0000","last_fullsized":"2023-11-08T19:24:16.108583+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.104642+0000","last_change":"2023-11-08T19:24:16.104642+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.104642+0000","last_undegraded":"2023-11-08T19:24:16.104642+0000","last_fullsized":"2023-11-08T19:24:16.104642+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.111443+0000","last_change":"2023-11-08T19:24:16.111443+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.111443+0000","last_undegraded":"2023-11-08T19:24:16.111443+0000","last_fullsized":"2023-11-08T19:24:16.111443+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.104157+0000","last_change":"2023-11-08T19:24:16.104157+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.104157+0000","last_undegraded":"2023-11-08T19:24:16.104157+0000","last_fullsized":"2023-11-08T19:24:16.104157+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.110920+0000","last_change":"2023-11-08T19:24:16.110920+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.110920+0000","last_undegraded":"2023-11-08T19:24:16.110920+0000","last_fullsized":"2023-11-08T19:24:16.110920+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.105829+0000","last_change":"2023-11-08T19:24:16.105829+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.105829+0000","last_undegraded":"2023-11-08T19:24:16.105829+0000","last_fullsized":"2023-11-08T19:24:16.105829+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.105116+0000","last_change":"2023-11-08T19:24:16.105116+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.105116+0000","last_undegraded":"2023-11-08T19:24:16.105116+0000","last_fullsized":"2023-11-08T19:24:16.105116+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:16.098411+0000","last_change":"2023-11-08T19:24:16.098411+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.098411+0000","last_undegraded":"2023-11-08T19:24:16.098411+0000","last_fullsized":"2023-11-08T19:24:16.098411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.113340+0000","last_change":"2023-11-08T19:24:16.113340+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.113340+0000","last_undegraded":"2023-11-08T19:24:16.113340+0000","last_fullsized":"2023-11-08T19:24:16.113340+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:16.098411+0000","last_change":"2023-11-08T19:24:16.098411+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.098411+0000","last_undegraded":"2023-11-08T19:24:16.098411+0000","last_fullsized":"2023-11-08T19:24:16.098411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":3,"reported_epoch":37,"state":"creating+activating","last_fresh":"2023-11-08T19:24:16.104218+0000","last_change":"2023-11-08T19:24:16.104218+0000","last_active":"2023-11-08T19:24:15.096674+0000","last_peered":"2023-11-08T19:24:15.096674+0000","last_clean":"2023-11-08T19:24:15.096674+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.104218+0000","last_undegraded":"2023-11-08T19:24:16.104218+0000","last_fullsized":"2023-11-08T19:24:16.104218+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:20:58.002466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":["6","4"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.114932+0000","last_change":"2023-11-08T19:24:16.114932+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.114932+0000","last_undegraded":"2023-11-08T19:24:16.114932+0000","last_fullsized":"2023-11-08T19:24:16.114932+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":3,"reported_epoch":37,"state":"creating+activating","last_fresh":"2023-11-08T19:24:16.110243+0000","last_change":"2023-11-08T19:24:16.110243+0000","last_active":"2023-11-08T19:24:15.096674+0000","last_peered":"2023-11-08T19:24:15.096674+0000","last_clean":"2023-11-08T19:24:15.096674+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.110243+0000","last_undegraded":"2023-11-08T19:24:16.110243+0000","last_fullsized":"2023-11-08T19:24:16.110243+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:11:30.828881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":["0","7"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.105329+0000","last_change":"2023-11-08T19:24:16.105329+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.105329+0000","last_undegraded":"2023-11-08T19:24:16.105329+0000","last_fullsized":"2023-11-08T19:24:16.105329+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-08T19:24:16.124256+0000","last_change":"2023-11-08T19:24:16.124256+0000","last_active":"2023-11-08T19:24:16.124256+0000","last_peered":"2023-11-08T19:24:16.124256+0000","last_clean":"2023-11-08T19:24:16.124256+0000","last_became_active":"2023-11-08T19:24:16.121912+0000","last_became_peered":"2023-11-08T19:24:16.121912+0000","last_unstale":"2023-11-08T19:24:16.124256+0000","last_undegraded":"2023-11-08T19:24:16.124256+0000","last_fullsized":"2023-11-08T19:24:16.124256+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:09:54.584065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.118036+0000","last_change":"2023-11-08T19:24:16.118036+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.118036+0000","last_undegraded":"2023-11-08T19:24:16.118036+0000","last_fullsized":"2023-11-08T19:24:16.118036+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":3,"reported_epoch":37,"state":"creating+activating","last_fresh":"2023-11-08T19:24:16.104592+0000","last_change":"2023-11-08T19:24:16.104592+0000","last_active":"2023-11-08T19:24:15.096674+0000","last_peered":"2023-11-08T19:24:15.096674+0000","last_clean":"2023-11-08T19:24:15.096674+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.104592+0000","last_undegraded":"2023-11-08T19:24:16.104592+0000","last_fullsized":"2023-11-08T19:24:16.104592+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:27:42.478804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":["4","3"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.112418+0000","last_change":"2023-11-08T19:24:16.112418+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.112418+0000","last_undegraded":"2023-11-08T19:24:16.112418+0000","last_fullsized":"2023-11-08T19:24:16.112418+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":3,"reported_epoch":37,"state":"creating+activating","last_fresh":"2023-11-08T19:24:16.108195+0000","last_change":"2023-11-08T19:24:16.108195+0000","last_active":"2023-11-08T19:24:15.096674+0000","last_peered":"2023-11-08T19:24:15.096674+0000","last_clean":"2023-11-08T19:24:15.096674+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.108195+0000","last_undegraded":"2023-11-08T19:24:16.108195+0000","last_fullsized":"2023-11-08T19:24:16.108195+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:11:30.828881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":["5","0"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.110575+0000","last_change":"2023-11-08T19:24:16.110575+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.110575+0000","last_undegraded":"2023-11-08T19:24:16.110575+0000","last_fullsized":"2023-11-08T19:24:16.110575+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-11-08T19:24:15.105771+0000","last_change":"2023-11-08T19:24:15.105771+0000","last_active":"2023-11-08T19:24:15.096674+0000","last_peered":"2023-11-08T19:24:15.096674+0000","last_clean":"2023-11-08T19:24:15.096674+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:15.105771+0000","last_undegraded":"2023-11-08T19:24:15.105771+0000","last_fullsized":"2023-11-08T19:24:15.105771+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.105388+0000","last_change":"2023-11-08T19:24:16.105388+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.105388+0000","last_undegraded":"2023-11-08T19:24:16.105388+0000","last_fullsized":"2023-11-08T19:24:16.105388+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-08T19:24:16.123153+0000","last_change":"2023-11-08T19:24:16.123153+0000","last_active":"2023-11-08T19:24:16.123153+0000","last_peered":"2023-11-08T19:24:16.123153+0000","last_clean":"2023-11-08T19:24:16.123153+0000","last_became_active":"2023-11-08T19:24:16.122837+0000","last_became_peered":"2023-11-08T19:24:16.122837+0000","last_unstale":"2023-11-08T19:24:16.123153+0000","last_undegraded":"2023-11-08T19:24:16.123153+0000","last_fullsized":"2023-11-08T19:24:16.123153+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:20:58.002466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.110672+0000","last_change":"2023-11-08T19:24:16.110672+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.110672+0000","last_undegraded":"2023-11-08T19:24:16.110672+0000","last_fullsized":"2023-11-08T19:24:16.110672+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-08T19:24:16.116788+0000","last_change":"2023-11-08T19:24:16.115097+0000","last_active":"2023-11-08T19:24:16.116788+0000","last_peered":"2023-11-08T19:24:16.116788+0000","last_clean":"2023-11-08T19:24:16.116788+0000","last_became_active":"2023-11-08T19:24:16.114776+0000","last_became_peered":"2023-11-08T19:24:16.114776+0000","last_unstale":"2023-11-08T19:24:16.116788+0000","last_undegraded":"2023-11-08T19:24:16.116788+0000","last_fullsized":"2023-11-08T19:24:16.116788+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:56:22.819911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.109118+0000","last_change":"2023-11-08T19:24:16.109118+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.109118+0000","last_undegraded":"2023-11-08T19:24:16.109118+0000","last_fullsized":"2023-11-08T19:24:16.109118+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":3,"reported_epoch":37,"state":"creating+activating","last_fresh":"2023-11-08T19:24:16.117622+0000","last_change":"2023-11-08T19:24:16.117622+0000","last_active":"2023-11-08T19:24:15.096674+0000","last_peered":"2023-11-08T19:24:15.096674+0000","last_clean":"2023-11-08T19:24:15.096674+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.117622+0000","last_undegraded":"2023-11-08T19:24:16.117622+0000","last_fullsized":"2023-11-08T19:24:16.117622+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:45:52.271444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:16.098411+0000","last_change":"2023-11-08T19:24:16.098411+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.098411+0000","last_undegraded":"2023-11-08T19:24:16.098411+0000","last_fullsized":"2023-11-08T19:24:16.098411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":3,"reported_epoch":37,"state":"creating+activating","last_fresh":"2023-11-08T19:24:16.109849+0000","last_change":"2023-11-08T19:24:16.109849+0000","last_active":"2023-11-08T19:24:15.096674+0000","last_peered":"2023-11-08T19:24:15.096674+0000","last_clean":"2023-11-08T19:24:15.096674+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.109849+0000","last_undegraded":"2023-11-08T19:24:16.109849+0000","last_fullsized":"2023-11-08T19:24:16.109849+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:09:02.617546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":["5","3"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.110635+0000","last_change":"2023-11-08T19:24:16.110635+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.110635+0000","last_undegraded":"2023-11-08T19:24:16.110635+0000","last_fullsized":"2023-11-08T19:24:16.110635+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":3,"reported_epoch":37,"state":"creating+activating","last_fresh":"2023-11-08T19:24:16.108353+0000","last_change":"2023-11-08T19:24:16.108353+0000","last_active":"2023-11-08T19:24:15.096674+0000","last_peered":"2023-11-08T19:24:15.096674+0000","last_clean":"2023-11-08T19:24:15.096674+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.108353+0000","last_undegraded":"2023-11-08T19:24:16.108353+0000","last_fullsized":"2023-11-08T19:24:16.108353+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:09:54.584065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":["5","1"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.105522+0000","last_change":"2023-11-08T19:24:16.105522+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.105522+0000","last_undegraded":"2023-11-08T19:24:16.105522+0000","last_fullsized":"2023-11-08T19:24:16.105522+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":3,"reported_epoch":37,"state":"creating+activating","last_fresh":"2023-11-08T19:24:16.118395+0000","last_change":"2023-11-08T19:24:16.118395+0000","last_active":"2023-11-08T19:24:15.096674+0000","last_peered":"2023-11-08T19:24:15.096674+0000","last_clean":"2023-11-08T19:24:15.096674+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.118395+0000","last_undegraded":"2023-11-08T19:24:16.118395+0000","last_fullsized":"2023-11-08T19:24:16.118395+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:21:06.998550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.113169+0000","last_change":"2023-11-08T19:24:16.113169+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.113169+0000","last_undegraded":"2023-11-08T19:24:16.113169+0000","last_fullsized":"2023-11-08T19:24:16.113169+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":4,"reported_epoch":37,"state":"creating+activating","last_fresh":"2023-11-08T19:24:16.119864+0000","last_change":"2023-11-08T19:24:16.111647+0000","last_active":"2023-11-08T19:24:15.096674+0000","last_peered":"2023-11-08T19:24:15.096674+0000","last_clean":"2023-11-08T19:24:15.096674+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.119864+0000","last_undegraded":"2023-11-08T19:24:16.119864+0000","last_fullsized":"2023-11-08T19:24:16.119864+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:09:02.617546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":["3","0"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.110978+0000","last_change":"2023-11-08T19:24:16.110978+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.110978+0000","last_undegraded":"2023-11-08T19:24:16.110978+0000","last_fullsized":"2023-11-08T19:24:16.110978+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-08T19:24:16.123874+0000","last_change":"2023-11-08T19:24:16.123874+0000","last_active":"2023-11-08T19:24:16.123874+0000","last_peered":"2023-11-08T19:24:16.123874+0000","last_clean":"2023-11-08T19:24:16.123874+0000","last_became_active":"2023-11-08T19:24:16.123508+0000","last_became_peered":"2023-11-08T19:24:16.123508+0000","last_unstale":"2023-11-08T19:24:16.123874+0000","last_undegraded":"2023-11-08T19:24:16.123874+0000","last_fullsized":"2023-11-08T19:24:16.123874+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:29:45.264000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:16.098411+0000","last_change":"2023-11-08T19:24:16.098411+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.098411+0000","last_undegraded":"2023-11-08T19:24:16.098411+0000","last_fullsized":"2023-11-08T19:24:16.098411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-08T19:24:16.109232+0000","last_change":"2023-11-08T19:24:16.109232+0000","last_active":"2023-11-08T19:24:16.109232+0000","last_peered":"2023-11-08T19:24:16.109232+0000","last_clean":"2023-11-08T19:24:16.109232+0000","last_became_active":"2023-11-08T19:24:16.108931+0000","last_became_peered":"2023-11-08T19:24:16.108931+0000","last_unstale":"2023-11-08T19:24:16.109232+0000","last_undegraded":"2023-11-08T19:24:16.109232+0000","last_fullsized":"2023-11-08T19:24:16.109232+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:11:30.828881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.118968+0000","last_change":"2023-11-08T19:24:16.118968+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.118968+0000","last_undegraded":"2023-11-08T19:24:16.118968+0000","last_fullsized":"2023-11-08T19:24:16.118968+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-11-08T19:24:15.105548+0000","last_change":"2023-11-08T19:24:15.105548+0000","last_active":"2023-11-08T19:24:15.096674+0000","last_peered":"2023-11-08T19:24:15.096674+0000","last_clean":"2023-11-08T19:24:15.096674+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:15.105548+0000","last_undegraded":"2023-11-08T19:24:15.105548+0000","last_fullsized":"2023-11-08T19:24:15.105548+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.118506+0000","last_change":"2023-11-08T19:24:16.118506+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.118506+0000","last_undegraded":"2023-11-08T19:24:16.118506+0000","last_fullsized":"2023-11-08T19:24:16.118506+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":3,"reported_epoch":37,"state":"creating+activating","last_fresh":"2023-11-08T19:24:16.108462+0000","last_change":"2023-11-08T19:24:16.108462+0000","last_active":"2023-11-08T19:24:15.096674+0000","last_peered":"2023-11-08T19:24:15.096674+0000","last_clean":"2023-11-08T19:24:15.096674+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.108462+0000","last_undegraded":"2023-11-08T19:24:16.108462+0000","last_fullsized":"2023-11-08T19:24:16.108462+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:11:10.911014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":["5","4"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.111051+0000","last_change":"2023-11-08T19:24:16.111051+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.111051+0000","last_undegraded":"2023-11-08T19:24:16.111051+0000","last_fullsized":"2023-11-08T19:24:16.111051+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-08T19:24:16.119926+0000","last_change":"2023-11-08T19:24:16.117967+0000","last_active":"2023-11-08T19:24:16.119926+0000","last_peered":"2023-11-08T19:24:16.119926+0000","last_clean":"2023-11-08T19:24:16.119926+0000","last_became_active":"2023-11-08T19:24:16.117675+0000","last_became_peered":"2023-11-08T19:24:16.117675+0000","last_unstale":"2023-11-08T19:24:16.119926+0000","last_undegraded":"2023-11-08T19:24:16.119926+0000","last_fullsized":"2023-11-08T19:24:16.119926+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:55:14.474408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.104722+0000","last_change":"2023-11-08T19:24:16.104722+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.104722+0000","last_undegraded":"2023-11-08T19:24:16.104722+0000","last_fullsized":"2023-11-08T19:24:16.104722+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":3,"reported_epoch":37,"state":"creating+activating","last_fresh":"2023-11-08T19:24:16.105728+0000","last_change":"2023-11-08T19:24:16.105728+0000","last_active":"2023-11-08T19:24:15.096674+0000","last_peered":"2023-11-08T19:24:15.096674+0000","last_clean":"2023-11-08T19:24:15.096674+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.105728+0000","last_undegraded":"2023-11-08T19:24:16.105728+0000","last_fullsized":"2023-11-08T19:24:16.105728+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:29:40.689965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":["2","7"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.108756+0000","last_change":"2023-11-08T19:24:16.108756+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.108756+0000","last_undegraded":"2023-11-08T19:24:16.108756+0000","last_fullsized":"2023-11-08T19:24:16.108756+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-08T19:24:16.124598+0000","last_change":"2023-11-08T19:24:16.120284+0000","last_active":"2023-11-08T19:24:16.124598+0000","last_peered":"2023-11-08T19:24:16.124598+0000","last_clean":"2023-11-08T19:24:16.124598+0000","last_became_active":"2023-11-08T19:24:16.119983+0000","last_became_peered":"2023-11-08T19:24:16.119983+0000","last_unstale":"2023-11-08T19:24:16.124598+0000","last_undegraded":"2023-11-08T19:24:16.124598+0000","last_fullsized":"2023-11-08T19:24:16.124598+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:11:30.828881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:16.098411+0000","last_change":"2023-11-08T19:24:16.098411+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.098411+0000","last_undegraded":"2023-11-08T19:24:16.098411+0000","last_fullsized":"2023-11-08T19:24:16.098411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":3,"reported_epoch":37,"state":"creating+activating","last_fresh":"2023-11-08T19:24:16.105274+0000","last_change":"2023-11-08T19:24:16.105274+0000","last_active":"2023-11-08T19:24:15.096674+0000","last_peered":"2023-11-08T19:24:15.096674+0000","last_clean":"2023-11-08T19:24:15.096674+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.105274+0000","last_undegraded":"2023-11-08T19:24:16.105274+0000","last_fullsized":"2023-11-08T19:24:16.105274+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:12:27.366563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.111075+0000","last_change":"2023-11-08T19:24:16.111075+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.111075+0000","last_undegraded":"2023-11-08T19:24:16.111075+0000","last_fullsized":"2023-11-08T19:24:16.111075+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":3,"reported_epoch":37,"state":"creating+activating","last_fresh":"2023-11-08T19:24:16.105285+0000","last_change":"2023-11-08T19:24:16.105285+0000","last_active":"2023-11-08T19:24:15.096674+0000","last_peered":"2023-11-08T19:24:15.096674+0000","last_clean":"2023-11-08T19:24:15.096674+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.105285+0000","last_undegraded":"2023-11-08T19:24:16.105285+0000","last_fullsized":"2023-11-08T19:24:16.105285+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:00:00.984858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":["2","4"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.110601+0000","last_change":"2023-11-08T19:24:16.110601+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.110601+0000","last_undegraded":"2023-11-08T19:24:16.110601+0000","last_fullsized":"2023-11-08T19:24:16.110601+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-11-08T19:24:15.105379+0000","last_change":"2023-11-08T19:24:15.105379+0000","last_active":"2023-11-08T19:24:15.096674+0000","last_peered":"2023-11-08T19:24:15.096674+0000","last_clean":"2023-11-08T19:24:15.096674+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:15.105379+0000","last_undegraded":"2023-11-08T19:24:15.105379+0000","last_fullsized":"2023-11-08T19:24:15.105379+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.118531+0000","last_change":"2023-11-08T19:24:16.118531+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.118531+0000","last_undegraded":"2023-11-08T19:24:16.118531+0000","last_fullsized":"2023-11-08T19:24:16.118531+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":3,"reported_epoch":37,"state":"creating+activating","last_fresh":"2023-11-08T19:24:16.106636+0000","last_change":"2023-11-08T19:24:16.106636+0000","last_active":"2023-11-08T19:24:15.096674+0000","last_peered":"2023-11-08T19:24:15.096674+0000","last_clean":"2023-11-08T19:24:15.096674+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.106636+0000","last_undegraded":"2023-11-08T19:24:16.106636+0000","last_fullsized":"2023-11-08T19:24:16.106636+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:21:28.704207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.112087+0000","last_change":"2023-11-08T19:24:16.112087+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.112087+0000","last_undegraded":"2023-11-08T19:24:16.112087+0000","last_fullsized":"2023-11-08T19:24:16.112087+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":3,"reported_epoch":37,"state":"creating+activating","last_fresh":"2023-11-08T19:24:16.108247+0000","last_change":"2023-11-08T19:24:16.108247+0000","last_active":"2023-11-08T19:24:15.096674+0000","last_peered":"2023-11-08T19:24:15.096674+0000","last_clean":"2023-11-08T19:24:15.096674+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.108247+0000","last_undegraded":"2023-11-08T19:24:16.108247+0000","last_fullsized":"2023-11-08T19:24:16.108247+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:29:45.264000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":["5","1"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:16.098411+0000","last_change":"2023-11-08T19:24:16.098411+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.098411+0000","last_undegraded":"2023-11-08T19:24:16.098411+0000","last_fullsized":"2023-11-08T19:24:16.098411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":3,"reported_epoch":37,"state":"creating+activating","last_fresh":"2023-11-08T19:24:16.105795+0000","last_change":"2023-11-08T19:24:16.105795+0000","last_active":"2023-11-08T19:24:15.096674+0000","last_peered":"2023-11-08T19:24:15.096674+0000","last_clean":"2023-11-08T19:24:15.096674+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.105795+0000","last_undegraded":"2023-11-08T19:24:16.105795+0000","last_fullsized":"2023-11-08T19:24:16.105795+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:57:50.625953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":["2","5"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.111509+0000","last_change":"2023-11-08T19:24:16.111509+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.111509+0000","last_undegraded":"2023-11-08T19:24:16.111509+0000","last_fullsized":"2023-11-08T19:24:16.111509+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":3,"reported_epoch":37,"state":"creating+activating","last_fresh":"2023-11-08T19:24:16.109823+0000","last_change":"2023-11-08T19:24:16.109823+0000","last_active":"2023-11-08T19:24:15.096674+0000","last_peered":"2023-11-08T19:24:15.096674+0000","last_clean":"2023-11-08T19:24:15.096674+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.109823+0000","last_undegraded":"2023-11-08T19:24:16.109823+0000","last_fullsized":"2023-11-08T19:24:16.109823+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:55:14.474408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.112822+0000","last_change":"2023-11-08T19:24:16.112822+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.112822+0000","last_undegraded":"2023-11-08T19:24:16.112822+0000","last_fullsized":"2023-11-08T19:24:16.112822+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":3,"reported_epoch":37,"state":"creating+activating","last_fresh":"2023-11-08T19:24:16.109981+0000","last_change":"2023-11-08T19:24:16.109981+0000","last_active":"2023-11-08T19:24:15.096674+0000","last_peered":"2023-11-08T19:24:15.096674+0000","last_clean":"2023-11-08T19:24:15.096674+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.109981+0000","last_undegraded":"2023-11-08T19:24:16.109981+0000","last_fullsized":"2023-11-08T19:24:16.109981+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:20:58.002466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.110942+0000","last_change":"2023-11-08T19:24:16.110942+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.110942+0000","last_undegraded":"2023-11-08T19:24:16.110942+0000","last_fullsized":"2023-11-08T19:24:16.110942+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":3,"reported_epoch":37,"state":"creating+activating","last_fresh":"2023-11-08T19:24:16.106153+0000","last_change":"2023-11-08T19:24:16.106153+0000","last_active":"2023-11-08T19:24:15.096674+0000","last_peered":"2023-11-08T19:24:15.096674+0000","last_clean":"2023-11-08T19:24:15.096674+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.106153+0000","last_undegraded":"2023-11-08T19:24:16.106153+0000","last_fullsized":"2023-11-08T19:24:16.106153+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:29:45.264000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":["6","0"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.104903+0000","last_change":"2023-11-08T19:24:16.104903+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.104903+0000","last_undegraded":"2023-11-08T19:24:16.104903+0000","last_fullsized":"2023-11-08T19:24:16.104903+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-08T19:24:16.124372+0000","last_change":"2023-11-08T19:24:16.124372+0000","last_active":"2023-11-08T19:24:16.124372+0000","last_peered":"2023-11-08T19:24:16.124372+0000","last_clean":"2023-11-08T19:24:16.124372+0000","last_became_active":"2023-11-08T19:24:16.124097+0000","last_became_peered":"2023-11-08T19:24:16.124097+0000","last_unstale":"2023-11-08T19:24:16.124372+0000","last_undegraded":"2023-11-08T19:24:16.124372+0000","last_fullsized":"2023-11-08T19:24:16.124372+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:33:43.650501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:16.098411+0000","last_change":"2023-11-08T19:24:16.098411+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.098411+0000","last_undegraded":"2023-11-08T19:24:16.098411+0000","last_fullsized":"2023-11-08T19:24:16.098411+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":3,"reported_epoch":37,"state":"creating+activating","last_fresh":"2023-11-08T19:24:16.110922+0000","last_change":"2023-11-08T19:24:16.110922+0000","last_active":"2023-11-08T19:24:15.096674+0000","last_peered":"2023-11-08T19:24:15.096674+0000","last_clean":"2023-11-08T19:24:15.096674+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.110922+0000","last_undegraded":"2023-11-08T19:24:16.110922+0000","last_fullsized":"2023-11-08T19:24:16.110922+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:11:10.911014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-11-08T19:24:16.110534+0000","last_change":"2023-11-08T19:24:16.110534+0000","last_active":"2023-11-08T19:24:16.098411+0000","last_peered":"2023-11-08T19:24:16.098411+0000","last_clean":"2023-11-08T19:24:16.098411+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:16.110534+0000","last_undegraded":"2023-11-08T19:24:16.110534+0000","last_fullsized":"2023-11-08T19:24:16.110534+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-11-08T19:24:15.106050+0000","last_change":"2023-11-08T19:24:15.106050+0000","last_active":"2023-11-08T19:24:15.096674+0000","last_peered":"2023-11-08T19:24:15.096674+0000","last_clean":"2023-11-08T19:24:15.096674+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:15.106050+0000","last_undegraded":"2023-11-08T19:24:15.106050+0000","last_fullsized":"2023-11-08T19:24:15.106050+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":177,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-08T19:24:10.353372+0000","last_change":"2023-11-08T19:22:58.054283+0000","last_active":"2023-11-08T19:24:10.353372+0000","last_peered":"2023-11-08T19:24:10.353372+0000","last_clean":"2023-11-08T19:24:10.353372+0000","last_became_active":"2023-11-08T19:22:58.053337+0000","last_became_peered":"2023-11-08T19:22:58.053337+0000","last_unstale":"2023-11-08T19:24:10.353372+0000","last_undegraded":"2023-11-08T19:24:10.353372+0000","last_fullsized":"2023-11-08T19:24:10.353372+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:22:56.479654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:22:56.479654+0000","last_clean_scrub_stamp":"2023-11-08T19:22:56.479654+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:16:05.317001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":106,"acting":106,"num_store_stats":7},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":995328,"data_stored":758032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.70199999999999996}]},{"osd":1,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.626}]},{"osd":2,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.67700000000000005}]},{"osd":3,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.72199999999999998}]},{"osd":4,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.753},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.73899999999999999}]},{"osd":5,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.91100000000000003}]},{"osd":6,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.80100000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":173801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.62},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.436}]},{"osd":1,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.57899999999999996}]},{"osd":2,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.65200000000000002}]},{"osd":3,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":0.54500000000000004}]},{"osd":4,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.66400000000000003}]},{"osd":5,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.495},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.51500000000000001}]},{"osd":7,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.63700000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":173801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":2.1850000000000001,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":0.39900000000000002}]},{"osd":2,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.29799999999999999}]},{"osd":3,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":2.2120000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.434}]},{"osd":4,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.66600000000000004}]},{"osd":5,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.57499999999999996}]},{"osd":6,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":2.093,"5min":2.093,"15min":2.093},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.59599999999999997}]},{"osd":7,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":2.1299999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.65300000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":1007616,"data_stored":764169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":19.295999999999999,"5min":19.295999999999999,"15min":19.295999999999999},"last":0.34499999999999997},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":17.204000000000001,"5min":17.204000000000001,"15min":17.204000000000001},"last":0.252}]},{"osd":2,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":6.524,"5min":6.524,"15min":6.524},"last":0.316},{"interface":"front","average":{"1min":1.169,"5min":1.169,"15min":1.169},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":17.175000000000001,"5min":17.175000000000001,"15min":17.175000000000001},"last":0.35699999999999998}]},{"osd":3,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":14.324,"5min":14.324,"15min":14.324},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.40200000000000002}]},{"osd":4,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.304,"15min":1.304},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":17.056000000000001,"5min":17.056000000000001,"15min":17.056000000000001},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":5.0289999999999999,"5min":5.0289999999999999,"15min":5.0289999999999999},"last":0.56299999999999994}]},{"osd":5,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":5.0590000000000002,"5min":5.0590000000000002,"15min":5.0590000000000002},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.47199999999999998}]},{"osd":6,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.49299999999999999},{"interface":"front","average":{"1min":1.357,"5min":1.357,"15min":1.357},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":17.111999999999998,"5min":17.111999999999998,"15min":17.111999999999998},"last":0.55500000000000005}]},{"osd":7,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.371,"15min":1.371},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":17.146000000000001,"5min":17.146000000000001,"15min":17.146000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":4.9829999999999997,"5min":4.9829999999999997,"15min":4.9829999999999997},"last":0.52400000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":173801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":3.4100000000000001,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":0.20899999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":3.4369999999999998,"5min":3.4369999999999998,"15min":3.4369999999999998},"last":0.29599999999999999}]},{"osd":1,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":4.0679999999999996,"5min":4.0679999999999996,"15min":4.0679999999999996},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":4.3499999999999996,"5min":4.3499999999999996,"15min":4.3499999999999996},"last":0.36099999999999999}]},{"osd":3,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":3.8580000000000001,"5min":3.8580000000000001,"15min":3.8580000000000001},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":3.476,"5min":3.476,"15min":3.476},"last":0.28599999999999998}]},{"osd":4,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":4.0090000000000003,"5min":4.0090000000000003,"15min":4.0090000000000003},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":4.1040000000000001,"5min":4.1040000000000001,"15min":4.1040000000000001},"last":0.46000000000000002}]},{"osd":5,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":4.0869999999999997,"5min":4.0869999999999997,"15min":4.0869999999999997},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":3.843,"5min":3.843,"15min":3.843},"last":0.443}]},{"osd":6,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":4.1399999999999997,"5min":4.1399999999999997,"15min":4.1399999999999997},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":4.0499999999999998,"5min":4.0499999999999998,"15min":4.0499999999999998},"last":0.503}]},{"osd":7,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":4.157,"5min":4.157,"15min":4.157},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":4.1710000000000003,"5min":4.1710000000000003,"15min":4.1710000000000003},"last":0.61499999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":173801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.36099999999999999}]},{"osd":1,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":0.37},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.33300000000000002}]},{"osd":2,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.315}]},{"osd":4,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.57099999999999995}]},{"osd":5,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.53100000000000003}]},{"osd":6,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.46400000000000002}]},{"osd":7,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.60999999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":173801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":2.2090000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.503}]},{"osd":1,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.627},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.45100000000000001}]},{"osd":2,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":2.8490000000000002,"5min":2.8490000000000002,"15min":2.8490000000000002},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.47999999999999998}]},{"osd":3,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":3.4849999999999999,"5min":3.4849999999999999,"15min":3.4849999999999999},"last":0.65400000000000003}]},{"osd":5,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.54400000000000004}]},{"osd":6,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":4.1529999999999996,"5min":4.1529999999999996,"15min":4.1529999999999996},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.69699999999999995}]},{"osd":7,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":5.5359999999999996,"5min":5.5359999999999996,"15min":5.5359999999999996},"last":0.70999999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":173801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.61499999999999999}]},{"osd":1,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":2.2919999999999998,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":0.47699999999999998}]},{"osd":2,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.495}]},{"osd":3,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.56799999999999995}]},{"osd":4,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":2.3300000000000001,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.70799999999999996}]},{"osd":6,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":2.3650000000000002,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":0.433}]},{"osd":7,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.66700000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:24:21.986 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:24:22.141 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.139+0000 7fcdcfe78700 1 Processor -- start 2023-11-08T19:24:22.141 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.139+0000 7fcdcfe78700 1 -- start start 2023-11-08T19:24:22.144 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.140+0000 7fcdcfe78700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fcdc81624c0 0x7fcdc806bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:22.145 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.140+0000 7fcdcfe78700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcdc8066c80 0x7fcdc806c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:22.145 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.140+0000 7fcdcfe78700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdc806e2a0 con 0x7fcdc80ca630 2023-11-08T19:24:22.145 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.140+0000 7fcdcfe78700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdc80cc5c0 con 0x7fcdc81624c0 2023-11-08T19:24:22.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.140+0000 7fcdcfe78700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc806d970 con 0x7fcdc8066c80 2023-11-08T19:24:22.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.140+0000 7fcdcdc14700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fcdc81624c0 0x7fcdc806bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:22.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.140+0000 7fcdcdc14700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fcdc81624c0 0x7fcdc806bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39376/0 (socket says 172.21.15.149:39376) 2023-11-08T19:24:22.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.140+0000 7fcdcdc14700 1 -- 172.21.15.149:0/4064893734 learned_addr learned my addr 172.21.15.149:0/4064893734 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:22.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.140+0000 7fcdcd413700 1 --2- 172.21.15.149:0/4064893734 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcdc8066c80 0x7fcdc806c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:22.148 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.140+0000 7fcdcdc14700 1 -- 172.21.15.149:0/4064893734 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcdc8066c80 msgr2=0x7fcdc806c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:22.148 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.140+0000 7fcdcdc14700 1 --2- 172.21.15.149:0/4064893734 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcdc8066c80 0x7fcdc806c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:22.148 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.140+0000 7fcdcdc14700 1 -- 172.21.15.149:0/4064893734 >> v1:172.21.15.160:6789/0 conn(0x7fcdc80ca630 legacy=0x7fcdc80caac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:22.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.140+0000 7fcdcdc14700 1 -- 172.21.15.149:0/4064893734 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdc806dc50 con 0x7fcdc81624c0 2023-11-08T19:24:22.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.140+0000 7fcdcdc14700 1 --2- 172.21.15.149:0/4064893734 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcdc81624c0 0x7fcdc806bb90 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fcdc40098f0 tx=0x7fcdc4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a846a858cc94ace1 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:22.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.140+0000 7fcdccc12700 1 -- 172.21.15.149:0/4064893734 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc4004230 con 0x7fcdc81624c0 2023-11-08T19:24:22.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.141+0000 7fcdccc12700 1 -- 172.21.15.149:0/4064893734 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdc4004390 con 0x7fcdc81624c0 2023-11-08T19:24:22.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.141+0000 7fcdccc12700 1 -- 172.21.15.149:0/4064893734 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc40036a0 con 0x7fcdc81624c0 2023-11-08T19:24:22.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.141+0000 7fcdcfe78700 1 -- 172.21.15.149:0/4064893734 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcdc81624c0 msgr2=0x7fcdc806bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:22.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.141+0000 7fcdcfe78700 1 --2- 172.21.15.149:0/4064893734 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcdc81624c0 0x7fcdc806bb90 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fcdc40098f0 tx=0x7fcdc4009c00 comp rx=0 tx=0).stop 2023-11-08T19:24:22.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.141+0000 7fcdcfe78700 1 -- 172.21.15.149:0/4064893734 shutdown_connections 2023-11-08T19:24:22.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.141+0000 7fcdcfe78700 1 --2- 172.21.15.149:0/4064893734 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcdc81624c0 0x7fcdc806bb90 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:22.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.141+0000 7fcdcfe78700 1 --2- 172.21.15.149:0/4064893734 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcdc8066c80 0x7fcdc806c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:22.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.141+0000 7fcdcfe78700 1 -- 172.21.15.149:0/4064893734 >> 172.21.15.149:0/4064893734 conn(0x7fcdc8071720 msgr2=0x7fcdc8071b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:22.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.141+0000 7fcdcfe78700 1 -- 172.21.15.149:0/4064893734 shutdown_connections 2023-11-08T19:24:22.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.141+0000 7fcdcfe78700 1 -- 172.21.15.149:0/4064893734 wait complete. 2023-11-08T19:24:22.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.142+0000 7fcdcfe78700 1 Processor -- start 2023-11-08T19:24:22.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.142+0000 7fcdcfe78700 1 -- start start 2023-11-08T19:24:22.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.143+0000 7fcdcfe78700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcdc8066c80 0x7fcdc8156400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:22.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.143+0000 7fcdcfe78700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcdc80ca630 0x7fcdc80c4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:22.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.143+0000 7fcdcfe78700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcdc81624c0 0x7fcdc80ad910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:22.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.143+0000 7fcdcfe78700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc80b2a90 con 0x7fcdc8066c80 2023-11-08T19:24:22.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.143+0000 7fcdcfe78700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc80c6ed0 con 0x7fcdc80ca630 2023-11-08T19:24:22.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.143+0000 7fcdcfe78700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc80c71b0 con 0x7fcdc81624c0 2023-11-08T19:24:22.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.143+0000 7fcdcdc14700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcdc8066c80 0x7fcdc8156400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:22.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.143+0000 7fcdcdc14700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcdc8066c80 0x7fcdc8156400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39380/0 (socket says 172.21.15.149:39380) 2023-11-08T19:24:22.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.143+0000 7fcdcdc14700 1 -- 172.21.15.149:0/3173887499 learned_addr learned my addr 172.21.15.149:0/3173887499 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:22.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.143+0000 7fcdce415700 1 --2- 172.21.15.149:0/3173887499 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcdc81624c0 0x7fcdc80ad910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:22.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.143+0000 7fcdcd413700 1 --2- 172.21.15.149:0/3173887499 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcdc80ca630 0x7fcdc80c4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:22.158 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.144+0000 7fcdcdc14700 1 -- 172.21.15.149:0/3173887499 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcdc81624c0 msgr2=0x7fcdc80ad910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:22.158 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.144+0000 7fcdcdc14700 1 --2- 172.21.15.149:0/3173887499 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcdc81624c0 0x7fcdc80ad910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:22.158 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.144+0000 7fcdcdc14700 1 -- 172.21.15.149:0/3173887499 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcdc80ca630 msgr2=0x7fcdc80c4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:22.158 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.144+0000 7fcdcdc14700 1 --2- 172.21.15.149:0/3173887499 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcdc80ca630 0x7fcdc80c4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:22.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.144+0000 7fcdcdc14700 1 -- 172.21.15.149:0/3173887499 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdc4009550 con 0x7fcdc8066c80 2023-11-08T19:24:22.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.144+0000 7fcdcdc14700 1 --2- 172.21.15.149:0/3173887499 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcdc8066c80 0x7fcdc8156400 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fcdc8070a50 tx=0x7fcdc4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:22.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.144+0000 7fcdbe7fc700 1 -- 172.21.15.149:0/3173887499 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc400b860 con 0x7fcdc8066c80 2023-11-08T19:24:22.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.144+0000 7fcdbe7fc700 1 -- 172.21.15.149:0/3173887499 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdc400ba00 con 0x7fcdc8066c80 2023-11-08T19:24:22.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.144+0000 7fcdbe7fc700 1 -- 172.21.15.149:0/3173887499 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc400bdb0 con 0x7fcdc8066c80 2023-11-08T19:24:22.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.144+0000 7fcdcfe78700 1 -- 172.21.15.149:0/3173887499 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdc8156940 con 0x7fcdc8066c80 2023-11-08T19:24:22.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.144+0000 7fcdcfe78700 1 -- 172.21.15.149:0/3173887499 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdc80c5210 con 0x7fcdc8066c80 2023-11-08T19:24:22.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.145+0000 7fcdcfe78700 1 -- 172.21.15.149:0/3173887499 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdc80745f0 con 0x7fcdc8066c80 2023-11-08T19:24:22.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.146+0000 7fcdbe7fc700 1 -- 172.21.15.149:0/3173887499 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcdc401b440 con 0x7fcdc8066c80 2023-11-08T19:24:22.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.146+0000 7fcdbe7fc700 1 --2- 172.21.15.149:0/3173887499 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fcdac06af50 0x7fcdac06d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:22.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.146+0000 7fcdbe7fc700 1 -- 172.21.15.149:0/3173887499 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fcdc408b010 con 0x7fcdc8066c80 2023-11-08T19:24:22.161 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.146+0000 7fcdcd413700 1 --2- 172.21.15.149:0/3173887499 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fcdac06af50 0x7fcdac06d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:22.161 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.146+0000 7fcdcd413700 1 --2- 172.21.15.149:0/3173887499 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fcdac06af50 0x7fcdac06d410 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fcdc80b5d20 tx=0x7fcdb8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:22.161 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.151+0000 7fcdbe7fc700 1 -- 172.21.15.149:0/3173887499 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcdc40560f0 con 0x7fcdc8066c80 2023-11-08T19:24:22.339 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.337+0000 7fcdcfe78700 1 -- 172.21.15.149:0/3173887499 --> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcdc80722b0 con 0x7fcdac06af50 2023-11-08T19:24:22.347 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.344+0000 7fcdbe7fc700 1 -- 172.21.15.149:0/3173887499 <== mgr.4104 v2:172.21.15.149:6832/1929837472 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289538 (secure 0 0 0) 0x7fcdc80722b0 con 0x7fcdac06af50 2023-11-08T19:24:22.350 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:24:22.353 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.348+0000 7fcdcfe78700 1 -- 172.21.15.149:0/3173887499 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fcdac06af50 msgr2=0x7fcdac06d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:22.353 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.348+0000 7fcdcfe78700 1 --2- 172.21.15.149:0/3173887499 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fcdac06af50 0x7fcdac06d410 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fcdc80b5d20 tx=0x7fcdb8008040 comp rx=0 tx=0).stop 2023-11-08T19:24:22.353 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.348+0000 7fcdcfe78700 1 -- 172.21.15.149:0/3173887499 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcdc8066c80 msgr2=0x7fcdc8156400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:22.353 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.348+0000 7fcdcfe78700 1 --2- 172.21.15.149:0/3173887499 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcdc8066c80 0x7fcdc8156400 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fcdc8070a50 tx=0x7fcdc4004750 comp rx=0 tx=0).stop 2023-11-08T19:24:22.353 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.348+0000 7fcdcfe78700 1 -- 172.21.15.149:0/3173887499 shutdown_connections 2023-11-08T19:24:22.354 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.348+0000 7fcdcfe78700 1 --2- 172.21.15.149:0/3173887499 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fcdac06af50 0x7fcdac06d410 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:22.354 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.348+0000 7fcdcfe78700 1 --2- 172.21.15.149:0/3173887499 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcdc81624c0 0x7fcdc80ad910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:22.354 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.348+0000 7fcdcfe78700 1 --2- 172.21.15.149:0/3173887499 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcdc8066c80 0x7fcdc8156400 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:22.354 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.348+0000 7fcdcfe78700 1 --2- 172.21.15.149:0/3173887499 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcdc80ca630 0x7fcdc80c4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:22.354 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.348+0000 7fcdcfe78700 1 -- 172.21.15.149:0/3173887499 >> 172.21.15.149:0/3173887499 conn(0x7fcdc8071720 msgr2=0x7fcdc80af860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:22.355 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.348+0000 7fcdcfe78700 1 -- 172.21.15.149:0/3173887499 shutdown_connections 2023-11-08T19:24:22.355 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.348+0000 7fcdcfe78700 1 -- 172.21.15.149:0/3173887499 wait complete. 2023-11-08T19:24:22.355 INFO:teuthology.orchestra.run.smithi149.stderr:dumped all 2023-11-08T19:24:22.362 INFO:teuthology.orchestra.run.smithi149.stdout:{"pg_ready":true,"pg_map":{"version":75,"stamp":"2023-11-08T19:24:22.002583+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":167,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220904,"kb_used_data":4732,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753816,"statfs":{"total":773094113280,"available":772867907584,"internally_reserved":0,"allocated":4845568,"data_stored":2731824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001211"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.171770+0000","last_change":"2023-11-08T19:24:17.123033+0000","last_active":"2023-11-08T19:24:19.171770+0000","last_peered":"2023-11-08T19:24:19.171770+0000","last_clean":"2023-11-08T19:24:19.171770+0000","last_became_active":"2023-11-08T19:24:17.122782+0000","last_became_peered":"2023-11-08T19:24:17.122782+0000","last_unstale":"2023-11-08T19:24:19.171770+0000","last_undegraded":"2023-11-08T19:24:19.171770+0000","last_fullsized":"2023-11-08T19:24:19.171770+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:18:26.252263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.171643+0000","last_change":"2023-11-08T19:24:17.119814+0000","last_active":"2023-11-08T19:24:19.171643+0000","last_peered":"2023-11-08T19:24:19.171643+0000","last_clean":"2023-11-08T19:24:19.171643+0000","last_became_active":"2023-11-08T19:24:17.119581+0000","last_became_peered":"2023-11-08T19:24:17.119581+0000","last_unstale":"2023-11-08T19:24:19.171643+0000","last_undegraded":"2023-11-08T19:24:19.171643+0000","last_fullsized":"2023-11-08T19:24:19.171643+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:39:50.238810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.620818+0000","last_change":"2023-11-08T19:24:17.122049+0000","last_active":"2023-11-08T19:24:19.620818+0000","last_peered":"2023-11-08T19:24:19.620818+0000","last_clean":"2023-11-08T19:24:19.620818+0000","last_became_active":"2023-11-08T19:24:17.121756+0000","last_became_peered":"2023-11-08T19:24:17.121756+0000","last_unstale":"2023-11-08T19:24:19.620818+0000","last_undegraded":"2023-11-08T19:24:19.620818+0000","last_fullsized":"2023-11-08T19:24:19.620818+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:16:13.162177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.626466+0000","last_change":"2023-11-08T19:24:17.111612+0000","last_active":"2023-11-08T19:24:18.626466+0000","last_peered":"2023-11-08T19:24:18.626466+0000","last_clean":"2023-11-08T19:24:18.626466+0000","last_became_active":"2023-11-08T19:24:17.111250+0000","last_became_peered":"2023-11-08T19:24:17.111250+0000","last_unstale":"2023-11-08T19:24:18.626466+0000","last_undegraded":"2023-11-08T19:24:18.626466+0000","last_fullsized":"2023-11-08T19:24:18.626466+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:20:59.004203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.626465+0000","last_change":"2023-11-08T19:24:17.111927+0000","last_active":"2023-11-08T19:24:18.626465+0000","last_peered":"2023-11-08T19:24:18.626465+0000","last_clean":"2023-11-08T19:24:18.626465+0000","last_became_active":"2023-11-08T19:24:17.111621+0000","last_became_peered":"2023-11-08T19:24:17.111621+0000","last_unstale":"2023-11-08T19:24:18.626465+0000","last_undegraded":"2023-11-08T19:24:18.626465+0000","last_fullsized":"2023-11-08T19:24:18.626465+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:56:23.821648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.108465+0000","last_change":"2023-11-08T19:24:17.120284+0000","last_active":"2023-11-08T19:24:18.108465+0000","last_peered":"2023-11-08T19:24:18.108465+0000","last_clean":"2023-11-08T19:24:18.108465+0000","last_became_active":"2023-11-08T19:24:17.120029+0000","last_became_peered":"2023-11-08T19:24:17.120029+0000","last_unstale":"2023-11-08T19:24:18.108465+0000","last_undegraded":"2023-11-08T19:24:18.108465+0000","last_fullsized":"2023-11-08T19:24:18.108465+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:33:32.862712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.629168+0000","last_change":"2023-11-08T19:24:17.126220+0000","last_active":"2023-11-08T19:24:18.629168+0000","last_peered":"2023-11-08T19:24:18.629168+0000","last_clean":"2023-11-08T19:24:18.629168+0000","last_became_active":"2023-11-08T19:24:17.125965+0000","last_became_peered":"2023-11-08T19:24:17.125965+0000","last_unstale":"2023-11-08T19:24:18.629168+0000","last_undegraded":"2023-11-08T19:24:18.629168+0000","last_fullsized":"2023-11-08T19:24:18.629168+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:05:23.478967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.171327+0000","last_change":"2023-11-08T19:24:17.123508+0000","last_active":"2023-11-08T19:24:19.171327+0000","last_peered":"2023-11-08T19:24:19.171327+0000","last_clean":"2023-11-08T19:24:19.171327+0000","last_became_active":"2023-11-08T19:24:17.123240+0000","last_became_peered":"2023-11-08T19:24:17.123240+0000","last_unstale":"2023-11-08T19:24:19.171327+0000","last_undegraded":"2023-11-08T19:24:19.171327+0000","last_fullsized":"2023-11-08T19:24:19.171327+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:05:23.478967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.621184+0000","last_change":"2023-11-08T19:24:17.122127+0000","last_active":"2023-11-08T19:24:19.621184+0000","last_peered":"2023-11-08T19:24:19.621184+0000","last_clean":"2023-11-08T19:24:19.621184+0000","last_became_active":"2023-11-08T19:24:17.121856+0000","last_became_peered":"2023-11-08T19:24:17.121856+0000","last_unstale":"2023-11-08T19:24:19.621184+0000","last_undegraded":"2023-11-08T19:24:19.621184+0000","last_fullsized":"2023-11-08T19:24:19.621184+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:41:09.802388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.629558+0000","last_change":"2023-11-08T19:24:17.126282+0000","last_active":"2023-11-08T19:24:18.629558+0000","last_peered":"2023-11-08T19:24:18.629558+0000","last_clean":"2023-11-08T19:24:18.629558+0000","last_became_active":"2023-11-08T19:24:17.125897+0000","last_became_peered":"2023-11-08T19:24:17.125897+0000","last_unstale":"2023-11-08T19:24:18.629558+0000","last_undegraded":"2023-11-08T19:24:18.629558+0000","last_fullsized":"2023-11-08T19:24:18.629558+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:18:26.252263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.629549+0000","last_change":"2023-11-08T19:24:17.119545+0000","last_active":"2023-11-08T19:24:18.629549+0000","last_peered":"2023-11-08T19:24:18.629549+0000","last_clean":"2023-11-08T19:24:18.629549+0000","last_became_active":"2023-11-08T19:24:17.119216+0000","last_became_peered":"2023-11-08T19:24:17.119216+0000","last_unstale":"2023-11-08T19:24:18.629549+0000","last_undegraded":"2023-11-08T19:24:18.629549+0000","last_fullsized":"2023-11-08T19:24:18.629549+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:53:54.966516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.620933+0000","last_change":"2023-11-08T19:24:17.120015+0000","last_active":"2023-11-08T19:24:19.620933+0000","last_peered":"2023-11-08T19:24:19.620933+0000","last_clean":"2023-11-08T19:24:19.620933+0000","last_became_active":"2023-11-08T19:24:17.119727+0000","last_became_peered":"2023-11-08T19:24:17.119727+0000","last_unstale":"2023-11-08T19:24:19.620933+0000","last_undegraded":"2023-11-08T19:24:19.620933+0000","last_fullsized":"2023-11-08T19:24:19.620933+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:53:38.138608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.629195+0000","last_change":"2023-11-08T19:24:17.128141+0000","last_active":"2023-11-08T19:24:18.629195+0000","last_peered":"2023-11-08T19:24:18.629195+0000","last_clean":"2023-11-08T19:24:18.629195+0000","last_became_active":"2023-11-08T19:24:17.127788+0000","last_became_peered":"2023-11-08T19:24:17.127788+0000","last_unstale":"2023-11-08T19:24:18.629195+0000","last_undegraded":"2023-11-08T19:24:18.629195+0000","last_fullsized":"2023-11-08T19:24:18.629195+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:21:41.966251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.109986+0000","last_change":"2023-11-08T19:24:17.116970+0000","last_active":"2023-11-08T19:24:18.109986+0000","last_peered":"2023-11-08T19:24:18.109986+0000","last_clean":"2023-11-08T19:24:18.109986+0000","last_became_active":"2023-11-08T19:24:17.116708+0000","last_became_peered":"2023-11-08T19:24:17.116708+0000","last_unstale":"2023-11-08T19:24:18.109986+0000","last_undegraded":"2023-11-08T19:24:18.109986+0000","last_fullsized":"2023-11-08T19:24:18.109986+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:12:58.048320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.629201+0000","last_change":"2023-11-08T19:24:17.119392+0000","last_active":"2023-11-08T19:24:18.629201+0000","last_peered":"2023-11-08T19:24:18.629201+0000","last_clean":"2023-11-08T19:24:18.629201+0000","last_became_active":"2023-11-08T19:24:17.119100+0000","last_became_peered":"2023-11-08T19:24:17.119100+0000","last_unstale":"2023-11-08T19:24:18.629201+0000","last_undegraded":"2023-11-08T19:24:18.629201+0000","last_fullsized":"2023-11-08T19:24:18.629201+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:08:50.861077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.639524+0000","last_change":"2023-11-08T19:24:17.127685+0000","last_active":"2023-11-08T19:24:19.639524+0000","last_peered":"2023-11-08T19:24:19.639524+0000","last_clean":"2023-11-08T19:24:19.639524+0000","last_became_active":"2023-11-08T19:24:17.127019+0000","last_became_peered":"2023-11-08T19:24:17.127019+0000","last_unstale":"2023-11-08T19:24:19.639524+0000","last_undegraded":"2023-11-08T19:24:19.639524+0000","last_fullsized":"2023-11-08T19:24:19.639524+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:38:34.568472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.640116+0000","last_change":"2023-11-08T19:24:17.125050+0000","last_active":"2023-11-08T19:24:19.640116+0000","last_peered":"2023-11-08T19:24:19.640116+0000","last_clean":"2023-11-08T19:24:19.640116+0000","last_became_active":"2023-11-08T19:24:17.124290+0000","last_became_peered":"2023-11-08T19:24:17.124290+0000","last_unstale":"2023-11-08T19:24:19.640116+0000","last_undegraded":"2023-11-08T19:24:19.640116+0000","last_fullsized":"2023-11-08T19:24:19.640116+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:12.060745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.109617+0000","last_change":"2023-11-08T19:24:17.118666+0000","last_active":"2023-11-08T19:24:18.109617+0000","last_peered":"2023-11-08T19:24:18.109617+0000","last_clean":"2023-11-08T19:24:18.109617+0000","last_became_active":"2023-11-08T19:24:17.118272+0000","last_became_peered":"2023-11-08T19:24:17.118272+0000","last_unstale":"2023-11-08T19:24:18.109617+0000","last_undegraded":"2023-11-08T19:24:18.109617+0000","last_fullsized":"2023-11-08T19:24:18.109617+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:42:55.799453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.626562+0000","last_change":"2023-11-08T19:24:17.120411+0000","last_active":"2023-11-08T19:24:18.626562+0000","last_peered":"2023-11-08T19:24:18.626562+0000","last_clean":"2023-11-08T19:24:18.626562+0000","last_became_active":"2023-11-08T19:24:17.120029+0000","last_became_peered":"2023-11-08T19:24:17.120029+0000","last_unstale":"2023-11-08T19:24:18.626562+0000","last_undegraded":"2023-11-08T19:24:18.626562+0000","last_fullsized":"2023-11-08T19:24:18.626562+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:33:44.652238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.109500+0000","last_change":"2023-11-08T19:24:17.115499+0000","last_active":"2023-11-08T19:24:18.109500+0000","last_peered":"2023-11-08T19:24:18.109500+0000","last_clean":"2023-11-08T19:24:18.109500+0000","last_became_active":"2023-11-08T19:24:17.115213+0000","last_became_peered":"2023-11-08T19:24:17.115213+0000","last_unstale":"2023-11-08T19:24:18.109500+0000","last_undegraded":"2023-11-08T19:24:18.109500+0000","last_fullsized":"2023-11-08T19:24:18.109500+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:32:37.195254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.629278+0000","last_change":"2023-11-08T19:24:17.122189+0000","last_active":"2023-11-08T19:24:18.629278+0000","last_peered":"2023-11-08T19:24:18.629278+0000","last_clean":"2023-11-08T19:24:18.629278+0000","last_became_active":"2023-11-08T19:24:17.121889+0000","last_became_peered":"2023-11-08T19:24:17.121889+0000","last_unstale":"2023-11-08T19:24:18.629278+0000","last_undegraded":"2023-11-08T19:24:18.629278+0000","last_fullsized":"2023-11-08T19:24:18.629278+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:12.060745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.109547+0000","last_change":"2023-11-08T19:24:17.114478+0000","last_active":"2023-11-08T19:24:18.109547+0000","last_peered":"2023-11-08T19:24:18.109547+0000","last_clean":"2023-11-08T19:24:18.109547+0000","last_became_active":"2023-11-08T19:24:17.114207+0000","last_became_peered":"2023-11-08T19:24:17.114207+0000","last_unstale":"2023-11-08T19:24:18.109547+0000","last_undegraded":"2023-11-08T19:24:18.109547+0000","last_fullsized":"2023-11-08T19:24:18.109547+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:32:37.195254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.639778+0000","last_change":"2023-11-08T19:24:17.127471+0000","last_active":"2023-11-08T19:24:19.639778+0000","last_peered":"2023-11-08T19:24:19.639778+0000","last_clean":"2023-11-08T19:24:19.639778+0000","last_became_active":"2023-11-08T19:24:17.125384+0000","last_became_peered":"2023-11-08T19:24:17.125384+0000","last_unstale":"2023-11-08T19:24:19.639778+0000","last_undegraded":"2023-11-08T19:24:19.639778+0000","last_fullsized":"2023-11-08T19:24:19.639778+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:56:51.753457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.626382+0000","last_change":"2023-11-08T19:24:17.123153+0000","last_active":"2023-11-08T19:24:18.626382+0000","last_peered":"2023-11-08T19:24:18.626382+0000","last_clean":"2023-11-08T19:24:18.626382+0000","last_became_active":"2023-11-08T19:24:17.122842+0000","last_became_peered":"2023-11-08T19:24:17.122842+0000","last_unstale":"2023-11-08T19:24:18.626382+0000","last_undegraded":"2023-11-08T19:24:18.626382+0000","last_fullsized":"2023-11-08T19:24:18.626382+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:27:43.480541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.109994+0000","last_change":"2023-11-08T19:24:17.119904+0000","last_active":"2023-11-08T19:24:18.109994+0000","last_peered":"2023-11-08T19:24:18.109994+0000","last_clean":"2023-11-08T19:24:18.109994+0000","last_became_active":"2023-11-08T19:24:17.119682+0000","last_became_peered":"2023-11-08T19:24:17.119682+0000","last_unstale":"2023-11-08T19:24:18.109994+0000","last_undegraded":"2023-11-08T19:24:18.109994+0000","last_fullsized":"2023-11-08T19:24:18.109994+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:12:58.048320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.108589+0000","last_change":"2023-11-08T19:24:17.118368+0000","last_active":"2023-11-08T19:24:18.108589+0000","last_peered":"2023-11-08T19:24:18.108589+0000","last_clean":"2023-11-08T19:24:18.108589+0000","last_became_active":"2023-11-08T19:24:17.118099+0000","last_became_peered":"2023-11-08T19:24:17.118099+0000","last_unstale":"2023-11-08T19:24:18.108589+0000","last_undegraded":"2023-11-08T19:24:18.108589+0000","last_fullsized":"2023-11-08T19:24:18.108589+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:00:12.858113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.109838+0000","last_change":"2023-11-08T19:24:17.116006+0000","last_active":"2023-11-08T19:24:18.109838+0000","last_peered":"2023-11-08T19:24:18.109838+0000","last_clean":"2023-11-08T19:24:18.109838+0000","last_became_active":"2023-11-08T19:24:17.114407+0000","last_became_peered":"2023-11-08T19:24:17.114407+0000","last_unstale":"2023-11-08T19:24:18.109838+0000","last_undegraded":"2023-11-08T19:24:18.109838+0000","last_fullsized":"2023-11-08T19:24:18.109838+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:33:32.862712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.629538+0000","last_change":"2023-11-08T19:24:17.123637+0000","last_active":"2023-11-08T19:24:18.629538+0000","last_peered":"2023-11-08T19:24:18.629538+0000","last_clean":"2023-11-08T19:24:18.629538+0000","last_became_active":"2023-11-08T19:24:17.123374+0000","last_became_peered":"2023-11-08T19:24:17.123374+0000","last_unstale":"2023-11-08T19:24:18.629538+0000","last_undegraded":"2023-11-08T19:24:18.629538+0000","last_fullsized":"2023-11-08T19:24:18.629538+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:39:50.238810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.110117+0000","last_change":"2023-11-08T19:24:17.120031+0000","last_active":"2023-11-08T19:24:18.110117+0000","last_peered":"2023-11-08T19:24:18.110117+0000","last_clean":"2023-11-08T19:24:18.110117+0000","last_became_active":"2023-11-08T19:24:17.118844+0000","last_became_peered":"2023-11-08T19:24:17.118844+0000","last_unstale":"2023-11-08T19:24:18.110117+0000","last_undegraded":"2023-11-08T19:24:18.110117+0000","last_fullsized":"2023-11-08T19:24:18.110117+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:00:12.858113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.109836+0000","last_change":"2023-11-08T19:24:17.120799+0000","last_active":"2023-11-08T19:24:18.109836+0000","last_peered":"2023-11-08T19:24:18.109836+0000","last_clean":"2023-11-08T19:24:18.109836+0000","last_became_active":"2023-11-08T19:24:17.120547+0000","last_became_peered":"2023-11-08T19:24:17.120547+0000","last_unstale":"2023-11-08T19:24:18.109836+0000","last_undegraded":"2023-11-08T19:24:18.109836+0000","last_fullsized":"2023-11-08T19:24:18.109836+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:37:25.491966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.639820+0000","last_change":"2023-11-08T19:24:17.126988+0000","last_active":"2023-11-08T19:24:19.639820+0000","last_peered":"2023-11-08T19:24:19.639820+0000","last_clean":"2023-11-08T19:24:19.639820+0000","last_became_active":"2023-11-08T19:24:17.125342+0000","last_became_peered":"2023-11-08T19:24:17.125342+0000","last_unstale":"2023-11-08T19:24:19.639820+0000","last_undegraded":"2023-11-08T19:24:19.639820+0000","last_fullsized":"2023-11-08T19:24:19.639820+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:54:17.779367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.108459+0000","last_change":"2023-11-08T19:24:17.119513+0000","last_active":"2023-11-08T19:24:18.108459+0000","last_peered":"2023-11-08T19:24:18.108459+0000","last_clean":"2023-11-08T19:24:18.108459+0000","last_became_active":"2023-11-08T19:24:17.119266+0000","last_became_peered":"2023-11-08T19:24:17.119266+0000","last_unstale":"2023-11-08T19:24:18.108459+0000","last_undegraded":"2023-11-08T19:24:18.108459+0000","last_fullsized":"2023-11-08T19:24:18.108459+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:37:25.491966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.639846+0000","last_change":"2023-11-08T19:24:17.124148+0000","last_active":"2023-11-08T19:24:19.639846+0000","last_peered":"2023-11-08T19:24:19.639846+0000","last_clean":"2023-11-08T19:24:19.639846+0000","last_became_active":"2023-11-08T19:24:17.123849+0000","last_became_peered":"2023-11-08T19:24:17.123849+0000","last_unstale":"2023-11-08T19:24:19.639846+0000","last_undegraded":"2023-11-08T19:24:19.639846+0000","last_fullsized":"2023-11-08T19:24:19.639846+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:05:23.478967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.493590+0000","last_change":"2023-11-08T19:24:16.115544+0000","last_active":"2023-11-08T19:24:17.493590+0000","last_peered":"2023-11-08T19:24:17.493590+0000","last_clean":"2023-11-08T19:24:17.493590+0000","last_became_active":"2023-11-08T19:24:16.115253+0000","last_became_peered":"2023-11-08T19:24:16.115253+0000","last_unstale":"2023-11-08T19:24:17.493590+0000","last_undegraded":"2023-11-08T19:24:17.493590+0000","last_fullsized":"2023-11-08T19:24:17.493590+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:27:10.600227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.108858+0000","last_change":"2023-11-08T19:24:17.118929+0000","last_active":"2023-11-08T19:24:18.108858+0000","last_peered":"2023-11-08T19:24:18.108858+0000","last_clean":"2023-11-08T19:24:18.108858+0000","last_became_active":"2023-11-08T19:24:17.118635+0000","last_became_peered":"2023-11-08T19:24:17.118635+0000","last_unstale":"2023-11-08T19:24:18.108858+0000","last_undegraded":"2023-11-08T19:24:18.108858+0000","last_fullsized":"2023-11-08T19:24:18.108858+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:38:34.568472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.491639+0000","last_change":"2023-11-08T19:24:16.121042+0000","last_active":"2023-11-08T19:24:17.491639+0000","last_peered":"2023-11-08T19:24:17.491639+0000","last_clean":"2023-11-08T19:24:17.491639+0000","last_became_active":"2023-11-08T19:24:16.120776+0000","last_became_peered":"2023-11-08T19:24:16.120776+0000","last_unstale":"2023-11-08T19:24:17.491639+0000","last_undegraded":"2023-11-08T19:24:17.491639+0000","last_fullsized":"2023-11-08T19:24:17.491639+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:27:10.600227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.110506+0000","last_change":"2023-11-08T19:24:17.117821+0000","last_active":"2023-11-08T19:24:18.110506+0000","last_peered":"2023-11-08T19:24:18.110506+0000","last_clean":"2023-11-08T19:24:18.110506+0000","last_became_active":"2023-11-08T19:24:17.117535+0000","last_became_peered":"2023-11-08T19:24:17.117535+0000","last_unstale":"2023-11-08T19:24:18.110506+0000","last_undegraded":"2023-11-08T19:24:18.110506+0000","last_fullsized":"2023-11-08T19:24:18.110506+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:16:13.162177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.491489+0000","last_change":"2023-11-08T19:24:16.124256+0000","last_active":"2023-11-08T19:24:17.491489+0000","last_peered":"2023-11-08T19:24:17.491489+0000","last_clean":"2023-11-08T19:24:17.491489+0000","last_became_active":"2023-11-08T19:24:16.121912+0000","last_became_peered":"2023-11-08T19:24:16.121912+0000","last_unstale":"2023-11-08T19:24:17.491489+0000","last_undegraded":"2023-11-08T19:24:17.491489+0000","last_fullsized":"2023-11-08T19:24:17.491489+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:32:36.193518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.171878+0000","last_change":"2023-11-08T19:24:17.122526+0000","last_active":"2023-11-08T19:24:19.171878+0000","last_peered":"2023-11-08T19:24:19.171878+0000","last_clean":"2023-11-08T19:24:19.171878+0000","last_became_active":"2023-11-08T19:24:17.122262+0000","last_became_peered":"2023-11-08T19:24:17.122262+0000","last_unstale":"2023-11-08T19:24:19.171878+0000","last_undegraded":"2023-11-08T19:24:19.171878+0000","last_fullsized":"2023-11-08T19:24:19.171878+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:45:20.406135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.489853+0000","last_change":"2023-11-08T19:24:16.125612+0000","last_active":"2023-11-08T19:24:17.489853+0000","last_peered":"2023-11-08T19:24:17.489853+0000","last_clean":"2023-11-08T19:24:17.489853+0000","last_became_active":"2023-11-08T19:24:16.125298+0000","last_became_peered":"2023-11-08T19:24:16.125298+0000","last_unstale":"2023-11-08T19:24:17.489853+0000","last_undegraded":"2023-11-08T19:24:17.489853+0000","last_fullsized":"2023-11-08T19:24:17.489853+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:36:18.253463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.620881+0000","last_change":"2023-11-08T19:24:17.122574+0000","last_active":"2023-11-08T19:24:19.620881+0000","last_peered":"2023-11-08T19:24:19.620881+0000","last_clean":"2023-11-08T19:24:19.620881+0000","last_became_active":"2023-11-08T19:24:17.122305+0000","last_became_peered":"2023-11-08T19:24:17.122305+0000","last_unstale":"2023-11-08T19:24:19.620881+0000","last_undegraded":"2023-11-08T19:24:19.620881+0000","last_fullsized":"2023-11-08T19:24:19.620881+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:38:34.568472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.490497+0000","last_change":"2023-11-08T19:24:16.121095+0000","last_active":"2023-11-08T19:24:17.490497+0000","last_peered":"2023-11-08T19:24:17.490497+0000","last_clean":"2023-11-08T19:24:17.490497+0000","last_became_active":"2023-11-08T19:24:16.120647+0000","last_became_peered":"2023-11-08T19:24:16.120647+0000","last_unstale":"2023-11-08T19:24:17.490497+0000","last_undegraded":"2023-11-08T19:24:17.490497+0000","last_fullsized":"2023-11-08T19:24:17.490497+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:36:18.253463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.629306+0000","last_change":"2023-11-08T19:24:17.122489+0000","last_active":"2023-11-08T19:24:18.629306+0000","last_peered":"2023-11-08T19:24:18.629306+0000","last_clean":"2023-11-08T19:24:18.629306+0000","last_became_active":"2023-11-08T19:24:17.122205+0000","last_became_peered":"2023-11-08T19:24:17.122205+0000","last_unstale":"2023-11-08T19:24:18.629306+0000","last_undegraded":"2023-11-08T19:24:18.629306+0000","last_fullsized":"2023-11-08T19:24:18.629306+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:31:10.520077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.493343+0000","last_change":"2023-11-08T19:24:16.119182+0000","last_active":"2023-11-08T19:24:17.493343+0000","last_peered":"2023-11-08T19:24:17.493343+0000","last_clean":"2023-11-08T19:24:17.493343+0000","last_became_active":"2023-11-08T19:24:16.118932+0000","last_became_peered":"2023-11-08T19:24:16.118932+0000","last_unstale":"2023-11-08T19:24:17.493343+0000","last_undegraded":"2023-11-08T19:24:17.493343+0000","last_fullsized":"2023-11-08T19:24:17.493343+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:21:06.998550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.109704+0000","last_change":"2023-11-08T19:24:17.118405+0000","last_active":"2023-11-08T19:24:18.109704+0000","last_peered":"2023-11-08T19:24:18.109704+0000","last_clean":"2023-11-08T19:24:18.109704+0000","last_became_active":"2023-11-08T19:24:17.118129+0000","last_became_peered":"2023-11-08T19:24:17.118129+0000","last_unstale":"2023-11-08T19:24:18.109704+0000","last_undegraded":"2023-11-08T19:24:18.109704+0000","last_fullsized":"2023-11-08T19:24:18.109704+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:42:55.799453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.111724+0000","last_change":"2023-11-08T19:24:16.123153+0000","last_active":"2023-11-08T19:24:17.111724+0000","last_peered":"2023-11-08T19:24:17.111724+0000","last_clean":"2023-11-08T19:24:17.111724+0000","last_became_active":"2023-11-08T19:24:16.122837+0000","last_became_peered":"2023-11-08T19:24:16.122837+0000","last_unstale":"2023-11-08T19:24:17.111724+0000","last_undegraded":"2023-11-08T19:24:17.111724+0000","last_fullsized":"2023-11-08T19:24:17.111724+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:09:19.268418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.171638+0000","last_change":"2023-11-08T19:24:17.127308+0000","last_active":"2023-11-08T19:24:19.171638+0000","last_peered":"2023-11-08T19:24:19.171638+0000","last_clean":"2023-11-08T19:24:19.171638+0000","last_became_active":"2023-11-08T19:24:17.126959+0000","last_became_peered":"2023-11-08T19:24:17.126959+0000","last_unstale":"2023-11-08T19:24:19.171638+0000","last_undegraded":"2023-11-08T19:24:19.171638+0000","last_fullsized":"2023-11-08T19:24:19.171638+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:31:10.520077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.106903+0000","last_change":"2023-11-08T19:24:16.115097+0000","last_active":"2023-11-08T19:24:17.106903+0000","last_peered":"2023-11-08T19:24:17.106903+0000","last_clean":"2023-11-08T19:24:17.106903+0000","last_became_active":"2023-11-08T19:24:16.114776+0000","last_became_peered":"2023-11-08T19:24:16.114776+0000","last_unstale":"2023-11-08T19:24:17.106903+0000","last_undegraded":"2023-11-08T19:24:17.106903+0000","last_fullsized":"2023-11-08T19:24:17.106903+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:29:45.264000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.626668+0000","last_change":"2023-11-08T19:24:17.114263+0000","last_active":"2023-11-08T19:24:18.626668+0000","last_peered":"2023-11-08T19:24:18.626668+0000","last_clean":"2023-11-08T19:24:18.626668+0000","last_became_active":"2023-11-08T19:24:17.113979+0000","last_became_peered":"2023-11-08T19:24:17.113979+0000","last_unstale":"2023-11-08T19:24:18.626668+0000","last_undegraded":"2023-11-08T19:24:18.626668+0000","last_fullsized":"2023-11-08T19:24:18.626668+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:11:31.830617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.114474+0000","last_change":"2023-11-08T19:24:16.125536+0000","last_active":"2023-11-08T19:24:17.114474+0000","last_peered":"2023-11-08T19:24:17.114474+0000","last_clean":"2023-11-08T19:24:17.114474+0000","last_became_active":"2023-11-08T19:24:16.125250+0000","last_became_peered":"2023-11-08T19:24:16.125250+0000","last_unstale":"2023-11-08T19:24:17.114474+0000","last_undegraded":"2023-11-08T19:24:17.114474+0000","last_fullsized":"2023-11-08T19:24:17.114474+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:54:16.777631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.639960+0000","last_change":"2023-11-08T19:24:17.124866+0000","last_active":"2023-11-08T19:24:19.639960+0000","last_peered":"2023-11-08T19:24:19.639960+0000","last_clean":"2023-11-08T19:24:19.639960+0000","last_became_active":"2023-11-08T19:24:17.124608+0000","last_became_peered":"2023-11-08T19:24:17.124608+0000","last_unstale":"2023-11-08T19:24:19.639960+0000","last_undegraded":"2023-11-08T19:24:19.639960+0000","last_fullsized":"2023-11-08T19:24:19.639960+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:21:41.966251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.114810+0000","last_change":"2023-11-08T19:24:16.125654+0000","last_active":"2023-11-08T19:24:17.114810+0000","last_peered":"2023-11-08T19:24:17.114810+0000","last_clean":"2023-11-08T19:24:17.114810+0000","last_became_active":"2023-11-08T19:24:16.125312+0000","last_became_peered":"2023-11-08T19:24:16.125312+0000","last_unstale":"2023-11-08T19:24:17.114810+0000","last_undegraded":"2023-11-08T19:24:17.114810+0000","last_fullsized":"2023-11-08T19:24:17.114810+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:38:33.566735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.621115+0000","last_change":"2023-11-08T19:24:17.127916+0000","last_active":"2023-11-08T19:24:19.621115+0000","last_peered":"2023-11-08T19:24:19.621115+0000","last_clean":"2023-11-08T19:24:19.621115+0000","last_became_active":"2023-11-08T19:24:17.127617+0000","last_became_peered":"2023-11-08T19:24:17.127617+0000","last_unstale":"2023-11-08T19:24:19.621115+0000","last_undegraded":"2023-11-08T19:24:19.621115+0000","last_fullsized":"2023-11-08T19:24:19.621115+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:54:17.779367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.490739+0000","last_change":"2023-11-08T19:24:16.120737+0000","last_active":"2023-11-08T19:24:17.490739+0000","last_peered":"2023-11-08T19:24:17.490739+0000","last_clean":"2023-11-08T19:24:17.490739+0000","last_became_active":"2023-11-08T19:24:16.120426+0000","last_became_peered":"2023-11-08T19:24:16.120426+0000","last_unstale":"2023-11-08T19:24:17.490739+0000","last_undegraded":"2023-11-08T19:24:17.490739+0000","last_fullsized":"2023-11-08T19:24:17.490739+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:00:11.856376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.110033+0000","last_change":"2023-11-08T19:24:17.112649+0000","last_active":"2023-11-08T19:24:18.110033+0000","last_peered":"2023-11-08T19:24:18.110033+0000","last_clean":"2023-11-08T19:24:18.110033+0000","last_became_active":"2023-11-08T19:24:17.112367+0000","last_became_peered":"2023-11-08T19:24:17.112367+0000","last_unstale":"2023-11-08T19:24:18.110033+0000","last_undegraded":"2023-11-08T19:24:18.110033+0000","last_fullsized":"2023-11-08T19:24:18.110033+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:37:25.491966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.494286+0000","last_change":"2023-11-08T19:24:16.125204+0000","last_active":"2023-11-08T19:24:17.494286+0000","last_peered":"2023-11-08T19:24:17.494286+0000","last_clean":"2023-11-08T19:24:17.494286+0000","last_became_active":"2023-11-08T19:24:16.124854+0000","last_became_peered":"2023-11-08T19:24:16.124854+0000","last_unstale":"2023-11-08T19:24:17.494286+0000","last_undegraded":"2023-11-08T19:24:17.494286+0000","last_fullsized":"2023-11-08T19:24:17.494286+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:41:08.800652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.620710+0000","last_change":"2023-11-08T19:24:17.122294+0000","last_active":"2023-11-08T19:24:19.620710+0000","last_peered":"2023-11-08T19:24:19.620710+0000","last_clean":"2023-11-08T19:24:19.620710+0000","last_became_active":"2023-11-08T19:24:17.121925+0000","last_became_peered":"2023-11-08T19:24:17.121925+0000","last_unstale":"2023-11-08T19:24:19.620710+0000","last_undegraded":"2023-11-08T19:24:19.620710+0000","last_fullsized":"2023-11-08T19:24:19.620710+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:37:25.491966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.488720+0000","last_change":"2023-11-08T19:24:16.124120+0000","last_active":"2023-11-08T19:24:17.488720+0000","last_peered":"2023-11-08T19:24:17.488720+0000","last_clean":"2023-11-08T19:24:17.488720+0000","last_became_active":"2023-11-08T19:24:16.123861+0000","last_became_peered":"2023-11-08T19:24:16.123861+0000","last_unstale":"2023-11-08T19:24:17.488720+0000","last_undegraded":"2023-11-08T19:24:17.488720+0000","last_fullsized":"2023-11-08T19:24:17.488720+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:53:37.136871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.171338+0000","last_change":"2023-11-08T19:24:17.123772+0000","last_active":"2023-11-08T19:24:19.171338+0000","last_peered":"2023-11-08T19:24:19.171338+0000","last_clean":"2023-11-08T19:24:19.171338+0000","last_became_active":"2023-11-08T19:24:17.123465+0000","last_became_peered":"2023-11-08T19:24:17.123465+0000","last_unstale":"2023-11-08T19:24:19.171338+0000","last_undegraded":"2023-11-08T19:24:19.171338+0000","last_fullsized":"2023-11-08T19:24:19.171338+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:25:04.337488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.110649+0000","last_change":"2023-11-08T19:24:16.123874+0000","last_active":"2023-11-08T19:24:17.110649+0000","last_peered":"2023-11-08T19:24:17.110649+0000","last_clean":"2023-11-08T19:24:17.110649+0000","last_became_active":"2023-11-08T19:24:16.123508+0000","last_became_peered":"2023-11-08T19:24:16.123508+0000","last_unstale":"2023-11-08T19:24:17.110649+0000","last_undegraded":"2023-11-08T19:24:17.110649+0000","last_fullsized":"2023-11-08T19:24:17.110649+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:21:06.998550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.639774+0000","last_change":"2023-11-08T19:24:17.124156+0000","last_active":"2023-11-08T19:24:19.639774+0000","last_peered":"2023-11-08T19:24:19.639774+0000","last_clean":"2023-11-08T19:24:19.639774+0000","last_became_active":"2023-11-08T19:24:17.123823+0000","last_became_peered":"2023-11-08T19:24:17.123823+0000","last_unstale":"2023-11-08T19:24:19.639774+0000","last_undegraded":"2023-11-08T19:24:19.639774+0000","last_fullsized":"2023-11-08T19:24:19.639774+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:41:09.802388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.106233+0000","last_change":"2023-11-08T19:24:16.109232+0000","last_active":"2023-11-08T19:24:17.106233+0000","last_peered":"2023-11-08T19:24:17.106233+0000","last_clean":"2023-11-08T19:24:17.106233+0000","last_became_active":"2023-11-08T19:24:16.108931+0000","last_became_peered":"2023-11-08T19:24:16.108931+0000","last_unstale":"2023-11-08T19:24:17.106233+0000","last_undegraded":"2023-11-08T19:24:17.106233+0000","last_fullsized":"2023-11-08T19:24:17.106233+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:45:52.271444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.171490+0000","last_change":"2023-11-08T19:24:17.120690+0000","last_active":"2023-11-08T19:24:19.171490+0000","last_peered":"2023-11-08T19:24:19.171490+0000","last_clean":"2023-11-08T19:24:19.171490+0000","last_became_active":"2023-11-08T19:24:17.120428+0000","last_became_peered":"2023-11-08T19:24:17.120428+0000","last_unstale":"2023-11-08T19:24:19.171490+0000","last_undegraded":"2023-11-08T19:24:19.171490+0000","last_fullsized":"2023-11-08T19:24:19.171490+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:08:50.861077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.493744+0000","last_change":"2023-11-08T19:24:16.119756+0000","last_active":"2023-11-08T19:24:17.493744+0000","last_peered":"2023-11-08T19:24:17.493744+0000","last_clean":"2023-11-08T19:24:17.493744+0000","last_became_active":"2023-11-08T19:24:16.119460+0000","last_became_peered":"2023-11-08T19:24:16.119460+0000","last_unstale":"2023-11-08T19:24:17.493744+0000","last_undegraded":"2023-11-08T19:24:17.493744+0000","last_fullsized":"2023-11-08T19:24:17.493744+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:00:11.856376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.171544+0000","last_change":"2023-11-08T19:24:17.119623+0000","last_active":"2023-11-08T19:24:19.171544+0000","last_peered":"2023-11-08T19:24:19.171544+0000","last_clean":"2023-11-08T19:24:19.171544+0000","last_became_active":"2023-11-08T19:24:17.119345+0000","last_became_peered":"2023-11-08T19:24:17.119345+0000","last_unstale":"2023-11-08T19:24:19.171544+0000","last_undegraded":"2023-11-08T19:24:19.171544+0000","last_fullsized":"2023-11-08T19:24:19.171544+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:12.060745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.491505+0000","last_change":"2023-11-08T19:24:16.116135+0000","last_active":"2023-11-08T19:24:17.491505+0000","last_peered":"2023-11-08T19:24:17.491505+0000","last_clean":"2023-11-08T19:24:17.491505+0000","last_became_active":"2023-11-08T19:24:16.115879+0000","last_became_peered":"2023-11-08T19:24:16.115879+0000","last_unstale":"2023-11-08T19:24:17.491505+0000","last_undegraded":"2023-11-08T19:24:17.491505+0000","last_fullsized":"2023-11-08T19:24:17.491505+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:41:08.800652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.629581+0000","last_change":"2023-11-08T19:24:17.122627+0000","last_active":"2023-11-08T19:24:18.629581+0000","last_peered":"2023-11-08T19:24:18.629581+0000","last_clean":"2023-11-08T19:24:18.629581+0000","last_became_active":"2023-11-08T19:24:17.122313+0000","last_became_peered":"2023-11-08T19:24:17.122313+0000","last_unstale":"2023-11-08T19:24:18.629581+0000","last_undegraded":"2023-11-08T19:24:18.629581+0000","last_fullsized":"2023-11-08T19:24:18.629581+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:45:20.406135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.491205+0000","last_change":"2023-11-08T19:24:16.117967+0000","last_active":"2023-11-08T19:24:17.491205+0000","last_peered":"2023-11-08T19:24:17.491205+0000","last_clean":"2023-11-08T19:24:17.491205+0000","last_became_active":"2023-11-08T19:24:16.117675+0000","last_became_peered":"2023-11-08T19:24:16.117675+0000","last_unstale":"2023-11-08T19:24:17.491205+0000","last_undegraded":"2023-11-08T19:24:17.491205+0000","last_fullsized":"2023-11-08T19:24:17.491205+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:27:10.600227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.110440+0000","last_change":"2023-11-08T19:24:17.119911+0000","last_active":"2023-11-08T19:24:18.110440+0000","last_peered":"2023-11-08T19:24:18.110440+0000","last_clean":"2023-11-08T19:24:18.110440+0000","last_became_active":"2023-11-08T19:24:17.119640+0000","last_became_peered":"2023-11-08T19:24:17.119640+0000","last_unstale":"2023-11-08T19:24:18.110440+0000","last_undegraded":"2023-11-08T19:24:18.110440+0000","last_fullsized":"2023-11-08T19:24:18.110440+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:00:12.858113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.493128+0000","last_change":"2023-11-08T19:24:16.119485+0000","last_active":"2023-11-08T19:24:17.493128+0000","last_peered":"2023-11-08T19:24:17.493128+0000","last_clean":"2023-11-08T19:24:17.493128+0000","last_became_active":"2023-11-08T19:24:16.119234+0000","last_became_peered":"2023-11-08T19:24:16.119234+0000","last_unstale":"2023-11-08T19:24:17.493128+0000","last_undegraded":"2023-11-08T19:24:17.493128+0000","last_fullsized":"2023-11-08T19:24:17.493128+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:27:28.711503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.626583+0000","last_change":"2023-11-08T19:24:17.123516+0000","last_active":"2023-11-08T19:24:18.626583+0000","last_peered":"2023-11-08T19:24:18.626583+0000","last_clean":"2023-11-08T19:24:18.626583+0000","last_became_active":"2023-11-08T19:24:17.122503+0000","last_became_peered":"2023-11-08T19:24:17.122503+0000","last_unstale":"2023-11-08T19:24:18.626583+0000","last_undegraded":"2023-11-08T19:24:18.626583+0000","last_fullsized":"2023-11-08T19:24:18.626583+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:55:15.476144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.113619+0000","last_change":"2023-11-08T19:24:16.120284+0000","last_active":"2023-11-08T19:24:17.113619+0000","last_peered":"2023-11-08T19:24:17.113619+0000","last_clean":"2023-11-08T19:24:17.113619+0000","last_became_active":"2023-11-08T19:24:16.119983+0000","last_became_peered":"2023-11-08T19:24:16.119983+0000","last_unstale":"2023-11-08T19:24:17.113619+0000","last_undegraded":"2023-11-08T19:24:17.113619+0000","last_fullsized":"2023-11-08T19:24:17.113619+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:42:54.797716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.639623+0000","last_change":"2023-11-08T19:24:17.127930+0000","last_active":"2023-11-08T19:24:19.639623+0000","last_peered":"2023-11-08T19:24:19.639623+0000","last_clean":"2023-11-08T19:24:19.639623+0000","last_became_active":"2023-11-08T19:24:17.127656+0000","last_became_peered":"2023-11-08T19:24:17.127656+0000","last_unstale":"2023-11-08T19:24:19.639623+0000","last_undegraded":"2023-11-08T19:24:19.639623+0000","last_fullsized":"2023-11-08T19:24:19.639623+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:53:38.138608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.489973+0000","last_change":"2023-11-08T19:24:16.116495+0000","last_active":"2023-11-08T19:24:17.489973+0000","last_peered":"2023-11-08T19:24:17.489973+0000","last_clean":"2023-11-08T19:24:17.489973+0000","last_became_active":"2023-11-08T19:24:16.116191+0000","last_became_peered":"2023-11-08T19:24:16.116191+0000","last_unstale":"2023-11-08T19:24:17.489973+0000","last_undegraded":"2023-11-08T19:24:17.489973+0000","last_fullsized":"2023-11-08T19:24:17.489973+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:49:05.309488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.620773+0000","last_change":"2023-11-08T19:24:17.128861+0000","last_active":"2023-11-08T19:24:19.620773+0000","last_peered":"2023-11-08T19:24:19.620773+0000","last_clean":"2023-11-08T19:24:19.620773+0000","last_became_active":"2023-11-08T19:24:17.128594+0000","last_became_peered":"2023-11-08T19:24:17.128594+0000","last_unstale":"2023-11-08T19:24:19.620773+0000","last_undegraded":"2023-11-08T19:24:19.620773+0000","last_fullsized":"2023-11-08T19:24:19.620773+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:00:12.858113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.106999+0000","last_change":"2023-11-08T19:24:16.113723+0000","last_active":"2023-11-08T19:24:17.106999+0000","last_peered":"2023-11-08T19:24:17.106999+0000","last_clean":"2023-11-08T19:24:17.106999+0000","last_became_active":"2023-11-08T19:24:16.113374+0000","last_became_peered":"2023-11-08T19:24:16.113374+0000","last_unstale":"2023-11-08T19:24:17.106999+0000","last_undegraded":"2023-11-08T19:24:17.106999+0000","last_fullsized":"2023-11-08T19:24:17.106999+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:18:44.789207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.629171+0000","last_change":"2023-11-08T19:24:17.117595+0000","last_active":"2023-11-08T19:24:18.629171+0000","last_peered":"2023-11-08T19:24:18.629171+0000","last_clean":"2023-11-08T19:24:18.629171+0000","last_became_active":"2023-11-08T19:24:17.117300+0000","last_became_peered":"2023-11-08T19:24:17.117300+0000","last_unstale":"2023-11-08T19:24:18.629171+0000","last_undegraded":"2023-11-08T19:24:18.629171+0000","last_fullsized":"2023-11-08T19:24:18.629171+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:25:04.337488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.116218+0000","last_change":"2023-11-08T19:24:16.119794+0000","last_active":"2023-11-08T19:24:17.116218+0000","last_peered":"2023-11-08T19:24:17.116218+0000","last_clean":"2023-11-08T19:24:17.116218+0000","last_became_active":"2023-11-08T19:24:16.119524+0000","last_became_peered":"2023-11-08T19:24:16.119524+0000","last_unstale":"2023-11-08T19:24:17.116218+0000","last_undegraded":"2023-11-08T19:24:17.116218+0000","last_fullsized":"2023-11-08T19:24:17.116218+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:16:12.160440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.171479+0000","last_change":"2023-11-08T19:24:17.128143+0000","last_active":"2023-11-08T19:24:19.171479+0000","last_peered":"2023-11-08T19:24:19.171479+0000","last_clean":"2023-11-08T19:24:19.171479+0000","last_became_active":"2023-11-08T19:24:17.127912+0000","last_became_peered":"2023-11-08T19:24:17.127912+0000","last_unstale":"2023-11-08T19:24:19.171479+0000","last_undegraded":"2023-11-08T19:24:19.171479+0000","last_fullsized":"2023-11-08T19:24:19.171479+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:21:41.966251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.107002+0000","last_change":"2023-11-08T19:24:16.116956+0000","last_active":"2023-11-08T19:24:17.107002+0000","last_peered":"2023-11-08T19:24:17.107002+0000","last_clean":"2023-11-08T19:24:17.107002+0000","last_became_active":"2023-11-08T19:24:16.116715+0000","last_became_peered":"2023-11-08T19:24:16.116715+0000","last_unstale":"2023-11-08T19:24:17.107002+0000","last_undegraded":"2023-11-08T19:24:17.107002+0000","last_fullsized":"2023-11-08T19:24:17.107002+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:50:55.092096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.108668+0000","last_change":"2023-11-08T19:24:17.122910+0000","last_active":"2023-11-08T19:24:18.108668+0000","last_peered":"2023-11-08T19:24:18.108668+0000","last_clean":"2023-11-08T19:24:18.108668+0000","last_became_active":"2023-11-08T19:24:17.122626+0000","last_became_peered":"2023-11-08T19:24:17.122626+0000","last_unstale":"2023-11-08T19:24:18.108668+0000","last_undegraded":"2023-11-08T19:24:18.108668+0000","last_fullsized":"2023-11-08T19:24:18.108668+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:16:13.162177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.490553+0000","last_change":"2023-11-08T19:24:16.121737+0000","last_active":"2023-11-08T19:24:17.490553+0000","last_peered":"2023-11-08T19:24:17.490553+0000","last_clean":"2023-11-08T19:24:17.490553+0000","last_became_active":"2023-11-08T19:24:16.121491+0000","last_became_peered":"2023-11-08T19:24:16.121491+0000","last_unstale":"2023-11-08T19:24:17.490553+0000","last_undegraded":"2023-11-08T19:24:17.490553+0000","last_fullsized":"2023-11-08T19:24:17.490553+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:54:16.777631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.640062+0000","last_change":"2023-11-08T19:24:17.129203+0000","last_active":"2023-11-08T19:24:19.640062+0000","last_peered":"2023-11-08T19:24:19.640062+0000","last_clean":"2023-11-08T19:24:19.640062+0000","last_became_active":"2023-11-08T19:24:17.128943+0000","last_became_peered":"2023-11-08T19:24:17.128943+0000","last_unstale":"2023-11-08T19:24:19.640062+0000","last_undegraded":"2023-11-08T19:24:19.640062+0000","last_fullsized":"2023-11-08T19:24:19.640062+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:08:50.861077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.626600+0000","last_change":"2023-11-08T19:24:16.117342+0000","last_active":"2023-11-08T19:24:18.626600+0000","last_peered":"2023-11-08T19:24:18.626600+0000","last_clean":"2023-11-08T19:24:18.626600+0000","last_became_active":"2023-11-08T19:24:16.117074+0000","last_became_peered":"2023-11-08T19:24:16.117074+0000","last_unstale":"2023-11-08T19:24:18.626600+0000","last_undegraded":"2023-11-08T19:24:18.626600+0000","last_fullsized":"2023-11-08T19:24:18.626600+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:17:40.377190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.171701+0000","last_change":"2023-11-08T19:24:17.122493+0000","last_active":"2023-11-08T19:24:19.171701+0000","last_peered":"2023-11-08T19:24:19.171701+0000","last_clean":"2023-11-08T19:24:19.171701+0000","last_became_active":"2023-11-08T19:24:17.122230+0000","last_became_peered":"2023-11-08T19:24:17.122230+0000","last_unstale":"2023-11-08T19:24:19.171701+0000","last_undegraded":"2023-11-08T19:24:19.171701+0000","last_fullsized":"2023-11-08T19:24:19.171701+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:53:54.966516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.118004+0000","last_change":"2023-11-08T19:24:16.121272+0000","last_active":"2023-11-08T19:24:17.118004+0000","last_peered":"2023-11-08T19:24:17.118004+0000","last_clean":"2023-11-08T19:24:17.118004+0000","last_became_active":"2023-11-08T19:24:16.120986+0000","last_became_peered":"2023-11-08T19:24:16.120986+0000","last_unstale":"2023-11-08T19:24:17.118004+0000","last_undegraded":"2023-11-08T19:24:17.118004+0000","last_fullsized":"2023-11-08T19:24:17.118004+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:32:36.193518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.620710+0000","last_change":"2023-11-08T19:24:17.125793+0000","last_active":"2023-11-08T19:24:19.620710+0000","last_peered":"2023-11-08T19:24:19.620710+0000","last_clean":"2023-11-08T19:24:19.620710+0000","last_became_active":"2023-11-08T19:24:17.125451+0000","last_became_peered":"2023-11-08T19:24:17.125451+0000","last_unstale":"2023-11-08T19:24:19.620710+0000","last_undegraded":"2023-11-08T19:24:19.620710+0000","last_fullsized":"2023-11-08T19:24:19.620710+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:12:58.048320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.115100+0000","last_change":"2023-11-08T19:24:16.123141+0000","last_active":"2023-11-08T19:24:17.115100+0000","last_peered":"2023-11-08T19:24:17.115100+0000","last_clean":"2023-11-08T19:24:17.115100+0000","last_became_active":"2023-11-08T19:24:16.122900+0000","last_became_peered":"2023-11-08T19:24:16.122900+0000","last_unstale":"2023-11-08T19:24:17.115100+0000","last_undegraded":"2023-11-08T19:24:17.115100+0000","last_fullsized":"2023-11-08T19:24:17.115100+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:09:19.268418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.108503+0000","last_change":"2023-11-08T19:24:17.118955+0000","last_active":"2023-11-08T19:24:18.108503+0000","last_peered":"2023-11-08T19:24:18.108503+0000","last_clean":"2023-11-08T19:24:18.108503+0000","last_became_active":"2023-11-08T19:24:17.118669+0000","last_became_peered":"2023-11-08T19:24:17.118669+0000","last_unstale":"2023-11-08T19:24:18.108503+0000","last_undegraded":"2023-11-08T19:24:18.108503+0000","last_fullsized":"2023-11-08T19:24:18.108503+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:12:58.048320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.106906+0000","last_change":"2023-11-08T19:24:16.117069+0000","last_active":"2023-11-08T19:24:17.106906+0000","last_peered":"2023-11-08T19:24:17.106906+0000","last_clean":"2023-11-08T19:24:17.106906+0000","last_became_active":"2023-11-08T19:24:16.116782+0000","last_became_peered":"2023-11-08T19:24:16.116782+0000","last_unstale":"2023-11-08T19:24:17.106906+0000","last_undegraded":"2023-11-08T19:24:17.106906+0000","last_fullsized":"2023-11-08T19:24:17.106906+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:36:18.253463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.109836+0000","last_change":"2023-11-08T19:24:17.124099+0000","last_active":"2023-11-08T19:24:18.109836+0000","last_peered":"2023-11-08T19:24:18.109836+0000","last_clean":"2023-11-08T19:24:18.109836+0000","last_became_active":"2023-11-08T19:24:17.123803+0000","last_became_peered":"2023-11-08T19:24:17.123803+0000","last_unstale":"2023-11-08T19:24:18.109836+0000","last_undegraded":"2023-11-08T19:24:18.109836+0000","last_fullsized":"2023-11-08T19:24:18.109836+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:33:32.862712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.106929+0000","last_change":"2023-11-08T19:24:16.124372+0000","last_active":"2023-11-08T19:24:17.106929+0000","last_peered":"2023-11-08T19:24:17.106929+0000","last_clean":"2023-11-08T19:24:17.106929+0000","last_became_active":"2023-11-08T19:24:16.124097+0000","last_became_peered":"2023-11-08T19:24:16.124097+0000","last_unstale":"2023-11-08T19:24:17.106929+0000","last_undegraded":"2023-11-08T19:24:17.106929+0000","last_fullsized":"2023-11-08T19:24:17.106929+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:09:54.584065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.639921+0000","last_change":"2023-11-08T19:24:17.127281+0000","last_active":"2023-11-08T19:24:19.639921+0000","last_peered":"2023-11-08T19:24:19.639921+0000","last_clean":"2023-11-08T19:24:19.639921+0000","last_became_active":"2023-11-08T19:24:17.126969+0000","last_became_peered":"2023-11-08T19:24:17.126969+0000","last_unstale":"2023-11-08T19:24:19.639921+0000","last_undegraded":"2023-11-08T19:24:19.639921+0000","last_fullsized":"2023-11-08T19:24:19.639921+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:25:04.337488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.113688+0000","last_change":"2023-11-08T19:24:16.125300+0000","last_active":"2023-11-08T19:24:17.113688+0000","last_peered":"2023-11-08T19:24:17.113688+0000","last_clean":"2023-11-08T19:24:17.113688+0000","last_became_active":"2023-11-08T19:24:16.125011+0000","last_became_peered":"2023-11-08T19:24:16.125011+0000","last_unstale":"2023-11-08T19:24:17.113688+0000","last_undegraded":"2023-11-08T19:24:17.113688+0000","last_fullsized":"2023-11-08T19:24:17.113688+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:38:33.566735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.629727+0000","last_change":"2023-11-08T19:24:17.124753+0000","last_active":"2023-11-08T19:24:18.629727+0000","last_peered":"2023-11-08T19:24:18.629727+0000","last_clean":"2023-11-08T19:24:18.629727+0000","last_became_active":"2023-11-08T19:24:17.124494+0000","last_became_peered":"2023-11-08T19:24:17.124494+0000","last_unstale":"2023-11-08T19:24:18.629727+0000","last_undegraded":"2023-11-08T19:24:18.629727+0000","last_fullsized":"2023-11-08T19:24:18.629727+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:39:34.453886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.113407+0000","last_change":"2023-11-08T19:24:16.121492+0000","last_active":"2023-11-08T19:24:17.113407+0000","last_peered":"2023-11-08T19:24:17.113407+0000","last_clean":"2023-11-08T19:24:17.113407+0000","last_became_active":"2023-11-08T19:24:16.121224+0000","last_became_peered":"2023-11-08T19:24:16.121224+0000","last_unstale":"2023-11-08T19:24:17.113407+0000","last_undegraded":"2023-11-08T19:24:17.113407+0000","last_fullsized":"2023-11-08T19:24:17.113407+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:09:19.268418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":180,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.116039+0000","last_change":"2023-11-08T19:22:58.054283+0000","last_active":"2023-11-08T19:24:17.116039+0000","last_peered":"2023-11-08T19:24:17.116039+0000","last_clean":"2023-11-08T19:24:17.116039+0000","last_became_active":"2023-11-08T19:22:58.053337+0000","last_became_peered":"2023-11-08T19:22:58.053337+0000","last_unstale":"2023-11-08T19:24:17.116039+0000","last_undegraded":"2023-11-08T19:24:17.116039+0000","last_fullsized":"2023-11-08T19:24:17.116039+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:22:56.479654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:22:56.479654+0000","last_clean_scrub_stamp":"2023-11-08T19:22:56.479654+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:16:05.317001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28048,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343792,"statfs":{"total":96636764160,"available":96608043008,"internally_reserved":0,"allocated":1048576,"data_stored":779541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.52200000000000002}]},{"osd":1,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.40100000000000002}]},{"osd":2,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.46400000000000002}]},{"osd":3,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.53400000000000003}]},{"osd":4,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.57299999999999995}]},{"osd":5,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.56200000000000006}]},{"osd":6,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.622}]}]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":194693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.53500000000000003}]},{"osd":1,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.64300000000000002}]},{"osd":2,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.435},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.46000000000000002}]},{"osd":3,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":0.55500000000000005}]},{"osd":4,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.61399999999999999}]},{"osd":5,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.504},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.57199999999999995}]},{"osd":7,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.58599999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":454656,"data_stored":194201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":2.1850000000000001,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":0.39200000000000002}]},{"osd":2,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.29199999999999998}]},{"osd":3,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.378},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":2.2120000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.43099999999999999}]},{"osd":4,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.745},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.64600000000000002}]},{"osd":5,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.60499999999999998}]},{"osd":6,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":2.093,"5min":2.093,"15min":2.093},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.67000000000000004}]},{"osd":7,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":0.63},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":2.1299999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.68700000000000006}]}]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28044,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343796,"statfs":{"total":96636764160,"available":96608047104,"internally_reserved":0,"allocated":1048576,"data_stored":784513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":19.295999999999999,"5min":19.295999999999999,"15min":19.295999999999999},"last":0.29399999999999998},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":17.204000000000001,"5min":17.204000000000001,"15min":17.204000000000001},"last":0.42599999999999999}]},{"osd":2,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":6.524,"5min":6.524,"15min":6.524},"last":0.45200000000000001},{"interface":"front","average":{"1min":1.169,"5min":1.169,"15min":1.169},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":17.175000000000001,"5min":17.175000000000001,"15min":17.175000000000001},"last":0.36199999999999999}]},{"osd":3,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":14.324,"5min":14.324,"15min":14.324},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.39900000000000002}]},{"osd":4,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.304,"15min":1.304},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":17.056000000000001,"5min":17.056000000000001,"15min":17.056000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":5.0289999999999999,"5min":5.0289999999999999,"15min":5.0289999999999999},"last":0.54400000000000004}]},{"osd":5,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":5.0590000000000002,"5min":5.0590000000000002,"15min":5.0590000000000002},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.52800000000000002}]},{"osd":6,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.60999999999999999},{"interface":"front","average":{"1min":1.357,"5min":1.357,"15min":1.357},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":17.111999999999998,"5min":17.111999999999998,"15min":17.111999999999998},"last":0.56100000000000005}]},{"osd":7,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.371,"15min":1.371},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":17.146000000000001,"5min":17.146000000000001,"15min":17.146000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":4.9829999999999997,"5min":4.9829999999999997,"15min":4.9829999999999997},"last":0.47099999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":194181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":3.4100000000000001,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":3.4369999999999998,"5min":3.4369999999999998,"15min":3.4369999999999998},"last":0.23999999999999999}]},{"osd":1,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":4.0679999999999996,"5min":4.0679999999999996,"15min":4.0679999999999996},"last":0.31},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":4.3499999999999996,"5min":4.3499999999999996,"15min":4.3499999999999996},"last":0.33900000000000002}]},{"osd":3,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":3.8580000000000001,"5min":3.8580000000000001,"15min":3.8580000000000001},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":3.476,"5min":3.476,"15min":3.476},"last":0.27600000000000002}]},{"osd":4,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":4.0090000000000003,"5min":4.0090000000000003,"15min":4.0090000000000003},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":4.1040000000000001,"5min":4.1040000000000001,"15min":4.1040000000000001},"last":0.70799999999999996}]},{"osd":5,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":4.0869999999999997,"5min":4.0869999999999997,"15min":4.0869999999999997},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":3.843,"5min":3.843,"15min":3.843},"last":0.63600000000000001}]},{"osd":6,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":4.1399999999999997,"5min":4.1399999999999997,"15min":4.1399999999999997},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":4.0499999999999998,"5min":4.0499999999999998,"15min":4.0499999999999998},"last":0.53200000000000003}]},{"osd":7,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":4.157,"5min":4.157,"15min":4.157},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":4.1710000000000003,"5min":4.1710000000000003,"15min":4.1710000000000003},"last":0.58499999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":195757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.46100000000000002}]},{"osd":1,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.51800000000000002}]},{"osd":2,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.48799999999999999}]},{"osd":4,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.752}]},{"osd":5,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.61299999999999999}]},{"osd":6,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.78700000000000003}]},{"osd":7,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.71499999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":458752,"data_stored":194715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.627},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":2.2090000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.56399999999999995}]},{"osd":1,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.495},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.46700000000000003}]},{"osd":2,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":2.8490000000000002,"5min":2.8490000000000002,"15min":2.8490000000000002},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.44400000000000001}]},{"osd":3,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":3.4849999999999999,"5min":3.4849999999999999,"15min":3.4849999999999999},"last":0.69699999999999995}]},{"osd":5,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.54400000000000004}]},{"osd":6,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":4.1529999999999996,"5min":4.1529999999999996,"15min":4.1529999999999996},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.65800000000000003}]},{"osd":7,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":5.5359999999999996,"5min":5.5359999999999996,"15min":5.5359999999999996},"last":0.74299999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":458752,"data_stored":194223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.56699999999999995}]},{"osd":1,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":2.2919999999999998,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":0.66300000000000003}]},{"osd":2,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.622},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.59199999999999997}]},{"osd":3,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.70799999999999996}]},{"osd":4,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":2.3300000000000001,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.73899999999999999}]},{"osd":6,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":2.3650000000000002,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":0.754}]},{"osd":7,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.79500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:24:22.368 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-08T19:24:22.523 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.521+0000 7f012f787700 1 Processor -- start 2023-11-08T19:24:22.523 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.521+0000 7f012f787700 1 -- start start 2023-11-08T19:24:22.530 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.522+0000 7f012f787700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f012815dc90 0x7f01280cc280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:22.530 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.522+0000 7f012f787700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f01280cf940 0x7f01280cfdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:22.530 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.522+0000 7f012f787700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01280cbdf0 con 0x7f01280cac70 2023-11-08T19:24:22.531 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.522+0000 7f012f787700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01280ccdd0 con 0x7f01280cf940 2023-11-08T19:24:22.531 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.522+0000 7f012f787700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01280cb1e0 con 0x7f012815dc90 2023-11-08T19:24:22.531 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.522+0000 7f012cd22700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f01280cac70 0x7f012806b560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:41392/0 (socket says 172.21.15.149:41392) 2023-11-08T19:24:22.531 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.522+0000 7f012cd22700 1 -- 172.21.15.149:0/1899415714 learned_addr learned my addr 172.21.15.149:0/1899415714 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:24:22.532 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.522+0000 7f011ffff700 1 -- 172.21.15.149:0/1899415714 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3660994715 0 0) 0x7f01280cbdf0 con 0x7f01280cac70 2023-11-08T19:24:22.532 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.522+0000 7f012dd24700 1 --2- 172.21.15.149:0/1899415714 >> v2:172.21.15.160:3300/0 conn(0x7f01280cf940 0x7f01280cfdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:22.532 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.522+0000 7f011ffff700 1 -- 172.21.15.149:0/1899415714 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01140035b0 con 0x7f01280cac70 2023-11-08T19:24:22.532 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.522+0000 7f012d523700 1 --2- 172.21.15.149:0/1899415714 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f012815dc90 0x7f01280cc280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:22.532 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.522+0000 7f011ffff700 1 -- 172.21.15.149:0/1899415714 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 937855062 0 0) 0x7f01140035b0 con 0x7f01280cac70 2023-11-08T19:24:22.533 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.522+0000 7f011ffff700 1 -- 172.21.15.149:0/1899415714 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f012815dc90 msgr2=0x7f01280cc280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:22.533 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.522+0000 7f011ffff700 1 --2- 172.21.15.149:0/1899415714 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f012815dc90 0x7f01280cc280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:22.533 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.522+0000 7f011ffff700 1 -- 172.21.15.149:0/1899415714 >> v2:172.21.15.160:3300/0 conn(0x7f01280cf940 msgr2=0x7f01280cfdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:22.533 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.522+0000 7f011ffff700 1 --2- 172.21.15.149:0/1899415714 >> v2:172.21.15.160:3300/0 conn(0x7f01280cf940 0x7f01280cfdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:22.533 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.522+0000 7f011ffff700 1 -- 172.21.15.149:0/1899415714 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01280cb4c0 con 0x7f01280cac70 2023-11-08T19:24:22.534 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.522+0000 7f011ffff700 1 -- 172.21.15.149:0/1899415714 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f0118001670 con 0x7f01280cac70 2023-11-08T19:24:22.534 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.523+0000 7f011ffff700 1 -- 172.21.15.149:0/1899415714 >> v1:172.21.15.149:6789/0 conn(0x7f01280cac70 legacy=0x7f012806b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:22.534 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.523+0000 7f011ffff700 1 --2- 172.21.15.149:0/1899415714 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f012815dc90 0x7f0114003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:22.534 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.523+0000 7f011ffff700 1 --2- 172.21.15.149:0/1899415714 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0114003f80 0x7f0114004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:22.534 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.523+0000 7f011ffff700 1 --2- 172.21.15.149:0/1899415714 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0114004d90 0x7f0114005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:22.535 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.523+0000 7f011ffff700 1 -- 172.21.15.149:0/1899415714 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01280ccdd0 con 0x7f0114004d90 2023-11-08T19:24:22.535 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.523+0000 7f011ffff700 1 -- 172.21.15.149:0/1899415714 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01280cb1e0 con 0x7f0114003f80 2023-11-08T19:24:22.535 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.523+0000 7f011ffff700 1 -- 172.21.15.149:0/1899415714 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f011400ba10 con 0x7f012815dc90 2023-11-08T19:24:22.535 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.523+0000 7f012dd24700 1 --2- 172.21.15.149:0/1899415714 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0114004d90 0x7f0114005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:22.535 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.523+0000 7f012d523700 1 --2- 172.21.15.149:0/1899415714 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f012815dc90 0x7f0114003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:22.535 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.523+0000 7f012cd22700 1 --2- 172.21.15.149:0/1899415714 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0114003f80 0x7f0114004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:22.536 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.523+0000 7f012dd24700 1 -- 172.21.15.149:0/1899415714 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f012815dc90 msgr2=0x7f0114003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:22.536 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.523+0000 7f012dd24700 1 --2- 172.21.15.149:0/1899415714 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f012815dc90 0x7f0114003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:22.536 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.523+0000 7f012dd24700 1 -- 172.21.15.149:0/1899415714 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0114003f80 msgr2=0x7f0114004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:22.536 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.523+0000 7f012dd24700 1 --2- 172.21.15.149:0/1899415714 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0114003f80 0x7f0114004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:22.536 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.523+0000 7f012dd24700 1 -- 172.21.15.149:0/1899415714 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01140035b0 con 0x7f0114004d90 2023-11-08T19:24:22.537 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.523+0000 7f012dd24700 1 --2- 172.21.15.149:0/1899415714 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0114004d90 0x7f0114005210 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f0120009fc0 tx=0x7f0114005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e77a5cd006e103b3 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:22.537 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.523+0000 7f011ffff700 1 -- 172.21.15.149:0/1899415714 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012000ebd0 con 0x7f0114004d90 2023-11-08T19:24:22.537 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.523+0000 7f011ffff700 1 -- 172.21.15.149:0/1899415714 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f012000f040 con 0x7f0114004d90 2023-11-08T19:24:22.537 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.523+0000 7f011ffff700 1 -- 172.21.15.149:0/1899415714 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0120014480 con 0x7f0114004d90 2023-11-08T19:24:22.537 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.524+0000 7f012f787700 1 -- 172.21.15.149:0/1899415714 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0114004d90 msgr2=0x7f0114005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:22.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.524+0000 7f012f787700 1 --2- 172.21.15.149:0/1899415714 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0114004d90 0x7f0114005210 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f0120009fc0 tx=0x7f0114005880 comp rx=0 tx=0).stop 2023-11-08T19:24:22.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.524+0000 7f012dd24700 1 -- 172.21.15.149:0/1899415714 reap_dead start 2023-11-08T19:24:22.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.524+0000 7f012f787700 1 -- 172.21.15.149:0/1899415714 shutdown_connections 2023-11-08T19:24:22.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.524+0000 7f012f787700 1 -- 172.21.15.149:0/1899415714 >> 172.21.15.149:0/1899415714 conn(0x7f01280d0620 msgr2=0x7f01280d0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:22.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.524+0000 7f012f787700 1 -- 172.21.15.149:0/1899415714 shutdown_connections 2023-11-08T19:24:22.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.524+0000 7f012f787700 1 -- 172.21.15.149:0/1899415714 wait complete. 2023-11-08T19:24:22.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.525+0000 7f012f787700 1 Processor -- start 2023-11-08T19:24:22.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.525+0000 7f012f787700 1 -- start start 2023-11-08T19:24:22.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.526+0000 7f012f787700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0114004d90 0x7f01280c78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:22.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.526+0000 7f012f787700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f01281e5190 0x7f01281e6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:22.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.526+0000 7f012f787700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f01280cd950 0x7f012815a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:22.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.526+0000 7f012f787700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01280b32d0 con 0x7f0114004d90 2023-11-08T19:24:22.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.526+0000 7f012f787700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01281e5700 con 0x7f01281e5190 2023-11-08T19:24:22.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.526+0000 7f012f787700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01281e59e0 con 0x7f01280cd950 2023-11-08T19:24:22.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.526+0000 7f012d523700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0114004d90 0x7f01280c78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:22.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.526+0000 7f012d523700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0114004d90 0x7f01280c78d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39402/0 (socket says 172.21.15.149:39402) 2023-11-08T19:24:22.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.526+0000 7f012d523700 1 -- 172.21.15.149:0/1581428220 learned_addr learned my addr 172.21.15.149:0/1581428220 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:22.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.526+0000 7f012dd24700 1 --2- 172.21.15.149:0/1581428220 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f01280cd950 0x7f012815a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:22.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.526+0000 7f012cd22700 1 --2- 172.21.15.149:0/1581428220 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f01281e5190 0x7f01281e6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:22.542 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.526+0000 7f012d523700 1 -- 172.21.15.149:0/1581428220 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f01280cd950 msgr2=0x7f012815a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:22.542 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.526+0000 7f012d523700 1 --2- 172.21.15.149:0/1581428220 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f01280cd950 0x7f012815a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:22.542 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.526+0000 7f012d523700 1 -- 172.21.15.149:0/1581428220 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f01281e5190 msgr2=0x7f01281e6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:22.542 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.526+0000 7f012d523700 1 --2- 172.21.15.149:0/1581428220 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f01281e5190 0x7f01281e6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:22.543 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.526+0000 7f012d523700 1 -- 172.21.15.149:0/1581428220 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01281e5cc0 con 0x7f0114004d90 2023-11-08T19:24:22.543 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.526+0000 7f012cd22700 1 --2- 172.21.15.149:0/1581428220 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f01281e5190 0x7f01281e6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:24:22.543 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.526+0000 7f012d523700 1 --2- 172.21.15.149:0/1581428220 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0114004d90 0x7f01280c78d0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f0124011aa0 tx=0x7f0124011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:22.543 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.526+0000 7f011dffb700 1 -- 172.21.15.149:0/1581428220 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012400f980 con 0x7f0114004d90 2023-11-08T19:24:22.543 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.526+0000 7f011dffb700 1 -- 172.21.15.149:0/1581428220 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f012400fae0 con 0x7f0114004d90 2023-11-08T19:24:22.544 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.527+0000 7f012f787700 1 -- 172.21.15.149:0/1581428220 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01281e5fa0 con 0x7f0114004d90 2023-11-08T19:24:22.544 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.527+0000 7f011dffb700 1 -- 172.21.15.149:0/1581428220 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012400fe90 con 0x7f0114004d90 2023-11-08T19:24:22.544 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.527+0000 7f012f787700 1 -- 172.21.15.149:0/1581428220 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01281e7300 con 0x7f0114004d90 2023-11-08T19:24:22.544 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.528+0000 7f012f787700 1 -- 172.21.15.149:0/1581428220 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01280b35b0 con 0x7f0114004d90 2023-11-08T19:24:22.544 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.528+0000 7f011dffb700 1 -- 172.21.15.149:0/1581428220 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0124014440 con 0x7f0114004d90 2023-11-08T19:24:22.545 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.529+0000 7f011dffb700 1 --2- 172.21.15.149:0/1581428220 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f010c06af00 0x7f010c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:22.545 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.529+0000 7f012cd22700 1 --2- 172.21.15.149:0/1581428220 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f010c06af00 0x7f010c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:22.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.529+0000 7f011dffb700 1 -- 172.21.15.149:0/1581428220 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0124089f40 con 0x7f0114004d90 2023-11-08T19:24:22.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.529+0000 7f012cd22700 1 --2- 172.21.15.149:0/1581428220 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f010c06af00 0x7f010c06d3c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f01280b6340 tx=0x7f0118009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:22.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.534+0000 7f011dffb700 1 -- 172.21.15.149:0/1581428220 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0124054f70 con 0x7f0114004d90 2023-11-08T19:24:22.804 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.801+0000 7f012f787700 1 -- 172.21.15.149:0/1581428220 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f01280745f0 con 0x7f0114004d90 2023-11-08T19:24:22.804 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.802+0000 7f011dffb700 1 -- 172.21.15.149:0/1581428220 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1172 (secure 0 0 0) 0x7f0124058590 con 0x7f0114004d90 2023-11-08T19:24:22.805 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:24:22.805 INFO:teuthology.orchestra.run.smithi149.stdout:{"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":98,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":39,"num_osds":8,"num_up_osds":8,"osd_up_since":1699471375,"num_in_osds":8,"osd_in_since":1699471366,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":226205696,"bytes_avail":772867907584,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":17,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":5259}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2023-11-08T19:23:57.998001+0000","services":{"mds":{"daemons":{"summary":"","d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-11-08T19:24:22.806 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.804+0000 7f012f787700 1 -- 172.21.15.149:0/1581428220 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f010c06af00 msgr2=0x7f010c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:22.807 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.804+0000 7f012f787700 1 --2- 172.21.15.149:0/1581428220 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f010c06af00 0x7f010c06d3c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f01280b6340 tx=0x7f0118009040 comp rx=0 tx=0).stop 2023-11-08T19:24:22.807 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.804+0000 7f012f787700 1 -- 172.21.15.149:0/1581428220 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0114004d90 msgr2=0x7f01280c78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:22.807 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.804+0000 7f012f787700 1 --2- 172.21.15.149:0/1581428220 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0114004d90 0x7f01280c78d0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f0124011aa0 tx=0x7f0124011e60 comp rx=0 tx=0).stop 2023-11-08T19:24:22.807 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.804+0000 7f012f787700 1 -- 172.21.15.149:0/1581428220 shutdown_connections 2023-11-08T19:24:22.807 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.804+0000 7f012f787700 1 --2- 172.21.15.149:0/1581428220 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f010c06af00 0x7f010c06d3c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:22.808 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.804+0000 7f012f787700 1 --2- 172.21.15.149:0/1581428220 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f01280cd950 0x7f012815a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:22.808 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.804+0000 7f012f787700 1 --2- 172.21.15.149:0/1581428220 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0114004d90 0x7f01280c78d0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:22.808 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.804+0000 7f012f787700 1 --2- 172.21.15.149:0/1581428220 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f01281e5190 0x7f01281e6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:22.808 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.804+0000 7f012f787700 1 -- 172.21.15.149:0/1581428220 >> 172.21.15.149:0/1581428220 conn(0x7f01280d0620 msgr2=0x7f012815cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:22.808 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.804+0000 7f012f787700 1 -- 172.21.15.149:0/1581428220 shutdown_connections 2023-11-08T19:24:22.808 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.804+0000 7f012f787700 1 -- 172.21.15.149:0/1581428220 wait complete. 2023-11-08T19:24:22.818 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-08T19:24:22.819 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:24:22.940 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.938+0000 7f03b737d700 1 Processor -- start 2023-11-08T19:24:22.940 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.938+0000 7f03b737d700 1 -- start start 2023-11-08T19:24:22.944 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.939+0000 7f03b737d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03b015b950 0x7f03b00cc290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:22.944 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.939+0000 7f03b737d700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03b015bd30 con 0x7f03b00c9690 2023-11-08T19:24:22.944 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.939+0000 7f03b737d700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03b00c7670 con 0x7f03b00d0fe0 2023-11-08T19:24:22.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.939+0000 7f03b737d700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03b00caa90 con 0x7f03b015b950 2023-11-08T19:24:22.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.939+0000 7f03b591a700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f03b00c9690 0x7f03b015fb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:41414/0 (socket says 172.21.15.149:41414) 2023-11-08T19:24:22.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.939+0000 7f03b591a700 1 -- 172.21.15.149:0/2577916063 learned_addr learned my addr 172.21.15.149:0/2577916063 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:24:22.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.939+0000 7f03a7fff700 1 -- 172.21.15.149:0/2577916063 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 287590942 0 0) 0x7f03b015bd30 con 0x7f03b00c9690 2023-11-08T19:24:22.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.939+0000 7f03b5119700 1 --2- 172.21.15.149:0/2577916063 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03b015b950 0x7f03b00cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:22.946 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.939+0000 7f03a7fff700 1 -- 172.21.15.149:0/2577916063 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f039c0035b0 con 0x7f03b00c9690 2023-11-08T19:24:22.946 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.939+0000 7f03a7fff700 1 -- 172.21.15.149:0/2577916063 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 954884604 0 0) 0x7f039c0035b0 con 0x7f03b00c9690 2023-11-08T19:24:22.946 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.939+0000 7f03a7fff700 1 -- 172.21.15.149:0/2577916063 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03b015b950 msgr2=0x7f03b00cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:22.946 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.939+0000 7f03a7fff700 1 --2- 172.21.15.149:0/2577916063 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03b015b950 0x7f03b00cc290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:22.946 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.939+0000 7f03a7fff700 1 -- 172.21.15.149:0/2577916063 >> v1:172.21.15.160:6789/0 conn(0x7f03b00d0fe0 legacy=0x7f03b015f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:22.947 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.939+0000 7f03a7fff700 1 -- 172.21.15.149:0/2577916063 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b00c81f0 con 0x7f03b00c9690 2023-11-08T19:24:22.947 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.939+0000 7f03a7fff700 1 -- 172.21.15.149:0/2577916063 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f03a80019f0 con 0x7f03b00c9690 2023-11-08T19:24:22.947 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.940+0000 7f03a7fff700 1 -- 172.21.15.149:0/2577916063 >> v1:172.21.15.149:6789/0 conn(0x7f03b00c9690 legacy=0x7f03b015fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:22.947 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.940+0000 7f03a7fff700 1 --2- 172.21.15.149:0/2577916063 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f039c003a30 0x7f039c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:22.947 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.940+0000 7f03a7fff700 1 --2- 172.21.15.149:0/2577916063 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03b015b950 0x7f039c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:22.948 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.940+0000 7f03a7fff700 1 --2- 172.21.15.149:0/2577916063 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f039c004d90 0x7f039c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:22.948 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.940+0000 7f03a7fff700 1 -- 172.21.15.149:0/2577916063 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b00caa90 con 0x7f039c004d90 2023-11-08T19:24:22.948 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.940+0000 7f03a7fff700 1 -- 172.21.15.149:0/2577916063 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f039c00ba10 con 0x7f039c003a30 2023-11-08T19:24:22.948 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.940+0000 7f03a7fff700 1 -- 172.21.15.149:0/2577916063 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f039c00bbd0 con 0x7f03b015b950 2023-11-08T19:24:22.948 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.940+0000 7f03b591a700 1 --2- 172.21.15.149:0/2577916063 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f039c004d90 0x7f039c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:22.949 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.940+0000 7f03b4918700 1 --2- 172.21.15.149:0/2577916063 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03b015b950 0x7f039c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:22.949 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.940+0000 7f03b5119700 1 --2- 172.21.15.149:0/2577916063 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f039c003a30 0x7f039c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:22.949 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.940+0000 7f03b591a700 1 -- 172.21.15.149:0/2577916063 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03b015b950 msgr2=0x7f039c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:22.949 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.940+0000 7f03b591a700 1 --2- 172.21.15.149:0/2577916063 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03b015b950 0x7f039c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:22.949 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.940+0000 7f03b591a700 1 -- 172.21.15.149:0/2577916063 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f039c003a30 msgr2=0x7f039c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:22.950 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.940+0000 7f03b591a700 1 --2- 172.21.15.149:0/2577916063 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f039c003a30 0x7f039c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:22.950 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.940+0000 7f03b591a700 1 -- 172.21.15.149:0/2577916063 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f039c0035b0 con 0x7f039c004d90 2023-11-08T19:24:22.950 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.940+0000 7f03b591a700 1 --2- 172.21.15.149:0/2577916063 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f039c004d90 0x7f039c005210 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f03a800a7f0 tx=0x7f039c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ea7fa2b3194af4d server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:22.950 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.940+0000 7f03a7fff700 1 -- 172.21.15.149:0/2577916063 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a800a2f0 con 0x7f039c004d90 2023-11-08T19:24:22.950 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.940+0000 7f03a7fff700 1 -- 172.21.15.149:0/2577916063 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a8012620 con 0x7f039c004d90 2023-11-08T19:24:22.951 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.940+0000 7f03a7fff700 1 -- 172.21.15.149:0/2577916063 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a80129d0 con 0x7f039c004d90 2023-11-08T19:24:22.951 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.941+0000 7f03b737d700 1 -- 172.21.15.149:0/2577916063 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f039c004d90 msgr2=0x7f039c005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:22.951 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.941+0000 7f03b737d700 1 --2- 172.21.15.149:0/2577916063 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f039c004d90 0x7f039c005210 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f03a800a7f0 tx=0x7f039c005880 comp rx=0 tx=0).stop 2023-11-08T19:24:22.951 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.941+0000 7f03b591a700 1 -- 172.21.15.149:0/2577916063 reap_dead start 2023-11-08T19:24:22.951 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.941+0000 7f03b737d700 1 -- 172.21.15.149:0/2577916063 shutdown_connections 2023-11-08T19:24:22.952 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.941+0000 7f03b737d700 1 -- 172.21.15.149:0/2577916063 >> 172.21.15.149:0/2577916063 conn(0x7f03b0099a40 msgr2=0x7f03b00d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:22.952 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.941+0000 7f03b737d700 1 -- 172.21.15.149:0/2577916063 shutdown_connections 2023-11-08T19:24:22.952 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.941+0000 7f03b737d700 1 -- 172.21.15.149:0/2577916063 wait complete. 2023-11-08T19:24:22.952 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.942+0000 7f03b737d700 1 Processor -- start 2023-11-08T19:24:22.952 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.942+0000 7f03b737d700 1 -- start start 2023-11-08T19:24:22.955 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.943+0000 7f03b737d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f039c004d90 0x7f03b0148d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:22.955 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.943+0000 7f03b737d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03b00cc290 0x7f03b00cc710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:22.956 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.943+0000 7f03b737d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03b015bf50 0x7f03b015c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:22.956 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.943+0000 7f03b737d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b00ccc50 con 0x7f039c004d90 2023-11-08T19:24:22.956 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.943+0000 7f03b737d700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b015f140 con 0x7f03b015bf50 2023-11-08T19:24:22.956 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.943+0000 7f03b737d700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03b01492b0 con 0x7f03b00cc290 2023-11-08T19:24:22.956 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.943+0000 7f03b5119700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f039c004d90 0x7f03b0148d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:22.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.943+0000 7f03b5119700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f039c004d90 0x7f03b0148d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39420/0 (socket says 172.21.15.149:39420) 2023-11-08T19:24:22.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.943+0000 7f03b5119700 1 -- 172.21.15.149:0/213526694 learned_addr learned my addr 172.21.15.149:0/213526694 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:22.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.943+0000 7f03b4918700 1 --2- 172.21.15.149:0/213526694 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03b00cc290 0x7f03b00cc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:22.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.943+0000 7f03b591a700 1 --2- 172.21.15.149:0/213526694 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03b015bf50 0x7f03b015c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:22.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.943+0000 7f03b5119700 1 -- 172.21.15.149:0/213526694 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03b00cc290 msgr2=0x7f03b00cc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:22.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.943+0000 7f03b5119700 1 --2- 172.21.15.149:0/213526694 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03b00cc290 0x7f03b00cc710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:22.958 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.943+0000 7f03b5119700 1 -- 172.21.15.149:0/213526694 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03b015bf50 msgr2=0x7f03b015c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:22.958 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.943+0000 7f03b5119700 1 --2- 172.21.15.149:0/213526694 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03b015bf50 0x7f03b015c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:22.958 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.943+0000 7f03b5119700 1 -- 172.21.15.149:0/213526694 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b015e0a0 con 0x7f039c004d90 2023-11-08T19:24:22.958 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.943+0000 7f03b5119700 1 --2- 172.21.15.149:0/213526694 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f039c004d90 0x7f03b0148d70 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f03ac0119f0 tx=0x7f03ac011db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:22.958 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.943+0000 7f03a5ffb700 1 -- 172.21.15.149:0/213526694 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ac005c30 con 0x7f039c004d90 2023-11-08T19:24:22.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.943+0000 7f03a5ffb700 1 -- 172.21.15.149:0/213526694 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03ac005d90 con 0x7f039c004d90 2023-11-08T19:24:22.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.944+0000 7f03a5ffb700 1 -- 172.21.15.149:0/213526694 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ac00f950 con 0x7f039c004d90 2023-11-08T19:24:22.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.944+0000 7f03b737d700 1 -- 172.21.15.149:0/213526694 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03b015e380 con 0x7f039c004d90 2023-11-08T19:24:22.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.944+0000 7f03b737d700 1 -- 172.21.15.149:0/213526694 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03b015e940 con 0x7f039c004d90 2023-11-08T19:24:22.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.945+0000 7f03b737d700 1 -- 172.21.15.149:0/213526694 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03b00745f0 con 0x7f039c004d90 2023-11-08T19:24:22.960 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.945+0000 7f03a5ffb700 1 -- 172.21.15.149:0/213526694 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f03ac00fab0 con 0x7f039c004d90 2023-11-08T19:24:22.960 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.945+0000 7f03a5ffb700 1 --2- 172.21.15.149:0/213526694 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f039406af00 0x7f039406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:22.960 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.946+0000 7f03a5ffb700 1 -- 172.21.15.149:0/213526694 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f03ac089fc0 con 0x7f039c004d90 2023-11-08T19:24:22.960 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.946+0000 7f03b4918700 1 --2- 172.21.15.149:0/213526694 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f039406af00 0x7f039406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:22.960 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.946+0000 7f03b4918700 1 --2- 172.21.15.149:0/213526694 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f039406af00 0x7f039406d3c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f03b006f050 tx=0x7f03a0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:22.961 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:22.950+0000 7f03a5ffb700 1 -- 172.21.15.149:0/213526694 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f03ac054e90 con 0x7f039c004d90 2023-11-08T19:24:23.138 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:23.136+0000 7f03b737d700 1 -- 172.21.15.149:0/213526694 --> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f03b00c78c0 con 0x7f039406af00 2023-11-08T19:24:23.145 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:23.144+0000 7f03a5ffb700 1 -- 172.21.15.149:0/213526694 <== mgr.4104 v2:172.21.15.149:6832/1929837472 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289538 (secure 0 0 0) 0x7f03a0001450 con 0x7f039406af00 2023-11-08T19:24:23.149 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:24:23.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:23.147+0000 7f03b737d700 1 -- 172.21.15.149:0/213526694 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f039406af00 msgr2=0x7f039406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:23.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:23.147+0000 7f03b737d700 1 --2- 172.21.15.149:0/213526694 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f039406af00 0x7f039406d3c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f03b006f050 tx=0x7f03a0009040 comp rx=0 tx=0).stop 2023-11-08T19:24:23.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:23.147+0000 7f03b737d700 1 -- 172.21.15.149:0/213526694 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f039c004d90 msgr2=0x7f03b0148d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:23.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:23.147+0000 7f03b737d700 1 --2- 172.21.15.149:0/213526694 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f039c004d90 0x7f03b0148d70 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f03ac0119f0 tx=0x7f03ac011db0 comp rx=0 tx=0).stop 2023-11-08T19:24:23.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:23.147+0000 7f03b737d700 1 -- 172.21.15.149:0/213526694 shutdown_connections 2023-11-08T19:24:23.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:23.147+0000 7f03b737d700 1 --2- 172.21.15.149:0/213526694 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f039406af00 0x7f039406d3c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:23.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:23.147+0000 7f03b737d700 1 --2- 172.21.15.149:0/213526694 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03b015bf50 0x7f03b015c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:23.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:23.147+0000 7f03b737d700 1 --2- 172.21.15.149:0/213526694 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f039c004d90 0x7f03b0148d70 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:23.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:23.147+0000 7f03b737d700 1 --2- 172.21.15.149:0/213526694 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03b00cc290 0x7f03b00cc710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:23.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:23.147+0000 7f03b737d700 1 -- 172.21.15.149:0/213526694 >> 172.21.15.149:0/213526694 conn(0x7f03b0099a40 msgr2=0x7f03b00c8580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:23.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:23.147+0000 7f03b737d700 1 -- 172.21.15.149:0/213526694 shutdown_connections 2023-11-08T19:24:23.154 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:23.147+0000 7f03b737d700 1 -- 172.21.15.149:0/213526694 wait complete. 2023-11-08T19:24:23.154 INFO:teuthology.orchestra.run.smithi149.stderr:dumped all 2023-11-08T19:24:23.161 INFO:teuthology.orchestra.run.smithi149.stdout:{"pg_ready":true,"pg_map":{"version":75,"stamp":"2023-11-08T19:24:22.002583+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":167,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220904,"kb_used_data":4732,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753816,"statfs":{"total":773094113280,"available":772867907584,"internally_reserved":0,"allocated":4845568,"data_stored":2731824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001211"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.171770+0000","last_change":"2023-11-08T19:24:17.123033+0000","last_active":"2023-11-08T19:24:19.171770+0000","last_peered":"2023-11-08T19:24:19.171770+0000","last_clean":"2023-11-08T19:24:19.171770+0000","last_became_active":"2023-11-08T19:24:17.122782+0000","last_became_peered":"2023-11-08T19:24:17.122782+0000","last_unstale":"2023-11-08T19:24:19.171770+0000","last_undegraded":"2023-11-08T19:24:19.171770+0000","last_fullsized":"2023-11-08T19:24:19.171770+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:18:26.252263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.171643+0000","last_change":"2023-11-08T19:24:17.119814+0000","last_active":"2023-11-08T19:24:19.171643+0000","last_peered":"2023-11-08T19:24:19.171643+0000","last_clean":"2023-11-08T19:24:19.171643+0000","last_became_active":"2023-11-08T19:24:17.119581+0000","last_became_peered":"2023-11-08T19:24:17.119581+0000","last_unstale":"2023-11-08T19:24:19.171643+0000","last_undegraded":"2023-11-08T19:24:19.171643+0000","last_fullsized":"2023-11-08T19:24:19.171643+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:39:50.238810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.620818+0000","last_change":"2023-11-08T19:24:17.122049+0000","last_active":"2023-11-08T19:24:19.620818+0000","last_peered":"2023-11-08T19:24:19.620818+0000","last_clean":"2023-11-08T19:24:19.620818+0000","last_became_active":"2023-11-08T19:24:17.121756+0000","last_became_peered":"2023-11-08T19:24:17.121756+0000","last_unstale":"2023-11-08T19:24:19.620818+0000","last_undegraded":"2023-11-08T19:24:19.620818+0000","last_fullsized":"2023-11-08T19:24:19.620818+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:16:13.162177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.626466+0000","last_change":"2023-11-08T19:24:17.111612+0000","last_active":"2023-11-08T19:24:18.626466+0000","last_peered":"2023-11-08T19:24:18.626466+0000","last_clean":"2023-11-08T19:24:18.626466+0000","last_became_active":"2023-11-08T19:24:17.111250+0000","last_became_peered":"2023-11-08T19:24:17.111250+0000","last_unstale":"2023-11-08T19:24:18.626466+0000","last_undegraded":"2023-11-08T19:24:18.626466+0000","last_fullsized":"2023-11-08T19:24:18.626466+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:20:59.004203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.626465+0000","last_change":"2023-11-08T19:24:17.111927+0000","last_active":"2023-11-08T19:24:18.626465+0000","last_peered":"2023-11-08T19:24:18.626465+0000","last_clean":"2023-11-08T19:24:18.626465+0000","last_became_active":"2023-11-08T19:24:17.111621+0000","last_became_peered":"2023-11-08T19:24:17.111621+0000","last_unstale":"2023-11-08T19:24:18.626465+0000","last_undegraded":"2023-11-08T19:24:18.626465+0000","last_fullsized":"2023-11-08T19:24:18.626465+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:56:23.821648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.108465+0000","last_change":"2023-11-08T19:24:17.120284+0000","last_active":"2023-11-08T19:24:18.108465+0000","last_peered":"2023-11-08T19:24:18.108465+0000","last_clean":"2023-11-08T19:24:18.108465+0000","last_became_active":"2023-11-08T19:24:17.120029+0000","last_became_peered":"2023-11-08T19:24:17.120029+0000","last_unstale":"2023-11-08T19:24:18.108465+0000","last_undegraded":"2023-11-08T19:24:18.108465+0000","last_fullsized":"2023-11-08T19:24:18.108465+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:33:32.862712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.629168+0000","last_change":"2023-11-08T19:24:17.126220+0000","last_active":"2023-11-08T19:24:18.629168+0000","last_peered":"2023-11-08T19:24:18.629168+0000","last_clean":"2023-11-08T19:24:18.629168+0000","last_became_active":"2023-11-08T19:24:17.125965+0000","last_became_peered":"2023-11-08T19:24:17.125965+0000","last_unstale":"2023-11-08T19:24:18.629168+0000","last_undegraded":"2023-11-08T19:24:18.629168+0000","last_fullsized":"2023-11-08T19:24:18.629168+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:05:23.478967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.171327+0000","last_change":"2023-11-08T19:24:17.123508+0000","last_active":"2023-11-08T19:24:19.171327+0000","last_peered":"2023-11-08T19:24:19.171327+0000","last_clean":"2023-11-08T19:24:19.171327+0000","last_became_active":"2023-11-08T19:24:17.123240+0000","last_became_peered":"2023-11-08T19:24:17.123240+0000","last_unstale":"2023-11-08T19:24:19.171327+0000","last_undegraded":"2023-11-08T19:24:19.171327+0000","last_fullsized":"2023-11-08T19:24:19.171327+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:05:23.478967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.621184+0000","last_change":"2023-11-08T19:24:17.122127+0000","last_active":"2023-11-08T19:24:19.621184+0000","last_peered":"2023-11-08T19:24:19.621184+0000","last_clean":"2023-11-08T19:24:19.621184+0000","last_became_active":"2023-11-08T19:24:17.121856+0000","last_became_peered":"2023-11-08T19:24:17.121856+0000","last_unstale":"2023-11-08T19:24:19.621184+0000","last_undegraded":"2023-11-08T19:24:19.621184+0000","last_fullsized":"2023-11-08T19:24:19.621184+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:41:09.802388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.629558+0000","last_change":"2023-11-08T19:24:17.126282+0000","last_active":"2023-11-08T19:24:18.629558+0000","last_peered":"2023-11-08T19:24:18.629558+0000","last_clean":"2023-11-08T19:24:18.629558+0000","last_became_active":"2023-11-08T19:24:17.125897+0000","last_became_peered":"2023-11-08T19:24:17.125897+0000","last_unstale":"2023-11-08T19:24:18.629558+0000","last_undegraded":"2023-11-08T19:24:18.629558+0000","last_fullsized":"2023-11-08T19:24:18.629558+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:18:26.252263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.629549+0000","last_change":"2023-11-08T19:24:17.119545+0000","last_active":"2023-11-08T19:24:18.629549+0000","last_peered":"2023-11-08T19:24:18.629549+0000","last_clean":"2023-11-08T19:24:18.629549+0000","last_became_active":"2023-11-08T19:24:17.119216+0000","last_became_peered":"2023-11-08T19:24:17.119216+0000","last_unstale":"2023-11-08T19:24:18.629549+0000","last_undegraded":"2023-11-08T19:24:18.629549+0000","last_fullsized":"2023-11-08T19:24:18.629549+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:53:54.966516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.620933+0000","last_change":"2023-11-08T19:24:17.120015+0000","last_active":"2023-11-08T19:24:19.620933+0000","last_peered":"2023-11-08T19:24:19.620933+0000","last_clean":"2023-11-08T19:24:19.620933+0000","last_became_active":"2023-11-08T19:24:17.119727+0000","last_became_peered":"2023-11-08T19:24:17.119727+0000","last_unstale":"2023-11-08T19:24:19.620933+0000","last_undegraded":"2023-11-08T19:24:19.620933+0000","last_fullsized":"2023-11-08T19:24:19.620933+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:53:38.138608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.629195+0000","last_change":"2023-11-08T19:24:17.128141+0000","last_active":"2023-11-08T19:24:18.629195+0000","last_peered":"2023-11-08T19:24:18.629195+0000","last_clean":"2023-11-08T19:24:18.629195+0000","last_became_active":"2023-11-08T19:24:17.127788+0000","last_became_peered":"2023-11-08T19:24:17.127788+0000","last_unstale":"2023-11-08T19:24:18.629195+0000","last_undegraded":"2023-11-08T19:24:18.629195+0000","last_fullsized":"2023-11-08T19:24:18.629195+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:21:41.966251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.109986+0000","last_change":"2023-11-08T19:24:17.116970+0000","last_active":"2023-11-08T19:24:18.109986+0000","last_peered":"2023-11-08T19:24:18.109986+0000","last_clean":"2023-11-08T19:24:18.109986+0000","last_became_active":"2023-11-08T19:24:17.116708+0000","last_became_peered":"2023-11-08T19:24:17.116708+0000","last_unstale":"2023-11-08T19:24:18.109986+0000","last_undegraded":"2023-11-08T19:24:18.109986+0000","last_fullsized":"2023-11-08T19:24:18.109986+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:12:58.048320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.629201+0000","last_change":"2023-11-08T19:24:17.119392+0000","last_active":"2023-11-08T19:24:18.629201+0000","last_peered":"2023-11-08T19:24:18.629201+0000","last_clean":"2023-11-08T19:24:18.629201+0000","last_became_active":"2023-11-08T19:24:17.119100+0000","last_became_peered":"2023-11-08T19:24:17.119100+0000","last_unstale":"2023-11-08T19:24:18.629201+0000","last_undegraded":"2023-11-08T19:24:18.629201+0000","last_fullsized":"2023-11-08T19:24:18.629201+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:08:50.861077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.639524+0000","last_change":"2023-11-08T19:24:17.127685+0000","last_active":"2023-11-08T19:24:19.639524+0000","last_peered":"2023-11-08T19:24:19.639524+0000","last_clean":"2023-11-08T19:24:19.639524+0000","last_became_active":"2023-11-08T19:24:17.127019+0000","last_became_peered":"2023-11-08T19:24:17.127019+0000","last_unstale":"2023-11-08T19:24:19.639524+0000","last_undegraded":"2023-11-08T19:24:19.639524+0000","last_fullsized":"2023-11-08T19:24:19.639524+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:38:34.568472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.640116+0000","last_change":"2023-11-08T19:24:17.125050+0000","last_active":"2023-11-08T19:24:19.640116+0000","last_peered":"2023-11-08T19:24:19.640116+0000","last_clean":"2023-11-08T19:24:19.640116+0000","last_became_active":"2023-11-08T19:24:17.124290+0000","last_became_peered":"2023-11-08T19:24:17.124290+0000","last_unstale":"2023-11-08T19:24:19.640116+0000","last_undegraded":"2023-11-08T19:24:19.640116+0000","last_fullsized":"2023-11-08T19:24:19.640116+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:12.060745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.109617+0000","last_change":"2023-11-08T19:24:17.118666+0000","last_active":"2023-11-08T19:24:18.109617+0000","last_peered":"2023-11-08T19:24:18.109617+0000","last_clean":"2023-11-08T19:24:18.109617+0000","last_became_active":"2023-11-08T19:24:17.118272+0000","last_became_peered":"2023-11-08T19:24:17.118272+0000","last_unstale":"2023-11-08T19:24:18.109617+0000","last_undegraded":"2023-11-08T19:24:18.109617+0000","last_fullsized":"2023-11-08T19:24:18.109617+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:42:55.799453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.626562+0000","last_change":"2023-11-08T19:24:17.120411+0000","last_active":"2023-11-08T19:24:18.626562+0000","last_peered":"2023-11-08T19:24:18.626562+0000","last_clean":"2023-11-08T19:24:18.626562+0000","last_became_active":"2023-11-08T19:24:17.120029+0000","last_became_peered":"2023-11-08T19:24:17.120029+0000","last_unstale":"2023-11-08T19:24:18.626562+0000","last_undegraded":"2023-11-08T19:24:18.626562+0000","last_fullsized":"2023-11-08T19:24:18.626562+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:33:44.652238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.109500+0000","last_change":"2023-11-08T19:24:17.115499+0000","last_active":"2023-11-08T19:24:18.109500+0000","last_peered":"2023-11-08T19:24:18.109500+0000","last_clean":"2023-11-08T19:24:18.109500+0000","last_became_active":"2023-11-08T19:24:17.115213+0000","last_became_peered":"2023-11-08T19:24:17.115213+0000","last_unstale":"2023-11-08T19:24:18.109500+0000","last_undegraded":"2023-11-08T19:24:18.109500+0000","last_fullsized":"2023-11-08T19:24:18.109500+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:32:37.195254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.629278+0000","last_change":"2023-11-08T19:24:17.122189+0000","last_active":"2023-11-08T19:24:18.629278+0000","last_peered":"2023-11-08T19:24:18.629278+0000","last_clean":"2023-11-08T19:24:18.629278+0000","last_became_active":"2023-11-08T19:24:17.121889+0000","last_became_peered":"2023-11-08T19:24:17.121889+0000","last_unstale":"2023-11-08T19:24:18.629278+0000","last_undegraded":"2023-11-08T19:24:18.629278+0000","last_fullsized":"2023-11-08T19:24:18.629278+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:12.060745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.109547+0000","last_change":"2023-11-08T19:24:17.114478+0000","last_active":"2023-11-08T19:24:18.109547+0000","last_peered":"2023-11-08T19:24:18.109547+0000","last_clean":"2023-11-08T19:24:18.109547+0000","last_became_active":"2023-11-08T19:24:17.114207+0000","last_became_peered":"2023-11-08T19:24:17.114207+0000","last_unstale":"2023-11-08T19:24:18.109547+0000","last_undegraded":"2023-11-08T19:24:18.109547+0000","last_fullsized":"2023-11-08T19:24:18.109547+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:32:37.195254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.639778+0000","last_change":"2023-11-08T19:24:17.127471+0000","last_active":"2023-11-08T19:24:19.639778+0000","last_peered":"2023-11-08T19:24:19.639778+0000","last_clean":"2023-11-08T19:24:19.639778+0000","last_became_active":"2023-11-08T19:24:17.125384+0000","last_became_peered":"2023-11-08T19:24:17.125384+0000","last_unstale":"2023-11-08T19:24:19.639778+0000","last_undegraded":"2023-11-08T19:24:19.639778+0000","last_fullsized":"2023-11-08T19:24:19.639778+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:56:51.753457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.626382+0000","last_change":"2023-11-08T19:24:17.123153+0000","last_active":"2023-11-08T19:24:18.626382+0000","last_peered":"2023-11-08T19:24:18.626382+0000","last_clean":"2023-11-08T19:24:18.626382+0000","last_became_active":"2023-11-08T19:24:17.122842+0000","last_became_peered":"2023-11-08T19:24:17.122842+0000","last_unstale":"2023-11-08T19:24:18.626382+0000","last_undegraded":"2023-11-08T19:24:18.626382+0000","last_fullsized":"2023-11-08T19:24:18.626382+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:27:43.480541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.109994+0000","last_change":"2023-11-08T19:24:17.119904+0000","last_active":"2023-11-08T19:24:18.109994+0000","last_peered":"2023-11-08T19:24:18.109994+0000","last_clean":"2023-11-08T19:24:18.109994+0000","last_became_active":"2023-11-08T19:24:17.119682+0000","last_became_peered":"2023-11-08T19:24:17.119682+0000","last_unstale":"2023-11-08T19:24:18.109994+0000","last_undegraded":"2023-11-08T19:24:18.109994+0000","last_fullsized":"2023-11-08T19:24:18.109994+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:12:58.048320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.108589+0000","last_change":"2023-11-08T19:24:17.118368+0000","last_active":"2023-11-08T19:24:18.108589+0000","last_peered":"2023-11-08T19:24:18.108589+0000","last_clean":"2023-11-08T19:24:18.108589+0000","last_became_active":"2023-11-08T19:24:17.118099+0000","last_became_peered":"2023-11-08T19:24:17.118099+0000","last_unstale":"2023-11-08T19:24:18.108589+0000","last_undegraded":"2023-11-08T19:24:18.108589+0000","last_fullsized":"2023-11-08T19:24:18.108589+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:00:12.858113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.109838+0000","last_change":"2023-11-08T19:24:17.116006+0000","last_active":"2023-11-08T19:24:18.109838+0000","last_peered":"2023-11-08T19:24:18.109838+0000","last_clean":"2023-11-08T19:24:18.109838+0000","last_became_active":"2023-11-08T19:24:17.114407+0000","last_became_peered":"2023-11-08T19:24:17.114407+0000","last_unstale":"2023-11-08T19:24:18.109838+0000","last_undegraded":"2023-11-08T19:24:18.109838+0000","last_fullsized":"2023-11-08T19:24:18.109838+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:33:32.862712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.629538+0000","last_change":"2023-11-08T19:24:17.123637+0000","last_active":"2023-11-08T19:24:18.629538+0000","last_peered":"2023-11-08T19:24:18.629538+0000","last_clean":"2023-11-08T19:24:18.629538+0000","last_became_active":"2023-11-08T19:24:17.123374+0000","last_became_peered":"2023-11-08T19:24:17.123374+0000","last_unstale":"2023-11-08T19:24:18.629538+0000","last_undegraded":"2023-11-08T19:24:18.629538+0000","last_fullsized":"2023-11-08T19:24:18.629538+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:39:50.238810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.110117+0000","last_change":"2023-11-08T19:24:17.120031+0000","last_active":"2023-11-08T19:24:18.110117+0000","last_peered":"2023-11-08T19:24:18.110117+0000","last_clean":"2023-11-08T19:24:18.110117+0000","last_became_active":"2023-11-08T19:24:17.118844+0000","last_became_peered":"2023-11-08T19:24:17.118844+0000","last_unstale":"2023-11-08T19:24:18.110117+0000","last_undegraded":"2023-11-08T19:24:18.110117+0000","last_fullsized":"2023-11-08T19:24:18.110117+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:00:12.858113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.109836+0000","last_change":"2023-11-08T19:24:17.120799+0000","last_active":"2023-11-08T19:24:18.109836+0000","last_peered":"2023-11-08T19:24:18.109836+0000","last_clean":"2023-11-08T19:24:18.109836+0000","last_became_active":"2023-11-08T19:24:17.120547+0000","last_became_peered":"2023-11-08T19:24:17.120547+0000","last_unstale":"2023-11-08T19:24:18.109836+0000","last_undegraded":"2023-11-08T19:24:18.109836+0000","last_fullsized":"2023-11-08T19:24:18.109836+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:37:25.491966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.639820+0000","last_change":"2023-11-08T19:24:17.126988+0000","last_active":"2023-11-08T19:24:19.639820+0000","last_peered":"2023-11-08T19:24:19.639820+0000","last_clean":"2023-11-08T19:24:19.639820+0000","last_became_active":"2023-11-08T19:24:17.125342+0000","last_became_peered":"2023-11-08T19:24:17.125342+0000","last_unstale":"2023-11-08T19:24:19.639820+0000","last_undegraded":"2023-11-08T19:24:19.639820+0000","last_fullsized":"2023-11-08T19:24:19.639820+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:54:17.779367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.108459+0000","last_change":"2023-11-08T19:24:17.119513+0000","last_active":"2023-11-08T19:24:18.108459+0000","last_peered":"2023-11-08T19:24:18.108459+0000","last_clean":"2023-11-08T19:24:18.108459+0000","last_became_active":"2023-11-08T19:24:17.119266+0000","last_became_peered":"2023-11-08T19:24:17.119266+0000","last_unstale":"2023-11-08T19:24:18.108459+0000","last_undegraded":"2023-11-08T19:24:18.108459+0000","last_fullsized":"2023-11-08T19:24:18.108459+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:37:25.491966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.639846+0000","last_change":"2023-11-08T19:24:17.124148+0000","last_active":"2023-11-08T19:24:19.639846+0000","last_peered":"2023-11-08T19:24:19.639846+0000","last_clean":"2023-11-08T19:24:19.639846+0000","last_became_active":"2023-11-08T19:24:17.123849+0000","last_became_peered":"2023-11-08T19:24:17.123849+0000","last_unstale":"2023-11-08T19:24:19.639846+0000","last_undegraded":"2023-11-08T19:24:19.639846+0000","last_fullsized":"2023-11-08T19:24:19.639846+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:05:23.478967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.493590+0000","last_change":"2023-11-08T19:24:16.115544+0000","last_active":"2023-11-08T19:24:17.493590+0000","last_peered":"2023-11-08T19:24:17.493590+0000","last_clean":"2023-11-08T19:24:17.493590+0000","last_became_active":"2023-11-08T19:24:16.115253+0000","last_became_peered":"2023-11-08T19:24:16.115253+0000","last_unstale":"2023-11-08T19:24:17.493590+0000","last_undegraded":"2023-11-08T19:24:17.493590+0000","last_fullsized":"2023-11-08T19:24:17.493590+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:27:10.600227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.108858+0000","last_change":"2023-11-08T19:24:17.118929+0000","last_active":"2023-11-08T19:24:18.108858+0000","last_peered":"2023-11-08T19:24:18.108858+0000","last_clean":"2023-11-08T19:24:18.108858+0000","last_became_active":"2023-11-08T19:24:17.118635+0000","last_became_peered":"2023-11-08T19:24:17.118635+0000","last_unstale":"2023-11-08T19:24:18.108858+0000","last_undegraded":"2023-11-08T19:24:18.108858+0000","last_fullsized":"2023-11-08T19:24:18.108858+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:38:34.568472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.491639+0000","last_change":"2023-11-08T19:24:16.121042+0000","last_active":"2023-11-08T19:24:17.491639+0000","last_peered":"2023-11-08T19:24:17.491639+0000","last_clean":"2023-11-08T19:24:17.491639+0000","last_became_active":"2023-11-08T19:24:16.120776+0000","last_became_peered":"2023-11-08T19:24:16.120776+0000","last_unstale":"2023-11-08T19:24:17.491639+0000","last_undegraded":"2023-11-08T19:24:17.491639+0000","last_fullsized":"2023-11-08T19:24:17.491639+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:27:10.600227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.110506+0000","last_change":"2023-11-08T19:24:17.117821+0000","last_active":"2023-11-08T19:24:18.110506+0000","last_peered":"2023-11-08T19:24:18.110506+0000","last_clean":"2023-11-08T19:24:18.110506+0000","last_became_active":"2023-11-08T19:24:17.117535+0000","last_became_peered":"2023-11-08T19:24:17.117535+0000","last_unstale":"2023-11-08T19:24:18.110506+0000","last_undegraded":"2023-11-08T19:24:18.110506+0000","last_fullsized":"2023-11-08T19:24:18.110506+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:16:13.162177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.491489+0000","last_change":"2023-11-08T19:24:16.124256+0000","last_active":"2023-11-08T19:24:17.491489+0000","last_peered":"2023-11-08T19:24:17.491489+0000","last_clean":"2023-11-08T19:24:17.491489+0000","last_became_active":"2023-11-08T19:24:16.121912+0000","last_became_peered":"2023-11-08T19:24:16.121912+0000","last_unstale":"2023-11-08T19:24:17.491489+0000","last_undegraded":"2023-11-08T19:24:17.491489+0000","last_fullsized":"2023-11-08T19:24:17.491489+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:32:36.193518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.171878+0000","last_change":"2023-11-08T19:24:17.122526+0000","last_active":"2023-11-08T19:24:19.171878+0000","last_peered":"2023-11-08T19:24:19.171878+0000","last_clean":"2023-11-08T19:24:19.171878+0000","last_became_active":"2023-11-08T19:24:17.122262+0000","last_became_peered":"2023-11-08T19:24:17.122262+0000","last_unstale":"2023-11-08T19:24:19.171878+0000","last_undegraded":"2023-11-08T19:24:19.171878+0000","last_fullsized":"2023-11-08T19:24:19.171878+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:45:20.406135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.489853+0000","last_change":"2023-11-08T19:24:16.125612+0000","last_active":"2023-11-08T19:24:17.489853+0000","last_peered":"2023-11-08T19:24:17.489853+0000","last_clean":"2023-11-08T19:24:17.489853+0000","last_became_active":"2023-11-08T19:24:16.125298+0000","last_became_peered":"2023-11-08T19:24:16.125298+0000","last_unstale":"2023-11-08T19:24:17.489853+0000","last_undegraded":"2023-11-08T19:24:17.489853+0000","last_fullsized":"2023-11-08T19:24:17.489853+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:36:18.253463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.620881+0000","last_change":"2023-11-08T19:24:17.122574+0000","last_active":"2023-11-08T19:24:19.620881+0000","last_peered":"2023-11-08T19:24:19.620881+0000","last_clean":"2023-11-08T19:24:19.620881+0000","last_became_active":"2023-11-08T19:24:17.122305+0000","last_became_peered":"2023-11-08T19:24:17.122305+0000","last_unstale":"2023-11-08T19:24:19.620881+0000","last_undegraded":"2023-11-08T19:24:19.620881+0000","last_fullsized":"2023-11-08T19:24:19.620881+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:38:34.568472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.490497+0000","last_change":"2023-11-08T19:24:16.121095+0000","last_active":"2023-11-08T19:24:17.490497+0000","last_peered":"2023-11-08T19:24:17.490497+0000","last_clean":"2023-11-08T19:24:17.490497+0000","last_became_active":"2023-11-08T19:24:16.120647+0000","last_became_peered":"2023-11-08T19:24:16.120647+0000","last_unstale":"2023-11-08T19:24:17.490497+0000","last_undegraded":"2023-11-08T19:24:17.490497+0000","last_fullsized":"2023-11-08T19:24:17.490497+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:36:18.253463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.629306+0000","last_change":"2023-11-08T19:24:17.122489+0000","last_active":"2023-11-08T19:24:18.629306+0000","last_peered":"2023-11-08T19:24:18.629306+0000","last_clean":"2023-11-08T19:24:18.629306+0000","last_became_active":"2023-11-08T19:24:17.122205+0000","last_became_peered":"2023-11-08T19:24:17.122205+0000","last_unstale":"2023-11-08T19:24:18.629306+0000","last_undegraded":"2023-11-08T19:24:18.629306+0000","last_fullsized":"2023-11-08T19:24:18.629306+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:31:10.520077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.493343+0000","last_change":"2023-11-08T19:24:16.119182+0000","last_active":"2023-11-08T19:24:17.493343+0000","last_peered":"2023-11-08T19:24:17.493343+0000","last_clean":"2023-11-08T19:24:17.493343+0000","last_became_active":"2023-11-08T19:24:16.118932+0000","last_became_peered":"2023-11-08T19:24:16.118932+0000","last_unstale":"2023-11-08T19:24:17.493343+0000","last_undegraded":"2023-11-08T19:24:17.493343+0000","last_fullsized":"2023-11-08T19:24:17.493343+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:21:06.998550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.109704+0000","last_change":"2023-11-08T19:24:17.118405+0000","last_active":"2023-11-08T19:24:18.109704+0000","last_peered":"2023-11-08T19:24:18.109704+0000","last_clean":"2023-11-08T19:24:18.109704+0000","last_became_active":"2023-11-08T19:24:17.118129+0000","last_became_peered":"2023-11-08T19:24:17.118129+0000","last_unstale":"2023-11-08T19:24:18.109704+0000","last_undegraded":"2023-11-08T19:24:18.109704+0000","last_fullsized":"2023-11-08T19:24:18.109704+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:42:55.799453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.111724+0000","last_change":"2023-11-08T19:24:16.123153+0000","last_active":"2023-11-08T19:24:17.111724+0000","last_peered":"2023-11-08T19:24:17.111724+0000","last_clean":"2023-11-08T19:24:17.111724+0000","last_became_active":"2023-11-08T19:24:16.122837+0000","last_became_peered":"2023-11-08T19:24:16.122837+0000","last_unstale":"2023-11-08T19:24:17.111724+0000","last_undegraded":"2023-11-08T19:24:17.111724+0000","last_fullsized":"2023-11-08T19:24:17.111724+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:09:19.268418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.171638+0000","last_change":"2023-11-08T19:24:17.127308+0000","last_active":"2023-11-08T19:24:19.171638+0000","last_peered":"2023-11-08T19:24:19.171638+0000","last_clean":"2023-11-08T19:24:19.171638+0000","last_became_active":"2023-11-08T19:24:17.126959+0000","last_became_peered":"2023-11-08T19:24:17.126959+0000","last_unstale":"2023-11-08T19:24:19.171638+0000","last_undegraded":"2023-11-08T19:24:19.171638+0000","last_fullsized":"2023-11-08T19:24:19.171638+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:31:10.520077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.106903+0000","last_change":"2023-11-08T19:24:16.115097+0000","last_active":"2023-11-08T19:24:17.106903+0000","last_peered":"2023-11-08T19:24:17.106903+0000","last_clean":"2023-11-08T19:24:17.106903+0000","last_became_active":"2023-11-08T19:24:16.114776+0000","last_became_peered":"2023-11-08T19:24:16.114776+0000","last_unstale":"2023-11-08T19:24:17.106903+0000","last_undegraded":"2023-11-08T19:24:17.106903+0000","last_fullsized":"2023-11-08T19:24:17.106903+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:29:45.264000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.626668+0000","last_change":"2023-11-08T19:24:17.114263+0000","last_active":"2023-11-08T19:24:18.626668+0000","last_peered":"2023-11-08T19:24:18.626668+0000","last_clean":"2023-11-08T19:24:18.626668+0000","last_became_active":"2023-11-08T19:24:17.113979+0000","last_became_peered":"2023-11-08T19:24:17.113979+0000","last_unstale":"2023-11-08T19:24:18.626668+0000","last_undegraded":"2023-11-08T19:24:18.626668+0000","last_fullsized":"2023-11-08T19:24:18.626668+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:11:31.830617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.114474+0000","last_change":"2023-11-08T19:24:16.125536+0000","last_active":"2023-11-08T19:24:17.114474+0000","last_peered":"2023-11-08T19:24:17.114474+0000","last_clean":"2023-11-08T19:24:17.114474+0000","last_became_active":"2023-11-08T19:24:16.125250+0000","last_became_peered":"2023-11-08T19:24:16.125250+0000","last_unstale":"2023-11-08T19:24:17.114474+0000","last_undegraded":"2023-11-08T19:24:17.114474+0000","last_fullsized":"2023-11-08T19:24:17.114474+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:54:16.777631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.639960+0000","last_change":"2023-11-08T19:24:17.124866+0000","last_active":"2023-11-08T19:24:19.639960+0000","last_peered":"2023-11-08T19:24:19.639960+0000","last_clean":"2023-11-08T19:24:19.639960+0000","last_became_active":"2023-11-08T19:24:17.124608+0000","last_became_peered":"2023-11-08T19:24:17.124608+0000","last_unstale":"2023-11-08T19:24:19.639960+0000","last_undegraded":"2023-11-08T19:24:19.639960+0000","last_fullsized":"2023-11-08T19:24:19.639960+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:21:41.966251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.114810+0000","last_change":"2023-11-08T19:24:16.125654+0000","last_active":"2023-11-08T19:24:17.114810+0000","last_peered":"2023-11-08T19:24:17.114810+0000","last_clean":"2023-11-08T19:24:17.114810+0000","last_became_active":"2023-11-08T19:24:16.125312+0000","last_became_peered":"2023-11-08T19:24:16.125312+0000","last_unstale":"2023-11-08T19:24:17.114810+0000","last_undegraded":"2023-11-08T19:24:17.114810+0000","last_fullsized":"2023-11-08T19:24:17.114810+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:38:33.566735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.621115+0000","last_change":"2023-11-08T19:24:17.127916+0000","last_active":"2023-11-08T19:24:19.621115+0000","last_peered":"2023-11-08T19:24:19.621115+0000","last_clean":"2023-11-08T19:24:19.621115+0000","last_became_active":"2023-11-08T19:24:17.127617+0000","last_became_peered":"2023-11-08T19:24:17.127617+0000","last_unstale":"2023-11-08T19:24:19.621115+0000","last_undegraded":"2023-11-08T19:24:19.621115+0000","last_fullsized":"2023-11-08T19:24:19.621115+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:54:17.779367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.490739+0000","last_change":"2023-11-08T19:24:16.120737+0000","last_active":"2023-11-08T19:24:17.490739+0000","last_peered":"2023-11-08T19:24:17.490739+0000","last_clean":"2023-11-08T19:24:17.490739+0000","last_became_active":"2023-11-08T19:24:16.120426+0000","last_became_peered":"2023-11-08T19:24:16.120426+0000","last_unstale":"2023-11-08T19:24:17.490739+0000","last_undegraded":"2023-11-08T19:24:17.490739+0000","last_fullsized":"2023-11-08T19:24:17.490739+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:00:11.856376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.110033+0000","last_change":"2023-11-08T19:24:17.112649+0000","last_active":"2023-11-08T19:24:18.110033+0000","last_peered":"2023-11-08T19:24:18.110033+0000","last_clean":"2023-11-08T19:24:18.110033+0000","last_became_active":"2023-11-08T19:24:17.112367+0000","last_became_peered":"2023-11-08T19:24:17.112367+0000","last_unstale":"2023-11-08T19:24:18.110033+0000","last_undegraded":"2023-11-08T19:24:18.110033+0000","last_fullsized":"2023-11-08T19:24:18.110033+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:37:25.491966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.494286+0000","last_change":"2023-11-08T19:24:16.125204+0000","last_active":"2023-11-08T19:24:17.494286+0000","last_peered":"2023-11-08T19:24:17.494286+0000","last_clean":"2023-11-08T19:24:17.494286+0000","last_became_active":"2023-11-08T19:24:16.124854+0000","last_became_peered":"2023-11-08T19:24:16.124854+0000","last_unstale":"2023-11-08T19:24:17.494286+0000","last_undegraded":"2023-11-08T19:24:17.494286+0000","last_fullsized":"2023-11-08T19:24:17.494286+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:41:08.800652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.620710+0000","last_change":"2023-11-08T19:24:17.122294+0000","last_active":"2023-11-08T19:24:19.620710+0000","last_peered":"2023-11-08T19:24:19.620710+0000","last_clean":"2023-11-08T19:24:19.620710+0000","last_became_active":"2023-11-08T19:24:17.121925+0000","last_became_peered":"2023-11-08T19:24:17.121925+0000","last_unstale":"2023-11-08T19:24:19.620710+0000","last_undegraded":"2023-11-08T19:24:19.620710+0000","last_fullsized":"2023-11-08T19:24:19.620710+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:37:25.491966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.488720+0000","last_change":"2023-11-08T19:24:16.124120+0000","last_active":"2023-11-08T19:24:17.488720+0000","last_peered":"2023-11-08T19:24:17.488720+0000","last_clean":"2023-11-08T19:24:17.488720+0000","last_became_active":"2023-11-08T19:24:16.123861+0000","last_became_peered":"2023-11-08T19:24:16.123861+0000","last_unstale":"2023-11-08T19:24:17.488720+0000","last_undegraded":"2023-11-08T19:24:17.488720+0000","last_fullsized":"2023-11-08T19:24:17.488720+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:53:37.136871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.171338+0000","last_change":"2023-11-08T19:24:17.123772+0000","last_active":"2023-11-08T19:24:19.171338+0000","last_peered":"2023-11-08T19:24:19.171338+0000","last_clean":"2023-11-08T19:24:19.171338+0000","last_became_active":"2023-11-08T19:24:17.123465+0000","last_became_peered":"2023-11-08T19:24:17.123465+0000","last_unstale":"2023-11-08T19:24:19.171338+0000","last_undegraded":"2023-11-08T19:24:19.171338+0000","last_fullsized":"2023-11-08T19:24:19.171338+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:25:04.337488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.110649+0000","last_change":"2023-11-08T19:24:16.123874+0000","last_active":"2023-11-08T19:24:17.110649+0000","last_peered":"2023-11-08T19:24:17.110649+0000","last_clean":"2023-11-08T19:24:17.110649+0000","last_became_active":"2023-11-08T19:24:16.123508+0000","last_became_peered":"2023-11-08T19:24:16.123508+0000","last_unstale":"2023-11-08T19:24:17.110649+0000","last_undegraded":"2023-11-08T19:24:17.110649+0000","last_fullsized":"2023-11-08T19:24:17.110649+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:21:06.998550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.639774+0000","last_change":"2023-11-08T19:24:17.124156+0000","last_active":"2023-11-08T19:24:19.639774+0000","last_peered":"2023-11-08T19:24:19.639774+0000","last_clean":"2023-11-08T19:24:19.639774+0000","last_became_active":"2023-11-08T19:24:17.123823+0000","last_became_peered":"2023-11-08T19:24:17.123823+0000","last_unstale":"2023-11-08T19:24:19.639774+0000","last_undegraded":"2023-11-08T19:24:19.639774+0000","last_fullsized":"2023-11-08T19:24:19.639774+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:41:09.802388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.106233+0000","last_change":"2023-11-08T19:24:16.109232+0000","last_active":"2023-11-08T19:24:17.106233+0000","last_peered":"2023-11-08T19:24:17.106233+0000","last_clean":"2023-11-08T19:24:17.106233+0000","last_became_active":"2023-11-08T19:24:16.108931+0000","last_became_peered":"2023-11-08T19:24:16.108931+0000","last_unstale":"2023-11-08T19:24:17.106233+0000","last_undegraded":"2023-11-08T19:24:17.106233+0000","last_fullsized":"2023-11-08T19:24:17.106233+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:45:52.271444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.171490+0000","last_change":"2023-11-08T19:24:17.120690+0000","last_active":"2023-11-08T19:24:19.171490+0000","last_peered":"2023-11-08T19:24:19.171490+0000","last_clean":"2023-11-08T19:24:19.171490+0000","last_became_active":"2023-11-08T19:24:17.120428+0000","last_became_peered":"2023-11-08T19:24:17.120428+0000","last_unstale":"2023-11-08T19:24:19.171490+0000","last_undegraded":"2023-11-08T19:24:19.171490+0000","last_fullsized":"2023-11-08T19:24:19.171490+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:08:50.861077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.493744+0000","last_change":"2023-11-08T19:24:16.119756+0000","last_active":"2023-11-08T19:24:17.493744+0000","last_peered":"2023-11-08T19:24:17.493744+0000","last_clean":"2023-11-08T19:24:17.493744+0000","last_became_active":"2023-11-08T19:24:16.119460+0000","last_became_peered":"2023-11-08T19:24:16.119460+0000","last_unstale":"2023-11-08T19:24:17.493744+0000","last_undegraded":"2023-11-08T19:24:17.493744+0000","last_fullsized":"2023-11-08T19:24:17.493744+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:00:11.856376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.171544+0000","last_change":"2023-11-08T19:24:17.119623+0000","last_active":"2023-11-08T19:24:19.171544+0000","last_peered":"2023-11-08T19:24:19.171544+0000","last_clean":"2023-11-08T19:24:19.171544+0000","last_became_active":"2023-11-08T19:24:17.119345+0000","last_became_peered":"2023-11-08T19:24:17.119345+0000","last_unstale":"2023-11-08T19:24:19.171544+0000","last_undegraded":"2023-11-08T19:24:19.171544+0000","last_fullsized":"2023-11-08T19:24:19.171544+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:12.060745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.491505+0000","last_change":"2023-11-08T19:24:16.116135+0000","last_active":"2023-11-08T19:24:17.491505+0000","last_peered":"2023-11-08T19:24:17.491505+0000","last_clean":"2023-11-08T19:24:17.491505+0000","last_became_active":"2023-11-08T19:24:16.115879+0000","last_became_peered":"2023-11-08T19:24:16.115879+0000","last_unstale":"2023-11-08T19:24:17.491505+0000","last_undegraded":"2023-11-08T19:24:17.491505+0000","last_fullsized":"2023-11-08T19:24:17.491505+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:41:08.800652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.629581+0000","last_change":"2023-11-08T19:24:17.122627+0000","last_active":"2023-11-08T19:24:18.629581+0000","last_peered":"2023-11-08T19:24:18.629581+0000","last_clean":"2023-11-08T19:24:18.629581+0000","last_became_active":"2023-11-08T19:24:17.122313+0000","last_became_peered":"2023-11-08T19:24:17.122313+0000","last_unstale":"2023-11-08T19:24:18.629581+0000","last_undegraded":"2023-11-08T19:24:18.629581+0000","last_fullsized":"2023-11-08T19:24:18.629581+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:45:20.406135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.491205+0000","last_change":"2023-11-08T19:24:16.117967+0000","last_active":"2023-11-08T19:24:17.491205+0000","last_peered":"2023-11-08T19:24:17.491205+0000","last_clean":"2023-11-08T19:24:17.491205+0000","last_became_active":"2023-11-08T19:24:16.117675+0000","last_became_peered":"2023-11-08T19:24:16.117675+0000","last_unstale":"2023-11-08T19:24:17.491205+0000","last_undegraded":"2023-11-08T19:24:17.491205+0000","last_fullsized":"2023-11-08T19:24:17.491205+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:27:10.600227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.110440+0000","last_change":"2023-11-08T19:24:17.119911+0000","last_active":"2023-11-08T19:24:18.110440+0000","last_peered":"2023-11-08T19:24:18.110440+0000","last_clean":"2023-11-08T19:24:18.110440+0000","last_became_active":"2023-11-08T19:24:17.119640+0000","last_became_peered":"2023-11-08T19:24:17.119640+0000","last_unstale":"2023-11-08T19:24:18.110440+0000","last_undegraded":"2023-11-08T19:24:18.110440+0000","last_fullsized":"2023-11-08T19:24:18.110440+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:00:12.858113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.493128+0000","last_change":"2023-11-08T19:24:16.119485+0000","last_active":"2023-11-08T19:24:17.493128+0000","last_peered":"2023-11-08T19:24:17.493128+0000","last_clean":"2023-11-08T19:24:17.493128+0000","last_became_active":"2023-11-08T19:24:16.119234+0000","last_became_peered":"2023-11-08T19:24:16.119234+0000","last_unstale":"2023-11-08T19:24:17.493128+0000","last_undegraded":"2023-11-08T19:24:17.493128+0000","last_fullsized":"2023-11-08T19:24:17.493128+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:27:28.711503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.626583+0000","last_change":"2023-11-08T19:24:17.123516+0000","last_active":"2023-11-08T19:24:18.626583+0000","last_peered":"2023-11-08T19:24:18.626583+0000","last_clean":"2023-11-08T19:24:18.626583+0000","last_became_active":"2023-11-08T19:24:17.122503+0000","last_became_peered":"2023-11-08T19:24:17.122503+0000","last_unstale":"2023-11-08T19:24:18.626583+0000","last_undegraded":"2023-11-08T19:24:18.626583+0000","last_fullsized":"2023-11-08T19:24:18.626583+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:55:15.476144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.113619+0000","last_change":"2023-11-08T19:24:16.120284+0000","last_active":"2023-11-08T19:24:17.113619+0000","last_peered":"2023-11-08T19:24:17.113619+0000","last_clean":"2023-11-08T19:24:17.113619+0000","last_became_active":"2023-11-08T19:24:16.119983+0000","last_became_peered":"2023-11-08T19:24:16.119983+0000","last_unstale":"2023-11-08T19:24:17.113619+0000","last_undegraded":"2023-11-08T19:24:17.113619+0000","last_fullsized":"2023-11-08T19:24:17.113619+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:42:54.797716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.639623+0000","last_change":"2023-11-08T19:24:17.127930+0000","last_active":"2023-11-08T19:24:19.639623+0000","last_peered":"2023-11-08T19:24:19.639623+0000","last_clean":"2023-11-08T19:24:19.639623+0000","last_became_active":"2023-11-08T19:24:17.127656+0000","last_became_peered":"2023-11-08T19:24:17.127656+0000","last_unstale":"2023-11-08T19:24:19.639623+0000","last_undegraded":"2023-11-08T19:24:19.639623+0000","last_fullsized":"2023-11-08T19:24:19.639623+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:53:38.138608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.489973+0000","last_change":"2023-11-08T19:24:16.116495+0000","last_active":"2023-11-08T19:24:17.489973+0000","last_peered":"2023-11-08T19:24:17.489973+0000","last_clean":"2023-11-08T19:24:17.489973+0000","last_became_active":"2023-11-08T19:24:16.116191+0000","last_became_peered":"2023-11-08T19:24:16.116191+0000","last_unstale":"2023-11-08T19:24:17.489973+0000","last_undegraded":"2023-11-08T19:24:17.489973+0000","last_fullsized":"2023-11-08T19:24:17.489973+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:49:05.309488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.620773+0000","last_change":"2023-11-08T19:24:17.128861+0000","last_active":"2023-11-08T19:24:19.620773+0000","last_peered":"2023-11-08T19:24:19.620773+0000","last_clean":"2023-11-08T19:24:19.620773+0000","last_became_active":"2023-11-08T19:24:17.128594+0000","last_became_peered":"2023-11-08T19:24:17.128594+0000","last_unstale":"2023-11-08T19:24:19.620773+0000","last_undegraded":"2023-11-08T19:24:19.620773+0000","last_fullsized":"2023-11-08T19:24:19.620773+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:00:12.858113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.106999+0000","last_change":"2023-11-08T19:24:16.113723+0000","last_active":"2023-11-08T19:24:17.106999+0000","last_peered":"2023-11-08T19:24:17.106999+0000","last_clean":"2023-11-08T19:24:17.106999+0000","last_became_active":"2023-11-08T19:24:16.113374+0000","last_became_peered":"2023-11-08T19:24:16.113374+0000","last_unstale":"2023-11-08T19:24:17.106999+0000","last_undegraded":"2023-11-08T19:24:17.106999+0000","last_fullsized":"2023-11-08T19:24:17.106999+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:18:44.789207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.629171+0000","last_change":"2023-11-08T19:24:17.117595+0000","last_active":"2023-11-08T19:24:18.629171+0000","last_peered":"2023-11-08T19:24:18.629171+0000","last_clean":"2023-11-08T19:24:18.629171+0000","last_became_active":"2023-11-08T19:24:17.117300+0000","last_became_peered":"2023-11-08T19:24:17.117300+0000","last_unstale":"2023-11-08T19:24:18.629171+0000","last_undegraded":"2023-11-08T19:24:18.629171+0000","last_fullsized":"2023-11-08T19:24:18.629171+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:25:04.337488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.116218+0000","last_change":"2023-11-08T19:24:16.119794+0000","last_active":"2023-11-08T19:24:17.116218+0000","last_peered":"2023-11-08T19:24:17.116218+0000","last_clean":"2023-11-08T19:24:17.116218+0000","last_became_active":"2023-11-08T19:24:16.119524+0000","last_became_peered":"2023-11-08T19:24:16.119524+0000","last_unstale":"2023-11-08T19:24:17.116218+0000","last_undegraded":"2023-11-08T19:24:17.116218+0000","last_fullsized":"2023-11-08T19:24:17.116218+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:16:12.160440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.171479+0000","last_change":"2023-11-08T19:24:17.128143+0000","last_active":"2023-11-08T19:24:19.171479+0000","last_peered":"2023-11-08T19:24:19.171479+0000","last_clean":"2023-11-08T19:24:19.171479+0000","last_became_active":"2023-11-08T19:24:17.127912+0000","last_became_peered":"2023-11-08T19:24:17.127912+0000","last_unstale":"2023-11-08T19:24:19.171479+0000","last_undegraded":"2023-11-08T19:24:19.171479+0000","last_fullsized":"2023-11-08T19:24:19.171479+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:21:41.966251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.107002+0000","last_change":"2023-11-08T19:24:16.116956+0000","last_active":"2023-11-08T19:24:17.107002+0000","last_peered":"2023-11-08T19:24:17.107002+0000","last_clean":"2023-11-08T19:24:17.107002+0000","last_became_active":"2023-11-08T19:24:16.116715+0000","last_became_peered":"2023-11-08T19:24:16.116715+0000","last_unstale":"2023-11-08T19:24:17.107002+0000","last_undegraded":"2023-11-08T19:24:17.107002+0000","last_fullsized":"2023-11-08T19:24:17.107002+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:50:55.092096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.108668+0000","last_change":"2023-11-08T19:24:17.122910+0000","last_active":"2023-11-08T19:24:18.108668+0000","last_peered":"2023-11-08T19:24:18.108668+0000","last_clean":"2023-11-08T19:24:18.108668+0000","last_became_active":"2023-11-08T19:24:17.122626+0000","last_became_peered":"2023-11-08T19:24:17.122626+0000","last_unstale":"2023-11-08T19:24:18.108668+0000","last_undegraded":"2023-11-08T19:24:18.108668+0000","last_fullsized":"2023-11-08T19:24:18.108668+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:16:13.162177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.490553+0000","last_change":"2023-11-08T19:24:16.121737+0000","last_active":"2023-11-08T19:24:17.490553+0000","last_peered":"2023-11-08T19:24:17.490553+0000","last_clean":"2023-11-08T19:24:17.490553+0000","last_became_active":"2023-11-08T19:24:16.121491+0000","last_became_peered":"2023-11-08T19:24:16.121491+0000","last_unstale":"2023-11-08T19:24:17.490553+0000","last_undegraded":"2023-11-08T19:24:17.490553+0000","last_fullsized":"2023-11-08T19:24:17.490553+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:54:16.777631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.640062+0000","last_change":"2023-11-08T19:24:17.129203+0000","last_active":"2023-11-08T19:24:19.640062+0000","last_peered":"2023-11-08T19:24:19.640062+0000","last_clean":"2023-11-08T19:24:19.640062+0000","last_became_active":"2023-11-08T19:24:17.128943+0000","last_became_peered":"2023-11-08T19:24:17.128943+0000","last_unstale":"2023-11-08T19:24:19.640062+0000","last_undegraded":"2023-11-08T19:24:19.640062+0000","last_fullsized":"2023-11-08T19:24:19.640062+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:08:50.861077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.626600+0000","last_change":"2023-11-08T19:24:16.117342+0000","last_active":"2023-11-08T19:24:18.626600+0000","last_peered":"2023-11-08T19:24:18.626600+0000","last_clean":"2023-11-08T19:24:18.626600+0000","last_became_active":"2023-11-08T19:24:16.117074+0000","last_became_peered":"2023-11-08T19:24:16.117074+0000","last_unstale":"2023-11-08T19:24:18.626600+0000","last_undegraded":"2023-11-08T19:24:18.626600+0000","last_fullsized":"2023-11-08T19:24:18.626600+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:17:40.377190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.171701+0000","last_change":"2023-11-08T19:24:17.122493+0000","last_active":"2023-11-08T19:24:19.171701+0000","last_peered":"2023-11-08T19:24:19.171701+0000","last_clean":"2023-11-08T19:24:19.171701+0000","last_became_active":"2023-11-08T19:24:17.122230+0000","last_became_peered":"2023-11-08T19:24:17.122230+0000","last_unstale":"2023-11-08T19:24:19.171701+0000","last_undegraded":"2023-11-08T19:24:19.171701+0000","last_fullsized":"2023-11-08T19:24:19.171701+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:53:54.966516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.118004+0000","last_change":"2023-11-08T19:24:16.121272+0000","last_active":"2023-11-08T19:24:17.118004+0000","last_peered":"2023-11-08T19:24:17.118004+0000","last_clean":"2023-11-08T19:24:17.118004+0000","last_became_active":"2023-11-08T19:24:16.120986+0000","last_became_peered":"2023-11-08T19:24:16.120986+0000","last_unstale":"2023-11-08T19:24:17.118004+0000","last_undegraded":"2023-11-08T19:24:17.118004+0000","last_fullsized":"2023-11-08T19:24:17.118004+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:32:36.193518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.620710+0000","last_change":"2023-11-08T19:24:17.125793+0000","last_active":"2023-11-08T19:24:19.620710+0000","last_peered":"2023-11-08T19:24:19.620710+0000","last_clean":"2023-11-08T19:24:19.620710+0000","last_became_active":"2023-11-08T19:24:17.125451+0000","last_became_peered":"2023-11-08T19:24:17.125451+0000","last_unstale":"2023-11-08T19:24:19.620710+0000","last_undegraded":"2023-11-08T19:24:19.620710+0000","last_fullsized":"2023-11-08T19:24:19.620710+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:12:58.048320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.115100+0000","last_change":"2023-11-08T19:24:16.123141+0000","last_active":"2023-11-08T19:24:17.115100+0000","last_peered":"2023-11-08T19:24:17.115100+0000","last_clean":"2023-11-08T19:24:17.115100+0000","last_became_active":"2023-11-08T19:24:16.122900+0000","last_became_peered":"2023-11-08T19:24:16.122900+0000","last_unstale":"2023-11-08T19:24:17.115100+0000","last_undegraded":"2023-11-08T19:24:17.115100+0000","last_fullsized":"2023-11-08T19:24:17.115100+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:09:19.268418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.108503+0000","last_change":"2023-11-08T19:24:17.118955+0000","last_active":"2023-11-08T19:24:18.108503+0000","last_peered":"2023-11-08T19:24:18.108503+0000","last_clean":"2023-11-08T19:24:18.108503+0000","last_became_active":"2023-11-08T19:24:17.118669+0000","last_became_peered":"2023-11-08T19:24:17.118669+0000","last_unstale":"2023-11-08T19:24:18.108503+0000","last_undegraded":"2023-11-08T19:24:18.108503+0000","last_fullsized":"2023-11-08T19:24:18.108503+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:12:58.048320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.106906+0000","last_change":"2023-11-08T19:24:16.117069+0000","last_active":"2023-11-08T19:24:17.106906+0000","last_peered":"2023-11-08T19:24:17.106906+0000","last_clean":"2023-11-08T19:24:17.106906+0000","last_became_active":"2023-11-08T19:24:16.116782+0000","last_became_peered":"2023-11-08T19:24:16.116782+0000","last_unstale":"2023-11-08T19:24:17.106906+0000","last_undegraded":"2023-11-08T19:24:17.106906+0000","last_fullsized":"2023-11-08T19:24:17.106906+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:36:18.253463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.109836+0000","last_change":"2023-11-08T19:24:17.124099+0000","last_active":"2023-11-08T19:24:18.109836+0000","last_peered":"2023-11-08T19:24:18.109836+0000","last_clean":"2023-11-08T19:24:18.109836+0000","last_became_active":"2023-11-08T19:24:17.123803+0000","last_became_peered":"2023-11-08T19:24:17.123803+0000","last_unstale":"2023-11-08T19:24:18.109836+0000","last_undegraded":"2023-11-08T19:24:18.109836+0000","last_fullsized":"2023-11-08T19:24:18.109836+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:33:32.862712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.106929+0000","last_change":"2023-11-08T19:24:16.124372+0000","last_active":"2023-11-08T19:24:17.106929+0000","last_peered":"2023-11-08T19:24:17.106929+0000","last_clean":"2023-11-08T19:24:17.106929+0000","last_became_active":"2023-11-08T19:24:16.124097+0000","last_became_peered":"2023-11-08T19:24:16.124097+0000","last_unstale":"2023-11-08T19:24:17.106929+0000","last_undegraded":"2023-11-08T19:24:17.106929+0000","last_fullsized":"2023-11-08T19:24:17.106929+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:09:54.584065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.639921+0000","last_change":"2023-11-08T19:24:17.127281+0000","last_active":"2023-11-08T19:24:19.639921+0000","last_peered":"2023-11-08T19:24:19.639921+0000","last_clean":"2023-11-08T19:24:19.639921+0000","last_became_active":"2023-11-08T19:24:17.126969+0000","last_became_peered":"2023-11-08T19:24:17.126969+0000","last_unstale":"2023-11-08T19:24:19.639921+0000","last_undegraded":"2023-11-08T19:24:19.639921+0000","last_fullsized":"2023-11-08T19:24:19.639921+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:25:04.337488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.113688+0000","last_change":"2023-11-08T19:24:16.125300+0000","last_active":"2023-11-08T19:24:17.113688+0000","last_peered":"2023-11-08T19:24:17.113688+0000","last_clean":"2023-11-08T19:24:17.113688+0000","last_became_active":"2023-11-08T19:24:16.125011+0000","last_became_peered":"2023-11-08T19:24:16.125011+0000","last_unstale":"2023-11-08T19:24:17.113688+0000","last_undegraded":"2023-11-08T19:24:17.113688+0000","last_fullsized":"2023-11-08T19:24:17.113688+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:38:33.566735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.629727+0000","last_change":"2023-11-08T19:24:17.124753+0000","last_active":"2023-11-08T19:24:18.629727+0000","last_peered":"2023-11-08T19:24:18.629727+0000","last_clean":"2023-11-08T19:24:18.629727+0000","last_became_active":"2023-11-08T19:24:17.124494+0000","last_became_peered":"2023-11-08T19:24:17.124494+0000","last_unstale":"2023-11-08T19:24:18.629727+0000","last_undegraded":"2023-11-08T19:24:18.629727+0000","last_fullsized":"2023-11-08T19:24:18.629727+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:39:34.453886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.113407+0000","last_change":"2023-11-08T19:24:16.121492+0000","last_active":"2023-11-08T19:24:17.113407+0000","last_peered":"2023-11-08T19:24:17.113407+0000","last_clean":"2023-11-08T19:24:17.113407+0000","last_became_active":"2023-11-08T19:24:16.121224+0000","last_became_peered":"2023-11-08T19:24:16.121224+0000","last_unstale":"2023-11-08T19:24:17.113407+0000","last_undegraded":"2023-11-08T19:24:17.113407+0000","last_fullsized":"2023-11-08T19:24:17.113407+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:09:19.268418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":180,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.116039+0000","last_change":"2023-11-08T19:22:58.054283+0000","last_active":"2023-11-08T19:24:17.116039+0000","last_peered":"2023-11-08T19:24:17.116039+0000","last_clean":"2023-11-08T19:24:17.116039+0000","last_became_active":"2023-11-08T19:22:58.053337+0000","last_became_peered":"2023-11-08T19:22:58.053337+0000","last_unstale":"2023-11-08T19:24:17.116039+0000","last_undegraded":"2023-11-08T19:24:17.116039+0000","last_fullsized":"2023-11-08T19:24:17.116039+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:22:56.479654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:22:56.479654+0000","last_clean_scrub_stamp":"2023-11-08T19:22:56.479654+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:16:05.317001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28048,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343792,"statfs":{"total":96636764160,"available":96608043008,"internally_reserved":0,"allocated":1048576,"data_stored":779541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.52200000000000002}]},{"osd":1,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.40100000000000002}]},{"osd":2,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.46400000000000002}]},{"osd":3,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.53400000000000003}]},{"osd":4,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.57299999999999995}]},{"osd":5,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.56200000000000006}]},{"osd":6,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.622}]}]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":194693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.53500000000000003}]},{"osd":1,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.64300000000000002}]},{"osd":2,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.435},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.46000000000000002}]},{"osd":3,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":0.55500000000000005}]},{"osd":4,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.61399999999999999}]},{"osd":5,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.504},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.57199999999999995}]},{"osd":7,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.58599999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":454656,"data_stored":194201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":2.1850000000000001,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":0.39200000000000002}]},{"osd":2,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.29199999999999998}]},{"osd":3,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.378},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":2.2120000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.43099999999999999}]},{"osd":4,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.745},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.64600000000000002}]},{"osd":5,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.60499999999999998}]},{"osd":6,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":2.093,"5min":2.093,"15min":2.093},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.67000000000000004}]},{"osd":7,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":0.63},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":2.1299999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.68700000000000006}]}]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28044,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343796,"statfs":{"total":96636764160,"available":96608047104,"internally_reserved":0,"allocated":1048576,"data_stored":784513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":19.295999999999999,"5min":19.295999999999999,"15min":19.295999999999999},"last":0.29399999999999998},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":17.204000000000001,"5min":17.204000000000001,"15min":17.204000000000001},"last":0.42599999999999999}]},{"osd":2,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":6.524,"5min":6.524,"15min":6.524},"last":0.45200000000000001},{"interface":"front","average":{"1min":1.169,"5min":1.169,"15min":1.169},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":17.175000000000001,"5min":17.175000000000001,"15min":17.175000000000001},"last":0.36199999999999999}]},{"osd":3,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":14.324,"5min":14.324,"15min":14.324},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.39900000000000002}]},{"osd":4,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.304,"15min":1.304},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":17.056000000000001,"5min":17.056000000000001,"15min":17.056000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":5.0289999999999999,"5min":5.0289999999999999,"15min":5.0289999999999999},"last":0.54400000000000004}]},{"osd":5,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":5.0590000000000002,"5min":5.0590000000000002,"15min":5.0590000000000002},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.52800000000000002}]},{"osd":6,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.60999999999999999},{"interface":"front","average":{"1min":1.357,"5min":1.357,"15min":1.357},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":17.111999999999998,"5min":17.111999999999998,"15min":17.111999999999998},"last":0.56100000000000005}]},{"osd":7,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.371,"15min":1.371},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":17.146000000000001,"5min":17.146000000000001,"15min":17.146000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":4.9829999999999997,"5min":4.9829999999999997,"15min":4.9829999999999997},"last":0.47099999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":194181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":3.4100000000000001,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":3.4369999999999998,"5min":3.4369999999999998,"15min":3.4369999999999998},"last":0.23999999999999999}]},{"osd":1,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":4.0679999999999996,"5min":4.0679999999999996,"15min":4.0679999999999996},"last":0.31},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":4.3499999999999996,"5min":4.3499999999999996,"15min":4.3499999999999996},"last":0.33900000000000002}]},{"osd":3,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":3.8580000000000001,"5min":3.8580000000000001,"15min":3.8580000000000001},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":3.476,"5min":3.476,"15min":3.476},"last":0.27600000000000002}]},{"osd":4,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":4.0090000000000003,"5min":4.0090000000000003,"15min":4.0090000000000003},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":4.1040000000000001,"5min":4.1040000000000001,"15min":4.1040000000000001},"last":0.70799999999999996}]},{"osd":5,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":4.0869999999999997,"5min":4.0869999999999997,"15min":4.0869999999999997},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":3.843,"5min":3.843,"15min":3.843},"last":0.63600000000000001}]},{"osd":6,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":4.1399999999999997,"5min":4.1399999999999997,"15min":4.1399999999999997},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":4.0499999999999998,"5min":4.0499999999999998,"15min":4.0499999999999998},"last":0.53200000000000003}]},{"osd":7,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":4.157,"5min":4.157,"15min":4.157},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":4.1710000000000003,"5min":4.1710000000000003,"15min":4.1710000000000003},"last":0.58499999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":195757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.46100000000000002}]},{"osd":1,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.51800000000000002}]},{"osd":2,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.48799999999999999}]},{"osd":4,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.752}]},{"osd":5,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.61299999999999999}]},{"osd":6,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.78700000000000003}]},{"osd":7,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.71499999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":458752,"data_stored":194715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.627},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":2.2090000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.56399999999999995}]},{"osd":1,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.495},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.46700000000000003}]},{"osd":2,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":2.8490000000000002,"5min":2.8490000000000002,"15min":2.8490000000000002},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.44400000000000001}]},{"osd":3,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":3.4849999999999999,"5min":3.4849999999999999,"15min":3.4849999999999999},"last":0.69699999999999995}]},{"osd":5,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.54400000000000004}]},{"osd":6,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":4.1529999999999996,"5min":4.1529999999999996,"15min":4.1529999999999996},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.65800000000000003}]},{"osd":7,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":5.5359999999999996,"5min":5.5359999999999996,"15min":5.5359999999999996},"last":0.74299999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":458752,"data_stored":194223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.56699999999999995}]},{"osd":1,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":2.2919999999999998,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":0.66300000000000003}]},{"osd":2,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.622},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.59199999999999997}]},{"osd":3,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.70799999999999996}]},{"osd":4,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":2.3300000000000001,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.73899999999999999}]},{"osd":6,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":2.3650000000000002,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":0.754}]},{"osd":7,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.79500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:24:26.172 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:24:26.306 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.303+0000 7f384bf1d700 1 Processor -- start 2023-11-08T19:24:26.306 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.304+0000 7f384bf1d700 1 -- start start 2023-11-08T19:24:26.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.304+0000 7f384bf1d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f384415db70 0x7f3844161dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:26.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.304+0000 7f384bf1d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f38440b2c00 0x7f384415df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:26.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.305+0000 7f384bf1d700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3844161940 con 0x7f384406ab80 2023-11-08T19:24:26.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.305+0000 7f384bf1d700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f384415eeb0 con 0x7f384415db70 2023-11-08T19:24:26.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.305+0000 7f384bf1d700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f384415e8f0 con 0x7f38440b2c00 2023-11-08T19:24:26.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.305+0000 7f3849cb9700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f384415db70 0x7f3844161dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:26.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.305+0000 7f384a4ba700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f384406ab80 0x7f3844071dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:41432/0 (socket says 172.21.15.149:41432) 2023-11-08T19:24:26.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.305+0000 7f384a4ba700 1 -- 172.21.15.149:0/1292911522 learned_addr learned my addr 172.21.15.149:0/1292911522 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:24:26.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.305+0000 7f3849cb9700 1 -- 172.21.15.149:0/1292911522 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f38440b2c00 msgr2=0x7f384415df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:26.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.305+0000 7f38494b8700 1 --2- 172.21.15.149:0/1292911522 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f38440b2c00 0x7f384415df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:26.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.305+0000 7f3849cb9700 1 --2- 172.21.15.149:0/1292911522 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f38440b2c00 0x7f384415df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:26.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.305+0000 7f3849cb9700 1 -- 172.21.15.149:0/1292911522 >> v1:172.21.15.149:6789/0 conn(0x7f384406ab80 legacy=0x7f3844071dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:26.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.305+0000 7f3848cb7700 1 -- 172.21.15.149:0/1292911522 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1054390713 0 0) 0x7f3844161940 con 0x7f384406ab80 2023-11-08T19:24:26.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.305+0000 7f3849cb9700 1 -- 172.21.15.149:0/1292911522 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f384415ebd0 con 0x7f384415db70 2023-11-08T19:24:26.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.305+0000 7f38494b8700 1 --2- 172.21.15.149:0/1292911522 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f38440b2c00 0x7f384415df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:24:26.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.305+0000 7f3849cb9700 1 --2- 172.21.15.149:0/1292911522 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f384415db70 0x7f3844161dd0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f3834009840 tx=0x7f3834009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d1f5b1cb6b0ef61 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:26.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.305+0000 7f3848cb7700 1 -- 172.21.15.149:0/1292911522 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3834011830 con 0x7f384415db70 2023-11-08T19:24:26.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.305+0000 7f3848cb7700 1 -- 172.21.15.149:0/1292911522 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3834011990 con 0x7f384415db70 2023-11-08T19:24:26.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.305+0000 7f3848cb7700 1 -- 172.21.15.149:0/1292911522 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3834011d20 con 0x7f384415db70 2023-11-08T19:24:26.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.306+0000 7f384bf1d700 1 -- 172.21.15.149:0/1292911522 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f384415db70 msgr2=0x7f3844161dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:26.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.306+0000 7f384bf1d700 1 --2- 172.21.15.149:0/1292911522 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f384415db70 0x7f3844161dd0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f3834009840 tx=0x7f3834009b50 comp rx=0 tx=0).stop 2023-11-08T19:24:26.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.306+0000 7f384bf1d700 1 -- 172.21.15.149:0/1292911522 shutdown_connections 2023-11-08T19:24:26.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.306+0000 7f384bf1d700 1 --2- 172.21.15.149:0/1292911522 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f384415db70 0x7f3844161dd0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:26.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.306+0000 7f384bf1d700 1 --2- 172.21.15.149:0/1292911522 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f38440b2c00 0x7f384415df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:26.314 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.306+0000 7f384bf1d700 1 -- 172.21.15.149:0/1292911522 >> 172.21.15.149:0/1292911522 conn(0x7f38440ccff0 msgr2=0x7f38440cd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:26.314 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.306+0000 7f384bf1d700 1 -- 172.21.15.149:0/1292911522 shutdown_connections 2023-11-08T19:24:26.314 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.306+0000 7f384bf1d700 1 -- 172.21.15.149:0/1292911522 wait complete. 2023-11-08T19:24:26.317 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.307+0000 7f384bf1d700 1 Processor -- start 2023-11-08T19:24:26.317 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.307+0000 7f384bf1d700 1 -- start start 2023-11-08T19:24:26.317 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.308+0000 7f384bf1d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f384406ab80 0x7f38440b5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:26.318 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.308+0000 7f384bf1d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f38440b2c00 0x7f38441f2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:26.318 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.308+0000 7f384bf1d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f384415db70 0x7f384406e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:26.318 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.308+0000 7f384bf1d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38441514f0 con 0x7f384415db70 2023-11-08T19:24:26.318 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.308+0000 7f384bf1d700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384406ead0 con 0x7f384406ab80 2023-11-08T19:24:26.318 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.308+0000 7f384bf1d700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38440ad2d0 con 0x7f38440b2c00 2023-11-08T19:24:26.319 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.308+0000 7f384a4ba700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f384415db70 0x7f384406e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:26.319 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.308+0000 7f384a4ba700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f384415db70 0x7f384406e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39436/0 (socket says 172.21.15.149:39436) 2023-11-08T19:24:26.319 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.308+0000 7f384a4ba700 1 -- 172.21.15.149:0/1372822195 learned_addr learned my addr 172.21.15.149:0/1372822195 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:26.319 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.308+0000 7f38494b8700 1 --2- 172.21.15.149:0/1372822195 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f38440b2c00 0x7f38441f2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:26.319 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.308+0000 7f3849cb9700 1 --2- 172.21.15.149:0/1372822195 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f384406ab80 0x7f38440b5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:26.320 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.308+0000 7f384a4ba700 1 -- 172.21.15.149:0/1372822195 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f38440b2c00 msgr2=0x7f38441f2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:26.320 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.308+0000 7f384a4ba700 1 --2- 172.21.15.149:0/1372822195 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f38440b2c00 0x7f38441f2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:26.320 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.308+0000 7f384a4ba700 1 -- 172.21.15.149:0/1372822195 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f384406ab80 msgr2=0x7f38440b5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:26.320 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.308+0000 7f384a4ba700 1 --2- 172.21.15.149:0/1372822195 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f384406ab80 0x7f38440b5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:26.320 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.308+0000 7f384a4ba700 1 -- 172.21.15.149:0/1372822195 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38340094a0 con 0x7f384415db70 2023-11-08T19:24:26.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.309+0000 7f384a4ba700 1 --2- 172.21.15.149:0/1372822195 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f384415db70 0x7f384406e590 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f383c00cba0 tx=0x7f383c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:26.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.309+0000 7f383a7fc700 1 -- 172.21.15.149:0/1372822195 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383c00ab80 con 0x7f384415db70 2023-11-08T19:24:26.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.309+0000 7f383a7fc700 1 -- 172.21.15.149:0/1372822195 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f383c00ad00 con 0x7f384415db70 2023-11-08T19:24:26.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.309+0000 7f384bf1d700 1 -- 172.21.15.149:0/1372822195 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38440ad5b0 con 0x7f384415db70 2023-11-08T19:24:26.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.309+0000 7f383a7fc700 1 -- 172.21.15.149:0/1372822195 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383c007310 con 0x7f384415db70 2023-11-08T19:24:26.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.309+0000 7f384bf1d700 1 -- 172.21.15.149:0/1372822195 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38440adb70 con 0x7f384415db70 2023-11-08T19:24:26.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.310+0000 7f384bf1d700 1 -- 172.21.15.149:0/1372822195 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38440745f0 con 0x7f384415db70 2023-11-08T19:24:26.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.310+0000 7f383a7fc700 1 -- 172.21.15.149:0/1372822195 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f383c007470 con 0x7f384415db70 2023-11-08T19:24:26.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.311+0000 7f383a7fc700 1 --2- 172.21.15.149:0/1372822195 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f382806af00 0x7f382806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:26.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.311+0000 7f3849cb9700 1 --2- 172.21.15.149:0/1372822195 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f382806af00 0x7f382806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:26.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.311+0000 7f383a7fc700 1 -- 172.21.15.149:0/1372822195 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f383c089570 con 0x7f384415db70 2023-11-08T19:24:26.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.311+0000 7f3849cb9700 1 --2- 172.21.15.149:0/1372822195 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f382806af00 0x7f382806d3c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f38340090b0 tx=0x7f3834008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:26.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.316+0000 7f383a7fc700 1 -- 172.21.15.149:0/1372822195 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f383c0544e0 con 0x7f384415db70 2023-11-08T19:24:26.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.499+0000 7f384bf1d700 1 -- 172.21.15.149:0/1372822195 --> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f38441615d0 con 0x7f382806af00 2023-11-08T19:24:26.509 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.507+0000 7f383a7fc700 1 -- 172.21.15.149:0/1372822195 <== mgr.4104 v2:172.21.15.149:6832/1929837472 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289513 (secure 0 0 0) 0x7f3834011c00 con 0x7f382806af00 2023-11-08T19:24:26.513 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:24:26.516 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.510+0000 7f384bf1d700 1 -- 172.21.15.149:0/1372822195 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f382806af00 msgr2=0x7f382806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:26.517 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.510+0000 7f384bf1d700 1 --2- 172.21.15.149:0/1372822195 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f382806af00 0x7f382806d3c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f38340090b0 tx=0x7f3834008030 comp rx=0 tx=0).stop 2023-11-08T19:24:26.517 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.510+0000 7f384bf1d700 1 -- 172.21.15.149:0/1372822195 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f384415db70 msgr2=0x7f384406e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:26.517 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.510+0000 7f384bf1d700 1 --2- 172.21.15.149:0/1372822195 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f384415db70 0x7f384406e590 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f383c00cba0 tx=0x7f383c00cf60 comp rx=0 tx=0).stop 2023-11-08T19:24:26.517 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.510+0000 7f384bf1d700 1 -- 172.21.15.149:0/1372822195 shutdown_connections 2023-11-08T19:24:26.517 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.510+0000 7f384bf1d700 1 --2- 172.21.15.149:0/1372822195 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f382806af00 0x7f382806d3c0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:26.518 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.510+0000 7f384bf1d700 1 --2- 172.21.15.149:0/1372822195 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f384406ab80 0x7f38440b5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:26.518 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.510+0000 7f384bf1d700 1 --2- 172.21.15.149:0/1372822195 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f384415db70 0x7f384406e590 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:26.518 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.510+0000 7f384bf1d700 1 --2- 172.21.15.149:0/1372822195 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f38440b2c00 0x7f38441f2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:26.518 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.510+0000 7f384bf1d700 1 -- 172.21.15.149:0/1372822195 >> 172.21.15.149:0/1372822195 conn(0x7f38440ccff0 msgr2=0x7f3844160aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:26.519 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.511+0000 7f384bf1d700 1 -- 172.21.15.149:0/1372822195 shutdown_connections 2023-11-08T19:24:26.519 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.511+0000 7f384bf1d700 1 -- 172.21.15.149:0/1372822195 wait complete. 2023-11-08T19:24:26.519 INFO:teuthology.orchestra.run.smithi149.stderr:dumped all 2023-11-08T19:24:26.525 INFO:teuthology.orchestra.run.smithi149.stdout:{"pg_ready":true,"pg_map":{"version":77,"stamp":"2023-11-08T19:24:26.003879+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220912,"kb_used_data":4744,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753808,"statfs":{"total":773094113280,"available":772867899392,"internally_reserved":0,"allocated":4857856,"data_stored":2738444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.899081"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.171770+0000","last_change":"2023-11-08T19:24:17.123033+0000","last_active":"2023-11-08T19:24:19.171770+0000","last_peered":"2023-11-08T19:24:19.171770+0000","last_clean":"2023-11-08T19:24:19.171770+0000","last_became_active":"2023-11-08T19:24:17.122782+0000","last_became_peered":"2023-11-08T19:24:17.122782+0000","last_unstale":"2023-11-08T19:24:19.171770+0000","last_undegraded":"2023-11-08T19:24:19.171770+0000","last_fullsized":"2023-11-08T19:24:19.171770+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:18:26.252263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.171643+0000","last_change":"2023-11-08T19:24:17.119814+0000","last_active":"2023-11-08T19:24:19.171643+0000","last_peered":"2023-11-08T19:24:19.171643+0000","last_clean":"2023-11-08T19:24:19.171643+0000","last_became_active":"2023-11-08T19:24:17.119581+0000","last_became_peered":"2023-11-08T19:24:17.119581+0000","last_unstale":"2023-11-08T19:24:19.171643+0000","last_undegraded":"2023-11-08T19:24:19.171643+0000","last_fullsized":"2023-11-08T19:24:19.171643+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:39:50.238810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.620818+0000","last_change":"2023-11-08T19:24:17.122049+0000","last_active":"2023-11-08T19:24:19.620818+0000","last_peered":"2023-11-08T19:24:19.620818+0000","last_clean":"2023-11-08T19:24:19.620818+0000","last_became_active":"2023-11-08T19:24:17.121756+0000","last_became_peered":"2023-11-08T19:24:17.121756+0000","last_unstale":"2023-11-08T19:24:19.620818+0000","last_undegraded":"2023-11-08T19:24:19.620818+0000","last_fullsized":"2023-11-08T19:24:19.620818+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:16:13.162177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.626466+0000","last_change":"2023-11-08T19:24:17.111612+0000","last_active":"2023-11-08T19:24:18.626466+0000","last_peered":"2023-11-08T19:24:18.626466+0000","last_clean":"2023-11-08T19:24:18.626466+0000","last_became_active":"2023-11-08T19:24:17.111250+0000","last_became_peered":"2023-11-08T19:24:17.111250+0000","last_unstale":"2023-11-08T19:24:18.626466+0000","last_undegraded":"2023-11-08T19:24:18.626466+0000","last_fullsized":"2023-11-08T19:24:18.626466+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:20:59.004203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.626465+0000","last_change":"2023-11-08T19:24:17.111927+0000","last_active":"2023-11-08T19:24:18.626465+0000","last_peered":"2023-11-08T19:24:18.626465+0000","last_clean":"2023-11-08T19:24:18.626465+0000","last_became_active":"2023-11-08T19:24:17.111621+0000","last_became_peered":"2023-11-08T19:24:17.111621+0000","last_unstale":"2023-11-08T19:24:18.626465+0000","last_undegraded":"2023-11-08T19:24:18.626465+0000","last_fullsized":"2023-11-08T19:24:18.626465+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:56:23.821648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.108465+0000","last_change":"2023-11-08T19:24:17.120284+0000","last_active":"2023-11-08T19:24:18.108465+0000","last_peered":"2023-11-08T19:24:18.108465+0000","last_clean":"2023-11-08T19:24:18.108465+0000","last_became_active":"2023-11-08T19:24:17.120029+0000","last_became_peered":"2023-11-08T19:24:17.120029+0000","last_unstale":"2023-11-08T19:24:18.108465+0000","last_undegraded":"2023-11-08T19:24:18.108465+0000","last_fullsized":"2023-11-08T19:24:18.108465+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:33:32.862712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.629168+0000","last_change":"2023-11-08T19:24:17.126220+0000","last_active":"2023-11-08T19:24:18.629168+0000","last_peered":"2023-11-08T19:24:18.629168+0000","last_clean":"2023-11-08T19:24:18.629168+0000","last_became_active":"2023-11-08T19:24:17.125965+0000","last_became_peered":"2023-11-08T19:24:17.125965+0000","last_unstale":"2023-11-08T19:24:18.629168+0000","last_undegraded":"2023-11-08T19:24:18.629168+0000","last_fullsized":"2023-11-08T19:24:18.629168+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:05:23.478967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.171327+0000","last_change":"2023-11-08T19:24:17.123508+0000","last_active":"2023-11-08T19:24:19.171327+0000","last_peered":"2023-11-08T19:24:19.171327+0000","last_clean":"2023-11-08T19:24:19.171327+0000","last_became_active":"2023-11-08T19:24:17.123240+0000","last_became_peered":"2023-11-08T19:24:17.123240+0000","last_unstale":"2023-11-08T19:24:19.171327+0000","last_undegraded":"2023-11-08T19:24:19.171327+0000","last_fullsized":"2023-11-08T19:24:19.171327+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:05:23.478967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.621184+0000","last_change":"2023-11-08T19:24:17.122127+0000","last_active":"2023-11-08T19:24:19.621184+0000","last_peered":"2023-11-08T19:24:19.621184+0000","last_clean":"2023-11-08T19:24:19.621184+0000","last_became_active":"2023-11-08T19:24:17.121856+0000","last_became_peered":"2023-11-08T19:24:17.121856+0000","last_unstale":"2023-11-08T19:24:19.621184+0000","last_undegraded":"2023-11-08T19:24:19.621184+0000","last_fullsized":"2023-11-08T19:24:19.621184+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:41:09.802388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.629558+0000","last_change":"2023-11-08T19:24:17.126282+0000","last_active":"2023-11-08T19:24:18.629558+0000","last_peered":"2023-11-08T19:24:18.629558+0000","last_clean":"2023-11-08T19:24:18.629558+0000","last_became_active":"2023-11-08T19:24:17.125897+0000","last_became_peered":"2023-11-08T19:24:17.125897+0000","last_unstale":"2023-11-08T19:24:18.629558+0000","last_undegraded":"2023-11-08T19:24:18.629558+0000","last_fullsized":"2023-11-08T19:24:18.629558+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:18:26.252263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.629549+0000","last_change":"2023-11-08T19:24:17.119545+0000","last_active":"2023-11-08T19:24:18.629549+0000","last_peered":"2023-11-08T19:24:18.629549+0000","last_clean":"2023-11-08T19:24:18.629549+0000","last_became_active":"2023-11-08T19:24:17.119216+0000","last_became_peered":"2023-11-08T19:24:17.119216+0000","last_unstale":"2023-11-08T19:24:18.629549+0000","last_undegraded":"2023-11-08T19:24:18.629549+0000","last_fullsized":"2023-11-08T19:24:18.629549+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:53:54.966516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.620933+0000","last_change":"2023-11-08T19:24:17.120015+0000","last_active":"2023-11-08T19:24:19.620933+0000","last_peered":"2023-11-08T19:24:19.620933+0000","last_clean":"2023-11-08T19:24:19.620933+0000","last_became_active":"2023-11-08T19:24:17.119727+0000","last_became_peered":"2023-11-08T19:24:17.119727+0000","last_unstale":"2023-11-08T19:24:19.620933+0000","last_undegraded":"2023-11-08T19:24:19.620933+0000","last_fullsized":"2023-11-08T19:24:19.620933+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:53:38.138608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.629195+0000","last_change":"2023-11-08T19:24:17.128141+0000","last_active":"2023-11-08T19:24:18.629195+0000","last_peered":"2023-11-08T19:24:18.629195+0000","last_clean":"2023-11-08T19:24:18.629195+0000","last_became_active":"2023-11-08T19:24:17.127788+0000","last_became_peered":"2023-11-08T19:24:17.127788+0000","last_unstale":"2023-11-08T19:24:18.629195+0000","last_undegraded":"2023-11-08T19:24:18.629195+0000","last_fullsized":"2023-11-08T19:24:18.629195+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:21:41.966251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.109986+0000","last_change":"2023-11-08T19:24:17.116970+0000","last_active":"2023-11-08T19:24:18.109986+0000","last_peered":"2023-11-08T19:24:18.109986+0000","last_clean":"2023-11-08T19:24:18.109986+0000","last_became_active":"2023-11-08T19:24:17.116708+0000","last_became_peered":"2023-11-08T19:24:17.116708+0000","last_unstale":"2023-11-08T19:24:18.109986+0000","last_undegraded":"2023-11-08T19:24:18.109986+0000","last_fullsized":"2023-11-08T19:24:18.109986+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:12:58.048320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.629201+0000","last_change":"2023-11-08T19:24:17.119392+0000","last_active":"2023-11-08T19:24:18.629201+0000","last_peered":"2023-11-08T19:24:18.629201+0000","last_clean":"2023-11-08T19:24:18.629201+0000","last_became_active":"2023-11-08T19:24:17.119100+0000","last_became_peered":"2023-11-08T19:24:17.119100+0000","last_unstale":"2023-11-08T19:24:18.629201+0000","last_undegraded":"2023-11-08T19:24:18.629201+0000","last_fullsized":"2023-11-08T19:24:18.629201+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:08:50.861077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.639524+0000","last_change":"2023-11-08T19:24:17.127685+0000","last_active":"2023-11-08T19:24:19.639524+0000","last_peered":"2023-11-08T19:24:19.639524+0000","last_clean":"2023-11-08T19:24:19.639524+0000","last_became_active":"2023-11-08T19:24:17.127019+0000","last_became_peered":"2023-11-08T19:24:17.127019+0000","last_unstale":"2023-11-08T19:24:19.639524+0000","last_undegraded":"2023-11-08T19:24:19.639524+0000","last_fullsized":"2023-11-08T19:24:19.639524+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:38:34.568472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.640116+0000","last_change":"2023-11-08T19:24:17.125050+0000","last_active":"2023-11-08T19:24:19.640116+0000","last_peered":"2023-11-08T19:24:19.640116+0000","last_clean":"2023-11-08T19:24:19.640116+0000","last_became_active":"2023-11-08T19:24:17.124290+0000","last_became_peered":"2023-11-08T19:24:17.124290+0000","last_unstale":"2023-11-08T19:24:19.640116+0000","last_undegraded":"2023-11-08T19:24:19.640116+0000","last_fullsized":"2023-11-08T19:24:19.640116+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:12.060745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.109617+0000","last_change":"2023-11-08T19:24:17.118666+0000","last_active":"2023-11-08T19:24:18.109617+0000","last_peered":"2023-11-08T19:24:18.109617+0000","last_clean":"2023-11-08T19:24:18.109617+0000","last_became_active":"2023-11-08T19:24:17.118272+0000","last_became_peered":"2023-11-08T19:24:17.118272+0000","last_unstale":"2023-11-08T19:24:18.109617+0000","last_undegraded":"2023-11-08T19:24:18.109617+0000","last_fullsized":"2023-11-08T19:24:18.109617+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:42:55.799453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.626562+0000","last_change":"2023-11-08T19:24:17.120411+0000","last_active":"2023-11-08T19:24:18.626562+0000","last_peered":"2023-11-08T19:24:18.626562+0000","last_clean":"2023-11-08T19:24:18.626562+0000","last_became_active":"2023-11-08T19:24:17.120029+0000","last_became_peered":"2023-11-08T19:24:17.120029+0000","last_unstale":"2023-11-08T19:24:18.626562+0000","last_undegraded":"2023-11-08T19:24:18.626562+0000","last_fullsized":"2023-11-08T19:24:18.626562+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:33:44.652238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.109500+0000","last_change":"2023-11-08T19:24:17.115499+0000","last_active":"2023-11-08T19:24:18.109500+0000","last_peered":"2023-11-08T19:24:18.109500+0000","last_clean":"2023-11-08T19:24:18.109500+0000","last_became_active":"2023-11-08T19:24:17.115213+0000","last_became_peered":"2023-11-08T19:24:17.115213+0000","last_unstale":"2023-11-08T19:24:18.109500+0000","last_undegraded":"2023-11-08T19:24:18.109500+0000","last_fullsized":"2023-11-08T19:24:18.109500+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:32:37.195254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.629278+0000","last_change":"2023-11-08T19:24:17.122189+0000","last_active":"2023-11-08T19:24:18.629278+0000","last_peered":"2023-11-08T19:24:18.629278+0000","last_clean":"2023-11-08T19:24:18.629278+0000","last_became_active":"2023-11-08T19:24:17.121889+0000","last_became_peered":"2023-11-08T19:24:17.121889+0000","last_unstale":"2023-11-08T19:24:18.629278+0000","last_undegraded":"2023-11-08T19:24:18.629278+0000","last_fullsized":"2023-11-08T19:24:18.629278+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:12.060745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.109547+0000","last_change":"2023-11-08T19:24:17.114478+0000","last_active":"2023-11-08T19:24:18.109547+0000","last_peered":"2023-11-08T19:24:18.109547+0000","last_clean":"2023-11-08T19:24:18.109547+0000","last_became_active":"2023-11-08T19:24:17.114207+0000","last_became_peered":"2023-11-08T19:24:17.114207+0000","last_unstale":"2023-11-08T19:24:18.109547+0000","last_undegraded":"2023-11-08T19:24:18.109547+0000","last_fullsized":"2023-11-08T19:24:18.109547+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:32:37.195254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.639778+0000","last_change":"2023-11-08T19:24:17.127471+0000","last_active":"2023-11-08T19:24:19.639778+0000","last_peered":"2023-11-08T19:24:19.639778+0000","last_clean":"2023-11-08T19:24:19.639778+0000","last_became_active":"2023-11-08T19:24:17.125384+0000","last_became_peered":"2023-11-08T19:24:17.125384+0000","last_unstale":"2023-11-08T19:24:19.639778+0000","last_undegraded":"2023-11-08T19:24:19.639778+0000","last_fullsized":"2023-11-08T19:24:19.639778+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:56:51.753457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.626382+0000","last_change":"2023-11-08T19:24:17.123153+0000","last_active":"2023-11-08T19:24:18.626382+0000","last_peered":"2023-11-08T19:24:18.626382+0000","last_clean":"2023-11-08T19:24:18.626382+0000","last_became_active":"2023-11-08T19:24:17.122842+0000","last_became_peered":"2023-11-08T19:24:17.122842+0000","last_unstale":"2023-11-08T19:24:18.626382+0000","last_undegraded":"2023-11-08T19:24:18.626382+0000","last_fullsized":"2023-11-08T19:24:18.626382+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:27:43.480541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.109994+0000","last_change":"2023-11-08T19:24:17.119904+0000","last_active":"2023-11-08T19:24:18.109994+0000","last_peered":"2023-11-08T19:24:18.109994+0000","last_clean":"2023-11-08T19:24:18.109994+0000","last_became_active":"2023-11-08T19:24:17.119682+0000","last_became_peered":"2023-11-08T19:24:17.119682+0000","last_unstale":"2023-11-08T19:24:18.109994+0000","last_undegraded":"2023-11-08T19:24:18.109994+0000","last_fullsized":"2023-11-08T19:24:18.109994+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:12:58.048320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.108589+0000","last_change":"2023-11-08T19:24:17.118368+0000","last_active":"2023-11-08T19:24:18.108589+0000","last_peered":"2023-11-08T19:24:18.108589+0000","last_clean":"2023-11-08T19:24:18.108589+0000","last_became_active":"2023-11-08T19:24:17.118099+0000","last_became_peered":"2023-11-08T19:24:17.118099+0000","last_unstale":"2023-11-08T19:24:18.108589+0000","last_undegraded":"2023-11-08T19:24:18.108589+0000","last_fullsized":"2023-11-08T19:24:18.108589+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:00:12.858113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.109838+0000","last_change":"2023-11-08T19:24:17.116006+0000","last_active":"2023-11-08T19:24:18.109838+0000","last_peered":"2023-11-08T19:24:18.109838+0000","last_clean":"2023-11-08T19:24:18.109838+0000","last_became_active":"2023-11-08T19:24:17.114407+0000","last_became_peered":"2023-11-08T19:24:17.114407+0000","last_unstale":"2023-11-08T19:24:18.109838+0000","last_undegraded":"2023-11-08T19:24:18.109838+0000","last_fullsized":"2023-11-08T19:24:18.109838+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:33:32.862712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.629538+0000","last_change":"2023-11-08T19:24:17.123637+0000","last_active":"2023-11-08T19:24:18.629538+0000","last_peered":"2023-11-08T19:24:18.629538+0000","last_clean":"2023-11-08T19:24:18.629538+0000","last_became_active":"2023-11-08T19:24:17.123374+0000","last_became_peered":"2023-11-08T19:24:17.123374+0000","last_unstale":"2023-11-08T19:24:18.629538+0000","last_undegraded":"2023-11-08T19:24:18.629538+0000","last_fullsized":"2023-11-08T19:24:18.629538+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:39:50.238810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.110117+0000","last_change":"2023-11-08T19:24:17.120031+0000","last_active":"2023-11-08T19:24:18.110117+0000","last_peered":"2023-11-08T19:24:18.110117+0000","last_clean":"2023-11-08T19:24:18.110117+0000","last_became_active":"2023-11-08T19:24:17.118844+0000","last_became_peered":"2023-11-08T19:24:17.118844+0000","last_unstale":"2023-11-08T19:24:18.110117+0000","last_undegraded":"2023-11-08T19:24:18.110117+0000","last_fullsized":"2023-11-08T19:24:18.110117+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:00:12.858113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.109836+0000","last_change":"2023-11-08T19:24:17.120799+0000","last_active":"2023-11-08T19:24:18.109836+0000","last_peered":"2023-11-08T19:24:18.109836+0000","last_clean":"2023-11-08T19:24:18.109836+0000","last_became_active":"2023-11-08T19:24:17.120547+0000","last_became_peered":"2023-11-08T19:24:17.120547+0000","last_unstale":"2023-11-08T19:24:18.109836+0000","last_undegraded":"2023-11-08T19:24:18.109836+0000","last_fullsized":"2023-11-08T19:24:18.109836+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:37:25.491966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.639820+0000","last_change":"2023-11-08T19:24:17.126988+0000","last_active":"2023-11-08T19:24:19.639820+0000","last_peered":"2023-11-08T19:24:19.639820+0000","last_clean":"2023-11-08T19:24:19.639820+0000","last_became_active":"2023-11-08T19:24:17.125342+0000","last_became_peered":"2023-11-08T19:24:17.125342+0000","last_unstale":"2023-11-08T19:24:19.639820+0000","last_undegraded":"2023-11-08T19:24:19.639820+0000","last_fullsized":"2023-11-08T19:24:19.639820+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:54:17.779367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.108459+0000","last_change":"2023-11-08T19:24:17.119513+0000","last_active":"2023-11-08T19:24:18.108459+0000","last_peered":"2023-11-08T19:24:18.108459+0000","last_clean":"2023-11-08T19:24:18.108459+0000","last_became_active":"2023-11-08T19:24:17.119266+0000","last_became_peered":"2023-11-08T19:24:17.119266+0000","last_unstale":"2023-11-08T19:24:18.108459+0000","last_undegraded":"2023-11-08T19:24:18.108459+0000","last_fullsized":"2023-11-08T19:24:18.108459+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:37:25.491966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.639846+0000","last_change":"2023-11-08T19:24:17.124148+0000","last_active":"2023-11-08T19:24:19.639846+0000","last_peered":"2023-11-08T19:24:19.639846+0000","last_clean":"2023-11-08T19:24:19.639846+0000","last_became_active":"2023-11-08T19:24:17.123849+0000","last_became_peered":"2023-11-08T19:24:17.123849+0000","last_unstale":"2023-11-08T19:24:19.639846+0000","last_undegraded":"2023-11-08T19:24:19.639846+0000","last_fullsized":"2023-11-08T19:24:19.639846+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:05:23.478967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.493590+0000","last_change":"2023-11-08T19:24:16.115544+0000","last_active":"2023-11-08T19:24:17.493590+0000","last_peered":"2023-11-08T19:24:17.493590+0000","last_clean":"2023-11-08T19:24:17.493590+0000","last_became_active":"2023-11-08T19:24:16.115253+0000","last_became_peered":"2023-11-08T19:24:16.115253+0000","last_unstale":"2023-11-08T19:24:17.493590+0000","last_undegraded":"2023-11-08T19:24:17.493590+0000","last_fullsized":"2023-11-08T19:24:17.493590+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:27:10.600227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.108858+0000","last_change":"2023-11-08T19:24:17.118929+0000","last_active":"2023-11-08T19:24:18.108858+0000","last_peered":"2023-11-08T19:24:18.108858+0000","last_clean":"2023-11-08T19:24:18.108858+0000","last_became_active":"2023-11-08T19:24:17.118635+0000","last_became_peered":"2023-11-08T19:24:17.118635+0000","last_unstale":"2023-11-08T19:24:18.108858+0000","last_undegraded":"2023-11-08T19:24:18.108858+0000","last_fullsized":"2023-11-08T19:24:18.108858+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:38:34.568472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.491639+0000","last_change":"2023-11-08T19:24:16.121042+0000","last_active":"2023-11-08T19:24:17.491639+0000","last_peered":"2023-11-08T19:24:17.491639+0000","last_clean":"2023-11-08T19:24:17.491639+0000","last_became_active":"2023-11-08T19:24:16.120776+0000","last_became_peered":"2023-11-08T19:24:16.120776+0000","last_unstale":"2023-11-08T19:24:17.491639+0000","last_undegraded":"2023-11-08T19:24:17.491639+0000","last_fullsized":"2023-11-08T19:24:17.491639+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:27:10.600227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.110506+0000","last_change":"2023-11-08T19:24:17.117821+0000","last_active":"2023-11-08T19:24:18.110506+0000","last_peered":"2023-11-08T19:24:18.110506+0000","last_clean":"2023-11-08T19:24:18.110506+0000","last_became_active":"2023-11-08T19:24:17.117535+0000","last_became_peered":"2023-11-08T19:24:17.117535+0000","last_unstale":"2023-11-08T19:24:18.110506+0000","last_undegraded":"2023-11-08T19:24:18.110506+0000","last_fullsized":"2023-11-08T19:24:18.110506+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:16:13.162177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.491489+0000","last_change":"2023-11-08T19:24:16.124256+0000","last_active":"2023-11-08T19:24:17.491489+0000","last_peered":"2023-11-08T19:24:17.491489+0000","last_clean":"2023-11-08T19:24:17.491489+0000","last_became_active":"2023-11-08T19:24:16.121912+0000","last_became_peered":"2023-11-08T19:24:16.121912+0000","last_unstale":"2023-11-08T19:24:17.491489+0000","last_undegraded":"2023-11-08T19:24:17.491489+0000","last_fullsized":"2023-11-08T19:24:17.491489+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:32:36.193518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.171878+0000","last_change":"2023-11-08T19:24:17.122526+0000","last_active":"2023-11-08T19:24:19.171878+0000","last_peered":"2023-11-08T19:24:19.171878+0000","last_clean":"2023-11-08T19:24:19.171878+0000","last_became_active":"2023-11-08T19:24:17.122262+0000","last_became_peered":"2023-11-08T19:24:17.122262+0000","last_unstale":"2023-11-08T19:24:19.171878+0000","last_undegraded":"2023-11-08T19:24:19.171878+0000","last_fullsized":"2023-11-08T19:24:19.171878+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:45:20.406135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.489853+0000","last_change":"2023-11-08T19:24:16.125612+0000","last_active":"2023-11-08T19:24:17.489853+0000","last_peered":"2023-11-08T19:24:17.489853+0000","last_clean":"2023-11-08T19:24:17.489853+0000","last_became_active":"2023-11-08T19:24:16.125298+0000","last_became_peered":"2023-11-08T19:24:16.125298+0000","last_unstale":"2023-11-08T19:24:17.489853+0000","last_undegraded":"2023-11-08T19:24:17.489853+0000","last_fullsized":"2023-11-08T19:24:17.489853+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:36:18.253463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.620881+0000","last_change":"2023-11-08T19:24:17.122574+0000","last_active":"2023-11-08T19:24:19.620881+0000","last_peered":"2023-11-08T19:24:19.620881+0000","last_clean":"2023-11-08T19:24:19.620881+0000","last_became_active":"2023-11-08T19:24:17.122305+0000","last_became_peered":"2023-11-08T19:24:17.122305+0000","last_unstale":"2023-11-08T19:24:19.620881+0000","last_undegraded":"2023-11-08T19:24:19.620881+0000","last_fullsized":"2023-11-08T19:24:19.620881+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:38:34.568472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.490497+0000","last_change":"2023-11-08T19:24:16.121095+0000","last_active":"2023-11-08T19:24:17.490497+0000","last_peered":"2023-11-08T19:24:17.490497+0000","last_clean":"2023-11-08T19:24:17.490497+0000","last_became_active":"2023-11-08T19:24:16.120647+0000","last_became_peered":"2023-11-08T19:24:16.120647+0000","last_unstale":"2023-11-08T19:24:17.490497+0000","last_undegraded":"2023-11-08T19:24:17.490497+0000","last_fullsized":"2023-11-08T19:24:17.490497+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:36:18.253463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.629306+0000","last_change":"2023-11-08T19:24:17.122489+0000","last_active":"2023-11-08T19:24:18.629306+0000","last_peered":"2023-11-08T19:24:18.629306+0000","last_clean":"2023-11-08T19:24:18.629306+0000","last_became_active":"2023-11-08T19:24:17.122205+0000","last_became_peered":"2023-11-08T19:24:17.122205+0000","last_unstale":"2023-11-08T19:24:18.629306+0000","last_undegraded":"2023-11-08T19:24:18.629306+0000","last_fullsized":"2023-11-08T19:24:18.629306+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:31:10.520077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.493343+0000","last_change":"2023-11-08T19:24:16.119182+0000","last_active":"2023-11-08T19:24:17.493343+0000","last_peered":"2023-11-08T19:24:17.493343+0000","last_clean":"2023-11-08T19:24:17.493343+0000","last_became_active":"2023-11-08T19:24:16.118932+0000","last_became_peered":"2023-11-08T19:24:16.118932+0000","last_unstale":"2023-11-08T19:24:17.493343+0000","last_undegraded":"2023-11-08T19:24:17.493343+0000","last_fullsized":"2023-11-08T19:24:17.493343+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:21:06.998550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.109704+0000","last_change":"2023-11-08T19:24:17.118405+0000","last_active":"2023-11-08T19:24:18.109704+0000","last_peered":"2023-11-08T19:24:18.109704+0000","last_clean":"2023-11-08T19:24:18.109704+0000","last_became_active":"2023-11-08T19:24:17.118129+0000","last_became_peered":"2023-11-08T19:24:17.118129+0000","last_unstale":"2023-11-08T19:24:18.109704+0000","last_undegraded":"2023-11-08T19:24:18.109704+0000","last_fullsized":"2023-11-08T19:24:18.109704+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:42:55.799453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.111724+0000","last_change":"2023-11-08T19:24:16.123153+0000","last_active":"2023-11-08T19:24:17.111724+0000","last_peered":"2023-11-08T19:24:17.111724+0000","last_clean":"2023-11-08T19:24:17.111724+0000","last_became_active":"2023-11-08T19:24:16.122837+0000","last_became_peered":"2023-11-08T19:24:16.122837+0000","last_unstale":"2023-11-08T19:24:17.111724+0000","last_undegraded":"2023-11-08T19:24:17.111724+0000","last_fullsized":"2023-11-08T19:24:17.111724+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:09:19.268418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.171638+0000","last_change":"2023-11-08T19:24:17.127308+0000","last_active":"2023-11-08T19:24:19.171638+0000","last_peered":"2023-11-08T19:24:19.171638+0000","last_clean":"2023-11-08T19:24:19.171638+0000","last_became_active":"2023-11-08T19:24:17.126959+0000","last_became_peered":"2023-11-08T19:24:17.126959+0000","last_unstale":"2023-11-08T19:24:19.171638+0000","last_undegraded":"2023-11-08T19:24:19.171638+0000","last_fullsized":"2023-11-08T19:24:19.171638+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:31:10.520077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.106903+0000","last_change":"2023-11-08T19:24:16.115097+0000","last_active":"2023-11-08T19:24:17.106903+0000","last_peered":"2023-11-08T19:24:17.106903+0000","last_clean":"2023-11-08T19:24:17.106903+0000","last_became_active":"2023-11-08T19:24:16.114776+0000","last_became_peered":"2023-11-08T19:24:16.114776+0000","last_unstale":"2023-11-08T19:24:17.106903+0000","last_undegraded":"2023-11-08T19:24:17.106903+0000","last_fullsized":"2023-11-08T19:24:17.106903+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:29:45.264000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.626668+0000","last_change":"2023-11-08T19:24:17.114263+0000","last_active":"2023-11-08T19:24:18.626668+0000","last_peered":"2023-11-08T19:24:18.626668+0000","last_clean":"2023-11-08T19:24:18.626668+0000","last_became_active":"2023-11-08T19:24:17.113979+0000","last_became_peered":"2023-11-08T19:24:17.113979+0000","last_unstale":"2023-11-08T19:24:18.626668+0000","last_undegraded":"2023-11-08T19:24:18.626668+0000","last_fullsized":"2023-11-08T19:24:18.626668+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:11:31.830617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.114474+0000","last_change":"2023-11-08T19:24:16.125536+0000","last_active":"2023-11-08T19:24:17.114474+0000","last_peered":"2023-11-08T19:24:17.114474+0000","last_clean":"2023-11-08T19:24:17.114474+0000","last_became_active":"2023-11-08T19:24:16.125250+0000","last_became_peered":"2023-11-08T19:24:16.125250+0000","last_unstale":"2023-11-08T19:24:17.114474+0000","last_undegraded":"2023-11-08T19:24:17.114474+0000","last_fullsized":"2023-11-08T19:24:17.114474+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:54:16.777631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.639960+0000","last_change":"2023-11-08T19:24:17.124866+0000","last_active":"2023-11-08T19:24:19.639960+0000","last_peered":"2023-11-08T19:24:19.639960+0000","last_clean":"2023-11-08T19:24:19.639960+0000","last_became_active":"2023-11-08T19:24:17.124608+0000","last_became_peered":"2023-11-08T19:24:17.124608+0000","last_unstale":"2023-11-08T19:24:19.639960+0000","last_undegraded":"2023-11-08T19:24:19.639960+0000","last_fullsized":"2023-11-08T19:24:19.639960+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:21:41.966251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.114810+0000","last_change":"2023-11-08T19:24:16.125654+0000","last_active":"2023-11-08T19:24:17.114810+0000","last_peered":"2023-11-08T19:24:17.114810+0000","last_clean":"2023-11-08T19:24:17.114810+0000","last_became_active":"2023-11-08T19:24:16.125312+0000","last_became_peered":"2023-11-08T19:24:16.125312+0000","last_unstale":"2023-11-08T19:24:17.114810+0000","last_undegraded":"2023-11-08T19:24:17.114810+0000","last_fullsized":"2023-11-08T19:24:17.114810+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:38:33.566735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.621115+0000","last_change":"2023-11-08T19:24:17.127916+0000","last_active":"2023-11-08T19:24:19.621115+0000","last_peered":"2023-11-08T19:24:19.621115+0000","last_clean":"2023-11-08T19:24:19.621115+0000","last_became_active":"2023-11-08T19:24:17.127617+0000","last_became_peered":"2023-11-08T19:24:17.127617+0000","last_unstale":"2023-11-08T19:24:19.621115+0000","last_undegraded":"2023-11-08T19:24:19.621115+0000","last_fullsized":"2023-11-08T19:24:19.621115+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:54:17.779367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.490739+0000","last_change":"2023-11-08T19:24:16.120737+0000","last_active":"2023-11-08T19:24:17.490739+0000","last_peered":"2023-11-08T19:24:17.490739+0000","last_clean":"2023-11-08T19:24:17.490739+0000","last_became_active":"2023-11-08T19:24:16.120426+0000","last_became_peered":"2023-11-08T19:24:16.120426+0000","last_unstale":"2023-11-08T19:24:17.490739+0000","last_undegraded":"2023-11-08T19:24:17.490739+0000","last_fullsized":"2023-11-08T19:24:17.490739+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:00:11.856376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.110033+0000","last_change":"2023-11-08T19:24:17.112649+0000","last_active":"2023-11-08T19:24:18.110033+0000","last_peered":"2023-11-08T19:24:18.110033+0000","last_clean":"2023-11-08T19:24:18.110033+0000","last_became_active":"2023-11-08T19:24:17.112367+0000","last_became_peered":"2023-11-08T19:24:17.112367+0000","last_unstale":"2023-11-08T19:24:18.110033+0000","last_undegraded":"2023-11-08T19:24:18.110033+0000","last_fullsized":"2023-11-08T19:24:18.110033+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:37:25.491966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.494286+0000","last_change":"2023-11-08T19:24:16.125204+0000","last_active":"2023-11-08T19:24:17.494286+0000","last_peered":"2023-11-08T19:24:17.494286+0000","last_clean":"2023-11-08T19:24:17.494286+0000","last_became_active":"2023-11-08T19:24:16.124854+0000","last_became_peered":"2023-11-08T19:24:16.124854+0000","last_unstale":"2023-11-08T19:24:17.494286+0000","last_undegraded":"2023-11-08T19:24:17.494286+0000","last_fullsized":"2023-11-08T19:24:17.494286+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:41:08.800652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.620710+0000","last_change":"2023-11-08T19:24:17.122294+0000","last_active":"2023-11-08T19:24:19.620710+0000","last_peered":"2023-11-08T19:24:19.620710+0000","last_clean":"2023-11-08T19:24:19.620710+0000","last_became_active":"2023-11-08T19:24:17.121925+0000","last_became_peered":"2023-11-08T19:24:17.121925+0000","last_unstale":"2023-11-08T19:24:19.620710+0000","last_undegraded":"2023-11-08T19:24:19.620710+0000","last_fullsized":"2023-11-08T19:24:19.620710+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:37:25.491966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.488720+0000","last_change":"2023-11-08T19:24:16.124120+0000","last_active":"2023-11-08T19:24:17.488720+0000","last_peered":"2023-11-08T19:24:17.488720+0000","last_clean":"2023-11-08T19:24:17.488720+0000","last_became_active":"2023-11-08T19:24:16.123861+0000","last_became_peered":"2023-11-08T19:24:16.123861+0000","last_unstale":"2023-11-08T19:24:17.488720+0000","last_undegraded":"2023-11-08T19:24:17.488720+0000","last_fullsized":"2023-11-08T19:24:17.488720+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:53:37.136871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.171338+0000","last_change":"2023-11-08T19:24:17.123772+0000","last_active":"2023-11-08T19:24:19.171338+0000","last_peered":"2023-11-08T19:24:19.171338+0000","last_clean":"2023-11-08T19:24:19.171338+0000","last_became_active":"2023-11-08T19:24:17.123465+0000","last_became_peered":"2023-11-08T19:24:17.123465+0000","last_unstale":"2023-11-08T19:24:19.171338+0000","last_undegraded":"2023-11-08T19:24:19.171338+0000","last_fullsized":"2023-11-08T19:24:19.171338+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:25:04.337488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.110649+0000","last_change":"2023-11-08T19:24:16.123874+0000","last_active":"2023-11-08T19:24:17.110649+0000","last_peered":"2023-11-08T19:24:17.110649+0000","last_clean":"2023-11-08T19:24:17.110649+0000","last_became_active":"2023-11-08T19:24:16.123508+0000","last_became_peered":"2023-11-08T19:24:16.123508+0000","last_unstale":"2023-11-08T19:24:17.110649+0000","last_undegraded":"2023-11-08T19:24:17.110649+0000","last_fullsized":"2023-11-08T19:24:17.110649+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:21:06.998550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.639774+0000","last_change":"2023-11-08T19:24:17.124156+0000","last_active":"2023-11-08T19:24:19.639774+0000","last_peered":"2023-11-08T19:24:19.639774+0000","last_clean":"2023-11-08T19:24:19.639774+0000","last_became_active":"2023-11-08T19:24:17.123823+0000","last_became_peered":"2023-11-08T19:24:17.123823+0000","last_unstale":"2023-11-08T19:24:19.639774+0000","last_undegraded":"2023-11-08T19:24:19.639774+0000","last_fullsized":"2023-11-08T19:24:19.639774+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:41:09.802388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.106233+0000","last_change":"2023-11-08T19:24:16.109232+0000","last_active":"2023-11-08T19:24:17.106233+0000","last_peered":"2023-11-08T19:24:17.106233+0000","last_clean":"2023-11-08T19:24:17.106233+0000","last_became_active":"2023-11-08T19:24:16.108931+0000","last_became_peered":"2023-11-08T19:24:16.108931+0000","last_unstale":"2023-11-08T19:24:17.106233+0000","last_undegraded":"2023-11-08T19:24:17.106233+0000","last_fullsized":"2023-11-08T19:24:17.106233+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:45:52.271444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.171490+0000","last_change":"2023-11-08T19:24:17.120690+0000","last_active":"2023-11-08T19:24:19.171490+0000","last_peered":"2023-11-08T19:24:19.171490+0000","last_clean":"2023-11-08T19:24:19.171490+0000","last_became_active":"2023-11-08T19:24:17.120428+0000","last_became_peered":"2023-11-08T19:24:17.120428+0000","last_unstale":"2023-11-08T19:24:19.171490+0000","last_undegraded":"2023-11-08T19:24:19.171490+0000","last_fullsized":"2023-11-08T19:24:19.171490+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:08:50.861077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.493744+0000","last_change":"2023-11-08T19:24:16.119756+0000","last_active":"2023-11-08T19:24:17.493744+0000","last_peered":"2023-11-08T19:24:17.493744+0000","last_clean":"2023-11-08T19:24:17.493744+0000","last_became_active":"2023-11-08T19:24:16.119460+0000","last_became_peered":"2023-11-08T19:24:16.119460+0000","last_unstale":"2023-11-08T19:24:17.493744+0000","last_undegraded":"2023-11-08T19:24:17.493744+0000","last_fullsized":"2023-11-08T19:24:17.493744+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:00:11.856376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.171544+0000","last_change":"2023-11-08T19:24:17.119623+0000","last_active":"2023-11-08T19:24:19.171544+0000","last_peered":"2023-11-08T19:24:19.171544+0000","last_clean":"2023-11-08T19:24:19.171544+0000","last_became_active":"2023-11-08T19:24:17.119345+0000","last_became_peered":"2023-11-08T19:24:17.119345+0000","last_unstale":"2023-11-08T19:24:19.171544+0000","last_undegraded":"2023-11-08T19:24:19.171544+0000","last_fullsized":"2023-11-08T19:24:19.171544+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:12.060745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.491505+0000","last_change":"2023-11-08T19:24:16.116135+0000","last_active":"2023-11-08T19:24:17.491505+0000","last_peered":"2023-11-08T19:24:17.491505+0000","last_clean":"2023-11-08T19:24:17.491505+0000","last_became_active":"2023-11-08T19:24:16.115879+0000","last_became_peered":"2023-11-08T19:24:16.115879+0000","last_unstale":"2023-11-08T19:24:17.491505+0000","last_undegraded":"2023-11-08T19:24:17.491505+0000","last_fullsized":"2023-11-08T19:24:17.491505+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:41:08.800652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.629581+0000","last_change":"2023-11-08T19:24:17.122627+0000","last_active":"2023-11-08T19:24:18.629581+0000","last_peered":"2023-11-08T19:24:18.629581+0000","last_clean":"2023-11-08T19:24:18.629581+0000","last_became_active":"2023-11-08T19:24:17.122313+0000","last_became_peered":"2023-11-08T19:24:17.122313+0000","last_unstale":"2023-11-08T19:24:18.629581+0000","last_undegraded":"2023-11-08T19:24:18.629581+0000","last_fullsized":"2023-11-08T19:24:18.629581+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:45:20.406135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.491205+0000","last_change":"2023-11-08T19:24:16.117967+0000","last_active":"2023-11-08T19:24:17.491205+0000","last_peered":"2023-11-08T19:24:17.491205+0000","last_clean":"2023-11-08T19:24:17.491205+0000","last_became_active":"2023-11-08T19:24:16.117675+0000","last_became_peered":"2023-11-08T19:24:16.117675+0000","last_unstale":"2023-11-08T19:24:17.491205+0000","last_undegraded":"2023-11-08T19:24:17.491205+0000","last_fullsized":"2023-11-08T19:24:17.491205+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:27:10.600227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.110440+0000","last_change":"2023-11-08T19:24:17.119911+0000","last_active":"2023-11-08T19:24:18.110440+0000","last_peered":"2023-11-08T19:24:18.110440+0000","last_clean":"2023-11-08T19:24:18.110440+0000","last_became_active":"2023-11-08T19:24:17.119640+0000","last_became_peered":"2023-11-08T19:24:17.119640+0000","last_unstale":"2023-11-08T19:24:18.110440+0000","last_undegraded":"2023-11-08T19:24:18.110440+0000","last_fullsized":"2023-11-08T19:24:18.110440+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:00:12.858113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.493128+0000","last_change":"2023-11-08T19:24:16.119485+0000","last_active":"2023-11-08T19:24:17.493128+0000","last_peered":"2023-11-08T19:24:17.493128+0000","last_clean":"2023-11-08T19:24:17.493128+0000","last_became_active":"2023-11-08T19:24:16.119234+0000","last_became_peered":"2023-11-08T19:24:16.119234+0000","last_unstale":"2023-11-08T19:24:17.493128+0000","last_undegraded":"2023-11-08T19:24:17.493128+0000","last_fullsized":"2023-11-08T19:24:17.493128+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:27:28.711503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.626583+0000","last_change":"2023-11-08T19:24:17.123516+0000","last_active":"2023-11-08T19:24:18.626583+0000","last_peered":"2023-11-08T19:24:18.626583+0000","last_clean":"2023-11-08T19:24:18.626583+0000","last_became_active":"2023-11-08T19:24:17.122503+0000","last_became_peered":"2023-11-08T19:24:17.122503+0000","last_unstale":"2023-11-08T19:24:18.626583+0000","last_undegraded":"2023-11-08T19:24:18.626583+0000","last_fullsized":"2023-11-08T19:24:18.626583+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:55:15.476144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.113619+0000","last_change":"2023-11-08T19:24:16.120284+0000","last_active":"2023-11-08T19:24:17.113619+0000","last_peered":"2023-11-08T19:24:17.113619+0000","last_clean":"2023-11-08T19:24:17.113619+0000","last_became_active":"2023-11-08T19:24:16.119983+0000","last_became_peered":"2023-11-08T19:24:16.119983+0000","last_unstale":"2023-11-08T19:24:17.113619+0000","last_undegraded":"2023-11-08T19:24:17.113619+0000","last_fullsized":"2023-11-08T19:24:17.113619+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:42:54.797716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.639623+0000","last_change":"2023-11-08T19:24:17.127930+0000","last_active":"2023-11-08T19:24:19.639623+0000","last_peered":"2023-11-08T19:24:19.639623+0000","last_clean":"2023-11-08T19:24:19.639623+0000","last_became_active":"2023-11-08T19:24:17.127656+0000","last_became_peered":"2023-11-08T19:24:17.127656+0000","last_unstale":"2023-11-08T19:24:19.639623+0000","last_undegraded":"2023-11-08T19:24:19.639623+0000","last_fullsized":"2023-11-08T19:24:19.639623+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:53:38.138608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.489973+0000","last_change":"2023-11-08T19:24:16.116495+0000","last_active":"2023-11-08T19:24:17.489973+0000","last_peered":"2023-11-08T19:24:17.489973+0000","last_clean":"2023-11-08T19:24:17.489973+0000","last_became_active":"2023-11-08T19:24:16.116191+0000","last_became_peered":"2023-11-08T19:24:16.116191+0000","last_unstale":"2023-11-08T19:24:17.489973+0000","last_undegraded":"2023-11-08T19:24:17.489973+0000","last_fullsized":"2023-11-08T19:24:17.489973+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:49:05.309488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.620773+0000","last_change":"2023-11-08T19:24:17.128861+0000","last_active":"2023-11-08T19:24:19.620773+0000","last_peered":"2023-11-08T19:24:19.620773+0000","last_clean":"2023-11-08T19:24:19.620773+0000","last_became_active":"2023-11-08T19:24:17.128594+0000","last_became_peered":"2023-11-08T19:24:17.128594+0000","last_unstale":"2023-11-08T19:24:19.620773+0000","last_undegraded":"2023-11-08T19:24:19.620773+0000","last_fullsized":"2023-11-08T19:24:19.620773+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:00:12.858113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.106999+0000","last_change":"2023-11-08T19:24:16.113723+0000","last_active":"2023-11-08T19:24:17.106999+0000","last_peered":"2023-11-08T19:24:17.106999+0000","last_clean":"2023-11-08T19:24:17.106999+0000","last_became_active":"2023-11-08T19:24:16.113374+0000","last_became_peered":"2023-11-08T19:24:16.113374+0000","last_unstale":"2023-11-08T19:24:17.106999+0000","last_undegraded":"2023-11-08T19:24:17.106999+0000","last_fullsized":"2023-11-08T19:24:17.106999+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:18:44.789207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.629171+0000","last_change":"2023-11-08T19:24:17.117595+0000","last_active":"2023-11-08T19:24:18.629171+0000","last_peered":"2023-11-08T19:24:18.629171+0000","last_clean":"2023-11-08T19:24:18.629171+0000","last_became_active":"2023-11-08T19:24:17.117300+0000","last_became_peered":"2023-11-08T19:24:17.117300+0000","last_unstale":"2023-11-08T19:24:18.629171+0000","last_undegraded":"2023-11-08T19:24:18.629171+0000","last_fullsized":"2023-11-08T19:24:18.629171+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:25:04.337488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.116218+0000","last_change":"2023-11-08T19:24:16.119794+0000","last_active":"2023-11-08T19:24:17.116218+0000","last_peered":"2023-11-08T19:24:17.116218+0000","last_clean":"2023-11-08T19:24:17.116218+0000","last_became_active":"2023-11-08T19:24:16.119524+0000","last_became_peered":"2023-11-08T19:24:16.119524+0000","last_unstale":"2023-11-08T19:24:17.116218+0000","last_undegraded":"2023-11-08T19:24:17.116218+0000","last_fullsized":"2023-11-08T19:24:17.116218+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:16:12.160440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.171479+0000","last_change":"2023-11-08T19:24:17.128143+0000","last_active":"2023-11-08T19:24:19.171479+0000","last_peered":"2023-11-08T19:24:19.171479+0000","last_clean":"2023-11-08T19:24:19.171479+0000","last_became_active":"2023-11-08T19:24:17.127912+0000","last_became_peered":"2023-11-08T19:24:17.127912+0000","last_unstale":"2023-11-08T19:24:19.171479+0000","last_undegraded":"2023-11-08T19:24:19.171479+0000","last_fullsized":"2023-11-08T19:24:19.171479+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:21:41.966251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.107002+0000","last_change":"2023-11-08T19:24:16.116956+0000","last_active":"2023-11-08T19:24:17.107002+0000","last_peered":"2023-11-08T19:24:17.107002+0000","last_clean":"2023-11-08T19:24:17.107002+0000","last_became_active":"2023-11-08T19:24:16.116715+0000","last_became_peered":"2023-11-08T19:24:16.116715+0000","last_unstale":"2023-11-08T19:24:17.107002+0000","last_undegraded":"2023-11-08T19:24:17.107002+0000","last_fullsized":"2023-11-08T19:24:17.107002+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:50:55.092096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.108668+0000","last_change":"2023-11-08T19:24:17.122910+0000","last_active":"2023-11-08T19:24:18.108668+0000","last_peered":"2023-11-08T19:24:18.108668+0000","last_clean":"2023-11-08T19:24:18.108668+0000","last_became_active":"2023-11-08T19:24:17.122626+0000","last_became_peered":"2023-11-08T19:24:17.122626+0000","last_unstale":"2023-11-08T19:24:18.108668+0000","last_undegraded":"2023-11-08T19:24:18.108668+0000","last_fullsized":"2023-11-08T19:24:18.108668+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:16:13.162177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.490553+0000","last_change":"2023-11-08T19:24:16.121737+0000","last_active":"2023-11-08T19:24:17.490553+0000","last_peered":"2023-11-08T19:24:17.490553+0000","last_clean":"2023-11-08T19:24:17.490553+0000","last_became_active":"2023-11-08T19:24:16.121491+0000","last_became_peered":"2023-11-08T19:24:16.121491+0000","last_unstale":"2023-11-08T19:24:17.490553+0000","last_undegraded":"2023-11-08T19:24:17.490553+0000","last_fullsized":"2023-11-08T19:24:17.490553+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:54:16.777631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.640062+0000","last_change":"2023-11-08T19:24:17.129203+0000","last_active":"2023-11-08T19:24:19.640062+0000","last_peered":"2023-11-08T19:24:19.640062+0000","last_clean":"2023-11-08T19:24:19.640062+0000","last_became_active":"2023-11-08T19:24:17.128943+0000","last_became_peered":"2023-11-08T19:24:17.128943+0000","last_unstale":"2023-11-08T19:24:19.640062+0000","last_undegraded":"2023-11-08T19:24:19.640062+0000","last_fullsized":"2023-11-08T19:24:19.640062+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:08:50.861077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.626600+0000","last_change":"2023-11-08T19:24:16.117342+0000","last_active":"2023-11-08T19:24:18.626600+0000","last_peered":"2023-11-08T19:24:18.626600+0000","last_clean":"2023-11-08T19:24:18.626600+0000","last_became_active":"2023-11-08T19:24:16.117074+0000","last_became_peered":"2023-11-08T19:24:16.117074+0000","last_unstale":"2023-11-08T19:24:18.626600+0000","last_undegraded":"2023-11-08T19:24:18.626600+0000","last_fullsized":"2023-11-08T19:24:18.626600+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:17:40.377190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.171701+0000","last_change":"2023-11-08T19:24:17.122493+0000","last_active":"2023-11-08T19:24:19.171701+0000","last_peered":"2023-11-08T19:24:19.171701+0000","last_clean":"2023-11-08T19:24:19.171701+0000","last_became_active":"2023-11-08T19:24:17.122230+0000","last_became_peered":"2023-11-08T19:24:17.122230+0000","last_unstale":"2023-11-08T19:24:19.171701+0000","last_undegraded":"2023-11-08T19:24:19.171701+0000","last_fullsized":"2023-11-08T19:24:19.171701+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:53:54.966516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.118004+0000","last_change":"2023-11-08T19:24:16.121272+0000","last_active":"2023-11-08T19:24:17.118004+0000","last_peered":"2023-11-08T19:24:17.118004+0000","last_clean":"2023-11-08T19:24:17.118004+0000","last_became_active":"2023-11-08T19:24:16.120986+0000","last_became_peered":"2023-11-08T19:24:16.120986+0000","last_unstale":"2023-11-08T19:24:17.118004+0000","last_undegraded":"2023-11-08T19:24:17.118004+0000","last_fullsized":"2023-11-08T19:24:17.118004+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:32:36.193518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.620710+0000","last_change":"2023-11-08T19:24:17.125793+0000","last_active":"2023-11-08T19:24:19.620710+0000","last_peered":"2023-11-08T19:24:19.620710+0000","last_clean":"2023-11-08T19:24:19.620710+0000","last_became_active":"2023-11-08T19:24:17.125451+0000","last_became_peered":"2023-11-08T19:24:17.125451+0000","last_unstale":"2023-11-08T19:24:19.620710+0000","last_undegraded":"2023-11-08T19:24:19.620710+0000","last_fullsized":"2023-11-08T19:24:19.620710+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:12:58.048320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.115100+0000","last_change":"2023-11-08T19:24:16.123141+0000","last_active":"2023-11-08T19:24:17.115100+0000","last_peered":"2023-11-08T19:24:17.115100+0000","last_clean":"2023-11-08T19:24:17.115100+0000","last_became_active":"2023-11-08T19:24:16.122900+0000","last_became_peered":"2023-11-08T19:24:16.122900+0000","last_unstale":"2023-11-08T19:24:17.115100+0000","last_undegraded":"2023-11-08T19:24:17.115100+0000","last_fullsized":"2023-11-08T19:24:17.115100+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:09:19.268418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.108503+0000","last_change":"2023-11-08T19:24:17.118955+0000","last_active":"2023-11-08T19:24:18.108503+0000","last_peered":"2023-11-08T19:24:18.108503+0000","last_clean":"2023-11-08T19:24:18.108503+0000","last_became_active":"2023-11-08T19:24:17.118669+0000","last_became_peered":"2023-11-08T19:24:17.118669+0000","last_unstale":"2023-11-08T19:24:18.108503+0000","last_undegraded":"2023-11-08T19:24:18.108503+0000","last_fullsized":"2023-11-08T19:24:18.108503+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:12:58.048320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.106906+0000","last_change":"2023-11-08T19:24:16.117069+0000","last_active":"2023-11-08T19:24:17.106906+0000","last_peered":"2023-11-08T19:24:17.106906+0000","last_clean":"2023-11-08T19:24:17.106906+0000","last_became_active":"2023-11-08T19:24:16.116782+0000","last_became_peered":"2023-11-08T19:24:16.116782+0000","last_unstale":"2023-11-08T19:24:17.106906+0000","last_undegraded":"2023-11-08T19:24:17.106906+0000","last_fullsized":"2023-11-08T19:24:17.106906+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:36:18.253463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.109836+0000","last_change":"2023-11-08T19:24:17.124099+0000","last_active":"2023-11-08T19:24:18.109836+0000","last_peered":"2023-11-08T19:24:18.109836+0000","last_clean":"2023-11-08T19:24:18.109836+0000","last_became_active":"2023-11-08T19:24:17.123803+0000","last_became_peered":"2023-11-08T19:24:17.123803+0000","last_unstale":"2023-11-08T19:24:18.109836+0000","last_undegraded":"2023-11-08T19:24:18.109836+0000","last_fullsized":"2023-11-08T19:24:18.109836+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:33:32.862712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.106929+0000","last_change":"2023-11-08T19:24:16.124372+0000","last_active":"2023-11-08T19:24:17.106929+0000","last_peered":"2023-11-08T19:24:17.106929+0000","last_clean":"2023-11-08T19:24:17.106929+0000","last_became_active":"2023-11-08T19:24:16.124097+0000","last_became_peered":"2023-11-08T19:24:16.124097+0000","last_unstale":"2023-11-08T19:24:17.106929+0000","last_undegraded":"2023-11-08T19:24:17.106929+0000","last_fullsized":"2023-11-08T19:24:17.106929+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:09:54.584065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:19.639921+0000","last_change":"2023-11-08T19:24:17.127281+0000","last_active":"2023-11-08T19:24:19.639921+0000","last_peered":"2023-11-08T19:24:19.639921+0000","last_clean":"2023-11-08T19:24:19.639921+0000","last_became_active":"2023-11-08T19:24:17.126969+0000","last_became_peered":"2023-11-08T19:24:17.126969+0000","last_unstale":"2023-11-08T19:24:19.639921+0000","last_undegraded":"2023-11-08T19:24:19.639921+0000","last_fullsized":"2023-11-08T19:24:19.639921+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:25:04.337488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.113688+0000","last_change":"2023-11-08T19:24:16.125300+0000","last_active":"2023-11-08T19:24:17.113688+0000","last_peered":"2023-11-08T19:24:17.113688+0000","last_clean":"2023-11-08T19:24:17.113688+0000","last_became_active":"2023-11-08T19:24:16.125011+0000","last_became_peered":"2023-11-08T19:24:16.125011+0000","last_unstale":"2023-11-08T19:24:17.113688+0000","last_undegraded":"2023-11-08T19:24:17.113688+0000","last_fullsized":"2023-11-08T19:24:17.113688+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:38:33.566735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T19:24:18.629727+0000","last_change":"2023-11-08T19:24:17.124753+0000","last_active":"2023-11-08T19:24:18.629727+0000","last_peered":"2023-11-08T19:24:18.629727+0000","last_clean":"2023-11-08T19:24:18.629727+0000","last_became_active":"2023-11-08T19:24:17.124494+0000","last_became_peered":"2023-11-08T19:24:17.124494+0000","last_unstale":"2023-11-08T19:24:18.629727+0000","last_undegraded":"2023-11-08T19:24:18.629727+0000","last_fullsized":"2023-11-08T19:24:18.629727+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:16.098411+0000","last_clean_scrub_stamp":"2023-11-08T19:24:16.098411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:39:34.453886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.113407+0000","last_change":"2023-11-08T19:24:16.121492+0000","last_active":"2023-11-08T19:24:17.113407+0000","last_peered":"2023-11-08T19:24:17.113407+0000","last_clean":"2023-11-08T19:24:17.113407+0000","last_became_active":"2023-11-08T19:24:16.121224+0000","last_became_peered":"2023-11-08T19:24:16.121224+0000","last_unstale":"2023-11-08T19:24:17.113407+0000","last_undegraded":"2023-11-08T19:24:17.113407+0000","last_fullsized":"2023-11-08T19:24:17.113407+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:15.096674+0000","last_clean_scrub_stamp":"2023-11-08T19:24:15.096674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:09:19.268418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":180,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-08T19:24:17.116039+0000","last_change":"2023-11-08T19:22:58.054283+0000","last_active":"2023-11-08T19:24:17.116039+0000","last_peered":"2023-11-08T19:24:17.116039+0000","last_clean":"2023-11-08T19:24:17.116039+0000","last_became_active":"2023-11-08T19:22:58.053337+0000","last_became_peered":"2023-11-08T19:22:58.053337+0000","last_unstale":"2023-11-08T19:24:17.116039+0000","last_undegraded":"2023-11-08T19:24:17.116039+0000","last_fullsized":"2023-11-08T19:24:17.116039+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:22:56.479654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:22:56.479654+0000","last_clean_scrub_stamp":"2023-11-08T19:22:56.479654+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:16:05.317001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28056,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343784,"statfs":{"total":96636764160,"available":96608034816,"internally_reserved":0,"allocated":1060864,"data_stored":786161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.496}]},{"osd":1,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.41799999999999998}]},{"osd":2,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.38500000000000001}]},{"osd":3,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.54300000000000004}]},{"osd":4,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.44500000000000001}]},{"osd":5,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.55900000000000005}]},{"osd":6,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.623}]}]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":194693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.53500000000000003}]},{"osd":1,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.64300000000000002}]},{"osd":2,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.435},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.46000000000000002}]},{"osd":3,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":0.55500000000000005}]},{"osd":4,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.61399999999999999}]},{"osd":5,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.504},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.57199999999999995}]},{"osd":7,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.58599999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":454656,"data_stored":194201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":2.1850000000000001,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":0.39200000000000002}]},{"osd":2,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.29199999999999998}]},{"osd":3,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.378},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":2.2120000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.43099999999999999}]},{"osd":4,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.745},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.64600000000000002}]},{"osd":5,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.60499999999999998}]},{"osd":6,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":2.093,"5min":2.093,"15min":2.093},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.67000000000000004}]},{"osd":7,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":0.63},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":2.1299999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.68700000000000006}]}]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28044,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343796,"statfs":{"total":96636764160,"available":96608047104,"internally_reserved":0,"allocated":1048576,"data_stored":784513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":19.295999999999999,"5min":19.295999999999999,"15min":19.295999999999999},"last":0.29399999999999998},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":17.204000000000001,"5min":17.204000000000001,"15min":17.204000000000001},"last":0.42599999999999999}]},{"osd":2,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":6.524,"5min":6.524,"15min":6.524},"last":0.45200000000000001},{"interface":"front","average":{"1min":1.169,"5min":1.169,"15min":1.169},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":17.175000000000001,"5min":17.175000000000001,"15min":17.175000000000001},"last":0.36199999999999999}]},{"osd":3,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":14.324,"5min":14.324,"15min":14.324},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.39900000000000002}]},{"osd":4,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.304,"15min":1.304},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":17.056000000000001,"5min":17.056000000000001,"15min":17.056000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":5.0289999999999999,"5min":5.0289999999999999,"15min":5.0289999999999999},"last":0.54400000000000004}]},{"osd":5,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":5.0590000000000002,"5min":5.0590000000000002,"15min":5.0590000000000002},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.52800000000000002}]},{"osd":6,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.60999999999999999},{"interface":"front","average":{"1min":1.357,"5min":1.357,"15min":1.357},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":17.111999999999998,"5min":17.111999999999998,"15min":17.111999999999998},"last":0.56100000000000005}]},{"osd":7,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.371,"15min":1.371},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":17.146000000000001,"5min":17.146000000000001,"15min":17.146000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":4.9829999999999997,"5min":4.9829999999999997,"15min":4.9829999999999997},"last":0.47099999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":194181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":3.4100000000000001,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":3.4369999999999998,"5min":3.4369999999999998,"15min":3.4369999999999998},"last":0.23999999999999999}]},{"osd":1,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":4.0679999999999996,"5min":4.0679999999999996,"15min":4.0679999999999996},"last":0.31},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":4.3499999999999996,"5min":4.3499999999999996,"15min":4.3499999999999996},"last":0.33900000000000002}]},{"osd":3,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":3.8580000000000001,"5min":3.8580000000000001,"15min":3.8580000000000001},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":3.476,"5min":3.476,"15min":3.476},"last":0.27600000000000002}]},{"osd":4,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":4.0090000000000003,"5min":4.0090000000000003,"15min":4.0090000000000003},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":4.1040000000000001,"5min":4.1040000000000001,"15min":4.1040000000000001},"last":0.70799999999999996}]},{"osd":5,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":4.0869999999999997,"5min":4.0869999999999997,"15min":4.0869999999999997},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":3.843,"5min":3.843,"15min":3.843},"last":0.63600000000000001}]},{"osd":6,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":4.1399999999999997,"5min":4.1399999999999997,"15min":4.1399999999999997},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":4.0499999999999998,"5min":4.0499999999999998,"15min":4.0499999999999998},"last":0.53200000000000003}]},{"osd":7,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":4.157,"5min":4.157,"15min":4.157},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":4.1710000000000003,"5min":4.1710000000000003,"15min":4.1710000000000003},"last":0.58499999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":195757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.46100000000000002}]},{"osd":1,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.51800000000000002}]},{"osd":2,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.48799999999999999}]},{"osd":4,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.752}]},{"osd":5,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.61299999999999999}]},{"osd":6,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.78700000000000003}]},{"osd":7,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.71499999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":458752,"data_stored":194715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.627},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":2.2090000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.56399999999999995}]},{"osd":1,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.495},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.46700000000000003}]},{"osd":2,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":2.8490000000000002,"5min":2.8490000000000002,"15min":2.8490000000000002},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.44400000000000001}]},{"osd":3,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":3.4849999999999999,"5min":3.4849999999999999,"15min":3.4849999999999999},"last":0.69699999999999995}]},{"osd":5,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.54400000000000004}]},{"osd":6,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":4.1529999999999996,"5min":4.1529999999999996,"15min":4.1529999999999996},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.65800000000000003}]},{"osd":7,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":5.5359999999999996,"5min":5.5359999999999996,"15min":5.5359999999999996},"last":0.74299999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":458752,"data_stored":194223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.56699999999999995}]},{"osd":1,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":2.2919999999999998,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":0.66300000000000003}]},{"osd":2,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.622},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.59199999999999997}]},{"osd":3,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.70799999999999996}]},{"osd":4,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":2.3300000000000001,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.73899999999999999}]},{"osd":6,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":2.3650000000000002,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":0.754}]},{"osd":7,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.79500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:24:26.531 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-08T19:24:26.531 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-08T19:24:26.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.691+0000 7f3db2c8f700 1 Processor -- start 2023-11-08T19:24:26.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.691+0000 7f3db2c8f700 1 -- start start 2023-11-08T19:24:26.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.692+0000 7f3db2c8f700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3dac15e0f0 0x7f3dac0d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:26.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.692+0000 7f3db2c8f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3dac0cf2e0 0x7f3dac15a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:26.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.692+0000 7f3db2c8f700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dac15c340 con 0x7f3dac0af5b0 2023-11-08T19:24:26.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.692+0000 7f3db2c8f700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dac15b1e0 con 0x7f3dac15e0f0 2023-11-08T19:24:26.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.692+0000 7f3db2c8f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dac15b4c0 con 0x7f3dac0cf2e0 2023-11-08T19:24:26.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.692+0000 7f3db0a2b700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3dac15e0f0 0x7f3dac0d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:26.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.692+0000 7f3db0a2b700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3dac15e0f0 0x7f3dac0d0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39440/0 (socket says 172.21.15.149:39440) 2023-11-08T19:24:26.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.692+0000 7f3db0a2b700 1 -- 172.21.15.149:0/1565835647 learned_addr learned my addr 172.21.15.149:0/1565835647 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:26.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.692+0000 7f3db122c700 1 --2- 172.21.15.149:0/1565835647 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3dac0cf2e0 0x7f3dac15a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:26.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.692+0000 7f3db0a2b700 1 -- 172.21.15.149:0/1565835647 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3dac0cf2e0 msgr2=0x7f3dac15a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:26.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.692+0000 7f3db0a2b700 1 --2- 172.21.15.149:0/1565835647 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3dac0cf2e0 0x7f3dac15a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:26.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.693+0000 7f3db0a2b700 1 -- 172.21.15.149:0/1565835647 >> v1:172.21.15.160:6789/0 conn(0x7f3dac0af5b0 legacy=0x7f3dac0cebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:26.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.693+0000 7f3db0a2b700 1 -- 172.21.15.149:0/1565835647 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dac15b7a0 con 0x7f3dac15e0f0 2023-11-08T19:24:26.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.693+0000 7f3db0a2b700 1 --2- 172.21.15.149:0/1565835647 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3dac15e0f0 0x7f3dac0d0f20 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f3da0006fd0 tx=0x7f3da000be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4efc0ead50605e45 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:26.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.693+0000 7f3dab7fe700 1 -- 172.21.15.149:0/1565835647 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da0005e30 con 0x7f3dac15e0f0 2023-11-08T19:24:26.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.693+0000 7f3dab7fe700 1 -- 172.21.15.149:0/1565835647 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3da0004030 con 0x7f3dac15e0f0 2023-11-08T19:24:26.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.693+0000 7f3dab7fe700 1 -- 172.21.15.149:0/1565835647 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da00043e0 con 0x7f3dac15e0f0 2023-11-08T19:24:26.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.693+0000 7f3db2c8f700 1 -- 172.21.15.149:0/1565835647 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3dac15e0f0 msgr2=0x7f3dac0d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:26.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.693+0000 7f3db2c8f700 1 --2- 172.21.15.149:0/1565835647 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3dac15e0f0 0x7f3dac0d0f20 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f3da0006fd0 tx=0x7f3da000be70 comp rx=0 tx=0).stop 2023-11-08T19:24:26.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.693+0000 7f3db2c8f700 1 -- 172.21.15.149:0/1565835647 shutdown_connections 2023-11-08T19:24:26.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.693+0000 7f3db2c8f700 1 --2- 172.21.15.149:0/1565835647 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3dac0cf2e0 0x7f3dac15a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:26.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.693+0000 7f3db2c8f700 1 --2- 172.21.15.149:0/1565835647 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3dac15e0f0 0x7f3dac0d0f20 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:26.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.693+0000 7f3db2c8f700 1 -- 172.21.15.149:0/1565835647 >> 172.21.15.149:0/1565835647 conn(0x7f3dac099a40 msgr2=0x7f3dac0d05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:26.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.693+0000 7f3db2c8f700 1 -- 172.21.15.149:0/1565835647 shutdown_connections 2023-11-08T19:24:26.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.693+0000 7f3db2c8f700 1 -- 172.21.15.149:0/1565835647 wait complete. 2023-11-08T19:24:26.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.695+0000 7f3db2c8f700 1 Processor -- start 2023-11-08T19:24:26.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.695+0000 7f3db2c8f700 1 -- start start 2023-11-08T19:24:26.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.695+0000 7f3db2c8f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3dac0af5b0 0x7f3dac156d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:26.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.695+0000 7f3db2c8f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3dac0cf2e0 0x7f3dac0c6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:26.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.695+0000 7f3db2c8f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3dac15e0f0 0x7f3dac146810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:26.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.695+0000 7f3db2c8f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dac0b2880 con 0x7f3dac0af5b0 2023-11-08T19:24:26.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.695+0000 7f3db2c8f700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dac1573a0 con 0x7f3dac0cf2e0 2023-11-08T19:24:26.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.695+0000 7f3db2c8f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dac157680 con 0x7f3dac15e0f0 2023-11-08T19:24:26.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.696+0000 7f3db0a2b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3dac0af5b0 0x7f3dac156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:26.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.696+0000 7f3db0a2b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3dac0af5b0 0x7f3dac156d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39446/0 (socket says 172.21.15.149:39446) 2023-11-08T19:24:26.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.696+0000 7f3db0a2b700 1 -- 172.21.15.149:0/3081521515 learned_addr learned my addr 172.21.15.149:0/3081521515 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:26.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.696+0000 7f3dabfff700 1 --2- 172.21.15.149:0/3081521515 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3dac0cf2e0 0x7f3dac0c6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:26.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.696+0000 7f3db0a2b700 1 -- 172.21.15.149:0/3081521515 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3dac15e0f0 msgr2=0x7f3dac146810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:26.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.696+0000 7f3db122c700 1 --2- 172.21.15.149:0/3081521515 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3dac15e0f0 0x7f3dac146810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:26.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.696+0000 7f3db0a2b700 1 --2- 172.21.15.149:0/3081521515 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3dac15e0f0 0x7f3dac146810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:26.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.696+0000 7f3db0a2b700 1 -- 172.21.15.149:0/3081521515 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3dac0cf2e0 msgr2=0x7f3dac0c6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:26.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.696+0000 7f3db0a2b700 1 --2- 172.21.15.149:0/3081521515 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3dac0cf2e0 0x7f3dac0c6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:26.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.696+0000 7f3db0a2b700 1 -- 172.21.15.149:0/3081521515 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da000b7a0 con 0x7f3dac0af5b0 2023-11-08T19:24:26.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.696+0000 7f3db0a2b700 1 --2- 172.21.15.149:0/3081521515 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3dac0af5b0 0x7f3dac156d30 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f3da000beb0 tx=0x7f3da0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:26.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.696+0000 7f3da97fa700 1 -- 172.21.15.149:0/3081521515 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da0020070 con 0x7f3dac0af5b0 2023-11-08T19:24:26.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.696+0000 7f3da97fa700 1 -- 172.21.15.149:0/3081521515 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3da00039b0 con 0x7f3dac0af5b0 2023-11-08T19:24:26.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.696+0000 7f3da97fa700 1 -- 172.21.15.149:0/3081521515 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da0003d40 con 0x7f3dac0af5b0 2023-11-08T19:24:26.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.696+0000 7f3db2c8f700 1 -- 172.21.15.149:0/3081521515 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dac157960 con 0x7f3dac0af5b0 2023-11-08T19:24:26.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.696+0000 7f3db2c8f700 1 -- 172.21.15.149:0/3081521515 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dac157c40 con 0x7f3dac0af5b0 2023-11-08T19:24:26.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.697+0000 7f3db2c8f700 1 -- 172.21.15.149:0/3081521515 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dac144a40 con 0x7f3dac0af5b0 2023-11-08T19:24:26.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.698+0000 7f3da97fa700 1 -- 172.21.15.149:0/3081521515 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3da0024410 con 0x7f3dac0af5b0 2023-11-08T19:24:26.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.698+0000 7f3da97fa700 1 --2- 172.21.15.149:0/3081521515 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3d9006af00 0x7f3d9006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:26.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.698+0000 7f3da97fa700 1 -- 172.21.15.149:0/3081521515 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3da008cde0 con 0x7f3dac0af5b0 2023-11-08T19:24:26.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.699+0000 7f3dabfff700 1 --2- 172.21.15.149:0/3081521515 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3d9006af00 0x7f3d9006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:26.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.699+0000 7f3dabfff700 1 --2- 172.21.15.149:0/3081521515 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3d9006af00 0x7f3d9006d3c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3dac0cd050 tx=0x7f3d98009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:26.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.703+0000 7f3da97fa700 1 -- 172.21.15.149:0/3081521515 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3da0057e60 con 0x7f3dac0af5b0 2023-11-08T19:24:26.974 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.972+0000 7f3db2c8f700 1 -- 172.21.15.149:0/3081521515 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f3dac04f730 con 0x7f3dac0af5b0 2023-11-08T19:24:26.976 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.974+0000 7f3da97fa700 1 -- 172.21.15.149:0/3081521515 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+147 (secure 0 0 0) 0x7f3da00290e0 con 0x7f3dac0af5b0 2023-11-08T19:24:26.976 INFO:teuthology.orchestra.run.smithi149.stdout:[client.0] 2023-11-08T19:24:26.977 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDi30tlQEEsNxAAiPozrOREh+IJXoj7ZkhvLg== 2023-11-08T19:24:26.977 INFO:teuthology.orchestra.run.smithi149.stdout: caps mds = "allow" 2023-11-08T19:24:26.977 INFO:teuthology.orchestra.run.smithi149.stdout: caps mon = "allow r" 2023-11-08T19:24:26.977 INFO:teuthology.orchestra.run.smithi149.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-08T19:24:26.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.977+0000 7f3db2c8f700 1 -- 172.21.15.149:0/3081521515 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3d9006af00 msgr2=0x7f3d9006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:26.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.977+0000 7f3db2c8f700 1 --2- 172.21.15.149:0/3081521515 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3d9006af00 0x7f3d9006d3c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3dac0cd050 tx=0x7f3d98009040 comp rx=0 tx=0).stop 2023-11-08T19:24:26.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.977+0000 7f3db2c8f700 1 -- 172.21.15.149:0/3081521515 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3dac0af5b0 msgr2=0x7f3dac156d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:26.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.977+0000 7f3db2c8f700 1 --2- 172.21.15.149:0/3081521515 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3dac0af5b0 0x7f3dac156d30 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f3da000beb0 tx=0x7f3da0004750 comp rx=0 tx=0).stop 2023-11-08T19:24:26.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.977+0000 7f3db2c8f700 1 -- 172.21.15.149:0/3081521515 shutdown_connections 2023-11-08T19:24:26.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.977+0000 7f3db2c8f700 1 --2- 172.21.15.149:0/3081521515 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3d9006af00 0x7f3d9006d3c0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:26.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.977+0000 7f3db2c8f700 1 --2- 172.21.15.149:0/3081521515 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3dac15e0f0 0x7f3dac146810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:26.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.977+0000 7f3db2c8f700 1 --2- 172.21.15.149:0/3081521515 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3dac0af5b0 0x7f3dac156d30 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:26.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.977+0000 7f3db2c8f700 1 --2- 172.21.15.149:0/3081521515 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3dac0cf2e0 0x7f3dac0c6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:26.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.977+0000 7f3db2c8f700 1 -- 172.21.15.149:0/3081521515 >> 172.21.15.149:0/3081521515 conn(0x7f3dac099a40 msgr2=0x7f3dac158d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:26.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.977+0000 7f3db2c8f700 1 -- 172.21.15.149:0/3081521515 shutdown_connections 2023-11-08T19:24:26.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:26.977+0000 7f3db2c8f700 1 -- 172.21.15.149:0/3081521515 wait complete. 2023-11-08T19:24:26.982 INFO:teuthology.orchestra.run.smithi149.stderr:updated caps for client.0 2023-11-08T19:24:26.991 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:24:27.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.111+0000 7f772a510700 1 Processor -- start 2023-11-08T19:24:27.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.111+0000 7f772a510700 1 -- start start 2023-11-08T19:24:27.116 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.111+0000 7f772a510700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f772406f7e0 0x7f77240cfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:27.116 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.111+0000 7f772a510700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7724072df0 con 0x7f772415a780 2023-11-08T19:24:27.116 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.111+0000 7f772a510700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7724070660 con 0x7f77240b1ff0 2023-11-08T19:24:27.116 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.111+0000 7f772a510700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f772406fdc0 con 0x7f772406f7e0 2023-11-08T19:24:27.117 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.112+0000 7f7723fff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f772415a780 0x7f772415ea10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:41456/0 (socket says 172.21.15.149:41456) 2023-11-08T19:24:27.117 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.112+0000 7f7723fff700 1 -- 172.21.15.149:0/1483185869 learned_addr learned my addr 172.21.15.149:0/1483185869 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:24:27.117 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.112+0000 7f77237fe700 1 --2- 172.21.15.149:0/1483185869 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f772406f7e0 0x7f77240cfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:27.118 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.112+0000 7f7722ffd700 1 -- 172.21.15.149:0/1483185869 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 850148746 0 0) 0x7f7724072df0 con 0x7f772415a780 2023-11-08T19:24:27.118 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.112+0000 7f7722ffd700 1 -- 172.21.15.149:0/1483185869 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77100035b0 con 0x7f772415a780 2023-11-08T19:24:27.118 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.112+0000 7f7722ffd700 1 -- 172.21.15.149:0/1483185869 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4269817573 0 0) 0x7f7724070660 con 0x7f77240b1ff0 2023-11-08T19:24:27.118 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.112+0000 7f7722ffd700 1 -- 172.21.15.149:0/1483185869 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7724072df0 con 0x7f77240b1ff0 2023-11-08T19:24:27.118 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.112+0000 7f77237fe700 1 -- 172.21.15.149:0/1483185869 >> v1:172.21.15.160:6789/0 conn(0x7f77240b1ff0 legacy=0x7f77240cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:27.119 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.112+0000 7f77237fe700 1 -- 172.21.15.149:0/1483185869 >> v1:172.21.15.149:6789/0 conn(0x7f772415a780 legacy=0x7f772415ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:27.119 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.112+0000 7f77237fe700 1 -- 172.21.15.149:0/1483185869 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77240700a0 con 0x7f772406f7e0 2023-11-08T19:24:27.119 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.112+0000 7f77237fe700 1 --2- 172.21.15.149:0/1483185869 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f772406f7e0 0x7f77240cfce0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7714009870 tx=0x7f7714009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f9560d451bc860a server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:27.119 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.112+0000 7f7722ffd700 1 -- 172.21.15.149:0/1483185869 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7714011830 con 0x7f772406f7e0 2023-11-08T19:24:27.119 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.112+0000 7f7722ffd700 1 -- 172.21.15.149:0/1483185869 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7714011990 con 0x7f772406f7e0 2023-11-08T19:24:27.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.112+0000 7f7722ffd700 1 -- 172.21.15.149:0/1483185869 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7714011d20 con 0x7f772406f7e0 2023-11-08T19:24:27.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.113+0000 7f772a510700 1 -- 172.21.15.149:0/1483185869 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f772406f7e0 msgr2=0x7f77240cfce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:27.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.113+0000 7f772a510700 1 --2- 172.21.15.149:0/1483185869 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f772406f7e0 0x7f77240cfce0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7714009870 tx=0x7f7714009b80 comp rx=0 tx=0).stop 2023-11-08T19:24:27.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.113+0000 7f772a510700 1 -- 172.21.15.149:0/1483185869 shutdown_connections 2023-11-08T19:24:27.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.113+0000 7f772a510700 1 --2- 172.21.15.149:0/1483185869 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f772406f7e0 0x7f77240cfce0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:27.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.113+0000 7f772a510700 1 -- 172.21.15.149:0/1483185869 >> 172.21.15.149:0/1483185869 conn(0x7f77240ccff0 msgr2=0x7f77240cd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:27.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.113+0000 7f772a510700 1 -- 172.21.15.149:0/1483185869 shutdown_connections 2023-11-08T19:24:27.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.113+0000 7f772a510700 1 -- 172.21.15.149:0/1483185869 wait complete. 2023-11-08T19:24:27.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.114+0000 7f772a510700 1 Processor -- start 2023-11-08T19:24:27.124 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.114+0000 7f772a510700 1 -- start start 2023-11-08T19:24:27.125 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.115+0000 7f772a510700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f772406f7e0 0x7f77240c6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:27.125 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.115+0000 7f772a510700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f77240b1ff0 0x7f77241502c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:27.125 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.115+0000 7f772a510700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f772415a780 0x7f772406ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:27.125 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.115+0000 7f772a510700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77240c6d50 con 0x7f772406f7e0 2023-11-08T19:24:27.126 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.115+0000 7f772a510700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77240c6a70 con 0x7f772415a780 2023-11-08T19:24:27.126 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.115+0000 7f772a510700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f772414f800 con 0x7f77240b1ff0 2023-11-08T19:24:27.126 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.115+0000 7f7723fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f772406f7e0 0x7f77240c6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:27.126 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.115+0000 7f7723fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f772406f7e0 0x7f77240c6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39460/0 (socket says 172.21.15.149:39460) 2023-11-08T19:24:27.126 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.115+0000 7f7723fff700 1 -- 172.21.15.149:0/1857169893 learned_addr learned my addr 172.21.15.149:0/1857169893 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:27.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.115+0000 7f77237fe700 1 --2- 172.21.15.149:0/1857169893 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f77240b1ff0 0x7f77241502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:27.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.115+0000 7f7728aad700 1 --2- 172.21.15.149:0/1857169893 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f772415a780 0x7f772406ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:27.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.115+0000 7f7723fff700 1 -- 172.21.15.149:0/1857169893 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f77240b1ff0 msgr2=0x7f77241502c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:27.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.115+0000 7f7723fff700 1 --2- 172.21.15.149:0/1857169893 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f77240b1ff0 0x7f77241502c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:27.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.116+0000 7f7723fff700 1 -- 172.21.15.149:0/1857169893 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f772415a780 msgr2=0x7f772406ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:27.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.116+0000 7f7723fff700 1 --2- 172.21.15.149:0/1857169893 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f772415a780 0x7f772406ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:27.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.116+0000 7f7723fff700 1 -- 172.21.15.149:0/1857169893 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77140094a0 con 0x7f772406f7e0 2023-11-08T19:24:27.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.116+0000 7f7723fff700 1 --2- 172.21.15.149:0/1857169893 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f772406f7e0 0x7f77240c6440 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f770c001eb0 tx=0x7f770c00c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:27.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.116+0000 7f7720ff9700 1 -- 172.21.15.149:0/1857169893 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770c005d70 con 0x7f772406f7e0 2023-11-08T19:24:27.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.116+0000 7f7720ff9700 1 -- 172.21.15.149:0/1857169893 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f770c0070d0 con 0x7f772406f7e0 2023-11-08T19:24:27.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.116+0000 7f772a510700 1 -- 172.21.15.149:0/1857169893 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f772414fae0 con 0x7f772406f7e0 2023-11-08T19:24:27.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.116+0000 7f7720ff9700 1 -- 172.21.15.149:0/1857169893 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770c007460 con 0x7f772406f7e0 2023-11-08T19:24:27.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.116+0000 7f772a510700 1 -- 172.21.15.149:0/1857169893 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7724150800 con 0x7f772406f7e0 2023-11-08T19:24:27.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.117+0000 7f772a510700 1 -- 172.21.15.149:0/1857169893 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77240745f0 con 0x7f772406f7e0 2023-11-08T19:24:27.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.117+0000 7f7720ff9700 1 -- 172.21.15.149:0/1857169893 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f770c0075c0 con 0x7f772406f7e0 2023-11-08T19:24:27.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.118+0000 7f7720ff9700 1 --2- 172.21.15.149:0/1857169893 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f770406af00 0x7f770406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:27.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.118+0000 7f7720ff9700 1 -- 172.21.15.149:0/1857169893 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f770c088c20 con 0x7f772406f7e0 2023-11-08T19:24:27.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.118+0000 7f77237fe700 1 --2- 172.21.15.149:0/1857169893 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f770406af00 0x7f770406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:27.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.118+0000 7f77237fe700 1 --2- 172.21.15.149:0/1857169893 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f770406af00 0x7f770406d3c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f77140097c0 tx=0x7f771401c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:27.131 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.122+0000 7f7720ff9700 1 -- 172.21.15.149:0/1857169893 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f770c053a80 con 0x7f772406f7e0 2023-11-08T19:24:27.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.360+0000 7f772a510700 1 -- 172.21.15.149:0/1857169893 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f77240ceda0 con 0x7f772406f7e0 2023-11-08T19:24:27.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.360+0000 7f7720ff9700 1 -- 172.21.15.149:0/1857169893 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4922 (secure 0 0 0) 0x7f770c0570a0 con 0x7f772406f7e0 2023-11-08T19:24:27.363 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:24:27.363 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4877,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/3602590195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3602590195},{"type":"v1","addr":"172.21.15.160:6834","nonce":3602590195}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5107,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/1432406788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":1432406788},{"type":"v1","addr":"172.21.15.160:6835","nonce":1432406788}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5125,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/3066975859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3066975859},{"type":"v1","addr":"172.21.15.149:6837","nonce":3066975859}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-08T19:24:16.502193+0000","modified":"2023-11-08T19:24:19.886052+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5259":{"gid":5259,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.149:6836/746083826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":746083826},{"type":"v1","addr":"172.21.15.149:6836","nonce":746083826}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-08T19:24:27.365 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.362+0000 7f772a510700 1 -- 172.21.15.149:0/1857169893 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f770406af00 msgr2=0x7f770406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:27.365 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.362+0000 7f772a510700 1 --2- 172.21.15.149:0/1857169893 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f770406af00 0x7f770406d3c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f77140097c0 tx=0x7f771401c040 comp rx=0 tx=0).stop 2023-11-08T19:24:27.365 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.362+0000 7f772a510700 1 -- 172.21.15.149:0/1857169893 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f772406f7e0 msgr2=0x7f77240c6440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:27.365 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.362+0000 7f772a510700 1 --2- 172.21.15.149:0/1857169893 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f772406f7e0 0x7f77240c6440 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f770c001eb0 tx=0x7f770c00c7b0 comp rx=0 tx=0).stop 2023-11-08T19:24:27.366 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.363+0000 7f772a510700 1 -- 172.21.15.149:0/1857169893 shutdown_connections 2023-11-08T19:24:27.366 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.363+0000 7f772a510700 1 --2- 172.21.15.149:0/1857169893 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f770406af00 0x7f770406d3c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:27.366 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.363+0000 7f772a510700 1 --2- 172.21.15.149:0/1857169893 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f772415a780 0x7f772406ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:27.366 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.363+0000 7f772a510700 1 --2- 172.21.15.149:0/1857169893 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f772406f7e0 0x7f77240c6440 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:27.367 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.363+0000 7f772a510700 1 --2- 172.21.15.149:0/1857169893 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f77240b1ff0 0x7f77241502c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:27.367 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.363+0000 7f772a510700 1 -- 172.21.15.149:0/1857169893 >> 172.21.15.149:0/1857169893 conn(0x7f77240ccff0 msgr2=0x7f77240ce590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:27.367 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.363+0000 7f772a510700 1 -- 172.21.15.149:0/1857169893 shutdown_connections 2023-11-08T19:24:27.367 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.363+0000 7f772a510700 1 -- 172.21.15.149:0/1857169893 wait complete. 2023-11-08T19:24:27.368 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 17 2023-11-08T19:24:27.779 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-08T19:24:16.502193+0000', 'modified': '2023-11-08T19:24:19.886052+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5259}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5259': {'gid': 5259, 'name': 'a', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.149:6836/746083826', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6834', 'nonce': 746083826}, {'type': 'v1', 'addr': '172.21.15.149:6836', 'nonce': 746083826}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-08T19:24:27.780 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-08T19:24:27.780 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-08T19:24:27.906 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.903+0000 7fb22b0d9700 1 Processor -- start 2023-11-08T19:24:27.906 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.904+0000 7fb22b0d9700 1 -- start start 2023-11-08T19:24:27.908 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.904+0000 7fb22b0d9700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fb22415dc30 0x7fb22406f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:27.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.904+0000 7fb22b0d9700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb2240d2060 0x7fb22406f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:27.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.904+0000 7fb22b0d9700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2240700c0 con 0x7fb22406fc70 2023-11-08T19:24:27.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.904+0000 7fb22b0d9700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb22406bd50 con 0x7fb2240d2060 2023-11-08T19:24:27.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.904+0000 7fb22b0d9700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2240d04b0 con 0x7fb22415dc30 2023-11-08T19:24:27.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.905+0000 7fb223fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb2240d2060 0x7fb22406f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:27.910 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.905+0000 7fb229676700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fb22406fc70 0x7fb224161790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:41474/0 (socket says 172.21.15.149:41474) 2023-11-08T19:24:27.910 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.905+0000 7fb229676700 1 -- 172.21.15.149:0/1163710947 learned_addr learned my addr 172.21.15.149:0/1163710947 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:24:27.910 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.905+0000 7fb223fff700 1 -- 172.21.15.149:0/1163710947 >> v2:172.21.15.160:3300/0 conn(0x7fb22415dc30 msgr2=0x7fb22406f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:27.910 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.905+0000 7fb228e75700 1 --2- 172.21.15.149:0/1163710947 >> v2:172.21.15.160:3300/0 conn(0x7fb22415dc30 0x7fb22406f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:27.911 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.905+0000 7fb223fff700 1 --2- 172.21.15.149:0/1163710947 >> v2:172.21.15.160:3300/0 conn(0x7fb22415dc30 0x7fb22406f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:27.911 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.905+0000 7fb2237fe700 1 -- 172.21.15.149:0/1163710947 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2785273009 0 0) 0x7fb21c001490 con 0x7fb22406fc70 2023-11-08T19:24:27.911 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.905+0000 7fb223fff700 1 -- 172.21.15.149:0/1163710947 >> v1:172.21.15.149:6789/0 conn(0x7fb22406fc70 legacy=0x7fb224161790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:27.911 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.905+0000 7fb223fff700 1 -- 172.21.15.149:0/1163710947 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2240d24f0 con 0x7fb2240d2060 2023-11-08T19:24:27.911 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.905+0000 7fb228e75700 1 --2- 172.21.15.149:0/1163710947 >> v2:172.21.15.160:3300/0 conn(0x7fb22415dc30 0x7fb22406f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:24:27.912 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.905+0000 7fb223fff700 1 --2- 172.21.15.149:0/1163710947 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2240d2060 0x7fb22406f730 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fb210009840 tx=0x7fb210009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e91dde36ab5be082 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:27.912 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.905+0000 7fb2237fe700 1 -- 172.21.15.149:0/1163710947 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb210011830 con 0x7fb2240d2060 2023-11-08T19:24:27.912 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.905+0000 7fb2237fe700 1 -- 172.21.15.149:0/1163710947 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb210011990 con 0x7fb2240d2060 2023-11-08T19:24:27.912 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.905+0000 7fb2237fe700 1 -- 172.21.15.149:0/1163710947 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb210011d20 con 0x7fb2240d2060 2023-11-08T19:24:27.912 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.906+0000 7fb22b0d9700 1 -- 172.21.15.149:0/1163710947 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2240d2060 msgr2=0x7fb22406f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:27.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.906+0000 7fb22b0d9700 1 --2- 172.21.15.149:0/1163710947 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2240d2060 0x7fb22406f730 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fb210009840 tx=0x7fb210009b50 comp rx=0 tx=0).stop 2023-11-08T19:24:27.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.906+0000 7fb22b0d9700 1 -- 172.21.15.149:0/1163710947 shutdown_connections 2023-11-08T19:24:27.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.906+0000 7fb22b0d9700 1 --2- 172.21.15.149:0/1163710947 >> v2:172.21.15.160:3300/0 conn(0x7fb22415dc30 0x7fb22406f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:27.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.906+0000 7fb22b0d9700 1 --2- 172.21.15.149:0/1163710947 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2240d2060 0x7fb22406f730 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:27.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.906+0000 7fb22b0d9700 1 -- 172.21.15.149:0/1163710947 >> 172.21.15.149:0/1163710947 conn(0x7fb22408afd0 msgr2=0x7fb2240d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:27.914 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.906+0000 7fb22b0d9700 1 -- 172.21.15.149:0/1163710947 shutdown_connections 2023-11-08T19:24:27.914 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.906+0000 7fb22b0d9700 1 -- 172.21.15.149:0/1163710947 wait complete. 2023-11-08T19:24:27.923 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.907+0000 7fb22b0d9700 1 Processor -- start 2023-11-08T19:24:27.923 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.907+0000 7fb22b0d9700 1 -- start start 2023-11-08T19:24:27.923 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.908+0000 7fb22b0d9700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb22406fc70 0x7fb224151e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:27.924 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.908+0000 7fb22b0d9700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2240d2060 0x7fb2240afbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:27.924 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.908+0000 7fb22b0d9700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb22415dc30 0x7fb2240b00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:27.924 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.908+0000 7fb22b0d9700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2240b6130 con 0x7fb2240d2060 2023-11-08T19:24:27.924 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.908+0000 7fb22b0d9700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2240b5090 con 0x7fb22415dc30 2023-11-08T19:24:27.924 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.908+0000 7fb22b0d9700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2240b5370 con 0x7fb22406fc70 2023-11-08T19:24:27.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.908+0000 7fb223fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2240d2060 0x7fb2240afbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:27.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.908+0000 7fb223fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2240d2060 0x7fb2240afbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39476/0 (socket says 172.21.15.149:39476) 2023-11-08T19:24:27.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.908+0000 7fb223fff700 1 -- 172.21.15.149:0/3159695188 learned_addr learned my addr 172.21.15.149:0/3159695188 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:27.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.908+0000 7fb229676700 1 --2- 172.21.15.149:0/3159695188 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb22415dc30 0x7fb2240b00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:27.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.908+0000 7fb228e75700 1 --2- 172.21.15.149:0/3159695188 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb22406fc70 0x7fb224151e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:27.926 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.908+0000 7fb223fff700 1 -- 172.21.15.149:0/3159695188 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb22406fc70 msgr2=0x7fb224151e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:27.926 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.908+0000 7fb223fff700 1 --2- 172.21.15.149:0/3159695188 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb22406fc70 0x7fb224151e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:27.926 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.908+0000 7fb223fff700 1 -- 172.21.15.149:0/3159695188 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb22415dc30 msgr2=0x7fb2240b00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:27.926 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.908+0000 7fb223fff700 1 --2- 172.21.15.149:0/3159695188 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb22415dc30 0x7fb2240b00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:27.926 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.908+0000 7fb223fff700 1 -- 172.21.15.149:0/3159695188 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2100094a0 con 0x7fb2240d2060 2023-11-08T19:24:27.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.908+0000 7fb228e75700 1 --2- 172.21.15.149:0/3159695188 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb22406fc70 0x7fb224151e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:24:27.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.908+0000 7fb223fff700 1 --2- 172.21.15.149:0/3159695188 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2240d2060 0x7fb2240afbb0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fb210014040 tx=0x7fb210004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:27.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.909+0000 7fb2217fa700 1 -- 172.21.15.149:0/3159695188 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21001abc0 con 0x7fb2240d2060 2023-11-08T19:24:27.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.909+0000 7fb2217fa700 1 -- 172.21.15.149:0/3159695188 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb21001ad20 con 0x7fb2240d2060 2023-11-08T19:24:27.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.909+0000 7fb22b0d9700 1 -- 172.21.15.149:0/3159695188 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2240b5650 con 0x7fb2240d2060 2023-11-08T19:24:27.928 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.909+0000 7fb2217fa700 1 -- 172.21.15.149:0/3159695188 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb210024610 con 0x7fb2240d2060 2023-11-08T19:24:27.928 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.909+0000 7fb22b0d9700 1 -- 172.21.15.149:0/3159695188 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2240b5c10 con 0x7fb2240d2060 2023-11-08T19:24:27.928 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.910+0000 7fb2217fa700 1 -- 172.21.15.149:0/3159695188 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb21002d450 con 0x7fb2240d2060 2023-11-08T19:24:27.928 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.911+0000 7fb2217fa700 1 --2- 172.21.15.149:0/3159695188 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb20806af00 0x7fb20806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:27.928 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.911+0000 7fb2217fa700 1 -- 172.21.15.149:0/3159695188 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb21008add0 con 0x7fb2240d2060 2023-11-08T19:24:27.929 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.911+0000 7fb228e75700 1 --2- 172.21.15.149:0/3159695188 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb20806af00 0x7fb20806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:27.929 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.911+0000 7fb228e75700 1 --2- 172.21.15.149:0/3159695188 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb20806af00 0x7fb20806d3c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb218006fd0 tx=0x7fb218008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:27.929 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.913+0000 7fb2372d2b80 1 Processor -- start 2023-11-08T19:24:27.929 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.913+0000 7fb2372d2b80 1 -- start start 2023-11-08T19:24:27.929 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.913+0000 7fb2372d2b80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55cbab0ec6f0 0x55cbab11c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:27.930 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.913+0000 7fb2372d2b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cbab0eec30 0x55cbab11c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:27.930 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.913+0000 7fb2372d2b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cbab0ecad0 0x55cbab106f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:27.930 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.913+0000 7fb2372d2b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbab0586e0 con 0x55cbab0ecad0 2023-11-08T19:24:27.930 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.913+0000 7fb2372d2b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbab04c3b0 con 0x55cbab0eec30 2023-11-08T19:24:27.930 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.913+0000 7fb2372d2b80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cbab049cd0 con 0x55cbab0ec6f0 2023-11-08T19:24:27.931 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.913+0000 7fb229676700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cbab0ecad0 0x55cbab106f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:27.931 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.913+0000 7fb229676700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cbab0ecad0 0x55cbab106f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39486/0 (socket says 172.21.15.149:39486) 2023-11-08T19:24:27.931 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.914+0000 7fb229676700 1 -- 172.21.15.149:0/1188622167 learned_addr learned my addr 172.21.15.149:0/1188622167 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:27.931 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.914+0000 7fb223fff700 1 --2- 172.21.15.149:0/1188622167 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cbab0eec30 0x55cbab11c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:27.931 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.914+0000 7fb228e75700 1 --2- 172.21.15.149:0/1188622167 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55cbab0ec6f0 0x55cbab11c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:27.932 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.914+0000 7fb229676700 1 -- 172.21.15.149:0/1188622167 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55cbab0ec6f0 msgr2=0x55cbab11c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:27.932 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.914+0000 7fb229676700 1 --2- 172.21.15.149:0/1188622167 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55cbab0ec6f0 0x55cbab11c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:27.932 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.914+0000 7fb229676700 1 -- 172.21.15.149:0/1188622167 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cbab0eec30 msgr2=0x55cbab11c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:27.932 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.914+0000 7fb229676700 1 --2- 172.21.15.149:0/1188622167 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cbab0eec30 0x55cbab11c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:27.933 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.914+0000 7fb229676700 1 -- 172.21.15.149:0/1188622167 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cbaaec25e0 con 0x55cbab0ecad0 2023-11-08T19:24:27.933 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.914+0000 7fb228e75700 1 --2- 172.21.15.149:0/1188622167 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55cbab0ec6f0 0x55cbab11c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:24:27.933 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.914+0000 7fb229676700 1 --2- 172.21.15.149:0/1188622167 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cbab0ecad0 0x55cbab106f90 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fb21c002110 tx=0x7fb21c007330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37199b1207c4559 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:27.933 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.914+0000 7fb20e7fc700 1 -- 172.21.15.149:0/1188622167 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21c007aa0 con 0x55cbab0ecad0 2023-11-08T19:24:27.933 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.914+0000 7fb20e7fc700 1 -- 172.21.15.149:0/1188622167 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb21c014480 con 0x55cbab0ecad0 2023-11-08T19:24:27.934 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.914+0000 7fb20e7fc700 1 -- 172.21.15.149:0/1188622167 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21c0147f0 con 0x55cbab0ecad0 2023-11-08T19:24:27.934 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.915+0000 7fb2372d2b80 1 -- 172.21.15.149:0/1188622167 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cbab0ecad0 msgr2=0x55cbab106f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:27.934 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.915+0000 7fb2372d2b80 1 --2- 172.21.15.149:0/1188622167 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cbab0ecad0 0x55cbab106f90 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fb21c002110 tx=0x7fb21c007330 comp rx=0 tx=0).stop 2023-11-08T19:24:27.934 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.915+0000 7fb2372d2b80 1 -- 172.21.15.149:0/1188622167 shutdown_connections 2023-11-08T19:24:27.934 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.915+0000 7fb2372d2b80 1 --2- 172.21.15.149:0/1188622167 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cbab0ecad0 0x55cbab106f90 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:27.935 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.915+0000 7fb2372d2b80 1 --2- 172.21.15.149:0/1188622167 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55cbab0ec6f0 0x55cbab11c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:27.935 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.915+0000 7fb2372d2b80 1 --2- 172.21.15.149:0/1188622167 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cbab0eec30 0x55cbab11c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:27.935 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.915+0000 7fb2372d2b80 1 -- 172.21.15.149:0/1188622167 >> 172.21.15.149:0/1188622167 conn(0x55cbab067660 msgr2=0x55cbab0f23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:27.935 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.915+0000 7fb2372d2b80 1 -- 172.21.15.149:0/1188622167 shutdown_connections 2023-11-08T19:24:27.935 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.915+0000 7fb2372d2b80 1 -- 172.21.15.149:0/1188622167 wait complete. 2023-11-08T19:24:27.936 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.915+0000 7fb2372d2b80 1 -- start start 2023-11-08T19:24:27.936 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.916+0000 7fb2372d2b80 1 Processor -- start 2023-11-08T19:24:27.936 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.916+0000 7fb2372d2b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cbab0ec6f0 0x55cbab11ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:27.936 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.916+0000 7fb2372d2b80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55cbab0ecad0 0x55cbab12eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:27.936 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.916+0000 7fb2372d2b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cbab1204b0 0x55cbab0ed420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:27.937 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.916+0000 7fb2372d2b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbab0455c0 con 0x55cbab1204b0 2023-11-08T19:24:27.937 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.916+0000 7fb2372d2b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbaafe10d0 con 0x55cbab0ec6f0 2023-11-08T19:24:27.937 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.916+0000 7fb2372d2b80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cbaafe0d70 con 0x55cbab0ecad0 2023-11-08T19:24:27.937 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.916+0000 7fb2372d2b80 10 client.0 _ll_register_callbacks cb 0x55cbaae3d7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-08T19:24:27.937 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.916+0000 7fb229676700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cbab1204b0 0x55cbab0ed420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:27.938 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.917+0000 7fb229676700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cbab1204b0 0x55cbab0ed420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39492/0 (socket says 172.21.15.149:39492) 2023-11-08T19:24:27.938 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.917+0000 7fb229676700 1 -- 172.21.15.149:0/3316452175 learned_addr learned my addr 172.21.15.149:0/3316452175 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:27.938 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.917+0000 7fb223fff700 1 --2- 172.21.15.149:0/3316452175 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55cbab0ecad0 0x55cbab12eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:27.938 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.917+0000 7fb228e75700 1 --2- 172.21.15.149:0/3316452175 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cbab0ec6f0 0x55cbab11ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:27.938 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.917+0000 7fb229676700 1 -- 172.21.15.149:0/3316452175 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55cbab0ecad0 msgr2=0x55cbab12eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:27.939 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.917+0000 7fb229676700 1 --2- 172.21.15.149:0/3316452175 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55cbab0ecad0 0x55cbab12eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:27.939 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.917+0000 7fb229676700 1 -- 172.21.15.149:0/3316452175 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cbab0ec6f0 msgr2=0x55cbab11ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:27.939 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.917+0000 7fb229676700 1 --2- 172.21.15.149:0/3316452175 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cbab0ec6f0 0x55cbab11ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:27.939 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.917+0000 7fb229676700 1 -- 172.21.15.149:0/3316452175 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb21c00f040 con 0x55cbab1204b0 2023-11-08T19:24:27.939 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.917+0000 7fb228e75700 1 --2- 172.21.15.149:0/3316452175 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cbab0ec6f0 0x55cbab11ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:24:27.940 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.917+0000 7fb229676700 1 --2- 172.21.15.149:0/3316452175 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cbab1204b0 0x55cbab0ed420 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fb21c000f80 tx=0x7fb21c001790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=328b427f5f492e80 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:27.940 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.917+0000 7fb2037fe700 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2023-11-08T19:24:27.940 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.917+0000 7fb2037fe700 1 -- 172.21.15.149:0/3316452175 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21c007aa0 con 0x55cbab1204b0 2023-11-08T19:24:27.940 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.917+0000 7fb2037fe700 1 -- 172.21.15.149:0/3316452175 <== mon.0 v2:172.21.15.149:3300/0 2 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb21c014d10 con 0x55cbab1204b0 2023-11-08T19:24:27.940 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.917+0000 7fb2372d2b80 1 -- 172.21.15.149:0/3316452175 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cbab0e4880 con 0x55cbab1204b0 2023-11-08T19:24:27.941 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.917+0000 7fb2037fe700 1 -- 172.21.15.149:0/3316452175 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb21c001830 con 0x55cbab1204b0 2023-11-08T19:24:27.941 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.917+0000 7fb2372d2b80 10 client.5460 fetch_fsmap learned FSMap version 17 2023-11-08T19:24:27.941 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.917+0000 7fb2372d2b80 1 -- 172.21.15.149:0/3316452175 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55cbaae6ed90 con 0x55cbab1204b0 2023-11-08T19:24:27.941 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.917+0000 7fb2037fe700 1 -- 172.21.15.149:0/3316452175 <== mon.0 v2:172.21.15.149:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cbab0e4880 con 0x55cbab1204b0 2023-11-08T19:24:27.941 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.918+0000 7fb2037fe700 1 -- 172.21.15.149:0/3316452175 <== mon.0 v2:172.21.15.149:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fb21c027440 con 0x55cbab1204b0 2023-11-08T19:24:27.942 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.918+0000 7fb2372d2b80 10 client.5460 fetch_fsmap finished waiting for FSMap version 17 2023-11-08T19:24:27.942 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.918+0000 7fb2372d2b80 10 client.5460 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-08T19:24:27.942 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.918+0000 7fb2372d2b80 20 client.5460 populate_metadata read hostname 'smithi149' 2023-11-08T19:24:27.942 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.918+0000 7fb2372d2b80 1 --2- 172.21.15.149:0/3316452175 >> [v2:172.21.15.149:6834/746083826,v1:172.21.15.149:6836/746083826] conn(0x55cbab1195f0 0x55cbab11b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:27.942 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.918+0000 7fb2372d2b80 4 client.5460 mds_command: new command op to 5259 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-08T19:24:27.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.918+0000 7fb2372d2b80 1 -- 172.21.15.149:0/3316452175 --> [v2:172.21.15.149:6834/746083826,v1:172.21.15.149:6836/746083826] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cbab0c0a30 con 0x55cbab1195f0 2023-11-08T19:24:27.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.918+0000 7fb228e75700 1 --2- 172.21.15.149:0/3316452175 >> [v2:172.21.15.149:6834/746083826,v1:172.21.15.149:6836/746083826] conn(0x55cbab1195f0 0x55cbab11b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:27.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.918+0000 7fb2037fe700 10 client.5460 ms_handle_connect on v2:172.21.15.149:6834/746083826 2023-11-08T19:24:27.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.918+0000 7fb228e75700 1 --2- 172.21.15.149:0/3316452175 >> [v2:172.21.15.149:6834/746083826,v1:172.21.15.149:6836/746083826] conn(0x55cbab1195f0 0x55cbab11b700 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3fbf6a99e0e26334 server_cookie=5aba1551f2b4835d in_seq=0 out_seq=0 2023-11-08T19:24:27.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.919+0000 7fb2037fe700 1 -- 172.21.15.149:0/3316452175 <== mds.0 v2:172.21.15.149:6834/746083826 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55cbab0c0a30 con 0x55cbab1195f0 2023-11-08T19:24:27.944 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.919+0000 7fb2037fe700 10 client.5460 handle_command_reply: tid=0 2023-11-08T19:24:27.944 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.919+0000 7fb2372d2b80 1 client.5460 shutdown 2023-11-08T19:24:27.944 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.919+0000 7fb2372d2b80 1 -- 172.21.15.149:0/3316452175 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cbab1204b0 msgr2=0x55cbab0ed420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:27.944 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.919+0000 7fb2372d2b80 1 --2- 172.21.15.149:0/3316452175 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cbab1204b0 0x55cbab0ed420 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fb21c000f80 tx=0x7fb21c001790 comp rx=0 tx=0).stop 2023-11-08T19:24:27.944 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.919+0000 7fb2372d2b80 1 -- 172.21.15.149:0/3316452175 shutdown_connections 2023-11-08T19:24:27.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.919+0000 7fb2372d2b80 1 --2- 172.21.15.149:0/3316452175 >> [v2:172.21.15.149:6834/746083826,v1:172.21.15.149:6836/746083826] conn(0x55cbab1195f0 0x55cbab11b700 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:27.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.919+0000 7fb2372d2b80 1 --2- 172.21.15.149:0/3316452175 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cbab0ec6f0 0x55cbab11ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:27.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.919+0000 7fb2037fe700 0 client.5460 ms_handle_reset on v2:172.21.15.149:6834/746083826 2023-11-08T19:24:27.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.919+0000 7fb2372d2b80 1 --2- 172.21.15.149:0/3316452175 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cbab1204b0 0x55cbab0ed420 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:27.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.919+0000 7fb2372d2b80 1 --2- 172.21.15.149:0/3316452175 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55cbab0ecad0 0x55cbab12eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:27.946 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.919+0000 7fb2372d2b80 1 -- 172.21.15.149:0/3316452175 >> 172.21.15.149:0/3316452175 conn(0x55cbab067660 msgr2=0x55cbab0ef8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:27.946 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.919+0000 7fb2372d2b80 1 -- 172.21.15.149:0/3316452175 shutdown_connections 2023-11-08T19:24:27.946 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.919+0000 7fb2372d2b80 1 -- 172.21.15.149:0/3316452175 wait complete. 2023-11-08T19:24:27.946 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.919+0000 7fb2372d2b80 20 client.5460 trim_cache size 0 max 16384 2023-11-08T19:24:27.952 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.937+0000 7fb2372d2b80 1 Processor -- start 2023-11-08T19:24:27.953 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.937+0000 7fb2372d2b80 1 -- start start 2023-11-08T19:24:27.953 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.937+0000 7fb2372d2b80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55cbab0ec6f0 0x55cbab1591e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:27.953 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.937+0000 7fb2372d2b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cbab0ecad0 0x55cbab12e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:27.953 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.937+0000 7fb2372d2b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cbab1204b0 0x55cbab0eb500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:27.954 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.937+0000 7fb2372d2b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbaaec48d0 con 0x55cbab0ecad0 2023-11-08T19:24:27.954 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.937+0000 7fb2372d2b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbab119f20 con 0x55cbab1204b0 2023-11-08T19:24:27.954 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.937+0000 7fb2372d2b80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cbab0ef6e0 con 0x55cbab0ec6f0 2023-11-08T19:24:27.954 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.937+0000 7fb223fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cbab0ecad0 0x55cbab12e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:27.954 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.937+0000 7fb223fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cbab0ecad0 0x55cbab12e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39498/0 (socket says 172.21.15.149:39498) 2023-11-08T19:24:27.955 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.937+0000 7fb223fff700 1 -- 172.21.15.149:0/2460175674 learned_addr learned my addr 172.21.15.149:0/2460175674 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:27.955 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.938+0000 7fb228e75700 1 --2- 172.21.15.149:0/2460175674 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55cbab0ec6f0 0x55cbab1591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:27.955 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.938+0000 7fb223fff700 1 -- 172.21.15.149:0/2460175674 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55cbab0ec6f0 msgr2=0x55cbab1591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:27.955 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.938+0000 7fb229676700 1 --2- 172.21.15.149:0/2460175674 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cbab1204b0 0x55cbab0eb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:27.955 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.938+0000 7fb223fff700 1 --2- 172.21.15.149:0/2460175674 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55cbab0ec6f0 0x55cbab1591e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:27.956 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.938+0000 7fb223fff700 1 -- 172.21.15.149:0/2460175674 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cbab1204b0 msgr2=0x55cbab0eb500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:27.956 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.938+0000 7fb223fff700 1 --2- 172.21.15.149:0/2460175674 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cbab1204b0 0x55cbab0eb500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:27.956 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.938+0000 7fb223fff700 1 -- 172.21.15.149:0/2460175674 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cbaae57c10 con 0x55cbab0ecad0 2023-11-08T19:24:27.956 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.938+0000 7fb229676700 1 --2- 172.21.15.149:0/2460175674 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cbab1204b0 0x55cbab0eb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:24:27.956 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.938+0000 7fb228e75700 1 --2- 172.21.15.149:0/2460175674 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55cbab0ec6f0 0x55cbab1591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:24:27.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.938+0000 7fb223fff700 1 --2- 172.21.15.149:0/2460175674 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cbab0ecad0 0x55cbab12e940 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fb2100598b0 tx=0x7fb21001d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d2683506255ef63 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:27.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.938+0000 7fb20effd700 1 -- 172.21.15.149:0/2460175674 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb210055f10 con 0x55cbab0ecad0 2023-11-08T19:24:27.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.938+0000 7fb20effd700 1 -- 172.21.15.149:0/2460175674 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb210071070 con 0x55cbab0ecad0 2023-11-08T19:24:27.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.938+0000 7fb20effd700 1 -- 172.21.15.149:0/2460175674 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb210059bb0 con 0x55cbab0ecad0 2023-11-08T19:24:27.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.938+0000 7fb2372d2b80 1 -- 172.21.15.149:0/2460175674 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cbab0ecad0 msgr2=0x55cbab12e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:27.958 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.938+0000 7fb2372d2b80 1 --2- 172.21.15.149:0/2460175674 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cbab0ecad0 0x55cbab12e940 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fb2100598b0 tx=0x7fb21001d040 comp rx=0 tx=0).stop 2023-11-08T19:24:27.958 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.938+0000 7fb2372d2b80 1 -- 172.21.15.149:0/2460175674 shutdown_connections 2023-11-08T19:24:27.958 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.938+0000 7fb2372d2b80 1 --2- 172.21.15.149:0/2460175674 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cbab1204b0 0x55cbab0eb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:27.958 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.938+0000 7fb2372d2b80 1 --2- 172.21.15.149:0/2460175674 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55cbab0ec6f0 0x55cbab1591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:27.958 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.938+0000 7fb2372d2b80 1 --2- 172.21.15.149:0/2460175674 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cbab0ecad0 0x55cbab12e940 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:27.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.938+0000 7fb2372d2b80 1 -- 172.21.15.149:0/2460175674 >> 172.21.15.149:0/2460175674 conn(0x55cbab067660 msgr2=0x55cbab0e87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:27.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.939+0000 7fb2372d2b80 1 -- 172.21.15.149:0/2460175674 shutdown_connections 2023-11-08T19:24:27.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.939+0000 7fb2372d2b80 1 -- 172.21.15.149:0/2460175674 wait complete. 2023-11-08T19:24:27.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.939+0000 7fb2372d2b80 1 -- start start 2023-11-08T19:24:27.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.939+0000 7fb2372d2b80 1 Processor -- start 2023-11-08T19:24:27.961 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.940+0000 7fb2372d2b80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55cbab0ec6f0 0x55cbab12df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:27.961 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.940+0000 7fb2372d2b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cbab0ecad0 0x55cbab13a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:27.961 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.940+0000 7fb2372d2b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cbab1204b0 0x55cbab107c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:27.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.940+0000 7fb2372d2b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbab138dd0 con 0x55cbab1204b0 2023-11-08T19:24:27.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.940+0000 7fb2372d2b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbab106c70 con 0x55cbab0ecad0 2023-11-08T19:24:27.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.940+0000 7fb2372d2b80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cbab13ac40 con 0x55cbab0ec6f0 2023-11-08T19:24:27.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.940+0000 7fb2372d2b80 10 client.0 _ll_register_callbacks cb 0x7fb21c017070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-08T19:24:27.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.940+0000 7fb229676700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cbab1204b0 0x55cbab107c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:27.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.940+0000 7fb229676700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cbab1204b0 0x55cbab107c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39506/0 (socket says 172.21.15.149:39506) 2023-11-08T19:24:27.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.940+0000 7fb229676700 1 -- 172.21.15.149:0/495378357 learned_addr learned my addr 172.21.15.149:0/495378357 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:27.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.940+0000 7fb223fff700 1 --2- 172.21.15.149:0/495378357 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cbab0ecad0 0x55cbab13a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:27.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.940+0000 7fb228e75700 1 --2- 172.21.15.149:0/495378357 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55cbab0ec6f0 0x55cbab12df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:27.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.940+0000 7fb229676700 1 -- 172.21.15.149:0/495378357 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55cbab0ec6f0 msgr2=0x55cbab12df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:27.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.940+0000 7fb229676700 1 --2- 172.21.15.149:0/495378357 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55cbab0ec6f0 0x55cbab12df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:27.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.940+0000 7fb229676700 1 -- 172.21.15.149:0/495378357 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cbab0ecad0 msgr2=0x55cbab13a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:27.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.940+0000 7fb229676700 1 --2- 172.21.15.149:0/495378357 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cbab0ecad0 0x55cbab13a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:27.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.940+0000 7fb229676700 1 -- 172.21.15.149:0/495378357 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2240b5c10 con 0x55cbab1204b0 2023-11-08T19:24:27.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.940+0000 7fb229676700 1 --2- 172.21.15.149:0/495378357 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cbab1204b0 0x55cbab107c50 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fb21c0012e0 tx=0x7fb21c001bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb818cd3fe870566 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:27.965 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.941+0000 7fb2037fe700 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2023-11-08T19:24:27.965 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.941+0000 7fb2037fe700 1 -- 172.21.15.149:0/495378357 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21c001fe0 con 0x55cbab1204b0 2023-11-08T19:24:27.965 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.941+0000 7fb2037fe700 1 -- 172.21.15.149:0/495378357 <== mon.0 v2:172.21.15.149:3300/0 2 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb21c001750 con 0x55cbab1204b0 2023-11-08T19:24:27.965 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.941+0000 7fb2372d2b80 1 -- 172.21.15.149:0/495378357 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb21c014480 con 0x55cbab1204b0 2023-11-08T19:24:27.966 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.941+0000 7fb2037fe700 1 -- 172.21.15.149:0/495378357 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb21c014980 con 0x55cbab1204b0 2023-11-08T19:24:27.966 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.941+0000 7fb2372d2b80 10 client.5466 fetch_fsmap learned FSMap version 17 2023-11-08T19:24:27.966 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.941+0000 7fb2372d2b80 1 -- 172.21.15.149:0/495378357 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55cbaae95200 con 0x55cbab1204b0 2023-11-08T19:24:27.966 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.941+0000 7fb2037fe700 1 -- 172.21.15.149:0/495378357 <== mon.0 v2:172.21.15.149:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb21c014480 con 0x55cbab1204b0 2023-11-08T19:24:27.966 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.941+0000 7fb2037fe700 1 -- 172.21.15.149:0/495378357 <== mon.0 v2:172.21.15.149:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fb21c027440 con 0x55cbab1204b0 2023-11-08T19:24:27.967 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.941+0000 7fb2372d2b80 10 client.5466 fetch_fsmap finished waiting for FSMap version 17 2023-11-08T19:24:27.967 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.941+0000 7fb2372d2b80 10 client.5466 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-08T19:24:27.967 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.941+0000 7fb2372d2b80 20 client.5466 populate_metadata read hostname 'smithi149' 2023-11-08T19:24:27.967 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.941+0000 7fb2372d2b80 1 --2- 172.21.15.149:0/495378357 >> [v2:172.21.15.149:6834/746083826,v1:172.21.15.149:6836/746083826] conn(0x55cbab1a0a00 0x55cbab1a0de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:27.968 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.941+0000 7fb2372d2b80 4 client.5466 mds_command: new command op to 5259 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-08T19:24:27.968 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.941+0000 7fb2372d2b80 1 -- 172.21.15.149:0/495378357 --> [v2:172.21.15.149:6834/746083826,v1:172.21.15.149:6836/746083826] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55cbab03e5a0 con 0x55cbab1a0a00 2023-11-08T19:24:27.968 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.941+0000 7fb228e75700 1 --2- 172.21.15.149:0/495378357 >> [v2:172.21.15.149:6834/746083826,v1:172.21.15.149:6836/746083826] conn(0x55cbab1a0a00 0x55cbab1a0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:27.968 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.941+0000 7fb2037fe700 10 client.5466 ms_handle_connect on v2:172.21.15.149:6834/746083826 2023-11-08T19:24:27.968 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.941+0000 7fb228e75700 1 --2- 172.21.15.149:0/495378357 >> [v2:172.21.15.149:6834/746083826,v1:172.21.15.149:6836/746083826] conn(0x55cbab1a0a00 0x55cbab1a0de0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a0a630277ab94a5 server_cookie=f1aa44ba7c67176f in_seq=0 out_seq=0 2023-11-08T19:24:27.969 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.942+0000 7fb2037fe700 1 -- 172.21.15.149:0/495378357 <== mds.0 v2:172.21.15.149:6834/746083826 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55cbab03e5a0 con 0x55cbab1a0a00 2023-11-08T19:24:27.969 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.942+0000 7fb2037fe700 10 client.5466 handle_command_reply: tid=0 2023-11-08T19:24:27.969 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.942+0000 7fb2372d2b80 1 client.5466 shutdown 2023-11-08T19:24:27.969 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.942+0000 7fb2372d2b80 1 -- 172.21.15.149:0/495378357 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cbab1204b0 msgr2=0x55cbab107c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:27.969 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.942+0000 7fb2372d2b80 1 --2- 172.21.15.149:0/495378357 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cbab1204b0 0x55cbab107c50 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fb21c0012e0 tx=0x7fb21c001bf0 comp rx=0 tx=0).stop 2023-11-08T19:24:27.970 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.942+0000 7fb2372d2b80 1 -- 172.21.15.149:0/495378357 shutdown_connections 2023-11-08T19:24:27.970 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.942+0000 7fb2372d2b80 1 --2- 172.21.15.149:0/495378357 >> [v2:172.21.15.149:6834/746083826,v1:172.21.15.149:6836/746083826] conn(0x55cbab1a0a00 0x55cbab1a0de0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:27.970 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.942+0000 7fb2372d2b80 1 --2- 172.21.15.149:0/495378357 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cbab1204b0 0x55cbab107c50 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:27.970 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.942+0000 7fb2037fe700 0 client.5466 ms_handle_reset on v2:172.21.15.149:6834/746083826 2023-11-08T19:24:27.971 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.942+0000 7fb2372d2b80 1 --2- 172.21.15.149:0/495378357 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55cbab0ec6f0 0x55cbab12df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:27.971 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.942+0000 7fb2372d2b80 1 --2- 172.21.15.149:0/495378357 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cbab0ecad0 0x55cbab13a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:27.971 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.942+0000 7fb2372d2b80 1 -- 172.21.15.149:0/495378357 >> 172.21.15.149:0/495378357 conn(0x55cbab067660 msgr2=0x55cbab11ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:27.971 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.942+0000 7fb2372d2b80 1 -- 172.21.15.149:0/495378357 shutdown_connections 2023-11-08T19:24:27.971 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.942+0000 7fb2372d2b80 1 -- 172.21.15.149:0/495378357 wait complete. 2023-11-08T19:24:27.972 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.942+0000 7fb2372d2b80 20 client.5466 trim_cache size 0 max 16384 2023-11-08T19:24:27.972 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2023-11-08T19:24:27.972 INFO:teuthology.orchestra.run.smithi149.stdout: "cluster_fsid": "0aba7c70-fe80-4446-a2f5-7502ac3adfb4", 2023-11-08T19:24:27.973 INFO:teuthology.orchestra.run.smithi149.stdout: "whoami": 0, 2023-11-08T19:24:27.973 INFO:teuthology.orchestra.run.smithi149.stdout: "id": 5259, 2023-11-08T19:24:27.973 INFO:teuthology.orchestra.run.smithi149.stdout: "want_state": "up:active", 2023-11-08T19:24:27.973 INFO:teuthology.orchestra.run.smithi149.stdout: "state": "up:active", 2023-11-08T19:24:27.973 INFO:teuthology.orchestra.run.smithi149.stdout: "fs_name": "cephfs", 2023-11-08T19:24:27.974 INFO:teuthology.orchestra.run.smithi149.stdout: "rank_uptime": 10.462584102999999, 2023-11-08T19:24:27.974 INFO:teuthology.orchestra.run.smithi149.stdout: "mdsmap_epoch": 17, 2023-11-08T19:24:27.974 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_epoch": 39, 2023-11-08T19:24:27.974 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_epoch_barrier": 39, 2023-11-08T19:24:27.974 INFO:teuthology.orchestra.run.smithi149.stdout: "uptime": 19.321088106000001 2023-11-08T19:24:27.975 INFO:teuthology.orchestra.run.smithi149.stdout:} 2023-11-08T19:24:27.976 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.943+0000 7fb22b0d9700 1 -- 172.21.15.149:0/3159695188 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb20806af00 msgr2=0x7fb20806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:27.976 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.943+0000 7fb22b0d9700 1 --2- 172.21.15.149:0/3159695188 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb20806af00 0x7fb20806d3c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb218006fd0 tx=0x7fb218008040 comp rx=0 tx=0).stop 2023-11-08T19:24:27.977 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.943+0000 7fb22b0d9700 1 -- 172.21.15.149:0/3159695188 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2240d2060 msgr2=0x7fb2240afbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:27.977 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.943+0000 7fb22b0d9700 1 --2- 172.21.15.149:0/3159695188 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2240d2060 0x7fb2240afbb0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fb210014040 tx=0x7fb210004750 comp rx=0 tx=0).stop 2023-11-08T19:24:27.977 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.943+0000 7fb22b0d9700 1 -- 172.21.15.149:0/3159695188 shutdown_connections 2023-11-08T19:24:27.977 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.943+0000 7fb22b0d9700 1 --2- 172.21.15.149:0/3159695188 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb20806af00 0x7fb20806d3c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:27.977 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.943+0000 7fb22b0d9700 1 --2- 172.21.15.149:0/3159695188 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb22415dc30 0x7fb2240b00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:27.978 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.943+0000 7fb22b0d9700 1 --2- 172.21.15.149:0/3159695188 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb22406fc70 0x7fb224151e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:27.978 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.943+0000 7fb22b0d9700 1 --2- 172.21.15.149:0/3159695188 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2240d2060 0x7fb2240afbb0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:27.978 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.943+0000 7fb22b0d9700 1 -- 172.21.15.149:0/3159695188 >> 172.21.15.149:0/3159695188 conn(0x7fb22408afd0 msgr2=0x7fb22406ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:27.978 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.943+0000 7fb22b0d9700 1 -- 172.21.15.149:0/3159695188 shutdown_connections 2023-11-08T19:24:27.978 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:27.943+0000 7fb22b0d9700 1 -- 172.21.15.149:0/3159695188 wait complete. 2023-11-08T19:24:27.979 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-08T19:24:28.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.098+0000 7f262196d700 1 Processor -- start 2023-11-08T19:24:28.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.098+0000 7f262196d700 1 -- start start 2023-11-08T19:24:28.103 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.099+0000 7f262196d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f261c161a50 0x7f261c161f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:28.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.099+0000 7f262196d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f261c0ce500 0x7f261c0ce990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:28.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.099+0000 7f262196d700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f261c0d1a10 con 0x7f261c161670 2023-11-08T19:24:28.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.099+0000 7f262196d700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f261c0d1cf0 con 0x7f261c161a50 2023-11-08T19:24:28.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.099+0000 7f262196d700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f261c0d1fd0 con 0x7f261c0ce500 2023-11-08T19:24:28.105 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.099+0000 7f261a7fc700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f261c161a50 0x7f261c161f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:28.105 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.099+0000 7f261affd700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f261c161670 0x7f261c0b5e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:41512/0 (socket says 172.21.15.149:41512) 2023-11-08T19:24:28.105 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.099+0000 7f261affd700 1 -- 172.21.15.149:0/2314484869 learned_addr learned my addr 172.21.15.149:0/2314484869 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:24:28.105 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.099+0000 7f261a7fc700 1 -- 172.21.15.149:0/2314484869 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f261c0ce500 msgr2=0x7f261c0ce990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:28.106 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.099+0000 7f261a7fc700 1 --2- 172.21.15.149:0/2314484869 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f261c0ce500 0x7f261c0ce990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:28.106 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.099+0000 7f261a7fc700 1 -- 172.21.15.149:0/2314484869 >> v1:172.21.15.149:6789/0 conn(0x7f261c161670 legacy=0x7f261c0b5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:28.106 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.099+0000 7f2619ffb700 1 -- 172.21.15.149:0/2314484869 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 722270095 0 0) 0x7f261c0d1a10 con 0x7f261c161670 2023-11-08T19:24:28.106 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.099+0000 7f261a7fc700 1 -- 172.21.15.149:0/2314484869 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f261c0d22b0 con 0x7f261c161a50 2023-11-08T19:24:28.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.099+0000 7f261a7fc700 1 --2- 172.21.15.149:0/2314484869 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f261c161a50 0x7f261c161f00 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f260c009840 tx=0x7f260c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=666ec053c87003f3 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:28.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.100+0000 7f2619ffb700 1 -- 172.21.15.149:0/2314484869 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260c011830 con 0x7f261c161a50 2023-11-08T19:24:28.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.100+0000 7f2619ffb700 1 -- 172.21.15.149:0/2314484869 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f260c011990 con 0x7f261c161a50 2023-11-08T19:24:28.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.100+0000 7f2619ffb700 1 -- 172.21.15.149:0/2314484869 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260c011d20 con 0x7f261c161a50 2023-11-08T19:24:28.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.100+0000 7f262196d700 1 -- 172.21.15.149:0/2314484869 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f261c161a50 msgr2=0x7f261c161f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:28.108 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.100+0000 7f262196d700 1 --2- 172.21.15.149:0/2314484869 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f261c161a50 0x7f261c161f00 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f260c009840 tx=0x7f260c009b50 comp rx=0 tx=0).stop 2023-11-08T19:24:28.108 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.100+0000 7f262196d700 1 -- 172.21.15.149:0/2314484869 shutdown_connections 2023-11-08T19:24:28.108 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.100+0000 7f262196d700 1 --2- 172.21.15.149:0/2314484869 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f261c0ce500 0x7f261c0ce990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:28.108 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.100+0000 7f262196d700 1 --2- 172.21.15.149:0/2314484869 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f261c161a50 0x7f261c161f00 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:28.108 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.100+0000 7f262196d700 1 -- 172.21.15.149:0/2314484869 >> 172.21.15.149:0/2314484869 conn(0x7f261c0d3980 msgr2=0x7f261c0d3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:28.109 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.100+0000 7f262196d700 1 -- 172.21.15.149:0/2314484869 shutdown_connections 2023-11-08T19:24:28.109 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.100+0000 7f262196d700 1 -- 172.21.15.149:0/2314484869 wait complete. 2023-11-08T19:24:28.109 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.101+0000 7f262196d700 1 Processor -- start 2023-11-08T19:24:28.109 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.102+0000 7f262196d700 1 -- start start 2023-11-08T19:24:28.112 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.102+0000 7f262196d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f261c0ce500 0x7f261c15c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:28.112 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.102+0000 7f262196d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f261c161670 0x7f261c15bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:28.112 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.102+0000 7f262196d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f261c161a50 0x7f261c0c8240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:28.112 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.102+0000 7f262196d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261c0c9d90 con 0x7f261c161670 2023-11-08T19:24:28.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.102+0000 7f262196d700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261c15c0b0 con 0x7f261c0ce500 2023-11-08T19:24:28.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.102+0000 7f262196d700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f261c0c8780 con 0x7f261c161a50 2023-11-08T19:24:28.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.102+0000 7f261a7fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f261c161670 0x7f261c15bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:28.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.102+0000 7f261a7fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f261c161670 0x7f261c15bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39518/0 (socket says 172.21.15.149:39518) 2023-11-08T19:24:28.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.102+0000 7f261a7fc700 1 -- 172.21.15.149:0/1339733240 learned_addr learned my addr 172.21.15.149:0/1339733240 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:28.114 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.103+0000 7f261affd700 1 --2- 172.21.15.149:0/1339733240 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f261c0ce500 0x7f261c15c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:28.114 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.103+0000 7f261b7fe700 1 --2- 172.21.15.149:0/1339733240 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f261c161a50 0x7f261c0c8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:28.114 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.103+0000 7f261a7fc700 1 -- 172.21.15.149:0/1339733240 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f261c161a50 msgr2=0x7f261c0c8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:28.114 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.103+0000 7f261a7fc700 1 --2- 172.21.15.149:0/1339733240 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f261c161a50 0x7f261c0c8240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:28.114 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.103+0000 7f261a7fc700 1 -- 172.21.15.149:0/1339733240 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f261c0ce500 msgr2=0x7f261c15c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:28.115 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.103+0000 7f261a7fc700 1 --2- 172.21.15.149:0/1339733240 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f261c0ce500 0x7f261c15c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:28.115 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.103+0000 7f261a7fc700 1 -- 172.21.15.149:0/1339733240 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f260c0094a0 con 0x7f261c161670 2023-11-08T19:24:28.115 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.103+0000 7f261b7fe700 1 --2- 172.21.15.149:0/1339733240 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f261c161a50 0x7f261c0c8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:24:28.115 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.103+0000 7f261a7fc700 1 --2- 172.21.15.149:0/1339733240 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f261c161670 0x7f261c15bb70 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f260c014040 tx=0x7f260c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:28.115 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.103+0000 7f2603fff700 1 -- 172.21.15.149:0/1339733240 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260c0036a0 con 0x7f261c161670 2023-11-08T19:24:28.116 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.103+0000 7f2603fff700 1 -- 172.21.15.149:0/1339733240 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f260c01f070 con 0x7f261c161670 2023-11-08T19:24:28.116 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.103+0000 7f262196d700 1 -- 172.21.15.149:0/1339733240 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f261c0c8a00 con 0x7f261c161670 2023-11-08T19:24:28.116 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.103+0000 7f2603fff700 1 -- 172.21.15.149:0/1339733240 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260c003a60 con 0x7f261c161670 2023-11-08T19:24:28.116 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.103+0000 7f262196d700 1 -- 172.21.15.149:0/1339733240 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f261c0b36f0 con 0x7f261c161670 2023-11-08T19:24:28.116 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.104+0000 7f262196d700 1 -- 172.21.15.149:0/1339733240 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f261c0745f0 con 0x7f261c161670 2023-11-08T19:24:28.117 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.105+0000 7f2603fff700 1 -- 172.21.15.149:0/1339733240 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f260c003bc0 con 0x7f261c161670 2023-11-08T19:24:28.117 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.105+0000 7f2603fff700 1 --2- 172.21.15.149:0/1339733240 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f260806af00 0x7f260806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:28.117 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.105+0000 7f2603fff700 1 -- 172.21.15.149:0/1339733240 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f260c021070 con 0x7f261c161670 2023-11-08T19:24:28.117 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.105+0000 7f261affd700 1 --2- 172.21.15.149:0/1339733240 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f260806af00 0x7f260806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:28.117 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.105+0000 7f261affd700 1 --2- 172.21.15.149:0/1339733240 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f260806af00 0x7f260806d3c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f261c0cf4e0 tx=0x7f2610009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:28.118 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.110+0000 7f2603fff700 1 -- 172.21.15.149:0/1339733240 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f260c056050 con 0x7f261c161670 2023-11-08T19:24:28.345 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.343+0000 7f262196d700 1 -- 172.21.15.149:0/1339733240 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f261c08b060 con 0x7f261c161670 2023-11-08T19:24:28.346 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.343+0000 7f2603fff700 1 -- 172.21.15.149:0/1339733240 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f260c059670 con 0x7f261c161670 2023-11-08T19:24:28.346 INFO:teuthology.orchestra.run.smithi149.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-08T19:24:28.348 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.345+0000 7f262196d700 1 -- 172.21.15.149:0/1339733240 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f260806af00 msgr2=0x7f260806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:28.348 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.345+0000 7f262196d700 1 --2- 172.21.15.149:0/1339733240 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f260806af00 0x7f260806d3c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f261c0cf4e0 tx=0x7f2610009040 comp rx=0 tx=0).stop 2023-11-08T19:24:28.348 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.345+0000 7f262196d700 1 -- 172.21.15.149:0/1339733240 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f261c161670 msgr2=0x7f261c15bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:28.349 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.345+0000 7f262196d700 1 --2- 172.21.15.149:0/1339733240 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f261c161670 0x7f261c15bb70 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f260c014040 tx=0x7f260c004750 comp rx=0 tx=0).stop 2023-11-08T19:24:28.349 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.345+0000 7f262196d700 1 -- 172.21.15.149:0/1339733240 shutdown_connections 2023-11-08T19:24:28.349 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.345+0000 7f262196d700 1 --2- 172.21.15.149:0/1339733240 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f260806af00 0x7f260806d3c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:28.349 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.345+0000 7f262196d700 1 --2- 172.21.15.149:0/1339733240 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f261c0ce500 0x7f261c15c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:28.349 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.345+0000 7f262196d700 1 --2- 172.21.15.149:0/1339733240 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f261c161a50 0x7f261c0c8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:28.350 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.345+0000 7f262196d700 1 --2- 172.21.15.149:0/1339733240 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f261c161670 0x7f261c15bb70 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:28.350 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.345+0000 7f262196d700 1 -- 172.21.15.149:0/1339733240 >> 172.21.15.149:0/1339733240 conn(0x7f261c0d3980 msgr2=0x7f261c0b2ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:28.350 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.345+0000 7f262196d700 1 -- 172.21.15.149:0/1339733240 shutdown_connections 2023-11-08T19:24:28.350 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:28.345+0000 7f262196d700 1 -- 172.21.15.149:0/1339733240 wait complete. 2023-11-08T19:24:28.359 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-08T19:24:28.360 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-08T19:24:28.360 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi149.front.sepia.ceph.com 2023-11-08T19:24:28.361 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-08T19:24:28.361 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-08T19:24:28.361 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-08T19:24:28.361 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-08T19:24:28.362 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-08T19:24:28.362 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-08T19:24:28.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:24:28.363 DEBUG:teuthology.orchestra.run.smithi149:> ip addr 2023-11-08T19:24:28.381 INFO:teuthology.orchestra.run.smithi149.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-08T19:24:28.381 INFO:teuthology.orchestra.run.smithi149.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-08T19:24:28.381 INFO:teuthology.orchestra.run.smithi149.stdout: inet 127.0.0.1/8 scope host lo 2023-11-08T19:24:28.381 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:24:28.382 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 ::1/128 scope host 2023-11-08T19:24:28.382 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:24:28.382 INFO:teuthology.orchestra.run.smithi149.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-08T19:24:28.382 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a4 brd ff:ff:ff:ff:ff:ff 2023-11-08T19:24:28.382 INFO:teuthology.orchestra.run.smithi149.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-08T19:24:28.383 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a5 brd ff:ff:ff:ff:ff:ff 2023-11-08T19:24:28.383 INFO:teuthology.orchestra.run.smithi149.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-08T19:24:28.383 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:56 brd ff:ff:ff:ff:ff:ff 2023-11-08T19:24:28.383 INFO:teuthology.orchestra.run.smithi149.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-08T19:24:28.383 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:57 brd ff:ff:ff:ff:ff:ff 2023-11-08T19:24:28.384 INFO:teuthology.orchestra.run.smithi149.stdout: inet 172.21.15.149/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-08T19:24:28.384 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft 42325sec preferred_lft 42325sec 2023-11-08T19:24:28.384 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::a27d:6f0d:7890:36f/64 scope link noprefixroute 2023-11-08T19:24:28.384 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:24:28.384 INFO:teuthology.orchestra.run.smithi149.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-08T19:24:28.385 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 82:12:e7:85:4e:11 brd ff:ff:ff:ff:ff:ff 2023-11-08T19:24:28.385 INFO:teuthology.orchestra.run.smithi149.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-08T19:24:28.385 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:24:28.385 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::4c22:cdff:fed4:d829/64 scope link 2023-11-08T19:24:28.385 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:24:28.386 INFO:teuthology.orchestra.run.smithi149.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-08T19:24:28.386 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether e6:a6:23:51:6c:ef brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-08T19:24:28.386 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::e4a6:23ff:fe51:6cef/64 scope link 2023-11-08T19:24:28.386 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:24:28.386 INFO:teuthology.orchestra.run.smithi149.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-08T19:24:28.387 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 82:12:e7:85:4e:11 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-08T19:24:28.387 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::8012:e7ff:fe85:4e11/64 scope link 2023-11-08T19:24:28.387 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:24:28.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:24:28.388 DEBUG:teuthology.orchestra.run.smithi149:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-08T19:24:28.446 INFO:teuthology.orchestra.run.smithi149.stdout:1 2023-11-08T19:24:28.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:24:28.447 DEBUG:teuthology.orchestra.run.smithi149:> route 2023-11-08T19:24:28.505 INFO:teuthology.orchestra.run.smithi149.stdout:Kernel IP routing table 2023-11-08T19:24:28.506 INFO:teuthology.orchestra.run.smithi149.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-08T19:24:28.506 INFO:teuthology.orchestra.run.smithi149.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-08T19:24:28.506 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-08T19:24:28.506 INFO:teuthology.orchestra.run.smithi149.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-08T19:24:28.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:24:28.507 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec bash -c ' 2023-11-08T19:24:28.507 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2023-11-08T19:24:28.508 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-08T19:24:28.508 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-08T19:24:28.508 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-08T19:24:28.509 DEBUG:teuthology.orchestra.run.smithi149:> ') 2023-11-08T19:24:28.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:24:28.611 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2023-11-08T19:24:28.627 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-08T19:24:28.628 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-08T19:24:28.628 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-08T19:24:28.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:24:28.629 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set brx.0 up 2023-11-08T19:24:28.695 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-08T19:24:28.696 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-08T19:24:28.752 INFO:teuthology.orchestra.run.smithi149.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-08T19:24:28.752 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-08T19:24:28.752 DEBUG:teuthology.orchestra.run.smithi149:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-08T19:24:28.808 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-08T19:24:28.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:24:28.809 DEBUG:teuthology.orchestra.run.smithi149:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-08T19:24:28.893 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-08T19:24:28.893 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-08T19:24:28.894 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2023-11-08T19:24:28.902 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-08T19:24:28.902 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-08T19:24:28.903 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2023-11-08T19:24:28.903 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.149:3300,172.21.15.160:3300,172.21.15.160:3301" 2023-11-08T19:24:28.904 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-08T19:24:28.947 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-08T19:24:28.947 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-08T19:24:28.948 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2023-11-08T19:24:28.948 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.149:3300,172.21.15.160:3300,172.21.15.160:3301" 2023-11-08T19:24:28.949 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-08T19:24:28.949 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.149:6789,172.21.15.160:6789,172.21.15.160:6790" 2023-11-08T19:24:28.949 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.149:6789,172.21.15.160:6789,172.21.15.160:6790:/ 2023-11-08T19:24:28.950 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=0aba7c70-fe80-4446-a2f5-7502ac3adfb4" will pass to kernel 2023-11-08T19:24:28.963 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-08T19:24:28.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:24:28.964 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-08T19:24:28.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:24:28.993 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-08T19:24:29.076 INFO:teuthology.orchestra.run.smithi149.stdout:client5478 2023-11-08T19:24:29.076 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-11-08T19:24:29.077 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:24:29.133 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create snap-test-pool 2023-11-08T19:24:29.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:29.293+0000 7f2550e1e700 1 Processor -- start 2023-11-08T19:24:29.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:29.293+0000 7f2550e1e700 1 -- start start 2023-11-08T19:24:29.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:29.294+0000 7f2550e1e700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f254c15df40 0x7f254c06c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:29.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:29.294+0000 7f2550e1e700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f254c0cb660 0x7f254c06c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:29.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:29.294+0000 7f2550e1e700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f254c15e320 con 0x7f254c06ab80 2023-11-08T19:24:29.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:29.294+0000 7f2550e1e700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f254c06b020 con 0x7f254c15df40 2023-11-08T19:24:29.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:29.294+0000 7f2550e1e700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f254c06b2e0 con 0x7f254c0cb660 2023-11-08T19:24:29.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:29.295+0000 7f254ad9d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f254c0cb660 0x7f254c06c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:29.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:29.295+0000 7f254a59c700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f254c15df40 0x7f254c06c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:29.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:29.295+0000 7f254ad9d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f254c0cb660 0x7f254c06c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.149:59820/0 (socket says 172.21.15.149:59820) 2023-11-08T19:24:29.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:29.295+0000 7f254ad9d700 1 -- 172.21.15.149:0/4225023907 learned_addr learned my addr 172.21.15.149:0/4225023907 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:29.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:29.295+0000 7f254ad9d700 1 -- 172.21.15.149:0/4225023907 >> v2:172.21.15.160:3300/0 conn(0x7f254c15df40 msgr2=0x7f254c06c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:29.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:29.295+0000 7f254ad9d700 1 --2- 172.21.15.149:0/4225023907 >> v2:172.21.15.160:3300/0 conn(0x7f254c15df40 0x7f254c06c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:29.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:29.295+0000 7f254ad9d700 1 -- 172.21.15.149:0/4225023907 >> v1:172.21.15.160:6789/0 conn(0x7f254c06ab80 legacy=0x7f254c0caf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:29.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:29.295+0000 7f254ad9d700 1 -- 172.21.15.149:0/4225023907 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f254c06b5c0 con 0x7f254c0cb660 2023-11-08T19:24:29.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:29.295+0000 7f254a59c700 1 --2- 172.21.15.149:0/4225023907 >> v2:172.21.15.160:3300/0 conn(0x7f254c15df40 0x7f254c06c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:24:29.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:29.296+0000 7f254ad9d700 1 --2- 172.21.15.149:0/4225023907 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f254c0cb660 0x7f254c06c5e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2544009e50 tx=0x7f254400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5bf48133b2cc59f4 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:29.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:29.296+0000 7f254959a700 1 -- 172.21.15.149:0/4225023907 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254400e070 con 0x7f254c0cb660 2023-11-08T19:24:29.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:29.296+0000 7f254959a700 1 -- 172.21.15.149:0/4225023907 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f254400b910 con 0x7f254c0cb660 2023-11-08T19:24:29.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:29.296+0000 7f254959a700 1 -- 172.21.15.149:0/4225023907 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254400bcc0 con 0x7f254c0cb660 2023-11-08T19:24:29.304 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:29.296+0000 7f2550e1e700 1 -- 172.21.15.149:0/4225023907 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f254c0cb660 msgr2=0x7f254c06c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:29.305 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:29.296+0000 7f2550e1e700 1 --2- 172.21.15.149:0/4225023907 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f254c0cb660 0x7f254c06c5e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2544009e50 tx=0x7f254400b330 comp rx=0 tx=0).stop 2023-11-08T19:24:29.305 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:29.296+0000 7f2550e1e700 1 -- 172.21.15.149:0/4225023907 shutdown_connections 2023-11-08T19:24:29.305 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:29.296+0000 7f2550e1e700 1 --2- 172.21.15.149:0/4225023907 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f254c0cb660 0x7f254c06c5e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:29.305 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:29.296+0000 7f2550e1e700 1 --2- 172.21.15.149:0/4225023907 >> v2:172.21.15.160:3300/0 conn(0x7f254c15df40 0x7f254c06c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:29.306 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:29.296+0000 7f2550e1e700 1 -- 172.21.15.149:0/4225023907 >> 172.21.15.149:0/4225023907 conn(0x7f254c0d0640 msgr2=0x7f254c0d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:29.306 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:29.296+0000 7f2550e1e700 1 -- 172.21.15.149:0/4225023907 shutdown_connections 2023-11-08T19:24:29.306 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:29.296+0000 7f2550e1e700 1 -- 172.21.15.149:0/4225023907 wait complete. 2023-11-08T19:24:29.306 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:29.298+0000 7f2550e1e700 1 Processor -- start 2023-11-08T19:24:29.306 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:29.298+0000 7f2550e1e700 1 -- start start 2023-11-08T19:24:29.307 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:29.298+0000 7f2550e1e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f254c06ab80 0x7f254c0ca540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:29.307 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:29.299+0000 7f2550e1e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f254c0cb660 0x7f254c0c58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:29.307 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:29.299+0000 7f2550e1e700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f254c15df40 0x7f254c0aee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:29.307 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:29.299+0000 7f2550e1e700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f254c0ad240 con 0x7f254c0cb660 2023-11-08T19:24:29.307 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:29.299+0000 7f2550e1e700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f254c0ad490 con 0x7f254c06ab80 2023-11-08T19:24:29.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:29.299+0000 7f2550e1e700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f254c0ad770 con 0x7f254c15df40 2023-11-08T19:24:29.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:29.299+0000 7f2549d9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f254c0cb660 0x7f254c0c58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:29.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:29.299+0000 7f2549d9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f254c0cb660 0x7f254c0c58d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39536/0 (socket says 172.21.15.149:39536) 2023-11-08T19:24:29.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:29.299+0000 7f2549d9b700 1 -- 172.21.15.149:0/946541962 learned_addr learned my addr 172.21.15.149:0/946541962 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:29.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:29.299+0000 7f254ad9d700 1 --2- 172.21.15.149:0/946541962 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f254c15df40 0x7f254c0aee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:29.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:29.299+0000 7f254a59c700 1 --2- 172.21.15.149:0/946541962 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f254c06ab80 0x7f254c0ca540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:29.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:29.299+0000 7f2549d9b700 1 -- 172.21.15.149:0/946541962 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f254c15df40 msgr2=0x7f254c0aee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:29.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:29.299+0000 7f2549d9b700 1 --2- 172.21.15.149:0/946541962 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f254c15df40 0x7f254c0aee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:29.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:29.299+0000 7f2549d9b700 1 -- 172.21.15.149:0/946541962 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f254c06ab80 msgr2=0x7f254c0ca540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:29.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:29.299+0000 7f2549d9b700 1 --2- 172.21.15.149:0/946541962 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f254c06ab80 0x7f254c0ca540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:29.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:29.299+0000 7f2549d9b700 1 -- 172.21.15.149:0/946541962 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f253c0094a0 con 0x7f254c0cb660 2023-11-08T19:24:29.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:29.299+0000 7f2549d9b700 1 --2- 172.21.15.149:0/946541962 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f254c0cb660 0x7f254c0c58d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f254000c4e0 tx=0x7f254000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:29.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:29.299+0000 7f253affd700 1 -- 172.21.15.149:0/946541962 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25400052d0 con 0x7f254c0cb660 2023-11-08T19:24:29.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:29.299+0000 7f253affd700 1 -- 172.21.15.149:0/946541962 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2540005430 con 0x7f254c0cb660 2023-11-08T19:24:29.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:29.299+0000 7f2550e1e700 1 -- 172.21.15.149:0/946541962 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2544009b30 con 0x7f254c0cb660 2023-11-08T19:24:29.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:29.299+0000 7f253affd700 1 -- 172.21.15.149:0/946541962 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25400038c0 con 0x7f254c0cb660 2023-11-08T19:24:29.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:29.299+0000 7f2550e1e700 1 -- 172.21.15.149:0/946541962 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f254c0c7b70 con 0x7f254c0cb660 2023-11-08T19:24:29.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:29.300+0000 7f2550e1e700 1 -- 172.21.15.149:0/946541962 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f254c0c76f0 con 0x7f254c0cb660 2023-11-08T19:24:29.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:29.301+0000 7f253affd700 1 -- 172.21.15.149:0/946541962 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2540003a20 con 0x7f254c0cb660 2023-11-08T19:24:29.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:29.301+0000 7f253affd700 1 --2- 172.21.15.149:0/946541962 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f252c06af30 0x7f252c06d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:29.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:29.301+0000 7f253affd700 1 -- 172.21.15.149:0/946541962 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2540088b60 con 0x7f254c0cb660 2023-11-08T19:24:29.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:29.301+0000 7f254a59c700 1 --2- 172.21.15.149:0/946541962 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f252c06af30 0x7f252c06d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:29.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:29.302+0000 7f254a59c700 1 --2- 172.21.15.149:0/946541962 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f252c06af30 0x7f252c06d3f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f253c009c60 tx=0x7f253c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:29.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:29.306+0000 7f253affd700 1 -- 172.21.15.149:0/946541962 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f254c0c76f0 con 0x7f254c0cb660 2023-11-08T19:24:29.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:29.497+0000 7f2550e1e700 1 -- 172.21.15.149:0/946541962 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "snap-test-pool"} v 0) v1 -- 0x7f254c0c76f0 con 0x7f254c0cb660 2023-11-08T19:24:30.123 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.121+0000 7f253affd700 1 -- 172.21.15.149:0/946541962 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "snap-test-pool"}]=0 pool 'snap-test-pool' created v40) v1 ==== 118+0+0 (secure 0 0 0) 0x7f254c0c76f0 con 0x7f254c0cb660 2023-11-08T19:24:30.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.126+0000 7f2550e1e700 1 -- 172.21.15.149:0/946541962 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f252c06af30 msgr2=0x7f252c06d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:30.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.126+0000 7f2550e1e700 1 --2- 172.21.15.149:0/946541962 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f252c06af30 0x7f252c06d3f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f253c009c60 tx=0x7f253c008040 comp rx=0 tx=0).stop 2023-11-08T19:24:30.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.126+0000 7f2550e1e700 1 -- 172.21.15.149:0/946541962 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f254c0cb660 msgr2=0x7f254c0c58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:30.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.126+0000 7f2550e1e700 1 --2- 172.21.15.149:0/946541962 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f254c0cb660 0x7f254c0c58d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f254000c4e0 tx=0x7f254000c8a0 comp rx=0 tx=0).stop 2023-11-08T19:24:30.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.126+0000 7f2550e1e700 1 -- 172.21.15.149:0/946541962 shutdown_connections 2023-11-08T19:24:30.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.126+0000 7f2550e1e700 1 --2- 172.21.15.149:0/946541962 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f252c06af30 0x7f252c06d3f0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:30.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.126+0000 7f2550e1e700 1 --2- 172.21.15.149:0/946541962 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f254c06ab80 0x7f254c0ca540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:30.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.126+0000 7f2550e1e700 1 --2- 172.21.15.149:0/946541962 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f254c15df40 0x7f254c0aee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:30.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.126+0000 7f2550e1e700 1 --2- 172.21.15.149:0/946541962 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f254c0cb660 0x7f254c0c58d0 secure :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f254000c4e0 tx=0x7f254000c8a0 comp rx=0 tx=0).stop 2023-11-08T19:24:30.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.126+0000 7f2550e1e700 1 -- 172.21.15.149:0/946541962 >> 172.21.15.149:0/946541962 conn(0x7f254c0d0640 msgr2=0x7f254c0b0740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:30.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.127+0000 7f2550e1e700 1 -- 172.21.15.149:0/946541962 shutdown_connections 2023-11-08T19:24:30.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.127+0000 7f2550e1e700 1 -- 172.21.15.149:0/946541962 wait complete. 2023-11-08T19:24:30.133 INFO:teuthology.orchestra.run.smithi149.stderr:pool 'snap-test-pool' created 2023-11-08T19:24:30.147 DEBUG:teuthology.orchestra.run.smithi149:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool snap-test-pool mksnap snap3 2023-11-08T19:24:30.191 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.189+0000 7f365dcff080 1 Processor -- start 2023-11-08T19:24:30.191 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.189+0000 7f365dcff080 1 -- start start 2023-11-08T19:24:30.196 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.190+0000 7f365dcff080 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5620c19bb4e0 0x5620c19fd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:30.196 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.190+0000 7f365dcff080 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5620c1a066a0 0x5620c19eb830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:30.196 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.190+0000 7f365dcff080 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5620c1a94830 0x5620c1a91e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:30.196 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.190+0000 7f365dcff080 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620c196ac30 con 0x5620c19bb4e0 2023-11-08T19:24:30.197 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.190+0000 7f365dcff080 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620c1966520 con 0x5620c1a94830 2023-11-08T19:24:30.197 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.190+0000 7f365dcff080 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x5620c1900740 con 0x5620c1a066a0 2023-11-08T19:24:30.197 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.190+0000 7f3653d94700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5620c19bb4e0 0x5620c19fd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:30.197 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.190+0000 7f3653d94700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5620c19bb4e0 0x5620c19fd7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39548/0 (socket says 172.21.15.149:39548) 2023-11-08T19:24:30.198 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.190+0000 7f3653d94700 1 -- 172.21.15.149:0/702762022 learned_addr learned my addr 172.21.15.149:0/702762022 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:30.198 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.190+0000 7f3653593700 1 --2- 172.21.15.149:0/702762022 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5620c1a066a0 0x5620c19eb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:30.198 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.190+0000 7f3654595700 1 --2- 172.21.15.149:0/702762022 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5620c1a94830 0x5620c1a91e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:30.198 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.190+0000 7f3653d94700 1 -- 172.21.15.149:0/702762022 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5620c1a066a0 msgr2=0x5620c19eb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:30.198 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.190+0000 7f3653d94700 1 --2- 172.21.15.149:0/702762022 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5620c1a066a0 0x5620c19eb830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:30.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.190+0000 7f3653d94700 1 -- 172.21.15.149:0/702762022 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5620c1a94830 msgr2=0x5620c1a91e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:30.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.190+0000 7f3653d94700 1 --2- 172.21.15.149:0/702762022 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5620c1a94830 0x5620c1a91e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:30.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.190+0000 7f3653d94700 1 -- 172.21.15.149:0/702762022 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3644005d20 con 0x5620c19bb4e0 2023-11-08T19:24:30.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.190+0000 7f3653d94700 1 --2- 172.21.15.149:0/702762022 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5620c19bb4e0 0x5620c19fd7f0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f363c00b240 tx=0x7f363c00b550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e21df2842fc5603b server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:30.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.190+0000 7f3652591700 1 -- 172.21.15.149:0/702762022 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363c014070 con 0x5620c19bb4e0 2023-11-08T19:24:30.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.190+0000 7f3652591700 1 -- 172.21.15.149:0/702762022 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f363c00f3f0 con 0x5620c19bb4e0 2023-11-08T19:24:30.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.190+0000 7f3652591700 1 -- 172.21.15.149:0/702762022 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363c00f780 con 0x5620c19bb4e0 2023-11-08T19:24:30.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.191+0000 7f365dcff080 1 -- 172.21.15.149:0/702762022 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5620c19bb4e0 msgr2=0x5620c19fd7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:30.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.191+0000 7f365dcff080 1 --2- 172.21.15.149:0/702762022 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5620c19bb4e0 0x5620c19fd7f0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f363c00b240 tx=0x7f363c00b550 comp rx=0 tx=0).stop 2023-11-08T19:24:30.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.191+0000 7f365dcff080 1 -- 172.21.15.149:0/702762022 shutdown_connections 2023-11-08T19:24:30.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.191+0000 7f365dcff080 1 --2- 172.21.15.149:0/702762022 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5620c1a94830 0x5620c1a91e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:30.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.191+0000 7f365dcff080 1 --2- 172.21.15.149:0/702762022 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5620c19bb4e0 0x5620c19fd7f0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:30.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.191+0000 7f365dcff080 1 --2- 172.21.15.149:0/702762022 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5620c1a066a0 0x5620c19eb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:30.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.191+0000 7f365dcff080 1 -- 172.21.15.149:0/702762022 >> 172.21.15.149:0/702762022 conn(0x5620c1a03cb0 msgr2=0x5620c19ec540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:30.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.191+0000 7f365dcff080 1 -- 172.21.15.149:0/702762022 shutdown_connections 2023-11-08T19:24:30.202 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.191+0000 7f365dcff080 1 -- 172.21.15.149:0/702762022 wait complete. 2023-11-08T19:24:30.202 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.191+0000 7f365dcff080 1 Processor -- start 2023-11-08T19:24:30.202 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.192+0000 7f365dcff080 1 -- start start 2023-11-08T19:24:30.202 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.192+0000 7f365dcff080 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5620c19bb4e0 0x5620c19fd760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:30.203 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.192+0000 7f365dcff080 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5620c1a066a0 0x5620c1a88e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:30.203 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.192+0000 7f365dcff080 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5620c1a94830 0x5620c1a89340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:30.203 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.192+0000 7f365dcff080 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620c19003e0 con 0x5620c1a066a0 2023-11-08T19:24:30.203 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.192+0000 7f365dcff080 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620c18f4680 con 0x5620c1a94830 2023-11-08T19:24:30.203 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.192+0000 7f365dcff080 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x5620c19fae80 con 0x5620c19bb4e0 2023-11-08T19:24:30.203 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.192+0000 7f3653593700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5620c1a066a0 0x5620c1a88e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:30.204 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.192+0000 7f3653593700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5620c1a066a0 0x5620c1a88e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39556/0 (socket says 172.21.15.149:39556) 2023-11-08T19:24:30.204 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.192+0000 7f3653593700 1 -- 172.21.15.149:0/1606499204 learned_addr learned my addr 172.21.15.149:0/1606499204 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:30.204 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.192+0000 7f3654595700 1 --2- 172.21.15.149:0/1606499204 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5620c1a94830 0x5620c1a89340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:30.204 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.192+0000 7f3653d94700 1 --2- 172.21.15.149:0/1606499204 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5620c19bb4e0 0x5620c19fd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:30.205 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.193+0000 7f3653593700 1 -- 172.21.15.149:0/1606499204 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5620c19bb4e0 msgr2=0x5620c19fd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:30.205 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.193+0000 7f3653593700 1 --2- 172.21.15.149:0/1606499204 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5620c19bb4e0 0x5620c19fd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:30.205 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.193+0000 7f3653593700 1 -- 172.21.15.149:0/1606499204 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5620c1a94830 msgr2=0x5620c1a89340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:30.205 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.193+0000 7f3653593700 1 --2- 172.21.15.149:0/1606499204 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5620c1a94830 0x5620c1a89340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:30.206 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.193+0000 7f3653593700 1 -- 172.21.15.149:0/1606499204 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f363c001b00 con 0x5620c1a066a0 2023-11-08T19:24:30.206 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.193+0000 7f3653593700 1 --2- 172.21.15.149:0/1606499204 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5620c1a066a0 0x5620c1a88e00 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f3644011000 tx=0x7f3644002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:30.206 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.193+0000 7f365158f700 1 -- 172.21.15.149:0/1606499204 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3644008690 con 0x5620c1a066a0 2023-11-08T19:24:30.206 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.193+0000 7f365158f700 1 -- 172.21.15.149:0/1606499204 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f364401d680 con 0x5620c1a066a0 2023-11-08T19:24:30.206 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.193+0000 7f365dcff080 1 -- 172.21.15.149:0/1606499204 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5620c18ffb70 con 0x5620c1a066a0 2023-11-08T19:24:30.207 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.193+0000 7f365158f700 1 -- 172.21.15.149:0/1606499204 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364401da30 con 0x5620c1a066a0 2023-11-08T19:24:30.207 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.193+0000 7f365dcff080 1 -- 172.21.15.149:0/1606499204 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5620c18ff5d0 con 0x5620c1a066a0 2023-11-08T19:24:30.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.194+0000 7f365158f700 1 -- 172.21.15.149:0/1606499204 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3644019040 con 0x5620c1a066a0 2023-11-08T19:24:30.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.195+0000 7f365158f700 1 --2- 172.21.15.149:0/1606499204 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3634069820 0x7f363406bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:30.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.195+0000 7f365158f700 1 -- 172.21.15.149:0/1606499204 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f3644089d70 con 0x5620c1a066a0 2023-11-08T19:24:30.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.195+0000 7f3653d94700 1 --2- 172.21.15.149:0/1606499204 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3634069820 0x7f363406bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:30.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.195+0000 7f365dcff080 1 -- 172.21.15.149:0/1606499204 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- pool_op(create snap pool 7 tid 1 name snap3 v0) v4 -- 0x5620c19704a0 con 0x5620c1a066a0 2023-11-08T19:24:30.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:30.195+0000 7f3653d94700 1 --2- 172.21.15.149:0/1606499204 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3634069820 0x7f363406bce0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x5620c19a9e30 tx=0x7f363c009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:31.132 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.130+0000 7f365158f700 1 -- 172.21.15.149:0/1606499204 <== mon.0 v2:172.21.15.149:3300/0 6 ==== pool_op_reply(tid 1 (0) Success v41) v1 ==== 43+0+0 (secure 0 0 0) 0x7f364402d020 con 0x5620c1a066a0 2023-11-08T19:24:31.133 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.130+0000 7f365158f700 1 -- 172.21.15.149:0/1606499204 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=41}) v3 -- 0x7f3634072510 con 0x5620c1a066a0 2023-11-08T19:24:31.133 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.131+0000 7f365158f700 1 -- 172.21.15.149:0/1606499204 <== mon.0 v2:172.21.15.149:3300/0 7 ==== osd_map(41..41 src has 1..41) v4 ==== 718+0+0 (secure 0 0 0) 0x7f3644058fd0 con 0x5620c1a066a0 2023-11-08T19:24:31.134 INFO:teuthology.orchestra.run.smithi149.stdout:created pool snap-test-pool snap snap3 2023-11-08T19:24:31.135 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.133+0000 7f365dcff080 1 -- 172.21.15.149:0/1606499204 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3634069820 msgr2=0x7f363406bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:31.135 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.133+0000 7f365dcff080 1 --2- 172.21.15.149:0/1606499204 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3634069820 0x7f363406bce0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x5620c19a9e30 tx=0x7f363c009000 comp rx=0 tx=0).stop 2023-11-08T19:24:31.135 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.133+0000 7f365dcff080 1 -- 172.21.15.149:0/1606499204 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5620c1a066a0 msgr2=0x5620c1a88e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:31.135 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.133+0000 7f365dcff080 1 --2- 172.21.15.149:0/1606499204 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5620c1a066a0 0x5620c1a88e00 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f3644011000 tx=0x7f3644002fb0 comp rx=0 tx=0).stop 2023-11-08T19:24:31.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.133+0000 7f365dcff080 1 -- 172.21.15.149:0/1606499204 shutdown_connections 2023-11-08T19:24:31.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.133+0000 7f365dcff080 1 --2- 172.21.15.149:0/1606499204 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3634069820 0x7f363406bce0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:31.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.133+0000 7f365dcff080 1 --2- 172.21.15.149:0/1606499204 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5620c1a94830 0x5620c1a89340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:31.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.133+0000 7f365dcff080 1 --2- 172.21.15.149:0/1606499204 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5620c19bb4e0 0x5620c19fd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:31.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.133+0000 7f365dcff080 1 --2- 172.21.15.149:0/1606499204 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5620c1a066a0 0x5620c1a88e00 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:31.137 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.133+0000 7f365dcff080 1 -- 172.21.15.149:0/1606499204 >> 172.21.15.149:0/1606499204 conn(0x5620c1a03cb0 msgr2=0x5620c1a91e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:31.137 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.133+0000 7f365dcff080 1 -- 172.21.15.149:0/1606499204 shutdown_connections 2023-11-08T19:24:31.137 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.133+0000 7f365dcff080 1 -- 172.21.15.149:0/1606499204 wait complete. 2023-11-08T19:24:31.140 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs snap-test-pool 2023-11-08T19:24:31.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.307+0000 7f3eb595b700 1 Processor -- start 2023-11-08T19:24:31.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.308+0000 7f3eb595b700 1 -- start start 2023-11-08T19:24:31.316 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.308+0000 7f3eb595b700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f3eb015db50 0x7f3eb01616a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:31.316 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.308+0000 7f3eb595b700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3eb006ab80 0x7f3eb006b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:31.316 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.308+0000 7f3eb595b700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eb00cf130 con 0x7f3eb00b2a40 2023-11-08T19:24:31.316 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.308+0000 7f3eb595b700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3eb0162690 con 0x7f3eb015db50 2023-11-08T19:24:31.317 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.308+0000 7f3eb595b700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb006b550 con 0x7f3eb006ab80 2023-11-08T19:24:31.317 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.309+0000 7f3eae7fc700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f3eb00b2a40 0x7f3eb00cacc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:41564/0 (socket says 172.21.15.149:41564) 2023-11-08T19:24:31.317 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.309+0000 7f3eae7fc700 1 -- 172.21.15.149:0/4168942335 learned_addr learned my addr 172.21.15.149:0/4168942335 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:24:31.317 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.309+0000 7f3eaeffd700 1 --2- 172.21.15.149:0/4168942335 >> v2:172.21.15.160:3300/0 conn(0x7f3eb015db50 0x7f3eb01616a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:31.318 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.309+0000 7f3eaf7fe700 1 --2- 172.21.15.149:0/4168942335 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3eb006ab80 0x7f3eb006b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:31.318 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.309+0000 7f3eadffb700 1 -- 172.21.15.149:0/4168942335 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3077619885 0 0) 0x7f3eb00cf130 con 0x7f3eb00b2a40 2023-11-08T19:24:31.318 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.309+0000 7f3eadffb700 1 -- 172.21.15.149:0/4168942335 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e980035b0 con 0x7f3eb00b2a40 2023-11-08T19:24:31.318 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.309+0000 7f3eadffb700 1 -- 172.21.15.149:0/4168942335 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2614840242 0 0) 0x7f3e980035b0 con 0x7f3eb00b2a40 2023-11-08T19:24:31.318 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.309+0000 7f3eadffb700 1 -- 172.21.15.149:0/4168942335 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3eb006ab80 msgr2=0x7f3eb006b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:31.319 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.309+0000 7f3eadffb700 1 --2- 172.21.15.149:0/4168942335 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3eb006ab80 0x7f3eb006b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:31.319 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.309+0000 7f3eadffb700 1 -- 172.21.15.149:0/4168942335 >> v2:172.21.15.160:3300/0 conn(0x7f3eb015db50 msgr2=0x7f3eb01616a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:31.319 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.309+0000 7f3eadffb700 1 --2- 172.21.15.149:0/4168942335 >> v2:172.21.15.160:3300/0 conn(0x7f3eb015db50 0x7f3eb01616a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:31.319 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.309+0000 7f3eadffb700 1 -- 172.21.15.149:0/4168942335 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eb015df30 con 0x7f3eb00b2a40 2023-11-08T19:24:31.319 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.309+0000 7f3eadffb700 1 -- 172.21.15.149:0/4168942335 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f3ea0001670 con 0x7f3eb00b2a40 2023-11-08T19:24:31.320 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.309+0000 7f3eadffb700 1 -- 172.21.15.149:0/4168942335 >> v1:172.21.15.149:6789/0 conn(0x7f3eb00b2a40 legacy=0x7f3eb00cacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:31.320 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.309+0000 7f3eadffb700 1 --2- 172.21.15.149:0/4168942335 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e98003a70 0x7f3e98003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:31.320 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.309+0000 7f3eadffb700 1 --2- 172.21.15.149:0/4168942335 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3e98004850 0x7f3e98004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:31.320 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.309+0000 7f3eadffb700 1 --2- 172.21.15.149:0/4168942335 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3eb006ab80 0x7f3e98005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:31.320 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.309+0000 7f3eadffb700 1 -- 172.21.15.149:0/4168942335 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb0162690 con 0x7f3e98003a70 2023-11-08T19:24:31.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.309+0000 7f3eadffb700 1 -- 172.21.15.149:0/4168942335 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb006b550 con 0x7f3e98004850 2023-11-08T19:24:31.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.309+0000 7f3eadffb700 1 -- 172.21.15.149:0/4168942335 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9800ba10 con 0x7f3eb006ab80 2023-11-08T19:24:31.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.309+0000 7f3eaeffd700 1 --2- 172.21.15.149:0/4168942335 >> v2:172.21.15.160:3300/0 conn(0x7f3eb015db50 0x7f3eb01616a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:24:31.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.309+0000 7f3eaeffd700 1 --2- 172.21.15.149:0/4168942335 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e98003a70 0x7f3e98003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:31.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.309+0000 7f3eae7fc700 1 --2- 172.21.15.149:0/4168942335 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3e98004850 0x7f3e98004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:31.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.309+0000 7f3eaf7fe700 1 --2- 172.21.15.149:0/4168942335 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3eb006ab80 0x7f3e98005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:31.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.310+0000 7f3eaeffd700 1 -- 172.21.15.149:0/4168942335 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3eb006ab80 msgr2=0x7f3e98005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:31.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.310+0000 7f3eaeffd700 1 --2- 172.21.15.149:0/4168942335 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3eb006ab80 0x7f3e98005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:31.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.310+0000 7f3eaeffd700 1 -- 172.21.15.149:0/4168942335 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3e98004850 msgr2=0x7f3e98004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:31.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.310+0000 7f3eaeffd700 1 --2- 172.21.15.149:0/4168942335 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3e98004850 0x7f3e98004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:31.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.310+0000 7f3eaeffd700 1 -- 172.21.15.149:0/4168942335 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e980035b0 con 0x7f3e98003a70 2023-11-08T19:24:31.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.310+0000 7f3eaeffd700 1 --2- 172.21.15.149:0/4168942335 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e98003a70 0x7f3e98003e90 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4009d40 tx=0x7f3e98005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c41ee2627ee5255 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:31.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.310+0000 7f3eadffb700 1 -- 172.21.15.149:0/4168942335 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea4009e90 con 0x7f3e98003a70 2023-11-08T19:24:31.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.310+0000 7f3eadffb700 1 -- 172.21.15.149:0/4168942335 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea400e9a0 con 0x7f3e98003a70 2023-11-08T19:24:31.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.310+0000 7f3eadffb700 1 -- 172.21.15.149:0/4168942335 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea400ed10 con 0x7f3e98003a70 2023-11-08T19:24:31.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.310+0000 7f3eb595b700 1 -- 172.21.15.149:0/4168942335 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e98003a70 msgr2=0x7f3e98003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:31.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.310+0000 7f3eb595b700 1 --2- 172.21.15.149:0/4168942335 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e98003a70 0x7f3e98003e90 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4009d40 tx=0x7f3e98005880 comp rx=0 tx=0).stop 2023-11-08T19:24:31.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.310+0000 7f3eaf7fe700 1 -- 172.21.15.149:0/4168942335 reap_dead start 2023-11-08T19:24:31.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.310+0000 7f3eb595b700 1 -- 172.21.15.149:0/4168942335 shutdown_connections 2023-11-08T19:24:31.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.310+0000 7f3eb595b700 1 -- 172.21.15.149:0/4168942335 >> 172.21.15.149:0/4168942335 conn(0x7f3eb006df50 msgr2=0x7f3eb006e360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:31.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.310+0000 7f3eb595b700 1 -- 172.21.15.149:0/4168942335 shutdown_connections 2023-11-08T19:24:31.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.310+0000 7f3eb595b700 1 -- 172.21.15.149:0/4168942335 wait complete. 2023-11-08T19:24:31.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.312+0000 7f3eb595b700 1 Processor -- start 2023-11-08T19:24:31.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.312+0000 7f3eb595b700 1 -- start start 2023-11-08T19:24:31.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.313+0000 7f3eb595b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e98003a70 0x7f3eb01586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:31.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.313+0000 7f3eb595b700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3eb0157fa0 0x7f3eb00c6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:31.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.313+0000 7f3eb595b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3eb00c69d0 0x7f3eb00c8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:31.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.313+0000 7f3eb595b700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb00c6e60 con 0x7f3e98003a70 2023-11-08T19:24:31.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.313+0000 7f3eb595b700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb01601e0 con 0x7f3eb00c69d0 2023-11-08T19:24:31.328 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.313+0000 7f3eb595b700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb0160d60 con 0x7f3eb0157fa0 2023-11-08T19:24:31.328 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.313+0000 7f3eaeffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e98003a70 0x7f3eb01586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:31.328 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.313+0000 7f3eaeffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e98003a70 0x7f3eb01586a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39574/0 (socket says 172.21.15.149:39574) 2023-11-08T19:24:31.328 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.313+0000 7f3eaeffd700 1 -- 172.21.15.149:0/3192127530 learned_addr learned my addr 172.21.15.149:0/3192127530 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:31.328 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.313+0000 7f3eaeffd700 1 -- 172.21.15.149:0/3192127530 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3eb0157fa0 msgr2=0x7f3eb00c6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:31.329 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.313+0000 7f3eaeffd700 1 --2- 172.21.15.149:0/3192127530 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3eb0157fa0 0x7f3eb00c6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:31.329 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.313+0000 7f3eaeffd700 1 -- 172.21.15.149:0/3192127530 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3eb00c69d0 msgr2=0x7f3eb00c8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:31.329 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.313+0000 7f3eaeffd700 1 --2- 172.21.15.149:0/3192127530 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3eb00c69d0 0x7f3eb00c8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:31.329 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.313+0000 7f3eaeffd700 1 -- 172.21.15.149:0/3192127530 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eb0160430 con 0x7f3e98003a70 2023-11-08T19:24:31.330 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.313+0000 7f3eaeffd700 1 --2- 172.21.15.149:0/3192127530 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e98003a70 0x7f3eb01586a0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f3ea400e790 tx=0x7f3ea40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:31.330 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.313+0000 7f3e97fff700 1 -- 172.21.15.149:0/3192127530 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea4021070 con 0x7f3e98003a70 2023-11-08T19:24:31.330 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.313+0000 7f3e97fff700 1 -- 172.21.15.149:0/3192127530 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea4009e90 con 0x7f3e98003a70 2023-11-08T19:24:31.330 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.313+0000 7f3e97fff700 1 -- 172.21.15.149:0/3192127530 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea4003ad0 con 0x7f3e98003a70 2023-11-08T19:24:31.330 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.313+0000 7f3eb595b700 1 -- 172.21.15.149:0/3192127530 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3eb0160710 con 0x7f3e98003a70 2023-11-08T19:24:31.331 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.313+0000 7f3eb595b700 1 -- 172.21.15.149:0/3192127530 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eb0158420 con 0x7f3e98003a70 2023-11-08T19:24:31.332 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.314+0000 7f3eb595b700 1 -- 172.21.15.149:0/3192127530 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3eb00c6e00 con 0x7f3e98003a70 2023-11-08T19:24:31.332 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.315+0000 7f3e97fff700 1 -- 172.21.15.149:0/3192127530 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3ea4003c30 con 0x7f3e98003a70 2023-11-08T19:24:31.332 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.315+0000 7f3e97fff700 1 --2- 172.21.15.149:0/3192127530 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3e9c06af00 0x7f3e9c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:31.333 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.315+0000 7f3eae7fc700 1 --2- 172.21.15.149:0/3192127530 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3e9c06af00 0x7f3e9c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:31.333 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.315+0000 7f3e97fff700 1 -- 172.21.15.149:0/3192127530 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6421+0+0 (secure 0 0 0) 0x7f3ea408b090 con 0x7f3e98003a70 2023-11-08T19:24:31.333 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.316+0000 7f3eae7fc700 1 --2- 172.21.15.149:0/3192127530 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3e9c06af00 0x7f3e9c06d3c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3ea0000c00 tx=0x7f3ea0001010 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:31.333 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.320+0000 7f3e97fff700 1 -- 172.21.15.149:0/3192127530 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3ea4059a30 con 0x7f3e98003a70 2023-11-08T19:24:31.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.553+0000 7f3eb595b700 1 -- 172.21.15.149:0/3192127530 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "snap-test-pool"} v 0) v1 -- 0x7f3eb004f730 con 0x7f3e98003a70 2023-11-08T19:24:31.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.554+0000 7f3e97fff700 1 -- 172.21.15.149:0/3192127530 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "snap-test-pool"}]=-95 pool(7) already has mon-managed snaps; can't attach pool to fs v17) v1 ==== 173+0+0 (secure 0 0 0) 0x7f3ea40595c0 con 0x7f3e98003a70 2023-11-08T19:24:31.558 INFO:teuthology.orchestra.run.smithi149.stderr:Error ENOTSUP: pool(7) already has mon-managed snaps; can't attach pool to fs 2023-11-08T19:24:31.561 DEBUG:teuthology.orchestra.run:got remote process result: 95 2023-11-08T19:24:31.562 DEBUG:teuthology.orchestra.run.smithi149:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool snap-test-pool rmsnap snap3 2023-11-08T19:24:31.605 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.602+0000 7f09b6c68080 1 Processor -- start 2023-11-08T19:24:31.605 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.603+0000 7f09b6c68080 1 -- start start 2023-11-08T19:24:31.609 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.603+0000 7f09b6c68080 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562d3d777690 0x562d3d821520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:31.610 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.603+0000 7f09b6c68080 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x562d3d820550 0x562d3d81f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:31.610 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.603+0000 7f09b6c68080 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562d3d820930 0x562d3d817760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:31.610 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.603+0000 7f09b6c68080 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d3d6f2520 con 0x562d3d777690 2023-11-08T19:24:31.611 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.603+0000 7f09b6c68080 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d3d68c740 con 0x562d3d820930 2023-11-08T19:24:31.611 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.603+0000 7f09b6c68080 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x562d3d68c3e0 con 0x562d3d820550 2023-11-08T19:24:31.611 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.603+0000 7f09accfd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562d3d777690 0x562d3d821520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:31.611 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.603+0000 7f09accfd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562d3d777690 0x562d3d821520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39586/0 (socket says 172.21.15.149:39586) 2023-11-08T19:24:31.611 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.603+0000 7f09accfd700 1 -- 172.21.15.149:0/1721583207 learned_addr learned my addr 172.21.15.149:0/1721583207 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:31.612 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.603+0000 7f09a7fff700 1 --2- 172.21.15.149:0/1721583207 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x562d3d820550 0x562d3d81f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:31.612 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.604+0000 7f09ad4fe700 1 --2- 172.21.15.149:0/1721583207 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562d3d820930 0x562d3d817760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:31.612 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.604+0000 7f09accfd700 1 -- 172.21.15.149:0/1721583207 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x562d3d820550 msgr2=0x562d3d81f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:31.612 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.604+0000 7f09accfd700 1 --2- 172.21.15.149:0/1721583207 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x562d3d820550 0x562d3d81f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:31.612 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.604+0000 7f09accfd700 1 -- 172.21.15.149:0/1721583207 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562d3d820930 msgr2=0x562d3d817760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:31.612 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.604+0000 7f09accfd700 1 --2- 172.21.15.149:0/1721583207 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562d3d820930 0x562d3d817760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:31.613 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.604+0000 7f09accfd700 1 -- 172.21.15.149:0/1721583207 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a0005d20 con 0x562d3d777690 2023-11-08T19:24:31.613 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.604+0000 7f09accfd700 1 --2- 172.21.15.149:0/1721583207 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562d3d777690 0x562d3d821520 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f09a0000c00 tx=0x7f09a000d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=726a2d1ee7c9a591 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:31.613 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.604+0000 7f09a6ffd700 1 -- 172.21.15.149:0/1721583207 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a0008b60 con 0x562d3d777690 2023-11-08T19:24:31.614 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.604+0000 7f09a6ffd700 1 -- 172.21.15.149:0/1721583207 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09a0008ce0 con 0x562d3d777690 2023-11-08T19:24:31.614 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.604+0000 7f09a6ffd700 1 -- 172.21.15.149:0/1721583207 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a001e690 con 0x562d3d777690 2023-11-08T19:24:31.615 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.604+0000 7f09b6c68080 1 -- 172.21.15.149:0/1721583207 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562d3d777690 msgr2=0x562d3d821520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:31.615 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.604+0000 7f09b6c68080 1 --2- 172.21.15.149:0/1721583207 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562d3d777690 0x562d3d821520 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f09a0000c00 tx=0x7f09a000d000 comp rx=0 tx=0).stop 2023-11-08T19:24:31.615 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.604+0000 7f09b6c68080 1 -- 172.21.15.149:0/1721583207 shutdown_connections 2023-11-08T19:24:31.616 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.604+0000 7f09b6c68080 1 --2- 172.21.15.149:0/1721583207 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562d3d820930 0x562d3d817760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:31.616 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.604+0000 7f09b6c68080 1 --2- 172.21.15.149:0/1721583207 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562d3d777690 0x562d3d821520 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:31.616 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.604+0000 7f09b6c68080 1 --2- 172.21.15.149:0/1721583207 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x562d3d820550 0x562d3d81f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:31.617 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.604+0000 7f09b6c68080 1 -- 172.21.15.149:0/1721583207 >> 172.21.15.149:0/1721583207 conn(0x562d3d7756d0 msgr2=0x562d3d793fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:31.617 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.604+0000 7f09b6c68080 1 -- 172.21.15.149:0/1721583207 shutdown_connections 2023-11-08T19:24:31.617 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.604+0000 7f09b6c68080 1 -- 172.21.15.149:0/1721583207 wait complete. 2023-11-08T19:24:31.618 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.605+0000 7f09b6c68080 1 Processor -- start 2023-11-08T19:24:31.618 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.605+0000 7f09b6c68080 1 -- start start 2023-11-08T19:24:31.619 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.606+0000 7f09b6c68080 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562d3d777690 0x562d3d8165c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:31.619 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.606+0000 7f09b6c68080 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562d3d820550 0x562d3d817760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:31.619 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.606+0000 7f09b6c68080 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x562d3d820930 0x562d3d821040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:31.620 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.606+0000 7f09b6c68080 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d3d680680 con 0x562d3d820550 2023-11-08T19:24:31.620 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.606+0000 7f09b6c68080 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d3d7739c0 con 0x562d3d777690 2023-11-08T19:24:31.620 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.606+0000 7f09b6c68080 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x562d3d773400 con 0x562d3d820930 2023-11-08T19:24:31.621 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.606+0000 7f09a7fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562d3d820550 0x562d3d817760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:31.621 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.606+0000 7f09a7fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562d3d820550 0x562d3d817760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39594/0 (socket says 172.21.15.149:39594) 2023-11-08T19:24:31.622 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.606+0000 7f09a7fff700 1 -- 172.21.15.149:0/1023734983 learned_addr learned my addr 172.21.15.149:0/1023734983 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:31.622 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.606+0000 7f09ad4fe700 1 --2- 172.21.15.149:0/1023734983 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x562d3d820930 0x562d3d821040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:31.622 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.606+0000 7f09accfd700 1 --2- 172.21.15.149:0/1023734983 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562d3d777690 0x562d3d8165c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:31.623 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.606+0000 7f09a7fff700 1 -- 172.21.15.149:0/1023734983 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x562d3d820930 msgr2=0x562d3d821040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:31.623 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.606+0000 7f09a7fff700 1 --2- 172.21.15.149:0/1023734983 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x562d3d820930 0x562d3d821040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:31.624 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.606+0000 7f09a7fff700 1 -- 172.21.15.149:0/1023734983 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562d3d777690 msgr2=0x562d3d8165c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:31.624 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.606+0000 7f09a7fff700 1 --2- 172.21.15.149:0/1023734983 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562d3d777690 0x562d3d8165c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:31.624 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.606+0000 7f09a7fff700 1 -- 172.21.15.149:0/1023734983 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562d3d6b27c0 con 0x562d3d820550 2023-11-08T19:24:31.625 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.606+0000 7f09accfd700 1 --2- 172.21.15.149:0/1023734983 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562d3d777690 0x562d3d8165c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:24:31.625 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.606+0000 7f09a7fff700 1 --2- 172.21.15.149:0/1023734983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562d3d820550 0x562d3d817760 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f0998007e00 tx=0x7f0998006660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:31.626 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.606+0000 7f09a5ffb700 1 -- 172.21.15.149:0/1023734983 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09980135f0 con 0x562d3d820550 2023-11-08T19:24:31.626 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.606+0000 7f09a5ffb700 1 -- 172.21.15.149:0/1023734983 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f099800f040 con 0x562d3d820550 2023-11-08T19:24:31.626 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.606+0000 7f09a5ffb700 1 -- 172.21.15.149:0/1023734983 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0998013990 con 0x562d3d820550 2023-11-08T19:24:31.627 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.606+0000 7f09b6c68080 1 -- 172.21.15.149:0/1023734983 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562d3d6987d0 con 0x562d3d820550 2023-11-08T19:24:31.627 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.607+0000 7f09b6c68080 1 -- 172.21.15.149:0/1023734983 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562d3d68bb70 con 0x562d3d820550 2023-11-08T19:24:31.628 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.608+0000 7f09a5ffb700 1 -- 172.21.15.149:0/1023734983 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0998013af0 con 0x562d3d820550 2023-11-08T19:24:31.629 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.608+0000 7f09a5ffb700 1 --2- 172.21.15.149:0/1023734983 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0990069820 0x7f099006bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:31.629 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.608+0000 7f09a5ffb700 1 -- 172.21.15.149:0/1023734983 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6421+0+0 (secure 0 0 0) 0x7f0998087550 con 0x562d3d820550 2023-11-08T19:24:31.630 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.608+0000 7f09accfd700 1 --2- 172.21.15.149:0/1023734983 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0990069820 0x7f099006bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:31.630 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.608+0000 7f09b6c68080 1 -- 172.21.15.149:0/1023734983 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- pool_op(delete snap pool 7 tid 1 name snap3 v0) v4 -- 0x562d3d6fc4a0 con 0x562d3d820550 2023-11-08T19:24:31.631 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:31.609+0000 7f09accfd700 1 --2- 172.21.15.149:0/1023734983 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0990069820 0x7f099006bce0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x562d3d81bcd0 tx=0x7f09a0014040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:32.142 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.140+0000 7f09a5ffb700 1 -- 172.21.15.149:0/1023734983 <== mon.0 v2:172.21.15.149:3300/0 6 ==== pool_op_reply(tid 1 (0) Success v42) v1 ==== 43+0+0 (secure 0 0 0) 0x7f0998052470 con 0x562d3d820550 2023-11-08T19:24:32.143 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.140+0000 7f09a5ffb700 1 -- 172.21.15.149:0/1023734983 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=42}) v3 -- 0x7f0990072570 con 0x562d3d820550 2023-11-08T19:24:32.143 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.140+0000 7f09a5ffb700 1 -- 172.21.15.149:0/1023734983 <== mon.0 v2:172.21.15.149:3300/0 7 ==== osd_map(42..42 src has 1..42) v4 ==== 643+0+0 (secure 0 0 0) 0x7f0998056130 con 0x562d3d820550 2023-11-08T19:24:32.143 INFO:teuthology.orchestra.run.smithi149.stdout:removed pool snap-test-pool snap snap3 2023-11-08T19:24:32.144 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.141+0000 7f09b6c68080 1 -- 172.21.15.149:0/1023734983 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0990069820 msgr2=0x7f099006bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:32.145 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.141+0000 7f09b6c68080 1 --2- 172.21.15.149:0/1023734983 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0990069820 0x7f099006bce0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x562d3d81bcd0 tx=0x7f09a0014040 comp rx=0 tx=0).stop 2023-11-08T19:24:32.145 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.141+0000 7f09b6c68080 1 -- 172.21.15.149:0/1023734983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562d3d820550 msgr2=0x562d3d817760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:32.145 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.141+0000 7f09b6c68080 1 --2- 172.21.15.149:0/1023734983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562d3d820550 0x562d3d817760 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f0998007e00 tx=0x7f0998006660 comp rx=0 tx=0).stop 2023-11-08T19:24:32.145 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.141+0000 7f09b6c68080 1 -- 172.21.15.149:0/1023734983 shutdown_connections 2023-11-08T19:24:32.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.141+0000 7f09b6c68080 1 --2- 172.21.15.149:0/1023734983 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0990069820 0x7f099006bce0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:32.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.141+0000 7f09b6c68080 1 --2- 172.21.15.149:0/1023734983 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562d3d777690 0x562d3d8165c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:32.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.141+0000 7f09b6c68080 1 --2- 172.21.15.149:0/1023734983 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x562d3d820930 0x562d3d821040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:32.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.141+0000 7f09b6c68080 1 --2- 172.21.15.149:0/1023734983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562d3d820550 0x562d3d817760 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:32.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.141+0000 7f09b6c68080 1 -- 172.21.15.149:0/1023734983 >> 172.21.15.149:0/1023734983 conn(0x562d3d7756d0 msgr2=0x562d3d793fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:32.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.141+0000 7f09b6c68080 1 -- 172.21.15.149:0/1023734983 shutdown_connections 2023-11-08T19:24:32.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.141+0000 7f09b6c68080 1 -- 172.21.15.149:0/1023734983 wait complete. 2023-11-08T19:24:32.148 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete snap-test-pool 2023-11-08T19:24:32.314 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.312+0000 7f532fd59700 1 Processor -- start 2023-11-08T19:24:32.315 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.312+0000 7f532fd59700 1 -- start start 2023-11-08T19:24:32.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.313+0000 7f532fd59700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f532815d890 0x7f53280b94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:32.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.313+0000 7f532fd59700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f532815dc70 0x7f5328161590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:32.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.313+0000 7f532fd59700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53280b68f0 con 0x7f53280d0300 2023-11-08T19:24:32.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.313+0000 7f532fd59700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5328161ca0 con 0x7f532815dc70 2023-11-08T19:24:32.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.313+0000 7f532fd59700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5328161f80 con 0x7f532815d890 2023-11-08T19:24:32.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.313+0000 7f532d2f4700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f532815dc70 0x7f5328161590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:32.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.313+0000 7f532d2f4700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f532815dc70 0x7f5328161590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39600/0 (socket says 172.21.15.149:39600) 2023-11-08T19:24:32.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.313+0000 7f532d2f4700 1 -- 172.21.15.149:0/4214944415 learned_addr learned my addr 172.21.15.149:0/4214944415 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:32.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.313+0000 7f532daf5700 1 --2- 172.21.15.149:0/4214944415 >> v2:172.21.15.160:3300/0 conn(0x7f532815d890 0x7f53280b94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:32.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.314+0000 7f532d2f4700 1 -- 172.21.15.149:0/4214944415 >> v2:172.21.15.160:3300/0 conn(0x7f532815d890 msgr2=0x7f53280b94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:32.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.314+0000 7f532d2f4700 1 --2- 172.21.15.149:0/4214944415 >> v2:172.21.15.160:3300/0 conn(0x7f532815d890 0x7f53280b94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:32.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.314+0000 7f532d2f4700 1 -- 172.21.15.149:0/4214944415 >> v1:172.21.15.160:6789/0 conn(0x7f53280d0300 legacy=0x7f53280b53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:32.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.314+0000 7f532d2f4700 1 -- 172.21.15.149:0/4214944415 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5328162260 con 0x7f532815dc70 2023-11-08T19:24:32.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.314+0000 7f532daf5700 1 --2- 172.21.15.149:0/4214944415 >> v2:172.21.15.160:3300/0 conn(0x7f532815d890 0x7f53280b94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:24:32.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.314+0000 7f532d2f4700 1 --2- 172.21.15.149:0/4214944415 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f532815dc70 0x7f5328161590 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f53280b6520 tx=0x7f5324009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f549e866b94db084 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:32.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.314+0000 7f532caf3700 1 -- 172.21.15.149:0/4214944415 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532400b870 con 0x7f532815dc70 2023-11-08T19:24:32.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.314+0000 7f532caf3700 1 -- 172.21.15.149:0/4214944415 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f532400b9d0 con 0x7f532815dc70 2023-11-08T19:24:32.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.314+0000 7f532caf3700 1 -- 172.21.15.149:0/4214944415 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532400bd60 con 0x7f532815dc70 2023-11-08T19:24:32.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.314+0000 7f532fd59700 1 -- 172.21.15.149:0/4214944415 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f532815dc70 msgr2=0x7f5328161590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:32.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.314+0000 7f532fd59700 1 --2- 172.21.15.149:0/4214944415 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f532815dc70 0x7f5328161590 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f53280b6520 tx=0x7f5324009bd0 comp rx=0 tx=0).stop 2023-11-08T19:24:32.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.314+0000 7f532fd59700 1 -- 172.21.15.149:0/4214944415 shutdown_connections 2023-11-08T19:24:32.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.314+0000 7f532fd59700 1 --2- 172.21.15.149:0/4214944415 >> v2:172.21.15.160:3300/0 conn(0x7f532815d890 0x7f53280b94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:32.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.314+0000 7f532fd59700 1 --2- 172.21.15.149:0/4214944415 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f532815dc70 0x7f5328161590 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:32.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.314+0000 7f532fd59700 1 -- 172.21.15.149:0/4214944415 >> 172.21.15.149:0/4214944415 conn(0x7f532806bd60 msgr2=0x7f532806c140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:32.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.315+0000 7f532fd59700 1 -- 172.21.15.149:0/4214944415 shutdown_connections 2023-11-08T19:24:32.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.315+0000 7f532fd59700 1 -- 172.21.15.149:0/4214944415 wait complete. 2023-11-08T19:24:32.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.316+0000 7f532fd59700 1 Processor -- start 2023-11-08T19:24:32.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.316+0000 7f532fd59700 1 -- start start 2023-11-08T19:24:32.328 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.316+0000 7f532fd59700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53280d0300 0x7f53280c6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:32.328 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.316+0000 7f532fd59700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f532815d890 0x7f5328158f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:32.328 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.316+0000 7f532fd59700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f532815dc70 0x7f53281594d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:32.328 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.316+0000 7f532fd59700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5328160f40 con 0x7f53280d0300 2023-11-08T19:24:32.328 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.316+0000 7f532fd59700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53280ca2e0 con 0x7f532815dc70 2023-11-08T19:24:32.328 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.316+0000 7f532fd59700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53280c7a40 con 0x7f532815d890 2023-11-08T19:24:32.329 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.317+0000 7f532daf5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53280d0300 0x7f53280c6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:32.329 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.317+0000 7f532daf5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53280d0300 0x7f53280c6030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39604/0 (socket says 172.21.15.149:39604) 2023-11-08T19:24:32.330 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.317+0000 7f532daf5700 1 -- 172.21.15.149:0/2794146620 learned_addr learned my addr 172.21.15.149:0/2794146620 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:32.330 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.317+0000 7f532d2f4700 1 --2- 172.21.15.149:0/2794146620 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f532815d890 0x7f5328158f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:32.330 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.317+0000 7f532e2f6700 1 --2- 172.21.15.149:0/2794146620 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f532815dc70 0x7f53281594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:32.330 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.317+0000 7f532daf5700 1 -- 172.21.15.149:0/2794146620 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f532815d890 msgr2=0x7f5328158f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:32.330 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.317+0000 7f532daf5700 1 --2- 172.21.15.149:0/2794146620 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f532815d890 0x7f5328158f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:32.331 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.317+0000 7f532daf5700 1 -- 172.21.15.149:0/2794146620 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f532815dc70 msgr2=0x7f53281594d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:32.331 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.317+0000 7f532daf5700 1 --2- 172.21.15.149:0/2794146620 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f532815dc70 0x7f53281594d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:32.331 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.317+0000 7f532daf5700 1 -- 172.21.15.149:0/2794146620 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5324009550 con 0x7f53280d0300 2023-11-08T19:24:32.331 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.317+0000 7f532e2f6700 1 --2- 172.21.15.149:0/2794146620 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f532815dc70 0x7f53281594d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:24:32.332 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.317+0000 7f532d2f4700 1 --2- 172.21.15.149:0/2794146620 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f532815d890 0x7f5328158f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:24:32.332 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.317+0000 7f532daf5700 1 --2- 172.21.15.149:0/2794146620 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53280d0300 0x7f53280c6030 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f531800e840 tx=0x7f531800ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:32.332 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.317+0000 7f531e7fc700 1 -- 172.21.15.149:0/2794146620 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5318013610 con 0x7f53280d0300 2023-11-08T19:24:32.332 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.317+0000 7f531e7fc700 1 -- 172.21.15.149:0/2794146620 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5318013770 con 0x7f53280d0300 2023-11-08T19:24:32.332 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.317+0000 7f532fd59700 1 -- 172.21.15.149:0/2794146620 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5328160c60 con 0x7f53280d0300 2023-11-08T19:24:32.333 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.317+0000 7f531e7fc700 1 -- 172.21.15.149:0/2794146620 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5318013b20 con 0x7f53280d0300 2023-11-08T19:24:32.333 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.317+0000 7f532fd59700 1 -- 172.21.15.149:0/2794146620 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53280c7fc0 con 0x7f53280d0300 2023-11-08T19:24:32.333 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.318+0000 7f532fd59700 1 -- 172.21.15.149:0/2794146620 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53280c78a0 con 0x7f53280d0300 2023-11-08T19:24:32.333 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.319+0000 7f531e7fc700 1 -- 172.21.15.149:0/2794146620 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5318013c80 con 0x7f53280d0300 2023-11-08T19:24:32.333 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.319+0000 7f531e7fc700 1 --2- 172.21.15.149:0/2794146620 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f530c06af00 0x7f530c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:32.334 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.319+0000 7f531e7fc700 1 -- 172.21.15.149:0/2794146620 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6438+0+0 (secure 0 0 0) 0x7f5318089560 con 0x7f53280d0300 2023-11-08T19:24:32.334 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.319+0000 7f532d2f4700 1 --2- 172.21.15.149:0/2794146620 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f530c06af00 0x7f530c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:32.334 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.319+0000 7f532d2f4700 1 --2- 172.21.15.149:0/2794146620 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f530c06af00 0x7f530c06d3c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5324014040 tx=0x7f5324008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:32.335 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.324+0000 7f531e7fc700 1 -- 172.21.15.149:0/2794146620 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f53280c78a0 con 0x7f53280d0300 2023-11-08T19:24:32.519 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.517+0000 7f532fd59700 1 -- 172.21.15.149:0/2794146620 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "snap-test-pool"} v 0) v1 -- 0x7f53280c78a0 con 0x7f53280d0300 2023-11-08T19:24:32.520 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.518+0000 7f531e7fc700 1 -- 172.21.15.149:0/2794146620 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "snap-test-pool"}]=-1 WARNING: this will *PERMANENTLY DESTROY* all data stored in pool snap-test-pool. If you are *ABSOLUTELY CERTAIN* that is what you want, pass the pool name *twice*, followed by --yes-i-really-really-mean-it. v42) v1 ==== 296+0+0 (secure 0 0 0) 0x7f53280c78a0 con 0x7f53280d0300 2023-11-08T19:24:32.521 INFO:teuthology.orchestra.run.smithi149.stderr:Error EPERM: WARNING: this will *PERMANENTLY DESTROY* all data stored in pool snap-test-pool. If you are *ABSOLUTELY CERTAIN* that is what you want, pass the pool name *twice*, followed by --yes-i-really-really-mean-it. 2023-11-08T19:24:32.525 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-08T19:24:32.526 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-08T19:24:32.526 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-08T19:24:32.567 DEBUG:teuthology.orchestra.run.smithi160:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-08T19:24:32.617 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-08T19:24:32.618 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-11-08T19:24:32.618 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:24:32.636 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-11-08T19:24:32.636 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:24:32.693 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:24:32.854 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.852+0000 7f0058eda700 1 Processor -- start 2023-11-08T19:24:32.855 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.852+0000 7f0058eda700 1 -- start start 2023-11-08T19:24:32.859 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.853+0000 7f0058eda700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f00540b0f50 0x7f005406cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:32.859 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.853+0000 7f0058eda700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00540b1d70 con 0x7f0054071610 2023-11-08T19:24:32.859 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.853+0000 7f0058eda700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0054071bb0 con 0x7f00540b13e0 2023-11-08T19:24:32.860 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.853+0000 7f0058eda700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0054072830 con 0x7f00540b0f50 2023-11-08T19:24:32.860 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.853+0000 7f005259c700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f0054071610 0x7f005415add0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:41614/0 (socket says 172.21.15.149:41614) 2023-11-08T19:24:32.860 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.853+0000 7f005259c700 1 -- 172.21.15.149:0/1947851495 learned_addr learned my addr 172.21.15.149:0/1947851495 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:24:32.860 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.853+0000 7f0051d9b700 1 --2- 172.21.15.149:0/1947851495 >> v2:172.21.15.160:3300/0 conn(0x7f00540b0f50 0x7f005406cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:32.860 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.854+0000 7f005159a700 1 -- 172.21.15.149:0/1947851495 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4280248485 0 0) 0x7f00540b1d70 con 0x7f0054071610 2023-11-08T19:24:32.861 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.854+0000 7f005159a700 1 -- 172.21.15.149:0/1947851495 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f003c0035b0 con 0x7f0054071610 2023-11-08T19:24:32.861 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.854+0000 7f005159a700 1 -- 172.21.15.149:0/1947851495 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2227882929 0 0) 0x7f003c0035b0 con 0x7f0054071610 2023-11-08T19:24:32.861 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.854+0000 7f005159a700 1 -- 172.21.15.149:0/1947851495 >> v2:172.21.15.160:3300/0 conn(0x7f00540b0f50 msgr2=0x7f005406cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:32.861 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.854+0000 7f005159a700 1 --2- 172.21.15.149:0/1947851495 >> v2:172.21.15.160:3300/0 conn(0x7f00540b0f50 0x7f005406cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:32.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.854+0000 7f005159a700 1 -- 172.21.15.149:0/1947851495 >> v1:172.21.15.160:6789/0 conn(0x7f00540b13e0 legacy=0x7f0054164e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:32.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.854+0000 7f005159a700 1 -- 172.21.15.149:0/1947851495 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0054071e90 con 0x7f0054071610 2023-11-08T19:24:32.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.854+0000 7f005159a700 1 -- 172.21.15.149:0/1947851495 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f0048001670 con 0x7f0054071610 2023-11-08T19:24:32.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.854+0000 7f005159a700 1 -- 172.21.15.149:0/1947851495 >> v1:172.21.15.149:6789/0 conn(0x7f0054071610 legacy=0x7f005415add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:32.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.854+0000 7f005159a700 1 --2- 172.21.15.149:0/1947851495 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f003c003a00 0x7f003c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:32.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.854+0000 7f005159a700 1 --2- 172.21.15.149:0/1947851495 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f003c004850 0x7f003c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:32.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.854+0000 7f005159a700 1 --2- 172.21.15.149:0/1947851495 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f003c005210 0x7f003c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:32.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.854+0000 7f005159a700 1 -- 172.21.15.149:0/1947851495 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0054072830 con 0x7f003c004850 2023-11-08T19:24:32.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.854+0000 7f005159a700 1 -- 172.21.15.149:0/1947851495 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f003c00c1b0 con 0x7f003c003a00 2023-11-08T19:24:32.864 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.854+0000 7f005159a700 1 -- 172.21.15.149:0/1947851495 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f003c00c370 con 0x7f003c005210 2023-11-08T19:24:32.864 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.854+0000 7f0051d9b700 1 --2- 172.21.15.149:0/1947851495 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f003c004850 0x7f003c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:32.864 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.854+0000 7f005259c700 1 --2- 172.21.15.149:0/1947851495 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f003c003a00 0x7f003c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:32.864 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.854+0000 7f0052d9d700 1 --2- 172.21.15.149:0/1947851495 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f003c005210 0x7f003c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:32.864 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.854+0000 7f0051d9b700 1 -- 172.21.15.149:0/1947851495 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f003c005210 msgr2=0x7f003c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:32.865 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.854+0000 7f0051d9b700 1 --2- 172.21.15.149:0/1947851495 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f003c005210 0x7f003c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:32.865 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.854+0000 7f0051d9b700 1 -- 172.21.15.149:0/1947851495 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f003c003a00 msgr2=0x7f003c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:32.865 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.854+0000 7f0051d9b700 1 --2- 172.21.15.149:0/1947851495 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f003c003a00 0x7f003c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:32.865 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.854+0000 7f0051d9b700 1 -- 172.21.15.149:0/1947851495 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f003c0035b0 con 0x7f003c004850 2023-11-08T19:24:32.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.854+0000 7f005259c700 1 --2- 172.21.15.149:0/1947851495 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f003c003a00 0x7f003c003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:24:32.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.854+0000 7f0052d9d700 1 -- 172.21.15.149:0/1947851495 reap_dead start 2023-11-08T19:24:32.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.854+0000 7f0051d9b700 1 --2- 172.21.15.149:0/1947851495 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f003c004850 0x7f003c004cd0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f0044009b60 tx=0x7f003c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a792b25101a9b77e server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:32.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.855+0000 7f005159a700 1 -- 172.21.15.149:0/1947851495 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004400e6c0 con 0x7f003c004850 2023-11-08T19:24:32.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.855+0000 7f005159a700 1 -- 172.21.15.149:0/1947851495 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f004400e820 con 0x7f003c004850 2023-11-08T19:24:32.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.855+0000 7f005159a700 1 -- 172.21.15.149:0/1947851495 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004400eb90 con 0x7f003c004850 2023-11-08T19:24:32.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.855+0000 7f0058eda700 1 -- 172.21.15.149:0/1947851495 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f003c004850 msgr2=0x7f003c004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:32.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.855+0000 7f0058eda700 1 --2- 172.21.15.149:0/1947851495 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f003c004850 0x7f003c004cd0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f0044009b60 tx=0x7f003c005880 comp rx=0 tx=0).stop 2023-11-08T19:24:32.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.855+0000 7f0058eda700 1 -- 172.21.15.149:0/1947851495 shutdown_connections 2023-11-08T19:24:32.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.855+0000 7f0058eda700 1 --2- 172.21.15.149:0/1947851495 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f003c004850 0x7f003c004cd0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:32.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.855+0000 7f0058eda700 1 -- 172.21.15.149:0/1947851495 >> 172.21.15.149:0/1947851495 conn(0x7f005406b3d0 msgr2=0x7f00540cf460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:32.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.855+0000 7f0058eda700 1 -- 172.21.15.149:0/1947851495 shutdown_connections 2023-11-08T19:24:32.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.855+0000 7f0058eda700 1 -- 172.21.15.149:0/1947851495 wait complete. 2023-11-08T19:24:32.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.857+0000 7f0058eda700 1 Processor -- start 2023-11-08T19:24:32.869 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.857+0000 7f0058eda700 1 -- start start 2023-11-08T19:24:32.872 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.858+0000 7f0058eda700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f003c004850 0x7f005414f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:32.872 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.858+0000 7f0058eda700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0054153b80 0x7f005406cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:32.872 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.858+0000 7f0058eda700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f005406d220 0x7f00540b4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:32.872 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.858+0000 7f0058eda700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0054153760 con 0x7f005406d220 2023-11-08T19:24:32.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.858+0000 7f0058eda700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f005406d6a0 con 0x7f003c004850 2023-11-08T19:24:32.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.858+0000 7f0058eda700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0054152880 con 0x7f0054153b80 2023-11-08T19:24:32.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.858+0000 7f0052d9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f005406d220 0x7f00540b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:32.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.858+0000 7f0052d9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f005406d220 0x7f00540b4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39628/0 (socket says 172.21.15.149:39628) 2023-11-08T19:24:32.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.858+0000 7f0052d9d700 1 -- 172.21.15.149:0/1468256743 learned_addr learned my addr 172.21.15.149:0/1468256743 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:32.874 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.858+0000 7f005259c700 1 --2- 172.21.15.149:0/1468256743 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f003c004850 0x7f005414f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:32.874 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.858+0000 7f0051d9b700 1 --2- 172.21.15.149:0/1468256743 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0054153b80 0x7f005406cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:32.874 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.858+0000 7f0052d9d700 1 -- 172.21.15.149:0/1468256743 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0054153b80 msgr2=0x7f005406cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:32.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.858+0000 7f0052d9d700 1 --2- 172.21.15.149:0/1468256743 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0054153b80 0x7f005406cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:32.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.858+0000 7f0052d9d700 1 -- 172.21.15.149:0/1468256743 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f003c004850 msgr2=0x7f005414f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:32.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.858+0000 7f0052d9d700 1 --2- 172.21.15.149:0/1468256743 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f003c004850 0x7f005414f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:32.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.858+0000 7f0052d9d700 1 -- 172.21.15.149:0/1468256743 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0054152b20 con 0x7f005406d220 2023-11-08T19:24:32.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.858+0000 7f005259c700 1 --2- 172.21.15.149:0/1468256743 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f003c004850 0x7f005414f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:24:32.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.858+0000 7f0051d9b700 1 --2- 172.21.15.149:0/1468256743 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0054153b80 0x7f005406cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:24:32.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.859+0000 7f0052d9d700 1 --2- 172.21.15.149:0/1468256743 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f005406d220 0x7f00540b4450 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f00540b1880 tx=0x7f004c00e5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:32.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.859+0000 7f0042ffd700 1 -- 172.21.15.149:0/1468256743 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c010e70 con 0x7f005406d220 2023-11-08T19:24:32.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.859+0000 7f0042ffd700 1 -- 172.21.15.149:0/1468256743 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f004c003a00 con 0x7f005406d220 2023-11-08T19:24:32.878 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.859+0000 7f0058eda700 1 -- 172.21.15.149:0/1468256743 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f005414fb10 con 0x7f005406d220 2023-11-08T19:24:32.878 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.859+0000 7f0042ffd700 1 -- 172.21.15.149:0/1468256743 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c003db0 con 0x7f005406d220 2023-11-08T19:24:32.879 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.859+0000 7f0058eda700 1 -- 172.21.15.149:0/1468256743 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00541530a0 con 0x7f005406d220 2023-11-08T19:24:32.879 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.860+0000 7f0058eda700 1 -- 172.21.15.149:0/1468256743 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00540c5d70 con 0x7f005406d220 2023-11-08T19:24:32.879 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.860+0000 7f0042ffd700 1 -- 172.21.15.149:0/1468256743 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f004c0050d0 con 0x7f005406d220 2023-11-08T19:24:32.879 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.861+0000 7f0042ffd700 1 --2- 172.21.15.149:0/1468256743 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f003406af00 0x7f003406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:32.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.861+0000 7f005259c700 1 --2- 172.21.15.149:0/1468256743 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f003406af00 0x7f003406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:32.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.861+0000 7f0042ffd700 1 -- 172.21.15.149:0/1468256743 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6438+0+0 (secure 0 0 0) 0x7f004c08bcd0 con 0x7f005406d220 2023-11-08T19:24:32.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.861+0000 7f005259c700 1 --2- 172.21.15.149:0/1468256743 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f003406af00 0x7f003406d3c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0048001eb0 tx=0x7f0048000ed0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:32.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:32.865+0000 7f0042ffd700 1 -- 172.21.15.149:0/1468256743 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f004c056b30 con 0x7f005406d220 2023-11-08T19:24:33.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.055+0000 7f0058eda700 1 -- 172.21.15.149:0/1468256743 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f00540745f0 con 0x7f005406d220 2023-11-08T19:24:33.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.056+0000 7f0042ffd700 1 -- 172.21.15.149:0/1468256743 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+18649 (secure 0 0 0) 0x7f004c05a150 con 0x7f005406d220 2023-11-08T19:24:33.059 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:24:33.060 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":42,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:24:32.128826+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-08T19:24:14.467859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-08T19:24:15.470328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-08T19:24:29.516185+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":1,"length":1}]}],"new_removed_snaps":[{"pool":7,"snaps":[{"begin":1,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:24:33.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.059+0000 7f0058eda700 1 -- 172.21.15.149:0/1468256743 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f003406af00 msgr2=0x7f003406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:33.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.059+0000 7f0058eda700 1 --2- 172.21.15.149:0/1468256743 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f003406af00 0x7f003406d3c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0048001eb0 tx=0x7f0048000ed0 comp rx=0 tx=0).stop 2023-11-08T19:24:33.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.059+0000 7f0058eda700 1 -- 172.21.15.149:0/1468256743 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f005406d220 msgr2=0x7f00540b4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:33.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.059+0000 7f0058eda700 1 --2- 172.21.15.149:0/1468256743 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f005406d220 0x7f00540b4450 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f00540b1880 tx=0x7f004c00e5d0 comp rx=0 tx=0).stop 2023-11-08T19:24:33.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.059+0000 7f0058eda700 1 -- 172.21.15.149:0/1468256743 shutdown_connections 2023-11-08T19:24:33.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.059+0000 7f0058eda700 1 --2- 172.21.15.149:0/1468256743 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f003406af00 0x7f003406d3c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:33.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.059+0000 7f0058eda700 1 --2- 172.21.15.149:0/1468256743 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f003c004850 0x7f005414f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:33.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.059+0000 7f0058eda700 1 --2- 172.21.15.149:0/1468256743 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f005406d220 0x7f00540b4450 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:33.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.059+0000 7f0058eda700 1 --2- 172.21.15.149:0/1468256743 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0054153b80 0x7f005406cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:33.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.059+0000 7f0058eda700 1 -- 172.21.15.149:0/1468256743 >> 172.21.15.149:0/1468256743 conn(0x7f005406b3d0 msgr2=0x7f00540aeec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:33.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.059+0000 7f0058eda700 1 -- 172.21.15.149:0/1468256743 shutdown_connections 2023-11-08T19:24:33.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.059+0000 7f0058eda700 1 -- 172.21.15.149:0/1468256743 wait complete. 2023-11-08T19:24:33.073 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-08T19:22:56.023194+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-08T19:24:14.467859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-11-08T19:24:15.470328+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-08T19:24:29.516185+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 42, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-08T19:24:33.074 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-08T19:24:33.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.199+0000 7f2c6caf5700 1 Processor -- start 2023-11-08T19:24:33.202 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.199+0000 7f2c6caf5700 1 -- start start 2023-11-08T19:24:33.204 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.200+0000 7f2c6caf5700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f2c6815df40 0x7f2c6806c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:33.204 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.200+0000 7f2c6caf5700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2c6806ab80 0x7f2c6806c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:33.204 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.200+0000 7f2c6caf5700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c6815e320 con 0x7f2c680cf1c0 2023-11-08T19:24:33.205 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.200+0000 7f2c6caf5700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c6806b020 con 0x7f2c6806ab80 2023-11-08T19:24:33.205 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.200+0000 7f2c6caf5700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c6806b2e0 con 0x7f2c6815df40 2023-11-08T19:24:33.205 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.200+0000 7f2c65d9b700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2c6806ab80 0x7f2c6806c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:33.205 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.200+0000 7f2c66d9d700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f2c680cf1c0 0x7f2c680caf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:41634/0 (socket says 172.21.15.149:41634) 2023-11-08T19:24:33.205 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.200+0000 7f2c66d9d700 1 -- 172.21.15.149:0/2678569603 learned_addr learned my addr 172.21.15.149:0/2678569603 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:24:33.205 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.200+0000 7f2c65d9b700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2c6806ab80 0x7f2c6806c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39632/0 (socket says 172.21.15.149:39632) 2023-11-08T19:24:33.206 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.200+0000 7f2c6659c700 1 --2- 172.21.15.149:0/2678569603 >> v2:172.21.15.160:3300/0 conn(0x7f2c6815df40 0x7f2c6806c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:33.206 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.200+0000 7f2c65d9b700 1 -- 172.21.15.149:0/2678569603 >> v2:172.21.15.160:3300/0 conn(0x7f2c6815df40 msgr2=0x7f2c6806c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:33.206 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.200+0000 7f2c65d9b700 1 --2- 172.21.15.149:0/2678569603 >> v2:172.21.15.160:3300/0 conn(0x7f2c6815df40 0x7f2c6806c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:33.206 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.200+0000 7f2c65d9b700 1 -- 172.21.15.149:0/2678569603 >> v1:172.21.15.149:6789/0 conn(0x7f2c680cf1c0 legacy=0x7f2c680caf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:33.207 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.201+0000 7f2c65d9b700 1 -- 172.21.15.149:0/2678569603 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c6806b5c0 con 0x7f2c6806ab80 2023-11-08T19:24:33.207 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.201+0000 7f2c6559a700 1 -- 172.21.15.149:0/2678569603 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3627068353 0 0) 0x7f2c6815e320 con 0x7f2c680cf1c0 2023-11-08T19:24:33.207 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.201+0000 7f2c65d9b700 1 --2- 172.21.15.149:0/2678569603 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c6806ab80 0x7f2c6806c5e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f2c680ce190 tx=0x7f2c58009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9de6b581b3946b17 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:33.207 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.201+0000 7f2c6559a700 1 -- 172.21.15.149:0/2678569603 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c58011830 con 0x7f2c6806ab80 2023-11-08T19:24:33.207 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.201+0000 7f2c6559a700 1 -- 172.21.15.149:0/2678569603 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c58011990 con 0x7f2c6806ab80 2023-11-08T19:24:33.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.201+0000 7f2c6559a700 1 -- 172.21.15.149:0/2678569603 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c58011d20 con 0x7f2c6806ab80 2023-11-08T19:24:33.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.201+0000 7f2c6caf5700 1 -- 172.21.15.149:0/2678569603 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c6806ab80 msgr2=0x7f2c6806c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:33.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.201+0000 7f2c6caf5700 1 --2- 172.21.15.149:0/2678569603 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c6806ab80 0x7f2c6806c5e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f2c680ce190 tx=0x7f2c58009b20 comp rx=0 tx=0).stop 2023-11-08T19:24:33.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.201+0000 7f2c6caf5700 1 -- 172.21.15.149:0/2678569603 shutdown_connections 2023-11-08T19:24:33.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.201+0000 7f2c6caf5700 1 --2- 172.21.15.149:0/2678569603 >> v2:172.21.15.160:3300/0 conn(0x7f2c6815df40 0x7f2c6806c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:33.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.201+0000 7f2c6caf5700 1 --2- 172.21.15.149:0/2678569603 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c6806ab80 0x7f2c6806c5e0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:33.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.201+0000 7f2c6caf5700 1 -- 172.21.15.149:0/2678569603 >> 172.21.15.149:0/2678569603 conn(0x7f2c680d0640 msgr2=0x7f2c680d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:33.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.201+0000 7f2c6caf5700 1 -- 172.21.15.149:0/2678569603 shutdown_connections 2023-11-08T19:24:33.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.201+0000 7f2c6caf5700 1 -- 172.21.15.149:0/2678569603 wait complete. 2023-11-08T19:24:33.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.203+0000 7f2c6caf5700 1 Processor -- start 2023-11-08T19:24:33.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.203+0000 7f2c6caf5700 1 -- start start 2023-11-08T19:24:33.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.204+0000 7f2c6caf5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c6806ab80 0x7f2c68158590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:33.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.204+0000 7f2c6caf5700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2c680cf1c0 0x7f2c680c5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:33.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.204+0000 7f2c6caf5700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2c6815df40 0x7f2c680c4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:33.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.204+0000 7f2c6caf5700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c680c5230 con 0x7f2c6806ab80 2023-11-08T19:24:33.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.204+0000 7f2c6caf5700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c680ae7c0 con 0x7f2c6815df40 2023-11-08T19:24:33.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.204+0000 7f2c6caf5700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c680adc40 con 0x7f2c680cf1c0 2023-11-08T19:24:33.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.204+0000 7f2c6659c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c6806ab80 0x7f2c68158590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:33.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.204+0000 7f2c6659c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c6806ab80 0x7f2c68158590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39638/0 (socket says 172.21.15.149:39638) 2023-11-08T19:24:33.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.204+0000 7f2c6659c700 1 -- 172.21.15.149:0/3027774632 learned_addr learned my addr 172.21.15.149:0/3027774632 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:33.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.204+0000 7f2c6659c700 1 -- 172.21.15.149:0/3027774632 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2c680cf1c0 msgr2=0x7f2c680c5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:33.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.204+0000 7f2c6659c700 1 --2- 172.21.15.149:0/3027774632 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2c680cf1c0 0x7f2c680c5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:33.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.204+0000 7f2c6659c700 1 -- 172.21.15.149:0/3027774632 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2c6815df40 msgr2=0x7f2c680c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:33.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.204+0000 7f2c6659c700 1 --2- 172.21.15.149:0/3027774632 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2c6815df40 0x7f2c680c4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:33.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.204+0000 7f2c6659c700 1 -- 172.21.15.149:0/3027774632 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c580094a0 con 0x7f2c6806ab80 2023-11-08T19:24:33.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.204+0000 7f2c6659c700 1 --2- 172.21.15.149:0/3027774632 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c6806ab80 0x7f2c68158590 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c00c820 tx=0x7f2c5c00cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:33.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.204+0000 7f2c56ffd700 1 -- 172.21.15.149:0/3027774632 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c011800 con 0x7f2c6806ab80 2023-11-08T19:24:33.216 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.204+0000 7f2c56ffd700 1 -- 172.21.15.149:0/3027774632 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c5c011960 con 0x7f2c6806ab80 2023-11-08T19:24:33.216 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.204+0000 7f2c56ffd700 1 -- 172.21.15.149:0/3027774632 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c011cf0 con 0x7f2c6806ab80 2023-11-08T19:24:33.216 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.204+0000 7f2c6caf5700 1 -- 172.21.15.149:0/3027774632 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c680adf20 con 0x7f2c6806ab80 2023-11-08T19:24:33.216 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.204+0000 7f2c6caf5700 1 -- 172.21.15.149:0/3027774632 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c680ae4e0 con 0x7f2c6806ab80 2023-11-08T19:24:33.216 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.205+0000 7f2c6caf5700 1 -- 172.21.15.149:0/3027774632 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c6815e390 con 0x7f2c6806ab80 2023-11-08T19:24:33.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.206+0000 7f2c56ffd700 1 -- 172.21.15.149:0/3027774632 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2c5c018360 con 0x7f2c6806ab80 2023-11-08T19:24:33.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.206+0000 7f2c56ffd700 1 --2- 172.21.15.149:0/3027774632 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2c4806af00 0x7f2c4806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:33.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.206+0000 7f2c56ffd700 1 -- 172.21.15.149:0/3027774632 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6438+0+0 (secure 0 0 0) 0x7f2c5c089740 con 0x7f2c6806ab80 2023-11-08T19:24:33.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.206+0000 7f2c65d9b700 1 --2- 172.21.15.149:0/3027774632 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2c4806af00 0x7f2c4806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:33.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.206+0000 7f2c65d9b700 1 --2- 172.21.15.149:0/3027774632 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2c4806af00 0x7f2c4806d3c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2c580090b0 tx=0x7f2c58010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:33.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.211+0000 7f2c56ffd700 1 -- 172.21.15.149:0/3027774632 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2c5c0545a0 con 0x7f2c6806ab80 2023-11-08T19:24:33.403 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.401+0000 7f2c6caf5700 1 -- 172.21.15.149:0/3027774632 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2c6804f730 con 0x7f2c6806ab80 2023-11-08T19:24:33.404 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.401+0000 7f2c56ffd700 1 -- 172.21.15.149:0/3027774632 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2c5c057bc0 con 0x7f2c6806ab80 2023-11-08T19:24:33.404 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 1 2023-11-08T19:24:33.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.403+0000 7f2c6caf5700 1 -- 172.21.15.149:0/3027774632 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2c4806af00 msgr2=0x7f2c4806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:33.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.403+0000 7f2c6caf5700 1 --2- 172.21.15.149:0/3027774632 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2c4806af00 0x7f2c4806d3c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2c580090b0 tx=0x7f2c58010000 comp rx=0 tx=0).stop 2023-11-08T19:24:33.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.403+0000 7f2c6caf5700 1 -- 172.21.15.149:0/3027774632 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c6806ab80 msgr2=0x7f2c68158590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:33.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.403+0000 7f2c6caf5700 1 --2- 172.21.15.149:0/3027774632 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c6806ab80 0x7f2c68158590 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c00c820 tx=0x7f2c5c00cbe0 comp rx=0 tx=0).stop 2023-11-08T19:24:33.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.403+0000 7f2c6caf5700 1 -- 172.21.15.149:0/3027774632 shutdown_connections 2023-11-08T19:24:33.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.403+0000 7f2c6caf5700 1 --2- 172.21.15.149:0/3027774632 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2c4806af00 0x7f2c4806d3c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:33.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.403+0000 7f2c6caf5700 1 --2- 172.21.15.149:0/3027774632 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2c6815df40 0x7f2c680c4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:33.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.403+0000 7f2c6caf5700 1 --2- 172.21.15.149:0/3027774632 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c6806ab80 0x7f2c68158590 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:33.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.403+0000 7f2c6caf5700 1 --2- 172.21.15.149:0/3027774632 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2c680cf1c0 0x7f2c680c5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:33.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.403+0000 7f2c6caf5700 1 -- 172.21.15.149:0/3027774632 >> 172.21.15.149:0/3027774632 conn(0x7f2c680d0640 msgr2=0x7f2c681597d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:33.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.403+0000 7f2c6caf5700 1 -- 172.21.15.149:0/3027774632 shutdown_connections 2023-11-08T19:24:33.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.403+0000 7f2c6caf5700 1 -- 172.21.15.149:0/3027774632 wait complete. 2023-11-08T19:24:33.418 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-08T19:24:33.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.539+0000 7f9eb2978700 1 Processor -- start 2023-11-08T19:24:33.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.539+0000 7f9eb2978700 1 -- start start 2023-11-08T19:24:33.545 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.540+0000 7f9eb2978700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f9eac0cfaf0 0x7f9eac164e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:33.545 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.540+0000 7f9eb2978700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9eac157e90 con 0x7f9eac157ab0 2023-11-08T19:24:33.545 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.540+0000 7f9eb2978700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9eac15a5b0 con 0x7f9eac0ce720 2023-11-08T19:24:33.545 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.540+0000 7f9eb2978700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9eac15b230 con 0x7f9eac0cfaf0 2023-11-08T19:24:33.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.540+0000 7f9eabfff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f9eac157ab0 0x7f9eac0ae9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:41648/0 (socket says 172.21.15.149:41648) 2023-11-08T19:24:33.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.540+0000 7f9eabfff700 1 -- 172.21.15.149:0/2657196207 learned_addr learned my addr 172.21.15.149:0/2657196207 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:24:33.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.540+0000 7f9eb0f15700 1 --2- 172.21.15.149:0/2657196207 >> v2:172.21.15.160:3300/0 conn(0x7f9eac0cfaf0 0x7f9eac164e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:33.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.540+0000 7f9eaaffd700 1 -- 172.21.15.149:0/2657196207 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 362926727 0 0) 0x7f9eac157e90 con 0x7f9eac157ab0 2023-11-08T19:24:33.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.540+0000 7f9eaaffd700 1 -- 172.21.15.149:0/2657196207 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e940035b0 con 0x7f9eac157ab0 2023-11-08T19:24:33.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.541+0000 7f9eaaffd700 1 -- 172.21.15.149:0/2657196207 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 698884596 0 0) 0x7f9e940035b0 con 0x7f9eac157ab0 2023-11-08T19:24:33.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.541+0000 7f9eaaffd700 1 -- 172.21.15.149:0/2657196207 >> v2:172.21.15.160:3300/0 conn(0x7f9eac0cfaf0 msgr2=0x7f9eac164e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:33.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.541+0000 7f9eaaffd700 1 --2- 172.21.15.149:0/2657196207 >> v2:172.21.15.160:3300/0 conn(0x7f9eac0cfaf0 0x7f9eac164e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:33.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.541+0000 7f9eaaffd700 1 -- 172.21.15.149:0/2657196207 >> v1:172.21.15.160:6789/0 conn(0x7f9eac0ce720 legacy=0x7f9eac0cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:33.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.541+0000 7f9eaaffd700 1 -- 172.21.15.149:0/2657196207 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eac15a890 con 0x7f9eac157ab0 2023-11-08T19:24:33.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.541+0000 7f9eaaffd700 1 -- 172.21.15.149:0/2657196207 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f9e9c001670 con 0x7f9eac157ab0 2023-11-08T19:24:33.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.541+0000 7f9eaaffd700 1 -- 172.21.15.149:0/2657196207 >> v1:172.21.15.149:6789/0 conn(0x7f9eac157ab0 legacy=0x7f9eac0ae9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:33.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.541+0000 7f9eaaffd700 1 --2- 172.21.15.149:0/2657196207 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9e94003a70 0x7f9e94003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:33.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.541+0000 7f9eaaffd700 1 --2- 172.21.15.149:0/2657196207 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e94004850 0x7f9e94004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:33.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.541+0000 7f9eaaffd700 1 --2- 172.21.15.149:0/2657196207 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9e94005280 0x7f9e9400cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:33.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.541+0000 7f9eaaffd700 1 -- 172.21.15.149:0/2657196207 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac15b230 con 0x7f9e94004850 2023-11-08T19:24:33.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.541+0000 7f9eaaffd700 1 -- 172.21.15.149:0/2657196207 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9400d2f0 con 0x7f9e94003a70 2023-11-08T19:24:33.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.541+0000 7f9eaaffd700 1 -- 172.21.15.149:0/2657196207 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9400d4b0 con 0x7f9e94005280 2023-11-08T19:24:33.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.541+0000 7f9eab7fe700 1 --2- 172.21.15.149:0/2657196207 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e94004850 0x7f9e94004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:33.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.541+0000 7f9eabfff700 1 --2- 172.21.15.149:0/2657196207 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9e94003a70 0x7f9e94003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:33.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.541+0000 7f9eb0f15700 1 --2- 172.21.15.149:0/2657196207 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9e94005280 0x7f9e9400cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:33.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.541+0000 7f9eab7fe700 1 -- 172.21.15.149:0/2657196207 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9e94005280 msgr2=0x7f9e9400cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:33.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.541+0000 7f9eab7fe700 1 --2- 172.21.15.149:0/2657196207 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9e94005280 0x7f9e9400cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:33.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.541+0000 7f9eab7fe700 1 -- 172.21.15.149:0/2657196207 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9e94003a70 msgr2=0x7f9e94003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:33.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.541+0000 7f9eab7fe700 1 --2- 172.21.15.149:0/2657196207 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9e94003a70 0x7f9e94003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:33.551 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.541+0000 7f9eb0f15700 1 -- 172.21.15.149:0/2657196207 reap_dead start 2023-11-08T19:24:33.551 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.541+0000 7f9eab7fe700 1 -- 172.21.15.149:0/2657196207 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e940035b0 con 0x7f9e94004850 2023-11-08T19:24:33.551 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.541+0000 7f9eab7fe700 1 --2- 172.21.15.149:0/2657196207 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e94004850 0x7f9e94004cd0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f9ea00017c0 tx=0x7f9e94005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df6ad12e3deeb89a server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:33.551 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.541+0000 7f9eaaffd700 1 -- 172.21.15.149:0/2657196207 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea00052d0 con 0x7f9e94004850 2023-11-08T19:24:33.551 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.541+0000 7f9eaaffd700 1 -- 172.21.15.149:0/2657196207 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea0005450 con 0x7f9e94004850 2023-11-08T19:24:33.551 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.541+0000 7f9eaaffd700 1 -- 172.21.15.149:0/2657196207 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea00038c0 con 0x7f9e94004850 2023-11-08T19:24:33.552 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.542+0000 7f9eb2978700 1 -- 172.21.15.149:0/2657196207 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e94004850 msgr2=0x7f9e94004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:33.552 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.542+0000 7f9eb2978700 1 --2- 172.21.15.149:0/2657196207 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e94004850 0x7f9e94004cd0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f9ea00017c0 tx=0x7f9e94005880 comp rx=0 tx=0).stop 2023-11-08T19:24:33.552 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.542+0000 7f9eb2978700 1 -- 172.21.15.149:0/2657196207 shutdown_connections 2023-11-08T19:24:33.552 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.542+0000 7f9eb2978700 1 --2- 172.21.15.149:0/2657196207 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e94004850 0x7f9e94004cd0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:33.552 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.542+0000 7f9eb2978700 1 -- 172.21.15.149:0/2657196207 >> 172.21.15.149:0/2657196207 conn(0x7f9eac06b1b0 msgr2=0x7f9eac0b13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:33.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.542+0000 7f9eb2978700 1 -- 172.21.15.149:0/2657196207 shutdown_connections 2023-11-08T19:24:33.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.542+0000 7f9eb2978700 1 -- 172.21.15.149:0/2657196207 wait complete. 2023-11-08T19:24:33.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.544+0000 7f9eb2978700 1 Processor -- start 2023-11-08T19:24:33.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.544+0000 7f9eb2978700 1 -- start start 2023-11-08T19:24:33.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.545+0000 7f9eb2978700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e94004850 0x7f9eac1f2920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:33.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.545+0000 7f9eb2978700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9eac1f1760 0x7f9eac158fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:33.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.545+0000 7f9eb2978700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9eac159500 0x7f9eac0cb850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:33.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.545+0000 7f9eb2978700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac15eaa0 con 0x7f9e94004850 2023-11-08T19:24:33.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.545+0000 7f9eb2978700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac1f1c60 con 0x7f9eac1f1760 2023-11-08T19:24:33.558 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.545+0000 7f9eb2978700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac1f1f40 con 0x7f9eac159500 2023-11-08T19:24:33.558 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.545+0000 7f9eabfff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e94004850 0x7f9eac1f2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:33.558 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.545+0000 7f9eabfff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e94004850 0x7f9eac1f2920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39658/0 (socket says 172.21.15.149:39658) 2023-11-08T19:24:33.558 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.545+0000 7f9eabfff700 1 -- 172.21.15.149:0/3895528177 learned_addr learned my addr 172.21.15.149:0/3895528177 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:33.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.545+0000 7f9eabfff700 1 -- 172.21.15.149:0/3895528177 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9eac159500 msgr2=0x7f9eac0cb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:33.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.545+0000 7f9eabfff700 1 --2- 172.21.15.149:0/3895528177 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9eac159500 0x7f9eac0cb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:33.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.545+0000 7f9eabfff700 1 -- 172.21.15.149:0/3895528177 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9eac1f1760 msgr2=0x7f9eac158fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:33.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.545+0000 7f9eabfff700 1 --2- 172.21.15.149:0/3895528177 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9eac1f1760 0x7f9eac158fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:33.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.545+0000 7f9eabfff700 1 -- 172.21.15.149:0/3895528177 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eac1f2220 con 0x7f9e94004850 2023-11-08T19:24:33.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.545+0000 7f9eabfff700 1 --2- 172.21.15.149:0/3895528177 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e94004850 0x7f9eac1f2920 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c007290 tx=0x7f9e9c007650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:33.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.545+0000 7f9ea8ff9700 1 -- 172.21.15.149:0/3895528177 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9c00f640 con 0x7f9e94004850 2023-11-08T19:24:33.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.545+0000 7f9ea8ff9700 1 -- 172.21.15.149:0/3895528177 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e9c00f7a0 con 0x7f9e94004850 2023-11-08T19:24:33.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.545+0000 7f9ea8ff9700 1 -- 172.21.15.149:0/3895528177 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9c00fb30 con 0x7f9e94004850 2023-11-08T19:24:33.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.545+0000 7f9eb2978700 1 -- 172.21.15.149:0/3895528177 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9eac1f2500 con 0x7f9e94004850 2023-11-08T19:24:33.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.545+0000 7f9eb2978700 1 -- 172.21.15.149:0/3895528177 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eac1f4a40 con 0x7f9e94004850 2023-11-08T19:24:33.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.546+0000 7f9eb2978700 1 -- 172.21.15.149:0/3895528177 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9eac04f730 con 0x7f9e94004850 2023-11-08T19:24:33.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.547+0000 7f9ea8ff9700 1 -- 172.21.15.149:0/3895528177 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9e9c00fc90 con 0x7f9e94004850 2023-11-08T19:24:33.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.547+0000 7f9ea8ff9700 1 --2- 172.21.15.149:0/3895528177 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9e9806af00 0x7f9e9806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:33.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.547+0000 7f9ea8ff9700 1 -- 172.21.15.149:0/3895528177 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6438+0+0 (secure 0 0 0) 0x7f9e9c089720 con 0x7f9e94004850 2023-11-08T19:24:33.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.547+0000 7f9eab7fe700 1 --2- 172.21.15.149:0/3895528177 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9e9806af00 0x7f9e9806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:33.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.548+0000 7f9eab7fe700 1 --2- 172.21.15.149:0/3895528177 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9e9806af00 0x7f9e9806d3c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9eac0b2560 tx=0x7f9ea0011000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:33.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.552+0000 7f9ea8ff9700 1 -- 172.21.15.149:0/3895528177 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9e9c054580 con 0x7f9e94004850 2023-11-08T19:24:33.746 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.744+0000 7f9eb2978700 1 -- 172.21.15.149:0/3895528177 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9eac0ca010 con 0x7f9e94004850 2023-11-08T19:24:33.747 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.745+0000 7f9ea8ff9700 1 -- 172.21.15.149:0/3895528177 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v42) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9e9c057ba0 con 0x7f9e94004850 2023-11-08T19:24:33.747 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:24:33.749 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.747+0000 7f9eb2978700 1 -- 172.21.15.149:0/3895528177 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9e9806af00 msgr2=0x7f9e9806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:33.749 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.747+0000 7f9eb2978700 1 --2- 172.21.15.149:0/3895528177 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9e9806af00 0x7f9e9806d3c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9eac0b2560 tx=0x7f9ea0011000 comp rx=0 tx=0).stop 2023-11-08T19:24:33.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.747+0000 7f9eb2978700 1 -- 172.21.15.149:0/3895528177 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e94004850 msgr2=0x7f9eac1f2920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:33.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.747+0000 7f9eb2978700 1 --2- 172.21.15.149:0/3895528177 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e94004850 0x7f9eac1f2920 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c007290 tx=0x7f9e9c007650 comp rx=0 tx=0).stop 2023-11-08T19:24:33.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.747+0000 7f9eb2978700 1 -- 172.21.15.149:0/3895528177 shutdown_connections 2023-11-08T19:24:33.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.747+0000 7f9eb2978700 1 --2- 172.21.15.149:0/3895528177 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9e9806af00 0x7f9e9806d3c0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:33.751 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.747+0000 7f9eb2978700 1 --2- 172.21.15.149:0/3895528177 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9eac159500 0x7f9eac0cb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:33.751 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.747+0000 7f9eb2978700 1 --2- 172.21.15.149:0/3895528177 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e94004850 0x7f9eac1f2920 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:33.751 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.747+0000 7f9eb2978700 1 --2- 172.21.15.149:0/3895528177 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9eac1f1760 0x7f9eac158fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:33.751 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.747+0000 7f9eb2978700 1 -- 172.21.15.149:0/3895528177 >> 172.21.15.149:0/3895528177 conn(0x7f9eac06b1b0 msgr2=0x7f9eac06d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:33.751 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.747+0000 7f9eb2978700 1 -- 172.21.15.149:0/3895528177 shutdown_connections 2023-11-08T19:24:33.752 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.747+0000 7f9eb2978700 1 -- 172.21.15.149:0/3895528177 wait complete. 2023-11-08T19:24:33.761 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-08T19:24:33.885 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.882+0000 7f0b24d1e700 1 Processor -- start 2023-11-08T19:24:33.885 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.883+0000 7f0b24d1e700 1 -- start start 2023-11-08T19:24:33.887 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.883+0000 7f0b24d1e700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0b200cc0d0 0x7f0b2015f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:33.887 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.884+0000 7f0b24d1e700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b2015be80 con 0x7f0b200cc4b0 2023-11-08T19:24:33.888 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.884+0000 7f0b24d1e700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b2015fba0 con 0x7f0b200cc910 2023-11-08T19:24:33.888 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.884+0000 7f0b24d1e700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b2015f9b0 con 0x7f0b200cc0d0 2023-11-08T19:24:33.888 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.884+0000 7f0b1e59c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0b200cc0d0 0x7f0b2015f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:33.888 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.884+0000 7f0b1dd9b700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f0b200cc4b0 0x7f0b2015c620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:41668/0 (socket says 172.21.15.149:41668) 2023-11-08T19:24:33.889 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.884+0000 7f0b1dd9b700 1 -- 172.21.15.149:0/2971733510 learned_addr learned my addr 172.21.15.149:0/2971733510 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:24:33.889 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.884+0000 7f0b1e59c700 1 -- 172.21.15.149:0/2971733510 >> v1:172.21.15.160:6789/0 conn(0x7f0b200cc910 legacy=0x7f0b200cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:33.889 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.884+0000 7f0b1e59c700 1 -- 172.21.15.149:0/2971733510 >> v1:172.21.15.149:6789/0 conn(0x7f0b200cc4b0 legacy=0x7f0b2015c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:33.889 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.884+0000 7f0b1d59a700 1 -- 172.21.15.149:0/2971733510 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2987609490 0 0) 0x7f0b2015be80 con 0x7f0b200cc4b0 2023-11-08T19:24:33.889 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.884+0000 7f0b1e59c700 1 -- 172.21.15.149:0/2971733510 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b2015fe80 con 0x7f0b200cc0d0 2023-11-08T19:24:33.890 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.884+0000 7f0b1e59c700 1 --2- 172.21.15.149:0/2971733510 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b200cc0d0 0x7f0b2015f470 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f0b14009840 tx=0x7f0b14009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed803b53c570a663 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:33.890 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.884+0000 7f0b1d59a700 1 -- 172.21.15.149:0/2971733510 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b14011830 con 0x7f0b200cc0d0 2023-11-08T19:24:33.890 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.884+0000 7f0b1d59a700 1 -- 172.21.15.149:0/2971733510 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b14011990 con 0x7f0b200cc0d0 2023-11-08T19:24:33.890 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.884+0000 7f0b1d59a700 1 -- 172.21.15.149:0/2971733510 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b14011d20 con 0x7f0b200cc0d0 2023-11-08T19:24:33.890 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.885+0000 7f0b24d1e700 1 -- 172.21.15.149:0/2971733510 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b200cc0d0 msgr2=0x7f0b2015f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:33.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.885+0000 7f0b24d1e700 1 --2- 172.21.15.149:0/2971733510 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b200cc0d0 0x7f0b2015f470 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f0b14009840 tx=0x7f0b14009b50 comp rx=0 tx=0).stop 2023-11-08T19:24:33.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.885+0000 7f0b24d1e700 1 -- 172.21.15.149:0/2971733510 shutdown_connections 2023-11-08T19:24:33.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.885+0000 7f0b24d1e700 1 --2- 172.21.15.149:0/2971733510 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b200cc0d0 0x7f0b2015f470 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:33.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.885+0000 7f0b24d1e700 1 -- 172.21.15.149:0/2971733510 >> 172.21.15.149:0/2971733510 conn(0x7f0b2006f120 msgr2=0x7f0b2006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:33.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.885+0000 7f0b24d1e700 1 -- 172.21.15.149:0/2971733510 shutdown_connections 2023-11-08T19:24:33.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.885+0000 7f0b24d1e700 1 -- 172.21.15.149:0/2971733510 wait complete. 2023-11-08T19:24:33.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.886+0000 7f0b24d1e700 1 Processor -- start 2023-11-08T19:24:33.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.886+0000 7f0b24d1e700 1 -- start start 2023-11-08T19:24:33.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.887+0000 7f0b24d1e700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0b200cc0d0 0x7f0b200c79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:33.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.887+0000 7f0b24d1e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b200cc4b0 0x7f0b201568e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:33.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.887+0000 7f0b24d1e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b200cc910 0x7f0b20156e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:33.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.887+0000 7f0b24d1e700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b200c9870 con 0x7f0b200cc910 2023-11-08T19:24:33.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.887+0000 7f0b24d1e700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b20157730 con 0x7f0b200cc4b0 2023-11-08T19:24:33.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.887+0000 7f0b24d1e700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b20157450 con 0x7f0b200cc0d0 2023-11-08T19:24:33.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.887+0000 7f0b1ed9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b200cc910 0x7f0b20156e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:33.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.887+0000 7f0b1ed9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b200cc910 0x7f0b20156e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39674/0 (socket says 172.21.15.149:39674) 2023-11-08T19:24:33.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.887+0000 7f0b1ed9d700 1 -- 172.21.15.149:0/74111883 learned_addr learned my addr 172.21.15.149:0/74111883 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:33.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.887+0000 7f0b1dd9b700 1 --2- 172.21.15.149:0/74111883 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b200cc4b0 0x7f0b201568e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:33.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.887+0000 7f0b1e59c700 1 --2- 172.21.15.149:0/74111883 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0b200cc0d0 0x7f0b200c79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:33.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.887+0000 7f0b1ed9d700 1 -- 172.21.15.149:0/74111883 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0b200cc0d0 msgr2=0x7f0b200c79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:33.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.887+0000 7f0b1ed9d700 1 --2- 172.21.15.149:0/74111883 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0b200cc0d0 0x7f0b200c79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:33.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.887+0000 7f0b1ed9d700 1 -- 172.21.15.149:0/74111883 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b200cc4b0 msgr2=0x7f0b201568e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:33.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.887+0000 7f0b1ed9d700 1 --2- 172.21.15.149:0/74111883 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b200cc4b0 0x7f0b201568e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:33.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.888+0000 7f0b1ed9d700 1 -- 172.21.15.149:0/74111883 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b140094a0 con 0x7f0b200cc910 2023-11-08T19:24:33.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.888+0000 7f0b1ed9d700 1 --2- 172.21.15.149:0/74111883 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b200cc910 0x7f0b20156e20 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f0b1800cc50 tx=0x7f0b1800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:33.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.888+0000 7f0b0effd700 1 -- 172.21.15.149:0/74111883 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b18003c00 con 0x7f0b200cc910 2023-11-08T19:24:33.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.888+0000 7f0b0effd700 1 -- 172.21.15.149:0/74111883 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b18003d60 con 0x7f0b200cc910 2023-11-08T19:24:33.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.888+0000 7f0b24d1e700 1 -- 172.21.15.149:0/74111883 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b200c91b0 con 0x7f0b200cc910 2023-11-08T19:24:33.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.888+0000 7f0b0effd700 1 -- 172.21.15.149:0/74111883 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1800aaf0 con 0x7f0b200cc910 2023-11-08T19:24:33.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.888+0000 7f0b24d1e700 1 -- 172.21.15.149:0/74111883 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b201551f0 con 0x7f0b200cc910 2023-11-08T19:24:33.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.889+0000 7f0b24d1e700 1 -- 172.21.15.149:0/74111883 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b200c99b0 con 0x7f0b200cc910 2023-11-08T19:24:33.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.889+0000 7f0b0effd700 1 -- 172.21.15.149:0/74111883 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0b1800ac50 con 0x7f0b200cc910 2023-11-08T19:24:33.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.890+0000 7f0b0effd700 1 --2- 172.21.15.149:0/74111883 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0b0006af00 0x7f0b0006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:33.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.890+0000 7f0b1e59c700 1 --2- 172.21.15.149:0/74111883 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0b0006af00 0x7f0b0006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:33.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.890+0000 7f0b0effd700 1 -- 172.21.15.149:0/74111883 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6438+0+0 (secure 0 0 0) 0x7f0b180898f0 con 0x7f0b200cc910 2023-11-08T19:24:33.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.890+0000 7f0b1e59c700 1 --2- 172.21.15.149:0/74111883 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0b0006af00 0x7f0b0006d3c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0b140090b0 tx=0x7f0b1401c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:33.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:33.895+0000 7f0b0effd700 1 -- 172.21.15.149:0/74111883 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0b200c99b0 con 0x7f0b200cc910 2023-11-08T19:24:34.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.084+0000 7f0b24d1e700 1 -- 172.21.15.149:0/74111883 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0b200c99b0 con 0x7f0b200cc910 2023-11-08T19:24:34.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.084+0000 7f0b0effd700 1 -- 172.21.15.149:0/74111883 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v42) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0b200c99b0 con 0x7f0b200cc910 2023-11-08T19:24:34.087 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 64 2023-11-08T19:24:34.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.086+0000 7f0b24d1e700 1 -- 172.21.15.149:0/74111883 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0b0006af00 msgr2=0x7f0b0006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:34.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.086+0000 7f0b24d1e700 1 --2- 172.21.15.149:0/74111883 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0b0006af00 0x7f0b0006d3c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0b140090b0 tx=0x7f0b1401c040 comp rx=0 tx=0).stop 2023-11-08T19:24:34.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.086+0000 7f0b24d1e700 1 -- 172.21.15.149:0/74111883 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b200cc910 msgr2=0x7f0b20156e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:34.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.086+0000 7f0b24d1e700 1 --2- 172.21.15.149:0/74111883 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b200cc910 0x7f0b20156e20 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f0b1800cc50 tx=0x7f0b1800cf60 comp rx=0 tx=0).stop 2023-11-08T19:24:34.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.086+0000 7f0b24d1e700 1 -- 172.21.15.149:0/74111883 shutdown_connections 2023-11-08T19:24:34.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.086+0000 7f0b24d1e700 1 --2- 172.21.15.149:0/74111883 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0b0006af00 0x7f0b0006d3c0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:34.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.086+0000 7f0b24d1e700 1 --2- 172.21.15.149:0/74111883 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b200cc910 0x7f0b20156e20 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:34.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.086+0000 7f0b24d1e700 1 --2- 172.21.15.149:0/74111883 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0b200cc0d0 0x7f0b200c79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:34.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.086+0000 7f0b24d1e700 1 --2- 172.21.15.149:0/74111883 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b200cc4b0 0x7f0b201568e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:34.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.086+0000 7f0b24d1e700 1 -- 172.21.15.149:0/74111883 >> 172.21.15.149:0/74111883 conn(0x7f0b2006f120 msgr2=0x7f0b2015d790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:34.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.086+0000 7f0b24d1e700 1 -- 172.21.15.149:0/74111883 shutdown_connections 2023-11-08T19:24:34.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.086+0000 7f0b24d1e700 1 -- 172.21.15.149:0/74111883 wait complete. 2023-11-08T19:24:34.100 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-08T19:24:34.227 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.225+0000 7f6a65288700 1 Processor -- start 2023-11-08T19:24:34.227 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.225+0000 7f6a65288700 1 -- start start 2023-11-08T19:24:34.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.225+0000 7f6a65288700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6a600d1130 0x7f6a600b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:34.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.225+0000 7f6a65288700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a600b6470 con 0x7f6a600cc870 2023-11-08T19:24:34.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.225+0000 7f6a65288700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a6015afd0 con 0x7f6a6015abf0 2023-11-08T19:24:34.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.225+0000 7f6a65288700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a600b66a0 con 0x7f6a600d1130 2023-11-08T19:24:34.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.226+0000 7f6a5e7fc700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6a600d1130 0x7f6a600b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:34.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.226+0000 7f6a5f7fe700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f6a600cc870 0x7f6a6006bc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:41684/0 (socket says 172.21.15.149:41684) 2023-11-08T19:24:34.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.226+0000 7f6a5f7fe700 1 -- 172.21.15.149:0/594475548 learned_addr learned my addr 172.21.15.149:0/594475548 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:24:34.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.226+0000 7f6a5e7fc700 1 -- 172.21.15.149:0/594475548 >> v1:172.21.15.160:6789/0 conn(0x7f6a6015abf0 legacy=0x7f6a600cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:34.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.226+0000 7f6a5e7fc700 1 -- 172.21.15.149:0/594475548 >> v1:172.21.15.149:6789/0 conn(0x7f6a600cc870 legacy=0x7f6a6006bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:34.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.226+0000 7f6a5e7fc700 1 -- 172.21.15.149:0/594475548 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a6015e880 con 0x7f6a600d1130 2023-11-08T19:24:34.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.226+0000 7f6a5dffb700 1 -- 172.21.15.149:0/594475548 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1664849850 0 0) 0x7f6a600b6470 con 0x7f6a600cc870 2023-11-08T19:24:34.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.226+0000 7f6a5e7fc700 1 --2- 172.21.15.149:0/594475548 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a600d1130 0x7f6a600b5f30 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f6a54009840 tx=0x7f6a54009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=317d3c7ce4282932 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:34.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.226+0000 7f6a5dffb700 1 -- 172.21.15.149:0/594475548 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a54004230 con 0x7f6a600d1130 2023-11-08T19:24:34.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.226+0000 7f6a5dffb700 1 -- 172.21.15.149:0/594475548 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a54004390 con 0x7f6a600d1130 2023-11-08T19:24:34.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.226+0000 7f6a5dffb700 1 -- 172.21.15.149:0/594475548 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a540036a0 con 0x7f6a600d1130 2023-11-08T19:24:34.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.227+0000 7f6a65288700 1 -- 172.21.15.149:0/594475548 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a600d1130 msgr2=0x7f6a600b5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:34.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.227+0000 7f6a65288700 1 --2- 172.21.15.149:0/594475548 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a600d1130 0x7f6a600b5f30 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f6a54009840 tx=0x7f6a54009b50 comp rx=0 tx=0).stop 2023-11-08T19:24:34.234 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.227+0000 7f6a65288700 1 -- 172.21.15.149:0/594475548 shutdown_connections 2023-11-08T19:24:34.234 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.227+0000 7f6a65288700 1 --2- 172.21.15.149:0/594475548 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a600d1130 0x7f6a600b5f30 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:34.234 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.227+0000 7f6a65288700 1 -- 172.21.15.149:0/594475548 >> 172.21.15.149:0/594475548 conn(0x7f6a600d0640 msgr2=0x7f6a600d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:34.234 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.227+0000 7f6a65288700 1 -- 172.21.15.149:0/594475548 shutdown_connections 2023-11-08T19:24:34.234 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.227+0000 7f6a65288700 1 -- 172.21.15.149:0/594475548 wait complete. 2023-11-08T19:24:34.237 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.228+0000 7f6a65288700 1 Processor -- start 2023-11-08T19:24:34.237 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.228+0000 7f6a65288700 1 -- start start 2023-11-08T19:24:34.238 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.229+0000 7f6a65288700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a600cc870 0x7f6a60158f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:34.238 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.229+0000 7f6a65288700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6a600d1130 0x7f6a6015cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:34.238 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.229+0000 7f6a65288700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6a6015abf0 0x7f6a601506b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:34.238 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.229+0000 7f6a65288700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a600c7dd0 con 0x7f6a600cc870 2023-11-08T19:24:34.239 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.229+0000 7f6a65288700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6015d7d0 con 0x7f6a6015abf0 2023-11-08T19:24:34.239 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.229+0000 7f6a65288700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a600ac960 con 0x7f6a600d1130 2023-11-08T19:24:34.239 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.229+0000 7f6a5effd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a600cc870 0x7f6a60158f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:34.239 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.229+0000 7f6a5effd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a600cc870 0x7f6a60158f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39684/0 (socket says 172.21.15.149:39684) 2023-11-08T19:24:34.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.229+0000 7f6a5effd700 1 -- 172.21.15.149:0/345185995 learned_addr learned my addr 172.21.15.149:0/345185995 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:34.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.229+0000 7f6a5f7fe700 1 --2- 172.21.15.149:0/345185995 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6a6015abf0 0x7f6a601506b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:34.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.229+0000 7f6a5e7fc700 1 --2- 172.21.15.149:0/345185995 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6a600d1130 0x7f6a6015cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:34.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.229+0000 7f6a5effd700 1 -- 172.21.15.149:0/345185995 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6a600d1130 msgr2=0x7f6a6015cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:34.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.229+0000 7f6a5effd700 1 --2- 172.21.15.149:0/345185995 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6a600d1130 0x7f6a6015cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:34.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.229+0000 7f6a5effd700 1 -- 172.21.15.149:0/345185995 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6a6015abf0 msgr2=0x7f6a601506b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:34.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.229+0000 7f6a5effd700 1 --2- 172.21.15.149:0/345185995 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6a6015abf0 0x7f6a601506b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:34.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.229+0000 7f6a5effd700 1 -- 172.21.15.149:0/345185995 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a540094a0 con 0x7f6a600cc870 2023-11-08T19:24:34.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.229+0000 7f6a5effd700 1 --2- 172.21.15.149:0/345185995 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a600cc870 0x7f6a60158f80 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f6a5000c4d0 tx=0x7f6a5000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:34.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.230+0000 7f6a477fe700 1 -- 172.21.15.149:0/345185995 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a50011790 con 0x7f6a600cc870 2023-11-08T19:24:34.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.230+0000 7f6a477fe700 1 -- 172.21.15.149:0/345185995 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a500118f0 con 0x7f6a600cc870 2023-11-08T19:24:34.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.230+0000 7f6a477fe700 1 -- 172.21.15.149:0/345185995 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a50011ca0 con 0x7f6a600cc870 2023-11-08T19:24:34.243 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.230+0000 7f6a65288700 1 -- 172.21.15.149:0/345185995 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a600acc40 con 0x7f6a600cc870 2023-11-08T19:24:34.243 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.230+0000 7f6a65288700 1 -- 172.21.15.149:0/345185995 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a600ad200 con 0x7f6a600cc870 2023-11-08T19:24:34.244 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.231+0000 7f6a65288700 1 -- 172.21.15.149:0/345185995 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a600ad3f0 con 0x7f6a600cc870 2023-11-08T19:24:34.244 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.231+0000 7f6a477fe700 1 -- 172.21.15.149:0/345185995 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6a5001c460 con 0x7f6a600cc870 2023-11-08T19:24:34.244 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.231+0000 7f6a477fe700 1 --2- 172.21.15.149:0/345185995 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6a4c06af00 0x7f6a4c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:34.245 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.231+0000 7f6a477fe700 1 -- 172.21.15.149:0/345185995 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6438+0+0 (secure 0 0 0) 0x7f6a50089810 con 0x7f6a600cc870 2023-11-08T19:24:34.245 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.231+0000 7f6a5e7fc700 1 --2- 172.21.15.149:0/345185995 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6a4c06af00 0x7f6a4c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:34.245 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.232+0000 7f6a5e7fc700 1 --2- 172.21.15.149:0/345185995 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6a4c06af00 0x7f6a4c06d3c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6a540090b0 tx=0x7f6a54008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:34.246 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.236+0000 7f6a477fe700 1 -- 172.21.15.149:0/345185995 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6a50054560 con 0x7f6a600cc870 2023-11-08T19:24:34.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.429+0000 7f6a65288700 1 -- 172.21.15.149:0/345185995 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f6a6004f730 con 0x7f6a600cc870 2023-11-08T19:24:34.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.429+0000 7f6a477fe700 1 -- 172.21.15.149:0/345185995 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v42) v1 ==== 103+0+11 (secure 0 0 0) 0x7f6a50057b80 con 0x7f6a600cc870 2023-11-08T19:24:34.432 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:24:34.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.431+0000 7f6a65288700 1 -- 172.21.15.149:0/345185995 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6a4c06af00 msgr2=0x7f6a4c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:34.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.431+0000 7f6a65288700 1 --2- 172.21.15.149:0/345185995 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6a4c06af00 0x7f6a4c06d3c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6a540090b0 tx=0x7f6a54008030 comp rx=0 tx=0).stop 2023-11-08T19:24:34.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.431+0000 7f6a65288700 1 -- 172.21.15.149:0/345185995 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a600cc870 msgr2=0x7f6a60158f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:34.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.431+0000 7f6a65288700 1 --2- 172.21.15.149:0/345185995 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a600cc870 0x7f6a60158f80 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f6a5000c4d0 tx=0x7f6a5000c890 comp rx=0 tx=0).stop 2023-11-08T19:24:34.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.431+0000 7f6a65288700 1 -- 172.21.15.149:0/345185995 shutdown_connections 2023-11-08T19:24:34.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.431+0000 7f6a65288700 1 --2- 172.21.15.149:0/345185995 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6a4c06af00 0x7f6a4c06d3c0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:34.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.431+0000 7f6a65288700 1 --2- 172.21.15.149:0/345185995 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6a6015abf0 0x7f6a601506b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:34.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.431+0000 7f6a65288700 1 --2- 172.21.15.149:0/345185995 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a600cc870 0x7f6a60158f80 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:34.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.431+0000 7f6a65288700 1 --2- 172.21.15.149:0/345185995 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6a600d1130 0x7f6a6015cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:34.438 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.431+0000 7f6a65288700 1 -- 172.21.15.149:0/345185995 >> 172.21.15.149:0/345185995 conn(0x7f6a600d0640 msgr2=0x7f6a600d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:34.438 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.431+0000 7f6a65288700 1 -- 172.21.15.149:0/345185995 shutdown_connections 2023-11-08T19:24:34.438 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.431+0000 7f6a65288700 1 -- 172.21.15.149:0/345185995 wait complete. 2023-11-08T19:24:34.446 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-08T19:24:34.569 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.567+0000 7f421f396700 1 Processor -- start 2023-11-08T19:24:34.570 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.567+0000 7f421f396700 1 -- start start 2023-11-08T19:24:34.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.568+0000 7f421f396700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f42180b27c0 0x7f42180ce380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:34.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.568+0000 7f421f396700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42180d1330 con 0x7f42180afb30 2023-11-08T19:24:34.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.568+0000 7f421f396700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42180cb490 con 0x7f42180b16b0 2023-11-08T19:24:34.575 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.568+0000 7f421f396700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42180cb770 con 0x7f42180b27c0 2023-11-08T19:24:34.575 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.568+0000 7f421d132700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f42180afb30 0x7f42180cbf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:41694/0 (socket says 172.21.15.149:41694) 2023-11-08T19:24:34.575 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.568+0000 7f421d132700 1 -- 172.21.15.149:0/667205602 learned_addr learned my addr 172.21.15.149:0/667205602 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:24:34.576 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.568+0000 7f421d933700 1 --2- 172.21.15.149:0/667205602 >> v2:172.21.15.160:3300/0 conn(0x7f42180b27c0 0x7f42180ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:34.576 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.568+0000 7f420ffff700 1 -- 172.21.15.149:0/667205602 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2235297295 0 0) 0x7f42180d1330 con 0x7f42180afb30 2023-11-08T19:24:34.576 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.568+0000 7f420ffff700 1 -- 172.21.15.149:0/667205602 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42040035b0 con 0x7f42180afb30 2023-11-08T19:24:34.576 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.569+0000 7f420ffff700 1 -- 172.21.15.149:0/667205602 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2014081743 0 0) 0x7f42040035b0 con 0x7f42180afb30 2023-11-08T19:24:34.576 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.569+0000 7f420ffff700 1 -- 172.21.15.149:0/667205602 >> v2:172.21.15.160:3300/0 conn(0x7f42180b27c0 msgr2=0x7f42180ce380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:34.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.569+0000 7f420ffff700 1 --2- 172.21.15.149:0/667205602 >> v2:172.21.15.160:3300/0 conn(0x7f42180b27c0 0x7f42180ce380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:34.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.569+0000 7f420ffff700 1 -- 172.21.15.149:0/667205602 >> v1:172.21.15.160:6789/0 conn(0x7f42180b16b0 legacy=0x7f42180b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:34.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.569+0000 7f420ffff700 1 -- 172.21.15.149:0/667205602 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42180cba50 con 0x7f42180afb30 2023-11-08T19:24:34.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.569+0000 7f420ffff700 1 -- 172.21.15.149:0/667205602 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f42080017f0 con 0x7f42180afb30 2023-11-08T19:24:34.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.569+0000 7f420ffff700 1 -- 172.21.15.149:0/667205602 >> v1:172.21.15.149:6789/0 conn(0x7f42180afb30 legacy=0x7f42180cbf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:34.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.569+0000 7f420ffff700 1 --2- 172.21.15.149:0/667205602 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4204003a00 0x7f4204003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:34.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.569+0000 7f420ffff700 1 --2- 172.21.15.149:0/667205602 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4204004850 0x7f4204004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:34.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.569+0000 7f420ffff700 1 --2- 172.21.15.149:0/667205602 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4204005330 0x7f420400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:34.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.569+0000 7f420ffff700 1 -- 172.21.15.149:0/667205602 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42180cb770 con 0x7f4204003a00 2023-11-08T19:24:34.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.569+0000 7f420ffff700 1 -- 172.21.15.149:0/667205602 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420400c200 con 0x7f4204005330 2023-11-08T19:24:34.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.569+0000 7f420ffff700 1 -- 172.21.15.149:0/667205602 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f420400c3c0 con 0x7f4204004850 2023-11-08T19:24:34.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.569+0000 7f421d132700 1 --2- 172.21.15.149:0/667205602 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4204003a00 0x7f4204003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:34.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.569+0000 7f421d933700 1 --2- 172.21.15.149:0/667205602 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4204005330 0x7f420400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:34.580 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.569+0000 7f421c931700 1 --2- 172.21.15.149:0/667205602 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4204004850 0x7f4204004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:34.580 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.569+0000 7f421d132700 1 -- 172.21.15.149:0/667205602 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4204004850 msgr2=0x7f4204004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:34.580 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.569+0000 7f421d132700 1 --2- 172.21.15.149:0/667205602 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4204004850 0x7f4204004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:34.580 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.569+0000 7f421d132700 1 -- 172.21.15.149:0/667205602 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4204005330 msgr2=0x7f420400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:34.580 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.569+0000 7f421d132700 1 --2- 172.21.15.149:0/667205602 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4204005330 0x7f420400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:34.581 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.569+0000 7f421d933700 1 -- 172.21.15.149:0/667205602 reap_dead start 2023-11-08T19:24:34.581 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.569+0000 7f421d132700 1 -- 172.21.15.149:0/667205602 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42040035b0 con 0x7f4204003a00 2023-11-08T19:24:34.581 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.569+0000 7f421d132700 1 --2- 172.21.15.149:0/667205602 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4204003a00 0x7f4204003e20 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f420800c210 tx=0x7f4204005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36f9d48dbbfcd6bd server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:34.581 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.570+0000 7f420ffff700 1 -- 172.21.15.149:0/667205602 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420800cd30 con 0x7f4204003a00 2023-11-08T19:24:34.582 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.570+0000 7f420ffff700 1 -- 172.21.15.149:0/667205602 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f420800ce90 con 0x7f4204003a00 2023-11-08T19:24:34.582 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.570+0000 7f420ffff700 1 -- 172.21.15.149:0/667205602 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42080072d0 con 0x7f4204003a00 2023-11-08T19:24:34.582 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.570+0000 7f421f396700 1 -- 172.21.15.149:0/667205602 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4204003a00 msgr2=0x7f4204003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:34.583 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.570+0000 7f421f396700 1 --2- 172.21.15.149:0/667205602 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4204003a00 0x7f4204003e20 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f420800c210 tx=0x7f4204005880 comp rx=0 tx=0).stop 2023-11-08T19:24:34.583 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.570+0000 7f421f396700 1 -- 172.21.15.149:0/667205602 shutdown_connections 2023-11-08T19:24:34.583 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.570+0000 7f421f396700 1 --2- 172.21.15.149:0/667205602 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4204003a00 0x7f4204003e20 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:34.583 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.570+0000 7f421f396700 1 -- 172.21.15.149:0/667205602 >> 172.21.15.149:0/667205602 conn(0x7f4218099a40 msgr2=0x7f42180d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:34.583 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.570+0000 7f421f396700 1 -- 172.21.15.149:0/667205602 shutdown_connections 2023-11-08T19:24:34.584 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.570+0000 7f421f396700 1 -- 172.21.15.149:0/667205602 wait complete. 2023-11-08T19:24:34.584 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.572+0000 7f421f396700 1 Processor -- start 2023-11-08T19:24:34.584 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.572+0000 7f421f396700 1 -- start start 2023-11-08T19:24:34.587 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.573+0000 7f421f396700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4204003a00 0x7f42181f14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:34.587 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.573+0000 7f421f396700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42180c9880 0x7f42180c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:34.588 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.573+0000 7f421f396700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4218158b40 0x7f4218158ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:34.588 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.573+0000 7f421f396700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42181598b0 con 0x7f42180c9880 2023-11-08T19:24:34.588 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.573+0000 7f421f396700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42180ca240 con 0x7f4218158b40 2023-11-08T19:24:34.588 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.573+0000 7f421f396700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4218146f80 con 0x7f4204003a00 2023-11-08T19:24:34.588 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.573+0000 7f421c931700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42180c9880 0x7f42180c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:34.589 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.573+0000 7f421c931700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42180c9880 0x7f42180c9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39704/0 (socket says 172.21.15.149:39704) 2023-11-08T19:24:34.589 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.573+0000 7f421c931700 1 -- 172.21.15.149:0/2772544403 learned_addr learned my addr 172.21.15.149:0/2772544403 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:34.589 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.573+0000 7f421d132700 1 --2- 172.21.15.149:0/2772544403 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4204003a00 0x7f42181f14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:34.589 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.573+0000 7f421d933700 1 --2- 172.21.15.149:0/2772544403 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4218158b40 0x7f4218158ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:34.589 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.573+0000 7f421c931700 1 -- 172.21.15.149:0/2772544403 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4204003a00 msgr2=0x7f42181f14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:34.590 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.573+0000 7f421c931700 1 --2- 172.21.15.149:0/2772544403 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4204003a00 0x7f42181f14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:34.590 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.573+0000 7f421c931700 1 -- 172.21.15.149:0/2772544403 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4218158b40 msgr2=0x7f4218158ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:34.590 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.573+0000 7f421c931700 1 --2- 172.21.15.149:0/2772544403 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4218158b40 0x7f4218158ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:34.590 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.573+0000 7f421c931700 1 -- 172.21.15.149:0/2772544403 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42181461c0 con 0x7f42180c9880 2023-11-08T19:24:34.590 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.573+0000 7f421c931700 1 --2- 172.21.15.149:0/2772544403 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42180c9880 0x7f42180c9d00 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f421400f610 tx=0x7f421400f920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:34.591 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.573+0000 7f420dffb700 1 -- 172.21.15.149:0/2772544403 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42140052e0 con 0x7f42180c9880 2023-11-08T19:24:34.591 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.573+0000 7f420dffb700 1 -- 172.21.15.149:0/2772544403 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4214005440 con 0x7f42180c9880 2023-11-08T19:24:34.591 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.573+0000 7f420dffb700 1 -- 172.21.15.149:0/2772544403 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42140038a0 con 0x7f42180c9880 2023-11-08T19:24:34.591 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.573+0000 7f421f396700 1 -- 172.21.15.149:0/2772544403 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42181464a0 con 0x7f42180c9880 2023-11-08T19:24:34.591 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.574+0000 7f421f396700 1 -- 172.21.15.149:0/2772544403 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4218146a60 con 0x7f42180c9880 2023-11-08T19:24:34.592 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.575+0000 7f421f396700 1 -- 172.21.15.149:0/2772544403 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42180745f0 con 0x7f42180c9880 2023-11-08T19:24:34.592 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.575+0000 7f420dffb700 1 -- 172.21.15.149:0/2772544403 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4214003a00 con 0x7f42180c9880 2023-11-08T19:24:34.592 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.575+0000 7f420dffb700 1 --2- 172.21.15.149:0/2772544403 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f41fc06af30 0x7f41fc06d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:34.592 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.575+0000 7f420dffb700 1 -- 172.21.15.149:0/2772544403 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6438+0+0 (secure 0 0 0) 0x7f4214089640 con 0x7f42180c9880 2023-11-08T19:24:34.593 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.575+0000 7f421d132700 1 --2- 172.21.15.149:0/2772544403 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f41fc06af30 0x7f41fc06d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:34.593 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.576+0000 7f421d132700 1 --2- 172.21.15.149:0/2772544403 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f41fc06af30 0x7f41fc06d3f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4208000c00 tx=0x7f4208007000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:34.593 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.580+0000 7f420dffb700 1 -- 172.21.15.149:0/2772544403 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f42140542e0 con 0x7f42180c9880 2023-11-08T19:24:34.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.787+0000 7f421f396700 1 -- 172.21.15.149:0/2772544403 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f421815d920 con 0x7f42180c9880 2023-11-08T19:24:34.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.788+0000 7f420dffb700 1 -- 172.21.15.149:0/2772544403 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v42) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4214003cb0 con 0x7f42180c9880 2023-11-08T19:24:34.792 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.790+0000 7f421f396700 1 -- 172.21.15.149:0/2772544403 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f41fc06af30 msgr2=0x7f41fc06d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:34.792 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.790+0000 7f421f396700 1 --2- 172.21.15.149:0/2772544403 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f41fc06af30 0x7f41fc06d3f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4208000c00 tx=0x7f4208007000 comp rx=0 tx=0).stop 2023-11-08T19:24:34.793 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.790+0000 7f421f396700 1 -- 172.21.15.149:0/2772544403 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42180c9880 msgr2=0x7f42180c9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:34.793 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.790+0000 7f421f396700 1 --2- 172.21.15.149:0/2772544403 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42180c9880 0x7f42180c9d00 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f421400f610 tx=0x7f421400f920 comp rx=0 tx=0).stop 2023-11-08T19:24:34.793 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.790+0000 7f421f396700 1 -- 172.21.15.149:0/2772544403 shutdown_connections 2023-11-08T19:24:34.793 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.790+0000 7f421f396700 1 --2- 172.21.15.149:0/2772544403 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f41fc06af30 0x7f41fc06d3f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:34.793 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.790+0000 7f421f396700 1 --2- 172.21.15.149:0/2772544403 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4218158b40 0x7f4218158ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:34.794 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.790+0000 7f421f396700 1 --2- 172.21.15.149:0/2772544403 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4204003a00 0x7f42181f14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:34.794 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.790+0000 7f421f396700 1 --2- 172.21.15.149:0/2772544403 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42180c9880 0x7f42180c9d00 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:34.794 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.790+0000 7f421f396700 1 -- 172.21.15.149:0/2772544403 >> 172.21.15.149:0/2772544403 conn(0x7f4218099a40 msgr2=0x7f42180adba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:34.794 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.790+0000 7f421f396700 1 -- 172.21.15.149:0/2772544403 shutdown_connections 2023-11-08T19:24:34.795 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:34.790+0000 7f421f396700 1 -- 172.21.15.149:0/2772544403 wait complete. 2023-11-08T19:24:34.795 INFO:teuthology.orchestra.run.smithi149.stderr:listed 0 entries 2023-11-08T19:24:34.804 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-08T19:24:34.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:24:34.805 DEBUG:teuthology.orchestra.run.smithi149:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-08T19:24:34.842 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi149.front.sepia.ceph.com 2023-11-08T19:24:34.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:24:34.848 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-08T19:24:34.900 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-11-08T19:24:34.900 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:24:34.922 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284272k,nr_inodes=4071068,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16330 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-08T19:24:34.923 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-11-08T19:24:34.924 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:24:34.958 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=8026740k,nr_inodes=2006685,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=31,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15303 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1609048k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-11-08T19:24:34.959 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-11-08T19:24:34.959 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:24:34.983 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284272k,nr_inodes=4071068,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16330 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-08T19:24:34.984 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:24:35.119 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.116+0000 7f95aa861700 1 Processor -- start 2023-11-08T19:24:35.119 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.116+0000 7f95aa861700 1 -- start start 2023-11-08T19:24:35.124 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.117+0000 7f95aa861700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95a406f7e0 0x7f95a40cfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:35.125 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.117+0000 7f95aa861700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95a4072df0 con 0x7f95a40b1ff0 2023-11-08T19:24:35.125 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.117+0000 7f95aa861700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95a4070660 con 0x7f95a415a780 2023-11-08T19:24:35.125 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.117+0000 7f95aa861700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95a406fdc0 con 0x7f95a406f7e0 2023-11-08T19:24:35.126 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.117+0000 7f95a8dfe700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f95a40b1ff0 0x7f95a40cbc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:41716/0 (socket says 172.21.15.149:41716) 2023-11-08T19:24:35.126 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.117+0000 7f95a8dfe700 1 -- 172.21.15.149:0/2416685468 learned_addr learned my addr 172.21.15.149:0/2416685468 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:24:35.126 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.118+0000 7f95a2ffd700 1 -- 172.21.15.149:0/2416685468 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1126536179 0 0) 0x7f95a4072df0 con 0x7f95a40b1ff0 2023-11-08T19:24:35.126 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.118+0000 7f95a2ffd700 1 -- 172.21.15.149:0/2416685468 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f958c0035b0 con 0x7f95a40b1ff0 2023-11-08T19:24:35.126 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.118+0000 7f95a37fe700 1 --2- 172.21.15.149:0/2416685468 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95a406f7e0 0x7f95a40cfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:35.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.118+0000 7f95a2ffd700 1 -- 172.21.15.149:0/2416685468 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3174920126 0 0) 0x7f958c0035b0 con 0x7f95a40b1ff0 2023-11-08T19:24:35.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.118+0000 7f95a2ffd700 1 -- 172.21.15.149:0/2416685468 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95a406f7e0 msgr2=0x7f95a40cfce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:35.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.118+0000 7f95a2ffd700 1 --2- 172.21.15.149:0/2416685468 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95a406f7e0 0x7f95a40cfce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:35.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.118+0000 7f95a2ffd700 1 -- 172.21.15.149:0/2416685468 >> v1:172.21.15.160:6789/0 conn(0x7f95a415a780 legacy=0x7f95a415ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:35.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.118+0000 7f95a2ffd700 1 -- 172.21.15.149:0/2416685468 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a40700a0 con 0x7f95a40b1ff0 2023-11-08T19:24:35.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.118+0000 7f95a2ffd700 1 -- 172.21.15.149:0/2416685468 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f959c0019f0 con 0x7f95a40b1ff0 2023-11-08T19:24:35.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.118+0000 7f95a2ffd700 1 -- 172.21.15.149:0/2416685468 >> v1:172.21.15.149:6789/0 conn(0x7f95a40b1ff0 legacy=0x7f95a40cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:35.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.118+0000 7f95a2ffd700 1 --2- 172.21.15.149:0/2416685468 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f958c003a30 0x7f958c003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:35.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.118+0000 7f95a2ffd700 1 --2- 172.21.15.149:0/2416685468 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f958c004850 0x7f958c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:35.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.118+0000 7f95a2ffd700 1 --2- 172.21.15.149:0/2416685468 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95a406f7e0 0x7f958c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:35.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.118+0000 7f95a2ffd700 1 -- 172.21.15.149:0/2416685468 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a406fdc0 con 0x7f958c003a30 2023-11-08T19:24:35.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.118+0000 7f95a2ffd700 1 -- 172.21.15.149:0/2416685468 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f958c00baf0 con 0x7f958c004850 2023-11-08T19:24:35.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.118+0000 7f95a2ffd700 1 -- 172.21.15.149:0/2416685468 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f958c00bcb0 con 0x7f95a406f7e0 2023-11-08T19:24:35.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.118+0000 7f95a3fff700 1 --2- 172.21.15.149:0/2416685468 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f958c003a30 0x7f958c003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:35.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.118+0000 7f95a37fe700 1 --2- 172.21.15.149:0/2416685468 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f958c004850 0x7f958c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:35.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.118+0000 7f95a8dfe700 1 --2- 172.21.15.149:0/2416685468 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95a406f7e0 0x7f958c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:35.131 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.118+0000 7f95a3fff700 1 -- 172.21.15.149:0/2416685468 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95a406f7e0 msgr2=0x7f958c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:35.131 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.118+0000 7f95a3fff700 1 --2- 172.21.15.149:0/2416685468 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95a406f7e0 0x7f958c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:35.131 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.118+0000 7f95a3fff700 1 -- 172.21.15.149:0/2416685468 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f958c004850 msgr2=0x7f958c004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:35.131 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.118+0000 7f95a3fff700 1 --2- 172.21.15.149:0/2416685468 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f958c004850 0x7f958c004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:35.131 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.118+0000 7f95a3fff700 1 -- 172.21.15.149:0/2416685468 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f958c0035b0 con 0x7f958c003a30 2023-11-08T19:24:35.132 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.118+0000 7f95a37fe700 1 --2- 172.21.15.149:0/2416685468 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f958c004850 0x7f958c004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:24:35.132 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.118+0000 7f95a3fff700 1 --2- 172.21.15.149:0/2416685468 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f958c003a30 0x7f958c003e50 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f9598007fd0 tx=0x7f958c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6042c4287daed68b server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:35.132 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.119+0000 7f95a2ffd700 1 -- 172.21.15.149:0/2416685468 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95980052d0 con 0x7f958c003a30 2023-11-08T19:24:35.132 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.119+0000 7f95a2ffd700 1 -- 172.21.15.149:0/2416685468 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9598005470 con 0x7f958c003a30 2023-11-08T19:24:35.132 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.119+0000 7f95a2ffd700 1 -- 172.21.15.149:0/2416685468 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95980038c0 con 0x7f958c003a30 2023-11-08T19:24:35.133 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.119+0000 7f95aa861700 1 -- 172.21.15.149:0/2416685468 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f958c003a30 msgr2=0x7f958c003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:35.133 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.119+0000 7f95aa861700 1 --2- 172.21.15.149:0/2416685468 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f958c003a30 0x7f958c003e50 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f9598007fd0 tx=0x7f958c005880 comp rx=0 tx=0).stop 2023-11-08T19:24:35.133 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.119+0000 7f95a8dfe700 1 -- 172.21.15.149:0/2416685468 reap_dead start 2023-11-08T19:24:35.133 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.119+0000 7f95aa861700 1 -- 172.21.15.149:0/2416685468 shutdown_connections 2023-11-08T19:24:35.133 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.119+0000 7f95aa861700 1 -- 172.21.15.149:0/2416685468 >> 172.21.15.149:0/2416685468 conn(0x7f95a40ccff0 msgr2=0x7f95a40cd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:35.134 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.119+0000 7f95aa861700 1 -- 172.21.15.149:0/2416685468 shutdown_connections 2023-11-08T19:24:35.134 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.119+0000 7f95aa861700 1 -- 172.21.15.149:0/2416685468 wait complete. 2023-11-08T19:24:35.134 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.120+0000 7f95aa861700 1 Processor -- start 2023-11-08T19:24:35.137 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.121+0000 7f95aa861700 1 -- start start 2023-11-08T19:24:35.138 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.121+0000 7f95aa861700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f958c003a30 0x7f95a415dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:35.138 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.121+0000 7f95aa861700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95a41f32d0 0x7f95a40b4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:35.138 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.121+0000 7f95aa861700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95a41e4af0 0x7f95a41e4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:35.139 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.121+0000 7f95aa861700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a41e54e0 con 0x7f95a41e4af0 2023-11-08T19:24:35.139 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.121+0000 7f95aa861700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a40b5300 con 0x7f95a41f32d0 2023-11-08T19:24:35.139 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.121+0000 7f95aa861700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95a40b55e0 con 0x7f958c003a30 2023-11-08T19:24:35.140 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.121+0000 7f95a8dfe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95a41e4af0 0x7f95a41e4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:35.140 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.121+0000 7f95a8dfe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95a41e4af0 0x7f95a41e4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39726/0 (socket says 172.21.15.149:39726) 2023-11-08T19:24:35.140 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.121+0000 7f95a8dfe700 1 -- 172.21.15.149:0/244212179 learned_addr learned my addr 172.21.15.149:0/244212179 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:35.140 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.121+0000 7f95a37fe700 1 --2- 172.21.15.149:0/244212179 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95a41f32d0 0x7f95a40b4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:35.141 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.121+0000 7f95a3fff700 1 --2- 172.21.15.149:0/244212179 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f958c003a30 0x7f95a415dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:35.141 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.122+0000 7f95a8dfe700 1 -- 172.21.15.149:0/244212179 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f958c003a30 msgr2=0x7f95a415dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:35.141 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.122+0000 7f95a8dfe700 1 --2- 172.21.15.149:0/244212179 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f958c003a30 0x7f95a415dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:35.141 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.122+0000 7f95a8dfe700 1 -- 172.21.15.149:0/244212179 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95a41f32d0 msgr2=0x7f95a40b4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:35.141 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.122+0000 7f95a8dfe700 1 --2- 172.21.15.149:0/244212179 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95a41f32d0 0x7f95a40b4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:35.142 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.122+0000 7f95a8dfe700 1 -- 172.21.15.149:0/244212179 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a40b58c0 con 0x7f95a41e4af0 2023-11-08T19:24:35.142 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.122+0000 7f95a8dfe700 1 --2- 172.21.15.149:0/244212179 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95a41e4af0 0x7f95a41e4fa0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f95a406cc10 tx=0x7f959c007c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:35.142 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.122+0000 7f95a0ff9700 1 -- 172.21.15.149:0/244212179 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959c00eb50 con 0x7f95a41e4af0 2023-11-08T19:24:35.142 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.122+0000 7f95a0ff9700 1 -- 172.21.15.149:0/244212179 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f959c00ecb0 con 0x7f95a41e4af0 2023-11-08T19:24:35.142 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.122+0000 7f95a0ff9700 1 -- 172.21.15.149:0/244212179 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959c013420 con 0x7f95a41e4af0 2023-11-08T19:24:35.143 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.122+0000 7f95aa861700 1 -- 172.21.15.149:0/244212179 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95a40c7a80 con 0x7f95a41e4af0 2023-11-08T19:24:35.143 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.122+0000 7f95aa861700 1 -- 172.21.15.149:0/244212179 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95a40b5020 con 0x7f95a41e4af0 2023-11-08T19:24:35.144 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.123+0000 7f95aa861700 1 -- 172.21.15.149:0/244212179 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95a40c7fa0 con 0x7f95a41e4af0 2023-11-08T19:24:35.144 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.124+0000 7f95a0ff9700 1 -- 172.21.15.149:0/244212179 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f959c013580 con 0x7f95a41e4af0 2023-11-08T19:24:35.144 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.124+0000 7f95a0ff9700 1 --2- 172.21.15.149:0/244212179 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f959006af00 0x7f959006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:35.145 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.124+0000 7f95a3fff700 1 --2- 172.21.15.149:0/244212179 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f959006af00 0x7f959006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:35.145 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.124+0000 7f95a0ff9700 1 -- 172.21.15.149:0/244212179 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6438+0+0 (secure 0 0 0) 0x7f959c08a6a0 con 0x7f95a41e4af0 2023-11-08T19:24:35.145 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.125+0000 7f95a3fff700 1 --2- 172.21.15.149:0/244212179 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f959006af00 0x7f959006d3c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f9598007fd0 tx=0x7f9598009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:35.145 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.129+0000 7f95a0ff9700 1 -- 172.21.15.149:0/244212179 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f959c0555a0 con 0x7f95a41e4af0 2023-11-08T19:24:35.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.361+0000 7f95aa861700 1 -- 172.21.15.149:0/244212179 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f95a40c7fa0 con 0x7f95a41e4af0 2023-11-08T19:24:35.364 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.361+0000 7f95a0ff9700 1 -- 172.21.15.149:0/244212179 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4922 (secure 0 0 0) 0x7f95a40c7fa0 con 0x7f95a41e4af0 2023-11-08T19:24:35.364 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:24:35.365 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4877,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/3602590195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3602590195},{"type":"v1","addr":"172.21.15.160:6834","nonce":3602590195}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5107,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/1432406788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":1432406788},{"type":"v1","addr":"172.21.15.160:6835","nonce":1432406788}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5125,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/3066975859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3066975859},{"type":"v1","addr":"172.21.15.149:6837","nonce":3066975859}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-08T19:24:16.502193+0000","modified":"2023-11-08T19:24:19.886052+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5259":{"gid":5259,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.149:6836/746083826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":746083826},{"type":"v1","addr":"172.21.15.149:6836","nonce":746083826}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-08T19:24:35.367 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.363+0000 7f95aa861700 1 -- 172.21.15.149:0/244212179 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f959006af00 msgr2=0x7f959006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:35.367 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.363+0000 7f95aa861700 1 --2- 172.21.15.149:0/244212179 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f959006af00 0x7f959006d3c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f9598007fd0 tx=0x7f9598009030 comp rx=0 tx=0).stop 2023-11-08T19:24:35.368 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.363+0000 7f95aa861700 1 -- 172.21.15.149:0/244212179 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95a41e4af0 msgr2=0x7f95a41e4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:35.368 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.363+0000 7f95aa861700 1 --2- 172.21.15.149:0/244212179 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95a41e4af0 0x7f95a41e4fa0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f95a406cc10 tx=0x7f959c007c90 comp rx=0 tx=0).stop 2023-11-08T19:24:35.369 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.363+0000 7f95aa861700 1 -- 172.21.15.149:0/244212179 shutdown_connections 2023-11-08T19:24:35.369 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.363+0000 7f95aa861700 1 --2- 172.21.15.149:0/244212179 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f959006af00 0x7f959006d3c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:35.370 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.363+0000 7f95aa861700 1 --2- 172.21.15.149:0/244212179 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95a41e4af0 0x7f95a41e4fa0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:35.370 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.363+0000 7f95aa861700 1 --2- 172.21.15.149:0/244212179 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f958c003a30 0x7f95a415dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:35.370 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.363+0000 7f95aa861700 1 --2- 172.21.15.149:0/244212179 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95a41f32d0 0x7f95a40b4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:35.370 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.363+0000 7f95aa861700 1 -- 172.21.15.149:0/244212179 >> 172.21.15.149:0/244212179 conn(0x7f95a40ccff0 msgr2=0x7f95a415b150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:35.371 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.363+0000 7f95aa861700 1 -- 172.21.15.149:0/244212179 shutdown_connections 2023-11-08T19:24:35.371 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.363+0000 7f95aa861700 1 -- 172.21.15.149:0/244212179 wait complete. 2023-11-08T19:24:35.371 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 17 2023-11-08T19:24:35.378 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:24:35.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.497+0000 7fbfe7816700 1 Processor -- start 2023-11-08T19:24:35.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.497+0000 7fbfe7816700 1 -- start start 2023-11-08T19:24:35.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.498+0000 7fbfe7816700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fbfe00cc140 0x7fbfe00cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:35.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.498+0000 7fbfe7816700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fbfe00b2cd0 0x7fbfe015d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:35.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.498+0000 7fbfe7816700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfe00cce50 con 0x7fbfe00b2850 2023-11-08T19:24:35.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.498+0000 7fbfe7816700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfe00b2430 con 0x7fbfe00b2cd0 2023-11-08T19:24:35.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.498+0000 7fbfe7816700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfe00cc520 con 0x7fbfe00cc140 2023-11-08T19:24:35.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.498+0000 7fbfe4db1700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fbfe00b2850 0x7fbfe00cabf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:41732/0 (socket says 172.21.15.149:41732) 2023-11-08T19:24:35.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.498+0000 7fbfe4db1700 1 -- 172.21.15.149:0/1641210092 learned_addr learned my addr 172.21.15.149:0/1641210092 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:24:35.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.498+0000 7fbfe5db3700 1 --2- 172.21.15.149:0/1641210092 >> v2:172.21.15.149:3300/0 conn(0x7fbfe00b2cd0 0x7fbfe015d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:35.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.498+0000 7fbfd3fff700 1 -- 172.21.15.149:0/1641210092 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 538343735 0 0) 0x7fbfe00cce50 con 0x7fbfe00b2850 2023-11-08T19:24:35.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.498+0000 7fbfd3fff700 1 -- 172.21.15.149:0/1641210092 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfcc0035b0 con 0x7fbfe00b2850 2023-11-08T19:24:35.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.498+0000 7fbfe55b2700 1 --2- 172.21.15.149:0/1641210092 >> v2:172.21.15.160:3300/0 conn(0x7fbfe00cc140 0x7fbfe00cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:35.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.498+0000 7fbfe5db3700 1 -- 172.21.15.149:0/1641210092 >> v2:172.21.15.160:3300/0 conn(0x7fbfe00cc140 msgr2=0x7fbfe00cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:35.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.498+0000 7fbfe5db3700 1 --2- 172.21.15.149:0/1641210092 >> v2:172.21.15.160:3300/0 conn(0x7fbfe00cc140 0x7fbfe00cc910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:35.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.498+0000 7fbfe5db3700 1 -- 172.21.15.149:0/1641210092 >> v1:172.21.15.149:6789/0 conn(0x7fbfe00b2850 legacy=0x7fbfe00cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:35.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.498+0000 7fbfe5db3700 1 -- 172.21.15.149:0/1641210092 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe00b17b0 con 0x7fbfe00b2cd0 2023-11-08T19:24:35.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.498+0000 7fbfe5db3700 1 --2- 172.21.15.149:0/1641210092 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbfe00b2cd0 0x7fbfe015d2b0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fbfe00ce120 tx=0x7fbfd800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b74314f14d1e6b7b server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:35.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.498+0000 7fbfd3fff700 1 -- 172.21.15.149:0/1641210092 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd800e070 con 0x7fbfe00b2cd0 2023-11-08T19:24:35.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.498+0000 7fbfd3fff700 1 -- 172.21.15.149:0/1641210092 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfd800bb20 con 0x7fbfe00b2cd0 2023-11-08T19:24:35.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.498+0000 7fbfd3fff700 1 -- 172.21.15.149:0/1641210092 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd8012430 con 0x7fbfe00b2cd0 2023-11-08T19:24:35.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.499+0000 7fbfe7816700 1 -- 172.21.15.149:0/1641210092 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbfe00b2cd0 msgr2=0x7fbfe015d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:35.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.499+0000 7fbfe7816700 1 --2- 172.21.15.149:0/1641210092 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbfe00b2cd0 0x7fbfe015d2b0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fbfe00ce120 tx=0x7fbfd800b330 comp rx=0 tx=0).stop 2023-11-08T19:24:35.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.499+0000 7fbfe7816700 1 -- 172.21.15.149:0/1641210092 shutdown_connections 2023-11-08T19:24:35.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.499+0000 7fbfe7816700 1 --2- 172.21.15.149:0/1641210092 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbfe00b2cd0 0x7fbfe015d2b0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:35.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.499+0000 7fbfe7816700 1 --2- 172.21.15.149:0/1641210092 >> v2:172.21.15.160:3300/0 conn(0x7fbfe00cc140 0x7fbfe00cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:35.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.499+0000 7fbfe7816700 1 -- 172.21.15.149:0/1641210092 >> 172.21.15.149:0/1641210092 conn(0x7fbfe0099a40 msgr2=0x7fbfe00d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:35.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.499+0000 7fbfe7816700 1 -- 172.21.15.149:0/1641210092 shutdown_connections 2023-11-08T19:24:35.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.499+0000 7fbfe7816700 1 -- 172.21.15.149:0/1641210092 wait complete. 2023-11-08T19:24:35.509 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.500+0000 7fbfe7816700 1 Processor -- start 2023-11-08T19:24:35.509 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.500+0000 7fbfe7816700 1 -- start start 2023-11-08T19:24:35.510 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.501+0000 7fbfe7816700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbfe00b2850 0x7fbfe014e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:35.510 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.501+0000 7fbfe7816700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbfe00b2cd0 0x7fbfe01f4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:35.510 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.501+0000 7fbfe7816700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbfe00cc140 0x7fbfe00b52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:35.510 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.501+0000 7fbfe7816700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe01f4c70 con 0x7fbfe00b2cd0 2023-11-08T19:24:35.510 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.501+0000 7fbfe7816700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe014ea40 con 0x7fbfe00cc140 2023-11-08T19:24:35.511 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.501+0000 7fbfe7816700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe014ed20 con 0x7fbfe00b2850 2023-11-08T19:24:35.511 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.501+0000 7fbfe4db1700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbfe00b2cd0 0x7fbfe01f4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:35.511 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.501+0000 7fbfe4db1700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbfe00b2cd0 0x7fbfe01f4730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39736/0 (socket says 172.21.15.149:39736) 2023-11-08T19:24:35.511 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.501+0000 7fbfe4db1700 1 -- 172.21.15.149:0/1581199799 learned_addr learned my addr 172.21.15.149:0/1581199799 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:35.511 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.501+0000 7fbfe5db3700 1 --2- 172.21.15.149:0/1581199799 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbfe00cc140 0x7fbfe00b52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:35.512 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.501+0000 7fbfe55b2700 1 --2- 172.21.15.149:0/1581199799 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbfe00b2850 0x7fbfe014e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:35.512 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.501+0000 7fbfe4db1700 1 -- 172.21.15.149:0/1581199799 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbfe00b2850 msgr2=0x7fbfe014e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:35.512 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.501+0000 7fbfe4db1700 1 --2- 172.21.15.149:0/1581199799 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbfe00b2850 0x7fbfe014e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:35.512 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.501+0000 7fbfe4db1700 1 -- 172.21.15.149:0/1581199799 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbfe00cc140 msgr2=0x7fbfe00b52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:35.512 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.501+0000 7fbfe4db1700 1 --2- 172.21.15.149:0/1581199799 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbfe00cc140 0x7fbfe00b52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:35.513 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.501+0000 7fbfe4db1700 1 -- 172.21.15.149:0/1581199799 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd8009a70 con 0x7fbfe00b2cd0 2023-11-08T19:24:35.513 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.501+0000 7fbfe5db3700 1 --2- 172.21.15.149:0/1581199799 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbfe00cc140 0x7fbfe00b52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:24:35.513 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.501+0000 7fbfe4db1700 1 --2- 172.21.15.149:0/1581199799 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbfe00b2cd0 0x7fbfe01f4730 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4001eb0 tx=0x7fbfd400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:35.513 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.502+0000 7fbfd1ffb700 1 -- 172.21.15.149:0/1581199799 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd4005d70 con 0x7fbfe00b2cd0 2023-11-08T19:24:35.513 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.502+0000 7fbfd1ffb700 1 -- 172.21.15.149:0/1581199799 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfd40070d0 con 0x7fbfe00b2cd0 2023-11-08T19:24:35.513 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.502+0000 7fbfe7816700 1 -- 172.21.15.149:0/1581199799 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfe014f000 con 0x7fbfe00b2cd0 2023-11-08T19:24:35.514 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.502+0000 7fbfd1ffb700 1 -- 172.21.15.149:0/1581199799 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd4007460 con 0x7fbfe00b2cd0 2023-11-08T19:24:35.514 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.502+0000 7fbfe7816700 1 -- 172.21.15.149:0/1581199799 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfe014f5c0 con 0x7fbfe00b2cd0 2023-11-08T19:24:35.514 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.503+0000 7fbfe7816700 1 -- 172.21.15.149:0/1581199799 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfe00745f0 con 0x7fbfe00b2cd0 2023-11-08T19:24:35.514 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.503+0000 7fbfd1ffb700 1 -- 172.21.15.149:0/1581199799 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbfd40075c0 con 0x7fbfe00b2cd0 2023-11-08T19:24:35.514 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.504+0000 7fbfd1ffb700 1 --2- 172.21.15.149:0/1581199799 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fbfc406af00 0x7fbfc406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:35.515 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.504+0000 7fbfd1ffb700 1 -- 172.21.15.149:0/1581199799 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6438+0+0 (secure 0 0 0) 0x7fbfd4088dd0 con 0x7fbfe00b2cd0 2023-11-08T19:24:35.515 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.504+0000 7fbfe55b2700 1 --2- 172.21.15.149:0/1581199799 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fbfc406af00 0x7fbfc406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:35.515 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.504+0000 7fbfe55b2700 1 --2- 172.21.15.149:0/1581199799 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fbfc406af00 0x7fbfc406d3c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc006fd0 tx=0x7fbfdc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:35.516 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.509+0000 7fbfd1ffb700 1 -- 172.21.15.149:0/1581199799 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbfd4053ba0 con 0x7fbfe00b2cd0 2023-11-08T19:24:35.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.698+0000 7fbfe7816700 1 -- 172.21.15.149:0/1581199799 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbfe00cf640 con 0x7fbfe00b2cd0 2023-11-08T19:24:35.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.700+0000 7fbfd1ffb700 1 -- 172.21.15.149:0/1581199799 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+18649 (secure 0 0 0) 0x7fbfd4017090 con 0x7fbfe00b2cd0 2023-11-08T19:24:35.702 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:24:35.702 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":42,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:24:32.128826+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-08T19:24:14.467859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-08T19:24:15.470328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-08T19:24:29.516185+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":1,"length":1}]}],"new_removed_snaps":[{"pool":7,"snaps":[{"begin":1,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:24:35.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.702+0000 7fbfe7816700 1 -- 172.21.15.149:0/1581199799 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fbfc406af00 msgr2=0x7fbfc406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:35.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.702+0000 7fbfe7816700 1 --2- 172.21.15.149:0/1581199799 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fbfc406af00 0x7fbfc406d3c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc006fd0 tx=0x7fbfdc008040 comp rx=0 tx=0).stop 2023-11-08T19:24:35.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.702+0000 7fbfe7816700 1 -- 172.21.15.149:0/1581199799 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbfe00b2cd0 msgr2=0x7fbfe01f4730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:35.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.702+0000 7fbfe7816700 1 --2- 172.21.15.149:0/1581199799 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbfe00b2cd0 0x7fbfe01f4730 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4001eb0 tx=0x7fbfd400c860 comp rx=0 tx=0).stop 2023-11-08T19:24:35.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.702+0000 7fbfe7816700 1 -- 172.21.15.149:0/1581199799 shutdown_connections 2023-11-08T19:24:35.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.702+0000 7fbfe7816700 1 --2- 172.21.15.149:0/1581199799 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fbfc406af00 0x7fbfc406d3c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:35.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.702+0000 7fbfe7816700 1 --2- 172.21.15.149:0/1581199799 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbfe00cc140 0x7fbfe00b52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:35.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.702+0000 7fbfe7816700 1 --2- 172.21.15.149:0/1581199799 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbfe00b2850 0x7fbfe014e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:35.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.702+0000 7fbfe7816700 1 --2- 172.21.15.149:0/1581199799 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbfe00b2cd0 0x7fbfe01f4730 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:35.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.702+0000 7fbfe7816700 1 -- 172.21.15.149:0/1581199799 >> 172.21.15.149:0/1581199799 conn(0x7fbfe0099a40 msgr2=0x7fbfe006f870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:35.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.702+0000 7fbfe7816700 1 -- 172.21.15.149:0/1581199799 shutdown_connections 2023-11-08T19:24:35.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.702+0000 7fbfe7816700 1 -- 172.21.15.149:0/1581199799 wait complete. 2023-11-08T19:24:35.716 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-08T19:22:56.023194+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-08T19:24:14.467859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-11-08T19:24:15.470328+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-08T19:24:29.516185+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 42, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-08T19:24:35.717 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-08T19:24:35.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.839+0000 7f91c7d12700 1 Processor -- start 2023-11-08T19:24:35.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.839+0000 7f91c7d12700 1 -- start start 2023-11-08T19:24:35.849 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.840+0000 7f91c7d12700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f91c015dbe0 0x7f91c00d3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:35.849 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.840+0000 7f91c7d12700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f91c00d0330 0x7f91c00d07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:35.850 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.840+0000 7f91c7d12700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91c015dfc0 con 0x7f91c00b9640 2023-11-08T19:24:35.850 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.840+0000 7f91c7d12700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91c00d2090 con 0x7f91c015dbe0 2023-11-08T19:24:35.850 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.840+0000 7f91c7d12700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91c00d0d00 con 0x7f91c00d0330 2023-11-08T19:24:35.850 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.840+0000 7f91c5aae700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f91c015dbe0 0x7f91c00d3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:35.851 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.840+0000 7f91c52ad700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f91c00b9640 0x7f91c00d1980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:41744/0 (socket says 172.21.15.149:41744) 2023-11-08T19:24:35.851 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.840+0000 7f91c52ad700 1 -- 172.21.15.149:0/2802010636 learned_addr learned my addr 172.21.15.149:0/2802010636 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:24:35.851 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.840+0000 7f91c62af700 1 --2- 172.21.15.149:0/2802010636 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f91c00d0330 0x7f91c00d07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:35.851 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.840+0000 7f91c5aae700 1 -- 172.21.15.149:0/2802010636 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f91c00d0330 msgr2=0x7f91c00d07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:35.851 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.840+0000 7f91c5aae700 1 --2- 172.21.15.149:0/2802010636 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f91c00d0330 0x7f91c00d07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:35.852 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.840+0000 7f91c5aae700 1 -- 172.21.15.149:0/2802010636 >> v1:172.21.15.149:6789/0 conn(0x7f91c00b9640 legacy=0x7f91c00d1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:35.852 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.840+0000 7f91c4aac700 1 -- 172.21.15.149:0/2802010636 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4196102787 0 0) 0x7f91c015dfc0 con 0x7f91c00b9640 2023-11-08T19:24:35.852 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.840+0000 7f91c5aae700 1 -- 172.21.15.149:0/2802010636 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c00d2280 con 0x7f91c015dbe0 2023-11-08T19:24:35.852 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.840+0000 7f91c5aae700 1 --2- 172.21.15.149:0/2802010636 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91c015dbe0 0x7f91c00d3320 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f91bc009840 tx=0x7f91bc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c2099e8f02f68ea server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:35.852 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.840+0000 7f91c4aac700 1 -- 172.21.15.149:0/2802010636 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91bc011830 con 0x7f91c015dbe0 2023-11-08T19:24:35.853 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.840+0000 7f91c4aac700 1 -- 172.21.15.149:0/2802010636 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91bc011990 con 0x7f91c015dbe0 2023-11-08T19:24:35.853 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.840+0000 7f91c4aac700 1 -- 172.21.15.149:0/2802010636 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91bc011d20 con 0x7f91c015dbe0 2023-11-08T19:24:35.853 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.841+0000 7f91c7d12700 1 -- 172.21.15.149:0/2802010636 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91c015dbe0 msgr2=0x7f91c00d3320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:35.853 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.841+0000 7f91c7d12700 1 --2- 172.21.15.149:0/2802010636 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91c015dbe0 0x7f91c00d3320 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f91bc009840 tx=0x7f91bc009b50 comp rx=0 tx=0).stop 2023-11-08T19:24:35.853 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.841+0000 7f91c7d12700 1 -- 172.21.15.149:0/2802010636 shutdown_connections 2023-11-08T19:24:35.854 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.841+0000 7f91c7d12700 1 --2- 172.21.15.149:0/2802010636 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f91c00d0330 0x7f91c00d07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:35.854 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.841+0000 7f91c7d12700 1 --2- 172.21.15.149:0/2802010636 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91c015dbe0 0x7f91c00d3320 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:35.854 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.841+0000 7f91c7d12700 1 -- 172.21.15.149:0/2802010636 >> 172.21.15.149:0/2802010636 conn(0x7f91c006bd60 msgr2=0x7f91c006c140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:35.854 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.841+0000 7f91c7d12700 1 -- 172.21.15.149:0/2802010636 shutdown_connections 2023-11-08T19:24:35.855 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.841+0000 7f91c7d12700 1 -- 172.21.15.149:0/2802010636 wait complete. 2023-11-08T19:24:35.855 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.842+0000 7f91c7d12700 1 Processor -- start 2023-11-08T19:24:35.855 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.842+0000 7f91c7d12700 1 -- start start 2023-11-08T19:24:35.855 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.843+0000 7f91c7d12700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91c00b9640 0x7f91c00b4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:35.856 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.843+0000 7f91c7d12700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91c00d0330 0x7f91c015ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:35.856 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.843+0000 7f91c7d12700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f91c015dbe0 0x7f91c015ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:35.856 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.843+0000 7f91c7d12700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c00b3ba0 con 0x7f91c00b9640 2023-11-08T19:24:35.856 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.843+0000 7f91c7d12700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c00b3e80 con 0x7f91c00d0330 2023-11-08T19:24:35.856 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.843+0000 7f91c7d12700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91c00b4160 con 0x7f91c015dbe0 2023-11-08T19:24:35.857 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.843+0000 7f91c5aae700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91c00b9640 0x7f91c00b4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:35.857 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.843+0000 7f91c5aae700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91c00b9640 0x7f91c00b4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39746/0 (socket says 172.21.15.149:39746) 2023-11-08T19:24:35.857 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.843+0000 7f91c5aae700 1 -- 172.21.15.149:0/2452155762 learned_addr learned my addr 172.21.15.149:0/2452155762 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:35.857 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.843+0000 7f91c62af700 1 --2- 172.21.15.149:0/2452155762 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f91c015dbe0 0x7f91c015ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:35.857 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.843+0000 7f91c52ad700 1 --2- 172.21.15.149:0/2452155762 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91c00d0330 0x7f91c015ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:35.858 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.843+0000 7f91c5aae700 1 -- 172.21.15.149:0/2452155762 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f91c015dbe0 msgr2=0x7f91c015ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:35.858 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.843+0000 7f91c5aae700 1 --2- 172.21.15.149:0/2452155762 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f91c015dbe0 0x7f91c015ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:35.858 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.843+0000 7f91c5aae700 1 -- 172.21.15.149:0/2452155762 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91c00d0330 msgr2=0x7f91c015ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:35.858 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.843+0000 7f91c5aae700 1 --2- 172.21.15.149:0/2452155762 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91c00d0330 0x7f91c015ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:35.858 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.843+0000 7f91c5aae700 1 -- 172.21.15.149:0/2452155762 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91bc0094a0 con 0x7f91c00b9640 2023-11-08T19:24:35.859 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.844+0000 7f91c5aae700 1 --2- 172.21.15.149:0/2452155762 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91c00b9640 0x7f91c00b4c40 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f91bc014040 tx=0x7f91bc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:35.859 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.844+0000 7f91b67fc700 1 -- 172.21.15.149:0/2452155762 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91bc0038a0 con 0x7f91c00b9640 2023-11-08T19:24:35.859 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.844+0000 7f91b67fc700 1 -- 172.21.15.149:0/2452155762 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91bc01e070 con 0x7f91c00b9640 2023-11-08T19:24:35.859 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.844+0000 7f91c7d12700 1 -- 172.21.15.149:0/2452155762 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91c00b4440 con 0x7f91c00b9640 2023-11-08T19:24:35.859 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.844+0000 7f91b67fc700 1 -- 172.21.15.149:0/2452155762 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91bc003c20 con 0x7f91c00b9640 2023-11-08T19:24:35.860 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.844+0000 7f91c7d12700 1 -- 172.21.15.149:0/2452155762 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91c00b3800 con 0x7f91c00b9640 2023-11-08T19:24:35.860 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.845+0000 7f91c7d12700 1 -- 172.21.15.149:0/2452155762 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91c004f730 con 0x7f91c00b9640 2023-11-08T19:24:35.860 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.845+0000 7f91b67fc700 1 -- 172.21.15.149:0/2452155762 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f91bc02d450 con 0x7f91c00b9640 2023-11-08T19:24:35.860 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.846+0000 7f91b67fc700 1 --2- 172.21.15.149:0/2452155762 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f91a406af00 0x7f91a406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:35.861 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.846+0000 7f91b67fc700 1 -- 172.21.15.149:0/2452155762 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6438+0+0 (secure 0 0 0) 0x7f91bc08ad20 con 0x7f91c00b9640 2023-11-08T19:24:35.861 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.846+0000 7f91c52ad700 1 --2- 172.21.15.149:0/2452155762 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f91a406af00 0x7f91a406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:35.861 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.846+0000 7f91c52ad700 1 --2- 172.21.15.149:0/2452155762 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f91a406af00 0x7f91a406d3c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f91c00b5180 tx=0x7f91b0007be0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:35.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:35.850+0000 7f91b67fc700 1 -- 172.21.15.149:0/2452155762 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f91bc055bd0 con 0x7f91c00b9640 2023-11-08T19:24:36.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.038+0000 7f91c7d12700 1 -- 172.21.15.149:0/2452155762 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f91c0073a50 con 0x7f91c00b9640 2023-11-08T19:24:36.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.038+0000 7f91b67fc700 1 -- 172.21.15.149:0/2452155762 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) v1 ==== 93+0+10 (secure 0 0 0) 0x7f91bc0200a0 con 0x7f91c00b9640 2023-11-08T19:24:36.041 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 1 2023-11-08T19:24:36.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.040+0000 7f91c7d12700 1 -- 172.21.15.149:0/2452155762 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f91a406af00 msgr2=0x7f91a406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:36.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.040+0000 7f91c7d12700 1 --2- 172.21.15.149:0/2452155762 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f91a406af00 0x7f91a406d3c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f91c00b5180 tx=0x7f91b0007be0 comp rx=0 tx=0).stop 2023-11-08T19:24:36.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.040+0000 7f91c7d12700 1 -- 172.21.15.149:0/2452155762 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91c00b9640 msgr2=0x7f91c00b4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:36.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.040+0000 7f91c7d12700 1 --2- 172.21.15.149:0/2452155762 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91c00b9640 0x7f91c00b4c40 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f91bc014040 tx=0x7f91bc004750 comp rx=0 tx=0).stop 2023-11-08T19:24:36.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.040+0000 7f91c7d12700 1 -- 172.21.15.149:0/2452155762 shutdown_connections 2023-11-08T19:24:36.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.040+0000 7f91c7d12700 1 --2- 172.21.15.149:0/2452155762 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f91a406af00 0x7f91a406d3c0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:36.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.040+0000 7f91c7d12700 1 --2- 172.21.15.149:0/2452155762 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f91c015dbe0 0x7f91c015ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:36.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.040+0000 7f91c7d12700 1 --2- 172.21.15.149:0/2452155762 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91c00b9640 0x7f91c00b4c40 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:36.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.040+0000 7f91c7d12700 1 --2- 172.21.15.149:0/2452155762 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91c00d0330 0x7f91c015ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:36.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.040+0000 7f91c7d12700 1 -- 172.21.15.149:0/2452155762 >> 172.21.15.149:0/2452155762 conn(0x7f91c006bd60 msgr2=0x7f91c00d35a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:36.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.040+0000 7f91c7d12700 1 -- 172.21.15.149:0/2452155762 shutdown_connections 2023-11-08T19:24:36.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.040+0000 7f91c7d12700 1 -- 172.21.15.149:0/2452155762 wait complete. 2023-11-08T19:24:36.054 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-08T19:24:36.180 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.178+0000 7f13081b7700 1 Processor -- start 2023-11-08T19:24:36.181 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.178+0000 7f13081b7700 1 -- start start 2023-11-08T19:24:36.183 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.179+0000 7f13081b7700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f130015abf0 0x7f13000b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:36.183 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.179+0000 7f13081b7700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f13000d1130 0x7f13000cc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:36.184 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.179+0000 7f13081b7700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13000b6470 con 0x7f13000cc6a0 2023-11-08T19:24:36.184 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.179+0000 7f13081b7700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13000b66a0 con 0x7f13000d1130 2023-11-08T19:24:36.184 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.179+0000 7f13081b7700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13000d04a0 con 0x7f130015abf0 2023-11-08T19:24:36.184 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.179+0000 7f1305752700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f13000d1130 0x7f13000cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:36.184 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.179+0000 7f1306754700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f13000cc6a0 0x7f13000ce210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:41760/0 (socket says 172.21.15.149:41760) 2023-11-08T19:24:36.185 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.179+0000 7f1305752700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f13000d1130 0x7f13000cc160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39754/0 (socket says 172.21.15.149:39754) 2023-11-08T19:24:36.185 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.179+0000 7f1306754700 1 -- 172.21.15.149:0/3311608615 learned_addr learned my addr 172.21.15.149:0/3311608615 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:24:36.185 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.180+0000 7f1305752700 1 -- 172.21.15.149:0/3311608615 >> v2:172.21.15.160:3300/0 conn(0x7f130015abf0 msgr2=0x7f13000b5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:36.185 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.180+0000 7f1305f53700 1 --2- 172.21.15.149:0/3311608615 >> v2:172.21.15.160:3300/0 conn(0x7f130015abf0 0x7f13000b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:36.185 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.180+0000 7f1305752700 1 --2- 172.21.15.149:0/3311608615 >> v2:172.21.15.160:3300/0 conn(0x7f130015abf0 0x7f13000b5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:36.186 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.180+0000 7f1305752700 1 -- 172.21.15.149:0/3311608615 >> v1:172.21.15.149:6789/0 conn(0x7f13000cc6a0 legacy=0x7f13000ce210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:36.186 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.180+0000 7f1304f51700 1 -- 172.21.15.149:0/3311608615 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1505750224 0 0) 0x7f13000b6470 con 0x7f13000cc6a0 2023-11-08T19:24:36.186 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.180+0000 7f1305752700 1 -- 172.21.15.149:0/3311608615 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f130015afd0 con 0x7f13000d1130 2023-11-08T19:24:36.186 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.180+0000 7f1305752700 1 --2- 172.21.15.149:0/3311608615 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13000d1130 0x7f13000cc160 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f1300067970 tx=0x7f12fc009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35f517ee04186f71 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:36.186 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.180+0000 7f1304f51700 1 -- 172.21.15.149:0/3311608615 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12fc011830 con 0x7f13000d1130 2023-11-08T19:24:36.187 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.180+0000 7f1304f51700 1 -- 172.21.15.149:0/3311608615 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12fc011990 con 0x7f13000d1130 2023-11-08T19:24:36.187 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.180+0000 7f1304f51700 1 -- 172.21.15.149:0/3311608615 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12fc011d20 con 0x7f13000d1130 2023-11-08T19:24:36.187 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.181+0000 7f13081b7700 1 -- 172.21.15.149:0/3311608615 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13000d1130 msgr2=0x7f13000cc160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:36.187 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.181+0000 7f13081b7700 1 --2- 172.21.15.149:0/3311608615 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13000d1130 0x7f13000cc160 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f1300067970 tx=0x7f12fc009b20 comp rx=0 tx=0).stop 2023-11-08T19:24:36.187 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.181+0000 7f13081b7700 1 -- 172.21.15.149:0/3311608615 shutdown_connections 2023-11-08T19:24:36.188 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.181+0000 7f13081b7700 1 --2- 172.21.15.149:0/3311608615 >> v2:172.21.15.160:3300/0 conn(0x7f130015abf0 0x7f13000b5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:36.188 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.181+0000 7f13081b7700 1 --2- 172.21.15.149:0/3311608615 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13000d1130 0x7f13000cc160 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:36.188 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.181+0000 7f13081b7700 1 -- 172.21.15.149:0/3311608615 >> 172.21.15.149:0/3311608615 conn(0x7f13000d0640 msgr2=0x7f13000d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:36.188 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.181+0000 7f13081b7700 1 -- 172.21.15.149:0/3311608615 shutdown_connections 2023-11-08T19:24:36.188 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.181+0000 7f13081b7700 1 -- 172.21.15.149:0/3311608615 wait complete. 2023-11-08T19:24:36.191 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.182+0000 7f13081b7700 1 Processor -- start 2023-11-08T19:24:36.191 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.182+0000 7f13081b7700 1 -- start start 2023-11-08T19:24:36.191 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.183+0000 7f13081b7700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13000cc6a0 0x7f130015b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:36.191 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.183+0000 7f13081b7700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13000d1130 0x7f130014fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:36.192 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.183+0000 7f13081b7700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f130015abf0 0x7f13000b12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:36.192 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.183+0000 7f13081b7700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13000c84c0 con 0x7f13000cc6a0 2023-11-08T19:24:36.192 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.183+0000 7f13081b7700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13000c78b0 con 0x7f13000d1130 2023-11-08T19:24:36.192 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.183+0000 7f13081b7700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13000c7b90 con 0x7f130015abf0 2023-11-08T19:24:36.192 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.183+0000 7f1305f53700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13000cc6a0 0x7f130015b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:36.193 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.183+0000 7f1305f53700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13000cc6a0 0x7f130015b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39760/0 (socket says 172.21.15.149:39760) 2023-11-08T19:24:36.193 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.183+0000 7f1305f53700 1 -- 172.21.15.149:0/20856579 learned_addr learned my addr 172.21.15.149:0/20856579 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:36.193 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.183+0000 7f1305f53700 1 -- 172.21.15.149:0/20856579 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f130015abf0 msgr2=0x7f13000b12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:36.193 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.183+0000 7f1305f53700 1 --2- 172.21.15.149:0/20856579 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f130015abf0 0x7f13000b12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:36.193 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.183+0000 7f1305f53700 1 -- 172.21.15.149:0/20856579 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13000d1130 msgr2=0x7f130014fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:36.194 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.183+0000 7f1305f53700 1 --2- 172.21.15.149:0/20856579 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13000d1130 0x7f130014fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:36.194 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.183+0000 7f1305f53700 1 -- 172.21.15.149:0/20856579 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12fc0094a0 con 0x7f13000cc6a0 2023-11-08T19:24:36.194 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.183+0000 7f1305f53700 1 --2- 172.21.15.149:0/20856579 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13000cc6a0 0x7f130015b1c0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f12f000c7f0 tx=0x7f12f000cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:36.194 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.183+0000 7f12f67fc700 1 -- 172.21.15.149:0/20856579 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f0011800 con 0x7f13000cc6a0 2023-11-08T19:24:36.194 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.183+0000 7f12f67fc700 1 -- 172.21.15.149:0/20856579 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f0011960 con 0x7f13000cc6a0 2023-11-08T19:24:36.195 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.183+0000 7f13081b7700 1 -- 172.21.15.149:0/20856579 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13000c7e70 con 0x7f13000cc6a0 2023-11-08T19:24:36.195 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.183+0000 7f12f67fc700 1 -- 172.21.15.149:0/20856579 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f0011d10 con 0x7f13000cc6a0 2023-11-08T19:24:36.195 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.183+0000 7f13081b7700 1 -- 172.21.15.149:0/20856579 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13001500f0 con 0x7f13000cc6a0 2023-11-08T19:24:36.195 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.184+0000 7f13081b7700 1 -- 172.21.15.149:0/20856579 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f130015e800 con 0x7f13000cc6a0 2023-11-08T19:24:36.195 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.185+0000 7f12f67fc700 1 -- 172.21.15.149:0/20856579 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f12f0018360 con 0x7f13000cc6a0 2023-11-08T19:24:36.196 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.185+0000 7f12f67fc700 1 --2- 172.21.15.149:0/20856579 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f12e406af00 0x7f12e406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:36.196 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.185+0000 7f12f67fc700 1 -- 172.21.15.149:0/20856579 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6438+0+0 (secure 0 0 0) 0x7f12f00898e0 con 0x7f13000cc6a0 2023-11-08T19:24:36.196 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.185+0000 7f1305752700 1 --2- 172.21.15.149:0/20856579 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f12e406af00 0x7f12e406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:36.196 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.185+0000 7f1305752700 1 --2- 172.21.15.149:0/20856579 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f12e406af00 0x7f12e406d3c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f130015dfc0 tx=0x7f12fc010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:36.197 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.190+0000 7f12f67fc700 1 -- 172.21.15.149:0/20856579 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f12f00546c0 con 0x7f13000cc6a0 2023-11-08T19:24:36.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.380+0000 7f13081b7700 1 -- 172.21.15.149:0/20856579 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f130004f730 con 0x7f13000cc6a0 2023-11-08T19:24:36.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.380+0000 7f12f67fc700 1 -- 172.21.15.149:0/20856579 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v42) v1 ==== 104+0+11 (secure 0 0 0) 0x7f12f0057ce0 con 0x7f13000cc6a0 2023-11-08T19:24:36.383 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:24:36.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.382+0000 7f13081b7700 1 -- 172.21.15.149:0/20856579 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f12e406af00 msgr2=0x7f12e406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:36.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.382+0000 7f13081b7700 1 --2- 172.21.15.149:0/20856579 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f12e406af00 0x7f12e406d3c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f130015dfc0 tx=0x7f12fc010000 comp rx=0 tx=0).stop 2023-11-08T19:24:36.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.382+0000 7f13081b7700 1 -- 172.21.15.149:0/20856579 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13000cc6a0 msgr2=0x7f130015b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:36.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.382+0000 7f13081b7700 1 --2- 172.21.15.149:0/20856579 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13000cc6a0 0x7f130015b1c0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f12f000c7f0 tx=0x7f12f000cbb0 comp rx=0 tx=0).stop 2023-11-08T19:24:36.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.382+0000 7f13081b7700 1 -- 172.21.15.149:0/20856579 shutdown_connections 2023-11-08T19:24:36.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.382+0000 7f13081b7700 1 --2- 172.21.15.149:0/20856579 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f12e406af00 0x7f12e406d3c0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:36.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.382+0000 7f13081b7700 1 --2- 172.21.15.149:0/20856579 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f130015abf0 0x7f13000b12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:36.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.382+0000 7f13081b7700 1 --2- 172.21.15.149:0/20856579 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13000cc6a0 0x7f130015b1c0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:36.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.382+0000 7f13081b7700 1 --2- 172.21.15.149:0/20856579 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13000d1130 0x7f130014fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:36.387 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.382+0000 7f13081b7700 1 -- 172.21.15.149:0/20856579 >> 172.21.15.149:0/20856579 conn(0x7f13000d0640 msgr2=0x7f13000ce960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:36.387 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.382+0000 7f13081b7700 1 -- 172.21.15.149:0/20856579 shutdown_connections 2023-11-08T19:24:36.387 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.382+0000 7f13081b7700 1 -- 172.21.15.149:0/20856579 wait complete. 2023-11-08T19:24:36.397 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-08T19:24:36.520 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.518+0000 7f0016017700 1 Processor -- start 2023-11-08T19:24:36.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.518+0000 7f0016017700 1 -- start start 2023-11-08T19:24:36.523 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.519+0000 7f0016017700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f001006ab80 0x7f00100caf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:36.523 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.519+0000 7f0016017700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f00100cf1c0 0x7f00100cb490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:36.523 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.519+0000 7f0016017700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f001015e320 con 0x7f001015df40 2023-11-08T19:24:36.523 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.519+0000 7f0016017700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f001006b020 con 0x7f001006ab80 2023-11-08T19:24:36.524 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.519+0000 7f0016017700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f001006b2e0 con 0x7f00100cf1c0 2023-11-08T19:24:36.524 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.519+0000 7f000effd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f001006ab80 0x7f00100caf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:36.524 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.519+0000 7f000f7fe700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f001015df40 0x7f001006c0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:41770/0 (socket says 172.21.15.149:41770) 2023-11-08T19:24:36.524 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.519+0000 7f000effd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f001006ab80 0x7f00100caf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39770/0 (socket says 172.21.15.149:39770) 2023-11-08T19:24:36.524 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.519+0000 7f000f7fe700 1 -- 172.21.15.149:0/1617100128 learned_addr learned my addr 172.21.15.149:0/1617100128 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:24:36.525 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.519+0000 7f000ffff700 1 --2- 172.21.15.149:0/1617100128 >> v2:172.21.15.160:3300/0 conn(0x7f00100cf1c0 0x7f00100cb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:36.525 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.519+0000 7f000effd700 1 -- 172.21.15.149:0/1617100128 >> v2:172.21.15.160:3300/0 conn(0x7f00100cf1c0 msgr2=0x7f00100cb490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:36.525 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.519+0000 7f000effd700 1 --2- 172.21.15.149:0/1617100128 >> v2:172.21.15.160:3300/0 conn(0x7f00100cf1c0 0x7f00100cb490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:36.525 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.519+0000 7f000effd700 1 -- 172.21.15.149:0/1617100128 >> v1:172.21.15.149:6789/0 conn(0x7f001015df40 legacy=0x7f001006c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:36.525 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.519+0000 7f000e7fc700 1 -- 172.21.15.149:0/1617100128 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1549936854 0 0) 0x7f001015e320 con 0x7f001015df40 2023-11-08T19:24:36.526 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.519+0000 7f000effd700 1 -- 172.21.15.149:0/1617100128 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f001006b5c0 con 0x7f001006ab80 2023-11-08T19:24:36.526 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.520+0000 7f000effd700 1 --2- 172.21.15.149:0/1617100128 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f001006ab80 0x7f00100caf50 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f00100b2180 tx=0x7f0000009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bb7d773d6666aae server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:36.526 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.520+0000 7f000e7fc700 1 -- 172.21.15.149:0/1617100128 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0000011830 con 0x7f001006ab80 2023-11-08T19:24:36.526 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.520+0000 7f000e7fc700 1 -- 172.21.15.149:0/1617100128 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0000011990 con 0x7f001006ab80 2023-11-08T19:24:36.527 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.520+0000 7f000e7fc700 1 -- 172.21.15.149:0/1617100128 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0000011d20 con 0x7f001006ab80 2023-11-08T19:24:36.527 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.520+0000 7f0016017700 1 -- 172.21.15.149:0/1617100128 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f001006ab80 msgr2=0x7f00100caf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:36.527 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.520+0000 7f0016017700 1 --2- 172.21.15.149:0/1617100128 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f001006ab80 0x7f00100caf50 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f00100b2180 tx=0x7f0000009b20 comp rx=0 tx=0).stop 2023-11-08T19:24:36.527 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.520+0000 7f0016017700 1 -- 172.21.15.149:0/1617100128 shutdown_connections 2023-11-08T19:24:36.527 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.520+0000 7f0016017700 1 --2- 172.21.15.149:0/1617100128 >> v2:172.21.15.160:3300/0 conn(0x7f00100cf1c0 0x7f00100cb490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:36.527 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.520+0000 7f0016017700 1 --2- 172.21.15.149:0/1617100128 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f001006ab80 0x7f00100caf50 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:36.528 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.520+0000 7f0016017700 1 -- 172.21.15.149:0/1617100128 >> 172.21.15.149:0/1617100128 conn(0x7f00100d0640 msgr2=0x7f00100d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:36.528 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.520+0000 7f0016017700 1 -- 172.21.15.149:0/1617100128 shutdown_connections 2023-11-08T19:24:36.528 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.520+0000 7f0016017700 1 -- 172.21.15.149:0/1617100128 wait complete. 2023-11-08T19:24:36.531 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.521+0000 7f0016017700 1 Processor -- start 2023-11-08T19:24:36.531 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.522+0000 7f0016017700 1 -- start start 2023-11-08T19:24:36.531 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.522+0000 7f0016017700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f001006ab80 0x7f0010160760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:36.531 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.522+0000 7f0016017700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f00100cf1c0 0x7f00101f3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:36.531 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.522+0000 7f0016017700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f001015df40 0x7f00101f3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:36.532 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.522+0000 7f0016017700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f001015e6e0 con 0x7f001006ab80 2023-11-08T19:24:36.532 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.522+0000 7f0016017700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f001015e9c0 con 0x7f001015df40 2023-11-08T19:24:36.532 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.522+0000 7f0016017700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f001015eca0 con 0x7f00100cf1c0 2023-11-08T19:24:36.532 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.522+0000 7f000f7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f001006ab80 0x7f0010160760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:36.533 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.522+0000 7f000f7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f001006ab80 0x7f0010160760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39774/0 (socket says 172.21.15.149:39774) 2023-11-08T19:24:36.533 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.522+0000 7f000f7fe700 1 -- 172.21.15.149:0/1418616884 learned_addr learned my addr 172.21.15.149:0/1418616884 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:36.533 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.523+0000 7f000effd700 1 --2- 172.21.15.149:0/1418616884 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f00100cf1c0 0x7f00101f3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:36.533 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.523+0000 7f000ffff700 1 --2- 172.21.15.149:0/1418616884 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f001015df40 0x7f00101f3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:36.533 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.523+0000 7f000f7fe700 1 -- 172.21.15.149:0/1418616884 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f00100cf1c0 msgr2=0x7f00101f3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:36.534 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.523+0000 7f000f7fe700 1 --2- 172.21.15.149:0/1418616884 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f00100cf1c0 0x7f00101f3310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:36.534 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.523+0000 7f000f7fe700 1 -- 172.21.15.149:0/1418616884 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f001015df40 msgr2=0x7f00101f3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:36.534 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.523+0000 7f000f7fe700 1 --2- 172.21.15.149:0/1418616884 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f001015df40 0x7f00101f3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:36.534 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.523+0000 7f000f7fe700 1 -- 172.21.15.149:0/1418616884 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00000094a0 con 0x7f001006ab80 2023-11-08T19:24:36.534 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.523+0000 7f000effd700 1 --2- 172.21.15.149:0/1418616884 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f00100cf1c0 0x7f00101f3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:24:36.535 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.523+0000 7f000f7fe700 1 --2- 172.21.15.149:0/1418616884 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f001006ab80 0x7f0010160760 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7efff800c550 tx=0x7efff800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:36.535 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.523+0000 7f0007fff700 1 -- 172.21.15.149:0/1418616884 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff8004c80 con 0x7f001006ab80 2023-11-08T19:24:36.535 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.523+0000 7f0007fff700 1 -- 172.21.15.149:0/1418616884 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff8004e00 con 0x7f001006ab80 2023-11-08T19:24:36.535 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.523+0000 7f0016017700 1 -- 172.21.15.149:0/1418616884 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f001015ef80 con 0x7f001006ab80 2023-11-08T19:24:36.535 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.523+0000 7f0007fff700 1 -- 172.21.15.149:0/1418616884 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff8007310 con 0x7f001006ab80 2023-11-08T19:24:36.536 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.523+0000 7f0016017700 1 -- 172.21.15.149:0/1418616884 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0010160ca0 con 0x7f001006ab80 2023-11-08T19:24:36.536 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.524+0000 7f0016017700 1 -- 172.21.15.149:0/1418616884 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00100726a0 con 0x7f001006ab80 2023-11-08T19:24:36.536 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.524+0000 7f0007fff700 1 -- 172.21.15.149:0/1418616884 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efff8007470 con 0x7f001006ab80 2023-11-08T19:24:36.536 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.525+0000 7f0007fff700 1 --2- 172.21.15.149:0/1418616884 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7efff006af00 0x7efff006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:36.536 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.525+0000 7f0007fff700 1 -- 172.21.15.149:0/1418616884 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6438+0+0 (secure 0 0 0) 0x7efff8089640 con 0x7f001006ab80 2023-11-08T19:24:36.537 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.525+0000 7f000effd700 1 --2- 172.21.15.149:0/1418616884 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7efff006af00 0x7efff006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:36.537 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.525+0000 7f000effd700 1 --2- 172.21.15.149:0/1418616884 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7efff006af00 0x7efff006d3c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f00000090b0 tx=0x7f0000008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:36.537 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.530+0000 7f0007fff700 1 -- 172.21.15.149:0/1418616884 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efff8054390 con 0x7f001006ab80 2023-11-08T19:24:36.724 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.722+0000 7f0016017700 1 -- 172.21.15.149:0/1418616884 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f001004f730 con 0x7f001006ab80 2023-11-08T19:24:36.725 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.723+0000 7f0007fff700 1 -- 172.21.15.149:0/1418616884 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v42) v1 ==== 100+0+11 (secure 0 0 0) 0x7efff80579b0 con 0x7f001006ab80 2023-11-08T19:24:36.725 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 64 2023-11-08T19:24:36.727 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.725+0000 7f0016017700 1 -- 172.21.15.149:0/1418616884 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7efff006af00 msgr2=0x7efff006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:36.727 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.725+0000 7f0016017700 1 --2- 172.21.15.149:0/1418616884 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7efff006af00 0x7efff006d3c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f00000090b0 tx=0x7f0000008030 comp rx=0 tx=0).stop 2023-11-08T19:24:36.727 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.725+0000 7f0016017700 1 -- 172.21.15.149:0/1418616884 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f001006ab80 msgr2=0x7f0010160760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:36.727 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.725+0000 7f0016017700 1 --2- 172.21.15.149:0/1418616884 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f001006ab80 0x7f0010160760 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7efff800c550 tx=0x7efff800c910 comp rx=0 tx=0).stop 2023-11-08T19:24:36.728 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.725+0000 7f0016017700 1 -- 172.21.15.149:0/1418616884 shutdown_connections 2023-11-08T19:24:36.728 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.725+0000 7f0016017700 1 --2- 172.21.15.149:0/1418616884 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7efff006af00 0x7efff006d3c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:36.728 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.725+0000 7f0016017700 1 --2- 172.21.15.149:0/1418616884 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f001015df40 0x7f00101f3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:36.728 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.725+0000 7f0016017700 1 --2- 172.21.15.149:0/1418616884 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f001006ab80 0x7f0010160760 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:36.728 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.725+0000 7f0016017700 1 --2- 172.21.15.149:0/1418616884 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f00100cf1c0 0x7f00101f3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:36.729 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.725+0000 7f0016017700 1 -- 172.21.15.149:0/1418616884 >> 172.21.15.149:0/1418616884 conn(0x7f00100d0640 msgr2=0x7f00100c3530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:36.729 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.725+0000 7f0016017700 1 -- 172.21.15.149:0/1418616884 shutdown_connections 2023-11-08T19:24:36.729 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.725+0000 7f0016017700 1 -- 172.21.15.149:0/1418616884 wait complete. 2023-11-08T19:24:36.739 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-08T19:24:36.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.860+0000 7f9c00b51700 1 Processor -- start 2023-11-08T19:24:36.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.861+0000 7f9c00b51700 1 -- start start 2023-11-08T19:24:36.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.861+0000 7f9c00b51700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9bfc15df40 0x7f9bfc06c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:36.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.861+0000 7f9c00b51700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f9bfc06ab80 0x7f9bfc06c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:36.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.861+0000 7f9c00b51700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bfc15e320 con 0x7f9bfc0cf1c0 2023-11-08T19:24:36.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.861+0000 7f9c00b51700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bfc06b020 con 0x7f9bfc06ab80 2023-11-08T19:24:36.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.862+0000 7f9c00b51700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bfc06b2e0 con 0x7f9bfc15df40 2023-11-08T19:24:36.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.862+0000 7f9bf9d9b700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f9bfc06ab80 0x7f9bfc06c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:36.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.862+0000 7f9bf9d9b700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f9bfc06ab80 0x7f9bfc06c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39782/0 (socket says 172.21.15.149:39782) 2023-11-08T19:24:36.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.862+0000 7f9bf9d9b700 1 -- 172.21.15.149:0/2223590057 learned_addr learned my addr 172.21.15.149:0/2223590057 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:36.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.862+0000 7f9bfa59c700 1 --2- 172.21.15.149:0/2223590057 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9bfc15df40 0x7f9bfc06c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:36.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.862+0000 7f9bf9d9b700 1 -- 172.21.15.149:0/2223590057 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9bfc15df40 msgr2=0x7f9bfc06c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:36.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.862+0000 7f9bf9d9b700 1 --2- 172.21.15.149:0/2223590057 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9bfc15df40 0x7f9bfc06c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:36.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.862+0000 7f9bf9d9b700 1 -- 172.21.15.149:0/2223590057 >> v1:172.21.15.160:6789/0 conn(0x7f9bfc0cf1c0 legacy=0x7f9bfc0caf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:36.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.862+0000 7f9bf9d9b700 1 -- 172.21.15.149:0/2223590057 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bfc06b5c0 con 0x7f9bfc06ab80 2023-11-08T19:24:36.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.862+0000 7f9bfa59c700 1 --2- 172.21.15.149:0/2223590057 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9bfc15df40 0x7f9bfc06c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:24:36.869 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.862+0000 7f9bf9d9b700 1 --2- 172.21.15.149:0/2223590057 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9bfc06ab80 0x7f9bfc06c5e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f9bec0098f0 tx=0x7f9bec009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23f69f9b98f75da3 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:36.869 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.862+0000 7f9bf959a700 1 -- 172.21.15.149:0/2223590057 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bec00b8a0 con 0x7f9bfc06ab80 2023-11-08T19:24:36.869 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.862+0000 7f9bf959a700 1 -- 172.21.15.149:0/2223590057 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bec00ba00 con 0x7f9bfc06ab80 2023-11-08T19:24:36.869 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.862+0000 7f9bf959a700 1 -- 172.21.15.149:0/2223590057 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bec00bd90 con 0x7f9bfc06ab80 2023-11-08T19:24:36.869 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.863+0000 7f9c00b51700 1 -- 172.21.15.149:0/2223590057 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9bfc06ab80 msgr2=0x7f9bfc06c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:36.869 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.863+0000 7f9c00b51700 1 --2- 172.21.15.149:0/2223590057 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9bfc06ab80 0x7f9bfc06c5e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f9bec0098f0 tx=0x7f9bec009c00 comp rx=0 tx=0).stop 2023-11-08T19:24:36.870 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.863+0000 7f9c00b51700 1 -- 172.21.15.149:0/2223590057 shutdown_connections 2023-11-08T19:24:36.870 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.863+0000 7f9c00b51700 1 --2- 172.21.15.149:0/2223590057 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9bfc15df40 0x7f9bfc06c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:36.870 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.863+0000 7f9c00b51700 1 --2- 172.21.15.149:0/2223590057 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9bfc06ab80 0x7f9bfc06c5e0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:36.870 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.863+0000 7f9c00b51700 1 -- 172.21.15.149:0/2223590057 >> 172.21.15.149:0/2223590057 conn(0x7f9bfc0d0640 msgr2=0x7f9bfc0d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:36.870 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.863+0000 7f9c00b51700 1 -- 172.21.15.149:0/2223590057 shutdown_connections 2023-11-08T19:24:36.871 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.863+0000 7f9c00b51700 1 -- 172.21.15.149:0/2223590057 wait complete. 2023-11-08T19:24:36.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.864+0000 7f9c00b51700 1 Processor -- start 2023-11-08T19:24:36.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.864+0000 7f9c00b51700 1 -- start start 2023-11-08T19:24:36.874 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.865+0000 7f9c00b51700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9bfc06ab80 0x7f9bfc14cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:36.874 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.865+0000 7f9c00b51700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9bfc0cf1c0 0x7f9bfc0c4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:36.874 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.865+0000 7f9c00b51700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9bfc15df40 0x7f9bfc0ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:36.874 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.865+0000 7f9c00b51700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bfc15ffb0 con 0x7f9bfc15df40 2023-11-08T19:24:36.874 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.865+0000 7f9c00b51700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bfc0c5640 con 0x7f9bfc0cf1c0 2023-11-08T19:24:36.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.865+0000 7f9c00b51700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bfc15f610 con 0x7f9bfc06ab80 2023-11-08T19:24:36.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.865+0000 7f9bfad9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9bfc15df40 0x7f9bfc0ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:36.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.865+0000 7f9bfad9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9bfc15df40 0x7f9bfc0ac8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39792/0 (socket says 172.21.15.149:39792) 2023-11-08T19:24:36.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.865+0000 7f9bfad9d700 1 -- 172.21.15.149:0/1869777063 learned_addr learned my addr 172.21.15.149:0/1869777063 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:36.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.865+0000 7f9bf9d9b700 1 --2- 172.21.15.149:0/1869777063 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9bfc0cf1c0 0x7f9bfc0c4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:36.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.865+0000 7f9bfa59c700 1 --2- 172.21.15.149:0/1869777063 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9bfc06ab80 0x7f9bfc14cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:36.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.865+0000 7f9bfad9d700 1 -- 172.21.15.149:0/1869777063 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9bfc06ab80 msgr2=0x7f9bfc14cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:36.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.865+0000 7f9bfad9d700 1 --2- 172.21.15.149:0/1869777063 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9bfc06ab80 0x7f9bfc14cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:36.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.865+0000 7f9bfad9d700 1 -- 172.21.15.149:0/1869777063 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9bfc0cf1c0 msgr2=0x7f9bfc0c4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:36.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.865+0000 7f9bfad9d700 1 --2- 172.21.15.149:0/1869777063 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9bfc0cf1c0 0x7f9bfc0c4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:36.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.865+0000 7f9bfad9d700 1 -- 172.21.15.149:0/1869777063 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bec009550 con 0x7f9bfc15df40 2023-11-08T19:24:36.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.866+0000 7f9bfad9d700 1 --2- 172.21.15.149:0/1869777063 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9bfc15df40 0x7f9bfc0ac8c0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f9bf400cc50 tx=0x7f9bf400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:36.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.866+0000 7f9beaffd700 1 -- 172.21.15.149:0/1869777063 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf4003c00 con 0x7f9bfc15df40 2023-11-08T19:24:36.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.866+0000 7f9beaffd700 1 -- 172.21.15.149:0/1869777063 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bf4003d60 con 0x7f9bfc15df40 2023-11-08T19:24:36.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.866+0000 7f9c00b51700 1 -- 172.21.15.149:0/1869777063 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bfc15f8f0 con 0x7f9bfc15df40 2023-11-08T19:24:36.878 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.866+0000 7f9beaffd700 1 -- 172.21.15.149:0/1869777063 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf400aab0 con 0x7f9bfc15df40 2023-11-08T19:24:36.878 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.866+0000 7f9c00b51700 1 -- 172.21.15.149:0/1869777063 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bfc156f90 con 0x7f9bfc15df40 2023-11-08T19:24:36.878 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.867+0000 7f9c00b51700 1 -- 172.21.15.149:0/1869777063 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bfc157120 con 0x7f9bfc15df40 2023-11-08T19:24:36.878 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.867+0000 7f9beaffd700 1 -- 172.21.15.149:0/1869777063 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9bf400ac10 con 0x7f9bfc15df40 2023-11-08T19:24:36.878 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.868+0000 7f9beaffd700 1 --2- 172.21.15.149:0/1869777063 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9bdc06af00 0x7f9bdc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:36.879 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.868+0000 7f9bfa59c700 1 --2- 172.21.15.149:0/1869777063 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9bdc06af00 0x7f9bdc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:36.879 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.868+0000 7f9beaffd700 1 -- 172.21.15.149:0/1869777063 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6438+0+0 (secure 0 0 0) 0x7f9bf40898a0 con 0x7f9bfc15df40 2023-11-08T19:24:36.879 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.868+0000 7f9bfa59c700 1 --2- 172.21.15.149:0/1869777063 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9bdc06af00 0x7f9bdc06d3c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc159a60 tx=0x7f9bf0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:36.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:36.873+0000 7f9beaffd700 1 -- 172.21.15.149:0/1869777063 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9bfc157120 con 0x7f9bfc15df40 2023-11-08T19:24:37.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.061+0000 7f9c00b51700 1 -- 172.21.15.149:0/1869777063 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f9bfc1600f0 con 0x7f9bfc15df40 2023-11-08T19:24:37.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.061+0000 7f9beaffd700 1 -- 172.21.15.149:0/1869777063 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v42) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9bfc1600f0 con 0x7f9bfc15df40 2023-11-08T19:24:37.064 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:24:37.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.063+0000 7f9c00b51700 1 -- 172.21.15.149:0/1869777063 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9bdc06af00 msgr2=0x7f9bdc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:37.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.063+0000 7f9c00b51700 1 --2- 172.21.15.149:0/1869777063 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9bdc06af00 0x7f9bdc06d3c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc159a60 tx=0x7f9bf0008040 comp rx=0 tx=0).stop 2023-11-08T19:24:37.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.063+0000 7f9c00b51700 1 -- 172.21.15.149:0/1869777063 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9bfc15df40 msgr2=0x7f9bfc0ac8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:37.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.063+0000 7f9c00b51700 1 --2- 172.21.15.149:0/1869777063 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9bfc15df40 0x7f9bfc0ac8c0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f9bf400cc50 tx=0x7f9bf400cf60 comp rx=0 tx=0).stop 2023-11-08T19:24:37.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.064+0000 7f9c00b51700 1 -- 172.21.15.149:0/1869777063 shutdown_connections 2023-11-08T19:24:37.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.064+0000 7f9c00b51700 1 --2- 172.21.15.149:0/1869777063 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9bdc06af00 0x7f9bdc06d3c0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:37.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.064+0000 7f9c00b51700 1 --2- 172.21.15.149:0/1869777063 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9bfc15df40 0x7f9bfc0ac8c0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:37.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.064+0000 7f9c00b51700 1 --2- 172.21.15.149:0/1869777063 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9bfc06ab80 0x7f9bfc14cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:37.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.064+0000 7f9c00b51700 1 --2- 172.21.15.149:0/1869777063 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9bfc0cf1c0 0x7f9bfc0c4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:37.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.064+0000 7f9c00b51700 1 -- 172.21.15.149:0/1869777063 >> 172.21.15.149:0/1869777063 conn(0x7f9bfc0d0640 msgr2=0x7f9bfc15ac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:37.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.064+0000 7f9c00b51700 1 -- 172.21.15.149:0/1869777063 shutdown_connections 2023-11-08T19:24:37.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.064+0000 7f9c00b51700 1 -- 172.21.15.149:0/1869777063 wait complete. 2023-11-08T19:24:37.078 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:24:37.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.198+0000 7fd1d125d700 1 Processor -- start 2023-11-08T19:24:37.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.198+0000 7fd1d125d700 1 -- start start 2023-11-08T19:24:37.202 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.198+0000 7fd1d125d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd1cc15b950 0x7fd1cc0ce130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:37.202 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.198+0000 7fd1d125d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd1cc0d0430 0x7fd1cc0ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:37.203 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.198+0000 7fd1d125d700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1cc0cc2e0 con 0x7fd1cc0cd5e0 2023-11-08T19:24:37.203 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.198+0000 7fd1d125d700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1cc0cc580 con 0x7fd1cc15b950 2023-11-08T19:24:37.203 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.198+0000 7fd1d125d700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1cc0cc820 con 0x7fd1cc0d0430 2023-11-08T19:24:37.203 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.198+0000 7fd1cad9d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd1cc15b950 0x7fd1cc0ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:37.203 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.198+0000 7fd1cad9d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd1cc15b950 0x7fd1cc0ce130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39796/0 (socket says 172.21.15.149:39796) 2023-11-08T19:24:37.203 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.198+0000 7fd1cad9d700 1 -- 172.21.15.149:0/2619552810 learned_addr learned my addr 172.21.15.149:0/2619552810 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:37.204 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.199+0000 7fd1cad9d700 1 -- 172.21.15.149:0/2619552810 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd1cc0d0430 msgr2=0x7fd1cc0ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:37.204 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.199+0000 7fd1cb59e700 1 --2- 172.21.15.149:0/2619552810 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd1cc0d0430 0x7fd1cc0ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:37.204 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.199+0000 7fd1cad9d700 1 --2- 172.21.15.149:0/2619552810 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd1cc0d0430 0x7fd1cc0ce670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:37.204 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.199+0000 7fd1cad9d700 1 -- 172.21.15.149:0/2619552810 >> v1:172.21.15.160:6789/0 conn(0x7fd1cc0cd5e0 legacy=0x7fd1cc0cfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:37.204 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.199+0000 7fd1cad9d700 1 -- 172.21.15.149:0/2619552810 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1cc0ccb00 con 0x7fd1cc15b950 2023-11-08T19:24:37.205 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.199+0000 7fd1cad9d700 1 --2- 172.21.15.149:0/2619552810 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1cc15b950 0x7fd1cc0ce130 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc006fd0 tx=0x7fd1bc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0360dd618b84a64 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:37.205 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.199+0000 7fd1c9d9b700 1 -- 172.21.15.149:0/2619552810 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc005e30 con 0x7fd1cc15b950 2023-11-08T19:24:37.205 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.199+0000 7fd1c9d9b700 1 -- 172.21.15.149:0/2619552810 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1bc006030 con 0x7fd1cc15b950 2023-11-08T19:24:37.205 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.199+0000 7fd1c9d9b700 1 -- 172.21.15.149:0/2619552810 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc0063c0 con 0x7fd1cc15b950 2023-11-08T19:24:37.205 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.199+0000 7fd1d125d700 1 -- 172.21.15.149:0/2619552810 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1cc15b950 msgr2=0x7fd1cc0ce130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:37.205 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.199+0000 7fd1d125d700 1 --2- 172.21.15.149:0/2619552810 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1cc15b950 0x7fd1cc0ce130 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc006fd0 tx=0x7fd1bc009bd0 comp rx=0 tx=0).stop 2023-11-08T19:24:37.206 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.200+0000 7fd1d125d700 1 -- 172.21.15.149:0/2619552810 shutdown_connections 2023-11-08T19:24:37.206 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.200+0000 7fd1d125d700 1 --2- 172.21.15.149:0/2619552810 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd1cc0d0430 0x7fd1cc0ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:37.206 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.200+0000 7fd1d125d700 1 --2- 172.21.15.149:0/2619552810 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1cc15b950 0x7fd1cc0ce130 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:37.206 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.200+0000 7fd1d125d700 1 -- 172.21.15.149:0/2619552810 >> 172.21.15.149:0/2619552810 conn(0x7fd1cc08afd0 msgr2=0x7fd1cc0d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:37.207 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.200+0000 7fd1d125d700 1 -- 172.21.15.149:0/2619552810 shutdown_connections 2023-11-08T19:24:37.207 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.200+0000 7fd1d125d700 1 -- 172.21.15.149:0/2619552810 wait complete. 2023-11-08T19:24:37.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.201+0000 7fd1d125d700 1 Processor -- start 2023-11-08T19:24:37.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.201+0000 7fd1d125d700 1 -- start start 2023-11-08T19:24:37.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.202+0000 7fd1d125d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd1cc0d0430 0x7fd1cc0c5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:37.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.202+0000 7fd1d125d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd1cc15b950 0x7fd1cc0ae330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:37.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.202+0000 7fd1d125d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1cc0ae870 0x7fd1cc14ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:37.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.202+0000 7fd1d125d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1cc0c8000 con 0x7fd1cc0ae870 2023-11-08T19:24:37.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.202+0000 7fd1d125d700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1cc0aecf0 con 0x7fd1cc0d0430 2023-11-08T19:24:37.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.202+0000 7fd1d125d700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1cc0c7660 con 0x7fd1cc15b950 2023-11-08T19:24:37.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.202+0000 7fd1cb59e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1cc0ae870 0x7fd1cc14ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:37.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.202+0000 7fd1cb59e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1cc0ae870 0x7fd1cc14ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39806/0 (socket says 172.21.15.149:39806) 2023-11-08T19:24:37.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.202+0000 7fd1cb59e700 1 -- 172.21.15.149:0/3163936461 learned_addr learned my addr 172.21.15.149:0/3163936461 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:37.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.202+0000 7fd1cad9d700 1 --2- 172.21.15.149:0/3163936461 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd1cc0d0430 0x7fd1cc0c5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:37.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.202+0000 7fd1ca59c700 1 --2- 172.21.15.149:0/3163936461 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd1cc15b950 0x7fd1cc0ae330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:37.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.202+0000 7fd1cb59e700 1 -- 172.21.15.149:0/3163936461 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd1cc15b950 msgr2=0x7fd1cc0ae330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:37.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.202+0000 7fd1cb59e700 1 --2- 172.21.15.149:0/3163936461 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd1cc15b950 0x7fd1cc0ae330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:37.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.202+0000 7fd1cb59e700 1 -- 172.21.15.149:0/3163936461 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd1cc0d0430 msgr2=0x7fd1cc0c5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:37.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.202+0000 7fd1cb59e700 1 --2- 172.21.15.149:0/3163936461 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd1cc0d0430 0x7fd1cc0c5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:37.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.202+0000 7fd1cb59e700 1 -- 172.21.15.149:0/3163936461 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1bc009500 con 0x7fd1cc0ae870 2023-11-08T19:24:37.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.202+0000 7fd1ca59c700 1 --2- 172.21.15.149:0/3163936461 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd1cc15b950 0x7fd1cc0ae330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:24:37.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.202+0000 7fd1cb59e700 1 --2- 172.21.15.149:0/3163936461 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1cc0ae870 0x7fd1cc14ac20 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd1c400cd70 tx=0x7fd1c400a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:37.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.203+0000 7fd1b37fe700 1 -- 172.21.15.149:0/3163936461 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c4003a20 con 0x7fd1cc0ae870 2023-11-08T19:24:37.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.203+0000 7fd1b37fe700 1 -- 172.21.15.149:0/3163936461 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c4003b80 con 0x7fd1cc0ae870 2023-11-08T19:24:37.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.203+0000 7fd1d125d700 1 -- 172.21.15.149:0/3163936461 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1cc0c7940 con 0x7fd1cc0ae870 2023-11-08T19:24:37.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.203+0000 7fd1b37fe700 1 -- 172.21.15.149:0/3163936461 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c4004020 con 0x7fd1cc0ae870 2023-11-08T19:24:37.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.203+0000 7fd1d125d700 1 -- 172.21.15.149:0/3163936461 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1cc0c5e40 con 0x7fd1cc0ae870 2023-11-08T19:24:37.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.204+0000 7fd1d125d700 1 -- 172.21.15.149:0/3163936461 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1cc0c8140 con 0x7fd1cc0ae870 2023-11-08T19:24:37.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.204+0000 7fd1b37fe700 1 -- 172.21.15.149:0/3163936461 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd1c4004180 con 0x7fd1cc0ae870 2023-11-08T19:24:37.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.204+0000 7fd1b37fe700 1 --2- 172.21.15.149:0/3163936461 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd1b806af00 0x7fd1b806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:37.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.205+0000 7fd1b37fe700 1 -- 172.21.15.149:0/3163936461 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6438+0+0 (secure 0 0 0) 0x7fd1c4012070 con 0x7fd1cc0ae870 2023-11-08T19:24:37.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.205+0000 7fd1cad9d700 1 --2- 172.21.15.149:0/3163936461 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd1b806af00 0x7fd1b806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:37.216 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.205+0000 7fd1cad9d700 1 --2- 172.21.15.149:0/3163936461 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd1b806af00 0x7fd1b806d3c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc013040 tx=0x7fd1bc008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:37.216 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.210+0000 7fd1b37fe700 1 -- 172.21.15.149:0/3163936461 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd1cc0c8140 con 0x7fd1cc0ae870 2023-11-08T19:24:37.444 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.442+0000 7fd1d125d700 1 -- 172.21.15.149:0/3163936461 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd1cc0c8140 con 0x7fd1cc0ae870 2023-11-08T19:24:37.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.443+0000 7fd1b37fe700 1 -- 172.21.15.149:0/3163936461 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4922 (secure 0 0 0) 0x7fd1cc0c8140 con 0x7fd1cc0ae870 2023-11-08T19:24:37.445 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:24:37.446 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4877,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/3602590195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3602590195},{"type":"v1","addr":"172.21.15.160:6834","nonce":3602590195}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5107,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/1432406788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":1432406788},{"type":"v1","addr":"172.21.15.160:6835","nonce":1432406788}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5125,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/3066975859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3066975859},{"type":"v1","addr":"172.21.15.149:6837","nonce":3066975859}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-08T19:24:16.502193+0000","modified":"2023-11-08T19:24:19.886052+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5259":{"gid":5259,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.149:6836/746083826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":746083826},{"type":"v1","addr":"172.21.15.149:6836","nonce":746083826}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-08T19:24:37.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.445+0000 7fd1d125d700 1 -- 172.21.15.149:0/3163936461 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd1b806af00 msgr2=0x7fd1b806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:37.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.445+0000 7fd1d125d700 1 --2- 172.21.15.149:0/3163936461 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd1b806af00 0x7fd1b806d3c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc013040 tx=0x7fd1bc008070 comp rx=0 tx=0).stop 2023-11-08T19:24:37.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.445+0000 7fd1d125d700 1 -- 172.21.15.149:0/3163936461 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1cc0ae870 msgr2=0x7fd1cc14ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:37.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.445+0000 7fd1d125d700 1 --2- 172.21.15.149:0/3163936461 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1cc0ae870 0x7fd1cc14ac20 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd1c400cd70 tx=0x7fd1c400a570 comp rx=0 tx=0).stop 2023-11-08T19:24:37.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.445+0000 7fd1d125d700 1 -- 172.21.15.149:0/3163936461 shutdown_connections 2023-11-08T19:24:37.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.445+0000 7fd1d125d700 1 --2- 172.21.15.149:0/3163936461 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd1b806af00 0x7fd1b806d3c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:37.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.445+0000 7fd1d125d700 1 --2- 172.21.15.149:0/3163936461 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd1cc0d0430 0x7fd1cc0c5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:37.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.445+0000 7fd1d125d700 1 --2- 172.21.15.149:0/3163936461 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1cc0ae870 0x7fd1cc14ac20 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:37.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.445+0000 7fd1d125d700 1 --2- 172.21.15.149:0/3163936461 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd1cc15b950 0x7fd1cc0ae330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:37.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.445+0000 7fd1d125d700 1 -- 172.21.15.149:0/3163936461 >> 172.21.15.149:0/3163936461 conn(0x7fd1cc08afd0 msgr2=0x7fd1cc0b0120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:37.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.445+0000 7fd1d125d700 1 -- 172.21.15.149:0/3163936461 shutdown_connections 2023-11-08T19:24:37.450 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.445+0000 7fd1d125d700 1 -- 172.21.15.149:0/3163936461 wait complete. 2023-11-08T19:24:37.450 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 17 2023-11-08T19:24:37.460 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:24:37.580 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.578+0000 7f3f93f77700 1 Processor -- start 2023-11-08T19:24:37.581 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.578+0000 7f3f93f77700 1 -- start start 2023-11-08T19:24:37.583 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.579+0000 7f3f93f77700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3f8c0cc910 0x7f3f8c0cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:37.583 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.579+0000 7f3f93f77700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3f8c0cb130 0x7f3f8c15d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:37.584 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.579+0000 7f3f93f77700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f8c0b2f60 con 0x7f3f8c0cc140 2023-11-08T19:24:37.584 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.579+0000 7f3f93f77700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f8c0b2430 con 0x7f3f8c0cb130 2023-11-08T19:24:37.584 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.579+0000 7f3f93f77700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8c0cc520 con 0x7f3f8c0cc910 2023-11-08T19:24:37.584 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.579+0000 7f3f92514700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3f8c0cb130 0x7f3f8c15d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:37.584 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.579+0000 7f3f92514700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3f8c0cb130 0x7f3f8c15d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39812/0 (socket says 172.21.15.149:39812) 2023-11-08T19:24:37.585 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.579+0000 7f3f91d13700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f3f8c0cc140 0x7f3f8c0b2850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:41812/0 (socket says 172.21.15.149:41812) 2023-11-08T19:24:37.585 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.579+0000 7f3f92514700 1 -- 172.21.15.149:0/1432327115 learned_addr learned my addr 172.21.15.149:0/1432327115 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:37.585 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.579+0000 7f3f91512700 1 --2- 172.21.15.149:0/1432327115 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3f8c0cc910 0x7f3f8c0cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:37.585 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.579+0000 7f3f92514700 1 -- 172.21.15.149:0/1432327115 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3f8c0cc910 msgr2=0x7f3f8c0cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:37.585 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.579+0000 7f3f92514700 1 --2- 172.21.15.149:0/1432327115 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3f8c0cc910 0x7f3f8c0cabf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:37.586 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.579+0000 7f3f92514700 1 -- 172.21.15.149:0/1432327115 >> v1:172.21.15.149:6789/0 conn(0x7f3f8c0cc140 legacy=0x7f3f8c0b2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:37.586 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.579+0000 7f3f92514700 1 -- 172.21.15.149:0/1432327115 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f8c0cb5b0 con 0x7f3f8c0cb130 2023-11-08T19:24:37.586 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.579+0000 7f3f90d11700 1 -- 172.21.15.149:0/1432327115 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1857764859 0 0) 0x7f3f8c0b2f60 con 0x7f3f8c0cc140 2023-11-08T19:24:37.586 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.580+0000 7f3f92514700 1 --2- 172.21.15.149:0/1432327115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f8c0cb130 0x7f3f8c15d2b0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f3f84009e50 tx=0x7f3f8400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6fbd246c167e669 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:37.586 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.580+0000 7f3f90d11700 1 -- 172.21.15.149:0/1432327115 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8400e070 con 0x7f3f8c0cb130 2023-11-08T19:24:37.586 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.580+0000 7f3f90d11700 1 -- 172.21.15.149:0/1432327115 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f8400b9c0 con 0x7f3f8c0cb130 2023-11-08T19:24:37.587 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.580+0000 7f3f90d11700 1 -- 172.21.15.149:0/1432327115 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8400bd70 con 0x7f3f8c0cb130 2023-11-08T19:24:37.587 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.580+0000 7f3f93f77700 1 -- 172.21.15.149:0/1432327115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f8c0cb130 msgr2=0x7f3f8c15d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:37.587 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.580+0000 7f3f93f77700 1 --2- 172.21.15.149:0/1432327115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f8c0cb130 0x7f3f8c15d2b0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f3f84009e50 tx=0x7f3f8400b330 comp rx=0 tx=0).stop 2023-11-08T19:24:37.587 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.580+0000 7f3f93f77700 1 -- 172.21.15.149:0/1432327115 shutdown_connections 2023-11-08T19:24:37.587 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.580+0000 7f3f93f77700 1 --2- 172.21.15.149:0/1432327115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f8c0cb130 0x7f3f8c15d2b0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:37.588 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.580+0000 7f3f93f77700 1 --2- 172.21.15.149:0/1432327115 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3f8c0cc910 0x7f3f8c0cabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:37.588 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.580+0000 7f3f93f77700 1 -- 172.21.15.149:0/1432327115 >> 172.21.15.149:0/1432327115 conn(0x7f3f8c099a40 msgr2=0x7f3f8c0d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:37.588 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.580+0000 7f3f93f77700 1 -- 172.21.15.149:0/1432327115 shutdown_connections 2023-11-08T19:24:37.588 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.580+0000 7f3f93f77700 1 -- 172.21.15.149:0/1432327115 wait complete. 2023-11-08T19:24:37.591 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.582+0000 7f3f93f77700 1 Processor -- start 2023-11-08T19:24:37.591 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.582+0000 7f3f93f77700 1 -- start start 2023-11-08T19:24:37.592 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.584+0000 7f3f93f77700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f8c0cb130 0x7f3f8c0b5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:37.592 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.584+0000 7f3f93f77700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f8c0cc140 0x7f3f8c1f4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:37.592 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.584+0000 7f3f93f77700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3f8c0cc910 0x7f3f8c14e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:37.592 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.584+0000 7f3f93f77700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8c1f4690 con 0x7f3f8c0cc140 2023-11-08T19:24:37.592 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.584+0000 7f3f93f77700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8c0c82f0 con 0x7f3f8c0cb130 2023-11-08T19:24:37.593 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.584+0000 7f3f93f77700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8c0c8b90 con 0x7f3f8c0cc910 2023-11-08T19:24:37.593 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.584+0000 7f3f91512700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f8c0cc140 0x7f3f8c1f4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:37.593 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.584+0000 7f3f91512700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f8c0cc140 0x7f3f8c1f4150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39816/0 (socket says 172.21.15.149:39816) 2023-11-08T19:24:37.593 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.584+0000 7f3f91512700 1 -- 172.21.15.149:0/4094389901 learned_addr learned my addr 172.21.15.149:0/4094389901 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:37.593 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.584+0000 7f3f92514700 1 --2- 172.21.15.149:0/4094389901 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3f8c0cc910 0x7f3f8c14e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:37.594 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.584+0000 7f3f91d13700 1 --2- 172.21.15.149:0/4094389901 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f8c0cb130 0x7f3f8c0b5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:37.594 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.584+0000 7f3f91512700 1 -- 172.21.15.149:0/4094389901 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3f8c0cc910 msgr2=0x7f3f8c14e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:37.594 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.584+0000 7f3f91512700 1 --2- 172.21.15.149:0/4094389901 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3f8c0cc910 0x7f3f8c14e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:37.594 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.584+0000 7f3f91512700 1 -- 172.21.15.149:0/4094389901 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f8c0cb130 msgr2=0x7f3f8c0b5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:37.594 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.584+0000 7f3f91512700 1 --2- 172.21.15.149:0/4094389901 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f8c0cb130 0x7f3f8c0b5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:37.595 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.584+0000 7f3f91512700 1 -- 172.21.15.149:0/4094389901 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f84009b30 con 0x7f3f8c0cc140 2023-11-08T19:24:37.595 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.584+0000 7f3f92514700 1 --2- 172.21.15.149:0/4094389901 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3f8c0cc910 0x7f3f8c14e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:24:37.595 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.584+0000 7f3f91d13700 1 --2- 172.21.15.149:0/4094389901 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f8c0cb130 0x7f3f8c0b5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:24:37.595 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.584+0000 7f3f91512700 1 --2- 172.21.15.149:0/4094389901 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f8c0cc140 0x7f3f8c1f4150 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f3f8800c7f0 tx=0x7f3f8800cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:37.595 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.584+0000 7f3f827fc700 1 -- 172.21.15.149:0/4094389901 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f88004220 con 0x7f3f8c0cc140 2023-11-08T19:24:37.596 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.584+0000 7f3f827fc700 1 -- 172.21.15.149:0/4094389901 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f88004380 con 0x7f3f8c0cc140 2023-11-08T19:24:37.596 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.584+0000 7f3f93f77700 1 -- 172.21.15.149:0/4094389901 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f8c14e630 con 0x7f3f8c0cc140 2023-11-08T19:24:37.596 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.584+0000 7f3f827fc700 1 -- 172.21.15.149:0/4094389901 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f880036a0 con 0x7f3f8c0cc140 2023-11-08T19:24:37.596 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.584+0000 7f3f93f77700 1 -- 172.21.15.149:0/4094389901 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f8c0c8540 con 0x7f3f8c0cc140 2023-11-08T19:24:37.596 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.585+0000 7f3f93f77700 1 -- 172.21.15.149:0/4094389901 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f8c0b1790 con 0x7f3f8c0cc140 2023-11-08T19:24:37.596 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.585+0000 7f3f827fc700 1 -- 172.21.15.149:0/4094389901 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3f88003800 con 0x7f3f8c0cc140 2023-11-08T19:24:37.597 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.585+0000 7f3f827fc700 1 --2- 172.21.15.149:0/4094389901 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3f7006af00 0x7f3f7006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:37.597 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.585+0000 7f3f827fc700 1 -- 172.21.15.149:0/4094389901 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6438+0+0 (secure 0 0 0) 0x7f3f88089410 con 0x7f3f8c0cc140 2023-11-08T19:24:37.597 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.585+0000 7f3f91d13700 1 --2- 172.21.15.149:0/4094389901 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3f7006af00 0x7f3f7006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:37.597 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.586+0000 7f3f91d13700 1 --2- 172.21.15.149:0/4094389901 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3f7006af00 0x7f3f7006d3c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c001020 tx=0x7f3f7c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:37.598 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.591+0000 7f3f827fc700 1 -- 172.21.15.149:0/4094389901 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3f8c0b1790 con 0x7f3f8c0cc140 2023-11-08T19:24:37.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.781+0000 7f3f93f77700 1 -- 172.21.15.149:0/4094389901 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3f8c0b1790 con 0x7f3f8c0cc140 2023-11-08T19:24:37.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.782+0000 7f3f827fc700 1 -- 172.21.15.149:0/4094389901 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+18649 (secure 0 0 0) 0x7f3f8c0b1790 con 0x7f3f8c0cc140 2023-11-08T19:24:37.785 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:24:37.785 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":42,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:24:32.128826+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-08T19:24:14.467859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-08T19:24:15.470328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-08T19:24:29.516185+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":1,"length":1}]}],"new_removed_snaps":[{"pool":7,"snaps":[{"begin":1,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:24:37.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.785+0000 7f3f93f77700 1 -- 172.21.15.149:0/4094389901 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3f7006af00 msgr2=0x7f3f7006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:37.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.785+0000 7f3f93f77700 1 --2- 172.21.15.149:0/4094389901 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3f7006af00 0x7f3f7006d3c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c001020 tx=0x7f3f7c009040 comp rx=0 tx=0).stop 2023-11-08T19:24:37.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.785+0000 7f3f93f77700 1 -- 172.21.15.149:0/4094389901 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f8c0cc140 msgr2=0x7f3f8c1f4150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:37.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.785+0000 7f3f93f77700 1 --2- 172.21.15.149:0/4094389901 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f8c0cc140 0x7f3f8c1f4150 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f3f8800c7f0 tx=0x7f3f8800cbb0 comp rx=0 tx=0).stop 2023-11-08T19:24:37.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.785+0000 7f3f93f77700 1 -- 172.21.15.149:0/4094389901 shutdown_connections 2023-11-08T19:24:37.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.785+0000 7f3f93f77700 1 --2- 172.21.15.149:0/4094389901 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3f7006af00 0x7f3f7006d3c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:37.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.785+0000 7f3f93f77700 1 --2- 172.21.15.149:0/4094389901 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f8c0cb130 0x7f3f8c0b5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:37.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.785+0000 7f3f93f77700 1 --2- 172.21.15.149:0/4094389901 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3f8c0cc910 0x7f3f8c14e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:37.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.785+0000 7f3f93f77700 1 --2- 172.21.15.149:0/4094389901 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f8c0cc140 0x7f3f8c1f4150 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:37.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.785+0000 7f3f93f77700 1 -- 172.21.15.149:0/4094389901 >> 172.21.15.149:0/4094389901 conn(0x7f3f8c099a40 msgr2=0x7f3f8c0c7670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:37.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.785+0000 7f3f93f77700 1 -- 172.21.15.149:0/4094389901 shutdown_connections 2023-11-08T19:24:37.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.785+0000 7f3f93f77700 1 -- 172.21.15.149:0/4094389901 wait complete. 2023-11-08T19:24:37.799 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-08T19:24:37.800 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:24:37.879 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T19:24:37.882 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T19:24:37.923 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.922+0000 7f93b9614700 1 Processor -- start 2023-11-08T19:24:37.923 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.922+0000 7f93b9614700 1 -- start start 2023-11-08T19:24:37.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.922+0000 7f93b9614700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f93b4161670 0x7f93b40b5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:37.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.922+0000 7f93b9614700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f93b4161a50 0x7f93b4161ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:37.926 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.922+0000 7f93b9614700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93b40d1a10 con 0x7f93b415dd90 2023-11-08T19:24:37.926 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.922+0000 7f93b9614700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93b40d1cf0 con 0x7f93b4161a50 2023-11-08T19:24:37.926 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.922+0000 7f93b9614700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93b40d1fd0 con 0x7f93b4161670 2023-11-08T19:24:37.926 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.922+0000 7f93b27fc700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f93b4161a50 0x7f93b4161ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:37.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.922+0000 7f93b37fe700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f93b415dd90 0x7f93b415e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:41826/0 (socket says 172.21.15.149:41826) 2023-11-08T19:24:37.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.922+0000 7f93b37fe700 1 -- 172.21.15.149:0/1038513522 learned_addr learned my addr 172.21.15.149:0/1038513522 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:24:37.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.922+0000 7f93b2ffd700 1 --2- 172.21.15.149:0/1038513522 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f93b4161670 0x7f93b40b5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:37.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.922+0000 7f93b27fc700 1 -- 172.21.15.149:0/1038513522 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f93b4161670 msgr2=0x7f93b40b5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:37.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.922+0000 7f93b27fc700 1 --2- 172.21.15.149:0/1038513522 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f93b4161670 0x7f93b40b5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:37.928 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.922+0000 7f93b27fc700 1 -- 172.21.15.149:0/1038513522 >> v1:172.21.15.149:6789/0 conn(0x7f93b415dd90 legacy=0x7f93b415e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:37.928 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.922+0000 7f93b27fc700 1 -- 172.21.15.149:0/1038513522 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b40d22b0 con 0x7f93b4161a50 2023-11-08T19:24:37.928 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.922+0000 7f93b1ffb700 1 -- 172.21.15.149:0/1038513522 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2048475946 0 0) 0x7f93b40d1a10 con 0x7f93b415dd90 2023-11-08T19:24:37.928 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.922+0000 7f93b2ffd700 1 --2- 172.21.15.149:0/1038513522 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f93b4161670 0x7f93b40b5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:24:37.928 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.922+0000 7f93b27fc700 1 --2- 172.21.15.149:0/1038513522 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93b4161a50 0x7f93b4161ed0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f93a8009840 tx=0x7f93a8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b9b0dd9f2ea45a3 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:37.929 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.922+0000 7f93b1ffb700 1 -- 172.21.15.149:0/1038513522 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a8011830 con 0x7f93b4161a50 2023-11-08T19:24:37.929 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.922+0000 7f93b1ffb700 1 -- 172.21.15.149:0/1038513522 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a8011990 con 0x7f93b4161a50 2023-11-08T19:24:37.929 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.922+0000 7f93b1ffb700 1 -- 172.21.15.149:0/1038513522 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a8011d20 con 0x7f93b4161a50 2023-11-08T19:24:37.929 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.923+0000 7f93b9614700 1 -- 172.21.15.149:0/1038513522 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93b4161a50 msgr2=0x7f93b4161ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:37.929 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.923+0000 7f93b9614700 1 --2- 172.21.15.149:0/1038513522 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93b4161a50 0x7f93b4161ed0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f93a8009840 tx=0x7f93a8009b50 comp rx=0 tx=0).stop 2023-11-08T19:24:37.929 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.923+0000 7f93b9614700 1 -- 172.21.15.149:0/1038513522 shutdown_connections 2023-11-08T19:24:37.930 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.923+0000 7f93b9614700 1 --2- 172.21.15.149:0/1038513522 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f93b4161670 0x7f93b40b5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:37.930 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.923+0000 7f93b9614700 1 --2- 172.21.15.149:0/1038513522 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93b4161a50 0x7f93b4161ed0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:37.930 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.923+0000 7f93b9614700 1 -- 172.21.15.149:0/1038513522 >> 172.21.15.149:0/1038513522 conn(0x7f93b40d3980 msgr2=0x7f93b40d3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:37.930 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.923+0000 7f93b9614700 1 -- 172.21.15.149:0/1038513522 shutdown_connections 2023-11-08T19:24:37.931 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.923+0000 7f93b9614700 1 -- 172.21.15.149:0/1038513522 wait complete. 2023-11-08T19:24:37.933 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.925+0000 7f93b9614700 1 Processor -- start 2023-11-08T19:24:37.934 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.925+0000 7f93b9614700 1 -- start start 2023-11-08T19:24:37.934 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.926+0000 7f93b9614700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f93b415dd90 0x7f93b4159170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:37.934 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.926+0000 7f93b9614700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f93b4161670 0x7f93b41f4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:37.934 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.926+0000 7f93b9614700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93b4161a50 0x7f93b40c92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:37.935 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.926+0000 7f93b9614700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b41f4ab0 con 0x7f93b4161a50 2023-11-08T19:24:37.935 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.926+0000 7f93b9614700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b40b7650 con 0x7f93b4161670 2023-11-08T19:24:37.935 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.926+0000 7f93b9614700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93b40b7930 con 0x7f93b415dd90 2023-11-08T19:24:37.935 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.926+0000 7f93b37fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93b4161a50 0x7f93b40c92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:37.935 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.926+0000 7f93b37fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93b4161a50 0x7f93b40c92e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39832/0 (socket says 172.21.15.149:39832) 2023-11-08T19:24:37.936 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.926+0000 7f93b37fe700 1 -- 172.21.15.149:0/1849148349 learned_addr learned my addr 172.21.15.149:0/1849148349 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:37.936 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.926+0000 7f93b2ffd700 1 --2- 172.21.15.149:0/1849148349 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f93b415dd90 0x7f93b4159170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:37.936 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.926+0000 7f93b27fc700 1 --2- 172.21.15.149:0/1849148349 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f93b4161670 0x7f93b41f4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:37.936 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.926+0000 7f93b37fe700 1 -- 172.21.15.149:0/1849148349 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f93b415dd90 msgr2=0x7f93b4159170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:37.937 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.926+0000 7f93b37fe700 1 --2- 172.21.15.149:0/1849148349 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f93b415dd90 0x7f93b4159170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:37.937 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.926+0000 7f93b37fe700 1 -- 172.21.15.149:0/1849148349 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f93b4161670 msgr2=0x7f93b41f4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:37.937 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.926+0000 7f93b37fe700 1 --2- 172.21.15.149:0/1849148349 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f93b4161670 0x7f93b41f4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:37.937 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.926+0000 7f93b37fe700 1 -- 172.21.15.149:0/1849148349 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a80094a0 con 0x7f93b4161a50 2023-11-08T19:24:37.937 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.926+0000 7f93b27fc700 1 --2- 172.21.15.149:0/1849148349 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f93b4161670 0x7f93b41f4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:24:37.938 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.926+0000 7f93b37fe700 1 --2- 172.21.15.149:0/1849148349 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93b4161a50 0x7f93b40c92e0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f93ac00cca0 tx=0x7f93ac00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:37.938 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.926+0000 7f939b7fe700 1 -- 172.21.15.149:0/1849148349 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93ac00cea0 con 0x7f93b4161a50 2023-11-08T19:24:37.938 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.926+0000 7f939b7fe700 1 -- 172.21.15.149:0/1849148349 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93ac00ade0 con 0x7f93b4161a50 2023-11-08T19:24:37.938 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.926+0000 7f93b9614700 1 -- 172.21.15.149:0/1849148349 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93b40b7c10 con 0x7f93b4161a50 2023-11-08T19:24:37.938 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.926+0000 7f939b7fe700 1 -- 172.21.15.149:0/1849148349 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93ac007310 con 0x7f93b4161a50 2023-11-08T19:24:37.939 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.926+0000 7f93b9614700 1 -- 172.21.15.149:0/1849148349 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93b40b81d0 con 0x7f93b4161a50 2023-11-08T19:24:37.939 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.927+0000 7f93b9614700 1 -- 172.21.15.149:0/1849148349 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93b40b83f0 con 0x7f93b4161a50 2023-11-08T19:24:37.939 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.928+0000 7f939b7fe700 1 -- 172.21.15.149:0/1849148349 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f93ac007470 con 0x7f93b4161a50 2023-11-08T19:24:37.939 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.928+0000 7f939b7fe700 1 --2- 172.21.15.149:0/1849148349 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f93a006af00 0x7f93a006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:37.939 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.928+0000 7f939b7fe700 1 -- 172.21.15.149:0/1849148349 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6438+0+0 (secure 0 0 0) 0x7f93ac089780 con 0x7f93b4161a50 2023-11-08T19:24:37.940 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.928+0000 7f93b2ffd700 1 --2- 172.21.15.149:0/1849148349 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f93a006af00 0x7f93a006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:37.940 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.929+0000 7f93b2ffd700 1 --2- 172.21.15.149:0/1849148349 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f93a006af00 0x7f93a006d3c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f93a400aa50 tx=0x7f93a4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:37.940 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:37.934+0000 7f939b7fe700 1 -- 172.21.15.149:0/1849148349 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f93ac0545e0 con 0x7f93b4161a50 2023-11-08T19:24:38.174 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.172+0000 7f93b9614700 1 -- 172.21.15.149:0/1849148349 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f93b40745f0 con 0x7f93b4161a50 2023-11-08T19:24:38.175 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.173+0000 7f939b7fe700 1 -- 172.21.15.149:0/1849148349 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4922 (secure 0 0 0) 0x7f93ac057c00 con 0x7f93b4161a50 2023-11-08T19:24:38.176 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:24:38.176 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4877,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/3602590195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3602590195},{"type":"v1","addr":"172.21.15.160:6834","nonce":3602590195}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5107,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/1432406788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":1432406788},{"type":"v1","addr":"172.21.15.160:6835","nonce":1432406788}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5125,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/3066975859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3066975859},{"type":"v1","addr":"172.21.15.149:6837","nonce":3066975859}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-08T19:24:16.502193+0000","modified":"2023-11-08T19:24:19.886052+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5259":{"gid":5259,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.149:6836/746083826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":746083826},{"type":"v1","addr":"172.21.15.149:6836","nonce":746083826}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-08T19:24:38.178 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.176+0000 7f93b9614700 1 -- 172.21.15.149:0/1849148349 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f93a006af00 msgr2=0x7f93a006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:38.178 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.176+0000 7f93b9614700 1 --2- 172.21.15.149:0/1849148349 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f93a006af00 0x7f93a006d3c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f93a400aa50 tx=0x7f93a4008040 comp rx=0 tx=0).stop 2023-11-08T19:24:38.178 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.176+0000 7f93b9614700 1 -- 172.21.15.149:0/1849148349 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93b4161a50 msgr2=0x7f93b40c92e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:38.179 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.176+0000 7f93b9614700 1 --2- 172.21.15.149:0/1849148349 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93b4161a50 0x7f93b40c92e0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f93ac00cca0 tx=0x7f93ac00a340 comp rx=0 tx=0).stop 2023-11-08T19:24:38.179 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.176+0000 7f93b9614700 1 -- 172.21.15.149:0/1849148349 shutdown_connections 2023-11-08T19:24:38.179 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.176+0000 7f93b9614700 1 --2- 172.21.15.149:0/1849148349 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f93a006af00 0x7f93a006d3c0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:38.179 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.176+0000 7f93b9614700 1 --2- 172.21.15.149:0/1849148349 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93b4161a50 0x7f93b40c92e0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:38.179 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.176+0000 7f93b9614700 1 --2- 172.21.15.149:0/1849148349 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f93b415dd90 0x7f93b4159170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:38.180 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.176+0000 7f93b9614700 1 --2- 172.21.15.149:0/1849148349 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f93b4161670 0x7f93b41f4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:38.180 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.176+0000 7f93b9614700 1 -- 172.21.15.149:0/1849148349 >> 172.21.15.149:0/1849148349 conn(0x7f93b40d3980 msgr2=0x7f93b40b4c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:38.180 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.176+0000 7f93b9614700 1 -- 172.21.15.149:0/1849148349 shutdown_connections 2023-11-08T19:24:38.180 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.176+0000 7f93b9614700 1 -- 172.21.15.149:0/1849148349 wait complete. 2023-11-08T19:24:38.181 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 17 2023-11-08T19:24:38.190 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:24:38.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.310+0000 7f569fea8700 1 Processor -- start 2023-11-08T19:24:38.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.310+0000 7f569fea8700 1 -- start start 2023-11-08T19:24:38.314 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.311+0000 7f569fea8700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f56980b2c00 0x7f569815df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:38.314 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.311+0000 7f569fea8700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f569806ab80 0x7f569806b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:38.314 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.311+0000 7f569fea8700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56981624e0 con 0x7f569815db70 2023-11-08T19:24:38.314 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.311+0000 7f569fea8700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f569806b550 con 0x7f569806ab80 2023-11-08T19:24:38.315 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.311+0000 7f569fea8700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5698161940 con 0x7f56980b2c00 2023-11-08T19:24:38.315 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.311+0000 7f569d443700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f56980b2c00 0x7f569815df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:38.315 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.311+0000 7f569e445700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f569806ab80 0x7f569806b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:38.315 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.311+0000 7f569d443700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f56980b2c00 0x7f569815df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.149:60126/0 (socket says 172.21.15.149:60126) 2023-11-08T19:24:38.315 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.311+0000 7f569e445700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f569806ab80 0x7f569806b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.149:40832/0 (socket says 172.21.15.149:40832) 2023-11-08T19:24:38.316 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.311+0000 7f569d443700 1 -- 172.21.15.149:0/1632372084 learned_addr learned my addr 172.21.15.149:0/1632372084 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:38.316 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.312+0000 7f569d443700 1 -- 172.21.15.149:0/1632372084 >> v2:172.21.15.160:3300/0 conn(0x7f569806ab80 msgr2=0x7f569806b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:38.316 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.312+0000 7f569d443700 1 --2- 172.21.15.149:0/1632372084 >> v2:172.21.15.160:3300/0 conn(0x7f569806ab80 0x7f569806b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:38.316 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.312+0000 7f569d443700 1 -- 172.21.15.149:0/1632372084 >> v1:172.21.15.160:6789/0 conn(0x7f569815db70 legacy=0x7f5698161dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:38.316 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.312+0000 7f569d443700 1 -- 172.21.15.149:0/1632372084 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f569815eeb0 con 0x7f56980b2c00 2023-11-08T19:24:38.317 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.312+0000 7f569e445700 1 --2- 172.21.15.149:0/1632372084 >> v2:172.21.15.160:3300/0 conn(0x7f569806ab80 0x7f569806b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:24:38.317 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.312+0000 7f569d443700 1 --2- 172.21.15.149:0/1632372084 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f56980b2c00 0x7f569815df50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f56880098f0 tx=0x7f5688009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a28607599095521 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:38.317 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.312+0000 7f569cc42700 1 -- 172.21.15.149:0/1632372084 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5688011830 con 0x7f56980b2c00 2023-11-08T19:24:38.317 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.312+0000 7f569cc42700 1 -- 172.21.15.149:0/1632372084 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5688011990 con 0x7f56980b2c00 2023-11-08T19:24:38.317 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.312+0000 7f569cc42700 1 -- 172.21.15.149:0/1632372084 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5688011d20 con 0x7f56980b2c00 2023-11-08T19:24:38.318 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.312+0000 7f569fea8700 1 -- 172.21.15.149:0/1632372084 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f56980b2c00 msgr2=0x7f569815df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:38.318 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.312+0000 7f569fea8700 1 --2- 172.21.15.149:0/1632372084 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f56980b2c00 0x7f569815df50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f56880098f0 tx=0x7f5688009c00 comp rx=0 tx=0).stop 2023-11-08T19:24:38.318 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.313+0000 7f569fea8700 1 -- 172.21.15.149:0/1632372084 shutdown_connections 2023-11-08T19:24:38.318 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.313+0000 7f569fea8700 1 --2- 172.21.15.149:0/1632372084 >> v2:172.21.15.160:3300/0 conn(0x7f569806ab80 0x7f569806b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:38.318 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.313+0000 7f569fea8700 1 --2- 172.21.15.149:0/1632372084 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f56980b2c00 0x7f569815df50 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:38.319 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.313+0000 7f569fea8700 1 -- 172.21.15.149:0/1632372084 >> 172.21.15.149:0/1632372084 conn(0x7f56980ccff0 msgr2=0x7f56980cd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:38.319 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.313+0000 7f569fea8700 1 -- 172.21.15.149:0/1632372084 shutdown_connections 2023-11-08T19:24:38.319 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.313+0000 7f569fea8700 1 -- 172.21.15.149:0/1632372084 wait complete. 2023-11-08T19:24:38.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.314+0000 7f569fea8700 1 Processor -- start 2023-11-08T19:24:38.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.314+0000 7f569fea8700 1 -- start start 2023-11-08T19:24:38.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.314+0000 7f569fea8700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f569806ab80 0x7f56980b3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:38.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.314+0000 7f569fea8700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f56980b2c00 0x7f569815bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:38.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.315+0000 7f569fea8700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f569815db70 0x7f56980aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:38.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.315+0000 7f569fea8700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56980b3b20 con 0x7f569815db70 2023-11-08T19:24:38.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.315+0000 7f569fea8700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56980b48a0 con 0x7f56980b2c00 2023-11-08T19:24:38.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.315+0000 7f569fea8700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f569815c070 con 0x7f569806ab80 2023-11-08T19:24:38.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.315+0000 7f569e445700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f569815db70 0x7f56980aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:38.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.315+0000 7f569e445700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f569815db70 0x7f56980aebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39846/0 (socket says 172.21.15.149:39846) 2023-11-08T19:24:38.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.315+0000 7f569e445700 1 -- 172.21.15.149:0/394622868 learned_addr learned my addr 172.21.15.149:0/394622868 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:38.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.315+0000 7f569d443700 1 --2- 172.21.15.149:0/394622868 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f56980b2c00 0x7f569815bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:38.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.315+0000 7f569dc44700 1 --2- 172.21.15.149:0/394622868 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f569806ab80 0x7f56980b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:38.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.315+0000 7f569e445700 1 -- 172.21.15.149:0/394622868 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f569806ab80 msgr2=0x7f56980b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:38.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.315+0000 7f569e445700 1 --2- 172.21.15.149:0/394622868 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f569806ab80 0x7f56980b3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:38.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.315+0000 7f569e445700 1 -- 172.21.15.149:0/394622868 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f56980b2c00 msgr2=0x7f569815bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:38.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.315+0000 7f569e445700 1 --2- 172.21.15.149:0/394622868 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f56980b2c00 0x7f569815bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:38.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.315+0000 7f569e445700 1 -- 172.21.15.149:0/394622868 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5690009a70 con 0x7f569815db70 2023-11-08T19:24:38.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.315+0000 7f569e445700 1 --2- 172.21.15.149:0/394622868 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f569815db70 0x7f56980aebb0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f569000efc0 tx=0x7f569000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:38.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.315+0000 7f568e7fc700 1 -- 172.21.15.149:0/394622868 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569000ca90 con 0x7f569815db70 2023-11-08T19:24:38.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.315+0000 7f568e7fc700 1 -- 172.21.15.149:0/394622868 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f569000f040 con 0x7f569815db70 2023-11-08T19:24:38.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.315+0000 7f569fea8700 1 -- 172.21.15.149:0/394622868 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5688009550 con 0x7f569815db70 2023-11-08T19:24:38.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.315+0000 7f568e7fc700 1 -- 172.21.15.149:0/394622868 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569000ce30 con 0x7f569815db70 2023-11-08T19:24:38.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.315+0000 7f569fea8700 1 -- 172.21.15.149:0/394622868 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56980b40a0 con 0x7f569815db70 2023-11-08T19:24:38.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.316+0000 7f569fea8700 1 -- 172.21.15.149:0/394622868 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56980745f0 con 0x7f569815db70 2023-11-08T19:24:38.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.317+0000 7f568e7fc700 1 -- 172.21.15.149:0/394622868 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5690014480 con 0x7f569815db70 2023-11-08T19:24:38.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.317+0000 7f568e7fc700 1 --2- 172.21.15.149:0/394622868 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f567c06af00 0x7f567c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:38.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.317+0000 7f569dc44700 1 --2- 172.21.15.149:0/394622868 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f567c06af00 0x7f567c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:38.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.317+0000 7f568e7fc700 1 -- 172.21.15.149:0/394622868 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6438+0+0 (secure 0 0 0) 0x7f569008a020 con 0x7f569815db70 2023-11-08T19:24:38.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.318+0000 7f569dc44700 1 --2- 172.21.15.149:0/394622868 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f567c06af00 0x7f567c06d3c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5694007fd0 tx=0x7f5694009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:38.328 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.322+0000 7f568e7fc700 1 -- 172.21.15.149:0/394622868 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5690054d70 con 0x7f569815db70 2023-11-08T19:24:38.558 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.557+0000 7f569fea8700 1 -- 172.21.15.149:0/394622868 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5698072860 con 0x7f569815db70 2023-11-08T19:24:38.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.557+0000 7f568e7fc700 1 -- 172.21.15.149:0/394622868 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4922 (secure 0 0 0) 0x7f5690009cd0 con 0x7f569815db70 2023-11-08T19:24:38.559 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:24:38.559 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4877,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/3602590195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3602590195},{"type":"v1","addr":"172.21.15.160:6834","nonce":3602590195}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5107,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/1432406788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":1432406788},{"type":"v1","addr":"172.21.15.160:6835","nonce":1432406788}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5125,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/3066975859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3066975859},{"type":"v1","addr":"172.21.15.149:6837","nonce":3066975859}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-08T19:24:16.502193+0000","modified":"2023-11-08T19:24:19.886052+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5259":{"gid":5259,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.149:6836/746083826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":746083826},{"type":"v1","addr":"172.21.15.149:6836","nonce":746083826}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-08T19:24:38.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.560+0000 7f569fea8700 1 -- 172.21.15.149:0/394622868 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f567c06af00 msgr2=0x7f567c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:38.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.560+0000 7f569fea8700 1 --2- 172.21.15.149:0/394622868 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f567c06af00 0x7f567c06d3c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5694007fd0 tx=0x7f5694009040 comp rx=0 tx=0).stop 2023-11-08T19:24:38.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.560+0000 7f569fea8700 1 -- 172.21.15.149:0/394622868 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f569815db70 msgr2=0x7f56980aebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:38.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.560+0000 7f569fea8700 1 --2- 172.21.15.149:0/394622868 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f569815db70 0x7f56980aebb0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f569000efc0 tx=0x7f569000c3a0 comp rx=0 tx=0).stop 2023-11-08T19:24:38.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.560+0000 7f569fea8700 1 -- 172.21.15.149:0/394622868 shutdown_connections 2023-11-08T19:24:38.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.560+0000 7f569fea8700 1 --2- 172.21.15.149:0/394622868 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f567c06af00 0x7f567c06d3c0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:38.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.560+0000 7f569fea8700 1 --2- 172.21.15.149:0/394622868 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f569815db70 0x7f56980aebb0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:38.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.560+0000 7f569fea8700 1 --2- 172.21.15.149:0/394622868 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f569806ab80 0x7f56980b3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:38.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.560+0000 7f569fea8700 1 --2- 172.21.15.149:0/394622868 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f56980b2c00 0x7f569815bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:38.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.560+0000 7f569fea8700 1 -- 172.21.15.149:0/394622868 >> 172.21.15.149:0/394622868 conn(0x7f56980ccff0 msgr2=0x7f5698073720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:38.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.560+0000 7f569fea8700 1 -- 172.21.15.149:0/394622868 shutdown_connections 2023-11-08T19:24:38.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.560+0000 7f569fea8700 1 -- 172.21.15.149:0/394622868 wait complete. 2023-11-08T19:24:38.564 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 17 2023-11-08T19:24:38.573 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:24:38.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.693+0000 7f3a2ecb9700 1 Processor -- start 2023-11-08T19:24:38.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.693+0000 7f3a2ecb9700 1 -- start start 2023-11-08T19:24:38.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.694+0000 7f3a2ecb9700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f3a2815b950 0x7f3a280ce130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:38.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.694+0000 7f3a2ecb9700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3a280d0430 0x7f3a280ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:38.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.694+0000 7f3a2ecb9700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a280cc2e0 con 0x7f3a280cd5e0 2023-11-08T19:24:38.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.694+0000 7f3a2ecb9700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a280cc580 con 0x7f3a2815b950 2023-11-08T19:24:38.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.694+0000 7f3a2ecb9700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a280cc820 con 0x7f3a280d0430 2023-11-08T19:24:38.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.694+0000 7f3a27fff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f3a280cd5e0 0x7f3a280cfd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:41854/0 (socket says 172.21.15.149:41854) 2023-11-08T19:24:38.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.694+0000 7f3a27fff700 1 -- 172.21.15.149:0/2959500547 learned_addr learned my addr 172.21.15.149:0/2959500547 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:24:38.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.694+0000 7f3a2ca55700 1 --2- 172.21.15.149:0/2959500547 >> v2:172.21.15.160:3300/0 conn(0x7f3a2815b950 0x7f3a280ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:38.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.694+0000 7f3a2d256700 1 --2- 172.21.15.149:0/2959500547 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3a280d0430 0x7f3a280ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:38.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.694+0000 7f3a277fe700 1 -- 172.21.15.149:0/2959500547 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2899366917 0 0) 0x7f3a280cc2e0 con 0x7f3a280cd5e0 2023-11-08T19:24:38.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.694+0000 7f3a277fe700 1 -- 172.21.15.149:0/2959500547 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a180035b0 con 0x7f3a280cd5e0 2023-11-08T19:24:38.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.694+0000 7f3a2d256700 1 -- 172.21.15.149:0/2959500547 >> v2:172.21.15.160:3300/0 conn(0x7f3a2815b950 msgr2=0x7f3a280ce130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:38.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.694+0000 7f3a2d256700 1 --2- 172.21.15.149:0/2959500547 >> v2:172.21.15.160:3300/0 conn(0x7f3a2815b950 0x7f3a280ce130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:38.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.694+0000 7f3a2d256700 1 -- 172.21.15.149:0/2959500547 >> v1:172.21.15.149:6789/0 conn(0x7f3a280cd5e0 legacy=0x7f3a280cfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:38.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.694+0000 7f3a2d256700 1 -- 172.21.15.149:0/2959500547 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a280ccb00 con 0x7f3a280d0430 2023-11-08T19:24:38.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.694+0000 7f3a2d256700 1 --2- 172.21.15.149:0/2959500547 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3a280d0430 0x7f3a280ce670 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3a20009d90 tx=0x7f3a2000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0f73f4e4ce08cf8 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:38.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.695+0000 7f3a277fe700 1 -- 172.21.15.149:0/2959500547 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2000e070 con 0x7f3a280d0430 2023-11-08T19:24:38.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.695+0000 7f3a277fe700 1 -- 172.21.15.149:0/2959500547 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a2000bb20 con 0x7f3a280d0430 2023-11-08T19:24:38.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.695+0000 7f3a277fe700 1 -- 172.21.15.149:0/2959500547 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a20012430 con 0x7f3a280d0430 2023-11-08T19:24:38.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.695+0000 7f3a2ecb9700 1 -- 172.21.15.149:0/2959500547 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3a280d0430 msgr2=0x7f3a280ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:38.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.695+0000 7f3a2ecb9700 1 --2- 172.21.15.149:0/2959500547 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3a280d0430 0x7f3a280ce670 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3a20009d90 tx=0x7f3a2000b330 comp rx=0 tx=0).stop 2023-11-08T19:24:38.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.695+0000 7f3a2ecb9700 1 -- 172.21.15.149:0/2959500547 shutdown_connections 2023-11-08T19:24:38.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.695+0000 7f3a2ecb9700 1 --2- 172.21.15.149:0/2959500547 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3a280d0430 0x7f3a280ce670 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:38.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.695+0000 7f3a2ecb9700 1 --2- 172.21.15.149:0/2959500547 >> v2:172.21.15.160:3300/0 conn(0x7f3a2815b950 0x7f3a280ce130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:38.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.695+0000 7f3a2ecb9700 1 -- 172.21.15.149:0/2959500547 >> 172.21.15.149:0/2959500547 conn(0x7f3a2808afd0 msgr2=0x7f3a280d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:38.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.695+0000 7f3a2ecb9700 1 -- 172.21.15.149:0/2959500547 shutdown_connections 2023-11-08T19:24:38.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.695+0000 7f3a2ecb9700 1 -- 172.21.15.149:0/2959500547 wait complete. 2023-11-08T19:24:38.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.696+0000 7f3a2ecb9700 1 Processor -- start 2023-11-08T19:24:38.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.696+0000 7f3a2ecb9700 1 -- start start 2023-11-08T19:24:38.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.697+0000 7f3a2ecb9700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3a280d0430 0x7f3a280b68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:38.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.697+0000 7f3a2ecb9700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a2815b950 0x7f3a281f4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:38.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.697+0000 7f3a2ecb9700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3a281f4c90 0x7f3a281f03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:38.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.697+0000 7f3a2ecb9700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a280cb6e0 con 0x7f3a2815b950 2023-11-08T19:24:38.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.697+0000 7f3a2ecb9700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a281f5120 con 0x7f3a281f4c90 2023-11-08T19:24:38.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.697+0000 7f3a2ecb9700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a280c9b80 con 0x7f3a280d0430 2023-11-08T19:24:38.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.697+0000 7f3a27fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a2815b950 0x7f3a281f4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:38.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.697+0000 7f3a27fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a2815b950 0x7f3a281f4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39858/0 (socket says 172.21.15.149:39858) 2023-11-08T19:24:38.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.697+0000 7f3a27fff700 1 -- 172.21.15.149:0/660285727 learned_addr learned my addr 172.21.15.149:0/660285727 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:38.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.698+0000 7f3a2ca55700 1 --2- 172.21.15.149:0/660285727 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3a280d0430 0x7f3a280b68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:38.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.698+0000 7f3a2d256700 1 --2- 172.21.15.149:0/660285727 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3a281f4c90 0x7f3a281f03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:38.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.698+0000 7f3a27fff700 1 -- 172.21.15.149:0/660285727 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3a280d0430 msgr2=0x7f3a280b68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:38.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.698+0000 7f3a27fff700 1 --2- 172.21.15.149:0/660285727 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3a280d0430 0x7f3a280b68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:38.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.698+0000 7f3a27fff700 1 -- 172.21.15.149:0/660285727 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3a281f4c90 msgr2=0x7f3a281f03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:38.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.698+0000 7f3a27fff700 1 --2- 172.21.15.149:0/660285727 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3a281f4c90 0x7f3a281f03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:38.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.698+0000 7f3a27fff700 1 -- 172.21.15.149:0/660285727 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a20009a70 con 0x7f3a2815b950 2023-11-08T19:24:38.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.698+0000 7f3a27fff700 1 --2- 172.21.15.149:0/660285727 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a2815b950 0x7f3a281f4750 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f3a1400c700 tx=0x7f3a1400cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:38.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.698+0000 7f3a257fa700 1 -- 172.21.15.149:0/660285727 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a14005d70 con 0x7f3a2815b950 2023-11-08T19:24:38.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.698+0000 7f3a257fa700 1 -- 172.21.15.149:0/660285727 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a140070d0 con 0x7f3a2815b950 2023-11-08T19:24:38.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.698+0000 7f3a2ecb9700 1 -- 172.21.15.149:0/660285727 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a280c92c0 con 0x7f3a2815b950 2023-11-08T19:24:38.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.698+0000 7f3a257fa700 1 -- 172.21.15.149:0/660285727 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a14007460 con 0x7f3a2815b950 2023-11-08T19:24:38.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.698+0000 7f3a2ecb9700 1 -- 172.21.15.149:0/660285727 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a280c9530 con 0x7f3a2815b950 2023-11-08T19:24:38.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.699+0000 7f3a2ecb9700 1 -- 172.21.15.149:0/660285727 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a280c9cf0 con 0x7f3a2815b950 2023-11-08T19:24:38.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.699+0000 7f3a257fa700 1 -- 172.21.15.149:0/660285727 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3a140075c0 con 0x7f3a2815b950 2023-11-08T19:24:38.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.700+0000 7f3a257fa700 1 --2- 172.21.15.149:0/660285727 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3a0c06af00 0x7f3a0c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:38.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.700+0000 7f3a257fa700 1 -- 172.21.15.149:0/660285727 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6438+0+0 (secure 0 0 0) 0x7f3a14088e90 con 0x7f3a2815b950 2023-11-08T19:24:38.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.700+0000 7f3a2ca55700 1 --2- 172.21.15.149:0/660285727 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3a0c06af00 0x7f3a0c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:38.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.700+0000 7f3a2ca55700 1 --2- 172.21.15.149:0/660285727 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3a0c06af00 0x7f3a0c06d3c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c009ab0 tx=0x7f3a1c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:38.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.705+0000 7f3a257fa700 1 -- 172.21.15.149:0/660285727 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3a14053c70 con 0x7f3a2815b950 2023-11-08T19:24:38.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.894+0000 7f3a2ecb9700 1 -- 172.21.15.149:0/660285727 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3a280745f0 con 0x7f3a2815b950 2023-11-08T19:24:38.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.895+0000 7f3a257fa700 1 -- 172.21.15.149:0/660285727 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+18649 (secure 0 0 0) 0x7f3a14057290 con 0x7f3a2815b950 2023-11-08T19:24:38.897 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:24:38.897 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":42,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:24:32.128826+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-08T19:24:14.467859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-08T19:24:15.470328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-08T19:24:29.516185+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":1,"length":1}]}],"new_removed_snaps":[{"pool":7,"snaps":[{"begin":1,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:24:38.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.897+0000 7f3a2ecb9700 1 -- 172.21.15.149:0/660285727 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3a0c06af00 msgr2=0x7f3a0c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:38.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.897+0000 7f3a2ecb9700 1 --2- 172.21.15.149:0/660285727 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3a0c06af00 0x7f3a0c06d3c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c009ab0 tx=0x7f3a1c008040 comp rx=0 tx=0).stop 2023-11-08T19:24:38.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.897+0000 7f3a2ecb9700 1 -- 172.21.15.149:0/660285727 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a2815b950 msgr2=0x7f3a281f4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:38.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.897+0000 7f3a2ecb9700 1 --2- 172.21.15.149:0/660285727 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a2815b950 0x7f3a281f4750 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f3a1400c700 tx=0x7f3a1400cac0 comp rx=0 tx=0).stop 2023-11-08T19:24:38.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.897+0000 7f3a2ecb9700 1 -- 172.21.15.149:0/660285727 shutdown_connections 2023-11-08T19:24:38.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.897+0000 7f3a2ecb9700 1 --2- 172.21.15.149:0/660285727 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3a0c06af00 0x7f3a0c06d3c0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:38.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.897+0000 7f3a2ecb9700 1 --2- 172.21.15.149:0/660285727 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3a281f4c90 0x7f3a281f03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:38.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.897+0000 7f3a2ecb9700 1 --2- 172.21.15.149:0/660285727 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3a280d0430 0x7f3a280b68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:38.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.897+0000 7f3a2ecb9700 1 --2- 172.21.15.149:0/660285727 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a2815b950 0x7f3a281f4750 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:38.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.897+0000 7f3a2ecb9700 1 -- 172.21.15.149:0/660285727 >> 172.21.15.149:0/660285727 conn(0x7f3a2808afd0 msgr2=0x7f3a280cfd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:38.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.898+0000 7f3a2ecb9700 1 -- 172.21.15.149:0/660285727 shutdown_connections 2023-11-08T19:24:38.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:38.898+0000 7f3a2ecb9700 1 -- 172.21.15.149:0/660285727 wait complete. 2023-11-08T19:24:38.911 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-08T19:24:39.032 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.031+0000 7ff966834700 1 Processor -- start 2023-11-08T19:24:39.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.031+0000 7ff966834700 1 -- start start 2023-11-08T19:24:39.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.032+0000 7ff966834700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7ff9600cb300 0x7ff96015d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:39.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.032+0000 7ff966834700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9600b2f60 con 0x7ff9600cc140 2023-11-08T19:24:39.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.032+0000 7ff966834700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9600cc520 con 0x7ff9600cc910 2023-11-08T19:24:39.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.032+0000 7ff966834700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9600b2430 con 0x7ff9600cb300 2023-11-08T19:24:39.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.032+0000 7ff95ffff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7ff9600cc140 0x7ff9600b2850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:41866/0 (socket says 172.21.15.149:41866) 2023-11-08T19:24:39.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.032+0000 7ff95ffff700 1 -- 172.21.15.149:0/2495516241 learned_addr learned my addr 172.21.15.149:0/2495516241 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:24:39.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.032+0000 7ff964dd1700 1 --2- 172.21.15.149:0/2495516241 >> v2:172.21.15.160:3300/0 conn(0x7ff9600cb300 0x7ff96015d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:39.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.033+0000 7ff95effd700 1 -- 172.21.15.149:0/2495516241 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2084063459 0 0) 0x7ff9600b2f60 con 0x7ff9600cc140 2023-11-08T19:24:39.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.033+0000 7ff95effd700 1 -- 172.21.15.149:0/2495516241 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9480035b0 con 0x7ff9600cc140 2023-11-08T19:24:39.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.033+0000 7ff95effd700 1 -- 172.21.15.149:0/2495516241 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2883615996 0 0) 0x7ff9480035b0 con 0x7ff9600cc140 2023-11-08T19:24:39.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.033+0000 7ff95effd700 1 -- 172.21.15.149:0/2495516241 >> v2:172.21.15.160:3300/0 conn(0x7ff9600cb300 msgr2=0x7ff96015d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:39.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.033+0000 7ff95effd700 1 --2- 172.21.15.149:0/2495516241 >> v2:172.21.15.160:3300/0 conn(0x7ff9600cb300 0x7ff96015d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:39.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.033+0000 7ff95effd700 1 -- 172.21.15.149:0/2495516241 >> v1:172.21.15.160:6789/0 conn(0x7ff9600cc910 legacy=0x7ff9600cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:39.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.033+0000 7ff95effd700 1 -- 172.21.15.149:0/2495516241 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9600b17b0 con 0x7ff9600cc140 2023-11-08T19:24:39.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.033+0000 7ff95effd700 1 -- 172.21.15.149:0/2495516241 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7ff9540017f0 con 0x7ff9600cc140 2023-11-08T19:24:39.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.033+0000 7ff95effd700 1 -- 172.21.15.149:0/2495516241 >> v1:172.21.15.149:6789/0 conn(0x7ff9600cc140 legacy=0x7ff9600b2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:39.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.033+0000 7ff95effd700 1 --2- 172.21.15.149:0/2495516241 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff948003a00 0x7ff948003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:39.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.033+0000 7ff95effd700 1 --2- 172.21.15.149:0/2495516241 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff948004850 0x7ff948004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:39.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.033+0000 7ff95effd700 1 --2- 172.21.15.149:0/2495516241 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff948005210 0x7ff94800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:39.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.033+0000 7ff95effd700 1 -- 172.21.15.149:0/2495516241 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9600b2430 con 0x7ff948005210 2023-11-08T19:24:39.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.033+0000 7ff95effd700 1 -- 172.21.15.149:0/2495516241 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff94800c0b0 con 0x7ff948004850 2023-11-08T19:24:39.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.033+0000 7ff95effd700 1 -- 172.21.15.149:0/2495516241 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff94800c270 con 0x7ff948003a00 2023-11-08T19:24:39.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.033+0000 7ff964dd1700 1 --2- 172.21.15.149:0/2495516241 >> v2:172.21.15.160:3300/0 conn(0x7ff9600cb300 0x7ff96015d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:24:39.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.033+0000 7ff964dd1700 1 --2- 172.21.15.149:0/2495516241 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff948005210 0x7ff94800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:39.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.033+0000 7ff95ffff700 1 --2- 172.21.15.149:0/2495516241 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff948003a00 0x7ff948003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:39.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.033+0000 7ff95f7fe700 1 --2- 172.21.15.149:0/2495516241 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff948004850 0x7ff948004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:39.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.033+0000 7ff964dd1700 1 -- 172.21.15.149:0/2495516241 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff948003a00 msgr2=0x7ff948003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:39.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.033+0000 7ff964dd1700 1 --2- 172.21.15.149:0/2495516241 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff948003a00 0x7ff948003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:39.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.033+0000 7ff964dd1700 1 -- 172.21.15.149:0/2495516241 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff948004850 msgr2=0x7ff948004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:39.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.033+0000 7ff964dd1700 1 --2- 172.21.15.149:0/2495516241 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff948004850 0x7ff948004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:39.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.033+0000 7ff964dd1700 1 -- 172.21.15.149:0/2495516241 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9480035b0 con 0x7ff948005210 2023-11-08T19:24:39.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.033+0000 7ff964dd1700 1 -- 172.21.15.149:0/2495516241 reap_dead start 2023-11-08T19:24:39.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.034+0000 7ff964dd1700 1 --2- 172.21.15.149:0/2495516241 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff948005210 0x7ff94800ba10 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7ff95800e320 tx=0x7ff948005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ac2043fa4426803 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:39.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.034+0000 7ff95effd700 1 -- 172.21.15.149:0/2495516241 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95800edc0 con 0x7ff948005210 2023-11-08T19:24:39.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.034+0000 7ff95effd700 1 -- 172.21.15.149:0/2495516241 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff95800f040 con 0x7ff948005210 2023-11-08T19:24:39.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.034+0000 7ff95effd700 1 -- 172.21.15.149:0/2495516241 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff958003c60 con 0x7ff948005210 2023-11-08T19:24:39.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.034+0000 7ff966834700 1 -- 172.21.15.149:0/2495516241 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff948005210 msgr2=0x7ff94800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:39.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.034+0000 7ff966834700 1 --2- 172.21.15.149:0/2495516241 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff948005210 0x7ff94800ba10 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7ff95800e320 tx=0x7ff948005880 comp rx=0 tx=0).stop 2023-11-08T19:24:39.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.034+0000 7ff966834700 1 -- 172.21.15.149:0/2495516241 shutdown_connections 2023-11-08T19:24:39.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.034+0000 7ff966834700 1 --2- 172.21.15.149:0/2495516241 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff948005210 0x7ff94800ba10 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:39.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.034+0000 7ff966834700 1 -- 172.21.15.149:0/2495516241 >> 172.21.15.149:0/2495516241 conn(0x7ff960099a40 msgr2=0x7ff9600d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:39.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.034+0000 7ff966834700 1 -- 172.21.15.149:0/2495516241 shutdown_connections 2023-11-08T19:24:39.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.034+0000 7ff966834700 1 -- 172.21.15.149:0/2495516241 wait complete. 2023-11-08T19:24:39.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.036+0000 7ff966834700 1 Processor -- start 2023-11-08T19:24:39.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.036+0000 7ff966834700 1 -- start start 2023-11-08T19:24:39.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.036+0000 7ff966834700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff948005210 0x7ff9600b57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:39.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.036+0000 7ff966834700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff9601e6430 0x7ff96014f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:39.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.036+0000 7ff966834700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9601502e0 0x7ff9601e7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:39.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.036+0000 7ff966834700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9601e7720 con 0x7ff9601502e0 2023-11-08T19:24:39.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.036+0000 7ff966834700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9601e68b0 con 0x7ff9601e6430 2023-11-08T19:24:39.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.036+0000 7ff966834700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff960160780 con 0x7ff948005210 2023-11-08T19:24:39.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.037+0000 7ff964dd1700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9601502e0 0x7ff9601e7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:39.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.037+0000 7ff964dd1700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9601502e0 0x7ff9601e7b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39880/0 (socket says 172.21.15.149:39880) 2023-11-08T19:24:39.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.037+0000 7ff964dd1700 1 -- 172.21.15.149:0/25951576 learned_addr learned my addr 172.21.15.149:0/25951576 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:39.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.037+0000 7ff95ffff700 1 --2- 172.21.15.149:0/25951576 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff948005210 0x7ff9600b57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:39.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.037+0000 7ff964dd1700 1 -- 172.21.15.149:0/25951576 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff948005210 msgr2=0x7ff9600b57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:39.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.037+0000 7ff964dd1700 1 --2- 172.21.15.149:0/25951576 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff948005210 0x7ff9600b57b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:39.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.037+0000 7ff95f7fe700 1 --2- 172.21.15.149:0/25951576 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff9601e6430 0x7ff96014f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:39.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.037+0000 7ff964dd1700 1 -- 172.21.15.149:0/25951576 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff9601e6430 msgr2=0x7ff96014f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:39.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.037+0000 7ff964dd1700 1 --2- 172.21.15.149:0/25951576 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff9601e6430 0x7ff96014f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:39.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.037+0000 7ff964dd1700 1 -- 172.21.15.149:0/25951576 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9601e6aa0 con 0x7ff9601502e0 2023-11-08T19:24:39.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.037+0000 7ff964dd1700 1 --2- 172.21.15.149:0/25951576 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9601502e0 0x7ff9601e7b40 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7ff9600ca9b0 tx=0x7ff958009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:39.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.037+0000 7ff95cff9700 1 -- 172.21.15.149:0/25951576 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff958004020 con 0x7ff9601502e0 2023-11-08T19:24:39.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.037+0000 7ff95cff9700 1 -- 172.21.15.149:0/25951576 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9580041a0 con 0x7ff9601502e0 2023-11-08T19:24:39.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.037+0000 7ff966834700 1 -- 172.21.15.149:0/25951576 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9601e6d80 con 0x7ff9601502e0 2023-11-08T19:24:39.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.037+0000 7ff95cff9700 1 -- 172.21.15.149:0/25951576 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff958004550 con 0x7ff9601502e0 2023-11-08T19:24:39.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.037+0000 7ff966834700 1 -- 172.21.15.149:0/25951576 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9601e7340 con 0x7ff9601502e0 2023-11-08T19:24:39.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.038+0000 7ff966834700 1 -- 172.21.15.149:0/25951576 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9601e7860 con 0x7ff9601502e0 2023-11-08T19:24:39.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.039+0000 7ff95cff9700 1 -- 172.21.15.149:0/25951576 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff958023070 con 0x7ff9601502e0 2023-11-08T19:24:39.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.039+0000 7ff95cff9700 1 --2- 172.21.15.149:0/25951576 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff94c06af00 0x7ff94c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:39.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.039+0000 7ff95cff9700 1 -- 172.21.15.149:0/25951576 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6438+0+0 (secure 0 0 0) 0x7ff95808b290 con 0x7ff9601502e0 2023-11-08T19:24:39.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.039+0000 7ff95ffff700 1 --2- 172.21.15.149:0/25951576 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff94c06af00 0x7ff94c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:39.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.039+0000 7ff95ffff700 1 --2- 172.21.15.149:0/25951576 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff94c06af00 0x7ff94c06d3c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff954000ef0 tx=0x7ff954009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:39.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.044+0000 7ff95cff9700 1 -- 172.21.15.149:0/25951576 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff9601e7860 con 0x7ff9601502e0 2023-11-08T19:24:39.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.285+0000 7ff966834700 1 -- 172.21.15.149:0/25951576 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ff9601e7860 con 0x7ff9601502e0 2023-11-08T19:24:39.287 INFO:tasks.ceph.mon.a.smithi149.stderr:2023-11-08T19:24:39.285+0000 7f2b592f2700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-08T19:24:39.288 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.287+0000 7ff95cff9700 1 -- 172.21.15.149:0/25951576 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) v1 ==== 161+0+0 (secure 0 0 0) 0x7ff9601e7860 con 0x7ff9601502e0 2023-11-08T19:24:39.292 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.290+0000 7ff966834700 1 -- 172.21.15.149:0/25951576 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff94c06af00 msgr2=0x7ff94c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:39.292 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.290+0000 7ff966834700 1 --2- 172.21.15.149:0/25951576 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff94c06af00 0x7ff94c06d3c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff954000ef0 tx=0x7ff954009040 comp rx=0 tx=0).stop 2023-11-08T19:24:39.292 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.290+0000 7ff966834700 1 -- 172.21.15.149:0/25951576 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9601502e0 msgr2=0x7ff9601e7b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:39.292 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.290+0000 7ff966834700 1 --2- 172.21.15.149:0/25951576 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9601502e0 0x7ff9601e7b40 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7ff9600ca9b0 tx=0x7ff958009750 comp rx=0 tx=0).stop 2023-11-08T19:24:39.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.290+0000 7ff966834700 1 -- 172.21.15.149:0/25951576 shutdown_connections 2023-11-08T19:24:39.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.290+0000 7ff966834700 1 --2- 172.21.15.149:0/25951576 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff94c06af00 0x7ff94c06d3c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:39.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.290+0000 7ff966834700 1 --2- 172.21.15.149:0/25951576 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9601502e0 0x7ff9601e7b40 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:39.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.290+0000 7ff966834700 1 --2- 172.21.15.149:0/25951576 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff948005210 0x7ff9600b57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:39.294 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.290+0000 7ff966834700 1 --2- 172.21.15.149:0/25951576 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff9601e6430 0x7ff96014f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:39.294 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.290+0000 7ff966834700 1 -- 172.21.15.149:0/25951576 >> 172.21.15.149:0/25951576 conn(0x7ff960099a40 msgr2=0x7ff9600d0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:39.294 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.291+0000 7ff966834700 1 -- 172.21.15.149:0/25951576 shutdown_connections 2023-11-08T19:24:39.294 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.291+0000 7ff966834700 1 -- 172.21.15.149:0/25951576 wait complete. 2023-11-08T19:24:39.295 INFO:teuthology.orchestra.run.smithi149.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-08T19:24:39.295 INFO:tasks.ceph.mds.a.smithi149.stderr: -3131> 2023-11-08T19:24:19.457+0000 7f2e53188700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-08T19:24:39.305 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-08T19:24:39.322 INFO:tasks.ceph.mds.a.smithi149.stdout:starting mds.a at 2023-11-08T19:24:39.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.428+0000 7f021e3d5700 1 Processor -- start 2023-11-08T19:24:39.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.429+0000 7f021e3d5700 1 -- start start 2023-11-08T19:24:39.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.429+0000 7f021e3d5700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f021815f470 0x7f021815c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:39.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.429+0000 7f021e3d5700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f021815be80 con 0x7f02180cc0d0 2023-11-08T19:24:39.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.429+0000 7f021e3d5700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02180ccbc0 con 0x7f021815cb60 2023-11-08T19:24:39.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.429+0000 7f021e3d5700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f021815f8d0 con 0x7f021815f470 2023-11-08T19:24:39.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.430+0000 7f020ffff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f021815f470 0x7f021815c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:39.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.430+0000 7f0217fff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f02180cc0d0 0x7f02180cc4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:41898/0 (socket says 172.21.15.149:41898) 2023-11-08T19:24:39.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.430+0000 7f0217fff700 1 -- 172.21.15.149:0/4052917132 learned_addr learned my addr 172.21.15.149:0/4052917132 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:24:39.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.430+0000 7f020ffff700 1 -- 172.21.15.149:0/4052917132 >> v1:172.21.15.160:6789/0 conn(0x7f021815cb60 legacy=0x7f02180cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:39.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.430+0000 7f020ffff700 1 -- 172.21.15.149:0/4052917132 >> v1:172.21.15.149:6789/0 conn(0x7f02180cc0d0 legacy=0x7f02180cc4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:39.438 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.430+0000 7f02177fe700 1 -- 172.21.15.149:0/4052917132 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2254807056 0 0) 0x7f021815be80 con 0x7f02180cc0d0 2023-11-08T19:24:39.438 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.430+0000 7f020ffff700 1 -- 172.21.15.149:0/4052917132 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f021815fba0 con 0x7f021815f470 2023-11-08T19:24:39.438 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.430+0000 7f020ffff700 1 --2- 172.21.15.149:0/4052917132 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f021815f470 0x7f021815c620 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f0200009840 tx=0x7f0200009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de3606d3e11fe9b4 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:39.438 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.430+0000 7f02177fe700 1 -- 172.21.15.149:0/4052917132 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0200004230 con 0x7f021815f470 2023-11-08T19:24:39.438 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.430+0000 7f02177fe700 1 -- 172.21.15.149:0/4052917132 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0200004390 con 0x7f021815f470 2023-11-08T19:24:39.439 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.430+0000 7f02177fe700 1 -- 172.21.15.149:0/4052917132 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02000036a0 con 0x7f021815f470 2023-11-08T19:24:39.439 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.431+0000 7f021e3d5700 1 -- 172.21.15.149:0/4052917132 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f021815f470 msgr2=0x7f021815c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:39.439 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.431+0000 7f021e3d5700 1 --2- 172.21.15.149:0/4052917132 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f021815f470 0x7f021815c620 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f0200009840 tx=0x7f0200009b50 comp rx=0 tx=0).stop 2023-11-08T19:24:39.439 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.431+0000 7f021e3d5700 1 -- 172.21.15.149:0/4052917132 shutdown_connections 2023-11-08T19:24:39.439 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.431+0000 7f021e3d5700 1 --2- 172.21.15.149:0/4052917132 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f021815f470 0x7f021815c620 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:39.440 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.431+0000 7f021e3d5700 1 -- 172.21.15.149:0/4052917132 >> 172.21.15.149:0/4052917132 conn(0x7f021806f120 msgr2=0x7f021806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:39.440 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.431+0000 7f021e3d5700 1 -- 172.21.15.149:0/4052917132 shutdown_connections 2023-11-08T19:24:39.440 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.431+0000 7f021e3d5700 1 -- 172.21.15.149:0/4052917132 wait complete. 2023-11-08T19:24:39.440 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.432+0000 7f021e3d5700 1 Processor -- start 2023-11-08T19:24:39.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.432+0000 7f021e3d5700 1 -- start start 2023-11-08T19:24:39.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.433+0000 7f021e3d5700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02180cc0d0 0x7f0218157f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:39.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.433+0000 7f021e3d5700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f021815cb60 0x7f02180c7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:39.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.433+0000 7f021e3d5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f021815f470 0x7f02180c7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:39.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.433+0000 7f021e3d5700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02180b1e30 con 0x7f021815f470 2023-11-08T19:24:39.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.433+0000 7f021e3d5700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02180b2110 con 0x7f02180cc0d0 2023-11-08T19:24:39.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.433+0000 7f021e3d5700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02180b23f0 con 0x7f021815cb60 2023-11-08T19:24:39.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.433+0000 7f021c972700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f021815f470 0x7f02180c7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:39.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.433+0000 7f021c972700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f021815f470 0x7f02180c7890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39904/0 (socket says 172.21.15.149:39904) 2023-11-08T19:24:39.443 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.433+0000 7f021c972700 1 -- 172.21.15.149:0/188579236 learned_addr learned my addr 172.21.15.149:0/188579236 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:39.443 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.433+0000 7f0217fff700 1 --2- 172.21.15.149:0/188579236 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02180cc0d0 0x7f0218157f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:39.443 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.433+0000 7f020ffff700 1 --2- 172.21.15.149:0/188579236 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f021815cb60 0x7f02180c7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:39.443 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.433+0000 7f021c972700 1 -- 172.21.15.149:0/188579236 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f021815cb60 msgr2=0x7f02180c7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:39.443 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.433+0000 7f021c972700 1 --2- 172.21.15.149:0/188579236 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f021815cb60 0x7f02180c7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:39.443 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.433+0000 7f021c972700 1 -- 172.21.15.149:0/188579236 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02180cc0d0 msgr2=0x7f0218157f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:39.444 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.433+0000 7f021c972700 1 --2- 172.21.15.149:0/188579236 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02180cc0d0 0x7f0218157f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:39.444 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.433+0000 7f021c972700 1 -- 172.21.15.149:0/188579236 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02000094a0 con 0x7f021815f470 2023-11-08T19:24:39.444 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.433+0000 7f021c972700 1 --2- 172.21.15.149:0/188579236 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f021815f470 0x7f02180c7890 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f021000cba0 tx=0x7f021000ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:39.444 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.433+0000 7f02157fa700 1 -- 172.21.15.149:0/188579236 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021000aaa0 con 0x7f021815f470 2023-11-08T19:24:39.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.433+0000 7f02157fa700 1 -- 172.21.15.149:0/188579236 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f021000ac00 con 0x7f021815f470 2023-11-08T19:24:39.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.433+0000 7f02157fa700 1 -- 172.21.15.149:0/188579236 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0210012420 con 0x7f021815f470 2023-11-08T19:24:39.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.433+0000 7f021e3d5700 1 -- 172.21.15.149:0/188579236 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02180b26d0 con 0x7f021815f470 2023-11-08T19:24:39.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.434+0000 7f021e3d5700 1 -- 172.21.15.149:0/188579236 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02180c5430 con 0x7f021815f470 2023-11-08T19:24:39.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.434+0000 7f021e3d5700 1 -- 172.21.15.149:0/188579236 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02180c9aa0 con 0x7f021815f470 2023-11-08T19:24:39.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.436+0000 7f02157fa700 1 -- 172.21.15.149:0/188579236 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0210012580 con 0x7f021815f470 2023-11-08T19:24:39.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.436+0000 7f02157fa700 1 --2- 172.21.15.149:0/188579236 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f01f806af00 0x7f01f806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:39.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.436+0000 7f02157fa700 1 -- 172.21.15.149:0/188579236 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6468+0+0 (secure 0 0 0) 0x7f021008a2e0 con 0x7f021815f470 2023-11-08T19:24:39.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.437+0000 7f0217fff700 1 --2- 172.21.15.149:0/188579236 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f01f806af00 0x7f01f806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:39.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.437+0000 7f0217fff700 1 --2- 172.21.15.149:0/188579236 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f01f806af00 0x7f01f806d3c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0208000f60 tx=0x7f0208007e70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:39.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.440+0000 7f02157fa700 1 -- 172.21.15.149:0/188579236 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0210055100 con 0x7f021815f470 2023-11-08T19:24:39.679 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:39.678+0000 7f021e3d5700 1 -- 172.21.15.149:0/188579236 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0218160140 con 0x7f021815f470 2023-11-08T19:24:40.294 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.293+0000 7f02157fa700 1 -- 172.21.15.149:0/188579236 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0218160140 con 0x7f021815f470 2023-11-08T19:24:40.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.296+0000 7f021e3d5700 1 -- 172.21.15.149:0/188579236 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f01f806af00 msgr2=0x7f01f806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:40.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.296+0000 7f021e3d5700 1 --2- 172.21.15.149:0/188579236 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f01f806af00 0x7f01f806d3c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0208000f60 tx=0x7f0208007e70 comp rx=0 tx=0).stop 2023-11-08T19:24:40.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.296+0000 7f021e3d5700 1 -- 172.21.15.149:0/188579236 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f021815f470 msgr2=0x7f02180c7890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:40.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.296+0000 7f021e3d5700 1 --2- 172.21.15.149:0/188579236 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f021815f470 0x7f02180c7890 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f021000cba0 tx=0x7f021000ceb0 comp rx=0 tx=0).stop 2023-11-08T19:24:40.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.296+0000 7f021e3d5700 1 -- 172.21.15.149:0/188579236 shutdown_connections 2023-11-08T19:24:40.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.296+0000 7f021e3d5700 1 --2- 172.21.15.149:0/188579236 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f01f806af00 0x7f01f806d3c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:40.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.296+0000 7f021e3d5700 1 --2- 172.21.15.149:0/188579236 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02180cc0d0 0x7f0218157f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:40.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.296+0000 7f021e3d5700 1 --2- 172.21.15.149:0/188579236 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f021815f470 0x7f02180c7890 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:40.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.296+0000 7f021e3d5700 1 --2- 172.21.15.149:0/188579236 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f021815cb60 0x7f02180c7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:40.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.296+0000 7f021e3d5700 1 -- 172.21.15.149:0/188579236 >> 172.21.15.149:0/188579236 conn(0x7f021806f120 msgr2=0x7f021815d690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:40.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.296+0000 7f021e3d5700 1 -- 172.21.15.149:0/188579236 shutdown_connections 2023-11-08T19:24:40.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.296+0000 7f021e3d5700 1 -- 172.21.15.149:0/188579236 wait complete. 2023-11-08T19:24:40.311 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-08T19:24:40.478 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.477+0000 7fa4b1a5a700 1 Processor -- start 2023-11-08T19:24:40.478 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.477+0000 7fa4b1a5a700 1 -- start start 2023-11-08T19:24:40.480 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.477+0000 7fa4b1a5a700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa4ac15de90 0x7fa4ac0b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:40.480 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.477+0000 7fa4b1a5a700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fa4ac15eff0 0x7fa4ac0cfa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:40.481 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.477+0000 7fa4b1a5a700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4ac0d03a0 con 0x7fa4ac0cff60 2023-11-08T19:24:40.481 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.477+0000 7fa4b1a5a700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4ac15f590 con 0x7fa4ac15de90 2023-11-08T19:24:40.481 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.477+0000 7fa4b1a5a700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4ac06dee0 con 0x7fa4ac15eff0 2023-11-08T19:24:40.481 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.478+0000 7fa4aaffd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa4ac15de90 0x7fa4ac0b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:40.482 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.478+0000 7fa4aaffd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa4ac15de90 0x7fa4ac0b40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39910/0 (socket says 172.21.15.149:39910) 2023-11-08T19:24:40.482 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.478+0000 7fa4aaffd700 1 -- 172.21.15.149:0/2387862797 learned_addr learned my addr 172.21.15.149:0/2387862797 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:40.482 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.478+0000 7fa4aa7fc700 1 --2- 172.21.15.149:0/2387862797 >> v2:172.21.15.160:3300/0 conn(0x7fa4ac15eff0 0x7fa4ac0cfa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:40.482 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.478+0000 7fa4aaffd700 1 -- 172.21.15.149:0/2387862797 >> v2:172.21.15.160:3300/0 conn(0x7fa4ac15eff0 msgr2=0x7fa4ac0cfa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:40.482 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.478+0000 7fa4aaffd700 1 --2- 172.21.15.149:0/2387862797 >> v2:172.21.15.160:3300/0 conn(0x7fa4ac15eff0 0x7fa4ac0cfa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:40.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.478+0000 7fa4aaffd700 1 -- 172.21.15.149:0/2387862797 >> v1:172.21.15.160:6789/0 conn(0x7fa4ac0cff60 legacy=0x7fa4ac0b2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:40.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.478+0000 7fa4aaffd700 1 -- 172.21.15.149:0/2387862797 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4ac0cd370 con 0x7fa4ac15de90 2023-11-08T19:24:40.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.478+0000 7fa4aaffd700 1 --2- 172.21.15.149:0/2387862797 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4ac15de90 0x7fa4ac0b40d0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac06f3e0 tx=0x7fa49c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be5381313f427d3a server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:40.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.478+0000 7fa4a9ffb700 1 -- 172.21.15.149:0/2387862797 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49c004230 con 0x7fa4ac15de90 2023-11-08T19:24:40.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.478+0000 7fa4a9ffb700 1 -- 172.21.15.149:0/2387862797 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa49c004390 con 0x7fa4ac15de90 2023-11-08T19:24:40.484 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.478+0000 7fa4a9ffb700 1 -- 172.21.15.149:0/2387862797 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49c0036a0 con 0x7fa4ac15de90 2023-11-08T19:24:40.484 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.479+0000 7fa4b1a5a700 1 -- 172.21.15.149:0/2387862797 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4ac15de90 msgr2=0x7fa4ac0b40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:40.484 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.479+0000 7fa4b1a5a700 1 --2- 172.21.15.149:0/2387862797 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4ac15de90 0x7fa4ac0b40d0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac06f3e0 tx=0x7fa49c009bd0 comp rx=0 tx=0).stop 2023-11-08T19:24:40.484 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.479+0000 7fa4b1a5a700 1 -- 172.21.15.149:0/2387862797 shutdown_connections 2023-11-08T19:24:40.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.479+0000 7fa4b1a5a700 1 --2- 172.21.15.149:0/2387862797 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4ac15de90 0x7fa4ac0b40d0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:40.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.479+0000 7fa4b1a5a700 1 --2- 172.21.15.149:0/2387862797 >> v2:172.21.15.160:3300/0 conn(0x7fa4ac15eff0 0x7fa4ac0cfa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:40.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.479+0000 7fa4b1a5a700 1 -- 172.21.15.149:0/2387862797 >> 172.21.15.149:0/2387862797 conn(0x7fa4ac06afa0 msgr2=0x7fa4ac06b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:40.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.479+0000 7fa4b1a5a700 1 -- 172.21.15.149:0/2387862797 shutdown_connections 2023-11-08T19:24:40.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.479+0000 7fa4b1a5a700 1 -- 172.21.15.149:0/2387862797 wait complete. 2023-11-08T19:24:40.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.480+0000 7fa4b1a5a700 1 Processor -- start 2023-11-08T19:24:40.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.480+0000 7fa4b1a5a700 1 -- start start 2023-11-08T19:24:40.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.481+0000 7fa4b1a5a700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa4ac0cff60 0x7fa4ac0c24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:40.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.481+0000 7fa4b1a5a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa4ac15de90 0x7fa4ac158560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:40.490 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.481+0000 7fa4b1a5a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4ac15eff0 0x7fa4ac158aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:40.490 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.481+0000 7fa4b1a5a700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ac0affa0 con 0x7fa4ac15eff0 2023-11-08T19:24:40.490 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.481+0000 7fa4b1a5a700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ac097b00 con 0x7fa4ac15de90 2023-11-08T19:24:40.490 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.481+0000 7fa4b1a5a700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ac097de0 con 0x7fa4ac0cff60 2023-11-08T19:24:40.490 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.481+0000 7fa4ab7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4ac15eff0 0x7fa4ac158aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:40.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.481+0000 7fa4ab7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4ac15eff0 0x7fa4ac158aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39918/0 (socket says 172.21.15.149:39918) 2023-11-08T19:24:40.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.481+0000 7fa4ab7fe700 1 -- 172.21.15.149:0/1313080945 learned_addr learned my addr 172.21.15.149:0/1313080945 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:40.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.481+0000 7fa4ab7fe700 1 -- 172.21.15.149:0/1313080945 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa4ac0cff60 msgr2=0x7fa4ac0c24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:40.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.481+0000 7fa4ab7fe700 1 --2- 172.21.15.149:0/1313080945 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa4ac0cff60 0x7fa4ac0c24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:40.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.481+0000 7fa4aa7fc700 1 --2- 172.21.15.149:0/1313080945 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa4ac15de90 0x7fa4ac158560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:40.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.481+0000 7fa4ab7fe700 1 -- 172.21.15.149:0/1313080945 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa4ac15de90 msgr2=0x7fa4ac158560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:40.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.481+0000 7fa4ab7fe700 1 --2- 172.21.15.149:0/1313080945 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa4ac15de90 0x7fa4ac158560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:40.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.481+0000 7fa4ab7fe700 1 -- 172.21.15.149:0/1313080945 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa49c009550 con 0x7fa4ac15eff0 2023-11-08T19:24:40.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.481+0000 7fa4ab7fe700 1 --2- 172.21.15.149:0/1313080945 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4ac15eff0 0x7fa4ac158aa0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fa4a400cc10 tx=0x7fa4a400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:40.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.482+0000 7fa493fff700 1 -- 172.21.15.149:0/1313080945 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a400abb0 con 0x7fa4ac15eff0 2023-11-08T19:24:40.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.482+0000 7fa493fff700 1 -- 172.21.15.149:0/1313080945 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4a400ad10 con 0x7fa4ac15eff0 2023-11-08T19:24:40.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.482+0000 7fa4b1a5a700 1 -- 172.21.15.149:0/1313080945 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4ac0980c0 con 0x7fa4ac15eff0 2023-11-08T19:24:40.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.482+0000 7fa493fff700 1 -- 172.21.15.149:0/1313080945 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a4012660 con 0x7fa4ac15eff0 2023-11-08T19:24:40.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.482+0000 7fa4b1a5a700 1 -- 172.21.15.149:0/1313080945 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4ac0c2a20 con 0x7fa4ac15eff0 2023-11-08T19:24:40.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.483+0000 7fa4b1a5a700 1 -- 172.21.15.149:0/1313080945 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4ac0745f0 con 0x7fa4ac15eff0 2023-11-08T19:24:40.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.483+0000 7fa493fff700 1 -- 172.21.15.149:0/1313080945 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa4a40127c0 con 0x7fa4ac15eff0 2023-11-08T19:24:40.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.483+0000 7fa493fff700 1 --2- 172.21.15.149:0/1313080945 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa49806af00 0x7fa49806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:40.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.483+0000 7fa493fff700 1 -- 172.21.15.149:0/1313080945 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6468+0+0 (secure 0 0 0) 0x7fa4a4089fb0 con 0x7fa4ac15eff0 2023-11-08T19:24:40.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.483+0000 7fa4aaffd700 1 --2- 172.21.15.149:0/1313080945 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa49806af00 0x7fa49806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:40.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.484+0000 7fa4aaffd700 1 --2- 172.21.15.149:0/1313080945 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa49806af00 0x7fa49806d3c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa49c000c00 tx=0x7fa49c010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:40.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.488+0000 7fa493fff700 1 -- 172.21.15.149:0/1313080945 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa4a40bcca0 con 0x7fa4ac15eff0 2023-11-08T19:24:40.679 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:40.678+0000 7fa4b1a5a700 1 -- 172.21.15.149:0/1313080945 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa4ac0c9990 con 0x7fa4ac15eff0 2023-11-08T19:24:41.295 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.294+0000 7fa493fff700 1 -- 172.21.15.149:0/1313080945 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v45) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa4a4016070 con 0x7fa4ac15eff0 2023-11-08T19:24:41.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.298+0000 7fa4b1a5a700 1 -- 172.21.15.149:0/1313080945 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa49806af00 msgr2=0x7fa49806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:41.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.298+0000 7fa4b1a5a700 1 --2- 172.21.15.149:0/1313080945 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa49806af00 0x7fa49806d3c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa49c000c00 tx=0x7fa49c010000 comp rx=0 tx=0).stop 2023-11-08T19:24:41.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.298+0000 7fa4b1a5a700 1 -- 172.21.15.149:0/1313080945 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4ac15eff0 msgr2=0x7fa4ac158aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:41.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.298+0000 7fa4b1a5a700 1 --2- 172.21.15.149:0/1313080945 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4ac15eff0 0x7fa4ac158aa0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fa4a400cc10 tx=0x7fa4a400a060 comp rx=0 tx=0).stop 2023-11-08T19:24:41.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.298+0000 7fa4b1a5a700 1 -- 172.21.15.149:0/1313080945 shutdown_connections 2023-11-08T19:24:41.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.298+0000 7fa4b1a5a700 1 --2- 172.21.15.149:0/1313080945 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa49806af00 0x7fa49806d3c0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:41.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.298+0000 7fa4b1a5a700 1 --2- 172.21.15.149:0/1313080945 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4ac15eff0 0x7fa4ac158aa0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:41.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.298+0000 7fa4b1a5a700 1 --2- 172.21.15.149:0/1313080945 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa4ac0cff60 0x7fa4ac0c24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:41.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.298+0000 7fa4b1a5a700 1 --2- 172.21.15.149:0/1313080945 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa4ac15de90 0x7fa4ac158560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:41.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.298+0000 7fa4b1a5a700 1 -- 172.21.15.149:0/1313080945 >> 172.21.15.149:0/1313080945 conn(0x7fa4ac06afa0 msgr2=0x7fa4ac0ad9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:41.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.298+0000 7fa4b1a5a700 1 -- 172.21.15.149:0/1313080945 shutdown_connections 2023-11-08T19:24:41.302 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.298+0000 7fa4b1a5a700 1 -- 172.21.15.149:0/1313080945 wait complete. 2023-11-08T19:24:41.302 INFO:teuthology.orchestra.run.smithi149.stderr:pool 'cephfs_metadata' removed 2023-11-08T19:24:41.314 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-08T19:24:41.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.440+0000 7f5ff1b15700 1 Processor -- start 2023-11-08T19:24:41.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.440+0000 7f5ff1b15700 1 -- start start 2023-11-08T19:24:41.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.441+0000 7f5ff1b15700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5fec15a870 0x7f5fec0cbd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:41.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.442+0000 7f5ff1b15700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fec15ac50 con 0x7f5fec0b27f0 2023-11-08T19:24:41.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.442+0000 7f5ff1b15700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fec06fe40 con 0x7f5fec072a40 2023-11-08T19:24:41.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.442+0000 7f5ff1b15700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fec0d02b0 con 0x7f5fec15a870 2023-11-08T19:24:41.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.442+0000 7f5febfff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f5fec0b27f0 0x7f5fec15b0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:41928/0 (socket says 172.21.15.149:41928) 2023-11-08T19:24:41.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.442+0000 7f5febfff700 1 -- 172.21.15.149:0/2514020130 learned_addr learned my addr 172.21.15.149:0/2514020130 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:24:41.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.442+0000 7f5fea7fc700 1 -- 172.21.15.149:0/2514020130 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2959276768 0 0) 0x7f5fec15ac50 con 0x7f5fec0b27f0 2023-11-08T19:24:41.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.442+0000 7f5fea7fc700 1 -- 172.21.15.149:0/2514020130 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fd40035b0 con 0x7f5fec0b27f0 2023-11-08T19:24:41.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.442+0000 7f5feb7fe700 1 --2- 172.21.15.149:0/2514020130 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5fec15a870 0x7f5fec0cbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:41.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.442+0000 7f5fea7fc700 1 -- 172.21.15.149:0/2514020130 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2757932162 0 0) 0x7f5fd40035b0 con 0x7f5fec0b27f0 2023-11-08T19:24:41.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.442+0000 7f5fea7fc700 1 -- 172.21.15.149:0/2514020130 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5fec15a870 msgr2=0x7f5fec0cbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:41.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.442+0000 7f5fea7fc700 1 --2- 172.21.15.149:0/2514020130 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5fec15a870 0x7f5fec0cbd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:41.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.442+0000 7f5fea7fc700 1 -- 172.21.15.149:0/2514020130 >> v1:172.21.15.160:6789/0 conn(0x7f5fec072a40 legacy=0x7f5fec0b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:41.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.442+0000 7f5fea7fc700 1 -- 172.21.15.149:0/2514020130 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fec070120 con 0x7f5fec0b27f0 2023-11-08T19:24:41.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.442+0000 7f5fea7fc700 1 -- 172.21.15.149:0/2514020130 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f5fe40019f0 con 0x7f5fec0b27f0 2023-11-08T19:24:41.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.442+0000 7f5fea7fc700 1 -- 172.21.15.149:0/2514020130 >> v1:172.21.15.149:6789/0 conn(0x7f5fec0b27f0 legacy=0x7f5fec15b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:41.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.442+0000 7f5fea7fc700 1 --2- 172.21.15.149:0/2514020130 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5fec15a870 0x7f5fd4003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:41.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.442+0000 7f5fea7fc700 1 --2- 172.21.15.149:0/2514020130 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5fd4004060 0x7f5fd4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:41.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.442+0000 7f5fea7fc700 1 --2- 172.21.15.149:0/2514020130 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5fd4004d90 0x7f5fd4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:41.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.442+0000 7f5fea7fc700 1 -- 172.21.15.149:0/2514020130 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd400bc20 con 0x7f5fd4004d90 2023-11-08T19:24:41.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.442+0000 7f5fea7fc700 1 -- 172.21.15.149:0/2514020130 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd400bd90 con 0x7f5fd4004060 2023-11-08T19:24:41.450 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.442+0000 7f5fea7fc700 1 -- 172.21.15.149:0/2514020130 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd400bf50 con 0x7f5fec15a870 2023-11-08T19:24:41.450 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.442+0000 7f5febfff700 1 --2- 172.21.15.149:0/2514020130 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5fd4004d90 0x7f5fd4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:41.450 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.442+0000 7f5feb7fe700 1 --2- 172.21.15.149:0/2514020130 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5fec15a870 0x7f5fd4003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:41.450 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.442+0000 7f5feaffd700 1 --2- 172.21.15.149:0/2514020130 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5fd4004060 0x7f5fd4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:41.450 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.443+0000 7f5febfff700 1 -- 172.21.15.149:0/2514020130 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5fec15a870 msgr2=0x7f5fd4003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:41.451 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.443+0000 7f5febfff700 1 --2- 172.21.15.149:0/2514020130 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5fec15a870 0x7f5fd4003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:41.451 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.443+0000 7f5febfff700 1 -- 172.21.15.149:0/2514020130 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5fd4004060 msgr2=0x7f5fd4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:41.451 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.443+0000 7f5febfff700 1 --2- 172.21.15.149:0/2514020130 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5fd4004060 0x7f5fd4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:41.451 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.443+0000 7f5febfff700 1 -- 172.21.15.149:0/2514020130 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd40035b0 con 0x7f5fd4004d90 2023-11-08T19:24:41.451 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.443+0000 7f5febfff700 1 --2- 172.21.15.149:0/2514020130 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5fd4004d90 0x7f5fd4005210 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f5fe400a7f0 tx=0x7f5fd4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3d4ac4d0fa89f08 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:41.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.443+0000 7f5fea7fc700 1 -- 172.21.15.149:0/2514020130 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe400a2f0 con 0x7f5fd4004d90 2023-11-08T19:24:41.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.443+0000 7f5fea7fc700 1 -- 172.21.15.149:0/2514020130 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe4012620 con 0x7f5fd4004d90 2023-11-08T19:24:41.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.443+0000 7f5fea7fc700 1 -- 172.21.15.149:0/2514020130 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe40129d0 con 0x7f5fd4004d90 2023-11-08T19:24:41.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.443+0000 7f5ff1b15700 1 -- 172.21.15.149:0/2514020130 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5fd4004d90 msgr2=0x7f5fd4005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:41.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.443+0000 7f5ff1b15700 1 --2- 172.21.15.149:0/2514020130 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5fd4004d90 0x7f5fd4005210 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f5fe400a7f0 tx=0x7f5fd4005880 comp rx=0 tx=0).stop 2023-11-08T19:24:41.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.443+0000 7f5febfff700 1 -- 172.21.15.149:0/2514020130 reap_dead start 2023-11-08T19:24:41.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.444+0000 7f5ff1b15700 1 -- 172.21.15.149:0/2514020130 shutdown_connections 2023-11-08T19:24:41.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.444+0000 7f5ff1b15700 1 -- 172.21.15.149:0/2514020130 >> 172.21.15.149:0/2514020130 conn(0x7f5fec0cd0e0 msgr2=0x7f5fec0cd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:41.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.444+0000 7f5ff1b15700 1 -- 172.21.15.149:0/2514020130 shutdown_connections 2023-11-08T19:24:41.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.444+0000 7f5ff1b15700 1 -- 172.21.15.149:0/2514020130 wait complete. 2023-11-08T19:24:41.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.445+0000 7f5ff1b15700 1 Processor -- start 2023-11-08T19:24:41.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.445+0000 7f5ff1b15700 1 -- start start 2023-11-08T19:24:41.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.446+0000 7f5ff1b15700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5fec1e7aa0 0x7f5fec0ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:41.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.446+0000 7f5ff1b15700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5fec159ad0 0x7f5fec0c9a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:41.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.446+0000 7f5ff1b15700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5fec0c9f60 0x7f5fec0ca3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:41.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.446+0000 7f5ff1b15700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fec158be0 con 0x7f5fec159ad0 2023-11-08T19:24:41.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.446+0000 7f5ff1b15700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fec15a120 con 0x7f5fec0c9f60 2023-11-08T19:24:41.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.446+0000 7f5ff1b15700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fec1e7e80 con 0x7f5fec1e7aa0 2023-11-08T19:24:41.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.446+0000 7f5feaffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5fec159ad0 0x7f5fec0c9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:41.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.446+0000 7f5feaffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5fec159ad0 0x7f5fec0c9a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39938/0 (socket says 172.21.15.149:39938) 2023-11-08T19:24:41.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.446+0000 7f5feaffd700 1 -- 172.21.15.149:0/2851028456 learned_addr learned my addr 172.21.15.149:0/2851028456 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:41.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.446+0000 7f5febfff700 1 --2- 172.21.15.149:0/2851028456 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5fec0c9f60 0x7f5fec0ca3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:41.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.446+0000 7f5feb7fe700 1 --2- 172.21.15.149:0/2851028456 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5fec1e7aa0 0x7f5fec0ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:41.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.446+0000 7f5feaffd700 1 -- 172.21.15.149:0/2851028456 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5fec1e7aa0 msgr2=0x7f5fec0ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:41.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.446+0000 7f5feaffd700 1 --2- 172.21.15.149:0/2851028456 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5fec1e7aa0 0x7f5fec0ac8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:41.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.446+0000 7f5feaffd700 1 -- 172.21.15.149:0/2851028456 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5fec0c9f60 msgr2=0x7f5fec0ca3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:41.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.446+0000 7f5feaffd700 1 --2- 172.21.15.149:0/2851028456 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5fec0c9f60 0x7f5fec0ca3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:41.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.446+0000 7f5feaffd700 1 -- 172.21.15.149:0/2851028456 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fec0c7860 con 0x7f5fec159ad0 2023-11-08T19:24:41.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.446+0000 7f5febfff700 1 --2- 172.21.15.149:0/2851028456 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5fec0c9f60 0x7f5fec0ca3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:24:41.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.446+0000 7f5feb7fe700 1 --2- 172.21.15.149:0/2851028456 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5fec1e7aa0 0x7f5fec0ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:24:41.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.446+0000 7f5feaffd700 1 --2- 172.21.15.149:0/2851028456 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5fec159ad0 0x7f5fec0c9a20 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc00f7f0 tx=0x7f5fdc00fbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:41.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.446+0000 7f5fd3fff700 1 -- 172.21.15.149:0/2851028456 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fdc0052e0 con 0x7f5fec159ad0 2023-11-08T19:24:41.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.446+0000 7f5fd3fff700 1 -- 172.21.15.149:0/2851028456 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fdc005440 con 0x7f5fec159ad0 2023-11-08T19:24:41.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.446+0000 7f5ff1b15700 1 -- 172.21.15.149:0/2851028456 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fec0c7b40 con 0x7f5fec159ad0 2023-11-08T19:24:41.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.446+0000 7f5fd3fff700 1 -- 172.21.15.149:0/2851028456 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fdc0038c0 con 0x7f5fec159ad0 2023-11-08T19:24:41.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.446+0000 7f5ff1b15700 1 -- 172.21.15.149:0/2851028456 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fec1f6cf0 con 0x7f5fec159ad0 2023-11-08T19:24:41.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.447+0000 7f5ff1b15700 1 -- 172.21.15.149:0/2851028456 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fec0c93a0 con 0x7f5fec159ad0 2023-11-08T19:24:41.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.448+0000 7f5fd3fff700 1 -- 172.21.15.149:0/2851028456 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5fdc003a20 con 0x7f5fec159ad0 2023-11-08T19:24:41.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.448+0000 7f5fd3fff700 1 --2- 172.21.15.149:0/2851028456 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5fd806af00 0x7f5fd806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:41.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.448+0000 7f5fd3fff700 1 -- 172.21.15.149:0/2851028456 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6030+0+0 (secure 0 0 0) 0x7f5fdc0894a0 con 0x7f5fec159ad0 2023-11-08T19:24:41.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.448+0000 7f5feb7fe700 1 --2- 172.21.15.149:0/2851028456 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5fd806af00 0x7f5fd806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:41.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.449+0000 7f5feb7fe700 1 --2- 172.21.15.149:0/2851028456 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5fd806af00 0x7f5fd806d3c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5fe0009940 tx=0x7f5fe0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:41.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.453+0000 7f5fd3fff700 1 -- 172.21.15.149:0/2851028456 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5fdc0544a0 con 0x7f5fec159ad0 2023-11-08T19:24:41.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:41.644+0000 7f5ff1b15700 1 -- 172.21.15.149:0/2851028456 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5fec0745f0 con 0x7f5fec159ad0 2023-11-08T19:24:42.302 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.300+0000 7f5fd3fff700 1 -- 172.21.15.149:0/2851028456 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v46) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5fdc057ac0 con 0x7f5fec159ad0 2023-11-08T19:24:42.304 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.303+0000 7f5ff1b15700 1 -- 172.21.15.149:0/2851028456 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5fd806af00 msgr2=0x7f5fd806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:42.305 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.303+0000 7f5ff1b15700 1 --2- 172.21.15.149:0/2851028456 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5fd806af00 0x7f5fd806d3c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5fe0009940 tx=0x7f5fe0008040 comp rx=0 tx=0).stop 2023-11-08T19:24:42.305 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.303+0000 7f5ff1b15700 1 -- 172.21.15.149:0/2851028456 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5fec159ad0 msgr2=0x7f5fec0c9a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:42.305 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.303+0000 7f5ff1b15700 1 --2- 172.21.15.149:0/2851028456 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5fec159ad0 0x7f5fec0c9a20 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc00f7f0 tx=0x7f5fdc00fbb0 comp rx=0 tx=0).stop 2023-11-08T19:24:42.305 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.303+0000 7f5ff1b15700 1 -- 172.21.15.149:0/2851028456 shutdown_connections 2023-11-08T19:24:42.305 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.303+0000 7f5ff1b15700 1 --2- 172.21.15.149:0/2851028456 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5fd806af00 0x7f5fd806d3c0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:42.306 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.303+0000 7f5ff1b15700 1 --2- 172.21.15.149:0/2851028456 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5fec0c9f60 0x7f5fec0ca3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:42.306 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.303+0000 7f5ff1b15700 1 --2- 172.21.15.149:0/2851028456 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5fec1e7aa0 0x7f5fec0ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:42.306 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.303+0000 7f5ff1b15700 1 --2- 172.21.15.149:0/2851028456 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5fec159ad0 0x7f5fec0c9a20 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:42.306 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.303+0000 7f5ff1b15700 1 -- 172.21.15.149:0/2851028456 >> 172.21.15.149:0/2851028456 conn(0x7f5fec0cd0e0 msgr2=0x7f5fec0b00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:42.307 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.303+0000 7f5ff1b15700 1 -- 172.21.15.149:0/2851028456 shutdown_connections 2023-11-08T19:24:42.307 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.303+0000 7f5ff1b15700 1 -- 172.21.15.149:0/2851028456 wait complete. 2023-11-08T19:24:42.307 INFO:teuthology.orchestra.run.smithi149.stderr:pool 'cephfs_data' removed 2023-11-08T19:24:42.318 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-08T19:24:42.443 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.442+0000 7f82ab4d7700 1 Processor -- start 2023-11-08T19:24:42.443 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.442+0000 7f82ab4d7700 1 -- start start 2023-11-08T19:24:42.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.443+0000 7f82ab4d7700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f82a40cb660 0x7f82a40ce540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:42.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.443+0000 7f82ab4d7700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82a415e320 con 0x7f82a415df40 2023-11-08T19:24:42.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.443+0000 7f82ab4d7700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82a406b020 con 0x7f82a406ab80 2023-11-08T19:24:42.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.443+0000 7f82ab4d7700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82a406b2e0 con 0x7f82a40cb660 2023-11-08T19:24:42.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.443+0000 7f82a9273700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f82a415df40 0x7f82a406c0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:41944/0 (socket says 172.21.15.149:41944) 2023-11-08T19:24:42.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.443+0000 7f82a9a74700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f82a40cb660 0x7f82a40ce540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:42.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.443+0000 7f82a9273700 1 -- 172.21.15.149:0/435681720 learned_addr learned my addr 172.21.15.149:0/435681720 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:24:42.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.443+0000 7f82a9a74700 1 -- 172.21.15.149:0/435681720 >> v1:172.21.15.160:6789/0 conn(0x7f82a406ab80 legacy=0x7f82a40caf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:42.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.443+0000 7f82a9a74700 1 -- 172.21.15.149:0/435681720 >> v1:172.21.15.149:6789/0 conn(0x7f82a415df40 legacy=0x7f82a406c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:42.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.443+0000 7f829bfff700 1 -- 172.21.15.149:0/435681720 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3227025336 0 0) 0x7f82a415e320 con 0x7f82a415df40 2023-11-08T19:24:42.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.443+0000 7f82a9a74700 1 -- 172.21.15.149:0/435681720 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82a406b5c0 con 0x7f82a40cb660 2023-11-08T19:24:42.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.443+0000 7f82a9a74700 1 --2- 172.21.15.149:0/435681720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82a40cb660 0x7f82a40ce540 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f829c009d90 tx=0x7f829c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8354589e1ff7837 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:42.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.444+0000 7f829bfff700 1 -- 172.21.15.149:0/435681720 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829c00e070 con 0x7f82a40cb660 2023-11-08T19:24:42.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.444+0000 7f829bfff700 1 -- 172.21.15.149:0/435681720 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f829c00bb90 con 0x7f82a40cb660 2023-11-08T19:24:42.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.444+0000 7f829bfff700 1 -- 172.21.15.149:0/435681720 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829c003a20 con 0x7f82a40cb660 2023-11-08T19:24:42.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.444+0000 7f82ab4d7700 1 -- 172.21.15.149:0/435681720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82a40cb660 msgr2=0x7f82a40ce540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:42.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.444+0000 7f82ab4d7700 1 --2- 172.21.15.149:0/435681720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82a40cb660 0x7f82a40ce540 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f829c009d90 tx=0x7f829c00b330 comp rx=0 tx=0).stop 2023-11-08T19:24:42.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.444+0000 7f82ab4d7700 1 -- 172.21.15.149:0/435681720 shutdown_connections 2023-11-08T19:24:42.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.444+0000 7f82ab4d7700 1 --2- 172.21.15.149:0/435681720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82a40cb660 0x7f82a40ce540 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:42.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.444+0000 7f82ab4d7700 1 -- 172.21.15.149:0/435681720 >> 172.21.15.149:0/435681720 conn(0x7f82a40d0640 msgr2=0x7f82a40d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:42.450 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.444+0000 7f82ab4d7700 1 -- 172.21.15.149:0/435681720 shutdown_connections 2023-11-08T19:24:42.450 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.444+0000 7f82ab4d7700 1 -- 172.21.15.149:0/435681720 wait complete. 2023-11-08T19:24:42.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.445+0000 7f82ab4d7700 1 Processor -- start 2023-11-08T19:24:42.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.445+0000 7f82ab4d7700 1 -- start start 2023-11-08T19:24:42.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.446+0000 7f82ab4d7700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82a406ab80 0x7f82a414fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:42.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.446+0000 7f82ab4d7700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f82a40cb660 0x7f82a40b12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:42.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.446+0000 7f82ab4d7700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f82a415df40 0x7f82a40b17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:42.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.446+0000 7f82ab4d7700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a41501a0 con 0x7f82a406ab80 2023-11-08T19:24:42.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.446+0000 7f82ab4d7700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a40ae5b0 con 0x7f82a40cb660 2023-11-08T19:24:42.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.446+0000 7f82ab4d7700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82a40ae890 con 0x7f82a415df40 2023-11-08T19:24:42.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.446+0000 7f82a9273700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82a406ab80 0x7f82a414fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:42.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.446+0000 7f82a9273700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82a406ab80 0x7f82a414fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39948/0 (socket says 172.21.15.149:39948) 2023-11-08T19:24:42.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.446+0000 7f82a9273700 1 -- 172.21.15.149:0/3515558820 learned_addr learned my addr 172.21.15.149:0/3515558820 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:42.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.446+0000 7f82a8a72700 1 --2- 172.21.15.149:0/3515558820 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f82a40cb660 0x7f82a40b12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:42.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.447+0000 7f82a9a74700 1 --2- 172.21.15.149:0/3515558820 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f82a415df40 0x7f82a40b17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:42.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.447+0000 7f82a9273700 1 -- 172.21.15.149:0/3515558820 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f82a415df40 msgr2=0x7f82a40b17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:42.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.447+0000 7f82a9273700 1 --2- 172.21.15.149:0/3515558820 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f82a415df40 0x7f82a40b17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:42.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.447+0000 7f82a9273700 1 -- 172.21.15.149:0/3515558820 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f82a40cb660 msgr2=0x7f82a40b12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:42.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.447+0000 7f82a9273700 1 --2- 172.21.15.149:0/3515558820 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f82a40cb660 0x7f82a40b12a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:42.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.447+0000 7f82a9273700 1 -- 172.21.15.149:0/3515558820 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f829c009a70 con 0x7f82a406ab80 2023-11-08T19:24:42.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.447+0000 7f82a9273700 1 --2- 172.21.15.149:0/3515558820 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82a406ab80 0x7f82a414fc60 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f82a000c550 tx=0x7f82a000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:42.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.447+0000 7f8299ffb700 1 -- 172.21.15.149:0/3515558820 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a0004c80 con 0x7f82a406ab80 2023-11-08T19:24:42.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.447+0000 7f8299ffb700 1 -- 172.21.15.149:0/3515558820 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82a0004e00 con 0x7f82a406ab80 2023-11-08T19:24:42.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.447+0000 7f8299ffb700 1 -- 172.21.15.149:0/3515558820 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a0007310 con 0x7f82a406ab80 2023-11-08T19:24:42.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.447+0000 7f82ab4d7700 1 -- 172.21.15.149:0/3515558820 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82a40aeb70 con 0x7f82a406ab80 2023-11-08T19:24:42.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.447+0000 7f82ab4d7700 1 -- 172.21.15.149:0/3515558820 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82a40af130 con 0x7f82a406ab80 2023-11-08T19:24:42.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.448+0000 7f82ab4d7700 1 -- 172.21.15.149:0/3515558820 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82a40af350 con 0x7f82a406ab80 2023-11-08T19:24:42.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.448+0000 7f8299ffb700 1 -- 172.21.15.149:0/3515558820 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f82a0007470 con 0x7f82a406ab80 2023-11-08T19:24:42.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.449+0000 7f8299ffb700 1 --2- 172.21.15.149:0/3515558820 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f828806af00 0x7f828806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:42.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.449+0000 7f8299ffb700 1 -- 172.21.15.149:0/3515558820 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f82a0089250 con 0x7f82a406ab80 2023-11-08T19:24:42.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.449+0000 7f82a8a72700 1 --2- 172.21.15.149:0/3515558820 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f828806af00 0x7f828806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:42.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.449+0000 7f82a8a72700 1 --2- 172.21.15.149:0/3515558820 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f828806af00 0x7f828806d3c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8294003e60 tx=0x7f8294009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:42.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.453+0000 7f8299ffb700 1 -- 172.21.15.149:0/3515558820 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f82a0054360 con 0x7f82a406ab80 2023-11-08T19:24:42.647 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.646+0000 7f82ab4d7700 1 -- 172.21.15.149:0/3515558820 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f82a404f730 con 0x7f82a406ab80 2023-11-08T19:24:42.650 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.649+0000 7f8299ffb700 1 -- 172.21.15.149:0/3515558820 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v12) v1 ==== 104+0+0 (secure 0 0 0) 0x7f82a0057980 con 0x7f82a406ab80 2023-11-08T19:24:42.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.651+0000 7f82ab4d7700 1 -- 172.21.15.149:0/3515558820 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f828806af00 msgr2=0x7f828806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:42.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.651+0000 7f82ab4d7700 1 --2- 172.21.15.149:0/3515558820 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f828806af00 0x7f828806d3c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8294003e60 tx=0x7f8294009040 comp rx=0 tx=0).stop 2023-11-08T19:24:42.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.651+0000 7f82ab4d7700 1 -- 172.21.15.149:0/3515558820 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82a406ab80 msgr2=0x7f82a414fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:42.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.651+0000 7f82ab4d7700 1 --2- 172.21.15.149:0/3515558820 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82a406ab80 0x7f82a414fc60 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f82a000c550 tx=0x7f82a000c910 comp rx=0 tx=0).stop 2023-11-08T19:24:42.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.652+0000 7f82ab4d7700 1 -- 172.21.15.149:0/3515558820 shutdown_connections 2023-11-08T19:24:42.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.652+0000 7f82ab4d7700 1 --2- 172.21.15.149:0/3515558820 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f828806af00 0x7f828806d3c0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:42.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.652+0000 7f82ab4d7700 1 --2- 172.21.15.149:0/3515558820 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f82a415df40 0x7f82a40b17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:42.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.652+0000 7f82ab4d7700 1 --2- 172.21.15.149:0/3515558820 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82a406ab80 0x7f82a414fc60 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:42.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.652+0000 7f82ab4d7700 1 --2- 172.21.15.149:0/3515558820 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f82a40cb660 0x7f82a40b12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:42.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.652+0000 7f82ab4d7700 1 -- 172.21.15.149:0/3515558820 >> 172.21.15.149:0/3515558820 conn(0x7f82a40d0640 msgr2=0x7f82a40b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:42.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.652+0000 7f82ab4d7700 1 -- 172.21.15.149:0/3515558820 shutdown_connections 2023-11-08T19:24:42.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.652+0000 7f82ab4d7700 1 -- 172.21.15.149:0/3515558820 wait complete. 2023-11-08T19:24:42.665 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_attaching_pools_with_snaps_to_fs_fails' 2023-11-08T19:24:42.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.785+0000 7f15a4b85700 1 Processor -- start 2023-11-08T19:24:42.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.785+0000 7f15a4b85700 1 -- start start 2023-11-08T19:24:42.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.786+0000 7f15a4b85700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f15a00cc140 0x7f15a00cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:42.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.786+0000 7f15a4b85700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f15a00b2cd0 0x7f15a015d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:42.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.786+0000 7f15a4b85700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15a00cce50 con 0x7f15a00b2850 2023-11-08T19:24:42.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.786+0000 7f15a4b85700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15a00b2430 con 0x7f15a00b2cd0 2023-11-08T19:24:42.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.786+0000 7f15a4b85700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15a00cc520 con 0x7f15a00cc140 2023-11-08T19:24:42.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.787+0000 7f159ed9d700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f15a00b2cd0 0x7f15a015d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:42.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.787+0000 7f159e59c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f15a00cc140 0x7f15a00cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:42.791 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.787+0000 7f159ed9d700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f15a00b2cd0 0x7f15a015d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.149:40952/0 (socket says 172.21.15.149:40952) 2023-11-08T19:24:42.791 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.787+0000 7f159ed9d700 1 -- 172.21.15.149:0/3176199531 learned_addr learned my addr 172.21.15.149:0/3176199531 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:42.791 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.787+0000 7f159e59c700 1 -- 172.21.15.149:0/3176199531 >> v2:172.21.15.160:3300/0 conn(0x7f15a00b2cd0 msgr2=0x7f15a015d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:42.791 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.787+0000 7f159e59c700 1 --2- 172.21.15.149:0/3176199531 >> v2:172.21.15.160:3300/0 conn(0x7f15a00b2cd0 0x7f15a015d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:42.792 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.787+0000 7f159e59c700 1 -- 172.21.15.149:0/3176199531 >> v1:172.21.15.160:6789/0 conn(0x7f15a00b2850 legacy=0x7f15a00cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:42.792 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.787+0000 7f159e59c700 1 -- 172.21.15.149:0/3176199531 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a00b17b0 con 0x7f15a00cc140 2023-11-08T19:24:42.792 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.787+0000 7f159e59c700 1 --2- 172.21.15.149:0/3176199531 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f15a00cc140 0x7f15a00cc910 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1594009820 tx=0x7f1594009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e66d40110360f669 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:42.792 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.787+0000 7f159d59a700 1 -- 172.21.15.149:0/3176199531 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1594005e30 con 0x7f15a00cc140 2023-11-08T19:24:42.792 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.787+0000 7f159d59a700 1 -- 172.21.15.149:0/3176199531 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1594006030 con 0x7f15a00cc140 2023-11-08T19:24:42.793 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.787+0000 7f159d59a700 1 -- 172.21.15.149:0/3176199531 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15940063c0 con 0x7f15a00cc140 2023-11-08T19:24:42.793 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.788+0000 7f15a4b85700 1 -- 172.21.15.149:0/3176199531 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f15a00cc140 msgr2=0x7f15a00cc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:42.793 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.788+0000 7f15a4b85700 1 --2- 172.21.15.149:0/3176199531 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f15a00cc140 0x7f15a00cc910 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1594009820 tx=0x7f1594009b30 comp rx=0 tx=0).stop 2023-11-08T19:24:42.793 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.788+0000 7f15a4b85700 1 -- 172.21.15.149:0/3176199531 shutdown_connections 2023-11-08T19:24:42.793 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.788+0000 7f15a4b85700 1 --2- 172.21.15.149:0/3176199531 >> v2:172.21.15.160:3300/0 conn(0x7f15a00b2cd0 0x7f15a015d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:42.793 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.788+0000 7f15a4b85700 1 --2- 172.21.15.149:0/3176199531 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f15a00cc140 0x7f15a00cc910 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:42.794 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.788+0000 7f15a4b85700 1 -- 172.21.15.149:0/3176199531 >> 172.21.15.149:0/3176199531 conn(0x7f15a0099a40 msgr2=0x7f15a00d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:42.794 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.788+0000 7f15a4b85700 1 -- 172.21.15.149:0/3176199531 shutdown_connections 2023-11-08T19:24:42.794 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.788+0000 7f15a4b85700 1 -- 172.21.15.149:0/3176199531 wait complete. 2023-11-08T19:24:42.797 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.790+0000 7f15a4b85700 1 Processor -- start 2023-11-08T19:24:42.797 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.790+0000 7f15a4b85700 1 -- start start 2023-11-08T19:24:42.798 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.791+0000 7f15a4b85700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15a00b2850 0x7f15a015ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:42.798 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.791+0000 7f15a4b85700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f15a00b2cd0 0x7f15a009a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:42.798 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.791+0000 7f15a4b85700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f15a00cc140 0x7f15a009c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:42.798 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.791+0000 7f15a4b85700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a009ad60 con 0x7f15a00b2850 2023-11-08T19:24:42.798 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.791+0000 7f15a4b85700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a009b040 con 0x7f15a00b2cd0 2023-11-08T19:24:42.799 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.791+0000 7f15a4b85700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15a009b320 con 0x7f15a00cc140 2023-11-08T19:24:42.799 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.791+0000 7f159e59c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15a00b2850 0x7f15a015ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:42.799 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.791+0000 7f159e59c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15a00b2850 0x7f15a015ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39962/0 (socket says 172.21.15.149:39962) 2023-11-08T19:24:42.799 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.791+0000 7f159e59c700 1 -- 172.21.15.149:0/2311598078 learned_addr learned my addr 172.21.15.149:0/2311598078 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:42.799 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.791+0000 7f159ed9d700 1 --2- 172.21.15.149:0/2311598078 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f15a00cc140 0x7f15a009c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:42.800 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.791+0000 7f159dd9b700 1 --2- 172.21.15.149:0/2311598078 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f15a00b2cd0 0x7f15a009a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:42.800 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.791+0000 7f159e59c700 1 -- 172.21.15.149:0/2311598078 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f15a00cc140 msgr2=0x7f15a009c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:42.800 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.791+0000 7f159e59c700 1 --2- 172.21.15.149:0/2311598078 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f15a00cc140 0x7f15a009c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:42.800 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.791+0000 7f159e59c700 1 -- 172.21.15.149:0/2311598078 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f15a00b2cd0 msgr2=0x7f15a009a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:42.800 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.791+0000 7f159e59c700 1 --2- 172.21.15.149:0/2311598078 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f15a00b2cd0 0x7f15a009a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:42.801 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.791+0000 7f159e59c700 1 -- 172.21.15.149:0/2311598078 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1594009430 con 0x7f15a00b2850 2023-11-08T19:24:42.801 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.791+0000 7f159ed9d700 1 --2- 172.21.15.149:0/2311598078 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f15a00cc140 0x7f15a009c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:24:42.801 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.791+0000 7f159e59c700 1 --2- 172.21.15.149:0/2311598078 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15a00b2850 0x7f15a015ebb0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f1594000c00 tx=0x7f1594004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:42.801 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.792+0000 7f158effd700 1 -- 172.21.15.149:0/2311598078 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15940063a0 con 0x7f15a00b2850 2023-11-08T19:24:42.801 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.792+0000 7f158effd700 1 -- 172.21.15.149:0/2311598078 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1594020070 con 0x7f15a00b2850 2023-11-08T19:24:42.802 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.792+0000 7f158effd700 1 -- 172.21.15.149:0/2311598078 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1594006760 con 0x7f15a00b2850 2023-11-08T19:24:42.802 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.792+0000 7f15a4b85700 1 -- 172.21.15.149:0/2311598078 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15a00ae390 con 0x7f15a00b2850 2023-11-08T19:24:42.802 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.792+0000 7f15a4b85700 1 -- 172.21.15.149:0/2311598078 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15a009a880 con 0x7f15a00b2850 2023-11-08T19:24:42.802 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.793+0000 7f15a4b85700 1 -- 172.21.15.149:0/2311598078 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15a00ae8b0 con 0x7f15a00b2850 2023-11-08T19:24:42.802 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.793+0000 7f158effd700 1 -- 172.21.15.149:0/2311598078 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1594022030 con 0x7f15a00b2850 2023-11-08T19:24:42.803 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.793+0000 7f158effd700 1 --2- 172.21.15.149:0/2311598078 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f158006af00 0x7f158006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:42.803 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.794+0000 7f158effd700 1 -- 172.21.15.149:0/2311598078 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f159408aaf0 con 0x7f15a00b2850 2023-11-08T19:24:42.803 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.794+0000 7f159dd9b700 1 --2- 172.21.15.149:0/2311598078 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f158006af00 0x7f158006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:42.803 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.794+0000 7f159dd9b700 1 --2- 172.21.15.149:0/2311598078 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f158006af00 0x7f158006d3c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f15a015f4a0 tx=0x7f1590009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:42.804 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:42.798+0000 7f158effd700 1 -- 172.21.15.149:0/2311598078 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f15a00ae8b0 con 0x7f15a00b2850 2023-11-08T19:24:43.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.064+0000 7f15a4b85700 1 -- 172.21.15.149:0/2311598078 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_attaching_pools_with_snaps_to_fs_fails"]} v 0) v1 -- 0x7f15a00ae8b0 con 0x7f15a00b2850 2023-11-08T19:24:43.303 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.302+0000 7f158effd700 1 -- 172.21.15.149:0/2311598078 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_attaching_pools_with_snaps_to_fs_fails"]}]=0 v115) v1 ==== 173+0+0 (secure 0 0 0) 0x7f1594055c90 con 0x7f15a00b2850 2023-11-08T19:24:43.306 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.304+0000 7f15a4b85700 1 -- 172.21.15.149:0/2311598078 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f158006af00 msgr2=0x7f158006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:43.306 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.304+0000 7f15a4b85700 1 --2- 172.21.15.149:0/2311598078 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f158006af00 0x7f158006d3c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f15a015f4a0 tx=0x7f1590009040 comp rx=0 tx=0).stop 2023-11-08T19:24:43.306 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.304+0000 7f15a4b85700 1 -- 172.21.15.149:0/2311598078 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15a00b2850 msgr2=0x7f15a015ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:43.306 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.304+0000 7f15a4b85700 1 --2- 172.21.15.149:0/2311598078 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15a00b2850 0x7f15a015ebb0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f1594000c00 tx=0x7f1594004750 comp rx=0 tx=0).stop 2023-11-08T19:24:43.307 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.304+0000 7f15a4b85700 1 -- 172.21.15.149:0/2311598078 shutdown_connections 2023-11-08T19:24:43.307 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.304+0000 7f15a4b85700 1 --2- 172.21.15.149:0/2311598078 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f158006af00 0x7f158006d3c0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:43.307 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.304+0000 7f15a4b85700 1 --2- 172.21.15.149:0/2311598078 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f15a00cc140 0x7f15a009c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:43.307 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.304+0000 7f15a4b85700 1 --2- 172.21.15.149:0/2311598078 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15a00b2850 0x7f15a015ebb0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:43.307 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.304+0000 7f15a4b85700 1 --2- 172.21.15.149:0/2311598078 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f15a00b2cd0 0x7f15a009a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:43.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.304+0000 7f15a4b85700 1 -- 172.21.15.149:0/2311598078 >> 172.21.15.149:0/2311598078 conn(0x7f15a0099a40 msgr2=0x7f15a00c7670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:43.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.305+0000 7f15a4b85700 1 -- 172.21.15.149:0/2311598078 shutdown_connections 2023-11-08T19:24:43.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.305+0000 7f15a4b85700 1 -- 172.21.15.149:0/2311598078 wait complete. 2023-11-08T19:24:43.319 INFO:tasks.cephfs_test_runner:Test that attempt to attach pool with snapshots to an fs fails ... ok 2023-11-08T19:24:43.319 INFO:tasks.cephfs_test_runner:Starting test: test_disallow_monitor_managed_snaps_for_fs_pools (tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools) Test that creation of monitor managed snaps fails for pools attached 2023-11-08T19:24:43.319 INFO:tasks.cephfs_test_runner:test_disallow_monitor_managed_snaps_for_fs_pools (tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools) 2023-11-08T19:24:43.320 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:24:43.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.440+0000 7f2758f29700 1 Processor -- start 2023-11-08T19:24:43.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.440+0000 7f2758f29700 1 -- start start 2023-11-08T19:24:43.444 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.441+0000 7f2758f29700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f275415b150 0x7f27540ccfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:43.444 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.441+0000 7f2758f29700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f27540b0ee0 0x7f27540b1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:43.444 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.441+0000 7f2758f29700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27540b1880 con 0x7f275415b530 2023-11-08T19:24:43.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.441+0000 7f2758f29700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27540ce3b0 con 0x7f27540b0ee0 2023-11-08T19:24:43.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.441+0000 7f2758f29700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27540cd5f0 con 0x7f275415b150 2023-11-08T19:24:43.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.441+0000 7f2752d9d700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f27540b0ee0 0x7f27540b1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:43.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.441+0000 7f275259c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f275415b150 0x7f27540ccfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:43.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.441+0000 7f2752d9d700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f27540b0ee0 0x7f27540b1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.149:40966/0 (socket says 172.21.15.149:40966) 2023-11-08T19:24:43.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.441+0000 7f2752d9d700 1 -- 172.21.15.149:0/1188205271 learned_addr learned my addr 172.21.15.149:0/1188205271 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:43.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.442+0000 7f275259c700 1 -- 172.21.15.149:0/1188205271 >> v2:172.21.15.160:3300/0 conn(0x7f27540b0ee0 msgr2=0x7f27540b1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:43.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.442+0000 7f275259c700 1 --2- 172.21.15.149:0/1188205271 >> v2:172.21.15.160:3300/0 conn(0x7f27540b0ee0 0x7f27540b1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:43.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.442+0000 7f275259c700 1 -- 172.21.15.149:0/1188205271 >> v1:172.21.15.160:6789/0 conn(0x7f275415b530 legacy=0x7f2754071f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:43.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.442+0000 7f275259c700 1 -- 172.21.15.149:0/1188205271 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27540cd8d0 con 0x7f275415b150 2023-11-08T19:24:43.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.442+0000 7f2752d9d700 1 --2- 172.21.15.149:0/1188205271 >> v2:172.21.15.160:3300/0 conn(0x7f27540b0ee0 0x7f27540b1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:24:43.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.442+0000 7f275259c700 1 --2- 172.21.15.149:0/1188205271 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f275415b150 0x7f27540ccfa0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2748009840 tx=0x7f2748009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2b34d8e4886c920 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:43.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.442+0000 7f275159a700 1 -- 172.21.15.149:0/1188205271 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2748011830 con 0x7f275415b150 2023-11-08T19:24:43.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.442+0000 7f275159a700 1 -- 172.21.15.149:0/1188205271 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2748011990 con 0x7f275415b150 2023-11-08T19:24:43.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.442+0000 7f275159a700 1 -- 172.21.15.149:0/1188205271 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2748011d20 con 0x7f275415b150 2023-11-08T19:24:43.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.443+0000 7f2758f29700 1 -- 172.21.15.149:0/1188205271 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f275415b150 msgr2=0x7f27540ccfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:43.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.443+0000 7f2758f29700 1 --2- 172.21.15.149:0/1188205271 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f275415b150 0x7f27540ccfa0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2748009840 tx=0x7f2748009b50 comp rx=0 tx=0).stop 2023-11-08T19:24:43.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.443+0000 7f2758f29700 1 -- 172.21.15.149:0/1188205271 shutdown_connections 2023-11-08T19:24:43.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.443+0000 7f2758f29700 1 --2- 172.21.15.149:0/1188205271 >> v2:172.21.15.160:3300/0 conn(0x7f27540b0ee0 0x7f27540b1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:43.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.443+0000 7f2758f29700 1 --2- 172.21.15.149:0/1188205271 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f275415b150 0x7f27540ccfa0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:43.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.443+0000 7f2758f29700 1 -- 172.21.15.149:0/1188205271 >> 172.21.15.149:0/1188205271 conn(0x7f275406b3d0 msgr2=0x7f27540cf460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:43.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.443+0000 7f2758f29700 1 -- 172.21.15.149:0/1188205271 shutdown_connections 2023-11-08T19:24:43.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.443+0000 7f2758f29700 1 -- 172.21.15.149:0/1188205271 wait complete. 2023-11-08T19:24:43.451 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.444+0000 7f2758f29700 1 Processor -- start 2023-11-08T19:24:43.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.444+0000 7f2758f29700 1 -- start start 2023-11-08T19:24:43.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.445+0000 7f2758f29700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f27540b0ee0 0x7f27541eeba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:43.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.445+0000 7f2758f29700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f275415b150 0x7f27540c64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:43.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.445+0000 7f2758f29700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f275415b530 0x7f27540c69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:43.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.445+0000 7f2758f29700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27540c5a30 con 0x7f27540b0ee0 2023-11-08T19:24:43.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.445+0000 7f2758f29700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2754141e90 con 0x7f275415b530 2023-11-08T19:24:43.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.445+0000 7f2758f29700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27541ef0e0 con 0x7f275415b150 2023-11-08T19:24:43.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.445+0000 7f275259c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f27540b0ee0 0x7f27541eeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:43.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.445+0000 7f275259c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f27540b0ee0 0x7f27541eeba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39976/0 (socket says 172.21.15.149:39976) 2023-11-08T19:24:43.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.445+0000 7f275259c700 1 -- 172.21.15.149:0/1776707435 learned_addr learned my addr 172.21.15.149:0/1776707435 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:43.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.445+0000 7f2751d9b700 1 --2- 172.21.15.149:0/1776707435 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f275415b150 0x7f27540c64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:43.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.445+0000 7f275259c700 1 -- 172.21.15.149:0/1776707435 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f275415b150 msgr2=0x7f27540c64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:43.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.445+0000 7f2752d9d700 1 --2- 172.21.15.149:0/1776707435 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f275415b530 0x7f27540c69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:43.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.445+0000 7f275259c700 1 --2- 172.21.15.149:0/1776707435 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f275415b150 0x7f27540c64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:43.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.445+0000 7f275259c700 1 -- 172.21.15.149:0/1776707435 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f275415b530 msgr2=0x7f27540c69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:43.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.445+0000 7f275259c700 1 --2- 172.21.15.149:0/1776707435 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f275415b530 0x7f27540c69e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:43.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.445+0000 7f275259c700 1 -- 172.21.15.149:0/1776707435 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f274c00bd40 con 0x7f27540b0ee0 2023-11-08T19:24:43.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.445+0000 7f275259c700 1 --2- 172.21.15.149:0/1776707435 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f27540b0ee0 0x7f27541eeba0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f2748009fd0 tx=0x7f2748004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:43.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.446+0000 7f2742ffd700 1 -- 172.21.15.149:0/1776707435 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27480036a0 con 0x7f27540b0ee0 2023-11-08T19:24:43.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.446+0000 7f2742ffd700 1 -- 172.21.15.149:0/1776707435 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f274801f070 con 0x7f27540b0ee0 2023-11-08T19:24:43.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.446+0000 7f2758f29700 1 -- 172.21.15.149:0/1776707435 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27480094a0 con 0x7f27540b0ee0 2023-11-08T19:24:43.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.446+0000 7f2742ffd700 1 -- 172.21.15.149:0/1776707435 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2748003a60 con 0x7f27540b0ee0 2023-11-08T19:24:43.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.446+0000 7f2758f29700 1 -- 172.21.15.149:0/1776707435 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2754141840 con 0x7f27540b0ee0 2023-11-08T19:24:43.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.447+0000 7f2758f29700 1 -- 172.21.15.149:0/1776707435 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27540745f0 con 0x7f27540b0ee0 2023-11-08T19:24:43.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.447+0000 7f2742ffd700 1 -- 172.21.15.149:0/1776707435 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2748003bc0 con 0x7f27540b0ee0 2023-11-08T19:24:43.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.447+0000 7f2742ffd700 1 --2- 172.21.15.149:0/1776707435 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f273406af00 0x7f273406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:43.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.447+0000 7f2742ffd700 1 -- 172.21.15.149:0/1776707435 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f2748021070 con 0x7f27540b0ee0 2023-11-08T19:24:43.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.447+0000 7f2751d9b700 1 --2- 172.21.15.149:0/1776707435 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f273406af00 0x7f273406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:43.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.448+0000 7f2751d9b700 1 --2- 172.21.15.149:0/1776707435 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f273406af00 0x7f273406d3c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f27541f2740 tx=0x7f2744009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:43.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.452+0000 7f2742ffd700 1 -- 172.21.15.149:0/1776707435 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2748055fe0 con 0x7f27540b0ee0 2023-11-08T19:24:43.642 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.641+0000 7f2758f29700 1 -- 172.21.15.149:0/1776707435 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f27540ce0f0 con 0x7f27540b0ee0 2023-11-08T19:24:43.643 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.642+0000 7f2742ffd700 1 -- 172.21.15.149:0/1776707435 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+14980 (secure 0 0 0) 0x7f2748015090 con 0x7f27540b0ee0 2023-11-08T19:24:43.643 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:24:43.643 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":46,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:24:42.295207+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-08T19:24:29.516185+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.149:6836/746083826":"2023-11-09T19:24:39.286243+0000","172.21.15.149:6834/746083826":"2023-11-09T19:24:39.286243+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:24:43.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.644+0000 7f2758f29700 1 -- 172.21.15.149:0/1776707435 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f273406af00 msgr2=0x7f273406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:43.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.644+0000 7f2758f29700 1 --2- 172.21.15.149:0/1776707435 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f273406af00 0x7f273406d3c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f27541f2740 tx=0x7f2744009040 comp rx=0 tx=0).stop 2023-11-08T19:24:43.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.644+0000 7f2758f29700 1 -- 172.21.15.149:0/1776707435 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f27540b0ee0 msgr2=0x7f27541eeba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:43.646 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.644+0000 7f2758f29700 1 --2- 172.21.15.149:0/1776707435 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f27540b0ee0 0x7f27541eeba0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f2748009fd0 tx=0x7f2748004750 comp rx=0 tx=0).stop 2023-11-08T19:24:43.646 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.644+0000 7f2758f29700 1 -- 172.21.15.149:0/1776707435 shutdown_connections 2023-11-08T19:24:43.646 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.644+0000 7f2758f29700 1 --2- 172.21.15.149:0/1776707435 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f273406af00 0x7f273406d3c0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:43.646 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.644+0000 7f2758f29700 1 --2- 172.21.15.149:0/1776707435 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f275415b530 0x7f27540c69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:43.647 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.644+0000 7f2758f29700 1 --2- 172.21.15.149:0/1776707435 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f27540b0ee0 0x7f27541eeba0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:43.647 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.644+0000 7f2758f29700 1 --2- 172.21.15.149:0/1776707435 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f275415b150 0x7f27540c64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:43.647 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.644+0000 7f2758f29700 1 -- 172.21.15.149:0/1776707435 >> 172.21.15.149:0/1776707435 conn(0x7f275406b3d0 msgr2=0x7f27540b0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:43.647 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.644+0000 7f2758f29700 1 -- 172.21.15.149:0/1776707435 shutdown_connections 2023-11-08T19:24:43.647 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.644+0000 7f2758f29700 1 -- 172.21.15.149:0/1776707435 wait complete. 2023-11-08T19:24:43.658 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-08T19:22:56.023194+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-08T19:24:29.516185+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 42, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-08T19:24:43.658 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-08T19:24:43.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.786+0000 7f43ecba8700 1 Processor -- start 2023-11-08T19:24:43.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.786+0000 7f43ecba8700 1 -- start start 2023-11-08T19:24:43.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.787+0000 7f43ecba8700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f43e815dc80 0x7f43e80aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:43.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.787+0000 7f43ecba8700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f43e80ce620 0x7f43e80af030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:43.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.787+0000 7f43ecba8700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43e80cb190 con 0x7f43e815e060 2023-11-08T19:24:43.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.787+0000 7f43ecba8700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43e80cbda0 con 0x7f43e815dc80 2023-11-08T19:24:43.791 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.787+0000 7f43ecba8700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43e80cb470 con 0x7f43e80ce620 2023-11-08T19:24:43.791 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.787+0000 7f43e659c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f43e815dc80 0x7f43e80aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:43.791 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.787+0000 7f43e659c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f43e815dc80 0x7f43e80aeaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39984/0 (socket says 172.21.15.149:39984) 2023-11-08T19:24:43.791 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.787+0000 7f43e659c700 1 -- 172.21.15.149:0/2920141983 learned_addr learned my addr 172.21.15.149:0/2920141983 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:43.792 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.787+0000 7f43e6d9d700 1 --2- 172.21.15.149:0/2920141983 >> v2:172.21.15.160:3300/0 conn(0x7f43e80ce620 0x7f43e80af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:43.792 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.787+0000 7f43e659c700 1 -- 172.21.15.149:0/2920141983 >> v2:172.21.15.160:3300/0 conn(0x7f43e80ce620 msgr2=0x7f43e80af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:43.792 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.787+0000 7f43e659c700 1 --2- 172.21.15.149:0/2920141983 >> v2:172.21.15.160:3300/0 conn(0x7f43e80ce620 0x7f43e80af030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:43.792 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.787+0000 7f43e659c700 1 -- 172.21.15.149:0/2920141983 >> v1:172.21.15.160:6789/0 conn(0x7f43e815e060 legacy=0x7f43e80cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:43.792 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.788+0000 7f43e659c700 1 -- 172.21.15.149:0/2920141983 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e80cb750 con 0x7f43e815dc80 2023-11-08T19:24:43.793 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.788+0000 7f43e659c700 1 --2- 172.21.15.149:0/2920141983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43e815dc80 0x7f43e80aeaf0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f43e80cc810 tx=0x7f43dc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a579bc9720b47f93 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:43.793 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.788+0000 7f43e559a700 1 -- 172.21.15.149:0/2920141983 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43dc004230 con 0x7f43e815dc80 2023-11-08T19:24:43.793 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.788+0000 7f43e559a700 1 -- 172.21.15.149:0/2920141983 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43dc004390 con 0x7f43e815dc80 2023-11-08T19:24:43.793 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.788+0000 7f43e559a700 1 -- 172.21.15.149:0/2920141983 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43dc0036a0 con 0x7f43e815dc80 2023-11-08T19:24:43.793 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.788+0000 7f43ecba8700 1 -- 172.21.15.149:0/2920141983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43e815dc80 msgr2=0x7f43e80aeaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:43.794 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.788+0000 7f43ecba8700 1 --2- 172.21.15.149:0/2920141983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43e815dc80 0x7f43e80aeaf0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f43e80cc810 tx=0x7f43dc009bd0 comp rx=0 tx=0).stop 2023-11-08T19:24:43.794 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.788+0000 7f43ecba8700 1 -- 172.21.15.149:0/2920141983 shutdown_connections 2023-11-08T19:24:43.794 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.788+0000 7f43ecba8700 1 --2- 172.21.15.149:0/2920141983 >> v2:172.21.15.160:3300/0 conn(0x7f43e80ce620 0x7f43e80af030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:43.794 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.788+0000 7f43ecba8700 1 --2- 172.21.15.149:0/2920141983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43e815dc80 0x7f43e80aeaf0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:43.794 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.788+0000 7f43ecba8700 1 -- 172.21.15.149:0/2920141983 >> 172.21.15.149:0/2920141983 conn(0x7f43e80cc860 msgr2=0x7f43e80ccc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:43.795 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.789+0000 7f43ecba8700 1 -- 172.21.15.149:0/2920141983 shutdown_connections 2023-11-08T19:24:43.795 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.789+0000 7f43ecba8700 1 -- 172.21.15.149:0/2920141983 wait complete. 2023-11-08T19:24:43.797 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.790+0000 7f43ecba8700 1 Processor -- start 2023-11-08T19:24:43.798 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.790+0000 7f43ecba8700 1 -- start start 2023-11-08T19:24:43.798 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.791+0000 7f43ecba8700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f43e80ce620 0x7f43e814fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:43.798 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.791+0000 7f43ecba8700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f43e815dc80 0x7f43e81f7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:43.798 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.791+0000 7f43ecba8700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43e815e060 0x7f43e80b3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:43.798 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.791+0000 7f43ecba8700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e81f33c0 con 0x7f43e815e060 2023-11-08T19:24:43.799 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.791+0000 7f43ecba8700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e8150130 con 0x7f43e815dc80 2023-11-08T19:24:43.799 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.791+0000 7f43ecba8700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43e81f35d0 con 0x7f43e80ce620 2023-11-08T19:24:43.799 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.791+0000 7f43e6d9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43e815e060 0x7f43e80b3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:43.799 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.791+0000 7f43e6d9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43e815e060 0x7f43e80b3340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:39994/0 (socket says 172.21.15.149:39994) 2023-11-08T19:24:43.799 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.791+0000 7f43e6d9d700 1 -- 172.21.15.149:0/3453797313 learned_addr learned my addr 172.21.15.149:0/3453797313 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:43.800 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.791+0000 7f43e5d9b700 1 --2- 172.21.15.149:0/3453797313 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f43e815dc80 0x7f43e81f7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:43.800 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.791+0000 7f43e659c700 1 --2- 172.21.15.149:0/3453797313 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f43e80ce620 0x7f43e814fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:43.800 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.791+0000 7f43e6d9d700 1 -- 172.21.15.149:0/3453797313 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f43e80ce620 msgr2=0x7f43e814fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:43.800 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.791+0000 7f43e6d9d700 1 --2- 172.21.15.149:0/3453797313 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f43e80ce620 0x7f43e814fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:43.800 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.791+0000 7f43e6d9d700 1 -- 172.21.15.149:0/3453797313 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f43e815dc80 msgr2=0x7f43e81f7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:43.801 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.791+0000 7f43e6d9d700 1 --2- 172.21.15.149:0/3453797313 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f43e815dc80 0x7f43e81f7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:43.801 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.791+0000 7f43e6d9d700 1 -- 172.21.15.149:0/3453797313 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43dc009550 con 0x7f43e815e060 2023-11-08T19:24:43.801 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.791+0000 7f43e5d9b700 1 --2- 172.21.15.149:0/3453797313 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f43e815dc80 0x7f43e81f7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:24:43.801 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.791+0000 7f43e659c700 1 --2- 172.21.15.149:0/3453797313 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f43e80ce620 0x7f43e814fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:24:43.801 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.791+0000 7f43e6d9d700 1 --2- 172.21.15.149:0/3453797313 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43e815e060 0x7f43e80b3340 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f43e0007e60 tx=0x7f43e000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:43.802 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.791+0000 7f43d6ffd700 1 -- 172.21.15.149:0/3453797313 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e000ede0 con 0x7f43e815e060 2023-11-08T19:24:43.802 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.791+0000 7f43d6ffd700 1 -- 172.21.15.149:0/3453797313 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43e0014420 con 0x7f43e815e060 2023-11-08T19:24:43.802 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.791+0000 7f43ecba8700 1 -- 172.21.15.149:0/3453797313 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43e81f38b0 con 0x7f43e815e060 2023-11-08T19:24:43.802 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.791+0000 7f43d6ffd700 1 -- 172.21.15.149:0/3453797313 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e00147d0 con 0x7f43e815e060 2023-11-08T19:24:43.802 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.791+0000 7f43ecba8700 1 -- 172.21.15.149:0/3453797313 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43e81f3e70 con 0x7f43e815e060 2023-11-08T19:24:43.803 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.792+0000 7f43ecba8700 1 -- 172.21.15.149:0/3453797313 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43e804f730 con 0x7f43e815e060 2023-11-08T19:24:43.803 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.793+0000 7f43d6ffd700 1 -- 172.21.15.149:0/3453797313 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f43e0014930 con 0x7f43e815e060 2023-11-08T19:24:43.803 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.793+0000 7f43d6ffd700 1 --2- 172.21.15.149:0/3453797313 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f43c806af00 0x7f43c806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:43.803 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.793+0000 7f43e659c700 1 --2- 172.21.15.149:0/3453797313 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f43c806af00 0x7f43c806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:43.803 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.793+0000 7f43d6ffd700 1 -- 172.21.15.149:0/3453797313 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f43e0089ce0 con 0x7f43e815e060 2023-11-08T19:24:43.804 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.794+0000 7f43e659c700 1 --2- 172.21.15.149:0/3453797313 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f43c806af00 0x7f43c806d3c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f43dc009130 tx=0x7f43dc008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:43.804 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.798+0000 7f43d6ffd700 1 -- 172.21.15.149:0/3453797313 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f43e0054df0 con 0x7f43e815e060 2023-11-08T19:24:43.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.985+0000 7f43ecba8700 1 -- 172.21.15.149:0/3453797313 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f43e80b5d60 con 0x7f43e815e060 2023-11-08T19:24:43.987 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.986+0000 7f43d6ffd700 1 -- 172.21.15.149:0/3453797313 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) v1 ==== 93+0+10 (secure 0 0 0) 0x7f43e0058410 con 0x7f43e815e060 2023-11-08T19:24:43.988 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 1 2023-11-08T19:24:43.989 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.988+0000 7f43ecba8700 1 -- 172.21.15.149:0/3453797313 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f43c806af00 msgr2=0x7f43c806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:43.990 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.988+0000 7f43ecba8700 1 --2- 172.21.15.149:0/3453797313 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f43c806af00 0x7f43c806d3c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f43dc009130 tx=0x7f43dc008030 comp rx=0 tx=0).stop 2023-11-08T19:24:43.990 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.988+0000 7f43ecba8700 1 -- 172.21.15.149:0/3453797313 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43e815e060 msgr2=0x7f43e80b3340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:43.990 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.988+0000 7f43ecba8700 1 --2- 172.21.15.149:0/3453797313 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43e815e060 0x7f43e80b3340 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f43e0007e60 tx=0x7f43e000e3c0 comp rx=0 tx=0).stop 2023-11-08T19:24:43.990 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.988+0000 7f43ecba8700 1 -- 172.21.15.149:0/3453797313 shutdown_connections 2023-11-08T19:24:43.991 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.988+0000 7f43ecba8700 1 --2- 172.21.15.149:0/3453797313 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f43c806af00 0x7f43c806d3c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:43.991 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.988+0000 7f43ecba8700 1 --2- 172.21.15.149:0/3453797313 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43e815e060 0x7f43e80b3340 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:43.991 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.988+0000 7f43ecba8700 1 --2- 172.21.15.149:0/3453797313 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f43e80ce620 0x7f43e814fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:43.991 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.988+0000 7f43ecba8700 1 --2- 172.21.15.149:0/3453797313 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f43e815dc80 0x7f43e81f7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:43.991 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.988+0000 7f43ecba8700 1 -- 172.21.15.149:0/3453797313 >> 172.21.15.149:0/3453797313 conn(0x7f43e80cc860 msgr2=0x7f43e80b5270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:43.992 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.988+0000 7f43ecba8700 1 -- 172.21.15.149:0/3453797313 shutdown_connections 2023-11-08T19:24:43.992 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:43.988+0000 7f43ecba8700 1 -- 172.21.15.149:0/3453797313 wait complete. 2023-11-08T19:24:44.002 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-08T19:24:44.126 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.125+0000 7f0b03cdb700 1 Processor -- start 2023-11-08T19:24:44.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.125+0000 7f0b03cdb700 1 -- start start 2023-11-08T19:24:44.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.126+0000 7f0b03cdb700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f0afc06f030 0x7f0afc0cae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:44.131 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.126+0000 7f0b03cdb700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0afc06ab80 0x7f0afc06e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:44.131 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.126+0000 7f0b03cdb700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0afc0af590 con 0x7f0afc0cdce0 2023-11-08T19:24:44.131 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.126+0000 7f0b03cdb700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0afc06d8b0 con 0x7f0afc06f030 2023-11-08T19:24:44.131 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.126+0000 7f0b03cdb700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0afc066f40 con 0x7f0afc06ab80 2023-11-08T19:24:44.131 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.126+0000 7f0b01a77700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f0afc0cdce0 0x7f0afc0ce0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:42000/0 (socket says 172.21.15.149:42000) 2023-11-08T19:24:44.132 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.126+0000 7f0b01a77700 1 -- 172.21.15.149:0/2227712014 learned_addr learned my addr 172.21.15.149:0/2227712014 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:24:44.132 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.126+0000 7f0b02278700 1 --2- 172.21.15.149:0/2227712014 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0afc06ab80 0x7f0afc06e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:44.132 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.126+0000 7f0b01276700 1 --2- 172.21.15.149:0/2227712014 >> v2:172.21.15.160:3300/0 conn(0x7f0afc06f030 0x7f0afc0cae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:44.132 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.126+0000 7f0b00a75700 1 -- 172.21.15.149:0/2227712014 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3143202649 0 0) 0x7f0afc0af590 con 0x7f0afc0cdce0 2023-11-08T19:24:44.132 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.126+0000 7f0b00a75700 1 -- 172.21.15.149:0/2227712014 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ae80035b0 con 0x7f0afc0cdce0 2023-11-08T19:24:44.133 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.127+0000 7f0b00a75700 1 -- 172.21.15.149:0/2227712014 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3658128193 0 0) 0x7f0ae80035b0 con 0x7f0afc0cdce0 2023-11-08T19:24:44.133 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.127+0000 7f0b00a75700 1 -- 172.21.15.149:0/2227712014 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0afc06ab80 msgr2=0x7f0afc06e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:44.133 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.127+0000 7f0b00a75700 1 --2- 172.21.15.149:0/2227712014 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0afc06ab80 0x7f0afc06e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:44.133 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.127+0000 7f0b00a75700 1 -- 172.21.15.149:0/2227712014 >> v2:172.21.15.160:3300/0 conn(0x7f0afc06f030 msgr2=0x7f0afc0cae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:44.133 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.127+0000 7f0b00a75700 1 --2- 172.21.15.149:0/2227712014 >> v2:172.21.15.160:3300/0 conn(0x7f0afc06f030 0x7f0afc0cae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:44.134 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.127+0000 7f0b00a75700 1 -- 172.21.15.149:0/2227712014 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0afc0cb4d0 con 0x7f0afc0cdce0 2023-11-08T19:24:44.134 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.127+0000 7f0b00a75700 1 -- 172.21.15.149:0/2227712014 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f0aec001670 con 0x7f0afc0cdce0 2023-11-08T19:24:44.134 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.127+0000 7f0b00a75700 1 -- 172.21.15.149:0/2227712014 >> v1:172.21.15.149:6789/0 conn(0x7f0afc0cdce0 legacy=0x7f0afc0ce0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:44.134 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.127+0000 7f0b00a75700 1 --2- 172.21.15.149:0/2227712014 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0afc06ab80 0x7f0ae8003a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:44.135 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.127+0000 7f0b00a75700 1 --2- 172.21.15.149:0/2227712014 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ae8003ff0 0x7f0ae8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:44.135 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.127+0000 7f0b00a75700 1 --2- 172.21.15.149:0/2227712014 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ae8004d90 0x7f0ae8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:44.135 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.127+0000 7f0b00a75700 1 -- 172.21.15.149:0/2227712014 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0afc06d8b0 con 0x7f0ae8004d90 2023-11-08T19:24:44.135 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.127+0000 7f0b00a75700 1 -- 172.21.15.149:0/2227712014 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0afc066f40 con 0x7f0ae8003ff0 2023-11-08T19:24:44.135 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.127+0000 7f0b00a75700 1 -- 172.21.15.149:0/2227712014 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae800ba40 con 0x7f0afc06ab80 2023-11-08T19:24:44.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.127+0000 7f0b02278700 1 --2- 172.21.15.149:0/2227712014 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ae8004d90 0x7f0ae8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:44.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.127+0000 7f0b01a77700 1 --2- 172.21.15.149:0/2227712014 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0afc06ab80 0x7f0ae8003a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:44.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.127+0000 7f0b01276700 1 --2- 172.21.15.149:0/2227712014 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ae8003ff0 0x7f0ae8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:44.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.127+0000 7f0b02278700 1 -- 172.21.15.149:0/2227712014 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0afc06ab80 msgr2=0x7f0ae8003a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:44.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.127+0000 7f0b02278700 1 --2- 172.21.15.149:0/2227712014 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0afc06ab80 0x7f0ae8003a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:44.137 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.127+0000 7f0b02278700 1 -- 172.21.15.149:0/2227712014 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ae8003ff0 msgr2=0x7f0ae8004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:44.137 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.127+0000 7f0b02278700 1 --2- 172.21.15.149:0/2227712014 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ae8003ff0 0x7f0ae8004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:44.137 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.127+0000 7f0b02278700 1 -- 172.21.15.149:0/2227712014 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae80035b0 con 0x7f0ae8004d90 2023-11-08T19:24:44.137 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.127+0000 7f0b02278700 1 --2- 172.21.15.149:0/2227712014 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ae8004d90 0x7f0ae8005210 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f0af4009fc0 tx=0x7f0ae8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82503f4f3b9a0b0c server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:44.138 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.127+0000 7f0b00a75700 1 -- 172.21.15.149:0/2227712014 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af400ec30 con 0x7f0ae8004d90 2023-11-08T19:24:44.138 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.127+0000 7f0b00a75700 1 -- 172.21.15.149:0/2227712014 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af400f040 con 0x7f0ae8004d90 2023-11-08T19:24:44.138 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.127+0000 7f0b00a75700 1 -- 172.21.15.149:0/2227712014 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af4014480 con 0x7f0ae8004d90 2023-11-08T19:24:44.138 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.128+0000 7f0b03cdb700 1 -- 172.21.15.149:0/2227712014 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ae8004d90 msgr2=0x7f0ae8005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:44.139 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.128+0000 7f0b03cdb700 1 --2- 172.21.15.149:0/2227712014 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ae8004d90 0x7f0ae8005210 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f0af4009fc0 tx=0x7f0ae8005880 comp rx=0 tx=0).stop 2023-11-08T19:24:44.139 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.128+0000 7f0b02278700 1 -- 172.21.15.149:0/2227712014 reap_dead start 2023-11-08T19:24:44.139 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.128+0000 7f0b03cdb700 1 -- 172.21.15.149:0/2227712014 shutdown_connections 2023-11-08T19:24:44.139 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.128+0000 7f0b03cdb700 1 -- 172.21.15.149:0/2227712014 >> 172.21.15.149:0/2227712014 conn(0x7f0afc0cc860 msgr2=0x7f0afc0ccc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:44.139 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.128+0000 7f0b03cdb700 1 -- 172.21.15.149:0/2227712014 shutdown_connections 2023-11-08T19:24:44.140 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.128+0000 7f0b03cdb700 1 -- 172.21.15.149:0/2227712014 wait complete. 2023-11-08T19:24:44.140 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.129+0000 7f0b03cdb700 1 Processor -- start 2023-11-08T19:24:44.140 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.129+0000 7f0b03cdb700 1 -- start start 2023-11-08T19:24:44.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.130+0000 7f0b03cdb700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ae8004d90 0x7f0afc156ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:44.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.130+0000 7f0b03cdb700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0afc0b4210 0x7f0afc0b4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:44.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.130+0000 7f0b03cdb700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0afc1f6b70 0x7f0afc1f6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:44.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.130+0000 7f0b03cdb700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0afc1f7520 con 0x7f0afc0b4210 2023-11-08T19:24:44.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.130+0000 7f0b03cdb700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0afc1557a0 con 0x7f0ae8004d90 2023-11-08T19:24:44.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.130+0000 7f0b03cdb700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0afc154280 con 0x7f0afc1f6b70 2023-11-08T19:24:44.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.130+0000 7f0b01276700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0afc0b4210 0x7f0afc0b4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:44.148 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.130+0000 7f0b01276700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0afc0b4210 0x7f0afc0b4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40012/0 (socket says 172.21.15.149:40012) 2023-11-08T19:24:44.148 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.130+0000 7f0b01276700 1 -- 172.21.15.149:0/1208140896 learned_addr learned my addr 172.21.15.149:0/1208140896 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:44.148 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.130+0000 7f0b01a77700 1 --2- 172.21.15.149:0/1208140896 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ae8004d90 0x7f0afc156ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:44.148 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.130+0000 7f0b02278700 1 --2- 172.21.15.149:0/1208140896 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0afc1f6b70 0x7f0afc1f6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:44.148 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.130+0000 7f0b01276700 1 -- 172.21.15.149:0/1208140896 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0afc1f6b70 msgr2=0x7f0afc1f6fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:44.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.130+0000 7f0b01276700 1 --2- 172.21.15.149:0/1208140896 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0afc1f6b70 0x7f0afc1f6fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:44.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.130+0000 7f0b01276700 1 -- 172.21.15.149:0/1208140896 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ae8004d90 msgr2=0x7f0afc156ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:44.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.130+0000 7f0b01276700 1 --2- 172.21.15.149:0/1208140896 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ae8004d90 0x7f0afc156ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:44.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.130+0000 7f0b01276700 1 -- 172.21.15.149:0/1208140896 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0afc155a60 con 0x7f0afc0b4210 2023-11-08T19:24:44.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.131+0000 7f0b01276700 1 --2- 172.21.15.149:0/1208140896 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0afc0b4210 0x7f0afc0b4690 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f0af8011aa0 tx=0x7f0af8011db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:44.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.131+0000 7f0af27fc700 1 -- 172.21.15.149:0/1208140896 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af8011ee0 con 0x7f0afc0b4210 2023-11-08T19:24:44.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.131+0000 7f0af27fc700 1 -- 172.21.15.149:0/1208140896 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af800f940 con 0x7f0afc0b4210 2023-11-08T19:24:44.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.131+0000 7f0b03cdb700 1 -- 172.21.15.149:0/1208140896 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0afc155d40 con 0x7f0afc0b4210 2023-11-08T19:24:44.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.131+0000 7f0af27fc700 1 -- 172.21.15.149:0/1208140896 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af800fcd0 con 0x7f0afc0b4210 2023-11-08T19:24:44.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.131+0000 7f0b03cdb700 1 -- 172.21.15.149:0/1208140896 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0afc156300 con 0x7f0afc0b4210 2023-11-08T19:24:44.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.132+0000 7f0b03cdb700 1 -- 172.21.15.149:0/1208140896 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0afc04f730 con 0x7f0afc0b4210 2023-11-08T19:24:44.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.132+0000 7f0af27fc700 1 -- 172.21.15.149:0/1208140896 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0af8014440 con 0x7f0afc0b4210 2023-11-08T19:24:44.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.133+0000 7f0af27fc700 1 --2- 172.21.15.149:0/1208140896 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0ae006af00 0x7f0ae006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:44.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.133+0000 7f0af27fc700 1 -- 172.21.15.149:0/1208140896 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f0af8089c10 con 0x7f0afc0b4210 2023-11-08T19:24:44.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.133+0000 7f0b01a77700 1 --2- 172.21.15.149:0/1208140896 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0ae006af00 0x7f0ae006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:44.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.133+0000 7f0b01a77700 1 --2- 172.21.15.149:0/1208140896 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0ae006af00 0x7f0ae006d3c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0aec000fb0 tx=0x7f0aec007980 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:44.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.137+0000 7f0af27fc700 1 -- 172.21.15.149:0/1208140896 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0af8054d60 con 0x7f0afc0b4210 2023-11-08T19:24:44.331 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.330+0000 7f0b03cdb700 1 -- 172.21.15.149:0/1208140896 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f0afc0b5d60 con 0x7f0afc0b4210 2023-11-08T19:24:44.331 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.330+0000 7f0af27fc700 1 -- 172.21.15.149:0/1208140896 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v46) v1 ==== 103+0+11 (secure 0 0 0) 0x7f0af8058380 con 0x7f0afc0b4210 2023-11-08T19:24:44.331 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:24:44.333 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.332+0000 7f0b03cdb700 1 -- 172.21.15.149:0/1208140896 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0ae006af00 msgr2=0x7f0ae006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:44.334 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.332+0000 7f0b03cdb700 1 --2- 172.21.15.149:0/1208140896 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0ae006af00 0x7f0ae006d3c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0aec000fb0 tx=0x7f0aec007980 comp rx=0 tx=0).stop 2023-11-08T19:24:44.334 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.332+0000 7f0b03cdb700 1 -- 172.21.15.149:0/1208140896 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0afc0b4210 msgr2=0x7f0afc0b4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:44.334 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.332+0000 7f0b03cdb700 1 --2- 172.21.15.149:0/1208140896 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0afc0b4210 0x7f0afc0b4690 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f0af8011aa0 tx=0x7f0af8011db0 comp rx=0 tx=0).stop 2023-11-08T19:24:44.334 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.332+0000 7f0b03cdb700 1 -- 172.21.15.149:0/1208140896 shutdown_connections 2023-11-08T19:24:44.335 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.332+0000 7f0b03cdb700 1 --2- 172.21.15.149:0/1208140896 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0ae006af00 0x7f0ae006d3c0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:44.335 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.332+0000 7f0b03cdb700 1 --2- 172.21.15.149:0/1208140896 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ae8004d90 0x7f0afc156ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:44.335 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.332+0000 7f0b03cdb700 1 --2- 172.21.15.149:0/1208140896 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0afc1f6b70 0x7f0afc1f6fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:44.335 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.332+0000 7f0b03cdb700 1 --2- 172.21.15.149:0/1208140896 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0afc0b4210 0x7f0afc0b4690 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:44.335 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.332+0000 7f0b03cdb700 1 -- 172.21.15.149:0/1208140896 >> 172.21.15.149:0/1208140896 conn(0x7f0afc0cc860 msgr2=0x7f0afc0c6660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:44.336 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.332+0000 7f0b03cdb700 1 -- 172.21.15.149:0/1208140896 shutdown_connections 2023-11-08T19:24:44.336 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.332+0000 7f0b03cdb700 1 -- 172.21.15.149:0/1208140896 wait complete. 2023-11-08T19:24:44.346 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_disallow_monitor_managed_snaps_for_fs_pools' 2023-11-08T19:24:44.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.466+0000 7f817734c700 1 Processor -- start 2023-11-08T19:24:44.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.466+0000 7f817734c700 1 -- start start 2023-11-08T19:24:44.471 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.466+0000 7f817734c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f81700cc140 0x7f81700cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:44.472 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.467+0000 7f817734c700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f81700b2cd0 0x7f817015d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:44.472 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.467+0000 7f817734c700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81700cce50 con 0x7f81700b2850 2023-11-08T19:24:44.472 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.467+0000 7f817734c700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81700b2430 con 0x7f81700b2cd0 2023-11-08T19:24:44.472 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.467+0000 7f817734c700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81700cc520 con 0x7f81700cc140 2023-11-08T19:24:44.472 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.467+0000 7f81748e7700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f81700b2850 0x7f81700cabf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:42022/0 (socket says 172.21.15.149:42022) 2023-11-08T19:24:44.473 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.467+0000 7f81748e7700 1 -- 172.21.15.149:0/2919509486 learned_addr learned my addr 172.21.15.149:0/2919509486 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:24:44.473 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.467+0000 7f8167fff700 1 -- 172.21.15.149:0/2919509486 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 922753803 0 0) 0x7f81700cce50 con 0x7f81700b2850 2023-11-08T19:24:44.473 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.467+0000 7f81758e9700 1 --2- 172.21.15.149:0/2919509486 >> v2:172.21.15.160:3300/0 conn(0x7f81700b2cd0 0x7f817015d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:44.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.467+0000 7f8167fff700 1 -- 172.21.15.149:0/2919509486 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f815c0035b0 con 0x7f81700b2850 2023-11-08T19:24:44.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.467+0000 7f81750e8700 1 --2- 172.21.15.149:0/2919509486 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f81700cc140 0x7f81700cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:44.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.467+0000 7f8167fff700 1 -- 172.21.15.149:0/2919509486 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3136568477 0 0) 0x7f815c0035b0 con 0x7f81700b2850 2023-11-08T19:24:44.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.467+0000 7f8167fff700 1 -- 172.21.15.149:0/2919509486 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f81700cc140 msgr2=0x7f81700cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:44.475 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.467+0000 7f8167fff700 1 --2- 172.21.15.149:0/2919509486 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f81700cc140 0x7f81700cc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:44.475 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.467+0000 7f8167fff700 1 -- 172.21.15.149:0/2919509486 >> v2:172.21.15.160:3300/0 conn(0x7f81700b2cd0 msgr2=0x7f817015d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:44.475 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.467+0000 7f8167fff700 1 --2- 172.21.15.149:0/2919509486 >> v2:172.21.15.160:3300/0 conn(0x7f81700b2cd0 0x7f817015d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:44.475 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.467+0000 7f8167fff700 1 -- 172.21.15.149:0/2919509486 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81700b17b0 con 0x7f81700b2850 2023-11-08T19:24:44.475 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.467+0000 7f8167fff700 1 -- 172.21.15.149:0/2919509486 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f816c001670 con 0x7f81700b2850 2023-11-08T19:24:44.476 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.467+0000 7f8167fff700 1 -- 172.21.15.149:0/2919509486 >> v1:172.21.15.149:6789/0 conn(0x7f81700b2850 legacy=0x7f81700cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:44.476 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.467+0000 7f8167fff700 1 --2- 172.21.15.149:0/2919509486 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f815c003a00 0x7f815c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:44.476 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.467+0000 7f8167fff700 1 --2- 172.21.15.149:0/2919509486 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f815c004850 0x7f815c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:44.476 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.467+0000 7f8167fff700 1 --2- 172.21.15.149:0/2919509486 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f81700cc140 0x7f815c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:44.476 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.467+0000 7f8167fff700 1 -- 172.21.15.149:0/2919509486 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81700b2430 con 0x7f815c003a00 2023-11-08T19:24:44.477 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.467+0000 7f8167fff700 1 -- 172.21.15.149:0/2919509486 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81700cc520 con 0x7f815c004850 2023-11-08T19:24:44.477 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.467+0000 7f8167fff700 1 -- 172.21.15.149:0/2919509486 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f815c00ba10 con 0x7f81700cc140 2023-11-08T19:24:44.477 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.467+0000 7f81750e8700 1 --2- 172.21.15.149:0/2919509486 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f815c003a00 0x7f815c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:44.477 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.467+0000 7f81748e7700 1 --2- 172.21.15.149:0/2919509486 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f815c004850 0x7f815c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:44.477 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.468+0000 7f81758e9700 1 --2- 172.21.15.149:0/2919509486 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f81700cc140 0x7f815c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:44.478 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.468+0000 7f81750e8700 1 -- 172.21.15.149:0/2919509486 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f81700cc140 msgr2=0x7f815c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:44.478 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.468+0000 7f81750e8700 1 --2- 172.21.15.149:0/2919509486 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f81700cc140 0x7f815c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:44.478 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.468+0000 7f81750e8700 1 -- 172.21.15.149:0/2919509486 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f815c004850 msgr2=0x7f815c004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:44.478 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.468+0000 7f81750e8700 1 --2- 172.21.15.149:0/2919509486 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f815c004850 0x7f815c004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:44.478 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.468+0000 7f81750e8700 1 -- 172.21.15.149:0/2919509486 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f815c0035b0 con 0x7f815c003a00 2023-11-08T19:24:44.479 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.468+0000 7f81750e8700 1 --2- 172.21.15.149:0/2919509486 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f815c003a00 0x7f815c003e20 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f8160009b40 tx=0x7f815c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1aa6cbb10e9e27c server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:44.479 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.468+0000 7f8167fff700 1 -- 172.21.15.149:0/2919509486 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8160005a20 con 0x7f815c003a00 2023-11-08T19:24:44.479 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.468+0000 7f8167fff700 1 -- 172.21.15.149:0/2919509486 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8160005b80 con 0x7f815c003a00 2023-11-08T19:24:44.479 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.468+0000 7f8167fff700 1 -- 172.21.15.149:0/2919509486 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816000e6c0 con 0x7f815c003a00 2023-11-08T19:24:44.479 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.468+0000 7f817734c700 1 -- 172.21.15.149:0/2919509486 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f815c003a00 msgr2=0x7f815c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:44.480 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.468+0000 7f817734c700 1 --2- 172.21.15.149:0/2919509486 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f815c003a00 0x7f815c003e20 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f8160009b40 tx=0x7f815c005880 comp rx=0 tx=0).stop 2023-11-08T19:24:44.480 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.468+0000 7f81758e9700 1 -- 172.21.15.149:0/2919509486 reap_dead start 2023-11-08T19:24:44.480 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.469+0000 7f817734c700 1 -- 172.21.15.149:0/2919509486 shutdown_connections 2023-11-08T19:24:44.480 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.469+0000 7f817734c700 1 -- 172.21.15.149:0/2919509486 >> 172.21.15.149:0/2919509486 conn(0x7f8170099a40 msgr2=0x7f81700d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:44.480 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.469+0000 7f817734c700 1 -- 172.21.15.149:0/2919509486 shutdown_connections 2023-11-08T19:24:44.480 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.469+0000 7f817734c700 1 -- 172.21.15.149:0/2919509486 wait complete. 2023-11-08T19:24:44.481 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.470+0000 7f817734c700 1 Processor -- start 2023-11-08T19:24:44.481 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.470+0000 7f817734c700 1 -- start start 2023-11-08T19:24:44.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.471+0000 7f817734c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f815c003a00 0x7f8170156a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:44.484 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.471+0000 7f817734c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f81700b4540 0x7f817015f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:44.484 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.471+0000 7f817734c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f817015f600 0x7f81700b4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:44.484 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.471+0000 7f817734c700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81700b4120 con 0x7f81700b4540 2023-11-08T19:24:44.484 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.471+0000 7f817734c700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817015fa90 con 0x7f815c003a00 2023-11-08T19:24:44.484 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.471+0000 7f817734c700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81700b3250 con 0x7f817015f600 2023-11-08T19:24:44.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.471+0000 7f81748e7700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f81700b4540 0x7f817015f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:44.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.471+0000 7f81748e7700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f81700b4540 0x7f817015f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40032/0 (socket says 172.21.15.149:40032) 2023-11-08T19:24:44.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.471+0000 7f81748e7700 1 -- 172.21.15.149:0/567864756 learned_addr learned my addr 172.21.15.149:0/567864756 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:44.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.471+0000 7f81750e8700 1 --2- 172.21.15.149:0/567864756 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f815c003a00 0x7f8170156a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:44.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.471+0000 7f81758e9700 1 --2- 172.21.15.149:0/567864756 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f817015f600 0x7f81700b4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:44.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.471+0000 7f81748e7700 1 -- 172.21.15.149:0/567864756 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f817015f600 msgr2=0x7f81700b4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:44.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.471+0000 7f81748e7700 1 --2- 172.21.15.149:0/567864756 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f817015f600 0x7f81700b4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:44.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.471+0000 7f81748e7700 1 -- 172.21.15.149:0/567864756 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f815c003a00 msgr2=0x7f8170156a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:44.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.471+0000 7f81748e7700 1 --2- 172.21.15.149:0/567864756 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f815c003a00 0x7f8170156a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:44.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.471+0000 7f81748e7700 1 -- 172.21.15.149:0/567864756 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8170156fc0 con 0x7f81700b4540 2023-11-08T19:24:44.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.472+0000 7f81748e7700 1 --2- 172.21.15.149:0/567864756 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f81700b4540 0x7f817015f0c0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f816c000fb0 tx=0x7f816c0075f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:44.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.472+0000 7f8165ffb700 1 -- 172.21.15.149:0/567864756 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816c0077d0 con 0x7f81700b4540 2023-11-08T19:24:44.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.472+0000 7f8165ffb700 1 -- 172.21.15.149:0/567864756 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f816c00f840 con 0x7f81700b4540 2023-11-08T19:24:44.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.472+0000 7f817734c700 1 -- 172.21.15.149:0/567864756 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81700b34a0 con 0x7f81700b4540 2023-11-08T19:24:44.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.472+0000 7f8165ffb700 1 -- 172.21.15.149:0/567864756 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816c00fbf0 con 0x7f81700b4540 2023-11-08T19:24:44.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.472+0000 7f817734c700 1 -- 172.21.15.149:0/567864756 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81700b3a60 con 0x7f81700b4540 2023-11-08T19:24:44.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.473+0000 7f817734c700 1 -- 172.21.15.149:0/567864756 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81700b4260 con 0x7f81700b4540 2023-11-08T19:24:44.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.473+0000 7f8165ffb700 1 -- 172.21.15.149:0/567864756 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f816c00fd50 con 0x7f81700b4540 2023-11-08T19:24:44.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.474+0000 7f8165ffb700 1 --2- 172.21.15.149:0/567864756 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f815406af00 0x7f815406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:44.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.474+0000 7f8165ffb700 1 -- 172.21.15.149:0/567864756 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f816c089540 con 0x7f81700b4540 2023-11-08T19:24:44.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.474+0000 7f81750e8700 1 --2- 172.21.15.149:0/567864756 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f815406af00 0x7f815406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:44.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.474+0000 7f81750e8700 1 --2- 172.21.15.149:0/567864756 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f815406af00 0x7f815406d3c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8160009a60 tx=0x7f8160008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:44.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.478+0000 7f8165ffb700 1 -- 172.21.15.149:0/567864756 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f81700b4260 con 0x7f81700b4540 2023-11-08T19:24:44.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:44.749+0000 7f817734c700 1 -- 172.21.15.149:0/567864756 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_disallow_monitor_managed_snaps_for_fs_pools"]} v 0) v1 -- 0x7f81700b4260 con 0x7f81700b4540 2023-11-08T19:24:45.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.308+0000 7f8165ffb700 1 -- 172.21.15.149:0/567864756 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_disallow_monitor_managed_snaps_for_fs_pools"]}]=0 v117) v1 ==== 181+0+0 (secure 0 0 0) 0x7f81700b4260 con 0x7f81700b4540 2023-11-08T19:24:45.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.311+0000 7f817734c700 1 -- 172.21.15.149:0/567864756 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f815406af00 msgr2=0x7f815406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:45.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.311+0000 7f817734c700 1 --2- 172.21.15.149:0/567864756 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f815406af00 0x7f815406d3c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8160009a60 tx=0x7f8160008030 comp rx=0 tx=0).stop 2023-11-08T19:24:45.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.311+0000 7f817734c700 1 -- 172.21.15.149:0/567864756 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f81700b4540 msgr2=0x7f817015f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:45.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.311+0000 7f817734c700 1 --2- 172.21.15.149:0/567864756 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f81700b4540 0x7f817015f0c0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f816c000fb0 tx=0x7f816c0075f0 comp rx=0 tx=0).stop 2023-11-08T19:24:45.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.311+0000 7f817734c700 1 -- 172.21.15.149:0/567864756 shutdown_connections 2023-11-08T19:24:45.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.311+0000 7f817734c700 1 --2- 172.21.15.149:0/567864756 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f815406af00 0x7f815406d3c0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:45.314 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.311+0000 7f817734c700 1 --2- 172.21.15.149:0/567864756 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f815c003a00 0x7f8170156a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:45.314 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.311+0000 7f817734c700 1 --2- 172.21.15.149:0/567864756 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f817015f600 0x7f81700b4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:45.314 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.311+0000 7f817734c700 1 --2- 172.21.15.149:0/567864756 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f81700b4540 0x7f817015f0c0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:45.314 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.311+0000 7f817734c700 1 -- 172.21.15.149:0/567864756 >> 172.21.15.149:0/567864756 conn(0x7f8170099a40 msgr2=0x7f81700c7670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:45.315 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.311+0000 7f817734c700 1 -- 172.21.15.149:0/567864756 shutdown_connections 2023-11-08T19:24:45.315 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.311+0000 7f817734c700 1 -- 172.21.15.149:0/567864756 wait complete. 2023-11-08T19:24:45.326 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-08T19:24:45.451 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.450+0000 7f1e696b3700 1 Processor -- start 2023-11-08T19:24:45.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.450+0000 7f1e696b3700 1 -- start start 2023-11-08T19:24:45.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.451+0000 7f1e696b3700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f1e6415d890 0x7f1e640b94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:45.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.451+0000 7f1e696b3700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1e6415dc70 0x7f1e64161590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:45.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.451+0000 7f1e696b3700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f1e640d0300 0x7f1e640d0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:45.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.451+0000 7f1e696b3700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e640b68f0 con 0x7f1e640d0300 2023-11-08T19:24:45.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.451+0000 7f1e696b3700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e640d0c70 con 0x7f1e6415d890 2023-11-08T19:24:45.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.451+0000 7f1e696b3700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e64161ca0 con 0x7f1e6415dc70 2023-11-08T19:24:45.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.451+0000 7f1e637fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f1e640d0300 0x7f1e640d0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:45.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.451+0000 7f1e637fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f1e640d0300 0x7f1e640d0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40042/0 (socket says 172.21.15.149:40042) 2023-11-08T19:24:45.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.451+0000 7f1e637fe700 1 -- 172.21.15.149:0/1289958047 learned_addr learned my addr 172.21.15.149:0/1289958047 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:45.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.451+0000 7f1e627fc700 1 --2- 172.21.15.149:0/1289958047 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1e6415dc70 0x7f1e64161590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:45.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.451+0000 7f1e62ffd700 1 --2- 172.21.15.149:0/1289958047 >> v2:172.21.15.160:3300/0 conn(0x7f1e6415d890 0x7f1e640b94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:45.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.451+0000 7f1e637fe700 1 -- 172.21.15.149:0/1289958047 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1e6415dc70 msgr2=0x7f1e64161590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:45.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.451+0000 7f1e637fe700 1 --2- 172.21.15.149:0/1289958047 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1e6415dc70 0x7f1e64161590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:45.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.451+0000 7f1e637fe700 1 -- 172.21.15.149:0/1289958047 >> v2:172.21.15.160:3300/0 conn(0x7f1e6415d890 msgr2=0x7f1e640b94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:45.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.451+0000 7f1e637fe700 1 --2- 172.21.15.149:0/1289958047 >> v2:172.21.15.160:3300/0 conn(0x7f1e6415d890 0x7f1e640b94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:45.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.451+0000 7f1e637fe700 1 -- 172.21.15.149:0/1289958047 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e64161f80 con 0x7f1e640d0300 2023-11-08T19:24:45.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.452+0000 7f1e637fe700 1 --2- 172.21.15.149:0/1289958047 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e640d0300 0x7f1e640d0730 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f1e640b6520 tx=0x7f1e5c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f796cda53cd6f271 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:45.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.452+0000 7f1e61ffb700 1 -- 172.21.15.149:0/1289958047 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c00e070 con 0x7f1e640d0300 2023-11-08T19:24:45.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.452+0000 7f1e61ffb700 1 -- 172.21.15.149:0/1289958047 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e5c00b910 con 0x7f1e640d0300 2023-11-08T19:24:45.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.452+0000 7f1e61ffb700 1 -- 172.21.15.149:0/1289958047 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c00bcc0 con 0x7f1e640d0300 2023-11-08T19:24:45.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.452+0000 7f1e696b3700 1 -- 172.21.15.149:0/1289958047 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e640d0300 msgr2=0x7f1e640d0730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:45.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.452+0000 7f1e696b3700 1 --2- 172.21.15.149:0/1289958047 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e640d0300 0x7f1e640d0730 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f1e640b6520 tx=0x7f1e5c00b330 comp rx=0 tx=0).stop 2023-11-08T19:24:45.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.452+0000 7f1e696b3700 1 -- 172.21.15.149:0/1289958047 shutdown_connections 2023-11-08T19:24:45.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.452+0000 7f1e696b3700 1 --2- 172.21.15.149:0/1289958047 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e640d0300 0x7f1e640d0730 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:45.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.452+0000 7f1e696b3700 1 --2- 172.21.15.149:0/1289958047 >> v2:172.21.15.160:3300/0 conn(0x7f1e6415d890 0x7f1e640b94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:45.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.452+0000 7f1e696b3700 1 --2- 172.21.15.149:0/1289958047 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1e6415dc70 0x7f1e64161590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:45.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.452+0000 7f1e696b3700 1 -- 172.21.15.149:0/1289958047 >> 172.21.15.149:0/1289958047 conn(0x7f1e6406bd60 msgr2=0x7f1e6406c140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:45.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.452+0000 7f1e696b3700 1 -- 172.21.15.149:0/1289958047 shutdown_connections 2023-11-08T19:24:45.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.452+0000 7f1e696b3700 1 -- 172.21.15.149:0/1289958047 wait complete. 2023-11-08T19:24:45.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.454+0000 7f1e696b3700 1 Processor -- start 2023-11-08T19:24:45.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.454+0000 7f1e696b3700 1 -- start start 2023-11-08T19:24:45.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.454+0000 7f1e696b3700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e640d0300 0x7f1e641f4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:45.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.454+0000 7f1e696b3700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1e6415d890 0x7f1e640c7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:45.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.454+0000 7f1e696b3700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e6415dc70 0x7f1e641f2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:45.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.454+0000 7f1e696b3700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e640c97b0 con 0x7f1e6415dc70 2023-11-08T19:24:45.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.454+0000 7f1e696b3700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e640c83b0 con 0x7f1e640d0300 2023-11-08T19:24:45.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.454+0000 7f1e696b3700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e640c8ba0 con 0x7f1e6415d890 2023-11-08T19:24:45.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.455+0000 7f1e637fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e6415dc70 0x7f1e641f2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:45.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.455+0000 7f1e637fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e6415dc70 0x7f1e641f2a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40048/0 (socket says 172.21.15.149:40048) 2023-11-08T19:24:45.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.455+0000 7f1e637fe700 1 -- 172.21.15.149:0/3476874430 learned_addr learned my addr 172.21.15.149:0/3476874430 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:45.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.455+0000 7f1e627fc700 1 --2- 172.21.15.149:0/3476874430 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1e6415d890 0x7f1e640c7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:45.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.455+0000 7f1e62ffd700 1 --2- 172.21.15.149:0/3476874430 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e640d0300 0x7f1e641f4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:45.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.455+0000 7f1e637fe700 1 -- 172.21.15.149:0/3476874430 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1e6415d890 msgr2=0x7f1e640c7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:45.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.455+0000 7f1e637fe700 1 --2- 172.21.15.149:0/3476874430 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1e6415d890 0x7f1e640c7e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:45.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.455+0000 7f1e637fe700 1 -- 172.21.15.149:0/3476874430 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e640d0300 msgr2=0x7f1e641f4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:45.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.455+0000 7f1e637fe700 1 --2- 172.21.15.149:0/3476874430 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e640d0300 0x7f1e641f4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:45.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.455+0000 7f1e637fe700 1 -- 172.21.15.149:0/3476874430 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e5c009b30 con 0x7f1e6415dc70 2023-11-08T19:24:45.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.455+0000 7f1e637fe700 1 --2- 172.21.15.149:0/3476874430 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e6415dc70 0x7f1e641f2a60 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f1e6406d2c0 tx=0x7f1e5c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:45.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.455+0000 7f1e4b7fe700 1 -- 172.21.15.149:0/3476874430 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c0099b0 con 0x7f1e6415dc70 2023-11-08T19:24:45.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.455+0000 7f1e4b7fe700 1 -- 172.21.15.149:0/3476874430 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e5c00ce80 con 0x7f1e6415dc70 2023-11-08T19:24:45.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.455+0000 7f1e696b3700 1 -- 172.21.15.149:0/3476874430 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e640c8e80 con 0x7f1e6415dc70 2023-11-08T19:24:45.468 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.455+0000 7f1e4b7fe700 1 -- 172.21.15.149:0/3476874430 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c004490 con 0x7f1e6415dc70 2023-11-08T19:24:45.468 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.455+0000 7f1e696b3700 1 -- 172.21.15.149:0/3476874430 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e640c9440 con 0x7f1e6415dc70 2023-11-08T19:24:45.468 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.456+0000 7f1e696b3700 1 -- 172.21.15.149:0/3476874430 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e6404f730 con 0x7f1e6415dc70 2023-11-08T19:24:45.468 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.457+0000 7f1e4b7fe700 1 -- 172.21.15.149:0/3476874430 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1e5c0045f0 con 0x7f1e6415dc70 2023-11-08T19:24:45.468 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.457+0000 7f1e4b7fe700 1 --2- 172.21.15.149:0/3476874430 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1e5006af00 0x7f1e5006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:45.469 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.457+0000 7f1e4b7fe700 1 -- 172.21.15.149:0/3476874430 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f1e5c08a840 con 0x7f1e6415dc70 2023-11-08T19:24:45.469 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.457+0000 7f1e62ffd700 1 --2- 172.21.15.149:0/3476874430 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1e5006af00 0x7f1e5006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:45.469 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.457+0000 7f1e62ffd700 1 --2- 172.21.15.149:0/3476874430 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1e5006af00 0x7f1e5006d3c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1e58009be0 tx=0x7f1e58009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:45.469 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.462+0000 7f1e4b7fe700 1 -- 172.21.15.149:0/3476874430 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1e5c055a90 con 0x7f1e6415dc70 2023-11-08T19:24:45.651 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.650+0000 7f1e696b3700 1 -- 172.21.15.149:0/3476874430 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f1e640d1500 con 0x7f1e6415dc70 2023-11-08T19:24:45.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.653+0000 7f1e4b7fe700 1 -- 172.21.15.149:0/3476874430 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v13)=0 v13) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1e5c020020 con 0x7f1e6415dc70 2023-11-08T19:24:45.657 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.655+0000 7f1e696b3700 1 -- 172.21.15.149:0/3476874430 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1e5006af00 msgr2=0x7f1e5006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:45.657 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.655+0000 7f1e696b3700 1 --2- 172.21.15.149:0/3476874430 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1e5006af00 0x7f1e5006d3c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1e58009be0 tx=0x7f1e58009210 comp rx=0 tx=0).stop 2023-11-08T19:24:45.657 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.655+0000 7f1e696b3700 1 -- 172.21.15.149:0/3476874430 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e6415dc70 msgr2=0x7f1e641f2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:45.657 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.655+0000 7f1e696b3700 1 --2- 172.21.15.149:0/3476874430 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e6415dc70 0x7f1e641f2a60 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f1e6406d2c0 tx=0x7f1e5c004ad0 comp rx=0 tx=0).stop 2023-11-08T19:24:45.658 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.655+0000 7f1e696b3700 1 -- 172.21.15.149:0/3476874430 shutdown_connections 2023-11-08T19:24:45.658 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.655+0000 7f1e696b3700 1 --2- 172.21.15.149:0/3476874430 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1e5006af00 0x7f1e5006d3c0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:45.658 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.655+0000 7f1e696b3700 1 --2- 172.21.15.149:0/3476874430 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e640d0300 0x7f1e641f4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:45.658 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.655+0000 7f1e696b3700 1 --2- 172.21.15.149:0/3476874430 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e6415dc70 0x7f1e641f2a60 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:45.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.655+0000 7f1e696b3700 1 --2- 172.21.15.149:0/3476874430 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1e6415d890 0x7f1e640c7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:45.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.655+0000 7f1e696b3700 1 -- 172.21.15.149:0/3476874430 >> 172.21.15.149:0/3476874430 conn(0x7f1e6406bd60 msgr2=0x7f1e64157160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:45.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.655+0000 7f1e696b3700 1 -- 172.21.15.149:0/3476874430 shutdown_connections 2023-11-08T19:24:45.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.655+0000 7f1e696b3700 1 -- 172.21.15.149:0/3476874430 wait complete. 2023-11-08T19:24:45.669 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-08T19:24:45.669 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-08T19:24:45.708 DEBUG:teuthology.orchestra.run.smithi160:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-08T19:24:45.755 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-08T19:24:45.756 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-11-08T19:24:45.756 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:24:45.774 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=8026740k,nr_inodes=2006685,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=31,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15303 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1609048k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-11-08T19:24:45.774 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-11-08T19:24:45.775 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:24:45.815 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284272k,nr_inodes=4071068,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16330 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-08T19:24:45.816 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-11-08T19:24:45.817 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:24:45.834 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=8026740k,nr_inodes=2006685,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=31,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15303 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1609048k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-11-08T19:24:45.834 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-11-08T19:24:45.835 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:24:45.874 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284272k,nr_inodes=4071068,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16330 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-08T19:24:45.875 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-08T19:24:45.876 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:24:45.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.995+0000 7f1411e1a700 1 Processor -- start 2023-11-08T19:24:45.997 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.995+0000 7f1411e1a700 1 -- start start 2023-11-08T19:24:45.999 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.996+0000 7f1411e1a700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f140c15db70 0x7f140c161dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:46.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.996+0000 7f1411e1a700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f140c06ab80 0x7f140c06b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:46.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.996+0000 7f1411e1a700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f140c161940 con 0x7f140c0b2c00 2023-11-08T19:24:46.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.996+0000 7f1411e1a700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f140c06b570 con 0x7f140c06ab80 2023-11-08T19:24:46.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.996+0000 7f1411e1a700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f140c15e660 con 0x7f140c15db70 2023-11-08T19:24:46.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.996+0000 7f140bfff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f140c06ab80 0x7f140c06b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:46.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.996+0000 7f140bfff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f140c06ab80 0x7f140c06b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40054/0 (socket says 172.21.15.149:40054) 2023-11-08T19:24:46.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.996+0000 7f140bfff700 1 -- 172.21.15.149:0/2461206156 learned_addr learned my addr 172.21.15.149:0/2461206156 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:46.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.996+0000 7f140bfff700 1 -- 172.21.15.149:0/2461206156 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f140c15db70 msgr2=0x7f140c161dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:46.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.996+0000 7f140bfff700 1 --2- 172.21.15.149:0/2461206156 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f140c15db70 0x7f140c161dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:46.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.996+0000 7f140bfff700 1 -- 172.21.15.149:0/2461206156 >> v1:172.21.15.160:6789/0 conn(0x7f140c0b2c00 legacy=0x7f140c15df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:46.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.996+0000 7f140bfff700 1 -- 172.21.15.149:0/2461206156 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f140c15eeb0 con 0x7f140c06ab80 2023-11-08T19:24:46.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.997+0000 7f140bfff700 1 --2- 172.21.15.149:0/2461206156 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f140c06ab80 0x7f140c06b030 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f1404009e50 tx=0x7f140400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6adf2beb1825eba server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:46.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.997+0000 7f140a7fc700 1 -- 172.21.15.149:0/2461206156 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140400e070 con 0x7f140c06ab80 2023-11-08T19:24:46.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.997+0000 7f140a7fc700 1 -- 172.21.15.149:0/2461206156 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1404003a20 con 0x7f140c06ab80 2023-11-08T19:24:46.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.997+0000 7f140a7fc700 1 -- 172.21.15.149:0/2461206156 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1404003dd0 con 0x7f140c06ab80 2023-11-08T19:24:46.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.997+0000 7f1411e1a700 1 -- 172.21.15.149:0/2461206156 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f140c06ab80 msgr2=0x7f140c06b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:46.004 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.997+0000 7f1411e1a700 1 --2- 172.21.15.149:0/2461206156 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f140c06ab80 0x7f140c06b030 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f1404009e50 tx=0x7f140400b330 comp rx=0 tx=0).stop 2023-11-08T19:24:46.004 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.997+0000 7f1411e1a700 1 -- 172.21.15.149:0/2461206156 shutdown_connections 2023-11-08T19:24:46.004 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.997+0000 7f1411e1a700 1 --2- 172.21.15.149:0/2461206156 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f140c06ab80 0x7f140c06b030 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:46.004 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.997+0000 7f1411e1a700 1 --2- 172.21.15.149:0/2461206156 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f140c15db70 0x7f140c161dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:46.005 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.997+0000 7f1411e1a700 1 -- 172.21.15.149:0/2461206156 >> 172.21.15.149:0/2461206156 conn(0x7f140c0ccff0 msgr2=0x7f140c0cd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:46.005 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.997+0000 7f1411e1a700 1 -- 172.21.15.149:0/2461206156 shutdown_connections 2023-11-08T19:24:46.005 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.997+0000 7f1411e1a700 1 -- 172.21.15.149:0/2461206156 wait complete. 2023-11-08T19:24:46.008 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.999+0000 7f1411e1a700 1 Processor -- start 2023-11-08T19:24:46.008 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:45.999+0000 7f1411e1a700 1 -- start start 2023-11-08T19:24:46.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.000+0000 7f1411e1a700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f140c06ab80 0x7f140c0c53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:46.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.000+0000 7f1411e1a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f140c0b2c00 0x7f140c0c6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:46.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.000+0000 7f1411e1a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f140c15db70 0x7f140c1e6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:46.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.000+0000 7f1411e1a700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f140c0c7010 con 0x7f140c0b2c00 2023-11-08T19:24:46.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.000+0000 7f1411e1a700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f140c0c6640 con 0x7f140c15db70 2023-11-08T19:24:46.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.000+0000 7f1411e1a700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f140c159010 con 0x7f140c06ab80 2023-11-08T19:24:46.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.000+0000 7f140affd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f140c0b2c00 0x7f140c0c6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:46.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.000+0000 7f140affd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f140c0b2c00 0x7f140c0c6ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40058/0 (socket says 172.21.15.149:40058) 2023-11-08T19:24:46.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.000+0000 7f140affd700 1 -- 172.21.15.149:0/4255386108 learned_addr learned my addr 172.21.15.149:0/4255386108 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:46.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.000+0000 7f140bfff700 1 --2- 172.21.15.149:0/4255386108 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f140c15db70 0x7f140c1e6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:46.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.000+0000 7f140b7fe700 1 --2- 172.21.15.149:0/4255386108 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f140c06ab80 0x7f140c0c53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:46.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.000+0000 7f140affd700 1 -- 172.21.15.149:0/4255386108 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f140c06ab80 msgr2=0x7f140c0c53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:46.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.000+0000 7f140affd700 1 --2- 172.21.15.149:0/4255386108 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f140c06ab80 0x7f140c0c53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:46.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.000+0000 7f140affd700 1 -- 172.21.15.149:0/4255386108 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f140c15db70 msgr2=0x7f140c1e6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:46.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.000+0000 7f140affd700 1 --2- 172.21.15.149:0/4255386108 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f140c15db70 0x7f140c1e6d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:46.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.000+0000 7f140affd700 1 -- 172.21.15.149:0/4255386108 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1404009b30 con 0x7f140c0b2c00 2023-11-08T19:24:46.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.001+0000 7f140affd700 1 --2- 172.21.15.149:0/4255386108 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f140c0b2c00 0x7f140c0c6ad0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f13fc00b450 tx=0x7f13fc00b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:46.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.001+0000 7f13f3fff700 1 -- 172.21.15.149:0/4255386108 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13fc011830 con 0x7f140c0b2c00 2023-11-08T19:24:46.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.001+0000 7f13f3fff700 1 -- 172.21.15.149:0/4255386108 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13fc011990 con 0x7f140c0b2c00 2023-11-08T19:24:46.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.001+0000 7f13f3fff700 1 -- 172.21.15.149:0/4255386108 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13fc011d20 con 0x7f140c0b2c00 2023-11-08T19:24:46.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.001+0000 7f1411e1a700 1 -- 172.21.15.149:0/4255386108 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f140c0c5a30 con 0x7f140c0b2c00 2023-11-08T19:24:46.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.001+0000 7f1411e1a700 1 -- 172.21.15.149:0/4255386108 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f140c0c5ff0 con 0x7f140c0b2c00 2023-11-08T19:24:46.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.002+0000 7f1411e1a700 1 -- 172.21.15.149:0/4255386108 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f140c0745f0 con 0x7f140c0b2c00 2023-11-08T19:24:46.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.002+0000 7f13f3fff700 1 -- 172.21.15.149:0/4255386108 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f13fc01a400 con 0x7f140c0b2c00 2023-11-08T19:24:46.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.003+0000 7f13f3fff700 1 --2- 172.21.15.149:0/4255386108 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f13f806af00 0x7f13f806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:46.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.003+0000 7f13f3fff700 1 -- 172.21.15.149:0/4255386108 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f13fc0895d0 con 0x7f140c0b2c00 2023-11-08T19:24:46.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.003+0000 7f140b7fe700 1 --2- 172.21.15.149:0/4255386108 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f13f806af00 0x7f13f806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:46.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.003+0000 7f140b7fe700 1 --2- 172.21.15.149:0/4255386108 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f13f806af00 0x7f13f806d3c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1400006fd0 tx=0x7f1400008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:46.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.007+0000 7f13f3fff700 1 -- 172.21.15.149:0/4255386108 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f13fc0546e0 con 0x7f140c0b2c00 2023-11-08T19:24:46.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.239+0000 7f1411e1a700 1 -- 172.21.15.149:0/4255386108 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f140c0c6780 con 0x7f140c0b2c00 2023-11-08T19:24:46.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.240+0000 7f13f3fff700 1 -- 172.21.15.149:0/4255386108 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+3711 (secure 0 0 0) 0x7f13fc057d00 con 0x7f140c0b2c00 2023-11-08T19:24:46.242 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:24:46.242 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":19,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4877,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/3602590195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3602590195},{"type":"v1","addr":"172.21.15.160:6834","nonce":3602590195}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5107,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/1432406788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":1432406788},{"type":"v1","addr":"172.21.15.160:6835","nonce":1432406788}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5125,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/3066975859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3066975859},{"type":"v1","addr":"172.21.15.149:6837","nonce":3066975859}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5652,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/1294077527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":1294077527},{"type":"v1","addr":"172.21.15.149:6836","nonce":1294077527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[]} 2023-11-08T19:24:46.244 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.242+0000 7f1411e1a700 1 -- 172.21.15.149:0/4255386108 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f13f806af00 msgr2=0x7f13f806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:46.244 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.242+0000 7f1411e1a700 1 --2- 172.21.15.149:0/4255386108 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f13f806af00 0x7f13f806d3c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1400006fd0 tx=0x7f1400008040 comp rx=0 tx=0).stop 2023-11-08T19:24:46.244 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.242+0000 7f1411e1a700 1 -- 172.21.15.149:0/4255386108 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f140c0b2c00 msgr2=0x7f140c0c6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:46.244 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.242+0000 7f1411e1a700 1 --2- 172.21.15.149:0/4255386108 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f140c0b2c00 0x7f140c0c6ad0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f13fc00b450 tx=0x7f13fc00b810 comp rx=0 tx=0).stop 2023-11-08T19:24:46.245 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.242+0000 7f1411e1a700 1 -- 172.21.15.149:0/4255386108 shutdown_connections 2023-11-08T19:24:46.245 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.242+0000 7f1411e1a700 1 --2- 172.21.15.149:0/4255386108 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f13f806af00 0x7f13f806d3c0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:46.245 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.242+0000 7f1411e1a700 1 --2- 172.21.15.149:0/4255386108 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f140c15db70 0x7f140c1e6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:46.245 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.242+0000 7f1411e1a700 1 --2- 172.21.15.149:0/4255386108 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f140c06ab80 0x7f140c0c53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:46.246 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.242+0000 7f1411e1a700 1 --2- 172.21.15.149:0/4255386108 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f140c0b2c00 0x7f140c0c6ad0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:46.246 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.242+0000 7f1411e1a700 1 -- 172.21.15.149:0/4255386108 >> 172.21.15.149:0/4255386108 conn(0x7f140c0ccff0 msgr2=0x7f140c15cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:46.246 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.243+0000 7f1411e1a700 1 -- 172.21.15.149:0/4255386108 shutdown_connections 2023-11-08T19:24:46.247 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.243+0000 7f1411e1a700 1 -- 172.21.15.149:0/4255386108 wait complete. 2023-11-08T19:24:46.247 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 19 2023-11-08T19:24:46.256 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-08T19:24:46.256 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-08T19:24:46.257 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-08T19:24:46.257 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T19:24:46.257 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-08T19:24:46.257 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-08T19:24:46.258 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-08T19:24:46.258 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T19:24:46.258 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-08T19:24:46.259 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-08T19:24:46.259 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-08T19:24:46.259 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T19:24:46.260 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-08T19:24:46.260 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-08T19:24:46.260 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-08T19:24:46.260 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T19:24:46.266 INFO:tasks.ceph.mds.a:Stopped 2023-11-08T19:24:46.267 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-08T19:24:46.268 INFO:tasks.ceph.mds.c:Stopped 2023-11-08T19:24:46.268 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-08T19:24:46.270 INFO:tasks.ceph.mds.b:Stopped 2023-11-08T19:24:46.270 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-08T19:24:46.272 INFO:tasks.ceph.mds.d:Stopped 2023-11-08T19:24:46.272 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-08T19:24:46.309 INFO:tasks.ceph.mds.a:Started 2023-11-08T19:24:46.310 DEBUG:teuthology.parallel:result is None 2023-11-08T19:24:46.310 INFO:tasks.ceph.mds.c:Started 2023-11-08T19:24:46.311 DEBUG:teuthology.parallel:result is None 2023-11-08T19:24:46.313 INFO:tasks.ceph.mds.b:Started 2023-11-08T19:24:46.313 DEBUG:teuthology.parallel:result is None 2023-11-08T19:24:46.315 INFO:tasks.ceph.mds.d:Started 2023-11-08T19:24:46.315 DEBUG:teuthology.parallel:result is None 2023-11-08T19:24:46.315 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-08T19:24:46.389 INFO:tasks.ceph.mds.a.smithi149.stdout:starting mds.a at 2023-11-08T19:24:46.390 INFO:tasks.ceph.mds.c.smithi149.stdout:starting mds.c at 2023-11-08T19:24:46.399 INFO:tasks.ceph.mds.b.smithi160.stdout:starting mds.b at 2023-11-08T19:24:46.400 INFO:tasks.ceph.mds.d.smithi160.stdout:starting mds.d at 2023-11-08T19:24:46.444 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.443+0000 7fdf5d76d700 1 Processor -- start 2023-11-08T19:24:46.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.443+0000 7fdf5d76d700 1 -- start start 2023-11-08T19:24:46.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.444+0000 7fdf5d76d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fdf58161670 0x7fdf580b5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:46.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.444+0000 7fdf5d76d700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf580d1a10 con 0x7fdf58161a50 2023-11-08T19:24:46.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.444+0000 7fdf5d76d700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf580d1cf0 con 0x7fdf580ce500 2023-11-08T19:24:46.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.444+0000 7fdf5d76d700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf580d1fd0 con 0x7fdf58161670 2023-11-08T19:24:46.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.444+0000 7fdf56ffd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fdf58161670 0x7fdf580b5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:46.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.444+0000 7fdf567fc700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fdf58161a50 0x7fdf58161f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:42092/0 (socket says 172.21.15.149:42092) 2023-11-08T19:24:46.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.444+0000 7fdf567fc700 1 -- 172.21.15.149:0/2098195393 learned_addr learned my addr 172.21.15.149:0/2098195393 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:24:46.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.444+0000 7fdf56ffd700 1 -- 172.21.15.149:0/2098195393 >> v1:172.21.15.160:6789/0 conn(0x7fdf580ce500 legacy=0x7fdf580ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:46.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.444+0000 7fdf56ffd700 1 -- 172.21.15.149:0/2098195393 >> v1:172.21.15.149:6789/0 conn(0x7fdf58161a50 legacy=0x7fdf58161f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:46.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.444+0000 7fdf56ffd700 1 -- 172.21.15.149:0/2098195393 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf580d22b0 con 0x7fdf58161670 2023-11-08T19:24:46.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.444+0000 7fdf56ffd700 1 --2- 172.21.15.149:0/2098195393 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf58161670 0x7fdf580b5e10 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c009820 tx=0x7fdf4c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=209cd0a4ac1921cd server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:46.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.445+0000 7fdf55ffb700 1 -- 172.21.15.149:0/2098195393 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4c005e30 con 0x7fdf58161670 2023-11-08T19:24:46.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.445+0000 7fdf55ffb700 1 -- 172.21.15.149:0/2098195393 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf4c006030 con 0x7fdf58161670 2023-11-08T19:24:46.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.445+0000 7fdf55ffb700 1 -- 172.21.15.149:0/2098195393 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4c0063e0 con 0x7fdf58161670 2023-11-08T19:24:46.450 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.445+0000 7fdf5d76d700 1 -- 172.21.15.149:0/2098195393 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf58161670 msgr2=0x7fdf580b5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:46.450 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.445+0000 7fdf5d76d700 1 --2- 172.21.15.149:0/2098195393 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf58161670 0x7fdf580b5e10 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c009820 tx=0x7fdf4c009b30 comp rx=0 tx=0).stop 2023-11-08T19:24:46.450 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.445+0000 7fdf5d76d700 1 -- 172.21.15.149:0/2098195393 shutdown_connections 2023-11-08T19:24:46.450 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.445+0000 7fdf5d76d700 1 --2- 172.21.15.149:0/2098195393 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf58161670 0x7fdf580b5e10 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:46.451 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.445+0000 7fdf5d76d700 1 -- 172.21.15.149:0/2098195393 >> 172.21.15.149:0/2098195393 conn(0x7fdf580d3980 msgr2=0x7fdf580d3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:46.451 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.445+0000 7fdf5d76d700 1 -- 172.21.15.149:0/2098195393 shutdown_connections 2023-11-08T19:24:46.451 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.445+0000 7fdf5d76d700 1 -- 172.21.15.149:0/2098195393 wait complete. 2023-11-08T19:24:46.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.446+0000 7fdf5d76d700 1 Processor -- start 2023-11-08T19:24:46.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.447+0000 7fdf5d76d700 1 -- start start 2023-11-08T19:24:46.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.447+0000 7fdf5d76d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf580ce500 0x7fdf580a1190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:46.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.447+0000 7fdf5d76d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdf58161670 0x7fdf580c9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:46.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.447+0000 7fdf5d76d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf58161a50 0x7fdf5815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:46.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.447+0000 7fdf5d76d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf580ca090 con 0x7fdf580ce500 2023-11-08T19:24:46.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.447+0000 7fdf5d76d700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf580ca360 con 0x7fdf58161a50 2023-11-08T19:24:46.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.447+0000 7fdf5d76d700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf580ca640 con 0x7fdf58161670 2023-11-08T19:24:46.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.447+0000 7fdf56ffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf580ce500 0x7fdf580a1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:46.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.447+0000 7fdf56ffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf580ce500 0x7fdf580a1190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40094/0 (socket says 172.21.15.149:40094) 2023-11-08T19:24:46.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.447+0000 7fdf56ffd700 1 -- 172.21.15.149:0/1335347283 learned_addr learned my addr 172.21.15.149:0/1335347283 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:46.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.448+0000 7fdf567fc700 1 --2- 172.21.15.149:0/1335347283 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdf58161670 0x7fdf580c9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:46.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.448+0000 7fdf577fe700 1 --2- 172.21.15.149:0/1335347283 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf58161a50 0x7fdf5815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:46.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.448+0000 7fdf56ffd700 1 -- 172.21.15.149:0/1335347283 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdf58161670 msgr2=0x7fdf580c9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:46.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.448+0000 7fdf56ffd700 1 --2- 172.21.15.149:0/1335347283 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdf58161670 0x7fdf580c9b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:46.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.448+0000 7fdf56ffd700 1 -- 172.21.15.149:0/1335347283 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf58161a50 msgr2=0x7fdf5815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:46.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.448+0000 7fdf56ffd700 1 --2- 172.21.15.149:0/1335347283 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf58161a50 0x7fdf5815abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:46.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.448+0000 7fdf56ffd700 1 -- 172.21.15.149:0/1335347283 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf4c009430 con 0x7fdf580ce500 2023-11-08T19:24:46.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.448+0000 7fdf577fe700 1 --2- 172.21.15.149:0/1335347283 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf58161a50 0x7fdf5815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:24:46.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.448+0000 7fdf56ffd700 1 --2- 172.21.15.149:0/1335347283 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf580ce500 0x7fdf580a1190 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c000c00 tx=0x7fdf4c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:46.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.448+0000 7fdf3f7fe700 1 -- 172.21.15.149:0/1335347283 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4c004240 con 0x7fdf580ce500 2023-11-08T19:24:46.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.448+0000 7fdf3f7fe700 1 -- 172.21.15.149:0/1335347283 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf4c020070 con 0x7fdf580ce500 2023-11-08T19:24:46.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.448+0000 7fdf5d76d700 1 -- 172.21.15.149:0/1335347283 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf580ca9c0 con 0x7fdf580ce500 2023-11-08T19:24:46.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.448+0000 7fdf3f7fe700 1 -- 172.21.15.149:0/1335347283 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4c0045e0 con 0x7fdf580ce500 2023-11-08T19:24:46.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.448+0000 7fdf5d76d700 1 -- 172.21.15.149:0/1335347283 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf580caf80 con 0x7fdf580ce500 2023-11-08T19:24:46.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.449+0000 7fdf5d76d700 1 -- 172.21.15.149:0/1335347283 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf580745f0 con 0x7fdf580ce500 2023-11-08T19:24:46.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.450+0000 7fdf3f7fe700 1 -- 172.21.15.149:0/1335347283 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdf4c022030 con 0x7fdf580ce500 2023-11-08T19:24:46.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.450+0000 7fdf3f7fe700 1 --2- 172.21.15.149:0/1335347283 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fdf4406af00 0x7fdf4406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:46.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.450+0000 7fdf567fc700 1 --2- 172.21.15.149:0/1335347283 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fdf4406af00 0x7fdf4406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:46.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.450+0000 7fdf3f7fe700 1 -- 172.21.15.149:0/1335347283 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fdf4c08ad40 con 0x7fdf580ce500 2023-11-08T19:24:46.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.450+0000 7fdf567fc700 1 --2- 172.21.15.149:0/1335347283 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fdf4406af00 0x7fdf4406d3c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fdf581e7340 tx=0x7fdf48009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:46.468 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.455+0000 7fdf3f7fe700 1 -- 172.21.15.149:0/1335347283 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdf4c055e60 con 0x7fdf580ce500 2023-11-08T19:24:46.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:46.660+0000 7fdf5d76d700 1 -- 172.21.15.149:0/1335347283 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fdf5808b060 con 0x7fdf580ce500 2023-11-08T19:24:47.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.681+0000 7fdf3f7fe700 1 -- 172.21.15.149:0/1335347283 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v51) v1 ==== 97+0+0 (secure 0 0 0) 0x7fdf4c059480 con 0x7fdf580ce500 2023-11-08T19:24:47.686 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.684+0000 7fdf5d76d700 1 -- 172.21.15.149:0/1335347283 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fdf4406af00 msgr2=0x7fdf4406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:47.686 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.684+0000 7fdf5d76d700 1 --2- 172.21.15.149:0/1335347283 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fdf4406af00 0x7fdf4406d3c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fdf581e7340 tx=0x7fdf48009040 comp rx=0 tx=0).stop 2023-11-08T19:24:47.686 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.684+0000 7fdf5d76d700 1 -- 172.21.15.149:0/1335347283 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf580ce500 msgr2=0x7fdf580a1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:47.686 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.684+0000 7fdf5d76d700 1 --2- 172.21.15.149:0/1335347283 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf580ce500 0x7fdf580a1190 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c000c00 tx=0x7fdf4c004750 comp rx=0 tx=0).stop 2023-11-08T19:24:47.687 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.684+0000 7fdf5d76d700 1 -- 172.21.15.149:0/1335347283 shutdown_connections 2023-11-08T19:24:47.687 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.684+0000 7fdf5d76d700 1 --2- 172.21.15.149:0/1335347283 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fdf4406af00 0x7fdf4406d3c0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:47.687 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.684+0000 7fdf5d76d700 1 --2- 172.21.15.149:0/1335347283 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf58161a50 0x7fdf5815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:47.687 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.684+0000 7fdf5d76d700 1 --2- 172.21.15.149:0/1335347283 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf580ce500 0x7fdf580a1190 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:47.687 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.684+0000 7fdf5d76d700 1 --2- 172.21.15.149:0/1335347283 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdf58161670 0x7fdf580c9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:47.688 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.684+0000 7fdf5d76d700 1 -- 172.21.15.149:0/1335347283 >> 172.21.15.149:0/1335347283 conn(0x7fdf580d3980 msgr2=0x7fdf5815d060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:47.688 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.684+0000 7fdf5d76d700 1 -- 172.21.15.149:0/1335347283 shutdown_connections 2023-11-08T19:24:47.688 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.684+0000 7fdf5d76d700 1 -- 172.21.15.149:0/1335347283 wait complete. 2023-11-08T19:24:47.688 INFO:teuthology.orchestra.run.smithi149.stderr: removed all blocklist entries 2023-11-08T19:24:47.700 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-08T19:24:47.828 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.827+0000 7f8735369700 1 Processor -- start 2023-11-08T19:24:47.828 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.827+0000 7f8735369700 1 -- start start 2023-11-08T19:24:47.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.827+0000 7f8735369700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f87300ced30 0x7f873006ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:47.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.827+0000 7f8735369700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f873006fd20 con 0x7f873006bb90 2023-11-08T19:24:47.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.827+0000 7f8735369700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f873006ffb0 con 0x7f873015dc10 2023-11-08T19:24:47.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.827+0000 7f8735369700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f873006dfd0 con 0x7f87300ced30 2023-11-08T19:24:47.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.828+0000 7f872f7fe700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f873006bb90 0x7f87300ca360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:42108/0 (socket says 172.21.15.149:42108) 2023-11-08T19:24:47.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.828+0000 7f872f7fe700 1 -- 172.21.15.149:0/1608439107 learned_addr learned my addr 172.21.15.149:0/1608439107 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:24:47.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.828+0000 7f872e7fc700 1 --2- 172.21.15.149:0/1608439107 >> v2:172.21.15.160:3300/0 conn(0x7f87300ced30 0x7f873006ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:47.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.828+0000 7f872dffb700 1 -- 172.21.15.149:0/1608439107 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3389847994 0 0) 0x7f873006fd20 con 0x7f873006bb90 2023-11-08T19:24:47.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.828+0000 7f872dffb700 1 -- 172.21.15.149:0/1608439107 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87180035b0 con 0x7f873006bb90 2023-11-08T19:24:47.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.828+0000 7f872dffb700 1 -- 172.21.15.149:0/1608439107 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2788391863 0 0) 0x7f87180035b0 con 0x7f873006bb90 2023-11-08T19:24:47.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.828+0000 7f872dffb700 1 -- 172.21.15.149:0/1608439107 >> v2:172.21.15.160:3300/0 conn(0x7f87300ced30 msgr2=0x7f873006ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:47.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.828+0000 7f872dffb700 1 --2- 172.21.15.149:0/1608439107 >> v2:172.21.15.160:3300/0 conn(0x7f87300ced30 0x7f873006ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:47.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.828+0000 7f872dffb700 1 -- 172.21.15.149:0/1608439107 >> v1:172.21.15.160:6789/0 conn(0x7f873015dc10 legacy=0x7f873006f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:47.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.828+0000 7f872dffb700 1 -- 172.21.15.149:0/1608439107 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f873006e2b0 con 0x7f873006bb90 2023-11-08T19:24:47.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.828+0000 7f872dffb700 1 -- 172.21.15.149:0/1608439107 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f87280019f0 con 0x7f873006bb90 2023-11-08T19:24:47.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.828+0000 7f872dffb700 1 -- 172.21.15.149:0/1608439107 >> v1:172.21.15.149:6789/0 conn(0x7f873006bb90 legacy=0x7f87300ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:47.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.828+0000 7f872dffb700 1 --2- 172.21.15.149:0/1608439107 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8718003a00 0x7f8718003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:47.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.828+0000 7f872dffb700 1 --2- 172.21.15.149:0/1608439107 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8718004850 0x7f8718004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:47.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.828+0000 7f872dffb700 1 --2- 172.21.15.149:0/1608439107 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8718005210 0x7f871800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:47.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.828+0000 7f872dffb700 1 -- 172.21.15.149:0/1608439107 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f873006dfd0 con 0x7f8718003a00 2023-11-08T19:24:47.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.828+0000 7f872dffb700 1 -- 172.21.15.149:0/1608439107 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871800c0c0 con 0x7f8718004850 2023-11-08T19:24:47.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.828+0000 7f872dffb700 1 -- 172.21.15.149:0/1608439107 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f871800c280 con 0x7f8718005210 2023-11-08T19:24:47.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.828+0000 7f872effd700 1 --2- 172.21.15.149:0/1608439107 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8718003a00 0x7f8718003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:47.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.828+0000 7f872e7fc700 1 --2- 172.21.15.149:0/1608439107 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8718004850 0x7f8718004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:47.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.828+0000 7f872f7fe700 1 --2- 172.21.15.149:0/1608439107 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8718005210 0x7f871800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:47.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.829+0000 7f872effd700 1 -- 172.21.15.149:0/1608439107 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8718005210 msgr2=0x7f871800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:47.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.829+0000 7f872effd700 1 --2- 172.21.15.149:0/1608439107 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8718005210 0x7f871800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:47.842 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.829+0000 7f872effd700 1 -- 172.21.15.149:0/1608439107 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8718004850 msgr2=0x7f8718004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:47.842 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.829+0000 7f872effd700 1 --2- 172.21.15.149:0/1608439107 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8718004850 0x7f8718004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:47.842 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.829+0000 7f872effd700 1 -- 172.21.15.149:0/1608439107 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87180035b0 con 0x7f8718003a00 2023-11-08T19:24:47.842 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.829+0000 7f872f7fe700 1 --2- 172.21.15.149:0/1608439107 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8718005210 0x7f871800ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:24:47.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.829+0000 7f872f7fe700 1 -- 172.21.15.149:0/1608439107 reap_dead start 2023-11-08T19:24:47.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.829+0000 7f872effd700 1 --2- 172.21.15.149:0/1608439107 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8718003a00 0x7f8718003e20 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f87200017c0 tx=0x7f8718005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfe7dc5fdece49e9 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:47.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.829+0000 7f872dffb700 1 -- 172.21.15.149:0/1608439107 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87200052d0 con 0x7f8718003a00 2023-11-08T19:24:47.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.829+0000 7f872dffb700 1 -- 172.21.15.149:0/1608439107 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8720005430 con 0x7f8718003a00 2023-11-08T19:24:47.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.829+0000 7f872dffb700 1 -- 172.21.15.149:0/1608439107 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87200038c0 con 0x7f8718003a00 2023-11-08T19:24:47.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.829+0000 7f8735369700 1 -- 172.21.15.149:0/1608439107 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8718003a00 msgr2=0x7f8718003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:47.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.829+0000 7f8735369700 1 --2- 172.21.15.149:0/1608439107 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8718003a00 0x7f8718003e20 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f87200017c0 tx=0x7f8718005880 comp rx=0 tx=0).stop 2023-11-08T19:24:47.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.829+0000 7f8735369700 1 -- 172.21.15.149:0/1608439107 shutdown_connections 2023-11-08T19:24:47.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.829+0000 7f8735369700 1 --2- 172.21.15.149:0/1608439107 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8718003a00 0x7f8718003e20 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:47.845 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.829+0000 7f8735369700 1 -- 172.21.15.149:0/1608439107 >> 172.21.15.149:0/1608439107 conn(0x7f8730071670 msgr2=0x7f8730071a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:47.845 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.829+0000 7f8735369700 1 -- 172.21.15.149:0/1608439107 shutdown_connections 2023-11-08T19:24:47.845 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.829+0000 7f8735369700 1 -- 172.21.15.149:0/1608439107 wait complete. 2023-11-08T19:24:47.845 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.831+0000 7f8735369700 1 Processor -- start 2023-11-08T19:24:47.845 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.831+0000 7f8735369700 1 -- start start 2023-11-08T19:24:47.846 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.831+0000 7f8735369700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8718003a00 0x7f87301582d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:47.846 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.831+0000 7f8735369700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8730155de0 0x7f873015ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:47.846 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.831+0000 7f8735369700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f87301f4910 0x7f87300aec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:47.846 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.831+0000 7f8735369700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87301580d0 con 0x7f8730155de0 2023-11-08T19:24:47.847 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.831+0000 7f8735369700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87301f3850 con 0x7f87301f4910 2023-11-08T19:24:47.847 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.831+0000 7f8735369700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8730156270 con 0x7f8718003a00 2023-11-08T19:24:47.847 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.832+0000 7f872e7fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8730155de0 0x7f873015ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:47.847 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.832+0000 7f872e7fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8730155de0 0x7f873015ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40116/0 (socket says 172.21.15.149:40116) 2023-11-08T19:24:47.847 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.832+0000 7f872e7fc700 1 -- 172.21.15.149:0/2500993566 learned_addr learned my addr 172.21.15.149:0/2500993566 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:47.848 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.832+0000 7f872f7fe700 1 --2- 172.21.15.149:0/2500993566 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f87301f4910 0x7f87300aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:47.848 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.832+0000 7f872effd700 1 --2- 172.21.15.149:0/2500993566 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8718003a00 0x7f87301582d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:47.848 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.832+0000 7f872e7fc700 1 -- 172.21.15.149:0/2500993566 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8718003a00 msgr2=0x7f87301582d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:47.848 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.832+0000 7f872e7fc700 1 --2- 172.21.15.149:0/2500993566 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8718003a00 0x7f87301582d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:47.849 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.832+0000 7f872e7fc700 1 -- 172.21.15.149:0/2500993566 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f87301f4910 msgr2=0x7f87300aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:47.849 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.832+0000 7f872e7fc700 1 --2- 172.21.15.149:0/2500993566 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f87301f4910 0x7f87300aec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:47.849 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.832+0000 7f872e7fc700 1 -- 172.21.15.149:0/2500993566 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8730156550 con 0x7f8730155de0 2023-11-08T19:24:47.849 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.832+0000 7f872e7fc700 1 --2- 172.21.15.149:0/2500993566 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8730155de0 0x7f873015ffb0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f8724011aa0 tx=0x7f8724011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:47.849 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.832+0000 7f87177fe700 1 -- 172.21.15.149:0/2500993566 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872400f9e0 con 0x7f8730155de0 2023-11-08T19:24:47.850 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.832+0000 7f87177fe700 1 -- 172.21.15.149:0/2500993566 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f872400fb40 con 0x7f8730155de0 2023-11-08T19:24:47.850 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.832+0000 7f8735369700 1 -- 172.21.15.149:0/2500993566 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8730156830 con 0x7f8730155de0 2023-11-08T19:24:47.850 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.832+0000 7f87177fe700 1 -- 172.21.15.149:0/2500993566 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8724014440 con 0x7f8730155de0 2023-11-08T19:24:47.850 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.832+0000 7f8735369700 1 -- 172.21.15.149:0/2500993566 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8730158810 con 0x7f8730155de0 2023-11-08T19:24:47.851 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.833+0000 7f8735369700 1 -- 172.21.15.149:0/2500993566 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87301f39c0 con 0x7f8730155de0 2023-11-08T19:24:47.851 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.834+0000 7f87177fe700 1 -- 172.21.15.149:0/2500993566 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f87240145a0 con 0x7f8730155de0 2023-11-08T19:24:47.851 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.834+0000 7f87177fe700 1 --2- 172.21.15.149:0/2500993566 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f871c06af00 0x7f871c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:47.851 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.834+0000 7f87177fe700 1 -- 172.21.15.149:0/2500993566 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f8724089c20 con 0x7f8730155de0 2023-11-08T19:24:47.852 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.834+0000 7f872effd700 1 --2- 172.21.15.149:0/2500993566 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f871c06af00 0x7f871c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:47.852 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.835+0000 7f872effd700 1 --2- 172.21.15.149:0/2500993566 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f871c06af00 0x7f871c06d3c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8720015040 tx=0x7f8720009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:47.852 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:47.839+0000 7f87177fe700 1 -- 172.21.15.149:0/2500993566 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8724054e10 con 0x7f8730155de0 2023-11-08T19:24:48.106 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.104+0000 7f8735369700 1 -- 172.21.15.149:0/2500993566 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f87300745f0 con 0x7f8730155de0 2023-11-08T19:24:48.106 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.105+0000 7f87177fe700 1 -- 172.21.15.149:0/2500993566 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f8724058430 con 0x7f8730155de0 2023-11-08T19:24:48.106 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:24:48.107 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2023-11-08T19:24:48.107 INFO:teuthology.orchestra.run.smithi149.stdout: "auth_dump": [ 2023-11-08T19:24:48.107 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:24:48.107 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "mds.a", 2023-11-08T19:24:48.108 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDi30tlcD8lHxAAxmvMr1hdJWLyJ0wOQhILow==", 2023-11-08T19:24:48.108 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:24:48.108 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow", 2023-11-08T19:24:48.108 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow *", 2023-11-08T19:24:48.109 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow *", 2023-11-08T19:24:48.109 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:24:48.109 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:24:48.109 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:24:48.109 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:24:48.110 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "mds.b", 2023-11-08T19:24:48.110 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDi30tl0d56KxAA42ebu7JWPHSW2Y+aUT9G8Q==", 2023-11-08T19:24:48.110 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:24:48.110 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow", 2023-11-08T19:24:48.111 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow *", 2023-11-08T19:24:48.111 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow *", 2023-11-08T19:24:48.111 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:24:48.111 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:24:48.111 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:24:48.112 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:24:48.112 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "mds.c", 2023-11-08T19:24:48.112 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDi30tl+SliJhAAznNm6dtyajBE0T8WKqdhhw==", 2023-11-08T19:24:48.112 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:24:48.113 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow", 2023-11-08T19:24:48.113 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow *", 2023-11-08T19:24:48.113 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow *", 2023-11-08T19:24:48.113 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:24:48.113 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:24:48.114 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:24:48.114 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:24:48.114 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "mds.d", 2023-11-08T19:24:48.114 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDi30tl9sLWMhAACaIzwVjIgVky9P6tAK9/rw==", 2023-11-08T19:24:48.114 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:24:48.115 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow", 2023-11-08T19:24:48.115 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow *", 2023-11-08T19:24:48.115 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow *", 2023-11-08T19:24:48.115 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:24:48.116 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:24:48.116 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:24:48.116 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:24:48.116 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "osd.0", 2023-11-08T19:24:48.116 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDm30tl1SLuEBAA8gYyfPfXV+rd7sXTr5NytA==", 2023-11-08T19:24:48.117 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:24:48.117 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow profile osd", 2023-11-08T19:24:48.117 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile osd", 2023-11-08T19:24:48.117 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:24:48.117 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:24:48.118 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:24:48.118 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:24:48.118 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "osd.1", 2023-11-08T19:24:48.118 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDp30tllvSCEBAAgyXiQm+ld9zVjv2Uo2UilA==", 2023-11-08T19:24:48.119 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:24:48.119 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow profile osd", 2023-11-08T19:24:48.119 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile osd", 2023-11-08T19:24:48.119 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:24:48.119 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:24:48.120 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:24:48.120 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:24:48.120 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "osd.2", 2023-11-08T19:24:48.120 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDs30tlGvZ9DxAAzOPbDXlbk+oxHvXhNfPnNQ==", 2023-11-08T19:24:48.121 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:24:48.121 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow profile osd", 2023-11-08T19:24:48.121 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile osd", 2023-11-08T19:24:48.121 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:24:48.121 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:24:48.122 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:24:48.122 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:24:48.122 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "osd.3", 2023-11-08T19:24:48.122 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDv30tlg0i3DhAAKEy9WQ+VBcJMuKALuYVTEg==", 2023-11-08T19:24:48.122 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:24:48.123 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow profile osd", 2023-11-08T19:24:48.123 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile osd", 2023-11-08T19:24:48.123 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:24:48.123 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:24:48.123 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:24:48.124 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:24:48.124 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "osd.4", 2023-11-08T19:24:48.124 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQD130tlrd3gFRAA0IM+0Dr48SgjXRHcCzypfg==", 2023-11-08T19:24:48.124 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:24:48.124 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow profile osd", 2023-11-08T19:24:48.125 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile osd", 2023-11-08T19:24:48.125 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:24:48.125 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:24:48.125 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:24:48.126 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:24:48.126 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "osd.5", 2023-11-08T19:24:48.126 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQD430tlCMCRFRAAJwP6E9TRRNneQzL7TVU6jg==", 2023-11-08T19:24:48.127 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:24:48.127 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow profile osd", 2023-11-08T19:24:48.127 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile osd", 2023-11-08T19:24:48.127 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:24:48.249 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:24:48.250 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:24:48.250 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:24:48.250 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "osd.6", 2023-11-08T19:24:48.250 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQD730tl176/FBAADjNAIKgdn3bIRlN725KW7g==", 2023-11-08T19:24:48.251 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:24:48.251 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow profile osd", 2023-11-08T19:24:48.251 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile osd", 2023-11-08T19:24:48.251 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:24:48.251 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:24:48.252 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:24:48.252 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:24:48.252 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "osd.7", 2023-11-08T19:24:48.252 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQD+30tl6CCxFBAAcProM9OqTGE6LtReNxvljA==", 2023-11-08T19:24:48.252 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:24:48.253 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow profile osd", 2023-11-08T19:24:48.253 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile osd", 2023-11-08T19:24:48.253 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:24:48.253 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:24:48.253 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:24:48.254 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:24:48.254 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "client.0", 2023-11-08T19:24:48.254 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDi30tlQEEsNxAAiPozrOREh+IJXoj7ZkhvLg==", 2023-11-08T19:24:48.254 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:24:48.254 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow", 2023-11-08T19:24:48.255 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow r", 2023-11-08T19:24:48.255 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-08T19:24:48.255 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:24:48.255 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:24:48.255 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:24:48.255 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "client.1", 2023-11-08T19:24:48.256 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDj30tluO08AhAAKiNHfc6ETU6HU+0PSkRTdg==", 2023-11-08T19:24:48.256 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:24:48.256 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow", 2023-11-08T19:24:48.256 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow r", 2023-11-08T19:24:48.256 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow rw", 2023-11-08T19:24:48.256 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow rwx" 2023-11-08T19:24:48.257 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:24:48.257 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:24:48.257 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:24:48.257 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "client.2", 2023-11-08T19:24:48.257 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDi30tlZfZ+OhAAak0bEZA4XzCWwYINh0SvGQ==", 2023-11-08T19:24:48.258 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:24:48.258 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow", 2023-11-08T19:24:48.258 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow r", 2023-11-08T19:24:48.258 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow rw", 2023-11-08T19:24:48.258 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow rwx" 2023-11-08T19:24:48.259 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:24:48.259 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:24:48.259 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:24:48.259 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "client.3", 2023-11-08T19:24:48.259 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDj30tlLMAICBAAApxzbDjmCxzR32Puyeov6A==", 2023-11-08T19:24:48.260 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:24:48.260 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow", 2023-11-08T19:24:48.260 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow r", 2023-11-08T19:24:48.260 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow rw", 2023-11-08T19:24:48.260 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow rwx" 2023-11-08T19:24:48.261 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:24:48.261 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:24:48.261 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:24:48.261 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "client.admin", 2023-11-08T19:24:48.261 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDi30tltpwRARAAZZQDTm7CIC4J4HH6G378+w==", 2023-11-08T19:24:48.261 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:24:48.262 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow *", 2023-11-08T19:24:48.262 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow *", 2023-11-08T19:24:48.262 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow *", 2023-11-08T19:24:48.262 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:24:48.262 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:24:48.263 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:24:48.263 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:24:48.263 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "mgr.x", 2023-11-08T19:24:48.263 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDi30tluyy2GxAATC2v0iOLVbRrea6w+2Cy8g==", 2023-11-08T19:24:48.263 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:24:48.263 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow *", 2023-11-08T19:24:48.264 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile mgr", 2023-11-08T19:24:48.264 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:24:48.264 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:24:48.264 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:24:48.264 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:24:48.264 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "mgr.y", 2023-11-08T19:24:48.265 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDi30tlxwfmFhAAfauMRZmdBm6TQXw07oVQJw==", 2023-11-08T19:24:48.265 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:24:48.265 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow *", 2023-11-08T19:24:48.265 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile mgr", 2023-11-08T19:24:48.265 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:24:48.265 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:24:48.266 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:24:48.266 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2023-11-08T19:24:48.266 INFO:teuthology.orchestra.run.smithi149.stdout:} 2023-11-08T19:24:48.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.107+0000 7f8735369700 1 -- 172.21.15.149:0/2500993566 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f871c06af00 msgr2=0x7f871c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:48.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.107+0000 7f8735369700 1 --2- 172.21.15.149:0/2500993566 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f871c06af00 0x7f871c06d3c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8720015040 tx=0x7f8720009030 comp rx=0 tx=0).stop 2023-11-08T19:24:48.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.107+0000 7f8735369700 1 -- 172.21.15.149:0/2500993566 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8730155de0 msgr2=0x7f873015ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:48.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.107+0000 7f8735369700 1 --2- 172.21.15.149:0/2500993566 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8730155de0 0x7f873015ffb0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f8724011aa0 tx=0x7f8724011e60 comp rx=0 tx=0).stop 2023-11-08T19:24:48.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.107+0000 7f8735369700 1 -- 172.21.15.149:0/2500993566 shutdown_connections 2023-11-08T19:24:48.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.107+0000 7f8735369700 1 --2- 172.21.15.149:0/2500993566 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f871c06af00 0x7f871c06d3c0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:48.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.107+0000 7f8735369700 1 --2- 172.21.15.149:0/2500993566 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f87301f4910 0x7f87300aec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:48.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.107+0000 7f8735369700 1 --2- 172.21.15.149:0/2500993566 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8718003a00 0x7f87301582d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:48.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.107+0000 7f8735369700 1 --2- 172.21.15.149:0/2500993566 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8730155de0 0x7f873015ffb0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:48.270 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.107+0000 7f8735369700 1 -- 172.21.15.149:0/2500993566 >> 172.21.15.149:0/2500993566 conn(0x7f8730071670 msgr2=0x7f873015ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:48.270 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.107+0000 7f8735369700 1 -- 172.21.15.149:0/2500993566 shutdown_connections 2023-11-08T19:24:48.270 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.107+0000 7f8735369700 1 -- 172.21.15.149:0/2500993566 wait complete. 2023-11-08T19:24:48.271 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:24:48.393 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.392+0000 7f77add2f700 1 Processor -- start 2023-11-08T19:24:48.394 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.392+0000 7f77add2f700 1 -- start start 2023-11-08T19:24:48.396 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.393+0000 7f77add2f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f77a815dc30 0x7f77a806f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:48.397 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.393+0000 7f77add2f700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f77a80d2060 0x7f77a806f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:48.397 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.393+0000 7f77add2f700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77a806bd50 con 0x7f77a806fc70 2023-11-08T19:24:48.397 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.393+0000 7f77add2f700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77a8070100 con 0x7f77a80d2060 2023-11-08T19:24:48.397 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.393+0000 7f77add2f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77a80d04b0 con 0x7f77a815dc30 2023-11-08T19:24:48.397 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.393+0000 7f77a6ffd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f77a80d2060 0x7f77a806f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:48.398 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.393+0000 7f77a7fff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f77a806fc70 0x7f77a8161790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:42130/0 (socket says 172.21.15.149:42130) 2023-11-08T19:24:48.398 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.393+0000 7f77a7fff700 1 -- 172.21.15.149:0/761141918 learned_addr learned my addr 172.21.15.149:0/761141918 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:24:48.398 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.393+0000 7f77a77fe700 1 --2- 172.21.15.149:0/761141918 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f77a815dc30 0x7f77a806f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:48.398 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.393+0000 7f77a6ffd700 1 -- 172.21.15.149:0/761141918 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f77a815dc30 msgr2=0x7f77a806f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:48.398 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.393+0000 7f77a6ffd700 1 --2- 172.21.15.149:0/761141918 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f77a815dc30 0x7f77a806f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:48.399 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.393+0000 7f77a6ffd700 1 -- 172.21.15.149:0/761141918 >> v1:172.21.15.149:6789/0 conn(0x7f77a806fc70 legacy=0x7f77a8161790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:48.399 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.393+0000 7f77a6ffd700 1 -- 172.21.15.149:0/761141918 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a80d0730 con 0x7f77a80d2060 2023-11-08T19:24:48.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.393+0000 7f77a67fc700 1 -- 172.21.15.149:0/761141918 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1706094172 0 0) 0x7f77a806bd50 con 0x7f77a806fc70 2023-11-08T19:24:48.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.393+0000 7f77a6ffd700 1 --2- 172.21.15.149:0/761141918 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f77a80d2060 0x7f77a806f730 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f7798009840 tx=0x7f7798009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d84d37c909e16976 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:48.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.394+0000 7f77a67fc700 1 -- 172.21.15.149:0/761141918 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7798011830 con 0x7f77a80d2060 2023-11-08T19:24:48.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.394+0000 7f77a67fc700 1 -- 172.21.15.149:0/761141918 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7798011990 con 0x7f77a80d2060 2023-11-08T19:24:48.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.394+0000 7f77a67fc700 1 -- 172.21.15.149:0/761141918 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7798011d20 con 0x7f77a80d2060 2023-11-08T19:24:48.401 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.394+0000 7f77add2f700 1 -- 172.21.15.149:0/761141918 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f77a80d2060 msgr2=0x7f77a806f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:48.401 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.394+0000 7f77add2f700 1 --2- 172.21.15.149:0/761141918 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f77a80d2060 0x7f77a806f730 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f7798009840 tx=0x7f7798009b50 comp rx=0 tx=0).stop 2023-11-08T19:24:48.401 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.394+0000 7f77add2f700 1 -- 172.21.15.149:0/761141918 shutdown_connections 2023-11-08T19:24:48.401 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.394+0000 7f77add2f700 1 --2- 172.21.15.149:0/761141918 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f77a815dc30 0x7f77a806f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:48.401 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.394+0000 7f77add2f700 1 --2- 172.21.15.149:0/761141918 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f77a80d2060 0x7f77a806f730 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:48.402 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.394+0000 7f77add2f700 1 -- 172.21.15.149:0/761141918 >> 172.21.15.149:0/761141918 conn(0x7f77a808afd0 msgr2=0x7f77a80d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:48.402 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.394+0000 7f77add2f700 1 -- 172.21.15.149:0/761141918 shutdown_connections 2023-11-08T19:24:48.402 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.394+0000 7f77add2f700 1 -- 172.21.15.149:0/761141918 wait complete. 2023-11-08T19:24:48.402 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.395+0000 7f77add2f700 1 Processor -- start 2023-11-08T19:24:48.402 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.396+0000 7f77add2f700 1 -- start start 2023-11-08T19:24:48.405 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.396+0000 7f77add2f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f77a806fc70 0x7f77a80ca390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:48.405 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.396+0000 7f77add2f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f77a80d2060 0x7f77a80b55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:48.405 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.396+0000 7f77add2f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f77a815dc30 0x7f77a80b3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:48.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.396+0000 7f77add2f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a80ca8d0 con 0x7f77a806fc70 2023-11-08T19:24:48.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.396+0000 7f77add2f700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a80b5ae0 con 0x7f77a815dc30 2023-11-08T19:24:48.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.396+0000 7f77add2f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77a80b5d80 con 0x7f77a80d2060 2023-11-08T19:24:48.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.396+0000 7f77a77fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f77a806fc70 0x7f77a80ca390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:48.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.396+0000 7f77a77fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f77a806fc70 0x7f77a80ca390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40130/0 (socket says 172.21.15.149:40130) 2023-11-08T19:24:48.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.396+0000 7f77a77fe700 1 -- 172.21.15.149:0/3024749943 learned_addr learned my addr 172.21.15.149:0/3024749943 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:48.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.397+0000 7f77a6ffd700 1 --2- 172.21.15.149:0/3024749943 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f77a80d2060 0x7f77a80b55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:48.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.397+0000 7f77a7fff700 1 --2- 172.21.15.149:0/3024749943 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f77a815dc30 0x7f77a80b3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:48.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.397+0000 7f77a77fe700 1 -- 172.21.15.149:0/3024749943 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f77a80d2060 msgr2=0x7f77a80b55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:48.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.397+0000 7f77a77fe700 1 --2- 172.21.15.149:0/3024749943 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f77a80d2060 0x7f77a80b55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:48.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.397+0000 7f77a77fe700 1 -- 172.21.15.149:0/3024749943 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f77a815dc30 msgr2=0x7f77a80b3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:48.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.397+0000 7f77a77fe700 1 --2- 172.21.15.149:0/3024749943 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f77a815dc30 0x7f77a80b3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:48.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.397+0000 7f77a77fe700 1 -- 172.21.15.149:0/3024749943 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77980094a0 con 0x7f77a806fc70 2023-11-08T19:24:48.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.397+0000 7f77a77fe700 1 --2- 172.21.15.149:0/3024749943 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f77a806fc70 0x7f77a80ca390 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f779c00d7d0 tx=0x7f779c00db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:48.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.397+0000 7f778ffff700 1 -- 172.21.15.149:0/3024749943 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779c0125f0 con 0x7f77a806fc70 2023-11-08T19:24:48.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.397+0000 7f778ffff700 1 -- 172.21.15.149:0/3024749943 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f779c012750 con 0x7f77a806fc70 2023-11-08T19:24:48.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.397+0000 7f778ffff700 1 -- 172.21.15.149:0/3024749943 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779c012b00 con 0x7f77a806fc70 2023-11-08T19:24:48.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.397+0000 7f77add2f700 1 -- 172.21.15.149:0/3024749943 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77a80b6060 con 0x7f77a806fc70 2023-11-08T19:24:48.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.397+0000 7f77add2f700 1 -- 172.21.15.149:0/3024749943 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77a80b6620 con 0x7f77a806fc70 2023-11-08T19:24:48.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.398+0000 7f77add2f700 1 -- 172.21.15.149:0/3024749943 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77a80745f0 con 0x7f77a806fc70 2023-11-08T19:24:48.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.398+0000 7f778ffff700 1 -- 172.21.15.149:0/3024749943 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f779c012c60 con 0x7f77a806fc70 2023-11-08T19:24:48.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.399+0000 7f778ffff700 1 --2- 172.21.15.149:0/3024749943 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f779406af00 0x7f779406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:48.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.399+0000 7f77a6ffd700 1 --2- 172.21.15.149:0/3024749943 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f779406af00 0x7f779406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:48.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.399+0000 7f778ffff700 1 -- 172.21.15.149:0/3024749943 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f779c0895f0 con 0x7f77a806fc70 2023-11-08T19:24:48.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.399+0000 7f77a6ffd700 1 --2- 172.21.15.149:0/3024749943 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f779406af00 0x7f779406d3c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7798000c00 tx=0x7f779801c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:48.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.404+0000 7f778ffff700 1 -- 172.21.15.149:0/3024749943 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f779c0547e0 con 0x7f77a806fc70 2023-11-08T19:24:48.596 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.595+0000 7f77add2f700 1 -- 172.21.15.149:0/3024749943 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f77a80ceff0 con 0x7f77a806fc70 2023-11-08T19:24:48.597 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.596+0000 7f778ffff700 1 -- 172.21.15.149:0/3024749943 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+14851 (secure 0 0 0) 0x7f779c057e00 con 0x7f77a806fc70 2023-11-08T19:24:48.598 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:24:48.598 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":51,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:24:47.678187+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-08T19:24:29.516185+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:24:48.600 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.598+0000 7f77add2f700 1 -- 172.21.15.149:0/3024749943 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f779406af00 msgr2=0x7f779406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:48.600 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.598+0000 7f77add2f700 1 --2- 172.21.15.149:0/3024749943 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f779406af00 0x7f779406d3c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7798000c00 tx=0x7f779801c040 comp rx=0 tx=0).stop 2023-11-08T19:24:48.600 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.598+0000 7f77add2f700 1 -- 172.21.15.149:0/3024749943 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f77a806fc70 msgr2=0x7f77a80ca390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:48.601 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.598+0000 7f77add2f700 1 --2- 172.21.15.149:0/3024749943 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f77a806fc70 0x7f77a80ca390 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f779c00d7d0 tx=0x7f779c00db90 comp rx=0 tx=0).stop 2023-11-08T19:24:48.601 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.599+0000 7f77add2f700 1 -- 172.21.15.149:0/3024749943 shutdown_connections 2023-11-08T19:24:48.601 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.599+0000 7f77add2f700 1 --2- 172.21.15.149:0/3024749943 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f779406af00 0x7f779406d3c0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:48.601 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.599+0000 7f77add2f700 1 --2- 172.21.15.149:0/3024749943 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f77a815dc30 0x7f77a80b3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:48.602 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.599+0000 7f77add2f700 1 --2- 172.21.15.149:0/3024749943 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f77a806fc70 0x7f77a80ca390 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:48.602 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.599+0000 7f77add2f700 1 --2- 172.21.15.149:0/3024749943 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f77a80d2060 0x7f77a80b55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:48.602 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.599+0000 7f77add2f700 1 -- 172.21.15.149:0/3024749943 >> 172.21.15.149:0/3024749943 conn(0x7f77a808afd0 msgr2=0x7f77a80b1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:48.602 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.599+0000 7f77add2f700 1 -- 172.21.15.149:0/3024749943 shutdown_connections 2023-11-08T19:24:48.603 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.599+0000 7f77add2f700 1 -- 172.21.15.149:0/3024749943 wait complete. 2023-11-08T19:24:48.612 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-08T19:22:56.023194+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-08T19:24:29.516185+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 42, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-08T19:24:48.613 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-08T19:24:48.738 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.737+0000 7fc75211c700 1 Processor -- start 2023-11-08T19:24:48.739 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.737+0000 7fc75211c700 1 -- start start 2023-11-08T19:24:48.745 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.738+0000 7fc75211c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc74c15abf0 0x7fc74c0b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:48.745 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.738+0000 7fc75211c700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc74c0b6470 con 0x7fc74c0cc870 2023-11-08T19:24:48.746 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.738+0000 7fc75211c700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc74c15afd0 con 0x7fc74c0d1130 2023-11-08T19:24:48.746 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.738+0000 7fc75211c700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc74c0b66a0 con 0x7fc74c15abf0 2023-11-08T19:24:48.746 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.738+0000 7fc74b7fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc74c15abf0 0x7fc74c0b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:48.747 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.738+0000 7fc74bfff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fc74c0cc870 0x7fc74c06bc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:42144/0 (socket says 172.21.15.149:42144) 2023-11-08T19:24:48.747 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.738+0000 7fc74bfff700 1 -- 172.21.15.149:0/1620499504 learned_addr learned my addr 172.21.15.149:0/1620499504 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:24:48.747 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.738+0000 7fc74b7fe700 1 -- 172.21.15.149:0/1620499504 >> v1:172.21.15.160:6789/0 conn(0x7fc74c0d1130 legacy=0x7fc74c0cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:48.748 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.738+0000 7fc74b7fe700 1 -- 172.21.15.149:0/1620499504 >> v1:172.21.15.149:6789/0 conn(0x7fc74c0cc870 legacy=0x7fc74c06bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:48.748 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.738+0000 7fc74b7fe700 1 -- 172.21.15.149:0/1620499504 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc74c15e880 con 0x7fc74c15abf0 2023-11-08T19:24:48.748 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.738+0000 7fc74a7fc700 1 -- 172.21.15.149:0/1620499504 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1677836656 0 0) 0x7fc74c0b6470 con 0x7fc74c0cc870 2023-11-08T19:24:48.748 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.738+0000 7fc74b7fe700 1 --2- 172.21.15.149:0/1620499504 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc74c15abf0 0x7fc74c0b5f30 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fc734009840 tx=0x7fc734009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=774355d6ee6597ba server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:48.749 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.739+0000 7fc74a7fc700 1 -- 172.21.15.149:0/1620499504 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc734004230 con 0x7fc74c15abf0 2023-11-08T19:24:48.749 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.739+0000 7fc74a7fc700 1 -- 172.21.15.149:0/1620499504 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc734004390 con 0x7fc74c15abf0 2023-11-08T19:24:48.749 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.739+0000 7fc74a7fc700 1 -- 172.21.15.149:0/1620499504 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7340036a0 con 0x7fc74c15abf0 2023-11-08T19:24:48.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.739+0000 7fc75211c700 1 -- 172.21.15.149:0/1620499504 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc74c15abf0 msgr2=0x7fc74c0b5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:48.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.739+0000 7fc75211c700 1 --2- 172.21.15.149:0/1620499504 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc74c15abf0 0x7fc74c0b5f30 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fc734009840 tx=0x7fc734009b50 comp rx=0 tx=0).stop 2023-11-08T19:24:48.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.739+0000 7fc75211c700 1 -- 172.21.15.149:0/1620499504 shutdown_connections 2023-11-08T19:24:48.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.739+0000 7fc75211c700 1 --2- 172.21.15.149:0/1620499504 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc74c15abf0 0x7fc74c0b5f30 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:48.751 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.739+0000 7fc75211c700 1 -- 172.21.15.149:0/1620499504 >> 172.21.15.149:0/1620499504 conn(0x7fc74c0d0640 msgr2=0x7fc74c0d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:48.751 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.739+0000 7fc75211c700 1 -- 172.21.15.149:0/1620499504 shutdown_connections 2023-11-08T19:24:48.751 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.739+0000 7fc75211c700 1 -- 172.21.15.149:0/1620499504 wait complete. 2023-11-08T19:24:48.752 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.740+0000 7fc75211c700 1 Processor -- start 2023-11-08T19:24:48.752 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.741+0000 7fc75211c700 1 -- start start 2023-11-08T19:24:48.752 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.741+0000 7fc75211c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc74c0cc870 0x7fc74c0c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:48.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.741+0000 7fc75211c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc74c0d1130 0x7fc74c06adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:48.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.741+0000 7fc75211c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc74c15abf0 0x7fc74c14e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:48.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.741+0000 7fc75211c700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc74c15d310 con 0x7fc74c0cc870 2023-11-08T19:24:48.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.741+0000 7fc75211c700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc74c15c690 con 0x7fc74c15abf0 2023-11-08T19:24:48.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.741+0000 7fc75211c700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc74c15c970 con 0x7fc74c0d1130 2023-11-08T19:24:48.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.741+0000 7fc74b7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc74c0cc870 0x7fc74c0c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:48.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.741+0000 7fc74b7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc74c0cc870 0x7fc74c0c8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40144/0 (socket says 172.21.15.149:40144) 2023-11-08T19:24:48.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.741+0000 7fc74b7fe700 1 -- 172.21.15.149:0/126239670 learned_addr learned my addr 172.21.15.149:0/126239670 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:48.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.742+0000 7fc74bfff700 1 --2- 172.21.15.149:0/126239670 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc74c15abf0 0x7fc74c14e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:48.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.742+0000 7fc74b7fe700 1 -- 172.21.15.149:0/126239670 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc74c0d1130 msgr2=0x7fc74c06adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:48.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.742+0000 7fc74affd700 1 --2- 172.21.15.149:0/126239670 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc74c0d1130 0x7fc74c06adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:48.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.742+0000 7fc74b7fe700 1 --2- 172.21.15.149:0/126239670 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc74c0d1130 0x7fc74c06adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:48.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.742+0000 7fc74b7fe700 1 -- 172.21.15.149:0/126239670 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc74c15abf0 msgr2=0x7fc74c14e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:48.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.742+0000 7fc74b7fe700 1 --2- 172.21.15.149:0/126239670 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc74c15abf0 0x7fc74c14e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:48.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.742+0000 7fc74b7fe700 1 -- 172.21.15.149:0/126239670 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7340094a0 con 0x7fc74c0cc870 2023-11-08T19:24:48.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.742+0000 7fc74bfff700 1 --2- 172.21.15.149:0/126239670 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc74c15abf0 0x7fc74c14e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:24:48.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.742+0000 7fc74affd700 1 --2- 172.21.15.149:0/126239670 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc74c0d1130 0x7fc74c06adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:24:48.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.742+0000 7fc74b7fe700 1 --2- 172.21.15.149:0/126239670 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc74c0cc870 0x7fc74c0c8120 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fc7340090b0 tx=0x7fc734004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:48.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.742+0000 7fc743fff700 1 -- 172.21.15.149:0/126239670 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc734011830 con 0x7fc74c0cc870 2023-11-08T19:24:48.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.742+0000 7fc75211c700 1 -- 172.21.15.149:0/126239670 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc74c15cc50 con 0x7fc74c0cc870 2023-11-08T19:24:48.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.742+0000 7fc743fff700 1 -- 172.21.15.149:0/126239670 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc73401e070 con 0x7fc74c0cc870 2023-11-08T19:24:48.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.742+0000 7fc743fff700 1 -- 172.21.15.149:0/126239670 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc734011bb0 con 0x7fc74c0cc870 2023-11-08T19:24:48.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.742+0000 7fc75211c700 1 -- 172.21.15.149:0/126239670 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc74c0c8660 con 0x7fc74c0cc870 2023-11-08T19:24:48.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.743+0000 7fc75211c700 1 -- 172.21.15.149:0/126239670 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc74c15d580 con 0x7fc74c0cc870 2023-11-08T19:24:48.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.743+0000 7fc743fff700 1 -- 172.21.15.149:0/126239670 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc734011d10 con 0x7fc74c0cc870 2023-11-08T19:24:48.760 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.744+0000 7fc743fff700 1 --2- 172.21.15.149:0/126239670 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc72c06af00 0x7fc72c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:48.760 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.744+0000 7fc743fff700 1 -- 172.21.15.149:0/126239670 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fc73408a940 con 0x7fc74c0cc870 2023-11-08T19:24:48.760 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.744+0000 7fc74affd700 1 --2- 172.21.15.149:0/126239670 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc72c06af00 0x7fc72c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:48.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.744+0000 7fc74affd700 1 --2- 172.21.15.149:0/126239670 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc72c06af00 0x7fc72c06d3c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc74c06ca80 tx=0x7fc73c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:48.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.749+0000 7fc743fff700 1 -- 172.21.15.149:0/126239670 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc734055ab0 con 0x7fc74c0cc870 2023-11-08T19:24:48.940 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.939+0000 7fc75211c700 1 -- 172.21.15.149:0/126239670 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc74c072030 con 0x7fc74c0cc870 2023-11-08T19:24:48.941 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.939+0000 7fc743fff700 1 -- 172.21.15.149:0/126239670 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v51) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc7340590d0 con 0x7fc74c0cc870 2023-11-08T19:24:48.941 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 1 2023-11-08T19:24:48.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.941+0000 7fc75211c700 1 -- 172.21.15.149:0/126239670 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc72c06af00 msgr2=0x7fc72c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:48.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.941+0000 7fc75211c700 1 --2- 172.21.15.149:0/126239670 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc72c06af00 0x7fc72c06d3c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc74c06ca80 tx=0x7fc73c008040 comp rx=0 tx=0).stop 2023-11-08T19:24:48.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.941+0000 7fc75211c700 1 -- 172.21.15.149:0/126239670 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc74c0cc870 msgr2=0x7fc74c0c8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:48.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.941+0000 7fc75211c700 1 --2- 172.21.15.149:0/126239670 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc74c0cc870 0x7fc74c0c8120 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fc7340090b0 tx=0x7fc734004750 comp rx=0 tx=0).stop 2023-11-08T19:24:48.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.941+0000 7fc75211c700 1 -- 172.21.15.149:0/126239670 shutdown_connections 2023-11-08T19:24:48.944 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.941+0000 7fc75211c700 1 --2- 172.21.15.149:0/126239670 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc72c06af00 0x7fc72c06d3c0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:48.944 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.941+0000 7fc75211c700 1 --2- 172.21.15.149:0/126239670 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc74c15abf0 0x7fc74c14e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:48.944 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.941+0000 7fc75211c700 1 --2- 172.21.15.149:0/126239670 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc74c0cc870 0x7fc74c0c8120 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:48.944 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.941+0000 7fc75211c700 1 --2- 172.21.15.149:0/126239670 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc74c0d1130 0x7fc74c06adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:48.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.941+0000 7fc75211c700 1 -- 172.21.15.149:0/126239670 >> 172.21.15.149:0/126239670 conn(0x7fc74c0d0640 msgr2=0x7fc74c0c98c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:48.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.941+0000 7fc75211c700 1 -- 172.21.15.149:0/126239670 shutdown_connections 2023-11-08T19:24:48.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:48.941+0000 7fc75211c700 1 -- 172.21.15.149:0/126239670 wait complete. 2023-11-08T19:24:48.955 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-08T19:24:49.078 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.077+0000 7fd4c1000700 1 Processor -- start 2023-11-08T19:24:49.078 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.077+0000 7fd4c1000700 1 -- start start 2023-11-08T19:24:49.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.078+0000 7fd4c1000700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fd4bc0cc870 0x7fd4bc0b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:49.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.078+0000 7fd4c1000700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4bc0b6470 con 0x7fd4bc0d1130 2023-11-08T19:24:49.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.078+0000 7fd4c1000700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4bc15afd0 con 0x7fd4bc15abf0 2023-11-08T19:24:49.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.078+0000 7fd4c1000700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4bc0b66a0 con 0x7fd4bc0cc870 2023-11-08T19:24:49.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.078+0000 7fd4b9d9b700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fd4bc0d1130 0x7fd4bc06bc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:42154/0 (socket says 172.21.15.149:42154) 2023-11-08T19:24:49.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.078+0000 7fd4b9d9b700 1 -- 172.21.15.149:0/689710114 learned_addr learned my addr 172.21.15.149:0/689710114 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:24:49.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.078+0000 7fd4bad9d700 1 --2- 172.21.15.149:0/689710114 >> v2:172.21.15.160:3300/0 conn(0x7fd4bc0cc870 0x7fd4bc0b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:49.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.078+0000 7fd4b959a700 1 -- 172.21.15.149:0/689710114 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1506787840 0 0) 0x7fd4bc0b6470 con 0x7fd4bc0d1130 2023-11-08T19:24:49.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.078+0000 7fd4b959a700 1 -- 172.21.15.149:0/689710114 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4a40035b0 con 0x7fd4bc0d1130 2023-11-08T19:24:49.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.078+0000 7fd4b959a700 1 -- 172.21.15.149:0/689710114 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2841497476 0 0) 0x7fd4a40035b0 con 0x7fd4bc0d1130 2023-11-08T19:24:49.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.078+0000 7fd4b959a700 1 -- 172.21.15.149:0/689710114 >> v2:172.21.15.160:3300/0 conn(0x7fd4bc0cc870 msgr2=0x7fd4bc0b5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:49.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.078+0000 7fd4b959a700 1 --2- 172.21.15.149:0/689710114 >> v2:172.21.15.160:3300/0 conn(0x7fd4bc0cc870 0x7fd4bc0b5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:49.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.078+0000 7fd4b959a700 1 -- 172.21.15.149:0/689710114 >> v1:172.21.15.160:6789/0 conn(0x7fd4bc15abf0 legacy=0x7fd4bc0cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:49.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.078+0000 7fd4b959a700 1 -- 172.21.15.149:0/689710114 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4bc15e880 con 0x7fd4bc0d1130 2023-11-08T19:24:49.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.078+0000 7fd4b959a700 1 -- 172.21.15.149:0/689710114 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7fd4ac001670 con 0x7fd4bc0d1130 2023-11-08T19:24:49.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.078+0000 7fd4b959a700 1 -- 172.21.15.149:0/689710114 >> v1:172.21.15.149:6789/0 conn(0x7fd4bc0d1130 legacy=0x7fd4bc06bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:49.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.078+0000 7fd4b959a700 1 --2- 172.21.15.149:0/689710114 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4a4003a70 0x7fd4a4003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:49.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.078+0000 7fd4b959a700 1 --2- 172.21.15.149:0/689710114 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd4a4004850 0x7fd4a4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:49.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.078+0000 7fd4b959a700 1 --2- 172.21.15.149:0/689710114 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd4a4005280 0x7fd4a400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:49.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.078+0000 7fd4b959a700 1 -- 172.21.15.149:0/689710114 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4bc0b66a0 con 0x7fd4a4003a70 2023-11-08T19:24:49.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.078+0000 7fd4b959a700 1 -- 172.21.15.149:0/689710114 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a400c1e0 con 0x7fd4a4004850 2023-11-08T19:24:49.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.078+0000 7fd4b959a700 1 -- 172.21.15.149:0/689710114 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a400c3a0 con 0x7fd4a4005280 2023-11-08T19:24:49.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.078+0000 7fd4ba59c700 1 --2- 172.21.15.149:0/689710114 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4a4003a70 0x7fd4a4003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:49.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.079+0000 7fd4b9d9b700 1 --2- 172.21.15.149:0/689710114 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd4a4004850 0x7fd4a4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:49.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.079+0000 7fd4bad9d700 1 --2- 172.21.15.149:0/689710114 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd4a4005280 0x7fd4a400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:49.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.079+0000 7fd4ba59c700 1 -- 172.21.15.149:0/689710114 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd4a4005280 msgr2=0x7fd4a400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:49.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.079+0000 7fd4ba59c700 1 --2- 172.21.15.149:0/689710114 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd4a4005280 0x7fd4a400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:49.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.079+0000 7fd4ba59c700 1 -- 172.21.15.149:0/689710114 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd4a4004850 msgr2=0x7fd4a4004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:49.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.079+0000 7fd4ba59c700 1 --2- 172.21.15.149:0/689710114 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd4a4004850 0x7fd4a4004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:49.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.079+0000 7fd4bad9d700 1 -- 172.21.15.149:0/689710114 reap_dead start 2023-11-08T19:24:49.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.079+0000 7fd4ba59c700 1 -- 172.21.15.149:0/689710114 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a40035b0 con 0x7fd4a4003a70 2023-11-08T19:24:49.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.079+0000 7fd4ba59c700 1 --2- 172.21.15.149:0/689710114 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4a4003a70 0x7fd4a4003e90 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fd4b00017c0 tx=0x7fd4a4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56a7a93d5812c3c3 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:49.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.079+0000 7fd4b959a700 1 -- 172.21.15.149:0/689710114 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b00052d0 con 0x7fd4a4003a70 2023-11-08T19:24:49.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.079+0000 7fd4b959a700 1 -- 172.21.15.149:0/689710114 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b0005430 con 0x7fd4a4003a70 2023-11-08T19:24:49.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.079+0000 7fd4b959a700 1 -- 172.21.15.149:0/689710114 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b00038c0 con 0x7fd4a4003a70 2023-11-08T19:24:49.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.079+0000 7fd4c1000700 1 -- 172.21.15.149:0/689710114 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4a4003a70 msgr2=0x7fd4a4003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:49.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.079+0000 7fd4c1000700 1 --2- 172.21.15.149:0/689710114 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4a4003a70 0x7fd4a4003e90 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fd4b00017c0 tx=0x7fd4a4005880 comp rx=0 tx=0).stop 2023-11-08T19:24:49.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.080+0000 7fd4c1000700 1 -- 172.21.15.149:0/689710114 shutdown_connections 2023-11-08T19:24:49.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.080+0000 7fd4c1000700 1 --2- 172.21.15.149:0/689710114 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4a4003a70 0x7fd4a4003e90 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:49.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.080+0000 7fd4c1000700 1 -- 172.21.15.149:0/689710114 >> 172.21.15.149:0/689710114 conn(0x7fd4bc0d0640 msgr2=0x7fd4bc0d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:49.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.080+0000 7fd4c1000700 1 -- 172.21.15.149:0/689710114 shutdown_connections 2023-11-08T19:24:49.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.080+0000 7fd4c1000700 1 -- 172.21.15.149:0/689710114 wait complete. 2023-11-08T19:24:49.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.081+0000 7fd4c1000700 1 Processor -- start 2023-11-08T19:24:49.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.081+0000 7fd4c1000700 1 -- start start 2023-11-08T19:24:49.094 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.082+0000 7fd4c1000700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd4a4003a70 0x7fd4bc0ca170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:49.094 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.082+0000 7fd4c1000700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4bc0c78a0 0x7fd4bc06b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:49.094 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.082+0000 7fd4c1000700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd4bc06bd40 0x7fd4bc0c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:49.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.082+0000 7fd4c1000700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4bc1436a0 con 0x7fd4bc0c78a0 2023-11-08T19:24:49.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.082+0000 7fd4c1000700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4bc06c1d0 con 0x7fd4a4003a70 2023-11-08T19:24:49.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.082+0000 7fd4c1000700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4bc0c7d60 con 0x7fd4bc06bd40 2023-11-08T19:24:49.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.082+0000 7fd4b9d9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4bc0c78a0 0x7fd4bc06b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:49.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.082+0000 7fd4b9d9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4bc0c78a0 0x7fd4bc06b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40166/0 (socket says 172.21.15.149:40166) 2023-11-08T19:24:49.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.082+0000 7fd4b9d9b700 1 -- 172.21.15.149:0/1381534496 learned_addr learned my addr 172.21.15.149:0/1381534496 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:49.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.082+0000 7fd4bad9d700 1 --2- 172.21.15.149:0/1381534496 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd4bc06bd40 0x7fd4bc0c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:49.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.082+0000 7fd4ba59c700 1 --2- 172.21.15.149:0/1381534496 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd4a4003a70 0x7fd4bc0ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:49.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.082+0000 7fd4b9d9b700 1 -- 172.21.15.149:0/1381534496 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd4bc06bd40 msgr2=0x7fd4bc0c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:49.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.082+0000 7fd4b9d9b700 1 --2- 172.21.15.149:0/1381534496 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd4bc06bd40 0x7fd4bc0c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:49.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.082+0000 7fd4b9d9b700 1 -- 172.21.15.149:0/1381534496 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd4a4003a70 msgr2=0x7fd4bc0ca170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:49.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.082+0000 7fd4b9d9b700 1 --2- 172.21.15.149:0/1381534496 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd4a4003a70 0x7fd4bc0ca170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:49.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.082+0000 7fd4b9d9b700 1 -- 172.21.15.149:0/1381534496 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4bc0c93b0 con 0x7fd4bc0c78a0 2023-11-08T19:24:49.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.082+0000 7fd4bad9d700 1 --2- 172.21.15.149:0/1381534496 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd4bc06bd40 0x7fd4bc0c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:24:49.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.082+0000 7fd4ba59c700 1 --2- 172.21.15.149:0/1381534496 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd4a4003a70 0x7fd4bc0ca170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:24:49.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.082+0000 7fd4b9d9b700 1 --2- 172.21.15.149:0/1381534496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4bc0c78a0 0x7fd4bc06b800 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac007290 tx=0x7fd4ac007650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:49.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.082+0000 7fd4aaffd700 1 -- 172.21.15.149:0/1381534496 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac00f6c0 con 0x7fd4bc0c78a0 2023-11-08T19:24:49.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.082+0000 7fd4aaffd700 1 -- 172.21.15.149:0/1381534496 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4ac00f820 con 0x7fd4bc0c78a0 2023-11-08T19:24:49.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.082+0000 7fd4c1000700 1 -- 172.21.15.149:0/1381534496 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4bc0c9690 con 0x7fd4bc0c78a0 2023-11-08T19:24:49.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.082+0000 7fd4aaffd700 1 -- 172.21.15.149:0/1381534496 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac00fbd0 con 0x7fd4bc0c78a0 2023-11-08T19:24:49.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.082+0000 7fd4c1000700 1 -- 172.21.15.149:0/1381534496 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4bc0c9c50 con 0x7fd4bc0c78a0 2023-11-08T19:24:49.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.083+0000 7fd4c1000700 1 -- 172.21.15.149:0/1381534496 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4bc04f730 con 0x7fd4bc0c78a0 2023-11-08T19:24:49.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.084+0000 7fd4aaffd700 1 -- 172.21.15.149:0/1381534496 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd4ac00fd30 con 0x7fd4bc0c78a0 2023-11-08T19:24:49.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.084+0000 7fd4aaffd700 1 --2- 172.21.15.149:0/1381534496 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd49c06af00 0x7fd49c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:49.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.084+0000 7fd4ba59c700 1 --2- 172.21.15.149:0/1381534496 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd49c06af00 0x7fd49c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:49.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.084+0000 7fd4aaffd700 1 -- 172.21.15.149:0/1381534496 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fd4ac089420 con 0x7fd4bc0c78a0 2023-11-08T19:24:49.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.085+0000 7fd4ba59c700 1 --2- 172.21.15.149:0/1381534496 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd49c06af00 0x7fd49c06d3c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0005040 tx=0x7fd4b0009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:49.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.089+0000 7fd4aaffd700 1 -- 172.21.15.149:0/1381534496 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd4ac054610 con 0x7fd4bc0c78a0 2023-11-08T19:24:49.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.280+0000 7fd4c1000700 1 -- 172.21.15.149:0/1381534496 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7fd4bc0c9e10 con 0x7fd4bc0c78a0 2023-11-08T19:24:49.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.280+0000 7fd4aaffd700 1 -- 172.21.15.149:0/1381534496 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v51) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd4ac057c30 con 0x7fd4bc0c78a0 2023-11-08T19:24:49.283 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:24:49.284 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.283+0000 7fd4c1000700 1 -- 172.21.15.149:0/1381534496 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd49c06af00 msgr2=0x7fd49c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:49.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.283+0000 7fd4c1000700 1 --2- 172.21.15.149:0/1381534496 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd49c06af00 0x7fd49c06d3c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0005040 tx=0x7fd4b0009030 comp rx=0 tx=0).stop 2023-11-08T19:24:49.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.283+0000 7fd4c1000700 1 -- 172.21.15.149:0/1381534496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4bc0c78a0 msgr2=0x7fd4bc06b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:49.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.283+0000 7fd4c1000700 1 --2- 172.21.15.149:0/1381534496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4bc0c78a0 0x7fd4bc06b800 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac007290 tx=0x7fd4ac007650 comp rx=0 tx=0).stop 2023-11-08T19:24:49.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.283+0000 7fd4c1000700 1 -- 172.21.15.149:0/1381534496 shutdown_connections 2023-11-08T19:24:49.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.283+0000 7fd4c1000700 1 --2- 172.21.15.149:0/1381534496 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd49c06af00 0x7fd49c06d3c0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:49.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.283+0000 7fd4c1000700 1 --2- 172.21.15.149:0/1381534496 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd4a4003a70 0x7fd4bc0ca170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:49.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.283+0000 7fd4c1000700 1 --2- 172.21.15.149:0/1381534496 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd4bc06bd40 0x7fd4bc0c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:49.287 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.283+0000 7fd4c1000700 1 --2- 172.21.15.149:0/1381534496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4bc0c78a0 0x7fd4bc06b800 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:49.287 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.283+0000 7fd4c1000700 1 -- 172.21.15.149:0/1381534496 >> 172.21.15.149:0/1381534496 conn(0x7fd4bc0d0640 msgr2=0x7fd4bc0b1580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:49.287 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.283+0000 7fd4c1000700 1 -- 172.21.15.149:0/1381534496 shutdown_connections 2023-11-08T19:24:49.288 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.283+0000 7fd4c1000700 1 -- 172.21.15.149:0/1381534496 wait complete. 2023-11-08T19:24:49.297 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-08T19:24:49.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.417+0000 7f58fd47a700 1 Processor -- start 2023-11-08T19:24:49.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.417+0000 7f58fd47a700 1 -- start start 2023-11-08T19:24:49.422 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.418+0000 7f58fd47a700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f58f815b790 0x7f58f815fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:49.422 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.418+0000 7f58fd47a700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f58f81600b0 0x7f58f80b0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:49.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.418+0000 7f58fd47a700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58f80716c0 con 0x7f58f80b4730 2023-11-08T19:24:49.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.418+0000 7f58fd47a700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58f815f440 con 0x7f58f81600b0 2023-11-08T19:24:49.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.418+0000 7f58fd47a700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58f8071910 con 0x7f58f815b790 2023-11-08T19:24:49.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.418+0000 7f58f67fc700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f58f81600b0 0x7f58f80b0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:49.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.418+0000 7f58f77fe700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f58f80b4730 0x7f58f80c9f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:42178/0 (socket says 172.21.15.149:42178) 2023-11-08T19:24:49.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.418+0000 7f58f77fe700 1 -- 172.21.15.149:0/420532196 learned_addr learned my addr 172.21.15.149:0/420532196 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:24:49.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.419+0000 7f58f5ffb700 1 -- 172.21.15.149:0/420532196 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 735811167 0 0) 0x7f58f80716c0 con 0x7f58f80b4730 2023-11-08T19:24:49.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.419+0000 7f58f6ffd700 1 --2- 172.21.15.149:0/420532196 >> v2:172.21.15.160:3300/0 conn(0x7f58f815b790 0x7f58f815fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:49.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.419+0000 7f58f5ffb700 1 -- 172.21.15.149:0/420532196 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58e00035b0 con 0x7f58f80b4730 2023-11-08T19:24:49.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.419+0000 7f58f67fc700 1 -- 172.21.15.149:0/420532196 >> v2:172.21.15.160:3300/0 conn(0x7f58f815b790 msgr2=0x7f58f815fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:49.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.419+0000 7f58f67fc700 1 --2- 172.21.15.149:0/420532196 >> v2:172.21.15.160:3300/0 conn(0x7f58f815b790 0x7f58f815fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:49.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.419+0000 7f58f67fc700 1 -- 172.21.15.149:0/420532196 >> v1:172.21.15.149:6789/0 conn(0x7f58f80b4730 legacy=0x7f58f80c9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:49.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.419+0000 7f58f67fc700 1 -- 172.21.15.149:0/420532196 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58f80cb7c0 con 0x7f58f81600b0 2023-11-08T19:24:49.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.419+0000 7f58f67fc700 1 --2- 172.21.15.149:0/420532196 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58f81600b0 0x7f58f80b0ee0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f58f806de60 tx=0x7f58e8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2891d59b5a76bcb7 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:49.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.419+0000 7f58f5ffb700 1 -- 172.21.15.149:0/420532196 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e8011830 con 0x7f58f81600b0 2023-11-08T19:24:49.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.419+0000 7f58f5ffb700 1 -- 172.21.15.149:0/420532196 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58e8011990 con 0x7f58f81600b0 2023-11-08T19:24:49.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.419+0000 7f58f5ffb700 1 -- 172.21.15.149:0/420532196 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e8011d20 con 0x7f58f81600b0 2023-11-08T19:24:49.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.419+0000 7f58fd47a700 1 -- 172.21.15.149:0/420532196 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58f81600b0 msgr2=0x7f58f80b0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:49.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.419+0000 7f58fd47a700 1 --2- 172.21.15.149:0/420532196 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58f81600b0 0x7f58f80b0ee0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f58f806de60 tx=0x7f58e8009b20 comp rx=0 tx=0).stop 2023-11-08T19:24:49.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.420+0000 7f58fd47a700 1 -- 172.21.15.149:0/420532196 shutdown_connections 2023-11-08T19:24:49.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.420+0000 7f58fd47a700 1 --2- 172.21.15.149:0/420532196 >> v2:172.21.15.160:3300/0 conn(0x7f58f815b790 0x7f58f815fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:49.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.420+0000 7f58fd47a700 1 --2- 172.21.15.149:0/420532196 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58f81600b0 0x7f58f80b0ee0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:49.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.420+0000 7f58fd47a700 1 -- 172.21.15.149:0/420532196 >> 172.21.15.149:0/420532196 conn(0x7f58f806b3d0 msgr2=0x7f58f80cf460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:49.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.420+0000 7f58fd47a700 1 -- 172.21.15.149:0/420532196 shutdown_connections 2023-11-08T19:24:49.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.420+0000 7f58fd47a700 1 -- 172.21.15.149:0/420532196 wait complete. 2023-11-08T19:24:49.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.421+0000 7f58fd47a700 1 Processor -- start 2023-11-08T19:24:49.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.421+0000 7f58fd47a700 1 -- start start 2023-11-08T19:24:49.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.422+0000 7f58fd47a700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f58f80b4730 0x7f58f8159980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:49.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.422+0000 7f58fd47a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f58f815b790 0x7f58f80ade90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:49.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.422+0000 7f58fd47a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58f814da70 0x7f58f80ae3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:49.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.422+0000 7f58fd47a700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f815ea90 con 0x7f58f814da70 2023-11-08T19:24:49.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.422+0000 7f58fd47a700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f815e1f0 con 0x7f58f815b790 2023-11-08T19:24:49.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.422+0000 7f58fd47a700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58f815e4d0 con 0x7f58f80b4730 2023-11-08T19:24:49.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.422+0000 7f58f77fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58f814da70 0x7f58f80ae3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:49.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.422+0000 7f58f77fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58f814da70 0x7f58f80ae3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40182/0 (socket says 172.21.15.149:40182) 2023-11-08T19:24:49.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.422+0000 7f58f77fe700 1 -- 172.21.15.149:0/1875806259 learned_addr learned my addr 172.21.15.149:0/1875806259 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:49.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.422+0000 7f58f6ffd700 1 --2- 172.21.15.149:0/1875806259 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f58f80b4730 0x7f58f8159980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:49.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.422+0000 7f58f67fc700 1 --2- 172.21.15.149:0/1875806259 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f58f815b790 0x7f58f80ade90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:49.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.422+0000 7f58f77fe700 1 -- 172.21.15.149:0/1875806259 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f58f80b4730 msgr2=0x7f58f8159980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:49.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.422+0000 7f58f77fe700 1 --2- 172.21.15.149:0/1875806259 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f58f80b4730 0x7f58f8159980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:49.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.422+0000 7f58f77fe700 1 -- 172.21.15.149:0/1875806259 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f58f815b790 msgr2=0x7f58f80ade90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:49.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.422+0000 7f58f77fe700 1 --2- 172.21.15.149:0/1875806259 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f58f815b790 0x7f58f80ade90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:49.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.422+0000 7f58f77fe700 1 -- 172.21.15.149:0/1875806259 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e80094a0 con 0x7f58f814da70 2023-11-08T19:24:49.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.423+0000 7f58f77fe700 1 --2- 172.21.15.149:0/1875806259 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58f814da70 0x7f58f80ae3d0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f58f000ca70 tx=0x7f58f000cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:49.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.423+0000 7f58df7fe700 1 -- 172.21.15.149:0/1875806259 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f000a9e0 con 0x7f58f814da70 2023-11-08T19:24:49.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.423+0000 7f58df7fe700 1 -- 172.21.15.149:0/1875806259 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58f000ab40 con 0x7f58f814da70 2023-11-08T19:24:49.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.423+0000 7f58fd47a700 1 -- 172.21.15.149:0/1875806259 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58f815e7b0 con 0x7f58f814da70 2023-11-08T19:24:49.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.423+0000 7f58df7fe700 1 -- 172.21.15.149:0/1875806259 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f0012400 con 0x7f58f814da70 2023-11-08T19:24:49.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.423+0000 7f58fd47a700 1 -- 172.21.15.149:0/1875806259 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58f815de10 con 0x7f58f814da70 2023-11-08T19:24:49.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.424+0000 7f58fd47a700 1 -- 172.21.15.149:0/1875806259 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58f80cd280 con 0x7f58f814da70 2023-11-08T19:24:49.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.424+0000 7f58df7fe700 1 -- 172.21.15.149:0/1875806259 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f58f001b3b0 con 0x7f58f814da70 2023-11-08T19:24:49.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.425+0000 7f58df7fe700 1 --2- 172.21.15.149:0/1875806259 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f58e406af00 0x7f58e406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:49.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.425+0000 7f58df7fe700 1 -- 172.21.15.149:0/1875806259 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f58f0088fc0 con 0x7f58f814da70 2023-11-08T19:24:49.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.425+0000 7f58f6ffd700 1 --2- 172.21.15.149:0/1875806259 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f58e406af00 0x7f58e406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:49.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.425+0000 7f58f6ffd700 1 --2- 172.21.15.149:0/1875806259 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f58e406af00 0x7f58e406d3c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f58ec006b20 tx=0x7f58ec008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:49.438 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.429+0000 7f58df7fe700 1 -- 172.21.15.149:0/1875806259 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f58f00bbca0 con 0x7f58f814da70 2023-11-08T19:24:49.623 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.622+0000 7f58fd47a700 1 -- 172.21.15.149:0/1875806259 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f58f80745f0 con 0x7f58f814da70 2023-11-08T19:24:49.623 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.622+0000 7f58df7fe700 1 -- 172.21.15.149:0/1875806259 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v51) v1 ==== 84+0+137 (secure 0 0 0) 0x7f58f00170a0 con 0x7f58f814da70 2023-11-08T19:24:49.624 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:24:49.624 INFO:teuthology.orchestra.run.smithi149.stdout:[ 2023-11-08T19:24:49.624 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:24:49.625 INFO:teuthology.orchestra.run.smithi149.stdout: "poolnum": 1, 2023-11-08T19:24:49.625 INFO:teuthology.orchestra.run.smithi149.stdout: "poolname": ".mgr" 2023-11-08T19:24:49.625 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:24:49.625 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:24:49.626 INFO:teuthology.orchestra.run.smithi149.stdout: "poolnum": 7, 2023-11-08T19:24:49.626 INFO:teuthology.orchestra.run.smithi149.stdout: "poolname": "snap-test-pool" 2023-11-08T19:24:49.626 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:24:49.626 INFO:teuthology.orchestra.run.smithi149.stdout:] 2023-11-08T19:24:49.627 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.624+0000 7f58fd47a700 1 -- 172.21.15.149:0/1875806259 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f58e406af00 msgr2=0x7f58e406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:49.627 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.624+0000 7f58fd47a700 1 --2- 172.21.15.149:0/1875806259 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f58e406af00 0x7f58e406d3c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f58ec006b20 tx=0x7f58ec008040 comp rx=0 tx=0).stop 2023-11-08T19:24:49.628 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.624+0000 7f58fd47a700 1 -- 172.21.15.149:0/1875806259 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58f814da70 msgr2=0x7f58f80ae3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:49.628 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.624+0000 7f58fd47a700 1 --2- 172.21.15.149:0/1875806259 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58f814da70 0x7f58f80ae3d0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f58f000ca70 tx=0x7f58f000cd80 comp rx=0 tx=0).stop 2023-11-08T19:24:49.628 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.624+0000 7f58fd47a700 1 -- 172.21.15.149:0/1875806259 shutdown_connections 2023-11-08T19:24:49.628 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.624+0000 7f58fd47a700 1 --2- 172.21.15.149:0/1875806259 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f58e406af00 0x7f58e406d3c0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:49.629 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.624+0000 7f58fd47a700 1 --2- 172.21.15.149:0/1875806259 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58f814da70 0x7f58f80ae3d0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:49.629 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.624+0000 7f58fd47a700 1 --2- 172.21.15.149:0/1875806259 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f58f80b4730 0x7f58f8159980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:49.629 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.624+0000 7f58fd47a700 1 --2- 172.21.15.149:0/1875806259 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f58f815b790 0x7f58f80ade90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:49.629 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.624+0000 7f58fd47a700 1 -- 172.21.15.149:0/1875806259 >> 172.21.15.149:0/1875806259 conn(0x7f58f806b3d0 msgr2=0x7f58f80b2a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:49.629 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.624+0000 7f58fd47a700 1 -- 172.21.15.149:0/1875806259 shutdown_connections 2023-11-08T19:24:49.629 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.624+0000 7f58fd47a700 1 -- 172.21.15.149:0/1875806259 wait complete. 2023-11-08T19:24:49.638 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-08T19:24:49.638 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-08T19:24:49.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.761+0000 7fdd6c734700 1 Processor -- start 2023-11-08T19:24:49.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.761+0000 7fdd6c734700 1 -- start start 2023-11-08T19:24:49.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.762+0000 7fdd6c734700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdd6415da20 0x7fdd640cbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:49.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.762+0000 7fdd6c734700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fdd6406da60 0x7fdd6406c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:49.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.762+0000 7fdd6c734700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd64162630 con 0x7fdd6406d5e0 2023-11-08T19:24:49.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.762+0000 7fdd6c734700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd640cc2f0 con 0x7fdd6406da60 2023-11-08T19:24:49.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.762+0000 7fdd6c734700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd64161ab0 con 0x7fdd6415da20 2023-11-08T19:24:49.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.763+0000 7fdd69ccf700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fdd6406d5e0 0x7fdd640b31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:42190/0 (socket says 172.21.15.149:42190) 2023-11-08T19:24:49.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.763+0000 7fdd69ccf700 1 -- 172.21.15.149:0/2825035752 learned_addr learned my addr 172.21.15.149:0/2825035752 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:24:49.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.763+0000 7fdd6acd1700 1 --2- 172.21.15.149:0/2825035752 >> v2:172.21.15.160:3300/0 conn(0x7fdd6406da60 0x7fdd6406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:49.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.763+0000 7fdd6a4d0700 1 --2- 172.21.15.149:0/2825035752 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdd6415da20 0x7fdd640cbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:49.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.763+0000 7fdd694ce700 1 -- 172.21.15.149:0/2825035752 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3415213956 0 0) 0x7fdd64162630 con 0x7fdd6406d5e0 2023-11-08T19:24:49.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.763+0000 7fdd694ce700 1 -- 172.21.15.149:0/2825035752 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd500035b0 con 0x7fdd6406d5e0 2023-11-08T19:24:49.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.763+0000 7fdd694ce700 1 -- 172.21.15.149:0/2825035752 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2017603668 0 0) 0x7fdd500035b0 con 0x7fdd6406d5e0 2023-11-08T19:24:49.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.763+0000 7fdd6a4d0700 1 -- 172.21.15.149:0/2825035752 >> v2:172.21.15.160:3300/0 conn(0x7fdd6406da60 msgr2=0x7fdd6406c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:49.770 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.763+0000 7fdd6a4d0700 1 --2- 172.21.15.149:0/2825035752 >> v2:172.21.15.160:3300/0 conn(0x7fdd6406da60 0x7fdd6406c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:49.770 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.763+0000 7fdd6a4d0700 1 -- 172.21.15.149:0/2825035752 >> v1:172.21.15.149:6789/0 conn(0x7fdd6406d5e0 legacy=0x7fdd640b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:49.770 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.763+0000 7fdd6a4d0700 1 -- 172.21.15.149:0/2825035752 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd64161d90 con 0x7fdd6415da20 2023-11-08T19:24:49.770 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.763+0000 7fdd6acd1700 1 --2- 172.21.15.149:0/2825035752 >> v2:172.21.15.160:3300/0 conn(0x7fdd6406da60 0x7fdd6406c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:24:49.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.763+0000 7fdd6a4d0700 1 --2- 172.21.15.149:0/2825035752 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdd6415da20 0x7fdd640cbdb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdd54009840 tx=0x7fdd54009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e45d4d1dc1a1d3 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:49.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.763+0000 7fdd694ce700 1 -- 172.21.15.149:0/2825035752 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd60001670 con 0x7fdd6415da20 2023-11-08T19:24:49.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.763+0000 7fdd694ce700 1 -- 172.21.15.149:0/2825035752 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd54004030 con 0x7fdd6415da20 2023-11-08T19:24:49.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.763+0000 7fdd694ce700 1 -- 172.21.15.149:0/2825035752 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd540043c0 con 0x7fdd6415da20 2023-11-08T19:24:49.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.764+0000 7fdd6c734700 1 -- 172.21.15.149:0/2825035752 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdd6415da20 msgr2=0x7fdd640cbdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:49.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.764+0000 7fdd6c734700 1 --2- 172.21.15.149:0/2825035752 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdd6415da20 0x7fdd640cbdb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdd54009840 tx=0x7fdd54009b50 comp rx=0 tx=0).stop 2023-11-08T19:24:49.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.764+0000 7fdd6c734700 1 -- 172.21.15.149:0/2825035752 shutdown_connections 2023-11-08T19:24:49.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.764+0000 7fdd6c734700 1 --2- 172.21.15.149:0/2825035752 >> v2:172.21.15.160:3300/0 conn(0x7fdd6406da60 0x7fdd6406c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:49.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.764+0000 7fdd6c734700 1 --2- 172.21.15.149:0/2825035752 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdd6415da20 0x7fdd640cbdb0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:49.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.764+0000 7fdd6c734700 1 -- 172.21.15.149:0/2825035752 >> 172.21.15.149:0/2825035752 conn(0x7fdd640ce1e0 msgr2=0x7fdd640ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:49.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.764+0000 7fdd6c734700 1 -- 172.21.15.149:0/2825035752 shutdown_connections 2023-11-08T19:24:49.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.764+0000 7fdd6c734700 1 -- 172.21.15.149:0/2825035752 wait complete. 2023-11-08T19:24:49.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.765+0000 7fdd6c734700 1 Processor -- start 2023-11-08T19:24:49.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.765+0000 7fdd6c734700 1 -- start start 2023-11-08T19:24:49.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.766+0000 7fdd6c734700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdd6406d5e0 0x7fdd6415f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:49.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.766+0000 7fdd6c734700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdd6406da60 0x7fdd6414d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:49.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.766+0000 7fdd6c734700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdd6415da20 0x7fdd6414dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:49.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.766+0000 7fdd6c734700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6414b490 con 0x7fdd6406da60 2023-11-08T19:24:49.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.766+0000 7fdd6c734700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd64160340 con 0x7fdd6406d5e0 2023-11-08T19:24:49.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.766+0000 7fdd6c734700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd64160620 con 0x7fdd6415da20 2023-11-08T19:24:49.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.766+0000 7fdd69ccf700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdd6406da60 0x7fdd6414d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:49.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.766+0000 7fdd69ccf700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdd6406da60 0x7fdd6414d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40194/0 (socket says 172.21.15.149:40194) 2023-11-08T19:24:49.779 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.766+0000 7fdd69ccf700 1 -- 172.21.15.149:0/576316229 learned_addr learned my addr 172.21.15.149:0/576316229 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:49.779 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.766+0000 7fdd6a4d0700 1 --2- 172.21.15.149:0/576316229 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdd6406d5e0 0x7fdd6415f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:49.779 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.766+0000 7fdd6acd1700 1 --2- 172.21.15.149:0/576316229 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdd6415da20 0x7fdd6414dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:49.779 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.766+0000 7fdd69ccf700 1 -- 172.21.15.149:0/576316229 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdd6415da20 msgr2=0x7fdd6414dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:49.779 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.767+0000 7fdd69ccf700 1 --2- 172.21.15.149:0/576316229 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdd6415da20 0x7fdd6414dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:49.780 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.767+0000 7fdd69ccf700 1 -- 172.21.15.149:0/576316229 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdd6406d5e0 msgr2=0x7fdd6415f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:49.780 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.767+0000 7fdd69ccf700 1 --2- 172.21.15.149:0/576316229 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdd6406d5e0 0x7fdd6415f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:49.780 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.767+0000 7fdd69ccf700 1 -- 172.21.15.149:0/576316229 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd5c009a70 con 0x7fdd6406da60 2023-11-08T19:24:49.780 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.767+0000 7fdd69ccf700 1 --2- 172.21.15.149:0/576316229 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdd6406da60 0x7fdd6414d820 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fdd6000c780 tx=0x7fdd6000ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:49.780 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.767+0000 7fdd5affd700 1 -- 172.21.15.149:0/576316229 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd60004c80 con 0x7fdd6406da60 2023-11-08T19:24:49.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.767+0000 7fdd5affd700 1 -- 172.21.15.149:0/576316229 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd60004de0 con 0x7fdd6406da60 2023-11-08T19:24:49.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.767+0000 7fdd5affd700 1 -- 172.21.15.149:0/576316229 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd600072f0 con 0x7fdd6406da60 2023-11-08T19:24:49.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.767+0000 7fdd6c734700 1 -- 172.21.15.149:0/576316229 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd540094a0 con 0x7fdd6406da60 2023-11-08T19:24:49.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.767+0000 7fdd6c734700 1 -- 172.21.15.149:0/576316229 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd64160be0 con 0x7fdd6406da60 2023-11-08T19:24:49.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.768+0000 7fdd6c734700 1 -- 172.21.15.149:0/576316229 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd640745f0 con 0x7fdd6406da60 2023-11-08T19:24:49.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.768+0000 7fdd5affd700 1 -- 172.21.15.149:0/576316229 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdd60007450 con 0x7fdd6406da60 2023-11-08T19:24:49.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.769+0000 7fdd5affd700 1 --2- 172.21.15.149:0/576316229 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fdd4806af00 0x7fdd4806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:49.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.769+0000 7fdd5affd700 1 -- 172.21.15.149:0/576316229 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fdd60088590 con 0x7fdd6406da60 2023-11-08T19:24:49.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.769+0000 7fdd6a4d0700 1 --2- 172.21.15.149:0/576316229 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fdd4806af00 0x7fdd4806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:49.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.769+0000 7fdd6a4d0700 1 --2- 172.21.15.149:0/576316229 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fdd4806af00 0x7fdd4806d3c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fdd540090b0 tx=0x7fdd54008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:49.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.774+0000 7fdd5affd700 1 -- 172.21.15.149:0/576316229 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdd600536e0 con 0x7fdd6406da60 2023-11-08T19:24:49.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:49.963+0000 7fdd6c734700 1 -- 172.21.15.149:0/576316229 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fdd640cc0d0 con 0x7fdd6406da60 2023-11-08T19:24:50.329 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.328+0000 7fdd5affd700 1 -- 172.21.15.149:0/576316229 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v52) v1 ==== 138+0+0 (secure 0 0 0) 0x7fdd60007700 con 0x7fdd6406da60 2023-11-08T19:24:50.331 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.330+0000 7fdd6c734700 1 -- 172.21.15.149:0/576316229 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fdd4806af00 msgr2=0x7fdd4806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:50.331 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.330+0000 7fdd6c734700 1 --2- 172.21.15.149:0/576316229 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fdd4806af00 0x7fdd4806d3c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fdd540090b0 tx=0x7fdd54008030 comp rx=0 tx=0).stop 2023-11-08T19:24:50.332 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.330+0000 7fdd6c734700 1 -- 172.21.15.149:0/576316229 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdd6406da60 msgr2=0x7fdd6414d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:50.332 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.330+0000 7fdd6c734700 1 --2- 172.21.15.149:0/576316229 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdd6406da60 0x7fdd6414d820 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fdd6000c780 tx=0x7fdd6000ca90 comp rx=0 tx=0).stop 2023-11-08T19:24:50.332 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.330+0000 7fdd6c734700 1 -- 172.21.15.149:0/576316229 shutdown_connections 2023-11-08T19:24:50.332 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.330+0000 7fdd6c734700 1 --2- 172.21.15.149:0/576316229 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fdd4806af00 0x7fdd4806d3c0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:50.332 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.330+0000 7fdd6c734700 1 --2- 172.21.15.149:0/576316229 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdd6406d5e0 0x7fdd6415f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:50.333 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.330+0000 7fdd6c734700 1 --2- 172.21.15.149:0/576316229 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdd6415da20 0x7fdd6414dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:50.333 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.330+0000 7fdd6c734700 1 --2- 172.21.15.149:0/576316229 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdd6406da60 0x7fdd6414d820 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:50.333 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.330+0000 7fdd6c734700 1 -- 172.21.15.149:0/576316229 >> 172.21.15.149:0/576316229 conn(0x7fdd640ce1e0 msgr2=0x7fdd640b2000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:50.333 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.330+0000 7fdd6c734700 1 -- 172.21.15.149:0/576316229 shutdown_connections 2023-11-08T19:24:50.334 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.330+0000 7fdd6c734700 1 -- 172.21.15.149:0/576316229 wait complete. 2023-11-08T19:24:50.334 INFO:teuthology.orchestra.run.smithi149.stderr:pool 'cephfs_metadata' created 2023-11-08T19:24:50.348 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-08T19:24:50.476 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.475+0000 7ff2d0751700 1 Processor -- start 2023-11-08T19:24:50.477 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.475+0000 7ff2d0751700 1 -- start start 2023-11-08T19:24:50.480 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.476+0000 7ff2d0751700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff2c80ccf60 0x7ff2c80cd340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:50.481 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.476+0000 7ff2d0751700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2c8070780 con 0x7ff2c8072b60 2023-11-08T19:24:50.481 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.476+0000 7ff2d0751700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2c80cd880 con 0x7ff2c80cfde0 2023-11-08T19:24:50.481 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.476+0000 7ff2d0751700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c806fee0 con 0x7ff2c80ccf60 2023-11-08T19:24:50.481 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.476+0000 7ff2cecee700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7ff2c8072b60 0x7ff2c815e200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:42204/0 (socket says 172.21.15.149:42204) 2023-11-08T19:24:50.482 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.476+0000 7ff2cecee700 1 -- 172.21.15.149:0/2078976445 learned_addr learned my addr 172.21.15.149:0/2078976445 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:24:50.482 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.477+0000 7ff2ce4ed700 1 --2- 172.21.15.149:0/2078976445 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff2c80ccf60 0x7ff2c80cd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:50.482 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.477+0000 7ff2cd4eb700 1 -- 172.21.15.149:0/2078976445 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 194035274 0 0) 0x7ff2c8070780 con 0x7ff2c8072b60 2023-11-08T19:24:50.482 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.477+0000 7ff2cd4eb700 1 -- 172.21.15.149:0/2078976445 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2b40035b0 con 0x7ff2c8072b60 2023-11-08T19:24:50.482 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.477+0000 7ff2cd4eb700 1 -- 172.21.15.149:0/2078976445 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4176383810 0 0) 0x7ff2b40035b0 con 0x7ff2c8072b60 2023-11-08T19:24:50.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.477+0000 7ff2cd4eb700 1 -- 172.21.15.149:0/2078976445 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff2c80ccf60 msgr2=0x7ff2c80cd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:50.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.477+0000 7ff2cd4eb700 1 --2- 172.21.15.149:0/2078976445 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff2c80ccf60 0x7ff2c80cd340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:50.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.477+0000 7ff2cd4eb700 1 -- 172.21.15.149:0/2078976445 >> v1:172.21.15.160:6789/0 conn(0x7ff2c80cfde0 legacy=0x7ff2c815b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:50.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.477+0000 7ff2cd4eb700 1 -- 172.21.15.149:0/2078976445 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c80701c0 con 0x7ff2c8072b60 2023-11-08T19:24:50.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.477+0000 7ff2cd4eb700 1 -- 172.21.15.149:0/2078976445 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7ff2c00019f0 con 0x7ff2c8072b60 2023-11-08T19:24:50.484 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.477+0000 7ff2cd4eb700 1 -- 172.21.15.149:0/2078976445 >> v1:172.21.15.149:6789/0 conn(0x7ff2c8072b60 legacy=0x7ff2c815e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:50.484 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.477+0000 7ff2cd4eb700 1 --2- 172.21.15.149:0/2078976445 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff2b4003a30 0x7ff2b4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:50.484 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.477+0000 7ff2cd4eb700 1 --2- 172.21.15.149:0/2078976445 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff2c80ccf60 0x7ff2b4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:50.484 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.477+0000 7ff2cd4eb700 1 --2- 172.21.15.149:0/2078976445 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff2b4004d90 0x7ff2b4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:50.484 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.477+0000 7ff2cd4eb700 1 -- 172.21.15.149:0/2078976445 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c806fee0 con 0x7ff2b4004d90 2023-11-08T19:24:50.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.477+0000 7ff2cd4eb700 1 -- 172.21.15.149:0/2078976445 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b400ba10 con 0x7ff2b4003a30 2023-11-08T19:24:50.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.477+0000 7ff2cd4eb700 1 -- 172.21.15.149:0/2078976445 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b400dde0 con 0x7ff2c80ccf60 2023-11-08T19:24:50.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.477+0000 7ff2cecee700 1 --2- 172.21.15.149:0/2078976445 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff2b4004d90 0x7ff2b4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:50.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.477+0000 7ff2ce4ed700 1 --2- 172.21.15.149:0/2078976445 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff2b4003a30 0x7ff2b4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:50.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.477+0000 7ff2cdcec700 1 --2- 172.21.15.149:0/2078976445 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff2c80ccf60 0x7ff2b4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:50.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.477+0000 7ff2cecee700 1 -- 172.21.15.149:0/2078976445 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff2c80ccf60 msgr2=0x7ff2b4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:50.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.477+0000 7ff2cecee700 1 --2- 172.21.15.149:0/2078976445 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff2c80ccf60 0x7ff2b4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:50.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.477+0000 7ff2cecee700 1 -- 172.21.15.149:0/2078976445 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff2b4003a30 msgr2=0x7ff2b4003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:50.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.477+0000 7ff2cecee700 1 --2- 172.21.15.149:0/2078976445 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff2b4003a30 0x7ff2b4003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:50.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.478+0000 7ff2cecee700 1 -- 172.21.15.149:0/2078976445 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2b40035b0 con 0x7ff2b4004d90 2023-11-08T19:24:50.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.478+0000 7ff2cecee700 1 --2- 172.21.15.149:0/2078976445 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff2b4004d90 0x7ff2b4005210 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7ff2c8073010 tx=0x7ff2b4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54ff32ae28b50e14 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:50.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.478+0000 7ff2cd4eb700 1 -- 172.21.15.149:0/2078976445 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c0012600 con 0x7ff2b4004d90 2023-11-08T19:24:50.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.478+0000 7ff2cd4eb700 1 -- 172.21.15.149:0/2078976445 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2c0012780 con 0x7ff2b4004d90 2023-11-08T19:24:50.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.478+0000 7ff2cd4eb700 1 -- 172.21.15.149:0/2078976445 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c0012b30 con 0x7ff2b4004d90 2023-11-08T19:24:50.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.478+0000 7ff2d0751700 1 -- 172.21.15.149:0/2078976445 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff2b4004d90 msgr2=0x7ff2b4005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:50.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.478+0000 7ff2d0751700 1 --2- 172.21.15.149:0/2078976445 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff2b4004d90 0x7ff2b4005210 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7ff2c8073010 tx=0x7ff2b4005880 comp rx=0 tx=0).stop 2023-11-08T19:24:50.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.478+0000 7ff2cecee700 1 -- 172.21.15.149:0/2078976445 reap_dead start 2023-11-08T19:24:50.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.478+0000 7ff2d0751700 1 -- 172.21.15.149:0/2078976445 shutdown_connections 2023-11-08T19:24:50.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.478+0000 7ff2d0751700 1 -- 172.21.15.149:0/2078976445 >> 172.21.15.149:0/2078976445 conn(0x7ff2c806def0 msgr2=0x7ff2c806e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:50.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.478+0000 7ff2d0751700 1 -- 172.21.15.149:0/2078976445 shutdown_connections 2023-11-08T19:24:50.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.478+0000 7ff2d0751700 1 -- 172.21.15.149:0/2078976445 wait complete. 2023-11-08T19:24:50.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.480+0000 7ff2d0751700 1 Processor -- start 2023-11-08T19:24:50.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.480+0000 7ff2d0751700 1 -- start start 2023-11-08T19:24:50.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.480+0000 7ff2d0751700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff2b4004d90 0x7ff2c815ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:50.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.480+0000 7ff2d0751700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff2c80c7620 0x7ff2c8157170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:50.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.480+0000 7ff2d0751700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff2c80b5180 0x7ff2c80b5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:50.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.480+0000 7ff2d0751700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c80b5b50 con 0x7ff2c80b5180 2023-11-08T19:24:50.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.480+0000 7ff2d0751700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c815eb30 con 0x7ff2c80c7620 2023-11-08T19:24:50.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.480+0000 7ff2d0751700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c80c4aa0 con 0x7ff2b4004d90 2023-11-08T19:24:50.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.480+0000 7ff2cecee700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff2c80b5180 0x7ff2c80b5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:50.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.480+0000 7ff2cecee700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff2c80b5180 0x7ff2c80b5610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40214/0 (socket says 172.21.15.149:40214) 2023-11-08T19:24:50.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.480+0000 7ff2cecee700 1 -- 172.21.15.149:0/2632879255 learned_addr learned my addr 172.21.15.149:0/2632879255 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:50.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.481+0000 7ff2cdcec700 1 --2- 172.21.15.149:0/2632879255 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff2c80c7620 0x7ff2c8157170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:50.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.481+0000 7ff2ce4ed700 1 --2- 172.21.15.149:0/2632879255 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff2b4004d90 0x7ff2c815ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:50.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.481+0000 7ff2cecee700 1 -- 172.21.15.149:0/2632879255 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff2b4004d90 msgr2=0x7ff2c815ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:50.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.481+0000 7ff2cecee700 1 --2- 172.21.15.149:0/2632879255 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff2b4004d90 0x7ff2c815ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:50.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.481+0000 7ff2cecee700 1 -- 172.21.15.149:0/2632879255 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff2c80c7620 msgr2=0x7ff2c8157170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:50.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.481+0000 7ff2cecee700 1 --2- 172.21.15.149:0/2632879255 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff2c80c7620 0x7ff2c8157170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:50.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.481+0000 7ff2cecee700 1 -- 172.21.15.149:0/2632879255 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c80c7aa0 con 0x7ff2c80b5180 2023-11-08T19:24:50.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.481+0000 7ff2cecee700 1 --2- 172.21.15.149:0/2632879255 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff2c80b5180 0x7ff2c80b5610 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7ff2c0012000 tx=0x7ff2c0001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:50.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.481+0000 7ff2beffd700 1 -- 172.21.15.149:0/2632879255 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c00019b0 con 0x7ff2c80b5180 2023-11-08T19:24:50.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.481+0000 7ff2beffd700 1 -- 172.21.15.149:0/2632879255 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2c0012610 con 0x7ff2c80b5180 2023-11-08T19:24:50.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.481+0000 7ff2beffd700 1 -- 172.21.15.149:0/2632879255 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c001e630 con 0x7ff2c80b5180 2023-11-08T19:24:50.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.481+0000 7ff2d0751700 1 -- 172.21.15.149:0/2632879255 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2c81576b0 con 0x7ff2c80b5180 2023-11-08T19:24:50.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.481+0000 7ff2d0751700 1 -- 172.21.15.149:0/2632879255 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2c80c8000 con 0x7ff2c80b5180 2023-11-08T19:24:50.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.482+0000 7ff2d0751700 1 -- 172.21.15.149:0/2632879255 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2c8067680 con 0x7ff2c80b5180 2023-11-08T19:24:50.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.483+0000 7ff2beffd700 1 -- 172.21.15.149:0/2632879255 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff2c0024020 con 0x7ff2c80b5180 2023-11-08T19:24:50.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.483+0000 7ff2beffd700 1 --2- 172.21.15.149:0/2632879255 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff2ac06af00 0x7ff2ac06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:50.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.483+0000 7ff2beffd700 1 -- 172.21.15.149:0/2632879255 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5900+0+0 (secure 0 0 0) 0x7ff2c008bdd0 con 0x7ff2c80b5180 2023-11-08T19:24:50.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.483+0000 7ff2ce4ed700 1 --2- 172.21.15.149:0/2632879255 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff2ac06af00 0x7ff2ac06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:50.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.483+0000 7ff2ce4ed700 1 --2- 172.21.15.149:0/2632879255 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff2ac06af00 0x7ff2ac06d3c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff2c4009ba0 tx=0x7ff2c4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:50.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.488+0000 7ff2beffd700 1 -- 172.21.15.149:0/2632879255 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff2c0056f30 con 0x7ff2c80b5180 2023-11-08T19:24:50.678 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:50.677+0000 7ff2d0751700 1 -- 172.21.15.149:0/2632879255 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ff2c815b940 con 0x7ff2c80b5180 2023-11-08T19:24:51.331 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.330+0000 7ff2beffd700 1 -- 172.21.15.149:0/2632879255 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v53) v1 ==== 170+0+0 (secure 0 0 0) 0x7ff2c002c020 con 0x7ff2c80b5180 2023-11-08T19:24:51.334 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.333+0000 7ff2d0751700 1 -- 172.21.15.149:0/2632879255 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff2ac06af00 msgr2=0x7ff2ac06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:51.334 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.333+0000 7ff2d0751700 1 --2- 172.21.15.149:0/2632879255 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff2ac06af00 0x7ff2ac06d3c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff2c4009ba0 tx=0x7ff2c4008040 comp rx=0 tx=0).stop 2023-11-08T19:24:51.335 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.333+0000 7ff2d0751700 1 -- 172.21.15.149:0/2632879255 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff2c80b5180 msgr2=0x7ff2c80b5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:51.335 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.333+0000 7ff2d0751700 1 --2- 172.21.15.149:0/2632879255 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff2c80b5180 0x7ff2c80b5610 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7ff2c0012000 tx=0x7ff2c0001d80 comp rx=0 tx=0).stop 2023-11-08T19:24:51.335 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.333+0000 7ff2d0751700 1 -- 172.21.15.149:0/2632879255 shutdown_connections 2023-11-08T19:24:51.336 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.333+0000 7ff2d0751700 1 --2- 172.21.15.149:0/2632879255 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff2ac06af00 0x7ff2ac06d3c0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:51.336 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.333+0000 7ff2d0751700 1 --2- 172.21.15.149:0/2632879255 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff2c80b5180 0x7ff2c80b5610 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:51.336 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.333+0000 7ff2d0751700 1 --2- 172.21.15.149:0/2632879255 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff2b4004d90 0x7ff2c815ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:51.336 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.333+0000 7ff2d0751700 1 --2- 172.21.15.149:0/2632879255 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff2c80c7620 0x7ff2c8157170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:51.337 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.333+0000 7ff2d0751700 1 -- 172.21.15.149:0/2632879255 >> 172.21.15.149:0/2632879255 conn(0x7ff2c806def0 msgr2=0x7ff2c81588a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:51.337 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.333+0000 7ff2d0751700 1 -- 172.21.15.149:0/2632879255 shutdown_connections 2023-11-08T19:24:51.337 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.333+0000 7ff2d0751700 1 -- 172.21.15.149:0/2632879255 wait complete. 2023-11-08T19:24:51.338 INFO:teuthology.orchestra.run.smithi149.stderr:pool 'cephfs_data' created 2023-11-08T19:24:51.361 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-08T19:24:51.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.485+0000 7f4b605b8700 1 Processor -- start 2023-11-08T19:24:51.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.485+0000 7f4b605b8700 1 -- start start 2023-11-08T19:24:51.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.486+0000 7f4b605b8700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4b580b38e0 0x7f4b580cfd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:51.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.486+0000 7f4b605b8700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f4b5806d5e0 0x7f4b5806c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:51.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.486+0000 7f4b605b8700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b580cdd30 con 0x7f4b5815db10 2023-11-08T19:24:51.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.486+0000 7f4b605b8700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b580ced40 con 0x7f4b5806d5e0 2023-11-08T19:24:51.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.486+0000 7f4b605b8700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b580cbe50 con 0x7f4b580b38e0 2023-11-08T19:24:51.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.486+0000 7f4b5eb55700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f4b5806d5e0 0x7f4b5806c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:51.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.486+0000 7f4b5e354700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f4b5815db10 0x7f4b580b31d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:42220/0 (socket says 172.21.15.149:42220) 2023-11-08T19:24:51.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.486+0000 7f4b5e354700 1 -- 172.21.15.149:0/1008998776 learned_addr learned my addr 172.21.15.149:0/1008998776 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:24:51.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.487+0000 7f4b5db53700 1 --2- 172.21.15.149:0/1008998776 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4b580b38e0 0x7f4b580cfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:51.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.487+0000 7f4b5eb55700 1 -- 172.21.15.149:0/1008998776 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4b580b38e0 msgr2=0x7f4b580cfd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:51.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.487+0000 7f4b5eb55700 1 --2- 172.21.15.149:0/1008998776 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4b580b38e0 0x7f4b580cfd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:51.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.487+0000 7f4b5eb55700 1 -- 172.21.15.149:0/1008998776 >> v1:172.21.15.149:6789/0 conn(0x7f4b5815db10 legacy=0x7f4b580b31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:51.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.487+0000 7f4b5d352700 1 -- 172.21.15.149:0/1008998776 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1480244324 0 0) 0x7f4b580cdd30 con 0x7f4b5815db10 2023-11-08T19:24:51.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.487+0000 7f4b5eb55700 1 -- 172.21.15.149:0/1008998776 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b5806da70 con 0x7f4b5806d5e0 2023-11-08T19:24:51.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.487+0000 7f4b5eb55700 1 --2- 172.21.15.149:0/1008998776 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b5806d5e0 0x7f4b5806c160 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f4b48009d90 tx=0x7f4b4800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ba5c8b3f3a0d01a server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:51.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.487+0000 7f4b5d352700 1 -- 172.21.15.149:0/1008998776 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4800e070 con 0x7f4b5806d5e0 2023-11-08T19:24:51.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.487+0000 7f4b5d352700 1 -- 172.21.15.149:0/1008998776 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b4800bbd0 con 0x7f4b5806d5e0 2023-11-08T19:24:51.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.487+0000 7f4b5d352700 1 -- 172.21.15.149:0/1008998776 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b48012430 con 0x7f4b5806d5e0 2023-11-08T19:24:51.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.487+0000 7f4b605b8700 1 -- 172.21.15.149:0/1008998776 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b5806d5e0 msgr2=0x7f4b5806c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:51.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.487+0000 7f4b605b8700 1 --2- 172.21.15.149:0/1008998776 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b5806d5e0 0x7f4b5806c160 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f4b48009d90 tx=0x7f4b4800b330 comp rx=0 tx=0).stop 2023-11-08T19:24:51.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.488+0000 7f4b605b8700 1 -- 172.21.15.149:0/1008998776 shutdown_connections 2023-11-08T19:24:51.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.488+0000 7f4b605b8700 1 --2- 172.21.15.149:0/1008998776 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b5806d5e0 0x7f4b5806c160 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:51.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.488+0000 7f4b605b8700 1 --2- 172.21.15.149:0/1008998776 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4b580b38e0 0x7f4b580cfd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:51.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.488+0000 7f4b605b8700 1 -- 172.21.15.149:0/1008998776 >> 172.21.15.149:0/1008998776 conn(0x7f4b5806f120 msgr2=0x7f4b5806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:51.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.488+0000 7f4b605b8700 1 -- 172.21.15.149:0/1008998776 shutdown_connections 2023-11-08T19:24:51.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.488+0000 7f4b605b8700 1 -- 172.21.15.149:0/1008998776 wait complete. 2023-11-08T19:24:51.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.489+0000 7f4b605b8700 1 Processor -- start 2023-11-08T19:24:51.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.489+0000 7f4b605b8700 1 -- start start 2023-11-08T19:24:51.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.489+0000 7f4b605b8700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4b5806d5e0 0x7f4b5815c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:51.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.489+0000 7f4b605b8700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b580b38e0 0x7f4b580ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:51.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.490+0000 7f4b605b8700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b5815db10 0x7f4b580caf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:51.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.490+0000 7f4b605b8700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b580c6300 con 0x7f4b580b38e0 2023-11-08T19:24:51.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.490+0000 7f4b605b8700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b580c65e0 con 0x7f4b5815db10 2023-11-08T19:24:51.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.490+0000 7f4b605b8700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b580c68c0 con 0x7f4b5806d5e0 2023-11-08T19:24:51.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.490+0000 7f4b5db53700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b580b38e0 0x7f4b580ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:51.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.490+0000 7f4b5db53700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b580b38e0 0x7f4b580ca9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40226/0 (socket says 172.21.15.149:40226) 2023-11-08T19:24:51.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.490+0000 7f4b5db53700 1 -- 172.21.15.149:0/3078259459 learned_addr learned my addr 172.21.15.149:0/3078259459 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:51.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.490+0000 7f4b5e354700 1 --2- 172.21.15.149:0/3078259459 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4b5806d5e0 0x7f4b5815c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:51.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.490+0000 7f4b5eb55700 1 --2- 172.21.15.149:0/3078259459 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b5815db10 0x7f4b580caf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:51.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.490+0000 7f4b5db53700 1 -- 172.21.15.149:0/3078259459 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4b5806d5e0 msgr2=0x7f4b5815c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:51.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.490+0000 7f4b5db53700 1 --2- 172.21.15.149:0/3078259459 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4b5806d5e0 0x7f4b5815c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:51.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.490+0000 7f4b5db53700 1 -- 172.21.15.149:0/3078259459 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b5815db10 msgr2=0x7f4b580caf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:51.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.490+0000 7f4b5db53700 1 --2- 172.21.15.149:0/3078259459 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b5815db10 0x7f4b580caf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:51.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.490+0000 7f4b5db53700 1 -- 172.21.15.149:0/3078259459 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b48009a70 con 0x7f4b580b38e0 2023-11-08T19:24:51.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.490+0000 7f4b5eb55700 1 --2- 172.21.15.149:0/3078259459 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b5815db10 0x7f4b580caf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:24:51.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.490+0000 7f4b5db53700 1 --2- 172.21.15.149:0/3078259459 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b580b38e0 0x7f4b580ca9f0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c00d800 tx=0x7f4b4c00dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:51.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.490+0000 7f4b56ffd700 1 -- 172.21.15.149:0/3078259459 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4c0125f0 con 0x7f4b580b38e0 2023-11-08T19:24:51.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.490+0000 7f4b56ffd700 1 -- 172.21.15.149:0/3078259459 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b4c012750 con 0x7f4b580b38e0 2023-11-08T19:24:51.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.490+0000 7f4b56ffd700 1 -- 172.21.15.149:0/3078259459 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4c012b00 con 0x7f4b580b38e0 2023-11-08T19:24:51.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.490+0000 7f4b605b8700 1 -- 172.21.15.149:0/3078259459 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b580c6ba0 con 0x7f4b580b38e0 2023-11-08T19:24:51.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.490+0000 7f4b605b8700 1 -- 172.21.15.149:0/3078259459 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b5815c7b0 con 0x7f4b580b38e0 2023-11-08T19:24:51.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.491+0000 7f4b605b8700 1 -- 172.21.15.149:0/3078259459 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b580c70c0 con 0x7f4b580b38e0 2023-11-08T19:24:51.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.492+0000 7f4b56ffd700 1 -- 172.21.15.149:0/3078259459 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4b4c012c60 con 0x7f4b580b38e0 2023-11-08T19:24:51.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.492+0000 7f4b56ffd700 1 --2- 172.21.15.149:0/3078259459 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4b4406af00 0x7f4b4406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:51.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.492+0000 7f4b56ffd700 1 -- 172.21.15.149:0/3078259459 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6282+0+0 (secure 0 0 0) 0x7f4b4c089be0 con 0x7f4b580b38e0 2023-11-08T19:24:51.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.492+0000 7f4b5e354700 1 --2- 172.21.15.149:0/3078259459 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4b4406af00 0x7f4b4406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:51.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.493+0000 7f4b5e354700 1 --2- 172.21.15.149:0/3078259459 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4b4406af00 0x7f4b4406d3c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4b50000f60 tx=0x7f4b50007c90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:51.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.497+0000 7f4b56ffd700 1 -- 172.21.15.149:0/3078259459 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4b580c70c0 con 0x7f4b580b38e0 2023-11-08T19:24:51.734 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:51.733+0000 7f4b605b8700 1 -- 172.21.15.149:0/3078259459 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f4b580c70c0 con 0x7f4b580b38e0 2023-11-08T19:24:52.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.360+0000 7f4b56ffd700 1 -- 172.21.15.149:0/3078259459 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v21) v1 ==== 172+0+0 (secure 0 0 0) 0x7f4b580c70c0 con 0x7f4b580b38e0 2023-11-08T19:24:52.372 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.371+0000 7f4b605b8700 1 -- 172.21.15.149:0/3078259459 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4b4406af00 msgr2=0x7f4b4406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:52.373 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.371+0000 7f4b605b8700 1 --2- 172.21.15.149:0/3078259459 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4b4406af00 0x7f4b4406d3c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4b50000f60 tx=0x7f4b50007c90 comp rx=0 tx=0).stop 2023-11-08T19:24:52.373 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.371+0000 7f4b605b8700 1 -- 172.21.15.149:0/3078259459 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b580b38e0 msgr2=0x7f4b580ca9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:52.373 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.371+0000 7f4b605b8700 1 --2- 172.21.15.149:0/3078259459 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b580b38e0 0x7f4b580ca9f0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c00d800 tx=0x7f4b4c00dbc0 comp rx=0 tx=0).stop 2023-11-08T19:24:52.379 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.378+0000 7f4b605b8700 1 -- 172.21.15.149:0/3078259459 shutdown_connections 2023-11-08T19:24:52.379 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.378+0000 7f4b605b8700 1 --2- 172.21.15.149:0/3078259459 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4b4406af00 0x7f4b4406d3c0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:52.380 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.378+0000 7f4b605b8700 1 --2- 172.21.15.149:0/3078259459 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b5815db10 0x7f4b580caf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:52.380 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.378+0000 7f4b605b8700 1 --2- 172.21.15.149:0/3078259459 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4b5806d5e0 0x7f4b5815c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:52.380 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.378+0000 7f4b605b8700 1 --2- 172.21.15.149:0/3078259459 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b580b38e0 0x7f4b580ca9f0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:52.380 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.378+0000 7f4b605b8700 1 -- 172.21.15.149:0/3078259459 >> 172.21.15.149:0/3078259459 conn(0x7f4b5806f120 msgr2=0x7f4b580b0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:52.380 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.378+0000 7f4b605b8700 1 -- 172.21.15.149:0/3078259459 shutdown_connections 2023-11-08T19:24:52.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.378+0000 7f4b605b8700 1 -- 172.21.15.149:0/3078259459 wait complete. 2023-11-08T19:24:52.381 INFO:teuthology.orchestra.run.smithi149.stderr:new fs with metadata pool 8 and data pool 9 2023-11-08T19:24:52.395 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:24:52.516 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.515+0000 7f8eb411c700 1 Processor -- start 2023-11-08T19:24:52.516 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.515+0000 7f8eb411c700 1 -- start start 2023-11-08T19:24:52.520 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.516+0000 7f8eb411c700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f8eac0cc910 0x7f8eac0cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:52.520 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.516+0000 7f8eb411c700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8eac0b2f60 con 0x7f8eac0cc140 2023-11-08T19:24:52.520 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.516+0000 7f8eb411c700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8eac0cc520 con 0x7f8eac0cb130 2023-11-08T19:24:52.520 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.516+0000 7f8eb411c700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8eac0b2430 con 0x7f8eac0cc910 2023-11-08T19:24:52.520 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.516+0000 7f8eb1eb8700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f8eac0cc140 0x7f8eac0b2850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:42246/0 (socket says 172.21.15.149:42246) 2023-11-08T19:24:52.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.516+0000 7f8eb1eb8700 1 -- 172.21.15.149:0/4286689367 learned_addr learned my addr 172.21.15.149:0/4286689367 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:24:52.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.516+0000 7f8eb0eb6700 1 -- 172.21.15.149:0/4286689367 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2689183436 0 0) 0x7f8eac0b2f60 con 0x7f8eac0cc140 2023-11-08T19:24:52.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.516+0000 7f8eb0eb6700 1 -- 172.21.15.149:0/4286689367 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e980035b0 con 0x7f8eac0cc140 2023-11-08T19:24:52.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.516+0000 7f8eb16b7700 1 --2- 172.21.15.149:0/4286689367 >> v2:172.21.15.160:3300/0 conn(0x7f8eac0cc910 0x7f8eac0cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:52.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.517+0000 7f8eb0eb6700 1 -- 172.21.15.149:0/4286689367 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3785353272 0 0) 0x7f8e980035b0 con 0x7f8eac0cc140 2023-11-08T19:24:52.522 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.517+0000 7f8eb0eb6700 1 -- 172.21.15.149:0/4286689367 >> v2:172.21.15.160:3300/0 conn(0x7f8eac0cc910 msgr2=0x7f8eac0cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:52.522 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.517+0000 7f8eb0eb6700 1 --2- 172.21.15.149:0/4286689367 >> v2:172.21.15.160:3300/0 conn(0x7f8eac0cc910 0x7f8eac0cabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:52.522 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.517+0000 7f8eb0eb6700 1 -- 172.21.15.149:0/4286689367 >> v1:172.21.15.160:6789/0 conn(0x7f8eac0cb130 legacy=0x7f8eac15d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:52.522 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.517+0000 7f8eb0eb6700 1 -- 172.21.15.149:0/4286689367 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eac0cb5e0 con 0x7f8eac0cc140 2023-11-08T19:24:52.522 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.517+0000 7f8eb0eb6700 1 -- 172.21.15.149:0/4286689367 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f8e9c0017f0 con 0x7f8eac0cc140 2023-11-08T19:24:52.523 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.517+0000 7f8eb0eb6700 1 -- 172.21.15.149:0/4286689367 >> v1:172.21.15.149:6789/0 conn(0x7f8eac0cc140 legacy=0x7f8eac0b2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:52.523 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.517+0000 7f8eb0eb6700 1 --2- 172.21.15.149:0/4286689367 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8e98003a00 0x7f8e98003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:52.523 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.517+0000 7f8eb0eb6700 1 --2- 172.21.15.149:0/4286689367 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e98004850 0x7f8e98004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:52.523 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.517+0000 7f8eb0eb6700 1 --2- 172.21.15.149:0/4286689367 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8e98005210 0x7f8e9800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:52.523 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.517+0000 7f8eb0eb6700 1 -- 172.21.15.149:0/4286689367 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eac0b2430 con 0x7f8e98004850 2023-11-08T19:24:52.523 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.517+0000 7f8eb0eb6700 1 -- 172.21.15.149:0/4286689367 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9800c0b0 con 0x7f8e98005210 2023-11-08T19:24:52.524 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.517+0000 7f8eb0eb6700 1 -- 172.21.15.149:0/4286689367 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9800c270 con 0x7f8e98003a00 2023-11-08T19:24:52.524 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.517+0000 7f8eb16b7700 1 --2- 172.21.15.149:0/4286689367 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e98004850 0x7f8e98004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:52.524 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.517+0000 7f8eb1eb8700 1 --2- 172.21.15.149:0/4286689367 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8e98003a00 0x7f8e98003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:52.524 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.517+0000 7f8eb26b9700 1 --2- 172.21.15.149:0/4286689367 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8e98005210 0x7f8e9800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:52.525 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.517+0000 7f8eb16b7700 1 -- 172.21.15.149:0/4286689367 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8e98003a00 msgr2=0x7f8e98003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:52.525 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.517+0000 7f8eb16b7700 1 --2- 172.21.15.149:0/4286689367 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8e98003a00 0x7f8e98003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:52.525 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.517+0000 7f8eb16b7700 1 -- 172.21.15.149:0/4286689367 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8e98005210 msgr2=0x7f8e9800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:52.525 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.517+0000 7f8eb16b7700 1 --2- 172.21.15.149:0/4286689367 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8e98005210 0x7f8e9800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:52.525 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.517+0000 7f8eb16b7700 1 -- 172.21.15.149:0/4286689367 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e980035b0 con 0x7f8e98004850 2023-11-08T19:24:52.526 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.517+0000 7f8eb26b9700 1 -- 172.21.15.149:0/4286689367 reap_dead start 2023-11-08T19:24:52.526 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.517+0000 7f8eb16b7700 1 --2- 172.21.15.149:0/4286689367 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e98004850 0x7f8e98004cd0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f8ea8009b30 tx=0x7f8e98005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3971c1d35111ffdc server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:52.526 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.518+0000 7f8eb0eb6700 1 -- 172.21.15.149:0/4286689367 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea800e6c0 con 0x7f8e98004850 2023-11-08T19:24:52.526 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.518+0000 7f8eb0eb6700 1 -- 172.21.15.149:0/4286689367 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea800e820 con 0x7f8e98004850 2023-11-08T19:24:52.526 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.518+0000 7f8eb0eb6700 1 -- 172.21.15.149:0/4286689367 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea800eb90 con 0x7f8e98004850 2023-11-08T19:24:52.527 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.518+0000 7f8eb411c700 1 -- 172.21.15.149:0/4286689367 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e98004850 msgr2=0x7f8e98004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:52.527 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.518+0000 7f8eb411c700 1 --2- 172.21.15.149:0/4286689367 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e98004850 0x7f8e98004cd0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f8ea8009b30 tx=0x7f8e98005880 comp rx=0 tx=0).stop 2023-11-08T19:24:52.527 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.518+0000 7f8eb411c700 1 -- 172.21.15.149:0/4286689367 shutdown_connections 2023-11-08T19:24:52.527 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.518+0000 7f8eb411c700 1 --2- 172.21.15.149:0/4286689367 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e98004850 0x7f8e98004cd0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:52.527 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.518+0000 7f8eb411c700 1 -- 172.21.15.149:0/4286689367 >> 172.21.15.149:0/4286689367 conn(0x7f8eac099a40 msgr2=0x7f8eac0d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:52.527 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.518+0000 7f8eb411c700 1 -- 172.21.15.149:0/4286689367 shutdown_connections 2023-11-08T19:24:52.528 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.518+0000 7f8eb411c700 1 -- 172.21.15.149:0/4286689367 wait complete. 2023-11-08T19:24:52.530 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.519+0000 7f8eb411c700 1 Processor -- start 2023-11-08T19:24:52.531 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.519+0000 7f8eb411c700 1 -- start start 2023-11-08T19:24:52.531 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.520+0000 7f8eb411c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e98004850 0x7f8eac155b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:52.531 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.520+0000 7f8eb411c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8eac0b3250 0x7f8eac0af1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:52.531 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.520+0000 7f8eb411c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8eac0b36d0 0x7f8eac0af710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:52.531 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.520+0000 7f8eb411c700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eac1f4620 con 0x7f8e98004850 2023-11-08T19:24:52.532 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.520+0000 7f8eb411c700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eac1560b0 con 0x7f8eac0b36d0 2023-11-08T19:24:52.532 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.520+0000 7f8eb411c700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eac1f4830 con 0x7f8eac0b3250 2023-11-08T19:24:52.532 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.520+0000 7f8eb1eb8700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e98004850 0x7f8eac155b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:52.532 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.520+0000 7f8eb1eb8700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e98004850 0x7f8eac155b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40254/0 (socket says 172.21.15.149:40254) 2023-11-08T19:24:52.532 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.520+0000 7f8eb1eb8700 1 -- 172.21.15.149:0/600515342 learned_addr learned my addr 172.21.15.149:0/600515342 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:52.533 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.520+0000 7f8eb26b9700 1 --2- 172.21.15.149:0/600515342 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8eac0b36d0 0x7f8eac0af710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:52.533 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.520+0000 7f8eb16b7700 1 --2- 172.21.15.149:0/600515342 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8eac0b3250 0x7f8eac0af1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:52.533 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.520+0000 7f8eb1eb8700 1 -- 172.21.15.149:0/600515342 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8eac0b3250 msgr2=0x7f8eac0af1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:52.533 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.520+0000 7f8eb1eb8700 1 --2- 172.21.15.149:0/600515342 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8eac0b3250 0x7f8eac0af1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:52.533 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.520+0000 7f8eb1eb8700 1 -- 172.21.15.149:0/600515342 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8eac0b36d0 msgr2=0x7f8eac0af710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:52.534 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.520+0000 7f8eb1eb8700 1 --2- 172.21.15.149:0/600515342 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8eac0b36d0 0x7f8eac0af710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:52.534 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.520+0000 7f8eb1eb8700 1 -- 172.21.15.149:0/600515342 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eac1f4b10 con 0x7f8e98004850 2023-11-08T19:24:52.534 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.521+0000 7f8eb1eb8700 1 --2- 172.21.15.149:0/600515342 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e98004850 0x7f8eac155b70 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c001580 tx=0x7f8e9c00fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:52.534 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.521+0000 7f8ea27fc700 1 -- 172.21.15.149:0/600515342 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c0072e0 con 0x7f8e98004850 2023-11-08T19:24:52.534 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.521+0000 7f8ea27fc700 1 -- 172.21.15.149:0/600515342 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e9c007440 con 0x7f8e98004850 2023-11-08T19:24:52.535 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.521+0000 7f8ea27fc700 1 -- 172.21.15.149:0/600515342 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c005830 con 0x7f8e98004850 2023-11-08T19:24:52.535 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.521+0000 7f8eb411c700 1 -- 172.21.15.149:0/600515342 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eac1f4df0 con 0x7f8e98004850 2023-11-08T19:24:52.535 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.521+0000 7f8eb411c700 1 -- 172.21.15.149:0/600515342 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eac1f53b0 con 0x7f8e98004850 2023-11-08T19:24:52.535 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.522+0000 7f8eb411c700 1 -- 172.21.15.149:0/600515342 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8eac0745f0 con 0x7f8e98004850 2023-11-08T19:24:52.535 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.522+0000 7f8ea27fc700 1 -- 172.21.15.149:0/600515342 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8e9c005990 con 0x7f8e98004850 2023-11-08T19:24:52.536 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.522+0000 7f8ea27fc700 1 --2- 172.21.15.149:0/600515342 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f8e9006af00 0x7f8e9006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:52.536 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.523+0000 7f8ea27fc700 1 -- 172.21.15.149:0/600515342 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f8e9c089680 con 0x7f8e98004850 2023-11-08T19:24:52.536 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.523+0000 7f8eb16b7700 1 --2- 172.21.15.149:0/600515342 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f8e9006af00 0x7f8e9006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:52.536 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.523+0000 7f8eb16b7700 1 --2- 172.21.15.149:0/600515342 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f8e9006af00 0x7f8e9006d3c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8ea80090b0 tx=0x7f8ea801e040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:52.536 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.527+0000 7f8ea27fc700 1 -- 172.21.15.149:0/600515342 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8e9c054490 con 0x7f8e98004850 2023-11-08T19:24:52.721 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.720+0000 7f8eb411c700 1 -- 172.21.15.149:0/600515342 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8eac0b0ac0 con 0x7f8e98004850 2023-11-08T19:24:52.722 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.722+0000 7f8ea27fc700 1 -- 172.21.15.149:0/600515342 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+18572 (secure 0 0 0) 0x7f8e9c057ab0 con 0x7f8e98004850 2023-11-08T19:24:52.723 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:24:52.723 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":54,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:24:51.734689+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-08T19:24:29.516185+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-08T19:24:49.982090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-08T19:24:50.696398+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:24:52.725 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.724+0000 7f8eb411c700 1 -- 172.21.15.149:0/600515342 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f8e9006af00 msgr2=0x7f8e9006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:52.725 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.724+0000 7f8eb411c700 1 --2- 172.21.15.149:0/600515342 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f8e9006af00 0x7f8e9006d3c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8ea80090b0 tx=0x7f8ea801e040 comp rx=0 tx=0).stop 2023-11-08T19:24:52.726 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.724+0000 7f8eb411c700 1 -- 172.21.15.149:0/600515342 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e98004850 msgr2=0x7f8eac155b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:52.726 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.724+0000 7f8eb411c700 1 --2- 172.21.15.149:0/600515342 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e98004850 0x7f8eac155b70 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c001580 tx=0x7f8e9c00fae0 comp rx=0 tx=0).stop 2023-11-08T19:24:52.726 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.724+0000 7f8eb411c700 1 -- 172.21.15.149:0/600515342 shutdown_connections 2023-11-08T19:24:52.726 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.724+0000 7f8eb411c700 1 --2- 172.21.15.149:0/600515342 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f8e9006af00 0x7f8e9006d3c0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:52.727 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.724+0000 7f8eb411c700 1 --2- 172.21.15.149:0/600515342 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8eac0b36d0 0x7f8eac0af710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:52.727 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.724+0000 7f8eb411c700 1 --2- 172.21.15.149:0/600515342 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e98004850 0x7f8eac155b70 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:52.727 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.724+0000 7f8eb411c700 1 --2- 172.21.15.149:0/600515342 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8eac0b3250 0x7f8eac0af1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:52.727 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.724+0000 7f8eb411c700 1 -- 172.21.15.149:0/600515342 >> 172.21.15.149:0/600515342 conn(0x7f8eac099a40 msgr2=0x7f8eac0d09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:52.727 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.724+0000 7f8eb411c700 1 -- 172.21.15.149:0/600515342 shutdown_connections 2023-11-08T19:24:52.728 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.724+0000 7f8eb411c700 1 -- 172.21.15.149:0/600515342 wait complete. 2023-11-08T19:24:52.737 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:24:52.859 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.858+0000 7ff8ead0f700 1 Processor -- start 2023-11-08T19:24:52.860 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.858+0000 7ff8ead0f700 1 -- start start 2023-11-08T19:24:52.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.859+0000 7ff8ead0f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8e415dc30 0x7ff8e406f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:52.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.859+0000 7ff8ead0f700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7ff8e40d2060 0x7ff8e406f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:52.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.859+0000 7ff8ead0f700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8e406bd50 con 0x7ff8e406fc70 2023-11-08T19:24:52.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.859+0000 7ff8ead0f700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8e4070100 con 0x7ff8e40d2060 2023-11-08T19:24:52.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.859+0000 7ff8ead0f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e40d04b0 con 0x7ff8e415dc30 2023-11-08T19:24:52.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.859+0000 7ff8e8aab700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8e415dc30 0x7ff8e406f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:52.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.859+0000 7ff8e3fff700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7ff8e40d2060 0x7ff8e406f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:52.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.859+0000 7ff8e92ac700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7ff8e406fc70 0x7ff8e4161790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.149:53934/0 (socket says 172.21.15.149:53934) 2023-11-08T19:24:52.864 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.859+0000 7ff8e92ac700 1 -- 172.21.15.149:0/2877363074 learned_addr learned my addr 172.21.15.149:0/2877363074 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:24:52.864 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.859+0000 7ff8e8aab700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8e415dc30 0x7ff8e406f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.149:60550/0 (socket says 172.21.15.149:60550) 2023-11-08T19:24:52.864 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.859+0000 7ff8e8aab700 1 -- 172.21.15.149:0/2877363074 >> v2:172.21.15.160:3300/0 conn(0x7ff8e40d2060 msgr2=0x7ff8e406f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:52.864 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.859+0000 7ff8e8aab700 1 --2- 172.21.15.149:0/2877363074 >> v2:172.21.15.160:3300/0 conn(0x7ff8e40d2060 0x7ff8e406f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:52.864 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.859+0000 7ff8e8aab700 1 -- 172.21.15.149:0/2877363074 >> v1:172.21.15.160:6789/0 conn(0x7ff8e406fc70 legacy=0x7ff8e4161790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:52.865 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.859+0000 7ff8e8aab700 1 -- 172.21.15.149:0/2877363074 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8e40d0730 con 0x7ff8e415dc30 2023-11-08T19:24:52.865 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.859+0000 7ff8e37fe700 1 -- 172.21.15.149:0/2877363074 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 613599275 0 0) 0x7ff8e406bd50 con 0x7ff8e406fc70 2023-11-08T19:24:52.865 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.859+0000 7ff8e3fff700 1 --2- 172.21.15.149:0/2877363074 >> v2:172.21.15.160:3300/0 conn(0x7ff8e40d2060 0x7ff8e406f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:24:52.865 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.860+0000 7ff8e8aab700 1 --2- 172.21.15.149:0/2877363074 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8e415dc30 0x7ff8e406f0e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff8d8009820 tx=0x7ff8d8009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74f04ecfc5ccf852 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:52.865 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.860+0000 7ff8e37fe700 1 -- 172.21.15.149:0/2877363074 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d8005e30 con 0x7ff8e415dc30 2023-11-08T19:24:52.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.860+0000 7ff8e37fe700 1 -- 172.21.15.149:0/2877363074 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8d8006030 con 0x7ff8e415dc30 2023-11-08T19:24:52.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.860+0000 7ff8e37fe700 1 -- 172.21.15.149:0/2877363074 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d80063c0 con 0x7ff8e415dc30 2023-11-08T19:24:52.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.860+0000 7ff8ead0f700 1 -- 172.21.15.149:0/2877363074 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8e415dc30 msgr2=0x7ff8e406f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:52.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.860+0000 7ff8ead0f700 1 --2- 172.21.15.149:0/2877363074 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8e415dc30 0x7ff8e406f0e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff8d8009820 tx=0x7ff8d8009b30 comp rx=0 tx=0).stop 2023-11-08T19:24:52.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.860+0000 7ff8ead0f700 1 -- 172.21.15.149:0/2877363074 shutdown_connections 2023-11-08T19:24:52.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.860+0000 7ff8ead0f700 1 --2- 172.21.15.149:0/2877363074 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8e415dc30 0x7ff8e406f0e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:52.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.860+0000 7ff8ead0f700 1 --2- 172.21.15.149:0/2877363074 >> v2:172.21.15.160:3300/0 conn(0x7ff8e40d2060 0x7ff8e406f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:52.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.860+0000 7ff8ead0f700 1 -- 172.21.15.149:0/2877363074 >> 172.21.15.149:0/2877363074 conn(0x7ff8e408afd0 msgr2=0x7ff8e40d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:52.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.860+0000 7ff8ead0f700 1 -- 172.21.15.149:0/2877363074 shutdown_connections 2023-11-08T19:24:52.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.860+0000 7ff8ead0f700 1 -- 172.21.15.149:0/2877363074 wait complete. 2023-11-08T19:24:52.870 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.862+0000 7ff8ead0f700 1 Processor -- start 2023-11-08T19:24:52.870 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.862+0000 7ff8ead0f700 1 -- start start 2023-11-08T19:24:52.871 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.862+0000 7ff8ead0f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8e406fc70 0x7ff8e40b5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:52.871 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.862+0000 7ff8ead0f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8e40d2060 0x7ff8e4151b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:52.871 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.862+0000 7ff8ead0f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff8e415dc30 0x7ff8e406ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:52.871 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.862+0000 7ff8ead0f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e40b6b90 con 0x7ff8e406fc70 2023-11-08T19:24:52.871 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.862+0000 7ff8ead0f700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e40b6300 con 0x7ff8e415dc30 2023-11-08T19:24:52.872 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.862+0000 7ff8ead0f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e40ce530 con 0x7ff8e40d2060 2023-11-08T19:24:52.872 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.863+0000 7ff8e8aab700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8e406fc70 0x7ff8e40b5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:52.872 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.863+0000 7ff8e8aab700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8e406fc70 0x7ff8e40b5dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40268/0 (socket says 172.21.15.149:40268) 2023-11-08T19:24:52.872 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.863+0000 7ff8e8aab700 1 -- 172.21.15.149:0/2197706268 learned_addr learned my addr 172.21.15.149:0/2197706268 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:52.872 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.863+0000 7ff8e92ac700 1 --2- 172.21.15.149:0/2197706268 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff8e415dc30 0x7ff8e406ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:52.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.863+0000 7ff8e3fff700 1 --2- 172.21.15.149:0/2197706268 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8e40d2060 0x7ff8e4151b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:52.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.863+0000 7ff8e8aab700 1 -- 172.21.15.149:0/2197706268 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8e40d2060 msgr2=0x7ff8e4151b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:52.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.863+0000 7ff8e8aab700 1 --2- 172.21.15.149:0/2197706268 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8e40d2060 0x7ff8e4151b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:52.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.863+0000 7ff8e8aab700 1 -- 172.21.15.149:0/2197706268 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff8e415dc30 msgr2=0x7ff8e406ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:52.874 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.863+0000 7ff8e8aab700 1 --2- 172.21.15.149:0/2197706268 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff8e415dc30 0x7ff8e406ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:52.874 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.863+0000 7ff8e8aab700 1 -- 172.21.15.149:0/2197706268 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d00094a0 con 0x7ff8e406fc70 2023-11-08T19:24:52.874 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.863+0000 7ff8e3fff700 1 --2- 172.21.15.149:0/2197706268 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8e40d2060 0x7ff8e4151b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:24:52.874 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.863+0000 7ff8e8aab700 1 --2- 172.21.15.149:0/2197706268 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8e406fc70 0x7ff8e40b5dc0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7ff8d8000c00 tx=0x7ff8d8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:52.874 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.863+0000 7ff8e17fa700 1 -- 172.21.15.149:0/2197706268 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d80038a0 con 0x7ff8e406fc70 2023-11-08T19:24:52.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.863+0000 7ff8e17fa700 1 -- 172.21.15.149:0/2197706268 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8d8020070 con 0x7ff8e406fc70 2023-11-08T19:24:52.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.863+0000 7ff8ead0f700 1 -- 172.21.15.149:0/2197706268 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8d8009430 con 0x7ff8e406fc70 2023-11-08T19:24:52.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.863+0000 7ff8e17fa700 1 -- 172.21.15.149:0/2197706268 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d8003c60 con 0x7ff8e406fc70 2023-11-08T19:24:52.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.863+0000 7ff8ead0f700 1 -- 172.21.15.149:0/2197706268 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8e40cdc00 con 0x7ff8e406fc70 2023-11-08T19:24:52.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.864+0000 7ff8ead0f700 1 -- 172.21.15.149:0/2197706268 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8e40745f0 con 0x7ff8e406fc70 2023-11-08T19:24:52.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.865+0000 7ff8e17fa700 1 -- 172.21.15.149:0/2197706268 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff8d8022030 con 0x7ff8e406fc70 2023-11-08T19:24:52.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.865+0000 7ff8e17fa700 1 --2- 172.21.15.149:0/2197706268 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff8c806af00 0x7ff8c806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:52.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.865+0000 7ff8e17fa700 1 -- 172.21.15.149:0/2197706268 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7ff8d808ac80 con 0x7ff8e406fc70 2023-11-08T19:24:52.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.865+0000 7ff8e3fff700 1 --2- 172.21.15.149:0/2197706268 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff8c806af00 0x7ff8c806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:52.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.866+0000 7ff8e3fff700 1 --2- 172.21.15.149:0/2197706268 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff8c806af00 0x7ff8c806d3c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff8e41f6910 tx=0x7ff8d0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:52.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:52.870+0000 7ff8e17fa700 1 -- 172.21.15.149:0/2197706268 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff8d8055a80 con 0x7ff8e406fc70 2023-11-08T19:24:53.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.067+0000 7ff8ead0f700 1 -- 172.21.15.149:0/2197706268 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff8e40c9440 con 0x7ff8e406fc70 2023-11-08T19:24:53.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.068+0000 7ff8e17fa700 1 -- 172.21.15.149:0/2197706268 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+18572 (secure 0 0 0) 0x7ff8d80590a0 con 0x7ff8e406fc70 2023-11-08T19:24:53.070 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:24:53.070 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":54,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:24:51.734689+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-08T19:24:29.516185+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-08T19:24:49.982090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-08T19:24:50.696398+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:24:53.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.071+0000 7ff8ead0f700 1 -- 172.21.15.149:0/2197706268 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff8c806af00 msgr2=0x7ff8c806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:53.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.071+0000 7ff8ead0f700 1 --2- 172.21.15.149:0/2197706268 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff8c806af00 0x7ff8c806d3c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff8e41f6910 tx=0x7ff8d0008040 comp rx=0 tx=0).stop 2023-11-08T19:24:53.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.071+0000 7ff8ead0f700 1 -- 172.21.15.149:0/2197706268 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8e406fc70 msgr2=0x7ff8e40b5dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:53.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.071+0000 7ff8ead0f700 1 --2- 172.21.15.149:0/2197706268 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8e406fc70 0x7ff8e40b5dc0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7ff8d8000c00 tx=0x7ff8d8004750 comp rx=0 tx=0).stop 2023-11-08T19:24:53.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.071+0000 7ff8ead0f700 1 -- 172.21.15.149:0/2197706268 shutdown_connections 2023-11-08T19:24:53.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.071+0000 7ff8ead0f700 1 --2- 172.21.15.149:0/2197706268 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff8c806af00 0x7ff8c806d3c0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:53.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.071+0000 7ff8ead0f700 1 --2- 172.21.15.149:0/2197706268 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff8e415dc30 0x7ff8e406ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:53.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.071+0000 7ff8ead0f700 1 --2- 172.21.15.149:0/2197706268 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8e406fc70 0x7ff8e40b5dc0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:53.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.071+0000 7ff8ead0f700 1 --2- 172.21.15.149:0/2197706268 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8e40d2060 0x7ff8e4151b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:53.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.071+0000 7ff8ead0f700 1 -- 172.21.15.149:0/2197706268 >> 172.21.15.149:0/2197706268 conn(0x7ff8e408afd0 msgr2=0x7ff8e40b1dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:53.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.071+0000 7ff8ead0f700 1 -- 172.21.15.149:0/2197706268 shutdown_connections 2023-11-08T19:24:53.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.071+0000 7ff8ead0f700 1 -- 172.21.15.149:0/2197706268 wait complete. 2023-11-08T19:24:53.084 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-08T19:24:53.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.206+0000 7f02662dd700 1 Processor -- start 2023-11-08T19:24:53.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.207+0000 7f02662dd700 1 -- start start 2023-11-08T19:24:53.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.207+0000 7f02662dd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f02600d1130 0x7f02600b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:53.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.207+0000 7f02662dd700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f02600cc870 0x7f026006bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:53.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.207+0000 7f02662dd700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02600b6470 con 0x7f026015abf0 2023-11-08T19:24:53.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.207+0000 7f02662dd700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02600b66a0 con 0x7f02600d1130 2023-11-08T19:24:53.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.207+0000 7f02662dd700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02600d04a0 con 0x7f02600cc870 2023-11-08T19:24:53.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.207+0000 7f025f7fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f02600d1130 0x7f02600b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:53.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.207+0000 7f025f7fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f02600d1130 0x7f02600b5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40278/0 (socket says 172.21.15.149:40278) 2023-11-08T19:24:53.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.207+0000 7f025f7fe700 1 -- 172.21.15.149:0/1610054267 learned_addr learned my addr 172.21.15.149:0/1610054267 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:53.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.208+0000 7f026487a700 1 --2- 172.21.15.149:0/1610054267 >> v2:172.21.15.160:3300/0 conn(0x7f02600cc870 0x7f026006bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:53.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.208+0000 7f025f7fe700 1 -- 172.21.15.149:0/1610054267 >> v2:172.21.15.160:3300/0 conn(0x7f02600cc870 msgr2=0x7f026006bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:53.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.208+0000 7f025f7fe700 1 --2- 172.21.15.149:0/1610054267 >> v2:172.21.15.160:3300/0 conn(0x7f02600cc870 0x7f026006bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:53.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.208+0000 7f025f7fe700 1 -- 172.21.15.149:0/1610054267 >> v1:172.21.15.160:6789/0 conn(0x7f026015abf0 legacy=0x7f02600cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:53.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.208+0000 7f025f7fe700 1 -- 172.21.15.149:0/1610054267 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f026015afd0 con 0x7f02600d1130 2023-11-08T19:24:53.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.208+0000 7f025f7fe700 1 --2- 172.21.15.149:0/1610054267 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02600d1130 0x7f02600b5f30 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f02600cf3b0 tx=0x7f0250009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=147a73cf94a8ff23 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:53.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.208+0000 7f025effd700 1 -- 172.21.15.149:0/1610054267 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0250004230 con 0x7f02600d1130 2023-11-08T19:24:53.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.208+0000 7f025effd700 1 -- 172.21.15.149:0/1610054267 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0250004390 con 0x7f02600d1130 2023-11-08T19:24:53.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.208+0000 7f025effd700 1 -- 172.21.15.149:0/1610054267 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02500036a0 con 0x7f02600d1130 2023-11-08T19:24:53.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.209+0000 7f02662dd700 1 -- 172.21.15.149:0/1610054267 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02600d1130 msgr2=0x7f02600b5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:53.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.209+0000 7f02662dd700 1 --2- 172.21.15.149:0/1610054267 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02600d1130 0x7f02600b5f30 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f02600cf3b0 tx=0x7f0250009bd0 comp rx=0 tx=0).stop 2023-11-08T19:24:53.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.209+0000 7f02662dd700 1 -- 172.21.15.149:0/1610054267 shutdown_connections 2023-11-08T19:24:53.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.209+0000 7f02662dd700 1 --2- 172.21.15.149:0/1610054267 >> v2:172.21.15.160:3300/0 conn(0x7f02600cc870 0x7f026006bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:53.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.209+0000 7f02662dd700 1 --2- 172.21.15.149:0/1610054267 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02600d1130 0x7f02600b5f30 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:53.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.209+0000 7f02662dd700 1 -- 172.21.15.149:0/1610054267 >> 172.21.15.149:0/1610054267 conn(0x7f02600d0640 msgr2=0x7f02600d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:53.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.209+0000 7f02662dd700 1 -- 172.21.15.149:0/1610054267 shutdown_connections 2023-11-08T19:24:53.216 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.209+0000 7f02662dd700 1 -- 172.21.15.149:0/1610054267 wait complete. 2023-11-08T19:24:53.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.210+0000 7f02662dd700 1 Processor -- start 2023-11-08T19:24:53.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.210+0000 7f02662dd700 1 -- start start 2023-11-08T19:24:53.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.211+0000 7f02662dd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02600cc870 0x7f02601546c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:53.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.211+0000 7f02662dd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02600d1130 0x7f026015b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:53.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.211+0000 7f02662dd700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f026015abf0 0x7f0260152e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:53.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.211+0000 7f02662dd700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f026015c1d0 con 0x7f02600d1130 2023-11-08T19:24:53.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.211+0000 7f02662dd700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0260154c00 con 0x7f02600cc870 2023-11-08T19:24:53.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.211+0000 7f02662dd700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f026015b700 con 0x7f026015abf0 2023-11-08T19:24:53.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.211+0000 7f025f7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02600d1130 0x7f026015b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:53.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.211+0000 7f025f7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02600d1130 0x7f026015b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40284/0 (socket says 172.21.15.149:40284) 2023-11-08T19:24:53.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.211+0000 7f025f7fe700 1 -- 172.21.15.149:0/1314195221 learned_addr learned my addr 172.21.15.149:0/1314195221 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:53.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.211+0000 7f026487a700 1 --2- 172.21.15.149:0/1314195221 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f026015abf0 0x7f0260152e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:53.221 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.211+0000 7f025ffff700 1 --2- 172.21.15.149:0/1314195221 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02600cc870 0x7f02601546c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:53.221 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.211+0000 7f025f7fe700 1 -- 172.21.15.149:0/1314195221 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f026015abf0 msgr2=0x7f0260152e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:53.221 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.211+0000 7f025f7fe700 1 --2- 172.21.15.149:0/1314195221 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f026015abf0 0x7f0260152e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:53.221 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.211+0000 7f025f7fe700 1 -- 172.21.15.149:0/1314195221 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02600cc870 msgr2=0x7f02601546c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:53.221 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.211+0000 7f025f7fe700 1 --2- 172.21.15.149:0/1314195221 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02600cc870 0x7f02601546c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:53.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.211+0000 7f025f7fe700 1 -- 172.21.15.149:0/1314195221 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0250009550 con 0x7f02600d1130 2023-11-08T19:24:53.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.211+0000 7f025ffff700 1 --2- 172.21.15.149:0/1314195221 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02600cc870 0x7f02601546c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:24:53.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.211+0000 7f026487a700 1 --2- 172.21.15.149:0/1314195221 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f026015abf0 0x7f0260152e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:24:53.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.211+0000 7f025f7fe700 1 --2- 172.21.15.149:0/1314195221 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02600d1130 0x7f026015b1c0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f0250009130 tx=0x7f0250004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:53.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.212+0000 7f025cff9700 1 -- 172.21.15.149:0/1314195221 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0250003dc0 con 0x7f02600d1130 2023-11-08T19:24:53.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.212+0000 7f025cff9700 1 -- 172.21.15.149:0/1314195221 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f025001f070 con 0x7f02600d1130 2023-11-08T19:24:53.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.212+0000 7f025cff9700 1 -- 172.21.15.149:0/1314195221 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0250011870 con 0x7f02600d1130 2023-11-08T19:24:53.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.212+0000 7f02662dd700 1 -- 172.21.15.149:0/1314195221 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02600b3370 con 0x7f02600d1130 2023-11-08T19:24:53.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.212+0000 7f02662dd700 1 -- 172.21.15.149:0/1314195221 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f026015bc10 con 0x7f02600d1130 2023-11-08T19:24:53.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.213+0000 7f02662dd700 1 -- 172.21.15.149:0/1314195221 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f026015e800 con 0x7f02600d1130 2023-11-08T19:24:53.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.213+0000 7f025cff9700 1 -- 172.21.15.149:0/1314195221 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0250021030 con 0x7f02600d1130 2023-11-08T19:24:53.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.213+0000 7f025cff9700 1 --2- 172.21.15.149:0/1314195221 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f024c06af00 0x7f024c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:53.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.213+0000 7f025cff9700 1 -- 172.21.15.149:0/1314195221 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f025008aff0 con 0x7f02600d1130 2023-11-08T19:24:53.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.213+0000 7f025ffff700 1 --2- 172.21.15.149:0/1314195221 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f024c06af00 0x7f024c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:53.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.214+0000 7f025ffff700 1 --2- 172.21.15.149:0/1314195221 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f024c06af00 0x7f024c06d3c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0254003f40 tx=0x7f0254009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:53.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.218+0000 7f025cff9700 1 -- 172.21.15.149:0/1314195221 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0250055fb0 con 0x7f02600d1130 2023-11-08T19:24:53.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:53.453+0000 7f02662dd700 1 -- 172.21.15.149:0/1314195221 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f026004f730 con 0x7f02600d1130 2023-11-08T19:24:54.374 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.373+0000 7f025cff9700 1 -- 172.21.15.149:0/1314195221 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v24) v1 ==== 118+0+0 (secure 0 0 0) 0x7f02500595d0 con 0x7f02600d1130 2023-11-08T19:24:54.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.376+0000 7f02662dd700 1 -- 172.21.15.149:0/1314195221 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f024c06af00 msgr2=0x7f024c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:54.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.376+0000 7f02662dd700 1 --2- 172.21.15.149:0/1314195221 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f024c06af00 0x7f024c06d3c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0254003f40 tx=0x7f0254009040 comp rx=0 tx=0).stop 2023-11-08T19:24:54.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.376+0000 7f02662dd700 1 -- 172.21.15.149:0/1314195221 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02600d1130 msgr2=0x7f026015b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:54.378 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.376+0000 7f02662dd700 1 --2- 172.21.15.149:0/1314195221 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02600d1130 0x7f026015b1c0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f0250009130 tx=0x7f0250004750 comp rx=0 tx=0).stop 2023-11-08T19:24:54.378 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.376+0000 7f02662dd700 1 -- 172.21.15.149:0/1314195221 shutdown_connections 2023-11-08T19:24:54.378 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.376+0000 7f02662dd700 1 --2- 172.21.15.149:0/1314195221 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f024c06af00 0x7f024c06d3c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:54.378 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.376+0000 7f02662dd700 1 --2- 172.21.15.149:0/1314195221 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02600cc870 0x7f02601546c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:54.379 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.376+0000 7f02662dd700 1 --2- 172.21.15.149:0/1314195221 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f026015abf0 0x7f0260152e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:54.379 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.376+0000 7f02662dd700 1 --2- 172.21.15.149:0/1314195221 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02600d1130 0x7f026015b1c0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:54.379 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.376+0000 7f02662dd700 1 -- 172.21.15.149:0/1314195221 >> 172.21.15.149:0/1314195221 conn(0x7f02600d0640 msgr2=0x7f0260159eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:54.379 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.376+0000 7f02662dd700 1 -- 172.21.15.149:0/1314195221 shutdown_connections 2023-11-08T19:24:54.379 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.376+0000 7f02662dd700 1 -- 172.21.15.149:0/1314195221 wait complete. 2023-11-08T19:24:54.390 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-08T19:24:54.391 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-08T19:24:54.517 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.516+0000 7fcaa1769700 1 Processor -- start 2023-11-08T19:24:54.517 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.516+0000 7fcaa1769700 1 -- start start 2023-11-08T19:24:54.519 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.517+0000 7fcaa1769700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fca9c06b290 0x7fca9c1616a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:54.520 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.517+0000 7fcaa1769700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca9c0cf130 con 0x7fca9c0b2a40 2023-11-08T19:24:54.520 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.517+0000 7fcaa1769700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca9c15df30 con 0x7fca9c15db50 2023-11-08T19:24:54.520 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.517+0000 7fcaa1769700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca9c162690 con 0x7fca9c06b290 2023-11-08T19:24:54.520 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.517+0000 7fca9b7fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fca9c06b290 0x7fca9c1616a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:54.520 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.517+0000 7fca9a7fc700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fca9c0b2a40 0x7fca9c06ab80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:42292/0 (socket says 172.21.15.149:42292) 2023-11-08T19:24:54.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.517+0000 7fca9a7fc700 1 -- 172.21.15.149:0/3500519683 learned_addr learned my addr 172.21.15.149:0/3500519683 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:24:54.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.517+0000 7fca9b7fe700 1 -- 172.21.15.149:0/3500519683 >> v1:172.21.15.160:6789/0 conn(0x7fca9c15db50 legacy=0x7fca9c0cacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:54.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.517+0000 7fca9b7fe700 1 -- 172.21.15.149:0/3500519683 >> v1:172.21.15.149:6789/0 conn(0x7fca9c0b2a40 legacy=0x7fca9c06ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:54.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.517+0000 7fca9b7fe700 1 -- 172.21.15.149:0/3500519683 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca9c161df0 con 0x7fca9c06b290 2023-11-08T19:24:54.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.517+0000 7fca99ffb700 1 -- 172.21.15.149:0/3500519683 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3613939239 0 0) 0x7fca9c0cf130 con 0x7fca9c0b2a40 2023-11-08T19:24:54.522 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.517+0000 7fca9b7fe700 1 --2- 172.21.15.149:0/3500519683 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca9c06b290 0x7fca9c1616a0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fca94009d90 tx=0x7fca9400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a1f47800ea18772 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:54.522 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.517+0000 7fca99ffb700 1 -- 172.21.15.149:0/3500519683 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9400e070 con 0x7fca9c06b290 2023-11-08T19:24:54.522 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.518+0000 7fca99ffb700 1 -- 172.21.15.149:0/3500519683 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca9400bb90 con 0x7fca9c06b290 2023-11-08T19:24:54.522 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.518+0000 7fca99ffb700 1 -- 172.21.15.149:0/3500519683 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca94003a20 con 0x7fca9c06b290 2023-11-08T19:24:54.523 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.518+0000 7fcaa1769700 1 -- 172.21.15.149:0/3500519683 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca9c06b290 msgr2=0x7fca9c1616a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:54.523 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.518+0000 7fcaa1769700 1 --2- 172.21.15.149:0/3500519683 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca9c06b290 0x7fca9c1616a0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fca94009d90 tx=0x7fca9400b330 comp rx=0 tx=0).stop 2023-11-08T19:24:54.523 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.518+0000 7fcaa1769700 1 -- 172.21.15.149:0/3500519683 shutdown_connections 2023-11-08T19:24:54.523 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.518+0000 7fcaa1769700 1 --2- 172.21.15.149:0/3500519683 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca9c06b290 0x7fca9c1616a0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:54.523 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.518+0000 7fcaa1769700 1 -- 172.21.15.149:0/3500519683 >> 172.21.15.149:0/3500519683 conn(0x7fca9c06df50 msgr2=0x7fca9c06e360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:54.524 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.518+0000 7fcaa1769700 1 -- 172.21.15.149:0/3500519683 shutdown_connections 2023-11-08T19:24:54.524 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.518+0000 7fcaa1769700 1 -- 172.21.15.149:0/3500519683 wait complete. 2023-11-08T19:24:54.526 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.519+0000 7fcaa1769700 1 Processor -- start 2023-11-08T19:24:54.527 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.519+0000 7fcaa1769700 1 -- start start 2023-11-08T19:24:54.527 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.520+0000 7fcaa1769700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca9c06b290 0x7fca9c0c6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:54.527 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.520+0000 7fcaa1769700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca9c0b2a40 0x7fca9c1e9980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:54.527 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.520+0000 7fcaa1769700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fca9c15db50 0x7fca9c1e9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:54.528 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.520+0000 7fcaa1769700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c1516f0 con 0x7fca9c06b290 2023-11-08T19:24:54.528 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.520+0000 7fcaa1769700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c0c6b60 con 0x7fca9c0b2a40 2023-11-08T19:24:54.528 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.520+0000 7fcaa1769700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c1e84b0 con 0x7fca9c15db50 2023-11-08T19:24:54.528 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.520+0000 7fca9affd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca9c06b290 0x7fca9c0c6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:54.528 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.520+0000 7fca9affd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca9c06b290 0x7fca9c0c6620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40294/0 (socket says 172.21.15.149:40294) 2023-11-08T19:24:54.529 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.520+0000 7fca9affd700 1 -- 172.21.15.149:0/3509059839 learned_addr learned my addr 172.21.15.149:0/3509059839 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:54.529 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.520+0000 7fca9a7fc700 1 --2- 172.21.15.149:0/3509059839 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca9c0b2a40 0x7fca9c1e9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:54.529 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.520+0000 7fca9b7fe700 1 --2- 172.21.15.149:0/3509059839 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fca9c15db50 0x7fca9c1e9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:54.529 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.521+0000 7fca9affd700 1 -- 172.21.15.149:0/3509059839 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fca9c15db50 msgr2=0x7fca9c1e9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:54.529 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.521+0000 7fca9affd700 1 --2- 172.21.15.149:0/3509059839 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fca9c15db50 0x7fca9c1e9ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:54.530 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.521+0000 7fca9affd700 1 -- 172.21.15.149:0/3509059839 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca9c0b2a40 msgr2=0x7fca9c1e9980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:54.530 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.521+0000 7fca9affd700 1 --2- 172.21.15.149:0/3509059839 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca9c0b2a40 0x7fca9c1e9980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:54.530 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.521+0000 7fca9affd700 1 -- 172.21.15.149:0/3509059839 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca94009a70 con 0x7fca9c06b290 2023-11-08T19:24:54.530 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.521+0000 7fca9a7fc700 1 --2- 172.21.15.149:0/3509059839 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca9c0b2a40 0x7fca9c1e9980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:24:54.530 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.521+0000 7fca9affd700 1 --2- 172.21.15.149:0/3509059839 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca9c06b290 0x7fca9c0c6620 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fca9000c4d0 tx=0x7fca9000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:54.531 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.521+0000 7fca837fe700 1 -- 172.21.15.149:0/3509059839 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca90011790 con 0x7fca9c06b290 2023-11-08T19:24:54.531 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.521+0000 7fca837fe700 1 -- 172.21.15.149:0/3509059839 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca900118f0 con 0x7fca9c06b290 2023-11-08T19:24:54.531 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.521+0000 7fcaa1769700 1 -- 172.21.15.149:0/3509059839 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca9c1e8790 con 0x7fca9c06b290 2023-11-08T19:24:54.531 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.521+0000 7fca837fe700 1 -- 172.21.15.149:0/3509059839 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca90011ca0 con 0x7fca9c06b290 2023-11-08T19:24:54.531 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.521+0000 7fcaa1769700 1 -- 172.21.15.149:0/3509059839 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca9c1e8d50 con 0x7fca9c06b290 2023-11-08T19:24:54.532 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.522+0000 7fcaa1769700 1 -- 172.21.15.149:0/3509059839 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca9c0ce4e0 con 0x7fca9c06b290 2023-11-08T19:24:54.532 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.522+0000 7fca837fe700 1 -- 172.21.15.149:0/3509059839 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fca9001c460 con 0x7fca9c06b290 2023-11-08T19:24:54.532 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.523+0000 7fca837fe700 1 --2- 172.21.15.149:0/3509059839 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fca8806af00 0x7fca8806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:54.532 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.523+0000 7fca837fe700 1 -- 172.21.15.149:0/3509059839 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fca900896c0 con 0x7fca9c06b290 2023-11-08T19:24:54.532 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.523+0000 7fca9a7fc700 1 --2- 172.21.15.149:0/3509059839 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fca8806af00 0x7fca8806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:54.533 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.523+0000 7fca9a7fc700 1 --2- 172.21.15.149:0/3509059839 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fca8806af00 0x7fca8806d3c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fca9c1e9910 tx=0x7fca8c007ca0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:54.533 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.528+0000 7fca837fe700 1 -- 172.21.15.149:0/3509059839 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fca90054560 con 0x7fca9c06b290 2023-11-08T19:24:54.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:54.763+0000 7fcaa1769700 1 -- 172.21.15.149:0/3509059839 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fca9c0afbf0 con 0x7fca9c06b290 2023-11-08T19:24:55.379 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.378+0000 7fca837fe700 1 -- 172.21.15.149:0/3509059839 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v25) v1 ==== 122+0+0 (secure 0 0 0) 0x7fca90057b80 con 0x7fca9c06b290 2023-11-08T19:24:55.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.381+0000 7fcaa1769700 1 -- 172.21.15.149:0/3509059839 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fca8806af00 msgr2=0x7fca8806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:55.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.381+0000 7fcaa1769700 1 --2- 172.21.15.149:0/3509059839 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fca8806af00 0x7fca8806d3c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fca9c1e9910 tx=0x7fca8c007ca0 comp rx=0 tx=0).stop 2023-11-08T19:24:55.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.381+0000 7fcaa1769700 1 -- 172.21.15.149:0/3509059839 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca9c06b290 msgr2=0x7fca9c0c6620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:55.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.381+0000 7fcaa1769700 1 --2- 172.21.15.149:0/3509059839 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca9c06b290 0x7fca9c0c6620 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fca9000c4d0 tx=0x7fca9000c890 comp rx=0 tx=0).stop 2023-11-08T19:24:55.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.381+0000 7fcaa1769700 1 -- 172.21.15.149:0/3509059839 shutdown_connections 2023-11-08T19:24:55.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.381+0000 7fcaa1769700 1 --2- 172.21.15.149:0/3509059839 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fca8806af00 0x7fca8806d3c0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:55.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.381+0000 7fcaa1769700 1 --2- 172.21.15.149:0/3509059839 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fca9c15db50 0x7fca9c1e9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:55.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.381+0000 7fcaa1769700 1 --2- 172.21.15.149:0/3509059839 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca9c06b290 0x7fca9c0c6620 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:55.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.381+0000 7fcaa1769700 1 --2- 172.21.15.149:0/3509059839 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca9c0b2a40 0x7fca9c1e9980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:55.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.382+0000 7fcaa1769700 1 -- 172.21.15.149:0/3509059839 >> 172.21.15.149:0/3509059839 conn(0x7fca9c06df50 msgr2=0x7fca9c15ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:55.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.382+0000 7fcaa1769700 1 -- 172.21.15.149:0/3509059839 shutdown_connections 2023-11-08T19:24:55.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.382+0000 7fcaa1769700 1 -- 172.21.15.149:0/3509059839 wait complete. 2023-11-08T19:24:55.397 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-08T19:24:55.398 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:24:55.524 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.523+0000 7f4eaafaf700 1 Processor -- start 2023-11-08T19:24:55.525 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.523+0000 7f4eaafaf700 1 -- start start 2023-11-08T19:24:55.528 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.524+0000 7f4eaafaf700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f4ea40cc910 0x7f4ea40cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:55.529 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.524+0000 7f4eaafaf700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ea40b2f60 con 0x7f4ea40cb130 2023-11-08T19:24:55.529 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.524+0000 7f4eaafaf700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ea40cc520 con 0x7f4ea40cc140 2023-11-08T19:24:55.529 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.524+0000 7f4eaafaf700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ea40b2430 con 0x7f4ea40cc910 2023-11-08T19:24:55.529 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.524+0000 7f4ea954c700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f4ea40cb130 0x7f4ea415d2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:42308/0 (socket says 172.21.15.149:42308) 2023-11-08T19:24:55.530 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.524+0000 7f4ea954c700 1 -- 172.21.15.149:0/2596970680 learned_addr learned my addr 172.21.15.149:0/2596970680 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:24:55.530 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.524+0000 7f4ea3fff700 1 --2- 172.21.15.149:0/2596970680 >> v2:172.21.15.160:3300/0 conn(0x7f4ea40cc910 0x7f4ea40cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:55.530 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.524+0000 7f4ea37fe700 1 -- 172.21.15.149:0/2596970680 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4226003631 0 0) 0x7f4ea40b2f60 con 0x7f4ea40cb130 2023-11-08T19:24:55.530 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.524+0000 7f4ea37fe700 1 -- 172.21.15.149:0/2596970680 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e940035b0 con 0x7f4ea40cb130 2023-11-08T19:24:55.530 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.525+0000 7f4ea37fe700 1 -- 172.21.15.149:0/2596970680 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 94765423 0 0) 0x7f4e940035b0 con 0x7f4ea40cb130 2023-11-08T19:24:55.531 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.525+0000 7f4ea37fe700 1 -- 172.21.15.149:0/2596970680 >> v2:172.21.15.160:3300/0 conn(0x7f4ea40cc910 msgr2=0x7f4ea40cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:55.531 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.525+0000 7f4ea37fe700 1 --2- 172.21.15.149:0/2596970680 >> v2:172.21.15.160:3300/0 conn(0x7f4ea40cc910 0x7f4ea40cabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:55.531 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.525+0000 7f4ea37fe700 1 -- 172.21.15.149:0/2596970680 >> v1:172.21.15.160:6789/0 conn(0x7f4ea40cc140 legacy=0x7f4ea40b2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:55.531 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.525+0000 7f4ea37fe700 1 -- 172.21.15.149:0/2596970680 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea40cb5e0 con 0x7f4ea40cb130 2023-11-08T19:24:55.531 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.525+0000 7f4ea37fe700 1 -- 172.21.15.149:0/2596970680 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f4e9c0019f0 con 0x7f4ea40cb130 2023-11-08T19:24:55.532 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.525+0000 7f4ea37fe700 1 -- 172.21.15.149:0/2596970680 >> v1:172.21.15.149:6789/0 conn(0x7f4ea40cb130 legacy=0x7f4ea415d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:55.532 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.525+0000 7f4ea37fe700 1 --2- 172.21.15.149:0/2596970680 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4e94003a00 0x7f4e94003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:55.532 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.525+0000 7f4ea37fe700 1 --2- 172.21.15.149:0/2596970680 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e94004850 0x7f4e94004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:55.532 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.525+0000 7f4ea37fe700 1 --2- 172.21.15.149:0/2596970680 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4e94005210 0x7f4e9400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:55.532 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.525+0000 7f4ea37fe700 1 -- 172.21.15.149:0/2596970680 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea40b2430 con 0x7f4e94004850 2023-11-08T19:24:55.532 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.525+0000 7f4ea37fe700 1 -- 172.21.15.149:0/2596970680 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9400c0b0 con 0x7f4e94005210 2023-11-08T19:24:55.533 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.525+0000 7f4ea37fe700 1 -- 172.21.15.149:0/2596970680 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9400c270 con 0x7f4e94003a00 2023-11-08T19:24:55.533 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.525+0000 7f4ea3fff700 1 --2- 172.21.15.149:0/2596970680 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e94004850 0x7f4e94004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:55.533 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.525+0000 7f4ea954c700 1 --2- 172.21.15.149:0/2596970680 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4e94005210 0x7f4e9400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:55.533 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.525+0000 7f4ea8d4b700 1 --2- 172.21.15.149:0/2596970680 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4e94003a00 0x7f4e94003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:55.533 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.525+0000 7f4ea3fff700 1 -- 172.21.15.149:0/2596970680 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4e94003a00 msgr2=0x7f4e94003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:55.534 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.525+0000 7f4ea3fff700 1 --2- 172.21.15.149:0/2596970680 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4e94003a00 0x7f4e94003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:55.534 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.525+0000 7f4ea3fff700 1 -- 172.21.15.149:0/2596970680 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4e94005210 msgr2=0x7f4e9400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:55.534 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.525+0000 7f4ea3fff700 1 --2- 172.21.15.149:0/2596970680 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4e94005210 0x7f4e9400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:55.534 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.525+0000 7f4ea3fff700 1 -- 172.21.15.149:0/2596970680 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e940035b0 con 0x7f4e94004850 2023-11-08T19:24:55.535 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.525+0000 7f4ea954c700 1 -- 172.21.15.149:0/2596970680 reap_dead start 2023-11-08T19:24:55.535 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.525+0000 7f4ea8d4b700 1 --2- 172.21.15.149:0/2596970680 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4e94003a00 0x7f4e94003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:24:55.535 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.525+0000 7f4ea3fff700 1 --2- 172.21.15.149:0/2596970680 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e94004850 0x7f4e94004cd0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f4e90009b30 tx=0x7f4e94005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d52a562f485aa360 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:55.535 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.525+0000 7f4ea37fe700 1 -- 172.21.15.149:0/2596970680 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9000e640 con 0x7f4e94004850 2023-11-08T19:24:55.535 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.525+0000 7f4ea37fe700 1 -- 172.21.15.149:0/2596970680 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e9000e7a0 con 0x7f4e94004850 2023-11-08T19:24:55.535 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.525+0000 7f4ea37fe700 1 -- 172.21.15.149:0/2596970680 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9000eb10 con 0x7f4e94004850 2023-11-08T19:24:55.536 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.526+0000 7f4eaafaf700 1 -- 172.21.15.149:0/2596970680 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e94004850 msgr2=0x7f4e94004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:55.536 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.526+0000 7f4eaafaf700 1 --2- 172.21.15.149:0/2596970680 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e94004850 0x7f4e94004cd0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f4e90009b30 tx=0x7f4e94005880 comp rx=0 tx=0).stop 2023-11-08T19:24:55.536 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.526+0000 7f4eaafaf700 1 -- 172.21.15.149:0/2596970680 shutdown_connections 2023-11-08T19:24:55.536 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.526+0000 7f4eaafaf700 1 --2- 172.21.15.149:0/2596970680 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e94004850 0x7f4e94004cd0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:55.536 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.526+0000 7f4eaafaf700 1 -- 172.21.15.149:0/2596970680 >> 172.21.15.149:0/2596970680 conn(0x7f4ea4099a40 msgr2=0x7f4ea40d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:55.537 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.526+0000 7f4eaafaf700 1 -- 172.21.15.149:0/2596970680 shutdown_connections 2023-11-08T19:24:55.537 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.526+0000 7f4eaafaf700 1 -- 172.21.15.149:0/2596970680 wait complete. 2023-11-08T19:24:55.537 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.527+0000 7f4eaafaf700 1 Processor -- start 2023-11-08T19:24:55.537 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.527+0000 7f4eaafaf700 1 -- start start 2023-11-08T19:24:55.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.528+0000 7f4eaafaf700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4e94004850 0x7f4ea4158220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:55.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.528+0000 7f4eaafaf700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4ea40c4b20 0x7f4ea40ad1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:55.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.528+0000 7f4eaafaf700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4ea40ad700 0x7f4ea40c6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:55.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.528+0000 7f4eaafaf700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea415d690 con 0x7f4ea40c4b20 2023-11-08T19:24:55.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.528+0000 7f4eaafaf700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea40c6f40 con 0x7f4ea40ad700 2023-11-08T19:24:55.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.528+0000 7f4eaafaf700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea40c7220 con 0x7f4e94004850 2023-11-08T19:24:55.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.528+0000 7f4ea3fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4ea40c4b20 0x7f4ea40ad1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:55.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.528+0000 7f4ea3fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4ea40c4b20 0x7f4ea40ad1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40316/0 (socket says 172.21.15.149:40316) 2023-11-08T19:24:55.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.528+0000 7f4ea3fff700 1 -- 172.21.15.149:0/2893974638 learned_addr learned my addr 172.21.15.149:0/2893974638 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:55.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.528+0000 7f4ea8d4b700 1 --2- 172.21.15.149:0/2893974638 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4e94004850 0x7f4ea4158220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:55.542 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.528+0000 7f4ea954c700 1 --2- 172.21.15.149:0/2893974638 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4ea40ad700 0x7f4ea40c6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:55.542 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.528+0000 7f4ea3fff700 1 -- 172.21.15.149:0/2893974638 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4e94004850 msgr2=0x7f4ea4158220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:55.542 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.528+0000 7f4ea3fff700 1 --2- 172.21.15.149:0/2893974638 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4e94004850 0x7f4ea4158220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:55.542 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.528+0000 7f4ea3fff700 1 -- 172.21.15.149:0/2893974638 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4ea40ad700 msgr2=0x7f4ea40c6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:55.542 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.528+0000 7f4ea3fff700 1 --2- 172.21.15.149:0/2893974638 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4ea40ad700 0x7f4ea40c6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:55.543 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.528+0000 7f4ea3fff700 1 -- 172.21.15.149:0/2893974638 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea415d2b0 con 0x7f4ea40c4b20 2023-11-08T19:24:55.543 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.529+0000 7f4ea3fff700 1 --2- 172.21.15.149:0/2893974638 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4ea40c4b20 0x7f4ea40ad1c0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f4e9400c080 tx=0x7f4e900047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:55.543 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.529+0000 7f4ea17fa700 1 -- 172.21.15.149:0/2893974638 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9000e640 con 0x7f4ea40c4b20 2023-11-08T19:24:55.543 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.529+0000 7f4ea17fa700 1 -- 172.21.15.149:0/2893974638 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e90013aa0 con 0x7f4ea40c4b20 2023-11-08T19:24:55.543 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.529+0000 7f4eaafaf700 1 -- 172.21.15.149:0/2893974638 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ea4158760 con 0x7f4ea40c4b20 2023-11-08T19:24:55.544 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.529+0000 7f4ea17fa700 1 -- 172.21.15.149:0/2893974638 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e90013e50 con 0x7f4ea40c4b20 2023-11-08T19:24:55.544 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.529+0000 7f4eaafaf700 1 -- 172.21.15.149:0/2893974638 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ea40c6c60 con 0x7f4ea40c4b20 2023-11-08T19:24:55.544 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.530+0000 7f4eaafaf700 1 -- 172.21.15.149:0/2893974638 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ea40745f0 con 0x7f4ea40c4b20 2023-11-08T19:24:55.544 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.530+0000 7f4ea17fa700 1 -- 172.21.15.149:0/2893974638 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4e90024070 con 0x7f4ea40c4b20 2023-11-08T19:24:55.544 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.530+0000 7f4ea17fa700 1 --2- 172.21.15.149:0/2893974638 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4e8806af00 0x7f4e8806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:55.545 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.531+0000 7f4ea17fa700 1 -- 172.21.15.149:0/2893974638 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f4e9008ae00 con 0x7f4ea40c4b20 2023-11-08T19:24:55.545 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.531+0000 7f4ea8d4b700 1 --2- 172.21.15.149:0/2893974638 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4e8806af00 0x7f4e8806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:55.545 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.531+0000 7f4ea8d4b700 1 --2- 172.21.15.149:0/2893974638 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4e8806af00 0x7f4e8806d3c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4e98000c00 tx=0x7f4e98009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:55.545 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.535+0000 7f4ea17fa700 1 -- 172.21.15.149:0/2893974638 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4e90055dc0 con 0x7f4ea40c4b20 2023-11-08T19:24:55.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.768+0000 7f4eaafaf700 1 -- 172.21.15.149:0/2893974638 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4ea40d0f70 con 0x7f4ea40c4b20 2023-11-08T19:24:55.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.768+0000 7f4ea17fa700 1 -- 172.21.15.149:0/2893974638 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f4e90017090 con 0x7f4ea40c4b20 2023-11-08T19:24:55.770 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:24:55.770 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5455,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/2693283976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2693283976},{"type":"v1","addr":"172.21.15.160:6834","nonce":2693283976}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5458,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/3714474190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":3714474190},{"type":"v1","addr":"172.21.15.160:6835","nonce":3714474190}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5730,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/1885678824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":1885678824},{"type":"v1","addr":"172.21.15.149:6836","nonce":1885678824}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-08T19:24:51.735078+0000","modified":"2023-11-08T19:24:54.764447+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5733},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5733":{"gid":5733,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6837/4238261436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":4238261436},{"type":"v1","addr":"172.21.15.149:6837","nonce":4238261436}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-08T19:24:55.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.770+0000 7f4eaafaf700 1 -- 172.21.15.149:0/2893974638 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4e8806af00 msgr2=0x7f4e8806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:55.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.770+0000 7f4eaafaf700 1 --2- 172.21.15.149:0/2893974638 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4e8806af00 0x7f4e8806d3c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4e98000c00 tx=0x7f4e98009040 comp rx=0 tx=0).stop 2023-11-08T19:24:55.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.770+0000 7f4eaafaf700 1 -- 172.21.15.149:0/2893974638 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4ea40c4b20 msgr2=0x7f4ea40ad1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:55.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.770+0000 7f4eaafaf700 1 --2- 172.21.15.149:0/2893974638 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4ea40c4b20 0x7f4ea40ad1c0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f4e9400c080 tx=0x7f4e900047c0 comp rx=0 tx=0).stop 2023-11-08T19:24:55.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.771+0000 7f4eaafaf700 1 -- 172.21.15.149:0/2893974638 shutdown_connections 2023-11-08T19:24:55.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.771+0000 7f4eaafaf700 1 --2- 172.21.15.149:0/2893974638 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4e8806af00 0x7f4e8806d3c0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:55.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.771+0000 7f4eaafaf700 1 --2- 172.21.15.149:0/2893974638 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4ea40ad700 0x7f4ea40c6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:55.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.771+0000 7f4eaafaf700 1 --2- 172.21.15.149:0/2893974638 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4e94004850 0x7f4ea4158220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:55.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.771+0000 7f4eaafaf700 1 --2- 172.21.15.149:0/2893974638 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4ea40c4b20 0x7f4ea40ad1c0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:55.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.771+0000 7f4eaafaf700 1 -- 172.21.15.149:0/2893974638 >> 172.21.15.149:0/2893974638 conn(0x7f4ea4099a40 msgr2=0x7f4ea40b0720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:55.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.771+0000 7f4eaafaf700 1 -- 172.21.15.149:0/2893974638 shutdown_connections 2023-11-08T19:24:55.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.771+0000 7f4eaafaf700 1 -- 172.21.15.149:0/2893974638 wait complete. 2023-11-08T19:24:55.775 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 25 2023-11-08T19:24:55.784 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:24:55.905 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.904+0000 7ff1d2039700 1 Processor -- start 2023-11-08T19:24:55.905 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.904+0000 7ff1d2039700 1 -- start start 2023-11-08T19:24:55.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.905+0000 7ff1d2039700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff1cc161670 0x7ff1cc0b5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:55.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.905+0000 7ff1d2039700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1cc0d1a10 con 0x7ff1cc0ce500 2023-11-08T19:24:55.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.905+0000 7ff1d2039700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1cc0d1cf0 con 0x7ff1cc161a50 2023-11-08T19:24:55.910 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.905+0000 7ff1d2039700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc0d1fd0 con 0x7ff1cc161670 2023-11-08T19:24:55.910 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.905+0000 7ff1cbfff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7ff1cc0ce500 0x7ff1cc0ce990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:42328/0 (socket says 172.21.15.149:42328) 2023-11-08T19:24:55.910 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.905+0000 7ff1cbfff700 1 -- 172.21.15.149:0/2003806851 learned_addr learned my addr 172.21.15.149:0/2003806851 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:24:55.910 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.905+0000 7ff1cb7fe700 1 --2- 172.21.15.149:0/2003806851 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff1cc161670 0x7ff1cc0b5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:55.911 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.905+0000 7ff1ca7fc700 1 -- 172.21.15.149:0/2003806851 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1246054976 0 0) 0x7ff1cc0d1a10 con 0x7ff1cc0ce500 2023-11-08T19:24:55.911 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.905+0000 7ff1ca7fc700 1 -- 172.21.15.149:0/2003806851 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1b40035b0 con 0x7ff1cc0ce500 2023-11-08T19:24:55.911 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.905+0000 7ff1ca7fc700 1 -- 172.21.15.149:0/2003806851 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1164506380 0 0) 0x7ff1b40035b0 con 0x7ff1cc0ce500 2023-11-08T19:24:55.911 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.905+0000 7ff1ca7fc700 1 -- 172.21.15.149:0/2003806851 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff1cc161670 msgr2=0x7ff1cc0b5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:55.911 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.905+0000 7ff1ca7fc700 1 --2- 172.21.15.149:0/2003806851 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff1cc161670 0x7ff1cc0b5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:55.912 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.905+0000 7ff1ca7fc700 1 -- 172.21.15.149:0/2003806851 >> v1:172.21.15.160:6789/0 conn(0x7ff1cc161a50 legacy=0x7ff1cc161ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:55.912 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.905+0000 7ff1ca7fc700 1 -- 172.21.15.149:0/2003806851 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1cc0d22b0 con 0x7ff1cc0ce500 2023-11-08T19:24:55.912 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.905+0000 7ff1ca7fc700 1 -- 172.21.15.149:0/2003806851 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7ff1c40019f0 con 0x7ff1cc0ce500 2023-11-08T19:24:55.912 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.905+0000 7ff1ca7fc700 1 -- 172.21.15.149:0/2003806851 >> v1:172.21.15.149:6789/0 conn(0x7ff1cc0ce500 legacy=0x7ff1cc0ce990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:55.912 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.906+0000 7ff1ca7fc700 1 --2- 172.21.15.149:0/2003806851 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff1cc161670 0x7ff1b4003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:55.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.906+0000 7ff1ca7fc700 1 --2- 172.21.15.149:0/2003806851 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1b4003fb0 0x7ff1b4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:55.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.906+0000 7ff1ca7fc700 1 --2- 172.21.15.149:0/2003806851 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff1b4004d90 0x7ff1b4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:55.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.906+0000 7ff1ca7fc700 1 -- 172.21.15.149:0/2003806851 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc0d1fd0 con 0x7ff1b4003fb0 2023-11-08T19:24:55.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.906+0000 7ff1ca7fc700 1 -- 172.21.15.149:0/2003806851 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b400baf0 con 0x7ff1b4004d90 2023-11-08T19:24:55.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.906+0000 7ff1ca7fc700 1 -- 172.21.15.149:0/2003806851 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b400bcb0 con 0x7ff1cc161670 2023-11-08T19:24:55.914 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.906+0000 7ff1caffd700 1 --2- 172.21.15.149:0/2003806851 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1b4003fb0 0x7ff1b4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:55.914 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.906+0000 7ff1cb7fe700 1 --2- 172.21.15.149:0/2003806851 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff1cc161670 0x7ff1b4003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:55.914 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.906+0000 7ff1cbfff700 1 --2- 172.21.15.149:0/2003806851 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff1b4004d90 0x7ff1b4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:55.914 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.906+0000 7ff1caffd700 1 -- 172.21.15.149:0/2003806851 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff1cc161670 msgr2=0x7ff1b4003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:55.914 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.906+0000 7ff1caffd700 1 --2- 172.21.15.149:0/2003806851 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff1cc161670 0x7ff1b4003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:55.915 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.906+0000 7ff1caffd700 1 -- 172.21.15.149:0/2003806851 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff1b4004d90 msgr2=0x7ff1b4005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:55.915 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.906+0000 7ff1caffd700 1 --2- 172.21.15.149:0/2003806851 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff1b4004d90 0x7ff1b4005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:55.915 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.906+0000 7ff1caffd700 1 -- 172.21.15.149:0/2003806851 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1b40035b0 con 0x7ff1b4003fb0 2023-11-08T19:24:55.915 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.906+0000 7ff1caffd700 1 --2- 172.21.15.149:0/2003806851 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1b4003fb0 0x7ff1b4004850 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc0017c0 tx=0x7ff1b4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d6ecfa5f64aba4c server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:55.915 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.906+0000 7ff1ca7fc700 1 -- 172.21.15.149:0/2003806851 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc0052d0 con 0x7ff1b4003fb0 2023-11-08T19:24:55.916 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.906+0000 7ff1ca7fc700 1 -- 172.21.15.149:0/2003806851 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1bc005430 con 0x7ff1b4003fb0 2023-11-08T19:24:55.916 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.906+0000 7ff1ca7fc700 1 -- 172.21.15.149:0/2003806851 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc0038c0 con 0x7ff1b4003fb0 2023-11-08T19:24:55.916 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.907+0000 7ff1d2039700 1 -- 172.21.15.149:0/2003806851 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1b4003fb0 msgr2=0x7ff1b4004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:55.916 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.907+0000 7ff1d2039700 1 --2- 172.21.15.149:0/2003806851 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1b4003fb0 0x7ff1b4004850 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc0017c0 tx=0x7ff1b4005880 comp rx=0 tx=0).stop 2023-11-08T19:24:55.916 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.907+0000 7ff1cbfff700 1 -- 172.21.15.149:0/2003806851 reap_dead start 2023-11-08T19:24:55.917 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.907+0000 7ff1d2039700 1 -- 172.21.15.149:0/2003806851 shutdown_connections 2023-11-08T19:24:55.917 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.907+0000 7ff1d2039700 1 -- 172.21.15.149:0/2003806851 >> 172.21.15.149:0/2003806851 conn(0x7ff1cc0d3980 msgr2=0x7ff1cc0d3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:55.917 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.907+0000 7ff1d2039700 1 -- 172.21.15.149:0/2003806851 shutdown_connections 2023-11-08T19:24:55.917 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.907+0000 7ff1d2039700 1 -- 172.21.15.149:0/2003806851 wait complete. 2023-11-08T19:24:55.917 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.908+0000 7ff1d2039700 1 Processor -- start 2023-11-08T19:24:55.917 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.908+0000 7ff1d2039700 1 -- start start 2023-11-08T19:24:55.920 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.909+0000 7ff1d2039700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff1b4003fb0 0x7ff1cc0cc510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:55.920 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.909+0000 7ff1d2039700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff1cc0ccdd0 0x7ff1cc1f4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:55.921 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.909+0000 7ff1d2039700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1cc09ec80 0x7ff1cc09f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:55.921 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.909+0000 7ff1d2039700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc09f640 con 0x7ff1cc09ec80 2023-11-08T19:24:55.921 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.909+0000 7ff1d2039700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc0cca50 con 0x7ff1cc0ccdd0 2023-11-08T19:24:55.921 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.909+0000 7ff1d2039700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc09d550 con 0x7ff1b4003fb0 2023-11-08T19:24:55.921 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.909+0000 7ff1cbfff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1cc09ec80 0x7ff1cc09f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:55.922 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.909+0000 7ff1cbfff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1cc09ec80 0x7ff1cc09f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40338/0 (socket says 172.21.15.149:40338) 2023-11-08T19:24:55.922 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.909+0000 7ff1cbfff700 1 -- 172.21.15.149:0/4267427594 learned_addr learned my addr 172.21.15.149:0/4267427594 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:55.922 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.909+0000 7ff1caffd700 1 --2- 172.21.15.149:0/4267427594 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff1cc0ccdd0 0x7ff1cc1f4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:55.922 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.909+0000 7ff1cb7fe700 1 --2- 172.21.15.149:0/4267427594 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff1b4003fb0 0x7ff1cc0cc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:55.923 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.909+0000 7ff1cbfff700 1 -- 172.21.15.149:0/4267427594 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff1b4003fb0 msgr2=0x7ff1cc0cc510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:55.923 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.909+0000 7ff1cbfff700 1 --2- 172.21.15.149:0/4267427594 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff1b4003fb0 0x7ff1cc0cc510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:55.923 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.909+0000 7ff1cbfff700 1 -- 172.21.15.149:0/4267427594 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff1cc0ccdd0 msgr2=0x7ff1cc1f4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:55.923 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.909+0000 7ff1cbfff700 1 --2- 172.21.15.149:0/4267427594 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff1cc0ccdd0 0x7ff1cc1f4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:55.923 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.909+0000 7ff1cbfff700 1 -- 172.21.15.149:0/4267427594 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1cc1f45d0 con 0x7ff1cc09ec80 2023-11-08T19:24:55.924 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.909+0000 7ff1cb7fe700 1 --2- 172.21.15.149:0/4267427594 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff1b4003fb0 0x7ff1cc0cc510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:24:55.924 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.910+0000 7ff1cbfff700 1 --2- 172.21.15.149:0/4267427594 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1cc09ec80 0x7ff1cc09f100 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc08b830 tx=0x7ff1c400a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:55.924 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.910+0000 7ff1b3fff700 1 -- 172.21.15.149:0/4267427594 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c400ad00 con 0x7ff1cc09ec80 2023-11-08T19:24:55.924 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.910+0000 7ff1b3fff700 1 -- 172.21.15.149:0/4267427594 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1c400ae60 con 0x7ff1cc09ec80 2023-11-08T19:24:55.924 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.910+0000 7ff1d2039700 1 -- 172.21.15.149:0/4267427594 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1cc0cd340 con 0x7ff1cc09ec80 2023-11-08T19:24:55.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.910+0000 7ff1b3fff700 1 -- 172.21.15.149:0/4267427594 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c4013630 con 0x7ff1cc09ec80 2023-11-08T19:24:55.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.910+0000 7ff1d2039700 1 -- 172.21.15.149:0/4267427594 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1cc0cd900 con 0x7ff1cc09ec80 2023-11-08T19:24:55.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.911+0000 7ff1d2039700 1 -- 172.21.15.149:0/4267427594 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1cc0745f0 con 0x7ff1cc09ec80 2023-11-08T19:24:55.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.911+0000 7ff1b3fff700 1 -- 172.21.15.149:0/4267427594 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff1c4013790 con 0x7ff1cc09ec80 2023-11-08T19:24:55.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.912+0000 7ff1b3fff700 1 --2- 172.21.15.149:0/4267427594 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff1b806af00 0x7ff1b806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:55.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.912+0000 7ff1cb7fe700 1 --2- 172.21.15.149:0/4267427594 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff1b806af00 0x7ff1b806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:55.926 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.912+0000 7ff1b3fff700 1 -- 172.21.15.149:0/4267427594 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7ff1c408a150 con 0x7ff1cc09ec80 2023-11-08T19:24:55.926 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.912+0000 7ff1cb7fe700 1 --2- 172.21.15.149:0/4267427594 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff1b806af00 0x7ff1b806d3c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc0b1f90 tx=0x7ff1c0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:55.926 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:55.917+0000 7ff1b3fff700 1 -- 172.21.15.149:0/4267427594 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff1c4054ff0 con 0x7ff1cc09ec80 2023-11-08T19:24:56.108 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.107+0000 7ff1d2039700 1 -- 172.21.15.149:0/4267427594 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff1cc08b060 con 0x7ff1cc09ec80 2023-11-08T19:24:56.109 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.108+0000 7ff1b3fff700 1 -- 172.21.15.149:0/4267427594 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+18559 (secure 0 0 0) 0x7ff1c4058610 con 0x7ff1cc09ec80 2023-11-08T19:24:56.110 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:24:56.110 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":55,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:24:53.348156+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-08T19:24:29.516185+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-08T19:24:49.982090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-08T19:24:50.696398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:24:56.112 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.111+0000 7ff1d2039700 1 -- 172.21.15.149:0/4267427594 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff1b806af00 msgr2=0x7ff1b806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:56.112 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.111+0000 7ff1d2039700 1 --2- 172.21.15.149:0/4267427594 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff1b806af00 0x7ff1b806d3c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc0b1f90 tx=0x7ff1c0008040 comp rx=0 tx=0).stop 2023-11-08T19:24:56.112 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.111+0000 7ff1d2039700 1 -- 172.21.15.149:0/4267427594 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1cc09ec80 msgr2=0x7ff1cc09f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:56.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.111+0000 7ff1d2039700 1 --2- 172.21.15.149:0/4267427594 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1cc09ec80 0x7ff1cc09f100 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc08b830 tx=0x7ff1c400a5f0 comp rx=0 tx=0).stop 2023-11-08T19:24:56.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.111+0000 7ff1d2039700 1 -- 172.21.15.149:0/4267427594 shutdown_connections 2023-11-08T19:24:56.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.111+0000 7ff1d2039700 1 --2- 172.21.15.149:0/4267427594 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff1b806af00 0x7ff1b806d3c0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:56.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.111+0000 7ff1d2039700 1 --2- 172.21.15.149:0/4267427594 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1cc09ec80 0x7ff1cc09f100 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:56.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.111+0000 7ff1d2039700 1 --2- 172.21.15.149:0/4267427594 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff1b4003fb0 0x7ff1cc0cc510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:56.114 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.111+0000 7ff1d2039700 1 --2- 172.21.15.149:0/4267427594 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff1cc0ccdd0 0x7ff1cc1f4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:56.114 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.111+0000 7ff1d2039700 1 -- 172.21.15.149:0/4267427594 >> 172.21.15.149:0/4267427594 conn(0x7ff1cc0d3980 msgr2=0x7ff1cc15fbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:56.114 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.111+0000 7ff1d2039700 1 -- 172.21.15.149:0/4267427594 shutdown_connections 2023-11-08T19:24:56.114 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.111+0000 7ff1d2039700 1 -- 172.21.15.149:0/4267427594 wait complete. 2023-11-08T19:24:56.125 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-08T19:24:56.125 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:24:56.246 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.245+0000 7f8484143700 1 Processor -- start 2023-11-08T19:24:56.247 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.245+0000 7f8484143700 1 -- start start 2023-11-08T19:24:56.250 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.246+0000 7f8484143700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f847c0afb30 0x7f847c0ce380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:56.250 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.246+0000 7f8484143700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f847c0d1330 con 0x7f847c0b20b0 2023-11-08T19:24:56.251 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.246+0000 7f8484143700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f847c0cb490 con 0x7f847c0b16b0 2023-11-08T19:24:56.251 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.246+0000 7f8484143700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f847c0cb770 con 0x7f847c0afb30 2023-11-08T19:24:56.253 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.246+0000 7f84826e0700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f847c0b20b0 0x7f847c0aff90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:42348/0 (socket says 172.21.15.149:42348) 2023-11-08T19:24:56.253 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.246+0000 7f84826e0700 1 -- 172.21.15.149:0/1962304084 learned_addr learned my addr 172.21.15.149:0/1962304084 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:24:56.253 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.246+0000 7f8480edd700 1 -- 172.21.15.149:0/1962304084 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 270719447 0 0) 0x7f847c0d1330 con 0x7f847c0b20b0 2023-11-08T19:24:56.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.246+0000 7f8481edf700 1 --2- 172.21.15.149:0/1962304084 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f847c0afb30 0x7f847c0ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:56.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.246+0000 7f8480edd700 1 -- 172.21.15.149:0/1962304084 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84680035b0 con 0x7f847c0b20b0 2023-11-08T19:24:56.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.247+0000 7f8480edd700 1 -- 172.21.15.149:0/1962304084 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 565416960 0 0) 0x7f84680035b0 con 0x7f847c0b20b0 2023-11-08T19:24:56.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.247+0000 7f8480edd700 1 -- 172.21.15.149:0/1962304084 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f847c0afb30 msgr2=0x7f847c0ce380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:56.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.247+0000 7f8480edd700 1 --2- 172.21.15.149:0/1962304084 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f847c0afb30 0x7f847c0ce380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:56.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.247+0000 7f8480edd700 1 -- 172.21.15.149:0/1962304084 >> v1:172.21.15.160:6789/0 conn(0x7f847c0b16b0 legacy=0x7f847c0cbf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:56.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.247+0000 7f8480edd700 1 -- 172.21.15.149:0/1962304084 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f847c0cba50 con 0x7f847c0b20b0 2023-11-08T19:24:56.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.247+0000 7f8480edd700 1 -- 172.21.15.149:0/1962304084 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f84740019f0 con 0x7f847c0b20b0 2023-11-08T19:24:56.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.247+0000 7f8480edd700 1 -- 172.21.15.149:0/1962304084 >> v1:172.21.15.149:6789/0 conn(0x7f847c0b20b0 legacy=0x7f847c0aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:56.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.247+0000 7f8480edd700 1 --2- 172.21.15.149:0/1962304084 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8468003a30 0x7f8468003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:56.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.247+0000 7f8480edd700 1 --2- 172.21.15.149:0/1962304084 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8468004850 0x7f8468004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:56.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.247+0000 7f8480edd700 1 --2- 172.21.15.149:0/1962304084 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f847c0afb30 0x7f84680052e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:56.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.247+0000 7f8480edd700 1 -- 172.21.15.149:0/1962304084 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f847c0cb770 con 0x7f8468004850 2023-11-08T19:24:56.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.247+0000 7f8480edd700 1 -- 172.21.15.149:0/1962304084 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f846800bbd0 con 0x7f8468003a30 2023-11-08T19:24:56.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.247+0000 7f8480edd700 1 -- 172.21.15.149:0/1962304084 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f846800bd90 con 0x7f847c0afb30 2023-11-08T19:24:56.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.247+0000 7f84816de700 1 --2- 172.21.15.149:0/1962304084 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8468004850 0x7f8468004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:56.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.247+0000 7f8481edf700 1 --2- 172.21.15.149:0/1962304084 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8468003a30 0x7f8468003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:56.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.247+0000 7f84826e0700 1 --2- 172.21.15.149:0/1962304084 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f847c0afb30 0x7f84680052e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:56.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.247+0000 7f84816de700 1 -- 172.21.15.149:0/1962304084 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f847c0afb30 msgr2=0x7f84680052e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:56.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.247+0000 7f84816de700 1 --2- 172.21.15.149:0/1962304084 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f847c0afb30 0x7f84680052e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:56.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.247+0000 7f84816de700 1 -- 172.21.15.149:0/1962304084 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8468003a30 msgr2=0x7f8468003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:56.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.247+0000 7f84816de700 1 --2- 172.21.15.149:0/1962304084 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8468003a30 0x7f8468003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:56.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.247+0000 7f84816de700 1 -- 172.21.15.149:0/1962304084 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84680035b0 con 0x7f8468004850 2023-11-08T19:24:56.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.247+0000 7f84816de700 1 --2- 172.21.15.149:0/1962304084 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8468004850 0x7f8468004cd0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f847c0b1ad0 tx=0x7f8468005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b9d0fe3fa89fa89 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:56.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.247+0000 7f8480edd700 1 -- 172.21.15.149:0/1962304084 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84780052d0 con 0x7f8468004850 2023-11-08T19:24:56.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.247+0000 7f8480edd700 1 -- 172.21.15.149:0/1962304084 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8478005470 con 0x7f8468004850 2023-11-08T19:24:56.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.248+0000 7f8480edd700 1 -- 172.21.15.149:0/1962304084 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84780038c0 con 0x7f8468004850 2023-11-08T19:24:56.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.248+0000 7f8484143700 1 -- 172.21.15.149:0/1962304084 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8468004850 msgr2=0x7f8468004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:56.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.248+0000 7f8484143700 1 --2- 172.21.15.149:0/1962304084 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8468004850 0x7f8468004cd0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f847c0b1ad0 tx=0x7f8468005880 comp rx=0 tx=0).stop 2023-11-08T19:24:56.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.248+0000 7f84826e0700 1 -- 172.21.15.149:0/1962304084 reap_dead start 2023-11-08T19:24:56.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.248+0000 7f8484143700 1 -- 172.21.15.149:0/1962304084 shutdown_connections 2023-11-08T19:24:56.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.248+0000 7f8484143700 1 -- 172.21.15.149:0/1962304084 >> 172.21.15.149:0/1962304084 conn(0x7f847c099a40 msgr2=0x7f847c0d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:56.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.248+0000 7f8484143700 1 -- 172.21.15.149:0/1962304084 shutdown_connections 2023-11-08T19:24:56.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.248+0000 7f8484143700 1 -- 172.21.15.149:0/1962304084 wait complete. 2023-11-08T19:24:56.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.250+0000 7f8484143700 1 Processor -- start 2023-11-08T19:24:56.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.250+0000 7f8484143700 1 -- start start 2023-11-08T19:24:56.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.251+0000 7f8484143700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8468004850 0x7f847c0c7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:56.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.251+0000 7f8484143700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f847c0c9c70 0x7f847c14d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:56.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.251+0000 7f8484143700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f847c1f3cb0 0x7f847c1f4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:56.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.251+0000 7f8484143700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f847c1f46a0 con 0x7f847c1f3cb0 2023-11-08T19:24:56.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.251+0000 7f8484143700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f847c0c5120 con 0x7f847c0c9c70 2023-11-08T19:24:56.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.251+0000 7f8484143700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f847c0c53c0 con 0x7f8468004850 2023-11-08T19:24:56.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.251+0000 7f84826e0700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f847c1f3cb0 0x7f847c1f4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:56.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.251+0000 7f84826e0700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f847c1f3cb0 0x7f847c1f4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40358/0 (socket says 172.21.15.149:40358) 2023-11-08T19:24:56.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.251+0000 7f84826e0700 1 -- 172.21.15.149:0/2842819537 learned_addr learned my addr 172.21.15.149:0/2842819537 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:56.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.251+0000 7f8481edf700 1 --2- 172.21.15.149:0/2842819537 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8468004850 0x7f847c0c7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:56.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.251+0000 7f84816de700 1 --2- 172.21.15.149:0/2842819537 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f847c0c9c70 0x7f847c14d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:56.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.251+0000 7f84826e0700 1 -- 172.21.15.149:0/2842819537 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8468004850 msgr2=0x7f847c0c7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:56.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.251+0000 7f84826e0700 1 --2- 172.21.15.149:0/2842819537 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8468004850 0x7f847c0c7670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:56.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.251+0000 7f84826e0700 1 -- 172.21.15.149:0/2842819537 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f847c0c9c70 msgr2=0x7f847c14d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:56.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.251+0000 7f84826e0700 1 --2- 172.21.15.149:0/2842819537 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f847c0c9c70 0x7f847c14d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:56.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.251+0000 7f84826e0700 1 -- 172.21.15.149:0/2842819537 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f847c0ca1e0 con 0x7f847c1f3cb0 2023-11-08T19:24:56.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.251+0000 7f84816de700 1 --2- 172.21.15.149:0/2842819537 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f847c0c9c70 0x7f847c14d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:24:56.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.251+0000 7f84826e0700 1 --2- 172.21.15.149:0/2842819537 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f847c1f3cb0 0x7f847c1f4160 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f847c0b2490 tx=0x7f847400a8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:56.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.251+0000 7f84727fc700 1 -- 172.21.15.149:0/2842819537 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8474007b60 con 0x7f847c1f3cb0 2023-11-08T19:24:56.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.251+0000 7f84727fc700 1 -- 172.21.15.149:0/2842819537 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8474015410 con 0x7f847c1f3cb0 2023-11-08T19:24:56.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.251+0000 7f8484143700 1 -- 172.21.15.149:0/2842819537 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f847c0ca4c0 con 0x7f847c1f3cb0 2023-11-08T19:24:56.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.251+0000 7f84727fc700 1 -- 172.21.15.149:0/2842819537 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84740157c0 con 0x7f847c1f3cb0 2023-11-08T19:24:56.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.251+0000 7f8484143700 1 -- 172.21.15.149:0/2842819537 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f847c0c7bb0 con 0x7f847c1f3cb0 2023-11-08T19:24:56.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.252+0000 7f8484143700 1 -- 172.21.15.149:0/2842819537 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f847c0745f0 con 0x7f847c1f3cb0 2023-11-08T19:24:56.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.253+0000 7f84727fc700 1 -- 172.21.15.149:0/2842819537 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8474015920 con 0x7f847c1f3cb0 2023-11-08T19:24:56.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.253+0000 7f84727fc700 1 --2- 172.21.15.149:0/2842819537 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f846006af00 0x7f846006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:56.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.253+0000 7f8481edf700 1 --2- 172.21.15.149:0/2842819537 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f846006af00 0x7f846006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:56.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.253+0000 7f84727fc700 1 -- 172.21.15.149:0/2842819537 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f847408c4d0 con 0x7f847c1f3cb0 2023-11-08T19:24:56.270 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.254+0000 7f8481edf700 1 --2- 172.21.15.149:0/2842819537 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f846006af00 0x7f846006d3c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f847c06edb0 tx=0x7f846c0091c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:56.270 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.258+0000 7f84727fc700 1 -- 172.21.15.149:0/2842819537 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f84740572e0 con 0x7f847c1f3cb0 2023-11-08T19:24:56.450 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.449+0000 7f8484143700 1 -- 172.21.15.149:0/2842819537 --> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f847c0ca9e0 con 0x7f846006af00 2023-11-08T19:24:56.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.458+0000 7f84727fc700 1 -- 172.21.15.149:0/2842819537 <== mgr.4104 v2:172.21.15.149:6832/1929837472 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+360302 (secure 0 0 0) 0x7f847c0ca9e0 con 0x7f846006af00 2023-11-08T19:24:56.466 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:24:56.469 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.462+0000 7f8484143700 1 -- 172.21.15.149:0/2842819537 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f846006af00 msgr2=0x7f846006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:56.470 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.462+0000 7f8484143700 1 --2- 172.21.15.149:0/2842819537 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f846006af00 0x7f846006d3c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f847c06edb0 tx=0x7f846c0091c0 comp rx=0 tx=0).stop 2023-11-08T19:24:56.470 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.462+0000 7f8484143700 1 -- 172.21.15.149:0/2842819537 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f847c1f3cb0 msgr2=0x7f847c1f4160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:56.470 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.462+0000 7f8484143700 1 --2- 172.21.15.149:0/2842819537 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f847c1f3cb0 0x7f847c1f4160 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f847c0b2490 tx=0x7f847400a8d0 comp rx=0 tx=0).stop 2023-11-08T19:24:56.470 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.462+0000 7f8484143700 1 -- 172.21.15.149:0/2842819537 shutdown_connections 2023-11-08T19:24:56.471 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.462+0000 7f8484143700 1 --2- 172.21.15.149:0/2842819537 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f846006af00 0x7f846006d3c0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:56.471 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.462+0000 7f8484143700 1 --2- 172.21.15.149:0/2842819537 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f847c1f3cb0 0x7f847c1f4160 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:56.471 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.462+0000 7f8484143700 1 --2- 172.21.15.149:0/2842819537 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8468004850 0x7f847c0c7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:56.471 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.462+0000 7f8484143700 1 --2- 172.21.15.149:0/2842819537 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f847c0c9c70 0x7f847c14d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:56.472 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.462+0000 7f8484143700 1 -- 172.21.15.149:0/2842819537 >> 172.21.15.149:0/2842819537 conn(0x7f847c099a40 msgr2=0x7f847c15c5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:56.472 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.462+0000 7f8484143700 1 -- 172.21.15.149:0/2842819537 shutdown_connections 2023-11-08T19:24:56.472 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.462+0000 7f8484143700 1 -- 172.21.15.149:0/2842819537 wait complete. 2023-11-08T19:24:56.472 INFO:teuthology.orchestra.run.smithi149.stderr:dumped all 2023-11-08T19:24:56.475 INFO:teuthology.orchestra.run.smithi149.stdout:{"pg_ready":true,"pg_map":{"version":108,"stamp":"2023-11-08T19:24:56.010182+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590458,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":175,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":154,"acting":154,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":76,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222188,"kb_used_data":6012,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752532,"statfs":{"total":773094113280,"available":772866592768,"internally_reserved":0,"allocated":6156288,"data_stored":3405037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":90,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.678875"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353924+0000","last_change":"2023-11-08T19:24:52.381786+0000","last_active":"2023-11-08T19:24:53.353924+0000","last_peered":"2023-11-08T19:24:53.353924+0000","last_clean":"2023-11-08T19:24:53.353924+0000","last_became_active":"2023-11-08T19:24:52.381496+0000","last_became_peered":"2023-11-08T19:24:52.381496+0000","last_unstale":"2023-11-08T19:24:53.353924+0000","last_undegraded":"2023-11-08T19:24:53.353924+0000","last_fullsized":"2023-11-08T19:24:53.353924+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:28:32.868165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353027+0000","last_change":"2023-11-08T19:24:52.376347+0000","last_active":"2023-11-08T19:24:53.353027+0000","last_peered":"2023-11-08T19:24:53.353027+0000","last_clean":"2023-11-08T19:24:53.353027+0000","last_became_active":"2023-11-08T19:24:52.375849+0000","last_became_peered":"2023-11-08T19:24:52.375849+0000","last_unstale":"2023-11-08T19:24:53.353027+0000","last_undegraded":"2023-11-08T19:24:53.353027+0000","last_fullsized":"2023-11-08T19:24:53.353027+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:31:56.573763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353154+0000","last_change":"2023-11-08T19:24:52.378669+0000","last_active":"2023-11-08T19:24:53.353154+0000","last_peered":"2023-11-08T19:24:53.353154+0000","last_clean":"2023-11-08T19:24:53.353154+0000","last_became_active":"2023-11-08T19:24:52.378389+0000","last_became_peered":"2023-11-08T19:24:52.378389+0000","last_unstale":"2023-11-08T19:24:53.353154+0000","last_undegraded":"2023-11-08T19:24:53.353154+0000","last_fullsized":"2023-11-08T19:24:53.353154+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:46:31.594290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353446+0000","last_change":"2023-11-08T19:24:52.381743+0000","last_active":"2023-11-08T19:24:53.353446+0000","last_peered":"2023-11-08T19:24:53.353446+0000","last_clean":"2023-11-08T19:24:53.353446+0000","last_became_active":"2023-11-08T19:24:52.381427+0000","last_became_peered":"2023-11-08T19:24:52.381427+0000","last_unstale":"2023-11-08T19:24:53.353446+0000","last_undegraded":"2023-11-08T19:24:53.353446+0000","last_fullsized":"2023-11-08T19:24:53.353446+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:46:51.125293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353428+0000","last_change":"2023-11-08T19:24:52.375322+0000","last_active":"2023-11-08T19:24:53.353428+0000","last_peered":"2023-11-08T19:24:53.353428+0000","last_clean":"2023-11-08T19:24:53.353428+0000","last_became_active":"2023-11-08T19:24:52.375013+0000","last_became_peered":"2023-11-08T19:24:52.375013+0000","last_unstale":"2023-11-08T19:24:53.353428+0000","last_undegraded":"2023-11-08T19:24:53.353428+0000","last_fullsized":"2023-11-08T19:24:53.353428+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:14:05.670963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.352833+0000","last_change":"2023-11-08T19:24:52.378669+0000","last_active":"2023-11-08T19:24:53.352833+0000","last_peered":"2023-11-08T19:24:53.352833+0000","last_clean":"2023-11-08T19:24:53.352833+0000","last_became_active":"2023-11-08T19:24:52.378393+0000","last_became_peered":"2023-11-08T19:24:52.378393+0000","last_unstale":"2023-11-08T19:24:53.352833+0000","last_undegraded":"2023-11-08T19:24:53.352833+0000","last_fullsized":"2023-11-08T19:24:53.352833+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:26:04.745188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.332581+0000","last_change":"2023-11-08T19:24:50.332581+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.332581+0000","last_undegraded":"2023-11-08T19:24:50.332581+0000","last_fullsized":"2023-11-08T19:24:50.332581+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:47.763090+0000","last_change":"2023-11-08T19:24:32.263958+0000","last_active":"2023-11-08T19:24:47.763090+0000","last_peered":"2023-11-08T19:24:47.763090+0000","last_clean":"2023-11-08T19:24:47.763090+0000","last_became_active":"2023-11-08T19:24:31.149011+0000","last_became_peered":"2023-11-08T19:24:31.149011+0000","last_unstale":"2023-11-08T19:24:47.763090+0000","last_undegraded":"2023-11-08T19:24:47.763090+0000","last_fullsized":"2023-11-08T19:24:47.763090+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:09:04.880374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033496900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.338177+0000","last_change":"2023-11-08T19:24:50.338177+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.338177+0000","last_undegraded":"2023-11-08T19:24:50.338177+0000","last_fullsized":"2023-11-08T19:24:50.338177+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:47.686281+0000","last_change":"2023-11-08T19:24:32.142892+0000","last_active":"2023-11-08T19:24:47.686281+0000","last_peered":"2023-11-08T19:24:47.686281+0000","last_clean":"2023-11-08T19:24:47.686281+0000","last_became_active":"2023-11-08T19:24:31.144912+0000","last_became_peered":"2023-11-08T19:24:31.144912+0000","last_unstale":"2023-11-08T19:24:47.686281+0000","last_undegraded":"2023-11-08T19:24:47.686281+0000","last_fullsized":"2023-11-08T19:24:47.686281+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:04:21.151484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056686900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353024+0000","last_change":"2023-11-08T19:24:52.381898+0000","last_active":"2023-11-08T19:24:53.353024+0000","last_peered":"2023-11-08T19:24:53.353024+0000","last_clean":"2023-11-08T19:24:53.353024+0000","last_became_active":"2023-11-08T19:24:52.381474+0000","last_became_peered":"2023-11-08T19:24:52.381474+0000","last_unstale":"2023-11-08T19:24:53.353024+0000","last_undegraded":"2023-11-08T19:24:53.353024+0000","last_fullsized":"2023-11-08T19:24:53.353024+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:45:51.213375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"54'8","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353655+0000","last_change":"2023-11-08T19:24:51.353683+0000","last_active":"2023-11-08T19:24:53.353655+0000","last_peered":"2023-11-08T19:24:53.353655+0000","last_clean":"2023-11-08T19:24:53.353655+0000","last_became_active":"2023-11-08T19:24:51.353201+0000","last_became_peered":"2023-11-08T19:24:51.353201+0000","last_unstale":"2023-11-08T19:24:53.353655+0000","last_undegraded":"2023-11-08T19:24:53.353655+0000","last_fullsized":"2023-11-08T19:24:53.353655+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:53:41.466355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":25,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:47.684477+0000","last_change":"2023-11-08T19:24:32.140514+0000","last_active":"2023-11-08T19:24:47.684477+0000","last_peered":"2023-11-08T19:24:47.684477+0000","last_clean":"2023-11-08T19:24:47.684477+0000","last_became_active":"2023-11-08T19:24:31.146668+0000","last_became_peered":"2023-11-08T19:24:31.146668+0000","last_unstale":"2023-11-08T19:24:47.684477+0000","last_undegraded":"2023-11-08T19:24:47.684477+0000","last_fullsized":"2023-11-08T19:24:47.684477+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:31:24.539374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071576699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.337661+0000","last_change":"2023-11-08T19:24:50.337661+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.337661+0000","last_undegraded":"2023-11-08T19:24:50.337661+0000","last_fullsized":"2023-11-08T19:24:50.337661+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:47.763081+0000","last_change":"2023-11-08T19:24:32.263963+0000","last_active":"2023-11-08T19:24:47.763081+0000","last_peered":"2023-11-08T19:24:47.763081+0000","last_clean":"2023-11-08T19:24:47.763081+0000","last_became_active":"2023-11-08T19:24:31.139062+0000","last_became_peered":"2023-11-08T19:24:31.139062+0000","last_unstale":"2023-11-08T19:24:47.763081+0000","last_undegraded":"2023-11-08T19:24:47.763081+0000","last_fullsized":"2023-11-08T19:24:47.763081+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:26.080042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033682599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353734+0000","last_change":"2023-11-08T19:24:52.376929+0000","last_active":"2023-11-08T19:24:53.353734+0000","last_peered":"2023-11-08T19:24:53.353734+0000","last_clean":"2023-11-08T19:24:53.353734+0000","last_became_active":"2023-11-08T19:24:52.376602+0000","last_became_peered":"2023-11-08T19:24:52.376602+0000","last_unstale":"2023-11-08T19:24:53.353734+0000","last_undegraded":"2023-11-08T19:24:53.353734+0000","last_fullsized":"2023-11-08T19:24:53.353734+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:14:34.758666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.337528+0000","last_change":"2023-11-08T19:24:50.337528+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.337528+0000","last_undegraded":"2023-11-08T19:24:50.337528+0000","last_fullsized":"2023-11-08T19:24:50.337528+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":25,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:47.684886+0000","last_change":"2023-11-08T19:24:32.141131+0000","last_active":"2023-11-08T19:24:47.684886+0000","last_peered":"2023-11-08T19:24:47.684886+0000","last_clean":"2023-11-08T19:24:47.684886+0000","last_became_active":"2023-11-08T19:24:31.146154+0000","last_became_peered":"2023-11-08T19:24:31.146154+0000","last_unstale":"2023-11-08T19:24:47.684886+0000","last_undegraded":"2023-11-08T19:24:47.684886+0000","last_fullsized":"2023-11-08T19:24:47.684886+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:18:40.271560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082432800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353882+0000","last_change":"2023-11-08T19:24:51.355043+0000","last_active":"2023-11-08T19:24:53.353882+0000","last_peered":"2023-11-08T19:24:53.353882+0000","last_clean":"2023-11-08T19:24:53.353882+0000","last_became_active":"2023-11-08T19:24:51.354777+0000","last_became_peered":"2023-11-08T19:24:51.354777+0000","last_unstale":"2023-11-08T19:24:53.353882+0000","last_undegraded":"2023-11-08T19:24:53.353882+0000","last_fullsized":"2023-11-08T19:24:53.353882+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:04:50.527868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:48.243070+0000","last_change":"2023-11-08T19:24:32.529486+0000","last_active":"2023-11-08T19:24:48.243070+0000","last_peered":"2023-11-08T19:24:48.243070+0000","last_clean":"2023-11-08T19:24:48.243070+0000","last_became_active":"2023-11-08T19:24:31.146260+0000","last_became_peered":"2023-11-08T19:24:31.146260+0000","last_unstale":"2023-11-08T19:24:48.243070+0000","last_undegraded":"2023-11-08T19:24:48.243070+0000","last_fullsized":"2023-11-08T19:24:48.243070+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:45:34.425432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059842900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353445+0000","last_change":"2023-11-08T19:24:52.375932+0000","last_active":"2023-11-08T19:24:53.353445+0000","last_peered":"2023-11-08T19:24:53.353445+0000","last_clean":"2023-11-08T19:24:53.353445+0000","last_became_active":"2023-11-08T19:24:52.375648+0000","last_became_peered":"2023-11-08T19:24:52.375648+0000","last_unstale":"2023-11-08T19:24:53.353445+0000","last_undegraded":"2023-11-08T19:24:53.353445+0000","last_fullsized":"2023-11-08T19:24:53.353445+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:26:22.628067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.332956+0000","last_change":"2023-11-08T19:24:50.332956+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.332956+0000","last_undegraded":"2023-11-08T19:24:50.332956+0000","last_fullsized":"2023-11-08T19:24:50.332956+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:48.243358+0000","last_change":"2023-11-08T19:24:32.530168+0000","last_active":"2023-11-08T19:24:48.243358+0000","last_peered":"2023-11-08T19:24:48.243358+0000","last_clean":"2023-11-08T19:24:48.243358+0000","last_became_active":"2023-11-08T19:24:31.144329+0000","last_became_peered":"2023-11-08T19:24:31.144329+0000","last_unstale":"2023-11-08T19:24:48.243358+0000","last_undegraded":"2023-11-08T19:24:48.243358+0000","last_fullsized":"2023-11-08T19:24:48.243358+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:05:36.085920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043484799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"54'3","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353873+0000","last_change":"2023-11-08T19:24:51.352040+0000","last_active":"2023-11-08T19:24:53.353873+0000","last_peered":"2023-11-08T19:24:53.353873+0000","last_clean":"2023-11-08T19:24:53.353873+0000","last_became_active":"2023-11-08T19:24:51.351762+0000","last_became_peered":"2023-11-08T19:24:51.351762+0000","last_unstale":"2023-11-08T19:24:53.353873+0000","last_undegraded":"2023-11-08T19:24:53.353873+0000","last_fullsized":"2023-11-08T19:24:53.353873+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:04:59.430912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":26,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:47.684819+0000","last_change":"2023-11-08T19:24:32.141190+0000","last_active":"2023-11-08T19:24:47.684819+0000","last_peered":"2023-11-08T19:24:47.684819+0000","last_clean":"2023-11-08T19:24:47.684819+0000","last_became_active":"2023-11-08T19:24:31.147651+0000","last_became_peered":"2023-11-08T19:24:31.147651+0000","last_unstale":"2023-11-08T19:24:47.684819+0000","last_undegraded":"2023-11-08T19:24:47.684819+0000","last_fullsized":"2023-11-08T19:24:47.684819+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:21:55.985548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043673300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.338584+0000","last_change":"2023-11-08T19:24:50.338584+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.338584+0000","last_undegraded":"2023-11-08T19:24:50.338584+0000","last_fullsized":"2023-11-08T19:24:50.338584+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":27,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.368381+0000","last_change":"2023-11-08T19:24:32.147011+0000","last_active":"2023-11-08T19:24:52.368381+0000","last_peered":"2023-11-08T19:24:52.368381+0000","last_clean":"2023-11-08T19:24:52.368381+0000","last_became_active":"2023-11-08T19:24:31.148250+0000","last_became_peered":"2023-11-08T19:24:31.148250+0000","last_unstale":"2023-11-08T19:24:52.368381+0000","last_undegraded":"2023-11-08T19:24:52.368381+0000","last_fullsized":"2023-11-08T19:24:52.368381+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:01:25.647952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043061299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.332279+0000","last_change":"2023-11-08T19:24:50.332279+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.332279+0000","last_undegraded":"2023-11-08T19:24:50.332279+0000","last_fullsized":"2023-11-08T19:24:50.332279+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:48.243314+0000","last_change":"2023-11-08T19:24:32.543880+0000","last_active":"2023-11-08T19:24:48.243314+0000","last_peered":"2023-11-08T19:24:48.243314+0000","last_clean":"2023-11-08T19:24:48.243314+0000","last_became_active":"2023-11-08T19:24:31.142052+0000","last_became_peered":"2023-11-08T19:24:31.142052+0000","last_unstale":"2023-11-08T19:24:48.243314+0000","last_undegraded":"2023-11-08T19:24:48.243314+0000","last_fullsized":"2023-11-08T19:24:48.243314+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:18:42.371676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014881058000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.332251+0000","last_change":"2023-11-08T19:24:50.332251+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.332251+0000","last_undegraded":"2023-11-08T19:24:50.332251+0000","last_fullsized":"2023-11-08T19:24:50.332251+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":27,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.365352+0000","last_change":"2023-11-08T19:24:32.147235+0000","last_active":"2023-11-08T19:24:52.365352+0000","last_peered":"2023-11-08T19:24:52.365352+0000","last_clean":"2023-11-08T19:24:52.365352+0000","last_became_active":"2023-11-08T19:24:31.146176+0000","last_became_peered":"2023-11-08T19:24:31.146176+0000","last_unstale":"2023-11-08T19:24:52.365352+0000","last_undegraded":"2023-11-08T19:24:52.365352+0000","last_fullsized":"2023-11-08T19:24:52.365352+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:39.214888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048481000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.338195+0000","last_change":"2023-11-08T19:24:50.338195+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.338195+0000","last_undegraded":"2023-11-08T19:24:50.338195+0000","last_fullsized":"2023-11-08T19:24:50.338195+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":26,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:47.684720+0000","last_change":"2023-11-08T19:24:32.142376+0000","last_active":"2023-11-08T19:24:47.684720+0000","last_peered":"2023-11-08T19:24:47.684720+0000","last_clean":"2023-11-08T19:24:47.684720+0000","last_became_active":"2023-11-08T19:24:31.144614+0000","last_became_peered":"2023-11-08T19:24:31.144614+0000","last_unstale":"2023-11-08T19:24:47.684720+0000","last_undegraded":"2023-11-08T19:24:47.684720+0000","last_fullsized":"2023-11-08T19:24:47.684720+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:09:04.880374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050362200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.339757+0000","last_change":"2023-11-08T19:24:50.339757+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.339757+0000","last_undegraded":"2023-11-08T19:24:50.339757+0000","last_fullsized":"2023-11-08T19:24:50.339757+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":27,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.365437+0000","last_change":"2023-11-08T19:24:32.146639+0000","last_active":"2023-11-08T19:24:52.365437+0000","last_peered":"2023-11-08T19:24:52.365437+0000","last_clean":"2023-11-08T19:24:52.365437+0000","last_became_active":"2023-11-08T19:24:31.147384+0000","last_became_peered":"2023-11-08T19:24:31.147384+0000","last_unstale":"2023-11-08T19:24:52.365437+0000","last_undegraded":"2023-11-08T19:24:52.365437+0000","last_fullsized":"2023-11-08T19:24:52.365437+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:30:21.946303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043834899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.338705+0000","last_change":"2023-11-08T19:24:50.338705+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.338705+0000","last_undegraded":"2023-11-08T19:24:50.338705+0000","last_fullsized":"2023-11-08T19:24:50.338705+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:48.242909+0000","last_change":"2023-11-08T19:24:32.544108+0000","last_active":"2023-11-08T19:24:48.242909+0000","last_peered":"2023-11-08T19:24:48.242909+0000","last_clean":"2023-11-08T19:24:48.242909+0000","last_became_active":"2023-11-08T19:24:31.143812+0000","last_became_peered":"2023-11-08T19:24:31.143812+0000","last_unstale":"2023-11-08T19:24:48.242909+0000","last_undegraded":"2023-11-08T19:24:48.242909+0000","last_fullsized":"2023-11-08T19:24:48.242909+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:27:59.135977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014956126,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.338406+0000","last_change":"2023-11-08T19:24:50.338406+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.338406+0000","last_undegraded":"2023-11-08T19:24:50.338406+0000","last_fullsized":"2023-11-08T19:24:50.338406+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:48.243404+0000","last_change":"2023-11-08T19:24:32.530378+0000","last_active":"2023-11-08T19:24:48.243404+0000","last_peered":"2023-11-08T19:24:48.243404+0000","last_clean":"2023-11-08T19:24:48.243404+0000","last_became_active":"2023-11-08T19:24:31.144341+0000","last_became_peered":"2023-11-08T19:24:31.144341+0000","last_unstale":"2023-11-08T19:24:48.243404+0000","last_undegraded":"2023-11-08T19:24:48.243404+0000","last_fullsized":"2023-11-08T19:24:48.243404+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:30:21.946303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058308299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.338593+0000","last_change":"2023-11-08T19:24:50.338593+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.338593+0000","last_undegraded":"2023-11-08T19:24:50.338593+0000","last_fullsized":"2023-11-08T19:24:50.338593+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":25,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:47.684544+0000","last_change":"2023-11-08T19:24:32.140832+0000","last_active":"2023-11-08T19:24:47.684544+0000","last_peered":"2023-11-08T19:24:47.684544+0000","last_clean":"2023-11-08T19:24:47.684544+0000","last_became_active":"2023-11-08T19:24:31.146557+0000","last_became_peered":"2023-11-08T19:24:31.146557+0000","last_unstale":"2023-11-08T19:24:47.684544+0000","last_undegraded":"2023-11-08T19:24:47.684544+0000","last_fullsized":"2023-11-08T19:24:47.684544+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:40:04.258107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099450100000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.352995+0000","last_change":"2023-11-08T19:24:52.381859+0000","last_active":"2023-11-08T19:24:53.352995+0000","last_peered":"2023-11-08T19:24:53.352995+0000","last_clean":"2023-11-08T19:24:53.352995+0000","last_became_active":"2023-11-08T19:24:52.381568+0000","last_became_peered":"2023-11-08T19:24:52.381568+0000","last_unstale":"2023-11-08T19:24:53.352995+0000","last_undegraded":"2023-11-08T19:24:53.352995+0000","last_fullsized":"2023-11-08T19:24:53.352995+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:09:36.064066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.332231+0000","last_change":"2023-11-08T19:24:50.332231+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.332231+0000","last_undegraded":"2023-11-08T19:24:50.332231+0000","last_fullsized":"2023-11-08T19:24:50.332231+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":25,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:47.684627+0000","last_change":"2023-11-08T19:24:32.141188+0000","last_active":"2023-11-08T19:24:47.684627+0000","last_peered":"2023-11-08T19:24:47.684627+0000","last_clean":"2023-11-08T19:24:47.684627+0000","last_became_active":"2023-11-08T19:24:31.148857+0000","last_became_peered":"2023-11-08T19:24:31.148857+0000","last_unstale":"2023-11-08T19:24:47.684627+0000","last_undegraded":"2023-11-08T19:24:47.684627+0000","last_fullsized":"2023-11-08T19:24:47.684627+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:45:34.425432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065078599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.338891+0000","last_change":"2023-11-08T19:24:50.338891+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.338891+0000","last_undegraded":"2023-11-08T19:24:50.338891+0000","last_fullsized":"2023-11-08T19:24:50.338891+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":25,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:47.684535+0000","last_change":"2023-11-08T19:24:32.140167+0000","last_active":"2023-11-08T19:24:47.684535+0000","last_peered":"2023-11-08T19:24:47.684535+0000","last_clean":"2023-11-08T19:24:47.684535+0000","last_became_active":"2023-11-08T19:24:31.147181+0000","last_became_peered":"2023-11-08T19:24:31.147181+0000","last_unstale":"2023-11-08T19:24:47.684535+0000","last_undegraded":"2023-11-08T19:24:47.684535+0000","last_fullsized":"2023-11-08T19:24:47.684535+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:26.080042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057135200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.337482+0000","last_change":"2023-11-08T19:24:50.337482+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.337482+0000","last_undegraded":"2023-11-08T19:24:50.337482+0000","last_fullsized":"2023-11-08T19:24:50.337482+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:48.243376+0000","last_change":"2023-11-08T19:24:32.530895+0000","last_active":"2023-11-08T19:24:48.243376+0000","last_peered":"2023-11-08T19:24:48.243376+0000","last_clean":"2023-11-08T19:24:48.243376+0000","last_became_active":"2023-11-08T19:24:31.146715+0000","last_became_peered":"2023-11-08T19:24:31.146715+0000","last_unstale":"2023-11-08T19:24:48.243376+0000","last_undegraded":"2023-11-08T19:24:48.243376+0000","last_fullsized":"2023-11-08T19:24:48.243376+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:39.214888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081671599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.337708+0000","last_change":"2023-11-08T19:24:50.337708+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.337708+0000","last_undegraded":"2023-11-08T19:24:50.337708+0000","last_fullsized":"2023-11-08T19:24:50.337708+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:48.243019+0000","last_change":"2023-11-08T19:24:32.333430+0000","last_active":"2023-11-08T19:24:48.243019+0000","last_peered":"2023-11-08T19:24:48.243019+0000","last_clean":"2023-11-08T19:24:48.243019+0000","last_became_active":"2023-11-08T19:24:31.141710+0000","last_became_peered":"2023-11-08T19:24:31.141710+0000","last_unstale":"2023-11-08T19:24:48.243019+0000","last_undegraded":"2023-11-08T19:24:48.243019+0000","last_fullsized":"2023-11-08T19:24:48.243019+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:32:51.214551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000430438,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.337614+0000","last_change":"2023-11-08T19:24:50.337614+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.337614+0000","last_undegraded":"2023-11-08T19:24:50.337614+0000","last_fullsized":"2023-11-08T19:24:50.337614+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:48.243160+0000","last_change":"2023-11-08T19:24:32.530333+0000","last_active":"2023-11-08T19:24:48.243160+0000","last_peered":"2023-11-08T19:24:48.243160+0000","last_clean":"2023-11-08T19:24:48.243160+0000","last_became_active":"2023-11-08T19:24:31.144838+0000","last_became_peered":"2023-11-08T19:24:31.144838+0000","last_unstale":"2023-11-08T19:24:48.243160+0000","last_undegraded":"2023-11-08T19:24:48.243160+0000","last_fullsized":"2023-11-08T19:24:48.243160+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:39:48.473183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081588799999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.339355+0000","last_change":"2023-11-08T19:24:50.339355+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.339355+0000","last_undegraded":"2023-11-08T19:24:50.339355+0000","last_fullsized":"2023-11-08T19:24:50.339355+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:48.243051+0000","last_change":"2023-11-08T19:24:32.333096+0000","last_active":"2023-11-08T19:24:48.243051+0000","last_peered":"2023-11-08T19:24:48.243051+0000","last_clean":"2023-11-08T19:24:48.243051+0000","last_became_active":"2023-11-08T19:24:31.142985+0000","last_became_peered":"2023-11-08T19:24:31.142985+0000","last_unstale":"2023-11-08T19:24:48.243051+0000","last_undegraded":"2023-11-08T19:24:48.243051+0000","last_fullsized":"2023-11-08T19:24:48.243051+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:36:33.274496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000386048,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.337563+0000","last_change":"2023-11-08T19:24:50.337563+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.337563+0000","last_undegraded":"2023-11-08T19:24:50.337563+0000","last_fullsized":"2023-11-08T19:24:50.337563+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:47.763042+0000","last_change":"2023-11-08T19:24:32.263810+0000","last_active":"2023-11-08T19:24:47.763042+0000","last_peered":"2023-11-08T19:24:47.763042+0000","last_clean":"2023-11-08T19:24:47.763042+0000","last_became_active":"2023-11-08T19:24:31.138814+0000","last_became_peered":"2023-11-08T19:24:31.138814+0000","last_unstale":"2023-11-08T19:24:47.763042+0000","last_undegraded":"2023-11-08T19:24:47.763042+0000","last_fullsized":"2023-11-08T19:24:47.763042+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:21:55.985548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048136000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.332121+0000","last_change":"2023-11-08T19:24:50.332121+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.332121+0000","last_undegraded":"2023-11-08T19:24:50.332121+0000","last_fullsized":"2023-11-08T19:24:50.332121+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:48.243150+0000","last_change":"2023-11-08T19:24:32.544063+0000","last_active":"2023-11-08T19:24:48.243150+0000","last_peered":"2023-11-08T19:24:48.243150+0000","last_clean":"2023-11-08T19:24:48.243150+0000","last_became_active":"2023-11-08T19:24:31.144795+0000","last_became_peered":"2023-11-08T19:24:31.144795+0000","last_unstale":"2023-11-08T19:24:48.243150+0000","last_undegraded":"2023-11-08T19:24:48.243150+0000","last_fullsized":"2023-11-08T19:24:48.243150+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:12:42.248307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01495431,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.337839+0000","last_change":"2023-11-08T19:24:50.337839+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.337839+0000","last_undegraded":"2023-11-08T19:24:50.337839+0000","last_fullsized":"2023-11-08T19:24:50.337839+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":27,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.368461+0000","last_change":"2023-11-08T19:24:32.147025+0000","last_active":"2023-11-08T19:24:52.368461+0000","last_peered":"2023-11-08T19:24:52.368461+0000","last_clean":"2023-11-08T19:24:52.368461+0000","last_became_active":"2023-11-08T19:24:31.147082+0000","last_became_peered":"2023-11-08T19:24:31.147082+0000","last_unstale":"2023-11-08T19:24:52.368461+0000","last_undegraded":"2023-11-08T19:24:52.368461+0000","last_fullsized":"2023-11-08T19:24:52.368461+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:02:27.987795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043701599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.337797+0000","last_change":"2023-11-08T19:24:50.337797+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.337797+0000","last_undegraded":"2023-11-08T19:24:50.337797+0000","last_fullsized":"2023-11-08T19:24:50.337797+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:48.243308+0000","last_change":"2023-11-08T19:24:32.530620+0000","last_active":"2023-11-08T19:24:48.243308+0000","last_peered":"2023-11-08T19:24:48.243308+0000","last_clean":"2023-11-08T19:24:48.243308+0000","last_became_active":"2023-11-08T19:24:31.144223+0000","last_became_peered":"2023-11-08T19:24:31.144223+0000","last_unstale":"2023-11-08T19:24:48.243308+0000","last_undegraded":"2023-11-08T19:24:48.243308+0000","last_fullsized":"2023-11-08T19:24:48.243308+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:01:25.647952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071879799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.337556+0000","last_change":"2023-11-08T19:24:50.337556+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.337556+0000","last_undegraded":"2023-11-08T19:24:50.337556+0000","last_fullsized":"2023-11-08T19:24:50.337556+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":25,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:47.684671+0000","last_change":"2023-11-08T19:24:32.140880+0000","last_active":"2023-11-08T19:24:47.684671+0000","last_peered":"2023-11-08T19:24:47.684671+0000","last_clean":"2023-11-08T19:24:47.684671+0000","last_became_active":"2023-11-08T19:24:31.146063+0000","last_became_peered":"2023-11-08T19:24:31.146063+0000","last_unstale":"2023-11-08T19:24:47.684671+0000","last_undegraded":"2023-11-08T19:24:47.684671+0000","last_fullsized":"2023-11-08T19:24:47.684671+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:54:08.985813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089896300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.338456+0000","last_change":"2023-11-08T19:24:50.338456+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.338456+0000","last_undegraded":"2023-11-08T19:24:50.338456+0000","last_fullsized":"2023-11-08T19:24:50.338456+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":26,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:47.684560+0000","last_change":"2023-11-08T19:24:32.139885+0000","last_active":"2023-11-08T19:24:47.684560+0000","last_peered":"2023-11-08T19:24:47.684560+0000","last_clean":"2023-11-08T19:24:47.684560+0000","last_became_active":"2023-11-08T19:24:31.145329+0000","last_became_peered":"2023-11-08T19:24:31.145329+0000","last_unstale":"2023-11-08T19:24:47.684560+0000","last_undegraded":"2023-11-08T19:24:47.684560+0000","last_fullsized":"2023-11-08T19:24:47.684560+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:25:18.356784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049012999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353207+0000","last_change":"2023-11-08T19:24:52.375489+0000","last_active":"2023-11-08T19:24:53.353207+0000","last_peered":"2023-11-08T19:24:53.353207+0000","last_clean":"2023-11-08T19:24:53.353207+0000","last_became_active":"2023-11-08T19:24:52.375203+0000","last_became_peered":"2023-11-08T19:24:52.375203+0000","last_unstale":"2023-11-08T19:24:53.353207+0000","last_undegraded":"2023-11-08T19:24:53.353207+0000","last_fullsized":"2023-11-08T19:24:53.353207+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:23:49.083463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.337604+0000","last_change":"2023-11-08T19:24:50.337604+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.337604+0000","last_undegraded":"2023-11-08T19:24:50.337604+0000","last_fullsized":"2023-11-08T19:24:50.337604+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:47.686283+0000","last_change":"2023-11-08T19:24:32.142836+0000","last_active":"2023-11-08T19:24:47.686283+0000","last_peered":"2023-11-08T19:24:47.686283+0000","last_clean":"2023-11-08T19:24:47.686283+0000","last_became_active":"2023-11-08T19:24:31.141367+0000","last_became_peered":"2023-11-08T19:24:31.141367+0000","last_unstale":"2023-11-08T19:24:47.686283+0000","last_undegraded":"2023-11-08T19:24:47.686283+0000","last_fullsized":"2023-11-08T19:24:47.686283+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:39.214888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001335136,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353587+0000","last_change":"2023-11-08T19:24:52.377063+0000","last_active":"2023-11-08T19:24:53.353587+0000","last_peered":"2023-11-08T19:24:53.353587+0000","last_clean":"2023-11-08T19:24:53.353587+0000","last_became_active":"2023-11-08T19:24:52.376791+0000","last_became_peered":"2023-11-08T19:24:52.376791+0000","last_unstale":"2023-11-08T19:24:53.353587+0000","last_undegraded":"2023-11-08T19:24:53.353587+0000","last_fullsized":"2023-11-08T19:24:53.353587+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:08:17.924911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.337932+0000","last_change":"2023-11-08T19:24:50.337932+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.337932+0000","last_undegraded":"2023-11-08T19:24:50.337932+0000","last_fullsized":"2023-11-08T19:24:50.337932+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:48.243004+0000","last_change":"2023-11-08T19:24:32.544285+0000","last_active":"2023-11-08T19:24:48.243004+0000","last_peered":"2023-11-08T19:24:48.243004+0000","last_clean":"2023-11-08T19:24:48.243004+0000","last_became_active":"2023-11-08T19:24:31.142028+0000","last_became_peered":"2023-11-08T19:24:31.142028+0000","last_unstale":"2023-11-08T19:24:48.243004+0000","last_undegraded":"2023-11-08T19:24:48.243004+0000","last_fullsized":"2023-11-08T19:24:48.243004+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:01:24.198196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067537399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.337660+0000","last_change":"2023-11-08T19:24:50.337660+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.337660+0000","last_undegraded":"2023-11-08T19:24:50.337660+0000","last_fullsized":"2023-11-08T19:24:50.337660+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:48.243228+0000","last_change":"2023-11-08T19:24:32.544333+0000","last_active":"2023-11-08T19:24:48.243228+0000","last_peered":"2023-11-08T19:24:48.243228+0000","last_clean":"2023-11-08T19:24:48.243228+0000","last_became_active":"2023-11-08T19:24:31.138598+0000","last_became_peered":"2023-11-08T19:24:31.138598+0000","last_unstale":"2023-11-08T19:24:48.243228+0000","last_undegraded":"2023-11-08T19:24:48.243228+0000","last_fullsized":"2023-11-08T19:24:48.243228+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:11.860580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015114824000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.332254+0000","last_change":"2023-11-08T19:24:50.332254+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.332254+0000","last_undegraded":"2023-11-08T19:24:50.332254+0000","last_fullsized":"2023-11-08T19:24:50.332254+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:48.243494+0000","last_change":"2023-11-08T19:24:32.530665+0000","last_active":"2023-11-08T19:24:48.243494+0000","last_peered":"2023-11-08T19:24:48.243494+0000","last_clean":"2023-11-08T19:24:48.243494+0000","last_became_active":"2023-11-08T19:24:31.148363+0000","last_became_peered":"2023-11-08T19:24:31.148363+0000","last_unstale":"2023-11-08T19:24:48.243494+0000","last_undegraded":"2023-11-08T19:24:48.243494+0000","last_fullsized":"2023-11-08T19:24:48.243494+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:02:27.987795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075444200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":194,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.364492+0000","last_change":"2023-11-08T19:22:58.054283+0000","last_active":"2023-11-08T19:24:52.364492+0000","last_peered":"2023-11-08T19:24:52.364492+0000","last_clean":"2023-11-08T19:24:52.364492+0000","last_became_active":"2023-11-08T19:22:58.053337+0000","last_became_peered":"2023-11-08T19:22:58.053337+0000","last_unstale":"2023-11-08T19:24:52.364492+0000","last_undegraded":"2023-11-08T19:24:52.364492+0000","last_fullsized":"2023-11-08T19:24:52.364492+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:22:56.479654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:22:56.479654+0000","last_clean_scrub_stamp":"2023-11-08T19:22:56.479654+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:16:05.317001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":1},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":90,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28252,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343588,"statfs":{"total":96636764160,"available":96607834112,"internally_reserved":0,"allocated":1257472,"data_stored":888859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.56699999999999995}]},{"osd":1,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.505}]},{"osd":2,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.59399999999999997}]},{"osd":3,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.68500000000000005}]},{"osd":4,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.54900000000000004}]},{"osd":5,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.66400000000000003}]},{"osd":6,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.63300000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":618496,"data_stored":276970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.499},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.51800000000000002}]},{"osd":1,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.66300000000000003}]},{"osd":2,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.55800000000000005}]},{"osd":3,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":0.53900000000000003}]},{"osd":4,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.57199999999999995}]},{"osd":5,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.64800000000000002}]},{"osd":7,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.63200000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27612,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":606208,"data_stored":270480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":2.1850000000000001,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":0.5}]},{"osd":2,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.37}]},{"osd":3,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":2.2120000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.441}]},{"osd":4,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.80600000000000005}]},{"osd":5,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.71099999999999997}]},{"osd":6,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":2.093,"5min":2.093,"15min":2.093},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.745}]},{"osd":7,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":2.1299999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.57699999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28204,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343636,"statfs":{"total":96636764160,"available":96607883264,"internally_reserved":0,"allocated":1212416,"data_stored":867338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":19.295999999999999,"5min":19.295999999999999,"15min":19.295999999999999},"last":0.26500000000000001},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":17.204000000000001,"5min":17.204000000000001,"15min":17.204000000000001},"last":0.36799999999999999}]},{"osd":2,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":6.524,"5min":6.524,"15min":6.524},"last":0.35099999999999998},{"interface":"front","average":{"1min":1.169,"5min":1.169,"15min":1.169},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":17.175000000000001,"5min":17.175000000000001,"15min":17.175000000000001},"last":0.31}]},{"osd":3,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":14.324,"5min":14.324,"15min":14.324},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.38600000000000001}]},{"osd":4,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.304,"15min":1.304},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":17.056000000000001,"5min":17.056000000000001,"15min":17.056000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":5.0289999999999999,"5min":5.0289999999999999,"15min":5.0289999999999999},"last":0.60499999999999998}]},{"osd":5,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":5.0590000000000002,"5min":5.0590000000000002,"15min":5.0590000000000002},"last":0.624},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.66800000000000004}]},{"osd":6,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.752},{"interface":"front","average":{"1min":1.357,"5min":1.357,"15min":1.357},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":17.111999999999998,"5min":17.111999999999998,"15min":17.111999999999998},"last":0.59499999999999997}]},{"osd":7,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.371,"15min":1.371},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":17.146000000000001,"5min":17.146000000000001,"15min":17.146000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":4.9829999999999997,"5min":4.9829999999999997,"15min":4.9829999999999997},"last":0.65700000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":618496,"data_stored":276970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":3.4100000000000001,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":3.4369999999999998,"5min":3.4369999999999998,"15min":3.4369999999999998},"last":0.36399999999999999}]},{"osd":1,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":4.0679999999999996,"5min":4.0679999999999996,"15min":4.0679999999999996},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":4.3499999999999996,"5min":4.3499999999999996,"15min":4.3499999999999996},"last":0.59399999999999997}]},{"osd":3,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":3.8580000000000001,"5min":3.8580000000000001,"15min":3.8580000000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":3.476,"5min":3.476,"15min":3.476},"last":0.40899999999999997}]},{"osd":4,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":4.0090000000000003,"5min":4.0090000000000003,"15min":4.0090000000000003},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":4.1040000000000001,"5min":4.1040000000000001,"15min":4.1040000000000001},"last":0.47699999999999998}]},{"osd":5,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":4.0869999999999997,"5min":4.0869999999999997,"15min":4.0869999999999997},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":3.843,"5min":3.843,"15min":3.843},"last":0.438}]},{"osd":6,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":4.1399999999999997,"5min":4.1399999999999997,"15min":4.1399999999999997},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":4.0499999999999998,"5min":4.0499999999999998,"15min":4.0499999999999998},"last":0.53900000000000003}]},{"osd":7,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":4.157,"5min":4.157,"15min":4.157},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":4.1710000000000003,"5min":4.1710000000000003,"15min":4.1710000000000003},"last":0.628}]}]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27624,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344216,"statfs":{"total":96636764160,"available":96608477184,"internally_reserved":0,"allocated":618496,"data_stored":276970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.33000000000000002}]},{"osd":1,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.39000000000000001}]},{"osd":2,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.35399999999999998}]},{"osd":4,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.54000000000000004}]},{"osd":5,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.46200000000000002}]},{"osd":6,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.58299999999999996}]},{"osd":7,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.5}]}]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27612,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":606208,"data_stored":270480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":2.2090000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.46800000000000003}]},{"osd":1,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.435},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.55700000000000005}]},{"osd":2,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":2.8490000000000002,"5min":2.8490000000000002,"15min":2.8490000000000002},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.48599999999999999}]},{"osd":3,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":3.4849999999999999,"5min":3.4849999999999999,"15min":3.4849999999999999},"last":0.58199999999999996}]},{"osd":5,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.377}]},{"osd":6,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":4.1529999999999996,"5min":4.1529999999999996,"15min":4.1529999999999996},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.53500000000000003}]},{"osd":7,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.5},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":5.5359999999999996,"5min":5.5359999999999996,"15min":5.5359999999999996},"last":0.60999999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":618496,"data_stored":276970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.71999999999999997}]},{"osd":1,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":2.2919999999999998,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":0.65400000000000003}]},{"osd":2,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.55200000000000005}]},{"osd":3,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.67500000000000004}]},{"osd":4,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":2.3300000000000001,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":0.376},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.56699999999999995}]},{"osd":6,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":2.3650000000000002,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":0.44400000000000001}]},{"osd":7,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.41599999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:24:56.484 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:24:56.637 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.636+0000 7f846a11b700 1 Processor -- start 2023-11-08T19:24:56.638 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.636+0000 7f846a11b700 1 -- start start 2023-11-08T19:24:56.640 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.637+0000 7f846a11b700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f84640afb30 0x7f84640ce380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:56.641 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.637+0000 7f846a11b700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f84640b16b0 0x7f84640cbf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:56.641 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.637+0000 7f846a11b700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84640d1330 con 0x7f84640b20b0 2023-11-08T19:24:56.641 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.637+0000 7f846a11b700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84640cb490 con 0x7f84640afb30 2023-11-08T19:24:56.641 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.637+0000 7f846a11b700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84640cb770 con 0x7f84640b16b0 2023-11-08T19:24:56.642 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.637+0000 7f8462ffd700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f84640b16b0 0x7f84640cbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:56.642 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.637+0000 7f84637fe700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f84640afb30 0x7f84640ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:56.642 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.637+0000 7f84637fe700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f84640afb30 0x7f84640ce380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.149:41354/0 (socket says 172.21.15.149:41354) 2023-11-08T19:24:56.642 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.637+0000 7f84637fe700 1 -- 172.21.15.149:0/2139560585 learned_addr learned my addr 172.21.15.149:0/2139560585 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:56.643 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.637+0000 7f8462ffd700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f84640b16b0 0x7f84640cbf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.149:60650/0 (socket says 172.21.15.149:60650) 2023-11-08T19:24:56.643 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.637+0000 7f8462ffd700 1 -- 172.21.15.149:0/2139560585 >> v2:172.21.15.160:3300/0 conn(0x7f84640afb30 msgr2=0x7f84640ce380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:56.643 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.637+0000 7f8462ffd700 1 --2- 172.21.15.149:0/2139560585 >> v2:172.21.15.160:3300/0 conn(0x7f84640afb30 0x7f84640ce380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:56.643 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.637+0000 7f8462ffd700 1 -- 172.21.15.149:0/2139560585 >> v1:172.21.15.160:6789/0 conn(0x7f84640b20b0 legacy=0x7f84640aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:56.643 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.638+0000 7f8462ffd700 1 -- 172.21.15.149:0/2139560585 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84640cba50 con 0x7f84640b16b0 2023-11-08T19:24:56.644 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.637+0000 7f84627fc700 1 -- 172.21.15.149:0/2139560585 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3344781707 0 0) 0x7f84640d1330 con 0x7f84640b20b0 2023-11-08T19:24:56.644 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.638+0000 7f84637fe700 1 --2- 172.21.15.149:0/2139560585 >> v2:172.21.15.160:3300/0 conn(0x7f84640afb30 0x7f84640ce380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:24:56.644 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.638+0000 7f8462ffd700 1 --2- 172.21.15.149:0/2139560585 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f84640b16b0 0x7f84640cbf70 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8458009840 tx=0x7f8458009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fa9e384f68a2bc2 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:56.644 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.638+0000 7f84627fc700 1 -- 172.21.15.149:0/2139560585 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8458011830 con 0x7f84640b16b0 2023-11-08T19:24:56.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.638+0000 7f84627fc700 1 -- 172.21.15.149:0/2139560585 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8458011990 con 0x7f84640b16b0 2023-11-08T19:24:56.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.638+0000 7f84627fc700 1 -- 172.21.15.149:0/2139560585 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8458011d20 con 0x7f84640b16b0 2023-11-08T19:24:56.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.638+0000 7f846a11b700 1 -- 172.21.15.149:0/2139560585 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f84640b16b0 msgr2=0x7f84640cbf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:56.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.638+0000 7f846a11b700 1 --2- 172.21.15.149:0/2139560585 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f84640b16b0 0x7f84640cbf70 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8458009840 tx=0x7f8458009b50 comp rx=0 tx=0).stop 2023-11-08T19:24:56.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.638+0000 7f846a11b700 1 -- 172.21.15.149:0/2139560585 shutdown_connections 2023-11-08T19:24:56.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.638+0000 7f846a11b700 1 --2- 172.21.15.149:0/2139560585 >> v2:172.21.15.160:3300/0 conn(0x7f84640afb30 0x7f84640ce380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:56.646 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.638+0000 7f846a11b700 1 --2- 172.21.15.149:0/2139560585 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f84640b16b0 0x7f84640cbf70 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:56.646 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.638+0000 7f846a11b700 1 -- 172.21.15.149:0/2139560585 >> 172.21.15.149:0/2139560585 conn(0x7f8464099a40 msgr2=0x7f84640d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:56.646 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.639+0000 7f846a11b700 1 -- 172.21.15.149:0/2139560585 shutdown_connections 2023-11-08T19:24:56.646 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.639+0000 7f846a11b700 1 -- 172.21.15.149:0/2139560585 wait complete. 2023-11-08T19:24:56.647 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.640+0000 7f846a11b700 1 Processor -- start 2023-11-08T19:24:56.649 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.640+0000 7f846a11b700 1 -- start start 2023-11-08T19:24:56.650 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.641+0000 7f846a11b700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f84640afb30 0x7f84640c9880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:56.650 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.641+0000 7f846a11b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f84640b16b0 0x7f846415c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:56.650 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.641+0000 7f846a11b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84640b20b0 0x7f84640c90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:56.650 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.641+0000 7f846a11b700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f846415c680 con 0x7f84640b20b0 2023-11-08T19:24:56.651 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.641+0000 7f846a11b700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84640c9610 con 0x7f84640b16b0 2023-11-08T19:24:56.651 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.641+0000 7f846a11b700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84640c9e60 con 0x7f84640afb30 2023-11-08T19:24:56.651 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.641+0000 7f8463fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84640b20b0 0x7f84640c90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:56.651 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.641+0000 7f8463fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84640b20b0 0x7f84640c90d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40372/0 (socket says 172.21.15.149:40372) 2023-11-08T19:24:56.651 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.641+0000 7f8463fff700 1 -- 172.21.15.149:0/1923031923 learned_addr learned my addr 172.21.15.149:0/1923031923 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:56.652 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.641+0000 7f8462ffd700 1 --2- 172.21.15.149:0/1923031923 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f84640b16b0 0x7f846415c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:56.652 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.641+0000 7f84637fe700 1 --2- 172.21.15.149:0/1923031923 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f84640afb30 0x7f84640c9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:56.652 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.641+0000 7f8463fff700 1 -- 172.21.15.149:0/1923031923 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f84640afb30 msgr2=0x7f84640c9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:56.652 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.641+0000 7f8463fff700 1 --2- 172.21.15.149:0/1923031923 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f84640afb30 0x7f84640c9880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:56.652 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.641+0000 7f8463fff700 1 -- 172.21.15.149:0/1923031923 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f84640b16b0 msgr2=0x7f846415c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:56.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.641+0000 7f8463fff700 1 --2- 172.21.15.149:0/1923031923 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f84640b16b0 0x7f846415c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:56.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.641+0000 7f8463fff700 1 -- 172.21.15.149:0/1923031923 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8454009500 con 0x7f84640b20b0 2023-11-08T19:24:56.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.641+0000 7f8463fff700 1 --2- 172.21.15.149:0/1923031923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84640b20b0 0x7f84640c90d0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f845c001560 tx=0x7f845c00cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:56.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.641+0000 7f844bfff700 1 -- 172.21.15.149:0/1923031923 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845c003e30 con 0x7f84640b20b0 2023-11-08T19:24:56.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.641+0000 7f844bfff700 1 -- 172.21.15.149:0/1923031923 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f845c005070 con 0x7f84640b20b0 2023-11-08T19:24:56.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.641+0000 7f846a11b700 1 -- 172.21.15.149:0/1923031923 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84580094a0 con 0x7f84640b20b0 2023-11-08T19:24:56.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.641+0000 7f844bfff700 1 -- 172.21.15.149:0/1923031923 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845c005420 con 0x7f84640b20b0 2023-11-08T19:24:56.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.641+0000 7f846a11b700 1 -- 172.21.15.149:0/1923031923 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84640ca420 con 0x7f84640b20b0 2023-11-08T19:24:56.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.642+0000 7f846a11b700 1 -- 172.21.15.149:0/1923031923 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84640b1ec0 con 0x7f84640b20b0 2023-11-08T19:24:56.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.643+0000 7f844bfff700 1 -- 172.21.15.149:0/1923031923 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f845c005580 con 0x7f84640b20b0 2023-11-08T19:24:56.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.643+0000 7f844bfff700 1 --2- 172.21.15.149:0/1923031923 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f845006af00 0x7f845006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:56.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.644+0000 7f844bfff700 1 -- 172.21.15.149:0/1923031923 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f845c0893d0 con 0x7f84640b20b0 2023-11-08T19:24:56.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.644+0000 7f84637fe700 1 --2- 172.21.15.149:0/1923031923 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f845006af00 0x7f845006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:56.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.644+0000 7f84637fe700 1 --2- 172.21.15.149:0/1923031923 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f845006af00 0x7f845006d3c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8454006fd0 tx=0x7f8454008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:56.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.648+0000 7f844bfff700 1 -- 172.21.15.149:0/1923031923 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f845c0542c0 con 0x7f84640b20b0 2023-11-08T19:24:56.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.835+0000 7f846a11b700 1 -- 172.21.15.149:0/1923031923 --> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f84640cfb40 con 0x7f845006af00 2023-11-08T19:24:56.845 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.844+0000 7f844bfff700 1 -- 172.21.15.149:0/1923031923 <== mgr.4104 v2:172.21.15.149:6832/1929837472 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+360302 (secure 0 0 0) 0x7f84640cfb40 con 0x7f845006af00 2023-11-08T19:24:56.849 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:24:56.852 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.848+0000 7f846a11b700 1 -- 172.21.15.149:0/1923031923 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f845006af00 msgr2=0x7f845006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:56.853 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.848+0000 7f846a11b700 1 --2- 172.21.15.149:0/1923031923 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f845006af00 0x7f845006d3c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8454006fd0 tx=0x7f8454008040 comp rx=0 tx=0).stop 2023-11-08T19:24:56.853 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.848+0000 7f846a11b700 1 -- 172.21.15.149:0/1923031923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84640b20b0 msgr2=0x7f84640c90d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:56.853 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.848+0000 7f846a11b700 1 --2- 172.21.15.149:0/1923031923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84640b20b0 0x7f84640c90d0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f845c001560 tx=0x7f845c00cc00 comp rx=0 tx=0).stop 2023-11-08T19:24:56.853 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.848+0000 7f846a11b700 1 -- 172.21.15.149:0/1923031923 shutdown_connections 2023-11-08T19:24:56.853 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.848+0000 7f846a11b700 1 --2- 172.21.15.149:0/1923031923 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f845006af00 0x7f845006d3c0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:56.854 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.848+0000 7f846a11b700 1 --2- 172.21.15.149:0/1923031923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84640b20b0 0x7f84640c90d0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:56.854 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.848+0000 7f846a11b700 1 --2- 172.21.15.149:0/1923031923 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f84640afb30 0x7f84640c9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:56.854 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.848+0000 7f846a11b700 1 --2- 172.21.15.149:0/1923031923 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f84640b16b0 0x7f846415c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:56.854 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.848+0000 7f846a11b700 1 -- 172.21.15.149:0/1923031923 >> 172.21.15.149:0/1923031923 conn(0x7f8464099a40 msgr2=0x7f84640aebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:56.855 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.848+0000 7f846a11b700 1 -- 172.21.15.149:0/1923031923 shutdown_connections 2023-11-08T19:24:56.855 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:56.848+0000 7f846a11b700 1 -- 172.21.15.149:0/1923031923 wait complete. 2023-11-08T19:24:56.855 INFO:teuthology.orchestra.run.smithi149.stderr:dumped all 2023-11-08T19:24:56.862 INFO:teuthology.orchestra.run.smithi149.stdout:{"pg_ready":true,"pg_map":{"version":108,"stamp":"2023-11-08T19:24:56.010182+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590458,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":175,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":154,"acting":154,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":76,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222188,"kb_used_data":6012,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752532,"statfs":{"total":773094113280,"available":772866592768,"internally_reserved":0,"allocated":6156288,"data_stored":3405037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":90,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.678875"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353924+0000","last_change":"2023-11-08T19:24:52.381786+0000","last_active":"2023-11-08T19:24:53.353924+0000","last_peered":"2023-11-08T19:24:53.353924+0000","last_clean":"2023-11-08T19:24:53.353924+0000","last_became_active":"2023-11-08T19:24:52.381496+0000","last_became_peered":"2023-11-08T19:24:52.381496+0000","last_unstale":"2023-11-08T19:24:53.353924+0000","last_undegraded":"2023-11-08T19:24:53.353924+0000","last_fullsized":"2023-11-08T19:24:53.353924+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:28:32.868165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353027+0000","last_change":"2023-11-08T19:24:52.376347+0000","last_active":"2023-11-08T19:24:53.353027+0000","last_peered":"2023-11-08T19:24:53.353027+0000","last_clean":"2023-11-08T19:24:53.353027+0000","last_became_active":"2023-11-08T19:24:52.375849+0000","last_became_peered":"2023-11-08T19:24:52.375849+0000","last_unstale":"2023-11-08T19:24:53.353027+0000","last_undegraded":"2023-11-08T19:24:53.353027+0000","last_fullsized":"2023-11-08T19:24:53.353027+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:31:56.573763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353154+0000","last_change":"2023-11-08T19:24:52.378669+0000","last_active":"2023-11-08T19:24:53.353154+0000","last_peered":"2023-11-08T19:24:53.353154+0000","last_clean":"2023-11-08T19:24:53.353154+0000","last_became_active":"2023-11-08T19:24:52.378389+0000","last_became_peered":"2023-11-08T19:24:52.378389+0000","last_unstale":"2023-11-08T19:24:53.353154+0000","last_undegraded":"2023-11-08T19:24:53.353154+0000","last_fullsized":"2023-11-08T19:24:53.353154+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:46:31.594290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353446+0000","last_change":"2023-11-08T19:24:52.381743+0000","last_active":"2023-11-08T19:24:53.353446+0000","last_peered":"2023-11-08T19:24:53.353446+0000","last_clean":"2023-11-08T19:24:53.353446+0000","last_became_active":"2023-11-08T19:24:52.381427+0000","last_became_peered":"2023-11-08T19:24:52.381427+0000","last_unstale":"2023-11-08T19:24:53.353446+0000","last_undegraded":"2023-11-08T19:24:53.353446+0000","last_fullsized":"2023-11-08T19:24:53.353446+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:46:51.125293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353428+0000","last_change":"2023-11-08T19:24:52.375322+0000","last_active":"2023-11-08T19:24:53.353428+0000","last_peered":"2023-11-08T19:24:53.353428+0000","last_clean":"2023-11-08T19:24:53.353428+0000","last_became_active":"2023-11-08T19:24:52.375013+0000","last_became_peered":"2023-11-08T19:24:52.375013+0000","last_unstale":"2023-11-08T19:24:53.353428+0000","last_undegraded":"2023-11-08T19:24:53.353428+0000","last_fullsized":"2023-11-08T19:24:53.353428+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:14:05.670963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.352833+0000","last_change":"2023-11-08T19:24:52.378669+0000","last_active":"2023-11-08T19:24:53.352833+0000","last_peered":"2023-11-08T19:24:53.352833+0000","last_clean":"2023-11-08T19:24:53.352833+0000","last_became_active":"2023-11-08T19:24:52.378393+0000","last_became_peered":"2023-11-08T19:24:52.378393+0000","last_unstale":"2023-11-08T19:24:53.352833+0000","last_undegraded":"2023-11-08T19:24:53.352833+0000","last_fullsized":"2023-11-08T19:24:53.352833+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:26:04.745188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.332581+0000","last_change":"2023-11-08T19:24:50.332581+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.332581+0000","last_undegraded":"2023-11-08T19:24:50.332581+0000","last_fullsized":"2023-11-08T19:24:50.332581+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:47.763090+0000","last_change":"2023-11-08T19:24:32.263958+0000","last_active":"2023-11-08T19:24:47.763090+0000","last_peered":"2023-11-08T19:24:47.763090+0000","last_clean":"2023-11-08T19:24:47.763090+0000","last_became_active":"2023-11-08T19:24:31.149011+0000","last_became_peered":"2023-11-08T19:24:31.149011+0000","last_unstale":"2023-11-08T19:24:47.763090+0000","last_undegraded":"2023-11-08T19:24:47.763090+0000","last_fullsized":"2023-11-08T19:24:47.763090+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:09:04.880374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033496900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.338177+0000","last_change":"2023-11-08T19:24:50.338177+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.338177+0000","last_undegraded":"2023-11-08T19:24:50.338177+0000","last_fullsized":"2023-11-08T19:24:50.338177+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:47.686281+0000","last_change":"2023-11-08T19:24:32.142892+0000","last_active":"2023-11-08T19:24:47.686281+0000","last_peered":"2023-11-08T19:24:47.686281+0000","last_clean":"2023-11-08T19:24:47.686281+0000","last_became_active":"2023-11-08T19:24:31.144912+0000","last_became_peered":"2023-11-08T19:24:31.144912+0000","last_unstale":"2023-11-08T19:24:47.686281+0000","last_undegraded":"2023-11-08T19:24:47.686281+0000","last_fullsized":"2023-11-08T19:24:47.686281+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:04:21.151484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056686900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353024+0000","last_change":"2023-11-08T19:24:52.381898+0000","last_active":"2023-11-08T19:24:53.353024+0000","last_peered":"2023-11-08T19:24:53.353024+0000","last_clean":"2023-11-08T19:24:53.353024+0000","last_became_active":"2023-11-08T19:24:52.381474+0000","last_became_peered":"2023-11-08T19:24:52.381474+0000","last_unstale":"2023-11-08T19:24:53.353024+0000","last_undegraded":"2023-11-08T19:24:53.353024+0000","last_fullsized":"2023-11-08T19:24:53.353024+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:45:51.213375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"54'8","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353655+0000","last_change":"2023-11-08T19:24:51.353683+0000","last_active":"2023-11-08T19:24:53.353655+0000","last_peered":"2023-11-08T19:24:53.353655+0000","last_clean":"2023-11-08T19:24:53.353655+0000","last_became_active":"2023-11-08T19:24:51.353201+0000","last_became_peered":"2023-11-08T19:24:51.353201+0000","last_unstale":"2023-11-08T19:24:53.353655+0000","last_undegraded":"2023-11-08T19:24:53.353655+0000","last_fullsized":"2023-11-08T19:24:53.353655+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:53:41.466355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":25,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:47.684477+0000","last_change":"2023-11-08T19:24:32.140514+0000","last_active":"2023-11-08T19:24:47.684477+0000","last_peered":"2023-11-08T19:24:47.684477+0000","last_clean":"2023-11-08T19:24:47.684477+0000","last_became_active":"2023-11-08T19:24:31.146668+0000","last_became_peered":"2023-11-08T19:24:31.146668+0000","last_unstale":"2023-11-08T19:24:47.684477+0000","last_undegraded":"2023-11-08T19:24:47.684477+0000","last_fullsized":"2023-11-08T19:24:47.684477+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:31:24.539374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071576699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.337661+0000","last_change":"2023-11-08T19:24:50.337661+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.337661+0000","last_undegraded":"2023-11-08T19:24:50.337661+0000","last_fullsized":"2023-11-08T19:24:50.337661+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:47.763081+0000","last_change":"2023-11-08T19:24:32.263963+0000","last_active":"2023-11-08T19:24:47.763081+0000","last_peered":"2023-11-08T19:24:47.763081+0000","last_clean":"2023-11-08T19:24:47.763081+0000","last_became_active":"2023-11-08T19:24:31.139062+0000","last_became_peered":"2023-11-08T19:24:31.139062+0000","last_unstale":"2023-11-08T19:24:47.763081+0000","last_undegraded":"2023-11-08T19:24:47.763081+0000","last_fullsized":"2023-11-08T19:24:47.763081+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:26.080042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033682599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353734+0000","last_change":"2023-11-08T19:24:52.376929+0000","last_active":"2023-11-08T19:24:53.353734+0000","last_peered":"2023-11-08T19:24:53.353734+0000","last_clean":"2023-11-08T19:24:53.353734+0000","last_became_active":"2023-11-08T19:24:52.376602+0000","last_became_peered":"2023-11-08T19:24:52.376602+0000","last_unstale":"2023-11-08T19:24:53.353734+0000","last_undegraded":"2023-11-08T19:24:53.353734+0000","last_fullsized":"2023-11-08T19:24:53.353734+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:14:34.758666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.337528+0000","last_change":"2023-11-08T19:24:50.337528+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.337528+0000","last_undegraded":"2023-11-08T19:24:50.337528+0000","last_fullsized":"2023-11-08T19:24:50.337528+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":25,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:47.684886+0000","last_change":"2023-11-08T19:24:32.141131+0000","last_active":"2023-11-08T19:24:47.684886+0000","last_peered":"2023-11-08T19:24:47.684886+0000","last_clean":"2023-11-08T19:24:47.684886+0000","last_became_active":"2023-11-08T19:24:31.146154+0000","last_became_peered":"2023-11-08T19:24:31.146154+0000","last_unstale":"2023-11-08T19:24:47.684886+0000","last_undegraded":"2023-11-08T19:24:47.684886+0000","last_fullsized":"2023-11-08T19:24:47.684886+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:18:40.271560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082432800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353882+0000","last_change":"2023-11-08T19:24:51.355043+0000","last_active":"2023-11-08T19:24:53.353882+0000","last_peered":"2023-11-08T19:24:53.353882+0000","last_clean":"2023-11-08T19:24:53.353882+0000","last_became_active":"2023-11-08T19:24:51.354777+0000","last_became_peered":"2023-11-08T19:24:51.354777+0000","last_unstale":"2023-11-08T19:24:53.353882+0000","last_undegraded":"2023-11-08T19:24:53.353882+0000","last_fullsized":"2023-11-08T19:24:53.353882+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:04:50.527868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:48.243070+0000","last_change":"2023-11-08T19:24:32.529486+0000","last_active":"2023-11-08T19:24:48.243070+0000","last_peered":"2023-11-08T19:24:48.243070+0000","last_clean":"2023-11-08T19:24:48.243070+0000","last_became_active":"2023-11-08T19:24:31.146260+0000","last_became_peered":"2023-11-08T19:24:31.146260+0000","last_unstale":"2023-11-08T19:24:48.243070+0000","last_undegraded":"2023-11-08T19:24:48.243070+0000","last_fullsized":"2023-11-08T19:24:48.243070+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:45:34.425432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059842900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353445+0000","last_change":"2023-11-08T19:24:52.375932+0000","last_active":"2023-11-08T19:24:53.353445+0000","last_peered":"2023-11-08T19:24:53.353445+0000","last_clean":"2023-11-08T19:24:53.353445+0000","last_became_active":"2023-11-08T19:24:52.375648+0000","last_became_peered":"2023-11-08T19:24:52.375648+0000","last_unstale":"2023-11-08T19:24:53.353445+0000","last_undegraded":"2023-11-08T19:24:53.353445+0000","last_fullsized":"2023-11-08T19:24:53.353445+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:26:22.628067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.332956+0000","last_change":"2023-11-08T19:24:50.332956+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.332956+0000","last_undegraded":"2023-11-08T19:24:50.332956+0000","last_fullsized":"2023-11-08T19:24:50.332956+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:48.243358+0000","last_change":"2023-11-08T19:24:32.530168+0000","last_active":"2023-11-08T19:24:48.243358+0000","last_peered":"2023-11-08T19:24:48.243358+0000","last_clean":"2023-11-08T19:24:48.243358+0000","last_became_active":"2023-11-08T19:24:31.144329+0000","last_became_peered":"2023-11-08T19:24:31.144329+0000","last_unstale":"2023-11-08T19:24:48.243358+0000","last_undegraded":"2023-11-08T19:24:48.243358+0000","last_fullsized":"2023-11-08T19:24:48.243358+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:05:36.085920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043484799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"54'3","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353873+0000","last_change":"2023-11-08T19:24:51.352040+0000","last_active":"2023-11-08T19:24:53.353873+0000","last_peered":"2023-11-08T19:24:53.353873+0000","last_clean":"2023-11-08T19:24:53.353873+0000","last_became_active":"2023-11-08T19:24:51.351762+0000","last_became_peered":"2023-11-08T19:24:51.351762+0000","last_unstale":"2023-11-08T19:24:53.353873+0000","last_undegraded":"2023-11-08T19:24:53.353873+0000","last_fullsized":"2023-11-08T19:24:53.353873+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:04:59.430912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":26,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:47.684819+0000","last_change":"2023-11-08T19:24:32.141190+0000","last_active":"2023-11-08T19:24:47.684819+0000","last_peered":"2023-11-08T19:24:47.684819+0000","last_clean":"2023-11-08T19:24:47.684819+0000","last_became_active":"2023-11-08T19:24:31.147651+0000","last_became_peered":"2023-11-08T19:24:31.147651+0000","last_unstale":"2023-11-08T19:24:47.684819+0000","last_undegraded":"2023-11-08T19:24:47.684819+0000","last_fullsized":"2023-11-08T19:24:47.684819+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:21:55.985548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043673300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.338584+0000","last_change":"2023-11-08T19:24:50.338584+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.338584+0000","last_undegraded":"2023-11-08T19:24:50.338584+0000","last_fullsized":"2023-11-08T19:24:50.338584+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":27,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.368381+0000","last_change":"2023-11-08T19:24:32.147011+0000","last_active":"2023-11-08T19:24:52.368381+0000","last_peered":"2023-11-08T19:24:52.368381+0000","last_clean":"2023-11-08T19:24:52.368381+0000","last_became_active":"2023-11-08T19:24:31.148250+0000","last_became_peered":"2023-11-08T19:24:31.148250+0000","last_unstale":"2023-11-08T19:24:52.368381+0000","last_undegraded":"2023-11-08T19:24:52.368381+0000","last_fullsized":"2023-11-08T19:24:52.368381+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:01:25.647952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043061299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.332279+0000","last_change":"2023-11-08T19:24:50.332279+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.332279+0000","last_undegraded":"2023-11-08T19:24:50.332279+0000","last_fullsized":"2023-11-08T19:24:50.332279+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:48.243314+0000","last_change":"2023-11-08T19:24:32.543880+0000","last_active":"2023-11-08T19:24:48.243314+0000","last_peered":"2023-11-08T19:24:48.243314+0000","last_clean":"2023-11-08T19:24:48.243314+0000","last_became_active":"2023-11-08T19:24:31.142052+0000","last_became_peered":"2023-11-08T19:24:31.142052+0000","last_unstale":"2023-11-08T19:24:48.243314+0000","last_undegraded":"2023-11-08T19:24:48.243314+0000","last_fullsized":"2023-11-08T19:24:48.243314+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:18:42.371676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014881058000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.332251+0000","last_change":"2023-11-08T19:24:50.332251+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.332251+0000","last_undegraded":"2023-11-08T19:24:50.332251+0000","last_fullsized":"2023-11-08T19:24:50.332251+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":27,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.365352+0000","last_change":"2023-11-08T19:24:32.147235+0000","last_active":"2023-11-08T19:24:52.365352+0000","last_peered":"2023-11-08T19:24:52.365352+0000","last_clean":"2023-11-08T19:24:52.365352+0000","last_became_active":"2023-11-08T19:24:31.146176+0000","last_became_peered":"2023-11-08T19:24:31.146176+0000","last_unstale":"2023-11-08T19:24:52.365352+0000","last_undegraded":"2023-11-08T19:24:52.365352+0000","last_fullsized":"2023-11-08T19:24:52.365352+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:39.214888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048481000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.338195+0000","last_change":"2023-11-08T19:24:50.338195+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.338195+0000","last_undegraded":"2023-11-08T19:24:50.338195+0000","last_fullsized":"2023-11-08T19:24:50.338195+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":26,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:47.684720+0000","last_change":"2023-11-08T19:24:32.142376+0000","last_active":"2023-11-08T19:24:47.684720+0000","last_peered":"2023-11-08T19:24:47.684720+0000","last_clean":"2023-11-08T19:24:47.684720+0000","last_became_active":"2023-11-08T19:24:31.144614+0000","last_became_peered":"2023-11-08T19:24:31.144614+0000","last_unstale":"2023-11-08T19:24:47.684720+0000","last_undegraded":"2023-11-08T19:24:47.684720+0000","last_fullsized":"2023-11-08T19:24:47.684720+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:09:04.880374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050362200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.339757+0000","last_change":"2023-11-08T19:24:50.339757+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.339757+0000","last_undegraded":"2023-11-08T19:24:50.339757+0000","last_fullsized":"2023-11-08T19:24:50.339757+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":27,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.365437+0000","last_change":"2023-11-08T19:24:32.146639+0000","last_active":"2023-11-08T19:24:52.365437+0000","last_peered":"2023-11-08T19:24:52.365437+0000","last_clean":"2023-11-08T19:24:52.365437+0000","last_became_active":"2023-11-08T19:24:31.147384+0000","last_became_peered":"2023-11-08T19:24:31.147384+0000","last_unstale":"2023-11-08T19:24:52.365437+0000","last_undegraded":"2023-11-08T19:24:52.365437+0000","last_fullsized":"2023-11-08T19:24:52.365437+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:30:21.946303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043834899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.338705+0000","last_change":"2023-11-08T19:24:50.338705+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.338705+0000","last_undegraded":"2023-11-08T19:24:50.338705+0000","last_fullsized":"2023-11-08T19:24:50.338705+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:48.242909+0000","last_change":"2023-11-08T19:24:32.544108+0000","last_active":"2023-11-08T19:24:48.242909+0000","last_peered":"2023-11-08T19:24:48.242909+0000","last_clean":"2023-11-08T19:24:48.242909+0000","last_became_active":"2023-11-08T19:24:31.143812+0000","last_became_peered":"2023-11-08T19:24:31.143812+0000","last_unstale":"2023-11-08T19:24:48.242909+0000","last_undegraded":"2023-11-08T19:24:48.242909+0000","last_fullsized":"2023-11-08T19:24:48.242909+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:27:59.135977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014956126,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.338406+0000","last_change":"2023-11-08T19:24:50.338406+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.338406+0000","last_undegraded":"2023-11-08T19:24:50.338406+0000","last_fullsized":"2023-11-08T19:24:50.338406+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:48.243404+0000","last_change":"2023-11-08T19:24:32.530378+0000","last_active":"2023-11-08T19:24:48.243404+0000","last_peered":"2023-11-08T19:24:48.243404+0000","last_clean":"2023-11-08T19:24:48.243404+0000","last_became_active":"2023-11-08T19:24:31.144341+0000","last_became_peered":"2023-11-08T19:24:31.144341+0000","last_unstale":"2023-11-08T19:24:48.243404+0000","last_undegraded":"2023-11-08T19:24:48.243404+0000","last_fullsized":"2023-11-08T19:24:48.243404+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:30:21.946303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058308299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.338593+0000","last_change":"2023-11-08T19:24:50.338593+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.338593+0000","last_undegraded":"2023-11-08T19:24:50.338593+0000","last_fullsized":"2023-11-08T19:24:50.338593+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":25,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:47.684544+0000","last_change":"2023-11-08T19:24:32.140832+0000","last_active":"2023-11-08T19:24:47.684544+0000","last_peered":"2023-11-08T19:24:47.684544+0000","last_clean":"2023-11-08T19:24:47.684544+0000","last_became_active":"2023-11-08T19:24:31.146557+0000","last_became_peered":"2023-11-08T19:24:31.146557+0000","last_unstale":"2023-11-08T19:24:47.684544+0000","last_undegraded":"2023-11-08T19:24:47.684544+0000","last_fullsized":"2023-11-08T19:24:47.684544+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:40:04.258107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099450100000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.352995+0000","last_change":"2023-11-08T19:24:52.381859+0000","last_active":"2023-11-08T19:24:53.352995+0000","last_peered":"2023-11-08T19:24:53.352995+0000","last_clean":"2023-11-08T19:24:53.352995+0000","last_became_active":"2023-11-08T19:24:52.381568+0000","last_became_peered":"2023-11-08T19:24:52.381568+0000","last_unstale":"2023-11-08T19:24:53.352995+0000","last_undegraded":"2023-11-08T19:24:53.352995+0000","last_fullsized":"2023-11-08T19:24:53.352995+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:09:36.064066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.332231+0000","last_change":"2023-11-08T19:24:50.332231+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.332231+0000","last_undegraded":"2023-11-08T19:24:50.332231+0000","last_fullsized":"2023-11-08T19:24:50.332231+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":25,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:47.684627+0000","last_change":"2023-11-08T19:24:32.141188+0000","last_active":"2023-11-08T19:24:47.684627+0000","last_peered":"2023-11-08T19:24:47.684627+0000","last_clean":"2023-11-08T19:24:47.684627+0000","last_became_active":"2023-11-08T19:24:31.148857+0000","last_became_peered":"2023-11-08T19:24:31.148857+0000","last_unstale":"2023-11-08T19:24:47.684627+0000","last_undegraded":"2023-11-08T19:24:47.684627+0000","last_fullsized":"2023-11-08T19:24:47.684627+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:45:34.425432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065078599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.338891+0000","last_change":"2023-11-08T19:24:50.338891+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.338891+0000","last_undegraded":"2023-11-08T19:24:50.338891+0000","last_fullsized":"2023-11-08T19:24:50.338891+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":25,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:47.684535+0000","last_change":"2023-11-08T19:24:32.140167+0000","last_active":"2023-11-08T19:24:47.684535+0000","last_peered":"2023-11-08T19:24:47.684535+0000","last_clean":"2023-11-08T19:24:47.684535+0000","last_became_active":"2023-11-08T19:24:31.147181+0000","last_became_peered":"2023-11-08T19:24:31.147181+0000","last_unstale":"2023-11-08T19:24:47.684535+0000","last_undegraded":"2023-11-08T19:24:47.684535+0000","last_fullsized":"2023-11-08T19:24:47.684535+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:26.080042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057135200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.337482+0000","last_change":"2023-11-08T19:24:50.337482+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.337482+0000","last_undegraded":"2023-11-08T19:24:50.337482+0000","last_fullsized":"2023-11-08T19:24:50.337482+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:48.243376+0000","last_change":"2023-11-08T19:24:32.530895+0000","last_active":"2023-11-08T19:24:48.243376+0000","last_peered":"2023-11-08T19:24:48.243376+0000","last_clean":"2023-11-08T19:24:48.243376+0000","last_became_active":"2023-11-08T19:24:31.146715+0000","last_became_peered":"2023-11-08T19:24:31.146715+0000","last_unstale":"2023-11-08T19:24:48.243376+0000","last_undegraded":"2023-11-08T19:24:48.243376+0000","last_fullsized":"2023-11-08T19:24:48.243376+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:39.214888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081671599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.337708+0000","last_change":"2023-11-08T19:24:50.337708+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.337708+0000","last_undegraded":"2023-11-08T19:24:50.337708+0000","last_fullsized":"2023-11-08T19:24:50.337708+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:48.243019+0000","last_change":"2023-11-08T19:24:32.333430+0000","last_active":"2023-11-08T19:24:48.243019+0000","last_peered":"2023-11-08T19:24:48.243019+0000","last_clean":"2023-11-08T19:24:48.243019+0000","last_became_active":"2023-11-08T19:24:31.141710+0000","last_became_peered":"2023-11-08T19:24:31.141710+0000","last_unstale":"2023-11-08T19:24:48.243019+0000","last_undegraded":"2023-11-08T19:24:48.243019+0000","last_fullsized":"2023-11-08T19:24:48.243019+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:32:51.214551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000430438,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.337614+0000","last_change":"2023-11-08T19:24:50.337614+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.337614+0000","last_undegraded":"2023-11-08T19:24:50.337614+0000","last_fullsized":"2023-11-08T19:24:50.337614+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:48.243160+0000","last_change":"2023-11-08T19:24:32.530333+0000","last_active":"2023-11-08T19:24:48.243160+0000","last_peered":"2023-11-08T19:24:48.243160+0000","last_clean":"2023-11-08T19:24:48.243160+0000","last_became_active":"2023-11-08T19:24:31.144838+0000","last_became_peered":"2023-11-08T19:24:31.144838+0000","last_unstale":"2023-11-08T19:24:48.243160+0000","last_undegraded":"2023-11-08T19:24:48.243160+0000","last_fullsized":"2023-11-08T19:24:48.243160+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:39:48.473183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081588799999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.339355+0000","last_change":"2023-11-08T19:24:50.339355+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.339355+0000","last_undegraded":"2023-11-08T19:24:50.339355+0000","last_fullsized":"2023-11-08T19:24:50.339355+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:48.243051+0000","last_change":"2023-11-08T19:24:32.333096+0000","last_active":"2023-11-08T19:24:48.243051+0000","last_peered":"2023-11-08T19:24:48.243051+0000","last_clean":"2023-11-08T19:24:48.243051+0000","last_became_active":"2023-11-08T19:24:31.142985+0000","last_became_peered":"2023-11-08T19:24:31.142985+0000","last_unstale":"2023-11-08T19:24:48.243051+0000","last_undegraded":"2023-11-08T19:24:48.243051+0000","last_fullsized":"2023-11-08T19:24:48.243051+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:36:33.274496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000386048,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.337563+0000","last_change":"2023-11-08T19:24:50.337563+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.337563+0000","last_undegraded":"2023-11-08T19:24:50.337563+0000","last_fullsized":"2023-11-08T19:24:50.337563+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:47.763042+0000","last_change":"2023-11-08T19:24:32.263810+0000","last_active":"2023-11-08T19:24:47.763042+0000","last_peered":"2023-11-08T19:24:47.763042+0000","last_clean":"2023-11-08T19:24:47.763042+0000","last_became_active":"2023-11-08T19:24:31.138814+0000","last_became_peered":"2023-11-08T19:24:31.138814+0000","last_unstale":"2023-11-08T19:24:47.763042+0000","last_undegraded":"2023-11-08T19:24:47.763042+0000","last_fullsized":"2023-11-08T19:24:47.763042+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:21:55.985548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048136000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.332121+0000","last_change":"2023-11-08T19:24:50.332121+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.332121+0000","last_undegraded":"2023-11-08T19:24:50.332121+0000","last_fullsized":"2023-11-08T19:24:50.332121+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:48.243150+0000","last_change":"2023-11-08T19:24:32.544063+0000","last_active":"2023-11-08T19:24:48.243150+0000","last_peered":"2023-11-08T19:24:48.243150+0000","last_clean":"2023-11-08T19:24:48.243150+0000","last_became_active":"2023-11-08T19:24:31.144795+0000","last_became_peered":"2023-11-08T19:24:31.144795+0000","last_unstale":"2023-11-08T19:24:48.243150+0000","last_undegraded":"2023-11-08T19:24:48.243150+0000","last_fullsized":"2023-11-08T19:24:48.243150+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:12:42.248307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01495431,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.337839+0000","last_change":"2023-11-08T19:24:50.337839+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.337839+0000","last_undegraded":"2023-11-08T19:24:50.337839+0000","last_fullsized":"2023-11-08T19:24:50.337839+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":27,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.368461+0000","last_change":"2023-11-08T19:24:32.147025+0000","last_active":"2023-11-08T19:24:52.368461+0000","last_peered":"2023-11-08T19:24:52.368461+0000","last_clean":"2023-11-08T19:24:52.368461+0000","last_became_active":"2023-11-08T19:24:31.147082+0000","last_became_peered":"2023-11-08T19:24:31.147082+0000","last_unstale":"2023-11-08T19:24:52.368461+0000","last_undegraded":"2023-11-08T19:24:52.368461+0000","last_fullsized":"2023-11-08T19:24:52.368461+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:02:27.987795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043701599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.337797+0000","last_change":"2023-11-08T19:24:50.337797+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.337797+0000","last_undegraded":"2023-11-08T19:24:50.337797+0000","last_fullsized":"2023-11-08T19:24:50.337797+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:48.243308+0000","last_change":"2023-11-08T19:24:32.530620+0000","last_active":"2023-11-08T19:24:48.243308+0000","last_peered":"2023-11-08T19:24:48.243308+0000","last_clean":"2023-11-08T19:24:48.243308+0000","last_became_active":"2023-11-08T19:24:31.144223+0000","last_became_peered":"2023-11-08T19:24:31.144223+0000","last_unstale":"2023-11-08T19:24:48.243308+0000","last_undegraded":"2023-11-08T19:24:48.243308+0000","last_fullsized":"2023-11-08T19:24:48.243308+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:01:25.647952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071879799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.337556+0000","last_change":"2023-11-08T19:24:50.337556+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.337556+0000","last_undegraded":"2023-11-08T19:24:50.337556+0000","last_fullsized":"2023-11-08T19:24:50.337556+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":25,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:47.684671+0000","last_change":"2023-11-08T19:24:32.140880+0000","last_active":"2023-11-08T19:24:47.684671+0000","last_peered":"2023-11-08T19:24:47.684671+0000","last_clean":"2023-11-08T19:24:47.684671+0000","last_became_active":"2023-11-08T19:24:31.146063+0000","last_became_peered":"2023-11-08T19:24:31.146063+0000","last_unstale":"2023-11-08T19:24:47.684671+0000","last_undegraded":"2023-11-08T19:24:47.684671+0000","last_fullsized":"2023-11-08T19:24:47.684671+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:54:08.985813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089896300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.338456+0000","last_change":"2023-11-08T19:24:50.338456+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.338456+0000","last_undegraded":"2023-11-08T19:24:50.338456+0000","last_fullsized":"2023-11-08T19:24:50.338456+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":26,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:47.684560+0000","last_change":"2023-11-08T19:24:32.139885+0000","last_active":"2023-11-08T19:24:47.684560+0000","last_peered":"2023-11-08T19:24:47.684560+0000","last_clean":"2023-11-08T19:24:47.684560+0000","last_became_active":"2023-11-08T19:24:31.145329+0000","last_became_peered":"2023-11-08T19:24:31.145329+0000","last_unstale":"2023-11-08T19:24:47.684560+0000","last_undegraded":"2023-11-08T19:24:47.684560+0000","last_fullsized":"2023-11-08T19:24:47.684560+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:25:18.356784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049012999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353207+0000","last_change":"2023-11-08T19:24:52.375489+0000","last_active":"2023-11-08T19:24:53.353207+0000","last_peered":"2023-11-08T19:24:53.353207+0000","last_clean":"2023-11-08T19:24:53.353207+0000","last_became_active":"2023-11-08T19:24:52.375203+0000","last_became_peered":"2023-11-08T19:24:52.375203+0000","last_unstale":"2023-11-08T19:24:53.353207+0000","last_undegraded":"2023-11-08T19:24:53.353207+0000","last_fullsized":"2023-11-08T19:24:53.353207+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:23:49.083463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.337604+0000","last_change":"2023-11-08T19:24:50.337604+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.337604+0000","last_undegraded":"2023-11-08T19:24:50.337604+0000","last_fullsized":"2023-11-08T19:24:50.337604+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:47.686283+0000","last_change":"2023-11-08T19:24:32.142836+0000","last_active":"2023-11-08T19:24:47.686283+0000","last_peered":"2023-11-08T19:24:47.686283+0000","last_clean":"2023-11-08T19:24:47.686283+0000","last_became_active":"2023-11-08T19:24:31.141367+0000","last_became_peered":"2023-11-08T19:24:31.141367+0000","last_unstale":"2023-11-08T19:24:47.686283+0000","last_undegraded":"2023-11-08T19:24:47.686283+0000","last_fullsized":"2023-11-08T19:24:47.686283+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:39.214888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001335136,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353587+0000","last_change":"2023-11-08T19:24:52.377063+0000","last_active":"2023-11-08T19:24:53.353587+0000","last_peered":"2023-11-08T19:24:53.353587+0000","last_clean":"2023-11-08T19:24:53.353587+0000","last_became_active":"2023-11-08T19:24:52.376791+0000","last_became_peered":"2023-11-08T19:24:52.376791+0000","last_unstale":"2023-11-08T19:24:53.353587+0000","last_undegraded":"2023-11-08T19:24:53.353587+0000","last_fullsized":"2023-11-08T19:24:53.353587+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:08:17.924911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.337932+0000","last_change":"2023-11-08T19:24:50.337932+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.337932+0000","last_undegraded":"2023-11-08T19:24:50.337932+0000","last_fullsized":"2023-11-08T19:24:50.337932+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:48.243004+0000","last_change":"2023-11-08T19:24:32.544285+0000","last_active":"2023-11-08T19:24:48.243004+0000","last_peered":"2023-11-08T19:24:48.243004+0000","last_clean":"2023-11-08T19:24:48.243004+0000","last_became_active":"2023-11-08T19:24:31.142028+0000","last_became_peered":"2023-11-08T19:24:31.142028+0000","last_unstale":"2023-11-08T19:24:48.243004+0000","last_undegraded":"2023-11-08T19:24:48.243004+0000","last_fullsized":"2023-11-08T19:24:48.243004+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:01:24.198196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067537399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.337660+0000","last_change":"2023-11-08T19:24:50.337660+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.337660+0000","last_undegraded":"2023-11-08T19:24:50.337660+0000","last_fullsized":"2023-11-08T19:24:50.337660+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:48.243228+0000","last_change":"2023-11-08T19:24:32.544333+0000","last_active":"2023-11-08T19:24:48.243228+0000","last_peered":"2023-11-08T19:24:48.243228+0000","last_clean":"2023-11-08T19:24:48.243228+0000","last_became_active":"2023-11-08T19:24:31.138598+0000","last_became_peered":"2023-11-08T19:24:31.138598+0000","last_unstale":"2023-11-08T19:24:48.243228+0000","last_undegraded":"2023-11-08T19:24:48.243228+0000","last_fullsized":"2023-11-08T19:24:48.243228+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:11.860580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015114824000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.332254+0000","last_change":"2023-11-08T19:24:50.332254+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.332254+0000","last_undegraded":"2023-11-08T19:24:50.332254+0000","last_fullsized":"2023-11-08T19:24:50.332254+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:48.243494+0000","last_change":"2023-11-08T19:24:32.530665+0000","last_active":"2023-11-08T19:24:48.243494+0000","last_peered":"2023-11-08T19:24:48.243494+0000","last_clean":"2023-11-08T19:24:48.243494+0000","last_became_active":"2023-11-08T19:24:31.148363+0000","last_became_peered":"2023-11-08T19:24:31.148363+0000","last_unstale":"2023-11-08T19:24:48.243494+0000","last_undegraded":"2023-11-08T19:24:48.243494+0000","last_fullsized":"2023-11-08T19:24:48.243494+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:02:27.987795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075444200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":194,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.364492+0000","last_change":"2023-11-08T19:22:58.054283+0000","last_active":"2023-11-08T19:24:52.364492+0000","last_peered":"2023-11-08T19:24:52.364492+0000","last_clean":"2023-11-08T19:24:52.364492+0000","last_became_active":"2023-11-08T19:22:58.053337+0000","last_became_peered":"2023-11-08T19:22:58.053337+0000","last_unstale":"2023-11-08T19:24:52.364492+0000","last_undegraded":"2023-11-08T19:24:52.364492+0000","last_fullsized":"2023-11-08T19:24:52.364492+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:22:56.479654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:22:56.479654+0000","last_clean_scrub_stamp":"2023-11-08T19:22:56.479654+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:16:05.317001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":1},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":90,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28252,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343588,"statfs":{"total":96636764160,"available":96607834112,"internally_reserved":0,"allocated":1257472,"data_stored":888859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.56699999999999995}]},{"osd":1,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.505}]},{"osd":2,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.59399999999999997}]},{"osd":3,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.68500000000000005}]},{"osd":4,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.54900000000000004}]},{"osd":5,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.66400000000000003}]},{"osd":6,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.63300000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":618496,"data_stored":276970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.499},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.51800000000000002}]},{"osd":1,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.66300000000000003}]},{"osd":2,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.55800000000000005}]},{"osd":3,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":0.53900000000000003}]},{"osd":4,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.57199999999999995}]},{"osd":5,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.64800000000000002}]},{"osd":7,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.63200000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27612,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":606208,"data_stored":270480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":2.1850000000000001,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":0.5}]},{"osd":2,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.37}]},{"osd":3,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":2.2120000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.441}]},{"osd":4,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.80600000000000005}]},{"osd":5,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.71099999999999997}]},{"osd":6,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":2.093,"5min":2.093,"15min":2.093},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.745}]},{"osd":7,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":2.1299999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.57699999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28204,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343636,"statfs":{"total":96636764160,"available":96607883264,"internally_reserved":0,"allocated":1212416,"data_stored":867338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":19.295999999999999,"5min":19.295999999999999,"15min":19.295999999999999},"last":0.26500000000000001},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":17.204000000000001,"5min":17.204000000000001,"15min":17.204000000000001},"last":0.36799999999999999}]},{"osd":2,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":6.524,"5min":6.524,"15min":6.524},"last":0.35099999999999998},{"interface":"front","average":{"1min":1.169,"5min":1.169,"15min":1.169},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":17.175000000000001,"5min":17.175000000000001,"15min":17.175000000000001},"last":0.31}]},{"osd":3,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":14.324,"5min":14.324,"15min":14.324},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.38600000000000001}]},{"osd":4,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.304,"15min":1.304},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":17.056000000000001,"5min":17.056000000000001,"15min":17.056000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":5.0289999999999999,"5min":5.0289999999999999,"15min":5.0289999999999999},"last":0.60499999999999998}]},{"osd":5,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":5.0590000000000002,"5min":5.0590000000000002,"15min":5.0590000000000002},"last":0.624},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.66800000000000004}]},{"osd":6,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.752},{"interface":"front","average":{"1min":1.357,"5min":1.357,"15min":1.357},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":17.111999999999998,"5min":17.111999999999998,"15min":17.111999999999998},"last":0.59499999999999997}]},{"osd":7,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.371,"15min":1.371},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":17.146000000000001,"5min":17.146000000000001,"15min":17.146000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":4.9829999999999997,"5min":4.9829999999999997,"15min":4.9829999999999997},"last":0.65700000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":618496,"data_stored":276970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":3.4100000000000001,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":3.4369999999999998,"5min":3.4369999999999998,"15min":3.4369999999999998},"last":0.36399999999999999}]},{"osd":1,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":4.0679999999999996,"5min":4.0679999999999996,"15min":4.0679999999999996},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":4.3499999999999996,"5min":4.3499999999999996,"15min":4.3499999999999996},"last":0.59399999999999997}]},{"osd":3,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":3.8580000000000001,"5min":3.8580000000000001,"15min":3.8580000000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":3.476,"5min":3.476,"15min":3.476},"last":0.40899999999999997}]},{"osd":4,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":4.0090000000000003,"5min":4.0090000000000003,"15min":4.0090000000000003},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":4.1040000000000001,"5min":4.1040000000000001,"15min":4.1040000000000001},"last":0.47699999999999998}]},{"osd":5,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":4.0869999999999997,"5min":4.0869999999999997,"15min":4.0869999999999997},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":3.843,"5min":3.843,"15min":3.843},"last":0.438}]},{"osd":6,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":4.1399999999999997,"5min":4.1399999999999997,"15min":4.1399999999999997},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":4.0499999999999998,"5min":4.0499999999999998,"15min":4.0499999999999998},"last":0.53900000000000003}]},{"osd":7,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":4.157,"5min":4.157,"15min":4.157},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":4.1710000000000003,"5min":4.1710000000000003,"15min":4.1710000000000003},"last":0.628}]}]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27624,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344216,"statfs":{"total":96636764160,"available":96608477184,"internally_reserved":0,"allocated":618496,"data_stored":276970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.33000000000000002}]},{"osd":1,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.39000000000000001}]},{"osd":2,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.35399999999999998}]},{"osd":4,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.54000000000000004}]},{"osd":5,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.46200000000000002}]},{"osd":6,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.58299999999999996}]},{"osd":7,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.5}]}]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27612,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":606208,"data_stored":270480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":2.2090000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.46800000000000003}]},{"osd":1,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.435},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.55700000000000005}]},{"osd":2,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":2.8490000000000002,"5min":2.8490000000000002,"15min":2.8490000000000002},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.48599999999999999}]},{"osd":3,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":3.4849999999999999,"5min":3.4849999999999999,"15min":3.4849999999999999},"last":0.58199999999999996}]},{"osd":5,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.377}]},{"osd":6,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":4.1529999999999996,"5min":4.1529999999999996,"15min":4.1529999999999996},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.53500000000000003}]},{"osd":7,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.5},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":5.5359999999999996,"5min":5.5359999999999996,"15min":5.5359999999999996},"last":0.60999999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":618496,"data_stored":276970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.71999999999999997}]},{"osd":1,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":2.2919999999999998,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":0.65400000000000003}]},{"osd":2,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.55200000000000005}]},{"osd":3,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.67500000000000004}]},{"osd":4,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":2.3300000000000001,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":0.376},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.56699999999999995}]},{"osd":6,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":2.3650000000000002,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":0.44400000000000001}]},{"osd":7,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.41599999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:24:56.870 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:24:57.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.021+0000 7f338ae1b700 1 Processor -- start 2023-11-08T19:24:57.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.022+0000 7f338ae1b700 1 -- start start 2023-11-08T19:24:57.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.022+0000 7f338ae1b700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3384161050 0x7f33840b6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:57.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.022+0000 7f338ae1b700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33840ce7a0 con 0x7f33840b4640 2023-11-08T19:24:57.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.022+0000 7f338ae1b700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33840d14a0 con 0x7f33840d1d40 2023-11-08T19:24:57.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.022+0000 7f338ae1b700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33840d1780 con 0x7f3384161050 2023-11-08T19:24:57.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.022+0000 7f3388bb7700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3384161050 0x7f33840b6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:57.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.022+0000 7f3383fff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f33840b4640 0x7f33840d4150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:42378/0 (socket says 172.21.15.149:42378) 2023-11-08T19:24:57.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.022+0000 7f3383fff700 1 -- 172.21.15.149:0/3186667150 learned_addr learned my addr 172.21.15.149:0/3186667150 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:24:57.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.023+0000 7f33837fe700 1 -- 172.21.15.149:0/3186667150 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1915277659 0 0) 0x7f33840ce7a0 con 0x7f33840b4640 2023-11-08T19:24:57.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.023+0000 7f33837fe700 1 -- 172.21.15.149:0/3186667150 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33740035b0 con 0x7f33840b4640 2023-11-08T19:24:57.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.023+0000 7f3388bb7700 1 -- 172.21.15.149:0/3186667150 >> v1:172.21.15.160:6789/0 conn(0x7f33840d1d40 legacy=0x7f33840d2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:57.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.023+0000 7f3388bb7700 1 -- 172.21.15.149:0/3186667150 >> v1:172.21.15.149:6789/0 conn(0x7f33840b4640 legacy=0x7f33840d4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:57.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.023+0000 7f3388bb7700 1 -- 172.21.15.149:0/3186667150 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33840d1a60 con 0x7f3384161050 2023-11-08T19:24:57.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.023+0000 7f3388bb7700 1 --2- 172.21.15.149:0/3186667150 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3384161050 0x7f33840b6680 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f3378009820 tx=0x7f3378009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6fd2abf721122bf server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:57.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.023+0000 7f33837fe700 1 -- 172.21.15.149:0/3186667150 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3378005e30 con 0x7f3384161050 2023-11-08T19:24:57.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.023+0000 7f33837fe700 1 -- 172.21.15.149:0/3186667150 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3378006030 con 0x7f3384161050 2023-11-08T19:24:57.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.023+0000 7f33837fe700 1 -- 172.21.15.149:0/3186667150 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33780063c0 con 0x7f3384161050 2023-11-08T19:24:57.032 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.024+0000 7f338ae1b700 1 -- 172.21.15.149:0/3186667150 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3384161050 msgr2=0x7f33840b6680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:57.032 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.024+0000 7f338ae1b700 1 --2- 172.21.15.149:0/3186667150 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3384161050 0x7f33840b6680 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f3378009820 tx=0x7f3378009b30 comp rx=0 tx=0).stop 2023-11-08T19:24:57.032 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.024+0000 7f338ae1b700 1 -- 172.21.15.149:0/3186667150 shutdown_connections 2023-11-08T19:24:57.032 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.024+0000 7f338ae1b700 1 --2- 172.21.15.149:0/3186667150 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3384161050 0x7f33840b6680 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:57.032 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.024+0000 7f338ae1b700 1 -- 172.21.15.149:0/3186667150 >> 172.21.15.149:0/3186667150 conn(0x7f338409cb70 msgr2=0x7f33840d3830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:57.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.024+0000 7f338ae1b700 1 -- 172.21.15.149:0/3186667150 shutdown_connections 2023-11-08T19:24:57.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.024+0000 7f338ae1b700 1 -- 172.21.15.149:0/3186667150 wait complete. 2023-11-08T19:24:57.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.025+0000 7f338ae1b700 1 Processor -- start 2023-11-08T19:24:57.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.025+0000 7f338ae1b700 1 -- start start 2023-11-08T19:24:57.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.026+0000 7f338ae1b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33840b4640 0x7f3384156b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:57.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.026+0000 7f338ae1b700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f33840d1d40 0x7f33841570c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:57.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.026+0000 7f338ae1b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3384161050 0x7f33841f04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:57.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.026+0000 7f338ae1b700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3384159790 con 0x7f33840b4640 2023-11-08T19:24:57.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.026+0000 7f338ae1b700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33841464d0 con 0x7f3384161050 2023-11-08T19:24:57.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.026+0000 7f338ae1b700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3384159140 con 0x7f33840d1d40 2023-11-08T19:24:57.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.026+0000 7f3388bb7700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33840b4640 0x7f3384156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:57.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.026+0000 7f3388bb7700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33840b4640 0x7f3384156b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40380/0 (socket says 172.21.15.149:40380) 2023-11-08T19:24:57.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.026+0000 7f3388bb7700 1 -- 172.21.15.149:0/4254102967 learned_addr learned my addr 172.21.15.149:0/4254102967 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:57.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.026+0000 7f33893b8700 1 --2- 172.21.15.149:0/4254102967 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3384161050 0x7f33841f04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:57.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.026+0000 7f3383fff700 1 --2- 172.21.15.149:0/4254102967 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f33840d1d40 0x7f33841570c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:57.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.026+0000 7f3388bb7700 1 -- 172.21.15.149:0/4254102967 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f33840d1d40 msgr2=0x7f33841570c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:57.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.026+0000 7f3388bb7700 1 --2- 172.21.15.149:0/4254102967 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f33840d1d40 0x7f33841570c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:57.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.026+0000 7f3388bb7700 1 -- 172.21.15.149:0/4254102967 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3384161050 msgr2=0x7f33841f04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:57.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.026+0000 7f3388bb7700 1 --2- 172.21.15.149:0/4254102967 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3384161050 0x7f33841f04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:57.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.026+0000 7f3388bb7700 1 -- 172.21.15.149:0/4254102967 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3378009430 con 0x7f33840b4640 2023-11-08T19:24:57.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.026+0000 7f33893b8700 1 --2- 172.21.15.149:0/4254102967 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3384161050 0x7f33841f04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:24:57.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.026+0000 7f3383fff700 1 --2- 172.21.15.149:0/4254102967 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f33840d1d40 0x7f33841570c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:24:57.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.026+0000 7f3388bb7700 1 --2- 172.21.15.149:0/4254102967 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33840b4640 0x7f3384156b80 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f3378009fd0 tx=0x7f3378004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:57.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.026+0000 7f33817fa700 1 -- 172.21.15.149:0/4254102967 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3378004240 con 0x7f33840b4640 2023-11-08T19:24:57.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.026+0000 7f33817fa700 1 -- 172.21.15.149:0/4254102967 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33780043a0 con 0x7f33840b4640 2023-11-08T19:24:57.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.026+0000 7f338ae1b700 1 -- 172.21.15.149:0/4254102967 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3384159420 con 0x7f33840b4640 2023-11-08T19:24:57.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.027+0000 7f33817fa700 1 -- 172.21.15.149:0/4254102967 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33780036a0 con 0x7f33840b4640 2023-11-08T19:24:57.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.027+0000 7f338ae1b700 1 -- 172.21.15.149:0/4254102967 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3384159c20 con 0x7f33840b4640 2023-11-08T19:24:57.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.027+0000 7f338ae1b700 1 -- 172.21.15.149:0/4254102967 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3384159a70 con 0x7f33840b4640 2023-11-08T19:24:57.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.028+0000 7f33817fa700 1 -- 172.21.15.149:0/4254102967 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3378022070 con 0x7f33840b4640 2023-11-08T19:24:57.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.028+0000 7f33817fa700 1 --2- 172.21.15.149:0/4254102967 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f336806af00 0x7f336806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:57.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.028+0000 7f33817fa700 1 -- 172.21.15.149:0/4254102967 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f337808b060 con 0x7f33840b4640 2023-11-08T19:24:57.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.028+0000 7f3383fff700 1 --2- 172.21.15.149:0/4254102967 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f336806af00 0x7f336806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:57.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.029+0000 7f3383fff700 1 --2- 172.21.15.149:0/4254102967 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f336806af00 0x7f336806d3c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f33841543d0 tx=0x7f3370009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:57.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.033+0000 7f33817fa700 1 -- 172.21.15.149:0/4254102967 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3378055f00 con 0x7f33840b4640 2023-11-08T19:24:57.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.221+0000 7f338ae1b700 1 -- 172.21.15.149:0/4254102967 --> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f33840ce400 con 0x7f336806af00 2023-11-08T19:24:57.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.231+0000 7f33817fa700 1 -- 172.21.15.149:0/4254102967 <== mgr.4104 v2:172.21.15.149:6832/1929837472 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+360302 (secure 0 0 0) 0x7f3370005920 con 0x7f336806af00 2023-11-08T19:24:57.237 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:24:57.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.235+0000 7f338ae1b700 1 -- 172.21.15.149:0/4254102967 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f336806af00 msgr2=0x7f336806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:57.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.235+0000 7f338ae1b700 1 --2- 172.21.15.149:0/4254102967 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f336806af00 0x7f336806d3c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f33841543d0 tx=0x7f3370009040 comp rx=0 tx=0).stop 2023-11-08T19:24:57.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.235+0000 7f338ae1b700 1 -- 172.21.15.149:0/4254102967 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33840b4640 msgr2=0x7f3384156b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:57.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.235+0000 7f338ae1b700 1 --2- 172.21.15.149:0/4254102967 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33840b4640 0x7f3384156b80 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f3378009fd0 tx=0x7f3378004750 comp rx=0 tx=0).stop 2023-11-08T19:24:57.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.235+0000 7f338ae1b700 1 -- 172.21.15.149:0/4254102967 shutdown_connections 2023-11-08T19:24:57.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.235+0000 7f338ae1b700 1 --2- 172.21.15.149:0/4254102967 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f336806af00 0x7f336806d3c0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:57.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.235+0000 7f338ae1b700 1 --2- 172.21.15.149:0/4254102967 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3384161050 0x7f33841f04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:57.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.235+0000 7f338ae1b700 1 --2- 172.21.15.149:0/4254102967 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33840b4640 0x7f3384156b80 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:57.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.235+0000 7f338ae1b700 1 --2- 172.21.15.149:0/4254102967 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f33840d1d40 0x7f33841570c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:57.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.235+0000 7f338ae1b700 1 -- 172.21.15.149:0/4254102967 >> 172.21.15.149:0/4254102967 conn(0x7f338409cb70 msgr2=0x7f33840d0030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:57.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.235+0000 7f338ae1b700 1 -- 172.21.15.149:0/4254102967 shutdown_connections 2023-11-08T19:24:57.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.235+0000 7f338ae1b700 1 -- 172.21.15.149:0/4254102967 wait complete. 2023-11-08T19:24:57.242 INFO:teuthology.orchestra.run.smithi149.stderr:dumped all 2023-11-08T19:24:57.248 INFO:teuthology.orchestra.run.smithi149.stdout:{"pg_ready":true,"pg_map":{"version":108,"stamp":"2023-11-08T19:24:56.010182+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590458,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":175,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":154,"acting":154,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":76,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222188,"kb_used_data":6012,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752532,"statfs":{"total":773094113280,"available":772866592768,"internally_reserved":0,"allocated":6156288,"data_stored":3405037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":90,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.678875"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353924+0000","last_change":"2023-11-08T19:24:52.381786+0000","last_active":"2023-11-08T19:24:53.353924+0000","last_peered":"2023-11-08T19:24:53.353924+0000","last_clean":"2023-11-08T19:24:53.353924+0000","last_became_active":"2023-11-08T19:24:52.381496+0000","last_became_peered":"2023-11-08T19:24:52.381496+0000","last_unstale":"2023-11-08T19:24:53.353924+0000","last_undegraded":"2023-11-08T19:24:53.353924+0000","last_fullsized":"2023-11-08T19:24:53.353924+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:28:32.868165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353027+0000","last_change":"2023-11-08T19:24:52.376347+0000","last_active":"2023-11-08T19:24:53.353027+0000","last_peered":"2023-11-08T19:24:53.353027+0000","last_clean":"2023-11-08T19:24:53.353027+0000","last_became_active":"2023-11-08T19:24:52.375849+0000","last_became_peered":"2023-11-08T19:24:52.375849+0000","last_unstale":"2023-11-08T19:24:53.353027+0000","last_undegraded":"2023-11-08T19:24:53.353027+0000","last_fullsized":"2023-11-08T19:24:53.353027+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:31:56.573763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353154+0000","last_change":"2023-11-08T19:24:52.378669+0000","last_active":"2023-11-08T19:24:53.353154+0000","last_peered":"2023-11-08T19:24:53.353154+0000","last_clean":"2023-11-08T19:24:53.353154+0000","last_became_active":"2023-11-08T19:24:52.378389+0000","last_became_peered":"2023-11-08T19:24:52.378389+0000","last_unstale":"2023-11-08T19:24:53.353154+0000","last_undegraded":"2023-11-08T19:24:53.353154+0000","last_fullsized":"2023-11-08T19:24:53.353154+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:46:31.594290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353446+0000","last_change":"2023-11-08T19:24:52.381743+0000","last_active":"2023-11-08T19:24:53.353446+0000","last_peered":"2023-11-08T19:24:53.353446+0000","last_clean":"2023-11-08T19:24:53.353446+0000","last_became_active":"2023-11-08T19:24:52.381427+0000","last_became_peered":"2023-11-08T19:24:52.381427+0000","last_unstale":"2023-11-08T19:24:53.353446+0000","last_undegraded":"2023-11-08T19:24:53.353446+0000","last_fullsized":"2023-11-08T19:24:53.353446+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:46:51.125293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353428+0000","last_change":"2023-11-08T19:24:52.375322+0000","last_active":"2023-11-08T19:24:53.353428+0000","last_peered":"2023-11-08T19:24:53.353428+0000","last_clean":"2023-11-08T19:24:53.353428+0000","last_became_active":"2023-11-08T19:24:52.375013+0000","last_became_peered":"2023-11-08T19:24:52.375013+0000","last_unstale":"2023-11-08T19:24:53.353428+0000","last_undegraded":"2023-11-08T19:24:53.353428+0000","last_fullsized":"2023-11-08T19:24:53.353428+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:14:05.670963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.352833+0000","last_change":"2023-11-08T19:24:52.378669+0000","last_active":"2023-11-08T19:24:53.352833+0000","last_peered":"2023-11-08T19:24:53.352833+0000","last_clean":"2023-11-08T19:24:53.352833+0000","last_became_active":"2023-11-08T19:24:52.378393+0000","last_became_peered":"2023-11-08T19:24:52.378393+0000","last_unstale":"2023-11-08T19:24:53.352833+0000","last_undegraded":"2023-11-08T19:24:53.352833+0000","last_fullsized":"2023-11-08T19:24:53.352833+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:26:04.745188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.332581+0000","last_change":"2023-11-08T19:24:50.332581+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.332581+0000","last_undegraded":"2023-11-08T19:24:50.332581+0000","last_fullsized":"2023-11-08T19:24:50.332581+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:47.763090+0000","last_change":"2023-11-08T19:24:32.263958+0000","last_active":"2023-11-08T19:24:47.763090+0000","last_peered":"2023-11-08T19:24:47.763090+0000","last_clean":"2023-11-08T19:24:47.763090+0000","last_became_active":"2023-11-08T19:24:31.149011+0000","last_became_peered":"2023-11-08T19:24:31.149011+0000","last_unstale":"2023-11-08T19:24:47.763090+0000","last_undegraded":"2023-11-08T19:24:47.763090+0000","last_fullsized":"2023-11-08T19:24:47.763090+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:09:04.880374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033496900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.338177+0000","last_change":"2023-11-08T19:24:50.338177+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.338177+0000","last_undegraded":"2023-11-08T19:24:50.338177+0000","last_fullsized":"2023-11-08T19:24:50.338177+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:47.686281+0000","last_change":"2023-11-08T19:24:32.142892+0000","last_active":"2023-11-08T19:24:47.686281+0000","last_peered":"2023-11-08T19:24:47.686281+0000","last_clean":"2023-11-08T19:24:47.686281+0000","last_became_active":"2023-11-08T19:24:31.144912+0000","last_became_peered":"2023-11-08T19:24:31.144912+0000","last_unstale":"2023-11-08T19:24:47.686281+0000","last_undegraded":"2023-11-08T19:24:47.686281+0000","last_fullsized":"2023-11-08T19:24:47.686281+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:04:21.151484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056686900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353024+0000","last_change":"2023-11-08T19:24:52.381898+0000","last_active":"2023-11-08T19:24:53.353024+0000","last_peered":"2023-11-08T19:24:53.353024+0000","last_clean":"2023-11-08T19:24:53.353024+0000","last_became_active":"2023-11-08T19:24:52.381474+0000","last_became_peered":"2023-11-08T19:24:52.381474+0000","last_unstale":"2023-11-08T19:24:53.353024+0000","last_undegraded":"2023-11-08T19:24:53.353024+0000","last_fullsized":"2023-11-08T19:24:53.353024+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:45:51.213375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"54'8","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353655+0000","last_change":"2023-11-08T19:24:51.353683+0000","last_active":"2023-11-08T19:24:53.353655+0000","last_peered":"2023-11-08T19:24:53.353655+0000","last_clean":"2023-11-08T19:24:53.353655+0000","last_became_active":"2023-11-08T19:24:51.353201+0000","last_became_peered":"2023-11-08T19:24:51.353201+0000","last_unstale":"2023-11-08T19:24:53.353655+0000","last_undegraded":"2023-11-08T19:24:53.353655+0000","last_fullsized":"2023-11-08T19:24:53.353655+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:53:41.466355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":25,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:47.684477+0000","last_change":"2023-11-08T19:24:32.140514+0000","last_active":"2023-11-08T19:24:47.684477+0000","last_peered":"2023-11-08T19:24:47.684477+0000","last_clean":"2023-11-08T19:24:47.684477+0000","last_became_active":"2023-11-08T19:24:31.146668+0000","last_became_peered":"2023-11-08T19:24:31.146668+0000","last_unstale":"2023-11-08T19:24:47.684477+0000","last_undegraded":"2023-11-08T19:24:47.684477+0000","last_fullsized":"2023-11-08T19:24:47.684477+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:31:24.539374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071576699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.337661+0000","last_change":"2023-11-08T19:24:50.337661+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.337661+0000","last_undegraded":"2023-11-08T19:24:50.337661+0000","last_fullsized":"2023-11-08T19:24:50.337661+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:47.763081+0000","last_change":"2023-11-08T19:24:32.263963+0000","last_active":"2023-11-08T19:24:47.763081+0000","last_peered":"2023-11-08T19:24:47.763081+0000","last_clean":"2023-11-08T19:24:47.763081+0000","last_became_active":"2023-11-08T19:24:31.139062+0000","last_became_peered":"2023-11-08T19:24:31.139062+0000","last_unstale":"2023-11-08T19:24:47.763081+0000","last_undegraded":"2023-11-08T19:24:47.763081+0000","last_fullsized":"2023-11-08T19:24:47.763081+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:26.080042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033682599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353734+0000","last_change":"2023-11-08T19:24:52.376929+0000","last_active":"2023-11-08T19:24:53.353734+0000","last_peered":"2023-11-08T19:24:53.353734+0000","last_clean":"2023-11-08T19:24:53.353734+0000","last_became_active":"2023-11-08T19:24:52.376602+0000","last_became_peered":"2023-11-08T19:24:52.376602+0000","last_unstale":"2023-11-08T19:24:53.353734+0000","last_undegraded":"2023-11-08T19:24:53.353734+0000","last_fullsized":"2023-11-08T19:24:53.353734+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:14:34.758666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.337528+0000","last_change":"2023-11-08T19:24:50.337528+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.337528+0000","last_undegraded":"2023-11-08T19:24:50.337528+0000","last_fullsized":"2023-11-08T19:24:50.337528+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":25,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:47.684886+0000","last_change":"2023-11-08T19:24:32.141131+0000","last_active":"2023-11-08T19:24:47.684886+0000","last_peered":"2023-11-08T19:24:47.684886+0000","last_clean":"2023-11-08T19:24:47.684886+0000","last_became_active":"2023-11-08T19:24:31.146154+0000","last_became_peered":"2023-11-08T19:24:31.146154+0000","last_unstale":"2023-11-08T19:24:47.684886+0000","last_undegraded":"2023-11-08T19:24:47.684886+0000","last_fullsized":"2023-11-08T19:24:47.684886+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:18:40.271560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082432800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353882+0000","last_change":"2023-11-08T19:24:51.355043+0000","last_active":"2023-11-08T19:24:53.353882+0000","last_peered":"2023-11-08T19:24:53.353882+0000","last_clean":"2023-11-08T19:24:53.353882+0000","last_became_active":"2023-11-08T19:24:51.354777+0000","last_became_peered":"2023-11-08T19:24:51.354777+0000","last_unstale":"2023-11-08T19:24:53.353882+0000","last_undegraded":"2023-11-08T19:24:53.353882+0000","last_fullsized":"2023-11-08T19:24:53.353882+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:04:50.527868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:48.243070+0000","last_change":"2023-11-08T19:24:32.529486+0000","last_active":"2023-11-08T19:24:48.243070+0000","last_peered":"2023-11-08T19:24:48.243070+0000","last_clean":"2023-11-08T19:24:48.243070+0000","last_became_active":"2023-11-08T19:24:31.146260+0000","last_became_peered":"2023-11-08T19:24:31.146260+0000","last_unstale":"2023-11-08T19:24:48.243070+0000","last_undegraded":"2023-11-08T19:24:48.243070+0000","last_fullsized":"2023-11-08T19:24:48.243070+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:45:34.425432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059842900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353445+0000","last_change":"2023-11-08T19:24:52.375932+0000","last_active":"2023-11-08T19:24:53.353445+0000","last_peered":"2023-11-08T19:24:53.353445+0000","last_clean":"2023-11-08T19:24:53.353445+0000","last_became_active":"2023-11-08T19:24:52.375648+0000","last_became_peered":"2023-11-08T19:24:52.375648+0000","last_unstale":"2023-11-08T19:24:53.353445+0000","last_undegraded":"2023-11-08T19:24:53.353445+0000","last_fullsized":"2023-11-08T19:24:53.353445+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:26:22.628067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.332956+0000","last_change":"2023-11-08T19:24:50.332956+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.332956+0000","last_undegraded":"2023-11-08T19:24:50.332956+0000","last_fullsized":"2023-11-08T19:24:50.332956+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:48.243358+0000","last_change":"2023-11-08T19:24:32.530168+0000","last_active":"2023-11-08T19:24:48.243358+0000","last_peered":"2023-11-08T19:24:48.243358+0000","last_clean":"2023-11-08T19:24:48.243358+0000","last_became_active":"2023-11-08T19:24:31.144329+0000","last_became_peered":"2023-11-08T19:24:31.144329+0000","last_unstale":"2023-11-08T19:24:48.243358+0000","last_undegraded":"2023-11-08T19:24:48.243358+0000","last_fullsized":"2023-11-08T19:24:48.243358+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:05:36.085920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043484799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"54'3","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353873+0000","last_change":"2023-11-08T19:24:51.352040+0000","last_active":"2023-11-08T19:24:53.353873+0000","last_peered":"2023-11-08T19:24:53.353873+0000","last_clean":"2023-11-08T19:24:53.353873+0000","last_became_active":"2023-11-08T19:24:51.351762+0000","last_became_peered":"2023-11-08T19:24:51.351762+0000","last_unstale":"2023-11-08T19:24:53.353873+0000","last_undegraded":"2023-11-08T19:24:53.353873+0000","last_fullsized":"2023-11-08T19:24:53.353873+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:04:59.430912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":26,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:47.684819+0000","last_change":"2023-11-08T19:24:32.141190+0000","last_active":"2023-11-08T19:24:47.684819+0000","last_peered":"2023-11-08T19:24:47.684819+0000","last_clean":"2023-11-08T19:24:47.684819+0000","last_became_active":"2023-11-08T19:24:31.147651+0000","last_became_peered":"2023-11-08T19:24:31.147651+0000","last_unstale":"2023-11-08T19:24:47.684819+0000","last_undegraded":"2023-11-08T19:24:47.684819+0000","last_fullsized":"2023-11-08T19:24:47.684819+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:21:55.985548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043673300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.338584+0000","last_change":"2023-11-08T19:24:50.338584+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.338584+0000","last_undegraded":"2023-11-08T19:24:50.338584+0000","last_fullsized":"2023-11-08T19:24:50.338584+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":27,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.368381+0000","last_change":"2023-11-08T19:24:32.147011+0000","last_active":"2023-11-08T19:24:52.368381+0000","last_peered":"2023-11-08T19:24:52.368381+0000","last_clean":"2023-11-08T19:24:52.368381+0000","last_became_active":"2023-11-08T19:24:31.148250+0000","last_became_peered":"2023-11-08T19:24:31.148250+0000","last_unstale":"2023-11-08T19:24:52.368381+0000","last_undegraded":"2023-11-08T19:24:52.368381+0000","last_fullsized":"2023-11-08T19:24:52.368381+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:01:25.647952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043061299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.332279+0000","last_change":"2023-11-08T19:24:50.332279+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.332279+0000","last_undegraded":"2023-11-08T19:24:50.332279+0000","last_fullsized":"2023-11-08T19:24:50.332279+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:48.243314+0000","last_change":"2023-11-08T19:24:32.543880+0000","last_active":"2023-11-08T19:24:48.243314+0000","last_peered":"2023-11-08T19:24:48.243314+0000","last_clean":"2023-11-08T19:24:48.243314+0000","last_became_active":"2023-11-08T19:24:31.142052+0000","last_became_peered":"2023-11-08T19:24:31.142052+0000","last_unstale":"2023-11-08T19:24:48.243314+0000","last_undegraded":"2023-11-08T19:24:48.243314+0000","last_fullsized":"2023-11-08T19:24:48.243314+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:18:42.371676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014881058000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.332251+0000","last_change":"2023-11-08T19:24:50.332251+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.332251+0000","last_undegraded":"2023-11-08T19:24:50.332251+0000","last_fullsized":"2023-11-08T19:24:50.332251+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":27,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.365352+0000","last_change":"2023-11-08T19:24:32.147235+0000","last_active":"2023-11-08T19:24:52.365352+0000","last_peered":"2023-11-08T19:24:52.365352+0000","last_clean":"2023-11-08T19:24:52.365352+0000","last_became_active":"2023-11-08T19:24:31.146176+0000","last_became_peered":"2023-11-08T19:24:31.146176+0000","last_unstale":"2023-11-08T19:24:52.365352+0000","last_undegraded":"2023-11-08T19:24:52.365352+0000","last_fullsized":"2023-11-08T19:24:52.365352+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:39.214888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048481000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.338195+0000","last_change":"2023-11-08T19:24:50.338195+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.338195+0000","last_undegraded":"2023-11-08T19:24:50.338195+0000","last_fullsized":"2023-11-08T19:24:50.338195+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":26,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:47.684720+0000","last_change":"2023-11-08T19:24:32.142376+0000","last_active":"2023-11-08T19:24:47.684720+0000","last_peered":"2023-11-08T19:24:47.684720+0000","last_clean":"2023-11-08T19:24:47.684720+0000","last_became_active":"2023-11-08T19:24:31.144614+0000","last_became_peered":"2023-11-08T19:24:31.144614+0000","last_unstale":"2023-11-08T19:24:47.684720+0000","last_undegraded":"2023-11-08T19:24:47.684720+0000","last_fullsized":"2023-11-08T19:24:47.684720+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:09:04.880374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050362200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.339757+0000","last_change":"2023-11-08T19:24:50.339757+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.339757+0000","last_undegraded":"2023-11-08T19:24:50.339757+0000","last_fullsized":"2023-11-08T19:24:50.339757+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":27,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.365437+0000","last_change":"2023-11-08T19:24:32.146639+0000","last_active":"2023-11-08T19:24:52.365437+0000","last_peered":"2023-11-08T19:24:52.365437+0000","last_clean":"2023-11-08T19:24:52.365437+0000","last_became_active":"2023-11-08T19:24:31.147384+0000","last_became_peered":"2023-11-08T19:24:31.147384+0000","last_unstale":"2023-11-08T19:24:52.365437+0000","last_undegraded":"2023-11-08T19:24:52.365437+0000","last_fullsized":"2023-11-08T19:24:52.365437+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:30:21.946303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043834899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.338705+0000","last_change":"2023-11-08T19:24:50.338705+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.338705+0000","last_undegraded":"2023-11-08T19:24:50.338705+0000","last_fullsized":"2023-11-08T19:24:50.338705+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:48.242909+0000","last_change":"2023-11-08T19:24:32.544108+0000","last_active":"2023-11-08T19:24:48.242909+0000","last_peered":"2023-11-08T19:24:48.242909+0000","last_clean":"2023-11-08T19:24:48.242909+0000","last_became_active":"2023-11-08T19:24:31.143812+0000","last_became_peered":"2023-11-08T19:24:31.143812+0000","last_unstale":"2023-11-08T19:24:48.242909+0000","last_undegraded":"2023-11-08T19:24:48.242909+0000","last_fullsized":"2023-11-08T19:24:48.242909+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:27:59.135977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014956126,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.338406+0000","last_change":"2023-11-08T19:24:50.338406+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.338406+0000","last_undegraded":"2023-11-08T19:24:50.338406+0000","last_fullsized":"2023-11-08T19:24:50.338406+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:48.243404+0000","last_change":"2023-11-08T19:24:32.530378+0000","last_active":"2023-11-08T19:24:48.243404+0000","last_peered":"2023-11-08T19:24:48.243404+0000","last_clean":"2023-11-08T19:24:48.243404+0000","last_became_active":"2023-11-08T19:24:31.144341+0000","last_became_peered":"2023-11-08T19:24:31.144341+0000","last_unstale":"2023-11-08T19:24:48.243404+0000","last_undegraded":"2023-11-08T19:24:48.243404+0000","last_fullsized":"2023-11-08T19:24:48.243404+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:30:21.946303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058308299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.338593+0000","last_change":"2023-11-08T19:24:50.338593+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.338593+0000","last_undegraded":"2023-11-08T19:24:50.338593+0000","last_fullsized":"2023-11-08T19:24:50.338593+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":25,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:47.684544+0000","last_change":"2023-11-08T19:24:32.140832+0000","last_active":"2023-11-08T19:24:47.684544+0000","last_peered":"2023-11-08T19:24:47.684544+0000","last_clean":"2023-11-08T19:24:47.684544+0000","last_became_active":"2023-11-08T19:24:31.146557+0000","last_became_peered":"2023-11-08T19:24:31.146557+0000","last_unstale":"2023-11-08T19:24:47.684544+0000","last_undegraded":"2023-11-08T19:24:47.684544+0000","last_fullsized":"2023-11-08T19:24:47.684544+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:40:04.258107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099450100000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.352995+0000","last_change":"2023-11-08T19:24:52.381859+0000","last_active":"2023-11-08T19:24:53.352995+0000","last_peered":"2023-11-08T19:24:53.352995+0000","last_clean":"2023-11-08T19:24:53.352995+0000","last_became_active":"2023-11-08T19:24:52.381568+0000","last_became_peered":"2023-11-08T19:24:52.381568+0000","last_unstale":"2023-11-08T19:24:53.352995+0000","last_undegraded":"2023-11-08T19:24:53.352995+0000","last_fullsized":"2023-11-08T19:24:53.352995+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:09:36.064066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.332231+0000","last_change":"2023-11-08T19:24:50.332231+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.332231+0000","last_undegraded":"2023-11-08T19:24:50.332231+0000","last_fullsized":"2023-11-08T19:24:50.332231+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":25,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:47.684627+0000","last_change":"2023-11-08T19:24:32.141188+0000","last_active":"2023-11-08T19:24:47.684627+0000","last_peered":"2023-11-08T19:24:47.684627+0000","last_clean":"2023-11-08T19:24:47.684627+0000","last_became_active":"2023-11-08T19:24:31.148857+0000","last_became_peered":"2023-11-08T19:24:31.148857+0000","last_unstale":"2023-11-08T19:24:47.684627+0000","last_undegraded":"2023-11-08T19:24:47.684627+0000","last_fullsized":"2023-11-08T19:24:47.684627+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:45:34.425432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065078599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.338891+0000","last_change":"2023-11-08T19:24:50.338891+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.338891+0000","last_undegraded":"2023-11-08T19:24:50.338891+0000","last_fullsized":"2023-11-08T19:24:50.338891+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":25,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:47.684535+0000","last_change":"2023-11-08T19:24:32.140167+0000","last_active":"2023-11-08T19:24:47.684535+0000","last_peered":"2023-11-08T19:24:47.684535+0000","last_clean":"2023-11-08T19:24:47.684535+0000","last_became_active":"2023-11-08T19:24:31.147181+0000","last_became_peered":"2023-11-08T19:24:31.147181+0000","last_unstale":"2023-11-08T19:24:47.684535+0000","last_undegraded":"2023-11-08T19:24:47.684535+0000","last_fullsized":"2023-11-08T19:24:47.684535+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:26.080042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057135200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.337482+0000","last_change":"2023-11-08T19:24:50.337482+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.337482+0000","last_undegraded":"2023-11-08T19:24:50.337482+0000","last_fullsized":"2023-11-08T19:24:50.337482+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:48.243376+0000","last_change":"2023-11-08T19:24:32.530895+0000","last_active":"2023-11-08T19:24:48.243376+0000","last_peered":"2023-11-08T19:24:48.243376+0000","last_clean":"2023-11-08T19:24:48.243376+0000","last_became_active":"2023-11-08T19:24:31.146715+0000","last_became_peered":"2023-11-08T19:24:31.146715+0000","last_unstale":"2023-11-08T19:24:48.243376+0000","last_undegraded":"2023-11-08T19:24:48.243376+0000","last_fullsized":"2023-11-08T19:24:48.243376+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:39.214888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081671599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.337708+0000","last_change":"2023-11-08T19:24:50.337708+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.337708+0000","last_undegraded":"2023-11-08T19:24:50.337708+0000","last_fullsized":"2023-11-08T19:24:50.337708+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:48.243019+0000","last_change":"2023-11-08T19:24:32.333430+0000","last_active":"2023-11-08T19:24:48.243019+0000","last_peered":"2023-11-08T19:24:48.243019+0000","last_clean":"2023-11-08T19:24:48.243019+0000","last_became_active":"2023-11-08T19:24:31.141710+0000","last_became_peered":"2023-11-08T19:24:31.141710+0000","last_unstale":"2023-11-08T19:24:48.243019+0000","last_undegraded":"2023-11-08T19:24:48.243019+0000","last_fullsized":"2023-11-08T19:24:48.243019+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:32:51.214551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000430438,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.337614+0000","last_change":"2023-11-08T19:24:50.337614+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.337614+0000","last_undegraded":"2023-11-08T19:24:50.337614+0000","last_fullsized":"2023-11-08T19:24:50.337614+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:48.243160+0000","last_change":"2023-11-08T19:24:32.530333+0000","last_active":"2023-11-08T19:24:48.243160+0000","last_peered":"2023-11-08T19:24:48.243160+0000","last_clean":"2023-11-08T19:24:48.243160+0000","last_became_active":"2023-11-08T19:24:31.144838+0000","last_became_peered":"2023-11-08T19:24:31.144838+0000","last_unstale":"2023-11-08T19:24:48.243160+0000","last_undegraded":"2023-11-08T19:24:48.243160+0000","last_fullsized":"2023-11-08T19:24:48.243160+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:39:48.473183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081588799999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.339355+0000","last_change":"2023-11-08T19:24:50.339355+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.339355+0000","last_undegraded":"2023-11-08T19:24:50.339355+0000","last_fullsized":"2023-11-08T19:24:50.339355+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:48.243051+0000","last_change":"2023-11-08T19:24:32.333096+0000","last_active":"2023-11-08T19:24:48.243051+0000","last_peered":"2023-11-08T19:24:48.243051+0000","last_clean":"2023-11-08T19:24:48.243051+0000","last_became_active":"2023-11-08T19:24:31.142985+0000","last_became_peered":"2023-11-08T19:24:31.142985+0000","last_unstale":"2023-11-08T19:24:48.243051+0000","last_undegraded":"2023-11-08T19:24:48.243051+0000","last_fullsized":"2023-11-08T19:24:48.243051+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:36:33.274496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000386048,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.337563+0000","last_change":"2023-11-08T19:24:50.337563+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.337563+0000","last_undegraded":"2023-11-08T19:24:50.337563+0000","last_fullsized":"2023-11-08T19:24:50.337563+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:47.763042+0000","last_change":"2023-11-08T19:24:32.263810+0000","last_active":"2023-11-08T19:24:47.763042+0000","last_peered":"2023-11-08T19:24:47.763042+0000","last_clean":"2023-11-08T19:24:47.763042+0000","last_became_active":"2023-11-08T19:24:31.138814+0000","last_became_peered":"2023-11-08T19:24:31.138814+0000","last_unstale":"2023-11-08T19:24:47.763042+0000","last_undegraded":"2023-11-08T19:24:47.763042+0000","last_fullsized":"2023-11-08T19:24:47.763042+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:21:55.985548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048136000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.332121+0000","last_change":"2023-11-08T19:24:50.332121+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.332121+0000","last_undegraded":"2023-11-08T19:24:50.332121+0000","last_fullsized":"2023-11-08T19:24:50.332121+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:48.243150+0000","last_change":"2023-11-08T19:24:32.544063+0000","last_active":"2023-11-08T19:24:48.243150+0000","last_peered":"2023-11-08T19:24:48.243150+0000","last_clean":"2023-11-08T19:24:48.243150+0000","last_became_active":"2023-11-08T19:24:31.144795+0000","last_became_peered":"2023-11-08T19:24:31.144795+0000","last_unstale":"2023-11-08T19:24:48.243150+0000","last_undegraded":"2023-11-08T19:24:48.243150+0000","last_fullsized":"2023-11-08T19:24:48.243150+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:12:42.248307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01495431,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.337839+0000","last_change":"2023-11-08T19:24:50.337839+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.337839+0000","last_undegraded":"2023-11-08T19:24:50.337839+0000","last_fullsized":"2023-11-08T19:24:50.337839+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":27,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.368461+0000","last_change":"2023-11-08T19:24:32.147025+0000","last_active":"2023-11-08T19:24:52.368461+0000","last_peered":"2023-11-08T19:24:52.368461+0000","last_clean":"2023-11-08T19:24:52.368461+0000","last_became_active":"2023-11-08T19:24:31.147082+0000","last_became_peered":"2023-11-08T19:24:31.147082+0000","last_unstale":"2023-11-08T19:24:52.368461+0000","last_undegraded":"2023-11-08T19:24:52.368461+0000","last_fullsized":"2023-11-08T19:24:52.368461+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:02:27.987795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043701599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.337797+0000","last_change":"2023-11-08T19:24:50.337797+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.337797+0000","last_undegraded":"2023-11-08T19:24:50.337797+0000","last_fullsized":"2023-11-08T19:24:50.337797+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:48.243308+0000","last_change":"2023-11-08T19:24:32.530620+0000","last_active":"2023-11-08T19:24:48.243308+0000","last_peered":"2023-11-08T19:24:48.243308+0000","last_clean":"2023-11-08T19:24:48.243308+0000","last_became_active":"2023-11-08T19:24:31.144223+0000","last_became_peered":"2023-11-08T19:24:31.144223+0000","last_unstale":"2023-11-08T19:24:48.243308+0000","last_undegraded":"2023-11-08T19:24:48.243308+0000","last_fullsized":"2023-11-08T19:24:48.243308+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:01:25.647952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071879799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.337556+0000","last_change":"2023-11-08T19:24:50.337556+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.337556+0000","last_undegraded":"2023-11-08T19:24:50.337556+0000","last_fullsized":"2023-11-08T19:24:50.337556+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":25,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:47.684671+0000","last_change":"2023-11-08T19:24:32.140880+0000","last_active":"2023-11-08T19:24:47.684671+0000","last_peered":"2023-11-08T19:24:47.684671+0000","last_clean":"2023-11-08T19:24:47.684671+0000","last_became_active":"2023-11-08T19:24:31.146063+0000","last_became_peered":"2023-11-08T19:24:31.146063+0000","last_unstale":"2023-11-08T19:24:47.684671+0000","last_undegraded":"2023-11-08T19:24:47.684671+0000","last_fullsized":"2023-11-08T19:24:47.684671+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:54:08.985813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089896300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.338456+0000","last_change":"2023-11-08T19:24:50.338456+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.338456+0000","last_undegraded":"2023-11-08T19:24:50.338456+0000","last_fullsized":"2023-11-08T19:24:50.338456+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":26,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:47.684560+0000","last_change":"2023-11-08T19:24:32.139885+0000","last_active":"2023-11-08T19:24:47.684560+0000","last_peered":"2023-11-08T19:24:47.684560+0000","last_clean":"2023-11-08T19:24:47.684560+0000","last_became_active":"2023-11-08T19:24:31.145329+0000","last_became_peered":"2023-11-08T19:24:31.145329+0000","last_unstale":"2023-11-08T19:24:47.684560+0000","last_undegraded":"2023-11-08T19:24:47.684560+0000","last_fullsized":"2023-11-08T19:24:47.684560+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:25:18.356784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049012999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353207+0000","last_change":"2023-11-08T19:24:52.375489+0000","last_active":"2023-11-08T19:24:53.353207+0000","last_peered":"2023-11-08T19:24:53.353207+0000","last_clean":"2023-11-08T19:24:53.353207+0000","last_became_active":"2023-11-08T19:24:52.375203+0000","last_became_peered":"2023-11-08T19:24:52.375203+0000","last_unstale":"2023-11-08T19:24:53.353207+0000","last_undegraded":"2023-11-08T19:24:53.353207+0000","last_fullsized":"2023-11-08T19:24:53.353207+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:23:49.083463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.337604+0000","last_change":"2023-11-08T19:24:50.337604+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.337604+0000","last_undegraded":"2023-11-08T19:24:50.337604+0000","last_fullsized":"2023-11-08T19:24:50.337604+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:47.686283+0000","last_change":"2023-11-08T19:24:32.142836+0000","last_active":"2023-11-08T19:24:47.686283+0000","last_peered":"2023-11-08T19:24:47.686283+0000","last_clean":"2023-11-08T19:24:47.686283+0000","last_became_active":"2023-11-08T19:24:31.141367+0000","last_became_peered":"2023-11-08T19:24:31.141367+0000","last_unstale":"2023-11-08T19:24:47.686283+0000","last_undegraded":"2023-11-08T19:24:47.686283+0000","last_fullsized":"2023-11-08T19:24:47.686283+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:39.214888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001335136,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353587+0000","last_change":"2023-11-08T19:24:52.377063+0000","last_active":"2023-11-08T19:24:53.353587+0000","last_peered":"2023-11-08T19:24:53.353587+0000","last_clean":"2023-11-08T19:24:53.353587+0000","last_became_active":"2023-11-08T19:24:52.376791+0000","last_became_peered":"2023-11-08T19:24:52.376791+0000","last_unstale":"2023-11-08T19:24:53.353587+0000","last_undegraded":"2023-11-08T19:24:53.353587+0000","last_fullsized":"2023-11-08T19:24:53.353587+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:08:17.924911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.337932+0000","last_change":"2023-11-08T19:24:50.337932+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.337932+0000","last_undegraded":"2023-11-08T19:24:50.337932+0000","last_fullsized":"2023-11-08T19:24:50.337932+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:48.243004+0000","last_change":"2023-11-08T19:24:32.544285+0000","last_active":"2023-11-08T19:24:48.243004+0000","last_peered":"2023-11-08T19:24:48.243004+0000","last_clean":"2023-11-08T19:24:48.243004+0000","last_became_active":"2023-11-08T19:24:31.142028+0000","last_became_peered":"2023-11-08T19:24:31.142028+0000","last_unstale":"2023-11-08T19:24:48.243004+0000","last_undegraded":"2023-11-08T19:24:48.243004+0000","last_fullsized":"2023-11-08T19:24:48.243004+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:01:24.198196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067537399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.337660+0000","last_change":"2023-11-08T19:24:50.337660+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.337660+0000","last_undegraded":"2023-11-08T19:24:50.337660+0000","last_fullsized":"2023-11-08T19:24:50.337660+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:48.243228+0000","last_change":"2023-11-08T19:24:32.544333+0000","last_active":"2023-11-08T19:24:48.243228+0000","last_peered":"2023-11-08T19:24:48.243228+0000","last_clean":"2023-11-08T19:24:48.243228+0000","last_became_active":"2023-11-08T19:24:31.138598+0000","last_became_peered":"2023-11-08T19:24:31.138598+0000","last_unstale":"2023-11-08T19:24:48.243228+0000","last_undegraded":"2023-11-08T19:24:48.243228+0000","last_fullsized":"2023-11-08T19:24:48.243228+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:11.860580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015114824000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:24:51.328652+0000","last_change":"2023-11-08T19:24:51.328652+0000","last_active":"2023-11-08T19:24:51.328652+0000","last_peered":"2023-11-08T19:24:51.328652+0000","last_clean":"2023-11-08T19:24:51.328652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:51.328652+0000","last_undegraded":"2023-11-08T19:24:51.328652+0000","last_fullsized":"2023-11-08T19:24:51.328652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-11-08T19:24:50.332254+0000","last_change":"2023-11-08T19:24:50.332254+0000","last_active":"2023-11-08T19:24:50.322101+0000","last_peered":"2023-11-08T19:24:50.322101+0000","last_clean":"2023-11-08T19:24:50.322101+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:24:50.332254+0000","last_undegraded":"2023-11-08T19:24:50.332254+0000","last_fullsized":"2023-11-08T19:24:50.332254+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-08T19:24:48.243494+0000","last_change":"2023-11-08T19:24:32.530665+0000","last_active":"2023-11-08T19:24:48.243494+0000","last_peered":"2023-11-08T19:24:48.243494+0000","last_clean":"2023-11-08T19:24:48.243494+0000","last_became_active":"2023-11-08T19:24:31.148363+0000","last_became_peered":"2023-11-08T19:24:31.148363+0000","last_unstale":"2023-11-08T19:24:48.243494+0000","last_undegraded":"2023-11-08T19:24:48.243494+0000","last_fullsized":"2023-11-08T19:24:48.243494+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:02:27.987795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075444200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":194,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.364492+0000","last_change":"2023-11-08T19:22:58.054283+0000","last_active":"2023-11-08T19:24:52.364492+0000","last_peered":"2023-11-08T19:24:52.364492+0000","last_clean":"2023-11-08T19:24:52.364492+0000","last_became_active":"2023-11-08T19:22:58.053337+0000","last_became_peered":"2023-11-08T19:22:58.053337+0000","last_unstale":"2023-11-08T19:24:52.364492+0000","last_undegraded":"2023-11-08T19:24:52.364492+0000","last_fullsized":"2023-11-08T19:24:52.364492+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:22:56.479654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:22:56.479654+0000","last_clean_scrub_stamp":"2023-11-08T19:22:56.479654+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:16:05.317001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":1},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":90,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28252,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343588,"statfs":{"total":96636764160,"available":96607834112,"internally_reserved":0,"allocated":1257472,"data_stored":888859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.56699999999999995}]},{"osd":1,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.505}]},{"osd":2,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.59399999999999997}]},{"osd":3,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.68500000000000005}]},{"osd":4,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.54900000000000004}]},{"osd":5,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.66400000000000003}]},{"osd":6,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.63300000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":618496,"data_stored":276970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.499},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.51800000000000002}]},{"osd":1,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.66300000000000003}]},{"osd":2,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.55800000000000005}]},{"osd":3,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":0.53900000000000003}]},{"osd":4,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.57199999999999995}]},{"osd":5,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.64800000000000002}]},{"osd":7,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.63200000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27612,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":606208,"data_stored":270480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":2.1850000000000001,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":0.5}]},{"osd":2,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.37}]},{"osd":3,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":2.2120000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.441}]},{"osd":4,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.80600000000000005}]},{"osd":5,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.71099999999999997}]},{"osd":6,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":2.093,"5min":2.093,"15min":2.093},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.745}]},{"osd":7,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":2.1299999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.57699999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28204,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343636,"statfs":{"total":96636764160,"available":96607883264,"internally_reserved":0,"allocated":1212416,"data_stored":867338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":19.295999999999999,"5min":19.295999999999999,"15min":19.295999999999999},"last":0.26500000000000001},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":17.204000000000001,"5min":17.204000000000001,"15min":17.204000000000001},"last":0.36799999999999999}]},{"osd":2,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":6.524,"5min":6.524,"15min":6.524},"last":0.35099999999999998},{"interface":"front","average":{"1min":1.169,"5min":1.169,"15min":1.169},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":17.175000000000001,"5min":17.175000000000001,"15min":17.175000000000001},"last":0.31}]},{"osd":3,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":14.324,"5min":14.324,"15min":14.324},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.38600000000000001}]},{"osd":4,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.304,"15min":1.304},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":17.056000000000001,"5min":17.056000000000001,"15min":17.056000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":5.0289999999999999,"5min":5.0289999999999999,"15min":5.0289999999999999},"last":0.60499999999999998}]},{"osd":5,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":5.0590000000000002,"5min":5.0590000000000002,"15min":5.0590000000000002},"last":0.624},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.66800000000000004}]},{"osd":6,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.752},{"interface":"front","average":{"1min":1.357,"5min":1.357,"15min":1.357},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":17.111999999999998,"5min":17.111999999999998,"15min":17.111999999999998},"last":0.59499999999999997}]},{"osd":7,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.371,"15min":1.371},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":17.146000000000001,"5min":17.146000000000001,"15min":17.146000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":4.9829999999999997,"5min":4.9829999999999997,"15min":4.9829999999999997},"last":0.65700000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":618496,"data_stored":276970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":3.4100000000000001,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":3.4369999999999998,"5min":3.4369999999999998,"15min":3.4369999999999998},"last":0.36399999999999999}]},{"osd":1,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":4.0679999999999996,"5min":4.0679999999999996,"15min":4.0679999999999996},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":4.3499999999999996,"5min":4.3499999999999996,"15min":4.3499999999999996},"last":0.59399999999999997}]},{"osd":3,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":3.8580000000000001,"5min":3.8580000000000001,"15min":3.8580000000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":3.476,"5min":3.476,"15min":3.476},"last":0.40899999999999997}]},{"osd":4,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":4.0090000000000003,"5min":4.0090000000000003,"15min":4.0090000000000003},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":4.1040000000000001,"5min":4.1040000000000001,"15min":4.1040000000000001},"last":0.47699999999999998}]},{"osd":5,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":4.0869999999999997,"5min":4.0869999999999997,"15min":4.0869999999999997},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":3.843,"5min":3.843,"15min":3.843},"last":0.438}]},{"osd":6,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":4.1399999999999997,"5min":4.1399999999999997,"15min":4.1399999999999997},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":4.0499999999999998,"5min":4.0499999999999998,"15min":4.0499999999999998},"last":0.53900000000000003}]},{"osd":7,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":4.157,"5min":4.157,"15min":4.157},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":4.1710000000000003,"5min":4.1710000000000003,"15min":4.1710000000000003},"last":0.628}]}]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27624,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344216,"statfs":{"total":96636764160,"available":96608477184,"internally_reserved":0,"allocated":618496,"data_stored":276970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.33000000000000002}]},{"osd":1,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.39000000000000001}]},{"osd":2,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.35399999999999998}]},{"osd":4,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.54000000000000004}]},{"osd":5,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.46200000000000002}]},{"osd":6,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.58299999999999996}]},{"osd":7,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.5}]}]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27612,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":606208,"data_stored":270480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":2.2090000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.46800000000000003}]},{"osd":1,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.435},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.55700000000000005}]},{"osd":2,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":2.8490000000000002,"5min":2.8490000000000002,"15min":2.8490000000000002},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.48599999999999999}]},{"osd":3,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":3.4849999999999999,"5min":3.4849999999999999,"15min":3.4849999999999999},"last":0.58199999999999996}]},{"osd":5,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.377}]},{"osd":6,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":4.1529999999999996,"5min":4.1529999999999996,"15min":4.1529999999999996},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.53500000000000003}]},{"osd":7,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.5},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":5.5359999999999996,"5min":5.5359999999999996,"15min":5.5359999999999996},"last":0.60999999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":618496,"data_stored":276970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.71999999999999997}]},{"osd":1,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":2.2919999999999998,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":0.65400000000000003}]},{"osd":2,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.55200000000000005}]},{"osd":3,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.67500000000000004}]},{"osd":4,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":2.3300000000000001,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":0.376},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.56699999999999995}]},{"osd":6,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":2.3650000000000002,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":0.44400000000000001}]},{"osd":7,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.41599999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:24:57.256 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3f is not active+clean 2023-11-08T19:24:57.256 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:24:51.328652+0000', 'last_change': '2023-11-08T19:24:51.328652+0000', 'last_active': '2023-11-08T19:24:51.328652+0000', 'last_peered': '2023-11-08T19:24:51.328652+0000', 'last_clean': '2023-11-08T19:24:51.328652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:51.328652+0000', 'last_undegraded': '2023-11-08T19:24:51.328652+0000', 'last_fullsized': '2023-11-08T19:24:51.328652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:24:57.257 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3e is not active+clean 2023-11-08T19:24:57.257 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:24:51.328652+0000', 'last_change': '2023-11-08T19:24:51.328652+0000', 'last_active': '2023-11-08T19:24:51.328652+0000', 'last_peered': '2023-11-08T19:24:51.328652+0000', 'last_clean': '2023-11-08T19:24:51.328652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:51.328652+0000', 'last_undegraded': '2023-11-08T19:24:51.328652+0000', 'last_fullsized': '2023-11-08T19:24:51.328652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:24:57.258 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3c is not active+clean 2023-11-08T19:24:57.258 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:24:51.328652+0000', 'last_change': '2023-11-08T19:24:51.328652+0000', 'last_active': '2023-11-08T19:24:51.328652+0000', 'last_peered': '2023-11-08T19:24:51.328652+0000', 'last_clean': '2023-11-08T19:24:51.328652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:51.328652+0000', 'last_undegraded': '2023-11-08T19:24:51.328652+0000', 'last_fullsized': '2023-11-08T19:24:51.328652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:24:57.259 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3b is not active+clean 2023-11-08T19:24:57.259 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:24:51.328652+0000', 'last_change': '2023-11-08T19:24:51.328652+0000', 'last_active': '2023-11-08T19:24:51.328652+0000', 'last_peered': '2023-11-08T19:24:51.328652+0000', 'last_clean': '2023-11-08T19:24:51.328652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:51.328652+0000', 'last_undegraded': '2023-11-08T19:24:51.328652+0000', 'last_fullsized': '2023-11-08T19:24:51.328652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:24:57.259 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3a is not active+clean 2023-11-08T19:24:57.260 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:24:51.328652+0000', 'last_change': '2023-11-08T19:24:51.328652+0000', 'last_active': '2023-11-08T19:24:51.328652+0000', 'last_peered': '2023-11-08T19:24:51.328652+0000', 'last_clean': '2023-11-08T19:24:51.328652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:51.328652+0000', 'last_undegraded': '2023-11-08T19:24:51.328652+0000', 'last_fullsized': '2023-11-08T19:24:51.328652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:24:57.260 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.39 is not active+clean 2023-11-08T19:24:57.260 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:24:51.328652+0000', 'last_change': '2023-11-08T19:24:51.328652+0000', 'last_active': '2023-11-08T19:24:51.328652+0000', 'last_peered': '2023-11-08T19:24:51.328652+0000', 'last_clean': '2023-11-08T19:24:51.328652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:51.328652+0000', 'last_undegraded': '2023-11-08T19:24:51.328652+0000', 'last_fullsized': '2023-11-08T19:24:51.328652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:24:57.261 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.38 is not active+clean 2023-11-08T19:24:57.261 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:24:51.328652+0000', 'last_change': '2023-11-08T19:24:51.328652+0000', 'last_active': '2023-11-08T19:24:51.328652+0000', 'last_peered': '2023-11-08T19:24:51.328652+0000', 'last_clean': '2023-11-08T19:24:51.328652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:51.328652+0000', 'last_undegraded': '2023-11-08T19:24:51.328652+0000', 'last_fullsized': '2023-11-08T19:24:51.328652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:24:57.262 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.37 is not active+clean 2023-11-08T19:24:57.262 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:24:51.328652+0000', 'last_change': '2023-11-08T19:24:51.328652+0000', 'last_active': '2023-11-08T19:24:51.328652+0000', 'last_peered': '2023-11-08T19:24:51.328652+0000', 'last_clean': '2023-11-08T19:24:51.328652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:51.328652+0000', 'last_undegraded': '2023-11-08T19:24:51.328652+0000', 'last_fullsized': '2023-11-08T19:24:51.328652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:24:57.262 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.36 is not active+clean 2023-11-08T19:24:57.263 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:24:51.328652+0000', 'last_change': '2023-11-08T19:24:51.328652+0000', 'last_active': '2023-11-08T19:24:51.328652+0000', 'last_peered': '2023-11-08T19:24:51.328652+0000', 'last_clean': '2023-11-08T19:24:51.328652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:51.328652+0000', 'last_undegraded': '2023-11-08T19:24:51.328652+0000', 'last_fullsized': '2023-11-08T19:24:51.328652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:24:57.263 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.35 is not active+clean 2023-11-08T19:24:57.264 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:24:51.328652+0000', 'last_change': '2023-11-08T19:24:51.328652+0000', 'last_active': '2023-11-08T19:24:51.328652+0000', 'last_peered': '2023-11-08T19:24:51.328652+0000', 'last_clean': '2023-11-08T19:24:51.328652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:51.328652+0000', 'last_undegraded': '2023-11-08T19:24:51.328652+0000', 'last_fullsized': '2023-11-08T19:24:51.328652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:24:57.264 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.34 is not active+clean 2023-11-08T19:24:57.264 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:24:51.328652+0000', 'last_change': '2023-11-08T19:24:51.328652+0000', 'last_active': '2023-11-08T19:24:51.328652+0000', 'last_peered': '2023-11-08T19:24:51.328652+0000', 'last_clean': '2023-11-08T19:24:51.328652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:51.328652+0000', 'last_undegraded': '2023-11-08T19:24:51.328652+0000', 'last_fullsized': '2023-11-08T19:24:51.328652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:24:57.265 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.33 is not active+clean 2023-11-08T19:24:57.265 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:24:51.328652+0000', 'last_change': '2023-11-08T19:24:51.328652+0000', 'last_active': '2023-11-08T19:24:51.328652+0000', 'last_peered': '2023-11-08T19:24:51.328652+0000', 'last_clean': '2023-11-08T19:24:51.328652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:51.328652+0000', 'last_undegraded': '2023-11-08T19:24:51.328652+0000', 'last_fullsized': '2023-11-08T19:24:51.328652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:24:57.266 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.32 is not active+clean 2023-11-08T19:24:57.266 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:24:51.328652+0000', 'last_change': '2023-11-08T19:24:51.328652+0000', 'last_active': '2023-11-08T19:24:51.328652+0000', 'last_peered': '2023-11-08T19:24:51.328652+0000', 'last_clean': '2023-11-08T19:24:51.328652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:51.328652+0000', 'last_undegraded': '2023-11-08T19:24:51.328652+0000', 'last_fullsized': '2023-11-08T19:24:51.328652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:24:57.266 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.31 is not active+clean 2023-11-08T19:24:57.267 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:24:51.328652+0000', 'last_change': '2023-11-08T19:24:51.328652+0000', 'last_active': '2023-11-08T19:24:51.328652+0000', 'last_peered': '2023-11-08T19:24:51.328652+0000', 'last_clean': '2023-11-08T19:24:51.328652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:51.328652+0000', 'last_undegraded': '2023-11-08T19:24:51.328652+0000', 'last_fullsized': '2023-11-08T19:24:51.328652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:24:57.267 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.30 is not active+clean 2023-11-08T19:24:57.268 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:24:51.328652+0000', 'last_change': '2023-11-08T19:24:51.328652+0000', 'last_active': '2023-11-08T19:24:51.328652+0000', 'last_peered': '2023-11-08T19:24:51.328652+0000', 'last_clean': '2023-11-08T19:24:51.328652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:51.328652+0000', 'last_undegraded': '2023-11-08T19:24:51.328652+0000', 'last_fullsized': '2023-11-08T19:24:51.328652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:24:57.268 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2f is not active+clean 2023-11-08T19:24:57.268 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:24:51.328652+0000', 'last_change': '2023-11-08T19:24:51.328652+0000', 'last_active': '2023-11-08T19:24:51.328652+0000', 'last_peered': '2023-11-08T19:24:51.328652+0000', 'last_clean': '2023-11-08T19:24:51.328652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:51.328652+0000', 'last_undegraded': '2023-11-08T19:24:51.328652+0000', 'last_fullsized': '2023-11-08T19:24:51.328652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:24:57.269 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2d is not active+clean 2023-11-08T19:24:57.269 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:24:51.328652+0000', 'last_change': '2023-11-08T19:24:51.328652+0000', 'last_active': '2023-11-08T19:24:51.328652+0000', 'last_peered': '2023-11-08T19:24:51.328652+0000', 'last_clean': '2023-11-08T19:24:51.328652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:51.328652+0000', 'last_undegraded': '2023-11-08T19:24:51.328652+0000', 'last_fullsized': '2023-11-08T19:24:51.328652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:24:57.270 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2c is not active+clean 2023-11-08T19:24:57.270 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:24:51.328652+0000', 'last_change': '2023-11-08T19:24:51.328652+0000', 'last_active': '2023-11-08T19:24:51.328652+0000', 'last_peered': '2023-11-08T19:24:51.328652+0000', 'last_clean': '2023-11-08T19:24:51.328652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:51.328652+0000', 'last_undegraded': '2023-11-08T19:24:51.328652+0000', 'last_fullsized': '2023-11-08T19:24:51.328652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:24:57.270 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2a is not active+clean 2023-11-08T19:24:57.271 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:24:51.328652+0000', 'last_change': '2023-11-08T19:24:51.328652+0000', 'last_active': '2023-11-08T19:24:51.328652+0000', 'last_peered': '2023-11-08T19:24:51.328652+0000', 'last_clean': '2023-11-08T19:24:51.328652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:51.328652+0000', 'last_undegraded': '2023-11-08T19:24:51.328652+0000', 'last_fullsized': '2023-11-08T19:24:51.328652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:24:57.271 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.28 is not active+clean 2023-11-08T19:24:57.271 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:24:51.328652+0000', 'last_change': '2023-11-08T19:24:51.328652+0000', 'last_active': '2023-11-08T19:24:51.328652+0000', 'last_peered': '2023-11-08T19:24:51.328652+0000', 'last_clean': '2023-11-08T19:24:51.328652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:51.328652+0000', 'last_undegraded': '2023-11-08T19:24:51.328652+0000', 'last_fullsized': '2023-11-08T19:24:51.328652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:24:57.272 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.27 is not active+clean 2023-11-08T19:24:57.272 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:24:51.328652+0000', 'last_change': '2023-11-08T19:24:51.328652+0000', 'last_active': '2023-11-08T19:24:51.328652+0000', 'last_peered': '2023-11-08T19:24:51.328652+0000', 'last_clean': '2023-11-08T19:24:51.328652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:51.328652+0000', 'last_undegraded': '2023-11-08T19:24:51.328652+0000', 'last_fullsized': '2023-11-08T19:24:51.328652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:24:57.273 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.26 is not active+clean 2023-11-08T19:24:57.273 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:24:51.328652+0000', 'last_change': '2023-11-08T19:24:51.328652+0000', 'last_active': '2023-11-08T19:24:51.328652+0000', 'last_peered': '2023-11-08T19:24:51.328652+0000', 'last_clean': '2023-11-08T19:24:51.328652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:51.328652+0000', 'last_undegraded': '2023-11-08T19:24:51.328652+0000', 'last_fullsized': '2023-11-08T19:24:51.328652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:24:57.273 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.25 is not active+clean 2023-11-08T19:24:57.274 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:24:51.328652+0000', 'last_change': '2023-11-08T19:24:51.328652+0000', 'last_active': '2023-11-08T19:24:51.328652+0000', 'last_peered': '2023-11-08T19:24:51.328652+0000', 'last_clean': '2023-11-08T19:24:51.328652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:51.328652+0000', 'last_undegraded': '2023-11-08T19:24:51.328652+0000', 'last_fullsized': '2023-11-08T19:24:51.328652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:24:57.274 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.24 is not active+clean 2023-11-08T19:24:57.275 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:24:51.328652+0000', 'last_change': '2023-11-08T19:24:51.328652+0000', 'last_active': '2023-11-08T19:24:51.328652+0000', 'last_peered': '2023-11-08T19:24:51.328652+0000', 'last_clean': '2023-11-08T19:24:51.328652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:51.328652+0000', 'last_undegraded': '2023-11-08T19:24:51.328652+0000', 'last_fullsized': '2023-11-08T19:24:51.328652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:24:57.275 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.23 is not active+clean 2023-11-08T19:24:57.275 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:24:51.328652+0000', 'last_change': '2023-11-08T19:24:51.328652+0000', 'last_active': '2023-11-08T19:24:51.328652+0000', 'last_peered': '2023-11-08T19:24:51.328652+0000', 'last_clean': '2023-11-08T19:24:51.328652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:51.328652+0000', 'last_undegraded': '2023-11-08T19:24:51.328652+0000', 'last_fullsized': '2023-11-08T19:24:51.328652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:24:57.276 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.21 is not active+clean 2023-11-08T19:24:57.276 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:24:51.328652+0000', 'last_change': '2023-11-08T19:24:51.328652+0000', 'last_active': '2023-11-08T19:24:51.328652+0000', 'last_peered': '2023-11-08T19:24:51.328652+0000', 'last_clean': '2023-11-08T19:24:51.328652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:51.328652+0000', 'last_undegraded': '2023-11-08T19:24:51.328652+0000', 'last_fullsized': '2023-11-08T19:24:51.328652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:24:57.277 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.20 is not active+clean 2023-11-08T19:24:57.277 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:24:51.328652+0000', 'last_change': '2023-11-08T19:24:51.328652+0000', 'last_active': '2023-11-08T19:24:51.328652+0000', 'last_peered': '2023-11-08T19:24:51.328652+0000', 'last_clean': '2023-11-08T19:24:51.328652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:51.328652+0000', 'last_undegraded': '2023-11-08T19:24:51.328652+0000', 'last_fullsized': '2023-11-08T19:24:51.328652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:24:57.277 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.12 is not active+clean 2023-11-08T19:24:57.278 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:24:50.332581+0000', 'last_change': '2023-11-08T19:24:50.332581+0000', 'last_active': '2023-11-08T19:24:50.322101+0000', 'last_peered': '2023-11-08T19:24:50.322101+0000', 'last_clean': '2023-11-08T19:24:50.322101+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:50.332581+0000', 'last_undegraded': '2023-11-08T19:24:50.332581+0000', 'last_fullsized': '2023-11-08T19:24:50.332581+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-08T19:24:57.278 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.12 is not active+clean 2023-11-08T19:24:57.279 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:24:51.328652+0000', 'last_change': '2023-11-08T19:24:51.328652+0000', 'last_active': '2023-11-08T19:24:51.328652+0000', 'last_peered': '2023-11-08T19:24:51.328652+0000', 'last_clean': '2023-11-08T19:24:51.328652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:51.328652+0000', 'last_undegraded': '2023-11-08T19:24:51.328652+0000', 'last_fullsized': '2023-11-08T19:24:51.328652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:24:57.279 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.13 is not active+clean 2023-11-08T19:24:57.279 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:24:50.338177+0000', 'last_change': '2023-11-08T19:24:50.338177+0000', 'last_active': '2023-11-08T19:24:50.322101+0000', 'last_peered': '2023-11-08T19:24:50.322101+0000', 'last_clean': '2023-11-08T19:24:50.322101+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:50.338177+0000', 'last_undegraded': '2023-11-08T19:24:50.338177+0000', 'last_fullsized': '2023-11-08T19:24:50.338177+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-08T19:24:57.280 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.10 is not active+clean 2023-11-08T19:24:57.280 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:24:51.328652+0000', 'last_change': '2023-11-08T19:24:51.328652+0000', 'last_active': '2023-11-08T19:24:51.328652+0000', 'last_peered': '2023-11-08T19:24:51.328652+0000', 'last_clean': '2023-11-08T19:24:51.328652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:51.328652+0000', 'last_undegraded': '2023-11-08T19:24:51.328652+0000', 'last_fullsized': '2023-11-08T19:24:51.328652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:24:57.281 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.11 is not active+clean 2023-11-08T19:24:57.281 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:24:50.337661+0000', 'last_change': '2023-11-08T19:24:50.337661+0000', 'last_active': '2023-11-08T19:24:50.322101+0000', 'last_peered': '2023-11-08T19:24:50.322101+0000', 'last_clean': '2023-11-08T19:24:50.322101+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:50.337661+0000', 'last_undegraded': '2023-11-08T19:24:50.337661+0000', 'last_fullsized': '2023-11-08T19:24:50.337661+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-08T19:24:57.282 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.16 is not active+clean 2023-11-08T19:24:57.282 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:24:50.337528+0000', 'last_change': '2023-11-08T19:24:50.337528+0000', 'last_active': '2023-11-08T19:24:50.322101+0000', 'last_peered': '2023-11-08T19:24:50.322101+0000', 'last_clean': '2023-11-08T19:24:50.322101+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:50.337528+0000', 'last_undegraded': '2023-11-08T19:24:50.337528+0000', 'last_fullsized': '2023-11-08T19:24:50.337528+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-08T19:24:57.282 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.16 is not active+clean 2023-11-08T19:24:57.283 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:24:51.328652+0000', 'last_change': '2023-11-08T19:24:51.328652+0000', 'last_active': '2023-11-08T19:24:51.328652+0000', 'last_peered': '2023-11-08T19:24:51.328652+0000', 'last_clean': '2023-11-08T19:24:51.328652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:51.328652+0000', 'last_undegraded': '2023-11-08T19:24:51.328652+0000', 'last_fullsized': '2023-11-08T19:24:51.328652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:24:57.283 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.14 is not active+clean 2023-11-08T19:24:57.283 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:24:50.332956+0000', 'last_change': '2023-11-08T19:24:50.332956+0000', 'last_active': '2023-11-08T19:24:50.322101+0000', 'last_peered': '2023-11-08T19:24:50.322101+0000', 'last_clean': '2023-11-08T19:24:50.322101+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:50.332956+0000', 'last_undegraded': '2023-11-08T19:24:50.332956+0000', 'last_fullsized': '2023-11-08T19:24:50.332956+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-08T19:24:57.284 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.14 is not active+clean 2023-11-08T19:24:57.284 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:24:51.328652+0000', 'last_change': '2023-11-08T19:24:51.328652+0000', 'last_active': '2023-11-08T19:24:51.328652+0000', 'last_peered': '2023-11-08T19:24:51.328652+0000', 'last_clean': '2023-11-08T19:24:51.328652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:51.328652+0000', 'last_undegraded': '2023-11-08T19:24:51.328652+0000', 'last_fullsized': '2023-11-08T19:24:51.328652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:24:57.285 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1b is not active+clean 2023-11-08T19:24:57.285 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:24:51.328652+0000', 'last_change': '2023-11-08T19:24:51.328652+0000', 'last_active': '2023-11-08T19:24:51.328652+0000', 'last_peered': '2023-11-08T19:24:51.328652+0000', 'last_clean': '2023-11-08T19:24:51.328652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:51.328652+0000', 'last_undegraded': '2023-11-08T19:24:51.328652+0000', 'last_fullsized': '2023-11-08T19:24:51.328652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:24:57.285 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1a is not active+clean 2023-11-08T19:24:57.286 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:24:50.338584+0000', 'last_change': '2023-11-08T19:24:50.338584+0000', 'last_active': '2023-11-08T19:24:50.322101+0000', 'last_peered': '2023-11-08T19:24:50.322101+0000', 'last_clean': '2023-11-08T19:24:50.322101+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:50.338584+0000', 'last_undegraded': '2023-11-08T19:24:50.338584+0000', 'last_fullsized': '2023-11-08T19:24:50.338584+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-08T19:24:57.286 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1a is not active+clean 2023-11-08T19:24:57.287 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:24:51.328652+0000', 'last_change': '2023-11-08T19:24:51.328652+0000', 'last_active': '2023-11-08T19:24:51.328652+0000', 'last_peered': '2023-11-08T19:24:51.328652+0000', 'last_clean': '2023-11-08T19:24:51.328652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:51.328652+0000', 'last_undegraded': '2023-11-08T19:24:51.328652+0000', 'last_fullsized': '2023-11-08T19:24:51.328652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:24:57.287 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1b is not active+clean 2023-11-08T19:24:57.287 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:24:50.332279+0000', 'last_change': '2023-11-08T19:24:50.332279+0000', 'last_active': '2023-11-08T19:24:50.322101+0000', 'last_peered': '2023-11-08T19:24:50.322101+0000', 'last_clean': '2023-11-08T19:24:50.322101+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:50.332279+0000', 'last_undegraded': '2023-11-08T19:24:50.332279+0000', 'last_fullsized': '2023-11-08T19:24:50.332279+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-08T19:24:57.288 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.19 is not active+clean 2023-11-08T19:24:57.288 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:24:51.328652+0000', 'last_change': '2023-11-08T19:24:51.328652+0000', 'last_active': '2023-11-08T19:24:51.328652+0000', 'last_peered': '2023-11-08T19:24:51.328652+0000', 'last_clean': '2023-11-08T19:24:51.328652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:51.328652+0000', 'last_undegraded': '2023-11-08T19:24:51.328652+0000', 'last_fullsized': '2023-11-08T19:24:51.328652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:24:57.289 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.18 is not active+clean 2023-11-08T19:24:57.289 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:24:50.332251+0000', 'last_change': '2023-11-08T19:24:50.332251+0000', 'last_active': '2023-11-08T19:24:50.322101+0000', 'last_peered': '2023-11-08T19:24:50.322101+0000', 'last_clean': '2023-11-08T19:24:50.322101+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:50.332251+0000', 'last_undegraded': '2023-11-08T19:24:50.332251+0000', 'last_fullsized': '2023-11-08T19:24:50.332251+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-08T19:24:57.289 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.18 is not active+clean 2023-11-08T19:24:57.290 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:24:51.328652+0000', 'last_change': '2023-11-08T19:24:51.328652+0000', 'last_active': '2023-11-08T19:24:51.328652+0000', 'last_peered': '2023-11-08T19:24:51.328652+0000', 'last_clean': '2023-11-08T19:24:51.328652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:51.328652+0000', 'last_undegraded': '2023-11-08T19:24:51.328652+0000', 'last_fullsized': '2023-11-08T19:24:51.328652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:24:57.290 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.19 is not active+clean 2023-11-08T19:24:57.291 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:24:50.338195+0000', 'last_change': '2023-11-08T19:24:50.338195+0000', 'last_active': '2023-11-08T19:24:50.322101+0000', 'last_peered': '2023-11-08T19:24:50.322101+0000', 'last_clean': '2023-11-08T19:24:50.322101+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:50.338195+0000', 'last_undegraded': '2023-11-08T19:24:50.338195+0000', 'last_fullsized': '2023-11-08T19:24:50.338195+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-08T19:24:57.291 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1f is not active+clean 2023-11-08T19:24:57.291 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:24:51.328652+0000', 'last_change': '2023-11-08T19:24:51.328652+0000', 'last_active': '2023-11-08T19:24:51.328652+0000', 'last_peered': '2023-11-08T19:24:51.328652+0000', 'last_clean': '2023-11-08T19:24:51.328652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:51.328652+0000', 'last_undegraded': '2023-11-08T19:24:51.328652+0000', 'last_fullsized': '2023-11-08T19:24:51.328652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:24:57.292 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1e is not active+clean 2023-11-08T19:24:57.292 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:24:50.339757+0000', 'last_change': '2023-11-08T19:24:50.339757+0000', 'last_active': '2023-11-08T19:24:50.322101+0000', 'last_peered': '2023-11-08T19:24:50.322101+0000', 'last_clean': '2023-11-08T19:24:50.322101+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:50.339757+0000', 'last_undegraded': '2023-11-08T19:24:50.339757+0000', 'last_fullsized': '2023-11-08T19:24:50.339757+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-08T19:24:57.293 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1e is not active+clean 2023-11-08T19:24:57.293 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:24:51.328652+0000', 'last_change': '2023-11-08T19:24:51.328652+0000', 'last_active': '2023-11-08T19:24:51.328652+0000', 'last_peered': '2023-11-08T19:24:51.328652+0000', 'last_clean': '2023-11-08T19:24:51.328652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:51.328652+0000', 'last_undegraded': '2023-11-08T19:24:51.328652+0000', 'last_fullsized': '2023-11-08T19:24:51.328652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:24:57.293 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1f is not active+clean 2023-11-08T19:24:57.294 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:24:50.338705+0000', 'last_change': '2023-11-08T19:24:50.338705+0000', 'last_active': '2023-11-08T19:24:50.322101+0000', 'last_peered': '2023-11-08T19:24:50.322101+0000', 'last_clean': '2023-11-08T19:24:50.322101+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:50.338705+0000', 'last_undegraded': '2023-11-08T19:24:50.338705+0000', 'last_fullsized': '2023-11-08T19:24:50.338705+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-08T19:24:57.294 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1d is not active+clean 2023-11-08T19:24:57.295 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:24:51.328652+0000', 'last_change': '2023-11-08T19:24:51.328652+0000', 'last_active': '2023-11-08T19:24:51.328652+0000', 'last_peered': '2023-11-08T19:24:51.328652+0000', 'last_clean': '2023-11-08T19:24:51.328652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:51.328652+0000', 'last_undegraded': '2023-11-08T19:24:51.328652+0000', 'last_fullsized': '2023-11-08T19:24:51.328652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:24:57.295 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1c is not active+clean 2023-11-08T19:24:57.295 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:24:50.338406+0000', 'last_change': '2023-11-08T19:24:50.338406+0000', 'last_active': '2023-11-08T19:24:50.322101+0000', 'last_peered': '2023-11-08T19:24:50.322101+0000', 'last_clean': '2023-11-08T19:24:50.322101+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:50.338406+0000', 'last_undegraded': '2023-11-08T19:24:50.338406+0000', 'last_fullsized': '2023-11-08T19:24:50.338406+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-08T19:24:57.296 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1c is not active+clean 2023-11-08T19:24:57.296 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:24:51.328652+0000', 'last_change': '2023-11-08T19:24:51.328652+0000', 'last_active': '2023-11-08T19:24:51.328652+0000', 'last_peered': '2023-11-08T19:24:51.328652+0000', 'last_clean': '2023-11-08T19:24:51.328652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:51.328652+0000', 'last_undegraded': '2023-11-08T19:24:51.328652+0000', 'last_fullsized': '2023-11-08T19:24:51.328652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:24:57.297 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1d is not active+clean 2023-11-08T19:24:57.297 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:24:50.338593+0000', 'last_change': '2023-11-08T19:24:50.338593+0000', 'last_active': '2023-11-08T19:24:50.322101+0000', 'last_peered': '2023-11-08T19:24:50.322101+0000', 'last_clean': '2023-11-08T19:24:50.322101+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:50.338593+0000', 'last_undegraded': '2023-11-08T19:24:50.338593+0000', 'last_fullsized': '2023-11-08T19:24:50.338593+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-08T19:24:57.297 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2 is not active+clean 2023-11-08T19:24:57.298 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:24:50.332231+0000', 'last_change': '2023-11-08T19:24:50.332231+0000', 'last_active': '2023-11-08T19:24:50.322101+0000', 'last_peered': '2023-11-08T19:24:50.322101+0000', 'last_clean': '2023-11-08T19:24:50.322101+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:50.332231+0000', 'last_undegraded': '2023-11-08T19:24:50.332231+0000', 'last_fullsized': '2023-11-08T19:24:50.332231+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-08T19:24:57.298 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2 is not active+clean 2023-11-08T19:24:57.298 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:24:51.328652+0000', 'last_change': '2023-11-08T19:24:51.328652+0000', 'last_active': '2023-11-08T19:24:51.328652+0000', 'last_peered': '2023-11-08T19:24:51.328652+0000', 'last_clean': '2023-11-08T19:24:51.328652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:51.328652+0000', 'last_undegraded': '2023-11-08T19:24:51.328652+0000', 'last_fullsized': '2023-11-08T19:24:51.328652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:24:57.299 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3 is not active+clean 2023-11-08T19:24:57.299 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:24:50.338891+0000', 'last_change': '2023-11-08T19:24:50.338891+0000', 'last_active': '2023-11-08T19:24:50.322101+0000', 'last_peered': '2023-11-08T19:24:50.322101+0000', 'last_clean': '2023-11-08T19:24:50.322101+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:50.338891+0000', 'last_undegraded': '2023-11-08T19:24:50.338891+0000', 'last_fullsized': '2023-11-08T19:24:50.338891+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-08T19:24:57.300 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1 is not active+clean 2023-11-08T19:24:57.300 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:24:51.328652+0000', 'last_change': '2023-11-08T19:24:51.328652+0000', 'last_active': '2023-11-08T19:24:51.328652+0000', 'last_peered': '2023-11-08T19:24:51.328652+0000', 'last_clean': '2023-11-08T19:24:51.328652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:51.328652+0000', 'last_undegraded': '2023-11-08T19:24:51.328652+0000', 'last_fullsized': '2023-11-08T19:24:51.328652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:24:57.300 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.0 is not active+clean 2023-11-08T19:24:57.301 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:24:50.337482+0000', 'last_change': '2023-11-08T19:24:50.337482+0000', 'last_active': '2023-11-08T19:24:50.322101+0000', 'last_peered': '2023-11-08T19:24:50.322101+0000', 'last_clean': '2023-11-08T19:24:50.322101+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:50.337482+0000', 'last_undegraded': '2023-11-08T19:24:50.337482+0000', 'last_fullsized': '2023-11-08T19:24:50.337482+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-08T19:24:57.301 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.0 is not active+clean 2023-11-08T19:24:57.302 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:24:51.328652+0000', 'last_change': '2023-11-08T19:24:51.328652+0000', 'last_active': '2023-11-08T19:24:51.328652+0000', 'last_peered': '2023-11-08T19:24:51.328652+0000', 'last_clean': '2023-11-08T19:24:51.328652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:51.328652+0000', 'last_undegraded': '2023-11-08T19:24:51.328652+0000', 'last_fullsized': '2023-11-08T19:24:51.328652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:24:57.302 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1 is not active+clean 2023-11-08T19:24:57.302 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:24:50.337708+0000', 'last_change': '2023-11-08T19:24:50.337708+0000', 'last_active': '2023-11-08T19:24:50.322101+0000', 'last_peered': '2023-11-08T19:24:50.322101+0000', 'last_clean': '2023-11-08T19:24:50.322101+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:50.337708+0000', 'last_undegraded': '2023-11-08T19:24:50.337708+0000', 'last_fullsized': '2023-11-08T19:24:50.337708+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-08T19:24:57.303 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.7 is not active+clean 2023-11-08T19:24:57.303 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:24:51.328652+0000', 'last_change': '2023-11-08T19:24:51.328652+0000', 'last_active': '2023-11-08T19:24:51.328652+0000', 'last_peered': '2023-11-08T19:24:51.328652+0000', 'last_clean': '2023-11-08T19:24:51.328652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:51.328652+0000', 'last_undegraded': '2023-11-08T19:24:51.328652+0000', 'last_fullsized': '2023-11-08T19:24:51.328652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:24:57.304 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.6 is not active+clean 2023-11-08T19:24:57.304 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:24:50.337614+0000', 'last_change': '2023-11-08T19:24:50.337614+0000', 'last_active': '2023-11-08T19:24:50.322101+0000', 'last_peered': '2023-11-08T19:24:50.322101+0000', 'last_clean': '2023-11-08T19:24:50.322101+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:50.337614+0000', 'last_undegraded': '2023-11-08T19:24:50.337614+0000', 'last_fullsized': '2023-11-08T19:24:50.337614+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-08T19:24:57.304 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.6 is not active+clean 2023-11-08T19:24:57.305 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:24:51.328652+0000', 'last_change': '2023-11-08T19:24:51.328652+0000', 'last_active': '2023-11-08T19:24:51.328652+0000', 'last_peered': '2023-11-08T19:24:51.328652+0000', 'last_clean': '2023-11-08T19:24:51.328652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:51.328652+0000', 'last_undegraded': '2023-11-08T19:24:51.328652+0000', 'last_fullsized': '2023-11-08T19:24:51.328652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:24:57.305 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.7 is not active+clean 2023-11-08T19:24:57.306 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:24:50.339355+0000', 'last_change': '2023-11-08T19:24:50.339355+0000', 'last_active': '2023-11-08T19:24:50.322101+0000', 'last_peered': '2023-11-08T19:24:50.322101+0000', 'last_clean': '2023-11-08T19:24:50.322101+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:50.339355+0000', 'last_undegraded': '2023-11-08T19:24:50.339355+0000', 'last_fullsized': '2023-11-08T19:24:50.339355+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-08T19:24:57.306 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.5 is not active+clean 2023-11-08T19:24:57.306 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:24:51.328652+0000', 'last_change': '2023-11-08T19:24:51.328652+0000', 'last_active': '2023-11-08T19:24:51.328652+0000', 'last_peered': '2023-11-08T19:24:51.328652+0000', 'last_clean': '2023-11-08T19:24:51.328652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:51.328652+0000', 'last_undegraded': '2023-11-08T19:24:51.328652+0000', 'last_fullsized': '2023-11-08T19:24:51.328652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:24:57.307 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.4 is not active+clean 2023-11-08T19:24:57.307 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:24:50.337563+0000', 'last_change': '2023-11-08T19:24:50.337563+0000', 'last_active': '2023-11-08T19:24:50.322101+0000', 'last_peered': '2023-11-08T19:24:50.322101+0000', 'last_clean': '2023-11-08T19:24:50.322101+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:50.337563+0000', 'last_undegraded': '2023-11-08T19:24:50.337563+0000', 'last_fullsized': '2023-11-08T19:24:50.337563+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-08T19:24:57.308 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.4 is not active+clean 2023-11-08T19:24:57.308 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:24:51.328652+0000', 'last_change': '2023-11-08T19:24:51.328652+0000', 'last_active': '2023-11-08T19:24:51.328652+0000', 'last_peered': '2023-11-08T19:24:51.328652+0000', 'last_clean': '2023-11-08T19:24:51.328652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:51.328652+0000', 'last_undegraded': '2023-11-08T19:24:51.328652+0000', 'last_fullsized': '2023-11-08T19:24:51.328652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:24:57.309 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.5 is not active+clean 2023-11-08T19:24:57.309 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:24:50.332121+0000', 'last_change': '2023-11-08T19:24:50.332121+0000', 'last_active': '2023-11-08T19:24:50.322101+0000', 'last_peered': '2023-11-08T19:24:50.322101+0000', 'last_clean': '2023-11-08T19:24:50.322101+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:50.332121+0000', 'last_undegraded': '2023-11-08T19:24:50.332121+0000', 'last_fullsized': '2023-11-08T19:24:50.332121+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-08T19:24:57.309 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.b is not active+clean 2023-11-08T19:24:57.310 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:24:51.328652+0000', 'last_change': '2023-11-08T19:24:51.328652+0000', 'last_active': '2023-11-08T19:24:51.328652+0000', 'last_peered': '2023-11-08T19:24:51.328652+0000', 'last_clean': '2023-11-08T19:24:51.328652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:51.328652+0000', 'last_undegraded': '2023-11-08T19:24:51.328652+0000', 'last_fullsized': '2023-11-08T19:24:51.328652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:24:57.310 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.a is not active+clean 2023-11-08T19:24:57.311 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:24:50.337839+0000', 'last_change': '2023-11-08T19:24:50.337839+0000', 'last_active': '2023-11-08T19:24:50.322101+0000', 'last_peered': '2023-11-08T19:24:50.322101+0000', 'last_clean': '2023-11-08T19:24:50.322101+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:50.337839+0000', 'last_undegraded': '2023-11-08T19:24:50.337839+0000', 'last_fullsized': '2023-11-08T19:24:50.337839+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-08T19:24:57.311 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.a is not active+clean 2023-11-08T19:24:57.312 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:24:51.328652+0000', 'last_change': '2023-11-08T19:24:51.328652+0000', 'last_active': '2023-11-08T19:24:51.328652+0000', 'last_peered': '2023-11-08T19:24:51.328652+0000', 'last_clean': '2023-11-08T19:24:51.328652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:51.328652+0000', 'last_undegraded': '2023-11-08T19:24:51.328652+0000', 'last_fullsized': '2023-11-08T19:24:51.328652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:24:57.312 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.b is not active+clean 2023-11-08T19:24:57.312 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:24:50.337797+0000', 'last_change': '2023-11-08T19:24:50.337797+0000', 'last_active': '2023-11-08T19:24:50.322101+0000', 'last_peered': '2023-11-08T19:24:50.322101+0000', 'last_clean': '2023-11-08T19:24:50.322101+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:50.337797+0000', 'last_undegraded': '2023-11-08T19:24:50.337797+0000', 'last_fullsized': '2023-11-08T19:24:50.337797+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-08T19:24:57.313 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.9 is not active+clean 2023-11-08T19:24:57.313 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:24:51.328652+0000', 'last_change': '2023-11-08T19:24:51.328652+0000', 'last_active': '2023-11-08T19:24:51.328652+0000', 'last_peered': '2023-11-08T19:24:51.328652+0000', 'last_clean': '2023-11-08T19:24:51.328652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:51.328652+0000', 'last_undegraded': '2023-11-08T19:24:51.328652+0000', 'last_fullsized': '2023-11-08T19:24:51.328652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:24:57.314 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.8 is not active+clean 2023-11-08T19:24:57.314 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:24:50.337556+0000', 'last_change': '2023-11-08T19:24:50.337556+0000', 'last_active': '2023-11-08T19:24:50.322101+0000', 'last_peered': '2023-11-08T19:24:50.322101+0000', 'last_clean': '2023-11-08T19:24:50.322101+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:50.337556+0000', 'last_undegraded': '2023-11-08T19:24:50.337556+0000', 'last_fullsized': '2023-11-08T19:24:50.337556+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-08T19:24:57.315 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.f is not active+clean 2023-11-08T19:24:57.315 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:24:51.328652+0000', 'last_change': '2023-11-08T19:24:51.328652+0000', 'last_active': '2023-11-08T19:24:51.328652+0000', 'last_peered': '2023-11-08T19:24:51.328652+0000', 'last_clean': '2023-11-08T19:24:51.328652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:51.328652+0000', 'last_undegraded': '2023-11-08T19:24:51.328652+0000', 'last_fullsized': '2023-11-08T19:24:51.328652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:24:57.315 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.e is not active+clean 2023-11-08T19:24:57.316 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:24:50.338456+0000', 'last_change': '2023-11-08T19:24:50.338456+0000', 'last_active': '2023-11-08T19:24:50.322101+0000', 'last_peered': '2023-11-08T19:24:50.322101+0000', 'last_clean': '2023-11-08T19:24:50.322101+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:50.338456+0000', 'last_undegraded': '2023-11-08T19:24:50.338456+0000', 'last_fullsized': '2023-11-08T19:24:50.338456+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-08T19:24:57.316 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.f is not active+clean 2023-11-08T19:24:57.316 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:24:50.337604+0000', 'last_change': '2023-11-08T19:24:50.337604+0000', 'last_active': '2023-11-08T19:24:50.322101+0000', 'last_peered': '2023-11-08T19:24:50.322101+0000', 'last_clean': '2023-11-08T19:24:50.322101+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:50.337604+0000', 'last_undegraded': '2023-11-08T19:24:50.337604+0000', 'last_fullsized': '2023-11-08T19:24:50.337604+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-08T19:24:57.317 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.c is not active+clean 2023-11-08T19:24:57.317 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:24:50.337932+0000', 'last_change': '2023-11-08T19:24:50.337932+0000', 'last_active': '2023-11-08T19:24:50.322101+0000', 'last_peered': '2023-11-08T19:24:50.322101+0000', 'last_clean': '2023-11-08T19:24:50.322101+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:50.337932+0000', 'last_undegraded': '2023-11-08T19:24:50.337932+0000', 'last_fullsized': '2023-11-08T19:24:50.337932+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-08T19:24:57.318 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.c is not active+clean 2023-11-08T19:24:57.318 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:24:51.328652+0000', 'last_change': '2023-11-08T19:24:51.328652+0000', 'last_active': '2023-11-08T19:24:51.328652+0000', 'last_peered': '2023-11-08T19:24:51.328652+0000', 'last_clean': '2023-11-08T19:24:51.328652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:51.328652+0000', 'last_undegraded': '2023-11-08T19:24:51.328652+0000', 'last_fullsized': '2023-11-08T19:24:51.328652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:24:57.318 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.d is not active+clean 2023-11-08T19:24:57.319 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:24:50.337660+0000', 'last_change': '2023-11-08T19:24:50.337660+0000', 'last_active': '2023-11-08T19:24:50.322101+0000', 'last_peered': '2023-11-08T19:24:50.322101+0000', 'last_clean': '2023-11-08T19:24:50.322101+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:50.337660+0000', 'last_undegraded': '2023-11-08T19:24:50.337660+0000', 'last_fullsized': '2023-11-08T19:24:50.337660+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-08T19:24:57.319 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.8 is not active+clean 2023-11-08T19:24:57.320 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:24:51.328652+0000', 'last_change': '2023-11-08T19:24:51.328652+0000', 'last_active': '2023-11-08T19:24:51.328652+0000', 'last_peered': '2023-11-08T19:24:51.328652+0000', 'last_clean': '2023-11-08T19:24:51.328652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:51.328652+0000', 'last_undegraded': '2023-11-08T19:24:51.328652+0000', 'last_fullsized': '2023-11-08T19:24:51.328652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:51.328652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:24:57.320 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.9 is not active+clean 2023-11-08T19:24:57.320 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:24:50.332254+0000', 'last_change': '2023-11-08T19:24:50.332254+0000', 'last_active': '2023-11-08T19:24:50.322101+0000', 'last_peered': '2023-11-08T19:24:50.322101+0000', 'last_clean': '2023-11-08T19:24:50.322101+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:24:50.332254+0000', 'last_undegraded': '2023-11-08T19:24:50.332254+0000', 'last_fullsized': '2023-11-08T19:24:50.332254+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'last_clean_scrub_stamp': '2023-11-08T19:24:50.322101+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-08T19:24:57.321 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-08T19:24:57.323 INFO:tasks.ceph.mds.c.smithi149.stderr:2023-11-08T19:24:57.318+0000 7f322a2fa700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-08T19:24:57.444 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.443+0000 7f2a2e346700 1 Processor -- start 2023-11-08T19:24:57.444 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.443+0000 7f2a2e346700 1 -- start start 2023-11-08T19:24:57.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.444+0000 7f2a2e346700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f2a280d0050 0x7f2a280cc280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:57.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.444+0000 7f2a2e346700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a280cbdf0 con 0x7f2a2815dc90 2023-11-08T19:24:57.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.444+0000 7f2a2e346700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a280cb1e0 con 0x7f2a280cac70 2023-11-08T19:24:57.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.444+0000 7f2a2e346700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a280ccdd0 con 0x7f2a280d0050 2023-11-08T19:24:57.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.444+0000 7f2a27fff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f2a2815dc90 0x7f2a2806b560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:42390/0 (socket says 172.21.15.149:42390) 2023-11-08T19:24:57.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.444+0000 7f2a27fff700 1 -- 172.21.15.149:0/3659753442 learned_addr learned my addr 172.21.15.149:0/3659753442 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:24:57.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.444+0000 7f2a26ffd700 1 -- 172.21.15.149:0/3659753442 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2788735058 0 0) 0x7f2a280cbdf0 con 0x7f2a2815dc90 2023-11-08T19:24:57.450 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.444+0000 7f2a26ffd700 1 -- 172.21.15.149:0/3659753442 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a100035b0 con 0x7f2a2815dc90 2023-11-08T19:24:57.450 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.444+0000 7f2a2c8e3700 1 --2- 172.21.15.149:0/3659753442 >> v2:172.21.15.160:3300/0 conn(0x7f2a280d0050 0x7f2a280cc280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:57.450 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.444+0000 7f2a26ffd700 1 -- 172.21.15.149:0/3659753442 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1792900570 0 0) 0x7f2a100035b0 con 0x7f2a2815dc90 2023-11-08T19:24:57.450 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.444+0000 7f2a26ffd700 1 -- 172.21.15.149:0/3659753442 >> v2:172.21.15.160:3300/0 conn(0x7f2a280d0050 msgr2=0x7f2a280cc280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:57.451 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.444+0000 7f2a26ffd700 1 --2- 172.21.15.149:0/3659753442 >> v2:172.21.15.160:3300/0 conn(0x7f2a280d0050 0x7f2a280cc280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:57.451 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.444+0000 7f2a26ffd700 1 -- 172.21.15.149:0/3659753442 >> v1:172.21.15.160:6789/0 conn(0x7f2a280cac70 legacy=0x7f2a280cf940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:57.451 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.444+0000 7f2a26ffd700 1 -- 172.21.15.149:0/3659753442 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a280cb4c0 con 0x7f2a2815dc90 2023-11-08T19:24:57.451 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.444+0000 7f2a26ffd700 1 -- 172.21.15.149:0/3659753442 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f2a1c001670 con 0x7f2a2815dc90 2023-11-08T19:24:57.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.444+0000 7f2a26ffd700 1 -- 172.21.15.149:0/3659753442 >> v1:172.21.15.149:6789/0 conn(0x7f2a2815dc90 legacy=0x7f2a2806b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:57.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.444+0000 7f2a26ffd700 1 --2- 172.21.15.149:0/3659753442 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2a10003a50 0x7f2a10003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:57.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.445+0000 7f2a26ffd700 1 --2- 172.21.15.149:0/3659753442 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a10004850 0x7f2a10004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:57.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.445+0000 7f2a26ffd700 1 --2- 172.21.15.149:0/3659753442 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a10005260 0x7f2a1000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:57.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.445+0000 7f2a26ffd700 1 -- 172.21.15.149:0/3659753442 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a280ccdd0 con 0x7f2a10004850 2023-11-08T19:24:57.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.445+0000 7f2a26ffd700 1 -- 172.21.15.149:0/3659753442 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1000c190 con 0x7f2a10005260 2023-11-08T19:24:57.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.445+0000 7f2a26ffd700 1 -- 172.21.15.149:0/3659753442 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1000c350 con 0x7f2a10003a50 2023-11-08T19:24:57.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.445+0000 7f2a277fe700 1 --2- 172.21.15.149:0/3659753442 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a10004850 0x7f2a10004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:57.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.445+0000 7f2a27fff700 1 --2- 172.21.15.149:0/3659753442 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2a10003a50 0x7f2a10003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:57.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.445+0000 7f2a2c8e3700 1 --2- 172.21.15.149:0/3659753442 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a10005260 0x7f2a1000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:57.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.445+0000 7f2a277fe700 1 -- 172.21.15.149:0/3659753442 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2a10003a50 msgr2=0x7f2a10003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:57.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.445+0000 7f2a277fe700 1 --2- 172.21.15.149:0/3659753442 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2a10003a50 0x7f2a10003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:57.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.445+0000 7f2a277fe700 1 -- 172.21.15.149:0/3659753442 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a10005260 msgr2=0x7f2a1000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:24:57.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.445+0000 7f2a277fe700 1 --2- 172.21.15.149:0/3659753442 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a10005260 0x7f2a1000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:57.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.445+0000 7f2a277fe700 1 -- 172.21.15.149:0/3659753442 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a100035b0 con 0x7f2a10004850 2023-11-08T19:24:57.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.445+0000 7f2a2c8e3700 1 --2- 172.21.15.149:0/3659753442 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a10005260 0x7f2a1000ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:24:57.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.445+0000 7f2a2c8e3700 1 -- 172.21.15.149:0/3659753442 reap_dead start 2023-11-08T19:24:57.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.445+0000 7f2a277fe700 1 --2- 172.21.15.149:0/3659753442 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a10004850 0x7f2a10004cd0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f2a18007fd0 tx=0x7f2a10005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce955ffba74ed597 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:57.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.445+0000 7f2a26ffd700 1 -- 172.21.15.149:0/3659753442 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a18016070 con 0x7f2a10004850 2023-11-08T19:24:57.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.445+0000 7f2a26ffd700 1 -- 172.21.15.149:0/3659753442 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a18006860 con 0x7f2a10004850 2023-11-08T19:24:57.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.445+0000 7f2a26ffd700 1 -- 172.21.15.149:0/3659753442 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a18003950 con 0x7f2a10004850 2023-11-08T19:24:57.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.446+0000 7f2a2e346700 1 -- 172.21.15.149:0/3659753442 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a10004850 msgr2=0x7f2a10004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:57.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.446+0000 7f2a2e346700 1 --2- 172.21.15.149:0/3659753442 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a10004850 0x7f2a10004cd0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f2a18007fd0 tx=0x7f2a10005880 comp rx=0 tx=0).stop 2023-11-08T19:24:57.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.446+0000 7f2a2e346700 1 -- 172.21.15.149:0/3659753442 shutdown_connections 2023-11-08T19:24:57.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.446+0000 7f2a2e346700 1 --2- 172.21.15.149:0/3659753442 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a10004850 0x7f2a10004cd0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:57.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.446+0000 7f2a2e346700 1 -- 172.21.15.149:0/3659753442 >> 172.21.15.149:0/3659753442 conn(0x7f2a280d0620 msgr2=0x7f2a280d0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:57.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.446+0000 7f2a2e346700 1 -- 172.21.15.149:0/3659753442 shutdown_connections 2023-11-08T19:24:57.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.446+0000 7f2a2e346700 1 -- 172.21.15.149:0/3659753442 wait complete. 2023-11-08T19:24:57.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.447+0000 7f2a2e346700 1 Processor -- start 2023-11-08T19:24:57.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.448+0000 7f2a2e346700 1 -- start start 2023-11-08T19:24:57.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.448+0000 7f2a2e346700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a10004850 0x7f2a280c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:57.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.448+0000 7f2a2e346700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a280c9e30 0x7f2a2814b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:57.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.448+0000 7f2a2e346700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2a280b4130 0x7f2a281e4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:57.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.448+0000 7f2a2e346700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a280c8d90 con 0x7f2a10004850 2023-11-08T19:24:57.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.448+0000 7f2a2e346700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a280c9070 con 0x7f2a280c9e30 2023-11-08T19:24:57.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.448+0000 7f2a2e346700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a280c9350 con 0x7f2a280b4130 2023-11-08T19:24:57.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.448+0000 7f2a27fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a10004850 0x7f2a280c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:57.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.449+0000 7f2a27fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a10004850 0x7f2a280c87b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40400/0 (socket says 172.21.15.149:40400) 2023-11-08T19:24:57.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.449+0000 7f2a27fff700 1 -- 172.21.15.149:0/350383259 learned_addr learned my addr 172.21.15.149:0/350383259 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:57.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.449+0000 7f2a277fe700 1 --2- 172.21.15.149:0/350383259 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a280c9e30 0x7f2a2814b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:57.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.449+0000 7f2a2c8e3700 1 --2- 172.21.15.149:0/350383259 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2a280b4130 0x7f2a281e4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:57.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.449+0000 7f2a27fff700 1 -- 172.21.15.149:0/350383259 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2a280b4130 msgr2=0x7f2a281e4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:57.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.449+0000 7f2a27fff700 1 --2- 172.21.15.149:0/350383259 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2a280b4130 0x7f2a281e4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:57.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.449+0000 7f2a27fff700 1 -- 172.21.15.149:0/350383259 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a280c9e30 msgr2=0x7f2a2814b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:57.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.449+0000 7f2a27fff700 1 --2- 172.21.15.149:0/350383259 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a280c9e30 0x7f2a2814b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:57.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.449+0000 7f2a27fff700 1 -- 172.21.15.149:0/350383259 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a280c9630 con 0x7f2a10004850 2023-11-08T19:24:57.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.449+0000 7f2a27fff700 1 --2- 172.21.15.149:0/350383259 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a10004850 0x7f2a280c87b0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c001a90 tx=0x7f2a1c007620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:57.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.449+0000 7f2a24ff9700 1 -- 172.21.15.149:0/350383259 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c001550 con 0x7f2a10004850 2023-11-08T19:24:57.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.449+0000 7f2a24ff9700 1 -- 172.21.15.149:0/350383259 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a1c00f870 con 0x7f2a10004850 2023-11-08T19:24:57.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.449+0000 7f2a2e346700 1 -- 172.21.15.149:0/350383259 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a280c9910 con 0x7f2a10004850 2023-11-08T19:24:57.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.449+0000 7f2a24ff9700 1 -- 172.21.15.149:0/350383259 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c00fc20 con 0x7f2a10004850 2023-11-08T19:24:57.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.449+0000 7f2a2e346700 1 -- 172.21.15.149:0/350383259 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a280b45b0 con 0x7f2a10004850 2023-11-08T19:24:57.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.450+0000 7f2a2e346700 1 -- 172.21.15.149:0/350383259 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a280b47d0 con 0x7f2a10004850 2023-11-08T19:24:57.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.450+0000 7f2a24ff9700 1 -- 172.21.15.149:0/350383259 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2a1c00fd80 con 0x7f2a10004850 2023-11-08T19:24:57.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.451+0000 7f2a24ff9700 1 --2- 172.21.15.149:0/350383259 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2a1406af00 0x7f2a1406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:57.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.451+0000 7f2a24ff9700 1 -- 172.21.15.149:0/350383259 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f2a1c089880 con 0x7f2a10004850 2023-11-08T19:24:57.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.451+0000 7f2a277fe700 1 --2- 172.21.15.149:0/350383259 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2a1406af00 0x7f2a1406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:57.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.451+0000 7f2a277fe700 1 --2- 172.21.15.149:0/350383259 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2a1406af00 0x7f2a1406d3c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f2a18014040 tx=0x7f2a18009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:57.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.456+0000 7f2a24ff9700 1 -- 172.21.15.149:0/350383259 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2a1c054690 con 0x7f2a10004850 2023-11-08T19:24:57.725 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.724+0000 7f2a2e346700 1 -- 172.21.15.149:0/350383259 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f2a280c91b0 con 0x7f2a10004850 2023-11-08T19:24:57.726 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.724+0000 7f2a24ff9700 1 -- 172.21.15.149:0/350383259 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1736 (secure 0 0 0) 0x7f2a280c91b0 con 0x7f2a10004850 2023-11-08T19:24:57.726 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:24:57.727 INFO:teuthology.orchestra.run.smithi149.stdout:{"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","health":{"status":"HEALTH_WARN","checks":{"POOL_APP_NOT_ENABLED":{"severity":"HEALTH_WARN","summary":{"message":"1 pool(s) do not have an application enabled","count":1},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":133,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":55,"num_osds":8,"num_up_osds":8,"osd_up_since":1699471375,"num_in_osds":8,"osd_in_since":1699471366,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":52},{"state_name":"active+clean","count":48},{"state_name":"creating+peering","count":29}],"num_pgs":129,"num_pools":4,"num_objects":8,"data_bytes":590458,"bytes_used":227520512,"bytes_avail":772866592768,"bytes_total":773094113280,"unknown_pgs_ratio":0.40310078859329224,"inactive_pgs_ratio":0.22480620443820953,"write_bytes_sec":180,"read_op_per_sec":0,"write_op_per_sec":2},"fsmap":{"epoch":25,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"c","status":"up:active","gid":5733}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2023-11-08T19:24:40.007035+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-11-08T19:24:57.728 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.726+0000 7f2a2e346700 1 -- 172.21.15.149:0/350383259 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2a1406af00 msgr2=0x7f2a1406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:57.728 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.726+0000 7f2a2e346700 1 --2- 172.21.15.149:0/350383259 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2a1406af00 0x7f2a1406d3c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f2a18014040 tx=0x7f2a18009030 comp rx=0 tx=0).stop 2023-11-08T19:24:57.728 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.726+0000 7f2a2e346700 1 -- 172.21.15.149:0/350383259 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a10004850 msgr2=0x7f2a280c87b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:57.729 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.726+0000 7f2a2e346700 1 --2- 172.21.15.149:0/350383259 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a10004850 0x7f2a280c87b0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c001a90 tx=0x7f2a1c007620 comp rx=0 tx=0).stop 2023-11-08T19:24:57.729 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.726+0000 7f2a2e346700 1 -- 172.21.15.149:0/350383259 shutdown_connections 2023-11-08T19:24:57.729 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.726+0000 7f2a2e346700 1 --2- 172.21.15.149:0/350383259 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2a1406af00 0x7f2a1406d3c0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:57.729 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.727+0000 7f2a2e346700 1 --2- 172.21.15.149:0/350383259 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2a280b4130 0x7f2a281e4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:57.730 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.727+0000 7f2a2e346700 1 --2- 172.21.15.149:0/350383259 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a10004850 0x7f2a280c87b0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:57.730 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.727+0000 7f2a2e346700 1 --2- 172.21.15.149:0/350383259 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a280c9e30 0x7f2a2814b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:57.730 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.727+0000 7f2a2e346700 1 -- 172.21.15.149:0/350383259 >> 172.21.15.149:0/350383259 conn(0x7f2a280d0620 msgr2=0x7f2a2815cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:57.730 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.727+0000 7f2a2e346700 1 -- 172.21.15.149:0/350383259 shutdown_connections 2023-11-08T19:24:57.730 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.727+0000 7f2a2e346700 1 -- 172.21.15.149:0/350383259 wait complete. 2023-11-08T19:24:57.740 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-08T19:24:57.741 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:24:57.861 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.860+0000 7fd4c27c0700 1 Processor -- start 2023-11-08T19:24:57.861 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.860+0000 7fd4c27c0700 1 -- start start 2023-11-08T19:24:57.864 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.860+0000 7fd4c27c0700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fd4bc0cc910 0x7fd4bc0cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:57.865 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.860+0000 7fd4c27c0700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4bc0b2f60 con 0x7fd4bc0cb130 2023-11-08T19:24:57.865 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.860+0000 7fd4c27c0700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4bc0cc520 con 0x7fd4bc0cc140 2023-11-08T19:24:57.865 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.860+0000 7fd4c27c0700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4bc0b2430 con 0x7fd4bc0cc910 2023-11-08T19:24:57.865 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.861+0000 7fd4c0d5d700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fd4bc0cb130 0x7fd4bc15d2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:42414/0 (socket says 172.21.15.149:42414) 2023-11-08T19:24:57.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.861+0000 7fd4c0d5d700 1 -- 172.21.15.149:0/1119700225 learned_addr learned my addr 172.21.15.149:0/1119700225 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:24:57.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.861+0000 7fd4bb7fe700 1 --2- 172.21.15.149:0/1119700225 >> v2:172.21.15.160:3300/0 conn(0x7fd4bc0cc910 0x7fd4bc0cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:57.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.861+0000 7fd4baffd700 1 -- 172.21.15.149:0/1119700225 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3565849783 0 0) 0x7fd4bc0b2f60 con 0x7fd4bc0cb130 2023-11-08T19:24:57.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.861+0000 7fd4baffd700 1 -- 172.21.15.149:0/1119700225 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4a40035b0 con 0x7fd4bc0cb130 2023-11-08T19:24:57.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.861+0000 7fd4baffd700 1 -- 172.21.15.149:0/1119700225 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1936212189 0 0) 0x7fd4bc0cc520 con 0x7fd4bc0cc140 2023-11-08T19:24:57.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.861+0000 7fd4baffd700 1 -- 172.21.15.149:0/1119700225 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4bc0b2f60 con 0x7fd4bc0cc140 2023-11-08T19:24:57.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.861+0000 7fd4baffd700 1 -- 172.21.15.149:0/1119700225 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2201946310 0 0) 0x7fd4a40035b0 con 0x7fd4bc0cb130 2023-11-08T19:24:57.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.861+0000 7fd4bb7fe700 1 -- 172.21.15.149:0/1119700225 >> v1:172.21.15.160:6789/0 conn(0x7fd4bc0cc140 legacy=0x7fd4bc0b2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:57.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.861+0000 7fd4bb7fe700 1 -- 172.21.15.149:0/1119700225 >> v1:172.21.15.149:6789/0 conn(0x7fd4bc0cb130 legacy=0x7fd4bc15d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:57.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.861+0000 7fd4bb7fe700 1 -- 172.21.15.149:0/1119700225 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4bc0cb5e0 con 0x7fd4bc0cc910 2023-11-08T19:24:57.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.861+0000 7fd4bb7fe700 1 --2- 172.21.15.149:0/1119700225 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd4bc0cc910 0x7fd4bc0cabf0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac009840 tx=0x7fd4ac009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73504028660903bc server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:57.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.861+0000 7fd4baffd700 1 -- 172.21.15.149:0/1119700225 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b40019f0 con 0x7fd4bc0cc910 2023-11-08T19:24:57.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.862+0000 7fd4baffd700 1 -- 172.21.15.149:0/1119700225 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4ac004030 con 0x7fd4bc0cc910 2023-11-08T19:24:57.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.862+0000 7fd4baffd700 1 -- 172.21.15.149:0/1119700225 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac0043c0 con 0x7fd4bc0cc910 2023-11-08T19:24:57.869 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.862+0000 7fd4c27c0700 1 -- 172.21.15.149:0/1119700225 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd4bc0cc910 msgr2=0x7fd4bc0cabf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:57.869 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.862+0000 7fd4c27c0700 1 --2- 172.21.15.149:0/1119700225 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd4bc0cc910 0x7fd4bc0cabf0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac009840 tx=0x7fd4ac009b50 comp rx=0 tx=0).stop 2023-11-08T19:24:57.869 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.862+0000 7fd4c27c0700 1 -- 172.21.15.149:0/1119700225 shutdown_connections 2023-11-08T19:24:57.870 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.862+0000 7fd4c27c0700 1 --2- 172.21.15.149:0/1119700225 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd4bc0cc910 0x7fd4bc0cabf0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:57.870 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.862+0000 7fd4c27c0700 1 -- 172.21.15.149:0/1119700225 >> 172.21.15.149:0/1119700225 conn(0x7fd4bc099a40 msgr2=0x7fd4bc0d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:57.870 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.862+0000 7fd4c27c0700 1 -- 172.21.15.149:0/1119700225 shutdown_connections 2023-11-08T19:24:57.870 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.862+0000 7fd4c27c0700 1 -- 172.21.15.149:0/1119700225 wait complete. 2023-11-08T19:24:57.871 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.863+0000 7fd4c27c0700 1 Processor -- start 2023-11-08T19:24:57.871 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.863+0000 7fd4c27c0700 1 -- start start 2023-11-08T19:24:57.874 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.864+0000 7fd4c27c0700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4bc0cb130 0x7fd4bc09a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:57.874 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.864+0000 7fd4c27c0700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd4bc0cc140 0x7fd4bc15eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:57.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.864+0000 7fd4c27c0700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd4bc0cc910 0x7fd4bc1f32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:57.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.864+0000 7fd4c27c0700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4bc09a880 con 0x7fd4bc0cb130 2023-11-08T19:24:57.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.864+0000 7fd4c27c0700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4bc06f940 con 0x7fd4bc0cc910 2023-11-08T19:24:57.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.864+0000 7fd4c27c0700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4bc06eb80 con 0x7fd4bc0cc140 2023-11-08T19:24:57.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.864+0000 7fd4bbfff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4bc0cb130 0x7fd4bc09a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:57.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.864+0000 7fd4bbfff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4bc0cb130 0x7fd4bc09a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40416/0 (socket says 172.21.15.149:40416) 2023-11-08T19:24:57.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.864+0000 7fd4bbfff700 1 -- 172.21.15.149:0/1111045510 learned_addr learned my addr 172.21.15.149:0/1111045510 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:24:57.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.864+0000 7fd4bb7fe700 1 --2- 172.21.15.149:0/1111045510 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd4bc0cc140 0x7fd4bc15eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:57.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.864+0000 7fd4c0d5d700 1 --2- 172.21.15.149:0/1111045510 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd4bc0cc910 0x7fd4bc1f32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:57.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.865+0000 7fd4bbfff700 1 -- 172.21.15.149:0/1111045510 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd4bc0cc140 msgr2=0x7fd4bc15eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:57.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.865+0000 7fd4bbfff700 1 --2- 172.21.15.149:0/1111045510 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd4bc0cc140 0x7fd4bc15eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:57.878 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.865+0000 7fd4bbfff700 1 -- 172.21.15.149:0/1111045510 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd4bc0cc910 msgr2=0x7fd4bc1f32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:57.878 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.865+0000 7fd4bbfff700 1 --2- 172.21.15.149:0/1111045510 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd4bc0cc910 0x7fd4bc1f32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:57.878 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.865+0000 7fd4bbfff700 1 -- 172.21.15.149:0/1111045510 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4ac0094a0 con 0x7fd4bc0cb130 2023-11-08T19:24:57.878 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.865+0000 7fd4bbfff700 1 --2- 172.21.15.149:0/1111045510 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4bc0cb130 0x7fd4bc09a340 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fd4b000c700 tx=0x7fd4b000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:57.878 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.865+0000 7fd4b8ff9700 1 -- 172.21.15.149:0/1111045510 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b00052d0 con 0x7fd4bc0cb130 2023-11-08T19:24:57.879 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.865+0000 7fd4b8ff9700 1 -- 172.21.15.149:0/1111045510 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b0005430 con 0x7fd4bc0cb130 2023-11-08T19:24:57.879 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.865+0000 7fd4c27c0700 1 -- 172.21.15.149:0/1111045510 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4bc06ee60 con 0x7fd4bc0cb130 2023-11-08T19:24:57.879 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.865+0000 7fd4b8ff9700 1 -- 172.21.15.149:0/1111045510 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b00038f0 con 0x7fd4bc0cb130 2023-11-08T19:24:57.879 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.865+0000 7fd4c27c0700 1 -- 172.21.15.149:0/1111045510 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4bc06f420 con 0x7fd4bc0cb130 2023-11-08T19:24:57.879 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.866+0000 7fd4c27c0700 1 -- 172.21.15.149:0/1111045510 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4bc0745f0 con 0x7fd4bc0cb130 2023-11-08T19:24:57.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.866+0000 7fd4b8ff9700 1 -- 172.21.15.149:0/1111045510 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd4b0003a50 con 0x7fd4bc0cb130 2023-11-08T19:24:57.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.867+0000 7fd4b8ff9700 1 --2- 172.21.15.149:0/1111045510 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd4a806af00 0x7fd4a806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:24:57.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.867+0000 7fd4b8ff9700 1 -- 172.21.15.149:0/1111045510 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fd4b0088d10 con 0x7fd4bc0cb130 2023-11-08T19:24:57.881 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.867+0000 7fd4bb7fe700 1 --2- 172.21.15.149:0/1111045510 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd4a806af00 0x7fd4a806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:24:57.881 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.867+0000 7fd4bb7fe700 1 --2- 172.21.15.149:0/1111045510 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd4a806af00 0x7fd4a806d3c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac009840 tx=0x7fd4ac008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:24:57.881 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:57.871+0000 7fd4b8ff9700 1 -- 172.21.15.149:0/1111045510 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd4b0053b30 con 0x7fd4bc0cb130 2023-11-08T19:24:58.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:58.058+0000 7fd4c27c0700 1 -- 172.21.15.149:0/1111045510 --> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd4bc0b1a90 con 0x7fd4a806af00 2023-11-08T19:24:58.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:58.067+0000 7fd4b8ff9700 1 -- 172.21.15.149:0/1111045510 <== mgr.4104 v2:172.21.15.149:6832/1929837472 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+370586 (secure 0 0 0) 0x7fd4ac0042a0 con 0x7fd4a806af00 2023-11-08T19:24:58.073 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:24:58.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:58.071+0000 7fd4c27c0700 1 -- 172.21.15.149:0/1111045510 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd4a806af00 msgr2=0x7fd4a806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:58.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:58.071+0000 7fd4c27c0700 1 --2- 172.21.15.149:0/1111045510 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd4a806af00 0x7fd4a806d3c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac009840 tx=0x7fd4ac008030 comp rx=0 tx=0).stop 2023-11-08T19:24:58.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:58.071+0000 7fd4c27c0700 1 -- 172.21.15.149:0/1111045510 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4bc0cb130 msgr2=0x7fd4bc09a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:24:58.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:58.071+0000 7fd4c27c0700 1 --2- 172.21.15.149:0/1111045510 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4bc0cb130 0x7fd4bc09a340 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fd4b000c700 tx=0x7fd4b000ca10 comp rx=0 tx=0).stop 2023-11-08T19:24:58.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:58.071+0000 7fd4c27c0700 1 -- 172.21.15.149:0/1111045510 shutdown_connections 2023-11-08T19:24:58.078 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:58.071+0000 7fd4c27c0700 1 --2- 172.21.15.149:0/1111045510 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd4a806af00 0x7fd4a806d3c0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:58.078 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:58.071+0000 7fd4c27c0700 1 --2- 172.21.15.149:0/1111045510 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd4bc0cc910 0x7fd4bc1f32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:58.078 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:58.071+0000 7fd4c27c0700 1 --2- 172.21.15.149:0/1111045510 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4bc0cb130 0x7fd4bc09a340 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:58.078 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:58.071+0000 7fd4c27c0700 1 --2- 172.21.15.149:0/1111045510 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd4bc0cc140 0x7fd4bc15eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:24:58.078 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:58.071+0000 7fd4c27c0700 1 -- 172.21.15.149:0/1111045510 >> 172.21.15.149:0/1111045510 conn(0x7fd4bc099a40 msgr2=0x7fd4bc0d02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:24:58.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:58.071+0000 7fd4c27c0700 1 -- 172.21.15.149:0/1111045510 shutdown_connections 2023-11-08T19:24:58.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:24:58.071+0000 7fd4c27c0700 1 -- 172.21.15.149:0/1111045510 wait complete. 2023-11-08T19:24:58.079 INFO:teuthology.orchestra.run.smithi149.stderr:dumped all 2023-11-08T19:24:58.084 INFO:teuthology.orchestra.run.smithi149.stdout:{"pg_ready":true,"pg_map":{"version":109,"stamp":"2023-11-08T19:24:58.010566+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":258,"acting":258,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":211,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222524,"kb_used_data":6344,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752196,"statfs":{"total":773094113280,"available":772866248704,"internally_reserved":0,"allocated":6496256,"data_stored":3572204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.676999"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.859265+0000","last_change":"2023-11-08T19:24:52.367968+0000","last_active":"2023-11-08T19:24:54.859265+0000","last_peered":"2023-11-08T19:24:54.859265+0000","last_clean":"2023-11-08T19:24:54.859265+0000","last_became_active":"2023-11-08T19:24:52.365264+0000","last_became_peered":"2023-11-08T19:24:52.365264+0000","last_unstale":"2023-11-08T19:24:54.859265+0000","last_undegraded":"2023-11-08T19:24:54.859265+0000","last_fullsized":"2023-11-08T19:24:54.859265+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:22:17.196492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.859784+0000","last_change":"2023-11-08T19:24:52.359850+0000","last_active":"2023-11-08T19:24:54.859784+0000","last_peered":"2023-11-08T19:24:54.859784+0000","last_clean":"2023-11-08T19:24:54.859784+0000","last_became_active":"2023-11-08T19:24:52.359572+0000","last_became_peered":"2023-11-08T19:24:52.359572+0000","last_unstale":"2023-11-08T19:24:54.859784+0000","last_undegraded":"2023-11-08T19:24:54.859784+0000","last_fullsized":"2023-11-08T19:24:54.859784+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:25:28.471025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353924+0000","last_change":"2023-11-08T19:24:52.381786+0000","last_active":"2023-11-08T19:24:53.353924+0000","last_peered":"2023-11-08T19:24:53.353924+0000","last_clean":"2023-11-08T19:24:53.353924+0000","last_became_active":"2023-11-08T19:24:52.381496+0000","last_became_peered":"2023-11-08T19:24:52.381496+0000","last_unstale":"2023-11-08T19:24:53.353924+0000","last_undegraded":"2023-11-08T19:24:53.353924+0000","last_fullsized":"2023-11-08T19:24:53.353924+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:28:32.868165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.352340+0000","last_change":"2023-11-08T19:24:52.370764+0000","last_active":"2023-11-08T19:24:53.352340+0000","last_peered":"2023-11-08T19:24:53.352340+0000","last_clean":"2023-11-08T19:24:53.352340+0000","last_became_active":"2023-11-08T19:24:52.370278+0000","last_became_peered":"2023-11-08T19:24:52.370278+0000","last_unstale":"2023-11-08T19:24:53.352340+0000","last_undegraded":"2023-11-08T19:24:53.352340+0000","last_fullsized":"2023-11-08T19:24:53.352340+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:46:51.125293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.860228+0000","last_change":"2023-11-08T19:24:52.370644+0000","last_active":"2023-11-08T19:24:54.860228+0000","last_peered":"2023-11-08T19:24:54.860228+0000","last_clean":"2023-11-08T19:24:54.860228+0000","last_became_active":"2023-11-08T19:24:52.370354+0000","last_became_peered":"2023-11-08T19:24:52.370354+0000","last_unstale":"2023-11-08T19:24:54.860228+0000","last_undegraded":"2023-11-08T19:24:54.860228+0000","last_fullsized":"2023-11-08T19:24:54.860228+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:40:25.469051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.625404+0000","last_change":"2023-11-08T19:24:52.369422+0000","last_active":"2023-11-08T19:24:54.625404+0000","last_peered":"2023-11-08T19:24:54.625404+0000","last_clean":"2023-11-08T19:24:54.625404+0000","last_became_active":"2023-11-08T19:24:52.369171+0000","last_became_peered":"2023-11-08T19:24:52.369171+0000","last_unstale":"2023-11-08T19:24:54.625404+0000","last_undegraded":"2023-11-08T19:24:54.625404+0000","last_fullsized":"2023-11-08T19:24:54.625404+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:46:51.125293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.352273+0000","last_change":"2023-11-08T19:24:52.367757+0000","last_active":"2023-11-08T19:24:53.352273+0000","last_peered":"2023-11-08T19:24:53.352273+0000","last_clean":"2023-11-08T19:24:53.352273+0000","last_became_active":"2023-11-08T19:24:52.367419+0000","last_became_peered":"2023-11-08T19:24:52.367419+0000","last_unstale":"2023-11-08T19:24:53.352273+0000","last_undegraded":"2023-11-08T19:24:53.352273+0000","last_fullsized":"2023-11-08T19:24:53.352273+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:19:42.465079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.858886+0000","last_change":"2023-11-08T19:24:52.362457+0000","last_active":"2023-11-08T19:24:54.858886+0000","last_peered":"2023-11-08T19:24:54.858886+0000","last_clean":"2023-11-08T19:24:54.858886+0000","last_became_active":"2023-11-08T19:24:52.362171+0000","last_became_peered":"2023-11-08T19:24:52.362171+0000","last_unstale":"2023-11-08T19:24:54.858886+0000","last_undegraded":"2023-11-08T19:24:54.858886+0000","last_fullsized":"2023-11-08T19:24:54.858886+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:23:24.004572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.352552+0000","last_change":"2023-11-08T19:24:52.374131+0000","last_active":"2023-11-08T19:24:53.352552+0000","last_peered":"2023-11-08T19:24:53.352552+0000","last_clean":"2023-11-08T19:24:53.352552+0000","last_became_active":"2023-11-08T19:24:52.373820+0000","last_became_peered":"2023-11-08T19:24:52.373820+0000","last_unstale":"2023-11-08T19:24:53.352552+0000","last_undegraded":"2023-11-08T19:24:53.352552+0000","last_fullsized":"2023-11-08T19:24:53.352552+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:34:00.935120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.859473+0000","last_change":"2023-11-08T19:24:52.368000+0000","last_active":"2023-11-08T19:24:54.859473+0000","last_peered":"2023-11-08T19:24:54.859473+0000","last_clean":"2023-11-08T19:24:54.859473+0000","last_became_active":"2023-11-08T19:24:52.367732+0000","last_became_peered":"2023-11-08T19:24:52.367732+0000","last_unstale":"2023-11-08T19:24:54.859473+0000","last_undegraded":"2023-11-08T19:24:54.859473+0000","last_fullsized":"2023-11-08T19:24:54.859473+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:50:54.639097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.859207+0000","last_change":"2023-11-08T19:24:52.357810+0000","last_active":"2023-11-08T19:24:54.859207+0000","last_peered":"2023-11-08T19:24:54.859207+0000","last_clean":"2023-11-08T19:24:54.859207+0000","last_became_active":"2023-11-08T19:24:52.357547+0000","last_became_peered":"2023-11-08T19:24:52.357547+0000","last_unstale":"2023-11-08T19:24:54.859207+0000","last_undegraded":"2023-11-08T19:24:54.859207+0000","last_fullsized":"2023-11-08T19:24:54.859207+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:23:44.153863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.352484+0000","last_change":"2023-11-08T19:24:52.370548+0000","last_active":"2023-11-08T19:24:53.352484+0000","last_peered":"2023-11-08T19:24:53.352484+0000","last_clean":"2023-11-08T19:24:53.352484+0000","last_became_active":"2023-11-08T19:24:52.369904+0000","last_became_peered":"2023-11-08T19:24:52.369904+0000","last_unstale":"2023-11-08T19:24:53.352484+0000","last_undegraded":"2023-11-08T19:24:53.352484+0000","last_fullsized":"2023-11-08T19:24:53.352484+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:08:17.924911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.446707+0000","last_change":"2023-11-08T19:24:52.371639+0000","last_active":"2023-11-08T19:24:53.446707+0000","last_peered":"2023-11-08T19:24:53.446707+0000","last_clean":"2023-11-08T19:24:53.446707+0000","last_became_active":"2023-11-08T19:24:52.371414+0000","last_became_peered":"2023-11-08T19:24:52.371414+0000","last_unstale":"2023-11-08T19:24:53.446707+0000","last_undegraded":"2023-11-08T19:24:53.446707+0000","last_fullsized":"2023-11-08T19:24:53.446707+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:23:44.153863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.352325+0000","last_change":"2023-11-08T19:24:52.366038+0000","last_active":"2023-11-08T19:24:53.352325+0000","last_peered":"2023-11-08T19:24:53.352325+0000","last_clean":"2023-11-08T19:24:53.352325+0000","last_became_active":"2023-11-08T19:24:52.365764+0000","last_became_peered":"2023-11-08T19:24:52.365764+0000","last_unstale":"2023-11-08T19:24:53.352325+0000","last_undegraded":"2023-11-08T19:24:53.352325+0000","last_fullsized":"2023-11-08T19:24:53.352325+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:04:17.106623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.352445+0000","last_change":"2023-11-08T19:24:52.368437+0000","last_active":"2023-11-08T19:24:53.352445+0000","last_peered":"2023-11-08T19:24:53.352445+0000","last_clean":"2023-11-08T19:24:53.352445+0000","last_became_active":"2023-11-08T19:24:52.368190+0000","last_became_peered":"2023-11-08T19:24:52.368190+0000","last_unstale":"2023-11-08T19:24:53.352445+0000","last_undegraded":"2023-11-08T19:24:53.352445+0000","last_fullsized":"2023-11-08T19:24:53.352445+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:53:42.472906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.625352+0000","last_change":"2023-11-08T19:24:52.372411+0000","last_active":"2023-11-08T19:24:54.625352+0000","last_peered":"2023-11-08T19:24:54.625352+0000","last_clean":"2023-11-08T19:24:54.625352+0000","last_became_active":"2023-11-08T19:24:52.372145+0000","last_became_peered":"2023-11-08T19:24:52.372145+0000","last_unstale":"2023-11-08T19:24:54.625352+0000","last_undegraded":"2023-11-08T19:24:54.625352+0000","last_fullsized":"2023-11-08T19:24:54.625352+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:23:49.083463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.859820+0000","last_change":"2023-11-08T19:24:52.367733+0000","last_active":"2023-11-08T19:24:54.859820+0000","last_peered":"2023-11-08T19:24:54.859820+0000","last_clean":"2023-11-08T19:24:54.859820+0000","last_became_active":"2023-11-08T19:24:52.367408+0000","last_became_peered":"2023-11-08T19:24:52.367408+0000","last_unstale":"2023-11-08T19:24:54.859820+0000","last_undegraded":"2023-11-08T19:24:54.859820+0000","last_fullsized":"2023-11-08T19:24:54.859820+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:20:13.353504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353027+0000","last_change":"2023-11-08T19:24:52.376347+0000","last_active":"2023-11-08T19:24:53.353027+0000","last_peered":"2023-11-08T19:24:53.353027+0000","last_clean":"2023-11-08T19:24:53.353027+0000","last_became_active":"2023-11-08T19:24:52.375849+0000","last_became_peered":"2023-11-08T19:24:52.375849+0000","last_unstale":"2023-11-08T19:24:53.353027+0000","last_undegraded":"2023-11-08T19:24:53.353027+0000","last_fullsized":"2023-11-08T19:24:53.353027+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:31:56.573763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.859936+0000","last_change":"2023-11-08T19:24:52.365022+0000","last_active":"2023-11-08T19:24:54.859936+0000","last_peered":"2023-11-08T19:24:54.859936+0000","last_clean":"2023-11-08T19:24:54.859936+0000","last_became_active":"2023-11-08T19:24:52.364699+0000","last_became_peered":"2023-11-08T19:24:52.364699+0000","last_unstale":"2023-11-08T19:24:54.859936+0000","last_undegraded":"2023-11-08T19:24:54.859936+0000","last_fullsized":"2023-11-08T19:24:54.859936+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:31:45.750319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.859034+0000","last_change":"2023-11-08T19:24:52.369315+0000","last_active":"2023-11-08T19:24:54.859034+0000","last_peered":"2023-11-08T19:24:54.859034+0000","last_clean":"2023-11-08T19:24:54.859034+0000","last_became_active":"2023-11-08T19:24:52.368967+0000","last_became_peered":"2023-11-08T19:24:52.368967+0000","last_unstale":"2023-11-08T19:24:54.859034+0000","last_undegraded":"2023-11-08T19:24:54.859034+0000","last_fullsized":"2023-11-08T19:24:54.859034+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:20:19.983408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353154+0000","last_change":"2023-11-08T19:24:52.378669+0000","last_active":"2023-11-08T19:24:53.353154+0000","last_peered":"2023-11-08T19:24:53.353154+0000","last_clean":"2023-11-08T19:24:53.353154+0000","last_became_active":"2023-11-08T19:24:52.378389+0000","last_became_peered":"2023-11-08T19:24:52.378389+0000","last_unstale":"2023-11-08T19:24:53.353154+0000","last_undegraded":"2023-11-08T19:24:53.353154+0000","last_fullsized":"2023-11-08T19:24:53.353154+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:46:31.594290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.859005+0000","last_change":"2023-11-08T19:24:52.371063+0000","last_active":"2023-11-08T19:24:54.859005+0000","last_peered":"2023-11-08T19:24:54.859005+0000","last_clean":"2023-11-08T19:24:54.859005+0000","last_became_active":"2023-11-08T19:24:52.370659+0000","last_became_peered":"2023-11-08T19:24:52.370659+0000","last_unstale":"2023-11-08T19:24:54.859005+0000","last_undegraded":"2023-11-08T19:24:54.859005+0000","last_fullsized":"2023-11-08T19:24:54.859005+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:51:12.721130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353446+0000","last_change":"2023-11-08T19:24:52.381743+0000","last_active":"2023-11-08T19:24:53.353446+0000","last_peered":"2023-11-08T19:24:53.353446+0000","last_clean":"2023-11-08T19:24:53.353446+0000","last_became_active":"2023-11-08T19:24:52.381427+0000","last_became_peered":"2023-11-08T19:24:52.381427+0000","last_unstale":"2023-11-08T19:24:53.353446+0000","last_undegraded":"2023-11-08T19:24:53.353446+0000","last_fullsized":"2023-11-08T19:24:53.353446+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:46:51.125293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.446369+0000","last_change":"2023-11-08T19:24:52.379334+0000","last_active":"2023-11-08T19:24:53.446369+0000","last_peered":"2023-11-08T19:24:53.446369+0000","last_clean":"2023-11-08T19:24:53.446369+0000","last_became_active":"2023-11-08T19:24:52.379044+0000","last_became_peered":"2023-11-08T19:24:52.379044+0000","last_unstale":"2023-11-08T19:24:53.446369+0000","last_undegraded":"2023-11-08T19:24:53.446369+0000","last_fullsized":"2023-11-08T19:24:53.446369+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:34:00.935120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.859445+0000","last_change":"2023-11-08T19:24:52.366987+0000","last_active":"2023-11-08T19:24:54.859445+0000","last_peered":"2023-11-08T19:24:54.859445+0000","last_clean":"2023-11-08T19:24:54.859445+0000","last_became_active":"2023-11-08T19:24:52.365321+0000","last_became_peered":"2023-11-08T19:24:52.365321+0000","last_unstale":"2023-11-08T19:24:54.859445+0000","last_undegraded":"2023-11-08T19:24:54.859445+0000","last_fullsized":"2023-11-08T19:24:54.859445+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:47.290986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.351822+0000","last_change":"2023-11-08T19:24:52.373160+0000","last_active":"2023-11-08T19:24:53.351822+0000","last_peered":"2023-11-08T19:24:53.351822+0000","last_clean":"2023-11-08T19:24:53.351822+0000","last_became_active":"2023-11-08T19:24:52.372873+0000","last_became_peered":"2023-11-08T19:24:52.372873+0000","last_unstale":"2023-11-08T19:24:53.351822+0000","last_undegraded":"2023-11-08T19:24:53.351822+0000","last_fullsized":"2023-11-08T19:24:53.351822+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:46:31.594290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.625623+0000","last_change":"2023-11-08T19:24:52.371810+0000","last_active":"2023-11-08T19:24:54.625623+0000","last_peered":"2023-11-08T19:24:54.625623+0000","last_clean":"2023-11-08T19:24:54.625623+0000","last_became_active":"2023-11-08T19:24:52.371516+0000","last_became_peered":"2023-11-08T19:24:52.371516+0000","last_unstale":"2023-11-08T19:24:54.625623+0000","last_undegraded":"2023-11-08T19:24:54.625623+0000","last_fullsized":"2023-11-08T19:24:54.625623+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:08:17.924911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.859297+0000","last_change":"2023-11-08T19:24:52.370855+0000","last_active":"2023-11-08T19:24:54.859297+0000","last_peered":"2023-11-08T19:24:54.859297+0000","last_clean":"2023-11-08T19:24:54.859297+0000","last_became_active":"2023-11-08T19:24:52.370508+0000","last_became_peered":"2023-11-08T19:24:52.370508+0000","last_unstale":"2023-11-08T19:24:54.859297+0000","last_undegraded":"2023-11-08T19:24:54.859297+0000","last_fullsized":"2023-11-08T19:24:54.859297+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:09:26.091318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.859197+0000","last_change":"2023-11-08T19:24:52.360652+0000","last_active":"2023-11-08T19:24:54.859197+0000","last_peered":"2023-11-08T19:24:54.859197+0000","last_clean":"2023-11-08T19:24:54.859197+0000","last_became_active":"2023-11-08T19:24:52.360372+0000","last_became_peered":"2023-11-08T19:24:52.360372+0000","last_unstale":"2023-11-08T19:24:54.859197+0000","last_undegraded":"2023-11-08T19:24:54.859197+0000","last_fullsized":"2023-11-08T19:24:54.859197+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:19:12.808598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353428+0000","last_change":"2023-11-08T19:24:52.375322+0000","last_active":"2023-11-08T19:24:53.353428+0000","last_peered":"2023-11-08T19:24:53.353428+0000","last_clean":"2023-11-08T19:24:53.353428+0000","last_became_active":"2023-11-08T19:24:52.375013+0000","last_became_peered":"2023-11-08T19:24:52.375013+0000","last_unstale":"2023-11-08T19:24:53.353428+0000","last_undegraded":"2023-11-08T19:24:53.353428+0000","last_fullsized":"2023-11-08T19:24:53.353428+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:14:05.670963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.859148+0000","last_change":"2023-11-08T19:24:52.363157+0000","last_active":"2023-11-08T19:24:54.859148+0000","last_peered":"2023-11-08T19:24:54.859148+0000","last_clean":"2023-11-08T19:24:54.859148+0000","last_became_active":"2023-11-08T19:24:52.362889+0000","last_became_peered":"2023-11-08T19:24:52.362889+0000","last_unstale":"2023-11-08T19:24:54.859148+0000","last_undegraded":"2023-11-08T19:24:54.859148+0000","last_fullsized":"2023-11-08T19:24:54.859148+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:25:39.567729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.625400+0000","last_change":"2023-11-08T19:24:52.367182+0000","last_active":"2023-11-08T19:24:54.625400+0000","last_peered":"2023-11-08T19:24:54.625400+0000","last_clean":"2023-11-08T19:24:54.625400+0000","last_became_active":"2023-11-08T19:24:52.366873+0000","last_became_peered":"2023-11-08T19:24:52.366873+0000","last_unstale":"2023-11-08T19:24:54.625400+0000","last_undegraded":"2023-11-08T19:24:54.625400+0000","last_fullsized":"2023-11-08T19:24:54.625400+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:26:22.628067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.352833+0000","last_change":"2023-11-08T19:24:52.378669+0000","last_active":"2023-11-08T19:24:53.352833+0000","last_peered":"2023-11-08T19:24:53.352833+0000","last_clean":"2023-11-08T19:24:53.352833+0000","last_became_active":"2023-11-08T19:24:52.378393+0000","last_became_peered":"2023-11-08T19:24:52.378393+0000","last_unstale":"2023-11-08T19:24:53.352833+0000","last_undegraded":"2023-11-08T19:24:53.352833+0000","last_fullsized":"2023-11-08T19:24:53.352833+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:26:04.745188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.358783+0000","last_change":"2023-11-08T19:24:51.344739+0000","last_active":"2023-11-08T19:24:52.358783+0000","last_peered":"2023-11-08T19:24:52.358783+0000","last_clean":"2023-11-08T19:24:52.358783+0000","last_became_active":"2023-11-08T19:24:51.344471+0000","last_became_peered":"2023-11-08T19:24:51.344471+0000","last_unstale":"2023-11-08T19:24:52.358783+0000","last_undegraded":"2023-11-08T19:24:52.358783+0000","last_fullsized":"2023-11-08T19:24:52.358783+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:28:19.340370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":27,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.354730+0000","last_change":"2023-11-08T19:24:32.263958+0000","last_active":"2023-11-08T19:24:52.354730+0000","last_peered":"2023-11-08T19:24:52.354730+0000","last_clean":"2023-11-08T19:24:52.354730+0000","last_became_active":"2023-11-08T19:24:31.149011+0000","last_became_peered":"2023-11-08T19:24:31.149011+0000","last_unstale":"2023-11-08T19:24:52.354730+0000","last_undegraded":"2023-11-08T19:24:52.354730+0000","last_fullsized":"2023-11-08T19:24:52.354730+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:09:04.880374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033496900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.351767+0000","last_change":"2023-11-08T19:24:52.361506+0000","last_active":"2023-11-08T19:24:53.351767+0000","last_peered":"2023-11-08T19:24:53.351767+0000","last_clean":"2023-11-08T19:24:53.351767+0000","last_became_active":"2023-11-08T19:24:52.361223+0000","last_became_peered":"2023-11-08T19:24:52.361223+0000","last_unstale":"2023-11-08T19:24:53.351767+0000","last_undegraded":"2023-11-08T19:24:53.351767+0000","last_fullsized":"2023-11-08T19:24:53.351767+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:31:56.573763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"54'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.383486+0000","last_change":"2023-11-08T19:24:51.356485+0000","last_active":"2023-11-08T19:24:52.383486+0000","last_peered":"2023-11-08T19:24:52.383486+0000","last_clean":"2023-11-08T19:24:52.383486+0000","last_became_active":"2023-11-08T19:24:51.356229+0000","last_became_peered":"2023-11-08T19:24:51.356229+0000","last_unstale":"2023-11-08T19:24:52.383486+0000","last_undegraded":"2023-11-08T19:24:52.383486+0000","last_fullsized":"2023-11-08T19:24:52.383486+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:14:04.664412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":27,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.357501+0000","last_change":"2023-11-08T19:24:32.142892+0000","last_active":"2023-11-08T19:24:52.357501+0000","last_peered":"2023-11-08T19:24:52.357501+0000","last_clean":"2023-11-08T19:24:52.357501+0000","last_became_active":"2023-11-08T19:24:31.144912+0000","last_became_peered":"2023-11-08T19:24:31.144912+0000","last_unstale":"2023-11-08T19:24:52.357501+0000","last_undegraded":"2023-11-08T19:24:52.357501+0000","last_fullsized":"2023-11-08T19:24:52.357501+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:04:21.151484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056686900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353024+0000","last_change":"2023-11-08T19:24:52.381898+0000","last_active":"2023-11-08T19:24:53.353024+0000","last_peered":"2023-11-08T19:24:53.353024+0000","last_clean":"2023-11-08T19:24:53.353024+0000","last_became_active":"2023-11-08T19:24:52.381474+0000","last_became_peered":"2023-11-08T19:24:52.381474+0000","last_unstale":"2023-11-08T19:24:53.353024+0000","last_undegraded":"2023-11-08T19:24:53.353024+0000","last_fullsized":"2023-11-08T19:24:53.353024+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:45:51.213375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"54'8","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353655+0000","last_change":"2023-11-08T19:24:51.353683+0000","last_active":"2023-11-08T19:24:53.353655+0000","last_peered":"2023-11-08T19:24:53.353655+0000","last_clean":"2023-11-08T19:24:53.353655+0000","last_became_active":"2023-11-08T19:24:51.353201+0000","last_became_peered":"2023-11-08T19:24:51.353201+0000","last_unstale":"2023-11-08T19:24:53.353655+0000","last_undegraded":"2023-11-08T19:24:53.353655+0000","last_fullsized":"2023-11-08T19:24:53.353655+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:53:41.466355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":28,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.358536+0000","last_change":"2023-11-08T19:24:32.140514+0000","last_active":"2023-11-08T19:24:52.358536+0000","last_peered":"2023-11-08T19:24:52.358536+0000","last_clean":"2023-11-08T19:24:52.358536+0000","last_became_active":"2023-11-08T19:24:31.146668+0000","last_became_peered":"2023-11-08T19:24:31.146668+0000","last_unstale":"2023-11-08T19:24:52.358536+0000","last_undegraded":"2023-11-08T19:24:52.358536+0000","last_fullsized":"2023-11-08T19:24:52.358536+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:31:24.539374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071576699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353446+0000","last_change":"2023-11-08T19:24:52.372375+0000","last_active":"2023-11-08T19:24:53.353446+0000","last_peered":"2023-11-08T19:24:53.353446+0000","last_clean":"2023-11-08T19:24:53.353446+0000","last_became_active":"2023-11-08T19:24:52.372011+0000","last_became_peered":"2023-11-08T19:24:52.372011+0000","last_unstale":"2023-11-08T19:24:53.353446+0000","last_undegraded":"2023-11-08T19:24:53.353446+0000","last_fullsized":"2023-11-08T19:24:53.353446+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:23:44.153863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.357101+0000","last_change":"2023-11-08T19:24:51.350477+0000","last_active":"2023-11-08T19:24:52.357101+0000","last_peered":"2023-11-08T19:24:52.357101+0000","last_clean":"2023-11-08T19:24:52.357101+0000","last_became_active":"2023-11-08T19:24:51.350209+0000","last_became_peered":"2023-11-08T19:24:51.350209+0000","last_unstale":"2023-11-08T19:24:52.357101+0000","last_undegraded":"2023-11-08T19:24:52.357101+0000","last_fullsized":"2023-11-08T19:24:52.357101+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:54:16.702041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":27,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.355183+0000","last_change":"2023-11-08T19:24:32.263963+0000","last_active":"2023-11-08T19:24:52.355183+0000","last_peered":"2023-11-08T19:24:52.355183+0000","last_clean":"2023-11-08T19:24:52.355183+0000","last_became_active":"2023-11-08T19:24:31.139062+0000","last_became_peered":"2023-11-08T19:24:31.139062+0000","last_unstale":"2023-11-08T19:24:52.355183+0000","last_undegraded":"2023-11-08T19:24:52.355183+0000","last_fullsized":"2023-11-08T19:24:52.355183+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:26.080042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033682599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353734+0000","last_change":"2023-11-08T19:24:52.376929+0000","last_active":"2023-11-08T19:24:53.353734+0000","last_peered":"2023-11-08T19:24:53.353734+0000","last_clean":"2023-11-08T19:24:53.353734+0000","last_became_active":"2023-11-08T19:24:52.376602+0000","last_became_peered":"2023-11-08T19:24:52.376602+0000","last_unstale":"2023-11-08T19:24:53.353734+0000","last_undegraded":"2023-11-08T19:24:53.353734+0000","last_fullsized":"2023-11-08T19:24:53.353734+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:14:34.758666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.351846+0000","last_change":"2023-11-08T19:24:51.355801+0000","last_active":"2023-11-08T19:24:52.351846+0000","last_peered":"2023-11-08T19:24:52.351846+0000","last_clean":"2023-11-08T19:24:52.351846+0000","last_became_active":"2023-11-08T19:24:51.355235+0000","last_became_peered":"2023-11-08T19:24:51.355235+0000","last_unstale":"2023-11-08T19:24:52.351846+0000","last_undegraded":"2023-11-08T19:24:52.351846+0000","last_fullsized":"2023-11-08T19:24:52.351846+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:51:27.832603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":28,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.359977+0000","last_change":"2023-11-08T19:24:32.141131+0000","last_active":"2023-11-08T19:24:52.359977+0000","last_peered":"2023-11-08T19:24:52.359977+0000","last_clean":"2023-11-08T19:24:52.359977+0000","last_became_active":"2023-11-08T19:24:31.146154+0000","last_became_peered":"2023-11-08T19:24:31.146154+0000","last_unstale":"2023-11-08T19:24:52.359977+0000","last_undegraded":"2023-11-08T19:24:52.359977+0000","last_fullsized":"2023-11-08T19:24:52.359977+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:18:40.271560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082432800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.352911+0000","last_change":"2023-11-08T19:24:52.363813+0000","last_active":"2023-11-08T19:24:53.352911+0000","last_peered":"2023-11-08T19:24:53.352911+0000","last_clean":"2023-11-08T19:24:53.352911+0000","last_became_active":"2023-11-08T19:24:52.363528+0000","last_became_peered":"2023-11-08T19:24:52.363528+0000","last_unstale":"2023-11-08T19:24:53.352911+0000","last_undegraded":"2023-11-08T19:24:53.352911+0000","last_fullsized":"2023-11-08T19:24:53.352911+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:33:39.146820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353882+0000","last_change":"2023-11-08T19:24:51.355043+0000","last_active":"2023-11-08T19:24:53.353882+0000","last_peered":"2023-11-08T19:24:53.353882+0000","last_clean":"2023-11-08T19:24:53.353882+0000","last_became_active":"2023-11-08T19:24:51.354777+0000","last_became_peered":"2023-11-08T19:24:51.354777+0000","last_unstale":"2023-11-08T19:24:53.353882+0000","last_undegraded":"2023-11-08T19:24:53.353882+0000","last_fullsized":"2023-11-08T19:24:53.353882+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:04:50.527868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":27,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.357143+0000","last_change":"2023-11-08T19:24:32.529486+0000","last_active":"2023-11-08T19:24:52.357143+0000","last_peered":"2023-11-08T19:24:52.357143+0000","last_clean":"2023-11-08T19:24:52.357143+0000","last_became_active":"2023-11-08T19:24:31.146260+0000","last_became_peered":"2023-11-08T19:24:31.146260+0000","last_unstale":"2023-11-08T19:24:52.357143+0000","last_undegraded":"2023-11-08T19:24:52.357143+0000","last_fullsized":"2023-11-08T19:24:52.357143+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:45:34.425432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059842900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353445+0000","last_change":"2023-11-08T19:24:52.375932+0000","last_active":"2023-11-08T19:24:53.353445+0000","last_peered":"2023-11-08T19:24:53.353445+0000","last_clean":"2023-11-08T19:24:53.353445+0000","last_became_active":"2023-11-08T19:24:52.375648+0000","last_became_peered":"2023-11-08T19:24:52.375648+0000","last_unstale":"2023-11-08T19:24:53.353445+0000","last_undegraded":"2023-11-08T19:24:53.353445+0000","last_fullsized":"2023-11-08T19:24:53.353445+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:26:22.628067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"54'6","reported_seq":18,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.386499+0000","last_change":"2023-11-08T19:24:51.351444+0000","last_active":"2023-11-08T19:24:52.386499+0000","last_peered":"2023-11-08T19:24:52.386499+0000","last_clean":"2023-11-08T19:24:52.386499+0000","last_became_active":"2023-11-08T19:24:51.351187+0000","last_became_peered":"2023-11-08T19:24:51.351187+0000","last_unstale":"2023-11-08T19:24:52.386499+0000","last_undegraded":"2023-11-08T19:24:52.386499+0000","last_fullsized":"2023-11-08T19:24:52.386499+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:28:19.340370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":27,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.357446+0000","last_change":"2023-11-08T19:24:32.530168+0000","last_active":"2023-11-08T19:24:52.357446+0000","last_peered":"2023-11-08T19:24:52.357446+0000","last_clean":"2023-11-08T19:24:52.357446+0000","last_became_active":"2023-11-08T19:24:31.144329+0000","last_became_peered":"2023-11-08T19:24:31.144329+0000","last_unstale":"2023-11-08T19:24:52.357446+0000","last_undegraded":"2023-11-08T19:24:52.357446+0000","last_fullsized":"2023-11-08T19:24:52.357446+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:05:36.085920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043484799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.858934+0000","last_change":"2023-11-08T19:24:52.373986+0000","last_active":"2023-11-08T19:24:54.858934+0000","last_peered":"2023-11-08T19:24:54.858934+0000","last_clean":"2023-11-08T19:24:54.858934+0000","last_became_active":"2023-11-08T19:24:52.373000+0000","last_became_peered":"2023-11-08T19:24:52.373000+0000","last_unstale":"2023-11-08T19:24:54.858934+0000","last_undegraded":"2023-11-08T19:24:54.858934+0000","last_fullsized":"2023-11-08T19:24:54.858934+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:34:00.935120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"54'3","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353873+0000","last_change":"2023-11-08T19:24:51.352040+0000","last_active":"2023-11-08T19:24:53.353873+0000","last_peered":"2023-11-08T19:24:53.353873+0000","last_clean":"2023-11-08T19:24:53.353873+0000","last_became_active":"2023-11-08T19:24:51.351762+0000","last_became_peered":"2023-11-08T19:24:51.351762+0000","last_unstale":"2023-11-08T19:24:53.353873+0000","last_undegraded":"2023-11-08T19:24:53.353873+0000","last_fullsized":"2023-11-08T19:24:53.353873+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:04:59.430912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":29,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.363201+0000","last_change":"2023-11-08T19:24:32.141190+0000","last_active":"2023-11-08T19:24:52.363201+0000","last_peered":"2023-11-08T19:24:52.363201+0000","last_clean":"2023-11-08T19:24:52.363201+0000","last_became_active":"2023-11-08T19:24:31.147651+0000","last_became_peered":"2023-11-08T19:24:31.147651+0000","last_unstale":"2023-11-08T19:24:52.363201+0000","last_undegraded":"2023-11-08T19:24:52.363201+0000","last_fullsized":"2023-11-08T19:24:52.363201+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:21:55.985548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043673300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.859572+0000","last_change":"2023-11-08T19:24:52.373351+0000","last_active":"2023-11-08T19:24:54.859572+0000","last_peered":"2023-11-08T19:24:54.859572+0000","last_clean":"2023-11-08T19:24:54.859572+0000","last_became_active":"2023-11-08T19:24:52.373106+0000","last_became_peered":"2023-11-08T19:24:52.373106+0000","last_unstale":"2023-11-08T19:24:54.859572+0000","last_undegraded":"2023-11-08T19:24:54.859572+0000","last_fullsized":"2023-11-08T19:24:54.859572+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:41:24.012491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"54'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.383067+0000","last_change":"2023-11-08T19:24:51.351129+0000","last_active":"2023-11-08T19:24:52.383067+0000","last_peered":"2023-11-08T19:24:52.383067+0000","last_clean":"2023-11-08T19:24:52.383067+0000","last_became_active":"2023-11-08T19:24:51.350872+0000","last_became_peered":"2023-11-08T19:24:51.350872+0000","last_unstale":"2023-11-08T19:24:52.383067+0000","last_undegraded":"2023-11-08T19:24:52.383067+0000","last_fullsized":"2023-11-08T19:24:52.383067+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:04:59.430912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":27,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.368381+0000","last_change":"2023-11-08T19:24:32.147011+0000","last_active":"2023-11-08T19:24:52.368381+0000","last_peered":"2023-11-08T19:24:52.368381+0000","last_clean":"2023-11-08T19:24:52.368381+0000","last_became_active":"2023-11-08T19:24:31.148250+0000","last_became_peered":"2023-11-08T19:24:31.148250+0000","last_unstale":"2023-11-08T19:24:52.368381+0000","last_undegraded":"2023-11-08T19:24:52.368381+0000","last_fullsized":"2023-11-08T19:24:52.368381+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:01:25.647952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043061299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.859350+0000","last_change":"2023-11-08T19:24:52.370905+0000","last_active":"2023-11-08T19:24:54.859350+0000","last_peered":"2023-11-08T19:24:54.859350+0000","last_clean":"2023-11-08T19:24:54.859350+0000","last_became_active":"2023-11-08T19:24:52.370322+0000","last_became_peered":"2023-11-08T19:24:52.370322+0000","last_unstale":"2023-11-08T19:24:54.859350+0000","last_undegraded":"2023-11-08T19:24:54.859350+0000","last_fullsized":"2023-11-08T19:24:54.859350+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:58:36.921504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"54'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.383294+0000","last_change":"2023-11-08T19:24:51.355208+0000","last_active":"2023-11-08T19:24:52.383294+0000","last_peered":"2023-11-08T19:24:52.383294+0000","last_clean":"2023-11-08T19:24:52.383294+0000","last_became_active":"2023-11-08T19:24:51.354921+0000","last_became_peered":"2023-11-08T19:24:51.354921+0000","last_unstale":"2023-11-08T19:24:52.383294+0000","last_undegraded":"2023-11-08T19:24:52.383294+0000","last_fullsized":"2023-11-08T19:24:52.383294+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:32.064974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":27,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.350956+0000","last_change":"2023-11-08T19:24:32.543880+0000","last_active":"2023-11-08T19:24:52.350956+0000","last_peered":"2023-11-08T19:24:52.350956+0000","last_clean":"2023-11-08T19:24:52.350956+0000","last_became_active":"2023-11-08T19:24:31.142052+0000","last_became_peered":"2023-11-08T19:24:31.142052+0000","last_unstale":"2023-11-08T19:24:52.350956+0000","last_undegraded":"2023-11-08T19:24:52.350956+0000","last_fullsized":"2023-11-08T19:24:52.350956+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:18:42.371676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014881058000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.859573+0000","last_change":"2023-11-08T19:24:52.367908+0000","last_active":"2023-11-08T19:24:54.859573+0000","last_peered":"2023-11-08T19:24:54.859573+0000","last_clean":"2023-11-08T19:24:54.859573+0000","last_became_active":"2023-11-08T19:24:52.367593+0000","last_became_peered":"2023-11-08T19:24:52.367593+0000","last_unstale":"2023-11-08T19:24:54.859573+0000","last_undegraded":"2023-11-08T19:24:54.859573+0000","last_fullsized":"2023-11-08T19:24:54.859573+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:59:13.014364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.362184+0000","last_change":"2023-11-08T19:24:51.342514+0000","last_active":"2023-11-08T19:24:52.362184+0000","last_peered":"2023-11-08T19:24:52.362184+0000","last_clean":"2023-11-08T19:24:52.362184+0000","last_became_active":"2023-11-08T19:24:51.342249+0000","last_became_peered":"2023-11-08T19:24:51.342249+0000","last_unstale":"2023-11-08T19:24:52.362184+0000","last_undegraded":"2023-11-08T19:24:52.362184+0000","last_fullsized":"2023-11-08T19:24:52.362184+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:13:02.452701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":27,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.365352+0000","last_change":"2023-11-08T19:24:32.147235+0000","last_active":"2023-11-08T19:24:52.365352+0000","last_peered":"2023-11-08T19:24:52.365352+0000","last_clean":"2023-11-08T19:24:52.365352+0000","last_became_active":"2023-11-08T19:24:31.146176+0000","last_became_peered":"2023-11-08T19:24:31.146176+0000","last_unstale":"2023-11-08T19:24:52.365352+0000","last_undegraded":"2023-11-08T19:24:52.365352+0000","last_fullsized":"2023-11-08T19:24:52.365352+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:39.214888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048481000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.446453+0000","last_change":"2023-11-08T19:24:52.367571+0000","last_active":"2023-11-08T19:24:53.446453+0000","last_peered":"2023-11-08T19:24:53.446453+0000","last_clean":"2023-11-08T19:24:53.446453+0000","last_became_active":"2023-11-08T19:24:52.367160+0000","last_became_peered":"2023-11-08T19:24:52.367160+0000","last_unstale":"2023-11-08T19:24:53.446453+0000","last_undegraded":"2023-11-08T19:24:53.446453+0000","last_fullsized":"2023-11-08T19:24:53.446453+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:33:39.146820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.357221+0000","last_change":"2023-11-08T19:24:51.349310+0000","last_active":"2023-11-08T19:24:52.357221+0000","last_peered":"2023-11-08T19:24:52.357221+0000","last_clean":"2023-11-08T19:24:52.357221+0000","last_became_active":"2023-11-08T19:24:51.348861+0000","last_became_peered":"2023-11-08T19:24:51.348861+0000","last_unstale":"2023-11-08T19:24:52.357221+0000","last_undegraded":"2023-11-08T19:24:52.357221+0000","last_fullsized":"2023-11-08T19:24:52.357221+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:26:03.738637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":29,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.363182+0000","last_change":"2023-11-08T19:24:32.142376+0000","last_active":"2023-11-08T19:24:52.363182+0000","last_peered":"2023-11-08T19:24:52.363182+0000","last_clean":"2023-11-08T19:24:52.363182+0000","last_became_active":"2023-11-08T19:24:31.144614+0000","last_became_peered":"2023-11-08T19:24:31.144614+0000","last_unstale":"2023-11-08T19:24:52.363182+0000","last_undegraded":"2023-11-08T19:24:52.363182+0000","last_fullsized":"2023-11-08T19:24:52.363182+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:09:04.880374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050362200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.859606+0000","last_change":"2023-11-08T19:24:52.370652+0000","last_active":"2023-11-08T19:24:54.859606+0000","last_peered":"2023-11-08T19:24:54.859606+0000","last_clean":"2023-11-08T19:24:54.859606+0000","last_became_active":"2023-11-08T19:24:52.370397+0000","last_became_peered":"2023-11-08T19:24:52.370397+0000","last_unstale":"2023-11-08T19:24:54.859606+0000","last_undegraded":"2023-11-08T19:24:54.859606+0000","last_fullsized":"2023-11-08T19:24:54.859606+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:06:14.801846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"54'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.381302+0000","last_change":"2023-11-08T19:24:51.349114+0000","last_active":"2023-11-08T19:24:52.381302+0000","last_peered":"2023-11-08T19:24:52.381302+0000","last_clean":"2023-11-08T19:24:52.381302+0000","last_became_active":"2023-11-08T19:24:51.348851+0000","last_became_peered":"2023-11-08T19:24:51.348851+0000","last_unstale":"2023-11-08T19:24:52.381302+0000","last_undegraded":"2023-11-08T19:24:52.381302+0000","last_fullsized":"2023-11-08T19:24:52.381302+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:11:45.936608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":27,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.365437+0000","last_change":"2023-11-08T19:24:32.146639+0000","last_active":"2023-11-08T19:24:52.365437+0000","last_peered":"2023-11-08T19:24:52.365437+0000","last_clean":"2023-11-08T19:24:52.365437+0000","last_became_active":"2023-11-08T19:24:31.147384+0000","last_became_peered":"2023-11-08T19:24:31.147384+0000","last_unstale":"2023-11-08T19:24:52.365437+0000","last_undegraded":"2023-11-08T19:24:52.365437+0000","last_fullsized":"2023-11-08T19:24:52.365437+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:30:21.946303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043834899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.625920+0000","last_change":"2023-11-08T19:24:52.373714+0000","last_active":"2023-11-08T19:24:54.625920+0000","last_peered":"2023-11-08T19:24:54.625920+0000","last_clean":"2023-11-08T19:24:54.625920+0000","last_became_active":"2023-11-08T19:24:52.372836+0000","last_became_peered":"2023-11-08T19:24:52.372836+0000","last_unstale":"2023-11-08T19:24:54.625920+0000","last_undegraded":"2023-11-08T19:24:54.625920+0000","last_fullsized":"2023-11-08T19:24:54.625920+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:23:24.004572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"54'4","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.383290+0000","last_change":"2023-11-08T19:24:51.352238+0000","last_active":"2023-11-08T19:24:52.383290+0000","last_peered":"2023-11-08T19:24:52.383290+0000","last_clean":"2023-11-08T19:24:52.383290+0000","last_became_active":"2023-11-08T19:24:51.352005+0000","last_became_peered":"2023-11-08T19:24:51.352005+0000","last_unstale":"2023-11-08T19:24:52.383290+0000","last_undegraded":"2023-11-08T19:24:52.383290+0000","last_fullsized":"2023-11-08T19:24:52.383290+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:45:50.206824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":27,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.350574+0000","last_change":"2023-11-08T19:24:32.544108+0000","last_active":"2023-11-08T19:24:52.350574+0000","last_peered":"2023-11-08T19:24:52.350574+0000","last_clean":"2023-11-08T19:24:52.350574+0000","last_became_active":"2023-11-08T19:24:31.143812+0000","last_became_peered":"2023-11-08T19:24:31.143812+0000","last_unstale":"2023-11-08T19:24:52.350574+0000","last_undegraded":"2023-11-08T19:24:52.350574+0000","last_fullsized":"2023-11-08T19:24:52.350574+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:27:59.135977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014956126,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.625716+0000","last_change":"2023-11-08T19:24:52.368874+0000","last_active":"2023-11-08T19:24:54.625716+0000","last_peered":"2023-11-08T19:24:54.625716+0000","last_clean":"2023-11-08T19:24:54.625716+0000","last_became_active":"2023-11-08T19:24:52.368378+0000","last_became_peered":"2023-11-08T19:24:52.368378+0000","last_unstale":"2023-11-08T19:24:54.625716+0000","last_undegraded":"2023-11-08T19:24:54.625716+0000","last_fullsized":"2023-11-08T19:24:54.625716+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:28:32.868165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"54'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.382053+0000","last_change":"2023-11-08T19:24:51.349712+0000","last_active":"2023-11-08T19:24:52.382053+0000","last_peered":"2023-11-08T19:24:52.382053+0000","last_clean":"2023-11-08T19:24:52.382053+0000","last_became_active":"2023-11-08T19:24:51.349432+0000","last_became_peered":"2023-11-08T19:24:51.349432+0000","last_unstale":"2023-11-08T19:24:52.382053+0000","last_undegraded":"2023-11-08T19:24:52.382053+0000","last_fullsized":"2023-11-08T19:24:52.382053+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:45:50.206824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":27,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.363264+0000","last_change":"2023-11-08T19:24:32.530378+0000","last_active":"2023-11-08T19:24:52.363264+0000","last_peered":"2023-11-08T19:24:52.363264+0000","last_clean":"2023-11-08T19:24:52.363264+0000","last_became_active":"2023-11-08T19:24:31.144341+0000","last_became_peered":"2023-11-08T19:24:31.144341+0000","last_unstale":"2023-11-08T19:24:52.363264+0000","last_undegraded":"2023-11-08T19:24:52.363264+0000","last_fullsized":"2023-11-08T19:24:52.363264+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:30:21.946303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058308299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.625747+0000","last_change":"2023-11-08T19:24:52.366470+0000","last_active":"2023-11-08T19:24:54.625747+0000","last_peered":"2023-11-08T19:24:54.625747+0000","last_clean":"2023-11-08T19:24:54.625747+0000","last_became_active":"2023-11-08T19:24:52.366168+0000","last_became_peered":"2023-11-08T19:24:52.366168+0000","last_unstale":"2023-11-08T19:24:54.625747+0000","last_undegraded":"2023-11-08T19:24:54.625747+0000","last_fullsized":"2023-11-08T19:24:54.625747+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:11:46.943159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"54'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.383543+0000","last_change":"2023-11-08T19:24:51.352460+0000","last_active":"2023-11-08T19:24:52.383543+0000","last_peered":"2023-11-08T19:24:52.383543+0000","last_clean":"2023-11-08T19:24:52.383543+0000","last_became_active":"2023-11-08T19:24:51.352204+0000","last_became_peered":"2023-11-08T19:24:51.352204+0000","last_unstale":"2023-11-08T19:24:52.383543+0000","last_undegraded":"2023-11-08T19:24:52.383543+0000","last_fullsized":"2023-11-08T19:24:52.383543+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:26:03.738637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":28,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.358811+0000","last_change":"2023-11-08T19:24:32.140832+0000","last_active":"2023-11-08T19:24:52.358811+0000","last_peered":"2023-11-08T19:24:52.358811+0000","last_clean":"2023-11-08T19:24:52.358811+0000","last_became_active":"2023-11-08T19:24:31.146557+0000","last_became_peered":"2023-11-08T19:24:31.146557+0000","last_unstale":"2023-11-08T19:24:52.358811+0000","last_undegraded":"2023-11-08T19:24:52.358811+0000","last_fullsized":"2023-11-08T19:24:52.358811+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:40:04.258107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099450100000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.352995+0000","last_change":"2023-11-08T19:24:52.381859+0000","last_active":"2023-11-08T19:24:53.352995+0000","last_peered":"2023-11-08T19:24:53.352995+0000","last_clean":"2023-11-08T19:24:53.352995+0000","last_became_active":"2023-11-08T19:24:52.381568+0000","last_became_peered":"2023-11-08T19:24:52.381568+0000","last_unstale":"2023-11-08T19:24:53.352995+0000","last_undegraded":"2023-11-08T19:24:53.352995+0000","last_fullsized":"2023-11-08T19:24:53.352995+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:09:36.064066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.363104+0000","last_change":"2023-11-08T19:24:51.351359+0000","last_active":"2023-11-08T19:24:52.363104+0000","last_peered":"2023-11-08T19:24:52.363104+0000","last_clean":"2023-11-08T19:24:52.363104+0000","last_became_active":"2023-11-08T19:24:51.351077+0000","last_became_peered":"2023-11-08T19:24:51.351077+0000","last_unstale":"2023-11-08T19:24:52.363104+0000","last_undegraded":"2023-11-08T19:24:52.363104+0000","last_fullsized":"2023-11-08T19:24:52.363104+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:01:44.402590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":28,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.358845+0000","last_change":"2023-11-08T19:24:32.141188+0000","last_active":"2023-11-08T19:24:52.358845+0000","last_peered":"2023-11-08T19:24:52.358845+0000","last_clean":"2023-11-08T19:24:52.358845+0000","last_became_active":"2023-11-08T19:24:31.148857+0000","last_became_peered":"2023-11-08T19:24:31.148857+0000","last_unstale":"2023-11-08T19:24:52.358845+0000","last_undegraded":"2023-11-08T19:24:52.358845+0000","last_fullsized":"2023-11-08T19:24:52.358845+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:45:34.425432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065078599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.859138+0000","last_change":"2023-11-08T19:24:52.356944+0000","last_active":"2023-11-08T19:24:54.859138+0000","last_peered":"2023-11-08T19:24:54.859138+0000","last_clean":"2023-11-08T19:24:54.859138+0000","last_became_active":"2023-11-08T19:24:52.356663+0000","last_became_peered":"2023-11-08T19:24:52.356663+0000","last_unstale":"2023-11-08T19:24:54.859138+0000","last_undegraded":"2023-11-08T19:24:54.859138+0000","last_fullsized":"2023-11-08T19:24:54.859138+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:00:00.539298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.354586+0000","last_change":"2023-11-08T19:24:51.350538+0000","last_active":"2023-11-08T19:24:52.354586+0000","last_peered":"2023-11-08T19:24:52.354586+0000","last_clean":"2023-11-08T19:24:52.354586+0000","last_became_active":"2023-11-08T19:24:51.350279+0000","last_became_peered":"2023-11-08T19:24:51.350279+0000","last_unstale":"2023-11-08T19:24:52.354586+0000","last_undegraded":"2023-11-08T19:24:52.354586+0000","last_fullsized":"2023-11-08T19:24:52.354586+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:32.064974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":28,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.358040+0000","last_change":"2023-11-08T19:24:32.140167+0000","last_active":"2023-11-08T19:24:52.358040+0000","last_peered":"2023-11-08T19:24:52.358040+0000","last_clean":"2023-11-08T19:24:52.358040+0000","last_became_active":"2023-11-08T19:24:31.147181+0000","last_became_peered":"2023-11-08T19:24:31.147181+0000","last_unstale":"2023-11-08T19:24:52.358040+0000","last_undegraded":"2023-11-08T19:24:52.358040+0000","last_fullsized":"2023-11-08T19:24:52.358040+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:26.080042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057135200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.859970+0000","last_change":"2023-11-08T19:24:52.367723+0000","last_active":"2023-11-08T19:24:54.859970+0000","last_peered":"2023-11-08T19:24:54.859970+0000","last_clean":"2023-11-08T19:24:54.859970+0000","last_became_active":"2023-11-08T19:24:52.367442+0000","last_became_peered":"2023-11-08T19:24:52.367442+0000","last_unstale":"2023-11-08T19:24:54.859970+0000","last_undegraded":"2023-11-08T19:24:54.859970+0000","last_fullsized":"2023-11-08T19:24:54.859970+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:23:47.982756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.350487+0000","last_change":"2023-11-08T19:24:51.349877+0000","last_active":"2023-11-08T19:24:52.350487+0000","last_peered":"2023-11-08T19:24:52.350487+0000","last_clean":"2023-11-08T19:24:52.350487+0000","last_became_active":"2023-11-08T19:24:51.349603+0000","last_became_peered":"2023-11-08T19:24:51.349603+0000","last_unstale":"2023-11-08T19:24:52.350487+0000","last_undegraded":"2023-11-08T19:24:52.350487+0000","last_fullsized":"2023-11-08T19:24:52.350487+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:45:50.206824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":27,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.362379+0000","last_change":"2023-11-08T19:24:32.530895+0000","last_active":"2023-11-08T19:24:52.362379+0000","last_peered":"2023-11-08T19:24:52.362379+0000","last_clean":"2023-11-08T19:24:52.362379+0000","last_became_active":"2023-11-08T19:24:31.146715+0000","last_became_peered":"2023-11-08T19:24:31.146715+0000","last_unstale":"2023-11-08T19:24:52.362379+0000","last_undegraded":"2023-11-08T19:24:52.362379+0000","last_fullsized":"2023-11-08T19:24:52.362379+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:39.214888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081671599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.858625+0000","last_change":"2023-11-08T19:24:52.368390+0000","last_active":"2023-11-08T19:24:54.858625+0000","last_peered":"2023-11-08T19:24:54.858625+0000","last_clean":"2023-11-08T19:24:54.858625+0000","last_became_active":"2023-11-08T19:24:52.368084+0000","last_became_peered":"2023-11-08T19:24:52.368084+0000","last_unstale":"2023-11-08T19:24:54.858625+0000","last_undegraded":"2023-11-08T19:24:54.858625+0000","last_fullsized":"2023-11-08T19:24:54.858625+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:53:42.472906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.354441+0000","last_change":"2023-11-08T19:24:51.351975+0000","last_active":"2023-11-08T19:24:52.354441+0000","last_peered":"2023-11-08T19:24:52.354441+0000","last_clean":"2023-11-08T19:24:52.354441+0000","last_became_active":"2023-11-08T19:24:51.351729+0000","last_became_peered":"2023-11-08T19:24:51.351729+0000","last_unstale":"2023-11-08T19:24:52.354441+0000","last_undegraded":"2023-11-08T19:24:52.354441+0000","last_fullsized":"2023-11-08T19:24:52.354441+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:13:02.452701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":27,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.359188+0000","last_change":"2023-11-08T19:24:32.333430+0000","last_active":"2023-11-08T19:24:52.359188+0000","last_peered":"2023-11-08T19:24:52.359188+0000","last_clean":"2023-11-08T19:24:52.359188+0000","last_became_active":"2023-11-08T19:24:31.141710+0000","last_became_peered":"2023-11-08T19:24:31.141710+0000","last_unstale":"2023-11-08T19:24:52.359188+0000","last_undegraded":"2023-11-08T19:24:52.359188+0000","last_fullsized":"2023-11-08T19:24:52.359188+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:32:51.214551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000430438,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.352282+0000","last_change":"2023-11-08T19:24:52.369539+0000","last_active":"2023-11-08T19:24:53.352282+0000","last_peered":"2023-11-08T19:24:53.352282+0000","last_clean":"2023-11-08T19:24:53.352282+0000","last_became_active":"2023-11-08T19:24:52.369278+0000","last_became_peered":"2023-11-08T19:24:52.369278+0000","last_unstale":"2023-11-08T19:24:53.352282+0000","last_undegraded":"2023-11-08T19:24:53.352282+0000","last_fullsized":"2023-11-08T19:24:53.352282+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:26:22.628067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.362009+0000","last_change":"2023-11-08T19:24:51.349871+0000","last_active":"2023-11-08T19:24:52.362009+0000","last_peered":"2023-11-08T19:24:52.362009+0000","last_clean":"2023-11-08T19:24:52.362009+0000","last_became_active":"2023-11-08T19:24:51.349612+0000","last_became_peered":"2023-11-08T19:24:51.349612+0000","last_unstale":"2023-11-08T19:24:52.362009+0000","last_undegraded":"2023-11-08T19:24:52.362009+0000","last_fullsized":"2023-11-08T19:24:52.362009+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:09:35.057515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":27,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.362531+0000","last_change":"2023-11-08T19:24:32.530333+0000","last_active":"2023-11-08T19:24:52.362531+0000","last_peered":"2023-11-08T19:24:52.362531+0000","last_clean":"2023-11-08T19:24:52.362531+0000","last_became_active":"2023-11-08T19:24:31.144838+0000","last_became_peered":"2023-11-08T19:24:31.144838+0000","last_unstale":"2023-11-08T19:24:52.362531+0000","last_undegraded":"2023-11-08T19:24:52.362531+0000","last_fullsized":"2023-11-08T19:24:52.362531+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:39:48.473183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081588799999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.351955+0000","last_change":"2023-11-08T19:24:52.365779+0000","last_active":"2023-11-08T19:24:53.351955+0000","last_peered":"2023-11-08T19:24:53.351955+0000","last_clean":"2023-11-08T19:24:53.351955+0000","last_became_active":"2023-11-08T19:24:52.365477+0000","last_became_peered":"2023-11-08T19:24:52.365477+0000","last_unstale":"2023-11-08T19:24:53.351955+0000","last_undegraded":"2023-11-08T19:24:53.351955+0000","last_fullsized":"2023-11-08T19:24:53.351955+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:14:05.670963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"54'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.383642+0000","last_change":"2023-11-08T19:24:51.352702+0000","last_active":"2023-11-08T19:24:52.383642+0000","last_peered":"2023-11-08T19:24:52.383642+0000","last_clean":"2023-11-08T19:24:52.383642+0000","last_became_active":"2023-11-08T19:24:51.352447+0000","last_became_peered":"2023-11-08T19:24:51.352447+0000","last_unstale":"2023-11-08T19:24:52.383642+0000","last_undegraded":"2023-11-08T19:24:52.383642+0000","last_fullsized":"2023-11-08T19:24:52.383642+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:28:19.340370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":27,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.358853+0000","last_change":"2023-11-08T19:24:32.333096+0000","last_active":"2023-11-08T19:24:52.358853+0000","last_peered":"2023-11-08T19:24:52.358853+0000","last_clean":"2023-11-08T19:24:52.358853+0000","last_became_active":"2023-11-08T19:24:31.142985+0000","last_became_peered":"2023-11-08T19:24:31.142985+0000","last_unstale":"2023-11-08T19:24:52.358853+0000","last_undegraded":"2023-11-08T19:24:52.358853+0000","last_fullsized":"2023-11-08T19:24:52.358853+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:36:33.274496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000386048,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.625773+0000","last_change":"2023-11-08T19:24:52.368692+0000","last_active":"2023-11-08T19:24:54.625773+0000","last_peered":"2023-11-08T19:24:54.625773+0000","last_clean":"2023-11-08T19:24:54.625773+0000","last_became_active":"2023-11-08T19:24:52.368065+0000","last_became_peered":"2023-11-08T19:24:52.368065+0000","last_unstale":"2023-11-08T19:24:54.625773+0000","last_undegraded":"2023-11-08T19:24:54.625773+0000","last_fullsized":"2023-11-08T19:24:54.625773+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:51:28.839154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.357204+0000","last_change":"2023-11-08T19:24:51.347813+0000","last_active":"2023-11-08T19:24:52.357204+0000","last_peered":"2023-11-08T19:24:52.357204+0000","last_clean":"2023-11-08T19:24:52.357204+0000","last_became_active":"2023-11-08T19:24:51.347531+0000","last_became_peered":"2023-11-08T19:24:51.347531+0000","last_unstale":"2023-11-08T19:24:52.357204+0000","last_undegraded":"2023-11-08T19:24:52.357204+0000","last_fullsized":"2023-11-08T19:24:52.357204+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:04:44.238632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":27,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.354591+0000","last_change":"2023-11-08T19:24:32.263810+0000","last_active":"2023-11-08T19:24:52.354591+0000","last_peered":"2023-11-08T19:24:52.354591+0000","last_clean":"2023-11-08T19:24:52.354591+0000","last_became_active":"2023-11-08T19:24:31.138814+0000","last_became_peered":"2023-11-08T19:24:31.138814+0000","last_unstale":"2023-11-08T19:24:52.354591+0000","last_undegraded":"2023-11-08T19:24:52.354591+0000","last_fullsized":"2023-11-08T19:24:52.354591+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:21:55.985548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048136000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.859066+0000","last_change":"2023-11-08T19:24:52.373600+0000","last_active":"2023-11-08T19:24:54.859066+0000","last_peered":"2023-11-08T19:24:54.859066+0000","last_clean":"2023-11-08T19:24:54.859066+0000","last_became_active":"2023-11-08T19:24:52.373330+0000","last_became_peered":"2023-11-08T19:24:52.373330+0000","last_unstale":"2023-11-08T19:24:54.859066+0000","last_undegraded":"2023-11-08T19:24:54.859066+0000","last_fullsized":"2023-11-08T19:24:54.859066+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:33:39.146820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.358702+0000","last_change":"2023-11-08T19:24:51.338424+0000","last_active":"2023-11-08T19:24:52.358702+0000","last_peered":"2023-11-08T19:24:52.358702+0000","last_clean":"2023-11-08T19:24:52.358702+0000","last_became_active":"2023-11-08T19:24:51.338129+0000","last_became_peered":"2023-11-08T19:24:51.338129+0000","last_unstale":"2023-11-08T19:24:52.358702+0000","last_undegraded":"2023-11-08T19:24:52.358702+0000","last_fullsized":"2023-11-08T19:24:52.358702+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:32.064974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":27,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.350835+0000","last_change":"2023-11-08T19:24:32.544063+0000","last_active":"2023-11-08T19:24:52.350835+0000","last_peered":"2023-11-08T19:24:52.350835+0000","last_clean":"2023-11-08T19:24:52.350835+0000","last_became_active":"2023-11-08T19:24:31.144795+0000","last_became_peered":"2023-11-08T19:24:31.144795+0000","last_unstale":"2023-11-08T19:24:52.350835+0000","last_undegraded":"2023-11-08T19:24:52.350835+0000","last_fullsized":"2023-11-08T19:24:52.350835+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:12:42.248307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01495431,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.625678+0000","last_change":"2023-11-08T19:24:52.370238+0000","last_active":"2023-11-08T19:24:54.625678+0000","last_peered":"2023-11-08T19:24:54.625678+0000","last_clean":"2023-11-08T19:24:54.625678+0000","last_became_active":"2023-11-08T19:24:52.369872+0000","last_became_peered":"2023-11-08T19:24:52.369872+0000","last_unstale":"2023-11-08T19:24:54.625678+0000","last_undegraded":"2023-11-08T19:24:54.625678+0000","last_fullsized":"2023-11-08T19:24:54.625678+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:14:34.758666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.355135+0000","last_change":"2023-11-08T19:24:51.353556+0000","last_active":"2023-11-08T19:24:52.355135+0000","last_peered":"2023-11-08T19:24:52.355135+0000","last_clean":"2023-11-08T19:24:52.355135+0000","last_became_active":"2023-11-08T19:24:51.353252+0000","last_became_peered":"2023-11-08T19:24:51.353252+0000","last_unstale":"2023-11-08T19:24:52.355135+0000","last_undegraded":"2023-11-08T19:24:52.355135+0000","last_fullsized":"2023-11-08T19:24:52.355135+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:19:41.458528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":27,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.368461+0000","last_change":"2023-11-08T19:24:32.147025+0000","last_active":"2023-11-08T19:24:52.368461+0000","last_peered":"2023-11-08T19:24:52.368461+0000","last_clean":"2023-11-08T19:24:52.368461+0000","last_became_active":"2023-11-08T19:24:31.147082+0000","last_became_peered":"2023-11-08T19:24:31.147082+0000","last_unstale":"2023-11-08T19:24:52.368461+0000","last_undegraded":"2023-11-08T19:24:52.368461+0000","last_fullsized":"2023-11-08T19:24:52.368461+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:02:27.987795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043701599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.351930+0000","last_change":"2023-11-08T19:24:52.360979+0000","last_active":"2023-11-08T19:24:53.351930+0000","last_peered":"2023-11-08T19:24:53.351930+0000","last_clean":"2023-11-08T19:24:53.351930+0000","last_became_active":"2023-11-08T19:24:52.360672+0000","last_became_peered":"2023-11-08T19:24:52.360672+0000","last_unstale":"2023-11-08T19:24:53.351930+0000","last_undegraded":"2023-11-08T19:24:53.351930+0000","last_fullsized":"2023-11-08T19:24:53.351930+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:23:49.083463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"54'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.383637+0000","last_change":"2023-11-08T19:24:51.339517+0000","last_active":"2023-11-08T19:24:52.383637+0000","last_peered":"2023-11-08T19:24:52.383637+0000","last_clean":"2023-11-08T19:24:52.383637+0000","last_became_active":"2023-11-08T19:24:51.339183+0000","last_became_peered":"2023-11-08T19:24:51.339183+0000","last_unstale":"2023-11-08T19:24:52.383637+0000","last_undegraded":"2023-11-08T19:24:52.383637+0000","last_fullsized":"2023-11-08T19:24:52.383637+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:26:21.621516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":27,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.361933+0000","last_change":"2023-11-08T19:24:32.530620+0000","last_active":"2023-11-08T19:24:52.361933+0000","last_peered":"2023-11-08T19:24:52.361933+0000","last_clean":"2023-11-08T19:24:52.361933+0000","last_became_active":"2023-11-08T19:24:31.144223+0000","last_became_peered":"2023-11-08T19:24:31.144223+0000","last_unstale":"2023-11-08T19:24:52.361933+0000","last_undegraded":"2023-11-08T19:24:52.361933+0000","last_fullsized":"2023-11-08T19:24:52.361933+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:01:25.647952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071879799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.625382+0000","last_change":"2023-11-08T19:24:52.368217+0000","last_active":"2023-11-08T19:24:54.625382+0000","last_peered":"2023-11-08T19:24:54.625382+0000","last_clean":"2023-11-08T19:24:54.625382+0000","last_became_active":"2023-11-08T19:24:52.366276+0000","last_became_peered":"2023-11-08T19:24:52.366276+0000","last_unstale":"2023-11-08T19:24:54.625382+0000","last_undegraded":"2023-11-08T19:24:54.625382+0000","last_fullsized":"2023-11-08T19:24:54.625382+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:14:05.670963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.357104+0000","last_change":"2023-11-08T19:24:51.353449+0000","last_active":"2023-11-08T19:24:52.357104+0000","last_peered":"2023-11-08T19:24:52.357104+0000","last_clean":"2023-11-08T19:24:52.357104+0000","last_became_active":"2023-11-08T19:24:51.353096+0000","last_became_peered":"2023-11-08T19:24:51.353096+0000","last_unstale":"2023-11-08T19:24:52.357104+0000","last_undegraded":"2023-11-08T19:24:52.357104+0000","last_fullsized":"2023-11-08T19:24:52.357104+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:04:59.430912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":28,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.358646+0000","last_change":"2023-11-08T19:24:32.140880+0000","last_active":"2023-11-08T19:24:52.358646+0000","last_peered":"2023-11-08T19:24:52.358646+0000","last_clean":"2023-11-08T19:24:52.358646+0000","last_became_active":"2023-11-08T19:24:31.146063+0000","last_became_peered":"2023-11-08T19:24:31.146063+0000","last_unstale":"2023-11-08T19:24:52.358646+0000","last_undegraded":"2023-11-08T19:24:52.358646+0000","last_fullsized":"2023-11-08T19:24:52.358646+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:54:08.985813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089896300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353781+0000","last_change":"2023-11-08T19:24:52.360248+0000","last_active":"2023-11-08T19:24:53.353781+0000","last_peered":"2023-11-08T19:24:53.353781+0000","last_clean":"2023-11-08T19:24:53.353781+0000","last_became_active":"2023-11-08T19:24:52.359929+0000","last_became_peered":"2023-11-08T19:24:52.359929+0000","last_unstale":"2023-11-08T19:24:53.353781+0000","last_undegraded":"2023-11-08T19:24:53.353781+0000","last_fullsized":"2023-11-08T19:24:53.353781+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:14:34.758666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"54'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.383919+0000","last_change":"2023-11-08T19:24:51.355250+0000","last_active":"2023-11-08T19:24:52.383919+0000","last_peered":"2023-11-08T19:24:52.383919+0000","last_clean":"2023-11-08T19:24:52.383919+0000","last_became_active":"2023-11-08T19:24:51.354947+0000","last_became_peered":"2023-11-08T19:24:51.354947+0000","last_unstale":"2023-11-08T19:24:52.383919+0000","last_undegraded":"2023-11-08T19:24:52.383919+0000","last_fullsized":"2023-11-08T19:24:52.383919+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:04:44.238632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":29,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.363177+0000","last_change":"2023-11-08T19:24:32.139885+0000","last_active":"2023-11-08T19:24:52.363177+0000","last_peered":"2023-11-08T19:24:52.363177+0000","last_clean":"2023-11-08T19:24:52.363177+0000","last_became_active":"2023-11-08T19:24:31.145329+0000","last_became_peered":"2023-11-08T19:24:31.145329+0000","last_unstale":"2023-11-08T19:24:52.363177+0000","last_undegraded":"2023-11-08T19:24:52.363177+0000","last_fullsized":"2023-11-08T19:24:52.363177+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:25:18.356784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049012999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353207+0000","last_change":"2023-11-08T19:24:52.375489+0000","last_active":"2023-11-08T19:24:53.353207+0000","last_peered":"2023-11-08T19:24:53.353207+0000","last_clean":"2023-11-08T19:24:53.353207+0000","last_became_active":"2023-11-08T19:24:52.375203+0000","last_became_peered":"2023-11-08T19:24:52.375203+0000","last_unstale":"2023-11-08T19:24:53.353207+0000","last_undegraded":"2023-11-08T19:24:53.353207+0000","last_fullsized":"2023-11-08T19:24:53.353207+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:23:49.083463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"54'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.383466+0000","last_change":"2023-11-08T19:24:51.355288+0000","last_active":"2023-11-08T19:24:52.383466+0000","last_peered":"2023-11-08T19:24:52.383466+0000","last_clean":"2023-11-08T19:24:52.383466+0000","last_became_active":"2023-11-08T19:24:51.355040+0000","last_became_peered":"2023-11-08T19:24:51.355040+0000","last_unstale":"2023-11-08T19:24:52.383466+0000","last_undegraded":"2023-11-08T19:24:52.383466+0000","last_fullsized":"2023-11-08T19:24:52.383466+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:09:35.057515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":27,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.357414+0000","last_change":"2023-11-08T19:24:32.142836+0000","last_active":"2023-11-08T19:24:52.357414+0000","last_peered":"2023-11-08T19:24:52.357414+0000","last_clean":"2023-11-08T19:24:52.357414+0000","last_became_active":"2023-11-08T19:24:31.141367+0000","last_became_peered":"2023-11-08T19:24:31.141367+0000","last_unstale":"2023-11-08T19:24:52.357414+0000","last_undegraded":"2023-11-08T19:24:52.357414+0000","last_fullsized":"2023-11-08T19:24:52.357414+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:39.214888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001335136,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353587+0000","last_change":"2023-11-08T19:24:52.377063+0000","last_active":"2023-11-08T19:24:53.353587+0000","last_peered":"2023-11-08T19:24:53.353587+0000","last_clean":"2023-11-08T19:24:53.353587+0000","last_became_active":"2023-11-08T19:24:52.376791+0000","last_became_peered":"2023-11-08T19:24:52.376791+0000","last_unstale":"2023-11-08T19:24:53.353587+0000","last_undegraded":"2023-11-08T19:24:53.353587+0000","last_fullsized":"2023-11-08T19:24:53.353587+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:08:17.924911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.361765+0000","last_change":"2023-11-08T19:24:51.351504+0000","last_active":"2023-11-08T19:24:52.361765+0000","last_peered":"2023-11-08T19:24:52.361765+0000","last_clean":"2023-11-08T19:24:52.361765+0000","last_became_active":"2023-11-08T19:24:51.351239+0000","last_became_peered":"2023-11-08T19:24:51.351239+0000","last_unstale":"2023-11-08T19:24:52.361765+0000","last_undegraded":"2023-11-08T19:24:52.361765+0000","last_fullsized":"2023-11-08T19:24:52.361765+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:54:16.702041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":27,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.351449+0000","last_change":"2023-11-08T19:24:32.544285+0000","last_active":"2023-11-08T19:24:52.351449+0000","last_peered":"2023-11-08T19:24:52.351449+0000","last_clean":"2023-11-08T19:24:52.351449+0000","last_became_active":"2023-11-08T19:24:31.142028+0000","last_became_peered":"2023-11-08T19:24:31.142028+0000","last_unstale":"2023-11-08T19:24:52.351449+0000","last_undegraded":"2023-11-08T19:24:52.351449+0000","last_fullsized":"2023-11-08T19:24:52.351449+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:01:24.198196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067537399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.860045+0000","last_change":"2023-11-08T19:24:52.364572+0000","last_active":"2023-11-08T19:24:54.860045+0000","last_peered":"2023-11-08T19:24:54.860045+0000","last_clean":"2023-11-08T19:24:54.860045+0000","last_became_active":"2023-11-08T19:24:52.364297+0000","last_became_peered":"2023-11-08T19:24:52.364297+0000","last_unstale":"2023-11-08T19:24:54.860045+0000","last_undegraded":"2023-11-08T19:24:54.860045+0000","last_fullsized":"2023-11-08T19:24:54.860045+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:25:15.982859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"54'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.383513+0000","last_change":"2023-11-08T19:24:51.349434+0000","last_active":"2023-11-08T19:24:52.383513+0000","last_peered":"2023-11-08T19:24:52.383513+0000","last_clean":"2023-11-08T19:24:52.383513+0000","last_became_active":"2023-11-08T19:24:51.349154+0000","last_became_peered":"2023-11-08T19:24:51.349154+0000","last_unstale":"2023-11-08T19:24:52.383513+0000","last_undegraded":"2023-11-08T19:24:52.383513+0000","last_fullsized":"2023-11-08T19:24:52.383513+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:09:35.057515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":27,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.351313+0000","last_change":"2023-11-08T19:24:32.544333+0000","last_active":"2023-11-08T19:24:52.351313+0000","last_peered":"2023-11-08T19:24:52.351313+0000","last_clean":"2023-11-08T19:24:52.351313+0000","last_became_active":"2023-11-08T19:24:31.138598+0000","last_became_peered":"2023-11-08T19:24:31.138598+0000","last_unstale":"2023-11-08T19:24:52.351313+0000","last_undegraded":"2023-11-08T19:24:52.351313+0000","last_fullsized":"2023-11-08T19:24:52.351313+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:11.860580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015114824000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.859075+0000","last_change":"2023-11-08T19:24:52.374075+0000","last_active":"2023-11-08T19:24:54.859075+0000","last_peered":"2023-11-08T19:24:54.859075+0000","last_clean":"2023-11-08T19:24:54.859075+0000","last_became_active":"2023-11-08T19:24:52.368948+0000","last_became_peered":"2023-11-08T19:24:52.368948+0000","last_unstale":"2023-11-08T19:24:54.859075+0000","last_undegraded":"2023-11-08T19:24:54.859075+0000","last_fullsized":"2023-11-08T19:24:54.859075+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:32:33.611039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.359580+0000","last_change":"2023-11-08T19:24:51.347235+0000","last_active":"2023-11-08T19:24:52.359580+0000","last_peered":"2023-11-08T19:24:52.359580+0000","last_clean":"2023-11-08T19:24:52.359580+0000","last_became_active":"2023-11-08T19:24:51.346983+0000","last_became_peered":"2023-11-08T19:24:51.346983+0000","last_unstale":"2023-11-08T19:24:52.359580+0000","last_undegraded":"2023-11-08T19:24:52.359580+0000","last_fullsized":"2023-11-08T19:24:52.359580+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:04:16.100072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":27,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.362218+0000","last_change":"2023-11-08T19:24:32.530665+0000","last_active":"2023-11-08T19:24:52.362218+0000","last_peered":"2023-11-08T19:24:52.362218+0000","last_clean":"2023-11-08T19:24:52.362218+0000","last_became_active":"2023-11-08T19:24:31.148363+0000","last_became_peered":"2023-11-08T19:24:31.148363+0000","last_unstale":"2023-11-08T19:24:52.362218+0000","last_undegraded":"2023-11-08T19:24:52.362218+0000","last_fullsized":"2023-11-08T19:24:52.362218+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:02:27.987795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075444200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":194,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.364492+0000","last_change":"2023-11-08T19:22:58.054283+0000","last_active":"2023-11-08T19:24:52.364492+0000","last_peered":"2023-11-08T19:24:52.364492+0000","last_clean":"2023-11-08T19:24:52.364492+0000","last_became_active":"2023-11-08T19:22:58.053337+0000","last_became_peered":"2023-11-08T19:22:58.053337+0000","last_unstale":"2023-11-08T19:24:52.364492+0000","last_undegraded":"2023-11-08T19:24:52.364492+0000","last_fullsized":"2023-11-08T19:24:52.364492+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:22:56.479654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:22:56.479654+0000","last_clean_scrub_stamp":"2023-11-08T19:22:56.479654+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:16:05.317001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28252,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343588,"statfs":{"total":96636764160,"available":96607834112,"internally_reserved":0,"allocated":1257472,"data_stored":888859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.56699999999999995}]},{"osd":1,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.505}]},{"osd":2,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.59399999999999997}]},{"osd":3,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.68500000000000005}]},{"osd":4,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.54900000000000004}]},{"osd":5,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.66400000000000003}]},{"osd":6,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.63300000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":655360,"data_stored":298331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.376}]},{"osd":1,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.433}]},{"osd":2,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.56899999999999995}]},{"osd":3,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":0.40100000000000002}]},{"osd":4,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.53900000000000003}]},{"osd":5,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.68700000000000006}]},{"osd":7,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.59599999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":659456,"data_stored":298421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.377},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":2.1850000000000001,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":0.22800000000000001}]},{"osd":2,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.32700000000000001}]},{"osd":3,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.438},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":2.2120000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.27600000000000002}]},{"osd":4,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.67800000000000005}]},{"osd":5,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.69999999999999996}]},{"osd":6,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":2.093,"5min":2.093,"15min":2.093},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.51900000000000002}]},{"osd":7,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":0.748},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":2.1299999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.56799999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28256,"kb_used_data":1236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343584,"statfs":{"total":96636764160,"available":96607830016,"internally_reserved":0,"allocated":1265664,"data_stored":890893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":19.295999999999999,"5min":19.295999999999999,"15min":19.295999999999999},"last":0.35199999999999998},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":17.204000000000001,"5min":17.204000000000001,"15min":17.204000000000001},"last":0.34100000000000003}]},{"osd":2,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":6.524,"5min":6.524,"15min":6.524},"last":0.32000000000000001},{"interface":"front","average":{"1min":1.169,"5min":1.169,"15min":1.169},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":17.175000000000001,"5min":17.175000000000001,"15min":17.175000000000001},"last":0.36699999999999999}]},{"osd":3,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":14.324,"5min":14.324,"15min":14.324},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.38300000000000001}]},{"osd":4,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.304,"15min":1.304},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":17.056000000000001,"5min":17.056000000000001,"15min":17.056000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":5.0289999999999999,"5min":5.0289999999999999,"15min":5.0289999999999999},"last":0.68100000000000005}]},{"osd":5,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":5.0590000000000002,"5min":5.0590000000000002,"15min":5.0590000000000002},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.65200000000000002}]},{"osd":6,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.78500000000000003},{"interface":"front","average":{"1min":1.357,"5min":1.357,"15min":1.357},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":17.111999999999998,"5min":17.111999999999998,"15min":17.111999999999998},"last":0.60699999999999998}]},{"osd":7,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.371,"15min":1.371},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":17.146000000000001,"5min":17.146000000000001,"15min":17.146000000000001},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":4.9829999999999997,"5min":4.9829999999999997,"15min":4.9829999999999997},"last":0.61899999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":663552,"data_stored":298387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":3.4100000000000001,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":3.4369999999999998,"5min":3.4369999999999998,"15min":3.4369999999999998},"last":0.33200000000000002}]},{"osd":1,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":4.0679999999999996,"5min":4.0679999999999996,"15min":4.0679999999999996},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":4.3499999999999996,"5min":4.3499999999999996,"15min":4.3499999999999996},"last":0.35699999999999998}]},{"osd":3,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":3.8580000000000001,"5min":3.8580000000000001,"15min":3.8580000000000001},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":3.476,"5min":3.476,"15min":3.476},"last":0.439}]},{"osd":4,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":4.0090000000000003,"5min":4.0090000000000003,"15min":4.0090000000000003},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":4.1040000000000001,"5min":4.1040000000000001,"15min":4.1040000000000001},"last":0.495}]},{"osd":5,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":4.0869999999999997,"5min":4.0869999999999997,"15min":4.0869999999999997},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":3.843,"5min":3.843,"15min":3.843},"last":0.63800000000000001}]},{"osd":6,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":4.1399999999999997,"5min":4.1399999999999997,"15min":4.1399999999999997},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":4.0499999999999998,"5min":4.0499999999999998,"15min":4.0499999999999998},"last":0.69099999999999995}]},{"osd":7,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":4.157,"5min":4.157,"15min":4.157},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":4.1710000000000003,"5min":4.1710000000000003,"15min":4.1710000000000003},"last":0.48099999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":663552,"data_stored":298387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.30299999999999999}]},{"osd":1,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.36099999999999999}]},{"osd":2,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.38100000000000001}]},{"osd":4,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.44900000000000001}]},{"osd":5,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.39100000000000001}]},{"osd":6,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.52100000000000002}]},{"osd":7,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.49299999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27680,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344160,"statfs":{"total":96636764160,"available":96608419840,"internally_reserved":0,"allocated":667648,"data_stored":299943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.496},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":2.2090000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.57399999999999995}]},{"osd":1,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.624},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.433}]},{"osd":2,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":2.8490000000000002,"5min":2.8490000000000002,"15min":2.8490000000000002},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.70199999999999996}]},{"osd":3,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":3.4849999999999999,"5min":3.4849999999999999,"15min":3.4849999999999999},"last":0.60299999999999998}]},{"osd":5,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.55100000000000005}]},{"osd":6,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":4.1529999999999996,"5min":4.1529999999999996,"15min":4.1529999999999996},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.45800000000000002}]},{"osd":7,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":5.5359999999999996,"5min":5.5359999999999996,"15min":5.5359999999999996},"last":0.68100000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":663552,"data_stored":298983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.71999999999999997}]},{"osd":1,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":2.2919999999999998,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":0.65400000000000003}]},{"osd":2,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.55200000000000005}]},{"osd":3,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.67500000000000004}]},{"osd":4,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":2.3300000000000001,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":0.376},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.56699999999999995}]},{"osd":6,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":2.3650000000000002,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":0.44400000000000001}]},{"osd":7,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.41599999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:25:01.093 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:25:01.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.228+0000 7f069b52b700 1 Processor -- start 2023-11-08T19:25:01.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.228+0000 7f069b52b700 1 -- start start 2023-11-08T19:25:01.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.229+0000 7f069b52b700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f06940668e0 0x7f069406bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:01.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.229+0000 7f069b52b700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f06940b5840 0x7f069406c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:01.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.229+0000 7f069b52b700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f069415f390 con 0x7f069415efb0 2023-11-08T19:25:01.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.229+0000 7f069b52b700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06940b3460 con 0x7f06940668e0 2023-11-08T19:25:01.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.229+0000 7f069b52b700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06940ce0a0 con 0x7f06940b5840 2023-11-08T19:25:01.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.229+0000 7f0698ac6700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f06940668e0 0x7f069406bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:01.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.229+0000 7f06992c7700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f069415efb0 0x7f06940b2d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.149:54090/0 (socket says 172.21.15.149:54090) 2023-11-08T19:25:01.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.229+0000 7f06992c7700 1 -- 172.21.15.149:0/167966055 learned_addr learned my addr 172.21.15.149:0/167966055 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:25:01.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.229+0000 7f0699ac8700 1 --2- 172.21.15.149:0/167966055 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f06940b5840 0x7f069406c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:01.235 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.230+0000 7f0699ac8700 1 -- 172.21.15.149:0/167966055 >> v2:172.21.15.160:3300/0 conn(0x7f06940668e0 msgr2=0x7f069406bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:01.235 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.230+0000 7f0699ac8700 1 --2- 172.21.15.149:0/167966055 >> v2:172.21.15.160:3300/0 conn(0x7f06940668e0 0x7f069406bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:01.236 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.230+0000 7f0699ac8700 1 -- 172.21.15.149:0/167966055 >> v1:172.21.15.160:6789/0 conn(0x7f069415efb0 legacy=0x7f06940b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:01.236 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.230+0000 7f0699ac8700 1 -- 172.21.15.149:0/167966055 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06940ce380 con 0x7f06940b5840 2023-11-08T19:25:01.236 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.230+0000 7f068bfff700 1 -- 172.21.15.149:0/167966055 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 67334293 0 0) 0x7f0684001110 con 0x7f069415efb0 2023-11-08T19:25:01.236 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.230+0000 7f0698ac6700 1 --2- 172.21.15.149:0/167966055 >> v2:172.21.15.160:3300/0 conn(0x7f06940668e0 0x7f069406bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:25:01.236 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.230+0000 7f0699ac8700 1 --2- 172.21.15.149:0/167966055 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f06940b5840 0x7f069406c0d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f068c009d90 tx=0x7f068c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5fbb35f678e7ff7 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:01.237 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.230+0000 7f068bfff700 1 -- 172.21.15.149:0/167966055 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068c00e070 con 0x7f06940b5840 2023-11-08T19:25:01.237 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.230+0000 7f068bfff700 1 -- 172.21.15.149:0/167966055 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f068c00bb20 con 0x7f06940b5840 2023-11-08T19:25:01.237 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.230+0000 7f068bfff700 1 -- 172.21.15.149:0/167966055 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068c012430 con 0x7f06940b5840 2023-11-08T19:25:01.237 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.231+0000 7f069b52b700 1 -- 172.21.15.149:0/167966055 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f06940b5840 msgr2=0x7f069406c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:01.237 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.231+0000 7f069b52b700 1 --2- 172.21.15.149:0/167966055 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f06940b5840 0x7f069406c0d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f068c009d90 tx=0x7f068c00b330 comp rx=0 tx=0).stop 2023-11-08T19:25:01.238 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.231+0000 7f069b52b700 1 -- 172.21.15.149:0/167966055 shutdown_connections 2023-11-08T19:25:01.238 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.231+0000 7f069b52b700 1 --2- 172.21.15.149:0/167966055 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f06940b5840 0x7f069406c0d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:01.238 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.231+0000 7f069b52b700 1 --2- 172.21.15.149:0/167966055 >> v2:172.21.15.160:3300/0 conn(0x7f06940668e0 0x7f069406bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:01.238 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.231+0000 7f069b52b700 1 -- 172.21.15.149:0/167966055 >> 172.21.15.149:0/167966055 conn(0x7f0694071720 msgr2=0x7f0694071b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:01.239 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.231+0000 7f069b52b700 1 -- 172.21.15.149:0/167966055 shutdown_connections 2023-11-08T19:25:01.239 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.231+0000 7f069b52b700 1 -- 172.21.15.149:0/167966055 wait complete. 2023-11-08T19:25:01.239 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.232+0000 7f069b52b700 1 Processor -- start 2023-11-08T19:25:01.239 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.232+0000 7f069b52b700 1 -- start start 2023-11-08T19:25:01.239 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.233+0000 7f069b52b700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f06940668e0 0x7f06941f65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:01.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.233+0000 7f069b52b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f06940b5840 0x7f0694159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:01.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.233+0000 7f069b52b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f069415efb0 0x7f069415a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:01.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.233+0000 7f069b52b700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06940c3d30 con 0x7f069415efb0 2023-11-08T19:25:01.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.233+0000 7f069b52b700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069406d4a0 con 0x7f06940b5840 2023-11-08T19:25:01.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.233+0000 7f069b52b700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06940c5d80 con 0x7f06940668e0 2023-11-08T19:25:01.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.233+0000 7f0699ac8700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f069415efb0 0x7f069415a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:01.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.233+0000 7f0699ac8700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f069415efb0 0x7f069415a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40432/0 (socket says 172.21.15.149:40432) 2023-11-08T19:25:01.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.233+0000 7f0699ac8700 1 -- 172.21.15.149:0/3425006710 learned_addr learned my addr 172.21.15.149:0/3425006710 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:01.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.233+0000 7f0698ac6700 1 --2- 172.21.15.149:0/3425006710 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f06940b5840 0x7f0694159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:01.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.233+0000 7f06992c7700 1 --2- 172.21.15.149:0/3425006710 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f06940668e0 0x7f06941f65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:01.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.233+0000 7f0699ac8700 1 -- 172.21.15.149:0/3425006710 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f06940668e0 msgr2=0x7f06941f65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:01.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.233+0000 7f0699ac8700 1 --2- 172.21.15.149:0/3425006710 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f06940668e0 0x7f06941f65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:01.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.233+0000 7f0699ac8700 1 -- 172.21.15.149:0/3425006710 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f06940b5840 msgr2=0x7f0694159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:01.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.233+0000 7f0699ac8700 1 --2- 172.21.15.149:0/3425006710 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f06940b5840 0x7f0694159eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:01.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.233+0000 7f0699ac8700 1 -- 172.21.15.149:0/3425006710 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06900094a0 con 0x7f069415efb0 2023-11-08T19:25:01.243 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.233+0000 7f0698ac6700 1 --2- 172.21.15.149:0/3425006710 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f06940b5840 0x7f0694159eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:25:01.243 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.234+0000 7f0699ac8700 1 --2- 172.21.15.149:0/3425006710 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f069415efb0 0x7f069415a3f0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f06940ce1e0 tx=0x7f068c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:01.243 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.234+0000 7f0689ffb700 1 -- 172.21.15.149:0/3425006710 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068c012430 con 0x7f069415efb0 2023-11-08T19:25:01.243 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.234+0000 7f0689ffb700 1 -- 172.21.15.149:0/3425006710 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f068c020070 con 0x7f069415efb0 2023-11-08T19:25:01.244 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.234+0000 7f069b52b700 1 -- 172.21.15.149:0/3425006710 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f068c009a70 con 0x7f069415efb0 2023-11-08T19:25:01.244 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.234+0000 7f0689ffb700 1 -- 172.21.15.149:0/3425006710 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068c004280 con 0x7f069415efb0 2023-11-08T19:25:01.244 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.234+0000 7f069b52b700 1 -- 172.21.15.149:0/3425006710 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06940c6340 con 0x7f069415efb0 2023-11-08T19:25:01.245 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.235+0000 7f069b52b700 1 -- 172.21.15.149:0/3425006710 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f069406d5e0 con 0x7f069415efb0 2023-11-08T19:25:01.245 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.235+0000 7f0689ffb700 1 -- 172.21.15.149:0/3425006710 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f068c0043e0 con 0x7f069415efb0 2023-11-08T19:25:01.245 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.236+0000 7f0689ffb700 1 --2- 172.21.15.149:0/3425006710 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f067806af00 0x7f067806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:01.246 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.236+0000 7f06992c7700 1 --2- 172.21.15.149:0/3425006710 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f067806af00 0x7f067806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:01.246 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.236+0000 7f0689ffb700 1 -- 172.21.15.149:0/3425006710 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f068c022070 con 0x7f069415efb0 2023-11-08T19:25:01.246 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.236+0000 7f06992c7700 1 --2- 172.21.15.149:0/3425006710 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f067806af00 0x7f067806d3c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0684000f60 tx=0x7f0684007e70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:01.246 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.241+0000 7f0689ffb700 1 -- 172.21.15.149:0/3425006710 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f069406d5e0 con 0x7f069415efb0 2023-11-08T19:25:01.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.426+0000 7f069b52b700 1 -- 172.21.15.149:0/3425006710 --> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f06940ce940 con 0x7f067806af00 2023-11-08T19:25:01.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.436+0000 7f0689ffb700 1 -- 172.21.15.149:0/3425006710 <== mgr.4104 v2:172.21.15.149:6832/1929837472 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+370586 (secure 0 0 0) 0x7f0684001290 con 0x7f067806af00 2023-11-08T19:25:01.441 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:25:01.444 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.440+0000 7f069b52b700 1 -- 172.21.15.149:0/3425006710 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f067806af00 msgr2=0x7f067806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:01.444 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.440+0000 7f069b52b700 1 --2- 172.21.15.149:0/3425006710 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f067806af00 0x7f067806d3c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0684000f60 tx=0x7f0684007e70 comp rx=0 tx=0).stop 2023-11-08T19:25:01.444 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.440+0000 7f069b52b700 1 -- 172.21.15.149:0/3425006710 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f069415efb0 msgr2=0x7f069415a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:01.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.440+0000 7f069b52b700 1 --2- 172.21.15.149:0/3425006710 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f069415efb0 0x7f069415a3f0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f06940ce1e0 tx=0x7f068c004ad0 comp rx=0 tx=0).stop 2023-11-08T19:25:01.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.440+0000 7f069b52b700 1 -- 172.21.15.149:0/3425006710 shutdown_connections 2023-11-08T19:25:01.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.440+0000 7f069b52b700 1 --2- 172.21.15.149:0/3425006710 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f067806af00 0x7f067806d3c0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:01.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.440+0000 7f069b52b700 1 --2- 172.21.15.149:0/3425006710 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f069415efb0 0x7f069415a3f0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:01.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.440+0000 7f069b52b700 1 --2- 172.21.15.149:0/3425006710 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f06940668e0 0x7f06941f65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:01.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.440+0000 7f069b52b700 1 --2- 172.21.15.149:0/3425006710 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f06940b5840 0x7f0694159eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:01.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.440+0000 7f069b52b700 1 -- 172.21.15.149:0/3425006710 >> 172.21.15.149:0/3425006710 conn(0x7f0694071720 msgr2=0x7f06940b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:01.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.440+0000 7f069b52b700 1 -- 172.21.15.149:0/3425006710 shutdown_connections 2023-11-08T19:25:01.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.440+0000 7f069b52b700 1 -- 172.21.15.149:0/3425006710 wait complete. 2023-11-08T19:25:01.447 INFO:teuthology.orchestra.run.smithi149.stderr:dumped all 2023-11-08T19:25:01.453 INFO:teuthology.orchestra.run.smithi149.stdout:{"pg_ready":true,"pg_map":{"version":110,"stamp":"2023-11-08T19:25:00.011221+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":258,"acting":258,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":211,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222524,"kb_used_data":6344,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752196,"statfs":{"total":773094113280,"available":772866248704,"internally_reserved":0,"allocated":6496256,"data_stored":3572204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001956"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.859265+0000","last_change":"2023-11-08T19:24:52.367968+0000","last_active":"2023-11-08T19:24:54.859265+0000","last_peered":"2023-11-08T19:24:54.859265+0000","last_clean":"2023-11-08T19:24:54.859265+0000","last_became_active":"2023-11-08T19:24:52.365264+0000","last_became_peered":"2023-11-08T19:24:52.365264+0000","last_unstale":"2023-11-08T19:24:54.859265+0000","last_undegraded":"2023-11-08T19:24:54.859265+0000","last_fullsized":"2023-11-08T19:24:54.859265+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:22:17.196492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.859784+0000","last_change":"2023-11-08T19:24:52.359850+0000","last_active":"2023-11-08T19:24:54.859784+0000","last_peered":"2023-11-08T19:24:54.859784+0000","last_clean":"2023-11-08T19:24:54.859784+0000","last_became_active":"2023-11-08T19:24:52.359572+0000","last_became_peered":"2023-11-08T19:24:52.359572+0000","last_unstale":"2023-11-08T19:24:54.859784+0000","last_undegraded":"2023-11-08T19:24:54.859784+0000","last_fullsized":"2023-11-08T19:24:54.859784+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:25:28.471025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353924+0000","last_change":"2023-11-08T19:24:52.381786+0000","last_active":"2023-11-08T19:24:53.353924+0000","last_peered":"2023-11-08T19:24:53.353924+0000","last_clean":"2023-11-08T19:24:53.353924+0000","last_became_active":"2023-11-08T19:24:52.381496+0000","last_became_peered":"2023-11-08T19:24:52.381496+0000","last_unstale":"2023-11-08T19:24:53.353924+0000","last_undegraded":"2023-11-08T19:24:53.353924+0000","last_fullsized":"2023-11-08T19:24:53.353924+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:28:32.868165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.352340+0000","last_change":"2023-11-08T19:24:52.370764+0000","last_active":"2023-11-08T19:24:53.352340+0000","last_peered":"2023-11-08T19:24:53.352340+0000","last_clean":"2023-11-08T19:24:53.352340+0000","last_became_active":"2023-11-08T19:24:52.370278+0000","last_became_peered":"2023-11-08T19:24:52.370278+0000","last_unstale":"2023-11-08T19:24:53.352340+0000","last_undegraded":"2023-11-08T19:24:53.352340+0000","last_fullsized":"2023-11-08T19:24:53.352340+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:46:51.125293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.860228+0000","last_change":"2023-11-08T19:24:52.370644+0000","last_active":"2023-11-08T19:24:54.860228+0000","last_peered":"2023-11-08T19:24:54.860228+0000","last_clean":"2023-11-08T19:24:54.860228+0000","last_became_active":"2023-11-08T19:24:52.370354+0000","last_became_peered":"2023-11-08T19:24:52.370354+0000","last_unstale":"2023-11-08T19:24:54.860228+0000","last_undegraded":"2023-11-08T19:24:54.860228+0000","last_fullsized":"2023-11-08T19:24:54.860228+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:40:25.469051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.625404+0000","last_change":"2023-11-08T19:24:52.369422+0000","last_active":"2023-11-08T19:24:54.625404+0000","last_peered":"2023-11-08T19:24:54.625404+0000","last_clean":"2023-11-08T19:24:54.625404+0000","last_became_active":"2023-11-08T19:24:52.369171+0000","last_became_peered":"2023-11-08T19:24:52.369171+0000","last_unstale":"2023-11-08T19:24:54.625404+0000","last_undegraded":"2023-11-08T19:24:54.625404+0000","last_fullsized":"2023-11-08T19:24:54.625404+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:46:51.125293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.352273+0000","last_change":"2023-11-08T19:24:52.367757+0000","last_active":"2023-11-08T19:24:53.352273+0000","last_peered":"2023-11-08T19:24:53.352273+0000","last_clean":"2023-11-08T19:24:53.352273+0000","last_became_active":"2023-11-08T19:24:52.367419+0000","last_became_peered":"2023-11-08T19:24:52.367419+0000","last_unstale":"2023-11-08T19:24:53.352273+0000","last_undegraded":"2023-11-08T19:24:53.352273+0000","last_fullsized":"2023-11-08T19:24:53.352273+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:19:42.465079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.858886+0000","last_change":"2023-11-08T19:24:52.362457+0000","last_active":"2023-11-08T19:24:54.858886+0000","last_peered":"2023-11-08T19:24:54.858886+0000","last_clean":"2023-11-08T19:24:54.858886+0000","last_became_active":"2023-11-08T19:24:52.362171+0000","last_became_peered":"2023-11-08T19:24:52.362171+0000","last_unstale":"2023-11-08T19:24:54.858886+0000","last_undegraded":"2023-11-08T19:24:54.858886+0000","last_fullsized":"2023-11-08T19:24:54.858886+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:23:24.004572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.352552+0000","last_change":"2023-11-08T19:24:52.374131+0000","last_active":"2023-11-08T19:24:53.352552+0000","last_peered":"2023-11-08T19:24:53.352552+0000","last_clean":"2023-11-08T19:24:53.352552+0000","last_became_active":"2023-11-08T19:24:52.373820+0000","last_became_peered":"2023-11-08T19:24:52.373820+0000","last_unstale":"2023-11-08T19:24:53.352552+0000","last_undegraded":"2023-11-08T19:24:53.352552+0000","last_fullsized":"2023-11-08T19:24:53.352552+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:34:00.935120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.859473+0000","last_change":"2023-11-08T19:24:52.368000+0000","last_active":"2023-11-08T19:24:54.859473+0000","last_peered":"2023-11-08T19:24:54.859473+0000","last_clean":"2023-11-08T19:24:54.859473+0000","last_became_active":"2023-11-08T19:24:52.367732+0000","last_became_peered":"2023-11-08T19:24:52.367732+0000","last_unstale":"2023-11-08T19:24:54.859473+0000","last_undegraded":"2023-11-08T19:24:54.859473+0000","last_fullsized":"2023-11-08T19:24:54.859473+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:50:54.639097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.859207+0000","last_change":"2023-11-08T19:24:52.357810+0000","last_active":"2023-11-08T19:24:54.859207+0000","last_peered":"2023-11-08T19:24:54.859207+0000","last_clean":"2023-11-08T19:24:54.859207+0000","last_became_active":"2023-11-08T19:24:52.357547+0000","last_became_peered":"2023-11-08T19:24:52.357547+0000","last_unstale":"2023-11-08T19:24:54.859207+0000","last_undegraded":"2023-11-08T19:24:54.859207+0000","last_fullsized":"2023-11-08T19:24:54.859207+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:23:44.153863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.352484+0000","last_change":"2023-11-08T19:24:52.370548+0000","last_active":"2023-11-08T19:24:53.352484+0000","last_peered":"2023-11-08T19:24:53.352484+0000","last_clean":"2023-11-08T19:24:53.352484+0000","last_became_active":"2023-11-08T19:24:52.369904+0000","last_became_peered":"2023-11-08T19:24:52.369904+0000","last_unstale":"2023-11-08T19:24:53.352484+0000","last_undegraded":"2023-11-08T19:24:53.352484+0000","last_fullsized":"2023-11-08T19:24:53.352484+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:08:17.924911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.446707+0000","last_change":"2023-11-08T19:24:52.371639+0000","last_active":"2023-11-08T19:24:53.446707+0000","last_peered":"2023-11-08T19:24:53.446707+0000","last_clean":"2023-11-08T19:24:53.446707+0000","last_became_active":"2023-11-08T19:24:52.371414+0000","last_became_peered":"2023-11-08T19:24:52.371414+0000","last_unstale":"2023-11-08T19:24:53.446707+0000","last_undegraded":"2023-11-08T19:24:53.446707+0000","last_fullsized":"2023-11-08T19:24:53.446707+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:23:44.153863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.352325+0000","last_change":"2023-11-08T19:24:52.366038+0000","last_active":"2023-11-08T19:24:53.352325+0000","last_peered":"2023-11-08T19:24:53.352325+0000","last_clean":"2023-11-08T19:24:53.352325+0000","last_became_active":"2023-11-08T19:24:52.365764+0000","last_became_peered":"2023-11-08T19:24:52.365764+0000","last_unstale":"2023-11-08T19:24:53.352325+0000","last_undegraded":"2023-11-08T19:24:53.352325+0000","last_fullsized":"2023-11-08T19:24:53.352325+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:04:17.106623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.352445+0000","last_change":"2023-11-08T19:24:52.368437+0000","last_active":"2023-11-08T19:24:53.352445+0000","last_peered":"2023-11-08T19:24:53.352445+0000","last_clean":"2023-11-08T19:24:53.352445+0000","last_became_active":"2023-11-08T19:24:52.368190+0000","last_became_peered":"2023-11-08T19:24:52.368190+0000","last_unstale":"2023-11-08T19:24:53.352445+0000","last_undegraded":"2023-11-08T19:24:53.352445+0000","last_fullsized":"2023-11-08T19:24:53.352445+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:53:42.472906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.625352+0000","last_change":"2023-11-08T19:24:52.372411+0000","last_active":"2023-11-08T19:24:54.625352+0000","last_peered":"2023-11-08T19:24:54.625352+0000","last_clean":"2023-11-08T19:24:54.625352+0000","last_became_active":"2023-11-08T19:24:52.372145+0000","last_became_peered":"2023-11-08T19:24:52.372145+0000","last_unstale":"2023-11-08T19:24:54.625352+0000","last_undegraded":"2023-11-08T19:24:54.625352+0000","last_fullsized":"2023-11-08T19:24:54.625352+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:23:49.083463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.859820+0000","last_change":"2023-11-08T19:24:52.367733+0000","last_active":"2023-11-08T19:24:54.859820+0000","last_peered":"2023-11-08T19:24:54.859820+0000","last_clean":"2023-11-08T19:24:54.859820+0000","last_became_active":"2023-11-08T19:24:52.367408+0000","last_became_peered":"2023-11-08T19:24:52.367408+0000","last_unstale":"2023-11-08T19:24:54.859820+0000","last_undegraded":"2023-11-08T19:24:54.859820+0000","last_fullsized":"2023-11-08T19:24:54.859820+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:20:13.353504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353027+0000","last_change":"2023-11-08T19:24:52.376347+0000","last_active":"2023-11-08T19:24:53.353027+0000","last_peered":"2023-11-08T19:24:53.353027+0000","last_clean":"2023-11-08T19:24:53.353027+0000","last_became_active":"2023-11-08T19:24:52.375849+0000","last_became_peered":"2023-11-08T19:24:52.375849+0000","last_unstale":"2023-11-08T19:24:53.353027+0000","last_undegraded":"2023-11-08T19:24:53.353027+0000","last_fullsized":"2023-11-08T19:24:53.353027+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:31:56.573763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.859936+0000","last_change":"2023-11-08T19:24:52.365022+0000","last_active":"2023-11-08T19:24:54.859936+0000","last_peered":"2023-11-08T19:24:54.859936+0000","last_clean":"2023-11-08T19:24:54.859936+0000","last_became_active":"2023-11-08T19:24:52.364699+0000","last_became_peered":"2023-11-08T19:24:52.364699+0000","last_unstale":"2023-11-08T19:24:54.859936+0000","last_undegraded":"2023-11-08T19:24:54.859936+0000","last_fullsized":"2023-11-08T19:24:54.859936+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:31:45.750319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.859034+0000","last_change":"2023-11-08T19:24:52.369315+0000","last_active":"2023-11-08T19:24:54.859034+0000","last_peered":"2023-11-08T19:24:54.859034+0000","last_clean":"2023-11-08T19:24:54.859034+0000","last_became_active":"2023-11-08T19:24:52.368967+0000","last_became_peered":"2023-11-08T19:24:52.368967+0000","last_unstale":"2023-11-08T19:24:54.859034+0000","last_undegraded":"2023-11-08T19:24:54.859034+0000","last_fullsized":"2023-11-08T19:24:54.859034+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:20:19.983408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353154+0000","last_change":"2023-11-08T19:24:52.378669+0000","last_active":"2023-11-08T19:24:53.353154+0000","last_peered":"2023-11-08T19:24:53.353154+0000","last_clean":"2023-11-08T19:24:53.353154+0000","last_became_active":"2023-11-08T19:24:52.378389+0000","last_became_peered":"2023-11-08T19:24:52.378389+0000","last_unstale":"2023-11-08T19:24:53.353154+0000","last_undegraded":"2023-11-08T19:24:53.353154+0000","last_fullsized":"2023-11-08T19:24:53.353154+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:46:31.594290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.859005+0000","last_change":"2023-11-08T19:24:52.371063+0000","last_active":"2023-11-08T19:24:54.859005+0000","last_peered":"2023-11-08T19:24:54.859005+0000","last_clean":"2023-11-08T19:24:54.859005+0000","last_became_active":"2023-11-08T19:24:52.370659+0000","last_became_peered":"2023-11-08T19:24:52.370659+0000","last_unstale":"2023-11-08T19:24:54.859005+0000","last_undegraded":"2023-11-08T19:24:54.859005+0000","last_fullsized":"2023-11-08T19:24:54.859005+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:51:12.721130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353446+0000","last_change":"2023-11-08T19:24:52.381743+0000","last_active":"2023-11-08T19:24:53.353446+0000","last_peered":"2023-11-08T19:24:53.353446+0000","last_clean":"2023-11-08T19:24:53.353446+0000","last_became_active":"2023-11-08T19:24:52.381427+0000","last_became_peered":"2023-11-08T19:24:52.381427+0000","last_unstale":"2023-11-08T19:24:53.353446+0000","last_undegraded":"2023-11-08T19:24:53.353446+0000","last_fullsized":"2023-11-08T19:24:53.353446+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:46:51.125293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.446369+0000","last_change":"2023-11-08T19:24:52.379334+0000","last_active":"2023-11-08T19:24:53.446369+0000","last_peered":"2023-11-08T19:24:53.446369+0000","last_clean":"2023-11-08T19:24:53.446369+0000","last_became_active":"2023-11-08T19:24:52.379044+0000","last_became_peered":"2023-11-08T19:24:52.379044+0000","last_unstale":"2023-11-08T19:24:53.446369+0000","last_undegraded":"2023-11-08T19:24:53.446369+0000","last_fullsized":"2023-11-08T19:24:53.446369+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:34:00.935120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.859445+0000","last_change":"2023-11-08T19:24:52.366987+0000","last_active":"2023-11-08T19:24:54.859445+0000","last_peered":"2023-11-08T19:24:54.859445+0000","last_clean":"2023-11-08T19:24:54.859445+0000","last_became_active":"2023-11-08T19:24:52.365321+0000","last_became_peered":"2023-11-08T19:24:52.365321+0000","last_unstale":"2023-11-08T19:24:54.859445+0000","last_undegraded":"2023-11-08T19:24:54.859445+0000","last_fullsized":"2023-11-08T19:24:54.859445+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:47.290986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.351822+0000","last_change":"2023-11-08T19:24:52.373160+0000","last_active":"2023-11-08T19:24:53.351822+0000","last_peered":"2023-11-08T19:24:53.351822+0000","last_clean":"2023-11-08T19:24:53.351822+0000","last_became_active":"2023-11-08T19:24:52.372873+0000","last_became_peered":"2023-11-08T19:24:52.372873+0000","last_unstale":"2023-11-08T19:24:53.351822+0000","last_undegraded":"2023-11-08T19:24:53.351822+0000","last_fullsized":"2023-11-08T19:24:53.351822+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:46:31.594290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.625623+0000","last_change":"2023-11-08T19:24:52.371810+0000","last_active":"2023-11-08T19:24:54.625623+0000","last_peered":"2023-11-08T19:24:54.625623+0000","last_clean":"2023-11-08T19:24:54.625623+0000","last_became_active":"2023-11-08T19:24:52.371516+0000","last_became_peered":"2023-11-08T19:24:52.371516+0000","last_unstale":"2023-11-08T19:24:54.625623+0000","last_undegraded":"2023-11-08T19:24:54.625623+0000","last_fullsized":"2023-11-08T19:24:54.625623+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:08:17.924911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.859297+0000","last_change":"2023-11-08T19:24:52.370855+0000","last_active":"2023-11-08T19:24:54.859297+0000","last_peered":"2023-11-08T19:24:54.859297+0000","last_clean":"2023-11-08T19:24:54.859297+0000","last_became_active":"2023-11-08T19:24:52.370508+0000","last_became_peered":"2023-11-08T19:24:52.370508+0000","last_unstale":"2023-11-08T19:24:54.859297+0000","last_undegraded":"2023-11-08T19:24:54.859297+0000","last_fullsized":"2023-11-08T19:24:54.859297+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:09:26.091318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.859197+0000","last_change":"2023-11-08T19:24:52.360652+0000","last_active":"2023-11-08T19:24:54.859197+0000","last_peered":"2023-11-08T19:24:54.859197+0000","last_clean":"2023-11-08T19:24:54.859197+0000","last_became_active":"2023-11-08T19:24:52.360372+0000","last_became_peered":"2023-11-08T19:24:52.360372+0000","last_unstale":"2023-11-08T19:24:54.859197+0000","last_undegraded":"2023-11-08T19:24:54.859197+0000","last_fullsized":"2023-11-08T19:24:54.859197+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:19:12.808598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353428+0000","last_change":"2023-11-08T19:24:52.375322+0000","last_active":"2023-11-08T19:24:53.353428+0000","last_peered":"2023-11-08T19:24:53.353428+0000","last_clean":"2023-11-08T19:24:53.353428+0000","last_became_active":"2023-11-08T19:24:52.375013+0000","last_became_peered":"2023-11-08T19:24:52.375013+0000","last_unstale":"2023-11-08T19:24:53.353428+0000","last_undegraded":"2023-11-08T19:24:53.353428+0000","last_fullsized":"2023-11-08T19:24:53.353428+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:14:05.670963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.859148+0000","last_change":"2023-11-08T19:24:52.363157+0000","last_active":"2023-11-08T19:24:54.859148+0000","last_peered":"2023-11-08T19:24:54.859148+0000","last_clean":"2023-11-08T19:24:54.859148+0000","last_became_active":"2023-11-08T19:24:52.362889+0000","last_became_peered":"2023-11-08T19:24:52.362889+0000","last_unstale":"2023-11-08T19:24:54.859148+0000","last_undegraded":"2023-11-08T19:24:54.859148+0000","last_fullsized":"2023-11-08T19:24:54.859148+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:25:39.567729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.625400+0000","last_change":"2023-11-08T19:24:52.367182+0000","last_active":"2023-11-08T19:24:54.625400+0000","last_peered":"2023-11-08T19:24:54.625400+0000","last_clean":"2023-11-08T19:24:54.625400+0000","last_became_active":"2023-11-08T19:24:52.366873+0000","last_became_peered":"2023-11-08T19:24:52.366873+0000","last_unstale":"2023-11-08T19:24:54.625400+0000","last_undegraded":"2023-11-08T19:24:54.625400+0000","last_fullsized":"2023-11-08T19:24:54.625400+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:26:22.628067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.352833+0000","last_change":"2023-11-08T19:24:52.378669+0000","last_active":"2023-11-08T19:24:53.352833+0000","last_peered":"2023-11-08T19:24:53.352833+0000","last_clean":"2023-11-08T19:24:53.352833+0000","last_became_active":"2023-11-08T19:24:52.378393+0000","last_became_peered":"2023-11-08T19:24:52.378393+0000","last_unstale":"2023-11-08T19:24:53.352833+0000","last_undegraded":"2023-11-08T19:24:53.352833+0000","last_fullsized":"2023-11-08T19:24:53.352833+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:26:04.745188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.358783+0000","last_change":"2023-11-08T19:24:51.344739+0000","last_active":"2023-11-08T19:24:52.358783+0000","last_peered":"2023-11-08T19:24:52.358783+0000","last_clean":"2023-11-08T19:24:52.358783+0000","last_became_active":"2023-11-08T19:24:51.344471+0000","last_became_peered":"2023-11-08T19:24:51.344471+0000","last_unstale":"2023-11-08T19:24:52.358783+0000","last_undegraded":"2023-11-08T19:24:52.358783+0000","last_fullsized":"2023-11-08T19:24:52.358783+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:28:19.340370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":27,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.354730+0000","last_change":"2023-11-08T19:24:32.263958+0000","last_active":"2023-11-08T19:24:52.354730+0000","last_peered":"2023-11-08T19:24:52.354730+0000","last_clean":"2023-11-08T19:24:52.354730+0000","last_became_active":"2023-11-08T19:24:31.149011+0000","last_became_peered":"2023-11-08T19:24:31.149011+0000","last_unstale":"2023-11-08T19:24:52.354730+0000","last_undegraded":"2023-11-08T19:24:52.354730+0000","last_fullsized":"2023-11-08T19:24:52.354730+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:09:04.880374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033496900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.351767+0000","last_change":"2023-11-08T19:24:52.361506+0000","last_active":"2023-11-08T19:24:53.351767+0000","last_peered":"2023-11-08T19:24:53.351767+0000","last_clean":"2023-11-08T19:24:53.351767+0000","last_became_active":"2023-11-08T19:24:52.361223+0000","last_became_peered":"2023-11-08T19:24:52.361223+0000","last_unstale":"2023-11-08T19:24:53.351767+0000","last_undegraded":"2023-11-08T19:24:53.351767+0000","last_fullsized":"2023-11-08T19:24:53.351767+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:31:56.573763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"54'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.383486+0000","last_change":"2023-11-08T19:24:51.356485+0000","last_active":"2023-11-08T19:24:52.383486+0000","last_peered":"2023-11-08T19:24:52.383486+0000","last_clean":"2023-11-08T19:24:52.383486+0000","last_became_active":"2023-11-08T19:24:51.356229+0000","last_became_peered":"2023-11-08T19:24:51.356229+0000","last_unstale":"2023-11-08T19:24:52.383486+0000","last_undegraded":"2023-11-08T19:24:52.383486+0000","last_fullsized":"2023-11-08T19:24:52.383486+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:14:04.664412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":27,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.357501+0000","last_change":"2023-11-08T19:24:32.142892+0000","last_active":"2023-11-08T19:24:52.357501+0000","last_peered":"2023-11-08T19:24:52.357501+0000","last_clean":"2023-11-08T19:24:52.357501+0000","last_became_active":"2023-11-08T19:24:31.144912+0000","last_became_peered":"2023-11-08T19:24:31.144912+0000","last_unstale":"2023-11-08T19:24:52.357501+0000","last_undegraded":"2023-11-08T19:24:52.357501+0000","last_fullsized":"2023-11-08T19:24:52.357501+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:04:21.151484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056686900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353024+0000","last_change":"2023-11-08T19:24:52.381898+0000","last_active":"2023-11-08T19:24:53.353024+0000","last_peered":"2023-11-08T19:24:53.353024+0000","last_clean":"2023-11-08T19:24:53.353024+0000","last_became_active":"2023-11-08T19:24:52.381474+0000","last_became_peered":"2023-11-08T19:24:52.381474+0000","last_unstale":"2023-11-08T19:24:53.353024+0000","last_undegraded":"2023-11-08T19:24:53.353024+0000","last_fullsized":"2023-11-08T19:24:53.353024+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:45:51.213375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"54'8","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353655+0000","last_change":"2023-11-08T19:24:51.353683+0000","last_active":"2023-11-08T19:24:53.353655+0000","last_peered":"2023-11-08T19:24:53.353655+0000","last_clean":"2023-11-08T19:24:53.353655+0000","last_became_active":"2023-11-08T19:24:51.353201+0000","last_became_peered":"2023-11-08T19:24:51.353201+0000","last_unstale":"2023-11-08T19:24:53.353655+0000","last_undegraded":"2023-11-08T19:24:53.353655+0000","last_fullsized":"2023-11-08T19:24:53.353655+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:53:41.466355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":28,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.358536+0000","last_change":"2023-11-08T19:24:32.140514+0000","last_active":"2023-11-08T19:24:52.358536+0000","last_peered":"2023-11-08T19:24:52.358536+0000","last_clean":"2023-11-08T19:24:52.358536+0000","last_became_active":"2023-11-08T19:24:31.146668+0000","last_became_peered":"2023-11-08T19:24:31.146668+0000","last_unstale":"2023-11-08T19:24:52.358536+0000","last_undegraded":"2023-11-08T19:24:52.358536+0000","last_fullsized":"2023-11-08T19:24:52.358536+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:31:24.539374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071576699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353446+0000","last_change":"2023-11-08T19:24:52.372375+0000","last_active":"2023-11-08T19:24:53.353446+0000","last_peered":"2023-11-08T19:24:53.353446+0000","last_clean":"2023-11-08T19:24:53.353446+0000","last_became_active":"2023-11-08T19:24:52.372011+0000","last_became_peered":"2023-11-08T19:24:52.372011+0000","last_unstale":"2023-11-08T19:24:53.353446+0000","last_undegraded":"2023-11-08T19:24:53.353446+0000","last_fullsized":"2023-11-08T19:24:53.353446+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:23:44.153863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.357101+0000","last_change":"2023-11-08T19:24:51.350477+0000","last_active":"2023-11-08T19:24:52.357101+0000","last_peered":"2023-11-08T19:24:52.357101+0000","last_clean":"2023-11-08T19:24:52.357101+0000","last_became_active":"2023-11-08T19:24:51.350209+0000","last_became_peered":"2023-11-08T19:24:51.350209+0000","last_unstale":"2023-11-08T19:24:52.357101+0000","last_undegraded":"2023-11-08T19:24:52.357101+0000","last_fullsized":"2023-11-08T19:24:52.357101+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:54:16.702041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":27,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.355183+0000","last_change":"2023-11-08T19:24:32.263963+0000","last_active":"2023-11-08T19:24:52.355183+0000","last_peered":"2023-11-08T19:24:52.355183+0000","last_clean":"2023-11-08T19:24:52.355183+0000","last_became_active":"2023-11-08T19:24:31.139062+0000","last_became_peered":"2023-11-08T19:24:31.139062+0000","last_unstale":"2023-11-08T19:24:52.355183+0000","last_undegraded":"2023-11-08T19:24:52.355183+0000","last_fullsized":"2023-11-08T19:24:52.355183+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:26.080042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033682599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353734+0000","last_change":"2023-11-08T19:24:52.376929+0000","last_active":"2023-11-08T19:24:53.353734+0000","last_peered":"2023-11-08T19:24:53.353734+0000","last_clean":"2023-11-08T19:24:53.353734+0000","last_became_active":"2023-11-08T19:24:52.376602+0000","last_became_peered":"2023-11-08T19:24:52.376602+0000","last_unstale":"2023-11-08T19:24:53.353734+0000","last_undegraded":"2023-11-08T19:24:53.353734+0000","last_fullsized":"2023-11-08T19:24:53.353734+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:14:34.758666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.351846+0000","last_change":"2023-11-08T19:24:51.355801+0000","last_active":"2023-11-08T19:24:52.351846+0000","last_peered":"2023-11-08T19:24:52.351846+0000","last_clean":"2023-11-08T19:24:52.351846+0000","last_became_active":"2023-11-08T19:24:51.355235+0000","last_became_peered":"2023-11-08T19:24:51.355235+0000","last_unstale":"2023-11-08T19:24:52.351846+0000","last_undegraded":"2023-11-08T19:24:52.351846+0000","last_fullsized":"2023-11-08T19:24:52.351846+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:51:27.832603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":28,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.359977+0000","last_change":"2023-11-08T19:24:32.141131+0000","last_active":"2023-11-08T19:24:52.359977+0000","last_peered":"2023-11-08T19:24:52.359977+0000","last_clean":"2023-11-08T19:24:52.359977+0000","last_became_active":"2023-11-08T19:24:31.146154+0000","last_became_peered":"2023-11-08T19:24:31.146154+0000","last_unstale":"2023-11-08T19:24:52.359977+0000","last_undegraded":"2023-11-08T19:24:52.359977+0000","last_fullsized":"2023-11-08T19:24:52.359977+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:18:40.271560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082432800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.352911+0000","last_change":"2023-11-08T19:24:52.363813+0000","last_active":"2023-11-08T19:24:53.352911+0000","last_peered":"2023-11-08T19:24:53.352911+0000","last_clean":"2023-11-08T19:24:53.352911+0000","last_became_active":"2023-11-08T19:24:52.363528+0000","last_became_peered":"2023-11-08T19:24:52.363528+0000","last_unstale":"2023-11-08T19:24:53.352911+0000","last_undegraded":"2023-11-08T19:24:53.352911+0000","last_fullsized":"2023-11-08T19:24:53.352911+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:33:39.146820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353882+0000","last_change":"2023-11-08T19:24:51.355043+0000","last_active":"2023-11-08T19:24:53.353882+0000","last_peered":"2023-11-08T19:24:53.353882+0000","last_clean":"2023-11-08T19:24:53.353882+0000","last_became_active":"2023-11-08T19:24:51.354777+0000","last_became_peered":"2023-11-08T19:24:51.354777+0000","last_unstale":"2023-11-08T19:24:53.353882+0000","last_undegraded":"2023-11-08T19:24:53.353882+0000","last_fullsized":"2023-11-08T19:24:53.353882+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:04:50.527868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":27,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.357143+0000","last_change":"2023-11-08T19:24:32.529486+0000","last_active":"2023-11-08T19:24:52.357143+0000","last_peered":"2023-11-08T19:24:52.357143+0000","last_clean":"2023-11-08T19:24:52.357143+0000","last_became_active":"2023-11-08T19:24:31.146260+0000","last_became_peered":"2023-11-08T19:24:31.146260+0000","last_unstale":"2023-11-08T19:24:52.357143+0000","last_undegraded":"2023-11-08T19:24:52.357143+0000","last_fullsized":"2023-11-08T19:24:52.357143+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:45:34.425432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059842900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353445+0000","last_change":"2023-11-08T19:24:52.375932+0000","last_active":"2023-11-08T19:24:53.353445+0000","last_peered":"2023-11-08T19:24:53.353445+0000","last_clean":"2023-11-08T19:24:53.353445+0000","last_became_active":"2023-11-08T19:24:52.375648+0000","last_became_peered":"2023-11-08T19:24:52.375648+0000","last_unstale":"2023-11-08T19:24:53.353445+0000","last_undegraded":"2023-11-08T19:24:53.353445+0000","last_fullsized":"2023-11-08T19:24:53.353445+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:26:22.628067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"54'6","reported_seq":18,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.386499+0000","last_change":"2023-11-08T19:24:51.351444+0000","last_active":"2023-11-08T19:24:52.386499+0000","last_peered":"2023-11-08T19:24:52.386499+0000","last_clean":"2023-11-08T19:24:52.386499+0000","last_became_active":"2023-11-08T19:24:51.351187+0000","last_became_peered":"2023-11-08T19:24:51.351187+0000","last_unstale":"2023-11-08T19:24:52.386499+0000","last_undegraded":"2023-11-08T19:24:52.386499+0000","last_fullsized":"2023-11-08T19:24:52.386499+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:28:19.340370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":27,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.357446+0000","last_change":"2023-11-08T19:24:32.530168+0000","last_active":"2023-11-08T19:24:52.357446+0000","last_peered":"2023-11-08T19:24:52.357446+0000","last_clean":"2023-11-08T19:24:52.357446+0000","last_became_active":"2023-11-08T19:24:31.144329+0000","last_became_peered":"2023-11-08T19:24:31.144329+0000","last_unstale":"2023-11-08T19:24:52.357446+0000","last_undegraded":"2023-11-08T19:24:52.357446+0000","last_fullsized":"2023-11-08T19:24:52.357446+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:05:36.085920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043484799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.858934+0000","last_change":"2023-11-08T19:24:52.373986+0000","last_active":"2023-11-08T19:24:54.858934+0000","last_peered":"2023-11-08T19:24:54.858934+0000","last_clean":"2023-11-08T19:24:54.858934+0000","last_became_active":"2023-11-08T19:24:52.373000+0000","last_became_peered":"2023-11-08T19:24:52.373000+0000","last_unstale":"2023-11-08T19:24:54.858934+0000","last_undegraded":"2023-11-08T19:24:54.858934+0000","last_fullsized":"2023-11-08T19:24:54.858934+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:34:00.935120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"54'3","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353873+0000","last_change":"2023-11-08T19:24:51.352040+0000","last_active":"2023-11-08T19:24:53.353873+0000","last_peered":"2023-11-08T19:24:53.353873+0000","last_clean":"2023-11-08T19:24:53.353873+0000","last_became_active":"2023-11-08T19:24:51.351762+0000","last_became_peered":"2023-11-08T19:24:51.351762+0000","last_unstale":"2023-11-08T19:24:53.353873+0000","last_undegraded":"2023-11-08T19:24:53.353873+0000","last_fullsized":"2023-11-08T19:24:53.353873+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:04:59.430912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":29,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.363201+0000","last_change":"2023-11-08T19:24:32.141190+0000","last_active":"2023-11-08T19:24:52.363201+0000","last_peered":"2023-11-08T19:24:52.363201+0000","last_clean":"2023-11-08T19:24:52.363201+0000","last_became_active":"2023-11-08T19:24:31.147651+0000","last_became_peered":"2023-11-08T19:24:31.147651+0000","last_unstale":"2023-11-08T19:24:52.363201+0000","last_undegraded":"2023-11-08T19:24:52.363201+0000","last_fullsized":"2023-11-08T19:24:52.363201+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:21:55.985548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043673300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.859572+0000","last_change":"2023-11-08T19:24:52.373351+0000","last_active":"2023-11-08T19:24:54.859572+0000","last_peered":"2023-11-08T19:24:54.859572+0000","last_clean":"2023-11-08T19:24:54.859572+0000","last_became_active":"2023-11-08T19:24:52.373106+0000","last_became_peered":"2023-11-08T19:24:52.373106+0000","last_unstale":"2023-11-08T19:24:54.859572+0000","last_undegraded":"2023-11-08T19:24:54.859572+0000","last_fullsized":"2023-11-08T19:24:54.859572+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:41:24.012491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"54'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.383067+0000","last_change":"2023-11-08T19:24:51.351129+0000","last_active":"2023-11-08T19:24:52.383067+0000","last_peered":"2023-11-08T19:24:52.383067+0000","last_clean":"2023-11-08T19:24:52.383067+0000","last_became_active":"2023-11-08T19:24:51.350872+0000","last_became_peered":"2023-11-08T19:24:51.350872+0000","last_unstale":"2023-11-08T19:24:52.383067+0000","last_undegraded":"2023-11-08T19:24:52.383067+0000","last_fullsized":"2023-11-08T19:24:52.383067+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:04:59.430912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":27,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.368381+0000","last_change":"2023-11-08T19:24:32.147011+0000","last_active":"2023-11-08T19:24:52.368381+0000","last_peered":"2023-11-08T19:24:52.368381+0000","last_clean":"2023-11-08T19:24:52.368381+0000","last_became_active":"2023-11-08T19:24:31.148250+0000","last_became_peered":"2023-11-08T19:24:31.148250+0000","last_unstale":"2023-11-08T19:24:52.368381+0000","last_undegraded":"2023-11-08T19:24:52.368381+0000","last_fullsized":"2023-11-08T19:24:52.368381+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:01:25.647952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043061299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.859350+0000","last_change":"2023-11-08T19:24:52.370905+0000","last_active":"2023-11-08T19:24:54.859350+0000","last_peered":"2023-11-08T19:24:54.859350+0000","last_clean":"2023-11-08T19:24:54.859350+0000","last_became_active":"2023-11-08T19:24:52.370322+0000","last_became_peered":"2023-11-08T19:24:52.370322+0000","last_unstale":"2023-11-08T19:24:54.859350+0000","last_undegraded":"2023-11-08T19:24:54.859350+0000","last_fullsized":"2023-11-08T19:24:54.859350+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:58:36.921504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"54'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.383294+0000","last_change":"2023-11-08T19:24:51.355208+0000","last_active":"2023-11-08T19:24:52.383294+0000","last_peered":"2023-11-08T19:24:52.383294+0000","last_clean":"2023-11-08T19:24:52.383294+0000","last_became_active":"2023-11-08T19:24:51.354921+0000","last_became_peered":"2023-11-08T19:24:51.354921+0000","last_unstale":"2023-11-08T19:24:52.383294+0000","last_undegraded":"2023-11-08T19:24:52.383294+0000","last_fullsized":"2023-11-08T19:24:52.383294+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:32.064974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":27,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.350956+0000","last_change":"2023-11-08T19:24:32.543880+0000","last_active":"2023-11-08T19:24:52.350956+0000","last_peered":"2023-11-08T19:24:52.350956+0000","last_clean":"2023-11-08T19:24:52.350956+0000","last_became_active":"2023-11-08T19:24:31.142052+0000","last_became_peered":"2023-11-08T19:24:31.142052+0000","last_unstale":"2023-11-08T19:24:52.350956+0000","last_undegraded":"2023-11-08T19:24:52.350956+0000","last_fullsized":"2023-11-08T19:24:52.350956+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:18:42.371676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014881058000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.859573+0000","last_change":"2023-11-08T19:24:52.367908+0000","last_active":"2023-11-08T19:24:54.859573+0000","last_peered":"2023-11-08T19:24:54.859573+0000","last_clean":"2023-11-08T19:24:54.859573+0000","last_became_active":"2023-11-08T19:24:52.367593+0000","last_became_peered":"2023-11-08T19:24:52.367593+0000","last_unstale":"2023-11-08T19:24:54.859573+0000","last_undegraded":"2023-11-08T19:24:54.859573+0000","last_fullsized":"2023-11-08T19:24:54.859573+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:59:13.014364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.362184+0000","last_change":"2023-11-08T19:24:51.342514+0000","last_active":"2023-11-08T19:24:52.362184+0000","last_peered":"2023-11-08T19:24:52.362184+0000","last_clean":"2023-11-08T19:24:52.362184+0000","last_became_active":"2023-11-08T19:24:51.342249+0000","last_became_peered":"2023-11-08T19:24:51.342249+0000","last_unstale":"2023-11-08T19:24:52.362184+0000","last_undegraded":"2023-11-08T19:24:52.362184+0000","last_fullsized":"2023-11-08T19:24:52.362184+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:13:02.452701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":27,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.365352+0000","last_change":"2023-11-08T19:24:32.147235+0000","last_active":"2023-11-08T19:24:52.365352+0000","last_peered":"2023-11-08T19:24:52.365352+0000","last_clean":"2023-11-08T19:24:52.365352+0000","last_became_active":"2023-11-08T19:24:31.146176+0000","last_became_peered":"2023-11-08T19:24:31.146176+0000","last_unstale":"2023-11-08T19:24:52.365352+0000","last_undegraded":"2023-11-08T19:24:52.365352+0000","last_fullsized":"2023-11-08T19:24:52.365352+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:39.214888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048481000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.446453+0000","last_change":"2023-11-08T19:24:52.367571+0000","last_active":"2023-11-08T19:24:53.446453+0000","last_peered":"2023-11-08T19:24:53.446453+0000","last_clean":"2023-11-08T19:24:53.446453+0000","last_became_active":"2023-11-08T19:24:52.367160+0000","last_became_peered":"2023-11-08T19:24:52.367160+0000","last_unstale":"2023-11-08T19:24:53.446453+0000","last_undegraded":"2023-11-08T19:24:53.446453+0000","last_fullsized":"2023-11-08T19:24:53.446453+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:33:39.146820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.357221+0000","last_change":"2023-11-08T19:24:51.349310+0000","last_active":"2023-11-08T19:24:52.357221+0000","last_peered":"2023-11-08T19:24:52.357221+0000","last_clean":"2023-11-08T19:24:52.357221+0000","last_became_active":"2023-11-08T19:24:51.348861+0000","last_became_peered":"2023-11-08T19:24:51.348861+0000","last_unstale":"2023-11-08T19:24:52.357221+0000","last_undegraded":"2023-11-08T19:24:52.357221+0000","last_fullsized":"2023-11-08T19:24:52.357221+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:26:03.738637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":29,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.363182+0000","last_change":"2023-11-08T19:24:32.142376+0000","last_active":"2023-11-08T19:24:52.363182+0000","last_peered":"2023-11-08T19:24:52.363182+0000","last_clean":"2023-11-08T19:24:52.363182+0000","last_became_active":"2023-11-08T19:24:31.144614+0000","last_became_peered":"2023-11-08T19:24:31.144614+0000","last_unstale":"2023-11-08T19:24:52.363182+0000","last_undegraded":"2023-11-08T19:24:52.363182+0000","last_fullsized":"2023-11-08T19:24:52.363182+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:09:04.880374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050362200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.859606+0000","last_change":"2023-11-08T19:24:52.370652+0000","last_active":"2023-11-08T19:24:54.859606+0000","last_peered":"2023-11-08T19:24:54.859606+0000","last_clean":"2023-11-08T19:24:54.859606+0000","last_became_active":"2023-11-08T19:24:52.370397+0000","last_became_peered":"2023-11-08T19:24:52.370397+0000","last_unstale":"2023-11-08T19:24:54.859606+0000","last_undegraded":"2023-11-08T19:24:54.859606+0000","last_fullsized":"2023-11-08T19:24:54.859606+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:06:14.801846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"54'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.381302+0000","last_change":"2023-11-08T19:24:51.349114+0000","last_active":"2023-11-08T19:24:52.381302+0000","last_peered":"2023-11-08T19:24:52.381302+0000","last_clean":"2023-11-08T19:24:52.381302+0000","last_became_active":"2023-11-08T19:24:51.348851+0000","last_became_peered":"2023-11-08T19:24:51.348851+0000","last_unstale":"2023-11-08T19:24:52.381302+0000","last_undegraded":"2023-11-08T19:24:52.381302+0000","last_fullsized":"2023-11-08T19:24:52.381302+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:11:45.936608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":27,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.365437+0000","last_change":"2023-11-08T19:24:32.146639+0000","last_active":"2023-11-08T19:24:52.365437+0000","last_peered":"2023-11-08T19:24:52.365437+0000","last_clean":"2023-11-08T19:24:52.365437+0000","last_became_active":"2023-11-08T19:24:31.147384+0000","last_became_peered":"2023-11-08T19:24:31.147384+0000","last_unstale":"2023-11-08T19:24:52.365437+0000","last_undegraded":"2023-11-08T19:24:52.365437+0000","last_fullsized":"2023-11-08T19:24:52.365437+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:30:21.946303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043834899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.625920+0000","last_change":"2023-11-08T19:24:52.373714+0000","last_active":"2023-11-08T19:24:54.625920+0000","last_peered":"2023-11-08T19:24:54.625920+0000","last_clean":"2023-11-08T19:24:54.625920+0000","last_became_active":"2023-11-08T19:24:52.372836+0000","last_became_peered":"2023-11-08T19:24:52.372836+0000","last_unstale":"2023-11-08T19:24:54.625920+0000","last_undegraded":"2023-11-08T19:24:54.625920+0000","last_fullsized":"2023-11-08T19:24:54.625920+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:23:24.004572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"54'4","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.383290+0000","last_change":"2023-11-08T19:24:51.352238+0000","last_active":"2023-11-08T19:24:52.383290+0000","last_peered":"2023-11-08T19:24:52.383290+0000","last_clean":"2023-11-08T19:24:52.383290+0000","last_became_active":"2023-11-08T19:24:51.352005+0000","last_became_peered":"2023-11-08T19:24:51.352005+0000","last_unstale":"2023-11-08T19:24:52.383290+0000","last_undegraded":"2023-11-08T19:24:52.383290+0000","last_fullsized":"2023-11-08T19:24:52.383290+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:45:50.206824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":27,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.350574+0000","last_change":"2023-11-08T19:24:32.544108+0000","last_active":"2023-11-08T19:24:52.350574+0000","last_peered":"2023-11-08T19:24:52.350574+0000","last_clean":"2023-11-08T19:24:52.350574+0000","last_became_active":"2023-11-08T19:24:31.143812+0000","last_became_peered":"2023-11-08T19:24:31.143812+0000","last_unstale":"2023-11-08T19:24:52.350574+0000","last_undegraded":"2023-11-08T19:24:52.350574+0000","last_fullsized":"2023-11-08T19:24:52.350574+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:27:59.135977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014956126,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.625716+0000","last_change":"2023-11-08T19:24:52.368874+0000","last_active":"2023-11-08T19:24:54.625716+0000","last_peered":"2023-11-08T19:24:54.625716+0000","last_clean":"2023-11-08T19:24:54.625716+0000","last_became_active":"2023-11-08T19:24:52.368378+0000","last_became_peered":"2023-11-08T19:24:52.368378+0000","last_unstale":"2023-11-08T19:24:54.625716+0000","last_undegraded":"2023-11-08T19:24:54.625716+0000","last_fullsized":"2023-11-08T19:24:54.625716+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:28:32.868165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"54'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.382053+0000","last_change":"2023-11-08T19:24:51.349712+0000","last_active":"2023-11-08T19:24:52.382053+0000","last_peered":"2023-11-08T19:24:52.382053+0000","last_clean":"2023-11-08T19:24:52.382053+0000","last_became_active":"2023-11-08T19:24:51.349432+0000","last_became_peered":"2023-11-08T19:24:51.349432+0000","last_unstale":"2023-11-08T19:24:52.382053+0000","last_undegraded":"2023-11-08T19:24:52.382053+0000","last_fullsized":"2023-11-08T19:24:52.382053+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:45:50.206824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":27,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.363264+0000","last_change":"2023-11-08T19:24:32.530378+0000","last_active":"2023-11-08T19:24:52.363264+0000","last_peered":"2023-11-08T19:24:52.363264+0000","last_clean":"2023-11-08T19:24:52.363264+0000","last_became_active":"2023-11-08T19:24:31.144341+0000","last_became_peered":"2023-11-08T19:24:31.144341+0000","last_unstale":"2023-11-08T19:24:52.363264+0000","last_undegraded":"2023-11-08T19:24:52.363264+0000","last_fullsized":"2023-11-08T19:24:52.363264+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:30:21.946303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058308299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.625747+0000","last_change":"2023-11-08T19:24:52.366470+0000","last_active":"2023-11-08T19:24:54.625747+0000","last_peered":"2023-11-08T19:24:54.625747+0000","last_clean":"2023-11-08T19:24:54.625747+0000","last_became_active":"2023-11-08T19:24:52.366168+0000","last_became_peered":"2023-11-08T19:24:52.366168+0000","last_unstale":"2023-11-08T19:24:54.625747+0000","last_undegraded":"2023-11-08T19:24:54.625747+0000","last_fullsized":"2023-11-08T19:24:54.625747+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:11:46.943159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"54'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.383543+0000","last_change":"2023-11-08T19:24:51.352460+0000","last_active":"2023-11-08T19:24:52.383543+0000","last_peered":"2023-11-08T19:24:52.383543+0000","last_clean":"2023-11-08T19:24:52.383543+0000","last_became_active":"2023-11-08T19:24:51.352204+0000","last_became_peered":"2023-11-08T19:24:51.352204+0000","last_unstale":"2023-11-08T19:24:52.383543+0000","last_undegraded":"2023-11-08T19:24:52.383543+0000","last_fullsized":"2023-11-08T19:24:52.383543+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:26:03.738637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":28,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.358811+0000","last_change":"2023-11-08T19:24:32.140832+0000","last_active":"2023-11-08T19:24:52.358811+0000","last_peered":"2023-11-08T19:24:52.358811+0000","last_clean":"2023-11-08T19:24:52.358811+0000","last_became_active":"2023-11-08T19:24:31.146557+0000","last_became_peered":"2023-11-08T19:24:31.146557+0000","last_unstale":"2023-11-08T19:24:52.358811+0000","last_undegraded":"2023-11-08T19:24:52.358811+0000","last_fullsized":"2023-11-08T19:24:52.358811+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:40:04.258107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099450100000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.352995+0000","last_change":"2023-11-08T19:24:52.381859+0000","last_active":"2023-11-08T19:24:53.352995+0000","last_peered":"2023-11-08T19:24:53.352995+0000","last_clean":"2023-11-08T19:24:53.352995+0000","last_became_active":"2023-11-08T19:24:52.381568+0000","last_became_peered":"2023-11-08T19:24:52.381568+0000","last_unstale":"2023-11-08T19:24:53.352995+0000","last_undegraded":"2023-11-08T19:24:53.352995+0000","last_fullsized":"2023-11-08T19:24:53.352995+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:09:36.064066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.363104+0000","last_change":"2023-11-08T19:24:51.351359+0000","last_active":"2023-11-08T19:24:52.363104+0000","last_peered":"2023-11-08T19:24:52.363104+0000","last_clean":"2023-11-08T19:24:52.363104+0000","last_became_active":"2023-11-08T19:24:51.351077+0000","last_became_peered":"2023-11-08T19:24:51.351077+0000","last_unstale":"2023-11-08T19:24:52.363104+0000","last_undegraded":"2023-11-08T19:24:52.363104+0000","last_fullsized":"2023-11-08T19:24:52.363104+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:01:44.402590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":28,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.358845+0000","last_change":"2023-11-08T19:24:32.141188+0000","last_active":"2023-11-08T19:24:52.358845+0000","last_peered":"2023-11-08T19:24:52.358845+0000","last_clean":"2023-11-08T19:24:52.358845+0000","last_became_active":"2023-11-08T19:24:31.148857+0000","last_became_peered":"2023-11-08T19:24:31.148857+0000","last_unstale":"2023-11-08T19:24:52.358845+0000","last_undegraded":"2023-11-08T19:24:52.358845+0000","last_fullsized":"2023-11-08T19:24:52.358845+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:45:34.425432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065078599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.859138+0000","last_change":"2023-11-08T19:24:52.356944+0000","last_active":"2023-11-08T19:24:54.859138+0000","last_peered":"2023-11-08T19:24:54.859138+0000","last_clean":"2023-11-08T19:24:54.859138+0000","last_became_active":"2023-11-08T19:24:52.356663+0000","last_became_peered":"2023-11-08T19:24:52.356663+0000","last_unstale":"2023-11-08T19:24:54.859138+0000","last_undegraded":"2023-11-08T19:24:54.859138+0000","last_fullsized":"2023-11-08T19:24:54.859138+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:00:00.539298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.354586+0000","last_change":"2023-11-08T19:24:51.350538+0000","last_active":"2023-11-08T19:24:52.354586+0000","last_peered":"2023-11-08T19:24:52.354586+0000","last_clean":"2023-11-08T19:24:52.354586+0000","last_became_active":"2023-11-08T19:24:51.350279+0000","last_became_peered":"2023-11-08T19:24:51.350279+0000","last_unstale":"2023-11-08T19:24:52.354586+0000","last_undegraded":"2023-11-08T19:24:52.354586+0000","last_fullsized":"2023-11-08T19:24:52.354586+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:32.064974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":28,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.358040+0000","last_change":"2023-11-08T19:24:32.140167+0000","last_active":"2023-11-08T19:24:52.358040+0000","last_peered":"2023-11-08T19:24:52.358040+0000","last_clean":"2023-11-08T19:24:52.358040+0000","last_became_active":"2023-11-08T19:24:31.147181+0000","last_became_peered":"2023-11-08T19:24:31.147181+0000","last_unstale":"2023-11-08T19:24:52.358040+0000","last_undegraded":"2023-11-08T19:24:52.358040+0000","last_fullsized":"2023-11-08T19:24:52.358040+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:26.080042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057135200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.859970+0000","last_change":"2023-11-08T19:24:52.367723+0000","last_active":"2023-11-08T19:24:54.859970+0000","last_peered":"2023-11-08T19:24:54.859970+0000","last_clean":"2023-11-08T19:24:54.859970+0000","last_became_active":"2023-11-08T19:24:52.367442+0000","last_became_peered":"2023-11-08T19:24:52.367442+0000","last_unstale":"2023-11-08T19:24:54.859970+0000","last_undegraded":"2023-11-08T19:24:54.859970+0000","last_fullsized":"2023-11-08T19:24:54.859970+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:23:47.982756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.350487+0000","last_change":"2023-11-08T19:24:51.349877+0000","last_active":"2023-11-08T19:24:52.350487+0000","last_peered":"2023-11-08T19:24:52.350487+0000","last_clean":"2023-11-08T19:24:52.350487+0000","last_became_active":"2023-11-08T19:24:51.349603+0000","last_became_peered":"2023-11-08T19:24:51.349603+0000","last_unstale":"2023-11-08T19:24:52.350487+0000","last_undegraded":"2023-11-08T19:24:52.350487+0000","last_fullsized":"2023-11-08T19:24:52.350487+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:45:50.206824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":27,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.362379+0000","last_change":"2023-11-08T19:24:32.530895+0000","last_active":"2023-11-08T19:24:52.362379+0000","last_peered":"2023-11-08T19:24:52.362379+0000","last_clean":"2023-11-08T19:24:52.362379+0000","last_became_active":"2023-11-08T19:24:31.146715+0000","last_became_peered":"2023-11-08T19:24:31.146715+0000","last_unstale":"2023-11-08T19:24:52.362379+0000","last_undegraded":"2023-11-08T19:24:52.362379+0000","last_fullsized":"2023-11-08T19:24:52.362379+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:39.214888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081671599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.858625+0000","last_change":"2023-11-08T19:24:52.368390+0000","last_active":"2023-11-08T19:24:54.858625+0000","last_peered":"2023-11-08T19:24:54.858625+0000","last_clean":"2023-11-08T19:24:54.858625+0000","last_became_active":"2023-11-08T19:24:52.368084+0000","last_became_peered":"2023-11-08T19:24:52.368084+0000","last_unstale":"2023-11-08T19:24:54.858625+0000","last_undegraded":"2023-11-08T19:24:54.858625+0000","last_fullsized":"2023-11-08T19:24:54.858625+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:53:42.472906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.354441+0000","last_change":"2023-11-08T19:24:51.351975+0000","last_active":"2023-11-08T19:24:52.354441+0000","last_peered":"2023-11-08T19:24:52.354441+0000","last_clean":"2023-11-08T19:24:52.354441+0000","last_became_active":"2023-11-08T19:24:51.351729+0000","last_became_peered":"2023-11-08T19:24:51.351729+0000","last_unstale":"2023-11-08T19:24:52.354441+0000","last_undegraded":"2023-11-08T19:24:52.354441+0000","last_fullsized":"2023-11-08T19:24:52.354441+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:13:02.452701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":27,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.359188+0000","last_change":"2023-11-08T19:24:32.333430+0000","last_active":"2023-11-08T19:24:52.359188+0000","last_peered":"2023-11-08T19:24:52.359188+0000","last_clean":"2023-11-08T19:24:52.359188+0000","last_became_active":"2023-11-08T19:24:31.141710+0000","last_became_peered":"2023-11-08T19:24:31.141710+0000","last_unstale":"2023-11-08T19:24:52.359188+0000","last_undegraded":"2023-11-08T19:24:52.359188+0000","last_fullsized":"2023-11-08T19:24:52.359188+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:32:51.214551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000430438,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.352282+0000","last_change":"2023-11-08T19:24:52.369539+0000","last_active":"2023-11-08T19:24:53.352282+0000","last_peered":"2023-11-08T19:24:53.352282+0000","last_clean":"2023-11-08T19:24:53.352282+0000","last_became_active":"2023-11-08T19:24:52.369278+0000","last_became_peered":"2023-11-08T19:24:52.369278+0000","last_unstale":"2023-11-08T19:24:53.352282+0000","last_undegraded":"2023-11-08T19:24:53.352282+0000","last_fullsized":"2023-11-08T19:24:53.352282+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:26:22.628067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.362009+0000","last_change":"2023-11-08T19:24:51.349871+0000","last_active":"2023-11-08T19:24:52.362009+0000","last_peered":"2023-11-08T19:24:52.362009+0000","last_clean":"2023-11-08T19:24:52.362009+0000","last_became_active":"2023-11-08T19:24:51.349612+0000","last_became_peered":"2023-11-08T19:24:51.349612+0000","last_unstale":"2023-11-08T19:24:52.362009+0000","last_undegraded":"2023-11-08T19:24:52.362009+0000","last_fullsized":"2023-11-08T19:24:52.362009+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:09:35.057515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":27,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.362531+0000","last_change":"2023-11-08T19:24:32.530333+0000","last_active":"2023-11-08T19:24:52.362531+0000","last_peered":"2023-11-08T19:24:52.362531+0000","last_clean":"2023-11-08T19:24:52.362531+0000","last_became_active":"2023-11-08T19:24:31.144838+0000","last_became_peered":"2023-11-08T19:24:31.144838+0000","last_unstale":"2023-11-08T19:24:52.362531+0000","last_undegraded":"2023-11-08T19:24:52.362531+0000","last_fullsized":"2023-11-08T19:24:52.362531+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:39:48.473183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081588799999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.351955+0000","last_change":"2023-11-08T19:24:52.365779+0000","last_active":"2023-11-08T19:24:53.351955+0000","last_peered":"2023-11-08T19:24:53.351955+0000","last_clean":"2023-11-08T19:24:53.351955+0000","last_became_active":"2023-11-08T19:24:52.365477+0000","last_became_peered":"2023-11-08T19:24:52.365477+0000","last_unstale":"2023-11-08T19:24:53.351955+0000","last_undegraded":"2023-11-08T19:24:53.351955+0000","last_fullsized":"2023-11-08T19:24:53.351955+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:14:05.670963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"54'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.383642+0000","last_change":"2023-11-08T19:24:51.352702+0000","last_active":"2023-11-08T19:24:52.383642+0000","last_peered":"2023-11-08T19:24:52.383642+0000","last_clean":"2023-11-08T19:24:52.383642+0000","last_became_active":"2023-11-08T19:24:51.352447+0000","last_became_peered":"2023-11-08T19:24:51.352447+0000","last_unstale":"2023-11-08T19:24:52.383642+0000","last_undegraded":"2023-11-08T19:24:52.383642+0000","last_fullsized":"2023-11-08T19:24:52.383642+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:28:19.340370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":27,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.358853+0000","last_change":"2023-11-08T19:24:32.333096+0000","last_active":"2023-11-08T19:24:52.358853+0000","last_peered":"2023-11-08T19:24:52.358853+0000","last_clean":"2023-11-08T19:24:52.358853+0000","last_became_active":"2023-11-08T19:24:31.142985+0000","last_became_peered":"2023-11-08T19:24:31.142985+0000","last_unstale":"2023-11-08T19:24:52.358853+0000","last_undegraded":"2023-11-08T19:24:52.358853+0000","last_fullsized":"2023-11-08T19:24:52.358853+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:36:33.274496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000386048,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.625773+0000","last_change":"2023-11-08T19:24:52.368692+0000","last_active":"2023-11-08T19:24:54.625773+0000","last_peered":"2023-11-08T19:24:54.625773+0000","last_clean":"2023-11-08T19:24:54.625773+0000","last_became_active":"2023-11-08T19:24:52.368065+0000","last_became_peered":"2023-11-08T19:24:52.368065+0000","last_unstale":"2023-11-08T19:24:54.625773+0000","last_undegraded":"2023-11-08T19:24:54.625773+0000","last_fullsized":"2023-11-08T19:24:54.625773+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:51:28.839154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.357204+0000","last_change":"2023-11-08T19:24:51.347813+0000","last_active":"2023-11-08T19:24:52.357204+0000","last_peered":"2023-11-08T19:24:52.357204+0000","last_clean":"2023-11-08T19:24:52.357204+0000","last_became_active":"2023-11-08T19:24:51.347531+0000","last_became_peered":"2023-11-08T19:24:51.347531+0000","last_unstale":"2023-11-08T19:24:52.357204+0000","last_undegraded":"2023-11-08T19:24:52.357204+0000","last_fullsized":"2023-11-08T19:24:52.357204+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:04:44.238632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":27,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.354591+0000","last_change":"2023-11-08T19:24:32.263810+0000","last_active":"2023-11-08T19:24:52.354591+0000","last_peered":"2023-11-08T19:24:52.354591+0000","last_clean":"2023-11-08T19:24:52.354591+0000","last_became_active":"2023-11-08T19:24:31.138814+0000","last_became_peered":"2023-11-08T19:24:31.138814+0000","last_unstale":"2023-11-08T19:24:52.354591+0000","last_undegraded":"2023-11-08T19:24:52.354591+0000","last_fullsized":"2023-11-08T19:24:52.354591+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:21:55.985548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048136000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.859066+0000","last_change":"2023-11-08T19:24:52.373600+0000","last_active":"2023-11-08T19:24:54.859066+0000","last_peered":"2023-11-08T19:24:54.859066+0000","last_clean":"2023-11-08T19:24:54.859066+0000","last_became_active":"2023-11-08T19:24:52.373330+0000","last_became_peered":"2023-11-08T19:24:52.373330+0000","last_unstale":"2023-11-08T19:24:54.859066+0000","last_undegraded":"2023-11-08T19:24:54.859066+0000","last_fullsized":"2023-11-08T19:24:54.859066+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:33:39.146820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.358702+0000","last_change":"2023-11-08T19:24:51.338424+0000","last_active":"2023-11-08T19:24:52.358702+0000","last_peered":"2023-11-08T19:24:52.358702+0000","last_clean":"2023-11-08T19:24:52.358702+0000","last_became_active":"2023-11-08T19:24:51.338129+0000","last_became_peered":"2023-11-08T19:24:51.338129+0000","last_unstale":"2023-11-08T19:24:52.358702+0000","last_undegraded":"2023-11-08T19:24:52.358702+0000","last_fullsized":"2023-11-08T19:24:52.358702+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:32.064974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":27,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.350835+0000","last_change":"2023-11-08T19:24:32.544063+0000","last_active":"2023-11-08T19:24:52.350835+0000","last_peered":"2023-11-08T19:24:52.350835+0000","last_clean":"2023-11-08T19:24:52.350835+0000","last_became_active":"2023-11-08T19:24:31.144795+0000","last_became_peered":"2023-11-08T19:24:31.144795+0000","last_unstale":"2023-11-08T19:24:52.350835+0000","last_undegraded":"2023-11-08T19:24:52.350835+0000","last_fullsized":"2023-11-08T19:24:52.350835+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:12:42.248307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01495431,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.625678+0000","last_change":"2023-11-08T19:24:52.370238+0000","last_active":"2023-11-08T19:24:54.625678+0000","last_peered":"2023-11-08T19:24:54.625678+0000","last_clean":"2023-11-08T19:24:54.625678+0000","last_became_active":"2023-11-08T19:24:52.369872+0000","last_became_peered":"2023-11-08T19:24:52.369872+0000","last_unstale":"2023-11-08T19:24:54.625678+0000","last_undegraded":"2023-11-08T19:24:54.625678+0000","last_fullsized":"2023-11-08T19:24:54.625678+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:14:34.758666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.355135+0000","last_change":"2023-11-08T19:24:51.353556+0000","last_active":"2023-11-08T19:24:52.355135+0000","last_peered":"2023-11-08T19:24:52.355135+0000","last_clean":"2023-11-08T19:24:52.355135+0000","last_became_active":"2023-11-08T19:24:51.353252+0000","last_became_peered":"2023-11-08T19:24:51.353252+0000","last_unstale":"2023-11-08T19:24:52.355135+0000","last_undegraded":"2023-11-08T19:24:52.355135+0000","last_fullsized":"2023-11-08T19:24:52.355135+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:19:41.458528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":27,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.368461+0000","last_change":"2023-11-08T19:24:32.147025+0000","last_active":"2023-11-08T19:24:52.368461+0000","last_peered":"2023-11-08T19:24:52.368461+0000","last_clean":"2023-11-08T19:24:52.368461+0000","last_became_active":"2023-11-08T19:24:31.147082+0000","last_became_peered":"2023-11-08T19:24:31.147082+0000","last_unstale":"2023-11-08T19:24:52.368461+0000","last_undegraded":"2023-11-08T19:24:52.368461+0000","last_fullsized":"2023-11-08T19:24:52.368461+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:02:27.987795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043701599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.351930+0000","last_change":"2023-11-08T19:24:52.360979+0000","last_active":"2023-11-08T19:24:53.351930+0000","last_peered":"2023-11-08T19:24:53.351930+0000","last_clean":"2023-11-08T19:24:53.351930+0000","last_became_active":"2023-11-08T19:24:52.360672+0000","last_became_peered":"2023-11-08T19:24:52.360672+0000","last_unstale":"2023-11-08T19:24:53.351930+0000","last_undegraded":"2023-11-08T19:24:53.351930+0000","last_fullsized":"2023-11-08T19:24:53.351930+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:23:49.083463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"54'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.383637+0000","last_change":"2023-11-08T19:24:51.339517+0000","last_active":"2023-11-08T19:24:52.383637+0000","last_peered":"2023-11-08T19:24:52.383637+0000","last_clean":"2023-11-08T19:24:52.383637+0000","last_became_active":"2023-11-08T19:24:51.339183+0000","last_became_peered":"2023-11-08T19:24:51.339183+0000","last_unstale":"2023-11-08T19:24:52.383637+0000","last_undegraded":"2023-11-08T19:24:52.383637+0000","last_fullsized":"2023-11-08T19:24:52.383637+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:26:21.621516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":27,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.361933+0000","last_change":"2023-11-08T19:24:32.530620+0000","last_active":"2023-11-08T19:24:52.361933+0000","last_peered":"2023-11-08T19:24:52.361933+0000","last_clean":"2023-11-08T19:24:52.361933+0000","last_became_active":"2023-11-08T19:24:31.144223+0000","last_became_peered":"2023-11-08T19:24:31.144223+0000","last_unstale":"2023-11-08T19:24:52.361933+0000","last_undegraded":"2023-11-08T19:24:52.361933+0000","last_fullsized":"2023-11-08T19:24:52.361933+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:01:25.647952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071879799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.625382+0000","last_change":"2023-11-08T19:24:52.368217+0000","last_active":"2023-11-08T19:24:54.625382+0000","last_peered":"2023-11-08T19:24:54.625382+0000","last_clean":"2023-11-08T19:24:54.625382+0000","last_became_active":"2023-11-08T19:24:52.366276+0000","last_became_peered":"2023-11-08T19:24:52.366276+0000","last_unstale":"2023-11-08T19:24:54.625382+0000","last_undegraded":"2023-11-08T19:24:54.625382+0000","last_fullsized":"2023-11-08T19:24:54.625382+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:14:05.670963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.357104+0000","last_change":"2023-11-08T19:24:51.353449+0000","last_active":"2023-11-08T19:24:52.357104+0000","last_peered":"2023-11-08T19:24:52.357104+0000","last_clean":"2023-11-08T19:24:52.357104+0000","last_became_active":"2023-11-08T19:24:51.353096+0000","last_became_peered":"2023-11-08T19:24:51.353096+0000","last_unstale":"2023-11-08T19:24:52.357104+0000","last_undegraded":"2023-11-08T19:24:52.357104+0000","last_fullsized":"2023-11-08T19:24:52.357104+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:04:59.430912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":28,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.358646+0000","last_change":"2023-11-08T19:24:32.140880+0000","last_active":"2023-11-08T19:24:52.358646+0000","last_peered":"2023-11-08T19:24:52.358646+0000","last_clean":"2023-11-08T19:24:52.358646+0000","last_became_active":"2023-11-08T19:24:31.146063+0000","last_became_peered":"2023-11-08T19:24:31.146063+0000","last_unstale":"2023-11-08T19:24:52.358646+0000","last_undegraded":"2023-11-08T19:24:52.358646+0000","last_fullsized":"2023-11-08T19:24:52.358646+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:54:08.985813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089896300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353781+0000","last_change":"2023-11-08T19:24:52.360248+0000","last_active":"2023-11-08T19:24:53.353781+0000","last_peered":"2023-11-08T19:24:53.353781+0000","last_clean":"2023-11-08T19:24:53.353781+0000","last_became_active":"2023-11-08T19:24:52.359929+0000","last_became_peered":"2023-11-08T19:24:52.359929+0000","last_unstale":"2023-11-08T19:24:53.353781+0000","last_undegraded":"2023-11-08T19:24:53.353781+0000","last_fullsized":"2023-11-08T19:24:53.353781+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:14:34.758666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"54'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.383919+0000","last_change":"2023-11-08T19:24:51.355250+0000","last_active":"2023-11-08T19:24:52.383919+0000","last_peered":"2023-11-08T19:24:52.383919+0000","last_clean":"2023-11-08T19:24:52.383919+0000","last_became_active":"2023-11-08T19:24:51.354947+0000","last_became_peered":"2023-11-08T19:24:51.354947+0000","last_unstale":"2023-11-08T19:24:52.383919+0000","last_undegraded":"2023-11-08T19:24:52.383919+0000","last_fullsized":"2023-11-08T19:24:52.383919+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:04:44.238632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":29,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.363177+0000","last_change":"2023-11-08T19:24:32.139885+0000","last_active":"2023-11-08T19:24:52.363177+0000","last_peered":"2023-11-08T19:24:52.363177+0000","last_clean":"2023-11-08T19:24:52.363177+0000","last_became_active":"2023-11-08T19:24:31.145329+0000","last_became_peered":"2023-11-08T19:24:31.145329+0000","last_unstale":"2023-11-08T19:24:52.363177+0000","last_undegraded":"2023-11-08T19:24:52.363177+0000","last_fullsized":"2023-11-08T19:24:52.363177+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:25:18.356784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049012999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353207+0000","last_change":"2023-11-08T19:24:52.375489+0000","last_active":"2023-11-08T19:24:53.353207+0000","last_peered":"2023-11-08T19:24:53.353207+0000","last_clean":"2023-11-08T19:24:53.353207+0000","last_became_active":"2023-11-08T19:24:52.375203+0000","last_became_peered":"2023-11-08T19:24:52.375203+0000","last_unstale":"2023-11-08T19:24:53.353207+0000","last_undegraded":"2023-11-08T19:24:53.353207+0000","last_fullsized":"2023-11-08T19:24:53.353207+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:23:49.083463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"54'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.383466+0000","last_change":"2023-11-08T19:24:51.355288+0000","last_active":"2023-11-08T19:24:52.383466+0000","last_peered":"2023-11-08T19:24:52.383466+0000","last_clean":"2023-11-08T19:24:52.383466+0000","last_became_active":"2023-11-08T19:24:51.355040+0000","last_became_peered":"2023-11-08T19:24:51.355040+0000","last_unstale":"2023-11-08T19:24:52.383466+0000","last_undegraded":"2023-11-08T19:24:52.383466+0000","last_fullsized":"2023-11-08T19:24:52.383466+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:09:35.057515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":27,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.357414+0000","last_change":"2023-11-08T19:24:32.142836+0000","last_active":"2023-11-08T19:24:52.357414+0000","last_peered":"2023-11-08T19:24:52.357414+0000","last_clean":"2023-11-08T19:24:52.357414+0000","last_became_active":"2023-11-08T19:24:31.141367+0000","last_became_peered":"2023-11-08T19:24:31.141367+0000","last_unstale":"2023-11-08T19:24:52.357414+0000","last_undegraded":"2023-11-08T19:24:52.357414+0000","last_fullsized":"2023-11-08T19:24:52.357414+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:39.214888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001335136,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:53.353587+0000","last_change":"2023-11-08T19:24:52.377063+0000","last_active":"2023-11-08T19:24:53.353587+0000","last_peered":"2023-11-08T19:24:53.353587+0000","last_clean":"2023-11-08T19:24:53.353587+0000","last_became_active":"2023-11-08T19:24:52.376791+0000","last_became_peered":"2023-11-08T19:24:52.376791+0000","last_unstale":"2023-11-08T19:24:53.353587+0000","last_undegraded":"2023-11-08T19:24:53.353587+0000","last_fullsized":"2023-11-08T19:24:53.353587+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:08:17.924911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.361765+0000","last_change":"2023-11-08T19:24:51.351504+0000","last_active":"2023-11-08T19:24:52.361765+0000","last_peered":"2023-11-08T19:24:52.361765+0000","last_clean":"2023-11-08T19:24:52.361765+0000","last_became_active":"2023-11-08T19:24:51.351239+0000","last_became_peered":"2023-11-08T19:24:51.351239+0000","last_unstale":"2023-11-08T19:24:52.361765+0000","last_undegraded":"2023-11-08T19:24:52.361765+0000","last_fullsized":"2023-11-08T19:24:52.361765+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:54:16.702041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":27,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.351449+0000","last_change":"2023-11-08T19:24:32.544285+0000","last_active":"2023-11-08T19:24:52.351449+0000","last_peered":"2023-11-08T19:24:52.351449+0000","last_clean":"2023-11-08T19:24:52.351449+0000","last_became_active":"2023-11-08T19:24:31.142028+0000","last_became_peered":"2023-11-08T19:24:31.142028+0000","last_unstale":"2023-11-08T19:24:52.351449+0000","last_undegraded":"2023-11-08T19:24:52.351449+0000","last_fullsized":"2023-11-08T19:24:52.351449+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:01:24.198196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067537399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.860045+0000","last_change":"2023-11-08T19:24:52.364572+0000","last_active":"2023-11-08T19:24:54.860045+0000","last_peered":"2023-11-08T19:24:54.860045+0000","last_clean":"2023-11-08T19:24:54.860045+0000","last_became_active":"2023-11-08T19:24:52.364297+0000","last_became_peered":"2023-11-08T19:24:52.364297+0000","last_unstale":"2023-11-08T19:24:54.860045+0000","last_undegraded":"2023-11-08T19:24:54.860045+0000","last_fullsized":"2023-11-08T19:24:54.860045+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:25:15.982859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"54'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.383513+0000","last_change":"2023-11-08T19:24:51.349434+0000","last_active":"2023-11-08T19:24:52.383513+0000","last_peered":"2023-11-08T19:24:52.383513+0000","last_clean":"2023-11-08T19:24:52.383513+0000","last_became_active":"2023-11-08T19:24:51.349154+0000","last_became_peered":"2023-11-08T19:24:51.349154+0000","last_unstale":"2023-11-08T19:24:52.383513+0000","last_undegraded":"2023-11-08T19:24:52.383513+0000","last_fullsized":"2023-11-08T19:24:52.383513+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:09:35.057515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":27,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.351313+0000","last_change":"2023-11-08T19:24:32.544333+0000","last_active":"2023-11-08T19:24:52.351313+0000","last_peered":"2023-11-08T19:24:52.351313+0000","last_clean":"2023-11-08T19:24:52.351313+0000","last_became_active":"2023-11-08T19:24:31.138598+0000","last_became_peered":"2023-11-08T19:24:31.138598+0000","last_unstale":"2023-11-08T19:24:52.351313+0000","last_undegraded":"2023-11-08T19:24:52.351313+0000","last_fullsized":"2023-11-08T19:24:52.351313+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:11.860580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015114824000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-08T19:24:54.859075+0000","last_change":"2023-11-08T19:24:52.374075+0000","last_active":"2023-11-08T19:24:54.859075+0000","last_peered":"2023-11-08T19:24:54.859075+0000","last_clean":"2023-11-08T19:24:54.859075+0000","last_became_active":"2023-11-08T19:24:52.368948+0000","last_became_peered":"2023-11-08T19:24:52.368948+0000","last_unstale":"2023-11-08T19:24:54.859075+0000","last_undegraded":"2023-11-08T19:24:54.859075+0000","last_fullsized":"2023-11-08T19:24:54.859075+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:51.328652+0000","last_clean_scrub_stamp":"2023-11-08T19:24:51.328652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:32:33.611039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.359580+0000","last_change":"2023-11-08T19:24:51.347235+0000","last_active":"2023-11-08T19:24:52.359580+0000","last_peered":"2023-11-08T19:24:52.359580+0000","last_clean":"2023-11-08T19:24:52.359580+0000","last_became_active":"2023-11-08T19:24:51.346983+0000","last_became_peered":"2023-11-08T19:24:51.346983+0000","last_unstale":"2023-11-08T19:24:52.359580+0000","last_undegraded":"2023-11-08T19:24:52.359580+0000","last_fullsized":"2023-11-08T19:24:52.359580+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:50.322101+0000","last_clean_scrub_stamp":"2023-11-08T19:24:50.322101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:04:16.100072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":27,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.362218+0000","last_change":"2023-11-08T19:24:32.530665+0000","last_active":"2023-11-08T19:24:52.362218+0000","last_peered":"2023-11-08T19:24:52.362218+0000","last_clean":"2023-11-08T19:24:52.362218+0000","last_became_active":"2023-11-08T19:24:31.148363+0000","last_became_peered":"2023-11-08T19:24:31.148363+0000","last_unstale":"2023-11-08T19:24:52.362218+0000","last_undegraded":"2023-11-08T19:24:52.362218+0000","last_fullsized":"2023-11-08T19:24:52.362218+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:02:27.987795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075444200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":194,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-08T19:24:52.364492+0000","last_change":"2023-11-08T19:22:58.054283+0000","last_active":"2023-11-08T19:24:52.364492+0000","last_peered":"2023-11-08T19:24:52.364492+0000","last_clean":"2023-11-08T19:24:52.364492+0000","last_became_active":"2023-11-08T19:22:58.053337+0000","last_became_peered":"2023-11-08T19:22:58.053337+0000","last_unstale":"2023-11-08T19:24:52.364492+0000","last_undegraded":"2023-11-08T19:24:52.364492+0000","last_fullsized":"2023-11-08T19:24:52.364492+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:22:56.479654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:22:56.479654+0000","last_clean_scrub_stamp":"2023-11-08T19:22:56.479654+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:16:05.317001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28252,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343588,"statfs":{"total":96636764160,"available":96607834112,"internally_reserved":0,"allocated":1257472,"data_stored":888859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.56699999999999995}]},{"osd":1,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.505}]},{"osd":2,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.59399999999999997}]},{"osd":3,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.68500000000000005}]},{"osd":4,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.54900000000000004}]},{"osd":5,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.66400000000000003}]},{"osd":6,"last update":"Wed Nov 8 19:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.63300000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":655360,"data_stored":298331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.376}]},{"osd":1,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.433}]},{"osd":2,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.56899999999999995}]},{"osd":3,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":0.40100000000000002}]},{"osd":4,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.53900000000000003}]},{"osd":5,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.68700000000000006}]},{"osd":7,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.59599999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":659456,"data_stored":298421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.377},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":2.1850000000000001,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":0.22800000000000001}]},{"osd":2,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.32700000000000001}]},{"osd":3,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.438},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":2.2120000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.27600000000000002}]},{"osd":4,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.67800000000000005}]},{"osd":5,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.69999999999999996}]},{"osd":6,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":2.093,"5min":2.093,"15min":2.093},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.51900000000000002}]},{"osd":7,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":0.748},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":2.1299999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.56799999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28256,"kb_used_data":1236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343584,"statfs":{"total":96636764160,"available":96607830016,"internally_reserved":0,"allocated":1265664,"data_stored":890893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":19.295999999999999,"5min":19.295999999999999,"15min":19.295999999999999},"last":0.35199999999999998},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":17.204000000000001,"5min":17.204000000000001,"15min":17.204000000000001},"last":0.34100000000000003}]},{"osd":2,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":6.524,"5min":6.524,"15min":6.524},"last":0.32000000000000001},{"interface":"front","average":{"1min":1.169,"5min":1.169,"15min":1.169},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":17.175000000000001,"5min":17.175000000000001,"15min":17.175000000000001},"last":0.36699999999999999}]},{"osd":3,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":14.324,"5min":14.324,"15min":14.324},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.38300000000000001}]},{"osd":4,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.304,"15min":1.304},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":17.056000000000001,"5min":17.056000000000001,"15min":17.056000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":5.0289999999999999,"5min":5.0289999999999999,"15min":5.0289999999999999},"last":0.68100000000000005}]},{"osd":5,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":5.0590000000000002,"5min":5.0590000000000002,"15min":5.0590000000000002},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.65200000000000002}]},{"osd":6,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.78500000000000003},{"interface":"front","average":{"1min":1.357,"5min":1.357,"15min":1.357},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":17.111999999999998,"5min":17.111999999999998,"15min":17.111999999999998},"last":0.60699999999999998}]},{"osd":7,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.371,"15min":1.371},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":17.146000000000001,"5min":17.146000000000001,"15min":17.146000000000001},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":4.9829999999999997,"5min":4.9829999999999997,"15min":4.9829999999999997},"last":0.61899999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":663552,"data_stored":298387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":3.4100000000000001,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":3.4369999999999998,"5min":3.4369999999999998,"15min":3.4369999999999998},"last":0.33200000000000002}]},{"osd":1,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":4.0679999999999996,"5min":4.0679999999999996,"15min":4.0679999999999996},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":4.3499999999999996,"5min":4.3499999999999996,"15min":4.3499999999999996},"last":0.35699999999999998}]},{"osd":3,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":3.8580000000000001,"5min":3.8580000000000001,"15min":3.8580000000000001},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":3.476,"5min":3.476,"15min":3.476},"last":0.439}]},{"osd":4,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":4.0090000000000003,"5min":4.0090000000000003,"15min":4.0090000000000003},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":4.1040000000000001,"5min":4.1040000000000001,"15min":4.1040000000000001},"last":0.495}]},{"osd":5,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":4.0869999999999997,"5min":4.0869999999999997,"15min":4.0869999999999997},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":3.843,"5min":3.843,"15min":3.843},"last":0.63800000000000001}]},{"osd":6,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":4.1399999999999997,"5min":4.1399999999999997,"15min":4.1399999999999997},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":4.0499999999999998,"5min":4.0499999999999998,"15min":4.0499999999999998},"last":0.69099999999999995}]},{"osd":7,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":4.157,"5min":4.157,"15min":4.157},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":4.1710000000000003,"5min":4.1710000000000003,"15min":4.1710000000000003},"last":0.48099999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":663552,"data_stored":298387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.30299999999999999}]},{"osd":1,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.36099999999999999}]},{"osd":2,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.38100000000000001}]},{"osd":4,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.44900000000000001}]},{"osd":5,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.39100000000000001}]},{"osd":6,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.52100000000000002}]},{"osd":7,"last update":"Wed Nov 8 19:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.49299999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27680,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344160,"statfs":{"total":96636764160,"available":96608419840,"internally_reserved":0,"allocated":667648,"data_stored":299943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.496},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":2.2090000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.57399999999999995}]},{"osd":1,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.624},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.433}]},{"osd":2,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":2.8490000000000002,"5min":2.8490000000000002,"15min":2.8490000000000002},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.70199999999999996}]},{"osd":3,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":3.4849999999999999,"5min":3.4849999999999999,"15min":3.4849999999999999},"last":0.60299999999999998}]},{"osd":5,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.55100000000000005}]},{"osd":6,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":4.1529999999999996,"5min":4.1529999999999996,"15min":4.1529999999999996},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.45800000000000002}]},{"osd":7,"last update":"Wed Nov 8 19:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":5.5359999999999996,"5min":5.5359999999999996,"15min":5.5359999999999996},"last":0.68100000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":663552,"data_stored":298983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.71999999999999997}]},{"osd":1,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":2.2919999999999998,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":0.65400000000000003}]},{"osd":2,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.55200000000000005}]},{"osd":3,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.67500000000000004}]},{"osd":4,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":2.3300000000000001,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":0.376},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.56699999999999995}]},{"osd":6,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":2.3650000000000002,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":0.44400000000000001}]},{"osd":7,"last update":"Wed Nov 8 19:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.41599999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:25:01.461 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-08T19:25:01.461 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-08T19:25:01.621 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.620+0000 7f016e44e700 1 Processor -- start 2023-11-08T19:25:01.622 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.620+0000 7f016e44e700 1 -- start start 2023-11-08T19:25:01.625 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.621+0000 7f016e44e700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f01680b5c80 0x7f01680b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:01.625 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.621+0000 7f016e44e700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f016815e9a0 con 0x7f01680cf410 2023-11-08T19:25:01.625 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.621+0000 7f016e44e700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f016815ada0 con 0x7f016815a9c0 2023-11-08T19:25:01.626 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.621+0000 7f016e44e700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01680732c0 con 0x7f01680b5c80 2023-11-08T19:25:01.626 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.621+0000 7f016c9eb700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f01680cf410 0x7f01680cbd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:42442/0 (socket says 172.21.15.149:42442) 2023-11-08T19:25:01.626 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.621+0000 7f016c9eb700 1 -- 172.21.15.149:0/1836517085 learned_addr learned my addr 172.21.15.149:0/1836517085 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:25:01.626 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.621+0000 7f01677fe700 1 --2- 172.21.15.149:0/1836517085 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f01680b5c80 0x7f01680b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:01.627 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.621+0000 7f0166ffd700 1 -- 172.21.15.149:0/1836517085 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2988540896 0 0) 0x7f016815e9a0 con 0x7f01680cf410 2023-11-08T19:25:01.627 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.621+0000 7f0166ffd700 1 -- 172.21.15.149:0/1836517085 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01500035b0 con 0x7f01680cf410 2023-11-08T19:25:01.627 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.621+0000 7f0166ffd700 1 -- 172.21.15.149:0/1836517085 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2601434374 0 0) 0x7f01500035b0 con 0x7f01680cf410 2023-11-08T19:25:01.627 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.621+0000 7f0166ffd700 1 -- 172.21.15.149:0/1836517085 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f01680b5c80 msgr2=0x7f01680b2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:01.627 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.622+0000 7f0166ffd700 1 --2- 172.21.15.149:0/1836517085 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f01680b5c80 0x7f01680b2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:01.628 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.622+0000 7f0166ffd700 1 -- 172.21.15.149:0/1836517085 >> v1:172.21.15.160:6789/0 conn(0x7f016815a9c0 legacy=0x7f016815ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:01.628 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.622+0000 7f0166ffd700 1 -- 172.21.15.149:0/1836517085 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0168072d00 con 0x7f01680cf410 2023-11-08T19:25:01.628 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.622+0000 7f0166ffd700 1 -- 172.21.15.149:0/1836517085 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f01600019f0 con 0x7f01680cf410 2023-11-08T19:25:01.628 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.622+0000 7f0166ffd700 1 -- 172.21.15.149:0/1836517085 >> v1:172.21.15.149:6789/0 conn(0x7f01680cf410 legacy=0x7f01680cbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:01.628 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.622+0000 7f0166ffd700 1 --2- 172.21.15.149:0/1836517085 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0150003a30 0x7f0150003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:01.629 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.622+0000 7f0166ffd700 1 --2- 172.21.15.149:0/1836517085 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f01680b5c80 0x7f0150004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:01.629 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.622+0000 7f0166ffd700 1 --2- 172.21.15.149:0/1836517085 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0150004d90 0x7f0150005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:01.629 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.622+0000 7f0166ffd700 1 -- 172.21.15.149:0/1836517085 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01680732c0 con 0x7f0150004d90 2023-11-08T19:25:01.629 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.622+0000 7f0166ffd700 1 -- 172.21.15.149:0/1836517085 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f015000bac0 con 0x7f0150003a30 2023-11-08T19:25:01.629 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.622+0000 7f0166ffd700 1 -- 172.21.15.149:0/1836517085 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f015000bc80 con 0x7f01680b5c80 2023-11-08T19:25:01.630 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.622+0000 7f016c9eb700 1 --2- 172.21.15.149:0/1836517085 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0150004d90 0x7f0150005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:01.630 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.622+0000 7f0167fff700 1 --2- 172.21.15.149:0/1836517085 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0150003a30 0x7f0150003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:01.630 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.622+0000 7f01677fe700 1 --2- 172.21.15.149:0/1836517085 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f01680b5c80 0x7f0150004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:01.630 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.622+0000 7f016c9eb700 1 -- 172.21.15.149:0/1836517085 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f01680b5c80 msgr2=0x7f0150004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:01.630 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.622+0000 7f016c9eb700 1 --2- 172.21.15.149:0/1836517085 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f01680b5c80 0x7f0150004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:01.631 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.622+0000 7f016c9eb700 1 -- 172.21.15.149:0/1836517085 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0150003a30 msgr2=0x7f0150003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:01.631 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.622+0000 7f016c9eb700 1 --2- 172.21.15.149:0/1836517085 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0150003a30 0x7f0150003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:01.631 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.622+0000 7f016c9eb700 1 -- 172.21.15.149:0/1836517085 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01500035b0 con 0x7f0150004d90 2023-11-08T19:25:01.631 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.622+0000 7f016c9eb700 1 --2- 172.21.15.149:0/1836517085 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0150004d90 0x7f0150005210 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f016000a830 tx=0x7f0150005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=815d8eb8c515fb12 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:01.631 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.622+0000 7f0166ffd700 1 -- 172.21.15.149:0/1836517085 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0160010690 con 0x7f0150004d90 2023-11-08T19:25:01.632 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.622+0000 7f0166ffd700 1 -- 172.21.15.149:0/1836517085 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0160010810 con 0x7f0150004d90 2023-11-08T19:25:01.632 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.622+0000 7f0166ffd700 1 -- 172.21.15.149:0/1836517085 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0160010bc0 con 0x7f0150004d90 2023-11-08T19:25:01.632 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.623+0000 7f016e44e700 1 -- 172.21.15.149:0/1836517085 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0150004d90 msgr2=0x7f0150005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:01.632 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.623+0000 7f016e44e700 1 --2- 172.21.15.149:0/1836517085 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0150004d90 0x7f0150005210 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f016000a830 tx=0x7f0150005880 comp rx=0 tx=0).stop 2023-11-08T19:25:01.632 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.623+0000 7f016c9eb700 1 -- 172.21.15.149:0/1836517085 reap_dead start 2023-11-08T19:25:01.633 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.623+0000 7f016e44e700 1 -- 172.21.15.149:0/1836517085 shutdown_connections 2023-11-08T19:25:01.633 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.623+0000 7f016e44e700 1 -- 172.21.15.149:0/1836517085 >> 172.21.15.149:0/1836517085 conn(0x7f016806dfd0 msgr2=0x7f016806e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:01.633 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.623+0000 7f016e44e700 1 -- 172.21.15.149:0/1836517085 shutdown_connections 2023-11-08T19:25:01.633 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.623+0000 7f016e44e700 1 -- 172.21.15.149:0/1836517085 wait complete. 2023-11-08T19:25:01.633 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.624+0000 7f016e44e700 1 Processor -- start 2023-11-08T19:25:01.634 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.624+0000 7f016e44e700 1 -- start start 2023-11-08T19:25:01.636 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.625+0000 7f016e44e700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0168159b20 0x7f01680b0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:01.636 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.625+0000 7f016e44e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f016814d650 0x7f016813c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:01.636 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.625+0000 7f016e44e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0168159f00 0x7f016813eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:01.637 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.625+0000 7f016e44e700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f016813e6a0 con 0x7f0168159f00 2023-11-08T19:25:01.637 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.625+0000 7f016e44e700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0168153cb0 con 0x7f016814d650 2023-11-08T19:25:01.637 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.625+0000 7f016e44e700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0168153f90 con 0x7f0168159b20 2023-11-08T19:25:01.637 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.625+0000 7f016c9eb700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0168159f00 0x7f016813eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:01.637 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.625+0000 7f016c9eb700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0168159f00 0x7f016813eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40452/0 (socket says 172.21.15.149:40452) 2023-11-08T19:25:01.638 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.625+0000 7f016c9eb700 1 -- 172.21.15.149:0/4241839306 learned_addr learned my addr 172.21.15.149:0/4241839306 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:01.638 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.625+0000 7f01677fe700 1 --2- 172.21.15.149:0/4241839306 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f016814d650 0x7f016813c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:01.638 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.625+0000 7f0167fff700 1 --2- 172.21.15.149:0/4241839306 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0168159b20 0x7f01680b0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:01.638 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.625+0000 7f016c9eb700 1 -- 172.21.15.149:0/4241839306 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0168159b20 msgr2=0x7f01680b0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:01.638 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.625+0000 7f016c9eb700 1 --2- 172.21.15.149:0/4241839306 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0168159b20 0x7f01680b0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:01.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.625+0000 7f016c9eb700 1 -- 172.21.15.149:0/4241839306 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f016814d650 msgr2=0x7f016813c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:01.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.625+0000 7f016c9eb700 1 --2- 172.21.15.149:0/4241839306 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f016814d650 0x7f016813c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:01.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.625+0000 7f016c9eb700 1 -- 172.21.15.149:0/4241839306 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0168154270 con 0x7f0168159f00 2023-11-08T19:25:01.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.626+0000 7f016c9eb700 1 --2- 172.21.15.149:0/4241839306 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0168159f00 0x7f016813eb30 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f0160014000 tx=0x7f0160001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:01.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.626+0000 7f0164ff9700 1 -- 172.21.15.149:0/4241839306 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0160010d90 con 0x7f0168159f00 2023-11-08T19:25:01.640 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.626+0000 7f0164ff9700 1 -- 172.21.15.149:0/4241839306 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0160011470 con 0x7f0168159f00 2023-11-08T19:25:01.640 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.626+0000 7f016e44e700 1 -- 172.21.15.149:0/4241839306 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0168154550 con 0x7f0168159f00 2023-11-08T19:25:01.640 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.626+0000 7f0164ff9700 1 -- 172.21.15.149:0/4241839306 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0160011820 con 0x7f0168159f00 2023-11-08T19:25:01.640 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.626+0000 7f016e44e700 1 -- 172.21.15.149:0/4241839306 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f016813cc00 con 0x7f0168159f00 2023-11-08T19:25:01.640 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.627+0000 7f016e44e700 1 -- 172.21.15.149:0/4241839306 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01680b6500 con 0x7f0168159f00 2023-11-08T19:25:01.641 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.627+0000 7f0164ff9700 1 -- 172.21.15.149:0/4241839306 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0160011980 con 0x7f0168159f00 2023-11-08T19:25:01.641 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.628+0000 7f0164ff9700 1 --2- 172.21.15.149:0/4241839306 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f015406af00 0x7f015406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:01.641 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.628+0000 7f0164ff9700 1 -- 172.21.15.149:0/4241839306 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f016008cd20 con 0x7f0168159f00 2023-11-08T19:25:01.641 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.628+0000 7f0167fff700 1 --2- 172.21.15.149:0/4241839306 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f015406af00 0x7f015406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:01.641 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.628+0000 7f0167fff700 1 --2- 172.21.15.149:0/4241839306 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f015406af00 0x7f015406d3c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f015c000c00 tx=0x7f015c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:01.642 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.632+0000 7f0164ff9700 1 -- 172.21.15.149:0/4241839306 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0160057da0 con 0x7f0168159f00 2023-11-08T19:25:01.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.898+0000 7f016e44e700 1 -- 172.21.15.149:0/4241839306 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f016815e600 con 0x7f0168159f00 2023-11-08T19:25:01.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.900+0000 7f0164ff9700 1 -- 172.21.15.149:0/4241839306 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+147 (secure 0 0 0) 0x7f016002a0e0 con 0x7f0168159f00 2023-11-08T19:25:01.902 INFO:teuthology.orchestra.run.smithi149.stdout:[client.0] 2023-11-08T19:25:01.902 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDi30tlQEEsNxAAiPozrOREh+IJXoj7ZkhvLg== 2023-11-08T19:25:01.904 INFO:teuthology.orchestra.run.smithi149.stdout: caps mds = "allow" 2023-11-08T19:25:01.905 INFO:teuthology.orchestra.run.smithi149.stdout: caps mon = "allow r" 2023-11-08T19:25:01.905 INFO:teuthology.orchestra.run.smithi149.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-08T19:25:01.907 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.903+0000 7f016e44e700 1 -- 172.21.15.149:0/4241839306 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f015406af00 msgr2=0x7f015406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:01.907 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.903+0000 7f016e44e700 1 --2- 172.21.15.149:0/4241839306 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f015406af00 0x7f015406d3c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f015c000c00 tx=0x7f015c009040 comp rx=0 tx=0).stop 2023-11-08T19:25:01.907 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.903+0000 7f016e44e700 1 -- 172.21.15.149:0/4241839306 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0168159f00 msgr2=0x7f016813eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:01.907 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.903+0000 7f016e44e700 1 --2- 172.21.15.149:0/4241839306 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0168159f00 0x7f016813eb30 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f0160014000 tx=0x7f0160001d80 comp rx=0 tx=0).stop 2023-11-08T19:25:01.907 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.903+0000 7f016e44e700 1 -- 172.21.15.149:0/4241839306 shutdown_connections 2023-11-08T19:25:01.908 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.903+0000 7f016e44e700 1 --2- 172.21.15.149:0/4241839306 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f015406af00 0x7f015406d3c0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:01.908 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.903+0000 7f016e44e700 1 --2- 172.21.15.149:0/4241839306 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0168159f00 0x7f016813eb30 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:01.908 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.903+0000 7f016e44e700 1 --2- 172.21.15.149:0/4241839306 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0168159b20 0x7f01680b0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:01.908 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.903+0000 7f016e44e700 1 --2- 172.21.15.149:0/4241839306 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f016814d650 0x7f016813c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:01.908 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.903+0000 7f016e44e700 1 -- 172.21.15.149:0/4241839306 >> 172.21.15.149:0/4241839306 conn(0x7f016806dfd0 msgr2=0x7f01680cc610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:01.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.903+0000 7f016e44e700 1 -- 172.21.15.149:0/4241839306 shutdown_connections 2023-11-08T19:25:01.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:01.903+0000 7f016e44e700 1 -- 172.21.15.149:0/4241839306 wait complete. 2023-11-08T19:25:01.909 INFO:teuthology.orchestra.run.smithi149.stderr:updated caps for client.0 2023-11-08T19:25:01.916 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:25:02.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.037+0000 7f3ce86aa700 1 Processor -- start 2023-11-08T19:25:02.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.037+0000 7f3ce86aa700 1 -- start start 2023-11-08T19:25:02.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.038+0000 7f3ce86aa700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3ce00cd5e0 0x7f3ce00cfd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:02.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.038+0000 7f3ce86aa700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ce00cc2e0 con 0x7f3ce015b950 2023-11-08T19:25:02.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.038+0000 7f3ce86aa700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ce00cc580 con 0x7f3ce00ce840 2023-11-08T19:25:02.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.038+0000 7f3ce86aa700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ce00cc820 con 0x7f3ce00cd5e0 2023-11-08T19:25:02.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.038+0000 7f3ce5c45700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3ce00cd5e0 0x7f3ce00cfd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:02.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.038+0000 7f3ce6446700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f3ce015b950 0x7f3ce00ce130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:42458/0 (socket says 172.21.15.149:42458) 2023-11-08T19:25:02.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.038+0000 7f3ce6446700 1 -- 172.21.15.149:0/3591164492 learned_addr learned my addr 172.21.15.149:0/3591164492 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:25:02.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.038+0000 7f3ce5c45700 1 -- 172.21.15.149:0/3591164492 >> v1:172.21.15.160:6789/0 conn(0x7f3ce00ce840 legacy=0x7f3ce00d0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:02.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.038+0000 7f3ce5c45700 1 -- 172.21.15.149:0/3591164492 >> v1:172.21.15.149:6789/0 conn(0x7f3ce015b950 legacy=0x7f3ce00ce130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:02.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.038+0000 7f3ce5c45700 1 -- 172.21.15.149:0/3591164492 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce00ccb00 con 0x7f3ce00cd5e0 2023-11-08T19:25:02.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.038+0000 7f3ce5444700 1 -- 172.21.15.149:0/3591164492 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 165064262 0 0) 0x7f3ce00cc2e0 con 0x7f3ce015b950 2023-11-08T19:25:02.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.038+0000 7f3ce5c45700 1 --2- 172.21.15.149:0/3591164492 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ce00cd5e0 0x7f3ce00cfd20 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0009840 tx=0x7f3cd0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8404802476e20b1 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:02.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.038+0000 7f3ce5444700 1 -- 172.21.15.149:0/3591164492 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd0004230 con 0x7f3ce00cd5e0 2023-11-08T19:25:02.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.039+0000 7f3ce5444700 1 -- 172.21.15.149:0/3591164492 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd0004390 con 0x7f3ce00cd5e0 2023-11-08T19:25:02.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.039+0000 7f3ce5444700 1 -- 172.21.15.149:0/3591164492 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd00036a0 con 0x7f3ce00cd5e0 2023-11-08T19:25:02.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.039+0000 7f3ce86aa700 1 -- 172.21.15.149:0/3591164492 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ce00cd5e0 msgr2=0x7f3ce00cfd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:02.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.039+0000 7f3ce86aa700 1 --2- 172.21.15.149:0/3591164492 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ce00cd5e0 0x7f3ce00cfd20 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0009840 tx=0x7f3cd0009b50 comp rx=0 tx=0).stop 2023-11-08T19:25:02.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.039+0000 7f3ce86aa700 1 -- 172.21.15.149:0/3591164492 shutdown_connections 2023-11-08T19:25:02.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.039+0000 7f3ce86aa700 1 --2- 172.21.15.149:0/3591164492 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ce00cd5e0 0x7f3ce00cfd20 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:02.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.039+0000 7f3ce86aa700 1 -- 172.21.15.149:0/3591164492 >> 172.21.15.149:0/3591164492 conn(0x7f3ce008afd0 msgr2=0x7f3ce00d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:02.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.039+0000 7f3ce86aa700 1 -- 172.21.15.149:0/3591164492 shutdown_connections 2023-11-08T19:25:02.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.039+0000 7f3ce86aa700 1 -- 172.21.15.149:0/3591164492 wait complete. 2023-11-08T19:25:02.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.040+0000 7f3ce86aa700 1 Processor -- start 2023-11-08T19:25:02.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.040+0000 7f3ce86aa700 1 -- start start 2023-11-08T19:25:02.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.041+0000 7f3ce86aa700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ce00ce840 0x7f3ce00c8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:02.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.041+0000 7f3ce86aa700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ce015b950 0x7f3ce015de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:02.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.041+0000 7f3ce86aa700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ce015a0b0 0x7f3ce015a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:02.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.041+0000 7f3ce86aa700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce00c56f0 con 0x7f3ce015b950 2023-11-08T19:25:02.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.041+0000 7f3ce86aa700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce00c8d50 con 0x7f3ce00ce840 2023-11-08T19:25:02.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.041+0000 7f3ce86aa700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce015aa30 con 0x7f3ce015a0b0 2023-11-08T19:25:02.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.041+0000 7f3ce5c45700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ce015b950 0x7f3ce015de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:02.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.041+0000 7f3ce5c45700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ce015b950 0x7f3ce015de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40464/0 (socket says 172.21.15.149:40464) 2023-11-08T19:25:02.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.041+0000 7f3ce5c45700 1 -- 172.21.15.149:0/1549118008 learned_addr learned my addr 172.21.15.149:0/1549118008 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:02.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.041+0000 7f3ce6446700 1 --2- 172.21.15.149:0/1549118008 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ce00ce840 0x7f3ce00c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:02.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.041+0000 7f3ce6c47700 1 --2- 172.21.15.149:0/1549118008 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ce015a0b0 0x7f3ce015a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:02.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.041+0000 7f3ce5c45700 1 -- 172.21.15.149:0/1549118008 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ce015a0b0 msgr2=0x7f3ce015a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:02.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.041+0000 7f3ce5c45700 1 --2- 172.21.15.149:0/1549118008 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ce015a0b0 0x7f3ce015a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:02.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.041+0000 7f3ce5c45700 1 -- 172.21.15.149:0/1549118008 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ce00ce840 msgr2=0x7f3ce00c8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:02.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.041+0000 7f3ce5c45700 1 --2- 172.21.15.149:0/1549118008 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ce00ce840 0x7f3ce00c8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:02.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.041+0000 7f3ce5c45700 1 -- 172.21.15.149:0/1549118008 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd00094a0 con 0x7f3ce015b950 2023-11-08T19:25:02.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.042+0000 7f3ce5c45700 1 --2- 172.21.15.149:0/1549118008 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ce015b950 0x7f3ce015de30 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0004000 tx=0x7f3cd0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:02.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.042+0000 7f3cd6ffd700 1 -- 172.21.15.149:0/1549118008 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd0003de0 con 0x7f3ce015b950 2023-11-08T19:25:02.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.042+0000 7f3cd6ffd700 1 -- 172.21.15.149:0/1549118008 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd001e070 con 0x7f3ce015b950 2023-11-08T19:25:02.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.042+0000 7f3ce86aa700 1 -- 172.21.15.149:0/1549118008 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ce00b68a0 con 0x7f3ce015b950 2023-11-08T19:25:02.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.042+0000 7f3cd6ffd700 1 -- 172.21.15.149:0/1549118008 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd0011870 con 0x7f3ce015b950 2023-11-08T19:25:02.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.042+0000 7f3ce86aa700 1 -- 172.21.15.149:0/1549118008 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ce00b6e60 con 0x7f3ce015b950 2023-11-08T19:25:02.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.043+0000 7f3ce86aa700 1 -- 172.21.15.149:0/1549118008 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ce00c5830 con 0x7f3ce015b950 2023-11-08T19:25:02.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.043+0000 7f3cd6ffd700 1 -- 172.21.15.149:0/1549118008 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3cd00119d0 con 0x7f3ce015b950 2023-11-08T19:25:02.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.044+0000 7f3cd6ffd700 1 --2- 172.21.15.149:0/1549118008 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3cc406af00 0x7f3cc406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:02.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.044+0000 7f3ce6446700 1 --2- 172.21.15.149:0/1549118008 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3cc406af00 0x7f3cc406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:02.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.044+0000 7f3cd6ffd700 1 -- 172.21.15.149:0/1549118008 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f3cd008aa90 con 0x7f3ce015b950 2023-11-08T19:25:02.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.044+0000 7f3ce6446700 1 --2- 172.21.15.149:0/1549118008 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3cc406af00 0x7f3cc406d3c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc0010e0 tx=0x7f3cdc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:02.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.048+0000 7f3cd6ffd700 1 -- 172.21.15.149:0/1549118008 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3ce00c5830 con 0x7f3ce015b950 2023-11-08T19:25:02.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.281+0000 7f3ce86aa700 1 -- 172.21.15.149:0/1549118008 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3ce00c5830 con 0x7f3ce015b950 2023-11-08T19:25:02.283 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.281+0000 7f3cd6ffd700 1 -- 172.21.15.149:0/1549118008 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f3ce00c5830 con 0x7f3ce015b950 2023-11-08T19:25:02.283 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:25:02.283 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5455,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/2693283976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2693283976},{"type":"v1","addr":"172.21.15.160:6834","nonce":2693283976}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5458,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/3714474190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":3714474190},{"type":"v1","addr":"172.21.15.160:6835","nonce":3714474190}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5730,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/1885678824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":1885678824},{"type":"v1","addr":"172.21.15.149:6836","nonce":1885678824}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-08T19:24:51.735078+0000","modified":"2023-11-08T19:24:54.764447+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5733},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5733":{"gid":5733,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6837/4238261436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":4238261436},{"type":"v1","addr":"172.21.15.149:6837","nonce":4238261436}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-08T19:25:02.284 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.283+0000 7f3ce86aa700 1 -- 172.21.15.149:0/1549118008 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3cc406af00 msgr2=0x7f3cc406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:02.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.283+0000 7f3ce86aa700 1 --2- 172.21.15.149:0/1549118008 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3cc406af00 0x7f3cc406d3c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc0010e0 tx=0x7f3cdc009040 comp rx=0 tx=0).stop 2023-11-08T19:25:02.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.283+0000 7f3ce86aa700 1 -- 172.21.15.149:0/1549118008 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ce015b950 msgr2=0x7f3ce015de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:02.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.283+0000 7f3ce86aa700 1 --2- 172.21.15.149:0/1549118008 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ce015b950 0x7f3ce015de30 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0004000 tx=0x7f3cd0004750 comp rx=0 tx=0).stop 2023-11-08T19:25:02.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.283+0000 7f3ce86aa700 1 -- 172.21.15.149:0/1549118008 shutdown_connections 2023-11-08T19:25:02.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.283+0000 7f3ce86aa700 1 --2- 172.21.15.149:0/1549118008 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3cc406af00 0x7f3cc406d3c0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:02.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.283+0000 7f3ce86aa700 1 --2- 172.21.15.149:0/1549118008 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ce00ce840 0x7f3ce00c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:02.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.283+0000 7f3ce86aa700 1 --2- 172.21.15.149:0/1549118008 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ce015a0b0 0x7f3ce015a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:02.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.283+0000 7f3ce86aa700 1 --2- 172.21.15.149:0/1549118008 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ce015b950 0x7f3ce015de30 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:02.287 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.283+0000 7f3ce86aa700 1 -- 172.21.15.149:0/1549118008 >> 172.21.15.149:0/1549118008 conn(0x7f3ce008afd0 msgr2=0x7f3ce00aee80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:02.287 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.283+0000 7f3ce86aa700 1 -- 172.21.15.149:0/1549118008 shutdown_connections 2023-11-08T19:25:02.287 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.283+0000 7f3ce86aa700 1 -- 172.21.15.149:0/1549118008 wait complete. 2023-11-08T19:25:02.287 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 25 2023-11-08T19:25:02.700 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-08T19:24:51.735078+0000', 'modified': '2023-11-08T19:24:54.764447+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5733}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5733': {'gid': 5733, 'name': 'c', 'rank': 0, 'incarnation': 21, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.149:6837/4238261436', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6835', 'nonce': 4238261436}, {'type': 'v1', 'addr': '172.21.15.149:6837', 'nonce': 4238261436}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-08T19:25:02.700 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-08T19:25:02.701 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-08T19:25:02.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.823+0000 7faed9f7b700 1 Processor -- start 2023-11-08T19:25:02.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.823+0000 7faed9f7b700 1 -- start start 2023-11-08T19:25:02.828 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.823+0000 7faed9f7b700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7faed40cb300 0x7faed415d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:02.828 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.823+0000 7faed9f7b700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faed40b2f60 con 0x7faed40cc140 2023-11-08T19:25:02.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.823+0000 7faed9f7b700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faed40cc520 con 0x7faed40cc910 2023-11-08T19:25:02.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.823+0000 7faed9f7b700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faed40b2430 con 0x7faed40cb300 2023-11-08T19:25:02.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.823+0000 7faed37fe700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7faed40cc140 0x7faed40b2850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:42472/0 (socket says 172.21.15.149:42472) 2023-11-08T19:25:02.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.823+0000 7faed37fe700 1 -- 172.21.15.149:0/2252412138 learned_addr learned my addr 172.21.15.149:0/2252412138 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:25:02.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.824+0000 7faed3fff700 1 --2- 172.21.15.149:0/2252412138 >> v2:172.21.15.160:3300/0 conn(0x7faed40cb300 0x7faed415d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:02.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.824+0000 7faed27fc700 1 -- 172.21.15.149:0/2252412138 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1481162805 0 0) 0x7faed40b2f60 con 0x7faed40cc140 2023-11-08T19:25:02.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.824+0000 7faed27fc700 1 -- 172.21.15.149:0/2252412138 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faec00035b0 con 0x7faed40cc140 2023-11-08T19:25:02.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.824+0000 7faed27fc700 1 -- 172.21.15.149:0/2252412138 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2929254867 0 0) 0x7faec00035b0 con 0x7faed40cc140 2023-11-08T19:25:02.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.824+0000 7faed27fc700 1 -- 172.21.15.149:0/2252412138 >> v2:172.21.15.160:3300/0 conn(0x7faed40cb300 msgr2=0x7faed415d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:02.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.824+0000 7faed27fc700 1 --2- 172.21.15.149:0/2252412138 >> v2:172.21.15.160:3300/0 conn(0x7faed40cb300 0x7faed415d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:02.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.824+0000 7faed27fc700 1 -- 172.21.15.149:0/2252412138 >> v1:172.21.15.160:6789/0 conn(0x7faed40cc910 legacy=0x7faed40cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:02.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.824+0000 7faed27fc700 1 -- 172.21.15.149:0/2252412138 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed40b17b0 con 0x7faed40cc140 2023-11-08T19:25:02.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.824+0000 7faed27fc700 1 -- 172.21.15.149:0/2252412138 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7faec40017f0 con 0x7faed40cc140 2023-11-08T19:25:02.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.824+0000 7faed27fc700 1 -- 172.21.15.149:0/2252412138 >> v1:172.21.15.149:6789/0 conn(0x7faed40cc140 legacy=0x7faed40b2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:02.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.824+0000 7faed27fc700 1 --2- 172.21.15.149:0/2252412138 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faec0003a00 0x7faec0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:02.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.824+0000 7faed27fc700 1 --2- 172.21.15.149:0/2252412138 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faec0004850 0x7faec0004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:02.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.824+0000 7faed27fc700 1 --2- 172.21.15.149:0/2252412138 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faec0005210 0x7faec000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:02.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.824+0000 7faed27fc700 1 -- 172.21.15.149:0/2252412138 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed40b2430 con 0x7faec0005210 2023-11-08T19:25:02.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.824+0000 7faed27fc700 1 -- 172.21.15.149:0/2252412138 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec000c0b0 con 0x7faec0003a00 2023-11-08T19:25:02.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.824+0000 7faed27fc700 1 -- 172.21.15.149:0/2252412138 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faec000c270 con 0x7faec0004850 2023-11-08T19:25:02.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.824+0000 7faed3fff700 1 --2- 172.21.15.149:0/2252412138 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faec0005210 0x7faec000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:02.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.824+0000 7faed37fe700 1 --2- 172.21.15.149:0/2252412138 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faec0003a00 0x7faec0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:02.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.824+0000 7faed2ffd700 1 --2- 172.21.15.149:0/2252412138 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faec0004850 0x7faec0004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:02.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.824+0000 7faed3fff700 1 -- 172.21.15.149:0/2252412138 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faec0004850 msgr2=0x7faec0004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:02.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.824+0000 7faed3fff700 1 --2- 172.21.15.149:0/2252412138 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faec0004850 0x7faec0004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:02.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.824+0000 7faed3fff700 1 -- 172.21.15.149:0/2252412138 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faec0003a00 msgr2=0x7faec0003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:02.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.824+0000 7faed3fff700 1 --2- 172.21.15.149:0/2252412138 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faec0003a00 0x7faec0003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:02.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.824+0000 7faed3fff700 1 -- 172.21.15.149:0/2252412138 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec00035b0 con 0x7faec0005210 2023-11-08T19:25:02.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.825+0000 7faed3fff700 1 -- 172.21.15.149:0/2252412138 reap_dead start 2023-11-08T19:25:02.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.825+0000 7faed3fff700 1 --2- 172.21.15.149:0/2252412138 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faec0005210 0x7faec000ba10 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7faecc009f90 tx=0x7faec0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eecdacb246fcfe3 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:02.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.825+0000 7faed27fc700 1 -- 172.21.15.149:0/2252412138 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faecc00ec30 con 0x7faec0005210 2023-11-08T19:25:02.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.825+0000 7faed27fc700 1 -- 172.21.15.149:0/2252412138 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faecc00f040 con 0x7faec0005210 2023-11-08T19:25:02.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.825+0000 7faed27fc700 1 -- 172.21.15.149:0/2252412138 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faecc014480 con 0x7faec0005210 2023-11-08T19:25:02.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.825+0000 7faed9f7b700 1 -- 172.21.15.149:0/2252412138 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faec0005210 msgr2=0x7faec000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:02.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.825+0000 7faed9f7b700 1 --2- 172.21.15.149:0/2252412138 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faec0005210 0x7faec000ba10 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7faecc009f90 tx=0x7faec0005880 comp rx=0 tx=0).stop 2023-11-08T19:25:02.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.825+0000 7faed9f7b700 1 -- 172.21.15.149:0/2252412138 shutdown_connections 2023-11-08T19:25:02.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.825+0000 7faed9f7b700 1 --2- 172.21.15.149:0/2252412138 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faec0005210 0x7faec000ba10 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:02.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.825+0000 7faed9f7b700 1 -- 172.21.15.149:0/2252412138 >> 172.21.15.149:0/2252412138 conn(0x7faed4099a40 msgr2=0x7faed40d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:02.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.825+0000 7faed9f7b700 1 -- 172.21.15.149:0/2252412138 shutdown_connections 2023-11-08T19:25:02.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.825+0000 7faed9f7b700 1 -- 172.21.15.149:0/2252412138 wait complete. 2023-11-08T19:25:02.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.827+0000 7faed9f7b700 1 Processor -- start 2023-11-08T19:25:02.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.827+0000 7faed9f7b700 1 -- start start 2023-11-08T19:25:02.846 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.828+0000 7faed9f7b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faec0005210 0x7faed414ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:02.846 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.828+0000 7faed9f7b700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faed40c84d0 0x7faed40c8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:02.846 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.828+0000 7faed9f7b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faed415c050 0x7faed415c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:02.846 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.828+0000 7faed9f7b700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed40c8e90 con 0x7faed415c050 2023-11-08T19:25:02.847 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.828+0000 7faed9f7b700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed415ca10 con 0x7faec0005210 2023-11-08T19:25:02.847 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.828+0000 7faed9f7b700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed415f3c0 con 0x7faed40c84d0 2023-11-08T19:25:02.847 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.828+0000 7faed3fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faed415c050 0x7faed415c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:02.847 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.828+0000 7faed3fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faed415c050 0x7faed415c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40486/0 (socket says 172.21.15.149:40486) 2023-11-08T19:25:02.847 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.828+0000 7faed3fff700 1 -- 172.21.15.149:0/1489151977 learned_addr learned my addr 172.21.15.149:0/1489151977 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:02.848 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.828+0000 7faed2ffd700 1 --2- 172.21.15.149:0/1489151977 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faed40c84d0 0x7faed40c8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:02.848 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.828+0000 7faed37fe700 1 --2- 172.21.15.149:0/1489151977 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faec0005210 0x7faed414ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:02.848 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.828+0000 7faed3fff700 1 -- 172.21.15.149:0/1489151977 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faed40c84d0 msgr2=0x7faed40c8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:02.848 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.828+0000 7faed3fff700 1 --2- 172.21.15.149:0/1489151977 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faed40c84d0 0x7faed40c8950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:02.848 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.828+0000 7faed3fff700 1 -- 172.21.15.149:0/1489151977 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faec0005210 msgr2=0x7faed414ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:02.849 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.828+0000 7faed3fff700 1 --2- 172.21.15.149:0/1489151977 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faec0005210 0x7faed414ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:02.849 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.828+0000 7faed3fff700 1 -- 172.21.15.149:0/1489151977 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed414bfc0 con 0x7faed415c050 2023-11-08T19:25:02.849 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.828+0000 7faed37fe700 1 --2- 172.21.15.149:0/1489151977 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faec0005210 0x7faed414ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:25:02.849 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.828+0000 7faed3fff700 1 --2- 172.21.15.149:0/1489151977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faed415c050 0x7faed415c4d0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7faecc0146b0 tx=0x7faecc004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:02.849 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.828+0000 7faecbfff700 1 -- 172.21.15.149:0/1489151977 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faecc007000 con 0x7faed415c050 2023-11-08T19:25:02.850 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.828+0000 7faecbfff700 1 -- 172.21.15.149:0/1489151977 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faecc003e30 con 0x7faed415c050 2023-11-08T19:25:02.850 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.828+0000 7faed9f7b700 1 -- 172.21.15.149:0/1489151977 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faed40b3250 con 0x7faed415c050 2023-11-08T19:25:02.850 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.828+0000 7faecbfff700 1 -- 172.21.15.149:0/1489151977 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faecc014ad0 con 0x7faed415c050 2023-11-08T19:25:02.850 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.828+0000 7faed9f7b700 1 -- 172.21.15.149:0/1489151977 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faed40b34f0 con 0x7faed415c050 2023-11-08T19:25:02.851 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.830+0000 7faecbfff700 1 -- 172.21.15.149:0/1489151977 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faecc023020 con 0x7faed415c050 2023-11-08T19:25:02.851 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.830+0000 7faecbfff700 1 --2- 172.21.15.149:0/1489151977 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7faeb406af00 0x7faeb406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:02.851 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.830+0000 7faecbfff700 1 -- 172.21.15.149:0/1489151977 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7faecc08b1e0 con 0x7faed415c050 2023-11-08T19:25:02.851 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.830+0000 7faed37fe700 1 --2- 172.21.15.149:0/1489151977 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7faeb406af00 0x7faeb406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:02.852 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.831+0000 7faed37fe700 1 --2- 172.21.15.149:0/1489151977 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7faeb406af00 0x7faeb406d3c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7faec40011d0 tx=0x7faec4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:02.852 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.832+0000 7faee6174b80 1 Processor -- start 2023-11-08T19:25:02.852 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.832+0000 7faee6174b80 1 -- start start 2023-11-08T19:25:02.852 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.833+0000 7faee6174b80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fee224e6f0 0x55fee227e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:02.852 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.833+0000 7faee6174b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fee2250c30 0x55fee227e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:02.853 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.833+0000 7faee6174b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fee224ead0 0x55fee2268f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:02.853 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.833+0000 7faee6174b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fee21ba6e0 con 0x55fee224ead0 2023-11-08T19:25:02.853 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.833+0000 7faee6174b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fee21ae3b0 con 0x55fee2250c30 2023-11-08T19:25:02.853 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.833+0000 7faee6174b80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fee21abcd0 con 0x55fee224e6f0 2023-11-08T19:25:02.853 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.833+0000 7faed3fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fee224ead0 0x55fee2268f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:02.854 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.833+0000 7faed3fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fee224ead0 0x55fee2268f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40492/0 (socket says 172.21.15.149:40492) 2023-11-08T19:25:02.854 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.833+0000 7faed3fff700 1 -- 172.21.15.149:0/657087687 learned_addr learned my addr 172.21.15.149:0/657087687 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:02.854 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.833+0000 7faed37fe700 1 --2- 172.21.15.149:0/657087687 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fee224e6f0 0x55fee227e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:02.854 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.833+0000 7faed2ffd700 1 --2- 172.21.15.149:0/657087687 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fee2250c30 0x55fee227e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:02.854 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.833+0000 7faed3fff700 1 -- 172.21.15.149:0/657087687 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fee224e6f0 msgr2=0x55fee227e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:02.855 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.833+0000 7faed3fff700 1 --2- 172.21.15.149:0/657087687 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fee224e6f0 0x55fee227e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:02.855 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.833+0000 7faed3fff700 1 -- 172.21.15.149:0/657087687 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fee2250c30 msgr2=0x55fee227e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:02.855 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.833+0000 7faed3fff700 1 --2- 172.21.15.149:0/657087687 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fee2250c30 0x55fee227e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:02.855 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.833+0000 7faed3fff700 1 -- 172.21.15.149:0/657087687 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fee20245e0 con 0x55fee224ead0 2023-11-08T19:25:02.855 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.833+0000 7faed37fe700 1 --2- 172.21.15.149:0/657087687 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fee224e6f0 0x55fee227e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:25:02.856 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.833+0000 7faed2ffd700 1 --2- 172.21.15.149:0/657087687 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fee2250c30 0x55fee227e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:25:02.856 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.833+0000 7faed3fff700 1 --2- 172.21.15.149:0/657087687 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fee224ead0 0x55fee2268f90 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7faecc089440 tx=0x7faecc059ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5415d0e57871f66 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:02.856 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.834+0000 7faec97fa700 1 -- 172.21.15.149:0/657087687 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faecc071070 con 0x55fee224ead0 2023-11-08T19:25:02.856 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.834+0000 7faec97fa700 1 -- 172.21.15.149:0/657087687 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faecc0600c0 con 0x55fee224ead0 2023-11-08T19:25:02.856 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.834+0000 7faec97fa700 1 -- 172.21.15.149:0/657087687 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faecc05dfb0 con 0x55fee224ead0 2023-11-08T19:25:02.857 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.834+0000 7faee6174b80 1 -- 172.21.15.149:0/657087687 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fee224ead0 msgr2=0x55fee2268f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:02.857 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.834+0000 7faee6174b80 1 --2- 172.21.15.149:0/657087687 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fee224ead0 0x55fee2268f90 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7faecc089440 tx=0x7faecc059ad0 comp rx=0 tx=0).stop 2023-11-08T19:25:02.858 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.834+0000 7faee6174b80 1 -- 172.21.15.149:0/657087687 shutdown_connections 2023-11-08T19:25:02.858 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.834+0000 7faee6174b80 1 --2- 172.21.15.149:0/657087687 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fee224ead0 0x55fee2268f90 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:02.858 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.834+0000 7faee6174b80 1 --2- 172.21.15.149:0/657087687 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fee224e6f0 0x55fee227e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:02.859 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.834+0000 7faee6174b80 1 --2- 172.21.15.149:0/657087687 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fee2250c30 0x55fee227e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:02.859 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.834+0000 7faee6174b80 1 -- 172.21.15.149:0/657087687 >> 172.21.15.149:0/657087687 conn(0x55fee21c9660 msgr2=0x55fee22543c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:02.860 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.834+0000 7faee6174b80 1 -- 172.21.15.149:0/657087687 shutdown_connections 2023-11-08T19:25:02.860 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.834+0000 7faee6174b80 1 -- 172.21.15.149:0/657087687 wait complete. 2023-11-08T19:25:02.860 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.835+0000 7faee6174b80 1 -- start start 2023-11-08T19:25:02.861 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.835+0000 7faee6174b80 1 Processor -- start 2023-11-08T19:25:02.861 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.836+0000 7faee6174b80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fee224e6f0 0x55fee22a84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:02.861 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.836+0000 7faee6174b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fee224ead0 0x55fee227b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:02.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.836+0000 7faee6174b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fee225ace0 0x55fee224f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:02.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.836+0000 7faee6174b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fee21a75c0 con 0x55fee225ace0 2023-11-08T19:25:02.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.836+0000 7faee6174b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fee21430d0 con 0x55fee224ead0 2023-11-08T19:25:02.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.836+0000 7faee6174b80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fee2142d70 con 0x55fee224e6f0 2023-11-08T19:25:02.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.836+0000 7faee6174b80 10 client.0 _ll_register_callbacks cb 0x55fee1f9f7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-08T19:25:02.864 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.836+0000 7faed3fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fee225ace0 0x55fee224f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:02.864 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.836+0000 7faed3fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fee225ace0 0x55fee224f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40500/0 (socket says 172.21.15.149:40500) 2023-11-08T19:25:02.865 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.836+0000 7faed3fff700 1 -- 172.21.15.149:0/4010532317 learned_addr learned my addr 172.21.15.149:0/4010532317 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:02.865 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.836+0000 7faed2ffd700 1 --2- 172.21.15.149:0/4010532317 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fee224ead0 0x55fee227b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:02.865 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.836+0000 7faed37fe700 1 --2- 172.21.15.149:0/4010532317 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fee224e6f0 0x55fee22a84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:02.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.836+0000 7faed3fff700 1 -- 172.21.15.149:0/4010532317 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fee224e6f0 msgr2=0x55fee22a84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:02.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.836+0000 7faed3fff700 1 --2- 172.21.15.149:0/4010532317 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fee224e6f0 0x55fee22a84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:02.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.836+0000 7faed3fff700 1 -- 172.21.15.149:0/4010532317 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fee224ead0 msgr2=0x55fee227b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:02.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.836+0000 7faed3fff700 1 --2- 172.21.15.149:0/4010532317 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fee224ead0 0x55fee227b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:02.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.836+0000 7faed3fff700 1 -- 172.21.15.149:0/4010532317 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faed40b34f0 con 0x55fee225ace0 2023-11-08T19:25:02.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.836+0000 7faed3fff700 1 --2- 172.21.15.149:0/4010532317 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fee225ace0 0x55fee224f020 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7faecc056360 tx=0x7faecc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d87f2e38a96df60a server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:02.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.836+0000 7faeb27fc700 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2023-11-08T19:25:02.869 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.836+0000 7faeb27fc700 1 -- 172.21.15.149:0/4010532317 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faecc071040 con 0x55fee225ace0 2023-11-08T19:25:02.869 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.837+0000 7faeb27fc700 1 -- 172.21.15.149:0/4010532317 <== mon.0 v2:172.21.15.149:3300/0 2 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7faecc05c030 con 0x55fee225ace0 2023-11-08T19:25:02.870 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.837+0000 7faee6174b80 1 -- 172.21.15.149:0/4010532317 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fee2246880 con 0x55fee225ace0 2023-11-08T19:25:02.870 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.837+0000 7faeb27fc700 1 -- 172.21.15.149:0/4010532317 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7faecc05e030 con 0x55fee225ace0 2023-11-08T19:25:02.870 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.837+0000 7faee6174b80 10 client.5910 fetch_fsmap learned FSMap version 25 2023-11-08T19:25:02.871 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.837+0000 7faee6174b80 1 -- 172.21.15.149:0/4010532317 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x55fee1fd0d90 con 0x55fee225ace0 2023-11-08T19:25:02.871 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.837+0000 7faeb27fc700 1 -- 172.21.15.149:0/4010532317 <== mon.0 v2:172.21.15.149:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fee2246880 con 0x55fee225ace0 2023-11-08T19:25:02.871 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.837+0000 7faeb27fc700 1 -- 172.21.15.149:0/4010532317 <== mon.0 v2:172.21.15.149:3300/0 5 ==== fsmap(e 25) v1 ==== 3294+0+0 (secure 0 0 0) 0x7faecc05a0c0 con 0x55fee225ace0 2023-11-08T19:25:02.872 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.837+0000 7faee6174b80 10 client.5910 fetch_fsmap finished waiting for FSMap version 25 2023-11-08T19:25:02.872 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.837+0000 7faee6174b80 10 client.5910 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-08T19:25:02.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.837+0000 7faee6174b80 20 client.5910 populate_metadata read hostname 'smithi149' 2023-11-08T19:25:02.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.837+0000 7faee6174b80 1 --2- 172.21.15.149:0/4010532317 >> [v2:172.21.15.149:6835/4238261436,v1:172.21.15.149:6837/4238261436] conn(0x55fee225c970 0x55fee225cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:02.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.837+0000 7faee6174b80 4 client.5910 mds_command: new command op to 5733 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-08T19:25:02.874 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.837+0000 7faee6174b80 1 -- 172.21.15.149:0/4010532317 --> [v2:172.21.15.149:6835/4238261436,v1:172.21.15.149:6837/4238261436] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fee2222a30 con 0x55fee225c970 2023-11-08T19:25:02.874 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.837+0000 7faed37fe700 1 --2- 172.21.15.149:0/4010532317 >> [v2:172.21.15.149:6835/4238261436,v1:172.21.15.149:6837/4238261436] conn(0x55fee225c970 0x55fee225cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:02.874 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.837+0000 7faeb27fc700 10 client.5910 ms_handle_connect on v2:172.21.15.149:6835/4238261436 2023-11-08T19:25:02.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.837+0000 7faed37fe700 1 --2- 172.21.15.149:0/4010532317 >> [v2:172.21.15.149:6835/4238261436,v1:172.21.15.149:6837/4238261436] conn(0x55fee225c970 0x55fee225cd50 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=644c3c1000ca0df server_cookie=3b576739e11744ef in_seq=0 out_seq=0 2023-11-08T19:25:02.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.838+0000 7faeb27fc700 1 -- 172.21.15.149:0/4010532317 <== mds.0 v2:172.21.15.149:6835/4238261436 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55fee2222a30 con 0x55fee225c970 2023-11-08T19:25:02.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.838+0000 7faeb27fc700 10 client.5910 handle_command_reply: tid=0 2023-11-08T19:25:02.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.838+0000 7faee6174b80 1 client.5910 shutdown 2023-11-08T19:25:02.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.838+0000 7faee6174b80 1 -- 172.21.15.149:0/4010532317 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fee225ace0 msgr2=0x55fee224f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:02.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.838+0000 7faee6174b80 1 --2- 172.21.15.149:0/4010532317 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fee225ace0 0x55fee224f020 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7faecc056360 tx=0x7faecc009750 comp rx=0 tx=0).stop 2023-11-08T19:25:02.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.838+0000 7faee6174b80 1 -- 172.21.15.149:0/4010532317 shutdown_connections 2023-11-08T19:25:02.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.838+0000 7faee6174b80 1 --2- 172.21.15.149:0/4010532317 >> [v2:172.21.15.149:6835/4238261436,v1:172.21.15.149:6837/4238261436] conn(0x55fee225c970 0x55fee225cd50 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:02.878 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.838+0000 7faee6174b80 1 --2- 172.21.15.149:0/4010532317 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fee225ace0 0x55fee224f020 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:02.878 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.838+0000 7faee6174b80 1 --2- 172.21.15.149:0/4010532317 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fee224e6f0 0x55fee22a84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:02.879 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.838+0000 7faeb27fc700 0 client.5910 ms_handle_reset on v2:172.21.15.149:6835/4238261436 2023-11-08T19:25:02.879 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.838+0000 7faee6174b80 1 --2- 172.21.15.149:0/4010532317 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fee224ead0 0x55fee227b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:02.879 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.838+0000 7faee6174b80 1 -- 172.21.15.149:0/4010532317 >> 172.21.15.149:0/4010532317 conn(0x55fee21c9660 msgr2=0x55fee22518f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:02.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.838+0000 7faee6174b80 1 -- 172.21.15.149:0/4010532317 shutdown_connections 2023-11-08T19:25:02.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.838+0000 7faee6174b80 1 -- 172.21.15.149:0/4010532317 wait complete. 2023-11-08T19:25:02.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.838+0000 7faee6174b80 20 client.5910 trim_cache size 0 max 16384 2023-11-08T19:25:02.890 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.856+0000 7faee6174b80 1 Processor -- start 2023-11-08T19:25:02.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.856+0000 7faee6174b80 1 -- start start 2023-11-08T19:25:02.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.857+0000 7faee6174b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fee224e6f0 0x55fee227b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:02.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.857+0000 7faee6174b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fee224ead0 0x55fee22bb160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:02.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.857+0000 7faee6174b80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fee225ace0 0x55fee229b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:02.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.857+0000 7faee6174b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fee20268d0 con 0x55fee224e6f0 2023-11-08T19:25:02.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.857+0000 7faee6174b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fee2251ec0 con 0x55fee224ead0 2023-11-08T19:25:02.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.857+0000 7faee6174b80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fee2294ca0 con 0x55fee225ace0 2023-11-08T19:25:02.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.857+0000 7faed37fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fee224e6f0 0x55fee227b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:02.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.857+0000 7faed37fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fee224e6f0 0x55fee227b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40508/0 (socket says 172.21.15.149:40508) 2023-11-08T19:25:02.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.857+0000 7faed37fe700 1 -- 172.21.15.149:0/2633455560 learned_addr learned my addr 172.21.15.149:0/2633455560 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:02.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.857+0000 7faed3fff700 1 --2- 172.21.15.149:0/2633455560 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fee225ace0 0x55fee229b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:02.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.857+0000 7faed2ffd700 1 --2- 172.21.15.149:0/2633455560 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fee224ead0 0x55fee22bb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:02.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.857+0000 7faed37fe700 1 -- 172.21.15.149:0/2633455560 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fee225ace0 msgr2=0x55fee229b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:02.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.857+0000 7faed37fe700 1 --2- 172.21.15.149:0/2633455560 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fee225ace0 0x55fee229b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:02.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.857+0000 7faed37fe700 1 -- 172.21.15.149:0/2633455560 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fee224ead0 msgr2=0x55fee22bb160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:02.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.857+0000 7faed37fe700 1 --2- 172.21.15.149:0/2633455560 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fee224ead0 0x55fee22bb160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:02.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.857+0000 7faed37fe700 1 -- 172.21.15.149:0/2633455560 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fee1fb9c10 con 0x55fee224e6f0 2023-11-08T19:25:02.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.857+0000 7faed37fe700 1 --2- 172.21.15.149:0/2633455560 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fee224e6f0 0x55fee227b220 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7faec4000c00 tx=0x7faec4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=474f28621e8f2f5 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:02.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.858+0000 7faec9ffb700 1 -- 172.21.15.149:0/2633455560 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec40154f0 con 0x55fee224e6f0 2023-11-08T19:25:02.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.858+0000 7faec9ffb700 1 -- 172.21.15.149:0/2633455560 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec402d070 con 0x55fee224e6f0 2023-11-08T19:25:02.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.858+0000 7faec9ffb700 1 -- 172.21.15.149:0/2633455560 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec4015850 con 0x55fee224e6f0 2023-11-08T19:25:02.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.858+0000 7faee6174b80 1 -- 172.21.15.149:0/2633455560 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fee224e6f0 msgr2=0x55fee227b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:02.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.858+0000 7faee6174b80 1 --2- 172.21.15.149:0/2633455560 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fee224e6f0 0x55fee227b220 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7faec4000c00 tx=0x7faec4014000 comp rx=0 tx=0).stop 2023-11-08T19:25:02.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.858+0000 7faee6174b80 1 -- 172.21.15.149:0/2633455560 shutdown_connections 2023-11-08T19:25:02.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.858+0000 7faee6174b80 1 --2- 172.21.15.149:0/2633455560 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fee225ace0 0x55fee229b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:02.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.858+0000 7faee6174b80 1 --2- 172.21.15.149:0/2633455560 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fee224e6f0 0x55fee227b220 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:02.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.858+0000 7faee6174b80 1 --2- 172.21.15.149:0/2633455560 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fee224ead0 0x55fee22bb160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:02.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.858+0000 7faee6174b80 1 -- 172.21.15.149:0/2633455560 >> 172.21.15.149:0/2633455560 conn(0x55fee21c9660 msgr2=0x55fee224dfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:02.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.858+0000 7faee6174b80 1 -- 172.21.15.149:0/2633455560 shutdown_connections 2023-11-08T19:25:02.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.858+0000 7faee6174b80 1 -- 172.21.15.149:0/2633455560 wait complete. 2023-11-08T19:25:02.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.859+0000 7faee6174b80 1 -- start start 2023-11-08T19:25:02.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.859+0000 7faee6174b80 1 Processor -- start 2023-11-08T19:25:02.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.860+0000 7faee6174b80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fee224e6f0 0x55fee2301e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:02.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.860+0000 7faee6174b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fee224ead0 0x55fee22a7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:02.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.860+0000 7faee6174b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fee225ace0 0x55fee22a8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:02.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.860+0000 7faee6174b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fee2251990 con 0x55fee224ead0 2023-11-08T19:25:02.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.860+0000 7faee6174b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fee2252e70 con 0x55fee225ace0 2023-11-08T19:25:02.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.860+0000 7faee6174b80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fee2292e00 con 0x55fee224e6f0 2023-11-08T19:25:02.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.860+0000 7faee6174b80 10 client.0 _ll_register_callbacks cb 0x7faecc0561a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-08T19:25:02.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.860+0000 7faed2ffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fee224ead0 0x55fee22a7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:02.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.860+0000 7faed2ffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fee224ead0 0x55fee22a7dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40512/0 (socket says 172.21.15.149:40512) 2023-11-08T19:25:02.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.860+0000 7faed2ffd700 1 -- 172.21.15.149:0/1263671975 learned_addr learned my addr 172.21.15.149:0/1263671975 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:02.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.860+0000 7faed3fff700 1 --2- 172.21.15.149:0/1263671975 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fee225ace0 0x55fee22a8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:02.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.860+0000 7faed37fe700 1 --2- 172.21.15.149:0/1263671975 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fee224e6f0 0x55fee2301e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:02.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.860+0000 7faed2ffd700 1 -- 172.21.15.149:0/1263671975 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fee224e6f0 msgr2=0x55fee2301e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:02.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.860+0000 7faed2ffd700 1 --2- 172.21.15.149:0/1263671975 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fee224e6f0 0x55fee2301e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:02.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.860+0000 7faed2ffd700 1 -- 172.21.15.149:0/1263671975 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fee225ace0 msgr2=0x55fee22a8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:02.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.860+0000 7faed2ffd700 1 --2- 172.21.15.149:0/1263671975 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fee225ace0 0x55fee22a8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:02.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.860+0000 7faed2ffd700 1 -- 172.21.15.149:0/1263671975 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faed40b17b0 con 0x55fee224ead0 2023-11-08T19:25:02.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.860+0000 7faed3fff700 1 --2- 172.21.15.149:0/1263671975 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fee225ace0 0x55fee22a8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:25:02.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.860+0000 7faed37fe700 1 --2- 172.21.15.149:0/1263671975 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fee224e6f0 0x55fee2301e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:25:02.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.860+0000 7faed2ffd700 1 --2- 172.21.15.149:0/1263671975 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fee224ead0 0x55fee22a7dd0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7faed415f580 tx=0x7faebc0176b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47f7630b6532d43e server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:02.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.860+0000 7faeb27fc700 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2023-11-08T19:25:02.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.860+0000 7faeb27fc700 1 -- 172.21.15.149:0/1263671975 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faebc004ef0 con 0x55fee224ead0 2023-11-08T19:25:02.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.860+0000 7faeb27fc700 1 -- 172.21.15.149:0/1263671975 <== mon.0 v2:172.21.15.149:3300/0 2 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7faebc017dc0 con 0x55fee224ead0 2023-11-08T19:25:02.902 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.860+0000 7faee6174b80 1 -- 172.21.15.149:0/1263671975 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faecc0600c0 con 0x55fee224ead0 2023-11-08T19:25:02.902 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.860+0000 7faeb27fc700 1 -- 172.21.15.149:0/1263671975 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7faebc006860 con 0x55fee224ead0 2023-11-08T19:25:02.902 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.861+0000 7faee6174b80 10 client.5916 fetch_fsmap learned FSMap version 25 2023-11-08T19:25:02.902 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.861+0000 7faee6174b80 1 -- 172.21.15.149:0/1263671975 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x55fee1ff7200 con 0x55fee224ead0 2023-11-08T19:25:02.902 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.861+0000 7faeb27fc700 1 -- 172.21.15.149:0/1263671975 <== mon.0 v2:172.21.15.149:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faecc0600c0 con 0x55fee224ead0 2023-11-08T19:25:02.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.861+0000 7faeb27fc700 1 -- 172.21.15.149:0/1263671975 <== mon.0 v2:172.21.15.149:3300/0 5 ==== fsmap(e 25) v1 ==== 3294+0+0 (secure 0 0 0) 0x7faebc0069c0 con 0x55fee224ead0 2023-11-08T19:25:02.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.861+0000 7faee6174b80 10 client.5916 fetch_fsmap finished waiting for FSMap version 25 2023-11-08T19:25:02.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.861+0000 7faee6174b80 10 client.5916 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-08T19:25:02.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.861+0000 7faee6174b80 20 client.5916 populate_metadata read hostname 'smithi149' 2023-11-08T19:25:02.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.861+0000 7faee6174b80 1 --2- 172.21.15.149:0/1263671975 >> [v2:172.21.15.149:6835/4238261436,v1:172.21.15.149:6837/4238261436] conn(0x55fee229c760 0x55fee229cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:02.904 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.861+0000 7faee6174b80 4 client.5916 mds_command: new command op to 5733 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-08T19:25:02.904 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.861+0000 7faee6174b80 1 -- 172.21.15.149:0/1263671975 --> [v2:172.21.15.149:6835/4238261436,v1:172.21.15.149:6837/4238261436] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55fee21a05a0 con 0x55fee229c760 2023-11-08T19:25:02.904 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.861+0000 7faed37fe700 1 --2- 172.21.15.149:0/1263671975 >> [v2:172.21.15.149:6835/4238261436,v1:172.21.15.149:6837/4238261436] conn(0x55fee229c760 0x55fee229cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:02.904 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.861+0000 7faeb27fc700 10 client.5916 ms_handle_connect on v2:172.21.15.149:6835/4238261436 2023-11-08T19:25:02.904 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.861+0000 7faed37fe700 1 --2- 172.21.15.149:0/1263671975 >> [v2:172.21.15.149:6835/4238261436,v1:172.21.15.149:6837/4238261436] conn(0x55fee229c760 0x55fee229cb40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b978d1ba705930e server_cookie=de75d9801c611553 in_seq=0 out_seq=0 2023-11-08T19:25:02.905 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.861+0000 7faeb27fc700 1 -- 172.21.15.149:0/1263671975 <== mds.0 v2:172.21.15.149:6835/4238261436 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+319 (crc 0 0 0) 0x55fee21a05a0 con 0x55fee229c760 2023-11-08T19:25:02.905 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.861+0000 7faeb27fc700 10 client.5916 handle_command_reply: tid=0 2023-11-08T19:25:02.905 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.861+0000 7faee6174b80 1 client.5916 shutdown 2023-11-08T19:25:02.905 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.861+0000 7faee6174b80 1 -- 172.21.15.149:0/1263671975 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fee224ead0 msgr2=0x55fee22a7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:02.905 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.862+0000 7faee6174b80 1 --2- 172.21.15.149:0/1263671975 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fee224ead0 0x55fee22a7dd0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7faed415f580 tx=0x7faebc0176b0 comp rx=0 tx=0).stop 2023-11-08T19:25:02.906 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.862+0000 7faee6174b80 1 -- 172.21.15.149:0/1263671975 shutdown_connections 2023-11-08T19:25:02.906 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.862+0000 7faee6174b80 1 --2- 172.21.15.149:0/1263671975 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fee225ace0 0x55fee22a8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:02.906 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.862+0000 7faee6174b80 1 --2- 172.21.15.149:0/1263671975 >> [v2:172.21.15.149:6835/4238261436,v1:172.21.15.149:6837/4238261436] conn(0x55fee229c760 0x55fee229cb40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:02.906 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.862+0000 7faee6174b80 1 --2- 172.21.15.149:0/1263671975 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fee224e6f0 0x55fee2301e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:02.906 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.862+0000 7faee6174b80 1 --2- 172.21.15.149:0/1263671975 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fee224ead0 0x55fee22a7dd0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:02.907 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.862+0000 7faeb27fc700 0 client.5916 ms_handle_reset on v2:172.21.15.149:6835/4238261436 2023-11-08T19:25:02.907 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.862+0000 7faee6174b80 1 -- 172.21.15.149:0/1263671975 >> 172.21.15.149:0/1263671975 conn(0x55fee21c9660 msgr2=0x55fee224d500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:02.907 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.862+0000 7faee6174b80 1 -- 172.21.15.149:0/1263671975 shutdown_connections 2023-11-08T19:25:02.907 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.862+0000 7faee6174b80 1 -- 172.21.15.149:0/1263671975 wait complete. 2023-11-08T19:25:02.907 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.862+0000 7faee6174b80 20 client.5916 trim_cache size 0 max 16384 2023-11-08T19:25:02.908 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2023-11-08T19:25:02.908 INFO:teuthology.orchestra.run.smithi149.stdout: "cluster_fsid": "0aba7c70-fe80-4446-a2f5-7502ac3adfb4", 2023-11-08T19:25:02.908 INFO:teuthology.orchestra.run.smithi149.stdout: "whoami": 0, 2023-11-08T19:25:02.909 INFO:teuthology.orchestra.run.smithi149.stdout: "id": 5733, 2023-11-08T19:25:02.909 INFO:teuthology.orchestra.run.smithi149.stdout: "want_state": "up:active", 2023-11-08T19:25:02.909 INFO:teuthology.orchestra.run.smithi149.stdout: "state": "up:active", 2023-11-08T19:25:02.909 INFO:teuthology.orchestra.run.smithi149.stdout: "fs_name": "cephfs", 2023-11-08T19:25:02.909 INFO:teuthology.orchestra.run.smithi149.stdout: "rank_uptime": 10.500224544, 2023-11-08T19:25:02.910 INFO:teuthology.orchestra.run.smithi149.stdout: "mdsmap_epoch": 25, 2023-11-08T19:25:02.910 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_epoch": 55, 2023-11-08T19:25:02.910 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_epoch_barrier": 55, 2023-11-08T19:25:02.910 INFO:teuthology.orchestra.run.smithi149.stdout: "uptime": 16.471257752 2023-11-08T19:25:02.910 INFO:teuthology.orchestra.run.smithi149.stdout:} 2023-11-08T19:25:02.912 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.862+0000 7faed9f7b700 1 -- 172.21.15.149:0/1489151977 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7faeb406af00 msgr2=0x7faeb406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:02.912 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.862+0000 7faed9f7b700 1 --2- 172.21.15.149:0/1489151977 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7faeb406af00 0x7faeb406d3c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7faec40011d0 tx=0x7faec4009040 comp rx=0 tx=0).stop 2023-11-08T19:25:02.912 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.862+0000 7faed9f7b700 1 -- 172.21.15.149:0/1489151977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faed415c050 msgr2=0x7faed415c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:02.912 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.862+0000 7faed9f7b700 1 --2- 172.21.15.149:0/1489151977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faed415c050 0x7faed415c4d0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7faecc0146b0 tx=0x7faecc004b40 comp rx=0 tx=0).stop 2023-11-08T19:25:02.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.862+0000 7faed9f7b700 1 -- 172.21.15.149:0/1489151977 shutdown_connections 2023-11-08T19:25:02.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.862+0000 7faed9f7b700 1 --2- 172.21.15.149:0/1489151977 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7faeb406af00 0x7faeb406d3c0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:02.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.862+0000 7faed9f7b700 1 --2- 172.21.15.149:0/1489151977 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faec0005210 0x7faed414ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:02.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.862+0000 7faed9f7b700 1 --2- 172.21.15.149:0/1489151977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faed415c050 0x7faed415c4d0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:02.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.862+0000 7faed9f7b700 1 --2- 172.21.15.149:0/1489151977 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faed40c84d0 0x7faed40c8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:02.914 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.862+0000 7faed9f7b700 1 -- 172.21.15.149:0/1489151977 >> 172.21.15.149:0/1489151977 conn(0x7faed4099a40 msgr2=0x7faed40c9ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:02.914 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.862+0000 7faed9f7b700 1 -- 172.21.15.149:0/1489151977 shutdown_connections 2023-11-08T19:25:02.914 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:02.862+0000 7faed9f7b700 1 -- 172.21.15.149:0/1489151977 wait complete. 2023-11-08T19:25:02.914 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-08T19:25:03.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.035+0000 7f535dd16700 1 Processor -- start 2023-11-08T19:25:03.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.035+0000 7f535dd16700 1 -- start start 2023-11-08T19:25:03.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.035+0000 7f535dd16700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f53580d0fe0 0x7f53580c8680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:03.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.035+0000 7f535dd16700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f53580cc9a0 0x7f53580c8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:03.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.035+0000 7f535dd16700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f535815bd30 con 0x7f535815b950 2023-11-08T19:25:03.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.035+0000 7f535dd16700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53580caa90 con 0x7f53580cc9a0 2023-11-08T19:25:03.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.035+0000 7f535dd16700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53580c7670 con 0x7f53580d0fe0 2023-11-08T19:25:03.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.036+0000 7f5357fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f53580cc9a0 0x7f53580c8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:03.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.036+0000 7f5357fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f53580cc9a0 0x7f53580c8bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40522/0 (socket says 172.21.15.149:40522) 2023-11-08T19:25:03.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.036+0000 7f5357fff700 1 -- 172.21.15.149:0/4273163804 learned_addr learned my addr 172.21.15.149:0/4273163804 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:03.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.036+0000 7f5356ffd700 1 --2- 172.21.15.149:0/4273163804 >> v2:172.21.15.160:3300/0 conn(0x7f53580d0fe0 0x7f53580c8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:03.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.036+0000 7f5357fff700 1 -- 172.21.15.149:0/4273163804 >> v2:172.21.15.160:3300/0 conn(0x7f53580d0fe0 msgr2=0x7f53580c8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:03.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.036+0000 7f5357fff700 1 --2- 172.21.15.149:0/4273163804 >> v2:172.21.15.160:3300/0 conn(0x7f53580d0fe0 0x7f53580c8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:03.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.036+0000 7f5357fff700 1 -- 172.21.15.149:0/4273163804 >> v1:172.21.15.160:6789/0 conn(0x7f535815b950 legacy=0x7f53580cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:03.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.036+0000 7f5357fff700 1 -- 172.21.15.149:0/4273163804 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53580c81f0 con 0x7f53580cc9a0 2023-11-08T19:25:03.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.036+0000 7f5357fff700 1 --2- 172.21.15.149:0/4273163804 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53580cc9a0 0x7f53580c8bc0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f53580b31c0 tx=0x7f535000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=675c048976ed5e83 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:03.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.036+0000 7f53567fc700 1 -- 172.21.15.149:0/4273163804 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535000e070 con 0x7f53580cc9a0 2023-11-08T19:25:03.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.036+0000 7f53567fc700 1 -- 172.21.15.149:0/4273163804 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f535000b9c0 con 0x7f53580cc9a0 2023-11-08T19:25:03.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.036+0000 7f53567fc700 1 -- 172.21.15.149:0/4273163804 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535000bd70 con 0x7f53580cc9a0 2023-11-08T19:25:03.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.037+0000 7f535dd16700 1 -- 172.21.15.149:0/4273163804 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53580cc9a0 msgr2=0x7f53580c8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:03.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.037+0000 7f535dd16700 1 --2- 172.21.15.149:0/4273163804 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53580cc9a0 0x7f53580c8bc0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f53580b31c0 tx=0x7f535000b330 comp rx=0 tx=0).stop 2023-11-08T19:25:03.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.037+0000 7f535dd16700 1 -- 172.21.15.149:0/4273163804 shutdown_connections 2023-11-08T19:25:03.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.037+0000 7f535dd16700 1 --2- 172.21.15.149:0/4273163804 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53580cc9a0 0x7f53580c8bc0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:03.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.037+0000 7f535dd16700 1 --2- 172.21.15.149:0/4273163804 >> v2:172.21.15.160:3300/0 conn(0x7f53580d0fe0 0x7f53580c8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:03.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.037+0000 7f535dd16700 1 -- 172.21.15.149:0/4273163804 >> 172.21.15.149:0/4273163804 conn(0x7f5358099a40 msgr2=0x7f53580d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:03.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.037+0000 7f535dd16700 1 -- 172.21.15.149:0/4273163804 shutdown_connections 2023-11-08T19:25:03.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.037+0000 7f535dd16700 1 -- 172.21.15.149:0/4273163804 wait complete. 2023-11-08T19:25:03.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.038+0000 7f535dd16700 1 Processor -- start 2023-11-08T19:25:03.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.038+0000 7f535dd16700 1 -- start start 2023-11-08T19:25:03.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.039+0000 7f535dd16700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53580cc9a0 0x7f535814f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:03.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.039+0000 7f535dd16700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53580d0fe0 0x7f5358159750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:03.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.039+0000 7f535dd16700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f535815b950 0x7f5358159c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:03.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.039+0000 7f535dd16700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53581f5a20 con 0x7f535815b950 2023-11-08T19:25:03.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.039+0000 7f535dd16700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53581f4b00 con 0x7f53580d0fe0 2023-11-08T19:25:03.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.039+0000 7f535dd16700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53581f4da0 con 0x7f53580cc9a0 2023-11-08T19:25:03.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.039+0000 7f5357fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f535815b950 0x7f5358159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:03.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.039+0000 7f5357fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f535815b950 0x7f5358159c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40528/0 (socket says 172.21.15.149:40528) 2023-11-08T19:25:03.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.039+0000 7f5357fff700 1 -- 172.21.15.149:0/4013069788 learned_addr learned my addr 172.21.15.149:0/4013069788 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:03.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.039+0000 7f5356ffd700 1 --2- 172.21.15.149:0/4013069788 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53580d0fe0 0x7f5358159750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:03.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.039+0000 7f53577fe700 1 --2- 172.21.15.149:0/4013069788 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53580cc9a0 0x7f535814f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:03.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.039+0000 7f5357fff700 1 -- 172.21.15.149:0/4013069788 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53580cc9a0 msgr2=0x7f535814f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:03.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.039+0000 7f5357fff700 1 --2- 172.21.15.149:0/4013069788 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53580cc9a0 0x7f535814f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:03.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.039+0000 7f5357fff700 1 -- 172.21.15.149:0/4013069788 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53580d0fe0 msgr2=0x7f5358159750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:03.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.039+0000 7f5357fff700 1 --2- 172.21.15.149:0/4013069788 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53580d0fe0 0x7f5358159750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:03.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.039+0000 7f5357fff700 1 -- 172.21.15.149:0/4013069788 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5350009b30 con 0x7f535815b950 2023-11-08T19:25:03.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.039+0000 7f5357fff700 1 --2- 172.21.15.149:0/4013069788 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f535815b950 0x7f5358159c90 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f535000b370 tx=0x7f5350004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:03.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.040+0000 7f533ffff700 1 -- 172.21.15.149:0/4013069788 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5350004880 con 0x7f535815b950 2023-11-08T19:25:03.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.040+0000 7f533ffff700 1 -- 172.21.15.149:0/4013069788 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53500092e0 con 0x7f535815b950 2023-11-08T19:25:03.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.040+0000 7f533ffff700 1 -- 172.21.15.149:0/4013069788 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535001c660 con 0x7f535815b950 2023-11-08T19:25:03.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.040+0000 7f535dd16700 1 -- 172.21.15.149:0/4013069788 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53581f5080 con 0x7f535815b950 2023-11-08T19:25:03.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.040+0000 7f535dd16700 1 -- 172.21.15.149:0/4013069788 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53581f5640 con 0x7f535815b950 2023-11-08T19:25:03.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.041+0000 7f535dd16700 1 -- 172.21.15.149:0/4013069788 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53580745f0 con 0x7f535815b950 2023-11-08T19:25:03.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.041+0000 7f533ffff700 1 -- 172.21.15.149:0/4013069788 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f535001c7c0 con 0x7f535815b950 2023-11-08T19:25:03.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.041+0000 7f533ffff700 1 --2- 172.21.15.149:0/4013069788 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f534406af00 0x7f534406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:03.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.042+0000 7f533ffff700 1 -- 172.21.15.149:0/4013069788 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f535008b130 con 0x7f535815b950 2023-11-08T19:25:03.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.042+0000 7f53577fe700 1 --2- 172.21.15.149:0/4013069788 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f534406af00 0x7f534406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:03.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.042+0000 7f53577fe700 1 --2- 172.21.15.149:0/4013069788 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f534406af00 0x7f534406d3c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5348000fb0 tx=0x7f5348009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:03.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.046+0000 7f533ffff700 1 -- 172.21.15.149:0/4013069788 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5350055fd0 con 0x7f535815b950 2023-11-08T19:25:03.288 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.287+0000 7f535dd16700 1 -- 172.21.15.149:0/4013069788 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f53580c8e10 con 0x7f535815b950 2023-11-08T19:25:03.289 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.288+0000 7f533ffff700 1 -- 172.21.15.149:0/4013069788 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) v1 ==== 53+0+73 (secure 0 0 0) 0x7f53500595f0 con 0x7f535815b950 2023-11-08T19:25:03.289 INFO:teuthology.orchestra.run.smithi149.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-08T19:25:03.291 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.290+0000 7f535dd16700 1 -- 172.21.15.149:0/4013069788 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f534406af00 msgr2=0x7f534406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:03.291 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.290+0000 7f535dd16700 1 --2- 172.21.15.149:0/4013069788 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f534406af00 0x7f534406d3c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5348000fb0 tx=0x7f5348009040 comp rx=0 tx=0).stop 2023-11-08T19:25:03.292 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.290+0000 7f535dd16700 1 -- 172.21.15.149:0/4013069788 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f535815b950 msgr2=0x7f5358159c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:03.292 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.290+0000 7f535dd16700 1 --2- 172.21.15.149:0/4013069788 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f535815b950 0x7f5358159c90 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f535000b370 tx=0x7f5350004ad0 comp rx=0 tx=0).stop 2023-11-08T19:25:03.292 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.290+0000 7f535dd16700 1 -- 172.21.15.149:0/4013069788 shutdown_connections 2023-11-08T19:25:03.292 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.290+0000 7f535dd16700 1 --2- 172.21.15.149:0/4013069788 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f534406af00 0x7f534406d3c0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:03.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.290+0000 7f535dd16700 1 --2- 172.21.15.149:0/4013069788 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f535815b950 0x7f5358159c90 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:03.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.290+0000 7f535dd16700 1 --2- 172.21.15.149:0/4013069788 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53580cc9a0 0x7f535814f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:03.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.290+0000 7f535dd16700 1 --2- 172.21.15.149:0/4013069788 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53580d0fe0 0x7f5358159750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:03.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.290+0000 7f535dd16700 1 -- 172.21.15.149:0/4013069788 >> 172.21.15.149:0/4013069788 conn(0x7f5358099a40 msgr2=0x7f53580c9070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:03.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.290+0000 7f535dd16700 1 -- 172.21.15.149:0/4013069788 shutdown_connections 2023-11-08T19:25:03.294 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:03.290+0000 7f535dd16700 1 -- 172.21.15.149:0/4013069788 wait complete. 2023-11-08T19:25:03.303 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-08T19:25:03.303 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-08T19:25:03.304 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi149.front.sepia.ceph.com 2023-11-08T19:25:03.304 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-08T19:25:03.304 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-08T19:25:03.305 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-08T19:25:03.305 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-08T19:25:03.305 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-08T19:25:03.306 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-08T19:25:03.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:25:03.307 DEBUG:teuthology.orchestra.run.smithi149:> ip addr 2023-11-08T19:25:03.324 INFO:teuthology.orchestra.run.smithi149.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-08T19:25:03.324 INFO:teuthology.orchestra.run.smithi149.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-08T19:25:03.324 INFO:teuthology.orchestra.run.smithi149.stdout: inet 127.0.0.1/8 scope host lo 2023-11-08T19:25:03.324 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:25:03.325 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 ::1/128 scope host 2023-11-08T19:25:03.325 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:25:03.325 INFO:teuthology.orchestra.run.smithi149.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-08T19:25:03.325 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a4 brd ff:ff:ff:ff:ff:ff 2023-11-08T19:25:03.325 INFO:teuthology.orchestra.run.smithi149.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-08T19:25:03.326 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a5 brd ff:ff:ff:ff:ff:ff 2023-11-08T19:25:03.326 INFO:teuthology.orchestra.run.smithi149.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-08T19:25:03.326 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:56 brd ff:ff:ff:ff:ff:ff 2023-11-08T19:25:03.326 INFO:teuthology.orchestra.run.smithi149.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-08T19:25:03.327 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:57 brd ff:ff:ff:ff:ff:ff 2023-11-08T19:25:03.327 INFO:teuthology.orchestra.run.smithi149.stdout: inet 172.21.15.149/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-08T19:25:03.327 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft 42290sec preferred_lft 42290sec 2023-11-08T19:25:03.327 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::a27d:6f0d:7890:36f/64 scope link noprefixroute 2023-11-08T19:25:03.327 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:25:03.328 INFO:teuthology.orchestra.run.smithi149.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-08T19:25:03.328 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 82:12:e7:85:4e:11 brd ff:ff:ff:ff:ff:ff 2023-11-08T19:25:03.328 INFO:teuthology.orchestra.run.smithi149.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-08T19:25:03.328 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:25:03.328 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::4c22:cdff:fed4:d829/64 scope link 2023-11-08T19:25:03.329 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:25:03.329 INFO:teuthology.orchestra.run.smithi149.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-08T19:25:03.329 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether e6:a6:23:51:6c:ef brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-08T19:25:03.329 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::e4a6:23ff:fe51:6cef/64 scope link 2023-11-08T19:25:03.329 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:25:03.330 INFO:teuthology.orchestra.run.smithi149.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-08T19:25:03.330 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 82:12:e7:85:4e:11 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-08T19:25:03.330 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::8012:e7ff:fe85:4e11/64 scope link 2023-11-08T19:25:03.330 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:25:03.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:25:03.331 DEBUG:teuthology.orchestra.run.smithi149:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-08T19:25:03.389 INFO:teuthology.orchestra.run.smithi149.stdout:1 2023-11-08T19:25:03.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:25:03.391 DEBUG:teuthology.orchestra.run.smithi149:> route 2023-11-08T19:25:03.450 INFO:teuthology.orchestra.run.smithi149.stdout:Kernel IP routing table 2023-11-08T19:25:03.450 INFO:teuthology.orchestra.run.smithi149.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-08T19:25:03.451 INFO:teuthology.orchestra.run.smithi149.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-08T19:25:03.451 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-08T19:25:03.451 INFO:teuthology.orchestra.run.smithi149.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-08T19:25:03.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:25:03.452 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec bash -c ' 2023-11-08T19:25:03.452 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2023-11-08T19:25:03.453 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-08T19:25:03.453 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-08T19:25:03.453 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-08T19:25:03.454 DEBUG:teuthology.orchestra.run.smithi149:> ') 2023-11-08T19:25:03.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:25:03.556 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2023-11-08T19:25:03.573 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-08T19:25:03.573 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-08T19:25:03.574 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-08T19:25:03.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:25:03.575 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set brx.0 up 2023-11-08T19:25:03.639 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-08T19:25:03.640 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-08T19:25:03.697 INFO:teuthology.orchestra.run.smithi149.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-08T19:25:03.697 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-08T19:25:03.697 DEBUG:teuthology.orchestra.run.smithi149:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-08T19:25:03.753 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-08T19:25:03.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:25:03.754 DEBUG:teuthology.orchestra.run.smithi149:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-08T19:25:03.838 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-08T19:25:03.838 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-08T19:25:03.838 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2023-11-08T19:25:03.847 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-08T19:25:03.847 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-08T19:25:03.847 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2023-11-08T19:25:03.847 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.149:3300,172.21.15.160:3300,172.21.15.160:3301" 2023-11-08T19:25:03.847 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-08T19:25:03.921 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-08T19:25:03.921 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-08T19:25:03.921 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2023-11-08T19:25:03.922 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.149:3300,172.21.15.160:3300,172.21.15.160:3301" 2023-11-08T19:25:03.922 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-08T19:25:03.922 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.149:6789,172.21.15.160:6789,172.21.15.160:6790" 2023-11-08T19:25:03.922 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.149:6789,172.21.15.160:6789,172.21.15.160:6790:/ 2023-11-08T19:25:03.923 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=0aba7c70-fe80-4446-a2f5-7502ac3adfb4" will pass to kernel 2023-11-08T19:25:03.924 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-08T19:25:03.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:25:03.926 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-08T19:25:03.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:25:03.954 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-08T19:25:04.040 INFO:teuthology.orchestra.run.smithi149.stdout:client5611 2023-11-08T19:25:04.041 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-11-08T19:25:04.041 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:25:04.058 DEBUG:teuthology.orchestra.run.smithi149:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data mksnap snap1 2023-11-08T19:25:04.141 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.140+0000 7f77034b4080 1 Processor -- start 2023-11-08T19:25:04.141 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.140+0000 7f77034b4080 1 -- start start 2023-11-08T19:25:04.145 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.140+0000 7f77034b4080 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5562cc8edaa0 0x5562cc918e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:04.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.140+0000 7f77034b4080 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5562cc9363d0 0x5562cc917e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:04.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.140+0000 7f77034b4080 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5562cc9c1470 0x5562cc8eb170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:04.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.140+0000 7f77034b4080 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562cc896520 con 0x5562cc9c1470 2023-11-08T19:25:04.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.140+0000 7f77034b4080 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562cc830740 con 0x5562cc9363d0 2023-11-08T19:25:04.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.140+0000 7f77034b4080 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x5562cc8303e0 con 0x5562cc8edaa0 2023-11-08T19:25:04.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.141+0000 7f76f9d4a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5562cc9c1470 0x5562cc8eb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:04.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.141+0000 7f76f9d4a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5562cc9c1470 0x5562cc8eb170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40546/0 (socket says 172.21.15.149:40546) 2023-11-08T19:25:04.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.141+0000 7f76f9d4a700 1 -- 172.21.15.149:0/3206713655 learned_addr learned my addr 172.21.15.149:0/3206713655 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:04.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.141+0000 7f76f9549700 1 --2- 172.21.15.149:0/3206713655 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5562cc8edaa0 0x5562cc918e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:04.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.141+0000 7f76f8d48700 1 --2- 172.21.15.149:0/3206713655 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5562cc9363d0 0x5562cc917e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:04.148 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.141+0000 7f76f9d4a700 1 -- 172.21.15.149:0/3206713655 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5562cc8edaa0 msgr2=0x5562cc918e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:04.148 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.141+0000 7f76f9d4a700 1 --2- 172.21.15.149:0/3206713655 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5562cc8edaa0 0x5562cc918e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:04.148 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.141+0000 7f76f9d4a700 1 -- 172.21.15.149:0/3206713655 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5562cc9363d0 msgr2=0x5562cc917e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:04.148 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.141+0000 7f76f9d4a700 1 --2- 172.21.15.149:0/3206713655 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5562cc9363d0 0x5562cc917e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:04.148 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.141+0000 7f76f9d4a700 1 -- 172.21.15.149:0/3206713655 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f400a1c0 con 0x5562cc9c1470 2023-11-08T19:25:04.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.141+0000 7f76f9d4a700 1 --2- 172.21.15.149:0/3206713655 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5562cc9c1470 0x5562cc8eb170 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f76f400a190 tx=0x7f76f400e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd983cc6b51f3cc9 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:04.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.141+0000 7f76eb7fe700 1 -- 172.21.15.149:0/3206713655 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f400e7d0 con 0x5562cc9c1470 2023-11-08T19:25:04.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.141+0000 7f76eb7fe700 1 -- 172.21.15.149:0/3206713655 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f400eaa0 con 0x5562cc9c1470 2023-11-08T19:25:04.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.141+0000 7f76eb7fe700 1 -- 172.21.15.149:0/3206713655 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f400ee30 con 0x5562cc9c1470 2023-11-08T19:25:04.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.142+0000 7f77034b4080 1 -- 172.21.15.149:0/3206713655 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5562cc9c1470 msgr2=0x5562cc8eb170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:04.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.142+0000 7f77034b4080 1 --2- 172.21.15.149:0/3206713655 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5562cc9c1470 0x5562cc8eb170 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f76f400a190 tx=0x7f76f400e000 comp rx=0 tx=0).stop 2023-11-08T19:25:04.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.142+0000 7f77034b4080 1 -- 172.21.15.149:0/3206713655 shutdown_connections 2023-11-08T19:25:04.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.142+0000 7f77034b4080 1 --2- 172.21.15.149:0/3206713655 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5562cc9c1470 0x5562cc8eb170 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:04.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.142+0000 7f77034b4080 1 --2- 172.21.15.149:0/3206713655 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5562cc8edaa0 0x5562cc918e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:04.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.142+0000 7f77034b4080 1 --2- 172.21.15.149:0/3206713655 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5562cc9363d0 0x5562cc917e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:04.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.142+0000 7f77034b4080 1 -- 172.21.15.149:0/3206713655 >> 172.21.15.149:0/3206713655 conn(0x5562cc9196d0 msgr2=0x5562cc9bd580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:04.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.142+0000 7f77034b4080 1 -- 172.21.15.149:0/3206713655 shutdown_connections 2023-11-08T19:25:04.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.142+0000 7f77034b4080 1 -- 172.21.15.149:0/3206713655 wait complete. 2023-11-08T19:25:04.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.142+0000 7f77034b4080 1 Processor -- start 2023-11-08T19:25:04.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.142+0000 7f77034b4080 1 -- start start 2023-11-08T19:25:04.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.143+0000 7f77034b4080 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5562cc8edaa0 0x5562cca51530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:04.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.143+0000 7f77034b4080 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5562cc9363d0 0x5562cc9af240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:04.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.143+0000 7f77034b4080 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5562cc9c1470 0x5562cc917c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:04.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.143+0000 7f77034b4080 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562cc824680 con 0x5562cc9c1470 2023-11-08T19:25:04.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.143+0000 7f77034b4080 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562cca51110 con 0x5562cc8edaa0 2023-11-08T19:25:04.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.143+0000 7f77034b4080 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x5562cc8ee180 con 0x5562cc9363d0 2023-11-08T19:25:04.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.143+0000 7f76f9d4a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5562cc9c1470 0x5562cc917c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:04.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.143+0000 7f76f9d4a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5562cc9c1470 0x5562cc917c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40552/0 (socket says 172.21.15.149:40552) 2023-11-08T19:25:04.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.143+0000 7f76f9d4a700 1 -- 172.21.15.149:0/3324150479 learned_addr learned my addr 172.21.15.149:0/3324150479 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:04.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.143+0000 7f76f8d48700 1 --2- 172.21.15.149:0/3324150479 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5562cc9363d0 0x5562cc9af240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:04.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.143+0000 7f76f9549700 1 --2- 172.21.15.149:0/3324150479 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5562cc8edaa0 0x5562cca51530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:04.154 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.143+0000 7f76f9d4a700 1 -- 172.21.15.149:0/3324150479 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5562cc9363d0 msgr2=0x5562cc9af240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:04.154 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.143+0000 7f76f9d4a700 1 --2- 172.21.15.149:0/3324150479 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5562cc9363d0 0x5562cc9af240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:04.154 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.143+0000 7f76f9d4a700 1 -- 172.21.15.149:0/3324150479 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5562cc8edaa0 msgr2=0x5562cca51530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:04.154 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.143+0000 7f76f9d4a700 1 --2- 172.21.15.149:0/3324150479 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5562cc8edaa0 0x5562cca51530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:04.154 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.143+0000 7f76f9d4a700 1 -- 172.21.15.149:0/3324150479 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5562cc8567c0 con 0x5562cc9c1470 2023-11-08T19:25:04.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.144+0000 7f76f9d4a700 1 --2- 172.21.15.149:0/3324150479 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5562cc9c1470 0x5562cc917c30 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x5562cc8ecc10 tx=0x7f76f4003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:04.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.144+0000 7f76ea7fc700 1 -- 172.21.15.149:0/3324150479 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f4029070 con 0x5562cc9c1470 2023-11-08T19:25:04.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.144+0000 7f76ea7fc700 1 -- 172.21.15.149:0/3324150479 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f4009030 con 0x5562cc9c1470 2023-11-08T19:25:04.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.144+0000 7f77034b4080 1 -- 172.21.15.149:0/3324150479 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5562cc83c7d0 con 0x5562cc9c1470 2023-11-08T19:25:04.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.144+0000 7f76ea7fc700 1 -- 172.21.15.149:0/3324150479 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f40248a0 con 0x5562cc9c1470 2023-11-08T19:25:04.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.144+0000 7f77034b4080 1 -- 172.21.15.149:0/3324150479 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5562cc82fb70 con 0x5562cc9c1470 2023-11-08T19:25:04.158 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-08T19:25:04.158 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.145+0000 7f76ea7fc700 1 -- 172.21.15.149:0/3324150479 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f76f4003040 con 0x5562cc9c1470 2023-11-08T19:25:04.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.145+0000 7f76ea7fc700 1 --2- 172.21.15.149:0/3324150479 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f76dc069820 0x7f76dc06bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:04.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.145+0000 7f76ea7fc700 1 -- 172.21.15.149:0/3324150479 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f76f408aa60 con 0x5562cc9c1470 2023-11-08T19:25:04.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.146+0000 7f76f9549700 1 --2- 172.21.15.149:0/3324150479 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f76dc069820 0x7f76dc06bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:04.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.146+0000 7f77034b4080 1 -- 172.21.15.149:0/3324150479 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- pool_op(create snap pool 9 tid 1 name snap1 v0) v4 -- 0x5562cc8a04a0 con 0x5562cc9c1470 2023-11-08T19:25:04.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.146+0000 7f76ea7fc700 1 -- 172.21.15.149:0/3324150479 <== mon.0 v2:172.21.15.149:3300/0 6 ==== pool_op_reply(tid 1 (95) Operation not supported v55) v1 ==== 43+0+0 (secure 0 0 0) 0x7f76f401f080 con 0x5562cc9c1470 2023-11-08T19:25:04.160 INFO:teuthology.orchestra.run.smithi149.stderr:error creating pool cephfs_data snapshot snap1: (95) Operation not supported 2023-11-08T19:25:04.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.146+0000 7f76f9549700 1 --2- 172.21.15.149:0/3324150479 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f76dc069820 0x7f76dc06bce0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x5562cca54460 tx=0x7f76f000e040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:04.161 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.146+0000 7f77034b4080 1 -- 172.21.15.149:0/3324150479 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f76dc069820 msgr2=0x7f76dc06bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:04.161 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.146+0000 7f77034b4080 1 --2- 172.21.15.149:0/3324150479 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f76dc069820 0x7f76dc06bce0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x5562cca54460 tx=0x7f76f000e040 comp rx=0 tx=0).stop 2023-11-08T19:25:04.161 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.146+0000 7f77034b4080 1 -- 172.21.15.149:0/3324150479 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5562cc9c1470 msgr2=0x5562cc917c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:04.161 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.146+0000 7f77034b4080 1 --2- 172.21.15.149:0/3324150479 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5562cc9c1470 0x5562cc917c30 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x5562cc8ecc10 tx=0x7f76f4003330 comp rx=0 tx=0).stop 2023-11-08T19:25:04.162 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.146+0000 7f77034b4080 1 -- 172.21.15.149:0/3324150479 shutdown_connections 2023-11-08T19:25:04.162 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.146+0000 7f77034b4080 1 --2- 172.21.15.149:0/3324150479 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f76dc069820 0x7f76dc06bce0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:04.162 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.146+0000 7f77034b4080 1 --2- 172.21.15.149:0/3324150479 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5562cc8edaa0 0x5562cca51530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:04.162 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.146+0000 7f77034b4080 1 --2- 172.21.15.149:0/3324150479 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5562cc9c1470 0x5562cc917c30 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:04.162 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.146+0000 7f77034b4080 1 --2- 172.21.15.149:0/3324150479 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5562cc9363d0 0x5562cc9af240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:04.163 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.146+0000 7f77034b4080 1 -- 172.21.15.149:0/3324150479 >> 172.21.15.149:0/3324150479 conn(0x5562cc9196d0 msgr2=0x5562cc8eb4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:04.163 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.146+0000 7f77034b4080 1 -- 172.21.15.149:0/3324150479 shutdown_connections 2023-11-08T19:25:04.163 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.146+0000 7f77034b4080 1 -- 172.21.15.149:0/3324150479 wait complete. 2023-11-08T19:25:04.164 DEBUG:teuthology.orchestra.run.smithi149:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata mksnap snap2 2023-11-08T19:25:04.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.241+0000 7f71961ef080 1 Processor -- start 2023-11-08T19:25:04.243 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.241+0000 7f71961ef080 1 -- start start 2023-11-08T19:25:04.247 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.242+0000 7f71961ef080 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55e744fc4d40 0x55e744fc4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:04.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.242+0000 7f71961ef080 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e74509e8d0 0x55e7450958d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:04.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.242+0000 7f71961ef080 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e74509ecb0 0x55e744fc3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:04.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.242+0000 7f71961ef080 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e744f6f520 con 0x55e74509ecb0 2023-11-08T19:25:04.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.242+0000 7f71961ef080 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e744f09740 con 0x55e74509e8d0 2023-11-08T19:25:04.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.242+0000 7f71961ef080 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e744f093e0 con 0x55e744fc4d40 2023-11-08T19:25:04.249 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.242+0000 7f718ca85700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e74509ecb0 0x55e744fc3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:04.249 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.242+0000 7f718ca85700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e74509ecb0 0x55e744fc3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40566/0 (socket says 172.21.15.149:40566) 2023-11-08T19:25:04.249 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.242+0000 7f718ca85700 1 -- 172.21.15.149:0/3427996619 learned_addr learned my addr 172.21.15.149:0/3427996619 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:04.249 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.242+0000 7f718c284700 1 --2- 172.21.15.149:0/3427996619 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55e744fc4d40 0x55e744fc4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:04.250 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.242+0000 7f718ba83700 1 --2- 172.21.15.149:0/3427996619 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e74509e8d0 0x55e7450958d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:04.250 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.242+0000 7f718ca85700 1 -- 172.21.15.149:0/3427996619 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55e744fc4d40 msgr2=0x55e744fc4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:04.250 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.242+0000 7f718ca85700 1 --2- 172.21.15.149:0/3427996619 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55e744fc4d40 0x55e744fc4590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:04.251 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.242+0000 7f718ca85700 1 -- 172.21.15.149:0/3427996619 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e74509e8d0 msgr2=0x55e7450958d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:04.251 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.242+0000 7f718ca85700 1 --2- 172.21.15.149:0/3427996619 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e74509e8d0 0x55e7450958d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:04.251 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.242+0000 7f718ca85700 1 -- 172.21.15.149:0/3427996619 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7184005de0 con 0x55e74509ecb0 2023-11-08T19:25:04.251 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.242+0000 7f718ba83700 1 --2- 172.21.15.149:0/3427996619 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e74509e8d0 0x55e7450958d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:25:04.251 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.243+0000 7f718ca85700 1 --2- 172.21.15.149:0/3427996619 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e74509ecb0 0x55e744fc3290 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x55e744fc6d50 tx=0x7f718400d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9d961d495e96476 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:04.252 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.243+0000 7f718aa81700 1 -- 172.21.15.149:0/3427996619 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7184008960 con 0x55e74509ecb0 2023-11-08T19:25:04.252 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.243+0000 7f718aa81700 1 -- 172.21.15.149:0/3427996619 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7184008ac0 con 0x55e74509ecb0 2023-11-08T19:25:04.252 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.243+0000 7f718aa81700 1 -- 172.21.15.149:0/3427996619 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7184008e50 con 0x55e74509ecb0 2023-11-08T19:25:04.252 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.243+0000 7f71961ef080 1 -- 172.21.15.149:0/3427996619 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e74509ecb0 msgr2=0x55e744fc3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:04.253 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.243+0000 7f71961ef080 1 --2- 172.21.15.149:0/3427996619 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e74509ecb0 0x55e744fc3290 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x55e744fc6d50 tx=0x7f718400d000 comp rx=0 tx=0).stop 2023-11-08T19:25:04.253 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.243+0000 7f71961ef080 1 -- 172.21.15.149:0/3427996619 shutdown_connections 2023-11-08T19:25:04.253 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.243+0000 7f71961ef080 1 --2- 172.21.15.149:0/3427996619 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e74509ecb0 0x55e744fc3290 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:04.253 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.243+0000 7f71961ef080 1 --2- 172.21.15.149:0/3427996619 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55e744fc4d40 0x55e744fc4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:04.253 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.243+0000 7f71961ef080 1 --2- 172.21.15.149:0/3427996619 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e74509e8d0 0x55e7450958d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:04.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.243+0000 7f71961ef080 1 -- 172.21.15.149:0/3427996619 >> 172.21.15.149:0/3427996619 conn(0x55e74500ccb0 msgr2=0x55e744ff5180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:04.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.243+0000 7f71961ef080 1 -- 172.21.15.149:0/3427996619 shutdown_connections 2023-11-08T19:25:04.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.243+0000 7f71961ef080 1 -- 172.21.15.149:0/3427996619 wait complete. 2023-11-08T19:25:04.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.244+0000 7f71961ef080 1 Processor -- start 2023-11-08T19:25:04.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.244+0000 7f71961ef080 1 -- start start 2023-11-08T19:25:04.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.244+0000 7f71961ef080 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e744fc4d40 0x55e745094930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:04.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.245+0000 7f71961ef080 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55e74509e8d0 0x55e744fc3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:04.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.245+0000 7f71961ef080 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e74509ecb0 0x55e744fc37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:04.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.245+0000 7f71961ef080 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e744efd680 con 0x55e74509ecb0 2023-11-08T19:25:04.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.245+0000 7f71961ef080 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e745098c90 con 0x55e744fc4d40 2023-11-08T19:25:04.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.245+0000 7f71961ef080 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e7450980a0 con 0x55e74509e8d0 2023-11-08T19:25:04.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.245+0000 7f718ca85700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e74509ecb0 0x55e744fc37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:04.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.245+0000 7f718ca85700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e74509ecb0 0x55e744fc37d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40572/0 (socket says 172.21.15.149:40572) 2023-11-08T19:25:04.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.245+0000 7f718ca85700 1 -- 172.21.15.149:0/3732620756 learned_addr learned my addr 172.21.15.149:0/3732620756 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:04.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.245+0000 7f718c284700 1 --2- 172.21.15.149:0/3732620756 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e744fc4d40 0x55e745094930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:04.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.245+0000 7f718ba83700 1 --2- 172.21.15.149:0/3732620756 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55e74509e8d0 0x55e744fc3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:04.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.245+0000 7f718ca85700 1 -- 172.21.15.149:0/3732620756 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55e74509e8d0 msgr2=0x55e744fc3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:04.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.245+0000 7f718ca85700 1 --2- 172.21.15.149:0/3732620756 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55e74509e8d0 0x55e744fc3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:04.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.245+0000 7f718ca85700 1 -- 172.21.15.149:0/3732620756 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e744fc4d40 msgr2=0x55e745094930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:04.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.245+0000 7f718ca85700 1 --2- 172.21.15.149:0/3732620756 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e744fc4d40 0x55e745094930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:04.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.245+0000 7f718ca85700 1 -- 172.21.15.149:0/3732620756 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e744f2f7c0 con 0x55e74509ecb0 2023-11-08T19:25:04.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.245+0000 7f718ca85700 1 --2- 172.21.15.149:0/3732620756 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e74509ecb0 0x55e744fc37d0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f718400c010 tx=0x7f7184002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:04.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.245+0000 7f7189a7f700 1 -- 172.21.15.149:0/3732620756 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7184008960 con 0x55e74509ecb0 2023-11-08T19:25:04.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.245+0000 7f7189a7f700 1 -- 172.21.15.149:0/3732620756 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f718401c850 con 0x55e74509ecb0 2023-11-08T19:25:04.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.245+0000 7f71961ef080 1 -- 172.21.15.149:0/3732620756 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e744f157d0 con 0x55e74509ecb0 2023-11-08T19:25:04.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.245+0000 7f7189a7f700 1 -- 172.21.15.149:0/3732620756 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718401cc00 con 0x55e74509ecb0 2023-11-08T19:25:04.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.245+0000 7f71961ef080 1 -- 172.21.15.149:0/3732620756 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e744f08b70 con 0x55e74509ecb0 2023-11-08T19:25:04.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.247+0000 7f7189a7f700 1 -- 172.21.15.149:0/3732620756 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f718402e480 con 0x55e74509ecb0 2023-11-08T19:25:04.261 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-08T19:25:04.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.247+0000 7f7189a7f700 1 --2- 172.21.15.149:0/3732620756 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f7178069820 0x7f717806bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:04.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.247+0000 7f7189a7f700 1 -- 172.21.15.149:0/3732620756 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f7184029070 con 0x55e74509ecb0 2023-11-08T19:25:04.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.247+0000 7f718c284700 1 --2- 172.21.15.149:0/3732620756 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f7178069820 0x7f717806bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:04.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.247+0000 7f71961ef080 1 -- 172.21.15.149:0/3732620756 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- pool_op(create snap pool 8 tid 1 name snap2 v0) v4 -- 0x55e744f794a0 con 0x55e74509ecb0 2023-11-08T19:25:04.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.247+0000 7f7189a7f700 1 -- 172.21.15.149:0/3732620756 <== mon.0 v2:172.21.15.149:3300/0 6 ==== pool_op_reply(tid 1 (95) Operation not supported v55) v1 ==== 43+0+0 (secure 0 0 0) 0x7f7184055ed0 con 0x55e74509ecb0 2023-11-08T19:25:04.263 INFO:teuthology.orchestra.run.smithi149.stderr:error creating pool cephfs_metadata snapshot snap2: (95) Operation not supported 2023-11-08T19:25:04.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.247+0000 7f71961ef080 1 -- 172.21.15.149:0/3732620756 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f7178069820 msgr2=0x7f717806bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:04.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.247+0000 7f71961ef080 1 --2- 172.21.15.149:0/3732620756 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f7178069820 0x7f717806bce0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0x7f717c002650 tx=0x7f717c006ac0 comp rx=0 tx=0).stop 2023-11-08T19:25:04.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.247+0000 7f71961ef080 1 -- 172.21.15.149:0/3732620756 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e74509ecb0 msgr2=0x55e744fc37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:04.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.247+0000 7f71961ef080 1 --2- 172.21.15.149:0/3732620756 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e74509ecb0 0x55e744fc37d0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f718400c010 tx=0x7f7184002fb0 comp rx=0 tx=0).stop 2023-11-08T19:25:04.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.248+0000 7f71961ef080 1 -- 172.21.15.149:0/3732620756 shutdown_connections 2023-11-08T19:25:04.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.248+0000 7f71961ef080 1 --2- 172.21.15.149:0/3732620756 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f7178069820 0x7f717806bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:04.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.248+0000 7f71961ef080 1 --2- 172.21.15.149:0/3732620756 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e744fc4d40 0x55e745094930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:04.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.248+0000 7f71961ef080 1 --2- 172.21.15.149:0/3732620756 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e74509ecb0 0x55e744fc37d0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:04.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.248+0000 7f71961ef080 1 --2- 172.21.15.149:0/3732620756 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55e74509e8d0 0x55e744fc3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:04.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.248+0000 7f71961ef080 1 -- 172.21.15.149:0/3732620756 >> 172.21.15.149:0/3732620756 conn(0x55e74500ccb0 msgr2=0x55e7450057e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:04.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.248+0000 7f71961ef080 1 -- 172.21.15.149:0/3732620756 shutdown_connections 2023-11-08T19:25:04.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.248+0000 7f71961ef080 1 -- 172.21.15.149:0/3732620756 wait complete. 2023-11-08T19:25:04.266 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool mksnap cephfs_data snap3 2023-11-08T19:25:04.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.425+0000 7f7a90c79700 1 Processor -- start 2023-11-08T19:25:04.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.425+0000 7f7a90c79700 1 -- start start 2023-11-08T19:25:04.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.426+0000 7f7a90c79700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f7a8c15abf0 0x7f7a8c0b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:04.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.426+0000 7f7a90c79700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a8c0b6470 con 0x7f7a8c0d1130 2023-11-08T19:25:04.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.426+0000 7f7a90c79700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a8c15afd0 con 0x7f7a8c0cc870 2023-11-08T19:25:04.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.426+0000 7f7a90c79700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a8c0b66a0 con 0x7f7a8c15abf0 2023-11-08T19:25:04.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.427+0000 7f7a8a59c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f7a8c15abf0 0x7f7a8c0b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:04.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.427+0000 7f7a8a59c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f7a8c15abf0 0x7f7a8c0b5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40576/0 (socket says 172.21.15.149:40576) 2023-11-08T19:25:04.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.427+0000 7f7a89d9b700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f7a8c0d1130 0x7f7a8c0cc160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:42578/0 (socket says 172.21.15.149:42578) 2023-11-08T19:25:04.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.427+0000 7f7a8a59c700 1 -- 172.21.15.149:0/1482146272 learned_addr learned my addr 172.21.15.149:0/1482146272 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:04.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.427+0000 7f7a8a59c700 1 -- 172.21.15.149:0/1482146272 >> v1:172.21.15.160:6789/0 conn(0x7f7a8c0cc870 legacy=0x7f7a8c06bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:04.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.427+0000 7f7a8a59c700 1 -- 172.21.15.149:0/1482146272 >> v1:172.21.15.149:6789/0 conn(0x7f7a8c0d1130 legacy=0x7f7a8c0cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:04.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.427+0000 7f7a8a59c700 1 -- 172.21.15.149:0/1482146272 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a8c15e880 con 0x7f7a8c15abf0 2023-11-08T19:25:04.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.427+0000 7f7a8959a700 1 -- 172.21.15.149:0/1482146272 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2540165615 0 0) 0x7f7a8c0b6470 con 0x7f7a8c0d1130 2023-11-08T19:25:04.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.427+0000 7f7a8a59c700 1 --2- 172.21.15.149:0/1482146272 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a8c15abf0 0x7f7a8c0b5f30 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f7a800098f0 tx=0x7f7a80009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e4be07cb5d052de server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:04.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.427+0000 7f7a8959a700 1 -- 172.21.15.149:0/1482146272 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a80004230 con 0x7f7a8c15abf0 2023-11-08T19:25:04.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.427+0000 7f7a8959a700 1 -- 172.21.15.149:0/1482146272 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a80004390 con 0x7f7a8c15abf0 2023-11-08T19:25:04.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.427+0000 7f7a8959a700 1 -- 172.21.15.149:0/1482146272 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a800036a0 con 0x7f7a8c15abf0 2023-11-08T19:25:04.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.428+0000 7f7a90c79700 1 -- 172.21.15.149:0/1482146272 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a8c15abf0 msgr2=0x7f7a8c0b5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:04.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.428+0000 7f7a90c79700 1 --2- 172.21.15.149:0/1482146272 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a8c15abf0 0x7f7a8c0b5f30 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f7a800098f0 tx=0x7f7a80009c00 comp rx=0 tx=0).stop 2023-11-08T19:25:04.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.428+0000 7f7a90c79700 1 -- 172.21.15.149:0/1482146272 shutdown_connections 2023-11-08T19:25:04.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.428+0000 7f7a90c79700 1 --2- 172.21.15.149:0/1482146272 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a8c15abf0 0x7f7a8c0b5f30 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:04.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.428+0000 7f7a90c79700 1 -- 172.21.15.149:0/1482146272 >> 172.21.15.149:0/1482146272 conn(0x7f7a8c0d0640 msgr2=0x7f7a8c0d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:04.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.428+0000 7f7a90c79700 1 -- 172.21.15.149:0/1482146272 shutdown_connections 2023-11-08T19:25:04.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.428+0000 7f7a90c79700 1 -- 172.21.15.149:0/1482146272 wait complete. 2023-11-08T19:25:04.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.429+0000 7f7a90c79700 1 Processor -- start 2023-11-08T19:25:04.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.429+0000 7f7a90c79700 1 -- start start 2023-11-08T19:25:04.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.430+0000 7f7a90c79700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7a8c0cc870 0x7f7a8c14e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:04.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.430+0000 7f7a90c79700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a8c0d1130 0x7f7a8c15d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:04.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.430+0000 7f7a90c79700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7a8c15abf0 0x7f7a8c15d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:04.438 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.430+0000 7f7a90c79700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8c0c9010 con 0x7f7a8c0d1130 2023-11-08T19:25:04.438 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.430+0000 7f7a90c79700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8c0c9220 con 0x7f7a8c0cc870 2023-11-08T19:25:04.438 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.430+0000 7f7a90c79700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8c0c9500 con 0x7f7a8c15abf0 2023-11-08T19:25:04.438 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.430+0000 7f7a89d9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a8c0d1130 0x7f7a8c15d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:04.439 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.430+0000 7f7a89d9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a8c0d1130 0x7f7a8c15d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40582/0 (socket says 172.21.15.149:40582) 2023-11-08T19:25:04.439 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.430+0000 7f7a89d9b700 1 -- 172.21.15.149:0/553414412 learned_addr learned my addr 172.21.15.149:0/553414412 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:04.439 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.430+0000 7f7a8a59c700 1 --2- 172.21.15.149:0/553414412 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7a8c0cc870 0x7f7a8c14e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:04.439 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.430+0000 7f7a8ad9d700 1 --2- 172.21.15.149:0/553414412 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7a8c15abf0 0x7f7a8c15d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:04.439 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.430+0000 7f7a89d9b700 1 -- 172.21.15.149:0/553414412 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7a8c15abf0 msgr2=0x7f7a8c15d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:04.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.430+0000 7f7a89d9b700 1 --2- 172.21.15.149:0/553414412 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7a8c15abf0 0x7f7a8c15d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:04.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.430+0000 7f7a89d9b700 1 -- 172.21.15.149:0/553414412 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7a8c0cc870 msgr2=0x7f7a8c14e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:04.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.430+0000 7f7a89d9b700 1 --2- 172.21.15.149:0/553414412 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7a8c0cc870 0x7f7a8c14e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:04.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.430+0000 7f7a89d9b700 1 -- 172.21.15.149:0/553414412 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a80009550 con 0x7f7a8c0d1130 2023-11-08T19:25:04.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.430+0000 7f7a8a59c700 1 --2- 172.21.15.149:0/553414412 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7a8c0cc870 0x7f7a8c14e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:25:04.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.430+0000 7f7a89d9b700 1 --2- 172.21.15.149:0/553414412 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a8c0d1130 0x7f7a8c15d3d0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c00c550 tx=0x7f7a7c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:04.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.431+0000 7f7a7affd700 1 -- 172.21.15.149:0/553414412 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7c004c80 con 0x7f7a8c0d1130 2023-11-08T19:25:04.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.431+0000 7f7a7affd700 1 -- 172.21.15.149:0/553414412 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a7c004e00 con 0x7f7a8c0d1130 2023-11-08T19:25:04.443 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.431+0000 7f7a90c79700 1 -- 172.21.15.149:0/553414412 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a8c0c97e0 con 0x7f7a8c0d1130 2023-11-08T19:25:04.443 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.431+0000 7f7a7affd700 1 -- 172.21.15.149:0/553414412 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7c007310 con 0x7f7a8c0d1130 2023-11-08T19:25:04.443 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.431+0000 7f7a90c79700 1 -- 172.21.15.149:0/553414412 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a8c14f630 con 0x7f7a8c0d1130 2023-11-08T19:25:04.443 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.432+0000 7f7a90c79700 1 -- 172.21.15.149:0/553414412 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a8c0c9360 con 0x7f7a8c0d1130 2023-11-08T19:25:04.443 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.432+0000 7f7a7affd700 1 -- 172.21.15.149:0/553414412 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7a7c007470 con 0x7f7a8c0d1130 2023-11-08T19:25:04.443 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.433+0000 7f7a7affd700 1 --2- 172.21.15.149:0/553414412 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f7a6c06af00 0x7f7a6c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:04.444 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.433+0000 7f7a7affd700 1 -- 172.21.15.149:0/553414412 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f7a7c0894e0 con 0x7f7a8c0d1130 2023-11-08T19:25:04.444 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.433+0000 7f7a8a59c700 1 --2- 172.21.15.149:0/553414412 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f7a6c06af00 0x7f7a6c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:04.444 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.433+0000 7f7a8a59c700 1 --2- 172.21.15.149:0/553414412 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f7a6c06af00 0x7f7a6c06d3c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f7a80009130 tx=0x7f7a80008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:04.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.437+0000 7f7a7affd700 1 -- 172.21.15.149:0/553414412 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7a8c0c9360 con 0x7f7a8c0d1130 2023-11-08T19:25:04.629 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.628+0000 7f7a90c79700 1 -- 172.21.15.149:0/553414412 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool mksnap", "pool": "cephfs_data", "snap": "snap3"} v 0) v1 -- 0x7f7a8c0c9d00 con 0x7f7a8c0d1130 2023-11-08T19:25:04.630 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.629+0000 7f7a7affd700 1 -- 172.21.15.149:0/553414412 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool mksnap", "pool": "cephfs_data", "snap": "snap3"}]=-95 (95) Operation not supported v55) v1 ==== 131+0+0 (secure 0 0 0) 0x7f7a8c0c9d00 con 0x7f7a8c0d1130 2023-11-08T19:25:04.631 INFO:teuthology.orchestra.run.smithi149.stderr:Error ENOTSUP: (95) Operation not supported 2023-11-08T19:25:04.635 DEBUG:teuthology.orchestra.run:got remote process result: 95 2023-11-08T19:25:04.636 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool mksnap cephfs_metadata snap4 2023-11-08T19:25:04.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.758+0000 7f13c6e3f700 1 Processor -- start 2023-11-08T19:25:04.760 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.758+0000 7f13c6e3f700 1 -- start start 2023-11-08T19:25:04.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.759+0000 7f13c6e3f700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f13c015abf0 0x7f13c00b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:04.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.759+0000 7f13c6e3f700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f13c00d1130 0x7f13c00cc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:04.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.759+0000 7f13c6e3f700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13c00b6470 con 0x7f13c00cc6a0 2023-11-08T19:25:04.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.759+0000 7f13c6e3f700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13c00b66a0 con 0x7f13c015abf0 2023-11-08T19:25:04.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.759+0000 7f13c6e3f700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13c00d04a0 con 0x7f13c00d1130 2023-11-08T19:25:04.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.759+0000 7f13c4bdb700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f13c015abf0 0x7f13c00b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:04.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.759+0000 7f13c53dc700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f13c00cc6a0 0x7f13c00ce210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:42594/0 (socket says 172.21.15.149:42594) 2023-11-08T19:25:04.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.759+0000 7f13c4bdb700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f13c015abf0 0x7f13c00b5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40588/0 (socket says 172.21.15.149:40588) 2023-11-08T19:25:04.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.759+0000 7f13c53dc700 1 -- 172.21.15.149:0/1165509700 learned_addr learned my addr 172.21.15.149:0/1165509700 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:25:04.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.759+0000 7f13bffff700 1 --2- 172.21.15.149:0/1165509700 >> v2:172.21.15.160:3300/0 conn(0x7f13c00d1130 0x7f13c00cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:04.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.759+0000 7f13c4bdb700 1 -- 172.21.15.149:0/1165509700 >> v2:172.21.15.160:3300/0 conn(0x7f13c00d1130 msgr2=0x7f13c00cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:04.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.759+0000 7f13c4bdb700 1 --2- 172.21.15.149:0/1165509700 >> v2:172.21.15.160:3300/0 conn(0x7f13c00d1130 0x7f13c00cc160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:04.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.759+0000 7f13c4bdb700 1 -- 172.21.15.149:0/1165509700 >> v1:172.21.15.149:6789/0 conn(0x7f13c00cc6a0 legacy=0x7f13c00ce210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:04.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.759+0000 7f13c4bdb700 1 -- 172.21.15.149:0/1165509700 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13c015afd0 con 0x7f13c015abf0 2023-11-08T19:25:04.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.759+0000 7f13bf7fe700 1 -- 172.21.15.149:0/1165509700 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2311864608 0 0) 0x7f13c00b6470 con 0x7f13c00cc6a0 2023-11-08T19:25:04.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.760+0000 7f13c4bdb700 1 --2- 172.21.15.149:0/1165509700 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13c015abf0 0x7f13c00b5f30 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f13c006d910 tx=0x7f13b4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bd305ea27082a7c server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:04.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.760+0000 7f13bf7fe700 1 -- 172.21.15.149:0/1165509700 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b4011830 con 0x7f13c015abf0 2023-11-08T19:25:04.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.760+0000 7f13bf7fe700 1 -- 172.21.15.149:0/1165509700 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13b4011990 con 0x7f13c015abf0 2023-11-08T19:25:04.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.760+0000 7f13bf7fe700 1 -- 172.21.15.149:0/1165509700 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b4011d20 con 0x7f13c015abf0 2023-11-08T19:25:04.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.760+0000 7f13c6e3f700 1 -- 172.21.15.149:0/1165509700 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13c015abf0 msgr2=0x7f13c00b5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:04.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.760+0000 7f13c6e3f700 1 --2- 172.21.15.149:0/1165509700 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13c015abf0 0x7f13c00b5f30 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f13c006d910 tx=0x7f13b4009b20 comp rx=0 tx=0).stop 2023-11-08T19:25:04.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.760+0000 7f13c6e3f700 1 -- 172.21.15.149:0/1165509700 shutdown_connections 2023-11-08T19:25:04.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.760+0000 7f13c6e3f700 1 --2- 172.21.15.149:0/1165509700 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13c015abf0 0x7f13c00b5f30 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:04.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.760+0000 7f13c6e3f700 1 --2- 172.21.15.149:0/1165509700 >> v2:172.21.15.160:3300/0 conn(0x7f13c00d1130 0x7f13c00cc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:04.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.760+0000 7f13c6e3f700 1 -- 172.21.15.149:0/1165509700 >> 172.21.15.149:0/1165509700 conn(0x7f13c00d0640 msgr2=0x7f13c00d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:04.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.760+0000 7f13c6e3f700 1 -- 172.21.15.149:0/1165509700 shutdown_connections 2023-11-08T19:25:04.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.760+0000 7f13c6e3f700 1 -- 172.21.15.149:0/1165509700 wait complete. 2023-11-08T19:25:04.770 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.762+0000 7f13c6e3f700 1 Processor -- start 2023-11-08T19:25:04.770 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.762+0000 7f13c6e3f700 1 -- start start 2023-11-08T19:25:04.770 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.763+0000 7f13c6e3f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13c00cc6a0 0x7f13c00ce460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:04.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.763+0000 7f13c6e3f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13c00d1130 0x7f13c01f19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:04.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.763+0000 7f13c6e3f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f13c015abf0 0x7f13c00b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:04.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.763+0000 7f13c6e3f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c00c8b00 con 0x7f13c00d1130 2023-11-08T19:25:04.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.763+0000 7f13c6e3f700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c00c8de0 con 0x7f13c00cc6a0 2023-11-08T19:25:04.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.763+0000 7f13c6e3f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13c00c90c0 con 0x7f13c015abf0 2023-11-08T19:25:04.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.763+0000 7f13bffff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13c00d1130 0x7f13c01f19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:04.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.763+0000 7f13bffff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13c00d1130 0x7f13c01f19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40594/0 (socket says 172.21.15.149:40594) 2023-11-08T19:25:04.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.763+0000 7f13bffff700 1 -- 172.21.15.149:0/3461550177 learned_addr learned my addr 172.21.15.149:0/3461550177 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:04.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.763+0000 7f13c53dc700 1 --2- 172.21.15.149:0/3461550177 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f13c015abf0 0x7f13c00b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:04.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.763+0000 7f13c4bdb700 1 --2- 172.21.15.149:0/3461550177 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13c00cc6a0 0x7f13c00ce460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:04.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.763+0000 7f13bffff700 1 -- 172.21.15.149:0/3461550177 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f13c015abf0 msgr2=0x7f13c00b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:04.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.763+0000 7f13bffff700 1 --2- 172.21.15.149:0/3461550177 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f13c015abf0 0x7f13c00b5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:04.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.763+0000 7f13bffff700 1 -- 172.21.15.149:0/3461550177 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13c00cc6a0 msgr2=0x7f13c00ce460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:04.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.763+0000 7f13bffff700 1 --2- 172.21.15.149:0/3461550177 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13c00cc6a0 0x7f13c00ce460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:04.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.763+0000 7f13bffff700 1 -- 172.21.15.149:0/3461550177 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13b40094a0 con 0x7f13c00d1130 2023-11-08T19:25:04.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.763+0000 7f13c4bdb700 1 --2- 172.21.15.149:0/3461550177 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13c00cc6a0 0x7f13c00ce460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:25:04.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.764+0000 7f13bffff700 1 --2- 172.21.15.149:0/3461550177 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13c00d1130 0x7f13c01f19a0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f13ac00e810 tx=0x7f13ac00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:04.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.764+0000 7f13bd7fa700 1 -- 172.21.15.149:0/3461550177 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13ac013610 con 0x7f13c00d1130 2023-11-08T19:25:04.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.764+0000 7f13bd7fa700 1 -- 172.21.15.149:0/3461550177 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13ac013770 con 0x7f13c00d1130 2023-11-08T19:25:04.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.764+0000 7f13c6e3f700 1 -- 172.21.15.149:0/3461550177 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13c00c93a0 con 0x7f13c00d1130 2023-11-08T19:25:04.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.764+0000 7f13bd7fa700 1 -- 172.21.15.149:0/3461550177 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13ac013b20 con 0x7f13c00d1130 2023-11-08T19:25:04.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.764+0000 7f13c6e3f700 1 -- 172.21.15.149:0/3461550177 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13c00c8760 con 0x7f13c00d1130 2023-11-08T19:25:04.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.765+0000 7f13c6e3f700 1 -- 172.21.15.149:0/3461550177 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13c00c98c0 con 0x7f13c00d1130 2023-11-08T19:25:04.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.765+0000 7f13bd7fa700 1 -- 172.21.15.149:0/3461550177 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f13ac013c80 con 0x7f13c00d1130 2023-11-08T19:25:04.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.766+0000 7f13bd7fa700 1 --2- 172.21.15.149:0/3461550177 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f13a406af00 0x7f13a406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:04.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.766+0000 7f13bd7fa700 1 -- 172.21.15.149:0/3461550177 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f13ac089510 con 0x7f13c00d1130 2023-11-08T19:25:04.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.766+0000 7f13c4bdb700 1 --2- 172.21.15.149:0/3461550177 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f13a406af00 0x7f13a406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:04.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.766+0000 7f13c4bdb700 1 --2- 172.21.15.149:0/3461550177 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f13a406af00 0x7f13a406d3c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f13b40090b0 tx=0x7f13b4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:04.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.770+0000 7f13bd7fa700 1 -- 172.21.15.149:0/3461550177 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f13c00c98c0 con 0x7f13c00d1130 2023-11-08T19:25:04.961 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.959+0000 7f13c6e3f700 1 -- 172.21.15.149:0/3461550177 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool mksnap", "pool": "cephfs_metadata", "snap": "snap4"} v 0) v1 -- 0x7f13c00c98c0 con 0x7f13c00d1130 2023-11-08T19:25:04.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:04.961+0000 7f13bd7fa700 1 -- 172.21.15.149:0/3461550177 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool mksnap", "pool": "cephfs_metadata", "snap": "snap4"}]=-95 (95) Operation not supported v55) v1 ==== 135+0+0 (secure 0 0 0) 0x7f13c00c98c0 con 0x7f13c00d1130 2023-11-08T19:25:04.964 INFO:teuthology.orchestra.run.smithi149.stderr:Error ENOTSUP: (95) Operation not supported 2023-11-08T19:25:04.968 DEBUG:teuthology.orchestra.run:got remote process result: 95 2023-11-08T19:25:04.969 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-08T19:25:04.969 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-08T19:25:05.014 DEBUG:teuthology.orchestra.run.smithi160:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-08T19:25:05.061 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-08T19:25:05.062 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-11-08T19:25:05.062 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:25:05.080 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-11-08T19:25:05.080 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:25:05.137 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:25:05.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.296+0000 7ff26fef5700 1 Processor -- start 2023-11-08T19:25:05.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.296+0000 7ff26fef5700 1 -- start start 2023-11-08T19:25:05.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.297+0000 7ff26fef5700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff2680cd5e0 0x7ff2680cfd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:05.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.297+0000 7ff26fef5700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2680cc2e0 con 0x7ff2680ce840 2023-11-08T19:25:05.302 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.297+0000 7ff26fef5700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2680cc580 con 0x7ff26815b950 2023-11-08T19:25:05.302 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.297+0000 7ff26fef5700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2680cc820 con 0x7ff2680cd5e0 2023-11-08T19:25:05.302 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.297+0000 7ff26e492700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7ff2680ce840 0x7ff2680d0260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:42608/0 (socket says 172.21.15.149:42608) 2023-11-08T19:25:05.302 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.297+0000 7ff26e492700 1 -- 172.21.15.149:0/1026469076 learned_addr learned my addr 172.21.15.149:0/1026469076 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:25:05.302 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.297+0000 7ff26d490700 1 --2- 172.21.15.149:0/1026469076 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff2680cd5e0 0x7ff2680cfd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:05.303 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.297+0000 7ff26cc8f700 1 -- 172.21.15.149:0/1026469076 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4238267279 0 0) 0x7ff2680cc2e0 con 0x7ff2680ce840 2023-11-08T19:25:05.303 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.297+0000 7ff26cc8f700 1 -- 172.21.15.149:0/1026469076 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2540035b0 con 0x7ff2680ce840 2023-11-08T19:25:05.303 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.297+0000 7ff26cc8f700 1 -- 172.21.15.149:0/1026469076 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2102121499 0 0) 0x7ff2540035b0 con 0x7ff2680ce840 2023-11-08T19:25:05.303 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.297+0000 7ff26cc8f700 1 -- 172.21.15.149:0/1026469076 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff2680cd5e0 msgr2=0x7ff2680cfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:05.304 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.297+0000 7ff26cc8f700 1 --2- 172.21.15.149:0/1026469076 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff2680cd5e0 0x7ff2680cfd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:05.304 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.297+0000 7ff26cc8f700 1 -- 172.21.15.149:0/1026469076 >> v1:172.21.15.160:6789/0 conn(0x7ff26815b950 legacy=0x7ff2680ce130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:05.304 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.297+0000 7ff26cc8f700 1 -- 172.21.15.149:0/1026469076 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2680ccb00 con 0x7ff2680ce840 2023-11-08T19:25:05.304 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.297+0000 7ff26cc8f700 1 -- 172.21.15.149:0/1026469076 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7ff2640019f0 con 0x7ff2680ce840 2023-11-08T19:25:05.304 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.297+0000 7ff26cc8f700 1 -- 172.21.15.149:0/1026469076 >> v1:172.21.15.149:6789/0 conn(0x7ff2680ce840 legacy=0x7ff2680d0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:05.305 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.297+0000 7ff26cc8f700 1 --2- 172.21.15.149:0/1026469076 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff254003a30 0x7ff254003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:05.305 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.297+0000 7ff26cc8f700 1 --2- 172.21.15.149:0/1026469076 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff254004390 0x7ff254004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:05.305 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.297+0000 7ff26cc8f700 1 --2- 172.21.15.149:0/1026469076 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff254005070 0x7ff25400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:05.305 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.297+0000 7ff26cc8f700 1 -- 172.21.15.149:0/1026469076 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2680cc820 con 0x7ff254005070 2023-11-08T19:25:05.305 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.297+0000 7ff26cc8f700 1 -- 172.21.15.149:0/1026469076 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff25400bf80 con 0x7ff254004390 2023-11-08T19:25:05.306 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.297+0000 7ff26cc8f700 1 -- 172.21.15.149:0/1026469076 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff25400c140 con 0x7ff254003a30 2023-11-08T19:25:05.306 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.297+0000 7ff26e492700 1 --2- 172.21.15.149:0/1026469076 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff254005070 0x7ff25400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:05.306 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.298+0000 7ff26dc91700 1 --2- 172.21.15.149:0/1026469076 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff254003a30 0x7ff254003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:05.306 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.298+0000 7ff26d490700 1 --2- 172.21.15.149:0/1026469076 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff254004390 0x7ff254004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:05.306 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.298+0000 7ff26e492700 1 -- 172.21.15.149:0/1026469076 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff254003a30 msgr2=0x7ff254003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:05.307 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.298+0000 7ff26e492700 1 --2- 172.21.15.149:0/1026469076 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff254003a30 0x7ff254003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:05.307 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.298+0000 7ff26e492700 1 -- 172.21.15.149:0/1026469076 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff254004390 msgr2=0x7ff254004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:05.307 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.298+0000 7ff26e492700 1 --2- 172.21.15.149:0/1026469076 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff254004390 0x7ff254004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:05.307 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.298+0000 7ff26e492700 1 -- 172.21.15.149:0/1026469076 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2540035b0 con 0x7ff254005070 2023-11-08T19:25:05.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.298+0000 7ff26e492700 1 --2- 172.21.15.149:0/1026469076 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff254005070 0x7ff25400ba10 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7ff26400a830 tx=0x7ff254005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e7afca7fed7c3f3 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:05.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.298+0000 7ff26cc8f700 1 -- 172.21.15.149:0/1026469076 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26400a2f0 con 0x7ff254005070 2023-11-08T19:25:05.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.298+0000 7ff26cc8f700 1 -- 172.21.15.149:0/1026469076 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff264012620 con 0x7ff254005070 2023-11-08T19:25:05.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.298+0000 7ff26cc8f700 1 -- 172.21.15.149:0/1026469076 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2640129d0 con 0x7ff254005070 2023-11-08T19:25:05.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.298+0000 7ff26fef5700 1 -- 172.21.15.149:0/1026469076 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff254005070 msgr2=0x7ff25400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:05.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.298+0000 7ff26fef5700 1 --2- 172.21.15.149:0/1026469076 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff254005070 0x7ff25400ba10 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7ff26400a830 tx=0x7ff254005880 comp rx=0 tx=0).stop 2023-11-08T19:25:05.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.299+0000 7ff26e492700 1 -- 172.21.15.149:0/1026469076 reap_dead start 2023-11-08T19:25:05.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.299+0000 7ff26fef5700 1 -- 172.21.15.149:0/1026469076 shutdown_connections 2023-11-08T19:25:05.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.299+0000 7ff26fef5700 1 -- 172.21.15.149:0/1026469076 >> 172.21.15.149:0/1026469076 conn(0x7ff26808afd0 msgr2=0x7ff2680d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:05.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.299+0000 7ff26fef5700 1 -- 172.21.15.149:0/1026469076 shutdown_connections 2023-11-08T19:25:05.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.299+0000 7ff26fef5700 1 -- 172.21.15.149:0/1026469076 wait complete. 2023-11-08T19:25:05.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.300+0000 7ff26fef5700 1 Processor -- start 2023-11-08T19:25:05.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.300+0000 7ff26fef5700 1 -- start start 2023-11-08T19:25:05.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.301+0000 7ff26fef5700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff254005070 0x7ff26815de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:05.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.301+0000 7ff26fef5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff2680b3490 0x7ff2680b3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:05.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.301+0000 7ff26fef5700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff2681f49d0 0x7ff2681f4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:05.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.301+0000 7ff26fef5700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2680c62c0 con 0x7ff2680b3490 2023-11-08T19:25:05.314 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.301+0000 7ff26fef5700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff26815e670 con 0x7ff2681f49d0 2023-11-08T19:25:05.314 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.301+0000 7ff26fef5700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff26815e950 con 0x7ff254005070 2023-11-08T19:25:05.314 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.301+0000 7ff26d490700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff2680b3490 0x7ff2680b3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:05.314 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.301+0000 7ff26d490700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff2680b3490 0x7ff2680b3910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40616/0 (socket says 172.21.15.149:40616) 2023-11-08T19:25:05.315 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.301+0000 7ff26d490700 1 -- 172.21.15.149:0/2969985787 learned_addr learned my addr 172.21.15.149:0/2969985787 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:05.315 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.301+0000 7ff26dc91700 1 --2- 172.21.15.149:0/2969985787 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff254005070 0x7ff26815de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:05.315 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.301+0000 7ff26e492700 1 --2- 172.21.15.149:0/2969985787 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff2681f49d0 0x7ff2681f4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:05.315 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.302+0000 7ff26d490700 1 -- 172.21.15.149:0/2969985787 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff254005070 msgr2=0x7ff26815de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:05.315 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.302+0000 7ff26d490700 1 --2- 172.21.15.149:0/2969985787 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff254005070 0x7ff26815de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:05.316 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.302+0000 7ff26d490700 1 -- 172.21.15.149:0/2969985787 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff2681f49d0 msgr2=0x7ff2681f4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:05.316 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.302+0000 7ff26d490700 1 --2- 172.21.15.149:0/2969985787 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff2681f49d0 0x7ff2681f4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:05.316 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.302+0000 7ff26d490700 1 -- 172.21.15.149:0/2969985787 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff26815ec30 con 0x7ff2680b3490 2023-11-08T19:25:05.316 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.302+0000 7ff26e492700 1 --2- 172.21.15.149:0/2969985787 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff2681f49d0 0x7ff2681f4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:25:05.316 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.302+0000 7ff26d490700 1 --2- 172.21.15.149:0/2969985787 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff2680b3490 0x7ff2680b3910 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7ff258011980 tx=0x7ff258011c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:05.316 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.302+0000 7ff25e7fc700 1 -- 172.21.15.149:0/2969985787 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff258011ed0 con 0x7ff2680b3490 2023-11-08T19:25:05.317 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.302+0000 7ff25e7fc700 1 -- 172.21.15.149:0/2969985787 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff258004240 con 0x7ff2680b3490 2023-11-08T19:25:05.317 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.302+0000 7ff26fef5700 1 -- 172.21.15.149:0/2969985787 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff26815ef10 con 0x7ff2680b3490 2023-11-08T19:25:05.317 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.302+0000 7ff25e7fc700 1 -- 172.21.15.149:0/2969985787 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25800f730 con 0x7ff2680b3490 2023-11-08T19:25:05.317 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.302+0000 7ff26fef5700 1 -- 172.21.15.149:0/2969985787 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2680b3e50 con 0x7ff2680b3490 2023-11-08T19:25:05.318 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.303+0000 7ff26fef5700 1 -- 172.21.15.149:0/2969985787 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff26815f150 con 0x7ff2680b3490 2023-11-08T19:25:05.318 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.303+0000 7ff25e7fc700 1 -- 172.21.15.149:0/2969985787 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff25800f890 con 0x7ff2680b3490 2023-11-08T19:25:05.318 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.304+0000 7ff25e7fc700 1 --2- 172.21.15.149:0/2969985787 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff24c06af00 0x7ff24c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:05.318 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.304+0000 7ff26dc91700 1 --2- 172.21.15.149:0/2969985787 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff24c06af00 0x7ff24c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:05.318 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.304+0000 7ff25e7fc700 1 -- 172.21.15.149:0/2969985787 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7ff258089d20 con 0x7ff2680b3490 2023-11-08T19:25:05.319 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.304+0000 7ff26dc91700 1 --2- 172.21.15.149:0/2969985787 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff24c06af00 0x7ff24c06d3c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff2600018b0 tx=0x7ff260009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:05.319 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.309+0000 7ff25e7fc700 1 -- 172.21.15.149:0/2969985787 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff258054b30 con 0x7ff2680b3490 2023-11-08T19:25:05.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.498+0000 7ff26fef5700 1 -- 172.21.15.149:0/2969985787 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff2680c65a0 con 0x7ff2680b3490 2023-11-08T19:25:05.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.499+0000 7ff25e7fc700 1 -- 172.21.15.149:0/2969985787 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+18559 (secure 0 0 0) 0x7ff258023090 con 0x7ff2680b3490 2023-11-08T19:25:05.501 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:25:05.501 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":55,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:24:53.348156+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-08T19:24:29.516185+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-08T19:24:49.982090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-08T19:24:50.696398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:25:05.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.501+0000 7ff26fef5700 1 -- 172.21.15.149:0/2969985787 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff24c06af00 msgr2=0x7ff24c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:05.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.501+0000 7ff26fef5700 1 --2- 172.21.15.149:0/2969985787 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff24c06af00 0x7ff24c06d3c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff2600018b0 tx=0x7ff260009040 comp rx=0 tx=0).stop 2023-11-08T19:25:05.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.501+0000 7ff26fef5700 1 -- 172.21.15.149:0/2969985787 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff2680b3490 msgr2=0x7ff2680b3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:05.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.501+0000 7ff26fef5700 1 --2- 172.21.15.149:0/2969985787 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff2680b3490 0x7ff2680b3910 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7ff258011980 tx=0x7ff258011c90 comp rx=0 tx=0).stop 2023-11-08T19:25:05.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.502+0000 7ff26fef5700 1 -- 172.21.15.149:0/2969985787 shutdown_connections 2023-11-08T19:25:05.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.502+0000 7ff26fef5700 1 --2- 172.21.15.149:0/2969985787 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff24c06af00 0x7ff24c06d3c0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:05.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.502+0000 7ff26fef5700 1 --2- 172.21.15.149:0/2969985787 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff2681f49d0 0x7ff2681f4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:05.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.502+0000 7ff26fef5700 1 --2- 172.21.15.149:0/2969985787 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff254005070 0x7ff26815de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:05.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.502+0000 7ff26fef5700 1 --2- 172.21.15.149:0/2969985787 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff2680b3490 0x7ff2680b3910 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:05.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.502+0000 7ff26fef5700 1 -- 172.21.15.149:0/2969985787 >> 172.21.15.149:0/2969985787 conn(0x7ff26808afd0 msgr2=0x7ff26815ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:05.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.502+0000 7ff26fef5700 1 -- 172.21.15.149:0/2969985787 shutdown_connections 2023-11-08T19:25:05.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.502+0000 7ff26fef5700 1 -- 172.21.15.149:0/2969985787 wait complete. 2023-11-08T19:25:05.515 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-08T19:22:56.023194+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-08T19:24:29.516185+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 42, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-08T19:24:49.982090+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-11-08T19:24:50.696398+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-08T19:25:05.516 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-08T19:25:05.640 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.638+0000 7f0e032b9700 1 Processor -- start 2023-11-08T19:25:05.640 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.639+0000 7f0e032b9700 1 -- start start 2023-11-08T19:25:05.644 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.639+0000 7f0e032b9700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0dfc06ab80 0x7f0dfc0caf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:05.644 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.639+0000 7f0e032b9700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f0dfc0cf1c0 0x7f0dfc0cb490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:05.644 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.639+0000 7f0e032b9700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dfc15e320 con 0x7f0dfc15df40 2023-11-08T19:25:05.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.640+0000 7f0e032b9700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dfc06b020 con 0x7f0dfc0cf1c0 2023-11-08T19:25:05.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.640+0000 7f0e032b9700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dfc06b2e0 con 0x7f0dfc06ab80 2023-11-08T19:25:05.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.640+0000 7f0e01055700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f0dfc15df40 0x7f0dfc06c0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:42624/0 (socket says 172.21.15.149:42624) 2023-11-08T19:25:05.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.640+0000 7f0e01055700 1 -- 172.21.15.149:0/2937232640 learned_addr learned my addr 172.21.15.149:0/2937232640 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:25:05.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.640+0000 7f0df3fff700 1 -- 172.21.15.149:0/2937232640 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 245071367 0 0) 0x7f0dfc15e320 con 0x7f0dfc15df40 2023-11-08T19:25:05.646 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.640+0000 7f0e00854700 1 --2- 172.21.15.149:0/2937232640 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0dfc06ab80 0x7f0dfc0caf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:05.646 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.640+0000 7f0df3fff700 1 -- 172.21.15.149:0/2937232640 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0de80035b0 con 0x7f0dfc15df40 2023-11-08T19:25:05.646 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.640+0000 7f0e01856700 1 --2- 172.21.15.149:0/2937232640 >> v2:172.21.15.160:3300/0 conn(0x7f0dfc0cf1c0 0x7f0dfc0cb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:05.646 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.640+0000 7f0df3fff700 1 -- 172.21.15.149:0/2937232640 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2778019964 0 0) 0x7f0de80035b0 con 0x7f0dfc15df40 2023-11-08T19:25:05.646 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.640+0000 7f0df3fff700 1 -- 172.21.15.149:0/2937232640 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0dfc06ab80 msgr2=0x7f0dfc0caf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:05.647 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.640+0000 7f0df3fff700 1 --2- 172.21.15.149:0/2937232640 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0dfc06ab80 0x7f0dfc0caf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:05.647 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.640+0000 7f0df3fff700 1 -- 172.21.15.149:0/2937232640 >> v2:172.21.15.160:3300/0 conn(0x7f0dfc0cf1c0 msgr2=0x7f0dfc0cb490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:05.647 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.640+0000 7f0df3fff700 1 --2- 172.21.15.149:0/2937232640 >> v2:172.21.15.160:3300/0 conn(0x7f0dfc0cf1c0 0x7f0dfc0cb490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:05.647 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.640+0000 7f0df3fff700 1 -- 172.21.15.149:0/2937232640 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dfc06b5c0 con 0x7f0dfc15df40 2023-11-08T19:25:05.647 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.640+0000 7f0df3fff700 1 -- 172.21.15.149:0/2937232640 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f0dec001670 con 0x7f0dfc15df40 2023-11-08T19:25:05.648 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.640+0000 7f0e01856700 1 --2- 172.21.15.149:0/2937232640 >> v2:172.21.15.160:3300/0 conn(0x7f0dfc0cf1c0 0x7f0dfc0cb490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:25:05.648 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.640+0000 7f0df3fff700 1 -- 172.21.15.149:0/2937232640 >> v1:172.21.15.149:6789/0 conn(0x7f0dfc15df40 legacy=0x7f0dfc06c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:05.648 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.640+0000 7f0df3fff700 1 --2- 172.21.15.149:0/2937232640 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0de8003a70 0x7f0de8003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:05.648 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.640+0000 7f0df3fff700 1 --2- 172.21.15.149:0/2937232640 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0de8004850 0x7f0de8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:05.648 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.640+0000 7f0df3fff700 1 --2- 172.21.15.149:0/2937232640 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0dfc06ab80 0x7f0de8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:05.649 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.640+0000 7f0df3fff700 1 -- 172.21.15.149:0/2937232640 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dfc06b020 con 0x7f0de8003a70 2023-11-08T19:25:05.649 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.640+0000 7f0df3fff700 1 -- 172.21.15.149:0/2937232640 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dfc06b2e0 con 0x7f0de8004850 2023-11-08T19:25:05.649 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.640+0000 7f0df3fff700 1 -- 172.21.15.149:0/2937232640 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0de800ba90 con 0x7f0dfc06ab80 2023-11-08T19:25:05.649 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.640+0000 7f0e01055700 1 --2- 172.21.15.149:0/2937232640 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0de8003a70 0x7f0de8003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:05.649 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.640+0000 7f0e00854700 1 --2- 172.21.15.149:0/2937232640 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0de8004850 0x7f0de8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:05.650 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.640+0000 7f0e01856700 1 --2- 172.21.15.149:0/2937232640 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0dfc06ab80 0x7f0de8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:05.650 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.641+0000 7f0e01055700 1 -- 172.21.15.149:0/2937232640 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0dfc06ab80 msgr2=0x7f0de8005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:05.650 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.641+0000 7f0e01055700 1 --2- 172.21.15.149:0/2937232640 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0dfc06ab80 0x7f0de8005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:05.650 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.641+0000 7f0e01055700 1 -- 172.21.15.149:0/2937232640 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0de8004850 msgr2=0x7f0de8004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:05.650 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.641+0000 7f0e01055700 1 --2- 172.21.15.149:0/2937232640 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0de8004850 0x7f0de8004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:05.651 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.641+0000 7f0e01055700 1 -- 172.21.15.149:0/2937232640 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0de80035b0 con 0x7f0de8003a70 2023-11-08T19:25:05.651 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.641+0000 7f0e01055700 1 --2- 172.21.15.149:0/2937232640 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0de8003a70 0x7f0de8003e90 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f0dec00c370 tx=0x7f0de8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b9edcb226dd3c36 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:05.651 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.641+0000 7f0df3fff700 1 -- 172.21.15.149:0/2937232640 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dec007c60 con 0x7f0de8003a70 2023-11-08T19:25:05.651 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.641+0000 7f0df3fff700 1 -- 172.21.15.149:0/2937232640 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dec005960 con 0x7f0de8003a70 2023-11-08T19:25:05.652 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.641+0000 7f0df3fff700 1 -- 172.21.15.149:0/2937232640 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dec005d10 con 0x7f0de8003a70 2023-11-08T19:25:05.652 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.641+0000 7f0e032b9700 1 -- 172.21.15.149:0/2937232640 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0de8003a70 msgr2=0x7f0de8003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:05.652 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.641+0000 7f0e032b9700 1 --2- 172.21.15.149:0/2937232640 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0de8003a70 0x7f0de8003e90 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f0dec00c370 tx=0x7f0de8005880 comp rx=0 tx=0).stop 2023-11-08T19:25:05.652 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.641+0000 7f0e01856700 1 -- 172.21.15.149:0/2937232640 reap_dead start 2023-11-08T19:25:05.652 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.641+0000 7f0e032b9700 1 -- 172.21.15.149:0/2937232640 shutdown_connections 2023-11-08T19:25:05.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.641+0000 7f0e032b9700 1 -- 172.21.15.149:0/2937232640 >> 172.21.15.149:0/2937232640 conn(0x7f0dfc0d0640 msgr2=0x7f0dfc0d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:05.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.642+0000 7f0e032b9700 1 -- 172.21.15.149:0/2937232640 shutdown_connections 2023-11-08T19:25:05.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.642+0000 7f0e032b9700 1 -- 172.21.15.149:0/2937232640 wait complete. 2023-11-08T19:25:05.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.643+0000 7f0e032b9700 1 Processor -- start 2023-11-08T19:25:05.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.643+0000 7f0e032b9700 1 -- start start 2023-11-08T19:25:05.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.643+0000 7f0e032b9700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0de8003a70 0x7f0dfc0adb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:05.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.643+0000 7f0e032b9700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0dfc160c90 0x7f0dfc158330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:05.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.643+0000 7f0e032b9700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0dfc0c8120 0x7f0dfc0c9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:05.657 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.643+0000 7f0e032b9700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dfc1601d0 con 0x7f0dfc0c8120 2023-11-08T19:25:05.657 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.643+0000 7f0e032b9700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dfc15e970 con 0x7f0de8003a70 2023-11-08T19:25:05.657 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.643+0000 7f0e032b9700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dfc0c8890 con 0x7f0dfc160c90 2023-11-08T19:25:05.657 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.644+0000 7f0e01856700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0dfc0c8120 0x7f0dfc0c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:05.657 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.644+0000 7f0e01856700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0dfc0c8120 0x7f0dfc0c9750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40638/0 (socket says 172.21.15.149:40638) 2023-11-08T19:25:05.658 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.644+0000 7f0e01856700 1 -- 172.21.15.149:0/2238004547 learned_addr learned my addr 172.21.15.149:0/2238004547 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:05.658 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.644+0000 7f0e00854700 1 --2- 172.21.15.149:0/2238004547 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0dfc160c90 0x7f0dfc158330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:05.658 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.644+0000 7f0e01856700 1 -- 172.21.15.149:0/2238004547 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0dfc160c90 msgr2=0x7f0dfc158330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:05.658 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.644+0000 7f0e01856700 1 --2- 172.21.15.149:0/2238004547 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0dfc160c90 0x7f0dfc158330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:05.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.644+0000 7f0e01055700 1 --2- 172.21.15.149:0/2238004547 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0de8003a70 0x7f0dfc0adb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:05.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.644+0000 7f0e01856700 1 -- 172.21.15.149:0/2238004547 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0de8003a70 msgr2=0x7f0dfc0adb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:05.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.644+0000 7f0e01856700 1 --2- 172.21.15.149:0/2238004547 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0de8003a70 0x7f0dfc0adb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:05.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.644+0000 7f0e01856700 1 -- 172.21.15.149:0/2238004547 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dfc0c8b70 con 0x7f0dfc0c8120 2023-11-08T19:25:05.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.644+0000 7f0e01856700 1 --2- 172.21.15.149:0/2238004547 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0dfc0c8120 0x7f0dfc0c9750 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc162a50 tx=0x7f0df4010440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:05.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.644+0000 7f0df1ffb700 1 -- 172.21.15.149:0/2238004547 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df401b070 con 0x7f0dfc0c8120 2023-11-08T19:25:05.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.644+0000 7f0df1ffb700 1 -- 172.21.15.149:0/2238004547 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0df4010c20 con 0x7f0dfc0c8120 2023-11-08T19:25:05.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.644+0000 7f0e032b9700 1 -- 172.21.15.149:0/2238004547 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dfc15e320 con 0x7f0dfc0c8120 2023-11-08T19:25:05.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.644+0000 7f0df1ffb700 1 -- 172.21.15.149:0/2238004547 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df4010db0 con 0x7f0dfc0c8120 2023-11-08T19:25:05.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.644+0000 7f0e032b9700 1 -- 172.21.15.149:0/2238004547 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dfc0c85a0 con 0x7f0dfc0c8120 2023-11-08T19:25:05.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.645+0000 7f0e032b9700 1 -- 172.21.15.149:0/2238004547 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dfc04f730 con 0x7f0dfc0c8120 2023-11-08T19:25:05.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.646+0000 7f0df1ffb700 1 -- 172.21.15.149:0/2238004547 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0df4017430 con 0x7f0dfc0c8120 2023-11-08T19:25:05.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.646+0000 7f0df1ffb700 1 --2- 172.21.15.149:0/2238004547 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0de006af00 0x7f0de006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:05.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.646+0000 7f0df1ffb700 1 -- 172.21.15.149:0/2238004547 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f0df4089b90 con 0x7f0dfc0c8120 2023-11-08T19:25:05.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.646+0000 7f0e01055700 1 --2- 172.21.15.149:0/2238004547 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0de006af00 0x7f0de006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:05.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.647+0000 7f0e01055700 1 --2- 172.21.15.149:0/2238004547 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0de006af00 0x7f0de006d3c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f0dec015040 tx=0x7f0dec00a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:05.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.651+0000 7f0df1ffb700 1 -- 172.21.15.149:0/2238004547 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0df40549a0 con 0x7f0dfc0c8120 2023-11-08T19:25:05.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.843+0000 7f0e032b9700 1 -- 172.21.15.149:0/2238004547 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0dfc072ae0 con 0x7f0dfc0c8120 2023-11-08T19:25:05.845 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.843+0000 7f0df1ffb700 1 -- 172.21.15.149:0/2238004547 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v55) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0df4057fc0 con 0x7f0dfc0c8120 2023-11-08T19:25:05.845 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 1 2023-11-08T19:25:05.847 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.846+0000 7f0e032b9700 1 -- 172.21.15.149:0/2238004547 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0de006af00 msgr2=0x7f0de006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:05.847 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.846+0000 7f0e032b9700 1 --2- 172.21.15.149:0/2238004547 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0de006af00 0x7f0de006d3c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f0dec015040 tx=0x7f0dec00a000 comp rx=0 tx=0).stop 2023-11-08T19:25:05.848 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.846+0000 7f0e032b9700 1 -- 172.21.15.149:0/2238004547 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0dfc0c8120 msgr2=0x7f0dfc0c9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:05.848 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.846+0000 7f0e032b9700 1 --2- 172.21.15.149:0/2238004547 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0dfc0c8120 0x7f0dfc0c9750 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc162a50 tx=0x7f0df4010440 comp rx=0 tx=0).stop 2023-11-08T19:25:05.848 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.846+0000 7f0e032b9700 1 -- 172.21.15.149:0/2238004547 shutdown_connections 2023-11-08T19:25:05.848 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.846+0000 7f0e032b9700 1 --2- 172.21.15.149:0/2238004547 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0de006af00 0x7f0de006d3c0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:05.848 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.846+0000 7f0e032b9700 1 --2- 172.21.15.149:0/2238004547 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0de8003a70 0x7f0dfc0adb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:05.849 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.846+0000 7f0e032b9700 1 --2- 172.21.15.149:0/2238004547 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0dfc0c8120 0x7f0dfc0c9750 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:05.849 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.846+0000 7f0e032b9700 1 --2- 172.21.15.149:0/2238004547 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0dfc160c90 0x7f0dfc158330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:05.849 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.846+0000 7f0e032b9700 1 -- 172.21.15.149:0/2238004547 >> 172.21.15.149:0/2238004547 conn(0x7f0dfc0d0640 msgr2=0x7f0dfc072030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:05.849 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.846+0000 7f0e032b9700 1 -- 172.21.15.149:0/2238004547 shutdown_connections 2023-11-08T19:25:05.849 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.846+0000 7f0e032b9700 1 -- 172.21.15.149:0/2238004547 wait complete. 2023-11-08T19:25:05.859 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-08T19:25:05.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.981+0000 7f2557aa9700 1 Processor -- start 2023-11-08T19:25:05.983 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.982+0000 7f2557aa9700 1 -- start start 2023-11-08T19:25:05.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.982+0000 7f2557aa9700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f25500cc0d0 0x7f255015f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:05.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.982+0000 7f2557aa9700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f25500cc4b0 0x7f255015c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:05.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.982+0000 7f2557aa9700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f255015be80 con 0x7f255015cb60 2023-11-08T19:25:05.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.982+0000 7f2557aa9700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f255015f9b0 con 0x7f25500cc4b0 2023-11-08T19:25:05.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.982+0000 7f2557aa9700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f255015fba0 con 0x7f25500cc0d0 2023-11-08T19:25:05.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.983+0000 7f2555044700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f25500cc4b0 0x7f255015c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:05.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.983+0000 7f2556046700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f255015cb60 0x7f25500cf320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:42648/0 (socket says 172.21.15.149:42648) 2023-11-08T19:25:05.987 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.983+0000 7f2556046700 1 -- 172.21.15.149:0/1617045015 learned_addr learned my addr 172.21.15.149:0/1617045015 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:25:05.987 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.983+0000 7f2555845700 1 --2- 172.21.15.149:0/1617045015 >> v2:172.21.15.160:3300/0 conn(0x7f25500cc0d0 0x7f255015f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:05.987 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.983+0000 7f2555044700 1 -- 172.21.15.149:0/1617045015 >> v2:172.21.15.160:3300/0 conn(0x7f25500cc0d0 msgr2=0x7f255015f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:05.987 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.983+0000 7f2555044700 1 --2- 172.21.15.149:0/1617045015 >> v2:172.21.15.160:3300/0 conn(0x7f25500cc0d0 0x7f255015f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:05.987 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.983+0000 7f2555044700 1 -- 172.21.15.149:0/1617045015 >> v1:172.21.15.149:6789/0 conn(0x7f255015cb60 legacy=0x7f25500cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:05.988 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.983+0000 7f2554843700 1 -- 172.21.15.149:0/1617045015 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1538509320 0 0) 0x7f255015be80 con 0x7f255015cb60 2023-11-08T19:25:05.988 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.983+0000 7f2555044700 1 -- 172.21.15.149:0/1617045015 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f255015fe80 con 0x7f25500cc4b0 2023-11-08T19:25:05.988 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.983+0000 7f2555845700 1 --2- 172.21.15.149:0/1617045015 >> v2:172.21.15.160:3300/0 conn(0x7f25500cc0d0 0x7f255015f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:25:05.988 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.983+0000 7f2555044700 1 --2- 172.21.15.149:0/1617045015 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25500cc4b0 0x7f255015c620 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f2550073370 tx=0x7f254c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=109ef0f6a3401d74 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:05.988 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.983+0000 7f2554843700 1 -- 172.21.15.149:0/1617045015 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254c011830 con 0x7f25500cc4b0 2023-11-08T19:25:05.988 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.983+0000 7f2554843700 1 -- 172.21.15.149:0/1617045015 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f254c011990 con 0x7f25500cc4b0 2023-11-08T19:25:05.989 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.983+0000 7f2554843700 1 -- 172.21.15.149:0/1617045015 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254c011d20 con 0x7f25500cc4b0 2023-11-08T19:25:05.989 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.984+0000 7f2557aa9700 1 -- 172.21.15.149:0/1617045015 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25500cc4b0 msgr2=0x7f255015c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:05.989 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.984+0000 7f2557aa9700 1 --2- 172.21.15.149:0/1617045015 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25500cc4b0 0x7f255015c620 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f2550073370 tx=0x7f254c009b20 comp rx=0 tx=0).stop 2023-11-08T19:25:05.989 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.984+0000 7f2557aa9700 1 -- 172.21.15.149:0/1617045015 shutdown_connections 2023-11-08T19:25:05.989 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.984+0000 7f2557aa9700 1 --2- 172.21.15.149:0/1617045015 >> v2:172.21.15.160:3300/0 conn(0x7f25500cc0d0 0x7f255015f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:05.990 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.984+0000 7f2557aa9700 1 --2- 172.21.15.149:0/1617045015 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25500cc4b0 0x7f255015c620 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:05.990 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.984+0000 7f2557aa9700 1 -- 172.21.15.149:0/1617045015 >> 172.21.15.149:0/1617045015 conn(0x7f255006f120 msgr2=0x7f255006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:05.990 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.984+0000 7f2557aa9700 1 -- 172.21.15.149:0/1617045015 shutdown_connections 2023-11-08T19:25:05.990 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.984+0000 7f2557aa9700 1 -- 172.21.15.149:0/1617045015 wait complete. 2023-11-08T19:25:05.993 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.985+0000 7f2557aa9700 1 Processor -- start 2023-11-08T19:25:05.993 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.985+0000 7f2557aa9700 1 -- start start 2023-11-08T19:25:05.993 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.986+0000 7f2557aa9700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25500cc0d0 0x7f25500cbad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:05.993 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.986+0000 7f2557aa9700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25500cc4b0 0x7f25500b1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:05.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.986+0000 7f2557aa9700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f255015cb60 0x7f25501f0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:05.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.986+0000 7f2557aa9700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25500b23f0 con 0x7f25500cc4b0 2023-11-08T19:25:05.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.986+0000 7f2557aa9700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25500b2650 con 0x7f25500cc0d0 2023-11-08T19:25:05.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.986+0000 7f2557aa9700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25500b2930 con 0x7f255015cb60 2023-11-08T19:25:05.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.986+0000 7f2555044700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25500cc4b0 0x7f25500b1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:05.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.986+0000 7f2555044700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25500cc4b0 0x7f25500b1eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40650/0 (socket says 172.21.15.149:40650) 2023-11-08T19:25:05.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.986+0000 7f2555044700 1 -- 172.21.15.149:0/3833088080 learned_addr learned my addr 172.21.15.149:0/3833088080 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:05.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.986+0000 7f2555044700 1 -- 172.21.15.149:0/3833088080 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f255015cb60 msgr2=0x7f25501f0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:05.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.986+0000 7f2556046700 1 --2- 172.21.15.149:0/3833088080 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f255015cb60 0x7f25501f0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:05.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.986+0000 7f2555845700 1 --2- 172.21.15.149:0/3833088080 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25500cc0d0 0x7f25500cbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:05.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.986+0000 7f2555044700 1 --2- 172.21.15.149:0/3833088080 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f255015cb60 0x7f25501f0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:05.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.986+0000 7f2555044700 1 -- 172.21.15.149:0/3833088080 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25500cc0d0 msgr2=0x7f25500cbad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:05.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.986+0000 7f2555044700 1 --2- 172.21.15.149:0/3833088080 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25500cc0d0 0x7f25500cbad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:05.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.986+0000 7f2555044700 1 -- 172.21.15.149:0/3833088080 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f254c0094a0 con 0x7f25500cc4b0 2023-11-08T19:25:05.997 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.986+0000 7f2555845700 1 --2- 172.21.15.149:0/3833088080 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25500cc0d0 0x7f25500cbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:25:05.997 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.986+0000 7f2555044700 1 --2- 172.21.15.149:0/3833088080 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25500cc4b0 0x7f25500b1eb0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f254c0090b0 tx=0x7f254c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:05.997 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.987+0000 7f25467fc700 1 -- 172.21.15.149:0/3833088080 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254c0038a0 con 0x7f25500cc4b0 2023-11-08T19:25:05.997 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.987+0000 7f25467fc700 1 -- 172.21.15.149:0/3833088080 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f254c01f070 con 0x7f25500cc4b0 2023-11-08T19:25:05.998 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.987+0000 7f2557aa9700 1 -- 172.21.15.149:0/3833088080 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25500b2c10 con 0x7f25500cc4b0 2023-11-08T19:25:05.998 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.987+0000 7f25467fc700 1 -- 172.21.15.149:0/3833088080 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254c003c20 con 0x7f25500cc4b0 2023-11-08T19:25:05.998 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.987+0000 7f2557aa9700 1 -- 172.21.15.149:0/3833088080 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25500b31d0 con 0x7f25500cc4b0 2023-11-08T19:25:05.998 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.988+0000 7f2557aa9700 1 -- 172.21.15.149:0/3833088080 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f255004f730 con 0x7f25500cc4b0 2023-11-08T19:25:05.998 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.988+0000 7f25467fc700 1 -- 172.21.15.149:0/3833088080 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f254c01a430 con 0x7f25500cc4b0 2023-11-08T19:25:05.999 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.988+0000 7f25467fc700 1 --2- 172.21.15.149:0/3833088080 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f253406af00 0x7f253406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:05.999 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.989+0000 7f25467fc700 1 -- 172.21.15.149:0/3833088080 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f254c021070 con 0x7f25500cc4b0 2023-11-08T19:25:05.999 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.989+0000 7f2555845700 1 --2- 172.21.15.149:0/3833088080 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f253406af00 0x7f253406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:05.999 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.989+0000 7f2555845700 1 --2- 172.21.15.149:0/3833088080 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f253406af00 0x7f253406d3c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2540009a60 tx=0x7f2540008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:06.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:05.993+0000 7f25467fc700 1 -- 172.21.15.149:0/3833088080 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f254c0560d0 con 0x7f25500cc4b0 2023-11-08T19:25:06.187 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.186+0000 7f2557aa9700 1 -- 172.21.15.149:0/3833088080 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f255006ff20 con 0x7f25500cc4b0 2023-11-08T19:25:06.187 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.186+0000 7f25467fc700 1 -- 172.21.15.149:0/3833088080 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v55) v1 ==== 103+0+11 (secure 0 0 0) 0x7f254c0596f0 con 0x7f25500cc4b0 2023-11-08T19:25:06.188 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:25:06.190 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.188+0000 7f2557aa9700 1 -- 172.21.15.149:0/3833088080 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f253406af00 msgr2=0x7f253406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:06.190 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.188+0000 7f2557aa9700 1 --2- 172.21.15.149:0/3833088080 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f253406af00 0x7f253406d3c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2540009a60 tx=0x7f2540008040 comp rx=0 tx=0).stop 2023-11-08T19:25:06.190 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.188+0000 7f2557aa9700 1 -- 172.21.15.149:0/3833088080 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25500cc4b0 msgr2=0x7f25500b1eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:06.190 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.188+0000 7f2557aa9700 1 --2- 172.21.15.149:0/3833088080 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25500cc4b0 0x7f25500b1eb0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f254c0090b0 tx=0x7f254c004750 comp rx=0 tx=0).stop 2023-11-08T19:25:06.190 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.188+0000 7f2557aa9700 1 -- 172.21.15.149:0/3833088080 shutdown_connections 2023-11-08T19:25:06.191 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.188+0000 7f2557aa9700 1 --2- 172.21.15.149:0/3833088080 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f253406af00 0x7f253406d3c0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:06.191 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.188+0000 7f2557aa9700 1 --2- 172.21.15.149:0/3833088080 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25500cc0d0 0x7f25500cbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:06.191 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.188+0000 7f2557aa9700 1 --2- 172.21.15.149:0/3833088080 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f255015cb60 0x7f25501f0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:06.191 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.188+0000 7f2557aa9700 1 --2- 172.21.15.149:0/3833088080 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25500cc4b0 0x7f25500b1eb0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:06.191 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.188+0000 7f2557aa9700 1 -- 172.21.15.149:0/3833088080 >> 172.21.15.149:0/3833088080 conn(0x7f255006f120 msgr2=0x7f255015b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:06.192 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.188+0000 7f2557aa9700 1 -- 172.21.15.149:0/3833088080 shutdown_connections 2023-11-08T19:25:06.192 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.188+0000 7f2557aa9700 1 -- 172.21.15.149:0/3833088080 wait complete. 2023-11-08T19:25:06.201 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-08T19:25:06.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.324+0000 7f40f45ca700 1 Processor -- start 2023-11-08T19:25:06.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.324+0000 7f40f45ca700 1 -- start start 2023-11-08T19:25:06.328 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.325+0000 7f40f45ca700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f40ec15df40 0x7f40ec06c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:06.328 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.325+0000 7f40f45ca700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f40ec0cb660 0x7f40ec06c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:06.328 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.325+0000 7f40f45ca700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40ec15e320 con 0x7f40ec06ab80 2023-11-08T19:25:06.329 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.325+0000 7f40f45ca700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40ec06b020 con 0x7f40ec0cb660 2023-11-08T19:25:06.329 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.325+0000 7f40f45ca700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40ec06b2e0 con 0x7f40ec15df40 2023-11-08T19:25:06.329 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.325+0000 7f40f2b67700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f40ec0cb660 0x7f40ec06c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:06.329 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.325+0000 7f40f1b65700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f40ec06ab80 0x7f40ec0caf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:42658/0 (socket says 172.21.15.149:42658) 2023-11-08T19:25:06.330 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.325+0000 7f40f1b65700 1 -- 172.21.15.149:0/4162140127 learned_addr learned my addr 172.21.15.149:0/4162140127 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:25:06.330 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.326+0000 7f40f2366700 1 --2- 172.21.15.149:0/4162140127 >> v2:172.21.15.160:3300/0 conn(0x7f40ec15df40 0x7f40ec06c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:06.330 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.326+0000 7f40f2b67700 1 -- 172.21.15.149:0/4162140127 >> v2:172.21.15.160:3300/0 conn(0x7f40ec15df40 msgr2=0x7f40ec06c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:06.330 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.326+0000 7f40f2b67700 1 --2- 172.21.15.149:0/4162140127 >> v2:172.21.15.160:3300/0 conn(0x7f40ec15df40 0x7f40ec06c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:06.330 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.326+0000 7f40f2b67700 1 -- 172.21.15.149:0/4162140127 >> v1:172.21.15.149:6789/0 conn(0x7f40ec06ab80 legacy=0x7f40ec0caf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:06.331 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.326+0000 7f40f2b67700 1 -- 172.21.15.149:0/4162140127 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40ec06b5c0 con 0x7f40ec0cb660 2023-11-08T19:25:06.331 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.326+0000 7f40f1364700 1 -- 172.21.15.149:0/4162140127 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1922371117 0 0) 0x7f40ec15e320 con 0x7f40ec06ab80 2023-11-08T19:25:06.331 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.326+0000 7f40f2b67700 1 --2- 172.21.15.149:0/4162140127 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40ec0cb660 0x7f40ec06c5e0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f40ec0ce190 tx=0x7f40e400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c57c870dcf284dc server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:06.331 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.326+0000 7f40f1364700 1 -- 172.21.15.149:0/4162140127 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e400e070 con 0x7f40ec0cb660 2023-11-08T19:25:06.331 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.326+0000 7f40f1364700 1 -- 172.21.15.149:0/4162140127 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e400bbd0 con 0x7f40ec0cb660 2023-11-08T19:25:06.332 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.326+0000 7f40f1364700 1 -- 172.21.15.149:0/4162140127 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e4012430 con 0x7f40ec0cb660 2023-11-08T19:25:06.332 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.326+0000 7f40f45ca700 1 -- 172.21.15.149:0/4162140127 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40ec0cb660 msgr2=0x7f40ec06c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:06.332 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.326+0000 7f40f45ca700 1 --2- 172.21.15.149:0/4162140127 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40ec0cb660 0x7f40ec06c5e0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f40ec0ce190 tx=0x7f40e400b330 comp rx=0 tx=0).stop 2023-11-08T19:25:06.332 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.327+0000 7f40f45ca700 1 -- 172.21.15.149:0/4162140127 shutdown_connections 2023-11-08T19:25:06.332 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.327+0000 7f40f45ca700 1 --2- 172.21.15.149:0/4162140127 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40ec0cb660 0x7f40ec06c5e0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:06.333 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.327+0000 7f40f45ca700 1 --2- 172.21.15.149:0/4162140127 >> v2:172.21.15.160:3300/0 conn(0x7f40ec15df40 0x7f40ec06c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:06.333 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.327+0000 7f40f45ca700 1 -- 172.21.15.149:0/4162140127 >> 172.21.15.149:0/4162140127 conn(0x7f40ec0d0640 msgr2=0x7f40ec0d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:06.333 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.327+0000 7f40f45ca700 1 -- 172.21.15.149:0/4162140127 shutdown_connections 2023-11-08T19:25:06.333 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.327+0000 7f40f45ca700 1 -- 172.21.15.149:0/4162140127 wait complete. 2023-11-08T19:25:06.335 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.328+0000 7f40f45ca700 1 Processor -- start 2023-11-08T19:25:06.336 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.328+0000 7f40f45ca700 1 -- start start 2023-11-08T19:25:06.336 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.329+0000 7f40f45ca700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f40ec06ab80 0x7f40ec14ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:06.336 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.329+0000 7f40f45ca700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f40ec0cb660 0x7f40ec0ca1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:06.336 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.329+0000 7f40f45ca700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40ec15df40 0x7f40ec15fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:06.337 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.329+0000 7f40f45ca700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40ec1612e0 con 0x7f40ec15df40 2023-11-08T19:25:06.337 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.329+0000 7f40f45ca700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40ec14eef0 con 0x7f40ec06ab80 2023-11-08T19:25:06.337 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.329+0000 7f40f45ca700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40ec15e770 con 0x7f40ec0cb660 2023-11-08T19:25:06.337 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.329+0000 7f40f2b67700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40ec15df40 0x7f40ec15fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:06.337 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.329+0000 7f40f2b67700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40ec15df40 0x7f40ec15fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40666/0 (socket says 172.21.15.149:40666) 2023-11-08T19:25:06.338 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.329+0000 7f40f2b67700 1 -- 172.21.15.149:0/844979552 learned_addr learned my addr 172.21.15.149:0/844979552 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:06.338 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.329+0000 7f40f2366700 1 --2- 172.21.15.149:0/844979552 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f40ec06ab80 0x7f40ec14ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:06.338 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.329+0000 7f40f1b65700 1 --2- 172.21.15.149:0/844979552 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f40ec0cb660 0x7f40ec0ca1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:06.338 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.330+0000 7f40f2b67700 1 -- 172.21.15.149:0/844979552 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f40ec0cb660 msgr2=0x7f40ec0ca1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:06.339 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.330+0000 7f40f2b67700 1 --2- 172.21.15.149:0/844979552 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f40ec0cb660 0x7f40ec0ca1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:06.339 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.330+0000 7f40f2b67700 1 -- 172.21.15.149:0/844979552 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f40ec06ab80 msgr2=0x7f40ec14ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:06.339 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.330+0000 7f40f2b67700 1 --2- 172.21.15.149:0/844979552 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f40ec06ab80 0x7f40ec14ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:06.339 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.330+0000 7f40f2b67700 1 -- 172.21.15.149:0/844979552 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e4009a70 con 0x7f40ec15df40 2023-11-08T19:25:06.339 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.330+0000 7f40f2b67700 1 --2- 172.21.15.149:0/844979552 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40ec15df40 0x7f40ec15fe10 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f40e4013000 tx=0x7f40e4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:06.339 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.330+0000 7f40e2ffd700 1 -- 172.21.15.149:0/844979552 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e4012430 con 0x7f40ec15df40 2023-11-08T19:25:06.340 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.330+0000 7f40e2ffd700 1 -- 172.21.15.149:0/844979552 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e4020070 con 0x7f40ec15df40 2023-11-08T19:25:06.340 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.330+0000 7f40e2ffd700 1 -- 172.21.15.149:0/844979552 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e4004280 con 0x7f40ec15df40 2023-11-08T19:25:06.340 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.330+0000 7f40f45ca700 1 -- 172.21.15.149:0/844979552 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40ec160c90 con 0x7f40ec15df40 2023-11-08T19:25:06.340 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.330+0000 7f40f45ca700 1 -- 172.21.15.149:0/844979552 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40ec14e410 con 0x7f40ec15df40 2023-11-08T19:25:06.341 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.331+0000 7f40f45ca700 1 -- 172.21.15.149:0/844979552 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40ec161450 con 0x7f40ec15df40 2023-11-08T19:25:06.341 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.331+0000 7f40e2ffd700 1 -- 172.21.15.149:0/844979552 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f40e40043e0 con 0x7f40ec15df40 2023-11-08T19:25:06.341 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.332+0000 7f40e2ffd700 1 --2- 172.21.15.149:0/844979552 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f40d006af00 0x7f40d006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:06.341 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.332+0000 7f40e2ffd700 1 -- 172.21.15.149:0/844979552 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f40e4022070 con 0x7f40ec15df40 2023-11-08T19:25:06.341 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.332+0000 7f40f2366700 1 --2- 172.21.15.149:0/844979552 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f40d006af00 0x7f40d006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:06.342 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.332+0000 7f40f2366700 1 --2- 172.21.15.149:0/844979552 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f40d006af00 0x7f40d006d3c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f40dc006b20 tx=0x7f40dc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:06.342 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.337+0000 7f40e2ffd700 1 -- 172.21.15.149:0/844979552 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f40e4056320 con 0x7f40ec15df40 2023-11-08T19:25:06.530 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.529+0000 7f40f45ca700 1 -- 172.21.15.149:0/844979552 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f40ec04f730 con 0x7f40ec15df40 2023-11-08T19:25:06.531 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.529+0000 7f40e2ffd700 1 -- 172.21.15.149:0/844979552 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v55) v1 ==== 104+0+11 (secure 0 0 0) 0x7f40e4059940 con 0x7f40ec15df40 2023-11-08T19:25:06.531 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:25:06.533 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.532+0000 7f40f45ca700 1 -- 172.21.15.149:0/844979552 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f40d006af00 msgr2=0x7f40d006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:06.533 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.532+0000 7f40f45ca700 1 --2- 172.21.15.149:0/844979552 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f40d006af00 0x7f40d006d3c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f40dc006b20 tx=0x7f40dc008040 comp rx=0 tx=0).stop 2023-11-08T19:25:06.533 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.532+0000 7f40f45ca700 1 -- 172.21.15.149:0/844979552 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40ec15df40 msgr2=0x7f40ec15fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:06.534 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.532+0000 7f40f45ca700 1 --2- 172.21.15.149:0/844979552 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40ec15df40 0x7f40ec15fe10 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f40e4013000 tx=0x7f40e4004ad0 comp rx=0 tx=0).stop 2023-11-08T19:25:06.534 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.532+0000 7f40f45ca700 1 -- 172.21.15.149:0/844979552 shutdown_connections 2023-11-08T19:25:06.534 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.532+0000 7f40f45ca700 1 --2- 172.21.15.149:0/844979552 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f40d006af00 0x7f40d006d3c0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:06.534 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.532+0000 7f40f45ca700 1 --2- 172.21.15.149:0/844979552 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f40ec06ab80 0x7f40ec14ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:06.534 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.532+0000 7f40f45ca700 1 --2- 172.21.15.149:0/844979552 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40ec15df40 0x7f40ec15fe10 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:06.535 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.532+0000 7f40f45ca700 1 --2- 172.21.15.149:0/844979552 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f40ec0cb660 0x7f40ec0ca1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:06.535 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.532+0000 7f40f45ca700 1 -- 172.21.15.149:0/844979552 >> 172.21.15.149:0/844979552 conn(0x7f40ec0d0640 msgr2=0x7f40ec0c35a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:06.535 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.532+0000 7f40f45ca700 1 -- 172.21.15.149:0/844979552 shutdown_connections 2023-11-08T19:25:06.535 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.532+0000 7f40f45ca700 1 -- 172.21.15.149:0/844979552 wait complete. 2023-11-08T19:25:06.545 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-08T19:25:06.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.669+0000 7fe797e2b700 1 Processor -- start 2023-11-08T19:25:06.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.669+0000 7fe797e2b700 1 -- start start 2023-11-08T19:25:06.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.670+0000 7fe797e2b700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe7900cdce0 0x7fe79006f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:06.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.670+0000 7fe797e2b700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fe79006ab80 0x7fe79006e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:06.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.670+0000 7fe797e2b700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7900af590 con 0x7fe7900cae40 2023-11-08T19:25:06.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.670+0000 7fe797e2b700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7900cb2f0 con 0x7fe7900cdce0 2023-11-08T19:25:06.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.670+0000 7fe797e2b700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe79006d8b0 con 0x7fe79006ab80 2023-11-08T19:25:06.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.670+0000 7fe795bc7700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe7900cdce0 0x7fe79006f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:06.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.670+0000 7fe795bc7700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe7900cdce0 0x7fe79006f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40670/0 (socket says 172.21.15.149:40670) 2023-11-08T19:25:06.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.670+0000 7fe795bc7700 1 -- 172.21.15.149:0/283823301 learned_addr learned my addr 172.21.15.149:0/283823301 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:06.675 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.670+0000 7fe7963c8700 1 --2- 172.21.15.149:0/283823301 >> v2:172.21.15.160:3300/0 conn(0x7fe79006ab80 0x7fe79006e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:06.675 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.670+0000 7fe795bc7700 1 -- 172.21.15.149:0/283823301 >> v2:172.21.15.160:3300/0 conn(0x7fe79006ab80 msgr2=0x7fe79006e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:06.675 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.670+0000 7fe795bc7700 1 --2- 172.21.15.149:0/283823301 >> v2:172.21.15.160:3300/0 conn(0x7fe79006ab80 0x7fe79006e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:06.675 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.670+0000 7fe795bc7700 1 -- 172.21.15.149:0/283823301 >> v1:172.21.15.160:6789/0 conn(0x7fe7900cae40 legacy=0x7fe7900ce0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:06.675 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.670+0000 7fe795bc7700 1 -- 172.21.15.149:0/283823301 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe790066f40 con 0x7fe7900cdce0 2023-11-08T19:25:06.676 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.671+0000 7fe795bc7700 1 --2- 172.21.15.149:0/283823301 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7900cdce0 0x7fe79006f030 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fe7900af7f0 tx=0x7fe780009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7f57dacac4852d6 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:06.676 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.671+0000 7fe794bc5700 1 -- 172.21.15.149:0/283823301 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe780004230 con 0x7fe7900cdce0 2023-11-08T19:25:06.676 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.671+0000 7fe794bc5700 1 -- 172.21.15.149:0/283823301 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe780004390 con 0x7fe7900cdce0 2023-11-08T19:25:06.676 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.671+0000 7fe794bc5700 1 -- 172.21.15.149:0/283823301 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7800036a0 con 0x7fe7900cdce0 2023-11-08T19:25:06.676 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.671+0000 7fe797e2b700 1 -- 172.21.15.149:0/283823301 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7900cdce0 msgr2=0x7fe79006f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:06.677 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.671+0000 7fe797e2b700 1 --2- 172.21.15.149:0/283823301 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7900cdce0 0x7fe79006f030 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fe7900af7f0 tx=0x7fe780009bd0 comp rx=0 tx=0).stop 2023-11-08T19:25:06.677 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.671+0000 7fe797e2b700 1 -- 172.21.15.149:0/283823301 shutdown_connections 2023-11-08T19:25:06.677 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.671+0000 7fe797e2b700 1 --2- 172.21.15.149:0/283823301 >> v2:172.21.15.160:3300/0 conn(0x7fe79006ab80 0x7fe79006e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:06.677 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.671+0000 7fe797e2b700 1 --2- 172.21.15.149:0/283823301 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7900cdce0 0x7fe79006f030 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:06.677 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.671+0000 7fe797e2b700 1 -- 172.21.15.149:0/283823301 >> 172.21.15.149:0/283823301 conn(0x7fe7900cc860 msgr2=0x7fe7900ccc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:06.678 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.671+0000 7fe797e2b700 1 -- 172.21.15.149:0/283823301 shutdown_connections 2023-11-08T19:25:06.678 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.671+0000 7fe797e2b700 1 -- 172.21.15.149:0/283823301 wait complete. 2023-11-08T19:25:06.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.673+0000 7fe797e2b700 1 Processor -- start 2023-11-08T19:25:06.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.673+0000 7fe797e2b700 1 -- start start 2023-11-08T19:25:06.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.673+0000 7fe797e2b700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe79006ab80 0x7fe79014ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:06.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.673+0000 7fe797e2b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7900cae40 0x7fe79014b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:06.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.673+0000 7fe797e2b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7900cdce0 0x7fe7900b4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:06.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.673+0000 7fe797e2b700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7900c8cb0 con 0x7fe7900cdce0 2023-11-08T19:25:06.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.673+0000 7fe797e2b700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe79014e630 con 0x7fe7900cae40 2023-11-08T19:25:06.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.673+0000 7fe797e2b700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7900c9810 con 0x7fe79006ab80 2023-11-08T19:25:06.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.673+0000 7fe7963c8700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7900cdce0 0x7fe7900b4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:06.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.673+0000 7fe7963c8700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7900cdce0 0x7fe7900b4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40678/0 (socket says 172.21.15.149:40678) 2023-11-08T19:25:06.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.673+0000 7fe7963c8700 1 -- 172.21.15.149:0/617084275 learned_addr learned my addr 172.21.15.149:0/617084275 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:06.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.674+0000 7fe795bc7700 1 --2- 172.21.15.149:0/617084275 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe79006ab80 0x7fe79014ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:06.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.674+0000 7fe7953c6700 1 --2- 172.21.15.149:0/617084275 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7900cae40 0x7fe79014b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:06.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.674+0000 7fe7963c8700 1 -- 172.21.15.149:0/617084275 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe79006ab80 msgr2=0x7fe79014ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:06.684 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.674+0000 7fe7963c8700 1 --2- 172.21.15.149:0/617084275 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe79006ab80 0x7fe79014ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:06.684 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.674+0000 7fe7963c8700 1 -- 172.21.15.149:0/617084275 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7900cae40 msgr2=0x7fe79014b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:06.684 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.674+0000 7fe7963c8700 1 --2- 172.21.15.149:0/617084275 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7900cae40 0x7fe79014b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:06.684 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.674+0000 7fe7963c8700 1 -- 172.21.15.149:0/617084275 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe780009550 con 0x7fe7900cdce0 2023-11-08T19:25:06.684 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.674+0000 7fe795bc7700 1 --2- 172.21.15.149:0/617084275 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe79006ab80 0x7fe79014ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:25:06.685 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.674+0000 7fe7963c8700 1 --2- 172.21.15.149:0/617084275 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7900cdce0 0x7fe7900b4c40 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fe78800cc60 tx=0x7fe78800a4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:06.685 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.674+0000 7fe7867fc700 1 -- 172.21.15.149:0/617084275 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78800ce60 con 0x7fe7900cdce0 2023-11-08T19:25:06.685 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.674+0000 7fe7867fc700 1 -- 172.21.15.149:0/617084275 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe78800acf0 con 0x7fe7900cdce0 2023-11-08T19:25:06.685 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.674+0000 7fe797e2b700 1 -- 172.21.15.149:0/617084275 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7900c8ee0 con 0x7fe7900cdce0 2023-11-08T19:25:06.685 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.674+0000 7fe7867fc700 1 -- 172.21.15.149:0/617084275 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe788003c40 con 0x7fe7900cdce0 2023-11-08T19:25:06.686 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.674+0000 7fe797e2b700 1 -- 172.21.15.149:0/617084275 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7900c94a0 con 0x7fe7900cdce0 2023-11-08T19:25:06.686 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.675+0000 7fe797e2b700 1 -- 172.21.15.149:0/617084275 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe79004f730 con 0x7fe7900cdce0 2023-11-08T19:25:06.686 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.675+0000 7fe7867fc700 1 -- 172.21.15.149:0/617084275 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe78800f3f0 con 0x7fe7900cdce0 2023-11-08T19:25:06.686 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.676+0000 7fe7867fc700 1 --2- 172.21.15.149:0/617084275 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe77406af00 0x7fe77406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:06.687 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.676+0000 7fe7867fc700 1 -- 172.21.15.149:0/617084275 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fe7880899b0 con 0x7fe7900cdce0 2023-11-08T19:25:06.687 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.676+0000 7fe795bc7700 1 --2- 172.21.15.149:0/617084275 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe77406af00 0x7fe77406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:06.687 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.676+0000 7fe795bc7700 1 --2- 172.21.15.149:0/617084275 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe77406af00 0x7fe77406d3c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe780009c10 tx=0x7fe780008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:06.687 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.681+0000 7fe7867fc700 1 -- 172.21.15.149:0/617084275 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe788054850 con 0x7fe7900cdce0 2023-11-08T19:25:06.871 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.869+0000 7fe797e2b700 1 -- 172.21.15.149:0/617084275 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe7900c9950 con 0x7fe7900cdce0 2023-11-08T19:25:06.871 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.870+0000 7fe7867fc700 1 -- 172.21.15.149:0/617084275 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v55) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe78801d070 con 0x7fe7900cdce0 2023-11-08T19:25:06.871 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 64 2023-11-08T19:25:06.874 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.872+0000 7fe797e2b700 1 -- 172.21.15.149:0/617084275 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe77406af00 msgr2=0x7fe77406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:06.874 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.872+0000 7fe797e2b700 1 --2- 172.21.15.149:0/617084275 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe77406af00 0x7fe77406d3c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe780009c10 tx=0x7fe780008030 comp rx=0 tx=0).stop 2023-11-08T19:25:06.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.872+0000 7fe797e2b700 1 -- 172.21.15.149:0/617084275 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7900cdce0 msgr2=0x7fe7900b4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:06.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.872+0000 7fe797e2b700 1 --2- 172.21.15.149:0/617084275 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7900cdce0 0x7fe7900b4c40 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fe78800cc60 tx=0x7fe78800a4d0 comp rx=0 tx=0).stop 2023-11-08T19:25:06.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.872+0000 7fe797e2b700 1 -- 172.21.15.149:0/617084275 shutdown_connections 2023-11-08T19:25:06.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.872+0000 7fe797e2b700 1 --2- 172.21.15.149:0/617084275 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe77406af00 0x7fe77406d3c0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:06.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.872+0000 7fe797e2b700 1 --2- 172.21.15.149:0/617084275 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7900cdce0 0x7fe7900b4c40 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:06.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.872+0000 7fe797e2b700 1 --2- 172.21.15.149:0/617084275 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe79006ab80 0x7fe79014ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:06.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.872+0000 7fe797e2b700 1 --2- 172.21.15.149:0/617084275 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7900cae40 0x7fe79014b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:06.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.872+0000 7fe797e2b700 1 -- 172.21.15.149:0/617084275 >> 172.21.15.149:0/617084275 conn(0x7fe7900cc860 msgr2=0x7fe7900cb9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:06.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.872+0000 7fe797e2b700 1 -- 172.21.15.149:0/617084275 shutdown_connections 2023-11-08T19:25:06.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:06.872+0000 7fe797e2b700 1 -- 172.21.15.149:0/617084275 wait complete. 2023-11-08T19:25:06.886 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-08T19:25:07.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.008+0000 7f6146df6700 1 Processor -- start 2023-11-08T19:25:07.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.008+0000 7f6146df6700 1 -- start start 2023-11-08T19:25:07.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.009+0000 7f6146df6700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f614015a780 0x7f614006f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:07.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.009+0000 7f6146df6700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f61400cfce0 0x7f614015ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:07.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.009+0000 7f6146df6700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6140072df0 con 0x7f614015ef50 2023-11-08T19:25:07.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.009+0000 7f6146df6700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f614006fdc0 con 0x7f614015a780 2023-11-08T19:25:07.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.009+0000 7f6146df6700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61400700a0 con 0x7f61400cfce0 2023-11-08T19:25:07.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.009+0000 7f6144b92700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f614015a780 0x7f614006f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:07.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.009+0000 7f6144b92700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f614015a780 0x7f614006f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40682/0 (socket says 172.21.15.149:40682) 2023-11-08T19:25:07.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.009+0000 7f6144b92700 1 -- 172.21.15.149:0/2053140377 learned_addr learned my addr 172.21.15.149:0/2053140377 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:07.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.009+0000 7f613ffff700 1 --2- 172.21.15.149:0/2053140377 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f61400cfce0 0x7f614015ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:07.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.009+0000 7f6144b92700 1 -- 172.21.15.149:0/2053140377 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f61400cfce0 msgr2=0x7f614015ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:07.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.009+0000 7f6144b92700 1 --2- 172.21.15.149:0/2053140377 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f61400cfce0 0x7f614015ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:07.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.009+0000 7f6144b92700 1 -- 172.21.15.149:0/2053140377 >> v1:172.21.15.160:6789/0 conn(0x7f614015ef50 legacy=0x7f61400b1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:07.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.009+0000 7f6144b92700 1 -- 172.21.15.149:0/2053140377 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6140070660 con 0x7f614015a780 2023-11-08T19:25:07.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.009+0000 7f6144b92700 1 --2- 172.21.15.149:0/2053140377 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f614015a780 0x7f614006f7e0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f61340098f0 tx=0x7f6134009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31a8dc6bc39bb175 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:07.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.009+0000 7f613f7fe700 1 -- 172.21.15.149:0/2053140377 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6134011830 con 0x7f614015a780 2023-11-08T19:25:07.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.009+0000 7f613f7fe700 1 -- 172.21.15.149:0/2053140377 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6134011990 con 0x7f614015a780 2023-11-08T19:25:07.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.009+0000 7f613f7fe700 1 -- 172.21.15.149:0/2053140377 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6134011d20 con 0x7f614015a780 2023-11-08T19:25:07.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.010+0000 7f6146df6700 1 -- 172.21.15.149:0/2053140377 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f614015a780 msgr2=0x7f614006f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:07.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.010+0000 7f6146df6700 1 --2- 172.21.15.149:0/2053140377 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f614015a780 0x7f614006f7e0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f61340098f0 tx=0x7f6134009c00 comp rx=0 tx=0).stop 2023-11-08T19:25:07.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.010+0000 7f6146df6700 1 -- 172.21.15.149:0/2053140377 shutdown_connections 2023-11-08T19:25:07.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.010+0000 7f6146df6700 1 --2- 172.21.15.149:0/2053140377 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f614015a780 0x7f614006f7e0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:07.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.010+0000 7f6146df6700 1 --2- 172.21.15.149:0/2053140377 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f61400cfce0 0x7f614015ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:07.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.010+0000 7f6146df6700 1 -- 172.21.15.149:0/2053140377 >> 172.21.15.149:0/2053140377 conn(0x7f61400ccff0 msgr2=0x7f61400cd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:07.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.010+0000 7f6146df6700 1 -- 172.21.15.149:0/2053140377 shutdown_connections 2023-11-08T19:25:07.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.010+0000 7f6146df6700 1 -- 172.21.15.149:0/2053140377 wait complete. 2023-11-08T19:25:07.018 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.011+0000 7f6146df6700 1 Processor -- start 2023-11-08T19:25:07.018 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.011+0000 7f6146df6700 1 -- start start 2023-11-08T19:25:07.020 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.012+0000 7f6146df6700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f61400cfce0 0x7f61401e5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:07.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.012+0000 7f6146df6700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f614015a780 0x7f61400c6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:07.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.012+0000 7f6146df6700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f614015ef50 0x7f61401e40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:07.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.012+0000 7f6146df6700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61401e4a60 con 0x7f614015ef50 2023-11-08T19:25:07.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.012+0000 7f6146df6700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61401e4d40 con 0x7f614015a780 2023-11-08T19:25:07.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.012+0000 7f6146df6700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61401e5020 con 0x7f61400cfce0 2023-11-08T19:25:07.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.012+0000 7f6145393700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f614015ef50 0x7f61401e40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:07.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.012+0000 7f6145393700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f614015ef50 0x7f61401e40f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40690/0 (socket says 172.21.15.149:40690) 2023-11-08T19:25:07.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.012+0000 7f6145393700 1 -- 172.21.15.149:0/1746398146 learned_addr learned my addr 172.21.15.149:0/1746398146 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:07.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.012+0000 7f613ffff700 1 --2- 172.21.15.149:0/1746398146 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f614015a780 0x7f61400c6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:07.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.012+0000 7f6144b92700 1 --2- 172.21.15.149:0/1746398146 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f61400cfce0 0x7f61401e5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:07.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.013+0000 7f6145393700 1 -- 172.21.15.149:0/1746398146 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f61400cfce0 msgr2=0x7f61401e5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:07.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.013+0000 7f6145393700 1 --2- 172.21.15.149:0/1746398146 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f61400cfce0 0x7f61401e5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:07.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.013+0000 7f6145393700 1 -- 172.21.15.149:0/1746398146 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f614015a780 msgr2=0x7f61400c6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:07.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.013+0000 7f6145393700 1 --2- 172.21.15.149:0/1746398146 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f614015a780 0x7f61400c6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:07.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.013+0000 7f6145393700 1 -- 172.21.15.149:0/1746398146 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6134009550 con 0x7f614015ef50 2023-11-08T19:25:07.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.013+0000 7f6145393700 1 --2- 172.21.15.149:0/1746398146 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f614015ef50 0x7f61401e40f0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f613800edf0 tx=0x7f613800c550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:07.025 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.013+0000 7f613d7fa700 1 -- 172.21.15.149:0/1746398146 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6138003a00 con 0x7f614015ef50 2023-11-08T19:25:07.025 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.013+0000 7f613d7fa700 1 -- 172.21.15.149:0/1746398146 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6138003b60 con 0x7f614015ef50 2023-11-08T19:25:07.025 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.013+0000 7f6146df6700 1 -- 172.21.15.149:0/1746398146 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61401e5300 con 0x7f614015ef50 2023-11-08T19:25:07.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.013+0000 7f613d7fa700 1 -- 172.21.15.149:0/1746398146 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61380050d0 con 0x7f614015ef50 2023-11-08T19:25:07.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.013+0000 7f6146df6700 1 -- 172.21.15.149:0/1746398146 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61400c66a0 con 0x7f614015ef50 2023-11-08T19:25:07.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.014+0000 7f6146df6700 1 -- 172.21.15.149:0/1746398146 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61401e5820 con 0x7f614015ef50 2023-11-08T19:25:07.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.014+0000 7f613d7fa700 1 -- 172.21.15.149:0/1746398146 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6138005230 con 0x7f614015ef50 2023-11-08T19:25:07.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.015+0000 7f613d7fa700 1 --2- 172.21.15.149:0/1746398146 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f612406af00 0x7f612406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:07.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.015+0000 7f613d7fa700 1 -- 172.21.15.149:0/1746398146 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f613808bdd0 con 0x7f614015ef50 2023-11-08T19:25:07.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.015+0000 7f6144b92700 1 --2- 172.21.15.149:0/1746398146 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f612406af00 0x7f612406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:07.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.015+0000 7f6144b92700 1 --2- 172.21.15.149:0/1746398146 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f612406af00 0x7f612406d3c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6134009c40 tx=0x7f6134008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:07.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.020+0000 7f613d7fa700 1 -- 172.21.15.149:0/1746398146 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f61401e5820 con 0x7f614015ef50 2023-11-08T19:25:07.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.227+0000 7f6146df6700 1 -- 172.21.15.149:0/1746398146 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f61401e5820 con 0x7f614015ef50 2023-11-08T19:25:07.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.227+0000 7f613d7fa700 1 -- 172.21.15.149:0/1746398146 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v55) v1 ==== 80+0+0 (secure 0 0 0) 0x7f61401e5820 con 0x7f614015ef50 2023-11-08T19:25:07.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.229+0000 7f6146df6700 1 -- 172.21.15.149:0/1746398146 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f612406af00 msgr2=0x7f612406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:07.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.229+0000 7f6146df6700 1 --2- 172.21.15.149:0/1746398146 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f612406af00 0x7f612406d3c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6134009c40 tx=0x7f6134008030 comp rx=0 tx=0).stop 2023-11-08T19:25:07.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.230+0000 7f6146df6700 1 -- 172.21.15.149:0/1746398146 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f614015ef50 msgr2=0x7f61401e40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:07.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.230+0000 7f6146df6700 1 --2- 172.21.15.149:0/1746398146 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f614015ef50 0x7f61401e40f0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f613800edf0 tx=0x7f613800c550 comp rx=0 tx=0).stop 2023-11-08T19:25:07.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.230+0000 7f6146df6700 1 -- 172.21.15.149:0/1746398146 shutdown_connections 2023-11-08T19:25:07.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.230+0000 7f6146df6700 1 --2- 172.21.15.149:0/1746398146 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f612406af00 0x7f612406d3c0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:07.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.230+0000 7f6146df6700 1 --2- 172.21.15.149:0/1746398146 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f614015ef50 0x7f61401e40f0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:07.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.230+0000 7f6146df6700 1 --2- 172.21.15.149:0/1746398146 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f61400cfce0 0x7f61401e5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:07.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.230+0000 7f6146df6700 1 --2- 172.21.15.149:0/1746398146 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f614015a780 0x7f61400c6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:07.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.230+0000 7f6146df6700 1 -- 172.21.15.149:0/1746398146 >> 172.21.15.149:0/1746398146 conn(0x7f61400ccff0 msgr2=0x7f614015c010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:07.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.230+0000 7f6146df6700 1 -- 172.21.15.149:0/1746398146 shutdown_connections 2023-11-08T19:25:07.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.230+0000 7f6146df6700 1 -- 172.21.15.149:0/1746398146 wait complete. 2023-11-08T19:25:07.234 INFO:teuthology.orchestra.run.smithi149.stderr:listed 0 entries 2023-11-08T19:25:07.243 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-08T19:25:07.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:25:07.244 DEBUG:teuthology.orchestra.run.smithi149:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-08T19:25:07.283 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi149.front.sepia.ceph.com 2023-11-08T19:25:07.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:25:07.284 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-08T19:25:07.341 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-11-08T19:25:07.342 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:25:07.364 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284272k,nr_inodes=4071068,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16330 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-08T19:25:07.364 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-11-08T19:25:07.364 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:25:07.398 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=8026740k,nr_inodes=2006685,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=31,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15303 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1609048k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-11-08T19:25:07.399 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-11-08T19:25:07.399 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:25:07.424 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284272k,nr_inodes=4071068,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16330 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-08T19:25:07.424 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:25:07.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.559+0000 7f07678c0700 1 Processor -- start 2023-11-08T19:25:07.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.559+0000 7f07678c0700 1 -- start start 2023-11-08T19:25:07.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.560+0000 7f07678c0700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f076015db70 0x7f0760161dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:07.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.560+0000 7f07678c0700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0760161940 con 0x7f07600b2c00 2023-11-08T19:25:07.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.560+0000 7f07678c0700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f076015e660 con 0x7f076006ab80 2023-11-08T19:25:07.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.560+0000 7f07678c0700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f076015eeb0 con 0x7f076015db70 2023-11-08T19:25:07.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.560+0000 7f0764e5b700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f07600b2c00 0x7f076015df50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:42698/0 (socket says 172.21.15.149:42698) 2023-11-08T19:25:07.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.560+0000 7f0764e5b700 1 -- 172.21.15.149:0/3523814302 learned_addr learned my addr 172.21.15.149:0/3523814302 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:25:07.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.560+0000 7f0757fff700 1 -- 172.21.15.149:0/3523814302 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1427772291 0 0) 0x7f0760161940 con 0x7f07600b2c00 2023-11-08T19:25:07.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.560+0000 7f076565c700 1 --2- 172.21.15.149:0/3523814302 >> v2:172.21.15.160:3300/0 conn(0x7f076015db70 0x7f0760161dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:07.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.560+0000 7f0757fff700 1 -- 172.21.15.149:0/3523814302 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f074c0035b0 con 0x7f07600b2c00 2023-11-08T19:25:07.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.560+0000 7f0757fff700 1 -- 172.21.15.149:0/3523814302 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 620620407 0 0) 0x7f074c0035b0 con 0x7f07600b2c00 2023-11-08T19:25:07.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.560+0000 7f0757fff700 1 -- 172.21.15.149:0/3523814302 >> v2:172.21.15.160:3300/0 conn(0x7f076015db70 msgr2=0x7f0760161dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:07.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.560+0000 7f0757fff700 1 --2- 172.21.15.149:0/3523814302 >> v2:172.21.15.160:3300/0 conn(0x7f076015db70 0x7f0760161dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:07.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.560+0000 7f0757fff700 1 -- 172.21.15.149:0/3523814302 >> v1:172.21.15.160:6789/0 conn(0x7f076006ab80 legacy=0x7f0760071dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:07.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.560+0000 7f0757fff700 1 -- 172.21.15.149:0/3523814302 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f076015e8f0 con 0x7f07600b2c00 2023-11-08T19:25:07.567 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.560+0000 7f0757fff700 1 -- 172.21.15.149:0/3523814302 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f0750001670 con 0x7f07600b2c00 2023-11-08T19:25:07.567 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.560+0000 7f0757fff700 1 -- 172.21.15.149:0/3523814302 >> v1:172.21.15.149:6789/0 conn(0x7f07600b2c00 legacy=0x7f076015df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:07.567 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.560+0000 7f0757fff700 1 --2- 172.21.15.149:0/3523814302 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f074c003a00 0x7f074c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:07.567 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.560+0000 7f0757fff700 1 --2- 172.21.15.149:0/3523814302 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f074c004850 0x7f074c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:07.567 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.560+0000 7f0757fff700 1 --2- 172.21.15.149:0/3523814302 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f074c005210 0x7f074c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:07.568 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.560+0000 7f0757fff700 1 -- 172.21.15.149:0/3523814302 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076015eeb0 con 0x7f074c004850 2023-11-08T19:25:07.568 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.560+0000 7f0757fff700 1 -- 172.21.15.149:0/3523814302 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f074c00c1b0 con 0x7f074c003a00 2023-11-08T19:25:07.568 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.560+0000 7f0757fff700 1 -- 172.21.15.149:0/3523814302 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f074c00c370 con 0x7f074c005210 2023-11-08T19:25:07.568 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.561+0000 7f0764e5b700 1 --2- 172.21.15.149:0/3523814302 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f074c004850 0x7f074c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:07.569 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.561+0000 7f076565c700 1 --2- 172.21.15.149:0/3523814302 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f074c003a00 0x7f074c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:07.569 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.561+0000 7f0765e5d700 1 --2- 172.21.15.149:0/3523814302 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f074c005210 0x7f074c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:07.569 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.561+0000 7f0764e5b700 1 -- 172.21.15.149:0/3523814302 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f074c005210 msgr2=0x7f074c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:07.569 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.561+0000 7f0764e5b700 1 --2- 172.21.15.149:0/3523814302 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f074c005210 0x7f074c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:07.569 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.561+0000 7f0764e5b700 1 -- 172.21.15.149:0/3523814302 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f074c003a00 msgr2=0x7f074c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:07.569 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.561+0000 7f0764e5b700 1 --2- 172.21.15.149:0/3523814302 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f074c003a00 0x7f074c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:07.570 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.561+0000 7f0764e5b700 1 -- 172.21.15.149:0/3523814302 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f074c0035b0 con 0x7f074c004850 2023-11-08T19:25:07.570 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.561+0000 7f0765e5d700 1 -- 172.21.15.149:0/3523814302 reap_dead start 2023-11-08T19:25:07.570 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.561+0000 7f0764e5b700 1 --2- 172.21.15.149:0/3523814302 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f074c004850 0x7f074c004cd0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f0750001050 tx=0x7f074c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0eea14a6186d3c7 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:07.570 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.561+0000 7f0757fff700 1 -- 172.21.15.149:0/3523814302 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075000cd50 con 0x7f074c004850 2023-11-08T19:25:07.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.561+0000 7f0757fff700 1 -- 172.21.15.149:0/3523814302 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0750005960 con 0x7f074c004850 2023-11-08T19:25:07.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.561+0000 7f0757fff700 1 -- 172.21.15.149:0/3523814302 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0750005d10 con 0x7f074c004850 2023-11-08T19:25:07.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.562+0000 7f07678c0700 1 -- 172.21.15.149:0/3523814302 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f074c004850 msgr2=0x7f074c004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:07.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.562+0000 7f07678c0700 1 --2- 172.21.15.149:0/3523814302 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f074c004850 0x7f074c004cd0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f0750001050 tx=0x7f074c005880 comp rx=0 tx=0).stop 2023-11-08T19:25:07.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.562+0000 7f07678c0700 1 -- 172.21.15.149:0/3523814302 shutdown_connections 2023-11-08T19:25:07.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.562+0000 7f07678c0700 1 --2- 172.21.15.149:0/3523814302 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f074c004850 0x7f074c004cd0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:07.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.562+0000 7f07678c0700 1 -- 172.21.15.149:0/3523814302 >> 172.21.15.149:0/3523814302 conn(0x7f07600ccff0 msgr2=0x7f07600cd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:07.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.562+0000 7f07678c0700 1 -- 172.21.15.149:0/3523814302 shutdown_connections 2023-11-08T19:25:07.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.562+0000 7f07678c0700 1 -- 172.21.15.149:0/3523814302 wait complete. 2023-11-08T19:25:07.575 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.563+0000 7f07678c0700 1 Processor -- start 2023-11-08T19:25:07.575 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.563+0000 7f07678c0700 1 -- start start 2023-11-08T19:25:07.575 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.564+0000 7f07678c0700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f074c004850 0x7f07600ad910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:07.576 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.564+0000 7f07678c0700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0760149650 0x7f07600ade50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:07.576 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.564+0000 7f07678c0700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f07600ae390 0x7f076014bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:07.576 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.564+0000 7f07678c0700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07600c7100 con 0x7f0760149650 2023-11-08T19:25:07.576 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.564+0000 7f07678c0700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07600c6b80 con 0x7f074c004850 2023-11-08T19:25:07.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.564+0000 7f07678c0700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07600c6e20 con 0x7f07600ae390 2023-11-08T19:25:07.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.564+0000 7f0764e5b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0760149650 0x7f07600ade50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:07.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.564+0000 7f0764e5b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0760149650 0x7f07600ade50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40708/0 (socket says 172.21.15.149:40708) 2023-11-08T19:25:07.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.564+0000 7f0764e5b700 1 -- 172.21.15.149:0/1993919176 learned_addr learned my addr 172.21.15.149:0/1993919176 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:07.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.564+0000 7f076565c700 1 --2- 172.21.15.149:0/1993919176 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f074c004850 0x7f07600ad910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:07.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.564+0000 7f0765e5d700 1 --2- 172.21.15.149:0/1993919176 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f07600ae390 0x7f076014bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:07.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.564+0000 7f0764e5b700 1 -- 172.21.15.149:0/1993919176 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f07600ae390 msgr2=0x7f076014bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:07.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.564+0000 7f0764e5b700 1 --2- 172.21.15.149:0/1993919176 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f07600ae390 0x7f076014bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:07.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.564+0000 7f0764e5b700 1 -- 172.21.15.149:0/1993919176 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f074c004850 msgr2=0x7f07600ad910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:07.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.564+0000 7f0764e5b700 1 --2- 172.21.15.149:0/1993919176 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f074c004850 0x7f07600ad910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:07.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.564+0000 7f0764e5b700 1 -- 172.21.15.149:0/1993919176 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0760149e10 con 0x7f0760149650 2023-11-08T19:25:07.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.564+0000 7f0765e5d700 1 --2- 172.21.15.149:0/1993919176 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f07600ae390 0x7f076014bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:25:07.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.564+0000 7f0764e5b700 1 --2- 172.21.15.149:0/1993919176 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0760149650 0x7f07600ade50 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f074c00c180 tx=0x7f0750000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:07.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.565+0000 7f0755ffb700 1 -- 172.21.15.149:0/1993919176 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0750007c00 con 0x7f0760149650 2023-11-08T19:25:07.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.565+0000 7f0755ffb700 1 -- 172.21.15.149:0/1993919176 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07500070d0 con 0x7f0760149650 2023-11-08T19:25:07.580 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.565+0000 7f07678c0700 1 -- 172.21.15.149:0/1993919176 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07600c46e0 con 0x7f0760149650 2023-11-08T19:25:07.580 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.565+0000 7f0755ffb700 1 -- 172.21.15.149:0/1993919176 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0750007460 con 0x7f0760149650 2023-11-08T19:25:07.580 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.565+0000 7f07678c0700 1 -- 172.21.15.149:0/1993919176 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f076015ce90 con 0x7f0760149650 2023-11-08T19:25:07.580 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.566+0000 7f07678c0700 1 -- 172.21.15.149:0/1993919176 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f076014a180 con 0x7f0760149650 2023-11-08T19:25:07.580 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.566+0000 7f0755ffb700 1 -- 172.21.15.149:0/1993919176 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f07500075c0 con 0x7f0760149650 2023-11-08T19:25:07.581 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.567+0000 7f0755ffb700 1 --2- 172.21.15.149:0/1993919176 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f074406af00 0x7f074406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:07.581 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.567+0000 7f076565c700 1 --2- 172.21.15.149:0/1993919176 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f074406af00 0x7f074406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:07.581 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.567+0000 7f0755ffb700 1 -- 172.21.15.149:0/1993919176 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f075008aef0 con 0x7f0760149650 2023-11-08T19:25:07.581 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.567+0000 7f076565c700 1 --2- 172.21.15.149:0/1993919176 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f074406af00 0x7f074406d3c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f075c009c60 tx=0x7f075c009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:07.582 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.572+0000 7f0755ffb700 1 -- 172.21.15.149:0/1993919176 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0750055eb0 con 0x7f0760149650 2023-11-08T19:25:07.804 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.803+0000 7f07678c0700 1 -- 172.21.15.149:0/1993919176 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0760149c70 con 0x7f0760149650 2023-11-08T19:25:07.805 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.804+0000 7f0755ffb700 1 -- 172.21.15.149:0/1993919176 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f0760149c70 con 0x7f0760149650 2023-11-08T19:25:07.806 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:25:07.806 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5455,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/2693283976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2693283976},{"type":"v1","addr":"172.21.15.160:6834","nonce":2693283976}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5458,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/3714474190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":3714474190},{"type":"v1","addr":"172.21.15.160:6835","nonce":3714474190}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5730,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/1885678824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":1885678824},{"type":"v1","addr":"172.21.15.149:6836","nonce":1885678824}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-08T19:24:51.735078+0000","modified":"2023-11-08T19:24:54.764447+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5733},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5733":{"gid":5733,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6837/4238261436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":4238261436},{"type":"v1","addr":"172.21.15.149:6837","nonce":4238261436}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-08T19:25:07.807 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.806+0000 7f07678c0700 1 -- 172.21.15.149:0/1993919176 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f074406af00 msgr2=0x7f074406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:07.808 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.806+0000 7f07678c0700 1 --2- 172.21.15.149:0/1993919176 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f074406af00 0x7f074406d3c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f075c009c60 tx=0x7f075c009210 comp rx=0 tx=0).stop 2023-11-08T19:25:07.808 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.806+0000 7f07678c0700 1 -- 172.21.15.149:0/1993919176 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0760149650 msgr2=0x7f07600ade50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:07.808 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.806+0000 7f07678c0700 1 --2- 172.21.15.149:0/1993919176 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0760149650 0x7f07600ade50 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f074c00c180 tx=0x7f0750000fe0 comp rx=0 tx=0).stop 2023-11-08T19:25:07.808 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.806+0000 7f07678c0700 1 -- 172.21.15.149:0/1993919176 shutdown_connections 2023-11-08T19:25:07.808 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.806+0000 7f07678c0700 1 --2- 172.21.15.149:0/1993919176 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f074406af00 0x7f074406d3c0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:07.809 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.806+0000 7f07678c0700 1 --2- 172.21.15.149:0/1993919176 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f074c004850 0x7f07600ad910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:07.809 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.806+0000 7f07678c0700 1 --2- 172.21.15.149:0/1993919176 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f07600ae390 0x7f076014bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:07.809 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.806+0000 7f07678c0700 1 --2- 172.21.15.149:0/1993919176 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0760149650 0x7f07600ade50 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:07.809 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.806+0000 7f07678c0700 1 -- 172.21.15.149:0/1993919176 >> 172.21.15.149:0/1993919176 conn(0x7f07600ccff0 msgr2=0x7f076015feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:07.809 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.806+0000 7f07678c0700 1 -- 172.21.15.149:0/1993919176 shutdown_connections 2023-11-08T19:25:07.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.806+0000 7f07678c0700 1 -- 172.21.15.149:0/1993919176 wait complete. 2023-11-08T19:25:07.810 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 25 2023-11-08T19:25:07.820 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:25:07.941 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.939+0000 7fe785797700 1 Processor -- start 2023-11-08T19:25:07.941 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.939+0000 7fe785797700 1 -- start start 2023-11-08T19:25:07.944 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.940+0000 7fe785797700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe78015b950 0x7fe7800ce130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:07.944 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.940+0000 7fe785797700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fe7800d0430 0x7fe7800ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:07.944 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.940+0000 7fe785797700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7800cc2e0 con 0x7fe7800cd5e0 2023-11-08T19:25:07.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.940+0000 7fe785797700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7800cc580 con 0x7fe7800d0430 2023-11-08T19:25:07.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.940+0000 7fe785797700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7800cc820 con 0x7fe78015b950 2023-11-08T19:25:07.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.940+0000 7fe77e7fc700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7fe7800cd5e0 0x7fe7800cfd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.149:54382/0 (socket says 172.21.15.149:54382) 2023-11-08T19:25:07.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.940+0000 7fe77e7fc700 1 -- 172.21.15.149:0/1697890605 learned_addr learned my addr 172.21.15.149:0/1697890605 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:25:07.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.940+0000 7fe77effd700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe78015b950 0x7fe7800ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:07.946 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.941+0000 7fe77f7fe700 1 --2- 172.21.15.149:0/1697890605 >> v2:172.21.15.160:3300/0 conn(0x7fe7800d0430 0x7fe7800ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:07.946 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.941+0000 7fe77dffb700 1 -- 172.21.15.149:0/1697890605 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4218140596 0 0) 0x7fe7800cc2e0 con 0x7fe7800cd5e0 2023-11-08T19:25:07.946 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.941+0000 7fe77dffb700 1 -- 172.21.15.149:0/1697890605 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7680035b0 con 0x7fe7800cd5e0 2023-11-08T19:25:07.946 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.941+0000 7fe77effd700 1 -- 172.21.15.149:0/1697890605 >> v2:172.21.15.160:3300/0 conn(0x7fe7800d0430 msgr2=0x7fe7800ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:07.947 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.941+0000 7fe77effd700 1 --2- 172.21.15.149:0/1697890605 >> v2:172.21.15.160:3300/0 conn(0x7fe7800d0430 0x7fe7800ce670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:07.947 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.941+0000 7fe77effd700 1 -- 172.21.15.149:0/1697890605 >> v1:172.21.15.160:6789/0 conn(0x7fe7800cd5e0 legacy=0x7fe7800cfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:07.947 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.941+0000 7fe77effd700 1 -- 172.21.15.149:0/1697890605 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7800ccb00 con 0x7fe78015b950 2023-11-08T19:25:07.947 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.941+0000 7fe77f7fe700 1 --2- 172.21.15.149:0/1697890605 >> v2:172.21.15.160:3300/0 conn(0x7fe7800d0430 0x7fe7800ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:25:07.948 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.941+0000 7fe77effd700 1 --2- 172.21.15.149:0/1697890605 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe78015b950 0x7fe7800ce130 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe774009820 tx=0x7fe774009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b93e23ca584fa93 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:07.948 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.941+0000 7fe77dffb700 1 -- 172.21.15.149:0/1697890605 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe774005e30 con 0x7fe78015b950 2023-11-08T19:25:07.948 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.941+0000 7fe77dffb700 1 -- 172.21.15.149:0/1697890605 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe774006030 con 0x7fe78015b950 2023-11-08T19:25:07.948 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.941+0000 7fe77dffb700 1 -- 172.21.15.149:0/1697890605 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7740063c0 con 0x7fe78015b950 2023-11-08T19:25:07.948 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.942+0000 7fe785797700 1 -- 172.21.15.149:0/1697890605 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe78015b950 msgr2=0x7fe7800ce130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:07.949 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.942+0000 7fe785797700 1 --2- 172.21.15.149:0/1697890605 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe78015b950 0x7fe7800ce130 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe774009820 tx=0x7fe774009b30 comp rx=0 tx=0).stop 2023-11-08T19:25:07.949 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.942+0000 7fe785797700 1 -- 172.21.15.149:0/1697890605 shutdown_connections 2023-11-08T19:25:07.949 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.942+0000 7fe785797700 1 --2- 172.21.15.149:0/1697890605 >> v2:172.21.15.160:3300/0 conn(0x7fe7800d0430 0x7fe7800ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:07.949 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.942+0000 7fe785797700 1 --2- 172.21.15.149:0/1697890605 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe78015b950 0x7fe7800ce130 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:07.950 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.942+0000 7fe785797700 1 -- 172.21.15.149:0/1697890605 >> 172.21.15.149:0/1697890605 conn(0x7fe78008afd0 msgr2=0x7fe7800d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:07.950 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.942+0000 7fe785797700 1 -- 172.21.15.149:0/1697890605 shutdown_connections 2023-11-08T19:25:07.950 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.942+0000 7fe785797700 1 -- 172.21.15.149:0/1697890605 wait complete. 2023-11-08T19:25:07.950 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.943+0000 7fe785797700 1 Processor -- start 2023-11-08T19:25:07.951 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.943+0000 7fe785797700 1 -- start start 2023-11-08T19:25:07.953 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.944+0000 7fe785797700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe7800d0430 0x7fe780153fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:07.954 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.944+0000 7fe785797700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe78015b950 0x7fe78015e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:07.954 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.944+0000 7fe785797700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7801545b0 0x7fe78015e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:07.954 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.944+0000 7fe785797700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe78015d010 con 0x7fe78015b950 2023-11-08T19:25:07.954 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.944+0000 7fe785797700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7800c6cd0 con 0x7fe7801545b0 2023-11-08T19:25:07.955 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.944+0000 7fe785797700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe78015eea0 con 0x7fe7800d0430 2023-11-08T19:25:07.955 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.944+0000 7fe77e7fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe78015b950 0x7fe78015e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:07.955 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.944+0000 7fe77e7fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe78015b950 0x7fe78015e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40722/0 (socket says 172.21.15.149:40722) 2023-11-08T19:25:07.955 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.944+0000 7fe77e7fc700 1 -- 172.21.15.149:0/807730730 learned_addr learned my addr 172.21.15.149:0/807730730 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:07.956 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.944+0000 7fe77f7fe700 1 --2- 172.21.15.149:0/807730730 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7801545b0 0x7fe78015e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:07.956 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.944+0000 7fe77effd700 1 --2- 172.21.15.149:0/807730730 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe7800d0430 0x7fe780153fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:07.956 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.944+0000 7fe77e7fc700 1 -- 172.21.15.149:0/807730730 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe7800d0430 msgr2=0x7fe780153fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:07.956 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.944+0000 7fe77e7fc700 1 --2- 172.21.15.149:0/807730730 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe7800d0430 0x7fe780153fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:07.956 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.944+0000 7fe77e7fc700 1 -- 172.21.15.149:0/807730730 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7801545b0 msgr2=0x7fe78015e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:07.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.944+0000 7fe77e7fc700 1 --2- 172.21.15.149:0/807730730 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7801545b0 0x7fe78015e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:07.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.944+0000 7fe77e7fc700 1 -- 172.21.15.149:0/807730730 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe778009a70 con 0x7fe78015b950 2023-11-08T19:25:07.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.944+0000 7fe77e7fc700 1 --2- 172.21.15.149:0/807730730 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe78015b950 0x7fe78015e420 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fe77000c700 tx=0x7fe77000cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:07.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.945+0000 7fe7677fe700 1 -- 172.21.15.149:0/807730730 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe770005d70 con 0x7fe78015b950 2023-11-08T19:25:07.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.945+0000 7fe7677fe700 1 -- 172.21.15.149:0/807730730 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7700070d0 con 0x7fe78015b950 2023-11-08T19:25:07.958 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.945+0000 7fe7677fe700 1 -- 172.21.15.149:0/807730730 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe770007460 con 0x7fe78015b950 2023-11-08T19:25:07.958 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.945+0000 7fe785797700 1 -- 172.21.15.149:0/807730730 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe774009430 con 0x7fe78015b950 2023-11-08T19:25:07.958 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.945+0000 7fe785797700 1 -- 172.21.15.149:0/807730730 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7800c7200 con 0x7fe78015b950 2023-11-08T19:25:07.958 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.946+0000 7fe785797700 1 -- 172.21.15.149:0/807730730 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7800745f0 con 0x7fe78015b950 2023-11-08T19:25:07.958 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.946+0000 7fe7677fe700 1 -- 172.21.15.149:0/807730730 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe7700075c0 con 0x7fe78015b950 2023-11-08T19:25:07.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.947+0000 7fe7677fe700 1 --2- 172.21.15.149:0/807730730 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe76c06af00 0x7fe76c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:07.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.947+0000 7fe77effd700 1 --2- 172.21.15.149:0/807730730 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe76c06af00 0x7fe76c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:07.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.947+0000 7fe7677fe700 1 -- 172.21.15.149:0/807730730 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fe770088ea0 con 0x7fe78015b950 2023-11-08T19:25:07.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.947+0000 7fe77effd700 1 --2- 172.21.15.149:0/807730730 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe76c06af00 0x7fe76c06d3c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe774000c00 tx=0x7fe774008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:07.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:07.952+0000 7fe7677fe700 1 -- 172.21.15.149:0/807730730 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe770053c20 con 0x7fe78015b950 2023-11-08T19:25:07.967 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T19:25:07.970 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T19:25:08.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.155+0000 7fe785797700 1 -- 172.21.15.149:0/807730730 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe78008b760 con 0x7fe78015b950 2023-11-08T19:25:08.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.156+0000 7fe7677fe700 1 -- 172.21.15.149:0/807730730 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+18559 (secure 0 0 0) 0x7fe770057240 con 0x7fe78015b950 2023-11-08T19:25:08.157 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:25:08.158 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":55,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:24:53.348156+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-08T19:24:29.516185+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-08T19:24:49.982090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-08T19:24:50.696398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:25:08.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.158+0000 7fe785797700 1 -- 172.21.15.149:0/807730730 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe76c06af00 msgr2=0x7fe76c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:08.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.158+0000 7fe785797700 1 --2- 172.21.15.149:0/807730730 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe76c06af00 0x7fe76c06d3c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe774000c00 tx=0x7fe774008070 comp rx=0 tx=0).stop 2023-11-08T19:25:08.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.158+0000 7fe785797700 1 -- 172.21.15.149:0/807730730 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe78015b950 msgr2=0x7fe78015e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:08.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.158+0000 7fe785797700 1 --2- 172.21.15.149:0/807730730 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe78015b950 0x7fe78015e420 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fe77000c700 tx=0x7fe77000cac0 comp rx=0 tx=0).stop 2023-11-08T19:25:08.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.158+0000 7fe785797700 1 -- 172.21.15.149:0/807730730 shutdown_connections 2023-11-08T19:25:08.161 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.158+0000 7fe785797700 1 --2- 172.21.15.149:0/807730730 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe76c06af00 0x7fe76c06d3c0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:08.161 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.158+0000 7fe785797700 1 --2- 172.21.15.149:0/807730730 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7801545b0 0x7fe78015e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:08.161 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.158+0000 7fe785797700 1 --2- 172.21.15.149:0/807730730 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe7800d0430 0x7fe780153fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:08.161 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.158+0000 7fe785797700 1 --2- 172.21.15.149:0/807730730 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe78015b950 0x7fe78015e420 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:08.161 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.158+0000 7fe785797700 1 -- 172.21.15.149:0/807730730 >> 172.21.15.149:0/807730730 conn(0x7fe78008afd0 msgr2=0x7fe7800b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:08.162 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.158+0000 7fe785797700 1 -- 172.21.15.149:0/807730730 shutdown_connections 2023-11-08T19:25:08.162 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.158+0000 7fe785797700 1 -- 172.21.15.149:0/807730730 wait complete. 2023-11-08T19:25:08.172 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-08T19:22:56.023194+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-08T19:24:29.516185+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 42, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-08T19:24:49.982090+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-11-08T19:24:50.696398+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-08T19:25:08.173 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-08T19:25:08.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.295+0000 7fc89a38e700 1 Processor -- start 2023-11-08T19:25:08.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.295+0000 7fc89a38e700 1 -- start start 2023-11-08T19:25:08.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.296+0000 7fc89a38e700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fc89415abf0 0x7fc8940b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:08.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.296+0000 7fc89a38e700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc8940d1130 0x7fc8940cc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:08.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.296+0000 7fc89a38e700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8940b6470 con 0x7fc8940cc6a0 2023-11-08T19:25:08.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.296+0000 7fc89a38e700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8940b66a0 con 0x7fc89415abf0 2023-11-08T19:25:08.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.296+0000 7fc89a38e700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8940d04a0 con 0x7fc8940d1130 2023-11-08T19:25:08.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.296+0000 7fc8937fe700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc8940d1130 0x7fc8940cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:08.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.296+0000 7fc893fff700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fc89415abf0 0x7fc8940b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:08.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.297+0000 7fc8937fe700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc8940d1130 0x7fc8940cc160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.149:32784/0 (socket says 172.21.15.149:32784) 2023-11-08T19:25:08.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.297+0000 7fc8937fe700 1 -- 172.21.15.149:0/147380713 learned_addr learned my addr 172.21.15.149:0/147380713 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:08.302 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.297+0000 7fc89892b700 1 --1- 172.21.15.149:0/147380713 >> v1:172.21.15.160:6789/0 conn(0x7fc8940cc6a0 0x7fc8940ce210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.149:54398/0 (socket says 172.21.15.149:54398) 2023-11-08T19:25:08.302 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.297+0000 7fc8937fe700 1 -- 172.21.15.149:0/147380713 >> v2:172.21.15.160:3300/0 conn(0x7fc89415abf0 msgr2=0x7fc8940b5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:08.302 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.297+0000 7fc8937fe700 1 --2- 172.21.15.149:0/147380713 >> v2:172.21.15.160:3300/0 conn(0x7fc89415abf0 0x7fc8940b5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:08.302 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.297+0000 7fc8937fe700 1 -- 172.21.15.149:0/147380713 >> v1:172.21.15.160:6789/0 conn(0x7fc8940cc6a0 legacy=0x7fc8940ce210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:08.303 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.297+0000 7fc8937fe700 1 -- 172.21.15.149:0/147380713 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc89415afd0 con 0x7fc8940d1130 2023-11-08T19:25:08.303 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.297+0000 7fc893fff700 1 --2- 172.21.15.149:0/147380713 >> v2:172.21.15.160:3300/0 conn(0x7fc89415abf0 0x7fc8940b5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:25:08.303 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.297+0000 7fc8937fe700 1 --2- 172.21.15.149:0/147380713 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc8940d1130 0x7fc8940cc160 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc88400bb90 tx=0x7fc88400bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13ad0147b7aa8ca6 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:08.303 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.297+0000 7fc892ffd700 1 -- 172.21.15.149:0/147380713 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88400dd30 con 0x7fc8940d1130 2023-11-08T19:25:08.303 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.297+0000 7fc892ffd700 1 -- 172.21.15.149:0/147380713 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc88400de90 con 0x7fc8940d1130 2023-11-08T19:25:08.304 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.297+0000 7fc892ffd700 1 -- 172.21.15.149:0/147380713 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc884010690 con 0x7fc8940d1130 2023-11-08T19:25:08.304 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.298+0000 7fc89a38e700 1 -- 172.21.15.149:0/147380713 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc8940d1130 msgr2=0x7fc8940cc160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:08.304 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.298+0000 7fc89a38e700 1 --2- 172.21.15.149:0/147380713 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc8940d1130 0x7fc8940cc160 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc88400bb90 tx=0x7fc88400bea0 comp rx=0 tx=0).stop 2023-11-08T19:25:08.304 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.298+0000 7fc89a38e700 1 -- 172.21.15.149:0/147380713 shutdown_connections 2023-11-08T19:25:08.304 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.298+0000 7fc89a38e700 1 --2- 172.21.15.149:0/147380713 >> v2:172.21.15.160:3300/0 conn(0x7fc89415abf0 0x7fc8940b5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:08.305 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.298+0000 7fc89a38e700 1 --2- 172.21.15.149:0/147380713 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc8940d1130 0x7fc8940cc160 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:08.305 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.298+0000 7fc89a38e700 1 -- 172.21.15.149:0/147380713 >> 172.21.15.149:0/147380713 conn(0x7fc8940d0640 msgr2=0x7fc8940d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:08.305 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.298+0000 7fc89a38e700 1 -- 172.21.15.149:0/147380713 shutdown_connections 2023-11-08T19:25:08.305 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.298+0000 7fc89a38e700 1 -- 172.21.15.149:0/147380713 wait complete. 2023-11-08T19:25:08.305 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.299+0000 7fc89a38e700 1 Processor -- start 2023-11-08T19:25:08.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.299+0000 7fc89a38e700 1 -- start start 2023-11-08T19:25:08.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.300+0000 7fc89a38e700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc8940cc6a0 0x7fc8940b3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:08.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.300+0000 7fc89a38e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8940d1130 0x7fc8940c6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:08.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.300+0000 7fc89a38e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc89415abf0 0x7fc8941567a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:08.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.300+0000 7fc89a38e700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc894144d50 con 0x7fc8940d1130 2023-11-08T19:25:08.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.300+0000 7fc89a38e700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8941443b0 con 0x7fc89415abf0 2023-11-08T19:25:08.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.300+0000 7fc89a38e700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc894144690 con 0x7fc8940cc6a0 2023-11-08T19:25:08.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.300+0000 7fc8937fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8940d1130 0x7fc8940c6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:08.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.300+0000 7fc8937fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8940d1130 0x7fc8940c6090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40734/0 (socket says 172.21.15.149:40734) 2023-11-08T19:25:08.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.300+0000 7fc8937fe700 1 -- 172.21.15.149:0/1284338659 learned_addr learned my addr 172.21.15.149:0/1284338659 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:08.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.300+0000 7fc893fff700 1 --2- 172.21.15.149:0/1284338659 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc8940cc6a0 0x7fc8940b3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:08.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.300+0000 7fc89892b700 1 --2- 172.21.15.149:0/1284338659 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc89415abf0 0x7fc8941567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:08.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.300+0000 7fc8937fe700 1 -- 172.21.15.149:0/1284338659 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc8940cc6a0 msgr2=0x7fc8940b3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:08.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.300+0000 7fc8937fe700 1 --2- 172.21.15.149:0/1284338659 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc8940cc6a0 0x7fc8940b3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:08.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.300+0000 7fc8937fe700 1 -- 172.21.15.149:0/1284338659 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc89415abf0 msgr2=0x7fc8941567a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:08.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.300+0000 7fc8937fe700 1 --2- 172.21.15.149:0/1284338659 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc89415abf0 0x7fc8941567a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:08.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.300+0000 7fc8937fe700 1 -- 172.21.15.149:0/1284338659 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8880094a0 con 0x7fc8940d1130 2023-11-08T19:25:08.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.301+0000 7fc8937fe700 1 --2- 172.21.15.149:0/1284338659 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8940d1130 0x7fc8940c6090 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fc884000c00 tx=0x7fc884004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:08.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.301+0000 7fc890ff9700 1 -- 172.21.15.149:0/1284338659 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88401f070 con 0x7fc8940d1130 2023-11-08T19:25:08.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.301+0000 7fc890ff9700 1 -- 172.21.15.149:0/1284338659 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc884003970 con 0x7fc8940d1130 2023-11-08T19:25:08.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.301+0000 7fc89a38e700 1 -- 172.21.15.149:0/1284338659 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc88400b7f0 con 0x7fc8940d1130 2023-11-08T19:25:08.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.301+0000 7fc890ff9700 1 -- 172.21.15.149:0/1284338659 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc884003d40 con 0x7fc8940d1130 2023-11-08T19:25:08.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.301+0000 7fc89a38e700 1 -- 172.21.15.149:0/1284338659 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8940c65d0 con 0x7fc8940d1130 2023-11-08T19:25:08.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.302+0000 7fc89a38e700 1 -- 172.21.15.149:0/1284338659 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc894144e90 con 0x7fc8940d1130 2023-11-08T19:25:08.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.302+0000 7fc890ff9700 1 -- 172.21.15.149:0/1284338659 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc884019400 con 0x7fc8940d1130 2023-11-08T19:25:08.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.303+0000 7fc890ff9700 1 --2- 172.21.15.149:0/1284338659 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc88006af00 0x7fc88006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:08.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.303+0000 7fc890ff9700 1 -- 172.21.15.149:0/1284338659 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fc88408cb50 con 0x7fc8940d1130 2023-11-08T19:25:08.314 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.303+0000 7fc893fff700 1 --2- 172.21.15.149:0/1284338659 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc88006af00 0x7fc88006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:08.314 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.303+0000 7fc893fff700 1 --2- 172.21.15.149:0/1284338659 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc88006af00 0x7fc88006d3c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc888009cd0 tx=0x7fc888009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:08.314 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.308+0000 7fc890ff9700 1 -- 172.21.15.149:0/1284338659 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc894144e90 con 0x7fc8940d1130 2023-11-08T19:25:08.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.501+0000 7fc89a38e700 1 -- 172.21.15.149:0/1284338659 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc894144e90 con 0x7fc8940d1130 2023-11-08T19:25:08.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.502+0000 7fc890ff9700 1 -- 172.21.15.149:0/1284338659 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v55) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc894144e90 con 0x7fc8940d1130 2023-11-08T19:25:08.503 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 1 2023-11-08T19:25:08.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.504+0000 7fc89a38e700 1 -- 172.21.15.149:0/1284338659 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc88006af00 msgr2=0x7fc88006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:08.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.504+0000 7fc89a38e700 1 --2- 172.21.15.149:0/1284338659 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc88006af00 0x7fc88006d3c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc888009cd0 tx=0x7fc888009210 comp rx=0 tx=0).stop 2023-11-08T19:25:08.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.504+0000 7fc89a38e700 1 -- 172.21.15.149:0/1284338659 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8940d1130 msgr2=0x7fc8940c6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:08.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.504+0000 7fc89a38e700 1 --2- 172.21.15.149:0/1284338659 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8940d1130 0x7fc8940c6090 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fc884000c00 tx=0x7fc884004750 comp rx=0 tx=0).stop 2023-11-08T19:25:08.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.504+0000 7fc89a38e700 1 -- 172.21.15.149:0/1284338659 shutdown_connections 2023-11-08T19:25:08.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.504+0000 7fc89a38e700 1 --2- 172.21.15.149:0/1284338659 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc88006af00 0x7fc88006d3c0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:08.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.504+0000 7fc89a38e700 1 --2- 172.21.15.149:0/1284338659 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc89415abf0 0x7fc8941567a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:08.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.504+0000 7fc89a38e700 1 --2- 172.21.15.149:0/1284338659 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc8940cc6a0 0x7fc8940b3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:08.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.504+0000 7fc89a38e700 1 --2- 172.21.15.149:0/1284338659 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8940d1130 0x7fc8940c6090 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:08.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.504+0000 7fc89a38e700 1 -- 172.21.15.149:0/1284338659 >> 172.21.15.149:0/1284338659 conn(0x7fc8940d0640 msgr2=0x7fc89406ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:08.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.504+0000 7fc89a38e700 1 -- 172.21.15.149:0/1284338659 shutdown_connections 2023-11-08T19:25:08.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.504+0000 7fc89a38e700 1 -- 172.21.15.149:0/1284338659 wait complete. 2023-11-08T19:25:08.517 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-08T19:25:08.641 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.640+0000 7f05ee20f700 1 Processor -- start 2023-11-08T19:25:08.642 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.640+0000 7f05ee20f700 1 -- start start 2023-11-08T19:25:08.650 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.641+0000 7f05ee20f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05e80cc870 0x7f05e80b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:08.650 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.641+0000 7f05ee20f700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05e80b6470 con 0x7f05e815abf0 2023-11-08T19:25:08.651 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.641+0000 7f05ee20f700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05e815afd0 con 0x7f05e80d1130 2023-11-08T19:25:08.651 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.641+0000 7f05ee20f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05e80b66a0 con 0x7f05e80cc870 2023-11-08T19:25:08.651 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.641+0000 7f05e77fe700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f05e815abf0 0x7f05e80cc160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:42742/0 (socket says 172.21.15.149:42742) 2023-11-08T19:25:08.651 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.641+0000 7f05e77fe700 1 -- 172.21.15.149:0/923071033 learned_addr learned my addr 172.21.15.149:0/923071033 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:25:08.652 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.641+0000 7f05e67fc700 1 -- 172.21.15.149:0/923071033 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 977711975 0 0) 0x7f05e80b6470 con 0x7f05e815abf0 2023-11-08T19:25:08.652 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.641+0000 7f05e67fc700 1 -- 172.21.15.149:0/923071033 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05d40035b0 con 0x7f05e815abf0 2023-11-08T19:25:08.652 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.641+0000 7f05e7fff700 1 --2- 172.21.15.149:0/923071033 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05e80cc870 0x7f05e80b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:08.652 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.641+0000 7f05e67fc700 1 -- 172.21.15.149:0/923071033 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1432064550 0 0) 0x7f05d40035b0 con 0x7f05e815abf0 2023-11-08T19:25:08.652 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.641+0000 7f05e67fc700 1 -- 172.21.15.149:0/923071033 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05e80cc870 msgr2=0x7f05e80b5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:08.652 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.641+0000 7f05e67fc700 1 --2- 172.21.15.149:0/923071033 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05e80cc870 0x7f05e80b5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:08.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.641+0000 7f05e67fc700 1 -- 172.21.15.149:0/923071033 >> v1:172.21.15.160:6789/0 conn(0x7f05e80d1130 legacy=0x7f05e806bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:08.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.641+0000 7f05e67fc700 1 -- 172.21.15.149:0/923071033 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e815e880 con 0x7f05e815abf0 2023-11-08T19:25:08.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.641+0000 7f05e67fc700 1 -- 172.21.15.149:0/923071033 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f05d0001670 con 0x7f05e815abf0 2023-11-08T19:25:08.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.642+0000 7f05e67fc700 1 -- 172.21.15.149:0/923071033 >> v1:172.21.15.149:6789/0 conn(0x7f05e815abf0 legacy=0x7f05e80cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:08.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.642+0000 7f05e67fc700 1 --2- 172.21.15.149:0/923071033 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05d4003aa0 0x7f05d4003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:08.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.642+0000 7f05e67fc700 1 --2- 172.21.15.149:0/923071033 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05e80cc870 0x7f05d4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:08.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.642+0000 7f05e67fc700 1 --2- 172.21.15.149:0/923071033 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05d4004d90 0x7f05d4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:08.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.642+0000 7f05e67fc700 1 -- 172.21.15.149:0/923071033 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e80b66a0 con 0x7f05d4004d90 2023-11-08T19:25:08.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.642+0000 7f05e67fc700 1 -- 172.21.15.149:0/923071033 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d400bbd0 con 0x7f05d4003aa0 2023-11-08T19:25:08.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.642+0000 7f05e67fc700 1 -- 172.21.15.149:0/923071033 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05d400dfa0 con 0x7f05e80cc870 2023-11-08T19:25:08.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.642+0000 7f05e7fff700 1 --2- 172.21.15.149:0/923071033 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05d4004d90 0x7f05d4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:08.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.642+0000 7f05e77fe700 1 --2- 172.21.15.149:0/923071033 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05d4003aa0 0x7f05d4003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:08.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.642+0000 7f05e6ffd700 1 --2- 172.21.15.149:0/923071033 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05e80cc870 0x7f05d4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:08.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.642+0000 7f05e7fff700 1 -- 172.21.15.149:0/923071033 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05e80cc870 msgr2=0x7f05d4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:08.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.642+0000 7f05e7fff700 1 --2- 172.21.15.149:0/923071033 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05e80cc870 0x7f05d4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:08.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.642+0000 7f05e7fff700 1 -- 172.21.15.149:0/923071033 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05d4003aa0 msgr2=0x7f05d4003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:08.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.642+0000 7f05e7fff700 1 --2- 172.21.15.149:0/923071033 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05d4003aa0 0x7f05d4003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:08.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.642+0000 7f05e7fff700 1 -- 172.21.15.149:0/923071033 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d40035b0 con 0x7f05d4004d90 2023-11-08T19:25:08.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.642+0000 7f05e7fff700 1 --2- 172.21.15.149:0/923071033 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05d4004d90 0x7f05d4005210 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f05e0009fc0 tx=0x7f05d4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92e033592f17c4ed server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:08.657 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.642+0000 7f05e67fc700 1 -- 172.21.15.149:0/923071033 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e000ec30 con 0x7f05d4004d90 2023-11-08T19:25:08.657 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.642+0000 7f05e67fc700 1 -- 172.21.15.149:0/923071033 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05e000f040 con 0x7f05d4004d90 2023-11-08T19:25:08.657 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.642+0000 7f05e67fc700 1 -- 172.21.15.149:0/923071033 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e0014480 con 0x7f05d4004d90 2023-11-08T19:25:08.657 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.643+0000 7f05ee20f700 1 -- 172.21.15.149:0/923071033 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05d4004d90 msgr2=0x7f05d4005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:08.658 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.643+0000 7f05ee20f700 1 --2- 172.21.15.149:0/923071033 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05d4004d90 0x7f05d4005210 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f05e0009fc0 tx=0x7f05d4005880 comp rx=0 tx=0).stop 2023-11-08T19:25:08.658 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.643+0000 7f05e7fff700 1 -- 172.21.15.149:0/923071033 reap_dead start 2023-11-08T19:25:08.658 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.643+0000 7f05ee20f700 1 -- 172.21.15.149:0/923071033 shutdown_connections 2023-11-08T19:25:08.658 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.643+0000 7f05ee20f700 1 -- 172.21.15.149:0/923071033 >> 172.21.15.149:0/923071033 conn(0x7f05e80d0640 msgr2=0x7f05e80d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:08.658 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.643+0000 7f05ee20f700 1 -- 172.21.15.149:0/923071033 shutdown_connections 2023-11-08T19:25:08.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.643+0000 7f05ee20f700 1 -- 172.21.15.149:0/923071033 wait complete. 2023-11-08T19:25:08.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.644+0000 7f05ee20f700 1 Processor -- start 2023-11-08T19:25:08.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.644+0000 7f05ee20f700 1 -- start start 2023-11-08T19:25:08.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.645+0000 7f05ee20f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05e814f680 0x7f05e80ce120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:08.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.645+0000 7f05ee20f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05e80ce660 0x7f05e815b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:08.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.645+0000 7f05ee20f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05e815b6a0 0x7f05e8155c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:08.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.645+0000 7f05ee20f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e814ff80 con 0x7f05e814f680 2023-11-08T19:25:08.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.645+0000 7f05ee20f700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e80ceae0 con 0x7f05e80ce660 2023-11-08T19:25:08.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.645+0000 7f05ee20f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05e815be20 con 0x7f05e815b6a0 2023-11-08T19:25:08.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.645+0000 7f05e77fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05e814f680 0x7f05e80ce120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:08.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.645+0000 7f05e77fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05e814f680 0x7f05e80ce120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40750/0 (socket says 172.21.15.149:40750) 2023-11-08T19:25:08.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.645+0000 7f05e77fe700 1 -- 172.21.15.149:0/981908193 learned_addr learned my addr 172.21.15.149:0/981908193 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:08.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.645+0000 7f05e7fff700 1 --2- 172.21.15.149:0/981908193 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05e815b6a0 0x7f05e8155c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:08.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.645+0000 7f05e6ffd700 1 --2- 172.21.15.149:0/981908193 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05e80ce660 0x7f05e815b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:08.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.645+0000 7f05e77fe700 1 -- 172.21.15.149:0/981908193 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05e815b6a0 msgr2=0x7f05e8155c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:08.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.645+0000 7f05e77fe700 1 --2- 172.21.15.149:0/981908193 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05e815b6a0 0x7f05e8155c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:08.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.645+0000 7f05e77fe700 1 -- 172.21.15.149:0/981908193 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05e80ce660 msgr2=0x7f05e815b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:08.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.645+0000 7f05e77fe700 1 --2- 172.21.15.149:0/981908193 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05e80ce660 0x7f05e815b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:08.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.645+0000 7f05e77fe700 1 -- 172.21.15.149:0/981908193 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e815d270 con 0x7f05e814f680 2023-11-08T19:25:08.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.645+0000 7f05e6ffd700 1 --2- 172.21.15.149:0/981908193 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05e80ce660 0x7f05e815b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:25:08.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.645+0000 7f05e77fe700 1 --2- 172.21.15.149:0/981908193 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05e814f680 0x7f05e80ce120 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f05d0007290 tx=0x7f05d00075a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:08.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.646+0000 7f05dffff700 1 -- 172.21.15.149:0/981908193 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d0012560 con 0x7f05e814f680 2023-11-08T19:25:08.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.646+0000 7f05dffff700 1 -- 172.21.15.149:0/981908193 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05d00126c0 con 0x7f05e814f680 2023-11-08T19:25:08.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.646+0000 7f05ee20f700 1 -- 172.21.15.149:0/981908193 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05e815d4f0 con 0x7f05e814f680 2023-11-08T19:25:08.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.646+0000 7f05dffff700 1 -- 172.21.15.149:0/981908193 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d0012a50 con 0x7f05e814f680 2023-11-08T19:25:08.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.646+0000 7f05ee20f700 1 -- 172.21.15.149:0/981908193 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05e815dab0 con 0x7f05e814f680 2023-11-08T19:25:08.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.647+0000 7f05ee20f700 1 -- 172.21.15.149:0/981908193 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05e80d0f50 con 0x7f05e814f680 2023-11-08T19:25:08.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.647+0000 7f05dffff700 1 -- 172.21.15.149:0/981908193 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f05d0012bb0 con 0x7f05e814f680 2023-11-08T19:25:08.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.647+0000 7f05dffff700 1 --2- 172.21.15.149:0/981908193 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f05c806af00 0x7f05c806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:08.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.648+0000 7f05dffff700 1 -- 172.21.15.149:0/981908193 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f05d0089790 con 0x7f05e814f680 2023-11-08T19:25:08.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.648+0000 7f05e6ffd700 1 --2- 172.21.15.149:0/981908193 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f05c806af00 0x7f05c806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:08.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.648+0000 7f05e6ffd700 1 --2- 172.21.15.149:0/981908193 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f05c806af00 0x7f05c806d3c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f05e81f2bd0 tx=0x7f05d8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:08.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.652+0000 7f05dffff700 1 -- 172.21.15.149:0/981908193 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f05d0054510 con 0x7f05e814f680 2023-11-08T19:25:08.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.840+0000 7f05ee20f700 1 -- 172.21.15.149:0/981908193 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f05e804f730 con 0x7f05e814f680 2023-11-08T19:25:08.842 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.840+0000 7f05dffff700 1 -- 172.21.15.149:0/981908193 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v55) v1 ==== 103+0+11 (secure 0 0 0) 0x7f05d0057b30 con 0x7f05e814f680 2023-11-08T19:25:08.842 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:25:08.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.842+0000 7f05ee20f700 1 -- 172.21.15.149:0/981908193 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f05c806af00 msgr2=0x7f05c806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:08.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.842+0000 7f05ee20f700 1 --2- 172.21.15.149:0/981908193 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f05c806af00 0x7f05c806d3c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f05e81f2bd0 tx=0x7f05d8009040 comp rx=0 tx=0).stop 2023-11-08T19:25:08.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.842+0000 7f05ee20f700 1 -- 172.21.15.149:0/981908193 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05e814f680 msgr2=0x7f05e80ce120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:08.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.842+0000 7f05ee20f700 1 --2- 172.21.15.149:0/981908193 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05e814f680 0x7f05e80ce120 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f05d0007290 tx=0x7f05d00075a0 comp rx=0 tx=0).stop 2023-11-08T19:25:08.845 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.842+0000 7f05ee20f700 1 -- 172.21.15.149:0/981908193 shutdown_connections 2023-11-08T19:25:08.845 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.842+0000 7f05ee20f700 1 --2- 172.21.15.149:0/981908193 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f05c806af00 0x7f05c806d3c0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:08.845 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.842+0000 7f05ee20f700 1 --2- 172.21.15.149:0/981908193 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05e815b6a0 0x7f05e8155c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:08.845 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.842+0000 7f05ee20f700 1 --2- 172.21.15.149:0/981908193 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05e814f680 0x7f05e80ce120 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:08.845 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.842+0000 7f05ee20f700 1 --2- 172.21.15.149:0/981908193 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05e80ce660 0x7f05e815b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:08.846 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.842+0000 7f05ee20f700 1 -- 172.21.15.149:0/981908193 >> 172.21.15.149:0/981908193 conn(0x7f05e80d0640 msgr2=0x7f05e80ccd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:08.846 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.843+0000 7f05ee20f700 1 -- 172.21.15.149:0/981908193 shutdown_connections 2023-11-08T19:25:08.846 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.843+0000 7f05ee20f700 1 -- 172.21.15.149:0/981908193 wait complete. 2023-11-08T19:25:08.856 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-08T19:25:08.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.979+0000 7f968c466700 1 Processor -- start 2023-11-08T19:25:08.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.979+0000 7f968c466700 1 -- start start 2023-11-08T19:25:08.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.980+0000 7f968c466700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f968415abf0 0x7f96840b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:08.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.980+0000 7f968c466700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f96840d1130 0x7f96840cc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:08.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.980+0000 7f968c466700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f96840cc6a0 0x7f96840ce210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:08.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.980+0000 7f968c466700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96840b66a0 con 0x7f96840cc6a0 2023-11-08T19:25:08.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.980+0000 7f968c466700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96840d04a0 con 0x7f96840d1130 2023-11-08T19:25:08.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.980+0000 7f968c466700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96840b6470 con 0x7f968415abf0 2023-11-08T19:25:08.984 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.980+0000 7f968aa03700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f96840cc6a0 0x7f96840ce210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:08.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.980+0000 7f968a202700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f968415abf0 0x7f96840b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:08.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.981+0000 7f968aa03700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f96840cc6a0 0x7f96840ce210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40758/0 (socket says 172.21.15.149:40758) 2023-11-08T19:25:08.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.981+0000 7f968aa03700 1 -- 172.21.15.149:0/1954242008 learned_addr learned my addr 172.21.15.149:0/1954242008 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:08.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.981+0000 7f9689a01700 1 --2- 172.21.15.149:0/1954242008 >> v2:172.21.15.160:3300/0 conn(0x7f96840d1130 0x7f96840cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:08.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.981+0000 7f968aa03700 1 -- 172.21.15.149:0/1954242008 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f968415abf0 msgr2=0x7f96840b5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:08.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.981+0000 7f968aa03700 1 --2- 172.21.15.149:0/1954242008 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f968415abf0 0x7f96840b5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:08.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.981+0000 7f968aa03700 1 -- 172.21.15.149:0/1954242008 >> v2:172.21.15.160:3300/0 conn(0x7f96840d1130 msgr2=0x7f96840cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:08.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.981+0000 7f968aa03700 1 --2- 172.21.15.149:0/1954242008 >> v2:172.21.15.160:3300/0 conn(0x7f96840d1130 0x7f96840cc160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:08.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.981+0000 7f968aa03700 1 -- 172.21.15.149:0/1954242008 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f968415afd0 con 0x7f96840cc6a0 2023-11-08T19:25:08.987 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.981+0000 7f968a202700 1 --2- 172.21.15.149:0/1954242008 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f968415abf0 0x7f96840b5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:25:08.987 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.981+0000 7f968aa03700 1 --2- 172.21.15.149:0/1954242008 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96840cc6a0 0x7f96840ce210 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f968406d9a0 tx=0x7f967c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb8b8db81fdf2e66 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:08.987 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.981+0000 7f9689200700 1 -- 172.21.15.149:0/1954242008 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967c00e070 con 0x7f96840cc6a0 2023-11-08T19:25:08.987 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.981+0000 7f9689200700 1 -- 172.21.15.149:0/1954242008 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f967c00b9c0 con 0x7f96840cc6a0 2023-11-08T19:25:08.988 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.981+0000 7f9689200700 1 -- 172.21.15.149:0/1954242008 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967c00bd70 con 0x7f96840cc6a0 2023-11-08T19:25:08.988 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.982+0000 7f968c466700 1 -- 172.21.15.149:0/1954242008 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96840cc6a0 msgr2=0x7f96840ce210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:08.988 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.982+0000 7f968c466700 1 --2- 172.21.15.149:0/1954242008 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96840cc6a0 0x7f96840ce210 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f968406d9a0 tx=0x7f967c00b330 comp rx=0 tx=0).stop 2023-11-08T19:25:08.988 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.982+0000 7f968c466700 1 -- 172.21.15.149:0/1954242008 shutdown_connections 2023-11-08T19:25:08.989 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.982+0000 7f968c466700 1 --2- 172.21.15.149:0/1954242008 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96840cc6a0 0x7f96840ce210 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:08.989 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.982+0000 7f968c466700 1 --2- 172.21.15.149:0/1954242008 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f968415abf0 0x7f96840b5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:08.989 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.982+0000 7f968c466700 1 --2- 172.21.15.149:0/1954242008 >> v2:172.21.15.160:3300/0 conn(0x7f96840d1130 0x7f96840cc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:08.989 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.982+0000 7f968c466700 1 -- 172.21.15.149:0/1954242008 >> 172.21.15.149:0/1954242008 conn(0x7f96840d0640 msgr2=0x7f96840d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:08.989 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.982+0000 7f968c466700 1 -- 172.21.15.149:0/1954242008 shutdown_connections 2023-11-08T19:25:08.990 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.982+0000 7f968c466700 1 -- 172.21.15.149:0/1954242008 wait complete. 2023-11-08T19:25:08.990 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.983+0000 7f968c466700 1 Processor -- start 2023-11-08T19:25:08.990 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.983+0000 7f968c466700 1 -- start start 2023-11-08T19:25:08.993 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.984+0000 7f968c466700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f96840cc6a0 0x7f968414ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:08.993 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.984+0000 7f968c466700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96840d1130 0x7f96840c9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:08.993 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.984+0000 7f968c466700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f968415abf0 0x7f96840c9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:08.993 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.984+0000 7f968c466700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9684150ed0 con 0x7f96840d1130 2023-11-08T19:25:08.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.984+0000 7f968c466700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96841511b0 con 0x7f968415abf0 2023-11-08T19:25:08.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.984+0000 7f968c466700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9684151490 con 0x7f96840cc6a0 2023-11-08T19:25:08.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.984+0000 7f9689a01700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96840d1130 0x7f96840c9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:08.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.984+0000 7f9689a01700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96840d1130 0x7f96840c9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40762/0 (socket says 172.21.15.149:40762) 2023-11-08T19:25:08.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.984+0000 7f9689a01700 1 -- 172.21.15.149:0/1268514432 learned_addr learned my addr 172.21.15.149:0/1268514432 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:08.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.984+0000 7f968aa03700 1 --2- 172.21.15.149:0/1268514432 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f968415abf0 0x7f96840c9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:08.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.984+0000 7f968a202700 1 --2- 172.21.15.149:0/1268514432 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f96840cc6a0 0x7f968414ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:08.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.985+0000 7f9689a01700 1 -- 172.21.15.149:0/1268514432 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f96840cc6a0 msgr2=0x7f968414ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:08.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.985+0000 7f9689a01700 1 --2- 172.21.15.149:0/1268514432 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f96840cc6a0 0x7f968414ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:08.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.985+0000 7f9689a01700 1 -- 172.21.15.149:0/1268514432 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f968415abf0 msgr2=0x7f96840c9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:08.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.985+0000 7f9689a01700 1 --2- 172.21.15.149:0/1268514432 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f968415abf0 0x7f96840c9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:08.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.985+0000 7f9689a01700 1 -- 172.21.15.149:0/1268514432 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f967c009b30 con 0x7f96840d1130 2023-11-08T19:25:08.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.985+0000 7f9689a01700 1 --2- 172.21.15.149:0/1268514432 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96840d1130 0x7f96840c9720 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f967800e810 tx=0x7f967800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:08.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.985+0000 7f9676ffd700 1 -- 172.21.15.149:0/1268514432 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9678013610 con 0x7f96840d1130 2023-11-08T19:25:08.997 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.985+0000 7f9676ffd700 1 -- 172.21.15.149:0/1268514432 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9678013770 con 0x7f96840d1130 2023-11-08T19:25:08.997 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.985+0000 7f9676ffd700 1 -- 172.21.15.149:0/1268514432 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9678013b20 con 0x7f96840d1130 2023-11-08T19:25:08.997 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.985+0000 7f968c466700 1 -- 172.21.15.149:0/1268514432 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9684151770 con 0x7f96840d1130 2023-11-08T19:25:08.997 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.985+0000 7f968c466700 1 -- 172.21.15.149:0/1268514432 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f968414f3a0 con 0x7f96840d1130 2023-11-08T19:25:08.998 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.986+0000 7f968c466700 1 -- 172.21.15.149:0/1268514432 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9684151dc0 con 0x7f96840d1130 2023-11-08T19:25:08.998 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.986+0000 7f9676ffd700 1 -- 172.21.15.149:0/1268514432 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9678013c80 con 0x7f96840d1130 2023-11-08T19:25:08.998 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.987+0000 7f9676ffd700 1 --2- 172.21.15.149:0/1268514432 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f966806af00 0x7f966806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:08.998 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.987+0000 7f9676ffd700 1 -- 172.21.15.149:0/1268514432 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f9678089520 con 0x7f96840d1130 2023-11-08T19:25:08.999 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.987+0000 7f968a202700 1 --2- 172.21.15.149:0/1268514432 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f966806af00 0x7f966806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:08.999 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.987+0000 7f968a202700 1 --2- 172.21.15.149:0/1268514432 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f966806af00 0x7f966806d3c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f9680009870 tx=0x7f9680008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:08.999 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:08.991+0000 7f9676ffd700 1 -- 172.21.15.149:0/1268514432 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9678054340 con 0x7f96840d1130 2023-11-08T19:25:09.183 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.182+0000 7f968c466700 1 -- 172.21.15.149:0/1268514432 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f968404f730 con 0x7f96840d1130 2023-11-08T19:25:09.183 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.182+0000 7f9676ffd700 1 -- 172.21.15.149:0/1268514432 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v55) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9678057960 con 0x7f96840d1130 2023-11-08T19:25:09.184 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:25:09.186 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.184+0000 7f968c466700 1 -- 172.21.15.149:0/1268514432 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f966806af00 msgr2=0x7f966806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:09.186 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.184+0000 7f968c466700 1 --2- 172.21.15.149:0/1268514432 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f966806af00 0x7f966806d3c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f9680009870 tx=0x7f9680008040 comp rx=0 tx=0).stop 2023-11-08T19:25:09.186 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.184+0000 7f968c466700 1 -- 172.21.15.149:0/1268514432 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96840d1130 msgr2=0x7f96840c9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:09.186 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.184+0000 7f968c466700 1 --2- 172.21.15.149:0/1268514432 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96840d1130 0x7f96840c9720 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f967800e810 tx=0x7f967800ebd0 comp rx=0 tx=0).stop 2023-11-08T19:25:09.187 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.184+0000 7f968c466700 1 -- 172.21.15.149:0/1268514432 shutdown_connections 2023-11-08T19:25:09.187 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.184+0000 7f968c466700 1 --2- 172.21.15.149:0/1268514432 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f966806af00 0x7f966806d3c0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:09.187 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.184+0000 7f968c466700 1 --2- 172.21.15.149:0/1268514432 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f968415abf0 0x7f96840c9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:09.187 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.184+0000 7f968c466700 1 --2- 172.21.15.149:0/1268514432 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f96840cc6a0 0x7f968414ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:09.187 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.184+0000 7f968c466700 1 --2- 172.21.15.149:0/1268514432 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96840d1130 0x7f96840c9720 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:09.188 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.184+0000 7f968c466700 1 -- 172.21.15.149:0/1268514432 >> 172.21.15.149:0/1268514432 conn(0x7f96840d0640 msgr2=0x7f9684072b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:09.188 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.184+0000 7f968c466700 1 -- 172.21.15.149:0/1268514432 shutdown_connections 2023-11-08T19:25:09.188 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.184+0000 7f968c466700 1 -- 172.21.15.149:0/1268514432 wait complete. 2023-11-08T19:25:09.198 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-08T19:25:09.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.320+0000 7fc0b56cb700 1 Processor -- start 2023-11-08T19:25:09.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.320+0000 7fc0b56cb700 1 -- start start 2023-11-08T19:25:09.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.321+0000 7fc0b56cb700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc0b015aaf0 0x7fc0b00ce6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:09.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.321+0000 7fc0b56cb700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0b006d8b0 con 0x7fc0b006c3a0 2023-11-08T19:25:09.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.321+0000 7fc0b56cb700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0b00cebe0 con 0x7fc0b00668e0 2023-11-08T19:25:09.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.321+0000 7fc0b56cb700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0b00cee60 con 0x7fc0b015aaf0 2023-11-08T19:25:09.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.321+0000 7fc0aeffd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc0b015aaf0 0x7fc0b00ce6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:09.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.321+0000 7fc0af7fe700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fc0b006c3a0 0x7fc0b006dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:42776/0 (socket says 172.21.15.149:42776) 2023-11-08T19:25:09.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.321+0000 7fc0aeffd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc0b015aaf0 0x7fc0b00ce6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40770/0 (socket says 172.21.15.149:40770) 2023-11-08T19:25:09.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.321+0000 7fc0af7fe700 1 -- 172.21.15.149:0/544380393 learned_addr learned my addr 172.21.15.149:0/544380393 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:25:09.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.322+0000 7fc0aeffd700 1 -- 172.21.15.149:0/544380393 >> v1:172.21.15.160:6789/0 conn(0x7fc0b00668e0 legacy=0x7fc0b006bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:09.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.322+0000 7fc0aeffd700 1 -- 172.21.15.149:0/544380393 >> v1:172.21.15.149:6789/0 conn(0x7fc0b006c3a0 legacy=0x7fc0b006dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:09.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.322+0000 7fc0aeffd700 1 -- 172.21.15.149:0/544380393 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b00cf140 con 0x7fc0b015aaf0 2023-11-08T19:25:09.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.322+0000 7fc0adffb700 1 -- 172.21.15.149:0/544380393 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3941683645 0 0) 0x7fc0b006d8b0 con 0x7fc0b006c3a0 2023-11-08T19:25:09.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.322+0000 7fc0aeffd700 1 --2- 172.21.15.149:0/544380393 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0b015aaf0 0x7fc0b00ce6a0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fc0a4009840 tx=0x7fc0a4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcc383701cca656e server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:09.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.322+0000 7fc0adffb700 1 -- 172.21.15.149:0/544380393 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a4011830 con 0x7fc0b015aaf0 2023-11-08T19:25:09.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.322+0000 7fc0adffb700 1 -- 172.21.15.149:0/544380393 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a4011990 con 0x7fc0b015aaf0 2023-11-08T19:25:09.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.322+0000 7fc0adffb700 1 -- 172.21.15.149:0/544380393 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a4011d20 con 0x7fc0b015aaf0 2023-11-08T19:25:09.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.323+0000 7fc0b56cb700 1 -- 172.21.15.149:0/544380393 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0b015aaf0 msgr2=0x7fc0b00ce6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:09.328 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.323+0000 7fc0b56cb700 1 --2- 172.21.15.149:0/544380393 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0b015aaf0 0x7fc0b00ce6a0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fc0a4009840 tx=0x7fc0a4009b50 comp rx=0 tx=0).stop 2023-11-08T19:25:09.328 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.323+0000 7fc0b56cb700 1 -- 172.21.15.149:0/544380393 shutdown_connections 2023-11-08T19:25:09.328 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.323+0000 7fc0b56cb700 1 --2- 172.21.15.149:0/544380393 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0b015aaf0 0x7fc0b00ce6a0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:09.328 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.323+0000 7fc0b56cb700 1 -- 172.21.15.149:0/544380393 >> 172.21.15.149:0/544380393 conn(0x7fc0b00cc860 msgr2=0x7fc0b00ccc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:09.328 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.323+0000 7fc0b56cb700 1 -- 172.21.15.149:0/544380393 shutdown_connections 2023-11-08T19:25:09.329 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.323+0000 7fc0b56cb700 1 -- 172.21.15.149:0/544380393 wait complete. 2023-11-08T19:25:09.331 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.324+0000 7fc0b56cb700 1 Processor -- start 2023-11-08T19:25:09.332 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.324+0000 7fc0b56cb700 1 -- start start 2023-11-08T19:25:09.332 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.325+0000 7fc0b56cb700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0b00668e0 0x7fc0b00c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:09.332 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.325+0000 7fc0b56cb700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc0b006c3a0 0x7fc0b01f0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:09.332 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.325+0000 7fc0b56cb700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc0b015aaf0 0x7fc0b00c8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:09.332 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.325+0000 7fc0b56cb700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b01f1df0 con 0x7fc0b00668e0 2023-11-08T19:25:09.333 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.325+0000 7fc0b56cb700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b01f0c70 con 0x7fc0b015aaf0 2023-11-08T19:25:09.333 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.325+0000 7fc0b56cb700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b01f11e0 con 0x7fc0b006c3a0 2023-11-08T19:25:09.333 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.325+0000 7fc0aeffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0b00668e0 0x7fc0b00c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:09.333 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.325+0000 7fc0aeffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0b00668e0 0x7fc0b00c6eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40776/0 (socket says 172.21.15.149:40776) 2023-11-08T19:25:09.334 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.325+0000 7fc0aeffd700 1 -- 172.21.15.149:0/3684635002 learned_addr learned my addr 172.21.15.149:0/3684635002 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:09.334 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.325+0000 7fc0af7fe700 1 --2- 172.21.15.149:0/3684635002 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc0b015aaf0 0x7fc0b00c8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:09.334 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.325+0000 7fc0ae7fc700 1 --2- 172.21.15.149:0/3684635002 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc0b006c3a0 0x7fc0b01f0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:09.334 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.325+0000 7fc0aeffd700 1 -- 172.21.15.149:0/3684635002 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc0b006c3a0 msgr2=0x7fc0b01f0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:09.334 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.325+0000 7fc0aeffd700 1 --2- 172.21.15.149:0/3684635002 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc0b006c3a0 0x7fc0b01f0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:09.335 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.325+0000 7fc0aeffd700 1 -- 172.21.15.149:0/3684635002 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc0b015aaf0 msgr2=0x7fc0b00c8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:09.335 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.325+0000 7fc0aeffd700 1 --2- 172.21.15.149:0/3684635002 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc0b015aaf0 0x7fc0b00c8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:09.335 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.325+0000 7fc0aeffd700 1 -- 172.21.15.149:0/3684635002 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a40094a0 con 0x7fc0b00668e0 2023-11-08T19:25:09.335 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.325+0000 7fc0af7fe700 1 --2- 172.21.15.149:0/3684635002 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc0b015aaf0 0x7fc0b00c8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:25:09.335 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.325+0000 7fc0ae7fc700 1 --2- 172.21.15.149:0/3684635002 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc0b006c3a0 0x7fc0b01f0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:25:09.336 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.325+0000 7fc0aeffd700 1 --2- 172.21.15.149:0/3684635002 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0b00668e0 0x7fc0b00c6eb0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fc0a40090b0 tx=0x7fc0a4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:09.336 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.325+0000 7fc0977fe700 1 -- 172.21.15.149:0/3684635002 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a401a900 con 0x7fc0b00668e0 2023-11-08T19:25:09.336 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.325+0000 7fc0977fe700 1 -- 172.21.15.149:0/3684635002 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a401aa60 con 0x7fc0b00668e0 2023-11-08T19:25:09.336 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.325+0000 7fc0b56cb700 1 -- 172.21.15.149:0/3684635002 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0b01f14c0 con 0x7fc0b00668e0 2023-11-08T19:25:09.336 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.325+0000 7fc0977fe700 1 -- 172.21.15.149:0/3684635002 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a401add0 con 0x7fc0b00668e0 2023-11-08T19:25:09.337 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.325+0000 7fc0b56cb700 1 -- 172.21.15.149:0/3684635002 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0b01f1a80 con 0x7fc0b00668e0 2023-11-08T19:25:09.337 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.326+0000 7fc0b56cb700 1 -- 172.21.15.149:0/3684635002 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0b004f730 con 0x7fc0b00668e0 2023-11-08T19:25:09.337 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.327+0000 7fc0977fe700 1 -- 172.21.15.149:0/3684635002 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc0a4022070 con 0x7fc0b00668e0 2023-11-08T19:25:09.337 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.327+0000 7fc0977fe700 1 --2- 172.21.15.149:0/3684635002 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc09c06af00 0x7fc09c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:09.338 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.327+0000 7fc0977fe700 1 -- 172.21.15.149:0/3684635002 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fc0a408aa70 con 0x7fc0b00668e0 2023-11-08T19:25:09.338 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.327+0000 7fc0ae7fc700 1 --2- 172.21.15.149:0/3684635002 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc09c06af00 0x7fc09c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:09.338 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.328+0000 7fc0ae7fc700 1 --2- 172.21.15.149:0/3684635002 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc09c06af00 0x7fc09c06d3c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc0b00b5320 tx=0x7fc0a0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:09.339 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.332+0000 7fc0977fe700 1 -- 172.21.15.149:0/3684635002 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc0a40559c0 con 0x7fc0b00668e0 2023-11-08T19:25:09.523 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.522+0000 7fc0b56cb700 1 -- 172.21.15.149:0/3684635002 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc0b00b5990 con 0x7fc0b00668e0 2023-11-08T19:25:09.524 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.523+0000 7fc0977fe700 1 -- 172.21.15.149:0/3684635002 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v55) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc0a40290a0 con 0x7fc0b00668e0 2023-11-08T19:25:09.524 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 64 2023-11-08T19:25:09.527 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.525+0000 7fc0b56cb700 1 -- 172.21.15.149:0/3684635002 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc09c06af00 msgr2=0x7fc09c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:09.527 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.525+0000 7fc0b56cb700 1 --2- 172.21.15.149:0/3684635002 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc09c06af00 0x7fc09c06d3c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc0b00b5320 tx=0x7fc0a0009040 comp rx=0 tx=0).stop 2023-11-08T19:25:09.527 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.525+0000 7fc0b56cb700 1 -- 172.21.15.149:0/3684635002 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0b00668e0 msgr2=0x7fc0b00c6eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:09.527 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.525+0000 7fc0b56cb700 1 --2- 172.21.15.149:0/3684635002 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0b00668e0 0x7fc0b00c6eb0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fc0a40090b0 tx=0x7fc0a4004750 comp rx=0 tx=0).stop 2023-11-08T19:25:09.527 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.525+0000 7fc0b56cb700 1 -- 172.21.15.149:0/3684635002 shutdown_connections 2023-11-08T19:25:09.528 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.525+0000 7fc0b56cb700 1 --2- 172.21.15.149:0/3684635002 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc09c06af00 0x7fc09c06d3c0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:09.528 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.525+0000 7fc0b56cb700 1 --2- 172.21.15.149:0/3684635002 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc0b015aaf0 0x7fc0b00c8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:09.528 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.525+0000 7fc0b56cb700 1 --2- 172.21.15.149:0/3684635002 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0b00668e0 0x7fc0b00c6eb0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:09.528 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.525+0000 7fc0b56cb700 1 --2- 172.21.15.149:0/3684635002 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc0b006c3a0 0x7fc0b01f0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:09.528 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.525+0000 7fc0b56cb700 1 -- 172.21.15.149:0/3684635002 >> 172.21.15.149:0/3684635002 conn(0x7fc0b00cc860 msgr2=0x7fc0b006ece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:09.529 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.525+0000 7fc0b56cb700 1 -- 172.21.15.149:0/3684635002 shutdown_connections 2023-11-08T19:25:09.529 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.525+0000 7fc0b56cb700 1 -- 172.21.15.149:0/3684635002 wait complete. 2023-11-08T19:25:09.539 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:25:09.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.659+0000 7f561dd30700 1 Processor -- start 2023-11-08T19:25:09.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.659+0000 7f561dd30700 1 -- start start 2023-11-08T19:25:09.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.660+0000 7f561dd30700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f56180b0870 0x7f56180d21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:09.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.660+0000 7f561dd30700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56180cbdc0 con 0x7f56180ce7c0 2023-11-08T19:25:09.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.660+0000 7f561dd30700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f561806c0f0 con 0x7f561815dee0 2023-11-08T19:25:09.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.660+0000 7f561dd30700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56180cc030 con 0x7f56180b0870 2023-11-08T19:25:09.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.660+0000 7f5616ffd700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f56180ce7c0 0x7f56180cc830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:42786/0 (socket says 172.21.15.149:42786) 2023-11-08T19:25:09.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.660+0000 7f5616ffd700 1 -- 172.21.15.149:0/3925356155 learned_addr learned my addr 172.21.15.149:0/3925356155 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:25:09.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.660+0000 7f56167fc700 1 -- 172.21.15.149:0/3925356155 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 403702032 0 0) 0x7f56180cbdc0 con 0x7f56180ce7c0 2023-11-08T19:25:09.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.660+0000 7f56167fc700 1 -- 172.21.15.149:0/3925356155 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56000035b0 con 0x7f56180ce7c0 2023-11-08T19:25:09.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.660+0000 7f5617fff700 1 --2- 172.21.15.149:0/3925356155 >> v2:172.21.15.160:3300/0 conn(0x7f56180b0870 0x7f56180d21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:09.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.660+0000 7f56167fc700 1 -- 172.21.15.149:0/3925356155 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1336787140 0 0) 0x7f56000035b0 con 0x7f56180ce7c0 2023-11-08T19:25:09.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.660+0000 7f56167fc700 1 -- 172.21.15.149:0/3925356155 >> v2:172.21.15.160:3300/0 conn(0x7f56180b0870 msgr2=0x7f56180d21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:09.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.660+0000 7f56167fc700 1 --2- 172.21.15.149:0/3925356155 >> v2:172.21.15.160:3300/0 conn(0x7f56180b0870 0x7f56180d21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:09.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.661+0000 7f56167fc700 1 -- 172.21.15.149:0/3925356155 >> v1:172.21.15.160:6789/0 conn(0x7f561815dee0 legacy=0x7f56180ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:09.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.661+0000 7f56167fc700 1 -- 172.21.15.149:0/3925356155 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56180cc310 con 0x7f56180ce7c0 2023-11-08T19:25:09.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.661+0000 7f56167fc700 1 -- 172.21.15.149:0/3925356155 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f5608001670 con 0x7f56180ce7c0 2023-11-08T19:25:09.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.661+0000 7f56167fc700 1 -- 172.21.15.149:0/3925356155 >> v1:172.21.15.149:6789/0 conn(0x7f56180ce7c0 legacy=0x7f56180cc830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:09.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.661+0000 7f56167fc700 1 --2- 172.21.15.149:0/3925356155 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5600003a00 0x7f5600003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:09.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.661+0000 7f56167fc700 1 --2- 172.21.15.149:0/3925356155 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5600004850 0x7f5600004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:09.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.661+0000 7f56167fc700 1 --2- 172.21.15.149:0/3925356155 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5600005210 0x7f560000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:09.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.661+0000 7f56167fc700 1 -- 172.21.15.149:0/3925356155 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56180cc030 con 0x7f5600004850 2023-11-08T19:25:09.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.661+0000 7f56167fc700 1 -- 172.21.15.149:0/3925356155 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f560000c1b0 con 0x7f5600003a00 2023-11-08T19:25:09.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.661+0000 7f56167fc700 1 -- 172.21.15.149:0/3925356155 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f560000c370 con 0x7f5600005210 2023-11-08T19:25:09.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.661+0000 7f5616ffd700 1 --2- 172.21.15.149:0/3925356155 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5600004850 0x7f5600004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:09.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.661+0000 7f56177fe700 1 --2- 172.21.15.149:0/3925356155 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5600003a00 0x7f5600003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:09.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.661+0000 7f5617fff700 1 --2- 172.21.15.149:0/3925356155 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5600005210 0x7f560000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:09.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.661+0000 7f5616ffd700 1 -- 172.21.15.149:0/3925356155 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5600005210 msgr2=0x7f560000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:09.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.661+0000 7f5616ffd700 1 --2- 172.21.15.149:0/3925356155 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5600005210 0x7f560000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:09.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.661+0000 7f5616ffd700 1 -- 172.21.15.149:0/3925356155 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5600003a00 msgr2=0x7f5600003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:09.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.661+0000 7f5616ffd700 1 --2- 172.21.15.149:0/3925356155 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5600003a00 0x7f5600003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:09.672 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.661+0000 7f5616ffd700 1 -- 172.21.15.149:0/3925356155 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56000035b0 con 0x7f5600004850 2023-11-08T19:25:09.672 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.661+0000 7f5617fff700 1 --2- 172.21.15.149:0/3925356155 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5600005210 0x7f560000ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:25:09.672 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.661+0000 7f5617fff700 1 -- 172.21.15.149:0/3925356155 reap_dead start 2023-11-08T19:25:09.672 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.661+0000 7f5616ffd700 1 --2- 172.21.15.149:0/3925356155 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5600004850 0x7f5600004cd0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f560800c240 tx=0x7f5600005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39ecad585b1f23cc server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:09.672 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.661+0000 7f56167fc700 1 -- 172.21.15.149:0/3925356155 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5608007c10 con 0x7f5600004850 2023-11-08T19:25:09.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.661+0000 7f56167fc700 1 -- 172.21.15.149:0/3925356155 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f560800cde0 con 0x7f5600004850 2023-11-08T19:25:09.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.661+0000 7f56167fc700 1 -- 172.21.15.149:0/3925356155 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5608005ba0 con 0x7f5600004850 2023-11-08T19:25:09.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.662+0000 7f561dd30700 1 -- 172.21.15.149:0/3925356155 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5600004850 msgr2=0x7f5600004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:09.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.662+0000 7f561dd30700 1 --2- 172.21.15.149:0/3925356155 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5600004850 0x7f5600004cd0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f560800c240 tx=0x7f5600005880 comp rx=0 tx=0).stop 2023-11-08T19:25:09.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.662+0000 7f561dd30700 1 -- 172.21.15.149:0/3925356155 shutdown_connections 2023-11-08T19:25:09.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.662+0000 7f561dd30700 1 --2- 172.21.15.149:0/3925356155 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5600004850 0x7f5600004cd0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:09.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.662+0000 7f561dd30700 1 -- 172.21.15.149:0/3925356155 >> 172.21.15.149:0/3925356155 conn(0x7f56180d16d0 msgr2=0x7f56180d1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:09.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.662+0000 7f561dd30700 1 -- 172.21.15.149:0/3925356155 shutdown_connections 2023-11-08T19:25:09.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.662+0000 7f561dd30700 1 -- 172.21.15.149:0/3925356155 wait complete. 2023-11-08T19:25:09.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.663+0000 7f561dd30700 1 Processor -- start 2023-11-08T19:25:09.675 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.664+0000 7f561dd30700 1 -- start start 2023-11-08T19:25:09.677 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.665+0000 7f561dd30700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5600004850 0x7f56181562d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:09.678 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.665+0000 7f561dd30700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f56180b6730 0x7f56180b6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:09.678 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.665+0000 7f561dd30700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5618157330 0x7f56181577c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:09.678 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.665+0000 7f561dd30700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5618157d00 con 0x7f5618157330 2023-11-08T19:25:09.678 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.665+0000 7f561dd30700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56180b5440 con 0x7f5600004850 2023-11-08T19:25:09.679 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.665+0000 7f561dd30700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56180b5690 con 0x7f56180b6730 2023-11-08T19:25:09.679 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.665+0000 7f5617fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5618157330 0x7f56181577c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:09.679 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.665+0000 7f5617fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5618157330 0x7f56181577c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40800/0 (socket says 172.21.15.149:40800) 2023-11-08T19:25:09.679 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.665+0000 7f5617fff700 1 -- 172.21.15.149:0/635798662 learned_addr learned my addr 172.21.15.149:0/635798662 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:09.679 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.665+0000 7f56177fe700 1 --2- 172.21.15.149:0/635798662 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5600004850 0x7f56181562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:09.680 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.665+0000 7f5616ffd700 1 --2- 172.21.15.149:0/635798662 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f56180b6730 0x7f56180b6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:09.680 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.665+0000 7f5617fff700 1 -- 172.21.15.149:0/635798662 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f56180b6730 msgr2=0x7f56180b6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:09.680 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.665+0000 7f5617fff700 1 --2- 172.21.15.149:0/635798662 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f56180b6730 0x7f56180b6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:09.680 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.665+0000 7f5617fff700 1 -- 172.21.15.149:0/635798662 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5600004850 msgr2=0x7f56181562d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:09.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.665+0000 7f5617fff700 1 --2- 172.21.15.149:0/635798662 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5600004850 0x7f56181562d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:09.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.665+0000 7f5617fff700 1 -- 172.21.15.149:0/635798662 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56180b5970 con 0x7f5618157330 2023-11-08T19:25:09.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.665+0000 7f5617fff700 1 --2- 172.21.15.149:0/635798662 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5618157330 0x7f56181577c0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f561806f0b0 tx=0x7f56100114b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:09.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.665+0000 7f55fffff700 1 -- 172.21.15.149:0/635798662 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f561000e030 con 0x7f5618157330 2023-11-08T19:25:09.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.665+0000 7f55fffff700 1 -- 172.21.15.149:0/635798662 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5610011c00 con 0x7f5618157330 2023-11-08T19:25:09.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.665+0000 7f561dd30700 1 -- 172.21.15.149:0/635798662 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56180b5c50 con 0x7f5618157330 2023-11-08T19:25:09.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.665+0000 7f55fffff700 1 -- 172.21.15.149:0/635798662 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5610016470 con 0x7f5618157330 2023-11-08T19:25:09.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.665+0000 7f561dd30700 1 -- 172.21.15.149:0/635798662 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56180b6210 con 0x7f5618157330 2023-11-08T19:25:09.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.666+0000 7f561dd30700 1 -- 172.21.15.149:0/635798662 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56180d2170 con 0x7f5618157330 2023-11-08T19:25:09.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.667+0000 7f55fffff700 1 -- 172.21.15.149:0/635798662 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f56100165d0 con 0x7f5618157330 2023-11-08T19:25:09.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.667+0000 7f55fffff700 1 --2- 172.21.15.149:0/635798662 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f560406af00 0x7f560406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:09.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.667+0000 7f55fffff700 1 -- 172.21.15.149:0/635798662 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f561000f070 con 0x7f5618157330 2023-11-08T19:25:09.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.667+0000 7f56177fe700 1 --2- 172.21.15.149:0/635798662 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f560406af00 0x7f560406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:09.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.668+0000 7f56177fe700 1 --2- 172.21.15.149:0/635798662 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f560406af00 0x7f560406d3c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f56180b4860 tx=0x7f560c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:09.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.672+0000 7f55fffff700 1 -- 172.21.15.149:0/635798662 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5610054fc0 con 0x7f5618157330 2023-11-08T19:25:09.906 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.905+0000 7f561dd30700 1 -- 172.21.15.149:0/635798662 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f561804f730 con 0x7f5618157330 2023-11-08T19:25:09.906 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.905+0000 7f55fffff700 1 -- 172.21.15.149:0/635798662 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f56100585e0 con 0x7f5618157330 2023-11-08T19:25:09.907 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:25:09.907 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5455,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/2693283976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2693283976},{"type":"v1","addr":"172.21.15.160:6834","nonce":2693283976}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5458,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/3714474190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":3714474190},{"type":"v1","addr":"172.21.15.160:6835","nonce":3714474190}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5730,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/1885678824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":1885678824},{"type":"v1","addr":"172.21.15.149:6836","nonce":1885678824}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-08T19:24:51.735078+0000","modified":"2023-11-08T19:24:54.764447+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5733},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5733":{"gid":5733,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6837/4238261436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":4238261436},{"type":"v1","addr":"172.21.15.149:6837","nonce":4238261436}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-08T19:25:09.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.907+0000 7f561dd30700 1 -- 172.21.15.149:0/635798662 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f560406af00 msgr2=0x7f560406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:09.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.907+0000 7f561dd30700 1 --2- 172.21.15.149:0/635798662 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f560406af00 0x7f560406d3c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f56180b4860 tx=0x7f560c009040 comp rx=0 tx=0).stop 2023-11-08T19:25:09.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.907+0000 7f561dd30700 1 -- 172.21.15.149:0/635798662 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5618157330 msgr2=0x7f56181577c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:09.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.907+0000 7f561dd30700 1 --2- 172.21.15.149:0/635798662 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5618157330 0x7f56181577c0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f561806f0b0 tx=0x7f56100114b0 comp rx=0 tx=0).stop 2023-11-08T19:25:09.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.907+0000 7f561dd30700 1 -- 172.21.15.149:0/635798662 shutdown_connections 2023-11-08T19:25:09.910 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.907+0000 7f561dd30700 1 --2- 172.21.15.149:0/635798662 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f560406af00 0x7f560406d3c0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:09.910 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.907+0000 7f561dd30700 1 --2- 172.21.15.149:0/635798662 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5600004850 0x7f56181562d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:09.910 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.907+0000 7f561dd30700 1 --2- 172.21.15.149:0/635798662 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5618157330 0x7f56181577c0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:09.910 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.907+0000 7f561dd30700 1 --2- 172.21.15.149:0/635798662 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f56180b6730 0x7f56180b6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:09.911 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.907+0000 7f561dd30700 1 -- 172.21.15.149:0/635798662 >> 172.21.15.149:0/635798662 conn(0x7f56180d16d0 msgr2=0x7f561806c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:09.911 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.907+0000 7f561dd30700 1 -- 172.21.15.149:0/635798662 shutdown_connections 2023-11-08T19:25:09.911 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:09.908+0000 7f561dd30700 1 -- 172.21.15.149:0/635798662 wait complete. 2023-11-08T19:25:09.911 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 25 2023-11-08T19:25:09.921 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:25:10.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.041+0000 7fbaf71db700 1 Processor -- start 2023-11-08T19:25:10.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.041+0000 7fbaf71db700 1 -- start start 2023-11-08T19:25:10.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.042+0000 7fbaf71db700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbaf00d0fe0 0x7fbaf00c8680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:10.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.042+0000 7fbaf71db700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fbaf00cc9a0 0x7fbaf00c8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:10.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.042+0000 7fbaf71db700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaf015bd30 con 0x7fbaf015b950 2023-11-08T19:25:10.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.042+0000 7fbaf71db700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaf00caa90 con 0x7fbaf00cc9a0 2023-11-08T19:25:10.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.042+0000 7fbaf71db700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf00c7670 con 0x7fbaf00d0fe0 2023-11-08T19:25:10.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.042+0000 7fbaf5778700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fbaf00cc9a0 0x7fbaf00c8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:10.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.042+0000 7fbaf5778700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fbaf00cc9a0 0x7fbaf00c8bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40808/0 (socket says 172.21.15.149:40808) 2023-11-08T19:25:10.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.042+0000 7fbaf5778700 1 -- 172.21.15.149:0/3941419424 learned_addr learned my addr 172.21.15.149:0/3941419424 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:10.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.042+0000 7fbaeffff700 1 --2- 172.21.15.149:0/3941419424 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbaf00d0fe0 0x7fbaf00c8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:10.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.042+0000 7fbaf5778700 1 -- 172.21.15.149:0/3941419424 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbaf00d0fe0 msgr2=0x7fbaf00c8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:10.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.042+0000 7fbaf5778700 1 --2- 172.21.15.149:0/3941419424 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbaf00d0fe0 0x7fbaf00c8680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:10.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.042+0000 7fbaf5778700 1 -- 172.21.15.149:0/3941419424 >> v1:172.21.15.160:6789/0 conn(0x7fbaf015b950 legacy=0x7fbaf00cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:10.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.042+0000 7fbaf5778700 1 -- 172.21.15.149:0/3941419424 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaf00c81f0 con 0x7fbaf00cc9a0 2023-11-08T19:25:10.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.042+0000 7fbaf5778700 1 --2- 172.21.15.149:0/3941419424 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbaf00cc9a0 0x7fbaf00c8bc0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fbae8009e50 tx=0x7fbae800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df8c4ff06b7aa2d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:10.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.042+0000 7fbaef7fe700 1 -- 172.21.15.149:0/3941419424 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae800e070 con 0x7fbaf00cc9a0 2023-11-08T19:25:10.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.042+0000 7fbaef7fe700 1 -- 172.21.15.149:0/3941419424 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbae800b9c0 con 0x7fbaf00cc9a0 2023-11-08T19:25:10.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.043+0000 7fbaef7fe700 1 -- 172.21.15.149:0/3941419424 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae800bd70 con 0x7fbaf00cc9a0 2023-11-08T19:25:10.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.043+0000 7fbaf71db700 1 -- 172.21.15.149:0/3941419424 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbaf00cc9a0 msgr2=0x7fbaf00c8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:10.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.043+0000 7fbaf71db700 1 --2- 172.21.15.149:0/3941419424 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbaf00cc9a0 0x7fbaf00c8bc0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fbae8009e50 tx=0x7fbae800b330 comp rx=0 tx=0).stop 2023-11-08T19:25:10.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.043+0000 7fbaf71db700 1 -- 172.21.15.149:0/3941419424 shutdown_connections 2023-11-08T19:25:10.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.043+0000 7fbaf71db700 1 --2- 172.21.15.149:0/3941419424 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbaf00cc9a0 0x7fbaf00c8bc0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:10.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.043+0000 7fbaf71db700 1 --2- 172.21.15.149:0/3941419424 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbaf00d0fe0 0x7fbaf00c8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:10.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.043+0000 7fbaf71db700 1 -- 172.21.15.149:0/3941419424 >> 172.21.15.149:0/3941419424 conn(0x7fbaf0099a40 msgr2=0x7fbaf00d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:10.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.043+0000 7fbaf71db700 1 -- 172.21.15.149:0/3941419424 shutdown_connections 2023-11-08T19:25:10.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.043+0000 7fbaf71db700 1 -- 172.21.15.149:0/3941419424 wait complete. 2023-11-08T19:25:10.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.045+0000 7fbaf71db700 1 Processor -- start 2023-11-08T19:25:10.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.045+0000 7fbaf71db700 1 -- start start 2023-11-08T19:25:10.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.046+0000 7fbaf71db700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbaf00cc9a0 0x7fbaf00c4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:10.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.046+0000 7fbaf71db700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbaf00d0fe0 0x7fbaf01f1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:10.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.046+0000 7fbaf71db700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbaf015b950 0x7fbaf015dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:10.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.046+0000 7fbaf71db700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf015ccd0 con 0x7fbaf015b950 2023-11-08T19:25:10.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.046+0000 7fbaf71db700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf015cf70 con 0x7fbaf00d0fe0 2023-11-08T19:25:10.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.046+0000 7fbaf71db700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf015d250 con 0x7fbaf00cc9a0 2023-11-08T19:25:10.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.046+0000 7fbaf5778700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbaf015b950 0x7fbaf015dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:10.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.046+0000 7fbaf5778700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbaf015b950 0x7fbaf015dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40814/0 (socket says 172.21.15.149:40814) 2023-11-08T19:25:10.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.046+0000 7fbaf5778700 1 -- 172.21.15.149:0/1096218062 learned_addr learned my addr 172.21.15.149:0/1096218062 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:10.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.046+0000 7fbaeffff700 1 --2- 172.21.15.149:0/1096218062 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbaf00d0fe0 0x7fbaf01f1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:10.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.046+0000 7fbaf4f77700 1 --2- 172.21.15.149:0/1096218062 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbaf00cc9a0 0x7fbaf00c4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:10.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.046+0000 7fbaf5778700 1 -- 172.21.15.149:0/1096218062 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbaf00cc9a0 msgr2=0x7fbaf00c4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:10.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.046+0000 7fbaf5778700 1 --2- 172.21.15.149:0/1096218062 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbaf00cc9a0 0x7fbaf00c4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:10.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.046+0000 7fbaf5778700 1 -- 172.21.15.149:0/1096218062 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbaf00d0fe0 msgr2=0x7fbaf01f1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:10.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.046+0000 7fbaf5778700 1 --2- 172.21.15.149:0/1096218062 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbaf00d0fe0 0x7fbaf01f1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:10.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.046+0000 7fbaf5778700 1 -- 172.21.15.149:0/1096218062 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbae8009b30 con 0x7fbaf015b950 2023-11-08T19:25:10.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.046+0000 7fbaf4f77700 1 --2- 172.21.15.149:0/1096218062 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbaf00cc9a0 0x7fbaf00c4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:25:10.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.046+0000 7fbaf5778700 1 --2- 172.21.15.149:0/1096218062 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbaf015b950 0x7fbaf015dd30 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fbaf00b3220 tx=0x7fbae8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:10.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.046+0000 7fbaed7fa700 1 -- 172.21.15.149:0/1096218062 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae80048f0 con 0x7fbaf015b950 2023-11-08T19:25:10.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.046+0000 7fbaed7fa700 1 -- 172.21.15.149:0/1096218062 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbae80092e0 con 0x7fbaf015b950 2023-11-08T19:25:10.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.046+0000 7fbaed7fa700 1 -- 172.21.15.149:0/1096218062 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae801c680 con 0x7fbaf015b950 2023-11-08T19:25:10.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.046+0000 7fbaf71db700 1 -- 172.21.15.149:0/1096218062 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaf015d530 con 0x7fbaf015b950 2023-11-08T19:25:10.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.047+0000 7fbaf71db700 1 -- 172.21.15.149:0/1096218062 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaf00c4880 con 0x7fbaf015b950 2023-11-08T19:25:10.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.047+0000 7fbaf71db700 1 -- 172.21.15.149:0/1096218062 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaf00c4a40 con 0x7fbaf015b950 2023-11-08T19:25:10.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.048+0000 7fbaed7fa700 1 -- 172.21.15.149:0/1096218062 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbae801c7e0 con 0x7fbaf015b950 2023-11-08T19:25:10.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.048+0000 7fbaed7fa700 1 --2- 172.21.15.149:0/1096218062 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fbad406af00 0x7fbad406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:10.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.048+0000 7fbaed7fa700 1 -- 172.21.15.149:0/1096218062 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fbae808b5c0 con 0x7fbaf015b950 2023-11-08T19:25:10.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.048+0000 7fbaf4f77700 1 --2- 172.21.15.149:0/1096218062 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fbad406af00 0x7fbad406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:10.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.049+0000 7fbaf4f77700 1 --2- 172.21.15.149:0/1096218062 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fbad406af00 0x7fbad406d3c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fbae4000fb0 tx=0x7fbae4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:10.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.053+0000 7fbaed7fa700 1 -- 172.21.15.149:0/1096218062 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbae8056460 con 0x7fbaf015b950 2023-11-08T19:25:10.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.247+0000 7fbaf71db700 1 -- 172.21.15.149:0/1096218062 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbaf00c9870 con 0x7fbaf015b950 2023-11-08T19:25:10.249 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.248+0000 7fbaed7fa700 1 -- 172.21.15.149:0/1096218062 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+18559 (secure 0 0 0) 0x7fbae8059a80 con 0x7fbaf015b950 2023-11-08T19:25:10.250 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:25:10.250 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":55,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:24:53.348156+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-08T19:24:29.516185+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-08T19:24:49.982090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-08T19:24:50.696398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:25:10.252 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.250+0000 7fbaf71db700 1 -- 172.21.15.149:0/1096218062 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fbad406af00 msgr2=0x7fbad406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:10.252 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.250+0000 7fbaf71db700 1 --2- 172.21.15.149:0/1096218062 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fbad406af00 0x7fbad406d3c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fbae4000fb0 tx=0x7fbae4009040 comp rx=0 tx=0).stop 2023-11-08T19:25:10.252 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.250+0000 7fbaf71db700 1 -- 172.21.15.149:0/1096218062 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbaf015b950 msgr2=0x7fbaf015dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:10.253 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.250+0000 7fbaf71db700 1 --2- 172.21.15.149:0/1096218062 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbaf015b950 0x7fbaf015dd30 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fbaf00b3220 tx=0x7fbae8004ad0 comp rx=0 tx=0).stop 2023-11-08T19:25:10.253 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.251+0000 7fbaf71db700 1 -- 172.21.15.149:0/1096218062 shutdown_connections 2023-11-08T19:25:10.253 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.251+0000 7fbaf71db700 1 --2- 172.21.15.149:0/1096218062 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fbad406af00 0x7fbad406d3c0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:10.253 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.251+0000 7fbaf71db700 1 --2- 172.21.15.149:0/1096218062 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbaf015b950 0x7fbaf015dd30 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:10.253 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.251+0000 7fbaf71db700 1 --2- 172.21.15.149:0/1096218062 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbaf00cc9a0 0x7fbaf00c4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:10.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.251+0000 7fbaf71db700 1 --2- 172.21.15.149:0/1096218062 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbaf00d0fe0 0x7fbaf01f1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:10.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.251+0000 7fbaf71db700 1 -- 172.21.15.149:0/1096218062 >> 172.21.15.149:0/1096218062 conn(0x7fbaf0099a40 msgr2=0x7fbaf015a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:10.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.251+0000 7fbaf71db700 1 -- 172.21.15.149:0/1096218062 shutdown_connections 2023-11-08T19:25:10.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.251+0000 7fbaf71db700 1 -- 172.21.15.149:0/1096218062 wait complete. 2023-11-08T19:25:10.264 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-08T19:25:10.264 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:25:10.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.384+0000 7f7dec1a4700 1 Processor -- start 2023-11-08T19:25:10.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.385+0000 7f7dec1a4700 1 -- start start 2023-11-08T19:25:10.394 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.385+0000 7f7dec1a4700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7de40cc910 0x7f7de40cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:10.394 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.385+0000 7f7dec1a4700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f7de40cb130 0x7f7de415d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:10.394 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.385+0000 7f7dec1a4700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7de40b2f60 con 0x7f7de40cc140 2023-11-08T19:25:10.395 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.385+0000 7f7dec1a4700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7de40b2430 con 0x7f7de40cb130 2023-11-08T19:25:10.395 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.385+0000 7f7dec1a4700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7de40cc520 con 0x7f7de40cc910 2023-11-08T19:25:10.395 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.386+0000 7f7de9f40700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f7de40cc140 0x7f7de40b2850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:42820/0 (socket says 172.21.15.149:42820) 2023-11-08T19:25:10.395 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.386+0000 7f7de9f40700 1 -- 172.21.15.149:0/2633439822 learned_addr learned my addr 172.21.15.149:0/2633439822 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:25:10.395 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.386+0000 7f7de8f3e700 1 -- 172.21.15.149:0/2633439822 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1835983131 0 0) 0x7f7de40b2f60 con 0x7f7de40cc140 2023-11-08T19:25:10.396 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.386+0000 7f7dea741700 1 --2- 172.21.15.149:0/2633439822 >> v2:172.21.15.160:3300/0 conn(0x7f7de40cb130 0x7f7de415d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:10.396 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.386+0000 7f7de973f700 1 --2- 172.21.15.149:0/2633439822 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7de40cc910 0x7f7de40cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:10.396 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.386+0000 7f7de8f3e700 1 -- 172.21.15.149:0/2633439822 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7dd00035b0 con 0x7f7de40cc140 2023-11-08T19:25:10.396 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.386+0000 7f7de8f3e700 1 -- 172.21.15.149:0/2633439822 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4009312432 0 0) 0x7f7dd00035b0 con 0x7f7de40cc140 2023-11-08T19:25:10.396 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.386+0000 7f7de8f3e700 1 -- 172.21.15.149:0/2633439822 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7de40cc910 msgr2=0x7f7de40cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:10.397 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.386+0000 7f7de8f3e700 1 --2- 172.21.15.149:0/2633439822 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7de40cc910 0x7f7de40cabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:10.397 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.386+0000 7f7de8f3e700 1 -- 172.21.15.149:0/2633439822 >> v2:172.21.15.160:3300/0 conn(0x7f7de40cb130 msgr2=0x7f7de415d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:10.397 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.386+0000 7f7de8f3e700 1 --2- 172.21.15.149:0/2633439822 >> v2:172.21.15.160:3300/0 conn(0x7f7de40cb130 0x7f7de415d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:10.397 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.386+0000 7f7de8f3e700 1 -- 172.21.15.149:0/2633439822 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de40cb5b0 con 0x7f7de40cc140 2023-11-08T19:25:10.397 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.386+0000 7f7de8f3e700 1 -- 172.21.15.149:0/2633439822 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f7dd40017f0 con 0x7f7de40cc140 2023-11-08T19:25:10.398 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.386+0000 7f7de8f3e700 1 -- 172.21.15.149:0/2633439822 >> v1:172.21.15.149:6789/0 conn(0x7f7de40cc140 legacy=0x7f7de40b2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:10.398 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.386+0000 7f7de8f3e700 1 --2- 172.21.15.149:0/2633439822 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7dd0003a00 0x7f7dd0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:10.398 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.386+0000 7f7de8f3e700 1 --2- 172.21.15.149:0/2633439822 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7de40cc910 0x7f7dd0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:10.398 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.386+0000 7f7de8f3e700 1 --2- 172.21.15.149:0/2633439822 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7dd0004d90 0x7f7dd0005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:10.398 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.386+0000 7f7de8f3e700 1 -- 172.21.15.149:0/2633439822 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de40b2430 con 0x7f7dd0003a00 2023-11-08T19:25:10.399 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.386+0000 7f7de8f3e700 1 -- 172.21.15.149:0/2633439822 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de40cc520 con 0x7f7dd0004d90 2023-11-08T19:25:10.399 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.386+0000 7f7de8f3e700 1 -- 172.21.15.149:0/2633439822 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd000ba10 con 0x7f7de40cc910 2023-11-08T19:25:10.399 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.386+0000 7f7de9f40700 1 --2- 172.21.15.149:0/2633439822 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7dd0003a00 0x7f7dd0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:10.399 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.386+0000 7f7dea741700 1 --2- 172.21.15.149:0/2633439822 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7dd0004d90 0x7f7dd0005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:10.399 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.386+0000 7f7de973f700 1 --2- 172.21.15.149:0/2633439822 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7de40cc910 0x7f7dd0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:10.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.386+0000 7f7de9f40700 1 -- 172.21.15.149:0/2633439822 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7de40cc910 msgr2=0x7f7dd0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:10.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.386+0000 7f7de9f40700 1 --2- 172.21.15.149:0/2633439822 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7de40cc910 0x7f7dd0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:10.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.386+0000 7f7de9f40700 1 -- 172.21.15.149:0/2633439822 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7dd0004d90 msgr2=0x7f7dd0005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:10.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.386+0000 7f7de9f40700 1 --2- 172.21.15.149:0/2633439822 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7dd0004d90 0x7f7dd0005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:10.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.386+0000 7f7de9f40700 1 -- 172.21.15.149:0/2633439822 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd00035b0 con 0x7f7dd0003a00 2023-11-08T19:25:10.401 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.386+0000 7f7dea741700 1 --2- 172.21.15.149:0/2633439822 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7dd0004d90 0x7f7dd0005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:25:10.401 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.387+0000 7f7de9f40700 1 --2- 172.21.15.149:0/2633439822 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7dd0003a00 0x7f7dd0003e20 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f7dd400c240 tx=0x7f7dd0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa86fdd0deea0d86 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:10.401 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.387+0000 7f7de8f3e700 1 -- 172.21.15.149:0/2633439822 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd400cde0 con 0x7f7dd0003a00 2023-11-08T19:25:10.401 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.387+0000 7f7de8f3e700 1 -- 172.21.15.149:0/2633439822 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dd4007bd0 con 0x7f7dd0003a00 2023-11-08T19:25:10.401 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.387+0000 7f7de8f3e700 1 -- 172.21.15.149:0/2633439822 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd4007310 con 0x7f7dd0003a00 2023-11-08T19:25:10.402 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.387+0000 7f7dec1a4700 1 -- 172.21.15.149:0/2633439822 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7dd0003a00 msgr2=0x7f7dd0003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:10.402 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.387+0000 7f7dec1a4700 1 --2- 172.21.15.149:0/2633439822 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7dd0003a00 0x7f7dd0003e20 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f7dd400c240 tx=0x7f7dd0005880 comp rx=0 tx=0).stop 2023-11-08T19:25:10.402 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.387+0000 7f7dea741700 1 -- 172.21.15.149:0/2633439822 reap_dead start 2023-11-08T19:25:10.402 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.387+0000 7f7dec1a4700 1 -- 172.21.15.149:0/2633439822 shutdown_connections 2023-11-08T19:25:10.402 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.387+0000 7f7dec1a4700 1 -- 172.21.15.149:0/2633439822 >> 172.21.15.149:0/2633439822 conn(0x7f7de4099a40 msgr2=0x7f7de40d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:10.402 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.387+0000 7f7dec1a4700 1 -- 172.21.15.149:0/2633439822 shutdown_connections 2023-11-08T19:25:10.403 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.387+0000 7f7dec1a4700 1 -- 172.21.15.149:0/2633439822 wait complete. 2023-11-08T19:25:10.403 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.389+0000 7f7dec1a4700 1 Processor -- start 2023-11-08T19:25:10.403 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.389+0000 7f7dec1a4700 1 -- start start 2023-11-08T19:25:10.403 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.389+0000 7f7dec1a4700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7dd0003a00 0x7f7de415d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:10.403 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.389+0000 7f7dec1a4700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7de40b5950 0x7f7de40b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:10.404 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.389+0000 7f7dec1a4700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7de415e350 0x7f7de415e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:10.404 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.389+0000 7f7dec1a4700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de415ed40 con 0x7f7de40b5950 2023-11-08T19:25:10.404 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.389+0000 7f7dec1a4700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de40c8420 con 0x7f7de415e350 2023-11-08T19:25:10.404 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.389+0000 7f7dec1a4700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7de40c86c0 con 0x7f7dd0003a00 2023-11-08T19:25:10.404 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.389+0000 7f7de973f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7de40b5950 0x7f7de40b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:10.405 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.389+0000 7f7de973f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7de40b5950 0x7f7de40b5dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40832/0 (socket says 172.21.15.149:40832) 2023-11-08T19:25:10.405 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.389+0000 7f7de973f700 1 -- 172.21.15.149:0/1702095935 learned_addr learned my addr 172.21.15.149:0/1702095935 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:10.405 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.390+0000 7f7de9f40700 1 --2- 172.21.15.149:0/1702095935 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7dd0003a00 0x7f7de415d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:10.405 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.390+0000 7f7dea741700 1 --2- 172.21.15.149:0/1702095935 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7de415e350 0x7f7de415e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:10.405 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.390+0000 7f7de973f700 1 -- 172.21.15.149:0/1702095935 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7dd0003a00 msgr2=0x7f7de415d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:10.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.390+0000 7f7de973f700 1 --2- 172.21.15.149:0/1702095935 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7dd0003a00 0x7f7de415d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:10.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.390+0000 7f7de973f700 1 -- 172.21.15.149:0/1702095935 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7de415e350 msgr2=0x7f7de415e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:10.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.390+0000 7f7de973f700 1 --2- 172.21.15.149:0/1702095935 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7de415e350 0x7f7de415e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:10.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.390+0000 7f7de973f700 1 -- 172.21.15.149:0/1702095935 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de40c89a0 con 0x7f7de40b5950 2023-11-08T19:25:10.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.390+0000 7f7dea741700 1 --2- 172.21.15.149:0/1702095935 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7de415e350 0x7f7de415e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:25:10.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.390+0000 7f7de973f700 1 --2- 172.21.15.149:0/1702095935 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7de40b5950 0x7f7de40b5dd0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f7de00116a0 tx=0x7f7de0011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:10.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.390+0000 7f7dda7fc700 1 -- 172.21.15.149:0/1702095935 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de0015870 con 0x7f7de40b5950 2023-11-08T19:25:10.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.390+0000 7f7dda7fc700 1 -- 172.21.15.149:0/1702095935 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7de00159d0 con 0x7f7de40b5950 2023-11-08T19:25:10.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.390+0000 7f7dec1a4700 1 -- 172.21.15.149:0/1702095935 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7de40c8c80 con 0x7f7de40b5950 2023-11-08T19:25:10.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.390+0000 7f7dda7fc700 1 -- 172.21.15.149:0/1702095935 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de0015d60 con 0x7f7de40b5950 2023-11-08T19:25:10.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.390+0000 7f7dec1a4700 1 -- 172.21.15.149:0/1702095935 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7de415de20 con 0x7f7de40b5950 2023-11-08T19:25:10.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.391+0000 7f7dec1a4700 1 -- 172.21.15.149:0/1702095935 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7de40745f0 con 0x7f7de40b5950 2023-11-08T19:25:10.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.392+0000 7f7dda7fc700 1 -- 172.21.15.149:0/1702095935 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7de0013400 con 0x7f7de40b5950 2023-11-08T19:25:10.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.392+0000 7f7dda7fc700 1 --2- 172.21.15.149:0/1702095935 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f7dc806af00 0x7f7dc806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:10.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.392+0000 7f7dda7fc700 1 -- 172.21.15.149:0/1702095935 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f7de0089c50 con 0x7f7de40b5950 2023-11-08T19:25:10.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.392+0000 7f7de9f40700 1 --2- 172.21.15.149:0/1702095935 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f7dc806af00 0x7f7dc806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:10.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.392+0000 7f7de9f40700 1 --2- 172.21.15.149:0/1702095935 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f7dc806af00 0x7f7dc806d3c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7de4066cc0 tx=0x7f7dd400a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:10.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.397+0000 7f7dda7fc700 1 -- 172.21.15.149:0/1702095935 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7de008f020 con 0x7f7de40b5950 2023-11-08T19:25:10.631 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.629+0000 7f7dec1a4700 1 -- 172.21.15.149:0/1702095935 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7de40c3e80 con 0x7f7de40b5950 2023-11-08T19:25:10.632 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.629+0000 7f7dda7fc700 1 -- 172.21.15.149:0/1702095935 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f7de0054a70 con 0x7f7de40b5950 2023-11-08T19:25:10.632 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:25:10.632 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5455,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/2693283976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2693283976},{"type":"v1","addr":"172.21.15.160:6834","nonce":2693283976}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5458,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/3714474190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":3714474190},{"type":"v1","addr":"172.21.15.160:6835","nonce":3714474190}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5730,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/1885678824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":1885678824},{"type":"v1","addr":"172.21.15.149:6836","nonce":1885678824}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-08T19:24:51.735078+0000","modified":"2023-11-08T19:24:54.764447+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5733},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5733":{"gid":5733,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6837/4238261436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":4238261436},{"type":"v1","addr":"172.21.15.149:6837","nonce":4238261436}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-08T19:25:10.634 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.631+0000 7f7dec1a4700 1 -- 172.21.15.149:0/1702095935 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f7dc806af00 msgr2=0x7f7dc806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:10.634 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.631+0000 7f7dec1a4700 1 --2- 172.21.15.149:0/1702095935 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f7dc806af00 0x7f7dc806d3c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7de4066cc0 tx=0x7f7dd400a000 comp rx=0 tx=0).stop 2023-11-08T19:25:10.634 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.631+0000 7f7dec1a4700 1 -- 172.21.15.149:0/1702095935 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7de40b5950 msgr2=0x7f7de40b5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:10.634 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.631+0000 7f7dec1a4700 1 --2- 172.21.15.149:0/1702095935 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7de40b5950 0x7f7de40b5dd0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f7de00116a0 tx=0x7f7de0011a60 comp rx=0 tx=0).stop 2023-11-08T19:25:10.635 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.631+0000 7f7dec1a4700 1 -- 172.21.15.149:0/1702095935 shutdown_connections 2023-11-08T19:25:10.635 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.631+0000 7f7dec1a4700 1 --2- 172.21.15.149:0/1702095935 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f7dc806af00 0x7f7dc806d3c0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:10.635 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.631+0000 7f7dec1a4700 1 --2- 172.21.15.149:0/1702095935 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7de415e350 0x7f7de415e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:10.635 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.631+0000 7f7dec1a4700 1 --2- 172.21.15.149:0/1702095935 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7dd0003a00 0x7f7de415d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:10.635 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.631+0000 7f7dec1a4700 1 --2- 172.21.15.149:0/1702095935 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7de40b5950 0x7f7de40b5dd0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:10.636 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.631+0000 7f7dec1a4700 1 -- 172.21.15.149:0/1702095935 >> 172.21.15.149:0/1702095935 conn(0x7f7de4099a40 msgr2=0x7f7de40c7790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:10.636 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.631+0000 7f7dec1a4700 1 -- 172.21.15.149:0/1702095935 shutdown_connections 2023-11-08T19:25:10.636 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.631+0000 7f7dec1a4700 1 -- 172.21.15.149:0/1702095935 wait complete. 2023-11-08T19:25:10.636 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 25 2023-11-08T19:25:10.646 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:25:10.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.765+0000 7f9eba62d700 1 Processor -- start 2023-11-08T19:25:10.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.765+0000 7f9eba62d700 1 -- start start 2023-11-08T19:25:10.770 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.766+0000 7f9eba62d700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f9eb40afb30 0x7f9eb40ce380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:10.770 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.766+0000 7f9eba62d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f9eb40b16b0 0x7f9eb40cbf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:10.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.766+0000 7f9eba62d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9eb40b20b0 0x7f9eb40b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:10.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.766+0000 7f9eba62d700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9eb40b2aa0 con 0x7f9eb40b16b0 2023-11-08T19:25:10.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.766+0000 7f9eba62d700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9eb40d1330 con 0x7f9eb40afb30 2023-11-08T19:25:10.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.766+0000 7f9eba62d700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb40cb490 con 0x7f9eb40b20b0 2023-11-08T19:25:10.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.766+0000 7f9eb37fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f9eb40b16b0 0x7f9eb40cbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:10.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.766+0000 7f9eb37fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f9eb40b16b0 0x7f9eb40cbf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40840/0 (socket says 172.21.15.149:40840) 2023-11-08T19:25:10.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.766+0000 7f9eb37fe700 1 -- 172.21.15.149:0/3804197731 learned_addr learned my addr 172.21.15.149:0/3804197731 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:10.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.766+0000 7f9eb3fff700 1 --2- 172.21.15.149:0/3804197731 >> v2:172.21.15.160:3300/0 conn(0x7f9eb40afb30 0x7f9eb40ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:10.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.766+0000 7f9eb8bca700 1 --2- 172.21.15.149:0/3804197731 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9eb40b20b0 0x7f9eb40b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:10.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.767+0000 7f9eb37fe700 1 -- 172.21.15.149:0/3804197731 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9eb40b20b0 msgr2=0x7f9eb40b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:10.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.767+0000 7f9eb37fe700 1 --2- 172.21.15.149:0/3804197731 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9eb40b20b0 0x7f9eb40b2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:10.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.767+0000 7f9eb37fe700 1 -- 172.21.15.149:0/3804197731 >> v2:172.21.15.160:3300/0 conn(0x7f9eb40afb30 msgr2=0x7f9eb40ce380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:10.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.767+0000 7f9eb37fe700 1 --2- 172.21.15.149:0/3804197731 >> v2:172.21.15.160:3300/0 conn(0x7f9eb40afb30 0x7f9eb40ce380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:10.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.767+0000 7f9eb37fe700 1 -- 172.21.15.149:0/3804197731 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb40cb770 con 0x7f9eb40b16b0 2023-11-08T19:25:10.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.767+0000 7f9eb37fe700 1 --2- 172.21.15.149:0/3804197731 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9eb40b16b0 0x7f9eb40cbf70 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f9eb40d0590 tx=0x7f9ea8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38f5427877e99e0e server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:10.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.767+0000 7f9eb2ffd700 1 -- 172.21.15.149:0/3804197731 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea800b870 con 0x7f9eb40b16b0 2023-11-08T19:25:10.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.767+0000 7f9eb2ffd700 1 -- 172.21.15.149:0/3804197731 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea800b9d0 con 0x7f9eb40b16b0 2023-11-08T19:25:10.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.767+0000 7f9eb2ffd700 1 -- 172.21.15.149:0/3804197731 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea800bd60 con 0x7f9eb40b16b0 2023-11-08T19:25:10.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.767+0000 7f9eba62d700 1 -- 172.21.15.149:0/3804197731 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9eb40b16b0 msgr2=0x7f9eb40cbf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:10.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.767+0000 7f9eba62d700 1 --2- 172.21.15.149:0/3804197731 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9eb40b16b0 0x7f9eb40cbf70 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f9eb40d0590 tx=0x7f9ea8009bd0 comp rx=0 tx=0).stop 2023-11-08T19:25:10.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.767+0000 7f9eba62d700 1 -- 172.21.15.149:0/3804197731 shutdown_connections 2023-11-08T19:25:10.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.767+0000 7f9eba62d700 1 --2- 172.21.15.149:0/3804197731 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9eb40b20b0 0x7f9eb40b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:10.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.767+0000 7f9eba62d700 1 --2- 172.21.15.149:0/3804197731 >> v2:172.21.15.160:3300/0 conn(0x7f9eb40afb30 0x7f9eb40ce380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:10.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.767+0000 7f9eba62d700 1 --2- 172.21.15.149:0/3804197731 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9eb40b16b0 0x7f9eb40cbf70 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:10.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.767+0000 7f9eba62d700 1 -- 172.21.15.149:0/3804197731 >> 172.21.15.149:0/3804197731 conn(0x7f9eb4099a40 msgr2=0x7f9eb40d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:10.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.767+0000 7f9eba62d700 1 -- 172.21.15.149:0/3804197731 shutdown_connections 2023-11-08T19:25:10.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.767+0000 7f9eba62d700 1 -- 172.21.15.149:0/3804197731 wait complete. 2023-11-08T19:25:10.779 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.769+0000 7f9eba62d700 1 Processor -- start 2023-11-08T19:25:10.779 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.769+0000 7f9eba62d700 1 -- start start 2023-11-08T19:25:10.780 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.770+0000 7f9eba62d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9eb40afb30 0x7f9eb41f3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:10.780 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.770+0000 7f9eba62d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9eb40b16b0 0x7f9eb41f74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:10.780 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.770+0000 7f9eba62d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9eb40b20b0 0x7f9eb40b5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:10.780 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.770+0000 7f9eba62d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb41f7a10 con 0x7f9eb40b16b0 2023-11-08T19:25:10.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.770+0000 7f9eba62d700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb41f3c40 con 0x7f9eb40b20b0 2023-11-08T19:25:10.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.770+0000 7f9eba62d700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb41f3f20 con 0x7f9eb40afb30 2023-11-08T19:25:10.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.770+0000 7f9eb37fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9eb40b16b0 0x7f9eb41f74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:10.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.770+0000 7f9eb37fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9eb40b16b0 0x7f9eb41f74d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40846/0 (socket says 172.21.15.149:40846) 2023-11-08T19:25:10.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.770+0000 7f9eb37fe700 1 -- 172.21.15.149:0/2488086324 learned_addr learned my addr 172.21.15.149:0/2488086324 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:10.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.770+0000 7f9eb3fff700 1 --2- 172.21.15.149:0/2488086324 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9eb40afb30 0x7f9eb41f3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:10.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.770+0000 7f9eb37fe700 1 -- 172.21.15.149:0/2488086324 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9eb40afb30 msgr2=0x7f9eb41f3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:10.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.770+0000 7f9eb37fe700 1 --2- 172.21.15.149:0/2488086324 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9eb40afb30 0x7f9eb41f3540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:10.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.770+0000 7f9eb37fe700 1 -- 172.21.15.149:0/2488086324 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9eb40b20b0 msgr2=0x7f9eb40b5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:10.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.770+0000 7f9eb8bca700 1 --2- 172.21.15.149:0/2488086324 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9eb40b20b0 0x7f9eb40b5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:10.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.770+0000 7f9eb37fe700 1 --2- 172.21.15.149:0/2488086324 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9eb40b20b0 0x7f9eb40b5690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:10.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.770+0000 7f9eb37fe700 1 -- 172.21.15.149:0/2488086324 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ea8009550 con 0x7f9eb40b16b0 2023-11-08T19:25:10.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.770+0000 7f9eb37fe700 1 --2- 172.21.15.149:0/2488086324 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9eb40b16b0 0x7f9eb41f74d0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8009c10 tx=0x7f9ea8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:10.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.770+0000 7f9eb0ff9700 1 -- 172.21.15.149:0/2488086324 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea8004250 con 0x7f9eb40b16b0 2023-11-08T19:25:10.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.770+0000 7f9eb0ff9700 1 -- 172.21.15.149:0/2488086324 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea801f070 con 0x7f9eb40b16b0 2023-11-08T19:25:10.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.770+0000 7f9eba62d700 1 -- 172.21.15.149:0/2488086324 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9eb41f4200 con 0x7f9eb40b16b0 2023-11-08T19:25:10.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.770+0000 7f9eb0ff9700 1 -- 172.21.15.149:0/2488086324 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea80045d0 con 0x7f9eb40b16b0 2023-11-08T19:25:10.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.770+0000 7f9eba62d700 1 -- 172.21.15.149:0/2488086324 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eb40b5bd0 con 0x7f9eb40b16b0 2023-11-08T19:25:10.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.771+0000 7f9eba62d700 1 -- 172.21.15.149:0/2488086324 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9eb40c98a0 con 0x7f9eb40b16b0 2023-11-08T19:25:10.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.772+0000 7f9eb0ff9700 1 -- 172.21.15.149:0/2488086324 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9ea8021030 con 0x7f9eb40b16b0 2023-11-08T19:25:10.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.772+0000 7f9eb0ff9700 1 --2- 172.21.15.149:0/2488086324 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9ea006af00 0x7f9ea006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:10.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.772+0000 7f9eb0ff9700 1 -- 172.21.15.149:0/2488086324 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f9ea808ac70 con 0x7f9eb40b16b0 2023-11-08T19:25:10.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.772+0000 7f9eb3fff700 1 --2- 172.21.15.149:0/2488086324 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9ea006af00 0x7f9ea006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:10.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.773+0000 7f9eb3fff700 1 --2- 172.21.15.149:0/2488086324 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9ea006af00 0x7f9ea006d3c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9ea4006fd0 tx=0x7f9ea4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:10.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:10.777+0000 7f9eb0ff9700 1 -- 172.21.15.149:0/2488086324 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9eb40c98a0 con 0x7f9eb40b16b0 2023-11-08T19:25:11.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.010+0000 7f9eba62d700 1 -- 172.21.15.149:0/2488086324 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9eb40c98a0 con 0x7f9eb40b16b0 2023-11-08T19:25:11.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.010+0000 7f9eb0ff9700 1 -- 172.21.15.149:0/2488086324 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f9eb40c98a0 con 0x7f9eb40b16b0 2023-11-08T19:25:11.013 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:25:11.013 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5455,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/2693283976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2693283976},{"type":"v1","addr":"172.21.15.160:6834","nonce":2693283976}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5458,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/3714474190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":3714474190},{"type":"v1","addr":"172.21.15.160:6835","nonce":3714474190}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5730,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/1885678824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":1885678824},{"type":"v1","addr":"172.21.15.149:6836","nonce":1885678824}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-08T19:24:51.735078+0000","modified":"2023-11-08T19:24:54.764447+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5733},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5733":{"gid":5733,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6837/4238261436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":4238261436},{"type":"v1","addr":"172.21.15.149:6837","nonce":4238261436}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-08T19:25:11.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.012+0000 7f9eba62d700 1 -- 172.21.15.149:0/2488086324 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9ea006af00 msgr2=0x7f9ea006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:11.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.012+0000 7f9eba62d700 1 --2- 172.21.15.149:0/2488086324 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9ea006af00 0x7f9ea006d3c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9ea4006fd0 tx=0x7f9ea4008040 comp rx=0 tx=0).stop 2023-11-08T19:25:11.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.012+0000 7f9eba62d700 1 -- 172.21.15.149:0/2488086324 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9eb40b16b0 msgr2=0x7f9eb41f74d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:11.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.012+0000 7f9eba62d700 1 --2- 172.21.15.149:0/2488086324 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9eb40b16b0 0x7f9eb41f74d0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8009c10 tx=0x7f9ea8004750 comp rx=0 tx=0).stop 2023-11-08T19:25:11.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.012+0000 7f9eba62d700 1 -- 172.21.15.149:0/2488086324 shutdown_connections 2023-11-08T19:25:11.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.012+0000 7f9eba62d700 1 --2- 172.21.15.149:0/2488086324 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9ea006af00 0x7f9ea006d3c0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:11.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.012+0000 7f9eba62d700 1 --2- 172.21.15.149:0/2488086324 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9eb40b20b0 0x7f9eb40b5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:11.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.012+0000 7f9eba62d700 1 --2- 172.21.15.149:0/2488086324 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9eb40afb30 0x7f9eb41f3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:11.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.012+0000 7f9eba62d700 1 --2- 172.21.15.149:0/2488086324 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9eb40b16b0 0x7f9eb41f74d0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:11.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.012+0000 7f9eba62d700 1 -- 172.21.15.149:0/2488086324 >> 172.21.15.149:0/2488086324 conn(0x7f9eb4099a40 msgr2=0x7f9eb406f8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:11.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.013+0000 7f9eba62d700 1 -- 172.21.15.149:0/2488086324 shutdown_connections 2023-11-08T19:25:11.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.013+0000 7f9eba62d700 1 -- 172.21.15.149:0/2488086324 wait complete. 2023-11-08T19:25:11.018 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 25 2023-11-08T19:25:11.027 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:25:11.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.148+0000 7f44be41a700 1 Processor -- start 2023-11-08T19:25:11.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.148+0000 7f44be41a700 1 -- start start 2023-11-08T19:25:11.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.148+0000 7f44be41a700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f44b80afb30 0x7f44b80ce380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:11.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.149+0000 7f44be41a700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f44b80b16b0 0x7f44b80cbf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:11.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.149+0000 7f44be41a700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f44b80b20b0 0x7f44b80b2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:11.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.149+0000 7f44be41a700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44b80b2a80 con 0x7f44b80b16b0 2023-11-08T19:25:11.154 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.149+0000 7f44be41a700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44b80d1330 con 0x7f44b80b20b0 2023-11-08T19:25:11.154 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.149+0000 7f44be41a700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44b80cb490 con 0x7f44b80afb30 2023-11-08T19:25:11.154 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.149+0000 7f44b77fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f44b80b16b0 0x7f44b80cbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:11.154 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.149+0000 7f44b77fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f44b80b16b0 0x7f44b80cbf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40854/0 (socket says 172.21.15.149:40854) 2023-11-08T19:25:11.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.149+0000 7f44b77fe700 1 -- 172.21.15.149:0/2035020323 learned_addr learned my addr 172.21.15.149:0/2035020323 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:11.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.149+0000 7f44b7fff700 1 --2- 172.21.15.149:0/2035020323 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f44b80afb30 0x7f44b80ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:11.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.149+0000 7f44bc9b7700 1 --2- 172.21.15.149:0/2035020323 >> v2:172.21.15.160:3300/0 conn(0x7f44b80b20b0 0x7f44b80b2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:11.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.149+0000 7f44b77fe700 1 -- 172.21.15.149:0/2035020323 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f44b80afb30 msgr2=0x7f44b80ce380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:11.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.149+0000 7f44b77fe700 1 --2- 172.21.15.149:0/2035020323 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f44b80afb30 0x7f44b80ce380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:11.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.149+0000 7f44b77fe700 1 -- 172.21.15.149:0/2035020323 >> v2:172.21.15.160:3300/0 conn(0x7f44b80b20b0 msgr2=0x7f44b80b2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:11.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.149+0000 7f44b77fe700 1 --2- 172.21.15.149:0/2035020323 >> v2:172.21.15.160:3300/0 conn(0x7f44b80b20b0 0x7f44b80b2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:11.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.149+0000 7f44b77fe700 1 -- 172.21.15.149:0/2035020323 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b80cb770 con 0x7f44b80b16b0 2023-11-08T19:25:11.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.149+0000 7f44b77fe700 1 --2- 172.21.15.149:0/2035020323 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44b80b16b0 0x7f44b80cbf70 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f44b80caf30 tx=0x7f44ac009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f493278200049a server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:11.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.149+0000 7f44b6ffd700 1 -- 172.21.15.149:0/2035020323 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ac011830 con 0x7f44b80b16b0 2023-11-08T19:25:11.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.149+0000 7f44b6ffd700 1 -- 172.21.15.149:0/2035020323 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44ac011990 con 0x7f44b80b16b0 2023-11-08T19:25:11.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.149+0000 7f44b6ffd700 1 -- 172.21.15.149:0/2035020323 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ac011d20 con 0x7f44b80b16b0 2023-11-08T19:25:11.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.150+0000 7f44be41a700 1 -- 172.21.15.149:0/2035020323 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44b80b16b0 msgr2=0x7f44b80cbf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:11.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.150+0000 7f44be41a700 1 --2- 172.21.15.149:0/2035020323 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44b80b16b0 0x7f44b80cbf70 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f44b80caf30 tx=0x7f44ac009bd0 comp rx=0 tx=0).stop 2023-11-08T19:25:11.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.150+0000 7f44be41a700 1 -- 172.21.15.149:0/2035020323 shutdown_connections 2023-11-08T19:25:11.158 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.150+0000 7f44be41a700 1 --2- 172.21.15.149:0/2035020323 >> v2:172.21.15.160:3300/0 conn(0x7f44b80b20b0 0x7f44b80b2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:11.158 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.150+0000 7f44be41a700 1 --2- 172.21.15.149:0/2035020323 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f44b80afb30 0x7f44b80ce380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:11.158 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.150+0000 7f44be41a700 1 --2- 172.21.15.149:0/2035020323 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44b80b16b0 0x7f44b80cbf70 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:11.158 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.150+0000 7f44be41a700 1 -- 172.21.15.149:0/2035020323 >> 172.21.15.149:0/2035020323 conn(0x7f44b8099a40 msgr2=0x7f44b80d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:11.158 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.150+0000 7f44be41a700 1 -- 172.21.15.149:0/2035020323 shutdown_connections 2023-11-08T19:25:11.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.150+0000 7f44be41a700 1 -- 172.21.15.149:0/2035020323 wait complete. 2023-11-08T19:25:11.161 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.151+0000 7f44be41a700 1 Processor -- start 2023-11-08T19:25:11.161 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.152+0000 7f44be41a700 1 -- start start 2023-11-08T19:25:11.162 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.153+0000 7f44be41a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44b80afb30 0x7f44b80c6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:11.162 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.153+0000 7f44be41a700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f44b80b16b0 0x7f44b806adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:11.162 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.153+0000 7f44be41a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f44b80b20b0 0x7f44b81e6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:11.162 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.153+0000 7f44be41a700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b815cc80 con 0x7f44b80afb30 2023-11-08T19:25:11.163 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.153+0000 7f44be41a700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b81e59b0 con 0x7f44b80b20b0 2023-11-08T19:25:11.163 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.153+0000 7f44be41a700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44b81e5c90 con 0x7f44b80b16b0 2023-11-08T19:25:11.163 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.153+0000 7f44b7fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44b80afb30 0x7f44b80c6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:11.163 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.153+0000 7f44b7fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44b80afb30 0x7f44b80c6900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40858/0 (socket says 172.21.15.149:40858) 2023-11-08T19:25:11.163 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.153+0000 7f44b7fff700 1 -- 172.21.15.149:0/596576046 learned_addr learned my addr 172.21.15.149:0/596576046 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:11.164 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.153+0000 7f44b77fe700 1 --2- 172.21.15.149:0/596576046 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f44b80b16b0 0x7f44b806adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:11.164 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.153+0000 7f44b7fff700 1 -- 172.21.15.149:0/596576046 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f44b80b16b0 msgr2=0x7f44b806adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:11.164 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.153+0000 7f44bc9b7700 1 --2- 172.21.15.149:0/596576046 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f44b80b20b0 0x7f44b81e6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:11.164 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.153+0000 7f44b7fff700 1 --2- 172.21.15.149:0/596576046 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f44b80b16b0 0x7f44b806adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:11.164 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.153+0000 7f44b7fff700 1 -- 172.21.15.149:0/596576046 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f44b80b20b0 msgr2=0x7f44b81e6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:11.165 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.153+0000 7f44b7fff700 1 --2- 172.21.15.149:0/596576046 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f44b80b20b0 0x7f44b81e6a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:11.165 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.153+0000 7f44b7fff700 1 -- 172.21.15.149:0/596576046 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44ac009550 con 0x7f44b80afb30 2023-11-08T19:25:11.165 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.153+0000 7f44b7fff700 1 --2- 172.21.15.149:0/596576046 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44b80afb30 0x7f44b80c6900 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f44a800e9b0 tx=0x7f44a800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:11.165 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.153+0000 7f44b4ff9700 1 -- 172.21.15.149:0/596576046 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a8009670 con 0x7f44b80afb30 2023-11-08T19:25:11.166 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.153+0000 7f44b4ff9700 1 -- 172.21.15.149:0/596576046 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44a8005a20 con 0x7f44b80afb30 2023-11-08T19:25:11.166 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.153+0000 7f44b4ff9700 1 -- 172.21.15.149:0/596576046 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a8005db0 con 0x7f44b80afb30 2023-11-08T19:25:11.166 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.153+0000 7f44be41a700 1 -- 172.21.15.149:0/596576046 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44b81e5f70 con 0x7f44b80afb30 2023-11-08T19:25:11.166 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.153+0000 7f44be41a700 1 -- 172.21.15.149:0/596576046 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44b81e6530 con 0x7f44b80afb30 2023-11-08T19:25:11.166 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.154+0000 7f44be41a700 1 -- 172.21.15.149:0/596576046 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44b81e68a0 con 0x7f44b80afb30 2023-11-08T19:25:11.167 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.155+0000 7f44b4ff9700 1 -- 172.21.15.149:0/596576046 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f44a800c850 con 0x7f44b80afb30 2023-11-08T19:25:11.167 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.155+0000 7f44b4ff9700 1 --2- 172.21.15.149:0/596576046 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f44a406af00 0x7f44a406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:11.167 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.155+0000 7f44b4ff9700 1 -- 172.21.15.149:0/596576046 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f44a8089ac0 con 0x7f44b80afb30 2023-11-08T19:25:11.167 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.155+0000 7f44b77fe700 1 --2- 172.21.15.149:0/596576046 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f44a406af00 0x7f44a406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:11.167 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.156+0000 7f44b77fe700 1 --2- 172.21.15.149:0/596576046 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f44a406af00 0x7f44a406d3c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f44b80b1ad0 tx=0x7f44ac008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:11.168 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.160+0000 7f44b4ff9700 1 -- 172.21.15.149:0/596576046 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f44a80548d0 con 0x7f44b80afb30 2023-11-08T19:25:11.353 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.351+0000 7f44be41a700 1 -- 172.21.15.149:0/596576046 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f44b81e66c0 con 0x7f44b80afb30 2023-11-08T19:25:11.354 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.352+0000 7f44b4ff9700 1 -- 172.21.15.149:0/596576046 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+18559 (secure 0 0 0) 0x7f44a8089e60 con 0x7f44b80afb30 2023-11-08T19:25:11.354 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:25:11.355 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":55,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:24:53.348156+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-08T19:24:29.516185+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-08T19:24:49.982090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-08T19:24:50.696398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:25:11.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.354+0000 7f44be41a700 1 -- 172.21.15.149:0/596576046 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f44a406af00 msgr2=0x7f44a406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:11.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.354+0000 7f44be41a700 1 --2- 172.21.15.149:0/596576046 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f44a406af00 0x7f44a406d3c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f44b80b1ad0 tx=0x7f44ac008030 comp rx=0 tx=0).stop 2023-11-08T19:25:11.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.354+0000 7f44be41a700 1 -- 172.21.15.149:0/596576046 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44b80afb30 msgr2=0x7f44b80c6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:11.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.354+0000 7f44be41a700 1 --2- 172.21.15.149:0/596576046 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44b80afb30 0x7f44b80c6900 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f44a800e9b0 tx=0x7f44a800ed70 comp rx=0 tx=0).stop 2023-11-08T19:25:11.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.354+0000 7f44be41a700 1 -- 172.21.15.149:0/596576046 shutdown_connections 2023-11-08T19:25:11.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.354+0000 7f44be41a700 1 --2- 172.21.15.149:0/596576046 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f44a406af00 0x7f44a406d3c0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:11.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.354+0000 7f44be41a700 1 --2- 172.21.15.149:0/596576046 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f44b80b20b0 0x7f44b81e6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:11.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.354+0000 7f44be41a700 1 --2- 172.21.15.149:0/596576046 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44b80afb30 0x7f44b80c6900 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:11.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.354+0000 7f44be41a700 1 --2- 172.21.15.149:0/596576046 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f44b80b16b0 0x7f44b806adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:11.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.354+0000 7f44be41a700 1 -- 172.21.15.149:0/596576046 >> 172.21.15.149:0/596576046 conn(0x7f44b8099a40 msgr2=0x7f44b806f660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:11.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.354+0000 7f44be41a700 1 -- 172.21.15.149:0/596576046 shutdown_connections 2023-11-08T19:25:11.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.354+0000 7f44be41a700 1 -- 172.21.15.149:0/596576046 wait complete. 2023-11-08T19:25:11.369 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-08T19:25:11.490 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.488+0000 7f2fcd56b700 1 Processor -- start 2023-11-08T19:25:11.490 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.488+0000 7f2fcd56b700 1 -- start start 2023-11-08T19:25:11.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.489+0000 7f2fcd56b700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f2fc8161670 0x7f2fc80b5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:11.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.489+0000 7f2fcd56b700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fc80d1a10 con 0x7f2fc8161a50 2023-11-08T19:25:11.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.489+0000 7f2fcd56b700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fc80d1cf0 con 0x7f2fc80ce500 2023-11-08T19:25:11.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.489+0000 7f2fcd56b700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fc80d1fd0 con 0x7f2fc8161670 2023-11-08T19:25:11.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.489+0000 7f2fc67fc700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f2fc8161a50 0x7f2fc8161f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:42868/0 (socket says 172.21.15.149:42868) 2023-11-08T19:25:11.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.489+0000 7f2fc67fc700 1 -- 172.21.15.149:0/2640287342 learned_addr learned my addr 172.21.15.149:0/2640287342 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:25:11.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.489+0000 7f2fc5ffb700 1 -- 172.21.15.149:0/2640287342 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3741092676 0 0) 0x7f2fc80d1a10 con 0x7f2fc8161a50 2023-11-08T19:25:11.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.489+0000 7f2fc5ffb700 1 -- 172.21.15.149:0/2640287342 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fb00035b0 con 0x7f2fc8161a50 2023-11-08T19:25:11.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.489+0000 7f2fc6ffd700 1 --2- 172.21.15.149:0/2640287342 >> v2:172.21.15.160:3300/0 conn(0x7f2fc8161670 0x7f2fc80b5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:11.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.489+0000 7f2fc5ffb700 1 -- 172.21.15.149:0/2640287342 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1480647226 0 0) 0x7f2fb00035b0 con 0x7f2fc8161a50 2023-11-08T19:25:11.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.489+0000 7f2fc5ffb700 1 -- 172.21.15.149:0/2640287342 >> v2:172.21.15.160:3300/0 conn(0x7f2fc8161670 msgr2=0x7f2fc80b5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:11.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.489+0000 7f2fc5ffb700 1 --2- 172.21.15.149:0/2640287342 >> v2:172.21.15.160:3300/0 conn(0x7f2fc8161670 0x7f2fc80b5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:11.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.489+0000 7f2fc5ffb700 1 -- 172.21.15.149:0/2640287342 >> v1:172.21.15.160:6789/0 conn(0x7f2fc80ce500 legacy=0x7f2fc80ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:11.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.489+0000 7f2fc5ffb700 1 -- 172.21.15.149:0/2640287342 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc80d22b0 con 0x7f2fc8161a50 2023-11-08T19:25:11.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.489+0000 7f2fc5ffb700 1 -- 172.21.15.149:0/2640287342 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f2fb8001670 con 0x7f2fc8161a50 2023-11-08T19:25:11.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.489+0000 7f2fc5ffb700 1 -- 172.21.15.149:0/2640287342 >> v1:172.21.15.149:6789/0 conn(0x7f2fc8161a50 legacy=0x7f2fc8161f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:11.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.489+0000 7f2fc5ffb700 1 --2- 172.21.15.149:0/2640287342 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2fb0003a00 0x7f2fb0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:11.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.489+0000 7f2fc5ffb700 1 --2- 172.21.15.149:0/2640287342 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fb0004850 0x7f2fb0004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:11.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.489+0000 7f2fc5ffb700 1 --2- 172.21.15.149:0/2640287342 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2fb0005210 0x7f2fb000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:11.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.489+0000 7f2fc5ffb700 1 -- 172.21.15.149:0/2640287342 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc80d1fd0 con 0x7f2fb0004850 2023-11-08T19:25:11.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.489+0000 7f2fc5ffb700 1 -- 172.21.15.149:0/2640287342 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb000c0b0 con 0x7f2fb0003a00 2023-11-08T19:25:11.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.489+0000 7f2fc5ffb700 1 -- 172.21.15.149:0/2640287342 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb000c270 con 0x7f2fb0005210 2023-11-08T19:25:11.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.490+0000 7f2fc67fc700 1 --2- 172.21.15.149:0/2640287342 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fb0004850 0x7f2fb0004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:11.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.490+0000 7f2fc6ffd700 1 --2- 172.21.15.149:0/2640287342 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2fb0003a00 0x7f2fb0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:11.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.490+0000 7f2fc77fe700 1 --2- 172.21.15.149:0/2640287342 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2fb0005210 0x7f2fb000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:11.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.490+0000 7f2fc67fc700 1 -- 172.21.15.149:0/2640287342 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2fb0005210 msgr2=0x7f2fb000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:11.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.490+0000 7f2fc67fc700 1 --2- 172.21.15.149:0/2640287342 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2fb0005210 0x7f2fb000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:11.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.490+0000 7f2fc67fc700 1 -- 172.21.15.149:0/2640287342 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2fb0003a00 msgr2=0x7f2fb0003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:11.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.490+0000 7f2fc67fc700 1 --2- 172.21.15.149:0/2640287342 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2fb0003a00 0x7f2fb0003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:11.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.490+0000 7f2fc67fc700 1 -- 172.21.15.149:0/2640287342 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb00035b0 con 0x7f2fb0004850 2023-11-08T19:25:11.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.490+0000 7f2fc6ffd700 1 --2- 172.21.15.149:0/2640287342 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2fb0003a00 0x7f2fb0003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:25:11.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.490+0000 7f2fc77fe700 1 -- 172.21.15.149:0/2640287342 reap_dead start 2023-11-08T19:25:11.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.490+0000 7f2fc67fc700 1 --2- 172.21.15.149:0/2640287342 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fb0004850 0x7f2fb0004cd0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f2fb800c2a0 tx=0x7f2fb0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5983f60b670e643e server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:11.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.490+0000 7f2fc5ffb700 1 -- 172.21.15.149:0/2640287342 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb8007c10 con 0x7f2fb0004850 2023-11-08T19:25:11.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.490+0000 7f2fc5ffb700 1 -- 172.21.15.149:0/2640287342 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb800cde0 con 0x7f2fb0004850 2023-11-08T19:25:11.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.490+0000 7f2fc5ffb700 1 -- 172.21.15.149:0/2640287342 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb8005ba0 con 0x7f2fb0004850 2023-11-08T19:25:11.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.491+0000 7f2fcd56b700 1 -- 172.21.15.149:0/2640287342 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fb0004850 msgr2=0x7f2fb0004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:11.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.491+0000 7f2fcd56b700 1 --2- 172.21.15.149:0/2640287342 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fb0004850 0x7f2fb0004cd0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f2fb800c2a0 tx=0x7f2fb0005880 comp rx=0 tx=0).stop 2023-11-08T19:25:11.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.491+0000 7f2fcd56b700 1 -- 172.21.15.149:0/2640287342 shutdown_connections 2023-11-08T19:25:11.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.491+0000 7f2fcd56b700 1 --2- 172.21.15.149:0/2640287342 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fb0004850 0x7f2fb0004cd0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:11.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.491+0000 7f2fcd56b700 1 -- 172.21.15.149:0/2640287342 >> 172.21.15.149:0/2640287342 conn(0x7f2fc80d3980 msgr2=0x7f2fc80d3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:11.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.491+0000 7f2fcd56b700 1 -- 172.21.15.149:0/2640287342 shutdown_connections 2023-11-08T19:25:11.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.491+0000 7f2fcd56b700 1 -- 172.21.15.149:0/2640287342 wait complete. 2023-11-08T19:25:11.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.492+0000 7f2fcd56b700 1 Processor -- start 2023-11-08T19:25:11.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.492+0000 7f2fcd56b700 1 -- start start 2023-11-08T19:25:11.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.493+0000 7f2fcd56b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2fb0004850 0x7f2fc81540e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:11.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.493+0000 7f2fcd56b700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2fc80ca9c0 0x7f2fc8146b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:11.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.493+0000 7f2fcd56b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fc80ccf60 0x7f2fc80cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:11.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.493+0000 7f2fcd56b700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc80cbe10 con 0x7f2fc80ccf60 2023-11-08T19:25:11.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.493+0000 7f2fcd56b700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc80cd920 con 0x7f2fb0004850 2023-11-08T19:25:11.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.493+0000 7f2fcd56b700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc80cb190 con 0x7f2fc80ca9c0 2023-11-08T19:25:11.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.493+0000 7f2fc77fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fc80ccf60 0x7f2fc80cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:11.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.493+0000 7f2fc77fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fc80ccf60 0x7f2fc80cd3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40882/0 (socket says 172.21.15.149:40882) 2023-11-08T19:25:11.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.493+0000 7f2fc77fe700 1 -- 172.21.15.149:0/2637469072 learned_addr learned my addr 172.21.15.149:0/2637469072 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:11.509 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.494+0000 7f2fc6ffd700 1 --2- 172.21.15.149:0/2637469072 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2fb0004850 0x7f2fc81540e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:11.509 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.494+0000 7f2fc67fc700 1 --2- 172.21.15.149:0/2637469072 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2fc80ca9c0 0x7f2fc8146b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:11.509 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.494+0000 7f2fc77fe700 1 -- 172.21.15.149:0/2637469072 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2fc80ca9c0 msgr2=0x7f2fc8146b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:11.509 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.494+0000 7f2fc77fe700 1 --2- 172.21.15.149:0/2637469072 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2fc80ca9c0 0x7f2fc8146b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:11.509 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.494+0000 7f2fc77fe700 1 -- 172.21.15.149:0/2637469072 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2fb0004850 msgr2=0x7f2fc81540e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:11.510 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.494+0000 7f2fc77fe700 1 --2- 172.21.15.149:0/2637469072 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2fb0004850 0x7f2fc81540e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:11.510 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.494+0000 7f2fc77fe700 1 -- 172.21.15.149:0/2637469072 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc80cb470 con 0x7f2fc80ccf60 2023-11-08T19:25:11.510 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.494+0000 7f2fc77fe700 1 --2- 172.21.15.149:0/2637469072 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fc80ccf60 0x7f2fc80cd3e0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f2fc8161e30 tx=0x7f2fc000ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:11.510 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.494+0000 7f2faf7fe700 1 -- 172.21.15.149:0/2637469072 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc000ee70 con 0x7f2fc80ccf60 2023-11-08T19:25:11.510 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.494+0000 7f2faf7fe700 1 -- 172.21.15.149:0/2637469072 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fc0003c10 con 0x7f2fc80ccf60 2023-11-08T19:25:11.511 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.494+0000 7f2fcd56b700 1 -- 172.21.15.149:0/2637469072 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fc80cb750 con 0x7f2fc80ccf60 2023-11-08T19:25:11.511 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.494+0000 7f2faf7fe700 1 -- 172.21.15.149:0/2637469072 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc00050d0 con 0x7f2fc80ccf60 2023-11-08T19:25:11.511 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.494+0000 7f2fcd56b700 1 -- 172.21.15.149:0/2637469072 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fc8147070 con 0x7f2fc80ccf60 2023-11-08T19:25:11.511 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.495+0000 7f2fcd56b700 1 -- 172.21.15.149:0/2637469072 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fc80745f0 con 0x7f2fc80ccf60 2023-11-08T19:25:11.511 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.496+0000 7f2faf7fe700 1 -- 172.21.15.149:0/2637469072 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2fc0005230 con 0x7f2fc80ccf60 2023-11-08T19:25:11.512 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.496+0000 7f2faf7fe700 1 --2- 172.21.15.149:0/2637469072 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2fb406af00 0x7f2fb406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:11.512 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.496+0000 7f2fc6ffd700 1 --2- 172.21.15.149:0/2637469072 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2fb406af00 0x7f2fb406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:11.512 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.496+0000 7f2faf7fe700 1 -- 172.21.15.149:0/2637469072 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f2fc0089680 con 0x7f2fc80ccf60 2023-11-08T19:25:11.512 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.497+0000 7f2fc6ffd700 1 --2- 172.21.15.149:0/2637469072 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2fb406af00 0x7f2fb406d3c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc009c50 tx=0x7f2fbc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:11.512 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.501+0000 7f2faf7fe700 1 -- 172.21.15.149:0/2637469072 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2fc0054400 con 0x7f2fc80ccf60 2023-11-08T19:25:11.732 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.730+0000 7f2fcd56b700 1 -- 172.21.15.149:0/2637469072 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f2fc808b060 con 0x7f2fc80ccf60 2023-11-08T19:25:11.733 INFO:tasks.ceph.mon.a.smithi149.stderr:2023-11-08T19:25:11.731+0000 7f2b592f2700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-08T19:25:11.734 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.733+0000 7f2faf7fe700 1 -- 172.21.15.149:0/2637469072 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v26) v1 ==== 161+0+0 (secure 0 0 0) 0x7f2fc0057a20 con 0x7f2fc80ccf60 2023-11-08T19:25:11.738 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.736+0000 7f2fcd56b700 1 -- 172.21.15.149:0/2637469072 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2fb406af00 msgr2=0x7f2fb406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:11.738 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.736+0000 7f2fcd56b700 1 --2- 172.21.15.149:0/2637469072 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2fb406af00 0x7f2fb406d3c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc009c50 tx=0x7f2fbc008040 comp rx=0 tx=0).stop 2023-11-08T19:25:11.739 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.736+0000 7f2fcd56b700 1 -- 172.21.15.149:0/2637469072 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fc80ccf60 msgr2=0x7f2fc80cd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:11.739 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.736+0000 7f2fcd56b700 1 --2- 172.21.15.149:0/2637469072 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fc80ccf60 0x7f2fc80cd3e0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f2fc8161e30 tx=0x7f2fc000ed50 comp rx=0 tx=0).stop 2023-11-08T19:25:11.739 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.736+0000 7f2fcd56b700 1 -- 172.21.15.149:0/2637469072 shutdown_connections 2023-11-08T19:25:11.739 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.736+0000 7f2fcd56b700 1 --2- 172.21.15.149:0/2637469072 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2fb406af00 0x7f2fb406d3c0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:11.739 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.736+0000 7f2fcd56b700 1 --2- 172.21.15.149:0/2637469072 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2fb0004850 0x7f2fc81540e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:11.740 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.736+0000 7f2fcd56b700 1 --2- 172.21.15.149:0/2637469072 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fc80ccf60 0x7f2fc80cd3e0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:11.740 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.736+0000 7f2fcd56b700 1 --2- 172.21.15.149:0/2637469072 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2fc80ca9c0 0x7f2fc8146b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:11.740 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.736+0000 7f2fcd56b700 1 -- 172.21.15.149:0/2637469072 >> 172.21.15.149:0/2637469072 conn(0x7f2fc80d3980 msgr2=0x7f2fc815fdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:11.740 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.736+0000 7f2fcd56b700 1 -- 172.21.15.149:0/2637469072 shutdown_connections 2023-11-08T19:25:11.740 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.736+0000 7f2fcd56b700 1 -- 172.21.15.149:0/2637469072 wait complete. 2023-11-08T19:25:11.741 INFO:teuthology.orchestra.run.smithi149.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-08T19:25:11.741 INFO:tasks.ceph.mds.c.smithi149.stderr: -2923> 2023-11-08T19:24:57.318+0000 7f322a2fa700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-08T19:25:11.754 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-08T19:25:11.771 INFO:tasks.ceph.mds.c.smithi149.stdout:starting mds.c at 2023-11-08T19:25:11.879 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.877+0000 7f2c56a5c700 1 Processor -- start 2023-11-08T19:25:11.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.877+0000 7f2c56a5c700 1 -- start start 2023-11-08T19:25:11.882 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.878+0000 7f2c56a5c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2c500b9640 0x7f2c500d3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:11.882 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.878+0000 7f2c56a5c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2c500d0330 0x7f2c500d07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:11.883 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.878+0000 7f2c56a5c700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c5015dfc0 con 0x7f2c5015dbe0 2023-11-08T19:25:11.883 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.878+0000 7f2c56a5c700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c500d2090 con 0x7f2c500d0330 2023-11-08T19:25:11.883 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.878+0000 7f2c56a5c700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c500d0d00 con 0x7f2c500b9640 2023-11-08T19:25:11.883 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.878+0000 7f2c54ff9700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2c500d0330 0x7f2c500d07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:11.884 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.878+0000 7f2c54ff9700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2c500d0330 0x7f2c500d07c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40902/0 (socket says 172.21.15.149:40902) 2023-11-08T19:25:11.884 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.878+0000 7f2c54ff9700 1 -- 172.21.15.149:0/2335514188 learned_addr learned my addr 172.21.15.149:0/2335514188 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:11.884 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.879+0000 7f2c4f7fe700 1 --2- 172.21.15.149:0/2335514188 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2c500b9640 0x7f2c500d3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:11.884 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.879+0000 7f2c54ff9700 1 -- 172.21.15.149:0/2335514188 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2c500b9640 msgr2=0x7f2c500d3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:11.885 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.879+0000 7f2c54ff9700 1 --2- 172.21.15.149:0/2335514188 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2c500b9640 0x7f2c500d3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:11.885 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.879+0000 7f2c54ff9700 1 -- 172.21.15.149:0/2335514188 >> v1:172.21.15.160:6789/0 conn(0x7f2c5015dbe0 legacy=0x7f2c500d1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:11.885 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.879+0000 7f2c54ff9700 1 -- 172.21.15.149:0/2335514188 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c500d2280 con 0x7f2c500d0330 2023-11-08T19:25:11.885 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.879+0000 7f2c54ff9700 1 --2- 172.21.15.149:0/2335514188 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c500d0330 0x7f2c500d07c0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f2c48009e50 tx=0x7f2c4800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c6eb81ce03a7b63 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:11.885 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.879+0000 7f2c4effd700 1 -- 172.21.15.149:0/2335514188 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4800e070 con 0x7f2c500d0330 2023-11-08T19:25:11.886 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.879+0000 7f2c4effd700 1 -- 172.21.15.149:0/2335514188 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c48003a20 con 0x7f2c500d0330 2023-11-08T19:25:11.886 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.879+0000 7f2c4effd700 1 -- 172.21.15.149:0/2335514188 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c48003dd0 con 0x7f2c500d0330 2023-11-08T19:25:11.886 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.880+0000 7f2c56a5c700 1 -- 172.21.15.149:0/2335514188 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c500d0330 msgr2=0x7f2c500d07c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:11.886 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.880+0000 7f2c56a5c700 1 --2- 172.21.15.149:0/2335514188 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c500d0330 0x7f2c500d07c0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f2c48009e50 tx=0x7f2c4800b330 comp rx=0 tx=0).stop 2023-11-08T19:25:11.887 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.880+0000 7f2c56a5c700 1 -- 172.21.15.149:0/2335514188 shutdown_connections 2023-11-08T19:25:11.887 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.880+0000 7f2c56a5c700 1 --2- 172.21.15.149:0/2335514188 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c500d0330 0x7f2c500d07c0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:11.887 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.880+0000 7f2c56a5c700 1 --2- 172.21.15.149:0/2335514188 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2c500b9640 0x7f2c500d3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:11.887 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.880+0000 7f2c56a5c700 1 -- 172.21.15.149:0/2335514188 >> 172.21.15.149:0/2335514188 conn(0x7f2c5006bd60 msgr2=0x7f2c5006c140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:11.887 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.880+0000 7f2c56a5c700 1 -- 172.21.15.149:0/2335514188 shutdown_connections 2023-11-08T19:25:11.888 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.880+0000 7f2c56a5c700 1 -- 172.21.15.149:0/2335514188 wait complete. 2023-11-08T19:25:11.890 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.881+0000 7f2c56a5c700 1 Processor -- start 2023-11-08T19:25:11.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.881+0000 7f2c56a5c700 1 -- start start 2023-11-08T19:25:11.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.882+0000 7f2c56a5c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2c500b9640 0x7f2c5015f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:11.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.882+0000 7f2c56a5c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2c500d0330 0x7f2c5015b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:11.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.882+0000 7f2c56a5c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c5015dbe0 0x7f2c5015bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:11.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.882+0000 7f2c56a5c700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c50160fc0 con 0x7f2c5015dbe0 2023-11-08T19:25:11.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.882+0000 7f2c56a5c700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c5015ff20 con 0x7f2c500d0330 2023-11-08T19:25:11.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.882+0000 7f2c56a5c700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c50160200 con 0x7f2c500b9640 2023-11-08T19:25:11.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.882+0000 7f2c54ff9700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c5015dbe0 0x7f2c5015bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:11.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.882+0000 7f2c54ff9700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c5015dbe0 0x7f2c5015bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40908/0 (socket says 172.21.15.149:40908) 2023-11-08T19:25:11.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.882+0000 7f2c54ff9700 1 -- 172.21.15.149:0/4158251820 learned_addr learned my addr 172.21.15.149:0/4158251820 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:11.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.882+0000 7f2c4ffff700 1 --2- 172.21.15.149:0/4158251820 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2c500b9640 0x7f2c5015f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:11.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.883+0000 7f2c4f7fe700 1 --2- 172.21.15.149:0/4158251820 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2c500d0330 0x7f2c5015b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:11.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.883+0000 7f2c54ff9700 1 -- 172.21.15.149:0/4158251820 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2c500b9640 msgr2=0x7f2c5015f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:11.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.883+0000 7f2c54ff9700 1 --2- 172.21.15.149:0/4158251820 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2c500b9640 0x7f2c5015f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:11.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.883+0000 7f2c54ff9700 1 -- 172.21.15.149:0/4158251820 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2c500d0330 msgr2=0x7f2c5015b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:11.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.883+0000 7f2c54ff9700 1 --2- 172.21.15.149:0/4158251820 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2c500d0330 0x7f2c5015b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:11.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.883+0000 7f2c54ff9700 1 -- 172.21.15.149:0/4158251820 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c48009b30 con 0x7f2c5015dbe0 2023-11-08T19:25:11.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.883+0000 7f2c4f7fe700 1 --2- 172.21.15.149:0/4158251820 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2c500d0330 0x7f2c5015b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:25:11.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.883+0000 7f2c54ff9700 1 --2- 172.21.15.149:0/4158251820 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c5015dbe0 0x7f2c5015bd40 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f2c500b6550 tx=0x7f2c48004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:11.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.883+0000 7f2c4cff9700 1 -- 172.21.15.149:0/4158251820 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c48004440 con 0x7f2c5015dbe0 2023-11-08T19:25:11.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.883+0000 7f2c4cff9700 1 -- 172.21.15.149:0/4158251820 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c480045c0 con 0x7f2c5015dbe0 2023-11-08T19:25:11.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.883+0000 7f2c56a5c700 1 -- 172.21.15.149:0/4158251820 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c501604e0 con 0x7f2c5015dbe0 2023-11-08T19:25:11.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.883+0000 7f2c4cff9700 1 -- 172.21.15.149:0/4158251820 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c48004970 con 0x7f2c5015dbe0 2023-11-08T19:25:11.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.883+0000 7f2c56a5c700 1 -- 172.21.15.149:0/4158251820 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c50160aa0 con 0x7f2c5015dbe0 2023-11-08T19:25:11.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.884+0000 7f2c56a5c700 1 -- 172.21.15.149:0/4158251820 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c5004f730 con 0x7f2c5015dbe0 2023-11-08T19:25:11.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.884+0000 7f2c4cff9700 1 -- 172.21.15.149:0/4158251820 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2c48025450 con 0x7f2c5015dbe0 2023-11-08T19:25:11.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.885+0000 7f2c4cff9700 1 --2- 172.21.15.149:0/4158251820 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2c3006af00 0x7f2c3006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:11.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.885+0000 7f2c4cff9700 1 -- 172.21.15.149:0/4158251820 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6468+0+0 (secure 0 0 0) 0x7f2c4808acc0 con 0x7f2c5015dbe0 2023-11-08T19:25:11.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.885+0000 7f2c4ffff700 1 --2- 172.21.15.149:0/4158251820 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2c3006af00 0x7f2c3006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:11.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.885+0000 7f2c4ffff700 1 --2- 172.21.15.149:0/4158251820 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2c3006af00 0x7f2c3006d3c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2c38009960 tx=0x7f2c380090e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:11.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:11.890+0000 7f2c4cff9700 1 -- 172.21.15.149:0/4158251820 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2c48059470 con 0x7f2c5015dbe0 2023-11-08T19:25:12.126 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.124+0000 7f2c56a5c700 1 -- 172.21.15.149:0/4158251820 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2c50073b80 con 0x7f2c5015dbe0 2023-11-08T19:25:12.740 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.738+0000 7f2c4cff9700 1 -- 172.21.15.149:0/4158251820 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v27) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2c480170a0 con 0x7f2c5015dbe0 2023-11-08T19:25:12.744 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.741+0000 7f2c56a5c700 1 -- 172.21.15.149:0/4158251820 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2c3006af00 msgr2=0x7f2c3006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:12.744 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.741+0000 7f2c56a5c700 1 --2- 172.21.15.149:0/4158251820 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2c3006af00 0x7f2c3006d3c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2c38009960 tx=0x7f2c380090e0 comp rx=0 tx=0).stop 2023-11-08T19:25:12.744 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.741+0000 7f2c56a5c700 1 -- 172.21.15.149:0/4158251820 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c5015dbe0 msgr2=0x7f2c5015bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:12.744 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.741+0000 7f2c56a5c700 1 --2- 172.21.15.149:0/4158251820 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c5015dbe0 0x7f2c5015bd40 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f2c500b6550 tx=0x7f2c48004ad0 comp rx=0 tx=0).stop 2023-11-08T19:25:12.745 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.741+0000 7f2c56a5c700 1 -- 172.21.15.149:0/4158251820 shutdown_connections 2023-11-08T19:25:12.745 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.741+0000 7f2c56a5c700 1 --2- 172.21.15.149:0/4158251820 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2c3006af00 0x7f2c3006d3c0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:12.745 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.741+0000 7f2c56a5c700 1 --2- 172.21.15.149:0/4158251820 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c5015dbe0 0x7f2c5015bd40 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:12.745 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.741+0000 7f2c56a5c700 1 --2- 172.21.15.149:0/4158251820 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2c500b9640 0x7f2c5015f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:12.746 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.741+0000 7f2c56a5c700 1 --2- 172.21.15.149:0/4158251820 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2c500d0330 0x7f2c5015b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:12.746 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.741+0000 7f2c56a5c700 1 -- 172.21.15.149:0/4158251820 >> 172.21.15.149:0/4158251820 conn(0x7f2c5006bd60 msgr2=0x7f2c500cca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:12.746 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.741+0000 7f2c56a5c700 1 -- 172.21.15.149:0/4158251820 shutdown_connections 2023-11-08T19:25:12.746 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.741+0000 7f2c56a5c700 1 -- 172.21.15.149:0/4158251820 wait complete. 2023-11-08T19:25:12.758 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-08T19:25:12.926 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.923+0000 7fdb887df700 1 Processor -- start 2023-11-08T19:25:12.926 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.923+0000 7fdb887df700 1 -- start start 2023-11-08T19:25:12.928 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.924+0000 7fdb887df700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fdb8015a870 0x7fdb800cbd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:12.928 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.924+0000 7fdb887df700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdb80072a40 0x7fdb80072ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:12.929 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.924+0000 7fdb887df700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb8015ac50 con 0x7fdb800b20e0 2023-11-08T19:25:12.929 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.924+0000 7fdb887df700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb800d02b0 con 0x7fdb8015a870 2023-11-08T19:25:12.929 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.924+0000 7fdb887df700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8006fe40 con 0x7fdb80072a40 2023-11-08T19:25:12.929 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.925+0000 7fdb8657b700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fdb8015a870 0x7fdb800cbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:12.929 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.925+0000 7fdb86d7c700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fdb800b20e0 0x7fdb8015b0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:42918/0 (socket says 172.21.15.149:42918) 2023-11-08T19:25:12.930 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.925+0000 7fdb86d7c700 1 -- 172.21.15.149:0/3337581854 learned_addr learned my addr 172.21.15.149:0/3337581854 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:25:12.930 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.925+0000 7fdb85d7a700 1 --2- 172.21.15.149:0/3337581854 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdb80072a40 0x7fdb80072ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:12.930 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.925+0000 7fdb8657b700 1 -- 172.21.15.149:0/3337581854 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdb80072a40 msgr2=0x7fdb80072ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:12.931 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.925+0000 7fdb8657b700 1 --2- 172.21.15.149:0/3337581854 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdb80072a40 0x7fdb80072ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:12.931 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.925+0000 7fdb8657b700 1 -- 172.21.15.149:0/3337581854 >> v1:172.21.15.149:6789/0 conn(0x7fdb800b20e0 legacy=0x7fdb8015b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:12.931 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.925+0000 7fdb85579700 1 -- 172.21.15.149:0/3337581854 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3837048727 0 0) 0x7fdb8015ac50 con 0x7fdb800b20e0 2023-11-08T19:25:12.931 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.925+0000 7fdb8657b700 1 -- 172.21.15.149:0/3337581854 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb80070120 con 0x7fdb8015a870 2023-11-08T19:25:12.931 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.925+0000 7fdb8657b700 1 --2- 172.21.15.149:0/3337581854 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdb8015a870 0x7fdb800cbd40 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c009840 tx=0x7fdb7c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20a6368e7df7557b server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:12.932 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.925+0000 7fdb85579700 1 -- 172.21.15.149:0/3337581854 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7c011830 con 0x7fdb8015a870 2023-11-08T19:25:12.932 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.925+0000 7fdb85579700 1 -- 172.21.15.149:0/3337581854 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb7c011990 con 0x7fdb8015a870 2023-11-08T19:25:12.932 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.925+0000 7fdb85579700 1 -- 172.21.15.149:0/3337581854 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7c011d20 con 0x7fdb8015a870 2023-11-08T19:25:12.932 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.926+0000 7fdb887df700 1 -- 172.21.15.149:0/3337581854 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdb8015a870 msgr2=0x7fdb800cbd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:12.932 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.926+0000 7fdb887df700 1 --2- 172.21.15.149:0/3337581854 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdb8015a870 0x7fdb800cbd40 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c009840 tx=0x7fdb7c009b50 comp rx=0 tx=0).stop 2023-11-08T19:25:12.933 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.926+0000 7fdb887df700 1 -- 172.21.15.149:0/3337581854 shutdown_connections 2023-11-08T19:25:12.933 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.926+0000 7fdb887df700 1 --2- 172.21.15.149:0/3337581854 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdb8015a870 0x7fdb800cbd40 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:12.933 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.926+0000 7fdb887df700 1 --2- 172.21.15.149:0/3337581854 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdb80072a40 0x7fdb80072ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:12.933 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.926+0000 7fdb887df700 1 -- 172.21.15.149:0/3337581854 >> 172.21.15.149:0/3337581854 conn(0x7fdb800cd0e0 msgr2=0x7fdb800cd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:12.934 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.926+0000 7fdb887df700 1 -- 172.21.15.149:0/3337581854 shutdown_connections 2023-11-08T19:25:12.934 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.926+0000 7fdb887df700 1 -- 172.21.15.149:0/3337581854 wait complete. 2023-11-08T19:25:12.936 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.927+0000 7fdb887df700 1 Processor -- start 2023-11-08T19:25:12.937 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.927+0000 7fdb887df700 1 -- start start 2023-11-08T19:25:12.937 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.928+0000 7fdb887df700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdb80072a40 0x7fdb800b48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:12.937 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.928+0000 7fdb887df700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdb800b20e0 0x7fdb800c8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:12.937 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.928+0000 7fdb887df700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdb8015a870 0x7fdb801595b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:12.937 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.928+0000 7fdb887df700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb80159f20 con 0x7fdb800b20e0 2023-11-08T19:25:12.938 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.928+0000 7fdb887df700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb800b4f40 con 0x7fdb80072a40 2023-11-08T19:25:12.938 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.928+0000 7fdb887df700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb800b5220 con 0x7fdb8015a870 2023-11-08T19:25:12.938 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.928+0000 7fdb85d7a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdb800b20e0 0x7fdb800c8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:12.938 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.928+0000 7fdb85d7a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdb800b20e0 0x7fdb800c8e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40922/0 (socket says 172.21.15.149:40922) 2023-11-08T19:25:12.938 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.928+0000 7fdb85d7a700 1 -- 172.21.15.149:0/3506316184 learned_addr learned my addr 172.21.15.149:0/3506316184 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:12.939 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.928+0000 7fdb85d7a700 1 -- 172.21.15.149:0/3506316184 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdb8015a870 msgr2=0x7fdb801595b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:12.939 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.928+0000 7fdb85d7a700 1 --2- 172.21.15.149:0/3506316184 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdb8015a870 0x7fdb801595b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:12.939 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.928+0000 7fdb85d7a700 1 -- 172.21.15.149:0/3506316184 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdb80072a40 msgr2=0x7fdb800b48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:12.939 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.928+0000 7fdb85d7a700 1 --2- 172.21.15.149:0/3506316184 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdb80072a40 0x7fdb800b48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:12.939 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.928+0000 7fdb85d7a700 1 -- 172.21.15.149:0/3506316184 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb7c0094a0 con 0x7fdb800b20e0 2023-11-08T19:25:12.940 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.928+0000 7fdb85d7a700 1 --2- 172.21.15.149:0/3506316184 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdb800b20e0 0x7fdb800c8e80 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fdb7000e9b0 tx=0x7fdb7000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:12.940 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.928+0000 7fdb76ffd700 1 -- 172.21.15.149:0/3506316184 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb70009710 con 0x7fdb800b20e0 2023-11-08T19:25:12.940 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.928+0000 7fdb76ffd700 1 -- 172.21.15.149:0/3506316184 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb7000c850 con 0x7fdb800b20e0 2023-11-08T19:25:12.940 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.928+0000 7fdb887df700 1 -- 172.21.15.149:0/3506316184 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb800b5500 con 0x7fdb800b20e0 2023-11-08T19:25:12.941 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.928+0000 7fdb76ffd700 1 -- 172.21.15.149:0/3506316184 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7000cbc0 con 0x7fdb800b20e0 2023-11-08T19:25:12.941 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.928+0000 7fdb887df700 1 -- 172.21.15.149:0/3506316184 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb800b5ac0 con 0x7fdb800b20e0 2023-11-08T19:25:12.941 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.929+0000 7fdb887df700 1 -- 172.21.15.149:0/3506316184 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb800745f0 con 0x7fdb800b20e0 2023-11-08T19:25:12.941 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.930+0000 7fdb76ffd700 1 -- 172.21.15.149:0/3506316184 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdb7000cd20 con 0x7fdb800b20e0 2023-11-08T19:25:12.941 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.930+0000 7fdb76ffd700 1 --2- 172.21.15.149:0/3506316184 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fdb6406af00 0x7fdb6406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:12.942 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.930+0000 7fdb76ffd700 1 -- 172.21.15.149:0/3506316184 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6468+0+0 (secure 0 0 0) 0x7fdb700899e0 con 0x7fdb800b20e0 2023-11-08T19:25:12.942 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.930+0000 7fdb8657b700 1 --2- 172.21.15.149:0/3506316184 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fdb6406af00 0x7fdb6406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:12.942 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.931+0000 7fdb8657b700 1 --2- 172.21.15.149:0/3506316184 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fdb6406af00 0x7fdb6406d3c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fdb800c7a50 tx=0x7fdb7c010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:12.942 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:12.935+0000 7fdb76ffd700 1 -- 172.21.15.149:0/3506316184 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdb70054780 con 0x7fdb800b20e0 2023-11-08T19:25:13.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:13.126+0000 7fdb887df700 1 -- 172.21.15.149:0/3506316184 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdb800b62b0 con 0x7fdb800b20e0 2023-11-08T19:25:14.134 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.130+0000 7fdb76ffd700 1 -- 172.21.15.149:0/3506316184 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v57) v1 ==== 181+0+0 (secure 0 0 0) 0x7fdb70057da0 con 0x7fdb800b20e0 2023-11-08T19:25:14.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.134+0000 7fdb887df700 1 -- 172.21.15.149:0/3506316184 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fdb6406af00 msgr2=0x7fdb6406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:14.137 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.134+0000 7fdb887df700 1 --2- 172.21.15.149:0/3506316184 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fdb6406af00 0x7fdb6406d3c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fdb800c7a50 tx=0x7fdb7c010000 comp rx=0 tx=0).stop 2023-11-08T19:25:14.137 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.134+0000 7fdb887df700 1 -- 172.21.15.149:0/3506316184 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdb800b20e0 msgr2=0x7fdb800c8e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:14.137 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.134+0000 7fdb887df700 1 --2- 172.21.15.149:0/3506316184 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdb800b20e0 0x7fdb800c8e80 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fdb7000e9b0 tx=0x7fdb7000ed70 comp rx=0 tx=0).stop 2023-11-08T19:25:14.148 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.134+0000 7fdb887df700 1 -- 172.21.15.149:0/3506316184 shutdown_connections 2023-11-08T19:25:14.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.134+0000 7fdb887df700 1 --2- 172.21.15.149:0/3506316184 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fdb6406af00 0x7fdb6406d3c0 secure :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fdb800c7a50 tx=0x7fdb7c010000 comp rx=0 tx=0).stop 2023-11-08T19:25:14.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.134+0000 7fdb887df700 1 --2- 172.21.15.149:0/3506316184 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdb80072a40 0x7fdb800b48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:14.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.134+0000 7fdb887df700 1 --2- 172.21.15.149:0/3506316184 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdb8015a870 0x7fdb801595b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:14.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.134+0000 7fdb887df700 1 --2- 172.21.15.149:0/3506316184 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdb800b20e0 0x7fdb800c8e80 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:14.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.134+0000 7fdb887df700 1 -- 172.21.15.149:0/3506316184 >> 172.21.15.149:0/3506316184 conn(0x7fdb800cd0e0 msgr2=0x7fdb800b12e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:14.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.135+0000 7fdb887df700 1 -- 172.21.15.149:0/3506316184 shutdown_connections 2023-11-08T19:25:14.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.135+0000 7fdb887df700 1 -- 172.21.15.149:0/3506316184 wait complete. 2023-11-08T19:25:14.150 INFO:teuthology.orchestra.run.smithi149.stderr:pool 'cephfs_metadata' removed 2023-11-08T19:25:14.152 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-08T19:25:14.279 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.277+0000 7fef4d7c9700 1 Processor -- start 2023-11-08T19:25:14.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.277+0000 7fef4d7c9700 1 -- start start 2023-11-08T19:25:14.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.278+0000 7fef4d7c9700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fef4815b8e0 0x7fef480ccde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:14.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.278+0000 7fef4d7c9700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fef480ce860 0x7fef480b23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:14.283 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.278+0000 7fef4d7c9700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef480b47c0 con 0x7fef4815bcc0 2023-11-08T19:25:14.283 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.278+0000 7fef4d7c9700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef480b4a80 con 0x7fef4815b8e0 2023-11-08T19:25:14.283 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.278+0000 7fef4d7c9700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef480b4d60 con 0x7fef480ce860 2023-11-08T19:25:14.283 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.278+0000 7fef46ffd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fef4815b8e0 0x7fef480ccde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:14.284 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.278+0000 7fef467fc700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fef4815bcc0 0x7fef480ce150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:42930/0 (socket says 172.21.15.149:42930) 2023-11-08T19:25:14.284 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.278+0000 7fef467fc700 1 -- 172.21.15.149:0/1570569216 learned_addr learned my addr 172.21.15.149:0/1570569216 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:25:14.284 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.278+0000 7fef477fe700 1 --2- 172.21.15.149:0/1570569216 >> v2:172.21.15.160:3300/0 conn(0x7fef480ce860 0x7fef480b23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:14.284 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.279+0000 7fef46ffd700 1 -- 172.21.15.149:0/1570569216 >> v2:172.21.15.160:3300/0 conn(0x7fef480ce860 msgr2=0x7fef480b23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:14.284 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.279+0000 7fef46ffd700 1 --2- 172.21.15.149:0/1570569216 >> v2:172.21.15.160:3300/0 conn(0x7fef480ce860 0x7fef480b23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:14.284 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.279+0000 7fef46ffd700 1 -- 172.21.15.149:0/1570569216 >> v1:172.21.15.149:6789/0 conn(0x7fef4815bcc0 legacy=0x7fef480ce150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:14.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.279+0000 7fef45ffb700 1 -- 172.21.15.149:0/1570569216 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3076764803 0 0) 0x7fef480b47c0 con 0x7fef4815bcc0 2023-11-08T19:25:14.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.279+0000 7fef46ffd700 1 -- 172.21.15.149:0/1570569216 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef480b5040 con 0x7fef4815b8e0 2023-11-08T19:25:14.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.279+0000 7fef46ffd700 1 --2- 172.21.15.149:0/1570569216 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef4815b8e0 0x7fef480ccde0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fef480d0920 tx=0x7fef3c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d8b1996b84e0a9b server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:14.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.279+0000 7fef45ffb700 1 -- 172.21.15.149:0/1570569216 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef3c011830 con 0x7fef4815b8e0 2023-11-08T19:25:14.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.279+0000 7fef45ffb700 1 -- 172.21.15.149:0/1570569216 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef3c011990 con 0x7fef4815b8e0 2023-11-08T19:25:14.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.279+0000 7fef45ffb700 1 -- 172.21.15.149:0/1570569216 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef3c011d20 con 0x7fef4815b8e0 2023-11-08T19:25:14.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.279+0000 7fef4d7c9700 1 -- 172.21.15.149:0/1570569216 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef4815b8e0 msgr2=0x7fef480ccde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:14.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.279+0000 7fef4d7c9700 1 --2- 172.21.15.149:0/1570569216 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef4815b8e0 0x7fef480ccde0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fef480d0920 tx=0x7fef3c009b20 comp rx=0 tx=0).stop 2023-11-08T19:25:14.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.279+0000 7fef4d7c9700 1 -- 172.21.15.149:0/1570569216 shutdown_connections 2023-11-08T19:25:14.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.279+0000 7fef4d7c9700 1 --2- 172.21.15.149:0/1570569216 >> v2:172.21.15.160:3300/0 conn(0x7fef480ce860 0x7fef480b23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:14.287 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.279+0000 7fef4d7c9700 1 --2- 172.21.15.149:0/1570569216 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef4815b8e0 0x7fef480ccde0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:14.289 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.279+0000 7fef4d7c9700 1 -- 172.21.15.149:0/1570569216 >> 172.21.15.149:0/1570569216 conn(0x7fef4809aac0 msgr2=0x7fef480d17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:14.290 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.279+0000 7fef4d7c9700 1 -- 172.21.15.149:0/1570569216 shutdown_connections 2023-11-08T19:25:14.290 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.279+0000 7fef4d7c9700 1 -- 172.21.15.149:0/1570569216 wait complete. 2023-11-08T19:25:14.295 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.281+0000 7fef4d7c9700 1 Processor -- start 2023-11-08T19:25:14.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.281+0000 7fef4d7c9700 1 -- start start 2023-11-08T19:25:14.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.281+0000 7fef4d7c9700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef480ce860 0x7fef480c9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:14.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.281+0000 7fef4d7c9700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fef4815b8e0 0x7fef480cac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:14.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.281+0000 7fef4d7c9700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fef4815bcc0 0x7fef480b2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:14.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.282+0000 7fef4d7c9700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef480c65a0 con 0x7fef480ce860 2023-11-08T19:25:14.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.282+0000 7fef4d7c9700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef480cb550 con 0x7fef4815bcc0 2023-11-08T19:25:14.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.282+0000 7fef4d7c9700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef480cb830 con 0x7fef4815b8e0 2023-11-08T19:25:14.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.282+0000 7fef46ffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef480ce860 0x7fef480c9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:14.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.282+0000 7fef46ffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef480ce860 0x7fef480c9360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40934/0 (socket says 172.21.15.149:40934) 2023-11-08T19:25:14.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.282+0000 7fef46ffd700 1 -- 172.21.15.149:0/1995500891 learned_addr learned my addr 172.21.15.149:0/1995500891 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:14.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.282+0000 7fef477fe700 1 --2- 172.21.15.149:0/1995500891 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fef4815bcc0 0x7fef480b2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:14.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.282+0000 7fef467fc700 1 --2- 172.21.15.149:0/1995500891 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fef4815b8e0 0x7fef480cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:14.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.282+0000 7fef46ffd700 1 -- 172.21.15.149:0/1995500891 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fef4815b8e0 msgr2=0x7fef480cac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:14.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.282+0000 7fef46ffd700 1 --2- 172.21.15.149:0/1995500891 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fef4815b8e0 0x7fef480cac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:14.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.282+0000 7fef46ffd700 1 -- 172.21.15.149:0/1995500891 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fef4815bcc0 msgr2=0x7fef480b2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:14.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.282+0000 7fef46ffd700 1 --2- 172.21.15.149:0/1995500891 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fef4815bcc0 0x7fef480b2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:14.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.282+0000 7fef46ffd700 1 -- 172.21.15.149:0/1995500891 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef3c0094a0 con 0x7fef480ce860 2023-11-08T19:25:14.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.282+0000 7fef46ffd700 1 --2- 172.21.15.149:0/1995500891 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef480ce860 0x7fef480c9360 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fef3c0090b0 tx=0x7fef3c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:14.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.282+0000 7fef2f7fe700 1 -- 172.21.15.149:0/1995500891 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef3c0036a0 con 0x7fef480ce860 2023-11-08T19:25:14.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.282+0000 7fef2f7fe700 1 -- 172.21.15.149:0/1995500891 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef3c01f070 con 0x7fef480ce860 2023-11-08T19:25:14.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.282+0000 7fef4d7c9700 1 -- 172.21.15.149:0/1995500891 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef480cbb10 con 0x7fef480ce860 2023-11-08T19:25:14.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.282+0000 7fef2f7fe700 1 -- 172.21.15.149:0/1995500891 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef3c003a60 con 0x7fef480ce860 2023-11-08T19:25:14.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.282+0000 7fef4d7c9700 1 -- 172.21.15.149:0/1995500891 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef480cb140 con 0x7fef480ce860 2023-11-08T19:25:14.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.283+0000 7fef4d7c9700 1 -- 172.21.15.149:0/1995500891 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef480cb2d0 con 0x7fef480ce860 2023-11-08T19:25:14.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.284+0000 7fef2f7fe700 1 -- 172.21.15.149:0/1995500891 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fef3c003bc0 con 0x7fef480ce860 2023-11-08T19:25:14.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.284+0000 7fef2f7fe700 1 --2- 172.21.15.149:0/1995500891 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fef3406af00 0x7fef3406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:14.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.284+0000 7fef2f7fe700 1 -- 172.21.15.149:0/1995500891 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6030+0+0 (secure 0 0 0) 0x7fef3c021070 con 0x7fef480ce860 2023-11-08T19:25:14.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.284+0000 7fef467fc700 1 --2- 172.21.15.149:0/1995500891 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fef3406af00 0x7fef3406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:14.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.284+0000 7fef467fc700 1 --2- 172.21.15.149:0/1995500891 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fef3406af00 0x7fef3406d3c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fef480ca800 tx=0x7fef38007e70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:14.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.289+0000 7fef2f7fe700 1 -- 172.21.15.149:0/1995500891 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fef3c055f30 con 0x7fef480ce860 2023-11-08T19:25:14.482 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:14.480+0000 7fef4d7c9700 1 -- 172.21.15.149:0/1995500891 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fef480745f0 con 0x7fef480ce860 2023-11-08T19:25:15.134 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.132+0000 7fef2f7fe700 1 -- 172.21.15.149:0/1995500891 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v58) v1 ==== 169+0+0 (secure 0 0 0) 0x7fef3c015020 con 0x7fef480ce860 2023-11-08T19:25:15.138 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.136+0000 7fef4d7c9700 1 -- 172.21.15.149:0/1995500891 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fef3406af00 msgr2=0x7fef3406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:15.139 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.136+0000 7fef4d7c9700 1 --2- 172.21.15.149:0/1995500891 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fef3406af00 0x7fef3406d3c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fef480ca800 tx=0x7fef38007e70 comp rx=0 tx=0).stop 2023-11-08T19:25:15.139 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.136+0000 7fef4d7c9700 1 -- 172.21.15.149:0/1995500891 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef480ce860 msgr2=0x7fef480c9360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:15.139 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.136+0000 7fef4d7c9700 1 --2- 172.21.15.149:0/1995500891 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef480ce860 0x7fef480c9360 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fef3c0090b0 tx=0x7fef3c004750 comp rx=0 tx=0).stop 2023-11-08T19:25:15.140 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.137+0000 7fef4d7c9700 1 -- 172.21.15.149:0/1995500891 shutdown_connections 2023-11-08T19:25:15.140 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.137+0000 7fef4d7c9700 1 --2- 172.21.15.149:0/1995500891 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fef3406af00 0x7fef3406d3c0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:15.140 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.137+0000 7fef4d7c9700 1 --2- 172.21.15.149:0/1995500891 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fef4815bcc0 0x7fef480b2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:15.141 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.137+0000 7fef4d7c9700 1 --2- 172.21.15.149:0/1995500891 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef480ce860 0x7fef480c9360 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:15.141 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.137+0000 7fef4d7c9700 1 --2- 172.21.15.149:0/1995500891 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fef4815b8e0 0x7fef480cac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:15.141 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.137+0000 7fef4d7c9700 1 -- 172.21.15.149:0/1995500891 >> 172.21.15.149:0/1995500891 conn(0x7fef4809aac0 msgr2=0x7fef48070890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:15.141 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.137+0000 7fef4d7c9700 1 -- 172.21.15.149:0/1995500891 shutdown_connections 2023-11-08T19:25:15.142 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.137+0000 7fef4d7c9700 1 -- 172.21.15.149:0/1995500891 wait complete. 2023-11-08T19:25:15.142 INFO:teuthology.orchestra.run.smithi149.stderr:pool 'cephfs_data' removed 2023-11-08T19:25:15.155 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-08T19:25:15.291 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.288+0000 7f6e18aea700 1 Processor -- start 2023-11-08T19:25:15.291 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.288+0000 7f6e18aea700 1 -- start start 2023-11-08T19:25:15.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.289+0000 7f6e18aea700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6e140cb660 0x7f6e140ce540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:15.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.289+0000 7f6e18aea700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e1415e320 con 0x7f6e1415df40 2023-11-08T19:25:15.294 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.289+0000 7f6e18aea700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e1406b020 con 0x7f6e1406ab80 2023-11-08T19:25:15.294 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.289+0000 7f6e18aea700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e1406b2e0 con 0x7f6e140cb660 2023-11-08T19:25:15.294 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.290+0000 7f6e12d9d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6e140cb660 0x7f6e140ce540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:15.294 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.290+0000 7f6e1259c700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f6e1415df40 0x7f6e1406c0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:42944/0 (socket says 172.21.15.149:42944) 2023-11-08T19:25:15.295 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.290+0000 7f6e1259c700 1 -- 172.21.15.149:0/3841463919 learned_addr learned my addr 172.21.15.149:0/3841463919 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:25:15.295 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.290+0000 7f6e12d9d700 1 -- 172.21.15.149:0/3841463919 >> v1:172.21.15.160:6789/0 conn(0x7f6e1406ab80 legacy=0x7f6e140caf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:15.295 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.290+0000 7f6e12d9d700 1 -- 172.21.15.149:0/3841463919 >> v1:172.21.15.149:6789/0 conn(0x7f6e1415df40 legacy=0x7f6e1406c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:15.295 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.290+0000 7f6e12d9d700 1 -- 172.21.15.149:0/3841463919 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e1406b5c0 con 0x7f6e140cb660 2023-11-08T19:25:15.295 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.290+0000 7f6e1159a700 1 -- 172.21.15.149:0/3841463919 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 88527999 0 0) 0x7f6e1415e320 con 0x7f6e1415df40 2023-11-08T19:25:15.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.290+0000 7f6e12d9d700 1 --2- 172.21.15.149:0/3841463919 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e140cb660 0x7f6e140ce540 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c009d90 tx=0x7f6e0c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dabaa492bc3984e server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:15.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.290+0000 7f6e1159a700 1 -- 172.21.15.149:0/3841463919 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0c00e070 con 0x7f6e140cb660 2023-11-08T19:25:15.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.290+0000 7f6e1159a700 1 -- 172.21.15.149:0/3841463919 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e0c00bbd0 con 0x7f6e140cb660 2023-11-08T19:25:15.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.290+0000 7f6e1159a700 1 -- 172.21.15.149:0/3841463919 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0c012430 con 0x7f6e140cb660 2023-11-08T19:25:15.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.291+0000 7f6e18aea700 1 -- 172.21.15.149:0/3841463919 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e140cb660 msgr2=0x7f6e140ce540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:15.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.291+0000 7f6e18aea700 1 --2- 172.21.15.149:0/3841463919 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e140cb660 0x7f6e140ce540 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c009d90 tx=0x7f6e0c00b330 comp rx=0 tx=0).stop 2023-11-08T19:25:15.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.291+0000 7f6e18aea700 1 -- 172.21.15.149:0/3841463919 shutdown_connections 2023-11-08T19:25:15.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.291+0000 7f6e18aea700 1 --2- 172.21.15.149:0/3841463919 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e140cb660 0x7f6e140ce540 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:15.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.291+0000 7f6e18aea700 1 -- 172.21.15.149:0/3841463919 >> 172.21.15.149:0/3841463919 conn(0x7f6e140d0640 msgr2=0x7f6e140d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:15.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.291+0000 7f6e18aea700 1 -- 172.21.15.149:0/3841463919 shutdown_connections 2023-11-08T19:25:15.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.291+0000 7f6e18aea700 1 -- 172.21.15.149:0/3841463919 wait complete. 2023-11-08T19:25:15.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.292+0000 7f6e18aea700 1 Processor -- start 2023-11-08T19:25:15.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.292+0000 7f6e18aea700 1 -- start start 2023-11-08T19:25:15.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.293+0000 7f6e18aea700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6e1406ab80 0x7f6e140ca580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:15.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.293+0000 7f6e18aea700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6e140cb660 0x7f6e14157f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:15.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.293+0000 7f6e18aea700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e1415df40 0x7f6e1415bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:15.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.293+0000 7f6e18aea700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e14158440 con 0x7f6e1415df40 2023-11-08T19:25:15.302 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.293+0000 7f6e18aea700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e140c94e0 con 0x7f6e140cb660 2023-11-08T19:25:15.302 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.293+0000 7f6e18aea700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e140c97c0 con 0x7f6e1406ab80 2023-11-08T19:25:15.302 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.293+0000 7f6e12d9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e1415df40 0x7f6e1415bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:15.302 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.293+0000 7f6e12d9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e1415df40 0x7f6e1415bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40948/0 (socket says 172.21.15.149:40948) 2023-11-08T19:25:15.303 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.293+0000 7f6e12d9d700 1 -- 172.21.15.149:0/2516308488 learned_addr learned my addr 172.21.15.149:0/2516308488 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:15.303 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.293+0000 7f6e1259c700 1 --2- 172.21.15.149:0/2516308488 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6e1406ab80 0x7f6e140ca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:15.303 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.293+0000 7f6e12d9d700 1 -- 172.21.15.149:0/2516308488 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6e1406ab80 msgr2=0x7f6e140ca580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:15.303 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.293+0000 7f6e12d9d700 1 --2- 172.21.15.149:0/2516308488 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6e1406ab80 0x7f6e140ca580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:15.303 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.293+0000 7f6e12d9d700 1 -- 172.21.15.149:0/2516308488 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6e140cb660 msgr2=0x7f6e14157f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:15.304 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.293+0000 7f6e12d9d700 1 --2- 172.21.15.149:0/2516308488 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6e140cb660 0x7f6e14157f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:15.304 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.293+0000 7f6e12d9d700 1 -- 172.21.15.149:0/2516308488 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e0c009a70 con 0x7f6e1415df40 2023-11-08T19:25:15.304 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.293+0000 7f6e1259c700 1 --2- 172.21.15.149:0/2516308488 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6e1406ab80 0x7f6e140ca580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:25:15.304 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.294+0000 7f6e12d9d700 1 --2- 172.21.15.149:0/2516308488 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e1415df40 0x7f6e1415bef0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c014040 tx=0x7f6e0c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:15.304 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.294+0000 7f6e02ffd700 1 -- 172.21.15.149:0/2516308488 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0c01b810 con 0x7f6e1415df40 2023-11-08T19:25:15.305 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.294+0000 7f6e02ffd700 1 -- 172.21.15.149:0/2516308488 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e0c020070 con 0x7f6e1415df40 2023-11-08T19:25:15.305 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.294+0000 7f6e18aea700 1 -- 172.21.15.149:0/2516308488 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e140c9aa0 con 0x7f6e1415df40 2023-11-08T19:25:15.305 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.294+0000 7f6e02ffd700 1 -- 172.21.15.149:0/2516308488 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0c01bbb0 con 0x7f6e1415df40 2023-11-08T19:25:15.305 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.294+0000 7f6e18aea700 1 -- 172.21.15.149:0/2516308488 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e140ca060 con 0x7f6e1415df40 2023-11-08T19:25:15.305 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.295+0000 7f6e18aea700 1 -- 172.21.15.149:0/2516308488 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e1406c730 con 0x7f6e1415df40 2023-11-08T19:25:15.306 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.295+0000 7f6e02ffd700 1 -- 172.21.15.149:0/2516308488 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6e0c01bd10 con 0x7f6e1415df40 2023-11-08T19:25:15.306 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.296+0000 7f6e02ffd700 1 --2- 172.21.15.149:0/2516308488 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6df406af00 0x7f6df406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:15.306 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.296+0000 7f6e02ffd700 1 -- 172.21.15.149:0/2516308488 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f6e0c022070 con 0x7f6e1415df40 2023-11-08T19:25:15.306 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.296+0000 7f6e1259c700 1 --2- 172.21.15.149:0/2516308488 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6df406af00 0x7f6df406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:15.306 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.296+0000 7f6e1259c700 1 --2- 172.21.15.149:0/2516308488 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6df406af00 0x7f6df406d3c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f6e08000f60 tx=0x7f6e08009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:15.307 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.301+0000 7f6e02ffd700 1 -- 172.21.15.149:0/2516308488 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6e0c05a730 con 0x7f6e1415df40 2023-11-08T19:25:15.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.493+0000 7f6e18aea700 1 -- 172.21.15.149:0/2516308488 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f6e1404f730 con 0x7f6e1415df40 2023-11-08T19:25:15.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.496+0000 7f6e02ffd700 1 -- 172.21.15.149:0/2516308488 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v14) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6e0c05a2c0 con 0x7f6e1415df40 2023-11-08T19:25:15.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.498+0000 7f6e18aea700 1 -- 172.21.15.149:0/2516308488 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6df406af00 msgr2=0x7f6df406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:15.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.498+0000 7f6e18aea700 1 --2- 172.21.15.149:0/2516308488 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6df406af00 0x7f6df406d3c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f6e08000f60 tx=0x7f6e08009040 comp rx=0 tx=0).stop 2023-11-08T19:25:15.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.498+0000 7f6e18aea700 1 -- 172.21.15.149:0/2516308488 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e1415df40 msgr2=0x7f6e1415bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:15.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.498+0000 7f6e18aea700 1 --2- 172.21.15.149:0/2516308488 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e1415df40 0x7f6e1415bef0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c014040 tx=0x7f6e0c004ad0 comp rx=0 tx=0).stop 2023-11-08T19:25:15.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.498+0000 7f6e18aea700 1 -- 172.21.15.149:0/2516308488 shutdown_connections 2023-11-08T19:25:15.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.498+0000 7f6e18aea700 1 --2- 172.21.15.149:0/2516308488 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6df406af00 0x7f6df406d3c0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:15.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.498+0000 7f6e18aea700 1 --2- 172.21.15.149:0/2516308488 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e1415df40 0x7f6e1415bef0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:15.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.498+0000 7f6e18aea700 1 --2- 172.21.15.149:0/2516308488 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6e1406ab80 0x7f6e140ca580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:15.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.498+0000 7f6e18aea700 1 --2- 172.21.15.149:0/2516308488 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6e140cb660 0x7f6e14157f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:15.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.498+0000 7f6e18aea700 1 -- 172.21.15.149:0/2516308488 >> 172.21.15.149:0/2516308488 conn(0x7f6e140d0640 msgr2=0x7f6e140cd080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:15.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.498+0000 7f6e18aea700 1 -- 172.21.15.149:0/2516308488 shutdown_connections 2023-11-08T19:25:15.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.498+0000 7f6e18aea700 1 -- 172.21.15.149:0/2516308488 wait complete. 2023-11-08T19:25:15.513 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_disallow_monitor_managed_snaps_for_fs_pools' 2023-11-08T19:25:15.634 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.632+0000 7f36e9658700 1 Processor -- start 2023-11-08T19:25:15.634 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.632+0000 7f36e9658700 1 -- start start 2023-11-08T19:25:15.637 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.633+0000 7f36e9658700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f36e4161a50 0x7f36e4161f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:15.637 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.633+0000 7f36e9658700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f36e40ce500 0x7f36e40ce990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:15.637 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.633+0000 7f36e9658700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36e40d1a10 con 0x7f36e4161670 2023-11-08T19:25:15.637 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.633+0000 7f36e9658700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36e40d1cf0 con 0x7f36e4161a50 2023-11-08T19:25:15.638 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.633+0000 7f36e9658700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36e40d1fd0 con 0x7f36e40ce500 2023-11-08T19:25:15.638 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.633+0000 7f36e27fc700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f36e4161a50 0x7f36e4161f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:15.638 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.633+0000 7f36e2ffd700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f36e4161670 0x7f36e40b5e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:42954/0 (socket says 172.21.15.149:42954) 2023-11-08T19:25:15.638 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.633+0000 7f36e2ffd700 1 -- 172.21.15.149:0/1126024921 learned_addr learned my addr 172.21.15.149:0/1126024921 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:25:15.638 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.633+0000 7f36e37fe700 1 --2- 172.21.15.149:0/1126024921 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f36e40ce500 0x7f36e40ce990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:15.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.633+0000 7f36e27fc700 1 -- 172.21.15.149:0/1126024921 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f36e40ce500 msgr2=0x7f36e40ce990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:15.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.633+0000 7f36e27fc700 1 --2- 172.21.15.149:0/1126024921 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f36e40ce500 0x7f36e40ce990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:15.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.633+0000 7f36e27fc700 1 -- 172.21.15.149:0/1126024921 >> v1:172.21.15.149:6789/0 conn(0x7f36e4161670 legacy=0x7f36e40b5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:15.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.633+0000 7f36e27fc700 1 -- 172.21.15.149:0/1126024921 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e40d22b0 con 0x7f36e4161a50 2023-11-08T19:25:15.640 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.633+0000 7f36e37fe700 1 --2- 172.21.15.149:0/1126024921 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f36e40ce500 0x7f36e40ce990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:25:15.640 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.633+0000 7f36e1ffb700 1 -- 172.21.15.149:0/1126024921 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3230633289 0 0) 0x7f36e40d1a10 con 0x7f36e4161670 2023-11-08T19:25:15.640 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.633+0000 7f36e27fc700 1 --2- 172.21.15.149:0/1126024921 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36e4161a50 0x7f36e4161f00 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f36d4009840 tx=0x7f36d4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1effb63e502d0b04 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:15.640 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.634+0000 7f36e1ffb700 1 -- 172.21.15.149:0/1126024921 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d4011830 con 0x7f36e4161a50 2023-11-08T19:25:15.640 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.634+0000 7f36e1ffb700 1 -- 172.21.15.149:0/1126024921 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36d4011990 con 0x7f36e4161a50 2023-11-08T19:25:15.641 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.634+0000 7f36e1ffb700 1 -- 172.21.15.149:0/1126024921 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d4011d20 con 0x7f36e4161a50 2023-11-08T19:25:15.641 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.634+0000 7f36e9658700 1 -- 172.21.15.149:0/1126024921 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36e4161a50 msgr2=0x7f36e4161f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:15.641 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.634+0000 7f36e9658700 1 --2- 172.21.15.149:0/1126024921 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36e4161a50 0x7f36e4161f00 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f36d4009840 tx=0x7f36d4009b50 comp rx=0 tx=0).stop 2023-11-08T19:25:15.641 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.634+0000 7f36e9658700 1 -- 172.21.15.149:0/1126024921 shutdown_connections 2023-11-08T19:25:15.642 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.634+0000 7f36e9658700 1 --2- 172.21.15.149:0/1126024921 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f36e40ce500 0x7f36e40ce990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:15.642 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.634+0000 7f36e9658700 1 --2- 172.21.15.149:0/1126024921 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36e4161a50 0x7f36e4161f00 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:15.642 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.634+0000 7f36e9658700 1 -- 172.21.15.149:0/1126024921 >> 172.21.15.149:0/1126024921 conn(0x7f36e40d3980 msgr2=0x7f36e40d3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:15.642 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.634+0000 7f36e9658700 1 -- 172.21.15.149:0/1126024921 shutdown_connections 2023-11-08T19:25:15.642 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.634+0000 7f36e9658700 1 -- 172.21.15.149:0/1126024921 wait complete. 2023-11-08T19:25:15.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.635+0000 7f36e9658700 1 Processor -- start 2023-11-08T19:25:15.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.636+0000 7f36e9658700 1 -- start start 2023-11-08T19:25:15.646 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.636+0000 7f36e9658700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f36e40ce500 0x7f36e40b7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:15.646 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.636+0000 7f36e9658700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36e4161670 0x7f36e4156e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:15.646 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.636+0000 7f36e9658700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f36e4161a50 0x7f36e40b8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:15.646 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.636+0000 7f36e9658700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e40b5d20 con 0x7f36e4161670 2023-11-08T19:25:15.647 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.636+0000 7f36e9658700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e40b8bb0 con 0x7f36e40ce500 2023-11-08T19:25:15.647 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.636+0000 7f36e9658700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36e40b6580 con 0x7f36e4161a50 2023-11-08T19:25:15.647 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.636+0000 7f36e27fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36e4161670 0x7f36e4156e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:15.647 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.636+0000 7f36e27fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36e4161670 0x7f36e4156e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40960/0 (socket says 172.21.15.149:40960) 2023-11-08T19:25:15.647 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.636+0000 7f36e27fc700 1 -- 172.21.15.149:0/3550579298 learned_addr learned my addr 172.21.15.149:0/3550579298 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:15.648 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.637+0000 7f36e37fe700 1 --2- 172.21.15.149:0/3550579298 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f36e4161a50 0x7f36e40b8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:15.648 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.637+0000 7f36e2ffd700 1 --2- 172.21.15.149:0/3550579298 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f36e40ce500 0x7f36e40b7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:15.649 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.637+0000 7f36e27fc700 1 -- 172.21.15.149:0/3550579298 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f36e4161a50 msgr2=0x7f36e40b8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:15.649 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.637+0000 7f36e27fc700 1 --2- 172.21.15.149:0/3550579298 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f36e4161a50 0x7f36e40b8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:15.649 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.637+0000 7f36e27fc700 1 -- 172.21.15.149:0/3550579298 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f36e40ce500 msgr2=0x7f36e40b7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:15.650 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.637+0000 7f36e27fc700 1 --2- 172.21.15.149:0/3550579298 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f36e40ce500 0x7f36e40b7340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:15.650 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.637+0000 7f36e27fc700 1 -- 172.21.15.149:0/3550579298 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d40094a0 con 0x7f36e4161670 2023-11-08T19:25:15.650 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.637+0000 7f36e27fc700 1 --2- 172.21.15.149:0/3550579298 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36e4161670 0x7f36e4156e50 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f36d40090b0 tx=0x7f36d4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:15.650 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.637+0000 7f36cb7fe700 1 -- 172.21.15.149:0/3550579298 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d4004590 con 0x7f36e4161670 2023-11-08T19:25:15.651 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.637+0000 7f36cb7fe700 1 -- 172.21.15.149:0/3550579298 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36d40036a0 con 0x7f36e4161670 2023-11-08T19:25:15.651 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.637+0000 7f36e9658700 1 -- 172.21.15.149:0/3550579298 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36e40b6860 con 0x7f36e4161670 2023-11-08T19:25:15.651 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.637+0000 7f36cb7fe700 1 -- 172.21.15.149:0/3550579298 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d4003a30 con 0x7f36e4161670 2023-11-08T19:25:15.651 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.637+0000 7f36e9658700 1 -- 172.21.15.149:0/3550579298 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36e40b6e20 con 0x7f36e4161670 2023-11-08T19:25:15.651 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.638+0000 7f36e9658700 1 -- 172.21.15.149:0/3550579298 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36e406dd10 con 0x7f36e4161670 2023-11-08T19:25:15.652 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.639+0000 7f36cb7fe700 1 -- 172.21.15.149:0/3550579298 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f36d4003b90 con 0x7f36e4161670 2023-11-08T19:25:15.652 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.639+0000 7f36cb7fe700 1 --2- 172.21.15.149:0/3550579298 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f36d006af00 0x7f36d006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:15.652 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.639+0000 7f36cb7fe700 1 -- 172.21.15.149:0/3550579298 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f36d408a940 con 0x7f36e4161670 2023-11-08T19:25:15.652 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.639+0000 7f36e2ffd700 1 --2- 172.21.15.149:0/3550579298 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f36d006af00 0x7f36d006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:15.652 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.639+0000 7f36e2ffd700 1 --2- 172.21.15.149:0/3550579298 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f36d006af00 0x7f36d006d3c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f36d80010e0 tx=0x7f36d8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:15.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.644+0000 7f36cb7fe700 1 -- 172.21.15.149:0/3550579298 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f36d4055b80 con 0x7f36e4161670 2023-11-08T19:25:15.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:15.911+0000 7f36e9658700 1 -- 172.21.15.149:0/3550579298 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_disallow_monitor_managed_snaps_for_fs_pools"]} v 0) v1 -- 0x7f36e40745f0 con 0x7f36e4161670 2023-11-08T19:25:16.143 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.141+0000 7f36cb7fe700 1 -- 172.21.15.149:0/3550579298 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_disallow_monitor_managed_snaps_for_fs_pools"]}]=0 v147) v1 ==== 178+0+0 (secure 0 0 0) 0x7f36d4015020 con 0x7f36e4161670 2023-11-08T19:25:16.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.144+0000 7f36e9658700 1 -- 172.21.15.149:0/3550579298 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f36d006af00 msgr2=0x7f36d006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:16.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.144+0000 7f36e9658700 1 --2- 172.21.15.149:0/3550579298 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f36d006af00 0x7f36d006d3c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f36d80010e0 tx=0x7f36d8009040 comp rx=0 tx=0).stop 2023-11-08T19:25:16.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.144+0000 7f36e9658700 1 -- 172.21.15.149:0/3550579298 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36e4161670 msgr2=0x7f36e4156e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:16.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.144+0000 7f36e9658700 1 --2- 172.21.15.149:0/3550579298 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36e4161670 0x7f36e4156e50 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f36d40090b0 tx=0x7f36d4004750 comp rx=0 tx=0).stop 2023-11-08T19:25:16.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.144+0000 7f36e9658700 1 -- 172.21.15.149:0/3550579298 shutdown_connections 2023-11-08T19:25:16.148 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.144+0000 7f36e9658700 1 --2- 172.21.15.149:0/3550579298 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f36d006af00 0x7f36d006d3c0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:16.148 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.144+0000 7f36e9658700 1 --2- 172.21.15.149:0/3550579298 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f36e40ce500 0x7f36e40b7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:16.148 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.144+0000 7f36e9658700 1 --2- 172.21.15.149:0/3550579298 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f36e4161a50 0x7f36e40b8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:16.148 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.144+0000 7f36e9658700 1 --2- 172.21.15.149:0/3550579298 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36e4161670 0x7f36e4156e50 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:16.148 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.144+0000 7f36e9658700 1 -- 172.21.15.149:0/3550579298 >> 172.21.15.149:0/3550579298 conn(0x7f36e40d3980 msgr2=0x7f36e4160c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:16.148 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.144+0000 7f36e9658700 1 -- 172.21.15.149:0/3550579298 shutdown_connections 2023-11-08T19:25:16.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.144+0000 7f36e9658700 1 -- 172.21.15.149:0/3550579298 wait complete. 2023-11-08T19:25:16.159 INFO:tasks.cephfs_test_runner:Test that creation of monitor managed snaps fails for pools attached ... ok 2023-11-08T19:25:16.159 INFO:tasks.cephfs_test_runner:Starting test: test_using_pool_with_snap_fails_fs_creation (tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools) Test that using a pool with snaps for fs creation fails 2023-11-08T19:25:16.159 INFO:tasks.cephfs_test_runner:test_using_pool_with_snap_fails_fs_creation (tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools) 2023-11-08T19:25:16.160 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:25:16.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.279+0000 7f0fd83f2700 1 Processor -- start 2023-11-08T19:25:16.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.279+0000 7f0fd83f2700 1 -- start start 2023-11-08T19:25:16.284 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.280+0000 7f0fd83f2700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0fd00ce840 0x7f0fd00d0430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:16.284 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.280+0000 7f0fd83f2700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fd00cc2e0 con 0x7f0fd00cd5e0 2023-11-08T19:25:16.284 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.280+0000 7f0fd83f2700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fd00cc580 con 0x7f0fd015b950 2023-11-08T19:25:16.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.280+0000 7f0fd83f2700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fd00cc820 con 0x7f0fd00ce840 2023-11-08T19:25:16.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.280+0000 7f0fd698f700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0fd00ce840 0x7f0fd00d0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:16.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.280+0000 7f0fd598d700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f0fd00cd5e0 0x7f0fd00cfd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:42970/0 (socket says 172.21.15.149:42970) 2023-11-08T19:25:16.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.280+0000 7f0fd598d700 1 -- 172.21.15.149:0/3498699139 learned_addr learned my addr 172.21.15.149:0/3498699139 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:25:16.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.281+0000 7f0fd698f700 1 -- 172.21.15.149:0/3498699139 >> v1:172.21.15.160:6789/0 conn(0x7f0fd015b950 legacy=0x7f0fd00ce130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:16.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.281+0000 7f0fd698f700 1 -- 172.21.15.149:0/3498699139 >> v1:172.21.15.149:6789/0 conn(0x7f0fd00cd5e0 legacy=0x7f0fd00cfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:16.287 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.281+0000 7f0fd698f700 1 -- 172.21.15.149:0/3498699139 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fd00ccb00 con 0x7f0fd00ce840 2023-11-08T19:25:16.287 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.281+0000 7f0fd518c700 1 -- 172.21.15.149:0/3498699139 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1220243653 0 0) 0x7f0fd00cc2e0 con 0x7f0fd00cd5e0 2023-11-08T19:25:16.287 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.281+0000 7f0fd698f700 1 --2- 172.21.15.149:0/3498699139 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0fd00ce840 0x7f0fd00d0430 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f0fc8009d90 tx=0x7f0fc800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f807e105ba70ee4a server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:16.287 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.281+0000 7f0fd518c700 1 -- 172.21.15.149:0/3498699139 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc800e070 con 0x7f0fd00ce840 2023-11-08T19:25:16.287 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.281+0000 7f0fd518c700 1 -- 172.21.15.149:0/3498699139 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc800bb90 con 0x7f0fd00ce840 2023-11-08T19:25:16.288 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.281+0000 7f0fd518c700 1 -- 172.21.15.149:0/3498699139 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc8003a20 con 0x7f0fd00ce840 2023-11-08T19:25:16.288 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.281+0000 7f0fd83f2700 1 -- 172.21.15.149:0/3498699139 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0fd00ce840 msgr2=0x7f0fd00d0430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:16.288 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.281+0000 7f0fd83f2700 1 --2- 172.21.15.149:0/3498699139 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0fd00ce840 0x7f0fd00d0430 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f0fc8009d90 tx=0x7f0fc800b330 comp rx=0 tx=0).stop 2023-11-08T19:25:16.288 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.282+0000 7f0fd83f2700 1 -- 172.21.15.149:0/3498699139 shutdown_connections 2023-11-08T19:25:16.289 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.282+0000 7f0fd83f2700 1 --2- 172.21.15.149:0/3498699139 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0fd00ce840 0x7f0fd00d0430 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:16.289 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.282+0000 7f0fd83f2700 1 -- 172.21.15.149:0/3498699139 >> 172.21.15.149:0/3498699139 conn(0x7f0fd008afd0 msgr2=0x7f0fd00d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:16.289 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.282+0000 7f0fd83f2700 1 -- 172.21.15.149:0/3498699139 shutdown_connections 2023-11-08T19:25:16.289 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.282+0000 7f0fd83f2700 1 -- 172.21.15.149:0/3498699139 wait complete. 2023-11-08T19:25:16.292 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.283+0000 7f0fd83f2700 1 Processor -- start 2023-11-08T19:25:16.292 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.283+0000 7f0fd83f2700 1 -- start start 2023-11-08T19:25:16.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.283+0000 7f0fd83f2700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0fd00ce840 0x7f0fd00cb280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:16.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.283+0000 7f0fd83f2700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0fd015b950 0x7f0fd00c8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:16.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.284+0000 7f0fd83f2700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0fd00c8d50 0x7f0fd01f0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:16.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.284+0000 7f0fd83f2700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd00c9200 con 0x7f0fd00ce840 2023-11-08T19:25:16.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.284+0000 7f0fd83f2700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd0156800 con 0x7f0fd00c8d50 2023-11-08T19:25:16.294 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.284+0000 7f0fd83f2700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd01f1840 con 0x7f0fd015b950 2023-11-08T19:25:16.294 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.284+0000 7f0fd618e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0fd00ce840 0x7f0fd00cb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:16.294 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.284+0000 7f0fd618e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0fd00ce840 0x7f0fd00cb280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40972/0 (socket says 172.21.15.149:40972) 2023-11-08T19:25:16.294 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.284+0000 7f0fd618e700 1 -- 172.21.15.149:0/3980362041 learned_addr learned my addr 172.21.15.149:0/3980362041 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:16.294 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.284+0000 7f0fd698f700 1 --2- 172.21.15.149:0/3980362041 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0fd00c8d50 0x7f0fd01f0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:16.295 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.284+0000 7f0fd598d700 1 --2- 172.21.15.149:0/3980362041 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0fd015b950 0x7f0fd00c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:16.295 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.284+0000 7f0fd618e700 1 -- 172.21.15.149:0/3980362041 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0fd015b950 msgr2=0x7f0fd00c8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:16.295 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.284+0000 7f0fd618e700 1 --2- 172.21.15.149:0/3980362041 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0fd015b950 0x7f0fd00c8810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:16.295 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.284+0000 7f0fd618e700 1 -- 172.21.15.149:0/3980362041 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0fd00c8d50 msgr2=0x7f0fd01f0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:16.295 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.284+0000 7f0fd618e700 1 --2- 172.21.15.149:0/3980362041 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0fd00c8d50 0x7f0fd01f0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:16.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.284+0000 7f0fd618e700 1 -- 172.21.15.149:0/3980362041 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc8009a70 con 0x7f0fd00ce840 2023-11-08T19:25:16.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.284+0000 7f0fd698f700 1 --2- 172.21.15.149:0/3980362041 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0fd00c8d50 0x7f0fd01f0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:25:16.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.284+0000 7f0fd618e700 1 --2- 172.21.15.149:0/3980362041 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0fd00ce840 0x7f0fd00cb280 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f0fc000b450 tx=0x7f0fc000b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:16.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.284+0000 7f0fc6ffd700 1 -- 172.21.15.149:0/3980362041 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc0004020 con 0x7f0fd00ce840 2023-11-08T19:25:16.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.284+0000 7f0fc6ffd700 1 -- 172.21.15.149:0/3980362041 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc0004180 con 0x7f0fd00ce840 2023-11-08T19:25:16.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.284+0000 7f0fd83f2700 1 -- 172.21.15.149:0/3980362041 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fd01f1b20 con 0x7f0fd00ce840 2023-11-08T19:25:16.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.284+0000 7f0fc6ffd700 1 -- 172.21.15.149:0/3980362041 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc0004530 con 0x7f0fd00ce840 2023-11-08T19:25:16.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.284+0000 7f0fd83f2700 1 -- 172.21.15.149:0/3980362041 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fd01f20e0 con 0x7f0fd00ce840 2023-11-08T19:25:16.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.285+0000 7f0fd83f2700 1 -- 172.21.15.149:0/3980362041 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fd00745f0 con 0x7f0fd00ce840 2023-11-08T19:25:16.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.286+0000 7f0fc6ffd700 1 -- 172.21.15.149:0/3980362041 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0fc00036d0 con 0x7f0fd00ce840 2023-11-08T19:25:16.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.286+0000 7f0fc6ffd700 1 --2- 172.21.15.149:0/3980362041 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0fb406af00 0x7f0fb406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:16.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.286+0000 7f0fc6ffd700 1 -- 172.21.15.149:0/3980362041 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f0fc0088d70 con 0x7f0fd00ce840 2023-11-08T19:25:16.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.286+0000 7f0fd598d700 1 --2- 172.21.15.149:0/3980362041 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0fb406af00 0x7f0fb406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:16.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.286+0000 7f0fd598d700 1 --2- 172.21.15.149:0/3980362041 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0fb406af00 0x7f0fb406d3c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f0fd00c51e0 tx=0x7f0fcc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:16.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.291+0000 7f0fc6ffd700 1 -- 172.21.15.149:0/3980362041 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0fc0053e80 con 0x7f0fd00ce840 2023-11-08T19:25:16.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.483+0000 7f0fd83f2700 1 -- 172.21.15.149:0/3980362041 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0fd008b760 con 0x7f0fd00ce840 2023-11-08T19:25:16.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.484+0000 7f0fc6ffd700 1 -- 172.21.15.149:0/3980362041 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+14982 (secure 0 0 0) 0x7f0fc0015070 con 0x7f0fd00ce840 2023-11-08T19:25:16.487 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:25:16.487 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":58,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:25:15.132414+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-08T19:24:29.516185+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.149:6837/4238261436":"2023-11-09T19:25:11.732875+0000","172.21.15.149:6835/4238261436":"2023-11-09T19:25:11.732875+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:25:16.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.486+0000 7f0fd83f2700 1 -- 172.21.15.149:0/3980362041 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0fb406af00 msgr2=0x7f0fb406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:16.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.486+0000 7f0fd83f2700 1 --2- 172.21.15.149:0/3980362041 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0fb406af00 0x7f0fb406d3c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f0fd00c51e0 tx=0x7f0fcc009040 comp rx=0 tx=0).stop 2023-11-08T19:25:16.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.486+0000 7f0fd83f2700 1 -- 172.21.15.149:0/3980362041 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0fd00ce840 msgr2=0x7f0fd00cb280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:16.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.486+0000 7f0fd83f2700 1 --2- 172.21.15.149:0/3980362041 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0fd00ce840 0x7f0fd00cb280 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f0fc000b450 tx=0x7f0fc000b810 comp rx=0 tx=0).stop 2023-11-08T19:25:16.490 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.486+0000 7f0fd83f2700 1 -- 172.21.15.149:0/3980362041 shutdown_connections 2023-11-08T19:25:16.490 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.486+0000 7f0fd83f2700 1 --2- 172.21.15.149:0/3980362041 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0fb406af00 0x7f0fb406d3c0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:16.490 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.486+0000 7f0fd83f2700 1 --2- 172.21.15.149:0/3980362041 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0fd00c8d50 0x7f0fd01f0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:16.490 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.486+0000 7f0fd83f2700 1 --2- 172.21.15.149:0/3980362041 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0fd00ce840 0x7f0fd00cb280 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:16.490 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.487+0000 7f0fd83f2700 1 --2- 172.21.15.149:0/3980362041 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0fd015b950 0x7f0fd00c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:16.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.487+0000 7f0fd83f2700 1 -- 172.21.15.149:0/3980362041 >> 172.21.15.149:0/3980362041 conn(0x7f0fd008afd0 msgr2=0x7f0fd0159570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:16.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.487+0000 7f0fd83f2700 1 -- 172.21.15.149:0/3980362041 shutdown_connections 2023-11-08T19:25:16.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.487+0000 7f0fd83f2700 1 -- 172.21.15.149:0/3980362041 wait complete. 2023-11-08T19:25:16.501 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-08T19:22:56.023194+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-08T19:24:29.516185+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 42, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-08T19:25:16.502 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-08T19:25:16.626 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.624+0000 7fa44dbf3700 1 Processor -- start 2023-11-08T19:25:16.627 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.624+0000 7fa44dbf3700 1 -- start start 2023-11-08T19:25:16.629 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.625+0000 7fa44dbf3700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fa44806ab80 0x7fa4480caf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:16.629 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.625+0000 7fa44dbf3700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa4480cf1c0 0x7fa4480cb490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:16.629 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.625+0000 7fa44dbf3700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa44815e320 con 0x7fa44815df40 2023-11-08T19:25:16.629 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.625+0000 7fa44dbf3700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa44806b020 con 0x7fa4480cf1c0 2023-11-08T19:25:16.630 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.625+0000 7fa44dbf3700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa44806b2e0 con 0x7fa44806ab80 2023-11-08T19:25:16.630 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.625+0000 7fa447fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa4480cf1c0 0x7fa4480cb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:16.630 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.625+0000 7fa447fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa4480cf1c0 0x7fa4480cb490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40984/0 (socket says 172.21.15.149:40984) 2023-11-08T19:25:16.630 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.625+0000 7fa447fff700 1 -- 172.21.15.149:0/2301148905 learned_addr learned my addr 172.21.15.149:0/2301148905 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:16.630 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.625+0000 7fa447fff700 1 -- 172.21.15.149:0/2301148905 >> v2:172.21.15.160:3300/0 conn(0x7fa44806ab80 msgr2=0x7fa4480caf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:16.631 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.625+0000 7fa447fff700 1 --2- 172.21.15.149:0/2301148905 >> v2:172.21.15.160:3300/0 conn(0x7fa44806ab80 0x7fa4480caf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:16.631 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.625+0000 7fa447fff700 1 -- 172.21.15.149:0/2301148905 >> v1:172.21.15.160:6789/0 conn(0x7fa44815df40 legacy=0x7fa44806c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:16.631 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.625+0000 7fa447fff700 1 -- 172.21.15.149:0/2301148905 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa44806b5c0 con 0x7fa4480cf1c0 2023-11-08T19:25:16.631 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.625+0000 7fa447fff700 1 --2- 172.21.15.149:0/2301148905 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4480cf1c0 0x7fa4480cb490 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fa44806d940 tx=0x7fa44000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1fa5b7f2f33c72c server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:16.631 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.626+0000 7fa4467fc700 1 -- 172.21.15.149:0/2301148905 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44000e070 con 0x7fa4480cf1c0 2023-11-08T19:25:16.632 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.626+0000 7fa4467fc700 1 -- 172.21.15.149:0/2301148905 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa440003a20 con 0x7fa4480cf1c0 2023-11-08T19:25:16.632 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.626+0000 7fa4467fc700 1 -- 172.21.15.149:0/2301148905 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa440003dd0 con 0x7fa4480cf1c0 2023-11-08T19:25:16.632 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.626+0000 7fa44dbf3700 1 -- 172.21.15.149:0/2301148905 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4480cf1c0 msgr2=0x7fa4480cb490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:16.632 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.626+0000 7fa44dbf3700 1 --2- 172.21.15.149:0/2301148905 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4480cf1c0 0x7fa4480cb490 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fa44806d940 tx=0x7fa44000b330 comp rx=0 tx=0).stop 2023-11-08T19:25:16.632 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.626+0000 7fa44dbf3700 1 -- 172.21.15.149:0/2301148905 shutdown_connections 2023-11-08T19:25:16.633 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.626+0000 7fa44dbf3700 1 --2- 172.21.15.149:0/2301148905 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4480cf1c0 0x7fa4480cb490 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:16.633 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.626+0000 7fa44dbf3700 1 --2- 172.21.15.149:0/2301148905 >> v2:172.21.15.160:3300/0 conn(0x7fa44806ab80 0x7fa4480caf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:16.633 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.626+0000 7fa44dbf3700 1 -- 172.21.15.149:0/2301148905 >> 172.21.15.149:0/2301148905 conn(0x7fa4480d0640 msgr2=0x7fa4480d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:16.633 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.626+0000 7fa44dbf3700 1 -- 172.21.15.149:0/2301148905 shutdown_connections 2023-11-08T19:25:16.633 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.626+0000 7fa44dbf3700 1 -- 172.21.15.149:0/2301148905 wait complete. 2023-11-08T19:25:16.636 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.627+0000 7fa44dbf3700 1 Processor -- start 2023-11-08T19:25:16.636 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.628+0000 7fa44dbf3700 1 -- start start 2023-11-08T19:25:16.636 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.628+0000 7fa44dbf3700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa44806ab80 0x7fa448157080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:16.637 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.628+0000 7fa44dbf3700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa4480cf1c0 0x7fa448160f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:16.637 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.628+0000 7fa44dbf3700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa44815df40 0x7fa44814ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:16.637 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.628+0000 7fa44dbf3700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa448160b50 con 0x7fa44815df40 2023-11-08T19:25:16.637 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.628+0000 7fa44dbf3700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4481614b0 con 0x7fa4480cf1c0 2023-11-08T19:25:16.637 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.628+0000 7fa44dbf3700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa44815fed0 con 0x7fa44806ab80 2023-11-08T19:25:16.638 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.628+0000 7fa447fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa44815df40 0x7fa44814ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:16.638 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.628+0000 7fa447fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa44815df40 0x7fa44814ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:40990/0 (socket says 172.21.15.149:40990) 2023-11-08T19:25:16.638 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.628+0000 7fa447fff700 1 -- 172.21.15.149:0/531804956 learned_addr learned my addr 172.21.15.149:0/531804956 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:16.638 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.628+0000 7fa4477fe700 1 --2- 172.21.15.149:0/531804956 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa44806ab80 0x7fa448157080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:16.638 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.628+0000 7fa446ffd700 1 --2- 172.21.15.149:0/531804956 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa4480cf1c0 0x7fa448160f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:16.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.629+0000 7fa447fff700 1 -- 172.21.15.149:0/531804956 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa44806ab80 msgr2=0x7fa448157080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:16.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.629+0000 7fa447fff700 1 --2- 172.21.15.149:0/531804956 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa44806ab80 0x7fa448157080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:16.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.629+0000 7fa447fff700 1 -- 172.21.15.149:0/531804956 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa4480cf1c0 msgr2=0x7fa448160f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:16.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.629+0000 7fa447fff700 1 --2- 172.21.15.149:0/531804956 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa4480cf1c0 0x7fa448160f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:16.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.629+0000 7fa447fff700 1 -- 172.21.15.149:0/531804956 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa440009b30 con 0x7fa44815df40 2023-11-08T19:25:16.640 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.629+0000 7fa447fff700 1 --2- 172.21.15.149:0/531804956 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa44815df40 0x7fa44814ca10 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fa440015040 tx=0x7fa440004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:16.640 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.629+0000 7fa42ffff700 1 -- 172.21.15.149:0/531804956 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4400092e0 con 0x7fa44815df40 2023-11-08T19:25:16.640 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.629+0000 7fa42ffff700 1 -- 172.21.15.149:0/531804956 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa440004240 con 0x7fa44815df40 2023-11-08T19:25:16.640 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.629+0000 7fa44dbf3700 1 -- 172.21.15.149:0/531804956 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4481601b0 con 0x7fa44815df40 2023-11-08T19:25:16.640 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.629+0000 7fa42ffff700 1 -- 172.21.15.149:0/531804956 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4400045f0 con 0x7fa44815df40 2023-11-08T19:25:16.641 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.629+0000 7fa44dbf3700 1 -- 172.21.15.149:0/531804956 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa448160770 con 0x7fa44815df40 2023-11-08T19:25:16.641 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.630+0000 7fa44dbf3700 1 -- 172.21.15.149:0/531804956 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa448160c90 con 0x7fa44815df40 2023-11-08T19:25:16.641 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.630+0000 7fa42ffff700 1 -- 172.21.15.149:0/531804956 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa440019070 con 0x7fa44815df40 2023-11-08T19:25:16.641 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.631+0000 7fa42ffff700 1 --2- 172.21.15.149:0/531804956 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa43406af00 0x7fa43406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:16.641 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.631+0000 7fa42ffff700 1 -- 172.21.15.149:0/531804956 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fa44008a3d0 con 0x7fa44815df40 2023-11-08T19:25:16.642 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.631+0000 7fa4477fe700 1 --2- 172.21.15.149:0/531804956 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa43406af00 0x7fa43406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:16.642 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.631+0000 7fa4477fe700 1 --2- 172.21.15.149:0/531804956 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa43406af00 0x7fa43406d3c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa448159730 tx=0x7fa43c0090e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:16.642 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.635+0000 7fa42ffff700 1 -- 172.21.15.149:0/531804956 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa448160c90 con 0x7fa44815df40 2023-11-08T19:25:16.827 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.824+0000 7fa44dbf3700 1 -- 172.21.15.149:0/531804956 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa448160c90 con 0x7fa44815df40 2023-11-08T19:25:16.827 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.825+0000 7fa42ffff700 1 -- 172.21.15.149:0/531804956 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v58) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa440017020 con 0x7fa44815df40 2023-11-08T19:25:16.828 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 1 2023-11-08T19:25:16.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.827+0000 7fa44dbf3700 1 -- 172.21.15.149:0/531804956 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa43406af00 msgr2=0x7fa43406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:16.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.827+0000 7fa44dbf3700 1 --2- 172.21.15.149:0/531804956 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa43406af00 0x7fa43406d3c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa448159730 tx=0x7fa43c0090e0 comp rx=0 tx=0).stop 2023-11-08T19:25:16.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.827+0000 7fa44dbf3700 1 -- 172.21.15.149:0/531804956 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa44815df40 msgr2=0x7fa44814ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:16.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.827+0000 7fa44dbf3700 1 --2- 172.21.15.149:0/531804956 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa44815df40 0x7fa44814ca10 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fa440015040 tx=0x7fa440004ad0 comp rx=0 tx=0).stop 2023-11-08T19:25:16.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.827+0000 7fa44dbf3700 1 -- 172.21.15.149:0/531804956 shutdown_connections 2023-11-08T19:25:16.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.827+0000 7fa44dbf3700 1 --2- 172.21.15.149:0/531804956 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa43406af00 0x7fa43406d3c0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:16.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.827+0000 7fa44dbf3700 1 --2- 172.21.15.149:0/531804956 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa44815df40 0x7fa44814ca10 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:16.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.827+0000 7fa44dbf3700 1 --2- 172.21.15.149:0/531804956 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa44806ab80 0x7fa448157080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:16.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.827+0000 7fa44dbf3700 1 --2- 172.21.15.149:0/531804956 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa4480cf1c0 0x7fa448160f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:16.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.827+0000 7fa44dbf3700 1 -- 172.21.15.149:0/531804956 >> 172.21.15.149:0/531804956 conn(0x7fa4480d0640 msgr2=0x7fa4480cbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:16.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.827+0000 7fa44dbf3700 1 -- 172.21.15.149:0/531804956 shutdown_connections 2023-11-08T19:25:16.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.827+0000 7fa44dbf3700 1 -- 172.21.15.149:0/531804956 wait complete. 2023-11-08T19:25:16.842 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-08T19:25:16.966 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.963+0000 7f635618e700 1 Processor -- start 2023-11-08T19:25:16.966 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.963+0000 7f635618e700 1 -- start start 2023-11-08T19:25:16.969 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.964+0000 7f635618e700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f63500cfd30 0x7f635006d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:16.970 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.964+0000 7f635618e700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63500cdd30 con 0x7f63500b38e0 2023-11-08T19:25:16.970 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.964+0000 7f635618e700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63500d0150 con 0x7f635015db10 2023-11-08T19:25:16.970 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.964+0000 7f635618e700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63500ced40 con 0x7f63500cfd30 2023-11-08T19:25:16.970 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.964+0000 7f634effd700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f63500b38e0 0x7f635006c160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:42998/0 (socket says 172.21.15.149:42998) 2023-11-08T19:25:16.971 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.964+0000 7f634effd700 1 -- 172.21.15.149:0/1580854221 learned_addr learned my addr 172.21.15.149:0/1580854221 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:25:16.971 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.965+0000 7f634e7fc700 1 -- 172.21.15.149:0/1580854221 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1607689777 0 0) 0x7f63500cdd30 con 0x7f63500b38e0 2023-11-08T19:25:16.971 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.965+0000 7f634e7fc700 1 -- 172.21.15.149:0/1580854221 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f633c0035b0 con 0x7f63500b38e0 2023-11-08T19:25:16.972 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.965+0000 7f634ffff700 1 --2- 172.21.15.149:0/1580854221 >> v2:172.21.15.160:3300/0 conn(0x7f63500cfd30 0x7f635006d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:16.972 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.965+0000 7f634e7fc700 1 -- 172.21.15.149:0/1580854221 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3979868349 0 0) 0x7f633c0035b0 con 0x7f63500b38e0 2023-11-08T19:25:16.972 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.965+0000 7f634e7fc700 1 -- 172.21.15.149:0/1580854221 >> v2:172.21.15.160:3300/0 conn(0x7f63500cfd30 msgr2=0x7f635006d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:16.972 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.965+0000 7f634e7fc700 1 --2- 172.21.15.149:0/1580854221 >> v2:172.21.15.160:3300/0 conn(0x7f63500cfd30 0x7f635006d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:16.973 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.965+0000 7f634e7fc700 1 -- 172.21.15.149:0/1580854221 >> v1:172.21.15.160:6789/0 conn(0x7f635015db10 legacy=0x7f63500b31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:16.973 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.965+0000 7f634e7fc700 1 -- 172.21.15.149:0/1580854221 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63500cbe50 con 0x7f63500b38e0 2023-11-08T19:25:16.973 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.965+0000 7f634e7fc700 1 -- 172.21.15.149:0/1580854221 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f6338001670 con 0x7f63500b38e0 2023-11-08T19:25:16.973 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.965+0000 7f634e7fc700 1 -- 172.21.15.149:0/1580854221 >> v1:172.21.15.149:6789/0 conn(0x7f63500b38e0 legacy=0x7f635006c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:16.973 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.965+0000 7f634e7fc700 1 --2- 172.21.15.149:0/1580854221 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f633c003a70 0x7f633c003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:16.974 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.965+0000 7f634e7fc700 1 --2- 172.21.15.149:0/1580854221 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f633c004850 0x7f633c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:16.974 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.965+0000 7f634e7fc700 1 --2- 172.21.15.149:0/1580854221 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f633c005210 0x7f633c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:16.974 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.965+0000 7f634e7fc700 1 -- 172.21.15.149:0/1580854221 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f633c00c0f0 con 0x7f633c004850 2023-11-08T19:25:16.974 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.965+0000 7f634e7fc700 1 -- 172.21.15.149:0/1580854221 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f633c00c260 con 0x7f633c005210 2023-11-08T19:25:16.974 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.965+0000 7f634e7fc700 1 -- 172.21.15.149:0/1580854221 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f633c00c420 con 0x7f633c003a70 2023-11-08T19:25:16.975 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.965+0000 7f634effd700 1 --2- 172.21.15.149:0/1580854221 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f633c004850 0x7f633c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:16.975 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.965+0000 7f634ffff700 1 --2- 172.21.15.149:0/1580854221 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f633c005210 0x7f633c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:16.975 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.965+0000 7f634f7fe700 1 --2- 172.21.15.149:0/1580854221 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f633c003a70 0x7f633c003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:16.975 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.965+0000 7f634effd700 1 -- 172.21.15.149:0/1580854221 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f633c003a70 msgr2=0x7f633c003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:16.975 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.965+0000 7f634effd700 1 --2- 172.21.15.149:0/1580854221 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f633c003a70 0x7f633c003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:16.976 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.965+0000 7f634effd700 1 -- 172.21.15.149:0/1580854221 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f633c005210 msgr2=0x7f633c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:16.976 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.965+0000 7f634effd700 1 --2- 172.21.15.149:0/1580854221 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f633c005210 0x7f633c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:16.976 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.965+0000 7f634ffff700 1 -- 172.21.15.149:0/1580854221 reap_dead start 2023-11-08T19:25:16.976 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.965+0000 7f634effd700 1 -- 172.21.15.149:0/1580854221 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f633c0035b0 con 0x7f633c004850 2023-11-08T19:25:16.976 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.966+0000 7f634effd700 1 --2- 172.21.15.149:0/1580854221 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f633c004850 0x7f633c004cd0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f633800c240 tx=0x7f633c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1c58674d6ea34e5 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:16.977 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.966+0000 7f634e7fc700 1 -- 172.21.15.149:0/1580854221 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6338007c10 con 0x7f633c004850 2023-11-08T19:25:16.977 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.966+0000 7f634e7fc700 1 -- 172.21.15.149:0/1580854221 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f633800cd80 con 0x7f633c004850 2023-11-08T19:25:16.977 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.966+0000 7f634e7fc700 1 -- 172.21.15.149:0/1580854221 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6338005ba0 con 0x7f633c004850 2023-11-08T19:25:16.977 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.966+0000 7f635618e700 1 -- 172.21.15.149:0/1580854221 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f633c004850 msgr2=0x7f633c004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:16.977 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.966+0000 7f635618e700 1 --2- 172.21.15.149:0/1580854221 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f633c004850 0x7f633c004cd0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f633800c240 tx=0x7f633c005880 comp rx=0 tx=0).stop 2023-11-08T19:25:16.978 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.966+0000 7f635618e700 1 -- 172.21.15.149:0/1580854221 shutdown_connections 2023-11-08T19:25:16.978 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.966+0000 7f635618e700 1 --2- 172.21.15.149:0/1580854221 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f633c004850 0x7f633c004cd0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:16.978 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.966+0000 7f635618e700 1 -- 172.21.15.149:0/1580854221 >> 172.21.15.149:0/1580854221 conn(0x7f635006f120 msgr2=0x7f635006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:16.978 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.966+0000 7f635618e700 1 -- 172.21.15.149:0/1580854221 shutdown_connections 2023-11-08T19:25:16.978 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.966+0000 7f635618e700 1 -- 172.21.15.149:0/1580854221 wait complete. 2023-11-08T19:25:16.979 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.968+0000 7f635618e700 1 Processor -- start 2023-11-08T19:25:16.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.968+0000 7f635618e700 1 -- start start 2023-11-08T19:25:16.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.969+0000 7f635618e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f633c004850 0x7f63501607c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:16.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.969+0000 7f635618e700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f63501497e0 0x7f6350149c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:16.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.969+0000 7f635618e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6350159910 0x7f6350159da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:16.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.969+0000 7f635618e700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f635014a1a0 con 0x7f6350159910 2023-11-08T19:25:16.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.969+0000 7f635618e700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f635014db80 con 0x7f633c004850 2023-11-08T19:25:16.983 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.969+0000 7f635618e700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f635015ece0 con 0x7f63501497e0 2023-11-08T19:25:16.983 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.969+0000 7f634ffff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6350159910 0x7f6350159da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:16.983 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.969+0000 7f634ffff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6350159910 0x7f6350159da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41010/0 (socket says 172.21.15.149:41010) 2023-11-08T19:25:16.983 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.969+0000 7f634ffff700 1 -- 172.21.15.149:0/1578974504 learned_addr learned my addr 172.21.15.149:0/1578974504 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:16.983 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.969+0000 7f634effd700 1 --2- 172.21.15.149:0/1578974504 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f63501497e0 0x7f6350149c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:16.984 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.969+0000 7f634ffff700 1 -- 172.21.15.149:0/1578974504 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f63501497e0 msgr2=0x7f6350149c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:16.984 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.969+0000 7f634ffff700 1 --2- 172.21.15.149:0/1578974504 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f63501497e0 0x7f6350149c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:16.984 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.969+0000 7f634ffff700 1 -- 172.21.15.149:0/1578974504 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f633c004850 msgr2=0x7f63501607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:16.984 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.969+0000 7f634f7fe700 1 --2- 172.21.15.149:0/1578974504 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f633c004850 0x7f63501607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:16.984 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.969+0000 7f634ffff700 1 --2- 172.21.15.149:0/1578974504 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f633c004850 0x7f63501607c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:16.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.969+0000 7f634ffff700 1 -- 172.21.15.149:0/1578974504 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f635015efc0 con 0x7f6350159910 2023-11-08T19:25:16.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.969+0000 7f634ffff700 1 --2- 172.21.15.149:0/1578974504 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6350159910 0x7f6350159da0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f63500cf290 tx=0x7f6340011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:16.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.970+0000 7f6347fff700 1 -- 172.21.15.149:0/1578974504 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6340004240 con 0x7f6350159910 2023-11-08T19:25:16.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.970+0000 7f6347fff700 1 -- 172.21.15.149:0/1578974504 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63400043a0 con 0x7f6350159910 2023-11-08T19:25:16.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.970+0000 7f635618e700 1 -- 172.21.15.149:0/1578974504 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f635015f2a0 con 0x7f6350159910 2023-11-08T19:25:16.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.970+0000 7f6347fff700 1 -- 172.21.15.149:0/1578974504 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63400038e0 con 0x7f6350159910 2023-11-08T19:25:16.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.970+0000 7f635618e700 1 -- 172.21.15.149:0/1578974504 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f635015f860 con 0x7f6350159910 2023-11-08T19:25:16.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.971+0000 7f635618e700 1 -- 172.21.15.149:0/1578974504 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63500cf100 con 0x7f6350159910 2023-11-08T19:25:16.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.971+0000 7f6347fff700 1 -- 172.21.15.149:0/1578974504 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6340003a40 con 0x7f6350159910 2023-11-08T19:25:16.987 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.971+0000 7f6347fff700 1 --2- 172.21.15.149:0/1578974504 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f633006af00 0x7f633006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:16.987 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.971+0000 7f6347fff700 1 -- 172.21.15.149:0/1578974504 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f63400896b0 con 0x7f6350159910 2023-11-08T19:25:16.987 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.971+0000 7f634f7fe700 1 --2- 172.21.15.149:0/1578974504 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f633006af00 0x7f633006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:16.987 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.972+0000 7f634f7fe700 1 --2- 172.21.15.149:0/1578974504 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f633006af00 0x7f633006d3c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6348003ba0 tx=0x7f6348009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:16.988 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:16.976+0000 7f6347fff700 1 -- 172.21.15.149:0/1578974504 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6340054850 con 0x7f6350159910 2023-11-08T19:25:17.169 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.167+0000 7f635618e700 1 -- 172.21.15.149:0/1578974504 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f635004f730 con 0x7f6350159910 2023-11-08T19:25:17.170 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.167+0000 7f6347fff700 1 -- 172.21.15.149:0/1578974504 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v58) v1 ==== 103+0+11 (secure 0 0 0) 0x7f634001d310 con 0x7f6350159910 2023-11-08T19:25:17.170 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:25:17.172 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.170+0000 7f635618e700 1 -- 172.21.15.149:0/1578974504 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f633006af00 msgr2=0x7f633006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:17.172 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.170+0000 7f635618e700 1 --2- 172.21.15.149:0/1578974504 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f633006af00 0x7f633006d3c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6348003ba0 tx=0x7f6348009040 comp rx=0 tx=0).stop 2023-11-08T19:25:17.173 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.170+0000 7f635618e700 1 -- 172.21.15.149:0/1578974504 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6350159910 msgr2=0x7f6350159da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:17.173 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.170+0000 7f635618e700 1 --2- 172.21.15.149:0/1578974504 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6350159910 0x7f6350159da0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f63500cf290 tx=0x7f6340011bf0 comp rx=0 tx=0).stop 2023-11-08T19:25:17.173 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.170+0000 7f635618e700 1 -- 172.21.15.149:0/1578974504 shutdown_connections 2023-11-08T19:25:17.173 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.170+0000 7f635618e700 1 --2- 172.21.15.149:0/1578974504 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f633006af00 0x7f633006d3c0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:17.173 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.170+0000 7f635618e700 1 --2- 172.21.15.149:0/1578974504 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f633c004850 0x7f63501607c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:17.174 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.170+0000 7f635618e700 1 --2- 172.21.15.149:0/1578974504 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6350159910 0x7f6350159da0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:17.174 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.170+0000 7f635618e700 1 --2- 172.21.15.149:0/1578974504 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f63501497e0 0x7f6350149c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:17.174 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.170+0000 7f635618e700 1 -- 172.21.15.149:0/1578974504 >> 172.21.15.149:0/1578974504 conn(0x7f635006f120 msgr2=0x7f63500c8820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:17.175 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.170+0000 7f635618e700 1 -- 172.21.15.149:0/1578974504 shutdown_connections 2023-11-08T19:25:17.175 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.170+0000 7f635618e700 1 -- 172.21.15.149:0/1578974504 wait complete. 2023-11-08T19:25:17.184 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_using_pool_with_snap_fails_fs_creation' 2023-11-08T19:25:17.305 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.303+0000 7f4756c43700 1 Processor -- start 2023-11-08T19:25:17.306 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.303+0000 7f4756c43700 1 -- start start 2023-11-08T19:25:17.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.304+0000 7f4756c43700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f47500d21f0 0x7f47500cfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:17.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.304+0000 7f4756c43700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f47500c5220 0x7f47500c56b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:17.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.304+0000 7f4756c43700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47500d2670 con 0x7f475015bbf0 2023-11-08T19:25:17.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.304+0000 7f4756c43700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47500cccb0 con 0x7f47500d21f0 2023-11-08T19:25:17.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.304+0000 7f4756c43700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47500d04c0 con 0x7f47500c5220 2023-11-08T19:25:17.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.304+0000 7f474ffff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f47500d21f0 0x7f47500cfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:17.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.304+0000 7f47549df700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f475015bbf0 0x7f47500cf4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:43016/0 (socket says 172.21.15.149:43016) 2023-11-08T19:25:17.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.304+0000 7f47549df700 1 -- 172.21.15.149:0/2820627707 learned_addr learned my addr 172.21.15.149:0/2820627707 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:25:17.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.305+0000 7f47551e0700 1 --2- 172.21.15.149:0/2820627707 >> v2:172.21.15.160:3300/0 conn(0x7f47500c5220 0x7f47500c56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:17.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.305+0000 7f474ffff700 1 -- 172.21.15.149:0/2820627707 >> v2:172.21.15.160:3300/0 conn(0x7f47500c5220 msgr2=0x7f47500c56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:17.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.305+0000 7f474ffff700 1 --2- 172.21.15.149:0/2820627707 >> v2:172.21.15.160:3300/0 conn(0x7f47500c5220 0x7f47500c56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:17.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.305+0000 7f474ffff700 1 -- 172.21.15.149:0/2820627707 >> v1:172.21.15.149:6789/0 conn(0x7f475015bbf0 legacy=0x7f47500cf4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:17.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.305+0000 7f474ffff700 1 -- 172.21.15.149:0/2820627707 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47500ccf50 con 0x7f47500d21f0 2023-11-08T19:25:17.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.305+0000 7f474f7fe700 1 -- 172.21.15.149:0/2820627707 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 758987195 0 0) 0x7f47500d2670 con 0x7f475015bbf0 2023-11-08T19:25:17.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.305+0000 7f474ffff700 1 --2- 172.21.15.149:0/2820627707 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47500d21f0 0x7f47500cfbc0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f4750073030 tx=0x7f473c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d938afaccc56004 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:17.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.305+0000 7f474f7fe700 1 -- 172.21.15.149:0/2820627707 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473c011830 con 0x7f47500d21f0 2023-11-08T19:25:17.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.305+0000 7f474f7fe700 1 -- 172.21.15.149:0/2820627707 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f473c011990 con 0x7f47500d21f0 2023-11-08T19:25:17.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.305+0000 7f474f7fe700 1 -- 172.21.15.149:0/2820627707 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473c011d20 con 0x7f47500d21f0 2023-11-08T19:25:17.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.306+0000 7f4756c43700 1 -- 172.21.15.149:0/2820627707 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47500d21f0 msgr2=0x7f47500cfbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:17.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.306+0000 7f4756c43700 1 --2- 172.21.15.149:0/2820627707 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47500d21f0 0x7f47500cfbc0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f4750073030 tx=0x7f473c009b20 comp rx=0 tx=0).stop 2023-11-08T19:25:17.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.306+0000 7f4756c43700 1 -- 172.21.15.149:0/2820627707 shutdown_connections 2023-11-08T19:25:17.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.306+0000 7f4756c43700 1 --2- 172.21.15.149:0/2820627707 >> v2:172.21.15.160:3300/0 conn(0x7f47500c5220 0x7f47500c56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:17.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.306+0000 7f4756c43700 1 --2- 172.21.15.149:0/2820627707 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47500d21f0 0x7f47500cfbc0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:17.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.306+0000 7f4756c43700 1 -- 172.21.15.149:0/2820627707 >> 172.21.15.149:0/2820627707 conn(0x7f47500d16d0 msgr2=0x7f47500d1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:17.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.306+0000 7f4756c43700 1 -- 172.21.15.149:0/2820627707 shutdown_connections 2023-11-08T19:25:17.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.306+0000 7f4756c43700 1 -- 172.21.15.149:0/2820627707 wait complete. 2023-11-08T19:25:17.316 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.307+0000 7f4756c43700 1 Processor -- start 2023-11-08T19:25:17.316 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.307+0000 7f4756c43700 1 -- start start 2023-11-08T19:25:17.316 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.308+0000 7f4756c43700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f47500c5220 0x7f4750153510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:17.316 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.308+0000 7f4756c43700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47500d21f0 0x7f47500ca850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:17.317 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.308+0000 7f4756c43700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f475015bbf0 0x7f475015a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:17.317 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.308+0000 7f4756c43700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47500c9670 con 0x7f47500d21f0 2023-11-08T19:25:17.317 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.309+0000 7f4756c43700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47501f1520 con 0x7f475015bbf0 2023-11-08T19:25:17.317 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.309+0000 7f4756c43700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47500c87a0 con 0x7f47500c5220 2023-11-08T19:25:17.317 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.309+0000 7f474ffff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47500d21f0 0x7f47500ca850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:17.318 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.309+0000 7f474ffff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47500d21f0 0x7f47500ca850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41022/0 (socket says 172.21.15.149:41022) 2023-11-08T19:25:17.318 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.309+0000 7f474ffff700 1 -- 172.21.15.149:0/585637943 learned_addr learned my addr 172.21.15.149:0/585637943 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:17.318 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.309+0000 7f47549df700 1 --2- 172.21.15.149:0/585637943 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f47500c5220 0x7f4750153510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:17.318 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.309+0000 7f47551e0700 1 --2- 172.21.15.149:0/585637943 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f475015bbf0 0x7f475015a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:17.318 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.309+0000 7f474ffff700 1 -- 172.21.15.149:0/585637943 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f47500c5220 msgr2=0x7f4750153510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:17.319 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.309+0000 7f474ffff700 1 --2- 172.21.15.149:0/585637943 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f47500c5220 0x7f4750153510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:17.319 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.309+0000 7f474ffff700 1 -- 172.21.15.149:0/585637943 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f475015bbf0 msgr2=0x7f475015a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:17.319 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.309+0000 7f474ffff700 1 --2- 172.21.15.149:0/585637943 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f475015bbf0 0x7f475015a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:17.319 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.309+0000 7f474ffff700 1 -- 172.21.15.149:0/585637943 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f473c0094a0 con 0x7f47500d21f0 2023-11-08T19:25:17.319 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.309+0000 7f47551e0700 1 --2- 172.21.15.149:0/585637943 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f475015bbf0 0x7f475015a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:25:17.319 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.309+0000 7f474ffff700 1 --2- 172.21.15.149:0/585637943 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47500d21f0 0x7f47500ca850 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f473c014040 tx=0x7f473c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:17.320 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.309+0000 7f474d7fa700 1 -- 172.21.15.149:0/585637943 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473c0036a0 con 0x7f47500d21f0 2023-11-08T19:25:17.320 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.309+0000 7f474d7fa700 1 -- 172.21.15.149:0/585637943 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f473c01e070 con 0x7f47500d21f0 2023-11-08T19:25:17.320 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.309+0000 7f474d7fa700 1 -- 172.21.15.149:0/585637943 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473c003a00 con 0x7f47500d21f0 2023-11-08T19:25:17.320 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.309+0000 7f4756c43700 1 -- 172.21.15.149:0/585637943 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47500c89f0 con 0x7f47500d21f0 2023-11-08T19:25:17.320 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.309+0000 7f4756c43700 1 -- 172.21.15.149:0/585637943 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47500c8fb0 con 0x7f47500d21f0 2023-11-08T19:25:17.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.310+0000 7f4756c43700 1 -- 172.21.15.149:0/585637943 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4750157020 con 0x7f47500d21f0 2023-11-08T19:25:17.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.311+0000 7f474d7fa700 1 -- 172.21.15.149:0/585637943 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f473c003b60 con 0x7f47500d21f0 2023-11-08T19:25:17.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.311+0000 7f474d7fa700 1 --2- 172.21.15.149:0/585637943 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f473406af30 0x7f473406d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:17.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.311+0000 7f474d7fa700 1 -- 172.21.15.149:0/585637943 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f473c08a5e0 con 0x7f47500d21f0 2023-11-08T19:25:17.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.311+0000 7f47549df700 1 --2- 172.21.15.149:0/585637943 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f473406af30 0x7f473406d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:17.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.311+0000 7f47549df700 1 --2- 172.21.15.149:0/585637943 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f473406af30 0x7f473406d3f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f47440010e0 tx=0x7f4744009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:17.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.316+0000 7f474d7fa700 1 -- 172.21.15.149:0/585637943 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4750157020 con 0x7f47500d21f0 2023-11-08T19:25:17.591 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:17.589+0000 7f4756c43700 1 -- 172.21.15.149:0/585637943 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_using_pool_with_snap_fails_fs_creation"]} v 0) v1 -- 0x7f4750157020 con 0x7f47500d21f0 2023-11-08T19:25:18.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.149+0000 7f474d7fa700 1 -- 172.21.15.149:0/585637943 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_using_pool_with_snap_fails_fs_creation"]}]=0 v149) v1 ==== 176+0+0 (secure 0 0 0) 0x7f4750157020 con 0x7f47500d21f0 2023-11-08T19:25:18.154 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.152+0000 7f4756c43700 1 -- 172.21.15.149:0/585637943 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f473406af30 msgr2=0x7f473406d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:18.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.152+0000 7f4756c43700 1 --2- 172.21.15.149:0/585637943 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f473406af30 0x7f473406d3f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f47440010e0 tx=0x7f4744009040 comp rx=0 tx=0).stop 2023-11-08T19:25:18.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.152+0000 7f4756c43700 1 -- 172.21.15.149:0/585637943 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47500d21f0 msgr2=0x7f47500ca850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:18.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.152+0000 7f4756c43700 1 --2- 172.21.15.149:0/585637943 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47500d21f0 0x7f47500ca850 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f473c014040 tx=0x7f473c004750 comp rx=0 tx=0).stop 2023-11-08T19:25:18.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.152+0000 7f4756c43700 1 -- 172.21.15.149:0/585637943 shutdown_connections 2023-11-08T19:25:18.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.152+0000 7f4756c43700 1 --2- 172.21.15.149:0/585637943 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f473406af30 0x7f473406d3f0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:18.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.152+0000 7f4756c43700 1 --2- 172.21.15.149:0/585637943 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f475015bbf0 0x7f475015a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:18.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.152+0000 7f4756c43700 1 --2- 172.21.15.149:0/585637943 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f47500c5220 0x7f4750153510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:18.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.152+0000 7f4756c43700 1 --2- 172.21.15.149:0/585637943 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47500d21f0 0x7f47500ca850 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:18.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.152+0000 7f4756c43700 1 -- 172.21.15.149:0/585637943 >> 172.21.15.149:0/585637943 conn(0x7f47500d16d0 msgr2=0x7f47500ce1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:18.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.152+0000 7f4756c43700 1 -- 172.21.15.149:0/585637943 shutdown_connections 2023-11-08T19:25:18.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.152+0000 7f4756c43700 1 -- 172.21.15.149:0/585637943 wait complete. 2023-11-08T19:25:18.168 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-08T19:25:18.294 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.292+0000 7ff5ac8da700 1 Processor -- start 2023-11-08T19:25:18.295 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.292+0000 7ff5ac8da700 1 -- start start 2023-11-08T19:25:18.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.293+0000 7ff5ac8da700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff5a815f470 0x7ff5a815c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:18.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.293+0000 7ff5ac8da700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7ff5a815cb60 0x7ff5a80cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:18.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.293+0000 7ff5ac8da700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5a815be80 con 0x7ff5a80cc0d0 2023-11-08T19:25:18.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.293+0000 7ff5ac8da700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5a80ccbc0 con 0x7ff5a815cb60 2023-11-08T19:25:18.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.293+0000 7ff5ac8da700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a815f8d0 con 0x7ff5a815f470 2023-11-08T19:25:18.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.293+0000 7ff5a659c700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7ff5a80cc0d0 0x7ff5a80cc4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:43030/0 (socket says 172.21.15.149:43030) 2023-11-08T19:25:18.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.293+0000 7ff5a659c700 1 -- 172.21.15.149:0/917480592 learned_addr learned my addr 172.21.15.149:0/917480592 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:25:18.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.294+0000 7ff5a559a700 1 -- 172.21.15.149:0/917480592 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1028161570 0 0) 0x7ff5a815be80 con 0x7ff5a80cc0d0 2023-11-08T19:25:18.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.294+0000 7ff5a6d9d700 1 --2- 172.21.15.149:0/917480592 >> v2:172.21.15.160:3300/0 conn(0x7ff5a815cb60 0x7ff5a80cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:18.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.294+0000 7ff5a5d9b700 1 --2- 172.21.15.149:0/917480592 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff5a815f470 0x7ff5a815c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:18.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.294+0000 7ff5a559a700 1 -- 172.21.15.149:0/917480592 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5900035b0 con 0x7ff5a80cc0d0 2023-11-08T19:25:18.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.294+0000 7ff5a559a700 1 -- 172.21.15.149:0/917480592 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3220598883 0 0) 0x7ff5900035b0 con 0x7ff5a80cc0d0 2023-11-08T19:25:18.302 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.294+0000 7ff5a559a700 1 -- 172.21.15.149:0/917480592 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff5a815f470 msgr2=0x7ff5a815c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:18.302 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.294+0000 7ff5a559a700 1 --2- 172.21.15.149:0/917480592 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff5a815f470 0x7ff5a815c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:18.302 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.294+0000 7ff5a559a700 1 -- 172.21.15.149:0/917480592 >> v2:172.21.15.160:3300/0 conn(0x7ff5a815cb60 msgr2=0x7ff5a80cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:18.302 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.294+0000 7ff5a559a700 1 --2- 172.21.15.149:0/917480592 >> v2:172.21.15.160:3300/0 conn(0x7ff5a815cb60 0x7ff5a80cf320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:18.302 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.294+0000 7ff5a559a700 1 -- 172.21.15.149:0/917480592 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a815fba0 con 0x7ff5a80cc0d0 2023-11-08T19:25:18.303 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.294+0000 7ff5a559a700 1 -- 172.21.15.149:0/917480592 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7ff59c001670 con 0x7ff5a80cc0d0 2023-11-08T19:25:18.303 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.294+0000 7ff5a559a700 1 -- 172.21.15.149:0/917480592 >> v1:172.21.15.149:6789/0 conn(0x7ff5a80cc0d0 legacy=0x7ff5a80cc4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:18.303 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.294+0000 7ff5a559a700 1 --2- 172.21.15.149:0/917480592 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff590003a70 0x7ff590003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:18.303 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.294+0000 7ff5a559a700 1 --2- 172.21.15.149:0/917480592 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff590004850 0x7ff590004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:18.303 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.294+0000 7ff5a559a700 1 --2- 172.21.15.149:0/917480592 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff5a815f470 0x7ff590005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:18.304 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.294+0000 7ff5a559a700 1 -- 172.21.15.149:0/917480592 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a80ccbc0 con 0x7ff590003a70 2023-11-08T19:25:18.304 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.294+0000 7ff5a559a700 1 -- 172.21.15.149:0/917480592 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a815f8d0 con 0x7ff590004850 2023-11-08T19:25:18.304 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.294+0000 7ff5a559a700 1 -- 172.21.15.149:0/917480592 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff59000ba10 con 0x7ff5a815f470 2023-11-08T19:25:18.304 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.294+0000 7ff5a659c700 1 --2- 172.21.15.149:0/917480592 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff590003a70 0x7ff590003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:18.304 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.294+0000 7ff5a5d9b700 1 --2- 172.21.15.149:0/917480592 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff590004850 0x7ff590004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:18.305 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.294+0000 7ff5a6d9d700 1 --2- 172.21.15.149:0/917480592 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff5a815f470 0x7ff590005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:18.305 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.294+0000 7ff5a659c700 1 -- 172.21.15.149:0/917480592 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff5a815f470 msgr2=0x7ff590005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:18.305 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.294+0000 7ff5a659c700 1 --2- 172.21.15.149:0/917480592 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff5a815f470 0x7ff590005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:18.305 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.294+0000 7ff5a659c700 1 -- 172.21.15.149:0/917480592 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff590004850 msgr2=0x7ff590004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:18.305 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.294+0000 7ff5a659c700 1 --2- 172.21.15.149:0/917480592 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff590004850 0x7ff590004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:18.306 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.294+0000 7ff5a659c700 1 -- 172.21.15.149:0/917480592 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5900035b0 con 0x7ff590003a70 2023-11-08T19:25:18.306 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.295+0000 7ff5a659c700 1 --2- 172.21.15.149:0/917480592 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff590003a70 0x7ff590003e90 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7ff59c00c350 tx=0x7ff590005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f065617cde34eddb server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:18.306 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.295+0000 7ff5a559a700 1 -- 172.21.15.149:0/917480592 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59c00ce50 con 0x7ff590003a70 2023-11-08T19:25:18.306 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.295+0000 7ff5a559a700 1 -- 172.21.15.149:0/917480592 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff59c005960 con 0x7ff590003a70 2023-11-08T19:25:18.307 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.295+0000 7ff5a559a700 1 -- 172.21.15.149:0/917480592 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59c005d10 con 0x7ff590003a70 2023-11-08T19:25:18.307 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.295+0000 7ff5ac8da700 1 -- 172.21.15.149:0/917480592 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff590003a70 msgr2=0x7ff590003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:18.307 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.295+0000 7ff5ac8da700 1 --2- 172.21.15.149:0/917480592 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff590003a70 0x7ff590003e90 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7ff59c00c350 tx=0x7ff590005880 comp rx=0 tx=0).stop 2023-11-08T19:25:18.307 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.295+0000 7ff5a6d9d700 1 -- 172.21.15.149:0/917480592 reap_dead start 2023-11-08T19:25:18.307 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.295+0000 7ff5ac8da700 1 -- 172.21.15.149:0/917480592 shutdown_connections 2023-11-08T19:25:18.307 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.295+0000 7ff5ac8da700 1 -- 172.21.15.149:0/917480592 >> 172.21.15.149:0/917480592 conn(0x7ff5a806f120 msgr2=0x7ff5a806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:18.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.295+0000 7ff5ac8da700 1 -- 172.21.15.149:0/917480592 shutdown_connections 2023-11-08T19:25:18.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.295+0000 7ff5ac8da700 1 -- 172.21.15.149:0/917480592 wait complete. 2023-11-08T19:25:18.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.297+0000 7ff5ac8da700 1 Processor -- start 2023-11-08T19:25:18.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.297+0000 7ff5ac8da700 1 -- start start 2023-11-08T19:25:18.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.297+0000 7ff5ac8da700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff590003a70 0x7ff5a80b0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:18.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.297+0000 7ff5ac8da700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff5a81578a0 0x7ff5a806bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:18.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.297+0000 7ff5ac8da700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5a806c1d0 0x7ff5a806c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:18.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.297+0000 7ff5ac8da700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a80c8a80 con 0x7ff5a806c1d0 2023-11-08T19:25:18.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.297+0000 7ff5ac8da700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a80c8d60 con 0x7ff5a81578a0 2023-11-08T19:25:18.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.297+0000 7ff5ac8da700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a80c9040 con 0x7ff590003a70 2023-11-08T19:25:18.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.298+0000 7ff5a6d9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5a806c1d0 0x7ff5a806c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:18.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.298+0000 7ff5a6d9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5a806c1d0 0x7ff5a806c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41044/0 (socket says 172.21.15.149:41044) 2023-11-08T19:25:18.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.298+0000 7ff5a6d9d700 1 -- 172.21.15.149:0/1749424331 learned_addr learned my addr 172.21.15.149:0/1749424331 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:18.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.298+0000 7ff5a5d9b700 1 --2- 172.21.15.149:0/1749424331 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff5a81578a0 0x7ff5a806bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:18.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.298+0000 7ff5a659c700 1 --2- 172.21.15.149:0/1749424331 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff590003a70 0x7ff5a80b0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:18.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.298+0000 7ff5a6d9d700 1 -- 172.21.15.149:0/1749424331 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff590003a70 msgr2=0x7ff5a80b0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:18.314 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.298+0000 7ff5a6d9d700 1 --2- 172.21.15.149:0/1749424331 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff590003a70 0x7ff5a80b0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:18.314 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.298+0000 7ff5a6d9d700 1 -- 172.21.15.149:0/1749424331 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff5a81578a0 msgr2=0x7ff5a806bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:18.314 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.298+0000 7ff5a6d9d700 1 --2- 172.21.15.149:0/1749424331 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff5a81578a0 0x7ff5a806bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:18.314 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.298+0000 7ff5a6d9d700 1 -- 172.21.15.149:0/1749424331 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a80c9320 con 0x7ff5a806c1d0 2023-11-08T19:25:18.314 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.298+0000 7ff5a5d9b700 1 --2- 172.21.15.149:0/1749424331 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff5a81578a0 0x7ff5a806bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:25:18.315 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.298+0000 7ff5a6d9d700 1 --2- 172.21.15.149:0/1749424331 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5a806c1d0 0x7ff5a806c680 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7ff5a80d1630 tx=0x7ff5a000f490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:18.315 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.298+0000 7ff596ffd700 1 -- 172.21.15.149:0/1749424331 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a000e040 con 0x7ff5a806c1d0 2023-11-08T19:25:18.315 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.298+0000 7ff596ffd700 1 -- 172.21.15.149:0/1749424331 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a000f040 con 0x7ff5a806c1d0 2023-11-08T19:25:18.315 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.298+0000 7ff5ac8da700 1 -- 172.21.15.149:0/1749424331 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5a80c9600 con 0x7ff5a806c1d0 2023-11-08T19:25:18.315 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.298+0000 7ff596ffd700 1 -- 172.21.15.149:0/1749424331 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a0015430 con 0x7ff5a806c1d0 2023-11-08T19:25:18.316 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.298+0000 7ff5ac8da700 1 -- 172.21.15.149:0/1749424331 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5a80c9d00 con 0x7ff5a806c1d0 2023-11-08T19:25:18.316 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.299+0000 7ff5ac8da700 1 -- 172.21.15.149:0/1749424331 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5a80cd640 con 0x7ff5a806c1d0 2023-11-08T19:25:18.316 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.300+0000 7ff596ffd700 1 -- 172.21.15.149:0/1749424331 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff5a0015590 con 0x7ff5a806c1d0 2023-11-08T19:25:18.316 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.300+0000 7ff596ffd700 1 --2- 172.21.15.149:0/1749424331 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff58806af00 0x7ff58806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:18.316 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.300+0000 7ff596ffd700 1 -- 172.21.15.149:0/1749424331 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5616+0+0 (secure 0 0 0) 0x7ff5a0089bc0 con 0x7ff5a806c1d0 2023-11-08T19:25:18.316 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.300+0000 7ff5a659c700 1 --2- 172.21.15.149:0/1749424331 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff58806af00 0x7ff58806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:18.317 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.301+0000 7ff5a659c700 1 --2- 172.21.15.149:0/1749424331 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff58806af00 0x7ff58806d3c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff59c008fd0 tx=0x7ff59c00a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:18.317 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.305+0000 7ff596ffd700 1 -- 172.21.15.149:0/1749424331 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff5a0054c50 con 0x7ff5a806c1d0 2023-11-08T19:25:18.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.495+0000 7ff5ac8da700 1 -- 172.21.15.149:0/1749424331 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7ff5a80c97f0 con 0x7ff5a806c1d0 2023-11-08T19:25:18.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.498+0000 7ff596ffd700 1 -- 172.21.15.149:0/1749424331 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v15)=0 v15) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff5a0058270 con 0x7ff5a806c1d0 2023-11-08T19:25:18.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.500+0000 7ff5ac8da700 1 -- 172.21.15.149:0/1749424331 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff58806af00 msgr2=0x7ff58806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:18.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.500+0000 7ff5ac8da700 1 --2- 172.21.15.149:0/1749424331 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff58806af00 0x7ff58806d3c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff59c008fd0 tx=0x7ff59c00a000 comp rx=0 tx=0).stop 2023-11-08T19:25:18.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.500+0000 7ff5ac8da700 1 -- 172.21.15.149:0/1749424331 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5a806c1d0 msgr2=0x7ff5a806c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:18.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.500+0000 7ff5ac8da700 1 --2- 172.21.15.149:0/1749424331 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5a806c1d0 0x7ff5a806c680 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7ff5a80d1630 tx=0x7ff5a000f490 comp rx=0 tx=0).stop 2023-11-08T19:25:18.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.500+0000 7ff5ac8da700 1 -- 172.21.15.149:0/1749424331 shutdown_connections 2023-11-08T19:25:18.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.500+0000 7ff5ac8da700 1 --2- 172.21.15.149:0/1749424331 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff58806af00 0x7ff58806d3c0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:18.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.500+0000 7ff5ac8da700 1 --2- 172.21.15.149:0/1749424331 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5a806c1d0 0x7ff5a806c680 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:18.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.500+0000 7ff5ac8da700 1 --2- 172.21.15.149:0/1749424331 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff590003a70 0x7ff5a80b0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:18.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.500+0000 7ff5ac8da700 1 --2- 172.21.15.149:0/1749424331 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff5a81578a0 0x7ff5a806bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:18.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.500+0000 7ff5ac8da700 1 -- 172.21.15.149:0/1749424331 >> 172.21.15.149:0/1749424331 conn(0x7ff5a806f120 msgr2=0x7ff5a80b5be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:18.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.500+0000 7ff5ac8da700 1 -- 172.21.15.149:0/1749424331 shutdown_connections 2023-11-08T19:25:18.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.500+0000 7ff5ac8da700 1 -- 172.21.15.149:0/1749424331 wait complete. 2023-11-08T19:25:18.515 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-08T19:25:18.515 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-08T19:25:18.565 DEBUG:teuthology.orchestra.run.smithi160:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-08T19:25:18.617 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-08T19:25:18.618 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-11-08T19:25:18.618 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:25:18.635 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=8026740k,nr_inodes=2006685,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=31,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15303 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1609048k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-11-08T19:25:18.636 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-11-08T19:25:18.637 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:25:18.655 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284272k,nr_inodes=4071068,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16330 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-08T19:25:18.656 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-11-08T19:25:18.656 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:25:18.692 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=8026740k,nr_inodes=2006685,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=31,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15303 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1609048k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-11-08T19:25:18.694 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-11-08T19:25:18.694 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:25:18.714 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284272k,nr_inodes=4071068,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16330 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-08T19:25:18.714 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-08T19:25:18.715 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:25:18.854 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.851+0000 7fcc1dfac700 1 Processor -- start 2023-11-08T19:25:18.854 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.852+0000 7fcc1dfac700 1 -- start start 2023-11-08T19:25:18.860 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.852+0000 7fcc1dfac700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fcc180ce850 0x7fcc180cca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:18.860 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.852+0000 7fcc1dfac700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc180d04f0 con 0x7fcc1815df40 2023-11-08T19:25:18.860 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.852+0000 7fcc1dfac700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc180cbeb0 con 0x7fcc180b2b60 2023-11-08T19:25:18.861 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.852+0000 7fcc1dfac700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc180d0740 con 0x7fcc180ce850 2023-11-08T19:25:18.861 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.852+0000 7fcc177fe700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fcc1815df40 0x7fcc180ce140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:43050/0 (socket says 172.21.15.149:43050) 2023-11-08T19:25:18.861 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.852+0000 7fcc177fe700 1 -- 172.21.15.149:0/1309490568 learned_addr learned my addr 172.21.15.149:0/1309490568 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:25:18.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.853+0000 7fcc17fff700 1 --2- 172.21.15.149:0/1309490568 >> v2:172.21.15.160:3300/0 conn(0x7fcc180ce850 0x7fcc180cca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:18.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.853+0000 7fcc167fc700 1 -- 172.21.15.149:0/1309490568 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1102319667 0 0) 0x7fcc180d04f0 con 0x7fcc1815df40 2023-11-08T19:25:18.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.853+0000 7fcc167fc700 1 -- 172.21.15.149:0/1309490568 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc040035b0 con 0x7fcc1815df40 2023-11-08T19:25:18.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.853+0000 7fcc167fc700 1 -- 172.21.15.149:0/1309490568 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2163490732 0 0) 0x7fcc040035b0 con 0x7fcc1815df40 2023-11-08T19:25:18.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.853+0000 7fcc17fff700 1 -- 172.21.15.149:0/1309490568 >> v1:172.21.15.160:6789/0 conn(0x7fcc180b2b60 legacy=0x7fcc180cc340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:18.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.853+0000 7fcc17fff700 1 -- 172.21.15.149:0/1309490568 >> v1:172.21.15.149:6789/0 conn(0x7fcc1815df40 legacy=0x7fcc180ce140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:18.864 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.853+0000 7fcc17fff700 1 -- 172.21.15.149:0/1309490568 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc180d0a20 con 0x7fcc180ce850 2023-11-08T19:25:18.864 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.853+0000 7fcc17fff700 1 --2- 172.21.15.149:0/1309490568 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc180ce850 0x7fcc180cca50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fcc10009d90 tx=0x7fcc1000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57aad705c36b9a42 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:18.864 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.853+0000 7fcc167fc700 1 -- 172.21.15.149:0/1309490568 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1000e070 con 0x7fcc180ce850 2023-11-08T19:25:18.864 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.853+0000 7fcc167fc700 1 -- 172.21.15.149:0/1309490568 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc10003a20 con 0x7fcc180ce850 2023-11-08T19:25:18.865 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.853+0000 7fcc167fc700 1 -- 172.21.15.149:0/1309490568 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc080017f0 con 0x7fcc180ce850 2023-11-08T19:25:18.865 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.854+0000 7fcc1dfac700 1 -- 172.21.15.149:0/1309490568 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc180ce850 msgr2=0x7fcc180cca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:18.865 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.854+0000 7fcc1dfac700 1 --2- 172.21.15.149:0/1309490568 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc180ce850 0x7fcc180cca50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fcc10009d90 tx=0x7fcc1000b330 comp rx=0 tx=0).stop 2023-11-08T19:25:18.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.854+0000 7fcc1dfac700 1 -- 172.21.15.149:0/1309490568 shutdown_connections 2023-11-08T19:25:18.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.854+0000 7fcc1dfac700 1 --2- 172.21.15.149:0/1309490568 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc180ce850 0x7fcc180cca50 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:18.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.854+0000 7fcc1dfac700 1 -- 172.21.15.149:0/1309490568 >> 172.21.15.149:0/1309490568 conn(0x7fcc180d1730 msgr2=0x7fcc180d1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:18.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.854+0000 7fcc1dfac700 1 -- 172.21.15.149:0/1309490568 shutdown_connections 2023-11-08T19:25:18.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.854+0000 7fcc1dfac700 1 -- 172.21.15.149:0/1309490568 wait complete. 2023-11-08T19:25:18.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.855+0000 7fcc1dfac700 1 Processor -- start 2023-11-08T19:25:18.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.855+0000 7fcc1dfac700 1 -- start start 2023-11-08T19:25:18.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.856+0000 7fcc1dfac700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc180b2b60 0x7fcc181f6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:18.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.856+0000 7fcc1dfac700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc180ce850 0x7fcc181f7160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:18.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.856+0000 7fcc1dfac700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcc1815df40 0x7fcc181f6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:18.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.856+0000 7fcc1dfac700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1815b700 con 0x7fcc180ce850 2023-11-08T19:25:18.869 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.856+0000 7fcc1dfac700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc18153f10 con 0x7fcc180b2b60 2023-11-08T19:25:18.869 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.856+0000 7fcc1dfac700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc181541f0 con 0x7fcc1815df40 2023-11-08T19:25:18.869 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.856+0000 7fcc16ffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc180ce850 0x7fcc181f7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:18.869 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.856+0000 7fcc16ffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc180ce850 0x7fcc181f7160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41058/0 (socket says 172.21.15.149:41058) 2023-11-08T19:25:18.869 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.856+0000 7fcc16ffd700 1 -- 172.21.15.149:0/597389378 learned_addr learned my addr 172.21.15.149:0/597389378 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:18.870 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.856+0000 7fcc177fe700 1 --2- 172.21.15.149:0/597389378 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc180b2b60 0x7fcc181f6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:18.870 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.856+0000 7fcc17fff700 1 --2- 172.21.15.149:0/597389378 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcc1815df40 0x7fcc181f6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:18.870 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.856+0000 7fcc16ffd700 1 -- 172.21.15.149:0/597389378 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcc1815df40 msgr2=0x7fcc181f6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:18.870 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.856+0000 7fcc16ffd700 1 --2- 172.21.15.149:0/597389378 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcc1815df40 0x7fcc181f6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:18.870 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.856+0000 7fcc16ffd700 1 -- 172.21.15.149:0/597389378 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc180b2b60 msgr2=0x7fcc181f6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:18.871 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.856+0000 7fcc16ffd700 1 --2- 172.21.15.149:0/597389378 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc180b2b60 0x7fcc181f6c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:18.871 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.856+0000 7fcc16ffd700 1 -- 172.21.15.149:0/597389378 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc10009a70 con 0x7fcc180ce850 2023-11-08T19:25:18.871 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.856+0000 7fcc177fe700 1 --2- 172.21.15.149:0/597389378 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc180b2b60 0x7fcc181f6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:25:18.871 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.856+0000 7fcc17fff700 1 --2- 172.21.15.149:0/597389378 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcc1815df40 0x7fcc181f6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:25:18.871 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.857+0000 7fcc16ffd700 1 --2- 172.21.15.149:0/597389378 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc180ce850 0x7fcc181f7160 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fcc0000c490 tx=0x7fcc0000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:18.872 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.857+0000 7fcc0ffff700 1 -- 172.21.15.149:0/597389378 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc000052d0 con 0x7fcc180ce850 2023-11-08T19:25:18.872 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.857+0000 7fcc0ffff700 1 -- 172.21.15.149:0/597389378 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc00005450 con 0x7fcc180ce850 2023-11-08T19:25:18.872 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.857+0000 7fcc1dfac700 1 -- 172.21.15.149:0/597389378 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc1815e4a0 con 0x7fcc180ce850 2023-11-08T19:25:18.872 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.857+0000 7fcc0ffff700 1 -- 172.21.15.149:0/597389378 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc00006aa0 con 0x7fcc180ce850 2023-11-08T19:25:18.872 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.857+0000 7fcc1dfac700 1 -- 172.21.15.149:0/597389378 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc1815b390 con 0x7fcc180ce850 2023-11-08T19:25:18.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.858+0000 7fcc1dfac700 1 -- 172.21.15.149:0/597389378 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc1815b8b0 con 0x7fcc180ce850 2023-11-08T19:25:18.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.858+0000 7fcc0ffff700 1 -- 172.21.15.149:0/597389378 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcc00003680 con 0x7fcc180ce850 2023-11-08T19:25:18.874 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.859+0000 7fcc0ffff700 1 --2- 172.21.15.149:0/597389378 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fcbf806af00 0x7fcbf806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:18.874 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.859+0000 7fcc0ffff700 1 -- 172.21.15.149:0/597389378 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fcc000888a0 con 0x7fcc180ce850 2023-11-08T19:25:18.874 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.859+0000 7fcc177fe700 1 --2- 172.21.15.149:0/597389378 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fcbf806af00 0x7fcbf806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:18.874 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.859+0000 7fcc177fe700 1 --2- 172.21.15.149:0/597389378 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fcbf806af00 0x7fcbf806d3c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fcc08001eb0 tx=0x7fcc08009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:18.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:18.864+0000 7fcc0ffff700 1 -- 172.21.15.149:0/597389378 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcc1815b8b0 con 0x7fcc180ce850 2023-11-08T19:25:19.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:19.099+0000 7fcc1dfac700 1 -- 172.21.15.149:0/597389378 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcc1815b840 con 0x7fcc180ce850 2023-11-08T19:25:19.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:19.099+0000 7fcc0ffff700 1 -- 172.21.15.149:0/597389378 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+3711 (secure 0 0 0) 0x7fcc00053930 con 0x7fcc180ce850 2023-11-08T19:25:19.137 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:25:19.137 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":27,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5455,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/2693283976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2693283976},{"type":"v1","addr":"172.21.15.160:6834","nonce":2693283976}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5458,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/3714474190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":3714474190},{"type":"v1","addr":"172.21.15.160:6835","nonce":3714474190}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5730,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/1885678824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":1885678824},{"type":"v1","addr":"172.21.15.149:6836","nonce":1885678824}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":6072,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/3142671510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3142671510},{"type":"v1","addr":"172.21.15.149:6837","nonce":3142671510}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[]} 2023-11-08T19:25:19.139 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:19.101+0000 7fcc1dfac700 1 -- 172.21.15.149:0/597389378 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fcbf806af00 msgr2=0x7fcbf806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:19.139 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:19.101+0000 7fcc1dfac700 1 --2- 172.21.15.149:0/597389378 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fcbf806af00 0x7fcbf806d3c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fcc08001eb0 tx=0x7fcc08009040 comp rx=0 tx=0).stop 2023-11-08T19:25:19.139 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:19.101+0000 7fcc1dfac700 1 -- 172.21.15.149:0/597389378 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc180ce850 msgr2=0x7fcc181f7160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:19.140 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:19.101+0000 7fcc1dfac700 1 --2- 172.21.15.149:0/597389378 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc180ce850 0x7fcc181f7160 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fcc0000c490 tx=0x7fcc0000c850 comp rx=0 tx=0).stop 2023-11-08T19:25:19.140 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:19.101+0000 7fcc1dfac700 1 -- 172.21.15.149:0/597389378 shutdown_connections 2023-11-08T19:25:19.140 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:19.101+0000 7fcc1dfac700 1 --2- 172.21.15.149:0/597389378 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fcbf806af00 0x7fcbf806d3c0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:19.140 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:19.101+0000 7fcc1dfac700 1 --2- 172.21.15.149:0/597389378 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc180b2b60 0x7fcc181f6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:19.140 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:19.101+0000 7fcc1dfac700 1 --2- 172.21.15.149:0/597389378 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcc1815df40 0x7fcc181f6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:19.141 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:19.101+0000 7fcc1dfac700 1 --2- 172.21.15.149:0/597389378 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc180ce850 0x7fcc181f7160 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:19.141 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:19.101+0000 7fcc1dfac700 1 -- 172.21.15.149:0/597389378 >> 172.21.15.149:0/597389378 conn(0x7fcc180d1730 msgr2=0x7fcc180d1b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:19.141 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:19.102+0000 7fcc1dfac700 1 -- 172.21.15.149:0/597389378 shutdown_connections 2023-11-08T19:25:19.141 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:19.102+0000 7fcc1dfac700 1 -- 172.21.15.149:0/597389378 wait complete. 2023-11-08T19:25:19.141 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 27 2023-11-08T19:25:19.142 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-08T19:25:19.142 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-08T19:25:19.143 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-08T19:25:19.143 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T19:25:19.143 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-08T19:25:19.143 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-08T19:25:19.144 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-08T19:25:19.144 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T19:25:19.144 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-08T19:25:19.144 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-08T19:25:19.145 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-08T19:25:19.145 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T19:25:19.145 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-08T19:25:19.146 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-08T19:25:19.146 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-08T19:25:19.146 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T19:25:19.155 INFO:tasks.ceph.mds.c:Stopped 2023-11-08T19:25:19.156 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-08T19:25:19.157 INFO:tasks.ceph.mds.b:Stopped 2023-11-08T19:25:19.157 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-08T19:25:19.159 INFO:tasks.ceph.mds.d:Stopped 2023-11-08T19:25:19.159 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-08T19:25:19.200 INFO:tasks.ceph.mds.c:Started 2023-11-08T19:25:19.200 DEBUG:teuthology.parallel:result is None 2023-11-08T19:25:19.202 INFO:tasks.ceph.mds.b:Started 2023-11-08T19:25:19.202 DEBUG:teuthology.parallel:result is None 2023-11-08T19:25:19.203 INFO:tasks.ceph.mds.d:Started 2023-11-08T19:25:19.204 DEBUG:teuthology.parallel:result is None 2023-11-08T19:25:19.275 INFO:tasks.ceph.mds.c.smithi149.stdout:starting mds.c at 2023-11-08T19:25:19.289 INFO:tasks.ceph.mds.b.smithi160.stdout:starting mds.b at 2023-11-08T19:25:19.290 INFO:tasks.ceph.mds.d.smithi160.stdout:starting mds.d at 2023-11-08T19:25:24.096 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-11-08T19:25:25.155 INFO:tasks.ceph.mds.a:Stopped 2023-11-08T19:25:25.156 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-08T19:25:25.159 INFO:tasks.ceph.mds.a:Started 2023-11-08T19:25:25.159 DEBUG:teuthology.parallel:result is None 2023-11-08T19:25:25.160 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-08T19:25:25.249 INFO:tasks.ceph.mds.a.smithi149.stdout:starting mds.a at 2023-11-08T19:25:25.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:25.295+0000 7f2a5bd45700 1 Processor -- start 2023-11-08T19:25:25.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:25.295+0000 7f2a5bd45700 1 -- start start 2023-11-08T19:25:25.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:25.296+0000 7f2a5bd45700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f2a5415df40 0x7f2a540ce140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:25.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:25.296+0000 7f2a5bd45700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2a540b2b60 0x7f2a540ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:25.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:25.296+0000 7f2a5bd45700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a540d04f0 con 0x7f2a540d2250 2023-11-08T19:25:25.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:25.296+0000 7f2a5bd45700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a540cbeb0 con 0x7f2a540b2b60 2023-11-08T19:25:25.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:25.296+0000 7f2a5bd45700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a540d0740 con 0x7f2a5415df40 2023-11-08T19:25:25.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:25.296+0000 7f2a592e0700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2a540b2b60 0x7f2a540ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:25.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:25.296+0000 7f2a5a2e2700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f2a540d2250 0x7f2a5406bfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:43094/0 (socket says 172.21.15.149:43094) 2023-11-08T19:25:25.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:25.296+0000 7f2a592e0700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2a540b2b60 0x7f2a540ce680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41088/0 (socket says 172.21.15.149:41088) 2023-11-08T19:25:25.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:25.296+0000 7f2a5a2e2700 1 -- 172.21.15.149:0/2228553973 learned_addr learned my addr 172.21.15.149:0/2228553973 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:25:25.302 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:25.296+0000 7f2a59ae1700 1 --2- 172.21.15.149:0/2228553973 >> v2:172.21.15.160:3300/0 conn(0x7f2a5415df40 0x7f2a540ce140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:25.302 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:25.296+0000 7f2a592e0700 1 -- 172.21.15.149:0/2228553973 >> v2:172.21.15.160:3300/0 conn(0x7f2a5415df40 msgr2=0x7f2a540ce140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:25.302 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:25.296+0000 7f2a592e0700 1 --2- 172.21.15.149:0/2228553973 >> v2:172.21.15.160:3300/0 conn(0x7f2a5415df40 0x7f2a540ce140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:25.302 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:25.296+0000 7f2a592e0700 1 -- 172.21.15.149:0/2228553973 >> v1:172.21.15.149:6789/0 conn(0x7f2a540d2250 legacy=0x7f2a5406bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:25.303 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:25.296+0000 7f2a592e0700 1 -- 172.21.15.149:0/2228553973 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a540d0a20 con 0x7f2a540b2b60 2023-11-08T19:25:25.303 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:25.296+0000 7f2a58adf700 1 -- 172.21.15.149:0/2228553973 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2541307967 0 0) 0x7f2a540d04f0 con 0x7f2a540d2250 2023-11-08T19:25:25.303 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:25.296+0000 7f2a592e0700 1 --2- 172.21.15.149:0/2228553973 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a540b2b60 0x7f2a540ce680 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f2a5408bf90 tx=0x7f2a48009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acef797a88658b7d server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:25.303 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:25.296+0000 7f2a58adf700 1 -- 172.21.15.149:0/2228553973 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a48011830 con 0x7f2a540b2b60 2023-11-08T19:25:25.303 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:25.296+0000 7f2a58adf700 1 -- 172.21.15.149:0/2228553973 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a48011990 con 0x7f2a540b2b60 2023-11-08T19:25:25.304 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:25.296+0000 7f2a58adf700 1 -- 172.21.15.149:0/2228553973 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a48011d20 con 0x7f2a540b2b60 2023-11-08T19:25:25.304 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:25.297+0000 7f2a5bd45700 1 -- 172.21.15.149:0/2228553973 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a540b2b60 msgr2=0x7f2a540ce680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:25.304 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:25.297+0000 7f2a5bd45700 1 --2- 172.21.15.149:0/2228553973 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a540b2b60 0x7f2a540ce680 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f2a5408bf90 tx=0x7f2a48009b20 comp rx=0 tx=0).stop 2023-11-08T19:25:25.304 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:25.297+0000 7f2a5bd45700 1 -- 172.21.15.149:0/2228553973 shutdown_connections 2023-11-08T19:25:25.304 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:25.297+0000 7f2a5bd45700 1 --2- 172.21.15.149:0/2228553973 >> v2:172.21.15.160:3300/0 conn(0x7f2a5415df40 0x7f2a540ce140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:25.305 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:25.297+0000 7f2a5bd45700 1 --2- 172.21.15.149:0/2228553973 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a540b2b60 0x7f2a540ce680 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:25.305 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:25.297+0000 7f2a5bd45700 1 -- 172.21.15.149:0/2228553973 >> 172.21.15.149:0/2228553973 conn(0x7f2a540d1730 msgr2=0x7f2a540d1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:25.305 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:25.297+0000 7f2a5bd45700 1 -- 172.21.15.149:0/2228553973 shutdown_connections 2023-11-08T19:25:25.305 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:25.297+0000 7f2a5bd45700 1 -- 172.21.15.149:0/2228553973 wait complete. 2023-11-08T19:25:25.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:25.298+0000 7f2a5bd45700 1 Processor -- start 2023-11-08T19:25:25.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:25.298+0000 7f2a5bd45700 1 -- start start 2023-11-08T19:25:25.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:25.299+0000 7f2a5bd45700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a540b2b60 0x7f2a5415fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:25.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:25.299+0000 7f2a5bd45700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a540d2250 0x7f2a541587f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:25.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:25.299+0000 7f2a5bd45700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2a5415df40 0x7f2a540ca770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:25.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:25.299+0000 7f2a5bd45700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5415f650 con 0x7f2a540d2250 2023-11-08T19:25:25.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:25.299+0000 7f2a5bd45700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5415e9d0 con 0x7f2a540b2b60 2023-11-08T19:25:25.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:25.299+0000 7f2a5bd45700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5415ecb0 con 0x7f2a5415df40 2023-11-08T19:25:25.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:25.299+0000 7f2a592e0700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a540d2250 0x7f2a541587f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:25.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:25.299+0000 7f2a592e0700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a540d2250 0x7f2a541587f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41096/0 (socket says 172.21.15.149:41096) 2023-11-08T19:25:25.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:25.299+0000 7f2a592e0700 1 -- 172.21.15.149:0/2618237553 learned_addr learned my addr 172.21.15.149:0/2618237553 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:25.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:25.299+0000 7f2a5a2e2700 1 --2- 172.21.15.149:0/2618237553 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2a5415df40 0x7f2a540ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:25.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:25.299+0000 7f2a59ae1700 1 --2- 172.21.15.149:0/2618237553 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a540b2b60 0x7f2a5415fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:25.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:25.299+0000 7f2a592e0700 1 -- 172.21.15.149:0/2618237553 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2a5415df40 msgr2=0x7f2a540ca770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:25.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:25.299+0000 7f2a592e0700 1 --2- 172.21.15.149:0/2618237553 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2a5415df40 0x7f2a540ca770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:25.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:25.299+0000 7f2a592e0700 1 -- 172.21.15.149:0/2618237553 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a540b2b60 msgr2=0x7f2a5415fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:25.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:25.299+0000 7f2a592e0700 1 --2- 172.21.15.149:0/2618237553 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a540b2b60 0x7f2a5415fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:25.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:25.299+0000 7f2a592e0700 1 -- 172.21.15.149:0/2618237553 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a480094a0 con 0x7f2a540d2250 2023-11-08T19:25:25.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:25.300+0000 7f2a592e0700 1 --2- 172.21.15.149:0/2618237553 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a540d2250 0x7f2a541587f0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f2a480090b0 tx=0x7f2a48004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:25.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:25.300+0000 7f2a527fc700 1 -- 172.21.15.149:0/2618237553 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a480036a0 con 0x7f2a540d2250 2023-11-08T19:25:25.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:25.300+0000 7f2a527fc700 1 -- 172.21.15.149:0/2618237553 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a4801f070 con 0x7f2a540d2250 2023-11-08T19:25:25.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:25.300+0000 7f2a5bd45700 1 -- 172.21.15.149:0/2618237553 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a5415e4a0 con 0x7f2a540d2250 2023-11-08T19:25:25.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:25.300+0000 7f2a527fc700 1 -- 172.21.15.149:0/2618237553 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a48003a20 con 0x7f2a540d2250 2023-11-08T19:25:25.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:25.300+0000 7f2a5bd45700 1 -- 172.21.15.149:0/2618237553 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a5415f270 con 0x7f2a540d2250 2023-11-08T19:25:25.314 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:25.301+0000 7f2a5bd45700 1 -- 172.21.15.149:0/2618237553 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a54067560 con 0x7f2a540d2250 2023-11-08T19:25:25.314 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:25.301+0000 7f2a527fc700 1 -- 172.21.15.149:0/2618237553 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2a48003b80 con 0x7f2a540d2250 2023-11-08T19:25:25.314 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:25.302+0000 7f2a527fc700 1 --2- 172.21.15.149:0/2618237553 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2a4006af00 0x7f2a4006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:25.314 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:25.302+0000 7f2a527fc700 1 -- 172.21.15.149:0/2618237553 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f2a48021070 con 0x7f2a540d2250 2023-11-08T19:25:25.315 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:25.302+0000 7f2a59ae1700 1 --2- 172.21.15.149:0/2618237553 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2a4006af00 0x7f2a4006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:25.315 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:25.302+0000 7f2a59ae1700 1 --2- 172.21.15.149:0/2618237553 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2a4006af00 0x7f2a4006d3c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c006fd0 tx=0x7f2a4c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:25.315 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:25.307+0000 7f2a527fc700 1 -- 172.21.15.149:0/2618237553 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2a48055e80 con 0x7f2a540d2250 2023-11-08T19:25:25.512 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:25.510+0000 7f2a5bd45700 1 -- 172.21.15.149:0/2618237553 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f2a5415f790 con 0x7f2a540d2250 2023-11-08T19:25:27.173 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.171+0000 7f2a527fc700 1 -- 172.21.15.149:0/2618237553 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v63) v1 ==== 97+0+0 (secure 0 0 0) 0x7f2a5415f790 con 0x7f2a540d2250 2023-11-08T19:25:27.176 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.174+0000 7f2a5bd45700 1 -- 172.21.15.149:0/2618237553 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2a4006af00 msgr2=0x7f2a4006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:27.177 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.174+0000 7f2a5bd45700 1 --2- 172.21.15.149:0/2618237553 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2a4006af00 0x7f2a4006d3c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c006fd0 tx=0x7f2a4c008040 comp rx=0 tx=0).stop 2023-11-08T19:25:27.177 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.174+0000 7f2a5bd45700 1 -- 172.21.15.149:0/2618237553 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a540d2250 msgr2=0x7f2a541587f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:27.177 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.174+0000 7f2a5bd45700 1 --2- 172.21.15.149:0/2618237553 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a540d2250 0x7f2a541587f0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f2a480090b0 tx=0x7f2a48004750 comp rx=0 tx=0).stop 2023-11-08T19:25:27.177 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.174+0000 7f2a5bd45700 1 -- 172.21.15.149:0/2618237553 shutdown_connections 2023-11-08T19:25:27.177 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.174+0000 7f2a5bd45700 1 --2- 172.21.15.149:0/2618237553 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2a4006af00 0x7f2a4006d3c0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:27.178 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.174+0000 7f2a5bd45700 1 --2- 172.21.15.149:0/2618237553 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a540b2b60 0x7f2a5415fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:27.178 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.174+0000 7f2a5bd45700 1 --2- 172.21.15.149:0/2618237553 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2a5415df40 0x7f2a540ca770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:27.178 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.174+0000 7f2a5bd45700 1 --2- 172.21.15.149:0/2618237553 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a540d2250 0x7f2a541587f0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:27.178 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.174+0000 7f2a5bd45700 1 -- 172.21.15.149:0/2618237553 >> 172.21.15.149:0/2618237553 conn(0x7f2a540d1730 msgr2=0x7f2a541597b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:27.179 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.174+0000 7f2a5bd45700 1 -- 172.21.15.149:0/2618237553 shutdown_connections 2023-11-08T19:25:27.179 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.174+0000 7f2a5bd45700 1 -- 172.21.15.149:0/2618237553 wait complete. 2023-11-08T19:25:27.180 INFO:teuthology.orchestra.run.smithi149.stderr: removed all blocklist entries 2023-11-08T19:25:27.192 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-08T19:25:27.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.316+0000 7fcf4112f700 1 Processor -- start 2023-11-08T19:25:27.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.316+0000 7fcf4112f700 1 -- start start 2023-11-08T19:25:27.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.317+0000 7fcf4112f700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fcf3c15df40 0x7fcf3c0ce140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:27.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.317+0000 7fcf4112f700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fcf3c0b2b60 0x7fcf3c0ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:27.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.317+0000 7fcf4112f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcf3c0d2250 0x7fcf3c06bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:27.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.317+0000 7fcf4112f700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf3c0d04f0 con 0x7fcf3c15df40 2023-11-08T19:25:27.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.317+0000 7fcf4112f700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf3c0cbeb0 con 0x7fcf3c0b2b60 2023-11-08T19:25:27.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.317+0000 7fcf4112f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3c0d0740 con 0x7fcf3c0d2250 2023-11-08T19:25:27.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.317+0000 7fcf3ad9d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fcf3c15df40 0x7fcf3c0ce140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:27.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.317+0000 7fcf3ad9d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fcf3c15df40 0x7fcf3c0ce140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41104/0 (socket says 172.21.15.149:41104) 2023-11-08T19:25:27.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.317+0000 7fcf3ad9d700 1 -- 172.21.15.149:0/3712604780 learned_addr learned my addr 172.21.15.149:0/3712604780 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:27.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.317+0000 7fcf3b59e700 1 --2- 172.21.15.149:0/3712604780 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcf3c0d2250 0x7fcf3c06bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:27.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.317+0000 7fcf3a59c700 1 --2- 172.21.15.149:0/3712604780 >> v2:172.21.15.160:3300/0 conn(0x7fcf3c0b2b60 0x7fcf3c0ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:27.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.318+0000 7fcf3ad9d700 1 -- 172.21.15.149:0/3712604780 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcf3c0d2250 msgr2=0x7fcf3c06bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:27.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.318+0000 7fcf3ad9d700 1 --2- 172.21.15.149:0/3712604780 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcf3c0d2250 0x7fcf3c06bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:27.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.318+0000 7fcf3ad9d700 1 -- 172.21.15.149:0/3712604780 >> v2:172.21.15.160:3300/0 conn(0x7fcf3c0b2b60 msgr2=0x7fcf3c0ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:27.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.318+0000 7fcf3ad9d700 1 --2- 172.21.15.149:0/3712604780 >> v2:172.21.15.160:3300/0 conn(0x7fcf3c0b2b60 0x7fcf3c0ce680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:27.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.318+0000 7fcf3ad9d700 1 -- 172.21.15.149:0/3712604780 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf3c0d0a20 con 0x7fcf3c15df40 2023-11-08T19:25:27.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.318+0000 7fcf3a59c700 1 --2- 172.21.15.149:0/3712604780 >> v2:172.21.15.160:3300/0 conn(0x7fcf3c0b2b60 0x7fcf3c0ce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:25:27.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.318+0000 7fcf3ad9d700 1 --2- 172.21.15.149:0/3712604780 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf3c15df40 0x7fcf3c0ce140 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c08bcf0 tx=0x7fcf30009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a0671bf521342cc server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:27.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.318+0000 7fcf39d9b700 1 -- 172.21.15.149:0/3712604780 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf30005e30 con 0x7fcf3c15df40 2023-11-08T19:25:27.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.318+0000 7fcf39d9b700 1 -- 172.21.15.149:0/3712604780 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf30004030 con 0x7fcf3c15df40 2023-11-08T19:25:27.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.318+0000 7fcf39d9b700 1 -- 172.21.15.149:0/3712604780 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf300043e0 con 0x7fcf3c15df40 2023-11-08T19:25:27.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.318+0000 7fcf4112f700 1 -- 172.21.15.149:0/3712604780 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf3c15df40 msgr2=0x7fcf3c0ce140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:27.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.318+0000 7fcf4112f700 1 --2- 172.21.15.149:0/3712604780 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf3c15df40 0x7fcf3c0ce140 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c08bcf0 tx=0x7fcf30009bd0 comp rx=0 tx=0).stop 2023-11-08T19:25:27.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.318+0000 7fcf4112f700 1 -- 172.21.15.149:0/3712604780 shutdown_connections 2023-11-08T19:25:27.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.318+0000 7fcf4112f700 1 --2- 172.21.15.149:0/3712604780 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcf3c0d2250 0x7fcf3c06bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:27.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.318+0000 7fcf4112f700 1 --2- 172.21.15.149:0/3712604780 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf3c15df40 0x7fcf3c0ce140 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:27.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.318+0000 7fcf4112f700 1 --2- 172.21.15.149:0/3712604780 >> v2:172.21.15.160:3300/0 conn(0x7fcf3c0b2b60 0x7fcf3c0ce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:27.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.318+0000 7fcf4112f700 1 -- 172.21.15.149:0/3712604780 >> 172.21.15.149:0/3712604780 conn(0x7fcf3c0d1730 msgr2=0x7fcf3c0d1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:27.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.319+0000 7fcf4112f700 1 -- 172.21.15.149:0/3712604780 shutdown_connections 2023-11-08T19:25:27.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.319+0000 7fcf4112f700 1 -- 172.21.15.149:0/3712604780 wait complete. 2023-11-08T19:25:27.330 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.320+0000 7fcf4112f700 1 Processor -- start 2023-11-08T19:25:27.330 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.320+0000 7fcf4112f700 1 -- start start 2023-11-08T19:25:27.331 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.321+0000 7fcf4112f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf3c0b2b60 0x7fcf3c1f7720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:27.331 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.321+0000 7fcf4112f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcf3c0d2250 0x7fcf3c1e7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:27.331 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.321+0000 7fcf4112f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcf3c15df40 0x7fcf3c0c5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:27.331 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.321+0000 7fcf4112f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3c1e78d0 con 0x7fcf3c0b2b60 2023-11-08T19:25:27.331 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.321+0000 7fcf4112f700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3c148540 con 0x7fcf3c15df40 2023-11-08T19:25:27.332 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.321+0000 7fcf4112f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3c1f7c60 con 0x7fcf3c0d2250 2023-11-08T19:25:27.332 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.321+0000 7fcf3ad9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf3c0b2b60 0x7fcf3c1f7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:27.332 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.321+0000 7fcf3ad9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf3c0b2b60 0x7fcf3c1f7720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41110/0 (socket says 172.21.15.149:41110) 2023-11-08T19:25:27.332 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.321+0000 7fcf3ad9d700 1 -- 172.21.15.149:0/3571398261 learned_addr learned my addr 172.21.15.149:0/3571398261 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:27.332 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.321+0000 7fcf3a59c700 1 --2- 172.21.15.149:0/3571398261 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcf3c0d2250 0x7fcf3c1e7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:27.333 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.321+0000 7fcf3b59e700 1 --2- 172.21.15.149:0/3571398261 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcf3c15df40 0x7fcf3c0c5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:27.333 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.321+0000 7fcf3ad9d700 1 -- 172.21.15.149:0/3571398261 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcf3c0d2250 msgr2=0x7fcf3c1e7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:27.333 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.321+0000 7fcf3ad9d700 1 --2- 172.21.15.149:0/3571398261 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcf3c0d2250 0x7fcf3c1e7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:27.333 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.321+0000 7fcf3ad9d700 1 -- 172.21.15.149:0/3571398261 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcf3c15df40 msgr2=0x7fcf3c0c5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:27.333 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.321+0000 7fcf3ad9d700 1 --2- 172.21.15.149:0/3571398261 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcf3c15df40 0x7fcf3c0c5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:27.334 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.321+0000 7fcf3ad9d700 1 -- 172.21.15.149:0/3571398261 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf30009500 con 0x7fcf3c0b2b60 2023-11-08T19:25:27.334 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.321+0000 7fcf3ad9d700 1 --2- 172.21.15.149:0/3571398261 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf3c0b2b60 0x7fcf3c1f7720 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fcf30009c10 tx=0x7fcf30004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:27.334 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.321+0000 7fcf237fe700 1 -- 172.21.15.149:0/3571398261 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf30003d90 con 0x7fcf3c0b2b60 2023-11-08T19:25:27.334 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.321+0000 7fcf237fe700 1 -- 172.21.15.149:0/3571398261 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf3001c420 con 0x7fcf3c0b2b60 2023-11-08T19:25:27.334 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.321+0000 7fcf4112f700 1 -- 172.21.15.149:0/3571398261 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf3c15e4a0 con 0x7fcf3c0b2b60 2023-11-08T19:25:27.334 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.321+0000 7fcf237fe700 1 -- 172.21.15.149:0/3571398261 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3001c7b0 con 0x7fcf3c0b2b60 2023-11-08T19:25:27.335 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.321+0000 7fcf4112f700 1 -- 172.21.15.149:0/3571398261 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf3c1e7210 con 0x7fcf3c0b2b60 2023-11-08T19:25:27.335 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.322+0000 7fcf4112f700 1 -- 172.21.15.149:0/3571398261 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf3c1e7b40 con 0x7fcf3c0b2b60 2023-11-08T19:25:27.335 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.323+0000 7fcf237fe700 1 -- 172.21.15.149:0/3571398261 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcf3001c910 con 0x7fcf3c0b2b60 2023-11-08T19:25:27.335 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.323+0000 7fcf237fe700 1 --2- 172.21.15.149:0/3571398261 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fcf2806af00 0x7fcf2806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:27.335 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.323+0000 7fcf237fe700 1 -- 172.21.15.149:0/3571398261 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fcf3008a5a0 con 0x7fcf3c0b2b60 2023-11-08T19:25:27.336 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.323+0000 7fcf3a59c700 1 --2- 172.21.15.149:0/3571398261 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fcf2806af00 0x7fcf2806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:27.336 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.324+0000 7fcf3a59c700 1 --2- 172.21.15.149:0/3571398261 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fcf2806af00 0x7fcf2806d3c0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c0b6ef0 tx=0x7fcf2c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:27.336 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.328+0000 7fcf237fe700 1 -- 172.21.15.149:0/3571398261 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcf30055790 con 0x7fcf3c0b2b60 2023-11-08T19:25:27.596 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.594+0000 7fcf4112f700 1 -- 172.21.15.149:0/3571398261 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fcf3c0745f0 con 0x7fcf3c0b2b60 2023-11-08T19:25:27.597 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.595+0000 7fcf237fe700 1 -- 172.21.15.149:0/3571398261 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fcf30058db0 con 0x7fcf3c0b2b60 2023-11-08T19:25:27.597 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:25:27.597 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2023-11-08T19:25:27.598 INFO:teuthology.orchestra.run.smithi149.stdout: "auth_dump": [ 2023-11-08T19:25:27.598 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:25:27.598 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "mds.a", 2023-11-08T19:25:27.598 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDi30tlcD8lHxAAxmvMr1hdJWLyJ0wOQhILow==", 2023-11-08T19:25:27.599 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:25:27.599 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow", 2023-11-08T19:25:27.599 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow *", 2023-11-08T19:25:27.599 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow *", 2023-11-08T19:25:27.599 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:25:27.600 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:25:27.600 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:25:27.600 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:25:27.600 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "mds.b", 2023-11-08T19:25:27.600 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDi30tl0d56KxAA42ebu7JWPHSW2Y+aUT9G8Q==", 2023-11-08T19:25:27.601 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:25:27.601 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow", 2023-11-08T19:25:27.601 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow *", 2023-11-08T19:25:27.601 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow *", 2023-11-08T19:25:27.601 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:25:27.602 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:25:27.602 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:25:27.602 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:25:27.602 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "mds.c", 2023-11-08T19:25:27.602 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDi30tl+SliJhAAznNm6dtyajBE0T8WKqdhhw==", 2023-11-08T19:25:27.603 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:25:27.603 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow", 2023-11-08T19:25:27.603 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow *", 2023-11-08T19:25:27.603 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow *", 2023-11-08T19:25:27.603 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:25:27.603 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:25:27.604 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:25:27.604 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:25:27.604 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "mds.d", 2023-11-08T19:25:27.604 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDi30tl9sLWMhAACaIzwVjIgVky9P6tAK9/rw==", 2023-11-08T19:25:27.604 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:25:27.605 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow", 2023-11-08T19:25:27.605 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow *", 2023-11-08T19:25:27.605 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow *", 2023-11-08T19:25:27.605 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:25:27.605 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:25:27.606 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:25:27.606 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:25:27.606 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "osd.0", 2023-11-08T19:25:27.606 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDm30tl1SLuEBAA8gYyfPfXV+rd7sXTr5NytA==", 2023-11-08T19:25:27.606 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:25:27.607 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow profile osd", 2023-11-08T19:25:27.607 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile osd", 2023-11-08T19:25:27.607 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:25:27.607 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:25:27.607 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:25:27.608 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:25:27.608 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "osd.1", 2023-11-08T19:25:27.608 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDp30tllvSCEBAAgyXiQm+ld9zVjv2Uo2UilA==", 2023-11-08T19:25:27.608 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:25:27.608 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow profile osd", 2023-11-08T19:25:27.608 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile osd", 2023-11-08T19:25:27.609 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:25:27.609 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:25:27.609 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:25:27.609 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:25:27.609 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "osd.2", 2023-11-08T19:25:27.610 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDs30tlGvZ9DxAAzOPbDXlbk+oxHvXhNfPnNQ==", 2023-11-08T19:25:27.610 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:25:27.610 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow profile osd", 2023-11-08T19:25:27.610 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile osd", 2023-11-08T19:25:27.610 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:25:27.611 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:25:27.611 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:25:27.611 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:25:27.611 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "osd.3", 2023-11-08T19:25:27.611 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDv30tlg0i3DhAAKEy9WQ+VBcJMuKALuYVTEg==", 2023-11-08T19:25:27.612 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:25:27.612 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow profile osd", 2023-11-08T19:25:27.612 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile osd", 2023-11-08T19:25:27.612 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:25:27.612 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:25:27.612 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:25:27.613 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:25:27.613 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "osd.4", 2023-11-08T19:25:27.613 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQD130tlrd3gFRAA0IM+0Dr48SgjXRHcCzypfg==", 2023-11-08T19:25:27.613 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:25:27.613 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow profile osd", 2023-11-08T19:25:27.614 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile osd", 2023-11-08T19:25:27.614 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:25:27.614 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:25:27.614 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:25:27.614 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:25:27.615 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "osd.5", 2023-11-08T19:25:27.615 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQD430tlCMCRFRAAJwP6E9TRRNneQzL7TVU6jg==", 2023-11-08T19:25:27.615 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:25:27.615 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow profile osd", 2023-11-08T19:25:27.615 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile osd", 2023-11-08T19:25:27.616 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:25:27.616 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:25:27.616 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:25:27.616 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:25:27.616 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "osd.6", 2023-11-08T19:25:27.617 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQD730tl176/FBAADjNAIKgdn3bIRlN725KW7g==", 2023-11-08T19:25:27.617 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:25:27.617 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow profile osd", 2023-11-08T19:25:27.617 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile osd", 2023-11-08T19:25:27.617 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:25:27.617 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:25:27.618 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:25:27.618 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:25:27.618 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "osd.7", 2023-11-08T19:25:27.618 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQD+30tl6CCxFBAAcProM9OqTGE6LtReNxvljA==", 2023-11-08T19:25:27.618 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:25:27.619 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow profile osd", 2023-11-08T19:25:27.619 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile osd", 2023-11-08T19:25:27.619 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:25:27.619 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:25:27.619 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:25:27.620 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:25:27.620 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "client.0", 2023-11-08T19:25:27.620 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDi30tlQEEsNxAAiPozrOREh+IJXoj7ZkhvLg==", 2023-11-08T19:25:27.620 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:25:27.620 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow", 2023-11-08T19:25:27.621 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow r", 2023-11-08T19:25:27.621 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-08T19:25:27.621 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:25:27.621 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:25:27.621 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:25:27.622 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "client.1", 2023-11-08T19:25:27.622 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDj30tluO08AhAAKiNHfc6ETU6HU+0PSkRTdg==", 2023-11-08T19:25:27.622 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:25:27.622 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow", 2023-11-08T19:25:27.622 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow r", 2023-11-08T19:25:27.622 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow rw", 2023-11-08T19:25:27.623 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow rwx" 2023-11-08T19:25:27.623 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:25:27.623 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:25:27.623 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:25:27.623 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "client.2", 2023-11-08T19:25:27.624 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDi30tlZfZ+OhAAak0bEZA4XzCWwYINh0SvGQ==", 2023-11-08T19:25:27.624 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:25:27.624 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow", 2023-11-08T19:25:27.624 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow r", 2023-11-08T19:25:27.624 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow rw", 2023-11-08T19:25:27.625 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow rwx" 2023-11-08T19:25:27.625 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:25:27.625 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:25:27.625 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:25:27.625 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "client.3", 2023-11-08T19:25:27.626 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDj30tlLMAICBAAApxzbDjmCxzR32Puyeov6A==", 2023-11-08T19:25:27.626 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:25:27.626 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow", 2023-11-08T19:25:27.626 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow r", 2023-11-08T19:25:27.626 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow rw", 2023-11-08T19:25:27.627 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow rwx" 2023-11-08T19:25:27.627 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:25:27.627 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:25:27.627 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:25:27.627 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "client.admin", 2023-11-08T19:25:27.628 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDi30tltpwRARAAZZQDTm7CIC4J4HH6G378+w==", 2023-11-08T19:25:27.628 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:25:27.628 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow *", 2023-11-08T19:25:27.628 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow *", 2023-11-08T19:25:27.628 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow *", 2023-11-08T19:25:27.628 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:25:27.629 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:25:27.629 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:25:27.629 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:25:27.629 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "mgr.x", 2023-11-08T19:25:27.629 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDi30tluyy2GxAATC2v0iOLVbRrea6w+2Cy8g==", 2023-11-08T19:25:27.630 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:25:27.630 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow *", 2023-11-08T19:25:27.630 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile mgr", 2023-11-08T19:25:27.630 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:25:27.630 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:25:27.631 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:25:27.631 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:25:27.631 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "mgr.y", 2023-11-08T19:25:27.631 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDi30tlxwfmFhAAfauMRZmdBm6TQXw07oVQJw==", 2023-11-08T19:25:27.631 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:25:27.632 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow *", 2023-11-08T19:25:27.632 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile mgr", 2023-11-08T19:25:27.632 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:25:27.632 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:25:27.632 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:25:27.632 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2023-11-08T19:25:27.633 INFO:teuthology.orchestra.run.smithi149.stdout:} 2023-11-08T19:25:27.634 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.597+0000 7fcf4112f700 1 -- 172.21.15.149:0/3571398261 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fcf2806af00 msgr2=0x7fcf2806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:27.634 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.597+0000 7fcf4112f700 1 --2- 172.21.15.149:0/3571398261 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fcf2806af00 0x7fcf2806d3c0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c0b6ef0 tx=0x7fcf2c008040 comp rx=0 tx=0).stop 2023-11-08T19:25:27.635 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.597+0000 7fcf4112f700 1 -- 172.21.15.149:0/3571398261 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf3c0b2b60 msgr2=0x7fcf3c1f7720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:27.635 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.597+0000 7fcf4112f700 1 --2- 172.21.15.149:0/3571398261 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf3c0b2b60 0x7fcf3c1f7720 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fcf30009c10 tx=0x7fcf30004750 comp rx=0 tx=0).stop 2023-11-08T19:25:27.635 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.597+0000 7fcf4112f700 1 -- 172.21.15.149:0/3571398261 shutdown_connections 2023-11-08T19:25:27.635 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.597+0000 7fcf4112f700 1 --2- 172.21.15.149:0/3571398261 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fcf2806af00 0x7fcf2806d3c0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:27.636 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.597+0000 7fcf4112f700 1 --2- 172.21.15.149:0/3571398261 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcf3c15df40 0x7fcf3c0c5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:27.636 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.597+0000 7fcf4112f700 1 --2- 172.21.15.149:0/3571398261 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf3c0b2b60 0x7fcf3c1f7720 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:27.636 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.597+0000 7fcf4112f700 1 --2- 172.21.15.149:0/3571398261 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcf3c0d2250 0x7fcf3c1e7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:27.636 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.597+0000 7fcf4112f700 1 -- 172.21.15.149:0/3571398261 >> 172.21.15.149:0/3571398261 conn(0x7fcf3c0d1730 msgr2=0x7fcf3c0cd930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:27.636 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.597+0000 7fcf4112f700 1 -- 172.21.15.149:0/3571398261 shutdown_connections 2023-11-08T19:25:27.636 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.597+0000 7fcf4112f700 1 -- 172.21.15.149:0/3571398261 wait complete. 2023-11-08T19:25:27.637 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:25:27.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.756+0000 7f6230cb5700 1 Processor -- start 2023-11-08T19:25:27.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.756+0000 7f6230cb5700 1 -- start start 2023-11-08T19:25:27.760 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.757+0000 7f6230cb5700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f622c0cc140 0x7f622c0cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:27.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.757+0000 7f6230cb5700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f622c0b2cd0 0x7f622c15d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:27.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.757+0000 7f6230cb5700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f622c0cce50 con 0x7f622c0b2850 2023-11-08T19:25:27.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.757+0000 7f6230cb5700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f622c0b2430 con 0x7f622c0cc140 2023-11-08T19:25:27.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.757+0000 7f6230cb5700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f622c0cc520 con 0x7f622c0b2cd0 2023-11-08T19:25:27.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.757+0000 7f622ad9d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f622c0b2cd0 0x7f622c15d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:27.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.757+0000 7f622a59c700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f622c0cc140 0x7f622c0cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:27.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.757+0000 7f6229d9b700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f622c0b2850 0x7f622c0cabf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.149:54786/0 (socket says 172.21.15.149:54786) 2023-11-08T19:25:27.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.757+0000 7f622ad9d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f622c0b2cd0 0x7f622c15d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.149:33174/0 (socket says 172.21.15.149:33174) 2023-11-08T19:25:27.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.757+0000 7f6229d9b700 1 -- 172.21.15.149:0/85480002 learned_addr learned my addr 172.21.15.149:0/85480002 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:25:27.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.757+0000 7f622a59c700 1 -- 172.21.15.149:0/85480002 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f622c0b2cd0 msgr2=0x7f622c15d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:27.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.757+0000 7f622a59c700 1 --2- 172.21.15.149:0/85480002 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f622c0b2cd0 0x7f622c15d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:27.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.757+0000 7f622a59c700 1 -- 172.21.15.149:0/85480002 >> v1:172.21.15.160:6789/0 conn(0x7f622c0b2850 legacy=0x7f622c0cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:27.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.757+0000 7f622a59c700 1 -- 172.21.15.149:0/85480002 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f622c0b17b0 con 0x7f622c0cc140 2023-11-08T19:25:27.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.757+0000 7f622959a700 1 -- 172.21.15.149:0/85480002 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3416724366 0 0) 0x7f622c0cce50 con 0x7f622c0b2850 2023-11-08T19:25:27.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.757+0000 7f622ad9d700 1 --2- 172.21.15.149:0/85480002 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f622c0b2cd0 0x7f622c15d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:25:27.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.758+0000 7f622a59c700 1 --2- 172.21.15.149:0/85480002 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f622c0cc140 0x7f622c0cc910 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f621c009820 tx=0x7f621c009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af56329acad2b2d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:27.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.758+0000 7f622959a700 1 -- 172.21.15.149:0/85480002 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621c005e30 con 0x7f622c0cc140 2023-11-08T19:25:27.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.758+0000 7f622959a700 1 -- 172.21.15.149:0/85480002 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f621c006030 con 0x7f622c0cc140 2023-11-08T19:25:27.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.758+0000 7f622959a700 1 -- 172.21.15.149:0/85480002 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621c0063c0 con 0x7f622c0cc140 2023-11-08T19:25:27.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.758+0000 7f6230cb5700 1 -- 172.21.15.149:0/85480002 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f622c0cc140 msgr2=0x7f622c0cc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:27.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.758+0000 7f6230cb5700 1 --2- 172.21.15.149:0/85480002 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f622c0cc140 0x7f622c0cc910 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f621c009820 tx=0x7f621c009b30 comp rx=0 tx=0).stop 2023-11-08T19:25:27.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.758+0000 7f6230cb5700 1 -- 172.21.15.149:0/85480002 shutdown_connections 2023-11-08T19:25:27.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.758+0000 7f6230cb5700 1 --2- 172.21.15.149:0/85480002 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f622c0b2cd0 0x7f622c15d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:27.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.758+0000 7f6230cb5700 1 --2- 172.21.15.149:0/85480002 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f622c0cc140 0x7f622c0cc910 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:27.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.758+0000 7f6230cb5700 1 -- 172.21.15.149:0/85480002 >> 172.21.15.149:0/85480002 conn(0x7f622c099a40 msgr2=0x7f622c0d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:27.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.758+0000 7f6230cb5700 1 -- 172.21.15.149:0/85480002 shutdown_connections 2023-11-08T19:25:27.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.758+0000 7f6230cb5700 1 -- 172.21.15.149:0/85480002 wait complete. 2023-11-08T19:25:27.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.760+0000 7f6230cb5700 1 Processor -- start 2023-11-08T19:25:27.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.760+0000 7f6230cb5700 1 -- start start 2023-11-08T19:25:27.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.760+0000 7f6230cb5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f622c0b2850 0x7f622c0b00b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:27.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.760+0000 7f6230cb5700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f622c0b2cd0 0x7f622c09dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:27.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.760+0000 7f6230cb5700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f622c0cc140 0x7f622c15d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:27.770 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.760+0000 7f6230cb5700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f622c09e150 con 0x7f622c0b2850 2023-11-08T19:25:27.770 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.760+0000 7f6230cb5700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f622c0b4060 con 0x7f622c0cc140 2023-11-08T19:25:27.770 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.760+0000 7f6230cb5700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f622c0b4340 con 0x7f622c0b2cd0 2023-11-08T19:25:27.770 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.760+0000 7f622a59c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f622c0b2850 0x7f622c0b00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:27.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.761+0000 7f622a59c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f622c0b2850 0x7f622c0b00b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41124/0 (socket says 172.21.15.149:41124) 2023-11-08T19:25:27.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.761+0000 7f622a59c700 1 -- 172.21.15.149:0/4168762784 learned_addr learned my addr 172.21.15.149:0/4168762784 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:27.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.761+0000 7f6229d9b700 1 --2- 172.21.15.149:0/4168762784 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f622c0b2cd0 0x7f622c09dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:27.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.761+0000 7f622ad9d700 1 --2- 172.21.15.149:0/4168762784 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f622c0cc140 0x7f622c15d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:27.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.761+0000 7f622a59c700 1 -- 172.21.15.149:0/4168762784 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f622c0b2cd0 msgr2=0x7f622c09dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:27.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.761+0000 7f622a59c700 1 --2- 172.21.15.149:0/4168762784 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f622c0b2cd0 0x7f622c09dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:27.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.761+0000 7f622a59c700 1 -- 172.21.15.149:0/4168762784 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f622c0cc140 msgr2=0x7f622c15d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:27.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.761+0000 7f622a59c700 1 --2- 172.21.15.149:0/4168762784 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f622c0cc140 0x7f622c15d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:27.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.761+0000 7f622a59c700 1 -- 172.21.15.149:0/4168762784 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6224009a70 con 0x7f622c0b2850 2023-11-08T19:25:27.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.761+0000 7f622a59c700 1 --2- 172.21.15.149:0/4168762784 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f622c0b2850 0x7f622c0b00b0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f621c009b70 tx=0x7f621c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:27.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.761+0000 7f621affd700 1 -- 172.21.15.149:0/4168762784 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621c003ab0 con 0x7f622c0b2850 2023-11-08T19:25:27.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.761+0000 7f621affd700 1 -- 172.21.15.149:0/4168762784 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f621c003c30 con 0x7f622c0b2850 2023-11-08T19:25:27.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.761+0000 7f6230cb5700 1 -- 172.21.15.149:0/4168762784 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f621c009430 con 0x7f622c0b2850 2023-11-08T19:25:27.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.761+0000 7f621affd700 1 -- 172.21.15.149:0/4168762784 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621c004560 con 0x7f622c0b2850 2023-11-08T19:25:27.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.761+0000 7f6230cb5700 1 -- 172.21.15.149:0/4168762784 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f622c0b4900 con 0x7f622c0b2850 2023-11-08T19:25:27.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.762+0000 7f6230cb5700 1 -- 172.21.15.149:0/4168762784 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f622c0745f0 con 0x7f622c0b2850 2023-11-08T19:25:27.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.763+0000 7f621affd700 1 -- 172.21.15.149:0/4168762784 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f621c022070 con 0x7f622c0b2850 2023-11-08T19:25:27.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.763+0000 7f621affd700 1 --2- 172.21.15.149:0/4168762784 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f620c06af00 0x7f620c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:27.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.763+0000 7f621affd700 1 -- 172.21.15.149:0/4168762784 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f621c08aba0 con 0x7f622c0b2850 2023-11-08T19:25:27.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.763+0000 7f6229d9b700 1 --2- 172.21.15.149:0/4168762784 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f620c06af00 0x7f620c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:27.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.763+0000 7f6229d9b700 1 --2- 172.21.15.149:0/4168762784 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f620c06af00 0x7f620c06d3c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f622c1f69a0 tx=0x7f6220007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:27.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.768+0000 7f621affd700 1 -- 172.21.15.149:0/4168762784 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f621c055d90 con 0x7f622c0b2850 2023-11-08T19:25:27.960 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.958+0000 7f6230cb5700 1 -- 172.21.15.149:0/4168762784 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f622c0cc910 con 0x7f622c0b2850 2023-11-08T19:25:27.961 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.959+0000 7f621affd700 1 -- 172.21.15.149:0/4168762784 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+14851 (secure 0 0 0) 0x7f621c0593b0 con 0x7f622c0b2850 2023-11-08T19:25:27.962 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:25:27.962 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":63,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:25:27.171300+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-08T19:24:29.516185+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:25:27.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.962+0000 7f6230cb5700 1 -- 172.21.15.149:0/4168762784 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f620c06af00 msgr2=0x7f620c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:27.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.962+0000 7f6230cb5700 1 --2- 172.21.15.149:0/4168762784 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f620c06af00 0x7f620c06d3c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f622c1f69a0 tx=0x7f6220007de0 comp rx=0 tx=0).stop 2023-11-08T19:25:27.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.962+0000 7f6230cb5700 1 -- 172.21.15.149:0/4168762784 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f622c0b2850 msgr2=0x7f622c0b00b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:27.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.962+0000 7f6230cb5700 1 --2- 172.21.15.149:0/4168762784 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f622c0b2850 0x7f622c0b00b0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f621c009b70 tx=0x7f621c004750 comp rx=0 tx=0).stop 2023-11-08T19:25:27.965 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.962+0000 7f6230cb5700 1 -- 172.21.15.149:0/4168762784 shutdown_connections 2023-11-08T19:25:27.965 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.962+0000 7f6230cb5700 1 --2- 172.21.15.149:0/4168762784 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f620c06af00 0x7f620c06d3c0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:27.965 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.962+0000 7f6230cb5700 1 --2- 172.21.15.149:0/4168762784 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f622c0cc140 0x7f622c15d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:27.965 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.962+0000 7f6230cb5700 1 --2- 172.21.15.149:0/4168762784 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f622c0b2850 0x7f622c0b00b0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:27.966 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.962+0000 7f6230cb5700 1 --2- 172.21.15.149:0/4168762784 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f622c0b2cd0 0x7f622c09dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:27.966 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.962+0000 7f6230cb5700 1 -- 172.21.15.149:0/4168762784 >> 172.21.15.149:0/4168762784 conn(0x7f622c099a40 msgr2=0x7f622c0d02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:27.966 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.962+0000 7f6230cb5700 1 -- 172.21.15.149:0/4168762784 shutdown_connections 2023-11-08T19:25:27.966 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:27.962+0000 7f6230cb5700 1 -- 172.21.15.149:0/4168762784 wait complete. 2023-11-08T19:25:27.976 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-08T19:22:56.023194+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-08T19:24:29.516185+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 42, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-08T19:25:27.977 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-08T19:25:28.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.099+0000 7f5807d67700 1 Processor -- start 2023-11-08T19:25:28.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.099+0000 7f5807d67700 1 -- start start 2023-11-08T19:25:28.105 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.100+0000 7f5807d67700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f58000d1130 0x7f58000b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:28.105 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.100+0000 7f5807d67700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58000b6470 con 0x7f58000cc870 2023-11-08T19:25:28.105 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.100+0000 7f5807d67700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f580015afd0 con 0x7f580015abf0 2023-11-08T19:25:28.105 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.100+0000 7f5807d67700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58000b66a0 con 0x7f58000d1130 2023-11-08T19:25:28.105 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.100+0000 7f5806304700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f58000cc870 0x7f580006bc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:43138/0 (socket says 172.21.15.149:43138) 2023-11-08T19:25:28.106 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.100+0000 7f5806304700 1 -- 172.21.15.149:0/1526396249 learned_addr learned my addr 172.21.15.149:0/1526396249 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:25:28.106 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.100+0000 7f5805302700 1 --2- 172.21.15.149:0/1526396249 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f58000d1130 0x7f58000b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:28.106 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.100+0000 7f5804b01700 1 -- 172.21.15.149:0/1526396249 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1224750500 0 0) 0x7f58000b6470 con 0x7f58000cc870 2023-11-08T19:25:28.106 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.100+0000 7f5804b01700 1 -- 172.21.15.149:0/1526396249 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57e80035b0 con 0x7f58000cc870 2023-11-08T19:25:28.106 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.101+0000 7f5804b01700 1 -- 172.21.15.149:0/1526396249 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3060612320 0 0) 0x7f57e80035b0 con 0x7f58000cc870 2023-11-08T19:25:28.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.101+0000 7f5804b01700 1 -- 172.21.15.149:0/1526396249 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f58000d1130 msgr2=0x7f58000b5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:28.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.101+0000 7f5804b01700 1 --2- 172.21.15.149:0/1526396249 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f58000d1130 0x7f58000b5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:28.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.101+0000 7f5804b01700 1 -- 172.21.15.149:0/1526396249 >> v1:172.21.15.160:6789/0 conn(0x7f580015abf0 legacy=0x7f58000cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:28.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.101+0000 7f5804b01700 1 -- 172.21.15.149:0/1526396249 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f580015e880 con 0x7f58000cc870 2023-11-08T19:25:28.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.101+0000 7f5804b01700 1 -- 172.21.15.149:0/1526396249 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f57f80019f0 con 0x7f58000cc870 2023-11-08T19:25:28.108 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.101+0000 7f5804b01700 1 -- 172.21.15.149:0/1526396249 >> v1:172.21.15.149:6789/0 conn(0x7f58000cc870 legacy=0x7f580006bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:28.108 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.101+0000 7f5804b01700 1 --2- 172.21.15.149:0/1526396249 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f57e8003aa0 0x7f57e8003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:28.108 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.101+0000 7f5804b01700 1 --2- 172.21.15.149:0/1526396249 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f58000d1130 0x7f57e8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:28.108 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.101+0000 7f5804b01700 1 --2- 172.21.15.149:0/1526396249 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57e8004d90 0x7f57e8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:28.108 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.101+0000 7f5804b01700 1 -- 172.21.15.149:0/1526396249 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58000b66a0 con 0x7f57e8004d90 2023-11-08T19:25:28.109 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.101+0000 7f5804b01700 1 -- 172.21.15.149:0/1526396249 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e800bb10 con 0x7f57e8003aa0 2023-11-08T19:25:28.109 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.101+0000 7f5804b01700 1 -- 172.21.15.149:0/1526396249 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57e800bcd0 con 0x7f58000d1130 2023-11-08T19:25:28.109 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.101+0000 7f5806304700 1 --2- 172.21.15.149:0/1526396249 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57e8004d90 0x7f57e8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:28.109 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.101+0000 7f5805302700 1 --2- 172.21.15.149:0/1526396249 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f58000d1130 0x7f57e8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:28.109 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.101+0000 7f5805b03700 1 --2- 172.21.15.149:0/1526396249 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f57e8003aa0 0x7f57e8003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:28.110 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.101+0000 7f5806304700 1 -- 172.21.15.149:0/1526396249 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f58000d1130 msgr2=0x7f57e8004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:28.110 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.101+0000 7f5806304700 1 --2- 172.21.15.149:0/1526396249 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f58000d1130 0x7f57e8004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:28.110 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.101+0000 7f5806304700 1 -- 172.21.15.149:0/1526396249 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f57e8003aa0 msgr2=0x7f57e8003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:28.110 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.101+0000 7f5806304700 1 --2- 172.21.15.149:0/1526396249 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f57e8003aa0 0x7f57e8003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:28.110 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.101+0000 7f5806304700 1 -- 172.21.15.149:0/1526396249 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e80035b0 con 0x7f57e8004d90 2023-11-08T19:25:28.111 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.101+0000 7f5806304700 1 --2- 172.21.15.149:0/1526396249 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57e8004d90 0x7f57e8005210 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f57f800a830 tx=0x7f57e8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0dc35a1ef1c7b7f server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:28.111 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.101+0000 7f5804b01700 1 -- 172.21.15.149:0/1526396249 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f8012600 con 0x7f57e8004d90 2023-11-08T19:25:28.111 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.101+0000 7f5804b01700 1 -- 172.21.15.149:0/1526396249 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57f8012780 con 0x7f57e8004d90 2023-11-08T19:25:28.111 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.101+0000 7f5804b01700 1 -- 172.21.15.149:0/1526396249 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f8012b30 con 0x7f57e8004d90 2023-11-08T19:25:28.111 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.102+0000 7f5807d67700 1 -- 172.21.15.149:0/1526396249 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57e8004d90 msgr2=0x7f57e8005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:28.112 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.102+0000 7f5807d67700 1 --2- 172.21.15.149:0/1526396249 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57e8004d90 0x7f57e8005210 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f57f800a830 tx=0x7f57e8005880 comp rx=0 tx=0).stop 2023-11-08T19:25:28.112 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.102+0000 7f5806304700 1 -- 172.21.15.149:0/1526396249 reap_dead start 2023-11-08T19:25:28.112 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.102+0000 7f5807d67700 1 -- 172.21.15.149:0/1526396249 shutdown_connections 2023-11-08T19:25:28.112 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.102+0000 7f5807d67700 1 -- 172.21.15.149:0/1526396249 >> 172.21.15.149:0/1526396249 conn(0x7f58000d0640 msgr2=0x7f58000d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:28.112 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.102+0000 7f5807d67700 1 -- 172.21.15.149:0/1526396249 shutdown_connections 2023-11-08T19:25:28.112 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.102+0000 7f5807d67700 1 -- 172.21.15.149:0/1526396249 wait complete. 2023-11-08T19:25:28.115 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.103+0000 7f5807d67700 1 Processor -- start 2023-11-08T19:25:28.115 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.103+0000 7f5807d67700 1 -- start start 2023-11-08T19:25:28.116 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.104+0000 7f5807d67700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5800150220 0x7f58000adc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:28.116 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.104+0000 7f5807d67700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5800150d90 0x7f58000ae150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:28.116 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.104+0000 7f5807d67700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f58001507d0 0x7f58000ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:28.117 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.104+0000 7f5807d67700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5800150600 con 0x7f5800150d90 2023-11-08T19:25:28.117 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.104+0000 7f5807d67700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58000c9020 con 0x7f58001507d0 2023-11-08T19:25:28.117 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.104+0000 7f5807d67700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58000c9300 con 0x7f5800150220 2023-11-08T19:25:28.117 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.104+0000 7f5805302700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5800150d90 0x7f58000ae150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:28.117 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.104+0000 7f5805302700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5800150d90 0x7f58000ae150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41144/0 (socket says 172.21.15.149:41144) 2023-11-08T19:25:28.118 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.104+0000 7f5805302700 1 -- 172.21.15.149:0/2172661872 learned_addr learned my addr 172.21.15.149:0/2172661872 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:28.118 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.104+0000 7f5805b03700 1 --2- 172.21.15.149:0/2172661872 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5800150220 0x7f58000adc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:28.118 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.104+0000 7f5806304700 1 --2- 172.21.15.149:0/2172661872 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f58001507d0 0x7f58000ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:28.118 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.104+0000 7f5805302700 1 -- 172.21.15.149:0/2172661872 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5800150220 msgr2=0x7f58000adc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:28.118 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.104+0000 7f5805302700 1 --2- 172.21.15.149:0/2172661872 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5800150220 0x7f58000adc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:28.119 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.104+0000 7f5805302700 1 -- 172.21.15.149:0/2172661872 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f58001507d0 msgr2=0x7f58000ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:28.119 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.104+0000 7f5805302700 1 --2- 172.21.15.149:0/2172661872 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f58001507d0 0x7f58000ac8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:28.119 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.104+0000 7f5805302700 1 -- 172.21.15.149:0/2172661872 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58000c95e0 con 0x7f5800150d90 2023-11-08T19:25:28.119 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.104+0000 7f5806304700 1 --2- 172.21.15.149:0/2172661872 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f58001507d0 0x7f58000ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:25:28.119 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.105+0000 7f5805302700 1 --2- 172.21.15.149:0/2172661872 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5800150d90 0x7f58000ae150 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f57f4011aa0 tx=0x7f57f4011db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:28.119 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.105+0000 7f57fe7fc700 1 -- 172.21.15.149:0/2172661872 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f400f940 con 0x7f5800150d90 2023-11-08T19:25:28.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.105+0000 7f57fe7fc700 1 -- 172.21.15.149:0/2172661872 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57f400faa0 con 0x7f5800150d90 2023-11-08T19:25:28.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.105+0000 7f5807d67700 1 -- 172.21.15.149:0/2172661872 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f580006ab80 con 0x7f5800150d90 2023-11-08T19:25:28.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.105+0000 7f57fe7fc700 1 -- 172.21.15.149:0/2172661872 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f400fe50 con 0x7f5800150d90 2023-11-08T19:25:28.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.105+0000 7f5807d67700 1 -- 172.21.15.149:0/2172661872 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f580015b720 con 0x7f5800150d90 2023-11-08T19:25:28.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.106+0000 7f5807d67700 1 -- 172.21.15.149:0/2172661872 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f580006b1d0 con 0x7f5800150d90 2023-11-08T19:25:28.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.106+0000 7f57fe7fc700 1 -- 172.21.15.149:0/2172661872 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f57f4014440 con 0x7f5800150d90 2023-11-08T19:25:28.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.107+0000 7f57fe7fc700 1 --2- 172.21.15.149:0/2172661872 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f57ec06af00 0x7f57ec06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:28.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.107+0000 7f57fe7fc700 1 -- 172.21.15.149:0/2172661872 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f57f4089cb0 con 0x7f5800150d90 2023-11-08T19:25:28.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.107+0000 7f5805b03700 1 --2- 172.21.15.149:0/2172661872 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f57ec06af00 0x7f57ec06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:28.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.107+0000 7f5805b03700 1 --2- 172.21.15.149:0/2172661872 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f57ec06af00 0x7f57ec06d3c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f57f00011a0 tx=0x7f57f0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:28.122 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.112+0000 7f57fe7fc700 1 -- 172.21.15.149:0/2172661872 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f57f4054f80 con 0x7f5800150d90 2023-11-08T19:25:28.304 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.301+0000 7f5807d67700 1 -- 172.21.15.149:0/2172661872 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f580004f730 con 0x7f5800150d90 2023-11-08T19:25:28.304 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.302+0000 7f57fe7fc700 1 -- 172.21.15.149:0/2172661872 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v63) v1 ==== 93+0+10 (secure 0 0 0) 0x7f57f4022020 con 0x7f5800150d90 2023-11-08T19:25:28.305 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 1 2023-11-08T19:25:28.307 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.304+0000 7f5807d67700 1 -- 172.21.15.149:0/2172661872 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f57ec06af00 msgr2=0x7f57ec06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:28.307 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.304+0000 7f5807d67700 1 --2- 172.21.15.149:0/2172661872 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f57ec06af00 0x7f57ec06d3c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f57f00011a0 tx=0x7f57f0009040 comp rx=0 tx=0).stop 2023-11-08T19:25:28.307 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.304+0000 7f5807d67700 1 -- 172.21.15.149:0/2172661872 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5800150d90 msgr2=0x7f58000ae150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:28.307 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.304+0000 7f5807d67700 1 --2- 172.21.15.149:0/2172661872 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5800150d90 0x7f58000ae150 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f57f4011aa0 tx=0x7f57f4011db0 comp rx=0 tx=0).stop 2023-11-08T19:25:28.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.304+0000 7f5807d67700 1 -- 172.21.15.149:0/2172661872 shutdown_connections 2023-11-08T19:25:28.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.304+0000 7f5807d67700 1 --2- 172.21.15.149:0/2172661872 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f57ec06af00 0x7f57ec06d3c0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:28.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.304+0000 7f5807d67700 1 --2- 172.21.15.149:0/2172661872 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f58001507d0 0x7f58000ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:28.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.304+0000 7f5807d67700 1 --2- 172.21.15.149:0/2172661872 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5800150220 0x7f58000adc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:28.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.304+0000 7f5807d67700 1 --2- 172.21.15.149:0/2172661872 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5800150d90 0x7f58000ae150 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:28.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.304+0000 7f5807d67700 1 -- 172.21.15.149:0/2172661872 >> 172.21.15.149:0/2172661872 conn(0x7f58000d0640 msgr2=0x7f58000ceb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:28.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.304+0000 7f5807d67700 1 -- 172.21.15.149:0/2172661872 shutdown_connections 2023-11-08T19:25:28.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.304+0000 7f5807d67700 1 -- 172.21.15.149:0/2172661872 wait complete. 2023-11-08T19:25:28.319 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-08T19:25:28.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.440+0000 7fe1b2a71700 1 Processor -- start 2023-11-08T19:25:28.443 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.440+0000 7fe1b2a71700 1 -- start start 2023-11-08T19:25:28.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.441+0000 7fe1b2a71700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe1ac15abf0 0x7fe1ac0b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:28.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.441+0000 7fe1b2a71700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1ac0cc870 0x7fe1ac06bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:28.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.441+0000 7fe1b2a71700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1ac0b6470 con 0x7fe1ac0d1130 2023-11-08T19:25:28.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.441+0000 7fe1b2a71700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1ac0b66a0 con 0x7fe1ac15abf0 2023-11-08T19:25:28.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.441+0000 7fe1b2a71700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac0d04a0 con 0x7fe1ac0cc870 2023-11-08T19:25:28.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.441+0000 7fe1b080d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe1ac15abf0 0x7fe1ac0b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:28.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.441+0000 7fe1b080d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe1ac15abf0 0x7fe1ac0b5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41154/0 (socket says 172.21.15.149:41154) 2023-11-08T19:25:28.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.441+0000 7fe1b080d700 1 -- 172.21.15.149:0/823478203 learned_addr learned my addr 172.21.15.149:0/823478203 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:28.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.441+0000 7fe1b100e700 1 --2- 172.21.15.149:0/823478203 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1ac0cc870 0x7fe1ac06bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:28.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.441+0000 7fe1b080d700 1 -- 172.21.15.149:0/823478203 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1ac0cc870 msgr2=0x7fe1ac06bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:28.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.441+0000 7fe1b080d700 1 --2- 172.21.15.149:0/823478203 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1ac0cc870 0x7fe1ac06bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:28.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.441+0000 7fe1b080d700 1 -- 172.21.15.149:0/823478203 >> v1:172.21.15.160:6789/0 conn(0x7fe1ac0d1130 legacy=0x7fe1ac0cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:28.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.441+0000 7fe1b080d700 1 -- 172.21.15.149:0/823478203 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1ac15afd0 con 0x7fe1ac15abf0 2023-11-08T19:25:28.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.441+0000 7fe1b100e700 1 --2- 172.21.15.149:0/823478203 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1ac0cc870 0x7fe1ac06bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:25:28.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.441+0000 7fe1b080d700 1 --2- 172.21.15.149:0/823478203 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1ac15abf0 0x7fe1ac0b5f30 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fe1a000bb90 tx=0x7fe1a000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bdc6b5058a29b98 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:28.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.441+0000 7fe1ab7fe700 1 -- 172.21.15.149:0/823478203 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a000dd10 con 0x7fe1ac15abf0 2023-11-08T19:25:28.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.441+0000 7fe1ab7fe700 1 -- 172.21.15.149:0/823478203 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a000de70 con 0x7fe1ac15abf0 2023-11-08T19:25:28.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.441+0000 7fe1ab7fe700 1 -- 172.21.15.149:0/823478203 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a0004230 con 0x7fe1ac15abf0 2023-11-08T19:25:28.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.442+0000 7fe1b2a71700 1 -- 172.21.15.149:0/823478203 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1ac15abf0 msgr2=0x7fe1ac0b5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:28.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.442+0000 7fe1b2a71700 1 --2- 172.21.15.149:0/823478203 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1ac15abf0 0x7fe1ac0b5f30 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fe1a000bb90 tx=0x7fe1a000bea0 comp rx=0 tx=0).stop 2023-11-08T19:25:28.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.442+0000 7fe1b2a71700 1 -- 172.21.15.149:0/823478203 shutdown_connections 2023-11-08T19:25:28.450 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.442+0000 7fe1b2a71700 1 --2- 172.21.15.149:0/823478203 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1ac0cc870 0x7fe1ac06bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:28.450 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.442+0000 7fe1b2a71700 1 --2- 172.21.15.149:0/823478203 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1ac15abf0 0x7fe1ac0b5f30 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:28.450 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.442+0000 7fe1b2a71700 1 -- 172.21.15.149:0/823478203 >> 172.21.15.149:0/823478203 conn(0x7fe1ac0d0640 msgr2=0x7fe1ac0d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:28.450 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.442+0000 7fe1b2a71700 1 -- 172.21.15.149:0/823478203 shutdown_connections 2023-11-08T19:25:28.450 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.442+0000 7fe1b2a71700 1 -- 172.21.15.149:0/823478203 wait complete. 2023-11-08T19:25:28.451 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.443+0000 7fe1b2a71700 1 Processor -- start 2023-11-08T19:25:28.451 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.443+0000 7fe1b2a71700 1 -- start start 2023-11-08T19:25:28.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.444+0000 7fe1b2a71700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe1ac0cc870 0x7fe1ac0c66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:28.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.444+0000 7fe1b2a71700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1ac0d1130 0x7fe1ac158730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:28.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.444+0000 7fe1b2a71700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1ac15abf0 0x7fe1ac158c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:28.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.444+0000 7fe1b2a71700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac15e0c0 con 0x7fe1ac0d1130 2023-11-08T19:25:28.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.444+0000 7fe1b2a71700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac0c6be0 con 0x7fe1ac0cc870 2023-11-08T19:25:28.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.444+0000 7fe1b2a71700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac15d820 con 0x7fe1ac15abf0 2023-11-08T19:25:28.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.444+0000 7fe1abfff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1ac0d1130 0x7fe1ac158730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:28.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.444+0000 7fe1abfff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1ac0d1130 0x7fe1ac158730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41160/0 (socket says 172.21.15.149:41160) 2023-11-08T19:25:28.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.444+0000 7fe1abfff700 1 -- 172.21.15.149:0/2329684871 learned_addr learned my addr 172.21.15.149:0/2329684871 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:28.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.444+0000 7fe1b080d700 1 --2- 172.21.15.149:0/2329684871 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe1ac0cc870 0x7fe1ac0c66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:28.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.444+0000 7fe1b100e700 1 --2- 172.21.15.149:0/2329684871 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1ac15abf0 0x7fe1ac158c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:28.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.445+0000 7fe1abfff700 1 -- 172.21.15.149:0/2329684871 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1ac15abf0 msgr2=0x7fe1ac158c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:28.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.445+0000 7fe1abfff700 1 --2- 172.21.15.149:0/2329684871 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1ac15abf0 0x7fe1ac158c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:28.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.445+0000 7fe1abfff700 1 -- 172.21.15.149:0/2329684871 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe1ac0cc870 msgr2=0x7fe1ac0c66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:28.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.445+0000 7fe1abfff700 1 --2- 172.21.15.149:0/2329684871 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe1ac0cc870 0x7fe1ac0c66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:28.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.445+0000 7fe1abfff700 1 -- 172.21.15.149:0/2329684871 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a000b7f0 con 0x7fe1ac0d1130 2023-11-08T19:25:28.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.445+0000 7fe1abfff700 1 --2- 172.21.15.149:0/2329684871 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1ac0d1130 0x7fe1ac158730 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fe19800c4d0 tx=0x7fe19800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:28.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.445+0000 7fe1a97fa700 1 -- 172.21.15.149:0/2329684871 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe198011790 con 0x7fe1ac0d1130 2023-11-08T19:25:28.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.445+0000 7fe1a97fa700 1 -- 172.21.15.149:0/2329684871 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1980118f0 con 0x7fe1ac0d1130 2023-11-08T19:25:28.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.445+0000 7fe1b2a71700 1 -- 172.21.15.149:0/2329684871 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1ac15db00 con 0x7fe1ac0d1130 2023-11-08T19:25:28.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.445+0000 7fe1a97fa700 1 -- 172.21.15.149:0/2329684871 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe198011ca0 con 0x7fe1ac0d1130 2023-11-08T19:25:28.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.445+0000 7fe1b2a71700 1 -- 172.21.15.149:0/2329684871 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1ac0c7840 con 0x7fe1ac0d1130 2023-11-08T19:25:28.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.446+0000 7fe1b2a71700 1 -- 172.21.15.149:0/2329684871 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1ac04f730 con 0x7fe1ac0d1130 2023-11-08T19:25:28.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.446+0000 7fe1a97fa700 1 -- 172.21.15.149:0/2329684871 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe19801c460 con 0x7fe1ac0d1130 2023-11-08T19:25:28.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.447+0000 7fe1a97fa700 1 --2- 172.21.15.149:0/2329684871 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe19006af30 0x7fe19006d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:28.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.447+0000 7fe1a97fa700 1 -- 172.21.15.149:0/2329684871 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fe1980891e0 con 0x7fe1ac0d1130 2023-11-08T19:25:28.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.447+0000 7fe1b080d700 1 --2- 172.21.15.149:0/2329684871 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe19006af30 0x7fe19006d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:28.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.447+0000 7fe1b080d700 1 --2- 172.21.15.149:0/2329684871 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe19006af30 0x7fe19006d3f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe1a000b340 tx=0x7fe1a001d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:28.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.452+0000 7fe1a97fa700 1 -- 172.21.15.149:0/2329684871 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe198054340 con 0x7fe1ac0d1130 2023-11-08T19:25:28.646 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.641+0000 7fe1b2a71700 1 -- 172.21.15.149:0/2329684871 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7fe1ac0ca950 con 0x7fe1ac0d1130 2023-11-08T19:25:28.646 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.642+0000 7fe1a97fa700 1 -- 172.21.15.149:0/2329684871 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v63) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe198057960 con 0x7fe1ac0d1130 2023-11-08T19:25:28.647 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:25:28.648 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.644+0000 7fe1b2a71700 1 -- 172.21.15.149:0/2329684871 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe19006af30 msgr2=0x7fe19006d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:28.648 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.644+0000 7fe1b2a71700 1 --2- 172.21.15.149:0/2329684871 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe19006af30 0x7fe19006d3f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe1a000b340 tx=0x7fe1a001d040 comp rx=0 tx=0).stop 2023-11-08T19:25:28.648 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.644+0000 7fe1b2a71700 1 -- 172.21.15.149:0/2329684871 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1ac0d1130 msgr2=0x7fe1ac158730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:28.648 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.644+0000 7fe1b2a71700 1 --2- 172.21.15.149:0/2329684871 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1ac0d1130 0x7fe1ac158730 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fe19800c4d0 tx=0x7fe19800c7e0 comp rx=0 tx=0).stop 2023-11-08T19:25:28.648 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.644+0000 7fe1b2a71700 1 -- 172.21.15.149:0/2329684871 shutdown_connections 2023-11-08T19:25:28.649 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.644+0000 7fe1b2a71700 1 --2- 172.21.15.149:0/2329684871 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe19006af30 0x7fe19006d3f0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:28.649 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.644+0000 7fe1b2a71700 1 --2- 172.21.15.149:0/2329684871 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe1ac0cc870 0x7fe1ac0c66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:28.649 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.644+0000 7fe1b2a71700 1 --2- 172.21.15.149:0/2329684871 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1ac15abf0 0x7fe1ac158c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:28.649 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.644+0000 7fe1b2a71700 1 --2- 172.21.15.149:0/2329684871 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1ac0d1130 0x7fe1ac158730 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:28.650 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.644+0000 7fe1b2a71700 1 -- 172.21.15.149:0/2329684871 >> 172.21.15.149:0/2329684871 conn(0x7fe1ac0d0640 msgr2=0x7fe1ac06abf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:28.650 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.644+0000 7fe1b2a71700 1 -- 172.21.15.149:0/2329684871 shutdown_connections 2023-11-08T19:25:28.650 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.644+0000 7fe1b2a71700 1 -- 172.21.15.149:0/2329684871 wait complete. 2023-11-08T19:25:28.659 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-08T19:25:28.780 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.778+0000 7fa2700ed700 1 Processor -- start 2023-11-08T19:25:28.780 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.778+0000 7fa2700ed700 1 -- start start 2023-11-08T19:25:28.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.779+0000 7fa2700ed700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa26815b950 0x7fa2680ce130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:28.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.779+0000 7fa2700ed700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2680cc2e0 con 0x7fa2680d0430 2023-11-08T19:25:28.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.779+0000 7fa2700ed700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2680cc580 con 0x7fa2680cd5e0 2023-11-08T19:25:28.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.779+0000 7fa2700ed700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2680cc820 con 0x7fa26815b950 2023-11-08T19:25:28.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.779+0000 7fa26de89700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa26815b950 0x7fa2680ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:28.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.779+0000 7fa26e68a700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fa2680d0430 0x7fa2681658e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:43172/0 (socket says 172.21.15.149:43172) 2023-11-08T19:25:28.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.779+0000 7fa26e68a700 1 -- 172.21.15.149:0/3565414468 learned_addr learned my addr 172.21.15.149:0/3565414468 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:25:28.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.779+0000 7fa26de89700 1 -- 172.21.15.149:0/3565414468 >> v1:172.21.15.160:6789/0 conn(0x7fa2680cd5e0 legacy=0x7fa2680cfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:28.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.779+0000 7fa26de89700 1 -- 172.21.15.149:0/3565414468 >> v1:172.21.15.149:6789/0 conn(0x7fa2680d0430 legacy=0x7fa2681658e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:28.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.779+0000 7fa26ce87700 1 -- 172.21.15.149:0/3565414468 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 401607235 0 0) 0x7fa2680cc2e0 con 0x7fa2680d0430 2023-11-08T19:25:28.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.779+0000 7fa26de89700 1 -- 172.21.15.149:0/3565414468 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2680ccb00 con 0x7fa26815b950 2023-11-08T19:25:28.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.779+0000 7fa26de89700 1 --2- 172.21.15.149:0/3565414468 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa26815b950 0x7fa2680ce130 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fa258009820 tx=0x7fa258009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=737470a975510c2b server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:28.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.779+0000 7fa26ce87700 1 -- 172.21.15.149:0/3565414468 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa258005e30 con 0x7fa26815b950 2023-11-08T19:25:28.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.779+0000 7fa26ce87700 1 -- 172.21.15.149:0/3565414468 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa258004030 con 0x7fa26815b950 2023-11-08T19:25:28.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.779+0000 7fa26ce87700 1 -- 172.21.15.149:0/3565414468 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2580043c0 con 0x7fa26815b950 2023-11-08T19:25:28.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.780+0000 7fa2700ed700 1 -- 172.21.15.149:0/3565414468 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa26815b950 msgr2=0x7fa2680ce130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:28.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.780+0000 7fa2700ed700 1 --2- 172.21.15.149:0/3565414468 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa26815b950 0x7fa2680ce130 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fa258009820 tx=0x7fa258009b30 comp rx=0 tx=0).stop 2023-11-08T19:25:28.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.780+0000 7fa2700ed700 1 -- 172.21.15.149:0/3565414468 shutdown_connections 2023-11-08T19:25:28.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.780+0000 7fa2700ed700 1 --2- 172.21.15.149:0/3565414468 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa26815b950 0x7fa2680ce130 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:28.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.780+0000 7fa2700ed700 1 -- 172.21.15.149:0/3565414468 >> 172.21.15.149:0/3565414468 conn(0x7fa26808afd0 msgr2=0x7fa2680d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:28.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.780+0000 7fa2700ed700 1 -- 172.21.15.149:0/3565414468 shutdown_connections 2023-11-08T19:25:28.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.780+0000 7fa2700ed700 1 -- 172.21.15.149:0/3565414468 wait complete. 2023-11-08T19:25:28.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.781+0000 7fa2700ed700 1 Processor -- start 2023-11-08T19:25:28.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.781+0000 7fa2700ed700 1 -- start start 2023-11-08T19:25:28.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.782+0000 7fa2700ed700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2680d0430 0x7fa268150930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:28.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.782+0000 7fa2700ed700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa26815b950 0x7fa26806bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:28.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.782+0000 7fa2700ed700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2680c57a0 0x7fa2680c5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:28.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.782+0000 7fa2700ed700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2680c6190 con 0x7fa2680c57a0 2023-11-08T19:25:28.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.782+0000 7fa2700ed700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa268150e70 con 0x7fa2680d0430 2023-11-08T19:25:28.791 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.782+0000 7fa2700ed700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa26806d700 con 0x7fa26815b950 2023-11-08T19:25:28.791 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.782+0000 7fa26e68a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2680c57a0 0x7fa2680c5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:28.791 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.782+0000 7fa26e68a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2680c57a0 0x7fa2680c5c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41176/0 (socket says 172.21.15.149:41176) 2023-11-08T19:25:28.791 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.782+0000 7fa26e68a700 1 -- 172.21.15.149:0/2831115867 learned_addr learned my addr 172.21.15.149:0/2831115867 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:28.791 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.782+0000 7fa26de89700 1 --2- 172.21.15.149:0/2831115867 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2680d0430 0x7fa268150930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:28.792 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.782+0000 7fa26d688700 1 --2- 172.21.15.149:0/2831115867 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa26815b950 0x7fa26806bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:28.792 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.782+0000 7fa26e68a700 1 -- 172.21.15.149:0/2831115867 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa26815b950 msgr2=0x7fa26806bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:28.792 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.782+0000 7fa26e68a700 1 --2- 172.21.15.149:0/2831115867 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa26815b950 0x7fa26806bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:28.792 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.782+0000 7fa26e68a700 1 -- 172.21.15.149:0/2831115867 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2680d0430 msgr2=0x7fa268150930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:28.792 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.782+0000 7fa26e68a700 1 --2- 172.21.15.149:0/2831115867 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2680d0430 0x7fa268150930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:28.793 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.782+0000 7fa26e68a700 1 -- 172.21.15.149:0/2831115867 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa258009430 con 0x7fa2680c57a0 2023-11-08T19:25:28.793 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.782+0000 7fa26de89700 1 --2- 172.21.15.149:0/2831115867 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2680d0430 0x7fa268150930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:25:28.793 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.782+0000 7fa26e68a700 1 --2- 172.21.15.149:0/2831115867 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2680c57a0 0x7fa2680c5c50 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fa26000cca0 tx=0x7fa26000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:28.793 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.783+0000 7fa25e7fc700 1 -- 172.21.15.149:0/2831115867 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26000cea0 con 0x7fa2680c57a0 2023-11-08T19:25:28.793 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.783+0000 7fa25e7fc700 1 -- 172.21.15.149:0/2831115867 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa26000ade0 con 0x7fa2680c57a0 2023-11-08T19:25:28.794 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.783+0000 7fa2700ed700 1 -- 172.21.15.149:0/2831115867 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa26806c660 con 0x7fa2680c57a0 2023-11-08T19:25:28.794 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.783+0000 7fa25e7fc700 1 -- 172.21.15.149:0/2831115867 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa260007310 con 0x7fa2680c57a0 2023-11-08T19:25:28.794 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.783+0000 7fa2700ed700 1 -- 172.21.15.149:0/2831115867 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa26806cc20 con 0x7fa2680c57a0 2023-11-08T19:25:28.794 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.783+0000 7fa2700ed700 1 -- 172.21.15.149:0/2831115867 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2680745f0 con 0x7fa2680c57a0 2023-11-08T19:25:28.794 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.784+0000 7fa25e7fc700 1 -- 172.21.15.149:0/2831115867 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa260007470 con 0x7fa2680c57a0 2023-11-08T19:25:28.795 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.784+0000 7fa25e7fc700 1 --2- 172.21.15.149:0/2831115867 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa24c06af30 0x7fa24c06d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:28.795 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.784+0000 7fa25e7fc700 1 -- 172.21.15.149:0/2831115867 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fa260089420 con 0x7fa2680c57a0 2023-11-08T19:25:28.795 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.784+0000 7fa26de89700 1 --2- 172.21.15.149:0/2831115867 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa24c06af30 0x7fa24c06d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:28.795 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.785+0000 7fa26de89700 1 --2- 172.21.15.149:0/2831115867 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa24c06af30 0x7fa24c06d3f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa258000c00 tx=0x7fa258008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:28.796 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.790+0000 7fa25e7fc700 1 -- 172.21.15.149:0/2831115867 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa260054580 con 0x7fa2680c57a0 2023-11-08T19:25:28.983 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.980+0000 7fa2700ed700 1 -- 172.21.15.149:0/2831115867 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa2680aeb20 con 0x7fa2680c57a0 2023-11-08T19:25:28.983 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.981+0000 7fa25e7fc700 1 -- 172.21.15.149:0/2831115867 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v63) v1 ==== 84+0+137 (secure 0 0 0) 0x7fa2600180a0 con 0x7fa2680c57a0 2023-11-08T19:25:28.983 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:25:28.984 INFO:teuthology.orchestra.run.smithi149.stdout:[ 2023-11-08T19:25:28.984 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:25:28.984 INFO:teuthology.orchestra.run.smithi149.stdout: "poolnum": 1, 2023-11-08T19:25:28.984 INFO:teuthology.orchestra.run.smithi149.stdout: "poolname": ".mgr" 2023-11-08T19:25:28.984 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:25:28.985 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:25:28.985 INFO:teuthology.orchestra.run.smithi149.stdout: "poolnum": 7, 2023-11-08T19:25:28.985 INFO:teuthology.orchestra.run.smithi149.stdout: "poolname": "snap-test-pool" 2023-11-08T19:25:28.985 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:25:28.985 INFO:teuthology.orchestra.run.smithi149.stdout:] 2023-11-08T19:25:28.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.983+0000 7fa2700ed700 1 -- 172.21.15.149:0/2831115867 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa24c06af30 msgr2=0x7fa24c06d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:28.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.983+0000 7fa2700ed700 1 --2- 172.21.15.149:0/2831115867 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa24c06af30 0x7fa24c06d3f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa258000c00 tx=0x7fa258008070 comp rx=0 tx=0).stop 2023-11-08T19:25:28.987 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.983+0000 7fa2700ed700 1 -- 172.21.15.149:0/2831115867 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2680c57a0 msgr2=0x7fa2680c5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:28.987 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.983+0000 7fa2700ed700 1 --2- 172.21.15.149:0/2831115867 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2680c57a0 0x7fa2680c5c50 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fa26000cca0 tx=0x7fa26000a340 comp rx=0 tx=0).stop 2023-11-08T19:25:28.987 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.983+0000 7fa2700ed700 1 -- 172.21.15.149:0/2831115867 shutdown_connections 2023-11-08T19:25:28.987 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.983+0000 7fa2700ed700 1 --2- 172.21.15.149:0/2831115867 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa24c06af30 0x7fa24c06d3f0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:28.987 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.983+0000 7fa2700ed700 1 --2- 172.21.15.149:0/2831115867 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2680d0430 0x7fa268150930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:28.988 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.983+0000 7fa2700ed700 1 --2- 172.21.15.149:0/2831115867 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2680c57a0 0x7fa2680c5c50 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:28.988 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.983+0000 7fa2700ed700 1 --2- 172.21.15.149:0/2831115867 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa26815b950 0x7fa26806bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:28.988 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.983+0000 7fa2700ed700 1 -- 172.21.15.149:0/2831115867 >> 172.21.15.149:0/2831115867 conn(0x7fa26808afd0 msgr2=0x7fa2680b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:28.988 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.983+0000 7fa2700ed700 1 -- 172.21.15.149:0/2831115867 shutdown_connections 2023-11-08T19:25:28.988 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:28.983+0000 7fa2700ed700 1 -- 172.21.15.149:0/2831115867 wait complete. 2023-11-08T19:25:28.997 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-08T19:25:28.997 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-08T19:25:29.122 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:29.121+0000 7fe09343e700 1 Processor -- start 2023-11-08T19:25:29.122 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:29.121+0000 7fe09343e700 1 -- start start 2023-11-08T19:25:29.124 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:29.121+0000 7fe09343e700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe08c15b8e0 0x7fe08c15fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:29.125 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:29.121+0000 7fe09343e700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe08c0b38f0 0x7fe08c0cfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:29.125 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:29.121+0000 7fe09343e700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe08c0cf330 con 0x7fe08c0cbdb0 2023-11-08T19:25:29.125 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:29.121+0000 7fe09343e700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe08c0b7290 con 0x7fe08c15b8e0 2023-11-08T19:25:29.125 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:29.121+0000 7fe09343e700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe08c1603d0 con 0x7fe08c0b38f0 2023-11-08T19:25:29.125 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:29.121+0000 7fe0911da700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe08c15b8e0 0x7fe08c15fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:29.126 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:29.121+0000 7fe0911da700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe08c15b8e0 0x7fe08c15fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41180/0 (socket says 172.21.15.149:41180) 2023-11-08T19:25:29.126 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:29.121+0000 7fe0911da700 1 -- 172.21.15.149:0/1922655265 learned_addr learned my addr 172.21.15.149:0/1922655265 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:29.126 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:29.121+0000 7fe0911da700 1 -- 172.21.15.149:0/1922655265 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe08c0b38f0 msgr2=0x7fe08c0cfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:29.126 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:29.121+0000 7fe0919db700 1 --2- 172.21.15.149:0/1922655265 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe08c0b38f0 0x7fe08c0cfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:29.126 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:29.121+0000 7fe0911da700 1 --2- 172.21.15.149:0/1922655265 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe08c0b38f0 0x7fe08c0cfaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:29.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:29.121+0000 7fe0911da700 1 -- 172.21.15.149:0/1922655265 >> v1:172.21.15.160:6789/0 conn(0x7fe08c0cbdb0 legacy=0x7fe08c0b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:29.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:29.121+0000 7fe0911da700 1 -- 172.21.15.149:0/1922655265 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe08c15bcc0 con 0x7fe08c15b8e0 2023-11-08T19:25:29.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:29.121+0000 7fe0911da700 1 --2- 172.21.15.149:0/1922655265 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe08c15b8e0 0x7fe08c15fe90 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fe0880098f0 tx=0x7fe088009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8850200fe793cbfe server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:29.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:29.121+0000 7fe083fff700 1 -- 172.21.15.149:0/1922655265 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe088004230 con 0x7fe08c15b8e0 2023-11-08T19:25:29.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:29.122+0000 7fe083fff700 1 -- 172.21.15.149:0/1922655265 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe088004390 con 0x7fe08c15b8e0 2023-11-08T19:25:29.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:29.122+0000 7fe083fff700 1 -- 172.21.15.149:0/1922655265 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0880036a0 con 0x7fe08c15b8e0 2023-11-08T19:25:29.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:29.122+0000 7fe09343e700 1 -- 172.21.15.149:0/1922655265 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe08c15b8e0 msgr2=0x7fe08c15fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:29.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:29.122+0000 7fe09343e700 1 --2- 172.21.15.149:0/1922655265 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe08c15b8e0 0x7fe08c15fe90 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fe0880098f0 tx=0x7fe088009c00 comp rx=0 tx=0).stop 2023-11-08T19:25:29.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:29.122+0000 7fe09343e700 1 -- 172.21.15.149:0/1922655265 shutdown_connections 2023-11-08T19:25:29.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:29.122+0000 7fe09343e700 1 --2- 172.21.15.149:0/1922655265 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe08c0b38f0 0x7fe08c0cfaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:29.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:29.122+0000 7fe09343e700 1 --2- 172.21.15.149:0/1922655265 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe08c15b8e0 0x7fe08c15fe90 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:29.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:29.122+0000 7fe09343e700 1 -- 172.21.15.149:0/1922655265 >> 172.21.15.149:0/1922655265 conn(0x7fe08c0ce1e0 msgr2=0x7fe08c0ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:29.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:29.122+0000 7fe09343e700 1 -- 172.21.15.149:0/1922655265 shutdown_connections 2023-11-08T19:25:29.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:29.122+0000 7fe09343e700 1 -- 172.21.15.149:0/1922655265 wait complete. 2023-11-08T19:25:29.134 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:29.124+0000 7fe09343e700 1 Processor -- start 2023-11-08T19:25:29.134 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:29.124+0000 7fe09343e700 1 -- start start 2023-11-08T19:25:29.135 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:29.124+0000 7fe09343e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe08c0b38f0 0x7fe08c0c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:29.135 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:29.124+0000 7fe09343e700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe08c0cbdb0 0x7fe08c0b5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:29.135 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:29.124+0000 7fe09343e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe08c15b8e0 0x7fe08c0b5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:29.135 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:29.124+0000 7fe09343e700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe08c147ee0 con 0x7fe08c0b38f0 2023-11-08T19:25:29.135 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:29.124+0000 7fe09343e700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe08c0ca9b0 con 0x7fe08c15b8e0 2023-11-08T19:25:29.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:29.124+0000 7fe09343e700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe08c1475b0 con 0x7fe08c0cbdb0 2023-11-08T19:25:29.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:29.124+0000 7fe0911da700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe08c0b38f0 0x7fe08c0c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:29.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:29.124+0000 7fe0911da700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe08c0b38f0 0x7fe08c0c8f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41184/0 (socket says 172.21.15.149:41184) 2023-11-08T19:25:29.137 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:29.124+0000 7fe0911da700 1 -- 172.21.15.149:0/3655746789 learned_addr learned my addr 172.21.15.149:0/3655746789 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:29.137 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:29.125+0000 7fe0909d9700 1 --2- 172.21.15.149:0/3655746789 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe08c0cbdb0 0x7fe08c0b5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:29.137 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:29.125+0000 7fe0919db700 1 --2- 172.21.15.149:0/3655746789 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe08c15b8e0 0x7fe08c0b5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:29.137 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:29.125+0000 7fe0911da700 1 -- 172.21.15.149:0/3655746789 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe08c0cbdb0 msgr2=0x7fe08c0b5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:29.137 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:29.125+0000 7fe0911da700 1 --2- 172.21.15.149:0/3655746789 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe08c0cbdb0 0x7fe08c0b5920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:29.138 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:29.125+0000 7fe0911da700 1 -- 172.21.15.149:0/3655746789 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe08c15b8e0 msgr2=0x7fe08c0b5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:29.138 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:29.125+0000 7fe0911da700 1 --2- 172.21.15.149:0/3655746789 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe08c15b8e0 0x7fe08c0b5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:29.138 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:29.125+0000 7fe0911da700 1 -- 172.21.15.149:0/3655746789 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe088009550 con 0x7fe08c0b38f0 2023-11-08T19:25:29.139 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:29.125+0000 7fe0911da700 1 --2- 172.21.15.149:0/3655746789 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe08c0b38f0 0x7fe08c0c8f00 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fe08c072d00 tx=0x7fe088004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:29.139 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:29.125+0000 7fe081ffb700 1 -- 172.21.15.149:0/3655746789 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08800b860 con 0x7fe08c0b38f0 2023-11-08T19:25:29.139 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:29.125+0000 7fe081ffb700 1 -- 172.21.15.149:0/3655746789 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe08800b9e0 con 0x7fe08c0b38f0 2023-11-08T19:25:29.139 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:29.125+0000 7fe09343e700 1 -- 172.21.15.149:0/3655746789 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe08c147890 con 0x7fe08c0b38f0 2023-11-08T19:25:29.140 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:29.125+0000 7fe081ffb700 1 -- 172.21.15.149:0/3655746789 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08800bd90 con 0x7fe08c0b38f0 2023-11-08T19:25:29.140 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:29.125+0000 7fe09343e700 1 -- 172.21.15.149:0/3655746789 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe08c148370 con 0x7fe08c0b38f0 2023-11-08T19:25:29.140 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:29.126+0000 7fe09343e700 1 -- 172.21.15.149:0/3655746789 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe08c1481c0 con 0x7fe08c0b38f0 2023-11-08T19:25:29.141 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:29.126+0000 7fe081ffb700 1 -- 172.21.15.149:0/3655746789 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe08801b440 con 0x7fe08c0b38f0 2023-11-08T19:25:29.141 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:29.127+0000 7fe081ffb700 1 --2- 172.21.15.149:0/3655746789 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe07006af00 0x7fe07006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:29.141 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:29.127+0000 7fe081ffb700 1 -- 172.21.15.149:0/3655746789 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fe08808aee0 con 0x7fe08c0b38f0 2023-11-08T19:25:29.142 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:29.127+0000 7fe0909d9700 1 --2- 172.21.15.149:0/3655746789 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe07006af00 0x7fe07006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:29.142 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:29.127+0000 7fe0909d9700 1 --2- 172.21.15.149:0/3655746789 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe07006af00 0x7fe07006d3c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe08c0c82b0 tx=0x7fe07c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:29.142 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:29.132+0000 7fe081ffb700 1 -- 172.21.15.149:0/3655746789 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe0880560d0 con 0x7fe08c0b38f0 2023-11-08T19:25:29.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:29.322+0000 7fe09343e700 1 -- 172.21.15.149:0/3655746789 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fe08c0745f0 con 0x7fe08c0b38f0 2023-11-08T19:25:30.194 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.193+0000 7fe081ffb700 1 -- 172.21.15.149:0/3655746789 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v64) v1 ==== 138+0+0 (secure 0 0 0) 0x7fe0880596f0 con 0x7fe08c0b38f0 2023-11-08T19:25:30.198 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.197+0000 7fe09343e700 1 -- 172.21.15.149:0/3655746789 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe07006af00 msgr2=0x7fe07006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:30.198 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.197+0000 7fe09343e700 1 --2- 172.21.15.149:0/3655746789 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe07006af00 0x7fe07006d3c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe08c0c82b0 tx=0x7fe07c009040 comp rx=0 tx=0).stop 2023-11-08T19:25:30.198 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.197+0000 7fe09343e700 1 -- 172.21.15.149:0/3655746789 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe08c0b38f0 msgr2=0x7fe08c0c8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:30.198 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.197+0000 7fe09343e700 1 --2- 172.21.15.149:0/3655746789 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe08c0b38f0 0x7fe08c0c8f00 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fe08c072d00 tx=0x7fe088004750 comp rx=0 tx=0).stop 2023-11-08T19:25:30.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.197+0000 7fe09343e700 1 -- 172.21.15.149:0/3655746789 shutdown_connections 2023-11-08T19:25:30.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.197+0000 7fe09343e700 1 --2- 172.21.15.149:0/3655746789 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe07006af00 0x7fe07006d3c0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:30.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.197+0000 7fe09343e700 1 --2- 172.21.15.149:0/3655746789 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe08c15b8e0 0x7fe08c0b5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:30.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.197+0000 7fe09343e700 1 --2- 172.21.15.149:0/3655746789 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe08c0b38f0 0x7fe08c0c8f00 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:30.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.197+0000 7fe09343e700 1 --2- 172.21.15.149:0/3655746789 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe08c0cbdb0 0x7fe08c0b5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:30.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.197+0000 7fe09343e700 1 -- 172.21.15.149:0/3655746789 >> 172.21.15.149:0/3655746789 conn(0x7fe08c0ce1e0 msgr2=0x7fe08c0b45b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:30.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.197+0000 7fe09343e700 1 -- 172.21.15.149:0/3655746789 shutdown_connections 2023-11-08T19:25:30.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.197+0000 7fe09343e700 1 -- 172.21.15.149:0/3655746789 wait complete. 2023-11-08T19:25:30.201 INFO:teuthology.orchestra.run.smithi149.stderr:pool 'cephfs_metadata' created 2023-11-08T19:25:30.215 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-08T19:25:30.344 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.343+0000 7f4b17e49700 1 Processor -- start 2023-11-08T19:25:30.345 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.344+0000 7f4b17e49700 1 -- start start 2023-11-08T19:25:30.347 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.344+0000 7f4b17e49700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f4b1015dc00 0x7f4b100b27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:30.347 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.344+0000 7f4b17e49700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f4b100cad20 0x7f4b1006ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:30.347 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.344+0000 7f4b17e49700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b1015dfe0 con 0x7f4b100b2d30 2023-11-08T19:25:30.348 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.344+0000 7f4b17e49700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b100cbe60 con 0x7f4b100cad20 2023-11-08T19:25:30.348 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.344+0000 7f4b17e49700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b100cb1e0 con 0x7f4b1015dc00 2023-11-08T19:25:30.348 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.345+0000 7f4b153e4700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f4b100cad20 0x7f4b1006ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:30.348 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.345+0000 7f4b153e4700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f4b100cad20 0x7f4b1006ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41192/0 (socket says 172.21.15.149:41192) 2023-11-08T19:25:30.349 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.345+0000 7f4b153e4700 1 -- 172.21.15.149:0/2619136103 learned_addr learned my addr 172.21.15.149:0/2619136103 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:30.349 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.345+0000 7f4b15be5700 1 --2- 172.21.15.149:0/2619136103 >> v2:172.21.15.160:3300/0 conn(0x7f4b1015dc00 0x7f4b100b27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:30.349 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.345+0000 7f4b153e4700 1 -- 172.21.15.149:0/2619136103 >> v2:172.21.15.160:3300/0 conn(0x7f4b1015dc00 msgr2=0x7f4b100b27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:30.349 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.345+0000 7f4b153e4700 1 --2- 172.21.15.149:0/2619136103 >> v2:172.21.15.160:3300/0 conn(0x7f4b1015dc00 0x7f4b100b27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:30.349 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.345+0000 7f4b153e4700 1 -- 172.21.15.149:0/2619136103 >> v1:172.21.15.160:6789/0 conn(0x7f4b100b2d30 legacy=0x7f4b10071f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:30.350 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.345+0000 7f4b153e4700 1 -- 172.21.15.149:0/2619136103 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b100cb4c0 con 0x7f4b100cad20 2023-11-08T19:25:30.350 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.345+0000 7f4b153e4700 1 --2- 172.21.15.149:0/2619136103 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b100cad20 0x7f4b1006ab80 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f4b10067f90 tx=0x7f4b0c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=210dc41c9955eaf1 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:30.350 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.345+0000 7f4b14be3700 1 -- 172.21.15.149:0/2619136103 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c011830 con 0x7f4b100cad20 2023-11-08T19:25:30.350 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.345+0000 7f4b14be3700 1 -- 172.21.15.149:0/2619136103 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b0c011990 con 0x7f4b100cad20 2023-11-08T19:25:30.350 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.345+0000 7f4b14be3700 1 -- 172.21.15.149:0/2619136103 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c011d20 con 0x7f4b100cad20 2023-11-08T19:25:30.351 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.346+0000 7f4b17e49700 1 -- 172.21.15.149:0/2619136103 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b100cad20 msgr2=0x7f4b1006ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:30.351 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.346+0000 7f4b17e49700 1 --2- 172.21.15.149:0/2619136103 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b100cad20 0x7f4b1006ab80 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f4b10067f90 tx=0x7f4b0c009bd0 comp rx=0 tx=0).stop 2023-11-08T19:25:30.351 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.346+0000 7f4b17e49700 1 -- 172.21.15.149:0/2619136103 shutdown_connections 2023-11-08T19:25:30.351 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.346+0000 7f4b17e49700 1 --2- 172.21.15.149:0/2619136103 >> v2:172.21.15.160:3300/0 conn(0x7f4b1015dc00 0x7f4b100b27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:30.352 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.346+0000 7f4b17e49700 1 --2- 172.21.15.149:0/2619136103 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b100cad20 0x7f4b1006ab80 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:30.352 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.346+0000 7f4b17e49700 1 -- 172.21.15.149:0/2619136103 >> 172.21.15.149:0/2619136103 conn(0x7f4b1006dfd0 msgr2=0x7f4b1006e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:30.352 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.346+0000 7f4b17e49700 1 -- 172.21.15.149:0/2619136103 shutdown_connections 2023-11-08T19:25:30.352 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.346+0000 7f4b17e49700 1 -- 172.21.15.149:0/2619136103 wait complete. 2023-11-08T19:25:30.355 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.347+0000 7f4b17e49700 1 Processor -- start 2023-11-08T19:25:30.355 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.347+0000 7f4b17e49700 1 -- start start 2023-11-08T19:25:30.355 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.348+0000 7f4b17e49700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b100b2d30 0x7f4b100c5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:30.356 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.348+0000 7f4b17e49700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b100cad20 0x7f4b10159ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:30.356 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.348+0000 7f4b17e49700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4b1015dc00 0x7f4b100c3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:30.356 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.348+0000 7f4b17e49700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b100c4a40 con 0x7f4b100b2d30 2023-11-08T19:25:30.356 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.348+0000 7f4b17e49700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b100c4d20 con 0x7f4b100cad20 2023-11-08T19:25:30.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.348+0000 7f4b17e49700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b100c5000 con 0x7f4b1015dc00 2023-11-08T19:25:30.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.348+0000 7f4b15be5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b100b2d30 0x7f4b100c5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:30.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.348+0000 7f4b15be5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b100b2d30 0x7f4b100c5ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41196/0 (socket says 172.21.15.149:41196) 2023-11-08T19:25:30.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.348+0000 7f4b15be5700 1 -- 172.21.15.149:0/3582647377 learned_addr learned my addr 172.21.15.149:0/3582647377 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:30.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.348+0000 7f4b153e4700 1 --2- 172.21.15.149:0/3582647377 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b100cad20 0x7f4b10159ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:30.360 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.348+0000 7f4b163e6700 1 --2- 172.21.15.149:0/3582647377 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4b1015dc00 0x7f4b100c3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:30.360 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.348+0000 7f4b15be5700 1 -- 172.21.15.149:0/3582647377 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4b1015dc00 msgr2=0x7f4b100c3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:30.360 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.348+0000 7f4b15be5700 1 --2- 172.21.15.149:0/3582647377 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4b1015dc00 0x7f4b100c3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:30.360 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.348+0000 7f4b15be5700 1 -- 172.21.15.149:0/3582647377 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b100cad20 msgr2=0x7f4b10159ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:30.361 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.348+0000 7f4b15be5700 1 --2- 172.21.15.149:0/3582647377 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b100cad20 0x7f4b10159ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:30.361 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.348+0000 7f4b15be5700 1 -- 172.21.15.149:0/3582647377 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b0c009550 con 0x7f4b100b2d30 2023-11-08T19:25:30.361 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.349+0000 7f4b15be5700 1 --2- 172.21.15.149:0/3582647377 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b100b2d30 0x7f4b100c5ae0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f4b0000e870 tx=0x7f4b0000eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:30.361 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.349+0000 7f4b067fc700 1 -- 172.21.15.149:0/3582647377 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b00009590 con 0x7f4b100b2d30 2023-11-08T19:25:30.361 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.349+0000 7f4b067fc700 1 -- 172.21.15.149:0/3582647377 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b00013680 con 0x7f4b100b2d30 2023-11-08T19:25:30.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.349+0000 7f4b17e49700 1 -- 172.21.15.149:0/3582647377 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b100c52e0 con 0x7f4b100b2d30 2023-11-08T19:25:30.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.349+0000 7f4b067fc700 1 -- 172.21.15.149:0/3582647377 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b000139f0 con 0x7f4b100b2d30 2023-11-08T19:25:30.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.349+0000 7f4b17e49700 1 -- 172.21.15.149:0/3582647377 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b1015a000 con 0x7f4b100b2d30 2023-11-08T19:25:30.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.350+0000 7f4b17e49700 1 -- 172.21.15.149:0/3582647377 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b100c5930 con 0x7f4b100b2d30 2023-11-08T19:25:30.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.350+0000 7f4b067fc700 1 -- 172.21.15.149:0/3582647377 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4b00013b50 con 0x7f4b100b2d30 2023-11-08T19:25:30.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.351+0000 7f4b067fc700 1 --2- 172.21.15.149:0/3582647377 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4af406af00 0x7f4af406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:30.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.351+0000 7f4b067fc700 1 -- 172.21.15.149:0/3582647377 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5900+0+0 (secure 0 0 0) 0x7f4b000894b0 con 0x7f4b100b2d30 2023-11-08T19:25:30.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.351+0000 7f4b153e4700 1 --2- 172.21.15.149:0/3582647377 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4af406af00 0x7f4af406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:30.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.351+0000 7f4b153e4700 1 --2- 172.21.15.149:0/3582647377 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4af406af00 0x7f4af406d3c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c009c10 tx=0x7f4b0c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:30.364 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.356+0000 7f4b067fc700 1 -- 172.21.15.149:0/3582647377 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4b000544a0 con 0x7f4b100b2d30 2023-11-08T19:25:30.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:30.547+0000 7f4b17e49700 1 -- 172.21.15.149:0/3582647377 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f4b100cb770 con 0x7f4b100b2d30 2023-11-08T19:25:30.808 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-11-08T19:25:31.204 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.203+0000 7f4b067fc700 1 -- 172.21.15.149:0/3582647377 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v65) v1 ==== 170+0+0 (secure 0 0 0) 0x7f4b00057ac0 con 0x7f4b100b2d30 2023-11-08T19:25:31.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.206+0000 7f4b17e49700 1 -- 172.21.15.149:0/3582647377 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4af406af00 msgr2=0x7f4af406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:31.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.206+0000 7f4b17e49700 1 --2- 172.21.15.149:0/3582647377 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4af406af00 0x7f4af406d3c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c009c10 tx=0x7f4b0c008030 comp rx=0 tx=0).stop 2023-11-08T19:25:31.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.206+0000 7f4b17e49700 1 -- 172.21.15.149:0/3582647377 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b100b2d30 msgr2=0x7f4b100c5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:31.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.206+0000 7f4b17e49700 1 --2- 172.21.15.149:0/3582647377 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b100b2d30 0x7f4b100c5ae0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f4b0000e870 tx=0x7f4b0000eb80 comp rx=0 tx=0).stop 2023-11-08T19:25:31.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.206+0000 7f4b17e49700 1 -- 172.21.15.149:0/3582647377 shutdown_connections 2023-11-08T19:25:31.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.206+0000 7f4b17e49700 1 --2- 172.21.15.149:0/3582647377 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4af406af00 0x7f4af406d3c0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:31.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.206+0000 7f4b17e49700 1 --2- 172.21.15.149:0/3582647377 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4b1015dc00 0x7f4b100c3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:31.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.206+0000 7f4b17e49700 1 --2- 172.21.15.149:0/3582647377 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b100b2d30 0x7f4b100c5ae0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:31.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.206+0000 7f4b17e49700 1 --2- 172.21.15.149:0/3582647377 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b100cad20 0x7f4b10159ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:31.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.206+0000 7f4b17e49700 1 -- 172.21.15.149:0/3582647377 >> 172.21.15.149:0/3582647377 conn(0x7f4b1006dfd0 msgr2=0x7f4b1015bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:31.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.206+0000 7f4b17e49700 1 -- 172.21.15.149:0/3582647377 shutdown_connections 2023-11-08T19:25:31.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.206+0000 7f4b17e49700 1 -- 172.21.15.149:0/3582647377 wait complete. 2023-11-08T19:25:31.211 INFO:teuthology.orchestra.run.smithi149.stderr:pool 'cephfs_data' created 2023-11-08T19:25:31.234 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-08T19:25:31.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.362+0000 7f32a2354700 1 Processor -- start 2023-11-08T19:25:31.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.362+0000 7f32a2354700 1 -- start start 2023-11-08T19:25:31.367 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.363+0000 7f32a2354700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f329c06ab80 0x7f329c0caf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:31.367 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.363+0000 7f32a2354700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f329c0cf1c0 0x7f329c0cb490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:31.367 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.363+0000 7f32a2354700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f329c15e320 con 0x7f329c15df40 2023-11-08T19:25:31.367 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.363+0000 7f32a2354700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f329c06b020 con 0x7f329c0cf1c0 2023-11-08T19:25:31.368 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.363+0000 7f32a2354700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f329c06b2e0 con 0x7f329c06ab80 2023-11-08T19:25:31.368 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.363+0000 7f32a08f1700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f329c0cf1c0 0x7f329c0cb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:31.368 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.363+0000 7f32a08f1700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f329c0cf1c0 0x7f329c0cb490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41208/0 (socket says 172.21.15.149:41208) 2023-11-08T19:25:31.368 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.363+0000 7f32a08f1700 1 -- 172.21.15.149:0/2548447206 learned_addr learned my addr 172.21.15.149:0/2548447206 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:31.369 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.363+0000 7f329b7fe700 1 --2- 172.21.15.149:0/2548447206 >> v2:172.21.15.160:3300/0 conn(0x7f329c06ab80 0x7f329c0caf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:31.369 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.363+0000 7f32a08f1700 1 -- 172.21.15.149:0/2548447206 >> v2:172.21.15.160:3300/0 conn(0x7f329c06ab80 msgr2=0x7f329c0caf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:31.369 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.363+0000 7f32a08f1700 1 --2- 172.21.15.149:0/2548447206 >> v2:172.21.15.160:3300/0 conn(0x7f329c06ab80 0x7f329c0caf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:31.369 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.363+0000 7f32a08f1700 1 -- 172.21.15.149:0/2548447206 >> v1:172.21.15.160:6789/0 conn(0x7f329c15df40 legacy=0x7f329c06c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:31.370 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.363+0000 7f32a08f1700 1 -- 172.21.15.149:0/2548447206 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f329c06b5c0 con 0x7f329c0cf1c0 2023-11-08T19:25:31.370 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.363+0000 7f329b7fe700 1 --2- 172.21.15.149:0/2548447206 >> v2:172.21.15.160:3300/0 conn(0x7f329c06ab80 0x7f329c0caf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:25:31.370 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.363+0000 7f32a08f1700 1 --2- 172.21.15.149:0/2548447206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f329c0cf1c0 0x7f329c0cb490 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f329c06d940 tx=0x7f329400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=191c42cd385ad350 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:31.370 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.364+0000 7f329affd700 1 -- 172.21.15.149:0/2548447206 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f329400e070 con 0x7f329c0cf1c0 2023-11-08T19:25:31.371 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.364+0000 7f329affd700 1 -- 172.21.15.149:0/2548447206 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3294003a20 con 0x7f329c0cf1c0 2023-11-08T19:25:31.371 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.364+0000 7f329affd700 1 -- 172.21.15.149:0/2548447206 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3294003dd0 con 0x7f329c0cf1c0 2023-11-08T19:25:31.371 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.364+0000 7f32a2354700 1 -- 172.21.15.149:0/2548447206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f329c0cf1c0 msgr2=0x7f329c0cb490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:31.371 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.364+0000 7f32a2354700 1 --2- 172.21.15.149:0/2548447206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f329c0cf1c0 0x7f329c0cb490 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f329c06d940 tx=0x7f329400b330 comp rx=0 tx=0).stop 2023-11-08T19:25:31.372 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.364+0000 7f32a2354700 1 -- 172.21.15.149:0/2548447206 shutdown_connections 2023-11-08T19:25:31.372 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.364+0000 7f32a2354700 1 --2- 172.21.15.149:0/2548447206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f329c0cf1c0 0x7f329c0cb490 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:31.372 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.364+0000 7f32a2354700 1 --2- 172.21.15.149:0/2548447206 >> v2:172.21.15.160:3300/0 conn(0x7f329c06ab80 0x7f329c0caf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:31.372 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.364+0000 7f32a2354700 1 -- 172.21.15.149:0/2548447206 >> 172.21.15.149:0/2548447206 conn(0x7f329c0d0640 msgr2=0x7f329c0d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:31.373 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.364+0000 7f32a2354700 1 -- 172.21.15.149:0/2548447206 shutdown_connections 2023-11-08T19:25:31.373 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.364+0000 7f32a2354700 1 -- 172.21.15.149:0/2548447206 wait complete. 2023-11-08T19:25:31.373 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.365+0000 7f32a2354700 1 Processor -- start 2023-11-08T19:25:31.374 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.366+0000 7f32a2354700 1 -- start start 2023-11-08T19:25:31.379 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.366+0000 7f32a2354700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f329c06ab80 0x7f329c0c82b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:31.379 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.366+0000 7f32a2354700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f329c0cf1c0 0x7f329c0ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:31.379 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.366+0000 7f32a2354700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f329c15df40 0x7f329c158870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:31.379 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.366+0000 7f32a2354700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f329c0c87f0 con 0x7f329c15df40 2023-11-08T19:25:31.380 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.366+0000 7f32a2354700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f329c0ace00 con 0x7f329c06ab80 2023-11-08T19:25:31.380 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.366+0000 7f32a2354700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f329c0ad060 con 0x7f329c0cf1c0 2023-11-08T19:25:31.380 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.366+0000 7f32a08f1700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f329c15df40 0x7f329c158870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:31.380 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.366+0000 7f32a08f1700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f329c15df40 0x7f329c158870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41212/0 (socket says 172.21.15.149:41212) 2023-11-08T19:25:31.380 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.366+0000 7f32a08f1700 1 -- 172.21.15.149:0/1450521217 learned_addr learned my addr 172.21.15.149:0/1450521217 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:31.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.366+0000 7f329b7fe700 1 --2- 172.21.15.149:0/1450521217 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f329c0cf1c0 0x7f329c0ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:31.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.367+0000 7f329bfff700 1 --2- 172.21.15.149:0/1450521217 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f329c06ab80 0x7f329c0c82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:31.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.367+0000 7f32a08f1700 1 -- 172.21.15.149:0/1450521217 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f329c0cf1c0 msgr2=0x7f329c0ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:31.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.367+0000 7f32a08f1700 1 --2- 172.21.15.149:0/1450521217 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f329c0cf1c0 0x7f329c0ac8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:31.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.367+0000 7f32a08f1700 1 -- 172.21.15.149:0/1450521217 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f329c06ab80 msgr2=0x7f329c0c82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:31.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.367+0000 7f32a08f1700 1 --2- 172.21.15.149:0/1450521217 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f329c06ab80 0x7f329c0c82b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:31.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.367+0000 7f32a08f1700 1 -- 172.21.15.149:0/1450521217 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3294009b30 con 0x7f329c15df40 2023-11-08T19:25:31.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.367+0000 7f32a08f1700 1 --2- 172.21.15.149:0/1450521217 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f329c15df40 0x7f329c158870 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f3294015040 tx=0x7f3294004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:31.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.367+0000 7f3298ff9700 1 -- 172.21.15.149:0/1450521217 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3294004440 con 0x7f329c15df40 2023-11-08T19:25:31.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.367+0000 7f3298ff9700 1 -- 172.21.15.149:0/1450521217 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32940045a0 con 0x7f329c15df40 2023-11-08T19:25:31.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.367+0000 7f32a2354700 1 -- 172.21.15.149:0/1450521217 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f329c0ad340 con 0x7f329c15df40 2023-11-08T19:25:31.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.367+0000 7f3298ff9700 1 -- 172.21.15.149:0/1450521217 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3294004950 con 0x7f329c15df40 2023-11-08T19:25:31.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.367+0000 7f32a2354700 1 -- 172.21.15.149:0/1450521217 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f329c0ad900 con 0x7f329c15df40 2023-11-08T19:25:31.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.368+0000 7f32a2354700 1 -- 172.21.15.149:0/1450521217 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f329c04f730 con 0x7f329c15df40 2023-11-08T19:25:31.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.368+0000 7f3298ff9700 1 -- 172.21.15.149:0/1450521217 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3294012430 con 0x7f329c15df40 2023-11-08T19:25:31.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.369+0000 7f3298ff9700 1 --2- 172.21.15.149:0/1450521217 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f328806af00 0x7f328806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:31.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.369+0000 7f3298ff9700 1 -- 172.21.15.149:0/1450521217 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6282+0+0 (secure 0 0 0) 0x7f329408ad50 con 0x7f329c15df40 2023-11-08T19:25:31.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.369+0000 7f329bfff700 1 --2- 172.21.15.149:0/1450521217 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f328806af00 0x7f328806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:31.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.369+0000 7f329bfff700 1 --2- 172.21.15.149:0/1450521217 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f328806af00 0x7f328806d3c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3290009870 tx=0x7f3290008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:31.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.374+0000 7f3298ff9700 1 -- 172.21.15.149:0/1450521217 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f329408e030 con 0x7f329c15df40 2023-11-08T19:25:31.608 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:31.607+0000 7f32a2354700 1 -- 172.21.15.149:0/1450521217 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f329c1614e0 con 0x7f329c15df40 2023-11-08T19:25:32.216 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.215+0000 7f3298ff9700 1 -- 172.21.15.149:0/1450521217 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v31) v1 ==== 174+0+0 (secure 0 0 0) 0x7f3294059660 con 0x7f329c15df40 2023-11-08T19:25:32.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.223+0000 7f32a2354700 1 -- 172.21.15.149:0/1450521217 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f328806af00 msgr2=0x7f328806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:32.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.223+0000 7f32a2354700 1 --2- 172.21.15.149:0/1450521217 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f328806af00 0x7f328806d3c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3290009870 tx=0x7f3290008040 comp rx=0 tx=0).stop 2023-11-08T19:25:32.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.223+0000 7f32a2354700 1 -- 172.21.15.149:0/1450521217 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f329c15df40 msgr2=0x7f329c158870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:32.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.223+0000 7f32a2354700 1 --2- 172.21.15.149:0/1450521217 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f329c15df40 0x7f329c158870 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f3294015040 tx=0x7f3294004ad0 comp rx=0 tx=0).stop 2023-11-08T19:25:32.227 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.226+0000 7f32a2354700 1 -- 172.21.15.149:0/1450521217 shutdown_connections 2023-11-08T19:25:32.227 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.226+0000 7f32a2354700 1 --2- 172.21.15.149:0/1450521217 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f328806af00 0x7f328806d3c0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:32.227 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.226+0000 7f32a2354700 1 --2- 172.21.15.149:0/1450521217 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f329c06ab80 0x7f329c0c82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:32.227 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.226+0000 7f32a2354700 1 --2- 172.21.15.149:0/1450521217 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f329c15df40 0x7f329c158870 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:32.227 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.226+0000 7f32a2354700 1 --2- 172.21.15.149:0/1450521217 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f329c0cf1c0 0x7f329c0ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:32.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.226+0000 7f32a2354700 1 -- 172.21.15.149:0/1450521217 >> 172.21.15.149:0/1450521217 conn(0x7f329c0d0640 msgr2=0x7f329c0c38a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:32.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.226+0000 7f32a2354700 1 -- 172.21.15.149:0/1450521217 shutdown_connections 2023-11-08T19:25:32.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.226+0000 7f32a2354700 1 -- 172.21.15.149:0/1450521217 wait complete. 2023-11-08T19:25:32.230 INFO:teuthology.orchestra.run.smithi149.stderr:new fs with metadata pool 10 and data pool 11 2023-11-08T19:25:32.248 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:25:32.369 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.368+0000 7ff5e370d700 1 Processor -- start 2023-11-08T19:25:32.370 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.369+0000 7ff5e370d700 1 -- start start 2023-11-08T19:25:32.372 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.369+0000 7ff5e370d700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7ff5dc0cc140 0x7ff5dc0cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:32.373 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.369+0000 7ff5e370d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff5dc0b2850 0x7ff5dc0cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:32.373 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.369+0000 7ff5e370d700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5dc0cce50 con 0x7ff5dc0b2cd0 2023-11-08T19:25:32.373 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.369+0000 7ff5e370d700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5dc0b2430 con 0x7ff5dc0b2850 2023-11-08T19:25:32.373 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.369+0000 7ff5e370d700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5dc0cc520 con 0x7ff5dc0cc140 2023-11-08T19:25:32.373 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.370+0000 7ff5e0ca8700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff5dc0b2850 0x7ff5dc0cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:32.374 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.370+0000 7ff5e1caa700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7ff5dc0b2cd0 0x7ff5dc15d2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:43234/0 (socket says 172.21.15.149:43234) 2023-11-08T19:25:32.374 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.370+0000 7ff5e1caa700 1 -- 172.21.15.149:0/884294280 learned_addr learned my addr 172.21.15.149:0/884294280 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:25:32.374 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.370+0000 7ff5e14a9700 1 --2- 172.21.15.149:0/884294280 >> v2:172.21.15.160:3300/0 conn(0x7ff5dc0cc140 0x7ff5dc0cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:32.374 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.370+0000 7ff5e0ca8700 1 -- 172.21.15.149:0/884294280 >> v2:172.21.15.160:3300/0 conn(0x7ff5dc0cc140 msgr2=0x7ff5dc0cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:32.374 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.370+0000 7ff5d3fff700 1 -- 172.21.15.149:0/884294280 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2660928375 0 0) 0x7ff5dc0cce50 con 0x7ff5dc0b2cd0 2023-11-08T19:25:32.375 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.370+0000 7ff5e0ca8700 1 --2- 172.21.15.149:0/884294280 >> v2:172.21.15.160:3300/0 conn(0x7ff5dc0cc140 0x7ff5dc0cc910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:32.375 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.370+0000 7ff5e0ca8700 1 -- 172.21.15.149:0/884294280 >> v1:172.21.15.149:6789/0 conn(0x7ff5dc0b2cd0 legacy=0x7ff5dc15d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:32.375 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.370+0000 7ff5e0ca8700 1 -- 172.21.15.149:0/884294280 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5dc0b17b0 con 0x7ff5dc0b2850 2023-11-08T19:25:32.375 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.370+0000 7ff5e0ca8700 1 --2- 172.21.15.149:0/884294280 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5dc0b2850 0x7ff5dc0cabf0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc0ce120 tx=0x7ff5d8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=415df27af83e108e server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:32.376 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.370+0000 7ff5d3fff700 1 -- 172.21.15.149:0/884294280 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d8011830 con 0x7ff5dc0b2850 2023-11-08T19:25:32.376 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.370+0000 7ff5d3fff700 1 -- 172.21.15.149:0/884294280 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5d8011990 con 0x7ff5dc0b2850 2023-11-08T19:25:32.376 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.370+0000 7ff5d3fff700 1 -- 172.21.15.149:0/884294280 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d8011d20 con 0x7ff5dc0b2850 2023-11-08T19:25:32.376 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.371+0000 7ff5e370d700 1 -- 172.21.15.149:0/884294280 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5dc0b2850 msgr2=0x7ff5dc0cabf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:32.376 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.371+0000 7ff5e370d700 1 --2- 172.21.15.149:0/884294280 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5dc0b2850 0x7ff5dc0cabf0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc0ce120 tx=0x7ff5d8009b20 comp rx=0 tx=0).stop 2023-11-08T19:25:32.376 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.371+0000 7ff5e370d700 1 -- 172.21.15.149:0/884294280 shutdown_connections 2023-11-08T19:25:32.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.371+0000 7ff5e370d700 1 --2- 172.21.15.149:0/884294280 >> v2:172.21.15.160:3300/0 conn(0x7ff5dc0cc140 0x7ff5dc0cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:32.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.371+0000 7ff5e370d700 1 --2- 172.21.15.149:0/884294280 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5dc0b2850 0x7ff5dc0cabf0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:32.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.371+0000 7ff5e370d700 1 -- 172.21.15.149:0/884294280 >> 172.21.15.149:0/884294280 conn(0x7ff5dc099a40 msgr2=0x7ff5dc0d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:32.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.371+0000 7ff5e370d700 1 -- 172.21.15.149:0/884294280 shutdown_connections 2023-11-08T19:25:32.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.371+0000 7ff5e370d700 1 -- 172.21.15.149:0/884294280 wait complete. 2023-11-08T19:25:32.380 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.372+0000 7ff5e370d700 1 Processor -- start 2023-11-08T19:25:32.380 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.372+0000 7ff5e370d700 1 -- start start 2023-11-08T19:25:32.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.373+0000 7ff5e370d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff5dc0b2850 0x7ff5dc154ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:32.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.373+0000 7ff5e370d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff5dc0b2cd0 0x7ff5dc0c55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:32.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.373+0000 7ff5e370d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5dc0cc140 0x7ff5dc0b4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:32.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.373+0000 7ff5e370d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5dc0b3940 con 0x7ff5dc0cc140 2023-11-08T19:25:32.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.373+0000 7ff5e370d700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5dc0b3f00 con 0x7ff5dc0b2850 2023-11-08T19:25:32.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.373+0000 7ff5e370d700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5dc0c8fc0 con 0x7ff5dc0b2cd0 2023-11-08T19:25:32.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.373+0000 7ff5e1caa700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5dc0cc140 0x7ff5dc0b4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:32.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.373+0000 7ff5e1caa700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5dc0cc140 0x7ff5dc0b4390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41238/0 (socket says 172.21.15.149:41238) 2023-11-08T19:25:32.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.373+0000 7ff5e1caa700 1 -- 172.21.15.149:0/3327415897 learned_addr learned my addr 172.21.15.149:0/3327415897 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:32.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.373+0000 7ff5e14a9700 1 --2- 172.21.15.149:0/3327415897 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff5dc0b2850 0x7ff5dc154ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:32.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.373+0000 7ff5e1caa700 1 -- 172.21.15.149:0/3327415897 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff5dc0b2cd0 msgr2=0x7ff5dc0c55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:32.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.373+0000 7ff5e0ca8700 1 --2- 172.21.15.149:0/3327415897 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff5dc0b2cd0 0x7ff5dc0c55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:32.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.373+0000 7ff5e1caa700 1 --2- 172.21.15.149:0/3327415897 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff5dc0b2cd0 0x7ff5dc0c55f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:32.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.373+0000 7ff5e1caa700 1 -- 172.21.15.149:0/3327415897 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff5dc0b2850 msgr2=0x7ff5dc154ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:32.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.373+0000 7ff5e1caa700 1 --2- 172.21.15.149:0/3327415897 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff5dc0b2850 0x7ff5dc154ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:32.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.373+0000 7ff5e1caa700 1 -- 172.21.15.149:0/3327415897 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d80094a0 con 0x7ff5dc0cc140 2023-11-08T19:25:32.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.373+0000 7ff5e1caa700 1 --2- 172.21.15.149:0/3327415897 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5dc0cc140 0x7ff5dc0b4390 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7ff5d400cc70 tx=0x7ff5d400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:32.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.373+0000 7ff5d1ffb700 1 -- 172.21.15.149:0/3327415897 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d400ad80 con 0x7ff5dc0cc140 2023-11-08T19:25:32.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.373+0000 7ff5d1ffb700 1 -- 172.21.15.149:0/3327415897 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5d400ce70 con 0x7ff5dc0cc140 2023-11-08T19:25:32.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.373+0000 7ff5e370d700 1 -- 172.21.15.149:0/3327415897 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5dc0c92a0 con 0x7ff5dc0cc140 2023-11-08T19:25:32.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.373+0000 7ff5d1ffb700 1 -- 172.21.15.149:0/3327415897 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d40072f0 con 0x7ff5dc0cc140 2023-11-08T19:25:32.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.374+0000 7ff5e370d700 1 -- 172.21.15.149:0/3327415897 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5dc0c5b30 con 0x7ff5dc0cc140 2023-11-08T19:25:32.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.375+0000 7ff5e370d700 1 -- 172.21.15.149:0/3327415897 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5dc0b4070 con 0x7ff5dc0cc140 2023-11-08T19:25:32.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.375+0000 7ff5d1ffb700 1 -- 172.21.15.149:0/3327415897 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff5d4007450 con 0x7ff5dc0cc140 2023-11-08T19:25:32.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.375+0000 7ff5d1ffb700 1 --2- 172.21.15.149:0/3327415897 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff5c006af00 0x7ff5c006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:32.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.375+0000 7ff5d1ffb700 1 -- 172.21.15.149:0/3327415897 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7ff5d4089790 con 0x7ff5dc0cc140 2023-11-08T19:25:32.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.375+0000 7ff5e14a9700 1 --2- 172.21.15.149:0/3327415897 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff5c006af00 0x7ff5c006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:32.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.376+0000 7ff5e14a9700 1 --2- 172.21.15.149:0/3327415897 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff5c006af00 0x7ff5c006d3c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc006fd0 tx=0x7ff5cc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:32.387 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.380+0000 7ff5d1ffb700 1 -- 172.21.15.149:0/3327415897 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff5d40545a0 con 0x7ff5dc0cc140 2023-11-08T19:25:32.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.573+0000 7ff5e370d700 1 -- 172.21.15.149:0/3327415897 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff5dc0745f0 con 0x7ff5dc0cc140 2023-11-08T19:25:32.576 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.575+0000 7ff5d1ffb700 1 -- 172.21.15.149:0/3327415897 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+18575 (secure 0 0 0) 0x7ff5d4057bc0 con 0x7ff5dc0cc140 2023-11-08T19:25:32.576 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:25:32.576 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":66,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:25:31.608607+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-08T19:24:29.516185+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-08T19:25:29.341646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-08T19:25:30.566751+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:25:32.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.577+0000 7ff5e370d700 1 -- 172.21.15.149:0/3327415897 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff5c006af00 msgr2=0x7ff5c006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:32.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.577+0000 7ff5e370d700 1 --2- 172.21.15.149:0/3327415897 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff5c006af00 0x7ff5c006d3c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc006fd0 tx=0x7ff5cc008040 comp rx=0 tx=0).stop 2023-11-08T19:25:32.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.577+0000 7ff5e370d700 1 -- 172.21.15.149:0/3327415897 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5dc0cc140 msgr2=0x7ff5dc0b4390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:32.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.577+0000 7ff5e370d700 1 --2- 172.21.15.149:0/3327415897 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5dc0cc140 0x7ff5dc0b4390 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7ff5d400cc70 tx=0x7ff5d400a340 comp rx=0 tx=0).stop 2023-11-08T19:25:32.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.577+0000 7ff5e370d700 1 -- 172.21.15.149:0/3327415897 shutdown_connections 2023-11-08T19:25:32.580 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.577+0000 7ff5e370d700 1 --2- 172.21.15.149:0/3327415897 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff5c006af00 0x7ff5c006d3c0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:32.580 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.577+0000 7ff5e370d700 1 --2- 172.21.15.149:0/3327415897 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff5dc0b2850 0x7ff5dc154ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:32.580 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.577+0000 7ff5e370d700 1 --2- 172.21.15.149:0/3327415897 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5dc0cc140 0x7ff5dc0b4390 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:32.581 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.577+0000 7ff5e370d700 1 --2- 172.21.15.149:0/3327415897 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff5dc0b2cd0 0x7ff5dc0c55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:32.581 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.577+0000 7ff5e370d700 1 -- 172.21.15.149:0/3327415897 >> 172.21.15.149:0/3327415897 conn(0x7ff5dc099a40 msgr2=0x7ff5dc0c7750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:32.581 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.577+0000 7ff5e370d700 1 -- 172.21.15.149:0/3327415897 shutdown_connections 2023-11-08T19:25:32.581 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.577+0000 7ff5e370d700 1 -- 172.21.15.149:0/3327415897 wait complete. 2023-11-08T19:25:32.591 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:25:32.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.711+0000 7f796a3ea700 1 Processor -- start 2023-11-08T19:25:32.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.711+0000 7f796a3ea700 1 -- start start 2023-11-08T19:25:32.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.712+0000 7f796a3ea700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f796415b950 0x7f79640ce130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:32.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.712+0000 7f796a3ea700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79640cc2e0 con 0x7f79640cd5e0 2023-11-08T19:25:32.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.712+0000 7f796a3ea700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79640cc580 con 0x7f79640d0430 2023-11-08T19:25:32.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.712+0000 7f796a3ea700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79640cc820 con 0x7f796415b950 2023-11-08T19:25:32.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.712+0000 7f7963fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f796415b950 0x7f79640ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:32.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.712+0000 7f7963fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f796415b950 0x7f79640ce130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41242/0 (socket says 172.21.15.149:41242) 2023-11-08T19:25:32.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.712+0000 7f7963fff700 1 -- 172.21.15.149:0/1760180265 learned_addr learned my addr 172.21.15.149:0/1760180265 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:32.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.712+0000 7f79637fe700 1 --1- 172.21.15.149:0/1760180265 >> v1:172.21.15.149:6789/0 conn(0x7f79640cd5e0 0x7f79640cfd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:43244/0 (socket says 172.21.15.149:43244) 2023-11-08T19:25:32.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.712+0000 7f7963fff700 1 -- 172.21.15.149:0/1760180265 >> v1:172.21.15.160:6789/0 conn(0x7f79640d0430 legacy=0x7f79641658e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:32.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.712+0000 7f7963fff700 1 -- 172.21.15.149:0/1760180265 >> v1:172.21.15.149:6789/0 conn(0x7f79640cd5e0 legacy=0x7f79640cfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:32.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.712+0000 7f7963fff700 1 -- 172.21.15.149:0/1760180265 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79640ccb00 con 0x7f796415b950 2023-11-08T19:25:32.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.713+0000 7f7963fff700 1 --2- 172.21.15.149:0/1760180265 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f796415b950 0x7f79640ce130 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f7958006fd0 tx=0x7f7958009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec2d2ad061fad62a server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:32.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.713+0000 7f7962ffd700 1 -- 172.21.15.149:0/1760180265 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7958005e30 con 0x7f796415b950 2023-11-08T19:25:32.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.713+0000 7f7962ffd700 1 -- 172.21.15.149:0/1760180265 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7958006030 con 0x7f796415b950 2023-11-08T19:25:32.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.713+0000 7f7962ffd700 1 -- 172.21.15.149:0/1760180265 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79580063e0 con 0x7f796415b950 2023-11-08T19:25:32.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.713+0000 7f796a3ea700 1 -- 172.21.15.149:0/1760180265 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f796415b950 msgr2=0x7f79640ce130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:32.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.713+0000 7f796a3ea700 1 --2- 172.21.15.149:0/1760180265 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f796415b950 0x7f79640ce130 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f7958006fd0 tx=0x7f7958009bd0 comp rx=0 tx=0).stop 2023-11-08T19:25:32.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.713+0000 7f796a3ea700 1 -- 172.21.15.149:0/1760180265 shutdown_connections 2023-11-08T19:25:32.719 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.713+0000 7f796a3ea700 1 --2- 172.21.15.149:0/1760180265 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f796415b950 0x7f79640ce130 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:32.719 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.713+0000 7f796a3ea700 1 -- 172.21.15.149:0/1760180265 >> 172.21.15.149:0/1760180265 conn(0x7f796408afd0 msgr2=0x7f79640d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:32.719 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.713+0000 7f796a3ea700 1 -- 172.21.15.149:0/1760180265 shutdown_connections 2023-11-08T19:25:32.719 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.713+0000 7f796a3ea700 1 -- 172.21.15.149:0/1760180265 wait complete. 2023-11-08T19:25:32.722 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.715+0000 7f796a3ea700 1 Processor -- start 2023-11-08T19:25:32.723 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.715+0000 7f796a3ea700 1 -- start start 2023-11-08T19:25:32.723 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.715+0000 7f796a3ea700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79640d0430 0x7f79641f0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:32.723 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.715+0000 7f796a3ea700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f796415b950 0x7f796406ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:32.723 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.715+0000 7f796a3ea700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f796415e2e0 0x7f796415c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:32.723 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.715+0000 7f796a3ea700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79641554c0 con 0x7f796415e2e0 2023-11-08T19:25:32.724 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.715+0000 7f796a3ea700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79641f1060 con 0x7f79640d0430 2023-11-08T19:25:32.724 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.715+0000 7f796a3ea700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79640707e0 con 0x7f796415b950 2023-11-08T19:25:32.724 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.716+0000 7f7968987700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f796415e2e0 0x7f796415c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:32.724 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.716+0000 7f7968987700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f796415e2e0 0x7f796415c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41250/0 (socket says 172.21.15.149:41250) 2023-11-08T19:25:32.724 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.716+0000 7f7968987700 1 -- 172.21.15.149:0/4128717992 learned_addr learned my addr 172.21.15.149:0/4128717992 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:32.725 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.716+0000 7f7963fff700 1 --2- 172.21.15.149:0/4128717992 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79640d0430 0x7f79641f0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:32.725 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.716+0000 7f79637fe700 1 --2- 172.21.15.149:0/4128717992 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f796415b950 0x7f796406ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:32.725 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.716+0000 7f7968987700 1 -- 172.21.15.149:0/4128717992 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f796415b950 msgr2=0x7f796406ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:32.725 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.716+0000 7f7968987700 1 --2- 172.21.15.149:0/4128717992 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f796415b950 0x7f796406ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:32.726 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.716+0000 7f7968987700 1 -- 172.21.15.149:0/4128717992 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79640d0430 msgr2=0x7f79641f0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:32.726 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.716+0000 7f7968987700 1 --2- 172.21.15.149:0/4128717992 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79640d0430 0x7f79641f0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:32.726 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.716+0000 7f7968987700 1 -- 172.21.15.149:0/4128717992 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7958009500 con 0x7f796415e2e0 2023-11-08T19:25:32.726 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.716+0000 7f79637fe700 1 --2- 172.21.15.149:0/4128717992 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f796415b950 0x7f796406ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:25:32.726 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.716+0000 7f7963fff700 1 --2- 172.21.15.149:0/4128717992 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79640d0430 0x7f79641f0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:25:32.727 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.716+0000 7f7968987700 1 --2- 172.21.15.149:0/4128717992 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f796415e2e0 0x7f796415c180 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f795c00cc40 tx=0x7f795c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:32.727 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.716+0000 7f7960ff9700 1 -- 172.21.15.149:0/4128717992 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795c00ab40 con 0x7f796415e2e0 2023-11-08T19:25:32.727 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.716+0000 7f7960ff9700 1 -- 172.21.15.149:0/4128717992 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f795c00aca0 con 0x7f796415e2e0 2023-11-08T19:25:32.727 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.716+0000 7f796a3ea700 1 -- 172.21.15.149:0/4128717992 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7964070350 con 0x7f796415e2e0 2023-11-08T19:25:32.727 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.716+0000 7f7960ff9700 1 -- 172.21.15.149:0/4128717992 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795c012660 con 0x7f796415e2e0 2023-11-08T19:25:32.728 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.716+0000 7f796a3ea700 1 -- 172.21.15.149:0/4128717992 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f796406fa20 con 0x7f796415e2e0 2023-11-08T19:25:32.728 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.717+0000 7f796a3ea700 1 -- 172.21.15.149:0/4128717992 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79640704e0 con 0x7f796415e2e0 2023-11-08T19:25:32.729 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.718+0000 7f7960ff9700 1 -- 172.21.15.149:0/4128717992 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f795c0127c0 con 0x7f796415e2e0 2023-11-08T19:25:32.729 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.718+0000 7f7960ff9700 1 --2- 172.21.15.149:0/4128717992 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f795006af00 0x7f795006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:32.729 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.718+0000 7f7960ff9700 1 -- 172.21.15.149:0/4128717992 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f795c089fe0 con 0x7f796415e2e0 2023-11-08T19:25:32.729 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.718+0000 7f7963fff700 1 --2- 172.21.15.149:0/4128717992 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f795006af00 0x7f795006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:32.729 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.719+0000 7f7963fff700 1 --2- 172.21.15.149:0/4128717992 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f795006af00 0x7f795006d3c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f7958013040 tx=0x7f7958008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:32.730 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.723+0000 7f7960ff9700 1 -- 172.21.15.149:0/4128717992 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f795c054df0 con 0x7f796415e2e0 2023-11-08T19:25:32.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.912+0000 7f796a3ea700 1 -- 172.21.15.149:0/4128717992 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f79640745f0 con 0x7f796415e2e0 2023-11-08T19:25:32.914 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.913+0000 7f7960ff9700 1 -- 172.21.15.149:0/4128717992 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+18575 (secure 0 0 0) 0x7f795c016020 con 0x7f796415e2e0 2023-11-08T19:25:32.915 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:25:32.915 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":66,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:25:31.608607+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-08T19:24:29.516185+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-08T19:25:29.341646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-08T19:25:30.566751+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:25:32.917 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.916+0000 7f796a3ea700 1 -- 172.21.15.149:0/4128717992 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f795006af00 msgr2=0x7f795006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:32.918 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.916+0000 7f796a3ea700 1 --2- 172.21.15.149:0/4128717992 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f795006af00 0x7f795006d3c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f7958013040 tx=0x7f7958008070 comp rx=0 tx=0).stop 2023-11-08T19:25:32.918 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.916+0000 7f796a3ea700 1 -- 172.21.15.149:0/4128717992 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f796415e2e0 msgr2=0x7f796415c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:32.918 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.916+0000 7f796a3ea700 1 --2- 172.21.15.149:0/4128717992 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f796415e2e0 0x7f796415c180 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f795c00cc40 tx=0x7f795c00a060 comp rx=0 tx=0).stop 2023-11-08T19:25:32.919 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.916+0000 7f796a3ea700 1 -- 172.21.15.149:0/4128717992 shutdown_connections 2023-11-08T19:25:32.919 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.916+0000 7f796a3ea700 1 --2- 172.21.15.149:0/4128717992 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f795006af00 0x7f795006d3c0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:32.919 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.916+0000 7f796a3ea700 1 --2- 172.21.15.149:0/4128717992 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79640d0430 0x7f79641f0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:32.919 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.916+0000 7f796a3ea700 1 --2- 172.21.15.149:0/4128717992 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f796415e2e0 0x7f796415c180 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:32.920 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.916+0000 7f796a3ea700 1 --2- 172.21.15.149:0/4128717992 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f796415b950 0x7f796406ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:32.920 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.916+0000 7f796a3ea700 1 -- 172.21.15.149:0/4128717992 >> 172.21.15.149:0/4128717992 conn(0x7f796408afd0 msgr2=0x7f79640b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:32.920 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.916+0000 7f796a3ea700 1 -- 172.21.15.149:0/4128717992 shutdown_connections 2023-11-08T19:25:32.920 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:32.916+0000 7f796a3ea700 1 -- 172.21.15.149:0/4128717992 wait complete. 2023-11-08T19:25:32.930 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-08T19:25:33.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:33.052+0000 7f035b3a9700 1 Processor -- start 2023-11-08T19:25:33.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:33.053+0000 7f035b3a9700 1 -- start start 2023-11-08T19:25:33.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:33.053+0000 7f035b3a9700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f035415abf0 0x7f03540b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:33.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:33.053+0000 7f035b3a9700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03540cc870 0x7f035406bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:33.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:33.053+0000 7f035b3a9700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03540b6470 con 0x7f03540d1130 2023-11-08T19:25:33.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:33.053+0000 7f035b3a9700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03540b66a0 con 0x7f035415abf0 2023-11-08T19:25:33.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:33.053+0000 7f035b3a9700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03540d04a0 con 0x7f03540cc870 2023-11-08T19:25:33.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:33.054+0000 7f0359145700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f035415abf0 0x7f03540b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:33.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:33.054+0000 7f0359946700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03540cc870 0x7f035406bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:33.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:33.054+0000 7f0359946700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03540cc870 0x7f035406bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.149:33314/0 (socket says 172.21.15.149:33314) 2023-11-08T19:25:33.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:33.054+0000 7f0359145700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f035415abf0 0x7f03540b5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.149:42246/0 (socket says 172.21.15.149:42246) 2023-11-08T19:25:33.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:33.054+0000 7f0359946700 1 -- 172.21.15.149:0/1531807292 learned_addr learned my addr 172.21.15.149:0/1531807292 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:33.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:33.054+0000 7f0358944700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f03540d1130 0x7f03540cc160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.149:54922/0 (socket says 172.21.15.149:54922) 2023-11-08T19:25:33.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:33.054+0000 7f0359946700 1 -- 172.21.15.149:0/1531807292 >> v2:172.21.15.160:3300/0 conn(0x7f035415abf0 msgr2=0x7f03540b5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:33.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:33.054+0000 7f0359946700 1 --2- 172.21.15.149:0/1531807292 >> v2:172.21.15.160:3300/0 conn(0x7f035415abf0 0x7f03540b5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:33.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:33.054+0000 7f0359946700 1 -- 172.21.15.149:0/1531807292 >> v1:172.21.15.160:6789/0 conn(0x7f03540d1130 legacy=0x7f03540cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:33.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:33.054+0000 7f0359946700 1 -- 172.21.15.149:0/1531807292 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f035415afd0 con 0x7f03540cc870 2023-11-08T19:25:33.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:33.054+0000 7f034bfff700 1 -- 172.21.15.149:0/1531807292 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3151637561 0 0) 0x7f03540b6470 con 0x7f03540d1130 2023-11-08T19:25:33.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:33.054+0000 7f0359145700 1 --2- 172.21.15.149:0/1531807292 >> v2:172.21.15.160:3300/0 conn(0x7f035415abf0 0x7f03540b5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:25:33.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:33.054+0000 7f0359946700 1 --2- 172.21.15.149:0/1531807292 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03540cc870 0x7f035406bc90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f034c00d150 tx=0x7f034c00d460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9756058e43b7ed78 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:33.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:33.054+0000 7f034bfff700 1 -- 172.21.15.149:0/1531807292 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034c010070 con 0x7f03540cc870 2023-11-08T19:25:33.061 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:33.054+0000 7f034bfff700 1 -- 172.21.15.149:0/1531807292 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f034c00dd10 con 0x7f03540cc870 2023-11-08T19:25:33.061 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:33.054+0000 7f034bfff700 1 -- 172.21.15.149:0/1531807292 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034c00b310 con 0x7f03540cc870 2023-11-08T19:25:33.061 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:33.055+0000 7f035b3a9700 1 -- 172.21.15.149:0/1531807292 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03540cc870 msgr2=0x7f035406bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:33.061 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:33.055+0000 7f035b3a9700 1 --2- 172.21.15.149:0/1531807292 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03540cc870 0x7f035406bc90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f034c00d150 tx=0x7f034c00d460 comp rx=0 tx=0).stop 2023-11-08T19:25:33.061 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:33.055+0000 7f035b3a9700 1 -- 172.21.15.149:0/1531807292 shutdown_connections 2023-11-08T19:25:33.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:33.055+0000 7f035b3a9700 1 --2- 172.21.15.149:0/1531807292 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03540cc870 0x7f035406bc90 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:33.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:33.055+0000 7f035b3a9700 1 --2- 172.21.15.149:0/1531807292 >> v2:172.21.15.160:3300/0 conn(0x7f035415abf0 0x7f03540b5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:33.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:33.055+0000 7f035b3a9700 1 -- 172.21.15.149:0/1531807292 >> 172.21.15.149:0/1531807292 conn(0x7f03540d0640 msgr2=0x7f03540d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:33.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:33.055+0000 7f035b3a9700 1 -- 172.21.15.149:0/1531807292 shutdown_connections 2023-11-08T19:25:33.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:33.055+0000 7f035b3a9700 1 -- 172.21.15.149:0/1531807292 wait complete. 2023-11-08T19:25:33.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:33.056+0000 7f035b3a9700 1 Processor -- start 2023-11-08T19:25:33.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:33.056+0000 7f035b3a9700 1 -- start start 2023-11-08T19:25:33.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:33.057+0000 7f035b3a9700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03540cc870 0x7f0354152c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:33.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:33.057+0000 7f035b3a9700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03540d1130 0x7f03540c9900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:33.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:33.057+0000 7f035b3a9700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f035415abf0 0x7f03540c9e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:33.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:33.057+0000 7f035b3a9700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03541531d0 con 0x7f03540cc870 2023-11-08T19:25:33.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:33.057+0000 7f035b3a9700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03540c84b0 con 0x7f035415abf0 2023-11-08T19:25:33.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:33.057+0000 7f035b3a9700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03540c8790 con 0x7f03540d1130 2023-11-08T19:25:33.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:33.057+0000 7f0359145700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03540cc870 0x7f0354152c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:33.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:33.057+0000 7f0359145700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03540cc870 0x7f0354152c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41262/0 (socket says 172.21.15.149:41262) 2023-11-08T19:25:33.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:33.057+0000 7f0358944700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03540d1130 0x7f03540c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:33.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:33.057+0000 7f0359145700 1 -- 172.21.15.149:0/4034540690 learned_addr learned my addr 172.21.15.149:0/4034540690 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:33.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:33.057+0000 7f0359946700 1 --2- 172.21.15.149:0/4034540690 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f035415abf0 0x7f03540c9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:33.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:33.058+0000 7f0359145700 1 -- 172.21.15.149:0/4034540690 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03540d1130 msgr2=0x7f03540c9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:33.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:33.058+0000 7f0359145700 1 --2- 172.21.15.149:0/4034540690 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03540d1130 0x7f03540c9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:33.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:33.058+0000 7f0359145700 1 -- 172.21.15.149:0/4034540690 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f035415abf0 msgr2=0x7f03540c9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:33.070 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:33.058+0000 7f0359145700 1 --2- 172.21.15.149:0/4034540690 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f035415abf0 0x7f03540c9e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:33.070 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:33.058+0000 7f0359145700 1 -- 172.21.15.149:0/4034540690 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03440094a0 con 0x7f03540cc870 2023-11-08T19:25:33.070 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:33.058+0000 7f0359145700 1 --2- 172.21.15.149:0/4034540690 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03540cc870 0x7f0354152c90 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f034400ebe0 tx=0x7f034400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:33.070 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:33.058+0000 7f0349ffb700 1 -- 172.21.15.149:0/4034540690 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034400c850 con 0x7f03540cc870 2023-11-08T19:25:33.071 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:33.058+0000 7f0349ffb700 1 -- 172.21.15.149:0/4034540690 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f034400c9b0 con 0x7f03540cc870 2023-11-08T19:25:33.071 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:33.058+0000 7f035b3a9700 1 -- 172.21.15.149:0/4034540690 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f034c00bd40 con 0x7f03540cc870 2023-11-08T19:25:33.071 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:33.058+0000 7f0349ffb700 1 -- 172.21.15.149:0/4034540690 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034400cd40 con 0x7f03540cc870 2023-11-08T19:25:33.071 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:33.058+0000 7f035b3a9700 1 -- 172.21.15.149:0/4034540690 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f035415c9c0 con 0x7f03540cc870 2023-11-08T19:25:33.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:33.059+0000 7f035b3a9700 1 -- 172.21.15.149:0/4034540690 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f035415cb50 con 0x7f03540cc870 2023-11-08T19:25:33.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:33.060+0000 7f0349ffb700 1 -- 172.21.15.149:0/4034540690 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0344013470 con 0x7f03540cc870 2023-11-08T19:25:33.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:33.060+0000 7f0349ffb700 1 --2- 172.21.15.149:0/4034540690 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f033806af00 0x7f033806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:33.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:33.060+0000 7f0349ffb700 1 -- 172.21.15.149:0/4034540690 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f03440898f0 con 0x7f03540cc870 2023-11-08T19:25:33.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:33.060+0000 7f0358944700 1 --2- 172.21.15.149:0/4034540690 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f033806af00 0x7f033806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:33.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:33.061+0000 7f0358944700 1 --2- 172.21.15.149:0/4034540690 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f033806af00 0x7f033806d3c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f03541f0440 tx=0x7f0350007e70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:33.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:33.065+0000 7f0349ffb700 1 -- 172.21.15.149:0/4034540690 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f03440546f0 con 0x7f03540cc870 2023-11-08T19:25:33.302 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:33.301+0000 7f035b3a9700 1 -- 172.21.15.149:0/4034540690 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f035404f730 con 0x7f03540cc870 2023-11-08T19:25:34.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.227+0000 7f0349ffb700 1 -- 172.21.15.149:0/4034540690 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v34) v1 ==== 118+0+0 (secure 0 0 0) 0x7f034400cea0 con 0x7f03540cc870 2023-11-08T19:25:34.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.230+0000 7f035b3a9700 1 -- 172.21.15.149:0/4034540690 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f033806af00 msgr2=0x7f033806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:34.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.230+0000 7f035b3a9700 1 --2- 172.21.15.149:0/4034540690 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f033806af00 0x7f033806d3c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f03541f0440 tx=0x7f0350007e70 comp rx=0 tx=0).stop 2023-11-08T19:25:34.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.230+0000 7f035b3a9700 1 -- 172.21.15.149:0/4034540690 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03540cc870 msgr2=0x7f0354152c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:34.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.230+0000 7f035b3a9700 1 --2- 172.21.15.149:0/4034540690 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03540cc870 0x7f0354152c90 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f034400ebe0 tx=0x7f034400eef0 comp rx=0 tx=0).stop 2023-11-08T19:25:34.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.231+0000 7f035b3a9700 1 -- 172.21.15.149:0/4034540690 shutdown_connections 2023-11-08T19:25:34.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.231+0000 7f035b3a9700 1 --2- 172.21.15.149:0/4034540690 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f033806af00 0x7f033806d3c0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:34.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.231+0000 7f035b3a9700 1 --2- 172.21.15.149:0/4034540690 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f035415abf0 0x7f03540c9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:34.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.231+0000 7f035b3a9700 1 --2- 172.21.15.149:0/4034540690 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03540cc870 0x7f0354152c90 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:34.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.231+0000 7f035b3a9700 1 --2- 172.21.15.149:0/4034540690 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03540d1130 0x7f03540c9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:34.234 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.231+0000 7f035b3a9700 1 -- 172.21.15.149:0/4034540690 >> 172.21.15.149:0/4034540690 conn(0x7f03540d0640 msgr2=0x7f03540d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:34.234 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.231+0000 7f035b3a9700 1 -- 172.21.15.149:0/4034540690 shutdown_connections 2023-11-08T19:25:34.234 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.231+0000 7f035b3a9700 1 -- 172.21.15.149:0/4034540690 wait complete. 2023-11-08T19:25:34.247 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-08T19:25:34.247 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-08T19:25:34.379 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.376+0000 7faa2f465700 1 Processor -- start 2023-11-08T19:25:34.380 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.376+0000 7faa2f465700 1 -- start start 2023-11-08T19:25:34.380 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.377+0000 7faa2f465700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faa2815abf0 0x7faa280b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:34.380 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.377+0000 7faa2f465700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa280b6470 con 0x7faa280d1130 2023-11-08T19:25:34.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.377+0000 7faa2f465700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa2815afd0 con 0x7faa280cc870 2023-11-08T19:25:34.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.377+0000 7faa2f465700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa280b66a0 con 0x7faa2815abf0 2023-11-08T19:25:34.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.377+0000 7faa2ca00700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7faa280d1130 0x7faa280cc160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:43270/0 (socket says 172.21.15.149:43270) 2023-11-08T19:25:34.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.377+0000 7faa2ca00700 1 -- 172.21.15.149:0/1399117446 learned_addr learned my addr 172.21.15.149:0/1399117446 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:25:34.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.377+0000 7faa2d201700 1 --2- 172.21.15.149:0/1399117446 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faa2815abf0 0x7faa280b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:34.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.378+0000 7faa1ffff700 1 -- 172.21.15.149:0/1399117446 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1646280779 0 0) 0x7faa280b6470 con 0x7faa280d1130 2023-11-08T19:25:34.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.378+0000 7faa1ffff700 1 -- 172.21.15.149:0/1399117446 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa140035b0 con 0x7faa280d1130 2023-11-08T19:25:34.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.378+0000 7faa1ffff700 1 -- 172.21.15.149:0/1399117446 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2634825463 0 0) 0x7faa2815afd0 con 0x7faa280cc870 2023-11-08T19:25:34.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.378+0000 7faa1ffff700 1 -- 172.21.15.149:0/1399117446 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa280b6470 con 0x7faa280cc870 2023-11-08T19:25:34.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.378+0000 7faa2d201700 1 -- 172.21.15.149:0/1399117446 >> v1:172.21.15.160:6789/0 conn(0x7faa280cc870 legacy=0x7faa2806bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:34.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.378+0000 7faa2d201700 1 -- 172.21.15.149:0/1399117446 >> v1:172.21.15.149:6789/0 conn(0x7faa280d1130 legacy=0x7faa280cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:34.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.378+0000 7faa2d201700 1 -- 172.21.15.149:0/1399117446 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa2815e880 con 0x7faa2815abf0 2023-11-08T19:25:34.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.378+0000 7faa2d201700 1 --2- 172.21.15.149:0/1399117446 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faa2815abf0 0x7faa280b5f30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7faa24009870 tx=0x7faa24009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d20c3ac779a07c1d server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:34.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.378+0000 7faa1ffff700 1 -- 172.21.15.149:0/1399117446 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa18001670 con 0x7faa2815abf0 2023-11-08T19:25:34.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.378+0000 7faa1ffff700 1 -- 172.21.15.149:0/1399117446 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa24004030 con 0x7faa2815abf0 2023-11-08T19:25:34.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.378+0000 7faa1ffff700 1 -- 172.21.15.149:0/1399117446 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa240043c0 con 0x7faa2815abf0 2023-11-08T19:25:34.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.379+0000 7faa2f465700 1 -- 172.21.15.149:0/1399117446 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faa2815abf0 msgr2=0x7faa280b5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:34.387 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.379+0000 7faa2f465700 1 --2- 172.21.15.149:0/1399117446 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faa2815abf0 0x7faa280b5f30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7faa24009870 tx=0x7faa24009b80 comp rx=0 tx=0).stop 2023-11-08T19:25:34.387 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.379+0000 7faa2f465700 1 -- 172.21.15.149:0/1399117446 shutdown_connections 2023-11-08T19:25:34.387 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.379+0000 7faa2f465700 1 --2- 172.21.15.149:0/1399117446 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faa2815abf0 0x7faa280b5f30 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:34.387 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.379+0000 7faa2f465700 1 -- 172.21.15.149:0/1399117446 >> 172.21.15.149:0/1399117446 conn(0x7faa280d0640 msgr2=0x7faa280d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:34.387 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.379+0000 7faa2f465700 1 -- 172.21.15.149:0/1399117446 shutdown_connections 2023-11-08T19:25:34.388 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.379+0000 7faa2f465700 1 -- 172.21.15.149:0/1399117446 wait complete. 2023-11-08T19:25:34.388 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.380+0000 7faa2f465700 1 Processor -- start 2023-11-08T19:25:34.388 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.380+0000 7faa2f465700 1 -- start start 2023-11-08T19:25:34.389 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.381+0000 7faa2f465700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa280cc870 0x7faa280b5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:34.389 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.381+0000 7faa2f465700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faa280d1130 0x7faa2815ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:34.389 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.381+0000 7faa2f465700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faa2815abf0 0x7faa2814b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:34.389 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.381+0000 7faa2f465700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa280b6260 con 0x7faa280cc870 2023-11-08T19:25:34.389 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.381+0000 7faa2f465700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa2815b9b0 con 0x7faa280d1130 2023-11-08T19:25:34.390 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.381+0000 7faa2f465700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa2815bc90 con 0x7faa2815abf0 2023-11-08T19:25:34.390 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.381+0000 7faa2d201700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa280cc870 0x7faa280b5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:34.390 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.381+0000 7faa2d201700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa280cc870 0x7faa280b5d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41274/0 (socket says 172.21.15.149:41274) 2023-11-08T19:25:34.390 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.381+0000 7faa2d201700 1 -- 172.21.15.149:0/2281296272 learned_addr learned my addr 172.21.15.149:0/2281296272 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:34.390 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.381+0000 7faa2ca00700 1 --2- 172.21.15.149:0/2281296272 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faa280d1130 0x7faa2815ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:34.391 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.381+0000 7faa2da02700 1 --2- 172.21.15.149:0/2281296272 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faa2815abf0 0x7faa2814b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:34.391 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.382+0000 7faa2d201700 1 -- 172.21.15.149:0/2281296272 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faa2815abf0 msgr2=0x7faa2814b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:34.391 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.382+0000 7faa2d201700 1 --2- 172.21.15.149:0/2281296272 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faa2815abf0 0x7faa2814b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:34.393 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.382+0000 7faa2d201700 1 -- 172.21.15.149:0/2281296272 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faa280d1130 msgr2=0x7faa2815ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:34.393 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.382+0000 7faa2d201700 1 --2- 172.21.15.149:0/2281296272 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faa280d1130 0x7faa2815ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:34.394 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.382+0000 7faa2d201700 1 -- 172.21.15.149:0/2281296272 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa240094a0 con 0x7faa280cc870 2023-11-08T19:25:34.394 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.382+0000 7faa2d201700 1 --2- 172.21.15.149:0/2281296272 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa280cc870 0x7faa280b5d20 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7faa240097c0 tx=0x7faa24004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:34.394 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.382+0000 7faa1dffb700 1 -- 172.21.15.149:0/2281296272 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa24003ea0 con 0x7faa280cc870 2023-11-08T19:25:34.394 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.382+0000 7faa1dffb700 1 -- 172.21.15.149:0/2281296272 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa24010590 con 0x7faa280cc870 2023-11-08T19:25:34.394 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.382+0000 7faa2f465700 1 -- 172.21.15.149:0/2281296272 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa2815bf70 con 0x7faa280cc870 2023-11-08T19:25:34.395 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.382+0000 7faa1dffb700 1 -- 172.21.15.149:0/2281296272 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa24010940 con 0x7faa280cc870 2023-11-08T19:25:34.395 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.382+0000 7faa2f465700 1 -- 172.21.15.149:0/2281296272 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa2815c530 con 0x7faa280cc870 2023-11-08T19:25:34.395 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.383+0000 7faa2f465700 1 -- 172.21.15.149:0/2281296272 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa280afed0 con 0x7faa280cc870 2023-11-08T19:25:34.395 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.384+0000 7faa1dffb700 1 -- 172.21.15.149:0/2281296272 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faa24010aa0 con 0x7faa280cc870 2023-11-08T19:25:34.395 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.384+0000 7faa1dffb700 1 --2- 172.21.15.149:0/2281296272 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7faa0c06af00 0x7faa0c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:34.396 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.384+0000 7faa1dffb700 1 -- 172.21.15.149:0/2281296272 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6382+0+0 (secure 0 0 0) 0x7faa2408aff0 con 0x7faa280cc870 2023-11-08T19:25:34.396 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.384+0000 7faa2ca00700 1 --2- 172.21.15.149:0/2281296272 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7faa0c06af00 0x7faa0c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:34.396 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.384+0000 7faa2ca00700 1 --2- 172.21.15.149:0/2281296272 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7faa0c06af00 0x7faa0c06d3c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7faa18001bb0 tx=0x7faa18001b40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:34.396 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.389+0000 7faa1dffb700 1 -- 172.21.15.149:0/2281296272 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7faa24055fb0 con 0x7faa280cc870 2023-11-08T19:25:34.626 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:34.625+0000 7faa2f465700 1 -- 172.21.15.149:0/2281296272 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7faa2804f730 con 0x7faa280cc870 2023-11-08T19:25:35.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.229+0000 7faa1dffb700 1 -- 172.21.15.149:0/2281296272 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v35) v1 ==== 122+0+0 (secure 0 0 0) 0x7faa240595d0 con 0x7faa280cc870 2023-11-08T19:25:35.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.232+0000 7faa2f465700 1 -- 172.21.15.149:0/2281296272 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7faa0c06af00 msgr2=0x7faa0c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:35.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.232+0000 7faa2f465700 1 --2- 172.21.15.149:0/2281296272 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7faa0c06af00 0x7faa0c06d3c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7faa18001bb0 tx=0x7faa18001b40 comp rx=0 tx=0).stop 2023-11-08T19:25:35.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.232+0000 7faa2f465700 1 -- 172.21.15.149:0/2281296272 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa280cc870 msgr2=0x7faa280b5d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:35.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.232+0000 7faa2f465700 1 --2- 172.21.15.149:0/2281296272 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa280cc870 0x7faa280b5d20 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7faa240097c0 tx=0x7faa24004750 comp rx=0 tx=0).stop 2023-11-08T19:25:35.234 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.232+0000 7faa2f465700 1 -- 172.21.15.149:0/2281296272 shutdown_connections 2023-11-08T19:25:35.234 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.232+0000 7faa2f465700 1 --2- 172.21.15.149:0/2281296272 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7faa0c06af00 0x7faa0c06d3c0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:35.234 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.232+0000 7faa2f465700 1 --2- 172.21.15.149:0/2281296272 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faa2815abf0 0x7faa2814b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:35.234 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.232+0000 7faa2f465700 1 --2- 172.21.15.149:0/2281296272 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa280cc870 0x7faa280b5d20 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:35.234 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.232+0000 7faa2f465700 1 --2- 172.21.15.149:0/2281296272 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faa280d1130 0x7faa2815ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:35.235 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.232+0000 7faa2f465700 1 -- 172.21.15.149:0/2281296272 >> 172.21.15.149:0/2281296272 conn(0x7faa280d0640 msgr2=0x7faa280b1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:35.235 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.232+0000 7faa2f465700 1 -- 172.21.15.149:0/2281296272 shutdown_connections 2023-11-08T19:25:35.235 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.232+0000 7faa2f465700 1 -- 172.21.15.149:0/2281296272 wait complete. 2023-11-08T19:25:35.247 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-08T19:25:35.248 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:25:35.370 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.369+0000 7f99a74b7700 1 Processor -- start 2023-11-08T19:25:35.371 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.369+0000 7f99a74b7700 1 -- start start 2023-11-08T19:25:35.375 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.370+0000 7f99a74b7700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f99a015b950 0x7f99a00ce130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:35.375 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.370+0000 7f99a74b7700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f99a00d0430 0x7f99a00ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:35.375 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.370+0000 7f99a74b7700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99a00cc2e0 con 0x7f99a00cd5e0 2023-11-08T19:25:35.375 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.370+0000 7f99a74b7700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99a00cc580 con 0x7f99a00d0430 2023-11-08T19:25:35.375 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.370+0000 7f99a74b7700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99a00cc820 con 0x7f99a015b950 2023-11-08T19:25:35.376 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.370+0000 7f99a4a52700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f99a00cd5e0 0x7f99a00cfd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:43286/0 (socket says 172.21.15.149:43286) 2023-11-08T19:25:35.376 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.370+0000 7f99a4a52700 1 -- 172.21.15.149:0/4029804115 learned_addr learned my addr 172.21.15.149:0/4029804115 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:25:35.376 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.371+0000 7f99a5253700 1 --2- 172.21.15.149:0/4029804115 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f99a015b950 0x7f99a00ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:35.376 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.371+0000 7f99a5a54700 1 --2- 172.21.15.149:0/4029804115 >> v2:172.21.15.160:3300/0 conn(0x7f99a00d0430 0x7f99a00ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:35.376 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.371+0000 7f9997fff700 1 -- 172.21.15.149:0/4029804115 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1525674589 0 0) 0x7f99a00cc2e0 con 0x7f99a00cd5e0 2023-11-08T19:25:35.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.371+0000 7f9997fff700 1 -- 172.21.15.149:0/4029804115 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f998c0035b0 con 0x7f99a00cd5e0 2023-11-08T19:25:35.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.371+0000 7f9997fff700 1 -- 172.21.15.149:0/4029804115 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 296861085 0 0) 0x7f998c0035b0 con 0x7f99a00cd5e0 2023-11-08T19:25:35.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.371+0000 7f9997fff700 1 -- 172.21.15.149:0/4029804115 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f99a015b950 msgr2=0x7f99a00ce130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:35.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.371+0000 7f9997fff700 1 --2- 172.21.15.149:0/4029804115 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f99a015b950 0x7f99a00ce130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:35.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.371+0000 7f9997fff700 1 -- 172.21.15.149:0/4029804115 >> v2:172.21.15.160:3300/0 conn(0x7f99a00d0430 msgr2=0x7f99a00ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:35.378 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.371+0000 7f9997fff700 1 --2- 172.21.15.149:0/4029804115 >> v2:172.21.15.160:3300/0 conn(0x7f99a00d0430 0x7f99a00ce670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:35.378 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.371+0000 7f9997fff700 1 -- 172.21.15.149:0/4029804115 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a00ccb00 con 0x7f99a00cd5e0 2023-11-08T19:25:35.378 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.371+0000 7f9997fff700 1 -- 172.21.15.149:0/4029804115 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f999c001670 con 0x7f99a00cd5e0 2023-11-08T19:25:35.378 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.371+0000 7f9997fff700 1 -- 172.21.15.149:0/4029804115 >> v1:172.21.15.149:6789/0 conn(0x7f99a00cd5e0 legacy=0x7f99a00cfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:35.378 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.371+0000 7f9997fff700 1 --2- 172.21.15.149:0/4029804115 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f998c003a00 0x7f998c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:35.379 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.371+0000 7f9997fff700 1 --2- 172.21.15.149:0/4029804115 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f99a015b950 0x7f998c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:35.379 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.371+0000 7f9997fff700 1 --2- 172.21.15.149:0/4029804115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f998c004d90 0x7f998c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:35.379 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.371+0000 7f9997fff700 1 -- 172.21.15.149:0/4029804115 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a00cc580 con 0x7f998c004d90 2023-11-08T19:25:35.379 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.371+0000 7f9997fff700 1 -- 172.21.15.149:0/4029804115 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a00cc820 con 0x7f998c003a00 2023-11-08T19:25:35.379 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.371+0000 7f9997fff700 1 -- 172.21.15.149:0/4029804115 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f998c00ba10 con 0x7f99a015b950 2023-11-08T19:25:35.380 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.371+0000 7f99a5a54700 1 --2- 172.21.15.149:0/4029804115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f998c004d90 0x7f998c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:35.380 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.371+0000 7f99a5253700 1 --2- 172.21.15.149:0/4029804115 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f998c003a00 0x7f998c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:35.380 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.371+0000 7f99a4a52700 1 --2- 172.21.15.149:0/4029804115 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f99a015b950 0x7f998c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:35.380 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.371+0000 7f99a5a54700 1 -- 172.21.15.149:0/4029804115 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f99a015b950 msgr2=0x7f998c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:35.380 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.371+0000 7f99a5a54700 1 --2- 172.21.15.149:0/4029804115 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f99a015b950 0x7f998c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:35.380 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.371+0000 7f99a5a54700 1 -- 172.21.15.149:0/4029804115 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f998c003a00 msgr2=0x7f998c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:35.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.371+0000 7f99a5a54700 1 --2- 172.21.15.149:0/4029804115 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f998c003a00 0x7f998c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:35.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.371+0000 7f99a5a54700 1 -- 172.21.15.149:0/4029804115 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f998c0035b0 con 0x7f998c004d90 2023-11-08T19:25:35.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.372+0000 7f99a5a54700 1 --2- 172.21.15.149:0/4029804115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f998c004d90 0x7f998c005210 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f9998009fc0 tx=0x7f998c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f181742d0df6a82 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:35.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.372+0000 7f9997fff700 1 -- 172.21.15.149:0/4029804115 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999800ec30 con 0x7f998c004d90 2023-11-08T19:25:35.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.372+0000 7f9997fff700 1 -- 172.21.15.149:0/4029804115 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f999800f040 con 0x7f998c004d90 2023-11-08T19:25:35.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.372+0000 7f9997fff700 1 -- 172.21.15.149:0/4029804115 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9998014480 con 0x7f998c004d90 2023-11-08T19:25:35.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.372+0000 7f99a74b7700 1 -- 172.21.15.149:0/4029804115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f998c004d90 msgr2=0x7f998c005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:35.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.372+0000 7f99a74b7700 1 --2- 172.21.15.149:0/4029804115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f998c004d90 0x7f998c005210 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f9998009fc0 tx=0x7f998c005880 comp rx=0 tx=0).stop 2023-11-08T19:25:35.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.372+0000 7f99a5a54700 1 -- 172.21.15.149:0/4029804115 reap_dead start 2023-11-08T19:25:35.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.372+0000 7f99a74b7700 1 -- 172.21.15.149:0/4029804115 shutdown_connections 2023-11-08T19:25:35.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.372+0000 7f99a74b7700 1 -- 172.21.15.149:0/4029804115 >> 172.21.15.149:0/4029804115 conn(0x7f99a008afd0 msgr2=0x7f99a00d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:35.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.372+0000 7f99a74b7700 1 -- 172.21.15.149:0/4029804115 shutdown_connections 2023-11-08T19:25:35.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.372+0000 7f99a74b7700 1 -- 172.21.15.149:0/4029804115 wait complete. 2023-11-08T19:25:35.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.374+0000 7f99a74b7700 1 Processor -- start 2023-11-08T19:25:35.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.374+0000 7f99a74b7700 1 -- start start 2023-11-08T19:25:35.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.374+0000 7f99a74b7700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f998c004d90 0x7f99a0159bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:35.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.374+0000 7f99a74b7700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f99a00c7db0 0x7f99a00c6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:35.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.374+0000 7f99a74b7700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f99a01f13f0 0x7f99a00b2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:35.387 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.374+0000 7f99a74b7700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a01f1db0 con 0x7f998c004d90 2023-11-08T19:25:35.387 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.374+0000 7f99a74b7700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a01f2090 con 0x7f99a00c7db0 2023-11-08T19:25:35.387 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.374+0000 7f99a74b7700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99a00c6490 con 0x7f99a01f13f0 2023-11-08T19:25:35.387 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.374+0000 7f99a5253700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f998c004d90 0x7f99a0159bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:35.387 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.374+0000 7f99a5253700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f998c004d90 0x7f99a0159bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41296/0 (socket says 172.21.15.149:41296) 2023-11-08T19:25:35.387 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.374+0000 7f99a5253700 1 -- 172.21.15.149:0/4012783802 learned_addr learned my addr 172.21.15.149:0/4012783802 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:35.388 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.375+0000 7f99a5a54700 1 --2- 172.21.15.149:0/4012783802 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f99a01f13f0 0x7f99a00b2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:35.388 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.375+0000 7f99a5253700 1 -- 172.21.15.149:0/4012783802 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f99a01f13f0 msgr2=0x7f99a00b2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:35.388 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.375+0000 7f99a5253700 1 --2- 172.21.15.149:0/4012783802 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f99a01f13f0 0x7f99a00b2fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:35.388 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.375+0000 7f99a5253700 1 -- 172.21.15.149:0/4012783802 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f99a00c7db0 msgr2=0x7f99a00c6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:35.388 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.375+0000 7f99a5253700 1 --2- 172.21.15.149:0/4012783802 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f99a00c7db0 0x7f99a00c6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:35.389 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.375+0000 7f99a5253700 1 -- 172.21.15.149:0/4012783802 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a00c6770 con 0x7f998c004d90 2023-11-08T19:25:35.389 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.375+0000 7f99a5253700 1 --2- 172.21.15.149:0/4012783802 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f998c004d90 0x7f99a0159bd0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f9990009fd0 tx=0x7f9990011d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:35.389 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.375+0000 7f9995ffb700 1 -- 172.21.15.149:0/4012783802 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9990009610 con 0x7f998c004d90 2023-11-08T19:25:35.389 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.375+0000 7f9995ffb700 1 -- 172.21.15.149:0/4012783802 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9990005c30 con 0x7f998c004d90 2023-11-08T19:25:35.389 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.375+0000 7f99a74b7700 1 -- 172.21.15.149:0/4012783802 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99a01f2370 con 0x7f998c004d90 2023-11-08T19:25:35.390 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.375+0000 7f9995ffb700 1 -- 172.21.15.149:0/4012783802 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999000f730 con 0x7f998c004d90 2023-11-08T19:25:35.390 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.375+0000 7f99a74b7700 1 -- 172.21.15.149:0/4012783802 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99a015a2f0 con 0x7f998c004d90 2023-11-08T19:25:35.390 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.376+0000 7f99a74b7700 1 -- 172.21.15.149:0/4012783802 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99a00745f0 con 0x7f998c004d90 2023-11-08T19:25:35.390 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.376+0000 7f9995ffb700 1 -- 172.21.15.149:0/4012783802 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f999000f890 con 0x7f998c004d90 2023-11-08T19:25:35.390 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.377+0000 7f9995ffb700 1 --2- 172.21.15.149:0/4012783802 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f998406af00 0x7f998406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:35.391 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.377+0000 7f9995ffb700 1 -- 172.21.15.149:0/4012783802 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f999008a0b0 con 0x7f998c004d90 2023-11-08T19:25:35.391 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.377+0000 7f99a4a52700 1 --2- 172.21.15.149:0/4012783802 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f998406af00 0x7f998406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:35.391 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.377+0000 7f99a4a52700 1 --2- 172.21.15.149:0/4012783802 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f998406af00 0x7f998406d3c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f99a00c9380 tx=0x7f999c000bc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:35.391 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.382+0000 7f9995ffb700 1 -- 172.21.15.149:0/4012783802 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9990054f80 con 0x7f998c004d90 2023-11-08T19:25:35.616 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.615+0000 7f99a74b7700 1 -- 172.21.15.149:0/4012783802 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f99a00cd0c0 con 0x7f998c004d90 2023-11-08T19:25:35.617 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.616+0000 7f9995ffb700 1 -- 172.21.15.149:0/4012783802 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4927 (secure 0 0 0) 0x7f99900585a0 con 0x7f998c004d90 2023-11-08T19:25:35.618 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:25:35.618 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5800,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/3460600894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3460600894},{"type":"v1","addr":"172.21.15.160:6834","nonce":3460600894}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":6165,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2549531465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2549531465},{"type":"v1","addr":"172.21.15.149:6835","nonce":2549531465}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":6180,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/4179310374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":4179310374},{"type":"v1","addr":"172.21.15.160:6835","nonce":4179310374}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-08T19:25:31.608945+0000","modified":"2023-11-08T19:25:34.626063+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6189},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6189":{"gid":6189,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6837/1548429999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":1548429999},{"type":"v1","addr":"172.21.15.149:6837","nonce":1548429999}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-08T19:25:35.621 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.618+0000 7f99a74b7700 1 -- 172.21.15.149:0/4012783802 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f998406af00 msgr2=0x7f998406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:35.621 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.618+0000 7f99a74b7700 1 --2- 172.21.15.149:0/4012783802 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f998406af00 0x7f998406d3c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f99a00c9380 tx=0x7f999c000bc0 comp rx=0 tx=0).stop 2023-11-08T19:25:35.621 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.618+0000 7f99a74b7700 1 -- 172.21.15.149:0/4012783802 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f998c004d90 msgr2=0x7f99a0159bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:35.622 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.618+0000 7f99a74b7700 1 --2- 172.21.15.149:0/4012783802 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f998c004d90 0x7f99a0159bd0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f9990009fd0 tx=0x7f9990011d30 comp rx=0 tx=0).stop 2023-11-08T19:25:35.622 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.618+0000 7f99a74b7700 1 -- 172.21.15.149:0/4012783802 shutdown_connections 2023-11-08T19:25:35.622 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.618+0000 7f99a74b7700 1 --2- 172.21.15.149:0/4012783802 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f998406af00 0x7f998406d3c0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:35.623 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.618+0000 7f99a74b7700 1 --2- 172.21.15.149:0/4012783802 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f99a01f13f0 0x7f99a00b2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:35.623 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.618+0000 7f99a74b7700 1 --2- 172.21.15.149:0/4012783802 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f998c004d90 0x7f99a0159bd0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:35.624 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.618+0000 7f99a74b7700 1 --2- 172.21.15.149:0/4012783802 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f99a00c7db0 0x7f99a00c6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:35.624 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.618+0000 7f99a74b7700 1 -- 172.21.15.149:0/4012783802 >> 172.21.15.149:0/4012783802 conn(0x7f99a008afd0 msgr2=0x7f99a00b0420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:35.624 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.618+0000 7f99a74b7700 1 -- 172.21.15.149:0/4012783802 shutdown_connections 2023-11-08T19:25:35.625 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.618+0000 7f99a74b7700 1 -- 172.21.15.149:0/4012783802 wait complete. 2023-11-08T19:25:35.625 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 35 2023-11-08T19:25:35.632 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:25:35.752 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.751+0000 7f1cc5197700 1 Processor -- start 2023-11-08T19:25:35.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.751+0000 7f1cc5197700 1 -- start start 2023-11-08T19:25:35.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.752+0000 7f1cc5197700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f1cc006da50 0x7f1cc006e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:35.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.752+0000 7f1cc5197700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cc00cb220 con 0x7f1cc006bb90 2023-11-08T19:25:35.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.752+0000 7f1cc5197700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cc00cb500 con 0x7f1cc015a1a0 2023-11-08T19:25:35.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.752+0000 7f1cc5197700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cc00cee10 con 0x7f1cc006da50 2023-11-08T19:25:35.760 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.752+0000 7f1cbf59e700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f1cc006bb90 0x7f1cc0164fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:43310/0 (socket says 172.21.15.149:43310) 2023-11-08T19:25:35.760 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.752+0000 7f1cbf59e700 1 -- 172.21.15.149:0/566649568 learned_addr learned my addr 172.21.15.149:0/566649568 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:25:35.760 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.752+0000 7f1cbed9d700 1 --2- 172.21.15.149:0/566649568 >> v2:172.21.15.160:3300/0 conn(0x7f1cc006da50 0x7f1cc006e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:35.760 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.752+0000 7f1cbdd9b700 1 -- 172.21.15.149:0/566649568 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1033410653 0 0) 0x7f1cc00cb220 con 0x7f1cc006bb90 2023-11-08T19:25:35.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.752+0000 7f1cbdd9b700 1 -- 172.21.15.149:0/566649568 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ca80035b0 con 0x7f1cc006bb90 2023-11-08T19:25:35.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.753+0000 7f1cbdd9b700 1 -- 172.21.15.149:0/566649568 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 99926879 0 0) 0x7f1ca80035b0 con 0x7f1cc006bb90 2023-11-08T19:25:35.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.753+0000 7f1cbdd9b700 1 -- 172.21.15.149:0/566649568 >> v2:172.21.15.160:3300/0 conn(0x7f1cc006da50 msgr2=0x7f1cc006e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:35.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.753+0000 7f1cbdd9b700 1 --2- 172.21.15.149:0/566649568 >> v2:172.21.15.160:3300/0 conn(0x7f1cc006da50 0x7f1cc006e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:35.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.753+0000 7f1cbdd9b700 1 -- 172.21.15.149:0/566649568 >> v1:172.21.15.160:6789/0 conn(0x7f1cc015a1a0 legacy=0x7f1cc00668e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:35.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.753+0000 7f1cbdd9b700 1 -- 172.21.15.149:0/566649568 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc00cb7e0 con 0x7f1cc006bb90 2023-11-08T19:25:35.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.753+0000 7f1cbdd9b700 1 -- 172.21.15.149:0/566649568 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f1cb80019f0 con 0x7f1cc006bb90 2023-11-08T19:25:35.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.753+0000 7f1cbdd9b700 1 -- 172.21.15.149:0/566649568 >> v1:172.21.15.149:6789/0 conn(0x7f1cc006bb90 legacy=0x7f1cc0164fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:35.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.753+0000 7f1cbdd9b700 1 --2- 172.21.15.149:0/566649568 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1ca8003a00 0x7f1ca8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:35.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.753+0000 7f1cbdd9b700 1 --2- 172.21.15.149:0/566649568 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ca8004850 0x7f1ca8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:35.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.753+0000 7f1cbdd9b700 1 --2- 172.21.15.149:0/566649568 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ca8005210 0x7f1ca800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:35.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.753+0000 7f1cbdd9b700 1 -- 172.21.15.149:0/566649568 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca800c080 con 0x7f1ca8005210 2023-11-08T19:25:35.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.753+0000 7f1cbdd9b700 1 -- 172.21.15.149:0/566649568 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca800c1f0 con 0x7f1ca8004850 2023-11-08T19:25:35.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.753+0000 7f1cbdd9b700 1 -- 172.21.15.149:0/566649568 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca800c3b0 con 0x7f1ca8003a00 2023-11-08T19:25:35.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.753+0000 7f1cbed9d700 1 --2- 172.21.15.149:0/566649568 >> v2:172.21.15.160:3300/0 conn(0x7f1cc006da50 0x7f1cc006e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:25:35.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.753+0000 7f1cbf59e700 1 --2- 172.21.15.149:0/566649568 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ca8005210 0x7f1ca800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:35.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.753+0000 7f1cbe59c700 1 --2- 172.21.15.149:0/566649568 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ca8004850 0x7f1ca8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:35.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.753+0000 7f1cbed9d700 1 --2- 172.21.15.149:0/566649568 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1ca8003a00 0x7f1ca8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:35.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.753+0000 7f1cbf59e700 1 -- 172.21.15.149:0/566649568 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1ca8003a00 msgr2=0x7f1ca8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:35.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.753+0000 7f1cbf59e700 1 --2- 172.21.15.149:0/566649568 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1ca8003a00 0x7f1ca8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:35.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.753+0000 7f1cbf59e700 1 -- 172.21.15.149:0/566649568 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ca8004850 msgr2=0x7f1ca8004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:35.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.753+0000 7f1cbf59e700 1 --2- 172.21.15.149:0/566649568 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ca8004850 0x7f1ca8004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:35.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.753+0000 7f1cbf59e700 1 -- 172.21.15.149:0/566649568 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca80035b0 con 0x7f1ca8005210 2023-11-08T19:25:35.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.753+0000 7f1cbf59e700 1 -- 172.21.15.149:0/566649568 reap_dead start 2023-11-08T19:25:35.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.753+0000 7f1cbf59e700 1 --2- 172.21.15.149:0/566649568 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ca8005210 0x7f1ca800ba10 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f1cb800a830 tx=0x7f1ca8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3279c22de590625f server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:35.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.753+0000 7f1cbdd9b700 1 -- 172.21.15.149:0/566649568 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb800a2f0 con 0x7f1ca8005210 2023-11-08T19:25:35.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.753+0000 7f1cbdd9b700 1 -- 172.21.15.149:0/566649568 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cb8012620 con 0x7f1ca8005210 2023-11-08T19:25:35.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.753+0000 7f1cbdd9b700 1 -- 172.21.15.149:0/566649568 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb80129d0 con 0x7f1ca8005210 2023-11-08T19:25:35.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.754+0000 7f1cc5197700 1 -- 172.21.15.149:0/566649568 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ca8005210 msgr2=0x7f1ca800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:35.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.754+0000 7f1cc5197700 1 --2- 172.21.15.149:0/566649568 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ca8005210 0x7f1ca800ba10 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f1cb800a830 tx=0x7f1ca8005880 comp rx=0 tx=0).stop 2023-11-08T19:25:35.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.754+0000 7f1cc5197700 1 -- 172.21.15.149:0/566649568 shutdown_connections 2023-11-08T19:25:35.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.754+0000 7f1cc5197700 1 --2- 172.21.15.149:0/566649568 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ca8005210 0x7f1ca800ba10 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:35.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.754+0000 7f1cc5197700 1 -- 172.21.15.149:0/566649568 >> 172.21.15.149:0/566649568 conn(0x7f1cc0071720 msgr2=0x7f1cc0071b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:35.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.754+0000 7f1cc5197700 1 -- 172.21.15.149:0/566649568 shutdown_connections 2023-11-08T19:25:35.770 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.754+0000 7f1cc5197700 1 -- 172.21.15.149:0/566649568 wait complete. 2023-11-08T19:25:35.770 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.755+0000 7f1cc5197700 1 Processor -- start 2023-11-08T19:25:35.770 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.755+0000 7f1cc5197700 1 -- start start 2023-11-08T19:25:35.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.756+0000 7f1cc5197700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ca8005210 0x7f1cc01f1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:35.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.756+0000 7f1cc5197700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1cc014b730 0x7f1cc00c9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:35.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.756+0000 7f1cc5197700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1cc00c9960 0x7f1cc00c57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:35.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.756+0000 7f1cc5197700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc00c6f70 con 0x7f1ca8005210 2023-11-08T19:25:35.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.756+0000 7f1cc5197700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc00c71e0 con 0x7f1cc00c9960 2023-11-08T19:25:35.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.756+0000 7f1cc5197700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc00c74c0 con 0x7f1cc014b730 2023-11-08T19:25:35.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.756+0000 7f1cbed9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ca8005210 0x7f1cc01f1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:35.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.756+0000 7f1cbed9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ca8005210 0x7f1cc01f1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41316/0 (socket says 172.21.15.149:41316) 2023-11-08T19:25:35.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.756+0000 7f1cbed9d700 1 -- 172.21.15.149:0/1384506485 learned_addr learned my addr 172.21.15.149:0/1384506485 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:35.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.756+0000 7f1cbf59e700 1 --2- 172.21.15.149:0/1384506485 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1cc00c9960 0x7f1cc00c57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:35.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.756+0000 7f1cbe59c700 1 --2- 172.21.15.149:0/1384506485 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1cc014b730 0x7f1cc00c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:35.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.757+0000 7f1cbed9d700 1 -- 172.21.15.149:0/1384506485 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1cc014b730 msgr2=0x7f1cc00c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:35.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.757+0000 7f1cbed9d700 1 --2- 172.21.15.149:0/1384506485 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1cc014b730 0x7f1cc00c9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:35.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.757+0000 7f1cbed9d700 1 -- 172.21.15.149:0/1384506485 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1cc00c9960 msgr2=0x7f1cc00c57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:35.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.757+0000 7f1cbed9d700 1 --2- 172.21.15.149:0/1384506485 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1cc00c9960 0x7f1cc00c57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:35.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.757+0000 7f1cbed9d700 1 -- 172.21.15.149:0/1384506485 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc00c77a0 con 0x7f1ca8005210 2023-11-08T19:25:35.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.757+0000 7f1cbed9d700 1 --2- 172.21.15.149:0/1384506485 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ca8005210 0x7f1cc01f1c00 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f1cb4010a30 tx=0x7f1cb4010d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:35.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.757+0000 7f1ca77fe700 1 -- 172.21.15.149:0/1384506485 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb4010ed0 con 0x7f1ca8005210 2023-11-08T19:25:35.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.757+0000 7f1ca77fe700 1 -- 172.21.15.149:0/1384506485 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cb400e870 con 0x7f1ca8005210 2023-11-08T19:25:35.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.757+0000 7f1cc5197700 1 -- 172.21.15.149:0/1384506485 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cc01f2140 con 0x7f1ca8005210 2023-11-08T19:25:35.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.757+0000 7f1ca77fe700 1 -- 172.21.15.149:0/1384506485 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb400ebe0 con 0x7f1ca8005210 2023-11-08T19:25:35.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.757+0000 7f1cc5197700 1 -- 172.21.15.149:0/1384506485 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cc014bbb0 con 0x7f1ca8005210 2023-11-08T19:25:35.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.758+0000 7f1cc5197700 1 -- 172.21.15.149:0/1384506485 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cc00c7b10 con 0x7f1ca8005210 2023-11-08T19:25:35.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.758+0000 7f1ca77fe700 1 -- 172.21.15.149:0/1384506485 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1cb400ed40 con 0x7f1ca8005210 2023-11-08T19:25:35.779 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.759+0000 7f1ca77fe700 1 --2- 172.21.15.149:0/1384506485 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1cac06af00 0x7f1cac06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:35.779 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.759+0000 7f1ca77fe700 1 -- 172.21.15.149:0/1384506485 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f1cb4089bb0 con 0x7f1ca8005210 2023-11-08T19:25:35.779 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.759+0000 7f1cbe59c700 1 --2- 172.21.15.149:0/1384506485 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1cac06af00 0x7f1cac06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:35.780 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.759+0000 7f1cbe59c700 1 --2- 172.21.15.149:0/1384506485 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1cac06af00 0x7f1cac06d3c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1cc00c6520 tx=0x7f1cb0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:35.780 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.764+0000 7f1ca77fe700 1 -- 172.21.15.149:0/1384506485 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1cb4054a50 con 0x7f1ca8005210 2023-11-08T19:25:35.953 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.952+0000 7f1cc5197700 1 -- 172.21.15.149:0/1384506485 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1cc00745f0 con 0x7f1ca8005210 2023-11-08T19:25:35.954 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.953+0000 7f1ca77fe700 1 -- 172.21.15.149:0/1384506485 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+18562 (secure 0 0 0) 0x7f1cb4058070 con 0x7f1ca8005210 2023-11-08T19:25:35.955 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:25:35.955 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":67,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:25:33.213614+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-08T19:24:29.516185+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-08T19:25:29.341646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-08T19:25:30.566751+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:25:35.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.956+0000 7f1cc5197700 1 -- 172.21.15.149:0/1384506485 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1cac06af00 msgr2=0x7f1cac06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:35.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.956+0000 7f1cc5197700 1 --2- 172.21.15.149:0/1384506485 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1cac06af00 0x7f1cac06d3c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1cc00c6520 tx=0x7f1cb0009040 comp rx=0 tx=0).stop 2023-11-08T19:25:35.958 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.956+0000 7f1cc5197700 1 -- 172.21.15.149:0/1384506485 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ca8005210 msgr2=0x7f1cc01f1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:35.958 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.956+0000 7f1cc5197700 1 --2- 172.21.15.149:0/1384506485 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ca8005210 0x7f1cc01f1c00 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f1cb4010a30 tx=0x7f1cb4010d40 comp rx=0 tx=0).stop 2023-11-08T19:25:35.958 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.956+0000 7f1cc5197700 1 -- 172.21.15.149:0/1384506485 shutdown_connections 2023-11-08T19:25:35.958 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.956+0000 7f1cc5197700 1 --2- 172.21.15.149:0/1384506485 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1cac06af00 0x7f1cac06d3c0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:35.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.956+0000 7f1cc5197700 1 --2- 172.21.15.149:0/1384506485 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1cc00c9960 0x7f1cc00c57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:35.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.956+0000 7f1cc5197700 1 --2- 172.21.15.149:0/1384506485 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ca8005210 0x7f1cc01f1c00 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:35.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.956+0000 7f1cc5197700 1 --2- 172.21.15.149:0/1384506485 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1cc014b730 0x7f1cc00c9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:35.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.956+0000 7f1cc5197700 1 -- 172.21.15.149:0/1384506485 >> 172.21.15.149:0/1384506485 conn(0x7f1cc0071720 msgr2=0x7f1cc006de30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:35.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.956+0000 7f1cc5197700 1 -- 172.21.15.149:0/1384506485 shutdown_connections 2023-11-08T19:25:35.960 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:35.956+0000 7f1cc5197700 1 -- 172.21.15.149:0/1384506485 wait complete. 2023-11-08T19:25:35.970 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-08T19:25:35.970 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:25:36.092 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.090+0000 7f5b20240700 1 Processor -- start 2023-11-08T19:25:36.092 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.090+0000 7f5b20240700 1 -- start start 2023-11-08T19:25:36.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.091+0000 7f5b20240700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b1815bc70 0x7f5b180cde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:36.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.091+0000 7f5b20240700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f5b1815c050 0x7f5b180ce3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:36.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.091+0000 7f5b20240700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f5b180ce8e0 0x7f5b180cf510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:36.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.091+0000 7f5b20240700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b180b4990 con 0x7f5b180ce8e0 2023-11-08T19:25:36.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.091+0000 7f5b20240700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b180b2b60 con 0x7f5b1815c050 2023-11-08T19:25:36.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.091+0000 7f5b20240700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b180cd680 con 0x7f5b1815bc70 2023-11-08T19:25:36.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.091+0000 7f5b1e7dd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f5b180ce8e0 0x7f5b180cf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:36.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.091+0000 7f5b1e7dd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f5b180ce8e0 0x7f5b180cf510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41328/0 (socket says 172.21.15.149:41328) 2023-11-08T19:25:36.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.091+0000 7f5b1e7dd700 1 -- 172.21.15.149:0/263337726 learned_addr learned my addr 172.21.15.149:0/263337726 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:36.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.091+0000 7f5b1dfdc700 1 --2- 172.21.15.149:0/263337726 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b1815bc70 0x7f5b180cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:36.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.092+0000 7f5b1d7db700 1 --2- 172.21.15.149:0/263337726 >> v2:172.21.15.160:3300/0 conn(0x7f5b1815c050 0x7f5b180ce3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:36.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.092+0000 7f5b1e7dd700 1 -- 172.21.15.149:0/263337726 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b1815bc70 msgr2=0x7f5b180cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:36.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.092+0000 7f5b1e7dd700 1 --2- 172.21.15.149:0/263337726 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b1815bc70 0x7f5b180cde60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:36.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.092+0000 7f5b1e7dd700 1 -- 172.21.15.149:0/263337726 >> v2:172.21.15.160:3300/0 conn(0x7f5b1815c050 msgr2=0x7f5b180ce3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:36.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.092+0000 7f5b1e7dd700 1 --2- 172.21.15.149:0/263337726 >> v2:172.21.15.160:3300/0 conn(0x7f5b1815c050 0x7f5b180ce3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:36.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.092+0000 7f5b1e7dd700 1 -- 172.21.15.149:0/263337726 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b180ccde0 con 0x7f5b180ce8e0 2023-11-08T19:25:36.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.092+0000 7f5b1e7dd700 1 --2- 172.21.15.149:0/263337726 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b180ce8e0 0x7f5b180cf510 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f5b1806e9a0 tx=0x7f5b1000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68ec26d72c28488 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:36.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.092+0000 7f5b1cfda700 1 -- 172.21.15.149:0/263337726 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1000e070 con 0x7f5b180ce8e0 2023-11-08T19:25:36.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.092+0000 7f5b1cfda700 1 -- 172.21.15.149:0/263337726 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b1000b9c0 con 0x7f5b180ce8e0 2023-11-08T19:25:36.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.092+0000 7f5b1cfda700 1 -- 172.21.15.149:0/263337726 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1000bd70 con 0x7f5b180ce8e0 2023-11-08T19:25:36.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.093+0000 7f5b20240700 1 -- 172.21.15.149:0/263337726 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b180ce8e0 msgr2=0x7f5b180cf510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:36.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.093+0000 7f5b20240700 1 --2- 172.21.15.149:0/263337726 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b180ce8e0 0x7f5b180cf510 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f5b1806e9a0 tx=0x7f5b1000b330 comp rx=0 tx=0).stop 2023-11-08T19:25:36.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.093+0000 7f5b20240700 1 -- 172.21.15.149:0/263337726 shutdown_connections 2023-11-08T19:25:36.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.093+0000 7f5b20240700 1 --2- 172.21.15.149:0/263337726 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b180ce8e0 0x7f5b180cf510 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:36.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.093+0000 7f5b20240700 1 --2- 172.21.15.149:0/263337726 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b1815bc70 0x7f5b180cde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:36.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.093+0000 7f5b20240700 1 --2- 172.21.15.149:0/263337726 >> v2:172.21.15.160:3300/0 conn(0x7f5b1815c050 0x7f5b180ce3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:36.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.093+0000 7f5b20240700 1 -- 172.21.15.149:0/263337726 >> 172.21.15.149:0/263337726 conn(0x7f5b180d1730 msgr2=0x7f5b180d1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:36.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.093+0000 7f5b20240700 1 -- 172.21.15.149:0/263337726 shutdown_connections 2023-11-08T19:25:36.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.093+0000 7f5b20240700 1 -- 172.21.15.149:0/263337726 wait complete. 2023-11-08T19:25:36.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.094+0000 7f5b20240700 1 Processor -- start 2023-11-08T19:25:36.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.094+0000 7f5b20240700 1 -- start start 2023-11-08T19:25:36.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.095+0000 7f5b20240700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b180ce8e0 0x7f5b1815e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:36.105 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.095+0000 7f5b20240700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b1815bc70 0x7f5b1815e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:36.105 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.095+0000 7f5b20240700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b1815c050 0x7f5b1815ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:36.105 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.095+0000 7f5b20240700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1815f3e0 con 0x7f5b1815bc70 2023-11-08T19:25:36.105 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.095+0000 7f5b20240700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1815dd10 con 0x7f5b1815c050 2023-11-08T19:25:36.105 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.095+0000 7f5b20240700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1806d720 con 0x7f5b180ce8e0 2023-11-08T19:25:36.106 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.095+0000 7f5b1d7db700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b1815bc70 0x7f5b1815e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:36.106 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.095+0000 7f5b1d7db700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b1815bc70 0x7f5b1815e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41332/0 (socket says 172.21.15.149:41332) 2023-11-08T19:25:36.106 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.095+0000 7f5b1d7db700 1 -- 172.21.15.149:0/3269137487 learned_addr learned my addr 172.21.15.149:0/3269137487 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:36.106 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.095+0000 7f5b1dfdc700 1 --2- 172.21.15.149:0/3269137487 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b180ce8e0 0x7f5b1815e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:36.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.095+0000 7f5b1d7db700 1 -- 172.21.15.149:0/3269137487 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b180ce8e0 msgr2=0x7f5b1815e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:36.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.095+0000 7f5b1d7db700 1 --2- 172.21.15.149:0/3269137487 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b180ce8e0 0x7f5b1815e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:36.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.095+0000 7f5b1e7dd700 1 --2- 172.21.15.149:0/3269137487 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b1815c050 0x7f5b1815ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:36.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.095+0000 7f5b1d7db700 1 -- 172.21.15.149:0/3269137487 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b1815c050 msgr2=0x7f5b1815ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:36.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.095+0000 7f5b1d7db700 1 --2- 172.21.15.149:0/3269137487 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b1815c050 0x7f5b1815ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:36.108 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.095+0000 7f5b1d7db700 1 -- 172.21.15.149:0/3269137487 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b10009b30 con 0x7f5b1815bc70 2023-11-08T19:25:36.108 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.095+0000 7f5b1dfdc700 1 --2- 172.21.15.149:0/3269137487 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b180ce8e0 0x7f5b1815e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:25:36.108 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.095+0000 7f5b1d7db700 1 --2- 172.21.15.149:0/3269137487 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b1815bc70 0x7f5b1815e670 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f5b1400e840 tx=0x7f5b1400ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:36.108 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.095+0000 7f5b0e7fc700 1 -- 172.21.15.149:0/3269137487 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b14013610 con 0x7f5b1815bc70 2023-11-08T19:25:36.109 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.095+0000 7f5b0e7fc700 1 -- 172.21.15.149:0/3269137487 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b14013770 con 0x7f5b1815bc70 2023-11-08T19:25:36.109 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.095+0000 7f5b20240700 1 -- 172.21.15.149:0/3269137487 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b1815d370 con 0x7f5b1815bc70 2023-11-08T19:25:36.109 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.095+0000 7f5b0e7fc700 1 -- 172.21.15.149:0/3269137487 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b14013b20 con 0x7f5b1815bc70 2023-11-08T19:25:36.110 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.095+0000 7f5b20240700 1 -- 172.21.15.149:0/3269137487 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b1815d930 con 0x7f5b1815bc70 2023-11-08T19:25:36.110 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.096+0000 7f5b20240700 1 -- 172.21.15.149:0/3269137487 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b180b3020 con 0x7f5b1815bc70 2023-11-08T19:25:36.110 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.097+0000 7f5b0e7fc700 1 -- 172.21.15.149:0/3269137487 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5b14013c80 con 0x7f5b1815bc70 2023-11-08T19:25:36.111 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.097+0000 7f5b0e7fc700 1 --2- 172.21.15.149:0/3269137487 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5afc06af00 0x7f5afc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:36.111 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.097+0000 7f5b0e7fc700 1 -- 172.21.15.149:0/3269137487 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f5b14089450 con 0x7f5b1815bc70 2023-11-08T19:25:36.112 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.097+0000 7f5b1dfdc700 1 --2- 172.21.15.149:0/3269137487 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5afc06af00 0x7f5afc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:36.112 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.098+0000 7f5b1dfdc700 1 --2- 172.21.15.149:0/3269137487 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5afc06af00 0x7f5afc06d3c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f5b08009980 tx=0x7f5b08008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:36.112 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.102+0000 7f5b0e7fc700 1 -- 172.21.15.149:0/3269137487 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5b140542f0 con 0x7f5b1815bc70 2023-11-08T19:25:36.185 INFO:tasks.ceph.mds.a.smithi149.stderr:2023-11-08T19:25:36.183+0000 7f4c81e8b700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-08T19:25:36.291 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.290+0000 7f5b20240700 1 -- 172.21.15.149:0/3269137487 --> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5b180cd3a0 con 0x7f5afc06af00 2023-11-08T19:25:36.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.300+0000 7f5b0e7fc700 1 -- 172.21.15.149:0/3269137487 <== mgr.4104 v2:172.21.15.149:6832/1929837472 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+360221 (secure 0 0 0) 0x7f5b08009590 con 0x7f5afc06af00 2023-11-08T19:25:36.305 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:25:36.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.303+0000 7f5b20240700 1 -- 172.21.15.149:0/3269137487 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5afc06af00 msgr2=0x7f5afc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:36.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.303+0000 7f5b20240700 1 --2- 172.21.15.149:0/3269137487 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5afc06af00 0x7f5afc06d3c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f5b08009980 tx=0x7f5b08008040 comp rx=0 tx=0).stop 2023-11-08T19:25:36.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.303+0000 7f5b20240700 1 -- 172.21.15.149:0/3269137487 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b1815bc70 msgr2=0x7f5b1815e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:36.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.303+0000 7f5b20240700 1 --2- 172.21.15.149:0/3269137487 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b1815bc70 0x7f5b1815e670 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f5b1400e840 tx=0x7f5b1400ec00 comp rx=0 tx=0).stop 2023-11-08T19:25:36.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.303+0000 7f5b20240700 1 -- 172.21.15.149:0/3269137487 shutdown_connections 2023-11-08T19:25:36.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.303+0000 7f5b20240700 1 --2- 172.21.15.149:0/3269137487 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5afc06af00 0x7f5afc06d3c0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:36.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.303+0000 7f5b20240700 1 --2- 172.21.15.149:0/3269137487 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b1815c050 0x7f5b1815ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:36.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.303+0000 7f5b20240700 1 --2- 172.21.15.149:0/3269137487 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b180ce8e0 0x7f5b1815e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:36.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.303+0000 7f5b20240700 1 --2- 172.21.15.149:0/3269137487 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b1815bc70 0x7f5b1815e670 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:36.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.303+0000 7f5b20240700 1 -- 172.21.15.149:0/3269137487 >> 172.21.15.149:0/3269137487 conn(0x7f5b180d1730 msgr2=0x7f5b180b4b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:36.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.303+0000 7f5b20240700 1 -- 172.21.15.149:0/3269137487 shutdown_connections 2023-11-08T19:25:36.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.303+0000 7f5b20240700 1 -- 172.21.15.149:0/3269137487 wait complete. 2023-11-08T19:25:36.312 INFO:teuthology.orchestra.run.smithi149.stderr:dumped all 2023-11-08T19:25:36.317 INFO:teuthology.orchestra.run.smithi149.stdout:{"pg_ready":true,"pg_map":{"version":140,"stamp":"2023-11-08T19:25:36.019097+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590950,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":163,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":121,"ondisk_log_size":121,"up":152,"acting":152,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":71,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223416,"kb_used_data":7240,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754751304,"statfs":{"total":773094113280,"available":772865335296,"internally_reserved":0,"allocated":7413760,"data_stored":4030588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.824621"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.244169+0000","last_change":"2023-11-08T19:25:32.242622+0000","last_active":"2023-11-08T19:25:32.244169+0000","last_peered":"2023-11-08T19:25:32.244169+0000","last_clean":"2023-11-08T19:25:32.244169+0000","last_became_active":"2023-11-08T19:25:32.241199+0000","last_became_peered":"2023-11-08T19:25:32.241199+0000","last_unstale":"2023-11-08T19:25:32.244169+0000","last_undegraded":"2023-11-08T19:25:32.244169+0000","last_fullsized":"2023-11-08T19:25:32.244169+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:58:53.564452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.243835+0000","last_change":"2023-11-08T19:25:32.241457+0000","last_active":"2023-11-08T19:25:32.243835+0000","last_peered":"2023-11-08T19:25:32.243835+0000","last_clean":"2023-11-08T19:25:32.243835+0000","last_became_active":"2023-11-08T19:25:32.240722+0000","last_became_peered":"2023-11-08T19:25:32.240722+0000","last_unstale":"2023-11-08T19:25:32.243835+0000","last_undegraded":"2023-11-08T19:25:32.243835+0000","last_fullsized":"2023-11-08T19:25:32.243835+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:30:42.550006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.240841+0000","last_change":"2023-11-08T19:25:32.231809+0000","last_active":"2023-11-08T19:25:32.240841+0000","last_peered":"2023-11-08T19:25:32.240841+0000","last_clean":"2023-11-08T19:25:32.240841+0000","last_became_active":"2023-11-08T19:25:32.231324+0000","last_became_peered":"2023-11-08T19:25:32.231324+0000","last_unstale":"2023-11-08T19:25:32.240841+0000","last_undegraded":"2023-11-08T19:25:32.240841+0000","last_fullsized":"2023-11-08T19:25:32.240841+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:53:01.958964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.242886+0000","last_change":"2023-11-08T19:25:32.239395+0000","last_active":"2023-11-08T19:25:32.242886+0000","last_peered":"2023-11-08T19:25:32.242886+0000","last_clean":"2023-11-08T19:25:32.242886+0000","last_became_active":"2023-11-08T19:25:32.238318+0000","last_became_peered":"2023-11-08T19:25:32.238318+0000","last_unstale":"2023-11-08T19:25:32.242886+0000","last_undegraded":"2023-11-08T19:25:32.242886+0000","last_fullsized":"2023-11-08T19:25:32.242886+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:32:09.874087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.202073+0000","last_change":"2023-11-08T19:25:30.202073+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.202073+0000","last_undegraded":"2023-11-08T19:25:30.202073+0000","last_fullsized":"2023-11-08T19:25:30.202073+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":35,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.563178+0000","last_change":"2023-11-08T19:24:32.263958+0000","last_active":"2023-11-08T19:25:27.563178+0000","last_peered":"2023-11-08T19:25:27.563178+0000","last_clean":"2023-11-08T19:25:27.563178+0000","last_became_active":"2023-11-08T19:24:31.149011+0000","last_became_peered":"2023-11-08T19:24:31.149011+0000","last_unstale":"2023-11-08T19:25:27.563178+0000","last_undegraded":"2023-11-08T19:25:27.563178+0000","last_fullsized":"2023-11-08T19:25:27.563178+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:09:04.880374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033496900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.203556+0000","last_change":"2023-11-08T19:25:30.203556+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.203556+0000","last_undegraded":"2023-11-08T19:25:30.203556+0000","last_fullsized":"2023-11-08T19:25:30.203556+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":34,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.177313+0000","last_change":"2023-11-08T19:24:32.142892+0000","last_active":"2023-11-08T19:25:27.177313+0000","last_peered":"2023-11-08T19:25:27.177313+0000","last_clean":"2023-11-08T19:25:27.177313+0000","last_became_active":"2023-11-08T19:24:31.144912+0000","last_became_peered":"2023-11-08T19:24:31.144912+0000","last_unstale":"2023-11-08T19:25:27.177313+0000","last_undegraded":"2023-11-08T19:25:27.177313+0000","last_fullsized":"2023-11-08T19:25:27.177313+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:04:21.151484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056686900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.204924+0000","last_change":"2023-11-08T19:25:30.204924+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.204924+0000","last_undegraded":"2023-11-08T19:25:30.204924+0000","last_fullsized":"2023-11-08T19:25:30.204924+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":37,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.179265+0000","last_change":"2023-11-08T19:24:32.140514+0000","last_active":"2023-11-08T19:25:27.179265+0000","last_peered":"2023-11-08T19:25:27.179265+0000","last_clean":"2023-11-08T19:25:27.179265+0000","last_became_active":"2023-11-08T19:24:31.146668+0000","last_became_peered":"2023-11-08T19:24:31.146668+0000","last_unstale":"2023-11-08T19:25:27.179265+0000","last_undegraded":"2023-11-08T19:25:27.179265+0000","last_fullsized":"2023-11-08T19:25:27.179265+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:31:24.539374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071576699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.240491+0000","last_change":"2023-11-08T19:25:32.231355+0000","last_active":"2023-11-08T19:25:32.240491+0000","last_peered":"2023-11-08T19:25:32.240491+0000","last_clean":"2023-11-08T19:25:32.240491+0000","last_became_active":"2023-11-08T19:25:32.231063+0000","last_became_peered":"2023-11-08T19:25:32.231063+0000","last_unstale":"2023-11-08T19:25:32.240491+0000","last_undegraded":"2023-11-08T19:25:32.240491+0000","last_fullsized":"2023-11-08T19:25:32.240491+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:45:36.557467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.197733+0000","last_change":"2023-11-08T19:25:30.197733+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.197733+0000","last_undegraded":"2023-11-08T19:25:30.197733+0000","last_fullsized":"2023-11-08T19:25:30.197733+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":35,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.563202+0000","last_change":"2023-11-08T19:24:32.263963+0000","last_active":"2023-11-08T19:25:27.563202+0000","last_peered":"2023-11-08T19:25:27.563202+0000","last_clean":"2023-11-08T19:25:27.563202+0000","last_became_active":"2023-11-08T19:24:31.139062+0000","last_became_peered":"2023-11-08T19:24:31.139062+0000","last_unstale":"2023-11-08T19:25:27.563202+0000","last_undegraded":"2023-11-08T19:25:27.563202+0000","last_fullsized":"2023-11-08T19:25:27.563202+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:26.080042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033682599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.197639+0000","last_change":"2023-11-08T19:25:30.197639+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.197639+0000","last_undegraded":"2023-11-08T19:25:30.197639+0000","last_fullsized":"2023-11-08T19:25:30.197639+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":37,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.179119+0000","last_change":"2023-11-08T19:24:32.141131+0000","last_active":"2023-11-08T19:25:27.179119+0000","last_peered":"2023-11-08T19:25:27.179119+0000","last_clean":"2023-11-08T19:25:27.179119+0000","last_became_active":"2023-11-08T19:24:31.146154+0000","last_became_peered":"2023-11-08T19:24:31.146154+0000","last_unstale":"2023-11-08T19:25:27.179119+0000","last_undegraded":"2023-11-08T19:25:27.179119+0000","last_fullsized":"2023-11-08T19:25:27.179119+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:18:40.271560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082432800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.205515+0000","last_change":"2023-11-08T19:25:30.205515+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.205515+0000","last_undegraded":"2023-11-08T19:25:30.205515+0000","last_fullsized":"2023-11-08T19:25:30.205515+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":33,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.562932+0000","last_change":"2023-11-08T19:24:32.529486+0000","last_active":"2023-11-08T19:25:27.562932+0000","last_peered":"2023-11-08T19:25:27.562932+0000","last_clean":"2023-11-08T19:25:27.562932+0000","last_became_active":"2023-11-08T19:24:31.146260+0000","last_became_peered":"2023-11-08T19:24:31.146260+0000","last_unstale":"2023-11-08T19:25:27.562932+0000","last_undegraded":"2023-11-08T19:25:27.562932+0000","last_fullsized":"2023-11-08T19:25:27.562932+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:45:34.425432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059842900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.244147+0000","last_change":"2023-11-08T19:25:32.242459+0000","last_active":"2023-11-08T19:25:32.244147+0000","last_peered":"2023-11-08T19:25:32.244147+0000","last_clean":"2023-11-08T19:25:32.244147+0000","last_became_active":"2023-11-08T19:25:32.240909+0000","last_became_peered":"2023-11-08T19:25:32.240909+0000","last_unstale":"2023-11-08T19:25:32.244147+0000","last_undegraded":"2023-11-08T19:25:32.244147+0000","last_fullsized":"2023-11-08T19:25:32.244147+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:38:24.832373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.204873+0000","last_change":"2023-11-08T19:25:30.204873+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.204873+0000","last_undegraded":"2023-11-08T19:25:30.204873+0000","last_fullsized":"2023-11-08T19:25:30.204873+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":33,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.562995+0000","last_change":"2023-11-08T19:24:32.530168+0000","last_active":"2023-11-08T19:25:27.562995+0000","last_peered":"2023-11-08T19:25:27.562995+0000","last_clean":"2023-11-08T19:25:27.562995+0000","last_became_active":"2023-11-08T19:24:31.144329+0000","last_became_peered":"2023-11-08T19:24:31.144329+0000","last_unstale":"2023-11-08T19:25:27.562995+0000","last_undegraded":"2023-11-08T19:25:27.562995+0000","last_fullsized":"2023-11-08T19:25:27.562995+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:05:36.085920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043484799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.202320+0000","last_change":"2023-11-08T19:25:30.202320+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.202320+0000","last_undegraded":"2023-11-08T19:25:30.202320+0000","last_fullsized":"2023-11-08T19:25:30.202320+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":38,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.177613+0000","last_change":"2023-11-08T19:24:32.141190+0000","last_active":"2023-11-08T19:25:27.177613+0000","last_peered":"2023-11-08T19:25:27.177613+0000","last_clean":"2023-11-08T19:25:27.177613+0000","last_became_active":"2023-11-08T19:24:31.147651+0000","last_became_peered":"2023-11-08T19:24:31.147651+0000","last_unstale":"2023-11-08T19:25:27.177613+0000","last_undegraded":"2023-11-08T19:25:27.177613+0000","last_fullsized":"2023-11-08T19:25:27.177613+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:21:55.985548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043673300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.199231+0000","last_change":"2023-11-08T19:25:30.199231+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.199231+0000","last_undegraded":"2023-11-08T19:25:30.199231+0000","last_fullsized":"2023-11-08T19:25:30.199231+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":36,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-08T19:25:31.219135+0000","last_change":"2023-11-08T19:24:32.147011+0000","last_active":"2023-11-08T19:25:31.219135+0000","last_peered":"2023-11-08T19:25:31.219135+0000","last_clean":"2023-11-08T19:25:31.219135+0000","last_became_active":"2023-11-08T19:24:31.148250+0000","last_became_peered":"2023-11-08T19:24:31.148250+0000","last_unstale":"2023-11-08T19:25:31.219135+0000","last_undegraded":"2023-11-08T19:25:31.219135+0000","last_fullsized":"2023-11-08T19:25:31.219135+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:01:25.647952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043061299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.197833+0000","last_change":"2023-11-08T19:25:30.197833+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.197833+0000","last_undegraded":"2023-11-08T19:25:30.197833+0000","last_fullsized":"2023-11-08T19:25:30.197833+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":34,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.563469+0000","last_change":"2023-11-08T19:24:32.543880+0000","last_active":"2023-11-08T19:25:27.563469+0000","last_peered":"2023-11-08T19:25:27.563469+0000","last_clean":"2023-11-08T19:25:27.563469+0000","last_became_active":"2023-11-08T19:24:31.142052+0000","last_became_peered":"2023-11-08T19:24:31.142052+0000","last_unstale":"2023-11-08T19:25:27.563469+0000","last_undegraded":"2023-11-08T19:25:27.563469+0000","last_fullsized":"2023-11-08T19:25:27.563469+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:18:42.371676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014881058000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.205764+0000","last_change":"2023-11-08T19:25:30.205764+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.205764+0000","last_undegraded":"2023-11-08T19:25:30.205764+0000","last_fullsized":"2023-11-08T19:25:30.205764+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":36,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-08T19:25:31.220157+0000","last_change":"2023-11-08T19:24:32.147235+0000","last_active":"2023-11-08T19:25:31.220157+0000","last_peered":"2023-11-08T19:25:31.220157+0000","last_clean":"2023-11-08T19:25:31.220157+0000","last_became_active":"2023-11-08T19:24:31.146176+0000","last_became_peered":"2023-11-08T19:24:31.146176+0000","last_unstale":"2023-11-08T19:25:31.220157+0000","last_undegraded":"2023-11-08T19:25:31.220157+0000","last_fullsized":"2023-11-08T19:25:31.220157+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:39.214888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048481000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.205527+0000","last_change":"2023-11-08T19:25:30.205527+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.205527+0000","last_undegraded":"2023-11-08T19:25:30.205527+0000","last_fullsized":"2023-11-08T19:25:30.205527+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":38,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.177637+0000","last_change":"2023-11-08T19:24:32.142376+0000","last_active":"2023-11-08T19:25:27.177637+0000","last_peered":"2023-11-08T19:25:27.177637+0000","last_clean":"2023-11-08T19:25:27.177637+0000","last_became_active":"2023-11-08T19:24:31.144614+0000","last_became_peered":"2023-11-08T19:24:31.144614+0000","last_unstale":"2023-11-08T19:25:27.177637+0000","last_undegraded":"2023-11-08T19:25:27.177637+0000","last_fullsized":"2023-11-08T19:25:27.177637+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:09:04.880374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050362200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.243857+0000","last_change":"2023-11-08T19:25:32.241615+0000","last_active":"2023-11-08T19:25:32.243857+0000","last_peered":"2023-11-08T19:25:32.243857+0000","last_clean":"2023-11-08T19:25:32.243857+0000","last_became_active":"2023-11-08T19:25:32.240989+0000","last_became_peered":"2023-11-08T19:25:32.240989+0000","last_unstale":"2023-11-08T19:25:32.243857+0000","last_undegraded":"2023-11-08T19:25:32.243857+0000","last_fullsized":"2023-11-08T19:25:32.243857+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:34:02.775077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.204319+0000","last_change":"2023-11-08T19:25:30.204319+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.204319+0000","last_undegraded":"2023-11-08T19:25:30.204319+0000","last_fullsized":"2023-11-08T19:25:30.204319+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":36,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-08T19:25:31.218923+0000","last_change":"2023-11-08T19:24:32.146639+0000","last_active":"2023-11-08T19:25:31.218923+0000","last_peered":"2023-11-08T19:25:31.218923+0000","last_clean":"2023-11-08T19:25:31.218923+0000","last_became_active":"2023-11-08T19:24:31.147384+0000","last_became_peered":"2023-11-08T19:24:31.147384+0000","last_unstale":"2023-11-08T19:25:31.218923+0000","last_undegraded":"2023-11-08T19:25:31.218923+0000","last_fullsized":"2023-11-08T19:25:31.218923+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:30:21.946303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043834899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.201615+0000","last_change":"2023-11-08T19:25:30.201615+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.201615+0000","last_undegraded":"2023-11-08T19:25:30.201615+0000","last_fullsized":"2023-11-08T19:25:30.201615+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":34,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.562977+0000","last_change":"2023-11-08T19:24:32.544108+0000","last_active":"2023-11-08T19:25:27.562977+0000","last_peered":"2023-11-08T19:25:27.562977+0000","last_clean":"2023-11-08T19:25:27.562977+0000","last_became_active":"2023-11-08T19:24:31.143812+0000","last_became_peered":"2023-11-08T19:24:31.143812+0000","last_unstale":"2023-11-08T19:25:27.562977+0000","last_undegraded":"2023-11-08T19:25:27.562977+0000","last_fullsized":"2023-11-08T19:25:27.562977+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:27:59.135977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014956126,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.201034+0000","last_change":"2023-11-08T19:25:30.201034+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.201034+0000","last_undegraded":"2023-11-08T19:25:30.201034+0000","last_fullsized":"2023-11-08T19:25:30.201034+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":33,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.563053+0000","last_change":"2023-11-08T19:24:32.530378+0000","last_active":"2023-11-08T19:25:27.563053+0000","last_peered":"2023-11-08T19:25:27.563053+0000","last_clean":"2023-11-08T19:25:27.563053+0000","last_became_active":"2023-11-08T19:24:31.144341+0000","last_became_peered":"2023-11-08T19:24:31.144341+0000","last_unstale":"2023-11-08T19:25:27.563053+0000","last_undegraded":"2023-11-08T19:25:27.563053+0000","last_fullsized":"2023-11-08T19:25:27.563053+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:30:21.946303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058308299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.243743+0000","last_change":"2023-11-08T19:25:32.241021+0000","last_active":"2023-11-08T19:25:32.243743+0000","last_peered":"2023-11-08T19:25:32.243743+0000","last_clean":"2023-11-08T19:25:32.243743+0000","last_became_active":"2023-11-08T19:25:32.240682+0000","last_became_peered":"2023-11-08T19:25:32.240682+0000","last_unstale":"2023-11-08T19:25:32.243743+0000","last_undegraded":"2023-11-08T19:25:32.243743+0000","last_fullsized":"2023-11-08T19:25:32.243743+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:32:32.171974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"66'4","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.243327+0000","last_change":"2023-11-08T19:25:31.233739+0000","last_active":"2023-11-08T19:25:32.243327+0000","last_peered":"2023-11-08T19:25:32.243327+0000","last_clean":"2023-11-08T19:25:32.243327+0000","last_became_active":"2023-11-08T19:25:31.233443+0000","last_became_peered":"2023-11-08T19:25:31.233443+0000","last_unstale":"2023-11-08T19:25:32.243327+0000","last_undegraded":"2023-11-08T19:25:32.243327+0000","last_fullsized":"2023-11-08T19:25:32.243327+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:50:34.453347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":37,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.179190+0000","last_change":"2023-11-08T19:24:32.140832+0000","last_active":"2023-11-08T19:25:27.179190+0000","last_peered":"2023-11-08T19:25:27.179190+0000","last_clean":"2023-11-08T19:25:27.179190+0000","last_became_active":"2023-11-08T19:24:31.146557+0000","last_became_peered":"2023-11-08T19:24:31.146557+0000","last_unstale":"2023-11-08T19:25:27.179190+0000","last_undegraded":"2023-11-08T19:25:27.179190+0000","last_fullsized":"2023-11-08T19:25:27.179190+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:40:04.258107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099450100000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.204036+0000","last_change":"2023-11-08T19:25:30.204036+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.204036+0000","last_undegraded":"2023-11-08T19:25:30.204036+0000","last_fullsized":"2023-11-08T19:25:30.204036+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":37,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.179205+0000","last_change":"2023-11-08T19:24:32.141188+0000","last_active":"2023-11-08T19:25:27.179205+0000","last_peered":"2023-11-08T19:25:27.179205+0000","last_clean":"2023-11-08T19:25:27.179205+0000","last_became_active":"2023-11-08T19:24:31.148857+0000","last_became_peered":"2023-11-08T19:24:31.148857+0000","last_unstale":"2023-11-08T19:25:27.179205+0000","last_undegraded":"2023-11-08T19:25:27.179205+0000","last_fullsized":"2023-11-08T19:25:27.179205+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:45:34.425432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065078599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.201855+0000","last_change":"2023-11-08T19:25:30.201855+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.201855+0000","last_undegraded":"2023-11-08T19:25:30.201855+0000","last_fullsized":"2023-11-08T19:25:30.201855+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":37,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.179206+0000","last_change":"2023-11-08T19:24:32.140167+0000","last_active":"2023-11-08T19:25:27.179206+0000","last_peered":"2023-11-08T19:25:27.179206+0000","last_clean":"2023-11-08T19:25:27.179206+0000","last_became_active":"2023-11-08T19:24:31.147181+0000","last_became_peered":"2023-11-08T19:24:31.147181+0000","last_unstale":"2023-11-08T19:25:27.179206+0000","last_undegraded":"2023-11-08T19:25:27.179206+0000","last_fullsized":"2023-11-08T19:25:27.179206+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:26.080042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057135200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.197604+0000","last_change":"2023-11-08T19:25:30.197604+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.197604+0000","last_undegraded":"2023-11-08T19:25:30.197604+0000","last_fullsized":"2023-11-08T19:25:30.197604+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":33,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.563345+0000","last_change":"2023-11-08T19:24:32.530895+0000","last_active":"2023-11-08T19:25:27.563345+0000","last_peered":"2023-11-08T19:25:27.563345+0000","last_clean":"2023-11-08T19:25:27.563345+0000","last_became_active":"2023-11-08T19:24:31.146715+0000","last_became_peered":"2023-11-08T19:24:31.146715+0000","last_unstale":"2023-11-08T19:25:27.563345+0000","last_undegraded":"2023-11-08T19:25:27.563345+0000","last_fullsized":"2023-11-08T19:25:27.563345+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:39.214888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081671599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.199269+0000","last_change":"2023-11-08T19:25:30.199269+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.199269+0000","last_undegraded":"2023-11-08T19:25:30.199269+0000","last_fullsized":"2023-11-08T19:25:30.199269+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":34,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.562867+0000","last_change":"2023-11-08T19:24:32.333430+0000","last_active":"2023-11-08T19:25:27.562867+0000","last_peered":"2023-11-08T19:25:27.562867+0000","last_clean":"2023-11-08T19:25:27.562867+0000","last_became_active":"2023-11-08T19:24:31.141710+0000","last_became_peered":"2023-11-08T19:24:31.141710+0000","last_unstale":"2023-11-08T19:25:27.562867+0000","last_undegraded":"2023-11-08T19:25:27.562867+0000","last_fullsized":"2023-11-08T19:25:27.562867+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:32:51.214551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000430438,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.243873+0000","last_change":"2023-11-08T19:25:32.241953+0000","last_active":"2023-11-08T19:25:32.243873+0000","last_peered":"2023-11-08T19:25:32.243873+0000","last_clean":"2023-11-08T19:25:32.243873+0000","last_became_active":"2023-11-08T19:25:32.241304+0000","last_became_peered":"2023-11-08T19:25:32.241304+0000","last_unstale":"2023-11-08T19:25:32.243873+0000","last_undegraded":"2023-11-08T19:25:32.243873+0000","last_fullsized":"2023-11-08T19:25:32.243873+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:12:10.425204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.201020+0000","last_change":"2023-11-08T19:25:30.201020+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.201020+0000","last_undegraded":"2023-11-08T19:25:30.201020+0000","last_fullsized":"2023-11-08T19:25:30.201020+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":33,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.562907+0000","last_change":"2023-11-08T19:24:32.530333+0000","last_active":"2023-11-08T19:25:27.562907+0000","last_peered":"2023-11-08T19:25:27.562907+0000","last_clean":"2023-11-08T19:25:27.562907+0000","last_became_active":"2023-11-08T19:24:31.144838+0000","last_became_peered":"2023-11-08T19:24:31.144838+0000","last_unstale":"2023-11-08T19:25:27.562907+0000","last_undegraded":"2023-11-08T19:25:27.562907+0000","last_fullsized":"2023-11-08T19:25:27.562907+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:39:48.473183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081588799999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.242599+0000","last_change":"2023-11-08T19:25:32.240888+0000","last_active":"2023-11-08T19:25:32.242599+0000","last_peered":"2023-11-08T19:25:32.242599+0000","last_clean":"2023-11-08T19:25:32.242599+0000","last_became_active":"2023-11-08T19:25:32.240537+0000","last_became_peered":"2023-11-08T19:25:32.240537+0000","last_unstale":"2023-11-08T19:25:32.242599+0000","last_undegraded":"2023-11-08T19:25:32.242599+0000","last_fullsized":"2023-11-08T19:25:32.242599+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:19:39.469446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.199253+0000","last_change":"2023-11-08T19:25:30.199253+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.199253+0000","last_undegraded":"2023-11-08T19:25:30.199253+0000","last_fullsized":"2023-11-08T19:25:30.199253+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":34,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.563039+0000","last_change":"2023-11-08T19:24:32.333096+0000","last_active":"2023-11-08T19:25:27.563039+0000","last_peered":"2023-11-08T19:25:27.563039+0000","last_clean":"2023-11-08T19:25:27.563039+0000","last_became_active":"2023-11-08T19:24:31.142985+0000","last_became_peered":"2023-11-08T19:24:31.142985+0000","last_unstale":"2023-11-08T19:25:27.563039+0000","last_undegraded":"2023-11-08T19:25:27.563039+0000","last_fullsized":"2023-11-08T19:25:27.563039+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:36:33.274496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000386048,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.203005+0000","last_change":"2023-11-08T19:25:30.203005+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.203005+0000","last_undegraded":"2023-11-08T19:25:30.203005+0000","last_fullsized":"2023-11-08T19:25:30.203005+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":35,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.562843+0000","last_change":"2023-11-08T19:24:32.263810+0000","last_active":"2023-11-08T19:25:27.562843+0000","last_peered":"2023-11-08T19:25:27.562843+0000","last_clean":"2023-11-08T19:25:27.562843+0000","last_became_active":"2023-11-08T19:24:31.138814+0000","last_became_peered":"2023-11-08T19:24:31.138814+0000","last_unstale":"2023-11-08T19:25:27.562843+0000","last_undegraded":"2023-11-08T19:25:27.562843+0000","last_fullsized":"2023-11-08T19:25:27.562843+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:21:55.985548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048136000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.204341+0000","last_change":"2023-11-08T19:25:30.204341+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.204341+0000","last_undegraded":"2023-11-08T19:25:30.204341+0000","last_fullsized":"2023-11-08T19:25:30.204341+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":34,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.562997+0000","last_change":"2023-11-08T19:24:32.544063+0000","last_active":"2023-11-08T19:25:27.562997+0000","last_peered":"2023-11-08T19:25:27.562997+0000","last_clean":"2023-11-08T19:25:27.562997+0000","last_became_active":"2023-11-08T19:24:31.144795+0000","last_became_peered":"2023-11-08T19:24:31.144795+0000","last_unstale":"2023-11-08T19:25:27.562997+0000","last_undegraded":"2023-11-08T19:25:27.562997+0000","last_fullsized":"2023-11-08T19:25:27.562997+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:12:42.248307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01495431,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.200988+0000","last_change":"2023-11-08T19:25:30.200988+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.200988+0000","last_undegraded":"2023-11-08T19:25:30.200988+0000","last_fullsized":"2023-11-08T19:25:30.200988+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":36,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-08T19:25:31.219062+0000","last_change":"2023-11-08T19:24:32.147025+0000","last_active":"2023-11-08T19:25:31.219062+0000","last_peered":"2023-11-08T19:25:31.219062+0000","last_clean":"2023-11-08T19:25:31.219062+0000","last_became_active":"2023-11-08T19:24:31.147082+0000","last_became_peered":"2023-11-08T19:24:31.147082+0000","last_unstale":"2023-11-08T19:25:31.219062+0000","last_undegraded":"2023-11-08T19:25:31.219062+0000","last_fullsized":"2023-11-08T19:25:31.219062+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:02:27.987795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043701599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.203020+0000","last_change":"2023-11-08T19:25:30.203020+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.203020+0000","last_undegraded":"2023-11-08T19:25:30.203020+0000","last_fullsized":"2023-11-08T19:25:30.203020+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":33,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.562971+0000","last_change":"2023-11-08T19:24:32.530620+0000","last_active":"2023-11-08T19:25:27.562971+0000","last_peered":"2023-11-08T19:25:27.562971+0000","last_clean":"2023-11-08T19:25:27.562971+0000","last_became_active":"2023-11-08T19:24:31.144223+0000","last_became_peered":"2023-11-08T19:24:31.144223+0000","last_unstale":"2023-11-08T19:25:27.562971+0000","last_undegraded":"2023-11-08T19:25:27.562971+0000","last_fullsized":"2023-11-08T19:25:27.562971+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:01:25.647952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071879799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.204059+0000","last_change":"2023-11-08T19:25:30.204059+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.204059+0000","last_undegraded":"2023-11-08T19:25:30.204059+0000","last_fullsized":"2023-11-08T19:25:30.204059+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":37,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.179267+0000","last_change":"2023-11-08T19:24:32.140880+0000","last_active":"2023-11-08T19:25:27.179267+0000","last_peered":"2023-11-08T19:25:27.179267+0000","last_clean":"2023-11-08T19:25:27.179267+0000","last_became_active":"2023-11-08T19:24:31.146063+0000","last_became_peered":"2023-11-08T19:24:31.146063+0000","last_unstale":"2023-11-08T19:25:27.179267+0000","last_undegraded":"2023-11-08T19:25:27.179267+0000","last_fullsized":"2023-11-08T19:25:27.179267+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:54:08.985813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089896300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.225054+0000","last_change":"2023-11-08T19:25:31.224949+0000","last_active":"2023-11-08T19:25:32.225054+0000","last_peered":"2023-11-08T19:25:32.225054+0000","last_clean":"2023-11-08T19:25:32.225054+0000","last_became_active":"2023-11-08T19:25:31.224687+0000","last_became_peered":"2023-11-08T19:25:31.224687+0000","last_unstale":"2023-11-08T19:25:32.225054+0000","last_undegraded":"2023-11-08T19:25:32.225054+0000","last_fullsized":"2023-11-08T19:25:32.225054+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:15:07.118614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":38,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.177607+0000","last_change":"2023-11-08T19:24:32.139885+0000","last_active":"2023-11-08T19:25:27.177607+0000","last_peered":"2023-11-08T19:25:27.177607+0000","last_clean":"2023-11-08T19:25:27.177607+0000","last_became_active":"2023-11-08T19:24:31.145329+0000","last_became_peered":"2023-11-08T19:24:31.145329+0000","last_unstale":"2023-11-08T19:25:27.177607+0000","last_undegraded":"2023-11-08T19:25:27.177607+0000","last_fullsized":"2023-11-08T19:25:27.177607+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:25:18.356784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049012999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.204372+0000","last_change":"2023-11-08T19:25:30.204372+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.204372+0000","last_undegraded":"2023-11-08T19:25:30.204372+0000","last_fullsized":"2023-11-08T19:25:30.204372+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":34,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.177264+0000","last_change":"2023-11-08T19:24:32.142836+0000","last_active":"2023-11-08T19:25:27.177264+0000","last_peered":"2023-11-08T19:25:27.177264+0000","last_clean":"2023-11-08T19:25:27.177264+0000","last_became_active":"2023-11-08T19:24:31.141367+0000","last_became_peered":"2023-11-08T19:24:31.141367+0000","last_unstale":"2023-11-08T19:25:27.177264+0000","last_undegraded":"2023-11-08T19:25:27.177264+0000","last_fullsized":"2023-11-08T19:25:27.177264+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:39.214888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001335136,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.244187+0000","last_change":"2023-11-08T19:25:32.243168+0000","last_active":"2023-11-08T19:25:32.244187+0000","last_peered":"2023-11-08T19:25:32.244187+0000","last_clean":"2023-11-08T19:25:32.244187+0000","last_became_active":"2023-11-08T19:25:32.242923+0000","last_became_peered":"2023-11-08T19:25:32.242923+0000","last_unstale":"2023-11-08T19:25:32.244187+0000","last_undegraded":"2023-11-08T19:25:32.244187+0000","last_fullsized":"2023-11-08T19:25:32.244187+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:09:29.604127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.201640+0000","last_change":"2023-11-08T19:25:30.201640+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.201640+0000","last_undegraded":"2023-11-08T19:25:30.201640+0000","last_fullsized":"2023-11-08T19:25:30.201640+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":34,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.563450+0000","last_change":"2023-11-08T19:24:32.544285+0000","last_active":"2023-11-08T19:25:27.563450+0000","last_peered":"2023-11-08T19:25:27.563450+0000","last_clean":"2023-11-08T19:25:27.563450+0000","last_became_active":"2023-11-08T19:24:31.142028+0000","last_became_peered":"2023-11-08T19:24:31.142028+0000","last_unstale":"2023-11-08T19:25:27.563450+0000","last_undegraded":"2023-11-08T19:25:27.563450+0000","last_fullsized":"2023-11-08T19:25:27.563450+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:01:24.198196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067537399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.205611+0000","last_change":"2023-11-08T19:25:30.205611+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.205611+0000","last_undegraded":"2023-11-08T19:25:30.205611+0000","last_fullsized":"2023-11-08T19:25:30.205611+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":34,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.563432+0000","last_change":"2023-11-08T19:24:32.544333+0000","last_active":"2023-11-08T19:25:27.563432+0000","last_peered":"2023-11-08T19:25:27.563432+0000","last_clean":"2023-11-08T19:25:27.563432+0000","last_became_active":"2023-11-08T19:24:31.138598+0000","last_became_peered":"2023-11-08T19:24:31.138598+0000","last_unstale":"2023-11-08T19:25:27.563432+0000","last_undegraded":"2023-11-08T19:25:27.563432+0000","last_fullsized":"2023-11-08T19:25:27.563432+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:11.860580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015114824000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.204838+0000","last_change":"2023-11-08T19:25:30.204838+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.204838+0000","last_undegraded":"2023-11-08T19:25:30.204838+0000","last_fullsized":"2023-11-08T19:25:30.204838+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":33,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.563239+0000","last_change":"2023-11-08T19:24:32.530665+0000","last_active":"2023-11-08T19:25:27.563239+0000","last_peered":"2023-11-08T19:25:27.563239+0000","last_clean":"2023-11-08T19:25:27.563239+0000","last_became_active":"2023-11-08T19:24:31.148363+0000","last_became_peered":"2023-11-08T19:24:31.148363+0000","last_unstale":"2023-11-08T19:25:27.563239+0000","last_undegraded":"2023-11-08T19:25:27.563239+0000","last_fullsized":"2023-11-08T19:25:27.563239+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:02:27.987795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075444200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":204,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-08T19:25:31.215764+0000","last_change":"2023-11-08T19:22:58.054283+0000","last_active":"2023-11-08T19:25:31.215764+0000","last_peered":"2023-11-08T19:25:31.215764+0000","last_clean":"2023-11-08T19:25:31.215764+0000","last_became_active":"2023-11-08T19:22:58.053337+0000","last_became_peered":"2023-11-08T19:22:58.053337+0000","last_unstale":"2023-11-08T19:25:31.215764+0000","last_undegraded":"2023-11-08T19:25:31.215764+0000","last_fullsized":"2023-11-08T19:25:31.215764+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:22:56.479654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:22:56.479654+0000","last_clean_scrub_stamp":"2023-11-08T19:22:56.479654+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:16:05.317001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":22,"acting":22,"num_store_stats":1},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574884,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28392,"kb_used_data":1368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343448,"statfs":{"total":96636764160,"available":96607690752,"internally_reserved":0,"allocated":1400832,"data_stored":959735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.54500000000000004,"15min":0.53500000000000003},"min":{"1min":0.47599999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56499999999999995,"15min":0.56299999999999994},"min":{"1min":0.39100000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.748,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.48799999999999999}]},{"osd":1,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.54400000000000004,"15min":0.54600000000000004},"min":{"1min":0.37,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.70599999999999996,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53100000000000003,"15min":0.52900000000000003},"min":{"1min":0.39200000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.72699999999999998,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.40600000000000003}]},{"osd":2,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.50800000000000001,"15min":0.50600000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.71099999999999997,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.53100000000000003,"15min":0.53300000000000003},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.69299999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.71099999999999997}]},{"osd":3,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.41799999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.65900000000000003,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56000000000000005,"15min":0.55600000000000005},"min":{"1min":0.437,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72199999999999998,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.76100000000000001}]},{"osd":4,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.48499999999999999,"15min":0.48199999999999998},"min":{"1min":0.33400000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.373,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.63300000000000001}]},{"osd":5,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.55100000000000005,"15min":0.54500000000000004},"min":{"1min":0.41199999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.58499999999999996,"15min":0.57899999999999996},"min":{"1min":0.438,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.67400000000000004}]},{"osd":6,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61099999999999999,"15min":0.61199999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.82299999999999995,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56699999999999995,"15min":0.56200000000000006},"min":{"1min":0.43099999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.69199999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":774144,"data_stored":354355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.59699999999999998,"15min":0.60499999999999998},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.78000000000000003,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.58499999999999996,"15min":0.59499999999999997},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.78800000000000003,"5min":1.478,"15min":1.478},"last":0.60699999999999998}]},{"osd":1,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.60499999999999998,"15min":0.60899999999999999},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.80600000000000005,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.621,"5min":0.66300000000000003,"15min":0.67000000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.81699999999999995,"5min":1.649,"15min":1.649},"last":0.72699999999999998}]},{"osd":2,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56000000000000005,"15min":0.55900000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.63,"15min":0.63500000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.75900000000000001,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.626}]},{"osd":3,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.61799999999999999,"15min":0.63400000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77000000000000002,"5min":1.766,"15min":1.766},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.61199999999999999,"15min":0.625},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.877,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":0.64000000000000001}]},{"osd":4,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.53700000000000003,"15min":0.54200000000000004},"min":{"1min":0.36399999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.64500000000000002,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.374},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.57699999999999996,"15min":0.58199999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.55500000000000005}]},{"osd":5,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.56399999999999995,"15min":0.57099999999999995},"min":{"1min":0.42599999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.63300000000000001,"15min":0.63900000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.71499999999999997,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.57499999999999996}]},{"osd":7,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.61199999999999999,"15min":0.61499999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.64400000000000002,"15min":0.64900000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.53200000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574883,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":774144,"data_stored":354355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:24:57 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.36399999999999999,"15min":0.36499999999999999},"min":{"1min":0.255,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.42699999999999999,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.40799999999999997,"15min":0.41899999999999998},"min":{"1min":0.22800000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.5,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":0.22900000000000001}]},{"osd":2,"last update":"Wed Nov 8 19:24:57 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.34499999999999997,"15min":0.34699999999999998},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.43099999999999999,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.37,"5min":0.39400000000000002,"15min":0.39800000000000002},"min":{"1min":0.26200000000000001,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.502,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.27000000000000002}]},{"osd":3,"last update":"Wed Nov 8 19:24:57 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.33500000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.69499999999999995,"5min":1.24,"15min":1.24},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.45800000000000002,"15min":0.46800000000000003},"min":{"1min":0.27600000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.503,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.33800000000000002}]},{"osd":4,"last update":"Wed Nov 8 19:24:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.61299999999999999,"15min":0.61699999999999999},"min":{"1min":0.42299999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.745,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.628},{"interface":"front","average":{"1min":0.625,"5min":0.57299999999999995,"15min":0.56499999999999995},"min":{"1min":0.502,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.56499999999999995}]},{"osd":5,"last update":"Wed Nov 8 19:24:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.56399999999999995,"15min":0.55600000000000005},"min":{"1min":0.42699999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.441,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.72299999999999998,"5min":1.115,"15min":1.115},"last":0.59899999999999998}]},{"osd":6,"last update":"Wed Nov 8 19:24:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.48999999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.84599999999999997,"5min":2.093,"15min":2.093},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.745,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.54600000000000004}]},{"osd":7,"last update":"Wed Nov 8 19:24:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.66700000000000004,"15min":0.67700000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.748,"5min":1.591,"15min":1.591},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.68700000000000006,"15min":0.69899999999999995},"min":{"1min":0.44600000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.77500000000000002,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.52900000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574883,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28360,"kb_used_data":1336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343480,"statfs":{"total":96636764160,"available":96607723520,"internally_reserved":0,"allocated":1368064,"data_stored":944723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":1.0509999999999999,"15min":1.175},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.51900000000000002,"5min":19.295999999999999,"15min":19.295999999999999},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.96999999999999997,"15min":1.0740000000000001},"min":{"1min":0.252,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.502,"5min":17.204000000000001,"15min":17.204000000000001},"last":0.36299999999999999}]},{"osd":2,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.59499999999999997,"15min":0.63500000000000001},"min":{"1min":0.28599999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.46500000000000002,"5min":6.524,"15min":6.524},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.36699999999999999,"5min":1.008,"15min":1.115},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.47799999999999998,"5min":17.175000000000001,"15min":17.175000000000001},"last":0.40899999999999997}]},{"osd":3,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.86399999999999999,"15min":0.94999999999999996},"min":{"1min":0.27600000000000002,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.48899999999999999,"5min":14.324,"15min":14.324},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.40000000000000002,"15min":0.40200000000000002},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.52100000000000002,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.433}]},{"osd":4,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":1.1599999999999999,"15min":1.256},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.76700000000000002,"5min":17.056000000000001,"15min":17.056000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.72899999999999998,"15min":0.753},"min":{"1min":0.441,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.749,"5min":5.0289999999999999,"15min":5.0289999999999999},"last":0.71999999999999997}]},{"osd":5,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.72899999999999998,"15min":0.75600000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.77300000000000002,"5min":5.0590000000000002,"15min":5.0590000000000002},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56699999999999995,"15min":0.56499999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.54500000000000004}]},{"osd":6,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.60399999999999998,"15min":0.60499999999999998},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":1.1990000000000001,"15min":1.304},"min":{"1min":0.35499999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.70099999999999996,"5min":17.111999999999998,"15min":17.111999999999998},"last":0.73399999999999999}]},{"osd":7,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":1.2170000000000001,"15min":1.319},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.77000000000000002,"5min":17.146000000000001,"15min":17.146000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.74099999999999999,"15min":0.76700000000000002},"min":{"1min":0.40899999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.83299999999999996,"5min":4.9829999999999997,"15min":4.9829999999999997},"last":0.751}]}]},{"osd":2,"up_from":13,"seq":55834574883,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":774144,"data_stored":354355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.46200000000000002,"15min":0.48499999999999999},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.48799999999999999,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.37,"5min":0.499,"15min":0.52100000000000002},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.68000000000000005,"5min":3.4369999999999998,"15min":3.4369999999999998},"last":0.379}]},{"osd":1,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.53400000000000003,"15min":0.56399999999999995},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.58299999999999996,"5min":4.0679999999999996,"15min":4.0679999999999996},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.439,"5min":0.58499999999999996,"15min":0.60899999999999999},"min":{"1min":0.29499999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.72099999999999997,"5min":4.3499999999999996,"15min":4.3499999999999996},"last":0.42099999999999999}]},{"osd":3,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.53100000000000003,"15min":0.54900000000000004},"min":{"1min":0.26600000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.75600000000000001,"5min":3.8580000000000001,"15min":3.8580000000000001},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.497,"15min":0.52300000000000002},"min":{"1min":0.27600000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.55400000000000005,"5min":3.476,"15min":3.476},"last":0.39700000000000002}]},{"osd":4,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.71099999999999997,"15min":0.72499999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.3180000000000001,"5min":4.0090000000000003,"15min":4.0090000000000003},"last":0.623},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.72699999999999998,"15min":0.747},"min":{"1min":0.46000000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.92300000000000004,"5min":4.1040000000000001,"15min":4.1040000000000001},"last":0.58199999999999996}]},{"osd":5,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.73199999999999998,"15min":0.75600000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.85399999999999998,"5min":4.0869999999999997,"15min":4.0869999999999997},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.73399999999999999,"15min":0.75800000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.73999999999999999,"5min":3.843,"15min":3.843},"last":0.56299999999999994}]},{"osd":6,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.748,"15min":0.77200000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0720000000000001,"5min":4.1399999999999997,"15min":4.1399999999999997},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.72099999999999997,"15min":0.745},"min":{"1min":0.42899999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.81100000000000005,"5min":4.0499999999999998,"15min":4.0499999999999998},"last":0.67800000000000005}]},{"osd":7,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.76600000000000001,"15min":0.78100000000000003},"min":{"1min":0.51000000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.181,"5min":4.157,"15min":4.157},"last":0.754},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.79100000000000004,"15min":0.81200000000000006},"min":{"1min":0.48099999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.222,"5min":4.1710000000000003,"15min":4.1710000000000003},"last":0.50600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574883,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":774144,"data_stored":354355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.38300000000000001,"15min":0.38600000000000001},"min":{"1min":0.24199999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.63300000000000001,"5min":1.458,"15min":1.458},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.39500000000000002,"15min":0.40000000000000002},"min":{"1min":0.29199999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.53800000000000003,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.503}]},{"osd":1,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.40799999999999997,"15min":0.41199999999999998},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.747,"5min":1.512,"15min":1.512},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.442,"15min":0.44900000000000001},"min":{"1min":0.311,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.59499999999999997,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.57099999999999995}]},{"osd":2,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.376,"15min":0.378},"min":{"1min":0.28100000000000003,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.55600000000000005,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.42799999999999999,"15min":0.42999999999999999},"min":{"1min":0.315,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.70399999999999996,"5min":1.536,"15min":1.536},"last":0.60899999999999999}]},{"osd":4,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.61299999999999999,"15min":0.621},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.72199999999999998,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.752,"5min":1.153,"15min":1.153},"last":0.65100000000000002}]},{"osd":5,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.59299999999999997,"15min":0.59199999999999997},"min":{"1min":0.42299999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.86499999999999999,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.59799999999999998,"15min":0.60599999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.77100000000000002,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.73699999999999999}]},{"osd":6,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.57799999999999996,"15min":0.58099999999999996},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.78300000000000003,"5min":1.113,"15min":1.113},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.61199999999999999,"15min":0.61399999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.82399999999999995,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.71799999999999997}]},{"osd":7,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.64400000000000002,"15min":0.65000000000000002},"min":{"1min":0.44700000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.72099999999999997,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.626,"5min":0.61799999999999999,"15min":0.61699999999999999},"min":{"1min":0.48199999999999998,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.83799999999999997,"5min":1.179,"15min":1.179},"last":0.627}]}]},{"osd":4,"up_from":13,"seq":55834574883,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":774144,"data_stored":354355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53800000000000003,"15min":0.53600000000000003},"min":{"1min":0.35699999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.68600000000000005,"5min":1.399,"15min":1.399},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.59099999999999997,"15min":0.59699999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.75700000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.68300000000000005}]},{"osd":1,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.36599999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.499,"15min":0.496},"min":{"1min":0.39700000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.505}]},{"osd":2,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.627,"15min":0.63800000000000001},"min":{"1min":0.377,"5min":0.373,"15min":0.373},"max":{"1min":0.77300000000000002,"5min":2.8490000000000002,"15min":2.8490000000000002},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.52500000000000002,"15min":0.52000000000000002},"min":{"1min":0.434,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.40799999999999997}]},{"osd":3,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.56999999999999995,"15min":0.56399999999999995},"min":{"1min":0.41199999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.71899999999999997,"15min":0.72999999999999998},"min":{"1min":0.53200000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.78500000000000003,"5min":3.4849999999999999,"15min":3.4849999999999999},"last":0.76000000000000001}]},{"osd":5,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52000000000000002,"15min":0.52100000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.68100000000000005,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56100000000000005,"15min":0.55800000000000005},"min":{"1min":0.36299999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.79100000000000004}]},{"osd":6,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.70199999999999996,"15min":0.72399999999999998},"min":{"1min":0.38,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.83199999999999996,"5min":4.1529999999999996,"15min":4.1529999999999996},"last":0.623},{"interface":"front","average":{"1min":0.621,"5min":0.61399999999999999,"15min":0.61299999999999999},"min":{"1min":0.42699999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.73999999999999999}]},{"osd":7,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57199999999999995,"15min":0.57099999999999995},"min":{"1min":0.41699999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.80500000000000005,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.83999999999999997,"15min":0.86399999999999999},"min":{"1min":0.55900000000000005,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.87,"5min":5.5359999999999996,"15min":5.5359999999999996},"last":0.83899999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574883,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":774144,"data_stored":354355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.54400000000000004,"15min":0.54900000000000004},"min":{"1min":0.32300000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.78100000000000003,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":0.432},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.52500000000000002,"15min":0.51900000000000002},"min":{"1min":0.38700000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.745,"5min":0.878,"15min":0.878},"last":0.47199999999999998}]},{"osd":1,"last update":"Wed Nov 8 19:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.54700000000000004,"15min":0.54500000000000004},"min":{"1min":0.32400000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.76300000000000001,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.60399999999999998,"15min":0.60999999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.66300000000000003,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":0.52700000000000002}]},{"osd":2,"last update":"Wed Nov 8 19:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.56000000000000005,"15min":0.55800000000000005},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.68999999999999995,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52800000000000002,"15min":0.52700000000000002},"min":{"1min":0.39400000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.66700000000000004,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.38200000000000001}]},{"osd":3,"last update":"Wed Nov 8 19:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.55700000000000005,"15min":0.55600000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71899999999999997,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57499999999999996,"15min":0.57299999999999995},"min":{"1min":0.46999999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.83699999999999997,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.45100000000000001}]},{"osd":4,"last update":"Wed Nov 8 19:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.59299999999999997,"15min":0.60499999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.80600000000000005,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.63500000000000001,"15min":0.63400000000000001},"min":{"1min":0.49299999999999999,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.81999999999999995,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.53900000000000003}]},{"osd":6,"last update":"Wed Nov 8 19:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.58599999999999997,"15min":0.57999999999999996},"min":{"1min":0.437,"5min":0.37,"15min":0.37},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.65900000000000003,"15min":0.67300000000000004},"min":{"1min":0.38400000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.754,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":0.495}]},{"osd":7,"last update":"Wed Nov 8 19:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.627,"15min":0.63},"min":{"1min":0.42399999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.77600000000000002,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.625,"5min":0.64500000000000002,"15min":0.64900000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.871,"5min":0.873,"15min":0.873},"last":0.59399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:25:36.325 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:25:36.478 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.476+0000 7f4bb73dd700 1 Processor -- start 2023-11-08T19:25:36.478 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.477+0000 7f4bb73dd700 1 -- start start 2023-11-08T19:25:36.482 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.477+0000 7f4bb73dd700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4bb00cc140 0x7f4bb00cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:36.482 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.477+0000 7f4bb73dd700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bb00cce50 con 0x7f4bb00b2cd0 2023-11-08T19:25:36.482 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.477+0000 7f4bb73dd700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bb00cc520 con 0x7f4bb00b2850 2023-11-08T19:25:36.482 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.477+0000 7f4bb73dd700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb00b2430 con 0x7f4bb00cc140 2023-11-08T19:25:36.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.478+0000 7f4bb597a700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f4bb00b2cd0 0x7f4bb015d2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:43342/0 (socket says 172.21.15.149:43342) 2023-11-08T19:25:36.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.478+0000 7f4bb597a700 1 -- 172.21.15.149:0/2371710421 learned_addr learned my addr 172.21.15.149:0/2371710421 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:25:36.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.478+0000 7f4bb5179700 1 --2- 172.21.15.149:0/2371710421 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4bb00cc140 0x7f4bb00cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:36.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.478+0000 7f4ba7fff700 1 -- 172.21.15.149:0/2371710421 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3401330391 0 0) 0x7f4bb00cce50 con 0x7f4bb00b2cd0 2023-11-08T19:25:36.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.478+0000 7f4ba7fff700 1 -- 172.21.15.149:0/2371710421 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b9c0035b0 con 0x7f4bb00b2cd0 2023-11-08T19:25:36.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.478+0000 7f4ba7fff700 1 -- 172.21.15.149:0/2371710421 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3939896745 0 0) 0x7f4b9c0035b0 con 0x7f4bb00b2cd0 2023-11-08T19:25:36.484 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.478+0000 7f4ba7fff700 1 -- 172.21.15.149:0/2371710421 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4bb00cc140 msgr2=0x7f4bb00cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:36.484 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.478+0000 7f4ba7fff700 1 --2- 172.21.15.149:0/2371710421 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4bb00cc140 0x7f4bb00cc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:36.484 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.478+0000 7f4ba7fff700 1 -- 172.21.15.149:0/2371710421 >> v1:172.21.15.160:6789/0 conn(0x7f4bb00b2850 legacy=0x7f4bb00cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:36.484 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.478+0000 7f4ba7fff700 1 -- 172.21.15.149:0/2371710421 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb00b17b0 con 0x7f4bb00b2cd0 2023-11-08T19:25:36.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.478+0000 7f4ba7fff700 1 -- 172.21.15.149:0/2371710421 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f4ba80019f0 con 0x7f4bb00b2cd0 2023-11-08T19:25:36.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.478+0000 7f4ba7fff700 1 -- 172.21.15.149:0/2371710421 >> v1:172.21.15.149:6789/0 conn(0x7f4bb00b2cd0 legacy=0x7f4bb015d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:36.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.478+0000 7f4ba7fff700 1 --2- 172.21.15.149:0/2371710421 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4bb00cc140 0x7f4b9c003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:36.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.478+0000 7f4ba7fff700 1 --2- 172.21.15.149:0/2371710421 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b9c003fb0 0x7f4b9c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:36.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.478+0000 7f4ba7fff700 1 --2- 172.21.15.149:0/2371710421 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b9c004d90 0x7f4b9c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:36.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.478+0000 7f4ba7fff700 1 -- 172.21.15.149:0/2371710421 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb00b2430 con 0x7f4b9c003fb0 2023-11-08T19:25:36.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.478+0000 7f4ba7fff700 1 -- 172.21.15.149:0/2371710421 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9c00baf0 con 0x7f4b9c004d90 2023-11-08T19:25:36.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.478+0000 7f4ba7fff700 1 -- 172.21.15.149:0/2371710421 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9c00bcb0 con 0x7f4bb00cc140 2023-11-08T19:25:36.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.478+0000 7f4bb4978700 1 --2- 172.21.15.149:0/2371710421 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b9c003fb0 0x7f4b9c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:36.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.478+0000 7f4bb5179700 1 --2- 172.21.15.149:0/2371710421 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4bb00cc140 0x7f4b9c003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:36.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.478+0000 7f4bb597a700 1 --2- 172.21.15.149:0/2371710421 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b9c004d90 0x7f4b9c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:36.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.479+0000 7f4bb4978700 1 -- 172.21.15.149:0/2371710421 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4bb00cc140 msgr2=0x7f4b9c003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:36.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.479+0000 7f4bb4978700 1 --2- 172.21.15.149:0/2371710421 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4bb00cc140 0x7f4b9c003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:36.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.479+0000 7f4bb4978700 1 -- 172.21.15.149:0/2371710421 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b9c004d90 msgr2=0x7f4b9c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:36.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.479+0000 7f4bb4978700 1 --2- 172.21.15.149:0/2371710421 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b9c004d90 0x7f4b9c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:36.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.479+0000 7f4bb4978700 1 -- 172.21.15.149:0/2371710421 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b9c0035b0 con 0x7f4b9c003fb0 2023-11-08T19:25:36.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.479+0000 7f4bb4978700 1 --2- 172.21.15.149:0/2371710421 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b9c003fb0 0x7f4b9c004850 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f4bac001800 tx=0x7f4b9c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=363db725c2901dec server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:36.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.479+0000 7f4ba7fff700 1 -- 172.21.15.149:0/2371710421 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bac0012f0 con 0x7f4b9c003fb0 2023-11-08T19:25:36.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.479+0000 7f4ba7fff700 1 -- 172.21.15.149:0/2371710421 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bac0052f0 con 0x7f4b9c003fb0 2023-11-08T19:25:36.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.479+0000 7f4ba7fff700 1 -- 172.21.15.149:0/2371710421 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bac006860 con 0x7f4b9c003fb0 2023-11-08T19:25:36.490 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.479+0000 7f4bb73dd700 1 -- 172.21.15.149:0/2371710421 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b9c003fb0 msgr2=0x7f4b9c004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:36.490 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.479+0000 7f4bb73dd700 1 --2- 172.21.15.149:0/2371710421 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b9c003fb0 0x7f4b9c004850 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f4bac001800 tx=0x7f4b9c005880 comp rx=0 tx=0).stop 2023-11-08T19:25:36.490 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.479+0000 7f4bb597a700 1 -- 172.21.15.149:0/2371710421 reap_dead start 2023-11-08T19:25:36.490 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.479+0000 7f4bb73dd700 1 -- 172.21.15.149:0/2371710421 shutdown_connections 2023-11-08T19:25:36.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.479+0000 7f4bb73dd700 1 -- 172.21.15.149:0/2371710421 >> 172.21.15.149:0/2371710421 conn(0x7f4bb0099a40 msgr2=0x7f4bb00d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:36.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.480+0000 7f4bb73dd700 1 -- 172.21.15.149:0/2371710421 shutdown_connections 2023-11-08T19:25:36.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.480+0000 7f4bb73dd700 1 -- 172.21.15.149:0/2371710421 wait complete. 2023-11-08T19:25:36.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.481+0000 7f4bb73dd700 1 Processor -- start 2023-11-08T19:25:36.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.481+0000 7f4bb73dd700 1 -- start start 2023-11-08T19:25:36.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.481+0000 7f4bb73dd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b9c003fb0 0x7f4bb009d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:36.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.481+0000 7f4bb73dd700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4bb009a5b0 0x7f4bb00ae930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:36.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.481+0000 7f4bb73dd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4bb009aa30 0x7f4bb01f06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:36.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.481+0000 7f4bb73dd700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb01f7bf0 con 0x7f4bb009aa30 2023-11-08T19:25:36.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.481+0000 7f4bb73dd700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb01f6fe0 con 0x7f4b9c003fb0 2023-11-08T19:25:36.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.481+0000 7f4bb73dd700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb01f72c0 con 0x7f4bb009a5b0 2023-11-08T19:25:36.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.482+0000 7f4bb597a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4bb009aa30 0x7f4bb01f06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:36.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.482+0000 7f4bb597a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4bb009aa30 0x7f4bb01f06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41350/0 (socket says 172.21.15.149:41350) 2023-11-08T19:25:36.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.482+0000 7f4bb597a700 1 -- 172.21.15.149:0/1076671764 learned_addr learned my addr 172.21.15.149:0/1076671764 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:36.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.482+0000 7f4bb5179700 1 --2- 172.21.15.149:0/1076671764 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b9c003fb0 0x7f4bb009d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:36.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.482+0000 7f4bb4978700 1 --2- 172.21.15.149:0/1076671764 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4bb009a5b0 0x7f4bb00ae930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:36.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.482+0000 7f4bb597a700 1 -- 172.21.15.149:0/1076671764 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4bb009a5b0 msgr2=0x7f4bb00ae930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:36.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.482+0000 7f4bb597a700 1 --2- 172.21.15.149:0/1076671764 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4bb009a5b0 0x7f4bb00ae930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:36.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.482+0000 7f4bb597a700 1 -- 172.21.15.149:0/1076671764 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b9c003fb0 msgr2=0x7f4bb009d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:36.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.482+0000 7f4bb597a700 1 --2- 172.21.15.149:0/1076671764 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b9c003fb0 0x7f4bb009d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:36.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.482+0000 7f4bb597a700 1 -- 172.21.15.149:0/1076671764 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb01f75a0 con 0x7f4bb009aa30 2023-11-08T19:25:36.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.482+0000 7f4bb597a700 1 --2- 172.21.15.149:0/1076671764 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4bb009aa30 0x7f4bb01f06d0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f4bb00b3220 tx=0x7f4ba800a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:36.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.482+0000 7f4ba5ffb700 1 -- 172.21.15.149:0/1076671764 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba800ad00 con 0x7f4bb009aa30 2023-11-08T19:25:36.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.482+0000 7f4ba5ffb700 1 -- 172.21.15.149:0/1076671764 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ba800ae60 con 0x7f4bb009aa30 2023-11-08T19:25:36.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.482+0000 7f4bb73dd700 1 -- 172.21.15.149:0/1076671764 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bb01f7880 con 0x7f4bb009aa30 2023-11-08T19:25:36.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.482+0000 7f4ba5ffb700 1 -- 172.21.15.149:0/1076671764 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba8013630 con 0x7f4bb009aa30 2023-11-08T19:25:36.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.483+0000 7f4bb73dd700 1 -- 172.21.15.149:0/1076671764 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bb009d560 con 0x7f4bb009aa30 2023-11-08T19:25:36.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.483+0000 7f4bb73dd700 1 -- 172.21.15.149:0/1076671764 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bb00745f0 con 0x7f4bb009aa30 2023-11-08T19:25:36.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.484+0000 7f4ba5ffb700 1 -- 172.21.15.149:0/1076671764 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4ba8013790 con 0x7f4bb009aa30 2023-11-08T19:25:36.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.484+0000 7f4ba5ffb700 1 --2- 172.21.15.149:0/1076671764 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4b9406af00 0x7f4b9406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:36.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.484+0000 7f4ba5ffb700 1 -- 172.21.15.149:0/1076671764 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f4ba808a290 con 0x7f4bb009aa30 2023-11-08T19:25:36.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.484+0000 7f4bb5179700 1 --2- 172.21.15.149:0/1076671764 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4b9406af00 0x7f4b9406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:36.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.485+0000 7f4bb5179700 1 --2- 172.21.15.149:0/1076671764 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4b9406af00 0x7f4b9406d3c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f4ba0009c40 tx=0x7f4ba00091c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:36.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.489+0000 7f4ba5ffb700 1 -- 172.21.15.149:0/1076671764 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4ba8055130 con 0x7f4bb009aa30 2023-11-08T19:25:36.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.673+0000 7f4bb73dd700 1 -- 172.21.15.149:0/1076671764 --> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4bb00b1d70 con 0x7f4b9406af00 2023-11-08T19:25:36.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.682+0000 7f4ba5ffb700 1 -- 172.21.15.149:0/1076671764 <== mgr.4104 v2:172.21.15.149:6832/1929837472 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+360221 (secure 0 0 0) 0x7f4ba0009e30 con 0x7f4b9406af00 2023-11-08T19:25:36.687 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:25:36.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.685+0000 7f4bb73dd700 1 -- 172.21.15.149:0/1076671764 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4b9406af00 msgr2=0x7f4b9406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:36.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.685+0000 7f4bb73dd700 1 --2- 172.21.15.149:0/1076671764 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4b9406af00 0x7f4b9406d3c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f4ba0009c40 tx=0x7f4ba00091c0 comp rx=0 tx=0).stop 2023-11-08T19:25:36.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.685+0000 7f4bb73dd700 1 -- 172.21.15.149:0/1076671764 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4bb009aa30 msgr2=0x7f4bb01f06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:36.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.685+0000 7f4bb73dd700 1 --2- 172.21.15.149:0/1076671764 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4bb009aa30 0x7f4bb01f06d0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f4bb00b3220 tx=0x7f4ba800a5f0 comp rx=0 tx=0).stop 2023-11-08T19:25:36.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.686+0000 7f4bb73dd700 1 -- 172.21.15.149:0/1076671764 shutdown_connections 2023-11-08T19:25:36.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.686+0000 7f4bb73dd700 1 --2- 172.21.15.149:0/1076671764 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4b9406af00 0x7f4b9406d3c0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:36.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.686+0000 7f4bb73dd700 1 --2- 172.21.15.149:0/1076671764 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b9c003fb0 0x7f4bb009d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:36.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.686+0000 7f4bb73dd700 1 --2- 172.21.15.149:0/1076671764 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4bb009aa30 0x7f4bb01f06d0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:36.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.686+0000 7f4bb73dd700 1 --2- 172.21.15.149:0/1076671764 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4bb009a5b0 0x7f4bb00ae930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:36.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.686+0000 7f4bb73dd700 1 -- 172.21.15.149:0/1076671764 >> 172.21.15.149:0/1076671764 conn(0x7f4bb0099a40 msgr2=0x7f4bb00d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:36.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.686+0000 7f4bb73dd700 1 -- 172.21.15.149:0/1076671764 shutdown_connections 2023-11-08T19:25:36.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.686+0000 7f4bb73dd700 1 -- 172.21.15.149:0/1076671764 wait complete. 2023-11-08T19:25:36.692 INFO:teuthology.orchestra.run.smithi149.stderr:dumped all 2023-11-08T19:25:36.699 INFO:teuthology.orchestra.run.smithi149.stdout:{"pg_ready":true,"pg_map":{"version":140,"stamp":"2023-11-08T19:25:36.019097+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590950,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":163,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":121,"ondisk_log_size":121,"up":152,"acting":152,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":71,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223416,"kb_used_data":7240,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754751304,"statfs":{"total":773094113280,"available":772865335296,"internally_reserved":0,"allocated":7413760,"data_stored":4030588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.824621"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.244169+0000","last_change":"2023-11-08T19:25:32.242622+0000","last_active":"2023-11-08T19:25:32.244169+0000","last_peered":"2023-11-08T19:25:32.244169+0000","last_clean":"2023-11-08T19:25:32.244169+0000","last_became_active":"2023-11-08T19:25:32.241199+0000","last_became_peered":"2023-11-08T19:25:32.241199+0000","last_unstale":"2023-11-08T19:25:32.244169+0000","last_undegraded":"2023-11-08T19:25:32.244169+0000","last_fullsized":"2023-11-08T19:25:32.244169+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:58:53.564452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.243835+0000","last_change":"2023-11-08T19:25:32.241457+0000","last_active":"2023-11-08T19:25:32.243835+0000","last_peered":"2023-11-08T19:25:32.243835+0000","last_clean":"2023-11-08T19:25:32.243835+0000","last_became_active":"2023-11-08T19:25:32.240722+0000","last_became_peered":"2023-11-08T19:25:32.240722+0000","last_unstale":"2023-11-08T19:25:32.243835+0000","last_undegraded":"2023-11-08T19:25:32.243835+0000","last_fullsized":"2023-11-08T19:25:32.243835+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:30:42.550006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.240841+0000","last_change":"2023-11-08T19:25:32.231809+0000","last_active":"2023-11-08T19:25:32.240841+0000","last_peered":"2023-11-08T19:25:32.240841+0000","last_clean":"2023-11-08T19:25:32.240841+0000","last_became_active":"2023-11-08T19:25:32.231324+0000","last_became_peered":"2023-11-08T19:25:32.231324+0000","last_unstale":"2023-11-08T19:25:32.240841+0000","last_undegraded":"2023-11-08T19:25:32.240841+0000","last_fullsized":"2023-11-08T19:25:32.240841+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:53:01.958964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.242886+0000","last_change":"2023-11-08T19:25:32.239395+0000","last_active":"2023-11-08T19:25:32.242886+0000","last_peered":"2023-11-08T19:25:32.242886+0000","last_clean":"2023-11-08T19:25:32.242886+0000","last_became_active":"2023-11-08T19:25:32.238318+0000","last_became_peered":"2023-11-08T19:25:32.238318+0000","last_unstale":"2023-11-08T19:25:32.242886+0000","last_undegraded":"2023-11-08T19:25:32.242886+0000","last_fullsized":"2023-11-08T19:25:32.242886+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:32:09.874087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.202073+0000","last_change":"2023-11-08T19:25:30.202073+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.202073+0000","last_undegraded":"2023-11-08T19:25:30.202073+0000","last_fullsized":"2023-11-08T19:25:30.202073+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":35,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.563178+0000","last_change":"2023-11-08T19:24:32.263958+0000","last_active":"2023-11-08T19:25:27.563178+0000","last_peered":"2023-11-08T19:25:27.563178+0000","last_clean":"2023-11-08T19:25:27.563178+0000","last_became_active":"2023-11-08T19:24:31.149011+0000","last_became_peered":"2023-11-08T19:24:31.149011+0000","last_unstale":"2023-11-08T19:25:27.563178+0000","last_undegraded":"2023-11-08T19:25:27.563178+0000","last_fullsized":"2023-11-08T19:25:27.563178+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:09:04.880374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033496900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.203556+0000","last_change":"2023-11-08T19:25:30.203556+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.203556+0000","last_undegraded":"2023-11-08T19:25:30.203556+0000","last_fullsized":"2023-11-08T19:25:30.203556+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":34,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.177313+0000","last_change":"2023-11-08T19:24:32.142892+0000","last_active":"2023-11-08T19:25:27.177313+0000","last_peered":"2023-11-08T19:25:27.177313+0000","last_clean":"2023-11-08T19:25:27.177313+0000","last_became_active":"2023-11-08T19:24:31.144912+0000","last_became_peered":"2023-11-08T19:24:31.144912+0000","last_unstale":"2023-11-08T19:25:27.177313+0000","last_undegraded":"2023-11-08T19:25:27.177313+0000","last_fullsized":"2023-11-08T19:25:27.177313+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:04:21.151484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056686900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.204924+0000","last_change":"2023-11-08T19:25:30.204924+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.204924+0000","last_undegraded":"2023-11-08T19:25:30.204924+0000","last_fullsized":"2023-11-08T19:25:30.204924+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":37,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.179265+0000","last_change":"2023-11-08T19:24:32.140514+0000","last_active":"2023-11-08T19:25:27.179265+0000","last_peered":"2023-11-08T19:25:27.179265+0000","last_clean":"2023-11-08T19:25:27.179265+0000","last_became_active":"2023-11-08T19:24:31.146668+0000","last_became_peered":"2023-11-08T19:24:31.146668+0000","last_unstale":"2023-11-08T19:25:27.179265+0000","last_undegraded":"2023-11-08T19:25:27.179265+0000","last_fullsized":"2023-11-08T19:25:27.179265+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:31:24.539374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071576699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.240491+0000","last_change":"2023-11-08T19:25:32.231355+0000","last_active":"2023-11-08T19:25:32.240491+0000","last_peered":"2023-11-08T19:25:32.240491+0000","last_clean":"2023-11-08T19:25:32.240491+0000","last_became_active":"2023-11-08T19:25:32.231063+0000","last_became_peered":"2023-11-08T19:25:32.231063+0000","last_unstale":"2023-11-08T19:25:32.240491+0000","last_undegraded":"2023-11-08T19:25:32.240491+0000","last_fullsized":"2023-11-08T19:25:32.240491+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:45:36.557467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.197733+0000","last_change":"2023-11-08T19:25:30.197733+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.197733+0000","last_undegraded":"2023-11-08T19:25:30.197733+0000","last_fullsized":"2023-11-08T19:25:30.197733+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":35,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.563202+0000","last_change":"2023-11-08T19:24:32.263963+0000","last_active":"2023-11-08T19:25:27.563202+0000","last_peered":"2023-11-08T19:25:27.563202+0000","last_clean":"2023-11-08T19:25:27.563202+0000","last_became_active":"2023-11-08T19:24:31.139062+0000","last_became_peered":"2023-11-08T19:24:31.139062+0000","last_unstale":"2023-11-08T19:25:27.563202+0000","last_undegraded":"2023-11-08T19:25:27.563202+0000","last_fullsized":"2023-11-08T19:25:27.563202+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:26.080042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033682599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.197639+0000","last_change":"2023-11-08T19:25:30.197639+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.197639+0000","last_undegraded":"2023-11-08T19:25:30.197639+0000","last_fullsized":"2023-11-08T19:25:30.197639+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":37,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.179119+0000","last_change":"2023-11-08T19:24:32.141131+0000","last_active":"2023-11-08T19:25:27.179119+0000","last_peered":"2023-11-08T19:25:27.179119+0000","last_clean":"2023-11-08T19:25:27.179119+0000","last_became_active":"2023-11-08T19:24:31.146154+0000","last_became_peered":"2023-11-08T19:24:31.146154+0000","last_unstale":"2023-11-08T19:25:27.179119+0000","last_undegraded":"2023-11-08T19:25:27.179119+0000","last_fullsized":"2023-11-08T19:25:27.179119+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:18:40.271560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082432800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.205515+0000","last_change":"2023-11-08T19:25:30.205515+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.205515+0000","last_undegraded":"2023-11-08T19:25:30.205515+0000","last_fullsized":"2023-11-08T19:25:30.205515+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":33,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.562932+0000","last_change":"2023-11-08T19:24:32.529486+0000","last_active":"2023-11-08T19:25:27.562932+0000","last_peered":"2023-11-08T19:25:27.562932+0000","last_clean":"2023-11-08T19:25:27.562932+0000","last_became_active":"2023-11-08T19:24:31.146260+0000","last_became_peered":"2023-11-08T19:24:31.146260+0000","last_unstale":"2023-11-08T19:25:27.562932+0000","last_undegraded":"2023-11-08T19:25:27.562932+0000","last_fullsized":"2023-11-08T19:25:27.562932+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:45:34.425432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059842900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.244147+0000","last_change":"2023-11-08T19:25:32.242459+0000","last_active":"2023-11-08T19:25:32.244147+0000","last_peered":"2023-11-08T19:25:32.244147+0000","last_clean":"2023-11-08T19:25:32.244147+0000","last_became_active":"2023-11-08T19:25:32.240909+0000","last_became_peered":"2023-11-08T19:25:32.240909+0000","last_unstale":"2023-11-08T19:25:32.244147+0000","last_undegraded":"2023-11-08T19:25:32.244147+0000","last_fullsized":"2023-11-08T19:25:32.244147+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:38:24.832373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.204873+0000","last_change":"2023-11-08T19:25:30.204873+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.204873+0000","last_undegraded":"2023-11-08T19:25:30.204873+0000","last_fullsized":"2023-11-08T19:25:30.204873+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":33,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.562995+0000","last_change":"2023-11-08T19:24:32.530168+0000","last_active":"2023-11-08T19:25:27.562995+0000","last_peered":"2023-11-08T19:25:27.562995+0000","last_clean":"2023-11-08T19:25:27.562995+0000","last_became_active":"2023-11-08T19:24:31.144329+0000","last_became_peered":"2023-11-08T19:24:31.144329+0000","last_unstale":"2023-11-08T19:25:27.562995+0000","last_undegraded":"2023-11-08T19:25:27.562995+0000","last_fullsized":"2023-11-08T19:25:27.562995+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:05:36.085920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043484799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.202320+0000","last_change":"2023-11-08T19:25:30.202320+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.202320+0000","last_undegraded":"2023-11-08T19:25:30.202320+0000","last_fullsized":"2023-11-08T19:25:30.202320+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":38,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.177613+0000","last_change":"2023-11-08T19:24:32.141190+0000","last_active":"2023-11-08T19:25:27.177613+0000","last_peered":"2023-11-08T19:25:27.177613+0000","last_clean":"2023-11-08T19:25:27.177613+0000","last_became_active":"2023-11-08T19:24:31.147651+0000","last_became_peered":"2023-11-08T19:24:31.147651+0000","last_unstale":"2023-11-08T19:25:27.177613+0000","last_undegraded":"2023-11-08T19:25:27.177613+0000","last_fullsized":"2023-11-08T19:25:27.177613+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:21:55.985548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043673300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.199231+0000","last_change":"2023-11-08T19:25:30.199231+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.199231+0000","last_undegraded":"2023-11-08T19:25:30.199231+0000","last_fullsized":"2023-11-08T19:25:30.199231+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":36,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-08T19:25:31.219135+0000","last_change":"2023-11-08T19:24:32.147011+0000","last_active":"2023-11-08T19:25:31.219135+0000","last_peered":"2023-11-08T19:25:31.219135+0000","last_clean":"2023-11-08T19:25:31.219135+0000","last_became_active":"2023-11-08T19:24:31.148250+0000","last_became_peered":"2023-11-08T19:24:31.148250+0000","last_unstale":"2023-11-08T19:25:31.219135+0000","last_undegraded":"2023-11-08T19:25:31.219135+0000","last_fullsized":"2023-11-08T19:25:31.219135+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:01:25.647952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043061299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.197833+0000","last_change":"2023-11-08T19:25:30.197833+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.197833+0000","last_undegraded":"2023-11-08T19:25:30.197833+0000","last_fullsized":"2023-11-08T19:25:30.197833+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":34,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.563469+0000","last_change":"2023-11-08T19:24:32.543880+0000","last_active":"2023-11-08T19:25:27.563469+0000","last_peered":"2023-11-08T19:25:27.563469+0000","last_clean":"2023-11-08T19:25:27.563469+0000","last_became_active":"2023-11-08T19:24:31.142052+0000","last_became_peered":"2023-11-08T19:24:31.142052+0000","last_unstale":"2023-11-08T19:25:27.563469+0000","last_undegraded":"2023-11-08T19:25:27.563469+0000","last_fullsized":"2023-11-08T19:25:27.563469+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:18:42.371676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014881058000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.205764+0000","last_change":"2023-11-08T19:25:30.205764+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.205764+0000","last_undegraded":"2023-11-08T19:25:30.205764+0000","last_fullsized":"2023-11-08T19:25:30.205764+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":36,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-08T19:25:31.220157+0000","last_change":"2023-11-08T19:24:32.147235+0000","last_active":"2023-11-08T19:25:31.220157+0000","last_peered":"2023-11-08T19:25:31.220157+0000","last_clean":"2023-11-08T19:25:31.220157+0000","last_became_active":"2023-11-08T19:24:31.146176+0000","last_became_peered":"2023-11-08T19:24:31.146176+0000","last_unstale":"2023-11-08T19:25:31.220157+0000","last_undegraded":"2023-11-08T19:25:31.220157+0000","last_fullsized":"2023-11-08T19:25:31.220157+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:39.214888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048481000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.205527+0000","last_change":"2023-11-08T19:25:30.205527+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.205527+0000","last_undegraded":"2023-11-08T19:25:30.205527+0000","last_fullsized":"2023-11-08T19:25:30.205527+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":38,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.177637+0000","last_change":"2023-11-08T19:24:32.142376+0000","last_active":"2023-11-08T19:25:27.177637+0000","last_peered":"2023-11-08T19:25:27.177637+0000","last_clean":"2023-11-08T19:25:27.177637+0000","last_became_active":"2023-11-08T19:24:31.144614+0000","last_became_peered":"2023-11-08T19:24:31.144614+0000","last_unstale":"2023-11-08T19:25:27.177637+0000","last_undegraded":"2023-11-08T19:25:27.177637+0000","last_fullsized":"2023-11-08T19:25:27.177637+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:09:04.880374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050362200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.243857+0000","last_change":"2023-11-08T19:25:32.241615+0000","last_active":"2023-11-08T19:25:32.243857+0000","last_peered":"2023-11-08T19:25:32.243857+0000","last_clean":"2023-11-08T19:25:32.243857+0000","last_became_active":"2023-11-08T19:25:32.240989+0000","last_became_peered":"2023-11-08T19:25:32.240989+0000","last_unstale":"2023-11-08T19:25:32.243857+0000","last_undegraded":"2023-11-08T19:25:32.243857+0000","last_fullsized":"2023-11-08T19:25:32.243857+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:34:02.775077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.204319+0000","last_change":"2023-11-08T19:25:30.204319+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.204319+0000","last_undegraded":"2023-11-08T19:25:30.204319+0000","last_fullsized":"2023-11-08T19:25:30.204319+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":36,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-08T19:25:31.218923+0000","last_change":"2023-11-08T19:24:32.146639+0000","last_active":"2023-11-08T19:25:31.218923+0000","last_peered":"2023-11-08T19:25:31.218923+0000","last_clean":"2023-11-08T19:25:31.218923+0000","last_became_active":"2023-11-08T19:24:31.147384+0000","last_became_peered":"2023-11-08T19:24:31.147384+0000","last_unstale":"2023-11-08T19:25:31.218923+0000","last_undegraded":"2023-11-08T19:25:31.218923+0000","last_fullsized":"2023-11-08T19:25:31.218923+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:30:21.946303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043834899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.201615+0000","last_change":"2023-11-08T19:25:30.201615+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.201615+0000","last_undegraded":"2023-11-08T19:25:30.201615+0000","last_fullsized":"2023-11-08T19:25:30.201615+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":34,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.562977+0000","last_change":"2023-11-08T19:24:32.544108+0000","last_active":"2023-11-08T19:25:27.562977+0000","last_peered":"2023-11-08T19:25:27.562977+0000","last_clean":"2023-11-08T19:25:27.562977+0000","last_became_active":"2023-11-08T19:24:31.143812+0000","last_became_peered":"2023-11-08T19:24:31.143812+0000","last_unstale":"2023-11-08T19:25:27.562977+0000","last_undegraded":"2023-11-08T19:25:27.562977+0000","last_fullsized":"2023-11-08T19:25:27.562977+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:27:59.135977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014956126,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.201034+0000","last_change":"2023-11-08T19:25:30.201034+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.201034+0000","last_undegraded":"2023-11-08T19:25:30.201034+0000","last_fullsized":"2023-11-08T19:25:30.201034+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":33,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.563053+0000","last_change":"2023-11-08T19:24:32.530378+0000","last_active":"2023-11-08T19:25:27.563053+0000","last_peered":"2023-11-08T19:25:27.563053+0000","last_clean":"2023-11-08T19:25:27.563053+0000","last_became_active":"2023-11-08T19:24:31.144341+0000","last_became_peered":"2023-11-08T19:24:31.144341+0000","last_unstale":"2023-11-08T19:25:27.563053+0000","last_undegraded":"2023-11-08T19:25:27.563053+0000","last_fullsized":"2023-11-08T19:25:27.563053+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:30:21.946303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058308299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.243743+0000","last_change":"2023-11-08T19:25:32.241021+0000","last_active":"2023-11-08T19:25:32.243743+0000","last_peered":"2023-11-08T19:25:32.243743+0000","last_clean":"2023-11-08T19:25:32.243743+0000","last_became_active":"2023-11-08T19:25:32.240682+0000","last_became_peered":"2023-11-08T19:25:32.240682+0000","last_unstale":"2023-11-08T19:25:32.243743+0000","last_undegraded":"2023-11-08T19:25:32.243743+0000","last_fullsized":"2023-11-08T19:25:32.243743+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:32:32.171974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"66'4","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.243327+0000","last_change":"2023-11-08T19:25:31.233739+0000","last_active":"2023-11-08T19:25:32.243327+0000","last_peered":"2023-11-08T19:25:32.243327+0000","last_clean":"2023-11-08T19:25:32.243327+0000","last_became_active":"2023-11-08T19:25:31.233443+0000","last_became_peered":"2023-11-08T19:25:31.233443+0000","last_unstale":"2023-11-08T19:25:32.243327+0000","last_undegraded":"2023-11-08T19:25:32.243327+0000","last_fullsized":"2023-11-08T19:25:32.243327+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:50:34.453347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":37,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.179190+0000","last_change":"2023-11-08T19:24:32.140832+0000","last_active":"2023-11-08T19:25:27.179190+0000","last_peered":"2023-11-08T19:25:27.179190+0000","last_clean":"2023-11-08T19:25:27.179190+0000","last_became_active":"2023-11-08T19:24:31.146557+0000","last_became_peered":"2023-11-08T19:24:31.146557+0000","last_unstale":"2023-11-08T19:25:27.179190+0000","last_undegraded":"2023-11-08T19:25:27.179190+0000","last_fullsized":"2023-11-08T19:25:27.179190+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:40:04.258107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099450100000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.204036+0000","last_change":"2023-11-08T19:25:30.204036+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.204036+0000","last_undegraded":"2023-11-08T19:25:30.204036+0000","last_fullsized":"2023-11-08T19:25:30.204036+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":37,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.179205+0000","last_change":"2023-11-08T19:24:32.141188+0000","last_active":"2023-11-08T19:25:27.179205+0000","last_peered":"2023-11-08T19:25:27.179205+0000","last_clean":"2023-11-08T19:25:27.179205+0000","last_became_active":"2023-11-08T19:24:31.148857+0000","last_became_peered":"2023-11-08T19:24:31.148857+0000","last_unstale":"2023-11-08T19:25:27.179205+0000","last_undegraded":"2023-11-08T19:25:27.179205+0000","last_fullsized":"2023-11-08T19:25:27.179205+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:45:34.425432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065078599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.201855+0000","last_change":"2023-11-08T19:25:30.201855+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.201855+0000","last_undegraded":"2023-11-08T19:25:30.201855+0000","last_fullsized":"2023-11-08T19:25:30.201855+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":37,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.179206+0000","last_change":"2023-11-08T19:24:32.140167+0000","last_active":"2023-11-08T19:25:27.179206+0000","last_peered":"2023-11-08T19:25:27.179206+0000","last_clean":"2023-11-08T19:25:27.179206+0000","last_became_active":"2023-11-08T19:24:31.147181+0000","last_became_peered":"2023-11-08T19:24:31.147181+0000","last_unstale":"2023-11-08T19:25:27.179206+0000","last_undegraded":"2023-11-08T19:25:27.179206+0000","last_fullsized":"2023-11-08T19:25:27.179206+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:26.080042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057135200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.197604+0000","last_change":"2023-11-08T19:25:30.197604+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.197604+0000","last_undegraded":"2023-11-08T19:25:30.197604+0000","last_fullsized":"2023-11-08T19:25:30.197604+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":33,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.563345+0000","last_change":"2023-11-08T19:24:32.530895+0000","last_active":"2023-11-08T19:25:27.563345+0000","last_peered":"2023-11-08T19:25:27.563345+0000","last_clean":"2023-11-08T19:25:27.563345+0000","last_became_active":"2023-11-08T19:24:31.146715+0000","last_became_peered":"2023-11-08T19:24:31.146715+0000","last_unstale":"2023-11-08T19:25:27.563345+0000","last_undegraded":"2023-11-08T19:25:27.563345+0000","last_fullsized":"2023-11-08T19:25:27.563345+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:39.214888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081671599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.199269+0000","last_change":"2023-11-08T19:25:30.199269+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.199269+0000","last_undegraded":"2023-11-08T19:25:30.199269+0000","last_fullsized":"2023-11-08T19:25:30.199269+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":34,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.562867+0000","last_change":"2023-11-08T19:24:32.333430+0000","last_active":"2023-11-08T19:25:27.562867+0000","last_peered":"2023-11-08T19:25:27.562867+0000","last_clean":"2023-11-08T19:25:27.562867+0000","last_became_active":"2023-11-08T19:24:31.141710+0000","last_became_peered":"2023-11-08T19:24:31.141710+0000","last_unstale":"2023-11-08T19:25:27.562867+0000","last_undegraded":"2023-11-08T19:25:27.562867+0000","last_fullsized":"2023-11-08T19:25:27.562867+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:32:51.214551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000430438,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.243873+0000","last_change":"2023-11-08T19:25:32.241953+0000","last_active":"2023-11-08T19:25:32.243873+0000","last_peered":"2023-11-08T19:25:32.243873+0000","last_clean":"2023-11-08T19:25:32.243873+0000","last_became_active":"2023-11-08T19:25:32.241304+0000","last_became_peered":"2023-11-08T19:25:32.241304+0000","last_unstale":"2023-11-08T19:25:32.243873+0000","last_undegraded":"2023-11-08T19:25:32.243873+0000","last_fullsized":"2023-11-08T19:25:32.243873+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:12:10.425204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.201020+0000","last_change":"2023-11-08T19:25:30.201020+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.201020+0000","last_undegraded":"2023-11-08T19:25:30.201020+0000","last_fullsized":"2023-11-08T19:25:30.201020+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":33,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.562907+0000","last_change":"2023-11-08T19:24:32.530333+0000","last_active":"2023-11-08T19:25:27.562907+0000","last_peered":"2023-11-08T19:25:27.562907+0000","last_clean":"2023-11-08T19:25:27.562907+0000","last_became_active":"2023-11-08T19:24:31.144838+0000","last_became_peered":"2023-11-08T19:24:31.144838+0000","last_unstale":"2023-11-08T19:25:27.562907+0000","last_undegraded":"2023-11-08T19:25:27.562907+0000","last_fullsized":"2023-11-08T19:25:27.562907+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:39:48.473183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081588799999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.242599+0000","last_change":"2023-11-08T19:25:32.240888+0000","last_active":"2023-11-08T19:25:32.242599+0000","last_peered":"2023-11-08T19:25:32.242599+0000","last_clean":"2023-11-08T19:25:32.242599+0000","last_became_active":"2023-11-08T19:25:32.240537+0000","last_became_peered":"2023-11-08T19:25:32.240537+0000","last_unstale":"2023-11-08T19:25:32.242599+0000","last_undegraded":"2023-11-08T19:25:32.242599+0000","last_fullsized":"2023-11-08T19:25:32.242599+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:19:39.469446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.199253+0000","last_change":"2023-11-08T19:25:30.199253+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.199253+0000","last_undegraded":"2023-11-08T19:25:30.199253+0000","last_fullsized":"2023-11-08T19:25:30.199253+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":34,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.563039+0000","last_change":"2023-11-08T19:24:32.333096+0000","last_active":"2023-11-08T19:25:27.563039+0000","last_peered":"2023-11-08T19:25:27.563039+0000","last_clean":"2023-11-08T19:25:27.563039+0000","last_became_active":"2023-11-08T19:24:31.142985+0000","last_became_peered":"2023-11-08T19:24:31.142985+0000","last_unstale":"2023-11-08T19:25:27.563039+0000","last_undegraded":"2023-11-08T19:25:27.563039+0000","last_fullsized":"2023-11-08T19:25:27.563039+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:36:33.274496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000386048,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.203005+0000","last_change":"2023-11-08T19:25:30.203005+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.203005+0000","last_undegraded":"2023-11-08T19:25:30.203005+0000","last_fullsized":"2023-11-08T19:25:30.203005+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":35,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.562843+0000","last_change":"2023-11-08T19:24:32.263810+0000","last_active":"2023-11-08T19:25:27.562843+0000","last_peered":"2023-11-08T19:25:27.562843+0000","last_clean":"2023-11-08T19:25:27.562843+0000","last_became_active":"2023-11-08T19:24:31.138814+0000","last_became_peered":"2023-11-08T19:24:31.138814+0000","last_unstale":"2023-11-08T19:25:27.562843+0000","last_undegraded":"2023-11-08T19:25:27.562843+0000","last_fullsized":"2023-11-08T19:25:27.562843+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:21:55.985548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048136000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.204341+0000","last_change":"2023-11-08T19:25:30.204341+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.204341+0000","last_undegraded":"2023-11-08T19:25:30.204341+0000","last_fullsized":"2023-11-08T19:25:30.204341+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":34,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.562997+0000","last_change":"2023-11-08T19:24:32.544063+0000","last_active":"2023-11-08T19:25:27.562997+0000","last_peered":"2023-11-08T19:25:27.562997+0000","last_clean":"2023-11-08T19:25:27.562997+0000","last_became_active":"2023-11-08T19:24:31.144795+0000","last_became_peered":"2023-11-08T19:24:31.144795+0000","last_unstale":"2023-11-08T19:25:27.562997+0000","last_undegraded":"2023-11-08T19:25:27.562997+0000","last_fullsized":"2023-11-08T19:25:27.562997+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:12:42.248307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01495431,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.200988+0000","last_change":"2023-11-08T19:25:30.200988+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.200988+0000","last_undegraded":"2023-11-08T19:25:30.200988+0000","last_fullsized":"2023-11-08T19:25:30.200988+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":36,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-08T19:25:31.219062+0000","last_change":"2023-11-08T19:24:32.147025+0000","last_active":"2023-11-08T19:25:31.219062+0000","last_peered":"2023-11-08T19:25:31.219062+0000","last_clean":"2023-11-08T19:25:31.219062+0000","last_became_active":"2023-11-08T19:24:31.147082+0000","last_became_peered":"2023-11-08T19:24:31.147082+0000","last_unstale":"2023-11-08T19:25:31.219062+0000","last_undegraded":"2023-11-08T19:25:31.219062+0000","last_fullsized":"2023-11-08T19:25:31.219062+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:02:27.987795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043701599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.203020+0000","last_change":"2023-11-08T19:25:30.203020+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.203020+0000","last_undegraded":"2023-11-08T19:25:30.203020+0000","last_fullsized":"2023-11-08T19:25:30.203020+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":33,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.562971+0000","last_change":"2023-11-08T19:24:32.530620+0000","last_active":"2023-11-08T19:25:27.562971+0000","last_peered":"2023-11-08T19:25:27.562971+0000","last_clean":"2023-11-08T19:25:27.562971+0000","last_became_active":"2023-11-08T19:24:31.144223+0000","last_became_peered":"2023-11-08T19:24:31.144223+0000","last_unstale":"2023-11-08T19:25:27.562971+0000","last_undegraded":"2023-11-08T19:25:27.562971+0000","last_fullsized":"2023-11-08T19:25:27.562971+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:01:25.647952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071879799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.204059+0000","last_change":"2023-11-08T19:25:30.204059+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.204059+0000","last_undegraded":"2023-11-08T19:25:30.204059+0000","last_fullsized":"2023-11-08T19:25:30.204059+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":37,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.179267+0000","last_change":"2023-11-08T19:24:32.140880+0000","last_active":"2023-11-08T19:25:27.179267+0000","last_peered":"2023-11-08T19:25:27.179267+0000","last_clean":"2023-11-08T19:25:27.179267+0000","last_became_active":"2023-11-08T19:24:31.146063+0000","last_became_peered":"2023-11-08T19:24:31.146063+0000","last_unstale":"2023-11-08T19:25:27.179267+0000","last_undegraded":"2023-11-08T19:25:27.179267+0000","last_fullsized":"2023-11-08T19:25:27.179267+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:54:08.985813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089896300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.225054+0000","last_change":"2023-11-08T19:25:31.224949+0000","last_active":"2023-11-08T19:25:32.225054+0000","last_peered":"2023-11-08T19:25:32.225054+0000","last_clean":"2023-11-08T19:25:32.225054+0000","last_became_active":"2023-11-08T19:25:31.224687+0000","last_became_peered":"2023-11-08T19:25:31.224687+0000","last_unstale":"2023-11-08T19:25:32.225054+0000","last_undegraded":"2023-11-08T19:25:32.225054+0000","last_fullsized":"2023-11-08T19:25:32.225054+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:15:07.118614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":38,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.177607+0000","last_change":"2023-11-08T19:24:32.139885+0000","last_active":"2023-11-08T19:25:27.177607+0000","last_peered":"2023-11-08T19:25:27.177607+0000","last_clean":"2023-11-08T19:25:27.177607+0000","last_became_active":"2023-11-08T19:24:31.145329+0000","last_became_peered":"2023-11-08T19:24:31.145329+0000","last_unstale":"2023-11-08T19:25:27.177607+0000","last_undegraded":"2023-11-08T19:25:27.177607+0000","last_fullsized":"2023-11-08T19:25:27.177607+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:25:18.356784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049012999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.204372+0000","last_change":"2023-11-08T19:25:30.204372+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.204372+0000","last_undegraded":"2023-11-08T19:25:30.204372+0000","last_fullsized":"2023-11-08T19:25:30.204372+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":34,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.177264+0000","last_change":"2023-11-08T19:24:32.142836+0000","last_active":"2023-11-08T19:25:27.177264+0000","last_peered":"2023-11-08T19:25:27.177264+0000","last_clean":"2023-11-08T19:25:27.177264+0000","last_became_active":"2023-11-08T19:24:31.141367+0000","last_became_peered":"2023-11-08T19:24:31.141367+0000","last_unstale":"2023-11-08T19:25:27.177264+0000","last_undegraded":"2023-11-08T19:25:27.177264+0000","last_fullsized":"2023-11-08T19:25:27.177264+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:39.214888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001335136,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.244187+0000","last_change":"2023-11-08T19:25:32.243168+0000","last_active":"2023-11-08T19:25:32.244187+0000","last_peered":"2023-11-08T19:25:32.244187+0000","last_clean":"2023-11-08T19:25:32.244187+0000","last_became_active":"2023-11-08T19:25:32.242923+0000","last_became_peered":"2023-11-08T19:25:32.242923+0000","last_unstale":"2023-11-08T19:25:32.244187+0000","last_undegraded":"2023-11-08T19:25:32.244187+0000","last_fullsized":"2023-11-08T19:25:32.244187+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:09:29.604127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.201640+0000","last_change":"2023-11-08T19:25:30.201640+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.201640+0000","last_undegraded":"2023-11-08T19:25:30.201640+0000","last_fullsized":"2023-11-08T19:25:30.201640+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":34,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.563450+0000","last_change":"2023-11-08T19:24:32.544285+0000","last_active":"2023-11-08T19:25:27.563450+0000","last_peered":"2023-11-08T19:25:27.563450+0000","last_clean":"2023-11-08T19:25:27.563450+0000","last_became_active":"2023-11-08T19:24:31.142028+0000","last_became_peered":"2023-11-08T19:24:31.142028+0000","last_unstale":"2023-11-08T19:25:27.563450+0000","last_undegraded":"2023-11-08T19:25:27.563450+0000","last_fullsized":"2023-11-08T19:25:27.563450+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:01:24.198196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067537399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.205611+0000","last_change":"2023-11-08T19:25:30.205611+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.205611+0000","last_undegraded":"2023-11-08T19:25:30.205611+0000","last_fullsized":"2023-11-08T19:25:30.205611+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":34,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.563432+0000","last_change":"2023-11-08T19:24:32.544333+0000","last_active":"2023-11-08T19:25:27.563432+0000","last_peered":"2023-11-08T19:25:27.563432+0000","last_clean":"2023-11-08T19:25:27.563432+0000","last_became_active":"2023-11-08T19:24:31.138598+0000","last_became_peered":"2023-11-08T19:24:31.138598+0000","last_unstale":"2023-11-08T19:25:27.563432+0000","last_undegraded":"2023-11-08T19:25:27.563432+0000","last_fullsized":"2023-11-08T19:25:27.563432+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:11.860580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015114824000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.204838+0000","last_change":"2023-11-08T19:25:30.204838+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.204838+0000","last_undegraded":"2023-11-08T19:25:30.204838+0000","last_fullsized":"2023-11-08T19:25:30.204838+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":33,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.563239+0000","last_change":"2023-11-08T19:24:32.530665+0000","last_active":"2023-11-08T19:25:27.563239+0000","last_peered":"2023-11-08T19:25:27.563239+0000","last_clean":"2023-11-08T19:25:27.563239+0000","last_became_active":"2023-11-08T19:24:31.148363+0000","last_became_peered":"2023-11-08T19:24:31.148363+0000","last_unstale":"2023-11-08T19:25:27.563239+0000","last_undegraded":"2023-11-08T19:25:27.563239+0000","last_fullsized":"2023-11-08T19:25:27.563239+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:02:27.987795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075444200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":204,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-08T19:25:31.215764+0000","last_change":"2023-11-08T19:22:58.054283+0000","last_active":"2023-11-08T19:25:31.215764+0000","last_peered":"2023-11-08T19:25:31.215764+0000","last_clean":"2023-11-08T19:25:31.215764+0000","last_became_active":"2023-11-08T19:22:58.053337+0000","last_became_peered":"2023-11-08T19:22:58.053337+0000","last_unstale":"2023-11-08T19:25:31.215764+0000","last_undegraded":"2023-11-08T19:25:31.215764+0000","last_fullsized":"2023-11-08T19:25:31.215764+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:22:56.479654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:22:56.479654+0000","last_clean_scrub_stamp":"2023-11-08T19:22:56.479654+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:16:05.317001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":22,"acting":22,"num_store_stats":1},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574884,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28392,"kb_used_data":1368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343448,"statfs":{"total":96636764160,"available":96607690752,"internally_reserved":0,"allocated":1400832,"data_stored":959735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.54500000000000004,"15min":0.53500000000000003},"min":{"1min":0.47599999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56499999999999995,"15min":0.56299999999999994},"min":{"1min":0.39100000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.748,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.48799999999999999}]},{"osd":1,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.54400000000000004,"15min":0.54600000000000004},"min":{"1min":0.37,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.70599999999999996,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53100000000000003,"15min":0.52900000000000003},"min":{"1min":0.39200000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.72699999999999998,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.40600000000000003}]},{"osd":2,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.50800000000000001,"15min":0.50600000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.71099999999999997,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.53100000000000003,"15min":0.53300000000000003},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.69299999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.71099999999999997}]},{"osd":3,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.41799999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.65900000000000003,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56000000000000005,"15min":0.55600000000000005},"min":{"1min":0.437,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72199999999999998,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.76100000000000001}]},{"osd":4,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.48499999999999999,"15min":0.48199999999999998},"min":{"1min":0.33400000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.373,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.63300000000000001}]},{"osd":5,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.55100000000000005,"15min":0.54500000000000004},"min":{"1min":0.41199999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.58499999999999996,"15min":0.57899999999999996},"min":{"1min":0.438,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.67400000000000004}]},{"osd":6,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61099999999999999,"15min":0.61199999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.82299999999999995,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56699999999999995,"15min":0.56200000000000006},"min":{"1min":0.43099999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.69199999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":774144,"data_stored":354355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.59699999999999998,"15min":0.60499999999999998},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.78000000000000003,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.58499999999999996,"15min":0.59499999999999997},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.78800000000000003,"5min":1.478,"15min":1.478},"last":0.60699999999999998}]},{"osd":1,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.60499999999999998,"15min":0.60899999999999999},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.80600000000000005,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.621,"5min":0.66300000000000003,"15min":0.67000000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.81699999999999995,"5min":1.649,"15min":1.649},"last":0.72699999999999998}]},{"osd":2,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56000000000000005,"15min":0.55900000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.63,"15min":0.63500000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.75900000000000001,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.626}]},{"osd":3,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.61799999999999999,"15min":0.63400000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77000000000000002,"5min":1.766,"15min":1.766},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.61199999999999999,"15min":0.625},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.877,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":0.64000000000000001}]},{"osd":4,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.53700000000000003,"15min":0.54200000000000004},"min":{"1min":0.36399999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.64500000000000002,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.374},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.57699999999999996,"15min":0.58199999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.55500000000000005}]},{"osd":5,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.56399999999999995,"15min":0.57099999999999995},"min":{"1min":0.42599999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.63300000000000001,"15min":0.63900000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.71499999999999997,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.57499999999999996}]},{"osd":7,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.61199999999999999,"15min":0.61499999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.64400000000000002,"15min":0.64900000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.53200000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574883,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":774144,"data_stored":354355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:24:57 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.36399999999999999,"15min":0.36499999999999999},"min":{"1min":0.255,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.42699999999999999,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.40799999999999997,"15min":0.41899999999999998},"min":{"1min":0.22800000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.5,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":0.22900000000000001}]},{"osd":2,"last update":"Wed Nov 8 19:24:57 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.34499999999999997,"15min":0.34699999999999998},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.43099999999999999,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.37,"5min":0.39400000000000002,"15min":0.39800000000000002},"min":{"1min":0.26200000000000001,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.502,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.27000000000000002}]},{"osd":3,"last update":"Wed Nov 8 19:24:57 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.33500000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.69499999999999995,"5min":1.24,"15min":1.24},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.45800000000000002,"15min":0.46800000000000003},"min":{"1min":0.27600000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.503,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.33800000000000002}]},{"osd":4,"last update":"Wed Nov 8 19:24:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.61299999999999999,"15min":0.61699999999999999},"min":{"1min":0.42299999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.745,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.628},{"interface":"front","average":{"1min":0.625,"5min":0.57299999999999995,"15min":0.56499999999999995},"min":{"1min":0.502,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.56499999999999995}]},{"osd":5,"last update":"Wed Nov 8 19:24:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.56399999999999995,"15min":0.55600000000000005},"min":{"1min":0.42699999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.441,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.72299999999999998,"5min":1.115,"15min":1.115},"last":0.59899999999999998}]},{"osd":6,"last update":"Wed Nov 8 19:24:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.48999999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.84599999999999997,"5min":2.093,"15min":2.093},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.745,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.54600000000000004}]},{"osd":7,"last update":"Wed Nov 8 19:24:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.66700000000000004,"15min":0.67700000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.748,"5min":1.591,"15min":1.591},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.68700000000000006,"15min":0.69899999999999995},"min":{"1min":0.44600000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.77500000000000002,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.52900000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574883,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28360,"kb_used_data":1336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343480,"statfs":{"total":96636764160,"available":96607723520,"internally_reserved":0,"allocated":1368064,"data_stored":944723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":1.0509999999999999,"15min":1.175},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.51900000000000002,"5min":19.295999999999999,"15min":19.295999999999999},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.96999999999999997,"15min":1.0740000000000001},"min":{"1min":0.252,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.502,"5min":17.204000000000001,"15min":17.204000000000001},"last":0.36299999999999999}]},{"osd":2,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.59499999999999997,"15min":0.63500000000000001},"min":{"1min":0.28599999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.46500000000000002,"5min":6.524,"15min":6.524},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.36699999999999999,"5min":1.008,"15min":1.115},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.47799999999999998,"5min":17.175000000000001,"15min":17.175000000000001},"last":0.40899999999999997}]},{"osd":3,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.86399999999999999,"15min":0.94999999999999996},"min":{"1min":0.27600000000000002,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.48899999999999999,"5min":14.324,"15min":14.324},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.40000000000000002,"15min":0.40200000000000002},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.52100000000000002,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.433}]},{"osd":4,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":1.1599999999999999,"15min":1.256},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.76700000000000002,"5min":17.056000000000001,"15min":17.056000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.72899999999999998,"15min":0.753},"min":{"1min":0.441,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.749,"5min":5.0289999999999999,"15min":5.0289999999999999},"last":0.71999999999999997}]},{"osd":5,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.72899999999999998,"15min":0.75600000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.77300000000000002,"5min":5.0590000000000002,"15min":5.0590000000000002},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56699999999999995,"15min":0.56499999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.54500000000000004}]},{"osd":6,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.60399999999999998,"15min":0.60499999999999998},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":1.1990000000000001,"15min":1.304},"min":{"1min":0.35499999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.70099999999999996,"5min":17.111999999999998,"15min":17.111999999999998},"last":0.73399999999999999}]},{"osd":7,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":1.2170000000000001,"15min":1.319},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.77000000000000002,"5min":17.146000000000001,"15min":17.146000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.74099999999999999,"15min":0.76700000000000002},"min":{"1min":0.40899999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.83299999999999996,"5min":4.9829999999999997,"15min":4.9829999999999997},"last":0.751}]}]},{"osd":2,"up_from":13,"seq":55834574883,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":774144,"data_stored":354355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.46200000000000002,"15min":0.48499999999999999},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.48799999999999999,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.37,"5min":0.499,"15min":0.52100000000000002},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.68000000000000005,"5min":3.4369999999999998,"15min":3.4369999999999998},"last":0.379}]},{"osd":1,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.53400000000000003,"15min":0.56399999999999995},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.58299999999999996,"5min":4.0679999999999996,"15min":4.0679999999999996},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.439,"5min":0.58499999999999996,"15min":0.60899999999999999},"min":{"1min":0.29499999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.72099999999999997,"5min":4.3499999999999996,"15min":4.3499999999999996},"last":0.42099999999999999}]},{"osd":3,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.53100000000000003,"15min":0.54900000000000004},"min":{"1min":0.26600000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.75600000000000001,"5min":3.8580000000000001,"15min":3.8580000000000001},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.497,"15min":0.52300000000000002},"min":{"1min":0.27600000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.55400000000000005,"5min":3.476,"15min":3.476},"last":0.39700000000000002}]},{"osd":4,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.71099999999999997,"15min":0.72499999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.3180000000000001,"5min":4.0090000000000003,"15min":4.0090000000000003},"last":0.623},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.72699999999999998,"15min":0.747},"min":{"1min":0.46000000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.92300000000000004,"5min":4.1040000000000001,"15min":4.1040000000000001},"last":0.58199999999999996}]},{"osd":5,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.73199999999999998,"15min":0.75600000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.85399999999999998,"5min":4.0869999999999997,"15min":4.0869999999999997},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.73399999999999999,"15min":0.75800000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.73999999999999999,"5min":3.843,"15min":3.843},"last":0.56299999999999994}]},{"osd":6,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.748,"15min":0.77200000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0720000000000001,"5min":4.1399999999999997,"15min":4.1399999999999997},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.72099999999999997,"15min":0.745},"min":{"1min":0.42899999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.81100000000000005,"5min":4.0499999999999998,"15min":4.0499999999999998},"last":0.67800000000000005}]},{"osd":7,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.76600000000000001,"15min":0.78100000000000003},"min":{"1min":0.51000000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.181,"5min":4.157,"15min":4.157},"last":0.754},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.79100000000000004,"15min":0.81200000000000006},"min":{"1min":0.48099999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.222,"5min":4.1710000000000003,"15min":4.1710000000000003},"last":0.50600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574883,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":774144,"data_stored":354355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.38300000000000001,"15min":0.38600000000000001},"min":{"1min":0.24199999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.63300000000000001,"5min":1.458,"15min":1.458},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.39500000000000002,"15min":0.40000000000000002},"min":{"1min":0.29199999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.53800000000000003,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.503}]},{"osd":1,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.40799999999999997,"15min":0.41199999999999998},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.747,"5min":1.512,"15min":1.512},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.442,"15min":0.44900000000000001},"min":{"1min":0.311,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.59499999999999997,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.57099999999999995}]},{"osd":2,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.376,"15min":0.378},"min":{"1min":0.28100000000000003,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.55600000000000005,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.42799999999999999,"15min":0.42999999999999999},"min":{"1min":0.315,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.70399999999999996,"5min":1.536,"15min":1.536},"last":0.60899999999999999}]},{"osd":4,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.61299999999999999,"15min":0.621},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.72199999999999998,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.752,"5min":1.153,"15min":1.153},"last":0.65100000000000002}]},{"osd":5,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.59299999999999997,"15min":0.59199999999999997},"min":{"1min":0.42299999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.86499999999999999,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.59799999999999998,"15min":0.60599999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.77100000000000002,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.73699999999999999}]},{"osd":6,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.57799999999999996,"15min":0.58099999999999996},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.78300000000000003,"5min":1.113,"15min":1.113},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.61199999999999999,"15min":0.61399999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.82399999999999995,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.71799999999999997}]},{"osd":7,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.64400000000000002,"15min":0.65000000000000002},"min":{"1min":0.44700000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.72099999999999997,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.626,"5min":0.61799999999999999,"15min":0.61699999999999999},"min":{"1min":0.48199999999999998,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.83799999999999997,"5min":1.179,"15min":1.179},"last":0.627}]}]},{"osd":4,"up_from":13,"seq":55834574883,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":774144,"data_stored":354355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53800000000000003,"15min":0.53600000000000003},"min":{"1min":0.35699999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.68600000000000005,"5min":1.399,"15min":1.399},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.59099999999999997,"15min":0.59699999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.75700000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.68300000000000005}]},{"osd":1,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.36599999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.499,"15min":0.496},"min":{"1min":0.39700000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.505}]},{"osd":2,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.627,"15min":0.63800000000000001},"min":{"1min":0.377,"5min":0.373,"15min":0.373},"max":{"1min":0.77300000000000002,"5min":2.8490000000000002,"15min":2.8490000000000002},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.52500000000000002,"15min":0.52000000000000002},"min":{"1min":0.434,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.40799999999999997}]},{"osd":3,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.56999999999999995,"15min":0.56399999999999995},"min":{"1min":0.41199999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.71899999999999997,"15min":0.72999999999999998},"min":{"1min":0.53200000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.78500000000000003,"5min":3.4849999999999999,"15min":3.4849999999999999},"last":0.76000000000000001}]},{"osd":5,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52000000000000002,"15min":0.52100000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.68100000000000005,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56100000000000005,"15min":0.55800000000000005},"min":{"1min":0.36299999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.79100000000000004}]},{"osd":6,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.70199999999999996,"15min":0.72399999999999998},"min":{"1min":0.38,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.83199999999999996,"5min":4.1529999999999996,"15min":4.1529999999999996},"last":0.623},{"interface":"front","average":{"1min":0.621,"5min":0.61399999999999999,"15min":0.61299999999999999},"min":{"1min":0.42699999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.73999999999999999}]},{"osd":7,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57199999999999995,"15min":0.57099999999999995},"min":{"1min":0.41699999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.80500000000000005,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.83999999999999997,"15min":0.86399999999999999},"min":{"1min":0.55900000000000005,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.87,"5min":5.5359999999999996,"15min":5.5359999999999996},"last":0.83899999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574883,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":774144,"data_stored":354355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.54400000000000004,"15min":0.54900000000000004},"min":{"1min":0.32300000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.78100000000000003,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":0.432},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.52500000000000002,"15min":0.51900000000000002},"min":{"1min":0.38700000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.745,"5min":0.878,"15min":0.878},"last":0.47199999999999998}]},{"osd":1,"last update":"Wed Nov 8 19:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.54700000000000004,"15min":0.54500000000000004},"min":{"1min":0.32400000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.76300000000000001,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.60399999999999998,"15min":0.60999999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.66300000000000003,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":0.52700000000000002}]},{"osd":2,"last update":"Wed Nov 8 19:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.56000000000000005,"15min":0.55800000000000005},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.68999999999999995,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52800000000000002,"15min":0.52700000000000002},"min":{"1min":0.39400000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.66700000000000004,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.38200000000000001}]},{"osd":3,"last update":"Wed Nov 8 19:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.55700000000000005,"15min":0.55600000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71899999999999997,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57499999999999996,"15min":0.57299999999999995},"min":{"1min":0.46999999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.83699999999999997,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.45100000000000001}]},{"osd":4,"last update":"Wed Nov 8 19:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.59299999999999997,"15min":0.60499999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.80600000000000005,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.63500000000000001,"15min":0.63400000000000001},"min":{"1min":0.49299999999999999,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.81999999999999995,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.53900000000000003}]},{"osd":6,"last update":"Wed Nov 8 19:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.58599999999999997,"15min":0.57999999999999996},"min":{"1min":0.437,"5min":0.37,"15min":0.37},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.65900000000000003,"15min":0.67300000000000004},"min":{"1min":0.38400000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.754,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":0.495}]},{"osd":7,"last update":"Wed Nov 8 19:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.627,"15min":0.63},"min":{"1min":0.42399999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.77600000000000002,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.625,"5min":0.64500000000000002,"15min":0.64900000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.871,"5min":0.873,"15min":0.873},"last":0.59399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:25:36.706 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:25:36.859 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.857+0000 7f6ddfd2b700 1 Processor -- start 2023-11-08T19:25:36.859 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.858+0000 7f6ddfd2b700 1 -- start start 2023-11-08T19:25:36.861 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.858+0000 7f6ddfd2b700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6dd815b950 0x7f6dd80ce130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:36.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.858+0000 7f6ddfd2b700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6dd80cd5e0 0x7f6dd80ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:36.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.858+0000 7f6ddfd2b700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dd80cc2e0 con 0x7f6dd80cfd20 2023-11-08T19:25:36.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.858+0000 7f6ddfd2b700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dd80cc580 con 0x7f6dd815b950 2023-11-08T19:25:36.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.858+0000 7f6ddfd2b700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd80cc820 con 0x7f6dd80cd5e0 2023-11-08T19:25:36.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.859+0000 7f6dddac7700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6dd815b950 0x7f6dd80ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:36.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.859+0000 7f6dddac7700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6dd815b950 0x7f6dd80ce130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41356/0 (socket says 172.21.15.149:41356) 2023-11-08T19:25:36.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.859+0000 7f6dddac7700 1 -- 172.21.15.149:0/2770743134 learned_addr learned my addr 172.21.15.149:0/2770743134 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:36.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.859+0000 7f6ddd2c6700 1 --2- 172.21.15.149:0/2770743134 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6dd80cd5e0 0x7f6dd80ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:36.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.859+0000 7f6dddac7700 1 -- 172.21.15.149:0/2770743134 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6dd80cd5e0 msgr2=0x7f6dd80ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:36.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.859+0000 7f6dddac7700 1 --2- 172.21.15.149:0/2770743134 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6dd80cd5e0 0x7f6dd80ce670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:36.864 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.859+0000 7f6dddac7700 1 -- 172.21.15.149:0/2770743134 >> v1:172.21.15.160:6789/0 conn(0x7f6dd80cfd20 legacy=0x7f6dd80d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:36.864 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.859+0000 7f6dddac7700 1 -- 172.21.15.149:0/2770743134 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd80ccb00 con 0x7f6dd815b950 2023-11-08T19:25:36.864 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.859+0000 7f6dddac7700 1 --2- 172.21.15.149:0/2770743134 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6dd815b950 0x7f6dd80ce130 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f6dd0006fd0 tx=0x7f6dd0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b7e3fed2d367803 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:36.864 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.859+0000 7f6ddcac5700 1 -- 172.21.15.149:0/2770743134 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd0005e30 con 0x7f6dd815b950 2023-11-08T19:25:36.864 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.859+0000 7f6ddcac5700 1 -- 172.21.15.149:0/2770743134 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dd0006030 con 0x7f6dd815b950 2023-11-08T19:25:36.865 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.859+0000 7f6ddcac5700 1 -- 172.21.15.149:0/2770743134 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd00063c0 con 0x7f6dd815b950 2023-11-08T19:25:36.865 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.860+0000 7f6ddfd2b700 1 -- 172.21.15.149:0/2770743134 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6dd815b950 msgr2=0x7f6dd80ce130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:36.865 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.860+0000 7f6ddfd2b700 1 --2- 172.21.15.149:0/2770743134 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6dd815b950 0x7f6dd80ce130 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f6dd0006fd0 tx=0x7f6dd0009bd0 comp rx=0 tx=0).stop 2023-11-08T19:25:36.865 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.860+0000 7f6ddfd2b700 1 -- 172.21.15.149:0/2770743134 shutdown_connections 2023-11-08T19:25:36.865 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.860+0000 7f6ddfd2b700 1 --2- 172.21.15.149:0/2770743134 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6dd815b950 0x7f6dd80ce130 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:36.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.860+0000 7f6ddfd2b700 1 --2- 172.21.15.149:0/2770743134 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6dd80cd5e0 0x7f6dd80ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:36.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.860+0000 7f6ddfd2b700 1 -- 172.21.15.149:0/2770743134 >> 172.21.15.149:0/2770743134 conn(0x7f6dd808afd0 msgr2=0x7f6dd80d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:36.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.860+0000 7f6ddfd2b700 1 -- 172.21.15.149:0/2770743134 shutdown_connections 2023-11-08T19:25:36.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.860+0000 7f6ddfd2b700 1 -- 172.21.15.149:0/2770743134 wait complete. 2023-11-08T19:25:36.869 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.861+0000 7f6ddfd2b700 1 Processor -- start 2023-11-08T19:25:36.869 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.861+0000 7f6ddfd2b700 1 -- start start 2023-11-08T19:25:36.869 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.862+0000 7f6ddfd2b700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6dd80cfd20 0x7f6dd80c9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:36.869 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.862+0000 7f6ddfd2b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6dd815b950 0x7f6dd80c5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:36.870 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.862+0000 7f6ddfd2b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6dd80afb90 0x7f6dd8155b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:36.870 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.862+0000 7f6ddfd2b700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd80c9650 con 0x7f6dd80afb90 2023-11-08T19:25:36.870 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.862+0000 7f6ddfd2b700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd80c9930 con 0x7f6dd815b950 2023-11-08T19:25:36.870 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.862+0000 7f6ddfd2b700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd80c9c10 con 0x7f6dd80cfd20 2023-11-08T19:25:36.870 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.862+0000 7f6dde2c8700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6dd80afb90 0x7f6dd8155b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:36.871 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.862+0000 7f6dde2c8700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6dd80afb90 0x7f6dd8155b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41366/0 (socket says 172.21.15.149:41366) 2023-11-08T19:25:36.871 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.862+0000 7f6dde2c8700 1 -- 172.21.15.149:0/4095834610 learned_addr learned my addr 172.21.15.149:0/4095834610 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:36.871 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.862+0000 7f6dddac7700 1 --2- 172.21.15.149:0/4095834610 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6dd80cfd20 0x7f6dd80c9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:36.871 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.862+0000 7f6ddd2c6700 1 --2- 172.21.15.149:0/4095834610 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6dd815b950 0x7f6dd80c5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:36.871 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.862+0000 7f6dde2c8700 1 -- 172.21.15.149:0/4095834610 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6dd80cfd20 msgr2=0x7f6dd80c9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:36.872 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.862+0000 7f6dde2c8700 1 --2- 172.21.15.149:0/4095834610 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6dd80cfd20 0x7f6dd80c9070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:36.872 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.862+0000 7f6dde2c8700 1 -- 172.21.15.149:0/4095834610 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6dd815b950 msgr2=0x7f6dd80c5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:36.872 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.862+0000 7f6dde2c8700 1 --2- 172.21.15.149:0/4095834610 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6dd815b950 0x7f6dd80c5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:36.872 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.862+0000 7f6dde2c8700 1 -- 172.21.15.149:0/4095834610 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd0009500 con 0x7f6dd80afb90 2023-11-08T19:25:36.872 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.862+0000 7f6dddac7700 1 --2- 172.21.15.149:0/4095834610 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6dd80cfd20 0x7f6dd80c9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:25:36.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.862+0000 7f6ddd2c6700 1 --2- 172.21.15.149:0/4095834610 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6dd815b950 0x7f6dd80c5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:25:36.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.862+0000 7f6dde2c8700 1 --2- 172.21.15.149:0/4095834610 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6dd80afb90 0x7f6dd8155b40 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f6dc800cc10 tx=0x7f6dc800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:36.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.862+0000 7f6dd67fc700 1 -- 172.21.15.149:0/4095834610 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc800abb0 con 0x7f6dd80afb90 2023-11-08T19:25:36.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.862+0000 7f6dd67fc700 1 -- 172.21.15.149:0/4095834610 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dc800ad10 con 0x7f6dd80afb90 2023-11-08T19:25:36.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.862+0000 7f6ddfd2b700 1 -- 172.21.15.149:0/4095834610 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dd80c9ef0 con 0x7f6dd80afb90 2023-11-08T19:25:36.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.862+0000 7f6dd67fc700 1 -- 172.21.15.149:0/4095834610 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc8012660 con 0x7f6dd80afb90 2023-11-08T19:25:36.874 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.862+0000 7f6ddfd2b700 1 -- 172.21.15.149:0/4095834610 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dd80c6230 con 0x7f6dd80afb90 2023-11-08T19:25:36.874 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.863+0000 7f6ddfd2b700 1 -- 172.21.15.149:0/4095834610 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dd80745f0 con 0x7f6dd80afb90 2023-11-08T19:25:36.874 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.864+0000 7f6dd67fc700 1 -- 172.21.15.149:0/4095834610 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6dc80127c0 con 0x7f6dd80afb90 2023-11-08T19:25:36.874 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.864+0000 7f6dd67fc700 1 --2- 172.21.15.149:0/4095834610 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6dc406af00 0x7f6dc406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:36.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.864+0000 7f6dd67fc700 1 -- 172.21.15.149:0/4095834610 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f6dc808a000 con 0x7f6dd80afb90 2023-11-08T19:25:36.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.864+0000 7f6dddac7700 1 --2- 172.21.15.149:0/4095834610 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6dc406af00 0x7f6dc406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:36.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.865+0000 7f6dddac7700 1 --2- 172.21.15.149:0/4095834610 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6dc406af00 0x7f6dc406d3c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f6dd0013040 tx=0x7f6dd0008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:36.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:36.869+0000 7f6dd67fc700 1 -- 172.21.15.149:0/4095834610 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6dc8054e00 con 0x7f6dd80afb90 2023-11-08T19:25:37.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.055+0000 7f6ddfd2b700 1 -- 172.21.15.149:0/4095834610 --> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6dd80c9aa0 con 0x7f6dc406af00 2023-11-08T19:25:37.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.065+0000 7f6dd67fc700 1 -- 172.21.15.149:0/4095834610 <== mgr.4104 v2:172.21.15.149:6832/1929837472 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+360221 (secure 0 0 0) 0x7f6dd80c9aa0 con 0x7f6dc406af00 2023-11-08T19:25:37.070 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:25:37.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.069+0000 7f6ddfd2b700 1 -- 172.21.15.149:0/4095834610 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6dc406af00 msgr2=0x7f6dc406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:37.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.069+0000 7f6ddfd2b700 1 --2- 172.21.15.149:0/4095834610 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6dc406af00 0x7f6dc406d3c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f6dd0013040 tx=0x7f6dd0008070 comp rx=0 tx=0).stop 2023-11-08T19:25:37.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.069+0000 7f6ddfd2b700 1 -- 172.21.15.149:0/4095834610 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6dd80afb90 msgr2=0x7f6dd8155b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:37.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.069+0000 7f6ddfd2b700 1 --2- 172.21.15.149:0/4095834610 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6dd80afb90 0x7f6dd8155b40 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f6dc800cc10 tx=0x7f6dc800a060 comp rx=0 tx=0).stop 2023-11-08T19:25:37.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.069+0000 7f6ddfd2b700 1 -- 172.21.15.149:0/4095834610 shutdown_connections 2023-11-08T19:25:37.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.069+0000 7f6ddfd2b700 1 --2- 172.21.15.149:0/4095834610 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6dc406af00 0x7f6dc406d3c0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:37.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.069+0000 7f6ddfd2b700 1 --2- 172.21.15.149:0/4095834610 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6dd80afb90 0x7f6dd8155b40 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:37.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.069+0000 7f6ddfd2b700 1 --2- 172.21.15.149:0/4095834610 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6dd80cfd20 0x7f6dd80c9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:37.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.069+0000 7f6ddfd2b700 1 --2- 172.21.15.149:0/4095834610 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6dd815b950 0x7f6dd80c5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:37.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.069+0000 7f6ddfd2b700 1 -- 172.21.15.149:0/4095834610 >> 172.21.15.149:0/4095834610 conn(0x7f6dd808afd0 msgr2=0x7f6dd815ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:37.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.069+0000 7f6ddfd2b700 1 -- 172.21.15.149:0/4095834610 shutdown_connections 2023-11-08T19:25:37.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.069+0000 7f6ddfd2b700 1 -- 172.21.15.149:0/4095834610 wait complete. 2023-11-08T19:25:37.076 INFO:teuthology.orchestra.run.smithi149.stderr:dumped all 2023-11-08T19:25:37.082 INFO:teuthology.orchestra.run.smithi149.stdout:{"pg_ready":true,"pg_map":{"version":140,"stamp":"2023-11-08T19:25:36.019097+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590950,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":163,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":121,"ondisk_log_size":121,"up":152,"acting":152,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":71,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223416,"kb_used_data":7240,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754751304,"statfs":{"total":773094113280,"available":772865335296,"internally_reserved":0,"allocated":7413760,"data_stored":4030588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.824621"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.244169+0000","last_change":"2023-11-08T19:25:32.242622+0000","last_active":"2023-11-08T19:25:32.244169+0000","last_peered":"2023-11-08T19:25:32.244169+0000","last_clean":"2023-11-08T19:25:32.244169+0000","last_became_active":"2023-11-08T19:25:32.241199+0000","last_became_peered":"2023-11-08T19:25:32.241199+0000","last_unstale":"2023-11-08T19:25:32.244169+0000","last_undegraded":"2023-11-08T19:25:32.244169+0000","last_fullsized":"2023-11-08T19:25:32.244169+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:58:53.564452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.243835+0000","last_change":"2023-11-08T19:25:32.241457+0000","last_active":"2023-11-08T19:25:32.243835+0000","last_peered":"2023-11-08T19:25:32.243835+0000","last_clean":"2023-11-08T19:25:32.243835+0000","last_became_active":"2023-11-08T19:25:32.240722+0000","last_became_peered":"2023-11-08T19:25:32.240722+0000","last_unstale":"2023-11-08T19:25:32.243835+0000","last_undegraded":"2023-11-08T19:25:32.243835+0000","last_fullsized":"2023-11-08T19:25:32.243835+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:30:42.550006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.240841+0000","last_change":"2023-11-08T19:25:32.231809+0000","last_active":"2023-11-08T19:25:32.240841+0000","last_peered":"2023-11-08T19:25:32.240841+0000","last_clean":"2023-11-08T19:25:32.240841+0000","last_became_active":"2023-11-08T19:25:32.231324+0000","last_became_peered":"2023-11-08T19:25:32.231324+0000","last_unstale":"2023-11-08T19:25:32.240841+0000","last_undegraded":"2023-11-08T19:25:32.240841+0000","last_fullsized":"2023-11-08T19:25:32.240841+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:53:01.958964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.242886+0000","last_change":"2023-11-08T19:25:32.239395+0000","last_active":"2023-11-08T19:25:32.242886+0000","last_peered":"2023-11-08T19:25:32.242886+0000","last_clean":"2023-11-08T19:25:32.242886+0000","last_became_active":"2023-11-08T19:25:32.238318+0000","last_became_peered":"2023-11-08T19:25:32.238318+0000","last_unstale":"2023-11-08T19:25:32.242886+0000","last_undegraded":"2023-11-08T19:25:32.242886+0000","last_fullsized":"2023-11-08T19:25:32.242886+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:32:09.874087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.202073+0000","last_change":"2023-11-08T19:25:30.202073+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.202073+0000","last_undegraded":"2023-11-08T19:25:30.202073+0000","last_fullsized":"2023-11-08T19:25:30.202073+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":35,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.563178+0000","last_change":"2023-11-08T19:24:32.263958+0000","last_active":"2023-11-08T19:25:27.563178+0000","last_peered":"2023-11-08T19:25:27.563178+0000","last_clean":"2023-11-08T19:25:27.563178+0000","last_became_active":"2023-11-08T19:24:31.149011+0000","last_became_peered":"2023-11-08T19:24:31.149011+0000","last_unstale":"2023-11-08T19:25:27.563178+0000","last_undegraded":"2023-11-08T19:25:27.563178+0000","last_fullsized":"2023-11-08T19:25:27.563178+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:09:04.880374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033496900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.203556+0000","last_change":"2023-11-08T19:25:30.203556+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.203556+0000","last_undegraded":"2023-11-08T19:25:30.203556+0000","last_fullsized":"2023-11-08T19:25:30.203556+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":34,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.177313+0000","last_change":"2023-11-08T19:24:32.142892+0000","last_active":"2023-11-08T19:25:27.177313+0000","last_peered":"2023-11-08T19:25:27.177313+0000","last_clean":"2023-11-08T19:25:27.177313+0000","last_became_active":"2023-11-08T19:24:31.144912+0000","last_became_peered":"2023-11-08T19:24:31.144912+0000","last_unstale":"2023-11-08T19:25:27.177313+0000","last_undegraded":"2023-11-08T19:25:27.177313+0000","last_fullsized":"2023-11-08T19:25:27.177313+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:04:21.151484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056686900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.204924+0000","last_change":"2023-11-08T19:25:30.204924+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.204924+0000","last_undegraded":"2023-11-08T19:25:30.204924+0000","last_fullsized":"2023-11-08T19:25:30.204924+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":37,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.179265+0000","last_change":"2023-11-08T19:24:32.140514+0000","last_active":"2023-11-08T19:25:27.179265+0000","last_peered":"2023-11-08T19:25:27.179265+0000","last_clean":"2023-11-08T19:25:27.179265+0000","last_became_active":"2023-11-08T19:24:31.146668+0000","last_became_peered":"2023-11-08T19:24:31.146668+0000","last_unstale":"2023-11-08T19:25:27.179265+0000","last_undegraded":"2023-11-08T19:25:27.179265+0000","last_fullsized":"2023-11-08T19:25:27.179265+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:31:24.539374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071576699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.240491+0000","last_change":"2023-11-08T19:25:32.231355+0000","last_active":"2023-11-08T19:25:32.240491+0000","last_peered":"2023-11-08T19:25:32.240491+0000","last_clean":"2023-11-08T19:25:32.240491+0000","last_became_active":"2023-11-08T19:25:32.231063+0000","last_became_peered":"2023-11-08T19:25:32.231063+0000","last_unstale":"2023-11-08T19:25:32.240491+0000","last_undegraded":"2023-11-08T19:25:32.240491+0000","last_fullsized":"2023-11-08T19:25:32.240491+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:45:36.557467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.197733+0000","last_change":"2023-11-08T19:25:30.197733+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.197733+0000","last_undegraded":"2023-11-08T19:25:30.197733+0000","last_fullsized":"2023-11-08T19:25:30.197733+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":35,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.563202+0000","last_change":"2023-11-08T19:24:32.263963+0000","last_active":"2023-11-08T19:25:27.563202+0000","last_peered":"2023-11-08T19:25:27.563202+0000","last_clean":"2023-11-08T19:25:27.563202+0000","last_became_active":"2023-11-08T19:24:31.139062+0000","last_became_peered":"2023-11-08T19:24:31.139062+0000","last_unstale":"2023-11-08T19:25:27.563202+0000","last_undegraded":"2023-11-08T19:25:27.563202+0000","last_fullsized":"2023-11-08T19:25:27.563202+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:26.080042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033682599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.197639+0000","last_change":"2023-11-08T19:25:30.197639+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.197639+0000","last_undegraded":"2023-11-08T19:25:30.197639+0000","last_fullsized":"2023-11-08T19:25:30.197639+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":37,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.179119+0000","last_change":"2023-11-08T19:24:32.141131+0000","last_active":"2023-11-08T19:25:27.179119+0000","last_peered":"2023-11-08T19:25:27.179119+0000","last_clean":"2023-11-08T19:25:27.179119+0000","last_became_active":"2023-11-08T19:24:31.146154+0000","last_became_peered":"2023-11-08T19:24:31.146154+0000","last_unstale":"2023-11-08T19:25:27.179119+0000","last_undegraded":"2023-11-08T19:25:27.179119+0000","last_fullsized":"2023-11-08T19:25:27.179119+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:18:40.271560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082432800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.205515+0000","last_change":"2023-11-08T19:25:30.205515+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.205515+0000","last_undegraded":"2023-11-08T19:25:30.205515+0000","last_fullsized":"2023-11-08T19:25:30.205515+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":33,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.562932+0000","last_change":"2023-11-08T19:24:32.529486+0000","last_active":"2023-11-08T19:25:27.562932+0000","last_peered":"2023-11-08T19:25:27.562932+0000","last_clean":"2023-11-08T19:25:27.562932+0000","last_became_active":"2023-11-08T19:24:31.146260+0000","last_became_peered":"2023-11-08T19:24:31.146260+0000","last_unstale":"2023-11-08T19:25:27.562932+0000","last_undegraded":"2023-11-08T19:25:27.562932+0000","last_fullsized":"2023-11-08T19:25:27.562932+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:45:34.425432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059842900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.244147+0000","last_change":"2023-11-08T19:25:32.242459+0000","last_active":"2023-11-08T19:25:32.244147+0000","last_peered":"2023-11-08T19:25:32.244147+0000","last_clean":"2023-11-08T19:25:32.244147+0000","last_became_active":"2023-11-08T19:25:32.240909+0000","last_became_peered":"2023-11-08T19:25:32.240909+0000","last_unstale":"2023-11-08T19:25:32.244147+0000","last_undegraded":"2023-11-08T19:25:32.244147+0000","last_fullsized":"2023-11-08T19:25:32.244147+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:38:24.832373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.204873+0000","last_change":"2023-11-08T19:25:30.204873+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.204873+0000","last_undegraded":"2023-11-08T19:25:30.204873+0000","last_fullsized":"2023-11-08T19:25:30.204873+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":33,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.562995+0000","last_change":"2023-11-08T19:24:32.530168+0000","last_active":"2023-11-08T19:25:27.562995+0000","last_peered":"2023-11-08T19:25:27.562995+0000","last_clean":"2023-11-08T19:25:27.562995+0000","last_became_active":"2023-11-08T19:24:31.144329+0000","last_became_peered":"2023-11-08T19:24:31.144329+0000","last_unstale":"2023-11-08T19:25:27.562995+0000","last_undegraded":"2023-11-08T19:25:27.562995+0000","last_fullsized":"2023-11-08T19:25:27.562995+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:05:36.085920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043484799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.202320+0000","last_change":"2023-11-08T19:25:30.202320+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.202320+0000","last_undegraded":"2023-11-08T19:25:30.202320+0000","last_fullsized":"2023-11-08T19:25:30.202320+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":38,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.177613+0000","last_change":"2023-11-08T19:24:32.141190+0000","last_active":"2023-11-08T19:25:27.177613+0000","last_peered":"2023-11-08T19:25:27.177613+0000","last_clean":"2023-11-08T19:25:27.177613+0000","last_became_active":"2023-11-08T19:24:31.147651+0000","last_became_peered":"2023-11-08T19:24:31.147651+0000","last_unstale":"2023-11-08T19:25:27.177613+0000","last_undegraded":"2023-11-08T19:25:27.177613+0000","last_fullsized":"2023-11-08T19:25:27.177613+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:21:55.985548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043673300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.199231+0000","last_change":"2023-11-08T19:25:30.199231+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.199231+0000","last_undegraded":"2023-11-08T19:25:30.199231+0000","last_fullsized":"2023-11-08T19:25:30.199231+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":36,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-08T19:25:31.219135+0000","last_change":"2023-11-08T19:24:32.147011+0000","last_active":"2023-11-08T19:25:31.219135+0000","last_peered":"2023-11-08T19:25:31.219135+0000","last_clean":"2023-11-08T19:25:31.219135+0000","last_became_active":"2023-11-08T19:24:31.148250+0000","last_became_peered":"2023-11-08T19:24:31.148250+0000","last_unstale":"2023-11-08T19:25:31.219135+0000","last_undegraded":"2023-11-08T19:25:31.219135+0000","last_fullsized":"2023-11-08T19:25:31.219135+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:01:25.647952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043061299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.197833+0000","last_change":"2023-11-08T19:25:30.197833+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.197833+0000","last_undegraded":"2023-11-08T19:25:30.197833+0000","last_fullsized":"2023-11-08T19:25:30.197833+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":34,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.563469+0000","last_change":"2023-11-08T19:24:32.543880+0000","last_active":"2023-11-08T19:25:27.563469+0000","last_peered":"2023-11-08T19:25:27.563469+0000","last_clean":"2023-11-08T19:25:27.563469+0000","last_became_active":"2023-11-08T19:24:31.142052+0000","last_became_peered":"2023-11-08T19:24:31.142052+0000","last_unstale":"2023-11-08T19:25:27.563469+0000","last_undegraded":"2023-11-08T19:25:27.563469+0000","last_fullsized":"2023-11-08T19:25:27.563469+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:18:42.371676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014881058000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.205764+0000","last_change":"2023-11-08T19:25:30.205764+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.205764+0000","last_undegraded":"2023-11-08T19:25:30.205764+0000","last_fullsized":"2023-11-08T19:25:30.205764+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":36,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-08T19:25:31.220157+0000","last_change":"2023-11-08T19:24:32.147235+0000","last_active":"2023-11-08T19:25:31.220157+0000","last_peered":"2023-11-08T19:25:31.220157+0000","last_clean":"2023-11-08T19:25:31.220157+0000","last_became_active":"2023-11-08T19:24:31.146176+0000","last_became_peered":"2023-11-08T19:24:31.146176+0000","last_unstale":"2023-11-08T19:25:31.220157+0000","last_undegraded":"2023-11-08T19:25:31.220157+0000","last_fullsized":"2023-11-08T19:25:31.220157+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:39.214888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048481000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.205527+0000","last_change":"2023-11-08T19:25:30.205527+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.205527+0000","last_undegraded":"2023-11-08T19:25:30.205527+0000","last_fullsized":"2023-11-08T19:25:30.205527+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":38,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.177637+0000","last_change":"2023-11-08T19:24:32.142376+0000","last_active":"2023-11-08T19:25:27.177637+0000","last_peered":"2023-11-08T19:25:27.177637+0000","last_clean":"2023-11-08T19:25:27.177637+0000","last_became_active":"2023-11-08T19:24:31.144614+0000","last_became_peered":"2023-11-08T19:24:31.144614+0000","last_unstale":"2023-11-08T19:25:27.177637+0000","last_undegraded":"2023-11-08T19:25:27.177637+0000","last_fullsized":"2023-11-08T19:25:27.177637+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:09:04.880374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050362200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.243857+0000","last_change":"2023-11-08T19:25:32.241615+0000","last_active":"2023-11-08T19:25:32.243857+0000","last_peered":"2023-11-08T19:25:32.243857+0000","last_clean":"2023-11-08T19:25:32.243857+0000","last_became_active":"2023-11-08T19:25:32.240989+0000","last_became_peered":"2023-11-08T19:25:32.240989+0000","last_unstale":"2023-11-08T19:25:32.243857+0000","last_undegraded":"2023-11-08T19:25:32.243857+0000","last_fullsized":"2023-11-08T19:25:32.243857+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:34:02.775077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.204319+0000","last_change":"2023-11-08T19:25:30.204319+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.204319+0000","last_undegraded":"2023-11-08T19:25:30.204319+0000","last_fullsized":"2023-11-08T19:25:30.204319+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":36,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-08T19:25:31.218923+0000","last_change":"2023-11-08T19:24:32.146639+0000","last_active":"2023-11-08T19:25:31.218923+0000","last_peered":"2023-11-08T19:25:31.218923+0000","last_clean":"2023-11-08T19:25:31.218923+0000","last_became_active":"2023-11-08T19:24:31.147384+0000","last_became_peered":"2023-11-08T19:24:31.147384+0000","last_unstale":"2023-11-08T19:25:31.218923+0000","last_undegraded":"2023-11-08T19:25:31.218923+0000","last_fullsized":"2023-11-08T19:25:31.218923+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:30:21.946303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043834899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.201615+0000","last_change":"2023-11-08T19:25:30.201615+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.201615+0000","last_undegraded":"2023-11-08T19:25:30.201615+0000","last_fullsized":"2023-11-08T19:25:30.201615+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":34,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.562977+0000","last_change":"2023-11-08T19:24:32.544108+0000","last_active":"2023-11-08T19:25:27.562977+0000","last_peered":"2023-11-08T19:25:27.562977+0000","last_clean":"2023-11-08T19:25:27.562977+0000","last_became_active":"2023-11-08T19:24:31.143812+0000","last_became_peered":"2023-11-08T19:24:31.143812+0000","last_unstale":"2023-11-08T19:25:27.562977+0000","last_undegraded":"2023-11-08T19:25:27.562977+0000","last_fullsized":"2023-11-08T19:25:27.562977+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:27:59.135977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014956126,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.201034+0000","last_change":"2023-11-08T19:25:30.201034+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.201034+0000","last_undegraded":"2023-11-08T19:25:30.201034+0000","last_fullsized":"2023-11-08T19:25:30.201034+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":33,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.563053+0000","last_change":"2023-11-08T19:24:32.530378+0000","last_active":"2023-11-08T19:25:27.563053+0000","last_peered":"2023-11-08T19:25:27.563053+0000","last_clean":"2023-11-08T19:25:27.563053+0000","last_became_active":"2023-11-08T19:24:31.144341+0000","last_became_peered":"2023-11-08T19:24:31.144341+0000","last_unstale":"2023-11-08T19:25:27.563053+0000","last_undegraded":"2023-11-08T19:25:27.563053+0000","last_fullsized":"2023-11-08T19:25:27.563053+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:30:21.946303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058308299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.243743+0000","last_change":"2023-11-08T19:25:32.241021+0000","last_active":"2023-11-08T19:25:32.243743+0000","last_peered":"2023-11-08T19:25:32.243743+0000","last_clean":"2023-11-08T19:25:32.243743+0000","last_became_active":"2023-11-08T19:25:32.240682+0000","last_became_peered":"2023-11-08T19:25:32.240682+0000","last_unstale":"2023-11-08T19:25:32.243743+0000","last_undegraded":"2023-11-08T19:25:32.243743+0000","last_fullsized":"2023-11-08T19:25:32.243743+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:32:32.171974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"66'4","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.243327+0000","last_change":"2023-11-08T19:25:31.233739+0000","last_active":"2023-11-08T19:25:32.243327+0000","last_peered":"2023-11-08T19:25:32.243327+0000","last_clean":"2023-11-08T19:25:32.243327+0000","last_became_active":"2023-11-08T19:25:31.233443+0000","last_became_peered":"2023-11-08T19:25:31.233443+0000","last_unstale":"2023-11-08T19:25:32.243327+0000","last_undegraded":"2023-11-08T19:25:32.243327+0000","last_fullsized":"2023-11-08T19:25:32.243327+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:50:34.453347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":37,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.179190+0000","last_change":"2023-11-08T19:24:32.140832+0000","last_active":"2023-11-08T19:25:27.179190+0000","last_peered":"2023-11-08T19:25:27.179190+0000","last_clean":"2023-11-08T19:25:27.179190+0000","last_became_active":"2023-11-08T19:24:31.146557+0000","last_became_peered":"2023-11-08T19:24:31.146557+0000","last_unstale":"2023-11-08T19:25:27.179190+0000","last_undegraded":"2023-11-08T19:25:27.179190+0000","last_fullsized":"2023-11-08T19:25:27.179190+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:40:04.258107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099450100000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.204036+0000","last_change":"2023-11-08T19:25:30.204036+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.204036+0000","last_undegraded":"2023-11-08T19:25:30.204036+0000","last_fullsized":"2023-11-08T19:25:30.204036+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":37,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.179205+0000","last_change":"2023-11-08T19:24:32.141188+0000","last_active":"2023-11-08T19:25:27.179205+0000","last_peered":"2023-11-08T19:25:27.179205+0000","last_clean":"2023-11-08T19:25:27.179205+0000","last_became_active":"2023-11-08T19:24:31.148857+0000","last_became_peered":"2023-11-08T19:24:31.148857+0000","last_unstale":"2023-11-08T19:25:27.179205+0000","last_undegraded":"2023-11-08T19:25:27.179205+0000","last_fullsized":"2023-11-08T19:25:27.179205+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:45:34.425432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065078599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.201855+0000","last_change":"2023-11-08T19:25:30.201855+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.201855+0000","last_undegraded":"2023-11-08T19:25:30.201855+0000","last_fullsized":"2023-11-08T19:25:30.201855+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":37,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.179206+0000","last_change":"2023-11-08T19:24:32.140167+0000","last_active":"2023-11-08T19:25:27.179206+0000","last_peered":"2023-11-08T19:25:27.179206+0000","last_clean":"2023-11-08T19:25:27.179206+0000","last_became_active":"2023-11-08T19:24:31.147181+0000","last_became_peered":"2023-11-08T19:24:31.147181+0000","last_unstale":"2023-11-08T19:25:27.179206+0000","last_undegraded":"2023-11-08T19:25:27.179206+0000","last_fullsized":"2023-11-08T19:25:27.179206+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:26.080042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057135200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.197604+0000","last_change":"2023-11-08T19:25:30.197604+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.197604+0000","last_undegraded":"2023-11-08T19:25:30.197604+0000","last_fullsized":"2023-11-08T19:25:30.197604+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":33,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.563345+0000","last_change":"2023-11-08T19:24:32.530895+0000","last_active":"2023-11-08T19:25:27.563345+0000","last_peered":"2023-11-08T19:25:27.563345+0000","last_clean":"2023-11-08T19:25:27.563345+0000","last_became_active":"2023-11-08T19:24:31.146715+0000","last_became_peered":"2023-11-08T19:24:31.146715+0000","last_unstale":"2023-11-08T19:25:27.563345+0000","last_undegraded":"2023-11-08T19:25:27.563345+0000","last_fullsized":"2023-11-08T19:25:27.563345+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:39.214888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081671599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.199269+0000","last_change":"2023-11-08T19:25:30.199269+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.199269+0000","last_undegraded":"2023-11-08T19:25:30.199269+0000","last_fullsized":"2023-11-08T19:25:30.199269+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":34,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.562867+0000","last_change":"2023-11-08T19:24:32.333430+0000","last_active":"2023-11-08T19:25:27.562867+0000","last_peered":"2023-11-08T19:25:27.562867+0000","last_clean":"2023-11-08T19:25:27.562867+0000","last_became_active":"2023-11-08T19:24:31.141710+0000","last_became_peered":"2023-11-08T19:24:31.141710+0000","last_unstale":"2023-11-08T19:25:27.562867+0000","last_undegraded":"2023-11-08T19:25:27.562867+0000","last_fullsized":"2023-11-08T19:25:27.562867+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:32:51.214551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000430438,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.243873+0000","last_change":"2023-11-08T19:25:32.241953+0000","last_active":"2023-11-08T19:25:32.243873+0000","last_peered":"2023-11-08T19:25:32.243873+0000","last_clean":"2023-11-08T19:25:32.243873+0000","last_became_active":"2023-11-08T19:25:32.241304+0000","last_became_peered":"2023-11-08T19:25:32.241304+0000","last_unstale":"2023-11-08T19:25:32.243873+0000","last_undegraded":"2023-11-08T19:25:32.243873+0000","last_fullsized":"2023-11-08T19:25:32.243873+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:12:10.425204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.201020+0000","last_change":"2023-11-08T19:25:30.201020+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.201020+0000","last_undegraded":"2023-11-08T19:25:30.201020+0000","last_fullsized":"2023-11-08T19:25:30.201020+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":33,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.562907+0000","last_change":"2023-11-08T19:24:32.530333+0000","last_active":"2023-11-08T19:25:27.562907+0000","last_peered":"2023-11-08T19:25:27.562907+0000","last_clean":"2023-11-08T19:25:27.562907+0000","last_became_active":"2023-11-08T19:24:31.144838+0000","last_became_peered":"2023-11-08T19:24:31.144838+0000","last_unstale":"2023-11-08T19:25:27.562907+0000","last_undegraded":"2023-11-08T19:25:27.562907+0000","last_fullsized":"2023-11-08T19:25:27.562907+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:39:48.473183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081588799999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.242599+0000","last_change":"2023-11-08T19:25:32.240888+0000","last_active":"2023-11-08T19:25:32.242599+0000","last_peered":"2023-11-08T19:25:32.242599+0000","last_clean":"2023-11-08T19:25:32.242599+0000","last_became_active":"2023-11-08T19:25:32.240537+0000","last_became_peered":"2023-11-08T19:25:32.240537+0000","last_unstale":"2023-11-08T19:25:32.242599+0000","last_undegraded":"2023-11-08T19:25:32.242599+0000","last_fullsized":"2023-11-08T19:25:32.242599+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:19:39.469446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.199253+0000","last_change":"2023-11-08T19:25:30.199253+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.199253+0000","last_undegraded":"2023-11-08T19:25:30.199253+0000","last_fullsized":"2023-11-08T19:25:30.199253+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":34,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.563039+0000","last_change":"2023-11-08T19:24:32.333096+0000","last_active":"2023-11-08T19:25:27.563039+0000","last_peered":"2023-11-08T19:25:27.563039+0000","last_clean":"2023-11-08T19:25:27.563039+0000","last_became_active":"2023-11-08T19:24:31.142985+0000","last_became_peered":"2023-11-08T19:24:31.142985+0000","last_unstale":"2023-11-08T19:25:27.563039+0000","last_undegraded":"2023-11-08T19:25:27.563039+0000","last_fullsized":"2023-11-08T19:25:27.563039+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:36:33.274496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000386048,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.203005+0000","last_change":"2023-11-08T19:25:30.203005+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.203005+0000","last_undegraded":"2023-11-08T19:25:30.203005+0000","last_fullsized":"2023-11-08T19:25:30.203005+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":35,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.562843+0000","last_change":"2023-11-08T19:24:32.263810+0000","last_active":"2023-11-08T19:25:27.562843+0000","last_peered":"2023-11-08T19:25:27.562843+0000","last_clean":"2023-11-08T19:25:27.562843+0000","last_became_active":"2023-11-08T19:24:31.138814+0000","last_became_peered":"2023-11-08T19:24:31.138814+0000","last_unstale":"2023-11-08T19:25:27.562843+0000","last_undegraded":"2023-11-08T19:25:27.562843+0000","last_fullsized":"2023-11-08T19:25:27.562843+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:21:55.985548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048136000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.204341+0000","last_change":"2023-11-08T19:25:30.204341+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.204341+0000","last_undegraded":"2023-11-08T19:25:30.204341+0000","last_fullsized":"2023-11-08T19:25:30.204341+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":34,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.562997+0000","last_change":"2023-11-08T19:24:32.544063+0000","last_active":"2023-11-08T19:25:27.562997+0000","last_peered":"2023-11-08T19:25:27.562997+0000","last_clean":"2023-11-08T19:25:27.562997+0000","last_became_active":"2023-11-08T19:24:31.144795+0000","last_became_peered":"2023-11-08T19:24:31.144795+0000","last_unstale":"2023-11-08T19:25:27.562997+0000","last_undegraded":"2023-11-08T19:25:27.562997+0000","last_fullsized":"2023-11-08T19:25:27.562997+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:12:42.248307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01495431,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.200988+0000","last_change":"2023-11-08T19:25:30.200988+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.200988+0000","last_undegraded":"2023-11-08T19:25:30.200988+0000","last_fullsized":"2023-11-08T19:25:30.200988+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":36,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-08T19:25:31.219062+0000","last_change":"2023-11-08T19:24:32.147025+0000","last_active":"2023-11-08T19:25:31.219062+0000","last_peered":"2023-11-08T19:25:31.219062+0000","last_clean":"2023-11-08T19:25:31.219062+0000","last_became_active":"2023-11-08T19:24:31.147082+0000","last_became_peered":"2023-11-08T19:24:31.147082+0000","last_unstale":"2023-11-08T19:25:31.219062+0000","last_undegraded":"2023-11-08T19:25:31.219062+0000","last_fullsized":"2023-11-08T19:25:31.219062+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:02:27.987795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043701599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.203020+0000","last_change":"2023-11-08T19:25:30.203020+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.203020+0000","last_undegraded":"2023-11-08T19:25:30.203020+0000","last_fullsized":"2023-11-08T19:25:30.203020+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":33,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.562971+0000","last_change":"2023-11-08T19:24:32.530620+0000","last_active":"2023-11-08T19:25:27.562971+0000","last_peered":"2023-11-08T19:25:27.562971+0000","last_clean":"2023-11-08T19:25:27.562971+0000","last_became_active":"2023-11-08T19:24:31.144223+0000","last_became_peered":"2023-11-08T19:24:31.144223+0000","last_unstale":"2023-11-08T19:25:27.562971+0000","last_undegraded":"2023-11-08T19:25:27.562971+0000","last_fullsized":"2023-11-08T19:25:27.562971+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:01:25.647952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071879799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.204059+0000","last_change":"2023-11-08T19:25:30.204059+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.204059+0000","last_undegraded":"2023-11-08T19:25:30.204059+0000","last_fullsized":"2023-11-08T19:25:30.204059+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":37,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.179267+0000","last_change":"2023-11-08T19:24:32.140880+0000","last_active":"2023-11-08T19:25:27.179267+0000","last_peered":"2023-11-08T19:25:27.179267+0000","last_clean":"2023-11-08T19:25:27.179267+0000","last_became_active":"2023-11-08T19:24:31.146063+0000","last_became_peered":"2023-11-08T19:24:31.146063+0000","last_unstale":"2023-11-08T19:25:27.179267+0000","last_undegraded":"2023-11-08T19:25:27.179267+0000","last_fullsized":"2023-11-08T19:25:27.179267+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:54:08.985813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089896300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.225054+0000","last_change":"2023-11-08T19:25:31.224949+0000","last_active":"2023-11-08T19:25:32.225054+0000","last_peered":"2023-11-08T19:25:32.225054+0000","last_clean":"2023-11-08T19:25:32.225054+0000","last_became_active":"2023-11-08T19:25:31.224687+0000","last_became_peered":"2023-11-08T19:25:31.224687+0000","last_unstale":"2023-11-08T19:25:32.225054+0000","last_undegraded":"2023-11-08T19:25:32.225054+0000","last_fullsized":"2023-11-08T19:25:32.225054+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:15:07.118614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":38,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.177607+0000","last_change":"2023-11-08T19:24:32.139885+0000","last_active":"2023-11-08T19:25:27.177607+0000","last_peered":"2023-11-08T19:25:27.177607+0000","last_clean":"2023-11-08T19:25:27.177607+0000","last_became_active":"2023-11-08T19:24:31.145329+0000","last_became_peered":"2023-11-08T19:24:31.145329+0000","last_unstale":"2023-11-08T19:25:27.177607+0000","last_undegraded":"2023-11-08T19:25:27.177607+0000","last_fullsized":"2023-11-08T19:25:27.177607+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:25:18.356784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049012999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.204372+0000","last_change":"2023-11-08T19:25:30.204372+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.204372+0000","last_undegraded":"2023-11-08T19:25:30.204372+0000","last_fullsized":"2023-11-08T19:25:30.204372+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":34,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.177264+0000","last_change":"2023-11-08T19:24:32.142836+0000","last_active":"2023-11-08T19:25:27.177264+0000","last_peered":"2023-11-08T19:25:27.177264+0000","last_clean":"2023-11-08T19:25:27.177264+0000","last_became_active":"2023-11-08T19:24:31.141367+0000","last_became_peered":"2023-11-08T19:24:31.141367+0000","last_unstale":"2023-11-08T19:25:27.177264+0000","last_undegraded":"2023-11-08T19:25:27.177264+0000","last_fullsized":"2023-11-08T19:25:27.177264+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:39.214888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001335136,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.244187+0000","last_change":"2023-11-08T19:25:32.243168+0000","last_active":"2023-11-08T19:25:32.244187+0000","last_peered":"2023-11-08T19:25:32.244187+0000","last_clean":"2023-11-08T19:25:32.244187+0000","last_became_active":"2023-11-08T19:25:32.242923+0000","last_became_peered":"2023-11-08T19:25:32.242923+0000","last_unstale":"2023-11-08T19:25:32.244187+0000","last_undegraded":"2023-11-08T19:25:32.244187+0000","last_fullsized":"2023-11-08T19:25:32.244187+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:09:29.604127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.201640+0000","last_change":"2023-11-08T19:25:30.201640+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.201640+0000","last_undegraded":"2023-11-08T19:25:30.201640+0000","last_fullsized":"2023-11-08T19:25:30.201640+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":34,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.563450+0000","last_change":"2023-11-08T19:24:32.544285+0000","last_active":"2023-11-08T19:25:27.563450+0000","last_peered":"2023-11-08T19:25:27.563450+0000","last_clean":"2023-11-08T19:25:27.563450+0000","last_became_active":"2023-11-08T19:24:31.142028+0000","last_became_peered":"2023-11-08T19:24:31.142028+0000","last_unstale":"2023-11-08T19:25:27.563450+0000","last_undegraded":"2023-11-08T19:25:27.563450+0000","last_fullsized":"2023-11-08T19:25:27.563450+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:01:24.198196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067537399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.205611+0000","last_change":"2023-11-08T19:25:30.205611+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.205611+0000","last_undegraded":"2023-11-08T19:25:30.205611+0000","last_fullsized":"2023-11-08T19:25:30.205611+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":34,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.563432+0000","last_change":"2023-11-08T19:24:32.544333+0000","last_active":"2023-11-08T19:25:27.563432+0000","last_peered":"2023-11-08T19:25:27.563432+0000","last_clean":"2023-11-08T19:25:27.563432+0000","last_became_active":"2023-11-08T19:24:31.138598+0000","last_became_peered":"2023-11-08T19:24:31.138598+0000","last_unstale":"2023-11-08T19:25:27.563432+0000","last_undegraded":"2023-11-08T19:25:27.563432+0000","last_fullsized":"2023-11-08T19:25:27.563432+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:11.860580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015114824000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.204838+0000","last_change":"2023-11-08T19:25:30.204838+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.204838+0000","last_undegraded":"2023-11-08T19:25:30.204838+0000","last_fullsized":"2023-11-08T19:25:30.204838+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":33,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.563239+0000","last_change":"2023-11-08T19:24:32.530665+0000","last_active":"2023-11-08T19:25:27.563239+0000","last_peered":"2023-11-08T19:25:27.563239+0000","last_clean":"2023-11-08T19:25:27.563239+0000","last_became_active":"2023-11-08T19:24:31.148363+0000","last_became_peered":"2023-11-08T19:24:31.148363+0000","last_unstale":"2023-11-08T19:25:27.563239+0000","last_undegraded":"2023-11-08T19:25:27.563239+0000","last_fullsized":"2023-11-08T19:25:27.563239+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:02:27.987795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075444200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":204,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-08T19:25:31.215764+0000","last_change":"2023-11-08T19:22:58.054283+0000","last_active":"2023-11-08T19:25:31.215764+0000","last_peered":"2023-11-08T19:25:31.215764+0000","last_clean":"2023-11-08T19:25:31.215764+0000","last_became_active":"2023-11-08T19:22:58.053337+0000","last_became_peered":"2023-11-08T19:22:58.053337+0000","last_unstale":"2023-11-08T19:25:31.215764+0000","last_undegraded":"2023-11-08T19:25:31.215764+0000","last_fullsized":"2023-11-08T19:25:31.215764+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:22:56.479654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:22:56.479654+0000","last_clean_scrub_stamp":"2023-11-08T19:22:56.479654+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:16:05.317001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":22,"acting":22,"num_store_stats":1},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574884,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28392,"kb_used_data":1368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343448,"statfs":{"total":96636764160,"available":96607690752,"internally_reserved":0,"allocated":1400832,"data_stored":959735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.54500000000000004,"15min":0.53500000000000003},"min":{"1min":0.47599999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56499999999999995,"15min":0.56299999999999994},"min":{"1min":0.39100000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.748,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.48799999999999999}]},{"osd":1,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.54400000000000004,"15min":0.54600000000000004},"min":{"1min":0.37,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.70599999999999996,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53100000000000003,"15min":0.52900000000000003},"min":{"1min":0.39200000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.72699999999999998,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.40600000000000003}]},{"osd":2,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.50800000000000001,"15min":0.50600000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.71099999999999997,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.53100000000000003,"15min":0.53300000000000003},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.69299999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.71099999999999997}]},{"osd":3,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.41799999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.65900000000000003,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56000000000000005,"15min":0.55600000000000005},"min":{"1min":0.437,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72199999999999998,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.76100000000000001}]},{"osd":4,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.48499999999999999,"15min":0.48199999999999998},"min":{"1min":0.33400000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.373,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.63300000000000001}]},{"osd":5,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.55100000000000005,"15min":0.54500000000000004},"min":{"1min":0.41199999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.58499999999999996,"15min":0.57899999999999996},"min":{"1min":0.438,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.67400000000000004}]},{"osd":6,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61099999999999999,"15min":0.61199999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.82299999999999995,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56699999999999995,"15min":0.56200000000000006},"min":{"1min":0.43099999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.69199999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":774144,"data_stored":354355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.59699999999999998,"15min":0.60499999999999998},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.78000000000000003,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.58499999999999996,"15min":0.59499999999999997},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.78800000000000003,"5min":1.478,"15min":1.478},"last":0.60699999999999998}]},{"osd":1,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.60499999999999998,"15min":0.60899999999999999},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.80600000000000005,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.621,"5min":0.66300000000000003,"15min":0.67000000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.81699999999999995,"5min":1.649,"15min":1.649},"last":0.72699999999999998}]},{"osd":2,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56000000000000005,"15min":0.55900000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.63,"15min":0.63500000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.75900000000000001,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.626}]},{"osd":3,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.61799999999999999,"15min":0.63400000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77000000000000002,"5min":1.766,"15min":1.766},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.61199999999999999,"15min":0.625},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.877,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":0.64000000000000001}]},{"osd":4,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.53700000000000003,"15min":0.54200000000000004},"min":{"1min":0.36399999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.64500000000000002,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.374},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.57699999999999996,"15min":0.58199999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.55500000000000005}]},{"osd":5,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.56399999999999995,"15min":0.57099999999999995},"min":{"1min":0.42599999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.63300000000000001,"15min":0.63900000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.71499999999999997,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.57499999999999996}]},{"osd":7,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.61199999999999999,"15min":0.61499999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.64400000000000002,"15min":0.64900000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.53200000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574883,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":774144,"data_stored":354355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:24:57 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.36399999999999999,"15min":0.36499999999999999},"min":{"1min":0.255,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.42699999999999999,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.40799999999999997,"15min":0.41899999999999998},"min":{"1min":0.22800000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.5,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":0.22900000000000001}]},{"osd":2,"last update":"Wed Nov 8 19:24:57 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.34499999999999997,"15min":0.34699999999999998},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.43099999999999999,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.37,"5min":0.39400000000000002,"15min":0.39800000000000002},"min":{"1min":0.26200000000000001,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.502,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.27000000000000002}]},{"osd":3,"last update":"Wed Nov 8 19:24:57 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.33500000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.69499999999999995,"5min":1.24,"15min":1.24},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.45800000000000002,"15min":0.46800000000000003},"min":{"1min":0.27600000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.503,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.33800000000000002}]},{"osd":4,"last update":"Wed Nov 8 19:24:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.61299999999999999,"15min":0.61699999999999999},"min":{"1min":0.42299999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.745,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.628},{"interface":"front","average":{"1min":0.625,"5min":0.57299999999999995,"15min":0.56499999999999995},"min":{"1min":0.502,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.56499999999999995}]},{"osd":5,"last update":"Wed Nov 8 19:24:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.56399999999999995,"15min":0.55600000000000005},"min":{"1min":0.42699999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.441,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.72299999999999998,"5min":1.115,"15min":1.115},"last":0.59899999999999998}]},{"osd":6,"last update":"Wed Nov 8 19:24:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.48999999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.84599999999999997,"5min":2.093,"15min":2.093},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.745,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.54600000000000004}]},{"osd":7,"last update":"Wed Nov 8 19:24:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.66700000000000004,"15min":0.67700000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.748,"5min":1.591,"15min":1.591},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.68700000000000006,"15min":0.69899999999999995},"min":{"1min":0.44600000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.77500000000000002,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.52900000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574883,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28360,"kb_used_data":1336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343480,"statfs":{"total":96636764160,"available":96607723520,"internally_reserved":0,"allocated":1368064,"data_stored":944723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":1.0509999999999999,"15min":1.175},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.51900000000000002,"5min":19.295999999999999,"15min":19.295999999999999},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.96999999999999997,"15min":1.0740000000000001},"min":{"1min":0.252,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.502,"5min":17.204000000000001,"15min":17.204000000000001},"last":0.36299999999999999}]},{"osd":2,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.59499999999999997,"15min":0.63500000000000001},"min":{"1min":0.28599999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.46500000000000002,"5min":6.524,"15min":6.524},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.36699999999999999,"5min":1.008,"15min":1.115},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.47799999999999998,"5min":17.175000000000001,"15min":17.175000000000001},"last":0.40899999999999997}]},{"osd":3,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.86399999999999999,"15min":0.94999999999999996},"min":{"1min":0.27600000000000002,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.48899999999999999,"5min":14.324,"15min":14.324},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.40000000000000002,"15min":0.40200000000000002},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.52100000000000002,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.433}]},{"osd":4,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":1.1599999999999999,"15min":1.256},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.76700000000000002,"5min":17.056000000000001,"15min":17.056000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.72899999999999998,"15min":0.753},"min":{"1min":0.441,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.749,"5min":5.0289999999999999,"15min":5.0289999999999999},"last":0.71999999999999997}]},{"osd":5,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.72899999999999998,"15min":0.75600000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.77300000000000002,"5min":5.0590000000000002,"15min":5.0590000000000002},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56699999999999995,"15min":0.56499999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.54500000000000004}]},{"osd":6,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.60399999999999998,"15min":0.60499999999999998},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":1.1990000000000001,"15min":1.304},"min":{"1min":0.35499999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.70099999999999996,"5min":17.111999999999998,"15min":17.111999999999998},"last":0.73399999999999999}]},{"osd":7,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":1.2170000000000001,"15min":1.319},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.77000000000000002,"5min":17.146000000000001,"15min":17.146000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.74099999999999999,"15min":0.76700000000000002},"min":{"1min":0.40899999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.83299999999999996,"5min":4.9829999999999997,"15min":4.9829999999999997},"last":0.751}]}]},{"osd":2,"up_from":13,"seq":55834574883,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":774144,"data_stored":354355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.46200000000000002,"15min":0.48499999999999999},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.48799999999999999,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.37,"5min":0.499,"15min":0.52100000000000002},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.68000000000000005,"5min":3.4369999999999998,"15min":3.4369999999999998},"last":0.379}]},{"osd":1,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.53400000000000003,"15min":0.56399999999999995},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.58299999999999996,"5min":4.0679999999999996,"15min":4.0679999999999996},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.439,"5min":0.58499999999999996,"15min":0.60899999999999999},"min":{"1min":0.29499999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.72099999999999997,"5min":4.3499999999999996,"15min":4.3499999999999996},"last":0.42099999999999999}]},{"osd":3,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.53100000000000003,"15min":0.54900000000000004},"min":{"1min":0.26600000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.75600000000000001,"5min":3.8580000000000001,"15min":3.8580000000000001},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.497,"15min":0.52300000000000002},"min":{"1min":0.27600000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.55400000000000005,"5min":3.476,"15min":3.476},"last":0.39700000000000002}]},{"osd":4,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.71099999999999997,"15min":0.72499999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.3180000000000001,"5min":4.0090000000000003,"15min":4.0090000000000003},"last":0.623},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.72699999999999998,"15min":0.747},"min":{"1min":0.46000000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.92300000000000004,"5min":4.1040000000000001,"15min":4.1040000000000001},"last":0.58199999999999996}]},{"osd":5,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.73199999999999998,"15min":0.75600000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.85399999999999998,"5min":4.0869999999999997,"15min":4.0869999999999997},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.73399999999999999,"15min":0.75800000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.73999999999999999,"5min":3.843,"15min":3.843},"last":0.56299999999999994}]},{"osd":6,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.748,"15min":0.77200000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0720000000000001,"5min":4.1399999999999997,"15min":4.1399999999999997},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.72099999999999997,"15min":0.745},"min":{"1min":0.42899999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.81100000000000005,"5min":4.0499999999999998,"15min":4.0499999999999998},"last":0.67800000000000005}]},{"osd":7,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.76600000000000001,"15min":0.78100000000000003},"min":{"1min":0.51000000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.181,"5min":4.157,"15min":4.157},"last":0.754},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.79100000000000004,"15min":0.81200000000000006},"min":{"1min":0.48099999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.222,"5min":4.1710000000000003,"15min":4.1710000000000003},"last":0.50600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574883,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":774144,"data_stored":354355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.38300000000000001,"15min":0.38600000000000001},"min":{"1min":0.24199999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.63300000000000001,"5min":1.458,"15min":1.458},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.39500000000000002,"15min":0.40000000000000002},"min":{"1min":0.29199999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.53800000000000003,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.503}]},{"osd":1,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.40799999999999997,"15min":0.41199999999999998},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.747,"5min":1.512,"15min":1.512},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.442,"15min":0.44900000000000001},"min":{"1min":0.311,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.59499999999999997,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.57099999999999995}]},{"osd":2,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.376,"15min":0.378},"min":{"1min":0.28100000000000003,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.55600000000000005,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.42799999999999999,"15min":0.42999999999999999},"min":{"1min":0.315,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.70399999999999996,"5min":1.536,"15min":1.536},"last":0.60899999999999999}]},{"osd":4,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.61299999999999999,"15min":0.621},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.72199999999999998,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.752,"5min":1.153,"15min":1.153},"last":0.65100000000000002}]},{"osd":5,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.59299999999999997,"15min":0.59199999999999997},"min":{"1min":0.42299999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.86499999999999999,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.59799999999999998,"15min":0.60599999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.77100000000000002,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.73699999999999999}]},{"osd":6,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.57799999999999996,"15min":0.58099999999999996},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.78300000000000003,"5min":1.113,"15min":1.113},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.61199999999999999,"15min":0.61399999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.82399999999999995,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.71799999999999997}]},{"osd":7,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.64400000000000002,"15min":0.65000000000000002},"min":{"1min":0.44700000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.72099999999999997,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.626,"5min":0.61799999999999999,"15min":0.61699999999999999},"min":{"1min":0.48199999999999998,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.83799999999999997,"5min":1.179,"15min":1.179},"last":0.627}]}]},{"osd":4,"up_from":13,"seq":55834574883,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":774144,"data_stored":354355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53800000000000003,"15min":0.53600000000000003},"min":{"1min":0.35699999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.68600000000000005,"5min":1.399,"15min":1.399},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.59099999999999997,"15min":0.59699999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.75700000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.68300000000000005}]},{"osd":1,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.36599999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.499,"15min":0.496},"min":{"1min":0.39700000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.505}]},{"osd":2,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.627,"15min":0.63800000000000001},"min":{"1min":0.377,"5min":0.373,"15min":0.373},"max":{"1min":0.77300000000000002,"5min":2.8490000000000002,"15min":2.8490000000000002},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.52500000000000002,"15min":0.52000000000000002},"min":{"1min":0.434,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.40799999999999997}]},{"osd":3,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.56999999999999995,"15min":0.56399999999999995},"min":{"1min":0.41199999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.71899999999999997,"15min":0.72999999999999998},"min":{"1min":0.53200000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.78500000000000003,"5min":3.4849999999999999,"15min":3.4849999999999999},"last":0.76000000000000001}]},{"osd":5,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52000000000000002,"15min":0.52100000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.68100000000000005,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56100000000000005,"15min":0.55800000000000005},"min":{"1min":0.36299999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.79100000000000004}]},{"osd":6,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.70199999999999996,"15min":0.72399999999999998},"min":{"1min":0.38,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.83199999999999996,"5min":4.1529999999999996,"15min":4.1529999999999996},"last":0.623},{"interface":"front","average":{"1min":0.621,"5min":0.61399999999999999,"15min":0.61299999999999999},"min":{"1min":0.42699999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.73999999999999999}]},{"osd":7,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57199999999999995,"15min":0.57099999999999995},"min":{"1min":0.41699999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.80500000000000005,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.83999999999999997,"15min":0.86399999999999999},"min":{"1min":0.55900000000000005,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.87,"5min":5.5359999999999996,"15min":5.5359999999999996},"last":0.83899999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574883,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":774144,"data_stored":354355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.54400000000000004,"15min":0.54900000000000004},"min":{"1min":0.32300000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.78100000000000003,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":0.432},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.52500000000000002,"15min":0.51900000000000002},"min":{"1min":0.38700000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.745,"5min":0.878,"15min":0.878},"last":0.47199999999999998}]},{"osd":1,"last update":"Wed Nov 8 19:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.54700000000000004,"15min":0.54500000000000004},"min":{"1min":0.32400000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.76300000000000001,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.60399999999999998,"15min":0.60999999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.66300000000000003,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":0.52700000000000002}]},{"osd":2,"last update":"Wed Nov 8 19:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.56000000000000005,"15min":0.55800000000000005},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.68999999999999995,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52800000000000002,"15min":0.52700000000000002},"min":{"1min":0.39400000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.66700000000000004,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.38200000000000001}]},{"osd":3,"last update":"Wed Nov 8 19:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.55700000000000005,"15min":0.55600000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71899999999999997,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57499999999999996,"15min":0.57299999999999995},"min":{"1min":0.46999999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.83699999999999997,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.45100000000000001}]},{"osd":4,"last update":"Wed Nov 8 19:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.59299999999999997,"15min":0.60499999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.80600000000000005,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.63500000000000001,"15min":0.63400000000000001},"min":{"1min":0.49299999999999999,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.81999999999999995,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.53900000000000003}]},{"osd":6,"last update":"Wed Nov 8 19:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.58599999999999997,"15min":0.57999999999999996},"min":{"1min":0.437,"5min":0.37,"15min":0.37},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.65900000000000003,"15min":0.67300000000000004},"min":{"1min":0.38400000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.754,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":0.495}]},{"osd":7,"last update":"Wed Nov 8 19:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.627,"15min":0.63},"min":{"1min":0.42399999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.77600000000000002,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.625,"5min":0.64500000000000002,"15min":0.64900000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.871,"5min":0.873,"15min":0.873},"last":0.59399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:25:37.089 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3e is not active+clean 2023-11-08T19:25:37.090 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:25:31.194359+0000', 'last_change': '2023-11-08T19:25:31.194359+0000', 'last_active': '2023-11-08T19:25:31.194359+0000', 'last_peered': '2023-11-08T19:25:31.194359+0000', 'last_clean': '2023-11-08T19:25:31.194359+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:31.194359+0000', 'last_undegraded': '2023-11-08T19:25:31.194359+0000', 'last_fullsized': '2023-11-08T19:25:31.194359+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:25:37.090 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3d is not active+clean 2023-11-08T19:25:37.090 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:25:31.194359+0000', 'last_change': '2023-11-08T19:25:31.194359+0000', 'last_active': '2023-11-08T19:25:31.194359+0000', 'last_peered': '2023-11-08T19:25:31.194359+0000', 'last_clean': '2023-11-08T19:25:31.194359+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:31.194359+0000', 'last_undegraded': '2023-11-08T19:25:31.194359+0000', 'last_fullsized': '2023-11-08T19:25:31.194359+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:25:37.091 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3c is not active+clean 2023-11-08T19:25:37.091 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:25:31.194359+0000', 'last_change': '2023-11-08T19:25:31.194359+0000', 'last_active': '2023-11-08T19:25:31.194359+0000', 'last_peered': '2023-11-08T19:25:31.194359+0000', 'last_clean': '2023-11-08T19:25:31.194359+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:31.194359+0000', 'last_undegraded': '2023-11-08T19:25:31.194359+0000', 'last_fullsized': '2023-11-08T19:25:31.194359+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:25:37.092 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3b is not active+clean 2023-11-08T19:25:37.092 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:25:31.194359+0000', 'last_change': '2023-11-08T19:25:31.194359+0000', 'last_active': '2023-11-08T19:25:31.194359+0000', 'last_peered': '2023-11-08T19:25:31.194359+0000', 'last_clean': '2023-11-08T19:25:31.194359+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:31.194359+0000', 'last_undegraded': '2023-11-08T19:25:31.194359+0000', 'last_fullsized': '2023-11-08T19:25:31.194359+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:25:37.092 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3a is not active+clean 2023-11-08T19:25:37.093 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:25:31.194359+0000', 'last_change': '2023-11-08T19:25:31.194359+0000', 'last_active': '2023-11-08T19:25:31.194359+0000', 'last_peered': '2023-11-08T19:25:31.194359+0000', 'last_clean': '2023-11-08T19:25:31.194359+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:31.194359+0000', 'last_undegraded': '2023-11-08T19:25:31.194359+0000', 'last_fullsized': '2023-11-08T19:25:31.194359+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:25:37.093 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.39 is not active+clean 2023-11-08T19:25:37.093 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:25:31.194359+0000', 'last_change': '2023-11-08T19:25:31.194359+0000', 'last_active': '2023-11-08T19:25:31.194359+0000', 'last_peered': '2023-11-08T19:25:31.194359+0000', 'last_clean': '2023-11-08T19:25:31.194359+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:31.194359+0000', 'last_undegraded': '2023-11-08T19:25:31.194359+0000', 'last_fullsized': '2023-11-08T19:25:31.194359+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:25:37.094 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.38 is not active+clean 2023-11-08T19:25:37.094 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:25:31.194359+0000', 'last_change': '2023-11-08T19:25:31.194359+0000', 'last_active': '2023-11-08T19:25:31.194359+0000', 'last_peered': '2023-11-08T19:25:31.194359+0000', 'last_clean': '2023-11-08T19:25:31.194359+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:31.194359+0000', 'last_undegraded': '2023-11-08T19:25:31.194359+0000', 'last_fullsized': '2023-11-08T19:25:31.194359+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:25:37.095 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.37 is not active+clean 2023-11-08T19:25:37.095 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:25:31.194359+0000', 'last_change': '2023-11-08T19:25:31.194359+0000', 'last_active': '2023-11-08T19:25:31.194359+0000', 'last_peered': '2023-11-08T19:25:31.194359+0000', 'last_clean': '2023-11-08T19:25:31.194359+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:31.194359+0000', 'last_undegraded': '2023-11-08T19:25:31.194359+0000', 'last_fullsized': '2023-11-08T19:25:31.194359+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:25:37.095 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.36 is not active+clean 2023-11-08T19:25:37.096 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:25:31.194359+0000', 'last_change': '2023-11-08T19:25:31.194359+0000', 'last_active': '2023-11-08T19:25:31.194359+0000', 'last_peered': '2023-11-08T19:25:31.194359+0000', 'last_clean': '2023-11-08T19:25:31.194359+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:31.194359+0000', 'last_undegraded': '2023-11-08T19:25:31.194359+0000', 'last_fullsized': '2023-11-08T19:25:31.194359+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:25:37.096 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.34 is not active+clean 2023-11-08T19:25:37.097 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:25:31.194359+0000', 'last_change': '2023-11-08T19:25:31.194359+0000', 'last_active': '2023-11-08T19:25:31.194359+0000', 'last_peered': '2023-11-08T19:25:31.194359+0000', 'last_clean': '2023-11-08T19:25:31.194359+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:31.194359+0000', 'last_undegraded': '2023-11-08T19:25:31.194359+0000', 'last_fullsized': '2023-11-08T19:25:31.194359+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:25:37.097 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.33 is not active+clean 2023-11-08T19:25:37.097 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:25:31.194359+0000', 'last_change': '2023-11-08T19:25:31.194359+0000', 'last_active': '2023-11-08T19:25:31.194359+0000', 'last_peered': '2023-11-08T19:25:31.194359+0000', 'last_clean': '2023-11-08T19:25:31.194359+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:31.194359+0000', 'last_undegraded': '2023-11-08T19:25:31.194359+0000', 'last_fullsized': '2023-11-08T19:25:31.194359+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:25:37.098 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.32 is not active+clean 2023-11-08T19:25:37.098 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:25:31.194359+0000', 'last_change': '2023-11-08T19:25:31.194359+0000', 'last_active': '2023-11-08T19:25:31.194359+0000', 'last_peered': '2023-11-08T19:25:31.194359+0000', 'last_clean': '2023-11-08T19:25:31.194359+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:31.194359+0000', 'last_undegraded': '2023-11-08T19:25:31.194359+0000', 'last_fullsized': '2023-11-08T19:25:31.194359+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:25:37.099 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.31 is not active+clean 2023-11-08T19:25:37.099 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:25:31.194359+0000', 'last_change': '2023-11-08T19:25:31.194359+0000', 'last_active': '2023-11-08T19:25:31.194359+0000', 'last_peered': '2023-11-08T19:25:31.194359+0000', 'last_clean': '2023-11-08T19:25:31.194359+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:31.194359+0000', 'last_undegraded': '2023-11-08T19:25:31.194359+0000', 'last_fullsized': '2023-11-08T19:25:31.194359+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:25:37.099 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.30 is not active+clean 2023-11-08T19:25:37.100 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:25:31.194359+0000', 'last_change': '2023-11-08T19:25:31.194359+0000', 'last_active': '2023-11-08T19:25:31.194359+0000', 'last_peered': '2023-11-08T19:25:31.194359+0000', 'last_clean': '2023-11-08T19:25:31.194359+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:31.194359+0000', 'last_undegraded': '2023-11-08T19:25:31.194359+0000', 'last_fullsized': '2023-11-08T19:25:31.194359+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:25:37.100 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2f is not active+clean 2023-11-08T19:25:37.100 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:25:31.194359+0000', 'last_change': '2023-11-08T19:25:31.194359+0000', 'last_active': '2023-11-08T19:25:31.194359+0000', 'last_peered': '2023-11-08T19:25:31.194359+0000', 'last_clean': '2023-11-08T19:25:31.194359+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:31.194359+0000', 'last_undegraded': '2023-11-08T19:25:31.194359+0000', 'last_fullsized': '2023-11-08T19:25:31.194359+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:25:37.101 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2e is not active+clean 2023-11-08T19:25:37.101 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:25:31.194359+0000', 'last_change': '2023-11-08T19:25:31.194359+0000', 'last_active': '2023-11-08T19:25:31.194359+0000', 'last_peered': '2023-11-08T19:25:31.194359+0000', 'last_clean': '2023-11-08T19:25:31.194359+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:31.194359+0000', 'last_undegraded': '2023-11-08T19:25:31.194359+0000', 'last_fullsized': '2023-11-08T19:25:31.194359+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:25:37.102 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2d is not active+clean 2023-11-08T19:25:37.102 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:25:31.194359+0000', 'last_change': '2023-11-08T19:25:31.194359+0000', 'last_active': '2023-11-08T19:25:31.194359+0000', 'last_peered': '2023-11-08T19:25:31.194359+0000', 'last_clean': '2023-11-08T19:25:31.194359+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:31.194359+0000', 'last_undegraded': '2023-11-08T19:25:31.194359+0000', 'last_fullsized': '2023-11-08T19:25:31.194359+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:25:37.102 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2c is not active+clean 2023-11-08T19:25:37.103 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:25:31.194359+0000', 'last_change': '2023-11-08T19:25:31.194359+0000', 'last_active': '2023-11-08T19:25:31.194359+0000', 'last_peered': '2023-11-08T19:25:31.194359+0000', 'last_clean': '2023-11-08T19:25:31.194359+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:31.194359+0000', 'last_undegraded': '2023-11-08T19:25:31.194359+0000', 'last_fullsized': '2023-11-08T19:25:31.194359+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:25:37.103 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2b is not active+clean 2023-11-08T19:25:37.104 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:25:31.194359+0000', 'last_change': '2023-11-08T19:25:31.194359+0000', 'last_active': '2023-11-08T19:25:31.194359+0000', 'last_peered': '2023-11-08T19:25:31.194359+0000', 'last_clean': '2023-11-08T19:25:31.194359+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:31.194359+0000', 'last_undegraded': '2023-11-08T19:25:31.194359+0000', 'last_fullsized': '2023-11-08T19:25:31.194359+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:25:37.104 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2a is not active+clean 2023-11-08T19:25:37.104 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:25:31.194359+0000', 'last_change': '2023-11-08T19:25:31.194359+0000', 'last_active': '2023-11-08T19:25:31.194359+0000', 'last_peered': '2023-11-08T19:25:31.194359+0000', 'last_clean': '2023-11-08T19:25:31.194359+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:31.194359+0000', 'last_undegraded': '2023-11-08T19:25:31.194359+0000', 'last_fullsized': '2023-11-08T19:25:31.194359+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:25:37.105 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.27 is not active+clean 2023-11-08T19:25:37.105 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:25:31.194359+0000', 'last_change': '2023-11-08T19:25:31.194359+0000', 'last_active': '2023-11-08T19:25:31.194359+0000', 'last_peered': '2023-11-08T19:25:31.194359+0000', 'last_clean': '2023-11-08T19:25:31.194359+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:31.194359+0000', 'last_undegraded': '2023-11-08T19:25:31.194359+0000', 'last_fullsized': '2023-11-08T19:25:31.194359+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:25:37.106 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.26 is not active+clean 2023-11-08T19:25:37.106 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:25:31.194359+0000', 'last_change': '2023-11-08T19:25:31.194359+0000', 'last_active': '2023-11-08T19:25:31.194359+0000', 'last_peered': '2023-11-08T19:25:31.194359+0000', 'last_clean': '2023-11-08T19:25:31.194359+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:31.194359+0000', 'last_undegraded': '2023-11-08T19:25:31.194359+0000', 'last_fullsized': '2023-11-08T19:25:31.194359+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:25:37.106 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.25 is not active+clean 2023-11-08T19:25:37.107 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:25:31.194359+0000', 'last_change': '2023-11-08T19:25:31.194359+0000', 'last_active': '2023-11-08T19:25:31.194359+0000', 'last_peered': '2023-11-08T19:25:31.194359+0000', 'last_clean': '2023-11-08T19:25:31.194359+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:31.194359+0000', 'last_undegraded': '2023-11-08T19:25:31.194359+0000', 'last_fullsized': '2023-11-08T19:25:31.194359+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:25:37.107 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.24 is not active+clean 2023-11-08T19:25:37.107 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:25:31.194359+0000', 'last_change': '2023-11-08T19:25:31.194359+0000', 'last_active': '2023-11-08T19:25:31.194359+0000', 'last_peered': '2023-11-08T19:25:31.194359+0000', 'last_clean': '2023-11-08T19:25:31.194359+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:31.194359+0000', 'last_undegraded': '2023-11-08T19:25:31.194359+0000', 'last_fullsized': '2023-11-08T19:25:31.194359+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:25:37.108 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.23 is not active+clean 2023-11-08T19:25:37.108 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:25:31.194359+0000', 'last_change': '2023-11-08T19:25:31.194359+0000', 'last_active': '2023-11-08T19:25:31.194359+0000', 'last_peered': '2023-11-08T19:25:31.194359+0000', 'last_clean': '2023-11-08T19:25:31.194359+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:31.194359+0000', 'last_undegraded': '2023-11-08T19:25:31.194359+0000', 'last_fullsized': '2023-11-08T19:25:31.194359+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:25:37.109 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.22 is not active+clean 2023-11-08T19:25:37.109 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:25:31.194359+0000', 'last_change': '2023-11-08T19:25:31.194359+0000', 'last_active': '2023-11-08T19:25:31.194359+0000', 'last_peered': '2023-11-08T19:25:31.194359+0000', 'last_clean': '2023-11-08T19:25:31.194359+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:31.194359+0000', 'last_undegraded': '2023-11-08T19:25:31.194359+0000', 'last_fullsized': '2023-11-08T19:25:31.194359+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:25:37.109 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.21 is not active+clean 2023-11-08T19:25:37.110 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:25:31.194359+0000', 'last_change': '2023-11-08T19:25:31.194359+0000', 'last_active': '2023-11-08T19:25:31.194359+0000', 'last_peered': '2023-11-08T19:25:31.194359+0000', 'last_clean': '2023-11-08T19:25:31.194359+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:31.194359+0000', 'last_undegraded': '2023-11-08T19:25:31.194359+0000', 'last_fullsized': '2023-11-08T19:25:31.194359+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:25:37.110 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.20 is not active+clean 2023-11-08T19:25:37.111 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:25:31.194359+0000', 'last_change': '2023-11-08T19:25:31.194359+0000', 'last_active': '2023-11-08T19:25:31.194359+0000', 'last_peered': '2023-11-08T19:25:31.194359+0000', 'last_clean': '2023-11-08T19:25:31.194359+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:31.194359+0000', 'last_undegraded': '2023-11-08T19:25:31.194359+0000', 'last_fullsized': '2023-11-08T19:25:31.194359+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:25:37.111 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.11 is not active+clean 2023-11-08T19:25:37.111 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:25:31.194359+0000', 'last_change': '2023-11-08T19:25:31.194359+0000', 'last_active': '2023-11-08T19:25:31.194359+0000', 'last_peered': '2023-11-08T19:25:31.194359+0000', 'last_clean': '2023-11-08T19:25:31.194359+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:31.194359+0000', 'last_undegraded': '2023-11-08T19:25:31.194359+0000', 'last_fullsized': '2023-11-08T19:25:31.194359+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:25:37.112 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.10 is not active+clean 2023-11-08T19:25:37.112 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:25:30.202073+0000', 'last_change': '2023-11-08T19:25:30.202073+0000', 'last_active': '2023-11-08T19:25:30.188791+0000', 'last_peered': '2023-11-08T19:25:30.188791+0000', 'last_clean': '2023-11-08T19:25:30.188791+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:30.202073+0000', 'last_undegraded': '2023-11-08T19:25:30.202073+0000', 'last_fullsized': '2023-11-08T19:25:30.202073+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-08T19:25:37.113 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.10 is not active+clean 2023-11-08T19:25:37.113 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:25:31.194359+0000', 'last_change': '2023-11-08T19:25:31.194359+0000', 'last_active': '2023-11-08T19:25:31.194359+0000', 'last_peered': '2023-11-08T19:25:31.194359+0000', 'last_clean': '2023-11-08T19:25:31.194359+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:31.194359+0000', 'last_undegraded': '2023-11-08T19:25:31.194359+0000', 'last_fullsized': '2023-11-08T19:25:31.194359+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:25:37.113 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.11 is not active+clean 2023-11-08T19:25:37.114 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:25:30.203556+0000', 'last_change': '2023-11-08T19:25:30.203556+0000', 'last_active': '2023-11-08T19:25:30.188791+0000', 'last_peered': '2023-11-08T19:25:30.188791+0000', 'last_clean': '2023-11-08T19:25:30.188791+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:30.203556+0000', 'last_undegraded': '2023-11-08T19:25:30.203556+0000', 'last_fullsized': '2023-11-08T19:25:30.203556+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-08T19:25:37.114 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.13 is not active+clean 2023-11-08T19:25:37.114 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:25:31.194359+0000', 'last_change': '2023-11-08T19:25:31.194359+0000', 'last_active': '2023-11-08T19:25:31.194359+0000', 'last_peered': '2023-11-08T19:25:31.194359+0000', 'last_clean': '2023-11-08T19:25:31.194359+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:31.194359+0000', 'last_undegraded': '2023-11-08T19:25:31.194359+0000', 'last_fullsized': '2023-11-08T19:25:31.194359+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:25:37.115 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.12 is not active+clean 2023-11-08T19:25:37.115 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:25:30.204924+0000', 'last_change': '2023-11-08T19:25:30.204924+0000', 'last_active': '2023-11-08T19:25:30.188791+0000', 'last_peered': '2023-11-08T19:25:30.188791+0000', 'last_clean': '2023-11-08T19:25:30.188791+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:30.204924+0000', 'last_undegraded': '2023-11-08T19:25:30.204924+0000', 'last_fullsized': '2023-11-08T19:25:30.204924+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-08T19:25:37.116 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.13 is not active+clean 2023-11-08T19:25:37.116 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:25:30.197733+0000', 'last_change': '2023-11-08T19:25:30.197733+0000', 'last_active': '2023-11-08T19:25:30.188791+0000', 'last_peered': '2023-11-08T19:25:30.188791+0000', 'last_clean': '2023-11-08T19:25:30.188791+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:30.197733+0000', 'last_undegraded': '2023-11-08T19:25:30.197733+0000', 'last_fullsized': '2023-11-08T19:25:30.197733+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-08T19:25:37.116 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.15 is not active+clean 2023-11-08T19:25:37.117 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:25:31.194359+0000', 'last_change': '2023-11-08T19:25:31.194359+0000', 'last_active': '2023-11-08T19:25:31.194359+0000', 'last_peered': '2023-11-08T19:25:31.194359+0000', 'last_clean': '2023-11-08T19:25:31.194359+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:31.194359+0000', 'last_undegraded': '2023-11-08T19:25:31.194359+0000', 'last_fullsized': '2023-11-08T19:25:31.194359+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:25:37.117 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.14 is not active+clean 2023-11-08T19:25:37.117 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:25:30.197639+0000', 'last_change': '2023-11-08T19:25:30.197639+0000', 'last_active': '2023-11-08T19:25:30.188791+0000', 'last_peered': '2023-11-08T19:25:30.188791+0000', 'last_clean': '2023-11-08T19:25:30.188791+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:30.197639+0000', 'last_undegraded': '2023-11-08T19:25:30.197639+0000', 'last_fullsized': '2023-11-08T19:25:30.197639+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-08T19:25:37.118 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.14 is not active+clean 2023-11-08T19:25:37.118 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:25:31.194359+0000', 'last_change': '2023-11-08T19:25:31.194359+0000', 'last_active': '2023-11-08T19:25:31.194359+0000', 'last_peered': '2023-11-08T19:25:31.194359+0000', 'last_clean': '2023-11-08T19:25:31.194359+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:31.194359+0000', 'last_undegraded': '2023-11-08T19:25:31.194359+0000', 'last_fullsized': '2023-11-08T19:25:31.194359+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:25:37.119 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.15 is not active+clean 2023-11-08T19:25:37.119 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:25:30.205515+0000', 'last_change': '2023-11-08T19:25:30.205515+0000', 'last_active': '2023-11-08T19:25:30.188791+0000', 'last_peered': '2023-11-08T19:25:30.188791+0000', 'last_clean': '2023-11-08T19:25:30.188791+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:30.205515+0000', 'last_undegraded': '2023-11-08T19:25:30.205515+0000', 'last_fullsized': '2023-11-08T19:25:30.205515+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-08T19:25:37.120 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.16 is not active+clean 2023-11-08T19:25:37.120 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:25:30.204873+0000', 'last_change': '2023-11-08T19:25:30.204873+0000', 'last_active': '2023-11-08T19:25:30.188791+0000', 'last_peered': '2023-11-08T19:25:30.188791+0000', 'last_clean': '2023-11-08T19:25:30.188791+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:30.204873+0000', 'last_undegraded': '2023-11-08T19:25:30.204873+0000', 'last_fullsized': '2023-11-08T19:25:30.204873+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-08T19:25:37.120 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.16 is not active+clean 2023-11-08T19:25:37.121 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:25:31.194359+0000', 'last_change': '2023-11-08T19:25:31.194359+0000', 'last_active': '2023-11-08T19:25:31.194359+0000', 'last_peered': '2023-11-08T19:25:31.194359+0000', 'last_clean': '2023-11-08T19:25:31.194359+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:31.194359+0000', 'last_undegraded': '2023-11-08T19:25:31.194359+0000', 'last_fullsized': '2023-11-08T19:25:31.194359+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:25:37.121 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.17 is not active+clean 2023-11-08T19:25:37.121 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:25:30.202320+0000', 'last_change': '2023-11-08T19:25:30.202320+0000', 'last_active': '2023-11-08T19:25:30.188791+0000', 'last_peered': '2023-11-08T19:25:30.188791+0000', 'last_clean': '2023-11-08T19:25:30.188791+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:30.202320+0000', 'last_undegraded': '2023-11-08T19:25:30.202320+0000', 'last_fullsized': '2023-11-08T19:25:30.202320+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-08T19:25:37.122 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.19 is not active+clean 2023-11-08T19:25:37.122 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:25:31.194359+0000', 'last_change': '2023-11-08T19:25:31.194359+0000', 'last_active': '2023-11-08T19:25:31.194359+0000', 'last_peered': '2023-11-08T19:25:31.194359+0000', 'last_clean': '2023-11-08T19:25:31.194359+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:31.194359+0000', 'last_undegraded': '2023-11-08T19:25:31.194359+0000', 'last_fullsized': '2023-11-08T19:25:31.194359+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:25:37.123 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.18 is not active+clean 2023-11-08T19:25:37.123 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:25:30.199231+0000', 'last_change': '2023-11-08T19:25:30.199231+0000', 'last_active': '2023-11-08T19:25:30.188791+0000', 'last_peered': '2023-11-08T19:25:30.188791+0000', 'last_clean': '2023-11-08T19:25:30.188791+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:30.199231+0000', 'last_undegraded': '2023-11-08T19:25:30.199231+0000', 'last_fullsized': '2023-11-08T19:25:30.199231+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-08T19:25:37.123 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.18 is not active+clean 2023-11-08T19:25:37.124 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:25:31.194359+0000', 'last_change': '2023-11-08T19:25:31.194359+0000', 'last_active': '2023-11-08T19:25:31.194359+0000', 'last_peered': '2023-11-08T19:25:31.194359+0000', 'last_clean': '2023-11-08T19:25:31.194359+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:31.194359+0000', 'last_undegraded': '2023-11-08T19:25:31.194359+0000', 'last_fullsized': '2023-11-08T19:25:31.194359+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:25:37.124 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.19 is not active+clean 2023-11-08T19:25:37.124 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:25:30.197833+0000', 'last_change': '2023-11-08T19:25:30.197833+0000', 'last_active': '2023-11-08T19:25:30.188791+0000', 'last_peered': '2023-11-08T19:25:30.188791+0000', 'last_clean': '2023-11-08T19:25:30.188791+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:30.197833+0000', 'last_undegraded': '2023-11-08T19:25:30.197833+0000', 'last_fullsized': '2023-11-08T19:25:30.197833+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-08T19:25:37.125 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1b is not active+clean 2023-11-08T19:25:37.125 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:25:31.194359+0000', 'last_change': '2023-11-08T19:25:31.194359+0000', 'last_active': '2023-11-08T19:25:31.194359+0000', 'last_peered': '2023-11-08T19:25:31.194359+0000', 'last_clean': '2023-11-08T19:25:31.194359+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:31.194359+0000', 'last_undegraded': '2023-11-08T19:25:31.194359+0000', 'last_fullsized': '2023-11-08T19:25:31.194359+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:25:37.126 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1a is not active+clean 2023-11-08T19:25:37.126 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:25:30.205764+0000', 'last_change': '2023-11-08T19:25:30.205764+0000', 'last_active': '2023-11-08T19:25:30.188791+0000', 'last_peered': '2023-11-08T19:25:30.188791+0000', 'last_clean': '2023-11-08T19:25:30.188791+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:30.205764+0000', 'last_undegraded': '2023-11-08T19:25:30.205764+0000', 'last_fullsized': '2023-11-08T19:25:30.205764+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-08T19:25:37.126 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1a is not active+clean 2023-11-08T19:25:37.127 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:25:31.194359+0000', 'last_change': '2023-11-08T19:25:31.194359+0000', 'last_active': '2023-11-08T19:25:31.194359+0000', 'last_peered': '2023-11-08T19:25:31.194359+0000', 'last_clean': '2023-11-08T19:25:31.194359+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:31.194359+0000', 'last_undegraded': '2023-11-08T19:25:31.194359+0000', 'last_fullsized': '2023-11-08T19:25:31.194359+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:25:37.127 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1b is not active+clean 2023-11-08T19:25:37.128 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:25:30.205527+0000', 'last_change': '2023-11-08T19:25:30.205527+0000', 'last_active': '2023-11-08T19:25:30.188791+0000', 'last_peered': '2023-11-08T19:25:30.188791+0000', 'last_clean': '2023-11-08T19:25:30.188791+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:30.205527+0000', 'last_undegraded': '2023-11-08T19:25:30.205527+0000', 'last_fullsized': '2023-11-08T19:25:30.205527+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-08T19:25:37.128 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1c is not active+clean 2023-11-08T19:25:37.128 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:25:30.204319+0000', 'last_change': '2023-11-08T19:25:30.204319+0000', 'last_active': '2023-11-08T19:25:30.188791+0000', 'last_peered': '2023-11-08T19:25:30.188791+0000', 'last_clean': '2023-11-08T19:25:30.188791+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:30.204319+0000', 'last_undegraded': '2023-11-08T19:25:30.204319+0000', 'last_fullsized': '2023-11-08T19:25:30.204319+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-08T19:25:37.129 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1c is not active+clean 2023-11-08T19:25:37.129 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:25:31.194359+0000', 'last_change': '2023-11-08T19:25:31.194359+0000', 'last_active': '2023-11-08T19:25:31.194359+0000', 'last_peered': '2023-11-08T19:25:31.194359+0000', 'last_clean': '2023-11-08T19:25:31.194359+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:31.194359+0000', 'last_undegraded': '2023-11-08T19:25:31.194359+0000', 'last_fullsized': '2023-11-08T19:25:31.194359+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:25:37.129 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1d is not active+clean 2023-11-08T19:25:37.130 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:25:30.201615+0000', 'last_change': '2023-11-08T19:25:30.201615+0000', 'last_active': '2023-11-08T19:25:30.188791+0000', 'last_peered': '2023-11-08T19:25:30.188791+0000', 'last_clean': '2023-11-08T19:25:30.188791+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:30.201615+0000', 'last_undegraded': '2023-11-08T19:25:30.201615+0000', 'last_fullsized': '2023-11-08T19:25:30.201615+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-08T19:25:37.130 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1f is not active+clean 2023-11-08T19:25:37.131 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:25:31.194359+0000', 'last_change': '2023-11-08T19:25:31.194359+0000', 'last_active': '2023-11-08T19:25:31.194359+0000', 'last_peered': '2023-11-08T19:25:31.194359+0000', 'last_clean': '2023-11-08T19:25:31.194359+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:31.194359+0000', 'last_undegraded': '2023-11-08T19:25:31.194359+0000', 'last_fullsized': '2023-11-08T19:25:31.194359+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:25:37.131 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1e is not active+clean 2023-11-08T19:25:37.132 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:25:30.201034+0000', 'last_change': '2023-11-08T19:25:30.201034+0000', 'last_active': '2023-11-08T19:25:30.188791+0000', 'last_peered': '2023-11-08T19:25:30.188791+0000', 'last_clean': '2023-11-08T19:25:30.188791+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:30.201034+0000', 'last_undegraded': '2023-11-08T19:25:30.201034+0000', 'last_fullsized': '2023-11-08T19:25:30.201034+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-08T19:25:37.133 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1 is not active+clean 2023-11-08T19:25:37.133 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:25:31.194359+0000', 'last_change': '2023-11-08T19:25:31.194359+0000', 'last_active': '2023-11-08T19:25:31.194359+0000', 'last_peered': '2023-11-08T19:25:31.194359+0000', 'last_clean': '2023-11-08T19:25:31.194359+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:31.194359+0000', 'last_undegraded': '2023-11-08T19:25:31.194359+0000', 'last_fullsized': '2023-11-08T19:25:31.194359+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:25:37.133 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.0 is not active+clean 2023-11-08T19:25:37.134 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:25:30.204036+0000', 'last_change': '2023-11-08T19:25:30.204036+0000', 'last_active': '2023-11-08T19:25:30.188791+0000', 'last_peered': '2023-11-08T19:25:30.188791+0000', 'last_clean': '2023-11-08T19:25:30.188791+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:30.204036+0000', 'last_undegraded': '2023-11-08T19:25:30.204036+0000', 'last_fullsized': '2023-11-08T19:25:30.204036+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-08T19:25:37.134 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.0 is not active+clean 2023-11-08T19:25:37.134 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:25:31.194359+0000', 'last_change': '2023-11-08T19:25:31.194359+0000', 'last_active': '2023-11-08T19:25:31.194359+0000', 'last_peered': '2023-11-08T19:25:31.194359+0000', 'last_clean': '2023-11-08T19:25:31.194359+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:31.194359+0000', 'last_undegraded': '2023-11-08T19:25:31.194359+0000', 'last_fullsized': '2023-11-08T19:25:31.194359+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:25:37.135 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1 is not active+clean 2023-11-08T19:25:37.135 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:25:30.201855+0000', 'last_change': '2023-11-08T19:25:30.201855+0000', 'last_active': '2023-11-08T19:25:30.188791+0000', 'last_peered': '2023-11-08T19:25:30.188791+0000', 'last_clean': '2023-11-08T19:25:30.188791+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:30.201855+0000', 'last_undegraded': '2023-11-08T19:25:30.201855+0000', 'last_fullsized': '2023-11-08T19:25:30.201855+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-08T19:25:37.136 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3 is not active+clean 2023-11-08T19:25:37.136 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:25:31.194359+0000', 'last_change': '2023-11-08T19:25:31.194359+0000', 'last_active': '2023-11-08T19:25:31.194359+0000', 'last_peered': '2023-11-08T19:25:31.194359+0000', 'last_clean': '2023-11-08T19:25:31.194359+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:31.194359+0000', 'last_undegraded': '2023-11-08T19:25:31.194359+0000', 'last_fullsized': '2023-11-08T19:25:31.194359+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:25:37.136 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2 is not active+clean 2023-11-08T19:25:37.137 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:25:30.197604+0000', 'last_change': '2023-11-08T19:25:30.197604+0000', 'last_active': '2023-11-08T19:25:30.188791+0000', 'last_peered': '2023-11-08T19:25:30.188791+0000', 'last_clean': '2023-11-08T19:25:30.188791+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:30.197604+0000', 'last_undegraded': '2023-11-08T19:25:30.197604+0000', 'last_fullsized': '2023-11-08T19:25:30.197604+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-08T19:25:37.137 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2 is not active+clean 2023-11-08T19:25:37.138 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:25:31.194359+0000', 'last_change': '2023-11-08T19:25:31.194359+0000', 'last_active': '2023-11-08T19:25:31.194359+0000', 'last_peered': '2023-11-08T19:25:31.194359+0000', 'last_clean': '2023-11-08T19:25:31.194359+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:31.194359+0000', 'last_undegraded': '2023-11-08T19:25:31.194359+0000', 'last_fullsized': '2023-11-08T19:25:31.194359+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:25:37.138 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3 is not active+clean 2023-11-08T19:25:37.138 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:25:30.199269+0000', 'last_change': '2023-11-08T19:25:30.199269+0000', 'last_active': '2023-11-08T19:25:30.188791+0000', 'last_peered': '2023-11-08T19:25:30.188791+0000', 'last_clean': '2023-11-08T19:25:30.188791+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:30.199269+0000', 'last_undegraded': '2023-11-08T19:25:30.199269+0000', 'last_fullsized': '2023-11-08T19:25:30.199269+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-08T19:25:37.139 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.4 is not active+clean 2023-11-08T19:25:37.139 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:25:30.201020+0000', 'last_change': '2023-11-08T19:25:30.201020+0000', 'last_active': '2023-11-08T19:25:30.188791+0000', 'last_peered': '2023-11-08T19:25:30.188791+0000', 'last_clean': '2023-11-08T19:25:30.188791+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:30.201020+0000', 'last_undegraded': '2023-11-08T19:25:30.201020+0000', 'last_fullsized': '2023-11-08T19:25:30.201020+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-08T19:25:37.139 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.5 is not active+clean 2023-11-08T19:25:37.140 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:25:30.199253+0000', 'last_change': '2023-11-08T19:25:30.199253+0000', 'last_active': '2023-11-08T19:25:30.188791+0000', 'last_peered': '2023-11-08T19:25:30.188791+0000', 'last_clean': '2023-11-08T19:25:30.188791+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:30.199253+0000', 'last_undegraded': '2023-11-08T19:25:30.199253+0000', 'last_fullsized': '2023-11-08T19:25:30.199253+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-08T19:25:37.140 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.7 is not active+clean 2023-11-08T19:25:37.141 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:25:31.194359+0000', 'last_change': '2023-11-08T19:25:31.194359+0000', 'last_active': '2023-11-08T19:25:31.194359+0000', 'last_peered': '2023-11-08T19:25:31.194359+0000', 'last_clean': '2023-11-08T19:25:31.194359+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:31.194359+0000', 'last_undegraded': '2023-11-08T19:25:31.194359+0000', 'last_fullsized': '2023-11-08T19:25:31.194359+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:25:37.141 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.6 is not active+clean 2023-11-08T19:25:37.141 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:25:30.203005+0000', 'last_change': '2023-11-08T19:25:30.203005+0000', 'last_active': '2023-11-08T19:25:30.188791+0000', 'last_peered': '2023-11-08T19:25:30.188791+0000', 'last_clean': '2023-11-08T19:25:30.188791+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:30.203005+0000', 'last_undegraded': '2023-11-08T19:25:30.203005+0000', 'last_fullsized': '2023-11-08T19:25:30.203005+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-08T19:25:37.142 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.6 is not active+clean 2023-11-08T19:25:37.142 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:25:31.194359+0000', 'last_change': '2023-11-08T19:25:31.194359+0000', 'last_active': '2023-11-08T19:25:31.194359+0000', 'last_peered': '2023-11-08T19:25:31.194359+0000', 'last_clean': '2023-11-08T19:25:31.194359+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:31.194359+0000', 'last_undegraded': '2023-11-08T19:25:31.194359+0000', 'last_fullsized': '2023-11-08T19:25:31.194359+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:25:37.143 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.7 is not active+clean 2023-11-08T19:25:37.143 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:25:30.204341+0000', 'last_change': '2023-11-08T19:25:30.204341+0000', 'last_active': '2023-11-08T19:25:30.188791+0000', 'last_peered': '2023-11-08T19:25:30.188791+0000', 'last_clean': '2023-11-08T19:25:30.188791+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:30.204341+0000', 'last_undegraded': '2023-11-08T19:25:30.204341+0000', 'last_fullsized': '2023-11-08T19:25:30.204341+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-08T19:25:37.143 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.9 is not active+clean 2023-11-08T19:25:37.144 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:25:31.194359+0000', 'last_change': '2023-11-08T19:25:31.194359+0000', 'last_active': '2023-11-08T19:25:31.194359+0000', 'last_peered': '2023-11-08T19:25:31.194359+0000', 'last_clean': '2023-11-08T19:25:31.194359+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:31.194359+0000', 'last_undegraded': '2023-11-08T19:25:31.194359+0000', 'last_fullsized': '2023-11-08T19:25:31.194359+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:25:37.144 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.8 is not active+clean 2023-11-08T19:25:37.144 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:25:30.200988+0000', 'last_change': '2023-11-08T19:25:30.200988+0000', 'last_active': '2023-11-08T19:25:30.188791+0000', 'last_peered': '2023-11-08T19:25:30.188791+0000', 'last_clean': '2023-11-08T19:25:30.188791+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:30.200988+0000', 'last_undegraded': '2023-11-08T19:25:30.200988+0000', 'last_fullsized': '2023-11-08T19:25:30.200988+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-08T19:25:37.145 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.8 is not active+clean 2023-11-08T19:25:37.145 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:25:31.194359+0000', 'last_change': '2023-11-08T19:25:31.194359+0000', 'last_active': '2023-11-08T19:25:31.194359+0000', 'last_peered': '2023-11-08T19:25:31.194359+0000', 'last_clean': '2023-11-08T19:25:31.194359+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:31.194359+0000', 'last_undegraded': '2023-11-08T19:25:31.194359+0000', 'last_fullsized': '2023-11-08T19:25:31.194359+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:25:37.146 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.9 is not active+clean 2023-11-08T19:25:37.146 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:25:30.203020+0000', 'last_change': '2023-11-08T19:25:30.203020+0000', 'last_active': '2023-11-08T19:25:30.188791+0000', 'last_peered': '2023-11-08T19:25:30.188791+0000', 'last_clean': '2023-11-08T19:25:30.188791+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:30.203020+0000', 'last_undegraded': '2023-11-08T19:25:30.203020+0000', 'last_fullsized': '2023-11-08T19:25:30.203020+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-08T19:25:37.146 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.b is not active+clean 2023-11-08T19:25:37.147 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:25:31.194359+0000', 'last_change': '2023-11-08T19:25:31.194359+0000', 'last_active': '2023-11-08T19:25:31.194359+0000', 'last_peered': '2023-11-08T19:25:31.194359+0000', 'last_clean': '2023-11-08T19:25:31.194359+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:31.194359+0000', 'last_undegraded': '2023-11-08T19:25:31.194359+0000', 'last_fullsized': '2023-11-08T19:25:31.194359+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:25:37.147 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.a is not active+clean 2023-11-08T19:25:37.148 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:25:30.204059+0000', 'last_change': '2023-11-08T19:25:30.204059+0000', 'last_active': '2023-11-08T19:25:30.188791+0000', 'last_peered': '2023-11-08T19:25:30.188791+0000', 'last_clean': '2023-11-08T19:25:30.188791+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:30.204059+0000', 'last_undegraded': '2023-11-08T19:25:30.204059+0000', 'last_fullsized': '2023-11-08T19:25:30.204059+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-08T19:25:37.148 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.d is not active+clean 2023-11-08T19:25:37.148 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:25:31.194359+0000', 'last_change': '2023-11-08T19:25:31.194359+0000', 'last_active': '2023-11-08T19:25:31.194359+0000', 'last_peered': '2023-11-08T19:25:31.194359+0000', 'last_clean': '2023-11-08T19:25:31.194359+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:31.194359+0000', 'last_undegraded': '2023-11-08T19:25:31.194359+0000', 'last_fullsized': '2023-11-08T19:25:31.194359+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:25:37.149 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.c is not active+clean 2023-11-08T19:25:37.149 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:25:31.194359+0000', 'last_change': '2023-11-08T19:25:31.194359+0000', 'last_active': '2023-11-08T19:25:31.194359+0000', 'last_peered': '2023-11-08T19:25:31.194359+0000', 'last_clean': '2023-11-08T19:25:31.194359+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:31.194359+0000', 'last_undegraded': '2023-11-08T19:25:31.194359+0000', 'last_fullsized': '2023-11-08T19:25:31.194359+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:25:37.149 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.d is not active+clean 2023-11-08T19:25:37.150 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:25:30.204372+0000', 'last_change': '2023-11-08T19:25:30.204372+0000', 'last_active': '2023-11-08T19:25:30.188791+0000', 'last_peered': '2023-11-08T19:25:30.188791+0000', 'last_clean': '2023-11-08T19:25:30.188791+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:30.204372+0000', 'last_undegraded': '2023-11-08T19:25:30.204372+0000', 'last_fullsized': '2023-11-08T19:25:30.204372+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-08T19:25:37.150 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.e is not active+clean 2023-11-08T19:25:37.151 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:25:30.201640+0000', 'last_change': '2023-11-08T19:25:30.201640+0000', 'last_active': '2023-11-08T19:25:30.188791+0000', 'last_peered': '2023-11-08T19:25:30.188791+0000', 'last_clean': '2023-11-08T19:25:30.188791+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:30.201640+0000', 'last_undegraded': '2023-11-08T19:25:30.201640+0000', 'last_fullsized': '2023-11-08T19:25:30.201640+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-08T19:25:37.151 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.e is not active+clean 2023-11-08T19:25:37.151 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:25:31.194359+0000', 'last_change': '2023-11-08T19:25:31.194359+0000', 'last_active': '2023-11-08T19:25:31.194359+0000', 'last_peered': '2023-11-08T19:25:31.194359+0000', 'last_clean': '2023-11-08T19:25:31.194359+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:31.194359+0000', 'last_undegraded': '2023-11-08T19:25:31.194359+0000', 'last_fullsized': '2023-11-08T19:25:31.194359+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:25:37.152 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.f is not active+clean 2023-11-08T19:25:37.152 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:25:30.205611+0000', 'last_change': '2023-11-08T19:25:30.205611+0000', 'last_active': '2023-11-08T19:25:30.188791+0000', 'last_peered': '2023-11-08T19:25:30.188791+0000', 'last_clean': '2023-11-08T19:25:30.188791+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:30.205611+0000', 'last_undegraded': '2023-11-08T19:25:30.205611+0000', 'last_fullsized': '2023-11-08T19:25:30.205611+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-08T19:25:37.153 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.a is not active+clean 2023-11-08T19:25:37.153 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:25:31.194359+0000', 'last_change': '2023-11-08T19:25:31.194359+0000', 'last_active': '2023-11-08T19:25:31.194359+0000', 'last_peered': '2023-11-08T19:25:31.194359+0000', 'last_clean': '2023-11-08T19:25:31.194359+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:31.194359+0000', 'last_undegraded': '2023-11-08T19:25:31.194359+0000', 'last_fullsized': '2023-11-08T19:25:31.194359+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:31.194359+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:25:37.153 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.b is not active+clean 2023-11-08T19:25:37.154 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 64, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:25:30.204838+0000', 'last_change': '2023-11-08T19:25:30.204838+0000', 'last_active': '2023-11-08T19:25:30.188791+0000', 'last_peered': '2023-11-08T19:25:30.188791+0000', 'last_clean': '2023-11-08T19:25:30.188791+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:25:30.204838+0000', 'last_undegraded': '2023-11-08T19:25:30.204838+0000', 'last_fullsized': '2023-11-08T19:25:30.204838+0000', 'mapping_epoch': 64, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 64, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'last_clean_scrub_stamp': '2023-11-08T19:25:30.188791+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-08T19:25:37.155 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-08T19:25:37.275 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.274+0000 7fe026cf7700 1 Processor -- start 2023-11-08T19:25:37.276 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.274+0000 7fe026cf7700 1 -- start start 2023-11-08T19:25:37.279 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.275+0000 7fe026cf7700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe0200d1140 0x7fe0200b0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:37.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.275+0000 7fe026cf7700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0200b0140 con 0x7fe0200cec00 2023-11-08T19:25:37.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.275+0000 7fe026cf7700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0200ce720 con 0x7fe0200cd660 2023-11-08T19:25:37.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.275+0000 7fe026cf7700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0200d15d0 con 0x7fe0200d1140 2023-11-08T19:25:37.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.275+0000 7fe024a93700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fe0200cec00 0x7fe0200cefe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:43372/0 (socket says 172.21.15.149:43372) 2023-11-08T19:25:37.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.275+0000 7fe024a93700 1 -- 172.21.15.149:0/984938023 learned_addr learned my addr 172.21.15.149:0/984938023 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:25:37.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.275+0000 7fe025294700 1 --2- 172.21.15.149:0/984938023 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe0200d1140 0x7fe0200b0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:37.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.275+0000 7fe01f7fe700 1 -- 172.21.15.149:0/984938023 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3375419013 0 0) 0x7fe0200b0140 con 0x7fe0200cec00 2023-11-08T19:25:37.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.275+0000 7fe01f7fe700 1 -- 172.21.15.149:0/984938023 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0100035b0 con 0x7fe0200cec00 2023-11-08T19:25:37.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.276+0000 7fe01f7fe700 1 -- 172.21.15.149:0/984938023 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3060333406 0 0) 0x7fe0100035b0 con 0x7fe0200cec00 2023-11-08T19:25:37.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.276+0000 7fe01f7fe700 1 -- 172.21.15.149:0/984938023 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe0200d1140 msgr2=0x7fe0200b0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:37.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.276+0000 7fe01f7fe700 1 --2- 172.21.15.149:0/984938023 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe0200d1140 0x7fe0200b0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:37.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.276+0000 7fe01f7fe700 1 -- 172.21.15.149:0/984938023 >> v1:172.21.15.160:6789/0 conn(0x7fe0200cd660 legacy=0x7fe0200b05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:37.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.276+0000 7fe01f7fe700 1 -- 172.21.15.149:0/984938023 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0200cdf00 con 0x7fe0200cec00 2023-11-08T19:25:37.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.276+0000 7fe01f7fe700 1 -- 172.21.15.149:0/984938023 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7fe014001670 con 0x7fe0200cec00 2023-11-08T19:25:37.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.276+0000 7fe01f7fe700 1 -- 172.21.15.149:0/984938023 >> v1:172.21.15.149:6789/0 conn(0x7fe0200cec00 legacy=0x7fe0200cefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:37.283 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.276+0000 7fe01f7fe700 1 --2- 172.21.15.149:0/984938023 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe0200d1140 0x7fe010003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:37.283 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.276+0000 7fe01f7fe700 1 --2- 172.21.15.149:0/984938023 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe010003f70 0x7fe010004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:37.283 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.276+0000 7fe01f7fe700 1 --2- 172.21.15.149:0/984938023 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe010004d90 0x7fe010005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:37.283 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.276+0000 7fe01f7fe700 1 -- 172.21.15.149:0/984938023 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0200d15d0 con 0x7fe010003f70 2023-11-08T19:25:37.283 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.276+0000 7fe01f7fe700 1 -- 172.21.15.149:0/984938023 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe01000bb20 con 0x7fe010004d90 2023-11-08T19:25:37.284 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.276+0000 7fe01f7fe700 1 -- 172.21.15.149:0/984938023 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe01000bce0 con 0x7fe0200d1140 2023-11-08T19:25:37.284 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.276+0000 7fe01ffff700 1 --2- 172.21.15.149:0/984938023 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe010003f70 0x7fe010004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:37.284 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.276+0000 7fe024a93700 1 --2- 172.21.15.149:0/984938023 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe0200d1140 0x7fe010003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:37.284 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.276+0000 7fe025294700 1 --2- 172.21.15.149:0/984938023 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe010004d90 0x7fe010005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:37.284 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.276+0000 7fe01ffff700 1 -- 172.21.15.149:0/984938023 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe0200d1140 msgr2=0x7fe010003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:37.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.276+0000 7fe01ffff700 1 --2- 172.21.15.149:0/984938023 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe0200d1140 0x7fe010003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:37.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.276+0000 7fe01ffff700 1 -- 172.21.15.149:0/984938023 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe010004d90 msgr2=0x7fe010005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:37.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.276+0000 7fe01ffff700 1 --2- 172.21.15.149:0/984938023 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe010004d90 0x7fe010005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:37.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.276+0000 7fe01ffff700 1 -- 172.21.15.149:0/984938023 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0100035b0 con 0x7fe010003f70 2023-11-08T19:25:37.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.276+0000 7fe01ffff700 1 --2- 172.21.15.149:0/984938023 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe010003f70 0x7fe010004850 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fe00c0018d0 tx=0x7fe010005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e33a11dbe5f03729 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:37.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.276+0000 7fe01f7fe700 1 -- 172.21.15.149:0/984938023 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00c00c690 con 0x7fe010003f70 2023-11-08T19:25:37.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.276+0000 7fe01f7fe700 1 -- 172.21.15.149:0/984938023 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe00c00c7f0 con 0x7fe010003f70 2023-11-08T19:25:37.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.276+0000 7fe01f7fe700 1 -- 172.21.15.149:0/984938023 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00c00cba0 con 0x7fe010003f70 2023-11-08T19:25:37.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.277+0000 7fe026cf7700 1 -- 172.21.15.149:0/984938023 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe010003f70 msgr2=0x7fe010004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:37.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.277+0000 7fe026cf7700 1 --2- 172.21.15.149:0/984938023 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe010003f70 0x7fe010004850 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fe00c0018d0 tx=0x7fe010005880 comp rx=0 tx=0).stop 2023-11-08T19:25:37.287 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.277+0000 7fe025294700 1 -- 172.21.15.149:0/984938023 reap_dead start 2023-11-08T19:25:37.287 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.277+0000 7fe026cf7700 1 -- 172.21.15.149:0/984938023 shutdown_connections 2023-11-08T19:25:37.287 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.277+0000 7fe026cf7700 1 -- 172.21.15.149:0/984938023 >> 172.21.15.149:0/984938023 conn(0x7fe0200d0620 msgr2=0x7fe0200d0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:37.287 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.277+0000 7fe026cf7700 1 -- 172.21.15.149:0/984938023 shutdown_connections 2023-11-08T19:25:37.287 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.277+0000 7fe026cf7700 1 -- 172.21.15.149:0/984938023 wait complete. 2023-11-08T19:25:37.288 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.278+0000 7fe026cf7700 1 Processor -- start 2023-11-08T19:25:37.288 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.278+0000 7fe026cf7700 1 -- start start 2023-11-08T19:25:37.291 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.279+0000 7fe026cf7700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe010003f70 0x7fe0200c6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:37.291 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.279+0000 7fe026cf7700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe0201f66e0 0x7fe0201596b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:37.291 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.279+0000 7fe026cf7700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0200b3210 0x7fe0200b3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:37.291 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.279+0000 7fe026cf7700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe020158040 con 0x7fe0200b3210 2023-11-08T19:25:37.291 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.279+0000 7fe026cf7700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe020158320 con 0x7fe0201f66e0 2023-11-08T19:25:37.292 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.279+0000 7fe026cf7700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0201f6ec0 con 0x7fe010003f70 2023-11-08T19:25:37.292 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.279+0000 7fe025294700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0200b3210 0x7fe0200b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:37.292 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.279+0000 7fe024a93700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe010003f70 0x7fe0200c6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:37.292 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.279+0000 7fe025294700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0200b3210 0x7fe0200b3690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41386/0 (socket says 172.21.15.149:41386) 2023-11-08T19:25:37.292 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.279+0000 7fe024a93700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe010003f70 0x7fe0200c6350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.149:33438/0 (socket says 172.21.15.149:33438) 2023-11-08T19:25:37.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.279+0000 7fe025294700 1 -- 172.21.15.149:0/3602236575 learned_addr learned my addr 172.21.15.149:0/3602236575 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:37.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.279+0000 7fe01ffff700 1 --2- 172.21.15.149:0/3602236575 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe0201f66e0 0x7fe0201596b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:37.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.280+0000 7fe025294700 1 -- 172.21.15.149:0/3602236575 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe010003f70 msgr2=0x7fe0200c6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:37.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.280+0000 7fe025294700 1 --2- 172.21.15.149:0/3602236575 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe010003f70 0x7fe0200c6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:37.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.280+0000 7fe025294700 1 -- 172.21.15.149:0/3602236575 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe0201f66e0 msgr2=0x7fe0201596b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:37.294 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.280+0000 7fe025294700 1 --2- 172.21.15.149:0/3602236575 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe0201f66e0 0x7fe0201596b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:37.294 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.280+0000 7fe025294700 1 -- 172.21.15.149:0/3602236575 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0201f71a0 con 0x7fe0200b3210 2023-11-08T19:25:37.294 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.280+0000 7fe024a93700 1 --2- 172.21.15.149:0/3602236575 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe010003f70 0x7fe0200c6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:25:37.294 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.280+0000 7fe025294700 1 --2- 172.21.15.149:0/3602236575 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0200b3210 0x7fe0200b3690 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fe0200cac20 tx=0x7fe018011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:37.294 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.280+0000 7fe01d7fa700 1 -- 172.21.15.149:0/3602236575 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe01800e040 con 0x7fe0200b3210 2023-11-08T19:25:37.295 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.280+0000 7fe01d7fa700 1 -- 172.21.15.149:0/3602236575 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe01800f040 con 0x7fe0200b3210 2023-11-08T19:25:37.295 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.280+0000 7fe01d7fa700 1 -- 172.21.15.149:0/3602236575 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe01800fc40 con 0x7fe0200b3210 2023-11-08T19:25:37.295 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.280+0000 7fe026cf7700 1 -- 172.21.15.149:0/3602236575 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0201f7480 con 0x7fe0200b3210 2023-11-08T19:25:37.295 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.280+0000 7fe026cf7700 1 -- 172.21.15.149:0/3602236575 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe020159bf0 con 0x7fe0200b3210 2023-11-08T19:25:37.295 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.281+0000 7fe026cf7700 1 -- 172.21.15.149:0/3602236575 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe020158490 con 0x7fe0200b3210 2023-11-08T19:25:37.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.281+0000 7fe01d7fa700 1 -- 172.21.15.149:0/3602236575 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe018022460 con 0x7fe0200b3210 2023-11-08T19:25:37.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.282+0000 7fe01d7fa700 1 --2- 172.21.15.149:0/3602236575 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe00406af00 0x7fe00406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:37.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.282+0000 7fe01d7fa700 1 -- 172.21.15.149:0/3602236575 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fe018089d20 con 0x7fe0200b3210 2023-11-08T19:25:37.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.282+0000 7fe024a93700 1 --2- 172.21.15.149:0/3602236575 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe00406af00 0x7fe00406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:37.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.282+0000 7fe024a93700 1 --2- 172.21.15.149:0/3602236575 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe00406af00 0x7fe00406d3c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fe0201e4a00 tx=0x7fe014000fa0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:37.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.287+0000 7fe01d7fa700 1 -- 172.21.15.149:0/3602236575 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe018054b30 con 0x7fe0200b3210 2023-11-08T19:25:37.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.559+0000 7fe026cf7700 1 -- 172.21.15.149:0/3602236575 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fe0200745f0 con 0x7fe0200b3210 2023-11-08T19:25:37.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.559+0000 7fe01d7fa700 1 -- 172.21.15.149:0/3602236575 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1736 (secure 0 0 0) 0x7fe018058150 con 0x7fe0200b3210 2023-11-08T19:25:37.561 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:25:37.561 INFO:teuthology.orchestra.run.smithi149.stdout:{"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","health":{"status":"HEALTH_WARN","checks":{"POOL_APP_NOT_ENABLED":{"severity":"HEALTH_WARN","summary":{"message":"1 pool(s) do not have an application enabled","count":1},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":173,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":67,"num_osds":8,"num_up_osds":8,"osd_up_since":1699471375,"num_in_osds":8,"osd_in_since":1699471366,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":53},{"state_name":"active+clean","count":46},{"state_name":"creating+peering","count":30}],"num_pgs":129,"num_pools":4,"num_objects":4,"data_bytes":590950,"bytes_used":228777984,"bytes_avail":772865335296,"bytes_total":773094113280,"unknown_pgs_ratio":0.41085270047187805,"inactive_pgs_ratio":0.23255814611911774,"write_bytes_sec":175,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":35,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"a","status":"up:active","gid":6189}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-11-08T19:25:12.013984+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-11-08T19:25:37.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.562+0000 7fe026cf7700 1 -- 172.21.15.149:0/3602236575 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe00406af00 msgr2=0x7fe00406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:37.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.562+0000 7fe026cf7700 1 --2- 172.21.15.149:0/3602236575 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe00406af00 0x7fe00406d3c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fe0201e4a00 tx=0x7fe014000fa0 comp rx=0 tx=0).stop 2023-11-08T19:25:37.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.562+0000 7fe026cf7700 1 -- 172.21.15.149:0/3602236575 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0200b3210 msgr2=0x7fe0200b3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:37.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.562+0000 7fe026cf7700 1 --2- 172.21.15.149:0/3602236575 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0200b3210 0x7fe0200b3690 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fe0200cac20 tx=0x7fe018011ed0 comp rx=0 tx=0).stop 2023-11-08T19:25:37.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.562+0000 7fe026cf7700 1 -- 172.21.15.149:0/3602236575 shutdown_connections 2023-11-08T19:25:37.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.562+0000 7fe026cf7700 1 --2- 172.21.15.149:0/3602236575 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe00406af00 0x7fe00406d3c0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:37.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.562+0000 7fe026cf7700 1 --2- 172.21.15.149:0/3602236575 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0200b3210 0x7fe0200b3690 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:37.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.562+0000 7fe026cf7700 1 --2- 172.21.15.149:0/3602236575 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe010003f70 0x7fe0200c6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:37.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.562+0000 7fe026cf7700 1 --2- 172.21.15.149:0/3602236575 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe0201f66e0 0x7fe0201596b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:37.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.562+0000 7fe026cf7700 1 -- 172.21.15.149:0/3602236575 >> 172.21.15.149:0/3602236575 conn(0x7fe0200d0620 msgr2=0x7fe02006e290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:37.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.562+0000 7fe026cf7700 1 -- 172.21.15.149:0/3602236575 shutdown_connections 2023-11-08T19:25:37.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.562+0000 7fe026cf7700 1 -- 172.21.15.149:0/3602236575 wait complete. 2023-11-08T19:25:37.576 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-08T19:25:37.576 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:25:37.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.696+0000 7fd3c2107700 1 Processor -- start 2023-11-08T19:25:37.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.696+0000 7fd3c2107700 1 -- start start 2023-11-08T19:25:37.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.697+0000 7fd3c2107700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fd3bc0cc140 0x7fd3bc0cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:37.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.697+0000 7fd3c2107700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd3bc0b2850 0x7fd3bc0cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:37.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.697+0000 7fd3c2107700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3bc0cce50 con 0x7fd3bc0b2cd0 2023-11-08T19:25:37.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.697+0000 7fd3c2107700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3bc0b2430 con 0x7fd3bc0cc140 2023-11-08T19:25:37.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.697+0000 7fd3c2107700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3bc0cc520 con 0x7fd3bc0b2850 2023-11-08T19:25:37.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.697+0000 7fd3baffd700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd3bc0b2850 0x7fd3bc0cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:37.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.697+0000 7fd3baffd700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd3bc0b2850 0x7fd3bc0cabf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.149:33448/0 (socket says 172.21.15.149:33448) 2023-11-08T19:25:37.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.697+0000 7fd3baffd700 1 -- 172.21.15.149:0/3455490266 learned_addr learned my addr 172.21.15.149:0/3455490266 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:37.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.697+0000 7fd3bb7fe700 1 --2- 172.21.15.149:0/3455490266 >> v2:172.21.15.160:3300/0 conn(0x7fd3bc0cc140 0x7fd3bc0cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:37.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.697+0000 7fd3baffd700 1 -- 172.21.15.149:0/3455490266 >> v2:172.21.15.160:3300/0 conn(0x7fd3bc0cc140 msgr2=0x7fd3bc0cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:37.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.697+0000 7fd3baffd700 1 --2- 172.21.15.149:0/3455490266 >> v2:172.21.15.160:3300/0 conn(0x7fd3bc0cc140 0x7fd3bc0cc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:37.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.697+0000 7fd3baffd700 1 -- 172.21.15.149:0/3455490266 >> v1:172.21.15.160:6789/0 conn(0x7fd3bc0b2cd0 legacy=0x7fd3bc15d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:37.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.697+0000 7fd3baffd700 1 -- 172.21.15.149:0/3455490266 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3bc0b17b0 con 0x7fd3bc0b2850 2023-11-08T19:25:37.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.698+0000 7fd3baffd700 1 --2- 172.21.15.149:0/3455490266 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd3bc0b2850 0x7fd3bc0cabf0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd3a40098f0 tx=0x7fd3a4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc4b2b2fe4d7e0cd server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:37.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.698+0000 7fd3ba7fc700 1 -- 172.21.15.149:0/3455490266 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a4011830 con 0x7fd3bc0b2850 2023-11-08T19:25:37.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.698+0000 7fd3ba7fc700 1 -- 172.21.15.149:0/3455490266 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3a4011990 con 0x7fd3bc0b2850 2023-11-08T19:25:37.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.698+0000 7fd3ba7fc700 1 -- 172.21.15.149:0/3455490266 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a4011d20 con 0x7fd3bc0b2850 2023-11-08T19:25:37.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.698+0000 7fd3c2107700 1 -- 172.21.15.149:0/3455490266 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd3bc0b2850 msgr2=0x7fd3bc0cabf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:37.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.698+0000 7fd3c2107700 1 --2- 172.21.15.149:0/3455490266 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd3bc0b2850 0x7fd3bc0cabf0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd3a40098f0 tx=0x7fd3a4009c00 comp rx=0 tx=0).stop 2023-11-08T19:25:37.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.698+0000 7fd3c2107700 1 -- 172.21.15.149:0/3455490266 shutdown_connections 2023-11-08T19:25:37.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.698+0000 7fd3c2107700 1 --2- 172.21.15.149:0/3455490266 >> v2:172.21.15.160:3300/0 conn(0x7fd3bc0cc140 0x7fd3bc0cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:37.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.698+0000 7fd3c2107700 1 --2- 172.21.15.149:0/3455490266 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd3bc0b2850 0x7fd3bc0cabf0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:37.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.698+0000 7fd3c2107700 1 -- 172.21.15.149:0/3455490266 >> 172.21.15.149:0/3455490266 conn(0x7fd3bc099a40 msgr2=0x7fd3bc0d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:37.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.698+0000 7fd3c2107700 1 -- 172.21.15.149:0/3455490266 shutdown_connections 2023-11-08T19:25:37.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.698+0000 7fd3c2107700 1 -- 172.21.15.149:0/3455490266 wait complete. 2023-11-08T19:25:37.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.700+0000 7fd3c2107700 1 Processor -- start 2023-11-08T19:25:37.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.700+0000 7fd3c2107700 1 -- start start 2023-11-08T19:25:37.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.701+0000 7fd3c2107700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3bc0b2850 0x7fd3bc14eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:37.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.701+0000 7fd3c2107700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3bc0b2cd0 0x7fd3bc09a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:37.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.701+0000 7fd3c2107700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd3bc0cc140 0x7fd3bc15f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:37.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.701+0000 7fd3c2107700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3bc14f410 con 0x7fd3bc0b2850 2023-11-08T19:25:37.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.701+0000 7fd3c2107700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3bc1526c0 con 0x7fd3bc0b2cd0 2023-11-08T19:25:37.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.701+0000 7fd3c2107700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3bc151b40 con 0x7fd3bc0cc140 2023-11-08T19:25:37.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.701+0000 7fd3bb7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3bc0b2850 0x7fd3bc14eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:37.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.701+0000 7fd3bb7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3bc0b2850 0x7fd3bc14eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41396/0 (socket says 172.21.15.149:41396) 2023-11-08T19:25:37.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.701+0000 7fd3bb7fe700 1 -- 172.21.15.149:0/3683937770 learned_addr learned my addr 172.21.15.149:0/3683937770 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:37.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.701+0000 7fd3bbfff700 1 --2- 172.21.15.149:0/3683937770 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd3bc0cc140 0x7fd3bc15f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:37.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.701+0000 7fd3baffd700 1 --2- 172.21.15.149:0/3683937770 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3bc0b2cd0 0x7fd3bc09a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:37.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.701+0000 7fd3bb7fe700 1 -- 172.21.15.149:0/3683937770 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd3bc0cc140 msgr2=0x7fd3bc15f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:37.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.701+0000 7fd3bb7fe700 1 --2- 172.21.15.149:0/3683937770 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd3bc0cc140 0x7fd3bc15f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:37.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.701+0000 7fd3bb7fe700 1 -- 172.21.15.149:0/3683937770 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3bc0b2cd0 msgr2=0x7fd3bc09a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:37.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.701+0000 7fd3bb7fe700 1 --2- 172.21.15.149:0/3683937770 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3bc0b2cd0 0x7fd3bc09a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:37.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.702+0000 7fd3bb7fe700 1 -- 172.21.15.149:0/3683937770 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a4009550 con 0x7fd3bc0b2850 2023-11-08T19:25:37.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.702+0000 7fd3bbfff700 1 --2- 172.21.15.149:0/3683937770 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd3bc0cc140 0x7fd3bc15f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:25:37.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.702+0000 7fd3baffd700 1 --2- 172.21.15.149:0/3683937770 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3bc0b2cd0 0x7fd3bc09a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:25:37.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.702+0000 7fd3bb7fe700 1 --2- 172.21.15.149:0/3683937770 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3bc0b2850 0x7fd3bc14eed0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac00e900 tx=0x7fd3ac00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:37.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.702+0000 7fd3b3fff700 1 -- 172.21.15.149:0/3683937770 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac009650 con 0x7fd3bc0b2850 2023-11-08T19:25:37.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.702+0000 7fd3b3fff700 1 -- 172.21.15.149:0/3683937770 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3ac00c850 con 0x7fd3bc0b2850 2023-11-08T19:25:37.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.702+0000 7fd3c2107700 1 -- 172.21.15.149:0/3683937770 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3bc151e20 con 0x7fd3bc0b2850 2023-11-08T19:25:37.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.702+0000 7fd3b3fff700 1 -- 172.21.15.149:0/3683937770 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac00cbc0 con 0x7fd3bc0b2850 2023-11-08T19:25:37.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.702+0000 7fd3c2107700 1 -- 172.21.15.149:0/3683937770 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3bc1523e0 con 0x7fd3bc0b2850 2023-11-08T19:25:37.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.703+0000 7fd3c2107700 1 -- 172.21.15.149:0/3683937770 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3bc14f740 con 0x7fd3bc0b2850 2023-11-08T19:25:37.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.703+0000 7fd3b3fff700 1 -- 172.21.15.149:0/3683937770 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd3ac00cd20 con 0x7fd3bc0b2850 2023-11-08T19:25:37.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.704+0000 7fd3b3fff700 1 --2- 172.21.15.149:0/3683937770 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd39c06af30 0x7fd39c06d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:37.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.704+0000 7fd3b3fff700 1 -- 172.21.15.149:0/3683937770 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fd3ac089c10 con 0x7fd3bc0b2850 2023-11-08T19:25:37.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.704+0000 7fd3baffd700 1 --2- 172.21.15.149:0/3683937770 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd39c06af30 0x7fd39c06d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:37.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.704+0000 7fd3baffd700 1 --2- 172.21.15.149:0/3683937770 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd39c06af30 0x7fd39c06d3f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fd3a4009c40 tx=0x7fd3a4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:37.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.709+0000 7fd3b3fff700 1 -- 172.21.15.149:0/3683937770 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd3bc14f740 con 0x7fd3bc0b2850 2023-11-08T19:25:37.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.895+0000 7fd3c2107700 1 -- 172.21.15.149:0/3683937770 --> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd3bc0b1d70 con 0x7fd39c06af30 2023-11-08T19:25:37.905 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.904+0000 7fd3b3fff700 1 -- 172.21.15.149:0/3683937770 <== mgr.4104 v2:172.21.15.149:6832/1929837472 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+360221 (secure 0 0 0) 0x7fd3a4011c80 con 0x7fd39c06af30 2023-11-08T19:25:37.910 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:25:37.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.908+0000 7fd3c2107700 1 -- 172.21.15.149:0/3683937770 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd39c06af30 msgr2=0x7fd39c06d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:37.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.908+0000 7fd3c2107700 1 --2- 172.21.15.149:0/3683937770 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd39c06af30 0x7fd39c06d3f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fd3a4009c40 tx=0x7fd3a4008030 comp rx=0 tx=0).stop 2023-11-08T19:25:37.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.908+0000 7fd3c2107700 1 -- 172.21.15.149:0/3683937770 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3bc0b2850 msgr2=0x7fd3bc14eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:37.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.908+0000 7fd3c2107700 1 --2- 172.21.15.149:0/3683937770 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3bc0b2850 0x7fd3bc14eed0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac00e900 tx=0x7fd3ac00ecc0 comp rx=0 tx=0).stop 2023-11-08T19:25:37.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.908+0000 7fd3c2107700 1 -- 172.21.15.149:0/3683937770 shutdown_connections 2023-11-08T19:25:37.914 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.908+0000 7fd3c2107700 1 --2- 172.21.15.149:0/3683937770 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd39c06af30 0x7fd39c06d3f0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:37.914 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.908+0000 7fd3c2107700 1 --2- 172.21.15.149:0/3683937770 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd3bc0cc140 0x7fd3bc15f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:37.914 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.908+0000 7fd3c2107700 1 --2- 172.21.15.149:0/3683937770 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3bc0b2850 0x7fd3bc14eed0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:37.914 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.908+0000 7fd3c2107700 1 --2- 172.21.15.149:0/3683937770 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3bc0b2cd0 0x7fd3bc09a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:37.915 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.908+0000 7fd3c2107700 1 -- 172.21.15.149:0/3683937770 >> 172.21.15.149:0/3683937770 conn(0x7fd3bc099a40 msgr2=0x7fd3bc0c7670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:37.915 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.908+0000 7fd3c2107700 1 -- 172.21.15.149:0/3683937770 shutdown_connections 2023-11-08T19:25:37.915 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:37.908+0000 7fd3c2107700 1 -- 172.21.15.149:0/3683937770 wait complete. 2023-11-08T19:25:37.915 INFO:teuthology.orchestra.run.smithi149.stderr:dumped all 2023-11-08T19:25:37.921 INFO:teuthology.orchestra.run.smithi149.stdout:{"pg_ready":true,"pg_map":{"version":140,"stamp":"2023-11-08T19:25:36.019097+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590950,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":163,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":121,"ondisk_log_size":121,"up":152,"acting":152,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":71,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223416,"kb_used_data":7240,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754751304,"statfs":{"total":773094113280,"available":772865335296,"internally_reserved":0,"allocated":7413760,"data_stored":4030588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.824621"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.244169+0000","last_change":"2023-11-08T19:25:32.242622+0000","last_active":"2023-11-08T19:25:32.244169+0000","last_peered":"2023-11-08T19:25:32.244169+0000","last_clean":"2023-11-08T19:25:32.244169+0000","last_became_active":"2023-11-08T19:25:32.241199+0000","last_became_peered":"2023-11-08T19:25:32.241199+0000","last_unstale":"2023-11-08T19:25:32.244169+0000","last_undegraded":"2023-11-08T19:25:32.244169+0000","last_fullsized":"2023-11-08T19:25:32.244169+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:58:53.564452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.243835+0000","last_change":"2023-11-08T19:25:32.241457+0000","last_active":"2023-11-08T19:25:32.243835+0000","last_peered":"2023-11-08T19:25:32.243835+0000","last_clean":"2023-11-08T19:25:32.243835+0000","last_became_active":"2023-11-08T19:25:32.240722+0000","last_became_peered":"2023-11-08T19:25:32.240722+0000","last_unstale":"2023-11-08T19:25:32.243835+0000","last_undegraded":"2023-11-08T19:25:32.243835+0000","last_fullsized":"2023-11-08T19:25:32.243835+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:30:42.550006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.240841+0000","last_change":"2023-11-08T19:25:32.231809+0000","last_active":"2023-11-08T19:25:32.240841+0000","last_peered":"2023-11-08T19:25:32.240841+0000","last_clean":"2023-11-08T19:25:32.240841+0000","last_became_active":"2023-11-08T19:25:32.231324+0000","last_became_peered":"2023-11-08T19:25:32.231324+0000","last_unstale":"2023-11-08T19:25:32.240841+0000","last_undegraded":"2023-11-08T19:25:32.240841+0000","last_fullsized":"2023-11-08T19:25:32.240841+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:53:01.958964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.242886+0000","last_change":"2023-11-08T19:25:32.239395+0000","last_active":"2023-11-08T19:25:32.242886+0000","last_peered":"2023-11-08T19:25:32.242886+0000","last_clean":"2023-11-08T19:25:32.242886+0000","last_became_active":"2023-11-08T19:25:32.238318+0000","last_became_peered":"2023-11-08T19:25:32.238318+0000","last_unstale":"2023-11-08T19:25:32.242886+0000","last_undegraded":"2023-11-08T19:25:32.242886+0000","last_fullsized":"2023-11-08T19:25:32.242886+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:32:09.874087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.202073+0000","last_change":"2023-11-08T19:25:30.202073+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.202073+0000","last_undegraded":"2023-11-08T19:25:30.202073+0000","last_fullsized":"2023-11-08T19:25:30.202073+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":35,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.563178+0000","last_change":"2023-11-08T19:24:32.263958+0000","last_active":"2023-11-08T19:25:27.563178+0000","last_peered":"2023-11-08T19:25:27.563178+0000","last_clean":"2023-11-08T19:25:27.563178+0000","last_became_active":"2023-11-08T19:24:31.149011+0000","last_became_peered":"2023-11-08T19:24:31.149011+0000","last_unstale":"2023-11-08T19:25:27.563178+0000","last_undegraded":"2023-11-08T19:25:27.563178+0000","last_fullsized":"2023-11-08T19:25:27.563178+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:09:04.880374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033496900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.203556+0000","last_change":"2023-11-08T19:25:30.203556+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.203556+0000","last_undegraded":"2023-11-08T19:25:30.203556+0000","last_fullsized":"2023-11-08T19:25:30.203556+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":34,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.177313+0000","last_change":"2023-11-08T19:24:32.142892+0000","last_active":"2023-11-08T19:25:27.177313+0000","last_peered":"2023-11-08T19:25:27.177313+0000","last_clean":"2023-11-08T19:25:27.177313+0000","last_became_active":"2023-11-08T19:24:31.144912+0000","last_became_peered":"2023-11-08T19:24:31.144912+0000","last_unstale":"2023-11-08T19:25:27.177313+0000","last_undegraded":"2023-11-08T19:25:27.177313+0000","last_fullsized":"2023-11-08T19:25:27.177313+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:04:21.151484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056686900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.204924+0000","last_change":"2023-11-08T19:25:30.204924+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.204924+0000","last_undegraded":"2023-11-08T19:25:30.204924+0000","last_fullsized":"2023-11-08T19:25:30.204924+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":37,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.179265+0000","last_change":"2023-11-08T19:24:32.140514+0000","last_active":"2023-11-08T19:25:27.179265+0000","last_peered":"2023-11-08T19:25:27.179265+0000","last_clean":"2023-11-08T19:25:27.179265+0000","last_became_active":"2023-11-08T19:24:31.146668+0000","last_became_peered":"2023-11-08T19:24:31.146668+0000","last_unstale":"2023-11-08T19:25:27.179265+0000","last_undegraded":"2023-11-08T19:25:27.179265+0000","last_fullsized":"2023-11-08T19:25:27.179265+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:31:24.539374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071576699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.240491+0000","last_change":"2023-11-08T19:25:32.231355+0000","last_active":"2023-11-08T19:25:32.240491+0000","last_peered":"2023-11-08T19:25:32.240491+0000","last_clean":"2023-11-08T19:25:32.240491+0000","last_became_active":"2023-11-08T19:25:32.231063+0000","last_became_peered":"2023-11-08T19:25:32.231063+0000","last_unstale":"2023-11-08T19:25:32.240491+0000","last_undegraded":"2023-11-08T19:25:32.240491+0000","last_fullsized":"2023-11-08T19:25:32.240491+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:45:36.557467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.197733+0000","last_change":"2023-11-08T19:25:30.197733+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.197733+0000","last_undegraded":"2023-11-08T19:25:30.197733+0000","last_fullsized":"2023-11-08T19:25:30.197733+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":35,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.563202+0000","last_change":"2023-11-08T19:24:32.263963+0000","last_active":"2023-11-08T19:25:27.563202+0000","last_peered":"2023-11-08T19:25:27.563202+0000","last_clean":"2023-11-08T19:25:27.563202+0000","last_became_active":"2023-11-08T19:24:31.139062+0000","last_became_peered":"2023-11-08T19:24:31.139062+0000","last_unstale":"2023-11-08T19:25:27.563202+0000","last_undegraded":"2023-11-08T19:25:27.563202+0000","last_fullsized":"2023-11-08T19:25:27.563202+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:26.080042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033682599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.197639+0000","last_change":"2023-11-08T19:25:30.197639+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.197639+0000","last_undegraded":"2023-11-08T19:25:30.197639+0000","last_fullsized":"2023-11-08T19:25:30.197639+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":37,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.179119+0000","last_change":"2023-11-08T19:24:32.141131+0000","last_active":"2023-11-08T19:25:27.179119+0000","last_peered":"2023-11-08T19:25:27.179119+0000","last_clean":"2023-11-08T19:25:27.179119+0000","last_became_active":"2023-11-08T19:24:31.146154+0000","last_became_peered":"2023-11-08T19:24:31.146154+0000","last_unstale":"2023-11-08T19:25:27.179119+0000","last_undegraded":"2023-11-08T19:25:27.179119+0000","last_fullsized":"2023-11-08T19:25:27.179119+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:18:40.271560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082432800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.205515+0000","last_change":"2023-11-08T19:25:30.205515+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.205515+0000","last_undegraded":"2023-11-08T19:25:30.205515+0000","last_fullsized":"2023-11-08T19:25:30.205515+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":33,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.562932+0000","last_change":"2023-11-08T19:24:32.529486+0000","last_active":"2023-11-08T19:25:27.562932+0000","last_peered":"2023-11-08T19:25:27.562932+0000","last_clean":"2023-11-08T19:25:27.562932+0000","last_became_active":"2023-11-08T19:24:31.146260+0000","last_became_peered":"2023-11-08T19:24:31.146260+0000","last_unstale":"2023-11-08T19:25:27.562932+0000","last_undegraded":"2023-11-08T19:25:27.562932+0000","last_fullsized":"2023-11-08T19:25:27.562932+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:45:34.425432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059842900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.244147+0000","last_change":"2023-11-08T19:25:32.242459+0000","last_active":"2023-11-08T19:25:32.244147+0000","last_peered":"2023-11-08T19:25:32.244147+0000","last_clean":"2023-11-08T19:25:32.244147+0000","last_became_active":"2023-11-08T19:25:32.240909+0000","last_became_peered":"2023-11-08T19:25:32.240909+0000","last_unstale":"2023-11-08T19:25:32.244147+0000","last_undegraded":"2023-11-08T19:25:32.244147+0000","last_fullsized":"2023-11-08T19:25:32.244147+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:38:24.832373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.204873+0000","last_change":"2023-11-08T19:25:30.204873+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.204873+0000","last_undegraded":"2023-11-08T19:25:30.204873+0000","last_fullsized":"2023-11-08T19:25:30.204873+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":33,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.562995+0000","last_change":"2023-11-08T19:24:32.530168+0000","last_active":"2023-11-08T19:25:27.562995+0000","last_peered":"2023-11-08T19:25:27.562995+0000","last_clean":"2023-11-08T19:25:27.562995+0000","last_became_active":"2023-11-08T19:24:31.144329+0000","last_became_peered":"2023-11-08T19:24:31.144329+0000","last_unstale":"2023-11-08T19:25:27.562995+0000","last_undegraded":"2023-11-08T19:25:27.562995+0000","last_fullsized":"2023-11-08T19:25:27.562995+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:05:36.085920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043484799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.202320+0000","last_change":"2023-11-08T19:25:30.202320+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.202320+0000","last_undegraded":"2023-11-08T19:25:30.202320+0000","last_fullsized":"2023-11-08T19:25:30.202320+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":38,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.177613+0000","last_change":"2023-11-08T19:24:32.141190+0000","last_active":"2023-11-08T19:25:27.177613+0000","last_peered":"2023-11-08T19:25:27.177613+0000","last_clean":"2023-11-08T19:25:27.177613+0000","last_became_active":"2023-11-08T19:24:31.147651+0000","last_became_peered":"2023-11-08T19:24:31.147651+0000","last_unstale":"2023-11-08T19:25:27.177613+0000","last_undegraded":"2023-11-08T19:25:27.177613+0000","last_fullsized":"2023-11-08T19:25:27.177613+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:21:55.985548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043673300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.199231+0000","last_change":"2023-11-08T19:25:30.199231+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.199231+0000","last_undegraded":"2023-11-08T19:25:30.199231+0000","last_fullsized":"2023-11-08T19:25:30.199231+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":36,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-08T19:25:31.219135+0000","last_change":"2023-11-08T19:24:32.147011+0000","last_active":"2023-11-08T19:25:31.219135+0000","last_peered":"2023-11-08T19:25:31.219135+0000","last_clean":"2023-11-08T19:25:31.219135+0000","last_became_active":"2023-11-08T19:24:31.148250+0000","last_became_peered":"2023-11-08T19:24:31.148250+0000","last_unstale":"2023-11-08T19:25:31.219135+0000","last_undegraded":"2023-11-08T19:25:31.219135+0000","last_fullsized":"2023-11-08T19:25:31.219135+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:01:25.647952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043061299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.197833+0000","last_change":"2023-11-08T19:25:30.197833+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.197833+0000","last_undegraded":"2023-11-08T19:25:30.197833+0000","last_fullsized":"2023-11-08T19:25:30.197833+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":34,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.563469+0000","last_change":"2023-11-08T19:24:32.543880+0000","last_active":"2023-11-08T19:25:27.563469+0000","last_peered":"2023-11-08T19:25:27.563469+0000","last_clean":"2023-11-08T19:25:27.563469+0000","last_became_active":"2023-11-08T19:24:31.142052+0000","last_became_peered":"2023-11-08T19:24:31.142052+0000","last_unstale":"2023-11-08T19:25:27.563469+0000","last_undegraded":"2023-11-08T19:25:27.563469+0000","last_fullsized":"2023-11-08T19:25:27.563469+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:18:42.371676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014881058000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.205764+0000","last_change":"2023-11-08T19:25:30.205764+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.205764+0000","last_undegraded":"2023-11-08T19:25:30.205764+0000","last_fullsized":"2023-11-08T19:25:30.205764+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":36,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-08T19:25:31.220157+0000","last_change":"2023-11-08T19:24:32.147235+0000","last_active":"2023-11-08T19:25:31.220157+0000","last_peered":"2023-11-08T19:25:31.220157+0000","last_clean":"2023-11-08T19:25:31.220157+0000","last_became_active":"2023-11-08T19:24:31.146176+0000","last_became_peered":"2023-11-08T19:24:31.146176+0000","last_unstale":"2023-11-08T19:25:31.220157+0000","last_undegraded":"2023-11-08T19:25:31.220157+0000","last_fullsized":"2023-11-08T19:25:31.220157+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:39.214888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048481000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.205527+0000","last_change":"2023-11-08T19:25:30.205527+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.205527+0000","last_undegraded":"2023-11-08T19:25:30.205527+0000","last_fullsized":"2023-11-08T19:25:30.205527+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":38,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.177637+0000","last_change":"2023-11-08T19:24:32.142376+0000","last_active":"2023-11-08T19:25:27.177637+0000","last_peered":"2023-11-08T19:25:27.177637+0000","last_clean":"2023-11-08T19:25:27.177637+0000","last_became_active":"2023-11-08T19:24:31.144614+0000","last_became_peered":"2023-11-08T19:24:31.144614+0000","last_unstale":"2023-11-08T19:25:27.177637+0000","last_undegraded":"2023-11-08T19:25:27.177637+0000","last_fullsized":"2023-11-08T19:25:27.177637+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:09:04.880374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050362200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.243857+0000","last_change":"2023-11-08T19:25:32.241615+0000","last_active":"2023-11-08T19:25:32.243857+0000","last_peered":"2023-11-08T19:25:32.243857+0000","last_clean":"2023-11-08T19:25:32.243857+0000","last_became_active":"2023-11-08T19:25:32.240989+0000","last_became_peered":"2023-11-08T19:25:32.240989+0000","last_unstale":"2023-11-08T19:25:32.243857+0000","last_undegraded":"2023-11-08T19:25:32.243857+0000","last_fullsized":"2023-11-08T19:25:32.243857+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:34:02.775077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.204319+0000","last_change":"2023-11-08T19:25:30.204319+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.204319+0000","last_undegraded":"2023-11-08T19:25:30.204319+0000","last_fullsized":"2023-11-08T19:25:30.204319+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":36,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-08T19:25:31.218923+0000","last_change":"2023-11-08T19:24:32.146639+0000","last_active":"2023-11-08T19:25:31.218923+0000","last_peered":"2023-11-08T19:25:31.218923+0000","last_clean":"2023-11-08T19:25:31.218923+0000","last_became_active":"2023-11-08T19:24:31.147384+0000","last_became_peered":"2023-11-08T19:24:31.147384+0000","last_unstale":"2023-11-08T19:25:31.218923+0000","last_undegraded":"2023-11-08T19:25:31.218923+0000","last_fullsized":"2023-11-08T19:25:31.218923+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:30:21.946303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043834899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.201615+0000","last_change":"2023-11-08T19:25:30.201615+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.201615+0000","last_undegraded":"2023-11-08T19:25:30.201615+0000","last_fullsized":"2023-11-08T19:25:30.201615+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":34,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.562977+0000","last_change":"2023-11-08T19:24:32.544108+0000","last_active":"2023-11-08T19:25:27.562977+0000","last_peered":"2023-11-08T19:25:27.562977+0000","last_clean":"2023-11-08T19:25:27.562977+0000","last_became_active":"2023-11-08T19:24:31.143812+0000","last_became_peered":"2023-11-08T19:24:31.143812+0000","last_unstale":"2023-11-08T19:25:27.562977+0000","last_undegraded":"2023-11-08T19:25:27.562977+0000","last_fullsized":"2023-11-08T19:25:27.562977+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:27:59.135977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014956126,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.201034+0000","last_change":"2023-11-08T19:25:30.201034+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.201034+0000","last_undegraded":"2023-11-08T19:25:30.201034+0000","last_fullsized":"2023-11-08T19:25:30.201034+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":33,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.563053+0000","last_change":"2023-11-08T19:24:32.530378+0000","last_active":"2023-11-08T19:25:27.563053+0000","last_peered":"2023-11-08T19:25:27.563053+0000","last_clean":"2023-11-08T19:25:27.563053+0000","last_became_active":"2023-11-08T19:24:31.144341+0000","last_became_peered":"2023-11-08T19:24:31.144341+0000","last_unstale":"2023-11-08T19:25:27.563053+0000","last_undegraded":"2023-11-08T19:25:27.563053+0000","last_fullsized":"2023-11-08T19:25:27.563053+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:30:21.946303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058308299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.243743+0000","last_change":"2023-11-08T19:25:32.241021+0000","last_active":"2023-11-08T19:25:32.243743+0000","last_peered":"2023-11-08T19:25:32.243743+0000","last_clean":"2023-11-08T19:25:32.243743+0000","last_became_active":"2023-11-08T19:25:32.240682+0000","last_became_peered":"2023-11-08T19:25:32.240682+0000","last_unstale":"2023-11-08T19:25:32.243743+0000","last_undegraded":"2023-11-08T19:25:32.243743+0000","last_fullsized":"2023-11-08T19:25:32.243743+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:32:32.171974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"66'4","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.243327+0000","last_change":"2023-11-08T19:25:31.233739+0000","last_active":"2023-11-08T19:25:32.243327+0000","last_peered":"2023-11-08T19:25:32.243327+0000","last_clean":"2023-11-08T19:25:32.243327+0000","last_became_active":"2023-11-08T19:25:31.233443+0000","last_became_peered":"2023-11-08T19:25:31.233443+0000","last_unstale":"2023-11-08T19:25:32.243327+0000","last_undegraded":"2023-11-08T19:25:32.243327+0000","last_fullsized":"2023-11-08T19:25:32.243327+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:50:34.453347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":37,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.179190+0000","last_change":"2023-11-08T19:24:32.140832+0000","last_active":"2023-11-08T19:25:27.179190+0000","last_peered":"2023-11-08T19:25:27.179190+0000","last_clean":"2023-11-08T19:25:27.179190+0000","last_became_active":"2023-11-08T19:24:31.146557+0000","last_became_peered":"2023-11-08T19:24:31.146557+0000","last_unstale":"2023-11-08T19:25:27.179190+0000","last_undegraded":"2023-11-08T19:25:27.179190+0000","last_fullsized":"2023-11-08T19:25:27.179190+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:40:04.258107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099450100000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.204036+0000","last_change":"2023-11-08T19:25:30.204036+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.204036+0000","last_undegraded":"2023-11-08T19:25:30.204036+0000","last_fullsized":"2023-11-08T19:25:30.204036+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":37,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.179205+0000","last_change":"2023-11-08T19:24:32.141188+0000","last_active":"2023-11-08T19:25:27.179205+0000","last_peered":"2023-11-08T19:25:27.179205+0000","last_clean":"2023-11-08T19:25:27.179205+0000","last_became_active":"2023-11-08T19:24:31.148857+0000","last_became_peered":"2023-11-08T19:24:31.148857+0000","last_unstale":"2023-11-08T19:25:27.179205+0000","last_undegraded":"2023-11-08T19:25:27.179205+0000","last_fullsized":"2023-11-08T19:25:27.179205+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:45:34.425432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065078599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.201855+0000","last_change":"2023-11-08T19:25:30.201855+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.201855+0000","last_undegraded":"2023-11-08T19:25:30.201855+0000","last_fullsized":"2023-11-08T19:25:30.201855+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":37,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.179206+0000","last_change":"2023-11-08T19:24:32.140167+0000","last_active":"2023-11-08T19:25:27.179206+0000","last_peered":"2023-11-08T19:25:27.179206+0000","last_clean":"2023-11-08T19:25:27.179206+0000","last_became_active":"2023-11-08T19:24:31.147181+0000","last_became_peered":"2023-11-08T19:24:31.147181+0000","last_unstale":"2023-11-08T19:25:27.179206+0000","last_undegraded":"2023-11-08T19:25:27.179206+0000","last_fullsized":"2023-11-08T19:25:27.179206+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:26.080042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057135200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.197604+0000","last_change":"2023-11-08T19:25:30.197604+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.197604+0000","last_undegraded":"2023-11-08T19:25:30.197604+0000","last_fullsized":"2023-11-08T19:25:30.197604+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":33,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.563345+0000","last_change":"2023-11-08T19:24:32.530895+0000","last_active":"2023-11-08T19:25:27.563345+0000","last_peered":"2023-11-08T19:25:27.563345+0000","last_clean":"2023-11-08T19:25:27.563345+0000","last_became_active":"2023-11-08T19:24:31.146715+0000","last_became_peered":"2023-11-08T19:24:31.146715+0000","last_unstale":"2023-11-08T19:25:27.563345+0000","last_undegraded":"2023-11-08T19:25:27.563345+0000","last_fullsized":"2023-11-08T19:25:27.563345+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:39.214888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081671599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.199269+0000","last_change":"2023-11-08T19:25:30.199269+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.199269+0000","last_undegraded":"2023-11-08T19:25:30.199269+0000","last_fullsized":"2023-11-08T19:25:30.199269+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":34,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.562867+0000","last_change":"2023-11-08T19:24:32.333430+0000","last_active":"2023-11-08T19:25:27.562867+0000","last_peered":"2023-11-08T19:25:27.562867+0000","last_clean":"2023-11-08T19:25:27.562867+0000","last_became_active":"2023-11-08T19:24:31.141710+0000","last_became_peered":"2023-11-08T19:24:31.141710+0000","last_unstale":"2023-11-08T19:25:27.562867+0000","last_undegraded":"2023-11-08T19:25:27.562867+0000","last_fullsized":"2023-11-08T19:25:27.562867+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:32:51.214551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000430438,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.243873+0000","last_change":"2023-11-08T19:25:32.241953+0000","last_active":"2023-11-08T19:25:32.243873+0000","last_peered":"2023-11-08T19:25:32.243873+0000","last_clean":"2023-11-08T19:25:32.243873+0000","last_became_active":"2023-11-08T19:25:32.241304+0000","last_became_peered":"2023-11-08T19:25:32.241304+0000","last_unstale":"2023-11-08T19:25:32.243873+0000","last_undegraded":"2023-11-08T19:25:32.243873+0000","last_fullsized":"2023-11-08T19:25:32.243873+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:12:10.425204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.201020+0000","last_change":"2023-11-08T19:25:30.201020+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.201020+0000","last_undegraded":"2023-11-08T19:25:30.201020+0000","last_fullsized":"2023-11-08T19:25:30.201020+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":33,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.562907+0000","last_change":"2023-11-08T19:24:32.530333+0000","last_active":"2023-11-08T19:25:27.562907+0000","last_peered":"2023-11-08T19:25:27.562907+0000","last_clean":"2023-11-08T19:25:27.562907+0000","last_became_active":"2023-11-08T19:24:31.144838+0000","last_became_peered":"2023-11-08T19:24:31.144838+0000","last_unstale":"2023-11-08T19:25:27.562907+0000","last_undegraded":"2023-11-08T19:25:27.562907+0000","last_fullsized":"2023-11-08T19:25:27.562907+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:39:48.473183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081588799999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.242599+0000","last_change":"2023-11-08T19:25:32.240888+0000","last_active":"2023-11-08T19:25:32.242599+0000","last_peered":"2023-11-08T19:25:32.242599+0000","last_clean":"2023-11-08T19:25:32.242599+0000","last_became_active":"2023-11-08T19:25:32.240537+0000","last_became_peered":"2023-11-08T19:25:32.240537+0000","last_unstale":"2023-11-08T19:25:32.242599+0000","last_undegraded":"2023-11-08T19:25:32.242599+0000","last_fullsized":"2023-11-08T19:25:32.242599+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:19:39.469446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.199253+0000","last_change":"2023-11-08T19:25:30.199253+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.199253+0000","last_undegraded":"2023-11-08T19:25:30.199253+0000","last_fullsized":"2023-11-08T19:25:30.199253+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":34,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.563039+0000","last_change":"2023-11-08T19:24:32.333096+0000","last_active":"2023-11-08T19:25:27.563039+0000","last_peered":"2023-11-08T19:25:27.563039+0000","last_clean":"2023-11-08T19:25:27.563039+0000","last_became_active":"2023-11-08T19:24:31.142985+0000","last_became_peered":"2023-11-08T19:24:31.142985+0000","last_unstale":"2023-11-08T19:25:27.563039+0000","last_undegraded":"2023-11-08T19:25:27.563039+0000","last_fullsized":"2023-11-08T19:25:27.563039+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:36:33.274496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000386048,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.203005+0000","last_change":"2023-11-08T19:25:30.203005+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.203005+0000","last_undegraded":"2023-11-08T19:25:30.203005+0000","last_fullsized":"2023-11-08T19:25:30.203005+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":35,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.562843+0000","last_change":"2023-11-08T19:24:32.263810+0000","last_active":"2023-11-08T19:25:27.562843+0000","last_peered":"2023-11-08T19:25:27.562843+0000","last_clean":"2023-11-08T19:25:27.562843+0000","last_became_active":"2023-11-08T19:24:31.138814+0000","last_became_peered":"2023-11-08T19:24:31.138814+0000","last_unstale":"2023-11-08T19:25:27.562843+0000","last_undegraded":"2023-11-08T19:25:27.562843+0000","last_fullsized":"2023-11-08T19:25:27.562843+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:21:55.985548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048136000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.204341+0000","last_change":"2023-11-08T19:25:30.204341+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.204341+0000","last_undegraded":"2023-11-08T19:25:30.204341+0000","last_fullsized":"2023-11-08T19:25:30.204341+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":34,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.562997+0000","last_change":"2023-11-08T19:24:32.544063+0000","last_active":"2023-11-08T19:25:27.562997+0000","last_peered":"2023-11-08T19:25:27.562997+0000","last_clean":"2023-11-08T19:25:27.562997+0000","last_became_active":"2023-11-08T19:24:31.144795+0000","last_became_peered":"2023-11-08T19:24:31.144795+0000","last_unstale":"2023-11-08T19:25:27.562997+0000","last_undegraded":"2023-11-08T19:25:27.562997+0000","last_fullsized":"2023-11-08T19:25:27.562997+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:12:42.248307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01495431,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.200988+0000","last_change":"2023-11-08T19:25:30.200988+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.200988+0000","last_undegraded":"2023-11-08T19:25:30.200988+0000","last_fullsized":"2023-11-08T19:25:30.200988+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":36,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-08T19:25:31.219062+0000","last_change":"2023-11-08T19:24:32.147025+0000","last_active":"2023-11-08T19:25:31.219062+0000","last_peered":"2023-11-08T19:25:31.219062+0000","last_clean":"2023-11-08T19:25:31.219062+0000","last_became_active":"2023-11-08T19:24:31.147082+0000","last_became_peered":"2023-11-08T19:24:31.147082+0000","last_unstale":"2023-11-08T19:25:31.219062+0000","last_undegraded":"2023-11-08T19:25:31.219062+0000","last_fullsized":"2023-11-08T19:25:31.219062+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:02:27.987795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043701599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.203020+0000","last_change":"2023-11-08T19:25:30.203020+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.203020+0000","last_undegraded":"2023-11-08T19:25:30.203020+0000","last_fullsized":"2023-11-08T19:25:30.203020+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":33,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.562971+0000","last_change":"2023-11-08T19:24:32.530620+0000","last_active":"2023-11-08T19:25:27.562971+0000","last_peered":"2023-11-08T19:25:27.562971+0000","last_clean":"2023-11-08T19:25:27.562971+0000","last_became_active":"2023-11-08T19:24:31.144223+0000","last_became_peered":"2023-11-08T19:24:31.144223+0000","last_unstale":"2023-11-08T19:25:27.562971+0000","last_undegraded":"2023-11-08T19:25:27.562971+0000","last_fullsized":"2023-11-08T19:25:27.562971+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:01:25.647952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071879799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.204059+0000","last_change":"2023-11-08T19:25:30.204059+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.204059+0000","last_undegraded":"2023-11-08T19:25:30.204059+0000","last_fullsized":"2023-11-08T19:25:30.204059+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":37,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.179267+0000","last_change":"2023-11-08T19:24:32.140880+0000","last_active":"2023-11-08T19:25:27.179267+0000","last_peered":"2023-11-08T19:25:27.179267+0000","last_clean":"2023-11-08T19:25:27.179267+0000","last_became_active":"2023-11-08T19:24:31.146063+0000","last_became_peered":"2023-11-08T19:24:31.146063+0000","last_unstale":"2023-11-08T19:25:27.179267+0000","last_undegraded":"2023-11-08T19:25:27.179267+0000","last_fullsized":"2023-11-08T19:25:27.179267+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:54:08.985813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089896300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.225054+0000","last_change":"2023-11-08T19:25:31.224949+0000","last_active":"2023-11-08T19:25:32.225054+0000","last_peered":"2023-11-08T19:25:32.225054+0000","last_clean":"2023-11-08T19:25:32.225054+0000","last_became_active":"2023-11-08T19:25:31.224687+0000","last_became_peered":"2023-11-08T19:25:31.224687+0000","last_unstale":"2023-11-08T19:25:32.225054+0000","last_undegraded":"2023-11-08T19:25:32.225054+0000","last_fullsized":"2023-11-08T19:25:32.225054+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:15:07.118614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":38,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.177607+0000","last_change":"2023-11-08T19:24:32.139885+0000","last_active":"2023-11-08T19:25:27.177607+0000","last_peered":"2023-11-08T19:25:27.177607+0000","last_clean":"2023-11-08T19:25:27.177607+0000","last_became_active":"2023-11-08T19:24:31.145329+0000","last_became_peered":"2023-11-08T19:24:31.145329+0000","last_unstale":"2023-11-08T19:25:27.177607+0000","last_undegraded":"2023-11-08T19:25:27.177607+0000","last_fullsized":"2023-11-08T19:25:27.177607+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:25:18.356784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049012999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.204372+0000","last_change":"2023-11-08T19:25:30.204372+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.204372+0000","last_undegraded":"2023-11-08T19:25:30.204372+0000","last_fullsized":"2023-11-08T19:25:30.204372+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":34,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.177264+0000","last_change":"2023-11-08T19:24:32.142836+0000","last_active":"2023-11-08T19:25:27.177264+0000","last_peered":"2023-11-08T19:25:27.177264+0000","last_clean":"2023-11-08T19:25:27.177264+0000","last_became_active":"2023-11-08T19:24:31.141367+0000","last_became_peered":"2023-11-08T19:24:31.141367+0000","last_unstale":"2023-11-08T19:25:27.177264+0000","last_undegraded":"2023-11-08T19:25:27.177264+0000","last_fullsized":"2023-11-08T19:25:27.177264+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:39.214888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001335136,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.244187+0000","last_change":"2023-11-08T19:25:32.243168+0000","last_active":"2023-11-08T19:25:32.244187+0000","last_peered":"2023-11-08T19:25:32.244187+0000","last_clean":"2023-11-08T19:25:32.244187+0000","last_became_active":"2023-11-08T19:25:32.242923+0000","last_became_peered":"2023-11-08T19:25:32.242923+0000","last_unstale":"2023-11-08T19:25:32.244187+0000","last_undegraded":"2023-11-08T19:25:32.244187+0000","last_fullsized":"2023-11-08T19:25:32.244187+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:09:29.604127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.201640+0000","last_change":"2023-11-08T19:25:30.201640+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.201640+0000","last_undegraded":"2023-11-08T19:25:30.201640+0000","last_fullsized":"2023-11-08T19:25:30.201640+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":34,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.563450+0000","last_change":"2023-11-08T19:24:32.544285+0000","last_active":"2023-11-08T19:25:27.563450+0000","last_peered":"2023-11-08T19:25:27.563450+0000","last_clean":"2023-11-08T19:25:27.563450+0000","last_became_active":"2023-11-08T19:24:31.142028+0000","last_became_peered":"2023-11-08T19:24:31.142028+0000","last_unstale":"2023-11-08T19:25:27.563450+0000","last_undegraded":"2023-11-08T19:25:27.563450+0000","last_fullsized":"2023-11-08T19:25:27.563450+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:01:24.198196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067537399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.205611+0000","last_change":"2023-11-08T19:25:30.205611+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.205611+0000","last_undegraded":"2023-11-08T19:25:30.205611+0000","last_fullsized":"2023-11-08T19:25:30.205611+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":34,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.563432+0000","last_change":"2023-11-08T19:24:32.544333+0000","last_active":"2023-11-08T19:25:27.563432+0000","last_peered":"2023-11-08T19:25:27.563432+0000","last_clean":"2023-11-08T19:25:27.563432+0000","last_became_active":"2023-11-08T19:24:31.138598+0000","last_became_peered":"2023-11-08T19:24:31.138598+0000","last_unstale":"2023-11-08T19:25:27.563432+0000","last_undegraded":"2023-11-08T19:25:27.563432+0000","last_fullsized":"2023-11-08T19:25:27.563432+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:11.860580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015114824000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:25:31.194359+0000","last_change":"2023-11-08T19:25:31.194359+0000","last_active":"2023-11-08T19:25:31.194359+0000","last_peered":"2023-11-08T19:25:31.194359+0000","last_clean":"2023-11-08T19:25:31.194359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:31.194359+0000","last_undegraded":"2023-11-08T19:25:31.194359+0000","last_fullsized":"2023-11-08T19:25:31.194359+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2023-11-08T19:25:30.204838+0000","last_change":"2023-11-08T19:25:30.204838+0000","last_active":"2023-11-08T19:25:30.188791+0000","last_peered":"2023-11-08T19:25:30.188791+0000","last_clean":"2023-11-08T19:25:30.188791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:25:30.204838+0000","last_undegraded":"2023-11-08T19:25:30.204838+0000","last_fullsized":"2023-11-08T19:25:30.204838+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":33,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-08T19:25:27.563239+0000","last_change":"2023-11-08T19:24:32.530665+0000","last_active":"2023-11-08T19:25:27.563239+0000","last_peered":"2023-11-08T19:25:27.563239+0000","last_clean":"2023-11-08T19:25:27.563239+0000","last_became_active":"2023-11-08T19:24:31.148363+0000","last_became_peered":"2023-11-08T19:24:31.148363+0000","last_unstale":"2023-11-08T19:25:27.563239+0000","last_undegraded":"2023-11-08T19:25:27.563239+0000","last_fullsized":"2023-11-08T19:25:27.563239+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:02:27.987795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075444200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":204,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-08T19:25:31.215764+0000","last_change":"2023-11-08T19:22:58.054283+0000","last_active":"2023-11-08T19:25:31.215764+0000","last_peered":"2023-11-08T19:25:31.215764+0000","last_clean":"2023-11-08T19:25:31.215764+0000","last_became_active":"2023-11-08T19:22:58.053337+0000","last_became_peered":"2023-11-08T19:22:58.053337+0000","last_unstale":"2023-11-08T19:25:31.215764+0000","last_undegraded":"2023-11-08T19:25:31.215764+0000","last_fullsized":"2023-11-08T19:25:31.215764+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:22:56.479654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:22:56.479654+0000","last_clean_scrub_stamp":"2023-11-08T19:22:56.479654+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:16:05.317001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":22,"acting":22,"num_store_stats":1},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574884,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28392,"kb_used_data":1368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343448,"statfs":{"total":96636764160,"available":96607690752,"internally_reserved":0,"allocated":1400832,"data_stored":959735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.54500000000000004,"15min":0.53500000000000003},"min":{"1min":0.47599999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56499999999999995,"15min":0.56299999999999994},"min":{"1min":0.39100000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.748,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.48799999999999999}]},{"osd":1,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.54400000000000004,"15min":0.54600000000000004},"min":{"1min":0.37,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.70599999999999996,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53100000000000003,"15min":0.52900000000000003},"min":{"1min":0.39200000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.72699999999999998,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.40600000000000003}]},{"osd":2,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.50800000000000001,"15min":0.50600000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.71099999999999997,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.53100000000000003,"15min":0.53300000000000003},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.69299999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.71099999999999997}]},{"osd":3,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.41799999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.65900000000000003,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56000000000000005,"15min":0.55600000000000005},"min":{"1min":0.437,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72199999999999998,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.76100000000000001}]},{"osd":4,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.48499999999999999,"15min":0.48199999999999998},"min":{"1min":0.33400000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.373,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.63300000000000001}]},{"osd":5,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.55100000000000005,"15min":0.54500000000000004},"min":{"1min":0.41199999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.58499999999999996,"15min":0.57899999999999996},"min":{"1min":0.438,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.67400000000000004}]},{"osd":6,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61099999999999999,"15min":0.61199999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.82299999999999995,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56699999999999995,"15min":0.56200000000000006},"min":{"1min":0.43099999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.69199999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":774144,"data_stored":354355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.59699999999999998,"15min":0.60499999999999998},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.78000000000000003,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.58499999999999996,"15min":0.59499999999999997},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.78800000000000003,"5min":1.478,"15min":1.478},"last":0.60699999999999998}]},{"osd":1,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.60499999999999998,"15min":0.60899999999999999},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.80600000000000005,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.621,"5min":0.66300000000000003,"15min":0.67000000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.81699999999999995,"5min":1.649,"15min":1.649},"last":0.72699999999999998}]},{"osd":2,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56000000000000005,"15min":0.55900000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.63,"15min":0.63500000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.75900000000000001,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.626}]},{"osd":3,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.61799999999999999,"15min":0.63400000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77000000000000002,"5min":1.766,"15min":1.766},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.61199999999999999,"15min":0.625},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.877,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":0.64000000000000001}]},{"osd":4,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.53700000000000003,"15min":0.54200000000000004},"min":{"1min":0.36399999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.64500000000000002,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.374},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.57699999999999996,"15min":0.58199999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.55500000000000005}]},{"osd":5,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.56399999999999995,"15min":0.57099999999999995},"min":{"1min":0.42599999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.63300000000000001,"15min":0.63900000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.71499999999999997,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.57499999999999996}]},{"osd":7,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.61199999999999999,"15min":0.61499999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.64400000000000002,"15min":0.64900000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.53200000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574883,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":774144,"data_stored":354355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:24:57 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.36399999999999999,"15min":0.36499999999999999},"min":{"1min":0.255,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.42699999999999999,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.40799999999999997,"15min":0.41899999999999998},"min":{"1min":0.22800000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.5,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":0.22900000000000001}]},{"osd":2,"last update":"Wed Nov 8 19:24:57 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.34499999999999997,"15min":0.34699999999999998},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.43099999999999999,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.37,"5min":0.39400000000000002,"15min":0.39800000000000002},"min":{"1min":0.26200000000000001,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.502,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.27000000000000002}]},{"osd":3,"last update":"Wed Nov 8 19:24:57 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.33500000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.69499999999999995,"5min":1.24,"15min":1.24},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.45800000000000002,"15min":0.46800000000000003},"min":{"1min":0.27600000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.503,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.33800000000000002}]},{"osd":4,"last update":"Wed Nov 8 19:24:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.61299999999999999,"15min":0.61699999999999999},"min":{"1min":0.42299999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.745,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.628},{"interface":"front","average":{"1min":0.625,"5min":0.57299999999999995,"15min":0.56499999999999995},"min":{"1min":0.502,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.56499999999999995}]},{"osd":5,"last update":"Wed Nov 8 19:24:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.56399999999999995,"15min":0.55600000000000005},"min":{"1min":0.42699999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.441,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.72299999999999998,"5min":1.115,"15min":1.115},"last":0.59899999999999998}]},{"osd":6,"last update":"Wed Nov 8 19:24:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.48999999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.84599999999999997,"5min":2.093,"15min":2.093},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.745,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.54600000000000004}]},{"osd":7,"last update":"Wed Nov 8 19:24:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.66700000000000004,"15min":0.67700000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.748,"5min":1.591,"15min":1.591},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.68700000000000006,"15min":0.69899999999999995},"min":{"1min":0.44600000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.77500000000000002,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.52900000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574883,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28360,"kb_used_data":1336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343480,"statfs":{"total":96636764160,"available":96607723520,"internally_reserved":0,"allocated":1368064,"data_stored":944723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":1.0509999999999999,"15min":1.175},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.51900000000000002,"5min":19.295999999999999,"15min":19.295999999999999},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.96999999999999997,"15min":1.0740000000000001},"min":{"1min":0.252,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.502,"5min":17.204000000000001,"15min":17.204000000000001},"last":0.36299999999999999}]},{"osd":2,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.59499999999999997,"15min":0.63500000000000001},"min":{"1min":0.28599999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.46500000000000002,"5min":6.524,"15min":6.524},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.36699999999999999,"5min":1.008,"15min":1.115},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.47799999999999998,"5min":17.175000000000001,"15min":17.175000000000001},"last":0.40899999999999997}]},{"osd":3,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.86399999999999999,"15min":0.94999999999999996},"min":{"1min":0.27600000000000002,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.48899999999999999,"5min":14.324,"15min":14.324},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.40000000000000002,"15min":0.40200000000000002},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.52100000000000002,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.433}]},{"osd":4,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":1.1599999999999999,"15min":1.256},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.76700000000000002,"5min":17.056000000000001,"15min":17.056000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.72899999999999998,"15min":0.753},"min":{"1min":0.441,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.749,"5min":5.0289999999999999,"15min":5.0289999999999999},"last":0.71999999999999997}]},{"osd":5,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.72899999999999998,"15min":0.75600000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.77300000000000002,"5min":5.0590000000000002,"15min":5.0590000000000002},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56699999999999995,"15min":0.56499999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.54500000000000004}]},{"osd":6,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.60399999999999998,"15min":0.60499999999999998},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":1.1990000000000001,"15min":1.304},"min":{"1min":0.35499999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.70099999999999996,"5min":17.111999999999998,"15min":17.111999999999998},"last":0.73399999999999999}]},{"osd":7,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":1.2170000000000001,"15min":1.319},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.77000000000000002,"5min":17.146000000000001,"15min":17.146000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.74099999999999999,"15min":0.76700000000000002},"min":{"1min":0.40899999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.83299999999999996,"5min":4.9829999999999997,"15min":4.9829999999999997},"last":0.751}]}]},{"osd":2,"up_from":13,"seq":55834574883,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":774144,"data_stored":354355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.46200000000000002,"15min":0.48499999999999999},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.48799999999999999,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.37,"5min":0.499,"15min":0.52100000000000002},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.68000000000000005,"5min":3.4369999999999998,"15min":3.4369999999999998},"last":0.379}]},{"osd":1,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.53400000000000003,"15min":0.56399999999999995},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.58299999999999996,"5min":4.0679999999999996,"15min":4.0679999999999996},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.439,"5min":0.58499999999999996,"15min":0.60899999999999999},"min":{"1min":0.29499999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.72099999999999997,"5min":4.3499999999999996,"15min":4.3499999999999996},"last":0.42099999999999999}]},{"osd":3,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.53100000000000003,"15min":0.54900000000000004},"min":{"1min":0.26600000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.75600000000000001,"5min":3.8580000000000001,"15min":3.8580000000000001},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.497,"15min":0.52300000000000002},"min":{"1min":0.27600000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.55400000000000005,"5min":3.476,"15min":3.476},"last":0.39700000000000002}]},{"osd":4,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.71099999999999997,"15min":0.72499999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.3180000000000001,"5min":4.0090000000000003,"15min":4.0090000000000003},"last":0.623},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.72699999999999998,"15min":0.747},"min":{"1min":0.46000000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.92300000000000004,"5min":4.1040000000000001,"15min":4.1040000000000001},"last":0.58199999999999996}]},{"osd":5,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.73199999999999998,"15min":0.75600000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.85399999999999998,"5min":4.0869999999999997,"15min":4.0869999999999997},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.73399999999999999,"15min":0.75800000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.73999999999999999,"5min":3.843,"15min":3.843},"last":0.56299999999999994}]},{"osd":6,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.748,"15min":0.77200000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0720000000000001,"5min":4.1399999999999997,"15min":4.1399999999999997},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.72099999999999997,"15min":0.745},"min":{"1min":0.42899999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.81100000000000005,"5min":4.0499999999999998,"15min":4.0499999999999998},"last":0.67800000000000005}]},{"osd":7,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.76600000000000001,"15min":0.78100000000000003},"min":{"1min":0.51000000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.181,"5min":4.157,"15min":4.157},"last":0.754},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.79100000000000004,"15min":0.81200000000000006},"min":{"1min":0.48099999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.222,"5min":4.1710000000000003,"15min":4.1710000000000003},"last":0.50600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574883,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":774144,"data_stored":354355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.38300000000000001,"15min":0.38600000000000001},"min":{"1min":0.24199999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.63300000000000001,"5min":1.458,"15min":1.458},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.39500000000000002,"15min":0.40000000000000002},"min":{"1min":0.29199999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.53800000000000003,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.503}]},{"osd":1,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.40799999999999997,"15min":0.41199999999999998},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.747,"5min":1.512,"15min":1.512},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.442,"15min":0.44900000000000001},"min":{"1min":0.311,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.59499999999999997,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.57099999999999995}]},{"osd":2,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.376,"15min":0.378},"min":{"1min":0.28100000000000003,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.55600000000000005,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.42799999999999999,"15min":0.42999999999999999},"min":{"1min":0.315,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.70399999999999996,"5min":1.536,"15min":1.536},"last":0.60899999999999999}]},{"osd":4,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.61299999999999999,"15min":0.621},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.72199999999999998,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.752,"5min":1.153,"15min":1.153},"last":0.65100000000000002}]},{"osd":5,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.59299999999999997,"15min":0.59199999999999997},"min":{"1min":0.42299999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.86499999999999999,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.59799999999999998,"15min":0.60599999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.77100000000000002,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.73699999999999999}]},{"osd":6,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.57799999999999996,"15min":0.58099999999999996},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.78300000000000003,"5min":1.113,"15min":1.113},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.61199999999999999,"15min":0.61399999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.82399999999999995,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.71799999999999997}]},{"osd":7,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.64400000000000002,"15min":0.65000000000000002},"min":{"1min":0.44700000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.72099999999999997,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.626,"5min":0.61799999999999999,"15min":0.61699999999999999},"min":{"1min":0.48199999999999998,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.83799999999999997,"5min":1.179,"15min":1.179},"last":0.627}]}]},{"osd":4,"up_from":13,"seq":55834574883,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":774144,"data_stored":354355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53800000000000003,"15min":0.53600000000000003},"min":{"1min":0.35699999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.68600000000000005,"5min":1.399,"15min":1.399},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.59099999999999997,"15min":0.59699999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.75700000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.68300000000000005}]},{"osd":1,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.36599999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.499,"15min":0.496},"min":{"1min":0.39700000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.505}]},{"osd":2,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.627,"15min":0.63800000000000001},"min":{"1min":0.377,"5min":0.373,"15min":0.373},"max":{"1min":0.77300000000000002,"5min":2.8490000000000002,"15min":2.8490000000000002},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.52500000000000002,"15min":0.52000000000000002},"min":{"1min":0.434,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.40799999999999997}]},{"osd":3,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.56999999999999995,"15min":0.56399999999999995},"min":{"1min":0.41199999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.71899999999999997,"15min":0.72999999999999998},"min":{"1min":0.53200000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.78500000000000003,"5min":3.4849999999999999,"15min":3.4849999999999999},"last":0.76000000000000001}]},{"osd":5,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52000000000000002,"15min":0.52100000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.68100000000000005,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56100000000000005,"15min":0.55800000000000005},"min":{"1min":0.36299999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.79100000000000004}]},{"osd":6,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.70199999999999996,"15min":0.72399999999999998},"min":{"1min":0.38,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.83199999999999996,"5min":4.1529999999999996,"15min":4.1529999999999996},"last":0.623},{"interface":"front","average":{"1min":0.621,"5min":0.61399999999999999,"15min":0.61299999999999999},"min":{"1min":0.42699999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.73999999999999999}]},{"osd":7,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57199999999999995,"15min":0.57099999999999995},"min":{"1min":0.41699999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.80500000000000005,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.83999999999999997,"15min":0.86399999999999999},"min":{"1min":0.55900000000000005,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.87,"5min":5.5359999999999996,"15min":5.5359999999999996},"last":0.83899999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574883,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":774144,"data_stored":354355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.54400000000000004,"15min":0.54900000000000004},"min":{"1min":0.32300000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.78100000000000003,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":0.432},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.52500000000000002,"15min":0.51900000000000002},"min":{"1min":0.38700000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.745,"5min":0.878,"15min":0.878},"last":0.47199999999999998}]},{"osd":1,"last update":"Wed Nov 8 19:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.54700000000000004,"15min":0.54500000000000004},"min":{"1min":0.32400000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.76300000000000001,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.60399999999999998,"15min":0.60999999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.66300000000000003,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":0.52700000000000002}]},{"osd":2,"last update":"Wed Nov 8 19:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.56000000000000005,"15min":0.55800000000000005},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.68999999999999995,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52800000000000002,"15min":0.52700000000000002},"min":{"1min":0.39400000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.66700000000000004,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.38200000000000001}]},{"osd":3,"last update":"Wed Nov 8 19:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.55700000000000005,"15min":0.55600000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71899999999999997,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57499999999999996,"15min":0.57299999999999995},"min":{"1min":0.46999999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.83699999999999997,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.45100000000000001}]},{"osd":4,"last update":"Wed Nov 8 19:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.59299999999999997,"15min":0.60499999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.80600000000000005,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.63500000000000001,"15min":0.63400000000000001},"min":{"1min":0.49299999999999999,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.81999999999999995,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.53900000000000003}]},{"osd":6,"last update":"Wed Nov 8 19:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.58599999999999997,"15min":0.57999999999999996},"min":{"1min":0.437,"5min":0.37,"15min":0.37},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.65900000000000003,"15min":0.67300000000000004},"min":{"1min":0.38400000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.754,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":0.495}]},{"osd":7,"last update":"Wed Nov 8 19:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.627,"15min":0.63},"min":{"1min":0.42399999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.77600000000000002,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.625,"5min":0.64500000000000002,"15min":0.64900000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.871,"5min":0.873,"15min":0.873},"last":0.59399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:25:38.039 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T19:25:38.041 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T19:25:40.930 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:25:41.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.058+0000 7fc9c15e4700 1 Processor -- start 2023-11-08T19:25:41.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.059+0000 7fc9c15e4700 1 -- start start 2023-11-08T19:25:41.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.059+0000 7fc9c15e4700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc9bc0cc140 0x7fc9bc0cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:41.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.059+0000 7fc9c15e4700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc9bc0b2850 0x7fc9bc0cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:41.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.059+0000 7fc9c15e4700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9bc0cce50 con 0x7fc9bc0b2cd0 2023-11-08T19:25:41.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.059+0000 7fc9c15e4700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9bc0b2430 con 0x7fc9bc0b2850 2023-11-08T19:25:41.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.059+0000 7fc9c15e4700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc0cc520 con 0x7fc9bc0cc140 2023-11-08T19:25:41.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.059+0000 7fc9ba7fc700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc9bc0b2850 0x7fc9bc0cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:41.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.059+0000 7fc9ba7fc700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc9bc0b2850 0x7fc9bc0cabf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41406/0 (socket says 172.21.15.149:41406) 2023-11-08T19:25:41.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.059+0000 7fc9ba7fc700 1 -- 172.21.15.149:0/880599309 learned_addr learned my addr 172.21.15.149:0/880599309 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:41.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.060+0000 7fc9baffd700 1 --2- 172.21.15.149:0/880599309 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc9bc0cc140 0x7fc9bc0cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:41.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.060+0000 7fc9ba7fc700 1 -- 172.21.15.149:0/880599309 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc9bc0cc140 msgr2=0x7fc9bc0cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:41.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.060+0000 7fc9ba7fc700 1 --2- 172.21.15.149:0/880599309 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc9bc0cc140 0x7fc9bc0cc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:41.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.060+0000 7fc9ba7fc700 1 -- 172.21.15.149:0/880599309 >> v1:172.21.15.160:6789/0 conn(0x7fc9bc0b2cd0 legacy=0x7fc9bc15d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:41.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.060+0000 7fc9ba7fc700 1 -- 172.21.15.149:0/880599309 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9bc0b17b0 con 0x7fc9bc0b2850 2023-11-08T19:25:41.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.060+0000 7fc9ba7fc700 1 --2- 172.21.15.149:0/880599309 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9bc0b2850 0x7fc9bc0cabf0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fc9a40098f0 tx=0x7fc9a4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a01b9ffe6af26ec server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:41.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.060+0000 7fc9b9ffb700 1 -- 172.21.15.149:0/880599309 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a4004230 con 0x7fc9bc0b2850 2023-11-08T19:25:41.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.060+0000 7fc9b9ffb700 1 -- 172.21.15.149:0/880599309 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9a4004390 con 0x7fc9bc0b2850 2023-11-08T19:25:41.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.060+0000 7fc9b9ffb700 1 -- 172.21.15.149:0/880599309 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a40036a0 con 0x7fc9bc0b2850 2023-11-08T19:25:41.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.061+0000 7fc9c15e4700 1 -- 172.21.15.149:0/880599309 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9bc0b2850 msgr2=0x7fc9bc0cabf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:41.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.061+0000 7fc9c15e4700 1 --2- 172.21.15.149:0/880599309 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9bc0b2850 0x7fc9bc0cabf0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fc9a40098f0 tx=0x7fc9a4009c00 comp rx=0 tx=0).stop 2023-11-08T19:25:41.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.061+0000 7fc9c15e4700 1 -- 172.21.15.149:0/880599309 shutdown_connections 2023-11-08T19:25:41.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.061+0000 7fc9c15e4700 1 --2- 172.21.15.149:0/880599309 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc9bc0cc140 0x7fc9bc0cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:41.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.061+0000 7fc9c15e4700 1 --2- 172.21.15.149:0/880599309 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9bc0b2850 0x7fc9bc0cabf0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:41.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.061+0000 7fc9c15e4700 1 -- 172.21.15.149:0/880599309 >> 172.21.15.149:0/880599309 conn(0x7fc9bc099a40 msgr2=0x7fc9bc0d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:41.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.061+0000 7fc9c15e4700 1 -- 172.21.15.149:0/880599309 shutdown_connections 2023-11-08T19:25:41.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.061+0000 7fc9c15e4700 1 -- 172.21.15.149:0/880599309 wait complete. 2023-11-08T19:25:41.071 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.062+0000 7fc9c15e4700 1 Processor -- start 2023-11-08T19:25:41.071 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.062+0000 7fc9c15e4700 1 -- start start 2023-11-08T19:25:41.071 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.063+0000 7fc9c15e4700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc9bc0b2850 0x7fc9bc09de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:41.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.063+0000 7fc9c15e4700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc9bc0b2cd0 0x7fc9bc09b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:41.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.063+0000 7fc9c15e4700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9bc0cc140 0x7fc9bc09b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:41.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.063+0000 7fc9c15e4700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc1f3710 con 0x7fc9bc0cc140 2023-11-08T19:25:41.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.063+0000 7fc9c15e4700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc1f39f0 con 0x7fc9bc0b2cd0 2023-11-08T19:25:41.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.063+0000 7fc9c15e4700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc1f3cd0 con 0x7fc9bc0b2850 2023-11-08T19:25:41.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.063+0000 7fc9bb7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9bc0cc140 0x7fc9bc09b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:41.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.063+0000 7fc9bb7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9bc0cc140 0x7fc9bc09b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41414/0 (socket says 172.21.15.149:41414) 2023-11-08T19:25:41.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.063+0000 7fc9bb7fe700 1 -- 172.21.15.149:0/2579845917 learned_addr learned my addr 172.21.15.149:0/2579845917 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:41.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.063+0000 7fc9ba7fc700 1 --2- 172.21.15.149:0/2579845917 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc9bc0b2cd0 0x7fc9bc09b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:41.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.063+0000 7fc9baffd700 1 --2- 172.21.15.149:0/2579845917 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc9bc0b2850 0x7fc9bc09de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:41.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.063+0000 7fc9bb7fe700 1 -- 172.21.15.149:0/2579845917 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc9bc0b2850 msgr2=0x7fc9bc09de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:41.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.063+0000 7fc9bb7fe700 1 --2- 172.21.15.149:0/2579845917 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc9bc0b2850 0x7fc9bc09de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:41.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.063+0000 7fc9bb7fe700 1 -- 172.21.15.149:0/2579845917 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc9bc0b2cd0 msgr2=0x7fc9bc09b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:41.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.063+0000 7fc9bb7fe700 1 --2- 172.21.15.149:0/2579845917 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc9bc0b2cd0 0x7fc9bc09b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:41.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.063+0000 7fc9bb7fe700 1 -- 172.21.15.149:0/2579845917 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a4009550 con 0x7fc9bc0cc140 2023-11-08T19:25:41.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.063+0000 7fc9ba7fc700 1 --2- 172.21.15.149:0/2579845917 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc9bc0b2cd0 0x7fc9bc09b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:25:41.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.063+0000 7fc9bb7fe700 1 --2- 172.21.15.149:0/2579845917 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9bc0cc140 0x7fc9bc09b8c0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fc9b400c450 tx=0x7fc9b400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:41.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.063+0000 7fc9b37fe700 1 -- 172.21.15.149:0/2579845917 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b4011790 con 0x7fc9bc0cc140 2023-11-08T19:25:41.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.063+0000 7fc9b37fe700 1 -- 172.21.15.149:0/2579845917 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b4011910 con 0x7fc9bc0cc140 2023-11-08T19:25:41.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.063+0000 7fc9c15e4700 1 -- 172.21.15.149:0/2579845917 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9bc1f3fb0 con 0x7fc9bc0cc140 2023-11-08T19:25:41.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.063+0000 7fc9b37fe700 1 -- 172.21.15.149:0/2579845917 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b4011cc0 con 0x7fc9bc0cc140 2023-11-08T19:25:41.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.064+0000 7fc9c15e4700 1 -- 172.21.15.149:0/2579845917 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9bc1604a0 con 0x7fc9bc0cc140 2023-11-08T19:25:41.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.064+0000 7fc9c15e4700 1 -- 172.21.15.149:0/2579845917 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9bc1f41f0 con 0x7fc9bc0cc140 2023-11-08T19:25:41.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.065+0000 7fc9b37fe700 1 -- 172.21.15.149:0/2579845917 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc9b401c460 con 0x7fc9bc0cc140 2023-11-08T19:25:41.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.065+0000 7fc9b37fe700 1 --2- 172.21.15.149:0/2579845917 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc99c06af00 0x7fc99c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:41.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.065+0000 7fc9b37fe700 1 -- 172.21.15.149:0/2579845917 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fc9b4089550 con 0x7fc9bc0cc140 2023-11-08T19:25:41.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.065+0000 7fc9baffd700 1 --2- 172.21.15.149:0/2579845917 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc99c06af00 0x7fc99c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:41.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.066+0000 7fc9baffd700 1 --2- 172.21.15.149:0/2579845917 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc99c06af00 0x7fc99c06d3c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac009ab0 tx=0x7fc9ac003a20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:41.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.070+0000 7fc9b37fe700 1 -- 172.21.15.149:0/2579845917 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc9b40544a0 con 0x7fc9bc0cc140 2023-11-08T19:25:41.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.257+0000 7fc9c15e4700 1 -- 172.21.15.149:0/2579845917 --> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc9bc0b1d70 con 0x7fc99c06af00 2023-11-08T19:25:41.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.267+0000 7fc9b37fe700 1 -- 172.21.15.149:0/2579845917 <== mgr.4104 v2:172.21.15.149:6832/1929837472 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+370444 (secure 0 0 0) 0x7fc9ac004530 con 0x7fc99c06af00 2023-11-08T19:25:41.272 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:25:41.276 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.271+0000 7fc9c15e4700 1 -- 172.21.15.149:0/2579845917 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc99c06af00 msgr2=0x7fc99c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:41.276 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.271+0000 7fc9c15e4700 1 --2- 172.21.15.149:0/2579845917 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc99c06af00 0x7fc99c06d3c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac009ab0 tx=0x7fc9ac003a20 comp rx=0 tx=0).stop 2023-11-08T19:25:41.276 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.271+0000 7fc9c15e4700 1 -- 172.21.15.149:0/2579845917 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9bc0cc140 msgr2=0x7fc9bc09b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:41.277 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.271+0000 7fc9c15e4700 1 --2- 172.21.15.149:0/2579845917 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9bc0cc140 0x7fc9bc09b8c0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fc9b400c450 tx=0x7fc9b400c810 comp rx=0 tx=0).stop 2023-11-08T19:25:41.277 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.271+0000 7fc9c15e4700 1 -- 172.21.15.149:0/2579845917 shutdown_connections 2023-11-08T19:25:41.277 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.271+0000 7fc9c15e4700 1 --2- 172.21.15.149:0/2579845917 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc99c06af00 0x7fc99c06d3c0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:41.277 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.271+0000 7fc9c15e4700 1 --2- 172.21.15.149:0/2579845917 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9bc0cc140 0x7fc9bc09b8c0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:41.277 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.271+0000 7fc9c15e4700 1 --2- 172.21.15.149:0/2579845917 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc9bc0b2850 0x7fc9bc09de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:41.278 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.271+0000 7fc9c15e4700 1 --2- 172.21.15.149:0/2579845917 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc9bc0b2cd0 0x7fc9bc09b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:41.278 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.271+0000 7fc9c15e4700 1 -- 172.21.15.149:0/2579845917 >> 172.21.15.149:0/2579845917 conn(0x7fc9bc099a40 msgr2=0x7fc9bc06b410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:41.278 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.271+0000 7fc9c15e4700 1 -- 172.21.15.149:0/2579845917 shutdown_connections 2023-11-08T19:25:41.279 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.271+0000 7fc9c15e4700 1 -- 172.21.15.149:0/2579845917 wait complete. 2023-11-08T19:25:41.280 INFO:teuthology.orchestra.run.smithi149.stderr:dumped all 2023-11-08T19:25:41.284 INFO:teuthology.orchestra.run.smithi149.stdout:{"pg_ready":true,"pg_map":{"version":142,"stamp":"2023-11-08T19:25:40.020129+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":258,"acting":258,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":231,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223720,"kb_used_data":7548,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754751000,"statfs":{"total":773094113280,"available":772865024000,"internally_reserved":0,"allocated":7729152,"data_stored":4184375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001856"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.244169+0000","last_change":"2023-11-08T19:25:32.242622+0000","last_active":"2023-11-08T19:25:32.244169+0000","last_peered":"2023-11-08T19:25:32.244169+0000","last_clean":"2023-11-08T19:25:32.244169+0000","last_became_active":"2023-11-08T19:25:32.241199+0000","last_became_peered":"2023-11-08T19:25:32.241199+0000","last_unstale":"2023-11-08T19:25:32.244169+0000","last_undegraded":"2023-11-08T19:25:32.244169+0000","last_fullsized":"2023-11-08T19:25:32.244169+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:58:53.564452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-08T19:25:33.219477+0000","last_change":"2023-11-08T19:25:32.228607+0000","last_active":"2023-11-08T19:25:33.219477+0000","last_peered":"2023-11-08T19:25:33.219477+0000","last_clean":"2023-11-08T19:25:33.219477+0000","last_became_active":"2023-11-08T19:25:32.227302+0000","last_became_peered":"2023-11-08T19:25:32.227302+0000","last_unstale":"2023-11-08T19:25:33.219477+0000","last_undegraded":"2023-11-08T19:25:33.219477+0000","last_fullsized":"2023-11-08T19:25:33.219477+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:32:09.874087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-08T19:25:33.217365+0000","last_change":"2023-11-08T19:25:32.228371+0000","last_active":"2023-11-08T19:25:33.217365+0000","last_peered":"2023-11-08T19:25:33.217365+0000","last_clean":"2023-11-08T19:25:33.217365+0000","last_became_active":"2023-11-08T19:25:32.228094+0000","last_became_peered":"2023-11-08T19:25:32.228094+0000","last_unstale":"2023-11-08T19:25:33.217365+0000","last_undegraded":"2023-11-08T19:25:33.217365+0000","last_fullsized":"2023-11-08T19:25:33.217365+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:53:22.418380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-08T19:25:34.567119+0000","last_change":"2023-11-08T19:25:32.222397+0000","last_active":"2023-11-08T19:25:34.567119+0000","last_peered":"2023-11-08T19:25:34.567119+0000","last_clean":"2023-11-08T19:25:34.567119+0000","last_became_active":"2023-11-08T19:25:32.222143+0000","last_became_peered":"2023-11-08T19:25:32.222143+0000","last_unstale":"2023-11-08T19:25:34.567119+0000","last_undegraded":"2023-11-08T19:25:34.567119+0000","last_fullsized":"2023-11-08T19:25:34.567119+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:24:27.848463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-08T19:25:34.534978+0000","last_change":"2023-11-08T19:25:32.225153+0000","last_active":"2023-11-08T19:25:34.534978+0000","last_peered":"2023-11-08T19:25:34.534978+0000","last_clean":"2023-11-08T19:25:34.534978+0000","last_became_active":"2023-11-08T19:25:32.224865+0000","last_became_peered":"2023-11-08T19:25:32.224865+0000","last_unstale":"2023-11-08T19:25:34.534978+0000","last_undegraded":"2023-11-08T19:25:34.534978+0000","last_fullsized":"2023-11-08T19:25:34.534978+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:46:31.079082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-08T19:25:33.219598+0000","last_change":"2023-11-08T19:25:32.222566+0000","last_active":"2023-11-08T19:25:33.219598+0000","last_peered":"2023-11-08T19:25:33.219598+0000","last_clean":"2023-11-08T19:25:33.219598+0000","last_became_active":"2023-11-08T19:25:32.222229+0000","last_became_peered":"2023-11-08T19:25:32.222229+0000","last_unstale":"2023-11-08T19:25:33.219598+0000","last_undegraded":"2023-11-08T19:25:33.219598+0000","last_fullsized":"2023-11-08T19:25:33.219598+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:19:39.469446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-08T19:25:35.255825+0000","last_change":"2023-11-08T19:25:32.226485+0000","last_active":"2023-11-08T19:25:35.255825+0000","last_peered":"2023-11-08T19:25:35.255825+0000","last_clean":"2023-11-08T19:25:35.255825+0000","last_became_active":"2023-11-08T19:25:32.226164+0000","last_became_peered":"2023-11-08T19:25:32.226164+0000","last_unstale":"2023-11-08T19:25:35.255825+0000","last_undegraded":"2023-11-08T19:25:35.255825+0000","last_fullsized":"2023-11-08T19:25:35.255825+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:50:35.458916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-08T19:25:33.219298+0000","last_change":"2023-11-08T19:25:32.221008+0000","last_active":"2023-11-08T19:25:33.219298+0000","last_peered":"2023-11-08T19:25:33.219298+0000","last_clean":"2023-11-08T19:25:33.219298+0000","last_became_active":"2023-11-08T19:25:32.220325+0000","last_became_peered":"2023-11-08T19:25:32.220325+0000","last_unstale":"2023-11-08T19:25:33.219298+0000","last_undegraded":"2023-11-08T19:25:33.219298+0000","last_fullsized":"2023-11-08T19:25:33.219298+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:53:01.958964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-08T19:25:34.535304+0000","last_change":"2023-11-08T19:25:32.230839+0000","last_active":"2023-11-08T19:25:34.535304+0000","last_peered":"2023-11-08T19:25:34.535304+0000","last_clean":"2023-11-08T19:25:34.535304+0000","last_became_active":"2023-11-08T19:25:32.230261+0000","last_became_peered":"2023-11-08T19:25:32.230261+0000","last_unstale":"2023-11-08T19:25:34.535304+0000","last_undegraded":"2023-11-08T19:25:34.535304+0000","last_fullsized":"2023-11-08T19:25:34.535304+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:27:02.493773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-08T19:25:33.219847+0000","last_change":"2023-11-08T19:25:32.231968+0000","last_active":"2023-11-08T19:25:33.219847+0000","last_peered":"2023-11-08T19:25:33.219847+0000","last_clean":"2023-11-08T19:25:33.219847+0000","last_became_active":"2023-11-08T19:25:32.224527+0000","last_became_peered":"2023-11-08T19:25:32.224527+0000","last_unstale":"2023-11-08T19:25:33.219847+0000","last_undegraded":"2023-11-08T19:25:33.219847+0000","last_fullsized":"2023-11-08T19:25:33.219847+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:12:55.618919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.243835+0000","last_change":"2023-11-08T19:25:32.241457+0000","last_active":"2023-11-08T19:25:32.243835+0000","last_peered":"2023-11-08T19:25:32.243835+0000","last_clean":"2023-11-08T19:25:32.243835+0000","last_became_active":"2023-11-08T19:25:32.240722+0000","last_became_peered":"2023-11-08T19:25:32.240722+0000","last_unstale":"2023-11-08T19:25:32.243835+0000","last_undegraded":"2023-11-08T19:25:32.243835+0000","last_fullsized":"2023-11-08T19:25:32.243835+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:30:42.550006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-08T19:25:34.567263+0000","last_change":"2023-11-08T19:25:32.224247+0000","last_active":"2023-11-08T19:25:34.567263+0000","last_peered":"2023-11-08T19:25:34.567263+0000","last_clean":"2023-11-08T19:25:34.567263+0000","last_became_active":"2023-11-08T19:25:32.223976+0000","last_became_peered":"2023-11-08T19:25:32.223976+0000","last_unstale":"2023-11-08T19:25:34.567263+0000","last_undegraded":"2023-11-08T19:25:34.567263+0000","last_fullsized":"2023-11-08T19:25:34.567263+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:25:55.848566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-08T19:25:33.829857+0000","last_change":"2023-11-08T19:25:32.217470+0000","last_active":"2023-11-08T19:25:33.829857+0000","last_peered":"2023-11-08T19:25:33.829857+0000","last_clean":"2023-11-08T19:25:33.829857+0000","last_became_active":"2023-11-08T19:25:32.217217+0000","last_became_peered":"2023-11-08T19:25:32.217217+0000","last_unstale":"2023-11-08T19:25:33.829857+0000","last_undegraded":"2023-11-08T19:25:33.829857+0000","last_fullsized":"2023-11-08T19:25:33.829857+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:13:12.221783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-08T19:25:34.534981+0000","last_change":"2023-11-08T19:25:32.223179+0000","last_active":"2023-11-08T19:25:34.534981+0000","last_peered":"2023-11-08T19:25:34.534981+0000","last_clean":"2023-11-08T19:25:34.534981+0000","last_became_active":"2023-11-08T19:25:32.222715+0000","last_became_peered":"2023-11-08T19:25:32.222715+0000","last_unstale":"2023-11-08T19:25:34.534981+0000","last_undegraded":"2023-11-08T19:25:34.534981+0000","last_fullsized":"2023-11-08T19:25:34.534981+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:32:36.439469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-08T19:25:33.829740+0000","last_change":"2023-11-08T19:25:32.215192+0000","last_active":"2023-11-08T19:25:33.829740+0000","last_peered":"2023-11-08T19:25:33.829740+0000","last_clean":"2023-11-08T19:25:33.829740+0000","last_became_active":"2023-11-08T19:25:32.214904+0000","last_became_peered":"2023-11-08T19:25:32.214904+0000","last_unstale":"2023-11-08T19:25:33.829740+0000","last_undegraded":"2023-11-08T19:25:33.829740+0000","last_fullsized":"2023-11-08T19:25:33.829740+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:12:47.567576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-08T19:25:33.218277+0000","last_change":"2023-11-08T19:25:32.222079+0000","last_active":"2023-11-08T19:25:33.218277+0000","last_peered":"2023-11-08T19:25:33.218277+0000","last_clean":"2023-11-08T19:25:33.218277+0000","last_became_active":"2023-11-08T19:25:32.221593+0000","last_became_peered":"2023-11-08T19:25:32.221593+0000","last_unstale":"2023-11-08T19:25:33.218277+0000","last_undegraded":"2023-11-08T19:25:33.218277+0000","last_fullsized":"2023-11-08T19:25:33.218277+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:04:36.957274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-08T19:25:34.535412+0000","last_change":"2023-11-08T19:25:32.230659+0000","last_active":"2023-11-08T19:25:34.535412+0000","last_peered":"2023-11-08T19:25:34.535412+0000","last_clean":"2023-11-08T19:25:34.535412+0000","last_became_active":"2023-11-08T19:25:32.229988+0000","last_became_peered":"2023-11-08T19:25:32.229988+0000","last_unstale":"2023-11-08T19:25:34.535412+0000","last_undegraded":"2023-11-08T19:25:34.535412+0000","last_fullsized":"2023-11-08T19:25:34.535412+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:47:30.991000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-08T19:25:34.567306+0000","last_change":"2023-11-08T19:25:32.221385+0000","last_active":"2023-11-08T19:25:34.567306+0000","last_peered":"2023-11-08T19:25:34.567306+0000","last_clean":"2023-11-08T19:25:34.567306+0000","last_became_active":"2023-11-08T19:25:32.221115+0000","last_became_peered":"2023-11-08T19:25:32.221115+0000","last_unstale":"2023-11-08T19:25:34.567306+0000","last_undegraded":"2023-11-08T19:25:34.567306+0000","last_fullsized":"2023-11-08T19:25:34.567306+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:06:36.981889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-08T19:25:33.219016+0000","last_change":"2023-11-08T19:25:32.220862+0000","last_active":"2023-11-08T19:25:33.219016+0000","last_peered":"2023-11-08T19:25:33.219016+0000","last_clean":"2023-11-08T19:25:33.219016+0000","last_became_active":"2023-11-08T19:25:32.220525+0000","last_became_peered":"2023-11-08T19:25:32.220525+0000","last_unstale":"2023-11-08T19:25:33.219016+0000","last_undegraded":"2023-11-08T19:25:33.219016+0000","last_fullsized":"2023-11-08T19:25:33.219016+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:28:28.334574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-08T19:25:33.829821+0000","last_change":"2023-11-08T19:25:32.221946+0000","last_active":"2023-11-08T19:25:33.829821+0000","last_peered":"2023-11-08T19:25:33.829821+0000","last_clean":"2023-11-08T19:25:33.829821+0000","last_became_active":"2023-11-08T19:25:32.221685+0000","last_became_peered":"2023-11-08T19:25:32.221685+0000","last_unstale":"2023-11-08T19:25:33.829821+0000","last_undegraded":"2023-11-08T19:25:33.829821+0000","last_fullsized":"2023-11-08T19:25:33.829821+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:42:47.943923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-08T19:25:33.218651+0000","last_change":"2023-11-08T19:25:32.222008+0000","last_active":"2023-11-08T19:25:33.218651+0000","last_peered":"2023-11-08T19:25:33.218651+0000","last_clean":"2023-11-08T19:25:33.218651+0000","last_became_active":"2023-11-08T19:25:32.221702+0000","last_became_peered":"2023-11-08T19:25:32.221702+0000","last_unstale":"2023-11-08T19:25:33.218651+0000","last_undegraded":"2023-11-08T19:25:33.218651+0000","last_fullsized":"2023-11-08T19:25:33.218651+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:55:22.228505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-08T19:25:33.218835+0000","last_change":"2023-11-08T19:25:32.234289+0000","last_active":"2023-11-08T19:25:33.218835+0000","last_peered":"2023-11-08T19:25:33.218835+0000","last_clean":"2023-11-08T19:25:33.218835+0000","last_became_active":"2023-11-08T19:25:32.231415+0000","last_became_peered":"2023-11-08T19:25:32.231415+0000","last_unstale":"2023-11-08T19:25:33.218835+0000","last_undegraded":"2023-11-08T19:25:33.218835+0000","last_fullsized":"2023-11-08T19:25:33.218835+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:05:50.373809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.240841+0000","last_change":"2023-11-08T19:25:32.231809+0000","last_active":"2023-11-08T19:25:32.240841+0000","last_peered":"2023-11-08T19:25:32.240841+0000","last_clean":"2023-11-08T19:25:32.240841+0000","last_became_active":"2023-11-08T19:25:32.231324+0000","last_became_peered":"2023-11-08T19:25:32.231324+0000","last_unstale":"2023-11-08T19:25:32.240841+0000","last_undegraded":"2023-11-08T19:25:32.240841+0000","last_fullsized":"2023-11-08T19:25:32.240841+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:53:01.958964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.242886+0000","last_change":"2023-11-08T19:25:32.239395+0000","last_active":"2023-11-08T19:25:32.242886+0000","last_peered":"2023-11-08T19:25:32.242886+0000","last_clean":"2023-11-08T19:25:32.242886+0000","last_became_active":"2023-11-08T19:25:32.238318+0000","last_became_peered":"2023-11-08T19:25:32.238318+0000","last_unstale":"2023-11-08T19:25:32.242886+0000","last_undegraded":"2023-11-08T19:25:32.242886+0000","last_fullsized":"2023-11-08T19:25:32.242886+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:32:09.874087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-08T19:25:33.219580+0000","last_change":"2023-11-08T19:25:32.239516+0000","last_active":"2023-11-08T19:25:33.219580+0000","last_peered":"2023-11-08T19:25:33.219580+0000","last_clean":"2023-11-08T19:25:33.219580+0000","last_became_active":"2023-11-08T19:25:32.239207+0000","last_became_peered":"2023-11-08T19:25:32.239207+0000","last_unstale":"2023-11-08T19:25:33.219580+0000","last_undegraded":"2023-11-08T19:25:33.219580+0000","last_fullsized":"2023-11-08T19:25:33.219580+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:40:06.963919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-08T19:25:35.256162+0000","last_change":"2023-11-08T19:25:32.226699+0000","last_active":"2023-11-08T19:25:35.256162+0000","last_peered":"2023-11-08T19:25:35.256162+0000","last_clean":"2023-11-08T19:25:35.256162+0000","last_became_active":"2023-11-08T19:25:32.226382+0000","last_became_peered":"2023-11-08T19:25:32.226382+0000","last_unstale":"2023-11-08T19:25:35.256162+0000","last_undegraded":"2023-11-08T19:25:35.256162+0000","last_fullsized":"2023-11-08T19:25:35.256162+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:42:47.943923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-08T19:25:33.217479+0000","last_change":"2023-11-08T19:25:32.228198+0000","last_active":"2023-11-08T19:25:33.217479+0000","last_peered":"2023-11-08T19:25:33.217479+0000","last_clean":"2023-11-08T19:25:33.217479+0000","last_became_active":"2023-11-08T19:25:32.226580+0000","last_became_peered":"2023-11-08T19:25:32.226580+0000","last_unstale":"2023-11-08T19:25:33.217479+0000","last_undegraded":"2023-11-08T19:25:33.217479+0000","last_fullsized":"2023-11-08T19:25:33.217479+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:33:21.434909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-08T19:25:33.219604+0000","last_change":"2023-11-08T19:25:32.232544+0000","last_active":"2023-11-08T19:25:33.219604+0000","last_peered":"2023-11-08T19:25:33.219604+0000","last_clean":"2023-11-08T19:25:33.219604+0000","last_became_active":"2023-11-08T19:25:32.230544+0000","last_became_peered":"2023-11-08T19:25:32.230544+0000","last_unstale":"2023-11-08T19:25:33.219604+0000","last_undegraded":"2023-11-08T19:25:33.219604+0000","last_fullsized":"2023-11-08T19:25:33.219604+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:07:30.783143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-08T19:25:33.217537+0000","last_change":"2023-11-08T19:25:32.225517+0000","last_active":"2023-11-08T19:25:33.217537+0000","last_peered":"2023-11-08T19:25:33.217537+0000","last_clean":"2023-11-08T19:25:33.217537+0000","last_became_active":"2023-11-08T19:25:32.225102+0000","last_became_peered":"2023-11-08T19:25:32.225102+0000","last_unstale":"2023-11-08T19:25:33.217537+0000","last_undegraded":"2023-11-08T19:25:33.217537+0000","last_fullsized":"2023-11-08T19:25:33.217537+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:26:44.788473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-08T19:25:35.255890+0000","last_change":"2023-11-08T19:25:32.223590+0000","last_active":"2023-11-08T19:25:35.255890+0000","last_peered":"2023-11-08T19:25:35.255890+0000","last_clean":"2023-11-08T19:25:35.255890+0000","last_became_active":"2023-11-08T19:25:32.223306+0000","last_became_peered":"2023-11-08T19:25:32.223306+0000","last_unstale":"2023-11-08T19:25:35.255890+0000","last_undegraded":"2023-11-08T19:25:35.255890+0000","last_fullsized":"2023-11-08T19:25:35.255890+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:43:51.289819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-08T19:25:35.255819+0000","last_change":"2023-11-08T19:25:32.225666+0000","last_active":"2023-11-08T19:25:35.255819+0000","last_peered":"2023-11-08T19:25:35.255819+0000","last_clean":"2023-11-08T19:25:35.255819+0000","last_became_active":"2023-11-08T19:25:32.225403+0000","last_became_peered":"2023-11-08T19:25:32.225403+0000","last_unstale":"2023-11-08T19:25:35.255819+0000","last_undegraded":"2023-11-08T19:25:35.255819+0000","last_fullsized":"2023-11-08T19:25:35.255819+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:12:10.425204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-08T19:25:33.219178+0000","last_change":"2023-11-08T19:25:32.226302+0000","last_active":"2023-11-08T19:25:33.219178+0000","last_peered":"2023-11-08T19:25:33.219178+0000","last_clean":"2023-11-08T19:25:33.219178+0000","last_became_active":"2023-11-08T19:25:32.225882+0000","last_became_peered":"2023-11-08T19:25:32.225882+0000","last_unstale":"2023-11-08T19:25:33.219178+0000","last_undegraded":"2023-11-08T19:25:33.219178+0000","last_fullsized":"2023-11-08T19:25:33.219178+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:45:36.557467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-08T19:25:34.534949+0000","last_change":"2023-11-08T19:25:32.229894+0000","last_active":"2023-11-08T19:25:34.534949+0000","last_peered":"2023-11-08T19:25:34.534949+0000","last_clean":"2023-11-08T19:25:34.534949+0000","last_became_active":"2023-11-08T19:25:32.229584+0000","last_became_peered":"2023-11-08T19:25:32.229584+0000","last_unstale":"2023-11-08T19:25:34.534949+0000","last_undegraded":"2023-11-08T19:25:34.534949+0000","last_fullsized":"2023-11-08T19:25:34.534949+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:10:15.929773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"66'8","reported_seq":20,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.244071+0000","last_change":"2023-11-08T19:25:31.220711+0000","last_active":"2023-11-08T19:25:32.244071+0000","last_peered":"2023-11-08T19:25:32.244071+0000","last_clean":"2023-11-08T19:25:32.244071+0000","last_became_active":"2023-11-08T19:25:31.220384+0000","last_became_peered":"2023-11-08T19:25:31.220384+0000","last_unstale":"2023-11-08T19:25:32.244071+0000","last_undegraded":"2023-11-08T19:25:32.244071+0000","last_fullsized":"2023-11-08T19:25:32.244071+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:59:51.874503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":38,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.212121+0000","last_change":"2023-11-08T19:24:32.263958+0000","last_active":"2023-11-08T19:25:32.212121+0000","last_peered":"2023-11-08T19:25:32.212121+0000","last_clean":"2023-11-08T19:25:32.212121+0000","last_became_active":"2023-11-08T19:24:31.149011+0000","last_became_peered":"2023-11-08T19:24:31.149011+0000","last_unstale":"2023-11-08T19:25:32.212121+0000","last_undegraded":"2023-11-08T19:25:32.212121+0000","last_fullsized":"2023-11-08T19:25:32.212121+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:09:04.880374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033496900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-08T19:25:33.829609+0000","last_change":"2023-11-08T19:25:32.217564+0000","last_active":"2023-11-08T19:25:33.829609+0000","last_peered":"2023-11-08T19:25:33.829609+0000","last_clean":"2023-11-08T19:25:33.829609+0000","last_became_active":"2023-11-08T19:25:32.217286+0000","last_became_peered":"2023-11-08T19:25:32.217286+0000","last_unstale":"2023-11-08T19:25:33.829609+0000","last_undegraded":"2023-11-08T19:25:33.829609+0000","last_fullsized":"2023-11-08T19:25:33.829609+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:43:51.289819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.216373+0000","last_change":"2023-11-08T19:25:31.222918+0000","last_active":"2023-11-08T19:25:32.216373+0000","last_peered":"2023-11-08T19:25:32.216373+0000","last_clean":"2023-11-08T19:25:32.216373+0000","last_became_active":"2023-11-08T19:25:31.222647+0000","last_became_peered":"2023-11-08T19:25:31.222647+0000","last_unstale":"2023-11-08T19:25:32.216373+0000","last_undegraded":"2023-11-08T19:25:32.216373+0000","last_fullsized":"2023-11-08T19:25:32.216373+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:30:41.544438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":37,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.218348+0000","last_change":"2023-11-08T19:24:32.142892+0000","last_active":"2023-11-08T19:25:32.218348+0000","last_peered":"2023-11-08T19:25:32.218348+0000","last_clean":"2023-11-08T19:25:32.218348+0000","last_became_active":"2023-11-08T19:24:31.144912+0000","last_became_peered":"2023-11-08T19:24:31.144912+0000","last_unstale":"2023-11-08T19:25:32.218348+0000","last_undegraded":"2023-11-08T19:25:32.218348+0000","last_fullsized":"2023-11-08T19:25:32.218348+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:04:21.151484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056686900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-08T19:25:35.256005+0000","last_change":"2023-11-08T19:25:32.225104+0000","last_active":"2023-11-08T19:25:35.256005+0000","last_peered":"2023-11-08T19:25:35.256005+0000","last_clean":"2023-11-08T19:25:35.256005+0000","last_became_active":"2023-11-08T19:25:32.224823+0000","last_became_peered":"2023-11-08T19:25:32.224823+0000","last_unstale":"2023-11-08T19:25:35.256005+0000","last_undegraded":"2023-11-08T19:25:35.256005+0000","last_fullsized":"2023-11-08T19:25:35.256005+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:12:47.567576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.210948+0000","last_change":"2023-11-08T19:25:31.223160+0000","last_active":"2023-11-08T19:25:32.210948+0000","last_peered":"2023-11-08T19:25:32.210948+0000","last_clean":"2023-11-08T19:25:32.210948+0000","last_became_active":"2023-11-08T19:25:31.222717+0000","last_became_peered":"2023-11-08T19:25:31.222717+0000","last_unstale":"2023-11-08T19:25:32.210948+0000","last_undegraded":"2023-11-08T19:25:32.210948+0000","last_fullsized":"2023-11-08T19:25:32.210948+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:05:49.368241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":40,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.210048+0000","last_change":"2023-11-08T19:24:32.140514+0000","last_active":"2023-11-08T19:25:32.210048+0000","last_peered":"2023-11-08T19:25:32.210048+0000","last_clean":"2023-11-08T19:25:32.210048+0000","last_became_active":"2023-11-08T19:24:31.146668+0000","last_became_peered":"2023-11-08T19:24:31.146668+0000","last_unstale":"2023-11-08T19:25:32.210048+0000","last_undegraded":"2023-11-08T19:25:32.210048+0000","last_fullsized":"2023-11-08T19:25:32.210048+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:31:24.539374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071576699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.240491+0000","last_change":"2023-11-08T19:25:32.231355+0000","last_active":"2023-11-08T19:25:32.240491+0000","last_peered":"2023-11-08T19:25:32.240491+0000","last_clean":"2023-11-08T19:25:32.240491+0000","last_became_active":"2023-11-08T19:25:32.231063+0000","last_became_peered":"2023-11-08T19:25:32.231063+0000","last_unstale":"2023-11-08T19:25:32.240491+0000","last_undegraded":"2023-11-08T19:25:32.240491+0000","last_fullsized":"2023-11-08T19:25:32.240491+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:45:36.557467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"66'2","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.241438+0000","last_change":"2023-11-08T19:25:31.222746+0000","last_active":"2023-11-08T19:25:32.241438+0000","last_peered":"2023-11-08T19:25:32.241438+0000","last_clean":"2023-11-08T19:25:32.241438+0000","last_became_active":"2023-11-08T19:25:31.222269+0000","last_became_peered":"2023-11-08T19:25:31.222269+0000","last_unstale":"2023-11-08T19:25:32.241438+0000","last_undegraded":"2023-11-08T19:25:32.241438+0000","last_fullsized":"2023-11-08T19:25:32.241438+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:20:58.843547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":38,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.210948+0000","last_change":"2023-11-08T19:24:32.263963+0000","last_active":"2023-11-08T19:25:32.210948+0000","last_peered":"2023-11-08T19:25:32.210948+0000","last_clean":"2023-11-08T19:25:32.210948+0000","last_became_active":"2023-11-08T19:24:31.139062+0000","last_became_peered":"2023-11-08T19:24:31.139062+0000","last_unstale":"2023-11-08T19:25:32.210948+0000","last_undegraded":"2023-11-08T19:25:32.210948+0000","last_fullsized":"2023-11-08T19:25:32.210948+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:26.080042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033682599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-08T19:25:34.535281+0000","last_change":"2023-11-08T19:25:32.225176+0000","last_active":"2023-11-08T19:25:34.535281+0000","last_peered":"2023-11-08T19:25:34.535281+0000","last_clean":"2023-11-08T19:25:34.535281+0000","last_became_active":"2023-11-08T19:25:32.224907+0000","last_became_peered":"2023-11-08T19:25:32.224907+0000","last_unstale":"2023-11-08T19:25:34.535281+0000","last_undegraded":"2023-11-08T19:25:34.535281+0000","last_fullsized":"2023-11-08T19:25:34.535281+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:14:45.536669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"66'6","reported_seq":18,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.238370+0000","last_change":"2023-11-08T19:25:31.224807+0000","last_active":"2023-11-08T19:25:32.238370+0000","last_peered":"2023-11-08T19:25:32.238370+0000","last_clean":"2023-11-08T19:25:32.238370+0000","last_became_active":"2023-11-08T19:25:31.224533+0000","last_became_peered":"2023-11-08T19:25:31.224533+0000","last_unstale":"2023-11-08T19:25:32.238370+0000","last_undegraded":"2023-11-08T19:25:32.238370+0000","last_fullsized":"2023-11-08T19:25:32.238370+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:59:51.874503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":40,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.211408+0000","last_change":"2023-11-08T19:24:32.141131+0000","last_active":"2023-11-08T19:25:32.211408+0000","last_peered":"2023-11-08T19:25:32.211408+0000","last_clean":"2023-11-08T19:25:32.211408+0000","last_became_active":"2023-11-08T19:24:31.146154+0000","last_became_peered":"2023-11-08T19:24:31.146154+0000","last_unstale":"2023-11-08T19:25:32.211408+0000","last_undegraded":"2023-11-08T19:25:32.211408+0000","last_fullsized":"2023-11-08T19:25:32.211408+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:18:40.271560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082432800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-08T19:25:33.219623+0000","last_change":"2023-11-08T19:25:32.222286+0000","last_active":"2023-11-08T19:25:33.219623+0000","last_peered":"2023-11-08T19:25:33.219623+0000","last_clean":"2023-11-08T19:25:33.219623+0000","last_became_active":"2023-11-08T19:25:32.221924+0000","last_became_peered":"2023-11-08T19:25:32.221924+0000","last_unstale":"2023-11-08T19:25:33.219623+0000","last_undegraded":"2023-11-08T19:25:33.219623+0000","last_fullsized":"2023-11-08T19:25:33.219623+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:30:42.550006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"66'3","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.232581+0000","last_change":"2023-11-08T19:25:31.230139+0000","last_active":"2023-11-08T19:25:32.232581+0000","last_peered":"2023-11-08T19:25:32.232581+0000","last_clean":"2023-11-08T19:25:32.232581+0000","last_became_active":"2023-11-08T19:25:31.229854+0000","last_became_peered":"2023-11-08T19:25:31.229854+0000","last_unstale":"2023-11-08T19:25:32.232581+0000","last_undegraded":"2023-11-08T19:25:32.232581+0000","last_fullsized":"2023-11-08T19:25:32.232581+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:13:56.042323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":36,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.211870+0000","last_change":"2023-11-08T19:24:32.529486+0000","last_active":"2023-11-08T19:25:32.211870+0000","last_peered":"2023-11-08T19:25:32.211870+0000","last_clean":"2023-11-08T19:25:32.211870+0000","last_became_active":"2023-11-08T19:24:31.146260+0000","last_became_peered":"2023-11-08T19:24:31.146260+0000","last_unstale":"2023-11-08T19:25:32.211870+0000","last_undegraded":"2023-11-08T19:25:32.211870+0000","last_fullsized":"2023-11-08T19:25:32.211870+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:45:34.425432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059842900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.244147+0000","last_change":"2023-11-08T19:25:32.242459+0000","last_active":"2023-11-08T19:25:32.244147+0000","last_peered":"2023-11-08T19:25:32.244147+0000","last_clean":"2023-11-08T19:25:32.244147+0000","last_became_active":"2023-11-08T19:25:32.240909+0000","last_became_peered":"2023-11-08T19:25:32.240909+0000","last_unstale":"2023-11-08T19:25:32.244147+0000","last_undegraded":"2023-11-08T19:25:32.244147+0000","last_fullsized":"2023-11-08T19:25:32.244147+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:38:24.832373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.211403+0000","last_change":"2023-11-08T19:25:31.224188+0000","last_active":"2023-11-08T19:25:32.211403+0000","last_peered":"2023-11-08T19:25:32.211403+0000","last_clean":"2023-11-08T19:25:32.211403+0000","last_became_active":"2023-11-08T19:25:31.223904+0000","last_became_peered":"2023-11-08T19:25:31.223904+0000","last_unstale":"2023-11-08T19:25:32.211403+0000","last_undegraded":"2023-11-08T19:25:32.211403+0000","last_fullsized":"2023-11-08T19:25:32.211403+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:12:54.613351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":36,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.211707+0000","last_change":"2023-11-08T19:24:32.530168+0000","last_active":"2023-11-08T19:25:32.211707+0000","last_peered":"2023-11-08T19:25:32.211707+0000","last_clean":"2023-11-08T19:25:32.211707+0000","last_became_active":"2023-11-08T19:24:31.144329+0000","last_became_peered":"2023-11-08T19:24:31.144329+0000","last_unstale":"2023-11-08T19:25:32.211707+0000","last_undegraded":"2023-11-08T19:25:32.211707+0000","last_fullsized":"2023-11-08T19:25:32.211707+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:05:36.085920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043484799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-08T19:25:35.256199+0000","last_change":"2023-11-08T19:25:32.239817+0000","last_active":"2023-11-08T19:25:35.256199+0000","last_peered":"2023-11-08T19:25:35.256199+0000","last_clean":"2023-11-08T19:25:35.256199+0000","last_became_active":"2023-11-08T19:25:32.239348+0000","last_became_peered":"2023-11-08T19:25:32.239348+0000","last_unstale":"2023-11-08T19:25:35.256199+0000","last_undegraded":"2023-11-08T19:25:35.256199+0000","last_fullsized":"2023-11-08T19:25:35.256199+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:13:12.221783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.217902+0000","last_change":"2023-11-08T19:25:31.230889+0000","last_active":"2023-11-08T19:25:32.217902+0000","last_peered":"2023-11-08T19:25:32.217902+0000","last_clean":"2023-11-08T19:25:32.217902+0000","last_became_active":"2023-11-08T19:25:31.230626+0000","last_became_peered":"2023-11-08T19:25:31.230626+0000","last_unstale":"2023-11-08T19:25:32.217902+0000","last_undegraded":"2023-11-08T19:25:32.217902+0000","last_fullsized":"2023-11-08T19:25:32.217902+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:25:54.842997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":41,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.216376+0000","last_change":"2023-11-08T19:24:32.141190+0000","last_active":"2023-11-08T19:25:32.216376+0000","last_peered":"2023-11-08T19:25:32.216376+0000","last_clean":"2023-11-08T19:25:32.216376+0000","last_became_active":"2023-11-08T19:24:31.147651+0000","last_became_peered":"2023-11-08T19:24:31.147651+0000","last_unstale":"2023-11-08T19:25:32.216376+0000","last_undegraded":"2023-11-08T19:25:32.216376+0000","last_fullsized":"2023-11-08T19:25:32.216376+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:21:55.985548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043673300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-08T19:25:33.829708+0000","last_change":"2023-11-08T19:25:32.218475+0000","last_active":"2023-11-08T19:25:33.829708+0000","last_peered":"2023-11-08T19:25:33.829708+0000","last_clean":"2023-11-08T19:25:33.829708+0000","last_became_active":"2023-11-08T19:25:32.218214+0000","last_became_peered":"2023-11-08T19:25:32.218214+0000","last_unstale":"2023-11-08T19:25:33.829708+0000","last_undegraded":"2023-11-08T19:25:33.829708+0000","last_fullsized":"2023-11-08T19:25:33.829708+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:45:57.483767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.207287+0000","last_change":"2023-11-08T19:25:31.219722+0000","last_active":"2023-11-08T19:25:32.207287+0000","last_peered":"2023-11-08T19:25:32.207287+0000","last_clean":"2023-11-08T19:25:32.207287+0000","last_became_active":"2023-11-08T19:25:31.217022+0000","last_became_peered":"2023-11-08T19:25:31.217022+0000","last_unstale":"2023-11-08T19:25:32.207287+0000","last_undegraded":"2023-11-08T19:25:32.207287+0000","last_fullsized":"2023-11-08T19:25:32.207287+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:34:39.795258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":36,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-08T19:25:31.219135+0000","last_change":"2023-11-08T19:24:32.147011+0000","last_active":"2023-11-08T19:25:31.219135+0000","last_peered":"2023-11-08T19:25:31.219135+0000","last_clean":"2023-11-08T19:25:31.219135+0000","last_became_active":"2023-11-08T19:24:31.148250+0000","last_became_peered":"2023-11-08T19:24:31.148250+0000","last_unstale":"2023-11-08T19:25:31.219135+0000","last_undegraded":"2023-11-08T19:25:31.219135+0000","last_fullsized":"2023-11-08T19:25:31.219135+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:01:25.647952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043061299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-08T19:25:34.534774+0000","last_change":"2023-11-08T19:25:32.223931+0000","last_active":"2023-11-08T19:25:34.534774+0000","last_peered":"2023-11-08T19:25:34.534774+0000","last_clean":"2023-11-08T19:25:34.534774+0000","last_became_active":"2023-11-08T19:25:32.222853+0000","last_became_peered":"2023-11-08T19:25:32.222853+0000","last_unstale":"2023-11-08T19:25:34.534774+0000","last_undegraded":"2023-11-08T19:25:34.534774+0000","last_fullsized":"2023-11-08T19:25:34.534774+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:26:44.610894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.210895+0000","last_change":"2023-11-08T19:25:31.222379+0000","last_active":"2023-11-08T19:25:32.210895+0000","last_peered":"2023-11-08T19:25:32.210895+0000","last_clean":"2023-11-08T19:25:32.210895+0000","last_became_active":"2023-11-08T19:25:31.222095+0000","last_became_peered":"2023-11-08T19:25:31.222095+0000","last_unstale":"2023-11-08T19:25:32.210895+0000","last_undegraded":"2023-11-08T19:25:32.210895+0000","last_fullsized":"2023-11-08T19:25:32.210895+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:33:12.471178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":37,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.219537+0000","last_change":"2023-11-08T19:24:32.543880+0000","last_active":"2023-11-08T19:25:32.219537+0000","last_peered":"2023-11-08T19:25:32.219537+0000","last_clean":"2023-11-08T19:25:32.219537+0000","last_became_active":"2023-11-08T19:24:31.142052+0000","last_became_peered":"2023-11-08T19:24:31.142052+0000","last_unstale":"2023-11-08T19:25:32.219537+0000","last_undegraded":"2023-11-08T19:25:32.219537+0000","last_fullsized":"2023-11-08T19:25:32.219537+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:18:42.371676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014881058000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-08T19:25:33.218790+0000","last_change":"2023-11-08T19:25:32.240945+0000","last_active":"2023-11-08T19:25:33.218790+0000","last_peered":"2023-11-08T19:25:33.218790+0000","last_clean":"2023-11-08T19:25:33.218790+0000","last_became_active":"2023-11-08T19:25:32.240689+0000","last_became_peered":"2023-11-08T19:25:32.240689+0000","last_unstale":"2023-11-08T19:25:33.218790+0000","last_undegraded":"2023-11-08T19:25:33.218790+0000","last_fullsized":"2023-11-08T19:25:33.218790+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:46:30.898400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"66'1","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.230190+0000","last_change":"2023-11-08T19:25:31.222436+0000","last_active":"2023-11-08T19:25:32.230190+0000","last_peered":"2023-11-08T19:25:32.230190+0000","last_clean":"2023-11-08T19:25:32.230190+0000","last_became_active":"2023-11-08T19:25:31.221481+0000","last_became_peered":"2023-11-08T19:25:31.221481+0000","last_unstale":"2023-11-08T19:25:32.230190+0000","last_undegraded":"2023-11-08T19:25:32.230190+0000","last_fullsized":"2023-11-08T19:25:32.230190+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:07:29.777575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":36,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-08T19:25:31.220157+0000","last_change":"2023-11-08T19:24:32.147235+0000","last_active":"2023-11-08T19:25:31.220157+0000","last_peered":"2023-11-08T19:25:31.220157+0000","last_clean":"2023-11-08T19:25:31.220157+0000","last_became_active":"2023-11-08T19:24:31.146176+0000","last_became_peered":"2023-11-08T19:24:31.146176+0000","last_unstale":"2023-11-08T19:25:31.220157+0000","last_undegraded":"2023-11-08T19:25:31.220157+0000","last_fullsized":"2023-11-08T19:25:31.220157+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:39.214888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048481000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-08T19:25:35.256117+0000","last_change":"2023-11-08T19:25:32.232961+0000","last_active":"2023-11-08T19:25:35.256117+0000","last_peered":"2023-11-08T19:25:35.256117+0000","last_clean":"2023-11-08T19:25:35.256117+0000","last_became_active":"2023-11-08T19:25:32.232690+0000","last_became_peered":"2023-11-08T19:25:32.232690+0000","last_unstale":"2023-11-08T19:25:35.256117+0000","last_undegraded":"2023-11-08T19:25:35.256117+0000","last_fullsized":"2023-11-08T19:25:35.256117+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:45:57.483767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"66'1","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.236972+0000","last_change":"2023-11-08T19:25:31.230304+0000","last_active":"2023-11-08T19:25:32.236972+0000","last_peered":"2023-11-08T19:25:32.236972+0000","last_clean":"2023-11-08T19:25:32.236972+0000","last_became_active":"2023-11-08T19:25:31.230021+0000","last_became_peered":"2023-11-08T19:25:31.230021+0000","last_unstale":"2023-11-08T19:25:32.236972+0000","last_undegraded":"2023-11-08T19:25:32.236972+0000","last_fullsized":"2023-11-08T19:25:32.236972+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:11:41.389668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":41,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.216742+0000","last_change":"2023-11-08T19:24:32.142376+0000","last_active":"2023-11-08T19:25:32.216742+0000","last_peered":"2023-11-08T19:25:32.216742+0000","last_clean":"2023-11-08T19:25:32.216742+0000","last_became_active":"2023-11-08T19:24:31.144614+0000","last_became_peered":"2023-11-08T19:24:31.144614+0000","last_unstale":"2023-11-08T19:25:32.216742+0000","last_undegraded":"2023-11-08T19:25:32.216742+0000","last_fullsized":"2023-11-08T19:25:32.216742+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:09:04.880374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050362200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.243857+0000","last_change":"2023-11-08T19:25:32.241615+0000","last_active":"2023-11-08T19:25:32.243857+0000","last_peered":"2023-11-08T19:25:32.243857+0000","last_clean":"2023-11-08T19:25:32.243857+0000","last_became_active":"2023-11-08T19:25:32.240989+0000","last_became_peered":"2023-11-08T19:25:32.240989+0000","last_unstale":"2023-11-08T19:25:32.243857+0000","last_undegraded":"2023-11-08T19:25:32.243857+0000","last_fullsized":"2023-11-08T19:25:32.243857+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:34:02.775077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"66'2","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.236715+0000","last_change":"2023-11-08T19:25:31.214240+0000","last_active":"2023-11-08T19:25:32.236715+0000","last_peered":"2023-11-08T19:25:32.236715+0000","last_clean":"2023-11-08T19:25:32.236715+0000","last_became_active":"2023-11-08T19:25:31.212891+0000","last_became_peered":"2023-11-08T19:25:31.212891+0000","last_unstale":"2023-11-08T19:25:32.236715+0000","last_undegraded":"2023-11-08T19:25:32.236715+0000","last_fullsized":"2023-11-08T19:25:32.236715+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:55:21.222936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":36,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-08T19:25:31.218923+0000","last_change":"2023-11-08T19:24:32.146639+0000","last_active":"2023-11-08T19:25:31.218923+0000","last_peered":"2023-11-08T19:25:31.218923+0000","last_clean":"2023-11-08T19:25:31.218923+0000","last_became_active":"2023-11-08T19:24:31.147384+0000","last_became_peered":"2023-11-08T19:24:31.147384+0000","last_unstale":"2023-11-08T19:25:31.218923+0000","last_undegraded":"2023-11-08T19:25:31.218923+0000","last_fullsized":"2023-11-08T19:25:31.218923+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:30:21.946303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043834899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-08T19:25:33.219569+0000","last_change":"2023-11-08T19:25:32.220499+0000","last_active":"2023-11-08T19:25:33.219569+0000","last_peered":"2023-11-08T19:25:33.219569+0000","last_clean":"2023-11-08T19:25:33.219569+0000","last_became_active":"2023-11-08T19:25:32.219984+0000","last_became_peered":"2023-11-08T19:25:32.219984+0000","last_unstale":"2023-11-08T19:25:33.219569+0000","last_undegraded":"2023-11-08T19:25:33.219569+0000","last_fullsized":"2023-11-08T19:25:33.219569+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:32:32.171974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"66'2","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.237303+0000","last_change":"2023-11-08T19:25:31.222327+0000","last_active":"2023-11-08T19:25:32.237303+0000","last_peered":"2023-11-08T19:25:32.237303+0000","last_clean":"2023-11-08T19:25:32.237303+0000","last_became_active":"2023-11-08T19:25:31.222038+0000","last_became_peered":"2023-11-08T19:25:31.222038+0000","last_unstale":"2023-11-08T19:25:32.237303+0000","last_undegraded":"2023-11-08T19:25:32.237303+0000","last_fullsized":"2023-11-08T19:25:32.237303+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:20:52.213642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":37,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.223364+0000","last_change":"2023-11-08T19:24:32.544108+0000","last_active":"2023-11-08T19:25:32.223364+0000","last_peered":"2023-11-08T19:25:32.223364+0000","last_clean":"2023-11-08T19:25:32.223364+0000","last_became_active":"2023-11-08T19:24:31.143812+0000","last_became_peered":"2023-11-08T19:24:31.143812+0000","last_unstale":"2023-11-08T19:25:32.223364+0000","last_undegraded":"2023-11-08T19:25:32.223364+0000","last_fullsized":"2023-11-08T19:25:32.223364+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:27:59.135977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014956126,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-08T19:25:34.535428+0000","last_change":"2023-11-08T19:25:32.230499+0000","last_active":"2023-11-08T19:25:34.535428+0000","last_peered":"2023-11-08T19:25:34.535428+0000","last_clean":"2023-11-08T19:25:34.535428+0000","last_became_active":"2023-11-08T19:25:32.229647+0000","last_became_peered":"2023-11-08T19:25:32.229647+0000","last_unstale":"2023-11-08T19:25:34.535428+0000","last_undegraded":"2023-11-08T19:25:34.535428+0000","last_fullsized":"2023-11-08T19:25:34.535428+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:08:57.790617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"66'1","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.226325+0000","last_change":"2023-11-08T19:25:31.220231+0000","last_active":"2023-11-08T19:25:32.226325+0000","last_peered":"2023-11-08T19:25:32.226325+0000","last_clean":"2023-11-08T19:25:32.226325+0000","last_became_active":"2023-11-08T19:25:31.219989+0000","last_became_peered":"2023-11-08T19:25:31.219989+0000","last_unstale":"2023-11-08T19:25:32.226325+0000","last_undegraded":"2023-11-08T19:25:32.226325+0000","last_fullsized":"2023-11-08T19:25:32.226325+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:15:07.118614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":36,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.211789+0000","last_change":"2023-11-08T19:24:32.530378+0000","last_active":"2023-11-08T19:25:32.211789+0000","last_peered":"2023-11-08T19:25:32.211789+0000","last_clean":"2023-11-08T19:25:32.211789+0000","last_became_active":"2023-11-08T19:24:31.144341+0000","last_became_peered":"2023-11-08T19:24:31.144341+0000","last_unstale":"2023-11-08T19:25:32.211789+0000","last_undegraded":"2023-11-08T19:25:32.211789+0000","last_fullsized":"2023-11-08T19:25:32.211789+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:30:21.946303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058308299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.243743+0000","last_change":"2023-11-08T19:25:32.241021+0000","last_active":"2023-11-08T19:25:32.243743+0000","last_peered":"2023-11-08T19:25:32.243743+0000","last_clean":"2023-11-08T19:25:32.243743+0000","last_became_active":"2023-11-08T19:25:32.240682+0000","last_became_peered":"2023-11-08T19:25:32.240682+0000","last_unstale":"2023-11-08T19:25:32.243743+0000","last_undegraded":"2023-11-08T19:25:32.243743+0000","last_fullsized":"2023-11-08T19:25:32.243743+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:32:32.171974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"66'4","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.243327+0000","last_change":"2023-11-08T19:25:31.233739+0000","last_active":"2023-11-08T19:25:32.243327+0000","last_peered":"2023-11-08T19:25:32.243327+0000","last_clean":"2023-11-08T19:25:32.243327+0000","last_became_active":"2023-11-08T19:25:31.233443+0000","last_became_peered":"2023-11-08T19:25:31.233443+0000","last_unstale":"2023-11-08T19:25:32.243327+0000","last_undegraded":"2023-11-08T19:25:32.243327+0000","last_fullsized":"2023-11-08T19:25:32.243327+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:50:34.453347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":40,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.209096+0000","last_change":"2023-11-08T19:24:32.140832+0000","last_active":"2023-11-08T19:25:32.209096+0000","last_peered":"2023-11-08T19:25:32.209096+0000","last_clean":"2023-11-08T19:25:32.209096+0000","last_became_active":"2023-11-08T19:24:31.146557+0000","last_became_peered":"2023-11-08T19:24:31.146557+0000","last_unstale":"2023-11-08T19:25:32.209096+0000","last_undegraded":"2023-11-08T19:25:32.209096+0000","last_fullsized":"2023-11-08T19:25:32.209096+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:40:04.258107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099450100000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-08T19:25:33.218981+0000","last_change":"2023-11-08T19:25:32.228627+0000","last_active":"2023-11-08T19:25:33.218981+0000","last_peered":"2023-11-08T19:25:33.218981+0000","last_clean":"2023-11-08T19:25:33.218981+0000","last_became_active":"2023-11-08T19:25:32.228272+0000","last_became_peered":"2023-11-08T19:25:32.228272+0000","last_unstale":"2023-11-08T19:25:33.218981+0000","last_undegraded":"2023-11-08T19:25:33.218981+0000","last_fullsized":"2023-11-08T19:25:33.218981+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:03:18.528951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.210447+0000","last_change":"2023-11-08T19:25:31.220428+0000","last_active":"2023-11-08T19:25:32.210447+0000","last_peered":"2023-11-08T19:25:32.210447+0000","last_clean":"2023-11-08T19:25:32.210447+0000","last_became_active":"2023-11-08T19:25:31.220167+0000","last_became_peered":"2023-11-08T19:25:31.220167+0000","last_unstale":"2023-11-08T19:25:32.210447+0000","last_undegraded":"2023-11-08T19:25:32.210447+0000","last_fullsized":"2023-11-08T19:25:32.210447+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:04:35.951705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":40,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.210205+0000","last_change":"2023-11-08T19:24:32.141188+0000","last_active":"2023-11-08T19:25:32.210205+0000","last_peered":"2023-11-08T19:25:32.210205+0000","last_clean":"2023-11-08T19:25:32.210205+0000","last_became_active":"2023-11-08T19:24:31.148857+0000","last_became_peered":"2023-11-08T19:24:31.148857+0000","last_unstale":"2023-11-08T19:25:32.210205+0000","last_undegraded":"2023-11-08T19:25:32.210205+0000","last_fullsized":"2023-11-08T19:25:32.210205+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:45:34.425432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065078599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-08T19:25:34.566913+0000","last_change":"2023-11-08T19:25:32.228785+0000","last_active":"2023-11-08T19:25:34.566913+0000","last_peered":"2023-11-08T19:25:34.566913+0000","last_clean":"2023-11-08T19:25:34.566913+0000","last_became_active":"2023-11-08T19:25:32.228494+0000","last_became_peered":"2023-11-08T19:25:32.228494+0000","last_unstale":"2023-11-08T19:25:34.566913+0000","last_undegraded":"2023-11-08T19:25:34.566913+0000","last_fullsized":"2023-11-08T19:25:34.566913+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:20:53.219210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.215913+0000","last_change":"2023-11-08T19:25:31.219907+0000","last_active":"2023-11-08T19:25:32.215913+0000","last_peered":"2023-11-08T19:25:32.215913+0000","last_clean":"2023-11-08T19:25:32.215913+0000","last_became_active":"2023-11-08T19:25:31.219625+0000","last_became_peered":"2023-11-08T19:25:31.219625+0000","last_unstale":"2023-11-08T19:25:32.215913+0000","last_undegraded":"2023-11-08T19:25:32.215913+0000","last_fullsized":"2023-11-08T19:25:32.215913+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:26:07.331163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":40,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.210622+0000","last_change":"2023-11-08T19:24:32.140167+0000","last_active":"2023-11-08T19:25:32.210622+0000","last_peered":"2023-11-08T19:25:32.210622+0000","last_clean":"2023-11-08T19:25:32.210622+0000","last_became_active":"2023-11-08T19:24:31.147181+0000","last_became_peered":"2023-11-08T19:24:31.147181+0000","last_unstale":"2023-11-08T19:25:32.210622+0000","last_undegraded":"2023-11-08T19:25:32.210622+0000","last_fullsized":"2023-11-08T19:25:32.210622+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:26.080042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057135200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-08T19:25:33.218672+0000","last_change":"2023-11-08T19:25:32.234811+0000","last_active":"2023-11-08T19:25:33.218672+0000","last_peered":"2023-11-08T19:25:33.218672+0000","last_clean":"2023-11-08T19:25:33.218672+0000","last_became_active":"2023-11-08T19:25:32.234326+0000","last_became_peered":"2023-11-08T19:25:32.234326+0000","last_unstale":"2023-11-08T19:25:33.218672+0000","last_undegraded":"2023-11-08T19:25:33.218672+0000","last_fullsized":"2023-11-08T19:25:33.218672+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:02:09.961209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.211841+0000","last_change":"2023-11-08T19:25:31.222526+0000","last_active":"2023-11-08T19:25:32.211841+0000","last_peered":"2023-11-08T19:25:32.211841+0000","last_clean":"2023-11-08T19:25:32.211841+0000","last_became_active":"2023-11-08T19:25:31.221022+0000","last_became_peered":"2023-11-08T19:25:31.221022+0000","last_unstale":"2023-11-08T19:25:32.211841+0000","last_undegraded":"2023-11-08T19:25:32.211841+0000","last_fullsized":"2023-11-08T19:25:32.211841+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:59:15.781642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":36,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.211161+0000","last_change":"2023-11-08T19:24:32.530895+0000","last_active":"2023-11-08T19:25:32.211161+0000","last_peered":"2023-11-08T19:25:32.211161+0000","last_clean":"2023-11-08T19:25:32.211161+0000","last_became_active":"2023-11-08T19:24:31.146715+0000","last_became_peered":"2023-11-08T19:24:31.146715+0000","last_unstale":"2023-11-08T19:25:32.211161+0000","last_undegraded":"2023-11-08T19:25:32.211161+0000","last_fullsized":"2023-11-08T19:25:32.211161+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:39.214888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081671599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-08T19:25:34.535124+0000","last_change":"2023-11-08T19:25:32.229771+0000","last_active":"2023-11-08T19:25:34.535124+0000","last_peered":"2023-11-08T19:25:34.535124+0000","last_clean":"2023-11-08T19:25:34.535124+0000","last_became_active":"2023-11-08T19:25:32.229463+0000","last_became_peered":"2023-11-08T19:25:32.229463+0000","last_unstale":"2023-11-08T19:25:34.535124+0000","last_undegraded":"2023-11-08T19:25:34.535124+0000","last_fullsized":"2023-11-08T19:25:34.535124+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:47:11.459997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.207729+0000","last_change":"2023-11-08T19:25:31.226682+0000","last_active":"2023-11-08T19:25:32.207729+0000","last_peered":"2023-11-08T19:25:32.207729+0000","last_clean":"2023-11-08T19:25:32.207729+0000","last_became_active":"2023-11-08T19:25:31.226362+0000","last_became_peered":"2023-11-08T19:25:31.226362+0000","last_unstale":"2023-11-08T19:25:32.207729+0000","last_undegraded":"2023-11-08T19:25:32.207729+0000","last_fullsized":"2023-11-08T19:25:32.207729+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:06:53.661984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":37,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.207738+0000","last_change":"2023-11-08T19:24:32.333430+0000","last_active":"2023-11-08T19:25:32.207738+0000","last_peered":"2023-11-08T19:25:32.207738+0000","last_clean":"2023-11-08T19:25:32.207738+0000","last_became_active":"2023-11-08T19:24:31.141710+0000","last_became_peered":"2023-11-08T19:24:31.141710+0000","last_unstale":"2023-11-08T19:25:32.207738+0000","last_undegraded":"2023-11-08T19:25:32.207738+0000","last_fullsized":"2023-11-08T19:25:32.207738+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:32:51.214551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000430438,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.243873+0000","last_change":"2023-11-08T19:25:32.241953+0000","last_active":"2023-11-08T19:25:32.243873+0000","last_peered":"2023-11-08T19:25:32.243873+0000","last_clean":"2023-11-08T19:25:32.243873+0000","last_became_active":"2023-11-08T19:25:32.241304+0000","last_became_peered":"2023-11-08T19:25:32.241304+0000","last_unstale":"2023-11-08T19:25:32.243873+0000","last_undegraded":"2023-11-08T19:25:32.243873+0000","last_fullsized":"2023-11-08T19:25:32.243873+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:12:10.425204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.211388+0000","last_change":"2023-11-08T19:25:31.226002+0000","last_active":"2023-11-08T19:25:32.211388+0000","last_peered":"2023-11-08T19:25:32.211388+0000","last_clean":"2023-11-08T19:25:32.211388+0000","last_became_active":"2023-11-08T19:25:31.225703+0000","last_became_peered":"2023-11-08T19:25:31.225703+0000","last_unstale":"2023-11-08T19:25:32.211388+0000","last_undegraded":"2023-11-08T19:25:32.211388+0000","last_fullsized":"2023-11-08T19:25:32.211388+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:58:52.558884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":36,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.212744+0000","last_change":"2023-11-08T19:24:32.530333+0000","last_active":"2023-11-08T19:25:32.212744+0000","last_peered":"2023-11-08T19:25:32.212744+0000","last_clean":"2023-11-08T19:25:32.212744+0000","last_became_active":"2023-11-08T19:24:31.144838+0000","last_became_peered":"2023-11-08T19:24:31.144838+0000","last_unstale":"2023-11-08T19:25:32.212744+0000","last_undegraded":"2023-11-08T19:25:32.212744+0000","last_fullsized":"2023-11-08T19:25:32.212744+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:39:48.473183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081588799999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.242599+0000","last_change":"2023-11-08T19:25:32.240888+0000","last_active":"2023-11-08T19:25:32.242599+0000","last_peered":"2023-11-08T19:25:32.242599+0000","last_clean":"2023-11-08T19:25:32.242599+0000","last_became_active":"2023-11-08T19:25:32.240537+0000","last_became_peered":"2023-11-08T19:25:32.240537+0000","last_unstale":"2023-11-08T19:25:32.242599+0000","last_undegraded":"2023-11-08T19:25:32.242599+0000","last_fullsized":"2023-11-08T19:25:32.242599+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:19:39.469446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.207531+0000","last_change":"2023-11-08T19:25:31.223986+0000","last_active":"2023-11-08T19:25:32.207531+0000","last_peered":"2023-11-08T19:25:32.207531+0000","last_clean":"2023-11-08T19:25:32.207531+0000","last_became_active":"2023-11-08T19:25:31.223748+0000","last_became_peered":"2023-11-08T19:25:31.223748+0000","last_unstale":"2023-11-08T19:25:32.207531+0000","last_undegraded":"2023-11-08T19:25:32.207531+0000","last_fullsized":"2023-11-08T19:25:32.207531+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:51:33.499235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":37,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.207689+0000","last_change":"2023-11-08T19:24:32.333096+0000","last_active":"2023-11-08T19:25:32.207689+0000","last_peered":"2023-11-08T19:25:32.207689+0000","last_clean":"2023-11-08T19:25:32.207689+0000","last_became_active":"2023-11-08T19:24:31.142985+0000","last_became_peered":"2023-11-08T19:24:31.142985+0000","last_unstale":"2023-11-08T19:25:32.207689+0000","last_undegraded":"2023-11-08T19:25:32.207689+0000","last_fullsized":"2023-11-08T19:25:32.207689+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:36:33.274496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000386048,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-08T19:25:35.256213+0000","last_change":"2023-11-08T19:25:32.224312+0000","last_active":"2023-11-08T19:25:35.256213+0000","last_peered":"2023-11-08T19:25:35.256213+0000","last_clean":"2023-11-08T19:25:35.256213+0000","last_became_active":"2023-11-08T19:25:32.223984+0000","last_became_peered":"2023-11-08T19:25:32.223984+0000","last_unstale":"2023-11-08T19:25:35.256213+0000","last_undegraded":"2023-11-08T19:25:35.256213+0000","last_fullsized":"2023-11-08T19:25:35.256213+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:27:03.271277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"67'1","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-08T19:25:35.256270+0000","last_change":"2023-11-08T19:25:31.223393+0000","last_active":"2023-11-08T19:25:35.256270+0000","last_peered":"2023-11-08T19:25:35.256270+0000","last_clean":"2023-11-08T19:25:35.256270+0000","last_became_active":"2023-11-08T19:25:31.223094+0000","last_became_peered":"2023-11-08T19:25:31.223094+0000","last_unstale":"2023-11-08T19:25:35.256270+0000","last_undegraded":"2023-11-08T19:25:35.256270+0000","last_fullsized":"2023-11-08T19:25:35.256270+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:09:28.598559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":38,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.210912+0000","last_change":"2023-11-08T19:24:32.263810+0000","last_active":"2023-11-08T19:25:32.210912+0000","last_peered":"2023-11-08T19:25:32.210912+0000","last_clean":"2023-11-08T19:25:32.210912+0000","last_became_active":"2023-11-08T19:24:31.138814+0000","last_became_peered":"2023-11-08T19:24:31.138814+0000","last_unstale":"2023-11-08T19:25:32.210912+0000","last_undegraded":"2023-11-08T19:25:32.210912+0000","last_fullsized":"2023-11-08T19:25:32.210912+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:21:55.985548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048136000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-08T19:25:33.830011+0000","last_change":"2023-11-08T19:25:32.214187+0000","last_active":"2023-11-08T19:25:33.830011+0000","last_peered":"2023-11-08T19:25:33.830011+0000","last_clean":"2023-11-08T19:25:33.830011+0000","last_became_active":"2023-11-08T19:25:32.213907+0000","last_became_peered":"2023-11-08T19:25:32.213907+0000","last_unstale":"2023-11-08T19:25:33.830011+0000","last_undegraded":"2023-11-08T19:25:33.830011+0000","last_fullsized":"2023-11-08T19:25:33.830011+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:27:03.271277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"66'2","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.232884+0000","last_change":"2023-11-08T19:25:31.230406+0000","last_active":"2023-11-08T19:25:32.232884+0000","last_peered":"2023-11-08T19:25:32.232884+0000","last_clean":"2023-11-08T19:25:32.232884+0000","last_became_active":"2023-11-08T19:25:31.230093+0000","last_became_peered":"2023-11-08T19:25:31.230093+0000","last_unstale":"2023-11-08T19:25:32.232884+0000","last_undegraded":"2023-11-08T19:25:32.232884+0000","last_fullsized":"2023-11-08T19:25:32.232884+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:25:54.842997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":37,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.219580+0000","last_change":"2023-11-08T19:24:32.544063+0000","last_active":"2023-11-08T19:25:32.219580+0000","last_peered":"2023-11-08T19:25:32.219580+0000","last_clean":"2023-11-08T19:25:32.219580+0000","last_became_active":"2023-11-08T19:24:31.144795+0000","last_became_peered":"2023-11-08T19:24:31.144795+0000","last_unstale":"2023-11-08T19:25:32.219580+0000","last_undegraded":"2023-11-08T19:25:32.219580+0000","last_fullsized":"2023-11-08T19:25:32.219580+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:12:42.248307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01495431,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-08T19:25:33.217494+0000","last_change":"2023-11-08T19:25:32.228258+0000","last_active":"2023-11-08T19:25:33.217494+0000","last_peered":"2023-11-08T19:25:33.217494+0000","last_clean":"2023-11-08T19:25:33.217494+0000","last_became_active":"2023-11-08T19:25:32.227973+0000","last_became_peered":"2023-11-08T19:25:32.227973+0000","last_unstale":"2023-11-08T19:25:33.217494+0000","last_undegraded":"2023-11-08T19:25:33.217494+0000","last_fullsized":"2023-11-08T19:25:33.217494+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:25:47.083226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.211838+0000","last_change":"2023-11-08T19:25:31.227074+0000","last_active":"2023-11-08T19:25:32.211838+0000","last_peered":"2023-11-08T19:25:32.211838+0000","last_clean":"2023-11-08T19:25:32.211838+0000","last_became_active":"2023-11-08T19:25:31.226805+0000","last_became_peered":"2023-11-08T19:25:31.226805+0000","last_unstale":"2023-11-08T19:25:32.211838+0000","last_undegraded":"2023-11-08T19:25:32.211838+0000","last_fullsized":"2023-11-08T19:25:32.211838+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:34:01.769509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":36,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-08T19:25:31.219062+0000","last_change":"2023-11-08T19:24:32.147025+0000","last_active":"2023-11-08T19:25:31.219062+0000","last_peered":"2023-11-08T19:25:31.219062+0000","last_clean":"2023-11-08T19:25:31.219062+0000","last_became_active":"2023-11-08T19:24:31.147082+0000","last_became_peered":"2023-11-08T19:24:31.147082+0000","last_unstale":"2023-11-08T19:25:31.219062+0000","last_undegraded":"2023-11-08T19:25:31.219062+0000","last_fullsized":"2023-11-08T19:25:31.219062+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:02:27.987795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043701599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-08T19:25:33.216973+0000","last_change":"2023-11-08T19:25:32.232164+0000","last_active":"2023-11-08T19:25:33.216973+0000","last_peered":"2023-11-08T19:25:33.216973+0000","last_clean":"2023-11-08T19:25:33.216973+0000","last_became_active":"2023-11-08T19:25:32.231843+0000","last_became_peered":"2023-11-08T19:25:32.231843+0000","last_unstale":"2023-11-08T19:25:33.216973+0000","last_undegraded":"2023-11-08T19:25:33.216973+0000","last_fullsized":"2023-11-08T19:25:33.216973+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:46:21.440785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.216886+0000","last_change":"2023-11-08T19:25:31.226188+0000","last_active":"2023-11-08T19:25:32.216886+0000","last_peered":"2023-11-08T19:25:32.216886+0000","last_clean":"2023-11-08T19:25:32.216886+0000","last_became_active":"2023-11-08T19:25:31.225774+0000","last_became_peered":"2023-11-08T19:25:31.225774+0000","last_unstale":"2023-11-08T19:25:32.216886+0000","last_undegraded":"2023-11-08T19:25:32.216886+0000","last_fullsized":"2023-11-08T19:25:32.216886+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:58:52.558884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":36,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.211471+0000","last_change":"2023-11-08T19:24:32.530620+0000","last_active":"2023-11-08T19:25:32.211471+0000","last_peered":"2023-11-08T19:25:32.211471+0000","last_clean":"2023-11-08T19:25:32.211471+0000","last_became_active":"2023-11-08T19:24:31.144223+0000","last_became_peered":"2023-11-08T19:24:31.144223+0000","last_unstale":"2023-11-08T19:25:32.211471+0000","last_undegraded":"2023-11-08T19:25:32.211471+0000","last_fullsized":"2023-11-08T19:25:32.211471+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:01:25.647952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071879799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-08T19:25:33.217247+0000","last_change":"2023-11-08T19:25:32.225344+0000","last_active":"2023-11-08T19:25:33.217247+0000","last_peered":"2023-11-08T19:25:33.217247+0000","last_clean":"2023-11-08T19:25:33.217247+0000","last_became_active":"2023-11-08T19:25:32.224832+0000","last_became_peered":"2023-11-08T19:25:32.224832+0000","last_unstale":"2023-11-08T19:25:33.217247+0000","last_undegraded":"2023-11-08T19:25:33.217247+0000","last_fullsized":"2023-11-08T19:25:33.217247+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:20:35.727598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.209306+0000","last_change":"2023-11-08T19:25:31.221192+0000","last_active":"2023-11-08T19:25:32.209306+0000","last_peered":"2023-11-08T19:25:32.209306+0000","last_clean":"2023-11-08T19:25:32.209306+0000","last_became_active":"2023-11-08T19:25:31.220874+0000","last_became_peered":"2023-11-08T19:25:31.220874+0000","last_unstale":"2023-11-08T19:25:32.209306+0000","last_undegraded":"2023-11-08T19:25:32.209306+0000","last_fullsized":"2023-11-08T19:25:32.209306+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:00:39.399436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":40,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.210147+0000","last_change":"2023-11-08T19:24:32.140880+0000","last_active":"2023-11-08T19:25:32.210147+0000","last_peered":"2023-11-08T19:25:32.210147+0000","last_clean":"2023-11-08T19:25:32.210147+0000","last_became_active":"2023-11-08T19:24:31.146063+0000","last_became_peered":"2023-11-08T19:24:31.146063+0000","last_unstale":"2023-11-08T19:25:32.210147+0000","last_undegraded":"2023-11-08T19:25:32.210147+0000","last_fullsized":"2023-11-08T19:25:32.210147+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:54:08.985813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089896300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-08T19:25:34.535298+0000","last_change":"2023-11-08T19:25:32.223360+0000","last_active":"2023-11-08T19:25:34.535298+0000","last_peered":"2023-11-08T19:25:34.535298+0000","last_clean":"2023-11-08T19:25:34.535298+0000","last_became_active":"2023-11-08T19:25:32.223097+0000","last_became_peered":"2023-11-08T19:25:32.223097+0000","last_unstale":"2023-11-08T19:25:34.535298+0000","last_undegraded":"2023-11-08T19:25:34.535298+0000","last_fullsized":"2023-11-08T19:25:34.535298+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:24:28.949169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.225054+0000","last_change":"2023-11-08T19:25:31.224949+0000","last_active":"2023-11-08T19:25:32.225054+0000","last_peered":"2023-11-08T19:25:32.225054+0000","last_clean":"2023-11-08T19:25:32.225054+0000","last_became_active":"2023-11-08T19:25:31.224687+0000","last_became_peered":"2023-11-08T19:25:31.224687+0000","last_unstale":"2023-11-08T19:25:32.225054+0000","last_undegraded":"2023-11-08T19:25:32.225054+0000","last_fullsized":"2023-11-08T19:25:32.225054+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:15:07.118614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":41,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.215870+0000","last_change":"2023-11-08T19:24:32.139885+0000","last_active":"2023-11-08T19:25:32.215870+0000","last_peered":"2023-11-08T19:25:32.215870+0000","last_clean":"2023-11-08T19:25:32.215870+0000","last_became_active":"2023-11-08T19:24:31.145329+0000","last_became_peered":"2023-11-08T19:24:31.145329+0000","last_unstale":"2023-11-08T19:25:32.215870+0000","last_undegraded":"2023-11-08T19:25:32.215870+0000","last_fullsized":"2023-11-08T19:25:32.215870+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:25:18.356784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049012999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-08T19:25:34.567308+0000","last_change":"2023-11-08T19:25:32.217169+0000","last_active":"2023-11-08T19:25:34.567308+0000","last_peered":"2023-11-08T19:25:34.567308+0000","last_clean":"2023-11-08T19:25:34.567308+0000","last_became_active":"2023-11-08T19:25:32.216903+0000","last_became_peered":"2023-11-08T19:25:32.216903+0000","last_unstale":"2023-11-08T19:25:34.567308+0000","last_undegraded":"2023-11-08T19:25:34.567308+0000","last_fullsized":"2023-11-08T19:25:34.567308+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:04:36.957274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"66'1","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.237047+0000","last_change":"2023-11-08T19:25:31.221443+0000","last_active":"2023-11-08T19:25:32.237047+0000","last_peered":"2023-11-08T19:25:32.237047+0000","last_clean":"2023-11-08T19:25:32.237047+0000","last_became_active":"2023-11-08T19:25:31.220836+0000","last_became_peered":"2023-11-08T19:25:31.220836+0000","last_unstale":"2023-11-08T19:25:32.237047+0000","last_undegraded":"2023-11-08T19:25:32.237047+0000","last_fullsized":"2023-11-08T19:25:32.237047+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:06:35.976321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":37,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.214922+0000","last_change":"2023-11-08T19:24:32.142836+0000","last_active":"2023-11-08T19:25:32.214922+0000","last_peered":"2023-11-08T19:25:32.214922+0000","last_clean":"2023-11-08T19:25:32.214922+0000","last_became_active":"2023-11-08T19:24:31.141367+0000","last_became_peered":"2023-11-08T19:24:31.141367+0000","last_unstale":"2023-11-08T19:25:32.214922+0000","last_undegraded":"2023-11-08T19:25:32.214922+0000","last_fullsized":"2023-11-08T19:25:32.214922+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:39.214888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001335136,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.244187+0000","last_change":"2023-11-08T19:25:32.243168+0000","last_active":"2023-11-08T19:25:32.244187+0000","last_peered":"2023-11-08T19:25:32.244187+0000","last_clean":"2023-11-08T19:25:32.244187+0000","last_became_active":"2023-11-08T19:25:32.242923+0000","last_became_peered":"2023-11-08T19:25:32.242923+0000","last_unstale":"2023-11-08T19:25:32.244187+0000","last_undegraded":"2023-11-08T19:25:32.244187+0000","last_fullsized":"2023-11-08T19:25:32.244187+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:09:29.604127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"66'2","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.236292+0000","last_change":"2023-11-08T19:25:31.225141+0000","last_active":"2023-11-08T19:25:32.236292+0000","last_peered":"2023-11-08T19:25:32.236292+0000","last_clean":"2023-11-08T19:25:32.236292+0000","last_became_active":"2023-11-08T19:25:31.224879+0000","last_became_peered":"2023-11-08T19:25:31.224879+0000","last_unstale":"2023-11-08T19:25:32.236292+0000","last_undegraded":"2023-11-08T19:25:32.236292+0000","last_fullsized":"2023-11-08T19:25:32.236292+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:24:26.842895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":37,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.222704+0000","last_change":"2023-11-08T19:24:32.544285+0000","last_active":"2023-11-08T19:25:32.222704+0000","last_peered":"2023-11-08T19:25:32.222704+0000","last_clean":"2023-11-08T19:25:32.222704+0000","last_became_active":"2023-11-08T19:24:31.142028+0000","last_became_peered":"2023-11-08T19:24:31.142028+0000","last_unstale":"2023-11-08T19:25:32.222704+0000","last_undegraded":"2023-11-08T19:25:32.222704+0000","last_fullsized":"2023-11-08T19:25:32.222704+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:01:24.198196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067537399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-08T19:25:33.219921+0000","last_change":"2023-11-08T19:25:32.232774+0000","last_active":"2023-11-08T19:25:33.219921+0000","last_peered":"2023-11-08T19:25:33.219921+0000","last_clean":"2023-11-08T19:25:33.219921+0000","last_became_active":"2023-11-08T19:25:32.232394+0000","last_became_peered":"2023-11-08T19:25:32.232394+0000","last_unstale":"2023-11-08T19:25:33.219921+0000","last_undegraded":"2023-11-08T19:25:33.219921+0000","last_fullsized":"2023-11-08T19:25:33.219921+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:01:47.229556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"66'1","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.233001+0000","last_change":"2023-11-08T19:25:31.230321+0000","last_active":"2023-11-08T19:25:32.233001+0000","last_peered":"2023-11-08T19:25:32.233001+0000","last_clean":"2023-11-08T19:25:32.233001+0000","last_became_active":"2023-11-08T19:25:31.230035+0000","last_became_peered":"2023-11-08T19:25:31.230035+0000","last_unstale":"2023-11-08T19:25:32.233001+0000","last_undegraded":"2023-11-08T19:25:32.233001+0000","last_fullsized":"2023-11-08T19:25:32.233001+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:20:52.213642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":37,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.219654+0000","last_change":"2023-11-08T19:24:32.544333+0000","last_active":"2023-11-08T19:25:32.219654+0000","last_peered":"2023-11-08T19:25:32.219654+0000","last_clean":"2023-11-08T19:25:32.219654+0000","last_became_active":"2023-11-08T19:24:31.138598+0000","last_became_peered":"2023-11-08T19:24:31.138598+0000","last_unstale":"2023-11-08T19:25:32.219654+0000","last_undegraded":"2023-11-08T19:25:32.219654+0000","last_fullsized":"2023-11-08T19:25:32.219654+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:11.860580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015114824000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-08T19:25:33.217130+0000","last_change":"2023-11-08T19:25:32.228274+0000","last_active":"2023-11-08T19:25:33.217130+0000","last_peered":"2023-11-08T19:25:33.217130+0000","last_clean":"2023-11-08T19:25:33.217130+0000","last_became_active":"2023-11-08T19:25:32.228002+0000","last_became_peered":"2023-11-08T19:25:32.228002+0000","last_unstale":"2023-11-08T19:25:33.217130+0000","last_undegraded":"2023-11-08T19:25:33.217130+0000","last_fullsized":"2023-11-08T19:25:33.217130+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:31.194359+0000","last_clean_scrub_stamp":"2023-11-08T19:25:31.194359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:39:13.159822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"66'2","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.236476+0000","last_change":"2023-11-08T19:25:31.219731+0000","last_active":"2023-11-08T19:25:32.236476+0000","last_peered":"2023-11-08T19:25:32.236476+0000","last_clean":"2023-11-08T19:25:32.236476+0000","last_became_active":"2023-11-08T19:25:31.219460+0000","last_became_peered":"2023-11-08T19:25:31.219460+0000","last_unstale":"2023-11-08T19:25:32.236476+0000","last_undegraded":"2023-11-08T19:25:32.236476+0000","last_fullsized":"2023-11-08T19:25:32.236476+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:30.188791+0000","last_clean_scrub_stamp":"2023-11-08T19:25:30.188791+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:01:46.223988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":36,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T19:25:32.211601+0000","last_change":"2023-11-08T19:24:32.530665+0000","last_active":"2023-11-08T19:25:32.211601+0000","last_peered":"2023-11-08T19:25:32.211601+0000","last_clean":"2023-11-08T19:25:32.211601+0000","last_became_active":"2023-11-08T19:24:31.148363+0000","last_became_peered":"2023-11-08T19:24:31.148363+0000","last_unstale":"2023-11-08T19:25:32.211601+0000","last_undegraded":"2023-11-08T19:25:32.211601+0000","last_fullsized":"2023-11-08T19:25:32.211601+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:02:27.987795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075444200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":204,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-08T19:25:31.215764+0000","last_change":"2023-11-08T19:22:58.054283+0000","last_active":"2023-11-08T19:25:31.215764+0000","last_peered":"2023-11-08T19:25:31.215764+0000","last_clean":"2023-11-08T19:25:31.215764+0000","last_became_active":"2023-11-08T19:22:58.053337+0000","last_became_peered":"2023-11-08T19:22:58.053337+0000","last_unstale":"2023-11-08T19:25:31.215764+0000","last_undegraded":"2023-11-08T19:25:31.215764+0000","last_fullsized":"2023-11-08T19:25:31.215764+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:22:56.479654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:22:56.479654+0000","last_clean_scrub_stamp":"2023-11-08T19:22:56.479654+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:16:05.317001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574884,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28392,"kb_used_data":1368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343448,"statfs":{"total":96636764160,"available":96607690752,"internally_reserved":0,"allocated":1400832,"data_stored":959735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.54500000000000004,"15min":0.53500000000000003},"min":{"1min":0.47599999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56499999999999995,"15min":0.56299999999999994},"min":{"1min":0.39100000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.748,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.48799999999999999}]},{"osd":1,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.54400000000000004,"15min":0.54600000000000004},"min":{"1min":0.37,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.70599999999999996,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53100000000000003,"15min":0.52900000000000003},"min":{"1min":0.39200000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.72699999999999998,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.40600000000000003}]},{"osd":2,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.50800000000000001,"15min":0.50600000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.71099999999999997,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.53100000000000003,"15min":0.53300000000000003},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.69299999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.71099999999999997}]},{"osd":3,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.41799999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.65900000000000003,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56000000000000005,"15min":0.55600000000000005},"min":{"1min":0.437,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72199999999999998,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.76100000000000001}]},{"osd":4,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.48499999999999999,"15min":0.48199999999999998},"min":{"1min":0.33400000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.373,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.63300000000000001}]},{"osd":5,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.55100000000000005,"15min":0.54500000000000004},"min":{"1min":0.41199999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.58499999999999996,"15min":0.57899999999999996},"min":{"1min":0.438,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.67400000000000004}]},{"osd":6,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61099999999999999,"15min":0.61199999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.82299999999999995,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56699999999999995,"15min":0.56200000000000006},"min":{"1min":0.43099999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.69199999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574885,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":819200,"data_stored":375816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.59699999999999998,"15min":0.60499999999999998},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.78000000000000003,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.58499999999999996,"15min":0.59499999999999997},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.78800000000000003,"5min":1.478,"15min":1.478},"last":0.372}]},{"osd":1,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.60499999999999998,"15min":0.60899999999999999},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.80600000000000005,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.621,"5min":0.66300000000000003,"15min":0.67000000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.81699999999999995,"5min":1.649,"15min":1.649},"last":0.52900000000000003}]},{"osd":2,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56000000000000005,"15min":0.55900000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.498},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.63,"15min":0.63500000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.75900000000000001,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.39500000000000002}]},{"osd":3,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.61799999999999999,"15min":0.63400000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77000000000000002,"5min":1.766,"15min":1.766},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.61199999999999999,"15min":0.625},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.877,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":0.41799999999999998}]},{"osd":4,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.53700000000000003,"15min":0.54200000000000004},"min":{"1min":0.36399999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.64500000000000002,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.57699999999999996,"15min":0.58199999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.58699999999999997}]},{"osd":5,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.56399999999999995,"15min":0.57099999999999995},"min":{"1min":0.42599999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.63300000000000001,"15min":0.63900000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.71499999999999997,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.60299999999999998}]},{"osd":7,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.61199999999999999,"15min":0.61499999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.64400000000000002,"15min":0.64900000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.56699999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574884,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":831488,"data_stored":377952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:24:57 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.36399999999999999,"15min":0.36499999999999999},"min":{"1min":0.255,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.42699999999999999,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.40799999999999997,"15min":0.41899999999999998},"min":{"1min":0.22800000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.5,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":0.35699999999999998}]},{"osd":2,"last update":"Wed Nov 8 19:24:57 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.34499999999999997,"15min":0.34699999999999998},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.43099999999999999,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.37,"5min":0.39400000000000002,"15min":0.39800000000000002},"min":{"1min":0.26200000000000001,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.502,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.38700000000000001}]},{"osd":3,"last update":"Wed Nov 8 19:24:57 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.33500000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.69499999999999995,"5min":1.24,"15min":1.24},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.45800000000000002,"15min":0.46800000000000003},"min":{"1min":0.27600000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.503,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.26100000000000001}]},{"osd":4,"last update":"Wed Nov 8 19:24:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.61299999999999999,"15min":0.61699999999999999},"min":{"1min":0.42299999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.745,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.625,"5min":0.57299999999999995,"15min":0.56499999999999995},"min":{"1min":0.502,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.76200000000000001}]},{"osd":5,"last update":"Wed Nov 8 19:24:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.56399999999999995,"15min":0.55600000000000005},"min":{"1min":0.42699999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.441,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.72299999999999998,"5min":1.115,"15min":1.115},"last":0.58399999999999996}]},{"osd":6,"last update":"Wed Nov 8 19:24:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.48999999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.84599999999999997,"5min":2.093,"15min":2.093},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.745,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.67300000000000004}]},{"osd":7,"last update":"Wed Nov 8 19:24:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.66700000000000004,"15min":0.67700000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.748,"5min":1.591,"15min":1.591},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.68700000000000006,"15min":0.69899999999999995},"min":{"1min":0.44600000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.77500000000000002,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.60799999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574884,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28392,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343448,"statfs":{"total":96636764160,"available":96607690752,"internally_reserved":0,"allocated":1404928,"data_stored":966092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":1.0509999999999999,"15min":1.175},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.51900000000000002,"5min":19.295999999999999,"15min":19.295999999999999},"last":0.501},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.96999999999999997,"15min":1.0740000000000001},"min":{"1min":0.252,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.502,"5min":17.204000000000001,"15min":17.204000000000001},"last":0.40200000000000002}]},{"osd":2,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.59499999999999997,"15min":0.63500000000000001},"min":{"1min":0.28599999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.46500000000000002,"5min":6.524,"15min":6.524},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.36699999999999999,"5min":1.008,"15min":1.115},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.47799999999999998,"5min":17.175000000000001,"15min":17.175000000000001},"last":0.44700000000000001}]},{"osd":3,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.86399999999999999,"15min":0.94999999999999996},"min":{"1min":0.27600000000000002,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.48899999999999999,"5min":14.324,"15min":14.324},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.40000000000000002,"15min":0.40200000000000002},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.52100000000000002,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.52300000000000002}]},{"osd":4,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":1.1599999999999999,"15min":1.256},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.76700000000000002,"5min":17.056000000000001,"15min":17.056000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.72899999999999998,"15min":0.753},"min":{"1min":0.441,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.749,"5min":5.0289999999999999,"15min":5.0289999999999999},"last":0.746}]},{"osd":5,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.72899999999999998,"15min":0.75600000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.77300000000000002,"5min":5.0590000000000002,"15min":5.0590000000000002},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56699999999999995,"15min":0.56499999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.72399999999999998}]},{"osd":6,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.60399999999999998,"15min":0.60499999999999998},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.57099999999999995,"5min":1.1990000000000001,"15min":1.304},"min":{"1min":0.35499999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.70099999999999996,"5min":17.111999999999998,"15min":17.111999999999998},"last":0.73199999999999998}]},{"osd":7,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":1.2170000000000001,"15min":1.319},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.77000000000000002,"5min":17.146000000000001,"15min":17.146000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.74099999999999999,"15min":0.76700000000000002},"min":{"1min":0.40899999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.83299999999999996,"5min":4.9829999999999997,"15min":4.9829999999999997},"last":0.69099999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574884,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":823296,"data_stored":377336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.46200000000000002,"15min":0.48499999999999999},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.48799999999999999,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.37,"5min":0.499,"15min":0.52100000000000002},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.68000000000000005,"5min":3.4369999999999998,"15min":3.4369999999999998},"last":0.42299999999999999}]},{"osd":1,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.53400000000000003,"15min":0.56399999999999995},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.58299999999999996,"5min":4.0679999999999996,"15min":4.0679999999999996},"last":0.372},{"interface":"front","average":{"1min":0.439,"5min":0.58499999999999996,"15min":0.60899999999999999},"min":{"1min":0.29499999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.72099999999999997,"5min":4.3499999999999996,"15min":4.3499999999999996},"last":0.46400000000000002}]},{"osd":3,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.53100000000000003,"15min":0.54900000000000004},"min":{"1min":0.26600000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.75600000000000001,"5min":3.8580000000000001,"15min":3.8580000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.497,"15min":0.52300000000000002},"min":{"1min":0.27600000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.55400000000000005,"5min":3.476,"15min":3.476},"last":0.33300000000000002}]},{"osd":4,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.71099999999999997,"15min":0.72499999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.3180000000000001,"5min":4.0090000000000003,"15min":4.0090000000000003},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.72699999999999998,"15min":0.747},"min":{"1min":0.46000000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.92300000000000004,"5min":4.1040000000000001,"15min":4.1040000000000001},"last":0.69099999999999995}]},{"osd":5,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.73199999999999998,"15min":0.75600000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.85399999999999998,"5min":4.0869999999999997,"15min":4.0869999999999997},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.73399999999999999,"15min":0.75800000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.73999999999999999,"5min":3.843,"15min":3.843},"last":0.72599999999999998}]},{"osd":6,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.748,"15min":0.77200000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0720000000000001,"5min":4.1399999999999997,"15min":4.1399999999999997},"last":0.623},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.72099999999999997,"15min":0.745},"min":{"1min":0.42899999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.81100000000000005,"5min":4.0499999999999998,"15min":4.0499999999999998},"last":0.78800000000000003}]},{"osd":7,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.76600000000000001,"15min":0.78100000000000003},"min":{"1min":0.51000000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.181,"5min":4.157,"15min":4.157},"last":0.754},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.79100000000000004,"15min":0.81200000000000006},"min":{"1min":0.48099999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.222,"5min":4.1710000000000003,"15min":4.1710000000000003},"last":0.73799999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574884,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":819200,"data_stored":375836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.38300000000000001,"15min":0.38600000000000001},"min":{"1min":0.24199999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.63300000000000001,"5min":1.458,"15min":1.458},"last":0.318},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.39500000000000002,"15min":0.40000000000000002},"min":{"1min":0.29199999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.53800000000000003,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.34499999999999997}]},{"osd":1,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.40799999999999997,"15min":0.41199999999999998},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.747,"5min":1.512,"15min":1.512},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.442,"15min":0.44900000000000001},"min":{"1min":0.311,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.59499999999999997,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.38}]},{"osd":2,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.376,"15min":0.378},"min":{"1min":0.28100000000000003,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.55600000000000005,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.42799999999999999,"15min":0.42999999999999999},"min":{"1min":0.315,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.70399999999999996,"5min":1.536,"15min":1.536},"last":0.36299999999999999}]},{"osd":4,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.61299999999999999,"15min":0.621},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.72199999999999998,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.752,"5min":1.153,"15min":1.153},"last":0.54300000000000004}]},{"osd":5,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.59299999999999997,"15min":0.59199999999999997},"min":{"1min":0.42299999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.86499999999999999,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.59799999999999998,"15min":0.60599999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.77100000000000002,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.46999999999999997}]},{"osd":6,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.57799999999999996,"15min":0.58099999999999996},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.78300000000000003,"5min":1.113,"15min":1.113},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.61199999999999999,"15min":0.61399999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.82399999999999995,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.63}]},{"osd":7,"last update":"Wed Nov 8 19:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.64400000000000002,"15min":0.65000000000000002},"min":{"1min":0.44700000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.72099999999999997,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.61799999999999999,"15min":0.61699999999999999},"min":{"1min":0.48199999999999998,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.83799999999999997,"5min":1.179,"15min":1.179},"last":0.58599999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574884,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":375794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53800000000000003,"15min":0.53600000000000003},"min":{"1min":0.35699999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.68600000000000005,"5min":1.399,"15min":1.399},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.59099999999999997,"15min":0.59699999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.75700000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.46899999999999997}]},{"osd":1,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.36599999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.499,"15min":0.496},"min":{"1min":0.39700000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.505}]},{"osd":2,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.627,"15min":0.63800000000000001},"min":{"1min":0.377,"5min":0.373,"15min":0.373},"max":{"1min":0.77300000000000002,"5min":2.8490000000000002,"15min":2.8490000000000002},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.52500000000000002,"15min":0.52000000000000002},"min":{"1min":0.434,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.53400000000000003}]},{"osd":3,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.56999999999999995,"15min":0.56399999999999995},"min":{"1min":0.41199999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.71899999999999997,"15min":0.72999999999999998},"min":{"1min":0.53200000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.78500000000000003,"5min":3.4849999999999999,"15min":3.4849999999999999},"last":0.72499999999999998}]},{"osd":5,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52000000000000002,"15min":0.52100000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.68100000000000005,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56100000000000005,"15min":0.55800000000000005},"min":{"1min":0.36299999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.623}]},{"osd":6,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.70199999999999996,"15min":0.72399999999999998},"min":{"1min":0.38,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.83199999999999996,"5min":4.1529999999999996,"15min":4.1529999999999996},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.61399999999999999,"15min":0.61299999999999999},"min":{"1min":0.42699999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.70899999999999996}]},{"osd":7,"last update":"Wed Nov 8 19:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57199999999999995,"15min":0.57099999999999995},"min":{"1min":0.41699999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.80500000000000005,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.83999999999999997,"15min":0.86399999999999999},"min":{"1min":0.55900000000000005,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.87,"5min":5.5359999999999996,"15min":5.5359999999999996},"last":0.751}]}]},{"osd":5,"up_from":13,"seq":55834574884,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":375814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.54400000000000004,"15min":0.54900000000000004},"min":{"1min":0.32300000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.78100000000000003,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.52500000000000002,"15min":0.51900000000000002},"min":{"1min":0.38700000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.745,"5min":0.878,"15min":0.878},"last":0.46700000000000003}]},{"osd":1,"last update":"Wed Nov 8 19:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.54700000000000004,"15min":0.54500000000000004},"min":{"1min":0.32400000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.76300000000000001,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.60399999999999998,"15min":0.60999999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.66300000000000003,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":0.68999999999999995}]},{"osd":2,"last update":"Wed Nov 8 19:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.56000000000000005,"15min":0.55800000000000005},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.68999999999999995,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52800000000000002,"15min":0.52700000000000002},"min":{"1min":0.39400000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.66700000000000004,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.61399999999999999}]},{"osd":3,"last update":"Wed Nov 8 19:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.55700000000000005,"15min":0.55600000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71899999999999997,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57499999999999996,"15min":0.57299999999999995},"min":{"1min":0.46999999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.83699999999999997,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.66300000000000003}]},{"osd":4,"last update":"Wed Nov 8 19:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.59299999999999997,"15min":0.60499999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.80600000000000005,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":0.748},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.63500000000000001,"15min":0.63400000000000001},"min":{"1min":0.49299999999999999,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.81999999999999995,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.77300000000000002}]},{"osd":6,"last update":"Wed Nov 8 19:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.58599999999999997,"15min":0.57999999999999996},"min":{"1min":0.437,"5min":0.37,"15min":0.37},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.65900000000000003,"15min":0.67300000000000004},"min":{"1min":0.38400000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.754,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":0.80500000000000005}]},{"osd":7,"last update":"Wed Nov 8 19:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.627,"15min":0.63},"min":{"1min":0.42399999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.77600000000000002,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.64500000000000002,"15min":0.64900000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.871,"5min":0.873,"15min":0.873},"last":0.78800000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:25:41.291 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-08T19:25:41.292 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-08T19:25:41.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.452+0000 7fd19e0e4700 1 Processor -- start 2023-11-08T19:25:41.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.452+0000 7fd19e0e4700 1 -- start start 2023-11-08T19:25:41.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.452+0000 7fd19e0e4700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd19815dc00 0x7fd1980b27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:41.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.452+0000 7fd19e0e4700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd1980cad20 0x7fd19806ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:41.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.452+0000 7fd19e0e4700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd19815dfe0 con 0x7fd1980b2d30 2023-11-08T19:25:41.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.452+0000 7fd19e0e4700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1980cbe60 con 0x7fd19815dc00 2023-11-08T19:25:41.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.452+0000 7fd19e0e4700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1980cb1e0 con 0x7fd1980cad20 2023-11-08T19:25:41.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.453+0000 7fd1977fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd19815dc00 0x7fd1980b27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:41.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.453+0000 7fd1977fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd19815dc00 0x7fd1980b27f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41418/0 (socket says 172.21.15.149:41418) 2023-11-08T19:25:41.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.453+0000 7fd1977fe700 1 -- 172.21.15.149:0/465713409 learned_addr learned my addr 172.21.15.149:0/465713409 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:41.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.453+0000 7fd196ffd700 1 --2- 172.21.15.149:0/465713409 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd1980cad20 0x7fd19806ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:41.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.453+0000 7fd1977fe700 1 -- 172.21.15.149:0/465713409 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd1980cad20 msgr2=0x7fd19806ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:41.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.453+0000 7fd1977fe700 1 --2- 172.21.15.149:0/465713409 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd1980cad20 0x7fd19806ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:41.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.453+0000 7fd1977fe700 1 -- 172.21.15.149:0/465713409 >> v1:172.21.15.160:6789/0 conn(0x7fd1980b2d30 legacy=0x7fd198071f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:41.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.453+0000 7fd1977fe700 1 -- 172.21.15.149:0/465713409 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1980cb4c0 con 0x7fd19815dc00 2023-11-08T19:25:41.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.453+0000 7fd196ffd700 1 --2- 172.21.15.149:0/465713409 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd1980cad20 0x7fd19806ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:25:41.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.453+0000 7fd1977fe700 1 --2- 172.21.15.149:0/465713409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd19815dc00 0x7fd1980b27f0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fd18c0098f0 tx=0x7fd18c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91eaf42ce8dffd3a server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:41.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.453+0000 7fd1967fc700 1 -- 172.21.15.149:0/465713409 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18c004230 con 0x7fd19815dc00 2023-11-08T19:25:41.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.453+0000 7fd1967fc700 1 -- 172.21.15.149:0/465713409 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd18c004390 con 0x7fd19815dc00 2023-11-08T19:25:41.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.453+0000 7fd1967fc700 1 -- 172.21.15.149:0/465713409 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18c0036a0 con 0x7fd19815dc00 2023-11-08T19:25:41.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.454+0000 7fd19e0e4700 1 -- 172.21.15.149:0/465713409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd19815dc00 msgr2=0x7fd1980b27f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:41.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.454+0000 7fd19e0e4700 1 --2- 172.21.15.149:0/465713409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd19815dc00 0x7fd1980b27f0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fd18c0098f0 tx=0x7fd18c009c00 comp rx=0 tx=0).stop 2023-11-08T19:25:41.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.454+0000 7fd19e0e4700 1 -- 172.21.15.149:0/465713409 shutdown_connections 2023-11-08T19:25:41.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.454+0000 7fd19e0e4700 1 --2- 172.21.15.149:0/465713409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd19815dc00 0x7fd1980b27f0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:41.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.454+0000 7fd19e0e4700 1 --2- 172.21.15.149:0/465713409 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd1980cad20 0x7fd19806ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:41.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.454+0000 7fd19e0e4700 1 -- 172.21.15.149:0/465713409 >> 172.21.15.149:0/465713409 conn(0x7fd19806dfd0 msgr2=0x7fd19806e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:41.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.454+0000 7fd19e0e4700 1 -- 172.21.15.149:0/465713409 shutdown_connections 2023-11-08T19:25:41.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.454+0000 7fd19e0e4700 1 -- 172.21.15.149:0/465713409 wait complete. 2023-11-08T19:25:41.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.455+0000 7fd19e0e4700 1 Processor -- start 2023-11-08T19:25:41.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.455+0000 7fd19e0e4700 1 -- start start 2023-11-08T19:25:41.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.456+0000 7fd19e0e4700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd1980b2d30 0x7fd1980c94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:41.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.456+0000 7fd19e0e4700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1980cad20 0x7fd19815ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:41.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.456+0000 7fd19e0e4700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd19815dc00 0x7fd198154b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:41.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.456+0000 7fd19e0e4700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd19815f120 con 0x7fd1980cad20 2023-11-08T19:25:41.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.456+0000 7fd19e0e4700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd19815f350 con 0x7fd1980b2d30 2023-11-08T19:25:41.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.456+0000 7fd19e0e4700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1981550b0 con 0x7fd19815dc00 2023-11-08T19:25:41.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.456+0000 7fd196ffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1980cad20 0x7fd19815ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:41.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.456+0000 7fd196ffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1980cad20 0x7fd19815ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41426/0 (socket says 172.21.15.149:41426) 2023-11-08T19:25:41.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.456+0000 7fd196ffd700 1 -- 172.21.15.149:0/4084383056 learned_addr learned my addr 172.21.15.149:0/4084383056 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:41.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.456+0000 7fd197fff700 1 --2- 172.21.15.149:0/4084383056 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd19815dc00 0x7fd198154b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:41.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.456+0000 7fd1977fe700 1 --2- 172.21.15.149:0/4084383056 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd1980b2d30 0x7fd1980c94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:41.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.456+0000 7fd196ffd700 1 -- 172.21.15.149:0/4084383056 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd19815dc00 msgr2=0x7fd198154b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:41.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.456+0000 7fd196ffd700 1 --2- 172.21.15.149:0/4084383056 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd19815dc00 0x7fd198154b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:41.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.456+0000 7fd196ffd700 1 -- 172.21.15.149:0/4084383056 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd1980b2d30 msgr2=0x7fd1980c94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:41.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.456+0000 7fd196ffd700 1 --2- 172.21.15.149:0/4084383056 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd1980b2d30 0x7fd1980c94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:41.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.456+0000 7fd196ffd700 1 -- 172.21.15.149:0/4084383056 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd18c009550 con 0x7fd1980cad20 2023-11-08T19:25:41.468 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.456+0000 7fd197fff700 1 --2- 172.21.15.149:0/4084383056 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd19815dc00 0x7fd198154b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:25:41.468 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.456+0000 7fd196ffd700 1 --2- 172.21.15.149:0/4084383056 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1980cad20 0x7fd19815ebe0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fd18800c750 tx=0x7fd18800cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:41.468 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.457+0000 7fd17ffff700 1 -- 172.21.15.149:0/4084383056 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd188011800 con 0x7fd1980cad20 2023-11-08T19:25:41.468 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.457+0000 7fd17ffff700 1 -- 172.21.15.149:0/4084383056 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd188011960 con 0x7fd1980cad20 2023-11-08T19:25:41.468 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.457+0000 7fd19e0e4700 1 -- 172.21.15.149:0/4084383056 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1980c7820 con 0x7fd1980cad20 2023-11-08T19:25:41.469 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.457+0000 7fd17ffff700 1 -- 172.21.15.149:0/4084383056 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd188011cd0 con 0x7fd1980cad20 2023-11-08T19:25:41.469 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.457+0000 7fd19e0e4700 1 -- 172.21.15.149:0/4084383056 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1980c7de0 con 0x7fd1980cad20 2023-11-08T19:25:41.469 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.458+0000 7fd19e0e4700 1 -- 172.21.15.149:0/4084383056 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1980cb780 con 0x7fd1980cad20 2023-11-08T19:25:41.469 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.458+0000 7fd17ffff700 1 -- 172.21.15.149:0/4084383056 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd188021350 con 0x7fd1980cad20 2023-11-08T19:25:41.469 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.458+0000 7fd17ffff700 1 --2- 172.21.15.149:0/4084383056 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd18406af00 0x7fd18406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:41.470 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.459+0000 7fd1977fe700 1 --2- 172.21.15.149:0/4084383056 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd18406af00 0x7fd18406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:41.470 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.459+0000 7fd17ffff700 1 -- 172.21.15.149:0/4084383056 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fd1880897f0 con 0x7fd1980cad20 2023-11-08T19:25:41.470 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.459+0000 7fd1977fe700 1 --2- 172.21.15.149:0/4084383056 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd18406af00 0x7fd18406d3c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd18c009130 tx=0x7fd18c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:41.471 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.463+0000 7fd17ffff700 1 -- 172.21.15.149:0/4084383056 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd1980cb780 con 0x7fd1980cad20 2023-11-08T19:25:41.735 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.734+0000 7fd19e0e4700 1 -- 172.21.15.149:0/4084383056 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fd1980cb780 con 0x7fd1980cad20 2023-11-08T19:25:41.737 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.736+0000 7fd17ffff700 1 -- 172.21.15.149:0/4084383056 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+147 (secure 0 0 0) 0x7fd18801e0b0 con 0x7fd1980cad20 2023-11-08T19:25:41.737 INFO:teuthology.orchestra.run.smithi149.stdout:[client.0] 2023-11-08T19:25:41.738 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDi30tlQEEsNxAAiPozrOREh+IJXoj7ZkhvLg== 2023-11-08T19:25:41.738 INFO:teuthology.orchestra.run.smithi149.stdout: caps mds = "allow" 2023-11-08T19:25:41.738 INFO:teuthology.orchestra.run.smithi149.stdout: caps mon = "allow r" 2023-11-08T19:25:41.738 INFO:teuthology.orchestra.run.smithi149.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-08T19:25:41.740 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.738+0000 7fd19e0e4700 1 -- 172.21.15.149:0/4084383056 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd18406af00 msgr2=0x7fd18406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:41.740 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.738+0000 7fd19e0e4700 1 --2- 172.21.15.149:0/4084383056 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd18406af00 0x7fd18406d3c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd18c009130 tx=0x7fd18c008030 comp rx=0 tx=0).stop 2023-11-08T19:25:41.740 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.738+0000 7fd19e0e4700 1 -- 172.21.15.149:0/4084383056 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1980cad20 msgr2=0x7fd19815ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:41.740 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.738+0000 7fd19e0e4700 1 --2- 172.21.15.149:0/4084383056 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1980cad20 0x7fd19815ebe0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fd18800c750 tx=0x7fd18800cb10 comp rx=0 tx=0).stop 2023-11-08T19:25:41.741 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.739+0000 7fd19e0e4700 1 -- 172.21.15.149:0/4084383056 shutdown_connections 2023-11-08T19:25:41.741 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.739+0000 7fd19e0e4700 1 --2- 172.21.15.149:0/4084383056 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd18406af00 0x7fd18406d3c0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:41.741 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.739+0000 7fd19e0e4700 1 --2- 172.21.15.149:0/4084383056 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd1980b2d30 0x7fd1980c94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:41.741 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.739+0000 7fd19e0e4700 1 --2- 172.21.15.149:0/4084383056 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd19815dc00 0x7fd198154b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:41.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.739+0000 7fd19e0e4700 1 --2- 172.21.15.149:0/4084383056 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1980cad20 0x7fd19815ebe0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:41.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.739+0000 7fd19e0e4700 1 -- 172.21.15.149:0/4084383056 >> 172.21.15.149:0/4084383056 conn(0x7fd19806dfd0 msgr2=0x7fd19815cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:41.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.739+0000 7fd19e0e4700 1 -- 172.21.15.149:0/4084383056 shutdown_connections 2023-11-08T19:25:41.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.739+0000 7fd19e0e4700 1 -- 172.21.15.149:0/4084383056 wait complete. 2023-11-08T19:25:41.743 INFO:teuthology.orchestra.run.smithi149.stderr:updated caps for client.0 2023-11-08T19:25:41.752 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:25:41.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.871+0000 7ff2605b7700 1 Processor -- start 2023-11-08T19:25:41.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.872+0000 7ff2605b7700 1 -- start start 2023-11-08T19:25:41.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.872+0000 7ff2605b7700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff2580ce840 0x7ff2580d0430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:41.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.872+0000 7ff2605b7700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2580cc2e0 con 0x7ff2580cd5e0 2023-11-08T19:25:41.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.872+0000 7ff2605b7700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2580cc580 con 0x7ff25815b950 2023-11-08T19:25:41.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.872+0000 7ff2605b7700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2580cc820 con 0x7ff2580ce840 2023-11-08T19:25:41.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.873+0000 7ff25db52700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7ff2580cd5e0 0x7ff2580cfd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:43436/0 (socket says 172.21.15.149:43436) 2023-11-08T19:25:41.878 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.873+0000 7ff25db52700 1 -- 172.21.15.149:0/1964781387 learned_addr learned my addr 172.21.15.149:0/1964781387 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:25:41.878 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.873+0000 7ff25eb54700 1 --2- 172.21.15.149:0/1964781387 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff2580ce840 0x7ff2580d0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:41.878 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.873+0000 7ff25d351700 1 -- 172.21.15.149:0/1964781387 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 388970389 0 0) 0x7ff2580cc2e0 con 0x7ff2580cd5e0 2023-11-08T19:25:41.878 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.873+0000 7ff25d351700 1 -- 172.21.15.149:0/1964781387 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2440035b0 con 0x7ff2580cd5e0 2023-11-08T19:25:41.879 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.873+0000 7ff25d351700 1 -- 172.21.15.149:0/1964781387 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 811831285 0 0) 0x7ff2440035b0 con 0x7ff2580cd5e0 2023-11-08T19:25:41.879 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.873+0000 7ff25d351700 1 -- 172.21.15.149:0/1964781387 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff2580ce840 msgr2=0x7ff2580d0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:41.879 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.873+0000 7ff25d351700 1 --2- 172.21.15.149:0/1964781387 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff2580ce840 0x7ff2580d0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:41.879 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.873+0000 7ff25d351700 1 -- 172.21.15.149:0/1964781387 >> v1:172.21.15.160:6789/0 conn(0x7ff25815b950 legacy=0x7ff2580ce130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:41.879 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.873+0000 7ff25d351700 1 -- 172.21.15.149:0/1964781387 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2580ccb00 con 0x7ff2580cd5e0 2023-11-08T19:25:41.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.873+0000 7ff25d351700 1 -- 172.21.15.149:0/1964781387 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7ff254001670 con 0x7ff2580cd5e0 2023-11-08T19:25:41.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.873+0000 7ff25d351700 1 -- 172.21.15.149:0/1964781387 >> v1:172.21.15.149:6789/0 conn(0x7ff2580cd5e0 legacy=0x7ff2580cfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:41.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.873+0000 7ff25d351700 1 --2- 172.21.15.149:0/1964781387 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff244003a30 0x7ff244003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:41.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.873+0000 7ff25d351700 1 --2- 172.21.15.149:0/1964781387 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff244004850 0x7ff244004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:41.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.873+0000 7ff25d351700 1 --2- 172.21.15.149:0/1964781387 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff2580ce840 0x7ff244005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:41.881 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.873+0000 7ff25d351700 1 -- 172.21.15.149:0/1964781387 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2580cc820 con 0x7ff244003a30 2023-11-08T19:25:41.881 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.873+0000 7ff25d351700 1 -- 172.21.15.149:0/1964781387 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff24400bb80 con 0x7ff244004850 2023-11-08T19:25:41.881 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.873+0000 7ff25d351700 1 -- 172.21.15.149:0/1964781387 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff24400bd40 con 0x7ff2580ce840 2023-11-08T19:25:41.881 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.873+0000 7ff25e353700 1 --2- 172.21.15.149:0/1964781387 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff244003a30 0x7ff244003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:41.882 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.873+0000 7ff25db52700 1 --2- 172.21.15.149:0/1964781387 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff244004850 0x7ff244004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:41.882 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.873+0000 7ff25eb54700 1 --2- 172.21.15.149:0/1964781387 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff2580ce840 0x7ff244005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:41.882 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.874+0000 7ff25e353700 1 -- 172.21.15.149:0/1964781387 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff2580ce840 msgr2=0x7ff244005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:41.882 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.874+0000 7ff25e353700 1 --2- 172.21.15.149:0/1964781387 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff2580ce840 0x7ff244005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:41.883 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.874+0000 7ff25e353700 1 -- 172.21.15.149:0/1964781387 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff244004850 msgr2=0x7ff244004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:41.883 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.874+0000 7ff25e353700 1 --2- 172.21.15.149:0/1964781387 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff244004850 0x7ff244004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:41.883 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.874+0000 7ff25e353700 1 -- 172.21.15.149:0/1964781387 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2440035b0 con 0x7ff244003a30 2023-11-08T19:25:41.883 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.874+0000 7ff25eb54700 1 --2- 172.21.15.149:0/1964781387 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff2580ce840 0x7ff244005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:25:41.883 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.874+0000 7ff25e353700 1 --2- 172.21.15.149:0/1964781387 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff244003a30 0x7ff244003e50 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7ff2480017f0 tx=0x7ff244005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52f620b3ede3f26 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:41.884 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.874+0000 7ff25d351700 1 -- 172.21.15.149:0/1964781387 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2480012e0 con 0x7ff244003a30 2023-11-08T19:25:41.884 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.874+0000 7ff25d351700 1 -- 172.21.15.149:0/1964781387 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2480052d0 con 0x7ff244003a30 2023-11-08T19:25:41.884 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.874+0000 7ff25d351700 1 -- 172.21.15.149:0/1964781387 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2480036d0 con 0x7ff244003a30 2023-11-08T19:25:41.884 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.874+0000 7ff2605b7700 1 -- 172.21.15.149:0/1964781387 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff244003a30 msgr2=0x7ff244003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:41.884 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.874+0000 7ff2605b7700 1 --2- 172.21.15.149:0/1964781387 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff244003a30 0x7ff244003e50 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7ff2480017f0 tx=0x7ff244005880 comp rx=0 tx=0).stop 2023-11-08T19:25:41.885 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.874+0000 7ff25eb54700 1 -- 172.21.15.149:0/1964781387 reap_dead start 2023-11-08T19:25:41.885 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.875+0000 7ff2605b7700 1 -- 172.21.15.149:0/1964781387 shutdown_connections 2023-11-08T19:25:41.885 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.875+0000 7ff2605b7700 1 -- 172.21.15.149:0/1964781387 >> 172.21.15.149:0/1964781387 conn(0x7ff25808afd0 msgr2=0x7ff2580d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:41.885 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.875+0000 7ff2605b7700 1 -- 172.21.15.149:0/1964781387 shutdown_connections 2023-11-08T19:25:41.885 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.875+0000 7ff2605b7700 1 -- 172.21.15.149:0/1964781387 wait complete. 2023-11-08T19:25:41.886 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.876+0000 7ff2605b7700 1 Processor -- start 2023-11-08T19:25:41.886 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.876+0000 7ff2605b7700 1 -- start start 2023-11-08T19:25:41.888 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.876+0000 7ff2605b7700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff244003a30 0x7ff258154320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:41.889 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.876+0000 7ff2605b7700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff258154b50 0x7ff2581e52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:41.889 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.876+0000 7ff2605b7700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff2581e5810 0x7ff2581e5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:41.889 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.876+0000 7ff2605b7700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2580c9420 con 0x7ff258154b50 2023-11-08T19:25:41.889 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.877+0000 7ff2605b7700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff258154860 con 0x7ff244003a30 2023-11-08T19:25:41.889 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.877+0000 7ff2605b7700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2580cab60 con 0x7ff2581e5810 2023-11-08T19:25:41.890 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.877+0000 7ff25db52700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff258154b50 0x7ff2581e52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:41.890 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.877+0000 7ff25db52700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff258154b50 0x7ff2581e52d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41446/0 (socket says 172.21.15.149:41446) 2023-11-08T19:25:41.890 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.877+0000 7ff25db52700 1 -- 172.21.15.149:0/1455354005 learned_addr learned my addr 172.21.15.149:0/1455354005 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:41.890 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.877+0000 7ff25eb54700 1 --2- 172.21.15.149:0/1455354005 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff2581e5810 0x7ff2581e5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:41.890 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.877+0000 7ff25e353700 1 --2- 172.21.15.149:0/1455354005 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff244003a30 0x7ff258154320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:41.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.877+0000 7ff25db52700 1 -- 172.21.15.149:0/1455354005 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff2581e5810 msgr2=0x7ff2581e5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:41.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.877+0000 7ff25db52700 1 --2- 172.21.15.149:0/1455354005 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff2581e5810 0x7ff2581e5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:41.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.877+0000 7ff25db52700 1 -- 172.21.15.149:0/1455354005 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff244003a30 msgr2=0x7ff258154320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:41.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.877+0000 7ff25db52700 1 --2- 172.21.15.149:0/1455354005 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff244003a30 0x7ff258154320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:41.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.877+0000 7ff25db52700 1 -- 172.21.15.149:0/1455354005 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2580c8810 con 0x7ff258154b50 2023-11-08T19:25:41.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.877+0000 7ff25db52700 1 --2- 172.21.15.149:0/1455354005 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff258154b50 0x7ff2581e52d0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7ff2540072c0 tx=0x7ff2540075d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:41.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.877+0000 7ff24effd700 1 -- 172.21.15.149:0/1455354005 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff254011580 con 0x7ff258154b50 2023-11-08T19:25:41.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.877+0000 7ff24effd700 1 -- 172.21.15.149:0/1455354005 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff254011720 con 0x7ff258154b50 2023-11-08T19:25:41.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.877+0000 7ff2605b7700 1 -- 172.21.15.149:0/1455354005 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2580c8af0 con 0x7ff258154b50 2023-11-08T19:25:41.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.877+0000 7ff24effd700 1 -- 172.21.15.149:0/1455354005 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff254011ad0 con 0x7ff258154b50 2023-11-08T19:25:41.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.877+0000 7ff2605b7700 1 -- 172.21.15.149:0/1455354005 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2580c90b0 con 0x7ff258154b50 2023-11-08T19:25:41.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.878+0000 7ff2605b7700 1 -- 172.21.15.149:0/1455354005 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2580c95d0 con 0x7ff258154b50 2023-11-08T19:25:41.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.879+0000 7ff24effd700 1 -- 172.21.15.149:0/1455354005 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff254011c30 con 0x7ff258154b50 2023-11-08T19:25:41.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.879+0000 7ff24effd700 1 --2- 172.21.15.149:0/1455354005 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff23c06af00 0x7ff23c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:41.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.880+0000 7ff24effd700 1 -- 172.21.15.149:0/1455354005 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6382+0+0 (secure 0 0 0) 0x7ff25408a020 con 0x7ff258154b50 2023-11-08T19:25:41.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.880+0000 7ff25e353700 1 --2- 172.21.15.149:0/1455354005 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff23c06af00 0x7ff23c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:41.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.880+0000 7ff25e353700 1 --2- 172.21.15.149:0/1455354005 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff23c06af00 0x7ff23c06d3c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff248000c00 tx=0x7ff248009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:41.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:41.883+0000 7ff24effd700 1 -- 172.21.15.149:0/1455354005 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff254054ec0 con 0x7ff258154b50 2023-11-08T19:25:42.116 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.115+0000 7ff2605b7700 1 -- 172.21.15.149:0/1455354005 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff2580745f0 con 0x7ff258154b50 2023-11-08T19:25:42.117 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.116+0000 7ff24effd700 1 -- 172.21.15.149:0/1455354005 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4927 (secure 0 0 0) 0x7ff25401a310 con 0x7ff258154b50 2023-11-08T19:25:42.117 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:25:42.118 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5800,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/3460600894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3460600894},{"type":"v1","addr":"172.21.15.160:6834","nonce":3460600894}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":6165,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2549531465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2549531465},{"type":"v1","addr":"172.21.15.149:6835","nonce":2549531465}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":6180,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/4179310374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":4179310374},{"type":"v1","addr":"172.21.15.160:6835","nonce":4179310374}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-08T19:25:31.608945+0000","modified":"2023-11-08T19:25:34.626063+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6189},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6189":{"gid":6189,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6837/1548429999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":1548429999},{"type":"v1","addr":"172.21.15.149:6837","nonce":1548429999}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-08T19:25:42.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.118+0000 7ff2605b7700 1 -- 172.21.15.149:0/1455354005 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff23c06af00 msgr2=0x7ff23c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:42.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.118+0000 7ff2605b7700 1 --2- 172.21.15.149:0/1455354005 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff23c06af00 0x7ff23c06d3c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff248000c00 tx=0x7ff248009030 comp rx=0 tx=0).stop 2023-11-08T19:25:42.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.118+0000 7ff2605b7700 1 -- 172.21.15.149:0/1455354005 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff258154b50 msgr2=0x7ff2581e52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:42.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.118+0000 7ff2605b7700 1 --2- 172.21.15.149:0/1455354005 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff258154b50 0x7ff2581e52d0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7ff2540072c0 tx=0x7ff2540075d0 comp rx=0 tx=0).stop 2023-11-08T19:25:42.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.118+0000 7ff2605b7700 1 -- 172.21.15.149:0/1455354005 shutdown_connections 2023-11-08T19:25:42.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.118+0000 7ff2605b7700 1 --2- 172.21.15.149:0/1455354005 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff23c06af00 0x7ff23c06d3c0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:42.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.118+0000 7ff2605b7700 1 --2- 172.21.15.149:0/1455354005 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff244003a30 0x7ff258154320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:42.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.118+0000 7ff2605b7700 1 --2- 172.21.15.149:0/1455354005 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff2581e5810 0x7ff2581e5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:42.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.118+0000 7ff2605b7700 1 --2- 172.21.15.149:0/1455354005 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff258154b50 0x7ff2581e52d0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:42.122 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.118+0000 7ff2605b7700 1 -- 172.21.15.149:0/1455354005 >> 172.21.15.149:0/1455354005 conn(0x7ff25808afd0 msgr2=0x7ff25815eb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:42.122 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.118+0000 7ff2605b7700 1 -- 172.21.15.149:0/1455354005 shutdown_connections 2023-11-08T19:25:42.122 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.118+0000 7ff2605b7700 1 -- 172.21.15.149:0/1455354005 wait complete. 2023-11-08T19:25:42.122 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 35 2023-11-08T19:25:42.534 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 35, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-08T19:25:31.608945+0000', 'modified': '2023-11-08T19:25:34.626063+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6189}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6189': {'gid': 6189, 'name': 'a', 'rank': 0, 'incarnation': 31, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.149:6837/1548429999', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6836', 'nonce': 1548429999}, {'type': 'v1', 'addr': '172.21.15.149:6837', 'nonce': 1548429999}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-08T19:25:42.534 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-08T19:25:42.535 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-08T19:25:42.658 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.657+0000 7f5b0dff8700 1 Processor -- start 2023-11-08T19:25:42.658 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.657+0000 7f5b0dff8700 1 -- start start 2023-11-08T19:25:42.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.658+0000 7f5b0dff8700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b080cc140 0x7f5b080cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:42.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.658+0000 7f5b0dff8700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f5b080b2850 0x7f5b080cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:42.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.658+0000 7f5b0dff8700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b080cce50 con 0x7f5b080b2cd0 2023-11-08T19:25:42.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.658+0000 7f5b0dff8700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b080b2430 con 0x7f5b080b2850 2023-11-08T19:25:42.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.658+0000 7f5b0dff8700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b080cc520 con 0x7f5b080cc140 2023-11-08T19:25:42.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.658+0000 7f5b06ffd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f5b080b2850 0x7f5b080cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:42.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.658+0000 7f5b06ffd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f5b080b2850 0x7f5b080cabf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41454/0 (socket says 172.21.15.149:41454) 2023-11-08T19:25:42.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.658+0000 7f5b06ffd700 1 -- 172.21.15.149:0/1908985186 learned_addr learned my addr 172.21.15.149:0/1908985186 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:42.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.658+0000 7f5b077fe700 1 --2- 172.21.15.149:0/1908985186 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b080cc140 0x7f5b080cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:42.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.658+0000 7f5b06ffd700 1 -- 172.21.15.149:0/1908985186 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b080cc140 msgr2=0x7f5b080cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:42.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.658+0000 7f5b06ffd700 1 --2- 172.21.15.149:0/1908985186 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b080cc140 0x7f5b080cc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:42.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.658+0000 7f5b06ffd700 1 -- 172.21.15.149:0/1908985186 >> v1:172.21.15.160:6789/0 conn(0x7f5b080b2cd0 legacy=0x7f5b0815d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:42.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.658+0000 7f5b06ffd700 1 -- 172.21.15.149:0/1908985186 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b080b17b0 con 0x7f5b080b2850 2023-11-08T19:25:42.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.658+0000 7f5b06ffd700 1 --2- 172.21.15.149:0/1908985186 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b080b2850 0x7f5b080cabf0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f5afc0098f0 tx=0x7f5afc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eaeae2fc1a25198 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:42.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.658+0000 7f5b067fc700 1 -- 172.21.15.149:0/1908985186 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc004230 con 0x7f5b080b2850 2023-11-08T19:25:42.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.658+0000 7f5b067fc700 1 -- 172.21.15.149:0/1908985186 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5afc004390 con 0x7f5b080b2850 2023-11-08T19:25:42.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.658+0000 7f5b067fc700 1 -- 172.21.15.149:0/1908985186 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc0036a0 con 0x7f5b080b2850 2023-11-08T19:25:42.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.659+0000 7f5b0dff8700 1 -- 172.21.15.149:0/1908985186 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b080b2850 msgr2=0x7f5b080cabf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:42.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.659+0000 7f5b0dff8700 1 --2- 172.21.15.149:0/1908985186 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b080b2850 0x7f5b080cabf0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f5afc0098f0 tx=0x7f5afc009c00 comp rx=0 tx=0).stop 2023-11-08T19:25:42.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.659+0000 7f5b0dff8700 1 -- 172.21.15.149:0/1908985186 shutdown_connections 2023-11-08T19:25:42.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.659+0000 7f5b0dff8700 1 --2- 172.21.15.149:0/1908985186 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b080cc140 0x7f5b080cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:42.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.659+0000 7f5b0dff8700 1 --2- 172.21.15.149:0/1908985186 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b080b2850 0x7f5b080cabf0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:42.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.659+0000 7f5b0dff8700 1 -- 172.21.15.149:0/1908985186 >> 172.21.15.149:0/1908985186 conn(0x7f5b08099a40 msgr2=0x7f5b080d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:42.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.659+0000 7f5b0dff8700 1 -- 172.21.15.149:0/1908985186 shutdown_connections 2023-11-08T19:25:42.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.659+0000 7f5b0dff8700 1 -- 172.21.15.149:0/1908985186 wait complete. 2023-11-08T19:25:42.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.660+0000 7f5b0dff8700 1 Processor -- start 2023-11-08T19:25:42.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.660+0000 7f5b0dff8700 1 -- start start 2023-11-08T19:25:42.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.661+0000 7f5b0dff8700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b080b2850 0x7f5b081f75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:42.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.661+0000 7f5b0dff8700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b080b2cd0 0x7f5b08156c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:42.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.661+0000 7f5b0dff8700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b080cc140 0x7f5b081f3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:42.675 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.661+0000 7f5b0dff8700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b081f6b60 con 0x7f5b080cc140 2023-11-08T19:25:42.675 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.661+0000 7f5b0dff8700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b081f4030 con 0x7f5b080b2850 2023-11-08T19:25:42.675 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.661+0000 7f5b0dff8700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b081f4310 con 0x7f5b080b2cd0 2023-11-08T19:25:42.675 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.661+0000 7f5b07fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b080cc140 0x7f5b081f3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:42.675 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.661+0000 7f5b07fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b080cc140 0x7f5b081f3570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41462/0 (socket says 172.21.15.149:41462) 2023-11-08T19:25:42.676 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.661+0000 7f5b07fff700 1 -- 172.21.15.149:0/2311992399 learned_addr learned my addr 172.21.15.149:0/2311992399 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:42.676 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.661+0000 7f5b06ffd700 1 --2- 172.21.15.149:0/2311992399 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b080b2cd0 0x7f5b08156c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:42.676 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.661+0000 7f5b077fe700 1 --2- 172.21.15.149:0/2311992399 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b080b2850 0x7f5b081f75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:42.676 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.662+0000 7f5b07fff700 1 -- 172.21.15.149:0/2311992399 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b080b2cd0 msgr2=0x7f5b08156c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:42.676 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.662+0000 7f5b07fff700 1 --2- 172.21.15.149:0/2311992399 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b080b2cd0 0x7f5b08156c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:42.677 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.662+0000 7f5b07fff700 1 -- 172.21.15.149:0/2311992399 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b080b2850 msgr2=0x7f5b081f75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:42.677 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.662+0000 7f5b07fff700 1 --2- 172.21.15.149:0/2311992399 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b080b2850 0x7f5b081f75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:42.677 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.662+0000 7f5b07fff700 1 -- 172.21.15.149:0/2311992399 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5afc009550 con 0x7f5b080cc140 2023-11-08T19:25:42.677 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.662+0000 7f5b07fff700 1 --2- 172.21.15.149:0/2311992399 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b080cc140 0x7f5b081f3570 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f5b0000cc10 tx=0x7f5b0000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:42.678 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.662+0000 7f5aeffff700 1 -- 172.21.15.149:0/2311992399 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0000abb0 con 0x7f5b080cc140 2023-11-08T19:25:42.678 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.662+0000 7f5aeffff700 1 -- 172.21.15.149:0/2311992399 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b0000ad10 con 0x7f5b080cc140 2023-11-08T19:25:42.678 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.662+0000 7f5b0dff8700 1 -- 172.21.15.149:0/2311992399 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b081f6db0 con 0x7f5b080cc140 2023-11-08T19:25:42.678 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.662+0000 7f5aeffff700 1 -- 172.21.15.149:0/2311992399 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b00012660 con 0x7f5b080cc140 2023-11-08T19:25:42.678 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.662+0000 7f5b0dff8700 1 -- 172.21.15.149:0/2311992399 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b08157150 con 0x7f5b080cc140 2023-11-08T19:25:42.679 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.663+0000 7f5aeffff700 1 -- 172.21.15.149:0/2311992399 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5b000127c0 con 0x7f5b080cc140 2023-11-08T19:25:42.679 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.664+0000 7f5aeffff700 1 --2- 172.21.15.149:0/2311992399 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5af406af00 0x7f5af406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:42.679 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.664+0000 7f5aeffff700 1 -- 172.21.15.149:0/2311992399 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f5b0008a0f0 con 0x7f5b080cc140 2023-11-08T19:25:42.679 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.664+0000 7f5b077fe700 1 --2- 172.21.15.149:0/2311992399 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5af406af00 0x7f5af406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:42.679 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.664+0000 7f5b077fe700 1 --2- 172.21.15.149:0/2311992399 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5af406af00 0x7f5af406d3c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f5af8006fd0 tx=0x7f5af8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:42.680 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.666+0000 7f5b1a1f1b80 1 Processor -- start 2023-11-08T19:25:42.680 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.666+0000 7f5b1a1f1b80 1 -- start start 2023-11-08T19:25:42.680 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.667+0000 7f5b1a1f1b80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x564bcb0c06f0 0x564bcb0f0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:42.680 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.667+0000 7f5b1a1f1b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564bcb0c2c30 0x564bcb0f0990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:42.680 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.667+0000 7f5b1a1f1b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564bcb0c0ad0 0x564bcb0daf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:42.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.667+0000 7f5b1a1f1b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bcb02c6e0 con 0x564bcb0c0ad0 2023-11-08T19:25:42.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.667+0000 7f5b1a1f1b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bcb0203b0 con 0x564bcb0c2c30 2023-11-08T19:25:42.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.667+0000 7f5b1a1f1b80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x564bcb01dcd0 con 0x564bcb0c06f0 2023-11-08T19:25:42.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.667+0000 7f5b07fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564bcb0c0ad0 0x564bcb0daf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:42.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.667+0000 7f5b07fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564bcb0c0ad0 0x564bcb0daf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41470/0 (socket says 172.21.15.149:41470) 2023-11-08T19:25:42.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.667+0000 7f5b07fff700 1 -- 172.21.15.149:0/3049946832 learned_addr learned my addr 172.21.15.149:0/3049946832 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:42.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.667+0000 7f5b077fe700 1 --2- 172.21.15.149:0/3049946832 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x564bcb0c06f0 0x564bcb0f0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:42.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.667+0000 7f5b06ffd700 1 --2- 172.21.15.149:0/3049946832 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564bcb0c2c30 0x564bcb0f0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:42.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.667+0000 7f5b07fff700 1 -- 172.21.15.149:0/3049946832 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x564bcb0c06f0 msgr2=0x564bcb0f0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:42.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.667+0000 7f5b07fff700 1 --2- 172.21.15.149:0/3049946832 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x564bcb0c06f0 0x564bcb0f0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:42.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.667+0000 7f5b07fff700 1 -- 172.21.15.149:0/3049946832 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564bcb0c2c30 msgr2=0x564bcb0f0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:42.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.667+0000 7f5b07fff700 1 --2- 172.21.15.149:0/3049946832 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564bcb0c2c30 0x564bcb0f0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:42.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.667+0000 7f5b07fff700 1 -- 172.21.15.149:0/3049946832 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564bcae965e0 con 0x564bcb0c0ad0 2023-11-08T19:25:42.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.667+0000 7f5b077fe700 1 --2- 172.21.15.149:0/3049946832 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x564bcb0c06f0 0x564bcb0f0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:25:42.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.667+0000 7f5b06ffd700 1 --2- 172.21.15.149:0/3049946832 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564bcb0c2c30 0x564bcb0f0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:25:42.684 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.667+0000 7f5b07fff700 1 --2- 172.21.15.149:0/3049946832 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564bcb0c0ad0 0x564bcb0daf90 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f5b0000a6b0 tx=0x7f5b00058520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f996686f9cef5287 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:42.684 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.668+0000 7f5aed7fa700 1 -- 172.21.15.149:0/3049946832 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b00070070 con 0x564bcb0c0ad0 2023-11-08T19:25:42.684 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.668+0000 7f5aed7fa700 1 -- 172.21.15.149:0/3049946832 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b00058b40 con 0x564bcb0c0ad0 2023-11-08T19:25:42.684 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.668+0000 7f5aed7fa700 1 -- 172.21.15.149:0/3049946832 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0005cc90 con 0x564bcb0c0ad0 2023-11-08T19:25:42.684 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.668+0000 7f5b1a1f1b80 1 -- 172.21.15.149:0/3049946832 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564bcb0c0ad0 msgr2=0x564bcb0daf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:42.685 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.668+0000 7f5b1a1f1b80 1 --2- 172.21.15.149:0/3049946832 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564bcb0c0ad0 0x564bcb0daf90 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f5b0000a6b0 tx=0x7f5b00058520 comp rx=0 tx=0).stop 2023-11-08T19:25:42.685 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.668+0000 7f5b1a1f1b80 1 -- 172.21.15.149:0/3049946832 shutdown_connections 2023-11-08T19:25:42.685 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.668+0000 7f5b1a1f1b80 1 --2- 172.21.15.149:0/3049946832 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564bcb0c0ad0 0x564bcb0daf90 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:42.685 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.668+0000 7f5b1a1f1b80 1 --2- 172.21.15.149:0/3049946832 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x564bcb0c06f0 0x564bcb0f0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:42.685 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.668+0000 7f5b1a1f1b80 1 --2- 172.21.15.149:0/3049946832 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564bcb0c2c30 0x564bcb0f0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:42.686 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.668+0000 7f5b1a1f1b80 1 -- 172.21.15.149:0/3049946832 >> 172.21.15.149:0/3049946832 conn(0x564bcb03b660 msgr2=0x564bcb0c63c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:42.686 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.668+0000 7f5b1a1f1b80 1 -- 172.21.15.149:0/3049946832 shutdown_connections 2023-11-08T19:25:42.686 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.668+0000 7f5b1a1f1b80 1 -- 172.21.15.149:0/3049946832 wait complete. 2023-11-08T19:25:42.686 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.669+0000 7f5b1a1f1b80 1 -- start start 2023-11-08T19:25:42.686 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.669+0000 7f5b1a1f1b80 1 Processor -- start 2023-11-08T19:25:42.687 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.670+0000 7f5b1a1f1b80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x564bcb0c06f0 0x564bcb11d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:42.687 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.670+0000 7f5b1a1f1b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564bcb0c0ad0 0x564bcb1027f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:42.687 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.670+0000 7f5b1a1f1b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564bcb0ef700 0x564bcb0efb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:42.687 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.670+0000 7f5b1a1f1b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bcb0195c0 con 0x564bcb0ef700 2023-11-08T19:25:42.687 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.670+0000 7f5b1a1f1b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bcafb50d0 con 0x564bcb0c0ad0 2023-11-08T19:25:42.688 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.670+0000 7f5b1a1f1b80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x564bcafb4d70 con 0x564bcb0c06f0 2023-11-08T19:25:42.688 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.670+0000 7f5b1a1f1b80 10 client.0 _ll_register_callbacks cb 0x564bcae117b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-08T19:25:42.688 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.670+0000 7f5b07fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564bcb0ef700 0x564bcb0efb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:42.688 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.670+0000 7f5b07fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564bcb0ef700 0x564bcb0efb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41476/0 (socket says 172.21.15.149:41476) 2023-11-08T19:25:42.688 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.670+0000 7f5b07fff700 1 -- 172.21.15.149:0/3015635939 learned_addr learned my addr 172.21.15.149:0/3015635939 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:42.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.670+0000 7f5b06ffd700 1 --2- 172.21.15.149:0/3015635939 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564bcb0c0ad0 0x564bcb1027f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:42.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.670+0000 7f5b077fe700 1 --2- 172.21.15.149:0/3015635939 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x564bcb0c06f0 0x564bcb11d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:42.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.670+0000 7f5b07fff700 1 -- 172.21.15.149:0/3015635939 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x564bcb0c06f0 msgr2=0x564bcb11d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:42.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.670+0000 7f5b07fff700 1 --2- 172.21.15.149:0/3015635939 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x564bcb0c06f0 0x564bcb11d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:42.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.670+0000 7f5b07fff700 1 -- 172.21.15.149:0/3015635939 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564bcb0c0ad0 msgr2=0x564bcb1027f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:42.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.670+0000 7f5b07fff700 1 --2- 172.21.15.149:0/3015635939 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564bcb0c0ad0 0x564bcb1027f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:42.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.670+0000 7f5b07fff700 1 -- 172.21.15.149:0/3015635939 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b08157150 con 0x564bcb0ef700 2023-11-08T19:25:42.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.670+0000 7f5b07fff700 1 --2- 172.21.15.149:0/3015635939 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564bcb0ef700 0x564bcb0efb80 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f5b0000cfd0 tx=0x7f5b0000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8072eed3f17192ef server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:42.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.670+0000 7f5ae67fc700 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2023-11-08T19:25:42.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.670+0000 7f5ae67fc700 1 -- 172.21.15.149:0/3015635939 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b00070040 con 0x564bcb0ef700 2023-11-08T19:25:42.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.670+0000 7f5ae67fc700 1 -- 172.21.15.149:0/3015635939 <== mon.0 v2:172.21.15.149:3300/0 2 ==== osd_map(67..67 src has 1..67) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f5b0005cc90 con 0x564bcb0ef700 2023-11-08T19:25:42.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.670+0000 7f5b1a1f1b80 1 -- 172.21.15.149:0/3015635939 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564bcb0b8880 con 0x564bcb0ef700 2023-11-08T19:25:42.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.671+0000 7f5ae67fc700 1 -- 172.21.15.149:0/3015635939 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5b000880b0 con 0x564bcb0ef700 2023-11-08T19:25:42.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.671+0000 7f5b1a1f1b80 10 client.6342 fetch_fsmap learned FSMap version 35 2023-11-08T19:25:42.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.671+0000 7f5b1a1f1b80 1 -- 172.21.15.149:0/3015635939 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) v3 -- 0x564bcae42d90 con 0x564bcb0ef700 2023-11-08T19:25:42.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.671+0000 7f5ae67fc700 1 -- 172.21.15.149:0/3015635939 <== mon.0 v2:172.21.15.149:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564bcb0b8880 con 0x564bcb0ef700 2023-11-08T19:25:42.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.671+0000 7f5ae67fc700 1 -- 172.21.15.149:0/3015635939 <== mon.0 v2:172.21.15.149:3300/0 5 ==== fsmap(e 35) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f5b000609b0 con 0x564bcb0ef700 2023-11-08T19:25:42.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.671+0000 7f5b1a1f1b80 10 client.6342 fetch_fsmap finished waiting for FSMap version 35 2023-11-08T19:25:42.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.671+0000 7f5b1a1f1b80 10 client.6342 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-08T19:25:42.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.671+0000 7f5b1a1f1b80 20 client.6342 populate_metadata read hostname 'smithi149' 2023-11-08T19:25:42.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.671+0000 7f5b1a1f1b80 1 --2- 172.21.15.149:0/3015635939 >> [v2:172.21.15.149:6836/1548429999,v1:172.21.15.149:6837/1548429999] conn(0x564bcb0e2060 0x564bcb0f15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:42.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.671+0000 7f5b1a1f1b80 4 client.6342 mds_command: new command op to 6189 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-08T19:25:42.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.671+0000 7f5b1a1f1b80 1 -- 172.21.15.149:0/3015635939 --> [v2:172.21.15.149:6836/1548429999,v1:172.21.15.149:6837/1548429999] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564bcb094a30 con 0x564bcb0e2060 2023-11-08T19:25:42.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.671+0000 7f5b077fe700 1 --2- 172.21.15.149:0/3015635939 >> [v2:172.21.15.149:6836/1548429999,v1:172.21.15.149:6837/1548429999] conn(0x564bcb0e2060 0x564bcb0f15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:42.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.671+0000 7f5ae67fc700 10 client.6342 ms_handle_connect on v2:172.21.15.149:6836/1548429999 2023-11-08T19:25:42.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.671+0000 7f5b077fe700 1 --2- 172.21.15.149:0/3015635939 >> [v2:172.21.15.149:6836/1548429999,v1:172.21.15.149:6837/1548429999] conn(0x564bcb0e2060 0x564bcb0f15c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=866f3cf6485bd68c server_cookie=733decfe002e39e0 in_seq=0 out_seq=0 2023-11-08T19:25:42.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.672+0000 7f5ae67fc700 1 -- 172.21.15.149:0/3015635939 <== mds.0 v2:172.21.15.149:6836/1548429999 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564bcb094a30 con 0x564bcb0e2060 2023-11-08T19:25:42.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.672+0000 7f5ae67fc700 10 client.6342 handle_command_reply: tid=0 2023-11-08T19:25:42.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.672+0000 7f5b1a1f1b80 1 client.6342 shutdown 2023-11-08T19:25:42.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.672+0000 7f5b1a1f1b80 1 -- 172.21.15.149:0/3015635939 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564bcb0ef700 msgr2=0x564bcb0efb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:42.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.672+0000 7f5b1a1f1b80 1 --2- 172.21.15.149:0/3015635939 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564bcb0ef700 0x564bcb0efb80 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f5b0000cfd0 tx=0x7f5b0000a620 comp rx=0 tx=0).stop 2023-11-08T19:25:42.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.672+0000 7f5b1a1f1b80 1 -- 172.21.15.149:0/3015635939 shutdown_connections 2023-11-08T19:25:42.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.672+0000 7f5b1a1f1b80 1 --2- 172.21.15.149:0/3015635939 >> [v2:172.21.15.149:6836/1548429999,v1:172.21.15.149:6837/1548429999] conn(0x564bcb0e2060 0x564bcb0f15c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:42.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.672+0000 7f5b1a1f1b80 1 --2- 172.21.15.149:0/3015635939 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564bcb0ef700 0x564bcb0efb80 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:42.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.672+0000 7f5ae67fc700 0 client.6342 ms_handle_reset on v2:172.21.15.149:6836/1548429999 2023-11-08T19:25:42.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.672+0000 7f5b1a1f1b80 1 --2- 172.21.15.149:0/3015635939 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x564bcb0c06f0 0x564bcb11d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:42.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.672+0000 7f5b1a1f1b80 1 --2- 172.21.15.149:0/3015635939 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564bcb0c0ad0 0x564bcb1027f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:42.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.672+0000 7f5b1a1f1b80 1 -- 172.21.15.149:0/3015635939 >> 172.21.15.149:0/3015635939 conn(0x564bcb03b660 msgr2=0x564bcb0dbdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:42.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.672+0000 7f5b1a1f1b80 1 -- 172.21.15.149:0/3015635939 shutdown_connections 2023-11-08T19:25:42.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.672+0000 7f5b1a1f1b80 1 -- 172.21.15.149:0/3015635939 wait complete. 2023-11-08T19:25:42.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.672+0000 7f5b1a1f1b80 20 client.6342 trim_cache size 0 max 16384 2023-11-08T19:25:42.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.690+0000 7f5b1a1f1b80 1 Processor -- start 2023-11-08T19:25:42.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.690+0000 7f5b1a1f1b80 1 -- start start 2023-11-08T19:25:42.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.691+0000 7f5b1a1f1b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564bcb0c06f0 0x564bcb0c34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:42.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.691+0000 7f5b1a1f1b80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x564bcb0c0ad0 0x564bcb0f2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:42.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.691+0000 7f5b1a1f1b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564bcb0ef700 0x564bcb0f2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:42.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.691+0000 7f5b1a1f1b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bcae988d0 con 0x564bcb0c06f0 2023-11-08T19:25:42.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.691+0000 7f5b1a1f1b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bcb0c1a50 con 0x564bcb0ef700 2023-11-08T19:25:42.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.691+0000 7f5b1a1f1b80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x564bcb0c7bf0 con 0x564bcb0c0ad0 2023-11-08T19:25:42.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.691+0000 7f5b077fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564bcb0c06f0 0x564bcb0c34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:42.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.691+0000 7f5b077fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564bcb0c06f0 0x564bcb0c34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41480/0 (socket says 172.21.15.149:41480) 2023-11-08T19:25:42.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.691+0000 7f5b077fe700 1 -- 172.21.15.149:0/2194254378 learned_addr learned my addr 172.21.15.149:0/2194254378 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:42.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.691+0000 7f5b07fff700 1 --2- 172.21.15.149:0/2194254378 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564bcb0ef700 0x564bcb0f2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:42.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.691+0000 7f5b077fe700 1 -- 172.21.15.149:0/2194254378 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x564bcb0c0ad0 msgr2=0x564bcb0f2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:42.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.691+0000 7f5b077fe700 1 --2- 172.21.15.149:0/2194254378 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x564bcb0c0ad0 0x564bcb0f2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:42.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.691+0000 7f5b077fe700 1 -- 172.21.15.149:0/2194254378 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564bcb0ef700 msgr2=0x564bcb0f2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:42.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.691+0000 7f5b077fe700 1 --2- 172.21.15.149:0/2194254378 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564bcb0ef700 0x564bcb0f2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:42.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.691+0000 7f5b077fe700 1 -- 172.21.15.149:0/2194254378 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564bcae2bc10 con 0x564bcb0c06f0 2023-11-08T19:25:42.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.691+0000 7f5b07fff700 1 --2- 172.21.15.149:0/2194254378 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564bcb0ef700 0x564bcb0f2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:25:42.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.692+0000 7f5b077fe700 1 --2- 172.21.15.149:0/2194254378 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564bcb0c06f0 0x564bcb0c34c0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f5af800b7b0 tx=0x7f5af8018040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=161ca2408b4e407a server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:42.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.692+0000 7f5aedffb700 1 -- 172.21.15.149:0/2194254378 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af8028040 con 0x564bcb0c06f0 2023-11-08T19:25:42.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.692+0000 7f5aedffb700 1 -- 172.21.15.149:0/2194254378 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5af8029d00 con 0x564bcb0c06f0 2023-11-08T19:25:42.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.692+0000 7f5aedffb700 1 -- 172.21.15.149:0/2194254378 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af800fee0 con 0x564bcb0c06f0 2023-11-08T19:25:42.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.692+0000 7f5b1a1f1b80 1 -- 172.21.15.149:0/2194254378 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564bcb0c06f0 msgr2=0x564bcb0c34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:42.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.692+0000 7f5b1a1f1b80 1 --2- 172.21.15.149:0/2194254378 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564bcb0c06f0 0x564bcb0c34c0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f5af800b7b0 tx=0x7f5af8018040 comp rx=0 tx=0).stop 2023-11-08T19:25:42.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.692+0000 7f5b1a1f1b80 1 -- 172.21.15.149:0/2194254378 shutdown_connections 2023-11-08T19:25:42.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.692+0000 7f5b1a1f1b80 1 --2- 172.21.15.149:0/2194254378 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564bcb0ef700 0x564bcb0f2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:42.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.692+0000 7f5b1a1f1b80 1 --2- 172.21.15.149:0/2194254378 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564bcb0c06f0 0x564bcb0c34c0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:42.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.692+0000 7f5b1a1f1b80 1 --2- 172.21.15.149:0/2194254378 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x564bcb0c0ad0 0x564bcb0f2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:42.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.692+0000 7f5b1a1f1b80 1 -- 172.21.15.149:0/2194254378 >> 172.21.15.149:0/2194254378 conn(0x564bcb03b660 msgr2=0x564bcb0bc7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:42.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.692+0000 7f5b1a1f1b80 1 -- 172.21.15.149:0/2194254378 shutdown_connections 2023-11-08T19:25:42.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.692+0000 7f5b1a1f1b80 1 -- 172.21.15.149:0/2194254378 wait complete. 2023-11-08T19:25:42.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.693+0000 7f5b1a1f1b80 1 -- start start 2023-11-08T19:25:42.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.693+0000 7f5b1a1f1b80 1 Processor -- start 2023-11-08T19:25:42.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.694+0000 7f5b1a1f1b80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x564bcb0c06f0 0x564bcb11cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:42.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.694+0000 7f5b1a1f1b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564bcb0c0ad0 0x564bcb0c12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:42.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.694+0000 7f5b1a1f1b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564bcb0ef700 0x564bcb177490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:42.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.694+0000 7f5b1a1f1b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bcb0f21c0 con 0x564bcb0ef700 2023-11-08T19:25:42.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.694+0000 7f5b1a1f1b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bcb0f26c0 con 0x564bcb0c0ad0 2023-11-08T19:25:42.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.694+0000 7f5b1a1f1b80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x564bcb178290 con 0x564bcb0c06f0 2023-11-08T19:25:42.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.694+0000 7f5b1a1f1b80 10 client.0 _ll_register_callbacks cb 0x7f5b00060e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-08T19:25:42.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.694+0000 7f5b07fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564bcb0ef700 0x564bcb177490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:42.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.694+0000 7f5b07fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564bcb0ef700 0x564bcb177490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41488/0 (socket says 172.21.15.149:41488) 2023-11-08T19:25:42.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.694+0000 7f5b07fff700 1 -- 172.21.15.149:0/2002469232 learned_addr learned my addr 172.21.15.149:0/2002469232 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:42.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.694+0000 7f5b077fe700 1 --2- 172.21.15.149:0/2002469232 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x564bcb0c06f0 0x564bcb11cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:42.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.694+0000 7f5b06ffd700 1 --2- 172.21.15.149:0/2002469232 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564bcb0c0ad0 0x564bcb0c12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:42.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.694+0000 7f5b07fff700 1 -- 172.21.15.149:0/2002469232 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x564bcb0c06f0 msgr2=0x564bcb11cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:42.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.694+0000 7f5b07fff700 1 --2- 172.21.15.149:0/2002469232 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x564bcb0c06f0 0x564bcb11cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:42.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.694+0000 7f5b07fff700 1 -- 172.21.15.149:0/2002469232 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564bcb0c0ad0 msgr2=0x564bcb0c12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:42.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.694+0000 7f5b07fff700 1 --2- 172.21.15.149:0/2002469232 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564bcb0c0ad0 0x564bcb0c12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:42.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.694+0000 7f5b07fff700 1 -- 172.21.15.149:0/2002469232 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5af800e040 con 0x564bcb0ef700 2023-11-08T19:25:42.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.694+0000 7f5b07fff700 1 --2- 172.21.15.149:0/2002469232 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564bcb0ef700 0x564bcb177490 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f5b00058540 tx=0x7f5b0001c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3f4986c2eb618ff server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:42.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.694+0000 7f5ae67fc700 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2023-11-08T19:25:42.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.694+0000 7f5ae67fc700 1 -- 172.21.15.149:0/2002469232 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b00070040 con 0x564bcb0ef700 2023-11-08T19:25:42.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.694+0000 7f5ae67fc700 1 -- 172.21.15.149:0/2002469232 <== mon.0 v2:172.21.15.149:3300/0 2 ==== osd_map(67..67 src has 1..67) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f5b000701a0 con 0x564bcb0ef700 2023-11-08T19:25:42.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.694+0000 7f5b1a1f1b80 1 -- 172.21.15.149:0/2002469232 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5b00058b40 con 0x564bcb0ef700 2023-11-08T19:25:42.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.695+0000 7f5ae67fc700 1 -- 172.21.15.149:0/2002469232 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5b00058680 con 0x564bcb0ef700 2023-11-08T19:25:42.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.695+0000 7f5b1a1f1b80 10 client.6348 fetch_fsmap learned FSMap version 35 2023-11-08T19:25:42.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.695+0000 7f5b1a1f1b80 1 -- 172.21.15.149:0/2002469232 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) v3 -- 0x564bcae69200 con 0x564bcb0ef700 2023-11-08T19:25:42.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.695+0000 7f5ae67fc700 1 -- 172.21.15.149:0/2002469232 <== mon.0 v2:172.21.15.149:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b00058b40 con 0x564bcb0ef700 2023-11-08T19:25:42.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.695+0000 7f5ae67fc700 1 -- 172.21.15.149:0/2002469232 <== mon.0 v2:172.21.15.149:3300/0 5 ==== fsmap(e 35) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f5b000609b0 con 0x564bcb0ef700 2023-11-08T19:25:42.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.695+0000 7f5b1a1f1b80 10 client.6348 fetch_fsmap finished waiting for FSMap version 35 2023-11-08T19:25:42.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.695+0000 7f5b1a1f1b80 10 client.6348 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-08T19:25:42.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.695+0000 7f5b1a1f1b80 20 client.6348 populate_metadata read hostname 'smithi149' 2023-11-08T19:25:42.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.695+0000 7f5b1a1f1b80 1 --2- 172.21.15.149:0/2002469232 >> [v2:172.21.15.149:6836/1548429999,v1:172.21.15.149:6837/1548429999] conn(0x564bcb177bc0 0x564bcb173520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:42.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.695+0000 7f5b1a1f1b80 4 client.6348 mds_command: new command op to 6189 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-08T19:25:42.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.695+0000 7f5b1a1f1b80 1 -- 172.21.15.149:0/2002469232 --> [v2:172.21.15.149:6836/1548429999,v1:172.21.15.149:6837/1548429999] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564bcb0125a0 con 0x564bcb177bc0 2023-11-08T19:25:42.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.695+0000 7f5b077fe700 1 --2- 172.21.15.149:0/2002469232 >> [v2:172.21.15.149:6836/1548429999,v1:172.21.15.149:6837/1548429999] conn(0x564bcb177bc0 0x564bcb173520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:42.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.695+0000 7f5ae67fc700 10 client.6348 ms_handle_connect on v2:172.21.15.149:6836/1548429999 2023-11-08T19:25:42.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.695+0000 7f5b077fe700 1 --2- 172.21.15.149:0/2002469232 >> [v2:172.21.15.149:6836/1548429999,v1:172.21.15.149:6837/1548429999] conn(0x564bcb177bc0 0x564bcb173520 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56e78f669d5246de server_cookie=c65bde8fd9751fef in_seq=0 out_seq=0 2023-11-08T19:25:42.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.695+0000 7f5ae67fc700 1 -- 172.21.15.149:0/2002469232 <== mds.0 v2:172.21.15.149:6836/1548429999 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+319 (crc 0 0 0) 0x564bcb0125a0 con 0x564bcb177bc0 2023-11-08T19:25:42.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.695+0000 7f5ae67fc700 10 client.6348 handle_command_reply: tid=0 2023-11-08T19:25:42.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.695+0000 7f5b1a1f1b80 1 client.6348 shutdown 2023-11-08T19:25:42.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.696+0000 7f5b1a1f1b80 1 -- 172.21.15.149:0/2002469232 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564bcb0ef700 msgr2=0x564bcb177490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:42.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.696+0000 7f5b1a1f1b80 1 --2- 172.21.15.149:0/2002469232 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564bcb0ef700 0x564bcb177490 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f5b00058540 tx=0x7f5b0001c000 comp rx=0 tx=0).stop 2023-11-08T19:25:42.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.696+0000 7f5b1a1f1b80 1 -- 172.21.15.149:0/2002469232 shutdown_connections 2023-11-08T19:25:42.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.696+0000 7f5b1a1f1b80 1 --2- 172.21.15.149:0/2002469232 >> [v2:172.21.15.149:6836/1548429999,v1:172.21.15.149:6837/1548429999] conn(0x564bcb177bc0 0x564bcb173520 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:42.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.696+0000 7f5b1a1f1b80 1 --2- 172.21.15.149:0/2002469232 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564bcb0ef700 0x564bcb177490 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:42.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.696+0000 7f5ae67fc700 0 client.6348 ms_handle_reset on v2:172.21.15.149:6836/1548429999 2023-11-08T19:25:42.719 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.696+0000 7f5b1a1f1b80 1 --2- 172.21.15.149:0/2002469232 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x564bcb0c06f0 0x564bcb11cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:42.719 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.696+0000 7f5b1a1f1b80 1 --2- 172.21.15.149:0/2002469232 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564bcb0c0ad0 0x564bcb0c12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:42.719 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.696+0000 7f5b1a1f1b80 1 -- 172.21.15.149:0/2002469232 >> 172.21.15.149:0/2002469232 conn(0x564bcb03b660 msgr2=0x564bcb0c48f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:42.719 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.696+0000 7f5b1a1f1b80 1 -- 172.21.15.149:0/2002469232 shutdown_connections 2023-11-08T19:25:42.719 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.696+0000 7f5b1a1f1b80 1 -- 172.21.15.149:0/2002469232 wait complete. 2023-11-08T19:25:42.720 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.696+0000 7f5b1a1f1b80 20 client.6348 trim_cache size 0 max 16384 2023-11-08T19:25:42.720 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2023-11-08T19:25:42.720 INFO:teuthology.orchestra.run.smithi149.stdout: "cluster_fsid": "0aba7c70-fe80-4446-a2f5-7502ac3adfb4", 2023-11-08T19:25:42.721 INFO:teuthology.orchestra.run.smithi149.stdout: "whoami": 0, 2023-11-08T19:25:42.721 INFO:teuthology.orchestra.run.smithi149.stdout: "id": 6189, 2023-11-08T19:25:42.721 INFO:teuthology.orchestra.run.smithi149.stdout: "want_state": "up:active", 2023-11-08T19:25:42.721 INFO:teuthology.orchestra.run.smithi149.stdout: "state": "up:active", 2023-11-08T19:25:42.721 INFO:teuthology.orchestra.run.smithi149.stdout: "fs_name": "cephfs", 2023-11-08T19:25:42.722 INFO:teuthology.orchestra.run.smithi149.stdout: "rank_uptime": 10.479783351, 2023-11-08T19:25:42.722 INFO:teuthology.orchestra.run.smithi149.stdout: "mdsmap_epoch": 35, 2023-11-08T19:25:42.722 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_epoch": 67, 2023-11-08T19:25:42.722 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_epoch_barrier": 67, 2023-11-08T19:25:42.722 INFO:teuthology.orchestra.run.smithi149.stdout: "uptime": 17.445331347 2023-11-08T19:25:42.723 INFO:teuthology.orchestra.run.smithi149.stdout:} 2023-11-08T19:25:42.724 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.696+0000 7f5b0dff8700 1 -- 172.21.15.149:0/2311992399 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5af406af00 msgr2=0x7f5af406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:42.724 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.696+0000 7f5b0dff8700 1 --2- 172.21.15.149:0/2311992399 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5af406af00 0x7f5af406d3c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f5af8006fd0 tx=0x7f5af8008040 comp rx=0 tx=0).stop 2023-11-08T19:25:42.725 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.696+0000 7f5b0dff8700 1 -- 172.21.15.149:0/2311992399 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b080cc140 msgr2=0x7f5b081f3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:42.725 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.696+0000 7f5b0dff8700 1 --2- 172.21.15.149:0/2311992399 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b080cc140 0x7f5b081f3570 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f5b0000cc10 tx=0x7f5b0000a060 comp rx=0 tx=0).stop 2023-11-08T19:25:42.725 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.696+0000 7f5b0dff8700 1 -- 172.21.15.149:0/2311992399 shutdown_connections 2023-11-08T19:25:42.725 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.696+0000 7f5b0dff8700 1 --2- 172.21.15.149:0/2311992399 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5af406af00 0x7f5af406d3c0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:42.725 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.696+0000 7f5b0dff8700 1 --2- 172.21.15.149:0/2311992399 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b080b2850 0x7f5b081f75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:42.726 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.696+0000 7f5b0dff8700 1 --2- 172.21.15.149:0/2311992399 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b080cc140 0x7f5b081f3570 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:42.726 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.696+0000 7f5b0dff8700 1 --2- 172.21.15.149:0/2311992399 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b080b2cd0 0x7f5b08156c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:42.726 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.696+0000 7f5b0dff8700 1 -- 172.21.15.149:0/2311992399 >> 172.21.15.149:0/2311992399 conn(0x7f5b08099a40 msgr2=0x7f5b080c7670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:42.726 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.696+0000 7f5b0dff8700 1 -- 172.21.15.149:0/2311992399 shutdown_connections 2023-11-08T19:25:42.726 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.696+0000 7f5b0dff8700 1 -- 172.21.15.149:0/2311992399 wait complete. 2023-11-08T19:25:42.727 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-08T19:25:42.848 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.847+0000 7f3ff8d7b700 1 Processor -- start 2023-11-08T19:25:42.849 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.847+0000 7f3ff8d7b700 1 -- start start 2023-11-08T19:25:42.851 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.848+0000 7f3ff8d7b700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ff40cd5e0 0x7f3ff40cfd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:42.851 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.848+0000 7f3ff8d7b700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3ff40ce840 0x7f3ff40d0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:42.851 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.848+0000 7f3ff8d7b700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ff40d07a0 con 0x7f3ff415b950 2023-11-08T19:25:42.852 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.848+0000 7f3ff8d7b700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ff40cc2e0 con 0x7f3ff40ce840 2023-11-08T19:25:42.852 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.848+0000 7f3ff8d7b700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff40cc580 con 0x7f3ff40cd5e0 2023-11-08T19:25:42.852 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.848+0000 7f3ff2d9d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3ff40ce840 0x7f3ff40d0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:42.852 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.848+0000 7f3ff259c700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f3ff415b950 0x7f3ff40ce130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:43496/0 (socket says 172.21.15.149:43496) 2023-11-08T19:25:42.852 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.848+0000 7f3ff2d9d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3ff40ce840 0x7f3ff40d0260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41498/0 (socket says 172.21.15.149:41498) 2023-11-08T19:25:42.853 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.848+0000 7f3ff259c700 1 -- 172.21.15.149:0/2089842151 learned_addr learned my addr 172.21.15.149:0/2089842151 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:25:42.853 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.848+0000 7f3ff1d9b700 1 --2- 172.21.15.149:0/2089842151 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ff40cd5e0 0x7f3ff40cfd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:42.853 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.848+0000 7f3ff2d9d700 1 -- 172.21.15.149:0/2089842151 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ff40cd5e0 msgr2=0x7f3ff40cfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:42.853 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.848+0000 7f3ff2d9d700 1 --2- 172.21.15.149:0/2089842151 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ff40cd5e0 0x7f3ff40cfd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:42.853 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.849+0000 7f3ff2d9d700 1 -- 172.21.15.149:0/2089842151 >> v1:172.21.15.149:6789/0 conn(0x7f3ff415b950 legacy=0x7f3ff40ce130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:42.853 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.849+0000 7f3ff2d9d700 1 -- 172.21.15.149:0/2089842151 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff40cc820 con 0x7f3ff40ce840 2023-11-08T19:25:42.854 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.849+0000 7f3ff159a700 1 -- 172.21.15.149:0/2089842151 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3324112677 0 0) 0x7f3ff40d07a0 con 0x7f3ff415b950 2023-11-08T19:25:42.854 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.849+0000 7f3ff2d9d700 1 --2- 172.21.15.149:0/2089842151 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ff40ce840 0x7f3ff40d0260 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f3fec009d90 tx=0x7f3fec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=307dab82d31851e8 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:42.854 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.849+0000 7f3ff159a700 1 -- 172.21.15.149:0/2089842151 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fec00e070 con 0x7f3ff40ce840 2023-11-08T19:25:42.854 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.849+0000 7f3ff159a700 1 -- 172.21.15.149:0/2089842151 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fec00bbd0 con 0x7f3ff40ce840 2023-11-08T19:25:42.854 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.849+0000 7f3ff159a700 1 -- 172.21.15.149:0/2089842151 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fec012430 con 0x7f3ff40ce840 2023-11-08T19:25:42.855 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.849+0000 7f3ff8d7b700 1 -- 172.21.15.149:0/2089842151 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ff40ce840 msgr2=0x7f3ff40d0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:42.855 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.849+0000 7f3ff8d7b700 1 --2- 172.21.15.149:0/2089842151 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ff40ce840 0x7f3ff40d0260 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f3fec009d90 tx=0x7f3fec00b330 comp rx=0 tx=0).stop 2023-11-08T19:25:42.855 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.849+0000 7f3ff8d7b700 1 -- 172.21.15.149:0/2089842151 shutdown_connections 2023-11-08T19:25:42.855 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.849+0000 7f3ff8d7b700 1 --2- 172.21.15.149:0/2089842151 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ff40ce840 0x7f3ff40d0260 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:42.855 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.849+0000 7f3ff8d7b700 1 --2- 172.21.15.149:0/2089842151 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ff40cd5e0 0x7f3ff40cfd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:42.856 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.849+0000 7f3ff8d7b700 1 -- 172.21.15.149:0/2089842151 >> 172.21.15.149:0/2089842151 conn(0x7f3ff408afd0 msgr2=0x7f3ff40d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:42.856 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.849+0000 7f3ff8d7b700 1 -- 172.21.15.149:0/2089842151 shutdown_connections 2023-11-08T19:25:42.856 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.850+0000 7f3ff8d7b700 1 -- 172.21.15.149:0/2089842151 wait complete. 2023-11-08T19:25:42.859 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.851+0000 7f3ff8d7b700 1 Processor -- start 2023-11-08T19:25:42.859 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.851+0000 7f3ff8d7b700 1 -- start start 2023-11-08T19:25:42.859 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.852+0000 7f3ff8d7b700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ff40ce840 0x7f3ff41f5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:42.859 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.852+0000 7f3ff8d7b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ff415b950 0x7f3ff41472b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:42.860 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.852+0000 7f3ff8d7b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ff40b4520 0x7f3ff40aed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:42.860 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.852+0000 7f3ff8d7b700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff41f5dd0 con 0x7f3ff415b950 2023-11-08T19:25:42.860 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.852+0000 7f3ff8d7b700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff4147db0 con 0x7f3ff40b4520 2023-11-08T19:25:42.860 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.852+0000 7f3ff8d7b700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff4148090 con 0x7f3ff40ce840 2023-11-08T19:25:42.860 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.852+0000 7f3ff1d9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ff415b950 0x7f3ff41472b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:42.861 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.852+0000 7f3ff1d9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ff415b950 0x7f3ff41472b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41502/0 (socket says 172.21.15.149:41502) 2023-11-08T19:25:42.861 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.852+0000 7f3ff1d9b700 1 -- 172.21.15.149:0/1189446164 learned_addr learned my addr 172.21.15.149:0/1189446164 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:42.861 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.852+0000 7f3ff2d9d700 1 --2- 172.21.15.149:0/1189446164 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ff40b4520 0x7f3ff40aed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:42.861 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.852+0000 7f3ff259c700 1 --2- 172.21.15.149:0/1189446164 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ff40ce840 0x7f3ff41f5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:42.861 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.852+0000 7f3ff1d9b700 1 -- 172.21.15.149:0/1189446164 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ff40ce840 msgr2=0x7f3ff41f5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:42.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.852+0000 7f3ff1d9b700 1 --2- 172.21.15.149:0/1189446164 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ff40ce840 0x7f3ff41f5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:42.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.852+0000 7f3ff1d9b700 1 -- 172.21.15.149:0/1189446164 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ff40b4520 msgr2=0x7f3ff40aed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:42.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.852+0000 7f3ff1d9b700 1 --2- 172.21.15.149:0/1189446164 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ff40b4520 0x7f3ff40aed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:42.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.852+0000 7f3ff1d9b700 1 -- 172.21.15.149:0/1189446164 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fec009a70 con 0x7f3ff415b950 2023-11-08T19:25:42.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.852+0000 7f3ff259c700 1 --2- 172.21.15.149:0/1189446164 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ff40ce840 0x7f3ff41f5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:25:42.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.852+0000 7f3ff2d9d700 1 --2- 172.21.15.149:0/1189446164 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ff40b4520 0x7f3ff40aed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:25:42.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.852+0000 7f3ff1d9b700 1 --2- 172.21.15.149:0/1189446164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ff415b950 0x7f3ff41472b0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f3fe400e810 tx=0x7f3fe400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:42.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.852+0000 7f3fe2ffd700 1 -- 172.21.15.149:0/1189446164 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe4013610 con 0x7f3ff415b950 2023-11-08T19:25:42.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.852+0000 7f3fe2ffd700 1 -- 172.21.15.149:0/1189446164 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fe4013770 con 0x7f3ff415b950 2023-11-08T19:25:42.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.852+0000 7f3fe2ffd700 1 -- 172.21.15.149:0/1189446164 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe4013b00 con 0x7f3ff415b950 2023-11-08T19:25:42.864 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.852+0000 7f3ff8d7b700 1 -- 172.21.15.149:0/1189446164 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ff4148370 con 0x7f3ff415b950 2023-11-08T19:25:42.864 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.852+0000 7f3ff8d7b700 1 -- 172.21.15.149:0/1189446164 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ff4148930 con 0x7f3ff415b950 2023-11-08T19:25:42.864 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.853+0000 7f3ff8d7b700 1 -- 172.21.15.149:0/1189446164 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ff40b0400 con 0x7f3ff415b950 2023-11-08T19:25:42.864 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.854+0000 7f3fe2ffd700 1 -- 172.21.15.149:0/1189446164 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3fe4013c60 con 0x7f3ff415b950 2023-11-08T19:25:42.864 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.854+0000 7f3fe2ffd700 1 --2- 172.21.15.149:0/1189446164 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3fd406af00 0x7f3fd406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:42.865 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.854+0000 7f3fe2ffd700 1 -- 172.21.15.149:0/1189446164 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f3fe4089470 con 0x7f3ff415b950 2023-11-08T19:25:42.865 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.854+0000 7f3ff259c700 1 --2- 172.21.15.149:0/1189446164 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3fd406af00 0x7f3fd406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:42.865 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.855+0000 7f3ff259c700 1 --2- 172.21.15.149:0/1189446164 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3fd406af00 0x7f3fd406d3c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f3fe8001730 tx=0x7f3fe8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:42.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:42.859+0000 7f3fe2ffd700 1 -- 172.21.15.149:0/1189446164 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3fe4054310 con 0x7f3ff415b950 2023-11-08T19:25:43.093 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:43.092+0000 7f3ff8d7b700 1 -- 172.21.15.149:0/1189446164 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3ff40745f0 con 0x7f3ff415b950 2023-11-08T19:25:43.094 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:43.093+0000 7f3fe2ffd700 1 -- 172.21.15.149:0/1189446164 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v35) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3fe405ce60 con 0x7f3ff415b950 2023-11-08T19:25:43.094 INFO:teuthology.orchestra.run.smithi149.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-08T19:25:43.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:43.095+0000 7f3ff8d7b700 1 -- 172.21.15.149:0/1189446164 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3fd406af00 msgr2=0x7f3fd406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:43.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:43.095+0000 7f3ff8d7b700 1 --2- 172.21.15.149:0/1189446164 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3fd406af00 0x7f3fd406d3c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f3fe8001730 tx=0x7f3fe8009040 comp rx=0 tx=0).stop 2023-11-08T19:25:43.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:43.095+0000 7f3ff8d7b700 1 -- 172.21.15.149:0/1189446164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ff415b950 msgr2=0x7f3ff41472b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:43.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:43.095+0000 7f3ff8d7b700 1 --2- 172.21.15.149:0/1189446164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ff415b950 0x7f3ff41472b0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f3fe400e810 tx=0x7f3fe400ebd0 comp rx=0 tx=0).stop 2023-11-08T19:25:43.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:43.095+0000 7f3ff8d7b700 1 -- 172.21.15.149:0/1189446164 shutdown_connections 2023-11-08T19:25:43.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:43.095+0000 7f3ff8d7b700 1 --2- 172.21.15.149:0/1189446164 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3fd406af00 0x7f3fd406d3c0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:43.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:43.095+0000 7f3ff8d7b700 1 --2- 172.21.15.149:0/1189446164 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ff40b4520 0x7f3ff40aed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:43.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:43.095+0000 7f3ff8d7b700 1 --2- 172.21.15.149:0/1189446164 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ff40ce840 0x7f3ff41f5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:43.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:43.095+0000 7f3ff8d7b700 1 --2- 172.21.15.149:0/1189446164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ff415b950 0x7f3ff41472b0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:43.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:43.095+0000 7f3ff8d7b700 1 -- 172.21.15.149:0/1189446164 >> 172.21.15.149:0/1189446164 conn(0x7f3ff408afd0 msgr2=0x7f3ff4159930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:43.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:43.095+0000 7f3ff8d7b700 1 -- 172.21.15.149:0/1189446164 shutdown_connections 2023-11-08T19:25:43.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:43.095+0000 7f3ff8d7b700 1 -- 172.21.15.149:0/1189446164 wait complete. 2023-11-08T19:25:43.108 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-08T19:25:43.109 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-08T19:25:43.109 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi149.front.sepia.ceph.com 2023-11-08T19:25:43.109 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-08T19:25:43.110 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-08T19:25:43.110 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-08T19:25:43.110 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-08T19:25:43.111 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-08T19:25:43.111 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-08T19:25:43.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:25:43.112 DEBUG:teuthology.orchestra.run.smithi149:> ip addr 2023-11-08T19:25:43.129 INFO:teuthology.orchestra.run.smithi149.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-08T19:25:43.129 INFO:teuthology.orchestra.run.smithi149.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-08T19:25:43.129 INFO:teuthology.orchestra.run.smithi149.stdout: inet 127.0.0.1/8 scope host lo 2023-11-08T19:25:43.129 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:25:43.130 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 ::1/128 scope host 2023-11-08T19:25:43.130 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:25:43.130 INFO:teuthology.orchestra.run.smithi149.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-08T19:25:43.130 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a4 brd ff:ff:ff:ff:ff:ff 2023-11-08T19:25:43.131 INFO:teuthology.orchestra.run.smithi149.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-08T19:25:43.131 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a5 brd ff:ff:ff:ff:ff:ff 2023-11-08T19:25:43.131 INFO:teuthology.orchestra.run.smithi149.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-08T19:25:43.131 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:56 brd ff:ff:ff:ff:ff:ff 2023-11-08T19:25:43.132 INFO:teuthology.orchestra.run.smithi149.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-08T19:25:43.132 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:57 brd ff:ff:ff:ff:ff:ff 2023-11-08T19:25:43.132 INFO:teuthology.orchestra.run.smithi149.stdout: inet 172.21.15.149/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-08T19:25:43.132 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft 42251sec preferred_lft 42251sec 2023-11-08T19:25:43.132 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::a27d:6f0d:7890:36f/64 scope link noprefixroute 2023-11-08T19:25:43.132 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:25:43.133 INFO:teuthology.orchestra.run.smithi149.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-08T19:25:43.133 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 82:12:e7:85:4e:11 brd ff:ff:ff:ff:ff:ff 2023-11-08T19:25:43.133 INFO:teuthology.orchestra.run.smithi149.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-08T19:25:43.133 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:25:43.133 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::4c22:cdff:fed4:d829/64 scope link 2023-11-08T19:25:43.134 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:25:43.134 INFO:teuthology.orchestra.run.smithi149.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-08T19:25:43.134 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether e6:a6:23:51:6c:ef brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-08T19:25:43.134 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::e4a6:23ff:fe51:6cef/64 scope link 2023-11-08T19:25:43.134 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:25:43.135 INFO:teuthology.orchestra.run.smithi149.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-08T19:25:43.135 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 82:12:e7:85:4e:11 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-08T19:25:43.135 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::8012:e7ff:fe85:4e11/64 scope link 2023-11-08T19:25:43.135 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:25:43.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:25:43.136 DEBUG:teuthology.orchestra.run.smithi149:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-08T19:25:43.196 INFO:teuthology.orchestra.run.smithi149.stdout:1 2023-11-08T19:25:43.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:25:43.198 DEBUG:teuthology.orchestra.run.smithi149:> route 2023-11-08T19:25:43.256 INFO:teuthology.orchestra.run.smithi149.stdout:Kernel IP routing table 2023-11-08T19:25:43.257 INFO:teuthology.orchestra.run.smithi149.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-08T19:25:43.257 INFO:teuthology.orchestra.run.smithi149.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-08T19:25:43.257 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-08T19:25:43.257 INFO:teuthology.orchestra.run.smithi149.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-08T19:25:43.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:25:43.258 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec bash -c ' 2023-11-08T19:25:43.259 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2023-11-08T19:25:43.259 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-08T19:25:43.259 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-08T19:25:43.260 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-08T19:25:43.260 DEBUG:teuthology.orchestra.run.smithi149:> ') 2023-11-08T19:25:43.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:25:43.364 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2023-11-08T19:25:43.383 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-08T19:25:43.385 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-08T19:25:43.386 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-08T19:25:43.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:25:43.387 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set brx.0 up 2023-11-08T19:25:43.450 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-08T19:25:43.450 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-08T19:25:43.507 INFO:teuthology.orchestra.run.smithi149.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-08T19:25:43.507 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-08T19:25:43.508 DEBUG:teuthology.orchestra.run.smithi149:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-08T19:25:43.563 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-08T19:25:43.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:25:43.564 DEBUG:teuthology.orchestra.run.smithi149:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-08T19:25:43.648 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-08T19:25:43.648 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-08T19:25:43.648 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2023-11-08T19:25:43.657 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-08T19:25:43.657 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-08T19:25:43.657 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2023-11-08T19:25:43.657 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.149:3300,172.21.15.160:3300,172.21.15.160:3301" 2023-11-08T19:25:43.658 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-08T19:25:43.731 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-08T19:25:43.731 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-08T19:25:43.731 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2023-11-08T19:25:43.731 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.149:3300,172.21.15.160:3300,172.21.15.160:3301" 2023-11-08T19:25:43.732 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-08T19:25:43.732 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.149:6789,172.21.15.160:6789,172.21.15.160:6790" 2023-11-08T19:25:43.732 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.149:6789,172.21.15.160:6789,172.21.15.160:6790:/ 2023-11-08T19:25:43.732 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=0aba7c70-fe80-4446-a2f5-7502ac3adfb4" will pass to kernel 2023-11-08T19:25:43.733 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-08T19:25:43.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:25:43.734 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-08T19:25:43.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:25:43.762 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-08T19:25:43.843 INFO:teuthology.orchestra.run.smithi149.stdout:client5929 2023-11-08T19:25:43.843 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-11-08T19:25:43.844 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:25:43.901 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create test_data_pool 2023-11-08T19:25:44.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.062+0000 7f92922ed700 1 Processor -- start 2023-11-08T19:25:44.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.062+0000 7f92922ed700 1 -- start start 2023-11-08T19:25:44.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.063+0000 7f92922ed700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f928c15abf0 0x7f928c0b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:44.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.063+0000 7f92922ed700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f928c0d1130 0x7f928c0cc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:44.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.063+0000 7f92922ed700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f928c0cc6a0 0x7f928c0ce210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:44.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.063+0000 7f92922ed700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f928c0b66a0 con 0x7f928c15abf0 2023-11-08T19:25:44.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.063+0000 7f92922ed700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f928c0d04a0 con 0x7f928c0cc6a0 2023-11-08T19:25:44.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.063+0000 7f92922ed700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f928c0b6470 con 0x7f928c0d1130 2023-11-08T19:25:44.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.063+0000 7f928bfff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f928c15abf0 0x7f928c0b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:44.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.063+0000 7f928bfff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f928c15abf0 0x7f928c0b5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41512/0 (socket says 172.21.15.149:41512) 2023-11-08T19:25:44.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.063+0000 7f928bfff700 1 -- 172.21.15.149:0/1903717176 learned_addr learned my addr 172.21.15.149:0/1903717176 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:44.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.063+0000 7f928b7fe700 1 --2- 172.21.15.149:0/1903717176 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f928c0d1130 0x7f928c0cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:44.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.063+0000 7f929088a700 1 --2- 172.21.15.149:0/1903717176 >> v2:172.21.15.160:3300/0 conn(0x7f928c0cc6a0 0x7f928c0ce210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:44.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.063+0000 7f928bfff700 1 -- 172.21.15.149:0/1903717176 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f928c0d1130 msgr2=0x7f928c0cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:44.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.063+0000 7f928bfff700 1 --2- 172.21.15.149:0/1903717176 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f928c0d1130 0x7f928c0cc160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:44.070 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.063+0000 7f928bfff700 1 -- 172.21.15.149:0/1903717176 >> v2:172.21.15.160:3300/0 conn(0x7f928c0cc6a0 msgr2=0x7f928c0ce210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:44.070 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.063+0000 7f928bfff700 1 --2- 172.21.15.149:0/1903717176 >> v2:172.21.15.160:3300/0 conn(0x7f928c0cc6a0 0x7f928c0ce210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:44.071 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.063+0000 7f928bfff700 1 -- 172.21.15.149:0/1903717176 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f928c15afd0 con 0x7f928c15abf0 2023-11-08T19:25:44.071 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.063+0000 7f928b7fe700 1 --2- 172.21.15.149:0/1903717176 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f928c0d1130 0x7f928c0cc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:25:44.071 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.063+0000 7f929088a700 1 --2- 172.21.15.149:0/1903717176 >> v2:172.21.15.160:3300/0 conn(0x7f928c0cc6a0 0x7f928c0ce210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:25:44.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.064+0000 7f928bfff700 1 --2- 172.21.15.149:0/1903717176 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f928c15abf0 0x7f928c0b5f30 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f928c069350 tx=0x7f9280009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a46ec937b9004666 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:44.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.064+0000 7f928affd700 1 -- 172.21.15.149:0/1903717176 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928000b870 con 0x7f928c15abf0 2023-11-08T19:25:44.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.064+0000 7f928affd700 1 -- 172.21.15.149:0/1903717176 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f928000b9d0 con 0x7f928c15abf0 2023-11-08T19:25:44.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.064+0000 7f928affd700 1 -- 172.21.15.149:0/1903717176 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928000bd60 con 0x7f928c15abf0 2023-11-08T19:25:44.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.064+0000 7f92922ed700 1 -- 172.21.15.149:0/1903717176 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f928c15abf0 msgr2=0x7f928c0b5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:44.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.064+0000 7f92922ed700 1 --2- 172.21.15.149:0/1903717176 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f928c15abf0 0x7f928c0b5f30 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f928c069350 tx=0x7f9280009bd0 comp rx=0 tx=0).stop 2023-11-08T19:25:44.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.064+0000 7f92922ed700 1 -- 172.21.15.149:0/1903717176 shutdown_connections 2023-11-08T19:25:44.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.064+0000 7f92922ed700 1 --2- 172.21.15.149:0/1903717176 >> v2:172.21.15.160:3300/0 conn(0x7f928c0cc6a0 0x7f928c0ce210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:44.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.064+0000 7f92922ed700 1 --2- 172.21.15.149:0/1903717176 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f928c15abf0 0x7f928c0b5f30 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:44.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.064+0000 7f92922ed700 1 --2- 172.21.15.149:0/1903717176 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f928c0d1130 0x7f928c0cc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:44.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.064+0000 7f92922ed700 1 -- 172.21.15.149:0/1903717176 >> 172.21.15.149:0/1903717176 conn(0x7f928c0d0640 msgr2=0x7f928c0d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:44.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.064+0000 7f92922ed700 1 -- 172.21.15.149:0/1903717176 shutdown_connections 2023-11-08T19:25:44.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.064+0000 7f92922ed700 1 -- 172.21.15.149:0/1903717176 wait complete. 2023-11-08T19:25:44.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.065+0000 7f92922ed700 1 Processor -- start 2023-11-08T19:25:44.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.066+0000 7f92922ed700 1 -- start start 2023-11-08T19:25:44.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.066+0000 7f92922ed700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f928c0cc6a0 0x7f928c154ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:44.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.066+0000 7f92922ed700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f928c0d1130 0x7f928c15cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:44.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.066+0000 7f92922ed700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f928c15abf0 0x7f928c15d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:44.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.066+0000 7f92922ed700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f928c15b550 con 0x7f928c0d1130 2023-11-08T19:25:44.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.066+0000 7f92922ed700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f928c15b830 con 0x7f928c0cc6a0 2023-11-08T19:25:44.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.066+0000 7f92922ed700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f928c15bb10 con 0x7f928c15abf0 2023-11-08T19:25:44.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.067+0000 7f928b7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f928c0d1130 0x7f928c15cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:44.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.067+0000 7f928b7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f928c0d1130 0x7f928c15cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41520/0 (socket says 172.21.15.149:41520) 2023-11-08T19:25:44.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.067+0000 7f928b7fe700 1 -- 172.21.15.149:0/3449002284 learned_addr learned my addr 172.21.15.149:0/3449002284 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:44.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.067+0000 7f929088a700 1 --2- 172.21.15.149:0/3449002284 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f928c15abf0 0x7f928c15d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:44.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.067+0000 7f928bfff700 1 --2- 172.21.15.149:0/3449002284 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f928c0cc6a0 0x7f928c154ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:44.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.067+0000 7f928b7fe700 1 -- 172.21.15.149:0/3449002284 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f928c15abf0 msgr2=0x7f928c15d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:44.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.067+0000 7f928b7fe700 1 --2- 172.21.15.149:0/3449002284 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f928c15abf0 0x7f928c15d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:44.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.067+0000 7f928b7fe700 1 -- 172.21.15.149:0/3449002284 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f928c0cc6a0 msgr2=0x7f928c154ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:44.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.067+0000 7f928b7fe700 1 --2- 172.21.15.149:0/3449002284 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f928c0cc6a0 0x7f928c154ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:44.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.067+0000 7f928b7fe700 1 -- 172.21.15.149:0/3449002284 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9280009550 con 0x7f928c0d1130 2023-11-08T19:25:44.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.067+0000 7f929088a700 1 --2- 172.21.15.149:0/3449002284 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f928c15abf0 0x7f928c15d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:25:44.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.067+0000 7f928bfff700 1 --2- 172.21.15.149:0/3449002284 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f928c0cc6a0 0x7f928c154ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:25:44.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.067+0000 7f928b7fe700 1 --2- 172.21.15.149:0/3449002284 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f928c0d1130 0x7f928c15cff0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f927c00e810 tx=0x7f927c00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:44.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.067+0000 7f9288ff9700 1 -- 172.21.15.149:0/3449002284 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927c013610 con 0x7f928c0d1130 2023-11-08T19:25:44.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.067+0000 7f9288ff9700 1 -- 172.21.15.149:0/3449002284 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f927c013770 con 0x7f928c0d1130 2023-11-08T19:25:44.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.067+0000 7f92922ed700 1 -- 172.21.15.149:0/3449002284 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f928c15bdf0 con 0x7f928c0d1130 2023-11-08T19:25:44.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.067+0000 7f9288ff9700 1 -- 172.21.15.149:0/3449002284 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927c013b20 con 0x7f928c0d1130 2023-11-08T19:25:44.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.067+0000 7f92922ed700 1 -- 172.21.15.149:0/3449002284 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f928c15b1e0 con 0x7f928c0d1130 2023-11-08T19:25:44.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.068+0000 7f92922ed700 1 -- 172.21.15.149:0/3449002284 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f928c04f730 con 0x7f928c0d1130 2023-11-08T19:25:44.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.069+0000 7f9288ff9700 1 -- 172.21.15.149:0/3449002284 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f927c013c80 con 0x7f928c0d1130 2023-11-08T19:25:44.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.069+0000 7f9288ff9700 1 --2- 172.21.15.149:0/3449002284 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f927806af00 0x7f927806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:44.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.069+0000 7f9288ff9700 1 -- 172.21.15.149:0/3449002284 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f927c0894d0 con 0x7f928c0d1130 2023-11-08T19:25:44.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.069+0000 7f928bfff700 1 --2- 172.21.15.149:0/3449002284 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f927806af00 0x7f927806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:44.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.069+0000 7f928bfff700 1 --2- 172.21.15.149:0/3449002284 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f927806af00 0x7f927806d3c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f9280009c10 tx=0x7f9280008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:44.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.074+0000 7f9288ff9700 1 -- 172.21.15.149:0/3449002284 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f927c0542e0 con 0x7f928c0d1130 2023-11-08T19:25:44.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:44.268+0000 7f92922ed700 1 -- 172.21.15.149:0/3449002284 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "test_data_pool"} v 0) v1 -- 0x7f928c0cd580 con 0x7f928c0d1130 2023-11-08T19:25:45.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.257+0000 7f9288ff9700 1 -- 172.21.15.149:0/3449002284 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "test_data_pool"}]=0 pool 'test_data_pool' created v68) v1 ==== 118+0+0 (secure 0 0 0) 0x7f927c057900 con 0x7f928c0d1130 2023-11-08T19:25:45.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.260+0000 7f92922ed700 1 -- 172.21.15.149:0/3449002284 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f927806af00 msgr2=0x7f927806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:45.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.260+0000 7f92922ed700 1 --2- 172.21.15.149:0/3449002284 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f927806af00 0x7f927806d3c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f9280009c10 tx=0x7f9280008030 comp rx=0 tx=0).stop 2023-11-08T19:25:45.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.260+0000 7f92922ed700 1 -- 172.21.15.149:0/3449002284 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f928c0d1130 msgr2=0x7f928c15cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:45.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.260+0000 7f92922ed700 1 --2- 172.21.15.149:0/3449002284 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f928c0d1130 0x7f928c15cff0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f927c00e810 tx=0x7f927c00ebd0 comp rx=0 tx=0).stop 2023-11-08T19:25:45.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.261+0000 7f92922ed700 1 -- 172.21.15.149:0/3449002284 shutdown_connections 2023-11-08T19:25:45.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.261+0000 7f92922ed700 1 --2- 172.21.15.149:0/3449002284 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f927806af00 0x7f927806d3c0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:45.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.261+0000 7f92922ed700 1 --2- 172.21.15.149:0/3449002284 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f928c0cc6a0 0x7f928c154ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:45.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.261+0000 7f92922ed700 1 --2- 172.21.15.149:0/3449002284 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f928c15abf0 0x7f928c15d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:45.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.261+0000 7f92922ed700 1 --2- 172.21.15.149:0/3449002284 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f928c0d1130 0x7f928c15cff0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:45.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.261+0000 7f92922ed700 1 -- 172.21.15.149:0/3449002284 >> 172.21.15.149:0/3449002284 conn(0x7f928c0d0640 msgr2=0x7f928c0b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:45.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.261+0000 7f92922ed700 1 -- 172.21.15.149:0/3449002284 shutdown_connections 2023-11-08T19:25:45.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.261+0000 7f92922ed700 1 -- 172.21.15.149:0/3449002284 wait complete. 2023-11-08T19:25:45.269 INFO:teuthology.orchestra.run.smithi149.stderr:pool 'test_data_pool' created 2023-11-08T19:25:45.279 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create test_metadata_pool 2023-11-08T19:25:45.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.403+0000 7f87923ad700 1 Processor -- start 2023-11-08T19:25:45.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.403+0000 7f87923ad700 1 -- start start 2023-11-08T19:25:45.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.403+0000 7f87923ad700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f878c15a0e0 0x7f878c0ce3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:45.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.403+0000 7f87923ad700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f878c0cc1c0 0x7f878c0ce910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:45.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.403+0000 7f87923ad700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f878c0cacd0 con 0x7f878c15dc90 2023-11-08T19:25:45.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.403+0000 7f87923ad700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f878c06e300 con 0x7f878c15a0e0 2023-11-08T19:25:45.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.403+0000 7f87923ad700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f878c06e5e0 con 0x7f878c0cc1c0 2023-11-08T19:25:45.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.404+0000 7f878bfff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f878c15a0e0 0x7f878c0ce3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:45.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.404+0000 7f878bfff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f878c15a0e0 0x7f878c0ce3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41526/0 (socket says 172.21.15.149:41526) 2023-11-08T19:25:45.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.404+0000 7f878bfff700 1 -- 172.21.15.149:0/2558788697 learned_addr learned my addr 172.21.15.149:0/2558788697 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:45.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.404+0000 7f879094a700 1 --2- 172.21.15.149:0/2558788697 >> v2:172.21.15.160:3300/0 conn(0x7f878c0cc1c0 0x7f878c0ce910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:45.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.404+0000 7f878bfff700 1 -- 172.21.15.149:0/2558788697 >> v2:172.21.15.160:3300/0 conn(0x7f878c0cc1c0 msgr2=0x7f878c0ce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:45.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.404+0000 7f878bfff700 1 --2- 172.21.15.149:0/2558788697 >> v2:172.21.15.160:3300/0 conn(0x7f878c0cc1c0 0x7f878c0ce910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:45.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.404+0000 7f878bfff700 1 -- 172.21.15.149:0/2558788697 >> v1:172.21.15.160:6789/0 conn(0x7f878c15dc90 legacy=0x7f878c15a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:45.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.404+0000 7f878bfff700 1 -- 172.21.15.149:0/2558788697 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f878c06e8c0 con 0x7f878c15a0e0 2023-11-08T19:25:45.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.404+0000 7f879094a700 1 --2- 172.21.15.149:0/2558788697 >> v2:172.21.15.160:3300/0 conn(0x7f878c0cc1c0 0x7f878c0ce910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:25:45.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.404+0000 7f878bfff700 1 --2- 172.21.15.149:0/2558788697 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f878c15a0e0 0x7f878c0ce3d0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f878c0cd630 tx=0x7f877c00be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89b3caa6ceb1344 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:45.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.404+0000 7f878affd700 1 -- 172.21.15.149:0/2558788697 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877c00dcf0 con 0x7f878c15a0e0 2023-11-08T19:25:45.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.404+0000 7f878affd700 1 -- 172.21.15.149:0/2558788697 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f877c00de50 con 0x7f878c15a0e0 2023-11-08T19:25:45.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.404+0000 7f878affd700 1 -- 172.21.15.149:0/2558788697 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877c004250 con 0x7f878c15a0e0 2023-11-08T19:25:45.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.405+0000 7f87923ad700 1 -- 172.21.15.149:0/2558788697 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f878c15a0e0 msgr2=0x7f878c0ce3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:45.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.405+0000 7f87923ad700 1 --2- 172.21.15.149:0/2558788697 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f878c15a0e0 0x7f878c0ce3d0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f878c0cd630 tx=0x7f877c00be70 comp rx=0 tx=0).stop 2023-11-08T19:25:45.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.405+0000 7f87923ad700 1 -- 172.21.15.149:0/2558788697 shutdown_connections 2023-11-08T19:25:45.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.405+0000 7f87923ad700 1 --2- 172.21.15.149:0/2558788697 >> v2:172.21.15.160:3300/0 conn(0x7f878c0cc1c0 0x7f878c0ce910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:45.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.405+0000 7f87923ad700 1 --2- 172.21.15.149:0/2558788697 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f878c15a0e0 0x7f878c0ce3d0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:45.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.405+0000 7f87923ad700 1 -- 172.21.15.149:0/2558788697 >> 172.21.15.149:0/2558788697 conn(0x7f878c0cc860 msgr2=0x7f878c0ccc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:45.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.405+0000 7f87923ad700 1 -- 172.21.15.149:0/2558788697 shutdown_connections 2023-11-08T19:25:45.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.405+0000 7f87923ad700 1 -- 172.21.15.149:0/2558788697 wait complete. 2023-11-08T19:25:45.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.406+0000 7f87923ad700 1 Processor -- start 2023-11-08T19:25:45.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.406+0000 7f87923ad700 1 -- start start 2023-11-08T19:25:45.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.407+0000 7f87923ad700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f878c0cc1c0 0x7f878c15b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:45.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.407+0000 7f87923ad700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f878c15a0e0 0x7f878c15a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:45.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.407+0000 7f87923ad700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f878c15dc90 0x7f878c157e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:45.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.407+0000 7f87923ad700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f878c0c6870 con 0x7f878c0cc1c0 2023-11-08T19:25:45.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.407+0000 7f87923ad700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f878c1583d0 con 0x7f878c15dc90 2023-11-08T19:25:45.417 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.407+0000 7f87923ad700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f878c15da70 con 0x7f878c15a0e0 2023-11-08T19:25:45.417 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.407+0000 7f878bfff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f878c0cc1c0 0x7f878c15b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:45.417 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.407+0000 7f878bfff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f878c0cc1c0 0x7f878c15b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41532/0 (socket says 172.21.15.149:41532) 2023-11-08T19:25:45.417 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.407+0000 7f878bfff700 1 -- 172.21.15.149:0/2774682705 learned_addr learned my addr 172.21.15.149:0/2774682705 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:45.417 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.407+0000 7f879094a700 1 --2- 172.21.15.149:0/2774682705 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f878c15dc90 0x7f878c157e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:45.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.407+0000 7f878b7fe700 1 --2- 172.21.15.149:0/2774682705 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f878c15a0e0 0x7f878c15a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:45.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.407+0000 7f878bfff700 1 -- 172.21.15.149:0/2774682705 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f878c15a0e0 msgr2=0x7f878c15a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:45.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.407+0000 7f878bfff700 1 --2- 172.21.15.149:0/2774682705 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f878c15a0e0 0x7f878c15a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:45.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.407+0000 7f878bfff700 1 -- 172.21.15.149:0/2774682705 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f878c15dc90 msgr2=0x7f878c157e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:45.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.407+0000 7f878bfff700 1 --2- 172.21.15.149:0/2774682705 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f878c15dc90 0x7f878c157e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:45.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.407+0000 7f878bfff700 1 -- 172.21.15.149:0/2774682705 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f877c00b7f0 con 0x7f878c0cc1c0 2023-11-08T19:25:45.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.408+0000 7f878bfff700 1 --2- 172.21.15.149:0/2774682705 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f878c0cc1c0 0x7f878c15b1d0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f878c06d0b0 tx=0x7f877c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:45.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.408+0000 7f8788ff9700 1 -- 172.21.15.149:0/2774682705 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877c020070 con 0x7f878c0cc1c0 2023-11-08T19:25:45.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.408+0000 7f8788ff9700 1 -- 172.21.15.149:0/2774682705 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f877c004030 con 0x7f878c0cc1c0 2023-11-08T19:25:45.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.408+0000 7f87923ad700 1 -- 172.21.15.149:0/2774682705 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f878c0aef40 con 0x7f878c0cc1c0 2023-11-08T19:25:45.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.408+0000 7f8788ff9700 1 -- 172.21.15.149:0/2774682705 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877c010470 con 0x7f878c0cc1c0 2023-11-08T19:25:45.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.408+0000 7f87923ad700 1 -- 172.21.15.149:0/2774682705 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f878c15d790 con 0x7f878c0cc1c0 2023-11-08T19:25:45.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.409+0000 7f87923ad700 1 -- 172.21.15.149:0/2774682705 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f878c15ae10 con 0x7f878c0cc1c0 2023-11-08T19:25:45.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.409+0000 7f8788ff9700 1 -- 172.21.15.149:0/2774682705 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f877c0193f0 con 0x7f878c0cc1c0 2023-11-08T19:25:45.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.410+0000 7f8788ff9700 1 --2- 172.21.15.149:0/2774682705 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f877806af00 0x7f877806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:45.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.410+0000 7f878b7fe700 1 --2- 172.21.15.149:0/2774682705 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f877806af00 0x7f877806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:45.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.410+0000 7f8788ff9700 1 -- 172.21.15.149:0/2774682705 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f877c08cfb0 con 0x7f878c0cc1c0 2023-11-08T19:25:45.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.410+0000 7f878b7fe700 1 --2- 172.21.15.149:0/2774682705 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f877806af00 0x7f877806d3c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f878c15b710 tx=0x7f8780008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:45.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.415+0000 7f8788ff9700 1 -- 172.21.15.149:0/2774682705 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f877c0bfca0 con 0x7f878c0cc1c0 2023-11-08T19:25:45.606 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:45.605+0000 7f87923ad700 1 -- 172.21.15.149:0/2774682705 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "test_metadata_pool"} v 0) v1 -- 0x7f878c04f730 con 0x7f878c0cc1c0 2023-11-08T19:25:46.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.263+0000 7f8788ff9700 1 -- 172.21.15.149:0/2774682705 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "test_metadata_pool"}]=0 pool 'test_metadata_pool' created v69) v1 ==== 126+0+0 (secure 0 0 0) 0x7f877c057c70 con 0x7f878c0cc1c0 2023-11-08T19:25:46.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.265+0000 7f87923ad700 1 -- 172.21.15.149:0/2774682705 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f877806af00 msgr2=0x7f877806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:46.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.265+0000 7f87923ad700 1 --2- 172.21.15.149:0/2774682705 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f877806af00 0x7f877806d3c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f878c15b710 tx=0x7f8780008040 comp rx=0 tx=0).stop 2023-11-08T19:25:46.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.265+0000 7f87923ad700 1 -- 172.21.15.149:0/2774682705 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f878c0cc1c0 msgr2=0x7f878c15b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:46.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.265+0000 7f87923ad700 1 --2- 172.21.15.149:0/2774682705 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f878c0cc1c0 0x7f878c15b1d0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f878c06d0b0 tx=0x7f877c004750 comp rx=0 tx=0).stop 2023-11-08T19:25:46.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.265+0000 7f87923ad700 1 -- 172.21.15.149:0/2774682705 shutdown_connections 2023-11-08T19:25:46.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.265+0000 7f87923ad700 1 --2- 172.21.15.149:0/2774682705 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f877806af00 0x7f877806d3c0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:46.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.265+0000 7f87923ad700 1 --2- 172.21.15.149:0/2774682705 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f878c15dc90 0x7f878c157e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:46.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.265+0000 7f87923ad700 1 --2- 172.21.15.149:0/2774682705 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f878c0cc1c0 0x7f878c15b1d0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:46.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.265+0000 7f87923ad700 1 --2- 172.21.15.149:0/2774682705 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f878c15a0e0 0x7f878c15a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:46.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.265+0000 7f87923ad700 1 -- 172.21.15.149:0/2774682705 >> 172.21.15.149:0/2774682705 conn(0x7f878c0cc860 msgr2=0x7f878c0af880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:46.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.266+0000 7f87923ad700 1 -- 172.21.15.149:0/2774682705 shutdown_connections 2023-11-08T19:25:46.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.266+0000 7f87923ad700 1 -- 172.21.15.149:0/2774682705 wait complete. 2023-11-08T19:25:46.270 INFO:teuthology.orchestra.run.smithi149.stderr:pool 'test_metadata_pool' created 2023-11-08T19:25:46.290 DEBUG:teuthology.orchestra.run.smithi149:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool test_data_pool mksnap snap4 2023-11-08T19:25:46.335 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.334+0000 7f31aeb72080 1 Processor -- start 2023-11-08T19:25:46.335 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.334+0000 7f31aeb72080 1 -- start start 2023-11-08T19:25:46.341 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.334+0000 7f31aeb72080 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3194002260 0x561524c37c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:46.341 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.334+0000 7f31aeb72080 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x561524c38360 0x561524c36eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:46.341 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.334+0000 7f31aeb72080 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561524b9f300 0x561524b9f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:46.341 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.334+0000 7f31aeb72080 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x561524b0bc30 con 0x7f3194002260 2023-11-08T19:25:46.342 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.334+0000 7f31aeb72080 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x561524b07520 con 0x561524b9f300 2023-11-08T19:25:46.342 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.334+0000 7f31aeb72080 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x561524aa1740 con 0x561524c38360 2023-11-08T19:25:46.342 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.335+0000 7f31a4c07700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3194002260 0x561524c37c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:46.342 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.335+0000 7f31a4c07700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3194002260 0x561524c37c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41552/0 (socket says 172.21.15.149:41552) 2023-11-08T19:25:46.343 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.335+0000 7f31a4c07700 1 -- 172.21.15.149:0/1444228445 learned_addr learned my addr 172.21.15.149:0/1444228445 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:46.343 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.335+0000 7f319ffff700 1 --2- 172.21.15.149:0/1444228445 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x561524c38360 0x561524c36eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:46.343 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.335+0000 7f31a5408700 1 --2- 172.21.15.149:0/1444228445 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561524b9f300 0x561524b9f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:46.343 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.335+0000 7f31a4c07700 1 -- 172.21.15.149:0/1444228445 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x561524c38360 msgr2=0x561524c36eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:46.343 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.335+0000 7f31a4c07700 1 --2- 172.21.15.149:0/1444228445 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x561524c38360 0x561524c36eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:46.344 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.335+0000 7f31a4c07700 1 -- 172.21.15.149:0/1444228445 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561524b9f300 msgr2=0x561524b9f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:46.344 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.335+0000 7f31a4c07700 1 --2- 172.21.15.149:0/1444228445 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561524b9f300 0x561524b9f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:46.344 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.335+0000 7f31a4c07700 1 -- 172.21.15.149:0/1444228445 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561524aa0b70 con 0x7f3194002260 2023-11-08T19:25:46.344 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.335+0000 7f31a4c07700 1 --2- 172.21.15.149:0/1444228445 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3194002260 0x561524c37c10 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f319000b930 tx=0x7f319000f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b67044872f87edff server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:46.345 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.335+0000 7f319effd700 1 -- 172.21.15.149:0/1444228445 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3190014040 con 0x7f3194002260 2023-11-08T19:25:46.345 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.335+0000 7f319effd700 1 -- 172.21.15.149:0/1444228445 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f319000be60 con 0x7f3194002260 2023-11-08T19:25:46.345 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.335+0000 7f319effd700 1 -- 172.21.15.149:0/1444228445 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319001b670 con 0x7f3194002260 2023-11-08T19:25:46.345 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.335+0000 7f31aeb72080 1 -- 172.21.15.149:0/1444228445 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3194002260 msgr2=0x561524c37c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:46.345 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.335+0000 7f31aeb72080 1 --2- 172.21.15.149:0/1444228445 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3194002260 0x561524c37c10 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f319000b930 tx=0x7f319000f000 comp rx=0 tx=0).stop 2023-11-08T19:25:46.346 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.336+0000 7f31aeb72080 1 -- 172.21.15.149:0/1444228445 shutdown_connections 2023-11-08T19:25:46.346 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.336+0000 7f31aeb72080 1 --2- 172.21.15.149:0/1444228445 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561524b9f300 0x561524b9f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:46.346 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.336+0000 7f31aeb72080 1 --2- 172.21.15.149:0/1444228445 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3194002260 0x561524c37c10 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:46.346 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.336+0000 7f31aeb72080 1 --2- 172.21.15.149:0/1444228445 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x561524c38360 0x561524c36eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:46.347 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.336+0000 7f31aeb72080 1 -- 172.21.15.149:0/1444228445 >> 172.21.15.149:0/1444228445 conn(0x561524ba4cb0 msgr2=0x561524b5da20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:46.347 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.336+0000 7f31aeb72080 1 -- 172.21.15.149:0/1444228445 shutdown_connections 2023-11-08T19:25:46.347 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.336+0000 7f31aeb72080 1 -- 172.21.15.149:0/1444228445 wait complete. 2023-11-08T19:25:46.347 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.336+0000 7f31aeb72080 1 Processor -- start 2023-11-08T19:25:46.347 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.336+0000 7f31aeb72080 1 -- start start 2023-11-08T19:25:46.348 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.337+0000 7f31aeb72080 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561524b9f300 0x561524c2aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:46.348 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.337+0000 7f31aeb72080 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561524c38360 0x561524b88d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:46.348 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.337+0000 7f31aeb72080 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3194002260 0x561524c33a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:46.349 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.337+0000 7f31aeb72080 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x561524aa13e0 con 0x561524c38360 2023-11-08T19:25:46.349 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.337+0000 7f31aeb72080 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x561524a95680 con 0x561524b9f300 2023-11-08T19:25:46.349 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.337+0000 7f31aeb72080 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x561524c2afe0 con 0x7f3194002260 2023-11-08T19:25:46.349 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.337+0000 7f319ffff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561524c38360 0x561524b88d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:46.350 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.337+0000 7f319ffff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561524c38360 0x561524b88d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41560/0 (socket says 172.21.15.149:41560) 2023-11-08T19:25:46.350 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.337+0000 7f319ffff700 1 -- 172.21.15.149:0/468622965 learned_addr learned my addr 172.21.15.149:0/468622965 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:46.350 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.337+0000 7f31a4c07700 1 --2- 172.21.15.149:0/468622965 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561524b9f300 0x561524c2aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:46.350 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.337+0000 7f31a5408700 1 --2- 172.21.15.149:0/468622965 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3194002260 0x561524c33a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:46.351 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.337+0000 7f319ffff700 1 -- 172.21.15.149:0/468622965 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3194002260 msgr2=0x561524c33a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:46.351 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.337+0000 7f319ffff700 1 --2- 172.21.15.149:0/468622965 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3194002260 0x561524c33a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:46.351 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.337+0000 7f319ffff700 1 -- 172.21.15.149:0/468622965 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561524b9f300 msgr2=0x561524c2aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:46.351 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.337+0000 7f319ffff700 1 --2- 172.21.15.149:0/468622965 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561524b9f300 0x561524c2aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:46.351 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.337+0000 7f319ffff700 1 -- 172.21.15.149:0/468622965 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3194001e10 con 0x561524c38360 2023-11-08T19:25:46.352 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.337+0000 7f319ffff700 1 --2- 172.21.15.149:0/468622965 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561524c38360 0x561524b88d80 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x561524b470a0 tx=0x7f3198001760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:46.352 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.338+0000 7f319dffb700 1 -- 172.21.15.149:0/468622965 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3198014070 con 0x561524c38360 2023-11-08T19:25:46.352 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.338+0000 7f319dffb700 1 -- 172.21.15.149:0/468622965 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3198005040 con 0x561524c38360 2023-11-08T19:25:46.352 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.338+0000 7f31aeb72080 1 -- 172.21.15.149:0/468622965 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561524aa05d0 con 0x561524c38360 2023-11-08T19:25:46.352 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.338+0000 7f319dffb700 1 -- 172.21.15.149:0/468622965 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319800e960 con 0x561524c38360 2023-11-08T19:25:46.353 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.338+0000 7f31aeb72080 1 -- 172.21.15.149:0/468622965 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561524b892c0 con 0x561524c38360 2023-11-08T19:25:46.353 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.339+0000 7f319dffb700 1 -- 172.21.15.149:0/468622965 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f319800eac0 con 0x561524c38360 2023-11-08T19:25:46.353 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.339+0000 7f319dffb700 1 --2- 172.21.15.149:0/468622965 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3188069820 0x7f318806bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:46.353 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.340+0000 7f319dffb700 1 -- 172.21.15.149:0/468622965 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f3198089370 con 0x561524c38360 2023-11-08T19:25:46.354 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.340+0000 7f31a4c07700 1 --2- 172.21.15.149:0/468622965 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3188069820 0x7f318806bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:46.354 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.340+0000 7f31aeb72080 1 -- 172.21.15.149:0/468622965 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- pool_op(create snap pool 12 tid 1 name snap4 v0) v4 -- 0x561524b114a0 con 0x561524c38360 2023-11-08T19:25:46.354 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:46.340+0000 7f31a4c07700 1 --2- 172.21.15.149:0/468622965 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3188069820 0x7f318806bce0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f3190003010 tx=0x7f3190027040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:47.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.271+0000 7f319dffb700 1 -- 172.21.15.149:0/468622965 <== mon.0 v2:172.21.15.149:3300/0 6 ==== pool_op_reply(tid 1 (0) Success v70) v1 ==== 43+0+0 (secure 0 0 0) 0x7f3198053f40 con 0x561524c38360 2023-11-08T19:25:47.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.271+0000 7f319dffb700 1 -- 172.21.15.149:0/468622965 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=70}) v3 -- 0x7f3188073f00 con 0x561524c38360 2023-11-08T19:25:47.273 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.272+0000 7f319dffb700 1 -- 172.21.15.149:0/468622965 <== mon.0 v2:172.21.15.149:3300/0 7 ==== osd_map(70..70 src has 1..70) v4 ==== 718+0+0 (secure 0 0 0) 0x7f3198058300 con 0x561524c38360 2023-11-08T19:25:47.273 INFO:teuthology.orchestra.run.smithi149.stdout:created pool test_data_pool snap snap4 2023-11-08T19:25:47.274 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.272+0000 7f31aeb72080 1 -- 172.21.15.149:0/468622965 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3188069820 msgr2=0x7f318806bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:47.274 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.272+0000 7f31aeb72080 1 --2- 172.21.15.149:0/468622965 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3188069820 0x7f318806bce0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f3190003010 tx=0x7f3190027040 comp rx=0 tx=0).stop 2023-11-08T19:25:47.274 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.272+0000 7f31aeb72080 1 -- 172.21.15.149:0/468622965 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561524c38360 msgr2=0x561524b88d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:47.274 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.272+0000 7f31aeb72080 1 --2- 172.21.15.149:0/468622965 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561524c38360 0x561524b88d80 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x561524b470a0 tx=0x7f3198001760 comp rx=0 tx=0).stop 2023-11-08T19:25:47.275 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.273+0000 7f31aeb72080 1 -- 172.21.15.149:0/468622965 shutdown_connections 2023-11-08T19:25:47.275 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.273+0000 7f31aeb72080 1 --2- 172.21.15.149:0/468622965 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3188069820 0x7f318806bce0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:47.275 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.273+0000 7f31aeb72080 1 --2- 172.21.15.149:0/468622965 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561524b9f300 0x561524c2aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:47.276 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.273+0000 7f31aeb72080 1 --2- 172.21.15.149:0/468622965 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3194002260 0x561524c33a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:47.276 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.273+0000 7f31aeb72080 1 --2- 172.21.15.149:0/468622965 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561524c38360 0x561524b88d80 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:47.276 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.273+0000 7f31aeb72080 1 -- 172.21.15.149:0/468622965 >> 172.21.15.149:0/468622965 conn(0x561524ba4cb0 msgr2=0x561524c37c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:47.276 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.274+0000 7f31aeb72080 1 -- 172.21.15.149:0/468622965 shutdown_connections 2023-11-08T19:25:47.276 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.274+0000 7f31aeb72080 1 -- 172.21.15.149:0/468622965 wait complete. 2023-11-08T19:25:47.282 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new testfs test_metadata_pool test_data_pool 2023-11-08T19:25:47.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.451+0000 7fb94f618700 1 Processor -- start 2023-11-08T19:25:47.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.451+0000 7fb94f618700 1 -- start start 2023-11-08T19:25:47.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.452+0000 7fb94f618700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb94806ab80 0x7fb9480caf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:47.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.452+0000 7fb94f618700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb94815e320 con 0x7fb94815df40 2023-11-08T19:25:47.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.452+0000 7fb94f618700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb94806b020 con 0x7fb9480cf1c0 2023-11-08T19:25:47.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.452+0000 7fb94f618700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb94806b2e0 con 0x7fb94806ab80 2023-11-08T19:25:47.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.452+0000 7fb94cbb3700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb94806ab80 0x7fb9480caf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:47.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.452+0000 7fb94d3b4700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fb94815df40 0x7fb94806c0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:43568/0 (socket says 172.21.15.149:43568) 2023-11-08T19:25:47.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.452+0000 7fb94d3b4700 1 -- 172.21.15.149:0/2292129039 learned_addr learned my addr 172.21.15.149:0/2292129039 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:25:47.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.452+0000 7fb94cbb3700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb94806ab80 0x7fb9480caf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41570/0 (socket says 172.21.15.149:41570) 2023-11-08T19:25:47.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.452+0000 7fb94cbb3700 1 -- 172.21.15.149:0/2292129039 >> v1:172.21.15.160:6789/0 conn(0x7fb9480cf1c0 legacy=0x7fb9480ce540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:47.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.452+0000 7fb94cbb3700 1 -- 172.21.15.149:0/2292129039 >> v1:172.21.15.149:6789/0 conn(0x7fb94815df40 legacy=0x7fb94806c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:47.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.452+0000 7fb93ffff700 1 -- 172.21.15.149:0/2292129039 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3250814322 0 0) 0x7fb94815e320 con 0x7fb94815df40 2023-11-08T19:25:47.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.452+0000 7fb94cbb3700 1 -- 172.21.15.149:0/2292129039 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb94806b5c0 con 0x7fb94806ab80 2023-11-08T19:25:47.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.452+0000 7fb94cbb3700 1 --2- 172.21.15.149:0/2292129039 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb94806ab80 0x7fb9480caf50 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fb944009840 tx=0x7fb944009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28ee9c9aef1d4317 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:47.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.452+0000 7fb93ffff700 1 -- 172.21.15.149:0/2292129039 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb944004230 con 0x7fb94806ab80 2023-11-08T19:25:47.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.452+0000 7fb93ffff700 1 -- 172.21.15.149:0/2292129039 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb944004390 con 0x7fb94806ab80 2023-11-08T19:25:47.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.452+0000 7fb93ffff700 1 -- 172.21.15.149:0/2292129039 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9440036a0 con 0x7fb94806ab80 2023-11-08T19:25:47.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.453+0000 7fb94f618700 1 -- 172.21.15.149:0/2292129039 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb94806ab80 msgr2=0x7fb9480caf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:47.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.453+0000 7fb94f618700 1 --2- 172.21.15.149:0/2292129039 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb94806ab80 0x7fb9480caf50 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fb944009840 tx=0x7fb944009b50 comp rx=0 tx=0).stop 2023-11-08T19:25:47.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.453+0000 7fb94f618700 1 -- 172.21.15.149:0/2292129039 shutdown_connections 2023-11-08T19:25:47.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.453+0000 7fb94f618700 1 --2- 172.21.15.149:0/2292129039 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb94806ab80 0x7fb9480caf50 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:47.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.453+0000 7fb94f618700 1 -- 172.21.15.149:0/2292129039 >> 172.21.15.149:0/2292129039 conn(0x7fb9480d0640 msgr2=0x7fb9480d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:47.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.453+0000 7fb94f618700 1 -- 172.21.15.149:0/2292129039 shutdown_connections 2023-11-08T19:25:47.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.453+0000 7fb94f618700 1 -- 172.21.15.149:0/2292129039 wait complete. 2023-11-08T19:25:47.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.454+0000 7fb94f618700 1 Processor -- start 2023-11-08T19:25:47.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.454+0000 7fb94f618700 1 -- start start 2023-11-08T19:25:47.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.455+0000 7fb94f618700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb94806ab80 0x7fb9480c5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:47.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.455+0000 7fb94f618700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb9480cf1c0 0x7fb9480ace80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:47.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.455+0000 7fb94f618700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb94815df40 0x7fb9480ad3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:47.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.455+0000 7fb94f618700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9480c4c20 con 0x7fb94815df40 2023-11-08T19:25:47.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.455+0000 7fb94f618700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9480c4f00 con 0x7fb94806ab80 2023-11-08T19:25:47.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.455+0000 7fb94f618700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9480c51e0 con 0x7fb9480cf1c0 2023-11-08T19:25:47.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.455+0000 7fb94dbb5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb94815df40 0x7fb9480ad3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:47.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.455+0000 7fb94dbb5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb94815df40 0x7fb9480ad3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41576/0 (socket says 172.21.15.149:41576) 2023-11-08T19:25:47.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.455+0000 7fb94dbb5700 1 -- 172.21.15.149:0/1630736632 learned_addr learned my addr 172.21.15.149:0/1630736632 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:47.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.455+0000 7fb94d3b4700 1 --2- 172.21.15.149:0/1630736632 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb94806ab80 0x7fb9480c5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:47.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.455+0000 7fb94cbb3700 1 --2- 172.21.15.149:0/1630736632 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb9480cf1c0 0x7fb9480ace80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:47.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.455+0000 7fb94dbb5700 1 -- 172.21.15.149:0/1630736632 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb9480cf1c0 msgr2=0x7fb9480ace80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:47.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.455+0000 7fb94dbb5700 1 --2- 172.21.15.149:0/1630736632 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb9480cf1c0 0x7fb9480ace80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:47.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.455+0000 7fb94dbb5700 1 -- 172.21.15.149:0/1630736632 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb94806ab80 msgr2=0x7fb9480c5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:47.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.455+0000 7fb94dbb5700 1 --2- 172.21.15.149:0/1630736632 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb94806ab80 0x7fb9480c5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:47.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.455+0000 7fb94dbb5700 1 -- 172.21.15.149:0/1630736632 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9440094a0 con 0x7fb94815df40 2023-11-08T19:25:47.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.455+0000 7fb94d3b4700 1 --2- 172.21.15.149:0/1630736632 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb94806ab80 0x7fb9480c5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:25:47.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.455+0000 7fb94cbb3700 1 --2- 172.21.15.149:0/1630736632 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb9480cf1c0 0x7fb9480ace80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:25:47.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.456+0000 7fb94dbb5700 1 --2- 172.21.15.149:0/1630736632 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb94815df40 0x7fb9480ad3c0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fb94000cba0 tx=0x7fb94000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:47.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.456+0000 7fb93dffb700 1 -- 172.21.15.149:0/1630736632 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94000ab80 con 0x7fb94815df40 2023-11-08T19:25:47.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.456+0000 7fb93dffb700 1 -- 172.21.15.149:0/1630736632 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb94000ace0 con 0x7fb94815df40 2023-11-08T19:25:47.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.456+0000 7fb94f618700 1 -- 172.21.15.149:0/1630736632 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9480c54c0 con 0x7fb94815df40 2023-11-08T19:25:47.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.456+0000 7fb93dffb700 1 -- 172.21.15.149:0/1630736632 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb940012660 con 0x7fb94815df40 2023-11-08T19:25:47.468 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.456+0000 7fb94f618700 1 -- 172.21.15.149:0/1630736632 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9480c6200 con 0x7fb94815df40 2023-11-08T19:25:47.469 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.457+0000 7fb94f618700 1 -- 172.21.15.149:0/1630736632 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9480c59e0 con 0x7fb94815df40 2023-11-08T19:25:47.469 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.457+0000 7fb93dffb700 1 -- 172.21.15.149:0/1630736632 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb9400127c0 con 0x7fb94815df40 2023-11-08T19:25:47.469 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.458+0000 7fb93dffb700 1 --2- 172.21.15.149:0/1630736632 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb92c06af00 0x7fb92c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:47.469 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.458+0000 7fb93dffb700 1 -- 172.21.15.149:0/1630736632 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 7131+0+0 (secure 0 0 0) 0x7fb94008a380 con 0x7fb94815df40 2023-11-08T19:25:47.470 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.458+0000 7fb94d3b4700 1 --2- 172.21.15.149:0/1630736632 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb92c06af00 0x7fb92c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:47.470 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.458+0000 7fb94d3b4700 1 --2- 172.21.15.149:0/1630736632 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb92c06af00 0x7fb92c06d3c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fb938000f60 tx=0x7fb938007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:47.470 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.463+0000 7fb93dffb700 1 -- 172.21.15.149:0/1630736632 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb9480c59e0 con 0x7fb94815df40 2023-11-08T19:25:47.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.697+0000 7fb94f618700 1 -- 172.21.15.149:0/1630736632 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "testfs", "metadata": "test_metadata_pool", "data": "test_data_pool"} v 0) v1 -- 0x7fb9480c59e0 con 0x7fb94815df40 2023-11-08T19:25:47.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.698+0000 7fb93dffb700 1 -- 172.21.15.149:0/1630736632 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "testfs", "metadata": "test_metadata_pool", "data": "test_data_pool"}]=-95 pool(12) already has mon-managed snaps; can't attach pool to fs v35) v1 ==== 198+0+0 (secure 0 0 0) 0x7fb9480c59e0 con 0x7fb94815df40 2023-11-08T19:25:47.700 INFO:teuthology.orchestra.run.smithi149.stderr:Error ENOTSUP: pool(12) already has mon-managed snaps; can't attach pool to fs 2023-11-08T19:25:47.704 DEBUG:teuthology.orchestra.run:got remote process result: 95 2023-11-08T19:25:47.705 DEBUG:teuthology.orchestra.run.smithi149:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool test_data_pool rmsnap snap4 2023-11-08T19:25:47.748 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.747+0000 7f1bd3173080 1 Processor -- start 2023-11-08T19:25:47.749 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.747+0000 7f1bd3173080 1 -- start start 2023-11-08T19:25:47.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.748+0000 7f1bd3173080 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1bb40027e0 0x5558d4a58390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:47.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.748+0000 7f1bd3173080 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5558d4a64420 0x5558d498ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:47.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.748+0000 7f1bd3173080 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5558d498efb0 0x5558d4a5b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:47.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.748+0000 7f1bd3173080 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558d493a520 con 0x5558d498efb0 2023-11-08T19:25:47.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.748+0000 7f1bd3173080 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558d48d4740 con 0x5558d4a64420 2023-11-08T19:25:47.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.748+0000 7f1bd3173080 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x5558d48d43e0 con 0x7f1bb40027e0 2023-11-08T19:25:47.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.748+0000 7f1bc9a09700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5558d498efb0 0x5558d4a5b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:47.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.748+0000 7f1bc9a09700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5558d498efb0 0x5558d4a5b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41596/0 (socket says 172.21.15.149:41596) 2023-11-08T19:25:47.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.748+0000 7f1bc9a09700 1 -- 172.21.15.149:0/1686811350 learned_addr learned my addr 172.21.15.149:0/1686811350 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:47.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.748+0000 7f1bc9208700 1 --2- 172.21.15.149:0/1686811350 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1bb40027e0 0x5558d4a58390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:47.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.748+0000 7f1bc8a07700 1 --2- 172.21.15.149:0/1686811350 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5558d4a64420 0x5558d498ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:47.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.748+0000 7f1bc9a09700 1 -- 172.21.15.149:0/1686811350 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1bb40027e0 msgr2=0x5558d4a58390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:47.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.748+0000 7f1bc9a09700 1 --2- 172.21.15.149:0/1686811350 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1bb40027e0 0x5558d4a58390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:47.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.748+0000 7f1bc9a09700 1 -- 172.21.15.149:0/1686811350 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5558d4a64420 msgr2=0x5558d498ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:47.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.748+0000 7f1bc9a09700 1 --2- 172.21.15.149:0/1686811350 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5558d4a64420 0x5558d498ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:47.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.748+0000 7f1bc9a09700 1 -- 172.21.15.149:0/1686811350 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5558d48e07d0 con 0x5558d498efb0 2023-11-08T19:25:47.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.748+0000 7f1bc8a07700 1 --2- 172.21.15.149:0/1686811350 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5558d4a64420 0x5558d498ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:25:47.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.748+0000 7f1bc9a09700 1 --2- 172.21.15.149:0/1686811350 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5558d498efb0 0x5558d4a5b910 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x5558d4990b40 tx=0x7f1bc4006340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6f2c5641d3203c1 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:47.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.748+0000 7f1bbb7fe700 1 -- 172.21.15.149:0/1686811350 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc4006ca0 con 0x5558d498efb0 2023-11-08T19:25:47.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.749+0000 7f1bbb7fe700 1 -- 172.21.15.149:0/1686811350 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc4006e00 con 0x5558d498efb0 2023-11-08T19:25:47.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.749+0000 7f1bbb7fe700 1 -- 172.21.15.149:0/1686811350 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc4003690 con 0x5558d498efb0 2023-11-08T19:25:47.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.749+0000 7f1bd3173080 1 -- 172.21.15.149:0/1686811350 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5558d498efb0 msgr2=0x5558d4a5b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:47.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.749+0000 7f1bd3173080 1 --2- 172.21.15.149:0/1686811350 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5558d498efb0 0x5558d4a5b910 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x5558d4990b40 tx=0x7f1bc4006340 comp rx=0 tx=0).stop 2023-11-08T19:25:47.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.749+0000 7f1bd3173080 1 -- 172.21.15.149:0/1686811350 shutdown_connections 2023-11-08T19:25:47.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.749+0000 7f1bd3173080 1 --2- 172.21.15.149:0/1686811350 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5558d498efb0 0x5558d4a5b910 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:47.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.749+0000 7f1bd3173080 1 --2- 172.21.15.149:0/1686811350 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1bb40027e0 0x5558d4a58390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:47.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.749+0000 7f1bd3173080 1 --2- 172.21.15.149:0/1686811350 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5558d4a64420 0x5558d498ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:47.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.749+0000 7f1bd3173080 1 -- 172.21.15.149:0/1686811350 >> 172.21.15.149:0/1686811350 conn(0x5558d49bd6d0 msgr2=0x5558d4a5dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:47.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.749+0000 7f1bd3173080 1 -- 172.21.15.149:0/1686811350 shutdown_connections 2023-11-08T19:25:47.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.749+0000 7f1bd3173080 1 -- 172.21.15.149:0/1686811350 wait complete. 2023-11-08T19:25:47.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.750+0000 7f1bd3173080 1 Processor -- start 2023-11-08T19:25:47.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.750+0000 7f1bd3173080 1 -- start start 2023-11-08T19:25:47.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.750+0000 7f1bd3173080 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5558d498efb0 0x5558d4a42a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:47.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.750+0000 7f1bd3173080 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5558d4a64420 0x5558d4a5f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:47.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.750+0000 7f1bd3173080 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1bb40027e0 0x5558d4a5ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:47.760 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.750+0000 7f1bd3173080 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558d48c8680 con 0x7f1bb40027e0 2023-11-08T19:25:47.760 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.750+0000 7f1bd3173080 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558d4a433f0 con 0x5558d4a64420 2023-11-08T19:25:47.760 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.750+0000 7f1bd3173080 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x5558d498ea70 con 0x5558d498efb0 2023-11-08T19:25:47.760 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.751+0000 7f1bc9a09700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1bb40027e0 0x5558d4a5ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:47.760 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.751+0000 7f1bc9a09700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1bb40027e0 0x5558d4a5ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41602/0 (socket says 172.21.15.149:41602) 2023-11-08T19:25:47.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.751+0000 7f1bc9a09700 1 -- 172.21.15.149:0/92203803 learned_addr learned my addr 172.21.15.149:0/92203803 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:47.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.751+0000 7f1bc9208700 1 --2- 172.21.15.149:0/92203803 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5558d498efb0 0x5558d4a42a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:47.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.751+0000 7f1bc8a07700 1 --2- 172.21.15.149:0/92203803 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5558d4a64420 0x5558d4a5f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:47.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.751+0000 7f1bc9a09700 1 -- 172.21.15.149:0/92203803 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5558d498efb0 msgr2=0x5558d4a42a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:47.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.751+0000 7f1bc9a09700 1 --2- 172.21.15.149:0/92203803 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5558d498efb0 0x5558d4a42a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:47.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.751+0000 7f1bc9a09700 1 -- 172.21.15.149:0/92203803 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5558d4a64420 msgr2=0x5558d4a5f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:47.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.751+0000 7f1bc9a09700 1 --2- 172.21.15.149:0/92203803 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5558d4a64420 0x5558d4a5f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:47.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.751+0000 7f1bc9a09700 1 -- 172.21.15.149:0/92203803 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5558d48fa7c0 con 0x7f1bb40027e0 2023-11-08T19:25:47.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.751+0000 7f1bc8a07700 1 --2- 172.21.15.149:0/92203803 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5558d4a64420 0x5558d4a5f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:25:47.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.751+0000 7f1bc9a09700 1 --2- 172.21.15.149:0/92203803 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1bb40027e0 0x5558d4a5ff00 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x5558d49923f0 tx=0x7f1bc4001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:47.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.751+0000 7f1bba7fc700 1 -- 172.21.15.149:0/92203803 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc4006ca0 con 0x7f1bb40027e0 2023-11-08T19:25:47.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.751+0000 7f1bba7fc700 1 -- 172.21.15.149:0/92203803 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc401c610 con 0x7f1bb40027e0 2023-11-08T19:25:47.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.751+0000 7f1bd3173080 1 -- 172.21.15.149:0/92203803 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5558d48d3b70 con 0x7f1bb40027e0 2023-11-08T19:25:47.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.751+0000 7f1bba7fc700 1 -- 172.21.15.149:0/92203803 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc401c9c0 con 0x7f1bb40027e0 2023-11-08T19:25:47.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.751+0000 7f1bd3173080 1 -- 172.21.15.149:0/92203803 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5558d48d35d0 con 0x7f1bb40027e0 2023-11-08T19:25:47.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.752+0000 7f1bba7fc700 1 -- 172.21.15.149:0/92203803 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1bc401cb20 con 0x7f1bb40027e0 2023-11-08T19:25:47.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.753+0000 7f1bba7fc700 1 --2- 172.21.15.149:0/92203803 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1bac069820 0x7f1bac06bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:47.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.753+0000 7f1bba7fc700 1 -- 172.21.15.149:0/92203803 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 7131+0+0 (secure 0 0 0) 0x7f1bc4089dc0 con 0x7f1bb40027e0 2023-11-08T19:25:47.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.753+0000 7f1bc9208700 1 --2- 172.21.15.149:0/92203803 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1bac069820 0x7f1bac06bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:47.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.753+0000 7f1bd3173080 1 -- 172.21.15.149:0/92203803 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- pool_op(delete snap pool 12 tid 1 name snap4 v0) v4 -- 0x5558d49444a0 con 0x7f1bb40027e0 2023-11-08T19:25:47.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:47.753+0000 7f1bc9208700 1 --2- 172.21.15.149:0/92203803 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1bac069820 0x7f1bac06bce0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x5558d49bb2c0 tx=0x7f1bc000c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:48.278 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.277+0000 7f1bba7fc700 1 -- 172.21.15.149:0/92203803 <== mon.0 v2:172.21.15.149:3300/0 6 ==== pool_op_reply(tid 1 (0) Success v71) v1 ==== 43+0+0 (secure 0 0 0) 0x7f1bc4054a10 con 0x7f1bb40027e0 2023-11-08T19:25:48.278 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.277+0000 7f1bba7fc700 1 -- 172.21.15.149:0/92203803 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=71}) v3 -- 0x7f1bac073f60 con 0x7f1bb40027e0 2023-11-08T19:25:48.278 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.277+0000 7f1bba7fc700 1 -- 172.21.15.149:0/92203803 <== mon.0 v2:172.21.15.149:3300/0 7 ==== osd_map(71..71 src has 1..71) v4 ==== 970+0+0 (secure 0 0 0) 0x7f1bc40222d0 con 0x7f1bb40027e0 2023-11-08T19:25:48.279 INFO:teuthology.orchestra.run.smithi149.stdout:removed pool test_data_pool snap snap4 2023-11-08T19:25:48.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.277+0000 7f1bd3173080 1 -- 172.21.15.149:0/92203803 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1bac069820 msgr2=0x7f1bac06bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:48.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.277+0000 7f1bd3173080 1 --2- 172.21.15.149:0/92203803 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1bac069820 0x7f1bac06bce0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x5558d49bb2c0 tx=0x7f1bc000c040 comp rx=0 tx=0).stop 2023-11-08T19:25:48.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.277+0000 7f1bd3173080 1 -- 172.21.15.149:0/92203803 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1bb40027e0 msgr2=0x5558d4a5ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:48.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.277+0000 7f1bd3173080 1 --2- 172.21.15.149:0/92203803 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1bb40027e0 0x5558d4a5ff00 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x5558d49923f0 tx=0x7f1bc4001d80 comp rx=0 tx=0).stop 2023-11-08T19:25:48.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.277+0000 7f1bd3173080 1 -- 172.21.15.149:0/92203803 shutdown_connections 2023-11-08T19:25:48.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.277+0000 7f1bd3173080 1 --2- 172.21.15.149:0/92203803 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1bac069820 0x7f1bac06bce0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:48.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.277+0000 7f1bd3173080 1 --2- 172.21.15.149:0/92203803 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1bb40027e0 0x5558d4a5ff00 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:48.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.277+0000 7f1bd3173080 1 --2- 172.21.15.149:0/92203803 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5558d498efb0 0x5558d4a42a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:48.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.277+0000 7f1bd3173080 1 --2- 172.21.15.149:0/92203803 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5558d4a64420 0x5558d4a5f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:48.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.277+0000 7f1bd3173080 1 -- 172.21.15.149:0/92203803 >> 172.21.15.149:0/92203803 conn(0x5558d49bd6d0 msgr2=0x5558d4a5da30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:48.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.277+0000 7f1bd3173080 1 -- 172.21.15.149:0/92203803 shutdown_connections 2023-11-08T19:25:48.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.277+0000 7f1bd3173080 1 -- 172.21.15.149:0/92203803 wait complete. 2023-11-08T19:25:48.283 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete test_data_pool 2023-11-08T19:25:48.451 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.450+0000 7f0f01f34700 1 Processor -- start 2023-11-08T19:25:48.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.450+0000 7f0f01f34700 1 -- start start 2023-11-08T19:25:48.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.451+0000 7f0f01f34700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f0efc15b880 0x7f0efc15f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:48.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.451+0000 7f0f01f34700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0efc0b3d60 con 0x7f0efc0b38b0 2023-11-08T19:25:48.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.451+0000 7f0f01f34700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0efc15bc60 con 0x7f0efc0b7460 2023-11-08T19:25:48.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.451+0000 7f0f01f34700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0efc0ccba0 con 0x7f0efc15b880 2023-11-08T19:25:48.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.451+0000 7f0efaffd700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f0efc0b38b0 0x7f0efc0b6d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:43608/0 (socket says 172.21.15.149:43608) 2023-11-08T19:25:48.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.451+0000 7f0efaffd700 1 -- 172.21.15.149:0/3866561184 learned_addr learned my addr 172.21.15.149:0/3866561184 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:25:48.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.451+0000 7f0efb7fe700 1 --2- 172.21.15.149:0/3866561184 >> v2:172.21.15.160:3300/0 conn(0x7f0efc15b880 0x7f0efc15f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:48.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.451+0000 7f0efa7fc700 1 -- 172.21.15.149:0/3866561184 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2958207542 0 0) 0x7f0efc0b3d60 con 0x7f0efc0b38b0 2023-11-08T19:25:48.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.451+0000 7f0efa7fc700 1 -- 172.21.15.149:0/3866561184 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ee80035b0 con 0x7f0efc0b38b0 2023-11-08T19:25:48.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.451+0000 7f0efa7fc700 1 -- 172.21.15.149:0/3866561184 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 439478884 0 0) 0x7f0ee80035b0 con 0x7f0efc0b38b0 2023-11-08T19:25:48.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.451+0000 7f0efa7fc700 1 -- 172.21.15.149:0/3866561184 >> v2:172.21.15.160:3300/0 conn(0x7f0efc15b880 msgr2=0x7f0efc15f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:48.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.451+0000 7f0efa7fc700 1 --2- 172.21.15.149:0/3866561184 >> v2:172.21.15.160:3300/0 conn(0x7f0efc15b880 0x7f0efc15f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:48.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.451+0000 7f0efa7fc700 1 -- 172.21.15.149:0/3866561184 >> v1:172.21.15.160:6789/0 conn(0x7f0efc0b7460 legacy=0x7f0efc0cfdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:48.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.451+0000 7f0efa7fc700 1 -- 172.21.15.149:0/3866561184 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0efc15f960 con 0x7f0efc0b38b0 2023-11-08T19:25:48.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.451+0000 7f0efa7fc700 1 -- 172.21.15.149:0/3866561184 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f0eec001670 con 0x7f0efc0b38b0 2023-11-08T19:25:48.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.451+0000 7f0efb7fe700 1 --2- 172.21.15.149:0/3866561184 >> v2:172.21.15.160:3300/0 conn(0x7f0efc15b880 0x7f0efc15f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:25:48.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.452+0000 7f0efa7fc700 1 -- 172.21.15.149:0/3866561184 >> v1:172.21.15.149:6789/0 conn(0x7f0efc0b38b0 legacy=0x7f0efc0b6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:48.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.452+0000 7f0efa7fc700 1 --2- 172.21.15.149:0/3866561184 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ee8003a70 0x7f0ee8003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:48.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.452+0000 7f0efa7fc700 1 --2- 172.21.15.149:0/3866561184 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0ee8004850 0x7f0ee8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:48.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.452+0000 7f0efa7fc700 1 --2- 172.21.15.149:0/3866561184 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ee8005280 0x7f0ee800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:48.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.452+0000 7f0efa7fc700 1 -- 172.21.15.149:0/3866561184 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0efc0ccba0 con 0x7f0ee8005280 2023-11-08T19:25:48.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.452+0000 7f0efa7fc700 1 -- 172.21.15.149:0/3866561184 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee800c1e0 con 0x7f0ee8003a70 2023-11-08T19:25:48.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.452+0000 7f0efa7fc700 1 -- 172.21.15.149:0/3866561184 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee800c3a0 con 0x7f0ee8004850 2023-11-08T19:25:48.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.452+0000 7f0efbfff700 1 --2- 172.21.15.149:0/3866561184 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ee8005280 0x7f0ee800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:48.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.452+0000 7f0efb7fe700 1 --2- 172.21.15.149:0/3866561184 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ee8003a70 0x7f0ee8003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:48.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.452+0000 7f0efaffd700 1 --2- 172.21.15.149:0/3866561184 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0ee8004850 0x7f0ee8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:48.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.452+0000 7f0efbfff700 1 -- 172.21.15.149:0/3866561184 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0ee8004850 msgr2=0x7f0ee8004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:48.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.452+0000 7f0efbfff700 1 --2- 172.21.15.149:0/3866561184 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0ee8004850 0x7f0ee8004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:48.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.452+0000 7f0efbfff700 1 -- 172.21.15.149:0/3866561184 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ee8003a70 msgr2=0x7f0ee8003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:48.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.452+0000 7f0efbfff700 1 --2- 172.21.15.149:0/3866561184 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ee8003a70 0x7f0ee8003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:48.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.452+0000 7f0efbfff700 1 -- 172.21.15.149:0/3866561184 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee80035b0 con 0x7f0ee8005280 2023-11-08T19:25:48.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.452+0000 7f0efaffd700 1 --2- 172.21.15.149:0/3866561184 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0ee8004850 0x7f0ee8004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:25:48.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.452+0000 7f0efbfff700 1 -- 172.21.15.149:0/3866561184 reap_dead start 2023-11-08T19:25:48.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.452+0000 7f0efbfff700 1 --2- 172.21.15.149:0/3866561184 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ee8005280 0x7f0ee800ba10 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f0ef400c190 tx=0x7f0ee8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25a4308de64fe05 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:48.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.452+0000 7f0efa7fc700 1 -- 172.21.15.149:0/3866561184 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef4001db0 con 0x7f0ee8005280 2023-11-08T19:25:48.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.452+0000 7f0efa7fc700 1 -- 172.21.15.149:0/3866561184 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ef400cc30 con 0x7f0ee8005280 2023-11-08T19:25:48.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.452+0000 7f0efa7fc700 1 -- 172.21.15.149:0/3866561184 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef4003a00 con 0x7f0ee8005280 2023-11-08T19:25:48.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.453+0000 7f0f01f34700 1 -- 172.21.15.149:0/3866561184 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ee8005280 msgr2=0x7f0ee800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:48.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.453+0000 7f0f01f34700 1 --2- 172.21.15.149:0/3866561184 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ee8005280 0x7f0ee800ba10 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f0ef400c190 tx=0x7f0ee8005880 comp rx=0 tx=0).stop 2023-11-08T19:25:48.468 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.453+0000 7f0f01f34700 1 -- 172.21.15.149:0/3866561184 shutdown_connections 2023-11-08T19:25:48.468 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.453+0000 7f0f01f34700 1 --2- 172.21.15.149:0/3866561184 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ee8005280 0x7f0ee800ba10 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:48.468 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.453+0000 7f0f01f34700 1 -- 172.21.15.149:0/3866561184 >> 172.21.15.149:0/3866561184 conn(0x7f0efc0ce210 msgr2=0x7f0efc0ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:48.468 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.453+0000 7f0f01f34700 1 -- 172.21.15.149:0/3866561184 shutdown_connections 2023-11-08T19:25:48.468 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.453+0000 7f0f01f34700 1 -- 172.21.15.149:0/3866561184 wait complete. 2023-11-08T19:25:48.469 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.454+0000 7f0f01f34700 1 Processor -- start 2023-11-08T19:25:48.469 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.454+0000 7f0f01f34700 1 -- start start 2023-11-08T19:25:48.469 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.455+0000 7f0f01f34700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ee8005280 0x7f0efc15ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:48.469 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.455+0000 7f0f01f34700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0efc15ea90 0x7f0efc153060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:48.469 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.455+0000 7f0f01f34700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0efc15d280 0x7f0efc157d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:48.470 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.455+0000 7f0f01f34700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0efc1535a0 con 0x7f0ee8005280 2023-11-08T19:25:48.470 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.455+0000 7f0f01f34700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0efc15d9f0 con 0x7f0efc15d280 2023-11-08T19:25:48.470 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.455+0000 7f0f01f34700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0efc15dcd0 con 0x7f0efc15ea90 2023-11-08T19:25:48.470 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.455+0000 7f0efb7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ee8005280 0x7f0efc15ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:48.470 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.455+0000 7f0efb7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ee8005280 0x7f0efc15ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41616/0 (socket says 172.21.15.149:41616) 2023-11-08T19:25:48.471 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.455+0000 7f0efb7fe700 1 -- 172.21.15.149:0/2530351165 learned_addr learned my addr 172.21.15.149:0/2530351165 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:48.471 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.455+0000 7f0efaffd700 1 --2- 172.21.15.149:0/2530351165 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0efc15ea90 0x7f0efc153060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:48.471 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.455+0000 7f0efbfff700 1 --2- 172.21.15.149:0/2530351165 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0efc15d280 0x7f0efc157d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:48.471 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.455+0000 7f0efb7fe700 1 -- 172.21.15.149:0/2530351165 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0efc15ea90 msgr2=0x7f0efc153060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:48.471 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.455+0000 7f0efb7fe700 1 --2- 172.21.15.149:0/2530351165 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0efc15ea90 0x7f0efc153060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:48.472 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.455+0000 7f0efb7fe700 1 -- 172.21.15.149:0/2530351165 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0efc15d280 msgr2=0x7f0efc157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:48.472 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.455+0000 7f0efb7fe700 1 --2- 172.21.15.149:0/2530351165 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0efc15d280 0x7f0efc157d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:48.472 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.455+0000 7f0efb7fe700 1 -- 172.21.15.149:0/2530351165 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0efc15dfb0 con 0x7f0ee8005280 2023-11-08T19:25:48.472 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.455+0000 7f0efaffd700 1 --2- 172.21.15.149:0/2530351165 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0efc15ea90 0x7f0efc153060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:25:48.472 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.455+0000 7f0efbfff700 1 --2- 172.21.15.149:0/2530351165 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0efc15d280 0x7f0efc157d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:25:48.472 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.456+0000 7f0efb7fe700 1 --2- 172.21.15.149:0/2530351165 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ee8005280 0x7f0efc15ca30 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f0ee4011ca0 tx=0x7f0ee400f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:48.473 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.456+0000 7f0ef3fff700 1 -- 172.21.15.149:0/2530351165 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee400fb30 con 0x7f0ee8005280 2023-11-08T19:25:48.473 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.456+0000 7f0ef3fff700 1 -- 172.21.15.149:0/2530351165 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee400fc90 con 0x7f0ee8005280 2023-11-08T19:25:48.473 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.456+0000 7f0f01f34700 1 -- 172.21.15.149:0/2530351165 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0efc15e290 con 0x7f0ee8005280 2023-11-08T19:25:48.473 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.456+0000 7f0ef3fff700 1 -- 172.21.15.149:0/2530351165 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee4004020 con 0x7f0ee8005280 2023-11-08T19:25:48.473 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.456+0000 7f0f01f34700 1 -- 172.21.15.149:0/2530351165 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0efc15d700 con 0x7f0ee8005280 2023-11-08T19:25:48.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.457+0000 7f0f01f34700 1 -- 172.21.15.149:0/2530351165 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0efc15e7b0 con 0x7f0ee8005280 2023-11-08T19:25:48.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.457+0000 7f0ef3fff700 1 -- 172.21.15.149:0/2530351165 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0ee4004180 con 0x7f0ee8005280 2023-11-08T19:25:48.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.457+0000 7f0ef3fff700 1 --2- 172.21.15.149:0/2530351165 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0edc06af30 0x7f0edc06d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:48.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.458+0000 7f0ef3fff700 1 -- 172.21.15.149:0/2530351165 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f0ee408a150 con 0x7f0ee8005280 2023-11-08T19:25:48.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.458+0000 7f0efaffd700 1 --2- 172.21.15.149:0/2530351165 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0edc06af30 0x7f0edc06d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:48.475 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.458+0000 7f0efaffd700 1 --2- 172.21.15.149:0/2530351165 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0edc06af30 0x7f0edc06d3f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f0efc15f6b0 tx=0x7f0eec009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:48.475 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.462+0000 7f0ef3fff700 1 -- 172.21.15.149:0/2530351165 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0efc15e7b0 con 0x7f0ee8005280 2023-11-08T19:25:48.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.652+0000 7f0f01f34700 1 -- 172.21.15.149:0/2530351165 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "test_data_pool"} v 0) v1 -- 0x7f0efc15e7b0 con 0x7f0ee8005280 2023-11-08T19:25:48.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.652+0000 7f0ef3fff700 1 -- 172.21.15.149:0/2530351165 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "test_data_pool"}]=-1 WARNING: this will *PERMANENTLY DESTROY* all data stored in pool test_data_pool. If you are *ABSOLUTELY CERTAIN* that is what you want, pass the pool name *twice*, followed by --yes-i-really-really-mean-it. v71) v1 ==== 296+0+0 (secure 0 0 0) 0x7f0efc15e7b0 con 0x7f0ee8005280 2023-11-08T19:25:48.655 INFO:teuthology.orchestra.run.smithi149.stderr:Error EPERM: WARNING: this will *PERMANENTLY DESTROY* all data stored in pool test_data_pool. If you are *ABSOLUTELY CERTAIN* that is what you want, pass the pool name *twice*, followed by --yes-i-really-really-mean-it. 2023-11-08T19:25:48.658 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-08T19:25:48.659 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete test_metadata_pool 2023-11-08T19:25:48.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.781+0000 7f0be3859700 1 Processor -- start 2023-11-08T19:25:48.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.781+0000 7f0be3859700 1 -- start start 2023-11-08T19:25:48.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.782+0000 7f0be3859700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0bdc15dbe0 0x7f0bdc0d3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:48.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.782+0000 7f0be3859700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0bdc0b9640 0x7f0bdc0d1980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:48.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.782+0000 7f0be3859700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f0bdc0d0330 0x7f0bdc0d07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:48.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.782+0000 7f0be3859700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bdc0d0d00 con 0x7f0bdc0b9640 2023-11-08T19:25:48.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.782+0000 7f0be3859700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bdc15dfc0 con 0x7f0bdc0d0330 2023-11-08T19:25:48.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.782+0000 7f0be3859700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc0d2280 con 0x7f0bdc15dbe0 2023-11-08T19:25:48.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.782+0000 7f0be0df4700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0bdc0b9640 0x7f0bdc0d1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:48.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.782+0000 7f0be0df4700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0bdc0b9640 0x7f0bdc0d1980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41626/0 (socket says 172.21.15.149:41626) 2023-11-08T19:25:48.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.782+0000 7f0be0df4700 1 -- 172.21.15.149:0/2781570084 learned_addr learned my addr 172.21.15.149:0/2781570084 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:48.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.782+0000 7f0be15f5700 1 --2- 172.21.15.149:0/2781570084 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0bdc15dbe0 0x7f0bdc0d3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:48.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.782+0000 7f0be1df6700 1 --2- 172.21.15.149:0/2781570084 >> v2:172.21.15.160:3300/0 conn(0x7f0bdc0d0330 0x7f0bdc0d07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:48.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.782+0000 7f0be0df4700 1 -- 172.21.15.149:0/2781570084 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0bdc15dbe0 msgr2=0x7f0bdc0d3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:48.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.782+0000 7f0be0df4700 1 --2- 172.21.15.149:0/2781570084 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0bdc15dbe0 0x7f0bdc0d3320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:48.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.782+0000 7f0be0df4700 1 -- 172.21.15.149:0/2781570084 >> v2:172.21.15.160:3300/0 conn(0x7f0bdc0d0330 msgr2=0x7f0bdc0d07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:48.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.782+0000 7f0be0df4700 1 --2- 172.21.15.149:0/2781570084 >> v2:172.21.15.160:3300/0 conn(0x7f0bdc0d0330 0x7f0bdc0d07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:48.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.782+0000 7f0be0df4700 1 -- 172.21.15.149:0/2781570084 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bdc0d2560 con 0x7f0bdc0b9640 2023-11-08T19:25:48.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.782+0000 7f0be1df6700 1 --2- 172.21.15.149:0/2781570084 >> v2:172.21.15.160:3300/0 conn(0x7f0bdc0d0330 0x7f0bdc0d07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:25:48.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.782+0000 7f0be0df4700 1 --2- 172.21.15.149:0/2781570084 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0bdc0b9640 0x7f0bdc0d1980 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc0b8f30 tx=0x7f0bd8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dd7a383f902306b server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:48.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.783+0000 7f0bd3fff700 1 -- 172.21.15.149:0/2781570084 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd800b870 con 0x7f0bdc0b9640 2023-11-08T19:25:48.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.783+0000 7f0bd3fff700 1 -- 172.21.15.149:0/2781570084 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bd800b9d0 con 0x7f0bdc0b9640 2023-11-08T19:25:48.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.783+0000 7f0bd3fff700 1 -- 172.21.15.149:0/2781570084 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd800bd60 con 0x7f0bdc0b9640 2023-11-08T19:25:48.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.783+0000 7f0be3859700 1 -- 172.21.15.149:0/2781570084 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0bdc0b9640 msgr2=0x7f0bdc0d1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:48.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.783+0000 7f0be3859700 1 --2- 172.21.15.149:0/2781570084 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0bdc0b9640 0x7f0bdc0d1980 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc0b8f30 tx=0x7f0bd8009bd0 comp rx=0 tx=0).stop 2023-11-08T19:25:48.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.783+0000 7f0be3859700 1 -- 172.21.15.149:0/2781570084 shutdown_connections 2023-11-08T19:25:48.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.783+0000 7f0be3859700 1 --2- 172.21.15.149:0/2781570084 >> v2:172.21.15.160:3300/0 conn(0x7f0bdc0d0330 0x7f0bdc0d07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:48.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.783+0000 7f0be3859700 1 --2- 172.21.15.149:0/2781570084 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0bdc15dbe0 0x7f0bdc0d3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:48.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.783+0000 7f0be3859700 1 --2- 172.21.15.149:0/2781570084 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0bdc0b9640 0x7f0bdc0d1980 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:48.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.783+0000 7f0be3859700 1 -- 172.21.15.149:0/2781570084 >> 172.21.15.149:0/2781570084 conn(0x7f0bdc06bd60 msgr2=0x7f0bdc06c140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:48.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.783+0000 7f0be3859700 1 -- 172.21.15.149:0/2781570084 shutdown_connections 2023-11-08T19:25:48.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.783+0000 7f0be3859700 1 -- 172.21.15.149:0/2781570084 wait complete. 2023-11-08T19:25:48.793 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.784+0000 7f0be3859700 1 Processor -- start 2023-11-08T19:25:48.793 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.785+0000 7f0be3859700 1 -- start start 2023-11-08T19:25:48.794 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.785+0000 7f0be3859700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0bdc0b9640 0x7f0bdc15e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:48.794 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.785+0000 7f0be3859700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0bdc0d0330 0x7f0bdc155130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:48.794 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.785+0000 7f0be3859700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0bdc15dbe0 0x7f0bdc15fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:48.794 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.785+0000 7f0be3859700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc160690 con 0x7f0bdc15dbe0 2023-11-08T19:25:48.794 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.785+0000 7f0be3859700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc160970 con 0x7f0bdc0d0330 2023-11-08T19:25:48.795 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.785+0000 7f0be3859700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc160c50 con 0x7f0bdc0b9640 2023-11-08T19:25:48.795 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.785+0000 7f0be1df6700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0bdc15dbe0 0x7f0bdc15fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:48.795 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.785+0000 7f0be1df6700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0bdc15dbe0 0x7f0bdc15fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41634/0 (socket says 172.21.15.149:41634) 2023-11-08T19:25:48.795 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.785+0000 7f0be1df6700 1 -- 172.21.15.149:0/2710273995 learned_addr learned my addr 172.21.15.149:0/2710273995 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:48.795 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.785+0000 7f0be0df4700 1 --2- 172.21.15.149:0/2710273995 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0bdc0d0330 0x7f0bdc155130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:48.796 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.785+0000 7f0be15f5700 1 --2- 172.21.15.149:0/2710273995 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0bdc0b9640 0x7f0bdc15e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:48.796 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.786+0000 7f0be1df6700 1 -- 172.21.15.149:0/2710273995 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0bdc0b9640 msgr2=0x7f0bdc15e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:48.796 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.786+0000 7f0be1df6700 1 --2- 172.21.15.149:0/2710273995 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0bdc0b9640 0x7f0bdc15e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:48.796 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.786+0000 7f0be1df6700 1 -- 172.21.15.149:0/2710273995 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0bdc0d0330 msgr2=0x7f0bdc155130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:48.796 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.786+0000 7f0be1df6700 1 --2- 172.21.15.149:0/2710273995 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0bdc0d0330 0x7f0bdc155130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:48.797 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.786+0000 7f0be1df6700 1 -- 172.21.15.149:0/2710273995 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bd8009550 con 0x7f0bdc15dbe0 2023-11-08T19:25:48.797 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.786+0000 7f0be1df6700 1 --2- 172.21.15.149:0/2710273995 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0bdc15dbe0 0x7f0bdc15fc90 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f0bd400cef0 tx=0x7f0bd400cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:48.797 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.786+0000 7f0bd1ffb700 1 -- 172.21.15.149:0/2710273995 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd400ac80 con 0x7f0bdc15dbe0 2023-11-08T19:25:48.797 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.786+0000 7f0bd1ffb700 1 -- 172.21.15.149:0/2710273995 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bd400ade0 con 0x7f0bdc15dbe0 2023-11-08T19:25:48.797 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.786+0000 7f0be3859700 1 -- 172.21.15.149:0/2710273995 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bdc160f30 con 0x7f0bdc15dbe0 2023-11-08T19:25:48.798 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.786+0000 7f0bd1ffb700 1 -- 172.21.15.149:0/2710273995 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd4015680 con 0x7f0bdc15dbe0 2023-11-08T19:25:48.798 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.786+0000 7f0be3859700 1 -- 172.21.15.149:0/2710273995 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bdc1601d0 con 0x7f0bdc15dbe0 2023-11-08T19:25:48.798 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.787+0000 7f0be3859700 1 -- 172.21.15.149:0/2710273995 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bdc160450 con 0x7f0bdc15dbe0 2023-11-08T19:25:48.798 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.788+0000 7f0bd1ffb700 1 -- 172.21.15.149:0/2710273995 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0bd400d430 con 0x7f0bdc15dbe0 2023-11-08T19:25:48.798 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.788+0000 7f0bd1ffb700 1 --2- 172.21.15.149:0/2710273995 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0bc006af00 0x7f0bc006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:48.799 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.788+0000 7f0bd1ffb700 1 -- 172.21.15.149:0/2710273995 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f0bd4089fa0 con 0x7f0bdc15dbe0 2023-11-08T19:25:48.799 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.788+0000 7f0be15f5700 1 --2- 172.21.15.149:0/2710273995 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0bc006af00 0x7f0bc006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:48.799 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.789+0000 7f0be15f5700 1 --2- 172.21.15.149:0/2710273995 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0bc006af00 0x7f0bc006d3c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc00ab60 tx=0x7f0bcc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:48.799 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.793+0000 7f0bd1ffb700 1 -- 172.21.15.149:0/2710273995 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0bd40bcca0 con 0x7f0bdc15dbe0 2023-11-08T19:25:48.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.981+0000 7f0be3859700 1 -- 172.21.15.149:0/2710273995 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "test_metadata_pool"} v 0) v1 -- 0x7f0bdc04f730 con 0x7f0bdc15dbe0 2023-11-08T19:25:48.983 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:48.982+0000 7f0bd1ffb700 1 -- 172.21.15.149:0/2710273995 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "test_metadata_pool"}]=-1 WARNING: this will *PERMANENTLY DESTROY* all data stored in pool test_metadata_pool. If you are *ABSOLUTELY CERTAIN* that is what you want, pass the pool name *twice*, followed by --yes-i-really-really-mean-it. v71) v1 ==== 304+0+0 (secure 0 0 0) 0x7f0bdc160450 con 0x7f0bdc15dbe0 2023-11-08T19:25:48.984 INFO:teuthology.orchestra.run.smithi149.stderr:Error EPERM: WARNING: this will *PERMANENTLY DESTROY* all data stored in pool test_metadata_pool. If you are *ABSOLUTELY CERTAIN* that is what you want, pass the pool name *twice*, followed by --yes-i-really-really-mean-it. 2023-11-08T19:25:48.988 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-08T19:25:48.989 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-08T19:25:48.989 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-08T19:25:49.038 DEBUG:teuthology.orchestra.run.smithi160:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-08T19:25:49.088 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-08T19:25:49.089 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-11-08T19:25:49.089 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:25:49.107 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-11-08T19:25:49.108 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:25:49.165 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:25:49.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.325+0000 7f0f761c4700 1 Processor -- start 2023-11-08T19:25:49.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.325+0000 7f0f761c4700 1 -- start start 2023-11-08T19:25:49.331 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.327+0000 7f0f761c4700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0f700ce840 0x7f0f700d0430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:49.331 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.327+0000 7f0f761c4700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f700cc2e0 con 0x7f0f7015b950 2023-11-08T19:25:49.331 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.327+0000 7f0f761c4700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f700cc580 con 0x7f0f700cd5e0 2023-11-08T19:25:49.332 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.327+0000 7f0f761c4700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f700cc820 con 0x7f0f700ce840 2023-11-08T19:25:49.332 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.327+0000 7f0f6f7fe700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f0f7015b950 0x7f0f700ce130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:43640/0 (socket says 172.21.15.149:43640) 2023-11-08T19:25:49.332 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.327+0000 7f0f6f7fe700 1 -- 172.21.15.149:0/1351882131 learned_addr learned my addr 172.21.15.149:0/1351882131 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:25:49.332 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.327+0000 7f0f6e7fc700 1 -- 172.21.15.149:0/1351882131 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 338046635 0 0) 0x7f0f700cc2e0 con 0x7f0f7015b950 2023-11-08T19:25:49.333 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.327+0000 7f0f6e7fc700 1 -- 172.21.15.149:0/1351882131 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f5c0035b0 con 0x7f0f7015b950 2023-11-08T19:25:49.333 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.327+0000 7f0f6ffff700 1 --2- 172.21.15.149:0/1351882131 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0f700ce840 0x7f0f700d0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:49.333 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.327+0000 7f0f6e7fc700 1 -- 172.21.15.149:0/1351882131 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2608650213 0 0) 0x7f0f5c0035b0 con 0x7f0f7015b950 2023-11-08T19:25:49.333 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.327+0000 7f0f6e7fc700 1 -- 172.21.15.149:0/1351882131 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0f700ce840 msgr2=0x7f0f700d0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:49.333 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.327+0000 7f0f6e7fc700 1 --2- 172.21.15.149:0/1351882131 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0f700ce840 0x7f0f700d0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:49.334 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.327+0000 7f0f6e7fc700 1 -- 172.21.15.149:0/1351882131 >> v1:172.21.15.160:6789/0 conn(0x7f0f700cd5e0 legacy=0x7f0f700cfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:49.334 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.327+0000 7f0f6e7fc700 1 -- 172.21.15.149:0/1351882131 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f700ccb00 con 0x7f0f7015b950 2023-11-08T19:25:49.334 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.327+0000 7f0f6e7fc700 1 -- 172.21.15.149:0/1351882131 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f0f600017f0 con 0x7f0f7015b950 2023-11-08T19:25:49.334 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.327+0000 7f0f6e7fc700 1 -- 172.21.15.149:0/1351882131 >> v1:172.21.15.149:6789/0 conn(0x7f0f7015b950 legacy=0x7f0f700ce130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:49.335 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.327+0000 7f0f6e7fc700 1 --2- 172.21.15.149:0/1351882131 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0f700ce840 0x7f0f5c003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:49.335 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.327+0000 7f0f6e7fc700 1 --2- 172.21.15.149:0/1351882131 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f5c003fb0 0x7f0f5c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:49.335 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.327+0000 7f0f6e7fc700 1 --2- 172.21.15.149:0/1351882131 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0f5c004d90 0x7f0f5c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:49.335 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.327+0000 7f0f6e7fc700 1 -- 172.21.15.149:0/1351882131 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f700cc820 con 0x7f0f5c003fb0 2023-11-08T19:25:49.336 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.327+0000 7f0f6e7fc700 1 -- 172.21.15.149:0/1351882131 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5c00bb80 con 0x7f0f5c004d90 2023-11-08T19:25:49.336 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.327+0000 7f0f6e7fc700 1 -- 172.21.15.149:0/1351882131 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5c00bd40 con 0x7f0f700ce840 2023-11-08T19:25:49.336 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.327+0000 7f0f6effd700 1 --2- 172.21.15.149:0/1351882131 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f5c003fb0 0x7f0f5c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:49.336 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.328+0000 7f0f6f7fe700 1 --2- 172.21.15.149:0/1351882131 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0f700ce840 0x7f0f5c003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:49.337 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.327+0000 7f0f6ffff700 1 --2- 172.21.15.149:0/1351882131 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0f5c004d90 0x7f0f5c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:49.337 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.328+0000 7f0f6effd700 1 -- 172.21.15.149:0/1351882131 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0f700ce840 msgr2=0x7f0f5c003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:49.337 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.328+0000 7f0f6effd700 1 --2- 172.21.15.149:0/1351882131 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0f700ce840 0x7f0f5c003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:49.337 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.328+0000 7f0f6effd700 1 -- 172.21.15.149:0/1351882131 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0f5c004d90 msgr2=0x7f0f5c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:49.338 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.328+0000 7f0f6effd700 1 --2- 172.21.15.149:0/1351882131 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0f5c004d90 0x7f0f5c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:49.338 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.328+0000 7f0f6effd700 1 -- 172.21.15.149:0/1351882131 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f5c0035b0 con 0x7f0f5c003fb0 2023-11-08T19:25:49.338 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.328+0000 7f0f6effd700 1 --2- 172.21.15.149:0/1351882131 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f5c003fb0 0x7f0f5c004850 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f0f70160590 tx=0x7f0f5c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b5e85fc87e3b0af server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:49.338 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.328+0000 7f0f6e7fc700 1 -- 172.21.15.149:0/1351882131 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f580052d0 con 0x7f0f5c003fb0 2023-11-08T19:25:49.339 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.328+0000 7f0f6e7fc700 1 -- 172.21.15.149:0/1351882131 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f58005470 con 0x7f0f5c003fb0 2023-11-08T19:25:49.339 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.328+0000 7f0f6e7fc700 1 -- 172.21.15.149:0/1351882131 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f580038c0 con 0x7f0f5c003fb0 2023-11-08T19:25:49.339 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.328+0000 7f0f761c4700 1 -- 172.21.15.149:0/1351882131 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f5c003fb0 msgr2=0x7f0f5c004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:49.339 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.328+0000 7f0f761c4700 1 --2- 172.21.15.149:0/1351882131 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f5c003fb0 0x7f0f5c004850 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f0f70160590 tx=0x7f0f5c005880 comp rx=0 tx=0).stop 2023-11-08T19:25:49.339 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.329+0000 7f0f6ffff700 1 -- 172.21.15.149:0/1351882131 reap_dead start 2023-11-08T19:25:49.340 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.329+0000 7f0f761c4700 1 -- 172.21.15.149:0/1351882131 shutdown_connections 2023-11-08T19:25:49.340 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.329+0000 7f0f761c4700 1 -- 172.21.15.149:0/1351882131 >> 172.21.15.149:0/1351882131 conn(0x7f0f7008afd0 msgr2=0x7f0f700d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:49.340 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.329+0000 7f0f761c4700 1 -- 172.21.15.149:0/1351882131 shutdown_connections 2023-11-08T19:25:49.340 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.329+0000 7f0f761c4700 1 -- 172.21.15.149:0/1351882131 wait complete. 2023-11-08T19:25:49.340 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.330+0000 7f0f761c4700 1 Processor -- start 2023-11-08T19:25:49.341 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.330+0000 7f0f761c4700 1 -- start start 2023-11-08T19:25:49.344 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.331+0000 7f0f761c4700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f5c003fb0 0x7f0f7015a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:49.344 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.331+0000 7f0f761c4700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0f700b6250 0x7f0f700b66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:49.344 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.331+0000 7f0f761c4700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0f700701f0 0x7f0f70070650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:49.344 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.331+0000 7f0f761c4700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f70070b90 con 0x7f0f5c003fb0 2023-11-08T19:25:49.345 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.331+0000 7f0f761c4700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7006cb80 con 0x7f0f700b6250 2023-11-08T19:25:49.345 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.331+0000 7f0f761c4700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f700c4890 con 0x7f0f700701f0 2023-11-08T19:25:49.345 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.331+0000 7f0f6f7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f5c003fb0 0x7f0f7015a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:49.345 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.331+0000 7f0f6f7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f5c003fb0 0x7f0f7015a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41650/0 (socket says 172.21.15.149:41650) 2023-11-08T19:25:49.345 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.331+0000 7f0f6f7fe700 1 -- 172.21.15.149:0/1257327222 learned_addr learned my addr 172.21.15.149:0/1257327222 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:49.346 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.331+0000 7f0f6ffff700 1 --2- 172.21.15.149:0/1257327222 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0f700701f0 0x7f0f70070650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:49.346 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.331+0000 7f0f6effd700 1 --2- 172.21.15.149:0/1257327222 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0f700b6250 0x7f0f700b66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:49.346 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.331+0000 7f0f6f7fe700 1 -- 172.21.15.149:0/1257327222 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0f700701f0 msgr2=0x7f0f70070650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:49.346 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.331+0000 7f0f6f7fe700 1 --2- 172.21.15.149:0/1257327222 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0f700701f0 0x7f0f70070650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:49.347 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.331+0000 7f0f6f7fe700 1 -- 172.21.15.149:0/1257327222 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0f700b6250 msgr2=0x7f0f700b66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:49.347 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.331+0000 7f0f6f7fe700 1 --2- 172.21.15.149:0/1257327222 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0f700b6250 0x7f0f700b66d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:49.347 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.331+0000 7f0f6f7fe700 1 -- 172.21.15.149:0/1257327222 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f7006bc90 con 0x7f0f5c003fb0 2023-11-08T19:25:49.347 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.331+0000 7f0f6effd700 1 --2- 172.21.15.149:0/1257327222 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0f700b6250 0x7f0f700b66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:25:49.347 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.331+0000 7f0f6f7fe700 1 --2- 172.21.15.149:0/1257327222 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f5c003fb0 0x7f0f7015a690 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f0f600011d0 tx=0x7f0f6000fe70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:49.348 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.331+0000 7f0f67fff700 1 -- 172.21.15.149:0/1257327222 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f60001ce0 con 0x7f0f5c003fb0 2023-11-08T19:25:49.348 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.331+0000 7f0f67fff700 1 -- 172.21.15.149:0/1257327222 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f600072e0 con 0x7f0f5c003fb0 2023-11-08T19:25:49.348 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.331+0000 7f0f761c4700 1 -- 172.21.15.149:0/1257327222 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f7006bf70 con 0x7f0f5c003fb0 2023-11-08T19:25:49.348 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.331+0000 7f0f67fff700 1 -- 172.21.15.149:0/1257327222 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f60007690 con 0x7f0f5c003fb0 2023-11-08T19:25:49.348 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.331+0000 7f0f761c4700 1 -- 172.21.15.149:0/1257327222 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f7006c530 con 0x7f0f5c003fb0 2023-11-08T19:25:49.349 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.332+0000 7f0f761c4700 1 -- 172.21.15.149:0/1257327222 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f700745f0 con 0x7f0f5c003fb0 2023-11-08T19:25:49.349 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.333+0000 7f0f67fff700 1 -- 172.21.15.149:0/1257327222 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0f60005830 con 0x7f0f5c003fb0 2023-11-08T19:25:49.349 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.333+0000 7f0f67fff700 1 --2- 172.21.15.149:0/1257327222 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0f5006af00 0x7f0f5006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:49.349 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.333+0000 7f0f67fff700 1 -- 172.21.15.149:0/1257327222 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f0f60089b50 con 0x7f0f5c003fb0 2023-11-08T19:25:49.349 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.333+0000 7f0f6effd700 1 --2- 172.21.15.149:0/1257327222 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0f5006af00 0x7f0f5006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:49.350 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.334+0000 7f0f6effd700 1 --2- 172.21.15.149:0/1257327222 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0f5006af00 0x7f0f5006d3c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f0f70160590 tx=0x7f0f58009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:49.350 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.338+0000 7f0f67fff700 1 -- 172.21.15.149:0/1257327222 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0f60054660 con 0x7f0f5c003fb0 2023-11-08T19:25:49.530 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.528+0000 7f0f761c4700 1 -- 172.21.15.149:0/1257327222 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0f7008b760 con 0x7f0f5c003fb0 2023-11-08T19:25:49.531 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.530+0000 7f0f67fff700 1 -- 172.21.15.149:0/1257327222 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+22137 (secure 0 0 0) 0x7f0f60057c80 con 0x7f0f5c003fb0 2023-11-08T19:25:49.532 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:25:49.532 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":71,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:25:48.269967+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-08T19:24:29.516185+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-08T19:25:29.341646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-08T19:25:30.566751+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-08T19:25:44.287064+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":71,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-08T19:25:45.623521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":12,"snaps":[{"begin":1,"length":1}]}],"new_removed_snaps":[{"pool":12,"snaps":[{"begin":1,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:25:49.533 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.532+0000 7f0f761c4700 1 -- 172.21.15.149:0/1257327222 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0f5006af00 msgr2=0x7f0f5006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:49.534 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.532+0000 7f0f761c4700 1 --2- 172.21.15.149:0/1257327222 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0f5006af00 0x7f0f5006d3c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f0f70160590 tx=0x7f0f58009030 comp rx=0 tx=0).stop 2023-11-08T19:25:49.534 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.532+0000 7f0f761c4700 1 -- 172.21.15.149:0/1257327222 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f5c003fb0 msgr2=0x7f0f7015a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:49.534 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.532+0000 7f0f761c4700 1 --2- 172.21.15.149:0/1257327222 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f5c003fb0 0x7f0f7015a690 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f0f600011d0 tx=0x7f0f6000fe70 comp rx=0 tx=0).stop 2023-11-08T19:25:49.534 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.532+0000 7f0f761c4700 1 -- 172.21.15.149:0/1257327222 shutdown_connections 2023-11-08T19:25:49.534 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.532+0000 7f0f761c4700 1 --2- 172.21.15.149:0/1257327222 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0f5006af00 0x7f0f5006d3c0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:49.535 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.532+0000 7f0f761c4700 1 --2- 172.21.15.149:0/1257327222 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0f700701f0 0x7f0f70070650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:49.535 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.532+0000 7f0f761c4700 1 --2- 172.21.15.149:0/1257327222 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f5c003fb0 0x7f0f7015a690 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:49.535 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.532+0000 7f0f761c4700 1 --2- 172.21.15.149:0/1257327222 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0f700b6250 0x7f0f700b66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:49.535 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.532+0000 7f0f761c4700 1 -- 172.21.15.149:0/1257327222 >> 172.21.15.149:0/1257327222 conn(0x7f0f7008afd0 msgr2=0x7f0f700b3a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:49.535 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.532+0000 7f0f761c4700 1 -- 172.21.15.149:0/1257327222 shutdown_connections 2023-11-08T19:25:49.536 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.532+0000 7f0f761c4700 1 -- 172.21.15.149:0/1257327222 wait complete. 2023-11-08T19:25:49.546 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-08T19:22:56.023194+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-08T19:24:29.516185+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 42, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-08T19:25:29.341646+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-11-08T19:25:30.566751+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_data_pool', 'create_time': '2023-11-08T19:25:44.287064+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 71, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-08T19:25:45.623521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-08T19:25:49.547 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-08T19:25:49.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.669+0000 7f9ebefce700 1 Processor -- start 2023-11-08T19:25:49.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.669+0000 7f9ebefce700 1 -- start start 2023-11-08T19:25:49.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.670+0000 7f9ebefce700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f9eb80af200 0x7f9eb80cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:49.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.670+0000 7f9ebefce700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f9eb815e060 0x7f9eb80ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:49.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.670+0000 7f9ebefce700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9eb80cb190 con 0x7f9eb815dc80 2023-11-08T19:25:49.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.670+0000 7f9ebefce700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9eb80ce990 con 0x7f9eb815e060 2023-11-08T19:25:49.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.670+0000 7f9ebefce700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9eb80cbda0 con 0x7f9eb80af200 2023-11-08T19:25:49.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.670+0000 7f9ebd56b700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f9eb815e060 0x7f9eb80ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:49.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.670+0000 7f9ebd56b700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f9eb815e060 0x7f9eb80ce450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41662/0 (socket says 172.21.15.149:41662) 2023-11-08T19:25:49.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.670+0000 7f9ebd56b700 1 -- 172.21.15.149:0/1830842674 learned_addr learned my addr 172.21.15.149:0/1830842674 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:49.675 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.671+0000 7f9eb7fff700 1 --2- 172.21.15.149:0/1830842674 >> v2:172.21.15.160:3300/0 conn(0x7f9eb80af200 0x7f9eb80cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:49.675 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.671+0000 7f9ebd56b700 1 -- 172.21.15.149:0/1830842674 >> v2:172.21.15.160:3300/0 conn(0x7f9eb80af200 msgr2=0x7f9eb80cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:49.675 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.671+0000 7f9ebd56b700 1 --2- 172.21.15.149:0/1830842674 >> v2:172.21.15.160:3300/0 conn(0x7f9eb80af200 0x7f9eb80cdf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:49.675 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.671+0000 7f9ebd56b700 1 -- 172.21.15.149:0/1830842674 >> v1:172.21.15.160:6789/0 conn(0x7f9eb815dc80 legacy=0x7f9eb80aeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:49.675 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.671+0000 7f9ebd56b700 1 -- 172.21.15.149:0/1830842674 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb80cb470 con 0x7f9eb815e060 2023-11-08T19:25:49.676 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.671+0000 7f9eb7fff700 1 --2- 172.21.15.149:0/1830842674 >> v2:172.21.15.160:3300/0 conn(0x7f9eb80af200 0x7f9eb80cdf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:25:49.676 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.671+0000 7f9ebd56b700 1 --2- 172.21.15.149:0/1830842674 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9eb815e060 0x7f9eb80ce450 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f9eb80712e0 tx=0x7f9eb000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1dc78df7b98b6dc server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:49.676 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.671+0000 7f9eb77fe700 1 -- 172.21.15.149:0/1830842674 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb000e070 con 0x7f9eb815e060 2023-11-08T19:25:49.676 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.671+0000 7f9eb77fe700 1 -- 172.21.15.149:0/1830842674 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb0003a20 con 0x7f9eb815e060 2023-11-08T19:25:49.676 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.671+0000 7f9eb77fe700 1 -- 172.21.15.149:0/1830842674 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb0003dd0 con 0x7f9eb815e060 2023-11-08T19:25:49.677 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.671+0000 7f9ebefce700 1 -- 172.21.15.149:0/1830842674 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9eb815e060 msgr2=0x7f9eb80ce450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:49.677 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.671+0000 7f9ebefce700 1 --2- 172.21.15.149:0/1830842674 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9eb815e060 0x7f9eb80ce450 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f9eb80712e0 tx=0x7f9eb000b330 comp rx=0 tx=0).stop 2023-11-08T19:25:49.677 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.672+0000 7f9ebefce700 1 -- 172.21.15.149:0/1830842674 shutdown_connections 2023-11-08T19:25:49.677 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.672+0000 7f9ebefce700 1 --2- 172.21.15.149:0/1830842674 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9eb815e060 0x7f9eb80ce450 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:49.677 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.672+0000 7f9ebefce700 1 --2- 172.21.15.149:0/1830842674 >> v2:172.21.15.160:3300/0 conn(0x7f9eb80af200 0x7f9eb80cdf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:49.678 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.672+0000 7f9ebefce700 1 -- 172.21.15.149:0/1830842674 >> 172.21.15.149:0/1830842674 conn(0x7f9eb80cc860 msgr2=0x7f9eb80ccc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:49.678 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.672+0000 7f9ebefce700 1 -- 172.21.15.149:0/1830842674 shutdown_connections 2023-11-08T19:25:49.678 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.672+0000 7f9ebefce700 1 -- 172.21.15.149:0/1830842674 wait complete. 2023-11-08T19:25:49.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.673+0000 7f9ebefce700 1 Processor -- start 2023-11-08T19:25:49.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.673+0000 7f9ebefce700 1 -- start start 2023-11-08T19:25:49.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.674+0000 7f9ebefce700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9eb80af200 0x7f9eb80b3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:49.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.674+0000 7f9ebefce700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9eb815dc80 0x7f9eb80c8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:49.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.674+0000 7f9ebefce700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9eb815e060 0x7f9eb81f7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:49.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.674+0000 7f9ebefce700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb81f70e0 con 0x7f9eb815e060 2023-11-08T19:25:49.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.674+0000 7f9ebefce700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb80b4270 con 0x7f9eb80af200 2023-11-08T19:25:49.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.674+0000 7f9ebefce700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb80b4550 con 0x7f9eb815dc80 2023-11-08T19:25:49.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.674+0000 7f9ebd56b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9eb815e060 0x7f9eb81f7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:49.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.674+0000 7f9ebd56b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9eb815e060 0x7f9eb81f7500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41668/0 (socket says 172.21.15.149:41668) 2023-11-08T19:25:49.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.674+0000 7f9ebd56b700 1 -- 172.21.15.149:0/2238868214 learned_addr learned my addr 172.21.15.149:0/2238868214 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:49.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.674+0000 7f9ebcd6a700 1 --2- 172.21.15.149:0/2238868214 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9eb80af200 0x7f9eb80b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:49.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.674+0000 7f9eb7fff700 1 --2- 172.21.15.149:0/2238868214 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9eb815dc80 0x7f9eb80c8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:49.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.674+0000 7f9ebd56b700 1 -- 172.21.15.149:0/2238868214 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9eb815dc80 msgr2=0x7f9eb80c8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:49.684 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.674+0000 7f9ebd56b700 1 --2- 172.21.15.149:0/2238868214 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9eb815dc80 0x7f9eb80c8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:49.684 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.674+0000 7f9ebd56b700 1 -- 172.21.15.149:0/2238868214 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9eb80af200 msgr2=0x7f9eb80b3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:49.684 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.674+0000 7f9ebd56b700 1 --2- 172.21.15.149:0/2238868214 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9eb80af200 0x7f9eb80b3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:49.684 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.674+0000 7f9ebd56b700 1 -- 172.21.15.149:0/2238868214 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb0009b30 con 0x7f9eb815e060 2023-11-08T19:25:49.684 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.674+0000 7f9eb7fff700 1 --2- 172.21.15.149:0/2238868214 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9eb815dc80 0x7f9eb80c8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:25:49.685 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.674+0000 7f9ebd56b700 1 --2- 172.21.15.149:0/2238868214 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9eb815e060 0x7f9eb81f7500 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0015040 tx=0x7f9eb0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:49.685 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.674+0000 7f9eb57fa700 1 -- 172.21.15.149:0/2238868214 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb0004440 con 0x7f9eb815e060 2023-11-08T19:25:49.685 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.674+0000 7f9eb57fa700 1 -- 172.21.15.149:0/2238868214 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb00045a0 con 0x7f9eb815e060 2023-11-08T19:25:49.685 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.674+0000 7f9ebefce700 1 -- 172.21.15.149:0/2238868214 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9eb81f6a20 con 0x7f9eb815e060 2023-11-08T19:25:49.685 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.674+0000 7f9eb57fa700 1 -- 172.21.15.149:0/2238868214 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb0004950 con 0x7f9eb815e060 2023-11-08T19:25:49.686 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.674+0000 7f9ebefce700 1 -- 172.21.15.149:0/2238868214 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eb80b3a90 con 0x7f9eb815e060 2023-11-08T19:25:49.686 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.675+0000 7f9ebefce700 1 -- 172.21.15.149:0/2238868214 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9eb806aed0 con 0x7f9eb815e060 2023-11-08T19:25:49.686 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.676+0000 7f9eb57fa700 1 -- 172.21.15.149:0/2238868214 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9eb0012430 con 0x7f9eb815e060 2023-11-08T19:25:49.686 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.676+0000 7f9eb57fa700 1 --2- 172.21.15.149:0/2238868214 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9e9c06af00 0x7f9e9c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:49.686 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.676+0000 7f9eb57fa700 1 -- 172.21.15.149:0/2238868214 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f9eb008aff0 con 0x7f9eb815e060 2023-11-08T19:25:49.687 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.676+0000 7f9ebcd6a700 1 --2- 172.21.15.149:0/2238868214 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9e9c06af00 0x7f9e9c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:49.687 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.677+0000 7f9ebcd6a700 1 --2- 172.21.15.149:0/2238868214 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9e9c06af00 0x7f9e9c06d3c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f9eac004f30 tx=0x7f9eac009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:49.687 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.681+0000 7f9eb57fa700 1 -- 172.21.15.149:0/2238868214 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9eb806aed0 con 0x7f9eb815e060 2023-11-08T19:25:49.870 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.868+0000 7f9ebefce700 1 -- 172.21.15.149:0/2238868214 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9eb81f7220 con 0x7f9eb815e060 2023-11-08T19:25:49.870 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.869+0000 7f9eb57fa700 1 -- 172.21.15.149:0/2238868214 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v71) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9eb81f7220 con 0x7f9eb815e060 2023-11-08T19:25:49.870 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 1 2023-11-08T19:25:49.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.871+0000 7f9ebefce700 1 -- 172.21.15.149:0/2238868214 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9e9c06af00 msgr2=0x7f9e9c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:49.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.871+0000 7f9ebefce700 1 --2- 172.21.15.149:0/2238868214 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9e9c06af00 0x7f9e9c06d3c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f9eac004f30 tx=0x7f9eac009040 comp rx=0 tx=0).stop 2023-11-08T19:25:49.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.871+0000 7f9ebefce700 1 -- 172.21.15.149:0/2238868214 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9eb815e060 msgr2=0x7f9eb81f7500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:49.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.871+0000 7f9ebefce700 1 --2- 172.21.15.149:0/2238868214 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9eb815e060 0x7f9eb81f7500 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0015040 tx=0x7f9eb0004ad0 comp rx=0 tx=0).stop 2023-11-08T19:25:49.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.871+0000 7f9ebefce700 1 -- 172.21.15.149:0/2238868214 shutdown_connections 2023-11-08T19:25:49.874 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.871+0000 7f9ebefce700 1 --2- 172.21.15.149:0/2238868214 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9e9c06af00 0x7f9e9c06d3c0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:49.874 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.871+0000 7f9ebefce700 1 --2- 172.21.15.149:0/2238868214 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9eb80af200 0x7f9eb80b3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:49.874 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.871+0000 7f9ebefce700 1 --2- 172.21.15.149:0/2238868214 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9eb815e060 0x7f9eb81f7500 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:49.874 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.871+0000 7f9ebefce700 1 --2- 172.21.15.149:0/2238868214 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9eb815dc80 0x7f9eb80c8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:49.874 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.871+0000 7f9ebefce700 1 -- 172.21.15.149:0/2238868214 >> 172.21.15.149:0/2238868214 conn(0x7f9eb80cc860 msgr2=0x7f9eb80cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:49.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.871+0000 7f9ebefce700 1 -- 172.21.15.149:0/2238868214 shutdown_connections 2023-11-08T19:25:49.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:49.871+0000 7f9ebefce700 1 -- 172.21.15.149:0/2238868214 wait complete. 2023-11-08T19:25:49.885 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-08T19:25:50.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.008+0000 7fe737d2d700 1 Processor -- start 2023-11-08T19:25:50.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.008+0000 7fe737d2d700 1 -- start start 2023-11-08T19:25:50.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.009+0000 7fe737d2d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe7300cfd50 0x7fe73006bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:50.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.009+0000 7fe737d2d700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe73006c3e0 con 0x7fe73006d700 2023-11-08T19:25:50.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.009+0000 7fe737d2d700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe730162560 con 0x7fe7300b3920 2023-11-08T19:25:50.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.009+0000 7fe737d2d700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7301619e0 con 0x7fe7300cfd50 2023-11-08T19:25:50.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.009+0000 7fe735ac9700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe7300cfd50 0x7fe73006bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:50.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.009+0000 7fe735ac9700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe7300cfd50 0x7fe73006bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41672/0 (socket says 172.21.15.149:41672) 2023-11-08T19:25:50.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.009+0000 7fe735ac9700 1 -- 172.21.15.149:0/1915902244 learned_addr learned my addr 172.21.15.149:0/1915902244 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:50.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.009+0000 7fe7352c8700 1 --1- 172.21.15.149:0/1915902244 >> v1:172.21.15.149:6789/0 conn(0x7fe73006d700 0x7fe7300b3210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:43674/0 (socket says 172.21.15.149:43674) 2023-11-08T19:25:50.018 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.009+0000 7fe735ac9700 1 -- 172.21.15.149:0/1915902244 >> v1:172.21.15.160:6789/0 conn(0x7fe7300b3920 legacy=0x7fe73015d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:50.018 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.009+0000 7fe735ac9700 1 -- 172.21.15.149:0/1915902244 >> v1:172.21.15.149:6789/0 conn(0x7fe73006d700 legacy=0x7fe7300b3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:50.018 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.009+0000 7fe735ac9700 1 -- 172.21.15.149:0/1915902244 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe730161cc0 con 0x7fe7300cfd50 2023-11-08T19:25:50.018 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.009+0000 7fe734ac7700 1 -- 172.21.15.149:0/1915902244 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3731290490 0 0) 0x7fe73006c3e0 con 0x7fe73006d700 2023-11-08T19:25:50.018 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.010+0000 7fe735ac9700 1 --2- 172.21.15.149:0/1915902244 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7300cfd50 0x7fe73006bea0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fe7240098f0 tx=0x7fe724009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac04b963243dfd41 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:50.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.010+0000 7fe734ac7700 1 -- 172.21.15.149:0/1915902244 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe724004230 con 0x7fe7300cfd50 2023-11-08T19:25:50.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.010+0000 7fe734ac7700 1 -- 172.21.15.149:0/1915902244 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe724004390 con 0x7fe7300cfd50 2023-11-08T19:25:50.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.010+0000 7fe734ac7700 1 -- 172.21.15.149:0/1915902244 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7240036a0 con 0x7fe7300cfd50 2023-11-08T19:25:50.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.010+0000 7fe737d2d700 1 -- 172.21.15.149:0/1915902244 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7300cfd50 msgr2=0x7fe73006bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:50.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.010+0000 7fe737d2d700 1 --2- 172.21.15.149:0/1915902244 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7300cfd50 0x7fe73006bea0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fe7240098f0 tx=0x7fe724009c00 comp rx=0 tx=0).stop 2023-11-08T19:25:50.020 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.010+0000 7fe737d2d700 1 -- 172.21.15.149:0/1915902244 shutdown_connections 2023-11-08T19:25:50.020 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.010+0000 7fe737d2d700 1 --2- 172.21.15.149:0/1915902244 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7300cfd50 0x7fe73006bea0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:50.020 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.010+0000 7fe737d2d700 1 -- 172.21.15.149:0/1915902244 >> 172.21.15.149:0/1915902244 conn(0x7fe7300ce210 msgr2=0x7fe7300ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:50.020 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.010+0000 7fe737d2d700 1 -- 172.21.15.149:0/1915902244 shutdown_connections 2023-11-08T19:25:50.020 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.011+0000 7fe737d2d700 1 -- 172.21.15.149:0/1915902244 wait complete. 2023-11-08T19:25:50.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.012+0000 7fe737d2d700 1 Processor -- start 2023-11-08T19:25:50.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.012+0000 7fe737d2d700 1 -- start start 2023-11-08T19:25:50.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.012+0000 7fe737d2d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe73006d700 0x7fe7301f62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:50.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.012+0000 7fe737d2d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7300b3920 0x7fe7301f33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:50.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.012+0000 7fe737d2d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7300cfd50 0x7fe7300cd020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:50.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.012+0000 7fe737d2d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe73015eb30 con 0x7fe7300cfd50 2023-11-08T19:25:50.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.012+0000 7fe737d2d700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7300c8c10 con 0x7fe7300b3920 2023-11-08T19:25:50.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.012+0000 7fe737d2d700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7300c8ef0 con 0x7fe73006d700 2023-11-08T19:25:50.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.012+0000 7fe7362ca700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7300cfd50 0x7fe7300cd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:50.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.013+0000 7fe7362ca700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7300cfd50 0x7fe7300cd020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41682/0 (socket says 172.21.15.149:41682) 2023-11-08T19:25:50.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.013+0000 7fe7362ca700 1 -- 172.21.15.149:0/1703668913 learned_addr learned my addr 172.21.15.149:0/1703668913 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:50.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.013+0000 7fe735ac9700 1 --2- 172.21.15.149:0/1703668913 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe73006d700 0x7fe7301f62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:50.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.013+0000 7fe7352c8700 1 --2- 172.21.15.149:0/1703668913 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7300b3920 0x7fe7301f33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:50.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.013+0000 7fe7362ca700 1 -- 172.21.15.149:0/1703668913 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe73006d700 msgr2=0x7fe7301f62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:50.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.013+0000 7fe7362ca700 1 --2- 172.21.15.149:0/1703668913 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe73006d700 0x7fe7301f62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:50.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.013+0000 7fe7362ca700 1 -- 172.21.15.149:0/1703668913 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7300b3920 msgr2=0x7fe7301f33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:50.025 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.013+0000 7fe7362ca700 1 --2- 172.21.15.149:0/1703668913 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7300b3920 0x7fe7301f33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:50.025 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.013+0000 7fe7362ca700 1 -- 172.21.15.149:0/1703668913 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe724009550 con 0x7fe7300cfd50 2023-11-08T19:25:50.025 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.013+0000 7fe7362ca700 1 --2- 172.21.15.149:0/1703668913 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7300cfd50 0x7fe7300cd020 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fe72800b9e0 tx=0x7fe72800bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:50.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.013+0000 7fe7227fc700 1 -- 172.21.15.149:0/1703668913 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72800c9b0 con 0x7fe7300cfd50 2023-11-08T19:25:50.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.013+0000 7fe7227fc700 1 -- 172.21.15.149:0/1703668913 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe72800cb50 con 0x7fe7300cfd50 2023-11-08T19:25:50.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.013+0000 7fe737d2d700 1 -- 172.21.15.149:0/1703668913 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7300c91d0 con 0x7fe7300cfd50 2023-11-08T19:25:50.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.013+0000 7fe7227fc700 1 -- 172.21.15.149:0/1703668913 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe728014440 con 0x7fe7300cfd50 2023-11-08T19:25:50.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.013+0000 7fe737d2d700 1 -- 172.21.15.149:0/1703668913 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7300c9790 con 0x7fe7300cfd50 2023-11-08T19:25:50.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.014+0000 7fe737d2d700 1 -- 172.21.15.149:0/1703668913 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7300c99b0 con 0x7fe7300cfd50 2023-11-08T19:25:50.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.014+0000 7fe7227fc700 1 -- 172.21.15.149:0/1703668913 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe7280145a0 con 0x7fe7300cfd50 2023-11-08T19:25:50.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.015+0000 7fe7227fc700 1 --2- 172.21.15.149:0/1703668913 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe71406af00 0x7fe71406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:50.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.015+0000 7fe7227fc700 1 -- 172.21.15.149:0/1703668913 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7148+0+0 (secure 0 0 0) 0x7fe7280896e0 con 0x7fe7300cfd50 2023-11-08T19:25:50.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.015+0000 7fe735ac9700 1 --2- 172.21.15.149:0/1703668913 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe71406af00 0x7fe71406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:50.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.015+0000 7fe735ac9700 1 --2- 172.21.15.149:0/1703668913 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe71406af00 0x7fe71406d3c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fe724009130 tx=0x7fe724008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:50.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.020+0000 7fe7227fc700 1 -- 172.21.15.149:0/1703668913 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe7280542a0 con 0x7fe7300cfd50 2023-11-08T19:25:50.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.212+0000 7fe737d2d700 1 -- 172.21.15.149:0/1703668913 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7fe73004f730 con 0x7fe7300cfd50 2023-11-08T19:25:50.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.213+0000 7fe7227fc700 1 -- 172.21.15.149:0/1703668913 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v71) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe7280578c0 con 0x7fe7300cfd50 2023-11-08T19:25:50.214 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:25:50.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.215+0000 7fe737d2d700 1 -- 172.21.15.149:0/1703668913 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe71406af00 msgr2=0x7fe71406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:50.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.215+0000 7fe737d2d700 1 --2- 172.21.15.149:0/1703668913 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe71406af00 0x7fe71406d3c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fe724009130 tx=0x7fe724008030 comp rx=0 tx=0).stop 2023-11-08T19:25:50.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.215+0000 7fe737d2d700 1 -- 172.21.15.149:0/1703668913 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7300cfd50 msgr2=0x7fe7300cd020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:50.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.215+0000 7fe737d2d700 1 --2- 172.21.15.149:0/1703668913 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7300cfd50 0x7fe7300cd020 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fe72800b9e0 tx=0x7fe72800bda0 comp rx=0 tx=0).stop 2023-11-08T19:25:50.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.215+0000 7fe737d2d700 1 -- 172.21.15.149:0/1703668913 shutdown_connections 2023-11-08T19:25:50.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.215+0000 7fe737d2d700 1 --2- 172.21.15.149:0/1703668913 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe71406af00 0x7fe71406d3c0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:50.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.215+0000 7fe737d2d700 1 --2- 172.21.15.149:0/1703668913 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7300cfd50 0x7fe7300cd020 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:50.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.215+0000 7fe737d2d700 1 --2- 172.21.15.149:0/1703668913 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe73006d700 0x7fe7301f62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:50.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.215+0000 7fe737d2d700 1 --2- 172.21.15.149:0/1703668913 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7300b3920 0x7fe7301f33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:50.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.215+0000 7fe737d2d700 1 -- 172.21.15.149:0/1703668913 >> 172.21.15.149:0/1703668913 conn(0x7fe7300ce210 msgr2=0x7fe7300b3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:50.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.215+0000 7fe737d2d700 1 -- 172.21.15.149:0/1703668913 shutdown_connections 2023-11-08T19:25:50.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.215+0000 7fe737d2d700 1 -- 172.21.15.149:0/1703668913 wait complete. 2023-11-08T19:25:50.229 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-08T19:25:50.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.352+0000 7f6e2a942700 1 Processor -- start 2023-11-08T19:25:50.650 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.352+0000 7f6e2a942700 1 -- start start 2023-11-08T19:25:50.650 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.353+0000 7f6e2a942700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f6e240cc0d0 0x7f6e2415f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:50.650 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.353+0000 7f6e2a942700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6e240cc910 0x7f6e240cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:50.651 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.353+0000 7f6e2a942700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e2415be80 con 0x7f6e240cc4b0 2023-11-08T19:25:50.651 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.353+0000 7f6e2a942700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e2415f9b0 con 0x7f6e240cc0d0 2023-11-08T19:25:50.651 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.353+0000 7f6e2a942700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2415fba0 con 0x7f6e240cc910 2023-11-08T19:25:50.651 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.353+0000 7f6e237fe700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f6e240cc4b0 0x7f6e2415c620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:43690/0 (socket says 172.21.15.149:43690) 2023-11-08T19:25:50.651 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.353+0000 7f6e237fe700 1 -- 172.21.15.149:0/2584642449 learned_addr learned my addr 172.21.15.149:0/2584642449 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:25:50.652 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.353+0000 7f6e23fff700 1 --2- 172.21.15.149:0/2584642449 >> v2:172.21.15.160:3300/0 conn(0x7f6e240cc0d0 0x7f6e2415f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:50.652 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.353+0000 7f6e28edf700 1 --2- 172.21.15.149:0/2584642449 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6e240cc910 0x7f6e240cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:50.652 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.353+0000 7f6e22ffd700 1 -- 172.21.15.149:0/2584642449 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4058802917 0 0) 0x7f6e2415be80 con 0x7f6e240cc4b0 2023-11-08T19:25:50.652 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.353+0000 7f6e22ffd700 1 -- 172.21.15.149:0/2584642449 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e0c0035b0 con 0x7f6e240cc4b0 2023-11-08T19:25:50.652 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.354+0000 7f6e22ffd700 1 -- 172.21.15.149:0/2584642449 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 23309583 0 0) 0x7f6e0c0035b0 con 0x7f6e240cc4b0 2023-11-08T19:25:50.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.354+0000 7f6e28edf700 1 -- 172.21.15.149:0/2584642449 >> v2:172.21.15.160:3300/0 conn(0x7f6e240cc0d0 msgr2=0x7f6e2415f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:50.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.354+0000 7f6e28edf700 1 --2- 172.21.15.149:0/2584642449 >> v2:172.21.15.160:3300/0 conn(0x7f6e240cc0d0 0x7f6e2415f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:50.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.354+0000 7f6e28edf700 1 -- 172.21.15.149:0/2584642449 >> v1:172.21.15.149:6789/0 conn(0x7f6e240cc4b0 legacy=0x7f6e2415c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:50.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.354+0000 7f6e28edf700 1 -- 172.21.15.149:0/2584642449 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e2415fe80 con 0x7f6e240cc910 2023-11-08T19:25:50.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.354+0000 7f6e23fff700 1 --2- 172.21.15.149:0/2584642449 >> v2:172.21.15.160:3300/0 conn(0x7f6e240cc0d0 0x7f6e2415f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:25:50.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.354+0000 7f6e28edf700 1 --2- 172.21.15.149:0/2584642449 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6e240cc910 0x7f6e240cf320 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c009d90 tx=0x7f6e1c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e25804e6780a95c server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:50.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.354+0000 7f6e22ffd700 1 -- 172.21.15.149:0/2584642449 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c00e070 con 0x7f6e240cc910 2023-11-08T19:25:50.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.354+0000 7f6e22ffd700 1 -- 172.21.15.149:0/2584642449 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e1c003a20 con 0x7f6e240cc910 2023-11-08T19:25:50.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.354+0000 7f6e22ffd700 1 -- 172.21.15.149:0/2584642449 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e14001670 con 0x7f6e240cc910 2023-11-08T19:25:50.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.354+0000 7f6e2a942700 1 -- 172.21.15.149:0/2584642449 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6e240cc910 msgr2=0x7f6e240cf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:50.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.354+0000 7f6e2a942700 1 --2- 172.21.15.149:0/2584642449 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6e240cc910 0x7f6e240cf320 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c009d90 tx=0x7f6e1c00b330 comp rx=0 tx=0).stop 2023-11-08T19:25:50.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.355+0000 7f6e2a942700 1 -- 172.21.15.149:0/2584642449 shutdown_connections 2023-11-08T19:25:50.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.355+0000 7f6e2a942700 1 --2- 172.21.15.149:0/2584642449 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6e240cc910 0x7f6e240cf320 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:50.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.355+0000 7f6e2a942700 1 --2- 172.21.15.149:0/2584642449 >> v2:172.21.15.160:3300/0 conn(0x7f6e240cc0d0 0x7f6e2415f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:50.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.355+0000 7f6e2a942700 1 -- 172.21.15.149:0/2584642449 >> 172.21.15.149:0/2584642449 conn(0x7f6e2406f120 msgr2=0x7f6e2406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:50.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.355+0000 7f6e2a942700 1 -- 172.21.15.149:0/2584642449 shutdown_connections 2023-11-08T19:25:50.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.355+0000 7f6e2a942700 1 -- 172.21.15.149:0/2584642449 wait complete. 2023-11-08T19:25:50.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.356+0000 7f6e2a942700 1 Processor -- start 2023-11-08T19:25:50.657 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.356+0000 7f6e2a942700 1 -- start start 2023-11-08T19:25:50.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.357+0000 7f6e2a942700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6e240cc0d0 0x7f6e2414bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:50.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.357+0000 7f6e2a942700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6e240cc4b0 0x7f6e240cafc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:50.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.357+0000 7f6e2a942700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e240cc910 0x7f6e240c77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:50.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.357+0000 7f6e2a942700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e240c4d00 con 0x7f6e240cc910 2023-11-08T19:25:50.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.357+0000 7f6e2a942700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e240c7cf0 con 0x7f6e240cc4b0 2023-11-08T19:25:50.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.357+0000 7f6e2a942700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e240c6710 con 0x7f6e240cc0d0 2023-11-08T19:25:50.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.357+0000 7f6e28edf700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e240cc910 0x7f6e240c77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:50.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.357+0000 7f6e28edf700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e240cc910 0x7f6e240c77b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41696/0 (socket says 172.21.15.149:41696) 2023-11-08T19:25:50.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.357+0000 7f6e28edf700 1 -- 172.21.15.149:0/3269721703 learned_addr learned my addr 172.21.15.149:0/3269721703 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:50.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.357+0000 7f6e23fff700 1 --2- 172.21.15.149:0/3269721703 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6e240cc0d0 0x7f6e2414bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:50.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.357+0000 7f6e237fe700 1 --2- 172.21.15.149:0/3269721703 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6e240cc4b0 0x7f6e240cafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:50.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.357+0000 7f6e28edf700 1 -- 172.21.15.149:0/3269721703 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6e240cc0d0 msgr2=0x7f6e2414bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:50.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.357+0000 7f6e28edf700 1 --2- 172.21.15.149:0/3269721703 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6e240cc0d0 0x7f6e2414bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:50.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.357+0000 7f6e28edf700 1 -- 172.21.15.149:0/3269721703 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6e240cc4b0 msgr2=0x7f6e240cafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:50.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.357+0000 7f6e28edf700 1 --2- 172.21.15.149:0/3269721703 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6e240cc4b0 0x7f6e240cafc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:50.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.357+0000 7f6e28edf700 1 -- 172.21.15.149:0/3269721703 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e180094a0 con 0x7f6e240cc910 2023-11-08T19:25:50.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.357+0000 7f6e237fe700 1 --2- 172.21.15.149:0/3269721703 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6e240cc4b0 0x7f6e240cafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:25:50.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.357+0000 7f6e28edf700 1 --2- 172.21.15.149:0/3269721703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e240cc910 0x7f6e240c77b0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f6e24074fb0 tx=0x7f6e1c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:50.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.357+0000 7f6e20ff9700 1 -- 172.21.15.149:0/3269721703 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c0045f0 con 0x7f6e240cc910 2023-11-08T19:25:50.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.357+0000 7f6e20ff9700 1 -- 172.21.15.149:0/3269721703 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e1c004750 con 0x7f6e240cc910 2023-11-08T19:25:50.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.357+0000 7f6e2a942700 1 -- 172.21.15.149:0/3269721703 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e1c009a70 con 0x7f6e240cc910 2023-11-08T19:25:50.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.357+0000 7f6e20ff9700 1 -- 172.21.15.149:0/3269721703 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c009450 con 0x7f6e240cc910 2023-11-08T19:25:50.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.357+0000 7f6e2a942700 1 -- 172.21.15.149:0/3269721703 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e240c6cd0 con 0x7f6e240cc910 2023-11-08T19:25:50.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.359+0000 7f6e2a942700 1 -- 172.21.15.149:0/3269721703 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e2404f730 con 0x7f6e240cc910 2023-11-08T19:25:50.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.359+0000 7f6e20ff9700 1 -- 172.21.15.149:0/3269721703 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6e1c0124b0 con 0x7f6e240cc910 2023-11-08T19:25:50.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.359+0000 7f6e20ff9700 1 --2- 172.21.15.149:0/3269721703 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6e1006af00 0x7f6e1006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:50.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.359+0000 7f6e20ff9700 1 -- 172.21.15.149:0/3269721703 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f6e1c08b880 con 0x7f6e240cc910 2023-11-08T19:25:50.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.359+0000 7f6e23fff700 1 --2- 172.21.15.149:0/3269721703 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6e1006af00 0x7f6e1006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:50.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.360+0000 7f6e23fff700 1 --2- 172.21.15.149:0/3269721703 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6e1006af00 0x7f6e1006d3c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f6e18009d00 tx=0x7f6e18008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:50.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.364+0000 7f6e20ff9700 1 -- 172.21.15.149:0/3269721703 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6e1c059eb0 con 0x7f6e240cc910 2023-11-08T19:25:50.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.553+0000 7f6e2a942700 1 -- 172.21.15.149:0/3269721703 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6e240cebf0 con 0x7f6e240cc910 2023-11-08T19:25:50.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.553+0000 7f6e20ff9700 1 -- 172.21.15.149:0/3269721703 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v71) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6e1c059a40 con 0x7f6e240cc910 2023-11-08T19:25:50.667 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:25:50.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.556+0000 7f6e2a942700 1 -- 172.21.15.149:0/3269721703 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6e1006af00 msgr2=0x7f6e1006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:50.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.556+0000 7f6e2a942700 1 --2- 172.21.15.149:0/3269721703 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6e1006af00 0x7f6e1006d3c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f6e18009d00 tx=0x7f6e18008040 comp rx=0 tx=0).stop 2023-11-08T19:25:50.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.556+0000 7f6e2a942700 1 -- 172.21.15.149:0/3269721703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e240cc910 msgr2=0x7f6e240c77b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:50.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.556+0000 7f6e2a942700 1 --2- 172.21.15.149:0/3269721703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e240cc910 0x7f6e240c77b0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f6e24074fb0 tx=0x7f6e1c004ad0 comp rx=0 tx=0).stop 2023-11-08T19:25:50.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.556+0000 7f6e2a942700 1 -- 172.21.15.149:0/3269721703 shutdown_connections 2023-11-08T19:25:50.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.556+0000 7f6e2a942700 1 --2- 172.21.15.149:0/3269721703 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6e1006af00 0x7f6e1006d3c0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:50.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.556+0000 7f6e2a942700 1 --2- 172.21.15.149:0/3269721703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e240cc910 0x7f6e240c77b0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:50.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.556+0000 7f6e2a942700 1 --2- 172.21.15.149:0/3269721703 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6e240cc0d0 0x7f6e2414bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:50.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.556+0000 7f6e2a942700 1 --2- 172.21.15.149:0/3269721703 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6e240cc4b0 0x7f6e240cafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:50.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.556+0000 7f6e2a942700 1 -- 172.21.15.149:0/3269721703 >> 172.21.15.149:0/3269721703 conn(0x7f6e2406f120 msgr2=0x7f6e2406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:50.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.556+0000 7f6e2a942700 1 -- 172.21.15.149:0/3269721703 shutdown_connections 2023-11-08T19:25:50.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.556+0000 7f6e2a942700 1 -- 172.21.15.149:0/3269721703 wait complete. 2023-11-08T19:25:50.672 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-08T19:25:50.796 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.795+0000 7f125b58a700 1 Processor -- start 2023-11-08T19:25:50.797 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.795+0000 7f125b58a700 1 -- start start 2023-11-08T19:25:50.800 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.796+0000 7f125b58a700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f125415abf0 0x7f12540b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:50.800 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.796+0000 7f125b58a700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f12540d1130 0x7f12540cc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:50.800 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.796+0000 7f125b58a700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f12540cc6a0 0x7f12540ce210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:50.801 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.796+0000 7f125b58a700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12540b66a0 con 0x7f125415abf0 2023-11-08T19:25:50.801 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.796+0000 7f125b58a700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12540d04a0 con 0x7f12540cc6a0 2023-11-08T19:25:50.801 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.796+0000 7f125b58a700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12540b6470 con 0x7f12540d1130 2023-11-08T19:25:50.801 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.796+0000 7f1259326700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f125415abf0 0x7f12540b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:50.801 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.796+0000 7f1259326700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f125415abf0 0x7f12540b5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41700/0 (socket says 172.21.15.149:41700) 2023-11-08T19:25:50.802 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.796+0000 7f1259326700 1 -- 172.21.15.149:0/3718575644 learned_addr learned my addr 172.21.15.149:0/3718575644 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:50.802 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.797+0000 7f1259b27700 1 --2- 172.21.15.149:0/3718575644 >> v2:172.21.15.160:3300/0 conn(0x7f12540cc6a0 0x7f12540ce210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:50.802 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.797+0000 7f1258b25700 1 --2- 172.21.15.149:0/3718575644 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f12540d1130 0x7f12540cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:50.802 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.797+0000 7f1259326700 1 -- 172.21.15.149:0/3718575644 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f12540d1130 msgr2=0x7f12540cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:50.802 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.797+0000 7f1259326700 1 --2- 172.21.15.149:0/3718575644 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f12540d1130 0x7f12540cc160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:50.803 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.797+0000 7f1259326700 1 -- 172.21.15.149:0/3718575644 >> v2:172.21.15.160:3300/0 conn(0x7f12540cc6a0 msgr2=0x7f12540ce210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:50.803 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.797+0000 7f1259326700 1 --2- 172.21.15.149:0/3718575644 >> v2:172.21.15.160:3300/0 conn(0x7f12540cc6a0 0x7f12540ce210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:50.803 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.797+0000 7f1259326700 1 -- 172.21.15.149:0/3718575644 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f125415afd0 con 0x7f125415abf0 2023-11-08T19:25:50.803 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.797+0000 7f1259b27700 1 --2- 172.21.15.149:0/3718575644 >> v2:172.21.15.160:3300/0 conn(0x7f12540cc6a0 0x7f12540ce210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:25:50.803 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.797+0000 7f1258b25700 1 --2- 172.21.15.149:0/3718575644 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f12540d1130 0x7f12540cc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:25:50.804 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.797+0000 7f1259326700 1 --2- 172.21.15.149:0/3718575644 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f125415abf0 0x7f12540b5f30 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f1254069350 tx=0x7f1244009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfeffc8ac99cf340 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:50.804 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.797+0000 7f124bfff700 1 -- 172.21.15.149:0/3718575644 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124400b870 con 0x7f125415abf0 2023-11-08T19:25:50.804 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.797+0000 7f124bfff700 1 -- 172.21.15.149:0/3718575644 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f124400b9d0 con 0x7f125415abf0 2023-11-08T19:25:50.804 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.797+0000 7f124bfff700 1 -- 172.21.15.149:0/3718575644 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124400bd60 con 0x7f125415abf0 2023-11-08T19:25:50.804 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.798+0000 7f125b58a700 1 -- 172.21.15.149:0/3718575644 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f125415abf0 msgr2=0x7f12540b5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:50.805 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.798+0000 7f125b58a700 1 --2- 172.21.15.149:0/3718575644 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f125415abf0 0x7f12540b5f30 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f1254069350 tx=0x7f1244009bd0 comp rx=0 tx=0).stop 2023-11-08T19:25:50.805 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.798+0000 7f125b58a700 1 -- 172.21.15.149:0/3718575644 shutdown_connections 2023-11-08T19:25:50.805 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.798+0000 7f125b58a700 1 --2- 172.21.15.149:0/3718575644 >> v2:172.21.15.160:3300/0 conn(0x7f12540cc6a0 0x7f12540ce210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:50.805 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.798+0000 7f125b58a700 1 --2- 172.21.15.149:0/3718575644 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f125415abf0 0x7f12540b5f30 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:50.805 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.798+0000 7f125b58a700 1 --2- 172.21.15.149:0/3718575644 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f12540d1130 0x7f12540cc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:50.806 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.798+0000 7f125b58a700 1 -- 172.21.15.149:0/3718575644 >> 172.21.15.149:0/3718575644 conn(0x7f12540d0640 msgr2=0x7f12540d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:50.806 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.798+0000 7f125b58a700 1 -- 172.21.15.149:0/3718575644 shutdown_connections 2023-11-08T19:25:50.806 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.798+0000 7f125b58a700 1 -- 172.21.15.149:0/3718575644 wait complete. 2023-11-08T19:25:50.806 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.799+0000 7f125b58a700 1 Processor -- start 2023-11-08T19:25:50.806 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.799+0000 7f125b58a700 1 -- start start 2023-11-08T19:25:50.809 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.800+0000 7f125b58a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f12540cc6a0 0x7f1254150b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:50.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.800+0000 7f125b58a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f12540d1130 0x7f12540b4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:50.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.800+0000 7f125b58a700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f125415abf0 0x7f12540ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:50.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.800+0000 7f125b58a700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1254151090 con 0x7f12540d1130 2023-11-08T19:25:50.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.800+0000 7f125b58a700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12540b5100 con 0x7f12540cc6a0 2023-11-08T19:25:50.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.800+0000 7f125b58a700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12540b5680 con 0x7f125415abf0 2023-11-08T19:25:50.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.800+0000 7f1258b25700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f12540d1130 0x7f12540b4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:50.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.800+0000 7f1258b25700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f12540d1130 0x7f12540b4bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41708/0 (socket says 172.21.15.149:41708) 2023-11-08T19:25:50.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.800+0000 7f1258b25700 1 -- 172.21.15.149:0/2795993481 learned_addr learned my addr 172.21.15.149:0/2795993481 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:50.812 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.800+0000 7f1259b27700 1 --2- 172.21.15.149:0/2795993481 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f125415abf0 0x7f12540ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:50.812 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.800+0000 7f1259326700 1 --2- 172.21.15.149:0/2795993481 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f12540cc6a0 0x7f1254150b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:50.812 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.800+0000 7f1258b25700 1 -- 172.21.15.149:0/2795993481 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f125415abf0 msgr2=0x7f12540ccb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:50.812 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.800+0000 7f1258b25700 1 --2- 172.21.15.149:0/2795993481 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f125415abf0 0x7f12540ccb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:50.812 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.800+0000 7f1258b25700 1 -- 172.21.15.149:0/2795993481 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f12540cc6a0 msgr2=0x7f1254150b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:50.813 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.800+0000 7f1258b25700 1 --2- 172.21.15.149:0/2795993481 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f12540cc6a0 0x7f1254150b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:50.813 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.800+0000 7f1258b25700 1 -- 172.21.15.149:0/2795993481 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1244009550 con 0x7f12540d1130 2023-11-08T19:25:50.813 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.800+0000 7f1259326700 1 --2- 172.21.15.149:0/2795993481 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f12540cc6a0 0x7f1254150b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:25:50.813 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.800+0000 7f1259b27700 1 --2- 172.21.15.149:0/2795993481 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f125415abf0 0x7f12540ccb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:25:50.813 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.800+0000 7f1258b25700 1 --2- 172.21.15.149:0/2795993481 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f12540d1130 0x7f12540b4bc0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f125000c750 tx=0x7f125000cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:50.814 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.800+0000 7f1249ffb700 1 -- 172.21.15.149:0/2795993481 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1250011800 con 0x7f12540d1130 2023-11-08T19:25:50.814 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.800+0000 7f1249ffb700 1 -- 172.21.15.149:0/2795993481 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1250011960 con 0x7f12540d1130 2023-11-08T19:25:50.814 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.800+0000 7f125b58a700 1 -- 172.21.15.149:0/2795993481 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12540b53a0 con 0x7f12540d1130 2023-11-08T19:25:50.814 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.800+0000 7f1249ffb700 1 -- 172.21.15.149:0/2795993481 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1250011cd0 con 0x7f12540d1130 2023-11-08T19:25:50.815 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.801+0000 7f125b58a700 1 -- 172.21.15.149:0/2795993481 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f125415b560 con 0x7f12540d1130 2023-11-08T19:25:50.815 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.801+0000 7f125b58a700 1 -- 172.21.15.149:0/2795993481 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f125404f730 con 0x7f12540d1130 2023-11-08T19:25:50.815 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.802+0000 7f1249ffb700 1 -- 172.21.15.149:0/2795993481 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1250021350 con 0x7f12540d1130 2023-11-08T19:25:50.815 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.802+0000 7f1249ffb700 1 --2- 172.21.15.149:0/2795993481 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f123806af00 0x7f123806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:50.815 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.803+0000 7f1259326700 1 --2- 172.21.15.149:0/2795993481 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f123806af00 0x7f123806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:50.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.803+0000 7f1249ffb700 1 -- 172.21.15.149:0/2795993481 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f1250089a60 con 0x7f12540d1130 2023-11-08T19:25:50.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.803+0000 7f1259326700 1 --2- 172.21.15.149:0/2795993481 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f123806af00 0x7f123806d3c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f1244009840 tx=0x7f1244008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:50.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.807+0000 7f1249ffb700 1 -- 172.21.15.149:0/2795993481 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1250054600 con 0x7f12540d1130 2023-11-08T19:25:50.997 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.996+0000 7f125b58a700 1 -- 172.21.15.149:0/2795993481 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1254167a00 con 0x7f12540d1130 2023-11-08T19:25:50.998 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.996+0000 7f1249ffb700 1 -- 172.21.15.149:0/2795993481 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v71) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1250057c20 con 0x7f12540d1130 2023-11-08T19:25:50.998 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 64 2023-11-08T19:25:51.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.998+0000 7f125b58a700 1 -- 172.21.15.149:0/2795993481 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f123806af00 msgr2=0x7f123806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:51.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.998+0000 7f125b58a700 1 --2- 172.21.15.149:0/2795993481 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f123806af00 0x7f123806d3c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f1244009840 tx=0x7f1244008030 comp rx=0 tx=0).stop 2023-11-08T19:25:51.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.998+0000 7f125b58a700 1 -- 172.21.15.149:0/2795993481 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f12540d1130 msgr2=0x7f12540b4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:51.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.998+0000 7f125b58a700 1 --2- 172.21.15.149:0/2795993481 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f12540d1130 0x7f12540b4bc0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f125000c750 tx=0x7f125000cb10 comp rx=0 tx=0).stop 2023-11-08T19:25:51.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.998+0000 7f125b58a700 1 -- 172.21.15.149:0/2795993481 shutdown_connections 2023-11-08T19:25:51.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.998+0000 7f125b58a700 1 --2- 172.21.15.149:0/2795993481 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f123806af00 0x7f123806d3c0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:51.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.998+0000 7f125b58a700 1 --2- 172.21.15.149:0/2795993481 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f12540cc6a0 0x7f1254150b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:51.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.998+0000 7f125b58a700 1 --2- 172.21.15.149:0/2795993481 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f125415abf0 0x7f12540ccb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:51.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.998+0000 7f125b58a700 1 --2- 172.21.15.149:0/2795993481 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f12540d1130 0x7f12540b4bc0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:51.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.998+0000 7f125b58a700 1 -- 172.21.15.149:0/2795993481 >> 172.21.15.149:0/2795993481 conn(0x7f12540d0640 msgr2=0x7f12540b0140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:51.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.999+0000 7f125b58a700 1 -- 172.21.15.149:0/2795993481 shutdown_connections 2023-11-08T19:25:51.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:50.999+0000 7f125b58a700 1 -- 172.21.15.149:0/2795993481 wait complete. 2023-11-08T19:25:51.013 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-08T19:25:51.139 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.138+0000 7f121bcb6700 1 Processor -- start 2023-11-08T19:25:51.139 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.138+0000 7f121bcb6700 1 -- start start 2023-11-08T19:25:51.142 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.139+0000 7f121bcb6700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f121415abf0 0x7f12140b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:51.142 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.139+0000 7f121bcb6700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f12140d1130 0x7f12140cc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:51.143 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.139+0000 7f121bcb6700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f12140cc6a0 0x7f12140ce210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:51.143 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.139+0000 7f121bcb6700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12140b66a0 con 0x7f121415abf0 2023-11-08T19:25:51.143 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.139+0000 7f121bcb6700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12140d04a0 con 0x7f12140cc6a0 2023-11-08T19:25:51.143 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.139+0000 7f121bcb6700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12140b6470 con 0x7f12140d1130 2023-11-08T19:25:51.144 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.139+0000 7f1219a52700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f121415abf0 0x7f12140b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:51.144 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.139+0000 7f1219a52700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f121415abf0 0x7f12140b5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41714/0 (socket says 172.21.15.149:41714) 2023-11-08T19:25:51.144 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.139+0000 7f1219a52700 1 -- 172.21.15.149:0/3169884081 learned_addr learned my addr 172.21.15.149:0/3169884081 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:51.144 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.139+0000 7f1219251700 1 --2- 172.21.15.149:0/3169884081 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f12140d1130 0x7f12140cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:51.145 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.139+0000 7f121a253700 1 --2- 172.21.15.149:0/3169884081 >> v2:172.21.15.160:3300/0 conn(0x7f12140cc6a0 0x7f12140ce210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:51.145 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.139+0000 7f1219a52700 1 -- 172.21.15.149:0/3169884081 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f12140d1130 msgr2=0x7f12140cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:51.145 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.139+0000 7f1219a52700 1 --2- 172.21.15.149:0/3169884081 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f12140d1130 0x7f12140cc160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:51.145 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.140+0000 7f1219a52700 1 -- 172.21.15.149:0/3169884081 >> v2:172.21.15.160:3300/0 conn(0x7f12140cc6a0 msgr2=0x7f12140ce210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:51.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.140+0000 7f1219a52700 1 --2- 172.21.15.149:0/3169884081 >> v2:172.21.15.160:3300/0 conn(0x7f12140cc6a0 0x7f12140ce210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:51.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.140+0000 7f1219a52700 1 -- 172.21.15.149:0/3169884081 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f121415afd0 con 0x7f121415abf0 2023-11-08T19:25:51.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.140+0000 7f1219a52700 1 --2- 172.21.15.149:0/3169884081 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f121415abf0 0x7f12140b5f30 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f1214069350 tx=0x7f1210009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeefb521bafe4768 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:51.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.140+0000 7f1218a50700 1 -- 172.21.15.149:0/3169884081 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f121000b870 con 0x7f121415abf0 2023-11-08T19:25:51.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.140+0000 7f1218a50700 1 -- 172.21.15.149:0/3169884081 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f121000b9d0 con 0x7f121415abf0 2023-11-08T19:25:51.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.140+0000 7f1218a50700 1 -- 172.21.15.149:0/3169884081 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f121000bd60 con 0x7f121415abf0 2023-11-08T19:25:51.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.141+0000 7f121bcb6700 1 -- 172.21.15.149:0/3169884081 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f121415abf0 msgr2=0x7f12140b5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:51.148 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.141+0000 7f121bcb6700 1 --2- 172.21.15.149:0/3169884081 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f121415abf0 0x7f12140b5f30 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f1214069350 tx=0x7f1210009bd0 comp rx=0 tx=0).stop 2023-11-08T19:25:51.148 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.141+0000 7f121bcb6700 1 -- 172.21.15.149:0/3169884081 shutdown_connections 2023-11-08T19:25:51.148 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.141+0000 7f121bcb6700 1 --2- 172.21.15.149:0/3169884081 >> v2:172.21.15.160:3300/0 conn(0x7f12140cc6a0 0x7f12140ce210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:51.148 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.141+0000 7f121bcb6700 1 --2- 172.21.15.149:0/3169884081 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f121415abf0 0x7f12140b5f30 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:51.148 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.141+0000 7f121bcb6700 1 --2- 172.21.15.149:0/3169884081 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f12140d1130 0x7f12140cc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:51.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.141+0000 7f121bcb6700 1 -- 172.21.15.149:0/3169884081 >> 172.21.15.149:0/3169884081 conn(0x7f12140d0640 msgr2=0x7f12140d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:51.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.141+0000 7f121bcb6700 1 -- 172.21.15.149:0/3169884081 shutdown_connections 2023-11-08T19:25:51.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.141+0000 7f121bcb6700 1 -- 172.21.15.149:0/3169884081 wait complete. 2023-11-08T19:25:51.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.142+0000 7f121bcb6700 1 Processor -- start 2023-11-08T19:25:51.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.142+0000 7f121bcb6700 1 -- start start 2023-11-08T19:25:51.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.143+0000 7f121bcb6700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f12140cc6a0 0x7f1214153630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:51.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.143+0000 7f121bcb6700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f12140d1130 0x7f12141565f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:51.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.143+0000 7f121bcb6700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f121415abf0 0x7f12140b42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:51.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.143+0000 7f121bcb6700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12140b32c0 con 0x7f12140cc6a0 2023-11-08T19:25:51.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.143+0000 7f121bcb6700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12140b3510 con 0x7f12140d1130 2023-11-08T19:25:51.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.143+0000 7f121bcb6700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12140b37f0 con 0x7f121415abf0 2023-11-08T19:25:51.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.143+0000 7f1219a52700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f12140cc6a0 0x7f1214153630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:51.154 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.143+0000 7f1219a52700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f12140cc6a0 0x7f1214153630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41720/0 (socket says 172.21.15.149:41720) 2023-11-08T19:25:51.154 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.143+0000 7f1219a52700 1 -- 172.21.15.149:0/2218894486 learned_addr learned my addr 172.21.15.149:0/2218894486 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:51.154 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.144+0000 7f1219251700 1 --2- 172.21.15.149:0/2218894486 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f12140d1130 0x7f12141565f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:51.154 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.144+0000 7f121a253700 1 --2- 172.21.15.149:0/2218894486 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f121415abf0 0x7f12140b42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:51.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.144+0000 7f1219a52700 1 -- 172.21.15.149:0/2218894486 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f121415abf0 msgr2=0x7f12140b42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:51.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.144+0000 7f1219a52700 1 --2- 172.21.15.149:0/2218894486 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f121415abf0 0x7f12140b42d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:51.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.144+0000 7f1219a52700 1 -- 172.21.15.149:0/2218894486 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f12140d1130 msgr2=0x7f12141565f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:51.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.144+0000 7f1219a52700 1 --2- 172.21.15.149:0/2218894486 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f12140d1130 0x7f12141565f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:51.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.144+0000 7f1219a52700 1 -- 172.21.15.149:0/2218894486 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1210009550 con 0x7f12140cc6a0 2023-11-08T19:25:51.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.144+0000 7f1219a52700 1 --2- 172.21.15.149:0/2218894486 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f12140cc6a0 0x7f1214153630 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f1210000c00 tx=0x7f1210004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:51.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.144+0000 7f120a7fc700 1 -- 172.21.15.149:0/2218894486 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1210004520 con 0x7f12140cc6a0 2023-11-08T19:25:51.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.144+0000 7f120a7fc700 1 -- 172.21.15.149:0/2218894486 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f121001e070 con 0x7f12140cc6a0 2023-11-08T19:25:51.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.144+0000 7f121bcb6700 1 -- 172.21.15.149:0/2218894486 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12140b3ad0 con 0x7f12140cc6a0 2023-11-08T19:25:51.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.144+0000 7f120a7fc700 1 -- 172.21.15.149:0/2218894486 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12100038c0 con 0x7f12140cc6a0 2023-11-08T19:25:51.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.144+0000 7f121bcb6700 1 -- 172.21.15.149:0/2218894486 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1214156b30 con 0x7f12140cc6a0 2023-11-08T19:25:51.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.146+0000 7f121bcb6700 1 -- 172.21.15.149:0/2218894486 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12140b3de0 con 0x7f12140cc6a0 2023-11-08T19:25:51.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.146+0000 7f120a7fc700 1 -- 172.21.15.149:0/2218894486 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1210003a20 con 0x7f12140cc6a0 2023-11-08T19:25:51.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.146+0000 7f120a7fc700 1 --2- 172.21.15.149:0/2218894486 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f11f806af00 0x7f11f806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:51.158 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.146+0000 7f120a7fc700 1 -- 172.21.15.149:0/2218894486 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f1210020070 con 0x7f12140cc6a0 2023-11-08T19:25:51.158 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.146+0000 7f1219251700 1 --2- 172.21.15.149:0/2218894486 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f11f806af00 0x7f11f806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:51.158 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.146+0000 7f1219251700 1 --2- 172.21.15.149:0/2218894486 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f11f806af00 0x7f11f806d3c0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f12141535e0 tx=0x7f1204008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:51.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.151+0000 7f120a7fc700 1 -- 172.21.15.149:0/2218894486 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1210055ca0 con 0x7f12140cc6a0 2023-11-08T19:25:51.344 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.343+0000 7f121bcb6700 1 -- 172.21.15.149:0/2218894486 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7f121415e800 con 0x7f12140cc6a0 2023-11-08T19:25:51.344 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.343+0000 7f120a7fc700 1 -- 172.21.15.149:0/2218894486 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v71) v1 ==== 103+0+11 (secure 0 0 0) 0x7f12100150a0 con 0x7f12140cc6a0 2023-11-08T19:25:51.345 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:25:51.347 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.345+0000 7f121bcb6700 1 -- 172.21.15.149:0/2218894486 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f11f806af00 msgr2=0x7f11f806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:51.347 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.345+0000 7f121bcb6700 1 --2- 172.21.15.149:0/2218894486 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f11f806af00 0x7f11f806d3c0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f12141535e0 tx=0x7f1204008040 comp rx=0 tx=0).stop 2023-11-08T19:25:51.347 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.345+0000 7f121bcb6700 1 -- 172.21.15.149:0/2218894486 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f12140cc6a0 msgr2=0x7f1214153630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:51.347 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.345+0000 7f121bcb6700 1 --2- 172.21.15.149:0/2218894486 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f12140cc6a0 0x7f1214153630 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f1210000c00 tx=0x7f1210004750 comp rx=0 tx=0).stop 2023-11-08T19:25:51.348 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.345+0000 7f121bcb6700 1 -- 172.21.15.149:0/2218894486 shutdown_connections 2023-11-08T19:25:51.348 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.345+0000 7f121bcb6700 1 --2- 172.21.15.149:0/2218894486 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f11f806af00 0x7f11f806d3c0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:51.348 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.345+0000 7f121bcb6700 1 --2- 172.21.15.149:0/2218894486 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f121415abf0 0x7f12140b42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:51.348 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.345+0000 7f121bcb6700 1 --2- 172.21.15.149:0/2218894486 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f12140cc6a0 0x7f1214153630 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:51.348 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.345+0000 7f121bcb6700 1 --2- 172.21.15.149:0/2218894486 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f12140d1130 0x7f12141565f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:51.349 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.345+0000 7f121bcb6700 1 -- 172.21.15.149:0/2218894486 >> 172.21.15.149:0/2218894486 conn(0x7f12140d0640 msgr2=0x7f1214154900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:51.349 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.346+0000 7f121bcb6700 1 -- 172.21.15.149:0/2218894486 shutdown_connections 2023-11-08T19:25:51.349 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.346+0000 7f121bcb6700 1 -- 172.21.15.149:0/2218894486 wait complete. 2023-11-08T19:25:51.359 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-08T19:25:51.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.482+0000 7f20a5314700 1 Processor -- start 2023-11-08T19:25:51.484 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.482+0000 7f20a5314700 1 -- start start 2023-11-08T19:25:51.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.483+0000 7f20a5314700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f20a006d700 0x7f20a00b3210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:51.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.483+0000 7f20a5314700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20a0162560 con 0x7f20a00cfd50 2023-11-08T19:25:51.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.483+0000 7f20a5314700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20a01619e0 con 0x7f20a00b3750 2023-11-08T19:25:51.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.483+0000 7f20a5314700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20a00b3be0 con 0x7f20a006d700 2023-11-08T19:25:51.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.483+0000 7f209effd700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f20a00cfd50 0x7f20a006bea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:43730/0 (socket says 172.21.15.149:43730) 2023-11-08T19:25:51.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.483+0000 7f209effd700 1 -- 172.21.15.149:0/3769343173 learned_addr learned my addr 172.21.15.149:0/3769343173 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:25:51.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.483+0000 7f209e7fc700 1 --2- 172.21.15.149:0/3769343173 >> v2:172.21.15.160:3300/0 conn(0x7f20a006d700 0x7f20a00b3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:51.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.483+0000 7f209dffb700 1 -- 172.21.15.149:0/3769343173 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 382257096 0 0) 0x7f20a0162560 con 0x7f20a00cfd50 2023-11-08T19:25:51.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.483+0000 7f209dffb700 1 -- 172.21.15.149:0/3769343173 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20880035b0 con 0x7f20a00cfd50 2023-11-08T19:25:51.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.484+0000 7f209dffb700 1 -- 172.21.15.149:0/3769343173 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2867530020 0 0) 0x7f20880035b0 con 0x7f20a00cfd50 2023-11-08T19:25:51.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.484+0000 7f209dffb700 1 -- 172.21.15.149:0/3769343173 >> v2:172.21.15.160:3300/0 conn(0x7f20a006d700 msgr2=0x7f20a00b3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:51.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.484+0000 7f209dffb700 1 --2- 172.21.15.149:0/3769343173 >> v2:172.21.15.160:3300/0 conn(0x7f20a006d700 0x7f20a00b3210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:51.490 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.484+0000 7f209dffb700 1 -- 172.21.15.149:0/3769343173 >> v1:172.21.15.160:6789/0 conn(0x7f20a00b3750 legacy=0x7f20a015d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:51.490 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.484+0000 7f209dffb700 1 -- 172.21.15.149:0/3769343173 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a0161cc0 con 0x7f20a00cfd50 2023-11-08T19:25:51.490 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.484+0000 7f209dffb700 1 -- 172.21.15.149:0/3769343173 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f2094001670 con 0x7f20a00cfd50 2023-11-08T19:25:51.490 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.484+0000 7f209dffb700 1 -- 172.21.15.149:0/3769343173 >> v1:172.21.15.149:6789/0 conn(0x7f20a00cfd50 legacy=0x7f20a006bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:51.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.484+0000 7f209dffb700 1 --2- 172.21.15.149:0/3769343173 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2088003a70 0x7f2088003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:51.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.484+0000 7f209dffb700 1 --2- 172.21.15.149:0/3769343173 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2088004850 0x7f2088004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:51.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.484+0000 7f209dffb700 1 --2- 172.21.15.149:0/3769343173 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2088005280 0x7f208800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:51.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.484+0000 7f209dffb700 1 -- 172.21.15.149:0/3769343173 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a00b3be0 con 0x7f2088004850 2023-11-08T19:25:51.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.484+0000 7f209dffb700 1 -- 172.21.15.149:0/3769343173 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f208800c1e0 con 0x7f2088003a70 2023-11-08T19:25:51.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.484+0000 7f209dffb700 1 -- 172.21.15.149:0/3769343173 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f208800c3a0 con 0x7f2088005280 2023-11-08T19:25:51.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.484+0000 7f209e7fc700 1 --2- 172.21.15.149:0/3769343173 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2088004850 0x7f2088004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:51.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.484+0000 7f209effd700 1 --2- 172.21.15.149:0/3769343173 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2088003a70 0x7f2088003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:51.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.484+0000 7f209f7fe700 1 --2- 172.21.15.149:0/3769343173 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2088005280 0x7f208800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:51.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.484+0000 7f209e7fc700 1 -- 172.21.15.149:0/3769343173 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2088005280 msgr2=0x7f208800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:51.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.484+0000 7f209e7fc700 1 --2- 172.21.15.149:0/3769343173 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2088005280 0x7f208800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:51.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.484+0000 7f209e7fc700 1 -- 172.21.15.149:0/3769343173 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2088003a70 msgr2=0x7f2088003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:51.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.484+0000 7f209e7fc700 1 --2- 172.21.15.149:0/3769343173 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2088003a70 0x7f2088003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:51.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.484+0000 7f209f7fe700 1 -- 172.21.15.149:0/3769343173 reap_dead start 2023-11-08T19:25:51.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.484+0000 7f209e7fc700 1 -- 172.21.15.149:0/3769343173 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20880035b0 con 0x7f2088004850 2023-11-08T19:25:51.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.484+0000 7f209e7fc700 1 --2- 172.21.15.149:0/3769343173 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2088004850 0x7f2088004cd0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f2090009b60 tx=0x7f2088005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbecca2d3deb2bbb server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:51.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.484+0000 7f209dffb700 1 -- 172.21.15.149:0/3769343173 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f209000e6c0 con 0x7f2088004850 2023-11-08T19:25:51.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.484+0000 7f209dffb700 1 -- 172.21.15.149:0/3769343173 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f209000e820 con 0x7f2088004850 2023-11-08T19:25:51.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.484+0000 7f209dffb700 1 -- 172.21.15.149:0/3769343173 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f209000eb90 con 0x7f2088004850 2023-11-08T19:25:51.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.485+0000 7f20a5314700 1 -- 172.21.15.149:0/3769343173 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2088004850 msgr2=0x7f2088004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:51.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.485+0000 7f20a5314700 1 --2- 172.21.15.149:0/3769343173 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2088004850 0x7f2088004cd0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f2090009b60 tx=0x7f2088005880 comp rx=0 tx=0).stop 2023-11-08T19:25:51.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.485+0000 7f20a5314700 1 -- 172.21.15.149:0/3769343173 shutdown_connections 2023-11-08T19:25:51.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.485+0000 7f20a5314700 1 --2- 172.21.15.149:0/3769343173 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2088004850 0x7f2088004cd0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:51.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.485+0000 7f20a5314700 1 -- 172.21.15.149:0/3769343173 >> 172.21.15.149:0/3769343173 conn(0x7f20a00ce210 msgr2=0x7f20a00ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:51.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.485+0000 7f20a5314700 1 -- 172.21.15.149:0/3769343173 shutdown_connections 2023-11-08T19:25:51.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.485+0000 7f20a5314700 1 -- 172.21.15.149:0/3769343173 wait complete. 2023-11-08T19:25:51.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.487+0000 7f20a5314700 1 Processor -- start 2023-11-08T19:25:51.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.487+0000 7f20a5314700 1 -- start start 2023-11-08T19:25:51.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.488+0000 7f20a5314700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2088004850 0x7f20a015bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:51.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.488+0000 7f20a5314700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20a015e570 0x7f20a015e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:51.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.488+0000 7f20a5314700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f20a00ca870 0x7f20a00cacf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:51.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.488+0000 7f20a5314700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a00cb230 con 0x7f20a015e570 2023-11-08T19:25:51.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.488+0000 7f20a5314700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a01e7c60 con 0x7f2088004850 2023-11-08T19:25:51.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.488+0000 7f20a5314700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20a015c280 con 0x7f20a00ca870 2023-11-08T19:25:51.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.488+0000 7f209e7fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20a015e570 0x7f20a015e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:51.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.488+0000 7f209e7fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20a015e570 0x7f20a015e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41742/0 (socket says 172.21.15.149:41742) 2023-11-08T19:25:51.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.488+0000 7f209e7fc700 1 -- 172.21.15.149:0/401801118 learned_addr learned my addr 172.21.15.149:0/401801118 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:51.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.488+0000 7f209effd700 1 --2- 172.21.15.149:0/401801118 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2088004850 0x7f20a015bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:51.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.488+0000 7f209f7fe700 1 --2- 172.21.15.149:0/401801118 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f20a00ca870 0x7f20a00cacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:51.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.488+0000 7f209e7fc700 1 -- 172.21.15.149:0/401801118 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f20a00ca870 msgr2=0x7f20a00cacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:51.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.488+0000 7f209e7fc700 1 --2- 172.21.15.149:0/401801118 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f20a00ca870 0x7f20a00cacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:51.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.488+0000 7f209e7fc700 1 -- 172.21.15.149:0/401801118 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2088004850 msgr2=0x7f20a015bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:51.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.488+0000 7f209e7fc700 1 --2- 172.21.15.149:0/401801118 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2088004850 0x7f20a015bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:51.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.488+0000 7f209e7fc700 1 -- 172.21.15.149:0/401801118 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a015f030 con 0x7f20a015e570 2023-11-08T19:25:51.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.488+0000 7f209effd700 1 --2- 172.21.15.149:0/401801118 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2088004850 0x7f20a015bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:25:51.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.488+0000 7f209f7fe700 1 --2- 172.21.15.149:0/401801118 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f20a00ca870 0x7f20a00cacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:25:51.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.488+0000 7f209e7fc700 1 --2- 172.21.15.149:0/401801118 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20a015e570 0x7f20a015e9f0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f208800c1b0 tx=0x7f20900047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:51.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.488+0000 7f20877fe700 1 -- 172.21.15.149:0/401801118 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f209000e6c0 con 0x7f20a015e570 2023-11-08T19:25:51.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.488+0000 7f20877fe700 1 -- 172.21.15.149:0/401801118 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2090003ad0 con 0x7f20a015e570 2023-11-08T19:25:51.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.488+0000 7f20a5314700 1 -- 172.21.15.149:0/401801118 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20a015f310 con 0x7f20a015e570 2023-11-08T19:25:51.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.489+0000 7f20877fe700 1 -- 172.21.15.149:0/401801118 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2090003e80 con 0x7f20a015e570 2023-11-08T19:25:51.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.489+0000 7f20a5314700 1 -- 172.21.15.149:0/401801118 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20a015f8d0 con 0x7f20a015e570 2023-11-08T19:25:51.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.489+0000 7f20a5314700 1 -- 172.21.15.149:0/401801118 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20a01e8b80 con 0x7f20a015e570 2023-11-08T19:25:51.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.490+0000 7f20877fe700 1 -- 172.21.15.149:0/401801118 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2090013470 con 0x7f20a015e570 2023-11-08T19:25:51.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.490+0000 7f20877fe700 1 --2- 172.21.15.149:0/401801118 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f208c06af00 0x7f208c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:51.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.490+0000 7f20877fe700 1 -- 172.21.15.149:0/401801118 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f209008b3f0 con 0x7f20a015e570 2023-11-08T19:25:51.509 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.490+0000 7f209effd700 1 --2- 172.21.15.149:0/401801118 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f208c06af00 0x7f208c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:51.509 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.491+0000 7f209effd700 1 --2- 172.21.15.149:0/401801118 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f208c06af00 0x7f208c06d3c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f20a0069830 tx=0x7f2094009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:51.509 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.495+0000 7f20877fe700 1 -- 172.21.15.149:0/401801118 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2090055f90 con 0x7f20a015e570 2023-11-08T19:25:51.686 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.685+0000 7f20a5314700 1 -- 172.21.15.149:0/401801118 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7f20a004f730 con 0x7f20a015e570 2023-11-08T19:25:51.686 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.685+0000 7f20877fe700 1 -- 172.21.15.149:0/401801118 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v71) v1 ==== 107+0+11 (secure 0 0 0) 0x7f20900595b0 con 0x7f20a015e570 2023-11-08T19:25:51.686 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:25:51.688 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.687+0000 7f20a5314700 1 -- 172.21.15.149:0/401801118 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f208c06af00 msgr2=0x7f208c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:51.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.687+0000 7f20a5314700 1 --2- 172.21.15.149:0/401801118 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f208c06af00 0x7f208c06d3c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f20a0069830 tx=0x7f2094009040 comp rx=0 tx=0).stop 2023-11-08T19:25:51.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.687+0000 7f20a5314700 1 -- 172.21.15.149:0/401801118 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20a015e570 msgr2=0x7f20a015e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:51.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.687+0000 7f20a5314700 1 --2- 172.21.15.149:0/401801118 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20a015e570 0x7f20a015e9f0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f208800c1b0 tx=0x7f20900047c0 comp rx=0 tx=0).stop 2023-11-08T19:25:51.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.687+0000 7f20a5314700 1 -- 172.21.15.149:0/401801118 shutdown_connections 2023-11-08T19:25:51.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.687+0000 7f20a5314700 1 --2- 172.21.15.149:0/401801118 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f208c06af00 0x7f208c06d3c0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:51.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.687+0000 7f20a5314700 1 --2- 172.21.15.149:0/401801118 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2088004850 0x7f20a015bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:51.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.687+0000 7f20a5314700 1 --2- 172.21.15.149:0/401801118 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f20a00ca870 0x7f20a00cacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:51.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.687+0000 7f20a5314700 1 --2- 172.21.15.149:0/401801118 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20a015e570 0x7f20a015e9f0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:51.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.687+0000 7f20a5314700 1 -- 172.21.15.149:0/401801118 >> 172.21.15.149:0/401801118 conn(0x7f20a00ce210 msgr2=0x7f20a006c140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:51.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.687+0000 7f20a5314700 1 -- 172.21.15.149:0/401801118 shutdown_connections 2023-11-08T19:25:51.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.687+0000 7f20a5314700 1 -- 172.21.15.149:0/401801118 wait complete. 2023-11-08T19:25:51.701 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-08T19:25:51.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.822+0000 7fea9b8ee700 1 Processor -- start 2023-11-08T19:25:51.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.822+0000 7fea9b8ee700 1 -- start start 2023-11-08T19:25:51.826 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.823+0000 7fea9b8ee700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fea940cd5e0 0x7fea940cfd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:51.826 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.823+0000 7fea9b8ee700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fea940ce840 0x7fea940d0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:51.826 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.823+0000 7fea9b8ee700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea940d07a0 con 0x7fea9415b950 2023-11-08T19:25:51.827 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.823+0000 7fea9b8ee700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea940cc2e0 con 0x7fea940ce840 2023-11-08T19:25:51.827 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.823+0000 7fea9b8ee700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea940cc580 con 0x7fea940cd5e0 2023-11-08T19:25:51.827 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.823+0000 7fea9968a700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fea9415b950 0x7fea940ce130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:43750/0 (socket says 172.21.15.149:43750) 2023-11-08T19:25:51.827 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.823+0000 7fea9968a700 1 -- 172.21.15.149:0/184419115 learned_addr learned my addr 172.21.15.149:0/184419115 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:25:51.827 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.823+0000 7fea98e89700 1 --2- 172.21.15.149:0/184419115 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fea940cd5e0 0x7fea940cfd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:51.828 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.823+0000 7fea99e8b700 1 --2- 172.21.15.149:0/184419115 >> v2:172.21.15.160:3300/0 conn(0x7fea940ce840 0x7fea940d0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:51.828 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.823+0000 7fea8bfff700 1 -- 172.21.15.149:0/184419115 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 535147636 0 0) 0x7fea940d07a0 con 0x7fea9415b950 2023-11-08T19:25:51.828 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.823+0000 7fea8bfff700 1 -- 172.21.15.149:0/184419115 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea800035b0 con 0x7fea9415b950 2023-11-08T19:25:51.828 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.823+0000 7fea98e89700 1 -- 172.21.15.149:0/184419115 >> v2:172.21.15.160:3300/0 conn(0x7fea940ce840 msgr2=0x7fea940d0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:51.828 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.823+0000 7fea98e89700 1 --2- 172.21.15.149:0/184419115 >> v2:172.21.15.160:3300/0 conn(0x7fea940ce840 0x7fea940d0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:51.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.823+0000 7fea98e89700 1 -- 172.21.15.149:0/184419115 >> v1:172.21.15.149:6789/0 conn(0x7fea9415b950 legacy=0x7fea940ce130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:51.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.823+0000 7fea98e89700 1 -- 172.21.15.149:0/184419115 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea940cc820 con 0x7fea940cd5e0 2023-11-08T19:25:51.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.824+0000 7fea98e89700 1 --2- 172.21.15.149:0/184419115 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fea940cd5e0 0x7fea940cfd20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fea90009840 tx=0x7fea90009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f608eb0e2ee02c33 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:51.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.824+0000 7fea8bfff700 1 -- 172.21.15.149:0/184419115 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea90011830 con 0x7fea940cd5e0 2023-11-08T19:25:51.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.824+0000 7fea8bfff700 1 -- 172.21.15.149:0/184419115 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea90011990 con 0x7fea940cd5e0 2023-11-08T19:25:51.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.824+0000 7fea8bfff700 1 -- 172.21.15.149:0/184419115 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea90011d20 con 0x7fea940cd5e0 2023-11-08T19:25:51.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.824+0000 7fea9b8ee700 1 -- 172.21.15.149:0/184419115 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fea940cd5e0 msgr2=0x7fea940cfd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:51.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.824+0000 7fea9b8ee700 1 --2- 172.21.15.149:0/184419115 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fea940cd5e0 0x7fea940cfd20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fea90009840 tx=0x7fea90009b50 comp rx=0 tx=0).stop 2023-11-08T19:25:51.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.824+0000 7fea9b8ee700 1 -- 172.21.15.149:0/184419115 shutdown_connections 2023-11-08T19:25:51.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.824+0000 7fea9b8ee700 1 --2- 172.21.15.149:0/184419115 >> v2:172.21.15.160:3300/0 conn(0x7fea940ce840 0x7fea940d0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:51.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.824+0000 7fea9b8ee700 1 --2- 172.21.15.149:0/184419115 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fea940cd5e0 0x7fea940cfd20 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:51.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.824+0000 7fea9b8ee700 1 -- 172.21.15.149:0/184419115 >> 172.21.15.149:0/184419115 conn(0x7fea9408afd0 msgr2=0x7fea940d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:51.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.824+0000 7fea9b8ee700 1 -- 172.21.15.149:0/184419115 shutdown_connections 2023-11-08T19:25:51.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.824+0000 7fea9b8ee700 1 -- 172.21.15.149:0/184419115 wait complete. 2023-11-08T19:25:51.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.825+0000 7fea9b8ee700 1 Processor -- start 2023-11-08T19:25:51.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.826+0000 7fea9b8ee700 1 -- start start 2023-11-08T19:25:51.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.826+0000 7fea9b8ee700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea940ce840 0x7fea940b4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:51.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.826+0000 7fea9b8ee700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fea9415b950 0x7fea941f10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:51.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.826+0000 7fea9b8ee700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fea940b6170 0x7fea941f1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:51.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.826+0000 7fea9b8ee700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea940b7280 con 0x7fea940ce840 2023-11-08T19:25:51.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.826+0000 7fea9b8ee700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea940b4c60 con 0x7fea940b6170 2023-11-08T19:25:51.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.826+0000 7fea9b8ee700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea940b4f40 con 0x7fea9415b950 2023-11-08T19:25:51.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.826+0000 7fea9968a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea940ce840 0x7fea940b4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:51.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.826+0000 7fea9968a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea940ce840 0x7fea940b4360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41754/0 (socket says 172.21.15.149:41754) 2023-11-08T19:25:51.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.826+0000 7fea9968a700 1 -- 172.21.15.149:0/2212920212 learned_addr learned my addr 172.21.15.149:0/2212920212 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:51.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.827+0000 7fea99e8b700 1 --2- 172.21.15.149:0/2212920212 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fea940b6170 0x7fea941f1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:51.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.827+0000 7fea98e89700 1 --2- 172.21.15.149:0/2212920212 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fea9415b950 0x7fea941f10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:51.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.827+0000 7fea9968a700 1 -- 172.21.15.149:0/2212920212 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fea9415b950 msgr2=0x7fea941f10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:51.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.827+0000 7fea9968a700 1 --2- 172.21.15.149:0/2212920212 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fea9415b950 0x7fea941f10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:51.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.827+0000 7fea9968a700 1 -- 172.21.15.149:0/2212920212 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fea940b6170 msgr2=0x7fea941f1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:51.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.827+0000 7fea9968a700 1 --2- 172.21.15.149:0/2212920212 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fea940b6170 0x7fea941f1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:51.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.827+0000 7fea9968a700 1 -- 172.21.15.149:0/2212920212 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea900094a0 con 0x7fea940ce840 2023-11-08T19:25:51.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.827+0000 7fea9968a700 1 --2- 172.21.15.149:0/2212920212 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea940ce840 0x7fea940b4360 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fea84001260 tx=0x7fea8400c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:51.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.827+0000 7fea89ffb700 1 -- 172.21.15.149:0/2212920212 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea840074e0 con 0x7fea940ce840 2023-11-08T19:25:51.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.827+0000 7fea89ffb700 1 -- 172.21.15.149:0/2212920212 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea84007640 con 0x7fea940ce840 2023-11-08T19:25:51.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.827+0000 7fea9b8ee700 1 -- 172.21.15.149:0/2212920212 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea940b5220 con 0x7fea940ce840 2023-11-08T19:25:51.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.827+0000 7fea89ffb700 1 -- 172.21.15.149:0/2212920212 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea84005a50 con 0x7fea940ce840 2023-11-08T19:25:51.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.827+0000 7fea9b8ee700 1 -- 172.21.15.149:0/2212920212 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea940b48a0 con 0x7fea940ce840 2023-11-08T19:25:51.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.828+0000 7fea9b8ee700 1 -- 172.21.15.149:0/2212920212 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea940b4a30 con 0x7fea940ce840 2023-11-08T19:25:51.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.829+0000 7fea89ffb700 1 -- 172.21.15.149:0/2212920212 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fea84005bb0 con 0x7fea940ce840 2023-11-08T19:25:51.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.829+0000 7fea89ffb700 1 --2- 172.21.15.149:0/2212920212 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fea7806af00 0x7fea7806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:51.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.829+0000 7fea89ffb700 1 -- 172.21.15.149:0/2212920212 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7148+0+0 (secure 0 0 0) 0x7fea84088e50 con 0x7fea940ce840 2023-11-08T19:25:51.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.829+0000 7fea98e89700 1 --2- 172.21.15.149:0/2212920212 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fea7806af00 0x7fea7806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:51.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.830+0000 7fea98e89700 1 --2- 172.21.15.149:0/2212920212 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fea7806af00 0x7fea7806d3c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fea94160590 tx=0x7fea90008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:51.842 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:51.834+0000 7fea89ffb700 1 -- 172.21.15.149:0/2212920212 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fea840539f0 con 0x7fea940ce840 2023-11-08T19:25:52.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.040+0000 7fea9b8ee700 1 -- 172.21.15.149:0/2212920212 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fea940745f0 con 0x7fea940ce840 2023-11-08T19:25:52.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.040+0000 7fea89ffb700 1 -- 172.21.15.149:0/2212920212 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v71) v1 ==== 80+0+0 (secure 0 0 0) 0x7fea84017020 con 0x7fea940ce840 2023-11-08T19:25:52.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.042+0000 7fea9b8ee700 1 -- 172.21.15.149:0/2212920212 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fea7806af00 msgr2=0x7fea7806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:52.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.042+0000 7fea9b8ee700 1 --2- 172.21.15.149:0/2212920212 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fea7806af00 0x7fea7806d3c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fea94160590 tx=0x7fea90008030 comp rx=0 tx=0).stop 2023-11-08T19:25:52.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.042+0000 7fea9b8ee700 1 -- 172.21.15.149:0/2212920212 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea940ce840 msgr2=0x7fea940b4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:52.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.042+0000 7fea9b8ee700 1 --2- 172.21.15.149:0/2212920212 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea940ce840 0x7fea940b4360 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fea84001260 tx=0x7fea8400c7b0 comp rx=0 tx=0).stop 2023-11-08T19:25:52.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.042+0000 7fea9b8ee700 1 -- 172.21.15.149:0/2212920212 shutdown_connections 2023-11-08T19:25:52.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.042+0000 7fea9b8ee700 1 --2- 172.21.15.149:0/2212920212 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fea7806af00 0x7fea7806d3c0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:52.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.042+0000 7fea9b8ee700 1 --2- 172.21.15.149:0/2212920212 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fea940b6170 0x7fea941f1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:52.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.042+0000 7fea9b8ee700 1 --2- 172.21.15.149:0/2212920212 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea940ce840 0x7fea940b4360 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:52.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.042+0000 7fea9b8ee700 1 --2- 172.21.15.149:0/2212920212 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fea9415b950 0x7fea941f10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:52.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.042+0000 7fea9b8ee700 1 -- 172.21.15.149:0/2212920212 >> 172.21.15.149:0/2212920212 conn(0x7fea9408afd0 msgr2=0x7fea940cd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:52.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.042+0000 7fea9b8ee700 1 -- 172.21.15.149:0/2212920212 shutdown_connections 2023-11-08T19:25:52.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.042+0000 7fea9b8ee700 1 -- 172.21.15.149:0/2212920212 wait complete. 2023-11-08T19:25:52.046 INFO:teuthology.orchestra.run.smithi149.stderr:listed 0 entries 2023-11-08T19:25:52.055 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-08T19:25:52.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:25:52.056 DEBUG:teuthology.orchestra.run.smithi149:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-08T19:25:52.096 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi149.front.sepia.ceph.com 2023-11-08T19:25:52.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:25:52.096 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-08T19:25:52.153 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-11-08T19:25:52.153 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:25:52.175 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284272k,nr_inodes=4071068,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16330 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-08T19:25:52.175 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-11-08T19:25:52.176 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:25:52.210 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=8026740k,nr_inodes=2006685,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=31,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15303 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1609048k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-11-08T19:25:52.211 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-11-08T19:25:52.211 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:25:52.236 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284272k,nr_inodes=4071068,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16330 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-08T19:25:52.236 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:25:52.371 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.370+0000 7f5d3d0da700 1 Processor -- start 2023-11-08T19:25:52.371 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.370+0000 7f5d3d0da700 1 -- start start 2023-11-08T19:25:52.373 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.370+0000 7f5d3d0da700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f5d380b27c0 0x7f5d380ce380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:52.374 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.370+0000 7f5d3d0da700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d380d1330 con 0x7f5d380afb30 2023-11-08T19:25:52.374 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.370+0000 7f5d3d0da700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d380cb490 con 0x7f5d380b16b0 2023-11-08T19:25:52.374 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.370+0000 7f5d3d0da700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d380cb770 con 0x7f5d380b27c0 2023-11-08T19:25:52.374 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.371+0000 7f5d3759e700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f5d380b27c0 0x7f5d380ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:52.375 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.371+0000 7f5d3759e700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f5d380b27c0 0x7f5d380ce380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41766/0 (socket says 172.21.15.149:41766) 2023-11-08T19:25:52.375 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.371+0000 7f5d3759e700 1 -- 172.21.15.149:0/3981023728 learned_addr learned my addr 172.21.15.149:0/3981023728 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:52.375 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.371+0000 7f5d36d9d700 1 --1- 172.21.15.149:0/3981023728 >> v1:172.21.15.149:6789/0 conn(0x7f5d380afb30 0x7f5d380cbf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:43764/0 (socket says 172.21.15.149:43764) 2023-11-08T19:25:52.375 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.371+0000 7f5d3759e700 1 -- 172.21.15.149:0/3981023728 >> v1:172.21.15.160:6789/0 conn(0x7f5d380b16b0 legacy=0x7f5d380b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:52.376 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.371+0000 7f5d3759e700 1 -- 172.21.15.149:0/3981023728 >> v1:172.21.15.149:6789/0 conn(0x7f5d380afb30 legacy=0x7f5d380cbf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:52.376 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.371+0000 7f5d3759e700 1 -- 172.21.15.149:0/3981023728 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d380cba50 con 0x7f5d380b27c0 2023-11-08T19:25:52.376 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.371+0000 7f5d35d9b700 1 -- 172.21.15.149:0/3981023728 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3870976157 0 0) 0x7f5d380d1330 con 0x7f5d380afb30 2023-11-08T19:25:52.376 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.371+0000 7f5d3759e700 1 --2- 172.21.15.149:0/3981023728 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d380b27c0 0x7f5d380ce380 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f5d3000d150 tx=0x7f5d3000d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c716e186c2086115 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:52.376 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.371+0000 7f5d35d9b700 1 -- 172.21.15.149:0/3981023728 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d30010070 con 0x7f5d380b27c0 2023-11-08T19:25:52.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.371+0000 7f5d35d9b700 1 -- 172.21.15.149:0/3981023728 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d3000dd80 con 0x7f5d380b27c0 2023-11-08T19:25:52.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.371+0000 7f5d35d9b700 1 -- 172.21.15.149:0/3981023728 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3000b310 con 0x7f5d380b27c0 2023-11-08T19:25:52.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.372+0000 7f5d3d0da700 1 -- 172.21.15.149:0/3981023728 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d380b27c0 msgr2=0x7f5d380ce380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:52.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.372+0000 7f5d3d0da700 1 --2- 172.21.15.149:0/3981023728 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d380b27c0 0x7f5d380ce380 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f5d3000d150 tx=0x7f5d3000d460 comp rx=0 tx=0).stop 2023-11-08T19:25:52.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.372+0000 7f5d3d0da700 1 -- 172.21.15.149:0/3981023728 shutdown_connections 2023-11-08T19:25:52.378 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.372+0000 7f5d3d0da700 1 --2- 172.21.15.149:0/3981023728 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d380b27c0 0x7f5d380ce380 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:52.378 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.372+0000 7f5d3d0da700 1 -- 172.21.15.149:0/3981023728 >> 172.21.15.149:0/3981023728 conn(0x7f5d38099a40 msgr2=0x7f5d380d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:52.378 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.372+0000 7f5d3d0da700 1 -- 172.21.15.149:0/3981023728 shutdown_connections 2023-11-08T19:25:52.378 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.372+0000 7f5d3d0da700 1 -- 172.21.15.149:0/3981023728 wait complete. 2023-11-08T19:25:52.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.373+0000 7f5d3d0da700 1 Processor -- start 2023-11-08T19:25:52.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.373+0000 7f5d3d0da700 1 -- start start 2023-11-08T19:25:52.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.374+0000 7f5d3d0da700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d380afb30 0x7f5d380ca160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:52.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.374+0000 7f5d3d0da700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5d380b16b0 0x7f5d380c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:52.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.374+0000 7f5d3d0da700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d380b27c0 0x7f5d381e33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:52.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.374+0000 7f5d3d0da700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d380c86b0 con 0x7f5d380b27c0 2023-11-08T19:25:52.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.374+0000 7f5d3d0da700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d380c8080 con 0x7f5d380afb30 2023-11-08T19:25:52.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.374+0000 7f5d3d0da700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d380c9b60 con 0x7f5d380b16b0 2023-11-08T19:25:52.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.374+0000 7f5d3759e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d380b27c0 0x7f5d381e33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:52.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.374+0000 7f5d3759e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d380b27c0 0x7f5d381e33d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41772/0 (socket says 172.21.15.149:41772) 2023-11-08T19:25:52.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.374+0000 7f5d3759e700 1 -- 172.21.15.149:0/703155919 learned_addr learned my addr 172.21.15.149:0/703155919 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:52.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.374+0000 7f5d36d9d700 1 --2- 172.21.15.149:0/703155919 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d380afb30 0x7f5d380ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:52.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.374+0000 7f5d3659c700 1 --2- 172.21.15.149:0/703155919 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5d380b16b0 0x7f5d380c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:52.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.374+0000 7f5d3759e700 1 -- 172.21.15.149:0/703155919 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5d380b16b0 msgr2=0x7f5d380c8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:52.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.374+0000 7f5d3759e700 1 --2- 172.21.15.149:0/703155919 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5d380b16b0 0x7f5d380c8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:52.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.374+0000 7f5d3759e700 1 -- 172.21.15.149:0/703155919 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d380afb30 msgr2=0x7f5d380ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:52.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.374+0000 7f5d3759e700 1 --2- 172.21.15.149:0/703155919 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d380afb30 0x7f5d380ca160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:52.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.374+0000 7f5d3759e700 1 -- 172.21.15.149:0/703155919 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d3000bd40 con 0x7f5d380b27c0 2023-11-08T19:25:52.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.375+0000 7f5d3759e700 1 --2- 172.21.15.149:0/703155919 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d380b27c0 0x7f5d381e33d0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f5d30017040 tx=0x7f5d30004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:52.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.375+0000 7f5d1f7fe700 1 -- 172.21.15.149:0/703155919 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3000aaa0 con 0x7f5d380b27c0 2023-11-08T19:25:52.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.375+0000 7f5d1f7fe700 1 -- 172.21.15.149:0/703155919 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d3000ac00 con 0x7f5d380b27c0 2023-11-08T19:25:52.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.375+0000 7f5d1f7fe700 1 -- 172.21.15.149:0/703155919 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d30004030 con 0x7f5d380b27c0 2023-11-08T19:25:52.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.375+0000 7f5d3d0da700 1 -- 172.21.15.149:0/703155919 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d380c9e40 con 0x7f5d380b27c0 2023-11-08T19:25:52.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.375+0000 7f5d3d0da700 1 -- 172.21.15.149:0/703155919 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d380c97f0 con 0x7f5d380b27c0 2023-11-08T19:25:52.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.376+0000 7f5d3d0da700 1 -- 172.21.15.149:0/703155919 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d380745f0 con 0x7f5d380b27c0 2023-11-08T19:25:52.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.376+0000 7f5d1f7fe700 1 -- 172.21.15.149:0/703155919 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5d3001b050 con 0x7f5d380b27c0 2023-11-08T19:25:52.387 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.377+0000 7f5d1f7fe700 1 --2- 172.21.15.149:0/703155919 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5d2406af00 0x7f5d2406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:52.387 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.377+0000 7f5d1f7fe700 1 -- 172.21.15.149:0/703155919 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f5d3008d130 con 0x7f5d380b27c0 2023-11-08T19:25:52.387 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.377+0000 7f5d36d9d700 1 --2- 172.21.15.149:0/703155919 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5d2406af00 0x7f5d2406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:52.387 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.377+0000 7f5d36d9d700 1 --2- 172.21.15.149:0/703155919 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5d2406af00 0x7f5d2406d3c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f5d28001020 tx=0x7f5d28009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:52.388 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.382+0000 7f5d1f7fe700 1 -- 172.21.15.149:0/703155919 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5d3005b760 con 0x7f5d380b27c0 2023-11-08T19:25:52.615 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.614+0000 7f5d3d0da700 1 -- 172.21.15.149:0/703155919 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5d380c87f0 con 0x7f5d380b27c0 2023-11-08T19:25:52.616 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.615+0000 7f5d1f7fe700 1 -- 172.21.15.149:0/703155919 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4927 (secure 0 0 0) 0x7f5d3005b2f0 con 0x7f5d380b27c0 2023-11-08T19:25:52.616 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:25:52.616 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5800,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/3460600894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3460600894},{"type":"v1","addr":"172.21.15.160:6834","nonce":3460600894}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":6165,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2549531465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2549531465},{"type":"v1","addr":"172.21.15.149:6835","nonce":2549531465}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":6180,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/4179310374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":4179310374},{"type":"v1","addr":"172.21.15.160:6835","nonce":4179310374}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-08T19:25:31.608945+0000","modified":"2023-11-08T19:25:34.626063+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6189},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6189":{"gid":6189,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6837/1548429999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":1548429999},{"type":"v1","addr":"172.21.15.149:6837","nonce":1548429999}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-08T19:25:52.618 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.617+0000 7f5d3d0da700 1 -- 172.21.15.149:0/703155919 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5d2406af00 msgr2=0x7f5d2406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:52.618 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.617+0000 7f5d3d0da700 1 --2- 172.21.15.149:0/703155919 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5d2406af00 0x7f5d2406d3c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f5d28001020 tx=0x7f5d28009040 comp rx=0 tx=0).stop 2023-11-08T19:25:52.619 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.617+0000 7f5d3d0da700 1 -- 172.21.15.149:0/703155919 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d380b27c0 msgr2=0x7f5d381e33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:52.619 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.617+0000 7f5d3d0da700 1 --2- 172.21.15.149:0/703155919 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d380b27c0 0x7f5d381e33d0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f5d30017040 tx=0x7f5d30004ad0 comp rx=0 tx=0).stop 2023-11-08T19:25:52.619 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.617+0000 7f5d3d0da700 1 -- 172.21.15.149:0/703155919 shutdown_connections 2023-11-08T19:25:52.619 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.617+0000 7f5d3d0da700 1 --2- 172.21.15.149:0/703155919 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5d2406af00 0x7f5d2406d3c0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:52.620 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.617+0000 7f5d3d0da700 1 --2- 172.21.15.149:0/703155919 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d380afb30 0x7f5d380ca160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:52.620 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.617+0000 7f5d3d0da700 1 --2- 172.21.15.149:0/703155919 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d380b27c0 0x7f5d381e33d0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:52.620 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.617+0000 7f5d3d0da700 1 --2- 172.21.15.149:0/703155919 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5d380b16b0 0x7f5d380c8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:52.620 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.617+0000 7f5d3d0da700 1 -- 172.21.15.149:0/703155919 >> 172.21.15.149:0/703155919 conn(0x7f5d38099a40 msgr2=0x7f5d380cbf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:52.620 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.617+0000 7f5d3d0da700 1 -- 172.21.15.149:0/703155919 shutdown_connections 2023-11-08T19:25:52.620 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.617+0000 7f5d3d0da700 1 -- 172.21.15.149:0/703155919 wait complete. 2023-11-08T19:25:52.621 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 35 2023-11-08T19:25:52.630 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:25:52.752 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.751+0000 7f2be4818700 1 Processor -- start 2023-11-08T19:25:52.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.751+0000 7f2be4818700 1 -- start start 2023-11-08T19:25:52.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.752+0000 7f2be4818700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f2be015b950 0x7f2be00ce130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:52.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.752+0000 7f2be4818700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2be00cc2e0 con 0x7f2be00cd5e0 2023-11-08T19:25:52.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.752+0000 7f2be4818700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2be00cc580 con 0x7f2be00d0430 2023-11-08T19:25:52.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.752+0000 7f2be4818700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2be00cc820 con 0x7f2be015b950 2023-11-08T19:25:52.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.752+0000 7f2bddd9b700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f2be00cd5e0 0x7f2be00cfd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:43778/0 (socket says 172.21.15.149:43778) 2023-11-08T19:25:52.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.752+0000 7f2bddd9b700 1 -- 172.21.15.149:0/2098819703 learned_addr learned my addr 172.21.15.149:0/2098819703 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:25:52.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.752+0000 7f2bde59c700 1 --2- 172.21.15.149:0/2098819703 >> v2:172.21.15.160:3300/0 conn(0x7f2be015b950 0x7f2be00ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:52.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.753+0000 7f2bdd59a700 1 -- 172.21.15.149:0/2098819703 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 588262546 0 0) 0x7f2be00cc2e0 con 0x7f2be00cd5e0 2023-11-08T19:25:52.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.753+0000 7f2bdd59a700 1 -- 172.21.15.149:0/2098819703 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2bc80035b0 con 0x7f2be00cd5e0 2023-11-08T19:25:52.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.753+0000 7f2bde59c700 1 -- 172.21.15.149:0/2098819703 >> v1:172.21.15.160:6789/0 conn(0x7f2be00d0430 legacy=0x7f2be01658e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:52.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.753+0000 7f2bde59c700 1 -- 172.21.15.149:0/2098819703 >> v1:172.21.15.149:6789/0 conn(0x7f2be00cd5e0 legacy=0x7f2be00cfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:52.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.753+0000 7f2bde59c700 1 -- 172.21.15.149:0/2098819703 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2be00ccb00 con 0x7f2be015b950 2023-11-08T19:25:52.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.753+0000 7f2bde59c700 1 --2- 172.21.15.149:0/2098819703 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2be015b950 0x7f2be00ce130 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2bd4009820 tx=0x7f2bd4009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df4179b18a36b8f3 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:52.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.753+0000 7f2bdd59a700 1 -- 172.21.15.149:0/2098819703 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd4005e30 con 0x7f2be015b950 2023-11-08T19:25:52.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.753+0000 7f2bdd59a700 1 -- 172.21.15.149:0/2098819703 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bd4006030 con 0x7f2be015b950 2023-11-08T19:25:52.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.753+0000 7f2bdd59a700 1 -- 172.21.15.149:0/2098819703 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd40063a0 con 0x7f2be015b950 2023-11-08T19:25:52.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.754+0000 7f2be4818700 1 -- 172.21.15.149:0/2098819703 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2be015b950 msgr2=0x7f2be00ce130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:52.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.754+0000 7f2be4818700 1 --2- 172.21.15.149:0/2098819703 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2be015b950 0x7f2be00ce130 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2bd4009820 tx=0x7f2bd4009b30 comp rx=0 tx=0).stop 2023-11-08T19:25:52.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.754+0000 7f2be4818700 1 -- 172.21.15.149:0/2098819703 shutdown_connections 2023-11-08T19:25:52.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.754+0000 7f2be4818700 1 --2- 172.21.15.149:0/2098819703 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2be015b950 0x7f2be00ce130 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:52.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.754+0000 7f2be4818700 1 -- 172.21.15.149:0/2098819703 >> 172.21.15.149:0/2098819703 conn(0x7f2be008afd0 msgr2=0x7f2be00d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:52.760 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.754+0000 7f2be4818700 1 -- 172.21.15.149:0/2098819703 shutdown_connections 2023-11-08T19:25:52.760 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.754+0000 7f2be4818700 1 -- 172.21.15.149:0/2098819703 wait complete. 2023-11-08T19:25:52.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.755+0000 7f2be4818700 1 Processor -- start 2023-11-08T19:25:52.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.755+0000 7f2be4818700 1 -- start start 2023-11-08T19:25:52.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.756+0000 7f2be4818700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2be00d0430 0x7f2be00b3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:52.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.756+0000 7f2be4818700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2be015b950 0x7f2be0150aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:52.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.756+0000 7f2be4818700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2be00b5770 0x7f2be006ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:52.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.756+0000 7f2be4818700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2be00b3d80 con 0x7f2be00b5770 2023-11-08T19:25:52.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.756+0000 7f2be4818700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2be0150fe0 con 0x7f2be00d0430 2023-11-08T19:25:52.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.756+0000 7f2be4818700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2be00b46d0 con 0x7f2be015b950 2023-11-08T19:25:52.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.756+0000 7f2bded9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2be00b5770 0x7f2be006ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:52.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.756+0000 7f2bded9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2be00b5770 0x7f2be006ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41786/0 (socket says 172.21.15.149:41786) 2023-11-08T19:25:52.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.756+0000 7f2bded9d700 1 -- 172.21.15.149:0/848766675 learned_addr learned my addr 172.21.15.149:0/848766675 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:52.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.756+0000 7f2bddd9b700 1 --2- 172.21.15.149:0/848766675 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2be015b950 0x7f2be0150aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:52.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.756+0000 7f2bde59c700 1 --2- 172.21.15.149:0/848766675 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2be00d0430 0x7f2be00b3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:52.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.756+0000 7f2bded9d700 1 -- 172.21.15.149:0/848766675 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2be015b950 msgr2=0x7f2be0150aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:52.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.756+0000 7f2bded9d700 1 --2- 172.21.15.149:0/848766675 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2be015b950 0x7f2be0150aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:52.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.756+0000 7f2bded9d700 1 -- 172.21.15.149:0/848766675 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2be00d0430 msgr2=0x7f2be00b3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:52.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.756+0000 7f2bded9d700 1 --2- 172.21.15.149:0/848766675 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2be00d0430 0x7f2be00b3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:52.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.756+0000 7f2bded9d700 1 -- 172.21.15.149:0/848766675 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bd4009430 con 0x7f2be00b5770 2023-11-08T19:25:52.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.756+0000 7f2bddd9b700 1 --2- 172.21.15.149:0/848766675 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2be015b950 0x7f2be0150aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:25:52.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.756+0000 7f2bde59c700 1 --2- 172.21.15.149:0/848766675 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2be00d0430 0x7f2be00b3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:25:52.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.756+0000 7f2bded9d700 1 --2- 172.21.15.149:0/848766675 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2be00b5770 0x7f2be006ee40 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f2bd800cc50 tx=0x7f2bd800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:52.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.757+0000 7f2bceffd700 1 -- 172.21.15.149:0/848766675 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd800ad80 con 0x7f2be00b5770 2023-11-08T19:25:52.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.757+0000 7f2bceffd700 1 -- 172.21.15.149:0/848766675 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bd800ce50 con 0x7f2be00b5770 2023-11-08T19:25:52.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.757+0000 7f2be4818700 1 -- 172.21.15.149:0/848766675 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2be00b49b0 con 0x7f2be00b5770 2023-11-08T19:25:52.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.757+0000 7f2bceffd700 1 -- 172.21.15.149:0/848766675 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd8003c40 con 0x7f2be00b5770 2023-11-08T19:25:52.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.757+0000 7f2be4818700 1 -- 172.21.15.149:0/848766675 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2be00b4f70 con 0x7f2be00b5770 2023-11-08T19:25:52.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.758+0000 7f2be4818700 1 -- 172.21.15.149:0/848766675 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2be00745f0 con 0x7f2be00b5770 2023-11-08T19:25:52.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.758+0000 7f2bceffd700 1 -- 172.21.15.149:0/848766675 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2bd80050d0 con 0x7f2be00b5770 2023-11-08T19:25:52.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.758+0000 7f2bceffd700 1 --2- 172.21.15.149:0/848766675 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2bc006af00 0x7f2bc006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:52.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.759+0000 7f2bceffd700 1 -- 172.21.15.149:0/848766675 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f2bd8089c00 con 0x7f2be00b5770 2023-11-08T19:25:52.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.759+0000 7f2bde59c700 1 --2- 172.21.15.149:0/848766675 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2bc006af00 0x7f2bc006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:52.770 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.759+0000 7f2bde59c700 1 --2- 172.21.15.149:0/848766675 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2bc006af00 0x7f2bc006d3c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f2bd4009b70 tx=0x7f2bd4008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:52.770 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.763+0000 7f2bceffd700 1 -- 172.21.15.149:0/848766675 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2bd8090080 con 0x7f2be00b5770 2023-11-08T19:25:52.956 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.955+0000 7f2be4818700 1 -- 172.21.15.149:0/848766675 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2be00b3f20 con 0x7f2be00b5770 2023-11-08T19:25:52.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.956+0000 7f2bceffd700 1 -- 172.21.15.149:0/848766675 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+22137 (secure 0 0 0) 0x7f2bd80547a0 con 0x7f2be00b5770 2023-11-08T19:25:52.958 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:25:52.958 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":71,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:25:48.269967+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-08T19:24:29.516185+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-08T19:25:29.341646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-08T19:25:30.566751+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-08T19:25:44.287064+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":71,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-08T19:25:45.623521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":12,"snaps":[{"begin":1,"length":1}]}],"new_removed_snaps":[{"pool":12,"snaps":[{"begin":1,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:25:52.960 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.958+0000 7f2be4818700 1 -- 172.21.15.149:0/848766675 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2bc006af00 msgr2=0x7f2bc006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:52.960 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.958+0000 7f2be4818700 1 --2- 172.21.15.149:0/848766675 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2bc006af00 0x7f2bc006d3c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f2bd4009b70 tx=0x7f2bd4008070 comp rx=0 tx=0).stop 2023-11-08T19:25:52.960 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.958+0000 7f2be4818700 1 -- 172.21.15.149:0/848766675 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2be00b5770 msgr2=0x7f2be006ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:52.960 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.958+0000 7f2be4818700 1 --2- 172.21.15.149:0/848766675 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2be00b5770 0x7f2be006ee40 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f2bd800cc50 tx=0x7f2bd800a340 comp rx=0 tx=0).stop 2023-11-08T19:25:52.961 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.958+0000 7f2be4818700 1 -- 172.21.15.149:0/848766675 shutdown_connections 2023-11-08T19:25:52.961 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.958+0000 7f2be4818700 1 --2- 172.21.15.149:0/848766675 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2bc006af00 0x7f2bc006d3c0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:52.961 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.958+0000 7f2be4818700 1 --2- 172.21.15.149:0/848766675 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2be00d0430 0x7f2be00b3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:52.961 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.958+0000 7f2be4818700 1 --2- 172.21.15.149:0/848766675 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2be00b5770 0x7f2be006ee40 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:52.961 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.958+0000 7f2be4818700 1 --2- 172.21.15.149:0/848766675 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2be015b950 0x7f2be0150aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:52.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.958+0000 7f2be4818700 1 -- 172.21.15.149:0/848766675 >> 172.21.15.149:0/848766675 conn(0x7f2be008afd0 msgr2=0x7f2be015def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:52.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.959+0000 7f2be4818700 1 -- 172.21.15.149:0/848766675 shutdown_connections 2023-11-08T19:25:52.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:52.959+0000 7f2be4818700 1 -- 172.21.15.149:0/848766675 wait complete. 2023-11-08T19:25:52.972 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-08T19:22:56.023194+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-08T19:24:29.516185+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 42, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-08T19:25:29.341646+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-11-08T19:25:30.566751+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_data_pool', 'create_time': '2023-11-08T19:25:44.287064+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 71, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-08T19:25:45.623521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-08T19:25:52.973 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-08T19:25:53.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.096+0000 7fc2a4606700 1 Processor -- start 2023-11-08T19:25:53.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.097+0000 7fc2a4606700 1 -- start start 2023-11-08T19:25:53.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.097+0000 7fc2a4606700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc29c06ab80 0x7fc29c0caf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:53.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.097+0000 7fc2a4606700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc29c15e320 con 0x7fc29c0cf1c0 2023-11-08T19:25:53.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.097+0000 7fc2a4606700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc29c06b020 con 0x7fc29c15df40 2023-11-08T19:25:53.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.097+0000 7fc2a4606700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc29c06b2e0 con 0x7fc29c06ab80 2023-11-08T19:25:53.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.098+0000 7fc2a1ba1700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc29c06ab80 0x7fc29c0caf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:53.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.098+0000 7fc2a2ba3700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fc29c0cf1c0 0x7fc29c0ce540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:43794/0 (socket says 172.21.15.149:43794) 2023-11-08T19:25:53.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.098+0000 7fc2a2ba3700 1 -- 172.21.15.149:0/1570676243 learned_addr learned my addr 172.21.15.149:0/1570676243 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:25:53.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.098+0000 7fc2a1ba1700 1 -- 172.21.15.149:0/1570676243 >> v1:172.21.15.160:6789/0 conn(0x7fc29c15df40 legacy=0x7fc29c06c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:53.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.098+0000 7fc2a1ba1700 1 -- 172.21.15.149:0/1570676243 >> v1:172.21.15.149:6789/0 conn(0x7fc29c0cf1c0 legacy=0x7fc29c0ce540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:53.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.098+0000 7fc2a1ba1700 1 -- 172.21.15.149:0/1570676243 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc29c06b5c0 con 0x7fc29c06ab80 2023-11-08T19:25:53.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.098+0000 7fc2a13a0700 1 -- 172.21.15.149:0/1570676243 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2843595800 0 0) 0x7fc29c15e320 con 0x7fc29c0cf1c0 2023-11-08T19:25:53.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.098+0000 7fc2a1ba1700 1 --2- 172.21.15.149:0/1570676243 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc29c06ab80 0x7fc29c0caf50 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fc298009840 tx=0x7fc298009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89c19c6be504d411 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:53.103 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.098+0000 7fc2a13a0700 1 -- 172.21.15.149:0/1570676243 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc298004230 con 0x7fc29c06ab80 2023-11-08T19:25:53.103 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.098+0000 7fc2a13a0700 1 -- 172.21.15.149:0/1570676243 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc298004390 con 0x7fc29c06ab80 2023-11-08T19:25:53.103 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.098+0000 7fc2a13a0700 1 -- 172.21.15.149:0/1570676243 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2980036a0 con 0x7fc29c06ab80 2023-11-08T19:25:53.103 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.099+0000 7fc2a4606700 1 -- 172.21.15.149:0/1570676243 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc29c06ab80 msgr2=0x7fc29c0caf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:53.103 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.099+0000 7fc2a4606700 1 --2- 172.21.15.149:0/1570676243 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc29c06ab80 0x7fc29c0caf50 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fc298009840 tx=0x7fc298009b50 comp rx=0 tx=0).stop 2023-11-08T19:25:53.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.099+0000 7fc2a4606700 1 -- 172.21.15.149:0/1570676243 shutdown_connections 2023-11-08T19:25:53.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.099+0000 7fc2a4606700 1 --2- 172.21.15.149:0/1570676243 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc29c06ab80 0x7fc29c0caf50 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:53.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.099+0000 7fc2a4606700 1 -- 172.21.15.149:0/1570676243 >> 172.21.15.149:0/1570676243 conn(0x7fc29c0d0640 msgr2=0x7fc29c0d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:53.105 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.099+0000 7fc2a4606700 1 -- 172.21.15.149:0/1570676243 shutdown_connections 2023-11-08T19:25:53.105 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.099+0000 7fc2a4606700 1 -- 172.21.15.149:0/1570676243 wait complete. 2023-11-08T19:25:53.108 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.100+0000 7fc2a4606700 1 Processor -- start 2023-11-08T19:25:53.108 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.100+0000 7fc2a4606700 1 -- start start 2023-11-08T19:25:53.108 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.101+0000 7fc2a4606700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc29c06ab80 0x7fc29c1f3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:53.108 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.101+0000 7fc2a4606700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc29c0cf1c0 0x7fc29c158ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:53.108 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.101+0000 7fc2a4606700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc29c15df40 0x7fc29c0c4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:53.109 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.101+0000 7fc2a4606700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc29c1f4080 con 0x7fc29c0cf1c0 2023-11-08T19:25:53.109 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.101+0000 7fc2a4606700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc29c159650 con 0x7fc29c06ab80 2023-11-08T19:25:53.109 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.101+0000 7fc2a4606700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc29c1f6c00 con 0x7fc29c15df40 2023-11-08T19:25:53.109 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.101+0000 7fc2a1ba1700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc29c0cf1c0 0x7fc29c158ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:53.109 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.101+0000 7fc2a1ba1700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc29c0cf1c0 0x7fc29c158ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41796/0 (socket says 172.21.15.149:41796) 2023-11-08T19:25:53.110 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.101+0000 7fc2a1ba1700 1 -- 172.21.15.149:0/3289204447 learned_addr learned my addr 172.21.15.149:0/3289204447 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:53.110 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.101+0000 7fc2a2ba3700 1 --2- 172.21.15.149:0/3289204447 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc29c15df40 0x7fc29c0c4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:53.110 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.101+0000 7fc2a23a2700 1 --2- 172.21.15.149:0/3289204447 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc29c06ab80 0x7fc29c1f3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:53.110 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.101+0000 7fc2a1ba1700 1 -- 172.21.15.149:0/3289204447 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc29c15df40 msgr2=0x7fc29c0c4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:53.111 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.101+0000 7fc2a1ba1700 1 --2- 172.21.15.149:0/3289204447 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc29c15df40 0x7fc29c0c4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:53.111 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.101+0000 7fc2a1ba1700 1 -- 172.21.15.149:0/3289204447 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc29c06ab80 msgr2=0x7fc29c1f3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:53.111 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.101+0000 7fc2a1ba1700 1 --2- 172.21.15.149:0/3289204447 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc29c06ab80 0x7fc29c1f3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:53.111 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.101+0000 7fc2a1ba1700 1 -- 172.21.15.149:0/3289204447 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2980094a0 con 0x7fc29c0cf1c0 2023-11-08T19:25:53.111 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.101+0000 7fc2a23a2700 1 --2- 172.21.15.149:0/3289204447 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc29c06ab80 0x7fc29c1f3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:25:53.112 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.101+0000 7fc2a1ba1700 1 --2- 172.21.15.149:0/3289204447 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc29c0cf1c0 0x7fc29c158ad0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fc298009b90 tx=0x7fc298004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:53.112 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.101+0000 7fc292ffd700 1 -- 172.21.15.149:0/3289204447 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc298011630 con 0x7fc29c0cf1c0 2023-11-08T19:25:53.112 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.101+0000 7fc292ffd700 1 -- 172.21.15.149:0/3289204447 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc29801e070 con 0x7fc29c0cf1c0 2023-11-08T19:25:53.112 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.101+0000 7fc2a4606700 1 -- 172.21.15.149:0/3289204447 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc29c1f6ee0 con 0x7fc29c0cf1c0 2023-11-08T19:25:53.112 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.101+0000 7fc292ffd700 1 -- 172.21.15.149:0/3289204447 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2980119b0 con 0x7fc29c0cf1c0 2023-11-08T19:25:53.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.101+0000 7fc2a4606700 1 -- 172.21.15.149:0/3289204447 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc29c1f74a0 con 0x7fc29c0cf1c0 2023-11-08T19:25:53.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.103+0000 7fc2a4606700 1 -- 172.21.15.149:0/3289204447 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc29c04f730 con 0x7fc29c0cf1c0 2023-11-08T19:25:53.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.103+0000 7fc292ffd700 1 -- 172.21.15.149:0/3289204447 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc298011b10 con 0x7fc29c0cf1c0 2023-11-08T19:25:53.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.103+0000 7fc292ffd700 1 --2- 172.21.15.149:0/3289204447 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc28006af00 0x7fc28006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:53.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.103+0000 7fc292ffd700 1 -- 172.21.15.149:0/3289204447 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7148+0+0 (secure 0 0 0) 0x7fc29808af50 con 0x7fc29c0cf1c0 2023-11-08T19:25:53.114 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.103+0000 7fc2a23a2700 1 --2- 172.21.15.149:0/3289204447 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc28006af00 0x7fc28006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:53.114 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.104+0000 7fc2a23a2700 1 --2- 172.21.15.149:0/3289204447 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc28006af00 0x7fc28006d3c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc28c006fd0 tx=0x7fc28c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:53.114 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.108+0000 7fc292ffd700 1 -- 172.21.15.149:0/3289204447 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc298055af0 con 0x7fc29c0cf1c0 2023-11-08T19:25:53.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.297+0000 7fc2a4606700 1 -- 172.21.15.149:0/3289204447 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc29c06d0a0 con 0x7fc29c0cf1c0 2023-11-08T19:25:53.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.298+0000 7fc292ffd700 1 -- 172.21.15.149:0/3289204447 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v71) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc298020020 con 0x7fc29c0cf1c0 2023-11-08T19:25:53.299 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 1 2023-11-08T19:25:53.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.300+0000 7fc2a4606700 1 -- 172.21.15.149:0/3289204447 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc28006af00 msgr2=0x7fc28006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:53.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.300+0000 7fc2a4606700 1 --2- 172.21.15.149:0/3289204447 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc28006af00 0x7fc28006d3c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc28c006fd0 tx=0x7fc28c008040 comp rx=0 tx=0).stop 2023-11-08T19:25:53.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.300+0000 7fc2a4606700 1 -- 172.21.15.149:0/3289204447 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc29c0cf1c0 msgr2=0x7fc29c158ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:53.302 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.300+0000 7fc2a4606700 1 --2- 172.21.15.149:0/3289204447 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc29c0cf1c0 0x7fc29c158ad0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fc298009b90 tx=0x7fc298004750 comp rx=0 tx=0).stop 2023-11-08T19:25:53.302 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.300+0000 7fc2a4606700 1 -- 172.21.15.149:0/3289204447 shutdown_connections 2023-11-08T19:25:53.302 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.300+0000 7fc2a4606700 1 --2- 172.21.15.149:0/3289204447 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc28006af00 0x7fc28006d3c0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:53.302 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.300+0000 7fc2a4606700 1 --2- 172.21.15.149:0/3289204447 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc29c06ab80 0x7fc29c1f3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:53.303 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.300+0000 7fc2a4606700 1 --2- 172.21.15.149:0/3289204447 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc29c15df40 0x7fc29c0c4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:53.303 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.300+0000 7fc2a4606700 1 --2- 172.21.15.149:0/3289204447 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc29c0cf1c0 0x7fc29c158ad0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:53.303 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.300+0000 7fc2a4606700 1 -- 172.21.15.149:0/3289204447 >> 172.21.15.149:0/3289204447 conn(0x7fc29c0d0640 msgr2=0x7fc29c06c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:53.303 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.300+0000 7fc2a4606700 1 -- 172.21.15.149:0/3289204447 shutdown_connections 2023-11-08T19:25:53.303 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.300+0000 7fc2a4606700 1 -- 172.21.15.149:0/3289204447 wait complete. 2023-11-08T19:25:53.313 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-08T19:25:53.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.436+0000 7f883dffa700 1 Processor -- start 2023-11-08T19:25:53.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.436+0000 7f883dffa700 1 -- start start 2023-11-08T19:25:53.440 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.436+0000 7f883dffa700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f88380722a0 0x7f883806ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:53.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.436+0000 7f883dffa700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f88380c7250 0x7f883806b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:53.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.436+0000 7f883dffa700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88380b3710 con 0x7f88380cb610 2023-11-08T19:25:53.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.436+0000 7f883dffa700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f883806cc00 con 0x7f88380722a0 2023-11-08T19:25:53.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.436+0000 7f883dffa700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f883806c640 con 0x7f88380c7250 2023-11-08T19:25:53.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.436+0000 7f88377fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f88380722a0 0x7f883806ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:53.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.437+0000 7f88377fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f88380722a0 0x7f883806ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41802/0 (socket says 172.21.15.149:41802) 2023-11-08T19:25:53.443 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.437+0000 7f8837fff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f88380cb610 0x7f883815fba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:43804/0 (socket says 172.21.15.149:43804) 2023-11-08T19:25:53.443 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.437+0000 7f88377fe700 1 -- 172.21.15.149:0/3800581503 learned_addr learned my addr 172.21.15.149:0/3800581503 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:53.443 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.437+0000 7f8836ffd700 1 --2- 172.21.15.149:0/3800581503 >> v2:172.21.15.160:3300/0 conn(0x7f88380c7250 0x7f883806b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:53.444 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.437+0000 7f88377fe700 1 -- 172.21.15.149:0/3800581503 >> v2:172.21.15.160:3300/0 conn(0x7f88380c7250 msgr2=0x7f883806b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:53.444 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.437+0000 7f88377fe700 1 --2- 172.21.15.149:0/3800581503 >> v2:172.21.15.160:3300/0 conn(0x7f88380c7250 0x7f883806b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:53.444 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.437+0000 7f88377fe700 1 -- 172.21.15.149:0/3800581503 >> v1:172.21.15.149:6789/0 conn(0x7f88380cb610 legacy=0x7f883815fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:53.444 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.437+0000 7f88367fc700 1 -- 172.21.15.149:0/3800581503 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4235731235 0 0) 0x7f88380b3710 con 0x7f88380cb610 2023-11-08T19:25:53.444 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.437+0000 7f88377fe700 1 -- 172.21.15.149:0/3800581503 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f883806c920 con 0x7f88380722a0 2023-11-08T19:25:53.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.437+0000 7f88377fe700 1 --2- 172.21.15.149:0/3800581503 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f88380722a0 0x7f883806ab80 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f8838067970 tx=0x7f8828009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=447016efa4247c87 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:53.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.437+0000 7f88367fc700 1 -- 172.21.15.149:0/3800581503 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882800b870 con 0x7f88380722a0 2023-11-08T19:25:53.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.437+0000 7f88367fc700 1 -- 172.21.15.149:0/3800581503 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f882800b9d0 con 0x7f88380722a0 2023-11-08T19:25:53.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.437+0000 7f88367fc700 1 -- 172.21.15.149:0/3800581503 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882800bd60 con 0x7f88380722a0 2023-11-08T19:25:53.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.438+0000 7f883dffa700 1 -- 172.21.15.149:0/3800581503 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f88380722a0 msgr2=0x7f883806ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:53.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.438+0000 7f883dffa700 1 --2- 172.21.15.149:0/3800581503 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f88380722a0 0x7f883806ab80 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f8838067970 tx=0x7f8828009bd0 comp rx=0 tx=0).stop 2023-11-08T19:25:53.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.438+0000 7f883dffa700 1 -- 172.21.15.149:0/3800581503 shutdown_connections 2023-11-08T19:25:53.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.438+0000 7f883dffa700 1 --2- 172.21.15.149:0/3800581503 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f88380722a0 0x7f883806ab80 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:53.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.438+0000 7f883dffa700 1 --2- 172.21.15.149:0/3800581503 >> v2:172.21.15.160:3300/0 conn(0x7f88380c7250 0x7f883806b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:53.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.438+0000 7f883dffa700 1 -- 172.21.15.149:0/3800581503 >> 172.21.15.149:0/3800581503 conn(0x7f88380d0640 msgr2=0x7f88380d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:53.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.438+0000 7f883dffa700 1 -- 172.21.15.149:0/3800581503 shutdown_connections 2023-11-08T19:25:53.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.438+0000 7f883dffa700 1 -- 172.21.15.149:0/3800581503 wait complete. 2023-11-08T19:25:53.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.439+0000 7f883dffa700 1 Processor -- start 2023-11-08T19:25:53.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.439+0000 7f883dffa700 1 -- start start 2023-11-08T19:25:53.450 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.440+0000 7f883dffa700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f88380722a0 0x7f883815c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:53.451 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.440+0000 7f883dffa700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f88380c7250 0x7f88381f1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:53.451 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.440+0000 7f883dffa700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f88380cb610 0x7f88381e58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:53.451 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.440+0000 7f883dffa700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88380c7710 con 0x7f88380c7250 2023-11-08T19:25:53.451 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.440+0000 7f883dffa700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88380c7960 con 0x7f88380cb610 2023-11-08T19:25:53.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.440+0000 7f883dffa700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88380c7c40 con 0x7f88380722a0 2023-11-08T19:25:53.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.440+0000 7f8836ffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f88380c7250 0x7f88381f1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:53.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.440+0000 7f8836ffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f88380c7250 0x7f88381f1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41808/0 (socket says 172.21.15.149:41808) 2023-11-08T19:25:53.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.440+0000 7f8836ffd700 1 -- 172.21.15.149:0/1650811082 learned_addr learned my addr 172.21.15.149:0/1650811082 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:53.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.440+0000 7f88377fe700 1 --2- 172.21.15.149:0/1650811082 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f88380722a0 0x7f883815c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:53.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.440+0000 7f8837fff700 1 --2- 172.21.15.149:0/1650811082 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f88380cb610 0x7f88381e58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:53.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.440+0000 7f8836ffd700 1 -- 172.21.15.149:0/1650811082 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f88380722a0 msgr2=0x7f883815c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:53.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.440+0000 7f8836ffd700 1 --2- 172.21.15.149:0/1650811082 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f88380722a0 0x7f883815c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:53.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.440+0000 7f8836ffd700 1 -- 172.21.15.149:0/1650811082 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f88380cb610 msgr2=0x7f88381e58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:53.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.440+0000 7f8836ffd700 1 --2- 172.21.15.149:0/1650811082 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f88380cb610 0x7f88381e58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:53.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.440+0000 7f8836ffd700 1 -- 172.21.15.149:0/1650811082 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8828009550 con 0x7f88380c7250 2023-11-08T19:25:53.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.440+0000 7f8836ffd700 1 --2- 172.21.15.149:0/1650811082 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f88380c7250 0x7f88381f1a50 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f882000c7f0 tx=0x7f882000cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:53.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.441+0000 7f882ffff700 1 -- 172.21.15.149:0/1650811082 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8820011800 con 0x7f88380c7250 2023-11-08T19:25:53.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.441+0000 7f882ffff700 1 -- 172.21.15.149:0/1650811082 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8820011960 con 0x7f88380c7250 2023-11-08T19:25:53.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.441+0000 7f882ffff700 1 -- 172.21.15.149:0/1650811082 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8820011cf0 con 0x7f88380c7250 2023-11-08T19:25:53.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.441+0000 7f883dffa700 1 -- 172.21.15.149:0/1650811082 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88380c7f20 con 0x7f88380c7250 2023-11-08T19:25:53.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.441+0000 7f883dffa700 1 -- 172.21.15.149:0/1650811082 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88380c84e0 con 0x7f88380c7250 2023-11-08T19:25:53.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.442+0000 7f883dffa700 1 -- 172.21.15.149:0/1650811082 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f883804f730 con 0x7f88380c7250 2023-11-08T19:25:53.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.442+0000 7f882ffff700 1 -- 172.21.15.149:0/1650811082 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8820018360 con 0x7f88380c7250 2023-11-08T19:25:53.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.442+0000 7f882ffff700 1 --2- 172.21.15.149:0/1650811082 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f881806af30 0x7f881806d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:53.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.442+0000 7f882ffff700 1 -- 172.21.15.149:0/1650811082 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f8820089ab0 con 0x7f88380c7250 2023-11-08T19:25:53.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.443+0000 7f88377fe700 1 --2- 172.21.15.149:0/1650811082 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f881806af30 0x7f881806d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:53.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.443+0000 7f88377fe700 1 --2- 172.21.15.149:0/1650811082 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f881806af30 0x7f881806d3f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f8828000c00 tx=0x7f8828008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:53.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.447+0000 7f882ffff700 1 -- 172.21.15.149:0/1650811082 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f88200545d0 con 0x7f88380c7250 2023-11-08T19:25:53.637 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.635+0000 7f883dffa700 1 -- 172.21.15.149:0/1650811082 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f88380c9810 con 0x7f88380c7250 2023-11-08T19:25:53.637 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.636+0000 7f882ffff700 1 -- 172.21.15.149:0/1650811082 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v71) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8820087e60 con 0x7f88380c7250 2023-11-08T19:25:53.637 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:25:53.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.638+0000 7f883dffa700 1 -- 172.21.15.149:0/1650811082 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f881806af30 msgr2=0x7f881806d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:53.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.638+0000 7f883dffa700 1 --2- 172.21.15.149:0/1650811082 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f881806af30 0x7f881806d3f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f8828000c00 tx=0x7f8828008030 comp rx=0 tx=0).stop 2023-11-08T19:25:53.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.638+0000 7f883dffa700 1 -- 172.21.15.149:0/1650811082 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f88380c7250 msgr2=0x7f88381f1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:53.640 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.638+0000 7f883dffa700 1 --2- 172.21.15.149:0/1650811082 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f88380c7250 0x7f88381f1a50 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f882000c7f0 tx=0x7f882000cbb0 comp rx=0 tx=0).stop 2023-11-08T19:25:53.640 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.638+0000 7f883dffa700 1 -- 172.21.15.149:0/1650811082 shutdown_connections 2023-11-08T19:25:53.640 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.638+0000 7f883dffa700 1 --2- 172.21.15.149:0/1650811082 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f881806af30 0x7f881806d3f0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:53.640 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.638+0000 7f883dffa700 1 --2- 172.21.15.149:0/1650811082 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f88380cb610 0x7f88381e58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:53.641 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.638+0000 7f883dffa700 1 --2- 172.21.15.149:0/1650811082 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f88380722a0 0x7f883815c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:53.641 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.638+0000 7f883dffa700 1 --2- 172.21.15.149:0/1650811082 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f88380c7250 0x7f88381f1a50 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:53.641 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.638+0000 7f883dffa700 1 -- 172.21.15.149:0/1650811082 >> 172.21.15.149:0/1650811082 conn(0x7f88380d0640 msgr2=0x7f88380c4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:53.642 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.638+0000 7f883dffa700 1 -- 172.21.15.149:0/1650811082 shutdown_connections 2023-11-08T19:25:53.642 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.638+0000 7f883dffa700 1 -- 172.21.15.149:0/1650811082 wait complete. 2023-11-08T19:25:53.651 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-08T19:25:53.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.774+0000 7f8fad1cd700 1 Processor -- start 2023-11-08T19:25:53.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.774+0000 7f8fad1cd700 1 -- start start 2023-11-08T19:25:53.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.775+0000 7f8fad1cd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f8fa80d0a10 0x7f8fa80b94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:53.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.775+0000 7f8fad1cd700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fa80b68f0 con 0x7f8fa815dc70 2023-11-08T19:25:53.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.775+0000 7f8fad1cd700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fa8161ca0 con 0x7f8fa815d890 2023-11-08T19:25:53.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.775+0000 7f8fad1cd700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fa8161f80 con 0x7f8fa80d0a10 2023-11-08T19:25:53.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.775+0000 7f8fa659c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f8fa80d0a10 0x7f8fa80b94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:53.779 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.775+0000 7f8fa659c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f8fa80d0a10 0x7f8fa80b94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41816/0 (socket says 172.21.15.149:41816) 2023-11-08T19:25:53.779 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.775+0000 7f8fa659c700 1 -- 172.21.15.149:0/180708068 learned_addr learned my addr 172.21.15.149:0/180708068 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:53.779 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.775+0000 7f8fa659c700 1 -- 172.21.15.149:0/180708068 >> v1:172.21.15.160:6789/0 conn(0x7f8fa815d890 legacy=0x7f8fa80d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:53.779 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.775+0000 7f8fa659c700 1 -- 172.21.15.149:0/180708068 >> v1:172.21.15.149:6789/0 conn(0x7f8fa815dc70 legacy=0x7f8fa80d22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:53.779 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.775+0000 7f8fa659c700 1 -- 172.21.15.149:0/180708068 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa8162260 con 0x7f8fa80d0a10 2023-11-08T19:25:53.780 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.775+0000 7f8fa659c700 1 --2- 172.21.15.149:0/180708068 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8fa80d0a10 0x7f8fa80b94c0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f8f980098f0 tx=0x7f8f98009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=713b459a0fc1a8e8 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:53.780 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.775+0000 7f8fa5d9b700 1 -- 172.21.15.149:0/180708068 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f98004230 con 0x7f8fa80d0a10 2023-11-08T19:25:53.780 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.775+0000 7f8fa5d9b700 1 -- 172.21.15.149:0/180708068 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f98004390 con 0x7f8fa80d0a10 2023-11-08T19:25:53.780 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.776+0000 7f8fa5d9b700 1 -- 172.21.15.149:0/180708068 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f980036a0 con 0x7f8fa80d0a10 2023-11-08T19:25:53.780 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.776+0000 7f8fad1cd700 1 -- 172.21.15.149:0/180708068 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8fa80d0a10 msgr2=0x7f8fa80b94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:53.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.776+0000 7f8fad1cd700 1 --2- 172.21.15.149:0/180708068 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8fa80d0a10 0x7f8fa80b94c0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f8f980098f0 tx=0x7f8f98009c00 comp rx=0 tx=0).stop 2023-11-08T19:25:53.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.776+0000 7f8fad1cd700 1 -- 172.21.15.149:0/180708068 shutdown_connections 2023-11-08T19:25:53.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.776+0000 7f8fad1cd700 1 --2- 172.21.15.149:0/180708068 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8fa80d0a10 0x7f8fa80b94c0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:53.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.776+0000 7f8fad1cd700 1 -- 172.21.15.149:0/180708068 >> 172.21.15.149:0/180708068 conn(0x7f8fa806bd60 msgr2=0x7f8fa806c140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:53.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.776+0000 7f8fad1cd700 1 -- 172.21.15.149:0/180708068 shutdown_connections 2023-11-08T19:25:53.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.776+0000 7f8fad1cd700 1 -- 172.21.15.149:0/180708068 wait complete. 2023-11-08T19:25:53.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.778+0000 7f8fad1cd700 1 Processor -- start 2023-11-08T19:25:53.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.778+0000 7f8fad1cd700 1 -- start start 2023-11-08T19:25:53.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.779+0000 7f8fad1cd700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8fa80d0a10 0x7f8fa80c9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:53.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.779+0000 7f8fad1cd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8fa815d890 0x7f8fa8160a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:53.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.779+0000 7f8fad1cd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8fa815dc70 0x7f8fa8155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:53.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.779+0000 7f8fad1cd700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa8160f50 con 0x7f8fa815dc70 2023-11-08T19:25:53.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.779+0000 7f8fad1cd700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa80cce00 con 0x7f8fa815d890 2023-11-08T19:25:53.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.779+0000 7f8fad1cd700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa80cc1f0 con 0x7f8fa80d0a10 2023-11-08T19:25:53.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.779+0000 7f8fa759e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8fa815dc70 0x7f8fa8155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:53.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.779+0000 7f8fa759e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8fa815dc70 0x7f8fa8155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41824/0 (socket says 172.21.15.149:41824) 2023-11-08T19:25:53.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.779+0000 7f8fa759e700 1 -- 172.21.15.149:0/3667277361 learned_addr learned my addr 172.21.15.149:0/3667277361 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:53.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.779+0000 7f8fa659c700 1 --2- 172.21.15.149:0/3667277361 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8fa815d890 0x7f8fa8160a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:53.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.779+0000 7f8fa6d9d700 1 --2- 172.21.15.149:0/3667277361 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8fa80d0a10 0x7f8fa80c9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:53.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.779+0000 7f8fa759e700 1 -- 172.21.15.149:0/3667277361 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8fa80d0a10 msgr2=0x7f8fa80c9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:53.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.779+0000 7f8fa759e700 1 --2- 172.21.15.149:0/3667277361 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8fa80d0a10 0x7f8fa80c9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:53.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.779+0000 7f8fa759e700 1 -- 172.21.15.149:0/3667277361 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8fa815d890 msgr2=0x7f8fa8160a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:53.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.779+0000 7f8fa759e700 1 --2- 172.21.15.149:0/3667277361 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8fa815d890 0x7f8fa8160a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:53.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.779+0000 7f8fa759e700 1 -- 172.21.15.149:0/3667277361 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f98009550 con 0x7f8fa815dc70 2023-11-08T19:25:53.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.779+0000 7f8fa6d9d700 1 --2- 172.21.15.149:0/3667277361 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8fa80d0a10 0x7f8fa80c9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:25:53.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.780+0000 7f8fa759e700 1 --2- 172.21.15.149:0/3667277361 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8fa815dc70 0x7f8fa8155fe0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f8fa000cb50 tx=0x7f8fa000cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:53.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.780+0000 7f8f8f7fe700 1 -- 172.21.15.149:0/3667277361 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa0003c00 con 0x7f8fa815dc70 2023-11-08T19:25:53.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.780+0000 7f8f8f7fe700 1 -- 172.21.15.149:0/3667277361 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa0003d60 con 0x7f8fa815dc70 2023-11-08T19:25:53.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.780+0000 7f8fad1cd700 1 -- 172.21.15.149:0/3667277361 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fa80cc4d0 con 0x7f8fa815dc70 2023-11-08T19:25:53.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.780+0000 7f8f8f7fe700 1 -- 172.21.15.149:0/3667277361 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa000ab70 con 0x7f8fa815dc70 2023-11-08T19:25:53.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.780+0000 7f8fad1cd700 1 -- 172.21.15.149:0/3667277361 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fa80cca90 con 0x7f8fa815dc70 2023-11-08T19:25:53.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.781+0000 7f8fad1cd700 1 -- 172.21.15.149:0/3667277361 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fa804f730 con 0x7f8fa815dc70 2023-11-08T19:25:53.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.781+0000 7f8f8f7fe700 1 -- 172.21.15.149:0/3667277361 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8fa000acd0 con 0x7f8fa815dc70 2023-11-08T19:25:53.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.782+0000 7f8f8f7fe700 1 --2- 172.21.15.149:0/3667277361 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f8f9406af00 0x7f8f9406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:53.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.782+0000 7f8f8f7fe700 1 -- 172.21.15.149:0/3667277361 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f8fa0089bd0 con 0x7f8fa815dc70 2023-11-08T19:25:53.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.782+0000 7f8fa6d9d700 1 --2- 172.21.15.149:0/3667277361 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f8f9406af00 0x7f8f9406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:53.791 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.782+0000 7f8fa6d9d700 1 --2- 172.21.15.149:0/3667277361 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f8f9406af00 0x7f8f9406d3c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c003f40 tx=0x7f8f9c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:53.791 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.787+0000 7f8f8f7fe700 1 -- 172.21.15.149:0/3667277361 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8fa00546e0 con 0x7f8fa815dc70 2023-11-08T19:25:53.976 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.975+0000 7f8fad1cd700 1 -- 172.21.15.149:0/3667277361 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8fa80ccf40 con 0x7f8fa815dc70 2023-11-08T19:25:53.977 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.975+0000 7f8f8f7fe700 1 -- 172.21.15.149:0/3667277361 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v71) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8fa0057d00 con 0x7f8fa815dc70 2023-11-08T19:25:53.977 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:25:53.979 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.978+0000 7f8fad1cd700 1 -- 172.21.15.149:0/3667277361 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f8f9406af00 msgr2=0x7f8f9406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:53.979 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.978+0000 7f8fad1cd700 1 --2- 172.21.15.149:0/3667277361 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f8f9406af00 0x7f8f9406d3c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c003f40 tx=0x7f8f9c009040 comp rx=0 tx=0).stop 2023-11-08T19:25:53.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.978+0000 7f8fad1cd700 1 -- 172.21.15.149:0/3667277361 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8fa815dc70 msgr2=0x7f8fa8155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:53.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.978+0000 7f8fad1cd700 1 --2- 172.21.15.149:0/3667277361 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8fa815dc70 0x7f8fa8155fe0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f8fa000cb50 tx=0x7f8fa000cf10 comp rx=0 tx=0).stop 2023-11-08T19:25:53.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.978+0000 7f8fad1cd700 1 -- 172.21.15.149:0/3667277361 shutdown_connections 2023-11-08T19:25:53.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.978+0000 7f8fad1cd700 1 --2- 172.21.15.149:0/3667277361 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f8f9406af00 0x7f8f9406d3c0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:53.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.978+0000 7f8fad1cd700 1 --2- 172.21.15.149:0/3667277361 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8fa815dc70 0x7f8fa8155fe0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:53.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.978+0000 7f8fad1cd700 1 --2- 172.21.15.149:0/3667277361 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8fa80d0a10 0x7f8fa80c9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:53.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.978+0000 7f8fad1cd700 1 --2- 172.21.15.149:0/3667277361 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8fa815d890 0x7f8fa8160a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:53.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.978+0000 7f8fad1cd700 1 -- 172.21.15.149:0/3667277361 >> 172.21.15.149:0/3667277361 conn(0x7f8fa806bd60 msgr2=0x7f8fa80d0300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:53.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.978+0000 7f8fad1cd700 1 -- 172.21.15.149:0/3667277361 shutdown_connections 2023-11-08T19:25:53.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:53.978+0000 7f8fad1cd700 1 -- 172.21.15.149:0/3667277361 wait complete. 2023-11-08T19:25:53.991 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-08T19:25:54.115 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.114+0000 7fb8e75f4700 1 Processor -- start 2023-11-08T19:25:54.115 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.114+0000 7fb8e75f4700 1 -- start start 2023-11-08T19:25:54.117 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.115+0000 7fb8e75f4700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb8e015a760 0x7fb8e0072240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:54.117 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.115+0000 7fb8e75f4700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fb8e015ed10 0x7fb8e00cbd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:54.117 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.115+0000 7fb8e75f4700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb8e00cf520 0x7fb8e00cf990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:54.118 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.115+0000 7fb8e75f4700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8e00cde60 con 0x7fb8e00cf520 2023-11-08T19:25:54.118 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.115+0000 7fb8e75f4700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8e00cfed0 con 0x7fb8e015ed10 2023-11-08T19:25:54.118 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.115+0000 7fb8e75f4700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e00ce240 con 0x7fb8e015a760 2023-11-08T19:25:54.118 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.115+0000 7fb8e5b91700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb8e00cf520 0x7fb8e00cf990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:54.118 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.115+0000 7fb8e5b91700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb8e00cf520 0x7fb8e00cf990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41832/0 (socket says 172.21.15.149:41832) 2023-11-08T19:25:54.119 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.115+0000 7fb8e5b91700 1 -- 172.21.15.149:0/1880465824 learned_addr learned my addr 172.21.15.149:0/1880465824 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:54.119 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.115+0000 7fb8e5390700 1 --2- 172.21.15.149:0/1880465824 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb8e015a760 0x7fb8e0072240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:54.119 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.115+0000 7fb8e4b8f700 1 --2- 172.21.15.149:0/1880465824 >> v2:172.21.15.160:3300/0 conn(0x7fb8e015ed10 0x7fb8e00cbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:54.119 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.115+0000 7fb8e5b91700 1 -- 172.21.15.149:0/1880465824 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb8e015a760 msgr2=0x7fb8e0072240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:54.119 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.115+0000 7fb8e5b91700 1 --2- 172.21.15.149:0/1880465824 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb8e015a760 0x7fb8e0072240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:54.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.115+0000 7fb8e5b91700 1 -- 172.21.15.149:0/1880465824 >> v2:172.21.15.160:3300/0 conn(0x7fb8e015ed10 msgr2=0x7fb8e00cbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:54.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.115+0000 7fb8e5b91700 1 --2- 172.21.15.149:0/1880465824 >> v2:172.21.15.160:3300/0 conn(0x7fb8e015ed10 0x7fb8e00cbd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:54.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.115+0000 7fb8e5b91700 1 -- 172.21.15.149:0/1880465824 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e00cc290 con 0x7fb8e00cf520 2023-11-08T19:25:54.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.116+0000 7fb8e5b91700 1 --2- 172.21.15.149:0/1880465824 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8e00cf520 0x7fb8e00cf990 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fb8e00b3170 tx=0x7fb8d800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48a021316f473de7 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:54.123 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.117+0000 7fb8d7fff700 1 -- 172.21.15.149:0/1880465824 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d800bb90 con 0x7fb8e00cf520 2023-11-08T19:25:54.123 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.118+0000 7fb8d7fff700 1 -- 172.21.15.149:0/1880465824 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8d800bcf0 con 0x7fb8e00cf520 2023-11-08T19:25:54.123 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.118+0000 7fb8d7fff700 1 -- 172.21.15.149:0/1880465824 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d8010630 con 0x7fb8e00cf520 2023-11-08T19:25:54.124 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.118+0000 7fb8e75f4700 1 -- 172.21.15.149:0/1880465824 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8e00cf520 msgr2=0x7fb8e00cf990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:54.124 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.118+0000 7fb8e75f4700 1 --2- 172.21.15.149:0/1880465824 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8e00cf520 0x7fb8e00cf990 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fb8e00b3170 tx=0x7fb8d800b330 comp rx=0 tx=0).stop 2023-11-08T19:25:54.125 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.118+0000 7fb8e75f4700 1 -- 172.21.15.149:0/1880465824 shutdown_connections 2023-11-08T19:25:54.125 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.118+0000 7fb8e75f4700 1 --2- 172.21.15.149:0/1880465824 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8e00cf520 0x7fb8e00cf990 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:54.125 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.118+0000 7fb8e75f4700 1 --2- 172.21.15.149:0/1880465824 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb8e015a760 0x7fb8e0072240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:54.125 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.118+0000 7fb8e75f4700 1 --2- 172.21.15.149:0/1880465824 >> v2:172.21.15.160:3300/0 conn(0x7fb8e015ed10 0x7fb8e00cbd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:54.125 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.118+0000 7fb8e75f4700 1 -- 172.21.15.149:0/1880465824 >> 172.21.15.149:0/1880465824 conn(0x7fb8e006df50 msgr2=0x7fb8e006e330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:54.126 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.118+0000 7fb8e75f4700 1 -- 172.21.15.149:0/1880465824 shutdown_connections 2023-11-08T19:25:54.126 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.118+0000 7fb8e75f4700 1 -- 172.21.15.149:0/1880465824 wait complete. 2023-11-08T19:25:54.126 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.120+0000 7fb8e75f4700 1 Processor -- start 2023-11-08T19:25:54.126 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.120+0000 7fb8e75f4700 1 -- start start 2023-11-08T19:25:54.126 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.120+0000 7fb8e75f4700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb8e00cf520 0x7fb8e00c3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:54.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.120+0000 7fb8e75f4700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8e015a760 0x7fb8e01520c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:54.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.120+0000 7fb8e75f4700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8e015ed10 0x7fb8e0157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:54.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.120+0000 7fb8e75f4700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e00c65b0 con 0x7fb8e015a760 2023-11-08T19:25:54.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.120+0000 7fb8e75f4700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e00c5930 con 0x7fb8e015ed10 2023-11-08T19:25:54.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.120+0000 7fb8e75f4700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e00c5c10 con 0x7fb8e00cf520 2023-11-08T19:25:54.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.120+0000 7fb8e4b8f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8e015a760 0x7fb8e01520c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:54.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.121+0000 7fb8e4b8f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8e015a760 0x7fb8e01520c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41836/0 (socket says 172.21.15.149:41836) 2023-11-08T19:25:54.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.121+0000 7fb8e4b8f700 1 -- 172.21.15.149:0/519248962 learned_addr learned my addr 172.21.15.149:0/519248962 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:54.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.121+0000 7fb8e5b91700 1 --2- 172.21.15.149:0/519248962 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8e015ed10 0x7fb8e0157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:54.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.121+0000 7fb8e4b8f700 1 -- 172.21.15.149:0/519248962 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb8e00cf520 msgr2=0x7fb8e00c3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:54.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.121+0000 7fb8e4b8f700 1 --2- 172.21.15.149:0/519248962 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb8e00cf520 0x7fb8e00c3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:54.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.121+0000 7fb8e4b8f700 1 -- 172.21.15.149:0/519248962 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8e015ed10 msgr2=0x7fb8e0157b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:54.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.121+0000 7fb8e4b8f700 1 --2- 172.21.15.149:0/519248962 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8e015ed10 0x7fb8e0157b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:54.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.121+0000 7fb8e4b8f700 1 -- 172.21.15.149:0/519248962 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8d8009b30 con 0x7fb8e015a760 2023-11-08T19:25:54.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.121+0000 7fb8e4b8f700 1 --2- 172.21.15.149:0/519248962 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8e015a760 0x7fb8e01520c0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fb8d0012fc0 tx=0x7fb8d00103a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:54.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.121+0000 7fb8d5ffb700 1 -- 172.21.15.149:0/519248962 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d000dbb0 con 0x7fb8e015a760 2023-11-08T19:25:54.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.121+0000 7fb8d5ffb700 1 -- 172.21.15.149:0/519248962 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8d0013040 con 0x7fb8e015a760 2023-11-08T19:25:54.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.121+0000 7fb8d5ffb700 1 -- 172.21.15.149:0/519248962 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d0010db0 con 0x7fb8e015a760 2023-11-08T19:25:54.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.121+0000 7fb8e75f4700 1 -- 172.21.15.149:0/519248962 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8e00c5ef0 con 0x7fb8e015a760 2023-11-08T19:25:54.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.122+0000 7fb8e75f4700 1 -- 172.21.15.149:0/519248962 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8e0152f20 con 0x7fb8e015a760 2023-11-08T19:25:54.132 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.122+0000 7fb8e75f4700 1 -- 172.21.15.149:0/519248962 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8e00c66f0 con 0x7fb8e015a760 2023-11-08T19:25:54.132 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.125+0000 7fb8d5ffb700 1 -- 172.21.15.149:0/519248962 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb8d0018480 con 0x7fb8e015a760 2023-11-08T19:25:54.132 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.125+0000 7fb8d5ffb700 1 --2- 172.21.15.149:0/519248962 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb8c406af00 0x7fb8c406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:54.132 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.125+0000 7fb8d5ffb700 1 -- 172.21.15.149:0/519248962 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7120+0+0 (secure 0 0 0) 0x7fb8d008e330 con 0x7fb8e015a760 2023-11-08T19:25:54.133 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.125+0000 7fb8e5390700 1 --2- 172.21.15.149:0/519248962 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb8c406af00 0x7fb8c406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:54.133 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.126+0000 7fb8e5390700 1 --2- 172.21.15.149:0/519248962 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb8c406af00 0x7fb8c406d3c0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc009a40 tx=0x7fb8dc009500 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:54.133 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.129+0000 7fb8d5ffb700 1 -- 172.21.15.149:0/519248962 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb8d0058ff0 con 0x7fb8e015a760 2023-11-08T19:25:54.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.321+0000 7fb8e75f4700 1 -- 172.21.15.149:0/519248962 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb8e00c66f0 con 0x7fb8e015a760 2023-11-08T19:25:54.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.322+0000 7fb8d5ffb700 1 -- 172.21.15.149:0/519248962 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v72) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb8e00c66f0 con 0x7fb8e015a760 2023-11-08T19:25:54.323 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 64 2023-11-08T19:25:54.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.324+0000 7fb8e75f4700 1 -- 172.21.15.149:0/519248962 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb8c406af00 msgr2=0x7fb8c406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:54.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.324+0000 7fb8e75f4700 1 --2- 172.21.15.149:0/519248962 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb8c406af00 0x7fb8c406d3c0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc009a40 tx=0x7fb8dc009500 comp rx=0 tx=0).stop 2023-11-08T19:25:54.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.324+0000 7fb8e75f4700 1 -- 172.21.15.149:0/519248962 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8e015a760 msgr2=0x7fb8e01520c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:54.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.324+0000 7fb8e75f4700 1 --2- 172.21.15.149:0/519248962 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8e015a760 0x7fb8e01520c0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fb8d0012fc0 tx=0x7fb8d00103a0 comp rx=0 tx=0).stop 2023-11-08T19:25:54.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.324+0000 7fb8e75f4700 1 -- 172.21.15.149:0/519248962 shutdown_connections 2023-11-08T19:25:54.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.324+0000 7fb8e75f4700 1 --2- 172.21.15.149:0/519248962 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb8c406af00 0x7fb8c406d3c0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:54.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.324+0000 7fb8e75f4700 1 --2- 172.21.15.149:0/519248962 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8e015ed10 0x7fb8e0157b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:54.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.324+0000 7fb8e75f4700 1 --2- 172.21.15.149:0/519248962 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb8e00cf520 0x7fb8e00c3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:54.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.324+0000 7fb8e75f4700 1 --2- 172.21.15.149:0/519248962 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8e015a760 0x7fb8e01520c0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:54.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.324+0000 7fb8e75f4700 1 -- 172.21.15.149:0/519248962 >> 172.21.15.149:0/519248962 conn(0x7fb8e006df50 msgr2=0x7fb8e015e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:54.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.324+0000 7fb8e75f4700 1 -- 172.21.15.149:0/519248962 shutdown_connections 2023-11-08T19:25:54.328 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.324+0000 7fb8e75f4700 1 -- 172.21.15.149:0/519248962 wait complete. 2023-11-08T19:25:54.337 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-08T19:25:54.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.462+0000 7fe71a5b5700 1 Processor -- start 2023-11-08T19:25:54.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.462+0000 7fe71a5b5700 1 -- start start 2023-11-08T19:25:54.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.462+0000 7fe71a5b5700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe71406ab80 0x7fe7140caf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:54.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.462+0000 7fe71a5b5700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe71415e320 con 0x7fe71415df40 2023-11-08T19:25:54.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.462+0000 7fe71a5b5700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe71406b020 con 0x7fe7140cf1c0 2023-11-08T19:25:54.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.462+0000 7fe71a5b5700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe71406b2e0 con 0x7fe71406ab80 2023-11-08T19:25:54.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.463+0000 7fe7137fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe71406ab80 0x7fe7140caf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:54.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.463+0000 7fe713fff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fe71415df40 0x7fe71406c0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:43844/0 (socket says 172.21.15.149:43844) 2023-11-08T19:25:54.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.463+0000 7fe713fff700 1 -- 172.21.15.149:0/3802618725 learned_addr learned my addr 172.21.15.149:0/3802618725 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:25:54.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.463+0000 7fe7137fe700 1 -- 172.21.15.149:0/3802618725 >> v1:172.21.15.160:6789/0 conn(0x7fe7140cf1c0 legacy=0x7fe7140ce540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:54.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.463+0000 7fe7137fe700 1 -- 172.21.15.149:0/3802618725 >> v1:172.21.15.149:6789/0 conn(0x7fe71415df40 legacy=0x7fe71406c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:54.468 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.463+0000 7fe7137fe700 1 -- 172.21.15.149:0/3802618725 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe71406b5c0 con 0x7fe71406ab80 2023-11-08T19:25:54.468 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.463+0000 7fe712ffd700 1 -- 172.21.15.149:0/3802618725 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4174787012 0 0) 0x7fe71415e320 con 0x7fe71415df40 2023-11-08T19:25:54.468 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.463+0000 7fe7137fe700 1 --2- 172.21.15.149:0/3802618725 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe71406ab80 0x7fe7140caf50 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fe708009840 tx=0x7fe708009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=426ab70ace849342 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:54.468 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.463+0000 7fe712ffd700 1 -- 172.21.15.149:0/3802618725 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe708004230 con 0x7fe71406ab80 2023-11-08T19:25:54.469 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.463+0000 7fe712ffd700 1 -- 172.21.15.149:0/3802618725 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe708004390 con 0x7fe71406ab80 2023-11-08T19:25:54.469 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.463+0000 7fe712ffd700 1 -- 172.21.15.149:0/3802618725 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7080036a0 con 0x7fe71406ab80 2023-11-08T19:25:54.469 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.464+0000 7fe71a5b5700 1 -- 172.21.15.149:0/3802618725 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe71406ab80 msgr2=0x7fe7140caf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:54.469 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.464+0000 7fe71a5b5700 1 --2- 172.21.15.149:0/3802618725 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe71406ab80 0x7fe7140caf50 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fe708009840 tx=0x7fe708009b50 comp rx=0 tx=0).stop 2023-11-08T19:25:54.469 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.464+0000 7fe71a5b5700 1 -- 172.21.15.149:0/3802618725 shutdown_connections 2023-11-08T19:25:54.470 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.464+0000 7fe71a5b5700 1 --2- 172.21.15.149:0/3802618725 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe71406ab80 0x7fe7140caf50 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:54.470 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.464+0000 7fe71a5b5700 1 -- 172.21.15.149:0/3802618725 >> 172.21.15.149:0/3802618725 conn(0x7fe7140d0640 msgr2=0x7fe7140d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:54.470 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.464+0000 7fe71a5b5700 1 -- 172.21.15.149:0/3802618725 shutdown_connections 2023-11-08T19:25:54.470 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.464+0000 7fe71a5b5700 1 -- 172.21.15.149:0/3802618725 wait complete. 2023-11-08T19:25:54.473 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.465+0000 7fe71a5b5700 1 Processor -- start 2023-11-08T19:25:54.473 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.465+0000 7fe71a5b5700 1 -- start start 2023-11-08T19:25:54.473 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.466+0000 7fe71a5b5700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe71406ab80 0x7fe7140c5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:54.473 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.466+0000 7fe71a5b5700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7140cf1c0 0x7fe7140ace80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:54.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.466+0000 7fe71a5b5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe71415df40 0x7fe7140ad3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:54.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.466+0000 7fe71a5b5700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7140c4c20 con 0x7fe71415df40 2023-11-08T19:25:54.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.466+0000 7fe71a5b5700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7140c4f00 con 0x7fe7140cf1c0 2023-11-08T19:25:54.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.466+0000 7fe71a5b5700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7140c51e0 con 0x7fe71406ab80 2023-11-08T19:25:54.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.466+0000 7fe718b52700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe71415df40 0x7fe7140ad3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:54.475 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.466+0000 7fe718b52700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe71415df40 0x7fe7140ad3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41852/0 (socket says 172.21.15.149:41852) 2023-11-08T19:25:54.475 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.466+0000 7fe718b52700 1 -- 172.21.15.149:0/3338073540 learned_addr learned my addr 172.21.15.149:0/3338073540 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:54.475 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.466+0000 7fe7137fe700 1 --2- 172.21.15.149:0/3338073540 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7140cf1c0 0x7fe7140ace80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:54.475 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.466+0000 7fe713fff700 1 --2- 172.21.15.149:0/3338073540 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe71406ab80 0x7fe7140c5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:54.475 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.466+0000 7fe718b52700 1 -- 172.21.15.149:0/3338073540 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe71406ab80 msgr2=0x7fe7140c5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:54.476 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.466+0000 7fe718b52700 1 --2- 172.21.15.149:0/3338073540 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe71406ab80 0x7fe7140c5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:54.476 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.466+0000 7fe718b52700 1 -- 172.21.15.149:0/3338073540 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7140cf1c0 msgr2=0x7fe7140ace80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:54.476 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.466+0000 7fe718b52700 1 --2- 172.21.15.149:0/3338073540 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7140cf1c0 0x7fe7140ace80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:54.476 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.466+0000 7fe718b52700 1 -- 172.21.15.149:0/3338073540 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7080094a0 con 0x7fe71415df40 2023-11-08T19:25:54.477 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.467+0000 7fe718b52700 1 --2- 172.21.15.149:0/3338073540 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe71415df40 0x7fe7140ad3c0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fe70c00cba0 tx=0x7fe70c00ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:54.477 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.467+0000 7fe710ff9700 1 -- 172.21.15.149:0/3338073540 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70c00aad0 con 0x7fe71415df40 2023-11-08T19:25:54.477 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.467+0000 7fe710ff9700 1 -- 172.21.15.149:0/3338073540 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe70c00ac30 con 0x7fe71415df40 2023-11-08T19:25:54.477 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.467+0000 7fe71a5b5700 1 -- 172.21.15.149:0/3338073540 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7140c54c0 con 0x7fe71415df40 2023-11-08T19:25:54.477 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.467+0000 7fe710ff9700 1 -- 172.21.15.149:0/3338073540 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70c012420 con 0x7fe71415df40 2023-11-08T19:25:54.478 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.467+0000 7fe71a5b5700 1 -- 172.21.15.149:0/3338073540 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7140c6200 con 0x7fe71415df40 2023-11-08T19:25:54.478 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.468+0000 7fe71a5b5700 1 -- 172.21.15.149:0/3338073540 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7140c59e0 con 0x7fe71415df40 2023-11-08T19:25:54.478 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.468+0000 7fe710ff9700 1 -- 172.21.15.149:0/3338073540 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe70c012580 con 0x7fe71415df40 2023-11-08T19:25:54.478 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.469+0000 7fe710ff9700 1 --2- 172.21.15.149:0/3338073540 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe70006af00 0x7fe70006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:54.478 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.469+0000 7fe713fff700 1 --2- 172.21.15.149:0/3338073540 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe70006af00 0x7fe70006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:54.479 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.469+0000 7fe710ff9700 1 -- 172.21.15.149:0/3338073540 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7120+0+0 (secure 0 0 0) 0x7fe70c08a220 con 0x7fe71415df40 2023-11-08T19:25:54.479 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.469+0000 7fe713fff700 1 --2- 172.21.15.149:0/3338073540 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe70006af00 0x7fe70006d3c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fe704000f60 tx=0x7fe704007c90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:54.479 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.473+0000 7fe710ff9700 1 -- 172.21.15.149:0/3338073540 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe7140c59e0 con 0x7fe71415df40 2023-11-08T19:25:54.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.661+0000 7fe71a5b5700 1 -- 172.21.15.149:0/3338073540 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7fe7140c59e0 con 0x7fe71415df40 2023-11-08T19:25:54.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.662+0000 7fe710ff9700 1 -- 172.21.15.149:0/3338073540 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v72) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe7140c59e0 con 0x7fe71415df40 2023-11-08T19:25:54.664 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:25:54.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.664+0000 7fe71a5b5700 1 -- 172.21.15.149:0/3338073540 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe70006af00 msgr2=0x7fe70006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:54.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.664+0000 7fe71a5b5700 1 --2- 172.21.15.149:0/3338073540 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe70006af00 0x7fe70006d3c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fe704000f60 tx=0x7fe704007c90 comp rx=0 tx=0).stop 2023-11-08T19:25:54.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.664+0000 7fe71a5b5700 1 -- 172.21.15.149:0/3338073540 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe71415df40 msgr2=0x7fe7140ad3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:54.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.664+0000 7fe71a5b5700 1 --2- 172.21.15.149:0/3338073540 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe71415df40 0x7fe7140ad3c0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fe70c00cba0 tx=0x7fe70c00ceb0 comp rx=0 tx=0).stop 2023-11-08T19:25:54.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.664+0000 7fe71a5b5700 1 -- 172.21.15.149:0/3338073540 shutdown_connections 2023-11-08T19:25:54.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.664+0000 7fe71a5b5700 1 --2- 172.21.15.149:0/3338073540 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe70006af00 0x7fe70006d3c0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:54.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.664+0000 7fe71a5b5700 1 --2- 172.21.15.149:0/3338073540 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe71415df40 0x7fe7140ad3c0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:54.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.664+0000 7fe71a5b5700 1 --2- 172.21.15.149:0/3338073540 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe71406ab80 0x7fe7140c5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:54.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.664+0000 7fe71a5b5700 1 --2- 172.21.15.149:0/3338073540 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7140cf1c0 0x7fe7140ace80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:54.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.664+0000 7fe71a5b5700 1 -- 172.21.15.149:0/3338073540 >> 172.21.15.149:0/3338073540 conn(0x7fe7140d0640 msgr2=0x7fe7140b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:54.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.664+0000 7fe71a5b5700 1 -- 172.21.15.149:0/3338073540 shutdown_connections 2023-11-08T19:25:54.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.664+0000 7fe71a5b5700 1 -- 172.21.15.149:0/3338073540 wait complete. 2023-11-08T19:25:54.678 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-08T19:25:54.803 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.802+0000 7f342e31a700 1 Processor -- start 2023-11-08T19:25:54.804 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.802+0000 7f342e31a700 1 -- start start 2023-11-08T19:25:54.806 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.803+0000 7f342e31a700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f342806ab80 0x7f34280caf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:54.806 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.803+0000 7f342e31a700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f34280cf1c0 0x7f34280cb490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:54.807 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.803+0000 7f342e31a700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f342815e320 con 0x7f342815df40 2023-11-08T19:25:54.807 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.803+0000 7f342e31a700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f342806b020 con 0x7f34280cf1c0 2023-11-08T19:25:54.807 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.803+0000 7f342e31a700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f342806b2e0 con 0x7f342806ab80 2023-11-08T19:25:54.807 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.803+0000 7f342c8b7700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f34280cf1c0 0x7f34280cb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:54.808 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.803+0000 7f342c8b7700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f34280cf1c0 0x7f34280cb490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41860/0 (socket says 172.21.15.149:41860) 2023-11-08T19:25:54.808 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.803+0000 7f342c8b7700 1 -- 172.21.15.149:0/3824960653 learned_addr learned my addr 172.21.15.149:0/3824960653 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:54.808 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.803+0000 7f34277fe700 1 --2- 172.21.15.149:0/3824960653 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f342806ab80 0x7f34280caf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:54.808 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.803+0000 7f342c8b7700 1 -- 172.21.15.149:0/3824960653 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f342806ab80 msgr2=0x7f34280caf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:54.808 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.803+0000 7f342c8b7700 1 --2- 172.21.15.149:0/3824960653 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f342806ab80 0x7f34280caf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:54.809 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.803+0000 7f342c8b7700 1 -- 172.21.15.149:0/3824960653 >> v1:172.21.15.160:6789/0 conn(0x7f342815df40 legacy=0x7f342806c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:54.809 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.804+0000 7f342c8b7700 1 -- 172.21.15.149:0/3824960653 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f342806b5c0 con 0x7f34280cf1c0 2023-11-08T19:25:54.809 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.804+0000 7f342c8b7700 1 --2- 172.21.15.149:0/3824960653 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34280cf1c0 0x7f34280cb490 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f3420009e50 tx=0x7f342000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ccfe65936facec4 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:54.809 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.804+0000 7f3426ffd700 1 -- 172.21.15.149:0/3824960653 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342000e070 con 0x7f34280cf1c0 2023-11-08T19:25:54.809 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.804+0000 7f3426ffd700 1 -- 172.21.15.149:0/3824960653 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f342000b910 con 0x7f34280cf1c0 2023-11-08T19:25:54.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.804+0000 7f3426ffd700 1 -- 172.21.15.149:0/3824960653 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342000bcc0 con 0x7f34280cf1c0 2023-11-08T19:25:54.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.804+0000 7f342e31a700 1 -- 172.21.15.149:0/3824960653 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34280cf1c0 msgr2=0x7f34280cb490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:54.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.804+0000 7f342e31a700 1 --2- 172.21.15.149:0/3824960653 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34280cf1c0 0x7f34280cb490 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f3420009e50 tx=0x7f342000b330 comp rx=0 tx=0).stop 2023-11-08T19:25:54.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.804+0000 7f342e31a700 1 -- 172.21.15.149:0/3824960653 shutdown_connections 2023-11-08T19:25:54.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.804+0000 7f342e31a700 1 --2- 172.21.15.149:0/3824960653 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34280cf1c0 0x7f34280cb490 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:54.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.804+0000 7f342e31a700 1 --2- 172.21.15.149:0/3824960653 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f342806ab80 0x7f34280caf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:54.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.804+0000 7f342e31a700 1 -- 172.21.15.149:0/3824960653 >> 172.21.15.149:0/3824960653 conn(0x7f34280d0640 msgr2=0x7f34280d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:54.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.804+0000 7f342e31a700 1 -- 172.21.15.149:0/3824960653 shutdown_connections 2023-11-08T19:25:54.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.804+0000 7f342e31a700 1 -- 172.21.15.149:0/3824960653 wait complete. 2023-11-08T19:25:54.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.806+0000 7f342e31a700 1 Processor -- start 2023-11-08T19:25:54.814 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.806+0000 7f342e31a700 1 -- start start 2023-11-08T19:25:54.814 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.806+0000 7f342e31a700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f342806ab80 0x7f34280ca340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:54.814 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.806+0000 7f342e31a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f34280cf1c0 0x7f34281f6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:54.814 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.806+0000 7f342e31a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f342815df40 0x7f3428148e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:54.815 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.806+0000 7f342e31a700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34281f7400 con 0x7f342815df40 2023-11-08T19:25:54.815 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.806+0000 7f342e31a700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34281f76e0 con 0x7f34280cf1c0 2023-11-08T19:25:54.815 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.806+0000 7f342e31a700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34281f79c0 con 0x7f342806ab80 2023-11-08T19:25:54.815 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.807+0000 7f342c8b7700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f342815df40 0x7f3428148e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:54.815 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.807+0000 7f342c8b7700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f342815df40 0x7f3428148e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41866/0 (socket says 172.21.15.149:41866) 2023-11-08T19:25:54.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.807+0000 7f342c8b7700 1 -- 172.21.15.149:0/2323961806 learned_addr learned my addr 172.21.15.149:0/2323961806 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:54.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.807+0000 7f3427fff700 1 --2- 172.21.15.149:0/2323961806 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f342806ab80 0x7f34280ca340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:54.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.807+0000 7f34277fe700 1 --2- 172.21.15.149:0/2323961806 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f34280cf1c0 0x7f34281f6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:54.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.807+0000 7f342c8b7700 1 -- 172.21.15.149:0/2323961806 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f342806ab80 msgr2=0x7f34280ca340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:54.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.807+0000 7f342c8b7700 1 --2- 172.21.15.149:0/2323961806 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f342806ab80 0x7f34280ca340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:54.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.807+0000 7f342c8b7700 1 -- 172.21.15.149:0/2323961806 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f34280cf1c0 msgr2=0x7f34281f6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:54.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.807+0000 7f342c8b7700 1 --2- 172.21.15.149:0/2323961806 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f34280cf1c0 0x7f34281f6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:54.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.807+0000 7f342c8b7700 1 -- 172.21.15.149:0/2323961806 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3420009b30 con 0x7f342815df40 2023-11-08T19:25:54.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.807+0000 7f34277fe700 1 --2- 172.21.15.149:0/2323961806 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f34280cf1c0 0x7f34281f6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:25:54.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.807+0000 7f342c8b7700 1 --2- 172.21.15.149:0/2323961806 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f342815df40 0x7f3428148e30 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f34280ce1c0 tx=0x7f3420004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:54.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.807+0000 7f3424ff9700 1 -- 172.21.15.149:0/2323961806 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34200099b0 con 0x7f342815df40 2023-11-08T19:25:54.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.807+0000 7f3424ff9700 1 -- 172.21.15.149:0/2323961806 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34200092e0 con 0x7f342815df40 2023-11-08T19:25:54.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.807+0000 7f3424ff9700 1 -- 172.21.15.149:0/2323961806 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342001c640 con 0x7f342815df40 2023-11-08T19:25:54.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.807+0000 7f342e31a700 1 -- 172.21.15.149:0/2323961806 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3428148630 con 0x7f342815df40 2023-11-08T19:25:54.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.807+0000 7f342e31a700 1 -- 172.21.15.149:0/2323961806 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34281f70f0 con 0x7f342815df40 2023-11-08T19:25:54.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.808+0000 7f342e31a700 1 -- 172.21.15.149:0/2323961806 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34280affd0 con 0x7f342815df40 2023-11-08T19:25:54.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.809+0000 7f3424ff9700 1 -- 172.21.15.149:0/2323961806 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f342001c7a0 con 0x7f342815df40 2023-11-08T19:25:54.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.809+0000 7f3424ff9700 1 --2- 172.21.15.149:0/2323961806 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f341406af00 0x7f341406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:54.820 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.809+0000 7f3424ff9700 1 -- 172.21.15.149:0/2323961806 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f342008b880 con 0x7f342815df40 2023-11-08T19:25:54.820 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.809+0000 7f3427fff700 1 --2- 172.21.15.149:0/2323961806 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f341406af00 0x7f341406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:54.820 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.810+0000 7f3427fff700 1 --2- 172.21.15.149:0/2323961806 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f341406af00 0x7f341406d3c0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f341c000f60 tx=0x7f341c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:54.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:54.814+0000 7f3424ff9700 1 -- 172.21.15.149:0/2323961806 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3420056440 con 0x7f342815df40 2023-11-08T19:25:55.005 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.004+0000 7f342e31a700 1 -- 172.21.15.149:0/2323961806 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7f3428148af0 con 0x7f342815df40 2023-11-08T19:25:55.006 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.005+0000 7f3424ff9700 1 -- 172.21.15.149:0/2323961806 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v72) v1 ==== 107+0+11 (secure 0 0 0) 0x7f3420059a60 con 0x7f342815df40 2023-11-08T19:25:55.006 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:25:55.008 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.007+0000 7f342e31a700 1 -- 172.21.15.149:0/2323961806 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f341406af00 msgr2=0x7f341406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:55.008 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.007+0000 7f342e31a700 1 --2- 172.21.15.149:0/2323961806 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f341406af00 0x7f341406d3c0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f341c000f60 tx=0x7f341c009040 comp rx=0 tx=0).stop 2023-11-08T19:25:55.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.007+0000 7f342e31a700 1 -- 172.21.15.149:0/2323961806 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f342815df40 msgr2=0x7f3428148e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:55.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.007+0000 7f342e31a700 1 --2- 172.21.15.149:0/2323961806 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f342815df40 0x7f3428148e30 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f34280ce1c0 tx=0x7f3420004ad0 comp rx=0 tx=0).stop 2023-11-08T19:25:55.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.007+0000 7f342e31a700 1 -- 172.21.15.149:0/2323961806 shutdown_connections 2023-11-08T19:25:55.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.007+0000 7f342e31a700 1 --2- 172.21.15.149:0/2323961806 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f341406af00 0x7f341406d3c0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:55.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.007+0000 7f342e31a700 1 --2- 172.21.15.149:0/2323961806 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f342815df40 0x7f3428148e30 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:55.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.007+0000 7f342e31a700 1 --2- 172.21.15.149:0/2323961806 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f342806ab80 0x7f34280ca340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:55.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.007+0000 7f342e31a700 1 --2- 172.21.15.149:0/2323961806 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f34280cf1c0 0x7f34281f6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:55.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.007+0000 7f342e31a700 1 -- 172.21.15.149:0/2323961806 >> 172.21.15.149:0/2323961806 conn(0x7f34280d0640 msgr2=0x7f34280cc570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:55.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.007+0000 7f342e31a700 1 -- 172.21.15.149:0/2323961806 shutdown_connections 2023-11-08T19:25:55.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.007+0000 7f342e31a700 1 -- 172.21.15.149:0/2323961806 wait complete. 2023-11-08T19:25:55.024 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:25:55.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.145+0000 7fe1ab9c7700 1 Processor -- start 2023-11-08T19:25:55.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.145+0000 7fe1ab9c7700 1 -- start start 2023-11-08T19:25:55.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.146+0000 7fe1ab9c7700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1a40ce840 0x7fe1a40d0430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:55.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.146+0000 7fe1ab9c7700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1a40cc2e0 con 0x7fe1a40cd5e0 2023-11-08T19:25:55.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.146+0000 7fe1ab9c7700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1a40cc580 con 0x7fe1a415b950 2023-11-08T19:25:55.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.146+0000 7fe1ab9c7700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a40cc820 con 0x7fe1a40ce840 2023-11-08T19:25:55.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.146+0000 7fe1a8f62700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fe1a40cd5e0 0x7fe1a40cfd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:43872/0 (socket says 172.21.15.149:43872) 2023-11-08T19:25:55.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.146+0000 7fe1a8f62700 1 -- 172.21.15.149:0/1097125180 learned_addr learned my addr 172.21.15.149:0/1097125180 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:25:55.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.146+0000 7fe1a9f64700 1 --2- 172.21.15.149:0/1097125180 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1a40ce840 0x7fe1a40d0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:55.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.146+0000 7fe19bfff700 1 -- 172.21.15.149:0/1097125180 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2935026600 0 0) 0x7fe1a40cc2e0 con 0x7fe1a40cd5e0 2023-11-08T19:25:55.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.146+0000 7fe19bfff700 1 -- 172.21.15.149:0/1097125180 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1900035b0 con 0x7fe1a40cd5e0 2023-11-08T19:25:55.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.146+0000 7fe19bfff700 1 -- 172.21.15.149:0/1097125180 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2546102041 0 0) 0x7fe1a40cc580 con 0x7fe1a415b950 2023-11-08T19:25:55.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.146+0000 7fe19bfff700 1 -- 172.21.15.149:0/1097125180 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1a40cc2e0 con 0x7fe1a415b950 2023-11-08T19:25:55.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.146+0000 7fe1a9f64700 1 -- 172.21.15.149:0/1097125180 >> v1:172.21.15.160:6789/0 conn(0x7fe1a415b950 legacy=0x7fe1a40ce130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:55.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.147+0000 7fe1a9f64700 1 -- 172.21.15.149:0/1097125180 >> v1:172.21.15.149:6789/0 conn(0x7fe1a40cd5e0 legacy=0x7fe1a40cfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:55.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.147+0000 7fe19bfff700 1 -- 172.21.15.149:0/1097125180 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3388643051 0 0) 0x7fe1900035b0 con 0x7fe1a40cd5e0 2023-11-08T19:25:55.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.147+0000 7fe1a9f64700 1 -- 172.21.15.149:0/1097125180 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a40ccb00 con 0x7fe1a40ce840 2023-11-08T19:25:55.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.147+0000 7fe1a9f64700 1 --2- 172.21.15.149:0/1097125180 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1a40ce840 0x7fe1a40d0430 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe19c009dc0 tx=0x7fe19c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4cd7385cd80f374d server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:55.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.147+0000 7fe19bfff700 1 -- 172.21.15.149:0/1097125180 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19c00e070 con 0x7fe1a40ce840 2023-11-08T19:25:55.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.147+0000 7fe19bfff700 1 -- 172.21.15.149:0/1097125180 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe19c003a20 con 0x7fe1a40ce840 2023-11-08T19:25:55.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.147+0000 7fe19bfff700 1 -- 172.21.15.149:0/1097125180 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe194001670 con 0x7fe1a40ce840 2023-11-08T19:25:55.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.147+0000 7fe1ab9c7700 1 -- 172.21.15.149:0/1097125180 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1a40ce840 msgr2=0x7fe1a40d0430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:55.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.147+0000 7fe1ab9c7700 1 --2- 172.21.15.149:0/1097125180 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1a40ce840 0x7fe1a40d0430 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe19c009dc0 tx=0x7fe19c00b330 comp rx=0 tx=0).stop 2023-11-08T19:25:55.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.147+0000 7fe1ab9c7700 1 -- 172.21.15.149:0/1097125180 shutdown_connections 2023-11-08T19:25:55.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.147+0000 7fe1ab9c7700 1 --2- 172.21.15.149:0/1097125180 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1a40ce840 0x7fe1a40d0430 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:55.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.147+0000 7fe1ab9c7700 1 -- 172.21.15.149:0/1097125180 >> 172.21.15.149:0/1097125180 conn(0x7fe1a408afd0 msgr2=0x7fe1a40d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:55.154 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.148+0000 7fe1ab9c7700 1 -- 172.21.15.149:0/1097125180 shutdown_connections 2023-11-08T19:25:55.154 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.148+0000 7fe1ab9c7700 1 -- 172.21.15.149:0/1097125180 wait complete. 2023-11-08T19:25:55.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.149+0000 7fe1ab9c7700 1 Processor -- start 2023-11-08T19:25:55.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.149+0000 7fe1ab9c7700 1 -- start start 2023-11-08T19:25:55.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.150+0000 7fe1ab9c7700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe1a40ce840 0x7fe1a414bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:55.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.150+0000 7fe1ab9c7700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1a415b950 0x7fe1a415d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:55.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.150+0000 7fe1ab9c7700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1a415d6d0 0x7fe1a40c5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:55.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.150+0000 7fe1ab9c7700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a414c150 con 0x7fe1a415d6d0 2023-11-08T19:25:55.158 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.150+0000 7fe1ab9c7700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a40c8cc0 con 0x7fe1a40ce840 2023-11-08T19:25:55.158 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.150+0000 7fe1ab9c7700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a40b1240 con 0x7fe1a415b950 2023-11-08T19:25:55.158 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.150+0000 7fe1a9f64700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1a415d6d0 0x7fe1a40c5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:55.158 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.150+0000 7fe1a9f64700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1a415d6d0 0x7fe1a40c5270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41878/0 (socket says 172.21.15.149:41878) 2023-11-08T19:25:55.158 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.150+0000 7fe1a9f64700 1 -- 172.21.15.149:0/1167606873 learned_addr learned my addr 172.21.15.149:0/1167606873 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:55.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.150+0000 7fe1a9763700 1 --2- 172.21.15.149:0/1167606873 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe1a40ce840 0x7fe1a414bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:55.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.150+0000 7fe1a8f62700 1 --2- 172.21.15.149:0/1167606873 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1a415b950 0x7fe1a415d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:55.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.150+0000 7fe1a9f64700 1 -- 172.21.15.149:0/1167606873 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1a415b950 msgr2=0x7fe1a415d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:55.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.150+0000 7fe1a9f64700 1 --2- 172.21.15.149:0/1167606873 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1a415b950 0x7fe1a415d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:55.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.150+0000 7fe1a9f64700 1 -- 172.21.15.149:0/1167606873 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe1a40ce840 msgr2=0x7fe1a414bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:55.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.150+0000 7fe1a9f64700 1 --2- 172.21.15.149:0/1167606873 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe1a40ce840 0x7fe1a414bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:55.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.150+0000 7fe1a9f64700 1 -- 172.21.15.149:0/1167606873 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe19c009a70 con 0x7fe1a415d6d0 2023-11-08T19:25:55.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.151+0000 7fe1a9f64700 1 --2- 172.21.15.149:0/1167606873 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1a415d6d0 0x7fe1a40c5270 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fe19c004000 tx=0x7fe19c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:55.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.151+0000 7fe199ffb700 1 -- 172.21.15.149:0/1167606873 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19c0044c0 con 0x7fe1a415d6d0 2023-11-08T19:25:55.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.151+0000 7fe199ffb700 1 -- 172.21.15.149:0/1167606873 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe19c004660 con 0x7fe1a415d6d0 2023-11-08T19:25:55.161 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.151+0000 7fe199ffb700 1 -- 172.21.15.149:0/1167606873 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19c01d470 con 0x7fe1a415d6d0 2023-11-08T19:25:55.161 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.151+0000 7fe1ab9c7700 1 -- 172.21.15.149:0/1167606873 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1a40b1520 con 0x7fe1a415d6d0 2023-11-08T19:25:55.161 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.151+0000 7fe1ab9c7700 1 -- 172.21.15.149:0/1167606873 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1a40b1ae0 con 0x7fe1a415d6d0 2023-11-08T19:25:55.161 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.152+0000 7fe1ab9c7700 1 -- 172.21.15.149:0/1167606873 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1a40d00c0 con 0x7fe1a415d6d0 2023-11-08T19:25:55.161 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.152+0000 7fe199ffb700 1 -- 172.21.15.149:0/1167606873 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe19c01d5d0 con 0x7fe1a415d6d0 2023-11-08T19:25:55.161 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.153+0000 7fe199ffb700 1 --2- 172.21.15.149:0/1167606873 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe18806af00 0x7fe18806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:55.162 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.153+0000 7fe199ffb700 1 -- 172.21.15.149:0/1167606873 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7120+0+0 (secure 0 0 0) 0x7fe19c08b6f0 con 0x7fe1a415d6d0 2023-11-08T19:25:55.162 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.153+0000 7fe1a9763700 1 --2- 172.21.15.149:0/1167606873 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe18806af00 0x7fe18806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:55.162 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.153+0000 7fe1a9763700 1 --2- 172.21.15.149:0/1167606873 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe18806af00 0x7fe18806d3c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fe1a0007fd0 tx=0x7fe1a0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:55.163 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.157+0000 7fe199ffb700 1 -- 172.21.15.149:0/1167606873 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe19c056220 con 0x7fe1a415d6d0 2023-11-08T19:25:55.397 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.396+0000 7fe1ab9c7700 1 -- 172.21.15.149:0/1167606873 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe1a40745f0 con 0x7fe1a415d6d0 2023-11-08T19:25:55.397 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.396+0000 7fe199ffb700 1 -- 172.21.15.149:0/1167606873 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4927 (secure 0 0 0) 0x7fe19c059840 con 0x7fe1a415d6d0 2023-11-08T19:25:55.398 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:25:55.398 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5800,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/3460600894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3460600894},{"type":"v1","addr":"172.21.15.160:6834","nonce":3460600894}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":6165,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2549531465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2549531465},{"type":"v1","addr":"172.21.15.149:6835","nonce":2549531465}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":6180,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/4179310374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":4179310374},{"type":"v1","addr":"172.21.15.160:6835","nonce":4179310374}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-08T19:25:31.608945+0000","modified":"2023-11-08T19:25:34.626063+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6189},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6189":{"gid":6189,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6837/1548429999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":1548429999},{"type":"v1","addr":"172.21.15.149:6837","nonce":1548429999}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-08T19:25:55.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.398+0000 7fe1ab9c7700 1 -- 172.21.15.149:0/1167606873 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe18806af00 msgr2=0x7fe18806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:55.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.398+0000 7fe1ab9c7700 1 --2- 172.21.15.149:0/1167606873 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe18806af00 0x7fe18806d3c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fe1a0007fd0 tx=0x7fe1a0009040 comp rx=0 tx=0).stop 2023-11-08T19:25:55.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.398+0000 7fe1ab9c7700 1 -- 172.21.15.149:0/1167606873 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1a415d6d0 msgr2=0x7fe1a40c5270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:55.401 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.398+0000 7fe1ab9c7700 1 --2- 172.21.15.149:0/1167606873 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1a415d6d0 0x7fe1a40c5270 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fe19c004000 tx=0x7fe19c004ad0 comp rx=0 tx=0).stop 2023-11-08T19:25:55.401 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.398+0000 7fe1ab9c7700 1 -- 172.21.15.149:0/1167606873 shutdown_connections 2023-11-08T19:25:55.401 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.398+0000 7fe1ab9c7700 1 --2- 172.21.15.149:0/1167606873 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe18806af00 0x7fe18806d3c0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:55.401 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.398+0000 7fe1ab9c7700 1 --2- 172.21.15.149:0/1167606873 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe1a40ce840 0x7fe1a414bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:55.401 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.398+0000 7fe1ab9c7700 1 --2- 172.21.15.149:0/1167606873 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1a415d6d0 0x7fe1a40c5270 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:55.402 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.399+0000 7fe1ab9c7700 1 --2- 172.21.15.149:0/1167606873 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1a415b950 0x7fe1a415d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:55.402 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.399+0000 7fe1ab9c7700 1 -- 172.21.15.149:0/1167606873 >> 172.21.15.149:0/1167606873 conn(0x7fe1a408afd0 msgr2=0x7fe1a41594e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:55.402 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.399+0000 7fe1ab9c7700 1 -- 172.21.15.149:0/1167606873 shutdown_connections 2023-11-08T19:25:55.402 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.399+0000 7fe1ab9c7700 1 -- 172.21.15.149:0/1167606873 wait complete. 2023-11-08T19:25:55.403 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 35 2023-11-08T19:25:55.412 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:25:55.533 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.531+0000 7fee72342700 1 Processor -- start 2023-11-08T19:25:55.533 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.532+0000 7fee72342700 1 -- start start 2023-11-08T19:25:55.535 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.532+0000 7fee72342700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fee6c15b950 0x7fee6c0ce130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:55.536 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.532+0000 7fee72342700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fee6c0cd5e0 0x7fee6c0ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:55.536 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.532+0000 7fee72342700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee6c0cc2e0 con 0x7fee6c0cfd20 2023-11-08T19:25:55.536 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.532+0000 7fee72342700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee6c0cc580 con 0x7fee6c15b950 2023-11-08T19:25:55.536 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.532+0000 7fee72342700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee6c0cc820 con 0x7fee6c0cd5e0 2023-11-08T19:25:55.536 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.532+0000 7fee6bfff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fee6c15b950 0x7fee6c0ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:55.537 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.533+0000 7fee6bfff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fee6c15b950 0x7fee6c0ce130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41882/0 (socket says 172.21.15.149:41882) 2023-11-08T19:25:55.537 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.533+0000 7fee6bfff700 1 -- 172.21.15.149:0/2417511139 learned_addr learned my addr 172.21.15.149:0/2417511139 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:55.537 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.533+0000 7fee6b7fe700 1 --2- 172.21.15.149:0/2417511139 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fee6c0cd5e0 0x7fee6c0ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:55.537 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.533+0000 7fee6bfff700 1 -- 172.21.15.149:0/2417511139 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fee6c0cd5e0 msgr2=0x7fee6c0ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:55.537 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.533+0000 7fee6bfff700 1 --2- 172.21.15.149:0/2417511139 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fee6c0cd5e0 0x7fee6c0ce670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:55.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.533+0000 7fee6bfff700 1 -- 172.21.15.149:0/2417511139 >> v1:172.21.15.160:6789/0 conn(0x7fee6c0cfd20 legacy=0x7fee6c0d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:55.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.533+0000 7fee6bfff700 1 -- 172.21.15.149:0/2417511139 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee6c0ccb00 con 0x7fee6c15b950 2023-11-08T19:25:55.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.533+0000 7fee6bfff700 1 --2- 172.21.15.149:0/2417511139 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee6c15b950 0x7fee6c0ce130 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fee5c006fd0 tx=0x7fee5c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=755b3be39c067ae2 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:55.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.533+0000 7fee6affd700 1 -- 172.21.15.149:0/2417511139 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5c005e30 con 0x7fee6c15b950 2023-11-08T19:25:55.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.533+0000 7fee6affd700 1 -- 172.21.15.149:0/2417511139 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee5c004030 con 0x7fee6c15b950 2023-11-08T19:25:55.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.533+0000 7fee6affd700 1 -- 172.21.15.149:0/2417511139 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5c0043e0 con 0x7fee6c15b950 2023-11-08T19:25:55.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.534+0000 7fee72342700 1 -- 172.21.15.149:0/2417511139 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee6c15b950 msgr2=0x7fee6c0ce130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:55.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.534+0000 7fee72342700 1 --2- 172.21.15.149:0/2417511139 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee6c15b950 0x7fee6c0ce130 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fee5c006fd0 tx=0x7fee5c009bd0 comp rx=0 tx=0).stop 2023-11-08T19:25:55.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.534+0000 7fee72342700 1 -- 172.21.15.149:0/2417511139 shutdown_connections 2023-11-08T19:25:55.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.534+0000 7fee72342700 1 --2- 172.21.15.149:0/2417511139 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee6c15b950 0x7fee6c0ce130 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:55.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.534+0000 7fee72342700 1 --2- 172.21.15.149:0/2417511139 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fee6c0cd5e0 0x7fee6c0ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:55.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.534+0000 7fee72342700 1 -- 172.21.15.149:0/2417511139 >> 172.21.15.149:0/2417511139 conn(0x7fee6c08afd0 msgr2=0x7fee6c0d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:55.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.534+0000 7fee72342700 1 -- 172.21.15.149:0/2417511139 shutdown_connections 2023-11-08T19:25:55.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.534+0000 7fee72342700 1 -- 172.21.15.149:0/2417511139 wait complete. 2023-11-08T19:25:55.543 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.535+0000 7fee72342700 1 Processor -- start 2023-11-08T19:25:55.543 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.535+0000 7fee72342700 1 -- start start 2023-11-08T19:25:55.544 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.536+0000 7fee72342700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fee6c0cfd20 0x7fee6c154fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:55.544 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.536+0000 7fee72342700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fee6c15b950 0x7fee6c0c59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:55.544 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.536+0000 7fee72342700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee6c0c5f10 0x7fee6c0c7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:55.544 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.536+0000 7fee72342700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee6c0ca220 con 0x7fee6c0c5f10 2023-11-08T19:25:55.544 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.536+0000 7fee72342700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee6c0ca410 con 0x7fee6c0cfd20 2023-11-08T19:25:55.545 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.536+0000 7fee72342700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee6c0ca6b0 con 0x7fee6c15b950 2023-11-08T19:25:55.545 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.536+0000 7fee708df700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee6c0c5f10 0x7fee6c0c7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:55.545 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.536+0000 7fee708df700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee6c0c5f10 0x7fee6c0c7730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41892/0 (socket says 172.21.15.149:41892) 2023-11-08T19:25:55.545 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.536+0000 7fee708df700 1 -- 172.21.15.149:0/3827928727 learned_addr learned my addr 172.21.15.149:0/3827928727 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:55.545 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.536+0000 7fee6b7fe700 1 --2- 172.21.15.149:0/3827928727 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fee6c15b950 0x7fee6c0c59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:55.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.536+0000 7fee6bfff700 1 --2- 172.21.15.149:0/3827928727 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fee6c0cfd20 0x7fee6c154fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:55.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.536+0000 7fee708df700 1 -- 172.21.15.149:0/3827928727 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fee6c15b950 msgr2=0x7fee6c0c59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:55.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.536+0000 7fee708df700 1 --2- 172.21.15.149:0/3827928727 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fee6c15b950 0x7fee6c0c59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:55.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.536+0000 7fee708df700 1 -- 172.21.15.149:0/3827928727 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fee6c0cfd20 msgr2=0x7fee6c154fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:55.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.536+0000 7fee708df700 1 --2- 172.21.15.149:0/3827928727 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fee6c0cfd20 0x7fee6c154fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:55.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.536+0000 7fee708df700 1 -- 172.21.15.149:0/3827928727 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee5c009500 con 0x7fee6c0c5f10 2023-11-08T19:25:55.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.536+0000 7fee708df700 1 --2- 172.21.15.149:0/3827928727 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee6c0c5f10 0x7fee6c0c7730 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fee6400cc50 tx=0x7fee6400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:55.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.537+0000 7fee68ff9700 1 -- 172.21.15.149:0/3827928727 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6400ad80 con 0x7fee6c0c5f10 2023-11-08T19:25:55.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.537+0000 7fee68ff9700 1 -- 172.21.15.149:0/3827928727 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee6400ce50 con 0x7fee6c0c5f10 2023-11-08T19:25:55.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.537+0000 7fee72342700 1 -- 172.21.15.149:0/3827928727 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee6c0ca990 con 0x7fee6c0c5f10 2023-11-08T19:25:55.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.537+0000 7fee68ff9700 1 -- 172.21.15.149:0/3827928727 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee64003c40 con 0x7fee6c0c5f10 2023-11-08T19:25:55.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.537+0000 7fee72342700 1 -- 172.21.15.149:0/3827928727 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee6c0caf50 con 0x7fee6c0c5f10 2023-11-08T19:25:55.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.538+0000 7fee72342700 1 -- 172.21.15.149:0/3827928727 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee6c0745f0 con 0x7fee6c0c5f10 2023-11-08T19:25:55.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.538+0000 7fee68ff9700 1 -- 172.21.15.149:0/3827928727 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fee640050d0 con 0x7fee6c0c5f10 2023-11-08T19:25:55.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.538+0000 7fee68ff9700 1 --2- 172.21.15.149:0/3827928727 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fee5806af00 0x7fee5806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:55.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.539+0000 7fee68ff9700 1 -- 172.21.15.149:0/3827928727 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7120+0+0 (secure 0 0 0) 0x7fee64089be0 con 0x7fee6c0c5f10 2023-11-08T19:25:55.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.539+0000 7fee6bfff700 1 --2- 172.21.15.149:0/3827928727 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fee5806af00 0x7fee5806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:55.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.539+0000 7fee6bfff700 1 --2- 172.21.15.149:0/3827928727 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fee5806af00 0x7fee5806d3c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fee5c006fd0 tx=0x7fee5c008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:55.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.543+0000 7fee68ff9700 1 -- 172.21.15.149:0/3827928727 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fee640547a0 con 0x7fee6c0c5f10 2023-11-08T19:25:55.737 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.736+0000 7fee72342700 1 -- 172.21.15.149:0/3827928727 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee6c08b760 con 0x7fee6c0c5f10 2023-11-08T19:25:55.739 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.738+0000 7fee68ff9700 1 -- 172.21.15.149:0/3827928727 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+22093 (secure 0 0 0) 0x7fee64057dc0 con 0x7fee6c0c5f10 2023-11-08T19:25:55.739 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:25:55.740 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":72,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:25:54.113814+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-08T19:24:29.516185+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-08T19:25:29.341646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-08T19:25:30.566751+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-08T19:25:44.287064+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":71,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-08T19:25:45.623521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":12,"snaps":[{"begin":1,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:25:55.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.740+0000 7fee72342700 1 -- 172.21.15.149:0/3827928727 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fee5806af00 msgr2=0x7fee5806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:55.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.740+0000 7fee72342700 1 --2- 172.21.15.149:0/3827928727 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fee5806af00 0x7fee5806d3c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fee5c006fd0 tx=0x7fee5c008070 comp rx=0 tx=0).stop 2023-11-08T19:25:55.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.740+0000 7fee72342700 1 -- 172.21.15.149:0/3827928727 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee6c0c5f10 msgr2=0x7fee6c0c7730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:55.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.740+0000 7fee72342700 1 --2- 172.21.15.149:0/3827928727 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee6c0c5f10 0x7fee6c0c7730 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fee6400cc50 tx=0x7fee6400a340 comp rx=0 tx=0).stop 2023-11-08T19:25:55.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.740+0000 7fee72342700 1 -- 172.21.15.149:0/3827928727 shutdown_connections 2023-11-08T19:25:55.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.740+0000 7fee72342700 1 --2- 172.21.15.149:0/3827928727 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fee5806af00 0x7fee5806d3c0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:55.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.740+0000 7fee72342700 1 --2- 172.21.15.149:0/3827928727 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fee6c0cfd20 0x7fee6c154fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:55.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.740+0000 7fee72342700 1 --2- 172.21.15.149:0/3827928727 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee6c0c5f10 0x7fee6c0c7730 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:55.744 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.740+0000 7fee72342700 1 --2- 172.21.15.149:0/3827928727 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fee6c15b950 0x7fee6c0c59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:55.744 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.740+0000 7fee72342700 1 -- 172.21.15.149:0/3827928727 >> 172.21.15.149:0/3827928727 conn(0x7fee6c08afd0 msgr2=0x7fee6c0afe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:55.744 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.740+0000 7fee72342700 1 -- 172.21.15.149:0/3827928727 shutdown_connections 2023-11-08T19:25:55.745 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.740+0000 7fee72342700 1 -- 172.21.15.149:0/3827928727 wait complete. 2023-11-08T19:25:55.754 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-08T19:25:55.755 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:25:55.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.875+0000 7f83aa496700 1 Processor -- start 2023-11-08T19:25:55.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.875+0000 7f83aa496700 1 -- start start 2023-11-08T19:25:55.879 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.876+0000 7f83aa496700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f83a40cc140 0x7f83a40cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:55.879 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.876+0000 7f83aa496700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f83a40b2cd0 0x7f83a415d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:55.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.876+0000 7f83aa496700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83a40cce50 con 0x7f83a40b2850 2023-11-08T19:25:55.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.876+0000 7f83aa496700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83a40b2430 con 0x7f83a40cc140 2023-11-08T19:25:55.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.876+0000 7f83aa496700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83a40cc520 con 0x7f83a40b2cd0 2023-11-08T19:25:55.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.876+0000 7f83a3fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f83a40cc140 0x7f83a40cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:55.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.876+0000 7f83a3fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f83a40cc140 0x7f83a40cc910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41896/0 (socket says 172.21.15.149:41896) 2023-11-08T19:25:55.881 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.876+0000 7f83a37fe700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f83a40b2850 0x7f83a40cabf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:43898/0 (socket says 172.21.15.149:43898) 2023-11-08T19:25:55.881 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.876+0000 7f83a3fff700 1 -- 172.21.15.149:0/1658901484 learned_addr learned my addr 172.21.15.149:0/1658901484 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:55.881 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.876+0000 7f83a3fff700 1 -- 172.21.15.149:0/1658901484 >> v2:172.21.15.160:3300/0 conn(0x7f83a40b2cd0 msgr2=0x7f83a415d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:55.881 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.876+0000 7f83a8a33700 1 --2- 172.21.15.149:0/1658901484 >> v2:172.21.15.160:3300/0 conn(0x7f83a40b2cd0 0x7f83a415d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:55.882 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.876+0000 7f83a3fff700 1 --2- 172.21.15.149:0/1658901484 >> v2:172.21.15.160:3300/0 conn(0x7f83a40b2cd0 0x7f83a415d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:55.882 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.876+0000 7f83a2ffd700 1 -- 172.21.15.149:0/1658901484 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1874462245 0 0) 0x7f83a40cce50 con 0x7f83a40b2850 2023-11-08T19:25:55.882 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.876+0000 7f83a3fff700 1 -- 172.21.15.149:0/1658901484 >> v1:172.21.15.149:6789/0 conn(0x7f83a40b2850 legacy=0x7f83a40cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:55.882 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.876+0000 7f83a3fff700 1 -- 172.21.15.149:0/1658901484 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a40b17b0 con 0x7f83a40cc140 2023-11-08T19:25:55.885 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.876+0000 7f83a3fff700 1 --2- 172.21.15.149:0/1658901484 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83a40cc140 0x7f83a40cc910 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f83a40c7600 tx=0x7f8398009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce4611797b3662b server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:55.886 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.876+0000 7f83a2ffd700 1 -- 172.21.15.149:0/1658901484 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8398005e30 con 0x7f83a40cc140 2023-11-08T19:25:55.887 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.876+0000 7f83a2ffd700 1 -- 172.21.15.149:0/1658901484 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8398004030 con 0x7f83a40cc140 2023-11-08T19:25:55.887 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.877+0000 7f83a2ffd700 1 -- 172.21.15.149:0/1658901484 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83980043e0 con 0x7f83a40cc140 2023-11-08T19:25:55.887 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.877+0000 7f83aa496700 1 -- 172.21.15.149:0/1658901484 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83a40cc140 msgr2=0x7f83a40cc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:55.888 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.877+0000 7f83aa496700 1 --2- 172.21.15.149:0/1658901484 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83a40cc140 0x7f83a40cc910 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f83a40c7600 tx=0x7f8398009bd0 comp rx=0 tx=0).stop 2023-11-08T19:25:55.888 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.877+0000 7f83aa496700 1 -- 172.21.15.149:0/1658901484 shutdown_connections 2023-11-08T19:25:55.888 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.877+0000 7f83aa496700 1 --2- 172.21.15.149:0/1658901484 >> v2:172.21.15.160:3300/0 conn(0x7f83a40b2cd0 0x7f83a415d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:55.889 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.877+0000 7f83aa496700 1 --2- 172.21.15.149:0/1658901484 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83a40cc140 0x7f83a40cc910 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:55.889 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.877+0000 7f83aa496700 1 -- 172.21.15.149:0/1658901484 >> 172.21.15.149:0/1658901484 conn(0x7f83a4099a40 msgr2=0x7f83a40d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:55.890 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.877+0000 7f83aa496700 1 -- 172.21.15.149:0/1658901484 shutdown_connections 2023-11-08T19:25:55.890 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.877+0000 7f83aa496700 1 -- 172.21.15.149:0/1658901484 wait complete. 2023-11-08T19:25:55.890 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.878+0000 7f83aa496700 1 Processor -- start 2023-11-08T19:25:55.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.878+0000 7f83aa496700 1 -- start start 2023-11-08T19:25:55.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.879+0000 7f83aa496700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f83a40b2850 0x7f83a409a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:55.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.879+0000 7f83aa496700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83a40b2cd0 0x7f83a4151560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:55.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.879+0000 7f83aa496700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f83a40cc140 0x7f83a414e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:55.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.879+0000 7f83aa496700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a406e040 con 0x7f83a40b2cd0 2023-11-08T19:25:55.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.879+0000 7f83aa496700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a4152050 con 0x7f83a40b2850 2023-11-08T19:25:55.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.879+0000 7f83aa496700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83a4152330 con 0x7f83a40cc140 2023-11-08T19:25:55.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.879+0000 7f83a37fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83a40b2cd0 0x7f83a4151560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:55.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.879+0000 7f83a37fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83a40b2cd0 0x7f83a4151560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41902/0 (socket says 172.21.15.149:41902) 2023-11-08T19:25:55.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.879+0000 7f83a37fe700 1 -- 172.21.15.149:0/1614017663 learned_addr learned my addr 172.21.15.149:0/1614017663 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:55.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.879+0000 7f83a3fff700 1 --2- 172.21.15.149:0/1614017663 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f83a40b2850 0x7f83a409a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:55.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.879+0000 7f83a8a33700 1 --2- 172.21.15.149:0/1614017663 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f83a40cc140 0x7f83a414e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:55.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.879+0000 7f83a37fe700 1 -- 172.21.15.149:0/1614017663 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f83a40cc140 msgr2=0x7f83a414e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:55.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.879+0000 7f83a37fe700 1 --2- 172.21.15.149:0/1614017663 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f83a40cc140 0x7f83a414e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:55.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.879+0000 7f83a37fe700 1 -- 172.21.15.149:0/1614017663 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f83a40b2850 msgr2=0x7f83a409a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:55.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.880+0000 7f83a37fe700 1 --2- 172.21.15.149:0/1614017663 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f83a40b2850 0x7f83a409a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:55.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.880+0000 7f83a37fe700 1 -- 172.21.15.149:0/1614017663 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8398009500 con 0x7f83a40b2cd0 2023-11-08T19:25:55.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.880+0000 7f83a37fe700 1 --2- 172.21.15.149:0/1614017663 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83a40b2cd0 0x7f83a4151560 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f839400c550 tx=0x7f839400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:55.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.880+0000 7f83a0ff9700 1 -- 172.21.15.149:0/1614017663 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8394004c80 con 0x7f83a40b2cd0 2023-11-08T19:25:55.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.880+0000 7f83a0ff9700 1 -- 172.21.15.149:0/1614017663 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8394004e00 con 0x7f83a40b2cd0 2023-11-08T19:25:55.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.880+0000 7f83aa496700 1 -- 172.21.15.149:0/1614017663 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83a406e250 con 0x7f83a40b2cd0 2023-11-08T19:25:55.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.880+0000 7f83a0ff9700 1 -- 172.21.15.149:0/1614017663 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8394007310 con 0x7f83a40b2cd0 2023-11-08T19:25:55.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.880+0000 7f83aa496700 1 -- 172.21.15.149:0/1614017663 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83a40adce0 con 0x7f83a40b2cd0 2023-11-08T19:25:55.902 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.881+0000 7f83aa496700 1 -- 172.21.15.149:0/1614017663 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83a406e770 con 0x7f83a40b2cd0 2023-11-08T19:25:55.902 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.881+0000 7f83a0ff9700 1 -- 172.21.15.149:0/1614017663 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8394007470 con 0x7f83a40b2cd0 2023-11-08T19:25:55.902 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.882+0000 7f83a0ff9700 1 --2- 172.21.15.149:0/1614017663 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f839006af00 0x7f839006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:55.902 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.882+0000 7f83a0ff9700 1 -- 172.21.15.149:0/1614017663 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f8394089700 con 0x7f83a40b2cd0 2023-11-08T19:25:55.902 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.882+0000 7f83a3fff700 1 --2- 172.21.15.149:0/1614017663 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f839006af00 0x7f839006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:55.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.882+0000 7f83a3fff700 1 --2- 172.21.15.149:0/1614017663 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f839006af00 0x7f839006d3c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f83a40c7600 tx=0x7f8398008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:55.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:55.886+0000 7f83a0ff9700 1 -- 172.21.15.149:0/1614017663 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f83a406e770 con 0x7f83a40b2cd0 2023-11-08T19:25:56.118 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.117+0000 7f83aa496700 1 -- 172.21.15.149:0/1614017663 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f83a406e770 con 0x7f83a40b2cd0 2023-11-08T19:25:56.119 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.118+0000 7f83a0ff9700 1 -- 172.21.15.149:0/1614017663 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4927 (secure 0 0 0) 0x7f83a406e770 con 0x7f83a40b2cd0 2023-11-08T19:25:56.120 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:25:56.120 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5800,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/3460600894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3460600894},{"type":"v1","addr":"172.21.15.160:6834","nonce":3460600894}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":6165,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2549531465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2549531465},{"type":"v1","addr":"172.21.15.149:6835","nonce":2549531465}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":6180,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/4179310374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":4179310374},{"type":"v1","addr":"172.21.15.160:6835","nonce":4179310374}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-08T19:25:31.608945+0000","modified":"2023-11-08T19:25:34.626063+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6189},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6189":{"gid":6189,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6837/1548429999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":1548429999},{"type":"v1","addr":"172.21.15.149:6837","nonce":1548429999}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-08T19:25:56.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.120+0000 7f83aa496700 1 -- 172.21.15.149:0/1614017663 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f839006af00 msgr2=0x7f839006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:56.122 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.120+0000 7f83aa496700 1 --2- 172.21.15.149:0/1614017663 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f839006af00 0x7f839006d3c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f83a40c7600 tx=0x7f8398008070 comp rx=0 tx=0).stop 2023-11-08T19:25:56.122 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.120+0000 7f83aa496700 1 -- 172.21.15.149:0/1614017663 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83a40b2cd0 msgr2=0x7f83a4151560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:56.122 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.120+0000 7f83aa496700 1 --2- 172.21.15.149:0/1614017663 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83a40b2cd0 0x7f83a4151560 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f839400c550 tx=0x7f839400c860 comp rx=0 tx=0).stop 2023-11-08T19:25:56.122 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.120+0000 7f83aa496700 1 -- 172.21.15.149:0/1614017663 shutdown_connections 2023-11-08T19:25:56.122 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.120+0000 7f83aa496700 1 --2- 172.21.15.149:0/1614017663 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f839006af00 0x7f839006d3c0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:56.123 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.120+0000 7f83aa496700 1 --2- 172.21.15.149:0/1614017663 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f83a40b2850 0x7f83a409a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:56.123 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.120+0000 7f83aa496700 1 --2- 172.21.15.149:0/1614017663 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f83a40cc140 0x7f83a414e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:56.123 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.120+0000 7f83aa496700 1 --2- 172.21.15.149:0/1614017663 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83a40b2cd0 0x7f83a4151560 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:56.123 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.120+0000 7f83aa496700 1 -- 172.21.15.149:0/1614017663 >> 172.21.15.149:0/1614017663 conn(0x7f83a4099a40 msgr2=0x7f83a40c7670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:56.123 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.120+0000 7f83aa496700 1 -- 172.21.15.149:0/1614017663 shutdown_connections 2023-11-08T19:25:56.124 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.120+0000 7f83aa496700 1 -- 172.21.15.149:0/1614017663 wait complete. 2023-11-08T19:25:56.124 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 35 2023-11-08T19:25:56.134 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:25:56.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.256+0000 7f80e295c700 1 Processor -- start 2023-11-08T19:25:56.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.256+0000 7f80e295c700 1 -- start start 2023-11-08T19:25:56.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.257+0000 7f80e295c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f80dc0cc910 0x7f80dc0cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:56.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.257+0000 7f80e295c700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f80dc0cb130 0x7f80dc15d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:56.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.257+0000 7f80e295c700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80dc0b2f60 con 0x7f80dc0cc140 2023-11-08T19:25:56.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.257+0000 7f80e295c700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80dc0b2430 con 0x7f80dc0cb130 2023-11-08T19:25:56.270 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.257+0000 7f80e295c700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80dc0cc520 con 0x7f80dc0cc910 2023-11-08T19:25:56.270 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.257+0000 7f80dbfff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f80dc0cc140 0x7f80dc0b2850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:43910/0 (socket says 172.21.15.149:43910) 2023-11-08T19:25:56.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.257+0000 7f80dbfff700 1 -- 172.21.15.149:0/3974607976 learned_addr learned my addr 172.21.15.149:0/3974607976 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:25:56.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.257+0000 7f80e0ef9700 1 --2- 172.21.15.149:0/3974607976 >> v2:172.21.15.160:3300/0 conn(0x7f80dc0cb130 0x7f80dc15d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:56.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.257+0000 7f80db7fe700 1 --2- 172.21.15.149:0/3974607976 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f80dc0cc910 0x7f80dc0cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:56.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.258+0000 7f80daffd700 1 -- 172.21.15.149:0/3974607976 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1258271505 0 0) 0x7f80dc0b2f60 con 0x7f80dc0cc140 2023-11-08T19:25:56.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.258+0000 7f80daffd700 1 -- 172.21.15.149:0/3974607976 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80c40035b0 con 0x7f80dc0cc140 2023-11-08T19:25:56.273 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.258+0000 7f80daffd700 1 -- 172.21.15.149:0/3974607976 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 229931079 0 0) 0x7f80c40035b0 con 0x7f80dc0cc140 2023-11-08T19:25:56.273 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.258+0000 7f80daffd700 1 -- 172.21.15.149:0/3974607976 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f80dc0cc910 msgr2=0x7f80dc0cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:56.274 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.258+0000 7f80daffd700 1 --2- 172.21.15.149:0/3974607976 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f80dc0cc910 0x7f80dc0cabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:56.274 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.258+0000 7f80daffd700 1 -- 172.21.15.149:0/3974607976 >> v2:172.21.15.160:3300/0 conn(0x7f80dc0cb130 msgr2=0x7f80dc15d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:56.274 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.258+0000 7f80daffd700 1 --2- 172.21.15.149:0/3974607976 >> v2:172.21.15.160:3300/0 conn(0x7f80dc0cb130 0x7f80dc15d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:56.275 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.258+0000 7f80daffd700 1 -- 172.21.15.149:0/3974607976 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80dc0cb5b0 con 0x7f80dc0cc140 2023-11-08T19:25:56.275 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.258+0000 7f80daffd700 1 -- 172.21.15.149:0/3974607976 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f80d00017f0 con 0x7f80dc0cc140 2023-11-08T19:25:56.275 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.258+0000 7f80daffd700 1 -- 172.21.15.149:0/3974607976 >> v1:172.21.15.149:6789/0 conn(0x7f80dc0cc140 legacy=0x7f80dc0b2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:56.276 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.258+0000 7f80daffd700 1 --2- 172.21.15.149:0/3974607976 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f80dc0cc910 0x7f80c4003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:56.276 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.258+0000 7f80daffd700 1 --2- 172.21.15.149:0/3974607976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80c4003f80 0x7f80c4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:56.276 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.258+0000 7f80daffd700 1 --2- 172.21.15.149:0/3974607976 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f80c4004d90 0x7f80c4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:56.276 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.258+0000 7f80daffd700 1 -- 172.21.15.149:0/3974607976 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80dc0b2430 con 0x7f80c4003f80 2023-11-08T19:25:56.277 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.258+0000 7f80daffd700 1 -- 172.21.15.149:0/3974607976 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80dc0cc520 con 0x7f80c4004d90 2023-11-08T19:25:56.277 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.258+0000 7f80daffd700 1 -- 172.21.15.149:0/3974607976 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80c400ba10 con 0x7f80dc0cc910 2023-11-08T19:25:56.277 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.258+0000 7f80e0ef9700 1 --2- 172.21.15.149:0/3974607976 >> v2:172.21.15.160:3300/0 conn(0x7f80dc0cb130 0x7f80dc15d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:25:56.277 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.258+0000 7f80db7fe700 1 --2- 172.21.15.149:0/3974607976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80c4003f80 0x7f80c4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:56.278 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.258+0000 7f80dbfff700 1 --2- 172.21.15.149:0/3974607976 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f80dc0cc910 0x7f80c4003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:56.278 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.258+0000 7f80e0ef9700 1 --2- 172.21.15.149:0/3974607976 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f80c4004d90 0x7f80c4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:56.278 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.258+0000 7f80db7fe700 1 -- 172.21.15.149:0/3974607976 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f80dc0cc910 msgr2=0x7f80c4003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:56.278 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.258+0000 7f80db7fe700 1 --2- 172.21.15.149:0/3974607976 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f80dc0cc910 0x7f80c4003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:56.279 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.258+0000 7f80db7fe700 1 -- 172.21.15.149:0/3974607976 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f80c4004d90 msgr2=0x7f80c4005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:56.279 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.258+0000 7f80db7fe700 1 --2- 172.21.15.149:0/3974607976 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f80c4004d90 0x7f80c4005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:56.279 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.258+0000 7f80db7fe700 1 -- 172.21.15.149:0/3974607976 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c40035b0 con 0x7f80c4003f80 2023-11-08T19:25:56.279 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.258+0000 7f80db7fe700 1 --2- 172.21.15.149:0/3974607976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80c4003f80 0x7f80c4004850 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f80cc009b30 tx=0x7f80c4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2ae592cbe0b4704 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:56.279 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.259+0000 7f80daffd700 1 -- 172.21.15.149:0/3974607976 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80cc00e660 con 0x7f80c4003f80 2023-11-08T19:25:56.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.259+0000 7f80daffd700 1 -- 172.21.15.149:0/3974607976 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80cc00e7c0 con 0x7f80c4003f80 2023-11-08T19:25:56.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.259+0000 7f80daffd700 1 -- 172.21.15.149:0/3974607976 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80cc00eb30 con 0x7f80c4003f80 2023-11-08T19:25:56.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.259+0000 7f80e295c700 1 -- 172.21.15.149:0/3974607976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80c4003f80 msgr2=0x7f80c4004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:56.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.259+0000 7f80e295c700 1 --2- 172.21.15.149:0/3974607976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80c4003f80 0x7f80c4004850 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f80cc009b30 tx=0x7f80c4005880 comp rx=0 tx=0).stop 2023-11-08T19:25:56.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.259+0000 7f80e0ef9700 1 -- 172.21.15.149:0/3974607976 reap_dead start 2023-11-08T19:25:56.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.259+0000 7f80e295c700 1 -- 172.21.15.149:0/3974607976 shutdown_connections 2023-11-08T19:25:56.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.259+0000 7f80e295c700 1 -- 172.21.15.149:0/3974607976 >> 172.21.15.149:0/3974607976 conn(0x7f80dc099a40 msgr2=0x7f80dc0d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:56.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.259+0000 7f80e295c700 1 -- 172.21.15.149:0/3974607976 shutdown_connections 2023-11-08T19:25:56.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.259+0000 7f80e295c700 1 -- 172.21.15.149:0/3974607976 wait complete. 2023-11-08T19:25:56.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.260+0000 7f80e295c700 1 Processor -- start 2023-11-08T19:25:56.283 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.261+0000 7f80e295c700 1 -- start start 2023-11-08T19:25:56.283 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.261+0000 7f80e295c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f80c4003f80 0x7f80dc154aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:56.283 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.261+0000 7f80e295c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80dc0c6780 0x7f80dc0c93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:56.283 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.261+0000 7f80e295c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f80dc0c6c00 0x7f80dc0c9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:56.283 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.261+0000 7f80e295c700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80dc0b58f0 con 0x7f80dc0c6780 2023-11-08T19:25:56.284 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.261+0000 7f80e295c700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80dc0b5bd0 con 0x7f80c4003f80 2023-11-08T19:25:56.284 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.261+0000 7f80e295c700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80dc0b5eb0 con 0x7f80dc0c6c00 2023-11-08T19:25:56.284 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.261+0000 7f80db7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80dc0c6780 0x7f80dc0c93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:56.284 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.261+0000 7f80db7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80dc0c6780 0x7f80dc0c93f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41922/0 (socket says 172.21.15.149:41922) 2023-11-08T19:25:56.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.261+0000 7f80db7fe700 1 -- 172.21.15.149:0/3706458825 learned_addr learned my addr 172.21.15.149:0/3706458825 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:56.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.262+0000 7f80dbfff700 1 --2- 172.21.15.149:0/3706458825 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f80c4003f80 0x7f80dc154aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:56.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.262+0000 7f80e0ef9700 1 --2- 172.21.15.149:0/3706458825 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f80dc0c6c00 0x7f80dc0c9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:56.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.262+0000 7f80db7fe700 1 -- 172.21.15.149:0/3706458825 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f80dc0c6c00 msgr2=0x7f80dc0c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:56.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.262+0000 7f80db7fe700 1 --2- 172.21.15.149:0/3706458825 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f80dc0c6c00 0x7f80dc0c9930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:56.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.262+0000 7f80db7fe700 1 -- 172.21.15.149:0/3706458825 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f80c4003f80 msgr2=0x7f80dc154aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:56.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.262+0000 7f80db7fe700 1 --2- 172.21.15.149:0/3706458825 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f80c4003f80 0x7f80dc154aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:56.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.262+0000 7f80db7fe700 1 -- 172.21.15.149:0/3706458825 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80dc0b6190 con 0x7f80dc0c6780 2023-11-08T19:25:56.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.262+0000 7f80dbfff700 1 --2- 172.21.15.149:0/3706458825 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f80c4003f80 0x7f80dc154aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:25:56.287 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.262+0000 7f80db7fe700 1 --2- 172.21.15.149:0/3706458825 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80dc0c6780 0x7f80dc0c93f0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f80c40046f0 tx=0x7f80cc0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:56.287 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.262+0000 7f80d8ff9700 1 -- 172.21.15.149:0/3706458825 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80cc00e660 con 0x7f80dc0c6780 2023-11-08T19:25:56.287 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.262+0000 7f80d8ff9700 1 -- 172.21.15.149:0/3706458825 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80cc013e30 con 0x7f80dc0c6780 2023-11-08T19:25:56.287 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.262+0000 7f80e295c700 1 -- 172.21.15.149:0/3706458825 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80dc0b58f0 con 0x7f80dc0c6780 2023-11-08T19:25:56.288 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.262+0000 7f80d8ff9700 1 -- 172.21.15.149:0/3706458825 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80cc01c690 con 0x7f80dc0c6780 2023-11-08T19:25:56.289 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.262+0000 7f80e295c700 1 -- 172.21.15.149:0/3706458825 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80dc154fe0 con 0x7f80dc0c6780 2023-11-08T19:25:56.290 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.263+0000 7f80e295c700 1 -- 172.21.15.149:0/3706458825 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80dc0745f0 con 0x7f80dc0c6780 2023-11-08T19:25:56.290 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.263+0000 7f80d8ff9700 1 -- 172.21.15.149:0/3706458825 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f80cc01c7f0 con 0x7f80dc0c6780 2023-11-08T19:25:56.290 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.264+0000 7f80d8ff9700 1 --2- 172.21.15.149:0/3706458825 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f80c806af00 0x7f80c806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:56.291 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.264+0000 7f80dbfff700 1 --2- 172.21.15.149:0/3706458825 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f80c806af00 0x7f80c806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:56.291 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.264+0000 7f80d8ff9700 1 -- 172.21.15.149:0/3706458825 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f80cc08b500 con 0x7f80dc0c6780 2023-11-08T19:25:56.292 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.264+0000 7f80dbfff700 1 --2- 172.21.15.149:0/3706458825 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f80c806af00 0x7f80c806d3c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f80d0000ef0 tx=0x7f80d0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:56.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.269+0000 7f80d8ff9700 1 -- 172.21.15.149:0/3706458825 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f80cc0561e0 con 0x7f80dc0c6780 2023-11-08T19:25:56.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.504+0000 7f80e295c700 1 -- 172.21.15.149:0/3706458825 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f80dc0c7330 con 0x7f80dc0c6780 2023-11-08T19:25:56.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.505+0000 7f80d8ff9700 1 -- 172.21.15.149:0/3706458825 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4927 (secure 0 0 0) 0x7f80cc059800 con 0x7f80dc0c6780 2023-11-08T19:25:56.507 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:25:56.507 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5800,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/3460600894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3460600894},{"type":"v1","addr":"172.21.15.160:6834","nonce":3460600894}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":6165,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2549531465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2549531465},{"type":"v1","addr":"172.21.15.149:6835","nonce":2549531465}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":6180,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/4179310374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":4179310374},{"type":"v1","addr":"172.21.15.160:6835","nonce":4179310374}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-08T19:25:31.608945+0000","modified":"2023-11-08T19:25:34.626063+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6189},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6189":{"gid":6189,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6837/1548429999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":1548429999},{"type":"v1","addr":"172.21.15.149:6837","nonce":1548429999}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-08T19:25:56.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.507+0000 7f80e295c700 1 -- 172.21.15.149:0/3706458825 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f80c806af00 msgr2=0x7f80c806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:56.509 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.507+0000 7f80e295c700 1 --2- 172.21.15.149:0/3706458825 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f80c806af00 0x7f80c806d3c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f80d0000ef0 tx=0x7f80d0009040 comp rx=0 tx=0).stop 2023-11-08T19:25:56.509 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.507+0000 7f80e295c700 1 -- 172.21.15.149:0/3706458825 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80dc0c6780 msgr2=0x7f80dc0c93f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:56.509 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.507+0000 7f80e295c700 1 --2- 172.21.15.149:0/3706458825 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80dc0c6780 0x7f80dc0c93f0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f80c40046f0 tx=0x7f80cc0047c0 comp rx=0 tx=0).stop 2023-11-08T19:25:56.509 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.507+0000 7f80e295c700 1 -- 172.21.15.149:0/3706458825 shutdown_connections 2023-11-08T19:25:56.510 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.507+0000 7f80e295c700 1 --2- 172.21.15.149:0/3706458825 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f80c806af00 0x7f80c806d3c0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:56.510 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.507+0000 7f80e295c700 1 --2- 172.21.15.149:0/3706458825 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f80c4003f80 0x7f80dc154aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:56.510 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.507+0000 7f80e295c700 1 --2- 172.21.15.149:0/3706458825 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f80dc0c6c00 0x7f80dc0c9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:56.510 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.507+0000 7f80e295c700 1 --2- 172.21.15.149:0/3706458825 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80dc0c6780 0x7f80dc0c93f0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:56.510 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.507+0000 7f80e295c700 1 -- 172.21.15.149:0/3706458825 >> 172.21.15.149:0/3706458825 conn(0x7f80dc099a40 msgr2=0x7f80dc0c7670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:56.511 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.507+0000 7f80e295c700 1 -- 172.21.15.149:0/3706458825 shutdown_connections 2023-11-08T19:25:56.511 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.507+0000 7f80e295c700 1 -- 172.21.15.149:0/3706458825 wait complete. 2023-11-08T19:25:56.511 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 35 2023-11-08T19:25:56.520 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:25:56.641 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.640+0000 7f049d033700 1 Processor -- start 2023-11-08T19:25:56.642 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.640+0000 7f049d033700 1 -- start start 2023-11-08T19:25:56.651 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.641+0000 7f049d033700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f04980cc140 0x7f04980cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:56.651 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.641+0000 7f049d033700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f04980b2850 0x7f04980cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:56.652 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.641+0000 7f049d033700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04980cce50 con 0x7f04980b2cd0 2023-11-08T19:25:56.652 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.641+0000 7f049d033700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04980b2430 con 0x7f04980b2850 2023-11-08T19:25:56.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.641+0000 7f049d033700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04980cc520 con 0x7f04980cc140 2023-11-08T19:25:56.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.641+0000 7f049659c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f04980b2850 0x7f04980cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:56.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.641+0000 7f049759e700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f04980b2cd0 0x7f049815d2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:43932/0 (socket says 172.21.15.149:43932) 2023-11-08T19:25:56.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.641+0000 7f049759e700 1 -- 172.21.15.149:0/1920346194 learned_addr learned my addr 172.21.15.149:0/1920346194 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:25:56.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.641+0000 7f049659c700 1 -- 172.21.15.149:0/1920346194 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f04980cc140 msgr2=0x7f04980cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:56.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.641+0000 7f0496d9d700 1 --2- 172.21.15.149:0/1920346194 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f04980cc140 0x7f04980cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:56.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.642+0000 7f049659c700 1 --2- 172.21.15.149:0/1920346194 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f04980cc140 0x7f04980cc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:56.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.642+0000 7f049659c700 1 -- 172.21.15.149:0/1920346194 >> v1:172.21.15.149:6789/0 conn(0x7f04980b2cd0 legacy=0x7f049815d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:56.657 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.642+0000 7f0495d9b700 1 -- 172.21.15.149:0/1920346194 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 976722680 0 0) 0x7f04980cce50 con 0x7f04980b2cd0 2023-11-08T19:25:56.657 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.642+0000 7f049659c700 1 -- 172.21.15.149:0/1920346194 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04980b17b0 con 0x7f04980b2850 2023-11-08T19:25:56.657 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.642+0000 7f0496d9d700 1 --2- 172.21.15.149:0/1920346194 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f04980cc140 0x7f04980cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:25:56.658 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.642+0000 7f049659c700 1 --2- 172.21.15.149:0/1920346194 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04980b2850 0x7f04980cabf0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f0488009840 tx=0x7f0488009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b8247131e08ea9a server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:56.658 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.642+0000 7f0495d9b700 1 -- 172.21.15.149:0/1920346194 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0488011830 con 0x7f04980b2850 2023-11-08T19:25:56.658 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.642+0000 7f0495d9b700 1 -- 172.21.15.149:0/1920346194 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0488011990 con 0x7f04980b2850 2023-11-08T19:25:56.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.642+0000 7f0495d9b700 1 -- 172.21.15.149:0/1920346194 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0488011d20 con 0x7f04980b2850 2023-11-08T19:25:56.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.642+0000 7f049d033700 1 -- 172.21.15.149:0/1920346194 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04980b2850 msgr2=0x7f04980cabf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:56.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.642+0000 7f049d033700 1 --2- 172.21.15.149:0/1920346194 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04980b2850 0x7f04980cabf0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f0488009840 tx=0x7f0488009b50 comp rx=0 tx=0).stop 2023-11-08T19:25:56.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.642+0000 7f049d033700 1 -- 172.21.15.149:0/1920346194 shutdown_connections 2023-11-08T19:25:56.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.642+0000 7f049d033700 1 --2- 172.21.15.149:0/1920346194 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f04980cc140 0x7f04980cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:56.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.642+0000 7f049d033700 1 --2- 172.21.15.149:0/1920346194 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04980b2850 0x7f04980cabf0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:56.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.642+0000 7f049d033700 1 -- 172.21.15.149:0/1920346194 >> 172.21.15.149:0/1920346194 conn(0x7f0498099a40 msgr2=0x7f04980d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:56.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.642+0000 7f049d033700 1 -- 172.21.15.149:0/1920346194 shutdown_connections 2023-11-08T19:25:56.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.642+0000 7f049d033700 1 -- 172.21.15.149:0/1920346194 wait complete. 2023-11-08T19:25:56.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.644+0000 7f049d033700 1 Processor -- start 2023-11-08T19:25:56.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.644+0000 7f049d033700 1 -- start start 2023-11-08T19:25:56.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.645+0000 7f049d033700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04980b2850 0x7f049809dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:56.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.645+0000 7f049d033700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f04980b2cd0 0x7f04980b4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:56.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.645+0000 7f049d033700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04980cc140 0x7f04980cfa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:56.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.645+0000 7f049d033700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04980b5920 con 0x7f04980cc140 2023-11-08T19:25:56.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.645+0000 7f049d033700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04980b5c00 con 0x7f04980b2850 2023-11-08T19:25:56.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.645+0000 7f049d033700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04980b5ee0 con 0x7f04980b2cd0 2023-11-08T19:25:56.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.645+0000 7f049759e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04980cc140 0x7f04980cfa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:56.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.645+0000 7f049759e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04980cc140 0x7f04980cfa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41936/0 (socket says 172.21.15.149:41936) 2023-11-08T19:25:56.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.645+0000 7f049759e700 1 -- 172.21.15.149:0/712357362 learned_addr learned my addr 172.21.15.149:0/712357362 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:56.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.645+0000 7f0496d9d700 1 --2- 172.21.15.149:0/712357362 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04980b2850 0x7f049809dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:56.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.645+0000 7f049659c700 1 --2- 172.21.15.149:0/712357362 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f04980b2cd0 0x7f04980b4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:56.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.645+0000 7f049759e700 1 -- 172.21.15.149:0/712357362 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f04980b2cd0 msgr2=0x7f04980b4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:56.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.645+0000 7f049759e700 1 --2- 172.21.15.149:0/712357362 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f04980b2cd0 0x7f04980b4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:56.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.645+0000 7f049759e700 1 -- 172.21.15.149:0/712357362 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04980b2850 msgr2=0x7f049809dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:56.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.645+0000 7f049759e700 1 --2- 172.21.15.149:0/712357362 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04980b2850 0x7f049809dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:56.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.645+0000 7f049759e700 1 -- 172.21.15.149:0/712357362 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04880094a0 con 0x7f04980cc140 2023-11-08T19:25:56.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.645+0000 7f049659c700 1 --2- 172.21.15.149:0/712357362 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f04980b2cd0 0x7f04980b4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:25:56.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.645+0000 7f049759e700 1 --2- 172.21.15.149:0/712357362 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04980cc140 0x7f04980cfa20 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f0490002230 tx=0x7f049000cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:56.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.645+0000 7f047f7fe700 1 -- 172.21.15.149:0/712357362 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f049000ab70 con 0x7f04980cc140 2023-11-08T19:25:56.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.645+0000 7f047f7fe700 1 -- 172.21.15.149:0/712357362 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f049000acf0 con 0x7f04980cc140 2023-11-08T19:25:56.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.645+0000 7f049d033700 1 -- 172.21.15.149:0/712357362 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04980b61c0 con 0x7f04980cc140 2023-11-08T19:25:56.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.646+0000 7f047f7fe700 1 -- 172.21.15.149:0/712357362 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0490007310 con 0x7f04980cc140 2023-11-08T19:25:56.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.646+0000 7f049d033700 1 -- 172.21.15.149:0/712357362 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f049809e1e0 con 0x7f04980cc140 2023-11-08T19:25:56.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.647+0000 7f049d033700 1 -- 172.21.15.149:0/712357362 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04980ad400 con 0x7f04980cc140 2023-11-08T19:25:56.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.647+0000 7f047f7fe700 1 -- 172.21.15.149:0/712357362 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0490007470 con 0x7f04980cc140 2023-11-08T19:25:56.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.647+0000 7f047f7fe700 1 --2- 172.21.15.149:0/712357362 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f048406af00 0x7f048406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:56.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.647+0000 7f047f7fe700 1 -- 172.21.15.149:0/712357362 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f04900899b0 con 0x7f04980cc140 2023-11-08T19:25:56.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.647+0000 7f0496d9d700 1 --2- 172.21.15.149:0/712357362 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f048406af00 0x7f048406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:56.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.648+0000 7f0496d9d700 1 --2- 172.21.15.149:0/712357362 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f048406af00 0x7f048406d3c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f048c00ab40 tx=0x7f048c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:56.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.652+0000 7f047f7fe700 1 -- 172.21.15.149:0/712357362 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f04900544e0 con 0x7f04980cc140 2023-11-08T19:25:56.846 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.844+0000 7f049d033700 1 -- 172.21.15.149:0/712357362 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f04980b1230 con 0x7f04980cc140 2023-11-08T19:25:56.847 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.846+0000 7f047f7fe700 1 -- 172.21.15.149:0/712357362 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+22093 (secure 0 0 0) 0x7f0490018090 con 0x7f04980cc140 2023-11-08T19:25:56.848 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:25:56.848 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":72,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:25:54.113814+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-08T19:24:29.516185+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-08T19:25:29.341646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-08T19:25:30.566751+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-08T19:25:44.287064+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":71,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-08T19:25:45.623521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":12,"snaps":[{"begin":1,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:25:56.850 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.848+0000 7f049d033700 1 -- 172.21.15.149:0/712357362 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f048406af00 msgr2=0x7f048406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:56.850 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.848+0000 7f049d033700 1 --2- 172.21.15.149:0/712357362 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f048406af00 0x7f048406d3c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f048c00ab40 tx=0x7f048c008040 comp rx=0 tx=0).stop 2023-11-08T19:25:56.851 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.848+0000 7f049d033700 1 -- 172.21.15.149:0/712357362 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04980cc140 msgr2=0x7f04980cfa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:56.851 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.848+0000 7f049d033700 1 --2- 172.21.15.149:0/712357362 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04980cc140 0x7f04980cfa20 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f0490002230 tx=0x7f049000cf50 comp rx=0 tx=0).stop 2023-11-08T19:25:56.852 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.848+0000 7f049d033700 1 -- 172.21.15.149:0/712357362 shutdown_connections 2023-11-08T19:25:56.852 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.848+0000 7f049d033700 1 --2- 172.21.15.149:0/712357362 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f048406af00 0x7f048406d3c0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:56.852 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.848+0000 7f049d033700 1 --2- 172.21.15.149:0/712357362 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04980b2850 0x7f049809dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:56.853 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.848+0000 7f049d033700 1 --2- 172.21.15.149:0/712357362 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04980cc140 0x7f04980cfa20 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:56.853 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.848+0000 7f049d033700 1 --2- 172.21.15.149:0/712357362 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f04980b2cd0 0x7f04980b4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:56.853 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.848+0000 7f049d033700 1 -- 172.21.15.149:0/712357362 >> 172.21.15.149:0/712357362 conn(0x7f0498099a40 msgr2=0x7f0498160d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:56.854 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.848+0000 7f049d033700 1 -- 172.21.15.149:0/712357362 shutdown_connections 2023-11-08T19:25:56.854 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.848+0000 7f049d033700 1 -- 172.21.15.149:0/712357362 wait complete. 2023-11-08T19:25:56.863 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-08T19:25:56.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.984+0000 7f85a5dc6700 1 Processor -- start 2023-11-08T19:25:56.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.984+0000 7f85a5dc6700 1 -- start start 2023-11-08T19:25:56.988 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.984+0000 7f85a5dc6700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f85a00668e0 0x7f85a006bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:56.988 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.984+0000 7f85a5dc6700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85a015f390 con 0x7f85a00b5840 2023-11-08T19:25:56.989 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.984+0000 7f85a5dc6700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85a00b3460 con 0x7f85a015efb0 2023-11-08T19:25:56.989 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.984+0000 7f85a5dc6700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85a00ce0a0 con 0x7f85a00668e0 2023-11-08T19:25:56.989 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.985+0000 7f859ffff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f85a00b5840 0x7f85a00cf140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:43946/0 (socket says 172.21.15.149:43946) 2023-11-08T19:25:56.990 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.985+0000 7f859ffff700 1 -- 172.21.15.149:0/3691940887 learned_addr learned my addr 172.21.15.149:0/3691940887 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:25:56.990 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.985+0000 7f859effd700 1 --2- 172.21.15.149:0/3691940887 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f85a00668e0 0x7f85a006bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:56.990 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.985+0000 7f859e7fc700 1 -- 172.21.15.149:0/3691940887 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 936272399 0 0) 0x7f8598001490 con 0x7f85a00b5840 2023-11-08T19:25:56.990 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.985+0000 7f859e7fc700 1 -- 172.21.15.149:0/3691940887 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f858c0035b0 con 0x7f85a00b5840 2023-11-08T19:25:56.990 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.985+0000 7f859e7fc700 1 -- 172.21.15.149:0/3691940887 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 965927103 0 0) 0x7f85a00b3460 con 0x7f85a015efb0 2023-11-08T19:25:56.991 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.985+0000 7f859e7fc700 1 -- 172.21.15.149:0/3691940887 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8598001490 con 0x7f85a015efb0 2023-11-08T19:25:56.991 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.985+0000 7f859effd700 1 -- 172.21.15.149:0/3691940887 >> v1:172.21.15.160:6789/0 conn(0x7f85a015efb0 legacy=0x7f85a00b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:56.991 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.985+0000 7f859effd700 1 -- 172.21.15.149:0/3691940887 >> v1:172.21.15.149:6789/0 conn(0x7f85a00b5840 legacy=0x7f85a00cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:56.991 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.985+0000 7f859e7fc700 1 -- 172.21.15.149:0/3691940887 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 300841059 0 0) 0x7f858c0035b0 con 0x7f85a00b5840 2023-11-08T19:25:56.992 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.985+0000 7f859effd700 1 -- 172.21.15.149:0/3691940887 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a00ce380 con 0x7f85a00668e0 2023-11-08T19:25:56.992 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.985+0000 7f859effd700 1 --2- 172.21.15.149:0/3691940887 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f85a00668e0 0x7f85a006bb90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8588009870 tx=0x7f8588009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7cba6f2b74f12e7 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:56.992 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.985+0000 7f859e7fc700 1 -- 172.21.15.149:0/3691940887 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8598001b80 con 0x7f85a00668e0 2023-11-08T19:25:56.993 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.985+0000 7f859e7fc700 1 -- 172.21.15.149:0/3691940887 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8588004030 con 0x7f85a00668e0 2023-11-08T19:25:56.993 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.986+0000 7f859e7fc700 1 -- 172.21.15.149:0/3691940887 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85880043a0 con 0x7f85a00668e0 2023-11-08T19:25:56.993 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.986+0000 7f85a5dc6700 1 -- 172.21.15.149:0/3691940887 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f85a00668e0 msgr2=0x7f85a006bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:56.993 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.986+0000 7f85a5dc6700 1 --2- 172.21.15.149:0/3691940887 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f85a00668e0 0x7f85a006bb90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8588009870 tx=0x7f8588009b80 comp rx=0 tx=0).stop 2023-11-08T19:25:56.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.986+0000 7f85a5dc6700 1 -- 172.21.15.149:0/3691940887 shutdown_connections 2023-11-08T19:25:56.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.986+0000 7f85a5dc6700 1 --2- 172.21.15.149:0/3691940887 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f85a00668e0 0x7f85a006bb90 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:56.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.986+0000 7f85a5dc6700 1 -- 172.21.15.149:0/3691940887 >> 172.21.15.149:0/3691940887 conn(0x7f85a0071720 msgr2=0x7f85a0071b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:56.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.986+0000 7f85a5dc6700 1 -- 172.21.15.149:0/3691940887 shutdown_connections 2023-11-08T19:25:56.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.986+0000 7f85a5dc6700 1 -- 172.21.15.149:0/3691940887 wait complete. 2023-11-08T19:25:56.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.987+0000 7f85a5dc6700 1 Processor -- start 2023-11-08T19:25:56.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.987+0000 7f85a5dc6700 1 -- start start 2023-11-08T19:25:56.998 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.988+0000 7f85a5dc6700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85a00668e0 0x7f85a01545e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:56.999 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.988+0000 7f85a5dc6700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f85a00b5840 0x7f85a0156af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:56.999 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.988+0000 7f85a5dc6700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f85a015efb0 0x7f85a0157030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:56.999 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.988+0000 7f85a5dc6700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a0155620 con 0x7f85a00668e0 2023-11-08T19:25:56.999 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.988+0000 7f85a5dc6700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a00c39f0 con 0x7f85a015efb0 2023-11-08T19:25:56.999 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.988+0000 7f85a5dc6700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85a0154b20 con 0x7f85a00b5840 2023-11-08T19:25:57.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.988+0000 7f859f7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85a00668e0 0x7f85a01545e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:57.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.988+0000 7f859f7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85a00668e0 0x7f85a01545e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41946/0 (socket says 172.21.15.149:41946) 2023-11-08T19:25:57.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.988+0000 7f859f7fe700 1 -- 172.21.15.149:0/338045084 learned_addr learned my addr 172.21.15.149:0/338045084 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:57.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.988+0000 7f859effd700 1 --2- 172.21.15.149:0/338045084 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f85a00b5840 0x7f85a0156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:57.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.988+0000 7f859ffff700 1 --2- 172.21.15.149:0/338045084 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f85a015efb0 0x7f85a0157030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:57.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.989+0000 7f859f7fe700 1 -- 172.21.15.149:0/338045084 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f85a00b5840 msgr2=0x7f85a0156af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:57.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.989+0000 7f859f7fe700 1 --2- 172.21.15.149:0/338045084 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f85a00b5840 0x7f85a0156af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:57.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.989+0000 7f859f7fe700 1 -- 172.21.15.149:0/338045084 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f85a015efb0 msgr2=0x7f85a0157030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:57.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.989+0000 7f859f7fe700 1 --2- 172.21.15.149:0/338045084 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f85a015efb0 0x7f85a0157030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:57.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.989+0000 7f859f7fe700 1 -- 172.21.15.149:0/338045084 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85880094a0 con 0x7f85a00668e0 2023-11-08T19:25:57.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.989+0000 7f859f7fe700 1 --2- 172.21.15.149:0/338045084 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85a00668e0 0x7f85a01545e0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f859000c550 tx=0x7f859000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:57.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.989+0000 7f8597fff700 1 -- 172.21.15.149:0/338045084 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85900052d0 con 0x7f85a00668e0 2023-11-08T19:25:57.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.989+0000 7f8597fff700 1 -- 172.21.15.149:0/338045084 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8590005430 con 0x7f85a00668e0 2023-11-08T19:25:57.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.989+0000 7f85a5dc6700 1 -- 172.21.15.149:0/338045084 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85a006f440 con 0x7f85a00668e0 2023-11-08T19:25:57.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.989+0000 7f8597fff700 1 -- 172.21.15.149:0/338045084 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85900038c0 con 0x7f85a00668e0 2023-11-08T19:25:57.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.989+0000 7f85a5dc6700 1 -- 172.21.15.149:0/338045084 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85a00c7250 con 0x7f85a00668e0 2023-11-08T19:25:57.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.990+0000 7f85a5dc6700 1 -- 172.21.15.149:0/338045084 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85a00745f0 con 0x7f85a00668e0 2023-11-08T19:25:57.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.990+0000 7f8597fff700 1 -- 172.21.15.149:0/338045084 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8590003a20 con 0x7f85a00668e0 2023-11-08T19:25:57.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.991+0000 7f8597fff700 1 --2- 172.21.15.149:0/338045084 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f858006af00 0x7f858006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:57.004 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.991+0000 7f8597fff700 1 -- 172.21.15.149:0/338045084 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f8590089020 con 0x7f85a00668e0 2023-11-08T19:25:57.004 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.991+0000 7f859effd700 1 --2- 172.21.15.149:0/338045084 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f858006af00 0x7f858006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:57.004 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.991+0000 7f859effd700 1 --2- 172.21.15.149:0/338045084 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f858006af00 0x7f858006d3c0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f85a0066d00 tx=0x7f8588008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:57.004 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:56.996+0000 7f8597fff700 1 -- 172.21.15.149:0/338045084 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8590053ad0 con 0x7f85a00668e0 2023-11-08T19:25:57.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.228+0000 7f85a5dc6700 1 -- 172.21.15.149:0/338045084 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f85a015e650 con 0x7f85a00668e0 2023-11-08T19:25:57.229 INFO:tasks.ceph.mon.a.smithi149.stderr:2023-11-08T19:25:57.228+0000 7f2b592f2700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-08T19:25:57.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.230+0000 7f8597fff700 1 -- 172.21.15.149:0/338045084 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v36) v1 ==== 161+0+0 (secure 0 0 0) 0x7f85900570f0 con 0x7f85a00668e0 2023-11-08T19:25:57.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.232+0000 7f85a5dc6700 1 -- 172.21.15.149:0/338045084 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f858006af00 msgr2=0x7f858006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:57.234 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.232+0000 7f85a5dc6700 1 --2- 172.21.15.149:0/338045084 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f858006af00 0x7f858006d3c0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f85a0066d00 tx=0x7f8588008030 comp rx=0 tx=0).stop 2023-11-08T19:25:57.234 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.232+0000 7f85a5dc6700 1 -- 172.21.15.149:0/338045084 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85a00668e0 msgr2=0x7f85a01545e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:57.234 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.232+0000 7f85a5dc6700 1 --2- 172.21.15.149:0/338045084 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85a00668e0 0x7f85a01545e0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f859000c550 tx=0x7f859000c860 comp rx=0 tx=0).stop 2023-11-08T19:25:57.234 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.232+0000 7f85a5dc6700 1 -- 172.21.15.149:0/338045084 shutdown_connections 2023-11-08T19:25:57.234 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.232+0000 7f85a5dc6700 1 --2- 172.21.15.149:0/338045084 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f858006af00 0x7f858006d3c0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:57.235 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.232+0000 7f85a5dc6700 1 --2- 172.21.15.149:0/338045084 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f85a015efb0 0x7f85a0157030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:57.235 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.232+0000 7f85a5dc6700 1 --2- 172.21.15.149:0/338045084 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85a00668e0 0x7f85a01545e0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:57.235 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.232+0000 7f85a5dc6700 1 --2- 172.21.15.149:0/338045084 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f85a00b5840 0x7f85a0156af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:57.235 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.232+0000 7f85a5dc6700 1 -- 172.21.15.149:0/338045084 >> 172.21.15.149:0/338045084 conn(0x7f85a0071720 msgr2=0x7f85a00b4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:57.236 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.232+0000 7f85a5dc6700 1 -- 172.21.15.149:0/338045084 shutdown_connections 2023-11-08T19:25:57.236 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.232+0000 7f85a5dc6700 1 -- 172.21.15.149:0/338045084 wait complete. 2023-11-08T19:25:57.236 INFO:teuthology.orchestra.run.smithi149.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-08T19:25:57.237 INFO:tasks.ceph.mds.a.smithi149.stderr: -3169> 2023-11-08T19:25:36.183+0000 7f4c81e8b700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-08T19:25:57.249 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-08T19:25:57.265 INFO:tasks.ceph.mds.a.smithi149.stdout:starting mds.a at 2023-11-08T19:25:57.373 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.372+0000 7fbf8178f700 1 Processor -- start 2023-11-08T19:25:57.373 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.372+0000 7fbf8178f700 1 -- start start 2023-11-08T19:25:57.376 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.372+0000 7fbf8178f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbf7c15f470 0x7fbf7c15c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:57.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.372+0000 7fbf8178f700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fbf7c15cb60 0x7fbf7c0cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:57.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.372+0000 7fbf8178f700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf7c15be80 con 0x7fbf7c0cc0d0 2023-11-08T19:25:57.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.372+0000 7fbf8178f700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf7c0ccbc0 con 0x7fbf7c15cb60 2023-11-08T19:25:57.378 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.372+0000 7fbf8178f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7c15f8d0 con 0x7fbf7c15f470 2023-11-08T19:25:57.378 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.373+0000 7fbf7affd700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fbf7c0cc0d0 0x7fbf7c0cc4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:43968/0 (socket says 172.21.15.149:43968) 2023-11-08T19:25:57.378 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.373+0000 7fbf7affd700 1 -- 172.21.15.149:0/3936532217 learned_addr learned my addr 172.21.15.149:0/3936532217 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:25:57.379 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.373+0000 7fbf7a7fc700 1 --2- 172.21.15.149:0/3936532217 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbf7c15f470 0x7fbf7c15c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:57.379 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.373+0000 7fbf7b7fe700 1 --2- 172.21.15.149:0/3936532217 >> v2:172.21.15.160:3300/0 conn(0x7fbf7c15cb60 0x7fbf7c0cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:57.380 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.373+0000 7fbf79ffb700 1 -- 172.21.15.149:0/3936532217 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1472529922 0 0) 0x7fbf7c15be80 con 0x7fbf7c0cc0d0 2023-11-08T19:25:57.380 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.373+0000 7fbf79ffb700 1 -- 172.21.15.149:0/3936532217 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf680035b0 con 0x7fbf7c0cc0d0 2023-11-08T19:25:57.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.373+0000 7fbf7a7fc700 1 -- 172.21.15.149:0/3936532217 >> v2:172.21.15.160:3300/0 conn(0x7fbf7c15cb60 msgr2=0x7fbf7c0cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:57.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.373+0000 7fbf7a7fc700 1 --2- 172.21.15.149:0/3936532217 >> v2:172.21.15.160:3300/0 conn(0x7fbf7c15cb60 0x7fbf7c0cf320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:57.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.373+0000 7fbf7a7fc700 1 -- 172.21.15.149:0/3936532217 >> v1:172.21.15.149:6789/0 conn(0x7fbf7c0cc0d0 legacy=0x7fbf7c0cc4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:57.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.373+0000 7fbf79ffb700 1 -- 172.21.15.149:0/3936532217 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4228750714 0 0) 0x7fbf680035b0 con 0x7fbf7c0cc0d0 2023-11-08T19:25:57.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.373+0000 7fbf7a7fc700 1 -- 172.21.15.149:0/3936532217 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf7c15fba0 con 0x7fbf7c15f470 2023-11-08T19:25:57.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.373+0000 7fbf7b7fe700 1 --2- 172.21.15.149:0/3936532217 >> v2:172.21.15.160:3300/0 conn(0x7fbf7c15cb60 0x7fbf7c0cf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:25:57.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.373+0000 7fbf7a7fc700 1 --2- 172.21.15.149:0/3936532217 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbf7c15f470 0x7fbf7c15c620 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbf64009840 tx=0x7fbf64009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6bddff2647bde9df server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:57.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.373+0000 7fbf79ffb700 1 -- 172.21.15.149:0/3936532217 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf6c0019f0 con 0x7fbf7c15f470 2023-11-08T19:25:57.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.373+0000 7fbf79ffb700 1 -- 172.21.15.149:0/3936532217 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf64004030 con 0x7fbf7c15f470 2023-11-08T19:25:57.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.373+0000 7fbf79ffb700 1 -- 172.21.15.149:0/3936532217 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf640043c0 con 0x7fbf7c15f470 2023-11-08T19:25:57.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.374+0000 7fbf8178f700 1 -- 172.21.15.149:0/3936532217 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbf7c15f470 msgr2=0x7fbf7c15c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:57.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.374+0000 7fbf8178f700 1 --2- 172.21.15.149:0/3936532217 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbf7c15f470 0x7fbf7c15c620 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbf64009840 tx=0x7fbf64009b50 comp rx=0 tx=0).stop 2023-11-08T19:25:57.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.374+0000 7fbf8178f700 1 -- 172.21.15.149:0/3936532217 shutdown_connections 2023-11-08T19:25:57.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.374+0000 7fbf8178f700 1 --2- 172.21.15.149:0/3936532217 >> v2:172.21.15.160:3300/0 conn(0x7fbf7c15cb60 0x7fbf7c0cf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:57.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.374+0000 7fbf8178f700 1 --2- 172.21.15.149:0/3936532217 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbf7c15f470 0x7fbf7c15c620 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:57.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.374+0000 7fbf8178f700 1 -- 172.21.15.149:0/3936532217 >> 172.21.15.149:0/3936532217 conn(0x7fbf7c06f120 msgr2=0x7fbf7c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:57.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.374+0000 7fbf8178f700 1 -- 172.21.15.149:0/3936532217 shutdown_connections 2023-11-08T19:25:57.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.374+0000 7fbf8178f700 1 -- 172.21.15.149:0/3936532217 wait complete. 2023-11-08T19:25:57.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.375+0000 7fbf8178f700 1 Processor -- start 2023-11-08T19:25:57.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.375+0000 7fbf8178f700 1 -- start start 2023-11-08T19:25:57.388 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.376+0000 7fbf8178f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbf7c0cc0d0 0x7fbf7c0c5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:57.388 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.376+0000 7fbf8178f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf7c15cb60 0x7fbf7c155d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:57.389 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.376+0000 7fbf8178f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbf7c15f470 0x7fbf7c1f0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:57.389 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.376+0000 7fbf8178f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7c0c72f0 con 0x7fbf7c15cb60 2023-11-08T19:25:57.389 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.376+0000 7fbf8178f700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7c0c6420 con 0x7fbf7c15f470 2023-11-08T19:25:57.389 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.376+0000 7fbf8178f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7c0c61d0 con 0x7fbf7c0cc0d0 2023-11-08T19:25:57.389 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.376+0000 7fbf7a7fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf7c15cb60 0x7fbf7c155d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:57.390 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.376+0000 7fbf7a7fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf7c15cb60 0x7fbf7c155d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41974/0 (socket says 172.21.15.149:41974) 2023-11-08T19:25:57.390 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.376+0000 7fbf7a7fc700 1 -- 172.21.15.149:0/1243261927 learned_addr learned my addr 172.21.15.149:0/1243261927 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:57.390 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.376+0000 7fbf7affd700 1 --2- 172.21.15.149:0/1243261927 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbf7c0cc0d0 0x7fbf7c0c5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:57.390 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.376+0000 7fbf7b7fe700 1 --2- 172.21.15.149:0/1243261927 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbf7c15f470 0x7fbf7c1f0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:57.390 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.377+0000 7fbf7a7fc700 1 -- 172.21.15.149:0/1243261927 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbf7c0cc0d0 msgr2=0x7fbf7c0c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:57.391 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.377+0000 7fbf7a7fc700 1 --2- 172.21.15.149:0/1243261927 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbf7c0cc0d0 0x7fbf7c0c5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:57.391 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.377+0000 7fbf7a7fc700 1 -- 172.21.15.149:0/1243261927 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbf7c15f470 msgr2=0x7fbf7c1f0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:57.391 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.377+0000 7fbf7a7fc700 1 --2- 172.21.15.149:0/1243261927 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbf7c15f470 0x7fbf7c1f0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:57.391 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.377+0000 7fbf7a7fc700 1 -- 172.21.15.149:0/1243261927 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf740094a0 con 0x7fbf7c15cb60 2023-11-08T19:25:57.392 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.377+0000 7fbf7a7fc700 1 --2- 172.21.15.149:0/1243261927 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf7c15cb60 0x7fbf7c155d10 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fbf640090b0 tx=0x7fbf64004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:57.392 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.377+0000 7fbf737fe700 1 -- 172.21.15.149:0/1243261927 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf64003a90 con 0x7fbf7c15cb60 2023-11-08T19:25:57.392 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.377+0000 7fbf737fe700 1 -- 172.21.15.149:0/1243261927 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf6401f070 con 0x7fbf7c15cb60 2023-11-08T19:25:57.392 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.377+0000 7fbf8178f700 1 -- 172.21.15.149:0/1243261927 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf640094a0 con 0x7fbf7c15cb60 2023-11-08T19:25:57.393 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.377+0000 7fbf737fe700 1 -- 172.21.15.149:0/1243261927 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf64003e50 con 0x7fbf7c15cb60 2023-11-08T19:25:57.393 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.377+0000 7fbf8178f700 1 -- 172.21.15.149:0/1243261927 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf7c0c6950 con 0x7fbf7c15cb60 2023-11-08T19:25:57.393 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.378+0000 7fbf8178f700 1 -- 172.21.15.149:0/1243261927 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf7c0c7430 con 0x7fbf7c15cb60 2023-11-08T19:25:57.393 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.379+0000 7fbf737fe700 1 -- 172.21.15.149:0/1243261927 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbf64021030 con 0x7fbf7c15cb60 2023-11-08T19:25:57.393 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.379+0000 7fbf737fe700 1 --2- 172.21.15.149:0/1243261927 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fbf5c06af00 0x7fbf5c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:57.394 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.379+0000 7fbf7affd700 1 --2- 172.21.15.149:0/1243261927 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fbf5c06af00 0x7fbf5c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:57.394 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.379+0000 7fbf737fe700 1 -- 172.21.15.149:0/1243261927 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 7178+0+0 (secure 0 0 0) 0x7fbf6408acb0 con 0x7fbf7c15cb60 2023-11-08T19:25:57.394 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.379+0000 7fbf7affd700 1 --2- 172.21.15.149:0/1243261927 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fbf5c06af00 0x7fbf5c06d3c0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c0012e0 tx=0x7fbf6c0015b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:57.394 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.384+0000 7fbf737fe700 1 -- 172.21.15.149:0/1243261927 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbf7c0c7430 con 0x7fbf7c15cb60 2023-11-08T19:25:57.620 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:57.619+0000 7fbf8178f700 1 -- 172.21.15.149:0/1243261927 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fbf7c0c7430 con 0x7fbf7c15cb60 2023-11-08T19:25:58.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.231+0000 7fbf737fe700 1 -- 172.21.15.149:0/1243261927 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v37) v1 ==== 104+0+0 (secure 0 0 0) 0x7fbf7c0c7430 con 0x7fbf7c15cb60 2023-11-08T19:25:58.235 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.234+0000 7fbf8178f700 1 -- 172.21.15.149:0/1243261927 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fbf5c06af00 msgr2=0x7fbf5c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:58.236 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.234+0000 7fbf8178f700 1 --2- 172.21.15.149:0/1243261927 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fbf5c06af00 0x7fbf5c06d3c0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c0012e0 tx=0x7fbf6c0015b0 comp rx=0 tx=0).stop 2023-11-08T19:25:58.236 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.234+0000 7fbf8178f700 1 -- 172.21.15.149:0/1243261927 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf7c15cb60 msgr2=0x7fbf7c155d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:58.236 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.234+0000 7fbf8178f700 1 --2- 172.21.15.149:0/1243261927 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf7c15cb60 0x7fbf7c155d10 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fbf640090b0 tx=0x7fbf64004750 comp rx=0 tx=0).stop 2023-11-08T19:25:58.236 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.235+0000 7fbf8178f700 1 -- 172.21.15.149:0/1243261927 shutdown_connections 2023-11-08T19:25:58.237 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.235+0000 7fbf8178f700 1 --2- 172.21.15.149:0/1243261927 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fbf5c06af00 0x7fbf5c06d3c0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:58.237 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.235+0000 7fbf8178f700 1 --2- 172.21.15.149:0/1243261927 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbf7c15f470 0x7fbf7c1f0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:58.237 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.235+0000 7fbf8178f700 1 --2- 172.21.15.149:0/1243261927 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbf7c0cc0d0 0x7fbf7c0c5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:58.237 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.235+0000 7fbf8178f700 1 --2- 172.21.15.149:0/1243261927 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf7c15cb60 0x7fbf7c155d10 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:58.237 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.235+0000 7fbf8178f700 1 -- 172.21.15.149:0/1243261927 >> 172.21.15.149:0/1243261927 conn(0x7fbf7c06f120 msgr2=0x7fbf7c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:58.238 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.235+0000 7fbf8178f700 1 -- 172.21.15.149:0/1243261927 shutdown_connections 2023-11-08T19:25:58.238 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.235+0000 7fbf8178f700 1 -- 172.21.15.149:0/1243261927 wait complete. 2023-11-08T19:25:58.250 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-08T19:25:58.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.417+0000 7f569c845700 1 Processor -- start 2023-11-08T19:25:58.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.417+0000 7f569c845700 1 -- start start 2023-11-08T19:25:58.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.418+0000 7f569c845700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f569806ab80 0x7f569815cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:58.422 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.418+0000 7f569c845700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f569815bff0 0x7f569815c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:58.422 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.418+0000 7f569c845700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56980cdec0 con 0x7f569806af60 2023-11-08T19:25:58.422 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.418+0000 7f569c845700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56980b2280 con 0x7f569806ab80 2023-11-08T19:25:58.422 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.418+0000 7f569c845700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56980b2560 con 0x7f569815bff0 2023-11-08T19:25:58.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.418+0000 7f569659c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f569806ab80 0x7f569815cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:58.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.418+0000 7f5695d9b700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f569806af60 0x7f5698070210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:43984/0 (socket says 172.21.15.149:43984) 2023-11-08T19:25:58.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.418+0000 7f569659c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f569806ab80 0x7f569815cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41982/0 (socket says 172.21.15.149:41982) 2023-11-08T19:25:58.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.418+0000 7f5695d9b700 1 -- 172.21.15.149:0/2002502810 learned_addr learned my addr 172.21.15.149:0/2002502810 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:25:58.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.418+0000 7f5696d9d700 1 --2- 172.21.15.149:0/2002502810 >> v2:172.21.15.160:3300/0 conn(0x7f569815bff0 0x7f569815c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:58.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.418+0000 7f569559a700 1 -- 172.21.15.149:0/2002502810 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1418839246 0 0) 0x7f56980cdec0 con 0x7f569806af60 2023-11-08T19:25:58.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.418+0000 7f569559a700 1 -- 172.21.15.149:0/2002502810 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56800035b0 con 0x7f569806af60 2023-11-08T19:25:58.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.418+0000 7f569659c700 1 -- 172.21.15.149:0/2002502810 >> v2:172.21.15.160:3300/0 conn(0x7f569815bff0 msgr2=0x7f569815c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:58.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.418+0000 7f569659c700 1 --2- 172.21.15.149:0/2002502810 >> v2:172.21.15.160:3300/0 conn(0x7f569815bff0 0x7f569815c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:58.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.418+0000 7f569659c700 1 -- 172.21.15.149:0/2002502810 >> v1:172.21.15.149:6789/0 conn(0x7f569806af60 legacy=0x7f5698070210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:58.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.418+0000 7f569659c700 1 -- 172.21.15.149:0/2002502810 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56980b2840 con 0x7f569806ab80 2023-11-08T19:25:58.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.418+0000 7f569659c700 1 --2- 172.21.15.149:0/2002502810 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f569806ab80 0x7f569815cf90 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f569806db60 tx=0x7f5688009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=885de884f9239cde server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:58.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.419+0000 7f569559a700 1 -- 172.21.15.149:0/2002502810 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5688011830 con 0x7f569806ab80 2023-11-08T19:25:58.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.419+0000 7f569559a700 1 -- 172.21.15.149:0/2002502810 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5688011990 con 0x7f569806ab80 2023-11-08T19:25:58.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.419+0000 7f569559a700 1 -- 172.21.15.149:0/2002502810 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5688011d20 con 0x7f569806ab80 2023-11-08T19:25:58.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.419+0000 7f569c845700 1 -- 172.21.15.149:0/2002502810 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f569806ab80 msgr2=0x7f569815cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:58.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.419+0000 7f569c845700 1 --2- 172.21.15.149:0/2002502810 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f569806ab80 0x7f569815cf90 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f569806db60 tx=0x7f5688009b20 comp rx=0 tx=0).stop 2023-11-08T19:25:58.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.419+0000 7f569c845700 1 -- 172.21.15.149:0/2002502810 shutdown_connections 2023-11-08T19:25:58.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.419+0000 7f569c845700 1 --2- 172.21.15.149:0/2002502810 >> v2:172.21.15.160:3300/0 conn(0x7f569815bff0 0x7f569815c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:58.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.419+0000 7f569c845700 1 --2- 172.21.15.149:0/2002502810 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f569806ab80 0x7f569815cf90 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:58.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.419+0000 7f569c845700 1 -- 172.21.15.149:0/2002502810 >> 172.21.15.149:0/2002502810 conn(0x7f56980cd0e0 msgr2=0x7f56980cd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:58.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.419+0000 7f569c845700 1 -- 172.21.15.149:0/2002502810 shutdown_connections 2023-11-08T19:25:58.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.419+0000 7f569c845700 1 -- 172.21.15.149:0/2002502810 wait complete. 2023-11-08T19:25:58.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.421+0000 7f569c845700 1 Processor -- start 2023-11-08T19:25:58.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.421+0000 7f569c845700 1 -- start start 2023-11-08T19:25:58.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.421+0000 7f569c845700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f569806ab80 0x7f5698154ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:58.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.421+0000 7f569c845700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f569806af60 0x7f56980c8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:58.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.421+0000 7f569c845700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f569815bff0 0x7f56981f0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:58.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.421+0000 7f569c845700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5698157d70 con 0x7f569806af60 2023-11-08T19:25:58.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.421+0000 7f569c845700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56981577b0 con 0x7f569815bff0 2023-11-08T19:25:58.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.421+0000 7f569c845700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5698157a90 con 0x7f569806ab80 2023-11-08T19:25:58.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.422+0000 7f5695d9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f569806af60 0x7f56980c8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:58.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.422+0000 7f5695d9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f569806af60 0x7f56980c8f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41988/0 (socket says 172.21.15.149:41988) 2023-11-08T19:25:58.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.422+0000 7f5695d9b700 1 -- 172.21.15.149:0/3558964845 learned_addr learned my addr 172.21.15.149:0/3558964845 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:58.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.422+0000 7f5696d9d700 1 --2- 172.21.15.149:0/3558964845 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f569815bff0 0x7f56981f0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:58.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.422+0000 7f5695d9b700 1 -- 172.21.15.149:0/3558964845 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f569806ab80 msgr2=0x7f5698154ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:58.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.422+0000 7f569659c700 1 --2- 172.21.15.149:0/3558964845 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f569806ab80 0x7f5698154ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:58.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.422+0000 7f5695d9b700 1 --2- 172.21.15.149:0/3558964845 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f569806ab80 0x7f5698154ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:58.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.422+0000 7f5695d9b700 1 -- 172.21.15.149:0/3558964845 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f569815bff0 msgr2=0x7f56981f0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:58.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.422+0000 7f5695d9b700 1 --2- 172.21.15.149:0/3558964845 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f569815bff0 0x7f56981f0350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:58.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.422+0000 7f5695d9b700 1 -- 172.21.15.149:0/3558964845 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56880094a0 con 0x7f569806af60 2023-11-08T19:25:58.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.422+0000 7f5695d9b700 1 --2- 172.21.15.149:0/3558964845 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f569806af60 0x7f56980c8f70 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f568c00c700 tx=0x7f568c00cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:58.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.422+0000 7f5686ffd700 1 -- 172.21.15.149:0/3558964845 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568c005d70 con 0x7f569806af60 2023-11-08T19:25:58.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.422+0000 7f5686ffd700 1 -- 172.21.15.149:0/3558964845 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f568c0070d0 con 0x7f569806af60 2023-11-08T19:25:58.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.422+0000 7f5686ffd700 1 -- 172.21.15.149:0/3558964845 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568c007460 con 0x7f569806af60 2023-11-08T19:25:58.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.422+0000 7f569c845700 1 -- 172.21.15.149:0/3558964845 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56980c8770 con 0x7f569806af60 2023-11-08T19:25:58.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.422+0000 7f569c845700 1 -- 172.21.15.149:0/3558964845 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5698155000 con 0x7f569806af60 2023-11-08T19:25:58.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.423+0000 7f569c845700 1 -- 172.21.15.149:0/3558964845 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56980c8c90 con 0x7f569806af60 2023-11-08T19:25:58.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.424+0000 7f5686ffd700 1 -- 172.21.15.149:0/3558964845 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f568c0075c0 con 0x7f569806af60 2023-11-08T19:25:58.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.424+0000 7f5686ffd700 1 --2- 172.21.15.149:0/3558964845 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f567806af00 0x7f567806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:58.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.424+0000 7f569659c700 1 --2- 172.21.15.149:0/3558964845 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f567806af00 0x7f567806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:58.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.424+0000 7f5686ffd700 1 -- 172.21.15.149:0/3558964845 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 7178+0+0 (secure 0 0 0) 0x7f568c089170 con 0x7f569806af60 2023-11-08T19:25:58.438 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.424+0000 7f569659c700 1 --2- 172.21.15.149:0/3558964845 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f567806af00 0x7f567806d3c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f56880090b0 tx=0x7f5688008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:58.438 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.429+0000 7f5686ffd700 1 -- 172.21.15.149:0/3558964845 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f56980c8c90 con 0x7f569806af60 2023-11-08T19:25:58.619 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:58.618+0000 7f569c845700 1 -- 172.21.15.149:0/3558964845 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f56980c8c90 con 0x7f569806af60 2023-11-08T19:25:59.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.312+0000 7f5686ffd700 1 -- 172.21.15.149:0/3558964845 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v74) v1 ==== 181+0+0 (secure 0 0 0) 0x7f56980c8c90 con 0x7f569806af60 2023-11-08T19:25:59.316 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.315+0000 7f569c845700 1 -- 172.21.15.149:0/3558964845 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f567806af00 msgr2=0x7f567806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:59.317 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.315+0000 7f569c845700 1 --2- 172.21.15.149:0/3558964845 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f567806af00 0x7f567806d3c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f56880090b0 tx=0x7f5688008030 comp rx=0 tx=0).stop 2023-11-08T19:25:59.317 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.315+0000 7f569c845700 1 -- 172.21.15.149:0/3558964845 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f569806af60 msgr2=0x7f56980c8f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:59.317 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.315+0000 7f569c845700 1 --2- 172.21.15.149:0/3558964845 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f569806af60 0x7f56980c8f70 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f568c00c700 tx=0x7f568c00cac0 comp rx=0 tx=0).stop 2023-11-08T19:25:59.318 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.316+0000 7f569c845700 1 -- 172.21.15.149:0/3558964845 shutdown_connections 2023-11-08T19:25:59.318 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.316+0000 7f569c845700 1 --2- 172.21.15.149:0/3558964845 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f567806af00 0x7f567806d3c0 secure :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f56880090b0 tx=0x7f5688008030 comp rx=0 tx=0).stop 2023-11-08T19:25:59.319 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.316+0000 7f569c845700 1 --2- 172.21.15.149:0/3558964845 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f569815bff0 0x7f56981f0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:59.319 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.316+0000 7f569c845700 1 --2- 172.21.15.149:0/3558964845 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f569806ab80 0x7f5698154ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:59.319 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.316+0000 7f569c845700 1 --2- 172.21.15.149:0/3558964845 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f569806af60 0x7f56980c8f70 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:59.319 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.316+0000 7f569c845700 1 -- 172.21.15.149:0/3558964845 >> 172.21.15.149:0/3558964845 conn(0x7f56980cd0e0 msgr2=0x7f569815ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:59.319 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.316+0000 7f569c845700 1 -- 172.21.15.149:0/3558964845 shutdown_connections 2023-11-08T19:25:59.320 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.316+0000 7f569c845700 1 -- 172.21.15.149:0/3558964845 wait complete. 2023-11-08T19:25:59.320 INFO:teuthology.orchestra.run.smithi149.stderr:pool 'cephfs_metadata' removed 2023-11-08T19:25:59.332 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-08T19:25:59.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.457+0000 7f337f295700 1 Processor -- start 2023-11-08T19:25:59.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.458+0000 7f337f295700 1 -- start start 2023-11-08T19:25:59.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.458+0000 7f337f295700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3378072cd0 0x7f337806ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:59.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.458+0000 7f337f295700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f337806b0c0 0x7f3378161730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:59.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.458+0000 7f337f295700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33780700d0 con 0x7f337815dcd0 2023-11-08T19:25:59.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.458+0000 7f337f295700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f337815e0b0 con 0x7f3378072cd0 2023-11-08T19:25:59.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.458+0000 7f337f295700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f337806b510 con 0x7f337806b0c0 2023-11-08T19:25:59.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.459+0000 7f337c830700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3378072cd0 0x7f337806ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:59.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.459+0000 7f337c830700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3378072cd0 0x7f337806ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41996/0 (socket says 172.21.15.149:41996) 2023-11-08T19:25:59.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.459+0000 7f337c830700 1 -- 172.21.15.149:0/714928511 learned_addr learned my addr 172.21.15.149:0/714928511 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:59.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.459+0000 7f337d832700 1 --2- 172.21.15.149:0/714928511 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f337806b0c0 0x7f3378161730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:59.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.459+0000 7f337c830700 1 -- 172.21.15.149:0/714928511 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f337806b0c0 msgr2=0x7f3378161730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:59.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.459+0000 7f337c830700 1 --2- 172.21.15.149:0/714928511 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f337806b0c0 0x7f3378161730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:59.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.459+0000 7f337c830700 1 -- 172.21.15.149:0/714928511 >> v1:172.21.15.160:6789/0 conn(0x7f337815dcd0 legacy=0x7f3378070470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:25:59.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.459+0000 7f337c830700 1 -- 172.21.15.149:0/714928511 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f337806fdf0 con 0x7f3378072cd0 2023-11-08T19:25:59.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.459+0000 7f337c830700 1 --2- 172.21.15.149:0/714928511 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3378072cd0 0x7f337806ab80 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f33740098f0 tx=0x7f3374009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6874f8a88d0fcd99 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:59.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.459+0000 7f336ffff700 1 -- 172.21.15.149:0/714928511 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3374004230 con 0x7f3378072cd0 2023-11-08T19:25:59.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.459+0000 7f336ffff700 1 -- 172.21.15.149:0/714928511 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3374004390 con 0x7f3378072cd0 2023-11-08T19:25:59.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.459+0000 7f336ffff700 1 -- 172.21.15.149:0/714928511 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33740036a0 con 0x7f3378072cd0 2023-11-08T19:25:59.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.460+0000 7f337f295700 1 -- 172.21.15.149:0/714928511 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3378072cd0 msgr2=0x7f337806ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:59.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.460+0000 7f337f295700 1 --2- 172.21.15.149:0/714928511 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3378072cd0 0x7f337806ab80 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f33740098f0 tx=0x7f3374009c00 comp rx=0 tx=0).stop 2023-11-08T19:25:59.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.460+0000 7f337f295700 1 -- 172.21.15.149:0/714928511 shutdown_connections 2023-11-08T19:25:59.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.460+0000 7f337f295700 1 --2- 172.21.15.149:0/714928511 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f337806b0c0 0x7f3378161730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:59.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.460+0000 7f337f295700 1 --2- 172.21.15.149:0/714928511 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3378072cd0 0x7f337806ab80 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:59.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.460+0000 7f337f295700 1 -- 172.21.15.149:0/714928511 >> 172.21.15.149:0/714928511 conn(0x7f33780cd0e0 msgr2=0x7f33780cd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:25:59.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.460+0000 7f337f295700 1 -- 172.21.15.149:0/714928511 shutdown_connections 2023-11-08T19:25:59.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.460+0000 7f337f295700 1 -- 172.21.15.149:0/714928511 wait complete. 2023-11-08T19:25:59.469 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.461+0000 7f337f295700 1 Processor -- start 2023-11-08T19:25:59.470 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.461+0000 7f337f295700 1 -- start start 2023-11-08T19:25:59.470 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.462+0000 7f337f295700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f337806b0c0 0x7f337815ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:59.470 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.462+0000 7f337f295700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3378072cd0 0x7f33780ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:59.471 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.462+0000 7f337f295700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f337815dcd0 0x7f33780aeb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:59.471 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.462+0000 7f337f295700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33780b3d60 con 0x7f337806b0c0 2023-11-08T19:25:59.471 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.462+0000 7f337f295700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33780ad2a0 con 0x7f337815dcd0 2023-11-08T19:25:59.471 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.462+0000 7f337f295700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33780b4000 con 0x7f3378072cd0 2023-11-08T19:25:59.472 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.462+0000 7f337d031700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f337806b0c0 0x7f337815ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:59.472 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.462+0000 7f337d031700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f337806b0c0 0x7f337815ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42000/0 (socket says 172.21.15.149:42000) 2023-11-08T19:25:59.472 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.462+0000 7f337d031700 1 -- 172.21.15.149:0/2314345641 learned_addr learned my addr 172.21.15.149:0/2314345641 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:25:59.472 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.462+0000 7f337c830700 1 --2- 172.21.15.149:0/2314345641 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3378072cd0 0x7f33780ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:59.472 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.462+0000 7f337d832700 1 --2- 172.21.15.149:0/2314345641 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f337815dcd0 0x7f33780aeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:59.473 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.462+0000 7f337d031700 1 -- 172.21.15.149:0/2314345641 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3378072cd0 msgr2=0x7f33780ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:59.473 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.462+0000 7f337d031700 1 --2- 172.21.15.149:0/2314345641 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3378072cd0 0x7f33780ac8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:59.473 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.462+0000 7f337d031700 1 -- 172.21.15.149:0/2314345641 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f337815dcd0 msgr2=0x7f33780aeb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:25:59.473 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.462+0000 7f337d031700 1 --2- 172.21.15.149:0/2314345641 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f337815dcd0 0x7f33780aeb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:25:59.473 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.462+0000 7f337d031700 1 -- 172.21.15.149:0/2314345641 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3374009550 con 0x7f337806b0c0 2023-11-08T19:25:59.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.462+0000 7f337c830700 1 --2- 172.21.15.149:0/2314345641 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3378072cd0 0x7f33780ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:25:59.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.462+0000 7f337d031700 1 --2- 172.21.15.149:0/2314345641 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f337806b0c0 0x7f337815ac00 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f336800b4a0 tx=0x7f336800b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:59.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.462+0000 7f336dffb700 1 -- 172.21.15.149:0/2314345641 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3368011830 con 0x7f337806b0c0 2023-11-08T19:25:59.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.463+0000 7f336dffb700 1 -- 172.21.15.149:0/2314345641 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3368011990 con 0x7f337806b0c0 2023-11-08T19:25:59.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.463+0000 7f337f295700 1 -- 172.21.15.149:0/2314345641 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33780b42e0 con 0x7f337806b0c0 2023-11-08T19:25:59.475 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.463+0000 7f336dffb700 1 -- 172.21.15.149:0/2314345641 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3368011d40 con 0x7f337806b0c0 2023-11-08T19:25:59.475 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.463+0000 7f337f295700 1 -- 172.21.15.149:0/2314345641 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33780ad580 con 0x7f337806b0c0 2023-11-08T19:25:59.475 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.464+0000 7f337f295700 1 -- 172.21.15.149:0/2314345641 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33780745f0 con 0x7f337806b0c0 2023-11-08T19:25:59.475 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.464+0000 7f336dffb700 1 -- 172.21.15.149:0/2314345641 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f336801a400 con 0x7f337806b0c0 2023-11-08T19:25:59.475 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.464+0000 7f336dffb700 1 --2- 172.21.15.149:0/2314345641 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f335c06aed0 0x7f335c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:25:59.476 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.465+0000 7f336dffb700 1 -- 172.21.15.149:0/2314345641 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6740+0+0 (secure 0 0 0) 0x7f33680896a0 con 0x7f337806b0c0 2023-11-08T19:25:59.476 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.465+0000 7f337c830700 1 --2- 172.21.15.149:0/2314345641 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f335c06aed0 0x7f335c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:25:59.476 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.465+0000 7f337c830700 1 --2- 172.21.15.149:0/2314345641 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f335c06aed0 0x7f335c06d390 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3374009130 tx=0x7f3374008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:25:59.476 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.469+0000 7f336dffb700 1 -- 172.21.15.149:0/2314345641 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3368054350 con 0x7f337806b0c0 2023-11-08T19:25:59.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:25:59.666+0000 7f337f295700 1 -- 172.21.15.149:0/2314345641 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f33780b65e0 con 0x7f337806b0c0 2023-11-08T19:26:00.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.319+0000 7f336dffb700 1 -- 172.21.15.149:0/2314345641 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v75) v1 ==== 169+0+0 (secure 0 0 0) 0x7f3368057970 con 0x7f337806b0c0 2023-11-08T19:26:00.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.324+0000 7f337f295700 1 -- 172.21.15.149:0/2314345641 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f335c06aed0 msgr2=0x7f335c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:00.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.324+0000 7f337f295700 1 --2- 172.21.15.149:0/2314345641 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f335c06aed0 0x7f335c06d390 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3374009130 tx=0x7f3374008030 comp rx=0 tx=0).stop 2023-11-08T19:26:00.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.324+0000 7f337f295700 1 -- 172.21.15.149:0/2314345641 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f337806b0c0 msgr2=0x7f337815ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:00.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.324+0000 7f337f295700 1 --2- 172.21.15.149:0/2314345641 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f337806b0c0 0x7f337815ac00 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f336800b4a0 tx=0x7f336800b860 comp rx=0 tx=0).stop 2023-11-08T19:26:00.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.324+0000 7f337f295700 1 -- 172.21.15.149:0/2314345641 shutdown_connections 2023-11-08T19:26:00.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.324+0000 7f337f295700 1 --2- 172.21.15.149:0/2314345641 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f335c06aed0 0x7f335c06d390 secure :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3374009130 tx=0x7f3374008030 comp rx=0 tx=0).stop 2023-11-08T19:26:00.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.324+0000 7f337f295700 1 --2- 172.21.15.149:0/2314345641 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f337815dcd0 0x7f33780aeb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:00.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.324+0000 7f337f295700 1 --2- 172.21.15.149:0/2314345641 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f337806b0c0 0x7f337815ac00 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:00.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.324+0000 7f337f295700 1 --2- 172.21.15.149:0/2314345641 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3378072cd0 0x7f33780ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:00.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.324+0000 7f337f295700 1 -- 172.21.15.149:0/2314345641 >> 172.21.15.149:0/2314345641 conn(0x7f33780cd0e0 msgr2=0x7f33780c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:00.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.324+0000 7f337f295700 1 -- 172.21.15.149:0/2314345641 shutdown_connections 2023-11-08T19:26:00.328 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.324+0000 7f337f295700 1 -- 172.21.15.149:0/2314345641 wait complete. 2023-11-08T19:26:00.328 INFO:teuthology.orchestra.run.smithi149.stderr:pool 'cephfs_data' removed 2023-11-08T19:26:00.339 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-08T19:26:00.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.464+0000 7f2c33c05700 1 Processor -- start 2023-11-08T19:26:00.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.464+0000 7f2c33c05700 1 -- start start 2023-11-08T19:26:00.468 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.464+0000 7f2c33c05700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2c2c15df40 0x7f2c2c06c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:00.468 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.465+0000 7f2c33c05700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f2c2c06ab80 0x7f2c2c06c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:00.468 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.465+0000 7f2c33c05700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c2c15e320 con 0x7f2c2c0cf1c0 2023-11-08T19:26:00.468 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.465+0000 7f2c33c05700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c2c06b020 con 0x7f2c2c15df40 2023-11-08T19:26:00.468 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.465+0000 7f2c33c05700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c2c06b2e0 con 0x7f2c2c06ab80 2023-11-08T19:26:00.469 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.465+0000 7f2c319a1700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2c2c15df40 0x7f2c2c06c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:00.469 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.465+0000 7f2c319a1700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2c2c15df40 0x7f2c2c06c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42008/0 (socket says 172.21.15.149:42008) 2023-11-08T19:26:00.469 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.465+0000 7f2c319a1700 1 -- 172.21.15.149:0/20300370 learned_addr learned my addr 172.21.15.149:0/20300370 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:00.469 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.465+0000 7f2c319a1700 1 -- 172.21.15.149:0/20300370 >> v2:172.21.15.160:3300/0 conn(0x7f2c2c06ab80 msgr2=0x7f2c2c06c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:00.470 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.465+0000 7f2c311a0700 1 --2- 172.21.15.149:0/20300370 >> v2:172.21.15.160:3300/0 conn(0x7f2c2c06ab80 0x7f2c2c06c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:00.470 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.465+0000 7f2c319a1700 1 --2- 172.21.15.149:0/20300370 >> v2:172.21.15.160:3300/0 conn(0x7f2c2c06ab80 0x7f2c2c06c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:00.470 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.465+0000 7f2c319a1700 1 -- 172.21.15.149:0/20300370 >> v1:172.21.15.160:6789/0 conn(0x7f2c2c0cf1c0 legacy=0x7f2c2c0caf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:00.470 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.465+0000 7f2c319a1700 1 -- 172.21.15.149:0/20300370 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c2c06b5c0 con 0x7f2c2c15df40 2023-11-08T19:26:00.470 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.465+0000 7f2c311a0700 1 --2- 172.21.15.149:0/20300370 >> v2:172.21.15.160:3300/0 conn(0x7f2c2c06ab80 0x7f2c2c06c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:26:00.471 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.465+0000 7f2c319a1700 1 --2- 172.21.15.149:0/20300370 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c2c15df40 0x7f2c2c06c0a0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c06d940 tx=0x7f2c1c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff95c9bc078b9e4b server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:00.471 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.465+0000 7f2c3099f700 1 -- 172.21.15.149:0/20300370 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1c004230 con 0x7f2c2c15df40 2023-11-08T19:26:00.471 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.465+0000 7f2c3099f700 1 -- 172.21.15.149:0/20300370 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c1c004390 con 0x7f2c2c15df40 2023-11-08T19:26:00.471 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.465+0000 7f2c3099f700 1 -- 172.21.15.149:0/20300370 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1c0036a0 con 0x7f2c2c15df40 2023-11-08T19:26:00.471 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.466+0000 7f2c33c05700 1 -- 172.21.15.149:0/20300370 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c2c15df40 msgr2=0x7f2c2c06c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:00.472 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.466+0000 7f2c33c05700 1 --2- 172.21.15.149:0/20300370 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c2c15df40 0x7f2c2c06c0a0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c06d940 tx=0x7f2c1c009bd0 comp rx=0 tx=0).stop 2023-11-08T19:26:00.472 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.466+0000 7f2c33c05700 1 -- 172.21.15.149:0/20300370 shutdown_connections 2023-11-08T19:26:00.472 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.466+0000 7f2c33c05700 1 --2- 172.21.15.149:0/20300370 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c2c15df40 0x7f2c2c06c0a0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:00.472 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.466+0000 7f2c33c05700 1 --2- 172.21.15.149:0/20300370 >> v2:172.21.15.160:3300/0 conn(0x7f2c2c06ab80 0x7f2c2c06c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:00.472 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.466+0000 7f2c33c05700 1 -- 172.21.15.149:0/20300370 >> 172.21.15.149:0/20300370 conn(0x7f2c2c0d0640 msgr2=0x7f2c2c0d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:00.472 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.466+0000 7f2c33c05700 1 -- 172.21.15.149:0/20300370 shutdown_connections 2023-11-08T19:26:00.473 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.466+0000 7f2c33c05700 1 -- 172.21.15.149:0/20300370 wait complete. 2023-11-08T19:26:00.475 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.467+0000 7f2c33c05700 1 Processor -- start 2023-11-08T19:26:00.476 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.467+0000 7f2c33c05700 1 -- start start 2023-11-08T19:26:00.476 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.468+0000 7f2c33c05700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2c2c06ab80 0x7f2c2c157b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:00.476 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.468+0000 7f2c33c05700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2c2c0cf1c0 0x7f2c2c0c5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:00.476 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.468+0000 7f2c33c05700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c2c15df40 0x7f2c2c1604c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:00.476 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.468+0000 7f2c33c05700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2c0c6b40 con 0x7f2c2c15df40 2023-11-08T19:26:00.477 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.468+0000 7f2c33c05700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2c158070 con 0x7f2c2c06ab80 2023-11-08T19:26:00.477 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.468+0000 7f2c33c05700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2c0c5f30 con 0x7f2c2c0cf1c0 2023-11-08T19:26:00.477 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.468+0000 7f2c321a2700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c2c15df40 0x7f2c2c1604c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:00.477 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.468+0000 7f2c321a2700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c2c15df40 0x7f2c2c1604c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42018/0 (socket says 172.21.15.149:42018) 2023-11-08T19:26:00.477 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.468+0000 7f2c321a2700 1 -- 172.21.15.149:0/1700075196 learned_addr learned my addr 172.21.15.149:0/1700075196 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:00.478 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.468+0000 7f2c319a1700 1 --2- 172.21.15.149:0/1700075196 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2c2c06ab80 0x7f2c2c157b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:00.478 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.468+0000 7f2c311a0700 1 --2- 172.21.15.149:0/1700075196 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2c2c0cf1c0 0x7f2c2c0c5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:00.478 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.468+0000 7f2c321a2700 1 -- 172.21.15.149:0/1700075196 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2c2c0cf1c0 msgr2=0x7f2c2c0c5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:00.478 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.468+0000 7f2c321a2700 1 --2- 172.21.15.149:0/1700075196 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2c2c0cf1c0 0x7f2c2c0c5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:00.478 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.468+0000 7f2c321a2700 1 -- 172.21.15.149:0/1700075196 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2c2c06ab80 msgr2=0x7f2c2c157b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:00.479 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.468+0000 7f2c321a2700 1 --2- 172.21.15.149:0/1700075196 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2c2c06ab80 0x7f2c2c157b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:00.479 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.468+0000 7f2c321a2700 1 -- 172.21.15.149:0/1700075196 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c1c009550 con 0x7f2c2c15df40 2023-11-08T19:26:00.479 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.469+0000 7f2c321a2700 1 --2- 172.21.15.149:0/1700075196 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c2c15df40 0x7f2c2c1604c0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f2c2400cc10 tx=0x7f2c2400cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:00.479 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.469+0000 7f2c227fc700 1 -- 172.21.15.149:0/1700075196 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c24004b90 con 0x7f2c2c15df40 2023-11-08T19:26:00.479 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.469+0000 7f2c227fc700 1 -- 172.21.15.149:0/1700075196 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c24004cf0 con 0x7f2c2c15df40 2023-11-08T19:26:00.480 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.469+0000 7f2c33c05700 1 -- 172.21.15.149:0/1700075196 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c2c0c6210 con 0x7f2c2c15df40 2023-11-08T19:26:00.480 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.469+0000 7f2c227fc700 1 -- 172.21.15.149:0/1700075196 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c2400aae0 con 0x7f2c2c15df40 2023-11-08T19:26:00.481 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.469+0000 7f2c33c05700 1 -- 172.21.15.149:0/1700075196 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c2c0c67d0 con 0x7f2c2c15df40 2023-11-08T19:26:00.481 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.470+0000 7f2c33c05700 1 -- 172.21.15.149:0/1700075196 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c2c04f730 con 0x7f2c2c15df40 2023-11-08T19:26:00.481 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.470+0000 7f2c227fc700 1 -- 172.21.15.149:0/1700075196 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2c2400ac40 con 0x7f2c2c15df40 2023-11-08T19:26:00.481 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.470+0000 7f2c227fc700 1 --2- 172.21.15.149:0/1700075196 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2c1006af00 0x7f2c1006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:00.482 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.471+0000 7f2c227fc700 1 -- 172.21.15.149:0/1700075196 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6326+0+0 (secure 0 0 0) 0x7f2c24089220 con 0x7f2c2c15df40 2023-11-08T19:26:00.482 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.471+0000 7f2c319a1700 1 --2- 172.21.15.149:0/1700075196 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2c1006af00 0x7f2c1006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:00.482 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.471+0000 7f2c319a1700 1 --2- 172.21.15.149:0/1700075196 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2c1006af00 0x7f2c1006d3c0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c009130 tx=0x7f2c1c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:00.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.475+0000 7f2c227fc700 1 -- 172.21.15.149:0/1700075196 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2c24054060 con 0x7f2c2c15df40 2023-11-08T19:26:00.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.664+0000 7f2c33c05700 1 -- 172.21.15.149:0/1700075196 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f2c2c0c6c80 con 0x7f2c2c15df40 2023-11-08T19:26:00.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.667+0000 7f2c227fc700 1 -- 172.21.15.149:0/1700075196 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v16) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2c24057680 con 0x7f2c2c15df40 2023-11-08T19:26:00.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.670+0000 7f2c33c05700 1 -- 172.21.15.149:0/1700075196 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2c1006af00 msgr2=0x7f2c1006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:00.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.670+0000 7f2c33c05700 1 --2- 172.21.15.149:0/1700075196 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2c1006af00 0x7f2c1006d3c0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c009130 tx=0x7f2c1c008030 comp rx=0 tx=0).stop 2023-11-08T19:26:00.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.670+0000 7f2c33c05700 1 -- 172.21.15.149:0/1700075196 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c2c15df40 msgr2=0x7f2c2c1604c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:00.672 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.670+0000 7f2c33c05700 1 --2- 172.21.15.149:0/1700075196 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c2c15df40 0x7f2c2c1604c0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f2c2400cc10 tx=0x7f2c2400cf20 comp rx=0 tx=0).stop 2023-11-08T19:26:00.672 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.670+0000 7f2c33c05700 1 -- 172.21.15.149:0/1700075196 shutdown_connections 2023-11-08T19:26:00.672 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.670+0000 7f2c33c05700 1 --2- 172.21.15.149:0/1700075196 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2c1006af00 0x7f2c1006d3c0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:00.672 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.670+0000 7f2c33c05700 1 --2- 172.21.15.149:0/1700075196 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2c2c06ab80 0x7f2c2c157b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:00.672 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.670+0000 7f2c33c05700 1 --2- 172.21.15.149:0/1700075196 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c2c15df40 0x7f2c2c1604c0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:00.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.670+0000 7f2c33c05700 1 --2- 172.21.15.149:0/1700075196 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2c2c0cf1c0 0x7f2c2c0c5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:00.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.670+0000 7f2c33c05700 1 -- 172.21.15.149:0/1700075196 >> 172.21.15.149:0/1700075196 conn(0x7f2c2c0d0640 msgr2=0x7f2c2c158c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:00.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.670+0000 7f2c33c05700 1 -- 172.21.15.149:0/1700075196 shutdown_connections 2023-11-08T19:26:00.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.670+0000 7f2c33c05700 1 -- 172.21.15.149:0/1700075196 wait complete. 2023-11-08T19:26:00.683 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_using_pool_with_snap_fails_fs_creation' 2023-11-08T19:26:00.804 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.803+0000 7ff0ad55c700 1 Processor -- start 2023-11-08T19:26:00.804 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.803+0000 7ff0ad55c700 1 -- start start 2023-11-08T19:26:00.808 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.803+0000 7ff0ad55c700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7ff0a8161a50 0x7ff0a8161f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:00.808 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.803+0000 7ff0ad55c700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0a80d1a10 con 0x7ff0a80ce500 2023-11-08T19:26:00.809 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.803+0000 7ff0ad55c700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0a80d1cf0 con 0x7ff0a8161670 2023-11-08T19:26:00.809 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.803+0000 7ff0ad55c700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0a80d1fd0 con 0x7ff0a8161a50 2023-11-08T19:26:00.809 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.804+0000 7ff0a77fe700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7ff0a80ce500 0x7ff0a80ce970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:44028/0 (socket says 172.21.15.149:44028) 2023-11-08T19:26:00.809 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.804+0000 7ff0a77fe700 1 -- 172.21.15.149:0/2301375248 learned_addr learned my addr 172.21.15.149:0/2301375248 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:26:00.809 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.804+0000 7ff0a67fc700 1 --2- 172.21.15.149:0/2301375248 >> v2:172.21.15.160:3300/0 conn(0x7ff0a8161a50 0x7ff0a8161f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:00.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.804+0000 7ff0a5ffb700 1 -- 172.21.15.149:0/2301375248 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 154230545 0 0) 0x7ff0a80d1a10 con 0x7ff0a80ce500 2023-11-08T19:26:00.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.804+0000 7ff0a5ffb700 1 -- 172.21.15.149:0/2301375248 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0900035b0 con 0x7ff0a80ce500 2023-11-08T19:26:00.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.804+0000 7ff0a5ffb700 1 -- 172.21.15.149:0/2301375248 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2950368368 0 0) 0x7ff0a80d1cf0 con 0x7ff0a8161670 2023-11-08T19:26:00.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.804+0000 7ff0a5ffb700 1 -- 172.21.15.149:0/2301375248 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0a80d1a10 con 0x7ff0a8161670 2023-11-08T19:26:00.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.804+0000 7ff0a5ffb700 1 -- 172.21.15.149:0/2301375248 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1127503478 0 0) 0x7ff0900035b0 con 0x7ff0a80ce500 2023-11-08T19:26:00.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.804+0000 7ff0a5ffb700 1 -- 172.21.15.149:0/2301375248 >> v2:172.21.15.160:3300/0 conn(0x7ff0a8161a50 msgr2=0x7ff0a8161f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:00.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.804+0000 7ff0a5ffb700 1 --2- 172.21.15.149:0/2301375248 >> v2:172.21.15.160:3300/0 conn(0x7ff0a8161a50 0x7ff0a8161f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:00.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.804+0000 7ff0a5ffb700 1 -- 172.21.15.149:0/2301375248 >> v1:172.21.15.160:6789/0 conn(0x7ff0a8161670 legacy=0x7ff0a80b5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:00.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.804+0000 7ff0a5ffb700 1 -- 172.21.15.149:0/2301375248 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a80d22b0 con 0x7ff0a80ce500 2023-11-08T19:26:00.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.804+0000 7ff0a5ffb700 1 -- 172.21.15.149:0/2301375248 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7ff0a00019f0 con 0x7ff0a80ce500 2023-11-08T19:26:00.812 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.804+0000 7ff0a5ffb700 1 -- 172.21.15.149:0/2301375248 >> v1:172.21.15.149:6789/0 conn(0x7ff0a80ce500 legacy=0x7ff0a80ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:00.812 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.804+0000 7ff0a5ffb700 1 --2- 172.21.15.149:0/2301375248 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff090003b90 0x7ff090003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:00.812 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.804+0000 7ff0a5ffb700 1 --2- 172.21.15.149:0/2301375248 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff090004850 0x7ff090004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:00.812 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.804+0000 7ff0a5ffb700 1 --2- 172.21.15.149:0/2301375248 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff090005210 0x7ff09000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:00.813 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.804+0000 7ff0a5ffb700 1 -- 172.21.15.149:0/2301375248 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a80d1fd0 con 0x7ff090004850 2023-11-08T19:26:00.813 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.804+0000 7ff0a5ffb700 1 -- 172.21.15.149:0/2301375248 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff09000c090 con 0x7ff090003b90 2023-11-08T19:26:00.813 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.804+0000 7ff0a5ffb700 1 -- 172.21.15.149:0/2301375248 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff09000c250 con 0x7ff090005210 2023-11-08T19:26:00.813 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.804+0000 7ff0a67fc700 1 --2- 172.21.15.149:0/2301375248 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff090004850 0x7ff090004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:00.813 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.804+0000 7ff0a6ffd700 1 --2- 172.21.15.149:0/2301375248 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff090003b90 0x7ff090003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:00.814 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.804+0000 7ff0a77fe700 1 --2- 172.21.15.149:0/2301375248 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff090005210 0x7ff09000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:00.814 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.805+0000 7ff0a67fc700 1 -- 172.21.15.149:0/2301375248 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff090005210 msgr2=0x7ff09000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:00.814 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.805+0000 7ff0a67fc700 1 --2- 172.21.15.149:0/2301375248 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff090005210 0x7ff09000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:00.814 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.805+0000 7ff0a67fc700 1 -- 172.21.15.149:0/2301375248 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff090003b90 msgr2=0x7ff090003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:00.814 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.805+0000 7ff0a67fc700 1 --2- 172.21.15.149:0/2301375248 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff090003b90 0x7ff090003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:00.815 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.805+0000 7ff0a67fc700 1 -- 172.21.15.149:0/2301375248 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0900035b0 con 0x7ff090004850 2023-11-08T19:26:00.815 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.805+0000 7ff0a77fe700 1 --2- 172.21.15.149:0/2301375248 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff090005210 0x7ff09000ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:26:00.815 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.805+0000 7ff0a77fe700 1 -- 172.21.15.149:0/2301375248 reap_dead start 2023-11-08T19:26:00.815 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.805+0000 7ff0a67fc700 1 --2- 172.21.15.149:0/2301375248 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff090004850 0x7ff090004cd0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7ff098009b60 tx=0x7ff090005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=138bbed1a90ab2c2 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:00.815 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.805+0000 7ff0a5ffb700 1 -- 172.21.15.149:0/2301375248 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff09800e6c0 con 0x7ff090004850 2023-11-08T19:26:00.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.805+0000 7ff0a5ffb700 1 -- 172.21.15.149:0/2301375248 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff09800e820 con 0x7ff090004850 2023-11-08T19:26:00.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.805+0000 7ff0a5ffb700 1 -- 172.21.15.149:0/2301375248 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff09800eb90 con 0x7ff090004850 2023-11-08T19:26:00.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.805+0000 7ff0ad55c700 1 -- 172.21.15.149:0/2301375248 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff090004850 msgr2=0x7ff090004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:00.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.805+0000 7ff0ad55c700 1 --2- 172.21.15.149:0/2301375248 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff090004850 0x7ff090004cd0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7ff098009b60 tx=0x7ff090005880 comp rx=0 tx=0).stop 2023-11-08T19:26:00.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.805+0000 7ff0ad55c700 1 -- 172.21.15.149:0/2301375248 shutdown_connections 2023-11-08T19:26:00.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.805+0000 7ff0ad55c700 1 --2- 172.21.15.149:0/2301375248 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff090004850 0x7ff090004cd0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:00.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.805+0000 7ff0ad55c700 1 -- 172.21.15.149:0/2301375248 >> 172.21.15.149:0/2301375248 conn(0x7ff0a80d3980 msgr2=0x7ff0a80d3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:00.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.805+0000 7ff0ad55c700 1 -- 172.21.15.149:0/2301375248 shutdown_connections 2023-11-08T19:26:00.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.805+0000 7ff0ad55c700 1 -- 172.21.15.149:0/2301375248 wait complete. 2023-11-08T19:26:00.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.807+0000 7ff0ad55c700 1 Processor -- start 2023-11-08T19:26:00.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.807+0000 7ff0ad55c700 1 -- start start 2023-11-08T19:26:00.820 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.808+0000 7ff0ad55c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff090004850 0x7ff0a815c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:00.820 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.808+0000 7ff0ad55c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0a815d080 0x7ff0a80cb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:00.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.808+0000 7ff0ad55c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0a81f4180 0x7ff0a81f4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:00.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.808+0000 7ff0ad55c700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a80cc950 con 0x7ff0a81f4180 2023-11-08T19:26:00.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.808+0000 7ff0ad55c700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a80ccd70 con 0x7ff0a815d080 2023-11-08T19:26:00.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.808+0000 7ff0ad55c700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a80cbcd0 con 0x7ff090004850 2023-11-08T19:26:00.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.808+0000 7ff0a77fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0a81f4180 0x7ff0a81f4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:00.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.808+0000 7ff0a77fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0a81f4180 0x7ff0a81f4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42038/0 (socket says 172.21.15.149:42038) 2023-11-08T19:26:00.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.808+0000 7ff0a77fe700 1 -- 172.21.15.149:0/2578400470 learned_addr learned my addr 172.21.15.149:0/2578400470 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:00.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.808+0000 7ff0a6ffd700 1 --2- 172.21.15.149:0/2578400470 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff090004850 0x7ff0a815c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:00.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.808+0000 7ff0a77fe700 1 -- 172.21.15.149:0/2578400470 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff090004850 msgr2=0x7ff0a815c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:00.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.808+0000 7ff0a77fe700 1 --2- 172.21.15.149:0/2578400470 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff090004850 0x7ff0a815c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:00.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.808+0000 7ff0a77fe700 1 -- 172.21.15.149:0/2578400470 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0a815d080 msgr2=0x7ff0a80cb3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:00.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.808+0000 7ff0a77fe700 1 --2- 172.21.15.149:0/2578400470 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0a815d080 0x7ff0a80cb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:00.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.808+0000 7ff0a77fe700 1 -- 172.21.15.149:0/2578400470 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a80cbfb0 con 0x7ff0a81f4180 2023-11-08T19:26:00.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.808+0000 7ff0a77fe700 1 --2- 172.21.15.149:0/2578400470 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0a81f4180 0x7ff0a81f4610 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7ff0a0001780 tx=0x7ff0a0007c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:00.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.808+0000 7ff08f7fe700 1 -- 172.21.15.149:0/2578400470 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a000ec60 con 0x7ff0a81f4180 2023-11-08T19:26:00.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.808+0000 7ff08f7fe700 1 -- 172.21.15.149:0/2578400470 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0a000edc0 con 0x7ff0a81f4180 2023-11-08T19:26:00.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.808+0000 7ff08f7fe700 1 -- 172.21.15.149:0/2578400470 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a0013640 con 0x7ff0a81f4180 2023-11-08T19:26:00.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.808+0000 7ff0ad55c700 1 -- 172.21.15.149:0/2578400470 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0a80cc290 con 0x7ff0a81f4180 2023-11-08T19:26:00.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.808+0000 7ff0ad55c700 1 -- 172.21.15.149:0/2578400470 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0a815ccc0 con 0x7ff0a81f4180 2023-11-08T19:26:00.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.809+0000 7ff0ad55c700 1 -- 172.21.15.149:0/2578400470 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0a80cca90 con 0x7ff0a81f4180 2023-11-08T19:26:00.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.810+0000 7ff08f7fe700 1 -- 172.21.15.149:0/2578400470 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff0a00137a0 con 0x7ff0a81f4180 2023-11-08T19:26:00.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.810+0000 7ff08f7fe700 1 --2- 172.21.15.149:0/2578400470 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff09406af00 0x7ff09406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:00.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.810+0000 7ff0a6ffd700 1 --2- 172.21.15.149:0/2578400470 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff09406af00 0x7ff09406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:00.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.810+0000 7ff08f7fe700 1 -- 172.21.15.149:0/2578400470 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6326+0+0 (secure 0 0 0) 0x7ff0a0089dd0 con 0x7ff0a81f4180 2023-11-08T19:26:00.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.811+0000 7ff0a6ffd700 1 --2- 172.21.15.149:0/2578400470 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff09406af00 0x7ff09406d3c0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff0a80b8b70 tx=0x7ff09c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:00.826 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:00.815+0000 7ff08f7fe700 1 -- 172.21.15.149:0/2578400470 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff0a80cca90 con 0x7ff0a81f4180 2023-11-08T19:26:01.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.089+0000 7ff0ad55c700 1 -- 172.21.15.149:0/2578400470 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_using_pool_with_snap_fails_fs_creation"]} v 0) v1 -- 0x7ff0a80cca90 con 0x7ff0a81f4180 2023-11-08T19:26:01.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.321+0000 7ff08f7fe700 1 -- 172.21.15.149:0/2578400470 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_using_pool_with_snap_fails_fs_creation"]}]=0 v189) v1 ==== 173+0+0 (secure 0 0 0) 0x7ff0a80cca90 con 0x7ff0a81f4180 2023-11-08T19:26:01.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.323+0000 7ff0ad55c700 1 -- 172.21.15.149:0/2578400470 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff09406af00 msgr2=0x7ff09406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:01.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.323+0000 7ff0ad55c700 1 --2- 172.21.15.149:0/2578400470 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff09406af00 0x7ff09406d3c0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff0a80b8b70 tx=0x7ff09c009040 comp rx=0 tx=0).stop 2023-11-08T19:26:01.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.323+0000 7ff0ad55c700 1 -- 172.21.15.149:0/2578400470 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0a81f4180 msgr2=0x7ff0a81f4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:01.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.323+0000 7ff0ad55c700 1 --2- 172.21.15.149:0/2578400470 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0a81f4180 0x7ff0a81f4610 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7ff0a0001780 tx=0x7ff0a0007c90 comp rx=0 tx=0).stop 2023-11-08T19:26:01.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.323+0000 7ff0ad55c700 1 -- 172.21.15.149:0/2578400470 shutdown_connections 2023-11-08T19:26:01.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.323+0000 7ff0ad55c700 1 --2- 172.21.15.149:0/2578400470 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff09406af00 0x7ff09406d3c0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:01.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.323+0000 7ff0ad55c700 1 --2- 172.21.15.149:0/2578400470 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0a81f4180 0x7ff0a81f4610 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:01.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.323+0000 7ff0ad55c700 1 --2- 172.21.15.149:0/2578400470 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff090004850 0x7ff0a815c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:01.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.323+0000 7ff0ad55c700 1 --2- 172.21.15.149:0/2578400470 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0a815d080 0x7ff0a80cb3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:01.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.323+0000 7ff0ad55c700 1 -- 172.21.15.149:0/2578400470 >> 172.21.15.149:0/2578400470 conn(0x7ff0a80d3980 msgr2=0x7ff0a815fff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:01.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.323+0000 7ff0ad55c700 1 -- 172.21.15.149:0/2578400470 shutdown_connections 2023-11-08T19:26:01.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.323+0000 7ff0ad55c700 1 -- 172.21.15.149:0/2578400470 wait complete. 2023-11-08T19:26:01.337 INFO:tasks.cephfs_test_runner:Test that using a pool with snaps for fs creation fails ... ok 2023-11-08T19:26:01.337 INFO:tasks.cephfs_test_runner:Starting test: test_allow_new_snaps_config (tasks.cephfs.test_snapshots.TestSnapshots) Check whether 'allow_new_snaps' setting works 2023-11-08T19:26:01.338 INFO:tasks.cephfs_test_runner:test_allow_new_snaps_config (tasks.cephfs.test_snapshots.TestSnapshots) 2023-11-08T19:26:01.338 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:26:01.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.458+0000 7f71fa946700 1 Processor -- start 2023-11-08T19:26:01.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.458+0000 7f71fa946700 1 -- start start 2023-11-08T19:26:01.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.458+0000 7f71fa946700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f71f415b950 0x7f71f40ce130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:01.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.458+0000 7f71fa946700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71f40cc2e0 con 0x7f71f40d0430 2023-11-08T19:26:01.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.459+0000 7f71fa946700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71f40cc580 con 0x7f71f40cd5e0 2023-11-08T19:26:01.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.459+0000 7f71fa946700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71f40cc820 con 0x7f71f415b950 2023-11-08T19:26:01.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.459+0000 7f71f3fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f71f415b950 0x7f71f40ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:01.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.459+0000 7f71f8ee3700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f71f40d0430 0x7f71f41658e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:44048/0 (socket says 172.21.15.149:44048) 2023-11-08T19:26:01.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.459+0000 7f71f8ee3700 1 -- 172.21.15.149:0/2164139593 learned_addr learned my addr 172.21.15.149:0/2164139593 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:26:01.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.459+0000 7f71f3fff700 1 -- 172.21.15.149:0/2164139593 >> v1:172.21.15.160:6789/0 conn(0x7f71f40cd5e0 legacy=0x7f71f40cfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:01.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.459+0000 7f71f3fff700 1 -- 172.21.15.149:0/2164139593 >> v1:172.21.15.149:6789/0 conn(0x7f71f40d0430 legacy=0x7f71f41658e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:01.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.459+0000 7f71f3fff700 1 -- 172.21.15.149:0/2164139593 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f40ccb00 con 0x7f71f415b950 2023-11-08T19:26:01.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.459+0000 7f71f3fff700 1 --2- 172.21.15.149:0/2164139593 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71f415b950 0x7f71f40ce130 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f71e4009820 tx=0x7f71e4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bb8ea89e3792a73 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:01.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.459+0000 7f71f2ffd700 1 -- 172.21.15.149:0/2164139593 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e4005e30 con 0x7f71f415b950 2023-11-08T19:26:01.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.459+0000 7f71f2ffd700 1 -- 172.21.15.149:0/2164139593 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e4006030 con 0x7f71f415b950 2023-11-08T19:26:01.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.459+0000 7f71f2ffd700 1 -- 172.21.15.149:0/2164139593 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e40063e0 con 0x7f71f415b950 2023-11-08T19:26:01.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.460+0000 7f71fa946700 1 -- 172.21.15.149:0/2164139593 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71f415b950 msgr2=0x7f71f40ce130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:01.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.460+0000 7f71fa946700 1 --2- 172.21.15.149:0/2164139593 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71f415b950 0x7f71f40ce130 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f71e4009820 tx=0x7f71e4009b30 comp rx=0 tx=0).stop 2023-11-08T19:26:01.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.460+0000 7f71fa946700 1 -- 172.21.15.149:0/2164139593 shutdown_connections 2023-11-08T19:26:01.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.460+0000 7f71fa946700 1 --2- 172.21.15.149:0/2164139593 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71f415b950 0x7f71f40ce130 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:01.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.460+0000 7f71fa946700 1 -- 172.21.15.149:0/2164139593 >> 172.21.15.149:0/2164139593 conn(0x7f71f408afd0 msgr2=0x7f71f40d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:01.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.460+0000 7f71fa946700 1 -- 172.21.15.149:0/2164139593 shutdown_connections 2023-11-08T19:26:01.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.460+0000 7f71fa946700 1 -- 172.21.15.149:0/2164139593 wait complete. 2023-11-08T19:26:01.468 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.461+0000 7f71fa946700 1 Processor -- start 2023-11-08T19:26:01.468 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.461+0000 7f71fa946700 1 -- start start 2023-11-08T19:26:01.469 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.462+0000 7f71fa946700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f71f40d0430 0x7f71f40b6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:01.469 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.462+0000 7f71fa946700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71f415b950 0x7f71f4144700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:01.469 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.462+0000 7f71fa946700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71f4144c40 0x7f71f40c7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:01.469 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.462+0000 7f71fa946700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f40b6d60 con 0x7f71f4144c40 2023-11-08T19:26:01.469 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.462+0000 7f71fa946700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f41f16b0 con 0x7f71f415b950 2023-11-08T19:26:01.470 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.462+0000 7f71fa946700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f40b1570 con 0x7f71f40d0430 2023-11-08T19:26:01.470 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.462+0000 7f71f8ee3700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71f4144c40 0x7f71f40c7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:01.470 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.462+0000 7f71f8ee3700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71f4144c40 0x7f71f40c7390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42052/0 (socket says 172.21.15.149:42052) 2023-11-08T19:26:01.470 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.462+0000 7f71f8ee3700 1 -- 172.21.15.149:0/235607394 learned_addr learned my addr 172.21.15.149:0/235607394 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:01.470 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.462+0000 7f71f37fe700 1 --2- 172.21.15.149:0/235607394 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71f415b950 0x7f71f4144700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:01.471 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.462+0000 7f71f3fff700 1 --2- 172.21.15.149:0/235607394 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f71f40d0430 0x7f71f40b6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:01.471 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.462+0000 7f71f8ee3700 1 -- 172.21.15.149:0/235607394 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f71f40d0430 msgr2=0x7f71f40b6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:01.471 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.462+0000 7f71f8ee3700 1 --2- 172.21.15.149:0/235607394 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f71f40d0430 0x7f71f40b6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:01.472 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.462+0000 7f71f8ee3700 1 -- 172.21.15.149:0/235607394 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71f415b950 msgr2=0x7f71f4144700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:01.472 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.462+0000 7f71f8ee3700 1 --2- 172.21.15.149:0/235607394 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71f415b950 0x7f71f4144700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:01.472 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.462+0000 7f71f8ee3700 1 -- 172.21.15.149:0/235607394 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e4009430 con 0x7f71f4144c40 2023-11-08T19:26:01.472 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.463+0000 7f71f8ee3700 1 --2- 172.21.15.149:0/235607394 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71f4144c40 0x7f71f40c7390 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f71ec00cbf0 tx=0x7f71ec00cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:01.472 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.463+0000 7f71f0ff9700 1 -- 172.21.15.149:0/235607394 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ec00aa00 con 0x7f71f4144c40 2023-11-08T19:26:01.473 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.463+0000 7f71f0ff9700 1 -- 172.21.15.149:0/235607394 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71ec00ab60 con 0x7f71f4144c40 2023-11-08T19:26:01.473 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.463+0000 7f71fa946700 1 -- 172.21.15.149:0/235607394 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71f40b0fb0 con 0x7f71f4144c40 2023-11-08T19:26:01.473 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.463+0000 7f71f0ff9700 1 -- 172.21.15.149:0/235607394 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ec012400 con 0x7f71f4144c40 2023-11-08T19:26:01.473 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.463+0000 7f71fa946700 1 -- 172.21.15.149:0/235607394 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71f40c6e70 con 0x7f71f4144c40 2023-11-08T19:26:01.473 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.464+0000 7f71fa946700 1 -- 172.21.15.149:0/235607394 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71f40c7060 con 0x7f71f4144c40 2023-11-08T19:26:01.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.464+0000 7f71f0ff9700 1 -- 172.21.15.149:0/235607394 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f71ec012560 con 0x7f71f4144c40 2023-11-08T19:26:01.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.464+0000 7f71f0ff9700 1 --2- 172.21.15.149:0/235607394 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f71e006af00 0x7f71e006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:01.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.465+0000 7f71f0ff9700 1 -- 172.21.15.149:0/235607394 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6326+0+0 (secure 0 0 0) 0x7f71ec0892a0 con 0x7f71f4144c40 2023-11-08T19:26:01.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.465+0000 7f71f3fff700 1 --2- 172.21.15.149:0/235607394 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f71e006af00 0x7f71e006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:01.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.465+0000 7f71f3fff700 1 --2- 172.21.15.149:0/235607394 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f71e006af00 0x7f71e006d3c0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f71e4013040 tx=0x7f71e4008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:01.475 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.469+0000 7f71f0ff9700 1 -- 172.21.15.149:0/235607394 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f71ec054190 con 0x7f71f4144c40 2023-11-08T19:26:01.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.659+0000 7f71fa946700 1 -- 172.21.15.149:0/235607394 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f71f40745f0 con 0x7f71f4144c40 2023-11-08T19:26:01.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.661+0000 7f71f0ff9700 1 -- 172.21.15.149:0/235607394 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+18470 (secure 0 0 0) 0x7f71ec0577b0 con 0x7f71f4144c40 2023-11-08T19:26:01.662 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:26:01.663 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":75,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:26:00.313625+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-08T19:24:29.516185+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-08T19:25:44.287064+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":71,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-08T19:25:45.623521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.149:6837/1548429999":"2023-11-09T19:25:57.229084+0000","172.21.15.149:6836/1548429999":"2023-11-09T19:25:57.229084+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:26:01.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.663+0000 7f71fa946700 1 -- 172.21.15.149:0/235607394 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f71e006af00 msgr2=0x7f71e006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:01.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.663+0000 7f71fa946700 1 --2- 172.21.15.149:0/235607394 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f71e006af00 0x7f71e006d3c0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f71e4013040 tx=0x7f71e4008070 comp rx=0 tx=0).stop 2023-11-08T19:26:01.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.663+0000 7f71fa946700 1 -- 172.21.15.149:0/235607394 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71f4144c40 msgr2=0x7f71f40c7390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:01.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.663+0000 7f71fa946700 1 --2- 172.21.15.149:0/235607394 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71f4144c40 0x7f71f40c7390 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f71ec00cbf0 tx=0x7f71ec00cf00 comp rx=0 tx=0).stop 2023-11-08T19:26:01.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.663+0000 7f71fa946700 1 -- 172.21.15.149:0/235607394 shutdown_connections 2023-11-08T19:26:01.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.663+0000 7f71fa946700 1 --2- 172.21.15.149:0/235607394 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f71e006af00 0x7f71e006d3c0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:01.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.663+0000 7f71fa946700 1 --2- 172.21.15.149:0/235607394 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71f4144c40 0x7f71f40c7390 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:01.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.663+0000 7f71fa946700 1 --2- 172.21.15.149:0/235607394 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f71f40d0430 0x7f71f40b6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:01.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.663+0000 7f71fa946700 1 --2- 172.21.15.149:0/235607394 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71f415b950 0x7f71f4144700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:01.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.663+0000 7f71fa946700 1 -- 172.21.15.149:0/235607394 >> 172.21.15.149:0/235607394 conn(0x7f71f408afd0 msgr2=0x7f71f415c150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:01.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.663+0000 7f71fa946700 1 -- 172.21.15.149:0/235607394 shutdown_connections 2023-11-08T19:26:01.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.663+0000 7f71fa946700 1 -- 172.21.15.149:0/235607394 wait complete. 2023-11-08T19:26:01.677 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-08T19:22:56.023194+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-08T19:24:29.516185+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 42, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_data_pool', 'create_time': '2023-11-08T19:25:44.287064+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 71, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-08T19:25:45.623521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-08T19:26:01.678 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-08T19:26:01.801 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.800+0000 7f34a44c0700 1 Processor -- start 2023-11-08T19:26:01.802 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.800+0000 7f34a44c0700 1 -- start start 2023-11-08T19:26:01.804 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.801+0000 7f34a44c0700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f349c15db10 0x7f349c0cfd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:01.805 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.801+0000 7f34a44c0700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f349c06d5e0 0x7f349c0b31d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:01.805 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.801+0000 7f34a44c0700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f349c0cdd30 con 0x7f349c0b3710 2023-11-08T19:26:01.805 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.801+0000 7f34a44c0700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f349c0ced40 con 0x7f349c15db10 2023-11-08T19:26:01.805 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.801+0000 7f34a44c0700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f349c0b3ba0 con 0x7f349c06d5e0 2023-11-08T19:26:01.806 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.802+0000 7f34a1a5b700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f349c06d5e0 0x7f349c0b31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:01.806 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.802+0000 7f34a225c700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f349c15db10 0x7f349c0cfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:01.806 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.802+0000 7f34a1a5b700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f349c06d5e0 0x7f349c0b31d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.149:34112/0 (socket says 172.21.15.149:34112) 2023-11-08T19:26:01.806 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.802+0000 7f34a1a5b700 1 -- 172.21.15.149:0/4270009851 learned_addr learned my addr 172.21.15.149:0/4270009851 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:01.807 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.802+0000 7f34a2a5d700 1 --1- 172.21.15.149:0/4270009851 >> v1:172.21.15.160:6789/0 conn(0x7f349c0b3710 0x7f349c161730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.149:55724/0 (socket says 172.21.15.149:55724) 2023-11-08T19:26:01.807 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.802+0000 7f34a1a5b700 1 -- 172.21.15.149:0/4270009851 >> v2:172.21.15.160:3300/0 conn(0x7f349c15db10 msgr2=0x7f349c0cfd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:01.807 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.802+0000 7f34a1a5b700 1 --2- 172.21.15.149:0/4270009851 >> v2:172.21.15.160:3300/0 conn(0x7f349c15db10 0x7f349c0cfd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:01.807 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.802+0000 7f34a1a5b700 1 -- 172.21.15.149:0/4270009851 >> v1:172.21.15.160:6789/0 conn(0x7f349c0b3710 legacy=0x7f349c161730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:01.807 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.802+0000 7f34a1a5b700 1 -- 172.21.15.149:0/4270009851 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f349c0cbe50 con 0x7f349c06d5e0 2023-11-08T19:26:01.808 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.802+0000 7f34a1a5b700 1 --2- 172.21.15.149:0/4270009851 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f349c06d5e0 0x7f349c0b31d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f34980098f0 tx=0x7f3498009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13e489b1b2863983 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:01.808 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.802+0000 7f34a125a700 1 -- 172.21.15.149:0/4270009851 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3498011830 con 0x7f349c06d5e0 2023-11-08T19:26:01.808 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.802+0000 7f34a125a700 1 -- 172.21.15.149:0/4270009851 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3498011990 con 0x7f349c06d5e0 2023-11-08T19:26:01.808 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.802+0000 7f34a125a700 1 -- 172.21.15.149:0/4270009851 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3498011d20 con 0x7f349c06d5e0 2023-11-08T19:26:01.808 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.803+0000 7f34a44c0700 1 -- 172.21.15.149:0/4270009851 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f349c06d5e0 msgr2=0x7f349c0b31d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:01.809 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.803+0000 7f34a44c0700 1 --2- 172.21.15.149:0/4270009851 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f349c06d5e0 0x7f349c0b31d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f34980098f0 tx=0x7f3498009c00 comp rx=0 tx=0).stop 2023-11-08T19:26:01.809 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.803+0000 7f34a44c0700 1 -- 172.21.15.149:0/4270009851 shutdown_connections 2023-11-08T19:26:01.809 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.803+0000 7f34a44c0700 1 --2- 172.21.15.149:0/4270009851 >> v2:172.21.15.160:3300/0 conn(0x7f349c15db10 0x7f349c0cfd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:01.809 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.803+0000 7f34a44c0700 1 --2- 172.21.15.149:0/4270009851 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f349c06d5e0 0x7f349c0b31d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:01.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.803+0000 7f34a44c0700 1 -- 172.21.15.149:0/4270009851 >> 172.21.15.149:0/4270009851 conn(0x7f349c06f120 msgr2=0x7f349c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:01.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.803+0000 7f34a44c0700 1 -- 172.21.15.149:0/4270009851 shutdown_connections 2023-11-08T19:26:01.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.803+0000 7f34a44c0700 1 -- 172.21.15.149:0/4270009851 wait complete. 2023-11-08T19:26:01.813 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.804+0000 7f34a44c0700 1 Processor -- start 2023-11-08T19:26:01.813 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.804+0000 7f34a44c0700 1 -- start start 2023-11-08T19:26:01.813 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.805+0000 7f34a44c0700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f349c06d5e0 0x7f349c0caf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:01.814 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.805+0000 7f34a44c0700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f349c0b3710 0x7f349c1f3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:01.814 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.805+0000 7f34a44c0700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f349c15db10 0x7f349c151530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:01.814 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.805+0000 7f34a44c0700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f349c1f41c0 con 0x7f349c06d5e0 2023-11-08T19:26:01.814 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.805+0000 7f34a44c0700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f349c0cb5e0 con 0x7f349c15db10 2023-11-08T19:26:01.815 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.805+0000 7f34a44c0700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f349c1f6830 con 0x7f349c0b3710 2023-11-08T19:26:01.815 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.805+0000 7f34a225c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f349c06d5e0 0x7f349c0caf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:01.815 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.805+0000 7f34a225c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f349c06d5e0 0x7f349c0caf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42058/0 (socket says 172.21.15.149:42058) 2023-11-08T19:26:01.815 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.805+0000 7f34a225c700 1 -- 172.21.15.149:0/469009439 learned_addr learned my addr 172.21.15.149:0/469009439 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:01.815 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.805+0000 7f34a1a5b700 1 --2- 172.21.15.149:0/469009439 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f349c0b3710 0x7f349c1f3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:01.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.805+0000 7f34a2a5d700 1 --2- 172.21.15.149:0/469009439 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f349c15db10 0x7f349c151530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:01.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.805+0000 7f34a225c700 1 -- 172.21.15.149:0/469009439 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f349c0b3710 msgr2=0x7f349c1f3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:01.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.805+0000 7f34a225c700 1 --2- 172.21.15.149:0/469009439 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f349c0b3710 0x7f349c1f3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:01.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.805+0000 7f34a225c700 1 -- 172.21.15.149:0/469009439 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f349c15db10 msgr2=0x7f349c151530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:01.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.805+0000 7f34a225c700 1 --2- 172.21.15.149:0/469009439 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f349c15db10 0x7f349c151530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:01.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.805+0000 7f34a225c700 1 -- 172.21.15.149:0/469009439 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3498009550 con 0x7f349c06d5e0 2023-11-08T19:26:01.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.805+0000 7f34a225c700 1 --2- 172.21.15.149:0/469009439 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f349c06d5e0 0x7f349c0caf50 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f348c00e870 tx=0x7f348c00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:01.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.806+0000 7f3492ffd700 1 -- 172.21.15.149:0/469009439 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348c009590 con 0x7f349c06d5e0 2023-11-08T19:26:01.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.806+0000 7f3492ffd700 1 -- 172.21.15.149:0/469009439 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f348c013680 con 0x7f349c06d5e0 2023-11-08T19:26:01.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.806+0000 7f34a44c0700 1 -- 172.21.15.149:0/469009439 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f349c1f6b10 con 0x7f349c06d5e0 2023-11-08T19:26:01.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.806+0000 7f3492ffd700 1 -- 172.21.15.149:0/469009439 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348c0139f0 con 0x7f349c06d5e0 2023-11-08T19:26:01.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.806+0000 7f34a44c0700 1 -- 172.21.15.149:0/469009439 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f349c1f70d0 con 0x7f349c06d5e0 2023-11-08T19:26:01.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.807+0000 7f34a44c0700 1 -- 172.21.15.149:0/469009439 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f349c04f730 con 0x7f349c06d5e0 2023-11-08T19:26:01.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.807+0000 7f3492ffd700 1 -- 172.21.15.149:0/469009439 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f348c013b50 con 0x7f349c06d5e0 2023-11-08T19:26:01.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.807+0000 7f3492ffd700 1 --2- 172.21.15.149:0/469009439 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f348006af00 0x7f348006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:01.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.807+0000 7f3492ffd700 1 -- 172.21.15.149:0/469009439 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6326+0+0 (secure 0 0 0) 0x7f348c0896f0 con 0x7f349c06d5e0 2023-11-08T19:26:01.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.807+0000 7f34a1a5b700 1 --2- 172.21.15.149:0/469009439 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f348006af00 0x7f348006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:01.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.808+0000 7f34a1a5b700 1 --2- 172.21.15.149:0/469009439 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f348006af00 0x7f348006d3c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f3498014040 tx=0x7f3498008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:01.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:01.812+0000 7f3492ffd700 1 -- 172.21.15.149:0/469009439 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f348c0544b0 con 0x7f349c06d5e0 2023-11-08T19:26:02.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.008+0000 7f34a44c0700 1 -- 172.21.15.149:0/469009439 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f349c06ff20 con 0x7f349c06d5e0 2023-11-08T19:26:02.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.008+0000 7f3492ffd700 1 -- 172.21.15.149:0/469009439 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) v1 ==== 93+0+10 (secure 0 0 0) 0x7f348c057ad0 con 0x7f349c06d5e0 2023-11-08T19:26:02.010 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 1 2023-11-08T19:26:02.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.011+0000 7f34a44c0700 1 -- 172.21.15.149:0/469009439 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f348006af00 msgr2=0x7f348006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:02.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.011+0000 7f34a44c0700 1 --2- 172.21.15.149:0/469009439 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f348006af00 0x7f348006d3c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f3498014040 tx=0x7f3498008030 comp rx=0 tx=0).stop 2023-11-08T19:26:02.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.011+0000 7f34a44c0700 1 -- 172.21.15.149:0/469009439 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f349c06d5e0 msgr2=0x7f349c0caf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:02.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.011+0000 7f34a44c0700 1 --2- 172.21.15.149:0/469009439 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f349c06d5e0 0x7f349c0caf50 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f348c00e870 tx=0x7f348c00eb80 comp rx=0 tx=0).stop 2023-11-08T19:26:02.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.011+0000 7f34a44c0700 1 -- 172.21.15.149:0/469009439 shutdown_connections 2023-11-08T19:26:02.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.011+0000 7f34a44c0700 1 --2- 172.21.15.149:0/469009439 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f348006af00 0x7f348006d3c0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:02.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.011+0000 7f34a44c0700 1 --2- 172.21.15.149:0/469009439 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f349c15db10 0x7f349c151530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:02.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.011+0000 7f34a44c0700 1 --2- 172.21.15.149:0/469009439 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f349c06d5e0 0x7f349c0caf50 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:02.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.011+0000 7f34a44c0700 1 --2- 172.21.15.149:0/469009439 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f349c0b3710 0x7f349c1f3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:02.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.011+0000 7f34a44c0700 1 -- 172.21.15.149:0/469009439 >> 172.21.15.149:0/469009439 conn(0x7f349c06f120 msgr2=0x7f349c0b6380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:02.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.011+0000 7f34a44c0700 1 -- 172.21.15.149:0/469009439 shutdown_connections 2023-11-08T19:26:02.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.011+0000 7f34a44c0700 1 -- 172.21.15.149:0/469009439 wait complete. 2023-11-08T19:26:02.024 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-08T19:26:02.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.145+0000 7efc54dff700 1 Processor -- start 2023-11-08T19:26:02.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.145+0000 7efc54dff700 1 -- start start 2023-11-08T19:26:02.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.146+0000 7efc54dff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7efc5015abf0 0x7efc500b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:02.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.146+0000 7efc54dff700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7efc500d1130 0x7efc500cc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:02.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.146+0000 7efc54dff700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc500b6470 con 0x7efc500cc6a0 2023-11-08T19:26:02.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.146+0000 7efc54dff700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc500b66a0 con 0x7efc5015abf0 2023-11-08T19:26:02.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.146+0000 7efc54dff700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc500d04a0 con 0x7efc500d1130 2023-11-08T19:26:02.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.146+0000 7efc4e59c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7efc5015abf0 0x7efc500b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:02.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.146+0000 7efc4e59c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7efc5015abf0 0x7efc500b5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42066/0 (socket says 172.21.15.149:42066) 2023-11-08T19:26:02.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.146+0000 7efc4e59c700 1 -- 172.21.15.149:0/2596714585 learned_addr learned my addr 172.21.15.149:0/2596714585 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:02.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.146+0000 7efc4dd9b700 1 --2- 172.21.15.149:0/2596714585 >> v2:172.21.15.160:3300/0 conn(0x7efc500d1130 0x7efc500cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:02.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.146+0000 7efc4e59c700 1 -- 172.21.15.149:0/2596714585 >> v2:172.21.15.160:3300/0 conn(0x7efc500d1130 msgr2=0x7efc500cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:02.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.146+0000 7efc4e59c700 1 --2- 172.21.15.149:0/2596714585 >> v2:172.21.15.160:3300/0 conn(0x7efc500d1130 0x7efc500cc160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:02.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.146+0000 7efc4e59c700 1 -- 172.21.15.149:0/2596714585 >> v1:172.21.15.160:6789/0 conn(0x7efc500cc6a0 legacy=0x7efc500ce210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:02.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.146+0000 7efc4e59c700 1 -- 172.21.15.149:0/2596714585 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc5015afd0 con 0x7efc5015abf0 2023-11-08T19:26:02.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.146+0000 7efc4e59c700 1 --2- 172.21.15.149:0/2596714585 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc5015abf0 0x7efc500b5f30 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7efc5006d910 tx=0x7efc40009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7846db7306c90bdc server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:02.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.147+0000 7efc4d59a700 1 -- 172.21.15.149:0/2596714585 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc40004230 con 0x7efc5015abf0 2023-11-08T19:26:02.154 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.147+0000 7efc4d59a700 1 -- 172.21.15.149:0/2596714585 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc40004390 con 0x7efc5015abf0 2023-11-08T19:26:02.154 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.147+0000 7efc4d59a700 1 -- 172.21.15.149:0/2596714585 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc400036a0 con 0x7efc5015abf0 2023-11-08T19:26:02.154 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.147+0000 7efc54dff700 1 -- 172.21.15.149:0/2596714585 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc5015abf0 msgr2=0x7efc500b5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:02.154 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.147+0000 7efc54dff700 1 --2- 172.21.15.149:0/2596714585 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc5015abf0 0x7efc500b5f30 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7efc5006d910 tx=0x7efc40009bd0 comp rx=0 tx=0).stop 2023-11-08T19:26:02.154 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.147+0000 7efc54dff700 1 -- 172.21.15.149:0/2596714585 shutdown_connections 2023-11-08T19:26:02.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.147+0000 7efc54dff700 1 --2- 172.21.15.149:0/2596714585 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc5015abf0 0x7efc500b5f30 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:02.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.147+0000 7efc54dff700 1 --2- 172.21.15.149:0/2596714585 >> v2:172.21.15.160:3300/0 conn(0x7efc500d1130 0x7efc500cc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:02.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.147+0000 7efc54dff700 1 -- 172.21.15.149:0/2596714585 >> 172.21.15.149:0/2596714585 conn(0x7efc500d0640 msgr2=0x7efc500d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:02.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.147+0000 7efc54dff700 1 -- 172.21.15.149:0/2596714585 shutdown_connections 2023-11-08T19:26:02.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.147+0000 7efc54dff700 1 -- 172.21.15.149:0/2596714585 wait complete. 2023-11-08T19:26:02.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.149+0000 7efc54dff700 1 Processor -- start 2023-11-08T19:26:02.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.149+0000 7efc54dff700 1 -- start start 2023-11-08T19:26:02.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.149+0000 7efc54dff700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efc500cc6a0 0x7efc500ad280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:02.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.149+0000 7efc54dff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efc500d1130 0x7efc501f6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:02.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.149+0000 7efc54dff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc5015abf0 0x7efc501f7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:02.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.149+0000 7efc54dff700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc500ad7c0 con 0x7efc5015abf0 2023-11-08T19:26:02.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.149+0000 7efc54dff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc501f74e0 con 0x7efc500d1130 2023-11-08T19:26:02.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.149+0000 7efc54dff700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc500b0de0 con 0x7efc500cc6a0 2023-11-08T19:26:02.161 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.149+0000 7efc4ed9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc5015abf0 0x7efc501f7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:02.161 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.150+0000 7efc4ed9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc5015abf0 0x7efc501f7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42076/0 (socket says 172.21.15.149:42076) 2023-11-08T19:26:02.162 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.150+0000 7efc4ed9d700 1 -- 172.21.15.149:0/2916776158 learned_addr learned my addr 172.21.15.149:0/2916776158 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:02.162 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.150+0000 7efc4dd9b700 1 --2- 172.21.15.149:0/2916776158 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efc500d1130 0x7efc501f6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:02.162 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.150+0000 7efc4e59c700 1 --2- 172.21.15.149:0/2916776158 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efc500cc6a0 0x7efc500ad280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:02.162 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.150+0000 7efc4ed9d700 1 -- 172.21.15.149:0/2916776158 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efc500cc6a0 msgr2=0x7efc500ad280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:02.162 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.150+0000 7efc4ed9d700 1 --2- 172.21.15.149:0/2916776158 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efc500cc6a0 0x7efc500ad280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:02.163 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.150+0000 7efc4ed9d700 1 -- 172.21.15.149:0/2916776158 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efc500d1130 msgr2=0x7efc501f6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:02.163 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.150+0000 7efc4ed9d700 1 --2- 172.21.15.149:0/2916776158 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efc500d1130 0x7efc501f6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:02.163 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.150+0000 7efc4ed9d700 1 -- 172.21.15.149:0/2916776158 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc40009550 con 0x7efc5015abf0 2023-11-08T19:26:02.163 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.150+0000 7efc4dd9b700 1 --2- 172.21.15.149:0/2916776158 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efc500d1130 0x7efc501f6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:26:02.164 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.150+0000 7efc4ed9d700 1 --2- 172.21.15.149:0/2916776158 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc5015abf0 0x7efc501f7c70 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7efc4800b970 tx=0x7efc4800bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:02.164 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.150+0000 7efc3effd700 1 -- 172.21.15.149:0/2916776158 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4800c9b0 con 0x7efc5015abf0 2023-11-08T19:26:02.164 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.150+0000 7efc3effd700 1 -- 172.21.15.149:0/2916776158 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc4800cb10 con 0x7efc5015abf0 2023-11-08T19:26:02.164 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.150+0000 7efc54dff700 1 -- 172.21.15.149:0/2916776158 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc500b10c0 con 0x7efc5015abf0 2023-11-08T19:26:02.164 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.150+0000 7efc3effd700 1 -- 172.21.15.149:0/2916776158 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc48014440 con 0x7efc5015abf0 2023-11-08T19:26:02.165 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.150+0000 7efc54dff700 1 -- 172.21.15.149:0/2916776158 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc500b13a0 con 0x7efc5015abf0 2023-11-08T19:26:02.165 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.151+0000 7efc54dff700 1 -- 172.21.15.149:0/2916776158 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc5015e800 con 0x7efc5015abf0 2023-11-08T19:26:02.165 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.152+0000 7efc3effd700 1 -- 172.21.15.149:0/2916776158 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efc4801d3b0 con 0x7efc5015abf0 2023-11-08T19:26:02.165 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.152+0000 7efc3effd700 1 --2- 172.21.15.149:0/2916776158 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7efc3006af00 0x7efc3006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:02.165 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.152+0000 7efc3effd700 1 -- 172.21.15.149:0/2916776158 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6326+0+0 (secure 0 0 0) 0x7efc48089480 con 0x7efc5015abf0 2023-11-08T19:26:02.166 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.152+0000 7efc4e59c700 1 --2- 172.21.15.149:0/2916776158 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7efc3006af00 0x7efc3006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:02.166 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.152+0000 7efc4e59c700 1 --2- 172.21.15.149:0/2916776158 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7efc3006af00 0x7efc3006d3c0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7efc40009130 tx=0x7efc40008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:02.166 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.157+0000 7efc3effd700 1 -- 172.21.15.149:0/2916776158 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efc480542d0 con 0x7efc5015abf0 2023-11-08T19:26:02.353 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.351+0000 7efc54dff700 1 -- 172.21.15.149:0/2916776158 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7efc5004f730 con 0x7efc5015abf0 2023-11-08T19:26:02.353 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.351+0000 7efc3effd700 1 -- 172.21.15.149:0/2916776158 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v75) v1 ==== 103+0+11 (secure 0 0 0) 0x7efc480578f0 con 0x7efc5015abf0 2023-11-08T19:26:02.354 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:26:02.356 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.353+0000 7efc54dff700 1 -- 172.21.15.149:0/2916776158 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7efc3006af00 msgr2=0x7efc3006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:02.356 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.353+0000 7efc54dff700 1 --2- 172.21.15.149:0/2916776158 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7efc3006af00 0x7efc3006d3c0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7efc40009130 tx=0x7efc40008030 comp rx=0 tx=0).stop 2023-11-08T19:26:02.356 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.353+0000 7efc54dff700 1 -- 172.21.15.149:0/2916776158 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc5015abf0 msgr2=0x7efc501f7c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:02.356 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.353+0000 7efc54dff700 1 --2- 172.21.15.149:0/2916776158 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc5015abf0 0x7efc501f7c70 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7efc4800b970 tx=0x7efc4800bd30 comp rx=0 tx=0).stop 2023-11-08T19:26:02.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.353+0000 7efc54dff700 1 -- 172.21.15.149:0/2916776158 shutdown_connections 2023-11-08T19:26:02.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.353+0000 7efc54dff700 1 --2- 172.21.15.149:0/2916776158 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7efc3006af00 0x7efc3006d3c0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:02.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.353+0000 7efc54dff700 1 --2- 172.21.15.149:0/2916776158 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc5015abf0 0x7efc501f7c70 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:02.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.353+0000 7efc54dff700 1 --2- 172.21.15.149:0/2916776158 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efc500cc6a0 0x7efc500ad280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:02.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.353+0000 7efc54dff700 1 --2- 172.21.15.149:0/2916776158 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efc500d1130 0x7efc501f6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:02.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.353+0000 7efc54dff700 1 -- 172.21.15.149:0/2916776158 >> 172.21.15.149:0/2916776158 conn(0x7efc500d0640 msgr2=0x7efc500cd880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:02.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.353+0000 7efc54dff700 1 -- 172.21.15.149:0/2916776158 shutdown_connections 2023-11-08T19:26:02.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.353+0000 7efc54dff700 1 -- 172.21.15.149:0/2916776158 wait complete. 2023-11-08T19:26:02.368 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-08T19:26:02.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.489+0000 7f7265dc1700 1 Processor -- start 2023-11-08T19:26:02.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.489+0000 7f7265dc1700 1 -- start start 2023-11-08T19:26:02.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.490+0000 7f7265dc1700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f726015abf0 0x7f72600b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:02.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.490+0000 7f7265dc1700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f72600d1130 0x7f72600cc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:02.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.490+0000 7f7265dc1700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72600b6470 con 0x7f72600cc6a0 2023-11-08T19:26:02.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.490+0000 7f7265dc1700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72600b66a0 con 0x7f72600d1130 2023-11-08T19:26:02.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.490+0000 7f7265dc1700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72600d04a0 con 0x7f726015abf0 2023-11-08T19:26:02.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.490+0000 7f725effd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f72600d1130 0x7f72600cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:02.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.490+0000 7f725effd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f72600d1130 0x7f72600cc160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42082/0 (socket says 172.21.15.149:42082) 2023-11-08T19:26:02.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.490+0000 7f725effd700 1 -- 172.21.15.149:0/1617568514 learned_addr learned my addr 172.21.15.149:0/1617568514 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:02.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.490+0000 7f725ffff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f72600cc6a0 0x7f72600ce210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:44084/0 (socket says 172.21.15.149:44084) 2023-11-08T19:26:02.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.490+0000 7f725f7fe700 1 --2- 172.21.15.149:0/1617568514 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f726015abf0 0x7f72600b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:02.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.490+0000 7f725effd700 1 -- 172.21.15.149:0/1617568514 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f726015abf0 msgr2=0x7f72600b5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:02.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.490+0000 7f725effd700 1 --2- 172.21.15.149:0/1617568514 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f726015abf0 0x7f72600b5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:02.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.491+0000 7f725effd700 1 -- 172.21.15.149:0/1617568514 >> v1:172.21.15.149:6789/0 conn(0x7f72600cc6a0 legacy=0x7f72600ce210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:02.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.491+0000 7f725effd700 1 -- 172.21.15.149:0/1617568514 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f726015afd0 con 0x7f72600d1130 2023-11-08T19:26:02.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.491+0000 7f725e7fc700 1 -- 172.21.15.149:0/1617568514 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3079278693 0 0) 0x7f72600b6470 con 0x7f72600cc6a0 2023-11-08T19:26:02.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.491+0000 7f725effd700 1 --2- 172.21.15.149:0/1617568514 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72600d1130 0x7f72600cc160 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f72500098f0 tx=0x7f7250009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=815b038ff723c635 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:02.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.491+0000 7f725e7fc700 1 -- 172.21.15.149:0/1617568514 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725000b8a0 con 0x7f72600d1130 2023-11-08T19:26:02.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.491+0000 7f725e7fc700 1 -- 172.21.15.149:0/1617568514 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f725000ba00 con 0x7f72600d1130 2023-11-08T19:26:02.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.491+0000 7f725e7fc700 1 -- 172.21.15.149:0/1617568514 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725000bd90 con 0x7f72600d1130 2023-11-08T19:26:02.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.491+0000 7f7265dc1700 1 -- 172.21.15.149:0/1617568514 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72600d1130 msgr2=0x7f72600cc160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:02.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.491+0000 7f7265dc1700 1 --2- 172.21.15.149:0/1617568514 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72600d1130 0x7f72600cc160 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f72500098f0 tx=0x7f7250009c00 comp rx=0 tx=0).stop 2023-11-08T19:26:02.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.491+0000 7f7265dc1700 1 -- 172.21.15.149:0/1617568514 shutdown_connections 2023-11-08T19:26:02.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.491+0000 7f7265dc1700 1 --2- 172.21.15.149:0/1617568514 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f726015abf0 0x7f72600b5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:02.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.491+0000 7f7265dc1700 1 --2- 172.21.15.149:0/1617568514 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72600d1130 0x7f72600cc160 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:02.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.491+0000 7f7265dc1700 1 -- 172.21.15.149:0/1617568514 >> 172.21.15.149:0/1617568514 conn(0x7f72600d0640 msgr2=0x7f72600d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:02.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.491+0000 7f7265dc1700 1 -- 172.21.15.149:0/1617568514 shutdown_connections 2023-11-08T19:26:02.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.491+0000 7f7265dc1700 1 -- 172.21.15.149:0/1617568514 wait complete. 2023-11-08T19:26:02.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.493+0000 7f7265dc1700 1 Processor -- start 2023-11-08T19:26:02.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.493+0000 7f7265dc1700 1 -- start start 2023-11-08T19:26:02.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.493+0000 7f7265dc1700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72600cc6a0 0x7f726014ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:02.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.493+0000 7f7265dc1700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f72600d1130 0x7f72600b5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:02.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.493+0000 7f7265dc1700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f726015abf0 0x7f72600b5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:02.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.493+0000 7f7265dc1700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72600c9280 con 0x7f72600cc6a0 2023-11-08T19:26:02.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.493+0000 7f7265dc1700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72600c9560 con 0x7f726015abf0 2023-11-08T19:26:02.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.493+0000 7f7265dc1700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72600c9840 con 0x7f72600d1130 2023-11-08T19:26:02.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.494+0000 7f725f7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72600cc6a0 0x7f726014ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:02.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.494+0000 7f725f7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72600cc6a0 0x7f726014ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42084/0 (socket says 172.21.15.149:42084) 2023-11-08T19:26:02.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.494+0000 7f725f7fe700 1 -- 172.21.15.149:0/3564563412 learned_addr learned my addr 172.21.15.149:0/3564563412 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:02.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.494+0000 7f725f7fe700 1 -- 172.21.15.149:0/3564563412 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f72600d1130 msgr2=0x7f72600b5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:02.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.494+0000 7f725f7fe700 1 --2- 172.21.15.149:0/3564563412 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f72600d1130 0x7f72600b5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:02.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.494+0000 7f725f7fe700 1 -- 172.21.15.149:0/3564563412 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f726015abf0 msgr2=0x7f72600b5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:02.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.494+0000 7f725f7fe700 1 --2- 172.21.15.149:0/3564563412 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f726015abf0 0x7f72600b5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:02.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.494+0000 7f725f7fe700 1 -- 172.21.15.149:0/3564563412 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7250009550 con 0x7f72600cc6a0 2023-11-08T19:26:02.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.494+0000 7f725f7fe700 1 --2- 172.21.15.149:0/3564563412 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72600cc6a0 0x7f726014ea50 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f725400e810 tx=0x7f725400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:02.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.494+0000 7f7247fff700 1 -- 172.21.15.149:0/3564563412 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7254013610 con 0x7f72600cc6a0 2023-11-08T19:26:02.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.494+0000 7f7247fff700 1 -- 172.21.15.149:0/3564563412 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7254013770 con 0x7f72600cc6a0 2023-11-08T19:26:02.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.494+0000 7f7265dc1700 1 -- 172.21.15.149:0/3564563412 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72600c9b20 con 0x7f72600cc6a0 2023-11-08T19:26:02.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.494+0000 7f7247fff700 1 -- 172.21.15.149:0/3564563412 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7254013b20 con 0x7f72600cc6a0 2023-11-08T19:26:02.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.494+0000 7f7265dc1700 1 -- 172.21.15.149:0/3564563412 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f726014ef90 con 0x7f72600cc6a0 2023-11-08T19:26:02.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.495+0000 7f7265dc1700 1 -- 172.21.15.149:0/3564563412 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7260068650 con 0x7f72600cc6a0 2023-11-08T19:26:02.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.496+0000 7f7247fff700 1 -- 172.21.15.149:0/3564563412 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7254013c80 con 0x7f72600cc6a0 2023-11-08T19:26:02.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.496+0000 7f7247fff700 1 --2- 172.21.15.149:0/3564563412 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f724c06af00 0x7f724c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:02.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.496+0000 7f7247fff700 1 -- 172.21.15.149:0/3564563412 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6326+0+0 (secure 0 0 0) 0x7f7254089540 con 0x7f72600cc6a0 2023-11-08T19:26:02.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.496+0000 7f725effd700 1 --2- 172.21.15.149:0/3564563412 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f724c06af00 0x7f724c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:02.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.496+0000 7f725effd700 1 --2- 172.21.15.149:0/3564563412 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f724c06af00 0x7f724c06d3c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f72601f6e20 tx=0x7f7250010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:02.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.501+0000 7f7247fff700 1 -- 172.21.15.149:0/3564563412 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7254054390 con 0x7f72600cc6a0 2023-11-08T19:26:02.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.689+0000 7f7265dc1700 1 -- 172.21.15.149:0/3564563412 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7f726006fc60 con 0x7f72600cc6a0 2023-11-08T19:26:02.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.689+0000 7f7247fff700 1 -- 172.21.15.149:0/3564563412 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v75) v1 ==== 103+0+11 (secure 0 0 0) 0x7f72540579b0 con 0x7f72600cc6a0 2023-11-08T19:26:02.692 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:26:02.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.691+0000 7f7265dc1700 1 -- 172.21.15.149:0/3564563412 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f724c06af00 msgr2=0x7f724c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:02.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.691+0000 7f7265dc1700 1 --2- 172.21.15.149:0/3564563412 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f724c06af00 0x7f724c06d3c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f72601f6e20 tx=0x7f7250010000 comp rx=0 tx=0).stop 2023-11-08T19:26:02.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.691+0000 7f7265dc1700 1 -- 172.21.15.149:0/3564563412 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72600cc6a0 msgr2=0x7f726014ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:02.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.691+0000 7f7265dc1700 1 --2- 172.21.15.149:0/3564563412 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72600cc6a0 0x7f726014ea50 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f725400e810 tx=0x7f725400ebd0 comp rx=0 tx=0).stop 2023-11-08T19:26:02.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.691+0000 7f7265dc1700 1 -- 172.21.15.149:0/3564563412 shutdown_connections 2023-11-08T19:26:02.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.691+0000 7f7265dc1700 1 --2- 172.21.15.149:0/3564563412 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f724c06af00 0x7f724c06d3c0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:02.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.691+0000 7f7265dc1700 1 --2- 172.21.15.149:0/3564563412 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f726015abf0 0x7f72600b5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:02.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.691+0000 7f7265dc1700 1 --2- 172.21.15.149:0/3564563412 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72600cc6a0 0x7f726014ea50 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:02.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.691+0000 7f7265dc1700 1 --2- 172.21.15.149:0/3564563412 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f72600d1130 0x7f72600b5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:02.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.692+0000 7f7265dc1700 1 -- 172.21.15.149:0/3564563412 >> 172.21.15.149:0/3564563412 conn(0x7f72600d0640 msgr2=0x7f7260072b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:02.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.692+0000 7f7265dc1700 1 -- 172.21.15.149:0/3564563412 shutdown_connections 2023-11-08T19:26:02.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.692+0000 7f7265dc1700 1 -- 172.21.15.149:0/3564563412 wait complete. 2023-11-08T19:26:02.706 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-08T19:26:02.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.828+0000 7f0d3be53700 1 Processor -- start 2023-11-08T19:26:02.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.828+0000 7f0d3be53700 1 -- start start 2023-11-08T19:26:02.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.829+0000 7f0d3be53700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0d3415abf0 0x7f0d340b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:02.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.829+0000 7f0d3be53700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0d340d1130 0x7f0d340cc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:02.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.829+0000 7f0d3be53700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d340b6470 con 0x7f0d340cc6a0 2023-11-08T19:26:02.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.829+0000 7f0d3be53700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d340b66a0 con 0x7f0d3415abf0 2023-11-08T19:26:02.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.829+0000 7f0d3be53700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d340d04a0 con 0x7f0d340d1130 2023-11-08T19:26:02.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.829+0000 7f0d39bef700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0d3415abf0 0x7f0d340b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:02.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.829+0000 7f0d39bef700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0d3415abf0 0x7f0d340b5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42092/0 (socket says 172.21.15.149:42092) 2023-11-08T19:26:02.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.829+0000 7f0d39bef700 1 -- 172.21.15.149:0/2352275089 learned_addr learned my addr 172.21.15.149:0/2352275089 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:02.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.829+0000 7f0d393ee700 1 --2- 172.21.15.149:0/2352275089 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0d340d1130 0x7f0d340cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:02.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.830+0000 7f0d39bef700 1 -- 172.21.15.149:0/2352275089 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0d340d1130 msgr2=0x7f0d340cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:02.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.830+0000 7f0d39bef700 1 --2- 172.21.15.149:0/2352275089 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0d340d1130 0x7f0d340cc160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:02.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.830+0000 7f0d39bef700 1 -- 172.21.15.149:0/2352275089 >> v1:172.21.15.160:6789/0 conn(0x7f0d340cc6a0 legacy=0x7f0d340ce210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:02.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.830+0000 7f0d39bef700 1 -- 172.21.15.149:0/2352275089 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d3415afd0 con 0x7f0d3415abf0 2023-11-08T19:26:02.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.830+0000 7f0d393ee700 1 --2- 172.21.15.149:0/2352275089 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0d340d1130 0x7f0d340cc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:26:02.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.830+0000 7f0d39bef700 1 --2- 172.21.15.149:0/2352275089 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d3415abf0 0x7f0d340b5f30 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f0d300098f0 tx=0x7f0d30009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dff2f3768ed3bb9b server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:02.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.830+0000 7f0d38bed700 1 -- 172.21.15.149:0/2352275089 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3000b8a0 con 0x7f0d3415abf0 2023-11-08T19:26:02.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.830+0000 7f0d38bed700 1 -- 172.21.15.149:0/2352275089 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d3000ba00 con 0x7f0d3415abf0 2023-11-08T19:26:02.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.830+0000 7f0d38bed700 1 -- 172.21.15.149:0/2352275089 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3000bd90 con 0x7f0d3415abf0 2023-11-08T19:26:02.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.830+0000 7f0d3be53700 1 -- 172.21.15.149:0/2352275089 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d3415abf0 msgr2=0x7f0d340b5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:02.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.830+0000 7f0d3be53700 1 --2- 172.21.15.149:0/2352275089 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d3415abf0 0x7f0d340b5f30 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f0d300098f0 tx=0x7f0d30009c00 comp rx=0 tx=0).stop 2023-11-08T19:26:02.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.831+0000 7f0d3be53700 1 -- 172.21.15.149:0/2352275089 shutdown_connections 2023-11-08T19:26:02.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.831+0000 7f0d3be53700 1 --2- 172.21.15.149:0/2352275089 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d3415abf0 0x7f0d340b5f30 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:02.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.831+0000 7f0d3be53700 1 --2- 172.21.15.149:0/2352275089 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0d340d1130 0x7f0d340cc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:02.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.831+0000 7f0d3be53700 1 -- 172.21.15.149:0/2352275089 >> 172.21.15.149:0/2352275089 conn(0x7f0d340d0640 msgr2=0x7f0d340d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:02.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.831+0000 7f0d3be53700 1 -- 172.21.15.149:0/2352275089 shutdown_connections 2023-11-08T19:26:02.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.831+0000 7f0d3be53700 1 -- 172.21.15.149:0/2352275089 wait complete. 2023-11-08T19:26:02.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.832+0000 7f0d3be53700 1 Processor -- start 2023-11-08T19:26:02.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.832+0000 7f0d3be53700 1 -- start start 2023-11-08T19:26:02.842 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.833+0000 7f0d3be53700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0d340cc6a0 0x7f0d340ca150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:02.842 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.833+0000 7f0d3be53700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d340d1130 0x7f0d340b1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:02.842 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.833+0000 7f0d3be53700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0d3415abf0 0x7f0d341f6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:02.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.833+0000 7f0d3be53700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d34159bb0 con 0x7f0d340d1130 2023-11-08T19:26:02.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.833+0000 7f0d3be53700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3415db40 con 0x7f0d3415abf0 2023-11-08T19:26:02.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.833+0000 7f0d3be53700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3415ccc0 con 0x7f0d340cc6a0 2023-11-08T19:26:02.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.833+0000 7f0d393ee700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d340d1130 0x7f0d340b1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:02.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.833+0000 7f0d393ee700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d340d1130 0x7f0d340b1400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42098/0 (socket says 172.21.15.149:42098) 2023-11-08T19:26:02.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.833+0000 7f0d393ee700 1 -- 172.21.15.149:0/388942853 learned_addr learned my addr 172.21.15.149:0/388942853 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:02.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.833+0000 7f0d39bef700 1 --2- 172.21.15.149:0/388942853 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0d340cc6a0 0x7f0d340ca150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:02.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.833+0000 7f0d393ee700 1 -- 172.21.15.149:0/388942853 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0d340cc6a0 msgr2=0x7f0d340ca150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:02.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.833+0000 7f0d393ee700 1 --2- 172.21.15.149:0/388942853 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0d340cc6a0 0x7f0d340ca150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:02.845 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.833+0000 7f0d393ee700 1 -- 172.21.15.149:0/388942853 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0d3415abf0 msgr2=0x7f0d341f6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:02.845 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.833+0000 7f0d393ee700 1 --2- 172.21.15.149:0/388942853 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0d3415abf0 0x7f0d341f6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:02.845 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.833+0000 7f0d393ee700 1 -- 172.21.15.149:0/388942853 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d30009550 con 0x7f0d340d1130 2023-11-08T19:26:02.845 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.833+0000 7f0d393ee700 1 --2- 172.21.15.149:0/388942853 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d340d1130 0x7f0d340b1400 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f0d2400e810 tx=0x7f0d2400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:02.845 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.833+0000 7f0d2a7fc700 1 -- 172.21.15.149:0/388942853 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d24013610 con 0x7f0d340d1130 2023-11-08T19:26:02.846 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.833+0000 7f0d2a7fc700 1 -- 172.21.15.149:0/388942853 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d24013770 con 0x7f0d340d1130 2023-11-08T19:26:02.846 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.833+0000 7f0d2a7fc700 1 -- 172.21.15.149:0/388942853 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d24013b20 con 0x7f0d340d1130 2023-11-08T19:26:02.846 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.833+0000 7f0d3be53700 1 -- 172.21.15.149:0/388942853 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d340c9720 con 0x7f0d340d1130 2023-11-08T19:26:02.846 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.833+0000 7f0d3be53700 1 -- 172.21.15.149:0/388942853 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d3415d480 con 0x7f0d340d1130 2023-11-08T19:26:02.847 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.834+0000 7f0d3be53700 1 -- 172.21.15.149:0/388942853 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d3404f730 con 0x7f0d340d1130 2023-11-08T19:26:02.847 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.835+0000 7f0d2a7fc700 1 -- 172.21.15.149:0/388942853 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0d24013c80 con 0x7f0d340d1130 2023-11-08T19:26:02.847 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.835+0000 7f0d2a7fc700 1 --2- 172.21.15.149:0/388942853 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0d1806af00 0x7f0d1806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:02.848 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.835+0000 7f0d2a7fc700 1 -- 172.21.15.149:0/388942853 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6326+0+0 (secure 0 0 0) 0x7f0d240894b0 con 0x7f0d340d1130 2023-11-08T19:26:02.848 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.835+0000 7f0d39bef700 1 --2- 172.21.15.149:0/388942853 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0d1806af00 0x7f0d1806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:02.849 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.835+0000 7f0d39bef700 1 --2- 172.21.15.149:0/388942853 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0d1806af00 0x7f0d1806d3c0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f0d30014040 tx=0x7f0d30008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:02.849 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:02.840+0000 7f0d2a7fc700 1 -- 172.21.15.149:0/388942853 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0d24054380 con 0x7f0d340d1130 2023-11-08T19:26:03.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.028+0000 7f0d3be53700 1 -- 172.21.15.149:0/388942853 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7f0d340cc300 con 0x7f0d340d1130 2023-11-08T19:26:03.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.028+0000 7f0d2a7fc700 1 -- 172.21.15.149:0/388942853 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v75) v1 ==== 107+0+11 (secure 0 0 0) 0x7f0d240579a0 con 0x7f0d340d1130 2023-11-08T19:26:03.031 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:26:03.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.030+0000 7f0d3be53700 1 -- 172.21.15.149:0/388942853 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0d1806af00 msgr2=0x7f0d1806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:03.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.030+0000 7f0d3be53700 1 --2- 172.21.15.149:0/388942853 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0d1806af00 0x7f0d1806d3c0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f0d30014040 tx=0x7f0d30008030 comp rx=0 tx=0).stop 2023-11-08T19:26:03.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.030+0000 7f0d3be53700 1 -- 172.21.15.149:0/388942853 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d340d1130 msgr2=0x7f0d340b1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:03.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.030+0000 7f0d3be53700 1 --2- 172.21.15.149:0/388942853 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d340d1130 0x7f0d340b1400 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f0d2400e810 tx=0x7f0d2400ebd0 comp rx=0 tx=0).stop 2023-11-08T19:26:03.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.030+0000 7f0d3be53700 1 -- 172.21.15.149:0/388942853 shutdown_connections 2023-11-08T19:26:03.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.030+0000 7f0d3be53700 1 --2- 172.21.15.149:0/388942853 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0d1806af00 0x7f0d1806d3c0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:03.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.030+0000 7f0d3be53700 1 --2- 172.21.15.149:0/388942853 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0d3415abf0 0x7f0d341f6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:03.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.030+0000 7f0d3be53700 1 --2- 172.21.15.149:0/388942853 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0d340cc6a0 0x7f0d340ca150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:03.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.030+0000 7f0d3be53700 1 --2- 172.21.15.149:0/388942853 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d340d1130 0x7f0d340b1400 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:03.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.030+0000 7f0d3be53700 1 -- 172.21.15.149:0/388942853 >> 172.21.15.149:0/388942853 conn(0x7f0d340d0640 msgr2=0x7f0d34150b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:03.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.030+0000 7f0d3be53700 1 -- 172.21.15.149:0/388942853 shutdown_connections 2023-11-08T19:26:03.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.030+0000 7f0d3be53700 1 -- 172.21.15.149:0/388942853 wait complete. 2023-11-08T19:26:03.045 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snapshots.TestSnapshots.test_allow_new_snaps_config' 2023-11-08T19:26:03.168 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.166+0000 7f0a0540b700 1 Processor -- start 2023-11-08T19:26:03.168 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.166+0000 7f0a0540b700 1 -- start start 2023-11-08T19:26:03.171 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.167+0000 7f0a0540b700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0a0006ef20 0x7f0a0006bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:03.172 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.167+0000 7f0a0540b700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a0015ab60 con 0x7f0a000cc150 2023-11-08T19:26:03.172 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.167+0000 7f0a0540b700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a0006d9e0 con 0x7f0a0015a780 2023-11-08T19:26:03.172 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.167+0000 7f0a0540b700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0006dcc0 con 0x7f0a0006ef20 2023-11-08T19:26:03.172 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.167+0000 7f09ff7fe700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f0a000cc150 0x7f0a0015e5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:44110/0 (socket says 172.21.15.149:44110) 2023-11-08T19:26:03.173 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.167+0000 7f09ff7fe700 1 -- 172.21.15.149:0/2596480371 learned_addr learned my addr 172.21.15.149:0/2596480371 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:26:03.173 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.167+0000 7f09fe7fc700 1 --2- 172.21.15.149:0/2596480371 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0a0006ef20 0x7f0a0006bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:03.173 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.167+0000 7f09fdffb700 1 -- 172.21.15.149:0/2596480371 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3190296416 0 0) 0x7f0a0015ab60 con 0x7f0a000cc150 2023-11-08T19:26:03.173 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.167+0000 7f09fdffb700 1 -- 172.21.15.149:0/2596480371 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09e80035b0 con 0x7f0a000cc150 2023-11-08T19:26:03.173 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.167+0000 7f09fdffb700 1 -- 172.21.15.149:0/2596480371 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 397949761 0 0) 0x7f09e80035b0 con 0x7f0a000cc150 2023-11-08T19:26:03.173 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.167+0000 7f09fdffb700 1 -- 172.21.15.149:0/2596480371 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0a0006ef20 msgr2=0x7f0a0006bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:03.174 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.167+0000 7f09fdffb700 1 --2- 172.21.15.149:0/2596480371 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0a0006ef20 0x7f0a0006bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:03.174 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.167+0000 7f09fdffb700 1 -- 172.21.15.149:0/2596480371 >> v1:172.21.15.160:6789/0 conn(0x7f0a0015a780 legacy=0x7f0a000cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:03.174 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.167+0000 7f09fdffb700 1 -- 172.21.15.149:0/2596480371 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a0006dfa0 con 0x7f0a000cc150 2023-11-08T19:26:03.175 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.167+0000 7f09fdffb700 1 -- 172.21.15.149:0/2596480371 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f09f80019f0 con 0x7f0a000cc150 2023-11-08T19:26:03.175 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.167+0000 7f09fdffb700 1 -- 172.21.15.149:0/2596480371 >> v1:172.21.15.149:6789/0 conn(0x7f0a000cc150 legacy=0x7f0a0015e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:03.175 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.167+0000 7f09fdffb700 1 --2- 172.21.15.149:0/2596480371 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f09e8003a30 0x7f09e8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:03.175 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.167+0000 7f09fdffb700 1 --2- 172.21.15.149:0/2596480371 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f09e80043e0 0x7f09e80048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:03.175 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.167+0000 7f09fdffb700 1 --2- 172.21.15.149:0/2596480371 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0a0006ef20 0x7f09e8005110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:03.176 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.167+0000 7f09fdffb700 1 -- 172.21.15.149:0/2596480371 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0006dcc0 con 0x7f09e8003a30 2023-11-08T19:26:03.176 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.167+0000 7f09fdffb700 1 -- 172.21.15.149:0/2596480371 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e800ba10 con 0x7f09e80043e0 2023-11-08T19:26:03.176 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.167+0000 7f09fdffb700 1 -- 172.21.15.149:0/2596480371 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09e800bbd0 con 0x7f0a0006ef20 2023-11-08T19:26:03.176 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.168+0000 7f09feffd700 1 --2- 172.21.15.149:0/2596480371 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f09e8003a30 0x7f09e8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:03.176 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.168+0000 7f09fe7fc700 1 --2- 172.21.15.149:0/2596480371 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f09e80043e0 0x7f09e80048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:03.177 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.168+0000 7f09ff7fe700 1 --2- 172.21.15.149:0/2596480371 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0a0006ef20 0x7f09e8005110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:03.177 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.168+0000 7f09feffd700 1 -- 172.21.15.149:0/2596480371 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0a0006ef20 msgr2=0x7f09e8005110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:03.177 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.168+0000 7f09feffd700 1 --2- 172.21.15.149:0/2596480371 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0a0006ef20 0x7f09e8005110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:03.177 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.168+0000 7f09feffd700 1 -- 172.21.15.149:0/2596480371 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f09e80043e0 msgr2=0x7f09e80048b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:03.177 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.168+0000 7f09feffd700 1 --2- 172.21.15.149:0/2596480371 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f09e80043e0 0x7f09e80048b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:03.178 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.168+0000 7f09feffd700 1 -- 172.21.15.149:0/2596480371 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e80035b0 con 0x7f09e8003a30 2023-11-08T19:26:03.178 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.168+0000 7f09feffd700 1 --2- 172.21.15.149:0/2596480371 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f09e8003a30 0x7f09e8003e10 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f09f00018d0 tx=0x7f09e8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4067e725c98f10b server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:03.178 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.168+0000 7f09fdffb700 1 -- 172.21.15.149:0/2596480371 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f000c690 con 0x7f09e8003a30 2023-11-08T19:26:03.178 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.168+0000 7f09fdffb700 1 -- 172.21.15.149:0/2596480371 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09f000c810 con 0x7f09e8003a30 2023-11-08T19:26:03.178 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.168+0000 7f09fdffb700 1 -- 172.21.15.149:0/2596480371 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f000cbc0 con 0x7f09e8003a30 2023-11-08T19:26:03.179 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.169+0000 7f0a0540b700 1 -- 172.21.15.149:0/2596480371 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f09e8003a30 msgr2=0x7f09e8003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:03.179 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.169+0000 7f0a0540b700 1 --2- 172.21.15.149:0/2596480371 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f09e8003a30 0x7f09e8003e10 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f09f00018d0 tx=0x7f09e8005880 comp rx=0 tx=0).stop 2023-11-08T19:26:03.179 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.169+0000 7f09ff7fe700 1 -- 172.21.15.149:0/2596480371 reap_dead start 2023-11-08T19:26:03.179 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.169+0000 7f0a0540b700 1 -- 172.21.15.149:0/2596480371 shutdown_connections 2023-11-08T19:26:03.179 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.169+0000 7f0a0540b700 1 -- 172.21.15.149:0/2596480371 >> 172.21.15.149:0/2596480371 conn(0x7f0a00071670 msgr2=0x7f0a00071a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:03.180 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.169+0000 7f0a0540b700 1 -- 172.21.15.149:0/2596480371 shutdown_connections 2023-11-08T19:26:03.180 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.169+0000 7f0a0540b700 1 -- 172.21.15.149:0/2596480371 wait complete. 2023-11-08T19:26:03.183 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.170+0000 7f0a0540b700 1 Processor -- start 2023-11-08T19:26:03.183 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.170+0000 7f0a0540b700 1 -- start start 2023-11-08T19:26:03.183 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.171+0000 7f0a0540b700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f09e8003a30 0x7f0a0014eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:03.183 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.171+0000 7f0a0540b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0a001f5310 0x7f0a001f1190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:03.183 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.171+0000 7f0a0540b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a00153e20 0x7f0a000b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:03.184 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.171+0000 7f0a0540b700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a00151ed0 con 0x7f0a001f5310 2023-11-08T19:26:03.184 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.171+0000 7f0a0540b700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a00154a00 con 0x7f0a00153e20 2023-11-08T19:26:03.184 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.171+0000 7f0a0540b700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0014f0b0 con 0x7f09e8003a30 2023-11-08T19:26:03.184 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.171+0000 7f09fe7fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0a001f5310 0x7f0a001f1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:03.184 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.171+0000 7f09fe7fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0a001f5310 0x7f0a001f1190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42118/0 (socket says 172.21.15.149:42118) 2023-11-08T19:26:03.185 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.171+0000 7f09fe7fc700 1 -- 172.21.15.149:0/196914351 learned_addr learned my addr 172.21.15.149:0/196914351 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:03.185 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.172+0000 7f09feffd700 1 --2- 172.21.15.149:0/196914351 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f09e8003a30 0x7f0a0014eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:03.185 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.172+0000 7f09ff7fe700 1 --2- 172.21.15.149:0/196914351 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a00153e20 0x7f0a000b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:03.185 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.172+0000 7f09fe7fc700 1 -- 172.21.15.149:0/196914351 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f09e8003a30 msgr2=0x7f0a0014eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:03.185 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.172+0000 7f09fe7fc700 1 --2- 172.21.15.149:0/196914351 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f09e8003a30 0x7f0a0014eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:03.186 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.172+0000 7f09fe7fc700 1 -- 172.21.15.149:0/196914351 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a00153e20 msgr2=0x7f0a000b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:03.186 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.172+0000 7f09fe7fc700 1 --2- 172.21.15.149:0/196914351 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a00153e20 0x7f0a000b2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:03.186 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.172+0000 7f09fe7fc700 1 -- 172.21.15.149:0/196914351 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a00154720 con 0x7f0a001f5310 2023-11-08T19:26:03.186 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.172+0000 7f09fe7fc700 1 --2- 172.21.15.149:0/196914351 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0a001f5310 0x7f0a001f1190 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f09f40119a0 tx=0x7f09f4011cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:03.186 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.172+0000 7f09e77fe700 1 -- 172.21.15.149:0/196914351 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f400f780 con 0x7f0a001f5310 2023-11-08T19:26:03.187 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.172+0000 7f09e77fe700 1 -- 172.21.15.149:0/196914351 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09f400f8e0 con 0x7f0a001f5310 2023-11-08T19:26:03.187 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.172+0000 7f0a0540b700 1 -- 172.21.15.149:0/196914351 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a00151880 con 0x7f0a001f5310 2023-11-08T19:26:03.187 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.172+0000 7f09e77fe700 1 -- 172.21.15.149:0/196914351 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f400fc70 con 0x7f0a001f5310 2023-11-08T19:26:03.187 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.172+0000 7f0a0540b700 1 -- 172.21.15.149:0/196914351 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a001f16d0 con 0x7f0a001f5310 2023-11-08T19:26:03.187 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.173+0000 7f0a0540b700 1 -- 172.21.15.149:0/196914351 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a001516e0 con 0x7f0a001f5310 2023-11-08T19:26:03.188 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.174+0000 7f09e77fe700 1 -- 172.21.15.149:0/196914351 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f09f4014440 con 0x7f0a001f5310 2023-11-08T19:26:03.188 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.174+0000 7f09e77fe700 1 --2- 172.21.15.149:0/196914351 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f09ec06af00 0x7f09ec06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:03.188 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.174+0000 7f09e77fe700 1 -- 172.21.15.149:0/196914351 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6326+0+0 (secure 0 0 0) 0x7f09f4089d30 con 0x7f0a001f5310 2023-11-08T19:26:03.188 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.174+0000 7f09feffd700 1 --2- 172.21.15.149:0/196914351 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f09ec06af00 0x7f09ec06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:03.188 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.174+0000 7f09feffd700 1 --2- 172.21.15.149:0/196914351 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f09ec06af00 0x7f09ec06d3c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f09f0014040 tx=0x7f09f0005040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:03.189 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.179+0000 7f09e77fe700 1 -- 172.21.15.149:0/196914351 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0a001516e0 con 0x7f0a001f5310 2023-11-08T19:26:03.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:03.451+0000 7f0a0540b700 1 -- 172.21.15.149:0/196914351 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestSnapshots.test_allow_new_snaps_config"]} v 0) v1 -- 0x7f0a001516e0 con 0x7f0a001f5310 2023-11-08T19:26:04.335 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.333+0000 7f09e77fe700 1 -- 172.21.15.149:0/196914351 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestSnapshots.test_allow_new_snaps_config"]}]=0 v192) v1 ==== 151+0+0 (secure 0 0 0) 0x7f0a001516e0 con 0x7f0a001f5310 2023-11-08T19:26:04.338 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.336+0000 7f0a0540b700 1 -- 172.21.15.149:0/196914351 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f09ec06af00 msgr2=0x7f09ec06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:04.338 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.336+0000 7f0a0540b700 1 --2- 172.21.15.149:0/196914351 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f09ec06af00 0x7f09ec06d3c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f09f0014040 tx=0x7f09f0005040 comp rx=0 tx=0).stop 2023-11-08T19:26:04.338 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.336+0000 7f0a0540b700 1 -- 172.21.15.149:0/196914351 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0a001f5310 msgr2=0x7f0a001f1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:04.339 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.336+0000 7f0a0540b700 1 --2- 172.21.15.149:0/196914351 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0a001f5310 0x7f0a001f1190 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f09f40119a0 tx=0x7f09f4011cb0 comp rx=0 tx=0).stop 2023-11-08T19:26:04.339 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.336+0000 7f0a0540b700 1 -- 172.21.15.149:0/196914351 shutdown_connections 2023-11-08T19:26:04.339 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.336+0000 7f0a0540b700 1 --2- 172.21.15.149:0/196914351 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f09ec06af00 0x7f09ec06d3c0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:04.339 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.336+0000 7f0a0540b700 1 --2- 172.21.15.149:0/196914351 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a00153e20 0x7f0a000b2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:04.339 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.336+0000 7f0a0540b700 1 --2- 172.21.15.149:0/196914351 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f09e8003a30 0x7f0a0014eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:04.340 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.336+0000 7f0a0540b700 1 --2- 172.21.15.149:0/196914351 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0a001f5310 0x7f0a001f1190 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:04.340 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.336+0000 7f0a0540b700 1 -- 172.21.15.149:0/196914351 >> 172.21.15.149:0/196914351 conn(0x7f0a00071670 msgr2=0x7f0a0015ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:04.340 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.336+0000 7f0a0540b700 1 -- 172.21.15.149:0/196914351 shutdown_connections 2023-11-08T19:26:04.340 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.336+0000 7f0a0540b700 1 -- 172.21.15.149:0/196914351 wait complete. 2023-11-08T19:26:04.353 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-08T19:26:04.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.481+0000 7fa2e3f2b700 1 Processor -- start 2023-11-08T19:26:04.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.481+0000 7fa2e3f2b700 1 -- start start 2023-11-08T19:26:04.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.482+0000 7fa2e3f2b700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fa2dc15abf0 0x7fa2dc0b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:04.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.482+0000 7fa2e3f2b700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa2dc0d1130 0x7fa2dc0cc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:04.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.482+0000 7fa2e3f2b700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2dc0b6470 con 0x7fa2dc0cc6a0 2023-11-08T19:26:04.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.482+0000 7fa2e3f2b700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2dc0b66a0 con 0x7fa2dc15abf0 2023-11-08T19:26:04.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.482+0000 7fa2e3f2b700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc0d04a0 con 0x7fa2dc0d1130 2023-11-08T19:26:04.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.482+0000 7fa2e1cc7700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fa2dc15abf0 0x7fa2dc0b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:04.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.482+0000 7fa2e14c6700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa2dc0d1130 0x7fa2dc0cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:04.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.482+0000 7fa2e24c8700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7fa2dc0cc6a0 0x7fa2dc0ce210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.149:55796/0 (socket says 172.21.15.149:55796) 2023-11-08T19:26:04.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.482+0000 7fa2e1cc7700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fa2dc15abf0 0x7fa2dc0b5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.149:43116/0 (socket says 172.21.15.149:43116) 2023-11-08T19:26:04.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.482+0000 7fa2e14c6700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa2dc0d1130 0x7fa2dc0cc160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.149:34182/0 (socket says 172.21.15.149:34182) 2023-11-08T19:26:04.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.482+0000 7fa2e24c8700 1 -- 172.21.15.149:0/1377918672 learned_addr learned my addr 172.21.15.149:0/1377918672 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:26:04.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.482+0000 7fa2e14c6700 1 -- 172.21.15.149:0/1377918672 >> v2:172.21.15.160:3300/0 conn(0x7fa2dc15abf0 msgr2=0x7fa2dc0b5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:04.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.482+0000 7fa2e14c6700 1 --2- 172.21.15.149:0/1377918672 >> v2:172.21.15.160:3300/0 conn(0x7fa2dc15abf0 0x7fa2dc0b5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:04.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.482+0000 7fa2e14c6700 1 -- 172.21.15.149:0/1377918672 >> v1:172.21.15.160:6789/0 conn(0x7fa2dc0cc6a0 legacy=0x7fa2dc0ce210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:04.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.482+0000 7fa2e14c6700 1 -- 172.21.15.149:0/1377918672 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2dc15afd0 con 0x7fa2dc0d1130 2023-11-08T19:26:04.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.482+0000 7fa2e1cc7700 1 --2- 172.21.15.149:0/1377918672 >> v2:172.21.15.160:3300/0 conn(0x7fa2dc15abf0 0x7fa2dc0b5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:26:04.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.483+0000 7fa2e14c6700 1 --2- 172.21.15.149:0/1377918672 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa2dc0d1130 0x7fa2dc0cc160 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa2d8009840 tx=0x7fa2d8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c981eef73cdad795 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:04.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.483+0000 7fa2e0cc5700 1 -- 172.21.15.149:0/1377918672 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d8011830 con 0x7fa2dc0d1130 2023-11-08T19:26:04.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.483+0000 7fa2e0cc5700 1 -- 172.21.15.149:0/1377918672 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d8011990 con 0x7fa2dc0d1130 2023-11-08T19:26:04.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.483+0000 7fa2e0cc5700 1 -- 172.21.15.149:0/1377918672 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d8011d20 con 0x7fa2dc0d1130 2023-11-08T19:26:04.490 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.483+0000 7fa2e3f2b700 1 -- 172.21.15.149:0/1377918672 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa2dc0d1130 msgr2=0x7fa2dc0cc160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:04.490 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.483+0000 7fa2e3f2b700 1 --2- 172.21.15.149:0/1377918672 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa2dc0d1130 0x7fa2dc0cc160 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa2d8009840 tx=0x7fa2d8009b50 comp rx=0 tx=0).stop 2023-11-08T19:26:04.490 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.483+0000 7fa2e3f2b700 1 -- 172.21.15.149:0/1377918672 shutdown_connections 2023-11-08T19:26:04.490 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.483+0000 7fa2e3f2b700 1 --2- 172.21.15.149:0/1377918672 >> v2:172.21.15.160:3300/0 conn(0x7fa2dc15abf0 0x7fa2dc0b5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:04.490 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.483+0000 7fa2e3f2b700 1 --2- 172.21.15.149:0/1377918672 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa2dc0d1130 0x7fa2dc0cc160 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:04.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.483+0000 7fa2e3f2b700 1 -- 172.21.15.149:0/1377918672 >> 172.21.15.149:0/1377918672 conn(0x7fa2dc0d0640 msgr2=0x7fa2dc0d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:04.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.483+0000 7fa2e3f2b700 1 -- 172.21.15.149:0/1377918672 shutdown_connections 2023-11-08T19:26:04.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.483+0000 7fa2e3f2b700 1 -- 172.21.15.149:0/1377918672 wait complete. 2023-11-08T19:26:04.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.484+0000 7fa2e3f2b700 1 Processor -- start 2023-11-08T19:26:04.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.485+0000 7fa2e3f2b700 1 -- start start 2023-11-08T19:26:04.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.485+0000 7fa2e3f2b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2dc0cc6a0 0x7fa2dc06adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:04.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.485+0000 7fa2e3f2b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2dc0d1130 0x7fa2dc157600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:04.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.485+0000 7fa2e3f2b700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa2dc15abf0 0x7fa2dc157b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:04.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.485+0000 7fa2e3f2b700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc158080 con 0x7fa2dc0d1130 2023-11-08T19:26:04.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.485+0000 7fa2e3f2b700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc15de70 con 0x7fa2dc0cc6a0 2023-11-08T19:26:04.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.485+0000 7fa2e3f2b700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc0ac8c0 con 0x7fa2dc15abf0 2023-11-08T19:26:04.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.485+0000 7fa2e14c6700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2dc0d1130 0x7fa2dc157600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:04.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.485+0000 7fa2e14c6700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2dc0d1130 0x7fa2dc157600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42132/0 (socket says 172.21.15.149:42132) 2023-11-08T19:26:04.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.485+0000 7fa2e14c6700 1 -- 172.21.15.149:0/844702283 learned_addr learned my addr 172.21.15.149:0/844702283 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:04.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.485+0000 7fa2e24c8700 1 --2- 172.21.15.149:0/844702283 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa2dc15abf0 0x7fa2dc157b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:04.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.485+0000 7fa2e1cc7700 1 --2- 172.21.15.149:0/844702283 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2dc0cc6a0 0x7fa2dc06adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:04.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.486+0000 7fa2e14c6700 1 -- 172.21.15.149:0/844702283 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa2dc15abf0 msgr2=0x7fa2dc157b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:04.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.486+0000 7fa2e14c6700 1 --2- 172.21.15.149:0/844702283 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa2dc15abf0 0x7fa2dc157b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:04.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.486+0000 7fa2e14c6700 1 -- 172.21.15.149:0/844702283 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2dc0cc6a0 msgr2=0x7fa2dc06adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:04.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.486+0000 7fa2e14c6700 1 --2- 172.21.15.149:0/844702283 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2dc0cc6a0 0x7fa2dc06adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:04.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.486+0000 7fa2e14c6700 1 -- 172.21.15.149:0/844702283 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2cc0094a0 con 0x7fa2dc0d1130 2023-11-08T19:26:04.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.486+0000 7fa2e14c6700 1 --2- 172.21.15.149:0/844702283 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2dc0d1130 0x7fa2dc157600 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fa2d8009fd0 tx=0x7fa2d8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:04.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.486+0000 7fa2d27fc700 1 -- 172.21.15.149:0/844702283 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d8004550 con 0x7fa2dc0d1130 2023-11-08T19:26:04.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.486+0000 7fa2d27fc700 1 -- 172.21.15.149:0/844702283 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d801f070 con 0x7fa2dc0d1130 2023-11-08T19:26:04.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.486+0000 7fa2e3f2b700 1 -- 172.21.15.149:0/844702283 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2d80094a0 con 0x7fa2dc0d1130 2023-11-08T19:26:04.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.486+0000 7fa2d27fc700 1 -- 172.21.15.149:0/844702283 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d80038e0 con 0x7fa2dc0d1130 2023-11-08T19:26:04.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.486+0000 7fa2e3f2b700 1 -- 172.21.15.149:0/844702283 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2dc0ace80 con 0x7fa2dc0d1130 2023-11-08T19:26:04.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.487+0000 7fa2d27fc700 1 -- 172.21.15.149:0/844702283 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa2d8003a40 con 0x7fa2dc0d1130 2023-11-08T19:26:04.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.488+0000 7fa2e3f2b700 1 -- 172.21.15.149:0/844702283 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2dc04f730 con 0x7fa2dc0d1130 2023-11-08T19:26:04.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.488+0000 7fa2d27fc700 1 --2- 172.21.15.149:0/844702283 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa2c006af00 0x7fa2c006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:04.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.488+0000 7fa2d27fc700 1 -- 172.21.15.149:0/844702283 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6326+0+0 (secure 0 0 0) 0x7fa2d8021070 con 0x7fa2dc0d1130 2023-11-08T19:26:04.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.488+0000 7fa2e1cc7700 1 --2- 172.21.15.149:0/844702283 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa2c006af00 0x7fa2c006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:04.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.488+0000 7fa2e1cc7700 1 --2- 172.21.15.149:0/844702283 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa2c006af00 0x7fa2c006d3c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc009d70 tx=0x7fa2cc009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:04.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.493+0000 7fa2d27fc700 1 -- 172.21.15.149:0/844702283 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa2d8055ef0 con 0x7fa2dc0d1130 2023-11-08T19:26:04.686 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.684+0000 7fa2e3f2b700 1 -- 172.21.15.149:0/844702283 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fa2dc0cfc20 con 0x7fa2dc0d1130 2023-11-08T19:26:04.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.688+0000 7fa2d27fc700 1 -- 172.21.15.149:0/844702283 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v17)=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa2d8059510 con 0x7fa2dc0d1130 2023-11-08T19:26:04.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.690+0000 7fa2e3f2b700 1 -- 172.21.15.149:0/844702283 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa2c006af00 msgr2=0x7fa2c006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:04.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.690+0000 7fa2e3f2b700 1 --2- 172.21.15.149:0/844702283 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa2c006af00 0x7fa2c006d3c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc009d70 tx=0x7fa2cc009210 comp rx=0 tx=0).stop 2023-11-08T19:26:04.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.690+0000 7fa2e3f2b700 1 -- 172.21.15.149:0/844702283 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2dc0d1130 msgr2=0x7fa2dc157600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:04.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.690+0000 7fa2e3f2b700 1 --2- 172.21.15.149:0/844702283 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2dc0d1130 0x7fa2dc157600 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fa2d8009fd0 tx=0x7fa2d8004750 comp rx=0 tx=0).stop 2023-11-08T19:26:04.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.690+0000 7fa2e3f2b700 1 -- 172.21.15.149:0/844702283 shutdown_connections 2023-11-08T19:26:04.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.690+0000 7fa2e3f2b700 1 --2- 172.21.15.149:0/844702283 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa2c006af00 0x7fa2c006d3c0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:04.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.690+0000 7fa2e3f2b700 1 --2- 172.21.15.149:0/844702283 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2dc0cc6a0 0x7fa2dc06adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:04.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.690+0000 7fa2e3f2b700 1 --2- 172.21.15.149:0/844702283 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa2dc15abf0 0x7fa2dc157b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:04.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.690+0000 7fa2e3f2b700 1 --2- 172.21.15.149:0/844702283 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2dc0d1130 0x7fa2dc157600 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:04.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.690+0000 7fa2e3f2b700 1 -- 172.21.15.149:0/844702283 >> 172.21.15.149:0/844702283 conn(0x7fa2dc0d0640 msgr2=0x7fa2dc0cccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:04.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.690+0000 7fa2e3f2b700 1 -- 172.21.15.149:0/844702283 shutdown_connections 2023-11-08T19:26:04.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:04.690+0000 7fa2e3f2b700 1 -- 172.21.15.149:0/844702283 wait complete. 2023-11-08T19:26:04.704 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-08T19:26:04.705 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-08T19:26:04.750 DEBUG:teuthology.orchestra.run.smithi160:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-08T19:26:04.798 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-08T19:26:04.799 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-11-08T19:26:04.799 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:26:04.816 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=8026740k,nr_inodes=2006685,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=31,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15303 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1609048k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-11-08T19:26:04.817 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-11-08T19:26:04.817 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:26:04.837 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284272k,nr_inodes=4071068,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16330 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-08T19:26:04.837 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-11-08T19:26:04.838 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:26:04.873 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=8026740k,nr_inodes=2006685,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=31,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15303 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1609048k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-11-08T19:26:04.874 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-11-08T19:26:04.874 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:26:04.895 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284272k,nr_inodes=4071068,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16330 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-08T19:26:04.896 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-08T19:26:04.896 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:26:05.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.032+0000 7ff0597ef700 1 Processor -- start 2023-11-08T19:26:05.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.032+0000 7ff0597ef700 1 -- start start 2023-11-08T19:26:05.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.033+0000 7ff0597ef700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff0540afb30 0x7ff0540ce380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:05.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.033+0000 7ff0597ef700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7ff0540b16b0 0x7ff0540cbf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:05.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.033+0000 7ff0597ef700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff0540b20b0 0x7ff0540b2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:05.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.033+0000 7ff0597ef700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0540b2a80 con 0x7ff0540b20b0 2023-11-08T19:26:05.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.033+0000 7ff0597ef700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0540d1330 con 0x7ff0540b16b0 2023-11-08T19:26:05.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.033+0000 7ff0597ef700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0540cb490 con 0x7ff0540afb30 2023-11-08T19:26:05.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.033+0000 7ff0537fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff0540b20b0 0x7ff0540b2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:05.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.033+0000 7ff0537fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff0540b20b0 0x7ff0540b2540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42138/0 (socket says 172.21.15.149:42138) 2023-11-08T19:26:05.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.033+0000 7ff0537fe700 1 -- 172.21.15.149:0/420520751 learned_addr learned my addr 172.21.15.149:0/420520751 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:05.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.033+0000 7ff052ffd700 1 --2- 172.21.15.149:0/420520751 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff0540afb30 0x7ff0540ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:05.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.033+0000 7ff0527fc700 1 --2- 172.21.15.149:0/420520751 >> v2:172.21.15.160:3300/0 conn(0x7ff0540b16b0 0x7ff0540cbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:05.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.034+0000 7ff0537fe700 1 -- 172.21.15.149:0/420520751 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff0540afb30 msgr2=0x7ff0540ce380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:05.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.034+0000 7ff0537fe700 1 --2- 172.21.15.149:0/420520751 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff0540afb30 0x7ff0540ce380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:05.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.034+0000 7ff0537fe700 1 -- 172.21.15.149:0/420520751 >> v2:172.21.15.160:3300/0 conn(0x7ff0540b16b0 msgr2=0x7ff0540cbf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:05.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.034+0000 7ff0537fe700 1 --2- 172.21.15.149:0/420520751 >> v2:172.21.15.160:3300/0 conn(0x7ff0540b16b0 0x7ff0540cbf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:05.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.034+0000 7ff0537fe700 1 -- 172.21.15.149:0/420520751 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0540cb770 con 0x7ff0540b20b0 2023-11-08T19:26:05.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.034+0000 7ff0537fe700 1 --2- 172.21.15.149:0/420520751 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0540b20b0 0x7ff0540b2540 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7ff05406cc70 tx=0x7ff04c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6480ff090fcd02f0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:05.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.034+0000 7ff051ffb700 1 -- 172.21.15.149:0/420520751 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04c00e070 con 0x7ff0540b20b0 2023-11-08T19:26:05.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.034+0000 7ff051ffb700 1 -- 172.21.15.149:0/420520751 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff04c00b9c0 con 0x7ff0540b20b0 2023-11-08T19:26:05.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.034+0000 7ff051ffb700 1 -- 172.21.15.149:0/420520751 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04c00bd70 con 0x7ff0540b20b0 2023-11-08T19:26:05.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.034+0000 7ff0597ef700 1 -- 172.21.15.149:0/420520751 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0540b20b0 msgr2=0x7ff0540b2540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:05.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.034+0000 7ff0597ef700 1 --2- 172.21.15.149:0/420520751 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0540b20b0 0x7ff0540b2540 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7ff05406cc70 tx=0x7ff04c00b330 comp rx=0 tx=0).stop 2023-11-08T19:26:05.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.034+0000 7ff0597ef700 1 -- 172.21.15.149:0/420520751 shutdown_connections 2023-11-08T19:26:05.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.034+0000 7ff0597ef700 1 --2- 172.21.15.149:0/420520751 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0540b20b0 0x7ff0540b2540 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:05.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.034+0000 7ff0597ef700 1 --2- 172.21.15.149:0/420520751 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff0540afb30 0x7ff0540ce380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:05.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.034+0000 7ff0597ef700 1 --2- 172.21.15.149:0/420520751 >> v2:172.21.15.160:3300/0 conn(0x7ff0540b16b0 0x7ff0540cbf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:05.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.034+0000 7ff0597ef700 1 -- 172.21.15.149:0/420520751 >> 172.21.15.149:0/420520751 conn(0x7ff054099a40 msgr2=0x7ff0540d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:05.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.034+0000 7ff0597ef700 1 -- 172.21.15.149:0/420520751 shutdown_connections 2023-11-08T19:26:05.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.034+0000 7ff0597ef700 1 -- 172.21.15.149:0/420520751 wait complete. 2023-11-08T19:26:05.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.036+0000 7ff0597ef700 1 Processor -- start 2023-11-08T19:26:05.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.036+0000 7ff0597ef700 1 -- start start 2023-11-08T19:26:05.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.036+0000 7ff0597ef700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff0540afb30 0x7ff054154610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:05.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.036+0000 7ff0597ef700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0540b16b0 0x7ff05414e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:05.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.037+0000 7ff0597ef700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0540b20b0 0x7ff0540ae6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:05.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.037+0000 7ff0597ef700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff054154b50 con 0x7ff0540b20b0 2023-11-08T19:26:05.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.037+0000 7ff0597ef700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff054164580 con 0x7ff0540b16b0 2023-11-08T19:26:05.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.037+0000 7ff0597ef700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0541647f0 con 0x7ff0540afb30 2023-11-08T19:26:05.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.037+0000 7ff0537fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0540b20b0 0x7ff0540ae6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:05.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.037+0000 7ff0537fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0540b20b0 0x7ff0540ae6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42148/0 (socket says 172.21.15.149:42148) 2023-11-08T19:26:05.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.037+0000 7ff0537fe700 1 -- 172.21.15.149:0/2132449377 learned_addr learned my addr 172.21.15.149:0/2132449377 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:05.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.037+0000 7ff052ffd700 1 --2- 172.21.15.149:0/2132449377 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff0540afb30 0x7ff054154610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:05.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.037+0000 7ff0527fc700 1 --2- 172.21.15.149:0/2132449377 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0540b16b0 0x7ff05414e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:05.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.037+0000 7ff0537fe700 1 -- 172.21.15.149:0/2132449377 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff0540afb30 msgr2=0x7ff054154610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:05.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.037+0000 7ff0537fe700 1 --2- 172.21.15.149:0/2132449377 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff0540afb30 0x7ff054154610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:05.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.037+0000 7ff0537fe700 1 -- 172.21.15.149:0/2132449377 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0540b16b0 msgr2=0x7ff05414e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:05.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.037+0000 7ff0537fe700 1 --2- 172.21.15.149:0/2132449377 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0540b16b0 0x7ff05414e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:05.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.037+0000 7ff0537fe700 1 -- 172.21.15.149:0/2132449377 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff04c009b30 con 0x7ff0540b20b0 2023-11-08T19:26:05.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.037+0000 7ff052ffd700 1 --2- 172.21.15.149:0/2132449377 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff0540afb30 0x7ff054154610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:26:05.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.037+0000 7ff0537fe700 1 --2- 172.21.15.149:0/2132449377 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0540b20b0 0x7ff0540ae6e0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7ff04c00b730 tx=0x7ff04c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:05.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.037+0000 7ff03b7fe700 1 -- 172.21.15.149:0/2132449377 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04c004250 con 0x7ff0540b20b0 2023-11-08T19:26:05.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.037+0000 7ff03b7fe700 1 -- 172.21.15.149:0/2132449377 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff04c0043b0 con 0x7ff0540b20b0 2023-11-08T19:26:05.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.037+0000 7ff03b7fe700 1 -- 172.21.15.149:0/2132449377 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04c004740 con 0x7ff0540b20b0 2023-11-08T19:26:05.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.037+0000 7ff0597ef700 1 -- 172.21.15.149:0/2132449377 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff054164ad0 con 0x7ff0540b20b0 2023-11-08T19:26:05.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.037+0000 7ff0597ef700 1 -- 172.21.15.149:0/2132449377 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0540ae2c0 con 0x7ff0540b20b0 2023-11-08T19:26:05.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.038+0000 7ff0597ef700 1 -- 172.21.15.149:0/2132449377 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0540745f0 con 0x7ff0540b20b0 2023-11-08T19:26:05.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.039+0000 7ff03b7fe700 1 -- 172.21.15.149:0/2132449377 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff04c01c440 con 0x7ff0540b20b0 2023-11-08T19:26:05.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.039+0000 7ff03b7fe700 1 --2- 172.21.15.149:0/2132449377 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff04006af00 0x7ff04006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:05.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.039+0000 7ff052ffd700 1 --2- 172.21.15.149:0/2132449377 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff04006af00 0x7ff04006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:05.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.039+0000 7ff03b7fe700 1 -- 172.21.15.149:0/2132449377 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6326+0+0 (secure 0 0 0) 0x7ff04c08ae20 con 0x7ff0540b20b0 2023-11-08T19:26:05.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.040+0000 7ff052ffd700 1 --2- 172.21.15.149:0/2132449377 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff04006af00 0x7ff04006d3c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7ff0541644b0 tx=0x7ff048008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:05.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.044+0000 7ff03b7fe700 1 -- 172.21.15.149:0/2132449377 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff04c059660 con 0x7ff0540b20b0 2023-11-08T19:26:05.277 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.275+0000 7ff0597ef700 1 -- 172.21.15.149:0/2132449377 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff0540c3eb0 con 0x7ff0540b20b0 2023-11-08T19:26:05.278 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.276+0000 7ff03b7fe700 1 -- 172.21.15.149:0/2132449377 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+3711 (secure 0 0 0) 0x7ff04c0591f0 con 0x7ff0540b20b0 2023-11-08T19:26:05.278 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:26:05.279 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":37,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5800,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/3460600894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3460600894},{"type":"v1","addr":"172.21.15.160:6834","nonce":3460600894}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":6165,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2549531465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2549531465},{"type":"v1","addr":"172.21.15.149:6835","nonce":2549531465}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":6180,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/4179310374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":4179310374},{"type":"v1","addr":"172.21.15.160:6835","nonce":4179310374}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":6567,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/2236845124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":2236845124},{"type":"v1","addr":"172.21.15.149:6837","nonce":2236845124}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":37}],"filesystems":[]} 2023-11-08T19:26:05.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.278+0000 7ff0597ef700 1 -- 172.21.15.149:0/2132449377 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff04006af00 msgr2=0x7ff04006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:05.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.278+0000 7ff0597ef700 1 --2- 172.21.15.149:0/2132449377 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff04006af00 0x7ff04006d3c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7ff0541644b0 tx=0x7ff048008040 comp rx=0 tx=0).stop 2023-11-08T19:26:05.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.278+0000 7ff0597ef700 1 -- 172.21.15.149:0/2132449377 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0540b20b0 msgr2=0x7ff0540ae6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:05.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.278+0000 7ff0597ef700 1 --2- 172.21.15.149:0/2132449377 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0540b20b0 0x7ff0540ae6e0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7ff04c00b730 tx=0x7ff04c004ad0 comp rx=0 tx=0).stop 2023-11-08T19:26:05.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.278+0000 7ff0597ef700 1 -- 172.21.15.149:0/2132449377 shutdown_connections 2023-11-08T19:26:05.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.278+0000 7ff0597ef700 1 --2- 172.21.15.149:0/2132449377 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff04006af00 0x7ff04006d3c0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:05.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.278+0000 7ff0597ef700 1 --2- 172.21.15.149:0/2132449377 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0540b20b0 0x7ff0540ae6e0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:05.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.278+0000 7ff0597ef700 1 --2- 172.21.15.149:0/2132449377 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff0540afb30 0x7ff054154610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:05.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.278+0000 7ff0597ef700 1 --2- 172.21.15.149:0/2132449377 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0540b16b0 0x7ff05414e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:05.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.278+0000 7ff0597ef700 1 -- 172.21.15.149:0/2132449377 >> 172.21.15.149:0/2132449377 conn(0x7ff054099a40 msgr2=0x7ff05406ec30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:05.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.278+0000 7ff0597ef700 1 -- 172.21.15.149:0/2132449377 shutdown_connections 2023-11-08T19:26:05.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.278+0000 7ff0597ef700 1 -- 172.21.15.149:0/2132449377 wait complete. 2023-11-08T19:26:05.283 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 37 2023-11-08T19:26:05.292 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-08T19:26:05.293 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-08T19:26:05.293 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-08T19:26:05.293 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T19:26:05.294 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-08T19:26:05.294 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-08T19:26:05.294 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-08T19:26:05.294 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T19:26:05.295 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-08T19:26:05.295 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-08T19:26:05.295 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-08T19:26:05.296 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T19:26:05.296 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-08T19:26:05.296 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-08T19:26:05.296 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-08T19:26:05.297 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T19:26:05.302 INFO:tasks.ceph.mds.a:Stopped 2023-11-08T19:26:05.303 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-08T19:26:05.304 INFO:tasks.ceph.mds.c:Stopped 2023-11-08T19:26:05.304 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-08T19:26:05.307 INFO:tasks.ceph.mds.b:Stopped 2023-11-08T19:26:05.307 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-08T19:26:05.308 INFO:tasks.ceph.mds.d:Stopped 2023-11-08T19:26:05.309 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-08T19:26:05.346 INFO:tasks.ceph.mds.a:Started 2023-11-08T19:26:05.346 DEBUG:teuthology.parallel:result is None 2023-11-08T19:26:05.347 INFO:tasks.ceph.mds.c:Started 2023-11-08T19:26:05.348 DEBUG:teuthology.parallel:result is None 2023-11-08T19:26:05.350 INFO:tasks.ceph.mds.b:Started 2023-11-08T19:26:05.350 DEBUG:teuthology.parallel:result is None 2023-11-08T19:26:05.351 INFO:tasks.ceph.mds.d:Started 2023-11-08T19:26:05.351 DEBUG:teuthology.parallel:result is None 2023-11-08T19:26:05.352 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-08T19:26:05.425 INFO:tasks.ceph.mds.c.smithi149.stdout:starting mds.c at 2023-11-08T19:26:05.425 INFO:tasks.ceph.mds.a.smithi149.stdout:starting mds.a at 2023-11-08T19:26:05.435 INFO:tasks.ceph.mds.d.smithi160.stdout:starting mds.d at 2023-11-08T19:26:05.435 INFO:tasks.ceph.mds.b.smithi160.stdout:starting mds.b at 2023-11-08T19:26:05.480 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.478+0000 7f360e348700 1 Processor -- start 2023-11-08T19:26:05.481 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.478+0000 7f360e348700 1 -- start start 2023-11-08T19:26:05.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.479+0000 7f360e348700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f360815a1a0 0x7f360806e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:05.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.479+0000 7f360e348700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f360806da50 0x7f360806bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:05.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.479+0000 7f360e348700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36080cb220 con 0x7f360806c0d0 2023-11-08T19:26:05.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.479+0000 7f360e348700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f360815a580 con 0x7f360806da50 2023-11-08T19:26:05.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.479+0000 7f360e348700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f360806c560 con 0x7f360815a1a0 2023-11-08T19:26:05.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.479+0000 7f360c8e5700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f360806c0d0 0x7f360815dc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:44182/0 (socket says 172.21.15.149:44182) 2023-11-08T19:26:05.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.479+0000 7f360c8e5700 1 -- 172.21.15.149:0/3633426584 learned_addr learned my addr 172.21.15.149:0/3633426584 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:26:05.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.479+0000 7f3607fff700 1 --2- 172.21.15.149:0/3633426584 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f360815a1a0 0x7f360806e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:05.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.479+0000 7f3606ffd700 1 -- 172.21.15.149:0/3633426584 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1967664873 0 0) 0x7f36080cb220 con 0x7f360806c0d0 2023-11-08T19:26:05.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.479+0000 7f36077fe700 1 --2- 172.21.15.149:0/3633426584 >> v2:172.21.15.160:3300/0 conn(0x7f360806da50 0x7f360806bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:05.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.479+0000 7f3606ffd700 1 -- 172.21.15.149:0/3633426584 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35f00046c0 con 0x7f360806c0d0 2023-11-08T19:26:05.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.479+0000 7f3606ffd700 1 -- 172.21.15.149:0/3633426584 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 71974145 0 0) 0x7f35f00046c0 con 0x7f360806c0d0 2023-11-08T19:26:05.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.479+0000 7f3606ffd700 1 -- 172.21.15.149:0/3633426584 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f360815a1a0 msgr2=0x7f360806e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:05.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.479+0000 7f3606ffd700 1 --2- 172.21.15.149:0/3633426584 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f360815a1a0 0x7f360806e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:05.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.479+0000 7f3606ffd700 1 -- 172.21.15.149:0/3633426584 >> v2:172.21.15.160:3300/0 conn(0x7f360806da50 msgr2=0x7f360806bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:05.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.479+0000 7f3606ffd700 1 --2- 172.21.15.149:0/3633426584 >> v2:172.21.15.160:3300/0 conn(0x7f360806da50 0x7f360806bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:05.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.479+0000 7f3606ffd700 1 -- 172.21.15.149:0/3633426584 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36080cb500 con 0x7f360806c0d0 2023-11-08T19:26:05.490 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.479+0000 7f3606ffd700 1 -- 172.21.15.149:0/3633426584 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f36000019f0 con 0x7f360806c0d0 2023-11-08T19:26:05.490 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.480+0000 7f3606ffd700 1 -- 172.21.15.149:0/3633426584 >> v1:172.21.15.149:6789/0 conn(0x7f360806c0d0 legacy=0x7f360815dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:05.490 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.480+0000 7f3606ffd700 1 --2- 172.21.15.149:0/3633426584 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35f0004b10 0x7f35f0004f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:05.490 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.480+0000 7f3606ffd700 1 --2- 172.21.15.149:0/3633426584 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f35f0005960 0x7f35f0005de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:05.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.480+0000 7f3606ffd700 1 --2- 172.21.15.149:0/3633426584 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f360815a1a0 0x7f35f0006320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:05.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.480+0000 7f3606ffd700 1 -- 172.21.15.149:0/3633426584 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f360815a580 con 0x7f35f0004b10 2023-11-08T19:26:05.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.480+0000 7f3606ffd700 1 -- 172.21.15.149:0/3633426584 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f360806c560 con 0x7f35f0005960 2023-11-08T19:26:05.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.480+0000 7f3606ffd700 1 -- 172.21.15.149:0/3633426584 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35f00034d0 con 0x7f360815a1a0 2023-11-08T19:26:05.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.480+0000 7f3607fff700 1 --2- 172.21.15.149:0/3633426584 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35f0004b10 0x7f35f0004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:05.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.480+0000 7f36077fe700 1 --2- 172.21.15.149:0/3633426584 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f35f0005960 0x7f35f0005de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:05.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.480+0000 7f360c8e5700 1 --2- 172.21.15.149:0/3633426584 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f360815a1a0 0x7f35f0006320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:05.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.480+0000 7f3607fff700 1 -- 172.21.15.149:0/3633426584 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f360815a1a0 msgr2=0x7f35f0006320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:05.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.480+0000 7f3607fff700 1 --2- 172.21.15.149:0/3633426584 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f360815a1a0 0x7f35f0006320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:05.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.480+0000 7f3607fff700 1 -- 172.21.15.149:0/3633426584 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f35f0005960 msgr2=0x7f35f0005de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:05.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.480+0000 7f3607fff700 1 --2- 172.21.15.149:0/3633426584 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f35f0005960 0x7f35f0005de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:05.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.480+0000 7f3607fff700 1 -- 172.21.15.149:0/3633426584 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35f00046c0 con 0x7f35f0004b10 2023-11-08T19:26:05.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.480+0000 7f3607fff700 1 --2- 172.21.15.149:0/3633426584 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35f0004b10 0x7f35f0004f30 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f35f8009b60 tx=0x7f35f0006990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fc8f123037b4105 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:05.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.480+0000 7f3606ffd700 1 -- 172.21.15.149:0/3633426584 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f800e6c0 con 0x7f35f0004b10 2023-11-08T19:26:05.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.480+0000 7f3606ffd700 1 -- 172.21.15.149:0/3633426584 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35f800e820 con 0x7f35f0004b10 2023-11-08T19:26:05.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.480+0000 7f3606ffd700 1 -- 172.21.15.149:0/3633426584 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f800eb90 con 0x7f35f0004b10 2023-11-08T19:26:05.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.481+0000 7f360e348700 1 -- 172.21.15.149:0/3633426584 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35f0004b10 msgr2=0x7f35f0004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:05.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.481+0000 7f360e348700 1 --2- 172.21.15.149:0/3633426584 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35f0004b10 0x7f35f0004f30 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f35f8009b60 tx=0x7f35f0006990 comp rx=0 tx=0).stop 2023-11-08T19:26:05.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.481+0000 7f360c8e5700 1 -- 172.21.15.149:0/3633426584 reap_dead start 2023-11-08T19:26:05.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.481+0000 7f360e348700 1 -- 172.21.15.149:0/3633426584 shutdown_connections 2023-11-08T19:26:05.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.481+0000 7f360e348700 1 -- 172.21.15.149:0/3633426584 >> 172.21.15.149:0/3633426584 conn(0x7f3608071720 msgr2=0x7f3608071b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:05.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.481+0000 7f360e348700 1 -- 172.21.15.149:0/3633426584 shutdown_connections 2023-11-08T19:26:05.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.481+0000 7f360e348700 1 -- 172.21.15.149:0/3633426584 wait complete. 2023-11-08T19:26:05.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.482+0000 7f360e348700 1 Processor -- start 2023-11-08T19:26:05.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.482+0000 7f360e348700 1 -- start start 2023-11-08T19:26:05.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.483+0000 7f360e348700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f35f0004b10 0x7f360815bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:05.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.483+0000 7f360e348700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f360815c190 0x7f36080cdd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:05.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.483+0000 7f360e348700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f360814e4a0 0x7f36080ce240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:05.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.483+0000 7f360e348700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f360815c630 con 0x7f360814e4a0 2023-11-08T19:26:05.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.483+0000 7f360e348700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36081f3f40 con 0x7f360815c190 2023-11-08T19:26:05.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.483+0000 7f360e348700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36081f4220 con 0x7f35f0004b10 2023-11-08T19:26:05.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.483+0000 7f360c8e5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f360814e4a0 0x7f36080ce240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:05.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.483+0000 7f360c8e5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f360814e4a0 0x7f36080ce240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42192/0 (socket says 172.21.15.149:42192) 2023-11-08T19:26:05.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.483+0000 7f36077fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f360815c190 0x7f36080cdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:05.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.483+0000 7f360c8e5700 1 -- 172.21.15.149:0/1257639035 learned_addr learned my addr 172.21.15.149:0/1257639035 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:05.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.483+0000 7f3607fff700 1 --2- 172.21.15.149:0/1257639035 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f35f0004b10 0x7f360815bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:05.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.483+0000 7f360c8e5700 1 -- 172.21.15.149:0/1257639035 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f35f0004b10 msgr2=0x7f360815bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:05.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.483+0000 7f360c8e5700 1 --2- 172.21.15.149:0/1257639035 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f35f0004b10 0x7f360815bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:05.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.483+0000 7f360c8e5700 1 -- 172.21.15.149:0/1257639035 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f360815c190 msgr2=0x7f36080cdd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:05.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.483+0000 7f360c8e5700 1 --2- 172.21.15.149:0/1257639035 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f360815c190 0x7f36080cdd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:05.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.483+0000 7f360c8e5700 1 -- 172.21.15.149:0/1257639035 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36081f4500 con 0x7f360814e4a0 2023-11-08T19:26:05.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.483+0000 7f36077fe700 1 --2- 172.21.15.149:0/1257639035 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f360815c190 0x7f36080cdd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:26:05.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.483+0000 7f360c8e5700 1 --2- 172.21.15.149:0/1257639035 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f360814e4a0 0x7f36080ce240 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f3600001330 tx=0x7f360000a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:05.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.484+0000 7f3604ff9700 1 -- 172.21.15.149:0/1257639035 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360000adb0 con 0x7f360814e4a0 2023-11-08T19:26:05.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.484+0000 7f3604ff9700 1 -- 172.21.15.149:0/1257639035 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36000133f0 con 0x7f360814e4a0 2023-11-08T19:26:05.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.484+0000 7f3604ff9700 1 -- 172.21.15.149:0/1257639035 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36000137a0 con 0x7f360814e4a0 2023-11-08T19:26:05.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.484+0000 7f360e348700 1 -- 172.21.15.149:0/1257639035 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36081f3bf0 con 0x7f360814e4a0 2023-11-08T19:26:05.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.484+0000 7f360e348700 1 -- 172.21.15.149:0/1257639035 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f360815e300 con 0x7f360814e4a0 2023-11-08T19:26:05.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.485+0000 7f360e348700 1 -- 172.21.15.149:0/1257639035 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f360815e4f0 con 0x7f360814e4a0 2023-11-08T19:26:05.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.485+0000 7f3604ff9700 1 -- 172.21.15.149:0/1257639035 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3600013900 con 0x7f360814e4a0 2023-11-08T19:26:05.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.486+0000 7f3604ff9700 1 --2- 172.21.15.149:0/1257639035 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f35f406af00 0x7f35f406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:05.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.486+0000 7f3604ff9700 1 -- 172.21.15.149:0/1257639035 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6326+0+0 (secure 0 0 0) 0x7f360008a060 con 0x7f360814e4a0 2023-11-08T19:26:05.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.486+0000 7f3607fff700 1 --2- 172.21.15.149:0/1257639035 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f35f406af00 0x7f35f406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:05.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.486+0000 7f3607fff700 1 --2- 172.21.15.149:0/1257639035 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f35f406af00 0x7f35f406d3c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f35f80090b0 tx=0x7f35f8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:05.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.490+0000 7f3604ff9700 1 -- 172.21.15.149:0/1257639035 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3600054ea0 con 0x7f360814e4a0 2023-11-08T19:26:05.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:05.696+0000 7f360e348700 1 -- 172.21.15.149:0/1257639035 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f360815c770 con 0x7f360814e4a0 2023-11-08T19:26:06.353 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.351+0000 7f3604ff9700 1 -- 172.21.15.149:0/1257639035 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v77) v1 ==== 97+0+0 (secure 0 0 0) 0x7f36000584c0 con 0x7f360814e4a0 2023-11-08T19:26:06.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.354+0000 7f360e348700 1 -- 172.21.15.149:0/1257639035 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f35f406af00 msgr2=0x7f35f406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:06.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.354+0000 7f360e348700 1 --2- 172.21.15.149:0/1257639035 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f35f406af00 0x7f35f406d3c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f35f80090b0 tx=0x7f35f8008030 comp rx=0 tx=0).stop 2023-11-08T19:26:06.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.354+0000 7f360e348700 1 -- 172.21.15.149:0/1257639035 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f360814e4a0 msgr2=0x7f36080ce240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:06.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.354+0000 7f360e348700 1 --2- 172.21.15.149:0/1257639035 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f360814e4a0 0x7f36080ce240 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f3600001330 tx=0x7f360000a640 comp rx=0 tx=0).stop 2023-11-08T19:26:06.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.354+0000 7f360e348700 1 -- 172.21.15.149:0/1257639035 shutdown_connections 2023-11-08T19:26:06.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.354+0000 7f360e348700 1 --2- 172.21.15.149:0/1257639035 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f35f406af00 0x7f35f406d3c0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:06.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.354+0000 7f360e348700 1 --2- 172.21.15.149:0/1257639035 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f360814e4a0 0x7f36080ce240 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:06.360 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.354+0000 7f360e348700 1 --2- 172.21.15.149:0/1257639035 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f35f0004b10 0x7f360815bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:06.360 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.354+0000 7f360e348700 1 --2- 172.21.15.149:0/1257639035 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f360815c190 0x7f36080cdd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:06.360 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.354+0000 7f360e348700 1 -- 172.21.15.149:0/1257639035 >> 172.21.15.149:0/1257639035 conn(0x7f3608071720 msgr2=0x7f36080b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:06.360 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.354+0000 7f360e348700 1 -- 172.21.15.149:0/1257639035 shutdown_connections 2023-11-08T19:26:06.360 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.354+0000 7f360e348700 1 -- 172.21.15.149:0/1257639035 wait complete. 2023-11-08T19:26:06.361 INFO:teuthology.orchestra.run.smithi149.stderr: removed all blocklist entries 2023-11-08T19:26:06.370 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-08T19:26:06.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.491+0000 7f557cc91700 1 Processor -- start 2023-11-08T19:26:06.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.491+0000 7f557cc91700 1 -- start start 2023-11-08T19:26:06.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.492+0000 7f557cc91700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f557806bb90 0x7f557806bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:06.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.492+0000 7f557cc91700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f557806eb00 0x7f557806efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:06.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.492+0000 7f557cc91700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55780cea30 con 0x7f55780cc0a0 2023-11-08T19:26:06.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.492+0000 7f557cc91700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f557806e670 con 0x7f557806bb90 2023-11-08T19:26:06.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.492+0000 7f557cc91700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f557806c4b0 con 0x7f557806eb00 2023-11-08T19:26:06.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.492+0000 7f5575d9b700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f55780cc0a0 0x7f55780ce320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:44200/0 (socket says 172.21.15.149:44200) 2023-11-08T19:26:06.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.492+0000 7f5575d9b700 1 -- 172.21.15.149:0/2029716243 learned_addr learned my addr 172.21.15.149:0/2029716243 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:26:06.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.492+0000 7f557559a700 1 -- 172.21.15.149:0/2029716243 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3663243434 0 0) 0x7f556c001110 con 0x7f55780cc0a0 2023-11-08T19:26:06.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.492+0000 7f557559a700 1 -- 172.21.15.149:0/2029716243 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55600035b0 con 0x7f55780cc0a0 2023-11-08T19:26:06.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.492+0000 7f5576d9d700 1 --2- 172.21.15.149:0/2029716243 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f557806eb00 0x7f557806efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:06.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.492+0000 7f557659c700 1 --2- 172.21.15.149:0/2029716243 >> v2:172.21.15.160:3300/0 conn(0x7f557806bb90 0x7f557806bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:06.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.492+0000 7f557559a700 1 -- 172.21.15.149:0/2029716243 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4070286046 0 0) 0x7f55600035b0 con 0x7f55780cc0a0 2023-11-08T19:26:06.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.492+0000 7f557559a700 1 -- 172.21.15.149:0/2029716243 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f557806eb00 msgr2=0x7f557806efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:06.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.492+0000 7f557559a700 1 --2- 172.21.15.149:0/2029716243 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f557806eb00 0x7f557806efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:06.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.492+0000 7f557559a700 1 -- 172.21.15.149:0/2029716243 >> v2:172.21.15.160:3300/0 conn(0x7f557806bb90 msgr2=0x7f557806bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:06.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.492+0000 7f557559a700 1 --2- 172.21.15.149:0/2029716243 >> v2:172.21.15.160:3300/0 conn(0x7f557806bb90 0x7f557806bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:06.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.492+0000 7f557559a700 1 -- 172.21.15.149:0/2029716243 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55780cec70 con 0x7f55780cc0a0 2023-11-08T19:26:06.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.492+0000 7f557559a700 1 -- 172.21.15.149:0/2029716243 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f556c001800 con 0x7f55780cc0a0 2023-11-08T19:26:06.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.492+0000 7f557559a700 1 -- 172.21.15.149:0/2029716243 >> v1:172.21.15.149:6789/0 conn(0x7f55780cc0a0 legacy=0x7f55780ce320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:06.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.493+0000 7f557559a700 1 --2- 172.21.15.149:0/2029716243 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5560003a00 0x7f5560003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:06.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.493+0000 7f557559a700 1 --2- 172.21.15.149:0/2029716243 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5560004850 0x7f5560004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:06.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.493+0000 7f557559a700 1 --2- 172.21.15.149:0/2029716243 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f557806eb00 0x7f5560005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:06.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.493+0000 7f557559a700 1 -- 172.21.15.149:0/2029716243 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f557806e670 con 0x7f5560003a00 2023-11-08T19:26:06.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.493+0000 7f557559a700 1 -- 172.21.15.149:0/2029716243 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f557806c4b0 con 0x7f5560004850 2023-11-08T19:26:06.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.493+0000 7f557559a700 1 -- 172.21.15.149:0/2029716243 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f556000ba10 con 0x7f557806eb00 2023-11-08T19:26:06.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.493+0000 7f557659c700 1 --2- 172.21.15.149:0/2029716243 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5560003a00 0x7f5560003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:06.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.493+0000 7f5575d9b700 1 --2- 172.21.15.149:0/2029716243 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5560004850 0x7f5560004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:06.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.493+0000 7f5576d9d700 1 --2- 172.21.15.149:0/2029716243 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f557806eb00 0x7f5560005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:06.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.493+0000 7f557659c700 1 -- 172.21.15.149:0/2029716243 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f557806eb00 msgr2=0x7f5560005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:06.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.493+0000 7f557659c700 1 --2- 172.21.15.149:0/2029716243 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f557806eb00 0x7f5560005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:06.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.493+0000 7f557659c700 1 -- 172.21.15.149:0/2029716243 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5560004850 msgr2=0x7f5560004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:06.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.493+0000 7f557659c700 1 --2- 172.21.15.149:0/2029716243 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5560004850 0x7f5560004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:06.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.493+0000 7f557659c700 1 -- 172.21.15.149:0/2029716243 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55600035b0 con 0x7f5560003a00 2023-11-08T19:26:06.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.493+0000 7f5575d9b700 1 --2- 172.21.15.149:0/2029716243 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5560004850 0x7f5560004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:26:06.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.493+0000 7f557659c700 1 --2- 172.21.15.149:0/2029716243 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5560003a00 0x7f5560003e20 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f5568009b60 tx=0x7f5560005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=507b9ceb0508f615 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:06.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.493+0000 7f557559a700 1 -- 172.21.15.149:0/2029716243 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f556800e6c0 con 0x7f5560003a00 2023-11-08T19:26:06.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.493+0000 7f557559a700 1 -- 172.21.15.149:0/2029716243 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f556800e820 con 0x7f5560003a00 2023-11-08T19:26:06.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.493+0000 7f557559a700 1 -- 172.21.15.149:0/2029716243 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f556800eb90 con 0x7f5560003a00 2023-11-08T19:26:06.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.494+0000 7f557cc91700 1 -- 172.21.15.149:0/2029716243 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5560003a00 msgr2=0x7f5560003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:06.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.494+0000 7f557cc91700 1 --2- 172.21.15.149:0/2029716243 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5560003a00 0x7f5560003e20 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f5568009b60 tx=0x7f5560005880 comp rx=0 tx=0).stop 2023-11-08T19:26:06.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.494+0000 7f5576d9d700 1 -- 172.21.15.149:0/2029716243 reap_dead start 2023-11-08T19:26:06.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.494+0000 7f557cc91700 1 -- 172.21.15.149:0/2029716243 shutdown_connections 2023-11-08T19:26:06.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.494+0000 7f557cc91700 1 -- 172.21.15.149:0/2029716243 >> 172.21.15.149:0/2029716243 conn(0x7f5578071670 msgr2=0x7f5578071a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:06.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.494+0000 7f557cc91700 1 -- 172.21.15.149:0/2029716243 shutdown_connections 2023-11-08T19:26:06.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.494+0000 7f557cc91700 1 -- 172.21.15.149:0/2029716243 wait complete. 2023-11-08T19:26:06.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.495+0000 7f557cc91700 1 Processor -- start 2023-11-08T19:26:06.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.495+0000 7f557cc91700 1 -- start start 2023-11-08T19:26:06.510 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.496+0000 7f557cc91700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5560003a00 0x7f55780c97a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:06.511 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.496+0000 7f557cc91700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f55781f2c20 0x7f557815f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:06.511 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.496+0000 7f557cc91700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f557815fde0 0x7f55780ae980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:06.511 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.496+0000 7f557cc91700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55780c9380 con 0x7f55781f2c20 2023-11-08T19:26:06.511 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.496+0000 7f557cc91700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5578160240 con 0x7f557815fde0 2023-11-08T19:26:06.512 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.496+0000 7f557cc91700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55780c8460 con 0x7f5560003a00 2023-11-08T19:26:06.512 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.496+0000 7f5575d9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f55781f2c20 0x7f557815f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:06.512 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.496+0000 7f5575d9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f55781f2c20 0x7f557815f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42212/0 (socket says 172.21.15.149:42212) 2023-11-08T19:26:06.512 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.496+0000 7f5575d9b700 1 -- 172.21.15.149:0/430471978 learned_addr learned my addr 172.21.15.149:0/430471978 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:06.512 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.496+0000 7f557659c700 1 --2- 172.21.15.149:0/430471978 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5560003a00 0x7f55780c97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:06.513 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.496+0000 7f5576d9d700 1 --2- 172.21.15.149:0/430471978 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f557815fde0 0x7f55780ae980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:06.513 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.496+0000 7f5575d9b700 1 -- 172.21.15.149:0/430471978 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5560003a00 msgr2=0x7f55780c97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:06.513 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.496+0000 7f5575d9b700 1 --2- 172.21.15.149:0/430471978 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5560003a00 0x7f55780c97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:06.513 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.496+0000 7f5575d9b700 1 -- 172.21.15.149:0/430471978 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f557815fde0 msgr2=0x7f55780ae980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:06.513 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.496+0000 7f5575d9b700 1 --2- 172.21.15.149:0/430471978 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f557815fde0 0x7f55780ae980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:06.514 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.496+0000 7f5575d9b700 1 -- 172.21.15.149:0/430471978 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55780c8700 con 0x7f55781f2c20 2023-11-08T19:26:06.514 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.497+0000 7f5575d9b700 1 --2- 172.21.15.149:0/430471978 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f55781f2c20 0x7f557815f8a0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f556c00e7b0 tx=0x7f556c00eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:06.514 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.497+0000 7f5566ffd700 1 -- 172.21.15.149:0/430471978 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f556c012590 con 0x7f55781f2c20 2023-11-08T19:26:06.514 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.497+0000 7f5566ffd700 1 -- 172.21.15.149:0/430471978 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f556c0126f0 con 0x7f55781f2c20 2023-11-08T19:26:06.514 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.497+0000 7f5566ffd700 1 -- 172.21.15.149:0/430471978 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f556c012a80 con 0x7f55781f2c20 2023-11-08T19:26:06.515 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.497+0000 7f557cc91700 1 -- 172.21.15.149:0/430471978 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55780c89e0 con 0x7f55781f2c20 2023-11-08T19:26:06.515 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.497+0000 7f557cc91700 1 -- 172.21.15.149:0/430471978 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55780c8fa0 con 0x7f55781f2c20 2023-11-08T19:26:06.515 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.498+0000 7f557cc91700 1 -- 172.21.15.149:0/430471978 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55780745f0 con 0x7f55781f2c20 2023-11-08T19:26:06.515 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.498+0000 7f5566ffd700 1 -- 172.21.15.149:0/430471978 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f556c012be0 con 0x7f55781f2c20 2023-11-08T19:26:06.515 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.498+0000 7f5566ffd700 1 --2- 172.21.15.149:0/430471978 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f555806af00 0x7f555806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:06.516 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.499+0000 7f5566ffd700 1 -- 172.21.15.149:0/430471978 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6240+0+0 (secure 0 0 0) 0x7f556c089440 con 0x7f55781f2c20 2023-11-08T19:26:06.516 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.499+0000 7f557659c700 1 --2- 172.21.15.149:0/430471978 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f555806af00 0x7f555806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:06.516 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.499+0000 7f557659c700 1 --2- 172.21.15.149:0/430471978 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f555806af00 0x7f555806d3c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f55680090b0 tx=0x7f5568008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:06.516 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.503+0000 7f5566ffd700 1 -- 172.21.15.149:0/430471978 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f556c0542e0 con 0x7f55781f2c20 2023-11-08T19:26:06.780 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.778+0000 7f557cc91700 1 -- 172.21.15.149:0/430471978 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f55780cea30 con 0x7f55781f2c20 2023-11-08T19:26:06.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.779+0000 7f5566ffd700 1 -- 172.21.15.149:0/430471978 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f55780cea30 con 0x7f55781f2c20 2023-11-08T19:26:06.781 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:26:06.781 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2023-11-08T19:26:06.782 INFO:teuthology.orchestra.run.smithi149.stdout: "auth_dump": [ 2023-11-08T19:26:06.782 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:26:06.782 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "mds.a", 2023-11-08T19:26:06.782 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDi30tlcD8lHxAAxmvMr1hdJWLyJ0wOQhILow==", 2023-11-08T19:26:06.783 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:26:06.783 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow", 2023-11-08T19:26:06.783 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow *", 2023-11-08T19:26:06.783 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow *", 2023-11-08T19:26:06.783 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:26:06.784 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:26:06.784 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:26:06.784 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:26:06.784 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "mds.b", 2023-11-08T19:26:06.784 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDi30tl0d56KxAA42ebu7JWPHSW2Y+aUT9G8Q==", 2023-11-08T19:26:06.785 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:26:06.785 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow", 2023-11-08T19:26:06.785 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow *", 2023-11-08T19:26:06.785 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow *", 2023-11-08T19:26:06.785 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:26:06.786 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:26:06.786 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:26:06.786 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:26:06.786 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "mds.c", 2023-11-08T19:26:06.786 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDi30tl+SliJhAAznNm6dtyajBE0T8WKqdhhw==", 2023-11-08T19:26:06.787 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:26:06.787 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow", 2023-11-08T19:26:06.787 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow *", 2023-11-08T19:26:06.787 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow *", 2023-11-08T19:26:06.787 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:26:06.788 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:26:06.788 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:26:06.789 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:26:06.789 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "mds.d", 2023-11-08T19:26:06.789 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDi30tl9sLWMhAACaIzwVjIgVky9P6tAK9/rw==", 2023-11-08T19:26:06.789 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:26:06.789 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow", 2023-11-08T19:26:06.790 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow *", 2023-11-08T19:26:06.790 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow *", 2023-11-08T19:26:06.790 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:26:06.790 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:26:06.790 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:26:06.791 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:26:06.791 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "osd.0", 2023-11-08T19:26:06.791 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDm30tl1SLuEBAA8gYyfPfXV+rd7sXTr5NytA==", 2023-11-08T19:26:06.791 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:26:06.791 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow profile osd", 2023-11-08T19:26:06.792 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile osd", 2023-11-08T19:26:06.792 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:26:06.792 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:26:06.793 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:26:06.793 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:26:06.793 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "osd.1", 2023-11-08T19:26:06.793 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDp30tllvSCEBAAgyXiQm+ld9zVjv2Uo2UilA==", 2023-11-08T19:26:06.794 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:26:06.794 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow profile osd", 2023-11-08T19:26:06.794 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile osd", 2023-11-08T19:26:06.794 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:26:06.794 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:26:06.795 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:26:06.795 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:26:06.795 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "osd.2", 2023-11-08T19:26:06.795 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDs30tlGvZ9DxAAzOPbDXlbk+oxHvXhNfPnNQ==", 2023-11-08T19:26:06.795 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:26:06.796 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow profile osd", 2023-11-08T19:26:06.796 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile osd", 2023-11-08T19:26:06.796 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:26:06.796 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:26:06.796 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:26:06.797 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:26:06.797 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "osd.3", 2023-11-08T19:26:06.797 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDv30tlg0i3DhAAKEy9WQ+VBcJMuKALuYVTEg==", 2023-11-08T19:26:06.797 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:26:06.797 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow profile osd", 2023-11-08T19:26:06.798 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile osd", 2023-11-08T19:26:06.798 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:26:06.798 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:26:06.798 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:26:06.798 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:26:06.799 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "osd.4", 2023-11-08T19:26:06.799 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQD130tlrd3gFRAA0IM+0Dr48SgjXRHcCzypfg==", 2023-11-08T19:26:06.799 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:26:06.799 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow profile osd", 2023-11-08T19:26:06.799 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile osd", 2023-11-08T19:26:06.800 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:26:06.800 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:26:06.800 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:26:06.800 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:26:06.800 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "osd.5", 2023-11-08T19:26:06.801 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQD430tlCMCRFRAAJwP6E9TRRNneQzL7TVU6jg==", 2023-11-08T19:26:06.801 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:26:06.801 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow profile osd", 2023-11-08T19:26:06.801 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile osd", 2023-11-08T19:26:06.801 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:26:06.802 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:26:06.802 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:26:06.802 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:26:06.802 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "osd.6", 2023-11-08T19:26:06.802 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQD730tl176/FBAADjNAIKgdn3bIRlN725KW7g==", 2023-11-08T19:26:06.803 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:26:06.803 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow profile osd", 2023-11-08T19:26:06.803 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile osd", 2023-11-08T19:26:06.803 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:26:06.803 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:26:06.803 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:26:06.804 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:26:06.804 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "osd.7", 2023-11-08T19:26:06.804 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQD+30tl6CCxFBAAcProM9OqTGE6LtReNxvljA==", 2023-11-08T19:26:06.804 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:26:06.804 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow profile osd", 2023-11-08T19:26:06.805 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile osd", 2023-11-08T19:26:06.805 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:26:06.805 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:26:06.805 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:26:06.806 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:26:06.806 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "client.0", 2023-11-08T19:26:06.806 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDi30tlQEEsNxAAiPozrOREh+IJXoj7ZkhvLg==", 2023-11-08T19:26:06.806 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:26:06.806 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow", 2023-11-08T19:26:06.807 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow r", 2023-11-08T19:26:06.807 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-08T19:26:06.807 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:26:06.807 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:26:06.807 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:26:06.808 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "client.1", 2023-11-08T19:26:06.808 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDj30tluO08AhAAKiNHfc6ETU6HU+0PSkRTdg==", 2023-11-08T19:26:06.808 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:26:06.808 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow", 2023-11-08T19:26:06.808 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow r", 2023-11-08T19:26:06.809 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow rw", 2023-11-08T19:26:06.809 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow rwx" 2023-11-08T19:26:06.809 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:26:06.809 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:26:06.809 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:26:06.810 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "client.2", 2023-11-08T19:26:06.810 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDi30tlZfZ+OhAAak0bEZA4XzCWwYINh0SvGQ==", 2023-11-08T19:26:06.810 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:26:06.810 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow", 2023-11-08T19:26:06.810 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow r", 2023-11-08T19:26:06.811 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow rw", 2023-11-08T19:26:06.811 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow rwx" 2023-11-08T19:26:06.811 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:26:06.811 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:26:06.811 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:26:06.812 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "client.3", 2023-11-08T19:26:06.812 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDj30tlLMAICBAAApxzbDjmCxzR32Puyeov6A==", 2023-11-08T19:26:06.812 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:26:06.812 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow", 2023-11-08T19:26:06.813 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow r", 2023-11-08T19:26:06.813 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow rw", 2023-11-08T19:26:06.813 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow rwx" 2023-11-08T19:26:06.813 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:26:06.813 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:26:06.814 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:26:06.814 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "client.admin", 2023-11-08T19:26:06.814 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDi30tltpwRARAAZZQDTm7CIC4J4HH6G378+w==", 2023-11-08T19:26:06.814 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:26:06.814 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow *", 2023-11-08T19:26:06.815 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow *", 2023-11-08T19:26:06.815 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow *", 2023-11-08T19:26:06.815 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:26:06.815 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:26:06.816 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:26:06.816 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:26:06.816 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "mgr.x", 2023-11-08T19:26:06.816 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDi30tluyy2GxAATC2v0iOLVbRrea6w+2Cy8g==", 2023-11-08T19:26:06.816 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:26:06.817 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow *", 2023-11-08T19:26:06.817 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile mgr", 2023-11-08T19:26:06.817 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:26:06.817 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:26:06.818 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:26:06.818 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:26:06.818 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "mgr.y", 2023-11-08T19:26:06.818 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDi30tlxwfmFhAAfauMRZmdBm6TQXw07oVQJw==", 2023-11-08T19:26:06.819 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:26:06.819 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow *", 2023-11-08T19:26:06.819 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile mgr", 2023-11-08T19:26:06.819 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:26:06.820 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:26:06.820 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:26:06.820 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2023-11-08T19:26:06.820 INFO:teuthology.orchestra.run.smithi149.stdout:} 2023-11-08T19:26:06.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.781+0000 7f557cc91700 1 -- 172.21.15.149:0/430471978 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f555806af00 msgr2=0x7f555806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:06.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.781+0000 7f557cc91700 1 --2- 172.21.15.149:0/430471978 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f555806af00 0x7f555806d3c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f55680090b0 tx=0x7f5568008030 comp rx=0 tx=0).stop 2023-11-08T19:26:06.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.781+0000 7f557cc91700 1 -- 172.21.15.149:0/430471978 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f55781f2c20 msgr2=0x7f557815f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:06.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.781+0000 7f557cc91700 1 --2- 172.21.15.149:0/430471978 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f55781f2c20 0x7f557815f8a0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f556c00e7b0 tx=0x7f556c00eb70 comp rx=0 tx=0).stop 2023-11-08T19:26:06.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.781+0000 7f557cc91700 1 -- 172.21.15.149:0/430471978 shutdown_connections 2023-11-08T19:26:06.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.781+0000 7f557cc91700 1 --2- 172.21.15.149:0/430471978 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f555806af00 0x7f555806d3c0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:06.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.781+0000 7f557cc91700 1 --2- 172.21.15.149:0/430471978 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f557815fde0 0x7f55780ae980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:06.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.781+0000 7f557cc91700 1 --2- 172.21.15.149:0/430471978 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5560003a00 0x7f55780c97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:06.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.781+0000 7f557cc91700 1 --2- 172.21.15.149:0/430471978 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f55781f2c20 0x7f557815f8a0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:06.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.781+0000 7f557cc91700 1 -- 172.21.15.149:0/430471978 >> 172.21.15.149:0/430471978 conn(0x7f5578071670 msgr2=0x7f55780ca340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:06.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.781+0000 7f557cc91700 1 -- 172.21.15.149:0/430471978 shutdown_connections 2023-11-08T19:26:06.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.781+0000 7f557cc91700 1 -- 172.21.15.149:0/430471978 wait complete. 2023-11-08T19:26:06.826 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:26:06.946 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.944+0000 7fa8a91a4700 1 Processor -- start 2023-11-08T19:26:06.947 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.944+0000 7fa8a91a4700 1 -- start start 2023-11-08T19:26:06.950 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.945+0000 7fa8a91a4700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa8a40cc140 0x7fa8a40cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:06.950 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.945+0000 7fa8a91a4700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa8a40b2850 0x7fa8a40cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:06.950 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.945+0000 7fa8a91a4700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fa8a40b2cd0 0x7fa8a40cb130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:06.951 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.945+0000 7fa8a91a4700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8a40b2430 con 0x7fa8a40cc140 2023-11-08T19:26:06.951 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.945+0000 7fa8a91a4700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8a40cb670 con 0x7fa8a40b2cd0 2023-11-08T19:26:06.951 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.945+0000 7fa8a91a4700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a40cce50 con 0x7fa8a40b2850 2023-11-08T19:26:06.951 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.945+0000 7fa8a2d9d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa8a40cc140 0x7fa8a40cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:06.951 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.945+0000 7fa8a2d9d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa8a40cc140 0x7fa8a40cc910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42218/0 (socket says 172.21.15.149:42218) 2023-11-08T19:26:06.952 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.945+0000 7fa8a2d9d700 1 -- 172.21.15.149:0/1719500966 learned_addr learned my addr 172.21.15.149:0/1719500966 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:06.952 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.946+0000 7fa8a259c700 1 --2- 172.21.15.149:0/1719500966 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa8a40b2850 0x7fa8a40cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:06.952 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.946+0000 7fa8a359e700 1 --2- 172.21.15.149:0/1719500966 >> v2:172.21.15.160:3300/0 conn(0x7fa8a40b2cd0 0x7fa8a40cb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:06.952 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.946+0000 7fa8a2d9d700 1 -- 172.21.15.149:0/1719500966 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa8a40b2850 msgr2=0x7fa8a40cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:06.952 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.946+0000 7fa8a2d9d700 1 --2- 172.21.15.149:0/1719500966 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa8a40b2850 0x7fa8a40cabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:06.953 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.946+0000 7fa8a2d9d700 1 -- 172.21.15.149:0/1719500966 >> v2:172.21.15.160:3300/0 conn(0x7fa8a40b2cd0 msgr2=0x7fa8a40cb130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:06.953 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.946+0000 7fa8a2d9d700 1 --2- 172.21.15.149:0/1719500966 >> v2:172.21.15.160:3300/0 conn(0x7fa8a40b2cd0 0x7fa8a40cb130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:06.953 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.946+0000 7fa8a2d9d700 1 -- 172.21.15.149:0/1719500966 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a40cc520 con 0x7fa8a40cc140 2023-11-08T19:26:06.953 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.946+0000 7fa8a359e700 1 --2- 172.21.15.149:0/1719500966 >> v2:172.21.15.160:3300/0 conn(0x7fa8a40b2cd0 0x7fa8a40cb130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:26:06.953 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.946+0000 7fa8a2d9d700 1 --2- 172.21.15.149:0/1719500966 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8a40cc140 0x7fa8a40cc910 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fa8a41616f0 tx=0x7fa894009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ec929245635bee server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:06.954 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.946+0000 7fa8a1d9b700 1 -- 172.21.15.149:0/1719500966 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa894005e30 con 0x7fa8a40cc140 2023-11-08T19:26:06.954 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.946+0000 7fa8a1d9b700 1 -- 172.21.15.149:0/1719500966 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa894004030 con 0x7fa8a40cc140 2023-11-08T19:26:06.954 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.946+0000 7fa8a1d9b700 1 -- 172.21.15.149:0/1719500966 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8940043e0 con 0x7fa8a40cc140 2023-11-08T19:26:06.954 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.947+0000 7fa8a91a4700 1 -- 172.21.15.149:0/1719500966 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8a40cc140 msgr2=0x7fa8a40cc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:06.954 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.947+0000 7fa8a91a4700 1 --2- 172.21.15.149:0/1719500966 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8a40cc140 0x7fa8a40cc910 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fa8a41616f0 tx=0x7fa894009bd0 comp rx=0 tx=0).stop 2023-11-08T19:26:06.955 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.947+0000 7fa8a91a4700 1 -- 172.21.15.149:0/1719500966 shutdown_connections 2023-11-08T19:26:06.955 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.947+0000 7fa8a91a4700 1 --2- 172.21.15.149:0/1719500966 >> v2:172.21.15.160:3300/0 conn(0x7fa8a40b2cd0 0x7fa8a40cb130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:06.955 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.947+0000 7fa8a91a4700 1 --2- 172.21.15.149:0/1719500966 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8a40cc140 0x7fa8a40cc910 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:06.955 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.947+0000 7fa8a91a4700 1 --2- 172.21.15.149:0/1719500966 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa8a40b2850 0x7fa8a40cabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:06.955 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.947+0000 7fa8a91a4700 1 -- 172.21.15.149:0/1719500966 >> 172.21.15.149:0/1719500966 conn(0x7fa8a4099a40 msgr2=0x7fa8a40d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:06.956 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.947+0000 7fa8a91a4700 1 -- 172.21.15.149:0/1719500966 shutdown_connections 2023-11-08T19:26:06.956 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.947+0000 7fa8a91a4700 1 -- 172.21.15.149:0/1719500966 wait complete. 2023-11-08T19:26:06.956 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.948+0000 7fa8a91a4700 1 Processor -- start 2023-11-08T19:26:06.956 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.948+0000 7fa8a91a4700 1 -- start start 2023-11-08T19:26:06.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.949+0000 7fa8a91a4700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa8a40b2850 0x7fa8a4154160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:06.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.949+0000 7fa8a91a4700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa8a40b2cd0 0x7fa8a4150400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:06.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.949+0000 7fa8a91a4700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8a40cc140 0x7fa8a4150940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:06.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.949+0000 7fa8a91a4700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a40ad1c0 con 0x7fa8a40cc140 2023-11-08T19:26:06.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.949+0000 7fa8a91a4700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a41518e0 con 0x7fa8a40b2850 2023-11-08T19:26:06.960 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.949+0000 7fa8a91a4700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a4150f40 con 0x7fa8a40b2cd0 2023-11-08T19:26:06.960 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.949+0000 7fa8a359e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8a40cc140 0x7fa8a4150940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:06.960 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.949+0000 7fa8a359e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8a40cc140 0x7fa8a4150940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42226/0 (socket says 172.21.15.149:42226) 2023-11-08T19:26:06.960 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.949+0000 7fa8a359e700 1 -- 172.21.15.149:0/2548575390 learned_addr learned my addr 172.21.15.149:0/2548575390 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:06.961 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.949+0000 7fa8a259c700 1 --2- 172.21.15.149:0/2548575390 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa8a40b2cd0 0x7fa8a4150400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:06.961 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.949+0000 7fa8a2d9d700 1 --2- 172.21.15.149:0/2548575390 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa8a40b2850 0x7fa8a4154160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:06.961 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.949+0000 7fa8a359e700 1 -- 172.21.15.149:0/2548575390 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa8a40b2cd0 msgr2=0x7fa8a4150400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:06.961 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.949+0000 7fa8a359e700 1 --2- 172.21.15.149:0/2548575390 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa8a40b2cd0 0x7fa8a4150400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:06.961 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.949+0000 7fa8a359e700 1 -- 172.21.15.149:0/2548575390 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa8a40b2850 msgr2=0x7fa8a4154160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:06.961 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.949+0000 7fa8a359e700 1 --2- 172.21.15.149:0/2548575390 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa8a40b2850 0x7fa8a4154160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:06.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.949+0000 7fa8a359e700 1 -- 172.21.15.149:0/2548575390 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa894009500 con 0x7fa8a40cc140 2023-11-08T19:26:06.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.950+0000 7fa8a359e700 1 --2- 172.21.15.149:0/2548575390 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8a40cc140 0x7fa8a4150940 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fa89c00cf20 tx=0x7fa89c00cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:06.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.950+0000 7fa88b7fe700 1 -- 172.21.15.149:0/2548575390 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89c00ad60 con 0x7fa8a40cc140 2023-11-08T19:26:06.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.950+0000 7fa88b7fe700 1 -- 172.21.15.149:0/2548575390 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa89c015440 con 0x7fa8a40cc140 2023-11-08T19:26:06.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.950+0000 7fa8a91a4700 1 -- 172.21.15.149:0/2548575390 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8a4151220 con 0x7fa8a40cc140 2023-11-08T19:26:06.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.950+0000 7fa88b7fe700 1 -- 172.21.15.149:0/2548575390 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89c0157f0 con 0x7fa8a40cc140 2023-11-08T19:26:06.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.950+0000 7fa8a91a4700 1 -- 172.21.15.149:0/2548575390 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8a40ad6b0 con 0x7fa8a40cc140 2023-11-08T19:26:06.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.951+0000 7fa8a91a4700 1 -- 172.21.15.149:0/2548575390 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8a40ad8d0 con 0x7fa8a40cc140 2023-11-08T19:26:06.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.951+0000 7fa88b7fe700 1 -- 172.21.15.149:0/2548575390 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa89c00d430 con 0x7fa8a40cc140 2023-11-08T19:26:06.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.952+0000 7fa88b7fe700 1 --2- 172.21.15.149:0/2548575390 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa89006af00 0x7fa89006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:06.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.952+0000 7fa88b7fe700 1 -- 172.21.15.149:0/2548575390 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6240+0+0 (secure 0 0 0) 0x7fa89c089ce0 con 0x7fa8a40cc140 2023-11-08T19:26:06.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.952+0000 7fa8a2d9d700 1 --2- 172.21.15.149:0/2548575390 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa89006af00 0x7fa89006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:06.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.952+0000 7fa8a2d9d700 1 --2- 172.21.15.149:0/2548575390 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa89006af00 0x7fa89006d3c0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fa8a41616f0 tx=0x7fa894008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:06.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:06.956+0000 7fa88b7fe700 1 -- 172.21.15.149:0/2548575390 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa89c054af0 con 0x7fa8a40cc140 2023-11-08T19:26:07.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.149+0000 7fa8a91a4700 1 -- 172.21.15.149:0/2548575390 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa8a40745f0 con 0x7fa8a40cc140 2023-11-08T19:26:07.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.150+0000 7fa88b7fe700 1 -- 172.21.15.149:0/2548575390 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+18339 (secure 0 0 0) 0x7fa89c01a070 con 0x7fa8a40cc140 2023-11-08T19:26:07.153 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:26:07.153 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":79,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:26:06.365974+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-08T19:24:29.516185+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-08T19:25:44.287064+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":71,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-08T19:25:45.623521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:26:07.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.153+0000 7fa8a91a4700 1 -- 172.21.15.149:0/2548575390 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa89006af00 msgr2=0x7fa89006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:07.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.153+0000 7fa8a91a4700 1 --2- 172.21.15.149:0/2548575390 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa89006af00 0x7fa89006d3c0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fa8a41616f0 tx=0x7fa894008070 comp rx=0 tx=0).stop 2023-11-08T19:26:07.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.153+0000 7fa8a91a4700 1 -- 172.21.15.149:0/2548575390 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8a40cc140 msgr2=0x7fa8a4150940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:07.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.153+0000 7fa8a91a4700 1 --2- 172.21.15.149:0/2548575390 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8a40cc140 0x7fa8a4150940 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fa89c00cf20 tx=0x7fa89c00cf50 comp rx=0 tx=0).stop 2023-11-08T19:26:07.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.153+0000 7fa8a91a4700 1 -- 172.21.15.149:0/2548575390 shutdown_connections 2023-11-08T19:26:07.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.153+0000 7fa8a91a4700 1 --2- 172.21.15.149:0/2548575390 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa89006af00 0x7fa89006d3c0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:07.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.153+0000 7fa8a91a4700 1 --2- 172.21.15.149:0/2548575390 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa8a40b2850 0x7fa8a4154160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:07.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.153+0000 7fa8a91a4700 1 --2- 172.21.15.149:0/2548575390 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8a40cc140 0x7fa8a4150940 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:07.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.153+0000 7fa8a91a4700 1 --2- 172.21.15.149:0/2548575390 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa8a40b2cd0 0x7fa8a4150400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:07.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.153+0000 7fa8a91a4700 1 -- 172.21.15.149:0/2548575390 >> 172.21.15.149:0/2548575390 conn(0x7fa8a4099a40 msgr2=0x7fa8a40c7670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:07.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.153+0000 7fa8a91a4700 1 -- 172.21.15.149:0/2548575390 shutdown_connections 2023-11-08T19:26:07.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.153+0000 7fa8a91a4700 1 -- 172.21.15.149:0/2548575390 wait complete. 2023-11-08T19:26:07.168 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-08T19:22:56.023194+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-08T19:24:29.516185+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 42, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_data_pool', 'create_time': '2023-11-08T19:25:44.287064+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 71, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-08T19:25:45.623521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-08T19:26:07.169 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-08T19:26:07.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.291+0000 7fe7d6b3a700 1 Processor -- start 2023-11-08T19:26:07.294 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.291+0000 7fe7d6b3a700 1 -- start start 2023-11-08T19:26:07.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.292+0000 7fe7d6b3a700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe7d00cb660 0x7fe7d00ce540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:07.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.292+0000 7fe7d6b3a700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7d015e320 con 0x7fe7d006ab80 2023-11-08T19:26:07.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.292+0000 7fe7d6b3a700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7d006b020 con 0x7fe7d015df40 2023-11-08T19:26:07.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.292+0000 7fe7d6b3a700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7d006b2e0 con 0x7fe7d00cb660 2023-11-08T19:26:07.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.292+0000 7fe7d50d7700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe7d00cb660 0x7fe7d00ce540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:07.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.292+0000 7fe7cffff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fe7d006ab80 0x7fe7d00caf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:44232/0 (socket says 172.21.15.149:44232) 2023-11-08T19:26:07.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.292+0000 7fe7cffff700 1 -- 172.21.15.149:0/3640975146 learned_addr learned my addr 172.21.15.149:0/3640975146 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:26:07.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.292+0000 7fe7d50d7700 1 -- 172.21.15.149:0/3640975146 >> v1:172.21.15.160:6789/0 conn(0x7fe7d015df40 legacy=0x7fe7d006c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:07.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.292+0000 7fe7d50d7700 1 -- 172.21.15.149:0/3640975146 >> v1:172.21.15.149:6789/0 conn(0x7fe7d006ab80 legacy=0x7fe7d00caf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:07.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.292+0000 7fe7cf7fe700 1 -- 172.21.15.149:0/3640975146 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2843182534 0 0) 0x7fe7d015e320 con 0x7fe7d006ab80 2023-11-08T19:26:07.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.293+0000 7fe7d50d7700 1 -- 172.21.15.149:0/3640975146 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d006b5c0 con 0x7fe7d00cb660 2023-11-08T19:26:07.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.293+0000 7fe7d50d7700 1 --2- 172.21.15.149:0/3640975146 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7d00cb660 0x7fe7d00ce540 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fe7c8009d90 tx=0x7fe7c800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2defb21f6f704e06 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:07.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.293+0000 7fe7cf7fe700 1 -- 172.21.15.149:0/3640975146 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c800e070 con 0x7fe7d00cb660 2023-11-08T19:26:07.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.293+0000 7fe7cf7fe700 1 -- 172.21.15.149:0/3640975146 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7c800bbd0 con 0x7fe7d00cb660 2023-11-08T19:26:07.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.293+0000 7fe7cf7fe700 1 -- 172.21.15.149:0/3640975146 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c8012430 con 0x7fe7d00cb660 2023-11-08T19:26:07.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.293+0000 7fe7d6b3a700 1 -- 172.21.15.149:0/3640975146 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7d00cb660 msgr2=0x7fe7d00ce540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:07.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.293+0000 7fe7d6b3a700 1 --2- 172.21.15.149:0/3640975146 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7d00cb660 0x7fe7d00ce540 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fe7c8009d90 tx=0x7fe7c800b330 comp rx=0 tx=0).stop 2023-11-08T19:26:07.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.293+0000 7fe7d6b3a700 1 -- 172.21.15.149:0/3640975146 shutdown_connections 2023-11-08T19:26:07.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.293+0000 7fe7d6b3a700 1 --2- 172.21.15.149:0/3640975146 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7d00cb660 0x7fe7d00ce540 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:07.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.293+0000 7fe7d6b3a700 1 -- 172.21.15.149:0/3640975146 >> 172.21.15.149:0/3640975146 conn(0x7fe7d00d0640 msgr2=0x7fe7d00d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:07.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.293+0000 7fe7d6b3a700 1 -- 172.21.15.149:0/3640975146 shutdown_connections 2023-11-08T19:26:07.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.293+0000 7fe7d6b3a700 1 -- 172.21.15.149:0/3640975146 wait complete. 2023-11-08T19:26:07.304 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.295+0000 7fe7d6b3a700 1 Processor -- start 2023-11-08T19:26:07.304 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.295+0000 7fe7d6b3a700 1 -- start start 2023-11-08T19:26:07.304 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.296+0000 7fe7d6b3a700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe7d006ab80 0x7fe7d014ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:07.304 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.296+0000 7fe7d6b3a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7d00cb660 0x7fe7d00b13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:07.304 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.296+0000 7fe7d6b3a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7d015df40 0x7fe7d00b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:07.305 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.296+0000 7fe7d6b3a700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d00ca5b0 con 0x7fe7d015df40 2023-11-08T19:26:07.305 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.296+0000 7fe7d6b3a700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d00add90 con 0x7fe7d00cb660 2023-11-08T19:26:07.305 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.296+0000 7fe7d6b3a700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d00c9a30 con 0x7fe7d006ab80 2023-11-08T19:26:07.305 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.296+0000 7fe7d50d7700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7d015df40 0x7fe7d00b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:07.305 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.296+0000 7fe7d50d7700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7d015df40 0x7fe7d00b18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42240/0 (socket says 172.21.15.149:42240) 2023-11-08T19:26:07.306 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.296+0000 7fe7d50d7700 1 -- 172.21.15.149:0/3776675548 learned_addr learned my addr 172.21.15.149:0/3776675548 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:07.306 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.296+0000 7fe7d48d6700 1 --2- 172.21.15.149:0/3776675548 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe7d006ab80 0x7fe7d014ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:07.306 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.296+0000 7fe7cffff700 1 --2- 172.21.15.149:0/3776675548 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7d00cb660 0x7fe7d00b13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:07.306 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.296+0000 7fe7d50d7700 1 -- 172.21.15.149:0/3776675548 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe7d006ab80 msgr2=0x7fe7d014ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:07.306 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.296+0000 7fe7d50d7700 1 --2- 172.21.15.149:0/3776675548 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe7d006ab80 0x7fe7d014ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:07.307 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.296+0000 7fe7d50d7700 1 -- 172.21.15.149:0/3776675548 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7d00cb660 msgr2=0x7fe7d00b13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:07.307 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.296+0000 7fe7d50d7700 1 --2- 172.21.15.149:0/3776675548 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7d00cb660 0x7fe7d00b13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:07.307 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.297+0000 7fe7d50d7700 1 -- 172.21.15.149:0/3776675548 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7c8009a70 con 0x7fe7d015df40 2023-11-08T19:26:07.307 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.297+0000 7fe7d50d7700 1 --2- 172.21.15.149:0/3776675548 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7d015df40 0x7fe7d00b18e0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fe7c8014040 tx=0x7fe7c8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:07.307 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.297+0000 7fe7cd7fa700 1 -- 172.21.15.149:0/3776675548 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c801b810 con 0x7fe7d015df40 2023-11-08T19:26:07.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.297+0000 7fe7cd7fa700 1 -- 172.21.15.149:0/3776675548 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7c8020070 con 0x7fe7d015df40 2023-11-08T19:26:07.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.297+0000 7fe7d6b3a700 1 -- 172.21.15.149:0/3776675548 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7d00c9d10 con 0x7fe7d015df40 2023-11-08T19:26:07.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.297+0000 7fe7cd7fa700 1 -- 172.21.15.149:0/3776675548 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c801bbb0 con 0x7fe7d015df40 2023-11-08T19:26:07.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.297+0000 7fe7d6b3a700 1 -- 172.21.15.149:0/3776675548 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7d00ca2d0 con 0x7fe7d015df40 2023-11-08T19:26:07.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.298+0000 7fe7d6b3a700 1 -- 172.21.15.149:0/3776675548 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7d00adf90 con 0x7fe7d015df40 2023-11-08T19:26:07.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.298+0000 7fe7cd7fa700 1 -- 172.21.15.149:0/3776675548 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe7c801bd10 con 0x7fe7d015df40 2023-11-08T19:26:07.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.299+0000 7fe7cd7fa700 1 --2- 172.21.15.149:0/3776675548 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe7b406af00 0x7fe7b406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:07.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.299+0000 7fe7d48d6700 1 --2- 172.21.15.149:0/3776675548 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe7b406af00 0x7fe7b406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:07.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.299+0000 7fe7cd7fa700 1 -- 172.21.15.149:0/3776675548 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6240+0+0 (secure 0 0 0) 0x7fe7c8022070 con 0x7fe7d015df40 2023-11-08T19:26:07.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.299+0000 7fe7d48d6700 1 --2- 172.21.15.149:0/3776675548 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe7b406af00 0x7fe7b406d3c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4000f60 tx=0x7fe7c4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:07.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.304+0000 7fe7cd7fa700 1 -- 172.21.15.149:0/3776675548 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe7d00adf90 con 0x7fe7d015df40 2023-11-08T19:26:07.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.497+0000 7fe7d6b3a700 1 -- 172.21.15.149:0/3776675548 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe7d00adf50 con 0x7fe7d015df40 2023-11-08T19:26:07.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.497+0000 7fe7cd7fa700 1 -- 172.21.15.149:0/3776675548 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe7c805a6d0 con 0x7fe7d015df40 2023-11-08T19:26:07.500 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 1 2023-11-08T19:26:07.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.500+0000 7fe7d6b3a700 1 -- 172.21.15.149:0/3776675548 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe7b406af00 msgr2=0x7fe7b406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:07.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.500+0000 7fe7d6b3a700 1 --2- 172.21.15.149:0/3776675548 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe7b406af00 0x7fe7b406d3c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4000f60 tx=0x7fe7c4009040 comp rx=0 tx=0).stop 2023-11-08T19:26:07.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.500+0000 7fe7d6b3a700 1 -- 172.21.15.149:0/3776675548 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7d015df40 msgr2=0x7fe7d00b18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:07.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.500+0000 7fe7d6b3a700 1 --2- 172.21.15.149:0/3776675548 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7d015df40 0x7fe7d00b18e0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fe7c8014040 tx=0x7fe7c8004ad0 comp rx=0 tx=0).stop 2023-11-08T19:26:07.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.500+0000 7fe7d6b3a700 1 -- 172.21.15.149:0/3776675548 shutdown_connections 2023-11-08T19:26:07.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.500+0000 7fe7d6b3a700 1 --2- 172.21.15.149:0/3776675548 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe7b406af00 0x7fe7b406d3c0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:07.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.500+0000 7fe7d6b3a700 1 --2- 172.21.15.149:0/3776675548 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7d015df40 0x7fe7d00b18e0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:07.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.500+0000 7fe7d6b3a700 1 --2- 172.21.15.149:0/3776675548 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe7d006ab80 0x7fe7d014ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:07.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.500+0000 7fe7d6b3a700 1 --2- 172.21.15.149:0/3776675548 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7d00cb660 0x7fe7d00b13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:07.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.500+0000 7fe7d6b3a700 1 -- 172.21.15.149:0/3776675548 >> 172.21.15.149:0/3776675548 conn(0x7fe7d00d0640 msgr2=0x7fe7d00b0730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:07.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.500+0000 7fe7d6b3a700 1 -- 172.21.15.149:0/3776675548 shutdown_connections 2023-11-08T19:26:07.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.500+0000 7fe7d6b3a700 1 -- 172.21.15.149:0/3776675548 wait complete. 2023-11-08T19:26:07.514 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-08T19:26:07.638 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.636+0000 7fb6653c7700 1 Processor -- start 2023-11-08T19:26:07.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.636+0000 7fb6653c7700 1 -- start start 2023-11-08T19:26:07.641 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.637+0000 7fb6653c7700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb66015dc80 0x7fb6600aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:07.641 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.637+0000 7fb6653c7700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb6600ce620 0x7fb6600af030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:07.641 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.637+0000 7fb6653c7700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6600cb190 con 0x7fb66015e060 2023-11-08T19:26:07.641 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.637+0000 7fb6653c7700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6600cbda0 con 0x7fb6600ce620 2023-11-08T19:26:07.641 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.637+0000 7fb6653c7700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6600cb470 con 0x7fb66015dc80 2023-11-08T19:26:07.642 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.637+0000 7fb65f7fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb6600ce620 0x7fb6600af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:07.642 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.637+0000 7fb65e7fc700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fb66015e060 0x7fb6600cdf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:44250/0 (socket says 172.21.15.149:44250) 2023-11-08T19:26:07.642 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.637+0000 7fb65e7fc700 1 -- 172.21.15.149:0/3069282919 learned_addr learned my addr 172.21.15.149:0/3069282919 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:26:07.642 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.637+0000 7fb65f7fe700 1 -- 172.21.15.149:0/3069282919 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb66015dc80 msgr2=0x7fb6600aeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:07.643 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.637+0000 7fb65f7fe700 1 --2- 172.21.15.149:0/3069282919 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb66015dc80 0x7fb6600aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:07.643 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.637+0000 7fb65f7fe700 1 -- 172.21.15.149:0/3069282919 >> v1:172.21.15.149:6789/0 conn(0x7fb66015e060 legacy=0x7fb6600cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:07.643 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.637+0000 7fb65f7fe700 1 -- 172.21.15.149:0/3069282919 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6600cb750 con 0x7fb6600ce620 2023-11-08T19:26:07.643 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.637+0000 7fb65dffb700 1 -- 172.21.15.149:0/3069282919 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 311181119 0 0) 0x7fb6600cb190 con 0x7fb66015e060 2023-11-08T19:26:07.643 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.637+0000 7fb65f7fe700 1 --2- 172.21.15.149:0/3069282919 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6600ce620 0x7fb6600af030 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fb658009d90 tx=0x7fb65800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15e7f66d88279c46 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:07.644 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.637+0000 7fb65dffb700 1 -- 172.21.15.149:0/3069282919 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65800e070 con 0x7fb6600ce620 2023-11-08T19:26:07.644 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.638+0000 7fb65dffb700 1 -- 172.21.15.149:0/3069282919 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb65800bbd0 con 0x7fb6600ce620 2023-11-08T19:26:07.644 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.638+0000 7fb65dffb700 1 -- 172.21.15.149:0/3069282919 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb658012430 con 0x7fb6600ce620 2023-11-08T19:26:07.644 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.638+0000 7fb6653c7700 1 -- 172.21.15.149:0/3069282919 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6600ce620 msgr2=0x7fb6600af030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:07.644 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.638+0000 7fb6653c7700 1 --2- 172.21.15.149:0/3069282919 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6600ce620 0x7fb6600af030 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fb658009d90 tx=0x7fb65800b330 comp rx=0 tx=0).stop 2023-11-08T19:26:07.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.638+0000 7fb6653c7700 1 -- 172.21.15.149:0/3069282919 shutdown_connections 2023-11-08T19:26:07.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.638+0000 7fb6653c7700 1 --2- 172.21.15.149:0/3069282919 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6600ce620 0x7fb6600af030 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:07.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.638+0000 7fb6653c7700 1 --2- 172.21.15.149:0/3069282919 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb66015dc80 0x7fb6600aeaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:07.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.638+0000 7fb6653c7700 1 -- 172.21.15.149:0/3069282919 >> 172.21.15.149:0/3069282919 conn(0x7fb6600cc860 msgr2=0x7fb6600ccc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:07.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.638+0000 7fb6653c7700 1 -- 172.21.15.149:0/3069282919 shutdown_connections 2023-11-08T19:26:07.646 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.638+0000 7fb6653c7700 1 -- 172.21.15.149:0/3069282919 wait complete. 2023-11-08T19:26:07.648 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.639+0000 7fb6653c7700 1 Processor -- start 2023-11-08T19:26:07.648 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.639+0000 7fb6653c7700 1 -- start start 2023-11-08T19:26:07.649 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.640+0000 7fb6653c7700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6600ce620 0x7fb6601e7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:07.649 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.640+0000 7fb6653c7700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb66015dc80 0x7fb6601e7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:07.649 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.640+0000 7fb6653c7700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb66015e060 0x7fb6600c4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:07.649 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.640+0000 7fb6653c7700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6600c6eb0 con 0x7fb6600ce620 2023-11-08T19:26:07.649 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.640+0000 7fb6653c7700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6600c7100 con 0x7fb66015dc80 2023-11-08T19:26:07.650 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.640+0000 7fb6653c7700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6600c43c0 con 0x7fb66015e060 2023-11-08T19:26:07.650 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.640+0000 7fb65effd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6600ce620 0x7fb6601e7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:07.650 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.640+0000 7fb65effd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6600ce620 0x7fb6601e7730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42256/0 (socket says 172.21.15.149:42256) 2023-11-08T19:26:07.650 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.640+0000 7fb65effd700 1 -- 172.21.15.149:0/2926276872 learned_addr learned my addr 172.21.15.149:0/2926276872 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:07.651 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.640+0000 7fb65e7fc700 1 --2- 172.21.15.149:0/2926276872 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb66015dc80 0x7fb6601e7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:07.652 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.640+0000 7fb65f7fe700 1 --2- 172.21.15.149:0/2926276872 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb66015e060 0x7fb6600c4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:07.652 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.641+0000 7fb65effd700 1 -- 172.21.15.149:0/2926276872 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb66015e060 msgr2=0x7fb6600c4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:07.652 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.641+0000 7fb65effd700 1 --2- 172.21.15.149:0/2926276872 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb66015e060 0x7fb6600c4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:07.652 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.641+0000 7fb65effd700 1 -- 172.21.15.149:0/2926276872 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb66015dc80 msgr2=0x7fb6601e7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:07.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.641+0000 7fb65effd700 1 --2- 172.21.15.149:0/2926276872 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb66015dc80 0x7fb6601e7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:07.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.641+0000 7fb65effd700 1 -- 172.21.15.149:0/2926276872 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb658009a70 con 0x7fb6600ce620 2023-11-08T19:26:07.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.641+0000 7fb65effd700 1 --2- 172.21.15.149:0/2926276872 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6600ce620 0x7fb6601e7730 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fb65400b530 tx=0x7fb65400b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:07.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.641+0000 7fb6477fe700 1 -- 172.21.15.149:0/2926276872 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb654011830 con 0x7fb6600ce620 2023-11-08T19:26:07.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.641+0000 7fb6477fe700 1 -- 172.21.15.149:0/2926276872 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6540119b0 con 0x7fb6600ce620 2023-11-08T19:26:07.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.641+0000 7fb6477fe700 1 -- 172.21.15.149:0/2926276872 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb654011d60 con 0x7fb6600ce620 2023-11-08T19:26:07.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.641+0000 7fb6653c7700 1 -- 172.21.15.149:0/2926276872 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6600c46a0 con 0x7fb6600ce620 2023-11-08T19:26:07.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.641+0000 7fb6653c7700 1 -- 172.21.15.149:0/2926276872 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6600c73e0 con 0x7fb6600ce620 2023-11-08T19:26:07.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.642+0000 7fb6653c7700 1 -- 172.21.15.149:0/2926276872 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb66004f730 con 0x7fb6600ce620 2023-11-08T19:26:07.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.642+0000 7fb6477fe700 1 -- 172.21.15.149:0/2926276872 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb65401a400 con 0x7fb6600ce620 2023-11-08T19:26:07.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.643+0000 7fb6477fe700 1 --2- 172.21.15.149:0/2926276872 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb64c06af00 0x7fb64c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:07.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.643+0000 7fb6477fe700 1 -- 172.21.15.149:0/2926276872 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6240+0+0 (secure 0 0 0) 0x7fb654089840 con 0x7fb6600ce620 2023-11-08T19:26:07.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.643+0000 7fb65e7fc700 1 --2- 172.21.15.149:0/2926276872 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb64c06af00 0x7fb64c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:07.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.643+0000 7fb65e7fc700 1 --2- 172.21.15.149:0/2926276872 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb64c06af00 0x7fb64c06d3c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fb660161150 tx=0x7fb650007be0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:07.657 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.648+0000 7fb6477fe700 1 -- 172.21.15.149:0/2926276872 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb654054770 con 0x7fb6600ce620 2023-11-08T19:26:07.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.838+0000 7fb6653c7700 1 -- 172.21.15.149:0/2926276872 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7fb6600b5d60 con 0x7fb6600ce620 2023-11-08T19:26:07.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.838+0000 7fb6477fe700 1 -- 172.21.15.149:0/2926276872 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v79) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb6540150a0 con 0x7fb6600ce620 2023-11-08T19:26:07.841 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:26:07.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.840+0000 7fb6653c7700 1 -- 172.21.15.149:0/2926276872 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb64c06af00 msgr2=0x7fb64c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:07.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.840+0000 7fb6653c7700 1 --2- 172.21.15.149:0/2926276872 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb64c06af00 0x7fb64c06d3c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fb660161150 tx=0x7fb650007be0 comp rx=0 tx=0).stop 2023-11-08T19:26:07.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.840+0000 7fb6653c7700 1 -- 172.21.15.149:0/2926276872 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6600ce620 msgr2=0x7fb6601e7730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:07.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.840+0000 7fb6653c7700 1 --2- 172.21.15.149:0/2926276872 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6600ce620 0x7fb6601e7730 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fb65400b530 tx=0x7fb65400b8f0 comp rx=0 tx=0).stop 2023-11-08T19:26:07.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.840+0000 7fb6653c7700 1 -- 172.21.15.149:0/2926276872 shutdown_connections 2023-11-08T19:26:07.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.840+0000 7fb6653c7700 1 --2- 172.21.15.149:0/2926276872 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb64c06af00 0x7fb64c06d3c0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:07.845 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.840+0000 7fb6653c7700 1 --2- 172.21.15.149:0/2926276872 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb66015e060 0x7fb6600c4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:07.845 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.840+0000 7fb6653c7700 1 --2- 172.21.15.149:0/2926276872 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6600ce620 0x7fb6601e7730 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:07.845 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.840+0000 7fb6653c7700 1 --2- 172.21.15.149:0/2926276872 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb66015dc80 0x7fb6601e7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:07.845 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.840+0000 7fb6653c7700 1 -- 172.21.15.149:0/2926276872 >> 172.21.15.149:0/2926276872 conn(0x7fb6600cc860 msgr2=0x7fb6600716e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:07.846 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.840+0000 7fb6653c7700 1 -- 172.21.15.149:0/2926276872 shutdown_connections 2023-11-08T19:26:07.846 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.840+0000 7fb6653c7700 1 -- 172.21.15.149:0/2926276872 wait complete. 2023-11-08T19:26:07.854 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-08T19:26:07.978 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.975+0000 7f0307ec3700 1 Processor -- start 2023-11-08T19:26:07.978 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.976+0000 7f0307ec3700 1 -- start start 2023-11-08T19:26:07.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.976+0000 7f0307ec3700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f030006ab80 0x7f03000caf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:07.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.976+0000 7f0307ec3700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f030015e320 con 0x7f030015df40 2023-11-08T19:26:07.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.976+0000 7f0307ec3700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f030006b020 con 0x7f03000cf1c0 2023-11-08T19:26:07.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.976+0000 7f0307ec3700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f030006b2e0 con 0x7f030006ab80 2023-11-08T19:26:07.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.977+0000 7f0305c5f700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f030015df40 0x7f030006c0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:44262/0 (socket says 172.21.15.149:44262) 2023-11-08T19:26:07.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.977+0000 7f0305c5f700 1 -- 172.21.15.149:0/2702951692 learned_addr learned my addr 172.21.15.149:0/2702951692 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:26:07.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.977+0000 7f030545e700 1 --2- 172.21.15.149:0/2702951692 >> v2:172.21.15.160:3300/0 conn(0x7f030006ab80 0x7f03000caf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:07.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.977+0000 7f0304c5d700 1 -- 172.21.15.149:0/2702951692 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2669342182 0 0) 0x7f030015e320 con 0x7f030015df40 2023-11-08T19:26:07.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.977+0000 7f0304c5d700 1 -- 172.21.15.149:0/2702951692 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02ec0035b0 con 0x7f030015df40 2023-11-08T19:26:07.983 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.977+0000 7f0304c5d700 1 -- 172.21.15.149:0/2702951692 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 478519257 0 0) 0x7f030006b020 con 0x7f03000cf1c0 2023-11-08T19:26:07.983 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.977+0000 7f0304c5d700 1 -- 172.21.15.149:0/2702951692 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f030015e320 con 0x7f03000cf1c0 2023-11-08T19:26:07.983 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.977+0000 7f0304c5d700 1 -- 172.21.15.149:0/2702951692 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 759000290 0 0) 0x7f02ec0035b0 con 0x7f030015df40 2023-11-08T19:26:07.983 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.977+0000 7f030545e700 1 -- 172.21.15.149:0/2702951692 >> v1:172.21.15.160:6789/0 conn(0x7f03000cf1c0 legacy=0x7f03000ce540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:07.983 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.977+0000 7f030545e700 1 -- 172.21.15.149:0/2702951692 >> v1:172.21.15.149:6789/0 conn(0x7f030015df40 legacy=0x7f030006c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:07.984 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.977+0000 7f030545e700 1 -- 172.21.15.149:0/2702951692 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f030006b5c0 con 0x7f030006ab80 2023-11-08T19:26:07.984 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.977+0000 7f030545e700 1 --2- 172.21.15.149:0/2702951692 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f030006ab80 0x7f03000caf50 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f02fc009840 tx=0x7f02fc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e6fc50ffe2894af server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:07.984 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.977+0000 7f0304c5d700 1 -- 172.21.15.149:0/2702951692 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f0001670 con 0x7f030006ab80 2023-11-08T19:26:07.984 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.977+0000 7f0304c5d700 1 -- 172.21.15.149:0/2702951692 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02fc004030 con 0x7f030006ab80 2023-11-08T19:26:07.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.977+0000 7f0304c5d700 1 -- 172.21.15.149:0/2702951692 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02fc0043a0 con 0x7f030006ab80 2023-11-08T19:26:07.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.978+0000 7f0307ec3700 1 -- 172.21.15.149:0/2702951692 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f030006ab80 msgr2=0x7f03000caf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:07.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.978+0000 7f0307ec3700 1 --2- 172.21.15.149:0/2702951692 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f030006ab80 0x7f03000caf50 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f02fc009840 tx=0x7f02fc009b50 comp rx=0 tx=0).stop 2023-11-08T19:26:07.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.978+0000 7f0307ec3700 1 -- 172.21.15.149:0/2702951692 shutdown_connections 2023-11-08T19:26:07.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.978+0000 7f0307ec3700 1 --2- 172.21.15.149:0/2702951692 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f030006ab80 0x7f03000caf50 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:07.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.978+0000 7f0307ec3700 1 -- 172.21.15.149:0/2702951692 >> 172.21.15.149:0/2702951692 conn(0x7f03000d0640 msgr2=0x7f03000d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:07.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.978+0000 7f0307ec3700 1 -- 172.21.15.149:0/2702951692 shutdown_connections 2023-11-08T19:26:07.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.978+0000 7f0307ec3700 1 -- 172.21.15.149:0/2702951692 wait complete. 2023-11-08T19:26:07.990 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.979+0000 7f0307ec3700 1 Processor -- start 2023-11-08T19:26:07.990 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.979+0000 7f0307ec3700 1 -- start start 2023-11-08T19:26:07.991 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.980+0000 7f0307ec3700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f030006ab80 0x7f0300160d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:07.991 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.980+0000 7f0307ec3700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03000cf1c0 0x7f03000ae760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:07.991 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.980+0000 7f0307ec3700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f030015df40 0x7f03001567a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:07.991 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.980+0000 7f0307ec3700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03000c4dd0 con 0x7f03000cf1c0 2023-11-08T19:26:07.992 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.980+0000 7f0307ec3700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03001612c0 con 0x7f030015df40 2023-11-08T19:26:07.992 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.980+0000 7f0307ec3700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f030015f460 con 0x7f030006ab80 2023-11-08T19:26:07.992 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.980+0000 7f030545e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03000cf1c0 0x7f03000ae760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:07.992 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.980+0000 7f030545e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03000cf1c0 0x7f03000ae760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42268/0 (socket says 172.21.15.149:42268) 2023-11-08T19:26:07.993 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.980+0000 7f030545e700 1 -- 172.21.15.149:0/3387952420 learned_addr learned my addr 172.21.15.149:0/3387952420 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:07.993 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.980+0000 7f0306460700 1 --2- 172.21.15.149:0/3387952420 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f030015df40 0x7f03001567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:07.993 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.980+0000 7f0305c5f700 1 --2- 172.21.15.149:0/3387952420 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f030006ab80 0x7f0300160d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:07.993 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.980+0000 7f030545e700 1 -- 172.21.15.149:0/3387952420 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f030006ab80 msgr2=0x7f0300160d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:07.993 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.980+0000 7f030545e700 1 --2- 172.21.15.149:0/3387952420 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f030006ab80 0x7f0300160d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:07.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.980+0000 7f030545e700 1 -- 172.21.15.149:0/3387952420 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f030015df40 msgr2=0x7f03001567a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:07.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.980+0000 7f030545e700 1 --2- 172.21.15.149:0/3387952420 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f030015df40 0x7f03001567a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:07.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.980+0000 7f030545e700 1 -- 172.21.15.149:0/3387952420 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02fc0094a0 con 0x7f03000cf1c0 2023-11-08T19:26:07.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.981+0000 7f030545e700 1 --2- 172.21.15.149:0/3387952420 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03000cf1c0 0x7f03000ae760 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f02fc009b90 tx=0x7f02fc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:07.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.981+0000 7f02f67fc700 1 -- 172.21.15.149:0/3387952420 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02fc004590 con 0x7f03000cf1c0 2023-11-08T19:26:07.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.981+0000 7f02f67fc700 1 -- 172.21.15.149:0/3387952420 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02fc01f070 con 0x7f03000cf1c0 2023-11-08T19:26:07.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.981+0000 7f0307ec3700 1 -- 172.21.15.149:0/3387952420 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f030015f740 con 0x7f03000cf1c0 2023-11-08T19:26:07.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.981+0000 7f02f67fc700 1 -- 172.21.15.149:0/3387952420 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02fc011870 con 0x7f03000cf1c0 2023-11-08T19:26:07.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.981+0000 7f0307ec3700 1 -- 172.21.15.149:0/3387952420 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f030015fd00 con 0x7f03000cf1c0 2023-11-08T19:26:07.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.982+0000 7f0307ec3700 1 -- 172.21.15.149:0/3387952420 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0300072680 con 0x7f03000cf1c0 2023-11-08T19:26:07.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.982+0000 7f02f67fc700 1 -- 172.21.15.149:0/3387952420 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f02fc0119d0 con 0x7f03000cf1c0 2023-11-08T19:26:07.997 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.982+0000 7f02f67fc700 1 --2- 172.21.15.149:0/3387952420 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f02e406af00 0x7f02e406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:07.997 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.982+0000 7f02f67fc700 1 -- 172.21.15.149:0/3387952420 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6240+0+0 (secure 0 0 0) 0x7f02fc021070 con 0x7f03000cf1c0 2023-11-08T19:26:07.997 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.983+0000 7f0305c5f700 1 --2- 172.21.15.149:0/3387952420 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f02e406af00 0x7f02e406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:07.998 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.983+0000 7f0305c5f700 1 --2- 172.21.15.149:0/3387952420 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f02e406af00 0x7f02e406d3c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f02f00011e0 tx=0x7f02f0001490 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:07.998 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:07.987+0000 7f02f67fc700 1 -- 172.21.15.149:0/3387952420 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f02fc055fa0 con 0x7f03000cf1c0 2023-11-08T19:26:08.134 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T19:26:08.136 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T19:26:08.184 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.182+0000 7f0307ec3700 1 -- 172.21.15.149:0/3387952420 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7f03000c4f10 con 0x7f03000cf1c0 2023-11-08T19:26:08.185 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.182+0000 7f02f67fc700 1 -- 172.21.15.149:0/3387952420 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v79) v1 ==== 103+0+11 (secure 0 0 0) 0x7f03000c4f10 con 0x7f03000cf1c0 2023-11-08T19:26:08.185 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:26:08.187 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.184+0000 7f0307ec3700 1 -- 172.21.15.149:0/3387952420 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f02e406af00 msgr2=0x7f02e406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:08.187 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.184+0000 7f0307ec3700 1 --2- 172.21.15.149:0/3387952420 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f02e406af00 0x7f02e406d3c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f02f00011e0 tx=0x7f02f0001490 comp rx=0 tx=0).stop 2023-11-08T19:26:08.187 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.185+0000 7f0307ec3700 1 -- 172.21.15.149:0/3387952420 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03000cf1c0 msgr2=0x7f03000ae760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:08.188 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.185+0000 7f0307ec3700 1 --2- 172.21.15.149:0/3387952420 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03000cf1c0 0x7f03000ae760 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f02fc009b90 tx=0x7f02fc004750 comp rx=0 tx=0).stop 2023-11-08T19:26:08.188 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.185+0000 7f0307ec3700 1 -- 172.21.15.149:0/3387952420 shutdown_connections 2023-11-08T19:26:08.188 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.185+0000 7f0307ec3700 1 --2- 172.21.15.149:0/3387952420 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f02e406af00 0x7f02e406d3c0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:08.188 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.185+0000 7f0307ec3700 1 --2- 172.21.15.149:0/3387952420 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f030015df40 0x7f03001567a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:08.189 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.185+0000 7f0307ec3700 1 --2- 172.21.15.149:0/3387952420 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f030006ab80 0x7f0300160d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:08.189 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.185+0000 7f0307ec3700 1 --2- 172.21.15.149:0/3387952420 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03000cf1c0 0x7f03000ae760 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:08.189 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.185+0000 7f0307ec3700 1 -- 172.21.15.149:0/3387952420 >> 172.21.15.149:0/3387952420 conn(0x7f03000d0640 msgr2=0x7f03000caf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:08.190 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.185+0000 7f0307ec3700 1 -- 172.21.15.149:0/3387952420 shutdown_connections 2023-11-08T19:26:08.190 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.185+0000 7f0307ec3700 1 -- 172.21.15.149:0/3387952420 wait complete. 2023-11-08T19:26:08.199 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-08T19:26:08.364 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.361+0000 7f5aa01e2700 1 Processor -- start 2023-11-08T19:26:08.364 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.362+0000 7f5aa01e2700 1 -- start start 2023-11-08T19:26:08.367 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.363+0000 7f5aa01e2700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5a9815abf0 0x7f5a980b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:08.367 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.363+0000 7f5aa01e2700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f5a980d1130 0x7f5a980cc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:08.367 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.363+0000 7f5aa01e2700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a980b6470 con 0x7f5a980cc6a0 2023-11-08T19:26:08.368 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.363+0000 7f5aa01e2700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a980b66a0 con 0x7f5a980d1130 2023-11-08T19:26:08.368 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.363+0000 7f5aa01e2700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a980d04a0 con 0x7f5a9815abf0 2023-11-08T19:26:08.368 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.363+0000 7f5a9d77d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f5a980d1130 0x7f5a980cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:08.369 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.363+0000 7f5a9d77d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f5a980d1130 0x7f5a980cc160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42276/0 (socket says 172.21.15.149:42276) 2023-11-08T19:26:08.369 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.363+0000 7f5a9d77d700 1 -- 172.21.15.149:0/1992059455 learned_addr learned my addr 172.21.15.149:0/1992059455 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:08.369 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.363+0000 7f5a9df7e700 1 --2- 172.21.15.149:0/1992059455 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5a9815abf0 0x7f5a980b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:08.369 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.363+0000 7f5a9d77d700 1 -- 172.21.15.149:0/1992059455 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5a9815abf0 msgr2=0x7f5a980b5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:08.370 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.363+0000 7f5a9d77d700 1 --2- 172.21.15.149:0/1992059455 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5a9815abf0 0x7f5a980b5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:08.370 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.363+0000 7f5a9d77d700 1 -- 172.21.15.149:0/1992059455 >> v1:172.21.15.160:6789/0 conn(0x7f5a980cc6a0 legacy=0x7f5a980ce210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:08.370 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.363+0000 7f5a9d77d700 1 -- 172.21.15.149:0/1992059455 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a9815afd0 con 0x7f5a980d1130 2023-11-08T19:26:08.370 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.363+0000 7f5a9df7e700 1 --2- 172.21.15.149:0/1992059455 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5a9815abf0 0x7f5a980b5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:26:08.371 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.363+0000 7f5a9d77d700 1 --2- 172.21.15.149:0/1992059455 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a980d1130 0x7f5a980cc160 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f5a880098f0 tx=0x7f5a88009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35e0cd159bee0347 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:08.371 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.363+0000 7f5a9cf7c700 1 -- 172.21.15.149:0/1992059455 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a8800b8a0 con 0x7f5a980d1130 2023-11-08T19:26:08.371 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.363+0000 7f5a9cf7c700 1 -- 172.21.15.149:0/1992059455 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a8800ba00 con 0x7f5a980d1130 2023-11-08T19:26:08.371 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.363+0000 7f5a9cf7c700 1 -- 172.21.15.149:0/1992059455 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a8800bd90 con 0x7f5a980d1130 2023-11-08T19:26:08.372 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.364+0000 7f5aa01e2700 1 -- 172.21.15.149:0/1992059455 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a980d1130 msgr2=0x7f5a980cc160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:08.372 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.364+0000 7f5aa01e2700 1 --2- 172.21.15.149:0/1992059455 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a980d1130 0x7f5a980cc160 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f5a880098f0 tx=0x7f5a88009c00 comp rx=0 tx=0).stop 2023-11-08T19:26:08.372 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.364+0000 7f5aa01e2700 1 -- 172.21.15.149:0/1992059455 shutdown_connections 2023-11-08T19:26:08.372 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.364+0000 7f5aa01e2700 1 --2- 172.21.15.149:0/1992059455 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5a9815abf0 0x7f5a980b5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:08.372 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.364+0000 7f5aa01e2700 1 --2- 172.21.15.149:0/1992059455 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a980d1130 0x7f5a980cc160 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:08.372 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.364+0000 7f5aa01e2700 1 -- 172.21.15.149:0/1992059455 >> 172.21.15.149:0/1992059455 conn(0x7f5a980d0640 msgr2=0x7f5a980d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:08.373 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.364+0000 7f5aa01e2700 1 -- 172.21.15.149:0/1992059455 shutdown_connections 2023-11-08T19:26:08.373 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.364+0000 7f5aa01e2700 1 -- 172.21.15.149:0/1992059455 wait complete. 2023-11-08T19:26:08.373 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.365+0000 7f5aa01e2700 1 Processor -- start 2023-11-08T19:26:08.374 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.365+0000 7f5aa01e2700 1 -- start start 2023-11-08T19:26:08.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.366+0000 7f5aa01e2700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a980cc6a0 0x7f5a980c9c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:08.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.366+0000 7f5aa01e2700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5a980d1130 0x7f5a98150950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:08.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.366+0000 7f5aa01e2700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5a9815abf0 0x7f5a98150e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:08.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.366+0000 7f5aa01e2700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a98152040 con 0x7f5a980cc6a0 2023-11-08T19:26:08.378 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.366+0000 7f5aa01e2700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a98152320 con 0x7f5a980d1130 2023-11-08T19:26:08.378 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.366+0000 7f5aa01e2700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a98152600 con 0x7f5a9815abf0 2023-11-08T19:26:08.378 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.366+0000 7f5a9df7e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a980cc6a0 0x7f5a980c9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:08.378 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.366+0000 7f5a9df7e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a980cc6a0 0x7f5a980c9c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42280/0 (socket says 172.21.15.149:42280) 2023-11-08T19:26:08.379 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.366+0000 7f5a9df7e700 1 -- 172.21.15.149:0/80960230 learned_addr learned my addr 172.21.15.149:0/80960230 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:08.379 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.366+0000 7f5a9d77d700 1 --2- 172.21.15.149:0/80960230 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5a980d1130 0x7f5a98150950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:08.379 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.366+0000 7f5a9e77f700 1 --2- 172.21.15.149:0/80960230 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5a9815abf0 0x7f5a98150e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:08.379 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.366+0000 7f5a9df7e700 1 -- 172.21.15.149:0/80960230 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5a9815abf0 msgr2=0x7f5a98150e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:08.380 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.366+0000 7f5a9df7e700 1 --2- 172.21.15.149:0/80960230 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5a9815abf0 0x7f5a98150e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:08.380 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.366+0000 7f5a9df7e700 1 -- 172.21.15.149:0/80960230 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5a980d1130 msgr2=0x7f5a98150950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:08.380 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.366+0000 7f5a9df7e700 1 --2- 172.21.15.149:0/80960230 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5a980d1130 0x7f5a98150950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:08.380 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.366+0000 7f5a9df7e700 1 -- 172.21.15.149:0/80960230 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a88009550 con 0x7f5a980cc6a0 2023-11-08T19:26:08.380 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.366+0000 7f5a9d77d700 1 --2- 172.21.15.149:0/80960230 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5a980d1130 0x7f5a98150950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:26:08.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.366+0000 7f5a9df7e700 1 --2- 172.21.15.149:0/80960230 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a980cc6a0 0x7f5a980c9c30 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f5a9400e810 tx=0x7f5a9400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:08.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.367+0000 7f5a8e7fc700 1 -- 172.21.15.149:0/80960230 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a94013610 con 0x7f5a980cc6a0 2023-11-08T19:26:08.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.367+0000 7f5a8e7fc700 1 -- 172.21.15.149:0/80960230 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a94013770 con 0x7f5a980cc6a0 2023-11-08T19:26:08.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.367+0000 7f5aa01e2700 1 -- 172.21.15.149:0/80960230 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a981528e0 con 0x7f5a980cc6a0 2023-11-08T19:26:08.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.367+0000 7f5a8e7fc700 1 -- 172.21.15.149:0/80960230 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a94013b20 con 0x7f5a980cc6a0 2023-11-08T19:26:08.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.367+0000 7f5aa01e2700 1 -- 172.21.15.149:0/80960230 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a980ca170 con 0x7f5a980cc6a0 2023-11-08T19:26:08.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.368+0000 7f5aa01e2700 1 -- 172.21.15.149:0/80960230 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a980afed0 con 0x7f5a980cc6a0 2023-11-08T19:26:08.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.368+0000 7f5a8e7fc700 1 -- 172.21.15.149:0/80960230 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5a94013c80 con 0x7f5a980cc6a0 2023-11-08T19:26:08.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.368+0000 7f5a8e7fc700 1 --2- 172.21.15.149:0/80960230 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5a7c06af00 0x7f5a7c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:08.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.368+0000 7f5a8e7fc700 1 -- 172.21.15.149:0/80960230 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6240+0+0 (secure 0 0 0) 0x7f5a940893b0 con 0x7f5a980cc6a0 2023-11-08T19:26:08.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.368+0000 7f5a9d77d700 1 --2- 172.21.15.149:0/80960230 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5a7c06af00 0x7f5a7c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:08.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.369+0000 7f5a9d77d700 1 --2- 172.21.15.149:0/80960230 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5a7c06af00 0x7f5a7c06d3c0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f5a88009c40 tx=0x7f5a88008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:08.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.373+0000 7f5a8e7fc700 1 -- 172.21.15.149:0/80960230 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5a940542e0 con 0x7f5a980cc6a0 2023-11-08T19:26:08.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.561+0000 7f5aa01e2700 1 -- 172.21.15.149:0/80960230 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7f5a98152180 con 0x7f5a980cc6a0 2023-11-08T19:26:08.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.561+0000 7f5a8e7fc700 1 -- 172.21.15.149:0/80960230 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v79) v1 ==== 107+0+11 (secure 0 0 0) 0x7f5a98152180 con 0x7f5a980cc6a0 2023-11-08T19:26:08.564 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:26:08.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.563+0000 7f5aa01e2700 1 -- 172.21.15.149:0/80960230 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5a7c06af00 msgr2=0x7f5a7c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:08.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.563+0000 7f5aa01e2700 1 --2- 172.21.15.149:0/80960230 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5a7c06af00 0x7f5a7c06d3c0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f5a88009c40 tx=0x7f5a88008030 comp rx=0 tx=0).stop 2023-11-08T19:26:08.567 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.563+0000 7f5aa01e2700 1 -- 172.21.15.149:0/80960230 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a980cc6a0 msgr2=0x7f5a980c9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:08.567 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.563+0000 7f5aa01e2700 1 --2- 172.21.15.149:0/80960230 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a980cc6a0 0x7f5a980c9c30 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f5a9400e810 tx=0x7f5a9400eb20 comp rx=0 tx=0).stop 2023-11-08T19:26:08.567 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.563+0000 7f5aa01e2700 1 -- 172.21.15.149:0/80960230 shutdown_connections 2023-11-08T19:26:08.567 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.563+0000 7f5aa01e2700 1 --2- 172.21.15.149:0/80960230 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5a7c06af00 0x7f5a7c06d3c0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:08.568 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.563+0000 7f5aa01e2700 1 --2- 172.21.15.149:0/80960230 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5a9815abf0 0x7f5a98150e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:08.568 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.563+0000 7f5aa01e2700 1 --2- 172.21.15.149:0/80960230 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a980cc6a0 0x7f5a980c9c30 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:08.568 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.563+0000 7f5aa01e2700 1 --2- 172.21.15.149:0/80960230 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5a980d1130 0x7f5a98150950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:08.569 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.563+0000 7f5aa01e2700 1 -- 172.21.15.149:0/80960230 >> 172.21.15.149:0/80960230 conn(0x7f5a980d0640 msgr2=0x7f5a98159ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:08.569 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.563+0000 7f5aa01e2700 1 -- 172.21.15.149:0/80960230 shutdown_connections 2023-11-08T19:26:08.569 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.563+0000 7f5aa01e2700 1 -- 172.21.15.149:0/80960230 wait complete. 2023-11-08T19:26:08.578 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-08T19:26:08.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.698+0000 7f465cb7a700 1 Processor -- start 2023-11-08T19:26:08.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.698+0000 7f465cb7a700 1 -- start start 2023-11-08T19:26:08.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.699+0000 7f465cb7a700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f46580cc140 0x7f46580cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:08.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.699+0000 7f465cb7a700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f46580b2cd0 0x7f465815d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:08.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.699+0000 7f465cb7a700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46580cce50 con 0x7f46580b2850 2023-11-08T19:26:08.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.699+0000 7f465cb7a700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46580b2430 con 0x7f46580cc140 2023-11-08T19:26:08.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.699+0000 7f465cb7a700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46580cc520 con 0x7f46580b2cd0 2023-11-08T19:26:08.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.699+0000 7f465659c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f46580cc140 0x7f46580cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:08.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.699+0000 7f465659c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f46580cc140 0x7f46580cc910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42288/0 (socket says 172.21.15.149:42288) 2023-11-08T19:26:08.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.699+0000 7f465659c700 1 -- 172.21.15.149:0/3684182606 learned_addr learned my addr 172.21.15.149:0/3684182606 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:08.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.699+0000 7f4656d9d700 1 --2- 172.21.15.149:0/3684182606 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f46580b2cd0 0x7f465815d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:08.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.699+0000 7f465659c700 1 -- 172.21.15.149:0/3684182606 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f46580b2cd0 msgr2=0x7f465815d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:08.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.699+0000 7f465659c700 1 --2- 172.21.15.149:0/3684182606 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f46580b2cd0 0x7f465815d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:08.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.699+0000 7f465659c700 1 -- 172.21.15.149:0/3684182606 >> v1:172.21.15.160:6789/0 conn(0x7f46580b2850 legacy=0x7f46580cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:08.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.699+0000 7f465659c700 1 -- 172.21.15.149:0/3684182606 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46580b17b0 con 0x7f46580cc140 2023-11-08T19:26:08.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.700+0000 7f465659c700 1 --2- 172.21.15.149:0/3684182606 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46580cc140 0x7f46580cc910 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f464c006fd0 tx=0x7f464c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=661183adf773cb3d server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:08.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.700+0000 7f465559a700 1 -- 172.21.15.149:0/3684182606 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464c005e30 con 0x7f46580cc140 2023-11-08T19:26:08.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.700+0000 7f465559a700 1 -- 172.21.15.149:0/3684182606 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f464c006030 con 0x7f46580cc140 2023-11-08T19:26:08.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.700+0000 7f465559a700 1 -- 172.21.15.149:0/3684182606 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464c0063c0 con 0x7f46580cc140 2023-11-08T19:26:08.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.700+0000 7f465cb7a700 1 -- 172.21.15.149:0/3684182606 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46580cc140 msgr2=0x7f46580cc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:08.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.700+0000 7f465cb7a700 1 --2- 172.21.15.149:0/3684182606 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46580cc140 0x7f46580cc910 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f464c006fd0 tx=0x7f464c009bd0 comp rx=0 tx=0).stop 2023-11-08T19:26:08.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.700+0000 7f465cb7a700 1 -- 172.21.15.149:0/3684182606 shutdown_connections 2023-11-08T19:26:08.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.700+0000 7f465cb7a700 1 --2- 172.21.15.149:0/3684182606 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f46580b2cd0 0x7f465815d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:08.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.700+0000 7f465cb7a700 1 --2- 172.21.15.149:0/3684182606 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46580cc140 0x7f46580cc910 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:08.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.700+0000 7f465cb7a700 1 -- 172.21.15.149:0/3684182606 >> 172.21.15.149:0/3684182606 conn(0x7f4658099a40 msgr2=0x7f46580d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:08.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.700+0000 7f465cb7a700 1 -- 172.21.15.149:0/3684182606 shutdown_connections 2023-11-08T19:26:08.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.700+0000 7f465cb7a700 1 -- 172.21.15.149:0/3684182606 wait complete. 2023-11-08T19:26:08.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.702+0000 7f465cb7a700 1 Processor -- start 2023-11-08T19:26:08.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.702+0000 7f465cb7a700 1 -- start start 2023-11-08T19:26:08.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.702+0000 7f465cb7a700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f46580b2850 0x7f4658156b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:08.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.702+0000 7f465cb7a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46580b2cd0 0x7f46580af8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:08.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.702+0000 7f465cb7a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f46580cc140 0x7f465809b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:08.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.702+0000 7f465cb7a700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f465809b330 con 0x7f46580b2cd0 2023-11-08T19:26:08.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.702+0000 7f465cb7a700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4658157070 con 0x7f46580cc140 2023-11-08T19:26:08.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.702+0000 7f465cb7a700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f465809a720 con 0x7f46580b2850 2023-11-08T19:26:08.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.703+0000 7f4655d9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46580b2cd0 0x7f46580af8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:08.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.703+0000 7f4655d9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46580b2cd0 0x7f46580af8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42296/0 (socket says 172.21.15.149:42296) 2023-11-08T19:26:08.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.703+0000 7f4655d9b700 1 -- 172.21.15.149:0/3790633324 learned_addr learned my addr 172.21.15.149:0/3790633324 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:08.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.703+0000 7f4655d9b700 1 -- 172.21.15.149:0/3790633324 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f46580b2850 msgr2=0x7f4658156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:08.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.703+0000 7f4655d9b700 1 --2- 172.21.15.149:0/3790633324 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f46580b2850 0x7f4658156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:08.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.703+0000 7f4655d9b700 1 -- 172.21.15.149:0/3790633324 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f46580cc140 msgr2=0x7f465809b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:08.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.703+0000 7f4655d9b700 1 --2- 172.21.15.149:0/3790633324 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f46580cc140 0x7f465809b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:08.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.703+0000 7f4655d9b700 1 -- 172.21.15.149:0/3790633324 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f464c009500 con 0x7f46580b2cd0 2023-11-08T19:26:08.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.703+0000 7f4655d9b700 1 --2- 172.21.15.149:0/3790633324 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46580b2cd0 0x7f46580af8b0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f464800c4a0 tx=0x7f464800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:08.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.703+0000 7f4646ffd700 1 -- 172.21.15.149:0/3790633324 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46480054e0 con 0x7f46580b2cd0 2023-11-08T19:26:08.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.703+0000 7f4646ffd700 1 -- 172.21.15.149:0/3790633324 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4648003680 con 0x7f46580b2cd0 2023-11-08T19:26:08.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.703+0000 7f465cb7a700 1 -- 172.21.15.149:0/3790633324 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f465809aa00 con 0x7f46580b2cd0 2023-11-08T19:26:08.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.703+0000 7f4646ffd700 1 -- 172.21.15.149:0/3790633324 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4648003a30 con 0x7f46580b2cd0 2023-11-08T19:26:08.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.703+0000 7f465cb7a700 1 -- 172.21.15.149:0/3790633324 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f465809afc0 con 0x7f46580b2cd0 2023-11-08T19:26:08.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.704+0000 7f465cb7a700 1 -- 172.21.15.149:0/3790633324 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46580745f0 con 0x7f46580b2cd0 2023-11-08T19:26:08.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.705+0000 7f4646ffd700 1 -- 172.21.15.149:0/3790633324 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4648003b90 con 0x7f46580b2cd0 2023-11-08T19:26:08.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.705+0000 7f4646ffd700 1 --2- 172.21.15.149:0/3790633324 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f463806af00 0x7f463806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:08.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.705+0000 7f4646ffd700 1 -- 172.21.15.149:0/3790633324 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6240+0+0 (secure 0 0 0) 0x7f4648088d10 con 0x7f46580b2cd0 2023-11-08T19:26:08.719 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.705+0000 7f465659c700 1 --2- 172.21.15.149:0/3790633324 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f463806af00 0x7f463806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:08.719 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.705+0000 7f465659c700 1 --2- 172.21.15.149:0/3790633324 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f463806af00 0x7f463806d3c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4658160b40 tx=0x7f464c010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:08.719 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.710+0000 7f4646ffd700 1 -- 172.21.15.149:0/3790633324 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4648053bb0 con 0x7f46580b2cd0 2023-11-08T19:26:08.904 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.901+0000 7f465cb7a700 1 -- 172.21.15.149:0/3790633324 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f46580d0f70 con 0x7f46580b2cd0 2023-11-08T19:26:08.904 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.902+0000 7f4646ffd700 1 -- 172.21.15.149:0/3790633324 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v79) v1 ==== 84+0+287 (secure 0 0 0) 0x7f4648017020 con 0x7f46580b2cd0 2023-11-08T19:26:08.904 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:26:08.905 INFO:teuthology.orchestra.run.smithi149.stdout:[ 2023-11-08T19:26:08.905 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:26:08.905 INFO:teuthology.orchestra.run.smithi149.stdout: "poolnum": 1, 2023-11-08T19:26:08.905 INFO:teuthology.orchestra.run.smithi149.stdout: "poolname": ".mgr" 2023-11-08T19:26:08.906 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:26:08.906 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:26:08.906 INFO:teuthology.orchestra.run.smithi149.stdout: "poolnum": 7, 2023-11-08T19:26:08.906 INFO:teuthology.orchestra.run.smithi149.stdout: "poolname": "snap-test-pool" 2023-11-08T19:26:08.907 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:26:08.907 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:26:08.907 INFO:teuthology.orchestra.run.smithi149.stdout: "poolnum": 12, 2023-11-08T19:26:08.907 INFO:teuthology.orchestra.run.smithi149.stdout: "poolname": "test_data_pool" 2023-11-08T19:26:08.907 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:26:08.908 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:26:08.908 INFO:teuthology.orchestra.run.smithi149.stdout: "poolnum": 13, 2023-11-08T19:26:08.908 INFO:teuthology.orchestra.run.smithi149.stdout: "poolname": "test_metadata_pool" 2023-11-08T19:26:08.908 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:26:08.909 INFO:teuthology.orchestra.run.smithi149.stdout:] 2023-11-08T19:26:08.910 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.904+0000 7f465cb7a700 1 -- 172.21.15.149:0/3790633324 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f463806af00 msgr2=0x7f463806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:08.911 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.904+0000 7f465cb7a700 1 --2- 172.21.15.149:0/3790633324 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f463806af00 0x7f463806d3c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4658160b40 tx=0x7f464c010000 comp rx=0 tx=0).stop 2023-11-08T19:26:08.911 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.904+0000 7f465cb7a700 1 -- 172.21.15.149:0/3790633324 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46580b2cd0 msgr2=0x7f46580af8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:08.912 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.904+0000 7f465cb7a700 1 --2- 172.21.15.149:0/3790633324 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46580b2cd0 0x7f46580af8b0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f464800c4a0 tx=0x7f464800c860 comp rx=0 tx=0).stop 2023-11-08T19:26:08.912 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.904+0000 7f465cb7a700 1 -- 172.21.15.149:0/3790633324 shutdown_connections 2023-11-08T19:26:08.912 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.904+0000 7f465cb7a700 1 --2- 172.21.15.149:0/3790633324 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f463806af00 0x7f463806d3c0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:08.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.904+0000 7f465cb7a700 1 --2- 172.21.15.149:0/3790633324 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f46580cc140 0x7f465809b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:08.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.904+0000 7f465cb7a700 1 --2- 172.21.15.149:0/3790633324 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f46580b2850 0x7f4658156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:08.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.904+0000 7f465cb7a700 1 --2- 172.21.15.149:0/3790633324 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46580b2cd0 0x7f46580af8b0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:08.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.904+0000 7f465cb7a700 1 -- 172.21.15.149:0/3790633324 >> 172.21.15.149:0/3790633324 conn(0x7f4658099a40 msgr2=0x7f465806ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:08.914 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.904+0000 7f465cb7a700 1 -- 172.21.15.149:0/3790633324 shutdown_connections 2023-11-08T19:26:08.914 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:08.904+0000 7f465cb7a700 1 -- 172.21.15.149:0/3790633324 wait complete. 2023-11-08T19:26:08.919 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-08T19:26:08.920 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-08T19:26:09.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:09.044+0000 7fbc9493b700 1 Processor -- start 2023-11-08T19:26:09.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:09.045+0000 7fbc9493b700 1 -- start start 2023-11-08T19:26:09.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:09.045+0000 7fbc9493b700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fbc90072a40 0x7fbc900b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:09.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:09.045+0000 7fbc9493b700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fbc90072ef0 0x7fbc900b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:09.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:09.045+0000 7fbc9493b700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc9015ac50 con 0x7fbc9015a870 2023-11-08T19:26:09.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:09.045+0000 7fbc9493b700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc900d02b0 con 0x7fbc90072a40 2023-11-08T19:26:09.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:09.045+0000 7fbc9493b700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc900cc450 con 0x7fbc90072ef0 2023-11-08T19:26:09.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:09.046+0000 7fbc8dd9b700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fbc90072a40 0x7fbc900b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:09.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:09.046+0000 7fbc8dd9b700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fbc90072a40 0x7fbc900b20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42304/0 (socket says 172.21.15.149:42304) 2023-11-08T19:26:09.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:09.046+0000 7fbc8dd9b700 1 -- 172.21.15.149:0/1149025773 learned_addr learned my addr 172.21.15.149:0/1149025773 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:09.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:09.046+0000 7fbc8ed9d700 1 --2- 172.21.15.149:0/1149025773 >> v2:172.21.15.160:3300/0 conn(0x7fbc90072ef0 0x7fbc900b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:09.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:09.046+0000 7fbc8dd9b700 1 -- 172.21.15.149:0/1149025773 >> v2:172.21.15.160:3300/0 conn(0x7fbc90072ef0 msgr2=0x7fbc900b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:09.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:09.046+0000 7fbc8dd9b700 1 --2- 172.21.15.149:0/1149025773 >> v2:172.21.15.160:3300/0 conn(0x7fbc90072ef0 0x7fbc900b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:09.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:09.046+0000 7fbc8dd9b700 1 -- 172.21.15.149:0/1149025773 >> v1:172.21.15.160:6789/0 conn(0x7fbc9015a870 legacy=0x7fbc900cbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:09.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:09.046+0000 7fbc8dd9b700 1 -- 172.21.15.149:0/1149025773 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc9006fe40 con 0x7fbc90072a40 2023-11-08T19:26:09.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:09.046+0000 7fbc8dd9b700 1 --2- 172.21.15.149:0/1149025773 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc90072a40 0x7fbc900b20e0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fbc90071ca0 tx=0x7fbc8000be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b903a5c4d8e484ea server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:09.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:09.046+0000 7fbc8d59a700 1 -- 172.21.15.149:0/1149025773 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8000dd30 con 0x7fbc90072a40 2023-11-08T19:26:09.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:09.046+0000 7fbc8d59a700 1 -- 172.21.15.149:0/1149025773 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc8000de90 con 0x7fbc90072a40 2023-11-08T19:26:09.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:09.046+0000 7fbc8d59a700 1 -- 172.21.15.149:0/1149025773 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc80010690 con 0x7fbc90072a40 2023-11-08T19:26:09.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:09.047+0000 7fbc9493b700 1 -- 172.21.15.149:0/1149025773 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc90072a40 msgr2=0x7fbc900b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:09.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:09.047+0000 7fbc9493b700 1 --2- 172.21.15.149:0/1149025773 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc90072a40 0x7fbc900b20e0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fbc90071ca0 tx=0x7fbc8000be70 comp rx=0 tx=0).stop 2023-11-08T19:26:09.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:09.047+0000 7fbc9493b700 1 -- 172.21.15.149:0/1149025773 shutdown_connections 2023-11-08T19:26:09.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:09.047+0000 7fbc9493b700 1 --2- 172.21.15.149:0/1149025773 >> v2:172.21.15.160:3300/0 conn(0x7fbc90072ef0 0x7fbc900b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:09.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:09.047+0000 7fbc9493b700 1 --2- 172.21.15.149:0/1149025773 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc90072a40 0x7fbc900b20e0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:09.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:09.047+0000 7fbc9493b700 1 -- 172.21.15.149:0/1149025773 >> 172.21.15.149:0/1149025773 conn(0x7fbc900cd0e0 msgr2=0x7fbc900cd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:09.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:09.047+0000 7fbc9493b700 1 -- 172.21.15.149:0/1149025773 shutdown_connections 2023-11-08T19:26:09.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:09.047+0000 7fbc9493b700 1 -- 172.21.15.149:0/1149025773 wait complete. 2023-11-08T19:26:09.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:09.048+0000 7fbc9493b700 1 Processor -- start 2023-11-08T19:26:09.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:09.048+0000 7fbc9493b700 1 -- start start 2023-11-08T19:26:09.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:09.049+0000 7fbc9493b700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbc90072a40 0x7fbc900c5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:09.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:09.049+0000 7fbc9493b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc90072ef0 0x7fbc9014b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:09.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:09.049+0000 7fbc9493b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc9015a870 0x7fbc9014daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:09.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:09.049+0000 7fbc9493b700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc900c6c00 con 0x7fbc9015a870 2023-11-08T19:26:09.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:09.049+0000 7fbc9493b700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc900c7020 con 0x7fbc90072ef0 2023-11-08T19:26:09.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:09.049+0000 7fbc9493b700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc900c5f80 con 0x7fbc90072a40 2023-11-08T19:26:09.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:09.049+0000 7fbc8ed9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc9015a870 0x7fbc9014daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:09.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:09.049+0000 7fbc8ed9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc9015a870 0x7fbc9014daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42310/0 (socket says 172.21.15.149:42310) 2023-11-08T19:26:09.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:09.049+0000 7fbc8ed9d700 1 -- 172.21.15.149:0/3950484303 learned_addr learned my addr 172.21.15.149:0/3950484303 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:09.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:09.049+0000 7fbc8e59c700 1 --2- 172.21.15.149:0/3950484303 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbc90072a40 0x7fbc900c5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:09.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:09.049+0000 7fbc8dd9b700 1 --2- 172.21.15.149:0/3950484303 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc90072ef0 0x7fbc9014b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:09.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:09.049+0000 7fbc8ed9d700 1 -- 172.21.15.149:0/3950484303 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbc90072a40 msgr2=0x7fbc900c5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:09.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:09.049+0000 7fbc8ed9d700 1 --2- 172.21.15.149:0/3950484303 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbc90072a40 0x7fbc900c5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:09.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:09.049+0000 7fbc8ed9d700 1 -- 172.21.15.149:0/3950484303 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc90072ef0 msgr2=0x7fbc9014b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:09.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:09.049+0000 7fbc8ed9d700 1 --2- 172.21.15.149:0/3950484303 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc90072ef0 0x7fbc9014b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:09.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:09.049+0000 7fbc8ed9d700 1 -- 172.21.15.149:0/3950484303 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc8000b7f0 con 0x7fbc9015a870 2023-11-08T19:26:09.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:09.049+0000 7fbc8ed9d700 1 --2- 172.21.15.149:0/3950484303 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc9015a870 0x7fbc9014daf0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fbc88007e40 tx=0x7fbc8800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:09.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:09.050+0000 7fbc7effd700 1 -- 172.21.15.149:0/3950484303 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8800eea0 con 0x7fbc9015a870 2023-11-08T19:26:09.070 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:09.050+0000 7fbc7effd700 1 -- 172.21.15.149:0/3950484303 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc88014420 con 0x7fbc9015a870 2023-11-08T19:26:09.070 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:09.050+0000 7fbc7effd700 1 -- 172.21.15.149:0/3950484303 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc880147b0 con 0x7fbc9015a870 2023-11-08T19:26:09.070 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:09.050+0000 7fbc9493b700 1 -- 172.21.15.149:0/3950484303 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc900c6260 con 0x7fbc9015a870 2023-11-08T19:26:09.071 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:09.050+0000 7fbc9493b700 1 -- 172.21.15.149:0/3950484303 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc900c6820 con 0x7fbc9015a870 2023-11-08T19:26:09.071 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:09.051+0000 7fbc9493b700 1 -- 172.21.15.149:0/3950484303 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc900745f0 con 0x7fbc9015a870 2023-11-08T19:26:09.071 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:09.051+0000 7fbc7effd700 1 -- 172.21.15.149:0/3950484303 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbc88014910 con 0x7fbc9015a870 2023-11-08T19:26:09.071 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:09.051+0000 7fbc7effd700 1 --2- 172.21.15.149:0/3950484303 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fbc7006af00 0x7fbc7006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:09.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:09.052+0000 7fbc7effd700 1 -- 172.21.15.149:0/3950484303 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6240+0+0 (secure 0 0 0) 0x7fbc88089f20 con 0x7fbc9015a870 2023-11-08T19:26:09.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:09.052+0000 7fbc8e59c700 1 --2- 172.21.15.149:0/3950484303 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fbc7006af00 0x7fbc7006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:09.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:09.052+0000 7fbc8e59c700 1 --2- 172.21.15.149:0/3950484303 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fbc7006af00 0x7fbc7006d3c0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fbc84000f60 tx=0x7fbc84009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:09.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:09.056+0000 7fbc7effd700 1 -- 172.21.15.149:0/3950484303 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbc88054e50 con 0x7fbc9015a870 2023-11-08T19:26:09.250 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:09.247+0000 7fbc9493b700 1 -- 172.21.15.149:0/3950484303 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fbc900cd940 con 0x7fbc9015a870 2023-11-08T19:26:10.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.118+0000 7fbc7effd700 1 -- 172.21.15.149:0/3950484303 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v80) v1 ==== 138+0+0 (secure 0 0 0) 0x7fbc88058470 con 0x7fbc9015a870 2023-11-08T19:26:10.124 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.121+0000 7fbc9493b700 1 -- 172.21.15.149:0/3950484303 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fbc7006af00 msgr2=0x7fbc7006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:10.124 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.121+0000 7fbc9493b700 1 --2- 172.21.15.149:0/3950484303 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fbc7006af00 0x7fbc7006d3c0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fbc84000f60 tx=0x7fbc84009040 comp rx=0 tx=0).stop 2023-11-08T19:26:10.124 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.121+0000 7fbc9493b700 1 -- 172.21.15.149:0/3950484303 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc9015a870 msgr2=0x7fbc9014daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:10.124 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.121+0000 7fbc9493b700 1 --2- 172.21.15.149:0/3950484303 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc9015a870 0x7fbc9014daf0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fbc88007e40 tx=0x7fbc8800e3c0 comp rx=0 tx=0).stop 2023-11-08T19:26:10.124 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.122+0000 7fbc9493b700 1 -- 172.21.15.149:0/3950484303 shutdown_connections 2023-11-08T19:26:10.125 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.122+0000 7fbc9493b700 1 --2- 172.21.15.149:0/3950484303 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fbc7006af00 0x7fbc7006d3c0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:10.125 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.122+0000 7fbc9493b700 1 --2- 172.21.15.149:0/3950484303 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc9015a870 0x7fbc9014daf0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:10.125 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.122+0000 7fbc9493b700 1 --2- 172.21.15.149:0/3950484303 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbc90072a40 0x7fbc900c5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:10.125 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.122+0000 7fbc9493b700 1 --2- 172.21.15.149:0/3950484303 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc90072ef0 0x7fbc9014b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:10.126 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.122+0000 7fbc9493b700 1 -- 172.21.15.149:0/3950484303 >> 172.21.15.149:0/3950484303 conn(0x7fbc900cd0e0 msgr2=0x7fbc900b00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:10.126 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.122+0000 7fbc9493b700 1 -- 172.21.15.149:0/3950484303 shutdown_connections 2023-11-08T19:26:10.126 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.122+0000 7fbc9493b700 1 -- 172.21.15.149:0/3950484303 wait complete. 2023-11-08T19:26:10.131 INFO:teuthology.orchestra.run.smithi149.stderr:pool 'cephfs_metadata' created 2023-11-08T19:26:10.144 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-08T19:26:10.275 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.273+0000 7feb938dd700 1 Processor -- start 2023-11-08T19:26:10.276 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.273+0000 7feb938dd700 1 -- start start 2023-11-08T19:26:10.278 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.274+0000 7feb938dd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7feb8c15bb80 0x7feb8c06d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:10.278 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.274+0000 7feb938dd700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7feb8c0b5350 0x7feb8c06dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:10.278 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.274+0000 7feb938dd700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb8c0b2be0 con 0x7feb8c0b58a0 2023-11-08T19:26:10.278 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.274+0000 7feb938dd700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb8c06ea60 con 0x7feb8c15bb80 2023-11-08T19:26:10.278 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.274+0000 7feb938dd700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb8c0cad90 con 0x7feb8c0b5350 2023-11-08T19:26:10.279 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.274+0000 7feb91679700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7feb8c15bb80 0x7feb8c06d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:10.279 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.274+0000 7feb91679700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7feb8c15bb80 0x7feb8c06d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42316/0 (socket says 172.21.15.149:42316) 2023-11-08T19:26:10.279 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.274+0000 7feb91679700 1 -- 172.21.15.149:0/4149362422 learned_addr learned my addr 172.21.15.149:0/4149362422 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:10.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.274+0000 7feb91679700 1 -- 172.21.15.149:0/4149362422 >> v2:172.21.15.160:3300/0 conn(0x7feb8c0b5350 msgr2=0x7feb8c06dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:10.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.274+0000 7feb91679700 1 --2- 172.21.15.149:0/4149362422 >> v2:172.21.15.160:3300/0 conn(0x7feb8c0b5350 0x7feb8c06dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:10.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.274+0000 7feb91679700 1 -- 172.21.15.149:0/4149362422 >> v1:172.21.15.160:6789/0 conn(0x7feb8c0b58a0 legacy=0x7feb8c15f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:10.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.274+0000 7feb91679700 1 -- 172.21.15.149:0/4149362422 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb8c0cafe0 con 0x7feb8c15bb80 2023-11-08T19:26:10.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.275+0000 7feb91679700 1 --2- 172.21.15.149:0/4149362422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb8c15bb80 0x7feb8c06d720 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7feb8c0687a0 tx=0x7feb7c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cddd0f43a0b957aa server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:10.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.275+0000 7feb83fff700 1 -- 172.21.15.149:0/4149362422 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7c004230 con 0x7feb8c15bb80 2023-11-08T19:26:10.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.275+0000 7feb83fff700 1 -- 172.21.15.149:0/4149362422 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb7c004390 con 0x7feb8c15bb80 2023-11-08T19:26:10.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.275+0000 7feb83fff700 1 -- 172.21.15.149:0/4149362422 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7c0036a0 con 0x7feb8c15bb80 2023-11-08T19:26:10.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.275+0000 7feb938dd700 1 -- 172.21.15.149:0/4149362422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb8c15bb80 msgr2=0x7feb8c06d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:10.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.275+0000 7feb938dd700 1 --2- 172.21.15.149:0/4149362422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb8c15bb80 0x7feb8c06d720 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7feb8c0687a0 tx=0x7feb7c009bd0 comp rx=0 tx=0).stop 2023-11-08T19:26:10.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.275+0000 7feb938dd700 1 -- 172.21.15.149:0/4149362422 shutdown_connections 2023-11-08T19:26:10.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.275+0000 7feb938dd700 1 --2- 172.21.15.149:0/4149362422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb8c15bb80 0x7feb8c06d720 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:10.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.275+0000 7feb938dd700 1 --2- 172.21.15.149:0/4149362422 >> v2:172.21.15.160:3300/0 conn(0x7feb8c0b5350 0x7feb8c06dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:10.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.275+0000 7feb938dd700 1 -- 172.21.15.149:0/4149362422 >> 172.21.15.149:0/4149362422 conn(0x7feb8c0cc7b0 msgr2=0x7feb8c0ccbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:10.283 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.275+0000 7feb938dd700 1 -- 172.21.15.149:0/4149362422 shutdown_connections 2023-11-08T19:26:10.283 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.275+0000 7feb938dd700 1 -- 172.21.15.149:0/4149362422 wait complete. 2023-11-08T19:26:10.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.276+0000 7feb938dd700 1 Processor -- start 2023-11-08T19:26:10.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.277+0000 7feb938dd700 1 -- start start 2023-11-08T19:26:10.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.277+0000 7feb938dd700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feb8c0b5350 0x7feb8c15a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:10.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.277+0000 7feb938dd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb8c0b58a0 0x7feb8c0b0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:10.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.277+0000 7feb938dd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feb8c15bb80 0x7feb8c0a8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:10.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.277+0000 7feb938dd700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb8c1f1650 con 0x7feb8c0b58a0 2023-11-08T19:26:10.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.277+0000 7feb938dd700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb8c0a9400 con 0x7feb8c15bb80 2023-11-08T19:26:10.287 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.277+0000 7feb938dd700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb8c0a9630 con 0x7feb8c0b5350 2023-11-08T19:26:10.287 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.277+0000 7feb90e78700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb8c0b58a0 0x7feb8c0b0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:10.287 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.277+0000 7feb90e78700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb8c0b58a0 0x7feb8c0b0ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42324/0 (socket says 172.21.15.149:42324) 2023-11-08T19:26:10.287 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.277+0000 7feb90e78700 1 -- 172.21.15.149:0/1100494031 learned_addr learned my addr 172.21.15.149:0/1100494031 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:10.287 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.277+0000 7feb91679700 1 --2- 172.21.15.149:0/1100494031 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feb8c0b5350 0x7feb8c15a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:10.288 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.277+0000 7feb91e7a700 1 --2- 172.21.15.149:0/1100494031 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feb8c15bb80 0x7feb8c0a8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:10.288 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.278+0000 7feb90e78700 1 -- 172.21.15.149:0/1100494031 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feb8c0b5350 msgr2=0x7feb8c15a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:10.288 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.278+0000 7feb90e78700 1 --2- 172.21.15.149:0/1100494031 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feb8c0b5350 0x7feb8c15a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:10.288 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.278+0000 7feb90e78700 1 -- 172.21.15.149:0/1100494031 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feb8c15bb80 msgr2=0x7feb8c0a8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:10.289 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.278+0000 7feb90e78700 1 --2- 172.21.15.149:0/1100494031 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feb8c15bb80 0x7feb8c0a8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:10.289 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.278+0000 7feb90e78700 1 -- 172.21.15.149:0/1100494031 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb7c009550 con 0x7feb8c0b58a0 2023-11-08T19:26:10.289 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.278+0000 7feb90e78700 1 --2- 172.21.15.149:0/1100494031 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb8c0b58a0 0x7feb8c0b0ee0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7feb8800b4a0 tx=0x7feb8800b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:10.289 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.278+0000 7feb81ffb700 1 -- 172.21.15.149:0/1100494031 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb88011830 con 0x7feb8c0b58a0 2023-11-08T19:26:10.290 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.278+0000 7feb81ffb700 1 -- 172.21.15.149:0/1100494031 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb88011990 con 0x7feb8c0b58a0 2023-11-08T19:26:10.290 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.278+0000 7feb81ffb700 1 -- 172.21.15.149:0/1100494031 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb88011d40 con 0x7feb8c0b58a0 2023-11-08T19:26:10.290 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.278+0000 7feb938dd700 1 -- 172.21.15.149:0/1100494031 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb8c0a9910 con 0x7feb8c0b58a0 2023-11-08T19:26:10.290 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.278+0000 7feb938dd700 1 -- 172.21.15.149:0/1100494031 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb8c0a9ed0 con 0x7feb8c0b58a0 2023-11-08T19:26:10.291 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.279+0000 7feb938dd700 1 -- 172.21.15.149:0/1100494031 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb8c1f1790 con 0x7feb8c0b58a0 2023-11-08T19:26:10.291 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.280+0000 7feb81ffb700 1 -- 172.21.15.149:0/1100494031 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7feb8801a400 con 0x7feb8c0b58a0 2023-11-08T19:26:10.291 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.280+0000 7feb81ffb700 1 --2- 172.21.15.149:0/1100494031 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7feb7006af00 0x7feb7006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:10.291 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.280+0000 7feb91679700 1 --2- 172.21.15.149:0/1100494031 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7feb7006af00 0x7feb7006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:10.291 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.280+0000 7feb81ffb700 1 -- 172.21.15.149:0/1100494031 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6610+0+0 (secure 0 0 0) 0x7feb88089830 con 0x7feb8c0b58a0 2023-11-08T19:26:10.292 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.281+0000 7feb91679700 1 --2- 172.21.15.149:0/1100494031 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7feb7006af00 0x7feb7006d3c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7feb7c009130 tx=0x7feb7c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:10.292 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.286+0000 7feb81ffb700 1 -- 172.21.15.149:0/1100494031 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7feb88054560 con 0x7feb8c0b58a0 2023-11-08T19:26:10.478 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:10.476+0000 7feb938dd700 1 -- 172.21.15.149:0/1100494031 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7feb8c068560 con 0x7feb8c0b58a0 2023-11-08T19:26:11.122 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.120+0000 7feb81ffb700 1 -- 172.21.15.149:0/1100494031 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v81) v1 ==== 170+0+0 (secure 0 0 0) 0x7feb88057b80 con 0x7feb8c0b58a0 2023-11-08T19:26:11.126 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.123+0000 7feb938dd700 1 -- 172.21.15.149:0/1100494031 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7feb7006af00 msgr2=0x7feb7006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:11.126 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.123+0000 7feb938dd700 1 --2- 172.21.15.149:0/1100494031 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7feb7006af00 0x7feb7006d3c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7feb7c009130 tx=0x7feb7c008030 comp rx=0 tx=0).stop 2023-11-08T19:26:11.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.123+0000 7feb938dd700 1 -- 172.21.15.149:0/1100494031 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb8c0b58a0 msgr2=0x7feb8c0b0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:11.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.123+0000 7feb938dd700 1 --2- 172.21.15.149:0/1100494031 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb8c0b58a0 0x7feb8c0b0ee0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7feb8800b4a0 tx=0x7feb8800b7b0 comp rx=0 tx=0).stop 2023-11-08T19:26:11.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.123+0000 7feb938dd700 1 -- 172.21.15.149:0/1100494031 shutdown_connections 2023-11-08T19:26:11.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.123+0000 7feb938dd700 1 --2- 172.21.15.149:0/1100494031 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7feb7006af00 0x7feb7006d3c0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:11.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.123+0000 7feb938dd700 1 --2- 172.21.15.149:0/1100494031 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feb8c15bb80 0x7feb8c0a8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:11.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.123+0000 7feb938dd700 1 --2- 172.21.15.149:0/1100494031 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feb8c0b5350 0x7feb8c15a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:11.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.123+0000 7feb938dd700 1 --2- 172.21.15.149:0/1100494031 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb8c0b58a0 0x7feb8c0b0ee0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:11.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.124+0000 7feb938dd700 1 -- 172.21.15.149:0/1100494031 >> 172.21.15.149:0/1100494031 conn(0x7feb8c0cc7b0 msgr2=0x7feb8c0715b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:11.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.124+0000 7feb938dd700 1 -- 172.21.15.149:0/1100494031 shutdown_connections 2023-11-08T19:26:11.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.124+0000 7feb938dd700 1 -- 172.21.15.149:0/1100494031 wait complete. 2023-11-08T19:26:11.129 INFO:teuthology.orchestra.run.smithi149.stderr:pool 'cephfs_data' created 2023-11-08T19:26:11.151 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-08T19:26:11.278 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.276+0000 7f3c9a0d7700 1 Processor -- start 2023-11-08T19:26:11.279 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.276+0000 7f3c9a0d7700 1 -- start start 2023-11-08T19:26:11.287 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.277+0000 7f3c9a0d7700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f3c940cdce0 0x7f3c9406f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:11.287 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.277+0000 7f3c9a0d7700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c940af590 con 0x7f3c9406ab80 2023-11-08T19:26:11.288 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.277+0000 7f3c9a0d7700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c9406d8b0 con 0x7f3c940cae40 2023-11-08T19:26:11.288 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.277+0000 7f3c9a0d7700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c940cb2f0 con 0x7f3c940cdce0 2023-11-08T19:26:11.288 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.277+0000 7f3c93fff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f3c9406ab80 0x7f3c9406e300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:44336/0 (socket says 172.21.15.149:44336) 2023-11-08T19:26:11.288 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.277+0000 7f3c93fff700 1 -- 172.21.15.149:0/703817715 learned_addr learned my addr 172.21.15.149:0/703817715 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:26:11.289 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.277+0000 7f3c937fe700 1 --2- 172.21.15.149:0/703817715 >> v2:172.21.15.160:3300/0 conn(0x7f3c940cdce0 0x7f3c9406f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:11.289 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.277+0000 7f3c927fc700 1 -- 172.21.15.149:0/703817715 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3421835253 0 0) 0x7f3c940af590 con 0x7f3c9406ab80 2023-11-08T19:26:11.289 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.277+0000 7f3c927fc700 1 -- 172.21.15.149:0/703817715 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c7c0035b0 con 0x7f3c9406ab80 2023-11-08T19:26:11.289 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.277+0000 7f3c927fc700 1 -- 172.21.15.149:0/703817715 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3066350358 0 0) 0x7f3c9406d8b0 con 0x7f3c940cae40 2023-11-08T19:26:11.289 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.277+0000 7f3c927fc700 1 -- 172.21.15.149:0/703817715 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c940af590 con 0x7f3c940cae40 2023-11-08T19:26:11.290 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.277+0000 7f3c927fc700 1 -- 172.21.15.149:0/703817715 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1788105331 0 0) 0x7f3c7c0035b0 con 0x7f3c9406ab80 2023-11-08T19:26:11.290 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.277+0000 7f3c927fc700 1 -- 172.21.15.149:0/703817715 >> v2:172.21.15.160:3300/0 conn(0x7f3c940cdce0 msgr2=0x7f3c9406f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:11.290 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.277+0000 7f3c927fc700 1 --2- 172.21.15.149:0/703817715 >> v2:172.21.15.160:3300/0 conn(0x7f3c940cdce0 0x7f3c9406f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:11.291 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.277+0000 7f3c927fc700 1 -- 172.21.15.149:0/703817715 >> v1:172.21.15.160:6789/0 conn(0x7f3c940cae40 legacy=0x7f3c940ce0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:11.291 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.277+0000 7f3c927fc700 1 -- 172.21.15.149:0/703817715 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c94066f40 con 0x7f3c9406ab80 2023-11-08T19:26:11.291 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.278+0000 7f3c927fc700 1 -- 172.21.15.149:0/703817715 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f3c8c0019f0 con 0x7f3c9406ab80 2023-11-08T19:26:11.291 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.278+0000 7f3c937fe700 1 --2- 172.21.15.149:0/703817715 >> v2:172.21.15.160:3300/0 conn(0x7f3c940cdce0 0x7f3c9406f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:26:11.291 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.278+0000 7f3c927fc700 1 -- 172.21.15.149:0/703817715 >> v1:172.21.15.149:6789/0 conn(0x7f3c9406ab80 legacy=0x7f3c9406e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:11.292 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.278+0000 7f3c927fc700 1 --2- 172.21.15.149:0/703817715 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c7c003c00 0x7f3c7c004000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:11.292 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.278+0000 7f3c927fc700 1 --2- 172.21.15.149:0/703817715 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c7c004850 0x7f3c7c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:11.292 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.278+0000 7f3c927fc700 1 --2- 172.21.15.149:0/703817715 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3c7c005210 0x7f3c7c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:11.292 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.278+0000 7f3c927fc700 1 -- 172.21.15.149:0/703817715 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c940cb2f0 con 0x7f3c7c003c00 2023-11-08T19:26:11.292 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.278+0000 7f3c927fc700 1 -- 172.21.15.149:0/703817715 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7c00c110 con 0x7f3c7c004850 2023-11-08T19:26:11.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.278+0000 7f3c927fc700 1 -- 172.21.15.149:0/703817715 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7c00c2d0 con 0x7f3c7c005210 2023-11-08T19:26:11.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.278+0000 7f3c937fe700 1 --2- 172.21.15.149:0/703817715 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c7c003c00 0x7f3c7c004000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:11.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.278+0000 7f3c92ffd700 1 --2- 172.21.15.149:0/703817715 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c7c004850 0x7f3c7c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:11.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.278+0000 7f3c93fff700 1 --2- 172.21.15.149:0/703817715 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3c7c005210 0x7f3c7c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:11.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.278+0000 7f3c937fe700 1 -- 172.21.15.149:0/703817715 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3c7c005210 msgr2=0x7f3c7c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:11.294 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.278+0000 7f3c937fe700 1 --2- 172.21.15.149:0/703817715 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3c7c005210 0x7f3c7c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:11.294 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.278+0000 7f3c937fe700 1 -- 172.21.15.149:0/703817715 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c7c004850 msgr2=0x7f3c7c004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:11.294 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.278+0000 7f3c937fe700 1 --2- 172.21.15.149:0/703817715 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c7c004850 0x7f3c7c004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:11.294 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.278+0000 7f3c937fe700 1 -- 172.21.15.149:0/703817715 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c7c0035b0 con 0x7f3c7c003c00 2023-11-08T19:26:11.294 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.278+0000 7f3c93fff700 1 --2- 172.21.15.149:0/703817715 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3c7c005210 0x7f3c7c00ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:26:11.295 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.278+0000 7f3c93fff700 1 -- 172.21.15.149:0/703817715 reap_dead start 2023-11-08T19:26:11.295 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.278+0000 7f3c937fe700 1 --2- 172.21.15.149:0/703817715 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c7c003c00 0x7f3c7c004000 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f3c88009d30 tx=0x7f3c7c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a790e507953ae5a server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:11.295 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.278+0000 7f3c927fc700 1 -- 172.21.15.149:0/703817715 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c88009e80 con 0x7f3c7c003c00 2023-11-08T19:26:11.295 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.278+0000 7f3c927fc700 1 -- 172.21.15.149:0/703817715 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c8800e9a0 con 0x7f3c7c003c00 2023-11-08T19:26:11.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.278+0000 7f3c927fc700 1 -- 172.21.15.149:0/703817715 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c8800ed10 con 0x7f3c7c003c00 2023-11-08T19:26:11.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.279+0000 7f3c9a0d7700 1 -- 172.21.15.149:0/703817715 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c7c003c00 msgr2=0x7f3c7c004000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:11.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.279+0000 7f3c9a0d7700 1 --2- 172.21.15.149:0/703817715 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c7c003c00 0x7f3c7c004000 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f3c88009d30 tx=0x7f3c7c005880 comp rx=0 tx=0).stop 2023-11-08T19:26:11.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.279+0000 7f3c9a0d7700 1 -- 172.21.15.149:0/703817715 shutdown_connections 2023-11-08T19:26:11.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.279+0000 7f3c9a0d7700 1 --2- 172.21.15.149:0/703817715 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c7c003c00 0x7f3c7c004000 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:11.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.279+0000 7f3c9a0d7700 1 -- 172.21.15.149:0/703817715 >> 172.21.15.149:0/703817715 conn(0x7f3c940cc860 msgr2=0x7f3c940ccc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:11.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.279+0000 7f3c9a0d7700 1 -- 172.21.15.149:0/703817715 shutdown_connections 2023-11-08T19:26:11.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.279+0000 7f3c9a0d7700 1 -- 172.21.15.149:0/703817715 wait complete. 2023-11-08T19:26:11.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.280+0000 7f3c9a0d7700 1 Processor -- start 2023-11-08T19:26:11.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.280+0000 7f3c9a0d7700 1 -- start start 2023-11-08T19:26:11.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.281+0000 7f3c9a0d7700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3c7c003c00 0x7f3c941f2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:11.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.281+0000 7f3c9a0d7700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c940c9660 0x7f3c9415fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:11.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.281+0000 7f3c9a0d7700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c94160210 0x7f3c941f69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:11.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.281+0000 7f3c9a0d7700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c9415f580 con 0x7f3c940c9660 2023-11-08T19:26:11.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.281+0000 7f3c9a0d7700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c94160690 con 0x7f3c94160210 2023-11-08T19:26:11.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.281+0000 7f3c9a0d7700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c940c70e0 con 0x7f3c7c003c00 2023-11-08T19:26:11.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.281+0000 7f3c937fe700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3c7c003c00 0x7f3c941f2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:11.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.281+0000 7f3c937fe700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3c7c003c00 0x7f3c941f2e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.149:34398/0 (socket says 172.21.15.149:34398) 2023-11-08T19:26:11.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.281+0000 7f3c937fe700 1 -- 172.21.15.149:0/1281534458 learned_addr learned my addr 172.21.15.149:0/1281534458 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:11.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.281+0000 7f3c93fff700 1 --2- 172.21.15.149:0/1281534458 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c94160210 0x7f3c941f69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:11.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.281+0000 7f3c92ffd700 1 --2- 172.21.15.149:0/1281534458 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c940c9660 0x7f3c9415fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:11.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.282+0000 7f3c937fe700 1 -- 172.21.15.149:0/1281534458 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c94160210 msgr2=0x7f3c941f69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:11.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.282+0000 7f3c937fe700 1 --2- 172.21.15.149:0/1281534458 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c94160210 0x7f3c941f69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:11.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.282+0000 7f3c937fe700 1 -- 172.21.15.149:0/1281534458 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c940c9660 msgr2=0x7f3c9415fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:11.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.282+0000 7f3c937fe700 1 --2- 172.21.15.149:0/1281534458 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c940c9660 0x7f3c9415fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:11.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.282+0000 7f3c937fe700 1 -- 172.21.15.149:0/1281534458 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c9415ece0 con 0x7f3c7c003c00 2023-11-08T19:26:11.302 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.282+0000 7f3c937fe700 1 --2- 172.21.15.149:0/1281534458 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3c7c003c00 0x7f3c941f2e50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c00c0e0 tx=0x7f3c88004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:11.302 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.282+0000 7f3c7bfff700 1 -- 172.21.15.149:0/1281534458 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c88009e80 con 0x7f3c7c003c00 2023-11-08T19:26:11.302 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.282+0000 7f3c7bfff700 1 -- 172.21.15.149:0/1281534458 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c88013df0 con 0x7f3c7c003c00 2023-11-08T19:26:11.302 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.282+0000 7f3c7bfff700 1 -- 172.21.15.149:0/1281534458 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c88004270 con 0x7f3c7c003c00 2023-11-08T19:26:11.303 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.282+0000 7f3c9a0d7700 1 -- 172.21.15.149:0/1281534458 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c9415efc0 con 0x7f3c7c003c00 2023-11-08T19:26:11.303 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.282+0000 7f3c9a0d7700 1 -- 172.21.15.149:0/1281534458 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c94152820 con 0x7f3c7c003c00 2023-11-08T19:26:11.303 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.283+0000 7f3c9a0d7700 1 -- 172.21.15.149:0/1281534458 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c940c6e90 con 0x7f3c7c003c00 2023-11-08T19:26:11.303 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.284+0000 7f3c7bfff700 1 -- 172.21.15.149:0/1281534458 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3c880043d0 con 0x7f3c7c003c00 2023-11-08T19:26:11.304 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.284+0000 7f3c7bfff700 1 --2- 172.21.15.149:0/1281534458 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3c8006af00 0x7f3c8006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:11.304 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.284+0000 7f3c7bfff700 1 -- 172.21.15.149:0/1281534458 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6992+0+0 (secure 0 0 0) 0x7f3c8808b200 con 0x7f3c7c003c00 2023-11-08T19:26:11.304 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.284+0000 7f3c92ffd700 1 --2- 172.21.15.149:0/1281534458 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3c8006af00 0x7f3c8006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:11.304 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.285+0000 7f3c92ffd700 1 --2- 172.21.15.149:0/1281534458 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3c8006af00 0x7f3c8006d3c0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f3c940c9da0 tx=0x7f3c84009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:11.305 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.290+0000 7f3c7bfff700 1 -- 172.21.15.149:0/1281534458 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3c88055f60 con 0x7f3c7c003c00 2023-11-08T19:26:11.528 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:11.526+0000 7f3c9a0d7700 1 -- 172.21.15.149:0/1281534458 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f3c9404f730 con 0x7f3c7c003c00 2023-11-08T19:26:12.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.157+0000 7f3c7bfff700 1 -- 172.21.15.149:0/1281534458 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 14 and data pool 15 v40) v1 ==== 174+0+0 (secure 0 0 0) 0x7f3c88059580 con 0x7f3c7c003c00 2023-11-08T19:26:12.170 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.167+0000 7f3c9a0d7700 1 -- 172.21.15.149:0/1281534458 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3c8006af00 msgr2=0x7f3c8006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:12.170 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.168+0000 7f3c9a0d7700 1 --2- 172.21.15.149:0/1281534458 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3c8006af00 0x7f3c8006d3c0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f3c940c9da0 tx=0x7f3c84009040 comp rx=0 tx=0).stop 2023-11-08T19:26:12.170 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.168+0000 7f3c9a0d7700 1 -- 172.21.15.149:0/1281534458 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3c7c003c00 msgr2=0x7f3c941f2e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:12.170 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.168+0000 7f3c9a0d7700 1 --2- 172.21.15.149:0/1281534458 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3c7c003c00 0x7f3c941f2e50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c00c0e0 tx=0x7f3c88004750 comp rx=0 tx=0).stop 2023-11-08T19:26:12.171 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.168+0000 7f3c9a0d7700 1 -- 172.21.15.149:0/1281534458 shutdown_connections 2023-11-08T19:26:12.172 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.168+0000 7f3c9a0d7700 1 --2- 172.21.15.149:0/1281534458 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3c8006af00 0x7f3c8006d3c0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:12.172 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.168+0000 7f3c9a0d7700 1 --2- 172.21.15.149:0/1281534458 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c94160210 0x7f3c941f69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:12.172 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.168+0000 7f3c9a0d7700 1 --2- 172.21.15.149:0/1281534458 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3c7c003c00 0x7f3c941f2e50 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:12.172 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.168+0000 7f3c9a0d7700 1 --2- 172.21.15.149:0/1281534458 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c940c9660 0x7f3c9415fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:12.173 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.168+0000 7f3c9a0d7700 1 -- 172.21.15.149:0/1281534458 >> 172.21.15.149:0/1281534458 conn(0x7f3c940cc860 msgr2=0x7f3c940b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:12.173 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.169+0000 7f3c9a0d7700 1 -- 172.21.15.149:0/1281534458 shutdown_connections 2023-11-08T19:26:12.173 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.169+0000 7f3c9a0d7700 1 -- 172.21.15.149:0/1281534458 wait complete. 2023-11-08T19:26:12.174 INFO:teuthology.orchestra.run.smithi149.stderr:new fs with metadata pool 14 and data pool 15 2023-11-08T19:26:12.186 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:26:12.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.306+0000 7f7c8b4ab700 1 Processor -- start 2023-11-08T19:26:12.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.306+0000 7f7c8b4ab700 1 -- start start 2023-11-08T19:26:12.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.307+0000 7f7c8b4ab700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7c841624c0 0x7f7c8406bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:12.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.307+0000 7f7c8b4ab700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f7c84066c80 0x7f7c8406c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:12.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.307+0000 7f7c8b4ab700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c8406e2a0 con 0x7f7c840ca630 2023-11-08T19:26:12.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.307+0000 7f7c8b4ab700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c840cc5c0 con 0x7f7c84066c80 2023-11-08T19:26:12.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.307+0000 7f7c8b4ab700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8406d970 con 0x7f7c841624c0 2023-11-08T19:26:12.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.307+0000 7f7c88a46700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f7c84066c80 0x7f7c8406c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:12.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.307+0000 7f7c88a46700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f7c84066c80 0x7f7c8406c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42364/0 (socket says 172.21.15.149:42364) 2023-11-08T19:26:12.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.307+0000 7f7c88a46700 1 -- 172.21.15.149:0/3887047262 learned_addr learned my addr 172.21.15.149:0/3887047262 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:12.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.307+0000 7f7c89247700 1 --2- 172.21.15.149:0/3887047262 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7c841624c0 0x7f7c8406bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:12.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.307+0000 7f7c88a46700 1 -- 172.21.15.149:0/3887047262 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7c841624c0 msgr2=0x7f7c8406bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:12.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.307+0000 7f7c88a46700 1 --2- 172.21.15.149:0/3887047262 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7c841624c0 0x7f7c8406bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:12.314 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.307+0000 7f7c88a46700 1 -- 172.21.15.149:0/3887047262 >> v1:172.21.15.160:6789/0 conn(0x7f7c840ca630 legacy=0x7f7c840caac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:12.314 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.307+0000 7f7c88a46700 1 -- 172.21.15.149:0/3887047262 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c8406dc50 con 0x7f7c84066c80 2023-11-08T19:26:12.314 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.307+0000 7f7c88a46700 1 --2- 172.21.15.149:0/3887047262 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c84066c80 0x7f7c8406c0d0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f7c740098f0 tx=0x7f7c74009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=500284e56abd3382 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:12.314 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.307+0000 7f7c7bfff700 1 -- 172.21.15.149:0/3887047262 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c74004230 con 0x7f7c84066c80 2023-11-08T19:26:12.315 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.308+0000 7f7c7bfff700 1 -- 172.21.15.149:0/3887047262 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c74004390 con 0x7f7c84066c80 2023-11-08T19:26:12.315 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.308+0000 7f7c7bfff700 1 -- 172.21.15.149:0/3887047262 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c740036a0 con 0x7f7c84066c80 2023-11-08T19:26:12.315 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.308+0000 7f7c8b4ab700 1 -- 172.21.15.149:0/3887047262 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c84066c80 msgr2=0x7f7c8406c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:12.315 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.308+0000 7f7c8b4ab700 1 --2- 172.21.15.149:0/3887047262 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c84066c80 0x7f7c8406c0d0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f7c740098f0 tx=0x7f7c74009c00 comp rx=0 tx=0).stop 2023-11-08T19:26:12.315 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.308+0000 7f7c8b4ab700 1 -- 172.21.15.149:0/3887047262 shutdown_connections 2023-11-08T19:26:12.316 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.308+0000 7f7c8b4ab700 1 --2- 172.21.15.149:0/3887047262 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7c841624c0 0x7f7c8406bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:12.316 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.308+0000 7f7c8b4ab700 1 --2- 172.21.15.149:0/3887047262 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c84066c80 0x7f7c8406c0d0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:12.316 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.308+0000 7f7c8b4ab700 1 -- 172.21.15.149:0/3887047262 >> 172.21.15.149:0/3887047262 conn(0x7f7c84071720 msgr2=0x7f7c84071b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:12.316 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.308+0000 7f7c8b4ab700 1 -- 172.21.15.149:0/3887047262 shutdown_connections 2023-11-08T19:26:12.316 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.308+0000 7f7c8b4ab700 1 -- 172.21.15.149:0/3887047262 wait complete. 2023-11-08T19:26:12.317 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.309+0000 7f7c8b4ab700 1 Processor -- start 2023-11-08T19:26:12.317 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.309+0000 7f7c8b4ab700 1 -- start start 2023-11-08T19:26:12.320 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.310+0000 7f7c8b4ab700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7c84066c80 0x7f7c8415c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:12.320 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.310+0000 7f7c8b4ab700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c840ca630 0x7f7c841f66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:12.320 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.310+0000 7f7c8b4ab700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c841624c0 0x7f7c841f4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:12.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.310+0000 7f7c8b4ab700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8415c930 con 0x7f7c841624c0 2023-11-08T19:26:12.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.310+0000 7f7c8b4ab700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c841f5610 con 0x7f7c840ca630 2023-11-08T19:26:12.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.310+0000 7f7c8b4ab700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c841f58f0 con 0x7f7c84066c80 2023-11-08T19:26:12.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.310+0000 7f7c89a48700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c841624c0 0x7f7c841f4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:12.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.310+0000 7f7c89a48700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c841624c0 0x7f7c841f4b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42370/0 (socket says 172.21.15.149:42370) 2023-11-08T19:26:12.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.310+0000 7f7c89a48700 1 -- 172.21.15.149:0/4170414401 learned_addr learned my addr 172.21.15.149:0/4170414401 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:12.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.310+0000 7f7c89247700 1 --2- 172.21.15.149:0/4170414401 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7c84066c80 0x7f7c8415c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:12.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.310+0000 7f7c88a46700 1 --2- 172.21.15.149:0/4170414401 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c840ca630 0x7f7c841f66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:12.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.310+0000 7f7c89a48700 1 -- 172.21.15.149:0/4170414401 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7c84066c80 msgr2=0x7f7c8415c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:12.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.310+0000 7f7c89a48700 1 --2- 172.21.15.149:0/4170414401 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7c84066c80 0x7f7c8415c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:12.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.310+0000 7f7c89a48700 1 -- 172.21.15.149:0/4170414401 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c840ca630 msgr2=0x7f7c841f66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:12.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.310+0000 7f7c89a48700 1 --2- 172.21.15.149:0/4170414401 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c840ca630 0x7f7c841f66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:12.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.311+0000 7f7c89a48700 1 -- 172.21.15.149:0/4170414401 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c74009550 con 0x7f7c841624c0 2023-11-08T19:26:12.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.311+0000 7f7c88a46700 1 --2- 172.21.15.149:0/4170414401 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c840ca630 0x7f7c841f66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:26:12.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.311+0000 7f7c89247700 1 --2- 172.21.15.149:0/4170414401 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7c84066c80 0x7f7c8415c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:26:12.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.311+0000 7f7c89a48700 1 --2- 172.21.15.149:0/4170414401 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c841624c0 0x7f7c841f4b70 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c00cc10 tx=0x7f7c7c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:12.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.311+0000 7f7c79ffb700 1 -- 172.21.15.149:0/4170414401 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7c00abb0 con 0x7f7c841624c0 2023-11-08T19:26:12.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.311+0000 7f7c79ffb700 1 -- 172.21.15.149:0/4170414401 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c7c00ad10 con 0x7f7c841624c0 2023-11-08T19:26:12.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.311+0000 7f7c8b4ab700 1 -- 172.21.15.149:0/4170414401 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c841f5bd0 con 0x7f7c841624c0 2023-11-08T19:26:12.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.311+0000 7f7c79ffb700 1 -- 172.21.15.149:0/4170414401 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7c012660 con 0x7f7c841624c0 2023-11-08T19:26:12.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.311+0000 7f7c8b4ab700 1 -- 172.21.15.149:0/4170414401 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c841f6190 con 0x7f7c841624c0 2023-11-08T19:26:12.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.312+0000 7f7c8b4ab700 1 -- 172.21.15.149:0/4170414401 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c841f63b0 con 0x7f7c841624c0 2023-11-08T19:26:12.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.312+0000 7f7c79ffb700 1 -- 172.21.15.149:0/4170414401 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7c7c0127c0 con 0x7f7c841624c0 2023-11-08T19:26:12.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.313+0000 7f7c79ffb700 1 --2- 172.21.15.149:0/4170414401 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f7c6806af00 0x7f7c6806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:12.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.313+0000 7f7c79ffb700 1 -- 172.21.15.149:0/4170414401 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f7c7c08a340 con 0x7f7c841624c0 2023-11-08T19:26:12.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.313+0000 7f7c89247700 1 --2- 172.21.15.149:0/4170414401 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f7c6806af00 0x7f7c6806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:12.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.313+0000 7f7c89247700 1 --2- 172.21.15.149:0/4170414401 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f7c6806af00 0x7f7c6806d3c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f7c80006fd0 tx=0x7f7c80008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:12.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.318+0000 7f7c79ffb700 1 -- 172.21.15.149:0/4170414401 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7c7c054f10 con 0x7f7c841624c0 2023-11-08T19:26:12.512 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.510+0000 7f7c8b4ab700 1 -- 172.21.15.149:0/4170414401 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c840745f0 con 0x7f7c841624c0 2023-11-08T19:26:12.514 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.512+0000 7f7c79ffb700 1 -- 172.21.15.149:0/4170414401 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+22002 (secure 0 0 0) 0x7f7c7c016090 con 0x7f7c841624c0 2023-11-08T19:26:12.515 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:26:12.515 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":82,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:26:11.528998+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-08T19:24:29.516185+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-08T19:25:44.287064+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":71,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-08T19:25:45.623521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-11-08T19:26:09.267609+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-11-08T19:26:10.496194+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:26:12.517 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.514+0000 7f7c8b4ab700 1 -- 172.21.15.149:0/4170414401 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f7c6806af00 msgr2=0x7f7c6806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:12.517 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.514+0000 7f7c8b4ab700 1 --2- 172.21.15.149:0/4170414401 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f7c6806af00 0x7f7c6806d3c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f7c80006fd0 tx=0x7f7c80008040 comp rx=0 tx=0).stop 2023-11-08T19:26:12.517 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.514+0000 7f7c8b4ab700 1 -- 172.21.15.149:0/4170414401 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c841624c0 msgr2=0x7f7c841f4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:12.517 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.514+0000 7f7c8b4ab700 1 --2- 172.21.15.149:0/4170414401 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c841624c0 0x7f7c841f4b70 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c00cc10 tx=0x7f7c7c00a060 comp rx=0 tx=0).stop 2023-11-08T19:26:12.518 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.514+0000 7f7c8b4ab700 1 -- 172.21.15.149:0/4170414401 shutdown_connections 2023-11-08T19:26:12.518 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.514+0000 7f7c8b4ab700 1 --2- 172.21.15.149:0/4170414401 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f7c6806af00 0x7f7c6806d3c0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:12.518 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.514+0000 7f7c8b4ab700 1 --2- 172.21.15.149:0/4170414401 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c841624c0 0x7f7c841f4b70 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:12.518 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.514+0000 7f7c8b4ab700 1 --2- 172.21.15.149:0/4170414401 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7c84066c80 0x7f7c8415c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:12.518 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.514+0000 7f7c8b4ab700 1 --2- 172.21.15.149:0/4170414401 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c840ca630 0x7f7c841f66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:12.519 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.514+0000 7f7c8b4ab700 1 -- 172.21.15.149:0/4170414401 >> 172.21.15.149:0/4170414401 conn(0x7f7c84071720 msgr2=0x7f7c8415fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:12.519 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.514+0000 7f7c8b4ab700 1 -- 172.21.15.149:0/4170414401 shutdown_connections 2023-11-08T19:26:12.519 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.514+0000 7f7c8b4ab700 1 -- 172.21.15.149:0/4170414401 wait complete. 2023-11-08T19:26:12.529 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:26:12.650 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.648+0000 7f25485f1700 1 Processor -- start 2023-11-08T19:26:12.650 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.648+0000 7f25485f1700 1 -- start start 2023-11-08T19:26:12.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.649+0000 7f25485f1700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f25400cc140 0x7f25400cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:12.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.649+0000 7f25485f1700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f25400b2cd0 0x7f254015d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:12.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.649+0000 7f25485f1700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25400cce50 con 0x7f25400b2850 2023-11-08T19:26:12.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.649+0000 7f25485f1700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25400b2430 con 0x7f25400cc140 2023-11-08T19:26:12.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.649+0000 7f25485f1700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25400cc520 con 0x7f25400b2cd0 2023-11-08T19:26:12.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.649+0000 7f2546b8e700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f25400b2cd0 0x7f254015d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:12.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.649+0000 7f254638d700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f25400cc140 0x7f25400cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:12.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.649+0000 7f254638d700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f25400cc140 0x7f25400cc910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.149:43366/0 (socket says 172.21.15.149:43366) 2023-11-08T19:26:12.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.649+0000 7f2545b8c700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f25400b2850 0x7f25400cabf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.149:56044/0 (socket says 172.21.15.149:56044) 2023-11-08T19:26:12.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.649+0000 7f2546b8e700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f25400b2cd0 0x7f254015d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.149:34434/0 (socket says 172.21.15.149:34434) 2023-11-08T19:26:12.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.649+0000 7f254638d700 1 -- 172.21.15.149:0/1830016646 learned_addr learned my addr 172.21.15.149:0/1830016646 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:12.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.650+0000 7f254638d700 1 -- 172.21.15.149:0/1830016646 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f25400b2cd0 msgr2=0x7f254015d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:12.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.650+0000 7f254638d700 1 --2- 172.21.15.149:0/1830016646 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f25400b2cd0 0x7f254015d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:12.657 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.650+0000 7f254638d700 1 -- 172.21.15.149:0/1830016646 >> v1:172.21.15.160:6789/0 conn(0x7f25400b2850 legacy=0x7f25400cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:12.657 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.650+0000 7f254538b700 1 -- 172.21.15.149:0/1830016646 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3425120359 0 0) 0x7f25400cce50 con 0x7f25400b2850 2023-11-08T19:26:12.657 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.650+0000 7f254638d700 1 -- 172.21.15.149:0/1830016646 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25400b17b0 con 0x7f25400cc140 2023-11-08T19:26:12.657 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.650+0000 7f2546b8e700 1 --2- 172.21.15.149:0/1830016646 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f25400b2cd0 0x7f254015d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:26:12.658 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.650+0000 7f254638d700 1 --2- 172.21.15.149:0/1830016646 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25400cc140 0x7f25400cc910 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f253c006fd0 tx=0x7f253c009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48a0931729b431e server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:12.658 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.650+0000 7f254538b700 1 -- 172.21.15.149:0/1830016646 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f253c005e30 con 0x7f25400cc140 2023-11-08T19:26:12.658 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.650+0000 7f254538b700 1 -- 172.21.15.149:0/1830016646 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f253c004030 con 0x7f25400cc140 2023-11-08T19:26:12.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.650+0000 7f254538b700 1 -- 172.21.15.149:0/1830016646 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f253c0043e0 con 0x7f25400cc140 2023-11-08T19:26:12.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.651+0000 7f25485f1700 1 -- 172.21.15.149:0/1830016646 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25400cc140 msgr2=0x7f25400cc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:12.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.651+0000 7f25485f1700 1 --2- 172.21.15.149:0/1830016646 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25400cc140 0x7f25400cc910 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f253c006fd0 tx=0x7f253c009bd0 comp rx=0 tx=0).stop 2023-11-08T19:26:12.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.651+0000 7f25485f1700 1 -- 172.21.15.149:0/1830016646 shutdown_connections 2023-11-08T19:26:12.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.651+0000 7f25485f1700 1 --2- 172.21.15.149:0/1830016646 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f25400b2cd0 0x7f254015d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:12.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.651+0000 7f25485f1700 1 --2- 172.21.15.149:0/1830016646 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25400cc140 0x7f25400cc910 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:12.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.651+0000 7f25485f1700 1 -- 172.21.15.149:0/1830016646 >> 172.21.15.149:0/1830016646 conn(0x7f2540099a40 msgr2=0x7f25400d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:12.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.651+0000 7f25485f1700 1 -- 172.21.15.149:0/1830016646 shutdown_connections 2023-11-08T19:26:12.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.651+0000 7f25485f1700 1 -- 172.21.15.149:0/1830016646 wait complete. 2023-11-08T19:26:12.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.652+0000 7f25485f1700 1 Processor -- start 2023-11-08T19:26:12.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.652+0000 7f25485f1700 1 -- start start 2023-11-08T19:26:12.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.653+0000 7f25485f1700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25400b2850 0x7f25400ae470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:12.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.653+0000 7f25485f1700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f25400b2cd0 0x7f25400b5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:12.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.653+0000 7f25485f1700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25400cc140 0x7f254014f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:12.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.653+0000 7f25485f1700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25400b60e0 con 0x7f25400b2850 2023-11-08T19:26:12.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.653+0000 7f25485f1700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25400b5e00 con 0x7f25400cc140 2023-11-08T19:26:12.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.653+0000 7f25485f1700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2540150a00 con 0x7f25400b2cd0 2023-11-08T19:26:12.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.653+0000 7f254638d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25400b2850 0x7f25400ae470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:12.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.653+0000 7f254638d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25400b2850 0x7f25400ae470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42380/0 (socket says 172.21.15.149:42380) 2023-11-08T19:26:12.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.653+0000 7f254638d700 1 -- 172.21.15.149:0/1958276210 learned_addr learned my addr 172.21.15.149:0/1958276210 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:12.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.653+0000 7f2545b8c700 1 --2- 172.21.15.149:0/1958276210 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f25400b2cd0 0x7f25400b5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:12.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.653+0000 7f2546b8e700 1 --2- 172.21.15.149:0/1958276210 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25400cc140 0x7f254014f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:12.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.653+0000 7f254638d700 1 -- 172.21.15.149:0/1958276210 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f25400b2cd0 msgr2=0x7f25400b5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:12.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.653+0000 7f254638d700 1 --2- 172.21.15.149:0/1958276210 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f25400b2cd0 0x7f25400b5300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:12.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.653+0000 7f254638d700 1 -- 172.21.15.149:0/1958276210 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25400cc140 msgr2=0x7f254014f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:12.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.653+0000 7f254638d700 1 --2- 172.21.15.149:0/1958276210 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25400cc140 0x7f254014f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:12.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.653+0000 7f254638d700 1 -- 172.21.15.149:0/1958276210 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2538009a70 con 0x7f25400b2850 2023-11-08T19:26:12.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.653+0000 7f254638d700 1 --2- 172.21.15.149:0/1958276210 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25400b2850 0x7f25400ae470 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f253c009130 tx=0x7f253c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:12.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.653+0000 7f2536ffd700 1 -- 172.21.15.149:0/1958276210 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f253c01d630 con 0x7f25400b2850 2023-11-08T19:26:12.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.653+0000 7f2536ffd700 1 -- 172.21.15.149:0/1958276210 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f253c01d790 con 0x7f25400b2850 2023-11-08T19:26:12.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.653+0000 7f2536ffd700 1 -- 172.21.15.149:0/1958276210 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f253c01db40 con 0x7f25400b2850 2023-11-08T19:26:12.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.653+0000 7f25485f1700 1 -- 172.21.15.149:0/1958276210 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f253c009500 con 0x7f25400b2850 2023-11-08T19:26:12.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.654+0000 7f25485f1700 1 -- 172.21.15.149:0/1958276210 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2540150fc0 con 0x7f25400b2850 2023-11-08T19:26:12.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.654+0000 7f25485f1700 1 -- 172.21.15.149:0/1958276210 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2540150860 con 0x7f25400b2850 2023-11-08T19:26:12.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.655+0000 7f2536ffd700 1 -- 172.21.15.149:0/1958276210 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f253c01dca0 con 0x7f25400b2850 2023-11-08T19:26:12.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.655+0000 7f2536ffd700 1 --2- 172.21.15.149:0/1958276210 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f252406af00 0x7f252406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:12.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.655+0000 7f2536ffd700 1 -- 172.21.15.149:0/1958276210 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f253c08afe0 con 0x7f25400b2850 2023-11-08T19:26:12.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.655+0000 7f2545b8c700 1 --2- 172.21.15.149:0/1958276210 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f252406af00 0x7f252406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:12.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.656+0000 7f2545b8c700 1 --2- 172.21.15.149:0/1958276210 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f252406af00 0x7f252406d3c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f2530000f60 tx=0x7f2530009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:12.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.660+0000 7f2536ffd700 1 -- 172.21.15.149:0/1958276210 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2540150860 con 0x7f25400b2850 2023-11-08T19:26:12.857 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.854+0000 7f25485f1700 1 -- 172.21.15.149:0/1958276210 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2540150860 con 0x7f25400b2850 2023-11-08T19:26:12.858 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.856+0000 7f2536ffd700 1 -- 172.21.15.149:0/1958276210 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+22002 (secure 0 0 0) 0x7f2540150860 con 0x7f25400b2850 2023-11-08T19:26:12.859 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:26:12.859 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":82,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:26:11.528998+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-08T19:24:29.516185+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-08T19:25:44.287064+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":71,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-08T19:25:45.623521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-11-08T19:26:09.267609+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-11-08T19:26:10.496194+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:26:12.860 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.858+0000 7f25485f1700 1 -- 172.21.15.149:0/1958276210 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f252406af00 msgr2=0x7f252406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:12.861 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.858+0000 7f25485f1700 1 --2- 172.21.15.149:0/1958276210 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f252406af00 0x7f252406d3c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f2530000f60 tx=0x7f2530009040 comp rx=0 tx=0).stop 2023-11-08T19:26:12.861 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.858+0000 7f25485f1700 1 -- 172.21.15.149:0/1958276210 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25400b2850 msgr2=0x7f25400ae470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:12.861 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.858+0000 7f25485f1700 1 --2- 172.21.15.149:0/1958276210 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25400b2850 0x7f25400ae470 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f253c009130 tx=0x7f253c004750 comp rx=0 tx=0).stop 2023-11-08T19:26:12.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.858+0000 7f25485f1700 1 -- 172.21.15.149:0/1958276210 shutdown_connections 2023-11-08T19:26:12.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.858+0000 7f25485f1700 1 --2- 172.21.15.149:0/1958276210 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f252406af00 0x7f252406d3c0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:12.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.858+0000 7f25485f1700 1 --2- 172.21.15.149:0/1958276210 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25400cc140 0x7f254014f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:12.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.858+0000 7f25485f1700 1 --2- 172.21.15.149:0/1958276210 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25400b2850 0x7f25400ae470 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:12.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.858+0000 7f25485f1700 1 --2- 172.21.15.149:0/1958276210 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f25400b2cd0 0x7f25400b5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:12.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.858+0000 7f25485f1700 1 -- 172.21.15.149:0/1958276210 >> 172.21.15.149:0/1958276210 conn(0x7f2540099a40 msgr2=0x7f2540160bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:12.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.858+0000 7f25485f1700 1 -- 172.21.15.149:0/1958276210 shutdown_connections 2023-11-08T19:26:12.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.858+0000 7f25485f1700 1 -- 172.21.15.149:0/1958276210 wait complete. 2023-11-08T19:26:12.873 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-08T19:26:12.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.994+0000 7f8aaf9e4700 1 Processor -- start 2023-11-08T19:26:12.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.994+0000 7f8aaf9e4700 1 -- start start 2023-11-08T19:26:12.998 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.995+0000 7f8aaf9e4700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f8aa815df40 0x7f8aa806c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:12.999 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.995+0000 7f8aaf9e4700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8aa815e320 con 0x7f8aa80cb660 2023-11-08T19:26:12.999 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.995+0000 7f8aaf9e4700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8aa806b020 con 0x7f8aa806ab80 2023-11-08T19:26:12.999 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.995+0000 7f8aaf9e4700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8aa806b2e0 con 0x7f8aa815df40 2023-11-08T19:26:12.999 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.995+0000 7f8aad780700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f8aa815df40 0x7f8aa806c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:12.999 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.995+0000 7f8aadf81700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f8aa80cb660 0x7f8aa80ce540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:44394/0 (socket says 172.21.15.149:44394) 2023-11-08T19:26:13.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.995+0000 7f8aadf81700 1 -- 172.21.15.149:0/2834168964 learned_addr learned my addr 172.21.15.149:0/2834168964 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:26:13.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.995+0000 7f8aad780700 1 -- 172.21.15.149:0/2834168964 >> v1:172.21.15.160:6789/0 conn(0x7f8aa806ab80 legacy=0x7f8aa80caf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:13.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.995+0000 7f8aad780700 1 -- 172.21.15.149:0/2834168964 >> v1:172.21.15.149:6789/0 conn(0x7f8aa80cb660 legacy=0x7f8aa80ce540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:13.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.995+0000 7f8aad780700 1 -- 172.21.15.149:0/2834168964 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa806b5c0 con 0x7f8aa815df40 2023-11-08T19:26:13.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.995+0000 7f8aad780700 1 --2- 172.21.15.149:0/2834168964 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8aa815df40 0x7f8aa806c0a0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f8aa4009840 tx=0x7f8aa4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8d07e615cf3db92 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:13.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.996+0000 7f8a9ffff700 1 -- 172.21.15.149:0/2834168964 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa4004230 con 0x7f8aa815df40 2023-11-08T19:26:13.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.996+0000 7f8a9ffff700 1 -- 172.21.15.149:0/2834168964 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aa4004390 con 0x7f8aa815df40 2023-11-08T19:26:13.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.996+0000 7f8a9ffff700 1 -- 172.21.15.149:0/2834168964 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa40036a0 con 0x7f8aa815df40 2023-11-08T19:26:13.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.996+0000 7f8aaf9e4700 1 -- 172.21.15.149:0/2834168964 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8aa815df40 msgr2=0x7f8aa806c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:13.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.996+0000 7f8aaf9e4700 1 --2- 172.21.15.149:0/2834168964 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8aa815df40 0x7f8aa806c0a0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f8aa4009840 tx=0x7f8aa4009b50 comp rx=0 tx=0).stop 2023-11-08T19:26:13.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.996+0000 7f8aaf9e4700 1 -- 172.21.15.149:0/2834168964 shutdown_connections 2023-11-08T19:26:13.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.996+0000 7f8aaf9e4700 1 --2- 172.21.15.149:0/2834168964 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8aa815df40 0x7f8aa806c0a0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:13.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.996+0000 7f8aaf9e4700 1 -- 172.21.15.149:0/2834168964 >> 172.21.15.149:0/2834168964 conn(0x7f8aa80d0640 msgr2=0x7f8aa80d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:13.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.996+0000 7f8aaf9e4700 1 -- 172.21.15.149:0/2834168964 shutdown_connections 2023-11-08T19:26:13.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.996+0000 7f8aaf9e4700 1 -- 172.21.15.149:0/2834168964 wait complete. 2023-11-08T19:26:13.006 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.997+0000 7f8aaf9e4700 1 Processor -- start 2023-11-08T19:26:13.007 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.997+0000 7f8aaf9e4700 1 -- start start 2023-11-08T19:26:13.007 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.998+0000 7f8aaf9e4700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8aa806ab80 0x7f8aa8156b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:13.007 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.998+0000 7f8aaf9e4700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8aa80cb660 0x7f8aa80ca2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:13.007 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.998+0000 7f8aaf9e4700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8aa815df40 0x7f8aa8160d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:13.008 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.998+0000 7f8aaf9e4700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa815fce0 con 0x7f8aa815df40 2023-11-08T19:26:13.008 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.998+0000 7f8aaf9e4700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa815ffc0 con 0x7f8aa806ab80 2023-11-08T19:26:13.008 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.998+0000 7f8aaf9e4700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa81602a0 con 0x7f8aa80cb660 2023-11-08T19:26:13.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.998+0000 7f8aadf81700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8aa815df40 0x7f8aa8160d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:13.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.998+0000 7f8aadf81700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8aa815df40 0x7f8aa8160d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42398/0 (socket says 172.21.15.149:42398) 2023-11-08T19:26:13.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.998+0000 7f8aadf81700 1 -- 172.21.15.149:0/3623176190 learned_addr learned my addr 172.21.15.149:0/3623176190 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:13.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.998+0000 7f8aad780700 1 --2- 172.21.15.149:0/3623176190 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8aa806ab80 0x7f8aa8156b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:13.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.998+0000 7f8aacf7f700 1 --2- 172.21.15.149:0/3623176190 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8aa80cb660 0x7f8aa80ca2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:13.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.998+0000 7f8aadf81700 1 -- 172.21.15.149:0/3623176190 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8aa80cb660 msgr2=0x7f8aa80ca2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:13.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.998+0000 7f8aadf81700 1 --2- 172.21.15.149:0/3623176190 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8aa80cb660 0x7f8aa80ca2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:13.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.998+0000 7f8aadf81700 1 -- 172.21.15.149:0/3623176190 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8aa806ab80 msgr2=0x7f8aa8156b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:13.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.998+0000 7f8aadf81700 1 --2- 172.21.15.149:0/3623176190 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8aa806ab80 0x7f8aa8156b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:13.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.998+0000 7f8aadf81700 1 -- 172.21.15.149:0/3623176190 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa40094a0 con 0x7f8aa815df40 2023-11-08T19:26:13.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.998+0000 7f8aacf7f700 1 --2- 172.21.15.149:0/3623176190 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8aa80cb660 0x7f8aa80ca2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:26:13.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.999+0000 7f8aad780700 1 --2- 172.21.15.149:0/3623176190 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8aa806ab80 0x7f8aa8156b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:26:13.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.999+0000 7f8aadf81700 1 --2- 172.21.15.149:0/3623176190 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8aa815df40 0x7f8aa8160d80 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f8aa000cb10 tx=0x7f8aa000ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:13.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.999+0000 7f8a9dffb700 1 -- 172.21.15.149:0/3623176190 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa000ab00 con 0x7f8aa815df40 2023-11-08T19:26:13.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.999+0000 7f8a9dffb700 1 -- 172.21.15.149:0/3623176190 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aa000ac60 con 0x7f8aa815df40 2023-11-08T19:26:13.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.999+0000 7f8aaf9e4700 1 -- 172.21.15.149:0/3623176190 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aa8160580 con 0x7f8aa815df40 2023-11-08T19:26:13.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.999+0000 7f8a9dffb700 1 -- 172.21.15.149:0/3623176190 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa0012400 con 0x7f8aa815df40 2023-11-08T19:26:13.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:12.999+0000 7f8aaf9e4700 1 -- 172.21.15.149:0/3623176190 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aa80ca830 con 0x7f8aa815df40 2023-11-08T19:26:13.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:13.000+0000 7f8aaf9e4700 1 -- 172.21.15.149:0/3623176190 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8aa8160aa0 con 0x7f8aa815df40 2023-11-08T19:26:13.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:13.000+0000 7f8a9dffb700 1 -- 172.21.15.149:0/3623176190 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8aa001b3b0 con 0x7f8aa815df40 2023-11-08T19:26:13.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:13.001+0000 7f8a9dffb700 1 --2- 172.21.15.149:0/3623176190 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f8a8c06af00 0x7f8a8c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:13.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:13.001+0000 7f8a9dffb700 1 -- 172.21.15.149:0/3623176190 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f8aa0089700 con 0x7f8aa815df40 2023-11-08T19:26:13.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:13.001+0000 7f8aad780700 1 --2- 172.21.15.149:0/3623176190 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f8a8c06af00 0x7f8a8c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:13.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:13.001+0000 7f8aad780700 1 --2- 172.21.15.149:0/3623176190 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f8a8c06af00 0x7f8a8c06d3c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f8aa40090b0 tx=0x7f8aa4013040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:13.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:13.006+0000 7f8a9dffb700 1 -- 172.21.15.149:0/3623176190 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8aa8160aa0 con 0x7f8aa815df40 2023-11-08T19:26:13.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:13.240+0000 7f8aaf9e4700 1 -- 172.21.15.149:0/3623176190 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f8aa8160aa0 con 0x7f8aa815df40 2023-11-08T19:26:14.164 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.162+0000 7f8a9dffb700 1 -- 172.21.15.149:0/3623176190 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v43) v1 ==== 118+0+0 (secure 0 0 0) 0x7f8aa8160aa0 con 0x7f8aa815df40 2023-11-08T19:26:14.168 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.165+0000 7f8aaf9e4700 1 -- 172.21.15.149:0/3623176190 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f8a8c06af00 msgr2=0x7f8a8c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:14.168 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.165+0000 7f8aaf9e4700 1 --2- 172.21.15.149:0/3623176190 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f8a8c06af00 0x7f8a8c06d3c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f8aa40090b0 tx=0x7f8aa4013040 comp rx=0 tx=0).stop 2023-11-08T19:26:14.168 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.165+0000 7f8aaf9e4700 1 -- 172.21.15.149:0/3623176190 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8aa815df40 msgr2=0x7f8aa8160d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:14.169 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.165+0000 7f8aaf9e4700 1 --2- 172.21.15.149:0/3623176190 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8aa815df40 0x7f8aa8160d80 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f8aa000cb10 tx=0x7f8aa000ced0 comp rx=0 tx=0).stop 2023-11-08T19:26:14.169 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.165+0000 7f8aaf9e4700 1 -- 172.21.15.149:0/3623176190 shutdown_connections 2023-11-08T19:26:14.169 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.165+0000 7f8aaf9e4700 1 --2- 172.21.15.149:0/3623176190 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f8a8c06af00 0x7f8a8c06d3c0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:14.169 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.165+0000 7f8aaf9e4700 1 --2- 172.21.15.149:0/3623176190 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8aa806ab80 0x7f8aa8156b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:14.169 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.165+0000 7f8aaf9e4700 1 --2- 172.21.15.149:0/3623176190 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8aa815df40 0x7f8aa8160d80 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:14.170 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.165+0000 7f8aaf9e4700 1 --2- 172.21.15.149:0/3623176190 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8aa80cb660 0x7f8aa80ca2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:14.170 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.165+0000 7f8aaf9e4700 1 -- 172.21.15.149:0/3623176190 >> 172.21.15.149:0/3623176190 conn(0x7f8aa80d0640 msgr2=0x7f8aa80d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:14.170 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.165+0000 7f8aaf9e4700 1 -- 172.21.15.149:0/3623176190 shutdown_connections 2023-11-08T19:26:14.171 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.165+0000 7f8aaf9e4700 1 -- 172.21.15.149:0/3623176190 wait complete. 2023-11-08T19:26:14.180 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-08T19:26:14.181 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-08T19:26:14.307 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.305+0000 7fc2c60a6700 1 Processor -- start 2023-11-08T19:26:14.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.305+0000 7fc2c60a6700 1 -- start start 2023-11-08T19:26:14.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.306+0000 7fc2c60a6700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc2c015df40 0x7fc2c006c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:14.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.306+0000 7fc2c60a6700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc2c00cb660 0x7fc2c006c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:14.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.306+0000 7fc2c60a6700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2c015e320 con 0x7fc2c006ab80 2023-11-08T19:26:14.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.306+0000 7fc2c60a6700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2c006b020 con 0x7fc2c00cb660 2023-11-08T19:26:14.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.306+0000 7fc2c60a6700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c006b2e0 con 0x7fc2c015df40 2023-11-08T19:26:14.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.306+0000 7fc2bffff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc2c00cb660 0x7fc2c006c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:14.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.306+0000 7fc2bffff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc2c00cb660 0x7fc2c006c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42406/0 (socket says 172.21.15.149:42406) 2023-11-08T19:26:14.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.306+0000 7fc2bffff700 1 -- 172.21.15.149:0/4160494970 learned_addr learned my addr 172.21.15.149:0/4160494970 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:14.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.306+0000 7fc2bffff700 1 -- 172.21.15.149:0/4160494970 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc2c015df40 msgr2=0x7fc2c006c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:14.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.306+0000 7fc2bffff700 1 --2- 172.21.15.149:0/4160494970 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc2c015df40 0x7fc2c006c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:14.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.306+0000 7fc2bffff700 1 -- 172.21.15.149:0/4160494970 >> v1:172.21.15.160:6789/0 conn(0x7fc2c006ab80 legacy=0x7fc2c00caf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:14.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.306+0000 7fc2bffff700 1 -- 172.21.15.149:0/4160494970 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2c006b5c0 con 0x7fc2c00cb660 2023-11-08T19:26:14.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.306+0000 7fc2bffff700 1 --2- 172.21.15.149:0/4160494970 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2c00cb660 0x7fc2c006c5e0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fc2b8009e50 tx=0x7fc2b800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=610d5be1e3e29f7a server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:14.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.307+0000 7fc2be7fc700 1 -- 172.21.15.149:0/4160494970 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b800e070 con 0x7fc2c00cb660 2023-11-08T19:26:14.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.307+0000 7fc2be7fc700 1 -- 172.21.15.149:0/4160494970 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2b8003a20 con 0x7fc2c00cb660 2023-11-08T19:26:14.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.307+0000 7fc2be7fc700 1 -- 172.21.15.149:0/4160494970 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b8003dd0 con 0x7fc2c00cb660 2023-11-08T19:26:14.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.307+0000 7fc2c60a6700 1 -- 172.21.15.149:0/4160494970 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2c00cb660 msgr2=0x7fc2c006c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:14.314 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.307+0000 7fc2c60a6700 1 --2- 172.21.15.149:0/4160494970 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2c00cb660 0x7fc2c006c5e0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fc2b8009e50 tx=0x7fc2b800b330 comp rx=0 tx=0).stop 2023-11-08T19:26:14.314 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.307+0000 7fc2c60a6700 1 -- 172.21.15.149:0/4160494970 shutdown_connections 2023-11-08T19:26:14.315 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.307+0000 7fc2c60a6700 1 --2- 172.21.15.149:0/4160494970 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2c00cb660 0x7fc2c006c5e0 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:14.315 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.307+0000 7fc2c60a6700 1 --2- 172.21.15.149:0/4160494970 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc2c015df40 0x7fc2c006c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:14.315 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.307+0000 7fc2c60a6700 1 -- 172.21.15.149:0/4160494970 >> 172.21.15.149:0/4160494970 conn(0x7fc2c00d0640 msgr2=0x7fc2c00d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:14.315 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.307+0000 7fc2c60a6700 1 -- 172.21.15.149:0/4160494970 shutdown_connections 2023-11-08T19:26:14.315 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.307+0000 7fc2c60a6700 1 -- 172.21.15.149:0/4160494970 wait complete. 2023-11-08T19:26:14.319 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.308+0000 7fc2c60a6700 1 Processor -- start 2023-11-08T19:26:14.320 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.309+0000 7fc2c60a6700 1 -- start start 2023-11-08T19:26:14.320 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.309+0000 7fc2c60a6700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc2c006ab80 0x7fc2c01512c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:14.320 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.309+0000 7fc2c60a6700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2c00cb660 0x7fc2c00c9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:14.320 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.309+0000 7fc2c60a6700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc2c015df40 0x7fc2c00c9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:14.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.309+0000 7fc2c60a6700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c0160b90 con 0x7fc2c00cb660 2023-11-08T19:26:14.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.309+0000 7fc2c60a6700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c00c7710 con 0x7fc2c015df40 2023-11-08T19:26:14.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.309+0000 7fc2c60a6700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c00ca190 con 0x7fc2c006ab80 2023-11-08T19:26:14.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.309+0000 7fc2beffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2c00cb660 0x7fc2c00c9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:14.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.309+0000 7fc2beffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2c00cb660 0x7fc2c00c9640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42410/0 (socket says 172.21.15.149:42410) 2023-11-08T19:26:14.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.309+0000 7fc2beffd700 1 -- 172.21.15.149:0/2117432962 learned_addr learned my addr 172.21.15.149:0/2117432962 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:14.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.309+0000 7fc2bf7fe700 1 --2- 172.21.15.149:0/2117432962 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc2c006ab80 0x7fc2c01512c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:14.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.310+0000 7fc2bffff700 1 --2- 172.21.15.149:0/2117432962 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc2c015df40 0x7fc2c00c9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:14.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.310+0000 7fc2beffd700 1 -- 172.21.15.149:0/2117432962 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc2c006ab80 msgr2=0x7fc2c01512c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:14.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.310+0000 7fc2beffd700 1 --2- 172.21.15.149:0/2117432962 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc2c006ab80 0x7fc2c01512c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:14.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.310+0000 7fc2beffd700 1 -- 172.21.15.149:0/2117432962 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc2c015df40 msgr2=0x7fc2c00c9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:14.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.310+0000 7fc2beffd700 1 --2- 172.21.15.149:0/2117432962 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc2c015df40 0x7fc2c00c9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:14.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.310+0000 7fc2beffd700 1 -- 172.21.15.149:0/2117432962 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b8009b30 con 0x7fc2c00cb660 2023-11-08T19:26:14.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.310+0000 7fc2beffd700 1 --2- 172.21.15.149:0/2117432962 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2c00cb660 0x7fc2c00c9640 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fc2b000c4a0 tx=0x7fc2b000c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:14.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.310+0000 7fc2b7fff700 1 -- 172.21.15.149:0/2117432962 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b00054e0 con 0x7fc2c00cb660 2023-11-08T19:26:14.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.310+0000 7fc2b7fff700 1 -- 172.21.15.149:0/2117432962 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2b0003680 con 0x7fc2c00cb660 2023-11-08T19:26:14.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.310+0000 7fc2b7fff700 1 -- 172.21.15.149:0/2117432962 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b0003a30 con 0x7fc2c00cb660 2023-11-08T19:26:14.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.310+0000 7fc2c60a6700 1 -- 172.21.15.149:0/2117432962 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2c0160e30 con 0x7fc2c00cb660 2023-11-08T19:26:14.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.310+0000 7fc2c60a6700 1 -- 172.21.15.149:0/2117432962 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2c01613f0 con 0x7fc2c00cb660 2023-11-08T19:26:14.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.311+0000 7fc2c60a6700 1 -- 172.21.15.149:0/2117432962 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2c01609f0 con 0x7fc2c00cb660 2023-11-08T19:26:14.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.311+0000 7fc2b7fff700 1 -- 172.21.15.149:0/2117432962 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc2b0003b90 con 0x7fc2c00cb660 2023-11-08T19:26:14.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.312+0000 7fc2b7fff700 1 --2- 172.21.15.149:0/2117432962 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc2a006af00 0x7fc2a006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:14.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.312+0000 7fc2b7fff700 1 -- 172.21.15.149:0/2117432962 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7fc2b0088ac0 con 0x7fc2c00cb660 2023-11-08T19:26:14.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.312+0000 7fc2bf7fe700 1 --2- 172.21.15.149:0/2117432962 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc2a006af00 0x7fc2a006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:14.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.312+0000 7fc2bf7fe700 1 --2- 172.21.15.149:0/2117432962 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc2a006af00 0x7fc2a006d3c0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fc2a8009970 tx=0x7fc2a8009110 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:14.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.317+0000 7fc2b7fff700 1 -- 172.21.15.149:0/2117432962 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc2c01609f0 con 0x7fc2c00cb660 2023-11-08T19:26:14.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:14.551+0000 7fc2c60a6700 1 -- 172.21.15.149:0/2117432962 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fc2c01609f0 con 0x7fc2c00cb660 2023-11-08T19:26:15.165 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.163+0000 7fc2b7fff700 1 -- 172.21.15.149:0/2117432962 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v44) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc2c01609f0 con 0x7fc2c00cb660 2023-11-08T19:26:15.168 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.165+0000 7fc2c60a6700 1 -- 172.21.15.149:0/2117432962 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc2a006af00 msgr2=0x7fc2a006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:15.168 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.165+0000 7fc2c60a6700 1 --2- 172.21.15.149:0/2117432962 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc2a006af00 0x7fc2a006d3c0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fc2a8009970 tx=0x7fc2a8009110 comp rx=0 tx=0).stop 2023-11-08T19:26:15.168 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.165+0000 7fc2c60a6700 1 -- 172.21.15.149:0/2117432962 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2c00cb660 msgr2=0x7fc2c00c9640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:15.168 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.165+0000 7fc2c60a6700 1 --2- 172.21.15.149:0/2117432962 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2c00cb660 0x7fc2c00c9640 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fc2b000c4a0 tx=0x7fc2b000c7b0 comp rx=0 tx=0).stop 2023-11-08T19:26:15.168 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.165+0000 7fc2c60a6700 1 -- 172.21.15.149:0/2117432962 shutdown_connections 2023-11-08T19:26:15.169 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.165+0000 7fc2c60a6700 1 --2- 172.21.15.149:0/2117432962 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc2a006af00 0x7fc2a006d3c0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:15.169 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.165+0000 7fc2c60a6700 1 --2- 172.21.15.149:0/2117432962 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc2c015df40 0x7fc2c00c9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:15.169 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.165+0000 7fc2c60a6700 1 --2- 172.21.15.149:0/2117432962 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc2c006ab80 0x7fc2c01512c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:15.169 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.165+0000 7fc2c60a6700 1 --2- 172.21.15.149:0/2117432962 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2c00cb660 0x7fc2c00c9640 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:15.169 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.165+0000 7fc2c60a6700 1 -- 172.21.15.149:0/2117432962 >> 172.21.15.149:0/2117432962 conn(0x7fc2c00d0640 msgr2=0x7fc2c00cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:15.170 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.166+0000 7fc2c60a6700 1 -- 172.21.15.149:0/2117432962 shutdown_connections 2023-11-08T19:26:15.170 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.166+0000 7fc2c60a6700 1 -- 172.21.15.149:0/2117432962 wait complete. 2023-11-08T19:26:15.182 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-08T19:26:15.183 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:26:15.304 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.302+0000 7f306006e700 1 Processor -- start 2023-11-08T19:26:15.304 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.302+0000 7f306006e700 1 -- start start 2023-11-08T19:26:15.307 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.302+0000 7f306006e700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f305815b950 0x7f30580ce130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:15.307 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.303+0000 7f306006e700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f30580d0430 0x7f30580ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:15.307 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.303+0000 7f306006e700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30580cc2e0 con 0x7f30580cd5e0 2023-11-08T19:26:15.307 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.303+0000 7f306006e700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30580cc580 con 0x7f30580d0430 2023-11-08T19:26:15.307 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.303+0000 7f306006e700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30580cc820 con 0x7f305815b950 2023-11-08T19:26:15.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.303+0000 7f305d609700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f30580cd5e0 0x7f30580cfd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:44420/0 (socket says 172.21.15.149:44420) 2023-11-08T19:26:15.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.303+0000 7f305d609700 1 -- 172.21.15.149:0/3159238691 learned_addr learned my addr 172.21.15.149:0/3159238691 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:26:15.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.303+0000 7f305e60b700 1 --2- 172.21.15.149:0/3159238691 >> v2:172.21.15.149:3300/0 conn(0x7f30580d0430 0x7f30580ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:15.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.303+0000 7f305de0a700 1 --2- 172.21.15.149:0/3159238691 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f305815b950 0x7f30580ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:15.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.303+0000 7f305ce08700 1 -- 172.21.15.149:0/3159238691 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1191236893 0 0) 0x7f30580cc2e0 con 0x7f30580cd5e0 2023-11-08T19:26:15.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.303+0000 7f305ce08700 1 -- 172.21.15.149:0/3159238691 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30440035b0 con 0x7f30580cd5e0 2023-11-08T19:26:15.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.303+0000 7f305e60b700 1 -- 172.21.15.149:0/3159238691 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f305815b950 msgr2=0x7f30580ce130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:15.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.303+0000 7f305e60b700 1 --2- 172.21.15.149:0/3159238691 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f305815b950 0x7f30580ce130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:15.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.303+0000 7f305e60b700 1 -- 172.21.15.149:0/3159238691 >> v1:172.21.15.149:6789/0 conn(0x7f30580cd5e0 legacy=0x7f30580cfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:15.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.303+0000 7f305e60b700 1 -- 172.21.15.149:0/3159238691 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30580ccb00 con 0x7f30580d0430 2023-11-08T19:26:15.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.303+0000 7f305e60b700 1 --2- 172.21.15.149:0/3159238691 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30580d0430 0x7f30580ce670 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f3050009d90 tx=0x7f305000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a591ed6e88b0e477 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:15.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.303+0000 7f305ce08700 1 -- 172.21.15.149:0/3159238691 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305000e070 con 0x7f30580d0430 2023-11-08T19:26:15.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.303+0000 7f305ce08700 1 -- 172.21.15.149:0/3159238691 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f305000bb20 con 0x7f30580d0430 2023-11-08T19:26:15.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.303+0000 7f305ce08700 1 -- 172.21.15.149:0/3159238691 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3050012430 con 0x7f30580d0430 2023-11-08T19:26:15.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.304+0000 7f306006e700 1 -- 172.21.15.149:0/3159238691 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30580d0430 msgr2=0x7f30580ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:15.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.304+0000 7f306006e700 1 --2- 172.21.15.149:0/3159238691 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30580d0430 0x7f30580ce670 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f3050009d90 tx=0x7f305000b330 comp rx=0 tx=0).stop 2023-11-08T19:26:15.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.304+0000 7f306006e700 1 -- 172.21.15.149:0/3159238691 shutdown_connections 2023-11-08T19:26:15.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.304+0000 7f306006e700 1 --2- 172.21.15.149:0/3159238691 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30580d0430 0x7f30580ce670 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:15.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.304+0000 7f306006e700 1 --2- 172.21.15.149:0/3159238691 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f305815b950 0x7f30580ce130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:15.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.304+0000 7f306006e700 1 -- 172.21.15.149:0/3159238691 >> 172.21.15.149:0/3159238691 conn(0x7f305808afd0 msgr2=0x7f30580d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:15.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.304+0000 7f306006e700 1 -- 172.21.15.149:0/3159238691 shutdown_connections 2023-11-08T19:26:15.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.304+0000 7f306006e700 1 -- 172.21.15.149:0/3159238691 wait complete. 2023-11-08T19:26:15.315 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.305+0000 7f306006e700 1 Processor -- start 2023-11-08T19:26:15.315 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.305+0000 7f306006e700 1 -- start start 2023-11-08T19:26:15.316 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.306+0000 7f306006e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f30580d0430 0x7f305806c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:15.316 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.306+0000 7f306006e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f305815b950 0x7f30580b3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:15.316 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.306+0000 7f306006e700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f30580c91b0 0x7f30580cabb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:15.316 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.306+0000 7f306006e700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30580b3d70 con 0x7f305815b950 2023-11-08T19:26:15.317 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.306+0000 7f306006e700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30580b5110 con 0x7f30580d0430 2023-11-08T19:26:15.317 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.306+0000 7f306006e700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f305806d600 con 0x7f30580c91b0 2023-11-08T19:26:15.317 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.306+0000 7f305d609700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f305815b950 0x7f30580b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:15.317 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.306+0000 7f305d609700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f305815b950 0x7f30580b3830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42424/0 (socket says 172.21.15.149:42424) 2023-11-08T19:26:15.318 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.306+0000 7f305d609700 1 -- 172.21.15.149:0/4207408904 learned_addr learned my addr 172.21.15.149:0/4207408904 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:15.318 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.306+0000 7f305e60b700 1 --2- 172.21.15.149:0/4207408904 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f30580c91b0 0x7f30580cabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:15.318 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.306+0000 7f305d609700 1 -- 172.21.15.149:0/4207408904 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f30580c91b0 msgr2=0x7f30580cabb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:15.318 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.306+0000 7f305d609700 1 --2- 172.21.15.149:0/4207408904 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f30580c91b0 0x7f30580cabb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:15.318 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.306+0000 7f305d609700 1 -- 172.21.15.149:0/4207408904 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f30580d0430 msgr2=0x7f305806c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:15.319 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.306+0000 7f305d609700 1 --2- 172.21.15.149:0/4207408904 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f30580d0430 0x7f305806c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:15.319 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.306+0000 7f305d609700 1 -- 172.21.15.149:0/4207408904 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3050009a70 con 0x7f305815b950 2023-11-08T19:26:15.319 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.306+0000 7f305d609700 1 --2- 172.21.15.149:0/4207408904 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f305815b950 0x7f30580b3830 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f305400c730 tx=0x7f305400caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:15.319 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.307+0000 7f304e7fc700 1 -- 172.21.15.149:0/4207408904 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3054005d70 con 0x7f305815b950 2023-11-08T19:26:15.320 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.307+0000 7f304e7fc700 1 -- 172.21.15.149:0/4207408904 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30540070d0 con 0x7f305815b950 2023-11-08T19:26:15.320 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.307+0000 7f304e7fc700 1 -- 172.21.15.149:0/4207408904 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3054007440 con 0x7f305815b950 2023-11-08T19:26:15.320 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.307+0000 7f306006e700 1 -- 172.21.15.149:0/4207408904 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f305806cd60 con 0x7f305815b950 2023-11-08T19:26:15.320 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.307+0000 7f306006e700 1 -- 172.21.15.149:0/4207408904 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f305806d320 con 0x7f305815b950 2023-11-08T19:26:15.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.308+0000 7f306006e700 1 -- 172.21.15.149:0/4207408904 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30580745f0 con 0x7f305815b950 2023-11-08T19:26:15.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.308+0000 7f304e7fc700 1 -- 172.21.15.149:0/4207408904 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f30540075a0 con 0x7f305815b950 2023-11-08T19:26:15.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.308+0000 7f304e7fc700 1 --2- 172.21.15.149:0/4207408904 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f303c06af00 0x7f303c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:15.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.308+0000 7f304e7fc700 1 -- 172.21.15.149:0/4207408904 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f3054088ef0 con 0x7f305815b950 2023-11-08T19:26:15.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.308+0000 7f305de0a700 1 --2- 172.21.15.149:0/4207408904 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f303c06af00 0x7f303c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:15.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.309+0000 7f305de0a700 1 --2- 172.21.15.149:0/4207408904 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f303c06af00 0x7f303c06d3c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f3048006ac0 tx=0x7f3048006a50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:15.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.313+0000 7f304e7fc700 1 -- 172.21.15.149:0/4207408904 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3054053b70 con 0x7f305815b950 2023-11-08T19:26:15.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.546+0000 7f306006e700 1 -- 172.21.15.149:0/4207408904 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f30580b5250 con 0x7f305815b950 2023-11-08T19:26:15.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.547+0000 7f304e7fc700 1 -- 172.21.15.149:0/4207408904 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4912 (secure 0 0 0) 0x7f30580b5250 con 0x7f305815b950 2023-11-08T19:26:15.549 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:26:15.550 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":44,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5681,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/1946892292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":1946892292},{"type":"v1","addr":"172.21.15.160:6835","nonce":1946892292}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39},{"gid":6145,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/84105573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":84105573},{"type":"v1","addr":"172.21.15.160:6833","nonce":84105573}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39},{"gid":6663,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/3243545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3243545},{"type":"v1","addr":"172.21.15.149:6836","nonce":3243545}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-08T19:26:11.529336+0000","modified":"2023-11-08T19:26:14.553465+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6666},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6666":{"gid":6666,"name":"a","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6837/1594746264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":1594746264},{"type":"v1","addr":"172.21.15.149:6837","nonce":1594746264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-08T19:26:15.551 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.549+0000 7f306006e700 1 -- 172.21.15.149:0/4207408904 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f303c06af00 msgr2=0x7f303c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:15.552 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.549+0000 7f306006e700 1 --2- 172.21.15.149:0/4207408904 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f303c06af00 0x7f303c06d3c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f3048006ac0 tx=0x7f3048006a50 comp rx=0 tx=0).stop 2023-11-08T19:26:15.552 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.549+0000 7f306006e700 1 -- 172.21.15.149:0/4207408904 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f305815b950 msgr2=0x7f30580b3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:15.552 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.549+0000 7f306006e700 1 --2- 172.21.15.149:0/4207408904 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f305815b950 0x7f30580b3830 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f305400c730 tx=0x7f305400caf0 comp rx=0 tx=0).stop 2023-11-08T19:26:15.552 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.549+0000 7f306006e700 1 -- 172.21.15.149:0/4207408904 shutdown_connections 2023-11-08T19:26:15.552 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.549+0000 7f306006e700 1 --2- 172.21.15.149:0/4207408904 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f303c06af00 0x7f303c06d3c0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:15.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.549+0000 7f306006e700 1 --2- 172.21.15.149:0/4207408904 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f30580d0430 0x7f305806c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:15.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.549+0000 7f306006e700 1 --2- 172.21.15.149:0/4207408904 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f30580c91b0 0x7f30580cabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:15.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.549+0000 7f306006e700 1 --2- 172.21.15.149:0/4207408904 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f305815b950 0x7f30580b3830 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:15.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.549+0000 7f306006e700 1 -- 172.21.15.149:0/4207408904 >> 172.21.15.149:0/4207408904 conn(0x7f305808afd0 msgr2=0x7f30580cfd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:15.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.549+0000 7f306006e700 1 -- 172.21.15.149:0/4207408904 shutdown_connections 2023-11-08T19:26:15.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.549+0000 7f306006e700 1 -- 172.21.15.149:0/4207408904 wait complete. 2023-11-08T19:26:15.554 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 44 2023-11-08T19:26:15.564 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:26:15.685 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.683+0000 7f50d0c45700 1 Processor -- start 2023-11-08T19:26:15.686 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.683+0000 7f50d0c45700 1 -- start start 2023-11-08T19:26:15.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.684+0000 7f50d0c45700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f50cc0b16b0 0x7f50cc0ce380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:15.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.684+0000 7f50d0c45700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50cc0d1330 con 0x7f50cc0b20b0 2023-11-08T19:26:15.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.684+0000 7f50d0c45700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50cc0cb490 con 0x7f50cc0afb30 2023-11-08T19:26:15.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.684+0000 7f50d0c45700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50cc0cb770 con 0x7f50cc0b16b0 2023-11-08T19:26:15.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.684+0000 7f50cad9d700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f50cc0b20b0 0x7f50cc0aff90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:44436/0 (socket says 172.21.15.149:44436) 2023-11-08T19:26:15.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.684+0000 7f50cad9d700 1 -- 172.21.15.149:0/2492224546 learned_addr learned my addr 172.21.15.149:0/2492224546 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:26:15.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.684+0000 7f50c9d9b700 1 --2- 172.21.15.149:0/2492224546 >> v2:172.21.15.160:3300/0 conn(0x7f50cc0b16b0 0x7f50cc0ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:15.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.684+0000 7f50c959a700 1 -- 172.21.15.149:0/2492224546 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 626879875 0 0) 0x7f50cc0d1330 con 0x7f50cc0b20b0 2023-11-08T19:26:15.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.684+0000 7f50c959a700 1 -- 172.21.15.149:0/2492224546 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50b40035b0 con 0x7f50cc0b20b0 2023-11-08T19:26:15.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.685+0000 7f50c959a700 1 -- 172.21.15.149:0/2492224546 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2277538176 0 0) 0x7f50cc0cb490 con 0x7f50cc0afb30 2023-11-08T19:26:15.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.685+0000 7f50c959a700 1 -- 172.21.15.149:0/2492224546 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50cc0d1330 con 0x7f50cc0afb30 2023-11-08T19:26:15.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.685+0000 7f50c959a700 1 -- 172.21.15.149:0/2492224546 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1596065397 0 0) 0x7f50b40035b0 con 0x7f50cc0b20b0 2023-11-08T19:26:15.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.685+0000 7f50c959a700 1 -- 172.21.15.149:0/2492224546 >> v2:172.21.15.160:3300/0 conn(0x7f50cc0b16b0 msgr2=0x7f50cc0ce380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:15.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.685+0000 7f50c959a700 1 --2- 172.21.15.149:0/2492224546 >> v2:172.21.15.160:3300/0 conn(0x7f50cc0b16b0 0x7f50cc0ce380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:15.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.685+0000 7f50c959a700 1 -- 172.21.15.149:0/2492224546 >> v1:172.21.15.160:6789/0 conn(0x7f50cc0afb30 legacy=0x7f50cc0cbf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:15.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.685+0000 7f50c959a700 1 -- 172.21.15.149:0/2492224546 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50cc0cba50 con 0x7f50cc0b20b0 2023-11-08T19:26:15.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.685+0000 7f50c959a700 1 -- 172.21.15.149:0/2492224546 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f50c40019f0 con 0x7f50cc0b20b0 2023-11-08T19:26:15.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.685+0000 7f50c9d9b700 1 --2- 172.21.15.149:0/2492224546 >> v2:172.21.15.160:3300/0 conn(0x7f50cc0b16b0 0x7f50cc0ce380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:26:15.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.685+0000 7f50c959a700 1 -- 172.21.15.149:0/2492224546 >> v1:172.21.15.149:6789/0 conn(0x7f50cc0b20b0 legacy=0x7f50cc0aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:15.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.685+0000 7f50c959a700 1 --2- 172.21.15.149:0/2492224546 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50b4003b90 0x7f50b4003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:15.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.685+0000 7f50c959a700 1 --2- 172.21.15.149:0/2492224546 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f50b4004850 0x7f50b4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:15.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.685+0000 7f50c959a700 1 --2- 172.21.15.149:0/2492224546 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f50b4005280 0x7f50b400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:15.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.685+0000 7f50c959a700 1 -- 172.21.15.149:0/2492224546 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50cc0cb770 con 0x7f50b4003b90 2023-11-08T19:26:15.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.685+0000 7f50c959a700 1 -- 172.21.15.149:0/2492224546 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b400c1e0 con 0x7f50b4005280 2023-11-08T19:26:15.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.685+0000 7f50c959a700 1 -- 172.21.15.149:0/2492224546 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50b400c3a0 con 0x7f50b4004850 2023-11-08T19:26:15.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.685+0000 7f50ca59c700 1 --2- 172.21.15.149:0/2492224546 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50b4003b90 0x7f50b4003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:15.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.685+0000 7f50cad9d700 1 --2- 172.21.15.149:0/2492224546 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f50b4005280 0x7f50b400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:15.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.685+0000 7f50c9d9b700 1 --2- 172.21.15.149:0/2492224546 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f50b4004850 0x7f50b4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:15.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.685+0000 7f50ca59c700 1 -- 172.21.15.149:0/2492224546 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f50b4004850 msgr2=0x7f50b4004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:15.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.685+0000 7f50ca59c700 1 --2- 172.21.15.149:0/2492224546 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f50b4004850 0x7f50b4004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:15.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.685+0000 7f50ca59c700 1 -- 172.21.15.149:0/2492224546 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f50b4005280 msgr2=0x7f50b400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:15.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.685+0000 7f50ca59c700 1 --2- 172.21.15.149:0/2492224546 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f50b4005280 0x7f50b400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:15.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.685+0000 7f50cad9d700 1 -- 172.21.15.149:0/2492224546 reap_dead start 2023-11-08T19:26:15.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.685+0000 7f50ca59c700 1 -- 172.21.15.149:0/2492224546 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b40035b0 con 0x7f50b4003b90 2023-11-08T19:26:15.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.685+0000 7f50ca59c700 1 --2- 172.21.15.149:0/2492224546 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50b4003b90 0x7f50b4003f90 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f50bc0019a0 tx=0x7f50b4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c83f10eba7e6c477 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:15.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.685+0000 7f50c959a700 1 -- 172.21.15.149:0/2492224546 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50bc001dd0 con 0x7f50b4003b90 2023-11-08T19:26:15.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.686+0000 7f50c959a700 1 -- 172.21.15.149:0/2492224546 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50bc0052f0 con 0x7f50b4003b90 2023-11-08T19:26:15.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.686+0000 7f50c959a700 1 -- 172.21.15.149:0/2492224546 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50bc001460 con 0x7f50b4003b90 2023-11-08T19:26:15.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.686+0000 7f50d0c45700 1 -- 172.21.15.149:0/2492224546 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50b4003b90 msgr2=0x7f50b4003f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:15.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.686+0000 7f50d0c45700 1 --2- 172.21.15.149:0/2492224546 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50b4003b90 0x7f50b4003f90 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f50bc0019a0 tx=0x7f50b4005880 comp rx=0 tx=0).stop 2023-11-08T19:26:15.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.686+0000 7f50d0c45700 1 -- 172.21.15.149:0/2492224546 shutdown_connections 2023-11-08T19:26:15.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.686+0000 7f50d0c45700 1 --2- 172.21.15.149:0/2492224546 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50b4003b90 0x7f50b4003f90 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:15.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.686+0000 7f50d0c45700 1 -- 172.21.15.149:0/2492224546 >> 172.21.15.149:0/2492224546 conn(0x7f50cc099a40 msgr2=0x7f50cc0d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:15.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.686+0000 7f50d0c45700 1 -- 172.21.15.149:0/2492224546 shutdown_connections 2023-11-08T19:26:15.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.686+0000 7f50d0c45700 1 -- 172.21.15.149:0/2492224546 wait complete. 2023-11-08T19:26:15.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.687+0000 7f50d0c45700 1 Processor -- start 2023-11-08T19:26:15.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.688+0000 7f50d0c45700 1 -- start start 2023-11-08T19:26:15.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.688+0000 7f50d0c45700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50b4003b90 0x7f50cc0c7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:15.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.688+0000 7f50d0c45700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f50cc1f5890 0x7f50cc0c69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:15.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.688+0000 7f50d0c45700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f50cc1f4c10 0x7f50cc1f5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:15.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.688+0000 7f50d0c45700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50cc1f55d0 con 0x7f50b4003b90 2023-11-08T19:26:15.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.688+0000 7f50d0c45700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50cc0c9df0 con 0x7f50cc1f5890 2023-11-08T19:26:15.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.688+0000 7f50d0c45700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50cc0ca040 con 0x7f50cc1f4c10 2023-11-08T19:26:15.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.688+0000 7f50ca59c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50b4003b90 0x7f50cc0c7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:15.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.688+0000 7f50ca59c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50b4003b90 0x7f50cc0c7670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42442/0 (socket says 172.21.15.149:42442) 2023-11-08T19:26:15.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.688+0000 7f50ca59c700 1 -- 172.21.15.149:0/682219435 learned_addr learned my addr 172.21.15.149:0/682219435 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:15.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.688+0000 7f50cad9d700 1 --2- 172.21.15.149:0/682219435 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f50cc1f4c10 0x7f50cc1f5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:15.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.688+0000 7f50c9d9b700 1 --2- 172.21.15.149:0/682219435 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f50cc1f5890 0x7f50cc0c69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:15.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.689+0000 7f50ca59c700 1 -- 172.21.15.149:0/682219435 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f50cc1f4c10 msgr2=0x7f50cc1f5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:15.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.689+0000 7f50ca59c700 1 --2- 172.21.15.149:0/682219435 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f50cc1f4c10 0x7f50cc1f5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:15.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.689+0000 7f50ca59c700 1 -- 172.21.15.149:0/682219435 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f50cc1f5890 msgr2=0x7f50cc0c69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:15.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.689+0000 7f50ca59c700 1 --2- 172.21.15.149:0/682219435 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f50cc1f5890 0x7f50cc0c69f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:15.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.689+0000 7f50ca59c700 1 -- 172.21.15.149:0/682219435 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50cc0ca320 con 0x7f50b4003b90 2023-11-08T19:26:15.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.689+0000 7f50ca59c700 1 --2- 172.21.15.149:0/682219435 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50b4003b90 0x7f50cc0c7670 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f50bc005040 tx=0x7f50bc001320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:15.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.689+0000 7f50baffd700 1 -- 172.21.15.149:0/682219435 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50bc001440 con 0x7f50b4003b90 2023-11-08T19:26:15.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.689+0000 7f50baffd700 1 -- 172.21.15.149:0/682219435 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50bc006ac0 con 0x7f50b4003b90 2023-11-08T19:26:15.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.689+0000 7f50d0c45700 1 -- 172.21.15.149:0/682219435 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50cc0ca600 con 0x7f50b4003b90 2023-11-08T19:26:15.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.689+0000 7f50baffd700 1 -- 172.21.15.149:0/682219435 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50bc006e50 con 0x7f50b4003b90 2023-11-08T19:26:15.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.689+0000 7f50d0c45700 1 -- 172.21.15.149:0/682219435 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50cc0c7bb0 con 0x7f50b4003b90 2023-11-08T19:26:15.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.690+0000 7f50d0c45700 1 -- 172.21.15.149:0/682219435 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50cc0ad400 con 0x7f50b4003b90 2023-11-08T19:26:15.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.690+0000 7f50baffd700 1 -- 172.21.15.149:0/682219435 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f50bc007040 con 0x7f50b4003b90 2023-11-08T19:26:15.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.691+0000 7f50baffd700 1 --2- 172.21.15.149:0/682219435 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f50ac06af30 0x7f50ac06d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:15.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.691+0000 7f50baffd700 1 -- 172.21.15.149:0/682219435 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f50bc08a220 con 0x7f50b4003b90 2023-11-08T19:26:15.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.691+0000 7f50c9d9b700 1 --2- 172.21.15.149:0/682219435 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f50ac06af30 0x7f50ac06d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:15.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.691+0000 7f50c9d9b700 1 --2- 172.21.15.149:0/682219435 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f50ac06af30 0x7f50ac06d3f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f50cc0ce5e0 tx=0x7f50c0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:15.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.696+0000 7f50baffd700 1 -- 172.21.15.149:0/682219435 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f50cc0ad400 con 0x7f50b4003b90 2023-11-08T19:26:15.887 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.885+0000 7f50d0c45700 1 -- 172.21.15.149:0/682219435 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f50cc0ad400 con 0x7f50b4003b90 2023-11-08T19:26:15.888 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.886+0000 7f50baffd700 1 -- 172.21.15.149:0/682219435 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+21989 (secure 0 0 0) 0x7f50cc0ad400 con 0x7f50b4003b90 2023-11-08T19:26:15.889 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:26:15.889 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":83,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:26:13.148903+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-08T19:24:29.516185+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-08T19:25:44.287064+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":71,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-08T19:25:45.623521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-11-08T19:26:09.267609+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-11-08T19:26:10.496194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:26:15.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.888+0000 7f50d0c45700 1 -- 172.21.15.149:0/682219435 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f50ac06af30 msgr2=0x7f50ac06d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:15.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.888+0000 7f50d0c45700 1 --2- 172.21.15.149:0/682219435 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f50ac06af30 0x7f50ac06d3f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f50cc0ce5e0 tx=0x7f50c0008040 comp rx=0 tx=0).stop 2023-11-08T19:26:15.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.888+0000 7f50d0c45700 1 -- 172.21.15.149:0/682219435 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50b4003b90 msgr2=0x7f50cc0c7670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:15.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.888+0000 7f50d0c45700 1 --2- 172.21.15.149:0/682219435 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50b4003b90 0x7f50cc0c7670 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f50bc005040 tx=0x7f50bc001320 comp rx=0 tx=0).stop 2023-11-08T19:26:15.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.888+0000 7f50d0c45700 1 -- 172.21.15.149:0/682219435 shutdown_connections 2023-11-08T19:26:15.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.888+0000 7f50d0c45700 1 --2- 172.21.15.149:0/682219435 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f50ac06af30 0x7f50ac06d3f0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:15.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.888+0000 7f50d0c45700 1 --2- 172.21.15.149:0/682219435 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f50cc1f4c10 0x7f50cc1f5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:15.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.888+0000 7f50d0c45700 1 --2- 172.21.15.149:0/682219435 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50b4003b90 0x7f50cc0c7670 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:15.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.888+0000 7f50d0c45700 1 --2- 172.21.15.149:0/682219435 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f50cc1f5890 0x7f50cc0c69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:15.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.888+0000 7f50d0c45700 1 -- 172.21.15.149:0/682219435 >> 172.21.15.149:0/682219435 conn(0x7f50cc099a40 msgr2=0x7f50cc0cbe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:15.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.889+0000 7f50d0c45700 1 -- 172.21.15.149:0/682219435 shutdown_connections 2023-11-08T19:26:15.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:15.889+0000 7f50d0c45700 1 -- 172.21.15.149:0/682219435 wait complete. 2023-11-08T19:26:15.903 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-08T19:26:15.904 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:26:16.025 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.022+0000 7f5a3c7d1700 1 Processor -- start 2023-11-08T19:26:16.025 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.023+0000 7f5a3c7d1700 1 -- start start 2023-11-08T19:26:16.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.023+0000 7f5a3c7d1700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5a3406c2a0 0x7f5a3406e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:16.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.023+0000 7f5a3c7d1700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f5a3406da50 0x7f5a340cdd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:16.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.024+0000 7f5a3c7d1700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a340cb220 con 0x7f5a3415a1a0 2023-11-08T19:26:16.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.024+0000 7f5a3c7d1700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a3415a580 con 0x7f5a3406da50 2023-11-08T19:26:16.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.024+0000 7f5a3c7d1700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a340725a0 con 0x7f5a3406c2a0 2023-11-08T19:26:16.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.024+0000 7f5a3a56d700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f5a3415a1a0 0x7f5a3406bb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.149:56118/0 (socket says 172.21.15.149:56118) 2023-11-08T19:26:16.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.024+0000 7f5a39d6c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5a3406c2a0 0x7f5a3406e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:16.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.024+0000 7f5a3ad6e700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f5a3406da50 0x7f5a340cdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:16.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.024+0000 7f5a3a56d700 1 -- 172.21.15.149:0/2846062234 learned_addr learned my addr 172.21.15.149:0/2846062234 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:26:16.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.024+0000 7f5a3956b700 1 -- 172.21.15.149:0/2846062234 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 491880266 0 0) 0x7f5a340cb220 con 0x7f5a3415a1a0 2023-11-08T19:26:16.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.024+0000 7f5a3956b700 1 -- 172.21.15.149:0/2846062234 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a200046c0 con 0x7f5a3415a1a0 2023-11-08T19:26:16.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.024+0000 7f5a39d6c700 1 -- 172.21.15.149:0/2846062234 >> v2:172.21.15.160:3300/0 conn(0x7f5a3406da50 msgr2=0x7f5a340cdd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:16.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.024+0000 7f5a39d6c700 1 --2- 172.21.15.149:0/2846062234 >> v2:172.21.15.160:3300/0 conn(0x7f5a3406da50 0x7f5a340cdd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:16.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.024+0000 7f5a39d6c700 1 -- 172.21.15.149:0/2846062234 >> v1:172.21.15.160:6789/0 conn(0x7f5a3415a1a0 legacy=0x7f5a3406bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:16.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.024+0000 7f5a39d6c700 1 -- 172.21.15.149:0/2846062234 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a340cb500 con 0x7f5a3406c2a0 2023-11-08T19:26:16.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.024+0000 7f5a3ad6e700 1 --2- 172.21.15.149:0/2846062234 >> v2:172.21.15.160:3300/0 conn(0x7f5a3406da50 0x7f5a340cdd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:26:16.032 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.024+0000 7f5a39d6c700 1 --2- 172.21.15.149:0/2846062234 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5a3406c2a0 0x7f5a3406e940 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5a30009840 tx=0x7f5a30009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ed10b53613b6f16 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:16.032 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.024+0000 7f5a3956b700 1 -- 172.21.15.149:0/2846062234 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a30011830 con 0x7f5a3406c2a0 2023-11-08T19:26:16.032 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.025+0000 7f5a3956b700 1 -- 172.21.15.149:0/2846062234 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a30011990 con 0x7f5a3406c2a0 2023-11-08T19:26:16.032 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.025+0000 7f5a3956b700 1 -- 172.21.15.149:0/2846062234 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a30011d20 con 0x7f5a3406c2a0 2023-11-08T19:26:16.032 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.025+0000 7f5a3c7d1700 1 -- 172.21.15.149:0/2846062234 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5a3406c2a0 msgr2=0x7f5a3406e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:16.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.025+0000 7f5a3c7d1700 1 --2- 172.21.15.149:0/2846062234 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5a3406c2a0 0x7f5a3406e940 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5a30009840 tx=0x7f5a30009b50 comp rx=0 tx=0).stop 2023-11-08T19:26:16.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.025+0000 7f5a3c7d1700 1 -- 172.21.15.149:0/2846062234 shutdown_connections 2023-11-08T19:26:16.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.025+0000 7f5a3c7d1700 1 --2- 172.21.15.149:0/2846062234 >> v2:172.21.15.160:3300/0 conn(0x7f5a3406da50 0x7f5a340cdd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:16.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.025+0000 7f5a3c7d1700 1 --2- 172.21.15.149:0/2846062234 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5a3406c2a0 0x7f5a3406e940 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:16.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.025+0000 7f5a3c7d1700 1 -- 172.21.15.149:0/2846062234 >> 172.21.15.149:0/2846062234 conn(0x7f5a34071720 msgr2=0x7f5a34071b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:16.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.025+0000 7f5a3c7d1700 1 -- 172.21.15.149:0/2846062234 shutdown_connections 2023-11-08T19:26:16.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.025+0000 7f5a3c7d1700 1 -- 172.21.15.149:0/2846062234 wait complete. 2023-11-08T19:26:16.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.026+0000 7f5a3c7d1700 1 Processor -- start 2023-11-08T19:26:16.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.026+0000 7f5a3c7d1700 1 -- start start 2023-11-08T19:26:16.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.027+0000 7f5a3c7d1700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5a3406c2a0 0x7f5a34151e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:16.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.027+0000 7f5a3c7d1700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5a3406da50 0x7f5a3414c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:16.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.027+0000 7f5a3c7d1700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a3415a1a0 0x7f5a341f3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:16.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.027+0000 7f5a3c7d1700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a341592d0 con 0x7f5a3415a1a0 2023-11-08T19:26:16.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.027+0000 7f5a3c7d1700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a341f3300 con 0x7f5a3406c2a0 2023-11-08T19:26:16.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.027+0000 7f5a3c7d1700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a34158a30 con 0x7f5a3406da50 2023-11-08T19:26:16.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.027+0000 7f5a3ad6e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a3415a1a0 0x7f5a341f3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:16.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.027+0000 7f5a3ad6e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a3415a1a0 0x7f5a341f3a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42460/0 (socket says 172.21.15.149:42460) 2023-11-08T19:26:16.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.027+0000 7f5a3a56d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5a3406c2a0 0x7f5a34151e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:16.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.027+0000 7f5a3ad6e700 1 -- 172.21.15.149:0/2665933855 learned_addr learned my addr 172.21.15.149:0/2665933855 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:16.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.027+0000 7f5a39d6c700 1 --2- 172.21.15.149:0/2665933855 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5a3406da50 0x7f5a3414c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:16.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.028+0000 7f5a3ad6e700 1 -- 172.21.15.149:0/2665933855 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5a3406da50 msgr2=0x7f5a3414c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:16.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.028+0000 7f5a3ad6e700 1 --2- 172.21.15.149:0/2665933855 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5a3406da50 0x7f5a3414c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:16.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.028+0000 7f5a3ad6e700 1 -- 172.21.15.149:0/2665933855 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5a3406c2a0 msgr2=0x7f5a34151e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:16.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.028+0000 7f5a3ad6e700 1 --2- 172.21.15.149:0/2665933855 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5a3406c2a0 0x7f5a34151e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:16.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.028+0000 7f5a3ad6e700 1 -- 172.21.15.149:0/2665933855 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a2c009a70 con 0x7f5a3415a1a0 2023-11-08T19:26:16.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.028+0000 7f5a3a56d700 1 --2- 172.21.15.149:0/2665933855 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5a3406c2a0 0x7f5a34151e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:26:16.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.028+0000 7f5a3ad6e700 1 --2- 172.21.15.149:0/2665933855 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a3415a1a0 0x7f5a341f3a80 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c00ef90 tx=0x7f5a2c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:16.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.028+0000 7f5a2affd700 1 -- 172.21.15.149:0/2665933855 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c00cc90 con 0x7f5a3415a1a0 2023-11-08T19:26:16.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.028+0000 7f5a2affd700 1 -- 172.21.15.149:0/2665933855 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a2c00f040 con 0x7f5a3415a1a0 2023-11-08T19:26:16.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.028+0000 7f5a3c7d1700 1 -- 172.21.15.149:0/2665933855 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a300094a0 con 0x7f5a3415a1a0 2023-11-08T19:26:16.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.028+0000 7f5a2affd700 1 -- 172.21.15.149:0/2665933855 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c0146c0 con 0x7f5a3415a1a0 2023-11-08T19:26:16.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.028+0000 7f5a3c7d1700 1 -- 172.21.15.149:0/2665933855 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a34158ff0 con 0x7f5a3415a1a0 2023-11-08T19:26:16.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.029+0000 7f5a3c7d1700 1 -- 172.21.15.149:0/2665933855 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a340745f0 con 0x7f5a3415a1a0 2023-11-08T19:26:16.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.029+0000 7f5a2affd700 1 -- 172.21.15.149:0/2665933855 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5a2c014820 con 0x7f5a3415a1a0 2023-11-08T19:26:16.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.030+0000 7f5a2affd700 1 --2- 172.21.15.149:0/2665933855 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5a1806af00 0x7f5a1806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:16.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.030+0000 7f5a3a56d700 1 --2- 172.21.15.149:0/2665933855 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5a1806af00 0x7f5a1806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:16.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.030+0000 7f5a2affd700 1 -- 172.21.15.149:0/2665933855 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f5a2c08a790 con 0x7f5a3415a1a0 2023-11-08T19:26:16.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.030+0000 7f5a3a56d700 1 --2- 172.21.15.149:0/2665933855 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5a1806af00 0x7f5a1806d3c0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f5a24007fd0 tx=0x7f5a24007dc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:16.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.035+0000 7f5a2affd700 1 -- 172.21.15.149:0/2665933855 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5a2c0552d0 con 0x7f5a3415a1a0 2023-11-08T19:26:16.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.222+0000 7f5a3c7d1700 1 -- 172.21.15.149:0/2665933855 --> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5a340cbac0 con 0x7f5a1806af00 2023-11-08T19:26:16.237 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.235+0000 7f5a2affd700 1 -- 172.21.15.149:0/2665933855 <== mgr.4104 v2:172.21.15.149:6832/1929837472 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+523682 (secure 0 0 0) 0x7f5a24007180 con 0x7f5a1806af00 2023-11-08T19:26:16.243 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:26:16.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.240+0000 7f5a3c7d1700 1 -- 172.21.15.149:0/2665933855 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5a1806af00 msgr2=0x7f5a1806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:16.249 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.240+0000 7f5a3c7d1700 1 --2- 172.21.15.149:0/2665933855 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5a1806af00 0x7f5a1806d3c0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f5a24007fd0 tx=0x7f5a24007dc0 comp rx=0 tx=0).stop 2023-11-08T19:26:16.249 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.240+0000 7f5a3c7d1700 1 -- 172.21.15.149:0/2665933855 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a3415a1a0 msgr2=0x7f5a341f3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:16.249 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.240+0000 7f5a3c7d1700 1 --2- 172.21.15.149:0/2665933855 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a3415a1a0 0x7f5a341f3a80 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c00ef90 tx=0x7f5a2c00c3a0 comp rx=0 tx=0).stop 2023-11-08T19:26:16.249 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.240+0000 7f5a3c7d1700 1 -- 172.21.15.149:0/2665933855 shutdown_connections 2023-11-08T19:26:16.249 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.240+0000 7f5a3c7d1700 1 --2- 172.21.15.149:0/2665933855 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5a1806af00 0x7f5a1806d3c0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:16.250 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.240+0000 7f5a3c7d1700 1 --2- 172.21.15.149:0/2665933855 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5a3406c2a0 0x7f5a34151e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:16.250 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.240+0000 7f5a3c7d1700 1 --2- 172.21.15.149:0/2665933855 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a3415a1a0 0x7f5a341f3a80 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:16.250 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.240+0000 7f5a3c7d1700 1 --2- 172.21.15.149:0/2665933855 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5a3406da50 0x7f5a3414c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:16.250 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.240+0000 7f5a3c7d1700 1 -- 172.21.15.149:0/2665933855 >> 172.21.15.149:0/2665933855 conn(0x7f5a34071720 msgr2=0x7f5a340b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:16.251 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.240+0000 7f5a3c7d1700 1 -- 172.21.15.149:0/2665933855 shutdown_connections 2023-11-08T19:26:16.251 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.240+0000 7f5a3c7d1700 1 -- 172.21.15.149:0/2665933855 wait complete. 2023-11-08T19:26:16.251 INFO:teuthology.orchestra.run.smithi149.stderr:dumped all 2023-11-08T19:26:16.255 INFO:teuthology.orchestra.run.smithi149.stdout:{"pg_ready":true,"pg_map":{"version":176,"stamp":"2023-11-08T19:26:16.028781+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590480,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":164,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":221,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225012,"kb_used_data":8852,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754749708,"statfs":{"total":773094113280,"available":772863700992,"internally_reserved":0,"allocated":9064448,"data_stored":4954891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.905889"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.132306+0000","last_change":"2023-11-08T19:26:11.132306+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.132306+0000","last_undegraded":"2023-11-08T19:26:11.132306+0000","last_fullsized":"2023-11-08T19:26:11.132306+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.130646+0000","last_change":"2023-11-08T19:26:11.130646+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.130646+0000","last_undegraded":"2023-11-08T19:26:11.130646+0000","last_fullsized":"2023-11-08T19:26:11.130646+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.134023+0000","last_change":"2023-11-08T19:26:11.134023+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.134023+0000","last_undegraded":"2023-11-08T19:26:11.134023+0000","last_fullsized":"2023-11-08T19:26:11.134023+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.158573+0000","last_change":"2023-11-08T19:26:12.159151+0000","last_active":"2023-11-08T19:26:13.158573+0000","last_peered":"2023-11-08T19:26:13.158573+0000","last_clean":"2023-11-08T19:26:13.158573+0000","last_became_active":"2023-11-08T19:26:12.158889+0000","last_became_peered":"2023-11-08T19:26:12.158889+0000","last_unstale":"2023-11-08T19:26:13.158573+0000","last_undegraded":"2023-11-08T19:26:13.158573+0000","last_fullsized":"2023-11-08T19:26:13.158573+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:40:48.988790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.157287+0000","last_change":"2023-11-08T19:26:12.159875+0000","last_active":"2023-11-08T19:26:13.157287+0000","last_peered":"2023-11-08T19:26:13.157287+0000","last_clean":"2023-11-08T19:26:13.157287+0000","last_became_active":"2023-11-08T19:26:12.159616+0000","last_became_peered":"2023-11-08T19:26:12.159616+0000","last_unstale":"2023-11-08T19:26:13.157287+0000","last_undegraded":"2023-11-08T19:26:13.157287+0000","last_fullsized":"2023-11-08T19:26:13.157287+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:31:03.813978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.131549+0000","last_change":"2023-11-08T19:26:11.131549+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.131549+0000","last_undegraded":"2023-11-08T19:26:11.131549+0000","last_fullsized":"2023-11-08T19:26:11.131549+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.158902+0000","last_change":"2023-11-08T19:26:12.163084+0000","last_active":"2023-11-08T19:26:13.158902+0000","last_peered":"2023-11-08T19:26:13.158902+0000","last_clean":"2023-11-08T19:26:13.158902+0000","last_became_active":"2023-11-08T19:26:12.162467+0000","last_became_peered":"2023-11-08T19:26:12.162467+0000","last_unstale":"2023-11-08T19:26:13.158902+0000","last_undegraded":"2023-11-08T19:26:13.158902+0000","last_fullsized":"2023-11-08T19:26:13.158902+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:15:38.428199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.130524+0000","last_change":"2023-11-08T19:26:11.130524+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.130524+0000","last_undegraded":"2023-11-08T19:26:11.130524+0000","last_fullsized":"2023-11-08T19:26:11.130524+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.132912+0000","last_change":"2023-11-08T19:26:11.132912+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.132912+0000","last_undegraded":"2023-11-08T19:26:11.132912+0000","last_fullsized":"2023-11-08T19:26:11.132912+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.132409+0000","last_change":"2023-11-08T19:26:11.132409+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.132409+0000","last_undegraded":"2023-11-08T19:26:11.132409+0000","last_fullsized":"2023-11-08T19:26:11.132409+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.157213+0000","last_change":"2023-11-08T19:26:12.171269+0000","last_active":"2023-11-08T19:26:13.157213+0000","last_peered":"2023-11-08T19:26:13.157213+0000","last_clean":"2023-11-08T19:26:13.157213+0000","last_became_active":"2023-11-08T19:26:12.171009+0000","last_became_peered":"2023-11-08T19:26:12.171009+0000","last_unstale":"2023-11-08T19:26:13.157213+0000","last_undegraded":"2023-11-08T19:26:13.157213+0000","last_fullsized":"2023-11-08T19:26:13.157213+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:19:17.065471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.132284+0000","last_change":"2023-11-08T19:26:11.132284+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.132284+0000","last_undegraded":"2023-11-08T19:26:11.132284+0000","last_fullsized":"2023-11-08T19:26:11.132284+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.131376+0000","last_change":"2023-11-08T19:26:11.131376+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.131376+0000","last_undegraded":"2023-11-08T19:26:11.131376+0000","last_fullsized":"2023-11-08T19:26:11.131376+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.157398+0000","last_change":"2023-11-08T19:26:12.171667+0000","last_active":"2023-11-08T19:26:13.157398+0000","last_peered":"2023-11-08T19:26:13.157398+0000","last_clean":"2023-11-08T19:26:13.157398+0000","last_became_active":"2023-11-08T19:26:12.169680+0000","last_became_peered":"2023-11-08T19:26:12.169680+0000","last_unstale":"2023-11-08T19:26:13.157398+0000","last_undegraded":"2023-11-08T19:26:13.157398+0000","last_fullsized":"2023-11-08T19:26:13.157398+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:04:11.614632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.158798+0000","last_change":"2023-11-08T19:26:12.168622+0000","last_active":"2023-11-08T19:26:13.158798+0000","last_peered":"2023-11-08T19:26:13.158798+0000","last_clean":"2023-11-08T19:26:13.158798+0000","last_became_active":"2023-11-08T19:26:12.168321+0000","last_became_peered":"2023-11-08T19:26:12.168321+0000","last_unstale":"2023-11-08T19:26:13.158798+0000","last_undegraded":"2023-11-08T19:26:13.158798+0000","last_fullsized":"2023-11-08T19:26:13.158798+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:45:37.194772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.132057+0000","last_change":"2023-11-08T19:26:11.132057+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.132057+0000","last_undegraded":"2023-11-08T19:26:11.132057+0000","last_fullsized":"2023-11-08T19:26:11.132057+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.130468+0000","last_change":"2023-11-08T19:26:11.130468+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.130468+0000","last_undegraded":"2023-11-08T19:26:11.130468+0000","last_fullsized":"2023-11-08T19:26:11.130468+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.f","version":"82'1","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.173319+0000","last_change":"2023-11-08T19:26:11.143492+0000","last_active":"2023-11-08T19:26:12.173319+0000","last_peered":"2023-11-08T19:26:12.173319+0000","last_clean":"2023-11-08T19:26:12.173319+0000","last_became_active":"2023-11-08T19:26:11.143296+0000","last_became_peered":"2023-11-08T19:26:11.143296+0000","last_unstale":"2023-11-08T19:26:12.173319+0000","last_undegraded":"2023-11-08T19:26:12.173319+0000","last_fullsized":"2023-11-08T19:26:12.173319+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:58:53.201963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.127738+0000","last_change":"2023-11-08T19:25:47.285071+0000","last_active":"2023-11-08T19:26:10.127738+0000","last_peered":"2023-11-08T19:26:10.127738+0000","last_clean":"2023-11-08T19:26:10.127738+0000","last_became_active":"2023-11-08T19:25:47.284788+0000","last_became_peered":"2023-11-08T19:25:47.284788+0000","last_unstale":"2023-11-08T19:26:10.127738+0000","last_undegraded":"2023-11-08T19:26:10.127738+0000","last_fullsized":"2023-11-08T19:26:10.127738+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:50:50.522780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":218,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.150652+0000","last_change":"2023-11-08T19:22:58.054283+0000","last_active":"2023-11-08T19:26:12.150652+0000","last_peered":"2023-11-08T19:26:12.150652+0000","last_clean":"2023-11-08T19:26:12.150652+0000","last_became_active":"2023-11-08T19:22:58.053337+0000","last_became_peered":"2023-11-08T19:22:58.053337+0000","last_unstale":"2023-11-08T19:26:12.150652+0000","last_undegraded":"2023-11-08T19:26:12.150652+0000","last_fullsized":"2023-11-08T19:26:12.150652+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:22:56.479654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:22:56.479654+0000","last_clean_scrub_stamp":"2023-11-08T19:22:56.479654+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:16:05.317001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.536896+0000","last_change":"2023-11-08T19:24:32.530665+0000","last_active":"2023-11-08T19:26:06.536896+0000","last_peered":"2023-11-08T19:26:06.536896+0000","last_clean":"2023-11-08T19:26:06.536896+0000","last_became_active":"2023-11-08T19:24:31.148363+0000","last_became_peered":"2023-11-08T19:24:31.148363+0000","last_unstale":"2023-11-08T19:26:06.536896+0000","last_undegraded":"2023-11-08T19:26:06.536896+0000","last_fullsized":"2023-11-08T19:26:06.536896+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:02:27.987795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075444200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.152384+0000","last_change":"2023-11-08T19:25:48.371346+0000","last_active":"2023-11-08T19:26:12.152384+0000","last_peered":"2023-11-08T19:26:12.152384+0000","last_clean":"2023-11-08T19:26:12.152384+0000","last_became_active":"2023-11-08T19:25:46.289470+0000","last_became_peered":"2023-11-08T19:25:46.289470+0000","last_unstale":"2023-11-08T19:26:12.152384+0000","last_undegraded":"2023-11-08T19:26:12.152384+0000","last_fullsized":"2023-11-08T19:26:12.152384+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:25:34.010085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000371219,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.128507+0000","last_change":"2023-11-08T19:26:10.128507+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.128507+0000","last_undegraded":"2023-11-08T19:26:10.128507+0000","last_fullsized":"2023-11-08T19:26:10.128507+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.656777+0000","last_change":"2023-11-08T19:25:47.283242+0000","last_active":"2023-11-08T19:26:06.656777+0000","last_peered":"2023-11-08T19:26:06.656777+0000","last_clean":"2023-11-08T19:26:06.656777+0000","last_became_active":"2023-11-08T19:25:47.282922+0000","last_became_peered":"2023-11-08T19:25:47.282922+0000","last_unstale":"2023-11-08T19:26:06.656777+0000","last_undegraded":"2023-11-08T19:26:06.656777+0000","last_fullsized":"2023-11-08T19:26:06.656777+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:26:23.400596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":48,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.126032+0000","last_change":"2023-11-08T19:24:32.544333+0000","last_active":"2023-11-08T19:26:10.126032+0000","last_peered":"2023-11-08T19:26:10.126032+0000","last_clean":"2023-11-08T19:26:10.126032+0000","last_became_active":"2023-11-08T19:24:31.138598+0000","last_became_peered":"2023-11-08T19:24:31.138598+0000","last_unstale":"2023-11-08T19:26:10.126032+0000","last_undegraded":"2023-11-08T19:26:10.126032+0000","last_fullsized":"2023-11-08T19:26:10.126032+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:11.860580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015114824000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.656459+0000","last_change":"2023-11-08T19:25:48.374357+0000","last_active":"2023-11-08T19:26:06.656459+0000","last_peered":"2023-11-08T19:26:06.656459+0000","last_clean":"2023-11-08T19:26:06.656459+0000","last_became_active":"2023-11-08T19:25:46.279007+0000","last_became_peered":"2023-11-08T19:25:46.279007+0000","last_unstale":"2023-11-08T19:26:06.656459+0000","last_undegraded":"2023-11-08T19:26:06.656459+0000","last_fullsized":"2023-11-08T19:26:06.656459+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:59:30.845191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036813240000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.127179+0000","last_change":"2023-11-08T19:26:10.127179+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.127179+0000","last_undegraded":"2023-11-08T19:26:10.127179+0000","last_fullsized":"2023-11-08T19:26:10.127179+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":19,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.655722+0000","last_change":"2023-11-08T19:25:47.285093+0000","last_active":"2023-11-08T19:26:06.655722+0000","last_peered":"2023-11-08T19:26:06.655722+0000","last_clean":"2023-11-08T19:26:06.655722+0000","last_became_active":"2023-11-08T19:25:47.284796+0000","last_became_peered":"2023-11-08T19:25:47.284796+0000","last_unstale":"2023-11-08T19:26:06.655722+0000","last_undegraded":"2023-11-08T19:26:06.655722+0000","last_fullsized":"2023-11-08T19:26:06.655722+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:46:36.504650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":48,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.126151+0000","last_change":"2023-11-08T19:24:32.544285+0000","last_active":"2023-11-08T19:26:10.126151+0000","last_peered":"2023-11-08T19:26:10.126151+0000","last_clean":"2023-11-08T19:26:10.126151+0000","last_became_active":"2023-11-08T19:24:31.142028+0000","last_became_peered":"2023-11-08T19:24:31.142028+0000","last_unstale":"2023-11-08T19:26:10.126151+0000","last_undegraded":"2023-11-08T19:26:10.126151+0000","last_fullsized":"2023-11-08T19:26:10.126151+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:01:24.198196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067537399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.125396+0000","last_change":"2023-11-08T19:25:48.372192+0000","last_active":"2023-11-08T19:26:10.125396+0000","last_peered":"2023-11-08T19:26:10.125396+0000","last_clean":"2023-11-08T19:26:10.125396+0000","last_became_active":"2023-11-08T19:25:46.288739+0000","last_became_peered":"2023-11-08T19:25:46.288739+0000","last_unstale":"2023-11-08T19:26:10.125396+0000","last_undegraded":"2023-11-08T19:26:10.125396+0000","last_fullsized":"2023-11-08T19:26:10.125396+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:45:04.839053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015057530000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.126826+0000","last_change":"2023-11-08T19:26:10.126826+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.126826+0000","last_undegraded":"2023-11-08T19:26:10.126826+0000","last_fullsized":"2023-11-08T19:26:10.126826+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.656592+0000","last_change":"2023-11-08T19:25:47.287920+0000","last_active":"2023-11-08T19:26:06.656592+0000","last_peered":"2023-11-08T19:26:06.656592+0000","last_clean":"2023-11-08T19:26:06.656592+0000","last_became_active":"2023-11-08T19:25:47.287494+0000","last_became_peered":"2023-11-08T19:25:47.287494+0000","last_unstale":"2023-11-08T19:26:06.656592+0000","last_undegraded":"2023-11-08T19:26:06.656592+0000","last_fullsized":"2023-11-08T19:26:06.656592+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:42:18.942062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":49,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.655728+0000","last_change":"2023-11-08T19:24:32.142836+0000","last_active":"2023-11-08T19:26:06.655728+0000","last_peered":"2023-11-08T19:26:06.655728+0000","last_clean":"2023-11-08T19:26:06.655728+0000","last_became_active":"2023-11-08T19:24:31.141367+0000","last_became_peered":"2023-11-08T19:24:31.141367+0000","last_unstale":"2023-11-08T19:26:06.655728+0000","last_undegraded":"2023-11-08T19:26:06.655728+0000","last_fullsized":"2023-11-08T19:26:06.655728+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:39.214888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001335136,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.126066+0000","last_change":"2023-11-08T19:25:48.372718+0000","last_active":"2023-11-08T19:26:10.126066+0000","last_peered":"2023-11-08T19:26:10.126066+0000","last_clean":"2023-11-08T19:26:10.126066+0000","last_became_active":"2023-11-08T19:25:46.289283+0000","last_became_peered":"2023-11-08T19:25:46.289283+0000","last_unstale":"2023-11-08T19:26:10.126066+0000","last_undegraded":"2023-11-08T19:26:10.126066+0000","last_fullsized":"2023-11-08T19:26:10.126066+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:15:51.881891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001274049,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.127425+0000","last_change":"2023-11-08T19:26:10.127425+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.127425+0000","last_undegraded":"2023-11-08T19:26:10.127425+0000","last_fullsized":"2023-11-08T19:26:10.127425+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":19,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.655831+0000","last_change":"2023-11-08T19:25:47.285353+0000","last_active":"2023-11-08T19:26:06.655831+0000","last_peered":"2023-11-08T19:26:06.655831+0000","last_clean":"2023-11-08T19:26:06.655831+0000","last_became_active":"2023-11-08T19:25:47.285075+0000","last_became_peered":"2023-11-08T19:25:47.285075+0000","last_unstale":"2023-11-08T19:26:06.655831+0000","last_undegraded":"2023-11-08T19:26:06.655831+0000","last_fullsized":"2023-11-08T19:26:06.655831+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:20:50.791463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":55,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.124563+0000","last_change":"2023-11-08T19:24:32.139885+0000","last_active":"2023-11-08T19:26:10.124563+0000","last_peered":"2023-11-08T19:26:10.124563+0000","last_clean":"2023-11-08T19:26:10.124563+0000","last_became_active":"2023-11-08T19:24:31.145329+0000","last_became_peered":"2023-11-08T19:24:31.145329+0000","last_unstale":"2023-11-08T19:26:10.124563+0000","last_undegraded":"2023-11-08T19:26:10.124563+0000","last_fullsized":"2023-11-08T19:26:10.124563+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:25:18.356784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049012999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.656819+0000","last_change":"2023-11-08T19:25:48.373848+0000","last_active":"2023-11-08T19:26:06.656819+0000","last_peered":"2023-11-08T19:26:06.656819+0000","last_clean":"2023-11-08T19:26:06.656819+0000","last_became_active":"2023-11-08T19:25:46.282174+0000","last_became_peered":"2023-11-08T19:25:46.282174+0000","last_unstale":"2023-11-08T19:26:06.656819+0000","last_undegraded":"2023-11-08T19:26:06.656819+0000","last_fullsized":"2023-11-08T19:26:06.656819+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:00:06.938052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000727792,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":3,"reported_epoch":81,"state":"creating+activating","last_fresh":"2023-11-08T19:26:11.130325+0000","last_change":"2023-11-08T19:26:11.130325+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.130325+0000","last_undegraded":"2023-11-08T19:26:11.130325+0000","last_fullsized":"2023-11-08T19:26:11.130325+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:26:26.007199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":["4","2"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.124963+0000","last_change":"2023-11-08T19:25:47.287677+0000","last_active":"2023-11-08T19:26:10.124963+0000","last_peered":"2023-11-08T19:26:10.124963+0000","last_clean":"2023-11-08T19:26:10.124963+0000","last_became_active":"2023-11-08T19:25:47.287419+0000","last_became_peered":"2023-11-08T19:25:47.287419+0000","last_unstale":"2023-11-08T19:26:10.124963+0000","last_undegraded":"2023-11-08T19:26:10.124963+0000","last_fullsized":"2023-11-08T19:26:10.124963+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:22:08.770702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":53,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.373729+0000","last_change":"2023-11-08T19:24:32.140880+0000","last_active":"2023-11-08T19:26:06.373729+0000","last_peered":"2023-11-08T19:26:06.373729+0000","last_clean":"2023-11-08T19:26:06.373729+0000","last_became_active":"2023-11-08T19:24:31.146063+0000","last_became_peered":"2023-11-08T19:24:31.146063+0000","last_unstale":"2023-11-08T19:26:06.373729+0000","last_undegraded":"2023-11-08T19:26:06.373729+0000","last_fullsized":"2023-11-08T19:26:06.373729+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:54:08.985813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089896300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.536953+0000","last_change":"2023-11-08T19:25:48.374690+0000","last_active":"2023-11-08T19:26:06.536953+0000","last_peered":"2023-11-08T19:26:06.536953+0000","last_clean":"2023-11-08T19:26:06.536953+0000","last_became_active":"2023-11-08T19:25:46.281986+0000","last_became_peered":"2023-11-08T19:25:46.281986+0000","last_unstale":"2023-11-08T19:26:06.536953+0000","last_undegraded":"2023-11-08T19:26:06.536953+0000","last_fullsized":"2023-11-08T19:26:06.536953+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:21:00.981136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003067771,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.122829+0000","last_change":"2023-11-08T19:26:10.122829+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.122829+0000","last_undegraded":"2023-11-08T19:26:10.122829+0000","last_fullsized":"2023-11-08T19:26:10.122829+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.152860+0000","last_change":"2023-11-08T19:25:47.287986+0000","last_active":"2023-11-08T19:26:12.152860+0000","last_peered":"2023-11-08T19:26:12.152860+0000","last_clean":"2023-11-08T19:26:12.152860+0000","last_became_active":"2023-11-08T19:25:47.287560+0000","last_became_peered":"2023-11-08T19:25:47.287560+0000","last_unstale":"2023-11-08T19:26:12.152860+0000","last_undegraded":"2023-11-08T19:26:12.152860+0000","last_fullsized":"2023-11-08T19:26:12.152860+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:35:31.433056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.537019+0000","last_change":"2023-11-08T19:24:32.530620+0000","last_active":"2023-11-08T19:26:06.537019+0000","last_peered":"2023-11-08T19:26:06.537019+0000","last_clean":"2023-11-08T19:26:06.537019+0000","last_became_active":"2023-11-08T19:24:31.144223+0000","last_became_peered":"2023-11-08T19:24:31.144223+0000","last_unstale":"2023-11-08T19:26:06.537019+0000","last_undegraded":"2023-11-08T19:26:06.537019+0000","last_fullsized":"2023-11-08T19:26:06.537019+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:01:25.647952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071879799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.373882+0000","last_change":"2023-11-08T19:25:48.285326+0000","last_active":"2023-11-08T19:26:06.373882+0000","last_peered":"2023-11-08T19:26:06.373882+0000","last_clean":"2023-11-08T19:26:06.373882+0000","last_became_active":"2023-11-08T19:25:46.278686+0000","last_became_peered":"2023-11-08T19:25:46.278686+0000","last_unstale":"2023-11-08T19:26:06.373882+0000","last_undegraded":"2023-11-08T19:26:06.373882+0000","last_fullsized":"2023-11-08T19:26:06.373882+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:25:34.010085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078409499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.159113+0000","last_change":"2023-11-08T19:26:12.163265+0000","last_active":"2023-11-08T19:26:13.159113+0000","last_peered":"2023-11-08T19:26:13.159113+0000","last_clean":"2023-11-08T19:26:13.159113+0000","last_became_active":"2023-11-08T19:26:12.162822+0000","last_became_peered":"2023-11-08T19:26:12.162822+0000","last_unstale":"2023-11-08T19:26:13.159113+0000","last_undegraded":"2023-11-08T19:26:13.159113+0000","last_fullsized":"2023-11-08T19:26:13.159113+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:45:22.870353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.129895+0000","last_change":"2023-11-08T19:26:10.129895+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.129895+0000","last_undegraded":"2023-11-08T19:26:10.129895+0000","last_fullsized":"2023-11-08T19:26:10.129895+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":20,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.373428+0000","last_change":"2023-11-08T19:25:47.289726+0000","last_active":"2023-11-08T19:26:06.373428+0000","last_peered":"2023-11-08T19:26:06.373428+0000","last_clean":"2023-11-08T19:26:06.373428+0000","last_became_active":"2023-11-08T19:25:47.289362+0000","last_became_peered":"2023-11-08T19:25:47.289362+0000","last_unstale":"2023-11-08T19:26:06.373428+0000","last_undegraded":"2023-11-08T19:26:06.373428+0000","last_fullsized":"2023-11-08T19:26:06.373428+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:38:55.785104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.152547+0000","last_change":"2023-11-08T19:24:32.147025+0000","last_active":"2023-11-08T19:26:12.152547+0000","last_peered":"2023-11-08T19:26:12.152547+0000","last_clean":"2023-11-08T19:26:12.152547+0000","last_became_active":"2023-11-08T19:24:31.147082+0000","last_became_peered":"2023-11-08T19:24:31.147082+0000","last_unstale":"2023-11-08T19:26:12.152547+0000","last_undegraded":"2023-11-08T19:26:12.152547+0000","last_fullsized":"2023-11-08T19:26:12.152547+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:02:27.987795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043701599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.537040+0000","last_change":"2023-11-08T19:25:48.374739+0000","last_active":"2023-11-08T19:26:06.537040+0000","last_peered":"2023-11-08T19:26:06.537040+0000","last_clean":"2023-11-08T19:26:06.537040+0000","last_became_active":"2023-11-08T19:25:46.282071+0000","last_became_peered":"2023-11-08T19:25:46.282071+0000","last_unstale":"2023-11-08T19:26:06.537040+0000","last_undegraded":"2023-11-08T19:26:06.537040+0000","last_fullsized":"2023-11-08T19:26:06.537040+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:42:47.677504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023654909999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.128081+0000","last_change":"2023-11-08T19:26:10.128081+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.128081+0000","last_undegraded":"2023-11-08T19:26:10.128081+0000","last_fullsized":"2023-11-08T19:26:10.128081+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":48,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.126115+0000","last_change":"2023-11-08T19:24:32.544063+0000","last_active":"2023-11-08T19:26:10.126115+0000","last_peered":"2023-11-08T19:26:10.126115+0000","last_clean":"2023-11-08T19:26:10.126115+0000","last_became_active":"2023-11-08T19:24:31.144795+0000","last_became_peered":"2023-11-08T19:24:31.144795+0000","last_unstale":"2023-11-08T19:26:10.126115+0000","last_undegraded":"2023-11-08T19:26:10.126115+0000","last_fullsized":"2023-11-08T19:26:10.126115+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:12:42.248307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01495431,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.372839+0000","last_change":"2023-11-08T19:25:48.283673+0000","last_active":"2023-11-08T19:26:06.372839+0000","last_peered":"2023-11-08T19:26:06.372839+0000","last_clean":"2023-11-08T19:26:06.372839+0000","last_became_active":"2023-11-08T19:25:46.285766+0000","last_became_peered":"2023-11-08T19:25:46.285766+0000","last_unstale":"2023-11-08T19:26:06.372839+0000","last_undegraded":"2023-11-08T19:26:06.372839+0000","last_fullsized":"2023-11-08T19:26:06.372839+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:46:35.498766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001756748,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.150819+0000","last_change":"2023-11-08T19:25:47.288301+0000","last_active":"2023-11-08T19:26:12.150819+0000","last_peered":"2023-11-08T19:26:12.150819+0000","last_clean":"2023-11-08T19:26:12.150819+0000","last_became_active":"2023-11-08T19:25:47.288027+0000","last_became_peered":"2023-11-08T19:25:47.288027+0000","last_unstale":"2023-11-08T19:26:12.150819+0000","last_undegraded":"2023-11-08T19:26:12.150819+0000","last_fullsized":"2023-11-08T19:26:12.150819+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:23:13.428596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.129880+0000","last_change":"2023-11-08T19:26:11.129880+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.129880+0000","last_undegraded":"2023-11-08T19:26:11.129880+0000","last_fullsized":"2023-11-08T19:26:11.129880+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.123109+0000","last_change":"2023-11-08T19:26:10.123109+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.123109+0000","last_undegraded":"2023-11-08T19:26:10.123109+0000","last_fullsized":"2023-11-08T19:26:10.123109+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":49,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.125528+0000","last_change":"2023-11-08T19:24:32.263810+0000","last_active":"2023-11-08T19:26:10.125528+0000","last_peered":"2023-11-08T19:26:10.125528+0000","last_clean":"2023-11-08T19:26:10.125528+0000","last_became_active":"2023-11-08T19:24:31.138814+0000","last_became_peered":"2023-11-08T19:24:31.138814+0000","last_unstale":"2023-11-08T19:26:10.125528+0000","last_undegraded":"2023-11-08T19:26:10.125528+0000","last_fullsized":"2023-11-08T19:26:10.125528+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:21:55.985548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048136000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.124329+0000","last_change":"2023-11-08T19:25:48.283572+0000","last_active":"2023-11-08T19:26:10.124329+0000","last_peered":"2023-11-08T19:26:10.124329+0000","last_clean":"2023-11-08T19:26:10.124329+0000","last_became_active":"2023-11-08T19:25:46.271936+0000","last_became_peered":"2023-11-08T19:25:46.271936+0000","last_unstale":"2023-11-08T19:26:10.124329+0000","last_undegraded":"2023-11-08T19:26:10.124329+0000","last_fullsized":"2023-11-08T19:26:10.124329+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:46:11.541748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00186835,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":20,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.372680+0000","last_change":"2023-11-08T19:25:47.282856+0000","last_active":"2023-11-08T19:26:06.372680+0000","last_peered":"2023-11-08T19:26:06.372680+0000","last_clean":"2023-11-08T19:26:06.372680+0000","last_became_active":"2023-11-08T19:25:47.282594+0000","last_became_peered":"2023-11-08T19:25:47.282594+0000","last_unstale":"2023-11-08T19:26:06.372680+0000","last_undegraded":"2023-11-08T19:26:06.372680+0000","last_fullsized":"2023-11-08T19:26:06.372680+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:14:12.111756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":3,"reported_epoch":81,"state":"creating+activating","last_fresh":"2023-11-08T19:26:11.131733+0000","last_change":"2023-11-08T19:26:11.131733+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.131733+0000","last_undegraded":"2023-11-08T19:26:11.131733+0000","last_fullsized":"2023-11-08T19:26:11.131733+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:23:55.641598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.656539+0000","last_change":"2023-11-08T19:24:32.333096+0000","last_active":"2023-11-08T19:26:06.656539+0000","last_peered":"2023-11-08T19:26:06.656539+0000","last_clean":"2023-11-08T19:26:06.656539+0000","last_became_active":"2023-11-08T19:24:31.142985+0000","last_became_peered":"2023-11-08T19:24:31.142985+0000","last_unstale":"2023-11-08T19:26:06.656539+0000","last_undegraded":"2023-11-08T19:26:06.656539+0000","last_fullsized":"2023-11-08T19:26:06.656539+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:36:33.274496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000386048,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.536827+0000","last_change":"2023-11-08T19:25:48.372963+0000","last_active":"2023-11-08T19:26:06.536827+0000","last_peered":"2023-11-08T19:26:06.536827+0000","last_clean":"2023-11-08T19:26:06.536827+0000","last_became_active":"2023-11-08T19:25:46.283263+0000","last_became_peered":"2023-11-08T19:25:46.283263+0000","last_unstale":"2023-11-08T19:26:06.536827+0000","last_undegraded":"2023-11-08T19:26:06.536827+0000","last_fullsized":"2023-11-08T19:26:06.536827+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:25:34.010085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019848779999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":19,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.655803+0000","last_change":"2023-11-08T19:25:47.284816+0000","last_active":"2023-11-08T19:26:06.655803+0000","last_peered":"2023-11-08T19:26:06.655803+0000","last_clean":"2023-11-08T19:26:06.655803+0000","last_became_active":"2023-11-08T19:25:47.284522+0000","last_became_peered":"2023-11-08T19:25:47.284522+0000","last_unstale":"2023-11-08T19:26:06.655803+0000","last_undegraded":"2023-11-08T19:26:06.655803+0000","last_fullsized":"2023-11-08T19:26:06.655803+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:39:28.223686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.129454+0000","last_change":"2023-11-08T19:26:10.129454+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.129454+0000","last_undegraded":"2023-11-08T19:26:10.129454+0000","last_fullsized":"2023-11-08T19:26:10.129454+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.536570+0000","last_change":"2023-11-08T19:24:32.530333+0000","last_active":"2023-11-08T19:26:06.536570+0000","last_peered":"2023-11-08T19:26:06.536570+0000","last_clean":"2023-11-08T19:26:06.536570+0000","last_became_active":"2023-11-08T19:24:31.144838+0000","last_became_peered":"2023-11-08T19:24:31.144838+0000","last_unstale":"2023-11-08T19:26:06.536570+0000","last_undegraded":"2023-11-08T19:26:06.536570+0000","last_fullsized":"2023-11-08T19:26:06.536570+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:39:48.473183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081588799999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.124486+0000","last_change":"2023-11-08T19:25:48.284699+0000","last_active":"2023-11-08T19:26:10.124486+0000","last_peered":"2023-11-08T19:26:10.124486+0000","last_clean":"2023-11-08T19:26:10.124486+0000","last_became_active":"2023-11-08T19:25:46.285588+0000","last_became_peered":"2023-11-08T19:25:46.285588+0000","last_unstale":"2023-11-08T19:26:10.124486+0000","last_undegraded":"2023-11-08T19:26:10.124486+0000","last_fullsized":"2023-11-08T19:26:10.124486+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:43:02.001903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023282350000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.536701+0000","last_change":"2023-11-08T19:25:47.283526+0000","last_active":"2023-11-08T19:26:06.536701+0000","last_peered":"2023-11-08T19:26:06.536701+0000","last_clean":"2023-11-08T19:26:06.536701+0000","last_became_active":"2023-11-08T19:25:47.283266+0000","last_became_peered":"2023-11-08T19:25:47.283266+0000","last_unstale":"2023-11-08T19:26:06.536701+0000","last_undegraded":"2023-11-08T19:26:06.536701+0000","last_fullsized":"2023-11-08T19:26:06.536701+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:35:31.433056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.127556+0000","last_change":"2023-11-08T19:26:10.127556+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.127556+0000","last_undegraded":"2023-11-08T19:26:10.127556+0000","last_fullsized":"2023-11-08T19:26:10.127556+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.657341+0000","last_change":"2023-11-08T19:24:32.333430+0000","last_active":"2023-11-08T19:26:06.657341+0000","last_peered":"2023-11-08T19:26:06.657341+0000","last_clean":"2023-11-08T19:26:06.657341+0000","last_became_active":"2023-11-08T19:24:31.141710+0000","last_became_peered":"2023-11-08T19:24:31.141710+0000","last_unstale":"2023-11-08T19:26:06.657341+0000","last_undegraded":"2023-11-08T19:26:06.657341+0000","last_fullsized":"2023-11-08T19:26:06.657341+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:32:51.214551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000430438,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.373255+0000","last_change":"2023-11-08T19:25:48.283855+0000","last_active":"2023-11-08T19:26:06.373255+0000","last_peered":"2023-11-08T19:26:06.373255+0000","last_clean":"2023-11-08T19:26:06.373255+0000","last_became_active":"2023-11-08T19:25:46.273336+0000","last_became_peered":"2023-11-08T19:25:46.273336+0000","last_unstale":"2023-11-08T19:26:06.373255+0000","last_undegraded":"2023-11-08T19:26:06.373255+0000","last_fullsized":"2023-11-08T19:26:06.373255+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:33:35.492889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092577200000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":20,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.373300+0000","last_change":"2023-11-08T19:25:47.282840+0000","last_active":"2023-11-08T19:26:06.373300+0000","last_peered":"2023-11-08T19:26:06.373300+0000","last_clean":"2023-11-08T19:26:06.373300+0000","last_became_active":"2023-11-08T19:25:47.282600+0000","last_became_peered":"2023-11-08T19:25:47.282600+0000","last_unstale":"2023-11-08T19:26:06.373300+0000","last_undegraded":"2023-11-08T19:26:06.373300+0000","last_fullsized":"2023-11-08T19:26:06.373300+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:53:37.482245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.131449+0000","last_change":"2023-11-08T19:26:11.131449+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.131449+0000","last_undegraded":"2023-11-08T19:26:11.131449+0000","last_fullsized":"2023-11-08T19:26:11.131449+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.127954+0000","last_change":"2023-11-08T19:26:10.127954+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.127954+0000","last_undegraded":"2023-11-08T19:26:10.127954+0000","last_fullsized":"2023-11-08T19:26:10.127954+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.124849+0000","last_change":"2023-11-08T19:25:47.285890+0000","last_active":"2023-11-08T19:26:10.124849+0000","last_peered":"2023-11-08T19:26:10.124849+0000","last_clean":"2023-11-08T19:26:10.124849+0000","last_became_active":"2023-11-08T19:25:47.285641+0000","last_became_peered":"2023-11-08T19:25:47.285641+0000","last_unstale":"2023-11-08T19:26:10.124849+0000","last_undegraded":"2023-11-08T19:26:10.124849+0000","last_fullsized":"2023-11-08T19:26:10.124849+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:27:18.335142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.536846+0000","last_change":"2023-11-08T19:24:32.530895+0000","last_active":"2023-11-08T19:26:06.536846+0000","last_peered":"2023-11-08T19:26:06.536846+0000","last_clean":"2023-11-08T19:26:06.536846+0000","last_became_active":"2023-11-08T19:24:31.146715+0000","last_became_peered":"2023-11-08T19:24:31.146715+0000","last_unstale":"2023-11-08T19:26:06.536846+0000","last_undegraded":"2023-11-08T19:26:06.536846+0000","last_fullsized":"2023-11-08T19:26:06.536846+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:39.214888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081671599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.373444+0000","last_change":"2023-11-08T19:25:48.284137+0000","last_active":"2023-11-08T19:26:06.373444+0000","last_peered":"2023-11-08T19:26:06.373444+0000","last_clean":"2023-11-08T19:26:06.373444+0000","last_became_active":"2023-11-08T19:25:46.285960+0000","last_became_peered":"2023-11-08T19:25:46.285960+0000","last_unstale":"2023-11-08T19:26:06.373444+0000","last_undegraded":"2023-11-08T19:26:06.373444+0000","last_fullsized":"2023-11-08T19:26:06.373444+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:26:01.141206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091649099999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.130517+0000","last_change":"2023-11-08T19:26:11.130517+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.130517+0000","last_undegraded":"2023-11-08T19:26:11.130517+0000","last_fullsized":"2023-11-08T19:26:11.130517+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.128682+0000","last_change":"2023-11-08T19:26:10.128682+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.128682+0000","last_undegraded":"2023-11-08T19:26:10.128682+0000","last_fullsized":"2023-11-08T19:26:10.128682+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.125287+0000","last_change":"2023-11-08T19:25:47.283642+0000","last_active":"2023-11-08T19:26:10.125287+0000","last_peered":"2023-11-08T19:26:10.125287+0000","last_clean":"2023-11-08T19:26:10.125287+0000","last_became_active":"2023-11-08T19:25:47.283360+0000","last_became_peered":"2023-11-08T19:25:47.283360+0000","last_unstale":"2023-11-08T19:26:10.125287+0000","last_undegraded":"2023-11-08T19:26:10.125287+0000","last_fullsized":"2023-11-08T19:26:10.125287+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:02:27.950152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":53,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.373531+0000","last_change":"2023-11-08T19:24:32.140167+0000","last_active":"2023-11-08T19:26:06.373531+0000","last_peered":"2023-11-08T19:26:06.373531+0000","last_clean":"2023-11-08T19:26:06.373531+0000","last_became_active":"2023-11-08T19:24:31.147181+0000","last_became_peered":"2023-11-08T19:24:31.147181+0000","last_unstale":"2023-11-08T19:26:06.373531+0000","last_undegraded":"2023-11-08T19:26:06.373531+0000","last_fullsized":"2023-11-08T19:26:06.373531+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:26.080042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057135200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.126009+0000","last_change":"2023-11-08T19:25:48.277705+0000","last_active":"2023-11-08T19:26:10.126009+0000","last_peered":"2023-11-08T19:26:10.126009+0000","last_clean":"2023-11-08T19:26:10.126009+0000","last_became_active":"2023-11-08T19:25:46.288848+0000","last_became_peered":"2023-11-08T19:25:46.288848+0000","last_unstale":"2023-11-08T19:26:10.126009+0000","last_undegraded":"2023-11-08T19:26:10.126009+0000","last_fullsized":"2023-11-08T19:26:10.126009+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:12:24.483185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097653099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.124238+0000","last_change":"2023-11-08T19:26:10.124238+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.124238+0000","last_undegraded":"2023-11-08T19:26:10.124238+0000","last_fullsized":"2023-11-08T19:26:10.124238+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.152208+0000","last_change":"2023-11-08T19:25:47.289456+0000","last_active":"2023-11-08T19:26:12.152208+0000","last_peered":"2023-11-08T19:26:12.152208+0000","last_clean":"2023-11-08T19:26:12.152208+0000","last_became_active":"2023-11-08T19:25:47.289177+0000","last_became_peered":"2023-11-08T19:25:47.289177+0000","last_unstale":"2023-11-08T19:26:12.152208+0000","last_undegraded":"2023-11-08T19:26:12.152208+0000","last_fullsized":"2023-11-08T19:26:12.152208+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:07:11.838364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":53,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.373110+0000","last_change":"2023-11-08T19:24:32.141188+0000","last_active":"2023-11-08T19:26:06.373110+0000","last_peered":"2023-11-08T19:26:06.373110+0000","last_clean":"2023-11-08T19:26:06.373110+0000","last_became_active":"2023-11-08T19:24:31.148857+0000","last_became_peered":"2023-11-08T19:24:31.148857+0000","last_unstale":"2023-11-08T19:26:06.373110+0000","last_undegraded":"2023-11-08T19:26:06.373110+0000","last_fullsized":"2023-11-08T19:26:06.373110+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:45:34.425432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065078599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.126285+0000","last_change":"2023-11-08T19:25:48.277423+0000","last_active":"2023-11-08T19:26:10.126285+0000","last_peered":"2023-11-08T19:26:10.126285+0000","last_clean":"2023-11-08T19:26:10.126285+0000","last_became_active":"2023-11-08T19:25:46.286211+0000","last_became_peered":"2023-11-08T19:25:46.286211+0000","last_unstale":"2023-11-08T19:26:10.126285+0000","last_undegraded":"2023-11-08T19:26:10.126285+0000","last_fullsized":"2023-11-08T19:26:10.126285+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:44:05.347800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073775700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-08T19:26:11.139671+0000","last_change":"2023-11-08T19:26:11.139671+0000","last_active":"2023-11-08T19:26:11.139671+0000","last_peered":"2023-11-08T19:26:11.139671+0000","last_clean":"2023-11-08T19:26:11.139671+0000","last_became_active":"2023-11-08T19:26:11.139289+0000","last_became_peered":"2023-11-08T19:26:11.139289+0000","last_unstale":"2023-11-08T19:26:11.139671+0000","last_undegraded":"2023-11-08T19:26:11.139671+0000","last_fullsized":"2023-11-08T19:26:11.139671+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:02:51.810261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.150500+0000","last_change":"2023-11-08T19:25:47.286020+0000","last_active":"2023-11-08T19:26:12.150500+0000","last_peered":"2023-11-08T19:26:12.150500+0000","last_clean":"2023-11-08T19:26:12.150500+0000","last_became_active":"2023-11-08T19:25:47.285728+0000","last_became_peered":"2023-11-08T19:25:47.285728+0000","last_unstale":"2023-11-08T19:26:12.150500+0000","last_undegraded":"2023-11-08T19:26:12.150500+0000","last_fullsized":"2023-11-08T19:26:12.150500+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:26:02.147090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":53,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.372699+0000","last_change":"2023-11-08T19:24:32.140832+0000","last_active":"2023-11-08T19:26:06.372699+0000","last_peered":"2023-11-08T19:26:06.372699+0000","last_clean":"2023-11-08T19:26:06.372699+0000","last_became_active":"2023-11-08T19:24:31.146557+0000","last_became_peered":"2023-11-08T19:24:31.146557+0000","last_unstale":"2023-11-08T19:26:06.372699+0000","last_undegraded":"2023-11-08T19:26:06.372699+0000","last_fullsized":"2023-11-08T19:26:06.372699+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:40:04.258107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099450100000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.536509+0000","last_change":"2023-11-08T19:25:48.372913+0000","last_active":"2023-11-08T19:26:06.536509+0000","last_peered":"2023-11-08T19:26:06.536509+0000","last_clean":"2023-11-08T19:26:06.536509+0000","last_became_active":"2023-11-08T19:25:46.281273+0000","last_became_peered":"2023-11-08T19:25:46.281273+0000","last_unstale":"2023-11-08T19:26:06.536509+0000","last_undegraded":"2023-11-08T19:26:06.536509+0000","last_fullsized":"2023-11-08T19:26:06.536509+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:07:10.832480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020904819999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.158343+0000","last_change":"2023-11-08T19:26:12.160942+0000","last_active":"2023-11-08T19:26:13.158343+0000","last_peered":"2023-11-08T19:26:13.158343+0000","last_clean":"2023-11-08T19:26:13.158343+0000","last_became_active":"2023-11-08T19:26:12.160665+0000","last_became_peered":"2023-11-08T19:26:12.160665+0000","last_unstale":"2023-11-08T19:26:13.158343+0000","last_undegraded":"2023-11-08T19:26:13.158343+0000","last_fullsized":"2023-11-08T19:26:13.158343+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:32:26.592331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.130327+0000","last_change":"2023-11-08T19:26:10.130327+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.130327+0000","last_undegraded":"2023-11-08T19:26:10.130327+0000","last_fullsized":"2023-11-08T19:26:10.130327+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.125554+0000","last_change":"2023-11-08T19:25:47.288256+0000","last_active":"2023-11-08T19:26:10.125554+0000","last_peered":"2023-11-08T19:26:10.125554+0000","last_clean":"2023-11-08T19:26:10.125554+0000","last_became_active":"2023-11-08T19:25:47.287905+0000","last_became_peered":"2023-11-08T19:25:47.287905+0000","last_unstale":"2023-11-08T19:26:10.125554+0000","last_undegraded":"2023-11-08T19:26:10.125554+0000","last_fullsized":"2023-11-08T19:26:10.125554+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:50:12.309248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.536919+0000","last_change":"2023-11-08T19:24:32.530378+0000","last_active":"2023-11-08T19:26:06.536919+0000","last_peered":"2023-11-08T19:26:06.536919+0000","last_clean":"2023-11-08T19:26:06.536919+0000","last_became_active":"2023-11-08T19:24:31.144341+0000","last_became_peered":"2023-11-08T19:24:31.144341+0000","last_unstale":"2023-11-08T19:26:06.536919+0000","last_undegraded":"2023-11-08T19:26:06.536919+0000","last_fullsized":"2023-11-08T19:26:06.536919+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:30:21.946303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058308299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.125107+0000","last_change":"2023-11-08T19:25:48.277150+0000","last_active":"2023-11-08T19:26:10.125107+0000","last_peered":"2023-11-08T19:26:10.125107+0000","last_clean":"2023-11-08T19:26:10.125107+0000","last_became_active":"2023-11-08T19:25:46.286933+0000","last_became_peered":"2023-11-08T19:25:46.286933+0000","last_unstale":"2023-11-08T19:26:10.125107+0000","last_undegraded":"2023-11-08T19:26:10.125107+0000","last_fullsized":"2023-11-08T19:26:10.125107+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:38:38.890354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080507500000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.131349+0000","last_change":"2023-11-08T19:26:11.131349+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.131349+0000","last_undegraded":"2023-11-08T19:26:11.131349+0000","last_fullsized":"2023-11-08T19:26:11.131349+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.123041+0000","last_change":"2023-11-08T19:26:10.123041+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.123041+0000","last_undegraded":"2023-11-08T19:26:10.123041+0000","last_fullsized":"2023-11-08T19:26:10.123041+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.125333+0000","last_change":"2023-11-08T19:25:47.282986+0000","last_active":"2023-11-08T19:26:10.125333+0000","last_peered":"2023-11-08T19:26:10.125333+0000","last_clean":"2023-11-08T19:26:10.125333+0000","last_became_active":"2023-11-08T19:25:47.282705+0000","last_became_peered":"2023-11-08T19:25:47.282705+0000","last_unstale":"2023-11-08T19:26:10.125333+0000","last_undegraded":"2023-11-08T19:26:10.125333+0000","last_fullsized":"2023-11-08T19:26:10.125333+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:34:17.838942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":48,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.125645+0000","last_change":"2023-11-08T19:24:32.544108+0000","last_active":"2023-11-08T19:26:10.125645+0000","last_peered":"2023-11-08T19:26:10.125645+0000","last_clean":"2023-11-08T19:26:10.125645+0000","last_became_active":"2023-11-08T19:24:31.143812+0000","last_became_peered":"2023-11-08T19:24:31.143812+0000","last_unstale":"2023-11-08T19:26:10.125645+0000","last_undegraded":"2023-11-08T19:26:10.125645+0000","last_fullsized":"2023-11-08T19:26:10.125645+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:27:59.135977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014956126,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.124568+0000","last_change":"2023-11-08T19:25:48.284435+0000","last_active":"2023-11-08T19:26:10.124568+0000","last_peered":"2023-11-08T19:26:10.124568+0000","last_clean":"2023-11-08T19:26:10.124568+0000","last_became_active":"2023-11-08T19:25:46.284288+0000","last_became_peered":"2023-11-08T19:25:46.284288+0000","last_unstale":"2023-11-08T19:26:10.124568+0000","last_undegraded":"2023-11-08T19:26:10.124568+0000","last_fullsized":"2023-11-08T19:26:10.124568+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:57:53.083448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001250894,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.129291+0000","last_change":"2023-11-08T19:26:11.129291+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.129291+0000","last_undegraded":"2023-11-08T19:26:11.129291+0000","last_fullsized":"2023-11-08T19:26:11.129291+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":3,"reported_epoch":81,"state":"creating+activating","last_fresh":"2023-11-08T19:26:11.130995+0000","last_change":"2023-11-08T19:26:11.130995+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.130995+0000","last_undegraded":"2023-11-08T19:26:11.130995+0000","last_fullsized":"2023-11-08T19:26:11.130995+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:58:17.949441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.124612+0000","last_change":"2023-11-08T19:25:47.282612+0000","last_active":"2023-11-08T19:26:10.124612+0000","last_peered":"2023-11-08T19:26:10.124612+0000","last_clean":"2023-11-08T19:26:10.124612+0000","last_became_active":"2023-11-08T19:25:47.282299+0000","last_became_peered":"2023-11-08T19:25:47.282299+0000","last_unstale":"2023-11-08T19:26:10.124612+0000","last_undegraded":"2023-11-08T19:26:10.124612+0000","last_fullsized":"2023-11-08T19:26:10.124612+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:43:18.319773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.151613+0000","last_change":"2023-11-08T19:24:32.146639+0000","last_active":"2023-11-08T19:26:12.151613+0000","last_peered":"2023-11-08T19:26:12.151613+0000","last_clean":"2023-11-08T19:26:12.151613+0000","last_became_active":"2023-11-08T19:24:31.147384+0000","last_became_peered":"2023-11-08T19:24:31.147384+0000","last_unstale":"2023-11-08T19:26:12.151613+0000","last_undegraded":"2023-11-08T19:26:12.151613+0000","last_fullsized":"2023-11-08T19:26:12.151613+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:30:21.946303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043834899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.124395+0000","last_change":"2023-11-08T19:25:48.283541+0000","last_active":"2023-11-08T19:26:10.124395+0000","last_peered":"2023-11-08T19:26:10.124395+0000","last_clean":"2023-11-08T19:26:10.124395+0000","last_became_active":"2023-11-08T19:25:46.285626+0000","last_became_peered":"2023-11-08T19:25:46.285626+0000","last_unstale":"2023-11-08T19:26:10.124395+0000","last_undegraded":"2023-11-08T19:26:10.124395+0000","last_fullsized":"2023-11-08T19:26:10.124395+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:48:17.033319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019032459999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.131450+0000","last_change":"2023-11-08T19:26:10.131450+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.131450+0000","last_undegraded":"2023-11-08T19:26:10.131450+0000","last_fullsized":"2023-11-08T19:26:10.131450+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":20,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.373197+0000","last_change":"2023-11-08T19:25:47.287878+0000","last_active":"2023-11-08T19:26:06.373197+0000","last_peered":"2023-11-08T19:26:06.373197+0000","last_clean":"2023-11-08T19:26:06.373197+0000","last_became_active":"2023-11-08T19:25:47.287617+0000","last_became_peered":"2023-11-08T19:25:47.287617+0000","last_unstale":"2023-11-08T19:26:06.373197+0000","last_undegraded":"2023-11-08T19:26:06.373197+0000","last_fullsized":"2023-11-08T19:26:06.373197+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:20:50.791463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":55,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.125379+0000","last_change":"2023-11-08T19:24:32.142376+0000","last_active":"2023-11-08T19:26:10.125379+0000","last_peered":"2023-11-08T19:26:10.125379+0000","last_clean":"2023-11-08T19:26:10.125379+0000","last_became_active":"2023-11-08T19:24:31.144614+0000","last_became_peered":"2023-11-08T19:24:31.144614+0000","last_unstale":"2023-11-08T19:26:10.125379+0000","last_undegraded":"2023-11-08T19:26:10.125379+0000","last_fullsized":"2023-11-08T19:26:10.125379+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:09:04.880374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050362200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.537032+0000","last_change":"2023-11-08T19:25:48.373636+0000","last_active":"2023-11-08T19:26:06.537032+0000","last_peered":"2023-11-08T19:26:06.537032+0000","last_clean":"2023-11-08T19:26:06.537032+0000","last_became_active":"2023-11-08T19:25:46.283803+0000","last_became_peered":"2023-11-08T19:25:46.283803+0000","last_unstale":"2023-11-08T19:26:06.537032+0000","last_undegraded":"2023-11-08T19:26:06.537032+0000","last_fullsized":"2023-11-08T19:26:06.537032+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:00:34.691748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002404855,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.131315+0000","last_change":"2023-11-08T19:26:11.131315+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.131315+0000","last_undegraded":"2023-11-08T19:26:11.131315+0000","last_fullsized":"2023-11-08T19:26:11.131315+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"82'1","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.171188+0000","last_change":"2023-11-08T19:26:11.143541+0000","last_active":"2023-11-08T19:26:12.171188+0000","last_peered":"2023-11-08T19:26:12.171188+0000","last_clean":"2023-11-08T19:26:12.171188+0000","last_became_active":"2023-11-08T19:26:11.143255+0000","last_became_peered":"2023-11-08T19:26:11.143255+0000","last_unstale":"2023-11-08T19:26:12.171188+0000","last_undegraded":"2023-11-08T19:26:12.171188+0000","last_fullsized":"2023-11-08T19:26:12.171188+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:19:00.174837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.152295+0000","last_change":"2023-11-08T19:25:47.287741+0000","last_active":"2023-11-08T19:26:12.152295+0000","last_peered":"2023-11-08T19:26:12.152295+0000","last_clean":"2023-11-08T19:26:12.152295+0000","last_became_active":"2023-11-08T19:25:47.287428+0000","last_became_peered":"2023-11-08T19:25:47.287428+0000","last_unstale":"2023-11-08T19:26:12.152295+0000","last_undegraded":"2023-11-08T19:26:12.152295+0000","last_fullsized":"2023-11-08T19:26:12.152295+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:38:55.785104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.153220+0000","last_change":"2023-11-08T19:24:32.147235+0000","last_active":"2023-11-08T19:26:12.153220+0000","last_peered":"2023-11-08T19:26:12.153220+0000","last_clean":"2023-11-08T19:26:12.153220+0000","last_became_active":"2023-11-08T19:24:31.146176+0000","last_became_peered":"2023-11-08T19:24:31.146176+0000","last_unstale":"2023-11-08T19:26:12.153220+0000","last_undegraded":"2023-11-08T19:26:12.153220+0000","last_fullsized":"2023-11-08T19:26:12.153220+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:39.214888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048481000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.536729+0000","last_change":"2023-11-08T19:25:48.373345+0000","last_active":"2023-11-08T19:26:06.536729+0000","last_peered":"2023-11-08T19:26:06.536729+0000","last_clean":"2023-11-08T19:26:06.536729+0000","last_became_active":"2023-11-08T19:25:46.282460+0000","last_became_peered":"2023-11-08T19:25:46.282460+0000","last_unstale":"2023-11-08T19:26:06.536729+0000","last_undegraded":"2023-11-08T19:26:06.536729+0000","last_fullsized":"2023-11-08T19:26:06.536729+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:25:30.927920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001972863,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.130984+0000","last_change":"2023-11-08T19:26:11.130984+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.130984+0000","last_undegraded":"2023-11-08T19:26:11.130984+0000","last_fullsized":"2023-11-08T19:26:11.130984+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.131011+0000","last_change":"2023-11-08T19:26:10.131011+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.131011+0000","last_undegraded":"2023-11-08T19:26:10.131011+0000","last_fullsized":"2023-11-08T19:26:10.131011+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.125470+0000","last_change":"2023-11-08T19:25:47.283708+0000","last_active":"2023-11-08T19:26:10.125470+0000","last_peered":"2023-11-08T19:26:10.125470+0000","last_clean":"2023-11-08T19:26:10.125470+0000","last_became_active":"2023-11-08T19:25:47.283433+0000","last_became_peered":"2023-11-08T19:25:47.283433+0000","last_unstale":"2023-11-08T19:26:10.125470+0000","last_undegraded":"2023-11-08T19:26:10.125470+0000","last_fullsized":"2023-11-08T19:26:10.125470+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:30:17.627967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":48,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.126607+0000","last_change":"2023-11-08T19:24:32.543880+0000","last_active":"2023-11-08T19:26:10.126607+0000","last_peered":"2023-11-08T19:26:10.126607+0000","last_clean":"2023-11-08T19:26:10.126607+0000","last_became_active":"2023-11-08T19:24:31.142052+0000","last_became_peered":"2023-11-08T19:24:31.142052+0000","last_unstale":"2023-11-08T19:26:10.126607+0000","last_undegraded":"2023-11-08T19:26:10.126607+0000","last_fullsized":"2023-11-08T19:26:10.126607+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:18:42.371676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014881058000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.373504+0000","last_change":"2023-11-08T19:25:48.284890+0000","last_active":"2023-11-08T19:26:06.373504+0000","last_peered":"2023-11-08T19:26:06.373504+0000","last_clean":"2023-11-08T19:26:06.373504+0000","last_became_active":"2023-11-08T19:25:46.279287+0000","last_became_peered":"2023-11-08T19:25:46.279287+0000","last_unstale":"2023-11-08T19:26:06.373504+0000","last_undegraded":"2023-11-08T19:26:06.373504+0000","last_fullsized":"2023-11-08T19:26:06.373504+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:35:30.427172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076856899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.131038+0000","last_change":"2023-11-08T19:26:11.131038+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.131038+0000","last_undegraded":"2023-11-08T19:26:11.131038+0000","last_fullsized":"2023-11-08T19:26:11.131038+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.130999+0000","last_change":"2023-11-08T19:26:10.130999+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.130999+0000","last_undegraded":"2023-11-08T19:26:10.130999+0000","last_fullsized":"2023-11-08T19:26:10.130999+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":20,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.373345+0000","last_change":"2023-11-08T19:25:47.285867+0000","last_active":"2023-11-08T19:26:06.373345+0000","last_peered":"2023-11-08T19:26:06.373345+0000","last_clean":"2023-11-08T19:26:06.373345+0000","last_became_active":"2023-11-08T19:25:47.285533+0000","last_became_peered":"2023-11-08T19:25:47.285533+0000","last_unstale":"2023-11-08T19:26:06.373345+0000","last_undegraded":"2023-11-08T19:26:06.373345+0000","last_fullsized":"2023-11-08T19:26:06.373345+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:26:59.852338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.152466+0000","last_change":"2023-11-08T19:24:32.147011+0000","last_active":"2023-11-08T19:26:12.152466+0000","last_peered":"2023-11-08T19:26:12.152466+0000","last_clean":"2023-11-08T19:26:12.152466+0000","last_became_active":"2023-11-08T19:24:31.148250+0000","last_became_peered":"2023-11-08T19:24:31.148250+0000","last_unstale":"2023-11-08T19:26:12.152466+0000","last_undegraded":"2023-11-08T19:26:12.152466+0000","last_fullsized":"2023-11-08T19:26:12.152466+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:01:25.647952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043061299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.125521+0000","last_change":"2023-11-08T19:25:48.284869+0000","last_active":"2023-11-08T19:26:10.125521+0000","last_peered":"2023-11-08T19:26:10.125521+0000","last_clean":"2023-11-08T19:26:10.125521+0000","last_became_active":"2023-11-08T19:25:46.285478+0000","last_became_peered":"2023-11-08T19:25:46.285478+0000","last_unstale":"2023-11-08T19:26:10.125521+0000","last_undegraded":"2023-11-08T19:26:10.125521+0000","last_fullsized":"2023-11-08T19:26:10.125521+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:49:51.368808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000376339,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.131103+0000","last_change":"2023-11-08T19:26:11.131103+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.131103+0000","last_undegraded":"2023-11-08T19:26:11.131103+0000","last_fullsized":"2023-11-08T19:26:11.131103+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.128845+0000","last_change":"2023-11-08T19:26:10.128845+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.128845+0000","last_undegraded":"2023-11-08T19:26:10.128845+0000","last_fullsized":"2023-11-08T19:26:10.128845+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.125020+0000","last_change":"2023-11-08T19:25:47.284429+0000","last_active":"2023-11-08T19:26:10.125020+0000","last_peered":"2023-11-08T19:26:10.125020+0000","last_clean":"2023-11-08T19:26:10.125020+0000","last_became_active":"2023-11-08T19:25:47.283990+0000","last_became_peered":"2023-11-08T19:25:47.283990+0000","last_unstale":"2023-11-08T19:26:10.125020+0000","last_undegraded":"2023-11-08T19:26:10.125020+0000","last_fullsized":"2023-11-08T19:26:10.125020+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:59:08.628317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":55,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.124560+0000","last_change":"2023-11-08T19:24:32.141190+0000","last_active":"2023-11-08T19:26:10.124560+0000","last_peered":"2023-11-08T19:26:10.124560+0000","last_clean":"2023-11-08T19:26:10.124560+0000","last_became_active":"2023-11-08T19:24:31.147651+0000","last_became_peered":"2023-11-08T19:24:31.147651+0000","last_unstale":"2023-11-08T19:26:10.124560+0000","last_undegraded":"2023-11-08T19:26:10.124560+0000","last_fullsized":"2023-11-08T19:26:10.124560+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:21:55.985548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043673300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.655820+0000","last_change":"2023-11-08T19:25:48.320707+0000","last_active":"2023-11-08T19:26:06.655820+0000","last_peered":"2023-11-08T19:26:06.655820+0000","last_clean":"2023-11-08T19:26:06.655820+0000","last_became_active":"2023-11-08T19:25:46.282307+0000","last_became_peered":"2023-11-08T19:25:46.282307+0000","last_unstale":"2023-11-08T19:26:06.655820+0000","last_undegraded":"2023-11-08T19:26:06.655820+0000","last_fullsized":"2023-11-08T19:26:06.655820+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:53:36.476361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047078400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.130955+0000","last_change":"2023-11-08T19:26:11.130955+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.130955+0000","last_undegraded":"2023-11-08T19:26:11.130955+0000","last_fullsized":"2023-11-08T19:26:11.130955+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.128054+0000","last_change":"2023-11-08T19:26:10.128054+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.128054+0000","last_undegraded":"2023-11-08T19:26:10.128054+0000","last_fullsized":"2023-11-08T19:26:10.128054+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.125006+0000","last_change":"2023-11-08T19:25:47.284227+0000","last_active":"2023-11-08T19:26:10.125006+0000","last_peered":"2023-11-08T19:26:10.125006+0000","last_clean":"2023-11-08T19:26:10.125006+0000","last_became_active":"2023-11-08T19:25:47.283927+0000","last_became_peered":"2023-11-08T19:25:47.283927+0000","last_unstale":"2023-11-08T19:26:10.125006+0000","last_undegraded":"2023-11-08T19:26:10.125006+0000","last_fullsized":"2023-11-08T19:26:10.125006+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:15:23.188047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.536878+0000","last_change":"2023-11-08T19:24:32.530168+0000","last_active":"2023-11-08T19:26:06.536878+0000","last_peered":"2023-11-08T19:26:06.536878+0000","last_clean":"2023-11-08T19:26:06.536878+0000","last_became_active":"2023-11-08T19:24:31.144329+0000","last_became_peered":"2023-11-08T19:24:31.144329+0000","last_unstale":"2023-11-08T19:26:06.536878+0000","last_undegraded":"2023-11-08T19:26:06.536878+0000","last_fullsized":"2023-11-08T19:26:06.536878+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:05:36.085920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043484799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.536437+0000","last_change":"2023-11-08T19:25:48.371291+0000","last_active":"2023-11-08T19:26:06.536437+0000","last_peered":"2023-11-08T19:26:06.536437+0000","last_clean":"2023-11-08T19:26:06.536437+0000","last_became_active":"2023-11-08T19:25:46.281425+0000","last_became_peered":"2023-11-08T19:25:46.281425+0000","last_unstale":"2023-11-08T19:26:06.536437+0000","last_undegraded":"2023-11-08T19:26:06.536437+0000","last_fullsized":"2023-11-08T19:26:06.536437+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:23:12.422712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00124314,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.128515+0000","last_change":"2023-11-08T19:26:11.128515+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.128515+0000","last_undegraded":"2023-11-08T19:26:11.128515+0000","last_fullsized":"2023-11-08T19:26:11.128515+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":3,"reported_epoch":81,"state":"creating+activating","last_fresh":"2023-11-08T19:26:11.128875+0000","last_change":"2023-11-08T19:26:11.128875+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.128875+0000","last_undegraded":"2023-11-08T19:26:11.128875+0000","last_fullsized":"2023-11-08T19:26:11.128875+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:34:00.358882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":["4","6"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.536522+0000","last_change":"2023-11-08T19:25:47.281724+0000","last_active":"2023-11-08T19:26:06.536522+0000","last_peered":"2023-11-08T19:26:06.536522+0000","last_clean":"2023-11-08T19:26:06.536522+0000","last_became_active":"2023-11-08T19:25:47.281425+0000","last_became_peered":"2023-11-08T19:25:47.281425+0000","last_unstale":"2023-11-08T19:26:06.536522+0000","last_undegraded":"2023-11-08T19:26:06.536522+0000","last_fullsized":"2023-11-08T19:26:06.536522+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:38:55.785104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.536534+0000","last_change":"2023-11-08T19:24:32.529486+0000","last_active":"2023-11-08T19:26:06.536534+0000","last_peered":"2023-11-08T19:26:06.536534+0000","last_clean":"2023-11-08T19:26:06.536534+0000","last_became_active":"2023-11-08T19:24:31.146260+0000","last_became_peered":"2023-11-08T19:24:31.146260+0000","last_unstale":"2023-11-08T19:26:06.536534+0000","last_undegraded":"2023-11-08T19:26:06.536534+0000","last_fullsized":"2023-11-08T19:26:06.536534+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:45:34.425432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059842900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.125457+0000","last_change":"2023-11-08T19:25:48.277457+0000","last_active":"2023-11-08T19:26:10.125457+0000","last_peered":"2023-11-08T19:26:10.125457+0000","last_clean":"2023-11-08T19:26:10.125457+0000","last_became_active":"2023-11-08T19:25:46.286239+0000","last_became_peered":"2023-11-08T19:25:46.286239+0000","last_unstale":"2023-11-08T19:26:10.125457+0000","last_undegraded":"2023-11-08T19:26:10.125457+0000","last_fullsized":"2023-11-08T19:26:10.125457+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:09:43.662108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000722421,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":3,"reported_epoch":81,"state":"creating+activating","last_fresh":"2023-11-08T19:26:11.131468+0000","last_change":"2023-11-08T19:26:11.131468+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.131468+0000","last_undegraded":"2023-11-08T19:26:11.131468+0000","last_fullsized":"2023-11-08T19:26:11.131468+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:50:16.234801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":["1","7"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.150529+0000","last_change":"2023-11-08T19:25:47.287874+0000","last_active":"2023-11-08T19:26:12.150529+0000","last_peered":"2023-11-08T19:26:12.150529+0000","last_clean":"2023-11-08T19:26:12.150529+0000","last_became_active":"2023-11-08T19:25:47.287456+0000","last_became_peered":"2023-11-08T19:25:47.287456+0000","last_unstale":"2023-11-08T19:26:12.150529+0000","last_undegraded":"2023-11-08T19:26:12.150529+0000","last_fullsized":"2023-11-08T19:26:12.150529+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:26:59.852338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":53,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.372762+0000","last_change":"2023-11-08T19:24:32.141131+0000","last_active":"2023-11-08T19:26:06.372762+0000","last_peered":"2023-11-08T19:26:06.372762+0000","last_clean":"2023-11-08T19:26:06.372762+0000","last_became_active":"2023-11-08T19:24:31.146154+0000","last_became_peered":"2023-11-08T19:24:31.146154+0000","last_unstale":"2023-11-08T19:26:06.372762+0000","last_undegraded":"2023-11-08T19:26:06.372762+0000","last_fullsized":"2023-11-08T19:26:06.372762+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:18:40.271560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082432800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.126197+0000","last_change":"2023-11-08T19:25:48.372729+0000","last_active":"2023-11-08T19:26:10.126197+0000","last_peered":"2023-11-08T19:26:10.126197+0000","last_clean":"2023-11-08T19:26:10.126197+0000","last_became_active":"2023-11-08T19:25:46.290114+0000","last_became_peered":"2023-11-08T19:25:46.290114+0000","last_unstale":"2023-11-08T19:26:10.126197+0000","last_undegraded":"2023-11-08T19:26:10.126197+0000","last_fullsized":"2023-11-08T19:26:10.126197+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:49:36.208776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061009499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":3,"reported_epoch":81,"state":"creating+activating","last_fresh":"2023-11-08T19:26:11.131145+0000","last_change":"2023-11-08T19:26:11.131145+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.131145+0000","last_undegraded":"2023-11-08T19:26:11.131145+0000","last_fullsized":"2023-11-08T19:26:11.131145+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:30:41.488076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":["1","5"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.536851+0000","last_change":"2023-11-08T19:25:47.283046+0000","last_active":"2023-11-08T19:26:06.536851+0000","last_peered":"2023-11-08T19:26:06.536851+0000","last_clean":"2023-11-08T19:26:06.536851+0000","last_became_active":"2023-11-08T19:25:47.282763+0000","last_became_peered":"2023-11-08T19:25:47.282763+0000","last_unstale":"2023-11-08T19:26:06.536851+0000","last_undegraded":"2023-11-08T19:26:06.536851+0000","last_fullsized":"2023-11-08T19:26:06.536851+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:12:51.389167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":49,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.126305+0000","last_change":"2023-11-08T19:24:32.263963+0000","last_active":"2023-11-08T19:26:10.126305+0000","last_peered":"2023-11-08T19:26:10.126305+0000","last_clean":"2023-11-08T19:26:10.126305+0000","last_became_active":"2023-11-08T19:24:31.139062+0000","last_became_peered":"2023-11-08T19:24:31.139062+0000","last_unstale":"2023-11-08T19:26:10.126305+0000","last_undegraded":"2023-11-08T19:26:10.126305+0000","last_fullsized":"2023-11-08T19:26:10.126305+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:26.080042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033682599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.373032+0000","last_change":"2023-11-08T19:25:48.283302+0000","last_active":"2023-11-08T19:26:06.373032+0000","last_peered":"2023-11-08T19:26:06.373032+0000","last_clean":"2023-11-08T19:26:06.373032+0000","last_became_active":"2023-11-08T19:25:46.284287+0000","last_became_peered":"2023-11-08T19:25:46.284287+0000","last_unstale":"2023-11-08T19:26:06.373032+0000","last_undegraded":"2023-11-08T19:26:06.373032+0000","last_fullsized":"2023-11-08T19:26:06.373032+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:39:27.217802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097880800000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.128580+0000","last_change":"2023-11-08T19:26:11.128580+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.128580+0000","last_undegraded":"2023-11-08T19:26:11.128580+0000","last_fullsized":"2023-11-08T19:26:11.128580+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":3,"reported_epoch":81,"state":"creating+activating","last_fresh":"2023-11-08T19:26:11.131935+0000","last_change":"2023-11-08T19:26:11.131935+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.131935+0000","last_undegraded":"2023-11-08T19:26:11.131935+0000","last_fullsized":"2023-11-08T19:26:11.131935+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:01:57.994055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":["3","0"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.124702+0000","last_change":"2023-11-08T19:25:47.286434+0000","last_active":"2023-11-08T19:26:10.124702+0000","last_peered":"2023-11-08T19:26:10.124702+0000","last_clean":"2023-11-08T19:26:10.124702+0000","last_became_active":"2023-11-08T19:25:47.286181+0000","last_became_peered":"2023-11-08T19:25:47.286181+0000","last_unstale":"2023-11-08T19:26:10.124702+0000","last_undegraded":"2023-11-08T19:26:10.124702+0000","last_fullsized":"2023-11-08T19:26:10.124702+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:13:27.285648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":53,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.373802+0000","last_change":"2023-11-08T19:24:32.140514+0000","last_active":"2023-11-08T19:26:06.373802+0000","last_peered":"2023-11-08T19:26:06.373802+0000","last_clean":"2023-11-08T19:26:06.373802+0000","last_became_active":"2023-11-08T19:24:31.146668+0000","last_became_peered":"2023-11-08T19:24:31.146668+0000","last_unstale":"2023-11-08T19:26:06.373802+0000","last_undegraded":"2023-11-08T19:26:06.373802+0000","last_fullsized":"2023-11-08T19:26:06.373802+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:31:24.539374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071576699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.656105+0000","last_change":"2023-11-08T19:25:48.320667+0000","last_active":"2023-11-08T19:26:06.656105+0000","last_peered":"2023-11-08T19:26:06.656105+0000","last_clean":"2023-11-08T19:26:06.656105+0000","last_became_active":"2023-11-08T19:25:46.290246+0000","last_became_peered":"2023-11-08T19:25:46.290246+0000","last_unstale":"2023-11-08T19:26:06.656105+0000","last_undegraded":"2023-11-08T19:26:06.656105+0000","last_fullsized":"2023-11-08T19:26:06.656105+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:33:35.492889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000423211,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.15","version":"82'3","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.172151+0000","last_change":"2023-11-08T19:26:11.147387+0000","last_active":"2023-11-08T19:26:12.172151+0000","last_peered":"2023-11-08T19:26:12.172151+0000","last_clean":"2023-11-08T19:26:12.172151+0000","last_became_active":"2023-11-08T19:26:11.147105+0000","last_became_peered":"2023-11-08T19:26:11.147105+0000","last_unstale":"2023-11-08T19:26:12.172151+0000","last_undegraded":"2023-11-08T19:26:12.172151+0000","last_fullsized":"2023-11-08T19:26:12.172151+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:29:49.218097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.126527+0000","last_change":"2023-11-08T19:25:47.287717+0000","last_active":"2023-11-08T19:26:10.126527+0000","last_peered":"2023-11-08T19:26:10.126527+0000","last_clean":"2023-11-08T19:26:10.126527+0000","last_became_active":"2023-11-08T19:25:47.287412+0000","last_became_peered":"2023-11-08T19:25:47.287412+0000","last_unstale":"2023-11-08T19:26:10.126527+0000","last_undegraded":"2023-11-08T19:26:10.126527+0000","last_fullsized":"2023-11-08T19:26:10.126527+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:18:04.478139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":49,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.656198+0000","last_change":"2023-11-08T19:24:32.142892+0000","last_active":"2023-11-08T19:26:06.656198+0000","last_peered":"2023-11-08T19:26:06.656198+0000","last_clean":"2023-11-08T19:26:06.656198+0000","last_became_active":"2023-11-08T19:24:31.144912+0000","last_became_peered":"2023-11-08T19:24:31.144912+0000","last_unstale":"2023-11-08T19:26:06.656198+0000","last_undegraded":"2023-11-08T19:26:06.656198+0000","last_fullsized":"2023-11-08T19:26:06.656198+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:04:21.151484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056686900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.373645+0000","last_change":"2023-11-08T19:25:48.285205+0000","last_active":"2023-11-08T19:26:06.373645+0000","last_peered":"2023-11-08T19:26:06.373645+0000","last_clean":"2023-11-08T19:26:06.373645+0000","last_became_active":"2023-11-08T19:25:46.285848+0000","last_became_peered":"2023-11-08T19:25:46.285848+0000","last_unstale":"2023-11-08T19:26:06.373645+0000","last_undegraded":"2023-11-08T19:26:06.373645+0000","last_fullsized":"2023-11-08T19:26:06.373645+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:07:10.832480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089732199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.158884+0000","last_change":"2023-11-08T19:26:12.170669+0000","last_active":"2023-11-08T19:26:13.158884+0000","last_peered":"2023-11-08T19:26:13.158884+0000","last_clean":"2023-11-08T19:26:13.158884+0000","last_became_active":"2023-11-08T19:26:12.170345+0000","last_became_peered":"2023-11-08T19:26:12.170345+0000","last_unstale":"2023-11-08T19:26:13.158884+0000","last_undegraded":"2023-11-08T19:26:13.158884+0000","last_fullsized":"2023-11-08T19:26:13.158884+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:32:15.350077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":3,"reported_epoch":81,"state":"creating+activating","last_fresh":"2023-11-08T19:26:11.130955+0000","last_change":"2023-11-08T19:26:11.130955+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.130955+0000","last_undegraded":"2023-11-08T19:26:11.130955+0000","last_fullsized":"2023-11-08T19:26:11.130955+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:27:23.712447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":["4","3"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":19,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.656005+0000","last_change":"2023-11-08T19:25:47.280177+0000","last_active":"2023-11-08T19:26:06.656005+0000","last_peered":"2023-11-08T19:26:06.656005+0000","last_clean":"2023-11-08T19:26:06.656005+0000","last_became_active":"2023-11-08T19:25:47.279913+0000","last_became_peered":"2023-11-08T19:25:47.279913+0000","last_unstale":"2023-11-08T19:26:06.656005+0000","last_undegraded":"2023-11-08T19:26:06.656005+0000","last_fullsized":"2023-11-08T19:26:06.656005+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:26:02.147090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":49,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.126250+0000","last_change":"2023-11-08T19:24:32.263958+0000","last_active":"2023-11-08T19:26:10.126250+0000","last_peered":"2023-11-08T19:26:10.126250+0000","last_clean":"2023-11-08T19:26:10.126250+0000","last_became_active":"2023-11-08T19:24:31.149011+0000","last_became_peered":"2023-11-08T19:24:31.149011+0000","last_unstale":"2023-11-08T19:26:10.126250+0000","last_undegraded":"2023-11-08T19:26:10.126250+0000","last_fullsized":"2023-11-08T19:26:10.126250+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:09:04.880374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033496900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.372612+0000","last_change":"2023-11-08T19:25:48.285075+0000","last_active":"2023-11-08T19:26:06.372612+0000","last_peered":"2023-11-08T19:26:06.372612+0000","last_clean":"2023-11-08T19:26:06.372612+0000","last_became_active":"2023-11-08T19:25:46.272479+0000","last_became_peered":"2023-11-08T19:25:46.272479+0000","last_unstale":"2023-11-08T19:26:06.372612+0000","last_undegraded":"2023-11-08T19:26:06.372612+0000","last_fullsized":"2023-11-08T19:26:06.372612+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:23:12.422712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001158117,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574892,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28600,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343240,"statfs":{"total":96636764160,"available":96607477760,"internally_reserved":0,"allocated":1617920,"data_stored":1082797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55200000000000005,"15min":0.53800000000000003},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.41399999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.71299999999999997,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.65300000000000002}]},{"osd":1,"last update":"Wed Nov 8 19:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.54800000000000004,"15min":0.54700000000000004},"min":{"1min":0.40799999999999997,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.69499999999999995,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.53800000000000003,"15min":0.53200000000000003},"min":{"1min":0.40600000000000003,"5min":0.37,"15min":0.37},"max":{"1min":0.75900000000000001,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.61699999999999999}]},{"osd":2,"last update":"Wed Nov 8 19:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.51400000000000001,"15min":0.50800000000000001},"min":{"1min":0.42899999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.75800000000000001,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.54000000000000004,"15min":0.53600000000000003},"min":{"1min":0.379,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.77800000000000002,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.63400000000000001}]},{"osd":3,"last update":"Wed Nov 8 19:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.53600000000000003,"15min":0.53400000000000003},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.56899999999999995,"15min":0.55900000000000005},"min":{"1min":0.42399999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76100000000000001,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.67600000000000005}]},{"osd":4,"last update":"Wed Nov 8 19:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.496,"15min":0.48599999999999999},"min":{"1min":0.35999999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.51900000000000002,"15min":0.51800000000000002},"min":{"1min":0.378,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.71399999999999997,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.45300000000000001}]},{"osd":5,"last update":"Wed Nov 8 19:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.55900000000000005,"15min":0.54800000000000004},"min":{"1min":0.39200000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.76300000000000001,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.58199999999999996,"15min":0.57799999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.68700000000000006,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.51100000000000001}]},{"osd":6,"last update":"Wed Nov 8 19:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.45600000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.80400000000000005,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57299999999999995,"15min":0.56399999999999995},"min":{"1min":0.441,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.69199999999999995,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.495}]}]},{"osd":6,"up_from":13,"seq":55834574892,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":978944,"data_stored":468818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.57299999999999995,"15min":0.59699999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.69799999999999995,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.57299999999999995,"15min":0.59099999999999997},"min":{"1min":0.313,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.754,"5min":1.478,"15min":1.478},"last":0.64400000000000002}]},{"osd":1,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.59599999999999997,"15min":0.60599999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.77500000000000002,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.65200000000000002,"15min":0.66600000000000004},"min":{"1min":0.435,"5min":0.433,"15min":0.433},"max":{"1min":0.78700000000000003,"5min":1.649,"15min":1.649},"last":0.72499999999999998}]},{"osd":2,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.621,"15min":0.63200000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76400000000000001,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.73699999999999999}]},{"osd":3,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.60399999999999998,"15min":0.63},"min":{"1min":0.42299999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.747,"5min":1.766,"15min":1.766},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.59499999999999997,"15min":0.61899999999999999},"min":{"1min":0.39300000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.82799999999999996,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":0.52100000000000002}]},{"osd":4,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53700000000000003,"15min":0.54200000000000004},"min":{"1min":0.36399999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.625},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57299999999999995,"15min":0.58099999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.81699999999999995,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.54700000000000004}]},{"osd":5,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.55500000000000005,"15min":0.56799999999999995},"min":{"1min":0.38800000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.73499999999999999,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.623,"15min":0.63600000000000001},"min":{"1min":0.41399999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.80200000000000005,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.45000000000000001}]},{"osd":7,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.60599999999999998,"15min":0.61299999999999999},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.77700000000000002,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.63600000000000001,"15min":0.64600000000000002},"min":{"1min":0.44400000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.71599999999999997,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.58399999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574891,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":978944,"data_stored":468818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.35699999999999998,"15min":0.36299999999999999},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.51200000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.38900000000000001,"15min":0.41299999999999998},"min":{"1min":0.22900000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.51700000000000002,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":0.35099999999999998}]},{"osd":2,"last update":"Wed Nov 8 19:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.33800000000000002,"15min":0.34499999999999997},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.53000000000000003,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.38100000000000001,"15min":0.39400000000000002},"min":{"1min":0.253,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.46400000000000002,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.41099999999999998}]},{"osd":3,"last update":"Wed Nov 8 19:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.40799999999999997,"15min":0.41699999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.432,"5min":1.24,"15min":1.24},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.371,"5min":0.438,"15min":0.46200000000000002},"min":{"1min":0.26100000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.47999999999999998,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.312}]},{"osd":4,"last update":"Wed Nov 8 19:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.60599999999999998,"15min":0.61399999999999999},"min":{"1min":0.46500000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72499999999999998,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57599999999999996,"15min":0.56599999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.76200000000000001,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.57199999999999995}]},{"osd":5,"last update":"Wed Nov 8 19:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.56999999999999995,"15min":0.55800000000000005},"min":{"1min":0.41399999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.72799999999999998,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.60199999999999998,"15min":0.60699999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.68700000000000006,"5min":1.115,"15min":1.115},"last":0.78600000000000003}]},{"osd":6,"last update":"Wed Nov 8 19:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.63,"15min":0.63800000000000001},"min":{"1min":0.439,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.746,"5min":2.093,"15min":2.093},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.59899999999999998,"15min":0.60299999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.76100000000000001,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.74099999999999999}]},{"osd":7,"last update":"Wed Nov 8 19:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.64700000000000002,"15min":0.67100000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.77600000000000002,"5min":1.591,"15min":1.591},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.66500000000000004,"15min":0.69199999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.70199999999999996,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.63600000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574891,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28556,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343284,"statfs":{"total":96636764160,"available":96607522816,"internally_reserved":0,"allocated":1572864,"data_stored":1059186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:26:00 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.879,"15min":1.1180000000000001},"min":{"1min":0.23799999999999999,"5min":0.192,"15min":0.192},"max":{"1min":0.60699999999999998,"5min":19.295999999999999,"15min":19.295999999999999},"last":0.434},{"interface":"front","average":{"1min":0.379,"5min":0.81999999999999995,"15min":1.024},"min":{"1min":0.24299999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.56000000000000005,"5min":17.204000000000001,"15min":17.204000000000001},"last":0.40799999999999997}]},{"osd":2,"last update":"Wed Nov 8 19:26:00 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.54200000000000004,"15min":0.61799999999999999},"min":{"1min":0.28299999999999997,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.54700000000000004,"5min":6.524,"15min":6.524},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.85399999999999998,"15min":1.0640000000000001},"min":{"1min":0.29499999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.60699999999999998,"5min":17.175000000000001,"15min":17.175000000000001},"last":0.45100000000000001}]},{"osd":3,"last update":"Wed Nov 8 19:26:00 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.746,"15min":0.91000000000000003},"min":{"1min":0.27100000000000002,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.55800000000000005,"5min":14.324,"15min":14.324},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.40799999999999997,"15min":0.40400000000000003},"min":{"1min":0.34699999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.48599999999999999}]},{"osd":4,"last update":"Wed Nov 8 19:26:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":1.028,"15min":1.212},"min":{"1min":0.52000000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.98999999999999999,"5min":17.056000000000001,"15min":17.056000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.70699999999999996,"15min":0.745},"min":{"1min":0.49099999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.82299999999999995,"5min":5.0289999999999999,"15min":5.0289999999999999},"last":0.60499999999999998}]},{"osd":5,"last update":"Wed Nov 8 19:26:00 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.69999999999999996,"15min":0.746},"min":{"1min":0.53400000000000003,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.85099999999999998,"5min":5.0590000000000002,"15min":5.0590000000000002},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.58399999999999996,"15min":0.56999999999999995},"min":{"1min":0.47199999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.64400000000000002}]},{"osd":6,"last update":"Wed Nov 8 19:26:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.61299999999999999,"15min":0.60799999999999998},"min":{"1min":0.505,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.68400000000000005,"5min":1.0649999999999999,"15min":1.2589999999999999},"min":{"1min":0.50800000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.0389999999999999,"5min":17.111999999999998,"15min":17.111999999999998},"last":0.72599999999999998}]},{"osd":7,"last update":"Wed Nov 8 19:26:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":1.0820000000000001,"15min":1.274},"min":{"1min":0.48099999999999998,"5min":0.376,"15min":0.376},"max":{"1min":1.0760000000000001,"5min":17.146000000000001,"15min":17.146000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.63,"5min":0.71099999999999997,"15min":0.75700000000000001},"min":{"1min":0.47099999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.91700000000000004,"5min":4.9829999999999997,"15min":4.9829999999999997},"last":0.68799999999999994}]}]},{"osd":2,"up_from":13,"seq":55834574891,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":978944,"data_stored":468818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.433,"15min":0.47499999999999998},"min":{"1min":0.23300000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.61299999999999999,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.46200000000000002,"15min":0.50800000000000001},"min":{"1min":0.23999999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.65100000000000002,"5min":3.4369999999999998,"15min":3.4369999999999998},"last":0.31900000000000001}]},{"osd":1,"last update":"Wed Nov 8 19:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.49099999999999999,"15min":0.54900000000000004},"min":{"1min":0.27000000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.48399999999999999,"5min":4.0679999999999996,"15min":4.0679999999999996},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.54400000000000004,"15min":0.59599999999999997},"min":{"1min":0.32300000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.58599999999999997,"5min":4.3499999999999996,"15min":4.3499999999999996},"last":0.438}]},{"osd":3,"last update":"Wed Nov 8 19:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.495,"15min":0.53700000000000003},"min":{"1min":0.27800000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.47099999999999997,"5min":3.8580000000000001,"15min":3.8580000000000001},"last":0.375},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.46300000000000002,"15min":0.51200000000000001},"min":{"1min":0.29599999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.55700000000000005,"5min":3.476,"15min":3.476},"last":0.34000000000000002}]},{"osd":4,"last update":"Wed Nov 8 19:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.68799999999999994,"15min":0.71799999999999997},"min":{"1min":0.44,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.98799999999999999,"5min":4.0090000000000003,"15min":4.0090000000000003},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.68899999999999995,"15min":0.73399999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.69099999999999995,"5min":4.1040000000000001,"15min":4.1040000000000001},"last":0.46500000000000002}]},{"osd":5,"last update":"Wed Nov 8 19:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.69299999999999995,"15min":0.74299999999999999},"min":{"1min":0.47999999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.874,"5min":4.0869999999999997,"15min":4.0869999999999997},"last":0.497},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.69599999999999995,"15min":0.746},"min":{"1min":0.435,"5min":0.433,"15min":0.433},"max":{"1min":0.78100000000000003,"5min":3.843,"15min":3.843},"last":0.56000000000000005}]},{"osd":6,"last update":"Wed Nov 8 19:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.70799999999999996,"15min":0.75900000000000001},"min":{"1min":0.45300000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.72699999999999998,"5min":4.1399999999999997,"15min":4.1399999999999997},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.68799999999999994,"15min":0.73399999999999999},"min":{"1min":0.49199999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.81499999999999995,"5min":4.0499999999999998,"15min":4.0499999999999998},"last":0.52500000000000002}]},{"osd":7,"last update":"Wed Nov 8 19:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.72799999999999998,"15min":0.76800000000000002},"min":{"1min":0.48799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.754,"5min":4.157,"15min":4.157},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.754,"15min":0.80000000000000004},"min":{"1min":0.505,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.93000000000000005,"5min":4.1710000000000003,"15min":4.1710000000000003},"last":0.54400000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574891,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":978944,"data_stored":468818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.38100000000000001,"15min":0.38500000000000001},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.64600000000000002,"5min":1.458,"15min":1.458},"last":0.373},{"interface":"front","average":{"1min":0.372,"5min":0.38900000000000001,"15min":0.39800000000000002},"min":{"1min":0.29499999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.53400000000000003,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.35699999999999998}]},{"osd":1,"last update":"Wed Nov 8 19:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.40500000000000003,"15min":0.41099999999999998},"min":{"1min":0.29599999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.61199999999999999,"5min":1.512,"15min":1.512},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.435,"15min":0.44700000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.59999999999999998,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.32500000000000001}]},{"osd":2,"last update":"Wed Nov 8 19:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.371,"15min":0.376},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.54800000000000004,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.41899999999999998,"15min":0.42699999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.60899999999999999,"5min":1.536,"15min":1.536},"last":0.42799999999999999}]},{"osd":4,"last update":"Wed Nov 8 19:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.60799999999999998,"15min":0.62},"min":{"1min":0.44900000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.77000000000000002,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.61299999999999999,"15min":0.61099999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.80200000000000005,"5min":1.153,"15min":1.153},"last":0.70399999999999996}]},{"osd":5,"last update":"Wed Nov 8 19:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.58899999999999997,"15min":0.59099999999999997},"min":{"1min":0.42399999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.69599999999999995,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.58899999999999997,"15min":0.60299999999999998},"min":{"1min":0.39300000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.73699999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.56899999999999995}]},{"osd":6,"last update":"Wed Nov 8 19:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57399999999999995,"15min":0.57999999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78500000000000003,"5min":1.113,"15min":1.113},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60799999999999998,"15min":0.61199999999999999},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72299999999999998,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.58599999999999997}]},{"osd":7,"last update":"Wed Nov 8 19:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.63500000000000001,"15min":0.64700000000000002},"min":{"1min":0.433,"5min":0.432,"15min":0.432},"max":{"1min":0.73999999999999999,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.62,"15min":0.61799999999999999},"min":{"1min":0.46300000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.754,"5min":1.179,"15min":1.179},"last":0.75600000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574891,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":978944,"data_stored":468818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:25:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.54500000000000004,"15min":0.53800000000000003},"min":{"1min":0.36799999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.80100000000000005,"5min":1.399,"15min":1.399},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58499999999999996,"15min":0.59499999999999997},"min":{"1min":0.44400000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73499999999999999,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.63500000000000001}]},{"osd":1,"last update":"Wed Nov 8 19:25:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.51400000000000001,"15min":0.51100000000000001},"min":{"1min":0.42199999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.502,"15min":0.497},"min":{"1min":0.40999999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.61799999999999999}]},{"osd":2,"last update":"Wed Nov 8 19:25:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.61899999999999999,"15min":0.63500000000000001},"min":{"1min":0.38200000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.80800000000000005,"5min":2.8490000000000002,"15min":2.8490000000000002},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.53800000000000003,"15min":0.52400000000000002},"min":{"1min":0.40799999999999997,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.71799999999999997,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.47199999999999998}]},{"osd":3,"last update":"Wed Nov 8 19:25:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57799999999999996,"15min":0.56599999999999995},"min":{"1min":0.47099999999999997,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.75700000000000001,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.70099999999999996,"15min":0.72399999999999998},"min":{"1min":0.48299999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.83199999999999996,"5min":3.4849999999999999,"15min":3.4849999999999999},"last":0.66600000000000004}]},{"osd":5,"last update":"Wed Nov 8 19:25:59 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.51800000000000002,"15min":0.52000000000000002},"min":{"1min":0.38,"5min":0.313,"15min":0.313},"max":{"1min":0.67200000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.56899999999999995,"15min":0.56100000000000005},"min":{"1min":0.39700000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.79100000000000004,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.65000000000000002}]},{"osd":6,"last update":"Wed Nov 8 19:25:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.67300000000000004,"15min":0.71499999999999997},"min":{"1min":0.38,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.71599999999999997,"5min":4.1529999999999996,"15min":4.1529999999999996},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.624,"5min":0.61599999999999999,"15min":0.61399999999999999},"min":{"1min":0.41699999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.73999999999999999,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.59999999999999998}]},{"osd":7,"last update":"Wed Nov 8 19:25:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57399999999999995,"15min":0.57199999999999995},"min":{"1min":0.47399999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.69999999999999996,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.80200000000000005,"15min":0.85199999999999998},"min":{"1min":0.52700000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.83899999999999997,"5min":5.5359999999999996,"15min":5.5359999999999996},"last":0.68700000000000006}]}]},{"osd":5,"up_from":13,"seq":55834574891,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":978944,"data_stored":468818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53700000000000003,"15min":0.54700000000000004},"min":{"1min":0.40600000000000003,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.63800000000000001,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":0.44},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.52500000000000002,"15min":0.51900000000000002},"min":{"1min":0.32800000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.68799999999999994,"5min":0.878,"15min":0.878},"last":0.26900000000000002}]},{"osd":1,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55300000000000005,"15min":0.54700000000000004},"min":{"1min":0.47199999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.68200000000000005,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.59299999999999997,"15min":0.60699999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.73899999999999999,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":0.32200000000000001}]},{"osd":2,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.34699999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.65300000000000002,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.53600000000000003,"15min":0.53000000000000003},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.70699999999999996,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.29699999999999999}]},{"osd":3,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.41299999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71799999999999997,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57699999999999996,"15min":0.57299999999999995},"min":{"1min":0.42199999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.73599999999999999,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.48599999999999999}]},{"osd":4,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.57499999999999996,"15min":0.59899999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.748,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.63700000000000001,"15min":0.63500000000000001},"min":{"1min":0.46500000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.77300000000000002,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.56100000000000005}]},{"osd":6,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.57899999999999996,"15min":0.57799999999999996},"min":{"1min":0.38200000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.73599999999999999,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.63800000000000001,"15min":0.66600000000000004},"min":{"1min":0.41799999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.80500000000000005,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":0.60399999999999998}]},{"osd":7,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.623,"15min":0.629},"min":{"1min":0.42499999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.82799999999999996,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.64200000000000002,"15min":0.64800000000000002},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.80700000000000005,"5min":0.873,"15min":0.873},"last":0.58599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:26:16.266 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:26:16.354 INFO:tasks.ceph.mds.a.smithi149.stderr:2023-11-08T19:26:16.351+0000 7f4e903b6700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-08T19:26:16.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.413+0000 7f8287845700 1 Processor -- start 2023-11-08T19:26:16.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.414+0000 7f8287845700 1 -- start start 2023-11-08T19:26:16.422 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.414+0000 7f8287845700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f82801624c0 0x7f828006bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:16.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.414+0000 7f8287845700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f82800cedf0 0x7f828006c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:16.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.414+0000 7f8287845700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f828006e2a0 con 0x7f8280066c80 2023-11-08T19:26:16.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.414+0000 7f8287845700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82800cc5c0 con 0x7f82800cedf0 2023-11-08T19:26:16.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.414+0000 7f8287845700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f828006d970 con 0x7f82801624c0 2023-11-08T19:26:16.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.414+0000 7f8284de0700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f8280066c80 0x7f82800ca630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:44468/0 (socket says 172.21.15.149:44468) 2023-11-08T19:26:16.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.414+0000 7f8284de0700 1 -- 172.21.15.149:0/2034821690 learned_addr learned my addr 172.21.15.149:0/2034821690 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:26:16.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.415+0000 7f82855e1700 1 --2- 172.21.15.149:0/2034821690 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f82801624c0 0x7f828006bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:16.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.415+0000 7f8285de2700 1 --2- 172.21.15.149:0/2034821690 >> v2:172.21.15.160:3300/0 conn(0x7f82800cedf0 0x7f828006c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:16.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.415+0000 7f8277fff700 1 -- 172.21.15.149:0/2034821690 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3477028465 0 0) 0x7f828006e2a0 con 0x7f8280066c80 2023-11-08T19:26:16.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.415+0000 7f8277fff700 1 -- 172.21.15.149:0/2034821690 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f826c0035b0 con 0x7f8280066c80 2023-11-08T19:26:16.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.415+0000 7f8277fff700 1 -- 172.21.15.149:0/2034821690 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1407644246 0 0) 0x7f826c0035b0 con 0x7f8280066c80 2023-11-08T19:26:16.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.415+0000 7f8277fff700 1 -- 172.21.15.149:0/2034821690 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f82801624c0 msgr2=0x7f828006bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:16.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.415+0000 7f8277fff700 1 --2- 172.21.15.149:0/2034821690 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f82801624c0 0x7f828006bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:16.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.415+0000 7f8277fff700 1 -- 172.21.15.149:0/2034821690 >> v2:172.21.15.160:3300/0 conn(0x7f82800cedf0 msgr2=0x7f828006c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:16.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.415+0000 7f8277fff700 1 --2- 172.21.15.149:0/2034821690 >> v2:172.21.15.160:3300/0 conn(0x7f82800cedf0 0x7f828006c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:16.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.415+0000 7f8277fff700 1 -- 172.21.15.149:0/2034821690 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f828006dc50 con 0x7f8280066c80 2023-11-08T19:26:16.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.415+0000 7f8277fff700 1 -- 172.21.15.149:0/2034821690 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f827c001670 con 0x7f8280066c80 2023-11-08T19:26:16.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.415+0000 7f8277fff700 1 -- 172.21.15.149:0/2034821690 >> v1:172.21.15.149:6789/0 conn(0x7f8280066c80 legacy=0x7f82800ca630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:16.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.415+0000 7f8277fff700 1 --2- 172.21.15.149:0/2034821690 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f826c003a00 0x7f826c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:16.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.415+0000 7f8277fff700 1 --2- 172.21.15.149:0/2034821690 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f82801624c0 0x7f826c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:16.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.415+0000 7f8277fff700 1 --2- 172.21.15.149:0/2034821690 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f826c004d90 0x7f826c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:16.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.415+0000 7f8277fff700 1 -- 172.21.15.149:0/2034821690 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82800cc5c0 con 0x7f826c003a00 2023-11-08T19:26:16.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.415+0000 7f8277fff700 1 -- 172.21.15.149:0/2034821690 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f828006d970 con 0x7f826c004d90 2023-11-08T19:26:16.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.415+0000 7f8277fff700 1 -- 172.21.15.149:0/2034821690 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f826c00ba10 con 0x7f82801624c0 2023-11-08T19:26:16.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.415+0000 7f8285de2700 1 --2- 172.21.15.149:0/2034821690 >> v2:172.21.15.160:3300/0 conn(0x7f82800cedf0 0x7f828006c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:26:16.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.415+0000 7f82855e1700 1 --2- 172.21.15.149:0/2034821690 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f826c003a00 0x7f826c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:16.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.415+0000 7f8284de0700 1 --2- 172.21.15.149:0/2034821690 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f82801624c0 0x7f826c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:16.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.415+0000 7f8285de2700 1 --2- 172.21.15.149:0/2034821690 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f826c004d90 0x7f826c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:16.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.415+0000 7f82855e1700 1 -- 172.21.15.149:0/2034821690 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f82801624c0 msgr2=0x7f826c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:16.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.415+0000 7f82855e1700 1 --2- 172.21.15.149:0/2034821690 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f82801624c0 0x7f826c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:16.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.415+0000 7f82855e1700 1 -- 172.21.15.149:0/2034821690 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f826c004d90 msgr2=0x7f826c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:16.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.415+0000 7f82855e1700 1 --2- 172.21.15.149:0/2034821690 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f826c004d90 0x7f826c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:16.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.415+0000 7f82855e1700 1 -- 172.21.15.149:0/2034821690 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f826c0035b0 con 0x7f826c003a00 2023-11-08T19:26:16.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.416+0000 7f8284de0700 1 --2- 172.21.15.149:0/2034821690 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f82801624c0 0x7f826c004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:26:16.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.416+0000 7f8285de2700 1 --2- 172.21.15.149:0/2034821690 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f826c004d90 0x7f826c005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:26:16.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.416+0000 7f82855e1700 1 --2- 172.21.15.149:0/2034821690 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f826c003a00 0x7f826c003e20 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f8270009b60 tx=0x7f826c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ec9a328f4c87c44 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:16.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.416+0000 7f8277fff700 1 -- 172.21.15.149:0/2034821690 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827000e6c0 con 0x7f826c003a00 2023-11-08T19:26:16.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.416+0000 7f8277fff700 1 -- 172.21.15.149:0/2034821690 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f827000e820 con 0x7f826c003a00 2023-11-08T19:26:16.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.416+0000 7f8277fff700 1 -- 172.21.15.149:0/2034821690 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827000eb90 con 0x7f826c003a00 2023-11-08T19:26:16.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.416+0000 7f8287845700 1 -- 172.21.15.149:0/2034821690 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f826c003a00 msgr2=0x7f826c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:16.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.416+0000 7f8287845700 1 --2- 172.21.15.149:0/2034821690 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f826c003a00 0x7f826c003e20 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f8270009b60 tx=0x7f826c005880 comp rx=0 tx=0).stop 2023-11-08T19:26:16.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.416+0000 7f8285de2700 1 -- 172.21.15.149:0/2034821690 reap_dead start 2023-11-08T19:26:16.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.416+0000 7f8287845700 1 -- 172.21.15.149:0/2034821690 shutdown_connections 2023-11-08T19:26:16.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.416+0000 7f8287845700 1 -- 172.21.15.149:0/2034821690 >> 172.21.15.149:0/2034821690 conn(0x7f8280071720 msgr2=0x7f8280071b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:16.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.416+0000 7f8287845700 1 -- 172.21.15.149:0/2034821690 shutdown_connections 2023-11-08T19:26:16.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.417+0000 7f8287845700 1 -- 172.21.15.149:0/2034821690 wait complete. 2023-11-08T19:26:16.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.418+0000 7f8287845700 1 Processor -- start 2023-11-08T19:26:16.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.418+0000 7f8287845700 1 -- start start 2023-11-08T19:26:16.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.418+0000 7f8287845700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f826c003a00 0x7f828015df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:16.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.418+0000 7f8287845700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f828015e510 0x7f828006ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:16.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.418+0000 7f8287845700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f828015edb0 0x7f828015f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:16.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.418+0000 7f8287845700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f828015f770 con 0x7f828015edb0 2023-11-08T19:26:16.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.418+0000 7f8287845700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82801f7280 con 0x7f828015e510 2023-11-08T19:26:16.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.418+0000 7f8287845700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82801f6670 con 0x7f826c003a00 2023-11-08T19:26:16.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.419+0000 7f8285de2700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f828015edb0 0x7f828015f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:16.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.419+0000 7f8285de2700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f828015edb0 0x7f828015f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42480/0 (socket says 172.21.15.149:42480) 2023-11-08T19:26:16.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.419+0000 7f8285de2700 1 -- 172.21.15.149:0/893681426 learned_addr learned my addr 172.21.15.149:0/893681426 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:16.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.419+0000 7f8285de2700 1 -- 172.21.15.149:0/893681426 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f826c003a00 msgr2=0x7f828015df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:16.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.419+0000 7f8285de2700 1 --2- 172.21.15.149:0/893681426 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f826c003a00 0x7f828015df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:16.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.419+0000 7f8285de2700 1 -- 172.21.15.149:0/893681426 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f828015e510 msgr2=0x7f828006ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:16.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.419+0000 7f8285de2700 1 --2- 172.21.15.149:0/893681426 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f828015e510 0x7f828006ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:16.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.419+0000 7f8285de2700 1 -- 172.21.15.149:0/893681426 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82801f6950 con 0x7f828015edb0 2023-11-08T19:26:16.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.419+0000 7f8285de2700 1 --2- 172.21.15.149:0/893681426 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f828015edb0 0x7f828015f230 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f82800af260 tx=0x7f82780114b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:16.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.419+0000 7f8275ffb700 1 -- 172.21.15.149:0/893681426 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827800e070 con 0x7f828015edb0 2023-11-08T19:26:16.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.419+0000 7f8275ffb700 1 -- 172.21.15.149:0/893681426 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8278011ce0 con 0x7f828015edb0 2023-11-08T19:26:16.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.419+0000 7f8275ffb700 1 -- 172.21.15.149:0/893681426 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8278011e70 con 0x7f828015edb0 2023-11-08T19:26:16.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.419+0000 7f8287845700 1 -- 172.21.15.149:0/893681426 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82801f6c30 con 0x7f828015edb0 2023-11-08T19:26:16.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.419+0000 7f8287845700 1 -- 172.21.15.149:0/893681426 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82800af2f0 con 0x7f828015edb0 2023-11-08T19:26:16.438 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.420+0000 7f8287845700 1 -- 172.21.15.149:0/893681426 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82800745f0 con 0x7f828015edb0 2023-11-08T19:26:16.438 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.421+0000 7f8275ffb700 1 -- 172.21.15.149:0/893681426 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8278003a20 con 0x7f828015edb0 2023-11-08T19:26:16.439 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.421+0000 7f8275ffb700 1 --2- 172.21.15.149:0/893681426 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f826406af00 0x7f826406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:16.439 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.421+0000 7f82855e1700 1 --2- 172.21.15.149:0/893681426 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f826406af00 0x7f826406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:16.439 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.421+0000 7f8275ffb700 1 -- 172.21.15.149:0/893681426 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f8278089f80 con 0x7f828015edb0 2023-11-08T19:26:16.440 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.422+0000 7f82855e1700 1 --2- 172.21.15.149:0/893681426 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f826406af00 0x7f826406d3c0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f8270000c00 tx=0x7f8270013000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:16.440 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.426+0000 7f8275ffb700 1 -- 172.21.15.149:0/893681426 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f82780bcca0 con 0x7f828015edb0 2023-11-08T19:26:16.614 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.612+0000 7f8287845700 1 -- 172.21.15.149:0/893681426 --> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f828006df30 con 0x7f826406af00 2023-11-08T19:26:16.627 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.625+0000 7f8275ffb700 1 -- 172.21.15.149:0/893681426 <== mgr.4104 v2:172.21.15.149:6832/1929837472 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+523682 (secure 0 0 0) 0x7f827000fa20 con 0x7f826406af00 2023-11-08T19:26:16.633 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:26:16.638 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.630+0000 7f8287845700 1 -- 172.21.15.149:0/893681426 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f826406af00 msgr2=0x7f826406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:16.638 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.630+0000 7f8287845700 1 --2- 172.21.15.149:0/893681426 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f826406af00 0x7f826406d3c0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f8270000c00 tx=0x7f8270013000 comp rx=0 tx=0).stop 2023-11-08T19:26:16.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.630+0000 7f8287845700 1 -- 172.21.15.149:0/893681426 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f828015edb0 msgr2=0x7f828015f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:16.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.630+0000 7f8287845700 1 --2- 172.21.15.149:0/893681426 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f828015edb0 0x7f828015f230 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f82800af260 tx=0x7f82780114b0 comp rx=0 tx=0).stop 2023-11-08T19:26:16.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.630+0000 7f8287845700 1 -- 172.21.15.149:0/893681426 shutdown_connections 2023-11-08T19:26:16.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.630+0000 7f8287845700 1 --2- 172.21.15.149:0/893681426 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f826406af00 0x7f826406d3c0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:16.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.630+0000 7f8287845700 1 --2- 172.21.15.149:0/893681426 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f828015edb0 0x7f828015f230 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:16.640 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.630+0000 7f8287845700 1 --2- 172.21.15.149:0/893681426 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f826c003a00 0x7f828015df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:16.640 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.630+0000 7f8287845700 1 --2- 172.21.15.149:0/893681426 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f828015e510 0x7f828006ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:16.640 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.630+0000 7f8287845700 1 -- 172.21.15.149:0/893681426 >> 172.21.15.149:0/893681426 conn(0x7f8280071720 msgr2=0x7f82800ae240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:16.640 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.630+0000 7f8287845700 1 -- 172.21.15.149:0/893681426 shutdown_connections 2023-11-08T19:26:16.640 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.630+0000 7f8287845700 1 -- 172.21.15.149:0/893681426 wait complete. 2023-11-08T19:26:16.641 INFO:teuthology.orchestra.run.smithi149.stderr:dumped all 2023-11-08T19:26:16.644 INFO:teuthology.orchestra.run.smithi149.stdout:{"pg_ready":true,"pg_map":{"version":176,"stamp":"2023-11-08T19:26:16.028781+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590480,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":164,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":221,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225012,"kb_used_data":8852,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754749708,"statfs":{"total":773094113280,"available":772863700992,"internally_reserved":0,"allocated":9064448,"data_stored":4954891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.905889"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.132306+0000","last_change":"2023-11-08T19:26:11.132306+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.132306+0000","last_undegraded":"2023-11-08T19:26:11.132306+0000","last_fullsized":"2023-11-08T19:26:11.132306+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.130646+0000","last_change":"2023-11-08T19:26:11.130646+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.130646+0000","last_undegraded":"2023-11-08T19:26:11.130646+0000","last_fullsized":"2023-11-08T19:26:11.130646+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.134023+0000","last_change":"2023-11-08T19:26:11.134023+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.134023+0000","last_undegraded":"2023-11-08T19:26:11.134023+0000","last_fullsized":"2023-11-08T19:26:11.134023+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.158573+0000","last_change":"2023-11-08T19:26:12.159151+0000","last_active":"2023-11-08T19:26:13.158573+0000","last_peered":"2023-11-08T19:26:13.158573+0000","last_clean":"2023-11-08T19:26:13.158573+0000","last_became_active":"2023-11-08T19:26:12.158889+0000","last_became_peered":"2023-11-08T19:26:12.158889+0000","last_unstale":"2023-11-08T19:26:13.158573+0000","last_undegraded":"2023-11-08T19:26:13.158573+0000","last_fullsized":"2023-11-08T19:26:13.158573+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:40:48.988790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.157287+0000","last_change":"2023-11-08T19:26:12.159875+0000","last_active":"2023-11-08T19:26:13.157287+0000","last_peered":"2023-11-08T19:26:13.157287+0000","last_clean":"2023-11-08T19:26:13.157287+0000","last_became_active":"2023-11-08T19:26:12.159616+0000","last_became_peered":"2023-11-08T19:26:12.159616+0000","last_unstale":"2023-11-08T19:26:13.157287+0000","last_undegraded":"2023-11-08T19:26:13.157287+0000","last_fullsized":"2023-11-08T19:26:13.157287+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:31:03.813978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.131549+0000","last_change":"2023-11-08T19:26:11.131549+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.131549+0000","last_undegraded":"2023-11-08T19:26:11.131549+0000","last_fullsized":"2023-11-08T19:26:11.131549+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.158902+0000","last_change":"2023-11-08T19:26:12.163084+0000","last_active":"2023-11-08T19:26:13.158902+0000","last_peered":"2023-11-08T19:26:13.158902+0000","last_clean":"2023-11-08T19:26:13.158902+0000","last_became_active":"2023-11-08T19:26:12.162467+0000","last_became_peered":"2023-11-08T19:26:12.162467+0000","last_unstale":"2023-11-08T19:26:13.158902+0000","last_undegraded":"2023-11-08T19:26:13.158902+0000","last_fullsized":"2023-11-08T19:26:13.158902+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:15:38.428199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.130524+0000","last_change":"2023-11-08T19:26:11.130524+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.130524+0000","last_undegraded":"2023-11-08T19:26:11.130524+0000","last_fullsized":"2023-11-08T19:26:11.130524+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.132912+0000","last_change":"2023-11-08T19:26:11.132912+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.132912+0000","last_undegraded":"2023-11-08T19:26:11.132912+0000","last_fullsized":"2023-11-08T19:26:11.132912+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.132409+0000","last_change":"2023-11-08T19:26:11.132409+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.132409+0000","last_undegraded":"2023-11-08T19:26:11.132409+0000","last_fullsized":"2023-11-08T19:26:11.132409+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.157213+0000","last_change":"2023-11-08T19:26:12.171269+0000","last_active":"2023-11-08T19:26:13.157213+0000","last_peered":"2023-11-08T19:26:13.157213+0000","last_clean":"2023-11-08T19:26:13.157213+0000","last_became_active":"2023-11-08T19:26:12.171009+0000","last_became_peered":"2023-11-08T19:26:12.171009+0000","last_unstale":"2023-11-08T19:26:13.157213+0000","last_undegraded":"2023-11-08T19:26:13.157213+0000","last_fullsized":"2023-11-08T19:26:13.157213+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:19:17.065471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.132284+0000","last_change":"2023-11-08T19:26:11.132284+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.132284+0000","last_undegraded":"2023-11-08T19:26:11.132284+0000","last_fullsized":"2023-11-08T19:26:11.132284+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.131376+0000","last_change":"2023-11-08T19:26:11.131376+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.131376+0000","last_undegraded":"2023-11-08T19:26:11.131376+0000","last_fullsized":"2023-11-08T19:26:11.131376+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.157398+0000","last_change":"2023-11-08T19:26:12.171667+0000","last_active":"2023-11-08T19:26:13.157398+0000","last_peered":"2023-11-08T19:26:13.157398+0000","last_clean":"2023-11-08T19:26:13.157398+0000","last_became_active":"2023-11-08T19:26:12.169680+0000","last_became_peered":"2023-11-08T19:26:12.169680+0000","last_unstale":"2023-11-08T19:26:13.157398+0000","last_undegraded":"2023-11-08T19:26:13.157398+0000","last_fullsized":"2023-11-08T19:26:13.157398+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:04:11.614632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.158798+0000","last_change":"2023-11-08T19:26:12.168622+0000","last_active":"2023-11-08T19:26:13.158798+0000","last_peered":"2023-11-08T19:26:13.158798+0000","last_clean":"2023-11-08T19:26:13.158798+0000","last_became_active":"2023-11-08T19:26:12.168321+0000","last_became_peered":"2023-11-08T19:26:12.168321+0000","last_unstale":"2023-11-08T19:26:13.158798+0000","last_undegraded":"2023-11-08T19:26:13.158798+0000","last_fullsized":"2023-11-08T19:26:13.158798+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:45:37.194772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.132057+0000","last_change":"2023-11-08T19:26:11.132057+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.132057+0000","last_undegraded":"2023-11-08T19:26:11.132057+0000","last_fullsized":"2023-11-08T19:26:11.132057+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.130468+0000","last_change":"2023-11-08T19:26:11.130468+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.130468+0000","last_undegraded":"2023-11-08T19:26:11.130468+0000","last_fullsized":"2023-11-08T19:26:11.130468+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.f","version":"82'1","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.173319+0000","last_change":"2023-11-08T19:26:11.143492+0000","last_active":"2023-11-08T19:26:12.173319+0000","last_peered":"2023-11-08T19:26:12.173319+0000","last_clean":"2023-11-08T19:26:12.173319+0000","last_became_active":"2023-11-08T19:26:11.143296+0000","last_became_peered":"2023-11-08T19:26:11.143296+0000","last_unstale":"2023-11-08T19:26:12.173319+0000","last_undegraded":"2023-11-08T19:26:12.173319+0000","last_fullsized":"2023-11-08T19:26:12.173319+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:58:53.201963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.127738+0000","last_change":"2023-11-08T19:25:47.285071+0000","last_active":"2023-11-08T19:26:10.127738+0000","last_peered":"2023-11-08T19:26:10.127738+0000","last_clean":"2023-11-08T19:26:10.127738+0000","last_became_active":"2023-11-08T19:25:47.284788+0000","last_became_peered":"2023-11-08T19:25:47.284788+0000","last_unstale":"2023-11-08T19:26:10.127738+0000","last_undegraded":"2023-11-08T19:26:10.127738+0000","last_fullsized":"2023-11-08T19:26:10.127738+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:50:50.522780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":218,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.150652+0000","last_change":"2023-11-08T19:22:58.054283+0000","last_active":"2023-11-08T19:26:12.150652+0000","last_peered":"2023-11-08T19:26:12.150652+0000","last_clean":"2023-11-08T19:26:12.150652+0000","last_became_active":"2023-11-08T19:22:58.053337+0000","last_became_peered":"2023-11-08T19:22:58.053337+0000","last_unstale":"2023-11-08T19:26:12.150652+0000","last_undegraded":"2023-11-08T19:26:12.150652+0000","last_fullsized":"2023-11-08T19:26:12.150652+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:22:56.479654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:22:56.479654+0000","last_clean_scrub_stamp":"2023-11-08T19:22:56.479654+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:16:05.317001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.536896+0000","last_change":"2023-11-08T19:24:32.530665+0000","last_active":"2023-11-08T19:26:06.536896+0000","last_peered":"2023-11-08T19:26:06.536896+0000","last_clean":"2023-11-08T19:26:06.536896+0000","last_became_active":"2023-11-08T19:24:31.148363+0000","last_became_peered":"2023-11-08T19:24:31.148363+0000","last_unstale":"2023-11-08T19:26:06.536896+0000","last_undegraded":"2023-11-08T19:26:06.536896+0000","last_fullsized":"2023-11-08T19:26:06.536896+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:02:27.987795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075444200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.152384+0000","last_change":"2023-11-08T19:25:48.371346+0000","last_active":"2023-11-08T19:26:12.152384+0000","last_peered":"2023-11-08T19:26:12.152384+0000","last_clean":"2023-11-08T19:26:12.152384+0000","last_became_active":"2023-11-08T19:25:46.289470+0000","last_became_peered":"2023-11-08T19:25:46.289470+0000","last_unstale":"2023-11-08T19:26:12.152384+0000","last_undegraded":"2023-11-08T19:26:12.152384+0000","last_fullsized":"2023-11-08T19:26:12.152384+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:25:34.010085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000371219,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.128507+0000","last_change":"2023-11-08T19:26:10.128507+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.128507+0000","last_undegraded":"2023-11-08T19:26:10.128507+0000","last_fullsized":"2023-11-08T19:26:10.128507+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.656777+0000","last_change":"2023-11-08T19:25:47.283242+0000","last_active":"2023-11-08T19:26:06.656777+0000","last_peered":"2023-11-08T19:26:06.656777+0000","last_clean":"2023-11-08T19:26:06.656777+0000","last_became_active":"2023-11-08T19:25:47.282922+0000","last_became_peered":"2023-11-08T19:25:47.282922+0000","last_unstale":"2023-11-08T19:26:06.656777+0000","last_undegraded":"2023-11-08T19:26:06.656777+0000","last_fullsized":"2023-11-08T19:26:06.656777+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:26:23.400596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":48,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.126032+0000","last_change":"2023-11-08T19:24:32.544333+0000","last_active":"2023-11-08T19:26:10.126032+0000","last_peered":"2023-11-08T19:26:10.126032+0000","last_clean":"2023-11-08T19:26:10.126032+0000","last_became_active":"2023-11-08T19:24:31.138598+0000","last_became_peered":"2023-11-08T19:24:31.138598+0000","last_unstale":"2023-11-08T19:26:10.126032+0000","last_undegraded":"2023-11-08T19:26:10.126032+0000","last_fullsized":"2023-11-08T19:26:10.126032+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:11.860580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015114824000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.656459+0000","last_change":"2023-11-08T19:25:48.374357+0000","last_active":"2023-11-08T19:26:06.656459+0000","last_peered":"2023-11-08T19:26:06.656459+0000","last_clean":"2023-11-08T19:26:06.656459+0000","last_became_active":"2023-11-08T19:25:46.279007+0000","last_became_peered":"2023-11-08T19:25:46.279007+0000","last_unstale":"2023-11-08T19:26:06.656459+0000","last_undegraded":"2023-11-08T19:26:06.656459+0000","last_fullsized":"2023-11-08T19:26:06.656459+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:59:30.845191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036813240000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.127179+0000","last_change":"2023-11-08T19:26:10.127179+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.127179+0000","last_undegraded":"2023-11-08T19:26:10.127179+0000","last_fullsized":"2023-11-08T19:26:10.127179+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":19,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.655722+0000","last_change":"2023-11-08T19:25:47.285093+0000","last_active":"2023-11-08T19:26:06.655722+0000","last_peered":"2023-11-08T19:26:06.655722+0000","last_clean":"2023-11-08T19:26:06.655722+0000","last_became_active":"2023-11-08T19:25:47.284796+0000","last_became_peered":"2023-11-08T19:25:47.284796+0000","last_unstale":"2023-11-08T19:26:06.655722+0000","last_undegraded":"2023-11-08T19:26:06.655722+0000","last_fullsized":"2023-11-08T19:26:06.655722+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:46:36.504650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":48,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.126151+0000","last_change":"2023-11-08T19:24:32.544285+0000","last_active":"2023-11-08T19:26:10.126151+0000","last_peered":"2023-11-08T19:26:10.126151+0000","last_clean":"2023-11-08T19:26:10.126151+0000","last_became_active":"2023-11-08T19:24:31.142028+0000","last_became_peered":"2023-11-08T19:24:31.142028+0000","last_unstale":"2023-11-08T19:26:10.126151+0000","last_undegraded":"2023-11-08T19:26:10.126151+0000","last_fullsized":"2023-11-08T19:26:10.126151+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:01:24.198196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067537399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.125396+0000","last_change":"2023-11-08T19:25:48.372192+0000","last_active":"2023-11-08T19:26:10.125396+0000","last_peered":"2023-11-08T19:26:10.125396+0000","last_clean":"2023-11-08T19:26:10.125396+0000","last_became_active":"2023-11-08T19:25:46.288739+0000","last_became_peered":"2023-11-08T19:25:46.288739+0000","last_unstale":"2023-11-08T19:26:10.125396+0000","last_undegraded":"2023-11-08T19:26:10.125396+0000","last_fullsized":"2023-11-08T19:26:10.125396+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:45:04.839053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015057530000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.126826+0000","last_change":"2023-11-08T19:26:10.126826+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.126826+0000","last_undegraded":"2023-11-08T19:26:10.126826+0000","last_fullsized":"2023-11-08T19:26:10.126826+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.656592+0000","last_change":"2023-11-08T19:25:47.287920+0000","last_active":"2023-11-08T19:26:06.656592+0000","last_peered":"2023-11-08T19:26:06.656592+0000","last_clean":"2023-11-08T19:26:06.656592+0000","last_became_active":"2023-11-08T19:25:47.287494+0000","last_became_peered":"2023-11-08T19:25:47.287494+0000","last_unstale":"2023-11-08T19:26:06.656592+0000","last_undegraded":"2023-11-08T19:26:06.656592+0000","last_fullsized":"2023-11-08T19:26:06.656592+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:42:18.942062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":49,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.655728+0000","last_change":"2023-11-08T19:24:32.142836+0000","last_active":"2023-11-08T19:26:06.655728+0000","last_peered":"2023-11-08T19:26:06.655728+0000","last_clean":"2023-11-08T19:26:06.655728+0000","last_became_active":"2023-11-08T19:24:31.141367+0000","last_became_peered":"2023-11-08T19:24:31.141367+0000","last_unstale":"2023-11-08T19:26:06.655728+0000","last_undegraded":"2023-11-08T19:26:06.655728+0000","last_fullsized":"2023-11-08T19:26:06.655728+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:39.214888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001335136,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.126066+0000","last_change":"2023-11-08T19:25:48.372718+0000","last_active":"2023-11-08T19:26:10.126066+0000","last_peered":"2023-11-08T19:26:10.126066+0000","last_clean":"2023-11-08T19:26:10.126066+0000","last_became_active":"2023-11-08T19:25:46.289283+0000","last_became_peered":"2023-11-08T19:25:46.289283+0000","last_unstale":"2023-11-08T19:26:10.126066+0000","last_undegraded":"2023-11-08T19:26:10.126066+0000","last_fullsized":"2023-11-08T19:26:10.126066+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:15:51.881891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001274049,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.127425+0000","last_change":"2023-11-08T19:26:10.127425+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.127425+0000","last_undegraded":"2023-11-08T19:26:10.127425+0000","last_fullsized":"2023-11-08T19:26:10.127425+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":19,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.655831+0000","last_change":"2023-11-08T19:25:47.285353+0000","last_active":"2023-11-08T19:26:06.655831+0000","last_peered":"2023-11-08T19:26:06.655831+0000","last_clean":"2023-11-08T19:26:06.655831+0000","last_became_active":"2023-11-08T19:25:47.285075+0000","last_became_peered":"2023-11-08T19:25:47.285075+0000","last_unstale":"2023-11-08T19:26:06.655831+0000","last_undegraded":"2023-11-08T19:26:06.655831+0000","last_fullsized":"2023-11-08T19:26:06.655831+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:20:50.791463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":55,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.124563+0000","last_change":"2023-11-08T19:24:32.139885+0000","last_active":"2023-11-08T19:26:10.124563+0000","last_peered":"2023-11-08T19:26:10.124563+0000","last_clean":"2023-11-08T19:26:10.124563+0000","last_became_active":"2023-11-08T19:24:31.145329+0000","last_became_peered":"2023-11-08T19:24:31.145329+0000","last_unstale":"2023-11-08T19:26:10.124563+0000","last_undegraded":"2023-11-08T19:26:10.124563+0000","last_fullsized":"2023-11-08T19:26:10.124563+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:25:18.356784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049012999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.656819+0000","last_change":"2023-11-08T19:25:48.373848+0000","last_active":"2023-11-08T19:26:06.656819+0000","last_peered":"2023-11-08T19:26:06.656819+0000","last_clean":"2023-11-08T19:26:06.656819+0000","last_became_active":"2023-11-08T19:25:46.282174+0000","last_became_peered":"2023-11-08T19:25:46.282174+0000","last_unstale":"2023-11-08T19:26:06.656819+0000","last_undegraded":"2023-11-08T19:26:06.656819+0000","last_fullsized":"2023-11-08T19:26:06.656819+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:00:06.938052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000727792,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":3,"reported_epoch":81,"state":"creating+activating","last_fresh":"2023-11-08T19:26:11.130325+0000","last_change":"2023-11-08T19:26:11.130325+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.130325+0000","last_undegraded":"2023-11-08T19:26:11.130325+0000","last_fullsized":"2023-11-08T19:26:11.130325+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:26:26.007199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":["4","2"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.124963+0000","last_change":"2023-11-08T19:25:47.287677+0000","last_active":"2023-11-08T19:26:10.124963+0000","last_peered":"2023-11-08T19:26:10.124963+0000","last_clean":"2023-11-08T19:26:10.124963+0000","last_became_active":"2023-11-08T19:25:47.287419+0000","last_became_peered":"2023-11-08T19:25:47.287419+0000","last_unstale":"2023-11-08T19:26:10.124963+0000","last_undegraded":"2023-11-08T19:26:10.124963+0000","last_fullsized":"2023-11-08T19:26:10.124963+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:22:08.770702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":53,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.373729+0000","last_change":"2023-11-08T19:24:32.140880+0000","last_active":"2023-11-08T19:26:06.373729+0000","last_peered":"2023-11-08T19:26:06.373729+0000","last_clean":"2023-11-08T19:26:06.373729+0000","last_became_active":"2023-11-08T19:24:31.146063+0000","last_became_peered":"2023-11-08T19:24:31.146063+0000","last_unstale":"2023-11-08T19:26:06.373729+0000","last_undegraded":"2023-11-08T19:26:06.373729+0000","last_fullsized":"2023-11-08T19:26:06.373729+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:54:08.985813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089896300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.536953+0000","last_change":"2023-11-08T19:25:48.374690+0000","last_active":"2023-11-08T19:26:06.536953+0000","last_peered":"2023-11-08T19:26:06.536953+0000","last_clean":"2023-11-08T19:26:06.536953+0000","last_became_active":"2023-11-08T19:25:46.281986+0000","last_became_peered":"2023-11-08T19:25:46.281986+0000","last_unstale":"2023-11-08T19:26:06.536953+0000","last_undegraded":"2023-11-08T19:26:06.536953+0000","last_fullsized":"2023-11-08T19:26:06.536953+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:21:00.981136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003067771,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.122829+0000","last_change":"2023-11-08T19:26:10.122829+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.122829+0000","last_undegraded":"2023-11-08T19:26:10.122829+0000","last_fullsized":"2023-11-08T19:26:10.122829+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.152860+0000","last_change":"2023-11-08T19:25:47.287986+0000","last_active":"2023-11-08T19:26:12.152860+0000","last_peered":"2023-11-08T19:26:12.152860+0000","last_clean":"2023-11-08T19:26:12.152860+0000","last_became_active":"2023-11-08T19:25:47.287560+0000","last_became_peered":"2023-11-08T19:25:47.287560+0000","last_unstale":"2023-11-08T19:26:12.152860+0000","last_undegraded":"2023-11-08T19:26:12.152860+0000","last_fullsized":"2023-11-08T19:26:12.152860+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:35:31.433056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.537019+0000","last_change":"2023-11-08T19:24:32.530620+0000","last_active":"2023-11-08T19:26:06.537019+0000","last_peered":"2023-11-08T19:26:06.537019+0000","last_clean":"2023-11-08T19:26:06.537019+0000","last_became_active":"2023-11-08T19:24:31.144223+0000","last_became_peered":"2023-11-08T19:24:31.144223+0000","last_unstale":"2023-11-08T19:26:06.537019+0000","last_undegraded":"2023-11-08T19:26:06.537019+0000","last_fullsized":"2023-11-08T19:26:06.537019+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:01:25.647952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071879799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.373882+0000","last_change":"2023-11-08T19:25:48.285326+0000","last_active":"2023-11-08T19:26:06.373882+0000","last_peered":"2023-11-08T19:26:06.373882+0000","last_clean":"2023-11-08T19:26:06.373882+0000","last_became_active":"2023-11-08T19:25:46.278686+0000","last_became_peered":"2023-11-08T19:25:46.278686+0000","last_unstale":"2023-11-08T19:26:06.373882+0000","last_undegraded":"2023-11-08T19:26:06.373882+0000","last_fullsized":"2023-11-08T19:26:06.373882+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:25:34.010085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078409499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.159113+0000","last_change":"2023-11-08T19:26:12.163265+0000","last_active":"2023-11-08T19:26:13.159113+0000","last_peered":"2023-11-08T19:26:13.159113+0000","last_clean":"2023-11-08T19:26:13.159113+0000","last_became_active":"2023-11-08T19:26:12.162822+0000","last_became_peered":"2023-11-08T19:26:12.162822+0000","last_unstale":"2023-11-08T19:26:13.159113+0000","last_undegraded":"2023-11-08T19:26:13.159113+0000","last_fullsized":"2023-11-08T19:26:13.159113+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:45:22.870353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.129895+0000","last_change":"2023-11-08T19:26:10.129895+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.129895+0000","last_undegraded":"2023-11-08T19:26:10.129895+0000","last_fullsized":"2023-11-08T19:26:10.129895+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":20,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.373428+0000","last_change":"2023-11-08T19:25:47.289726+0000","last_active":"2023-11-08T19:26:06.373428+0000","last_peered":"2023-11-08T19:26:06.373428+0000","last_clean":"2023-11-08T19:26:06.373428+0000","last_became_active":"2023-11-08T19:25:47.289362+0000","last_became_peered":"2023-11-08T19:25:47.289362+0000","last_unstale":"2023-11-08T19:26:06.373428+0000","last_undegraded":"2023-11-08T19:26:06.373428+0000","last_fullsized":"2023-11-08T19:26:06.373428+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:38:55.785104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.152547+0000","last_change":"2023-11-08T19:24:32.147025+0000","last_active":"2023-11-08T19:26:12.152547+0000","last_peered":"2023-11-08T19:26:12.152547+0000","last_clean":"2023-11-08T19:26:12.152547+0000","last_became_active":"2023-11-08T19:24:31.147082+0000","last_became_peered":"2023-11-08T19:24:31.147082+0000","last_unstale":"2023-11-08T19:26:12.152547+0000","last_undegraded":"2023-11-08T19:26:12.152547+0000","last_fullsized":"2023-11-08T19:26:12.152547+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:02:27.987795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043701599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.537040+0000","last_change":"2023-11-08T19:25:48.374739+0000","last_active":"2023-11-08T19:26:06.537040+0000","last_peered":"2023-11-08T19:26:06.537040+0000","last_clean":"2023-11-08T19:26:06.537040+0000","last_became_active":"2023-11-08T19:25:46.282071+0000","last_became_peered":"2023-11-08T19:25:46.282071+0000","last_unstale":"2023-11-08T19:26:06.537040+0000","last_undegraded":"2023-11-08T19:26:06.537040+0000","last_fullsized":"2023-11-08T19:26:06.537040+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:42:47.677504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023654909999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.128081+0000","last_change":"2023-11-08T19:26:10.128081+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.128081+0000","last_undegraded":"2023-11-08T19:26:10.128081+0000","last_fullsized":"2023-11-08T19:26:10.128081+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":48,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.126115+0000","last_change":"2023-11-08T19:24:32.544063+0000","last_active":"2023-11-08T19:26:10.126115+0000","last_peered":"2023-11-08T19:26:10.126115+0000","last_clean":"2023-11-08T19:26:10.126115+0000","last_became_active":"2023-11-08T19:24:31.144795+0000","last_became_peered":"2023-11-08T19:24:31.144795+0000","last_unstale":"2023-11-08T19:26:10.126115+0000","last_undegraded":"2023-11-08T19:26:10.126115+0000","last_fullsized":"2023-11-08T19:26:10.126115+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:12:42.248307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01495431,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.372839+0000","last_change":"2023-11-08T19:25:48.283673+0000","last_active":"2023-11-08T19:26:06.372839+0000","last_peered":"2023-11-08T19:26:06.372839+0000","last_clean":"2023-11-08T19:26:06.372839+0000","last_became_active":"2023-11-08T19:25:46.285766+0000","last_became_peered":"2023-11-08T19:25:46.285766+0000","last_unstale":"2023-11-08T19:26:06.372839+0000","last_undegraded":"2023-11-08T19:26:06.372839+0000","last_fullsized":"2023-11-08T19:26:06.372839+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:46:35.498766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001756748,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.150819+0000","last_change":"2023-11-08T19:25:47.288301+0000","last_active":"2023-11-08T19:26:12.150819+0000","last_peered":"2023-11-08T19:26:12.150819+0000","last_clean":"2023-11-08T19:26:12.150819+0000","last_became_active":"2023-11-08T19:25:47.288027+0000","last_became_peered":"2023-11-08T19:25:47.288027+0000","last_unstale":"2023-11-08T19:26:12.150819+0000","last_undegraded":"2023-11-08T19:26:12.150819+0000","last_fullsized":"2023-11-08T19:26:12.150819+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:23:13.428596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.129880+0000","last_change":"2023-11-08T19:26:11.129880+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.129880+0000","last_undegraded":"2023-11-08T19:26:11.129880+0000","last_fullsized":"2023-11-08T19:26:11.129880+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.123109+0000","last_change":"2023-11-08T19:26:10.123109+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.123109+0000","last_undegraded":"2023-11-08T19:26:10.123109+0000","last_fullsized":"2023-11-08T19:26:10.123109+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":49,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.125528+0000","last_change":"2023-11-08T19:24:32.263810+0000","last_active":"2023-11-08T19:26:10.125528+0000","last_peered":"2023-11-08T19:26:10.125528+0000","last_clean":"2023-11-08T19:26:10.125528+0000","last_became_active":"2023-11-08T19:24:31.138814+0000","last_became_peered":"2023-11-08T19:24:31.138814+0000","last_unstale":"2023-11-08T19:26:10.125528+0000","last_undegraded":"2023-11-08T19:26:10.125528+0000","last_fullsized":"2023-11-08T19:26:10.125528+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:21:55.985548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048136000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.124329+0000","last_change":"2023-11-08T19:25:48.283572+0000","last_active":"2023-11-08T19:26:10.124329+0000","last_peered":"2023-11-08T19:26:10.124329+0000","last_clean":"2023-11-08T19:26:10.124329+0000","last_became_active":"2023-11-08T19:25:46.271936+0000","last_became_peered":"2023-11-08T19:25:46.271936+0000","last_unstale":"2023-11-08T19:26:10.124329+0000","last_undegraded":"2023-11-08T19:26:10.124329+0000","last_fullsized":"2023-11-08T19:26:10.124329+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:46:11.541748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00186835,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":20,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.372680+0000","last_change":"2023-11-08T19:25:47.282856+0000","last_active":"2023-11-08T19:26:06.372680+0000","last_peered":"2023-11-08T19:26:06.372680+0000","last_clean":"2023-11-08T19:26:06.372680+0000","last_became_active":"2023-11-08T19:25:47.282594+0000","last_became_peered":"2023-11-08T19:25:47.282594+0000","last_unstale":"2023-11-08T19:26:06.372680+0000","last_undegraded":"2023-11-08T19:26:06.372680+0000","last_fullsized":"2023-11-08T19:26:06.372680+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:14:12.111756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":3,"reported_epoch":81,"state":"creating+activating","last_fresh":"2023-11-08T19:26:11.131733+0000","last_change":"2023-11-08T19:26:11.131733+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.131733+0000","last_undegraded":"2023-11-08T19:26:11.131733+0000","last_fullsized":"2023-11-08T19:26:11.131733+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:23:55.641598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.656539+0000","last_change":"2023-11-08T19:24:32.333096+0000","last_active":"2023-11-08T19:26:06.656539+0000","last_peered":"2023-11-08T19:26:06.656539+0000","last_clean":"2023-11-08T19:26:06.656539+0000","last_became_active":"2023-11-08T19:24:31.142985+0000","last_became_peered":"2023-11-08T19:24:31.142985+0000","last_unstale":"2023-11-08T19:26:06.656539+0000","last_undegraded":"2023-11-08T19:26:06.656539+0000","last_fullsized":"2023-11-08T19:26:06.656539+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:36:33.274496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000386048,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.536827+0000","last_change":"2023-11-08T19:25:48.372963+0000","last_active":"2023-11-08T19:26:06.536827+0000","last_peered":"2023-11-08T19:26:06.536827+0000","last_clean":"2023-11-08T19:26:06.536827+0000","last_became_active":"2023-11-08T19:25:46.283263+0000","last_became_peered":"2023-11-08T19:25:46.283263+0000","last_unstale":"2023-11-08T19:26:06.536827+0000","last_undegraded":"2023-11-08T19:26:06.536827+0000","last_fullsized":"2023-11-08T19:26:06.536827+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:25:34.010085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019848779999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":19,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.655803+0000","last_change":"2023-11-08T19:25:47.284816+0000","last_active":"2023-11-08T19:26:06.655803+0000","last_peered":"2023-11-08T19:26:06.655803+0000","last_clean":"2023-11-08T19:26:06.655803+0000","last_became_active":"2023-11-08T19:25:47.284522+0000","last_became_peered":"2023-11-08T19:25:47.284522+0000","last_unstale":"2023-11-08T19:26:06.655803+0000","last_undegraded":"2023-11-08T19:26:06.655803+0000","last_fullsized":"2023-11-08T19:26:06.655803+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:39:28.223686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.129454+0000","last_change":"2023-11-08T19:26:10.129454+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.129454+0000","last_undegraded":"2023-11-08T19:26:10.129454+0000","last_fullsized":"2023-11-08T19:26:10.129454+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.536570+0000","last_change":"2023-11-08T19:24:32.530333+0000","last_active":"2023-11-08T19:26:06.536570+0000","last_peered":"2023-11-08T19:26:06.536570+0000","last_clean":"2023-11-08T19:26:06.536570+0000","last_became_active":"2023-11-08T19:24:31.144838+0000","last_became_peered":"2023-11-08T19:24:31.144838+0000","last_unstale":"2023-11-08T19:26:06.536570+0000","last_undegraded":"2023-11-08T19:26:06.536570+0000","last_fullsized":"2023-11-08T19:26:06.536570+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:39:48.473183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081588799999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.124486+0000","last_change":"2023-11-08T19:25:48.284699+0000","last_active":"2023-11-08T19:26:10.124486+0000","last_peered":"2023-11-08T19:26:10.124486+0000","last_clean":"2023-11-08T19:26:10.124486+0000","last_became_active":"2023-11-08T19:25:46.285588+0000","last_became_peered":"2023-11-08T19:25:46.285588+0000","last_unstale":"2023-11-08T19:26:10.124486+0000","last_undegraded":"2023-11-08T19:26:10.124486+0000","last_fullsized":"2023-11-08T19:26:10.124486+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:43:02.001903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023282350000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.536701+0000","last_change":"2023-11-08T19:25:47.283526+0000","last_active":"2023-11-08T19:26:06.536701+0000","last_peered":"2023-11-08T19:26:06.536701+0000","last_clean":"2023-11-08T19:26:06.536701+0000","last_became_active":"2023-11-08T19:25:47.283266+0000","last_became_peered":"2023-11-08T19:25:47.283266+0000","last_unstale":"2023-11-08T19:26:06.536701+0000","last_undegraded":"2023-11-08T19:26:06.536701+0000","last_fullsized":"2023-11-08T19:26:06.536701+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:35:31.433056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.127556+0000","last_change":"2023-11-08T19:26:10.127556+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.127556+0000","last_undegraded":"2023-11-08T19:26:10.127556+0000","last_fullsized":"2023-11-08T19:26:10.127556+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.657341+0000","last_change":"2023-11-08T19:24:32.333430+0000","last_active":"2023-11-08T19:26:06.657341+0000","last_peered":"2023-11-08T19:26:06.657341+0000","last_clean":"2023-11-08T19:26:06.657341+0000","last_became_active":"2023-11-08T19:24:31.141710+0000","last_became_peered":"2023-11-08T19:24:31.141710+0000","last_unstale":"2023-11-08T19:26:06.657341+0000","last_undegraded":"2023-11-08T19:26:06.657341+0000","last_fullsized":"2023-11-08T19:26:06.657341+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:32:51.214551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000430438,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.373255+0000","last_change":"2023-11-08T19:25:48.283855+0000","last_active":"2023-11-08T19:26:06.373255+0000","last_peered":"2023-11-08T19:26:06.373255+0000","last_clean":"2023-11-08T19:26:06.373255+0000","last_became_active":"2023-11-08T19:25:46.273336+0000","last_became_peered":"2023-11-08T19:25:46.273336+0000","last_unstale":"2023-11-08T19:26:06.373255+0000","last_undegraded":"2023-11-08T19:26:06.373255+0000","last_fullsized":"2023-11-08T19:26:06.373255+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:33:35.492889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092577200000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":20,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.373300+0000","last_change":"2023-11-08T19:25:47.282840+0000","last_active":"2023-11-08T19:26:06.373300+0000","last_peered":"2023-11-08T19:26:06.373300+0000","last_clean":"2023-11-08T19:26:06.373300+0000","last_became_active":"2023-11-08T19:25:47.282600+0000","last_became_peered":"2023-11-08T19:25:47.282600+0000","last_unstale":"2023-11-08T19:26:06.373300+0000","last_undegraded":"2023-11-08T19:26:06.373300+0000","last_fullsized":"2023-11-08T19:26:06.373300+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:53:37.482245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.131449+0000","last_change":"2023-11-08T19:26:11.131449+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.131449+0000","last_undegraded":"2023-11-08T19:26:11.131449+0000","last_fullsized":"2023-11-08T19:26:11.131449+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.127954+0000","last_change":"2023-11-08T19:26:10.127954+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.127954+0000","last_undegraded":"2023-11-08T19:26:10.127954+0000","last_fullsized":"2023-11-08T19:26:10.127954+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.124849+0000","last_change":"2023-11-08T19:25:47.285890+0000","last_active":"2023-11-08T19:26:10.124849+0000","last_peered":"2023-11-08T19:26:10.124849+0000","last_clean":"2023-11-08T19:26:10.124849+0000","last_became_active":"2023-11-08T19:25:47.285641+0000","last_became_peered":"2023-11-08T19:25:47.285641+0000","last_unstale":"2023-11-08T19:26:10.124849+0000","last_undegraded":"2023-11-08T19:26:10.124849+0000","last_fullsized":"2023-11-08T19:26:10.124849+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:27:18.335142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.536846+0000","last_change":"2023-11-08T19:24:32.530895+0000","last_active":"2023-11-08T19:26:06.536846+0000","last_peered":"2023-11-08T19:26:06.536846+0000","last_clean":"2023-11-08T19:26:06.536846+0000","last_became_active":"2023-11-08T19:24:31.146715+0000","last_became_peered":"2023-11-08T19:24:31.146715+0000","last_unstale":"2023-11-08T19:26:06.536846+0000","last_undegraded":"2023-11-08T19:26:06.536846+0000","last_fullsized":"2023-11-08T19:26:06.536846+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:39.214888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081671599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.373444+0000","last_change":"2023-11-08T19:25:48.284137+0000","last_active":"2023-11-08T19:26:06.373444+0000","last_peered":"2023-11-08T19:26:06.373444+0000","last_clean":"2023-11-08T19:26:06.373444+0000","last_became_active":"2023-11-08T19:25:46.285960+0000","last_became_peered":"2023-11-08T19:25:46.285960+0000","last_unstale":"2023-11-08T19:26:06.373444+0000","last_undegraded":"2023-11-08T19:26:06.373444+0000","last_fullsized":"2023-11-08T19:26:06.373444+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:26:01.141206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091649099999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.130517+0000","last_change":"2023-11-08T19:26:11.130517+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.130517+0000","last_undegraded":"2023-11-08T19:26:11.130517+0000","last_fullsized":"2023-11-08T19:26:11.130517+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.128682+0000","last_change":"2023-11-08T19:26:10.128682+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.128682+0000","last_undegraded":"2023-11-08T19:26:10.128682+0000","last_fullsized":"2023-11-08T19:26:10.128682+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.125287+0000","last_change":"2023-11-08T19:25:47.283642+0000","last_active":"2023-11-08T19:26:10.125287+0000","last_peered":"2023-11-08T19:26:10.125287+0000","last_clean":"2023-11-08T19:26:10.125287+0000","last_became_active":"2023-11-08T19:25:47.283360+0000","last_became_peered":"2023-11-08T19:25:47.283360+0000","last_unstale":"2023-11-08T19:26:10.125287+0000","last_undegraded":"2023-11-08T19:26:10.125287+0000","last_fullsized":"2023-11-08T19:26:10.125287+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:02:27.950152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":53,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.373531+0000","last_change":"2023-11-08T19:24:32.140167+0000","last_active":"2023-11-08T19:26:06.373531+0000","last_peered":"2023-11-08T19:26:06.373531+0000","last_clean":"2023-11-08T19:26:06.373531+0000","last_became_active":"2023-11-08T19:24:31.147181+0000","last_became_peered":"2023-11-08T19:24:31.147181+0000","last_unstale":"2023-11-08T19:26:06.373531+0000","last_undegraded":"2023-11-08T19:26:06.373531+0000","last_fullsized":"2023-11-08T19:26:06.373531+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:26.080042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057135200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.126009+0000","last_change":"2023-11-08T19:25:48.277705+0000","last_active":"2023-11-08T19:26:10.126009+0000","last_peered":"2023-11-08T19:26:10.126009+0000","last_clean":"2023-11-08T19:26:10.126009+0000","last_became_active":"2023-11-08T19:25:46.288848+0000","last_became_peered":"2023-11-08T19:25:46.288848+0000","last_unstale":"2023-11-08T19:26:10.126009+0000","last_undegraded":"2023-11-08T19:26:10.126009+0000","last_fullsized":"2023-11-08T19:26:10.126009+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:12:24.483185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097653099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.124238+0000","last_change":"2023-11-08T19:26:10.124238+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.124238+0000","last_undegraded":"2023-11-08T19:26:10.124238+0000","last_fullsized":"2023-11-08T19:26:10.124238+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.152208+0000","last_change":"2023-11-08T19:25:47.289456+0000","last_active":"2023-11-08T19:26:12.152208+0000","last_peered":"2023-11-08T19:26:12.152208+0000","last_clean":"2023-11-08T19:26:12.152208+0000","last_became_active":"2023-11-08T19:25:47.289177+0000","last_became_peered":"2023-11-08T19:25:47.289177+0000","last_unstale":"2023-11-08T19:26:12.152208+0000","last_undegraded":"2023-11-08T19:26:12.152208+0000","last_fullsized":"2023-11-08T19:26:12.152208+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:07:11.838364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":53,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.373110+0000","last_change":"2023-11-08T19:24:32.141188+0000","last_active":"2023-11-08T19:26:06.373110+0000","last_peered":"2023-11-08T19:26:06.373110+0000","last_clean":"2023-11-08T19:26:06.373110+0000","last_became_active":"2023-11-08T19:24:31.148857+0000","last_became_peered":"2023-11-08T19:24:31.148857+0000","last_unstale":"2023-11-08T19:26:06.373110+0000","last_undegraded":"2023-11-08T19:26:06.373110+0000","last_fullsized":"2023-11-08T19:26:06.373110+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:45:34.425432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065078599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.126285+0000","last_change":"2023-11-08T19:25:48.277423+0000","last_active":"2023-11-08T19:26:10.126285+0000","last_peered":"2023-11-08T19:26:10.126285+0000","last_clean":"2023-11-08T19:26:10.126285+0000","last_became_active":"2023-11-08T19:25:46.286211+0000","last_became_peered":"2023-11-08T19:25:46.286211+0000","last_unstale":"2023-11-08T19:26:10.126285+0000","last_undegraded":"2023-11-08T19:26:10.126285+0000","last_fullsized":"2023-11-08T19:26:10.126285+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:44:05.347800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073775700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-08T19:26:11.139671+0000","last_change":"2023-11-08T19:26:11.139671+0000","last_active":"2023-11-08T19:26:11.139671+0000","last_peered":"2023-11-08T19:26:11.139671+0000","last_clean":"2023-11-08T19:26:11.139671+0000","last_became_active":"2023-11-08T19:26:11.139289+0000","last_became_peered":"2023-11-08T19:26:11.139289+0000","last_unstale":"2023-11-08T19:26:11.139671+0000","last_undegraded":"2023-11-08T19:26:11.139671+0000","last_fullsized":"2023-11-08T19:26:11.139671+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:02:51.810261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.150500+0000","last_change":"2023-11-08T19:25:47.286020+0000","last_active":"2023-11-08T19:26:12.150500+0000","last_peered":"2023-11-08T19:26:12.150500+0000","last_clean":"2023-11-08T19:26:12.150500+0000","last_became_active":"2023-11-08T19:25:47.285728+0000","last_became_peered":"2023-11-08T19:25:47.285728+0000","last_unstale":"2023-11-08T19:26:12.150500+0000","last_undegraded":"2023-11-08T19:26:12.150500+0000","last_fullsized":"2023-11-08T19:26:12.150500+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:26:02.147090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":53,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.372699+0000","last_change":"2023-11-08T19:24:32.140832+0000","last_active":"2023-11-08T19:26:06.372699+0000","last_peered":"2023-11-08T19:26:06.372699+0000","last_clean":"2023-11-08T19:26:06.372699+0000","last_became_active":"2023-11-08T19:24:31.146557+0000","last_became_peered":"2023-11-08T19:24:31.146557+0000","last_unstale":"2023-11-08T19:26:06.372699+0000","last_undegraded":"2023-11-08T19:26:06.372699+0000","last_fullsized":"2023-11-08T19:26:06.372699+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:40:04.258107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099450100000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.536509+0000","last_change":"2023-11-08T19:25:48.372913+0000","last_active":"2023-11-08T19:26:06.536509+0000","last_peered":"2023-11-08T19:26:06.536509+0000","last_clean":"2023-11-08T19:26:06.536509+0000","last_became_active":"2023-11-08T19:25:46.281273+0000","last_became_peered":"2023-11-08T19:25:46.281273+0000","last_unstale":"2023-11-08T19:26:06.536509+0000","last_undegraded":"2023-11-08T19:26:06.536509+0000","last_fullsized":"2023-11-08T19:26:06.536509+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:07:10.832480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020904819999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.158343+0000","last_change":"2023-11-08T19:26:12.160942+0000","last_active":"2023-11-08T19:26:13.158343+0000","last_peered":"2023-11-08T19:26:13.158343+0000","last_clean":"2023-11-08T19:26:13.158343+0000","last_became_active":"2023-11-08T19:26:12.160665+0000","last_became_peered":"2023-11-08T19:26:12.160665+0000","last_unstale":"2023-11-08T19:26:13.158343+0000","last_undegraded":"2023-11-08T19:26:13.158343+0000","last_fullsized":"2023-11-08T19:26:13.158343+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:32:26.592331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.130327+0000","last_change":"2023-11-08T19:26:10.130327+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.130327+0000","last_undegraded":"2023-11-08T19:26:10.130327+0000","last_fullsized":"2023-11-08T19:26:10.130327+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.125554+0000","last_change":"2023-11-08T19:25:47.288256+0000","last_active":"2023-11-08T19:26:10.125554+0000","last_peered":"2023-11-08T19:26:10.125554+0000","last_clean":"2023-11-08T19:26:10.125554+0000","last_became_active":"2023-11-08T19:25:47.287905+0000","last_became_peered":"2023-11-08T19:25:47.287905+0000","last_unstale":"2023-11-08T19:26:10.125554+0000","last_undegraded":"2023-11-08T19:26:10.125554+0000","last_fullsized":"2023-11-08T19:26:10.125554+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:50:12.309248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.536919+0000","last_change":"2023-11-08T19:24:32.530378+0000","last_active":"2023-11-08T19:26:06.536919+0000","last_peered":"2023-11-08T19:26:06.536919+0000","last_clean":"2023-11-08T19:26:06.536919+0000","last_became_active":"2023-11-08T19:24:31.144341+0000","last_became_peered":"2023-11-08T19:24:31.144341+0000","last_unstale":"2023-11-08T19:26:06.536919+0000","last_undegraded":"2023-11-08T19:26:06.536919+0000","last_fullsized":"2023-11-08T19:26:06.536919+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:30:21.946303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058308299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.125107+0000","last_change":"2023-11-08T19:25:48.277150+0000","last_active":"2023-11-08T19:26:10.125107+0000","last_peered":"2023-11-08T19:26:10.125107+0000","last_clean":"2023-11-08T19:26:10.125107+0000","last_became_active":"2023-11-08T19:25:46.286933+0000","last_became_peered":"2023-11-08T19:25:46.286933+0000","last_unstale":"2023-11-08T19:26:10.125107+0000","last_undegraded":"2023-11-08T19:26:10.125107+0000","last_fullsized":"2023-11-08T19:26:10.125107+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:38:38.890354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080507500000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.131349+0000","last_change":"2023-11-08T19:26:11.131349+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.131349+0000","last_undegraded":"2023-11-08T19:26:11.131349+0000","last_fullsized":"2023-11-08T19:26:11.131349+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.123041+0000","last_change":"2023-11-08T19:26:10.123041+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.123041+0000","last_undegraded":"2023-11-08T19:26:10.123041+0000","last_fullsized":"2023-11-08T19:26:10.123041+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.125333+0000","last_change":"2023-11-08T19:25:47.282986+0000","last_active":"2023-11-08T19:26:10.125333+0000","last_peered":"2023-11-08T19:26:10.125333+0000","last_clean":"2023-11-08T19:26:10.125333+0000","last_became_active":"2023-11-08T19:25:47.282705+0000","last_became_peered":"2023-11-08T19:25:47.282705+0000","last_unstale":"2023-11-08T19:26:10.125333+0000","last_undegraded":"2023-11-08T19:26:10.125333+0000","last_fullsized":"2023-11-08T19:26:10.125333+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:34:17.838942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":48,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.125645+0000","last_change":"2023-11-08T19:24:32.544108+0000","last_active":"2023-11-08T19:26:10.125645+0000","last_peered":"2023-11-08T19:26:10.125645+0000","last_clean":"2023-11-08T19:26:10.125645+0000","last_became_active":"2023-11-08T19:24:31.143812+0000","last_became_peered":"2023-11-08T19:24:31.143812+0000","last_unstale":"2023-11-08T19:26:10.125645+0000","last_undegraded":"2023-11-08T19:26:10.125645+0000","last_fullsized":"2023-11-08T19:26:10.125645+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:27:59.135977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014956126,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.124568+0000","last_change":"2023-11-08T19:25:48.284435+0000","last_active":"2023-11-08T19:26:10.124568+0000","last_peered":"2023-11-08T19:26:10.124568+0000","last_clean":"2023-11-08T19:26:10.124568+0000","last_became_active":"2023-11-08T19:25:46.284288+0000","last_became_peered":"2023-11-08T19:25:46.284288+0000","last_unstale":"2023-11-08T19:26:10.124568+0000","last_undegraded":"2023-11-08T19:26:10.124568+0000","last_fullsized":"2023-11-08T19:26:10.124568+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:57:53.083448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001250894,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.129291+0000","last_change":"2023-11-08T19:26:11.129291+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.129291+0000","last_undegraded":"2023-11-08T19:26:11.129291+0000","last_fullsized":"2023-11-08T19:26:11.129291+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":3,"reported_epoch":81,"state":"creating+activating","last_fresh":"2023-11-08T19:26:11.130995+0000","last_change":"2023-11-08T19:26:11.130995+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.130995+0000","last_undegraded":"2023-11-08T19:26:11.130995+0000","last_fullsized":"2023-11-08T19:26:11.130995+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:58:17.949441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.124612+0000","last_change":"2023-11-08T19:25:47.282612+0000","last_active":"2023-11-08T19:26:10.124612+0000","last_peered":"2023-11-08T19:26:10.124612+0000","last_clean":"2023-11-08T19:26:10.124612+0000","last_became_active":"2023-11-08T19:25:47.282299+0000","last_became_peered":"2023-11-08T19:25:47.282299+0000","last_unstale":"2023-11-08T19:26:10.124612+0000","last_undegraded":"2023-11-08T19:26:10.124612+0000","last_fullsized":"2023-11-08T19:26:10.124612+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:43:18.319773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.151613+0000","last_change":"2023-11-08T19:24:32.146639+0000","last_active":"2023-11-08T19:26:12.151613+0000","last_peered":"2023-11-08T19:26:12.151613+0000","last_clean":"2023-11-08T19:26:12.151613+0000","last_became_active":"2023-11-08T19:24:31.147384+0000","last_became_peered":"2023-11-08T19:24:31.147384+0000","last_unstale":"2023-11-08T19:26:12.151613+0000","last_undegraded":"2023-11-08T19:26:12.151613+0000","last_fullsized":"2023-11-08T19:26:12.151613+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:30:21.946303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043834899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.124395+0000","last_change":"2023-11-08T19:25:48.283541+0000","last_active":"2023-11-08T19:26:10.124395+0000","last_peered":"2023-11-08T19:26:10.124395+0000","last_clean":"2023-11-08T19:26:10.124395+0000","last_became_active":"2023-11-08T19:25:46.285626+0000","last_became_peered":"2023-11-08T19:25:46.285626+0000","last_unstale":"2023-11-08T19:26:10.124395+0000","last_undegraded":"2023-11-08T19:26:10.124395+0000","last_fullsized":"2023-11-08T19:26:10.124395+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:48:17.033319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019032459999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.131450+0000","last_change":"2023-11-08T19:26:10.131450+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.131450+0000","last_undegraded":"2023-11-08T19:26:10.131450+0000","last_fullsized":"2023-11-08T19:26:10.131450+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":20,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.373197+0000","last_change":"2023-11-08T19:25:47.287878+0000","last_active":"2023-11-08T19:26:06.373197+0000","last_peered":"2023-11-08T19:26:06.373197+0000","last_clean":"2023-11-08T19:26:06.373197+0000","last_became_active":"2023-11-08T19:25:47.287617+0000","last_became_peered":"2023-11-08T19:25:47.287617+0000","last_unstale":"2023-11-08T19:26:06.373197+0000","last_undegraded":"2023-11-08T19:26:06.373197+0000","last_fullsized":"2023-11-08T19:26:06.373197+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:20:50.791463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":55,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.125379+0000","last_change":"2023-11-08T19:24:32.142376+0000","last_active":"2023-11-08T19:26:10.125379+0000","last_peered":"2023-11-08T19:26:10.125379+0000","last_clean":"2023-11-08T19:26:10.125379+0000","last_became_active":"2023-11-08T19:24:31.144614+0000","last_became_peered":"2023-11-08T19:24:31.144614+0000","last_unstale":"2023-11-08T19:26:10.125379+0000","last_undegraded":"2023-11-08T19:26:10.125379+0000","last_fullsized":"2023-11-08T19:26:10.125379+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:09:04.880374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050362200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.537032+0000","last_change":"2023-11-08T19:25:48.373636+0000","last_active":"2023-11-08T19:26:06.537032+0000","last_peered":"2023-11-08T19:26:06.537032+0000","last_clean":"2023-11-08T19:26:06.537032+0000","last_became_active":"2023-11-08T19:25:46.283803+0000","last_became_peered":"2023-11-08T19:25:46.283803+0000","last_unstale":"2023-11-08T19:26:06.537032+0000","last_undegraded":"2023-11-08T19:26:06.537032+0000","last_fullsized":"2023-11-08T19:26:06.537032+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:00:34.691748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002404855,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.131315+0000","last_change":"2023-11-08T19:26:11.131315+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.131315+0000","last_undegraded":"2023-11-08T19:26:11.131315+0000","last_fullsized":"2023-11-08T19:26:11.131315+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"82'1","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.171188+0000","last_change":"2023-11-08T19:26:11.143541+0000","last_active":"2023-11-08T19:26:12.171188+0000","last_peered":"2023-11-08T19:26:12.171188+0000","last_clean":"2023-11-08T19:26:12.171188+0000","last_became_active":"2023-11-08T19:26:11.143255+0000","last_became_peered":"2023-11-08T19:26:11.143255+0000","last_unstale":"2023-11-08T19:26:12.171188+0000","last_undegraded":"2023-11-08T19:26:12.171188+0000","last_fullsized":"2023-11-08T19:26:12.171188+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:19:00.174837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.152295+0000","last_change":"2023-11-08T19:25:47.287741+0000","last_active":"2023-11-08T19:26:12.152295+0000","last_peered":"2023-11-08T19:26:12.152295+0000","last_clean":"2023-11-08T19:26:12.152295+0000","last_became_active":"2023-11-08T19:25:47.287428+0000","last_became_peered":"2023-11-08T19:25:47.287428+0000","last_unstale":"2023-11-08T19:26:12.152295+0000","last_undegraded":"2023-11-08T19:26:12.152295+0000","last_fullsized":"2023-11-08T19:26:12.152295+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:38:55.785104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.153220+0000","last_change":"2023-11-08T19:24:32.147235+0000","last_active":"2023-11-08T19:26:12.153220+0000","last_peered":"2023-11-08T19:26:12.153220+0000","last_clean":"2023-11-08T19:26:12.153220+0000","last_became_active":"2023-11-08T19:24:31.146176+0000","last_became_peered":"2023-11-08T19:24:31.146176+0000","last_unstale":"2023-11-08T19:26:12.153220+0000","last_undegraded":"2023-11-08T19:26:12.153220+0000","last_fullsized":"2023-11-08T19:26:12.153220+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:39.214888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048481000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.536729+0000","last_change":"2023-11-08T19:25:48.373345+0000","last_active":"2023-11-08T19:26:06.536729+0000","last_peered":"2023-11-08T19:26:06.536729+0000","last_clean":"2023-11-08T19:26:06.536729+0000","last_became_active":"2023-11-08T19:25:46.282460+0000","last_became_peered":"2023-11-08T19:25:46.282460+0000","last_unstale":"2023-11-08T19:26:06.536729+0000","last_undegraded":"2023-11-08T19:26:06.536729+0000","last_fullsized":"2023-11-08T19:26:06.536729+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:25:30.927920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001972863,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.130984+0000","last_change":"2023-11-08T19:26:11.130984+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.130984+0000","last_undegraded":"2023-11-08T19:26:11.130984+0000","last_fullsized":"2023-11-08T19:26:11.130984+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.131011+0000","last_change":"2023-11-08T19:26:10.131011+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.131011+0000","last_undegraded":"2023-11-08T19:26:10.131011+0000","last_fullsized":"2023-11-08T19:26:10.131011+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.125470+0000","last_change":"2023-11-08T19:25:47.283708+0000","last_active":"2023-11-08T19:26:10.125470+0000","last_peered":"2023-11-08T19:26:10.125470+0000","last_clean":"2023-11-08T19:26:10.125470+0000","last_became_active":"2023-11-08T19:25:47.283433+0000","last_became_peered":"2023-11-08T19:25:47.283433+0000","last_unstale":"2023-11-08T19:26:10.125470+0000","last_undegraded":"2023-11-08T19:26:10.125470+0000","last_fullsized":"2023-11-08T19:26:10.125470+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:30:17.627967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":48,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.126607+0000","last_change":"2023-11-08T19:24:32.543880+0000","last_active":"2023-11-08T19:26:10.126607+0000","last_peered":"2023-11-08T19:26:10.126607+0000","last_clean":"2023-11-08T19:26:10.126607+0000","last_became_active":"2023-11-08T19:24:31.142052+0000","last_became_peered":"2023-11-08T19:24:31.142052+0000","last_unstale":"2023-11-08T19:26:10.126607+0000","last_undegraded":"2023-11-08T19:26:10.126607+0000","last_fullsized":"2023-11-08T19:26:10.126607+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:18:42.371676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014881058000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.373504+0000","last_change":"2023-11-08T19:25:48.284890+0000","last_active":"2023-11-08T19:26:06.373504+0000","last_peered":"2023-11-08T19:26:06.373504+0000","last_clean":"2023-11-08T19:26:06.373504+0000","last_became_active":"2023-11-08T19:25:46.279287+0000","last_became_peered":"2023-11-08T19:25:46.279287+0000","last_unstale":"2023-11-08T19:26:06.373504+0000","last_undegraded":"2023-11-08T19:26:06.373504+0000","last_fullsized":"2023-11-08T19:26:06.373504+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:35:30.427172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076856899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.131038+0000","last_change":"2023-11-08T19:26:11.131038+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.131038+0000","last_undegraded":"2023-11-08T19:26:11.131038+0000","last_fullsized":"2023-11-08T19:26:11.131038+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.130999+0000","last_change":"2023-11-08T19:26:10.130999+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.130999+0000","last_undegraded":"2023-11-08T19:26:10.130999+0000","last_fullsized":"2023-11-08T19:26:10.130999+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":20,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.373345+0000","last_change":"2023-11-08T19:25:47.285867+0000","last_active":"2023-11-08T19:26:06.373345+0000","last_peered":"2023-11-08T19:26:06.373345+0000","last_clean":"2023-11-08T19:26:06.373345+0000","last_became_active":"2023-11-08T19:25:47.285533+0000","last_became_peered":"2023-11-08T19:25:47.285533+0000","last_unstale":"2023-11-08T19:26:06.373345+0000","last_undegraded":"2023-11-08T19:26:06.373345+0000","last_fullsized":"2023-11-08T19:26:06.373345+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:26:59.852338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.152466+0000","last_change":"2023-11-08T19:24:32.147011+0000","last_active":"2023-11-08T19:26:12.152466+0000","last_peered":"2023-11-08T19:26:12.152466+0000","last_clean":"2023-11-08T19:26:12.152466+0000","last_became_active":"2023-11-08T19:24:31.148250+0000","last_became_peered":"2023-11-08T19:24:31.148250+0000","last_unstale":"2023-11-08T19:26:12.152466+0000","last_undegraded":"2023-11-08T19:26:12.152466+0000","last_fullsized":"2023-11-08T19:26:12.152466+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:01:25.647952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043061299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.125521+0000","last_change":"2023-11-08T19:25:48.284869+0000","last_active":"2023-11-08T19:26:10.125521+0000","last_peered":"2023-11-08T19:26:10.125521+0000","last_clean":"2023-11-08T19:26:10.125521+0000","last_became_active":"2023-11-08T19:25:46.285478+0000","last_became_peered":"2023-11-08T19:25:46.285478+0000","last_unstale":"2023-11-08T19:26:10.125521+0000","last_undegraded":"2023-11-08T19:26:10.125521+0000","last_fullsized":"2023-11-08T19:26:10.125521+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:49:51.368808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000376339,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.131103+0000","last_change":"2023-11-08T19:26:11.131103+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.131103+0000","last_undegraded":"2023-11-08T19:26:11.131103+0000","last_fullsized":"2023-11-08T19:26:11.131103+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.128845+0000","last_change":"2023-11-08T19:26:10.128845+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.128845+0000","last_undegraded":"2023-11-08T19:26:10.128845+0000","last_fullsized":"2023-11-08T19:26:10.128845+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.125020+0000","last_change":"2023-11-08T19:25:47.284429+0000","last_active":"2023-11-08T19:26:10.125020+0000","last_peered":"2023-11-08T19:26:10.125020+0000","last_clean":"2023-11-08T19:26:10.125020+0000","last_became_active":"2023-11-08T19:25:47.283990+0000","last_became_peered":"2023-11-08T19:25:47.283990+0000","last_unstale":"2023-11-08T19:26:10.125020+0000","last_undegraded":"2023-11-08T19:26:10.125020+0000","last_fullsized":"2023-11-08T19:26:10.125020+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:59:08.628317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":55,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.124560+0000","last_change":"2023-11-08T19:24:32.141190+0000","last_active":"2023-11-08T19:26:10.124560+0000","last_peered":"2023-11-08T19:26:10.124560+0000","last_clean":"2023-11-08T19:26:10.124560+0000","last_became_active":"2023-11-08T19:24:31.147651+0000","last_became_peered":"2023-11-08T19:24:31.147651+0000","last_unstale":"2023-11-08T19:26:10.124560+0000","last_undegraded":"2023-11-08T19:26:10.124560+0000","last_fullsized":"2023-11-08T19:26:10.124560+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:21:55.985548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043673300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.655820+0000","last_change":"2023-11-08T19:25:48.320707+0000","last_active":"2023-11-08T19:26:06.655820+0000","last_peered":"2023-11-08T19:26:06.655820+0000","last_clean":"2023-11-08T19:26:06.655820+0000","last_became_active":"2023-11-08T19:25:46.282307+0000","last_became_peered":"2023-11-08T19:25:46.282307+0000","last_unstale":"2023-11-08T19:26:06.655820+0000","last_undegraded":"2023-11-08T19:26:06.655820+0000","last_fullsized":"2023-11-08T19:26:06.655820+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:53:36.476361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047078400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.130955+0000","last_change":"2023-11-08T19:26:11.130955+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.130955+0000","last_undegraded":"2023-11-08T19:26:11.130955+0000","last_fullsized":"2023-11-08T19:26:11.130955+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.128054+0000","last_change":"2023-11-08T19:26:10.128054+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.128054+0000","last_undegraded":"2023-11-08T19:26:10.128054+0000","last_fullsized":"2023-11-08T19:26:10.128054+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.125006+0000","last_change":"2023-11-08T19:25:47.284227+0000","last_active":"2023-11-08T19:26:10.125006+0000","last_peered":"2023-11-08T19:26:10.125006+0000","last_clean":"2023-11-08T19:26:10.125006+0000","last_became_active":"2023-11-08T19:25:47.283927+0000","last_became_peered":"2023-11-08T19:25:47.283927+0000","last_unstale":"2023-11-08T19:26:10.125006+0000","last_undegraded":"2023-11-08T19:26:10.125006+0000","last_fullsized":"2023-11-08T19:26:10.125006+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:15:23.188047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.536878+0000","last_change":"2023-11-08T19:24:32.530168+0000","last_active":"2023-11-08T19:26:06.536878+0000","last_peered":"2023-11-08T19:26:06.536878+0000","last_clean":"2023-11-08T19:26:06.536878+0000","last_became_active":"2023-11-08T19:24:31.144329+0000","last_became_peered":"2023-11-08T19:24:31.144329+0000","last_unstale":"2023-11-08T19:26:06.536878+0000","last_undegraded":"2023-11-08T19:26:06.536878+0000","last_fullsized":"2023-11-08T19:26:06.536878+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:05:36.085920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043484799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.536437+0000","last_change":"2023-11-08T19:25:48.371291+0000","last_active":"2023-11-08T19:26:06.536437+0000","last_peered":"2023-11-08T19:26:06.536437+0000","last_clean":"2023-11-08T19:26:06.536437+0000","last_became_active":"2023-11-08T19:25:46.281425+0000","last_became_peered":"2023-11-08T19:25:46.281425+0000","last_unstale":"2023-11-08T19:26:06.536437+0000","last_undegraded":"2023-11-08T19:26:06.536437+0000","last_fullsized":"2023-11-08T19:26:06.536437+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:23:12.422712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00124314,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.128515+0000","last_change":"2023-11-08T19:26:11.128515+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.128515+0000","last_undegraded":"2023-11-08T19:26:11.128515+0000","last_fullsized":"2023-11-08T19:26:11.128515+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":3,"reported_epoch":81,"state":"creating+activating","last_fresh":"2023-11-08T19:26:11.128875+0000","last_change":"2023-11-08T19:26:11.128875+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.128875+0000","last_undegraded":"2023-11-08T19:26:11.128875+0000","last_fullsized":"2023-11-08T19:26:11.128875+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:34:00.358882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":["4","6"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.536522+0000","last_change":"2023-11-08T19:25:47.281724+0000","last_active":"2023-11-08T19:26:06.536522+0000","last_peered":"2023-11-08T19:26:06.536522+0000","last_clean":"2023-11-08T19:26:06.536522+0000","last_became_active":"2023-11-08T19:25:47.281425+0000","last_became_peered":"2023-11-08T19:25:47.281425+0000","last_unstale":"2023-11-08T19:26:06.536522+0000","last_undegraded":"2023-11-08T19:26:06.536522+0000","last_fullsized":"2023-11-08T19:26:06.536522+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:38:55.785104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.536534+0000","last_change":"2023-11-08T19:24:32.529486+0000","last_active":"2023-11-08T19:26:06.536534+0000","last_peered":"2023-11-08T19:26:06.536534+0000","last_clean":"2023-11-08T19:26:06.536534+0000","last_became_active":"2023-11-08T19:24:31.146260+0000","last_became_peered":"2023-11-08T19:24:31.146260+0000","last_unstale":"2023-11-08T19:26:06.536534+0000","last_undegraded":"2023-11-08T19:26:06.536534+0000","last_fullsized":"2023-11-08T19:26:06.536534+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:45:34.425432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059842900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.125457+0000","last_change":"2023-11-08T19:25:48.277457+0000","last_active":"2023-11-08T19:26:10.125457+0000","last_peered":"2023-11-08T19:26:10.125457+0000","last_clean":"2023-11-08T19:26:10.125457+0000","last_became_active":"2023-11-08T19:25:46.286239+0000","last_became_peered":"2023-11-08T19:25:46.286239+0000","last_unstale":"2023-11-08T19:26:10.125457+0000","last_undegraded":"2023-11-08T19:26:10.125457+0000","last_fullsized":"2023-11-08T19:26:10.125457+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:09:43.662108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000722421,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":3,"reported_epoch":81,"state":"creating+activating","last_fresh":"2023-11-08T19:26:11.131468+0000","last_change":"2023-11-08T19:26:11.131468+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.131468+0000","last_undegraded":"2023-11-08T19:26:11.131468+0000","last_fullsized":"2023-11-08T19:26:11.131468+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:50:16.234801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":["1","7"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.150529+0000","last_change":"2023-11-08T19:25:47.287874+0000","last_active":"2023-11-08T19:26:12.150529+0000","last_peered":"2023-11-08T19:26:12.150529+0000","last_clean":"2023-11-08T19:26:12.150529+0000","last_became_active":"2023-11-08T19:25:47.287456+0000","last_became_peered":"2023-11-08T19:25:47.287456+0000","last_unstale":"2023-11-08T19:26:12.150529+0000","last_undegraded":"2023-11-08T19:26:12.150529+0000","last_fullsized":"2023-11-08T19:26:12.150529+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:26:59.852338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":53,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.372762+0000","last_change":"2023-11-08T19:24:32.141131+0000","last_active":"2023-11-08T19:26:06.372762+0000","last_peered":"2023-11-08T19:26:06.372762+0000","last_clean":"2023-11-08T19:26:06.372762+0000","last_became_active":"2023-11-08T19:24:31.146154+0000","last_became_peered":"2023-11-08T19:24:31.146154+0000","last_unstale":"2023-11-08T19:26:06.372762+0000","last_undegraded":"2023-11-08T19:26:06.372762+0000","last_fullsized":"2023-11-08T19:26:06.372762+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:18:40.271560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082432800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.126197+0000","last_change":"2023-11-08T19:25:48.372729+0000","last_active":"2023-11-08T19:26:10.126197+0000","last_peered":"2023-11-08T19:26:10.126197+0000","last_clean":"2023-11-08T19:26:10.126197+0000","last_became_active":"2023-11-08T19:25:46.290114+0000","last_became_peered":"2023-11-08T19:25:46.290114+0000","last_unstale":"2023-11-08T19:26:10.126197+0000","last_undegraded":"2023-11-08T19:26:10.126197+0000","last_fullsized":"2023-11-08T19:26:10.126197+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:49:36.208776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061009499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":3,"reported_epoch":81,"state":"creating+activating","last_fresh":"2023-11-08T19:26:11.131145+0000","last_change":"2023-11-08T19:26:11.131145+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.131145+0000","last_undegraded":"2023-11-08T19:26:11.131145+0000","last_fullsized":"2023-11-08T19:26:11.131145+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:30:41.488076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":["1","5"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.536851+0000","last_change":"2023-11-08T19:25:47.283046+0000","last_active":"2023-11-08T19:26:06.536851+0000","last_peered":"2023-11-08T19:26:06.536851+0000","last_clean":"2023-11-08T19:26:06.536851+0000","last_became_active":"2023-11-08T19:25:47.282763+0000","last_became_peered":"2023-11-08T19:25:47.282763+0000","last_unstale":"2023-11-08T19:26:06.536851+0000","last_undegraded":"2023-11-08T19:26:06.536851+0000","last_fullsized":"2023-11-08T19:26:06.536851+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:12:51.389167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":49,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.126305+0000","last_change":"2023-11-08T19:24:32.263963+0000","last_active":"2023-11-08T19:26:10.126305+0000","last_peered":"2023-11-08T19:26:10.126305+0000","last_clean":"2023-11-08T19:26:10.126305+0000","last_became_active":"2023-11-08T19:24:31.139062+0000","last_became_peered":"2023-11-08T19:24:31.139062+0000","last_unstale":"2023-11-08T19:26:10.126305+0000","last_undegraded":"2023-11-08T19:26:10.126305+0000","last_fullsized":"2023-11-08T19:26:10.126305+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:26.080042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033682599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.373032+0000","last_change":"2023-11-08T19:25:48.283302+0000","last_active":"2023-11-08T19:26:06.373032+0000","last_peered":"2023-11-08T19:26:06.373032+0000","last_clean":"2023-11-08T19:26:06.373032+0000","last_became_active":"2023-11-08T19:25:46.284287+0000","last_became_peered":"2023-11-08T19:25:46.284287+0000","last_unstale":"2023-11-08T19:26:06.373032+0000","last_undegraded":"2023-11-08T19:26:06.373032+0000","last_fullsized":"2023-11-08T19:26:06.373032+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:39:27.217802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097880800000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.128580+0000","last_change":"2023-11-08T19:26:11.128580+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.128580+0000","last_undegraded":"2023-11-08T19:26:11.128580+0000","last_fullsized":"2023-11-08T19:26:11.128580+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":3,"reported_epoch":81,"state":"creating+activating","last_fresh":"2023-11-08T19:26:11.131935+0000","last_change":"2023-11-08T19:26:11.131935+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.131935+0000","last_undegraded":"2023-11-08T19:26:11.131935+0000","last_fullsized":"2023-11-08T19:26:11.131935+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:01:57.994055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":["3","0"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.124702+0000","last_change":"2023-11-08T19:25:47.286434+0000","last_active":"2023-11-08T19:26:10.124702+0000","last_peered":"2023-11-08T19:26:10.124702+0000","last_clean":"2023-11-08T19:26:10.124702+0000","last_became_active":"2023-11-08T19:25:47.286181+0000","last_became_peered":"2023-11-08T19:25:47.286181+0000","last_unstale":"2023-11-08T19:26:10.124702+0000","last_undegraded":"2023-11-08T19:26:10.124702+0000","last_fullsized":"2023-11-08T19:26:10.124702+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:13:27.285648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":53,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.373802+0000","last_change":"2023-11-08T19:24:32.140514+0000","last_active":"2023-11-08T19:26:06.373802+0000","last_peered":"2023-11-08T19:26:06.373802+0000","last_clean":"2023-11-08T19:26:06.373802+0000","last_became_active":"2023-11-08T19:24:31.146668+0000","last_became_peered":"2023-11-08T19:24:31.146668+0000","last_unstale":"2023-11-08T19:26:06.373802+0000","last_undegraded":"2023-11-08T19:26:06.373802+0000","last_fullsized":"2023-11-08T19:26:06.373802+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:31:24.539374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071576699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.656105+0000","last_change":"2023-11-08T19:25:48.320667+0000","last_active":"2023-11-08T19:26:06.656105+0000","last_peered":"2023-11-08T19:26:06.656105+0000","last_clean":"2023-11-08T19:26:06.656105+0000","last_became_active":"2023-11-08T19:25:46.290246+0000","last_became_peered":"2023-11-08T19:25:46.290246+0000","last_unstale":"2023-11-08T19:26:06.656105+0000","last_undegraded":"2023-11-08T19:26:06.656105+0000","last_fullsized":"2023-11-08T19:26:06.656105+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:33:35.492889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000423211,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.15","version":"82'3","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.172151+0000","last_change":"2023-11-08T19:26:11.147387+0000","last_active":"2023-11-08T19:26:12.172151+0000","last_peered":"2023-11-08T19:26:12.172151+0000","last_clean":"2023-11-08T19:26:12.172151+0000","last_became_active":"2023-11-08T19:26:11.147105+0000","last_became_peered":"2023-11-08T19:26:11.147105+0000","last_unstale":"2023-11-08T19:26:12.172151+0000","last_undegraded":"2023-11-08T19:26:12.172151+0000","last_fullsized":"2023-11-08T19:26:12.172151+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:29:49.218097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.126527+0000","last_change":"2023-11-08T19:25:47.287717+0000","last_active":"2023-11-08T19:26:10.126527+0000","last_peered":"2023-11-08T19:26:10.126527+0000","last_clean":"2023-11-08T19:26:10.126527+0000","last_became_active":"2023-11-08T19:25:47.287412+0000","last_became_peered":"2023-11-08T19:25:47.287412+0000","last_unstale":"2023-11-08T19:26:10.126527+0000","last_undegraded":"2023-11-08T19:26:10.126527+0000","last_fullsized":"2023-11-08T19:26:10.126527+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:18:04.478139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":49,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.656198+0000","last_change":"2023-11-08T19:24:32.142892+0000","last_active":"2023-11-08T19:26:06.656198+0000","last_peered":"2023-11-08T19:26:06.656198+0000","last_clean":"2023-11-08T19:26:06.656198+0000","last_became_active":"2023-11-08T19:24:31.144912+0000","last_became_peered":"2023-11-08T19:24:31.144912+0000","last_unstale":"2023-11-08T19:26:06.656198+0000","last_undegraded":"2023-11-08T19:26:06.656198+0000","last_fullsized":"2023-11-08T19:26:06.656198+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:04:21.151484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056686900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.373645+0000","last_change":"2023-11-08T19:25:48.285205+0000","last_active":"2023-11-08T19:26:06.373645+0000","last_peered":"2023-11-08T19:26:06.373645+0000","last_clean":"2023-11-08T19:26:06.373645+0000","last_became_active":"2023-11-08T19:25:46.285848+0000","last_became_peered":"2023-11-08T19:25:46.285848+0000","last_unstale":"2023-11-08T19:26:06.373645+0000","last_undegraded":"2023-11-08T19:26:06.373645+0000","last_fullsized":"2023-11-08T19:26:06.373645+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:07:10.832480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089732199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.158884+0000","last_change":"2023-11-08T19:26:12.170669+0000","last_active":"2023-11-08T19:26:13.158884+0000","last_peered":"2023-11-08T19:26:13.158884+0000","last_clean":"2023-11-08T19:26:13.158884+0000","last_became_active":"2023-11-08T19:26:12.170345+0000","last_became_peered":"2023-11-08T19:26:12.170345+0000","last_unstale":"2023-11-08T19:26:13.158884+0000","last_undegraded":"2023-11-08T19:26:13.158884+0000","last_fullsized":"2023-11-08T19:26:13.158884+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:32:15.350077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":3,"reported_epoch":81,"state":"creating+activating","last_fresh":"2023-11-08T19:26:11.130955+0000","last_change":"2023-11-08T19:26:11.130955+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.130955+0000","last_undegraded":"2023-11-08T19:26:11.130955+0000","last_fullsized":"2023-11-08T19:26:11.130955+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:27:23.712447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":["4","3"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":19,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.656005+0000","last_change":"2023-11-08T19:25:47.280177+0000","last_active":"2023-11-08T19:26:06.656005+0000","last_peered":"2023-11-08T19:26:06.656005+0000","last_clean":"2023-11-08T19:26:06.656005+0000","last_became_active":"2023-11-08T19:25:47.279913+0000","last_became_peered":"2023-11-08T19:25:47.279913+0000","last_unstale":"2023-11-08T19:26:06.656005+0000","last_undegraded":"2023-11-08T19:26:06.656005+0000","last_fullsized":"2023-11-08T19:26:06.656005+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:26:02.147090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":49,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.126250+0000","last_change":"2023-11-08T19:24:32.263958+0000","last_active":"2023-11-08T19:26:10.126250+0000","last_peered":"2023-11-08T19:26:10.126250+0000","last_clean":"2023-11-08T19:26:10.126250+0000","last_became_active":"2023-11-08T19:24:31.149011+0000","last_became_peered":"2023-11-08T19:24:31.149011+0000","last_unstale":"2023-11-08T19:26:10.126250+0000","last_undegraded":"2023-11-08T19:26:10.126250+0000","last_fullsized":"2023-11-08T19:26:10.126250+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:09:04.880374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033496900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.372612+0000","last_change":"2023-11-08T19:25:48.285075+0000","last_active":"2023-11-08T19:26:06.372612+0000","last_peered":"2023-11-08T19:26:06.372612+0000","last_clean":"2023-11-08T19:26:06.372612+0000","last_became_active":"2023-11-08T19:25:46.272479+0000","last_became_peered":"2023-11-08T19:25:46.272479+0000","last_unstale":"2023-11-08T19:26:06.372612+0000","last_undegraded":"2023-11-08T19:26:06.372612+0000","last_fullsized":"2023-11-08T19:26:06.372612+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:23:12.422712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001158117,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574892,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28600,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343240,"statfs":{"total":96636764160,"available":96607477760,"internally_reserved":0,"allocated":1617920,"data_stored":1082797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55200000000000005,"15min":0.53800000000000003},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.41399999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.71299999999999997,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.65300000000000002}]},{"osd":1,"last update":"Wed Nov 8 19:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.54800000000000004,"15min":0.54700000000000004},"min":{"1min":0.40799999999999997,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.69499999999999995,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.53800000000000003,"15min":0.53200000000000003},"min":{"1min":0.40600000000000003,"5min":0.37,"15min":0.37},"max":{"1min":0.75900000000000001,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.61699999999999999}]},{"osd":2,"last update":"Wed Nov 8 19:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.51400000000000001,"15min":0.50800000000000001},"min":{"1min":0.42899999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.75800000000000001,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.54000000000000004,"15min":0.53600000000000003},"min":{"1min":0.379,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.77800000000000002,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.63400000000000001}]},{"osd":3,"last update":"Wed Nov 8 19:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.53600000000000003,"15min":0.53400000000000003},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.56899999999999995,"15min":0.55900000000000005},"min":{"1min":0.42399999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76100000000000001,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.67600000000000005}]},{"osd":4,"last update":"Wed Nov 8 19:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.496,"15min":0.48599999999999999},"min":{"1min":0.35999999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.51900000000000002,"15min":0.51800000000000002},"min":{"1min":0.378,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.71399999999999997,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.45300000000000001}]},{"osd":5,"last update":"Wed Nov 8 19:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.55900000000000005,"15min":0.54800000000000004},"min":{"1min":0.39200000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.76300000000000001,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.58199999999999996,"15min":0.57799999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.68700000000000006,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.51100000000000001}]},{"osd":6,"last update":"Wed Nov 8 19:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.45600000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.80400000000000005,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57299999999999995,"15min":0.56399999999999995},"min":{"1min":0.441,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.69199999999999995,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.495}]}]},{"osd":6,"up_from":13,"seq":55834574892,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":978944,"data_stored":468818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.57299999999999995,"15min":0.59699999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.69799999999999995,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.57299999999999995,"15min":0.59099999999999997},"min":{"1min":0.313,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.754,"5min":1.478,"15min":1.478},"last":0.64400000000000002}]},{"osd":1,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.59599999999999997,"15min":0.60599999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.77500000000000002,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.65200000000000002,"15min":0.66600000000000004},"min":{"1min":0.435,"5min":0.433,"15min":0.433},"max":{"1min":0.78700000000000003,"5min":1.649,"15min":1.649},"last":0.72499999999999998}]},{"osd":2,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.621,"15min":0.63200000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76400000000000001,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.73699999999999999}]},{"osd":3,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.60399999999999998,"15min":0.63},"min":{"1min":0.42299999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.747,"5min":1.766,"15min":1.766},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.59499999999999997,"15min":0.61899999999999999},"min":{"1min":0.39300000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.82799999999999996,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":0.52100000000000002}]},{"osd":4,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53700000000000003,"15min":0.54200000000000004},"min":{"1min":0.36399999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.625},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57299999999999995,"15min":0.58099999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.81699999999999995,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.54700000000000004}]},{"osd":5,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.55500000000000005,"15min":0.56799999999999995},"min":{"1min":0.38800000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.73499999999999999,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.623,"15min":0.63600000000000001},"min":{"1min":0.41399999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.80200000000000005,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.45000000000000001}]},{"osd":7,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.60599999999999998,"15min":0.61299999999999999},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.77700000000000002,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.63600000000000001,"15min":0.64600000000000002},"min":{"1min":0.44400000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.71599999999999997,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.58399999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574891,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":978944,"data_stored":468818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.35699999999999998,"15min":0.36299999999999999},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.51200000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.38900000000000001,"15min":0.41299999999999998},"min":{"1min":0.22900000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.51700000000000002,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":0.35099999999999998}]},{"osd":2,"last update":"Wed Nov 8 19:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.33800000000000002,"15min":0.34499999999999997},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.53000000000000003,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.38100000000000001,"15min":0.39400000000000002},"min":{"1min":0.253,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.46400000000000002,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.41099999999999998}]},{"osd":3,"last update":"Wed Nov 8 19:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.40799999999999997,"15min":0.41699999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.432,"5min":1.24,"15min":1.24},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.371,"5min":0.438,"15min":0.46200000000000002},"min":{"1min":0.26100000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.47999999999999998,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.312}]},{"osd":4,"last update":"Wed Nov 8 19:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.60599999999999998,"15min":0.61399999999999999},"min":{"1min":0.46500000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72499999999999998,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57599999999999996,"15min":0.56599999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.76200000000000001,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.57199999999999995}]},{"osd":5,"last update":"Wed Nov 8 19:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.56999999999999995,"15min":0.55800000000000005},"min":{"1min":0.41399999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.72799999999999998,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.60199999999999998,"15min":0.60699999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.68700000000000006,"5min":1.115,"15min":1.115},"last":0.78600000000000003}]},{"osd":6,"last update":"Wed Nov 8 19:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.63,"15min":0.63800000000000001},"min":{"1min":0.439,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.746,"5min":2.093,"15min":2.093},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.59899999999999998,"15min":0.60299999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.76100000000000001,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.74099999999999999}]},{"osd":7,"last update":"Wed Nov 8 19:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.64700000000000002,"15min":0.67100000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.77600000000000002,"5min":1.591,"15min":1.591},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.66500000000000004,"15min":0.69199999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.70199999999999996,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.63600000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574891,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28556,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343284,"statfs":{"total":96636764160,"available":96607522816,"internally_reserved":0,"allocated":1572864,"data_stored":1059186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:26:00 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.879,"15min":1.1180000000000001},"min":{"1min":0.23799999999999999,"5min":0.192,"15min":0.192},"max":{"1min":0.60699999999999998,"5min":19.295999999999999,"15min":19.295999999999999},"last":0.434},{"interface":"front","average":{"1min":0.379,"5min":0.81999999999999995,"15min":1.024},"min":{"1min":0.24299999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.56000000000000005,"5min":17.204000000000001,"15min":17.204000000000001},"last":0.40799999999999997}]},{"osd":2,"last update":"Wed Nov 8 19:26:00 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.54200000000000004,"15min":0.61799999999999999},"min":{"1min":0.28299999999999997,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.54700000000000004,"5min":6.524,"15min":6.524},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.85399999999999998,"15min":1.0640000000000001},"min":{"1min":0.29499999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.60699999999999998,"5min":17.175000000000001,"15min":17.175000000000001},"last":0.45100000000000001}]},{"osd":3,"last update":"Wed Nov 8 19:26:00 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.746,"15min":0.91000000000000003},"min":{"1min":0.27100000000000002,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.55800000000000005,"5min":14.324,"15min":14.324},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.40799999999999997,"15min":0.40400000000000003},"min":{"1min":0.34699999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.48599999999999999}]},{"osd":4,"last update":"Wed Nov 8 19:26:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":1.028,"15min":1.212},"min":{"1min":0.52000000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.98999999999999999,"5min":17.056000000000001,"15min":17.056000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.70699999999999996,"15min":0.745},"min":{"1min":0.49099999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.82299999999999995,"5min":5.0289999999999999,"15min":5.0289999999999999},"last":0.60499999999999998}]},{"osd":5,"last update":"Wed Nov 8 19:26:00 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.69999999999999996,"15min":0.746},"min":{"1min":0.53400000000000003,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.85099999999999998,"5min":5.0590000000000002,"15min":5.0590000000000002},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.58399999999999996,"15min":0.56999999999999995},"min":{"1min":0.47199999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.64400000000000002}]},{"osd":6,"last update":"Wed Nov 8 19:26:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.61299999999999999,"15min":0.60799999999999998},"min":{"1min":0.505,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.68400000000000005,"5min":1.0649999999999999,"15min":1.2589999999999999},"min":{"1min":0.50800000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.0389999999999999,"5min":17.111999999999998,"15min":17.111999999999998},"last":0.72599999999999998}]},{"osd":7,"last update":"Wed Nov 8 19:26:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":1.0820000000000001,"15min":1.274},"min":{"1min":0.48099999999999998,"5min":0.376,"15min":0.376},"max":{"1min":1.0760000000000001,"5min":17.146000000000001,"15min":17.146000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.63,"5min":0.71099999999999997,"15min":0.75700000000000001},"min":{"1min":0.47099999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.91700000000000004,"5min":4.9829999999999997,"15min":4.9829999999999997},"last":0.68799999999999994}]}]},{"osd":2,"up_from":13,"seq":55834574891,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":978944,"data_stored":468818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.433,"15min":0.47499999999999998},"min":{"1min":0.23300000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.61299999999999999,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.46200000000000002,"15min":0.50800000000000001},"min":{"1min":0.23999999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.65100000000000002,"5min":3.4369999999999998,"15min":3.4369999999999998},"last":0.31900000000000001}]},{"osd":1,"last update":"Wed Nov 8 19:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.49099999999999999,"15min":0.54900000000000004},"min":{"1min":0.27000000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.48399999999999999,"5min":4.0679999999999996,"15min":4.0679999999999996},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.54400000000000004,"15min":0.59599999999999997},"min":{"1min":0.32300000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.58599999999999997,"5min":4.3499999999999996,"15min":4.3499999999999996},"last":0.438}]},{"osd":3,"last update":"Wed Nov 8 19:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.495,"15min":0.53700000000000003},"min":{"1min":0.27800000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.47099999999999997,"5min":3.8580000000000001,"15min":3.8580000000000001},"last":0.375},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.46300000000000002,"15min":0.51200000000000001},"min":{"1min":0.29599999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.55700000000000005,"5min":3.476,"15min":3.476},"last":0.34000000000000002}]},{"osd":4,"last update":"Wed Nov 8 19:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.68799999999999994,"15min":0.71799999999999997},"min":{"1min":0.44,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.98799999999999999,"5min":4.0090000000000003,"15min":4.0090000000000003},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.68899999999999995,"15min":0.73399999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.69099999999999995,"5min":4.1040000000000001,"15min":4.1040000000000001},"last":0.46500000000000002}]},{"osd":5,"last update":"Wed Nov 8 19:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.69299999999999995,"15min":0.74299999999999999},"min":{"1min":0.47999999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.874,"5min":4.0869999999999997,"15min":4.0869999999999997},"last":0.497},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.69599999999999995,"15min":0.746},"min":{"1min":0.435,"5min":0.433,"15min":0.433},"max":{"1min":0.78100000000000003,"5min":3.843,"15min":3.843},"last":0.56000000000000005}]},{"osd":6,"last update":"Wed Nov 8 19:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.70799999999999996,"15min":0.75900000000000001},"min":{"1min":0.45300000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.72699999999999998,"5min":4.1399999999999997,"15min":4.1399999999999997},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.68799999999999994,"15min":0.73399999999999999},"min":{"1min":0.49199999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.81499999999999995,"5min":4.0499999999999998,"15min":4.0499999999999998},"last":0.52500000000000002}]},{"osd":7,"last update":"Wed Nov 8 19:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.72799999999999998,"15min":0.76800000000000002},"min":{"1min":0.48799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.754,"5min":4.157,"15min":4.157},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.754,"15min":0.80000000000000004},"min":{"1min":0.505,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.93000000000000005,"5min":4.1710000000000003,"15min":4.1710000000000003},"last":0.54400000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574891,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":978944,"data_stored":468818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.38100000000000001,"15min":0.38500000000000001},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.64600000000000002,"5min":1.458,"15min":1.458},"last":0.373},{"interface":"front","average":{"1min":0.372,"5min":0.38900000000000001,"15min":0.39800000000000002},"min":{"1min":0.29499999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.53400000000000003,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.35699999999999998}]},{"osd":1,"last update":"Wed Nov 8 19:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.40500000000000003,"15min":0.41099999999999998},"min":{"1min":0.29599999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.61199999999999999,"5min":1.512,"15min":1.512},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.435,"15min":0.44700000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.59999999999999998,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.32500000000000001}]},{"osd":2,"last update":"Wed Nov 8 19:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.371,"15min":0.376},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.54800000000000004,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.41899999999999998,"15min":0.42699999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.60899999999999999,"5min":1.536,"15min":1.536},"last":0.42799999999999999}]},{"osd":4,"last update":"Wed Nov 8 19:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.60799999999999998,"15min":0.62},"min":{"1min":0.44900000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.77000000000000002,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.61299999999999999,"15min":0.61099999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.80200000000000005,"5min":1.153,"15min":1.153},"last":0.70399999999999996}]},{"osd":5,"last update":"Wed Nov 8 19:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.58899999999999997,"15min":0.59099999999999997},"min":{"1min":0.42399999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.69599999999999995,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.58899999999999997,"15min":0.60299999999999998},"min":{"1min":0.39300000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.73699999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.56899999999999995}]},{"osd":6,"last update":"Wed Nov 8 19:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57399999999999995,"15min":0.57999999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78500000000000003,"5min":1.113,"15min":1.113},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60799999999999998,"15min":0.61199999999999999},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72299999999999998,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.58599999999999997}]},{"osd":7,"last update":"Wed Nov 8 19:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.63500000000000001,"15min":0.64700000000000002},"min":{"1min":0.433,"5min":0.432,"15min":0.432},"max":{"1min":0.73999999999999999,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.62,"15min":0.61799999999999999},"min":{"1min":0.46300000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.754,"5min":1.179,"15min":1.179},"last":0.75600000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574891,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":978944,"data_stored":468818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:25:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.54500000000000004,"15min":0.53800000000000003},"min":{"1min":0.36799999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.80100000000000005,"5min":1.399,"15min":1.399},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58499999999999996,"15min":0.59499999999999997},"min":{"1min":0.44400000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73499999999999999,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.63500000000000001}]},{"osd":1,"last update":"Wed Nov 8 19:25:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.51400000000000001,"15min":0.51100000000000001},"min":{"1min":0.42199999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.502,"15min":0.497},"min":{"1min":0.40999999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.61799999999999999}]},{"osd":2,"last update":"Wed Nov 8 19:25:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.61899999999999999,"15min":0.63500000000000001},"min":{"1min":0.38200000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.80800000000000005,"5min":2.8490000000000002,"15min":2.8490000000000002},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.53800000000000003,"15min":0.52400000000000002},"min":{"1min":0.40799999999999997,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.71799999999999997,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.47199999999999998}]},{"osd":3,"last update":"Wed Nov 8 19:25:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57799999999999996,"15min":0.56599999999999995},"min":{"1min":0.47099999999999997,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.75700000000000001,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.70099999999999996,"15min":0.72399999999999998},"min":{"1min":0.48299999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.83199999999999996,"5min":3.4849999999999999,"15min":3.4849999999999999},"last":0.66600000000000004}]},{"osd":5,"last update":"Wed Nov 8 19:25:59 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.51800000000000002,"15min":0.52000000000000002},"min":{"1min":0.38,"5min":0.313,"15min":0.313},"max":{"1min":0.67200000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.56899999999999995,"15min":0.56100000000000005},"min":{"1min":0.39700000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.79100000000000004,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.65000000000000002}]},{"osd":6,"last update":"Wed Nov 8 19:25:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.67300000000000004,"15min":0.71499999999999997},"min":{"1min":0.38,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.71599999999999997,"5min":4.1529999999999996,"15min":4.1529999999999996},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.624,"5min":0.61599999999999999,"15min":0.61399999999999999},"min":{"1min":0.41699999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.73999999999999999,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.59999999999999998}]},{"osd":7,"last update":"Wed Nov 8 19:25:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57399999999999995,"15min":0.57199999999999995},"min":{"1min":0.47399999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.69999999999999996,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.80200000000000005,"15min":0.85199999999999998},"min":{"1min":0.52700000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.83899999999999997,"5min":5.5359999999999996,"15min":5.5359999999999996},"last":0.68700000000000006}]}]},{"osd":5,"up_from":13,"seq":55834574891,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":978944,"data_stored":468818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53700000000000003,"15min":0.54700000000000004},"min":{"1min":0.40600000000000003,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.63800000000000001,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":0.44},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.52500000000000002,"15min":0.51900000000000002},"min":{"1min":0.32800000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.68799999999999994,"5min":0.878,"15min":0.878},"last":0.26900000000000002}]},{"osd":1,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55300000000000005,"15min":0.54700000000000004},"min":{"1min":0.47199999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.68200000000000005,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.59299999999999997,"15min":0.60699999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.73899999999999999,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":0.32200000000000001}]},{"osd":2,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.34699999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.65300000000000002,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.53600000000000003,"15min":0.53000000000000003},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.70699999999999996,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.29699999999999999}]},{"osd":3,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.41299999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71799999999999997,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57699999999999996,"15min":0.57299999999999995},"min":{"1min":0.42199999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.73599999999999999,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.48599999999999999}]},{"osd":4,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.57499999999999996,"15min":0.59899999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.748,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.63700000000000001,"15min":0.63500000000000001},"min":{"1min":0.46500000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.77300000000000002,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.56100000000000005}]},{"osd":6,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.57899999999999996,"15min":0.57799999999999996},"min":{"1min":0.38200000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.73599999999999999,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.63800000000000001,"15min":0.66600000000000004},"min":{"1min":0.41799999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.80500000000000005,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":0.60399999999999998}]},{"osd":7,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.623,"15min":0.629},"min":{"1min":0.42499999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.82799999999999996,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.64200000000000002,"15min":0.64800000000000002},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.80700000000000005,"5min":0.873,"15min":0.873},"last":0.58599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:26:16.654 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:26:16.805 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.803+0000 7fe4b630b700 1 Processor -- start 2023-11-08T19:26:16.805 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.803+0000 7fe4b630b700 1 -- start start 2023-11-08T19:26:16.809 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.804+0000 7fe4b630b700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe4b00cc9a0 0x7fe4b00c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:16.809 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.804+0000 7fe4b630b700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4b015bd30 con 0x7fe4b015b950 2023-11-08T19:26:16.809 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.804+0000 7fe4b630b700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4b00c7670 con 0x7fe4b00d0fe0 2023-11-08T19:26:16.809 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.804+0000 7fe4b630b700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b00caa90 con 0x7fe4b00cc9a0 2023-11-08T19:26:16.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.804+0000 7fe4affff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fe4b015b950 0x7fe4b00cc290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:44486/0 (socket says 172.21.15.149:44486) 2023-11-08T19:26:16.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.804+0000 7fe4affff700 1 -- 172.21.15.149:0/529151786 learned_addr learned my addr 172.21.15.149:0/529151786 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:26:16.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.804+0000 7fe4b48a8700 1 --2- 172.21.15.149:0/529151786 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe4b00cc9a0 0x7fe4b00c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:16.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.804+0000 7fe4af7fe700 1 -- 172.21.15.149:0/529151786 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2668321748 0 0) 0x7fe4b015bd30 con 0x7fe4b015b950 2023-11-08T19:26:16.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.804+0000 7fe4af7fe700 1 -- 172.21.15.149:0/529151786 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe49c0035b0 con 0x7fe4b015b950 2023-11-08T19:26:16.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.804+0000 7fe4af7fe700 1 -- 172.21.15.149:0/529151786 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3924441007 0 0) 0x7fe49c0035b0 con 0x7fe4b015b950 2023-11-08T19:26:16.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.804+0000 7fe4af7fe700 1 -- 172.21.15.149:0/529151786 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe4b00cc9a0 msgr2=0x7fe4b00c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:16.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.804+0000 7fe4af7fe700 1 --2- 172.21.15.149:0/529151786 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe4b00cc9a0 0x7fe4b00c8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:16.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.804+0000 7fe4af7fe700 1 -- 172.21.15.149:0/529151786 >> v1:172.21.15.160:6789/0 conn(0x7fe4b00d0fe0 legacy=0x7fe4b00c8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:16.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.804+0000 7fe4af7fe700 1 -- 172.21.15.149:0/529151786 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b00c81f0 con 0x7fe4b015b950 2023-11-08T19:26:16.812 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.804+0000 7fe4af7fe700 1 -- 172.21.15.149:0/529151786 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7fe4a00017f0 con 0x7fe4b015b950 2023-11-08T19:26:16.812 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.804+0000 7fe4af7fe700 1 -- 172.21.15.149:0/529151786 >> v1:172.21.15.149:6789/0 conn(0x7fe4b015b950 legacy=0x7fe4b00cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:16.812 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.804+0000 7fe4af7fe700 1 --2- 172.21.15.149:0/529151786 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe4b00cc9a0 0x7fe49c003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:16.812 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.804+0000 7fe4af7fe700 1 --2- 172.21.15.149:0/529151786 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe49c003f70 0x7fe49c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:16.812 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.804+0000 7fe4af7fe700 1 --2- 172.21.15.149:0/529151786 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe49c004d90 0x7fe49c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:16.813 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.804+0000 7fe4af7fe700 1 -- 172.21.15.149:0/529151786 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b00caa90 con 0x7fe49c003f70 2023-11-08T19:26:16.813 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.804+0000 7fe4af7fe700 1 -- 172.21.15.149:0/529151786 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c00bb20 con 0x7fe49c004d90 2023-11-08T19:26:16.813 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.804+0000 7fe4af7fe700 1 -- 172.21.15.149:0/529151786 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c00bce0 con 0x7fe4b00cc9a0 2023-11-08T19:26:16.813 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.805+0000 7fe4a7fff700 1 --2- 172.21.15.149:0/529151786 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe49c003f70 0x7fe49c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:16.813 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.805+0000 7fe4affff700 1 --2- 172.21.15.149:0/529151786 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe4b00cc9a0 0x7fe49c003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:16.814 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.805+0000 7fe4b48a8700 1 --2- 172.21.15.149:0/529151786 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe49c004d90 0x7fe49c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:16.814 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.805+0000 7fe4a7fff700 1 -- 172.21.15.149:0/529151786 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe4b00cc9a0 msgr2=0x7fe49c003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:16.814 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.805+0000 7fe4a7fff700 1 --2- 172.21.15.149:0/529151786 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe4b00cc9a0 0x7fe49c003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:16.814 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.805+0000 7fe4a7fff700 1 -- 172.21.15.149:0/529151786 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe49c004d90 msgr2=0x7fe49c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:16.815 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.805+0000 7fe4a7fff700 1 --2- 172.21.15.149:0/529151786 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe49c004d90 0x7fe49c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:16.815 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.805+0000 7fe4a7fff700 1 -- 172.21.15.149:0/529151786 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe49c0035b0 con 0x7fe49c003f70 2023-11-08T19:26:16.815 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.805+0000 7fe4a7fff700 1 --2- 172.21.15.149:0/529151786 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe49c003f70 0x7fe49c004850 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fe498001900 tx=0x7fe49c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8c62b2731612f2d server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:16.815 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.805+0000 7fe4af7fe700 1 -- 172.21.15.149:0/529151786 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe498016070 con 0x7fe49c003f70 2023-11-08T19:26:16.815 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.805+0000 7fe4af7fe700 1 -- 172.21.15.149:0/529151786 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe498001d30 con 0x7fe49c003f70 2023-11-08T19:26:16.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.805+0000 7fe4af7fe700 1 -- 172.21.15.149:0/529151786 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4980013f0 con 0x7fe49c003f70 2023-11-08T19:26:16.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.806+0000 7fe4b630b700 1 -- 172.21.15.149:0/529151786 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe49c003f70 msgr2=0x7fe49c004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:16.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.806+0000 7fe4b630b700 1 --2- 172.21.15.149:0/529151786 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe49c003f70 0x7fe49c004850 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fe498001900 tx=0x7fe49c005880 comp rx=0 tx=0).stop 2023-11-08T19:26:16.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.806+0000 7fe4b48a8700 1 -- 172.21.15.149:0/529151786 reap_dead start 2023-11-08T19:26:16.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.806+0000 7fe4b630b700 1 -- 172.21.15.149:0/529151786 shutdown_connections 2023-11-08T19:26:16.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.806+0000 7fe4b630b700 1 -- 172.21.15.149:0/529151786 >> 172.21.15.149:0/529151786 conn(0x7fe4b0099a40 msgr2=0x7fe4b00d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:16.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.806+0000 7fe4b630b700 1 -- 172.21.15.149:0/529151786 shutdown_connections 2023-11-08T19:26:16.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.806+0000 7fe4b630b700 1 -- 172.21.15.149:0/529151786 wait complete. 2023-11-08T19:26:16.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.807+0000 7fe4b630b700 1 Processor -- start 2023-11-08T19:26:16.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.807+0000 7fe4b630b700 1 -- start start 2023-11-08T19:26:16.820 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.808+0000 7fe4b630b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe49c003f70 0x7fe4b0158f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:16.820 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.808+0000 7fe4b630b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4b015cf20 0x7fe4b00c9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:16.820 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.808+0000 7fe4b630b700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe4b015d3a0 0x7fe4b00c9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:16.820 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.808+0000 7fe4b630b700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b009ade0 con 0x7fe4b015cf20 2023-11-08T19:26:16.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.808+0000 7fe4b630b700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b009b0c0 con 0x7fe49c003f70 2023-11-08T19:26:16.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.808+0000 7fe4b630b700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b009b3a0 con 0x7fe4b015d3a0 2023-11-08T19:26:16.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.808+0000 7fe4a7fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4b015cf20 0x7fe4b00c9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:16.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.808+0000 7fe4a7fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4b015cf20 0x7fe4b00c9590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42498/0 (socket says 172.21.15.149:42498) 2023-11-08T19:26:16.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.808+0000 7fe4a7fff700 1 -- 172.21.15.149:0/2613434654 learned_addr learned my addr 172.21.15.149:0/2613434654 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:16.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.808+0000 7fe4a7fff700 1 -- 172.21.15.149:0/2613434654 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe4b015d3a0 msgr2=0x7fe4b00c9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:16.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.808+0000 7fe4b48a8700 1 --2- 172.21.15.149:0/2613434654 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe4b015d3a0 0x7fe4b00c9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:16.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.808+0000 7fe4a7fff700 1 --2- 172.21.15.149:0/2613434654 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe4b015d3a0 0x7fe4b00c9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:16.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.808+0000 7fe4affff700 1 --2- 172.21.15.149:0/2613434654 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe49c003f70 0x7fe4b0158f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:16.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.808+0000 7fe4a7fff700 1 -- 172.21.15.149:0/2613434654 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe49c003f70 msgr2=0x7fe4b0158f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:16.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.808+0000 7fe4a7fff700 1 --2- 172.21.15.149:0/2613434654 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe49c003f70 0x7fe4b0158f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:16.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.808+0000 7fe4a7fff700 1 -- 172.21.15.149:0/2613434654 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b009b680 con 0x7fe4b015cf20 2023-11-08T19:26:16.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.808+0000 7fe4b48a8700 1 --2- 172.21.15.149:0/2613434654 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe4b015d3a0 0x7fe4b00c9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:26:16.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.808+0000 7fe4affff700 1 --2- 172.21.15.149:0/2613434654 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe49c003f70 0x7fe4b0158f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:26:16.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.808+0000 7fe4a7fff700 1 --2- 172.21.15.149:0/2613434654 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4b015cf20 0x7fe4b00c9590 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fe49800c3c0 tx=0x7fe4980012f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:16.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.808+0000 7fe4ad7fa700 1 -- 172.21.15.149:0/2613434654 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe498016040 con 0x7fe4b015cf20 2023-11-08T19:26:16.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.808+0000 7fe4ad7fa700 1 -- 172.21.15.149:0/2613434654 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4980054e0 con 0x7fe4b015cf20 2023-11-08T19:26:16.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.808+0000 7fe4ad7fa700 1 -- 172.21.15.149:0/2613434654 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe498007260 con 0x7fe4b015cf20 2023-11-08T19:26:16.826 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.808+0000 7fe4b630b700 1 -- 172.21.15.149:0/2613434654 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4b009b960 con 0x7fe4b015cf20 2023-11-08T19:26:16.826 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.808+0000 7fe4b630b700 1 -- 172.21.15.149:0/2613434654 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4b009be80 con 0x7fe4b015cf20 2023-11-08T19:26:16.826 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.809+0000 7fe4b630b700 1 -- 172.21.15.149:0/2613434654 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4b009bcd0 con 0x7fe4b015cf20 2023-11-08T19:26:16.826 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.810+0000 7fe4ad7fa700 1 -- 172.21.15.149:0/2613434654 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe4980073c0 con 0x7fe4b015cf20 2023-11-08T19:26:16.826 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.810+0000 7fe4ad7fa700 1 --2- 172.21.15.149:0/2613434654 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe49006af00 0x7fe49006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:16.827 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.810+0000 7fe4ad7fa700 1 -- 172.21.15.149:0/2613434654 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7fe49808a910 con 0x7fe4b015cf20 2023-11-08T19:26:16.827 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.810+0000 7fe4affff700 1 --2- 172.21.15.149:0/2613434654 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe49006af00 0x7fe49006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:16.827 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.811+0000 7fe4affff700 1 --2- 172.21.15.149:0/2613434654 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe49006af00 0x7fe49006d3c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0001360 tx=0x7fe4a0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:16.827 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:16.815+0000 7fe4ad7fa700 1 -- 172.21.15.149:0/2613434654 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe498055600 con 0x7fe4b015cf20 2023-11-08T19:26:17.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.000+0000 7fe4b630b700 1 -- 172.21.15.149:0/2613434654 --> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe4b00c3e10 con 0x7fe49006af00 2023-11-08T19:26:17.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.013+0000 7fe4ad7fa700 1 -- 172.21.15.149:0/2613434654 <== mgr.4104 v2:172.21.15.149:6832/1929837472 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+523682 (secure 0 0 0) 0x7fe4b00c3e10 con 0x7fe49006af00 2023-11-08T19:26:17.021 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:26:17.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.017+0000 7fe4b630b700 1 -- 172.21.15.149:0/2613434654 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe49006af00 msgr2=0x7fe49006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:17.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.017+0000 7fe4b630b700 1 --2- 172.21.15.149:0/2613434654 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe49006af00 0x7fe49006d3c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0001360 tx=0x7fe4a0009040 comp rx=0 tx=0).stop 2023-11-08T19:26:17.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.018+0000 7fe4b630b700 1 -- 172.21.15.149:0/2613434654 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4b015cf20 msgr2=0x7fe4b00c9590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:17.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.018+0000 7fe4b630b700 1 --2- 172.21.15.149:0/2613434654 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4b015cf20 0x7fe4b00c9590 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fe49800c3c0 tx=0x7fe4980012f0 comp rx=0 tx=0).stop 2023-11-08T19:26:17.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.018+0000 7fe4b630b700 1 -- 172.21.15.149:0/2613434654 shutdown_connections 2023-11-08T19:26:17.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.018+0000 7fe4b630b700 1 --2- 172.21.15.149:0/2613434654 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe49006af00 0x7fe49006d3c0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:17.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.018+0000 7fe4b630b700 1 --2- 172.21.15.149:0/2613434654 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe49c003f70 0x7fe4b0158f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:17.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.018+0000 7fe4b630b700 1 --2- 172.21.15.149:0/2613434654 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe4b015d3a0 0x7fe4b00c9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:17.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.018+0000 7fe4b630b700 1 --2- 172.21.15.149:0/2613434654 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4b015cf20 0x7fe4b00c9590 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:17.032 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.018+0000 7fe4b630b700 1 -- 172.21.15.149:0/2613434654 >> 172.21.15.149:0/2613434654 conn(0x7fe4b0099a40 msgr2=0x7fe4b006f6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:17.032 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.018+0000 7fe4b630b700 1 -- 172.21.15.149:0/2613434654 shutdown_connections 2023-11-08T19:26:17.032 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.018+0000 7fe4b630b700 1 -- 172.21.15.149:0/2613434654 wait complete. 2023-11-08T19:26:17.032 INFO:teuthology.orchestra.run.smithi149.stderr:dumped all 2023-11-08T19:26:17.033 INFO:teuthology.orchestra.run.smithi149.stdout:{"pg_ready":true,"pg_map":{"version":176,"stamp":"2023-11-08T19:26:16.028781+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590480,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":164,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":221,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225012,"kb_used_data":8852,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754749708,"statfs":{"total":773094113280,"available":772863700992,"internally_reserved":0,"allocated":9064448,"data_stored":4954891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.905889"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.132306+0000","last_change":"2023-11-08T19:26:11.132306+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.132306+0000","last_undegraded":"2023-11-08T19:26:11.132306+0000","last_fullsized":"2023-11-08T19:26:11.132306+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.130646+0000","last_change":"2023-11-08T19:26:11.130646+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.130646+0000","last_undegraded":"2023-11-08T19:26:11.130646+0000","last_fullsized":"2023-11-08T19:26:11.130646+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.134023+0000","last_change":"2023-11-08T19:26:11.134023+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.134023+0000","last_undegraded":"2023-11-08T19:26:11.134023+0000","last_fullsized":"2023-11-08T19:26:11.134023+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.158573+0000","last_change":"2023-11-08T19:26:12.159151+0000","last_active":"2023-11-08T19:26:13.158573+0000","last_peered":"2023-11-08T19:26:13.158573+0000","last_clean":"2023-11-08T19:26:13.158573+0000","last_became_active":"2023-11-08T19:26:12.158889+0000","last_became_peered":"2023-11-08T19:26:12.158889+0000","last_unstale":"2023-11-08T19:26:13.158573+0000","last_undegraded":"2023-11-08T19:26:13.158573+0000","last_fullsized":"2023-11-08T19:26:13.158573+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:40:48.988790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.157287+0000","last_change":"2023-11-08T19:26:12.159875+0000","last_active":"2023-11-08T19:26:13.157287+0000","last_peered":"2023-11-08T19:26:13.157287+0000","last_clean":"2023-11-08T19:26:13.157287+0000","last_became_active":"2023-11-08T19:26:12.159616+0000","last_became_peered":"2023-11-08T19:26:12.159616+0000","last_unstale":"2023-11-08T19:26:13.157287+0000","last_undegraded":"2023-11-08T19:26:13.157287+0000","last_fullsized":"2023-11-08T19:26:13.157287+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:31:03.813978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.131549+0000","last_change":"2023-11-08T19:26:11.131549+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.131549+0000","last_undegraded":"2023-11-08T19:26:11.131549+0000","last_fullsized":"2023-11-08T19:26:11.131549+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.158902+0000","last_change":"2023-11-08T19:26:12.163084+0000","last_active":"2023-11-08T19:26:13.158902+0000","last_peered":"2023-11-08T19:26:13.158902+0000","last_clean":"2023-11-08T19:26:13.158902+0000","last_became_active":"2023-11-08T19:26:12.162467+0000","last_became_peered":"2023-11-08T19:26:12.162467+0000","last_unstale":"2023-11-08T19:26:13.158902+0000","last_undegraded":"2023-11-08T19:26:13.158902+0000","last_fullsized":"2023-11-08T19:26:13.158902+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:15:38.428199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.130524+0000","last_change":"2023-11-08T19:26:11.130524+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.130524+0000","last_undegraded":"2023-11-08T19:26:11.130524+0000","last_fullsized":"2023-11-08T19:26:11.130524+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.132912+0000","last_change":"2023-11-08T19:26:11.132912+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.132912+0000","last_undegraded":"2023-11-08T19:26:11.132912+0000","last_fullsized":"2023-11-08T19:26:11.132912+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.132409+0000","last_change":"2023-11-08T19:26:11.132409+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.132409+0000","last_undegraded":"2023-11-08T19:26:11.132409+0000","last_fullsized":"2023-11-08T19:26:11.132409+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.157213+0000","last_change":"2023-11-08T19:26:12.171269+0000","last_active":"2023-11-08T19:26:13.157213+0000","last_peered":"2023-11-08T19:26:13.157213+0000","last_clean":"2023-11-08T19:26:13.157213+0000","last_became_active":"2023-11-08T19:26:12.171009+0000","last_became_peered":"2023-11-08T19:26:12.171009+0000","last_unstale":"2023-11-08T19:26:13.157213+0000","last_undegraded":"2023-11-08T19:26:13.157213+0000","last_fullsized":"2023-11-08T19:26:13.157213+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:19:17.065471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.132284+0000","last_change":"2023-11-08T19:26:11.132284+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.132284+0000","last_undegraded":"2023-11-08T19:26:11.132284+0000","last_fullsized":"2023-11-08T19:26:11.132284+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.131376+0000","last_change":"2023-11-08T19:26:11.131376+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.131376+0000","last_undegraded":"2023-11-08T19:26:11.131376+0000","last_fullsized":"2023-11-08T19:26:11.131376+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.157398+0000","last_change":"2023-11-08T19:26:12.171667+0000","last_active":"2023-11-08T19:26:13.157398+0000","last_peered":"2023-11-08T19:26:13.157398+0000","last_clean":"2023-11-08T19:26:13.157398+0000","last_became_active":"2023-11-08T19:26:12.169680+0000","last_became_peered":"2023-11-08T19:26:12.169680+0000","last_unstale":"2023-11-08T19:26:13.157398+0000","last_undegraded":"2023-11-08T19:26:13.157398+0000","last_fullsized":"2023-11-08T19:26:13.157398+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:04:11.614632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.158798+0000","last_change":"2023-11-08T19:26:12.168622+0000","last_active":"2023-11-08T19:26:13.158798+0000","last_peered":"2023-11-08T19:26:13.158798+0000","last_clean":"2023-11-08T19:26:13.158798+0000","last_became_active":"2023-11-08T19:26:12.168321+0000","last_became_peered":"2023-11-08T19:26:12.168321+0000","last_unstale":"2023-11-08T19:26:13.158798+0000","last_undegraded":"2023-11-08T19:26:13.158798+0000","last_fullsized":"2023-11-08T19:26:13.158798+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:45:37.194772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.132057+0000","last_change":"2023-11-08T19:26:11.132057+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.132057+0000","last_undegraded":"2023-11-08T19:26:11.132057+0000","last_fullsized":"2023-11-08T19:26:11.132057+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.130468+0000","last_change":"2023-11-08T19:26:11.130468+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.130468+0000","last_undegraded":"2023-11-08T19:26:11.130468+0000","last_fullsized":"2023-11-08T19:26:11.130468+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.f","version":"82'1","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.173319+0000","last_change":"2023-11-08T19:26:11.143492+0000","last_active":"2023-11-08T19:26:12.173319+0000","last_peered":"2023-11-08T19:26:12.173319+0000","last_clean":"2023-11-08T19:26:12.173319+0000","last_became_active":"2023-11-08T19:26:11.143296+0000","last_became_peered":"2023-11-08T19:26:11.143296+0000","last_unstale":"2023-11-08T19:26:12.173319+0000","last_undegraded":"2023-11-08T19:26:12.173319+0000","last_fullsized":"2023-11-08T19:26:12.173319+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:58:53.201963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.127738+0000","last_change":"2023-11-08T19:25:47.285071+0000","last_active":"2023-11-08T19:26:10.127738+0000","last_peered":"2023-11-08T19:26:10.127738+0000","last_clean":"2023-11-08T19:26:10.127738+0000","last_became_active":"2023-11-08T19:25:47.284788+0000","last_became_peered":"2023-11-08T19:25:47.284788+0000","last_unstale":"2023-11-08T19:26:10.127738+0000","last_undegraded":"2023-11-08T19:26:10.127738+0000","last_fullsized":"2023-11-08T19:26:10.127738+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:50:50.522780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":218,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.150652+0000","last_change":"2023-11-08T19:22:58.054283+0000","last_active":"2023-11-08T19:26:12.150652+0000","last_peered":"2023-11-08T19:26:12.150652+0000","last_clean":"2023-11-08T19:26:12.150652+0000","last_became_active":"2023-11-08T19:22:58.053337+0000","last_became_peered":"2023-11-08T19:22:58.053337+0000","last_unstale":"2023-11-08T19:26:12.150652+0000","last_undegraded":"2023-11-08T19:26:12.150652+0000","last_fullsized":"2023-11-08T19:26:12.150652+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:22:56.479654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:22:56.479654+0000","last_clean_scrub_stamp":"2023-11-08T19:22:56.479654+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:16:05.317001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.536896+0000","last_change":"2023-11-08T19:24:32.530665+0000","last_active":"2023-11-08T19:26:06.536896+0000","last_peered":"2023-11-08T19:26:06.536896+0000","last_clean":"2023-11-08T19:26:06.536896+0000","last_became_active":"2023-11-08T19:24:31.148363+0000","last_became_peered":"2023-11-08T19:24:31.148363+0000","last_unstale":"2023-11-08T19:26:06.536896+0000","last_undegraded":"2023-11-08T19:26:06.536896+0000","last_fullsized":"2023-11-08T19:26:06.536896+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:02:27.987795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075444200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.152384+0000","last_change":"2023-11-08T19:25:48.371346+0000","last_active":"2023-11-08T19:26:12.152384+0000","last_peered":"2023-11-08T19:26:12.152384+0000","last_clean":"2023-11-08T19:26:12.152384+0000","last_became_active":"2023-11-08T19:25:46.289470+0000","last_became_peered":"2023-11-08T19:25:46.289470+0000","last_unstale":"2023-11-08T19:26:12.152384+0000","last_undegraded":"2023-11-08T19:26:12.152384+0000","last_fullsized":"2023-11-08T19:26:12.152384+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:25:34.010085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000371219,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.128507+0000","last_change":"2023-11-08T19:26:10.128507+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.128507+0000","last_undegraded":"2023-11-08T19:26:10.128507+0000","last_fullsized":"2023-11-08T19:26:10.128507+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.656777+0000","last_change":"2023-11-08T19:25:47.283242+0000","last_active":"2023-11-08T19:26:06.656777+0000","last_peered":"2023-11-08T19:26:06.656777+0000","last_clean":"2023-11-08T19:26:06.656777+0000","last_became_active":"2023-11-08T19:25:47.282922+0000","last_became_peered":"2023-11-08T19:25:47.282922+0000","last_unstale":"2023-11-08T19:26:06.656777+0000","last_undegraded":"2023-11-08T19:26:06.656777+0000","last_fullsized":"2023-11-08T19:26:06.656777+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:26:23.400596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":48,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.126032+0000","last_change":"2023-11-08T19:24:32.544333+0000","last_active":"2023-11-08T19:26:10.126032+0000","last_peered":"2023-11-08T19:26:10.126032+0000","last_clean":"2023-11-08T19:26:10.126032+0000","last_became_active":"2023-11-08T19:24:31.138598+0000","last_became_peered":"2023-11-08T19:24:31.138598+0000","last_unstale":"2023-11-08T19:26:10.126032+0000","last_undegraded":"2023-11-08T19:26:10.126032+0000","last_fullsized":"2023-11-08T19:26:10.126032+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:11.860580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015114824000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.656459+0000","last_change":"2023-11-08T19:25:48.374357+0000","last_active":"2023-11-08T19:26:06.656459+0000","last_peered":"2023-11-08T19:26:06.656459+0000","last_clean":"2023-11-08T19:26:06.656459+0000","last_became_active":"2023-11-08T19:25:46.279007+0000","last_became_peered":"2023-11-08T19:25:46.279007+0000","last_unstale":"2023-11-08T19:26:06.656459+0000","last_undegraded":"2023-11-08T19:26:06.656459+0000","last_fullsized":"2023-11-08T19:26:06.656459+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:59:30.845191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036813240000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.127179+0000","last_change":"2023-11-08T19:26:10.127179+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.127179+0000","last_undegraded":"2023-11-08T19:26:10.127179+0000","last_fullsized":"2023-11-08T19:26:10.127179+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":19,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.655722+0000","last_change":"2023-11-08T19:25:47.285093+0000","last_active":"2023-11-08T19:26:06.655722+0000","last_peered":"2023-11-08T19:26:06.655722+0000","last_clean":"2023-11-08T19:26:06.655722+0000","last_became_active":"2023-11-08T19:25:47.284796+0000","last_became_peered":"2023-11-08T19:25:47.284796+0000","last_unstale":"2023-11-08T19:26:06.655722+0000","last_undegraded":"2023-11-08T19:26:06.655722+0000","last_fullsized":"2023-11-08T19:26:06.655722+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:46:36.504650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":48,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.126151+0000","last_change":"2023-11-08T19:24:32.544285+0000","last_active":"2023-11-08T19:26:10.126151+0000","last_peered":"2023-11-08T19:26:10.126151+0000","last_clean":"2023-11-08T19:26:10.126151+0000","last_became_active":"2023-11-08T19:24:31.142028+0000","last_became_peered":"2023-11-08T19:24:31.142028+0000","last_unstale":"2023-11-08T19:26:10.126151+0000","last_undegraded":"2023-11-08T19:26:10.126151+0000","last_fullsized":"2023-11-08T19:26:10.126151+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:01:24.198196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067537399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.125396+0000","last_change":"2023-11-08T19:25:48.372192+0000","last_active":"2023-11-08T19:26:10.125396+0000","last_peered":"2023-11-08T19:26:10.125396+0000","last_clean":"2023-11-08T19:26:10.125396+0000","last_became_active":"2023-11-08T19:25:46.288739+0000","last_became_peered":"2023-11-08T19:25:46.288739+0000","last_unstale":"2023-11-08T19:26:10.125396+0000","last_undegraded":"2023-11-08T19:26:10.125396+0000","last_fullsized":"2023-11-08T19:26:10.125396+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:45:04.839053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015057530000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.126826+0000","last_change":"2023-11-08T19:26:10.126826+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.126826+0000","last_undegraded":"2023-11-08T19:26:10.126826+0000","last_fullsized":"2023-11-08T19:26:10.126826+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.656592+0000","last_change":"2023-11-08T19:25:47.287920+0000","last_active":"2023-11-08T19:26:06.656592+0000","last_peered":"2023-11-08T19:26:06.656592+0000","last_clean":"2023-11-08T19:26:06.656592+0000","last_became_active":"2023-11-08T19:25:47.287494+0000","last_became_peered":"2023-11-08T19:25:47.287494+0000","last_unstale":"2023-11-08T19:26:06.656592+0000","last_undegraded":"2023-11-08T19:26:06.656592+0000","last_fullsized":"2023-11-08T19:26:06.656592+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:42:18.942062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":49,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.655728+0000","last_change":"2023-11-08T19:24:32.142836+0000","last_active":"2023-11-08T19:26:06.655728+0000","last_peered":"2023-11-08T19:26:06.655728+0000","last_clean":"2023-11-08T19:26:06.655728+0000","last_became_active":"2023-11-08T19:24:31.141367+0000","last_became_peered":"2023-11-08T19:24:31.141367+0000","last_unstale":"2023-11-08T19:26:06.655728+0000","last_undegraded":"2023-11-08T19:26:06.655728+0000","last_fullsized":"2023-11-08T19:26:06.655728+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:39.214888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001335136,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.126066+0000","last_change":"2023-11-08T19:25:48.372718+0000","last_active":"2023-11-08T19:26:10.126066+0000","last_peered":"2023-11-08T19:26:10.126066+0000","last_clean":"2023-11-08T19:26:10.126066+0000","last_became_active":"2023-11-08T19:25:46.289283+0000","last_became_peered":"2023-11-08T19:25:46.289283+0000","last_unstale":"2023-11-08T19:26:10.126066+0000","last_undegraded":"2023-11-08T19:26:10.126066+0000","last_fullsized":"2023-11-08T19:26:10.126066+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:15:51.881891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001274049,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.127425+0000","last_change":"2023-11-08T19:26:10.127425+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.127425+0000","last_undegraded":"2023-11-08T19:26:10.127425+0000","last_fullsized":"2023-11-08T19:26:10.127425+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":19,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.655831+0000","last_change":"2023-11-08T19:25:47.285353+0000","last_active":"2023-11-08T19:26:06.655831+0000","last_peered":"2023-11-08T19:26:06.655831+0000","last_clean":"2023-11-08T19:26:06.655831+0000","last_became_active":"2023-11-08T19:25:47.285075+0000","last_became_peered":"2023-11-08T19:25:47.285075+0000","last_unstale":"2023-11-08T19:26:06.655831+0000","last_undegraded":"2023-11-08T19:26:06.655831+0000","last_fullsized":"2023-11-08T19:26:06.655831+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:20:50.791463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":55,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.124563+0000","last_change":"2023-11-08T19:24:32.139885+0000","last_active":"2023-11-08T19:26:10.124563+0000","last_peered":"2023-11-08T19:26:10.124563+0000","last_clean":"2023-11-08T19:26:10.124563+0000","last_became_active":"2023-11-08T19:24:31.145329+0000","last_became_peered":"2023-11-08T19:24:31.145329+0000","last_unstale":"2023-11-08T19:26:10.124563+0000","last_undegraded":"2023-11-08T19:26:10.124563+0000","last_fullsized":"2023-11-08T19:26:10.124563+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:25:18.356784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049012999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.656819+0000","last_change":"2023-11-08T19:25:48.373848+0000","last_active":"2023-11-08T19:26:06.656819+0000","last_peered":"2023-11-08T19:26:06.656819+0000","last_clean":"2023-11-08T19:26:06.656819+0000","last_became_active":"2023-11-08T19:25:46.282174+0000","last_became_peered":"2023-11-08T19:25:46.282174+0000","last_unstale":"2023-11-08T19:26:06.656819+0000","last_undegraded":"2023-11-08T19:26:06.656819+0000","last_fullsized":"2023-11-08T19:26:06.656819+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:00:06.938052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000727792,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":3,"reported_epoch":81,"state":"creating+activating","last_fresh":"2023-11-08T19:26:11.130325+0000","last_change":"2023-11-08T19:26:11.130325+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.130325+0000","last_undegraded":"2023-11-08T19:26:11.130325+0000","last_fullsized":"2023-11-08T19:26:11.130325+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:26:26.007199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":["4","2"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.124963+0000","last_change":"2023-11-08T19:25:47.287677+0000","last_active":"2023-11-08T19:26:10.124963+0000","last_peered":"2023-11-08T19:26:10.124963+0000","last_clean":"2023-11-08T19:26:10.124963+0000","last_became_active":"2023-11-08T19:25:47.287419+0000","last_became_peered":"2023-11-08T19:25:47.287419+0000","last_unstale":"2023-11-08T19:26:10.124963+0000","last_undegraded":"2023-11-08T19:26:10.124963+0000","last_fullsized":"2023-11-08T19:26:10.124963+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:22:08.770702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":53,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.373729+0000","last_change":"2023-11-08T19:24:32.140880+0000","last_active":"2023-11-08T19:26:06.373729+0000","last_peered":"2023-11-08T19:26:06.373729+0000","last_clean":"2023-11-08T19:26:06.373729+0000","last_became_active":"2023-11-08T19:24:31.146063+0000","last_became_peered":"2023-11-08T19:24:31.146063+0000","last_unstale":"2023-11-08T19:26:06.373729+0000","last_undegraded":"2023-11-08T19:26:06.373729+0000","last_fullsized":"2023-11-08T19:26:06.373729+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:54:08.985813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089896300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.536953+0000","last_change":"2023-11-08T19:25:48.374690+0000","last_active":"2023-11-08T19:26:06.536953+0000","last_peered":"2023-11-08T19:26:06.536953+0000","last_clean":"2023-11-08T19:26:06.536953+0000","last_became_active":"2023-11-08T19:25:46.281986+0000","last_became_peered":"2023-11-08T19:25:46.281986+0000","last_unstale":"2023-11-08T19:26:06.536953+0000","last_undegraded":"2023-11-08T19:26:06.536953+0000","last_fullsized":"2023-11-08T19:26:06.536953+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:21:00.981136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003067771,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.122829+0000","last_change":"2023-11-08T19:26:10.122829+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.122829+0000","last_undegraded":"2023-11-08T19:26:10.122829+0000","last_fullsized":"2023-11-08T19:26:10.122829+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.152860+0000","last_change":"2023-11-08T19:25:47.287986+0000","last_active":"2023-11-08T19:26:12.152860+0000","last_peered":"2023-11-08T19:26:12.152860+0000","last_clean":"2023-11-08T19:26:12.152860+0000","last_became_active":"2023-11-08T19:25:47.287560+0000","last_became_peered":"2023-11-08T19:25:47.287560+0000","last_unstale":"2023-11-08T19:26:12.152860+0000","last_undegraded":"2023-11-08T19:26:12.152860+0000","last_fullsized":"2023-11-08T19:26:12.152860+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:35:31.433056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.537019+0000","last_change":"2023-11-08T19:24:32.530620+0000","last_active":"2023-11-08T19:26:06.537019+0000","last_peered":"2023-11-08T19:26:06.537019+0000","last_clean":"2023-11-08T19:26:06.537019+0000","last_became_active":"2023-11-08T19:24:31.144223+0000","last_became_peered":"2023-11-08T19:24:31.144223+0000","last_unstale":"2023-11-08T19:26:06.537019+0000","last_undegraded":"2023-11-08T19:26:06.537019+0000","last_fullsized":"2023-11-08T19:26:06.537019+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:01:25.647952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071879799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.373882+0000","last_change":"2023-11-08T19:25:48.285326+0000","last_active":"2023-11-08T19:26:06.373882+0000","last_peered":"2023-11-08T19:26:06.373882+0000","last_clean":"2023-11-08T19:26:06.373882+0000","last_became_active":"2023-11-08T19:25:46.278686+0000","last_became_peered":"2023-11-08T19:25:46.278686+0000","last_unstale":"2023-11-08T19:26:06.373882+0000","last_undegraded":"2023-11-08T19:26:06.373882+0000","last_fullsized":"2023-11-08T19:26:06.373882+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:25:34.010085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078409499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.159113+0000","last_change":"2023-11-08T19:26:12.163265+0000","last_active":"2023-11-08T19:26:13.159113+0000","last_peered":"2023-11-08T19:26:13.159113+0000","last_clean":"2023-11-08T19:26:13.159113+0000","last_became_active":"2023-11-08T19:26:12.162822+0000","last_became_peered":"2023-11-08T19:26:12.162822+0000","last_unstale":"2023-11-08T19:26:13.159113+0000","last_undegraded":"2023-11-08T19:26:13.159113+0000","last_fullsized":"2023-11-08T19:26:13.159113+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:45:22.870353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.129895+0000","last_change":"2023-11-08T19:26:10.129895+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.129895+0000","last_undegraded":"2023-11-08T19:26:10.129895+0000","last_fullsized":"2023-11-08T19:26:10.129895+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":20,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.373428+0000","last_change":"2023-11-08T19:25:47.289726+0000","last_active":"2023-11-08T19:26:06.373428+0000","last_peered":"2023-11-08T19:26:06.373428+0000","last_clean":"2023-11-08T19:26:06.373428+0000","last_became_active":"2023-11-08T19:25:47.289362+0000","last_became_peered":"2023-11-08T19:25:47.289362+0000","last_unstale":"2023-11-08T19:26:06.373428+0000","last_undegraded":"2023-11-08T19:26:06.373428+0000","last_fullsized":"2023-11-08T19:26:06.373428+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:38:55.785104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.152547+0000","last_change":"2023-11-08T19:24:32.147025+0000","last_active":"2023-11-08T19:26:12.152547+0000","last_peered":"2023-11-08T19:26:12.152547+0000","last_clean":"2023-11-08T19:26:12.152547+0000","last_became_active":"2023-11-08T19:24:31.147082+0000","last_became_peered":"2023-11-08T19:24:31.147082+0000","last_unstale":"2023-11-08T19:26:12.152547+0000","last_undegraded":"2023-11-08T19:26:12.152547+0000","last_fullsized":"2023-11-08T19:26:12.152547+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:02:27.987795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043701599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.537040+0000","last_change":"2023-11-08T19:25:48.374739+0000","last_active":"2023-11-08T19:26:06.537040+0000","last_peered":"2023-11-08T19:26:06.537040+0000","last_clean":"2023-11-08T19:26:06.537040+0000","last_became_active":"2023-11-08T19:25:46.282071+0000","last_became_peered":"2023-11-08T19:25:46.282071+0000","last_unstale":"2023-11-08T19:26:06.537040+0000","last_undegraded":"2023-11-08T19:26:06.537040+0000","last_fullsized":"2023-11-08T19:26:06.537040+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:42:47.677504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023654909999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.128081+0000","last_change":"2023-11-08T19:26:10.128081+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.128081+0000","last_undegraded":"2023-11-08T19:26:10.128081+0000","last_fullsized":"2023-11-08T19:26:10.128081+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":48,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.126115+0000","last_change":"2023-11-08T19:24:32.544063+0000","last_active":"2023-11-08T19:26:10.126115+0000","last_peered":"2023-11-08T19:26:10.126115+0000","last_clean":"2023-11-08T19:26:10.126115+0000","last_became_active":"2023-11-08T19:24:31.144795+0000","last_became_peered":"2023-11-08T19:24:31.144795+0000","last_unstale":"2023-11-08T19:26:10.126115+0000","last_undegraded":"2023-11-08T19:26:10.126115+0000","last_fullsized":"2023-11-08T19:26:10.126115+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:12:42.248307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01495431,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.372839+0000","last_change":"2023-11-08T19:25:48.283673+0000","last_active":"2023-11-08T19:26:06.372839+0000","last_peered":"2023-11-08T19:26:06.372839+0000","last_clean":"2023-11-08T19:26:06.372839+0000","last_became_active":"2023-11-08T19:25:46.285766+0000","last_became_peered":"2023-11-08T19:25:46.285766+0000","last_unstale":"2023-11-08T19:26:06.372839+0000","last_undegraded":"2023-11-08T19:26:06.372839+0000","last_fullsized":"2023-11-08T19:26:06.372839+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:46:35.498766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001756748,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.150819+0000","last_change":"2023-11-08T19:25:47.288301+0000","last_active":"2023-11-08T19:26:12.150819+0000","last_peered":"2023-11-08T19:26:12.150819+0000","last_clean":"2023-11-08T19:26:12.150819+0000","last_became_active":"2023-11-08T19:25:47.288027+0000","last_became_peered":"2023-11-08T19:25:47.288027+0000","last_unstale":"2023-11-08T19:26:12.150819+0000","last_undegraded":"2023-11-08T19:26:12.150819+0000","last_fullsized":"2023-11-08T19:26:12.150819+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:23:13.428596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.129880+0000","last_change":"2023-11-08T19:26:11.129880+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.129880+0000","last_undegraded":"2023-11-08T19:26:11.129880+0000","last_fullsized":"2023-11-08T19:26:11.129880+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.123109+0000","last_change":"2023-11-08T19:26:10.123109+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.123109+0000","last_undegraded":"2023-11-08T19:26:10.123109+0000","last_fullsized":"2023-11-08T19:26:10.123109+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":49,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.125528+0000","last_change":"2023-11-08T19:24:32.263810+0000","last_active":"2023-11-08T19:26:10.125528+0000","last_peered":"2023-11-08T19:26:10.125528+0000","last_clean":"2023-11-08T19:26:10.125528+0000","last_became_active":"2023-11-08T19:24:31.138814+0000","last_became_peered":"2023-11-08T19:24:31.138814+0000","last_unstale":"2023-11-08T19:26:10.125528+0000","last_undegraded":"2023-11-08T19:26:10.125528+0000","last_fullsized":"2023-11-08T19:26:10.125528+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:21:55.985548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048136000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.124329+0000","last_change":"2023-11-08T19:25:48.283572+0000","last_active":"2023-11-08T19:26:10.124329+0000","last_peered":"2023-11-08T19:26:10.124329+0000","last_clean":"2023-11-08T19:26:10.124329+0000","last_became_active":"2023-11-08T19:25:46.271936+0000","last_became_peered":"2023-11-08T19:25:46.271936+0000","last_unstale":"2023-11-08T19:26:10.124329+0000","last_undegraded":"2023-11-08T19:26:10.124329+0000","last_fullsized":"2023-11-08T19:26:10.124329+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:46:11.541748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00186835,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":20,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.372680+0000","last_change":"2023-11-08T19:25:47.282856+0000","last_active":"2023-11-08T19:26:06.372680+0000","last_peered":"2023-11-08T19:26:06.372680+0000","last_clean":"2023-11-08T19:26:06.372680+0000","last_became_active":"2023-11-08T19:25:47.282594+0000","last_became_peered":"2023-11-08T19:25:47.282594+0000","last_unstale":"2023-11-08T19:26:06.372680+0000","last_undegraded":"2023-11-08T19:26:06.372680+0000","last_fullsized":"2023-11-08T19:26:06.372680+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:14:12.111756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":3,"reported_epoch":81,"state":"creating+activating","last_fresh":"2023-11-08T19:26:11.131733+0000","last_change":"2023-11-08T19:26:11.131733+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.131733+0000","last_undegraded":"2023-11-08T19:26:11.131733+0000","last_fullsized":"2023-11-08T19:26:11.131733+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:23:55.641598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.656539+0000","last_change":"2023-11-08T19:24:32.333096+0000","last_active":"2023-11-08T19:26:06.656539+0000","last_peered":"2023-11-08T19:26:06.656539+0000","last_clean":"2023-11-08T19:26:06.656539+0000","last_became_active":"2023-11-08T19:24:31.142985+0000","last_became_peered":"2023-11-08T19:24:31.142985+0000","last_unstale":"2023-11-08T19:26:06.656539+0000","last_undegraded":"2023-11-08T19:26:06.656539+0000","last_fullsized":"2023-11-08T19:26:06.656539+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:36:33.274496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000386048,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.536827+0000","last_change":"2023-11-08T19:25:48.372963+0000","last_active":"2023-11-08T19:26:06.536827+0000","last_peered":"2023-11-08T19:26:06.536827+0000","last_clean":"2023-11-08T19:26:06.536827+0000","last_became_active":"2023-11-08T19:25:46.283263+0000","last_became_peered":"2023-11-08T19:25:46.283263+0000","last_unstale":"2023-11-08T19:26:06.536827+0000","last_undegraded":"2023-11-08T19:26:06.536827+0000","last_fullsized":"2023-11-08T19:26:06.536827+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:25:34.010085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019848779999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":19,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.655803+0000","last_change":"2023-11-08T19:25:47.284816+0000","last_active":"2023-11-08T19:26:06.655803+0000","last_peered":"2023-11-08T19:26:06.655803+0000","last_clean":"2023-11-08T19:26:06.655803+0000","last_became_active":"2023-11-08T19:25:47.284522+0000","last_became_peered":"2023-11-08T19:25:47.284522+0000","last_unstale":"2023-11-08T19:26:06.655803+0000","last_undegraded":"2023-11-08T19:26:06.655803+0000","last_fullsized":"2023-11-08T19:26:06.655803+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:39:28.223686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.129454+0000","last_change":"2023-11-08T19:26:10.129454+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.129454+0000","last_undegraded":"2023-11-08T19:26:10.129454+0000","last_fullsized":"2023-11-08T19:26:10.129454+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.536570+0000","last_change":"2023-11-08T19:24:32.530333+0000","last_active":"2023-11-08T19:26:06.536570+0000","last_peered":"2023-11-08T19:26:06.536570+0000","last_clean":"2023-11-08T19:26:06.536570+0000","last_became_active":"2023-11-08T19:24:31.144838+0000","last_became_peered":"2023-11-08T19:24:31.144838+0000","last_unstale":"2023-11-08T19:26:06.536570+0000","last_undegraded":"2023-11-08T19:26:06.536570+0000","last_fullsized":"2023-11-08T19:26:06.536570+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:39:48.473183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081588799999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.124486+0000","last_change":"2023-11-08T19:25:48.284699+0000","last_active":"2023-11-08T19:26:10.124486+0000","last_peered":"2023-11-08T19:26:10.124486+0000","last_clean":"2023-11-08T19:26:10.124486+0000","last_became_active":"2023-11-08T19:25:46.285588+0000","last_became_peered":"2023-11-08T19:25:46.285588+0000","last_unstale":"2023-11-08T19:26:10.124486+0000","last_undegraded":"2023-11-08T19:26:10.124486+0000","last_fullsized":"2023-11-08T19:26:10.124486+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:43:02.001903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023282350000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.536701+0000","last_change":"2023-11-08T19:25:47.283526+0000","last_active":"2023-11-08T19:26:06.536701+0000","last_peered":"2023-11-08T19:26:06.536701+0000","last_clean":"2023-11-08T19:26:06.536701+0000","last_became_active":"2023-11-08T19:25:47.283266+0000","last_became_peered":"2023-11-08T19:25:47.283266+0000","last_unstale":"2023-11-08T19:26:06.536701+0000","last_undegraded":"2023-11-08T19:26:06.536701+0000","last_fullsized":"2023-11-08T19:26:06.536701+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:35:31.433056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.127556+0000","last_change":"2023-11-08T19:26:10.127556+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.127556+0000","last_undegraded":"2023-11-08T19:26:10.127556+0000","last_fullsized":"2023-11-08T19:26:10.127556+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.657341+0000","last_change":"2023-11-08T19:24:32.333430+0000","last_active":"2023-11-08T19:26:06.657341+0000","last_peered":"2023-11-08T19:26:06.657341+0000","last_clean":"2023-11-08T19:26:06.657341+0000","last_became_active":"2023-11-08T19:24:31.141710+0000","last_became_peered":"2023-11-08T19:24:31.141710+0000","last_unstale":"2023-11-08T19:26:06.657341+0000","last_undegraded":"2023-11-08T19:26:06.657341+0000","last_fullsized":"2023-11-08T19:26:06.657341+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:32:51.214551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000430438,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.373255+0000","last_change":"2023-11-08T19:25:48.283855+0000","last_active":"2023-11-08T19:26:06.373255+0000","last_peered":"2023-11-08T19:26:06.373255+0000","last_clean":"2023-11-08T19:26:06.373255+0000","last_became_active":"2023-11-08T19:25:46.273336+0000","last_became_peered":"2023-11-08T19:25:46.273336+0000","last_unstale":"2023-11-08T19:26:06.373255+0000","last_undegraded":"2023-11-08T19:26:06.373255+0000","last_fullsized":"2023-11-08T19:26:06.373255+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:33:35.492889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092577200000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":20,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.373300+0000","last_change":"2023-11-08T19:25:47.282840+0000","last_active":"2023-11-08T19:26:06.373300+0000","last_peered":"2023-11-08T19:26:06.373300+0000","last_clean":"2023-11-08T19:26:06.373300+0000","last_became_active":"2023-11-08T19:25:47.282600+0000","last_became_peered":"2023-11-08T19:25:47.282600+0000","last_unstale":"2023-11-08T19:26:06.373300+0000","last_undegraded":"2023-11-08T19:26:06.373300+0000","last_fullsized":"2023-11-08T19:26:06.373300+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:53:37.482245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.131449+0000","last_change":"2023-11-08T19:26:11.131449+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.131449+0000","last_undegraded":"2023-11-08T19:26:11.131449+0000","last_fullsized":"2023-11-08T19:26:11.131449+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.127954+0000","last_change":"2023-11-08T19:26:10.127954+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.127954+0000","last_undegraded":"2023-11-08T19:26:10.127954+0000","last_fullsized":"2023-11-08T19:26:10.127954+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.124849+0000","last_change":"2023-11-08T19:25:47.285890+0000","last_active":"2023-11-08T19:26:10.124849+0000","last_peered":"2023-11-08T19:26:10.124849+0000","last_clean":"2023-11-08T19:26:10.124849+0000","last_became_active":"2023-11-08T19:25:47.285641+0000","last_became_peered":"2023-11-08T19:25:47.285641+0000","last_unstale":"2023-11-08T19:26:10.124849+0000","last_undegraded":"2023-11-08T19:26:10.124849+0000","last_fullsized":"2023-11-08T19:26:10.124849+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:27:18.335142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.536846+0000","last_change":"2023-11-08T19:24:32.530895+0000","last_active":"2023-11-08T19:26:06.536846+0000","last_peered":"2023-11-08T19:26:06.536846+0000","last_clean":"2023-11-08T19:26:06.536846+0000","last_became_active":"2023-11-08T19:24:31.146715+0000","last_became_peered":"2023-11-08T19:24:31.146715+0000","last_unstale":"2023-11-08T19:26:06.536846+0000","last_undegraded":"2023-11-08T19:26:06.536846+0000","last_fullsized":"2023-11-08T19:26:06.536846+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:39.214888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081671599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.373444+0000","last_change":"2023-11-08T19:25:48.284137+0000","last_active":"2023-11-08T19:26:06.373444+0000","last_peered":"2023-11-08T19:26:06.373444+0000","last_clean":"2023-11-08T19:26:06.373444+0000","last_became_active":"2023-11-08T19:25:46.285960+0000","last_became_peered":"2023-11-08T19:25:46.285960+0000","last_unstale":"2023-11-08T19:26:06.373444+0000","last_undegraded":"2023-11-08T19:26:06.373444+0000","last_fullsized":"2023-11-08T19:26:06.373444+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:26:01.141206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091649099999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.130517+0000","last_change":"2023-11-08T19:26:11.130517+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.130517+0000","last_undegraded":"2023-11-08T19:26:11.130517+0000","last_fullsized":"2023-11-08T19:26:11.130517+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.128682+0000","last_change":"2023-11-08T19:26:10.128682+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.128682+0000","last_undegraded":"2023-11-08T19:26:10.128682+0000","last_fullsized":"2023-11-08T19:26:10.128682+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.125287+0000","last_change":"2023-11-08T19:25:47.283642+0000","last_active":"2023-11-08T19:26:10.125287+0000","last_peered":"2023-11-08T19:26:10.125287+0000","last_clean":"2023-11-08T19:26:10.125287+0000","last_became_active":"2023-11-08T19:25:47.283360+0000","last_became_peered":"2023-11-08T19:25:47.283360+0000","last_unstale":"2023-11-08T19:26:10.125287+0000","last_undegraded":"2023-11-08T19:26:10.125287+0000","last_fullsized":"2023-11-08T19:26:10.125287+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:02:27.950152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":53,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.373531+0000","last_change":"2023-11-08T19:24:32.140167+0000","last_active":"2023-11-08T19:26:06.373531+0000","last_peered":"2023-11-08T19:26:06.373531+0000","last_clean":"2023-11-08T19:26:06.373531+0000","last_became_active":"2023-11-08T19:24:31.147181+0000","last_became_peered":"2023-11-08T19:24:31.147181+0000","last_unstale":"2023-11-08T19:26:06.373531+0000","last_undegraded":"2023-11-08T19:26:06.373531+0000","last_fullsized":"2023-11-08T19:26:06.373531+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:26.080042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057135200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.126009+0000","last_change":"2023-11-08T19:25:48.277705+0000","last_active":"2023-11-08T19:26:10.126009+0000","last_peered":"2023-11-08T19:26:10.126009+0000","last_clean":"2023-11-08T19:26:10.126009+0000","last_became_active":"2023-11-08T19:25:46.288848+0000","last_became_peered":"2023-11-08T19:25:46.288848+0000","last_unstale":"2023-11-08T19:26:10.126009+0000","last_undegraded":"2023-11-08T19:26:10.126009+0000","last_fullsized":"2023-11-08T19:26:10.126009+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:12:24.483185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097653099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.124238+0000","last_change":"2023-11-08T19:26:10.124238+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.124238+0000","last_undegraded":"2023-11-08T19:26:10.124238+0000","last_fullsized":"2023-11-08T19:26:10.124238+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.152208+0000","last_change":"2023-11-08T19:25:47.289456+0000","last_active":"2023-11-08T19:26:12.152208+0000","last_peered":"2023-11-08T19:26:12.152208+0000","last_clean":"2023-11-08T19:26:12.152208+0000","last_became_active":"2023-11-08T19:25:47.289177+0000","last_became_peered":"2023-11-08T19:25:47.289177+0000","last_unstale":"2023-11-08T19:26:12.152208+0000","last_undegraded":"2023-11-08T19:26:12.152208+0000","last_fullsized":"2023-11-08T19:26:12.152208+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:07:11.838364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":53,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.373110+0000","last_change":"2023-11-08T19:24:32.141188+0000","last_active":"2023-11-08T19:26:06.373110+0000","last_peered":"2023-11-08T19:26:06.373110+0000","last_clean":"2023-11-08T19:26:06.373110+0000","last_became_active":"2023-11-08T19:24:31.148857+0000","last_became_peered":"2023-11-08T19:24:31.148857+0000","last_unstale":"2023-11-08T19:26:06.373110+0000","last_undegraded":"2023-11-08T19:26:06.373110+0000","last_fullsized":"2023-11-08T19:26:06.373110+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:45:34.425432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065078599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.126285+0000","last_change":"2023-11-08T19:25:48.277423+0000","last_active":"2023-11-08T19:26:10.126285+0000","last_peered":"2023-11-08T19:26:10.126285+0000","last_clean":"2023-11-08T19:26:10.126285+0000","last_became_active":"2023-11-08T19:25:46.286211+0000","last_became_peered":"2023-11-08T19:25:46.286211+0000","last_unstale":"2023-11-08T19:26:10.126285+0000","last_undegraded":"2023-11-08T19:26:10.126285+0000","last_fullsized":"2023-11-08T19:26:10.126285+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:44:05.347800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073775700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-08T19:26:11.139671+0000","last_change":"2023-11-08T19:26:11.139671+0000","last_active":"2023-11-08T19:26:11.139671+0000","last_peered":"2023-11-08T19:26:11.139671+0000","last_clean":"2023-11-08T19:26:11.139671+0000","last_became_active":"2023-11-08T19:26:11.139289+0000","last_became_peered":"2023-11-08T19:26:11.139289+0000","last_unstale":"2023-11-08T19:26:11.139671+0000","last_undegraded":"2023-11-08T19:26:11.139671+0000","last_fullsized":"2023-11-08T19:26:11.139671+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:02:51.810261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.150500+0000","last_change":"2023-11-08T19:25:47.286020+0000","last_active":"2023-11-08T19:26:12.150500+0000","last_peered":"2023-11-08T19:26:12.150500+0000","last_clean":"2023-11-08T19:26:12.150500+0000","last_became_active":"2023-11-08T19:25:47.285728+0000","last_became_peered":"2023-11-08T19:25:47.285728+0000","last_unstale":"2023-11-08T19:26:12.150500+0000","last_undegraded":"2023-11-08T19:26:12.150500+0000","last_fullsized":"2023-11-08T19:26:12.150500+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:26:02.147090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":53,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.372699+0000","last_change":"2023-11-08T19:24:32.140832+0000","last_active":"2023-11-08T19:26:06.372699+0000","last_peered":"2023-11-08T19:26:06.372699+0000","last_clean":"2023-11-08T19:26:06.372699+0000","last_became_active":"2023-11-08T19:24:31.146557+0000","last_became_peered":"2023-11-08T19:24:31.146557+0000","last_unstale":"2023-11-08T19:26:06.372699+0000","last_undegraded":"2023-11-08T19:26:06.372699+0000","last_fullsized":"2023-11-08T19:26:06.372699+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:40:04.258107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099450100000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.536509+0000","last_change":"2023-11-08T19:25:48.372913+0000","last_active":"2023-11-08T19:26:06.536509+0000","last_peered":"2023-11-08T19:26:06.536509+0000","last_clean":"2023-11-08T19:26:06.536509+0000","last_became_active":"2023-11-08T19:25:46.281273+0000","last_became_peered":"2023-11-08T19:25:46.281273+0000","last_unstale":"2023-11-08T19:26:06.536509+0000","last_undegraded":"2023-11-08T19:26:06.536509+0000","last_fullsized":"2023-11-08T19:26:06.536509+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:07:10.832480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020904819999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.158343+0000","last_change":"2023-11-08T19:26:12.160942+0000","last_active":"2023-11-08T19:26:13.158343+0000","last_peered":"2023-11-08T19:26:13.158343+0000","last_clean":"2023-11-08T19:26:13.158343+0000","last_became_active":"2023-11-08T19:26:12.160665+0000","last_became_peered":"2023-11-08T19:26:12.160665+0000","last_unstale":"2023-11-08T19:26:13.158343+0000","last_undegraded":"2023-11-08T19:26:13.158343+0000","last_fullsized":"2023-11-08T19:26:13.158343+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:32:26.592331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.130327+0000","last_change":"2023-11-08T19:26:10.130327+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.130327+0000","last_undegraded":"2023-11-08T19:26:10.130327+0000","last_fullsized":"2023-11-08T19:26:10.130327+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.125554+0000","last_change":"2023-11-08T19:25:47.288256+0000","last_active":"2023-11-08T19:26:10.125554+0000","last_peered":"2023-11-08T19:26:10.125554+0000","last_clean":"2023-11-08T19:26:10.125554+0000","last_became_active":"2023-11-08T19:25:47.287905+0000","last_became_peered":"2023-11-08T19:25:47.287905+0000","last_unstale":"2023-11-08T19:26:10.125554+0000","last_undegraded":"2023-11-08T19:26:10.125554+0000","last_fullsized":"2023-11-08T19:26:10.125554+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:50:12.309248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.536919+0000","last_change":"2023-11-08T19:24:32.530378+0000","last_active":"2023-11-08T19:26:06.536919+0000","last_peered":"2023-11-08T19:26:06.536919+0000","last_clean":"2023-11-08T19:26:06.536919+0000","last_became_active":"2023-11-08T19:24:31.144341+0000","last_became_peered":"2023-11-08T19:24:31.144341+0000","last_unstale":"2023-11-08T19:26:06.536919+0000","last_undegraded":"2023-11-08T19:26:06.536919+0000","last_fullsized":"2023-11-08T19:26:06.536919+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:30:21.946303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058308299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.125107+0000","last_change":"2023-11-08T19:25:48.277150+0000","last_active":"2023-11-08T19:26:10.125107+0000","last_peered":"2023-11-08T19:26:10.125107+0000","last_clean":"2023-11-08T19:26:10.125107+0000","last_became_active":"2023-11-08T19:25:46.286933+0000","last_became_peered":"2023-11-08T19:25:46.286933+0000","last_unstale":"2023-11-08T19:26:10.125107+0000","last_undegraded":"2023-11-08T19:26:10.125107+0000","last_fullsized":"2023-11-08T19:26:10.125107+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:38:38.890354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080507500000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.131349+0000","last_change":"2023-11-08T19:26:11.131349+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.131349+0000","last_undegraded":"2023-11-08T19:26:11.131349+0000","last_fullsized":"2023-11-08T19:26:11.131349+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.123041+0000","last_change":"2023-11-08T19:26:10.123041+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.123041+0000","last_undegraded":"2023-11-08T19:26:10.123041+0000","last_fullsized":"2023-11-08T19:26:10.123041+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.125333+0000","last_change":"2023-11-08T19:25:47.282986+0000","last_active":"2023-11-08T19:26:10.125333+0000","last_peered":"2023-11-08T19:26:10.125333+0000","last_clean":"2023-11-08T19:26:10.125333+0000","last_became_active":"2023-11-08T19:25:47.282705+0000","last_became_peered":"2023-11-08T19:25:47.282705+0000","last_unstale":"2023-11-08T19:26:10.125333+0000","last_undegraded":"2023-11-08T19:26:10.125333+0000","last_fullsized":"2023-11-08T19:26:10.125333+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:34:17.838942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":48,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.125645+0000","last_change":"2023-11-08T19:24:32.544108+0000","last_active":"2023-11-08T19:26:10.125645+0000","last_peered":"2023-11-08T19:26:10.125645+0000","last_clean":"2023-11-08T19:26:10.125645+0000","last_became_active":"2023-11-08T19:24:31.143812+0000","last_became_peered":"2023-11-08T19:24:31.143812+0000","last_unstale":"2023-11-08T19:26:10.125645+0000","last_undegraded":"2023-11-08T19:26:10.125645+0000","last_fullsized":"2023-11-08T19:26:10.125645+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:27:59.135977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014956126,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.124568+0000","last_change":"2023-11-08T19:25:48.284435+0000","last_active":"2023-11-08T19:26:10.124568+0000","last_peered":"2023-11-08T19:26:10.124568+0000","last_clean":"2023-11-08T19:26:10.124568+0000","last_became_active":"2023-11-08T19:25:46.284288+0000","last_became_peered":"2023-11-08T19:25:46.284288+0000","last_unstale":"2023-11-08T19:26:10.124568+0000","last_undegraded":"2023-11-08T19:26:10.124568+0000","last_fullsized":"2023-11-08T19:26:10.124568+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:57:53.083448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001250894,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.129291+0000","last_change":"2023-11-08T19:26:11.129291+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.129291+0000","last_undegraded":"2023-11-08T19:26:11.129291+0000","last_fullsized":"2023-11-08T19:26:11.129291+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":3,"reported_epoch":81,"state":"creating+activating","last_fresh":"2023-11-08T19:26:11.130995+0000","last_change":"2023-11-08T19:26:11.130995+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.130995+0000","last_undegraded":"2023-11-08T19:26:11.130995+0000","last_fullsized":"2023-11-08T19:26:11.130995+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:58:17.949441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.124612+0000","last_change":"2023-11-08T19:25:47.282612+0000","last_active":"2023-11-08T19:26:10.124612+0000","last_peered":"2023-11-08T19:26:10.124612+0000","last_clean":"2023-11-08T19:26:10.124612+0000","last_became_active":"2023-11-08T19:25:47.282299+0000","last_became_peered":"2023-11-08T19:25:47.282299+0000","last_unstale":"2023-11-08T19:26:10.124612+0000","last_undegraded":"2023-11-08T19:26:10.124612+0000","last_fullsized":"2023-11-08T19:26:10.124612+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:43:18.319773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.151613+0000","last_change":"2023-11-08T19:24:32.146639+0000","last_active":"2023-11-08T19:26:12.151613+0000","last_peered":"2023-11-08T19:26:12.151613+0000","last_clean":"2023-11-08T19:26:12.151613+0000","last_became_active":"2023-11-08T19:24:31.147384+0000","last_became_peered":"2023-11-08T19:24:31.147384+0000","last_unstale":"2023-11-08T19:26:12.151613+0000","last_undegraded":"2023-11-08T19:26:12.151613+0000","last_fullsized":"2023-11-08T19:26:12.151613+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:30:21.946303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043834899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.124395+0000","last_change":"2023-11-08T19:25:48.283541+0000","last_active":"2023-11-08T19:26:10.124395+0000","last_peered":"2023-11-08T19:26:10.124395+0000","last_clean":"2023-11-08T19:26:10.124395+0000","last_became_active":"2023-11-08T19:25:46.285626+0000","last_became_peered":"2023-11-08T19:25:46.285626+0000","last_unstale":"2023-11-08T19:26:10.124395+0000","last_undegraded":"2023-11-08T19:26:10.124395+0000","last_fullsized":"2023-11-08T19:26:10.124395+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:48:17.033319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019032459999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.131450+0000","last_change":"2023-11-08T19:26:10.131450+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.131450+0000","last_undegraded":"2023-11-08T19:26:10.131450+0000","last_fullsized":"2023-11-08T19:26:10.131450+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":20,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.373197+0000","last_change":"2023-11-08T19:25:47.287878+0000","last_active":"2023-11-08T19:26:06.373197+0000","last_peered":"2023-11-08T19:26:06.373197+0000","last_clean":"2023-11-08T19:26:06.373197+0000","last_became_active":"2023-11-08T19:25:47.287617+0000","last_became_peered":"2023-11-08T19:25:47.287617+0000","last_unstale":"2023-11-08T19:26:06.373197+0000","last_undegraded":"2023-11-08T19:26:06.373197+0000","last_fullsized":"2023-11-08T19:26:06.373197+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:20:50.791463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":55,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.125379+0000","last_change":"2023-11-08T19:24:32.142376+0000","last_active":"2023-11-08T19:26:10.125379+0000","last_peered":"2023-11-08T19:26:10.125379+0000","last_clean":"2023-11-08T19:26:10.125379+0000","last_became_active":"2023-11-08T19:24:31.144614+0000","last_became_peered":"2023-11-08T19:24:31.144614+0000","last_unstale":"2023-11-08T19:26:10.125379+0000","last_undegraded":"2023-11-08T19:26:10.125379+0000","last_fullsized":"2023-11-08T19:26:10.125379+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:09:04.880374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050362200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.537032+0000","last_change":"2023-11-08T19:25:48.373636+0000","last_active":"2023-11-08T19:26:06.537032+0000","last_peered":"2023-11-08T19:26:06.537032+0000","last_clean":"2023-11-08T19:26:06.537032+0000","last_became_active":"2023-11-08T19:25:46.283803+0000","last_became_peered":"2023-11-08T19:25:46.283803+0000","last_unstale":"2023-11-08T19:26:06.537032+0000","last_undegraded":"2023-11-08T19:26:06.537032+0000","last_fullsized":"2023-11-08T19:26:06.537032+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:00:34.691748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002404855,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.131315+0000","last_change":"2023-11-08T19:26:11.131315+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.131315+0000","last_undegraded":"2023-11-08T19:26:11.131315+0000","last_fullsized":"2023-11-08T19:26:11.131315+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"82'1","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.171188+0000","last_change":"2023-11-08T19:26:11.143541+0000","last_active":"2023-11-08T19:26:12.171188+0000","last_peered":"2023-11-08T19:26:12.171188+0000","last_clean":"2023-11-08T19:26:12.171188+0000","last_became_active":"2023-11-08T19:26:11.143255+0000","last_became_peered":"2023-11-08T19:26:11.143255+0000","last_unstale":"2023-11-08T19:26:12.171188+0000","last_undegraded":"2023-11-08T19:26:12.171188+0000","last_fullsized":"2023-11-08T19:26:12.171188+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:19:00.174837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.152295+0000","last_change":"2023-11-08T19:25:47.287741+0000","last_active":"2023-11-08T19:26:12.152295+0000","last_peered":"2023-11-08T19:26:12.152295+0000","last_clean":"2023-11-08T19:26:12.152295+0000","last_became_active":"2023-11-08T19:25:47.287428+0000","last_became_peered":"2023-11-08T19:25:47.287428+0000","last_unstale":"2023-11-08T19:26:12.152295+0000","last_undegraded":"2023-11-08T19:26:12.152295+0000","last_fullsized":"2023-11-08T19:26:12.152295+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:38:55.785104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.153220+0000","last_change":"2023-11-08T19:24:32.147235+0000","last_active":"2023-11-08T19:26:12.153220+0000","last_peered":"2023-11-08T19:26:12.153220+0000","last_clean":"2023-11-08T19:26:12.153220+0000","last_became_active":"2023-11-08T19:24:31.146176+0000","last_became_peered":"2023-11-08T19:24:31.146176+0000","last_unstale":"2023-11-08T19:26:12.153220+0000","last_undegraded":"2023-11-08T19:26:12.153220+0000","last_fullsized":"2023-11-08T19:26:12.153220+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:39.214888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048481000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.536729+0000","last_change":"2023-11-08T19:25:48.373345+0000","last_active":"2023-11-08T19:26:06.536729+0000","last_peered":"2023-11-08T19:26:06.536729+0000","last_clean":"2023-11-08T19:26:06.536729+0000","last_became_active":"2023-11-08T19:25:46.282460+0000","last_became_peered":"2023-11-08T19:25:46.282460+0000","last_unstale":"2023-11-08T19:26:06.536729+0000","last_undegraded":"2023-11-08T19:26:06.536729+0000","last_fullsized":"2023-11-08T19:26:06.536729+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:25:30.927920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001972863,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.130984+0000","last_change":"2023-11-08T19:26:11.130984+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.130984+0000","last_undegraded":"2023-11-08T19:26:11.130984+0000","last_fullsized":"2023-11-08T19:26:11.130984+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.131011+0000","last_change":"2023-11-08T19:26:10.131011+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.131011+0000","last_undegraded":"2023-11-08T19:26:10.131011+0000","last_fullsized":"2023-11-08T19:26:10.131011+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.125470+0000","last_change":"2023-11-08T19:25:47.283708+0000","last_active":"2023-11-08T19:26:10.125470+0000","last_peered":"2023-11-08T19:26:10.125470+0000","last_clean":"2023-11-08T19:26:10.125470+0000","last_became_active":"2023-11-08T19:25:47.283433+0000","last_became_peered":"2023-11-08T19:25:47.283433+0000","last_unstale":"2023-11-08T19:26:10.125470+0000","last_undegraded":"2023-11-08T19:26:10.125470+0000","last_fullsized":"2023-11-08T19:26:10.125470+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:30:17.627967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":48,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.126607+0000","last_change":"2023-11-08T19:24:32.543880+0000","last_active":"2023-11-08T19:26:10.126607+0000","last_peered":"2023-11-08T19:26:10.126607+0000","last_clean":"2023-11-08T19:26:10.126607+0000","last_became_active":"2023-11-08T19:24:31.142052+0000","last_became_peered":"2023-11-08T19:24:31.142052+0000","last_unstale":"2023-11-08T19:26:10.126607+0000","last_undegraded":"2023-11-08T19:26:10.126607+0000","last_fullsized":"2023-11-08T19:26:10.126607+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:18:42.371676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014881058000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.373504+0000","last_change":"2023-11-08T19:25:48.284890+0000","last_active":"2023-11-08T19:26:06.373504+0000","last_peered":"2023-11-08T19:26:06.373504+0000","last_clean":"2023-11-08T19:26:06.373504+0000","last_became_active":"2023-11-08T19:25:46.279287+0000","last_became_peered":"2023-11-08T19:25:46.279287+0000","last_unstale":"2023-11-08T19:26:06.373504+0000","last_undegraded":"2023-11-08T19:26:06.373504+0000","last_fullsized":"2023-11-08T19:26:06.373504+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:35:30.427172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076856899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.131038+0000","last_change":"2023-11-08T19:26:11.131038+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.131038+0000","last_undegraded":"2023-11-08T19:26:11.131038+0000","last_fullsized":"2023-11-08T19:26:11.131038+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.130999+0000","last_change":"2023-11-08T19:26:10.130999+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.130999+0000","last_undegraded":"2023-11-08T19:26:10.130999+0000","last_fullsized":"2023-11-08T19:26:10.130999+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":20,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.373345+0000","last_change":"2023-11-08T19:25:47.285867+0000","last_active":"2023-11-08T19:26:06.373345+0000","last_peered":"2023-11-08T19:26:06.373345+0000","last_clean":"2023-11-08T19:26:06.373345+0000","last_became_active":"2023-11-08T19:25:47.285533+0000","last_became_peered":"2023-11-08T19:25:47.285533+0000","last_unstale":"2023-11-08T19:26:06.373345+0000","last_undegraded":"2023-11-08T19:26:06.373345+0000","last_fullsized":"2023-11-08T19:26:06.373345+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:26:59.852338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.152466+0000","last_change":"2023-11-08T19:24:32.147011+0000","last_active":"2023-11-08T19:26:12.152466+0000","last_peered":"2023-11-08T19:26:12.152466+0000","last_clean":"2023-11-08T19:26:12.152466+0000","last_became_active":"2023-11-08T19:24:31.148250+0000","last_became_peered":"2023-11-08T19:24:31.148250+0000","last_unstale":"2023-11-08T19:26:12.152466+0000","last_undegraded":"2023-11-08T19:26:12.152466+0000","last_fullsized":"2023-11-08T19:26:12.152466+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:01:25.647952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043061299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.125521+0000","last_change":"2023-11-08T19:25:48.284869+0000","last_active":"2023-11-08T19:26:10.125521+0000","last_peered":"2023-11-08T19:26:10.125521+0000","last_clean":"2023-11-08T19:26:10.125521+0000","last_became_active":"2023-11-08T19:25:46.285478+0000","last_became_peered":"2023-11-08T19:25:46.285478+0000","last_unstale":"2023-11-08T19:26:10.125521+0000","last_undegraded":"2023-11-08T19:26:10.125521+0000","last_fullsized":"2023-11-08T19:26:10.125521+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:49:51.368808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000376339,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.131103+0000","last_change":"2023-11-08T19:26:11.131103+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.131103+0000","last_undegraded":"2023-11-08T19:26:11.131103+0000","last_fullsized":"2023-11-08T19:26:11.131103+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.128845+0000","last_change":"2023-11-08T19:26:10.128845+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.128845+0000","last_undegraded":"2023-11-08T19:26:10.128845+0000","last_fullsized":"2023-11-08T19:26:10.128845+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.125020+0000","last_change":"2023-11-08T19:25:47.284429+0000","last_active":"2023-11-08T19:26:10.125020+0000","last_peered":"2023-11-08T19:26:10.125020+0000","last_clean":"2023-11-08T19:26:10.125020+0000","last_became_active":"2023-11-08T19:25:47.283990+0000","last_became_peered":"2023-11-08T19:25:47.283990+0000","last_unstale":"2023-11-08T19:26:10.125020+0000","last_undegraded":"2023-11-08T19:26:10.125020+0000","last_fullsized":"2023-11-08T19:26:10.125020+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:59:08.628317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":55,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.124560+0000","last_change":"2023-11-08T19:24:32.141190+0000","last_active":"2023-11-08T19:26:10.124560+0000","last_peered":"2023-11-08T19:26:10.124560+0000","last_clean":"2023-11-08T19:26:10.124560+0000","last_became_active":"2023-11-08T19:24:31.147651+0000","last_became_peered":"2023-11-08T19:24:31.147651+0000","last_unstale":"2023-11-08T19:26:10.124560+0000","last_undegraded":"2023-11-08T19:26:10.124560+0000","last_fullsized":"2023-11-08T19:26:10.124560+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:21:55.985548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043673300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.655820+0000","last_change":"2023-11-08T19:25:48.320707+0000","last_active":"2023-11-08T19:26:06.655820+0000","last_peered":"2023-11-08T19:26:06.655820+0000","last_clean":"2023-11-08T19:26:06.655820+0000","last_became_active":"2023-11-08T19:25:46.282307+0000","last_became_peered":"2023-11-08T19:25:46.282307+0000","last_unstale":"2023-11-08T19:26:06.655820+0000","last_undegraded":"2023-11-08T19:26:06.655820+0000","last_fullsized":"2023-11-08T19:26:06.655820+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:53:36.476361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047078400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.130955+0000","last_change":"2023-11-08T19:26:11.130955+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.130955+0000","last_undegraded":"2023-11-08T19:26:11.130955+0000","last_fullsized":"2023-11-08T19:26:11.130955+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.128054+0000","last_change":"2023-11-08T19:26:10.128054+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.128054+0000","last_undegraded":"2023-11-08T19:26:10.128054+0000","last_fullsized":"2023-11-08T19:26:10.128054+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.125006+0000","last_change":"2023-11-08T19:25:47.284227+0000","last_active":"2023-11-08T19:26:10.125006+0000","last_peered":"2023-11-08T19:26:10.125006+0000","last_clean":"2023-11-08T19:26:10.125006+0000","last_became_active":"2023-11-08T19:25:47.283927+0000","last_became_peered":"2023-11-08T19:25:47.283927+0000","last_unstale":"2023-11-08T19:26:10.125006+0000","last_undegraded":"2023-11-08T19:26:10.125006+0000","last_fullsized":"2023-11-08T19:26:10.125006+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:15:23.188047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.536878+0000","last_change":"2023-11-08T19:24:32.530168+0000","last_active":"2023-11-08T19:26:06.536878+0000","last_peered":"2023-11-08T19:26:06.536878+0000","last_clean":"2023-11-08T19:26:06.536878+0000","last_became_active":"2023-11-08T19:24:31.144329+0000","last_became_peered":"2023-11-08T19:24:31.144329+0000","last_unstale":"2023-11-08T19:26:06.536878+0000","last_undegraded":"2023-11-08T19:26:06.536878+0000","last_fullsized":"2023-11-08T19:26:06.536878+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:05:36.085920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043484799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.536437+0000","last_change":"2023-11-08T19:25:48.371291+0000","last_active":"2023-11-08T19:26:06.536437+0000","last_peered":"2023-11-08T19:26:06.536437+0000","last_clean":"2023-11-08T19:26:06.536437+0000","last_became_active":"2023-11-08T19:25:46.281425+0000","last_became_peered":"2023-11-08T19:25:46.281425+0000","last_unstale":"2023-11-08T19:26:06.536437+0000","last_undegraded":"2023-11-08T19:26:06.536437+0000","last_fullsized":"2023-11-08T19:26:06.536437+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:23:12.422712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00124314,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.128515+0000","last_change":"2023-11-08T19:26:11.128515+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.128515+0000","last_undegraded":"2023-11-08T19:26:11.128515+0000","last_fullsized":"2023-11-08T19:26:11.128515+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":3,"reported_epoch":81,"state":"creating+activating","last_fresh":"2023-11-08T19:26:11.128875+0000","last_change":"2023-11-08T19:26:11.128875+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.128875+0000","last_undegraded":"2023-11-08T19:26:11.128875+0000","last_fullsized":"2023-11-08T19:26:11.128875+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:34:00.358882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":["4","6"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.536522+0000","last_change":"2023-11-08T19:25:47.281724+0000","last_active":"2023-11-08T19:26:06.536522+0000","last_peered":"2023-11-08T19:26:06.536522+0000","last_clean":"2023-11-08T19:26:06.536522+0000","last_became_active":"2023-11-08T19:25:47.281425+0000","last_became_peered":"2023-11-08T19:25:47.281425+0000","last_unstale":"2023-11-08T19:26:06.536522+0000","last_undegraded":"2023-11-08T19:26:06.536522+0000","last_fullsized":"2023-11-08T19:26:06.536522+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:38:55.785104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.536534+0000","last_change":"2023-11-08T19:24:32.529486+0000","last_active":"2023-11-08T19:26:06.536534+0000","last_peered":"2023-11-08T19:26:06.536534+0000","last_clean":"2023-11-08T19:26:06.536534+0000","last_became_active":"2023-11-08T19:24:31.146260+0000","last_became_peered":"2023-11-08T19:24:31.146260+0000","last_unstale":"2023-11-08T19:26:06.536534+0000","last_undegraded":"2023-11-08T19:26:06.536534+0000","last_fullsized":"2023-11-08T19:26:06.536534+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:45:34.425432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059842900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.125457+0000","last_change":"2023-11-08T19:25:48.277457+0000","last_active":"2023-11-08T19:26:10.125457+0000","last_peered":"2023-11-08T19:26:10.125457+0000","last_clean":"2023-11-08T19:26:10.125457+0000","last_became_active":"2023-11-08T19:25:46.286239+0000","last_became_peered":"2023-11-08T19:25:46.286239+0000","last_unstale":"2023-11-08T19:26:10.125457+0000","last_undegraded":"2023-11-08T19:26:10.125457+0000","last_fullsized":"2023-11-08T19:26:10.125457+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:09:43.662108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000722421,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":3,"reported_epoch":81,"state":"creating+activating","last_fresh":"2023-11-08T19:26:11.131468+0000","last_change":"2023-11-08T19:26:11.131468+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.131468+0000","last_undegraded":"2023-11-08T19:26:11.131468+0000","last_fullsized":"2023-11-08T19:26:11.131468+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:50:16.234801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":["1","7"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.150529+0000","last_change":"2023-11-08T19:25:47.287874+0000","last_active":"2023-11-08T19:26:12.150529+0000","last_peered":"2023-11-08T19:26:12.150529+0000","last_clean":"2023-11-08T19:26:12.150529+0000","last_became_active":"2023-11-08T19:25:47.287456+0000","last_became_peered":"2023-11-08T19:25:47.287456+0000","last_unstale":"2023-11-08T19:26:12.150529+0000","last_undegraded":"2023-11-08T19:26:12.150529+0000","last_fullsized":"2023-11-08T19:26:12.150529+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:26:59.852338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":53,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.372762+0000","last_change":"2023-11-08T19:24:32.141131+0000","last_active":"2023-11-08T19:26:06.372762+0000","last_peered":"2023-11-08T19:26:06.372762+0000","last_clean":"2023-11-08T19:26:06.372762+0000","last_became_active":"2023-11-08T19:24:31.146154+0000","last_became_peered":"2023-11-08T19:24:31.146154+0000","last_unstale":"2023-11-08T19:26:06.372762+0000","last_undegraded":"2023-11-08T19:26:06.372762+0000","last_fullsized":"2023-11-08T19:26:06.372762+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:18:40.271560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082432800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.126197+0000","last_change":"2023-11-08T19:25:48.372729+0000","last_active":"2023-11-08T19:26:10.126197+0000","last_peered":"2023-11-08T19:26:10.126197+0000","last_clean":"2023-11-08T19:26:10.126197+0000","last_became_active":"2023-11-08T19:25:46.290114+0000","last_became_peered":"2023-11-08T19:25:46.290114+0000","last_unstale":"2023-11-08T19:26:10.126197+0000","last_undegraded":"2023-11-08T19:26:10.126197+0000","last_fullsized":"2023-11-08T19:26:10.126197+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:49:36.208776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061009499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":3,"reported_epoch":81,"state":"creating+activating","last_fresh":"2023-11-08T19:26:11.131145+0000","last_change":"2023-11-08T19:26:11.131145+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.131145+0000","last_undegraded":"2023-11-08T19:26:11.131145+0000","last_fullsized":"2023-11-08T19:26:11.131145+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:30:41.488076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":["1","5"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.536851+0000","last_change":"2023-11-08T19:25:47.283046+0000","last_active":"2023-11-08T19:26:06.536851+0000","last_peered":"2023-11-08T19:26:06.536851+0000","last_clean":"2023-11-08T19:26:06.536851+0000","last_became_active":"2023-11-08T19:25:47.282763+0000","last_became_peered":"2023-11-08T19:25:47.282763+0000","last_unstale":"2023-11-08T19:26:06.536851+0000","last_undegraded":"2023-11-08T19:26:06.536851+0000","last_fullsized":"2023-11-08T19:26:06.536851+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:12:51.389167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":49,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.126305+0000","last_change":"2023-11-08T19:24:32.263963+0000","last_active":"2023-11-08T19:26:10.126305+0000","last_peered":"2023-11-08T19:26:10.126305+0000","last_clean":"2023-11-08T19:26:10.126305+0000","last_became_active":"2023-11-08T19:24:31.139062+0000","last_became_peered":"2023-11-08T19:24:31.139062+0000","last_unstale":"2023-11-08T19:26:10.126305+0000","last_undegraded":"2023-11-08T19:26:10.126305+0000","last_fullsized":"2023-11-08T19:26:10.126305+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:26.080042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033682599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.373032+0000","last_change":"2023-11-08T19:25:48.283302+0000","last_active":"2023-11-08T19:26:06.373032+0000","last_peered":"2023-11-08T19:26:06.373032+0000","last_clean":"2023-11-08T19:26:06.373032+0000","last_became_active":"2023-11-08T19:25:46.284287+0000","last_became_peered":"2023-11-08T19:25:46.284287+0000","last_unstale":"2023-11-08T19:26:06.373032+0000","last_undegraded":"2023-11-08T19:26:06.373032+0000","last_fullsized":"2023-11-08T19:26:06.373032+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:39:27.217802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097880800000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.128580+0000","last_change":"2023-11-08T19:26:11.128580+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.128580+0000","last_undegraded":"2023-11-08T19:26:11.128580+0000","last_fullsized":"2023-11-08T19:26:11.128580+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":3,"reported_epoch":81,"state":"creating+activating","last_fresh":"2023-11-08T19:26:11.131935+0000","last_change":"2023-11-08T19:26:11.131935+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.131935+0000","last_undegraded":"2023-11-08T19:26:11.131935+0000","last_fullsized":"2023-11-08T19:26:11.131935+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:01:57.994055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":["3","0"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.124702+0000","last_change":"2023-11-08T19:25:47.286434+0000","last_active":"2023-11-08T19:26:10.124702+0000","last_peered":"2023-11-08T19:26:10.124702+0000","last_clean":"2023-11-08T19:26:10.124702+0000","last_became_active":"2023-11-08T19:25:47.286181+0000","last_became_peered":"2023-11-08T19:25:47.286181+0000","last_unstale":"2023-11-08T19:26:10.124702+0000","last_undegraded":"2023-11-08T19:26:10.124702+0000","last_fullsized":"2023-11-08T19:26:10.124702+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:13:27.285648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":53,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.373802+0000","last_change":"2023-11-08T19:24:32.140514+0000","last_active":"2023-11-08T19:26:06.373802+0000","last_peered":"2023-11-08T19:26:06.373802+0000","last_clean":"2023-11-08T19:26:06.373802+0000","last_became_active":"2023-11-08T19:24:31.146668+0000","last_became_peered":"2023-11-08T19:24:31.146668+0000","last_unstale":"2023-11-08T19:26:06.373802+0000","last_undegraded":"2023-11-08T19:26:06.373802+0000","last_fullsized":"2023-11-08T19:26:06.373802+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:31:24.539374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071576699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.656105+0000","last_change":"2023-11-08T19:25:48.320667+0000","last_active":"2023-11-08T19:26:06.656105+0000","last_peered":"2023-11-08T19:26:06.656105+0000","last_clean":"2023-11-08T19:26:06.656105+0000","last_became_active":"2023-11-08T19:25:46.290246+0000","last_became_peered":"2023-11-08T19:25:46.290246+0000","last_unstale":"2023-11-08T19:26:06.656105+0000","last_undegraded":"2023-11-08T19:26:06.656105+0000","last_fullsized":"2023-11-08T19:26:06.656105+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:33:35.492889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000423211,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.15","version":"82'3","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.172151+0000","last_change":"2023-11-08T19:26:11.147387+0000","last_active":"2023-11-08T19:26:12.172151+0000","last_peered":"2023-11-08T19:26:12.172151+0000","last_clean":"2023-11-08T19:26:12.172151+0000","last_became_active":"2023-11-08T19:26:11.147105+0000","last_became_peered":"2023-11-08T19:26:11.147105+0000","last_unstale":"2023-11-08T19:26:12.172151+0000","last_undegraded":"2023-11-08T19:26:12.172151+0000","last_fullsized":"2023-11-08T19:26:12.172151+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:29:49.218097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.126527+0000","last_change":"2023-11-08T19:25:47.287717+0000","last_active":"2023-11-08T19:26:10.126527+0000","last_peered":"2023-11-08T19:26:10.126527+0000","last_clean":"2023-11-08T19:26:10.126527+0000","last_became_active":"2023-11-08T19:25:47.287412+0000","last_became_peered":"2023-11-08T19:25:47.287412+0000","last_unstale":"2023-11-08T19:26:10.126527+0000","last_undegraded":"2023-11-08T19:26:10.126527+0000","last_fullsized":"2023-11-08T19:26:10.126527+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:18:04.478139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":49,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.656198+0000","last_change":"2023-11-08T19:24:32.142892+0000","last_active":"2023-11-08T19:26:06.656198+0000","last_peered":"2023-11-08T19:26:06.656198+0000","last_clean":"2023-11-08T19:26:06.656198+0000","last_became_active":"2023-11-08T19:24:31.144912+0000","last_became_peered":"2023-11-08T19:24:31.144912+0000","last_unstale":"2023-11-08T19:26:06.656198+0000","last_undegraded":"2023-11-08T19:26:06.656198+0000","last_fullsized":"2023-11-08T19:26:06.656198+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:04:21.151484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056686900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.373645+0000","last_change":"2023-11-08T19:25:48.285205+0000","last_active":"2023-11-08T19:26:06.373645+0000","last_peered":"2023-11-08T19:26:06.373645+0000","last_clean":"2023-11-08T19:26:06.373645+0000","last_became_active":"2023-11-08T19:25:46.285848+0000","last_became_peered":"2023-11-08T19:25:46.285848+0000","last_unstale":"2023-11-08T19:26:06.373645+0000","last_undegraded":"2023-11-08T19:26:06.373645+0000","last_fullsized":"2023-11-08T19:26:06.373645+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:07:10.832480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089732199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.158884+0000","last_change":"2023-11-08T19:26:12.170669+0000","last_active":"2023-11-08T19:26:13.158884+0000","last_peered":"2023-11-08T19:26:13.158884+0000","last_clean":"2023-11-08T19:26:13.158884+0000","last_became_active":"2023-11-08T19:26:12.170345+0000","last_became_peered":"2023-11-08T19:26:12.170345+0000","last_unstale":"2023-11-08T19:26:13.158884+0000","last_undegraded":"2023-11-08T19:26:13.158884+0000","last_fullsized":"2023-11-08T19:26:13.158884+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:32:15.350077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":3,"reported_epoch":81,"state":"creating+activating","last_fresh":"2023-11-08T19:26:11.130955+0000","last_change":"2023-11-08T19:26:11.130955+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.130955+0000","last_undegraded":"2023-11-08T19:26:11.130955+0000","last_fullsized":"2023-11-08T19:26:11.130955+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:27:23.712447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":["4","3"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":19,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.656005+0000","last_change":"2023-11-08T19:25:47.280177+0000","last_active":"2023-11-08T19:26:06.656005+0000","last_peered":"2023-11-08T19:26:06.656005+0000","last_clean":"2023-11-08T19:26:06.656005+0000","last_became_active":"2023-11-08T19:25:47.279913+0000","last_became_peered":"2023-11-08T19:25:47.279913+0000","last_unstale":"2023-11-08T19:26:06.656005+0000","last_undegraded":"2023-11-08T19:26:06.656005+0000","last_fullsized":"2023-11-08T19:26:06.656005+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:26:02.147090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":49,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.126250+0000","last_change":"2023-11-08T19:24:32.263958+0000","last_active":"2023-11-08T19:26:10.126250+0000","last_peered":"2023-11-08T19:26:10.126250+0000","last_clean":"2023-11-08T19:26:10.126250+0000","last_became_active":"2023-11-08T19:24:31.149011+0000","last_became_peered":"2023-11-08T19:24:31.149011+0000","last_unstale":"2023-11-08T19:26:10.126250+0000","last_undegraded":"2023-11-08T19:26:10.126250+0000","last_fullsized":"2023-11-08T19:26:10.126250+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:09:04.880374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033496900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.372612+0000","last_change":"2023-11-08T19:25:48.285075+0000","last_active":"2023-11-08T19:26:06.372612+0000","last_peered":"2023-11-08T19:26:06.372612+0000","last_clean":"2023-11-08T19:26:06.372612+0000","last_became_active":"2023-11-08T19:25:46.272479+0000","last_became_peered":"2023-11-08T19:25:46.272479+0000","last_unstale":"2023-11-08T19:26:06.372612+0000","last_undegraded":"2023-11-08T19:26:06.372612+0000","last_fullsized":"2023-11-08T19:26:06.372612+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:23:12.422712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001158117,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574892,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28600,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343240,"statfs":{"total":96636764160,"available":96607477760,"internally_reserved":0,"allocated":1617920,"data_stored":1082797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55200000000000005,"15min":0.53800000000000003},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.41399999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.71299999999999997,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.65300000000000002}]},{"osd":1,"last update":"Wed Nov 8 19:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.54800000000000004,"15min":0.54700000000000004},"min":{"1min":0.40799999999999997,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.69499999999999995,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.53800000000000003,"15min":0.53200000000000003},"min":{"1min":0.40600000000000003,"5min":0.37,"15min":0.37},"max":{"1min":0.75900000000000001,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.61699999999999999}]},{"osd":2,"last update":"Wed Nov 8 19:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.51400000000000001,"15min":0.50800000000000001},"min":{"1min":0.42899999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.75800000000000001,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.54000000000000004,"15min":0.53600000000000003},"min":{"1min":0.379,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.77800000000000002,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.63400000000000001}]},{"osd":3,"last update":"Wed Nov 8 19:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.53600000000000003,"15min":0.53400000000000003},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.56899999999999995,"15min":0.55900000000000005},"min":{"1min":0.42399999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76100000000000001,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.67600000000000005}]},{"osd":4,"last update":"Wed Nov 8 19:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.496,"15min":0.48599999999999999},"min":{"1min":0.35999999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.51900000000000002,"15min":0.51800000000000002},"min":{"1min":0.378,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.71399999999999997,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.45300000000000001}]},{"osd":5,"last update":"Wed Nov 8 19:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.55900000000000005,"15min":0.54800000000000004},"min":{"1min":0.39200000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.76300000000000001,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.58199999999999996,"15min":0.57799999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.68700000000000006,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.51100000000000001}]},{"osd":6,"last update":"Wed Nov 8 19:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.45600000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.80400000000000005,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57299999999999995,"15min":0.56399999999999995},"min":{"1min":0.441,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.69199999999999995,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.495}]}]},{"osd":6,"up_from":13,"seq":55834574892,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":978944,"data_stored":468818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.57299999999999995,"15min":0.59699999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.69799999999999995,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.57299999999999995,"15min":0.59099999999999997},"min":{"1min":0.313,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.754,"5min":1.478,"15min":1.478},"last":0.64400000000000002}]},{"osd":1,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.59599999999999997,"15min":0.60599999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.77500000000000002,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.65200000000000002,"15min":0.66600000000000004},"min":{"1min":0.435,"5min":0.433,"15min":0.433},"max":{"1min":0.78700000000000003,"5min":1.649,"15min":1.649},"last":0.72499999999999998}]},{"osd":2,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.621,"15min":0.63200000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76400000000000001,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.73699999999999999}]},{"osd":3,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.60399999999999998,"15min":0.63},"min":{"1min":0.42299999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.747,"5min":1.766,"15min":1.766},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.59499999999999997,"15min":0.61899999999999999},"min":{"1min":0.39300000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.82799999999999996,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":0.52100000000000002}]},{"osd":4,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53700000000000003,"15min":0.54200000000000004},"min":{"1min":0.36399999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.625},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57299999999999995,"15min":0.58099999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.81699999999999995,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.54700000000000004}]},{"osd":5,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.55500000000000005,"15min":0.56799999999999995},"min":{"1min":0.38800000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.73499999999999999,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.623,"15min":0.63600000000000001},"min":{"1min":0.41399999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.80200000000000005,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.45000000000000001}]},{"osd":7,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.60599999999999998,"15min":0.61299999999999999},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.77700000000000002,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.63600000000000001,"15min":0.64600000000000002},"min":{"1min":0.44400000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.71599999999999997,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.58399999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574891,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":978944,"data_stored":468818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.35699999999999998,"15min":0.36299999999999999},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.51200000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.38900000000000001,"15min":0.41299999999999998},"min":{"1min":0.22900000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.51700000000000002,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":0.35099999999999998}]},{"osd":2,"last update":"Wed Nov 8 19:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.33800000000000002,"15min":0.34499999999999997},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.53000000000000003,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.38100000000000001,"15min":0.39400000000000002},"min":{"1min":0.253,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.46400000000000002,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.41099999999999998}]},{"osd":3,"last update":"Wed Nov 8 19:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.40799999999999997,"15min":0.41699999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.432,"5min":1.24,"15min":1.24},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.371,"5min":0.438,"15min":0.46200000000000002},"min":{"1min":0.26100000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.47999999999999998,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.312}]},{"osd":4,"last update":"Wed Nov 8 19:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.60599999999999998,"15min":0.61399999999999999},"min":{"1min":0.46500000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72499999999999998,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57599999999999996,"15min":0.56599999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.76200000000000001,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.57199999999999995}]},{"osd":5,"last update":"Wed Nov 8 19:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.56999999999999995,"15min":0.55800000000000005},"min":{"1min":0.41399999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.72799999999999998,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.60199999999999998,"15min":0.60699999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.68700000000000006,"5min":1.115,"15min":1.115},"last":0.78600000000000003}]},{"osd":6,"last update":"Wed Nov 8 19:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.63,"15min":0.63800000000000001},"min":{"1min":0.439,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.746,"5min":2.093,"15min":2.093},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.59899999999999998,"15min":0.60299999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.76100000000000001,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.74099999999999999}]},{"osd":7,"last update":"Wed Nov 8 19:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.64700000000000002,"15min":0.67100000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.77600000000000002,"5min":1.591,"15min":1.591},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.66500000000000004,"15min":0.69199999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.70199999999999996,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.63600000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574891,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28556,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343284,"statfs":{"total":96636764160,"available":96607522816,"internally_reserved":0,"allocated":1572864,"data_stored":1059186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:26:00 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.879,"15min":1.1180000000000001},"min":{"1min":0.23799999999999999,"5min":0.192,"15min":0.192},"max":{"1min":0.60699999999999998,"5min":19.295999999999999,"15min":19.295999999999999},"last":0.434},{"interface":"front","average":{"1min":0.379,"5min":0.81999999999999995,"15min":1.024},"min":{"1min":0.24299999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.56000000000000005,"5min":17.204000000000001,"15min":17.204000000000001},"last":0.40799999999999997}]},{"osd":2,"last update":"Wed Nov 8 19:26:00 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.54200000000000004,"15min":0.61799999999999999},"min":{"1min":0.28299999999999997,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.54700000000000004,"5min":6.524,"15min":6.524},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.85399999999999998,"15min":1.0640000000000001},"min":{"1min":0.29499999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.60699999999999998,"5min":17.175000000000001,"15min":17.175000000000001},"last":0.45100000000000001}]},{"osd":3,"last update":"Wed Nov 8 19:26:00 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.746,"15min":0.91000000000000003},"min":{"1min":0.27100000000000002,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.55800000000000005,"5min":14.324,"15min":14.324},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.40799999999999997,"15min":0.40400000000000003},"min":{"1min":0.34699999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.48599999999999999}]},{"osd":4,"last update":"Wed Nov 8 19:26:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":1.028,"15min":1.212},"min":{"1min":0.52000000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.98999999999999999,"5min":17.056000000000001,"15min":17.056000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.70699999999999996,"15min":0.745},"min":{"1min":0.49099999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.82299999999999995,"5min":5.0289999999999999,"15min":5.0289999999999999},"last":0.60499999999999998}]},{"osd":5,"last update":"Wed Nov 8 19:26:00 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.69999999999999996,"15min":0.746},"min":{"1min":0.53400000000000003,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.85099999999999998,"5min":5.0590000000000002,"15min":5.0590000000000002},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.58399999999999996,"15min":0.56999999999999995},"min":{"1min":0.47199999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.64400000000000002}]},{"osd":6,"last update":"Wed Nov 8 19:26:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.61299999999999999,"15min":0.60799999999999998},"min":{"1min":0.505,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.68400000000000005,"5min":1.0649999999999999,"15min":1.2589999999999999},"min":{"1min":0.50800000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.0389999999999999,"5min":17.111999999999998,"15min":17.111999999999998},"last":0.72599999999999998}]},{"osd":7,"last update":"Wed Nov 8 19:26:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":1.0820000000000001,"15min":1.274},"min":{"1min":0.48099999999999998,"5min":0.376,"15min":0.376},"max":{"1min":1.0760000000000001,"5min":17.146000000000001,"15min":17.146000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.63,"5min":0.71099999999999997,"15min":0.75700000000000001},"min":{"1min":0.47099999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.91700000000000004,"5min":4.9829999999999997,"15min":4.9829999999999997},"last":0.68799999999999994}]}]},{"osd":2,"up_from":13,"seq":55834574891,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":978944,"data_stored":468818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.433,"15min":0.47499999999999998},"min":{"1min":0.23300000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.61299999999999999,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.46200000000000002,"15min":0.50800000000000001},"min":{"1min":0.23999999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.65100000000000002,"5min":3.4369999999999998,"15min":3.4369999999999998},"last":0.31900000000000001}]},{"osd":1,"last update":"Wed Nov 8 19:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.49099999999999999,"15min":0.54900000000000004},"min":{"1min":0.27000000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.48399999999999999,"5min":4.0679999999999996,"15min":4.0679999999999996},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.54400000000000004,"15min":0.59599999999999997},"min":{"1min":0.32300000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.58599999999999997,"5min":4.3499999999999996,"15min":4.3499999999999996},"last":0.438}]},{"osd":3,"last update":"Wed Nov 8 19:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.495,"15min":0.53700000000000003},"min":{"1min":0.27800000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.47099999999999997,"5min":3.8580000000000001,"15min":3.8580000000000001},"last":0.375},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.46300000000000002,"15min":0.51200000000000001},"min":{"1min":0.29599999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.55700000000000005,"5min":3.476,"15min":3.476},"last":0.34000000000000002}]},{"osd":4,"last update":"Wed Nov 8 19:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.68799999999999994,"15min":0.71799999999999997},"min":{"1min":0.44,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.98799999999999999,"5min":4.0090000000000003,"15min":4.0090000000000003},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.68899999999999995,"15min":0.73399999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.69099999999999995,"5min":4.1040000000000001,"15min":4.1040000000000001},"last":0.46500000000000002}]},{"osd":5,"last update":"Wed Nov 8 19:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.69299999999999995,"15min":0.74299999999999999},"min":{"1min":0.47999999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.874,"5min":4.0869999999999997,"15min":4.0869999999999997},"last":0.497},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.69599999999999995,"15min":0.746},"min":{"1min":0.435,"5min":0.433,"15min":0.433},"max":{"1min":0.78100000000000003,"5min":3.843,"15min":3.843},"last":0.56000000000000005}]},{"osd":6,"last update":"Wed Nov 8 19:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.70799999999999996,"15min":0.75900000000000001},"min":{"1min":0.45300000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.72699999999999998,"5min":4.1399999999999997,"15min":4.1399999999999997},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.68799999999999994,"15min":0.73399999999999999},"min":{"1min":0.49199999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.81499999999999995,"5min":4.0499999999999998,"15min":4.0499999999999998},"last":0.52500000000000002}]},{"osd":7,"last update":"Wed Nov 8 19:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.72799999999999998,"15min":0.76800000000000002},"min":{"1min":0.48799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.754,"5min":4.157,"15min":4.157},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.754,"15min":0.80000000000000004},"min":{"1min":0.505,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.93000000000000005,"5min":4.1710000000000003,"15min":4.1710000000000003},"last":0.54400000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574891,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":978944,"data_stored":468818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.38100000000000001,"15min":0.38500000000000001},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.64600000000000002,"5min":1.458,"15min":1.458},"last":0.373},{"interface":"front","average":{"1min":0.372,"5min":0.38900000000000001,"15min":0.39800000000000002},"min":{"1min":0.29499999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.53400000000000003,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.35699999999999998}]},{"osd":1,"last update":"Wed Nov 8 19:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.40500000000000003,"15min":0.41099999999999998},"min":{"1min":0.29599999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.61199999999999999,"5min":1.512,"15min":1.512},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.435,"15min":0.44700000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.59999999999999998,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.32500000000000001}]},{"osd":2,"last update":"Wed Nov 8 19:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.371,"15min":0.376},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.54800000000000004,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.41899999999999998,"15min":0.42699999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.60899999999999999,"5min":1.536,"15min":1.536},"last":0.42799999999999999}]},{"osd":4,"last update":"Wed Nov 8 19:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.60799999999999998,"15min":0.62},"min":{"1min":0.44900000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.77000000000000002,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.61299999999999999,"15min":0.61099999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.80200000000000005,"5min":1.153,"15min":1.153},"last":0.70399999999999996}]},{"osd":5,"last update":"Wed Nov 8 19:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.58899999999999997,"15min":0.59099999999999997},"min":{"1min":0.42399999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.69599999999999995,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.58899999999999997,"15min":0.60299999999999998},"min":{"1min":0.39300000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.73699999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.56899999999999995}]},{"osd":6,"last update":"Wed Nov 8 19:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57399999999999995,"15min":0.57999999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78500000000000003,"5min":1.113,"15min":1.113},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60799999999999998,"15min":0.61199999999999999},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72299999999999998,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.58599999999999997}]},{"osd":7,"last update":"Wed Nov 8 19:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.63500000000000001,"15min":0.64700000000000002},"min":{"1min":0.433,"5min":0.432,"15min":0.432},"max":{"1min":0.73999999999999999,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.62,"15min":0.61799999999999999},"min":{"1min":0.46300000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.754,"5min":1.179,"15min":1.179},"last":0.75600000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574891,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":978944,"data_stored":468818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:25:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.54500000000000004,"15min":0.53800000000000003},"min":{"1min":0.36799999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.80100000000000005,"5min":1.399,"15min":1.399},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58499999999999996,"15min":0.59499999999999997},"min":{"1min":0.44400000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73499999999999999,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.63500000000000001}]},{"osd":1,"last update":"Wed Nov 8 19:25:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.51400000000000001,"15min":0.51100000000000001},"min":{"1min":0.42199999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.502,"15min":0.497},"min":{"1min":0.40999999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.61799999999999999}]},{"osd":2,"last update":"Wed Nov 8 19:25:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.61899999999999999,"15min":0.63500000000000001},"min":{"1min":0.38200000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.80800000000000005,"5min":2.8490000000000002,"15min":2.8490000000000002},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.53800000000000003,"15min":0.52400000000000002},"min":{"1min":0.40799999999999997,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.71799999999999997,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.47199999999999998}]},{"osd":3,"last update":"Wed Nov 8 19:25:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57799999999999996,"15min":0.56599999999999995},"min":{"1min":0.47099999999999997,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.75700000000000001,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.70099999999999996,"15min":0.72399999999999998},"min":{"1min":0.48299999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.83199999999999996,"5min":3.4849999999999999,"15min":3.4849999999999999},"last":0.66600000000000004}]},{"osd":5,"last update":"Wed Nov 8 19:25:59 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.51800000000000002,"15min":0.52000000000000002},"min":{"1min":0.38,"5min":0.313,"15min":0.313},"max":{"1min":0.67200000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.56899999999999995,"15min":0.56100000000000005},"min":{"1min":0.39700000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.79100000000000004,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.65000000000000002}]},{"osd":6,"last update":"Wed Nov 8 19:25:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.67300000000000004,"15min":0.71499999999999997},"min":{"1min":0.38,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.71599999999999997,"5min":4.1529999999999996,"15min":4.1529999999999996},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.624,"5min":0.61599999999999999,"15min":0.61399999999999999},"min":{"1min":0.41699999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.73999999999999999,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.59999999999999998}]},{"osd":7,"last update":"Wed Nov 8 19:25:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57399999999999995,"15min":0.57199999999999995},"min":{"1min":0.47399999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.69999999999999996,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.80200000000000005,"15min":0.85199999999999998},"min":{"1min":0.52700000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.83899999999999997,"5min":5.5359999999999996,"15min":5.5359999999999996},"last":0.68700000000000006}]}]},{"osd":5,"up_from":13,"seq":55834574891,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":978944,"data_stored":468818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53700000000000003,"15min":0.54700000000000004},"min":{"1min":0.40600000000000003,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.63800000000000001,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":0.44},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.52500000000000002,"15min":0.51900000000000002},"min":{"1min":0.32800000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.68799999999999994,"5min":0.878,"15min":0.878},"last":0.26900000000000002}]},{"osd":1,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55300000000000005,"15min":0.54700000000000004},"min":{"1min":0.47199999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.68200000000000005,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.59299999999999997,"15min":0.60699999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.73899999999999999,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":0.32200000000000001}]},{"osd":2,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.34699999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.65300000000000002,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.53600000000000003,"15min":0.53000000000000003},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.70699999999999996,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.29699999999999999}]},{"osd":3,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.41299999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71799999999999997,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57699999999999996,"15min":0.57299999999999995},"min":{"1min":0.42199999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.73599999999999999,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.48599999999999999}]},{"osd":4,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.57499999999999996,"15min":0.59899999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.748,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.63700000000000001,"15min":0.63500000000000001},"min":{"1min":0.46500000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.77300000000000002,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.56100000000000005}]},{"osd":6,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.57899999999999996,"15min":0.57799999999999996},"min":{"1min":0.38200000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.73599999999999999,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.63800000000000001,"15min":0.66600000000000004},"min":{"1min":0.41799999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.80500000000000005,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":0.60399999999999998}]},{"osd":7,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.623,"15min":0.629},"min":{"1min":0.42499999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.82799999999999996,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.64200000000000002,"15min":0.64800000000000002},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.80700000000000005,"5min":0.873,"15min":0.873},"last":0.58599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:26:17.044 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3f is not active+clean 2023-11-08T19:26:17.044 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:26:11.132306+0000', 'last_change': '2023-11-08T19:26:11.132306+0000', 'last_active': '2023-11-08T19:26:11.120100+0000', 'last_peered': '2023-11-08T19:26:11.120100+0000', 'last_clean': '2023-11-08T19:26:11.120100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:11.132306+0000', 'last_undegraded': '2023-11-08T19:26:11.132306+0000', 'last_fullsized': '2023-11-08T19:26:11.132306+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-08T19:26:17.045 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3e is not active+clean 2023-11-08T19:26:17.045 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:26:11.120100+0000', 'last_change': '2023-11-08T19:26:11.120100+0000', 'last_active': '2023-11-08T19:26:11.120100+0000', 'last_peered': '2023-11-08T19:26:11.120100+0000', 'last_clean': '2023-11-08T19:26:11.120100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:11.120100+0000', 'last_undegraded': '2023-11-08T19:26:11.120100+0000', 'last_fullsized': '2023-11-08T19:26:11.120100+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:26:17.046 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3d is not active+clean 2023-11-08T19:26:17.046 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:26:11.130646+0000', 'last_change': '2023-11-08T19:26:11.130646+0000', 'last_active': '2023-11-08T19:26:11.120100+0000', 'last_peered': '2023-11-08T19:26:11.120100+0000', 'last_clean': '2023-11-08T19:26:11.120100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:11.130646+0000', 'last_undegraded': '2023-11-08T19:26:11.130646+0000', 'last_fullsized': '2023-11-08T19:26:11.130646+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-08T19:26:17.046 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3c is not active+clean 2023-11-08T19:26:17.047 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:26:11.134023+0000', 'last_change': '2023-11-08T19:26:11.134023+0000', 'last_active': '2023-11-08T19:26:11.120100+0000', 'last_peered': '2023-11-08T19:26:11.120100+0000', 'last_clean': '2023-11-08T19:26:11.120100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:11.134023+0000', 'last_undegraded': '2023-11-08T19:26:11.134023+0000', 'last_fullsized': '2023-11-08T19:26:11.134023+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-08T19:26:17.047 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3b is not active+clean 2023-11-08T19:26:17.048 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:26:11.120100+0000', 'last_change': '2023-11-08T19:26:11.120100+0000', 'last_active': '2023-11-08T19:26:11.120100+0000', 'last_peered': '2023-11-08T19:26:11.120100+0000', 'last_clean': '2023-11-08T19:26:11.120100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:11.120100+0000', 'last_undegraded': '2023-11-08T19:26:11.120100+0000', 'last_fullsized': '2023-11-08T19:26:11.120100+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:26:17.048 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.38 is not active+clean 2023-11-08T19:26:17.048 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:26:11.120100+0000', 'last_change': '2023-11-08T19:26:11.120100+0000', 'last_active': '2023-11-08T19:26:11.120100+0000', 'last_peered': '2023-11-08T19:26:11.120100+0000', 'last_clean': '2023-11-08T19:26:11.120100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:11.120100+0000', 'last_undegraded': '2023-11-08T19:26:11.120100+0000', 'last_fullsized': '2023-11-08T19:26:11.120100+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:26:17.049 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.37 is not active+clean 2023-11-08T19:26:17.049 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:26:11.131549+0000', 'last_change': '2023-11-08T19:26:11.131549+0000', 'last_active': '2023-11-08T19:26:11.120100+0000', 'last_peered': '2023-11-08T19:26:11.120100+0000', 'last_clean': '2023-11-08T19:26:11.120100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:11.131549+0000', 'last_undegraded': '2023-11-08T19:26:11.131549+0000', 'last_fullsized': '2023-11-08T19:26:11.131549+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-08T19:26:17.050 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.36 is not active+clean 2023-11-08T19:26:17.050 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:26:11.120100+0000', 'last_change': '2023-11-08T19:26:11.120100+0000', 'last_active': '2023-11-08T19:26:11.120100+0000', 'last_peered': '2023-11-08T19:26:11.120100+0000', 'last_clean': '2023-11-08T19:26:11.120100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:11.120100+0000', 'last_undegraded': '2023-11-08T19:26:11.120100+0000', 'last_fullsized': '2023-11-08T19:26:11.120100+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:26:17.050 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.34 is not active+clean 2023-11-08T19:26:17.051 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:26:11.130524+0000', 'last_change': '2023-11-08T19:26:11.130524+0000', 'last_active': '2023-11-08T19:26:11.120100+0000', 'last_peered': '2023-11-08T19:26:11.120100+0000', 'last_clean': '2023-11-08T19:26:11.120100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:11.130524+0000', 'last_undegraded': '2023-11-08T19:26:11.130524+0000', 'last_fullsized': '2023-11-08T19:26:11.130524+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-08T19:26:17.051 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.33 is not active+clean 2023-11-08T19:26:17.051 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:26:11.132912+0000', 'last_change': '2023-11-08T19:26:11.132912+0000', 'last_active': '2023-11-08T19:26:11.120100+0000', 'last_peered': '2023-11-08T19:26:11.120100+0000', 'last_clean': '2023-11-08T19:26:11.120100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:11.132912+0000', 'last_undegraded': '2023-11-08T19:26:11.132912+0000', 'last_fullsized': '2023-11-08T19:26:11.132912+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-08T19:26:17.052 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.32 is not active+clean 2023-11-08T19:26:17.052 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:26:11.120100+0000', 'last_change': '2023-11-08T19:26:11.120100+0000', 'last_active': '2023-11-08T19:26:11.120100+0000', 'last_peered': '2023-11-08T19:26:11.120100+0000', 'last_clean': '2023-11-08T19:26:11.120100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:11.120100+0000', 'last_undegraded': '2023-11-08T19:26:11.120100+0000', 'last_fullsized': '2023-11-08T19:26:11.120100+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:26:17.053 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.31 is not active+clean 2023-11-08T19:26:17.053 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:26:11.132409+0000', 'last_change': '2023-11-08T19:26:11.132409+0000', 'last_active': '2023-11-08T19:26:11.120100+0000', 'last_peered': '2023-11-08T19:26:11.120100+0000', 'last_clean': '2023-11-08T19:26:11.120100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:11.132409+0000', 'last_undegraded': '2023-11-08T19:26:11.132409+0000', 'last_fullsized': '2023-11-08T19:26:11.132409+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-08T19:26:17.053 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2f is not active+clean 2023-11-08T19:26:17.054 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:26:11.120100+0000', 'last_change': '2023-11-08T19:26:11.120100+0000', 'last_active': '2023-11-08T19:26:11.120100+0000', 'last_peered': '2023-11-08T19:26:11.120100+0000', 'last_clean': '2023-11-08T19:26:11.120100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:11.120100+0000', 'last_undegraded': '2023-11-08T19:26:11.120100+0000', 'last_fullsized': '2023-11-08T19:26:11.120100+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:26:17.054 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2e is not active+clean 2023-11-08T19:26:17.054 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:26:11.132284+0000', 'last_change': '2023-11-08T19:26:11.132284+0000', 'last_active': '2023-11-08T19:26:11.120100+0000', 'last_peered': '2023-11-08T19:26:11.120100+0000', 'last_clean': '2023-11-08T19:26:11.120100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:11.132284+0000', 'last_undegraded': '2023-11-08T19:26:11.132284+0000', 'last_fullsized': '2023-11-08T19:26:11.132284+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-08T19:26:17.055 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2d is not active+clean 2023-11-08T19:26:17.055 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:26:11.120100+0000', 'last_change': '2023-11-08T19:26:11.120100+0000', 'last_active': '2023-11-08T19:26:11.120100+0000', 'last_peered': '2023-11-08T19:26:11.120100+0000', 'last_clean': '2023-11-08T19:26:11.120100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:11.120100+0000', 'last_undegraded': '2023-11-08T19:26:11.120100+0000', 'last_fullsized': '2023-11-08T19:26:11.120100+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:26:17.056 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2c is not active+clean 2023-11-08T19:26:17.056 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:26:11.131376+0000', 'last_change': '2023-11-08T19:26:11.131376+0000', 'last_active': '2023-11-08T19:26:11.120100+0000', 'last_peered': '2023-11-08T19:26:11.120100+0000', 'last_clean': '2023-11-08T19:26:11.120100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:11.131376+0000', 'last_undegraded': '2023-11-08T19:26:11.131376+0000', 'last_fullsized': '2023-11-08T19:26:11.131376+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-08T19:26:17.056 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2b is not active+clean 2023-11-08T19:26:17.057 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:26:11.120100+0000', 'last_change': '2023-11-08T19:26:11.120100+0000', 'last_active': '2023-11-08T19:26:11.120100+0000', 'last_peered': '2023-11-08T19:26:11.120100+0000', 'last_clean': '2023-11-08T19:26:11.120100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:11.120100+0000', 'last_undegraded': '2023-11-08T19:26:11.120100+0000', 'last_fullsized': '2023-11-08T19:26:11.120100+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:26:17.057 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2a is not active+clean 2023-11-08T19:26:17.058 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:26:11.120100+0000', 'last_change': '2023-11-08T19:26:11.120100+0000', 'last_active': '2023-11-08T19:26:11.120100+0000', 'last_peered': '2023-11-08T19:26:11.120100+0000', 'last_clean': '2023-11-08T19:26:11.120100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:11.120100+0000', 'last_undegraded': '2023-11-08T19:26:11.120100+0000', 'last_fullsized': '2023-11-08T19:26:11.120100+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:26:17.058 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.29 is not active+clean 2023-11-08T19:26:17.058 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:26:11.120100+0000', 'last_change': '2023-11-08T19:26:11.120100+0000', 'last_active': '2023-11-08T19:26:11.120100+0000', 'last_peered': '2023-11-08T19:26:11.120100+0000', 'last_clean': '2023-11-08T19:26:11.120100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:11.120100+0000', 'last_undegraded': '2023-11-08T19:26:11.120100+0000', 'last_fullsized': '2023-11-08T19:26:11.120100+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:26:17.059 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.27 is not active+clean 2023-11-08T19:26:17.059 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:26:11.120100+0000', 'last_change': '2023-11-08T19:26:11.120100+0000', 'last_active': '2023-11-08T19:26:11.120100+0000', 'last_peered': '2023-11-08T19:26:11.120100+0000', 'last_clean': '2023-11-08T19:26:11.120100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:11.120100+0000', 'last_undegraded': '2023-11-08T19:26:11.120100+0000', 'last_fullsized': '2023-11-08T19:26:11.120100+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:26:17.060 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.26 is not active+clean 2023-11-08T19:26:17.060 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:26:11.120100+0000', 'last_change': '2023-11-08T19:26:11.120100+0000', 'last_active': '2023-11-08T19:26:11.120100+0000', 'last_peered': '2023-11-08T19:26:11.120100+0000', 'last_clean': '2023-11-08T19:26:11.120100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:11.120100+0000', 'last_undegraded': '2023-11-08T19:26:11.120100+0000', 'last_fullsized': '2023-11-08T19:26:11.120100+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:26:17.060 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.24 is not active+clean 2023-11-08T19:26:17.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:26:11.120100+0000', 'last_change': '2023-11-08T19:26:11.120100+0000', 'last_active': '2023-11-08T19:26:11.120100+0000', 'last_peered': '2023-11-08T19:26:11.120100+0000', 'last_clean': '2023-11-08T19:26:11.120100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:11.120100+0000', 'last_undegraded': '2023-11-08T19:26:11.120100+0000', 'last_fullsized': '2023-11-08T19:26:11.120100+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:26:17.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.23 is not active+clean 2023-11-08T19:26:17.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:26:11.120100+0000', 'last_change': '2023-11-08T19:26:11.120100+0000', 'last_active': '2023-11-08T19:26:11.120100+0000', 'last_peered': '2023-11-08T19:26:11.120100+0000', 'last_clean': '2023-11-08T19:26:11.120100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:11.120100+0000', 'last_undegraded': '2023-11-08T19:26:11.120100+0000', 'last_fullsized': '2023-11-08T19:26:11.120100+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:26:17.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.22 is not active+clean 2023-11-08T19:26:17.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:26:11.120100+0000', 'last_change': '2023-11-08T19:26:11.120100+0000', 'last_active': '2023-11-08T19:26:11.120100+0000', 'last_peered': '2023-11-08T19:26:11.120100+0000', 'last_clean': '2023-11-08T19:26:11.120100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:11.120100+0000', 'last_undegraded': '2023-11-08T19:26:11.120100+0000', 'last_fullsized': '2023-11-08T19:26:11.120100+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:26:17.063 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.21 is not active+clean 2023-11-08T19:26:17.063 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:26:11.132057+0000', 'last_change': '2023-11-08T19:26:11.132057+0000', 'last_active': '2023-11-08T19:26:11.120100+0000', 'last_peered': '2023-11-08T19:26:11.120100+0000', 'last_clean': '2023-11-08T19:26:11.120100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:11.132057+0000', 'last_undegraded': '2023-11-08T19:26:11.132057+0000', 'last_fullsized': '2023-11-08T19:26:11.132057+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-08T19:26:17.063 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.20 is not active+clean 2023-11-08T19:26:17.064 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:26:11.130468+0000', 'last_change': '2023-11-08T19:26:11.130468+0000', 'last_active': '2023-11-08T19:26:11.120100+0000', 'last_peered': '2023-11-08T19:26:11.120100+0000', 'last_clean': '2023-11-08T19:26:11.120100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:11.130468+0000', 'last_undegraded': '2023-11-08T19:26:11.130468+0000', 'last_fullsized': '2023-11-08T19:26:11.130468+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-08T19:26:17.064 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.e is not active+clean 2023-11-08T19:26:17.065 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:26:11.120100+0000', 'last_change': '2023-11-08T19:26:11.120100+0000', 'last_active': '2023-11-08T19:26:11.120100+0000', 'last_peered': '2023-11-08T19:26:11.120100+0000', 'last_clean': '2023-11-08T19:26:11.120100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:11.120100+0000', 'last_undegraded': '2023-11-08T19:26:11.120100+0000', 'last_fullsized': '2023-11-08T19:26:11.120100+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:26:17.065 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.a is not active+clean 2023-11-08T19:26:17.065 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:26:11.120100+0000', 'last_change': '2023-11-08T19:26:11.120100+0000', 'last_active': '2023-11-08T19:26:11.120100+0000', 'last_peered': '2023-11-08T19:26:11.120100+0000', 'last_clean': '2023-11-08T19:26:11.120100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:11.120100+0000', 'last_undegraded': '2023-11-08T19:26:11.120100+0000', 'last_fullsized': '2023-11-08T19:26:11.120100+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:26:17.066 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.b is not active+clean 2023-11-08T19:26:17.066 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:26:10.128507+0000', 'last_change': '2023-11-08T19:26:10.128507+0000', 'last_active': '2023-11-08T19:26:10.118333+0000', 'last_peered': '2023-11-08T19:26:10.118333+0000', 'last_clean': '2023-11-08T19:26:10.118333+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:10.128507+0000', 'last_undegraded': '2023-11-08T19:26:10.128507+0000', 'last_fullsized': '2023-11-08T19:26:10.128507+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-08T19:26:17.067 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.b is not active+clean 2023-11-08T19:26:17.067 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:26:11.120100+0000', 'last_change': '2023-11-08T19:26:11.120100+0000', 'last_active': '2023-11-08T19:26:11.120100+0000', 'last_peered': '2023-11-08T19:26:11.120100+0000', 'last_clean': '2023-11-08T19:26:11.120100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:11.120100+0000', 'last_undegraded': '2023-11-08T19:26:11.120100+0000', 'last_fullsized': '2023-11-08T19:26:11.120100+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:26:17.067 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.a is not active+clean 2023-11-08T19:26:17.068 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:26:10.127179+0000', 'last_change': '2023-11-08T19:26:10.127179+0000', 'last_active': '2023-11-08T19:26:10.118333+0000', 'last_peered': '2023-11-08T19:26:10.118333+0000', 'last_clean': '2023-11-08T19:26:10.118333+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:10.127179+0000', 'last_undegraded': '2023-11-08T19:26:10.127179+0000', 'last_fullsized': '2023-11-08T19:26:10.127179+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-08T19:26:17.068 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.8 is not active+clean 2023-11-08T19:26:17.068 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:26:11.120100+0000', 'last_change': '2023-11-08T19:26:11.120100+0000', 'last_active': '2023-11-08T19:26:11.120100+0000', 'last_peered': '2023-11-08T19:26:11.120100+0000', 'last_clean': '2023-11-08T19:26:11.120100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:11.120100+0000', 'last_undegraded': '2023-11-08T19:26:11.120100+0000', 'last_fullsized': '2023-11-08T19:26:11.120100+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:26:17.069 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.9 is not active+clean 2023-11-08T19:26:17.069 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:26:10.126826+0000', 'last_change': '2023-11-08T19:26:10.126826+0000', 'last_active': '2023-11-08T19:26:10.118333+0000', 'last_peered': '2023-11-08T19:26:10.118333+0000', 'last_clean': '2023-11-08T19:26:10.118333+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:10.126826+0000', 'last_undegraded': '2023-11-08T19:26:10.126826+0000', 'last_fullsized': '2023-11-08T19:26:10.126826+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-08T19:26:17.070 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.9 is not active+clean 2023-11-08T19:26:17.070 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:26:11.120100+0000', 'last_change': '2023-11-08T19:26:11.120100+0000', 'last_active': '2023-11-08T19:26:11.120100+0000', 'last_peered': '2023-11-08T19:26:11.120100+0000', 'last_clean': '2023-11-08T19:26:11.120100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:11.120100+0000', 'last_undegraded': '2023-11-08T19:26:11.120100+0000', 'last_fullsized': '2023-11-08T19:26:11.120100+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:26:17.070 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.8 is not active+clean 2023-11-08T19:26:17.071 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:26:10.127425+0000', 'last_change': '2023-11-08T19:26:10.127425+0000', 'last_active': '2023-11-08T19:26:10.118333+0000', 'last_peered': '2023-11-08T19:26:10.118333+0000', 'last_clean': '2023-11-08T19:26:10.118333+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:10.127425+0000', 'last_undegraded': '2023-11-08T19:26:10.127425+0000', 'last_fullsized': '2023-11-08T19:26:10.127425+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-08T19:26:17.071 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.f is not active+clean 2023-11-08T19:26:17.071 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:26:11.120100+0000', 'last_change': '2023-11-08T19:26:11.120100+0000', 'last_active': '2023-11-08T19:26:11.120100+0000', 'last_peered': '2023-11-08T19:26:11.120100+0000', 'last_clean': '2023-11-08T19:26:11.120100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:11.120100+0000', 'last_undegraded': '2023-11-08T19:26:11.120100+0000', 'last_fullsized': '2023-11-08T19:26:11.120100+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:26:17.072 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.e is not active+clean 2023-11-08T19:26:17.072 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.e', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 81, 'state': 'creating+activating', 'last_fresh': '2023-11-08T19:26:11.130325+0000', 'last_change': '2023-11-08T19:26:11.130325+0000', 'last_active': '2023-11-08T19:26:10.118333+0000', 'last_peered': '2023-11-08T19:26:10.118333+0000', 'last_clean': '2023-11-08T19:26:10.118333+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:11.130325+0000', 'last_undegraded': '2023-11-08T19:26:11.130325+0000', 'last_fullsized': '2023-11-08T19:26:11.130325+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-09T21:26:26.007199+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': ['4', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-08T19:26:17.073 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.c is not active+clean 2023-11-08T19:26:17.073 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:26:11.120100+0000', 'last_change': '2023-11-08T19:26:11.120100+0000', 'last_active': '2023-11-08T19:26:11.120100+0000', 'last_peered': '2023-11-08T19:26:11.120100+0000', 'last_clean': '2023-11-08T19:26:11.120100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:11.120100+0000', 'last_undegraded': '2023-11-08T19:26:11.120100+0000', 'last_fullsized': '2023-11-08T19:26:11.120100+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:26:17.073 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.d is not active+clean 2023-11-08T19:26:17.074 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:26:10.122829+0000', 'last_change': '2023-11-08T19:26:10.122829+0000', 'last_active': '2023-11-08T19:26:10.118333+0000', 'last_peered': '2023-11-08T19:26:10.118333+0000', 'last_clean': '2023-11-08T19:26:10.118333+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:10.122829+0000', 'last_undegraded': '2023-11-08T19:26:10.122829+0000', 'last_fullsized': '2023-11-08T19:26:10.122829+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-08T19:26:17.074 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.c is not active+clean 2023-11-08T19:26:17.075 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:26:10.129895+0000', 'last_change': '2023-11-08T19:26:10.129895+0000', 'last_active': '2023-11-08T19:26:10.118333+0000', 'last_peered': '2023-11-08T19:26:10.118333+0000', 'last_clean': '2023-11-08T19:26:10.118333+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:10.129895+0000', 'last_undegraded': '2023-11-08T19:26:10.129895+0000', 'last_fullsized': '2023-11-08T19:26:10.129895+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-08T19:26:17.075 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2 is not active+clean 2023-11-08T19:26:17.075 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:26:11.120100+0000', 'last_change': '2023-11-08T19:26:11.120100+0000', 'last_active': '2023-11-08T19:26:11.120100+0000', 'last_peered': '2023-11-08T19:26:11.120100+0000', 'last_clean': '2023-11-08T19:26:11.120100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:11.120100+0000', 'last_undegraded': '2023-11-08T19:26:11.120100+0000', 'last_fullsized': '2023-11-08T19:26:11.120100+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:26:17.076 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3 is not active+clean 2023-11-08T19:26:17.076 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:26:10.128081+0000', 'last_change': '2023-11-08T19:26:10.128081+0000', 'last_active': '2023-11-08T19:26:10.118333+0000', 'last_peered': '2023-11-08T19:26:10.118333+0000', 'last_clean': '2023-11-08T19:26:10.118333+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:10.128081+0000', 'last_undegraded': '2023-11-08T19:26:10.128081+0000', 'last_fullsized': '2023-11-08T19:26:10.128081+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-08T19:26:17.076 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3 is not active+clean 2023-11-08T19:26:17.077 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:26:11.129880+0000', 'last_change': '2023-11-08T19:26:11.129880+0000', 'last_active': '2023-11-08T19:26:11.120100+0000', 'last_peered': '2023-11-08T19:26:11.120100+0000', 'last_clean': '2023-11-08T19:26:11.120100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:11.129880+0000', 'last_undegraded': '2023-11-08T19:26:11.129880+0000', 'last_fullsized': '2023-11-08T19:26:11.129880+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-08T19:26:17.077 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2 is not active+clean 2023-11-08T19:26:17.078 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:26:10.123109+0000', 'last_change': '2023-11-08T19:26:10.123109+0000', 'last_active': '2023-11-08T19:26:10.118333+0000', 'last_peered': '2023-11-08T19:26:10.118333+0000', 'last_clean': '2023-11-08T19:26:10.118333+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:10.123109+0000', 'last_undegraded': '2023-11-08T19:26:10.123109+0000', 'last_fullsized': '2023-11-08T19:26:10.123109+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-08T19:26:17.078 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.0 is not active+clean 2023-11-08T19:26:17.078 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:26:11.120100+0000', 'last_change': '2023-11-08T19:26:11.120100+0000', 'last_active': '2023-11-08T19:26:11.120100+0000', 'last_peered': '2023-11-08T19:26:11.120100+0000', 'last_clean': '2023-11-08T19:26:11.120100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:11.120100+0000', 'last_undegraded': '2023-11-08T19:26:11.120100+0000', 'last_fullsized': '2023-11-08T19:26:11.120100+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:26:17.079 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1 is not active+clean 2023-11-08T19:26:17.079 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 81, 'state': 'creating+activating', 'last_fresh': '2023-11-08T19:26:11.131733+0000', 'last_change': '2023-11-08T19:26:11.131733+0000', 'last_active': '2023-11-08T19:26:10.118333+0000', 'last_peered': '2023-11-08T19:26:10.118333+0000', 'last_clean': '2023-11-08T19:26:10.118333+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:11.131733+0000', 'last_undegraded': '2023-11-08T19:26:11.131733+0000', 'last_fullsized': '2023-11-08T19:26:11.131733+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-09T22:23:55.641598+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': ['3', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-08T19:26:17.080 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1 is not active+clean 2023-11-08T19:26:17.080 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:26:11.120100+0000', 'last_change': '2023-11-08T19:26:11.120100+0000', 'last_active': '2023-11-08T19:26:11.120100+0000', 'last_peered': '2023-11-08T19:26:11.120100+0000', 'last_clean': '2023-11-08T19:26:11.120100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:11.120100+0000', 'last_undegraded': '2023-11-08T19:26:11.120100+0000', 'last_fullsized': '2023-11-08T19:26:11.120100+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:26:17.080 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.0 is not active+clean 2023-11-08T19:26:17.081 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:26:10.129454+0000', 'last_change': '2023-11-08T19:26:10.129454+0000', 'last_active': '2023-11-08T19:26:10.118333+0000', 'last_peered': '2023-11-08T19:26:10.118333+0000', 'last_clean': '2023-11-08T19:26:10.118333+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:10.129454+0000', 'last_undegraded': '2023-11-08T19:26:10.129454+0000', 'last_fullsized': '2023-11-08T19:26:10.129454+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-08T19:26:17.081 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.6 is not active+clean 2023-11-08T19:26:17.081 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:26:11.120100+0000', 'last_change': '2023-11-08T19:26:11.120100+0000', 'last_active': '2023-11-08T19:26:11.120100+0000', 'last_peered': '2023-11-08T19:26:11.120100+0000', 'last_clean': '2023-11-08T19:26:11.120100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:11.120100+0000', 'last_undegraded': '2023-11-08T19:26:11.120100+0000', 'last_fullsized': '2023-11-08T19:26:11.120100+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:26:17.082 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.7 is not active+clean 2023-11-08T19:26:17.082 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:26:10.127556+0000', 'last_change': '2023-11-08T19:26:10.127556+0000', 'last_active': '2023-11-08T19:26:10.118333+0000', 'last_peered': '2023-11-08T19:26:10.118333+0000', 'last_clean': '2023-11-08T19:26:10.118333+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:10.127556+0000', 'last_undegraded': '2023-11-08T19:26:10.127556+0000', 'last_fullsized': '2023-11-08T19:26:10.127556+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-08T19:26:17.083 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.7 is not active+clean 2023-11-08T19:26:17.083 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:26:11.131449+0000', 'last_change': '2023-11-08T19:26:11.131449+0000', 'last_active': '2023-11-08T19:26:11.120100+0000', 'last_peered': '2023-11-08T19:26:11.120100+0000', 'last_clean': '2023-11-08T19:26:11.120100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:11.131449+0000', 'last_undegraded': '2023-11-08T19:26:11.131449+0000', 'last_fullsized': '2023-11-08T19:26:11.131449+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-08T19:26:17.083 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.6 is not active+clean 2023-11-08T19:26:17.084 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:26:10.127954+0000', 'last_change': '2023-11-08T19:26:10.127954+0000', 'last_active': '2023-11-08T19:26:10.118333+0000', 'last_peered': '2023-11-08T19:26:10.118333+0000', 'last_clean': '2023-11-08T19:26:10.118333+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:10.127954+0000', 'last_undegraded': '2023-11-08T19:26:10.127954+0000', 'last_fullsized': '2023-11-08T19:26:10.127954+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-08T19:26:17.084 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.4 is not active+clean 2023-11-08T19:26:17.084 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:26:11.130517+0000', 'last_change': '2023-11-08T19:26:11.130517+0000', 'last_active': '2023-11-08T19:26:11.120100+0000', 'last_peered': '2023-11-08T19:26:11.120100+0000', 'last_clean': '2023-11-08T19:26:11.120100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:11.130517+0000', 'last_undegraded': '2023-11-08T19:26:11.130517+0000', 'last_fullsized': '2023-11-08T19:26:11.130517+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-08T19:26:17.085 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.5 is not active+clean 2023-11-08T19:26:17.085 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:26:10.128682+0000', 'last_change': '2023-11-08T19:26:10.128682+0000', 'last_active': '2023-11-08T19:26:10.118333+0000', 'last_peered': '2023-11-08T19:26:10.118333+0000', 'last_clean': '2023-11-08T19:26:10.118333+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:10.128682+0000', 'last_undegraded': '2023-11-08T19:26:10.128682+0000', 'last_fullsized': '2023-11-08T19:26:10.128682+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-08T19:26:17.086 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.5 is not active+clean 2023-11-08T19:26:17.086 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:26:11.120100+0000', 'last_change': '2023-11-08T19:26:11.120100+0000', 'last_active': '2023-11-08T19:26:11.120100+0000', 'last_peered': '2023-11-08T19:26:11.120100+0000', 'last_clean': '2023-11-08T19:26:11.120100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:11.120100+0000', 'last_undegraded': '2023-11-08T19:26:11.120100+0000', 'last_fullsized': '2023-11-08T19:26:11.120100+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:26:17.086 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.4 is not active+clean 2023-11-08T19:26:17.087 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:26:10.124238+0000', 'last_change': '2023-11-08T19:26:10.124238+0000', 'last_active': '2023-11-08T19:26:10.118333+0000', 'last_peered': '2023-11-08T19:26:10.118333+0000', 'last_clean': '2023-11-08T19:26:10.118333+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:10.124238+0000', 'last_undegraded': '2023-11-08T19:26:10.124238+0000', 'last_fullsized': '2023-11-08T19:26:10.124238+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-08T19:26:17.087 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1a is not active+clean 2023-11-08T19:26:17.088 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:26:11.120100+0000', 'last_change': '2023-11-08T19:26:11.120100+0000', 'last_active': '2023-11-08T19:26:11.120100+0000', 'last_peered': '2023-11-08T19:26:11.120100+0000', 'last_clean': '2023-11-08T19:26:11.120100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:11.120100+0000', 'last_undegraded': '2023-11-08T19:26:11.120100+0000', 'last_fullsized': '2023-11-08T19:26:11.120100+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:26:17.088 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1a is not active+clean 2023-11-08T19:26:17.088 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:26:10.130327+0000', 'last_change': '2023-11-08T19:26:10.130327+0000', 'last_active': '2023-11-08T19:26:10.118333+0000', 'last_peered': '2023-11-08T19:26:10.118333+0000', 'last_clean': '2023-11-08T19:26:10.118333+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:10.130327+0000', 'last_undegraded': '2023-11-08T19:26:10.130327+0000', 'last_fullsized': '2023-11-08T19:26:10.130327+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-08T19:26:17.089 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.18 is not active+clean 2023-11-08T19:26:17.089 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:26:11.131349+0000', 'last_change': '2023-11-08T19:26:11.131349+0000', 'last_active': '2023-11-08T19:26:11.120100+0000', 'last_peered': '2023-11-08T19:26:11.120100+0000', 'last_clean': '2023-11-08T19:26:11.120100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:11.131349+0000', 'last_undegraded': '2023-11-08T19:26:11.131349+0000', 'last_fullsized': '2023-11-08T19:26:11.131349+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-08T19:26:17.090 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.19 is not active+clean 2023-11-08T19:26:17.090 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:26:10.123041+0000', 'last_change': '2023-11-08T19:26:10.123041+0000', 'last_active': '2023-11-08T19:26:10.118333+0000', 'last_peered': '2023-11-08T19:26:10.118333+0000', 'last_clean': '2023-11-08T19:26:10.118333+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:10.123041+0000', 'last_undegraded': '2023-11-08T19:26:10.123041+0000', 'last_fullsized': '2023-11-08T19:26:10.123041+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-08T19:26:17.090 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.19 is not active+clean 2023-11-08T19:26:17.091 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:26:11.129291+0000', 'last_change': '2023-11-08T19:26:11.129291+0000', 'last_active': '2023-11-08T19:26:11.120100+0000', 'last_peered': '2023-11-08T19:26:11.120100+0000', 'last_clean': '2023-11-08T19:26:11.120100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:11.129291+0000', 'last_undegraded': '2023-11-08T19:26:11.129291+0000', 'last_fullsized': '2023-11-08T19:26:11.129291+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-08T19:26:17.091 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.18 is not active+clean 2023-11-08T19:26:17.091 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.18', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 81, 'state': 'creating+activating', 'last_fresh': '2023-11-08T19:26:11.130995+0000', 'last_change': '2023-11-08T19:26:11.130995+0000', 'last_active': '2023-11-08T19:26:10.118333+0000', 'last_peered': '2023-11-08T19:26:10.118333+0000', 'last_clean': '2023-11-08T19:26:10.118333+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:11.130995+0000', 'last_undegraded': '2023-11-08T19:26:11.130995+0000', 'last_fullsized': '2023-11-08T19:26:11.130995+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-10T05:58:17.949441+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': ['1', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-08T19:26:17.092 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1e is not active+clean 2023-11-08T19:26:17.092 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:26:11.120100+0000', 'last_change': '2023-11-08T19:26:11.120100+0000', 'last_active': '2023-11-08T19:26:11.120100+0000', 'last_peered': '2023-11-08T19:26:11.120100+0000', 'last_clean': '2023-11-08T19:26:11.120100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:11.120100+0000', 'last_undegraded': '2023-11-08T19:26:11.120100+0000', 'last_fullsized': '2023-11-08T19:26:11.120100+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:26:17.093 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1f is not active+clean 2023-11-08T19:26:17.093 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:26:10.131450+0000', 'last_change': '2023-11-08T19:26:10.131450+0000', 'last_active': '2023-11-08T19:26:10.118333+0000', 'last_peered': '2023-11-08T19:26:10.118333+0000', 'last_clean': '2023-11-08T19:26:10.118333+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:10.131450+0000', 'last_undegraded': '2023-11-08T19:26:10.131450+0000', 'last_fullsized': '2023-11-08T19:26:10.131450+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-08T19:26:17.093 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1f is not active+clean 2023-11-08T19:26:17.094 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:26:11.131315+0000', 'last_change': '2023-11-08T19:26:11.131315+0000', 'last_active': '2023-11-08T19:26:11.120100+0000', 'last_peered': '2023-11-08T19:26:11.120100+0000', 'last_clean': '2023-11-08T19:26:11.120100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:11.131315+0000', 'last_undegraded': '2023-11-08T19:26:11.131315+0000', 'last_fullsized': '2023-11-08T19:26:11.131315+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-08T19:26:17.094 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1c is not active+clean 2023-11-08T19:26:17.095 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:26:11.130984+0000', 'last_change': '2023-11-08T19:26:11.130984+0000', 'last_active': '2023-11-08T19:26:11.120100+0000', 'last_peered': '2023-11-08T19:26:11.120100+0000', 'last_clean': '2023-11-08T19:26:11.120100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:11.130984+0000', 'last_undegraded': '2023-11-08T19:26:11.130984+0000', 'last_fullsized': '2023-11-08T19:26:11.130984+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-08T19:26:17.095 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1d is not active+clean 2023-11-08T19:26:17.095 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:26:10.131011+0000', 'last_change': '2023-11-08T19:26:10.131011+0000', 'last_active': '2023-11-08T19:26:10.118333+0000', 'last_peered': '2023-11-08T19:26:10.118333+0000', 'last_clean': '2023-11-08T19:26:10.118333+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:10.131011+0000', 'last_undegraded': '2023-11-08T19:26:10.131011+0000', 'last_fullsized': '2023-11-08T19:26:10.131011+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-08T19:26:17.096 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1d is not active+clean 2023-11-08T19:26:17.096 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:26:11.131038+0000', 'last_change': '2023-11-08T19:26:11.131038+0000', 'last_active': '2023-11-08T19:26:11.120100+0000', 'last_peered': '2023-11-08T19:26:11.120100+0000', 'last_clean': '2023-11-08T19:26:11.120100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:11.131038+0000', 'last_undegraded': '2023-11-08T19:26:11.131038+0000', 'last_fullsized': '2023-11-08T19:26:11.131038+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-08T19:26:17.096 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1c is not active+clean 2023-11-08T19:26:17.097 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:26:10.130999+0000', 'last_change': '2023-11-08T19:26:10.130999+0000', 'last_active': '2023-11-08T19:26:10.118333+0000', 'last_peered': '2023-11-08T19:26:10.118333+0000', 'last_clean': '2023-11-08T19:26:10.118333+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:10.130999+0000', 'last_undegraded': '2023-11-08T19:26:10.130999+0000', 'last_fullsized': '2023-11-08T19:26:10.130999+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-08T19:26:17.097 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.12 is not active+clean 2023-11-08T19:26:17.098 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:26:11.131103+0000', 'last_change': '2023-11-08T19:26:11.131103+0000', 'last_active': '2023-11-08T19:26:11.120100+0000', 'last_peered': '2023-11-08T19:26:11.120100+0000', 'last_clean': '2023-11-08T19:26:11.120100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:11.131103+0000', 'last_undegraded': '2023-11-08T19:26:11.131103+0000', 'last_fullsized': '2023-11-08T19:26:11.131103+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-08T19:26:17.098 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.13 is not active+clean 2023-11-08T19:26:17.098 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:26:10.128845+0000', 'last_change': '2023-11-08T19:26:10.128845+0000', 'last_active': '2023-11-08T19:26:10.118333+0000', 'last_peered': '2023-11-08T19:26:10.118333+0000', 'last_clean': '2023-11-08T19:26:10.118333+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:10.128845+0000', 'last_undegraded': '2023-11-08T19:26:10.128845+0000', 'last_fullsized': '2023-11-08T19:26:10.128845+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-08T19:26:17.099 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.13 is not active+clean 2023-11-08T19:26:17.099 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:26:11.130955+0000', 'last_change': '2023-11-08T19:26:11.130955+0000', 'last_active': '2023-11-08T19:26:11.120100+0000', 'last_peered': '2023-11-08T19:26:11.120100+0000', 'last_clean': '2023-11-08T19:26:11.120100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:11.130955+0000', 'last_undegraded': '2023-11-08T19:26:11.130955+0000', 'last_fullsized': '2023-11-08T19:26:11.130955+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-08T19:26:17.100 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.12 is not active+clean 2023-11-08T19:26:17.100 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:26:10.128054+0000', 'last_change': '2023-11-08T19:26:10.128054+0000', 'last_active': '2023-11-08T19:26:10.118333+0000', 'last_peered': '2023-11-08T19:26:10.118333+0000', 'last_clean': '2023-11-08T19:26:10.118333+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:10.128054+0000', 'last_undegraded': '2023-11-08T19:26:10.128054+0000', 'last_fullsized': '2023-11-08T19:26:10.128054+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-08T19:26:17.100 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.10 is not active+clean 2023-11-08T19:26:17.101 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:26:11.128515+0000', 'last_change': '2023-11-08T19:26:11.128515+0000', 'last_active': '2023-11-08T19:26:11.120100+0000', 'last_peered': '2023-11-08T19:26:11.120100+0000', 'last_clean': '2023-11-08T19:26:11.120100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:11.128515+0000', 'last_undegraded': '2023-11-08T19:26:11.128515+0000', 'last_fullsized': '2023-11-08T19:26:11.128515+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-08T19:26:17.101 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.11 is not active+clean 2023-11-08T19:26:17.102 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.11', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 81, 'state': 'creating+activating', 'last_fresh': '2023-11-08T19:26:11.128875+0000', 'last_change': '2023-11-08T19:26:11.128875+0000', 'last_active': '2023-11-08T19:26:10.118333+0000', 'last_peered': '2023-11-08T19:26:10.118333+0000', 'last_clean': '2023-11-08T19:26:10.118333+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:11.128875+0000', 'last_undegraded': '2023-11-08T19:26:11.128875+0000', 'last_fullsized': '2023-11-08T19:26:11.128875+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-10T01:34:00.358882+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': ['4', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-08T19:26:17.102 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.11 is not active+clean 2023-11-08T19:26:17.102 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:26:11.120100+0000', 'last_change': '2023-11-08T19:26:11.120100+0000', 'last_active': '2023-11-08T19:26:11.120100+0000', 'last_peered': '2023-11-08T19:26:11.120100+0000', 'last_clean': '2023-11-08T19:26:11.120100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:11.120100+0000', 'last_undegraded': '2023-11-08T19:26:11.120100+0000', 'last_fullsized': '2023-11-08T19:26:11.120100+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:26:17.103 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.10 is not active+clean 2023-11-08T19:26:17.103 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.10', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 81, 'state': 'creating+activating', 'last_fresh': '2023-11-08T19:26:11.131468+0000', 'last_change': '2023-11-08T19:26:11.131468+0000', 'last_active': '2023-11-08T19:26:10.118333+0000', 'last_peered': '2023-11-08T19:26:10.118333+0000', 'last_clean': '2023-11-08T19:26:10.118333+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:11.131468+0000', 'last_undegraded': '2023-11-08T19:26:11.131468+0000', 'last_fullsized': '2023-11-08T19:26:11.131468+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-10T01:50:16.234801+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': ['1', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-08T19:26:17.104 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.16 is not active+clean 2023-11-08T19:26:17.104 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:26:11.120100+0000', 'last_change': '2023-11-08T19:26:11.120100+0000', 'last_active': '2023-11-08T19:26:11.120100+0000', 'last_peered': '2023-11-08T19:26:11.120100+0000', 'last_clean': '2023-11-08T19:26:11.120100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:11.120100+0000', 'last_undegraded': '2023-11-08T19:26:11.120100+0000', 'last_fullsized': '2023-11-08T19:26:11.120100+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:26:17.104 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.17 is not active+clean 2023-11-08T19:26:17.105 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.17', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 81, 'state': 'creating+activating', 'last_fresh': '2023-11-08T19:26:11.131145+0000', 'last_change': '2023-11-08T19:26:11.131145+0000', 'last_active': '2023-11-08T19:26:10.118333+0000', 'last_peered': '2023-11-08T19:26:10.118333+0000', 'last_clean': '2023-11-08T19:26:10.118333+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:11.131145+0000', 'last_undegraded': '2023-11-08T19:26:11.131145+0000', 'last_fullsized': '2023-11-08T19:26:11.131145+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-10T00:30:41.488076+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': ['1', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-08T19:26:17.105 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.17 is not active+clean 2023-11-08T19:26:17.105 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-11-08T19:26:11.128580+0000', 'last_change': '2023-11-08T19:26:11.128580+0000', 'last_active': '2023-11-08T19:26:11.120100+0000', 'last_peered': '2023-11-08T19:26:11.120100+0000', 'last_clean': '2023-11-08T19:26:11.120100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:11.128580+0000', 'last_undegraded': '2023-11-08T19:26:11.128580+0000', 'last_fullsized': '2023-11-08T19:26:11.128580+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-08T19:26:17.106 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.16 is not active+clean 2023-11-08T19:26:17.106 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.16', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 81, 'state': 'creating+activating', 'last_fresh': '2023-11-08T19:26:11.131935+0000', 'last_change': '2023-11-08T19:26:11.131935+0000', 'last_active': '2023-11-08T19:26:10.118333+0000', 'last_peered': '2023-11-08T19:26:10.118333+0000', 'last_clean': '2023-11-08T19:26:10.118333+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:11.131935+0000', 'last_undegraded': '2023-11-08T19:26:11.131935+0000', 'last_fullsized': '2023-11-08T19:26:11.131935+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-09T23:01:57.994055+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': ['3', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-08T19:26:17.107 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.14 is not active+clean 2023-11-08T19:26:17.107 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T19:26:11.120100+0000', 'last_change': '2023-11-08T19:26:11.120100+0000', 'last_active': '2023-11-08T19:26:11.120100+0000', 'last_peered': '2023-11-08T19:26:11.120100+0000', 'last_clean': '2023-11-08T19:26:11.120100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:11.120100+0000', 'last_undegraded': '2023-11-08T19:26:11.120100+0000', 'last_fullsized': '2023-11-08T19:26:11.120100+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:11.120100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T19:26:17.107 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.14 is not active+clean 2023-11-08T19:26:17.108 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.14', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 81, 'state': 'creating+activating', 'last_fresh': '2023-11-08T19:26:11.130955+0000', 'last_change': '2023-11-08T19:26:11.130955+0000', 'last_active': '2023-11-08T19:26:10.118333+0000', 'last_peered': '2023-11-08T19:26:10.118333+0000', 'last_clean': '2023-11-08T19:26:10.118333+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T19:26:11.130955+0000', 'last_undegraded': '2023-11-08T19:26:11.130955+0000', 'last_fullsized': '2023-11-08T19:26:11.130955+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'last_clean_scrub_stamp': '2023-11-08T19:26:10.118333+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-09T22:27:23.712447+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': ['4', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-08T19:26:17.109 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-08T19:26:17.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.229+0000 7fd68413d700 1 Processor -- start 2023-11-08T19:26:17.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.230+0000 7fd68413d700 1 -- start start 2023-11-08T19:26:17.234 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.230+0000 7fd68413d700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fd67c0cac70 0x7fd67c0cc280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:17.234 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.230+0000 7fd68413d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd67c0cf940 0x7fd67c0cfd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:17.235 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.230+0000 7fd68413d700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd67c0cbdf0 con 0x7fd67c15dc90 2023-11-08T19:26:17.237 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.230+0000 7fd68413d700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd67c0ccdd0 con 0x7fd67c0cf940 2023-11-08T19:26:17.238 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.230+0000 7fd68413d700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd67c0cb1e0 con 0x7fd67c0cac70 2023-11-08T19:26:17.238 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.230+0000 7fd6826da700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd67c0cf940 0x7fd67c0cfd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:17.238 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.230+0000 7fd681ed9700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fd67c15dc90 0x7fd67c06b560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:44506/0 (socket says 172.21.15.149:44506) 2023-11-08T19:26:17.238 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.231+0000 7fd681ed9700 1 -- 172.21.15.149:0/746732505 learned_addr learned my addr 172.21.15.149:0/746732505 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:26:17.239 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.231+0000 7fd6816d8700 1 --2- 172.21.15.149:0/746732505 >> v2:172.21.15.160:3300/0 conn(0x7fd67c0cac70 0x7fd67c0cc280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:17.239 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.231+0000 7fd6826da700 1 -- 172.21.15.149:0/746732505 >> v2:172.21.15.160:3300/0 conn(0x7fd67c0cac70 msgr2=0x7fd67c0cc280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:17.239 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.231+0000 7fd6826da700 1 --2- 172.21.15.149:0/746732505 >> v2:172.21.15.160:3300/0 conn(0x7fd67c0cac70 0x7fd67c0cc280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:17.239 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.231+0000 7fd6826da700 1 -- 172.21.15.149:0/746732505 >> v1:172.21.15.149:6789/0 conn(0x7fd67c15dc90 legacy=0x7fd67c06b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:17.239 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.231+0000 7fd6826da700 1 -- 172.21.15.149:0/746732505 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd67c0cb4c0 con 0x7fd67c0cf940 2023-11-08T19:26:17.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.231+0000 7fd6826da700 1 --2- 172.21.15.149:0/746732505 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd67c0cf940 0x7fd67c0cfd50 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fd67c071f70 tx=0x7fd67400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4db203108d07aa90 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:17.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.231+0000 7fd680ed7700 1 -- 172.21.15.149:0/746732505 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67400e070 con 0x7fd67c0cf940 2023-11-08T19:26:17.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.231+0000 7fd680ed7700 1 -- 172.21.15.149:0/746732505 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd67400bbd0 con 0x7fd67c0cf940 2023-11-08T19:26:17.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.231+0000 7fd680ed7700 1 -- 172.21.15.149:0/746732505 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd674012430 con 0x7fd67c0cf940 2023-11-08T19:26:17.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.232+0000 7fd68413d700 1 -- 172.21.15.149:0/746732505 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd67c0cf940 msgr2=0x7fd67c0cfd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:17.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.232+0000 7fd68413d700 1 --2- 172.21.15.149:0/746732505 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd67c0cf940 0x7fd67c0cfd50 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fd67c071f70 tx=0x7fd67400b330 comp rx=0 tx=0).stop 2023-11-08T19:26:17.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.232+0000 7fd68413d700 1 -- 172.21.15.149:0/746732505 shutdown_connections 2023-11-08T19:26:17.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.232+0000 7fd68413d700 1 --2- 172.21.15.149:0/746732505 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd67c0cf940 0x7fd67c0cfd50 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:17.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.232+0000 7fd68413d700 1 --2- 172.21.15.149:0/746732505 >> v2:172.21.15.160:3300/0 conn(0x7fd67c0cac70 0x7fd67c0cc280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:17.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.232+0000 7fd68413d700 1 -- 172.21.15.149:0/746732505 >> 172.21.15.149:0/746732505 conn(0x7fd67c0d0620 msgr2=0x7fd67c0d0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:17.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.232+0000 7fd68413d700 1 -- 172.21.15.149:0/746732505 shutdown_connections 2023-11-08T19:26:17.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.232+0000 7fd68413d700 1 -- 172.21.15.149:0/746732505 wait complete. 2023-11-08T19:26:17.245 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.233+0000 7fd68413d700 1 Processor -- start 2023-11-08T19:26:17.245 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.233+0000 7fd68413d700 1 -- start start 2023-11-08T19:26:17.245 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.234+0000 7fd68413d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd67c0cac70 0x7fd67c1e81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:17.245 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.234+0000 7fd68413d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd67c0cf940 0x7fd67c1e7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:17.245 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.234+0000 7fd68413d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd67c15dc90 0x7fd67c158dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:17.246 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.234+0000 7fd68413d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd67c1e6270 con 0x7fd67c0cac70 2023-11-08T19:26:17.246 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.234+0000 7fd68413d700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd67c0b5810 con 0x7fd67c15dc90 2023-11-08T19:26:17.246 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.234+0000 7fd68413d700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd67c1e77c0 con 0x7fd67c0cf940 2023-11-08T19:26:17.246 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.234+0000 7fd681ed9700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd67c0cac70 0x7fd67c1e81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:17.246 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.234+0000 7fd681ed9700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd67c0cac70 0x7fd67c1e81e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42510/0 (socket says 172.21.15.149:42510) 2023-11-08T19:26:17.247 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.234+0000 7fd681ed9700 1 -- 172.21.15.149:0/3698762958 learned_addr learned my addr 172.21.15.149:0/3698762958 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:17.247 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.234+0000 7fd6816d8700 1 --2- 172.21.15.149:0/3698762958 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd67c0cf940 0x7fd67c1e7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:17.247 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.234+0000 7fd6826da700 1 --2- 172.21.15.149:0/3698762958 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd67c15dc90 0x7fd67c158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:17.247 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.234+0000 7fd681ed9700 1 -- 172.21.15.149:0/3698762958 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd67c0cf940 msgr2=0x7fd67c1e7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:17.247 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.234+0000 7fd681ed9700 1 --2- 172.21.15.149:0/3698762958 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd67c0cf940 0x7fd67c1e7280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:17.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.234+0000 7fd681ed9700 1 -- 172.21.15.149:0/3698762958 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd67c15dc90 msgr2=0x7fd67c158dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:17.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.234+0000 7fd681ed9700 1 --2- 172.21.15.149:0/3698762958 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd67c15dc90 0x7fd67c158dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:17.249 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.234+0000 7fd681ed9700 1 -- 172.21.15.149:0/3698762958 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd674009a70 con 0x7fd67c0cac70 2023-11-08T19:26:17.249 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.234+0000 7fd6826da700 1 --2- 172.21.15.149:0/3698762958 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd67c15dc90 0x7fd67c158dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:26:17.249 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.234+0000 7fd681ed9700 1 --2- 172.21.15.149:0/3698762958 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd67c0cac70 0x7fd67c1e81e0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fd67000c550 tx=0x7fd67000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:17.250 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.234+0000 7fd66e7fc700 1 -- 172.21.15.149:0/3698762958 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd670005d70 con 0x7fd67c0cac70 2023-11-08T19:26:17.250 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.234+0000 7fd66e7fc700 1 -- 172.21.15.149:0/3698762958 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6700070d0 con 0x7fd67c0cac70 2023-11-08T19:26:17.250 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.234+0000 7fd68413d700 1 -- 172.21.15.149:0/3698762958 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd67c159310 con 0x7fd67c0cac70 2023-11-08T19:26:17.250 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.234+0000 7fd66e7fc700 1 -- 172.21.15.149:0/3698762958 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd670007440 con 0x7fd67c0cac70 2023-11-08T19:26:17.251 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.234+0000 7fd68413d700 1 -- 172.21.15.149:0/3698762958 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd67c1e7a40 con 0x7fd67c0cac70 2023-11-08T19:26:17.251 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.235+0000 7fd68413d700 1 -- 172.21.15.149:0/3698762958 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd67c0ce440 con 0x7fd67c0cac70 2023-11-08T19:26:17.251 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.236+0000 7fd66e7fc700 1 -- 172.21.15.149:0/3698762958 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd6700075a0 con 0x7fd67c0cac70 2023-11-08T19:26:17.251 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.236+0000 7fd66e7fc700 1 --2- 172.21.15.149:0/3698762958 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd66006af00 0x7fd66006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:17.251 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.236+0000 7fd66e7fc700 1 -- 172.21.15.149:0/3698762958 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7fd670088f00 con 0x7fd67c0cac70 2023-11-08T19:26:17.252 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.236+0000 7fd6816d8700 1 --2- 172.21.15.149:0/3698762958 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd66006af00 0x7fd66006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:17.252 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.237+0000 7fd6816d8700 1 --2- 172.21.15.149:0/3698762958 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd66006af00 0x7fd66006d3c0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fd67c1e3b30 tx=0x7fd678008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:17.252 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.241+0000 7fd66e7fc700 1 -- 172.21.15.149:0/3698762958 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd670053af0 con 0x7fd67c0cac70 2023-11-08T19:26:17.515 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.513+0000 7fd68413d700 1 -- 172.21.15.149:0/3698762958 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fd67c0745f0 con 0x7fd67c0cac70 2023-11-08T19:26:17.515 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.513+0000 7fd66e7fc700 1 -- 172.21.15.149:0/3698762958 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1784 (secure 0 0 0) 0x7fd670017710 con 0x7fd67c0cac70 2023-11-08T19:26:17.516 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:26:17.516 INFO:teuthology.orchestra.run.smithi149.stdout:{"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","health":{"status":"HEALTH_WARN","checks":{"POOL_APP_NOT_ENABLED":{"severity":"HEALTH_WARN","summary":{"message":"3 pool(s) do not have an application enabled","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":213,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":83,"num_osds":8,"num_up_osds":8,"osd_up_since":1699471375,"num_in_osds":8,"osd_in_since":1699471366,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":110},{"state_name":"creating+peering","count":43},{"state_name":"unknown","count":32},{"state_name":"creating+activating","count":8}],"num_pgs":193,"num_pools":6,"num_objects":5,"data_bytes":590480,"bytes_used":230412288,"bytes_avail":772863700992,"bytes_total":773094113280,"unknown_pgs_ratio":0.16580310463905334,"inactive_pgs_ratio":0.26424869894981384,"write_bytes_sec":346,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":44,"id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"a","status":"up:active","gid":6666}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2023-11-08T19:25:58.024529+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-11-08T19:26:17.518 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.516+0000 7fd68413d700 1 -- 172.21.15.149:0/3698762958 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd66006af00 msgr2=0x7fd66006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:17.518 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.516+0000 7fd68413d700 1 --2- 172.21.15.149:0/3698762958 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd66006af00 0x7fd66006d3c0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fd67c1e3b30 tx=0x7fd678008040 comp rx=0 tx=0).stop 2023-11-08T19:26:17.519 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.516+0000 7fd68413d700 1 -- 172.21.15.149:0/3698762958 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd67c0cac70 msgr2=0x7fd67c1e81e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:17.519 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.516+0000 7fd68413d700 1 --2- 172.21.15.149:0/3698762958 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd67c0cac70 0x7fd67c1e81e0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fd67000c550 tx=0x7fd67000c910 comp rx=0 tx=0).stop 2023-11-08T19:26:17.520 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.516+0000 7fd68413d700 1 -- 172.21.15.149:0/3698762958 shutdown_connections 2023-11-08T19:26:17.520 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.516+0000 7fd68413d700 1 --2- 172.21.15.149:0/3698762958 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd66006af00 0x7fd66006d3c0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:17.520 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.516+0000 7fd68413d700 1 --2- 172.21.15.149:0/3698762958 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd67c15dc90 0x7fd67c158dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:17.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.516+0000 7fd68413d700 1 --2- 172.21.15.149:0/3698762958 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd67c0cac70 0x7fd67c1e81e0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:17.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.516+0000 7fd68413d700 1 --2- 172.21.15.149:0/3698762958 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd67c0cf940 0x7fd67c1e7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:17.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.516+0000 7fd68413d700 1 -- 172.21.15.149:0/3698762958 >> 172.21.15.149:0/3698762958 conn(0x7fd67c0d0620 msgr2=0x7fd67c0ccf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:17.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.516+0000 7fd68413d700 1 -- 172.21.15.149:0/3698762958 shutdown_connections 2023-11-08T19:26:17.522 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.516+0000 7fd68413d700 1 -- 172.21.15.149:0/3698762958 wait complete. 2023-11-08T19:26:17.530 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-08T19:26:17.530 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:26:17.651 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.649+0000 7f2fa69ff700 1 Processor -- start 2023-11-08T19:26:17.651 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.649+0000 7f2fa69ff700 1 -- start start 2023-11-08T19:26:17.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.650+0000 7f2fa69ff700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f2fa015b950 0x7f2fa00cc290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:17.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.650+0000 7f2fa69ff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2fa00d0fe0 0x7f2fa00cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:17.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.650+0000 7f2fa69ff700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2fa015f440 0x7f2fa015f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:17.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.650+0000 7f2fa69ff700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fa00caa90 con 0x7f2fa00d0fe0 2023-11-08T19:26:17.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.650+0000 7f2fa69ff700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fa015bd30 con 0x7f2fa015b950 2023-11-08T19:26:17.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.650+0000 7f2fa69ff700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa00c7670 con 0x7f2fa015f440 2023-11-08T19:26:17.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.650+0000 7f2f9f7fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2fa00d0fe0 0x7f2fa00cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:17.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.650+0000 7f2f9f7fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2fa00d0fe0 0x7f2fa00cc7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42518/0 (socket says 172.21.15.149:42518) 2023-11-08T19:26:17.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.650+0000 7f2f9f7fe700 1 -- 172.21.15.149:0/132089080 learned_addr learned my addr 172.21.15.149:0/132089080 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:17.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.650+0000 7f2fa4f9c700 1 --2- 172.21.15.149:0/132089080 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2fa015f440 0x7f2fa015f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:17.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.650+0000 7f2f9ffff700 1 --2- 172.21.15.149:0/132089080 >> v2:172.21.15.160:3300/0 conn(0x7f2fa015b950 0x7f2fa00cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:17.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.650+0000 7f2f9f7fe700 1 -- 172.21.15.149:0/132089080 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2fa015f440 msgr2=0x7f2fa015f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:17.657 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.650+0000 7f2f9f7fe700 1 --2- 172.21.15.149:0/132089080 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2fa015f440 0x7f2fa015f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:17.657 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.650+0000 7f2f9f7fe700 1 -- 172.21.15.149:0/132089080 >> v2:172.21.15.160:3300/0 conn(0x7f2fa015b950 msgr2=0x7f2fa00cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:17.657 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.650+0000 7f2f9f7fe700 1 --2- 172.21.15.149:0/132089080 >> v2:172.21.15.160:3300/0 conn(0x7f2fa015b950 0x7f2fa00cc290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:17.657 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.650+0000 7f2f9f7fe700 1 -- 172.21.15.149:0/132089080 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa00c81f0 con 0x7f2fa00d0fe0 2023-11-08T19:26:17.658 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.650+0000 7f2f9f7fe700 1 --2- 172.21.15.149:0/132089080 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fa00d0fe0 0x7f2fa00cc7d0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f2fa00ce120 tx=0x7f2f90009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f77392e9ab9a059a server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:17.658 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.651+0000 7f2f9effd700 1 -- 172.21.15.149:0/132089080 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9000b870 con 0x7f2fa00d0fe0 2023-11-08T19:26:17.658 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.651+0000 7f2f9effd700 1 -- 172.21.15.149:0/132089080 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f9000b9d0 con 0x7f2fa00d0fe0 2023-11-08T19:26:17.658 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.651+0000 7f2f9effd700 1 -- 172.21.15.149:0/132089080 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9000bd60 con 0x7f2fa00d0fe0 2023-11-08T19:26:17.658 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.651+0000 7f2fa69ff700 1 -- 172.21.15.149:0/132089080 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fa00d0fe0 msgr2=0x7f2fa00cc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:17.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.651+0000 7f2fa69ff700 1 --2- 172.21.15.149:0/132089080 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fa00d0fe0 0x7f2fa00cc7d0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f2fa00ce120 tx=0x7f2f90009bd0 comp rx=0 tx=0).stop 2023-11-08T19:26:17.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.651+0000 7f2fa69ff700 1 -- 172.21.15.149:0/132089080 shutdown_connections 2023-11-08T19:26:17.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.651+0000 7f2fa69ff700 1 --2- 172.21.15.149:0/132089080 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2fa015f440 0x7f2fa015f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:17.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.651+0000 7f2fa69ff700 1 --2- 172.21.15.149:0/132089080 >> v2:172.21.15.160:3300/0 conn(0x7f2fa015b950 0x7f2fa00cc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:17.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.651+0000 7f2fa69ff700 1 --2- 172.21.15.149:0/132089080 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fa00d0fe0 0x7f2fa00cc7d0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:17.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.651+0000 7f2fa69ff700 1 -- 172.21.15.149:0/132089080 >> 172.21.15.149:0/132089080 conn(0x7f2fa0099a40 msgr2=0x7f2fa00d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:17.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.651+0000 7f2fa69ff700 1 -- 172.21.15.149:0/132089080 shutdown_connections 2023-11-08T19:26:17.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.651+0000 7f2fa69ff700 1 -- 172.21.15.149:0/132089080 wait complete. 2023-11-08T19:26:17.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.652+0000 7f2fa69ff700 1 Processor -- start 2023-11-08T19:26:17.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.653+0000 7f2fa69ff700 1 -- start start 2023-11-08T19:26:17.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.653+0000 7f2fa69ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2fa00d0fe0 0x7f2fa009c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:17.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.653+0000 7f2fa69ff700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2fa015b950 0x7f2fa014e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:17.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.653+0000 7f2fa69ff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fa015f440 0x7f2fa009dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:17.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.653+0000 7f2fa69ff700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa009d7b0 con 0x7f2fa015f440 2023-11-08T19:26:17.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.653+0000 7f2fa69ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa009cba0 con 0x7f2fa00d0fe0 2023-11-08T19:26:17.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.653+0000 7f2fa69ff700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa009ce80 con 0x7f2fa015b950 2023-11-08T19:26:17.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.653+0000 7f2fa4f9c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fa015f440 0x7f2fa009dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:17.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.653+0000 7f2fa4f9c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fa015f440 0x7f2fa009dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42528/0 (socket says 172.21.15.149:42528) 2023-11-08T19:26:17.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.653+0000 7f2fa4f9c700 1 -- 172.21.15.149:0/110375562 learned_addr learned my addr 172.21.15.149:0/110375562 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:17.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.653+0000 7f2f9f7fe700 1 --2- 172.21.15.149:0/110375562 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2fa015b950 0x7f2fa014e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:17.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.653+0000 7f2f9ffff700 1 --2- 172.21.15.149:0/110375562 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2fa00d0fe0 0x7f2fa009c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:17.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.654+0000 7f2fa4f9c700 1 -- 172.21.15.149:0/110375562 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2fa015b950 msgr2=0x7f2fa014e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:17.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.654+0000 7f2fa4f9c700 1 --2- 172.21.15.149:0/110375562 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2fa015b950 0x7f2fa014e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:17.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.654+0000 7f2fa4f9c700 1 -- 172.21.15.149:0/110375562 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2fa00d0fe0 msgr2=0x7f2fa009c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:17.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.654+0000 7f2fa4f9c700 1 --2- 172.21.15.149:0/110375562 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2fa00d0fe0 0x7f2fa009c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:17.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.654+0000 7f2fa4f9c700 1 -- 172.21.15.149:0/110375562 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f90009550 con 0x7f2fa015f440 2023-11-08T19:26:17.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.654+0000 7f2fa4f9c700 1 --2- 172.21.15.149:0/110375562 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fa015f440 0x7f2fa009dc40 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f2f98007e60 tx=0x7f2f9800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:17.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.654+0000 7f2f9cff9700 1 -- 172.21.15.149:0/110375562 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9800ed30 con 0x7f2fa015f440 2023-11-08T19:26:17.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.654+0000 7f2f9cff9700 1 -- 172.21.15.149:0/110375562 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f98014420 con 0x7f2fa015f440 2023-11-08T19:26:17.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.654+0000 7f2f9cff9700 1 -- 172.21.15.149:0/110375562 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f980147d0 con 0x7f2fa015f440 2023-11-08T19:26:17.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.654+0000 7f2fa69ff700 1 -- 172.21.15.149:0/110375562 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fa009d160 con 0x7f2fa015f440 2023-11-08T19:26:17.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.654+0000 7f2fa69ff700 1 -- 172.21.15.149:0/110375562 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fa014edd0 con 0x7f2fa015f440 2023-11-08T19:26:17.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.655+0000 7f2fa69ff700 1 -- 172.21.15.149:0/110375562 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fa014ef60 con 0x7f2fa015f440 2023-11-08T19:26:17.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.655+0000 7f2f9cff9700 1 -- 172.21.15.149:0/110375562 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2f98014930 con 0x7f2fa015f440 2023-11-08T19:26:17.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.656+0000 7f2f9cff9700 1 --2- 172.21.15.149:0/110375562 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2f8c06af00 0x7f2f8c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:17.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.656+0000 7f2f9cff9700 1 -- 172.21.15.149:0/110375562 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f2f9808a060 con 0x7f2fa015f440 2023-11-08T19:26:17.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.656+0000 7f2f9ffff700 1 --2- 172.21.15.149:0/110375562 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2f8c06af00 0x7f2f8c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:17.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.656+0000 7f2f9ffff700 1 --2- 172.21.15.149:0/110375562 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2f8c06af00 0x7f2f8c06d3c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f2f94006fd0 tx=0x7f2f94008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:17.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.661+0000 7f2f9cff9700 1 -- 172.21.15.149:0/110375562 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2f98054c30 con 0x7f2fa015f440 2023-11-08T19:26:17.851 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.848+0000 7f2fa69ff700 1 -- 172.21.15.149:0/110375562 --> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2fa00c78c0 con 0x7f2f8c06af00 2023-11-08T19:26:17.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.861+0000 7f2f9cff9700 1 -- 172.21.15.149:0/110375562 <== mgr.4104 v2:172.21.15.149:6832/1929837472 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+523682 (secure 0 0 0) 0x7f2f94009e60 con 0x7f2f8c06af00 2023-11-08T19:26:17.869 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:26:17.874 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.865+0000 7f2fa69ff700 1 -- 172.21.15.149:0/110375562 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2f8c06af00 msgr2=0x7f2f8c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:17.874 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.865+0000 7f2fa69ff700 1 --2- 172.21.15.149:0/110375562 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2f8c06af00 0x7f2f8c06d3c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f2f94006fd0 tx=0x7f2f94008040 comp rx=0 tx=0).stop 2023-11-08T19:26:17.874 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.865+0000 7f2fa69ff700 1 -- 172.21.15.149:0/110375562 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fa015f440 msgr2=0x7f2fa009dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:17.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.865+0000 7f2fa69ff700 1 --2- 172.21.15.149:0/110375562 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fa015f440 0x7f2fa009dc40 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f2f98007e60 tx=0x7f2f9800e3c0 comp rx=0 tx=0).stop 2023-11-08T19:26:17.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.865+0000 7f2fa69ff700 1 -- 172.21.15.149:0/110375562 shutdown_connections 2023-11-08T19:26:17.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.865+0000 7f2fa69ff700 1 --2- 172.21.15.149:0/110375562 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2f8c06af00 0x7f2f8c06d3c0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:17.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.865+0000 7f2fa69ff700 1 --2- 172.21.15.149:0/110375562 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2fa00d0fe0 0x7f2fa009c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:17.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.865+0000 7f2fa69ff700 1 --2- 172.21.15.149:0/110375562 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fa015f440 0x7f2fa009dc40 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:17.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.865+0000 7f2fa69ff700 1 --2- 172.21.15.149:0/110375562 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2fa015b950 0x7f2fa014e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:17.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.865+0000 7f2fa69ff700 1 -- 172.21.15.149:0/110375562 >> 172.21.15.149:0/110375562 conn(0x7f2fa0099a40 msgr2=0x7f2fa00c9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:17.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.865+0000 7f2fa69ff700 1 -- 172.21.15.149:0/110375562 shutdown_connections 2023-11-08T19:26:17.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:17.865+0000 7f2fa69ff700 1 -- 172.21.15.149:0/110375562 wait complete. 2023-11-08T19:26:17.876 INFO:teuthology.orchestra.run.smithi149.stderr:dumped all 2023-11-08T19:26:17.879 INFO:teuthology.orchestra.run.smithi149.stdout:{"pg_ready":true,"pg_map":{"version":176,"stamp":"2023-11-08T19:26:16.028781+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590480,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":164,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":221,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225012,"kb_used_data":8852,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754749708,"statfs":{"total":773094113280,"available":772863700992,"internally_reserved":0,"allocated":9064448,"data_stored":4954891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.905889"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.132306+0000","last_change":"2023-11-08T19:26:11.132306+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.132306+0000","last_undegraded":"2023-11-08T19:26:11.132306+0000","last_fullsized":"2023-11-08T19:26:11.132306+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.130646+0000","last_change":"2023-11-08T19:26:11.130646+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.130646+0000","last_undegraded":"2023-11-08T19:26:11.130646+0000","last_fullsized":"2023-11-08T19:26:11.130646+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.134023+0000","last_change":"2023-11-08T19:26:11.134023+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.134023+0000","last_undegraded":"2023-11-08T19:26:11.134023+0000","last_fullsized":"2023-11-08T19:26:11.134023+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.158573+0000","last_change":"2023-11-08T19:26:12.159151+0000","last_active":"2023-11-08T19:26:13.158573+0000","last_peered":"2023-11-08T19:26:13.158573+0000","last_clean":"2023-11-08T19:26:13.158573+0000","last_became_active":"2023-11-08T19:26:12.158889+0000","last_became_peered":"2023-11-08T19:26:12.158889+0000","last_unstale":"2023-11-08T19:26:13.158573+0000","last_undegraded":"2023-11-08T19:26:13.158573+0000","last_fullsized":"2023-11-08T19:26:13.158573+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:40:48.988790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.157287+0000","last_change":"2023-11-08T19:26:12.159875+0000","last_active":"2023-11-08T19:26:13.157287+0000","last_peered":"2023-11-08T19:26:13.157287+0000","last_clean":"2023-11-08T19:26:13.157287+0000","last_became_active":"2023-11-08T19:26:12.159616+0000","last_became_peered":"2023-11-08T19:26:12.159616+0000","last_unstale":"2023-11-08T19:26:13.157287+0000","last_undegraded":"2023-11-08T19:26:13.157287+0000","last_fullsized":"2023-11-08T19:26:13.157287+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:31:03.813978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.131549+0000","last_change":"2023-11-08T19:26:11.131549+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.131549+0000","last_undegraded":"2023-11-08T19:26:11.131549+0000","last_fullsized":"2023-11-08T19:26:11.131549+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.158902+0000","last_change":"2023-11-08T19:26:12.163084+0000","last_active":"2023-11-08T19:26:13.158902+0000","last_peered":"2023-11-08T19:26:13.158902+0000","last_clean":"2023-11-08T19:26:13.158902+0000","last_became_active":"2023-11-08T19:26:12.162467+0000","last_became_peered":"2023-11-08T19:26:12.162467+0000","last_unstale":"2023-11-08T19:26:13.158902+0000","last_undegraded":"2023-11-08T19:26:13.158902+0000","last_fullsized":"2023-11-08T19:26:13.158902+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:15:38.428199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.130524+0000","last_change":"2023-11-08T19:26:11.130524+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.130524+0000","last_undegraded":"2023-11-08T19:26:11.130524+0000","last_fullsized":"2023-11-08T19:26:11.130524+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.132912+0000","last_change":"2023-11-08T19:26:11.132912+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.132912+0000","last_undegraded":"2023-11-08T19:26:11.132912+0000","last_fullsized":"2023-11-08T19:26:11.132912+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.132409+0000","last_change":"2023-11-08T19:26:11.132409+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.132409+0000","last_undegraded":"2023-11-08T19:26:11.132409+0000","last_fullsized":"2023-11-08T19:26:11.132409+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.157213+0000","last_change":"2023-11-08T19:26:12.171269+0000","last_active":"2023-11-08T19:26:13.157213+0000","last_peered":"2023-11-08T19:26:13.157213+0000","last_clean":"2023-11-08T19:26:13.157213+0000","last_became_active":"2023-11-08T19:26:12.171009+0000","last_became_peered":"2023-11-08T19:26:12.171009+0000","last_unstale":"2023-11-08T19:26:13.157213+0000","last_undegraded":"2023-11-08T19:26:13.157213+0000","last_fullsized":"2023-11-08T19:26:13.157213+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:19:17.065471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.132284+0000","last_change":"2023-11-08T19:26:11.132284+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.132284+0000","last_undegraded":"2023-11-08T19:26:11.132284+0000","last_fullsized":"2023-11-08T19:26:11.132284+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.131376+0000","last_change":"2023-11-08T19:26:11.131376+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.131376+0000","last_undegraded":"2023-11-08T19:26:11.131376+0000","last_fullsized":"2023-11-08T19:26:11.131376+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.157398+0000","last_change":"2023-11-08T19:26:12.171667+0000","last_active":"2023-11-08T19:26:13.157398+0000","last_peered":"2023-11-08T19:26:13.157398+0000","last_clean":"2023-11-08T19:26:13.157398+0000","last_became_active":"2023-11-08T19:26:12.169680+0000","last_became_peered":"2023-11-08T19:26:12.169680+0000","last_unstale":"2023-11-08T19:26:13.157398+0000","last_undegraded":"2023-11-08T19:26:13.157398+0000","last_fullsized":"2023-11-08T19:26:13.157398+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:04:11.614632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.158798+0000","last_change":"2023-11-08T19:26:12.168622+0000","last_active":"2023-11-08T19:26:13.158798+0000","last_peered":"2023-11-08T19:26:13.158798+0000","last_clean":"2023-11-08T19:26:13.158798+0000","last_became_active":"2023-11-08T19:26:12.168321+0000","last_became_peered":"2023-11-08T19:26:12.168321+0000","last_unstale":"2023-11-08T19:26:13.158798+0000","last_undegraded":"2023-11-08T19:26:13.158798+0000","last_fullsized":"2023-11-08T19:26:13.158798+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:45:37.194772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.132057+0000","last_change":"2023-11-08T19:26:11.132057+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.132057+0000","last_undegraded":"2023-11-08T19:26:11.132057+0000","last_fullsized":"2023-11-08T19:26:11.132057+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.130468+0000","last_change":"2023-11-08T19:26:11.130468+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.130468+0000","last_undegraded":"2023-11-08T19:26:11.130468+0000","last_fullsized":"2023-11-08T19:26:11.130468+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.f","version":"82'1","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.173319+0000","last_change":"2023-11-08T19:26:11.143492+0000","last_active":"2023-11-08T19:26:12.173319+0000","last_peered":"2023-11-08T19:26:12.173319+0000","last_clean":"2023-11-08T19:26:12.173319+0000","last_became_active":"2023-11-08T19:26:11.143296+0000","last_became_peered":"2023-11-08T19:26:11.143296+0000","last_unstale":"2023-11-08T19:26:12.173319+0000","last_undegraded":"2023-11-08T19:26:12.173319+0000","last_fullsized":"2023-11-08T19:26:12.173319+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:58:53.201963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.127738+0000","last_change":"2023-11-08T19:25:47.285071+0000","last_active":"2023-11-08T19:26:10.127738+0000","last_peered":"2023-11-08T19:26:10.127738+0000","last_clean":"2023-11-08T19:26:10.127738+0000","last_became_active":"2023-11-08T19:25:47.284788+0000","last_became_peered":"2023-11-08T19:25:47.284788+0000","last_unstale":"2023-11-08T19:26:10.127738+0000","last_undegraded":"2023-11-08T19:26:10.127738+0000","last_fullsized":"2023-11-08T19:26:10.127738+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:50:50.522780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":218,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.150652+0000","last_change":"2023-11-08T19:22:58.054283+0000","last_active":"2023-11-08T19:26:12.150652+0000","last_peered":"2023-11-08T19:26:12.150652+0000","last_clean":"2023-11-08T19:26:12.150652+0000","last_became_active":"2023-11-08T19:22:58.053337+0000","last_became_peered":"2023-11-08T19:22:58.053337+0000","last_unstale":"2023-11-08T19:26:12.150652+0000","last_undegraded":"2023-11-08T19:26:12.150652+0000","last_fullsized":"2023-11-08T19:26:12.150652+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:22:56.479654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:22:56.479654+0000","last_clean_scrub_stamp":"2023-11-08T19:22:56.479654+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:16:05.317001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.536896+0000","last_change":"2023-11-08T19:24:32.530665+0000","last_active":"2023-11-08T19:26:06.536896+0000","last_peered":"2023-11-08T19:26:06.536896+0000","last_clean":"2023-11-08T19:26:06.536896+0000","last_became_active":"2023-11-08T19:24:31.148363+0000","last_became_peered":"2023-11-08T19:24:31.148363+0000","last_unstale":"2023-11-08T19:26:06.536896+0000","last_undegraded":"2023-11-08T19:26:06.536896+0000","last_fullsized":"2023-11-08T19:26:06.536896+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:02:27.987795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075444200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.152384+0000","last_change":"2023-11-08T19:25:48.371346+0000","last_active":"2023-11-08T19:26:12.152384+0000","last_peered":"2023-11-08T19:26:12.152384+0000","last_clean":"2023-11-08T19:26:12.152384+0000","last_became_active":"2023-11-08T19:25:46.289470+0000","last_became_peered":"2023-11-08T19:25:46.289470+0000","last_unstale":"2023-11-08T19:26:12.152384+0000","last_undegraded":"2023-11-08T19:26:12.152384+0000","last_fullsized":"2023-11-08T19:26:12.152384+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:25:34.010085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000371219,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.128507+0000","last_change":"2023-11-08T19:26:10.128507+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.128507+0000","last_undegraded":"2023-11-08T19:26:10.128507+0000","last_fullsized":"2023-11-08T19:26:10.128507+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.656777+0000","last_change":"2023-11-08T19:25:47.283242+0000","last_active":"2023-11-08T19:26:06.656777+0000","last_peered":"2023-11-08T19:26:06.656777+0000","last_clean":"2023-11-08T19:26:06.656777+0000","last_became_active":"2023-11-08T19:25:47.282922+0000","last_became_peered":"2023-11-08T19:25:47.282922+0000","last_unstale":"2023-11-08T19:26:06.656777+0000","last_undegraded":"2023-11-08T19:26:06.656777+0000","last_fullsized":"2023-11-08T19:26:06.656777+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:26:23.400596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":48,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.126032+0000","last_change":"2023-11-08T19:24:32.544333+0000","last_active":"2023-11-08T19:26:10.126032+0000","last_peered":"2023-11-08T19:26:10.126032+0000","last_clean":"2023-11-08T19:26:10.126032+0000","last_became_active":"2023-11-08T19:24:31.138598+0000","last_became_peered":"2023-11-08T19:24:31.138598+0000","last_unstale":"2023-11-08T19:26:10.126032+0000","last_undegraded":"2023-11-08T19:26:10.126032+0000","last_fullsized":"2023-11-08T19:26:10.126032+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:11.860580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015114824000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.656459+0000","last_change":"2023-11-08T19:25:48.374357+0000","last_active":"2023-11-08T19:26:06.656459+0000","last_peered":"2023-11-08T19:26:06.656459+0000","last_clean":"2023-11-08T19:26:06.656459+0000","last_became_active":"2023-11-08T19:25:46.279007+0000","last_became_peered":"2023-11-08T19:25:46.279007+0000","last_unstale":"2023-11-08T19:26:06.656459+0000","last_undegraded":"2023-11-08T19:26:06.656459+0000","last_fullsized":"2023-11-08T19:26:06.656459+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:59:30.845191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036813240000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.127179+0000","last_change":"2023-11-08T19:26:10.127179+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.127179+0000","last_undegraded":"2023-11-08T19:26:10.127179+0000","last_fullsized":"2023-11-08T19:26:10.127179+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":19,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.655722+0000","last_change":"2023-11-08T19:25:47.285093+0000","last_active":"2023-11-08T19:26:06.655722+0000","last_peered":"2023-11-08T19:26:06.655722+0000","last_clean":"2023-11-08T19:26:06.655722+0000","last_became_active":"2023-11-08T19:25:47.284796+0000","last_became_peered":"2023-11-08T19:25:47.284796+0000","last_unstale":"2023-11-08T19:26:06.655722+0000","last_undegraded":"2023-11-08T19:26:06.655722+0000","last_fullsized":"2023-11-08T19:26:06.655722+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:46:36.504650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":48,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.126151+0000","last_change":"2023-11-08T19:24:32.544285+0000","last_active":"2023-11-08T19:26:10.126151+0000","last_peered":"2023-11-08T19:26:10.126151+0000","last_clean":"2023-11-08T19:26:10.126151+0000","last_became_active":"2023-11-08T19:24:31.142028+0000","last_became_peered":"2023-11-08T19:24:31.142028+0000","last_unstale":"2023-11-08T19:26:10.126151+0000","last_undegraded":"2023-11-08T19:26:10.126151+0000","last_fullsized":"2023-11-08T19:26:10.126151+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:01:24.198196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067537399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.125396+0000","last_change":"2023-11-08T19:25:48.372192+0000","last_active":"2023-11-08T19:26:10.125396+0000","last_peered":"2023-11-08T19:26:10.125396+0000","last_clean":"2023-11-08T19:26:10.125396+0000","last_became_active":"2023-11-08T19:25:46.288739+0000","last_became_peered":"2023-11-08T19:25:46.288739+0000","last_unstale":"2023-11-08T19:26:10.125396+0000","last_undegraded":"2023-11-08T19:26:10.125396+0000","last_fullsized":"2023-11-08T19:26:10.125396+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:45:04.839053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015057530000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.126826+0000","last_change":"2023-11-08T19:26:10.126826+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.126826+0000","last_undegraded":"2023-11-08T19:26:10.126826+0000","last_fullsized":"2023-11-08T19:26:10.126826+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.656592+0000","last_change":"2023-11-08T19:25:47.287920+0000","last_active":"2023-11-08T19:26:06.656592+0000","last_peered":"2023-11-08T19:26:06.656592+0000","last_clean":"2023-11-08T19:26:06.656592+0000","last_became_active":"2023-11-08T19:25:47.287494+0000","last_became_peered":"2023-11-08T19:25:47.287494+0000","last_unstale":"2023-11-08T19:26:06.656592+0000","last_undegraded":"2023-11-08T19:26:06.656592+0000","last_fullsized":"2023-11-08T19:26:06.656592+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:42:18.942062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":49,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.655728+0000","last_change":"2023-11-08T19:24:32.142836+0000","last_active":"2023-11-08T19:26:06.655728+0000","last_peered":"2023-11-08T19:26:06.655728+0000","last_clean":"2023-11-08T19:26:06.655728+0000","last_became_active":"2023-11-08T19:24:31.141367+0000","last_became_peered":"2023-11-08T19:24:31.141367+0000","last_unstale":"2023-11-08T19:26:06.655728+0000","last_undegraded":"2023-11-08T19:26:06.655728+0000","last_fullsized":"2023-11-08T19:26:06.655728+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:39.214888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001335136,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.126066+0000","last_change":"2023-11-08T19:25:48.372718+0000","last_active":"2023-11-08T19:26:10.126066+0000","last_peered":"2023-11-08T19:26:10.126066+0000","last_clean":"2023-11-08T19:26:10.126066+0000","last_became_active":"2023-11-08T19:25:46.289283+0000","last_became_peered":"2023-11-08T19:25:46.289283+0000","last_unstale":"2023-11-08T19:26:10.126066+0000","last_undegraded":"2023-11-08T19:26:10.126066+0000","last_fullsized":"2023-11-08T19:26:10.126066+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:15:51.881891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001274049,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.127425+0000","last_change":"2023-11-08T19:26:10.127425+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.127425+0000","last_undegraded":"2023-11-08T19:26:10.127425+0000","last_fullsized":"2023-11-08T19:26:10.127425+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":19,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.655831+0000","last_change":"2023-11-08T19:25:47.285353+0000","last_active":"2023-11-08T19:26:06.655831+0000","last_peered":"2023-11-08T19:26:06.655831+0000","last_clean":"2023-11-08T19:26:06.655831+0000","last_became_active":"2023-11-08T19:25:47.285075+0000","last_became_peered":"2023-11-08T19:25:47.285075+0000","last_unstale":"2023-11-08T19:26:06.655831+0000","last_undegraded":"2023-11-08T19:26:06.655831+0000","last_fullsized":"2023-11-08T19:26:06.655831+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:20:50.791463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":55,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.124563+0000","last_change":"2023-11-08T19:24:32.139885+0000","last_active":"2023-11-08T19:26:10.124563+0000","last_peered":"2023-11-08T19:26:10.124563+0000","last_clean":"2023-11-08T19:26:10.124563+0000","last_became_active":"2023-11-08T19:24:31.145329+0000","last_became_peered":"2023-11-08T19:24:31.145329+0000","last_unstale":"2023-11-08T19:26:10.124563+0000","last_undegraded":"2023-11-08T19:26:10.124563+0000","last_fullsized":"2023-11-08T19:26:10.124563+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:25:18.356784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049012999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.656819+0000","last_change":"2023-11-08T19:25:48.373848+0000","last_active":"2023-11-08T19:26:06.656819+0000","last_peered":"2023-11-08T19:26:06.656819+0000","last_clean":"2023-11-08T19:26:06.656819+0000","last_became_active":"2023-11-08T19:25:46.282174+0000","last_became_peered":"2023-11-08T19:25:46.282174+0000","last_unstale":"2023-11-08T19:26:06.656819+0000","last_undegraded":"2023-11-08T19:26:06.656819+0000","last_fullsized":"2023-11-08T19:26:06.656819+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:00:06.938052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000727792,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":3,"reported_epoch":81,"state":"creating+activating","last_fresh":"2023-11-08T19:26:11.130325+0000","last_change":"2023-11-08T19:26:11.130325+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.130325+0000","last_undegraded":"2023-11-08T19:26:11.130325+0000","last_fullsized":"2023-11-08T19:26:11.130325+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:26:26.007199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":["4","2"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.124963+0000","last_change":"2023-11-08T19:25:47.287677+0000","last_active":"2023-11-08T19:26:10.124963+0000","last_peered":"2023-11-08T19:26:10.124963+0000","last_clean":"2023-11-08T19:26:10.124963+0000","last_became_active":"2023-11-08T19:25:47.287419+0000","last_became_peered":"2023-11-08T19:25:47.287419+0000","last_unstale":"2023-11-08T19:26:10.124963+0000","last_undegraded":"2023-11-08T19:26:10.124963+0000","last_fullsized":"2023-11-08T19:26:10.124963+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:22:08.770702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":53,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.373729+0000","last_change":"2023-11-08T19:24:32.140880+0000","last_active":"2023-11-08T19:26:06.373729+0000","last_peered":"2023-11-08T19:26:06.373729+0000","last_clean":"2023-11-08T19:26:06.373729+0000","last_became_active":"2023-11-08T19:24:31.146063+0000","last_became_peered":"2023-11-08T19:24:31.146063+0000","last_unstale":"2023-11-08T19:26:06.373729+0000","last_undegraded":"2023-11-08T19:26:06.373729+0000","last_fullsized":"2023-11-08T19:26:06.373729+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:54:08.985813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089896300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.536953+0000","last_change":"2023-11-08T19:25:48.374690+0000","last_active":"2023-11-08T19:26:06.536953+0000","last_peered":"2023-11-08T19:26:06.536953+0000","last_clean":"2023-11-08T19:26:06.536953+0000","last_became_active":"2023-11-08T19:25:46.281986+0000","last_became_peered":"2023-11-08T19:25:46.281986+0000","last_unstale":"2023-11-08T19:26:06.536953+0000","last_undegraded":"2023-11-08T19:26:06.536953+0000","last_fullsized":"2023-11-08T19:26:06.536953+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:21:00.981136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003067771,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.122829+0000","last_change":"2023-11-08T19:26:10.122829+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.122829+0000","last_undegraded":"2023-11-08T19:26:10.122829+0000","last_fullsized":"2023-11-08T19:26:10.122829+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.152860+0000","last_change":"2023-11-08T19:25:47.287986+0000","last_active":"2023-11-08T19:26:12.152860+0000","last_peered":"2023-11-08T19:26:12.152860+0000","last_clean":"2023-11-08T19:26:12.152860+0000","last_became_active":"2023-11-08T19:25:47.287560+0000","last_became_peered":"2023-11-08T19:25:47.287560+0000","last_unstale":"2023-11-08T19:26:12.152860+0000","last_undegraded":"2023-11-08T19:26:12.152860+0000","last_fullsized":"2023-11-08T19:26:12.152860+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:35:31.433056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.537019+0000","last_change":"2023-11-08T19:24:32.530620+0000","last_active":"2023-11-08T19:26:06.537019+0000","last_peered":"2023-11-08T19:26:06.537019+0000","last_clean":"2023-11-08T19:26:06.537019+0000","last_became_active":"2023-11-08T19:24:31.144223+0000","last_became_peered":"2023-11-08T19:24:31.144223+0000","last_unstale":"2023-11-08T19:26:06.537019+0000","last_undegraded":"2023-11-08T19:26:06.537019+0000","last_fullsized":"2023-11-08T19:26:06.537019+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:01:25.647952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071879799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.373882+0000","last_change":"2023-11-08T19:25:48.285326+0000","last_active":"2023-11-08T19:26:06.373882+0000","last_peered":"2023-11-08T19:26:06.373882+0000","last_clean":"2023-11-08T19:26:06.373882+0000","last_became_active":"2023-11-08T19:25:46.278686+0000","last_became_peered":"2023-11-08T19:25:46.278686+0000","last_unstale":"2023-11-08T19:26:06.373882+0000","last_undegraded":"2023-11-08T19:26:06.373882+0000","last_fullsized":"2023-11-08T19:26:06.373882+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:25:34.010085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078409499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.159113+0000","last_change":"2023-11-08T19:26:12.163265+0000","last_active":"2023-11-08T19:26:13.159113+0000","last_peered":"2023-11-08T19:26:13.159113+0000","last_clean":"2023-11-08T19:26:13.159113+0000","last_became_active":"2023-11-08T19:26:12.162822+0000","last_became_peered":"2023-11-08T19:26:12.162822+0000","last_unstale":"2023-11-08T19:26:13.159113+0000","last_undegraded":"2023-11-08T19:26:13.159113+0000","last_fullsized":"2023-11-08T19:26:13.159113+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:45:22.870353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.129895+0000","last_change":"2023-11-08T19:26:10.129895+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.129895+0000","last_undegraded":"2023-11-08T19:26:10.129895+0000","last_fullsized":"2023-11-08T19:26:10.129895+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":20,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.373428+0000","last_change":"2023-11-08T19:25:47.289726+0000","last_active":"2023-11-08T19:26:06.373428+0000","last_peered":"2023-11-08T19:26:06.373428+0000","last_clean":"2023-11-08T19:26:06.373428+0000","last_became_active":"2023-11-08T19:25:47.289362+0000","last_became_peered":"2023-11-08T19:25:47.289362+0000","last_unstale":"2023-11-08T19:26:06.373428+0000","last_undegraded":"2023-11-08T19:26:06.373428+0000","last_fullsized":"2023-11-08T19:26:06.373428+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:38:55.785104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.152547+0000","last_change":"2023-11-08T19:24:32.147025+0000","last_active":"2023-11-08T19:26:12.152547+0000","last_peered":"2023-11-08T19:26:12.152547+0000","last_clean":"2023-11-08T19:26:12.152547+0000","last_became_active":"2023-11-08T19:24:31.147082+0000","last_became_peered":"2023-11-08T19:24:31.147082+0000","last_unstale":"2023-11-08T19:26:12.152547+0000","last_undegraded":"2023-11-08T19:26:12.152547+0000","last_fullsized":"2023-11-08T19:26:12.152547+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:02:27.987795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043701599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.537040+0000","last_change":"2023-11-08T19:25:48.374739+0000","last_active":"2023-11-08T19:26:06.537040+0000","last_peered":"2023-11-08T19:26:06.537040+0000","last_clean":"2023-11-08T19:26:06.537040+0000","last_became_active":"2023-11-08T19:25:46.282071+0000","last_became_peered":"2023-11-08T19:25:46.282071+0000","last_unstale":"2023-11-08T19:26:06.537040+0000","last_undegraded":"2023-11-08T19:26:06.537040+0000","last_fullsized":"2023-11-08T19:26:06.537040+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:42:47.677504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023654909999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.128081+0000","last_change":"2023-11-08T19:26:10.128081+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.128081+0000","last_undegraded":"2023-11-08T19:26:10.128081+0000","last_fullsized":"2023-11-08T19:26:10.128081+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":48,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.126115+0000","last_change":"2023-11-08T19:24:32.544063+0000","last_active":"2023-11-08T19:26:10.126115+0000","last_peered":"2023-11-08T19:26:10.126115+0000","last_clean":"2023-11-08T19:26:10.126115+0000","last_became_active":"2023-11-08T19:24:31.144795+0000","last_became_peered":"2023-11-08T19:24:31.144795+0000","last_unstale":"2023-11-08T19:26:10.126115+0000","last_undegraded":"2023-11-08T19:26:10.126115+0000","last_fullsized":"2023-11-08T19:26:10.126115+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:12:42.248307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01495431,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.372839+0000","last_change":"2023-11-08T19:25:48.283673+0000","last_active":"2023-11-08T19:26:06.372839+0000","last_peered":"2023-11-08T19:26:06.372839+0000","last_clean":"2023-11-08T19:26:06.372839+0000","last_became_active":"2023-11-08T19:25:46.285766+0000","last_became_peered":"2023-11-08T19:25:46.285766+0000","last_unstale":"2023-11-08T19:26:06.372839+0000","last_undegraded":"2023-11-08T19:26:06.372839+0000","last_fullsized":"2023-11-08T19:26:06.372839+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:46:35.498766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001756748,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.150819+0000","last_change":"2023-11-08T19:25:47.288301+0000","last_active":"2023-11-08T19:26:12.150819+0000","last_peered":"2023-11-08T19:26:12.150819+0000","last_clean":"2023-11-08T19:26:12.150819+0000","last_became_active":"2023-11-08T19:25:47.288027+0000","last_became_peered":"2023-11-08T19:25:47.288027+0000","last_unstale":"2023-11-08T19:26:12.150819+0000","last_undegraded":"2023-11-08T19:26:12.150819+0000","last_fullsized":"2023-11-08T19:26:12.150819+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:23:13.428596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.129880+0000","last_change":"2023-11-08T19:26:11.129880+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.129880+0000","last_undegraded":"2023-11-08T19:26:11.129880+0000","last_fullsized":"2023-11-08T19:26:11.129880+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.123109+0000","last_change":"2023-11-08T19:26:10.123109+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.123109+0000","last_undegraded":"2023-11-08T19:26:10.123109+0000","last_fullsized":"2023-11-08T19:26:10.123109+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":49,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.125528+0000","last_change":"2023-11-08T19:24:32.263810+0000","last_active":"2023-11-08T19:26:10.125528+0000","last_peered":"2023-11-08T19:26:10.125528+0000","last_clean":"2023-11-08T19:26:10.125528+0000","last_became_active":"2023-11-08T19:24:31.138814+0000","last_became_peered":"2023-11-08T19:24:31.138814+0000","last_unstale":"2023-11-08T19:26:10.125528+0000","last_undegraded":"2023-11-08T19:26:10.125528+0000","last_fullsized":"2023-11-08T19:26:10.125528+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:21:55.985548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048136000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.124329+0000","last_change":"2023-11-08T19:25:48.283572+0000","last_active":"2023-11-08T19:26:10.124329+0000","last_peered":"2023-11-08T19:26:10.124329+0000","last_clean":"2023-11-08T19:26:10.124329+0000","last_became_active":"2023-11-08T19:25:46.271936+0000","last_became_peered":"2023-11-08T19:25:46.271936+0000","last_unstale":"2023-11-08T19:26:10.124329+0000","last_undegraded":"2023-11-08T19:26:10.124329+0000","last_fullsized":"2023-11-08T19:26:10.124329+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:46:11.541748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00186835,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":20,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.372680+0000","last_change":"2023-11-08T19:25:47.282856+0000","last_active":"2023-11-08T19:26:06.372680+0000","last_peered":"2023-11-08T19:26:06.372680+0000","last_clean":"2023-11-08T19:26:06.372680+0000","last_became_active":"2023-11-08T19:25:47.282594+0000","last_became_peered":"2023-11-08T19:25:47.282594+0000","last_unstale":"2023-11-08T19:26:06.372680+0000","last_undegraded":"2023-11-08T19:26:06.372680+0000","last_fullsized":"2023-11-08T19:26:06.372680+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:14:12.111756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":3,"reported_epoch":81,"state":"creating+activating","last_fresh":"2023-11-08T19:26:11.131733+0000","last_change":"2023-11-08T19:26:11.131733+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.131733+0000","last_undegraded":"2023-11-08T19:26:11.131733+0000","last_fullsized":"2023-11-08T19:26:11.131733+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:23:55.641598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.656539+0000","last_change":"2023-11-08T19:24:32.333096+0000","last_active":"2023-11-08T19:26:06.656539+0000","last_peered":"2023-11-08T19:26:06.656539+0000","last_clean":"2023-11-08T19:26:06.656539+0000","last_became_active":"2023-11-08T19:24:31.142985+0000","last_became_peered":"2023-11-08T19:24:31.142985+0000","last_unstale":"2023-11-08T19:26:06.656539+0000","last_undegraded":"2023-11-08T19:26:06.656539+0000","last_fullsized":"2023-11-08T19:26:06.656539+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:36:33.274496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000386048,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.536827+0000","last_change":"2023-11-08T19:25:48.372963+0000","last_active":"2023-11-08T19:26:06.536827+0000","last_peered":"2023-11-08T19:26:06.536827+0000","last_clean":"2023-11-08T19:26:06.536827+0000","last_became_active":"2023-11-08T19:25:46.283263+0000","last_became_peered":"2023-11-08T19:25:46.283263+0000","last_unstale":"2023-11-08T19:26:06.536827+0000","last_undegraded":"2023-11-08T19:26:06.536827+0000","last_fullsized":"2023-11-08T19:26:06.536827+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:25:34.010085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019848779999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":19,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.655803+0000","last_change":"2023-11-08T19:25:47.284816+0000","last_active":"2023-11-08T19:26:06.655803+0000","last_peered":"2023-11-08T19:26:06.655803+0000","last_clean":"2023-11-08T19:26:06.655803+0000","last_became_active":"2023-11-08T19:25:47.284522+0000","last_became_peered":"2023-11-08T19:25:47.284522+0000","last_unstale":"2023-11-08T19:26:06.655803+0000","last_undegraded":"2023-11-08T19:26:06.655803+0000","last_fullsized":"2023-11-08T19:26:06.655803+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:39:28.223686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.129454+0000","last_change":"2023-11-08T19:26:10.129454+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.129454+0000","last_undegraded":"2023-11-08T19:26:10.129454+0000","last_fullsized":"2023-11-08T19:26:10.129454+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.536570+0000","last_change":"2023-11-08T19:24:32.530333+0000","last_active":"2023-11-08T19:26:06.536570+0000","last_peered":"2023-11-08T19:26:06.536570+0000","last_clean":"2023-11-08T19:26:06.536570+0000","last_became_active":"2023-11-08T19:24:31.144838+0000","last_became_peered":"2023-11-08T19:24:31.144838+0000","last_unstale":"2023-11-08T19:26:06.536570+0000","last_undegraded":"2023-11-08T19:26:06.536570+0000","last_fullsized":"2023-11-08T19:26:06.536570+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:39:48.473183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081588799999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.124486+0000","last_change":"2023-11-08T19:25:48.284699+0000","last_active":"2023-11-08T19:26:10.124486+0000","last_peered":"2023-11-08T19:26:10.124486+0000","last_clean":"2023-11-08T19:26:10.124486+0000","last_became_active":"2023-11-08T19:25:46.285588+0000","last_became_peered":"2023-11-08T19:25:46.285588+0000","last_unstale":"2023-11-08T19:26:10.124486+0000","last_undegraded":"2023-11-08T19:26:10.124486+0000","last_fullsized":"2023-11-08T19:26:10.124486+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:43:02.001903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023282350000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.536701+0000","last_change":"2023-11-08T19:25:47.283526+0000","last_active":"2023-11-08T19:26:06.536701+0000","last_peered":"2023-11-08T19:26:06.536701+0000","last_clean":"2023-11-08T19:26:06.536701+0000","last_became_active":"2023-11-08T19:25:47.283266+0000","last_became_peered":"2023-11-08T19:25:47.283266+0000","last_unstale":"2023-11-08T19:26:06.536701+0000","last_undegraded":"2023-11-08T19:26:06.536701+0000","last_fullsized":"2023-11-08T19:26:06.536701+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:35:31.433056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.127556+0000","last_change":"2023-11-08T19:26:10.127556+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.127556+0000","last_undegraded":"2023-11-08T19:26:10.127556+0000","last_fullsized":"2023-11-08T19:26:10.127556+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.657341+0000","last_change":"2023-11-08T19:24:32.333430+0000","last_active":"2023-11-08T19:26:06.657341+0000","last_peered":"2023-11-08T19:26:06.657341+0000","last_clean":"2023-11-08T19:26:06.657341+0000","last_became_active":"2023-11-08T19:24:31.141710+0000","last_became_peered":"2023-11-08T19:24:31.141710+0000","last_unstale":"2023-11-08T19:26:06.657341+0000","last_undegraded":"2023-11-08T19:26:06.657341+0000","last_fullsized":"2023-11-08T19:26:06.657341+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:32:51.214551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000430438,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.373255+0000","last_change":"2023-11-08T19:25:48.283855+0000","last_active":"2023-11-08T19:26:06.373255+0000","last_peered":"2023-11-08T19:26:06.373255+0000","last_clean":"2023-11-08T19:26:06.373255+0000","last_became_active":"2023-11-08T19:25:46.273336+0000","last_became_peered":"2023-11-08T19:25:46.273336+0000","last_unstale":"2023-11-08T19:26:06.373255+0000","last_undegraded":"2023-11-08T19:26:06.373255+0000","last_fullsized":"2023-11-08T19:26:06.373255+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:33:35.492889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092577200000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":20,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.373300+0000","last_change":"2023-11-08T19:25:47.282840+0000","last_active":"2023-11-08T19:26:06.373300+0000","last_peered":"2023-11-08T19:26:06.373300+0000","last_clean":"2023-11-08T19:26:06.373300+0000","last_became_active":"2023-11-08T19:25:47.282600+0000","last_became_peered":"2023-11-08T19:25:47.282600+0000","last_unstale":"2023-11-08T19:26:06.373300+0000","last_undegraded":"2023-11-08T19:26:06.373300+0000","last_fullsized":"2023-11-08T19:26:06.373300+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:53:37.482245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.131449+0000","last_change":"2023-11-08T19:26:11.131449+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.131449+0000","last_undegraded":"2023-11-08T19:26:11.131449+0000","last_fullsized":"2023-11-08T19:26:11.131449+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.127954+0000","last_change":"2023-11-08T19:26:10.127954+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.127954+0000","last_undegraded":"2023-11-08T19:26:10.127954+0000","last_fullsized":"2023-11-08T19:26:10.127954+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.124849+0000","last_change":"2023-11-08T19:25:47.285890+0000","last_active":"2023-11-08T19:26:10.124849+0000","last_peered":"2023-11-08T19:26:10.124849+0000","last_clean":"2023-11-08T19:26:10.124849+0000","last_became_active":"2023-11-08T19:25:47.285641+0000","last_became_peered":"2023-11-08T19:25:47.285641+0000","last_unstale":"2023-11-08T19:26:10.124849+0000","last_undegraded":"2023-11-08T19:26:10.124849+0000","last_fullsized":"2023-11-08T19:26:10.124849+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:27:18.335142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.536846+0000","last_change":"2023-11-08T19:24:32.530895+0000","last_active":"2023-11-08T19:26:06.536846+0000","last_peered":"2023-11-08T19:26:06.536846+0000","last_clean":"2023-11-08T19:26:06.536846+0000","last_became_active":"2023-11-08T19:24:31.146715+0000","last_became_peered":"2023-11-08T19:24:31.146715+0000","last_unstale":"2023-11-08T19:26:06.536846+0000","last_undegraded":"2023-11-08T19:26:06.536846+0000","last_fullsized":"2023-11-08T19:26:06.536846+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:39.214888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081671599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.373444+0000","last_change":"2023-11-08T19:25:48.284137+0000","last_active":"2023-11-08T19:26:06.373444+0000","last_peered":"2023-11-08T19:26:06.373444+0000","last_clean":"2023-11-08T19:26:06.373444+0000","last_became_active":"2023-11-08T19:25:46.285960+0000","last_became_peered":"2023-11-08T19:25:46.285960+0000","last_unstale":"2023-11-08T19:26:06.373444+0000","last_undegraded":"2023-11-08T19:26:06.373444+0000","last_fullsized":"2023-11-08T19:26:06.373444+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:26:01.141206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091649099999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.130517+0000","last_change":"2023-11-08T19:26:11.130517+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.130517+0000","last_undegraded":"2023-11-08T19:26:11.130517+0000","last_fullsized":"2023-11-08T19:26:11.130517+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.128682+0000","last_change":"2023-11-08T19:26:10.128682+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.128682+0000","last_undegraded":"2023-11-08T19:26:10.128682+0000","last_fullsized":"2023-11-08T19:26:10.128682+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.125287+0000","last_change":"2023-11-08T19:25:47.283642+0000","last_active":"2023-11-08T19:26:10.125287+0000","last_peered":"2023-11-08T19:26:10.125287+0000","last_clean":"2023-11-08T19:26:10.125287+0000","last_became_active":"2023-11-08T19:25:47.283360+0000","last_became_peered":"2023-11-08T19:25:47.283360+0000","last_unstale":"2023-11-08T19:26:10.125287+0000","last_undegraded":"2023-11-08T19:26:10.125287+0000","last_fullsized":"2023-11-08T19:26:10.125287+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:02:27.950152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":53,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.373531+0000","last_change":"2023-11-08T19:24:32.140167+0000","last_active":"2023-11-08T19:26:06.373531+0000","last_peered":"2023-11-08T19:26:06.373531+0000","last_clean":"2023-11-08T19:26:06.373531+0000","last_became_active":"2023-11-08T19:24:31.147181+0000","last_became_peered":"2023-11-08T19:24:31.147181+0000","last_unstale":"2023-11-08T19:26:06.373531+0000","last_undegraded":"2023-11-08T19:26:06.373531+0000","last_fullsized":"2023-11-08T19:26:06.373531+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:26.080042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057135200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.126009+0000","last_change":"2023-11-08T19:25:48.277705+0000","last_active":"2023-11-08T19:26:10.126009+0000","last_peered":"2023-11-08T19:26:10.126009+0000","last_clean":"2023-11-08T19:26:10.126009+0000","last_became_active":"2023-11-08T19:25:46.288848+0000","last_became_peered":"2023-11-08T19:25:46.288848+0000","last_unstale":"2023-11-08T19:26:10.126009+0000","last_undegraded":"2023-11-08T19:26:10.126009+0000","last_fullsized":"2023-11-08T19:26:10.126009+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:12:24.483185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097653099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.124238+0000","last_change":"2023-11-08T19:26:10.124238+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.124238+0000","last_undegraded":"2023-11-08T19:26:10.124238+0000","last_fullsized":"2023-11-08T19:26:10.124238+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.152208+0000","last_change":"2023-11-08T19:25:47.289456+0000","last_active":"2023-11-08T19:26:12.152208+0000","last_peered":"2023-11-08T19:26:12.152208+0000","last_clean":"2023-11-08T19:26:12.152208+0000","last_became_active":"2023-11-08T19:25:47.289177+0000","last_became_peered":"2023-11-08T19:25:47.289177+0000","last_unstale":"2023-11-08T19:26:12.152208+0000","last_undegraded":"2023-11-08T19:26:12.152208+0000","last_fullsized":"2023-11-08T19:26:12.152208+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:07:11.838364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":53,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.373110+0000","last_change":"2023-11-08T19:24:32.141188+0000","last_active":"2023-11-08T19:26:06.373110+0000","last_peered":"2023-11-08T19:26:06.373110+0000","last_clean":"2023-11-08T19:26:06.373110+0000","last_became_active":"2023-11-08T19:24:31.148857+0000","last_became_peered":"2023-11-08T19:24:31.148857+0000","last_unstale":"2023-11-08T19:26:06.373110+0000","last_undegraded":"2023-11-08T19:26:06.373110+0000","last_fullsized":"2023-11-08T19:26:06.373110+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:45:34.425432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065078599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.126285+0000","last_change":"2023-11-08T19:25:48.277423+0000","last_active":"2023-11-08T19:26:10.126285+0000","last_peered":"2023-11-08T19:26:10.126285+0000","last_clean":"2023-11-08T19:26:10.126285+0000","last_became_active":"2023-11-08T19:25:46.286211+0000","last_became_peered":"2023-11-08T19:25:46.286211+0000","last_unstale":"2023-11-08T19:26:10.126285+0000","last_undegraded":"2023-11-08T19:26:10.126285+0000","last_fullsized":"2023-11-08T19:26:10.126285+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:44:05.347800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073775700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":8,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-08T19:26:11.139671+0000","last_change":"2023-11-08T19:26:11.139671+0000","last_active":"2023-11-08T19:26:11.139671+0000","last_peered":"2023-11-08T19:26:11.139671+0000","last_clean":"2023-11-08T19:26:11.139671+0000","last_became_active":"2023-11-08T19:26:11.139289+0000","last_became_peered":"2023-11-08T19:26:11.139289+0000","last_unstale":"2023-11-08T19:26:11.139671+0000","last_undegraded":"2023-11-08T19:26:11.139671+0000","last_fullsized":"2023-11-08T19:26:11.139671+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:02:51.810261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.150500+0000","last_change":"2023-11-08T19:25:47.286020+0000","last_active":"2023-11-08T19:26:12.150500+0000","last_peered":"2023-11-08T19:26:12.150500+0000","last_clean":"2023-11-08T19:26:12.150500+0000","last_became_active":"2023-11-08T19:25:47.285728+0000","last_became_peered":"2023-11-08T19:25:47.285728+0000","last_unstale":"2023-11-08T19:26:12.150500+0000","last_undegraded":"2023-11-08T19:26:12.150500+0000","last_fullsized":"2023-11-08T19:26:12.150500+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:26:02.147090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":53,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.372699+0000","last_change":"2023-11-08T19:24:32.140832+0000","last_active":"2023-11-08T19:26:06.372699+0000","last_peered":"2023-11-08T19:26:06.372699+0000","last_clean":"2023-11-08T19:26:06.372699+0000","last_became_active":"2023-11-08T19:24:31.146557+0000","last_became_peered":"2023-11-08T19:24:31.146557+0000","last_unstale":"2023-11-08T19:26:06.372699+0000","last_undegraded":"2023-11-08T19:26:06.372699+0000","last_fullsized":"2023-11-08T19:26:06.372699+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:40:04.258107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099450100000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.536509+0000","last_change":"2023-11-08T19:25:48.372913+0000","last_active":"2023-11-08T19:26:06.536509+0000","last_peered":"2023-11-08T19:26:06.536509+0000","last_clean":"2023-11-08T19:26:06.536509+0000","last_became_active":"2023-11-08T19:25:46.281273+0000","last_became_peered":"2023-11-08T19:25:46.281273+0000","last_unstale":"2023-11-08T19:26:06.536509+0000","last_undegraded":"2023-11-08T19:26:06.536509+0000","last_fullsized":"2023-11-08T19:26:06.536509+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:07:10.832480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020904819999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.158343+0000","last_change":"2023-11-08T19:26:12.160942+0000","last_active":"2023-11-08T19:26:13.158343+0000","last_peered":"2023-11-08T19:26:13.158343+0000","last_clean":"2023-11-08T19:26:13.158343+0000","last_became_active":"2023-11-08T19:26:12.160665+0000","last_became_peered":"2023-11-08T19:26:12.160665+0000","last_unstale":"2023-11-08T19:26:13.158343+0000","last_undegraded":"2023-11-08T19:26:13.158343+0000","last_fullsized":"2023-11-08T19:26:13.158343+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:32:26.592331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.130327+0000","last_change":"2023-11-08T19:26:10.130327+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.130327+0000","last_undegraded":"2023-11-08T19:26:10.130327+0000","last_fullsized":"2023-11-08T19:26:10.130327+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.125554+0000","last_change":"2023-11-08T19:25:47.288256+0000","last_active":"2023-11-08T19:26:10.125554+0000","last_peered":"2023-11-08T19:26:10.125554+0000","last_clean":"2023-11-08T19:26:10.125554+0000","last_became_active":"2023-11-08T19:25:47.287905+0000","last_became_peered":"2023-11-08T19:25:47.287905+0000","last_unstale":"2023-11-08T19:26:10.125554+0000","last_undegraded":"2023-11-08T19:26:10.125554+0000","last_fullsized":"2023-11-08T19:26:10.125554+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:50:12.309248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.536919+0000","last_change":"2023-11-08T19:24:32.530378+0000","last_active":"2023-11-08T19:26:06.536919+0000","last_peered":"2023-11-08T19:26:06.536919+0000","last_clean":"2023-11-08T19:26:06.536919+0000","last_became_active":"2023-11-08T19:24:31.144341+0000","last_became_peered":"2023-11-08T19:24:31.144341+0000","last_unstale":"2023-11-08T19:26:06.536919+0000","last_undegraded":"2023-11-08T19:26:06.536919+0000","last_fullsized":"2023-11-08T19:26:06.536919+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:30:21.946303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058308299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.125107+0000","last_change":"2023-11-08T19:25:48.277150+0000","last_active":"2023-11-08T19:26:10.125107+0000","last_peered":"2023-11-08T19:26:10.125107+0000","last_clean":"2023-11-08T19:26:10.125107+0000","last_became_active":"2023-11-08T19:25:46.286933+0000","last_became_peered":"2023-11-08T19:25:46.286933+0000","last_unstale":"2023-11-08T19:26:10.125107+0000","last_undegraded":"2023-11-08T19:26:10.125107+0000","last_fullsized":"2023-11-08T19:26:10.125107+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:38:38.890354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080507500000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.131349+0000","last_change":"2023-11-08T19:26:11.131349+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.131349+0000","last_undegraded":"2023-11-08T19:26:11.131349+0000","last_fullsized":"2023-11-08T19:26:11.131349+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.123041+0000","last_change":"2023-11-08T19:26:10.123041+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.123041+0000","last_undegraded":"2023-11-08T19:26:10.123041+0000","last_fullsized":"2023-11-08T19:26:10.123041+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.125333+0000","last_change":"2023-11-08T19:25:47.282986+0000","last_active":"2023-11-08T19:26:10.125333+0000","last_peered":"2023-11-08T19:26:10.125333+0000","last_clean":"2023-11-08T19:26:10.125333+0000","last_became_active":"2023-11-08T19:25:47.282705+0000","last_became_peered":"2023-11-08T19:25:47.282705+0000","last_unstale":"2023-11-08T19:26:10.125333+0000","last_undegraded":"2023-11-08T19:26:10.125333+0000","last_fullsized":"2023-11-08T19:26:10.125333+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:34:17.838942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":48,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.125645+0000","last_change":"2023-11-08T19:24:32.544108+0000","last_active":"2023-11-08T19:26:10.125645+0000","last_peered":"2023-11-08T19:26:10.125645+0000","last_clean":"2023-11-08T19:26:10.125645+0000","last_became_active":"2023-11-08T19:24:31.143812+0000","last_became_peered":"2023-11-08T19:24:31.143812+0000","last_unstale":"2023-11-08T19:26:10.125645+0000","last_undegraded":"2023-11-08T19:26:10.125645+0000","last_fullsized":"2023-11-08T19:26:10.125645+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:27:59.135977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014956126,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.124568+0000","last_change":"2023-11-08T19:25:48.284435+0000","last_active":"2023-11-08T19:26:10.124568+0000","last_peered":"2023-11-08T19:26:10.124568+0000","last_clean":"2023-11-08T19:26:10.124568+0000","last_became_active":"2023-11-08T19:25:46.284288+0000","last_became_peered":"2023-11-08T19:25:46.284288+0000","last_unstale":"2023-11-08T19:26:10.124568+0000","last_undegraded":"2023-11-08T19:26:10.124568+0000","last_fullsized":"2023-11-08T19:26:10.124568+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:57:53.083448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001250894,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.129291+0000","last_change":"2023-11-08T19:26:11.129291+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.129291+0000","last_undegraded":"2023-11-08T19:26:11.129291+0000","last_fullsized":"2023-11-08T19:26:11.129291+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":3,"reported_epoch":81,"state":"creating+activating","last_fresh":"2023-11-08T19:26:11.130995+0000","last_change":"2023-11-08T19:26:11.130995+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.130995+0000","last_undegraded":"2023-11-08T19:26:11.130995+0000","last_fullsized":"2023-11-08T19:26:11.130995+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:58:17.949441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.124612+0000","last_change":"2023-11-08T19:25:47.282612+0000","last_active":"2023-11-08T19:26:10.124612+0000","last_peered":"2023-11-08T19:26:10.124612+0000","last_clean":"2023-11-08T19:26:10.124612+0000","last_became_active":"2023-11-08T19:25:47.282299+0000","last_became_peered":"2023-11-08T19:25:47.282299+0000","last_unstale":"2023-11-08T19:26:10.124612+0000","last_undegraded":"2023-11-08T19:26:10.124612+0000","last_fullsized":"2023-11-08T19:26:10.124612+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:43:18.319773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.151613+0000","last_change":"2023-11-08T19:24:32.146639+0000","last_active":"2023-11-08T19:26:12.151613+0000","last_peered":"2023-11-08T19:26:12.151613+0000","last_clean":"2023-11-08T19:26:12.151613+0000","last_became_active":"2023-11-08T19:24:31.147384+0000","last_became_peered":"2023-11-08T19:24:31.147384+0000","last_unstale":"2023-11-08T19:26:12.151613+0000","last_undegraded":"2023-11-08T19:26:12.151613+0000","last_fullsized":"2023-11-08T19:26:12.151613+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:30:21.946303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043834899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.124395+0000","last_change":"2023-11-08T19:25:48.283541+0000","last_active":"2023-11-08T19:26:10.124395+0000","last_peered":"2023-11-08T19:26:10.124395+0000","last_clean":"2023-11-08T19:26:10.124395+0000","last_became_active":"2023-11-08T19:25:46.285626+0000","last_became_peered":"2023-11-08T19:25:46.285626+0000","last_unstale":"2023-11-08T19:26:10.124395+0000","last_undegraded":"2023-11-08T19:26:10.124395+0000","last_fullsized":"2023-11-08T19:26:10.124395+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:48:17.033319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019032459999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.131450+0000","last_change":"2023-11-08T19:26:10.131450+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.131450+0000","last_undegraded":"2023-11-08T19:26:10.131450+0000","last_fullsized":"2023-11-08T19:26:10.131450+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":20,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.373197+0000","last_change":"2023-11-08T19:25:47.287878+0000","last_active":"2023-11-08T19:26:06.373197+0000","last_peered":"2023-11-08T19:26:06.373197+0000","last_clean":"2023-11-08T19:26:06.373197+0000","last_became_active":"2023-11-08T19:25:47.287617+0000","last_became_peered":"2023-11-08T19:25:47.287617+0000","last_unstale":"2023-11-08T19:26:06.373197+0000","last_undegraded":"2023-11-08T19:26:06.373197+0000","last_fullsized":"2023-11-08T19:26:06.373197+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:20:50.791463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":55,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.125379+0000","last_change":"2023-11-08T19:24:32.142376+0000","last_active":"2023-11-08T19:26:10.125379+0000","last_peered":"2023-11-08T19:26:10.125379+0000","last_clean":"2023-11-08T19:26:10.125379+0000","last_became_active":"2023-11-08T19:24:31.144614+0000","last_became_peered":"2023-11-08T19:24:31.144614+0000","last_unstale":"2023-11-08T19:26:10.125379+0000","last_undegraded":"2023-11-08T19:26:10.125379+0000","last_fullsized":"2023-11-08T19:26:10.125379+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:09:04.880374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050362200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.537032+0000","last_change":"2023-11-08T19:25:48.373636+0000","last_active":"2023-11-08T19:26:06.537032+0000","last_peered":"2023-11-08T19:26:06.537032+0000","last_clean":"2023-11-08T19:26:06.537032+0000","last_became_active":"2023-11-08T19:25:46.283803+0000","last_became_peered":"2023-11-08T19:25:46.283803+0000","last_unstale":"2023-11-08T19:26:06.537032+0000","last_undegraded":"2023-11-08T19:26:06.537032+0000","last_fullsized":"2023-11-08T19:26:06.537032+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:00:34.691748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002404855,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.131315+0000","last_change":"2023-11-08T19:26:11.131315+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.131315+0000","last_undegraded":"2023-11-08T19:26:11.131315+0000","last_fullsized":"2023-11-08T19:26:11.131315+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"82'1","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.171188+0000","last_change":"2023-11-08T19:26:11.143541+0000","last_active":"2023-11-08T19:26:12.171188+0000","last_peered":"2023-11-08T19:26:12.171188+0000","last_clean":"2023-11-08T19:26:12.171188+0000","last_became_active":"2023-11-08T19:26:11.143255+0000","last_became_peered":"2023-11-08T19:26:11.143255+0000","last_unstale":"2023-11-08T19:26:12.171188+0000","last_undegraded":"2023-11-08T19:26:12.171188+0000","last_fullsized":"2023-11-08T19:26:12.171188+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:19:00.174837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.152295+0000","last_change":"2023-11-08T19:25:47.287741+0000","last_active":"2023-11-08T19:26:12.152295+0000","last_peered":"2023-11-08T19:26:12.152295+0000","last_clean":"2023-11-08T19:26:12.152295+0000","last_became_active":"2023-11-08T19:25:47.287428+0000","last_became_peered":"2023-11-08T19:25:47.287428+0000","last_unstale":"2023-11-08T19:26:12.152295+0000","last_undegraded":"2023-11-08T19:26:12.152295+0000","last_fullsized":"2023-11-08T19:26:12.152295+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:38:55.785104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.153220+0000","last_change":"2023-11-08T19:24:32.147235+0000","last_active":"2023-11-08T19:26:12.153220+0000","last_peered":"2023-11-08T19:26:12.153220+0000","last_clean":"2023-11-08T19:26:12.153220+0000","last_became_active":"2023-11-08T19:24:31.146176+0000","last_became_peered":"2023-11-08T19:24:31.146176+0000","last_unstale":"2023-11-08T19:26:12.153220+0000","last_undegraded":"2023-11-08T19:26:12.153220+0000","last_fullsized":"2023-11-08T19:26:12.153220+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:39.214888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048481000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.536729+0000","last_change":"2023-11-08T19:25:48.373345+0000","last_active":"2023-11-08T19:26:06.536729+0000","last_peered":"2023-11-08T19:26:06.536729+0000","last_clean":"2023-11-08T19:26:06.536729+0000","last_became_active":"2023-11-08T19:25:46.282460+0000","last_became_peered":"2023-11-08T19:25:46.282460+0000","last_unstale":"2023-11-08T19:26:06.536729+0000","last_undegraded":"2023-11-08T19:26:06.536729+0000","last_fullsized":"2023-11-08T19:26:06.536729+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:25:30.927920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001972863,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.130984+0000","last_change":"2023-11-08T19:26:11.130984+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.130984+0000","last_undegraded":"2023-11-08T19:26:11.130984+0000","last_fullsized":"2023-11-08T19:26:11.130984+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.131011+0000","last_change":"2023-11-08T19:26:10.131011+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.131011+0000","last_undegraded":"2023-11-08T19:26:10.131011+0000","last_fullsized":"2023-11-08T19:26:10.131011+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.125470+0000","last_change":"2023-11-08T19:25:47.283708+0000","last_active":"2023-11-08T19:26:10.125470+0000","last_peered":"2023-11-08T19:26:10.125470+0000","last_clean":"2023-11-08T19:26:10.125470+0000","last_became_active":"2023-11-08T19:25:47.283433+0000","last_became_peered":"2023-11-08T19:25:47.283433+0000","last_unstale":"2023-11-08T19:26:10.125470+0000","last_undegraded":"2023-11-08T19:26:10.125470+0000","last_fullsized":"2023-11-08T19:26:10.125470+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:30:17.627967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":48,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.126607+0000","last_change":"2023-11-08T19:24:32.543880+0000","last_active":"2023-11-08T19:26:10.126607+0000","last_peered":"2023-11-08T19:26:10.126607+0000","last_clean":"2023-11-08T19:26:10.126607+0000","last_became_active":"2023-11-08T19:24:31.142052+0000","last_became_peered":"2023-11-08T19:24:31.142052+0000","last_unstale":"2023-11-08T19:26:10.126607+0000","last_undegraded":"2023-11-08T19:26:10.126607+0000","last_fullsized":"2023-11-08T19:26:10.126607+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:18:42.371676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014881058000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.373504+0000","last_change":"2023-11-08T19:25:48.284890+0000","last_active":"2023-11-08T19:26:06.373504+0000","last_peered":"2023-11-08T19:26:06.373504+0000","last_clean":"2023-11-08T19:26:06.373504+0000","last_became_active":"2023-11-08T19:25:46.279287+0000","last_became_peered":"2023-11-08T19:25:46.279287+0000","last_unstale":"2023-11-08T19:26:06.373504+0000","last_undegraded":"2023-11-08T19:26:06.373504+0000","last_fullsized":"2023-11-08T19:26:06.373504+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:35:30.427172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076856899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.131038+0000","last_change":"2023-11-08T19:26:11.131038+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.131038+0000","last_undegraded":"2023-11-08T19:26:11.131038+0000","last_fullsized":"2023-11-08T19:26:11.131038+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.130999+0000","last_change":"2023-11-08T19:26:10.130999+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.130999+0000","last_undegraded":"2023-11-08T19:26:10.130999+0000","last_fullsized":"2023-11-08T19:26:10.130999+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":20,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.373345+0000","last_change":"2023-11-08T19:25:47.285867+0000","last_active":"2023-11-08T19:26:06.373345+0000","last_peered":"2023-11-08T19:26:06.373345+0000","last_clean":"2023-11-08T19:26:06.373345+0000","last_became_active":"2023-11-08T19:25:47.285533+0000","last_became_peered":"2023-11-08T19:25:47.285533+0000","last_unstale":"2023-11-08T19:26:06.373345+0000","last_undegraded":"2023-11-08T19:26:06.373345+0000","last_fullsized":"2023-11-08T19:26:06.373345+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:26:59.852338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.152466+0000","last_change":"2023-11-08T19:24:32.147011+0000","last_active":"2023-11-08T19:26:12.152466+0000","last_peered":"2023-11-08T19:26:12.152466+0000","last_clean":"2023-11-08T19:26:12.152466+0000","last_became_active":"2023-11-08T19:24:31.148250+0000","last_became_peered":"2023-11-08T19:24:31.148250+0000","last_unstale":"2023-11-08T19:26:12.152466+0000","last_undegraded":"2023-11-08T19:26:12.152466+0000","last_fullsized":"2023-11-08T19:26:12.152466+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:01:25.647952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043061299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.125521+0000","last_change":"2023-11-08T19:25:48.284869+0000","last_active":"2023-11-08T19:26:10.125521+0000","last_peered":"2023-11-08T19:26:10.125521+0000","last_clean":"2023-11-08T19:26:10.125521+0000","last_became_active":"2023-11-08T19:25:46.285478+0000","last_became_peered":"2023-11-08T19:25:46.285478+0000","last_unstale":"2023-11-08T19:26:10.125521+0000","last_undegraded":"2023-11-08T19:26:10.125521+0000","last_fullsized":"2023-11-08T19:26:10.125521+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:49:51.368808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000376339,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.131103+0000","last_change":"2023-11-08T19:26:11.131103+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.131103+0000","last_undegraded":"2023-11-08T19:26:11.131103+0000","last_fullsized":"2023-11-08T19:26:11.131103+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.128845+0000","last_change":"2023-11-08T19:26:10.128845+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.128845+0000","last_undegraded":"2023-11-08T19:26:10.128845+0000","last_fullsized":"2023-11-08T19:26:10.128845+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.125020+0000","last_change":"2023-11-08T19:25:47.284429+0000","last_active":"2023-11-08T19:26:10.125020+0000","last_peered":"2023-11-08T19:26:10.125020+0000","last_clean":"2023-11-08T19:26:10.125020+0000","last_became_active":"2023-11-08T19:25:47.283990+0000","last_became_peered":"2023-11-08T19:25:47.283990+0000","last_unstale":"2023-11-08T19:26:10.125020+0000","last_undegraded":"2023-11-08T19:26:10.125020+0000","last_fullsized":"2023-11-08T19:26:10.125020+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:59:08.628317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":55,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.124560+0000","last_change":"2023-11-08T19:24:32.141190+0000","last_active":"2023-11-08T19:26:10.124560+0000","last_peered":"2023-11-08T19:26:10.124560+0000","last_clean":"2023-11-08T19:26:10.124560+0000","last_became_active":"2023-11-08T19:24:31.147651+0000","last_became_peered":"2023-11-08T19:24:31.147651+0000","last_unstale":"2023-11-08T19:26:10.124560+0000","last_undegraded":"2023-11-08T19:26:10.124560+0000","last_fullsized":"2023-11-08T19:26:10.124560+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:21:55.985548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043673300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.655820+0000","last_change":"2023-11-08T19:25:48.320707+0000","last_active":"2023-11-08T19:26:06.655820+0000","last_peered":"2023-11-08T19:26:06.655820+0000","last_clean":"2023-11-08T19:26:06.655820+0000","last_became_active":"2023-11-08T19:25:46.282307+0000","last_became_peered":"2023-11-08T19:25:46.282307+0000","last_unstale":"2023-11-08T19:26:06.655820+0000","last_undegraded":"2023-11-08T19:26:06.655820+0000","last_fullsized":"2023-11-08T19:26:06.655820+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:53:36.476361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047078400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.130955+0000","last_change":"2023-11-08T19:26:11.130955+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.130955+0000","last_undegraded":"2023-11-08T19:26:11.130955+0000","last_fullsized":"2023-11-08T19:26:11.130955+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2023-11-08T19:26:10.128054+0000","last_change":"2023-11-08T19:26:10.128054+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:10.128054+0000","last_undegraded":"2023-11-08T19:26:10.128054+0000","last_fullsized":"2023-11-08T19:26:10.128054+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.125006+0000","last_change":"2023-11-08T19:25:47.284227+0000","last_active":"2023-11-08T19:26:10.125006+0000","last_peered":"2023-11-08T19:26:10.125006+0000","last_clean":"2023-11-08T19:26:10.125006+0000","last_became_active":"2023-11-08T19:25:47.283927+0000","last_became_peered":"2023-11-08T19:25:47.283927+0000","last_unstale":"2023-11-08T19:26:10.125006+0000","last_undegraded":"2023-11-08T19:26:10.125006+0000","last_fullsized":"2023-11-08T19:26:10.125006+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:15:23.188047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.536878+0000","last_change":"2023-11-08T19:24:32.530168+0000","last_active":"2023-11-08T19:26:06.536878+0000","last_peered":"2023-11-08T19:26:06.536878+0000","last_clean":"2023-11-08T19:26:06.536878+0000","last_became_active":"2023-11-08T19:24:31.144329+0000","last_became_peered":"2023-11-08T19:24:31.144329+0000","last_unstale":"2023-11-08T19:26:06.536878+0000","last_undegraded":"2023-11-08T19:26:06.536878+0000","last_fullsized":"2023-11-08T19:26:06.536878+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:05:36.085920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043484799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.536437+0000","last_change":"2023-11-08T19:25:48.371291+0000","last_active":"2023-11-08T19:26:06.536437+0000","last_peered":"2023-11-08T19:26:06.536437+0000","last_clean":"2023-11-08T19:26:06.536437+0000","last_became_active":"2023-11-08T19:25:46.281425+0000","last_became_peered":"2023-11-08T19:25:46.281425+0000","last_unstale":"2023-11-08T19:26:06.536437+0000","last_undegraded":"2023-11-08T19:26:06.536437+0000","last_fullsized":"2023-11-08T19:26:06.536437+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:23:12.422712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00124314,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.128515+0000","last_change":"2023-11-08T19:26:11.128515+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.128515+0000","last_undegraded":"2023-11-08T19:26:11.128515+0000","last_fullsized":"2023-11-08T19:26:11.128515+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":3,"reported_epoch":81,"state":"creating+activating","last_fresh":"2023-11-08T19:26:11.128875+0000","last_change":"2023-11-08T19:26:11.128875+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.128875+0000","last_undegraded":"2023-11-08T19:26:11.128875+0000","last_fullsized":"2023-11-08T19:26:11.128875+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:34:00.358882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":["4","6"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.536522+0000","last_change":"2023-11-08T19:25:47.281724+0000","last_active":"2023-11-08T19:26:06.536522+0000","last_peered":"2023-11-08T19:26:06.536522+0000","last_clean":"2023-11-08T19:26:06.536522+0000","last_became_active":"2023-11-08T19:25:47.281425+0000","last_became_peered":"2023-11-08T19:25:47.281425+0000","last_unstale":"2023-11-08T19:26:06.536522+0000","last_undegraded":"2023-11-08T19:26:06.536522+0000","last_fullsized":"2023-11-08T19:26:06.536522+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:38:55.785104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.536534+0000","last_change":"2023-11-08T19:24:32.529486+0000","last_active":"2023-11-08T19:26:06.536534+0000","last_peered":"2023-11-08T19:26:06.536534+0000","last_clean":"2023-11-08T19:26:06.536534+0000","last_became_active":"2023-11-08T19:24:31.146260+0000","last_became_peered":"2023-11-08T19:24:31.146260+0000","last_unstale":"2023-11-08T19:26:06.536534+0000","last_undegraded":"2023-11-08T19:26:06.536534+0000","last_fullsized":"2023-11-08T19:26:06.536534+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:45:34.425432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059842900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.125457+0000","last_change":"2023-11-08T19:25:48.277457+0000","last_active":"2023-11-08T19:26:10.125457+0000","last_peered":"2023-11-08T19:26:10.125457+0000","last_clean":"2023-11-08T19:26:10.125457+0000","last_became_active":"2023-11-08T19:25:46.286239+0000","last_became_peered":"2023-11-08T19:25:46.286239+0000","last_unstale":"2023-11-08T19:26:10.125457+0000","last_undegraded":"2023-11-08T19:26:10.125457+0000","last_fullsized":"2023-11-08T19:26:10.125457+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:09:43.662108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000722421,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":3,"reported_epoch":81,"state":"creating+activating","last_fresh":"2023-11-08T19:26:11.131468+0000","last_change":"2023-11-08T19:26:11.131468+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.131468+0000","last_undegraded":"2023-11-08T19:26:11.131468+0000","last_fullsized":"2023-11-08T19:26:11.131468+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:50:16.234801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":["1","7"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.150529+0000","last_change":"2023-11-08T19:25:47.287874+0000","last_active":"2023-11-08T19:26:12.150529+0000","last_peered":"2023-11-08T19:26:12.150529+0000","last_clean":"2023-11-08T19:26:12.150529+0000","last_became_active":"2023-11-08T19:25:47.287456+0000","last_became_peered":"2023-11-08T19:25:47.287456+0000","last_unstale":"2023-11-08T19:26:12.150529+0000","last_undegraded":"2023-11-08T19:26:12.150529+0000","last_fullsized":"2023-11-08T19:26:12.150529+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:26:59.852338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":53,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.372762+0000","last_change":"2023-11-08T19:24:32.141131+0000","last_active":"2023-11-08T19:26:06.372762+0000","last_peered":"2023-11-08T19:26:06.372762+0000","last_clean":"2023-11-08T19:26:06.372762+0000","last_became_active":"2023-11-08T19:24:31.146154+0000","last_became_peered":"2023-11-08T19:24:31.146154+0000","last_unstale":"2023-11-08T19:26:06.372762+0000","last_undegraded":"2023-11-08T19:26:06.372762+0000","last_fullsized":"2023-11-08T19:26:06.372762+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:18:40.271560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082432800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.126197+0000","last_change":"2023-11-08T19:25:48.372729+0000","last_active":"2023-11-08T19:26:10.126197+0000","last_peered":"2023-11-08T19:26:10.126197+0000","last_clean":"2023-11-08T19:26:10.126197+0000","last_became_active":"2023-11-08T19:25:46.290114+0000","last_became_peered":"2023-11-08T19:25:46.290114+0000","last_unstale":"2023-11-08T19:26:10.126197+0000","last_undegraded":"2023-11-08T19:26:10.126197+0000","last_fullsized":"2023-11-08T19:26:10.126197+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:49:36.208776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061009499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":3,"reported_epoch":81,"state":"creating+activating","last_fresh":"2023-11-08T19:26:11.131145+0000","last_change":"2023-11-08T19:26:11.131145+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.131145+0000","last_undegraded":"2023-11-08T19:26:11.131145+0000","last_fullsized":"2023-11-08T19:26:11.131145+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:30:41.488076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":["1","5"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.536851+0000","last_change":"2023-11-08T19:25:47.283046+0000","last_active":"2023-11-08T19:26:06.536851+0000","last_peered":"2023-11-08T19:26:06.536851+0000","last_clean":"2023-11-08T19:26:06.536851+0000","last_became_active":"2023-11-08T19:25:47.282763+0000","last_became_peered":"2023-11-08T19:25:47.282763+0000","last_unstale":"2023-11-08T19:26:06.536851+0000","last_undegraded":"2023-11-08T19:26:06.536851+0000","last_fullsized":"2023-11-08T19:26:06.536851+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:12:51.389167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":49,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.126305+0000","last_change":"2023-11-08T19:24:32.263963+0000","last_active":"2023-11-08T19:26:10.126305+0000","last_peered":"2023-11-08T19:26:10.126305+0000","last_clean":"2023-11-08T19:26:10.126305+0000","last_became_active":"2023-11-08T19:24:31.139062+0000","last_became_peered":"2023-11-08T19:24:31.139062+0000","last_unstale":"2023-11-08T19:26:10.126305+0000","last_undegraded":"2023-11-08T19:26:10.126305+0000","last_fullsized":"2023-11-08T19:26:10.126305+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:26.080042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033682599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.373032+0000","last_change":"2023-11-08T19:25:48.283302+0000","last_active":"2023-11-08T19:26:06.373032+0000","last_peered":"2023-11-08T19:26:06.373032+0000","last_clean":"2023-11-08T19:26:06.373032+0000","last_became_active":"2023-11-08T19:25:46.284287+0000","last_became_peered":"2023-11-08T19:25:46.284287+0000","last_unstale":"2023-11-08T19:26:06.373032+0000","last_undegraded":"2023-11-08T19:26:06.373032+0000","last_fullsized":"2023-11-08T19:26:06.373032+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:39:27.217802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097880800000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-11-08T19:26:11.128580+0000","last_change":"2023-11-08T19:26:11.128580+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.128580+0000","last_undegraded":"2023-11-08T19:26:11.128580+0000","last_fullsized":"2023-11-08T19:26:11.128580+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":3,"reported_epoch":81,"state":"creating+activating","last_fresh":"2023-11-08T19:26:11.131935+0000","last_change":"2023-11-08T19:26:11.131935+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.131935+0000","last_undegraded":"2023-11-08T19:26:11.131935+0000","last_fullsized":"2023-11-08T19:26:11.131935+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:01:57.994055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":["3","0"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.124702+0000","last_change":"2023-11-08T19:25:47.286434+0000","last_active":"2023-11-08T19:26:10.124702+0000","last_peered":"2023-11-08T19:26:10.124702+0000","last_clean":"2023-11-08T19:26:10.124702+0000","last_became_active":"2023-11-08T19:25:47.286181+0000","last_became_peered":"2023-11-08T19:25:47.286181+0000","last_unstale":"2023-11-08T19:26:10.124702+0000","last_undegraded":"2023-11-08T19:26:10.124702+0000","last_fullsized":"2023-11-08T19:26:10.124702+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:13:27.285648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":53,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.373802+0000","last_change":"2023-11-08T19:24:32.140514+0000","last_active":"2023-11-08T19:26:06.373802+0000","last_peered":"2023-11-08T19:26:06.373802+0000","last_clean":"2023-11-08T19:26:06.373802+0000","last_became_active":"2023-11-08T19:24:31.146668+0000","last_became_peered":"2023-11-08T19:24:31.146668+0000","last_unstale":"2023-11-08T19:26:06.373802+0000","last_undegraded":"2023-11-08T19:26:06.373802+0000","last_fullsized":"2023-11-08T19:26:06.373802+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:31:24.539374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071576699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.656105+0000","last_change":"2023-11-08T19:25:48.320667+0000","last_active":"2023-11-08T19:26:06.656105+0000","last_peered":"2023-11-08T19:26:06.656105+0000","last_clean":"2023-11-08T19:26:06.656105+0000","last_became_active":"2023-11-08T19:25:46.290246+0000","last_became_peered":"2023-11-08T19:25:46.290246+0000","last_unstale":"2023-11-08T19:26:06.656105+0000","last_undegraded":"2023-11-08T19:26:06.656105+0000","last_fullsized":"2023-11-08T19:26:06.656105+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:33:35.492889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000423211,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T19:26:11.120100+0000","last_change":"2023-11-08T19:26:11.120100+0000","last_active":"2023-11-08T19:26:11.120100+0000","last_peered":"2023-11-08T19:26:11.120100+0000","last_clean":"2023-11-08T19:26:11.120100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.120100+0000","last_undegraded":"2023-11-08T19:26:11.120100+0000","last_fullsized":"2023-11-08T19:26:11.120100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.15","version":"82'3","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.172151+0000","last_change":"2023-11-08T19:26:11.147387+0000","last_active":"2023-11-08T19:26:12.172151+0000","last_peered":"2023-11-08T19:26:12.172151+0000","last_clean":"2023-11-08T19:26:12.172151+0000","last_became_active":"2023-11-08T19:26:11.147105+0000","last_became_peered":"2023-11-08T19:26:11.147105+0000","last_unstale":"2023-11-08T19:26:12.172151+0000","last_undegraded":"2023-11-08T19:26:12.172151+0000","last_fullsized":"2023-11-08T19:26:12.172151+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:29:49.218097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.126527+0000","last_change":"2023-11-08T19:25:47.287717+0000","last_active":"2023-11-08T19:26:10.126527+0000","last_peered":"2023-11-08T19:26:10.126527+0000","last_clean":"2023-11-08T19:26:10.126527+0000","last_became_active":"2023-11-08T19:25:47.287412+0000","last_became_peered":"2023-11-08T19:25:47.287412+0000","last_unstale":"2023-11-08T19:26:10.126527+0000","last_undegraded":"2023-11-08T19:26:10.126527+0000","last_fullsized":"2023-11-08T19:26:10.126527+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:18:04.478139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":49,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.656198+0000","last_change":"2023-11-08T19:24:32.142892+0000","last_active":"2023-11-08T19:26:06.656198+0000","last_peered":"2023-11-08T19:26:06.656198+0000","last_clean":"2023-11-08T19:26:06.656198+0000","last_became_active":"2023-11-08T19:24:31.144912+0000","last_became_peered":"2023-11-08T19:24:31.144912+0000","last_unstale":"2023-11-08T19:26:06.656198+0000","last_undegraded":"2023-11-08T19:26:06.656198+0000","last_fullsized":"2023-11-08T19:26:06.656198+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:04:21.151484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056686900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.373645+0000","last_change":"2023-11-08T19:25:48.285205+0000","last_active":"2023-11-08T19:26:06.373645+0000","last_peered":"2023-11-08T19:26:06.373645+0000","last_clean":"2023-11-08T19:26:06.373645+0000","last_became_active":"2023-11-08T19:25:46.285848+0000","last_became_peered":"2023-11-08T19:25:46.285848+0000","last_unstale":"2023-11-08T19:26:06.373645+0000","last_undegraded":"2023-11-08T19:26:06.373645+0000","last_fullsized":"2023-11-08T19:26:06.373645+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:07:10.832480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089732199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.158884+0000","last_change":"2023-11-08T19:26:12.170669+0000","last_active":"2023-11-08T19:26:13.158884+0000","last_peered":"2023-11-08T19:26:13.158884+0000","last_clean":"2023-11-08T19:26:13.158884+0000","last_became_active":"2023-11-08T19:26:12.170345+0000","last_became_peered":"2023-11-08T19:26:12.170345+0000","last_unstale":"2023-11-08T19:26:13.158884+0000","last_undegraded":"2023-11-08T19:26:13.158884+0000","last_fullsized":"2023-11-08T19:26:13.158884+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:32:15.350077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":3,"reported_epoch":81,"state":"creating+activating","last_fresh":"2023-11-08T19:26:11.130955+0000","last_change":"2023-11-08T19:26:11.130955+0000","last_active":"2023-11-08T19:26:10.118333+0000","last_peered":"2023-11-08T19:26:10.118333+0000","last_clean":"2023-11-08T19:26:10.118333+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T19:26:11.130955+0000","last_undegraded":"2023-11-08T19:26:11.130955+0000","last_fullsized":"2023-11-08T19:26:11.130955+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:27:23.712447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":["4","3"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":19,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.656005+0000","last_change":"2023-11-08T19:25:47.280177+0000","last_active":"2023-11-08T19:26:06.656005+0000","last_peered":"2023-11-08T19:26:06.656005+0000","last_clean":"2023-11-08T19:26:06.656005+0000","last_became_active":"2023-11-08T19:25:47.279913+0000","last_became_peered":"2023-11-08T19:25:47.279913+0000","last_unstale":"2023-11-08T19:26:06.656005+0000","last_undegraded":"2023-11-08T19:26:06.656005+0000","last_fullsized":"2023-11-08T19:26:06.656005+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:26:02.147090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":49,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-08T19:26:10.126250+0000","last_change":"2023-11-08T19:24:32.263958+0000","last_active":"2023-11-08T19:26:10.126250+0000","last_peered":"2023-11-08T19:26:10.126250+0000","last_clean":"2023-11-08T19:26:10.126250+0000","last_became_active":"2023-11-08T19:24:31.149011+0000","last_became_peered":"2023-11-08T19:24:31.149011+0000","last_unstale":"2023-11-08T19:26:10.126250+0000","last_undegraded":"2023-11-08T19:26:10.126250+0000","last_fullsized":"2023-11-08T19:26:10.126250+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:09:04.880374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033496900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-08T19:26:06.372612+0000","last_change":"2023-11-08T19:25:48.285075+0000","last_active":"2023-11-08T19:26:06.372612+0000","last_peered":"2023-11-08T19:26:06.372612+0000","last_clean":"2023-11-08T19:26:06.372612+0000","last_became_active":"2023-11-08T19:25:46.272479+0000","last_became_peered":"2023-11-08T19:25:46.272479+0000","last_unstale":"2023-11-08T19:26:06.372612+0000","last_undegraded":"2023-11-08T19:26:06.372612+0000","last_fullsized":"2023-11-08T19:26:06.372612+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:23:12.422712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001158117,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574892,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28600,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343240,"statfs":{"total":96636764160,"available":96607477760,"internally_reserved":0,"allocated":1617920,"data_stored":1082797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55200000000000005,"15min":0.53800000000000003},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.41399999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.71299999999999997,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.65300000000000002}]},{"osd":1,"last update":"Wed Nov 8 19:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.54800000000000004,"15min":0.54700000000000004},"min":{"1min":0.40799999999999997,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.69499999999999995,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.53800000000000003,"15min":0.53200000000000003},"min":{"1min":0.40600000000000003,"5min":0.37,"15min":0.37},"max":{"1min":0.75900000000000001,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.61699999999999999}]},{"osd":2,"last update":"Wed Nov 8 19:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.51400000000000001,"15min":0.50800000000000001},"min":{"1min":0.42899999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.75800000000000001,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.54000000000000004,"15min":0.53600000000000003},"min":{"1min":0.379,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.77800000000000002,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.63400000000000001}]},{"osd":3,"last update":"Wed Nov 8 19:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.53600000000000003,"15min":0.53400000000000003},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.56899999999999995,"15min":0.55900000000000005},"min":{"1min":0.42399999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76100000000000001,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.67600000000000005}]},{"osd":4,"last update":"Wed Nov 8 19:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.496,"15min":0.48599999999999999},"min":{"1min":0.35999999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.51900000000000002,"15min":0.51800000000000002},"min":{"1min":0.378,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.71399999999999997,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.45300000000000001}]},{"osd":5,"last update":"Wed Nov 8 19:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.55900000000000005,"15min":0.54800000000000004},"min":{"1min":0.39200000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.76300000000000001,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.58199999999999996,"15min":0.57799999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.68700000000000006,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.51100000000000001}]},{"osd":6,"last update":"Wed Nov 8 19:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.45600000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.80400000000000005,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57299999999999995,"15min":0.56399999999999995},"min":{"1min":0.441,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.69199999999999995,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.495}]}]},{"osd":6,"up_from":13,"seq":55834574892,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":978944,"data_stored":468818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.57299999999999995,"15min":0.59699999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.69799999999999995,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.57299999999999995,"15min":0.59099999999999997},"min":{"1min":0.313,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.754,"5min":1.478,"15min":1.478},"last":0.64400000000000002}]},{"osd":1,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.59599999999999997,"15min":0.60599999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.77500000000000002,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.65200000000000002,"15min":0.66600000000000004},"min":{"1min":0.435,"5min":0.433,"15min":0.433},"max":{"1min":0.78700000000000003,"5min":1.649,"15min":1.649},"last":0.72499999999999998}]},{"osd":2,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.621,"15min":0.63200000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76400000000000001,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.73699999999999999}]},{"osd":3,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.60399999999999998,"15min":0.63},"min":{"1min":0.42299999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.747,"5min":1.766,"15min":1.766},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.59499999999999997,"15min":0.61899999999999999},"min":{"1min":0.39300000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.82799999999999996,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":0.52100000000000002}]},{"osd":4,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53700000000000003,"15min":0.54200000000000004},"min":{"1min":0.36399999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.625},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57299999999999995,"15min":0.58099999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.81699999999999995,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.54700000000000004}]},{"osd":5,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.55500000000000005,"15min":0.56799999999999995},"min":{"1min":0.38800000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.73499999999999999,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.623,"15min":0.63600000000000001},"min":{"1min":0.41399999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.80200000000000005,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.45000000000000001}]},{"osd":7,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.60599999999999998,"15min":0.61299999999999999},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.77700000000000002,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.63600000000000001,"15min":0.64600000000000002},"min":{"1min":0.44400000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.71599999999999997,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.58399999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574891,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":978944,"data_stored":468818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.35699999999999998,"15min":0.36299999999999999},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.51200000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.38900000000000001,"15min":0.41299999999999998},"min":{"1min":0.22900000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.51700000000000002,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":0.35099999999999998}]},{"osd":2,"last update":"Wed Nov 8 19:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.33800000000000002,"15min":0.34499999999999997},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.53000000000000003,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.38100000000000001,"15min":0.39400000000000002},"min":{"1min":0.253,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.46400000000000002,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.41099999999999998}]},{"osd":3,"last update":"Wed Nov 8 19:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.40799999999999997,"15min":0.41699999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.432,"5min":1.24,"15min":1.24},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.371,"5min":0.438,"15min":0.46200000000000002},"min":{"1min":0.26100000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.47999999999999998,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.312}]},{"osd":4,"last update":"Wed Nov 8 19:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.60599999999999998,"15min":0.61399999999999999},"min":{"1min":0.46500000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72499999999999998,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57599999999999996,"15min":0.56599999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.76200000000000001,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.57199999999999995}]},{"osd":5,"last update":"Wed Nov 8 19:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.56999999999999995,"15min":0.55800000000000005},"min":{"1min":0.41399999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.72799999999999998,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.60199999999999998,"15min":0.60699999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.68700000000000006,"5min":1.115,"15min":1.115},"last":0.78600000000000003}]},{"osd":6,"last update":"Wed Nov 8 19:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.63,"15min":0.63800000000000001},"min":{"1min":0.439,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.746,"5min":2.093,"15min":2.093},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.59899999999999998,"15min":0.60299999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.76100000000000001,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.74099999999999999}]},{"osd":7,"last update":"Wed Nov 8 19:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.64700000000000002,"15min":0.67100000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.77600000000000002,"5min":1.591,"15min":1.591},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.66500000000000004,"15min":0.69199999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.70199999999999996,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.63600000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574891,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28556,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343284,"statfs":{"total":96636764160,"available":96607522816,"internally_reserved":0,"allocated":1572864,"data_stored":1059186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:26:00 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.879,"15min":1.1180000000000001},"min":{"1min":0.23799999999999999,"5min":0.192,"15min":0.192},"max":{"1min":0.60699999999999998,"5min":19.295999999999999,"15min":19.295999999999999},"last":0.434},{"interface":"front","average":{"1min":0.379,"5min":0.81999999999999995,"15min":1.024},"min":{"1min":0.24299999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.56000000000000005,"5min":17.204000000000001,"15min":17.204000000000001},"last":0.40799999999999997}]},{"osd":2,"last update":"Wed Nov 8 19:26:00 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.54200000000000004,"15min":0.61799999999999999},"min":{"1min":0.28299999999999997,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.54700000000000004,"5min":6.524,"15min":6.524},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.85399999999999998,"15min":1.0640000000000001},"min":{"1min":0.29499999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.60699999999999998,"5min":17.175000000000001,"15min":17.175000000000001},"last":0.45100000000000001}]},{"osd":3,"last update":"Wed Nov 8 19:26:00 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.746,"15min":0.91000000000000003},"min":{"1min":0.27100000000000002,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.55800000000000005,"5min":14.324,"15min":14.324},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.40799999999999997,"15min":0.40400000000000003},"min":{"1min":0.34699999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.48599999999999999}]},{"osd":4,"last update":"Wed Nov 8 19:26:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":1.028,"15min":1.212},"min":{"1min":0.52000000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.98999999999999999,"5min":17.056000000000001,"15min":17.056000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.70699999999999996,"15min":0.745},"min":{"1min":0.49099999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.82299999999999995,"5min":5.0289999999999999,"15min":5.0289999999999999},"last":0.60499999999999998}]},{"osd":5,"last update":"Wed Nov 8 19:26:00 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.69999999999999996,"15min":0.746},"min":{"1min":0.53400000000000003,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.85099999999999998,"5min":5.0590000000000002,"15min":5.0590000000000002},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.58399999999999996,"15min":0.56999999999999995},"min":{"1min":0.47199999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.64400000000000002}]},{"osd":6,"last update":"Wed Nov 8 19:26:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.61299999999999999,"15min":0.60799999999999998},"min":{"1min":0.505,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.68400000000000005,"5min":1.0649999999999999,"15min":1.2589999999999999},"min":{"1min":0.50800000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.0389999999999999,"5min":17.111999999999998,"15min":17.111999999999998},"last":0.72599999999999998}]},{"osd":7,"last update":"Wed Nov 8 19:26:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":1.0820000000000001,"15min":1.274},"min":{"1min":0.48099999999999998,"5min":0.376,"15min":0.376},"max":{"1min":1.0760000000000001,"5min":17.146000000000001,"15min":17.146000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.63,"5min":0.71099999999999997,"15min":0.75700000000000001},"min":{"1min":0.47099999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.91700000000000004,"5min":4.9829999999999997,"15min":4.9829999999999997},"last":0.68799999999999994}]}]},{"osd":2,"up_from":13,"seq":55834574891,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":978944,"data_stored":468818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.433,"15min":0.47499999999999998},"min":{"1min":0.23300000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.61299999999999999,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.46200000000000002,"15min":0.50800000000000001},"min":{"1min":0.23999999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.65100000000000002,"5min":3.4369999999999998,"15min":3.4369999999999998},"last":0.31900000000000001}]},{"osd":1,"last update":"Wed Nov 8 19:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.49099999999999999,"15min":0.54900000000000004},"min":{"1min":0.27000000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.48399999999999999,"5min":4.0679999999999996,"15min":4.0679999999999996},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.54400000000000004,"15min":0.59599999999999997},"min":{"1min":0.32300000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.58599999999999997,"5min":4.3499999999999996,"15min":4.3499999999999996},"last":0.438}]},{"osd":3,"last update":"Wed Nov 8 19:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.495,"15min":0.53700000000000003},"min":{"1min":0.27800000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.47099999999999997,"5min":3.8580000000000001,"15min":3.8580000000000001},"last":0.375},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.46300000000000002,"15min":0.51200000000000001},"min":{"1min":0.29599999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.55700000000000005,"5min":3.476,"15min":3.476},"last":0.34000000000000002}]},{"osd":4,"last update":"Wed Nov 8 19:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.68799999999999994,"15min":0.71799999999999997},"min":{"1min":0.44,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.98799999999999999,"5min":4.0090000000000003,"15min":4.0090000000000003},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.68899999999999995,"15min":0.73399999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.69099999999999995,"5min":4.1040000000000001,"15min":4.1040000000000001},"last":0.46500000000000002}]},{"osd":5,"last update":"Wed Nov 8 19:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.69299999999999995,"15min":0.74299999999999999},"min":{"1min":0.47999999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.874,"5min":4.0869999999999997,"15min":4.0869999999999997},"last":0.497},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.69599999999999995,"15min":0.746},"min":{"1min":0.435,"5min":0.433,"15min":0.433},"max":{"1min":0.78100000000000003,"5min":3.843,"15min":3.843},"last":0.56000000000000005}]},{"osd":6,"last update":"Wed Nov 8 19:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.70799999999999996,"15min":0.75900000000000001},"min":{"1min":0.45300000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.72699999999999998,"5min":4.1399999999999997,"15min":4.1399999999999997},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.68799999999999994,"15min":0.73399999999999999},"min":{"1min":0.49199999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.81499999999999995,"5min":4.0499999999999998,"15min":4.0499999999999998},"last":0.52500000000000002}]},{"osd":7,"last update":"Wed Nov 8 19:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.72799999999999998,"15min":0.76800000000000002},"min":{"1min":0.48799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.754,"5min":4.157,"15min":4.157},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.754,"15min":0.80000000000000004},"min":{"1min":0.505,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.93000000000000005,"5min":4.1710000000000003,"15min":4.1710000000000003},"last":0.54400000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574891,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":978944,"data_stored":468818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.38100000000000001,"15min":0.38500000000000001},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.64600000000000002,"5min":1.458,"15min":1.458},"last":0.373},{"interface":"front","average":{"1min":0.372,"5min":0.38900000000000001,"15min":0.39800000000000002},"min":{"1min":0.29499999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.53400000000000003,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.35699999999999998}]},{"osd":1,"last update":"Wed Nov 8 19:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.40500000000000003,"15min":0.41099999999999998},"min":{"1min":0.29599999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.61199999999999999,"5min":1.512,"15min":1.512},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.435,"15min":0.44700000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.59999999999999998,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.32500000000000001}]},{"osd":2,"last update":"Wed Nov 8 19:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.371,"15min":0.376},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.54800000000000004,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.41899999999999998,"15min":0.42699999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.60899999999999999,"5min":1.536,"15min":1.536},"last":0.42799999999999999}]},{"osd":4,"last update":"Wed Nov 8 19:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.60799999999999998,"15min":0.62},"min":{"1min":0.44900000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.77000000000000002,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.61299999999999999,"15min":0.61099999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.80200000000000005,"5min":1.153,"15min":1.153},"last":0.70399999999999996}]},{"osd":5,"last update":"Wed Nov 8 19:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.58899999999999997,"15min":0.59099999999999997},"min":{"1min":0.42399999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.69599999999999995,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.58899999999999997,"15min":0.60299999999999998},"min":{"1min":0.39300000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.73699999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.56899999999999995}]},{"osd":6,"last update":"Wed Nov 8 19:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57399999999999995,"15min":0.57999999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78500000000000003,"5min":1.113,"15min":1.113},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60799999999999998,"15min":0.61199999999999999},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72299999999999998,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.58599999999999997}]},{"osd":7,"last update":"Wed Nov 8 19:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.63500000000000001,"15min":0.64700000000000002},"min":{"1min":0.433,"5min":0.432,"15min":0.432},"max":{"1min":0.73999999999999999,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.62,"15min":0.61799999999999999},"min":{"1min":0.46300000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.754,"5min":1.179,"15min":1.179},"last":0.75600000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574891,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":978944,"data_stored":468818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:25:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.54500000000000004,"15min":0.53800000000000003},"min":{"1min":0.36799999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.80100000000000005,"5min":1.399,"15min":1.399},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58499999999999996,"15min":0.59499999999999997},"min":{"1min":0.44400000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73499999999999999,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.63500000000000001}]},{"osd":1,"last update":"Wed Nov 8 19:25:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.51400000000000001,"15min":0.51100000000000001},"min":{"1min":0.42199999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.502,"15min":0.497},"min":{"1min":0.40999999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.61799999999999999}]},{"osd":2,"last update":"Wed Nov 8 19:25:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.61899999999999999,"15min":0.63500000000000001},"min":{"1min":0.38200000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.80800000000000005,"5min":2.8490000000000002,"15min":2.8490000000000002},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.53800000000000003,"15min":0.52400000000000002},"min":{"1min":0.40799999999999997,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.71799999999999997,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.47199999999999998}]},{"osd":3,"last update":"Wed Nov 8 19:25:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57799999999999996,"15min":0.56599999999999995},"min":{"1min":0.47099999999999997,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.75700000000000001,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.70099999999999996,"15min":0.72399999999999998},"min":{"1min":0.48299999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.83199999999999996,"5min":3.4849999999999999,"15min":3.4849999999999999},"last":0.66600000000000004}]},{"osd":5,"last update":"Wed Nov 8 19:25:59 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.51800000000000002,"15min":0.52000000000000002},"min":{"1min":0.38,"5min":0.313,"15min":0.313},"max":{"1min":0.67200000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.56899999999999995,"15min":0.56100000000000005},"min":{"1min":0.39700000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.79100000000000004,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.65000000000000002}]},{"osd":6,"last update":"Wed Nov 8 19:25:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.67300000000000004,"15min":0.71499999999999997},"min":{"1min":0.38,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.71599999999999997,"5min":4.1529999999999996,"15min":4.1529999999999996},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.624,"5min":0.61599999999999999,"15min":0.61399999999999999},"min":{"1min":0.41699999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.73999999999999999,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.59999999999999998}]},{"osd":7,"last update":"Wed Nov 8 19:25:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57399999999999995,"15min":0.57199999999999995},"min":{"1min":0.47399999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.69999999999999996,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.80200000000000005,"15min":0.85199999999999998},"min":{"1min":0.52700000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.83899999999999997,"5min":5.5359999999999996,"15min":5.5359999999999996},"last":0.68700000000000006}]}]},{"osd":5,"up_from":13,"seq":55834574891,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":978944,"data_stored":468818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53700000000000003,"15min":0.54700000000000004},"min":{"1min":0.40600000000000003,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.63800000000000001,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":0.44},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.52500000000000002,"15min":0.51900000000000002},"min":{"1min":0.32800000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.68799999999999994,"5min":0.878,"15min":0.878},"last":0.26900000000000002}]},{"osd":1,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55300000000000005,"15min":0.54700000000000004},"min":{"1min":0.47199999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.68200000000000005,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.59299999999999997,"15min":0.60699999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.73899999999999999,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":0.32200000000000001}]},{"osd":2,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.34699999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.65300000000000002,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.53600000000000003,"15min":0.53000000000000003},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.70699999999999996,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.29699999999999999}]},{"osd":3,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.41299999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71799999999999997,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57699999999999996,"15min":0.57299999999999995},"min":{"1min":0.42199999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.73599999999999999,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.48599999999999999}]},{"osd":4,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.57499999999999996,"15min":0.59899999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.748,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.63700000000000001,"15min":0.63500000000000001},"min":{"1min":0.46500000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.77300000000000002,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.56100000000000005}]},{"osd":6,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.57899999999999996,"15min":0.57799999999999996},"min":{"1min":0.38200000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.73599999999999999,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.63800000000000001,"15min":0.66600000000000004},"min":{"1min":0.41799999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.80500000000000005,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":0.60399999999999998}]},{"osd":7,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.623,"15min":0.629},"min":{"1min":0.42499999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.82799999999999996,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.64200000000000002,"15min":0.64800000000000002},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.80700000000000005,"5min":0.873,"15min":0.873},"last":0.58599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:26:20.891 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:26:21.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.025+0000 7f0a0a8a6700 1 Processor -- start 2023-11-08T19:26:21.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.025+0000 7f0a0a8a6700 1 -- start start 2023-11-08T19:26:21.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.025+0000 7f0a0a8a6700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0a040afb30 0x7f0a040ce380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:21.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.025+0000 7f0a0a8a6700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0a040b16b0 0x7f0a040cbf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:21.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.025+0000 7f0a0a8a6700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f0a040b20b0 0x7f0a040b2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:21.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.025+0000 7f0a0a8a6700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a040b2a80 con 0x7f0a040b16b0 2023-11-08T19:26:21.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.025+0000 7f0a0a8a6700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a040d1330 con 0x7f0a040b20b0 2023-11-08T19:26:21.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.025+0000 7f0a0a8a6700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a040cb490 con 0x7f0a040afb30 2023-11-08T19:26:21.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.025+0000 7f0a037fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0a040b16b0 0x7f0a040cbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:21.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.025+0000 7f0a037fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0a040b16b0 0x7f0a040cbf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42534/0 (socket says 172.21.15.149:42534) 2023-11-08T19:26:21.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.025+0000 7f0a037fe700 1 -- 172.21.15.149:0/959814000 learned_addr learned my addr 172.21.15.149:0/959814000 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:21.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.025+0000 7f0a03fff700 1 --2- 172.21.15.149:0/959814000 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0a040afb30 0x7f0a040ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:21.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.025+0000 7f0a08e43700 1 --2- 172.21.15.149:0/959814000 >> v2:172.21.15.160:3300/0 conn(0x7f0a040b20b0 0x7f0a040b2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:21.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.025+0000 7f0a037fe700 1 -- 172.21.15.149:0/959814000 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0a040afb30 msgr2=0x7f0a040ce380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:21.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.025+0000 7f0a037fe700 1 --2- 172.21.15.149:0/959814000 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0a040afb30 0x7f0a040ce380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:21.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.025+0000 7f0a037fe700 1 -- 172.21.15.149:0/959814000 >> v2:172.21.15.160:3300/0 conn(0x7f0a040b20b0 msgr2=0x7f0a040b2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:21.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.025+0000 7f0a037fe700 1 --2- 172.21.15.149:0/959814000 >> v2:172.21.15.160:3300/0 conn(0x7f0a040b20b0 0x7f0a040b2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:21.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.025+0000 7f0a037fe700 1 -- 172.21.15.149:0/959814000 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a040cb770 con 0x7f0a040b16b0 2023-11-08T19:26:21.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.025+0000 7f0a037fe700 1 --2- 172.21.15.149:0/959814000 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0a040b16b0 0x7f0a040cbf70 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f0a040caf30 tx=0x7f09f8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=511d5bc978784d7 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:21.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.025+0000 7f0a02ffd700 1 -- 172.21.15.149:0/959814000 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f8011830 con 0x7f0a040b16b0 2023-11-08T19:26:21.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.025+0000 7f0a02ffd700 1 -- 172.21.15.149:0/959814000 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09f8011990 con 0x7f0a040b16b0 2023-11-08T19:26:21.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.025+0000 7f0a02ffd700 1 -- 172.21.15.149:0/959814000 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f8011d20 con 0x7f0a040b16b0 2023-11-08T19:26:21.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.026+0000 7f0a0a8a6700 1 -- 172.21.15.149:0/959814000 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0a040b16b0 msgr2=0x7f0a040cbf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:21.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.026+0000 7f0a0a8a6700 1 --2- 172.21.15.149:0/959814000 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0a040b16b0 0x7f0a040cbf70 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f0a040caf30 tx=0x7f09f8009bd0 comp rx=0 tx=0).stop 2023-11-08T19:26:21.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.026+0000 7f0a0a8a6700 1 -- 172.21.15.149:0/959814000 shutdown_connections 2023-11-08T19:26:21.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.026+0000 7f0a0a8a6700 1 --2- 172.21.15.149:0/959814000 >> v2:172.21.15.160:3300/0 conn(0x7f0a040b20b0 0x7f0a040b2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:21.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.026+0000 7f0a0a8a6700 1 --2- 172.21.15.149:0/959814000 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0a040afb30 0x7f0a040ce380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:21.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.026+0000 7f0a0a8a6700 1 --2- 172.21.15.149:0/959814000 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0a040b16b0 0x7f0a040cbf70 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:21.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.026+0000 7f0a0a8a6700 1 -- 172.21.15.149:0/959814000 >> 172.21.15.149:0/959814000 conn(0x7f0a04099a40 msgr2=0x7f0a040d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:21.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.026+0000 7f0a0a8a6700 1 -- 172.21.15.149:0/959814000 shutdown_connections 2023-11-08T19:26:21.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.026+0000 7f0a0a8a6700 1 -- 172.21.15.149:0/959814000 wait complete. 2023-11-08T19:26:21.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.028+0000 7f0a0a8a6700 1 Processor -- start 2023-11-08T19:26:21.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.028+0000 7f0a0a8a6700 1 -- start start 2023-11-08T19:26:21.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.028+0000 7f0a0a8a6700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a040afb30 0x7f0a040c6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:21.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.028+0000 7f0a0a8a6700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0a040b16b0 0x7f0a0406adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:21.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.028+0000 7f0a0a8a6700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0a040b20b0 0x7f0a041e6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:21.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.029+0000 7f0a0a8a6700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0415cc80 con 0x7f0a040b16b0 2023-11-08T19:26:21.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.029+0000 7f0a0a8a6700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a041e59b0 con 0x7f0a040afb30 2023-11-08T19:26:21.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.029+0000 7f0a0a8a6700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a041e5c90 con 0x7f0a040b20b0 2023-11-08T19:26:21.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.029+0000 7f0a037fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0a040b16b0 0x7f0a0406adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:21.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.029+0000 7f0a037fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0a040b16b0 0x7f0a0406adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42540/0 (socket says 172.21.15.149:42540) 2023-11-08T19:26:21.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.029+0000 7f0a037fe700 1 -- 172.21.15.149:0/442581308 learned_addr learned my addr 172.21.15.149:0/442581308 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:21.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.029+0000 7f0a03fff700 1 --2- 172.21.15.149:0/442581308 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a040afb30 0x7f0a040c6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:21.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.029+0000 7f0a08e43700 1 --2- 172.21.15.149:0/442581308 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0a040b20b0 0x7f0a041e6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:21.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.029+0000 7f0a037fe700 1 -- 172.21.15.149:0/442581308 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0a040b20b0 msgr2=0x7f0a041e6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:21.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.029+0000 7f0a037fe700 1 --2- 172.21.15.149:0/442581308 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0a040b20b0 0x7f0a041e6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:21.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.029+0000 7f0a037fe700 1 -- 172.21.15.149:0/442581308 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a040afb30 msgr2=0x7f0a040c6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:21.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.029+0000 7f0a037fe700 1 --2- 172.21.15.149:0/442581308 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a040afb30 0x7f0a040c6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:21.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.029+0000 7f0a037fe700 1 -- 172.21.15.149:0/442581308 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f8009550 con 0x7f0a040b16b0 2023-11-08T19:26:21.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.029+0000 7f0a037fe700 1 --2- 172.21.15.149:0/442581308 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0a040b16b0 0x7f0a0406adf0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f09f8000c00 tx=0x7f09f8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:21.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.029+0000 7f0a00ff9700 1 -- 172.21.15.149:0/442581308 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f8004240 con 0x7f0a040b16b0 2023-11-08T19:26:21.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.029+0000 7f0a00ff9700 1 -- 172.21.15.149:0/442581308 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09f801f070 con 0x7f0a040b16b0 2023-11-08T19:26:21.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.029+0000 7f0a0a8a6700 1 -- 172.21.15.149:0/442581308 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a041e5f70 con 0x7f0a040b16b0 2023-11-08T19:26:21.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.029+0000 7f0a00ff9700 1 -- 172.21.15.149:0/442581308 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f80036a0 con 0x7f0a040b16b0 2023-11-08T19:26:21.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.029+0000 7f0a0a8a6700 1 -- 172.21.15.149:0/442581308 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a041e6530 con 0x7f0a040b16b0 2023-11-08T19:26:21.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.030+0000 7f0a0a8a6700 1 -- 172.21.15.149:0/442581308 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a040745f0 con 0x7f0a040b16b0 2023-11-08T19:26:21.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.031+0000 7f0a00ff9700 1 -- 172.21.15.149:0/442581308 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f09f8021030 con 0x7f0a040b16b0 2023-11-08T19:26:21.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.031+0000 7f0a00ff9700 1 --2- 172.21.15.149:0/442581308 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f09f006af00 0x7f09f006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:21.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.031+0000 7f0a00ff9700 1 -- 172.21.15.149:0/442581308 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f09f808ac30 con 0x7f0a040b16b0 2023-11-08T19:26:21.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.031+0000 7f0a03fff700 1 --2- 172.21.15.149:0/442581308 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f09f006af00 0x7f09f006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:21.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.032+0000 7f0a03fff700 1 --2- 172.21.15.149:0/442581308 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f09f006af00 0x7f09f006d3c0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f09f4009b40 tx=0x7f09f40091c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:21.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.036+0000 7f0a00ff9700 1 -- 172.21.15.149:0/442581308 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f09f8055920 con 0x7f0a040b16b0 2023-11-08T19:26:21.226 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.224+0000 7f0a0a8a6700 1 -- 172.21.15.149:0/442581308 --> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0a040cc4b0 con 0x7f09f006af00 2023-11-08T19:26:21.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.238+0000 7f0a00ff9700 1 -- 172.21.15.149:0/442581308 <== mgr.4104 v2:172.21.15.149:6832/1929837472 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+532077 (secure 0 0 0) 0x7f09f4005a20 con 0x7f09f006af00 2023-11-08T19:26:21.249 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:26:21.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.243+0000 7f0a0a8a6700 1 -- 172.21.15.149:0/442581308 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f09f006af00 msgr2=0x7f09f006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:21.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.243+0000 7f0a0a8a6700 1 --2- 172.21.15.149:0/442581308 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f09f006af00 0x7f09f006d3c0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f09f4009b40 tx=0x7f09f40091c0 comp rx=0 tx=0).stop 2023-11-08T19:26:21.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.244+0000 7f0a0a8a6700 1 -- 172.21.15.149:0/442581308 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0a040b16b0 msgr2=0x7f0a0406adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:21.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.244+0000 7f0a0a8a6700 1 --2- 172.21.15.149:0/442581308 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0a040b16b0 0x7f0a0406adf0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f09f8000c00 tx=0x7f09f8004750 comp rx=0 tx=0).stop 2023-11-08T19:26:21.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.244+0000 7f0a0a8a6700 1 -- 172.21.15.149:0/442581308 shutdown_connections 2023-11-08T19:26:21.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.244+0000 7f0a0a8a6700 1 --2- 172.21.15.149:0/442581308 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f09f006af00 0x7f09f006d3c0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:21.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.244+0000 7f0a0a8a6700 1 --2- 172.21.15.149:0/442581308 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a040afb30 0x7f0a040c6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:21.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.244+0000 7f0a0a8a6700 1 --2- 172.21.15.149:0/442581308 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0a040b20b0 0x7f0a041e6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:21.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.244+0000 7f0a0a8a6700 1 --2- 172.21.15.149:0/442581308 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0a040b16b0 0x7f0a0406adf0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:21.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.244+0000 7f0a0a8a6700 1 -- 172.21.15.149:0/442581308 >> 172.21.15.149:0/442581308 conn(0x7f0a04099a40 msgr2=0x7f0a0406f660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:21.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.244+0000 7f0a0a8a6700 1 -- 172.21.15.149:0/442581308 shutdown_connections 2023-11-08T19:26:21.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.244+0000 7f0a0a8a6700 1 -- 172.21.15.149:0/442581308 wait complete. 2023-11-08T19:26:21.259 INFO:teuthology.orchestra.run.smithi149.stderr:dumped all 2023-11-08T19:26:21.260 INFO:teuthology.orchestra.run.smithi149.stdout:{"pg_ready":true,"pg_map":{"version":178,"stamp":"2023-11-08T19:26:20.029924+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":362,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225344,"kb_used_data":9160,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754749376,"statfs":{"total":773094113280,"available":772863361024,"internally_reserved":0,"allocated":9379840,"data_stored":5124092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002136"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.873784+0000","last_change":"2023-11-08T19:26:12.159460+0000","last_active":"2023-11-08T19:26:13.873784+0000","last_peered":"2023-11-08T19:26:13.873784+0000","last_clean":"2023-11-08T19:26:13.873784+0000","last_became_active":"2023-11-08T19:26:12.159151+0000","last_became_peered":"2023-11-08T19:26:12.159151+0000","last_unstale":"2023-11-08T19:26:13.873784+0000","last_undegraded":"2023-11-08T19:26:13.873784+0000","last_fullsized":"2023-11-08T19:26:13.873784+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:25:56.795681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.987566+0000","last_change":"2023-11-08T19:26:12.161413+0000","last_active":"2023-11-08T19:26:13.987566+0000","last_peered":"2023-11-08T19:26:13.987566+0000","last_clean":"2023-11-08T19:26:13.987566+0000","last_became_active":"2023-11-08T19:26:12.160235+0000","last_became_peered":"2023-11-08T19:26:12.160235+0000","last_unstale":"2023-11-08T19:26:13.987566+0000","last_undegraded":"2023-11-08T19:26:13.987566+0000","last_fullsized":"2023-11-08T19:26:13.987566+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:02:41.945803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.873515+0000","last_change":"2023-11-08T19:26:12.159674+0000","last_active":"2023-11-08T19:26:13.873515+0000","last_peered":"2023-11-08T19:26:13.873515+0000","last_clean":"2023-11-08T19:26:13.873515+0000","last_became_active":"2023-11-08T19:26:12.159375+0000","last_became_peered":"2023-11-08T19:26:12.159375+0000","last_unstale":"2023-11-08T19:26:13.873515+0000","last_undegraded":"2023-11-08T19:26:13.873515+0000","last_fullsized":"2023-11-08T19:26:13.873515+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:25:59.877846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.157328+0000","last_change":"2023-11-08T19:26:12.164116+0000","last_active":"2023-11-08T19:26:13.157328+0000","last_peered":"2023-11-08T19:26:13.157328+0000","last_clean":"2023-11-08T19:26:13.157328+0000","last_became_active":"2023-11-08T19:26:12.163797+0000","last_became_peered":"2023-11-08T19:26:12.163797+0000","last_unstale":"2023-11-08T19:26:13.157328+0000","last_undegraded":"2023-11-08T19:26:13.157328+0000","last_fullsized":"2023-11-08T19:26:13.157328+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:02:25.295497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.657310+0000","last_change":"2023-11-08T19:26:12.164093+0000","last_active":"2023-11-08T19:26:13.657310+0000","last_peered":"2023-11-08T19:26:13.657310+0000","last_clean":"2023-11-08T19:26:13.657310+0000","last_became_active":"2023-11-08T19:26:12.163816+0000","last_became_peered":"2023-11-08T19:26:12.163816+0000","last_unstale":"2023-11-08T19:26:13.657310+0000","last_undegraded":"2023-11-08T19:26:13.657310+0000","last_fullsized":"2023-11-08T19:26:13.657310+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:32:15.350077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.158573+0000","last_change":"2023-11-08T19:26:12.159151+0000","last_active":"2023-11-08T19:26:13.158573+0000","last_peered":"2023-11-08T19:26:13.158573+0000","last_clean":"2023-11-08T19:26:13.158573+0000","last_became_active":"2023-11-08T19:26:12.158889+0000","last_became_peered":"2023-11-08T19:26:12.158889+0000","last_unstale":"2023-11-08T19:26:13.158573+0000","last_undegraded":"2023-11-08T19:26:13.158573+0000","last_fullsized":"2023-11-08T19:26:13.158573+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:40:48.988790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.157287+0000","last_change":"2023-11-08T19:26:12.159875+0000","last_active":"2023-11-08T19:26:13.157287+0000","last_peered":"2023-11-08T19:26:13.157287+0000","last_clean":"2023-11-08T19:26:13.157287+0000","last_became_active":"2023-11-08T19:26:12.159616+0000","last_became_peered":"2023-11-08T19:26:12.159616+0000","last_unstale":"2023-11-08T19:26:13.157287+0000","last_undegraded":"2023-11-08T19:26:13.157287+0000","last_fullsized":"2023-11-08T19:26:13.157287+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:31:03.813978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.986444+0000","last_change":"2023-11-08T19:26:12.159467+0000","last_active":"2023-11-08T19:26:13.986444+0000","last_peered":"2023-11-08T19:26:13.986444+0000","last_clean":"2023-11-08T19:26:13.986444+0000","last_became_active":"2023-11-08T19:26:12.159151+0000","last_became_peered":"2023-11-08T19:26:12.159151+0000","last_unstale":"2023-11-08T19:26:13.986444+0000","last_undegraded":"2023-11-08T19:26:13.986444+0000","last_fullsized":"2023-11-08T19:26:13.986444+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:50:52.505860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.157941+0000","last_change":"2023-11-08T19:26:12.163349+0000","last_active":"2023-11-08T19:26:13.157941+0000","last_peered":"2023-11-08T19:26:13.157941+0000","last_clean":"2023-11-08T19:26:13.157941+0000","last_became_active":"2023-11-08T19:26:12.163075+0000","last_became_peered":"2023-11-08T19:26:12.163075+0000","last_unstale":"2023-11-08T19:26:13.157941+0000","last_undegraded":"2023-11-08T19:26:13.157941+0000","last_fullsized":"2023-11-08T19:26:13.157941+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:18:29.340015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.657880+0000","last_change":"2023-11-08T19:26:12.169645+0000","last_active":"2023-11-08T19:26:13.657880+0000","last_peered":"2023-11-08T19:26:13.657880+0000","last_clean":"2023-11-08T19:26:13.657880+0000","last_became_active":"2023-11-08T19:26:12.169355+0000","last_became_peered":"2023-11-08T19:26:12.169355+0000","last_unstale":"2023-11-08T19:26:13.657880+0000","last_undegraded":"2023-11-08T19:26:13.657880+0000","last_fullsized":"2023-11-08T19:26:13.657880+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:10:54.156995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.158902+0000","last_change":"2023-11-08T19:26:12.163084+0000","last_active":"2023-11-08T19:26:13.158902+0000","last_peered":"2023-11-08T19:26:13.158902+0000","last_clean":"2023-11-08T19:26:13.158902+0000","last_became_active":"2023-11-08T19:26:12.162467+0000","last_became_peered":"2023-11-08T19:26:12.162467+0000","last_unstale":"2023-11-08T19:26:13.158902+0000","last_undegraded":"2023-11-08T19:26:13.158902+0000","last_fullsized":"2023-11-08T19:26:13.158902+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:15:38.428199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.157588+0000","last_change":"2023-11-08T19:26:12.157172+0000","last_active":"2023-11-08T19:26:13.157588+0000","last_peered":"2023-11-08T19:26:13.157588+0000","last_clean":"2023-11-08T19:26:13.157588+0000","last_became_active":"2023-11-08T19:26:12.156897+0000","last_became_peered":"2023-11-08T19:26:12.156897+0000","last_unstale":"2023-11-08T19:26:13.157588+0000","last_undegraded":"2023-11-08T19:26:13.157588+0000","last_fullsized":"2023-11-08T19:26:13.157588+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:22:58.925835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.157111+0000","last_change":"2023-11-08T19:26:12.161912+0000","last_active":"2023-11-08T19:26:13.157111+0000","last_peered":"2023-11-08T19:26:13.157111+0000","last_clean":"2023-11-08T19:26:13.157111+0000","last_became_active":"2023-11-08T19:26:12.161540+0000","last_became_peered":"2023-11-08T19:26:12.161540+0000","last_unstale":"2023-11-08T19:26:13.157111+0000","last_undegraded":"2023-11-08T19:26:13.157111+0000","last_fullsized":"2023-11-08T19:26:13.157111+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:10:54.156995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.986065+0000","last_change":"2023-11-08T19:26:12.159394+0000","last_active":"2023-11-08T19:26:13.986065+0000","last_peered":"2023-11-08T19:26:13.986065+0000","last_clean":"2023-11-08T19:26:13.986065+0000","last_became_active":"2023-11-08T19:26:12.158973+0000","last_became_peered":"2023-11-08T19:26:12.158973+0000","last_unstale":"2023-11-08T19:26:13.986065+0000","last_undegraded":"2023-11-08T19:26:13.986065+0000","last_fullsized":"2023-11-08T19:26:13.986065+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:10:09.529868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.156653+0000","last_change":"2023-11-08T19:26:12.170139+0000","last_active":"2023-11-08T19:26:13.156653+0000","last_peered":"2023-11-08T19:26:13.156653+0000","last_clean":"2023-11-08T19:26:13.156653+0000","last_became_active":"2023-11-08T19:26:12.169883+0000","last_became_peered":"2023-11-08T19:26:12.169883+0000","last_unstale":"2023-11-08T19:26:13.156653+0000","last_undegraded":"2023-11-08T19:26:13.156653+0000","last_fullsized":"2023-11-08T19:26:13.156653+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:45:22.870353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.157213+0000","last_change":"2023-11-08T19:26:12.171269+0000","last_active":"2023-11-08T19:26:13.157213+0000","last_peered":"2023-11-08T19:26:13.157213+0000","last_clean":"2023-11-08T19:26:13.157213+0000","last_became_active":"2023-11-08T19:26:12.171009+0000","last_became_peered":"2023-11-08T19:26:12.171009+0000","last_unstale":"2023-11-08T19:26:13.157213+0000","last_undegraded":"2023-11-08T19:26:13.157213+0000","last_fullsized":"2023-11-08T19:26:13.157213+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:19:17.065471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.987642+0000","last_change":"2023-11-08T19:26:12.162741+0000","last_active":"2023-11-08T19:26:13.987642+0000","last_peered":"2023-11-08T19:26:13.987642+0000","last_clean":"2023-11-08T19:26:13.987642+0000","last_became_active":"2023-11-08T19:26:12.162459+0000","last_became_peered":"2023-11-08T19:26:12.162459+0000","last_unstale":"2023-11-08T19:26:13.987642+0000","last_undegraded":"2023-11-08T19:26:13.987642+0000","last_fullsized":"2023-11-08T19:26:13.987642+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:57:57.698858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.157461+0000","last_change":"2023-11-08T19:26:12.158485+0000","last_active":"2023-11-08T19:26:13.157461+0000","last_peered":"2023-11-08T19:26:13.157461+0000","last_clean":"2023-11-08T19:26:13.157461+0000","last_became_active":"2023-11-08T19:26:12.158228+0000","last_became_peered":"2023-11-08T19:26:12.158228+0000","last_unstale":"2023-11-08T19:26:13.157461+0000","last_undegraded":"2023-11-08T19:26:13.157461+0000","last_fullsized":"2023-11-08T19:26:13.157461+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:54:06.639386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.986959+0000","last_change":"2023-11-08T19:26:12.170143+0000","last_active":"2023-11-08T19:26:13.986959+0000","last_peered":"2023-11-08T19:26:13.986959+0000","last_clean":"2023-11-08T19:26:13.986959+0000","last_became_active":"2023-11-08T19:26:12.169862+0000","last_became_peered":"2023-11-08T19:26:12.169862+0000","last_unstale":"2023-11-08T19:26:13.986959+0000","last_undegraded":"2023-11-08T19:26:13.986959+0000","last_fullsized":"2023-11-08T19:26:13.986959+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:27:43.197018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.158021+0000","last_change":"2023-11-08T19:26:12.167611+0000","last_active":"2023-11-08T19:26:13.158021+0000","last_peered":"2023-11-08T19:26:13.158021+0000","last_clean":"2023-11-08T19:26:13.158021+0000","last_became_active":"2023-11-08T19:26:12.167113+0000","last_became_peered":"2023-11-08T19:26:12.167113+0000","last_unstale":"2023-11-08T19:26:13.158021+0000","last_undegraded":"2023-11-08T19:26:13.158021+0000","last_fullsized":"2023-11-08T19:26:13.158021+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:16:17.749651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.986086+0000","last_change":"2023-11-08T19:26:12.160191+0000","last_active":"2023-11-08T19:26:13.986086+0000","last_peered":"2023-11-08T19:26:13.986086+0000","last_clean":"2023-11-08T19:26:13.986086+0000","last_became_active":"2023-11-08T19:26:12.159936+0000","last_became_peered":"2023-11-08T19:26:12.159936+0000","last_unstale":"2023-11-08T19:26:13.986086+0000","last_undegraded":"2023-11-08T19:26:13.986086+0000","last_fullsized":"2023-11-08T19:26:13.986086+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:12:50.350945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.986591+0000","last_change":"2023-11-08T19:26:12.160418+0000","last_active":"2023-11-08T19:26:13.986591+0000","last_peered":"2023-11-08T19:26:13.986591+0000","last_clean":"2023-11-08T19:26:13.986591+0000","last_became_active":"2023-11-08T19:26:12.159608+0000","last_became_peered":"2023-11-08T19:26:12.159608+0000","last_unstale":"2023-11-08T19:26:13.986591+0000","last_undegraded":"2023-11-08T19:26:13.986591+0000","last_fullsized":"2023-11-08T19:26:13.986591+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:43:40.827635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.986475+0000","last_change":"2023-11-08T19:26:12.155447+0000","last_active":"2023-11-08T19:26:13.986475+0000","last_peered":"2023-11-08T19:26:13.986475+0000","last_clean":"2023-11-08T19:26:13.986475+0000","last_became_active":"2023-11-08T19:26:12.155129+0000","last_became_peered":"2023-11-08T19:26:12.155129+0000","last_unstale":"2023-11-08T19:26:13.986475+0000","last_undegraded":"2023-11-08T19:26:13.986475+0000","last_fullsized":"2023-11-08T19:26:13.986475+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:20:09.608650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.157398+0000","last_change":"2023-11-08T19:26:12.171667+0000","last_active":"2023-11-08T19:26:13.157398+0000","last_peered":"2023-11-08T19:26:13.157398+0000","last_clean":"2023-11-08T19:26:13.157398+0000","last_became_active":"2023-11-08T19:26:12.169680+0000","last_became_peered":"2023-11-08T19:26:12.169680+0000","last_unstale":"2023-11-08T19:26:13.157398+0000","last_undegraded":"2023-11-08T19:26:13.157398+0000","last_fullsized":"2023-11-08T19:26:13.157398+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:04:11.614632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.657753+0000","last_change":"2023-11-08T19:26:12.168006+0000","last_active":"2023-11-08T19:26:13.657753+0000","last_peered":"2023-11-08T19:26:13.657753+0000","last_clean":"2023-11-08T19:26:13.657753+0000","last_became_active":"2023-11-08T19:26:12.167695+0000","last_became_peered":"2023-11-08T19:26:12.167695+0000","last_unstale":"2023-11-08T19:26:13.657753+0000","last_undegraded":"2023-11-08T19:26:13.657753+0000","last_fullsized":"2023-11-08T19:26:13.657753+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:19:20.481039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.987678+0000","last_change":"2023-11-08T19:26:12.170463+0000","last_active":"2023-11-08T19:26:13.987678+0000","last_peered":"2023-11-08T19:26:13.987678+0000","last_clean":"2023-11-08T19:26:13.987678+0000","last_became_active":"2023-11-08T19:26:12.170203+0000","last_became_peered":"2023-11-08T19:26:12.170203+0000","last_unstale":"2023-11-08T19:26:13.987678+0000","last_undegraded":"2023-11-08T19:26:13.987678+0000","last_fullsized":"2023-11-08T19:26:13.987678+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:10:55.113689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.158798+0000","last_change":"2023-11-08T19:26:12.168622+0000","last_active":"2023-11-08T19:26:13.158798+0000","last_peered":"2023-11-08T19:26:13.158798+0000","last_clean":"2023-11-08T19:26:13.158798+0000","last_became_active":"2023-11-08T19:26:12.168321+0000","last_became_peered":"2023-11-08T19:26:12.168321+0000","last_unstale":"2023-11-08T19:26:13.158798+0000","last_undegraded":"2023-11-08T19:26:13.158798+0000","last_fullsized":"2023-11-08T19:26:13.158798+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:45:37.194772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.657693+0000","last_change":"2023-11-08T19:26:12.165332+0000","last_active":"2023-11-08T19:26:13.657693+0000","last_peered":"2023-11-08T19:26:13.657693+0000","last_clean":"2023-11-08T19:26:13.657693+0000","last_became_active":"2023-11-08T19:26:12.165047+0000","last_became_peered":"2023-11-08T19:26:12.165047+0000","last_unstale":"2023-11-08T19:26:13.657693+0000","last_undegraded":"2023-11-08T19:26:13.657693+0000","last_fullsized":"2023-11-08T19:26:13.657693+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:45:22.870353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.987190+0000","last_change":"2023-11-08T19:26:12.158350+0000","last_active":"2023-11-08T19:26:13.987190+0000","last_peered":"2023-11-08T19:26:13.987190+0000","last_clean":"2023-11-08T19:26:13.987190+0000","last_became_active":"2023-11-08T19:26:12.158087+0000","last_became_peered":"2023-11-08T19:26:12.158087+0000","last_unstale":"2023-11-08T19:26:13.987190+0000","last_undegraded":"2023-11-08T19:26:13.987190+0000","last_fullsized":"2023-11-08T19:26:13.987190+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:00:12.175593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.986346+0000","last_change":"2023-11-08T19:26:12.159219+0000","last_active":"2023-11-08T19:26:13.986346+0000","last_peered":"2023-11-08T19:26:13.986346+0000","last_clean":"2023-11-08T19:26:13.986346+0000","last_became_active":"2023-11-08T19:26:12.158663+0000","last_became_peered":"2023-11-08T19:26:12.158663+0000","last_unstale":"2023-11-08T19:26:13.986346+0000","last_undegraded":"2023-11-08T19:26:13.986346+0000","last_fullsized":"2023-11-08T19:26:13.986346+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:46:37.409508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.156679+0000","last_change":"2023-11-08T19:26:12.155325+0000","last_active":"2023-11-08T19:26:13.156679+0000","last_peered":"2023-11-08T19:26:13.156679+0000","last_clean":"2023-11-08T19:26:13.156679+0000","last_became_active":"2023-11-08T19:26:12.155030+0000","last_became_peered":"2023-11-08T19:26:12.155030+0000","last_unstale":"2023-11-08T19:26:13.156679+0000","last_undegraded":"2023-11-08T19:26:13.156679+0000","last_fullsized":"2023-11-08T19:26:13.156679+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:19:20.481039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.873187+0000","last_change":"2023-11-08T19:26:12.163858+0000","last_active":"2023-11-08T19:26:13.873187+0000","last_peered":"2023-11-08T19:26:13.873187+0000","last_clean":"2023-11-08T19:26:13.873187+0000","last_became_active":"2023-11-08T19:26:12.163591+0000","last_became_peered":"2023-11-08T19:26:12.163591+0000","last_unstale":"2023-11-08T19:26:13.873187+0000","last_undegraded":"2023-11-08T19:26:13.873187+0000","last_fullsized":"2023-11-08T19:26:13.873187+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:39:20.646980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.987054+0000","last_change":"2023-11-08T19:26:12.165608+0000","last_active":"2023-11-08T19:26:13.987054+0000","last_peered":"2023-11-08T19:26:13.987054+0000","last_clean":"2023-11-08T19:26:13.987054+0000","last_became_active":"2023-11-08T19:26:12.164978+0000","last_became_peered":"2023-11-08T19:26:12.164978+0000","last_unstale":"2023-11-08T19:26:13.987054+0000","last_undegraded":"2023-11-08T19:26:13.987054+0000","last_fullsized":"2023-11-08T19:26:13.987054+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:22:33.632578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"82'1","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.173319+0000","last_change":"2023-11-08T19:26:11.143492+0000","last_active":"2023-11-08T19:26:12.173319+0000","last_peered":"2023-11-08T19:26:12.173319+0000","last_clean":"2023-11-08T19:26:12.173319+0000","last_became_active":"2023-11-08T19:26:11.143296+0000","last_became_peered":"2023-11-08T19:26:11.143296+0000","last_unstale":"2023-11-08T19:26:12.173319+0000","last_undegraded":"2023-11-08T19:26:12.173319+0000","last_fullsized":"2023-11-08T19:26:12.173319+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:58:53.201963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.147655+0000","last_change":"2023-11-08T19:25:47.285071+0000","last_active":"2023-11-08T19:26:12.147655+0000","last_peered":"2023-11-08T19:26:12.147655+0000","last_clean":"2023-11-08T19:26:12.147655+0000","last_became_active":"2023-11-08T19:25:47.284788+0000","last_became_peered":"2023-11-08T19:25:47.284788+0000","last_unstale":"2023-11-08T19:26:12.147655+0000","last_undegraded":"2023-11-08T19:26:12.147655+0000","last_fullsized":"2023-11-08T19:26:12.147655+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:50:50.522780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":218,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.150652+0000","last_change":"2023-11-08T19:22:58.054283+0000","last_active":"2023-11-08T19:26:12.150652+0000","last_peered":"2023-11-08T19:26:12.150652+0000","last_clean":"2023-11-08T19:26:12.150652+0000","last_became_active":"2023-11-08T19:22:58.053337+0000","last_became_peered":"2023-11-08T19:22:58.053337+0000","last_unstale":"2023-11-08T19:26:12.150652+0000","last_undegraded":"2023-11-08T19:26:12.150652+0000","last_fullsized":"2023-11-08T19:26:12.150652+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:22:56.479654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:22:56.479654+0000","last_clean_scrub_stamp":"2023-11-08T19:22:56.479654+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:16:05.317001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.142686+0000","last_change":"2023-11-08T19:24:32.530665+0000","last_active":"2023-11-08T19:26:12.142686+0000","last_peered":"2023-11-08T19:26:12.142686+0000","last_clean":"2023-11-08T19:26:12.142686+0000","last_became_active":"2023-11-08T19:24:31.148363+0000","last_became_peered":"2023-11-08T19:24:31.148363+0000","last_unstale":"2023-11-08T19:26:12.142686+0000","last_undegraded":"2023-11-08T19:26:12.142686+0000","last_fullsized":"2023-11-08T19:26:12.142686+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:02:27.987795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075444200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.152384+0000","last_change":"2023-11-08T19:25:48.371346+0000","last_active":"2023-11-08T19:26:12.152384+0000","last_peered":"2023-11-08T19:26:12.152384+0000","last_clean":"2023-11-08T19:26:12.152384+0000","last_became_active":"2023-11-08T19:25:46.289470+0000","last_became_peered":"2023-11-08T19:25:46.289470+0000","last_unstale":"2023-11-08T19:26:12.152384+0000","last_undegraded":"2023-11-08T19:26:12.152384+0000","last_fullsized":"2023-11-08T19:26:12.152384+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:25:34.010085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000371219,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.986209+0000","last_change":"2023-11-08T19:26:12.168668+0000","last_active":"2023-11-08T19:26:13.986209+0000","last_peered":"2023-11-08T19:26:13.986209+0000","last_clean":"2023-11-08T19:26:13.986209+0000","last_became_active":"2023-11-08T19:26:12.168375+0000","last_became_peered":"2023-11-08T19:26:12.168375+0000","last_unstale":"2023-11-08T19:26:13.986209+0000","last_undegraded":"2023-11-08T19:26:13.986209+0000","last_fullsized":"2023-11-08T19:26:13.986209+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:44:31.215560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"82'2","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.171731+0000","last_change":"2023-11-08T19:26:11.153931+0000","last_active":"2023-11-08T19:26:12.171731+0000","last_peered":"2023-11-08T19:26:12.171731+0000","last_clean":"2023-11-08T19:26:12.171731+0000","last_became_active":"2023-11-08T19:26:11.153610+0000","last_became_peered":"2023-11-08T19:26:11.153610+0000","last_unstale":"2023-11-08T19:26:12.171731+0000","last_undegraded":"2023-11-08T19:26:12.171731+0000","last_fullsized":"2023-11-08T19:26:12.171731+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:45:36.193005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.147833+0000","last_change":"2023-11-08T19:25:47.283242+0000","last_active":"2023-11-08T19:26:12.147833+0000","last_peered":"2023-11-08T19:26:12.147833+0000","last_clean":"2023-11-08T19:26:12.147833+0000","last_became_active":"2023-11-08T19:25:47.282922+0000","last_became_peered":"2023-11-08T19:25:47.282922+0000","last_unstale":"2023-11-08T19:26:12.147833+0000","last_undegraded":"2023-11-08T19:26:12.147833+0000","last_fullsized":"2023-11-08T19:26:12.147833+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:26:23.400596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.143648+0000","last_change":"2023-11-08T19:24:32.544333+0000","last_active":"2023-11-08T19:26:12.143648+0000","last_peered":"2023-11-08T19:26:12.143648+0000","last_clean":"2023-11-08T19:26:12.143648+0000","last_became_active":"2023-11-08T19:24:31.138598+0000","last_became_peered":"2023-11-08T19:24:31.138598+0000","last_unstale":"2023-11-08T19:26:12.143648+0000","last_undegraded":"2023-11-08T19:26:12.143648+0000","last_fullsized":"2023-11-08T19:26:12.143648+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:11.860580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015114824000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.147167+0000","last_change":"2023-11-08T19:25:48.374357+0000","last_active":"2023-11-08T19:26:12.147167+0000","last_peered":"2023-11-08T19:26:12.147167+0000","last_clean":"2023-11-08T19:26:12.147167+0000","last_became_active":"2023-11-08T19:25:46.279007+0000","last_became_peered":"2023-11-08T19:25:46.279007+0000","last_unstale":"2023-11-08T19:26:12.147167+0000","last_undegraded":"2023-11-08T19:26:12.147167+0000","last_fullsized":"2023-11-08T19:26:12.147167+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:59:30.845191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036813240000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.986293+0000","last_change":"2023-11-08T19:26:12.164599+0000","last_active":"2023-11-08T19:26:13.986293+0000","last_peered":"2023-11-08T19:26:13.986293+0000","last_clean":"2023-11-08T19:26:13.986293+0000","last_became_active":"2023-11-08T19:26:12.164316+0000","last_became_peered":"2023-11-08T19:26:12.164316+0000","last_unstale":"2023-11-08T19:26:13.986293+0000","last_undegraded":"2023-11-08T19:26:13.986293+0000","last_fullsized":"2023-11-08T19:26:13.986293+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:13:27.493317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.145403+0000","last_change":"2023-11-08T19:26:11.142150+0000","last_active":"2023-11-08T19:26:12.145403+0000","last_peered":"2023-11-08T19:26:12.145403+0000","last_clean":"2023-11-08T19:26:12.145403+0000","last_became_active":"2023-11-08T19:26:11.141861+0000","last_became_peered":"2023-11-08T19:26:11.141861+0000","last_unstale":"2023-11-08T19:26:12.145403+0000","last_undegraded":"2023-11-08T19:26:12.145403+0000","last_fullsized":"2023-11-08T19:26:12.145403+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:22:57.924067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.144135+0000","last_change":"2023-11-08T19:25:47.285093+0000","last_active":"2023-11-08T19:26:12.144135+0000","last_peered":"2023-11-08T19:26:12.144135+0000","last_clean":"2023-11-08T19:26:12.144135+0000","last_became_active":"2023-11-08T19:25:47.284796+0000","last_became_peered":"2023-11-08T19:25:47.284796+0000","last_unstale":"2023-11-08T19:26:12.144135+0000","last_undegraded":"2023-11-08T19:26:12.144135+0000","last_fullsized":"2023-11-08T19:26:12.144135+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:46:36.504650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.146743+0000","last_change":"2023-11-08T19:24:32.544285+0000","last_active":"2023-11-08T19:26:12.146743+0000","last_peered":"2023-11-08T19:26:12.146743+0000","last_clean":"2023-11-08T19:26:12.146743+0000","last_became_active":"2023-11-08T19:24:31.142028+0000","last_became_peered":"2023-11-08T19:24:31.142028+0000","last_unstale":"2023-11-08T19:26:12.146743+0000","last_undegraded":"2023-11-08T19:26:12.146743+0000","last_fullsized":"2023-11-08T19:26:12.146743+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:01:24.198196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067537399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.143487+0000","last_change":"2023-11-08T19:25:48.372192+0000","last_active":"2023-11-08T19:26:12.143487+0000","last_peered":"2023-11-08T19:26:12.143487+0000","last_clean":"2023-11-08T19:26:12.143487+0000","last_became_active":"2023-11-08T19:25:46.288739+0000","last_became_peered":"2023-11-08T19:25:46.288739+0000","last_unstale":"2023-11-08T19:26:12.143487+0000","last_undegraded":"2023-11-08T19:26:12.143487+0000","last_fullsized":"2023-11-08T19:26:12.143487+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:45:04.839053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015057530000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.985901+0000","last_change":"2023-11-08T19:26:12.164192+0000","last_active":"2023-11-08T19:26:13.985901+0000","last_peered":"2023-11-08T19:26:13.985901+0000","last_clean":"2023-11-08T19:26:13.985901+0000","last_became_active":"2023-11-08T19:26:12.163911+0000","last_became_peered":"2023-11-08T19:26:12.163911+0000","last_unstale":"2023-11-08T19:26:13.985901+0000","last_undegraded":"2023-11-08T19:26:13.985901+0000","last_fullsized":"2023-11-08T19:26:13.985901+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:39:04.758114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.144049+0000","last_change":"2023-11-08T19:26:11.142180+0000","last_active":"2023-11-08T19:26:12.144049+0000","last_peered":"2023-11-08T19:26:12.144049+0000","last_clean":"2023-11-08T19:26:12.144049+0000","last_became_active":"2023-11-08T19:26:11.141890+0000","last_became_peered":"2023-11-08T19:26:11.141890+0000","last_unstale":"2023-11-08T19:26:12.144049+0000","last_undegraded":"2023-11-08T19:26:12.144049+0000","last_fullsized":"2023-11-08T19:26:12.144049+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:43:12.543497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.149155+0000","last_change":"2023-11-08T19:25:47.287920+0000","last_active":"2023-11-08T19:26:12.149155+0000","last_peered":"2023-11-08T19:26:12.149155+0000","last_clean":"2023-11-08T19:26:12.149155+0000","last_became_active":"2023-11-08T19:25:47.287494+0000","last_became_peered":"2023-11-08T19:25:47.287494+0000","last_unstale":"2023-11-08T19:26:12.149155+0000","last_undegraded":"2023-11-08T19:26:12.149155+0000","last_fullsized":"2023-11-08T19:26:12.149155+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:42:18.942062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":52,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.147290+0000","last_change":"2023-11-08T19:24:32.142836+0000","last_active":"2023-11-08T19:26:12.147290+0000","last_peered":"2023-11-08T19:26:12.147290+0000","last_clean":"2023-11-08T19:26:12.147290+0000","last_became_active":"2023-11-08T19:24:31.141367+0000","last_became_peered":"2023-11-08T19:24:31.141367+0000","last_unstale":"2023-11-08T19:26:12.147290+0000","last_undegraded":"2023-11-08T19:26:12.147290+0000","last_fullsized":"2023-11-08T19:26:12.147290+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:39.214888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001335136,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.144241+0000","last_change":"2023-11-08T19:25:48.372718+0000","last_active":"2023-11-08T19:26:12.144241+0000","last_peered":"2023-11-08T19:26:12.144241+0000","last_clean":"2023-11-08T19:26:12.144241+0000","last_became_active":"2023-11-08T19:25:46.289283+0000","last_became_peered":"2023-11-08T19:25:46.289283+0000","last_unstale":"2023-11-08T19:26:12.144241+0000","last_undegraded":"2023-11-08T19:26:12.144241+0000","last_fullsized":"2023-11-08T19:26:12.144241+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:15:51.881891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001274049,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.657070+0000","last_change":"2023-11-08T19:26:12.169673+0000","last_active":"2023-11-08T19:26:13.657070+0000","last_peered":"2023-11-08T19:26:13.657070+0000","last_clean":"2023-11-08T19:26:13.657070+0000","last_became_active":"2023-11-08T19:26:12.169353+0000","last_became_peered":"2023-11-08T19:26:12.169353+0000","last_unstale":"2023-11-08T19:26:13.657070+0000","last_undegraded":"2023-11-08T19:26:13.657070+0000","last_fullsized":"2023-11-08T19:26:13.657070+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:40:48.988790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.139493+0000","last_change":"2023-11-08T19:26:11.144707+0000","last_active":"2023-11-08T19:26:12.139493+0000","last_peered":"2023-11-08T19:26:12.139493+0000","last_clean":"2023-11-08T19:26:12.139493+0000","last_became_active":"2023-11-08T19:26:11.144457+0000","last_became_peered":"2023-11-08T19:26:11.144457+0000","last_unstale":"2023-11-08T19:26:12.139493+0000","last_undegraded":"2023-11-08T19:26:12.139493+0000","last_fullsized":"2023-11-08T19:26:12.139493+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:19:16.063704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.146803+0000","last_change":"2023-11-08T19:25:47.285353+0000","last_active":"2023-11-08T19:26:12.146803+0000","last_peered":"2023-11-08T19:26:12.146803+0000","last_clean":"2023-11-08T19:26:12.146803+0000","last_became_active":"2023-11-08T19:25:47.285075+0000","last_became_peered":"2023-11-08T19:25:47.285075+0000","last_unstale":"2023-11-08T19:26:12.146803+0000","last_undegraded":"2023-11-08T19:26:12.146803+0000","last_fullsized":"2023-11-08T19:26:12.146803+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:20:50.791463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":57,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.146597+0000","last_change":"2023-11-08T19:24:32.139885+0000","last_active":"2023-11-08T19:26:12.146597+0000","last_peered":"2023-11-08T19:26:12.146597+0000","last_clean":"2023-11-08T19:26:12.146597+0000","last_became_active":"2023-11-08T19:24:31.145329+0000","last_became_peered":"2023-11-08T19:24:31.145329+0000","last_unstale":"2023-11-08T19:26:12.146597+0000","last_undegraded":"2023-11-08T19:26:12.146597+0000","last_fullsized":"2023-11-08T19:26:12.146597+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:25:18.356784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049012999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.148999+0000","last_change":"2023-11-08T19:25:48.373848+0000","last_active":"2023-11-08T19:26:12.148999+0000","last_peered":"2023-11-08T19:26:12.148999+0000","last_clean":"2023-11-08T19:26:12.148999+0000","last_became_active":"2023-11-08T19:25:46.282174+0000","last_became_peered":"2023-11-08T19:25:46.282174+0000","last_unstale":"2023-11-08T19:26:12.148999+0000","last_undegraded":"2023-11-08T19:26:12.148999+0000","last_fullsized":"2023-11-08T19:26:12.148999+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:00:06.938052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000727792,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.658017+0000","last_change":"2023-11-08T19:26:12.162347+0000","last_active":"2023-11-08T19:26:13.658017+0000","last_peered":"2023-11-08T19:26:13.658017+0000","last_clean":"2023-11-08T19:26:13.658017+0000","last_became_active":"2023-11-08T19:26:12.162060+0000","last_became_peered":"2023-11-08T19:26:12.162060+0000","last_unstale":"2023-11-08T19:26:13.658017+0000","last_undegraded":"2023-11-08T19:26:13.658017+0000","last_fullsized":"2023-11-08T19:26:13.658017+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:02:25.295497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"82'2","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.170953+0000","last_change":"2023-11-08T19:26:11.154004+0000","last_active":"2023-11-08T19:26:12.170953+0000","last_peered":"2023-11-08T19:26:12.170953+0000","last_clean":"2023-11-08T19:26:12.170953+0000","last_became_active":"2023-11-08T19:26:11.153740+0000","last_became_peered":"2023-11-08T19:26:11.153740+0000","last_unstale":"2023-11-08T19:26:12.170953+0000","last_undegraded":"2023-11-08T19:26:12.170953+0000","last_fullsized":"2023-11-08T19:26:12.170953+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:21:25.847129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.144117+0000","last_change":"2023-11-08T19:25:47.287677+0000","last_active":"2023-11-08T19:26:12.144117+0000","last_peered":"2023-11-08T19:26:12.144117+0000","last_clean":"2023-11-08T19:26:12.144117+0000","last_became_active":"2023-11-08T19:25:47.287419+0000","last_became_peered":"2023-11-08T19:25:47.287419+0000","last_unstale":"2023-11-08T19:26:12.144117+0000","last_undegraded":"2023-11-08T19:26:12.144117+0000","last_fullsized":"2023-11-08T19:26:12.144117+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:22:08.770702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":56,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.151081+0000","last_change":"2023-11-08T19:24:32.140880+0000","last_active":"2023-11-08T19:26:12.151081+0000","last_peered":"2023-11-08T19:26:12.151081+0000","last_clean":"2023-11-08T19:26:12.151081+0000","last_became_active":"2023-11-08T19:24:31.146063+0000","last_became_peered":"2023-11-08T19:24:31.146063+0000","last_unstale":"2023-11-08T19:26:12.151081+0000","last_undegraded":"2023-11-08T19:26:12.151081+0000","last_fullsized":"2023-11-08T19:26:12.151081+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:54:08.985813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089896300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.140240+0000","last_change":"2023-11-08T19:25:48.374690+0000","last_active":"2023-11-08T19:26:12.140240+0000","last_peered":"2023-11-08T19:26:12.140240+0000","last_clean":"2023-11-08T19:26:12.140240+0000","last_became_active":"2023-11-08T19:25:46.281986+0000","last_became_peered":"2023-11-08T19:25:46.281986+0000","last_unstale":"2023-11-08T19:26:12.140240+0000","last_undegraded":"2023-11-08T19:26:12.140240+0000","last_fullsized":"2023-11-08T19:26:12.140240+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:21:00.981136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003067771,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.986883+0000","last_change":"2023-11-08T19:26:12.159285+0000","last_active":"2023-11-08T19:26:13.986883+0000","last_peered":"2023-11-08T19:26:13.986883+0000","last_clean":"2023-11-08T19:26:13.986883+0000","last_became_active":"2023-11-08T19:26:12.158976+0000","last_became_peered":"2023-11-08T19:26:12.158976+0000","last_unstale":"2023-11-08T19:26:13.986883+0000","last_undegraded":"2023-11-08T19:26:13.986883+0000","last_fullsized":"2023-11-08T19:26:13.986883+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:45:30.706814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"82'1","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.167143+0000","last_change":"2023-11-08T19:26:11.142734+0000","last_active":"2023-11-08T19:26:12.167143+0000","last_peered":"2023-11-08T19:26:12.167143+0000","last_clean":"2023-11-08T19:26:12.167143+0000","last_became_active":"2023-11-08T19:26:11.142486+0000","last_became_peered":"2023-11-08T19:26:11.142486+0000","last_unstale":"2023-11-08T19:26:12.167143+0000","last_undegraded":"2023-11-08T19:26:12.167143+0000","last_fullsized":"2023-11-08T19:26:12.167143+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:01:57.994055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.152860+0000","last_change":"2023-11-08T19:25:47.287986+0000","last_active":"2023-11-08T19:26:12.152860+0000","last_peered":"2023-11-08T19:26:12.152860+0000","last_clean":"2023-11-08T19:26:12.152860+0000","last_became_active":"2023-11-08T19:25:47.287560+0000","last_became_peered":"2023-11-08T19:25:47.287560+0000","last_unstale":"2023-11-08T19:26:12.152860+0000","last_undegraded":"2023-11-08T19:26:12.152860+0000","last_fullsized":"2023-11-08T19:26:12.152860+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:35:31.433056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.140417+0000","last_change":"2023-11-08T19:24:32.530620+0000","last_active":"2023-11-08T19:26:12.140417+0000","last_peered":"2023-11-08T19:26:12.140417+0000","last_clean":"2023-11-08T19:26:12.140417+0000","last_became_active":"2023-11-08T19:24:31.144223+0000","last_became_peered":"2023-11-08T19:24:31.144223+0000","last_unstale":"2023-11-08T19:26:12.140417+0000","last_undegraded":"2023-11-08T19:26:12.140417+0000","last_fullsized":"2023-11-08T19:26:12.140417+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:01:25.647952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071879799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.151238+0000","last_change":"2023-11-08T19:25:48.285326+0000","last_active":"2023-11-08T19:26:12.151238+0000","last_peered":"2023-11-08T19:26:12.151238+0000","last_clean":"2023-11-08T19:26:12.151238+0000","last_became_active":"2023-11-08T19:25:46.278686+0000","last_became_peered":"2023-11-08T19:25:46.278686+0000","last_unstale":"2023-11-08T19:26:12.151238+0000","last_undegraded":"2023-11-08T19:26:12.151238+0000","last_fullsized":"2023-11-08T19:26:12.151238+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:25:34.010085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078409499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.159113+0000","last_change":"2023-11-08T19:26:12.163265+0000","last_active":"2023-11-08T19:26:13.159113+0000","last_peered":"2023-11-08T19:26:13.159113+0000","last_clean":"2023-11-08T19:26:13.159113+0000","last_became_active":"2023-11-08T19:26:12.162822+0000","last_became_peered":"2023-11-08T19:26:12.162822+0000","last_unstale":"2023-11-08T19:26:13.159113+0000","last_undegraded":"2023-11-08T19:26:13.159113+0000","last_fullsized":"2023-11-08T19:26:13.159113+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:45:22.870353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.140702+0000","last_change":"2023-11-08T19:26:11.145047+0000","last_active":"2023-11-08T19:26:12.140702+0000","last_peered":"2023-11-08T19:26:12.140702+0000","last_clean":"2023-11-08T19:26:12.140702+0000","last_became_active":"2023-11-08T19:26:11.144832+0000","last_became_peered":"2023-11-08T19:26:11.144832+0000","last_unstale":"2023-11-08T19:26:12.140702+0000","last_undegraded":"2023-11-08T19:26:12.140702+0000","last_fullsized":"2023-11-08T19:26:12.140702+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:10:53.155228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.150667+0000","last_change":"2023-11-08T19:25:47.289726+0000","last_active":"2023-11-08T19:26:12.150667+0000","last_peered":"2023-11-08T19:26:12.150667+0000","last_clean":"2023-11-08T19:26:12.150667+0000","last_became_active":"2023-11-08T19:25:47.289362+0000","last_became_peered":"2023-11-08T19:25:47.289362+0000","last_unstale":"2023-11-08T19:26:12.150667+0000","last_undegraded":"2023-11-08T19:26:12.150667+0000","last_fullsized":"2023-11-08T19:26:12.150667+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:38:55.785104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.152547+0000","last_change":"2023-11-08T19:24:32.147025+0000","last_active":"2023-11-08T19:26:12.152547+0000","last_peered":"2023-11-08T19:26:12.152547+0000","last_clean":"2023-11-08T19:26:12.152547+0000","last_became_active":"2023-11-08T19:24:31.147082+0000","last_became_peered":"2023-11-08T19:24:31.147082+0000","last_unstale":"2023-11-08T19:26:12.152547+0000","last_undegraded":"2023-11-08T19:26:12.152547+0000","last_fullsized":"2023-11-08T19:26:12.152547+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:02:27.987795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043701599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.142839+0000","last_change":"2023-11-08T19:25:48.374739+0000","last_active":"2023-11-08T19:26:12.142839+0000","last_peered":"2023-11-08T19:26:12.142839+0000","last_clean":"2023-11-08T19:26:12.142839+0000","last_became_active":"2023-11-08T19:25:46.282071+0000","last_became_peered":"2023-11-08T19:25:46.282071+0000","last_unstale":"2023-11-08T19:26:12.142839+0000","last_undegraded":"2023-11-08T19:26:12.142839+0000","last_fullsized":"2023-11-08T19:26:12.142839+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:42:47.677504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023654909999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.986581+0000","last_change":"2023-11-08T19:26:12.158425+0000","last_active":"2023-11-08T19:26:13.986581+0000","last_peered":"2023-11-08T19:26:13.986581+0000","last_clean":"2023-11-08T19:26:13.986581+0000","last_became_active":"2023-11-08T19:26:12.157214+0000","last_became_peered":"2023-11-08T19:26:12.157214+0000","last_unstale":"2023-11-08T19:26:13.986581+0000","last_undegraded":"2023-11-08T19:26:13.986581+0000","last_fullsized":"2023-11-08T19:26:13.986581+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:43:27.869664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.140269+0000","last_change":"2023-11-08T19:26:11.148145+0000","last_active":"2023-11-08T19:26:12.140269+0000","last_peered":"2023-11-08T19:26:12.140269+0000","last_clean":"2023-11-08T19:26:12.140269+0000","last_became_active":"2023-11-08T19:26:11.147879+0000","last_became_peered":"2023-11-08T19:26:11.147879+0000","last_unstale":"2023-11-08T19:26:12.140269+0000","last_undegraded":"2023-11-08T19:26:12.140269+0000","last_fullsized":"2023-11-08T19:26:12.140269+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:15:37.426431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.143690+0000","last_change":"2023-11-08T19:24:32.544063+0000","last_active":"2023-11-08T19:26:12.143690+0000","last_peered":"2023-11-08T19:26:12.143690+0000","last_clean":"2023-11-08T19:26:12.143690+0000","last_became_active":"2023-11-08T19:24:31.144795+0000","last_became_peered":"2023-11-08T19:24:31.144795+0000","last_unstale":"2023-11-08T19:26:12.143690+0000","last_undegraded":"2023-11-08T19:26:12.143690+0000","last_fullsized":"2023-11-08T19:26:12.143690+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:12:42.248307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01495431,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.150875+0000","last_change":"2023-11-08T19:25:48.283673+0000","last_active":"2023-11-08T19:26:12.150875+0000","last_peered":"2023-11-08T19:26:12.150875+0000","last_clean":"2023-11-08T19:26:12.150875+0000","last_became_active":"2023-11-08T19:25:46.285766+0000","last_became_peered":"2023-11-08T19:25:46.285766+0000","last_unstale":"2023-11-08T19:26:12.150875+0000","last_undegraded":"2023-11-08T19:26:12.150875+0000","last_fullsized":"2023-11-08T19:26:12.150875+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:46:35.498766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001756748,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.150819+0000","last_change":"2023-11-08T19:25:47.288301+0000","last_active":"2023-11-08T19:26:12.150819+0000","last_peered":"2023-11-08T19:26:12.150819+0000","last_clean":"2023-11-08T19:26:12.150819+0000","last_became_active":"2023-11-08T19:25:47.288027+0000","last_became_peered":"2023-11-08T19:25:47.288027+0000","last_unstale":"2023-11-08T19:26:12.150819+0000","last_undegraded":"2023-11-08T19:26:12.150819+0000","last_fullsized":"2023-11-08T19:26:12.150819+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:23:13.428596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.159134+0000","last_change":"2023-11-08T19:26:12.155673+0000","last_active":"2023-11-08T19:26:13.159134+0000","last_peered":"2023-11-08T19:26:13.159134+0000","last_clean":"2023-11-08T19:26:13.159134+0000","last_became_active":"2023-11-08T19:26:12.155391+0000","last_became_peered":"2023-11-08T19:26:12.155391+0000","last_unstale":"2023-11-08T19:26:13.159134+0000","last_undegraded":"2023-11-08T19:26:13.159134+0000","last_fullsized":"2023-11-08T19:26:13.159134+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:40:23.866099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.149079+0000","last_change":"2023-11-08T19:26:11.141886+0000","last_active":"2023-11-08T19:26:12.149079+0000","last_peered":"2023-11-08T19:26:12.149079+0000","last_clean":"2023-11-08T19:26:12.149079+0000","last_became_active":"2023-11-08T19:26:11.141614+0000","last_became_peered":"2023-11-08T19:26:11.141614+0000","last_unstale":"2023-11-08T19:26:12.149079+0000","last_undegraded":"2023-11-08T19:26:12.149079+0000","last_fullsized":"2023-11-08T19:26:12.149079+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:41:07.747649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.147796+0000","last_change":"2023-11-08T19:24:32.263810+0000","last_active":"2023-11-08T19:26:12.147796+0000","last_peered":"2023-11-08T19:26:12.147796+0000","last_clean":"2023-11-08T19:26:12.147796+0000","last_became_active":"2023-11-08T19:24:31.138814+0000","last_became_peered":"2023-11-08T19:24:31.138814+0000","last_unstale":"2023-11-08T19:26:12.147796+0000","last_undegraded":"2023-11-08T19:26:12.147796+0000","last_fullsized":"2023-11-08T19:26:12.147796+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:21:55.985548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048136000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.144753+0000","last_change":"2023-11-08T19:25:48.283572+0000","last_active":"2023-11-08T19:26:12.144753+0000","last_peered":"2023-11-08T19:26:12.144753+0000","last_clean":"2023-11-08T19:26:12.144753+0000","last_became_active":"2023-11-08T19:25:46.271936+0000","last_became_peered":"2023-11-08T19:25:46.271936+0000","last_unstale":"2023-11-08T19:26:12.144753+0000","last_undegraded":"2023-11-08T19:26:12.144753+0000","last_fullsized":"2023-11-08T19:26:12.144753+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:46:11.541748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00186835,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.150713+0000","last_change":"2023-11-08T19:25:47.282856+0000","last_active":"2023-11-08T19:26:12.150713+0000","last_peered":"2023-11-08T19:26:12.150713+0000","last_clean":"2023-11-08T19:26:12.150713+0000","last_became_active":"2023-11-08T19:25:47.282594+0000","last_became_peered":"2023-11-08T19:25:47.282594+0000","last_unstale":"2023-11-08T19:26:12.150713+0000","last_undegraded":"2023-11-08T19:26:12.150713+0000","last_fullsized":"2023-11-08T19:26:12.150713+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:14:12.111756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.986114+0000","last_change":"2023-11-08T19:26:12.157559+0000","last_active":"2023-11-08T19:26:13.986114+0000","last_peered":"2023-11-08T19:26:13.986114+0000","last_clean":"2023-11-08T19:26:13.986114+0000","last_became_active":"2023-11-08T19:26:12.157282+0000","last_became_peered":"2023-11-08T19:26:12.157282+0000","last_unstale":"2023-11-08T19:26:13.986114+0000","last_undegraded":"2023-11-08T19:26:13.986114+0000","last_fullsized":"2023-11-08T19:26:13.986114+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:51:15.384657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.145120+0000","last_change":"2023-11-08T19:26:11.147910+0000","last_active":"2023-11-08T19:26:12.145120+0000","last_peered":"2023-11-08T19:26:12.145120+0000","last_clean":"2023-11-08T19:26:12.145120+0000","last_became_active":"2023-11-08T19:26:11.146030+0000","last_became_peered":"2023-11-08T19:26:11.146030+0000","last_unstale":"2023-11-08T19:26:12.145120+0000","last_undegraded":"2023-11-08T19:26:12.145120+0000","last_fullsized":"2023-11-08T19:26:12.145120+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:04:10.612864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.147700+0000","last_change":"2023-11-08T19:24:32.333096+0000","last_active":"2023-11-08T19:26:12.147700+0000","last_peered":"2023-11-08T19:26:12.147700+0000","last_clean":"2023-11-08T19:26:12.147700+0000","last_became_active":"2023-11-08T19:24:31.142985+0000","last_became_peered":"2023-11-08T19:24:31.142985+0000","last_unstale":"2023-11-08T19:26:12.147700+0000","last_undegraded":"2023-11-08T19:26:12.147700+0000","last_fullsized":"2023-11-08T19:26:12.147700+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:36:33.274496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000386048,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.140443+0000","last_change":"2023-11-08T19:25:48.372963+0000","last_active":"2023-11-08T19:26:12.140443+0000","last_peered":"2023-11-08T19:26:12.140443+0000","last_clean":"2023-11-08T19:26:12.140443+0000","last_became_active":"2023-11-08T19:25:46.283263+0000","last_became_peered":"2023-11-08T19:25:46.283263+0000","last_unstale":"2023-11-08T19:26:12.140443+0000","last_undegraded":"2023-11-08T19:26:12.140443+0000","last_fullsized":"2023-11-08T19:26:12.140443+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:25:34.010085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019848779999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.145488+0000","last_change":"2023-11-08T19:25:47.284816+0000","last_active":"2023-11-08T19:26:12.145488+0000","last_peered":"2023-11-08T19:26:12.145488+0000","last_clean":"2023-11-08T19:26:12.145488+0000","last_became_active":"2023-11-08T19:25:47.284522+0000","last_became_peered":"2023-11-08T19:25:47.284522+0000","last_unstale":"2023-11-08T19:26:12.145488+0000","last_undegraded":"2023-11-08T19:26:12.145488+0000","last_fullsized":"2023-11-08T19:26:12.145488+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:39:28.223686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.656985+0000","last_change":"2023-11-08T19:26:12.164189+0000","last_active":"2023-11-08T19:26:13.656985+0000","last_peered":"2023-11-08T19:26:13.656985+0000","last_clean":"2023-11-08T19:26:13.656985+0000","last_became_active":"2023-11-08T19:26:12.163926+0000","last_became_peered":"2023-11-08T19:26:12.163926+0000","last_unstale":"2023-11-08T19:26:13.656985+0000","last_undegraded":"2023-11-08T19:26:13.656985+0000","last_fullsized":"2023-11-08T19:26:13.656985+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:32:26.592331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.147480+0000","last_change":"2023-11-08T19:26:11.154764+0000","last_active":"2023-11-08T19:26:12.147480+0000","last_peered":"2023-11-08T19:26:12.147480+0000","last_clean":"2023-11-08T19:26:12.147480+0000","last_became_active":"2023-11-08T19:26:11.153832+0000","last_became_peered":"2023-11-08T19:26:11.153832+0000","last_unstale":"2023-11-08T19:26:12.147480+0000","last_undegraded":"2023-11-08T19:26:12.147480+0000","last_fullsized":"2023-11-08T19:26:12.147480+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:20:18.393420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.139788+0000","last_change":"2023-11-08T19:24:32.530333+0000","last_active":"2023-11-08T19:26:12.139788+0000","last_peered":"2023-11-08T19:26:12.139788+0000","last_clean":"2023-11-08T19:26:12.139788+0000","last_became_active":"2023-11-08T19:24:31.144838+0000","last_became_peered":"2023-11-08T19:24:31.144838+0000","last_unstale":"2023-11-08T19:26:12.139788+0000","last_undegraded":"2023-11-08T19:26:12.139788+0000","last_fullsized":"2023-11-08T19:26:12.139788+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:39:48.473183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081588799999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.143634+0000","last_change":"2023-11-08T19:25:48.284699+0000","last_active":"2023-11-08T19:26:12.143634+0000","last_peered":"2023-11-08T19:26:12.143634+0000","last_clean":"2023-11-08T19:26:12.143634+0000","last_became_active":"2023-11-08T19:25:46.285588+0000","last_became_peered":"2023-11-08T19:25:46.285588+0000","last_unstale":"2023-11-08T19:26:12.143634+0000","last_undegraded":"2023-11-08T19:26:12.143634+0000","last_fullsized":"2023-11-08T19:26:12.143634+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:43:02.001903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023282350000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.140360+0000","last_change":"2023-11-08T19:25:47.283526+0000","last_active":"2023-11-08T19:26:12.140360+0000","last_peered":"2023-11-08T19:26:12.140360+0000","last_clean":"2023-11-08T19:26:12.140360+0000","last_became_active":"2023-11-08T19:25:47.283266+0000","last_became_peered":"2023-11-08T19:25:47.283266+0000","last_unstale":"2023-11-08T19:26:12.140360+0000","last_undegraded":"2023-11-08T19:26:12.140360+0000","last_fullsized":"2023-11-08T19:26:12.140360+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:35:31.433056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.987527+0000","last_change":"2023-11-08T19:26:12.161652+0000","last_active":"2023-11-08T19:26:13.987527+0000","last_peered":"2023-11-08T19:26:13.987527+0000","last_clean":"2023-11-08T19:26:13.987527+0000","last_became_active":"2023-11-08T19:26:12.161172+0000","last_became_peered":"2023-11-08T19:26:12.161172+0000","last_unstale":"2023-11-08T19:26:13.987527+0000","last_undegraded":"2023-11-08T19:26:13.987527+0000","last_fullsized":"2023-11-08T19:26:13.987527+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:35:07.237946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"82'2","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.172614+0000","last_change":"2023-11-08T19:26:11.142347+0000","last_active":"2023-11-08T19:26:12.172614+0000","last_peered":"2023-11-08T19:26:12.172614+0000","last_clean":"2023-11-08T19:26:12.172614+0000","last_became_active":"2023-11-08T19:26:11.141372+0000","last_became_peered":"2023-11-08T19:26:11.141372+0000","last_unstale":"2023-11-08T19:26:12.172614+0000","last_undegraded":"2023-11-08T19:26:12.172614+0000","last_fullsized":"2023-11-08T19:26:12.172614+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:39:35.055956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.149120+0000","last_change":"2023-11-08T19:24:32.333430+0000","last_active":"2023-11-08T19:26:12.149120+0000","last_peered":"2023-11-08T19:26:12.149120+0000","last_clean":"2023-11-08T19:26:12.149120+0000","last_became_active":"2023-11-08T19:24:31.141710+0000","last_became_peered":"2023-11-08T19:24:31.141710+0000","last_unstale":"2023-11-08T19:26:12.149120+0000","last_undegraded":"2023-11-08T19:26:12.149120+0000","last_fullsized":"2023-11-08T19:26:12.149120+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:32:51.214551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000430438,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.149808+0000","last_change":"2023-11-08T19:25:48.283855+0000","last_active":"2023-11-08T19:26:12.149808+0000","last_peered":"2023-11-08T19:26:12.149808+0000","last_clean":"2023-11-08T19:26:12.149808+0000","last_became_active":"2023-11-08T19:25:46.273336+0000","last_became_peered":"2023-11-08T19:25:46.273336+0000","last_unstale":"2023-11-08T19:26:12.149808+0000","last_undegraded":"2023-11-08T19:26:12.149808+0000","last_fullsized":"2023-11-08T19:26:12.149808+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:33:35.492889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092577200000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.152377+0000","last_change":"2023-11-08T19:25:47.282840+0000","last_active":"2023-11-08T19:26:12.152377+0000","last_peered":"2023-11-08T19:26:12.152377+0000","last_clean":"2023-11-08T19:26:12.152377+0000","last_became_active":"2023-11-08T19:25:47.282600+0000","last_became_peered":"2023-11-08T19:25:47.282600+0000","last_unstale":"2023-11-08T19:26:12.152377+0000","last_undegraded":"2023-11-08T19:26:12.152377+0000","last_fullsized":"2023-11-08T19:26:12.152377+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:53:37.482245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.873813+0000","last_change":"2023-11-08T19:26:12.159354+0000","last_active":"2023-11-08T19:26:13.873813+0000","last_peered":"2023-11-08T19:26:13.873813+0000","last_clean":"2023-11-08T19:26:13.873813+0000","last_became_active":"2023-11-08T19:26:12.158930+0000","last_became_peered":"2023-11-08T19:26:12.158930+0000","last_unstale":"2023-11-08T19:26:13.873813+0000","last_undegraded":"2023-11-08T19:26:13.873813+0000","last_fullsized":"2023-11-08T19:26:13.873813+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:13:16.251043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"83'1","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.987729+0000","last_change":"2023-11-08T19:26:11.156478+0000","last_active":"2023-11-08T19:26:13.987729+0000","last_peered":"2023-11-08T19:26:13.987729+0000","last_clean":"2023-11-08T19:26:13.987729+0000","last_became_active":"2023-11-08T19:26:11.156265+0000","last_became_peered":"2023-11-08T19:26:11.156265+0000","last_unstale":"2023-11-08T19:26:13.987729+0000","last_undegraded":"2023-11-08T19:26:13.987729+0000","last_fullsized":"2023-11-08T19:26:13.987729+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:10:49.908558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.144173+0000","last_change":"2023-11-08T19:25:47.285890+0000","last_active":"2023-11-08T19:26:12.144173+0000","last_peered":"2023-11-08T19:26:12.144173+0000","last_clean":"2023-11-08T19:26:12.144173+0000","last_became_active":"2023-11-08T19:25:47.285641+0000","last_became_peered":"2023-11-08T19:25:47.285641+0000","last_unstale":"2023-11-08T19:26:12.144173+0000","last_undegraded":"2023-11-08T19:26:12.144173+0000","last_fullsized":"2023-11-08T19:26:12.144173+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:27:18.335142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.140937+0000","last_change":"2023-11-08T19:24:32.530895+0000","last_active":"2023-11-08T19:26:12.140937+0000","last_peered":"2023-11-08T19:26:12.140937+0000","last_clean":"2023-11-08T19:26:12.140937+0000","last_became_active":"2023-11-08T19:24:31.146715+0000","last_became_peered":"2023-11-08T19:24:31.146715+0000","last_unstale":"2023-11-08T19:26:12.140937+0000","last_undegraded":"2023-11-08T19:26:12.140937+0000","last_fullsized":"2023-11-08T19:26:12.140937+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:39.214888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081671599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.152510+0000","last_change":"2023-11-08T19:25:48.284137+0000","last_active":"2023-11-08T19:26:12.152510+0000","last_peered":"2023-11-08T19:26:12.152510+0000","last_clean":"2023-11-08T19:26:12.152510+0000","last_became_active":"2023-11-08T19:25:46.285960+0000","last_became_peered":"2023-11-08T19:25:46.285960+0000","last_unstale":"2023-11-08T19:26:12.152510+0000","last_undegraded":"2023-11-08T19:26:12.152510+0000","last_fullsized":"2023-11-08T19:26:12.152510+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:26:01.141206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091649099999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.873609+0000","last_change":"2023-11-08T19:26:12.166199+0000","last_active":"2023-11-08T19:26:13.873609+0000","last_peered":"2023-11-08T19:26:13.873609+0000","last_clean":"2023-11-08T19:26:13.873609+0000","last_became_active":"2023-11-08T19:26:12.165918+0000","last_became_peered":"2023-11-08T19:26:12.165918+0000","last_unstale":"2023-11-08T19:26:13.873609+0000","last_undegraded":"2023-11-08T19:26:13.873609+0000","last_fullsized":"2023-11-08T19:26:13.873609+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:01:00.559509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.141178+0000","last_change":"2023-11-08T19:26:11.146187+0000","last_active":"2023-11-08T19:26:12.141178+0000","last_peered":"2023-11-08T19:26:12.141178+0000","last_clean":"2023-11-08T19:26:12.141178+0000","last_became_active":"2023-11-08T19:26:11.144173+0000","last_became_peered":"2023-11-08T19:26:11.144173+0000","last_unstale":"2023-11-08T19:26:12.141178+0000","last_undegraded":"2023-11-08T19:26:12.141178+0000","last_fullsized":"2023-11-08T19:26:12.141178+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:46:23.857534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.145115+0000","last_change":"2023-11-08T19:25:47.283642+0000","last_active":"2023-11-08T19:26:12.145115+0000","last_peered":"2023-11-08T19:26:12.145115+0000","last_clean":"2023-11-08T19:26:12.145115+0000","last_became_active":"2023-11-08T19:25:47.283360+0000","last_became_peered":"2023-11-08T19:25:47.283360+0000","last_unstale":"2023-11-08T19:26:12.145115+0000","last_undegraded":"2023-11-08T19:26:12.145115+0000","last_fullsized":"2023-11-08T19:26:12.145115+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:02:27.950152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":56,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.153444+0000","last_change":"2023-11-08T19:24:32.140167+0000","last_active":"2023-11-08T19:26:12.153444+0000","last_peered":"2023-11-08T19:26:12.153444+0000","last_clean":"2023-11-08T19:26:12.153444+0000","last_became_active":"2023-11-08T19:24:31.147181+0000","last_became_peered":"2023-11-08T19:24:31.147181+0000","last_unstale":"2023-11-08T19:26:12.153444+0000","last_undegraded":"2023-11-08T19:26:12.153444+0000","last_fullsized":"2023-11-08T19:26:12.153444+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:26.080042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057135200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.151890+0000","last_change":"2023-11-08T19:25:48.277705+0000","last_active":"2023-11-08T19:26:12.151890+0000","last_peered":"2023-11-08T19:26:12.151890+0000","last_clean":"2023-11-08T19:26:12.151890+0000","last_became_active":"2023-11-08T19:25:46.288848+0000","last_became_peered":"2023-11-08T19:25:46.288848+0000","last_unstale":"2023-11-08T19:26:12.151890+0000","last_undegraded":"2023-11-08T19:26:12.151890+0000","last_fullsized":"2023-11-08T19:26:12.151890+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:12:24.483185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097653099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.657628+0000","last_change":"2023-11-08T19:26:12.164642+0000","last_active":"2023-11-08T19:26:13.657628+0000","last_peered":"2023-11-08T19:26:13.657628+0000","last_clean":"2023-11-08T19:26:13.657628+0000","last_became_active":"2023-11-08T19:26:12.164321+0000","last_became_peered":"2023-11-08T19:26:12.164321+0000","last_unstale":"2023-11-08T19:26:13.657628+0000","last_undegraded":"2023-11-08T19:26:13.657628+0000","last_fullsized":"2023-11-08T19:26:13.657628+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:15:38.428199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.152199+0000","last_change":"2023-11-08T19:26:11.140101+0000","last_active":"2023-11-08T19:26:12.152199+0000","last_peered":"2023-11-08T19:26:12.152199+0000","last_clean":"2023-11-08T19:26:12.152199+0000","last_became_active":"2023-11-08T19:26:11.139640+0000","last_became_peered":"2023-11-08T19:26:11.139640+0000","last_unstale":"2023-11-08T19:26:12.152199+0000","last_undegraded":"2023-11-08T19:26:12.152199+0000","last_fullsized":"2023-11-08T19:26:12.152199+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:31:02.812211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.152208+0000","last_change":"2023-11-08T19:25:47.289456+0000","last_active":"2023-11-08T19:26:12.152208+0000","last_peered":"2023-11-08T19:26:12.152208+0000","last_clean":"2023-11-08T19:26:12.152208+0000","last_became_active":"2023-11-08T19:25:47.289177+0000","last_became_peered":"2023-11-08T19:25:47.289177+0000","last_unstale":"2023-11-08T19:26:12.152208+0000","last_undegraded":"2023-11-08T19:26:12.152208+0000","last_fullsized":"2023-11-08T19:26:12.152208+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:07:11.838364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":56,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.149680+0000","last_change":"2023-11-08T19:24:32.141188+0000","last_active":"2023-11-08T19:26:12.149680+0000","last_peered":"2023-11-08T19:26:12.149680+0000","last_clean":"2023-11-08T19:26:12.149680+0000","last_became_active":"2023-11-08T19:24:31.148857+0000","last_became_peered":"2023-11-08T19:24:31.148857+0000","last_unstale":"2023-11-08T19:26:12.149680+0000","last_undegraded":"2023-11-08T19:26:12.149680+0000","last_fullsized":"2023-11-08T19:26:12.149680+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:45:34.425432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065078599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.150615+0000","last_change":"2023-11-08T19:25:48.277423+0000","last_active":"2023-11-08T19:26:12.150615+0000","last_peered":"2023-11-08T19:26:12.150615+0000","last_clean":"2023-11-08T19:26:12.150615+0000","last_became_active":"2023-11-08T19:25:46.286211+0000","last_became_peered":"2023-11-08T19:25:46.286211+0000","last_unstale":"2023-11-08T19:26:12.150615+0000","last_undegraded":"2023-11-08T19:26:12.150615+0000","last_fullsized":"2023-11-08T19:26:12.150615+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:44:05.347800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073775700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.986914+0000","last_change":"2023-11-08T19:26:12.154888+0000","last_active":"2023-11-08T19:26:13.986914+0000","last_peered":"2023-11-08T19:26:13.986914+0000","last_clean":"2023-11-08T19:26:13.986914+0000","last_became_active":"2023-11-08T19:26:12.154581+0000","last_became_peered":"2023-11-08T19:26:12.154581+0000","last_unstale":"2023-11-08T19:26:13.986914+0000","last_undegraded":"2023-11-08T19:26:13.986914+0000","last_fullsized":"2023-11-08T19:26:13.986914+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:16:17.749651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"82'1","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.169022+0000","last_change":"2023-11-08T19:26:11.139671+0000","last_active":"2023-11-08T19:26:12.169022+0000","last_peered":"2023-11-08T19:26:12.169022+0000","last_clean":"2023-11-08T19:26:12.169022+0000","last_became_active":"2023-11-08T19:26:11.139289+0000","last_became_peered":"2023-11-08T19:26:11.139289+0000","last_unstale":"2023-11-08T19:26:12.169022+0000","last_undegraded":"2023-11-08T19:26:12.169022+0000","last_fullsized":"2023-11-08T19:26:12.169022+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:54:01.342354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.150500+0000","last_change":"2023-11-08T19:25:47.286020+0000","last_active":"2023-11-08T19:26:12.150500+0000","last_peered":"2023-11-08T19:26:12.150500+0000","last_clean":"2023-11-08T19:26:12.150500+0000","last_became_active":"2023-11-08T19:25:47.285728+0000","last_became_peered":"2023-11-08T19:25:47.285728+0000","last_unstale":"2023-11-08T19:26:12.150500+0000","last_undegraded":"2023-11-08T19:26:12.150500+0000","last_fullsized":"2023-11-08T19:26:12.150500+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:26:02.147090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":56,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.148926+0000","last_change":"2023-11-08T19:24:32.140832+0000","last_active":"2023-11-08T19:26:12.148926+0000","last_peered":"2023-11-08T19:26:12.148926+0000","last_clean":"2023-11-08T19:26:12.148926+0000","last_became_active":"2023-11-08T19:24:31.146557+0000","last_became_peered":"2023-11-08T19:24:31.146557+0000","last_unstale":"2023-11-08T19:26:12.148926+0000","last_undegraded":"2023-11-08T19:26:12.148926+0000","last_fullsized":"2023-11-08T19:26:12.148926+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:40:04.258107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099450100000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.139697+0000","last_change":"2023-11-08T19:25:48.372913+0000","last_active":"2023-11-08T19:26:12.139697+0000","last_peered":"2023-11-08T19:26:12.139697+0000","last_clean":"2023-11-08T19:26:12.139697+0000","last_became_active":"2023-11-08T19:25:46.281273+0000","last_became_peered":"2023-11-08T19:25:46.281273+0000","last_unstale":"2023-11-08T19:26:12.139697+0000","last_undegraded":"2023-11-08T19:26:12.139697+0000","last_fullsized":"2023-11-08T19:26:12.139697+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:07:10.832480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020904819999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.158343+0000","last_change":"2023-11-08T19:26:12.160942+0000","last_active":"2023-11-08T19:26:13.158343+0000","last_peered":"2023-11-08T19:26:13.158343+0000","last_clean":"2023-11-08T19:26:13.158343+0000","last_became_active":"2023-11-08T19:26:12.160665+0000","last_became_peered":"2023-11-08T19:26:12.160665+0000","last_unstale":"2023-11-08T19:26:13.158343+0000","last_undegraded":"2023-11-08T19:26:13.158343+0000","last_fullsized":"2023-11-08T19:26:13.158343+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:32:26.592331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"82'1","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.170028+0000","last_change":"2023-11-08T19:26:11.147874+0000","last_active":"2023-11-08T19:26:12.170028+0000","last_peered":"2023-11-08T19:26:12.170028+0000","last_clean":"2023-11-08T19:26:12.170028+0000","last_became_active":"2023-11-08T19:26:11.147602+0000","last_became_peered":"2023-11-08T19:26:11.147602+0000","last_unstale":"2023-11-08T19:26:12.170028+0000","last_undegraded":"2023-11-08T19:26:12.170028+0000","last_fullsized":"2023-11-08T19:26:12.170028+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:40:47.987023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.145198+0000","last_change":"2023-11-08T19:25:47.288256+0000","last_active":"2023-11-08T19:26:12.145198+0000","last_peered":"2023-11-08T19:26:12.145198+0000","last_clean":"2023-11-08T19:26:12.145198+0000","last_became_active":"2023-11-08T19:25:47.287905+0000","last_became_peered":"2023-11-08T19:25:47.287905+0000","last_unstale":"2023-11-08T19:26:12.145198+0000","last_undegraded":"2023-11-08T19:26:12.145198+0000","last_fullsized":"2023-11-08T19:26:12.145198+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:50:12.309248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.140571+0000","last_change":"2023-11-08T19:24:32.530378+0000","last_active":"2023-11-08T19:26:12.140571+0000","last_peered":"2023-11-08T19:26:12.140571+0000","last_clean":"2023-11-08T19:26:12.140571+0000","last_became_active":"2023-11-08T19:24:31.144341+0000","last_became_peered":"2023-11-08T19:24:31.144341+0000","last_unstale":"2023-11-08T19:26:12.140571+0000","last_undegraded":"2023-11-08T19:26:12.140571+0000","last_fullsized":"2023-11-08T19:26:12.140571+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:30:21.946303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058308299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.152007+0000","last_change":"2023-11-08T19:25:48.277150+0000","last_active":"2023-11-08T19:26:12.152007+0000","last_peered":"2023-11-08T19:26:12.152007+0000","last_clean":"2023-11-08T19:26:12.152007+0000","last_became_active":"2023-11-08T19:25:46.286933+0000","last_became_peered":"2023-11-08T19:25:46.286933+0000","last_unstale":"2023-11-08T19:26:12.152007+0000","last_undegraded":"2023-11-08T19:26:12.152007+0000","last_fullsized":"2023-11-08T19:26:12.152007+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:38:38.890354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080507500000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.156523+0000","last_change":"2023-11-08T19:26:12.154794+0000","last_active":"2023-11-08T19:26:13.156523+0000","last_peered":"2023-11-08T19:26:13.156523+0000","last_clean":"2023-11-08T19:26:13.156523+0000","last_became_active":"2023-11-08T19:26:12.154459+0000","last_became_peered":"2023-11-08T19:26:12.154459+0000","last_unstale":"2023-11-08T19:26:13.156523+0000","last_undegraded":"2023-11-08T19:26:13.156523+0000","last_fullsized":"2023-11-08T19:26:13.156523+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:32:15.350077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.150537+0000","last_change":"2023-11-08T19:26:11.140361+0000","last_active":"2023-11-08T19:26:12.150537+0000","last_peered":"2023-11-08T19:26:12.150537+0000","last_clean":"2023-11-08T19:26:12.150537+0000","last_became_active":"2023-11-08T19:26:11.140026+0000","last_became_peered":"2023-11-08T19:26:11.140026+0000","last_unstale":"2023-11-08T19:26:12.150537+0000","last_undegraded":"2023-11-08T19:26:12.150537+0000","last_fullsized":"2023-11-08T19:26:12.150537+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:29:49.218097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.148175+0000","last_change":"2023-11-08T19:25:47.282986+0000","last_active":"2023-11-08T19:26:12.148175+0000","last_peered":"2023-11-08T19:26:12.148175+0000","last_clean":"2023-11-08T19:26:12.148175+0000","last_became_active":"2023-11-08T19:25:47.282705+0000","last_became_peered":"2023-11-08T19:25:47.282705+0000","last_unstale":"2023-11-08T19:26:12.148175+0000","last_undegraded":"2023-11-08T19:26:12.148175+0000","last_fullsized":"2023-11-08T19:26:12.148175+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:34:17.838942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.143559+0000","last_change":"2023-11-08T19:24:32.544108+0000","last_active":"2023-11-08T19:26:12.143559+0000","last_peered":"2023-11-08T19:26:12.143559+0000","last_clean":"2023-11-08T19:26:12.143559+0000","last_became_active":"2023-11-08T19:24:31.143812+0000","last_became_peered":"2023-11-08T19:24:31.143812+0000","last_unstale":"2023-11-08T19:26:12.143559+0000","last_undegraded":"2023-11-08T19:26:12.143559+0000","last_fullsized":"2023-11-08T19:26:12.143559+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:27:59.135977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014956126,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.146870+0000","last_change":"2023-11-08T19:25:48.284435+0000","last_active":"2023-11-08T19:26:12.146870+0000","last_peered":"2023-11-08T19:26:12.146870+0000","last_clean":"2023-11-08T19:26:12.146870+0000","last_became_active":"2023-11-08T19:25:46.284288+0000","last_became_peered":"2023-11-08T19:25:46.284288+0000","last_unstale":"2023-11-08T19:26:12.146870+0000","last_undegraded":"2023-11-08T19:26:12.146870+0000","last_fullsized":"2023-11-08T19:26:12.146870+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:57:53.083448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001250894,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.157695+0000","last_change":"2023-11-08T19:26:12.159850+0000","last_active":"2023-11-08T19:26:13.157695+0000","last_peered":"2023-11-08T19:26:13.157695+0000","last_clean":"2023-11-08T19:26:13.157695+0000","last_became_active":"2023-11-08T19:26:12.159541+0000","last_became_peered":"2023-11-08T19:26:12.159541+0000","last_unstale":"2023-11-08T19:26:13.157695+0000","last_undegraded":"2023-11-08T19:26:13.157695+0000","last_fullsized":"2023-11-08T19:26:13.157695+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:39:36.057723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.148176+0000","last_change":"2023-11-08T19:26:11.142260+0000","last_active":"2023-11-08T19:26:12.148176+0000","last_peered":"2023-11-08T19:26:12.148176+0000","last_clean":"2023-11-08T19:26:12.148176+0000","last_became_active":"2023-11-08T19:26:11.141670+0000","last_became_peered":"2023-11-08T19:26:11.141670+0000","last_unstale":"2023-11-08T19:26:12.148176+0000","last_undegraded":"2023-11-08T19:26:12.148176+0000","last_fullsized":"2023-11-08T19:26:12.148176+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:34:00.358882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.145426+0000","last_change":"2023-11-08T19:25:47.282612+0000","last_active":"2023-11-08T19:26:12.145426+0000","last_peered":"2023-11-08T19:26:12.145426+0000","last_clean":"2023-11-08T19:26:12.145426+0000","last_became_active":"2023-11-08T19:25:47.282299+0000","last_became_peered":"2023-11-08T19:25:47.282299+0000","last_unstale":"2023-11-08T19:26:12.145426+0000","last_undegraded":"2023-11-08T19:26:12.145426+0000","last_fullsized":"2023-11-08T19:26:12.145426+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:43:18.319773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.151613+0000","last_change":"2023-11-08T19:24:32.146639+0000","last_active":"2023-11-08T19:26:12.151613+0000","last_peered":"2023-11-08T19:26:12.151613+0000","last_clean":"2023-11-08T19:26:12.151613+0000","last_became_active":"2023-11-08T19:24:31.147384+0000","last_became_peered":"2023-11-08T19:24:31.147384+0000","last_unstale":"2023-11-08T19:26:12.151613+0000","last_undegraded":"2023-11-08T19:26:12.151613+0000","last_fullsized":"2023-11-08T19:26:12.151613+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:30:21.946303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043834899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.143307+0000","last_change":"2023-11-08T19:25:48.283541+0000","last_active":"2023-11-08T19:26:12.143307+0000","last_peered":"2023-11-08T19:26:12.143307+0000","last_clean":"2023-11-08T19:26:12.143307+0000","last_became_active":"2023-11-08T19:25:46.285626+0000","last_became_peered":"2023-11-08T19:25:46.285626+0000","last_unstale":"2023-11-08T19:26:12.143307+0000","last_undegraded":"2023-11-08T19:26:12.143307+0000","last_fullsized":"2023-11-08T19:26:12.143307+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:48:17.033319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019032459999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.986916+0000","last_change":"2023-11-08T19:26:12.158334+0000","last_active":"2023-11-08T19:26:13.986916+0000","last_peered":"2023-11-08T19:26:13.986916+0000","last_clean":"2023-11-08T19:26:13.986916+0000","last_became_active":"2023-11-08T19:26:12.158068+0000","last_became_peered":"2023-11-08T19:26:12.158068+0000","last_unstale":"2023-11-08T19:26:13.986916+0000","last_undegraded":"2023-11-08T19:26:13.986916+0000","last_fullsized":"2023-11-08T19:26:13.986916+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:13:52.147524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"82'4","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.169346+0000","last_change":"2023-11-08T19:26:11.144711+0000","last_active":"2023-11-08T19:26:12.169346+0000","last_peered":"2023-11-08T19:26:12.169346+0000","last_clean":"2023-11-08T19:26:12.169346+0000","last_became_active":"2023-11-08T19:26:11.144408+0000","last_became_peered":"2023-11-08T19:26:11.144408+0000","last_unstale":"2023-11-08T19:26:12.169346+0000","last_undegraded":"2023-11-08T19:26:12.169346+0000","last_fullsized":"2023-11-08T19:26:12.169346+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:02:24.293730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.152283+0000","last_change":"2023-11-08T19:25:47.287878+0000","last_active":"2023-11-08T19:26:12.152283+0000","last_peered":"2023-11-08T19:26:12.152283+0000","last_clean":"2023-11-08T19:26:12.152283+0000","last_became_active":"2023-11-08T19:25:47.287617+0000","last_became_peered":"2023-11-08T19:25:47.287617+0000","last_unstale":"2023-11-08T19:26:12.152283+0000","last_undegraded":"2023-11-08T19:26:12.152283+0000","last_fullsized":"2023-11-08T19:26:12.152283+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:20:50.791463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":57,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.145356+0000","last_change":"2023-11-08T19:24:32.142376+0000","last_active":"2023-11-08T19:26:12.145356+0000","last_peered":"2023-11-08T19:26:12.145356+0000","last_clean":"2023-11-08T19:26:12.145356+0000","last_became_active":"2023-11-08T19:24:31.144614+0000","last_became_peered":"2023-11-08T19:24:31.144614+0000","last_unstale":"2023-11-08T19:26:12.145356+0000","last_undegraded":"2023-11-08T19:26:12.145356+0000","last_fullsized":"2023-11-08T19:26:12.145356+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:09:04.880374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050362200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.141313+0000","last_change":"2023-11-08T19:25:48.373636+0000","last_active":"2023-11-08T19:26:12.141313+0000","last_peered":"2023-11-08T19:26:12.141313+0000","last_clean":"2023-11-08T19:26:12.141313+0000","last_became_active":"2023-11-08T19:25:46.283803+0000","last_became_peered":"2023-11-08T19:25:46.283803+0000","last_unstale":"2023-11-08T19:26:12.141313+0000","last_undegraded":"2023-11-08T19:26:12.141313+0000","last_fullsized":"2023-11-08T19:26:12.141313+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:00:34.691748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002404855,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.157588+0000","last_change":"2023-11-08T19:26:12.162225+0000","last_active":"2023-11-08T19:26:13.157588+0000","last_peered":"2023-11-08T19:26:13.157588+0000","last_clean":"2023-11-08T19:26:13.157588+0000","last_became_active":"2023-11-08T19:26:12.161939+0000","last_became_peered":"2023-11-08T19:26:12.161939+0000","last_unstale":"2023-11-08T19:26:13.157588+0000","last_undegraded":"2023-11-08T19:26:13.157588+0000","last_fullsized":"2023-11-08T19:26:13.157588+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:07:41.962730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"82'1","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.171188+0000","last_change":"2023-11-08T19:26:11.143541+0000","last_active":"2023-11-08T19:26:12.171188+0000","last_peered":"2023-11-08T19:26:12.171188+0000","last_clean":"2023-11-08T19:26:12.171188+0000","last_became_active":"2023-11-08T19:26:11.143255+0000","last_became_peered":"2023-11-08T19:26:11.143255+0000","last_unstale":"2023-11-08T19:26:12.171188+0000","last_undegraded":"2023-11-08T19:26:12.171188+0000","last_fullsized":"2023-11-08T19:26:12.171188+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:19:00.174837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.152295+0000","last_change":"2023-11-08T19:25:47.287741+0000","last_active":"2023-11-08T19:26:12.152295+0000","last_peered":"2023-11-08T19:26:12.152295+0000","last_clean":"2023-11-08T19:26:12.152295+0000","last_became_active":"2023-11-08T19:25:47.287428+0000","last_became_peered":"2023-11-08T19:25:47.287428+0000","last_unstale":"2023-11-08T19:26:12.152295+0000","last_undegraded":"2023-11-08T19:26:12.152295+0000","last_fullsized":"2023-11-08T19:26:12.152295+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:38:55.785104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.153220+0000","last_change":"2023-11-08T19:24:32.147235+0000","last_active":"2023-11-08T19:26:12.153220+0000","last_peered":"2023-11-08T19:26:12.153220+0000","last_clean":"2023-11-08T19:26:12.153220+0000","last_became_active":"2023-11-08T19:24:31.146176+0000","last_became_peered":"2023-11-08T19:24:31.146176+0000","last_unstale":"2023-11-08T19:26:12.153220+0000","last_undegraded":"2023-11-08T19:26:12.153220+0000","last_fullsized":"2023-11-08T19:26:12.153220+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:39.214888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048481000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.140550+0000","last_change":"2023-11-08T19:25:48.373345+0000","last_active":"2023-11-08T19:26:12.140550+0000","last_peered":"2023-11-08T19:26:12.140550+0000","last_clean":"2023-11-08T19:26:12.140550+0000","last_became_active":"2023-11-08T19:25:46.282460+0000","last_became_peered":"2023-11-08T19:25:46.282460+0000","last_unstale":"2023-11-08T19:26:12.140550+0000","last_undegraded":"2023-11-08T19:26:12.140550+0000","last_fullsized":"2023-11-08T19:26:12.140550+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:25:30.927920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001972863,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.873462+0000","last_change":"2023-11-08T19:26:12.152774+0000","last_active":"2023-11-08T19:26:13.873462+0000","last_peered":"2023-11-08T19:26:13.873462+0000","last_clean":"2023-11-08T19:26:13.873462+0000","last_became_active":"2023-11-08T19:26:12.152514+0000","last_became_peered":"2023-11-08T19:26:12.152514+0000","last_unstale":"2023-11-08T19:26:13.873462+0000","last_undegraded":"2023-11-08T19:26:13.873462+0000","last_fullsized":"2023-11-08T19:26:13.873462+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:07:36.700241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"82'2","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.170776+0000","last_change":"2023-11-08T19:26:11.154554+0000","last_active":"2023-11-08T19:26:12.170776+0000","last_peered":"2023-11-08T19:26:12.170776+0000","last_clean":"2023-11-08T19:26:12.170776+0000","last_became_active":"2023-11-08T19:26:11.154211+0000","last_became_peered":"2023-11-08T19:26:11.154211+0000","last_unstale":"2023-11-08T19:26:12.170776+0000","last_undegraded":"2023-11-08T19:26:12.170776+0000","last_fullsized":"2023-11-08T19:26:12.170776+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:19:19.479272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.146079+0000","last_change":"2023-11-08T19:25:47.283708+0000","last_active":"2023-11-08T19:26:12.146079+0000","last_peered":"2023-11-08T19:26:12.146079+0000","last_clean":"2023-11-08T19:26:12.146079+0000","last_became_active":"2023-11-08T19:25:47.283433+0000","last_became_peered":"2023-11-08T19:25:47.283433+0000","last_unstale":"2023-11-08T19:26:12.146079+0000","last_undegraded":"2023-11-08T19:26:12.146079+0000","last_fullsized":"2023-11-08T19:26:12.146079+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:30:17.627967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.148980+0000","last_change":"2023-11-08T19:24:32.543880+0000","last_active":"2023-11-08T19:26:12.148980+0000","last_peered":"2023-11-08T19:26:12.148980+0000","last_clean":"2023-11-08T19:26:12.148980+0000","last_became_active":"2023-11-08T19:24:31.142052+0000","last_became_peered":"2023-11-08T19:24:31.142052+0000","last_unstale":"2023-11-08T19:26:12.148980+0000","last_undegraded":"2023-11-08T19:26:12.148980+0000","last_fullsized":"2023-11-08T19:26:12.148980+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:18:42.371676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014881058000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.150748+0000","last_change":"2023-11-08T19:25:48.284890+0000","last_active":"2023-11-08T19:26:12.150748+0000","last_peered":"2023-11-08T19:26:12.150748+0000","last_clean":"2023-11-08T19:26:12.150748+0000","last_became_active":"2023-11-08T19:25:46.279287+0000","last_became_peered":"2023-11-08T19:25:46.279287+0000","last_unstale":"2023-11-08T19:26:12.150748+0000","last_undegraded":"2023-11-08T19:26:12.150748+0000","last_fullsized":"2023-11-08T19:26:12.150748+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:35:30.427172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076856899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.158970+0000","last_change":"2023-11-08T19:26:12.159802+0000","last_active":"2023-11-08T19:26:13.158970+0000","last_peered":"2023-11-08T19:26:13.158970+0000","last_clean":"2023-11-08T19:26:13.158970+0000","last_became_active":"2023-11-08T19:26:12.159466+0000","last_became_peered":"2023-11-08T19:26:12.159466+0000","last_unstale":"2023-11-08T19:26:13.158970+0000","last_undegraded":"2023-11-08T19:26:13.158970+0000","last_fullsized":"2023-11-08T19:26:13.158970+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:50:02.076536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"82'2","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.172699+0000","last_change":"2023-11-08T19:26:11.144856+0000","last_active":"2023-11-08T19:26:12.172699+0000","last_peered":"2023-11-08T19:26:12.172699+0000","last_clean":"2023-11-08T19:26:12.172699+0000","last_became_active":"2023-11-08T19:26:11.144095+0000","last_became_peered":"2023-11-08T19:26:11.144095+0000","last_unstale":"2023-11-08T19:26:12.172699+0000","last_undegraded":"2023-11-08T19:26:12.172699+0000","last_fullsized":"2023-11-08T19:26:12.172699+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:45:21.868586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.150583+0000","last_change":"2023-11-08T19:25:47.285867+0000","last_active":"2023-11-08T19:26:12.150583+0000","last_peered":"2023-11-08T19:26:12.150583+0000","last_clean":"2023-11-08T19:26:12.150583+0000","last_became_active":"2023-11-08T19:25:47.285533+0000","last_became_peered":"2023-11-08T19:25:47.285533+0000","last_unstale":"2023-11-08T19:26:12.150583+0000","last_undegraded":"2023-11-08T19:26:12.150583+0000","last_fullsized":"2023-11-08T19:26:12.150583+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:26:59.852338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.152466+0000","last_change":"2023-11-08T19:24:32.147011+0000","last_active":"2023-11-08T19:26:12.152466+0000","last_peered":"2023-11-08T19:26:12.152466+0000","last_clean":"2023-11-08T19:26:12.152466+0000","last_became_active":"2023-11-08T19:24:31.148250+0000","last_became_peered":"2023-11-08T19:24:31.148250+0000","last_unstale":"2023-11-08T19:26:12.152466+0000","last_undegraded":"2023-11-08T19:26:12.152466+0000","last_fullsized":"2023-11-08T19:26:12.152466+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:01:25.647952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043061299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.146150+0000","last_change":"2023-11-08T19:25:48.284869+0000","last_active":"2023-11-08T19:26:12.146150+0000","last_peered":"2023-11-08T19:26:12.146150+0000","last_clean":"2023-11-08T19:26:12.146150+0000","last_became_active":"2023-11-08T19:25:46.285478+0000","last_became_peered":"2023-11-08T19:25:46.285478+0000","last_unstale":"2023-11-08T19:26:12.146150+0000","last_undegraded":"2023-11-08T19:26:12.146150+0000","last_fullsized":"2023-11-08T19:26:12.146150+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:49:51.368808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000376339,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.156597+0000","last_change":"2023-11-08T19:26:12.156142+0000","last_active":"2023-11-08T19:26:13.156597+0000","last_peered":"2023-11-08T19:26:13.156597+0000","last_clean":"2023-11-08T19:26:13.156597+0000","last_became_active":"2023-11-08T19:26:12.155835+0000","last_became_peered":"2023-11-08T19:26:12.155835+0000","last_unstale":"2023-11-08T19:26:13.156597+0000","last_undegraded":"2023-11-08T19:26:13.156597+0000","last_fullsized":"2023-11-08T19:26:13.156597+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:15:38.428199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"82'2","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.170920+0000","last_change":"2023-11-08T19:26:11.153715+0000","last_active":"2023-11-08T19:26:12.170920+0000","last_peered":"2023-11-08T19:26:12.170920+0000","last_clean":"2023-11-08T19:26:12.170920+0000","last_became_active":"2023-11-08T19:26:11.153440+0000","last_became_peered":"2023-11-08T19:26:11.153440+0000","last_unstale":"2023-11-08T19:26:12.170920+0000","last_undegraded":"2023-11-08T19:26:12.170920+0000","last_fullsized":"2023-11-08T19:26:12.170920+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:59:32.488426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.151931+0000","last_change":"2023-11-08T19:25:47.284429+0000","last_active":"2023-11-08T19:26:12.151931+0000","last_peered":"2023-11-08T19:26:12.151931+0000","last_clean":"2023-11-08T19:26:12.151931+0000","last_became_active":"2023-11-08T19:25:47.283990+0000","last_became_peered":"2023-11-08T19:25:47.283990+0000","last_unstale":"2023-11-08T19:26:12.151931+0000","last_undegraded":"2023-11-08T19:26:12.151931+0000","last_fullsized":"2023-11-08T19:26:12.151931+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:59:08.628317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":57,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.143878+0000","last_change":"2023-11-08T19:24:32.141190+0000","last_active":"2023-11-08T19:26:12.143878+0000","last_peered":"2023-11-08T19:26:12.143878+0000","last_clean":"2023-11-08T19:26:12.143878+0000","last_became_active":"2023-11-08T19:24:31.147651+0000","last_became_peered":"2023-11-08T19:24:31.147651+0000","last_unstale":"2023-11-08T19:26:12.143878+0000","last_undegraded":"2023-11-08T19:26:12.143878+0000","last_fullsized":"2023-11-08T19:26:12.143878+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:21:55.985548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043673300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.144271+0000","last_change":"2023-11-08T19:25:48.320707+0000","last_active":"2023-11-08T19:26:12.144271+0000","last_peered":"2023-11-08T19:26:12.144271+0000","last_clean":"2023-11-08T19:26:12.144271+0000","last_became_active":"2023-11-08T19:25:46.282307+0000","last_became_peered":"2023-11-08T19:25:46.282307+0000","last_unstale":"2023-11-08T19:26:12.144271+0000","last_undegraded":"2023-11-08T19:26:12.144271+0000","last_fullsized":"2023-11-08T19:26:12.144271+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:53:36.476361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047078400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.873411+0000","last_change":"2023-11-08T19:26:12.161696+0000","last_active":"2023-11-08T19:26:13.873411+0000","last_peered":"2023-11-08T19:26:13.873411+0000","last_clean":"2023-11-08T19:26:13.873411+0000","last_became_active":"2023-11-08T19:26:12.161192+0000","last_became_peered":"2023-11-08T19:26:12.161192+0000","last_unstale":"2023-11-08T19:26:13.873411+0000","last_undegraded":"2023-11-08T19:26:13.873411+0000","last_fullsized":"2023-11-08T19:26:13.873411+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:35:56.294932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.148857+0000","last_change":"2023-11-08T19:26:11.155098+0000","last_active":"2023-11-08T19:26:12.148857+0000","last_peered":"2023-11-08T19:26:12.148857+0000","last_clean":"2023-11-08T19:26:12.148857+0000","last_became_active":"2023-11-08T19:26:11.154795+0000","last_became_peered":"2023-11-08T19:26:11.154795+0000","last_unstale":"2023-11-08T19:26:12.148857+0000","last_undegraded":"2023-11-08T19:26:12.148857+0000","last_fullsized":"2023-11-08T19:26:12.148857+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:15:47.048155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.147301+0000","last_change":"2023-11-08T19:25:47.284227+0000","last_active":"2023-11-08T19:26:12.147301+0000","last_peered":"2023-11-08T19:26:12.147301+0000","last_clean":"2023-11-08T19:26:12.147301+0000","last_became_active":"2023-11-08T19:25:47.283927+0000","last_became_peered":"2023-11-08T19:25:47.283927+0000","last_unstale":"2023-11-08T19:26:12.147301+0000","last_undegraded":"2023-11-08T19:26:12.147301+0000","last_fullsized":"2023-11-08T19:26:12.147301+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:15:23.188047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.140489+0000","last_change":"2023-11-08T19:24:32.530168+0000","last_active":"2023-11-08T19:26:12.140489+0000","last_peered":"2023-11-08T19:26:12.140489+0000","last_clean":"2023-11-08T19:26:12.140489+0000","last_became_active":"2023-11-08T19:24:31.144329+0000","last_became_peered":"2023-11-08T19:24:31.144329+0000","last_unstale":"2023-11-08T19:26:12.140489+0000","last_undegraded":"2023-11-08T19:26:12.140489+0000","last_fullsized":"2023-11-08T19:26:12.140489+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:05:36.085920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043484799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.139649+0000","last_change":"2023-11-08T19:25:48.371291+0000","last_active":"2023-11-08T19:26:12.139649+0000","last_peered":"2023-11-08T19:26:12.139649+0000","last_clean":"2023-11-08T19:26:12.139649+0000","last_became_active":"2023-11-08T19:25:46.281425+0000","last_became_peered":"2023-11-08T19:25:46.281425+0000","last_unstale":"2023-11-08T19:26:12.139649+0000","last_undegraded":"2023-11-08T19:26:12.139649+0000","last_fullsized":"2023-11-08T19:26:12.139649+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:23:12.422712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00124314,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.158011+0000","last_change":"2023-11-08T19:26:12.160457+0000","last_active":"2023-11-08T19:26:13.158011+0000","last_peered":"2023-11-08T19:26:13.158011+0000","last_clean":"2023-11-08T19:26:13.158011+0000","last_became_active":"2023-11-08T19:26:12.160170+0000","last_became_peered":"2023-11-08T19:26:12.160170+0000","last_unstale":"2023-11-08T19:26:13.158011+0000","last_undegraded":"2023-11-08T19:26:13.158011+0000","last_fullsized":"2023-11-08T19:26:13.158011+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:45:30.706814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.146458+0000","last_change":"2023-11-08T19:26:11.142088+0000","last_active":"2023-11-08T19:26:12.146458+0000","last_peered":"2023-11-08T19:26:12.146458+0000","last_clean":"2023-11-08T19:26:12.146458+0000","last_became_active":"2023-11-08T19:26:11.141780+0000","last_became_peered":"2023-11-08T19:26:11.141780+0000","last_unstale":"2023-11-08T19:26:12.146458+0000","last_undegraded":"2023-11-08T19:26:12.146458+0000","last_fullsized":"2023-11-08T19:26:12.146458+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:43:12.543497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.140000+0000","last_change":"2023-11-08T19:25:47.281724+0000","last_active":"2023-11-08T19:26:12.140000+0000","last_peered":"2023-11-08T19:26:12.140000+0000","last_clean":"2023-11-08T19:26:12.140000+0000","last_became_active":"2023-11-08T19:25:47.281425+0000","last_became_peered":"2023-11-08T19:25:47.281425+0000","last_unstale":"2023-11-08T19:26:12.140000+0000","last_undegraded":"2023-11-08T19:26:12.140000+0000","last_fullsized":"2023-11-08T19:26:12.140000+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:38:55.785104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.139822+0000","last_change":"2023-11-08T19:24:32.529486+0000","last_active":"2023-11-08T19:26:12.139822+0000","last_peered":"2023-11-08T19:26:12.139822+0000","last_clean":"2023-11-08T19:26:12.139822+0000","last_became_active":"2023-11-08T19:24:31.146260+0000","last_became_peered":"2023-11-08T19:24:31.146260+0000","last_unstale":"2023-11-08T19:26:12.139822+0000","last_undegraded":"2023-11-08T19:26:12.139822+0000","last_fullsized":"2023-11-08T19:26:12.139822+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:45:34.425432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059842900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.147725+0000","last_change":"2023-11-08T19:25:48.277457+0000","last_active":"2023-11-08T19:26:12.147725+0000","last_peered":"2023-11-08T19:26:12.147725+0000","last_clean":"2023-11-08T19:26:12.147725+0000","last_became_active":"2023-11-08T19:25:46.286239+0000","last_became_peered":"2023-11-08T19:25:46.286239+0000","last_unstale":"2023-11-08T19:26:12.147725+0000","last_undegraded":"2023-11-08T19:26:12.147725+0000","last_fullsized":"2023-11-08T19:26:12.147725+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:09:43.662108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000722421,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.986000+0000","last_change":"2023-11-08T19:26:12.157608+0000","last_active":"2023-11-08T19:26:13.986000+0000","last_peered":"2023-11-08T19:26:13.986000+0000","last_clean":"2023-11-08T19:26:13.986000+0000","last_became_active":"2023-11-08T19:26:12.157315+0000","last_became_peered":"2023-11-08T19:26:12.157315+0000","last_unstale":"2023-11-08T19:26:13.986000+0000","last_undegraded":"2023-11-08T19:26:13.986000+0000","last_fullsized":"2023-11-08T19:26:13.986000+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:34:42.700818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"82'8","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.172411+0000","last_change":"2023-11-08T19:26:11.142254+0000","last_active":"2023-11-08T19:26:12.172411+0000","last_peered":"2023-11-08T19:26:12.172411+0000","last_clean":"2023-11-08T19:26:12.172411+0000","last_became_active":"2023-11-08T19:26:11.141995+0000","last_became_peered":"2023-11-08T19:26:11.141995+0000","last_unstale":"2023-11-08T19:26:12.172411+0000","last_undegraded":"2023-11-08T19:26:12.172411+0000","last_fullsized":"2023-11-08T19:26:12.172411+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:27:23.712447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.150529+0000","last_change":"2023-11-08T19:25:47.287874+0000","last_active":"2023-11-08T19:26:12.150529+0000","last_peered":"2023-11-08T19:26:12.150529+0000","last_clean":"2023-11-08T19:26:12.150529+0000","last_became_active":"2023-11-08T19:25:47.287456+0000","last_became_peered":"2023-11-08T19:25:47.287456+0000","last_unstale":"2023-11-08T19:26:12.150529+0000","last_undegraded":"2023-11-08T19:26:12.150529+0000","last_fullsized":"2023-11-08T19:26:12.150529+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:26:59.852338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":56,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.150793+0000","last_change":"2023-11-08T19:24:32.141131+0000","last_active":"2023-11-08T19:26:12.150793+0000","last_peered":"2023-11-08T19:26:12.150793+0000","last_clean":"2023-11-08T19:26:12.150793+0000","last_became_active":"2023-11-08T19:24:31.146154+0000","last_became_peered":"2023-11-08T19:24:31.146154+0000","last_unstale":"2023-11-08T19:26:12.150793+0000","last_undegraded":"2023-11-08T19:26:12.150793+0000","last_fullsized":"2023-11-08T19:26:12.150793+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:18:40.271560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082432800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.143725+0000","last_change":"2023-11-08T19:25:48.372729+0000","last_active":"2023-11-08T19:26:12.143725+0000","last_peered":"2023-11-08T19:26:12.143725+0000","last_clean":"2023-11-08T19:26:12.143725+0000","last_became_active":"2023-11-08T19:25:46.290114+0000","last_became_peered":"2023-11-08T19:25:46.290114+0000","last_unstale":"2023-11-08T19:26:12.143725+0000","last_undegraded":"2023-11-08T19:26:12.143725+0000","last_fullsized":"2023-11-08T19:26:12.143725+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:49:36.208776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061009499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.987745+0000","last_change":"2023-11-08T19:26:12.155778+0000","last_active":"2023-11-08T19:26:13.987745+0000","last_peered":"2023-11-08T19:26:13.987745+0000","last_clean":"2023-11-08T19:26:13.987745+0000","last_became_active":"2023-11-08T19:26:12.155497+0000","last_became_peered":"2023-11-08T19:26:12.155497+0000","last_unstale":"2023-11-08T19:26:13.987745+0000","last_undegraded":"2023-11-08T19:26:13.987745+0000","last_fullsized":"2023-11-08T19:26:13.987745+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:35:25.029412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.151807+0000","last_change":"2023-11-08T19:26:11.142065+0000","last_active":"2023-11-08T19:26:12.151807+0000","last_peered":"2023-11-08T19:26:12.151807+0000","last_clean":"2023-11-08T19:26:12.151807+0000","last_became_active":"2023-11-08T19:26:11.141797+0000","last_became_peered":"2023-11-08T19:26:11.141797+0000","last_unstale":"2023-11-08T19:26:12.151807+0000","last_undegraded":"2023-11-08T19:26:12.151807+0000","last_fullsized":"2023-11-08T19:26:12.151807+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:26:26.007199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.140329+0000","last_change":"2023-11-08T19:25:47.283046+0000","last_active":"2023-11-08T19:26:12.140329+0000","last_peered":"2023-11-08T19:26:12.140329+0000","last_clean":"2023-11-08T19:26:12.140329+0000","last_became_active":"2023-11-08T19:25:47.282763+0000","last_became_peered":"2023-11-08T19:25:47.282763+0000","last_unstale":"2023-11-08T19:26:12.140329+0000","last_undegraded":"2023-11-08T19:26:12.140329+0000","last_fullsized":"2023-11-08T19:26:12.140329+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:12:51.389167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.150698+0000","last_change":"2023-11-08T19:24:32.263963+0000","last_active":"2023-11-08T19:26:12.150698+0000","last_peered":"2023-11-08T19:26:12.150698+0000","last_clean":"2023-11-08T19:26:12.150698+0000","last_became_active":"2023-11-08T19:24:31.139062+0000","last_became_peered":"2023-11-08T19:24:31.139062+0000","last_unstale":"2023-11-08T19:26:12.150698+0000","last_undegraded":"2023-11-08T19:26:12.150698+0000","last_fullsized":"2023-11-08T19:26:12.150698+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:26.080042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033682599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.149588+0000","last_change":"2023-11-08T19:25:48.283302+0000","last_active":"2023-11-08T19:26:12.149588+0000","last_peered":"2023-11-08T19:26:12.149588+0000","last_clean":"2023-11-08T19:26:12.149588+0000","last_became_active":"2023-11-08T19:25:46.284287+0000","last_became_peered":"2023-11-08T19:25:46.284287+0000","last_unstale":"2023-11-08T19:26:12.149588+0000","last_undegraded":"2023-11-08T19:26:12.149588+0000","last_fullsized":"2023-11-08T19:26:12.149588+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:39:27.217802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097880800000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.158096+0000","last_change":"2023-11-08T19:26:12.160600+0000","last_active":"2023-11-08T19:26:13.158096+0000","last_peered":"2023-11-08T19:26:13.158096+0000","last_clean":"2023-11-08T19:26:13.158096+0000","last_became_active":"2023-11-08T19:26:12.160313+0000","last_became_peered":"2023-11-08T19:26:12.160313+0000","last_unstale":"2023-11-08T19:26:13.158096+0000","last_undegraded":"2023-11-08T19:26:13.158096+0000","last_fullsized":"2023-11-08T19:26:13.158096+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:50:37.171124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.145877+0000","last_change":"2023-11-08T19:26:11.155037+0000","last_active":"2023-11-08T19:26:12.145877+0000","last_peered":"2023-11-08T19:26:12.145877+0000","last_clean":"2023-11-08T19:26:12.145877+0000","last_became_active":"2023-11-08T19:26:11.154008+0000","last_became_peered":"2023-11-08T19:26:11.154008+0000","last_unstale":"2023-11-08T19:26:12.145877+0000","last_undegraded":"2023-11-08T19:26:12.145877+0000","last_fullsized":"2023-11-08T19:26:12.145877+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:32:25.590564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.144221+0000","last_change":"2023-11-08T19:25:47.286434+0000","last_active":"2023-11-08T19:26:12.144221+0000","last_peered":"2023-11-08T19:26:12.144221+0000","last_clean":"2023-11-08T19:26:12.144221+0000","last_became_active":"2023-11-08T19:25:47.286181+0000","last_became_peered":"2023-11-08T19:25:47.286181+0000","last_unstale":"2023-11-08T19:26:12.144221+0000","last_undegraded":"2023-11-08T19:26:12.144221+0000","last_fullsized":"2023-11-08T19:26:12.144221+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:13:27.285648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":56,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.151158+0000","last_change":"2023-11-08T19:24:32.140514+0000","last_active":"2023-11-08T19:26:12.151158+0000","last_peered":"2023-11-08T19:26:12.151158+0000","last_clean":"2023-11-08T19:26:12.151158+0000","last_became_active":"2023-11-08T19:24:31.146668+0000","last_became_peered":"2023-11-08T19:24:31.146668+0000","last_unstale":"2023-11-08T19:26:12.151158+0000","last_undegraded":"2023-11-08T19:26:12.151158+0000","last_fullsized":"2023-11-08T19:26:12.151158+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:31:24.539374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071576699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.148153+0000","last_change":"2023-11-08T19:25:48.320667+0000","last_active":"2023-11-08T19:26:12.148153+0000","last_peered":"2023-11-08T19:26:12.148153+0000","last_clean":"2023-11-08T19:26:12.148153+0000","last_became_active":"2023-11-08T19:25:46.290246+0000","last_became_peered":"2023-11-08T19:25:46.290246+0000","last_unstale":"2023-11-08T19:26:12.148153+0000","last_undegraded":"2023-11-08T19:26:12.148153+0000","last_fullsized":"2023-11-08T19:26:12.148153+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:33:35.492889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000423211,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.657296+0000","last_change":"2023-11-08T19:26:12.163283+0000","last_active":"2023-11-08T19:26:13.657296+0000","last_peered":"2023-11-08T19:26:13.657296+0000","last_clean":"2023-11-08T19:26:13.657296+0000","last_became_active":"2023-11-08T19:26:12.162991+0000","last_became_peered":"2023-11-08T19:26:12.162991+0000","last_unstale":"2023-11-08T19:26:13.657296+0000","last_undegraded":"2023-11-08T19:26:13.657296+0000","last_fullsized":"2023-11-08T19:26:13.657296+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:45:37.194772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"82'3","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.172151+0000","last_change":"2023-11-08T19:26:11.147387+0000","last_active":"2023-11-08T19:26:12.172151+0000","last_peered":"2023-11-08T19:26:12.172151+0000","last_clean":"2023-11-08T19:26:12.172151+0000","last_became_active":"2023-11-08T19:26:11.147105+0000","last_became_peered":"2023-11-08T19:26:11.147105+0000","last_unstale":"2023-11-08T19:26:12.172151+0000","last_undegraded":"2023-11-08T19:26:12.172151+0000","last_fullsized":"2023-11-08T19:26:12.172151+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:29:49.218097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.145844+0000","last_change":"2023-11-08T19:25:47.287717+0000","last_active":"2023-11-08T19:26:12.145844+0000","last_peered":"2023-11-08T19:26:12.145844+0000","last_clean":"2023-11-08T19:26:12.145844+0000","last_became_active":"2023-11-08T19:25:47.287412+0000","last_became_peered":"2023-11-08T19:25:47.287412+0000","last_unstale":"2023-11-08T19:26:12.145844+0000","last_undegraded":"2023-11-08T19:26:12.145844+0000","last_fullsized":"2023-11-08T19:26:12.145844+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:18:04.478139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":52,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.148235+0000","last_change":"2023-11-08T19:24:32.142892+0000","last_active":"2023-11-08T19:26:12.148235+0000","last_peered":"2023-11-08T19:26:12.148235+0000","last_clean":"2023-11-08T19:26:12.148235+0000","last_became_active":"2023-11-08T19:24:31.144912+0000","last_became_peered":"2023-11-08T19:24:31.144912+0000","last_unstale":"2023-11-08T19:26:12.148235+0000","last_undegraded":"2023-11-08T19:26:12.148235+0000","last_fullsized":"2023-11-08T19:26:12.148235+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:04:21.151484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056686900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.150892+0000","last_change":"2023-11-08T19:25:48.285205+0000","last_active":"2023-11-08T19:26:12.150892+0000","last_peered":"2023-11-08T19:26:12.150892+0000","last_clean":"2023-11-08T19:26:12.150892+0000","last_became_active":"2023-11-08T19:25:46.285848+0000","last_became_peered":"2023-11-08T19:25:46.285848+0000","last_unstale":"2023-11-08T19:26:12.150892+0000","last_undegraded":"2023-11-08T19:26:12.150892+0000","last_fullsized":"2023-11-08T19:26:12.150892+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:07:10.832480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089732199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-08T19:26:13.158884+0000","last_change":"2023-11-08T19:26:12.170669+0000","last_active":"2023-11-08T19:26:13.158884+0000","last_peered":"2023-11-08T19:26:13.158884+0000","last_clean":"2023-11-08T19:26:13.158884+0000","last_became_active":"2023-11-08T19:26:12.170345+0000","last_became_peered":"2023-11-08T19:26:12.170345+0000","last_unstale":"2023-11-08T19:26:13.158884+0000","last_undegraded":"2023-11-08T19:26:13.158884+0000","last_fullsized":"2023-11-08T19:26:13.158884+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:11.120100+0000","last_clean_scrub_stamp":"2023-11-08T19:26:11.120100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:32:15.350077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"82'6","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.174665+0000","last_change":"2023-11-08T19:26:11.142146+0000","last_active":"2023-11-08T19:26:12.174665+0000","last_peered":"2023-11-08T19:26:12.174665+0000","last_clean":"2023-11-08T19:26:12.174665+0000","last_became_active":"2023-11-08T19:26:11.141870+0000","last_became_peered":"2023-11-08T19:26:11.141870+0000","last_unstale":"2023-11-08T19:26:12.174665+0000","last_undegraded":"2023-11-08T19:26:12.174665+0000","last_fullsized":"2023-11-08T19:26:12.174665+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:10.118333+0000","last_clean_scrub_stamp":"2023-11-08T19:26:10.118333+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:00:56.276699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.146634+0000","last_change":"2023-11-08T19:25:47.280177+0000","last_active":"2023-11-08T19:26:12.146634+0000","last_peered":"2023-11-08T19:26:12.146634+0000","last_clean":"2023-11-08T19:26:12.146634+0000","last_became_active":"2023-11-08T19:25:47.279913+0000","last_became_peered":"2023-11-08T19:25:47.279913+0000","last_unstale":"2023-11-08T19:26:12.146634+0000","last_undegraded":"2023-11-08T19:26:12.146634+0000","last_fullsized":"2023-11-08T19:26:12.146634+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:26:02.147090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.147715+0000","last_change":"2023-11-08T19:24:32.263958+0000","last_active":"2023-11-08T19:26:12.147715+0000","last_peered":"2023-11-08T19:26:12.147715+0000","last_clean":"2023-11-08T19:26:12.147715+0000","last_became_active":"2023-11-08T19:24:31.149011+0000","last_became_peered":"2023-11-08T19:24:31.149011+0000","last_unstale":"2023-11-08T19:26:12.147715+0000","last_undegraded":"2023-11-08T19:26:12.147715+0000","last_fullsized":"2023-11-08T19:26:12.147715+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:09:04.880374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033496900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-08T19:26:12.152633+0000","last_change":"2023-11-08T19:25:48.285075+0000","last_active":"2023-11-08T19:26:12.152633+0000","last_peered":"2023-11-08T19:26:12.152633+0000","last_clean":"2023-11-08T19:26:12.152633+0000","last_became_active":"2023-11-08T19:25:46.272479+0000","last_became_peered":"2023-11-08T19:25:46.272479+0000","last_unstale":"2023-11-08T19:26:12.152633+0000","last_undegraded":"2023-11-08T19:26:12.152633+0000","last_fullsized":"2023-11-08T19:26:12.152633+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:23:12.422712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001158117,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574892,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28600,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343240,"statfs":{"total":96636764160,"available":96607477760,"internally_reserved":0,"allocated":1617920,"data_stored":1082797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55200000000000005,"15min":0.53800000000000003},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.41399999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.71299999999999997,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.65300000000000002}]},{"osd":1,"last update":"Wed Nov 8 19:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.54800000000000004,"15min":0.54700000000000004},"min":{"1min":0.40799999999999997,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.69499999999999995,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.53800000000000003,"15min":0.53200000000000003},"min":{"1min":0.40600000000000003,"5min":0.37,"15min":0.37},"max":{"1min":0.75900000000000001,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.61699999999999999}]},{"osd":2,"last update":"Wed Nov 8 19:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.51400000000000001,"15min":0.50800000000000001},"min":{"1min":0.42899999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.75800000000000001,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.54000000000000004,"15min":0.53600000000000003},"min":{"1min":0.379,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.77800000000000002,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.63400000000000001}]},{"osd":3,"last update":"Wed Nov 8 19:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.53600000000000003,"15min":0.53400000000000003},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.56899999999999995,"15min":0.55900000000000005},"min":{"1min":0.42399999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76100000000000001,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.67600000000000005}]},{"osd":4,"last update":"Wed Nov 8 19:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.496,"15min":0.48599999999999999},"min":{"1min":0.35999999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.51900000000000002,"15min":0.51800000000000002},"min":{"1min":0.378,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.71399999999999997,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.45300000000000001}]},{"osd":5,"last update":"Wed Nov 8 19:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.55900000000000005,"15min":0.54800000000000004},"min":{"1min":0.39200000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.76300000000000001,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.58199999999999996,"15min":0.57799999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.68700000000000006,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.51100000000000001}]},{"osd":6,"last update":"Wed Nov 8 19:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.45600000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.80400000000000005,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57299999999999995,"15min":0.56399999999999995},"min":{"1min":0.441,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.69199999999999995,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.495}]}]},{"osd":6,"up_from":13,"seq":55834574893,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28024,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343816,"statfs":{"total":96636764160,"available":96608067584,"internally_reserved":0,"allocated":1024000,"data_stored":492969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.57299999999999995,"15min":0.59699999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.69799999999999995,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.57299999999999995,"15min":0.59099999999999997},"min":{"1min":0.313,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.754,"5min":1.478,"15min":1.478},"last":0.64400000000000002}]},{"osd":1,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.59599999999999997,"15min":0.60599999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.77500000000000002,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.65200000000000002,"15min":0.66600000000000004},"min":{"1min":0.435,"5min":0.433,"15min":0.433},"max":{"1min":0.78700000000000003,"5min":1.649,"15min":1.649},"last":0.79100000000000004}]},{"osd":2,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.621,"15min":0.63200000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76400000000000001,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.73399999999999999}]},{"osd":3,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.60399999999999998,"15min":0.63},"min":{"1min":0.42299999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.747,"5min":1.766,"15min":1.766},"last":0.747},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.59499999999999997,"15min":0.61899999999999999},"min":{"1min":0.39300000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.82799999999999996,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":0.71499999999999997}]},{"osd":4,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53700000000000003,"15min":0.54200000000000004},"min":{"1min":0.36399999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57299999999999995,"15min":0.58099999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.81699999999999995,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.56299999999999994}]},{"osd":5,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.55500000000000005,"15min":0.56799999999999995},"min":{"1min":0.38800000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.73499999999999999,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.623,"15min":0.63600000000000001},"min":{"1min":0.41399999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.80200000000000005,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.495}]},{"osd":7,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.60599999999999998,"15min":0.61299999999999999},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.77700000000000002,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.63600000000000001,"15min":0.64600000000000002},"min":{"1min":0.44400000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.71599999999999997,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.61299999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574892,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343824,"statfs":{"total":96636764160,"available":96608075776,"internally_reserved":0,"allocated":1015808,"data_stored":492317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.35699999999999998,"15min":0.36299999999999999},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.51200000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.38900000000000001,"15min":0.41299999999999998},"min":{"1min":0.22900000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.51700000000000002,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":0.308}]},{"osd":2,"last update":"Wed Nov 8 19:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.33800000000000002,"15min":0.34499999999999997},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.53000000000000003,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.38100000000000001,"15min":0.39400000000000002},"min":{"1min":0.253,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.46400000000000002,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.36399999999999999}]},{"osd":3,"last update":"Wed Nov 8 19:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.40799999999999997,"15min":0.41699999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.432,"5min":1.24,"15min":1.24},"last":0.434},{"interface":"front","average":{"1min":0.371,"5min":0.438,"15min":0.46200000000000002},"min":{"1min":0.26100000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.47999999999999998,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.41699999999999998}]},{"osd":4,"last update":"Wed Nov 8 19:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.60599999999999998,"15min":0.61399999999999999},"min":{"1min":0.46500000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72499999999999998,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57599999999999996,"15min":0.56599999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.76200000000000001,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.40000000000000002}]},{"osd":5,"last update":"Wed Nov 8 19:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.56999999999999995,"15min":0.55800000000000005},"min":{"1min":0.41399999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.72799999999999998,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.60199999999999998,"15min":0.60699999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.68700000000000006,"5min":1.115,"15min":1.115},"last":0.50700000000000001}]},{"osd":6,"last update":"Wed Nov 8 19:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.63,"15min":0.63800000000000001},"min":{"1min":0.439,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.746,"5min":2.093,"15min":2.093},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.59899999999999998,"15min":0.60299999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.76100000000000001,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.621}]},{"osd":7,"last update":"Wed Nov 8 19:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.64700000000000002,"15min":0.67100000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.77600000000000002,"5min":1.591,"15min":1.591},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.66500000000000004,"15min":0.69199999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.70199999999999996,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.63500000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574892,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28596,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343244,"statfs":{"total":96636764160,"available":96607481856,"internally_reserved":0,"allocated":1613824,"data_stored":1083267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:26:00 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.879,"15min":1.1180000000000001},"min":{"1min":0.23799999999999999,"5min":0.192,"15min":0.192},"max":{"1min":0.60699999999999998,"5min":19.295999999999999,"15min":19.295999999999999},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.379,"5min":0.81999999999999995,"15min":1.024},"min":{"1min":0.24299999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.56000000000000005,"5min":17.204000000000001,"15min":17.204000000000001},"last":0.374}]},{"osd":2,"last update":"Wed Nov 8 19:26:00 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.54200000000000004,"15min":0.61799999999999999},"min":{"1min":0.28299999999999997,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.54700000000000004,"5min":6.524,"15min":6.524},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.85399999999999998,"15min":1.0640000000000001},"min":{"1min":0.29499999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.60699999999999998,"5min":17.175000000000001,"15min":17.175000000000001},"last":0.34300000000000003}]},{"osd":3,"last update":"Wed Nov 8 19:26:00 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.746,"15min":0.91000000000000003},"min":{"1min":0.27100000000000002,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.55800000000000005,"5min":14.324,"15min":14.324},"last":0.318},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.40799999999999997,"15min":0.40400000000000003},"min":{"1min":0.34699999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.39000000000000001}]},{"osd":4,"last update":"Wed Nov 8 19:26:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":1.028,"15min":1.212},"min":{"1min":0.52000000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.98999999999999999,"5min":17.056000000000001,"15min":17.056000000000001},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.70699999999999996,"15min":0.745},"min":{"1min":0.49099999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.82299999999999995,"5min":5.0289999999999999,"15min":5.0289999999999999},"last":0.55100000000000005}]},{"osd":5,"last update":"Wed Nov 8 19:26:00 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.69999999999999996,"15min":0.746},"min":{"1min":0.53400000000000003,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.85099999999999998,"5min":5.0590000000000002,"15min":5.0590000000000002},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.58399999999999996,"15min":0.56999999999999995},"min":{"1min":0.47199999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.433}]},{"osd":6,"last update":"Wed Nov 8 19:26:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.61299999999999999,"15min":0.60799999999999998},"min":{"1min":0.505,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":1.0649999999999999,"15min":1.2589999999999999},"min":{"1min":0.50800000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.0389999999999999,"5min":17.111999999999998,"15min":17.111999999999998},"last":0.56499999999999995}]},{"osd":7,"last update":"Wed Nov 8 19:26:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":1.0820000000000001,"15min":1.274},"min":{"1min":0.48099999999999998,"5min":0.376,"15min":0.376},"max":{"1min":1.0760000000000001,"5min":17.146000000000001,"15min":17.146000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.71099999999999997,"15min":0.75700000000000001},"min":{"1min":0.47099999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.91700000000000004,"5min":4.9829999999999997,"15min":4.9829999999999997},"last":0.57499999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574892,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":1019904,"data_stored":492351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.433,"15min":0.47499999999999998},"min":{"1min":0.23300000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.61299999999999999,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.46200000000000002,"15min":0.50800000000000001},"min":{"1min":0.23999999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.65100000000000002,"5min":3.4369999999999998,"15min":3.4369999999999998},"last":0.25600000000000001}]},{"osd":1,"last update":"Wed Nov 8 19:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.49099999999999999,"15min":0.54900000000000004},"min":{"1min":0.27000000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.48399999999999999,"5min":4.0679999999999996,"15min":4.0679999999999996},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.54400000000000004,"15min":0.59599999999999997},"min":{"1min":0.32300000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.58599999999999997,"5min":4.3499999999999996,"15min":4.3499999999999996},"last":0.35999999999999999}]},{"osd":3,"last update":"Wed Nov 8 19:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.495,"15min":0.53700000000000003},"min":{"1min":0.27800000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.47099999999999997,"5min":3.8580000000000001,"15min":3.8580000000000001},"last":0.313},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.46300000000000002,"15min":0.51200000000000001},"min":{"1min":0.29599999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.55700000000000005,"5min":3.476,"15min":3.476},"last":0.32900000000000001}]},{"osd":4,"last update":"Wed Nov 8 19:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.68799999999999994,"15min":0.71799999999999997},"min":{"1min":0.44,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.98799999999999999,"5min":4.0090000000000003,"15min":4.0090000000000003},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.68899999999999995,"15min":0.73399999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.69099999999999995,"5min":4.1040000000000001,"15min":4.1040000000000001},"last":0.51900000000000002}]},{"osd":5,"last update":"Wed Nov 8 19:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.69299999999999995,"15min":0.74299999999999999},"min":{"1min":0.47999999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.874,"5min":4.0869999999999997,"15min":4.0869999999999997},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.69599999999999995,"15min":0.746},"min":{"1min":0.435,"5min":0.433,"15min":0.433},"max":{"1min":0.78100000000000003,"5min":3.843,"15min":3.843},"last":0.5}]},{"osd":6,"last update":"Wed Nov 8 19:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.70799999999999996,"15min":0.75900000000000001},"min":{"1min":0.45300000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.72699999999999998,"5min":4.1399999999999997,"15min":4.1399999999999997},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.68799999999999994,"15min":0.73399999999999999},"min":{"1min":0.49199999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.81499999999999995,"5min":4.0499999999999998,"15min":4.0499999999999998},"last":0.46000000000000002}]},{"osd":7,"last update":"Wed Nov 8 19:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.72799999999999998,"15min":0.76800000000000002},"min":{"1min":0.48799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.754,"5min":4.157,"15min":4.157},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.754,"15min":0.80000000000000004},"min":{"1min":0.505,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.93000000000000005,"5min":4.1710000000000003,"15min":4.1710000000000003},"last":0.51000000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574892,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28032,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343808,"statfs":{"total":96636764160,"available":96608059392,"internally_reserved":0,"allocated":1032192,"data_stored":493951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.38100000000000001,"15min":0.38500000000000001},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.64600000000000002,"5min":1.458,"15min":1.458},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.372,"5min":0.38900000000000001,"15min":0.39800000000000002},"min":{"1min":0.29499999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.53400000000000003,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.32000000000000001}]},{"osd":1,"last update":"Wed Nov 8 19:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.40500000000000003,"15min":0.41099999999999998},"min":{"1min":0.29599999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.61199999999999999,"5min":1.512,"15min":1.512},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.435,"15min":0.44700000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.59999999999999998,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.29199999999999998}]},{"osd":2,"last update":"Wed Nov 8 19:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.371,"15min":0.376},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.54800000000000004,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.41899999999999998,"15min":0.42699999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.60899999999999999,"5min":1.536,"15min":1.536},"last":0.36799999999999999}]},{"osd":4,"last update":"Wed Nov 8 19:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.60799999999999998,"15min":0.62},"min":{"1min":0.44900000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.77000000000000002,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.61299999999999999,"15min":0.61099999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.80200000000000005,"5min":1.153,"15min":1.153},"last":0.52700000000000002}]},{"osd":5,"last update":"Wed Nov 8 19:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.58899999999999997,"15min":0.59099999999999997},"min":{"1min":0.42399999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.69599999999999995,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.58899999999999997,"15min":0.60299999999999998},"min":{"1min":0.39300000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.73699999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.46500000000000002}]},{"osd":6,"last update":"Wed Nov 8 19:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57399999999999995,"15min":0.57999999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78500000000000003,"5min":1.113,"15min":1.113},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60799999999999998,"15min":0.61199999999999999},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72299999999999998,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.48199999999999998}]},{"osd":7,"last update":"Wed Nov 8 19:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.63500000000000001,"15min":0.64700000000000002},"min":{"1min":0.433,"5min":0.432,"15min":0.432},"max":{"1min":0.73999999999999999,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.62,"15min":0.61799999999999999},"min":{"1min":0.46300000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.754,"5min":1.179,"15min":1.179},"last":0.60099999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574892,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343804,"statfs":{"total":96636764160,"available":96608055296,"internally_reserved":0,"allocated":1036288,"data_stored":494053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:25:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.54500000000000004,"15min":0.53800000000000003},"min":{"1min":0.36799999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.80100000000000005,"5min":1.399,"15min":1.399},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58499999999999996,"15min":0.59499999999999997},"min":{"1min":0.44400000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73499999999999999,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.63500000000000001}]},{"osd":1,"last update":"Wed Nov 8 19:25:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.51400000000000001,"15min":0.51100000000000001},"min":{"1min":0.42199999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.502,"15min":0.497},"min":{"1min":0.40999999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.61799999999999999}]},{"osd":2,"last update":"Wed Nov 8 19:25:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.61899999999999999,"15min":0.63500000000000001},"min":{"1min":0.38200000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.80800000000000005,"5min":2.8490000000000002,"15min":2.8490000000000002},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.53800000000000003,"15min":0.52400000000000002},"min":{"1min":0.40799999999999997,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.71799999999999997,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.47199999999999998}]},{"osd":3,"last update":"Wed Nov 8 19:25:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57799999999999996,"15min":0.56599999999999995},"min":{"1min":0.47099999999999997,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.75700000000000001,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.70099999999999996,"15min":0.72399999999999998},"min":{"1min":0.48299999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.83199999999999996,"5min":3.4849999999999999,"15min":3.4849999999999999},"last":0.66600000000000004}]},{"osd":5,"last update":"Wed Nov 8 19:25:59 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.51800000000000002,"15min":0.52000000000000002},"min":{"1min":0.38,"5min":0.313,"15min":0.313},"max":{"1min":0.67200000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.56899999999999995,"15min":0.56100000000000005},"min":{"1min":0.39700000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.79100000000000004,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.65000000000000002}]},{"osd":6,"last update":"Wed Nov 8 19:25:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.67300000000000004,"15min":0.71499999999999997},"min":{"1min":0.38,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.71599999999999997,"5min":4.1529999999999996,"15min":4.1529999999999996},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.624,"5min":0.61599999999999999,"15min":0.61399999999999999},"min":{"1min":0.41699999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.73999999999999999,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.59999999999999998}]},{"osd":7,"last update":"Wed Nov 8 19:25:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57399999999999995,"15min":0.57199999999999995},"min":{"1min":0.47399999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.69999999999999996,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.80200000000000005,"15min":0.85199999999999998},"min":{"1min":0.52700000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.83899999999999997,"5min":5.5359999999999996,"15min":5.5359999999999996},"last":0.68700000000000006}]}]},{"osd":5,"up_from":13,"seq":55834574892,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":1019904,"data_stored":492387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53700000000000003,"15min":0.54700000000000004},"min":{"1min":0.40600000000000003,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.63800000000000001,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.52500000000000002,"15min":0.51900000000000002},"min":{"1min":0.32800000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.68799999999999994,"5min":0.878,"15min":0.878},"last":0.52200000000000002}]},{"osd":1,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55300000000000005,"15min":0.54700000000000004},"min":{"1min":0.47199999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.68200000000000005,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.59299999999999997,"15min":0.60699999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.73899999999999999,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":0.58699999999999997}]},{"osd":2,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.34699999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.65300000000000002,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.53600000000000003,"15min":0.53000000000000003},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.70699999999999996,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.68999999999999995}]},{"osd":3,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.41299999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71799999999999997,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57699999999999996,"15min":0.57299999999999995},"min":{"1min":0.42199999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.73599999999999999,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.63100000000000001}]},{"osd":4,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.57499999999999996,"15min":0.59899999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.748,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.63700000000000001,"15min":0.63500000000000001},"min":{"1min":0.46500000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.77300000000000002,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.73199999999999998}]},{"osd":6,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.57899999999999996,"15min":0.57799999999999996},"min":{"1min":0.38200000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.73599999999999999,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.63800000000000001,"15min":0.66600000000000004},"min":{"1min":0.41799999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.80500000000000005,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":0.67800000000000005}]},{"osd":7,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.623,"15min":0.629},"min":{"1min":0.42499999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.82799999999999996,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.64200000000000002,"15min":0.64800000000000002},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.80700000000000005,"5min":0.873,"15min":0.873},"last":0.74399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:26:21.318 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-08T19:26:21.319 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-08T19:26:21.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.447+0000 7ff60a53c700 1 Processor -- start 2023-11-08T19:26:21.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.447+0000 7ff60a53c700 1 -- start start 2023-11-08T19:26:21.451 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.448+0000 7ff60a53c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff6040cad20 0x7ff60406ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:21.451 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.448+0000 7ff60a53c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff60406b0c0 0x7ff6040cc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:21.451 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.448+0000 7ff60a53c700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff60415dfe0 con 0x7ff60415dc00 2023-11-08T19:26:21.451 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.448+0000 7ff60a53c700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6040cbe60 con 0x7ff60406b0c0 2023-11-08T19:26:21.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.448+0000 7ff60a53c700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff60406b570 con 0x7ff6040cad20 2023-11-08T19:26:21.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.448+0000 7ff608ad9700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff60406b0c0 0x7ff6040cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:21.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.448+0000 7ff608ad9700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff60406b0c0 0x7ff6040cc950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42550/0 (socket says 172.21.15.149:42550) 2023-11-08T19:26:21.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.448+0000 7ff608ad9700 1 -- 172.21.15.149:0/148386753 learned_addr learned my addr 172.21.15.149:0/148386753 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:21.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.448+0000 7ff608ad9700 1 -- 172.21.15.149:0/148386753 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff6040cad20 msgr2=0x7ff60406ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:21.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.448+0000 7ff608ad9700 1 --2- 172.21.15.149:0/148386753 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff6040cad20 0x7ff60406ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:21.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.448+0000 7ff608ad9700 1 -- 172.21.15.149:0/148386753 >> v1:172.21.15.160:6789/0 conn(0x7ff60415dc00 legacy=0x7ff6040b27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:21.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.448+0000 7ff608ad9700 1 -- 172.21.15.149:0/148386753 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6040cb1e0 con 0x7ff60406b0c0 2023-11-08T19:26:21.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.448+0000 7ff608ad9700 1 --2- 172.21.15.149:0/148386753 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff60406b0c0 0x7ff6040cc950 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc009e50 tx=0x7ff5fc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d759993799511ded server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:21.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.449+0000 7ff602ffd700 1 -- 172.21.15.149:0/148386753 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc00e070 con 0x7ff60406b0c0 2023-11-08T19:26:21.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.449+0000 7ff602ffd700 1 -- 172.21.15.149:0/148386753 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5fc003a20 con 0x7ff60406b0c0 2023-11-08T19:26:21.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.449+0000 7ff602ffd700 1 -- 172.21.15.149:0/148386753 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc003dd0 con 0x7ff60406b0c0 2023-11-08T19:26:21.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.449+0000 7ff60a53c700 1 -- 172.21.15.149:0/148386753 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff60406b0c0 msgr2=0x7ff6040cc950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:21.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.449+0000 7ff60a53c700 1 --2- 172.21.15.149:0/148386753 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff60406b0c0 0x7ff6040cc950 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc009e50 tx=0x7ff5fc00b330 comp rx=0 tx=0).stop 2023-11-08T19:26:21.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.449+0000 7ff60a53c700 1 -- 172.21.15.149:0/148386753 shutdown_connections 2023-11-08T19:26:21.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.449+0000 7ff60a53c700 1 --2- 172.21.15.149:0/148386753 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff60406b0c0 0x7ff6040cc950 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:21.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.449+0000 7ff60a53c700 1 --2- 172.21.15.149:0/148386753 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff6040cad20 0x7ff60406ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:21.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.449+0000 7ff60a53c700 1 -- 172.21.15.149:0/148386753 >> 172.21.15.149:0/148386753 conn(0x7ff60406dfd0 msgr2=0x7ff60406e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:21.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.449+0000 7ff60a53c700 1 -- 172.21.15.149:0/148386753 shutdown_connections 2023-11-08T19:26:21.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.449+0000 7ff60a53c700 1 -- 172.21.15.149:0/148386753 wait complete. 2023-11-08T19:26:21.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.450+0000 7ff60a53c700 1 Processor -- start 2023-11-08T19:26:21.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.451+0000 7ff60a53c700 1 -- start start 2023-11-08T19:26:21.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.451+0000 7ff60a53c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff60406b0c0 0x7ff6040b1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:21.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.451+0000 7ff60a53c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff6040cad20 0x7ff6041f32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:21.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.451+0000 7ff60a53c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff60415dc00 0x7ff6040c5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:21.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.451+0000 7ff60a53c700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6040ac9c0 con 0x7ff60415dc00 2023-11-08T19:26:21.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.451+0000 7ff60a53c700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6040c6080 con 0x7ff60406b0c0 2023-11-08T19:26:21.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.451+0000 7ff60a53c700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6040b1870 con 0x7ff6040cad20 2023-11-08T19:26:21.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.451+0000 7ff608ad9700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff60415dc00 0x7ff6040c5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:21.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.451+0000 7ff608ad9700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff60415dc00 0x7ff6040c5040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42556/0 (socket says 172.21.15.149:42556) 2023-11-08T19:26:21.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.451+0000 7ff608ad9700 1 -- 172.21.15.149:0/3718508178 learned_addr learned my addr 172.21.15.149:0/3718508178 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:21.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.452+0000 7ff603fff700 1 --2- 172.21.15.149:0/3718508178 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff60406b0c0 0x7ff6040b1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:21.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.452+0000 7ff6037fe700 1 --2- 172.21.15.149:0/3718508178 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff6040cad20 0x7ff6041f32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:21.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.452+0000 7ff608ad9700 1 -- 172.21.15.149:0/3718508178 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff6040cad20 msgr2=0x7ff6041f32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:21.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.452+0000 7ff608ad9700 1 --2- 172.21.15.149:0/3718508178 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff6040cad20 0x7ff6041f32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:21.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.452+0000 7ff608ad9700 1 -- 172.21.15.149:0/3718508178 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff60406b0c0 msgr2=0x7ff6040b1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:21.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.452+0000 7ff608ad9700 1 --2- 172.21.15.149:0/3718508178 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff60406b0c0 0x7ff6040b1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:21.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.452+0000 7ff608ad9700 1 -- 172.21.15.149:0/3718508178 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5fc009b30 con 0x7ff60415dc00 2023-11-08T19:26:21.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.452+0000 7ff608ad9700 1 --2- 172.21.15.149:0/3718508178 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff60415dc00 0x7ff6040c5040 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7ff60406d300 tx=0x7ff5fc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:21.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.452+0000 7ff600ff9700 1 -- 172.21.15.149:0/3718508178 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc004240 con 0x7ff60415dc00 2023-11-08T19:26:21.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.452+0000 7ff600ff9700 1 -- 172.21.15.149:0/3718508178 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5fc0043a0 con 0x7ff60415dc00 2023-11-08T19:26:21.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.452+0000 7ff60a53c700 1 -- 172.21.15.149:0/3718508178 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6040c5ac0 con 0x7ff60415dc00 2023-11-08T19:26:21.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.452+0000 7ff600ff9700 1 -- 172.21.15.149:0/3718508178 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc004750 con 0x7ff60415dc00 2023-11-08T19:26:21.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.452+0000 7ff60a53c700 1 -- 172.21.15.149:0/3718508178 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6040c7820 con 0x7ff60415dc00 2023-11-08T19:26:21.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.453+0000 7ff60a53c700 1 -- 172.21.15.149:0/3718508178 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff60404f730 con 0x7ff60415dc00 2023-11-08T19:26:21.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.453+0000 7ff600ff9700 1 -- 172.21.15.149:0/3718508178 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff5fc019070 con 0x7ff60415dc00 2023-11-08T19:26:21.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.454+0000 7ff600ff9700 1 --2- 172.21.15.149:0/3718508178 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff5e406af00 0x7ff5e406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:21.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.454+0000 7ff600ff9700 1 -- 172.21.15.149:0/3718508178 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7ff5fc08af60 con 0x7ff60415dc00 2023-11-08T19:26:21.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.454+0000 7ff603fff700 1 --2- 172.21.15.149:0/3718508178 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff5e406af00 0x7ff5e406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:21.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.454+0000 7ff603fff700 1 --2- 172.21.15.149:0/3718508178 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff5e406af00 0x7ff5e406d3c0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec009870 tx=0x7ff5ec008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:21.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.459+0000 7ff600ff9700 1 -- 172.21.15.149:0/3718508178 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff5fc055a10 con 0x7ff60415dc00 2023-11-08T19:26:21.729 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.727+0000 7ff60a53c700 1 -- 172.21.15.149:0/3718508178 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7ff6040b3680 con 0x7ff60415dc00 2023-11-08T19:26:22.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.730+0000 7ff600ff9700 1 -- 172.21.15.149:0/3718508178 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) v1 ==== 190+0+147 (secure 0 0 0) 0x7ff5fc0170b0 con 0x7ff60415dc00 2023-11-08T19:26:22.058 INFO:teuthology.orchestra.run.smithi149.stdout:[client.0] 2023-11-08T19:26:22.058 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDi30tlQEEsNxAAiPozrOREh+IJXoj7ZkhvLg== 2023-11-08T19:26:22.059 INFO:teuthology.orchestra.run.smithi149.stdout: caps mds = "allow" 2023-11-08T19:26:22.059 INFO:teuthology.orchestra.run.smithi149.stdout: caps mon = "allow r" 2023-11-08T19:26:22.059 INFO:teuthology.orchestra.run.smithi149.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-08T19:26:22.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.732+0000 7ff60a53c700 1 -- 172.21.15.149:0/3718508178 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff5e406af00 msgr2=0x7ff5e406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:22.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.732+0000 7ff60a53c700 1 --2- 172.21.15.149:0/3718508178 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff5e406af00 0x7ff5e406d3c0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec009870 tx=0x7ff5ec008040 comp rx=0 tx=0).stop 2023-11-08T19:26:22.061 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.732+0000 7ff60a53c700 1 -- 172.21.15.149:0/3718508178 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff60415dc00 msgr2=0x7ff6040c5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:22.061 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.732+0000 7ff60a53c700 1 --2- 172.21.15.149:0/3718508178 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff60415dc00 0x7ff6040c5040 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7ff60406d300 tx=0x7ff5fc004ad0 comp rx=0 tx=0).stop 2023-11-08T19:26:22.061 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.732+0000 7ff60a53c700 1 -- 172.21.15.149:0/3718508178 shutdown_connections 2023-11-08T19:26:22.061 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.732+0000 7ff60a53c700 1 --2- 172.21.15.149:0/3718508178 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff5e406af00 0x7ff5e406d3c0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:22.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.732+0000 7ff60a53c700 1 --2- 172.21.15.149:0/3718508178 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff60406b0c0 0x7ff6040b1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:22.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.732+0000 7ff60a53c700 1 --2- 172.21.15.149:0/3718508178 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff60415dc00 0x7ff6040c5040 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:22.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.732+0000 7ff60a53c700 1 --2- 172.21.15.149:0/3718508178 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff6040cad20 0x7ff6041f32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:22.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.732+0000 7ff60a53c700 1 -- 172.21.15.149:0/3718508178 >> 172.21.15.149:0/3718508178 conn(0x7ff60406dfd0 msgr2=0x7ff6040b5110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:22.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.732+0000 7ff60a53c700 1 -- 172.21.15.149:0/3718508178 shutdown_connections 2023-11-08T19:26:22.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:21.732+0000 7ff60a53c700 1 -- 172.21.15.149:0/3718508178 wait complete. 2023-11-08T19:26:22.063 INFO:teuthology.orchestra.run.smithi149.stderr:updated caps for client.0 2023-11-08T19:26:22.063 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:26:22.188 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.186+0000 7f5d064f2700 1 Processor -- start 2023-11-08T19:26:22.188 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.186+0000 7f5d064f2700 1 -- start start 2023-11-08T19:26:22.191 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.187+0000 7f5d064f2700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f5d000cc910 0x7f5d000cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:22.191 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.187+0000 7f5d064f2700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5d000cb130 0x7f5d0015d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:22.191 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.187+0000 7f5d064f2700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d000b2f60 con 0x7f5d000cc140 2023-11-08T19:26:22.192 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.187+0000 7f5d064f2700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d000b2430 con 0x7f5d000cc910 2023-11-08T19:26:22.192 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.187+0000 7f5d064f2700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d000cc520 con 0x7f5d000cb130 2023-11-08T19:26:22.192 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.187+0000 7f5cff7fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f5d000cc910 0x7f5d000cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:22.193 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.187+0000 7f5cff7fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f5d000cc910 0x7f5d000cabf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42562/0 (socket says 172.21.15.149:42562) 2023-11-08T19:26:22.193 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.187+0000 7f5cff7fe700 1 -- 172.21.15.149:0/2859411632 learned_addr learned my addr 172.21.15.149:0/2859411632 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:22.193 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.187+0000 7f5cfffff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f5d000cc140 0x7f5d000b2850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:44562/0 (socket says 172.21.15.149:44562) 2023-11-08T19:26:22.193 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.188+0000 7f5d04a8f700 1 --2- 172.21.15.149:0/2859411632 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5d000cb130 0x7f5d0015d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:22.194 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.188+0000 7f5cff7fe700 1 -- 172.21.15.149:0/2859411632 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5d000cb130 msgr2=0x7f5d0015d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:22.194 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.188+0000 7f5cff7fe700 1 --2- 172.21.15.149:0/2859411632 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5d000cb130 0x7f5d0015d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:22.194 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.188+0000 7f5cff7fe700 1 -- 172.21.15.149:0/2859411632 >> v1:172.21.15.149:6789/0 conn(0x7f5d000cc140 legacy=0x7f5d000b2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:22.195 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.188+0000 7f5cff7fe700 1 -- 172.21.15.149:0/2859411632 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d000cb5e0 con 0x7f5d000cc910 2023-11-08T19:26:22.195 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.188+0000 7f5cfeffd700 1 -- 172.21.15.149:0/2859411632 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 718900482 0 0) 0x7f5d000b2f60 con 0x7f5d000cc140 2023-11-08T19:26:22.196 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.188+0000 7f5d04a8f700 1 --2- 172.21.15.149:0/2859411632 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5d000cb130 0x7f5d0015d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:26:22.196 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.188+0000 7f5cff7fe700 1 --2- 172.21.15.149:0/2859411632 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d000cc910 0x7f5d000cabf0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f5cf00098f0 tx=0x7f5cf0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4288655d874d705f server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:22.196 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.188+0000 7f5cfeffd700 1 -- 172.21.15.149:0/2859411632 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf000b8a0 con 0x7f5d000cc910 2023-11-08T19:26:22.197 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.188+0000 7f5cfeffd700 1 -- 172.21.15.149:0/2859411632 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cf000ba00 con 0x7f5d000cc910 2023-11-08T19:26:22.197 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.188+0000 7f5cfeffd700 1 -- 172.21.15.149:0/2859411632 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf000bd90 con 0x7f5d000cc910 2023-11-08T19:26:22.198 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.188+0000 7f5d064f2700 1 -- 172.21.15.149:0/2859411632 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d000cc910 msgr2=0x7f5d000cabf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:22.198 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.188+0000 7f5d064f2700 1 --2- 172.21.15.149:0/2859411632 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d000cc910 0x7f5d000cabf0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f5cf00098f0 tx=0x7f5cf0009c00 comp rx=0 tx=0).stop 2023-11-08T19:26:22.198 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.188+0000 7f5d064f2700 1 -- 172.21.15.149:0/2859411632 shutdown_connections 2023-11-08T19:26:22.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.188+0000 7f5d064f2700 1 --2- 172.21.15.149:0/2859411632 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5d000cb130 0x7f5d0015d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:22.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.188+0000 7f5d064f2700 1 --2- 172.21.15.149:0/2859411632 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d000cc910 0x7f5d000cabf0 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:22.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.188+0000 7f5d064f2700 1 -- 172.21.15.149:0/2859411632 >> 172.21.15.149:0/2859411632 conn(0x7f5d00099a40 msgr2=0x7f5d000d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:22.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.189+0000 7f5d064f2700 1 -- 172.21.15.149:0/2859411632 shutdown_connections 2023-11-08T19:26:22.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.189+0000 7f5d064f2700 1 -- 172.21.15.149:0/2859411632 wait complete. 2023-11-08T19:26:22.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.190+0000 7f5d064f2700 1 Processor -- start 2023-11-08T19:26:22.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.190+0000 7f5d064f2700 1 -- start start 2023-11-08T19:26:22.204 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.191+0000 7f5d064f2700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d000cb130 0x7f5d000c6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:22.205 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.191+0000 7f5d064f2700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5d000cc140 0x7f5d000ad1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:22.205 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.191+0000 7f5d064f2700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d000cc910 0x7f5d00152bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:22.205 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.191+0000 7f5d064f2700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d000ae5b0 con 0x7f5d000cb130 2023-11-08T19:26:22.205 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.191+0000 7f5d064f2700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d000ad700 con 0x7f5d000cc910 2023-11-08T19:26:22.206 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.191+0000 7f5d064f2700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d00153130 con 0x7f5d000cc140 2023-11-08T19:26:22.206 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.191+0000 7f5cfffff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d000cb130 0x7f5d000c6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:22.206 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.191+0000 7f5cfffff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d000cb130 0x7f5d000c6900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42566/0 (socket says 172.21.15.149:42566) 2023-11-08T19:26:22.207 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.191+0000 7f5cfffff700 1 -- 172.21.15.149:0/2569138901 learned_addr learned my addr 172.21.15.149:0/2569138901 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:22.207 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.191+0000 7f5cff7fe700 1 --2- 172.21.15.149:0/2569138901 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5d000cc140 0x7f5d000ad1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:22.207 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.191+0000 7f5d04a8f700 1 --2- 172.21.15.149:0/2569138901 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d000cc910 0x7f5d00152bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:22.207 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.191+0000 7f5cfffff700 1 -- 172.21.15.149:0/2569138901 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5d000cc140 msgr2=0x7f5d000ad1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:22.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.191+0000 7f5cfffff700 1 --2- 172.21.15.149:0/2569138901 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5d000cc140 0x7f5d000ad1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:22.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.191+0000 7f5cfffff700 1 -- 172.21.15.149:0/2569138901 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d000cc910 msgr2=0x7f5d00152bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:22.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.191+0000 7f5cfffff700 1 --2- 172.21.15.149:0/2569138901 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d000cc910 0x7f5d00152bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:22.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.191+0000 7f5cfffff700 1 -- 172.21.15.149:0/2569138901 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf0009550 con 0x7f5d000cb130 2023-11-08T19:26:22.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.191+0000 7f5cfffff700 1 --2- 172.21.15.149:0/2569138901 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d000cb130 0x7f5d000c6900 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f5ce800c5a0 tx=0x7f5ce800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:22.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.191+0000 7f5cfcff9700 1 -- 172.21.15.149:0/2569138901 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce80074e0 con 0x7f5d000cb130 2023-11-08T19:26:22.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.191+0000 7f5cfcff9700 1 -- 172.21.15.149:0/2569138901 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ce8007660 con 0x7f5d000cb130 2023-11-08T19:26:22.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.191+0000 7f5cfcff9700 1 -- 172.21.15.149:0/2569138901 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce8005a70 con 0x7f5d000cb130 2023-11-08T19:26:22.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.191+0000 7f5d064f2700 1 -- 172.21.15.149:0/2569138901 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d000ad930 con 0x7f5d000cb130 2023-11-08T19:26:22.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.191+0000 7f5d064f2700 1 -- 172.21.15.149:0/2569138901 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d000adef0 con 0x7f5d000cb130 2023-11-08T19:26:22.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.192+0000 7f5d064f2700 1 -- 172.21.15.149:0/2569138901 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d000ae6f0 con 0x7f5d000cb130 2023-11-08T19:26:22.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.193+0000 7f5cfcff9700 1 -- 172.21.15.149:0/2569138901 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5ce8005bd0 con 0x7f5d000cb130 2023-11-08T19:26:22.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.193+0000 7f5cfcff9700 1 --2- 172.21.15.149:0/2569138901 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5ce006af00 0x7f5ce006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:22.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.193+0000 7f5cfcff9700 1 -- 172.21.15.149:0/2569138901 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f5ce8088f30 con 0x7f5d000cb130 2023-11-08T19:26:22.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.193+0000 7f5cff7fe700 1 --2- 172.21.15.149:0/2569138901 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5ce006af00 0x7f5ce006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:22.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.194+0000 7f5cff7fe700 1 --2- 172.21.15.149:0/2569138901 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5ce006af00 0x7f5ce006d3c0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f5cf00098f0 tx=0x7f5cf0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:22.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.200+0000 7f5cfcff9700 1 -- 172.21.15.149:0/2569138901 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5d000ae6f0 con 0x7f5d000cb130 2023-11-08T19:26:22.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.432+0000 7f5d064f2700 1 -- 172.21.15.149:0/2569138901 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5d000745f0 con 0x7f5d000cb130 2023-11-08T19:26:22.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.433+0000 7f5cfcff9700 1 -- 172.21.15.149:0/2569138901 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4912 (secure 0 0 0) 0x7f5ce8017020 con 0x7f5d000cb130 2023-11-08T19:26:22.434 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:26:22.435 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":44,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5681,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/1946892292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":1946892292},{"type":"v1","addr":"172.21.15.160:6835","nonce":1946892292}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39},{"gid":6145,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/84105573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":84105573},{"type":"v1","addr":"172.21.15.160:6833","nonce":84105573}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39},{"gid":6663,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/3243545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3243545},{"type":"v1","addr":"172.21.15.149:6836","nonce":3243545}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-08T19:26:11.529336+0000","modified":"2023-11-08T19:26:14.553465+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6666},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6666":{"gid":6666,"name":"a","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6837/1594746264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":1594746264},{"type":"v1","addr":"172.21.15.149:6837","nonce":1594746264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-08T19:26:22.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.435+0000 7f5d064f2700 1 -- 172.21.15.149:0/2569138901 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5ce006af00 msgr2=0x7f5ce006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:22.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.435+0000 7f5d064f2700 1 --2- 172.21.15.149:0/2569138901 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5ce006af00 0x7f5ce006d3c0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f5cf00098f0 tx=0x7f5cf0008030 comp rx=0 tx=0).stop 2023-11-08T19:26:22.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.435+0000 7f5d064f2700 1 -- 172.21.15.149:0/2569138901 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d000cb130 msgr2=0x7f5d000c6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:22.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.435+0000 7f5d064f2700 1 --2- 172.21.15.149:0/2569138901 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d000cb130 0x7f5d000c6900 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f5ce800c5a0 tx=0x7f5ce800c8b0 comp rx=0 tx=0).stop 2023-11-08T19:26:22.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.435+0000 7f5d064f2700 1 -- 172.21.15.149:0/2569138901 shutdown_connections 2023-11-08T19:26:22.438 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.435+0000 7f5d064f2700 1 --2- 172.21.15.149:0/2569138901 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5ce006af00 0x7f5ce006d3c0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:22.438 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.435+0000 7f5d064f2700 1 --2- 172.21.15.149:0/2569138901 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d000cc910 0x7f5d00152bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:22.438 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.435+0000 7f5d064f2700 1 --2- 172.21.15.149:0/2569138901 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d000cb130 0x7f5d000c6900 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:22.438 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.435+0000 7f5d064f2700 1 --2- 172.21.15.149:0/2569138901 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5d000cc140 0x7f5d000ad1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:22.439 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.435+0000 7f5d064f2700 1 -- 172.21.15.149:0/2569138901 >> 172.21.15.149:0/2569138901 conn(0x7f5d00099a40 msgr2=0x7f5d0006ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:22.439 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.435+0000 7f5d064f2700 1 -- 172.21.15.149:0/2569138901 shutdown_connections 2023-11-08T19:26:22.439 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.435+0000 7f5d064f2700 1 -- 172.21.15.149:0/2569138901 wait complete. 2023-11-08T19:26:22.439 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 44 2023-11-08T19:26:22.851 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 44, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-08T19:26:11.529336+0000', 'modified': '2023-11-08T19:26:14.553465+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6666}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6666': {'gid': 6666, 'name': 'a', 'rank': 0, 'incarnation': 40, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.149:6837/1594746264', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6835', 'nonce': 1594746264}, {'type': 'v1', 'addr': '172.21.15.149:6837', 'nonce': 1594746264}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-08T19:26:22.852 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-08T19:26:22.852 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-08T19:26:22.977 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.976+0000 7f1ade59c700 1 Processor -- start 2023-11-08T19:26:22.978 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.976+0000 7f1ade59c700 1 -- start start 2023-11-08T19:26:22.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.977+0000 7f1ade59c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1ad815b950 0x7f1ad80ce130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:22.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.977+0000 7f1ade59c700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f1ad80d0430 0x7f1ad80ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:22.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.977+0000 7f1ade59c700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ad80cc2e0 con 0x7f1ad80cd5e0 2023-11-08T19:26:22.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.977+0000 7f1ade59c700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ad80cc580 con 0x7f1ad80d0430 2023-11-08T19:26:22.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.977+0000 7f1ade59c700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad80cc820 con 0x7f1ad815b950 2023-11-08T19:26:22.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.977+0000 7f1adcb39700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f1ad80d0430 0x7f1ad80ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:22.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.977+0000 7f1ad7fff700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1ad815b950 0x7f1ad80ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:22.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.977+0000 7f1ad77fe700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f1ad80cd5e0 0x7f1ad80cfd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.149:56244/0 (socket says 172.21.15.149:56244) 2023-11-08T19:26:22.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.977+0000 7f1ad77fe700 1 -- 172.21.15.149:0/1896846175 learned_addr learned my addr 172.21.15.149:0/1896846175 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:26:22.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.977+0000 7f1adcb39700 1 --2- 172.21.15.149:0/1896846175 >> v2:172.21.15.160:3300/0 conn(0x7f1ad80d0430 0x7f1ad80ce670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.149:43570/0 (socket says 172.21.15.149:43570) 2023-11-08T19:26:22.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.977+0000 7f1ad6ffd700 1 -- 172.21.15.149:0/1896846175 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2697962823 0 0) 0x7f1ad80cc2e0 con 0x7f1ad80cd5e0 2023-11-08T19:26:22.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.977+0000 7f1ad6ffd700 1 -- 172.21.15.149:0/1896846175 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ac40035b0 con 0x7f1ad80cd5e0 2023-11-08T19:26:22.983 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.978+0000 7f1adcb39700 1 -- 172.21.15.149:0/1896846175 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1ad815b950 msgr2=0x7f1ad80ce130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:22.983 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.978+0000 7f1adcb39700 1 --2- 172.21.15.149:0/1896846175 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1ad815b950 0x7f1ad80ce130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:22.983 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.978+0000 7f1adcb39700 1 -- 172.21.15.149:0/1896846175 >> v1:172.21.15.160:6789/0 conn(0x7f1ad80cd5e0 legacy=0x7f1ad80cfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:22.983 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.978+0000 7f1adcb39700 1 -- 172.21.15.149:0/1896846175 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad80ccb00 con 0x7f1ad80d0430 2023-11-08T19:26:22.984 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.978+0000 7f1ad7fff700 1 --2- 172.21.15.149:0/1896846175 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1ad815b950 0x7f1ad80ce130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:26:22.984 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.978+0000 7f1adcb39700 1 --2- 172.21.15.149:0/1896846175 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ad80d0430 0x7f1ad80ce670 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1ad0009d90 tx=0x7f1ad000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64a7b2b4e8edb52a server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:22.984 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.978+0000 7f1ad6ffd700 1 -- 172.21.15.149:0/1896846175 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad000e070 con 0x7f1ad80d0430 2023-11-08T19:26:22.984 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.978+0000 7f1ad6ffd700 1 -- 172.21.15.149:0/1896846175 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ad000bb20 con 0x7f1ad80d0430 2023-11-08T19:26:22.984 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.978+0000 7f1ad6ffd700 1 -- 172.21.15.149:0/1896846175 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad000be90 con 0x7f1ad80d0430 2023-11-08T19:26:22.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.978+0000 7f1ade59c700 1 -- 172.21.15.149:0/1896846175 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ad80d0430 msgr2=0x7f1ad80ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:22.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.978+0000 7f1ade59c700 1 --2- 172.21.15.149:0/1896846175 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ad80d0430 0x7f1ad80ce670 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1ad0009d90 tx=0x7f1ad000b330 comp rx=0 tx=0).stop 2023-11-08T19:26:22.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.978+0000 7f1ade59c700 1 -- 172.21.15.149:0/1896846175 shutdown_connections 2023-11-08T19:26:22.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.978+0000 7f1ade59c700 1 --2- 172.21.15.149:0/1896846175 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ad80d0430 0x7f1ad80ce670 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:22.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.978+0000 7f1ade59c700 1 --2- 172.21.15.149:0/1896846175 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1ad815b950 0x7f1ad80ce130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:22.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.978+0000 7f1ade59c700 1 -- 172.21.15.149:0/1896846175 >> 172.21.15.149:0/1896846175 conn(0x7f1ad808afd0 msgr2=0x7f1ad80d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:22.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.979+0000 7f1ade59c700 1 -- 172.21.15.149:0/1896846175 shutdown_connections 2023-11-08T19:26:22.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.979+0000 7f1ade59c700 1 -- 172.21.15.149:0/1896846175 wait complete. 2023-11-08T19:26:22.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.980+0000 7f1ade59c700 1 Processor -- start 2023-11-08T19:26:22.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.980+0000 7f1ade59c700 1 -- start start 2023-11-08T19:26:22.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.981+0000 7f1ade59c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ad80d0430 0x7f1ad815d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:22.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.981+0000 7f1ade59c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ad815b950 0x7f1ad80c7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:22.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.981+0000 7f1ade59c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1ad81f4a90 0x7f1ad81f4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:22.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.981+0000 7f1ade59c700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad815e770 con 0x7f1ad80d0430 2023-11-08T19:26:22.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.981+0000 7f1ade59c700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad81f5450 con 0x7f1ad815b950 2023-11-08T19:26:22.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.981+0000 7f1ade59c700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad815d8a0 con 0x7f1ad81f4a90 2023-11-08T19:26:22.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.981+0000 7f1ad7fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ad80d0430 0x7f1ad815d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:22.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.981+0000 7f1ad7fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ad80d0430 0x7f1ad815d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42580/0 (socket says 172.21.15.149:42580) 2023-11-08T19:26:22.997 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.981+0000 7f1ad7fff700 1 -- 172.21.15.149:0/3611336175 learned_addr learned my addr 172.21.15.149:0/3611336175 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:22.997 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.981+0000 7f1adcb39700 1 --2- 172.21.15.149:0/3611336175 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1ad81f4a90 0x7f1ad81f4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:22.997 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.981+0000 7f1ad77fe700 1 --2- 172.21.15.149:0/3611336175 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ad815b950 0x7f1ad80c7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:22.997 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.981+0000 7f1ad7fff700 1 -- 172.21.15.149:0/3611336175 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1ad81f4a90 msgr2=0x7f1ad81f4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:22.998 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.981+0000 7f1ad7fff700 1 --2- 172.21.15.149:0/3611336175 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1ad81f4a90 0x7f1ad81f4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:22.998 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.981+0000 7f1ad7fff700 1 -- 172.21.15.149:0/3611336175 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ad815b950 msgr2=0x7f1ad80c7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:22.998 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.981+0000 7f1ad7fff700 1 --2- 172.21.15.149:0/3611336175 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ad815b950 0x7f1ad80c7cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:22.998 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.981+0000 7f1ad7fff700 1 -- 172.21.15.149:0/3611336175 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac8009430 con 0x7f1ad80d0430 2023-11-08T19:26:22.998 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.981+0000 7f1ad7fff700 1 --2- 172.21.15.149:0/3611336175 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ad80d0430 0x7f1ad815d360 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f1ac800ebe0 tx=0x7f1ac8009e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:22.999 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.981+0000 7f1ad4ff9700 1 -- 172.21.15.149:0/3611336175 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac8005a20 con 0x7f1ad80d0430 2023-11-08T19:26:22.999 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.981+0000 7f1ad4ff9700 1 -- 172.21.15.149:0/3611336175 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ac8005b80 con 0x7f1ad80d0430 2023-11-08T19:26:22.999 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.981+0000 7f1ad4ff9700 1 -- 172.21.15.149:0/3611336175 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac800c8b0 con 0x7f1ad80d0430 2023-11-08T19:26:22.999 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.981+0000 7f1ade59c700 1 -- 172.21.15.149:0/3611336175 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ad0009a70 con 0x7f1ad80d0430 2023-11-08T19:26:22.999 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.981+0000 7f1ade59c700 1 -- 172.21.15.149:0/3611336175 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ad815ddd0 con 0x7f1ad80d0430 2023-11-08T19:26:23.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.983+0000 7f1ad4ff9700 1 -- 172.21.15.149:0/3611336175 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1ac800ca10 con 0x7f1ad80d0430 2023-11-08T19:26:23.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.983+0000 7f1ad4ff9700 1 --2- 172.21.15.149:0/3611336175 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1ab806af00 0x7f1ab806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:23.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.983+0000 7f1ad77fe700 1 --2- 172.21.15.149:0/3611336175 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1ab806af00 0x7f1ab806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:23.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.983+0000 7f1ad4ff9700 1 -- 172.21.15.149:0/3611336175 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f1ac8089d20 con 0x7f1ad80d0430 2023-11-08T19:26:23.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.984+0000 7f1ad77fe700 1 --2- 172.21.15.149:0/3611336175 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1ab806af00 0x7f1ab806d3c0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8154a20 tx=0x7f1ac0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:23.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.985+0000 7f1aea795b80 1 Processor -- start 2023-11-08T19:26:23.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.985+0000 7f1aea795b80 1 -- start start 2023-11-08T19:26:23.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.986+0000 7f1aea795b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fa983f2b30 0x55fa983d5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:23.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.986+0000 7f1aea795b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fa983f35d0 0x55fa983d5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:23.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.986+0000 7f1aea795b80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fa983a9450 0x55fa983a54c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:23.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.986+0000 7f1aea795b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa983116e0 con 0x55fa983f35d0 2023-11-08T19:26:23.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.986+0000 7f1aea795b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa983053b0 con 0x55fa983f2b30 2023-11-08T19:26:23.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.986+0000 7f1aea795b80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fa98302cd0 con 0x55fa983a9450 2023-11-08T19:26:23.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.986+0000 7f1ad77fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fa983f35d0 0x55fa983d5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:23.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.986+0000 7f1ad77fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fa983f35d0 0x55fa983d5990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42592/0 (socket says 172.21.15.149:42592) 2023-11-08T19:26:23.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.986+0000 7f1ad7fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fa983f2b30 0x55fa983d5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:23.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.986+0000 7f1ad77fe700 1 -- 172.21.15.149:0/2761634142 learned_addr learned my addr 172.21.15.149:0/2761634142 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:23.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.986+0000 7f1adcb39700 1 --2- 172.21.15.149:0/2761634142 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fa983a9450 0x55fa983a54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:23.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.986+0000 7f1ad77fe700 1 -- 172.21.15.149:0/2761634142 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fa983a9450 msgr2=0x55fa983a54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:23.004 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.986+0000 7f1ad77fe700 1 --2- 172.21.15.149:0/2761634142 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fa983a9450 0x55fa983a54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:23.004 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.986+0000 7f1ad77fe700 1 -- 172.21.15.149:0/2761634142 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fa983f2b30 msgr2=0x55fa983d5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:23.004 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.986+0000 7f1ad77fe700 1 --2- 172.21.15.149:0/2761634142 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fa983f2b30 0x55fa983d5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:23.004 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.986+0000 7f1ad77fe700 1 -- 172.21.15.149:0/2761634142 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa9817b5e0 con 0x55fa983f35d0 2023-11-08T19:26:23.004 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.986+0000 7f1ad7fff700 1 --2- 172.21.15.149:0/2761634142 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fa983f2b30 0x55fa983d5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:26:23.005 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.987+0000 7f1ad77fe700 1 --2- 172.21.15.149:0/2761634142 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fa983f35d0 0x55fa983d5990 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f1ac0005c00 tx=0x7f1ac0010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=169faade3e9798ad server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:23.005 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.987+0000 7f1acdffb700 1 -- 172.21.15.149:0/2761634142 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac0020450 con 0x55fa983f35d0 2023-11-08T19:26:23.005 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.987+0000 7f1acdffb700 1 -- 172.21.15.149:0/2761634142 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ac00205b0 con 0x55fa983f35d0 2023-11-08T19:26:23.005 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.987+0000 7f1acdffb700 1 -- 172.21.15.149:0/2761634142 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac0020920 con 0x55fa983f35d0 2023-11-08T19:26:23.005 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.987+0000 7f1aea795b80 1 -- 172.21.15.149:0/2761634142 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fa983f35d0 msgr2=0x55fa983d5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:23.005 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.987+0000 7f1aea795b80 1 --2- 172.21.15.149:0/2761634142 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fa983f35d0 0x55fa983d5990 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f1ac0005c00 tx=0x7f1ac0010000 comp rx=0 tx=0).stop 2023-11-08T19:26:23.006 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.987+0000 7f1aea795b80 1 -- 172.21.15.149:0/2761634142 shutdown_connections 2023-11-08T19:26:23.006 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.987+0000 7f1aea795b80 1 --2- 172.21.15.149:0/2761634142 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fa983f2b30 0x55fa983d5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:23.006 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.987+0000 7f1aea795b80 1 --2- 172.21.15.149:0/2761634142 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fa983a9450 0x55fa983a54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:23.006 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.987+0000 7f1aea795b80 1 --2- 172.21.15.149:0/2761634142 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fa983f35d0 0x55fa983d5990 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:23.006 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.987+0000 7f1aea795b80 1 -- 172.21.15.149:0/2761634142 >> 172.21.15.149:0/2761634142 conn(0x55fa98320660 msgr2=0x55fa983ab3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:23.007 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.987+0000 7f1aea795b80 1 -- 172.21.15.149:0/2761634142 shutdown_connections 2023-11-08T19:26:23.007 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.988+0000 7f1aea795b80 1 -- 172.21.15.149:0/2761634142 wait complete. 2023-11-08T19:26:23.007 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.988+0000 7f1aea795b80 1 -- start start 2023-11-08T19:26:23.007 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.988+0000 7f1aea795b80 1 Processor -- start 2023-11-08T19:26:23.007 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.990+0000 7f1aea795b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fa983a9450 0x55fa983eb230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:23.008 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.990+0000 7f1aea795b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fa983f2b30 0x55fa983d7c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:23.008 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.990+0000 7f1aea795b80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fa983f35d0 0x55fa983f1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:23.008 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.990+0000 7f1aea795b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa982fe5c0 con 0x55fa983f2b30 2023-11-08T19:26:23.008 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.990+0000 7f1aea795b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa9829a0d0 con 0x55fa983a9450 2023-11-08T19:26:23.008 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.990+0000 7f1aea795b80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fa98299d70 con 0x55fa983f35d0 2023-11-08T19:26:23.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.990+0000 7f1aea795b80 10 client.0 _ll_register_callbacks cb 0x55fa980f67b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-08T19:26:23.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.990+0000 7f1ad77fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fa983f2b30 0x55fa983d7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:23.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.990+0000 7f1ad77fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fa983f2b30 0x55fa983d7c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42596/0 (socket says 172.21.15.149:42596) 2023-11-08T19:26:23.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.990+0000 7f1ad77fe700 1 -- 172.21.15.149:0/2923749366 learned_addr learned my addr 172.21.15.149:0/2923749366 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:23.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.990+0000 7f1ad7fff700 1 --2- 172.21.15.149:0/2923749366 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fa983a9450 0x55fa983eb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:23.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.990+0000 7f1adcb39700 1 --2- 172.21.15.149:0/2923749366 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fa983f35d0 0x55fa983f1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:23.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.990+0000 7f1ad77fe700 1 -- 172.21.15.149:0/2923749366 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fa983f35d0 msgr2=0x55fa983f1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:23.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.990+0000 7f1ad77fe700 1 --2- 172.21.15.149:0/2923749366 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fa983f35d0 0x55fa983f1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:23.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.990+0000 7f1ad77fe700 1 -- 172.21.15.149:0/2923749366 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fa983a9450 msgr2=0x55fa983eb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:23.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.990+0000 7f1ad77fe700 1 --2- 172.21.15.149:0/2923749366 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fa983a9450 0x55fa983eb230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:23.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.990+0000 7f1ad77fe700 1 -- 172.21.15.149:0/2923749366 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ad815ddd0 con 0x55fa983f2b30 2023-11-08T19:26:23.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.990+0000 7f1ad77fe700 1 --2- 172.21.15.149:0/2923749366 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fa983f2b30 0x55fa983d7c90 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f1ac0013000 tx=0x7f1ac0007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e6d87bbb8208c56 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:23.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.990+0000 7f1ab6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2023-11-08T19:26:23.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.990+0000 7f1ab6ffd700 1 -- 172.21.15.149:0/2923749366 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac0027040 con 0x55fa983f2b30 2023-11-08T19:26:23.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.990+0000 7f1ab6ffd700 1 -- 172.21.15.149:0/2923749366 <== mon.0 v2:172.21.15.149:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f1ac002c630 con 0x55fa983f2b30 2023-11-08T19:26:23.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.990+0000 7f1aea795b80 1 -- 172.21.15.149:0/2923749366 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fa9839d880 con 0x55fa983f2b30 2023-11-08T19:26:23.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.990+0000 7f1ab6ffd700 1 -- 172.21.15.149:0/2923749366 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1ac0020450 con 0x55fa983f2b30 2023-11-08T19:26:23.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.990+0000 7f1aea795b80 10 client.6852 fetch_fsmap learned FSMap version 44 2023-11-08T19:26:23.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.990+0000 7f1aea795b80 1 -- 172.21.15.149:0/2923749366 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x7f1ac40035b0 con 0x55fa983f2b30 2023-11-08T19:26:23.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.991+0000 7f1ab6ffd700 1 -- 172.21.15.149:0/2923749366 <== mon.0 v2:172.21.15.149:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fa9839d880 con 0x55fa983f2b30 2023-11-08T19:26:23.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.991+0000 7f1ab6ffd700 1 -- 172.21.15.149:0/2923749366 <== mon.0 v2:172.21.15.149:3300/0 5 ==== fsmap(e 44) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f1ac002c830 con 0x55fa983f2b30 2023-11-08T19:26:23.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.991+0000 7f1aea795b80 10 client.6852 fetch_fsmap finished waiting for FSMap version 44 2023-11-08T19:26:23.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.991+0000 7f1aea795b80 10 client.6852 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-08T19:26:23.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.991+0000 7f1aea795b80 20 client.6852 populate_metadata read hostname 'smithi149' 2023-11-08T19:26:23.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.991+0000 7f1aea795b80 1 --2- 172.21.15.149:0/2923749366 >> [v2:172.21.15.149:6835/1594746264,v1:172.21.15.149:6837/1594746264] conn(0x55fa983b89c0 0x55fa983b5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:23.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.991+0000 7f1aea795b80 4 client.6852 mds_command: new command op to 6666 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-08T19:26:23.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.991+0000 7f1aea795b80 1 -- 172.21.15.149:0/2923749366 --> [v2:172.21.15.149:6835/1594746264,v1:172.21.15.149:6837/1594746264] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fa98379a30 con 0x55fa983b89c0 2023-11-08T19:26:23.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.991+0000 7f1ad7fff700 1 --2- 172.21.15.149:0/2923749366 >> [v2:172.21.15.149:6835/1594746264,v1:172.21.15.149:6837/1594746264] conn(0x55fa983b89c0 0x55fa983b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:23.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.991+0000 7f1ab6ffd700 10 client.6852 ms_handle_connect on v2:172.21.15.149:6835/1594746264 2023-11-08T19:26:23.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.991+0000 7f1ad7fff700 1 --2- 172.21.15.149:0/2923749366 >> [v2:172.21.15.149:6835/1594746264,v1:172.21.15.149:6837/1594746264] conn(0x55fa983b89c0 0x55fa983b5000 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db20f1513305e752 server_cookie=7610c725b6c3c456 in_seq=0 out_seq=0 2023-11-08T19:26:23.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.992+0000 7f1ab6ffd700 1 -- 172.21.15.149:0/2923749366 <== mds.0 v2:172.21.15.149:6835/1594746264 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55fa98379a30 con 0x55fa983b89c0 2023-11-08T19:26:23.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.992+0000 7f1ab6ffd700 10 client.6852 handle_command_reply: tid=0 2023-11-08T19:26:23.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.992+0000 7f1aea795b80 1 client.6852 shutdown 2023-11-08T19:26:23.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.992+0000 7f1aea795b80 1 -- 172.21.15.149:0/2923749366 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fa983f2b30 msgr2=0x55fa983d7c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:23.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.992+0000 7f1aea795b80 1 --2- 172.21.15.149:0/2923749366 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fa983f2b30 0x55fa983d7c90 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f1ac0013000 tx=0x7f1ac0007000 comp rx=0 tx=0).stop 2023-11-08T19:26:23.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.992+0000 7f1aea795b80 1 -- 172.21.15.149:0/2923749366 shutdown_connections 2023-11-08T19:26:23.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.992+0000 7f1aea795b80 1 --2- 172.21.15.149:0/2923749366 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fa983a9450 0x55fa983eb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:23.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.992+0000 7f1aea795b80 1 --2- 172.21.15.149:0/2923749366 >> [v2:172.21.15.149:6835/1594746264,v1:172.21.15.149:6837/1594746264] conn(0x55fa983b89c0 0x55fa983b5000 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:23.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.992+0000 7f1aea795b80 1 --2- 172.21.15.149:0/2923749366 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fa983f35d0 0x55fa983f1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:23.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.992+0000 7f1aea795b80 1 --2- 172.21.15.149:0/2923749366 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fa983f2b30 0x55fa983d7c90 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:23.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.992+0000 7f1ab6ffd700 0 client.6852 ms_handle_reset on v2:172.21.15.149:6835/1594746264 2023-11-08T19:26:23.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.992+0000 7f1aea795b80 1 -- 172.21.15.149:0/2923749366 >> 172.21.15.149:0/2923749366 conn(0x55fa98320660 msgr2=0x55fa983a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:23.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.992+0000 7f1aea795b80 1 -- 172.21.15.149:0/2923749366 shutdown_connections 2023-11-08T19:26:23.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.992+0000 7f1aea795b80 1 -- 172.21.15.149:0/2923749366 wait complete. 2023-11-08T19:26:23.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:22.992+0000 7f1aea795b80 20 client.6852 trim_cache size 0 max 16384 2023-11-08T19:26:23.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.010+0000 7f1aea795b80 1 Processor -- start 2023-11-08T19:26:23.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.010+0000 7f1aea795b80 1 -- start start 2023-11-08T19:26:23.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.011+0000 7f1aea795b80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fa983a9450 0x55fa98416720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:23.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.011+0000 7f1aea795b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fa983f2b30 0x55fa983f2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:23.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.011+0000 7f1aea795b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fa983f35d0 0x55fa983b0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:23.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.011+0000 7f1aea795b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa9817d8d0 con 0x55fa983f35d0 2023-11-08T19:26:23.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.011+0000 7f1aea795b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa983a9a70 con 0x55fa983f2b30 2023-11-08T19:26:23.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.011+0000 7f1aea795b80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fa983f0aa0 con 0x55fa983a9450 2023-11-08T19:26:23.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.011+0000 7f1adcb39700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fa983f35d0 0x55fa983b0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:23.025 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.011+0000 7f1adcb39700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fa983f35d0 0x55fa983b0f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42606/0 (socket says 172.21.15.149:42606) 2023-11-08T19:26:23.025 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.011+0000 7f1adcb39700 1 -- 172.21.15.149:0/290940260 learned_addr learned my addr 172.21.15.149:0/290940260 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:23.025 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.011+0000 7f1ad7fff700 1 --2- 172.21.15.149:0/290940260 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fa983a9450 0x55fa98416720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:23.025 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.011+0000 7f1ad77fe700 1 --2- 172.21.15.149:0/290940260 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fa983f2b30 0x55fa983f2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:23.025 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.011+0000 7f1adcb39700 1 -- 172.21.15.149:0/290940260 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fa983a9450 msgr2=0x55fa98416720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:23.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.011+0000 7f1adcb39700 1 --2- 172.21.15.149:0/290940260 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fa983a9450 0x55fa98416720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:23.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.011+0000 7f1adcb39700 1 -- 172.21.15.149:0/290940260 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fa983f2b30 msgr2=0x55fa983f2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:23.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.011+0000 7f1adcb39700 1 --2- 172.21.15.149:0/290940260 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fa983f2b30 0x55fa983f2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:23.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.011+0000 7f1adcb39700 1 -- 172.21.15.149:0/290940260 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa98127d90 con 0x55fa983f35d0 2023-11-08T19:26:23.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.011+0000 7f1ad7fff700 1 --2- 172.21.15.149:0/290940260 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fa983a9450 0x55fa98416720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:26:23.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.011+0000 7f1ad77fe700 1 --2- 172.21.15.149:0/290940260 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fa983f2b30 0x55fa983f2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:26:23.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.011+0000 7f1adcb39700 1 --2- 172.21.15.149:0/290940260 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fa983f35d0 0x55fa983b0f30 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f1ad808bb60 tx=0x7f1ad0010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83c8467b93f7e4eb server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:23.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.012+0000 7f1ace7fc700 1 -- 172.21.15.149:0/290940260 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad0003a20 con 0x55fa983f35d0 2023-11-08T19:26:23.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.012+0000 7f1ace7fc700 1 -- 172.21.15.149:0/290940260 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ad0003b80 con 0x55fa983f35d0 2023-11-08T19:26:23.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.012+0000 7f1ace7fc700 1 -- 172.21.15.149:0/290940260 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad0004040 con 0x55fa983f35d0 2023-11-08T19:26:23.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.012+0000 7f1aea795b80 1 -- 172.21.15.149:0/290940260 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fa983f35d0 msgr2=0x55fa983b0f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:23.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.012+0000 7f1aea795b80 1 --2- 172.21.15.149:0/290940260 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fa983f35d0 0x55fa983b0f30 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f1ad808bb60 tx=0x7f1ad0010000 comp rx=0 tx=0).stop 2023-11-08T19:26:23.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.012+0000 7f1aea795b80 1 -- 172.21.15.149:0/290940260 shutdown_connections 2023-11-08T19:26:23.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.012+0000 7f1aea795b80 1 --2- 172.21.15.149:0/290940260 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fa983f35d0 0x55fa983b0f30 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:23.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.012+0000 7f1aea795b80 1 --2- 172.21.15.149:0/290940260 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fa983a9450 0x55fa98416720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:23.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.012+0000 7f1aea795b80 1 --2- 172.21.15.149:0/290940260 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fa983f2b30 0x55fa983f2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:23.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.012+0000 7f1aea795b80 1 -- 172.21.15.149:0/290940260 >> 172.21.15.149:0/290940260 conn(0x55fa98320660 msgr2=0x55fa983a66c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:23.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.012+0000 7f1aea795b80 1 -- 172.21.15.149:0/290940260 shutdown_connections 2023-11-08T19:26:23.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.012+0000 7f1aea795b80 1 -- 172.21.15.149:0/290940260 wait complete. 2023-11-08T19:26:23.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.013+0000 7f1aea795b80 1 -- start start 2023-11-08T19:26:23.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.013+0000 7f1aea795b80 1 Processor -- start 2023-11-08T19:26:23.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.014+0000 7f1aea795b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fa983a9450 0x55fa983bf030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:23.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.014+0000 7f1aea795b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fa983f2b30 0x55fa983bf570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:23.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.014+0000 7f1aea795b80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fa983f35d0 0x55fa983f39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:23.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.014+0000 7f1aea795b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa983e6ac0 con 0x55fa983a9450 2023-11-08T19:26:23.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.014+0000 7f1aea795b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa983f4990 con 0x55fa983f2b30 2023-11-08T19:26:23.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.014+0000 7f1aea795b80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fa9840cd10 con 0x55fa983f35d0 2023-11-08T19:26:23.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.014+0000 7f1aea795b80 10 client.0 _ll_register_callbacks cb 0x7f1ac8058380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-08T19:26:23.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.014+0000 7f1ad7fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fa983a9450 0x55fa983bf030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:23.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.014+0000 7f1ad7fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fa983a9450 0x55fa983bf030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42608/0 (socket says 172.21.15.149:42608) 2023-11-08T19:26:23.032 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.014+0000 7f1ad7fff700 1 -- 172.21.15.149:0/303227745 learned_addr learned my addr 172.21.15.149:0/303227745 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:23.032 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.014+0000 7f1adcb39700 1 --2- 172.21.15.149:0/303227745 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fa983f35d0 0x55fa983f39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:23.032 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.014+0000 7f1ad77fe700 1 --2- 172.21.15.149:0/303227745 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fa983f2b30 0x55fa983bf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:23.032 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.014+0000 7f1ad7fff700 1 -- 172.21.15.149:0/303227745 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fa983f35d0 msgr2=0x55fa983f39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:23.032 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.014+0000 7f1ad7fff700 1 --2- 172.21.15.149:0/303227745 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fa983f35d0 0x55fa983f39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:23.032 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.014+0000 7f1ad7fff700 1 -- 172.21.15.149:0/303227745 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fa983f2b30 msgr2=0x55fa983bf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:23.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.014+0000 7f1ad7fff700 1 --2- 172.21.15.149:0/303227745 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fa983f2b30 0x55fa983bf570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:23.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.014+0000 7f1ad7fff700 1 -- 172.21.15.149:0/303227745 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ad80ccb00 con 0x55fa983a9450 2023-11-08T19:26:23.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.014+0000 7f1ad77fe700 1 --2- 172.21.15.149:0/303227745 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fa983f2b30 0x55fa983bf570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:26:23.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.014+0000 7f1ad7fff700 1 --2- 172.21.15.149:0/303227745 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fa983a9450 0x55fa983bf030 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f1ac8087d70 tx=0x7f1ac805c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d94e3a7e588f1375 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:23.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.014+0000 7f1ab6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2023-11-08T19:26:23.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.014+0000 7f1ab6ffd700 1 -- 172.21.15.149:0/303227745 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac8086070 con 0x55fa983a9450 2023-11-08T19:26:23.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.014+0000 7f1ab6ffd700 1 -- 172.21.15.149:0/303227745 <== mon.0 v2:172.21.15.149:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f1ac8058810 con 0x55fa983a9450 2023-11-08T19:26:23.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.015+0000 7f1aea795b80 1 -- 172.21.15.149:0/303227745 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1ac00205b0 con 0x55fa983a9450 2023-11-08T19:26:23.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.015+0000 7f1ab6ffd700 1 -- 172.21.15.149:0/303227745 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1ac80567b0 con 0x55fa983a9450 2023-11-08T19:26:23.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.015+0000 7f1aea795b80 10 client.6858 fetch_fsmap learned FSMap version 44 2023-11-08T19:26:23.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.015+0000 7f1aea795b80 1 -- 172.21.15.149:0/303227745 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x55fa98110c10 con 0x55fa983a9450 2023-11-08T19:26:23.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.015+0000 7f1ab6ffd700 1 -- 172.21.15.149:0/303227745 <== mon.0 v2:172.21.15.149:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ac00205b0 con 0x55fa983a9450 2023-11-08T19:26:23.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.015+0000 7f1ab6ffd700 1 -- 172.21.15.149:0/303227745 <== mon.0 v2:172.21.15.149:3300/0 5 ==== fsmap(e 44) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f1ac8074020 con 0x55fa983a9450 2023-11-08T19:26:23.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.015+0000 7f1aea795b80 10 client.6858 fetch_fsmap finished waiting for FSMap version 44 2023-11-08T19:26:23.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.015+0000 7f1aea795b80 10 client.6858 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-08T19:26:23.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.015+0000 7f1aea795b80 20 client.6858 populate_metadata read hostname 'smithi149' 2023-11-08T19:26:23.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.015+0000 7f1aea795b80 1 --2- 172.21.15.149:0/303227745 >> [v2:172.21.15.149:6835/1594746264,v1:172.21.15.149:6837/1594746264] conn(0x55fa983f41d0 0x55fa983d7310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:23.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.015+0000 7f1aea795b80 4 client.6858 mds_command: new command op to 6666 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-08T19:26:23.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.015+0000 7f1aea795b80 1 -- 172.21.15.149:0/303227745 --> [v2:172.21.15.149:6835/1594746264,v1:172.21.15.149:6837/1594746264] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55fa982f75a0 con 0x55fa983f41d0 2023-11-08T19:26:23.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.015+0000 7f1ad77fe700 1 --2- 172.21.15.149:0/303227745 >> [v2:172.21.15.149:6835/1594746264,v1:172.21.15.149:6837/1594746264] conn(0x55fa983f41d0 0x55fa983d7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:23.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.015+0000 7f1ab6ffd700 10 client.6858 ms_handle_connect on v2:172.21.15.149:6835/1594746264 2023-11-08T19:26:23.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.015+0000 7f1ad77fe700 1 --2- 172.21.15.149:0/303227745 >> [v2:172.21.15.149:6835/1594746264,v1:172.21.15.149:6837/1594746264] conn(0x55fa983f41d0 0x55fa983d7310 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a733eb9e6696f004 server_cookie=131881eb0f93731 in_seq=0 out_seq=0 2023-11-08T19:26:23.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.016+0000 7f1ab6ffd700 1 -- 172.21.15.149:0/303227745 <== mds.0 v2:172.21.15.149:6835/1594746264 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x7f1ac0018160 con 0x55fa983f41d0 2023-11-08T19:26:23.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.016+0000 7f1ab6ffd700 10 client.6858 handle_command_reply: tid=0 2023-11-08T19:26:23.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.016+0000 7f1aea795b80 1 client.6858 shutdown 2023-11-08T19:26:23.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.016+0000 7f1aea795b80 1 -- 172.21.15.149:0/303227745 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fa983a9450 msgr2=0x55fa983bf030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:23.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.016+0000 7f1aea795b80 1 --2- 172.21.15.149:0/303227745 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fa983a9450 0x55fa983bf030 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f1ac8087d70 tx=0x7f1ac805c7d0 comp rx=0 tx=0).stop 2023-11-08T19:26:23.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.016+0000 7f1aea795b80 1 -- 172.21.15.149:0/303227745 shutdown_connections 2023-11-08T19:26:23.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.016+0000 7f1aea795b80 1 --2- 172.21.15.149:0/303227745 >> [v2:172.21.15.149:6835/1594746264,v1:172.21.15.149:6837/1594746264] conn(0x55fa983f41d0 0x55fa983d7310 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:23.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.016+0000 7f1aea795b80 1 --2- 172.21.15.149:0/303227745 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fa983f35d0 0x55fa983f39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:23.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.016+0000 7f1ab6ffd700 0 client.6858 ms_handle_reset on v2:172.21.15.149:6835/1594746264 2023-11-08T19:26:23.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.016+0000 7f1aea795b80 1 --2- 172.21.15.149:0/303227745 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fa983a9450 0x55fa983bf030 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:23.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.016+0000 7f1aea795b80 1 --2- 172.21.15.149:0/303227745 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fa983f2b30 0x55fa983bf570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:23.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.016+0000 7f1aea795b80 1 -- 172.21.15.149:0/303227745 >> 172.21.15.149:0/303227745 conn(0x55fa98320660 msgr2=0x55fa983a66c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:23.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.016+0000 7f1aea795b80 1 -- 172.21.15.149:0/303227745 shutdown_connections 2023-11-08T19:26:23.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.016+0000 7f1aea795b80 1 -- 172.21.15.149:0/303227745 wait complete. 2023-11-08T19:26:23.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.016+0000 7f1aea795b80 20 client.6858 trim_cache size 0 max 16384 2023-11-08T19:26:23.040 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2023-11-08T19:26:23.040 INFO:teuthology.orchestra.run.smithi149.stdout: "cluster_fsid": "0aba7c70-fe80-4446-a2f5-7502ac3adfb4", 2023-11-08T19:26:23.041 INFO:teuthology.orchestra.run.smithi149.stdout: "whoami": 0, 2023-11-08T19:26:23.041 INFO:teuthology.orchestra.run.smithi149.stdout: "id": 6666, 2023-11-08T19:26:23.041 INFO:teuthology.orchestra.run.smithi149.stdout: "want_state": "up:active", 2023-11-08T19:26:23.041 INFO:teuthology.orchestra.run.smithi149.stdout: "state": "up:active", 2023-11-08T19:26:23.041 INFO:teuthology.orchestra.run.smithi149.stdout: "fs_name": "cephfs", 2023-11-08T19:26:23.041 INFO:teuthology.orchestra.run.smithi149.stdout: "rank_uptime": 10.866706799999999, 2023-11-08T19:26:23.042 INFO:teuthology.orchestra.run.smithi149.stdout: "mdsmap_epoch": 44, 2023-11-08T19:26:23.042 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_epoch": 83, 2023-11-08T19:26:23.042 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_epoch_barrier": 83, 2023-11-08T19:26:23.042 INFO:teuthology.orchestra.run.smithi149.stdout: "uptime": 17.590236576999999 2023-11-08T19:26:23.042 INFO:teuthology.orchestra.run.smithi149.stdout:} 2023-11-08T19:26:23.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.016+0000 7f1ade59c700 1 -- 172.21.15.149:0/3611336175 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1ab806af00 msgr2=0x7f1ab806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:23.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.016+0000 7f1ade59c700 1 --2- 172.21.15.149:0/3611336175 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1ab806af00 0x7f1ab806d3c0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8154a20 tx=0x7f1ac0009040 comp rx=0 tx=0).stop 2023-11-08T19:26:23.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.016+0000 7f1ade59c700 1 -- 172.21.15.149:0/3611336175 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ad80d0430 msgr2=0x7f1ad815d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:23.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.016+0000 7f1ade59c700 1 --2- 172.21.15.149:0/3611336175 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ad80d0430 0x7f1ad815d360 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f1ac800ebe0 tx=0x7f1ac8009e00 comp rx=0 tx=0).stop 2023-11-08T19:26:23.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.016+0000 7f1ade59c700 1 -- 172.21.15.149:0/3611336175 shutdown_connections 2023-11-08T19:26:23.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.016+0000 7f1ade59c700 1 --2- 172.21.15.149:0/3611336175 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1ab806af00 0x7f1ab806d3c0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:23.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.016+0000 7f1ade59c700 1 --2- 172.21.15.149:0/3611336175 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1ad81f4a90 0x7f1ad81f4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:23.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.016+0000 7f1ade59c700 1 --2- 172.21.15.149:0/3611336175 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ad80d0430 0x7f1ad815d360 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:23.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.016+0000 7f1ade59c700 1 --2- 172.21.15.149:0/3611336175 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ad815b950 0x7f1ad80c7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:23.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.016+0000 7f1ade59c700 1 -- 172.21.15.149:0/3611336175 >> 172.21.15.149:0/3611336175 conn(0x7f1ad808afd0 msgr2=0x7f1ad80afd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:23.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.017+0000 7f1ade59c700 1 -- 172.21.15.149:0/3611336175 shutdown_connections 2023-11-08T19:26:23.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.017+0000 7f1ade59c700 1 -- 172.21.15.149:0/3611336175 wait complete. 2023-11-08T19:26:23.046 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-08T19:26:23.169 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.168+0000 7fc96ca2e700 1 Processor -- start 2023-11-08T19:26:23.169 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.168+0000 7fc96ca2e700 1 -- start start 2023-11-08T19:26:23.176 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.168+0000 7fc96ca2e700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fc9680b2b60 0x7fc9680cc340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:23.177 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.169+0000 7fc96ca2e700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9680d04f0 con 0x7fc9680ce850 2023-11-08T19:26:23.177 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.169+0000 7fc96ca2e700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9680cbeb0 con 0x7fc96815df40 2023-11-08T19:26:23.177 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.169+0000 7fc96ca2e700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9680d0740 con 0x7fc9680b2b60 2023-11-08T19:26:23.177 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.169+0000 7fc966d9d700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fc9680ce850 0x7fc9680cc880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:44622/0 (socket says 172.21.15.149:44622) 2023-11-08T19:26:23.178 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.169+0000 7fc966d9d700 1 -- 172.21.15.149:0/2626722682 learned_addr learned my addr 172.21.15.149:0/2626722682 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:26:23.178 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.169+0000 7fc965d9b700 1 --2- 172.21.15.149:0/2626722682 >> v2:172.21.15.160:3300/0 conn(0x7fc9680b2b60 0x7fc9680cc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:23.178 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.169+0000 7fc96559a700 1 -- 172.21.15.149:0/2626722682 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2849968397 0 0) 0x7fc9680d04f0 con 0x7fc9680ce850 2023-11-08T19:26:23.178 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.169+0000 7fc96559a700 1 -- 172.21.15.149:0/2626722682 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9540035b0 con 0x7fc9680ce850 2023-11-08T19:26:23.179 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.169+0000 7fc96559a700 1 -- 172.21.15.149:0/2626722682 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3310676709 0 0) 0x7fc9680cbeb0 con 0x7fc96815df40 2023-11-08T19:26:23.179 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.169+0000 7fc96559a700 1 -- 172.21.15.149:0/2626722682 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9680d04f0 con 0x7fc96815df40 2023-11-08T19:26:23.179 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.169+0000 7fc96559a700 1 -- 172.21.15.149:0/2626722682 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2114065146 0 0) 0x7fc9540035b0 con 0x7fc9680ce850 2023-11-08T19:26:23.179 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.169+0000 7fc96559a700 1 -- 172.21.15.149:0/2626722682 >> v2:172.21.15.160:3300/0 conn(0x7fc9680b2b60 msgr2=0x7fc9680cc340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:23.179 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.169+0000 7fc96559a700 1 --2- 172.21.15.149:0/2626722682 >> v2:172.21.15.160:3300/0 conn(0x7fc9680b2b60 0x7fc9680cc340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:23.180 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.169+0000 7fc96559a700 1 -- 172.21.15.149:0/2626722682 >> v1:172.21.15.160:6789/0 conn(0x7fc96815df40 legacy=0x7fc9680ce140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:23.180 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.169+0000 7fc96559a700 1 -- 172.21.15.149:0/2626722682 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9680d0a20 con 0x7fc9680ce850 2023-11-08T19:26:23.180 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.169+0000 7fc96559a700 1 -- 172.21.15.149:0/2626722682 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7fc9600019f0 con 0x7fc9680ce850 2023-11-08T19:26:23.180 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.169+0000 7fc96559a700 1 -- 172.21.15.149:0/2626722682 >> v1:172.21.15.149:6789/0 conn(0x7fc9680ce850 legacy=0x7fc9680cc880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:23.181 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.169+0000 7fc96559a700 1 --2- 172.21.15.149:0/2626722682 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc954003be0 0x7fc954003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:23.181 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.169+0000 7fc96559a700 1 --2- 172.21.15.149:0/2626722682 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc954004850 0x7fc954004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:23.181 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.169+0000 7fc96559a700 1 --2- 172.21.15.149:0/2626722682 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc954005260 0x7fc95400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:23.181 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.169+0000 7fc96559a700 1 -- 172.21.15.149:0/2626722682 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9680d0740 con 0x7fc954003be0 2023-11-08T19:26:23.181 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.169+0000 7fc96559a700 1 -- 172.21.15.149:0/2626722682 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc95400c190 con 0x7fc954005260 2023-11-08T19:26:23.182 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.169+0000 7fc96559a700 1 -- 172.21.15.149:0/2626722682 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc95400c350 con 0x7fc954004850 2023-11-08T19:26:23.182 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.169+0000 7fc96659c700 1 --2- 172.21.15.149:0/2626722682 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc954003be0 0x7fc954003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:23.182 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.170+0000 7fc966d9d700 1 --2- 172.21.15.149:0/2626722682 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc954005260 0x7fc95400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:23.182 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.170+0000 7fc965d9b700 1 --2- 172.21.15.149:0/2626722682 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc954004850 0x7fc954004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:23.183 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.170+0000 7fc96659c700 1 -- 172.21.15.149:0/2626722682 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc954004850 msgr2=0x7fc954004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:23.183 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.170+0000 7fc96659c700 1 --2- 172.21.15.149:0/2626722682 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc954004850 0x7fc954004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:23.183 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.170+0000 7fc96659c700 1 -- 172.21.15.149:0/2626722682 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc954005260 msgr2=0x7fc95400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:23.183 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.170+0000 7fc96659c700 1 --2- 172.21.15.149:0/2626722682 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc954005260 0x7fc95400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:23.183 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.170+0000 7fc96659c700 1 -- 172.21.15.149:0/2626722682 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9540035b0 con 0x7fc954003be0 2023-11-08T19:26:23.184 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.170+0000 7fc966d9d700 1 --2- 172.21.15.149:0/2626722682 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc954005260 0x7fc95400ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:26:23.184 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.170+0000 7fc966d9d700 1 -- 172.21.15.149:0/2626722682 reap_dead start 2023-11-08T19:26:23.184 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.170+0000 7fc96659c700 1 --2- 172.21.15.149:0/2626722682 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc954003be0 0x7fc954003fe0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fc9500019a0 tx=0x7fc954005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf1c27ad267411e0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:23.184 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.170+0000 7fc96559a700 1 -- 172.21.15.149:0/2626722682 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc950001dd0 con 0x7fc954003be0 2023-11-08T19:26:23.184 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.170+0000 7fc96559a700 1 -- 172.21.15.149:0/2626722682 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9500052f0 con 0x7fc954003be0 2023-11-08T19:26:23.185 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.170+0000 7fc96559a700 1 -- 172.21.15.149:0/2626722682 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc950001460 con 0x7fc954003be0 2023-11-08T19:26:23.185 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.170+0000 7fc96ca2e700 1 -- 172.21.15.149:0/2626722682 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc954003be0 msgr2=0x7fc954003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:23.185 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.170+0000 7fc96ca2e700 1 --2- 172.21.15.149:0/2626722682 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc954003be0 0x7fc954003fe0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fc9500019a0 tx=0x7fc954005880 comp rx=0 tx=0).stop 2023-11-08T19:26:23.185 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.171+0000 7fc96ca2e700 1 -- 172.21.15.149:0/2626722682 shutdown_connections 2023-11-08T19:26:23.186 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.171+0000 7fc96ca2e700 1 --2- 172.21.15.149:0/2626722682 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc954003be0 0x7fc954003fe0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:23.186 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.171+0000 7fc96ca2e700 1 -- 172.21.15.149:0/2626722682 >> 172.21.15.149:0/2626722682 conn(0x7fc9680d1730 msgr2=0x7fc9680d1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:23.186 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.171+0000 7fc96ca2e700 1 -- 172.21.15.149:0/2626722682 shutdown_connections 2023-11-08T19:26:23.186 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.171+0000 7fc96ca2e700 1 -- 172.21.15.149:0/2626722682 wait complete. 2023-11-08T19:26:23.186 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.172+0000 7fc96ca2e700 1 Processor -- start 2023-11-08T19:26:23.187 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.172+0000 7fc96ca2e700 1 -- start start 2023-11-08T19:26:23.187 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.173+0000 7fc96ca2e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc954003be0 0x7fc9681547f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:23.187 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.173+0000 7fc96ca2e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9680c7dc0 0x7fc9680c92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:23.187 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.173+0000 7fc96ca2e700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc9680cac10 0x7fc9680cb090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:23.188 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.173+0000 7fc96ca2e700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9680cb5d0 con 0x7fc9680c7dc0 2023-11-08T19:26:23.188 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.173+0000 7fc96ca2e700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9680c9800 con 0x7fc954003be0 2023-11-08T19:26:23.188 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.173+0000 7fc96ca2e700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9680ca060 con 0x7fc9680cac10 2023-11-08T19:26:23.188 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.173+0000 7fc965d9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9680c7dc0 0x7fc9680c92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:23.188 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.173+0000 7fc965d9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9680c7dc0 0x7fc9680c92c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42630/0 (socket says 172.21.15.149:42630) 2023-11-08T19:26:23.189 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.173+0000 7fc965d9b700 1 -- 172.21.15.149:0/1967051808 learned_addr learned my addr 172.21.15.149:0/1967051808 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:23.189 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.173+0000 7fc966d9d700 1 --2- 172.21.15.149:0/1967051808 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc9680cac10 0x7fc9680cb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:23.189 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.173+0000 7fc96659c700 1 --2- 172.21.15.149:0/1967051808 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc954003be0 0x7fc9681547f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:23.189 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.173+0000 7fc965d9b700 1 -- 172.21.15.149:0/1967051808 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc9680cac10 msgr2=0x7fc9680cb090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:23.190 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.173+0000 7fc965d9b700 1 --2- 172.21.15.149:0/1967051808 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc9680cac10 0x7fc9680cb090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:23.190 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.173+0000 7fc965d9b700 1 -- 172.21.15.149:0/1967051808 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc954003be0 msgr2=0x7fc9681547f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:23.190 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.173+0000 7fc965d9b700 1 --2- 172.21.15.149:0/1967051808 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc954003be0 0x7fc9681547f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:23.190 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.173+0000 7fc965d9b700 1 -- 172.21.15.149:0/1967051808 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc96815e4a0 con 0x7fc9680c7dc0 2023-11-08T19:26:23.190 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.173+0000 7fc96659c700 1 --2- 172.21.15.149:0/1967051808 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc954003be0 0x7fc9681547f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:26:23.191 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.173+0000 7fc965d9b700 1 --2- 172.21.15.149:0/1967051808 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9680c7dc0 0x7fc9680c92c0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fc958011aa0 tx=0x7fc958011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:23.191 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.173+0000 7fc95effd700 1 -- 172.21.15.149:0/1967051808 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95800f960 con 0x7fc9680c7dc0 2023-11-08T19:26:23.191 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.173+0000 7fc95effd700 1 -- 172.21.15.149:0/1967051808 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc95800fac0 con 0x7fc9680c7dc0 2023-11-08T19:26:23.191 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.173+0000 7fc96ca2e700 1 -- 172.21.15.149:0/1967051808 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9680c9aa0 con 0x7fc9680c7dc0 2023-11-08T19:26:23.191 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.173+0000 7fc95effd700 1 -- 172.21.15.149:0/1967051808 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95800fe70 con 0x7fc9680c7dc0 2023-11-08T19:26:23.192 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.173+0000 7fc96ca2e700 1 -- 172.21.15.149:0/1967051808 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc96815b1d0 con 0x7fc9680c7dc0 2023-11-08T19:26:23.192 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.174+0000 7fc96ca2e700 1 -- 172.21.15.149:0/1967051808 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc96815b820 con 0x7fc9680c7dc0 2023-11-08T19:26:23.192 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.175+0000 7fc95effd700 1 -- 172.21.15.149:0/1967051808 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc958014440 con 0x7fc9680c7dc0 2023-11-08T19:26:23.192 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.175+0000 7fc95effd700 1 --2- 172.21.15.149:0/1967051808 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc94806af00 0x7fc94806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:23.193 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.175+0000 7fc95effd700 1 -- 172.21.15.149:0/1967051808 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7fc95808a300 con 0x7fc9680c7dc0 2023-11-08T19:26:23.193 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.175+0000 7fc96659c700 1 --2- 172.21.15.149:0/1967051808 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc94806af00 0x7fc94806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:23.193 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.176+0000 7fc96659c700 1 --2- 172.21.15.149:0/1967051808 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc94806af00 0x7fc94806d3c0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fc950005040 tx=0x7fc95000a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:23.194 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.180+0000 7fc95effd700 1 -- 172.21.15.149:0/1967051808 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc958054e40 con 0x7fc9680c7dc0 2023-11-08T19:26:23.417 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.416+0000 7fc96ca2e700 1 -- 172.21.15.149:0/1967051808 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc9680745f0 con 0x7fc9680c7dc0 2023-11-08T19:26:23.417 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.416+0000 7fc95effd700 1 -- 172.21.15.149:0/1967051808 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v44) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc958058460 con 0x7fc9680c7dc0 2023-11-08T19:26:23.417 INFO:teuthology.orchestra.run.smithi149.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-08T19:26:23.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.418+0000 7fc96ca2e700 1 -- 172.21.15.149:0/1967051808 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc94806af00 msgr2=0x7fc94806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:23.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.418+0000 7fc96ca2e700 1 --2- 172.21.15.149:0/1967051808 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc94806af00 0x7fc94806d3c0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fc950005040 tx=0x7fc95000a000 comp rx=0 tx=0).stop 2023-11-08T19:26:23.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.418+0000 7fc96ca2e700 1 -- 172.21.15.149:0/1967051808 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9680c7dc0 msgr2=0x7fc9680c92c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:23.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.418+0000 7fc96ca2e700 1 --2- 172.21.15.149:0/1967051808 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9680c7dc0 0x7fc9680c92c0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fc958011aa0 tx=0x7fc958011e60 comp rx=0 tx=0).stop 2023-11-08T19:26:23.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.418+0000 7fc96ca2e700 1 -- 172.21.15.149:0/1967051808 shutdown_connections 2023-11-08T19:26:23.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.418+0000 7fc96ca2e700 1 --2- 172.21.15.149:0/1967051808 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc94806af00 0x7fc94806d3c0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:23.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.418+0000 7fc96ca2e700 1 --2- 172.21.15.149:0/1967051808 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc954003be0 0x7fc9681547f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:23.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.418+0000 7fc96ca2e700 1 --2- 172.21.15.149:0/1967051808 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc9680cac10 0x7fc9680cb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:23.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.418+0000 7fc96ca2e700 1 --2- 172.21.15.149:0/1967051808 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9680c7dc0 0x7fc9680c92c0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:23.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.418+0000 7fc96ca2e700 1 -- 172.21.15.149:0/1967051808 >> 172.21.15.149:0/1967051808 conn(0x7fc9680d1730 msgr2=0x7fc96815a870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:23.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.418+0000 7fc96ca2e700 1 -- 172.21.15.149:0/1967051808 shutdown_connections 2023-11-08T19:26:23.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:23.418+0000 7fc96ca2e700 1 -- 172.21.15.149:0/1967051808 wait complete. 2023-11-08T19:26:23.431 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-08T19:26:23.432 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-08T19:26:23.432 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi149.front.sepia.ceph.com 2023-11-08T19:26:23.432 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-08T19:26:23.433 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-08T19:26:23.433 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-08T19:26:23.433 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-08T19:26:23.434 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-08T19:26:23.434 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-08T19:26:23.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:26:23.435 DEBUG:teuthology.orchestra.run.smithi149:> ip addr 2023-11-08T19:26:23.453 INFO:teuthology.orchestra.run.smithi149.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-08T19:26:23.453 INFO:teuthology.orchestra.run.smithi149.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-08T19:26:23.453 INFO:teuthology.orchestra.run.smithi149.stdout: inet 127.0.0.1/8 scope host lo 2023-11-08T19:26:23.453 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:26:23.454 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 ::1/128 scope host 2023-11-08T19:26:23.454 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:26:23.454 INFO:teuthology.orchestra.run.smithi149.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-08T19:26:23.454 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a4 brd ff:ff:ff:ff:ff:ff 2023-11-08T19:26:23.454 INFO:teuthology.orchestra.run.smithi149.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-08T19:26:23.455 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a5 brd ff:ff:ff:ff:ff:ff 2023-11-08T19:26:23.455 INFO:teuthology.orchestra.run.smithi149.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-08T19:26:23.455 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:56 brd ff:ff:ff:ff:ff:ff 2023-11-08T19:26:23.455 INFO:teuthology.orchestra.run.smithi149.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-08T19:26:23.455 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:57 brd ff:ff:ff:ff:ff:ff 2023-11-08T19:26:23.456 INFO:teuthology.orchestra.run.smithi149.stdout: inet 172.21.15.149/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-08T19:26:23.456 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft 42210sec preferred_lft 42210sec 2023-11-08T19:26:23.456 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::a27d:6f0d:7890:36f/64 scope link noprefixroute 2023-11-08T19:26:23.456 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:26:23.456 INFO:teuthology.orchestra.run.smithi149.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-08T19:26:23.457 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 82:12:e7:85:4e:11 brd ff:ff:ff:ff:ff:ff 2023-11-08T19:26:23.457 INFO:teuthology.orchestra.run.smithi149.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-08T19:26:23.457 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:26:23.457 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::4c22:cdff:fed4:d829/64 scope link 2023-11-08T19:26:23.457 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:26:23.458 INFO:teuthology.orchestra.run.smithi149.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-08T19:26:23.458 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether e6:a6:23:51:6c:ef brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-08T19:26:23.458 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::e4a6:23ff:fe51:6cef/64 scope link 2023-11-08T19:26:23.458 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:26:23.458 INFO:teuthology.orchestra.run.smithi149.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-08T19:26:23.459 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 82:12:e7:85:4e:11 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-08T19:26:23.459 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::8012:e7ff:fe85:4e11/64 scope link 2023-11-08T19:26:23.459 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:26:23.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:26:23.460 DEBUG:teuthology.orchestra.run.smithi149:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-08T19:26:23.518 INFO:teuthology.orchestra.run.smithi149.stdout:1 2023-11-08T19:26:23.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:26:23.520 DEBUG:teuthology.orchestra.run.smithi149:> route 2023-11-08T19:26:23.578 INFO:teuthology.orchestra.run.smithi149.stdout:Kernel IP routing table 2023-11-08T19:26:23.578 INFO:teuthology.orchestra.run.smithi149.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-08T19:26:23.578 INFO:teuthology.orchestra.run.smithi149.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-08T19:26:23.579 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-08T19:26:23.579 INFO:teuthology.orchestra.run.smithi149.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-08T19:26:23.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:26:23.580 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec bash -c ' 2023-11-08T19:26:23.580 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2023-11-08T19:26:23.580 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-08T19:26:23.581 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-08T19:26:23.581 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-08T19:26:23.582 DEBUG:teuthology.orchestra.run.smithi149:> ') 2023-11-08T19:26:23.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:26:23.684 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2023-11-08T19:26:23.701 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-08T19:26:23.701 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-08T19:26:23.702 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-08T19:26:23.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:26:23.703 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set brx.0 up 2023-11-08T19:26:23.767 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-08T19:26:23.768 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-08T19:26:23.825 INFO:teuthology.orchestra.run.smithi149.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-08T19:26:23.825 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-08T19:26:23.826 DEBUG:teuthology.orchestra.run.smithi149:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-08T19:26:23.881 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-08T19:26:23.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:26:23.882 DEBUG:teuthology.orchestra.run.smithi149:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-08T19:26:23.967 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-08T19:26:23.967 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-08T19:26:23.968 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2023-11-08T19:26:23.976 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-08T19:26:23.976 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-08T19:26:23.976 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2023-11-08T19:26:23.976 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.149:3300,172.21.15.160:3300,172.21.15.160:3301" 2023-11-08T19:26:23.977 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-08T19:26:24.003 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-08T19:26:24.004 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-08T19:26:24.004 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2023-11-08T19:26:24.004 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.149:3300,172.21.15.160:3300,172.21.15.160:3301" 2023-11-08T19:26:24.004 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-08T19:26:24.005 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.149:6789,172.21.15.160:6789,172.21.15.160:6790" 2023-11-08T19:26:24.005 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.149:6789,172.21.15.160:6789,172.21.15.160:6790:/ 2023-11-08T19:26:24.005 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=0aba7c70-fe80-4446-a2f5-7502ac3adfb4" will pass to kernel 2023-11-08T19:26:24.007 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-08T19:26:24.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:26:24.008 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-08T19:26:24.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:26:24.038 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-08T19:26:24.119 INFO:teuthology.orchestra.run.smithi149.stdout:client5780 2023-11-08T19:26:24.119 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-11-08T19:26:24.120 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:26:24.176 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config get mds_max_snaps_per_dir 2023-11-08T19:26:24.352 INFO:teuthology.orchestra.run.smithi149.stdout:{"mds_max_snaps_per_dir":"100"} 2023-11-08T19:26:24.353 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_max_snaps_per_dir": "100" } 2023-11-08T19:26:24.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:26:24.354 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test-allow-snaps) 2023-11-08T19:26:24.377 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_new_snaps false --yes-i-really-mean-it 2023-11-08T19:26:24.543 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:24.542+0000 7fa33d5aa700 1 Processor -- start 2023-11-08T19:26:24.543 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:24.542+0000 7fa33d5aa700 1 -- start start 2023-11-08T19:26:24.545 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:24.542+0000 7fa33d5aa700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fa33815dc50 0x7fa3380cfd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:24.545 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:24.542+0000 7fa33d5aa700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa3380d1de0 0x7fa3380cc470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:24.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:24.542+0000 7fa33d5aa700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa33806d060 con 0x7fa33815e030 2023-11-08T19:26:24.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:24.542+0000 7fa33d5aa700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3380cf900 con 0x7fa3380d1de0 2023-11-08T19:26:24.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:24.542+0000 7fa33d5aa700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa33806d340 con 0x7fa33815dc50 2023-11-08T19:26:24.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:24.543+0000 7fa3367fc700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fa33815e030 0x7fa3380d16d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:44642/0 (socket says 172.21.15.149:44642) 2023-11-08T19:26:24.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:24.543+0000 7fa3377fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa3380d1de0 0x7fa3380cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:24.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:24.543+0000 7fa3367fc700 1 -- 172.21.15.149:0/2912540596 learned_addr learned my addr 172.21.15.149:0/2912540596 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:26:24.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:24.543+0000 7fa336ffd700 1 --2- 172.21.15.149:0/2912540596 >> v2:172.21.15.160:3300/0 conn(0x7fa33815dc50 0x7fa3380cfd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:24.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:24.543+0000 7fa3377fe700 1 -- 172.21.15.149:0/2912540596 >> v2:172.21.15.160:3300/0 conn(0x7fa33815dc50 msgr2=0x7fa3380cfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:24.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:24.543+0000 7fa3377fe700 1 --2- 172.21.15.149:0/2912540596 >> v2:172.21.15.160:3300/0 conn(0x7fa33815dc50 0x7fa3380cfd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:24.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:24.543+0000 7fa3377fe700 1 -- 172.21.15.149:0/2912540596 >> v1:172.21.15.149:6789/0 conn(0x7fa33815e030 legacy=0x7fa3380d16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:24.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:24.543+0000 7fa335ffb700 1 -- 172.21.15.149:0/2912540596 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1945966369 0 0) 0x7fa33806d060 con 0x7fa33815e030 2023-11-08T19:26:24.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:24.543+0000 7fa3377fe700 1 -- 172.21.15.149:0/2912540596 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa33806d620 con 0x7fa3380d1de0 2023-11-08T19:26:24.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:24.543+0000 7fa3377fe700 1 --2- 172.21.15.149:0/2912540596 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3380d1de0 0x7fa3380cc470 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fa3380d2340 tx=0x7fa33000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b17bb73b9ca520a server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:24.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:24.543+0000 7fa335ffb700 1 -- 172.21.15.149:0/2912540596 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa33000e070 con 0x7fa3380d1de0 2023-11-08T19:26:24.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:24.543+0000 7fa335ffb700 1 -- 172.21.15.149:0/2912540596 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa33000bbd0 con 0x7fa3380d1de0 2023-11-08T19:26:24.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:24.543+0000 7fa335ffb700 1 -- 172.21.15.149:0/2912540596 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa330012430 con 0x7fa3380d1de0 2023-11-08T19:26:24.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:24.544+0000 7fa33d5aa700 1 -- 172.21.15.149:0/2912540596 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3380d1de0 msgr2=0x7fa3380cc470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:24.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:24.544+0000 7fa33d5aa700 1 --2- 172.21.15.149:0/2912540596 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3380d1de0 0x7fa3380cc470 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fa3380d2340 tx=0x7fa33000b330 comp rx=0 tx=0).stop 2023-11-08T19:26:24.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:24.544+0000 7fa33d5aa700 1 -- 172.21.15.149:0/2912540596 shutdown_connections 2023-11-08T19:26:24.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:24.544+0000 7fa33d5aa700 1 --2- 172.21.15.149:0/2912540596 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3380d1de0 0x7fa3380cc470 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:24.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:24.544+0000 7fa33d5aa700 1 --2- 172.21.15.149:0/2912540596 >> v2:172.21.15.160:3300/0 conn(0x7fa33815dc50 0x7fa3380cfd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:24.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:24.544+0000 7fa33d5aa700 1 -- 172.21.15.149:0/2912540596 >> 172.21.15.149:0/2912540596 conn(0x7fa3380b3290 msgr2=0x7fa3380b3670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:24.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:24.544+0000 7fa33d5aa700 1 -- 172.21.15.149:0/2912540596 shutdown_connections 2023-11-08T19:26:24.551 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:24.544+0000 7fa33d5aa700 1 -- 172.21.15.149:0/2912540596 wait complete. 2023-11-08T19:26:24.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:24.545+0000 7fa33d5aa700 1 Processor -- start 2023-11-08T19:26:24.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:24.546+0000 7fa33d5aa700 1 -- start start 2023-11-08T19:26:24.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:24.546+0000 7fa33d5aa700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa3380d1de0 0x7fa3380ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:24.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:24.546+0000 7fa33d5aa700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa33815dc50 0x7fa3380c92b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:24.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:24.546+0000 7fa33d5aa700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa33815e030 0x7fa33814fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:24.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:24.546+0000 7fa33d5aa700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3380c97f0 con 0x7fa33815e030 2023-11-08T19:26:24.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:24.546+0000 7fa33d5aa700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3380acf10 con 0x7fa33815dc50 2023-11-08T19:26:24.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:24.546+0000 7fa33d5aa700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3380ad1f0 con 0x7fa3380d1de0 2023-11-08T19:26:24.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:24.547+0000 7fa3377fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa33815e030 0x7fa33814fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:24.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:24.547+0000 7fa3377fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa33815e030 0x7fa33814fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42650/0 (socket says 172.21.15.149:42650) 2023-11-08T19:26:24.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:24.547+0000 7fa3377fe700 1 -- 172.21.15.149:0/4156419090 learned_addr learned my addr 172.21.15.149:0/4156419090 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:24.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:24.547+0000 7fa3367fc700 1 --2- 172.21.15.149:0/4156419090 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa33815dc50 0x7fa3380c92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:24.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:24.547+0000 7fa336ffd700 1 --2- 172.21.15.149:0/4156419090 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa3380d1de0 0x7fa3380ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:24.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:24.547+0000 7fa3377fe700 1 -- 172.21.15.149:0/4156419090 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa3380d1de0 msgr2=0x7fa3380ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:24.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:24.547+0000 7fa3377fe700 1 --2- 172.21.15.149:0/4156419090 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa3380d1de0 0x7fa3380ac8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:24.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:24.547+0000 7fa3377fe700 1 -- 172.21.15.149:0/4156419090 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa33815dc50 msgr2=0x7fa3380c92b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:24.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:24.547+0000 7fa3377fe700 1 --2- 172.21.15.149:0/4156419090 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa33815dc50 0x7fa3380c92b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:24.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:24.547+0000 7fa3377fe700 1 -- 172.21.15.149:0/4156419090 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa330009a70 con 0x7fa33815e030 2023-11-08T19:26:24.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:24.547+0000 7fa3377fe700 1 --2- 172.21.15.149:0/4156419090 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa33815e030 0x7fa33814fab0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fa330014040 tx=0x7fa330004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:24.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:24.547+0000 7fa31f7fe700 1 -- 172.21.15.149:0/4156419090 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa330012430 con 0x7fa33815e030 2023-11-08T19:26:24.558 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:24.547+0000 7fa31f7fe700 1 -- 172.21.15.149:0/4156419090 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa330020070 con 0x7fa33815e030 2023-11-08T19:26:24.558 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:24.547+0000 7fa33d5aa700 1 -- 172.21.15.149:0/4156419090 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3380ad4d0 con 0x7fa33815e030 2023-11-08T19:26:24.558 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:24.547+0000 7fa31f7fe700 1 -- 172.21.15.149:0/4156419090 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa330004280 con 0x7fa33815e030 2023-11-08T19:26:24.558 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:24.547+0000 7fa33d5aa700 1 -- 172.21.15.149:0/4156419090 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3380ada90 con 0x7fa33815e030 2023-11-08T19:26:24.558 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:24.548+0000 7fa33d5aa700 1 -- 172.21.15.149:0/4156419090 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3380745f0 con 0x7fa33815e030 2023-11-08T19:26:24.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:24.549+0000 7fa31f7fe700 1 -- 172.21.15.149:0/4156419090 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa3300043e0 con 0x7fa33815e030 2023-11-08T19:26:24.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:24.549+0000 7fa31f7fe700 1 --2- 172.21.15.149:0/4156419090 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa32406af00 0x7fa32406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:24.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:24.549+0000 7fa31f7fe700 1 -- 172.21.15.149:0/4156419090 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7fa330022070 con 0x7fa33815e030 2023-11-08T19:26:24.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:24.549+0000 7fa336ffd700 1 --2- 172.21.15.149:0/4156419090 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa32406af00 0x7fa32406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:24.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:24.549+0000 7fa336ffd700 1 --2- 172.21.15.149:0/4156419090 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa32406af00 0x7fa32406d3c0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fa328009930 tx=0x7fa328008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:24.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:24.554+0000 7fa31f7fe700 1 -- 172.21.15.149:0/4156419090 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa330056c80 con 0x7fa33815e030 2023-11-08T19:26:24.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:24.787+0000 7fa33d5aa700 1 -- 172.21.15.149:0/4156419090 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "false", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa3380cfae0 con 0x7fa33815e030 2023-11-08T19:26:25.207 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.206+0000 7fa31f7fe700 1 -- 172.21.15.149:0/4156419090 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "false", "yes_i_really_mean_it": true}]=0 disabled new snapshots v45) v1 ==== 169+0+0 (secure 0 0 0) 0x7fa33005a2a0 con 0x7fa33815e030 2023-11-08T19:26:25.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.209+0000 7fa33d5aa700 1 -- 172.21.15.149:0/4156419090 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa32406af00 msgr2=0x7fa32406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:25.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.209+0000 7fa33d5aa700 1 --2- 172.21.15.149:0/4156419090 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa32406af00 0x7fa32406d3c0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fa328009930 tx=0x7fa328008040 comp rx=0 tx=0).stop 2023-11-08T19:26:25.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.209+0000 7fa33d5aa700 1 -- 172.21.15.149:0/4156419090 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa33815e030 msgr2=0x7fa33814fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:25.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.209+0000 7fa33d5aa700 1 --2- 172.21.15.149:0/4156419090 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa33815e030 0x7fa33814fab0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fa330014040 tx=0x7fa330004ad0 comp rx=0 tx=0).stop 2023-11-08T19:26:25.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.209+0000 7fa33d5aa700 1 -- 172.21.15.149:0/4156419090 shutdown_connections 2023-11-08T19:26:25.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.209+0000 7fa33d5aa700 1 --2- 172.21.15.149:0/4156419090 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa32406af00 0x7fa32406d3c0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:25.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.209+0000 7fa33d5aa700 1 --2- 172.21.15.149:0/4156419090 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa33815e030 0x7fa33814fab0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:25.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.209+0000 7fa33d5aa700 1 --2- 172.21.15.149:0/4156419090 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa3380d1de0 0x7fa3380ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:25.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.209+0000 7fa33d5aa700 1 --2- 172.21.15.149:0/4156419090 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa33815dc50 0x7fa3380c92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:25.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.209+0000 7fa33d5aa700 1 -- 172.21.15.149:0/4156419090 >> 172.21.15.149:0/4156419090 conn(0x7fa3380b3290 msgr2=0x7fa3381609b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:25.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.209+0000 7fa33d5aa700 1 -- 172.21.15.149:0/4156419090 shutdown_connections 2023-11-08T19:26:25.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.209+0000 7fa33d5aa700 1 -- 172.21.15.149:0/4156419090 wait complete. 2023-11-08T19:26:25.214 INFO:teuthology.orchestra.run.smithi149.stderr:disabled new snapshots 2023-11-08T19:26:25.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:26:25.224 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test-allow-snaps/.snap/snap00) 2023-11-08T19:26:25.243 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-08T19:26:25.243 INFO:teuthology.orchestra.run.smithi149.stderr:mkdir: cannot create directory ‘test-allow-snaps/.snap/snap00’: Operation not permitted 2023-11-08T19:26:25.244 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2023-11-08T19:26:25.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.409+0000 7fd40633e700 1 Processor -- start 2023-11-08T19:26:25.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.409+0000 7fd40633e700 1 -- start start 2023-11-08T19:26:25.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.410+0000 7fd40633e700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd40015b8e0 0x7fd40015fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:25.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.410+0000 7fd40633e700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fd4000cbdb0 0x7fd4000b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:25.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.410+0000 7fd40633e700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd4000b3720 0x7fd400070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:25.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.410+0000 7fd40633e700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4000b7290 con 0x7fd4000b3720 2023-11-08T19:26:25.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.410+0000 7fd40633e700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4000b3b70 con 0x7fd4000cbdb0 2023-11-08T19:26:25.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.410+0000 7fd40633e700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4000cf330 con 0x7fd40015b8e0 2023-11-08T19:26:25.422 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.410+0000 7fd4048db700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd4000b3720 0x7fd400070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:25.422 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.410+0000 7fd4048db700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd4000b3720 0x7fd400070b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42658/0 (socket says 172.21.15.149:42658) 2023-11-08T19:26:25.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.410+0000 7fd4048db700 1 -- 172.21.15.149:0/2510404726 learned_addr learned my addr 172.21.15.149:0/2510404726 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:25.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.410+0000 7fd3ff7fe700 1 --2- 172.21.15.149:0/2510404726 >> v2:172.21.15.160:3300/0 conn(0x7fd4000cbdb0 0x7fd4000b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:25.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.410+0000 7fd3fffff700 1 --2- 172.21.15.149:0/2510404726 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd40015b8e0 0x7fd40015fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:25.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.410+0000 7fd4048db700 1 -- 172.21.15.149:0/2510404726 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd40015b8e0 msgr2=0x7fd40015fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:25.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.410+0000 7fd4048db700 1 --2- 172.21.15.149:0/2510404726 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd40015b8e0 0x7fd40015fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:25.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.410+0000 7fd4048db700 1 -- 172.21.15.149:0/2510404726 >> v2:172.21.15.160:3300/0 conn(0x7fd4000cbdb0 msgr2=0x7fd4000b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:25.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.410+0000 7fd4048db700 1 --2- 172.21.15.149:0/2510404726 >> v2:172.21.15.160:3300/0 conn(0x7fd4000cbdb0 0x7fd4000b31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:25.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.410+0000 7fd4048db700 1 -- 172.21.15.149:0/2510404726 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4001603d0 con 0x7fd4000b3720 2023-11-08T19:26:25.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.410+0000 7fd4048db700 1 --2- 172.21.15.149:0/2510404726 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4000b3720 0x7fd400070b80 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fd400070460 tx=0x7fd3f800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e300c6eb8407bd8f server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:25.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.410+0000 7fd3feffd700 1 -- 172.21.15.149:0/2510404726 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f800e070 con 0x7fd4000b3720 2023-11-08T19:26:25.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.411+0000 7fd3feffd700 1 -- 172.21.15.149:0/2510404726 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3f800b9c0 con 0x7fd4000b3720 2023-11-08T19:26:25.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.411+0000 7fd3feffd700 1 -- 172.21.15.149:0/2510404726 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f800bd70 con 0x7fd4000b3720 2023-11-08T19:26:25.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.411+0000 7fd40633e700 1 -- 172.21.15.149:0/2510404726 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4000b3720 msgr2=0x7fd400070b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:25.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.411+0000 7fd40633e700 1 --2- 172.21.15.149:0/2510404726 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4000b3720 0x7fd400070b80 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fd400070460 tx=0x7fd3f800b330 comp rx=0 tx=0).stop 2023-11-08T19:26:25.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.411+0000 7fd40633e700 1 -- 172.21.15.149:0/2510404726 shutdown_connections 2023-11-08T19:26:25.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.411+0000 7fd40633e700 1 --2- 172.21.15.149:0/2510404726 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4000b3720 0x7fd400070b80 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:25.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.411+0000 7fd40633e700 1 --2- 172.21.15.149:0/2510404726 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd40015b8e0 0x7fd40015fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:25.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.411+0000 7fd40633e700 1 --2- 172.21.15.149:0/2510404726 >> v2:172.21.15.160:3300/0 conn(0x7fd4000cbdb0 0x7fd4000b31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:25.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.411+0000 7fd40633e700 1 -- 172.21.15.149:0/2510404726 >> 172.21.15.149:0/2510404726 conn(0x7fd4000ce1e0 msgr2=0x7fd4000ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:25.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.411+0000 7fd40633e700 1 -- 172.21.15.149:0/2510404726 shutdown_connections 2023-11-08T19:26:25.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.411+0000 7fd40633e700 1 -- 172.21.15.149:0/2510404726 wait complete. 2023-11-08T19:26:25.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.412+0000 7fd40633e700 1 Processor -- start 2023-11-08T19:26:25.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.412+0000 7fd40633e700 1 -- start start 2023-11-08T19:26:25.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.413+0000 7fd40633e700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd4000b3720 0x7fd4000d16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:25.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.413+0000 7fd40633e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd4000cbdb0 0x7fd4000cade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:25.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.413+0000 7fd40633e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd40015b8e0 0x7fd4000cb320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:25.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.413+0000 7fd40633e700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4000d2020 con 0x7fd40015b8e0 2023-11-08T19:26:25.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.413+0000 7fd40633e700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd40015d0f0 con 0x7fd4000cbdb0 2023-11-08T19:26:25.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.413+0000 7fd40633e700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd40015d3d0 con 0x7fd4000b3720 2023-11-08T19:26:25.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.413+0000 7fd4048db700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd40015b8e0 0x7fd4000cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:25.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.413+0000 7fd4048db700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd40015b8e0 0x7fd4000cb320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42662/0 (socket says 172.21.15.149:42662) 2023-11-08T19:26:25.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.413+0000 7fd4048db700 1 -- 172.21.15.149:0/634650513 learned_addr learned my addr 172.21.15.149:0/634650513 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:25.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.414+0000 7fd3fffff700 1 --2- 172.21.15.149:0/634650513 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd4000b3720 0x7fd4000d16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:25.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.414+0000 7fd3ff7fe700 1 --2- 172.21.15.149:0/634650513 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd4000cbdb0 0x7fd4000cade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:25.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.414+0000 7fd4048db700 1 -- 172.21.15.149:0/634650513 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd4000b3720 msgr2=0x7fd4000d16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:25.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.414+0000 7fd4048db700 1 --2- 172.21.15.149:0/634650513 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd4000b3720 0x7fd4000d16f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:25.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.414+0000 7fd4048db700 1 -- 172.21.15.149:0/634650513 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd4000cbdb0 msgr2=0x7fd4000cade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:25.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.414+0000 7fd4048db700 1 --2- 172.21.15.149:0/634650513 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd4000cbdb0 0x7fd4000cade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:25.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.414+0000 7fd4048db700 1 -- 172.21.15.149:0/634650513 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f8009b30 con 0x7fd40015b8e0 2023-11-08T19:26:25.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.414+0000 7fd4048db700 1 --2- 172.21.15.149:0/634650513 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd40015b8e0 0x7fd4000cb320 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fd400072d00 tx=0x7fd3f8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:25.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.414+0000 7fd3fcff9700 1 -- 172.21.15.149:0/634650513 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f8004250 con 0x7fd40015b8e0 2023-11-08T19:26:25.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.414+0000 7fd3fcff9700 1 -- 172.21.15.149:0/634650513 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3f80043d0 con 0x7fd40015b8e0 2023-11-08T19:26:25.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.414+0000 7fd40633e700 1 -- 172.21.15.149:0/634650513 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd40015d6b0 con 0x7fd40015b8e0 2023-11-08T19:26:25.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.414+0000 7fd3fcff9700 1 -- 172.21.15.149:0/634650513 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f8004780 con 0x7fd40015b8e0 2023-11-08T19:26:25.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.414+0000 7fd40633e700 1 -- 172.21.15.149:0/634650513 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd40015deb0 con 0x7fd40015b8e0 2023-11-08T19:26:25.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.415+0000 7fd40633e700 1 -- 172.21.15.149:0/634650513 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd40015dbd0 con 0x7fd40015b8e0 2023-11-08T19:26:25.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.415+0000 7fd3fcff9700 1 -- 172.21.15.149:0/634650513 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd3f801c440 con 0x7fd40015b8e0 2023-11-08T19:26:25.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.416+0000 7fd3fcff9700 1 --2- 172.21.15.149:0/634650513 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd3ec06af00 0x7fd3ec06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:25.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.416+0000 7fd3fcff9700 1 -- 172.21.15.149:0/634650513 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7fd3f808b090 con 0x7fd40015b8e0 2023-11-08T19:26:25.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.416+0000 7fd3fffff700 1 --2- 172.21.15.149:0/634650513 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd3ec06af00 0x7fd3ec06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:25.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.416+0000 7fd3fffff700 1 --2- 172.21.15.149:0/634650513 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd3ec06af00 0x7fd3ec06d3c0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fd400158ef0 tx=0x7fd3f4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:25.438 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.420+0000 7fd3fcff9700 1 -- 172.21.15.149:0/634650513 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd3f8055c60 con 0x7fd40015b8e0 2023-11-08T19:26:25.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:25.655+0000 7fd40633e700 1 -- 172.21.15.149:0/634650513 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd4000745f0 con 0x7fd40015b8e0 2023-11-08T19:26:26.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.213+0000 7fd3fcff9700 1 -- 172.21.15.149:0/634650513 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v46) v1 ==== 167+0+0 (secure 0 0 0) 0x7fd3f80200d0 con 0x7fd40015b8e0 2023-11-08T19:26:26.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.216+0000 7fd40633e700 1 -- 172.21.15.149:0/634650513 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd3ec06af00 msgr2=0x7fd3ec06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:26.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.216+0000 7fd40633e700 1 --2- 172.21.15.149:0/634650513 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd3ec06af00 0x7fd3ec06d3c0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fd400158ef0 tx=0x7fd3f4008040 comp rx=0 tx=0).stop 2023-11-08T19:26:26.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.216+0000 7fd40633e700 1 -- 172.21.15.149:0/634650513 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd40015b8e0 msgr2=0x7fd4000cb320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:26.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.216+0000 7fd40633e700 1 --2- 172.21.15.149:0/634650513 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd40015b8e0 0x7fd4000cb320 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fd400072d00 tx=0x7fd3f8004ad0 comp rx=0 tx=0).stop 2023-11-08T19:26:26.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.216+0000 7fd40633e700 1 -- 172.21.15.149:0/634650513 shutdown_connections 2023-11-08T19:26:26.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.216+0000 7fd40633e700 1 --2- 172.21.15.149:0/634650513 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd3ec06af00 0x7fd3ec06d3c0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:26.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.216+0000 7fd40633e700 1 --2- 172.21.15.149:0/634650513 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd40015b8e0 0x7fd4000cb320 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:26.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.216+0000 7fd40633e700 1 --2- 172.21.15.149:0/634650513 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd4000b3720 0x7fd4000d16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:26.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.216+0000 7fd40633e700 1 --2- 172.21.15.149:0/634650513 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd4000cbdb0 0x7fd4000cade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:26.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.216+0000 7fd40633e700 1 -- 172.21.15.149:0/634650513 >> 172.21.15.149:0/634650513 conn(0x7fd4000ce1e0 msgr2=0x7fd4000b5820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:26.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.216+0000 7fd40633e700 1 -- 172.21.15.149:0/634650513 shutdown_connections 2023-11-08T19:26:26.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.216+0000 7fd40633e700 1 -- 172.21.15.149:0/634650513 wait complete. 2023-11-08T19:26:26.220 INFO:teuthology.orchestra.run.smithi149.stderr:enabled new snapshots 2023-11-08T19:26:26.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:26:26.231 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test-allow-snaps/.snap/snap00) 2023-11-08T19:26:26.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:26:26.271 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir test-allow-snaps/.snap/snap00) 2023-11-08T19:26:26.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:26:26.333 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir test-allow-snaps) 2023-11-08T19:26:26.391 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-08T19:26:26.391 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-08T19:26:26.473 DEBUG:teuthology.orchestra.run.smithi160:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-08T19:26:26.523 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-08T19:26:26.524 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-11-08T19:26:26.524 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:26:26.542 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-11-08T19:26:26.542 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:26:26.599 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:26:26.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.758+0000 7fe5adb95700 1 Processor -- start 2023-11-08T19:26:26.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.758+0000 7fe5adb95700 1 -- start start 2023-11-08T19:26:26.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.759+0000 7fe5adb95700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe5a80cc140 0x7fe5a80cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:26.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.759+0000 7fe5adb95700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe5a80b2cd0 0x7fe5a815d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:26.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.759+0000 7fe5adb95700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5a80cce50 con 0x7fe5a80b2850 2023-11-08T19:26:26.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.759+0000 7fe5adb95700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5a80b2430 con 0x7fe5a80b2cd0 2023-11-08T19:26:26.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.759+0000 7fe5adb95700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a80cc520 con 0x7fe5a80cc140 2023-11-08T19:26:26.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.759+0000 7fe5a7fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe5a80b2cd0 0x7fe5a815d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:26.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.759+0000 7fe5a7fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe5a80b2cd0 0x7fe5a815d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42670/0 (socket says 172.21.15.149:42670) 2023-11-08T19:26:26.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.759+0000 7fe5a7fff700 1 -- 172.21.15.149:0/4064405181 learned_addr learned my addr 172.21.15.149:0/4064405181 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:26.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.759+0000 7fe5a77fe700 1 --2- 172.21.15.149:0/4064405181 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe5a80cc140 0x7fe5a80cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:26.770 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.759+0000 7fe5a7fff700 1 -- 172.21.15.149:0/4064405181 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe5a80cc140 msgr2=0x7fe5a80cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:26.770 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.759+0000 7fe5a7fff700 1 --2- 172.21.15.149:0/4064405181 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe5a80cc140 0x7fe5a80cc910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:26.770 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.759+0000 7fe5a7fff700 1 -- 172.21.15.149:0/4064405181 >> v1:172.21.15.160:6789/0 conn(0x7fe5a80b2850 legacy=0x7fe5a80cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:26.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.759+0000 7fe5a7fff700 1 -- 172.21.15.149:0/4064405181 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a80b17b0 con 0x7fe5a80b2cd0 2023-11-08T19:26:26.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.759+0000 7fe5a7fff700 1 --2- 172.21.15.149:0/4064405181 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5a80b2cd0 0x7fe5a815d2b0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fe5a0009e50 tx=0x7fe5a000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e07b82cc17a5eb5e server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:26.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.760+0000 7fe5a67fc700 1 -- 172.21.15.149:0/4064405181 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a000e070 con 0x7fe5a80b2cd0 2023-11-08T19:26:26.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.760+0000 7fe5a67fc700 1 -- 172.21.15.149:0/4064405181 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a0003a20 con 0x7fe5a80b2cd0 2023-11-08T19:26:26.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.760+0000 7fe5a67fc700 1 -- 172.21.15.149:0/4064405181 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a0003dd0 con 0x7fe5a80b2cd0 2023-11-08T19:26:26.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.760+0000 7fe5adb95700 1 -- 172.21.15.149:0/4064405181 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5a80b2cd0 msgr2=0x7fe5a815d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:26.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.760+0000 7fe5adb95700 1 --2- 172.21.15.149:0/4064405181 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5a80b2cd0 0x7fe5a815d2b0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fe5a0009e50 tx=0x7fe5a000b330 comp rx=0 tx=0).stop 2023-11-08T19:26:26.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.760+0000 7fe5adb95700 1 -- 172.21.15.149:0/4064405181 shutdown_connections 2023-11-08T19:26:26.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.760+0000 7fe5adb95700 1 --2- 172.21.15.149:0/4064405181 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5a80b2cd0 0x7fe5a815d2b0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:26.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.760+0000 7fe5adb95700 1 --2- 172.21.15.149:0/4064405181 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe5a80cc140 0x7fe5a80cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:26.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.760+0000 7fe5adb95700 1 -- 172.21.15.149:0/4064405181 >> 172.21.15.149:0/4064405181 conn(0x7fe5a8099a40 msgr2=0x7fe5a80d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:26.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.760+0000 7fe5adb95700 1 -- 172.21.15.149:0/4064405181 shutdown_connections 2023-11-08T19:26:26.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.760+0000 7fe5adb95700 1 -- 172.21.15.149:0/4064405181 wait complete. 2023-11-08T19:26:26.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.761+0000 7fe5adb95700 1 Processor -- start 2023-11-08T19:26:26.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.761+0000 7fe5adb95700 1 -- start start 2023-11-08T19:26:26.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.762+0000 7fe5adb95700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe5a80b2850 0x7fe5a8155c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:26.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.762+0000 7fe5adb95700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe5a80b2cd0 0x7fe5a809d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:26.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.762+0000 7fe5adb95700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5a80cc140 0x7fe5a806e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:26.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.762+0000 7fe5adb95700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a809e130 con 0x7fe5a80cc140 2023-11-08T19:26:26.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.762+0000 7fe5adb95700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a809db70 con 0x7fe5a80b2cd0 2023-11-08T19:26:26.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.762+0000 7fe5adb95700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a809de50 con 0x7fe5a80b2850 2023-11-08T19:26:26.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.762+0000 7fe5a7fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5a80cc140 0x7fe5a806e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:26.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.762+0000 7fe5a7fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5a80cc140 0x7fe5a806e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42676/0 (socket says 172.21.15.149:42676) 2023-11-08T19:26:26.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.762+0000 7fe5a7fff700 1 -- 172.21.15.149:0/1595450899 learned_addr learned my addr 172.21.15.149:0/1595450899 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:26.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.762+0000 7fe5a77fe700 1 --2- 172.21.15.149:0/1595450899 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe5a80b2850 0x7fe5a8155c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:26.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.762+0000 7fe5a6ffd700 1 --2- 172.21.15.149:0/1595450899 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe5a80b2cd0 0x7fe5a809d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:26.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.763+0000 7fe5a7fff700 1 -- 172.21.15.149:0/1595450899 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe5a80b2850 msgr2=0x7fe5a8155c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:26.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.763+0000 7fe5a7fff700 1 --2- 172.21.15.149:0/1595450899 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe5a80b2850 0x7fe5a8155c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:26.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.763+0000 7fe5a7fff700 1 -- 172.21.15.149:0/1595450899 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe5a80b2cd0 msgr2=0x7fe5a809d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:26.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.763+0000 7fe5a7fff700 1 --2- 172.21.15.149:0/1595450899 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe5a80b2cd0 0x7fe5a809d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:26.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.763+0000 7fe5a7fff700 1 -- 172.21.15.149:0/1595450899 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a0009b30 con 0x7fe5a80cc140 2023-11-08T19:26:26.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.763+0000 7fe5a77fe700 1 --2- 172.21.15.149:0/1595450899 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe5a80b2850 0x7fe5a8155c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:26:26.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.763+0000 7fe5a6ffd700 1 --2- 172.21.15.149:0/1595450899 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe5a80b2cd0 0x7fe5a809d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:26:26.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.763+0000 7fe5a7fff700 1 --2- 172.21.15.149:0/1595450899 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5a80cc140 0x7fe5a806e7c0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fe5a0004000 tx=0x7fe5a0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:26.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.763+0000 7fe58ffff700 1 -- 172.21.15.149:0/1595450899 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a0004440 con 0x7fe5a80cc140 2023-11-08T19:26:26.779 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.763+0000 7fe58ffff700 1 -- 172.21.15.149:0/1595450899 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a00045a0 con 0x7fe5a80cc140 2023-11-08T19:26:26.779 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.763+0000 7fe5adb95700 1 -- 172.21.15.149:0/1595450899 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5a815d060 con 0x7fe5a80cc140 2023-11-08T19:26:26.779 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.763+0000 7fe58ffff700 1 -- 172.21.15.149:0/1595450899 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a0004950 con 0x7fe5a80cc140 2023-11-08T19:26:26.780 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.763+0000 7fe5adb95700 1 -- 172.21.15.149:0/1595450899 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5a809d7b0 con 0x7fe5a80cc140 2023-11-08T19:26:26.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.764+0000 7fe5adb95700 1 -- 172.21.15.149:0/1595450899 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5a809d940 con 0x7fe5a80cc140 2023-11-08T19:26:26.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.764+0000 7fe58ffff700 1 -- 172.21.15.149:0/1595450899 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe5a0012430 con 0x7fe5a80cc140 2023-11-08T19:26:26.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.765+0000 7fe58ffff700 1 --2- 172.21.15.149:0/1595450899 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe59406af00 0x7fe59406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:26.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.765+0000 7fe58ffff700 1 -- 172.21.15.149:0/1595450899 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7fe5a008b0e0 con 0x7fe5a80cc140 2023-11-08T19:26:26.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.765+0000 7fe5a77fe700 1 --2- 172.21.15.149:0/1595450899 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe59406af00 0x7fe59406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:26.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.765+0000 7fe5a77fe700 1 --2- 172.21.15.149:0/1595450899 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe59406af00 0x7fe59406d3c0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fe59c006fd0 tx=0x7fe59c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:26.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.770+0000 7fe58ffff700 1 -- 172.21.15.149:0/1595450899 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe5a0055c30 con 0x7fe5a80cc140 2023-11-08T19:26:26.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.961+0000 7fe5adb95700 1 -- 172.21.15.149:0/1595450899 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe5a815d520 con 0x7fe5a80cc140 2023-11-08T19:26:26.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.963+0000 7fe58ffff700 1 -- 172.21.15.149:0/1595450899 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+21989 (secure 0 0 0) 0x7fe5a0059250 con 0x7fe5a80cc140 2023-11-08T19:26:26.965 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:26:26.965 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":83,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:26:13.148903+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-08T19:24:29.516185+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-08T19:25:44.287064+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":71,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-08T19:25:45.623521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-11-08T19:26:09.267609+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-11-08T19:26:10.496194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:26:26.967 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.965+0000 7fe5adb95700 1 -- 172.21.15.149:0/1595450899 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe59406af00 msgr2=0x7fe59406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:26.967 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.965+0000 7fe5adb95700 1 --2- 172.21.15.149:0/1595450899 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe59406af00 0x7fe59406d3c0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fe59c006fd0 tx=0x7fe59c008040 comp rx=0 tx=0).stop 2023-11-08T19:26:26.967 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.965+0000 7fe5adb95700 1 -- 172.21.15.149:0/1595450899 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5a80cc140 msgr2=0x7fe5a806e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:26.968 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.965+0000 7fe5adb95700 1 --2- 172.21.15.149:0/1595450899 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5a80cc140 0x7fe5a806e7c0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fe5a0004000 tx=0x7fe5a0004ad0 comp rx=0 tx=0).stop 2023-11-08T19:26:26.969 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.965+0000 7fe5adb95700 1 -- 172.21.15.149:0/1595450899 shutdown_connections 2023-11-08T19:26:26.969 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.965+0000 7fe5adb95700 1 --2- 172.21.15.149:0/1595450899 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe59406af00 0x7fe59406d3c0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:26.969 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.965+0000 7fe5adb95700 1 --2- 172.21.15.149:0/1595450899 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5a80cc140 0x7fe5a806e7c0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:26.969 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.965+0000 7fe5adb95700 1 --2- 172.21.15.149:0/1595450899 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe5a80b2850 0x7fe5a8155c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:26.970 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.965+0000 7fe5adb95700 1 --2- 172.21.15.149:0/1595450899 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe5a80b2cd0 0x7fe5a809d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:26.970 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.965+0000 7fe5adb95700 1 -- 172.21.15.149:0/1595450899 >> 172.21.15.149:0/1595450899 conn(0x7fe5a8099a40 msgr2=0x7fe5a80cb320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:26.970 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.965+0000 7fe5adb95700 1 -- 172.21.15.149:0/1595450899 shutdown_connections 2023-11-08T19:26:26.970 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:26.965+0000 7fe5adb95700 1 -- 172.21.15.149:0/1595450899 wait complete. 2023-11-08T19:26:26.979 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-08T19:22:56.023194+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-08T19:24:29.516185+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 42, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_data_pool', 'create_time': '2023-11-08T19:25:44.287064+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 71, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-08T19:25:45.623521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-08T19:26:09.267609+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2023-11-08T19:26:10.496194+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-08T19:26:26.980 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-08T19:26:27.106 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.105+0000 7f669e511700 1 Processor -- start 2023-11-08T19:26:27.106 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.105+0000 7f669e511700 1 -- start start 2023-11-08T19:26:27.108 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.105+0000 7f669e511700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f669815df40 0x7f669806c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:27.109 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.105+0000 7f669e511700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f669815e320 con 0x7f66980cb660 2023-11-08T19:26:27.109 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.105+0000 7f669e511700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f669806b020 con 0x7f669806ab80 2023-11-08T19:26:27.109 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.105+0000 7f669e511700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f669806b2e0 con 0x7f669815df40 2023-11-08T19:26:27.109 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.106+0000 7f6697fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f669815df40 0x7f669806c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:27.109 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.106+0000 7f669caae700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f66980cb660 0x7f66980ce540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:44682/0 (socket says 172.21.15.149:44682) 2023-11-08T19:26:27.110 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.106+0000 7f669caae700 1 -- 172.21.15.149:0/3065558167 learned_addr learned my addr 172.21.15.149:0/3065558167 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:26:27.110 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.106+0000 7f6697fff700 1 -- 172.21.15.149:0/3065558167 >> v1:172.21.15.160:6789/0 conn(0x7f669806ab80 legacy=0x7f66980caf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:27.110 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.106+0000 7f6697fff700 1 -- 172.21.15.149:0/3065558167 >> v1:172.21.15.149:6789/0 conn(0x7f66980cb660 legacy=0x7f66980ce540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:27.110 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.106+0000 7f6697fff700 1 -- 172.21.15.149:0/3065558167 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f669806b5c0 con 0x7f669815df40 2023-11-08T19:26:27.110 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.106+0000 7f6697fff700 1 --2- 172.21.15.149:0/3065558167 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f669815df40 0x7f669806c0a0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f6688009840 tx=0x7f6688009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8b2aedb53242bf server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:27.111 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.106+0000 7f6696ffd700 1 -- 172.21.15.149:0/3065558167 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6688004230 con 0x7f669815df40 2023-11-08T19:26:27.111 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.106+0000 7f6696ffd700 1 -- 172.21.15.149:0/3065558167 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6688004390 con 0x7f669815df40 2023-11-08T19:26:27.111 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.106+0000 7f6696ffd700 1 -- 172.21.15.149:0/3065558167 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66880036a0 con 0x7f669815df40 2023-11-08T19:26:27.112 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.107+0000 7f669e511700 1 -- 172.21.15.149:0/3065558167 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f669815df40 msgr2=0x7f669806c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:27.112 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.107+0000 7f669e511700 1 --2- 172.21.15.149:0/3065558167 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f669815df40 0x7f669806c0a0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f6688009840 tx=0x7f6688009b50 comp rx=0 tx=0).stop 2023-11-08T19:26:27.112 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.107+0000 7f669e511700 1 -- 172.21.15.149:0/3065558167 shutdown_connections 2023-11-08T19:26:27.112 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.107+0000 7f669e511700 1 --2- 172.21.15.149:0/3065558167 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f669815df40 0x7f669806c0a0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:27.112 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.107+0000 7f669e511700 1 -- 172.21.15.149:0/3065558167 >> 172.21.15.149:0/3065558167 conn(0x7f66980d0640 msgr2=0x7f66980d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:27.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.107+0000 7f669e511700 1 -- 172.21.15.149:0/3065558167 shutdown_connections 2023-11-08T19:26:27.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.107+0000 7f669e511700 1 -- 172.21.15.149:0/3065558167 wait complete. 2023-11-08T19:26:27.115 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.108+0000 7f669e511700 1 Processor -- start 2023-11-08T19:26:27.116 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.108+0000 7f669e511700 1 -- start start 2023-11-08T19:26:27.116 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.109+0000 7f669e511700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f669806ab80 0x7f6698156b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:27.116 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.109+0000 7f669e511700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66980cb660 0x7f66980ca2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:27.116 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.109+0000 7f669e511700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f669815df40 0x7f6698160d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:27.116 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.109+0000 7f669e511700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f669815fce0 con 0x7f66980cb660 2023-11-08T19:26:27.117 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.109+0000 7f669e511700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f669815ffc0 con 0x7f669806ab80 2023-11-08T19:26:27.117 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.109+0000 7f669e511700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66981602a0 con 0x7f669815df40 2023-11-08T19:26:27.117 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.109+0000 7f66977fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66980cb660 0x7f66980ca2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:27.117 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.109+0000 7f66977fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66980cb660 0x7f66980ca2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42686/0 (socket says 172.21.15.149:42686) 2023-11-08T19:26:27.117 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.109+0000 7f66977fe700 1 -- 172.21.15.149:0/321200512 learned_addr learned my addr 172.21.15.149:0/321200512 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:27.118 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.109+0000 7f6697fff700 1 --2- 172.21.15.149:0/321200512 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f669806ab80 0x7f6698156b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:27.118 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.109+0000 7f669caae700 1 --2- 172.21.15.149:0/321200512 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f669815df40 0x7f6698160d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:27.118 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.109+0000 7f66977fe700 1 -- 172.21.15.149:0/321200512 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f669815df40 msgr2=0x7f6698160d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:27.118 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.109+0000 7f66977fe700 1 --2- 172.21.15.149:0/321200512 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f669815df40 0x7f6698160d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:27.118 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.109+0000 7f66977fe700 1 -- 172.21.15.149:0/321200512 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f669806ab80 msgr2=0x7f6698156b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:27.119 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.109+0000 7f66977fe700 1 --2- 172.21.15.149:0/321200512 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f669806ab80 0x7f6698156b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:27.119 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.109+0000 7f66977fe700 1 -- 172.21.15.149:0/321200512 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66880094a0 con 0x7f66980cb660 2023-11-08T19:26:27.119 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.109+0000 7f6697fff700 1 --2- 172.21.15.149:0/321200512 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f669806ab80 0x7f6698156b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:26:27.119 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.109+0000 7f66977fe700 1 --2- 172.21.15.149:0/321200512 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66980cb660 0x7f66980ca2f0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f668c00c4d0 tx=0x7f668c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:27.119 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.110+0000 7f6694ff9700 1 -- 172.21.15.149:0/321200512 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668c011790 con 0x7f66980cb660 2023-11-08T19:26:27.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.110+0000 7f6694ff9700 1 -- 172.21.15.149:0/321200512 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f668c0118f0 con 0x7f66980cb660 2023-11-08T19:26:27.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.110+0000 7f669e511700 1 -- 172.21.15.149:0/321200512 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6698160580 con 0x7f66980cb660 2023-11-08T19:26:27.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.110+0000 7f6694ff9700 1 -- 172.21.15.149:0/321200512 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668c011ca0 con 0x7f66980cb660 2023-11-08T19:26:27.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.110+0000 7f669e511700 1 -- 172.21.15.149:0/321200512 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66980ca830 con 0x7f66980cb660 2023-11-08T19:26:27.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.111+0000 7f669e511700 1 -- 172.21.15.149:0/321200512 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f669804f730 con 0x7f66980cb660 2023-11-08T19:26:27.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.111+0000 7f6694ff9700 1 -- 172.21.15.149:0/321200512 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f668c01c460 con 0x7f66980cb660 2023-11-08T19:26:27.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.111+0000 7f6694ff9700 1 --2- 172.21.15.149:0/321200512 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f668406af00 0x7f668406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:27.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.112+0000 7f6694ff9700 1 -- 172.21.15.149:0/321200512 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f668c089a20 con 0x7f66980cb660 2023-11-08T19:26:27.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.112+0000 7f6697fff700 1 --2- 172.21.15.149:0/321200512 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f668406af00 0x7f668406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:27.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.112+0000 7f6697fff700 1 --2- 172.21.15.149:0/321200512 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f668406af00 0x7f668406d3c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f66880090b0 tx=0x7f6688008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:27.122 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.116+0000 7f6694ff9700 1 -- 172.21.15.149:0/321200512 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f668c054560 con 0x7f66980cb660 2023-11-08T19:26:27.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.310+0000 7f669e511700 1 -- 172.21.15.149:0/321200512 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f66980cbd80 con 0x7f66980cb660 2023-11-08T19:26:27.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.310+0000 7f6694ff9700 1 -- 172.21.15.149:0/321200512 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v83) v1 ==== 93+0+10 (secure 0 0 0) 0x7f668c057b80 con 0x7f66980cb660 2023-11-08T19:26:27.312 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 1 2023-11-08T19:26:27.314 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.313+0000 7f669e511700 1 -- 172.21.15.149:0/321200512 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f668406af00 msgr2=0x7f668406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:27.314 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.313+0000 7f669e511700 1 --2- 172.21.15.149:0/321200512 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f668406af00 0x7f668406d3c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f66880090b0 tx=0x7f6688008030 comp rx=0 tx=0).stop 2023-11-08T19:26:27.315 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.313+0000 7f669e511700 1 -- 172.21.15.149:0/321200512 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66980cb660 msgr2=0x7f66980ca2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:27.315 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.313+0000 7f669e511700 1 --2- 172.21.15.149:0/321200512 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66980cb660 0x7f66980ca2f0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f668c00c4d0 tx=0x7f668c00c890 comp rx=0 tx=0).stop 2023-11-08T19:26:27.315 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.313+0000 7f669e511700 1 -- 172.21.15.149:0/321200512 shutdown_connections 2023-11-08T19:26:27.315 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.313+0000 7f669e511700 1 --2- 172.21.15.149:0/321200512 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f668406af00 0x7f668406d3c0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:27.315 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.313+0000 7f669e511700 1 --2- 172.21.15.149:0/321200512 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f669806ab80 0x7f6698156b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:27.316 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.313+0000 7f669e511700 1 --2- 172.21.15.149:0/321200512 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f669815df40 0x7f6698160d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:27.316 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.313+0000 7f669e511700 1 --2- 172.21.15.149:0/321200512 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66980cb660 0x7f66980ca2f0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:27.316 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.313+0000 7f669e511700 1 -- 172.21.15.149:0/321200512 >> 172.21.15.149:0/321200512 conn(0x7f66980d0640 msgr2=0x7f66980d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:27.316 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.313+0000 7f669e511700 1 -- 172.21.15.149:0/321200512 shutdown_connections 2023-11-08T19:26:27.316 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.313+0000 7f669e511700 1 -- 172.21.15.149:0/321200512 wait complete. 2023-11-08T19:26:27.326 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-08T19:26:27.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.448+0000 7f1ec52b7700 1 Processor -- start 2023-11-08T19:26:27.450 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.448+0000 7f1ec52b7700 1 -- start start 2023-11-08T19:26:27.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.450+0000 7f1ec52b7700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1ec015abf0 0x7f1ec00b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:27.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.450+0000 7f1ec52b7700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f1ec00d1130 0x7f1ec00cc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:27.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.450+0000 7f1ec52b7700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f1ec00cc6a0 0x7f1ec00ce210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:27.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.450+0000 7f1ec52b7700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ec00b66a0 con 0x7f1ec00d1130 2023-11-08T19:26:27.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.450+0000 7f1ec52b7700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ec00d04a0 con 0x7f1ec00cc6a0 2023-11-08T19:26:27.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.450+0000 7f1ec52b7700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec00b6470 con 0x7f1ec015abf0 2023-11-08T19:26:27.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.450+0000 7f1ebe7fc700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f1ec00d1130 0x7f1ec00cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:27.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.450+0000 7f1ebe7fc700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f1ec00d1130 0x7f1ec00cc160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42694/0 (socket says 172.21.15.149:42694) 2023-11-08T19:26:27.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.450+0000 7f1ebe7fc700 1 -- 172.21.15.149:0/824133464 learned_addr learned my addr 172.21.15.149:0/824133464 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:27.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.450+0000 7f1ebf7fe700 1 --2- 172.21.15.149:0/824133464 >> v2:172.21.15.160:3300/0 conn(0x7f1ec00cc6a0 0x7f1ec00ce210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:27.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.450+0000 7f1ebeffd700 1 --2- 172.21.15.149:0/824133464 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1ec015abf0 0x7f1ec00b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:27.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.450+0000 7f1ebe7fc700 1 -- 172.21.15.149:0/824133464 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1ec015abf0 msgr2=0x7f1ec00b5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:27.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.450+0000 7f1ebe7fc700 1 --2- 172.21.15.149:0/824133464 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1ec015abf0 0x7f1ec00b5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:27.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.450+0000 7f1ebe7fc700 1 -- 172.21.15.149:0/824133464 >> v2:172.21.15.160:3300/0 conn(0x7f1ec00cc6a0 msgr2=0x7f1ec00ce210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:27.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.450+0000 7f1ebe7fc700 1 --2- 172.21.15.149:0/824133464 >> v2:172.21.15.160:3300/0 conn(0x7f1ec00cc6a0 0x7f1ec00ce210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:27.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.450+0000 7f1ebe7fc700 1 -- 172.21.15.149:0/824133464 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec015afd0 con 0x7f1ec00d1130 2023-11-08T19:26:27.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.450+0000 7f1ebeffd700 1 --2- 172.21.15.149:0/824133464 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1ec015abf0 0x7f1ec00b5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:26:27.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.450+0000 7f1ebe7fc700 1 --2- 172.21.15.149:0/824133464 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ec00d1130 0x7f1ec00cc160 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f1ec00cabf0 tx=0x7f1eb0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58a4b979ea886cca server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:27.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.450+0000 7f1ebdffb700 1 -- 172.21.15.149:0/824133464 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb0011830 con 0x7f1ec00d1130 2023-11-08T19:26:27.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.450+0000 7f1ebdffb700 1 -- 172.21.15.149:0/824133464 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eb0011990 con 0x7f1ec00d1130 2023-11-08T19:26:27.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.450+0000 7f1ebdffb700 1 -- 172.21.15.149:0/824133464 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb0011d20 con 0x7f1ec00d1130 2023-11-08T19:26:27.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.451+0000 7f1ec52b7700 1 -- 172.21.15.149:0/824133464 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ec00d1130 msgr2=0x7f1ec00cc160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:27.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.451+0000 7f1ec52b7700 1 --2- 172.21.15.149:0/824133464 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ec00d1130 0x7f1ec00cc160 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f1ec00cabf0 tx=0x7f1eb0009bd0 comp rx=0 tx=0).stop 2023-11-08T19:26:27.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.451+0000 7f1ec52b7700 1 -- 172.21.15.149:0/824133464 shutdown_connections 2023-11-08T19:26:27.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.451+0000 7f1ec52b7700 1 --2- 172.21.15.149:0/824133464 >> v2:172.21.15.160:3300/0 conn(0x7f1ec00cc6a0 0x7f1ec00ce210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:27.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.451+0000 7f1ec52b7700 1 --2- 172.21.15.149:0/824133464 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1ec015abf0 0x7f1ec00b5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:27.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.451+0000 7f1ec52b7700 1 --2- 172.21.15.149:0/824133464 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ec00d1130 0x7f1ec00cc160 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:27.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.451+0000 7f1ec52b7700 1 -- 172.21.15.149:0/824133464 >> 172.21.15.149:0/824133464 conn(0x7f1ec00d0640 msgr2=0x7f1ec00d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:27.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.451+0000 7f1ec52b7700 1 -- 172.21.15.149:0/824133464 shutdown_connections 2023-11-08T19:26:27.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.451+0000 7f1ec52b7700 1 -- 172.21.15.149:0/824133464 wait complete. 2023-11-08T19:26:27.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.453+0000 7f1ec52b7700 1 Processor -- start 2023-11-08T19:26:27.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.453+0000 7f1ec52b7700 1 -- start start 2023-11-08T19:26:27.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.454+0000 7f1ec52b7700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ec00cc6a0 0x7f1ec01548d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:27.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.454+0000 7f1ec52b7700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ec00d1130 0x7f1ec00c8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:27.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.454+0000 7f1ec52b7700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1ec015abf0 0x7f1ec00c8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:27.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.454+0000 7f1ec52b7700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec01594d0 con 0x7f1ec00cc6a0 2023-11-08T19:26:27.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.454+0000 7f1ec52b7700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec0155270 con 0x7f1ec00d1130 2023-11-08T19:26:27.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.454+0000 7f1ec52b7700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec0154f90 con 0x7f1ec015abf0 2023-11-08T19:26:27.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.454+0000 7f1ebeffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ec00cc6a0 0x7f1ec01548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:27.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.454+0000 7f1ebeffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ec00cc6a0 0x7f1ec01548d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42698/0 (socket says 172.21.15.149:42698) 2023-11-08T19:26:27.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.454+0000 7f1ebeffd700 1 -- 172.21.15.149:0/2857469340 learned_addr learned my addr 172.21.15.149:0/2857469340 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:27.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.454+0000 7f1ebe7fc700 1 --2- 172.21.15.149:0/2857469340 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ec00d1130 0x7f1ec00c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:27.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.454+0000 7f1ebf7fe700 1 --2- 172.21.15.149:0/2857469340 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1ec015abf0 0x7f1ec00c8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:27.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.454+0000 7f1ebeffd700 1 -- 172.21.15.149:0/2857469340 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1ec015abf0 msgr2=0x7f1ec00c8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:27.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.454+0000 7f1ebeffd700 1 --2- 172.21.15.149:0/2857469340 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1ec015abf0 0x7f1ec00c8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:27.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.454+0000 7f1ebeffd700 1 -- 172.21.15.149:0/2857469340 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ec00d1130 msgr2=0x7f1ec00c8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:27.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.454+0000 7f1ebeffd700 1 --2- 172.21.15.149:0/2857469340 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ec00d1130 0x7f1ec00c8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:27.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.454+0000 7f1ebeffd700 1 -- 172.21.15.149:0/2857469340 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eb0009550 con 0x7f1ec00cc6a0 2023-11-08T19:26:27.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.454+0000 7f1ebf7fe700 1 --2- 172.21.15.149:0/2857469340 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1ec015abf0 0x7f1ec00c8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:26:27.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.454+0000 7f1ebeffd700 1 --2- 172.21.15.149:0/2857469340 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ec00cc6a0 0x7f1ec01548d0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f1eb400e760 tx=0x7f1eb400ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:27.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.454+0000 7f1ea77fe700 1 -- 172.21.15.149:0/2857469340 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb4013610 con 0x7f1ec00cc6a0 2023-11-08T19:26:27.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.454+0000 7f1ea77fe700 1 -- 172.21.15.149:0/2857469340 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eb4013770 con 0x7f1ec00cc6a0 2023-11-08T19:26:27.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.454+0000 7f1ec52b7700 1 -- 172.21.15.149:0/2857469340 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ec01591f0 con 0x7f1ec00cc6a0 2023-11-08T19:26:27.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.454+0000 7f1ea77fe700 1 -- 172.21.15.149:0/2857469340 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb4013b20 con 0x7f1ec00cc6a0 2023-11-08T19:26:27.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.454+0000 7f1ec52b7700 1 -- 172.21.15.149:0/2857469340 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ec015a170 con 0x7f1ec00cc6a0 2023-11-08T19:26:27.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.455+0000 7f1ec52b7700 1 -- 172.21.15.149:0/2857469340 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ec015b660 con 0x7f1ec00cc6a0 2023-11-08T19:26:27.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.456+0000 7f1ea77fe700 1 -- 172.21.15.149:0/2857469340 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1eb4013c80 con 0x7f1ec00cc6a0 2023-11-08T19:26:27.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.456+0000 7f1ea77fe700 1 --2- 172.21.15.149:0/2857469340 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1eac06af00 0x7f1eac06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:27.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.456+0000 7f1ea77fe700 1 -- 172.21.15.149:0/2857469340 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f1eb4089590 con 0x7f1ec00cc6a0 2023-11-08T19:26:27.468 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.456+0000 7f1ebe7fc700 1 --2- 172.21.15.149:0/2857469340 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1eac06af00 0x7f1eac06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:27.468 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.457+0000 7f1ebe7fc700 1 --2- 172.21.15.149:0/2857469340 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1eac06af00 0x7f1eac06d3c0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f1eb0009c10 tx=0x7f1eb0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:27.468 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.461+0000 7f1ea77fe700 1 -- 172.21.15.149:0/2857469340 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1eb4054160 con 0x7f1ec00cc6a0 2023-11-08T19:26:27.651 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.650+0000 7f1ec52b7700 1 -- 172.21.15.149:0/2857469340 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f1ec004f730 con 0x7f1ec00cc6a0 2023-11-08T19:26:27.652 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.651+0000 7f1ea77fe700 1 -- 172.21.15.149:0/2857469340 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v83) v1 ==== 103+0+11 (secure 0 0 0) 0x7f1eb4057780 con 0x7f1ec00cc6a0 2023-11-08T19:26:27.652 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:26:27.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.652+0000 7f1ec52b7700 1 -- 172.21.15.149:0/2857469340 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1eac06af00 msgr2=0x7f1eac06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:27.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.653+0000 7f1ec52b7700 1 --2- 172.21.15.149:0/2857469340 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1eac06af00 0x7f1eac06d3c0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f1eb0009c10 tx=0x7f1eb0008030 comp rx=0 tx=0).stop 2023-11-08T19:26:27.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.653+0000 7f1ec52b7700 1 -- 172.21.15.149:0/2857469340 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ec00cc6a0 msgr2=0x7f1ec01548d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:27.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.653+0000 7f1ec52b7700 1 --2- 172.21.15.149:0/2857469340 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ec00cc6a0 0x7f1ec01548d0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f1eb400e760 tx=0x7f1eb400ea70 comp rx=0 tx=0).stop 2023-11-08T19:26:27.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.653+0000 7f1ec52b7700 1 -- 172.21.15.149:0/2857469340 shutdown_connections 2023-11-08T19:26:27.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.653+0000 7f1ec52b7700 1 --2- 172.21.15.149:0/2857469340 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1eac06af00 0x7f1eac06d3c0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:27.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.653+0000 7f1ec52b7700 1 --2- 172.21.15.149:0/2857469340 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1ec015abf0 0x7f1ec00c8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:27.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.653+0000 7f1ec52b7700 1 --2- 172.21.15.149:0/2857469340 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ec00cc6a0 0x7f1ec01548d0 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:27.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.653+0000 7f1ec52b7700 1 --2- 172.21.15.149:0/2857469340 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ec00d1130 0x7f1ec00c8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:27.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.653+0000 7f1ec52b7700 1 -- 172.21.15.149:0/2857469340 >> 172.21.15.149:0/2857469340 conn(0x7f1ec00d0640 msgr2=0x7f1ec00b1640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:27.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.653+0000 7f1ec52b7700 1 -- 172.21.15.149:0/2857469340 shutdown_connections 2023-11-08T19:26:27.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.653+0000 7f1ec52b7700 1 -- 172.21.15.149:0/2857469340 wait complete. 2023-11-08T19:26:27.666 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-08T19:26:27.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.789+0000 7f701b246700 1 Processor -- start 2023-11-08T19:26:27.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.789+0000 7f701b246700 1 -- start start 2023-11-08T19:26:27.793 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.790+0000 7f701b246700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f701406ab80 0x7f70140caf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:27.793 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.790+0000 7f701b246700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f70140cf1c0 0x7f70140cb490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:27.793 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.790+0000 7f701b246700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f701415e320 con 0x7f701415df40 2023-11-08T19:26:27.793 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.790+0000 7f701b246700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f701406b020 con 0x7f701406ab80 2023-11-08T19:26:27.794 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.790+0000 7f701b246700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f701406b2e0 con 0x7f70140cf1c0 2023-11-08T19:26:27.794 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.790+0000 7f7013fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f701406ab80 0x7f70140caf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:27.794 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.790+0000 7f7013fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f701406ab80 0x7f70140caf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42708/0 (socket says 172.21.15.149:42708) 2023-11-08T19:26:27.794 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.790+0000 7f7013fff700 1 -- 172.21.15.149:0/2183590984 learned_addr learned my addr 172.21.15.149:0/2183590984 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:27.794 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.790+0000 7f70197e3700 1 --2- 172.21.15.149:0/2183590984 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f70140cf1c0 0x7f70140cb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:27.795 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.790+0000 7f7013fff700 1 -- 172.21.15.149:0/2183590984 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f70140cf1c0 msgr2=0x7f70140cb490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:27.795 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.790+0000 7f7013fff700 1 --2- 172.21.15.149:0/2183590984 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f70140cf1c0 0x7f70140cb490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:27.795 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.790+0000 7f7013fff700 1 -- 172.21.15.149:0/2183590984 >> v1:172.21.15.160:6789/0 conn(0x7f701415df40 legacy=0x7f701406c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:27.795 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.790+0000 7f7013fff700 1 -- 172.21.15.149:0/2183590984 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f701406b5c0 con 0x7f701406ab80 2023-11-08T19:26:27.796 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.790+0000 7f7013fff700 1 --2- 172.21.15.149:0/2183590984 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f701406ab80 0x7f70140caf50 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f70000098f0 tx=0x7f7000009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3e1b5badf40b34b server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:27.796 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.790+0000 7f70137fe700 1 -- 172.21.15.149:0/2183590984 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700000b8a0 con 0x7f701406ab80 2023-11-08T19:26:27.796 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.790+0000 7f70137fe700 1 -- 172.21.15.149:0/2183590984 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f700000ba00 con 0x7f701406ab80 2023-11-08T19:26:27.796 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.790+0000 7f70137fe700 1 -- 172.21.15.149:0/2183590984 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700000bd90 con 0x7f701406ab80 2023-11-08T19:26:27.796 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.791+0000 7f701b246700 1 -- 172.21.15.149:0/2183590984 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f701406ab80 msgr2=0x7f70140caf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:27.797 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.791+0000 7f701b246700 1 --2- 172.21.15.149:0/2183590984 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f701406ab80 0x7f70140caf50 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f70000098f0 tx=0x7f7000009c00 comp rx=0 tx=0).stop 2023-11-08T19:26:27.797 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.791+0000 7f701b246700 1 -- 172.21.15.149:0/2183590984 shutdown_connections 2023-11-08T19:26:27.797 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.791+0000 7f701b246700 1 --2- 172.21.15.149:0/2183590984 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f70140cf1c0 0x7f70140cb490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:27.797 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.791+0000 7f701b246700 1 --2- 172.21.15.149:0/2183590984 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f701406ab80 0x7f70140caf50 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:27.797 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.791+0000 7f701b246700 1 -- 172.21.15.149:0/2183590984 >> 172.21.15.149:0/2183590984 conn(0x7f70140d0640 msgr2=0x7f70140d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:27.798 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.791+0000 7f701b246700 1 -- 172.21.15.149:0/2183590984 shutdown_connections 2023-11-08T19:26:27.798 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.791+0000 7f701b246700 1 -- 172.21.15.149:0/2183590984 wait complete. 2023-11-08T19:26:27.800 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.792+0000 7f701b246700 1 Processor -- start 2023-11-08T19:26:27.801 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.792+0000 7f701b246700 1 -- start start 2023-11-08T19:26:27.801 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.793+0000 7f701b246700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f701406ab80 0x7f70140af1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:27.801 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.793+0000 7f701b246700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f70140cf1c0 0x7f70140cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:27.801 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.793+0000 7f701b246700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f701415df40 0x7f70140cd600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:27.801 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.793+0000 7f701b246700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70140ca670 con 0x7f701415df40 2023-11-08T19:26:27.802 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.793+0000 7f701b246700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70140af6f0 con 0x7f701406ab80 2023-11-08T19:26:27.802 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.793+0000 7f701b246700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70141f6b40 con 0x7f70140cf1c0 2023-11-08T19:26:27.802 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.793+0000 7f70197e3700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f701415df40 0x7f70140cd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:27.802 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.793+0000 7f7018fe2700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f701406ab80 0x7f70140af1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:27.802 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.793+0000 7f70197e3700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f701415df40 0x7f70140cd600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42716/0 (socket says 172.21.15.149:42716) 2023-11-08T19:26:27.803 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.793+0000 7f70197e3700 1 -- 172.21.15.149:0/3704535742 learned_addr learned my addr 172.21.15.149:0/3704535742 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:27.803 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.793+0000 7f7013fff700 1 --2- 172.21.15.149:0/3704535742 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f70140cf1c0 0x7f70140cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:27.803 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.794+0000 7f70197e3700 1 -- 172.21.15.149:0/3704535742 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f70140cf1c0 msgr2=0x7f70140cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:27.803 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.794+0000 7f70197e3700 1 --2- 172.21.15.149:0/3704535742 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f70140cf1c0 0x7f70140cd0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:27.804 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.794+0000 7f70197e3700 1 -- 172.21.15.149:0/3704535742 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f701406ab80 msgr2=0x7f70140af1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:27.804 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.794+0000 7f70197e3700 1 --2- 172.21.15.149:0/3704535742 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f701406ab80 0x7f70140af1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:27.804 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.794+0000 7f70197e3700 1 -- 172.21.15.149:0/3704535742 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7000009550 con 0x7f701415df40 2023-11-08T19:26:27.804 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.794+0000 7f70197e3700 1 --2- 172.21.15.149:0/3704535742 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f701415df40 0x7f70140cd600 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f700c007e60 tx=0x7f700c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:27.805 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.794+0000 7f70117fa700 1 -- 172.21.15.149:0/3704535742 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700c00ed30 con 0x7f701415df40 2023-11-08T19:26:27.805 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.794+0000 7f70117fa700 1 -- 172.21.15.149:0/3704535742 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f700c00ee90 con 0x7f701415df40 2023-11-08T19:26:27.805 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.794+0000 7f70117fa700 1 -- 172.21.15.149:0/3704535742 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700c014660 con 0x7f701415df40 2023-11-08T19:26:27.805 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.794+0000 7f701b246700 1 -- 172.21.15.149:0/3704535742 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f701415f130 con 0x7f701415df40 2023-11-08T19:26:27.805 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.794+0000 7f701b246700 1 -- 172.21.15.149:0/3704535742 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70141f7070 con 0x7f701415df40 2023-11-08T19:26:27.806 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.795+0000 7f701b246700 1 -- 172.21.15.149:0/3704535742 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f701406c730 con 0x7f701415df40 2023-11-08T19:26:27.806 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.795+0000 7f70117fa700 1 -- 172.21.15.149:0/3704535742 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f700c0147c0 con 0x7f701415df40 2023-11-08T19:26:27.806 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.796+0000 7f70117fa700 1 --2- 172.21.15.149:0/3704535742 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6ff806af00 0x7f6ff806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:27.806 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.796+0000 7f70117fa700 1 -- 172.21.15.149:0/3704535742 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f700c08a210 con 0x7f701415df40 2023-11-08T19:26:27.806 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.796+0000 7f7018fe2700 1 --2- 172.21.15.149:0/3704535742 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6ff806af00 0x7f6ff806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:27.807 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.796+0000 7f7018fe2700 1 --2- 172.21.15.149:0/3704535742 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6ff806af00 0x7f6ff806d3c0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f7008007fd0 tx=0x7f7008009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:27.807 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.801+0000 7f70117fa700 1 -- 172.21.15.149:0/3704535742 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f700c054d50 con 0x7f701415df40 2023-11-08T19:26:27.990 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.989+0000 7f701b246700 1 -- 172.21.15.149:0/3704535742 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7f701404f730 con 0x7f701415df40 2023-11-08T19:26:27.991 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.990+0000 7f70117fa700 1 -- 172.21.15.149:0/3704535742 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v83) v1 ==== 103+0+11 (secure 0 0 0) 0x7f700c058370 con 0x7f701415df40 2023-11-08T19:26:27.991 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:26:27.993 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.992+0000 7f701b246700 1 -- 172.21.15.149:0/3704535742 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6ff806af00 msgr2=0x7f6ff806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:27.993 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.992+0000 7f701b246700 1 --2- 172.21.15.149:0/3704535742 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6ff806af00 0x7f6ff806d3c0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f7008007fd0 tx=0x7f7008009040 comp rx=0 tx=0).stop 2023-11-08T19:26:27.993 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.992+0000 7f701b246700 1 -- 172.21.15.149:0/3704535742 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f701415df40 msgr2=0x7f70140cd600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:27.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.992+0000 7f701b246700 1 --2- 172.21.15.149:0/3704535742 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f701415df40 0x7f70140cd600 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f700c007e60 tx=0x7f700c00e3c0 comp rx=0 tx=0).stop 2023-11-08T19:26:27.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.992+0000 7f701b246700 1 -- 172.21.15.149:0/3704535742 shutdown_connections 2023-11-08T19:26:27.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.992+0000 7f701b246700 1 --2- 172.21.15.149:0/3704535742 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6ff806af00 0x7f6ff806d3c0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:27.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.992+0000 7f701b246700 1 --2- 172.21.15.149:0/3704535742 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f701406ab80 0x7f70140af1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:27.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.992+0000 7f701b246700 1 --2- 172.21.15.149:0/3704535742 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f701415df40 0x7f70140cd600 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:27.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.992+0000 7f701b246700 1 --2- 172.21.15.149:0/3704535742 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f70140cf1c0 0x7f70140cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:27.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.992+0000 7f701b246700 1 -- 172.21.15.149:0/3704535742 >> 172.21.15.149:0/3704535742 conn(0x7f70140d0640 msgr2=0x7f70141619a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:27.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.992+0000 7f701b246700 1 -- 172.21.15.149:0/3704535742 shutdown_connections 2023-11-08T19:26:27.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:27.992+0000 7f701b246700 1 -- 172.21.15.149:0/3704535742 wait complete. 2023-11-08T19:26:28.005 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-08T19:26:28.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.128+0000 7f19abd22700 1 Processor -- start 2023-11-08T19:26:28.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.128+0000 7f19abd22700 1 -- start start 2023-11-08T19:26:28.132 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.129+0000 7f19abd22700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f19a415df40 0x7f19a406c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:28.134 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.129+0000 7f19abd22700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f19a406ab80 0x7f19a406c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:28.134 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.129+0000 7f19abd22700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19a415e320 con 0x7f19a40cf1c0 2023-11-08T19:26:28.135 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.129+0000 7f19abd22700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19a406b020 con 0x7f19a415df40 2023-11-08T19:26:28.135 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.129+0000 7f19abd22700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19a406b2e0 con 0x7f19a406ab80 2023-11-08T19:26:28.135 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.129+0000 7f19a9abe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f19a415df40 0x7f19a406c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:28.135 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.129+0000 7f19a9abe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f19a415df40 0x7f19a406c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42720/0 (socket says 172.21.15.149:42720) 2023-11-08T19:26:28.135 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.129+0000 7f19a9abe700 1 -- 172.21.15.149:0/3660535254 learned_addr learned my addr 172.21.15.149:0/3660535254 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:28.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.129+0000 7f19a92bd700 1 --2- 172.21.15.149:0/3660535254 >> v2:172.21.15.160:3300/0 conn(0x7f19a406ab80 0x7f19a406c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:28.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.129+0000 7f19a9abe700 1 -- 172.21.15.149:0/3660535254 >> v2:172.21.15.160:3300/0 conn(0x7f19a406ab80 msgr2=0x7f19a406c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:28.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.129+0000 7f19a9abe700 1 --2- 172.21.15.149:0/3660535254 >> v2:172.21.15.160:3300/0 conn(0x7f19a406ab80 0x7f19a406c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:28.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.129+0000 7f19a9abe700 1 -- 172.21.15.149:0/3660535254 >> v1:172.21.15.160:6789/0 conn(0x7f19a40cf1c0 legacy=0x7f19a40caf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:28.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.129+0000 7f19a9abe700 1 -- 172.21.15.149:0/3660535254 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a406b5c0 con 0x7f19a415df40 2023-11-08T19:26:28.137 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.129+0000 7f19a92bd700 1 --2- 172.21.15.149:0/3660535254 >> v2:172.21.15.160:3300/0 conn(0x7f19a406ab80 0x7f19a406c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:26:28.137 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.129+0000 7f19a9abe700 1 --2- 172.21.15.149:0/3660535254 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19a415df40 0x7f19a406c0a0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f19a406d940 tx=0x7f19a0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=726fa7ba371ca90a server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:28.137 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.129+0000 7f19a8abc700 1 -- 172.21.15.149:0/3660535254 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a0004230 con 0x7f19a415df40 2023-11-08T19:26:28.137 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.130+0000 7f19a8abc700 1 -- 172.21.15.149:0/3660535254 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a0004390 con 0x7f19a415df40 2023-11-08T19:26:28.137 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.130+0000 7f19a8abc700 1 -- 172.21.15.149:0/3660535254 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a00036a0 con 0x7f19a415df40 2023-11-08T19:26:28.138 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.130+0000 7f19abd22700 1 -- 172.21.15.149:0/3660535254 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19a415df40 msgr2=0x7f19a406c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:28.138 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.130+0000 7f19abd22700 1 --2- 172.21.15.149:0/3660535254 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19a415df40 0x7f19a406c0a0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f19a406d940 tx=0x7f19a0009bd0 comp rx=0 tx=0).stop 2023-11-08T19:26:28.138 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.130+0000 7f19abd22700 1 -- 172.21.15.149:0/3660535254 shutdown_connections 2023-11-08T19:26:28.138 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.130+0000 7f19abd22700 1 --2- 172.21.15.149:0/3660535254 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19a415df40 0x7f19a406c0a0 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:28.138 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.130+0000 7f19abd22700 1 --2- 172.21.15.149:0/3660535254 >> v2:172.21.15.160:3300/0 conn(0x7f19a406ab80 0x7f19a406c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:28.139 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.130+0000 7f19abd22700 1 -- 172.21.15.149:0/3660535254 >> 172.21.15.149:0/3660535254 conn(0x7f19a40d0640 msgr2=0x7f19a40d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:28.139 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.130+0000 7f19abd22700 1 -- 172.21.15.149:0/3660535254 shutdown_connections 2023-11-08T19:26:28.139 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.130+0000 7f19abd22700 1 -- 172.21.15.149:0/3660535254 wait complete. 2023-11-08T19:26:28.139 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.131+0000 7f19abd22700 1 Processor -- start 2023-11-08T19:26:28.139 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.131+0000 7f19abd22700 1 -- start start 2023-11-08T19:26:28.142 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.132+0000 7f19abd22700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19a406ab80 0x7f19a4157b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:28.142 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.132+0000 7f19abd22700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f19a40cf1c0 0x7f19a40c5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:28.143 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.132+0000 7f19abd22700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f19a415df40 0x7f19a41604c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:28.143 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.132+0000 7f19abd22700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a40c6b40 con 0x7f19a406ab80 2023-11-08T19:26:28.143 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.132+0000 7f19abd22700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a4158070 con 0x7f19a415df40 2023-11-08T19:26:28.143 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.132+0000 7f19abd22700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19a40c5f30 con 0x7f19a40cf1c0 2023-11-08T19:26:28.143 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.132+0000 7f19a9abe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19a406ab80 0x7f19a4157b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:28.144 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.132+0000 7f19a9abe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19a406ab80 0x7f19a4157b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42726/0 (socket says 172.21.15.149:42726) 2023-11-08T19:26:28.144 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.132+0000 7f19a9abe700 1 -- 172.21.15.149:0/915844398 learned_addr learned my addr 172.21.15.149:0/915844398 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:28.144 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.132+0000 7f19aa2bf700 1 --2- 172.21.15.149:0/915844398 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f19a415df40 0x7f19a41604c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:28.144 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.132+0000 7f19a92bd700 1 --2- 172.21.15.149:0/915844398 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f19a40cf1c0 0x7f19a40c5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:28.145 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.132+0000 7f19a9abe700 1 -- 172.21.15.149:0/915844398 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f19a40cf1c0 msgr2=0x7f19a40c5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:28.145 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.132+0000 7f19a9abe700 1 --2- 172.21.15.149:0/915844398 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f19a40cf1c0 0x7f19a40c5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:28.145 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.132+0000 7f19a9abe700 1 -- 172.21.15.149:0/915844398 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f19a415df40 msgr2=0x7f19a41604c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:28.145 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.132+0000 7f19a9abe700 1 --2- 172.21.15.149:0/915844398 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f19a415df40 0x7f19a41604c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:28.145 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.132+0000 7f19a9abe700 1 -- 172.21.15.149:0/915844398 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a0009550 con 0x7f19a406ab80 2023-11-08T19:26:28.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.133+0000 7f19a9abe700 1 --2- 172.21.15.149:0/915844398 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19a406ab80 0x7f19a4157b30 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f19a40ce1c0 tx=0x7f19a0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:28.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.133+0000 7f199a7fc700 1 -- 172.21.15.149:0/915844398 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a0003ea0 con 0x7f19a406ab80 2023-11-08T19:26:28.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.133+0000 7f199a7fc700 1 -- 172.21.15.149:0/915844398 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a0011630 con 0x7f19a406ab80 2023-11-08T19:26:28.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.133+0000 7f199a7fc700 1 -- 172.21.15.149:0/915844398 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a00119e0 con 0x7f19a406ab80 2023-11-08T19:26:28.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.133+0000 7f19abd22700 1 -- 172.21.15.149:0/915844398 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19a40c6210 con 0x7f19a406ab80 2023-11-08T19:26:28.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.133+0000 7f19abd22700 1 -- 172.21.15.149:0/915844398 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19a40c67d0 con 0x7f19a406ab80 2023-11-08T19:26:28.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.134+0000 7f19abd22700 1 -- 172.21.15.149:0/915844398 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19a40c6960 con 0x7f19a406ab80 2023-11-08T19:26:28.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.134+0000 7f199a7fc700 1 -- 172.21.15.149:0/915844398 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f19a0011b40 con 0x7f19a406ab80 2023-11-08T19:26:28.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.135+0000 7f199a7fc700 1 --2- 172.21.15.149:0/915844398 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f198806af00 0x7f198806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:28.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.135+0000 7f199a7fc700 1 -- 172.21.15.149:0/915844398 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f19a008b060 con 0x7f19a406ab80 2023-11-08T19:26:28.148 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.135+0000 7f19a92bd700 1 --2- 172.21.15.149:0/915844398 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f198806af00 0x7f198806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:28.148 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.135+0000 7f19a92bd700 1 --2- 172.21.15.149:0/915844398 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f198806af00 0x7f198806d3c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f19a41f6ca0 tx=0x7f1994008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:28.148 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.140+0000 7f199a7fc700 1 -- 172.21.15.149:0/915844398 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f19a0055c30 con 0x7f19a406ab80 2023-11-08T19:26:28.338 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.337+0000 7f19abd22700 1 -- 172.21.15.149:0/915844398 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7f19a404f730 con 0x7f19a406ab80 2023-11-08T19:26:28.339 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.337+0000 7f199a7fc700 1 -- 172.21.15.149:0/915844398 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v83) v1 ==== 107+0+11 (secure 0 0 0) 0x7f19a0059250 con 0x7f19a406ab80 2023-11-08T19:26:28.339 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:26:28.341 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.339+0000 7f19abd22700 1 -- 172.21.15.149:0/915844398 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f198806af00 msgr2=0x7f198806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:28.341 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.339+0000 7f19abd22700 1 --2- 172.21.15.149:0/915844398 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f198806af00 0x7f198806d3c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f19a41f6ca0 tx=0x7f1994008040 comp rx=0 tx=0).stop 2023-11-08T19:26:28.341 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.339+0000 7f19abd22700 1 -- 172.21.15.149:0/915844398 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19a406ab80 msgr2=0x7f19a4157b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:28.341 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.339+0000 7f19abd22700 1 --2- 172.21.15.149:0/915844398 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19a406ab80 0x7f19a4157b30 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f19a40ce1c0 tx=0x7f19a0004750 comp rx=0 tx=0).stop 2023-11-08T19:26:28.342 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.340+0000 7f19abd22700 1 -- 172.21.15.149:0/915844398 shutdown_connections 2023-11-08T19:26:28.342 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.340+0000 7f19abd22700 1 --2- 172.21.15.149:0/915844398 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f198806af00 0x7f198806d3c0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:28.342 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.340+0000 7f19abd22700 1 --2- 172.21.15.149:0/915844398 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f19a415df40 0x7f19a41604c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:28.342 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.340+0000 7f19abd22700 1 --2- 172.21.15.149:0/915844398 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19a406ab80 0x7f19a4157b30 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:28.342 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.340+0000 7f19abd22700 1 --2- 172.21.15.149:0/915844398 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f19a40cf1c0 0x7f19a40c5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:28.343 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.340+0000 7f19abd22700 1 -- 172.21.15.149:0/915844398 >> 172.21.15.149:0/915844398 conn(0x7f19a40d0640 msgr2=0x7f19a4158c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:28.343 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.340+0000 7f19abd22700 1 -- 172.21.15.149:0/915844398 shutdown_connections 2023-11-08T19:26:28.343 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.340+0000 7f19abd22700 1 -- 172.21.15.149:0/915844398 wait complete. 2023-11-08T19:26:28.353 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-08T19:26:28.477 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.476+0000 7fb4083de700 1 Processor -- start 2023-11-08T19:26:28.477 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.476+0000 7fb4083de700 1 -- start start 2023-11-08T19:26:28.480 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.477+0000 7fb4083de700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb40015abf0 0x7fb4000b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:28.480 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.477+0000 7fb4083de700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fb4000d1130 0x7fb4000cc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:28.480 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.477+0000 7fb4083de700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4000b6470 con 0x7fb4000cc6a0 2023-11-08T19:26:28.480 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.477+0000 7fb4083de700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4000b66a0 con 0x7fb40015abf0 2023-11-08T19:26:28.480 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.477+0000 7fb4083de700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4000d04a0 con 0x7fb4000d1130 2023-11-08T19:26:28.481 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.477+0000 7fb40617a700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb40015abf0 0x7fb4000b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:28.481 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.477+0000 7fb40617a700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb40015abf0 0x7fb4000b5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42736/0 (socket says 172.21.15.149:42736) 2023-11-08T19:26:28.481 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.477+0000 7fb40617a700 1 -- 172.21.15.149:0/2679273459 learned_addr learned my addr 172.21.15.149:0/2679273459 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:28.481 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.477+0000 7fb40617a700 1 -- 172.21.15.149:0/2679273459 >> v2:172.21.15.160:3300/0 conn(0x7fb4000d1130 msgr2=0x7fb4000cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:28.481 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.477+0000 7fb405979700 1 --2- 172.21.15.149:0/2679273459 >> v2:172.21.15.160:3300/0 conn(0x7fb4000d1130 0x7fb4000cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:28.482 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.477+0000 7fb40617a700 1 --2- 172.21.15.149:0/2679273459 >> v2:172.21.15.160:3300/0 conn(0x7fb4000d1130 0x7fb4000cc160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:28.482 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.477+0000 7fb40617a700 1 -- 172.21.15.149:0/2679273459 >> v1:172.21.15.160:6789/0 conn(0x7fb4000cc6a0 legacy=0x7fb4000ce210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:28.482 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.477+0000 7fb40617a700 1 -- 172.21.15.149:0/2679273459 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb40015afd0 con 0x7fb40015abf0 2023-11-08T19:26:28.482 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.478+0000 7fb40617a700 1 --2- 172.21.15.149:0/2679273459 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb40015abf0 0x7fb4000b5f30 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fb40006d910 tx=0x7fb3f0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f53312f5037aa778 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:28.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.478+0000 7fb405178700 1 -- 172.21.15.149:0/2679273459 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f0004230 con 0x7fb40015abf0 2023-11-08T19:26:28.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.478+0000 7fb405178700 1 -- 172.21.15.149:0/2679273459 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3f0004390 con 0x7fb40015abf0 2023-11-08T19:26:28.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.478+0000 7fb405178700 1 -- 172.21.15.149:0/2679273459 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f00036a0 con 0x7fb40015abf0 2023-11-08T19:26:28.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.478+0000 7fb4083de700 1 -- 172.21.15.149:0/2679273459 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb40015abf0 msgr2=0x7fb4000b5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:28.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.478+0000 7fb4083de700 1 --2- 172.21.15.149:0/2679273459 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb40015abf0 0x7fb4000b5f30 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fb40006d910 tx=0x7fb3f0009bd0 comp rx=0 tx=0).stop 2023-11-08T19:26:28.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.478+0000 7fb4083de700 1 -- 172.21.15.149:0/2679273459 shutdown_connections 2023-11-08T19:26:28.484 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.478+0000 7fb4083de700 1 --2- 172.21.15.149:0/2679273459 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb40015abf0 0x7fb4000b5f30 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:28.484 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.478+0000 7fb4083de700 1 --2- 172.21.15.149:0/2679273459 >> v2:172.21.15.160:3300/0 conn(0x7fb4000d1130 0x7fb4000cc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:28.484 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.478+0000 7fb4083de700 1 -- 172.21.15.149:0/2679273459 >> 172.21.15.149:0/2679273459 conn(0x7fb4000d0640 msgr2=0x7fb4000d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:28.484 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.478+0000 7fb4083de700 1 -- 172.21.15.149:0/2679273459 shutdown_connections 2023-11-08T19:26:28.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.478+0000 7fb4083de700 1 -- 172.21.15.149:0/2679273459 wait complete. 2023-11-08T19:26:28.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.480+0000 7fb4083de700 1 Processor -- start 2023-11-08T19:26:28.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.480+0000 7fb4083de700 1 -- start start 2023-11-08T19:26:28.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.480+0000 7fb4083de700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb4000cc6a0 0x7fb4000ad280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:28.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.480+0000 7fb4083de700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb4000d1130 0x7fb4001f6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:28.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.480+0000 7fb4083de700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb40015abf0 0x7fb4001f7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:28.490 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.480+0000 7fb4083de700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4000ad7c0 con 0x7fb40015abf0 2023-11-08T19:26:28.490 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.480+0000 7fb4083de700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4001f74e0 con 0x7fb4000cc6a0 2023-11-08T19:26:28.490 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.480+0000 7fb4083de700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4000b0de0 con 0x7fb4000d1130 2023-11-08T19:26:28.490 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.480+0000 7fb40697b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb40015abf0 0x7fb4001f7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:28.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.480+0000 7fb40697b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb40015abf0 0x7fb4001f7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42744/0 (socket says 172.21.15.149:42744) 2023-11-08T19:26:28.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.480+0000 7fb40697b700 1 -- 172.21.15.149:0/4229426496 learned_addr learned my addr 172.21.15.149:0/4229426496 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:28.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.481+0000 7fb40617a700 1 --2- 172.21.15.149:0/4229426496 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb4000cc6a0 0x7fb4000ad280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:28.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.481+0000 7fb405979700 1 --2- 172.21.15.149:0/4229426496 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb4000d1130 0x7fb4001f6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:28.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.481+0000 7fb40697b700 1 -- 172.21.15.149:0/4229426496 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb4000d1130 msgr2=0x7fb4001f6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:28.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.481+0000 7fb40697b700 1 --2- 172.21.15.149:0/4229426496 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb4000d1130 0x7fb4001f6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:28.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.481+0000 7fb40697b700 1 -- 172.21.15.149:0/4229426496 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb4000cc6a0 msgr2=0x7fb4000ad280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:28.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.481+0000 7fb40697b700 1 --2- 172.21.15.149:0/4229426496 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb4000cc6a0 0x7fb4000ad280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:28.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.481+0000 7fb40697b700 1 -- 172.21.15.149:0/4229426496 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3f0009550 con 0x7fb40015abf0 2023-11-08T19:26:28.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.481+0000 7fb40697b700 1 --2- 172.21.15.149:0/4229426496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb40015abf0 0x7fb4001f7c70 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fb3f800b970 tx=0x7fb3f800bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:28.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.481+0000 7fb3f6ffd700 1 -- 172.21.15.149:0/4229426496 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f800c930 con 0x7fb40015abf0 2023-11-08T19:26:28.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.481+0000 7fb3f6ffd700 1 -- 172.21.15.149:0/4229426496 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3f800cad0 con 0x7fb40015abf0 2023-11-08T19:26:28.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.481+0000 7fb4083de700 1 -- 172.21.15.149:0/4229426496 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4000b10c0 con 0x7fb40015abf0 2023-11-08T19:26:28.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.481+0000 7fb3f6ffd700 1 -- 172.21.15.149:0/4229426496 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f800ce80 con 0x7fb40015abf0 2023-11-08T19:26:28.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.481+0000 7fb4083de700 1 -- 172.21.15.149:0/4229426496 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4000b13a0 con 0x7fb40015abf0 2023-11-08T19:26:28.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.482+0000 7fb4083de700 1 -- 172.21.15.149:0/4229426496 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb40015e800 con 0x7fb40015abf0 2023-11-08T19:26:28.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.482+0000 7fb3f6ffd700 1 -- 172.21.15.149:0/4229426496 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb3f8014440 con 0x7fb40015abf0 2023-11-08T19:26:28.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.483+0000 7fb3f6ffd700 1 --2- 172.21.15.149:0/4229426496 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb3e406af00 0x7fb3e406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:28.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.483+0000 7fb3f6ffd700 1 -- 172.21.15.149:0/4229426496 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7fb3f80895f0 con 0x7fb40015abf0 2023-11-08T19:26:28.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.483+0000 7fb40617a700 1 --2- 172.21.15.149:0/4229426496 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb3e406af00 0x7fb3e406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:28.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.483+0000 7fb40617a700 1 --2- 172.21.15.149:0/4229426496 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb3e406af00 0x7fb3e406d3c0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fb3f0009130 tx=0x7fb3f0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:28.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.488+0000 7fb3f6ffd700 1 -- 172.21.15.149:0/4229426496 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb3f8054270 con 0x7fb40015abf0 2023-11-08T19:26:28.678 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.676+0000 7fb4083de700 1 -- 172.21.15.149:0/4229426496 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb40004f730 con 0x7fb40015abf0 2023-11-08T19:26:28.678 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.677+0000 7fb3f6ffd700 1 -- 172.21.15.149:0/4229426496 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v83) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb3f8057890 con 0x7fb40015abf0 2023-11-08T19:26:28.679 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:26:28.680 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.679+0000 7fb4083de700 1 -- 172.21.15.149:0/4229426496 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb3e406af00 msgr2=0x7fb3e406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:28.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.679+0000 7fb4083de700 1 --2- 172.21.15.149:0/4229426496 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb3e406af00 0x7fb3e406d3c0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fb3f0009130 tx=0x7fb3f0008030 comp rx=0 tx=0).stop 2023-11-08T19:26:28.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.679+0000 7fb4083de700 1 -- 172.21.15.149:0/4229426496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb40015abf0 msgr2=0x7fb4001f7c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:28.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.679+0000 7fb4083de700 1 --2- 172.21.15.149:0/4229426496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb40015abf0 0x7fb4001f7c70 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fb3f800b970 tx=0x7fb3f800bc80 comp rx=0 tx=0).stop 2023-11-08T19:26:28.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.679+0000 7fb4083de700 1 -- 172.21.15.149:0/4229426496 shutdown_connections 2023-11-08T19:26:28.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.679+0000 7fb4083de700 1 --2- 172.21.15.149:0/4229426496 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb3e406af00 0x7fb3e406d3c0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:28.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.679+0000 7fb4083de700 1 --2- 172.21.15.149:0/4229426496 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb4000cc6a0 0x7fb4000ad280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:28.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.679+0000 7fb4083de700 1 --2- 172.21.15.149:0/4229426496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb40015abf0 0x7fb4001f7c70 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:28.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.679+0000 7fb4083de700 1 --2- 172.21.15.149:0/4229426496 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb4000d1130 0x7fb4001f6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:28.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.679+0000 7fb4083de700 1 -- 172.21.15.149:0/4229426496 >> 172.21.15.149:0/4229426496 conn(0x7fb4000d0640 msgr2=0x7fb4000cd880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:28.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.679+0000 7fb4083de700 1 -- 172.21.15.149:0/4229426496 shutdown_connections 2023-11-08T19:26:28.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.679+0000 7fb4083de700 1 -- 172.21.15.149:0/4229426496 wait complete. 2023-11-08T19:26:28.693 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-08T19:26:28.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.816+0000 7f3377c36700 1 Processor -- start 2023-11-08T19:26:28.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.816+0000 7f3377c36700 1 -- start start 2023-11-08T19:26:28.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.817+0000 7f3377c36700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f337006ab80 0x7f33700caf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:28.820 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.817+0000 7f3377c36700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f33700cf1c0 0x7f33700cb490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:28.820 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.817+0000 7f3377c36700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f337015e320 con 0x7f337015df40 2023-11-08T19:26:28.820 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.817+0000 7f3377c36700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f337006b020 con 0x7f337006ab80 2023-11-08T19:26:28.820 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.817+0000 7f3377c36700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f337006b2e0 con 0x7f33700cf1c0 2023-11-08T19:26:28.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.818+0000 7f33751d1700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f337006ab80 0x7f33700caf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:28.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.818+0000 7f33761d3700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f33700cf1c0 0x7f33700cb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:28.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.818+0000 7f33759d2700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f337015df40 0x7f337006c0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.149:56416/0 (socket says 172.21.15.149:56416) 2023-11-08T19:26:28.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.818+0000 7f33759d2700 1 -- 172.21.15.149:0/2276475094 learned_addr learned my addr 172.21.15.149:0/2276475094 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:26:28.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.818+0000 7f33751d1700 1 -- 172.21.15.149:0/2276475094 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f33700cf1c0 msgr2=0x7f33700cb490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:28.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.818+0000 7f33751d1700 1 --2- 172.21.15.149:0/2276475094 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f33700cf1c0 0x7f33700cb490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:28.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.818+0000 7f33751d1700 1 -- 172.21.15.149:0/2276475094 >> v1:172.21.15.160:6789/0 conn(0x7f337015df40 legacy=0x7f337006c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:28.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.818+0000 7f33751d1700 1 -- 172.21.15.149:0/2276475094 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f337006b5c0 con 0x7f337006ab80 2023-11-08T19:26:28.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.818+0000 7f33761d3700 1 --2- 172.21.15.149:0/2276475094 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f33700cf1c0 0x7f33700cb490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:26:28.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.818+0000 7f33751d1700 1 --2- 172.21.15.149:0/2276475094 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f337006ab80 0x7f33700caf50 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f336c009840 tx=0x7f336c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32c9aee9e2cf0509 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:28.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.818+0000 7f33749d0700 1 -- 172.21.15.149:0/2276475094 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336c011830 con 0x7f337006ab80 2023-11-08T19:26:28.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.818+0000 7f33749d0700 1 -- 172.21.15.149:0/2276475094 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f336c011990 con 0x7f337006ab80 2023-11-08T19:26:28.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.818+0000 7f33749d0700 1 -- 172.21.15.149:0/2276475094 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336c011d20 con 0x7f337006ab80 2023-11-08T19:26:28.827 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.819+0000 7f3377c36700 1 -- 172.21.15.149:0/2276475094 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f337006ab80 msgr2=0x7f33700caf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:28.827 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.819+0000 7f3377c36700 1 --2- 172.21.15.149:0/2276475094 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f337006ab80 0x7f33700caf50 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f336c009840 tx=0x7f336c009b50 comp rx=0 tx=0).stop 2023-11-08T19:26:28.828 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.819+0000 7f3377c36700 1 -- 172.21.15.149:0/2276475094 shutdown_connections 2023-11-08T19:26:28.828 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.819+0000 7f3377c36700 1 --2- 172.21.15.149:0/2276475094 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f33700cf1c0 0x7f33700cb490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:28.828 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.819+0000 7f3377c36700 1 --2- 172.21.15.149:0/2276475094 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f337006ab80 0x7f33700caf50 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:28.828 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.819+0000 7f3377c36700 1 -- 172.21.15.149:0/2276475094 >> 172.21.15.149:0/2276475094 conn(0x7f33700d0640 msgr2=0x7f33700d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:28.828 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.819+0000 7f3377c36700 1 -- 172.21.15.149:0/2276475094 shutdown_connections 2023-11-08T19:26:28.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.819+0000 7f3377c36700 1 -- 172.21.15.149:0/2276475094 wait complete. 2023-11-08T19:26:28.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.820+0000 7f3377c36700 1 Processor -- start 2023-11-08T19:26:28.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.820+0000 7f3377c36700 1 -- start start 2023-11-08T19:26:28.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.821+0000 7f3377c36700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f337006ab80 0x7f3370157aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:28.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.821+0000 7f3377c36700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f33700cf1c0 0x7f337015f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:28.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.821+0000 7f3377c36700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f337015df40 0x7f337015b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:28.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.821+0000 7f3377c36700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f337015e550 con 0x7f337015df40 2023-11-08T19:26:28.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.821+0000 7f3377c36700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f337015e830 con 0x7f337006ab80 2023-11-08T19:26:28.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.821+0000 7f3377c36700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f337015eb10 con 0x7f33700cf1c0 2023-11-08T19:26:28.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.821+0000 7f33761d3700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f337015df40 0x7f337015b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:28.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.821+0000 7f33761d3700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f337015df40 0x7f337015b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42758/0 (socket says 172.21.15.149:42758) 2023-11-08T19:26:28.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.821+0000 7f33761d3700 1 -- 172.21.15.149:0/3348313585 learned_addr learned my addr 172.21.15.149:0/3348313585 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:28.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.821+0000 7f33759d2700 1 --2- 172.21.15.149:0/3348313585 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f337006ab80 0x7f3370157aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:28.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.821+0000 7f33751d1700 1 --2- 172.21.15.149:0/3348313585 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f33700cf1c0 0x7f337015f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:28.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.821+0000 7f33761d3700 1 -- 172.21.15.149:0/3348313585 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f33700cf1c0 msgr2=0x7f337015f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:28.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.821+0000 7f33761d3700 1 --2- 172.21.15.149:0/3348313585 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f33700cf1c0 0x7f337015f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:28.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.821+0000 7f33761d3700 1 -- 172.21.15.149:0/3348313585 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f337006ab80 msgr2=0x7f3370157aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:28.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.821+0000 7f33761d3700 1 --2- 172.21.15.149:0/3348313585 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f337006ab80 0x7f3370157aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:28.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.821+0000 7f33761d3700 1 -- 172.21.15.149:0/3348313585 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3368009a70 con 0x7f337015df40 2023-11-08T19:26:28.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.822+0000 7f33761d3700 1 --2- 172.21.15.149:0/3348313585 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f337015df40 0x7f337015b5b0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f336800ef90 tx=0x7f336800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:28.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.822+0000 7f33667fc700 1 -- 172.21.15.149:0/3348313585 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3368009d70 con 0x7f337015df40 2023-11-08T19:26:28.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.822+0000 7f33667fc700 1 -- 172.21.15.149:0/3348313585 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f336800f040 con 0x7f337015df40 2023-11-08T19:26:28.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.822+0000 7f3377c36700 1 -- 172.21.15.149:0/3348313585 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f336c0094a0 con 0x7f337015df40 2023-11-08T19:26:28.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.822+0000 7f33667fc700 1 -- 172.21.15.149:0/3348313585 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3368014480 con 0x7f337015df40 2023-11-08T19:26:28.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.822+0000 7f3377c36700 1 -- 172.21.15.149:0/3348313585 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f337015f0d0 con 0x7f337015df40 2023-11-08T19:26:28.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.823+0000 7f3377c36700 1 -- 172.21.15.149:0/3348313585 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f337015f2c0 con 0x7f337015df40 2023-11-08T19:26:28.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.823+0000 7f33667fc700 1 -- 172.21.15.149:0/3348313585 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f33680145e0 con 0x7f337015df40 2023-11-08T19:26:28.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.824+0000 7f33667fc700 1 --2- 172.21.15.149:0/3348313585 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f335406af00 0x7f335406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:28.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.824+0000 7f33667fc700 1 -- 172.21.15.149:0/3348313585 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f336808a8f0 con 0x7f337015df40 2023-11-08T19:26:28.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.824+0000 7f33759d2700 1 --2- 172.21.15.149:0/3348313585 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f335406af00 0x7f335406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:28.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.824+0000 7f33759d2700 1 --2- 172.21.15.149:0/3348313585 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f335406af00 0x7f335406d3c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f3360005910 tx=0x7f3360009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:28.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:28.829+0000 7f33667fc700 1 -- 172.21.15.149:0/3348313585 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3368055430 con 0x7f337015df40 2023-11-08T19:26:29.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.017+0000 7f3377c36700 1 -- 172.21.15.149:0/3348313585 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f337006c730 con 0x7f337015df40 2023-11-08T19:26:29.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.018+0000 7f33667fc700 1 -- 172.21.15.149:0/3348313585 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v83) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3368018020 con 0x7f337015df40 2023-11-08T19:26:29.019 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 64 2023-11-08T19:26:29.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.020+0000 7f3377c36700 1 -- 172.21.15.149:0/3348313585 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f335406af00 msgr2=0x7f335406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:29.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.020+0000 7f3377c36700 1 --2- 172.21.15.149:0/3348313585 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f335406af00 0x7f335406d3c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f3360005910 tx=0x7f3360009040 comp rx=0 tx=0).stop 2023-11-08T19:26:29.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.020+0000 7f3377c36700 1 -- 172.21.15.149:0/3348313585 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f337015df40 msgr2=0x7f337015b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:29.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.020+0000 7f3377c36700 1 --2- 172.21.15.149:0/3348313585 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f337015df40 0x7f337015b5b0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f336800ef90 tx=0x7f336800c3a0 comp rx=0 tx=0).stop 2023-11-08T19:26:29.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.020+0000 7f3377c36700 1 -- 172.21.15.149:0/3348313585 shutdown_connections 2023-11-08T19:26:29.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.020+0000 7f3377c36700 1 --2- 172.21.15.149:0/3348313585 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f335406af00 0x7f335406d3c0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:29.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.020+0000 7f3377c36700 1 --2- 172.21.15.149:0/3348313585 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f337006ab80 0x7f3370157aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:29.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.020+0000 7f3377c36700 1 --2- 172.21.15.149:0/3348313585 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f337015df40 0x7f337015b5b0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:29.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.020+0000 7f3377c36700 1 --2- 172.21.15.149:0/3348313585 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f33700cf1c0 0x7f337015f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:29.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.020+0000 7f3377c36700 1 -- 172.21.15.149:0/3348313585 >> 172.21.15.149:0/3348313585 conn(0x7f33700d0640 msgr2=0x7f33700b1170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:29.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.020+0000 7f3377c36700 1 -- 172.21.15.149:0/3348313585 shutdown_connections 2023-11-08T19:26:29.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.020+0000 7f3377c36700 1 -- 172.21.15.149:0/3348313585 wait complete. 2023-11-08T19:26:29.033 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-08T19:26:29.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.155+0000 7fce0682b700 1 Processor -- start 2023-11-08T19:26:29.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.155+0000 7fce0682b700 1 -- start start 2023-11-08T19:26:29.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.156+0000 7fce0682b700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce0015db70 0x7fce00161dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:29.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.156+0000 7fce0682b700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fce0006ab80 0x7fce0006b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:29.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.156+0000 7fce0682b700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce00161940 con 0x7fce000b2c00 2023-11-08T19:26:29.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.156+0000 7fce0682b700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce0006b570 con 0x7fce0006ab80 2023-11-08T19:26:29.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.156+0000 7fce0682b700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce0015e660 con 0x7fce0015db70 2023-11-08T19:26:29.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.156+0000 7fce04dc8700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fce0006ab80 0x7fce0006b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:29.161 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.156+0000 7fcdff7fe700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fce000b2c00 0x7fce0015df50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:44766/0 (socket says 172.21.15.149:44766) 2023-11-08T19:26:29.161 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.156+0000 7fcdff7fe700 1 -- 172.21.15.149:0/3661743063 learned_addr learned my addr 172.21.15.149:0/3661743063 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:26:29.161 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.156+0000 7fcdfffff700 1 --2- 172.21.15.149:0/3661743063 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce0015db70 0x7fce00161dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:29.161 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.157+0000 7fcdfeffd700 1 -- 172.21.15.149:0/3661743063 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 109517854 0 0) 0x7fce00161940 con 0x7fce000b2c00 2023-11-08T19:26:29.161 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.157+0000 7fcdfeffd700 1 -- 172.21.15.149:0/3661743063 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcdec0035b0 con 0x7fce000b2c00 2023-11-08T19:26:29.162 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.157+0000 7fce04dc8700 1 -- 172.21.15.149:0/3661743063 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce0015db70 msgr2=0x7fce00161dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:29.162 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.157+0000 7fce04dc8700 1 --2- 172.21.15.149:0/3661743063 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce0015db70 0x7fce00161dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:29.162 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.157+0000 7fce04dc8700 1 -- 172.21.15.149:0/3661743063 >> v1:172.21.15.149:6789/0 conn(0x7fce000b2c00 legacy=0x7fce0015df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:29.162 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.157+0000 7fce04dc8700 1 -- 172.21.15.149:0/3661743063 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce0015eeb0 con 0x7fce0006ab80 2023-11-08T19:26:29.163 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.157+0000 7fce04dc8700 1 --2- 172.21.15.149:0/3661743063 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce0006ab80 0x7fce0006b030 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fcdf8009d90 tx=0x7fcdf800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6c39266a876738f server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:29.163 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.157+0000 7fcdfeffd700 1 -- 172.21.15.149:0/3661743063 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf800e070 con 0x7fce0006ab80 2023-11-08T19:26:29.163 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.157+0000 7fcdfeffd700 1 -- 172.21.15.149:0/3661743063 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf800bb20 con 0x7fce0006ab80 2023-11-08T19:26:29.163 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.157+0000 7fcdfeffd700 1 -- 172.21.15.149:0/3661743063 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf8012430 con 0x7fce0006ab80 2023-11-08T19:26:29.163 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.157+0000 7fce0682b700 1 -- 172.21.15.149:0/3661743063 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce0006ab80 msgr2=0x7fce0006b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:29.164 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.157+0000 7fce0682b700 1 --2- 172.21.15.149:0/3661743063 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce0006ab80 0x7fce0006b030 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fcdf8009d90 tx=0x7fcdf800b330 comp rx=0 tx=0).stop 2023-11-08T19:26:29.164 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.157+0000 7fce0682b700 1 -- 172.21.15.149:0/3661743063 shutdown_connections 2023-11-08T19:26:29.164 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.157+0000 7fce0682b700 1 --2- 172.21.15.149:0/3661743063 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce0006ab80 0x7fce0006b030 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:29.164 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.157+0000 7fce0682b700 1 --2- 172.21.15.149:0/3661743063 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce0015db70 0x7fce00161dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:29.164 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.157+0000 7fce0682b700 1 -- 172.21.15.149:0/3661743063 >> 172.21.15.149:0/3661743063 conn(0x7fce000ccff0 msgr2=0x7fce000cd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:29.165 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.158+0000 7fce0682b700 1 -- 172.21.15.149:0/3661743063 shutdown_connections 2023-11-08T19:26:29.165 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.158+0000 7fce0682b700 1 -- 172.21.15.149:0/3661743063 wait complete. 2023-11-08T19:26:29.165 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.159+0000 7fce0682b700 1 Processor -- start 2023-11-08T19:26:29.167 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.159+0000 7fce0682b700 1 -- start start 2023-11-08T19:26:29.168 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.160+0000 7fce0682b700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce0006ab80 0x7fce001f2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:29.168 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.160+0000 7fce0682b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce000b2c00 0x7fce00071dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:29.168 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.160+0000 7fce0682b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce0015db70 0x7fce00072300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:29.168 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.160+0000 7fce0682b700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce001f2e50 con 0x7fce0015db70 2023-11-08T19:26:29.169 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.160+0000 7fce0682b700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce001f3dc0 con 0x7fce000b2c00 2023-11-08T19:26:29.169 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.160+0000 7fce0682b700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce0014b500 con 0x7fce0006ab80 2023-11-08T19:26:29.169 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.160+0000 7fce04dc8700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce0015db70 0x7fce00072300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:29.169 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.160+0000 7fce04dc8700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce0015db70 0x7fce00072300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42772/0 (socket says 172.21.15.149:42772) 2023-11-08T19:26:29.169 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.160+0000 7fce04dc8700 1 -- 172.21.15.149:0/1865519645 learned_addr learned my addr 172.21.15.149:0/1865519645 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:29.170 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.160+0000 7fcdff7fe700 1 --2- 172.21.15.149:0/1865519645 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce000b2c00 0x7fce00071dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:29.170 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.160+0000 7fce04dc8700 1 -- 172.21.15.149:0/1865519645 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce0006ab80 msgr2=0x7fce001f2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:29.170 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.160+0000 7fce04dc8700 1 --2- 172.21.15.149:0/1865519645 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce0006ab80 0x7fce001f2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:29.170 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.160+0000 7fce04dc8700 1 -- 172.21.15.149:0/1865519645 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce000b2c00 msgr2=0x7fce00071dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:29.170 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.160+0000 7fce04dc8700 1 --2- 172.21.15.149:0/1865519645 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce000b2c00 0x7fce00071dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:29.171 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.160+0000 7fce04dc8700 1 -- 172.21.15.149:0/1865519645 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf8009a70 con 0x7fce0015db70 2023-11-08T19:26:29.171 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.160+0000 7fce04dc8700 1 --2- 172.21.15.149:0/1865519645 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce0015db70 0x7fce00072300 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fcdf8014040 tx=0x7fcdf8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:29.172 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.160+0000 7fcdfcff9700 1 -- 172.21.15.149:0/1865519645 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf80129f0 con 0x7fce0015db70 2023-11-08T19:26:29.172 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.160+0000 7fcdfcff9700 1 -- 172.21.15.149:0/1865519645 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf8020070 con 0x7fce0015db70 2023-11-08T19:26:29.172 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.160+0000 7fce0682b700 1 -- 172.21.15.149:0/1865519645 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce0014b7e0 con 0x7fce0015db70 2023-11-08T19:26:29.172 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.160+0000 7fcdfcff9700 1 -- 172.21.15.149:0/1865519645 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf8012db0 con 0x7fce0015db70 2023-11-08T19:26:29.173 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.160+0000 7fce0682b700 1 -- 172.21.15.149:0/1865519645 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce0014bda0 con 0x7fce0015db70 2023-11-08T19:26:29.173 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.161+0000 7fce0682b700 1 -- 172.21.15.149:0/1865519645 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce000745f0 con 0x7fce0015db70 2023-11-08T19:26:29.173 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.162+0000 7fcdfcff9700 1 -- 172.21.15.149:0/1865519645 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcdf8004040 con 0x7fce0015db70 2023-11-08T19:26:29.173 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.162+0000 7fcdfcff9700 1 --2- 172.21.15.149:0/1865519645 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fcde006af00 0x7fcde006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:29.173 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.162+0000 7fcdfcff9700 1 -- 172.21.15.149:0/1865519645 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7fcdf8022070 con 0x7fce0015db70 2023-11-08T19:26:29.174 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.162+0000 7fcdfffff700 1 --2- 172.21.15.149:0/1865519645 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fcde006af00 0x7fcde006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:29.174 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.163+0000 7fcdfffff700 1 --2- 172.21.15.149:0/1865519645 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fcde006af00 0x7fcde006d3c0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fcdf0006b20 tx=0x7fcdf0006ab0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:29.174 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.167+0000 7fcdfcff9700 1 -- 172.21.15.149:0/1865519645 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcdf8056590 con 0x7fce0015db70 2023-11-08T19:26:29.379 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.378+0000 7fce0682b700 1 -- 172.21.15.149:0/1865519645 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fce000b64f0 con 0x7fce0015db70 2023-11-08T19:26:29.379 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.378+0000 7fcdfcff9700 1 -- 172.21.15.149:0/1865519645 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v83) v1 ==== 80+0+0 (secure 0 0 0) 0x7fcdf8059bb0 con 0x7fce0015db70 2023-11-08T19:26:29.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.380+0000 7fce0682b700 1 -- 172.21.15.149:0/1865519645 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fcde006af00 msgr2=0x7fcde006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:29.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.380+0000 7fce0682b700 1 --2- 172.21.15.149:0/1865519645 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fcde006af00 0x7fcde006d3c0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fcdf0006b20 tx=0x7fcdf0006ab0 comp rx=0 tx=0).stop 2023-11-08T19:26:29.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.380+0000 7fce0682b700 1 -- 172.21.15.149:0/1865519645 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce0015db70 msgr2=0x7fce00072300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:29.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.380+0000 7fce0682b700 1 --2- 172.21.15.149:0/1865519645 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce0015db70 0x7fce00072300 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fcdf8014040 tx=0x7fcdf8004ad0 comp rx=0 tx=0).stop 2023-11-08T19:26:29.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.380+0000 7fce0682b700 1 -- 172.21.15.149:0/1865519645 shutdown_connections 2023-11-08T19:26:29.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.380+0000 7fce0682b700 1 --2- 172.21.15.149:0/1865519645 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fcde006af00 0x7fcde006d3c0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:29.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.380+0000 7fce0682b700 1 --2- 172.21.15.149:0/1865519645 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce0015db70 0x7fce00072300 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:29.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.380+0000 7fce0682b700 1 --2- 172.21.15.149:0/1865519645 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce0006ab80 0x7fce001f2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:29.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.380+0000 7fce0682b700 1 --2- 172.21.15.149:0/1865519645 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce000b2c00 0x7fce00071dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:29.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.380+0000 7fce0682b700 1 -- 172.21.15.149:0/1865519645 >> 172.21.15.149:0/1865519645 conn(0x7fce000ccff0 msgr2=0x7fce0015df50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:29.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.381+0000 7fce0682b700 1 -- 172.21.15.149:0/1865519645 shutdown_connections 2023-11-08T19:26:29.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.381+0000 7fce0682b700 1 -- 172.21.15.149:0/1865519645 wait complete. 2023-11-08T19:26:29.385 INFO:teuthology.orchestra.run.smithi149.stderr:listed 0 entries 2023-11-08T19:26:29.394 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-08T19:26:29.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:26:29.394 DEBUG:teuthology.orchestra.run.smithi149:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-08T19:26:29.440 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi149.front.sepia.ceph.com 2023-11-08T19:26:29.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:26:29.441 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-08T19:26:29.458 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-11-08T19:26:29.458 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:26:29.480 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284272k,nr_inodes=4071068,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16330 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-08T19:26:29.480 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-11-08T19:26:29.480 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:26:29.514 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=8026740k,nr_inodes=2006685,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=31,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15303 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1609048k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-11-08T19:26:29.515 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-11-08T19:26:29.515 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:26:29.540 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284272k,nr_inodes=4071068,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16330 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-08T19:26:29.540 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:26:29.675 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.674+0000 7fb45fc80700 1 Processor -- start 2023-11-08T19:26:29.675 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.674+0000 7fb45fc80700 1 -- start start 2023-11-08T19:26:29.678 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.675+0000 7fb45fc80700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb45815a780 0x7fb45806f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:29.679 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.675+0000 7fb45fc80700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fb4580cfce0 0x7fb45815ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:29.679 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.675+0000 7fb45fc80700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb458072df0 con 0x7fb45815ef50 2023-11-08T19:26:29.679 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.675+0000 7fb45fc80700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb45806fdc0 con 0x7fb4580cfce0 2023-11-08T19:26:29.679 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.675+0000 7fb45fc80700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4580700a0 con 0x7fb45815a780 2023-11-08T19:26:29.679 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.675+0000 7fb45e21d700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fb45815ef50 0x7fb4580b1ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:44782/0 (socket says 172.21.15.149:44782) 2023-11-08T19:26:29.680 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.675+0000 7fb45e21d700 1 -- 172.21.15.149:0/3866261382 learned_addr learned my addr 172.21.15.149:0/3866261382 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:26:29.680 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.675+0000 7fb45ca1a700 1 -- 172.21.15.149:0/3866261382 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 360878238 0 0) 0x7fb458072df0 con 0x7fb45815ef50 2023-11-08T19:26:29.680 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.675+0000 7fb45d21b700 1 --2- 172.21.15.149:0/3866261382 >> v2:172.21.15.160:3300/0 conn(0x7fb4580cfce0 0x7fb45815ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:29.680 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.675+0000 7fb45ca1a700 1 -- 172.21.15.149:0/3866261382 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4440035b0 con 0x7fb45815ef50 2023-11-08T19:26:29.680 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.675+0000 7fb45da1c700 1 --2- 172.21.15.149:0/3866261382 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb45815a780 0x7fb45806f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:29.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.675+0000 7fb45ca1a700 1 -- 172.21.15.149:0/3866261382 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1120542453 0 0) 0x7fb4440035b0 con 0x7fb45815ef50 2023-11-08T19:26:29.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.675+0000 7fb45ca1a700 1 -- 172.21.15.149:0/3866261382 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb45815a780 msgr2=0x7fb45806f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:29.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.675+0000 7fb45ca1a700 1 --2- 172.21.15.149:0/3866261382 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb45815a780 0x7fb45806f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:29.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.675+0000 7fb45ca1a700 1 -- 172.21.15.149:0/3866261382 >> v2:172.21.15.160:3300/0 conn(0x7fb4580cfce0 msgr2=0x7fb45815ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:29.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.675+0000 7fb45ca1a700 1 --2- 172.21.15.149:0/3866261382 >> v2:172.21.15.160:3300/0 conn(0x7fb4580cfce0 0x7fb45815ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:29.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.675+0000 7fb45ca1a700 1 -- 172.21.15.149:0/3866261382 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb458070660 con 0x7fb45815ef50 2023-11-08T19:26:29.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.675+0000 7fb45ca1a700 1 -- 172.21.15.149:0/3866261382 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7fb4500019f0 con 0x7fb45815ef50 2023-11-08T19:26:29.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.675+0000 7fb45ca1a700 1 -- 172.21.15.149:0/3866261382 >> v1:172.21.15.149:6789/0 conn(0x7fb45815ef50 legacy=0x7fb4580b1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:29.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.675+0000 7fb45ca1a700 1 --2- 172.21.15.149:0/3866261382 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb444003a00 0x7fb444003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:29.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.675+0000 7fb45ca1a700 1 --2- 172.21.15.149:0/3866261382 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb444004850 0x7fb444004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:29.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.675+0000 7fb45ca1a700 1 --2- 172.21.15.149:0/3866261382 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb45815a780 0x7fb444005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:29.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.675+0000 7fb45ca1a700 1 -- 172.21.15.149:0/3866261382 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45806fdc0 con 0x7fb444004850 2023-11-08T19:26:29.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.675+0000 7fb45ca1a700 1 -- 172.21.15.149:0/3866261382 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4580700a0 con 0x7fb444003a00 2023-11-08T19:26:29.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.675+0000 7fb45ca1a700 1 -- 172.21.15.149:0/3866261382 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb44400ba10 con 0x7fb45815a780 2023-11-08T19:26:29.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.676+0000 7fb45d21b700 1 --2- 172.21.15.149:0/3866261382 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb444004850 0x7fb444004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:29.684 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.676+0000 7fb45e21d700 1 --2- 172.21.15.149:0/3866261382 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb45815a780 0x7fb444005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:29.684 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.676+0000 7fb45da1c700 1 --2- 172.21.15.149:0/3866261382 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb444003a00 0x7fb444003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:29.684 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.676+0000 7fb45d21b700 1 -- 172.21.15.149:0/3866261382 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb45815a780 msgr2=0x7fb444005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:29.684 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.676+0000 7fb45d21b700 1 --2- 172.21.15.149:0/3866261382 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb45815a780 0x7fb444005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:29.685 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.676+0000 7fb45d21b700 1 -- 172.21.15.149:0/3866261382 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb444003a00 msgr2=0x7fb444003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:29.685 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.676+0000 7fb45d21b700 1 --2- 172.21.15.149:0/3866261382 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb444003a00 0x7fb444003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:29.685 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.676+0000 7fb45d21b700 1 -- 172.21.15.149:0/3866261382 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4440035b0 con 0x7fb444004850 2023-11-08T19:26:29.685 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.676+0000 7fb45da1c700 1 --2- 172.21.15.149:0/3866261382 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb444003a00 0x7fb444003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:26:29.685 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.676+0000 7fb45d21b700 1 --2- 172.21.15.149:0/3866261382 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb444004850 0x7fb444004cd0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fb448009b60 tx=0x7fb444005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb909bff17a6241 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:29.686 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.676+0000 7fb45ca1a700 1 -- 172.21.15.149:0/3866261382 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44800e6c0 con 0x7fb444004850 2023-11-08T19:26:29.686 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.676+0000 7fb45ca1a700 1 -- 172.21.15.149:0/3866261382 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb44800e820 con 0x7fb444004850 2023-11-08T19:26:29.686 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.676+0000 7fb45ca1a700 1 -- 172.21.15.149:0/3866261382 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44800eb90 con 0x7fb444004850 2023-11-08T19:26:29.686 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.677+0000 7fb45fc80700 1 -- 172.21.15.149:0/3866261382 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb444004850 msgr2=0x7fb444004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:29.686 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.677+0000 7fb45fc80700 1 --2- 172.21.15.149:0/3866261382 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb444004850 0x7fb444004cd0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fb448009b60 tx=0x7fb444005880 comp rx=0 tx=0).stop 2023-11-08T19:26:29.687 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.677+0000 7fb45e21d700 1 -- 172.21.15.149:0/3866261382 reap_dead start 2023-11-08T19:26:29.687 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.677+0000 7fb45fc80700 1 -- 172.21.15.149:0/3866261382 shutdown_connections 2023-11-08T19:26:29.687 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.677+0000 7fb45fc80700 1 -- 172.21.15.149:0/3866261382 >> 172.21.15.149:0/3866261382 conn(0x7fb4580ccff0 msgr2=0x7fb4580cd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:29.688 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.677+0000 7fb45fc80700 1 -- 172.21.15.149:0/3866261382 shutdown_connections 2023-11-08T19:26:29.688 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.677+0000 7fb45fc80700 1 -- 172.21.15.149:0/3866261382 wait complete. 2023-11-08T19:26:29.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.678+0000 7fb45fc80700 1 Processor -- start 2023-11-08T19:26:29.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.678+0000 7fb45fc80700 1 -- start start 2023-11-08T19:26:29.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.679+0000 7fb45fc80700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb444004850 0x7fb458151e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:29.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.679+0000 7fb45fc80700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb4580b4af0 0x7fb4580b1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:29.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.679+0000 7fb45fc80700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4580b2490 0x7fb4580b2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:29.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.679+0000 7fb45fc80700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4580b2940 con 0x7fb4580b2490 2023-11-08T19:26:29.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.679+0000 7fb45fc80700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4581559d0 con 0x7fb4580b4af0 2023-11-08T19:26:29.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.679+0000 7fb45fc80700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4580b4660 con 0x7fb444004850 2023-11-08T19:26:29.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.679+0000 7fb45e21d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4580b2490 0x7fb4580b2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:29.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.679+0000 7fb45e21d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4580b2490 0x7fb4580b2e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42792/0 (socket says 172.21.15.149:42792) 2023-11-08T19:26:29.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.679+0000 7fb45e21d700 1 -- 172.21.15.149:0/3738889009 learned_addr learned my addr 172.21.15.149:0/3738889009 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:29.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.679+0000 7fb45da1c700 1 --2- 172.21.15.149:0/3738889009 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb444004850 0x7fb458151e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:29.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.679+0000 7fb45d21b700 1 --2- 172.21.15.149:0/3738889009 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb4580b4af0 0x7fb4580b1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:29.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.679+0000 7fb45e21d700 1 -- 172.21.15.149:0/3738889009 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb444004850 msgr2=0x7fb458151e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:29.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.679+0000 7fb45e21d700 1 --2- 172.21.15.149:0/3738889009 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb444004850 0x7fb458151e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:29.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.679+0000 7fb45e21d700 1 -- 172.21.15.149:0/3738889009 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb4580b4af0 msgr2=0x7fb4580b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:29.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.679+0000 7fb45e21d700 1 --2- 172.21.15.149:0/3738889009 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb4580b4af0 0x7fb4580b1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:29.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.679+0000 7fb45e21d700 1 -- 172.21.15.149:0/3738889009 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4580b3a50 con 0x7fb4580b2490 2023-11-08T19:26:29.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.679+0000 7fb45d21b700 1 --2- 172.21.15.149:0/3738889009 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb4580b4af0 0x7fb4580b1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:26:29.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.679+0000 7fb45da1c700 1 --2- 172.21.15.149:0/3738889009 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb444004850 0x7fb458151e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:26:29.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.679+0000 7fb45e21d700 1 --2- 172.21.15.149:0/3738889009 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4580b2490 0x7fb4580b2e70 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fb45815e290 tx=0x7fb45000e4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:29.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.679+0000 7fb44e7fc700 1 -- 172.21.15.149:0/3738889009 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb450017070 con 0x7fb4580b2490 2023-11-08T19:26:29.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.679+0000 7fb44e7fc700 1 -- 172.21.15.149:0/3738889009 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb45000ed80 con 0x7fb4580b2490 2023-11-08T19:26:29.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.679+0000 7fb45fc80700 1 -- 172.21.15.149:0/3738889009 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4580b3d30 con 0x7fb4580b2490 2023-11-08T19:26:29.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.679+0000 7fb44e7fc700 1 -- 172.21.15.149:0/3738889009 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb450013420 con 0x7fb4580b2490 2023-11-08T19:26:29.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.679+0000 7fb45fc80700 1 -- 172.21.15.149:0/3738889009 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4580b42f0 con 0x7fb4580b2490 2023-11-08T19:26:29.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.680+0000 7fb45fc80700 1 -- 172.21.15.149:0/3738889009 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4580b6580 con 0x7fb4580b2490 2023-11-08T19:26:29.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.681+0000 7fb44e7fc700 1 -- 172.21.15.149:0/3738889009 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb450013580 con 0x7fb4580b2490 2023-11-08T19:26:29.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.681+0000 7fb44e7fc700 1 --2- 172.21.15.149:0/3738889009 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb43c06af00 0x7fb43c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:29.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.681+0000 7fb44e7fc700 1 -- 172.21.15.149:0/3738889009 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7fb450089890 con 0x7fb4580b2490 2023-11-08T19:26:29.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.681+0000 7fb45da1c700 1 --2- 172.21.15.149:0/3738889009 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb43c06af00 0x7fb43c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:29.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.682+0000 7fb45da1c700 1 --2- 172.21.15.149:0/3738889009 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb43c06af00 0x7fb43c06d3c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fb4580cab90 tx=0x7fb454008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:29.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.686+0000 7fb44e7fc700 1 -- 172.21.15.149:0/3738889009 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb450054460 con 0x7fb4580b2490 2023-11-08T19:26:29.921 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.920+0000 7fb45fc80700 1 -- 172.21.15.149:0/3738889009 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb4580745f0 con 0x7fb4580b2490 2023-11-08T19:26:29.921 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.920+0000 7fb44e7fc700 1 -- 172.21.15.149:0/3738889009 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4912 (secure 0 0 0) 0x7fb450057a80 con 0x7fb4580b2490 2023-11-08T19:26:29.922 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:26:29.922 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":46,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5681,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/1946892292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":1946892292},{"type":"v1","addr":"172.21.15.160:6835","nonce":1946892292}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39},{"gid":6145,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/84105573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":84105573},{"type":"v1","addr":"172.21.15.160:6833","nonce":84105573}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39},{"gid":6663,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/3243545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3243545},{"type":"v1","addr":"172.21.15.149:6836","nonce":3243545}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:11.529336+0000","modified":"2023-11-08T19:26:25.656271+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6666},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6666":{"gid":6666,"name":"a","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6837/1594746264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":1594746264},{"type":"v1","addr":"172.21.15.149:6837","nonce":1594746264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-08T19:26:29.924 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.922+0000 7fb45fc80700 1 -- 172.21.15.149:0/3738889009 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb43c06af00 msgr2=0x7fb43c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:29.924 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.922+0000 7fb45fc80700 1 --2- 172.21.15.149:0/3738889009 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb43c06af00 0x7fb43c06d3c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fb4580cab90 tx=0x7fb454008040 comp rx=0 tx=0).stop 2023-11-08T19:26:29.924 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.922+0000 7fb45fc80700 1 -- 172.21.15.149:0/3738889009 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4580b2490 msgr2=0x7fb4580b2e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:29.924 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.922+0000 7fb45fc80700 1 --2- 172.21.15.149:0/3738889009 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4580b2490 0x7fb4580b2e70 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fb45815e290 tx=0x7fb45000e4f0 comp rx=0 tx=0).stop 2023-11-08T19:26:29.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.922+0000 7fb45fc80700 1 -- 172.21.15.149:0/3738889009 shutdown_connections 2023-11-08T19:26:29.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.922+0000 7fb45fc80700 1 --2- 172.21.15.149:0/3738889009 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb43c06af00 0x7fb43c06d3c0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:29.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.922+0000 7fb45fc80700 1 --2- 172.21.15.149:0/3738889009 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4580b2490 0x7fb4580b2e70 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:29.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.922+0000 7fb45fc80700 1 --2- 172.21.15.149:0/3738889009 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb444004850 0x7fb458151e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:29.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.922+0000 7fb45fc80700 1 --2- 172.21.15.149:0/3738889009 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb4580b4af0 0x7fb4580b1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:29.926 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.922+0000 7fb45fc80700 1 -- 172.21.15.149:0/3738889009 >> 172.21.15.149:0/3738889009 conn(0x7fb4580ccff0 msgr2=0x7fb458158e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:29.926 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.922+0000 7fb45fc80700 1 -- 172.21.15.149:0/3738889009 shutdown_connections 2023-11-08T19:26:29.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:29.922+0000 7fb45fc80700 1 -- 172.21.15.149:0/3738889009 wait complete. 2023-11-08T19:26:29.927 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 46 2023-11-08T19:26:29.936 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:26:30.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.057+0000 7fb77721c700 1 Processor -- start 2023-11-08T19:26:30.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.057+0000 7fb77721c700 1 -- start start 2023-11-08T19:26:30.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.058+0000 7fb77721c700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fb77006fe40 0x7fb77006f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:30.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.058+0000 7fb77721c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb7700d2060 0x7fb77006c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:30.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.058+0000 7fb77721c700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb77006bd50 con 0x7fb77015dc30 2023-11-08T19:26:30.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.058+0000 7fb77721c700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7700d04b0 con 0x7fb77006fe40 2023-11-08T19:26:30.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.058+0000 7fb77721c700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7700d0730 con 0x7fb7700d2060 2023-11-08T19:26:30.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.058+0000 7fb774fb8700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fb77015dc30 0x7fb77006f730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:44798/0 (socket says 172.21.15.149:44798) 2023-11-08T19:26:30.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.058+0000 7fb774fb8700 1 -- 172.21.15.149:0/3675085018 learned_addr learned my addr 172.21.15.149:0/3675085018 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:26:30.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.058+0000 7fb76ffff700 1 --2- 172.21.15.149:0/3675085018 >> v2:172.21.15.160:3300/0 conn(0x7fb77006fe40 0x7fb77006f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:30.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.058+0000 7fb7757b9700 1 --2- 172.21.15.149:0/3675085018 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb7700d2060 0x7fb77006c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:30.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.058+0000 7fb76f7fe700 1 -- 172.21.15.149:0/3675085018 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2021172546 0 0) 0x7fb77006bd50 con 0x7fb77015dc30 2023-11-08T19:26:30.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.058+0000 7fb76f7fe700 1 -- 172.21.15.149:0/3675085018 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7600035b0 con 0x7fb77015dc30 2023-11-08T19:26:30.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.058+0000 7fb76f7fe700 1 -- 172.21.15.149:0/3675085018 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4173055816 0 0) 0x7fb7600035b0 con 0x7fb77015dc30 2023-11-08T19:26:30.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.058+0000 7fb76f7fe700 1 -- 172.21.15.149:0/3675085018 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb7700d2060 msgr2=0x7fb77006c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:30.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.058+0000 7fb76f7fe700 1 --2- 172.21.15.149:0/3675085018 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb7700d2060 0x7fb77006c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:30.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.058+0000 7fb76f7fe700 1 -- 172.21.15.149:0/3675085018 >> v2:172.21.15.160:3300/0 conn(0x7fb77006fe40 msgr2=0x7fb77006f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:30.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.058+0000 7fb76f7fe700 1 --2- 172.21.15.149:0/3675085018 >> v2:172.21.15.160:3300/0 conn(0x7fb77006fe40 0x7fb77006f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:30.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.058+0000 7fb76f7fe700 1 -- 172.21.15.149:0/3675085018 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7700d0a10 con 0x7fb77015dc30 2023-11-08T19:26:30.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.058+0000 7fb76f7fe700 1 -- 172.21.15.149:0/3675085018 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7fb7640017f0 con 0x7fb77015dc30 2023-11-08T19:26:30.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.058+0000 7fb76f7fe700 1 -- 172.21.15.149:0/3675085018 >> v1:172.21.15.149:6789/0 conn(0x7fb77015dc30 legacy=0x7fb77006f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:30.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.059+0000 7fb76f7fe700 1 --2- 172.21.15.149:0/3675085018 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb7700d2060 0x7fb760003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:30.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.059+0000 7fb76f7fe700 1 --2- 172.21.15.149:0/3675085018 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb760003f80 0x7fb760004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:30.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.059+0000 7fb76f7fe700 1 --2- 172.21.15.149:0/3675085018 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb760004d90 0x7fb760005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:30.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.059+0000 7fb76f7fe700 1 -- 172.21.15.149:0/3675085018 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7700d04b0 con 0x7fb760003f80 2023-11-08T19:26:30.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.059+0000 7fb76f7fe700 1 -- 172.21.15.149:0/3675085018 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7700d0730 con 0x7fb760004d90 2023-11-08T19:26:30.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.059+0000 7fb76f7fe700 1 -- 172.21.15.149:0/3675085018 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb76000ba10 con 0x7fb7700d2060 2023-11-08T19:26:30.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.059+0000 7fb76ffff700 1 --2- 172.21.15.149:0/3675085018 >> v2:172.21.15.160:3300/0 conn(0x7fb77006fe40 0x7fb77006f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:26:30.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.059+0000 7fb774fb8700 1 --2- 172.21.15.149:0/3675085018 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb7700d2060 0x7fb760003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:30.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.059+0000 7fb7757b9700 1 --2- 172.21.15.149:0/3675085018 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb760004d90 0x7fb760005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:30.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.059+0000 7fb76ffff700 1 --2- 172.21.15.149:0/3675085018 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb760003f80 0x7fb760004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:30.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.059+0000 7fb76ffff700 1 -- 172.21.15.149:0/3675085018 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb7700d2060 msgr2=0x7fb760003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:30.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.059+0000 7fb76ffff700 1 --2- 172.21.15.149:0/3675085018 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb7700d2060 0x7fb760003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:30.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.059+0000 7fb76ffff700 1 -- 172.21.15.149:0/3675085018 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb760004d90 msgr2=0x7fb760005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:30.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.059+0000 7fb76ffff700 1 --2- 172.21.15.149:0/3675085018 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb760004d90 0x7fb760005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:30.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.059+0000 7fb76ffff700 1 -- 172.21.15.149:0/3675085018 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7600035b0 con 0x7fb760003f80 2023-11-08T19:26:30.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.059+0000 7fb76ffff700 1 --2- 172.21.15.149:0/3675085018 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb760003f80 0x7fb760004850 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fb75c009d10 tx=0x7fb760005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3c5dca5571d8fff server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:30.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.059+0000 7fb76f7fe700 1 -- 172.21.15.149:0/3675085018 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75c009e60 con 0x7fb760003f80 2023-11-08T19:26:30.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.059+0000 7fb76f7fe700 1 -- 172.21.15.149:0/3675085018 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb75c004030 con 0x7fb760003f80 2023-11-08T19:26:30.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.059+0000 7fb76f7fe700 1 -- 172.21.15.149:0/3675085018 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75c0043a0 con 0x7fb760003f80 2023-11-08T19:26:30.070 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.060+0000 7fb77721c700 1 -- 172.21.15.149:0/3675085018 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb760003f80 msgr2=0x7fb760004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:30.070 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.060+0000 7fb77721c700 1 --2- 172.21.15.149:0/3675085018 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb760003f80 0x7fb760004850 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fb75c009d10 tx=0x7fb760005880 comp rx=0 tx=0).stop 2023-11-08T19:26:30.070 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.060+0000 7fb7757b9700 1 -- 172.21.15.149:0/3675085018 reap_dead start 2023-11-08T19:26:30.070 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.060+0000 7fb77721c700 1 -- 172.21.15.149:0/3675085018 shutdown_connections 2023-11-08T19:26:30.070 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.060+0000 7fb77721c700 1 -- 172.21.15.149:0/3675085018 >> 172.21.15.149:0/3675085018 conn(0x7fb77008afd0 msgr2=0x7fb7700d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:30.071 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.060+0000 7fb77721c700 1 -- 172.21.15.149:0/3675085018 shutdown_connections 2023-11-08T19:26:30.071 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.060+0000 7fb77721c700 1 -- 172.21.15.149:0/3675085018 wait complete. 2023-11-08T19:26:30.071 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.061+0000 7fb77721c700 1 Processor -- start 2023-11-08T19:26:30.071 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.061+0000 7fb77721c700 1 -- start start 2023-11-08T19:26:30.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.062+0000 7fb77721c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb760003f80 0x7fb7700cb460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:30.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.062+0000 7fb77721c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb7700b59a0 0x7fb7701f2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:30.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.062+0000 7fb77721c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7700c8810 0x7fb770154960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:30.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.062+0000 7fb77721c700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7700b5ea0 con 0x7fb7700c8810 2023-11-08T19:26:30.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.062+0000 7fb77721c700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb770153990 con 0x7fb7700b59a0 2023-11-08T19:26:30.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.062+0000 7fb77721c700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb770153ba0 con 0x7fb760003f80 2023-11-08T19:26:30.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.062+0000 7fb7757b9700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7700c8810 0x7fb770154960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:30.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.062+0000 7fb7757b9700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7700c8810 0x7fb770154960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42812/0 (socket says 172.21.15.149:42812) 2023-11-08T19:26:30.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.062+0000 7fb7757b9700 1 -- 172.21.15.149:0/2212647619 learned_addr learned my addr 172.21.15.149:0/2212647619 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:30.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.062+0000 7fb76ffff700 1 --2- 172.21.15.149:0/2212647619 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb7700b59a0 0x7fb7701f2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:30.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.062+0000 7fb774fb8700 1 --2- 172.21.15.149:0/2212647619 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb760003f80 0x7fb7700cb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:30.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.062+0000 7fb7757b9700 1 -- 172.21.15.149:0/2212647619 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb760003f80 msgr2=0x7fb7700cb460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:30.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.062+0000 7fb7757b9700 1 --2- 172.21.15.149:0/2212647619 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb760003f80 0x7fb7700cb460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:30.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.062+0000 7fb7757b9700 1 -- 172.21.15.149:0/2212647619 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb7700b59a0 msgr2=0x7fb7701f2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:30.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.062+0000 7fb7757b9700 1 --2- 172.21.15.149:0/2212647619 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb7700b59a0 0x7fb7701f2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:30.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.062+0000 7fb7757b9700 1 -- 172.21.15.149:0/2212647619 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb770153e80 con 0x7fb7700c8810 2023-11-08T19:26:30.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.062+0000 7fb76ffff700 1 --2- 172.21.15.149:0/2212647619 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb7700b59a0 0x7fb7701f2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:26:30.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.062+0000 7fb7757b9700 1 --2- 172.21.15.149:0/2212647619 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7700c8810 0x7fb770154960 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fb77008bca0 tx=0x7fb768011f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:30.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.063+0000 7fb76d7fa700 1 -- 172.21.15.149:0/2212647619 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76800e040 con 0x7fb7700c8810 2023-11-08T19:26:30.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.063+0000 7fb76d7fa700 1 -- 172.21.15.149:0/2212647619 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb76800f040 con 0x7fb7700c8810 2023-11-08T19:26:30.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.063+0000 7fb77721c700 1 -- 172.21.15.149:0/2212647619 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb770154160 con 0x7fb7700c8810 2023-11-08T19:26:30.078 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.063+0000 7fb76d7fa700 1 -- 172.21.15.149:0/2212647619 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76800fdb0 con 0x7fb7700c8810 2023-11-08T19:26:30.078 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.063+0000 7fb77721c700 1 -- 172.21.15.149:0/2212647619 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7700b4710 con 0x7fb7700c8810 2023-11-08T19:26:30.078 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.064+0000 7fb77721c700 1 -- 172.21.15.149:0/2212647619 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb770154680 con 0x7fb7700c8810 2023-11-08T19:26:30.078 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.064+0000 7fb76d7fa700 1 -- 172.21.15.149:0/2212647619 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb768022460 con 0x7fb7700c8810 2023-11-08T19:26:30.078 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.064+0000 7fb76d7fa700 1 --2- 172.21.15.149:0/2212647619 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb75406af00 0x7fb75406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:30.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.064+0000 7fb76d7fa700 1 -- 172.21.15.149:0/2212647619 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7fb76808a030 con 0x7fb7700c8810 2023-11-08T19:26:30.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.065+0000 7fb774fb8700 1 --2- 172.21.15.149:0/2212647619 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb75406af00 0x7fb75406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:30.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.065+0000 7fb774fb8700 1 --2- 172.21.15.149:0/2212647619 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb75406af00 0x7fb75406d3c0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fb7640011d0 tx=0x7fb764009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:30.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.069+0000 7fb76d7fa700 1 -- 172.21.15.149:0/2212647619 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb770154680 con 0x7fb7700c8810 2023-11-08T19:26:30.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.259+0000 7fb77721c700 1 -- 172.21.15.149:0/2212647619 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb770154680 con 0x7fb7700c8810 2023-11-08T19:26:30.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.261+0000 7fb76d7fa700 1 -- 172.21.15.149:0/2212647619 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+21989 (secure 0 0 0) 0x7fb770154680 con 0x7fb7700c8810 2023-11-08T19:26:30.262 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:26:30.262 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":83,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:26:13.148903+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-08T19:24:29.516185+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-08T19:25:44.287064+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":71,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-08T19:25:45.623521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-11-08T19:26:09.267609+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-11-08T19:26:10.496194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:26:30.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.263+0000 7fb77721c700 1 -- 172.21.15.149:0/2212647619 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb75406af00 msgr2=0x7fb75406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:30.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.263+0000 7fb77721c700 1 --2- 172.21.15.149:0/2212647619 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb75406af00 0x7fb75406d3c0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fb7640011d0 tx=0x7fb764009040 comp rx=0 tx=0).stop 2023-11-08T19:26:30.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.263+0000 7fb77721c700 1 -- 172.21.15.149:0/2212647619 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7700c8810 msgr2=0x7fb770154960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:30.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.263+0000 7fb77721c700 1 --2- 172.21.15.149:0/2212647619 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7700c8810 0x7fb770154960 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fb77008bca0 tx=0x7fb768011f80 comp rx=0 tx=0).stop 2023-11-08T19:26:30.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.263+0000 7fb77721c700 1 -- 172.21.15.149:0/2212647619 shutdown_connections 2023-11-08T19:26:30.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.263+0000 7fb77721c700 1 --2- 172.21.15.149:0/2212647619 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb75406af00 0x7fb75406d3c0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:30.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.263+0000 7fb77721c700 1 --2- 172.21.15.149:0/2212647619 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7700c8810 0x7fb770154960 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:30.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.263+0000 7fb77721c700 1 --2- 172.21.15.149:0/2212647619 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb760003f80 0x7fb7700cb460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:30.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.263+0000 7fb77721c700 1 --2- 172.21.15.149:0/2212647619 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb7700b59a0 0x7fb7701f2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:30.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.263+0000 7fb77721c700 1 -- 172.21.15.149:0/2212647619 >> 172.21.15.149:0/2212647619 conn(0x7fb77008afd0 msgr2=0x7fb77006ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:30.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.263+0000 7fb77721c700 1 -- 172.21.15.149:0/2212647619 shutdown_connections 2023-11-08T19:26:30.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.263+0000 7fb77721c700 1 -- 172.21.15.149:0/2212647619 wait complete. 2023-11-08T19:26:30.277 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-08T19:22:56.023194+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-08T19:24:29.516185+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 42, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_data_pool', 'create_time': '2023-11-08T19:25:44.287064+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 71, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-08T19:25:45.623521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-08T19:26:09.267609+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2023-11-08T19:26:10.496194+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-08T19:26:30.278 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-08T19:26:30.402 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.401+0000 7f4182c04700 1 Processor -- start 2023-11-08T19:26:30.403 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.401+0000 7f4182c04700 1 -- start start 2023-11-08T19:26:30.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.402+0000 7f4182c04700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f417c0cf320 0x7f417c0cf740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:30.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.402+0000 7f4182c04700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f417c15be80 con 0x7f417c0cc0d0 2023-11-08T19:26:30.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.402+0000 7f4182c04700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f417c0cfc80 con 0x7f417c15f470 2023-11-08T19:26:30.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.402+0000 7f4182c04700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f417c0ccbc0 con 0x7f417c0cf320 2023-11-08T19:26:30.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.402+0000 7f41809a0700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f417c0cc0d0 0x7f417c0cc4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:44818/0 (socket says 172.21.15.149:44818) 2023-11-08T19:26:30.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.402+0000 7f41809a0700 1 -- 172.21.15.149:0/2606079778 learned_addr learned my addr 172.21.15.149:0/2606079778 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:26:30.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.402+0000 7f417b7fe700 1 -- 172.21.15.149:0/2606079778 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 39784491 0 0) 0x7f417c15be80 con 0x7f417c0cc0d0 2023-11-08T19:26:30.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.402+0000 7f417b7fe700 1 -- 172.21.15.149:0/2606079778 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f416c0035b0 con 0x7f417c0cc0d0 2023-11-08T19:26:30.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.402+0000 7f41811a1700 1 --2- 172.21.15.149:0/2606079778 >> v2:172.21.15.160:3300/0 conn(0x7f417c0cf320 0x7f417c0cf740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:30.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.402+0000 7f417b7fe700 1 -- 172.21.15.149:0/2606079778 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 440948564 0 0) 0x7f416c0035b0 con 0x7f417c0cc0d0 2023-11-08T19:26:30.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.402+0000 7f417b7fe700 1 -- 172.21.15.149:0/2606079778 >> v2:172.21.15.160:3300/0 conn(0x7f417c0cf320 msgr2=0x7f417c0cf740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:30.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.402+0000 7f417b7fe700 1 --2- 172.21.15.149:0/2606079778 >> v2:172.21.15.160:3300/0 conn(0x7f417c0cf320 0x7f417c0cf740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:30.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.402+0000 7f417b7fe700 1 -- 172.21.15.149:0/2606079778 >> v1:172.21.15.160:6789/0 conn(0x7f417c15f470 legacy=0x7f417c15c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:30.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.402+0000 7f417b7fe700 1 -- 172.21.15.149:0/2606079778 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f417c15f8d0 con 0x7f417c0cc0d0 2023-11-08T19:26:30.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.402+0000 7f417b7fe700 1 -- 172.21.15.149:0/2606079778 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f4170001670 con 0x7f417c0cc0d0 2023-11-08T19:26:30.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.403+0000 7f417b7fe700 1 -- 172.21.15.149:0/2606079778 >> v1:172.21.15.149:6789/0 conn(0x7f417c0cc0d0 legacy=0x7f417c0cc4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:30.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.403+0000 7f417b7fe700 1 --2- 172.21.15.149:0/2606079778 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f416c003a70 0x7f416c003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:30.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.403+0000 7f417b7fe700 1 --2- 172.21.15.149:0/2606079778 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f416c004850 0x7f416c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:30.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.403+0000 7f417b7fe700 1 --2- 172.21.15.149:0/2606079778 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f416c005210 0x7f416c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:30.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.403+0000 7f417b7fe700 1 -- 172.21.15.149:0/2606079778 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f417c0ccbc0 con 0x7f416c004850 2023-11-08T19:26:30.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.403+0000 7f417b7fe700 1 -- 172.21.15.149:0/2606079778 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f416c00c140 con 0x7f416c005210 2023-11-08T19:26:30.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.403+0000 7f417b7fe700 1 -- 172.21.15.149:0/2606079778 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f416c00c300 con 0x7f416c003a70 2023-11-08T19:26:30.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.403+0000 7f417bfff700 1 --2- 172.21.15.149:0/2606079778 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f416c004850 0x7f416c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:30.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.403+0000 7f41809a0700 1 --2- 172.21.15.149:0/2606079778 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f416c003a70 0x7f416c003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:30.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.403+0000 7f41811a1700 1 --2- 172.21.15.149:0/2606079778 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f416c005210 0x7f416c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:30.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.403+0000 7f417bfff700 1 -- 172.21.15.149:0/2606079778 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f416c003a70 msgr2=0x7f416c003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:30.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.403+0000 7f417bfff700 1 --2- 172.21.15.149:0/2606079778 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f416c003a70 0x7f416c003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:30.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.403+0000 7f417bfff700 1 -- 172.21.15.149:0/2606079778 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f416c005210 msgr2=0x7f416c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:30.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.403+0000 7f417bfff700 1 --2- 172.21.15.149:0/2606079778 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f416c005210 0x7f416c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:30.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.403+0000 7f41811a1700 1 -- 172.21.15.149:0/2606079778 reap_dead start 2023-11-08T19:26:30.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.403+0000 7f417bfff700 1 -- 172.21.15.149:0/2606079778 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f416c0035b0 con 0x7f416c004850 2023-11-08T19:26:30.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.403+0000 7f41809a0700 1 --2- 172.21.15.149:0/2606079778 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f416c003a70 0x7f416c003e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:26:30.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.403+0000 7f417bfff700 1 --2- 172.21.15.149:0/2606079778 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f416c004850 0x7f416c004cd0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f4168001800 tx=0x7f416c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa6fb51e8dfcc956 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:30.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.403+0000 7f417b7fe700 1 -- 172.21.15.149:0/2606079778 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41680012f0 con 0x7f416c004850 2023-11-08T19:26:30.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.403+0000 7f417b7fe700 1 -- 172.21.15.149:0/2606079778 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4168005310 con 0x7f416c004850 2023-11-08T19:26:30.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.403+0000 7f417b7fe700 1 -- 172.21.15.149:0/2606079778 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4168006860 con 0x7f416c004850 2023-11-08T19:26:30.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.404+0000 7f4182c04700 1 -- 172.21.15.149:0/2606079778 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f416c004850 msgr2=0x7f416c004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:30.414 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.404+0000 7f4182c04700 1 --2- 172.21.15.149:0/2606079778 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f416c004850 0x7f416c004cd0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f4168001800 tx=0x7f416c005880 comp rx=0 tx=0).stop 2023-11-08T19:26:30.414 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.404+0000 7f4182c04700 1 -- 172.21.15.149:0/2606079778 shutdown_connections 2023-11-08T19:26:30.414 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.404+0000 7f4182c04700 1 --2- 172.21.15.149:0/2606079778 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f416c004850 0x7f416c004cd0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:30.414 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.404+0000 7f4182c04700 1 -- 172.21.15.149:0/2606079778 >> 172.21.15.149:0/2606079778 conn(0x7f417c06f120 msgr2=0x7f417c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:30.414 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.404+0000 7f4182c04700 1 -- 172.21.15.149:0/2606079778 shutdown_connections 2023-11-08T19:26:30.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.404+0000 7f4182c04700 1 -- 172.21.15.149:0/2606079778 wait complete. 2023-11-08T19:26:30.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.405+0000 7f4182c04700 1 Processor -- start 2023-11-08T19:26:30.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.405+0000 7f4182c04700 1 -- start start 2023-11-08T19:26:30.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.406+0000 7f4182c04700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f416c004850 0x7f417c0c5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:30.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.406+0000 7f4182c04700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f417c15e1c0 0x7f417c14ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:30.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.406+0000 7f4182c04700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f417c15d570 0x7f417c15d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:30.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.406+0000 7f4182c04700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f417c15df30 con 0x7f417c15d570 2023-11-08T19:26:30.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.406+0000 7f4182c04700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f417c0c6050 con 0x7f417c15e1c0 2023-11-08T19:26:30.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.406+0000 7f4182c04700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f417c0c5a90 con 0x7f416c004850 2023-11-08T19:26:30.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.407+0000 7f41811a1700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f417c15d570 0x7f417c15d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:30.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.407+0000 7f41811a1700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f417c15d570 0x7f417c15d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42832/0 (socket says 172.21.15.149:42832) 2023-11-08T19:26:30.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.407+0000 7f41811a1700 1 -- 172.21.15.149:0/3887890342 learned_addr learned my addr 172.21.15.149:0/3887890342 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:30.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.407+0000 7f41809a0700 1 --2- 172.21.15.149:0/3887890342 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f416c004850 0x7f417c0c5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:30.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.407+0000 7f417bfff700 1 --2- 172.21.15.149:0/3887890342 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f417c15e1c0 0x7f417c14ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:30.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.407+0000 7f41811a1700 1 -- 172.21.15.149:0/3887890342 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f416c004850 msgr2=0x7f417c0c5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:30.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.407+0000 7f41811a1700 1 --2- 172.21.15.149:0/3887890342 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f416c004850 0x7f417c0c5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:30.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.407+0000 7f41811a1700 1 -- 172.21.15.149:0/3887890342 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f417c15e1c0 msgr2=0x7f417c14ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:30.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.407+0000 7f41811a1700 1 --2- 172.21.15.149:0/3887890342 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f417c15e1c0 0x7f417c14ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:30.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.407+0000 7f41811a1700 1 -- 172.21.15.149:0/3887890342 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f417c0c5d70 con 0x7f417c15d570 2023-11-08T19:26:30.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.407+0000 7f41809a0700 1 --2- 172.21.15.149:0/3887890342 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f416c004850 0x7f417c0c5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:26:30.422 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.407+0000 7f417bfff700 1 --2- 172.21.15.149:0/3887890342 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f417c15e1c0 0x7f417c14ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:26:30.422 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.407+0000 7f41811a1700 1 --2- 172.21.15.149:0/3887890342 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f417c15d570 0x7f417c15d9f0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f417c0b0ba0 tx=0x7f41740114b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:30.422 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.407+0000 7f41797fa700 1 -- 172.21.15.149:0/3887890342 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417400e070 con 0x7f417c15d570 2023-11-08T19:26:30.422 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.407+0000 7f41797fa700 1 -- 172.21.15.149:0/3887890342 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4174003c30 con 0x7f417c15d570 2023-11-08T19:26:30.422 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.407+0000 7f4182c04700 1 -- 172.21.15.149:0/3887890342 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f417c0c89a0 con 0x7f417c15d570 2023-11-08T19:26:30.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.407+0000 7f41797fa700 1 -- 172.21.15.149:0/3887890342 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4174003e00 con 0x7f417c15d570 2023-11-08T19:26:30.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.407+0000 7f4182c04700 1 -- 172.21.15.149:0/3887890342 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f417c0c57a0 con 0x7f417c15d570 2023-11-08T19:26:30.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.408+0000 7f4182c04700 1 -- 172.21.15.149:0/3887890342 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f417c04f730 con 0x7f417c15d570 2023-11-08T19:26:30.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.409+0000 7f41797fa700 1 -- 172.21.15.149:0/3887890342 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f41740119e0 con 0x7f417c15d570 2023-11-08T19:26:30.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.409+0000 7f41797fa700 1 --2- 172.21.15.149:0/3887890342 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f416006af00 0x7f416006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:30.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.409+0000 7f41809a0700 1 --2- 172.21.15.149:0/3887890342 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f416006af00 0x7f416006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:30.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.409+0000 7f41797fa700 1 -- 172.21.15.149:0/3887890342 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f417408a170 con 0x7f417c15d570 2023-11-08T19:26:30.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.410+0000 7f41809a0700 1 --2- 172.21.15.149:0/3887890342 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f416006af00 0x7f416006d3c0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f4170001eb0 tx=0x7f4170009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:30.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.414+0000 7f41797fa700 1 -- 172.21.15.149:0/3887890342 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4174054d40 con 0x7f417c15d570 2023-11-08T19:26:30.605 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.604+0000 7f4182c04700 1 -- 172.21.15.149:0/3887890342 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f417c160130 con 0x7f417c15d570 2023-11-08T19:26:30.606 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.604+0000 7f41797fa700 1 -- 172.21.15.149:0/3887890342 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v83) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4174014350 con 0x7f417c15d570 2023-11-08T19:26:30.606 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 1 2023-11-08T19:26:30.608 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.606+0000 7f4182c04700 1 -- 172.21.15.149:0/3887890342 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f416006af00 msgr2=0x7f416006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:30.608 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.606+0000 7f4182c04700 1 --2- 172.21.15.149:0/3887890342 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f416006af00 0x7f416006d3c0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f4170001eb0 tx=0x7f4170009040 comp rx=0 tx=0).stop 2023-11-08T19:26:30.609 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.606+0000 7f4182c04700 1 -- 172.21.15.149:0/3887890342 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f417c15d570 msgr2=0x7f417c15d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:30.609 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.606+0000 7f4182c04700 1 --2- 172.21.15.149:0/3887890342 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f417c15d570 0x7f417c15d9f0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f417c0b0ba0 tx=0x7f41740114b0 comp rx=0 tx=0).stop 2023-11-08T19:26:30.609 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.606+0000 7f4182c04700 1 -- 172.21.15.149:0/3887890342 shutdown_connections 2023-11-08T19:26:30.610 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.606+0000 7f4182c04700 1 --2- 172.21.15.149:0/3887890342 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f416006af00 0x7f416006d3c0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:30.610 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.606+0000 7f4182c04700 1 --2- 172.21.15.149:0/3887890342 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f417c15d570 0x7f417c15d9f0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:30.610 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.606+0000 7f4182c04700 1 --2- 172.21.15.149:0/3887890342 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f416c004850 0x7f417c0c5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:30.612 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.607+0000 7f4182c04700 1 --2- 172.21.15.149:0/3887890342 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f417c15e1c0 0x7f417c14ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:30.612 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.607+0000 7f4182c04700 1 -- 172.21.15.149:0/3887890342 >> 172.21.15.149:0/3887890342 conn(0x7f417c06f120 msgr2=0x7f417c15b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:30.612 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.607+0000 7f4182c04700 1 -- 172.21.15.149:0/3887890342 shutdown_connections 2023-11-08T19:26:30.612 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.607+0000 7f4182c04700 1 -- 172.21.15.149:0/3887890342 wait complete. 2023-11-08T19:26:30.620 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-08T19:26:30.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.742+0000 7fcd4bcc8700 1 Processor -- start 2023-11-08T19:26:30.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.742+0000 7fcd4bcc8700 1 -- start start 2023-11-08T19:26:30.747 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.743+0000 7fcd4bcc8700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fcd440cc0d0 0x7fcd4415f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:30.747 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.743+0000 7fcd4bcc8700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd440cc4b0 0x7fcd4415c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:30.748 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.743+0000 7fcd4bcc8700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd4415be80 con 0x7fcd4415cb60 2023-11-08T19:26:30.748 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.743+0000 7fcd4bcc8700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd4415f9b0 con 0x7fcd440cc0d0 2023-11-08T19:26:30.748 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.743+0000 7fcd4bcc8700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4415fba0 con 0x7fcd440cc4b0 2023-11-08T19:26:30.748 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.743+0000 7fcd4a265700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fcd4415cb60 0x7fcd440cf320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:44842/0 (socket says 172.21.15.149:44842) 2023-11-08T19:26:30.748 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.743+0000 7fcd4a265700 1 -- 172.21.15.149:0/1119985171 learned_addr learned my addr 172.21.15.149:0/1119985171 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:26:30.749 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.743+0000 7fcd48a62700 1 -- 172.21.15.149:0/1119985171 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2298415903 0 0) 0x7fcd4415be80 con 0x7fcd4415cb60 2023-11-08T19:26:30.749 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.743+0000 7fcd49a64700 1 --2- 172.21.15.149:0/1119985171 >> v2:172.21.15.160:3300/0 conn(0x7fcd440cc0d0 0x7fcd4415f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:30.749 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.743+0000 7fcd48a62700 1 -- 172.21.15.149:0/1119985171 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd300035b0 con 0x7fcd4415cb60 2023-11-08T19:26:30.749 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.743+0000 7fcd49263700 1 --2- 172.21.15.149:0/1119985171 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd440cc4b0 0x7fcd4415c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:30.749 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.743+0000 7fcd48a62700 1 -- 172.21.15.149:0/1119985171 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4002162870 0 0) 0x7fcd300035b0 con 0x7fcd4415cb60 2023-11-08T19:26:30.749 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.743+0000 7fcd48a62700 1 -- 172.21.15.149:0/1119985171 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd440cc4b0 msgr2=0x7fcd4415c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:30.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.743+0000 7fcd48a62700 1 --2- 172.21.15.149:0/1119985171 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd440cc4b0 0x7fcd4415c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:30.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.743+0000 7fcd48a62700 1 -- 172.21.15.149:0/1119985171 >> v2:172.21.15.160:3300/0 conn(0x7fcd440cc0d0 msgr2=0x7fcd4415f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:30.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.743+0000 7fcd48a62700 1 --2- 172.21.15.149:0/1119985171 >> v2:172.21.15.160:3300/0 conn(0x7fcd440cc0d0 0x7fcd4415f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:30.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.743+0000 7fcd48a62700 1 -- 172.21.15.149:0/1119985171 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd4415fe80 con 0x7fcd4415cb60 2023-11-08T19:26:30.751 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.743+0000 7fcd48a62700 1 -- 172.21.15.149:0/1119985171 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7fcd3c0019f0 con 0x7fcd4415cb60 2023-11-08T19:26:30.751 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.743+0000 7fcd48a62700 1 -- 172.21.15.149:0/1119985171 >> v1:172.21.15.149:6789/0 conn(0x7fcd4415cb60 legacy=0x7fcd440cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:30.751 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.744+0000 7fcd48a62700 1 --2- 172.21.15.149:0/1119985171 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd440cc4b0 0x7fcd30003a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:30.751 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.744+0000 7fcd48a62700 1 --2- 172.21.15.149:0/1119985171 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcd30003ff0 0x7fcd30004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:30.751 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.744+0000 7fcd48a62700 1 --2- 172.21.15.149:0/1119985171 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd30004d90 0x7fcd30005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:30.752 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.744+0000 7fcd48a62700 1 -- 172.21.15.149:0/1119985171 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4415fba0 con 0x7fcd30004d90 2023-11-08T19:26:30.752 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.744+0000 7fcd48a62700 1 -- 172.21.15.149:0/1119985171 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3000ba10 con 0x7fcd30003ff0 2023-11-08T19:26:30.752 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.744+0000 7fcd48a62700 1 -- 172.21.15.149:0/1119985171 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3000bb80 con 0x7fcd440cc4b0 2023-11-08T19:26:30.752 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.744+0000 7fcd4a265700 1 --2- 172.21.15.149:0/1119985171 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd30004d90 0x7fcd30005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:30.752 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.744+0000 7fcd49a64700 1 --2- 172.21.15.149:0/1119985171 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd440cc4b0 0x7fcd30003a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:30.752 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.744+0000 7fcd49263700 1 --2- 172.21.15.149:0/1119985171 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcd30003ff0 0x7fcd30004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:30.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.744+0000 7fcd4a265700 1 -- 172.21.15.149:0/1119985171 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd440cc4b0 msgr2=0x7fcd30003a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:30.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.744+0000 7fcd4a265700 1 --2- 172.21.15.149:0/1119985171 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd440cc4b0 0x7fcd30003a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:30.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.744+0000 7fcd4a265700 1 -- 172.21.15.149:0/1119985171 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcd30003ff0 msgr2=0x7fcd30004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:30.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.744+0000 7fcd4a265700 1 --2- 172.21.15.149:0/1119985171 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcd30003ff0 0x7fcd30004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:30.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.744+0000 7fcd4a265700 1 -- 172.21.15.149:0/1119985171 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd300035b0 con 0x7fcd30004d90 2023-11-08T19:26:30.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.744+0000 7fcd4a265700 1 --2- 172.21.15.149:0/1119985171 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd30004d90 0x7fcd30005210 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c00a860 tx=0x7fcd30005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=667a4b9cb40ca219 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:30.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.744+0000 7fcd48a62700 1 -- 172.21.15.149:0/1119985171 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c012600 con 0x7fcd30004d90 2023-11-08T19:26:30.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.744+0000 7fcd48a62700 1 -- 172.21.15.149:0/1119985171 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd3c012760 con 0x7fcd30004d90 2023-11-08T19:26:30.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.744+0000 7fcd48a62700 1 -- 172.21.15.149:0/1119985171 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c012b10 con 0x7fcd30004d90 2023-11-08T19:26:30.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.745+0000 7fcd4bcc8700 1 -- 172.21.15.149:0/1119985171 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd30004d90 msgr2=0x7fcd30005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:30.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.745+0000 7fcd4bcc8700 1 --2- 172.21.15.149:0/1119985171 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd30004d90 0x7fcd30005210 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c00a860 tx=0x7fcd30005880 comp rx=0 tx=0).stop 2023-11-08T19:26:30.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.745+0000 7fcd4a265700 1 -- 172.21.15.149:0/1119985171 reap_dead start 2023-11-08T19:26:30.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.745+0000 7fcd4bcc8700 1 -- 172.21.15.149:0/1119985171 shutdown_connections 2023-11-08T19:26:30.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.745+0000 7fcd4bcc8700 1 -- 172.21.15.149:0/1119985171 >> 172.21.15.149:0/1119985171 conn(0x7fcd4406f120 msgr2=0x7fcd4406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:30.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.745+0000 7fcd4bcc8700 1 -- 172.21.15.149:0/1119985171 shutdown_connections 2023-11-08T19:26:30.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.745+0000 7fcd4bcc8700 1 -- 172.21.15.149:0/1119985171 wait complete. 2023-11-08T19:26:30.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.746+0000 7fcd4bcc8700 1 Processor -- start 2023-11-08T19:26:30.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.746+0000 7fcd4bcc8700 1 -- start start 2023-11-08T19:26:30.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.747+0000 7fcd4bcc8700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd44155ec0 0x7fcd440c96d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:30.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.747+0000 7fcd4bcc8700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd440b2040 0x7fcd441f0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:30.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.747+0000 7fcd4bcc8700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcd441f1340 0x7fcd440b3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:30.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.747+0000 7fcd4bcc8700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd441562a0 con 0x7fcd440b2040 2023-11-08T19:26:30.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.747+0000 7fcd4bcc8700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd440b2570 con 0x7fcd441f1340 2023-11-08T19:26:30.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.747+0000 7fcd4bcc8700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd440b2850 con 0x7fcd44155ec0 2023-11-08T19:26:30.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.747+0000 7fcd49263700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd440b2040 0x7fcd441f0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:30.760 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.747+0000 7fcd49263700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd440b2040 0x7fcd441f0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42850/0 (socket says 172.21.15.149:42850) 2023-11-08T19:26:30.760 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.747+0000 7fcd49263700 1 -- 172.21.15.149:0/877547456 learned_addr learned my addr 172.21.15.149:0/877547456 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:30.760 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.747+0000 7fcd49a64700 1 --2- 172.21.15.149:0/877547456 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd44155ec0 0x7fcd440c96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:30.760 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.747+0000 7fcd4a265700 1 --2- 172.21.15.149:0/877547456 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcd441f1340 0x7fcd440b3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:30.760 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.747+0000 7fcd49263700 1 -- 172.21.15.149:0/877547456 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd44155ec0 msgr2=0x7fcd440c96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:30.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.747+0000 7fcd49263700 1 --2- 172.21.15.149:0/877547456 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd44155ec0 0x7fcd440c96d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:30.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.747+0000 7fcd49263700 1 -- 172.21.15.149:0/877547456 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcd441f1340 msgr2=0x7fcd440b3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:30.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.747+0000 7fcd49263700 1 --2- 172.21.15.149:0/877547456 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcd441f1340 0x7fcd440b3610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:30.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.747+0000 7fcd49263700 1 -- 172.21.15.149:0/877547456 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd440b2b30 con 0x7fcd440b2040 2023-11-08T19:26:30.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.747+0000 7fcd49263700 1 --2- 172.21.15.149:0/877547456 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd440b2040 0x7fcd441f0e00 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fcd340119a0 tx=0x7fcd34011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:30.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.747+0000 7fcd3a7fc700 1 -- 172.21.15.149:0/877547456 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3400f940 con 0x7fcd440b2040 2023-11-08T19:26:30.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.747+0000 7fcd3a7fc700 1 -- 172.21.15.149:0/877547456 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd3400faa0 con 0x7fcd440b2040 2023-11-08T19:26:30.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.747+0000 7fcd4bcc8700 1 -- 172.21.15.149:0/877547456 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd440b2e10 con 0x7fcd440b2040 2023-11-08T19:26:30.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.747+0000 7fcd3a7fc700 1 -- 172.21.15.149:0/877547456 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3400fe30 con 0x7fcd440b2040 2023-11-08T19:26:30.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.747+0000 7fcd4bcc8700 1 -- 172.21.15.149:0/877547456 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd440c9c10 con 0x7fcd440b2040 2023-11-08T19:26:30.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.748+0000 7fcd4bcc8700 1 -- 172.21.15.149:0/877547456 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd440b3460 con 0x7fcd440b2040 2023-11-08T19:26:30.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.749+0000 7fcd3a7fc700 1 -- 172.21.15.149:0/877547456 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcd34014440 con 0x7fcd440b2040 2023-11-08T19:26:30.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.749+0000 7fcd3a7fc700 1 --2- 172.21.15.149:0/877547456 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fcd2806af00 0x7fcd2806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:30.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.749+0000 7fcd3a7fc700 1 -- 172.21.15.149:0/877547456 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7fcd3408a310 con 0x7fcd440b2040 2023-11-08T19:26:30.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.749+0000 7fcd49a64700 1 --2- 172.21.15.149:0/877547456 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fcd2806af00 0x7fcd2806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:30.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.750+0000 7fcd49a64700 1 --2- 172.21.15.149:0/877547456 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fcd2806af00 0x7fcd2806d3c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fcd40009c20 tx=0x7fcd40008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:30.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.754+0000 7fcd3a7fc700 1 -- 172.21.15.149:0/877547456 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcd34054dc0 con 0x7fcd440b2040 2023-11-08T19:26:30.942 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.941+0000 7fcd4bcc8700 1 -- 172.21.15.149:0/877547456 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7fcd441f1720 con 0x7fcd440b2040 2023-11-08T19:26:30.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.941+0000 7fcd3a7fc700 1 -- 172.21.15.149:0/877547456 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v83) v1 ==== 103+0+11 (secure 0 0 0) 0x7fcd340583e0 con 0x7fcd440b2040 2023-11-08T19:26:30.943 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:26:30.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.944+0000 7fcd4bcc8700 1 -- 172.21.15.149:0/877547456 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fcd2806af00 msgr2=0x7fcd2806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:30.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.944+0000 7fcd4bcc8700 1 --2- 172.21.15.149:0/877547456 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fcd2806af00 0x7fcd2806d3c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fcd40009c20 tx=0x7fcd40008040 comp rx=0 tx=0).stop 2023-11-08T19:26:30.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.944+0000 7fcd4bcc8700 1 -- 172.21.15.149:0/877547456 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd440b2040 msgr2=0x7fcd441f0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:30.946 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.944+0000 7fcd4bcc8700 1 --2- 172.21.15.149:0/877547456 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd440b2040 0x7fcd441f0e00 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fcd340119a0 tx=0x7fcd34011d60 comp rx=0 tx=0).stop 2023-11-08T19:26:30.946 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.944+0000 7fcd4bcc8700 1 -- 172.21.15.149:0/877547456 shutdown_connections 2023-11-08T19:26:30.946 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.944+0000 7fcd4bcc8700 1 --2- 172.21.15.149:0/877547456 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fcd2806af00 0x7fcd2806d3c0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:30.946 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.944+0000 7fcd4bcc8700 1 --2- 172.21.15.149:0/877547456 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcd441f1340 0x7fcd440b3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:30.946 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.944+0000 7fcd4bcc8700 1 --2- 172.21.15.149:0/877547456 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd44155ec0 0x7fcd440c96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:30.947 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.944+0000 7fcd4bcc8700 1 --2- 172.21.15.149:0/877547456 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd440b2040 0x7fcd441f0e00 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:30.947 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.944+0000 7fcd4bcc8700 1 -- 172.21.15.149:0/877547456 >> 172.21.15.149:0/877547456 conn(0x7fcd4406f120 msgr2=0x7fcd4415e630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:30.947 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.944+0000 7fcd4bcc8700 1 -- 172.21.15.149:0/877547456 shutdown_connections 2023-11-08T19:26:30.947 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:30.944+0000 7fcd4bcc8700 1 -- 172.21.15.149:0/877547456 wait complete. 2023-11-08T19:26:30.957 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-08T19:26:31.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.079+0000 7f941f7e3700 1 Processor -- start 2023-11-08T19:26:31.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.079+0000 7f941f7e3700 1 -- start start 2023-11-08T19:26:31.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.080+0000 7f941f7e3700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f941806ab80 0x7f94180caf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:31.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.080+0000 7f941f7e3700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f941815e320 con 0x7f94180cf1c0 2023-11-08T19:26:31.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.080+0000 7f941f7e3700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f941806b020 con 0x7f941815df40 2023-11-08T19:26:31.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.080+0000 7f941f7e3700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f941806b2e0 con 0x7f941806ab80 2023-11-08T19:26:31.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.080+0000 7f941cd7e700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f941806ab80 0x7f94180caf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:31.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.080+0000 7f941dd80700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f94180cf1c0 0x7f94180ce540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:44862/0 (socket says 172.21.15.149:44862) 2023-11-08T19:26:31.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.080+0000 7f941dd80700 1 -- 172.21.15.149:0/345273876 learned_addr learned my addr 172.21.15.149:0/345273876 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:26:31.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.081+0000 7f941cd7e700 1 -- 172.21.15.149:0/345273876 >> v1:172.21.15.160:6789/0 conn(0x7f941815df40 legacy=0x7f941806c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:31.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.081+0000 7f941cd7e700 1 -- 172.21.15.149:0/345273876 >> v1:172.21.15.149:6789/0 conn(0x7f94180cf1c0 legacy=0x7f94180ce540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:31.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.081+0000 7f941cd7e700 1 -- 172.21.15.149:0/345273876 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f941806b5c0 con 0x7f941806ab80 2023-11-08T19:26:31.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.081+0000 7f940ffff700 1 -- 172.21.15.149:0/345273876 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2757859551 0 0) 0x7f941815e320 con 0x7f94180cf1c0 2023-11-08T19:26:31.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.081+0000 7f941cd7e700 1 --2- 172.21.15.149:0/345273876 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f941806ab80 0x7f94180caf50 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f9414009840 tx=0x7f9414009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4764f7c3cdf9f8d7 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:31.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.081+0000 7f940ffff700 1 -- 172.21.15.149:0/345273876 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9414011830 con 0x7f941806ab80 2023-11-08T19:26:31.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.081+0000 7f940ffff700 1 -- 172.21.15.149:0/345273876 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9414011990 con 0x7f941806ab80 2023-11-08T19:26:31.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.081+0000 7f940ffff700 1 -- 172.21.15.149:0/345273876 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9414011d20 con 0x7f941806ab80 2023-11-08T19:26:31.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.082+0000 7f941f7e3700 1 -- 172.21.15.149:0/345273876 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f941806ab80 msgr2=0x7f94180caf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:31.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.082+0000 7f941f7e3700 1 --2- 172.21.15.149:0/345273876 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f941806ab80 0x7f94180caf50 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f9414009840 tx=0x7f9414009b50 comp rx=0 tx=0).stop 2023-11-08T19:26:31.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.082+0000 7f941f7e3700 1 -- 172.21.15.149:0/345273876 shutdown_connections 2023-11-08T19:26:31.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.082+0000 7f941f7e3700 1 --2- 172.21.15.149:0/345273876 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f941806ab80 0x7f94180caf50 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:31.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.082+0000 7f941f7e3700 1 -- 172.21.15.149:0/345273876 >> 172.21.15.149:0/345273876 conn(0x7f94180d0640 msgr2=0x7f94180d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:31.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.082+0000 7f941f7e3700 1 -- 172.21.15.149:0/345273876 shutdown_connections 2023-11-08T19:26:31.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.082+0000 7f941f7e3700 1 -- 172.21.15.149:0/345273876 wait complete. 2023-11-08T19:26:31.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.083+0000 7f941f7e3700 1 Processor -- start 2023-11-08T19:26:31.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.083+0000 7f941f7e3700 1 -- start start 2023-11-08T19:26:31.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.084+0000 7f941f7e3700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f941806ab80 0x7f94181f3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:31.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.084+0000 7f941f7e3700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94180cf1c0 0x7f94180af1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:31.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.084+0000 7f941f7e3700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f941815df40 0x7f941815a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:31.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.084+0000 7f941f7e3700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94181f42f0 con 0x7f94180cf1c0 2023-11-08T19:26:31.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.084+0000 7f941f7e3700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94180c6f60 con 0x7f941815df40 2023-11-08T19:26:31.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.084+0000 7f941f7e3700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f941815f5e0 con 0x7f941806ab80 2023-11-08T19:26:31.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.084+0000 7f941cd7e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94180cf1c0 0x7f94180af1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:31.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.084+0000 7f941cd7e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94180cf1c0 0x7f94180af1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42864/0 (socket says 172.21.15.149:42864) 2023-11-08T19:26:31.092 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.084+0000 7f941cd7e700 1 -- 172.21.15.149:0/3837287042 learned_addr learned my addr 172.21.15.149:0/3837287042 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:31.092 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.084+0000 7f941cd7e700 1 -- 172.21.15.149:0/3837287042 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f941806ab80 msgr2=0x7f94181f3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:31.092 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.084+0000 7f941cd7e700 1 --2- 172.21.15.149:0/3837287042 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f941806ab80 0x7f94181f3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:31.092 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.084+0000 7f941cd7e700 1 -- 172.21.15.149:0/3837287042 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f941815df40 msgr2=0x7f941815a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:31.092 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.084+0000 7f941cd7e700 1 --2- 172.21.15.149:0/3837287042 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f941815df40 0x7f941815a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:31.093 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.084+0000 7f941cd7e700 1 -- 172.21.15.149:0/3837287042 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94140094a0 con 0x7f94180cf1c0 2023-11-08T19:26:31.093 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.084+0000 7f941cd7e700 1 --2- 172.21.15.149:0/3837287042 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94180cf1c0 0x7f94180af1b0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f94140090b0 tx=0x7f9414004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:31.093 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.084+0000 7f940dffb700 1 -- 172.21.15.149:0/3837287042 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941401a980 con 0x7f94180cf1c0 2023-11-08T19:26:31.094 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.084+0000 7f940dffb700 1 -- 172.21.15.149:0/3837287042 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f941401ab00 con 0x7f94180cf1c0 2023-11-08T19:26:31.094 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.084+0000 7f940dffb700 1 -- 172.21.15.149:0/3837287042 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9414024420 con 0x7f94180cf1c0 2023-11-08T19:26:31.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.084+0000 7f941f7e3700 1 -- 172.21.15.149:0/3837287042 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f941815f880 con 0x7f94180cf1c0 2023-11-08T19:26:31.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.085+0000 7f941f7e3700 1 -- 172.21.15.149:0/3837287042 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f941815fe40 con 0x7f94180cf1c0 2023-11-08T19:26:31.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.085+0000 7f941f7e3700 1 -- 172.21.15.149:0/3837287042 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94180af7b0 con 0x7f94180cf1c0 2023-11-08T19:26:31.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.086+0000 7f940dffb700 1 -- 172.21.15.149:0/3837287042 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9414022070 con 0x7f94180cf1c0 2023-11-08T19:26:31.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.086+0000 7f940dffb700 1 --2- 172.21.15.149:0/3837287042 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f93fc06af00 0x7f93fc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:31.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.086+0000 7f940dffb700 1 -- 172.21.15.149:0/3837287042 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f941408aec0 con 0x7f94180cf1c0 2023-11-08T19:26:31.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.086+0000 7f941d57f700 1 --2- 172.21.15.149:0/3837287042 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f93fc06af00 0x7f93fc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:31.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.087+0000 7f941d57f700 1 --2- 172.21.15.149:0/3837287042 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f93fc06af00 0x7f93fc06d3c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f9408000f60 tx=0x7f9408007a40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:31.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.091+0000 7f940dffb700 1 -- 172.21.15.149:0/3837287042 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9414055bb0 con 0x7f94180cf1c0 2023-11-08T19:26:31.290 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.289+0000 7f941f7e3700 1 -- 172.21.15.149:0/3837287042 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7f9418160030 con 0x7f94180cf1c0 2023-11-08T19:26:31.291 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.290+0000 7f940dffb700 1 -- 172.21.15.149:0/3837287042 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v84) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9414029020 con 0x7f94180cf1c0 2023-11-08T19:26:31.291 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:26:31.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.292+0000 7f941f7e3700 1 -- 172.21.15.149:0/3837287042 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f93fc06af00 msgr2=0x7f93fc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:31.294 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.292+0000 7f941f7e3700 1 --2- 172.21.15.149:0/3837287042 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f93fc06af00 0x7f93fc06d3c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f9408000f60 tx=0x7f9408007a40 comp rx=0 tx=0).stop 2023-11-08T19:26:31.294 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.292+0000 7f941f7e3700 1 -- 172.21.15.149:0/3837287042 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94180cf1c0 msgr2=0x7f94180af1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:31.294 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.292+0000 7f941f7e3700 1 --2- 172.21.15.149:0/3837287042 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94180cf1c0 0x7f94180af1b0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f94140090b0 tx=0x7f9414004750 comp rx=0 tx=0).stop 2023-11-08T19:26:31.294 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.292+0000 7f941f7e3700 1 -- 172.21.15.149:0/3837287042 shutdown_connections 2023-11-08T19:26:31.294 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.292+0000 7f941f7e3700 1 --2- 172.21.15.149:0/3837287042 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f93fc06af00 0x7f93fc06d3c0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:31.295 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.292+0000 7f941f7e3700 1 --2- 172.21.15.149:0/3837287042 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f941815df40 0x7f941815a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:31.295 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.292+0000 7f941f7e3700 1 --2- 172.21.15.149:0/3837287042 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f941806ab80 0x7f94181f3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:31.295 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.292+0000 7f941f7e3700 1 --2- 172.21.15.149:0/3837287042 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94180cf1c0 0x7f94180af1b0 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:31.295 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.292+0000 7f941f7e3700 1 -- 172.21.15.149:0/3837287042 >> 172.21.15.149:0/3837287042 conn(0x7f94180d0640 msgr2=0x7f94180cea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:31.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.292+0000 7f941f7e3700 1 -- 172.21.15.149:0/3837287042 shutdown_connections 2023-11-08T19:26:31.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.292+0000 7f941f7e3700 1 -- 172.21.15.149:0/3837287042 wait complete. 2023-11-08T19:26:31.305 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-08T19:26:31.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.429+0000 7f717aca5700 1 Processor -- start 2023-11-08T19:26:31.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.429+0000 7f717aca5700 1 -- start start 2023-11-08T19:26:31.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.430+0000 7f717aca5700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f717406ab80 0x7f71740caf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:31.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.430+0000 7f717aca5700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f71740cf1c0 0x7f71740cb490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:31.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.430+0000 7f717aca5700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f717415e320 con 0x7f717415df40 2023-11-08T19:26:31.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.430+0000 7f717aca5700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f717406b020 con 0x7f717406ab80 2023-11-08T19:26:31.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.430+0000 7f717aca5700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f717406b2e0 con 0x7f71740cf1c0 2023-11-08T19:26:31.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.430+0000 7f7173fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f717406ab80 0x7f71740caf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:31.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.430+0000 7f7173fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f717406ab80 0x7f71740caf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42872/0 (socket says 172.21.15.149:42872) 2023-11-08T19:26:31.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.430+0000 7f7173fff700 1 -- 172.21.15.149:0/663690712 learned_addr learned my addr 172.21.15.149:0/663690712 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:31.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.430+0000 7f7179242700 1 --2- 172.21.15.149:0/663690712 >> v2:172.21.15.160:3300/0 conn(0x7f71740cf1c0 0x7f71740cb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:31.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.430+0000 7f7173fff700 1 -- 172.21.15.149:0/663690712 >> v2:172.21.15.160:3300/0 conn(0x7f71740cf1c0 msgr2=0x7f71740cb490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:31.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.430+0000 7f7173fff700 1 --2- 172.21.15.149:0/663690712 >> v2:172.21.15.160:3300/0 conn(0x7f71740cf1c0 0x7f71740cb490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:31.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.430+0000 7f7173fff700 1 -- 172.21.15.149:0/663690712 >> v1:172.21.15.160:6789/0 conn(0x7f717415df40 legacy=0x7f717406c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:31.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.430+0000 7f7173fff700 1 -- 172.21.15.149:0/663690712 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f717406b5c0 con 0x7f717406ab80 2023-11-08T19:26:31.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.430+0000 7f7173fff700 1 --2- 172.21.15.149:0/663690712 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f717406ab80 0x7f71740caf50 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f71740b2180 tx=0x7f7160009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be7c0ba189d21369 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:31.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.431+0000 7f71737fe700 1 -- 172.21.15.149:0/663690712 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716000b870 con 0x7f717406ab80 2023-11-08T19:26:31.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.431+0000 7f71737fe700 1 -- 172.21.15.149:0/663690712 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f716000b9d0 con 0x7f717406ab80 2023-11-08T19:26:31.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.431+0000 7f71737fe700 1 -- 172.21.15.149:0/663690712 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716000bd60 con 0x7f717406ab80 2023-11-08T19:26:31.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.431+0000 7f717aca5700 1 -- 172.21.15.149:0/663690712 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f717406ab80 msgr2=0x7f71740caf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:31.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.431+0000 7f717aca5700 1 --2- 172.21.15.149:0/663690712 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f717406ab80 0x7f71740caf50 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f71740b2180 tx=0x7f7160009bd0 comp rx=0 tx=0).stop 2023-11-08T19:26:31.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.431+0000 7f717aca5700 1 -- 172.21.15.149:0/663690712 shutdown_connections 2023-11-08T19:26:31.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.431+0000 7f717aca5700 1 --2- 172.21.15.149:0/663690712 >> v2:172.21.15.160:3300/0 conn(0x7f71740cf1c0 0x7f71740cb490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:31.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.431+0000 7f717aca5700 1 --2- 172.21.15.149:0/663690712 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f717406ab80 0x7f71740caf50 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:31.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.431+0000 7f717aca5700 1 -- 172.21.15.149:0/663690712 >> 172.21.15.149:0/663690712 conn(0x7f71740d0640 msgr2=0x7f71740d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:31.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.431+0000 7f717aca5700 1 -- 172.21.15.149:0/663690712 shutdown_connections 2023-11-08T19:26:31.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.431+0000 7f717aca5700 1 -- 172.21.15.149:0/663690712 wait complete. 2023-11-08T19:26:31.440 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.432+0000 7f717aca5700 1 Processor -- start 2023-11-08T19:26:31.440 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.432+0000 7f717aca5700 1 -- start start 2023-11-08T19:26:31.440 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.433+0000 7f717aca5700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f717406ab80 0x7f7174161170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:31.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.433+0000 7f717aca5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71740cf1c0 0x7f7174157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:31.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.433+0000 7f717aca5700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f717415df40 0x7f71740c9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:31.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.433+0000 7f717aca5700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f717415e5d0 con 0x7f71740cf1c0 2023-11-08T19:26:31.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.433+0000 7f717aca5700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71740c9fb0 con 0x7f717406ab80 2023-11-08T19:26:31.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.433+0000 7f717aca5700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71740ca260 con 0x7f717415df40 2023-11-08T19:26:31.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.433+0000 7f7173fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71740cf1c0 0x7f7174157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:31.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.433+0000 7f7173fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71740cf1c0 0x7f7174157ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42878/0 (socket says 172.21.15.149:42878) 2023-11-08T19:26:31.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.433+0000 7f7173fff700 1 -- 172.21.15.149:0/1599830385 learned_addr learned my addr 172.21.15.149:0/1599830385 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:31.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.433+0000 7f7179242700 1 --2- 172.21.15.149:0/1599830385 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f717415df40 0x7f71740c9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:31.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.433+0000 7f7178a41700 1 --2- 172.21.15.149:0/1599830385 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f717406ab80 0x7f7174161170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:31.443 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.434+0000 7f7173fff700 1 -- 172.21.15.149:0/1599830385 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f717415df40 msgr2=0x7f71740c9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:31.443 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.434+0000 7f7173fff700 1 --2- 172.21.15.149:0/1599830385 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f717415df40 0x7f71740c9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:31.443 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.434+0000 7f7173fff700 1 -- 172.21.15.149:0/1599830385 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f717406ab80 msgr2=0x7f7174161170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:31.443 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.434+0000 7f7173fff700 1 --2- 172.21.15.149:0/1599830385 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f717406ab80 0x7f7174161170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:31.443 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.434+0000 7f7173fff700 1 -- 172.21.15.149:0/1599830385 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7160009550 con 0x7f71740cf1c0 2023-11-08T19:26:31.444 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.434+0000 7f7173fff700 1 --2- 172.21.15.149:0/1599830385 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71740cf1c0 0x7f7174157ee0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f7160009c10 tx=0x7f7160004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:31.444 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.434+0000 7f71717fa700 1 -- 172.21.15.149:0/1599830385 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7160004250 con 0x7f71740cf1c0 2023-11-08T19:26:31.444 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.434+0000 7f71717fa700 1 -- 172.21.15.149:0/1599830385 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f716001f070 con 0x7f71740cf1c0 2023-11-08T19:26:31.444 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.434+0000 7f717aca5700 1 -- 172.21.15.149:0/1599830385 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71740ca540 con 0x7f71740cf1c0 2023-11-08T19:26:31.444 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.434+0000 7f71717fa700 1 -- 172.21.15.149:0/1599830385 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71600045d0 con 0x7f71740cf1c0 2023-11-08T19:26:31.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.434+0000 7f717aca5700 1 -- 172.21.15.149:0/1599830385 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f717415e820 con 0x7f71740cf1c0 2023-11-08T19:26:31.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.435+0000 7f717aca5700 1 -- 172.21.15.149:0/1599830385 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f717404f730 con 0x7f71740cf1c0 2023-11-08T19:26:31.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.435+0000 7f71717fa700 1 -- 172.21.15.149:0/1599830385 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7160021030 con 0x7f71740cf1c0 2023-11-08T19:26:31.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.436+0000 7f71717fa700 1 --2- 172.21.15.149:0/1599830385 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f715806af00 0x7f715806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:31.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.436+0000 7f71717fa700 1 -- 172.21.15.149:0/1599830385 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f716008aea0 con 0x7f71740cf1c0 2023-11-08T19:26:31.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.436+0000 7f7178a41700 1 --2- 172.21.15.149:0/1599830385 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f715806af00 0x7f715806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:31.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.436+0000 7f7178a41700 1 --2- 172.21.15.149:0/1599830385 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f715806af00 0x7f715806d3c0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f7168001800 tx=0x7f7168009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:31.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.440+0000 7f71717fa700 1 -- 172.21.15.149:0/1599830385 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f71600559c0 con 0x7f71740cf1c0 2023-11-08T19:26:31.638 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.637+0000 7f717aca5700 1 -- 172.21.15.149:0/1599830385 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7f717415ced0 con 0x7f71740cf1c0 2023-11-08T19:26:31.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.637+0000 7f71717fa700 1 -- 172.21.15.149:0/1599830385 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v84) v1 ==== 107+0+11 (secure 0 0 0) 0x7f7160058fe0 con 0x7f71740cf1c0 2023-11-08T19:26:31.639 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:26:31.641 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.639+0000 7f717aca5700 1 -- 172.21.15.149:0/1599830385 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f715806af00 msgr2=0x7f715806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:31.641 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.639+0000 7f717aca5700 1 --2- 172.21.15.149:0/1599830385 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f715806af00 0x7f715806d3c0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f7168001800 tx=0x7f7168009040 comp rx=0 tx=0).stop 2023-11-08T19:26:31.641 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.639+0000 7f717aca5700 1 -- 172.21.15.149:0/1599830385 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71740cf1c0 msgr2=0x7f7174157ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:31.642 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.639+0000 7f717aca5700 1 --2- 172.21.15.149:0/1599830385 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71740cf1c0 0x7f7174157ee0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f7160009c10 tx=0x7f7160004750 comp rx=0 tx=0).stop 2023-11-08T19:26:31.642 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.640+0000 7f717aca5700 1 -- 172.21.15.149:0/1599830385 shutdown_connections 2023-11-08T19:26:31.642 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.640+0000 7f717aca5700 1 --2- 172.21.15.149:0/1599830385 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f715806af00 0x7f715806d3c0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:31.642 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.640+0000 7f717aca5700 1 --2- 172.21.15.149:0/1599830385 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f717406ab80 0x7f7174161170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:31.643 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.640+0000 7f717aca5700 1 --2- 172.21.15.149:0/1599830385 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f717415df40 0x7f71740c9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:31.643 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.640+0000 7f717aca5700 1 --2- 172.21.15.149:0/1599830385 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71740cf1c0 0x7f7174157ee0 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:31.643 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.640+0000 7f717aca5700 1 -- 172.21.15.149:0/1599830385 >> 172.21.15.149:0/1599830385 conn(0x7f71740d0640 msgr2=0x7f717406bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:31.643 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.640+0000 7f717aca5700 1 -- 172.21.15.149:0/1599830385 shutdown_connections 2023-11-08T19:26:31.643 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.640+0000 7f717aca5700 1 -- 172.21.15.149:0/1599830385 wait complete. 2023-11-08T19:26:31.653 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-08T19:26:31.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.775+0000 7f53767ce700 1 Processor -- start 2023-11-08T19:26:31.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.775+0000 7f53767ce700 1 -- start start 2023-11-08T19:26:31.780 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.776+0000 7f53767ce700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f53700c7250 0x7f537006b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:31.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.776+0000 7f53767ce700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53700cb610 0x7f53700b4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:31.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.776+0000 7f53767ce700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53700b3710 con 0x7f53700722a0 2023-11-08T19:26:31.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.776+0000 7f53767ce700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f537006cc00 con 0x7f53700c7250 2023-11-08T19:26:31.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.776+0000 7f53767ce700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f537006c640 con 0x7f53700cb610 2023-11-08T19:26:31.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.776+0000 7f536ffff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f53700722a0 0x7f537006ab80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:44886/0 (socket says 172.21.15.149:44886) 2023-11-08T19:26:31.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.776+0000 7f536ffff700 1 -- 172.21.15.149:0/2706142246 learned_addr learned my addr 172.21.15.149:0/2706142246 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:26:31.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.776+0000 7f5374d6b700 1 --2- 172.21.15.149:0/2706142246 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53700cb610 0x7f53700b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:31.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.776+0000 7f536f7fe700 1 --2- 172.21.15.149:0/2706142246 >> v2:172.21.15.160:3300/0 conn(0x7f53700c7250 0x7f537006b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:31.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.776+0000 7f536effd700 1 -- 172.21.15.149:0/2706142246 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2887456762 0 0) 0x7f53700b3710 con 0x7f53700722a0 2023-11-08T19:26:31.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.776+0000 7f536effd700 1 -- 172.21.15.149:0/2706142246 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53580035b0 con 0x7f53700722a0 2023-11-08T19:26:31.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.777+0000 7f536effd700 1 -- 172.21.15.149:0/2706142246 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 839677951 0 0) 0x7f53580035b0 con 0x7f53700722a0 2023-11-08T19:26:31.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.777+0000 7f536effd700 1 -- 172.21.15.149:0/2706142246 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53700cb610 msgr2=0x7f53700b4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:31.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.777+0000 7f536effd700 1 --2- 172.21.15.149:0/2706142246 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53700cb610 0x7f53700b4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:31.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.777+0000 7f536effd700 1 -- 172.21.15.149:0/2706142246 >> v2:172.21.15.160:3300/0 conn(0x7f53700c7250 msgr2=0x7f537006b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:31.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.777+0000 7f536effd700 1 --2- 172.21.15.149:0/2706142246 >> v2:172.21.15.160:3300/0 conn(0x7f53700c7250 0x7f537006b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:31.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.777+0000 7f536effd700 1 -- 172.21.15.149:0/2706142246 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f537006c920 con 0x7f53700722a0 2023-11-08T19:26:31.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.777+0000 7f536effd700 1 -- 172.21.15.149:0/2706142246 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f5364001670 con 0x7f53700722a0 2023-11-08T19:26:31.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.777+0000 7f536effd700 1 -- 172.21.15.149:0/2706142246 >> v1:172.21.15.149:6789/0 conn(0x7f53700722a0 legacy=0x7f537006ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:31.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.777+0000 7f536effd700 1 --2- 172.21.15.149:0/2706142246 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5358003a70 0x7f5358003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:31.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.777+0000 7f536effd700 1 --2- 172.21.15.149:0/2706142246 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53700cb610 0x7f5358004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:31.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.777+0000 7f536effd700 1 --2- 172.21.15.149:0/2706142246 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5358004d90 0x7f5358005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:31.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.777+0000 7f536effd700 1 -- 172.21.15.149:0/2706142246 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f537006cc00 con 0x7f5358003a70 2023-11-08T19:26:31.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.777+0000 7f536effd700 1 -- 172.21.15.149:0/2706142246 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f537006c640 con 0x7f5358004d90 2023-11-08T19:26:31.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.777+0000 7f536effd700 1 -- 172.21.15.149:0/2706142246 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f535800bac0 con 0x7f53700cb610 2023-11-08T19:26:31.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.777+0000 7f536ffff700 1 --2- 172.21.15.149:0/2706142246 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5358003a70 0x7f5358003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:31.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.777+0000 7f536f7fe700 1 --2- 172.21.15.149:0/2706142246 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53700cb610 0x7f5358004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:31.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.777+0000 7f5374d6b700 1 --2- 172.21.15.149:0/2706142246 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5358004d90 0x7f5358005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:31.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.777+0000 7f536ffff700 1 -- 172.21.15.149:0/2706142246 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53700cb610 msgr2=0x7f5358004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:31.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.777+0000 7f536ffff700 1 --2- 172.21.15.149:0/2706142246 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53700cb610 0x7f5358004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:31.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.777+0000 7f536ffff700 1 -- 172.21.15.149:0/2706142246 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5358004d90 msgr2=0x7f5358005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:31.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.777+0000 7f536ffff700 1 --2- 172.21.15.149:0/2706142246 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5358004d90 0x7f5358005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:31.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.777+0000 7f536ffff700 1 -- 172.21.15.149:0/2706142246 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53580035b0 con 0x7f5358003a70 2023-11-08T19:26:31.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.777+0000 7f536ffff700 1 --2- 172.21.15.149:0/2706142246 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5358003a70 0x7f5358003e90 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f536400c320 tx=0x7f5358005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cd11b42b56744b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:31.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.777+0000 7f536effd700 1 -- 172.21.15.149:0/2706142246 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f536400ce60 con 0x7f5358003a70 2023-11-08T19:26:31.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.778+0000 7f536effd700 1 -- 172.21.15.149:0/2706142246 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5364005960 con 0x7f5358003a70 2023-11-08T19:26:31.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.778+0000 7f536effd700 1 -- 172.21.15.149:0/2706142246 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5364005d10 con 0x7f5358003a70 2023-11-08T19:26:31.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.778+0000 7f53767ce700 1 -- 172.21.15.149:0/2706142246 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5358003a70 msgr2=0x7f5358003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:31.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.778+0000 7f53767ce700 1 --2- 172.21.15.149:0/2706142246 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5358003a70 0x7f5358003e90 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f536400c320 tx=0x7f5358005880 comp rx=0 tx=0).stop 2023-11-08T19:26:31.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.778+0000 7f5374d6b700 1 -- 172.21.15.149:0/2706142246 reap_dead start 2023-11-08T19:26:31.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.778+0000 7f53767ce700 1 -- 172.21.15.149:0/2706142246 shutdown_connections 2023-11-08T19:26:31.791 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.778+0000 7f53767ce700 1 -- 172.21.15.149:0/2706142246 >> 172.21.15.149:0/2706142246 conn(0x7f53700d0640 msgr2=0x7f53700d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:31.791 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.778+0000 7f53767ce700 1 -- 172.21.15.149:0/2706142246 shutdown_connections 2023-11-08T19:26:31.791 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.778+0000 7f53767ce700 1 -- 172.21.15.149:0/2706142246 wait complete. 2023-11-08T19:26:31.791 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.779+0000 7f53767ce700 1 Processor -- start 2023-11-08T19:26:31.791 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.780+0000 7f53767ce700 1 -- start start 2023-11-08T19:26:31.794 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.780+0000 7f53767ce700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5358003a70 0x7f53700b1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:31.794 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.780+0000 7f53767ce700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53700cf470 0x7f53700cf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:31.794 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.780+0000 7f53767ce700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53700ad820 0x7f53700adca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:31.795 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.780+0000 7f53767ce700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53700d01c0 con 0x7f53700ad820 2023-11-08T19:26:31.795 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.780+0000 7f53767ce700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53700aca60 con 0x7f5358003a70 2023-11-08T19:26:31.795 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.780+0000 7f53767ce700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53700acd40 con 0x7f53700cf470 2023-11-08T19:26:31.795 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.780+0000 7f5374d6b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53700ad820 0x7f53700adca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:31.795 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.780+0000 7f5374d6b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53700ad820 0x7f53700adca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42898/0 (socket says 172.21.15.149:42898) 2023-11-08T19:26:31.796 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.780+0000 7f5374d6b700 1 -- 172.21.15.149:0/3017608844 learned_addr learned my addr 172.21.15.149:0/3017608844 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:31.796 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.781+0000 7f536f7fe700 1 --2- 172.21.15.149:0/3017608844 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53700cf470 0x7f53700cf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:31.796 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.781+0000 7f536ffff700 1 --2- 172.21.15.149:0/3017608844 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5358003a70 0x7f53700b1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:31.796 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.781+0000 7f5374d6b700 1 -- 172.21.15.149:0/3017608844 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53700cf470 msgr2=0x7f53700cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:31.796 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.781+0000 7f5374d6b700 1 --2- 172.21.15.149:0/3017608844 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53700cf470 0x7f53700cf8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:31.797 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.781+0000 7f5374d6b700 1 -- 172.21.15.149:0/3017608844 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5358003a70 msgr2=0x7f53700b1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:31.797 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.781+0000 7f5374d6b700 1 --2- 172.21.15.149:0/3017608844 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5358003a70 0x7f53700b1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:31.797 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.781+0000 7f5374d6b700 1 -- 172.21.15.149:0/3017608844 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53700ad020 con 0x7f53700ad820 2023-11-08T19:26:31.797 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.781+0000 7f536ffff700 1 --2- 172.21.15.149:0/3017608844 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5358003a70 0x7f53700b1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:26:31.797 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.781+0000 7f5374d6b700 1 --2- 172.21.15.149:0/3017608844 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53700ad820 0x7f53700adca0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f53700c40a0 tx=0x7f5368011f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:31.798 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.781+0000 7f536cff9700 1 -- 172.21.15.149:0/3017608844 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f536800e040 con 0x7f53700ad820 2023-11-08T19:26:31.798 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.781+0000 7f536cff9700 1 -- 172.21.15.149:0/3017608844 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f536800f040 con 0x7f53700ad820 2023-11-08T19:26:31.798 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.781+0000 7f53767ce700 1 -- 172.21.15.149:0/3017608844 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53700ad300 con 0x7f53700ad820 2023-11-08T19:26:31.798 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.781+0000 7f536cff9700 1 -- 172.21.15.149:0/3017608844 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f536800fdb0 con 0x7f53700ad820 2023-11-08T19:26:31.798 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.781+0000 7f53767ce700 1 -- 172.21.15.149:0/3017608844 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53700b1d70 con 0x7f53700ad820 2023-11-08T19:26:31.799 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.782+0000 7f53767ce700 1 -- 172.21.15.149:0/3017608844 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f537004f730 con 0x7f53700ad820 2023-11-08T19:26:31.799 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.782+0000 7f536cff9700 1 -- 172.21.15.149:0/3017608844 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5368022460 con 0x7f53700ad820 2023-11-08T19:26:31.799 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.783+0000 7f536cff9700 1 --2- 172.21.15.149:0/3017608844 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f535c06af00 0x7f535c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:31.799 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.783+0000 7f536cff9700 1 -- 172.21.15.149:0/3017608844 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f536808a120 con 0x7f53700ad820 2023-11-08T19:26:31.799 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.783+0000 7f536ffff700 1 --2- 172.21.15.149:0/3017608844 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f535c06af00 0x7f535c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:31.799 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.783+0000 7f536ffff700 1 --2- 172.21.15.149:0/3017608844 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f535c06af00 0x7f535c06d3c0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f5364015040 tx=0x7f536400a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:31.800 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.788+0000 7f536cff9700 1 -- 172.21.15.149:0/3017608844 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5368054c30 con 0x7f53700ad820 2023-11-08T19:26:31.977 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.976+0000 7f53767ce700 1 -- 172.21.15.149:0/3017608844 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f53700d0420 con 0x7f53700ad820 2023-11-08T19:26:31.977 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.976+0000 7f536cff9700 1 -- 172.21.15.149:0/3017608844 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5368058250 con 0x7f53700ad820 2023-11-08T19:26:31.978 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:26:31.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.978+0000 7f53767ce700 1 -- 172.21.15.149:0/3017608844 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f535c06af00 msgr2=0x7f535c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:31.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.979+0000 7f53767ce700 1 --2- 172.21.15.149:0/3017608844 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f535c06af00 0x7f535c06d3c0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f5364015040 tx=0x7f536400a000 comp rx=0 tx=0).stop 2023-11-08T19:26:31.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.979+0000 7f53767ce700 1 -- 172.21.15.149:0/3017608844 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53700ad820 msgr2=0x7f53700adca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:31.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.979+0000 7f53767ce700 1 --2- 172.21.15.149:0/3017608844 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53700ad820 0x7f53700adca0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f53700c40a0 tx=0x7f5368011f80 comp rx=0 tx=0).stop 2023-11-08T19:26:31.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.979+0000 7f53767ce700 1 -- 172.21.15.149:0/3017608844 shutdown_connections 2023-11-08T19:26:31.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.979+0000 7f53767ce700 1 --2- 172.21.15.149:0/3017608844 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f535c06af00 0x7f535c06d3c0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:31.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.979+0000 7f53767ce700 1 --2- 172.21.15.149:0/3017608844 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5358003a70 0x7f53700b1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:31.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.979+0000 7f53767ce700 1 --2- 172.21.15.149:0/3017608844 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53700ad820 0x7f53700adca0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:31.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.979+0000 7f53767ce700 1 --2- 172.21.15.149:0/3017608844 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53700cf470 0x7f53700cf8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:31.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.979+0000 7f53767ce700 1 -- 172.21.15.149:0/3017608844 >> 172.21.15.149:0/3017608844 conn(0x7f53700d0640 msgr2=0x7f53700d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:31.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.979+0000 7f53767ce700 1 -- 172.21.15.149:0/3017608844 shutdown_connections 2023-11-08T19:26:31.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:31.979+0000 7f53767ce700 1 -- 172.21.15.149:0/3017608844 wait complete. 2023-11-08T19:26:31.992 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-08T19:26:32.116 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.114+0000 7f3815fb7700 1 Processor -- start 2023-11-08T19:26:32.116 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.115+0000 7f3815fb7700 1 -- start start 2023-11-08T19:26:32.118 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.115+0000 7f3815fb7700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f38100d1130 0x7f38100b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:32.118 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.115+0000 7f3815fb7700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38100b6470 con 0x7f38100cc870 2023-11-08T19:26:32.119 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.115+0000 7f3815fb7700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f381015afd0 con 0x7f381015abf0 2023-11-08T19:26:32.119 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.115+0000 7f3815fb7700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38100b66a0 con 0x7f38100d1130 2023-11-08T19:26:32.119 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.115+0000 7f380effd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f38100d1130 0x7f38100b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:32.119 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.115+0000 7f380ffff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f38100cc870 0x7f381006bc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:44908/0 (socket says 172.21.15.149:44908) 2023-11-08T19:26:32.119 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.116+0000 7f380ffff700 1 -- 172.21.15.149:0/3657345533 learned_addr learned my addr 172.21.15.149:0/3657345533 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:26:32.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.116+0000 7f380effd700 1 -- 172.21.15.149:0/3657345533 >> v1:172.21.15.160:6789/0 conn(0x7f381015abf0 legacy=0x7f38100cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:32.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.116+0000 7f380effd700 1 -- 172.21.15.149:0/3657345533 >> v1:172.21.15.149:6789/0 conn(0x7f38100cc870 legacy=0x7f381006bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:32.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.116+0000 7f380effd700 1 -- 172.21.15.149:0/3657345533 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f381015e880 con 0x7f38100d1130 2023-11-08T19:26:32.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.116+0000 7f380e7fc700 1 -- 172.21.15.149:0/3657345533 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2891349635 0 0) 0x7f38100b6470 con 0x7f38100cc870 2023-11-08T19:26:32.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.116+0000 7f380effd700 1 --2- 172.21.15.149:0/3657345533 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38100d1130 0x7f38100b5f30 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f3800009840 tx=0x7f3800009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a30d9a7f98009bcc server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:32.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.116+0000 7f380e7fc700 1 -- 172.21.15.149:0/3657345533 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3800004230 con 0x7f38100d1130 2023-11-08T19:26:32.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.116+0000 7f380e7fc700 1 -- 172.21.15.149:0/3657345533 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3800004390 con 0x7f38100d1130 2023-11-08T19:26:32.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.116+0000 7f380e7fc700 1 -- 172.21.15.149:0/3657345533 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38000036a0 con 0x7f38100d1130 2023-11-08T19:26:32.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.117+0000 7f3815fb7700 1 -- 172.21.15.149:0/3657345533 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38100d1130 msgr2=0x7f38100b5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:32.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.117+0000 7f3815fb7700 1 --2- 172.21.15.149:0/3657345533 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38100d1130 0x7f38100b5f30 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f3800009840 tx=0x7f3800009b50 comp rx=0 tx=0).stop 2023-11-08T19:26:32.122 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.117+0000 7f3815fb7700 1 -- 172.21.15.149:0/3657345533 shutdown_connections 2023-11-08T19:26:32.122 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.117+0000 7f3815fb7700 1 --2- 172.21.15.149:0/3657345533 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38100d1130 0x7f38100b5f30 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:32.122 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.117+0000 7f3815fb7700 1 -- 172.21.15.149:0/3657345533 >> 172.21.15.149:0/3657345533 conn(0x7f38100d0640 msgr2=0x7f38100d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:32.122 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.117+0000 7f3815fb7700 1 -- 172.21.15.149:0/3657345533 shutdown_connections 2023-11-08T19:26:32.122 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.117+0000 7f3815fb7700 1 -- 172.21.15.149:0/3657345533 wait complete. 2023-11-08T19:26:32.125 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.118+0000 7f3815fb7700 1 Processor -- start 2023-11-08T19:26:32.125 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.118+0000 7f3815fb7700 1 -- start start 2023-11-08T19:26:32.126 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.119+0000 7f3815fb7700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38100cc870 0x7f38100c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:32.126 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.119+0000 7f3815fb7700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38100d1130 0x7f381015ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:32.126 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.119+0000 7f3815fb7700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f381015abf0 0x7f381015c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:32.126 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.119+0000 7f3815fb7700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38100c7bf0 con 0x7f38100cc870 2023-11-08T19:26:32.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.119+0000 7f3815fb7700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38100c7ed0 con 0x7f38100d1130 2023-11-08T19:26:32.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.119+0000 7f3815fb7700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38100c81b0 con 0x7f381015abf0 2023-11-08T19:26:32.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.119+0000 7f380f7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38100cc870 0x7f38100c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:32.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.119+0000 7f380f7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38100cc870 0x7f38100c8c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42908/0 (socket says 172.21.15.149:42908) 2023-11-08T19:26:32.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.119+0000 7f380f7fe700 1 -- 172.21.15.149:0/3380600034 learned_addr learned my addr 172.21.15.149:0/3380600034 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:32.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.119+0000 7f380effd700 1 --2- 172.21.15.149:0/3380600034 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38100d1130 0x7f381015ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:32.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.119+0000 7f380ffff700 1 --2- 172.21.15.149:0/3380600034 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f381015abf0 0x7f381015c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:32.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.119+0000 7f380f7fe700 1 -- 172.21.15.149:0/3380600034 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f381015abf0 msgr2=0x7f381015c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:32.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.119+0000 7f380f7fe700 1 --2- 172.21.15.149:0/3380600034 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f381015abf0 0x7f381015c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:32.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.119+0000 7f380f7fe700 1 -- 172.21.15.149:0/3380600034 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38100d1130 msgr2=0x7f381015ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:32.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.119+0000 7f380f7fe700 1 --2- 172.21.15.149:0/3380600034 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38100d1130 0x7f381015ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:32.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.119+0000 7f380f7fe700 1 -- 172.21.15.149:0/3380600034 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38000094a0 con 0x7f38100cc870 2023-11-08T19:26:32.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.119+0000 7f380ffff700 1 --2- 172.21.15.149:0/3380600034 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f381015abf0 0x7f381015c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:26:32.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.119+0000 7f380effd700 1 --2- 172.21.15.149:0/3380600034 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38100d1130 0x7f381015ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:26:32.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.119+0000 7f380f7fe700 1 --2- 172.21.15.149:0/3380600034 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38100cc870 0x7f38100c8c90 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f380400c4d0 tx=0x7f380400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:32.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.119+0000 7f37f7fff700 1 -- 172.21.15.149:0/3380600034 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3804011790 con 0x7f38100cc870 2023-11-08T19:26:32.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.119+0000 7f37f7fff700 1 -- 172.21.15.149:0/3380600034 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38040118f0 con 0x7f38100cc870 2023-11-08T19:26:32.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.119+0000 7f3815fb7700 1 -- 172.21.15.149:0/3380600034 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38100c8490 con 0x7f38100cc870 2023-11-08T19:26:32.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.119+0000 7f37f7fff700 1 -- 172.21.15.149:0/3380600034 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3804011ca0 con 0x7f38100cc870 2023-11-08T19:26:32.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.120+0000 7f3815fb7700 1 -- 172.21.15.149:0/3380600034 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f381015d390 con 0x7f38100cc870 2023-11-08T19:26:32.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.120+0000 7f3815fb7700 1 -- 172.21.15.149:0/3380600034 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f381004f730 con 0x7f38100cc870 2023-11-08T19:26:32.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.121+0000 7f37f7fff700 1 -- 172.21.15.149:0/3380600034 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f380401c460 con 0x7f38100cc870 2023-11-08T19:26:32.131 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.121+0000 7f37f7fff700 1 --2- 172.21.15.149:0/3380600034 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f37fc06af00 0x7f37fc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:32.131 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.121+0000 7f37f7fff700 1 -- 172.21.15.149:0/3380600034 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f3804089a50 con 0x7f38100cc870 2023-11-08T19:26:32.131 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.121+0000 7f380effd700 1 --2- 172.21.15.149:0/3380600034 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f37fc06af00 0x7f37fc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:32.131 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.122+0000 7f380effd700 1 --2- 172.21.15.149:0/3380600034 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f37fc06af00 0x7f37fc06d3c0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f38000090b0 tx=0x7f3800013040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:32.132 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.126+0000 7f37f7fff700 1 -- 172.21.15.149:0/3380600034 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3804054560 con 0x7f38100cc870 2023-11-08T19:26:32.317 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.316+0000 7f3815fb7700 1 -- 172.21.15.149:0/3380600034 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f38100b62f0 con 0x7f38100cc870 2023-11-08T19:26:32.318 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.316+0000 7f37f7fff700 1 -- 172.21.15.149:0/3380600034 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3804057b80 con 0x7f38100cc870 2023-11-08T19:26:32.318 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 64 2023-11-08T19:26:32.320 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.318+0000 7f3815fb7700 1 -- 172.21.15.149:0/3380600034 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f37fc06af00 msgr2=0x7f37fc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:32.320 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.318+0000 7f3815fb7700 1 --2- 172.21.15.149:0/3380600034 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f37fc06af00 0x7f37fc06d3c0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f38000090b0 tx=0x7f3800013040 comp rx=0 tx=0).stop 2023-11-08T19:26:32.320 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.318+0000 7f3815fb7700 1 -- 172.21.15.149:0/3380600034 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38100cc870 msgr2=0x7f38100c8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:32.320 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.318+0000 7f3815fb7700 1 --2- 172.21.15.149:0/3380600034 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38100cc870 0x7f38100c8c90 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f380400c4d0 tx=0x7f380400c890 comp rx=0 tx=0).stop 2023-11-08T19:26:32.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.319+0000 7f3815fb7700 1 -- 172.21.15.149:0/3380600034 shutdown_connections 2023-11-08T19:26:32.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.319+0000 7f3815fb7700 1 --2- 172.21.15.149:0/3380600034 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f37fc06af00 0x7f37fc06d3c0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:32.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.319+0000 7f3815fb7700 1 --2- 172.21.15.149:0/3380600034 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f381015abf0 0x7f381015c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:32.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.319+0000 7f3815fb7700 1 --2- 172.21.15.149:0/3380600034 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38100cc870 0x7f38100c8c90 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:32.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.319+0000 7f3815fb7700 1 --2- 172.21.15.149:0/3380600034 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38100d1130 0x7f381015ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:32.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.319+0000 7f3815fb7700 1 -- 172.21.15.149:0/3380600034 >> 172.21.15.149:0/3380600034 conn(0x7f38100d0640 msgr2=0x7f38100b0d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:32.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.319+0000 7f3815fb7700 1 -- 172.21.15.149:0/3380600034 shutdown_connections 2023-11-08T19:26:32.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.319+0000 7f3815fb7700 1 -- 172.21.15.149:0/3380600034 wait complete. 2023-11-08T19:26:32.332 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:26:32.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.451+0000 7f3a5fd4f700 1 Processor -- start 2023-11-08T19:26:32.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.452+0000 7f3a5fd4f700 1 -- start start 2023-11-08T19:26:32.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.452+0000 7f3a5fd4f700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f3a580afb30 0x7f3a580ce380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:32.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.452+0000 7f3a5fd4f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3a580b16b0 0x7f3a580cbf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:32.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.452+0000 7f3a5fd4f700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3a580b20b0 0x7f3a580b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:32.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.452+0000 7f3a5fd4f700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a580b2aa0 con 0x7f3a580b20b0 2023-11-08T19:26:32.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.452+0000 7f3a5fd4f700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a580d1330 con 0x7f3a580afb30 2023-11-08T19:26:32.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.452+0000 7f3a5fd4f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a580cb490 con 0x7f3a580b16b0 2023-11-08T19:26:32.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.453+0000 7f3a5e2ec700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3a580b20b0 0x7f3a580b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:32.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.453+0000 7f3a5e2ec700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3a580b20b0 0x7f3a580b2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42920/0 (socket says 172.21.15.149:42920) 2023-11-08T19:26:32.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.453+0000 7f3a5e2ec700 1 -- 172.21.15.149:0/4005321938 learned_addr learned my addr 172.21.15.149:0/4005321938 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:32.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.453+0000 7f3a5daeb700 1 --2- 172.21.15.149:0/4005321938 >> v2:172.21.15.160:3300/0 conn(0x7f3a580afb30 0x7f3a580ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:32.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.453+0000 7f3a5d2ea700 1 --2- 172.21.15.149:0/4005321938 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3a580b16b0 0x7f3a580cbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:32.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.453+0000 7f3a5e2ec700 1 -- 172.21.15.149:0/4005321938 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3a580b16b0 msgr2=0x7f3a580cbf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:32.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.453+0000 7f3a5e2ec700 1 --2- 172.21.15.149:0/4005321938 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3a580b16b0 0x7f3a580cbf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:32.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.453+0000 7f3a5e2ec700 1 -- 172.21.15.149:0/4005321938 >> v2:172.21.15.160:3300/0 conn(0x7f3a580afb30 msgr2=0x7f3a580ce380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:32.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.453+0000 7f3a5e2ec700 1 --2- 172.21.15.149:0/4005321938 >> v2:172.21.15.160:3300/0 conn(0x7f3a580afb30 0x7f3a580ce380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:32.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.453+0000 7f3a5e2ec700 1 -- 172.21.15.149:0/4005321938 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a580cb770 con 0x7f3a580b20b0 2023-11-08T19:26:32.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.453+0000 7f3a5daeb700 1 --2- 172.21.15.149:0/4005321938 >> v2:172.21.15.160:3300/0 conn(0x7f3a580afb30 0x7f3a580ce380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:26:32.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.453+0000 7f3a5e2ec700 1 --2- 172.21.15.149:0/4005321938 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a580b20b0 0x7f3a580b2560 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f3a580d0590 tx=0x7f3a5000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1e90af70dfd4a43 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:32.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.453+0000 7f3a5cae9700 1 -- 172.21.15.149:0/4005321938 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5000e070 con 0x7f3a580b20b0 2023-11-08T19:26:32.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.453+0000 7f3a5cae9700 1 -- 172.21.15.149:0/4005321938 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a5000b9c0 con 0x7f3a580b20b0 2023-11-08T19:26:32.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.453+0000 7f3a5cae9700 1 -- 172.21.15.149:0/4005321938 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5000bd70 con 0x7f3a580b20b0 2023-11-08T19:26:32.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.454+0000 7f3a5fd4f700 1 -- 172.21.15.149:0/4005321938 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a580b20b0 msgr2=0x7f3a580b2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:32.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.454+0000 7f3a5fd4f700 1 --2- 172.21.15.149:0/4005321938 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a580b20b0 0x7f3a580b2560 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f3a580d0590 tx=0x7f3a5000b330 comp rx=0 tx=0).stop 2023-11-08T19:26:32.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.454+0000 7f3a5fd4f700 1 -- 172.21.15.149:0/4005321938 shutdown_connections 2023-11-08T19:26:32.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.454+0000 7f3a5fd4f700 1 --2- 172.21.15.149:0/4005321938 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a580b20b0 0x7f3a580b2560 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:32.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.454+0000 7f3a5fd4f700 1 --2- 172.21.15.149:0/4005321938 >> v2:172.21.15.160:3300/0 conn(0x7f3a580afb30 0x7f3a580ce380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:32.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.454+0000 7f3a5fd4f700 1 --2- 172.21.15.149:0/4005321938 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3a580b16b0 0x7f3a580cbf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:32.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.454+0000 7f3a5fd4f700 1 -- 172.21.15.149:0/4005321938 >> 172.21.15.149:0/4005321938 conn(0x7f3a58099a40 msgr2=0x7f3a580d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:32.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.454+0000 7f3a5fd4f700 1 -- 172.21.15.149:0/4005321938 shutdown_connections 2023-11-08T19:26:32.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.454+0000 7f3a5fd4f700 1 -- 172.21.15.149:0/4005321938 wait complete. 2023-11-08T19:26:32.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.455+0000 7f3a5fd4f700 1 Processor -- start 2023-11-08T19:26:32.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.456+0000 7f3a5fd4f700 1 -- start start 2023-11-08T19:26:32.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.456+0000 7f3a5fd4f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3a580afb30 0x7f3a580b4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:32.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.456+0000 7f3a5fd4f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3a580b16b0 0x7f3a580b4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:32.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.456+0000 7f3a5fd4f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a580b20b0 0x7f3a58158ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:32.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.456+0000 7f3a5fd4f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a580b5f50 con 0x7f3a580b20b0 2023-11-08T19:26:32.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.456+0000 7f3a5fd4f700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a580b3570 con 0x7f3a580b16b0 2023-11-08T19:26:32.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.456+0000 7f3a5fd4f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a580b5340 con 0x7f3a580afb30 2023-11-08T19:26:32.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.457+0000 7f3a5e2ec700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a580b20b0 0x7f3a58158ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:32.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.457+0000 7f3a5e2ec700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a580b20b0 0x7f3a58158ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42926/0 (socket says 172.21.15.149:42926) 2023-11-08T19:26:32.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.457+0000 7f3a5e2ec700 1 -- 172.21.15.149:0/2556598475 learned_addr learned my addr 172.21.15.149:0/2556598475 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:32.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.457+0000 7f3a5d2ea700 1 --2- 172.21.15.149:0/2556598475 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3a580b16b0 0x7f3a580b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:32.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.457+0000 7f3a5daeb700 1 --2- 172.21.15.149:0/2556598475 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3a580afb30 0x7f3a580b4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:32.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.457+0000 7f3a5e2ec700 1 -- 172.21.15.149:0/2556598475 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3a580afb30 msgr2=0x7f3a580b4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:32.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.457+0000 7f3a5e2ec700 1 --2- 172.21.15.149:0/2556598475 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3a580afb30 0x7f3a580b4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:32.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.457+0000 7f3a5e2ec700 1 -- 172.21.15.149:0/2556598475 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3a580b16b0 msgr2=0x7f3a580b4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:32.468 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.457+0000 7f3a5e2ec700 1 --2- 172.21.15.149:0/2556598475 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3a580b16b0 0x7f3a580b4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:32.468 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.457+0000 7f3a5e2ec700 1 -- 172.21.15.149:0/2556598475 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a50009b30 con 0x7f3a580b20b0 2023-11-08T19:26:32.468 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.457+0000 7f3a5daeb700 1 --2- 172.21.15.149:0/2556598475 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3a580afb30 0x7f3a580b4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:26:32.468 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.457+0000 7f3a5e2ec700 1 --2- 172.21.15.149:0/2556598475 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a580b20b0 0x7f3a58158ce0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f3a58070a10 tx=0x7f3a50004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:32.468 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.457+0000 7f3a4a7fc700 1 -- 172.21.15.149:0/2556598475 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a500099b0 con 0x7f3a580b20b0 2023-11-08T19:26:32.469 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.457+0000 7f3a4a7fc700 1 -- 172.21.15.149:0/2556598475 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a50004250 con 0x7f3a580b20b0 2023-11-08T19:26:32.469 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.457+0000 7f3a5fd4f700 1 -- 172.21.15.149:0/2556598475 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a580b5620 con 0x7f3a580b20b0 2023-11-08T19:26:32.470 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.457+0000 7f3a4a7fc700 1 -- 172.21.15.149:0/2556598475 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a50004600 con 0x7f3a580b20b0 2023-11-08T19:26:32.470 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.457+0000 7f3a5fd4f700 1 -- 172.21.15.149:0/2556598475 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a580b5be0 con 0x7f3a580b20b0 2023-11-08T19:26:32.470 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.458+0000 7f3a5fd4f700 1 -- 172.21.15.149:0/2556598475 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a580b6100 con 0x7f3a580b20b0 2023-11-08T19:26:32.470 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.459+0000 7f3a4a7fc700 1 -- 172.21.15.149:0/2556598475 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3a50004760 con 0x7f3a580b20b0 2023-11-08T19:26:32.471 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.459+0000 7f3a4a7fc700 1 --2- 172.21.15.149:0/2556598475 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3a3c06af00 0x7f3a3c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:32.471 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.459+0000 7f3a4a7fc700 1 -- 172.21.15.149:0/2556598475 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f3a5008af80 con 0x7f3a580b20b0 2023-11-08T19:26:32.471 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.459+0000 7f3a5daeb700 1 --2- 172.21.15.149:0/2556598475 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3a3c06af00 0x7f3a3c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:32.471 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.459+0000 7f3a5daeb700 1 --2- 172.21.15.149:0/2556598475 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3a3c06af00 0x7f3a3c06d3c0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c0104d0 tx=0x7f3a4c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:32.472 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.464+0000 7f3a4a7fc700 1 -- 172.21.15.149:0/2556598475 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3a500bdca0 con 0x7f3a580b20b0 2023-11-08T19:26:32.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.695+0000 7f3a5fd4f700 1 -- 172.21.15.149:0/2556598475 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3a580b5d70 con 0x7f3a580b20b0 2023-11-08T19:26:32.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.695+0000 7f3a4a7fc700 1 -- 172.21.15.149:0/2556598475 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4912 (secure 0 0 0) 0x7f3a5002a090 con 0x7f3a580b20b0 2023-11-08T19:26:32.697 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:26:32.697 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":46,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5681,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/1946892292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":1946892292},{"type":"v1","addr":"172.21.15.160:6835","nonce":1946892292}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39},{"gid":6145,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/84105573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":84105573},{"type":"v1","addr":"172.21.15.160:6833","nonce":84105573}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39},{"gid":6663,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/3243545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3243545},{"type":"v1","addr":"172.21.15.149:6836","nonce":3243545}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:11.529336+0000","modified":"2023-11-08T19:26:25.656271+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6666},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6666":{"gid":6666,"name":"a","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6837/1594746264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":1594746264},{"type":"v1","addr":"172.21.15.149:6837","nonce":1594746264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-08T19:26:32.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.697+0000 7f3a5fd4f700 1 -- 172.21.15.149:0/2556598475 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3a3c06af00 msgr2=0x7f3a3c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:32.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.697+0000 7f3a5fd4f700 1 --2- 172.21.15.149:0/2556598475 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3a3c06af00 0x7f3a3c06d3c0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c0104d0 tx=0x7f3a4c008040 comp rx=0 tx=0).stop 2023-11-08T19:26:32.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.697+0000 7f3a5fd4f700 1 -- 172.21.15.149:0/2556598475 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a580b20b0 msgr2=0x7f3a58158ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:32.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.697+0000 7f3a5fd4f700 1 --2- 172.21.15.149:0/2556598475 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a580b20b0 0x7f3a58158ce0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f3a58070a10 tx=0x7f3a50004ad0 comp rx=0 tx=0).stop 2023-11-08T19:26:32.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.697+0000 7f3a5fd4f700 1 -- 172.21.15.149:0/2556598475 shutdown_connections 2023-11-08T19:26:32.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.697+0000 7f3a5fd4f700 1 --2- 172.21.15.149:0/2556598475 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3a3c06af00 0x7f3a3c06d3c0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:32.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.697+0000 7f3a5fd4f700 1 --2- 172.21.15.149:0/2556598475 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a580b20b0 0x7f3a58158ce0 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:32.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.697+0000 7f3a5fd4f700 1 --2- 172.21.15.149:0/2556598475 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3a580afb30 0x7f3a580b4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:32.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.697+0000 7f3a5fd4f700 1 --2- 172.21.15.149:0/2556598475 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3a580b16b0 0x7f3a580b4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:32.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.697+0000 7f3a5fd4f700 1 -- 172.21.15.149:0/2556598475 >> 172.21.15.149:0/2556598475 conn(0x7f3a58099a40 msgr2=0x7f3a580d05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:32.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.698+0000 7f3a5fd4f700 1 -- 172.21.15.149:0/2556598475 shutdown_connections 2023-11-08T19:26:32.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.698+0000 7f3a5fd4f700 1 -- 172.21.15.149:0/2556598475 wait complete. 2023-11-08T19:26:32.701 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 46 2023-11-08T19:26:32.711 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:26:32.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.830+0000 7fc4ca2ca700 1 Processor -- start 2023-11-08T19:26:32.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.830+0000 7fc4ca2ca700 1 -- start start 2023-11-08T19:26:32.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.831+0000 7fc4ca2ca700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc4c406c2a0 0x7fc4c406e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:32.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.831+0000 7fc4ca2ca700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4c40cb220 con 0x7fc4c415a1a0 2023-11-08T19:26:32.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.831+0000 7fc4ca2ca700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4c40cb500 con 0x7fc4c406da50 2023-11-08T19:26:32.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.831+0000 7fc4ca2ca700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c415a580 con 0x7fc4c406c2a0 2023-11-08T19:26:32.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.831+0000 7fc4c3fff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fc4c415a1a0 0x7fc4c406bb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:44932/0 (socket says 172.21.15.149:44932) 2023-11-08T19:26:32.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.831+0000 7fc4c3fff700 1 -- 172.21.15.149:0/1467063133 learned_addr learned my addr 172.21.15.149:0/1467063133 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:26:32.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.832+0000 7fc4c2ffd700 1 -- 172.21.15.149:0/1467063133 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1193253971 0 0) 0x7fc4c40cb220 con 0x7fc4c415a1a0 2023-11-08T19:26:32.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.832+0000 7fc4c37fe700 1 --2- 172.21.15.149:0/1467063133 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc4c406c2a0 0x7fc4c406e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:32.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.832+0000 7fc4c2ffd700 1 -- 172.21.15.149:0/1467063133 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4ac0035b0 con 0x7fc4c415a1a0 2023-11-08T19:26:32.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.832+0000 7fc4c2ffd700 1 -- 172.21.15.149:0/1467063133 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4287252645 0 0) 0x7fc4ac0035b0 con 0x7fc4c415a1a0 2023-11-08T19:26:32.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.832+0000 7fc4c2ffd700 1 -- 172.21.15.149:0/1467063133 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc4c406c2a0 msgr2=0x7fc4c406e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:32.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.832+0000 7fc4c2ffd700 1 --2- 172.21.15.149:0/1467063133 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc4c406c2a0 0x7fc4c406e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:32.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.832+0000 7fc4c2ffd700 1 -- 172.21.15.149:0/1467063133 >> v1:172.21.15.160:6789/0 conn(0x7fc4c406da50 legacy=0x7fc4c40cdd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:32.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.832+0000 7fc4c2ffd700 1 -- 172.21.15.149:0/1467063133 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4c40cb7e0 con 0x7fc4c415a1a0 2023-11-08T19:26:32.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.832+0000 7fc4c2ffd700 1 -- 172.21.15.149:0/1467063133 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7fc4b8001670 con 0x7fc4c415a1a0 2023-11-08T19:26:32.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.832+0000 7fc4c37fe700 1 --2- 172.21.15.149:0/1467063133 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc4c406c2a0 0x7fc4c406e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:26:32.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.832+0000 7fc4c2ffd700 1 -- 172.21.15.149:0/1467063133 >> v1:172.21.15.149:6789/0 conn(0x7fc4c415a1a0 legacy=0x7fc4c406bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:32.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.832+0000 7fc4c2ffd700 1 --2- 172.21.15.149:0/1467063133 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc4c406c2a0 0x7fc4ac003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:32.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.832+0000 7fc4c2ffd700 1 --2- 172.21.15.149:0/1467063133 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc4ac004020 0x7fc4ac004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:32.842 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.832+0000 7fc4c2ffd700 1 --2- 172.21.15.149:0/1467063133 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4ac004d90 0x7fc4ac005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:32.842 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.832+0000 7fc4c2ffd700 1 -- 172.21.15.149:0/1467063133 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c415a580 con 0x7fc4ac004d90 2023-11-08T19:26:32.842 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.832+0000 7fc4c2ffd700 1 -- 172.21.15.149:0/1467063133 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ac00bb70 con 0x7fc4ac004020 2023-11-08T19:26:32.842 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.832+0000 7fc4c2ffd700 1 -- 172.21.15.149:0/1467063133 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ac00bd30 con 0x7fc4c406c2a0 2023-11-08T19:26:32.842 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.832+0000 7fc4c8867700 1 --2- 172.21.15.149:0/1467063133 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4ac004d90 0x7fc4ac005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:32.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.832+0000 7fc4c3fff700 1 --2- 172.21.15.149:0/1467063133 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc4c406c2a0 0x7fc4ac003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:32.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.832+0000 7fc4c37fe700 1 --2- 172.21.15.149:0/1467063133 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc4ac004020 0x7fc4ac004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:32.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.832+0000 7fc4c8867700 1 -- 172.21.15.149:0/1467063133 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc4c406c2a0 msgr2=0x7fc4ac003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:32.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.832+0000 7fc4c8867700 1 --2- 172.21.15.149:0/1467063133 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc4c406c2a0 0x7fc4ac003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:32.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.832+0000 7fc4c8867700 1 -- 172.21.15.149:0/1467063133 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc4ac004020 msgr2=0x7fc4ac004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:32.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.832+0000 7fc4c8867700 1 --2- 172.21.15.149:0/1467063133 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc4ac004020 0x7fc4ac004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:32.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.832+0000 7fc4c8867700 1 -- 172.21.15.149:0/1467063133 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4ac0035b0 con 0x7fc4ac004d90 2023-11-08T19:26:32.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.832+0000 7fc4c37fe700 1 --2- 172.21.15.149:0/1467063133 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc4ac004020 0x7fc4ac004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:26:32.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.832+0000 7fc4c8867700 1 --2- 172.21.15.149:0/1467063133 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4ac004d90 0x7fc4ac005210 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc0021b0 tx=0x7fc4ac005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60429e9eea6ea04c server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:32.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.833+0000 7fc4c2ffd700 1 -- 172.21.15.149:0/1467063133 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc001e40 con 0x7fc4ac004d90 2023-11-08T19:26:32.845 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.833+0000 7fc4c2ffd700 1 -- 172.21.15.149:0/1467063133 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4bc00dc80 con 0x7fc4ac004d90 2023-11-08T19:26:32.845 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.833+0000 7fc4c2ffd700 1 -- 172.21.15.149:0/1467063133 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc003a00 con 0x7fc4ac004d90 2023-11-08T19:26:32.845 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.833+0000 7fc4ca2ca700 1 -- 172.21.15.149:0/1467063133 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4ac004d90 msgr2=0x7fc4ac005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:32.845 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.833+0000 7fc4ca2ca700 1 --2- 172.21.15.149:0/1467063133 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4ac004d90 0x7fc4ac005210 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc0021b0 tx=0x7fc4ac005880 comp rx=0 tx=0).stop 2023-11-08T19:26:32.845 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.833+0000 7fc4c8867700 1 -- 172.21.15.149:0/1467063133 reap_dead start 2023-11-08T19:26:32.846 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.833+0000 7fc4ca2ca700 1 -- 172.21.15.149:0/1467063133 shutdown_connections 2023-11-08T19:26:32.846 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.833+0000 7fc4ca2ca700 1 -- 172.21.15.149:0/1467063133 >> 172.21.15.149:0/1467063133 conn(0x7fc4c4071720 msgr2=0x7fc4c4071b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:32.846 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.833+0000 7fc4ca2ca700 1 -- 172.21.15.149:0/1467063133 shutdown_connections 2023-11-08T19:26:32.846 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.833+0000 7fc4ca2ca700 1 -- 172.21.15.149:0/1467063133 wait complete. 2023-11-08T19:26:32.846 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.834+0000 7fc4ca2ca700 1 Processor -- start 2023-11-08T19:26:32.847 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.835+0000 7fc4ca2ca700 1 -- start start 2023-11-08T19:26:32.847 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.835+0000 7fc4ca2ca700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc4c4158e30 0x7fc4c40c9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:32.847 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.835+0000 7fc4ca2ca700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc4c41f4fb0 0x7fc4c41f1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:32.847 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.835+0000 7fc4ca2ca700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4c4159210 0x7fc4c4156840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:32.847 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.835+0000 7fc4ca2ca700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c40c8710 con 0x7fc4c4159210 2023-11-08T19:26:32.847 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.835+0000 7fc4ca2ca700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c41f2860 con 0x7fc4c4158e30 2023-11-08T19:26:32.848 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.835+0000 7fc4ca2ca700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c41f22a0 con 0x7fc4c41f4fb0 2023-11-08T19:26:32.848 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.835+0000 7fc4c8867700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4c4159210 0x7fc4c4156840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:32.848 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.835+0000 7fc4c8867700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4c4159210 0x7fc4c4156840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42946/0 (socket says 172.21.15.149:42946) 2023-11-08T19:26:32.848 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.835+0000 7fc4c8867700 1 -- 172.21.15.149:0/3297062919 learned_addr learned my addr 172.21.15.149:0/3297062919 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:32.848 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.835+0000 7fc4c3fff700 1 --2- 172.21.15.149:0/3297062919 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc4c4158e30 0x7fc4c40c9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:32.849 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.836+0000 7fc4c37fe700 1 --2- 172.21.15.149:0/3297062919 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc4c41f4fb0 0x7fc4c41f1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:32.849 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.836+0000 7fc4c8867700 1 -- 172.21.15.149:0/3297062919 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc4c41f4fb0 msgr2=0x7fc4c41f1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:32.849 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.836+0000 7fc4c8867700 1 --2- 172.21.15.149:0/3297062919 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc4c41f4fb0 0x7fc4c41f1950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:32.849 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.836+0000 7fc4c8867700 1 -- 172.21.15.149:0/3297062919 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc4c4158e30 msgr2=0x7fc4c40c9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:32.849 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.836+0000 7fc4c8867700 1 --2- 172.21.15.149:0/3297062919 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc4c4158e30 0x7fc4c40c9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:32.850 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.836+0000 7fc4c8867700 1 -- 172.21.15.149:0/3297062919 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4c41f2580 con 0x7fc4c4159210 2023-11-08T19:26:32.850 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.836+0000 7fc4c37fe700 1 --2- 172.21.15.149:0/3297062919 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc4c41f4fb0 0x7fc4c41f1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:26:32.850 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.836+0000 7fc4c8867700 1 --2- 172.21.15.149:0/3297062919 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4c4159210 0x7fc4c4156840 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc004000 tx=0x7fc4bc0014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:32.850 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.836+0000 7fc4c0ff9700 1 -- 172.21.15.149:0/3297062919 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc0052d0 con 0x7fc4c4159210 2023-11-08T19:26:32.850 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.836+0000 7fc4c0ff9700 1 -- 172.21.15.149:0/3297062919 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4bc005430 con 0x7fc4c4159210 2023-11-08T19:26:32.851 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.836+0000 7fc4ca2ca700 1 -- 172.21.15.149:0/3297062919 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4c40c9090 con 0x7fc4c4159210 2023-11-08T19:26:32.851 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.836+0000 7fc4c0ff9700 1 -- 172.21.15.149:0/3297062919 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc0057e0 con 0x7fc4c4159210 2023-11-08T19:26:32.851 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.836+0000 7fc4ca2ca700 1 -- 172.21.15.149:0/3297062919 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4c40c9dd0 con 0x7fc4c4159210 2023-11-08T19:26:32.851 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.837+0000 7fc4ca2ca700 1 -- 172.21.15.149:0/3297062919 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4c40c95b0 con 0x7fc4c4159210 2023-11-08T19:26:32.852 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.837+0000 7fc4c0ff9700 1 -- 172.21.15.149:0/3297062919 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc4bc022070 con 0x7fc4c4159210 2023-11-08T19:26:32.852 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.838+0000 7fc4c0ff9700 1 --2- 172.21.15.149:0/3297062919 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc4b006af30 0x7fc4b006d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:32.853 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.838+0000 7fc4c0ff9700 1 -- 172.21.15.149:0/3297062919 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7148+0+0 (secure 0 0 0) 0x7fc4bc08b9a0 con 0x7fc4c4159210 2023-11-08T19:26:32.853 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.838+0000 7fc4c3fff700 1 --2- 172.21.15.149:0/3297062919 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc4b006af30 0x7fc4b006d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:32.853 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.838+0000 7fc4c3fff700 1 --2- 172.21.15.149:0/3297062919 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc4b006af30 0x7fc4b006d3f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fc4b8001050 tx=0x7fc4b8000f80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:32.853 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:32.842+0000 7fc4c0ff9700 1 -- 172.21.15.149:0/3297062919 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc4c40c95b0 con 0x7fc4c4159210 2023-11-08T19:26:33.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.036+0000 7fc4ca2ca700 1 -- 172.21.15.149:0/3297062919 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc4c40c95b0 con 0x7fc4c4159210 2023-11-08T19:26:33.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.038+0000 7fc4c0ff9700 1 -- 172.21.15.149:0/3297062919 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22099 (secure 0 0 0) 0x7fc4c40c95b0 con 0x7fc4c4159210 2023-11-08T19:26:33.040 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:26:33.040 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":84,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:26:31.232739+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-08T19:24:29.516185+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-08T19:25:44.287064+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":71,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-08T19:25:45.623521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-11-08T19:26:09.267609+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-11-08T19:26:10.496194+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":84,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:26:33.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.040+0000 7fc4ca2ca700 1 -- 172.21.15.149:0/3297062919 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc4b006af30 msgr2=0x7fc4b006d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:33.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.040+0000 7fc4ca2ca700 1 --2- 172.21.15.149:0/3297062919 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc4b006af30 0x7fc4b006d3f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fc4b8001050 tx=0x7fc4b8000f80 comp rx=0 tx=0).stop 2023-11-08T19:26:33.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.040+0000 7fc4ca2ca700 1 -- 172.21.15.149:0/3297062919 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4c4159210 msgr2=0x7fc4c4156840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:33.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.040+0000 7fc4ca2ca700 1 --2- 172.21.15.149:0/3297062919 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4c4159210 0x7fc4c4156840 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc004000 tx=0x7fc4bc0014a0 comp rx=0 tx=0).stop 2023-11-08T19:26:33.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.040+0000 7fc4ca2ca700 1 -- 172.21.15.149:0/3297062919 shutdown_connections 2023-11-08T19:26:33.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.040+0000 7fc4ca2ca700 1 --2- 172.21.15.149:0/3297062919 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc4b006af30 0x7fc4b006d3f0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:33.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.040+0000 7fc4ca2ca700 1 --2- 172.21.15.149:0/3297062919 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc4c4158e30 0x7fc4c40c9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:33.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.040+0000 7fc4ca2ca700 1 --2- 172.21.15.149:0/3297062919 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4c4159210 0x7fc4c4156840 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:33.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.040+0000 7fc4ca2ca700 1 --2- 172.21.15.149:0/3297062919 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc4c41f4fb0 0x7fc4c41f1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:33.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.040+0000 7fc4ca2ca700 1 -- 172.21.15.149:0/3297062919 >> 172.21.15.149:0/3297062919 conn(0x7fc4c4071720 msgr2=0x7fc4c415d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:33.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.041+0000 7fc4ca2ca700 1 -- 172.21.15.149:0/3297062919 shutdown_connections 2023-11-08T19:26:33.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.041+0000 7fc4ca2ca700 1 -- 172.21.15.149:0/3297062919 wait complete. 2023-11-08T19:26:33.054 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-08T19:26:33.054 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:26:33.175 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.174+0000 7f0801245700 1 Processor -- start 2023-11-08T19:26:33.175 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.174+0000 7f0801245700 1 -- start start 2023-11-08T19:26:33.178 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.174+0000 7f0801245700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f07fc0cc140 0x7f07fc0cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:33.178 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.174+0000 7f0801245700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f07fc0b2850 0x7f07fc0cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:33.178 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.174+0000 7f0801245700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07fc0cce50 con 0x7f07fc0b2cd0 2023-11-08T19:26:33.178 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.174+0000 7f0801245700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07fc0b2430 con 0x7f07fc0cc140 2023-11-08T19:26:33.178 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.174+0000 7f0801245700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07fc0cc520 con 0x7f07fc0b2850 2023-11-08T19:26:33.179 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.175+0000 7f07fad9d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f07fc0cc140 0x7f07fc0cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:33.179 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.175+0000 7f07fad9d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f07fc0cc140 0x7f07fc0cc910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42950/0 (socket says 172.21.15.149:42950) 2023-11-08T19:26:33.179 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.175+0000 7f07fad9d700 1 -- 172.21.15.149:0/3997091802 learned_addr learned my addr 172.21.15.149:0/3997091802 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:33.179 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.175+0000 7f07fa59c700 1 --2- 172.21.15.149:0/3997091802 >> v2:172.21.15.160:3300/0 conn(0x7f07fc0b2850 0x7f07fc0cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:33.179 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.175+0000 7f07fad9d700 1 -- 172.21.15.149:0/3997091802 >> v2:172.21.15.160:3300/0 conn(0x7f07fc0b2850 msgr2=0x7f07fc0cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:33.180 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.175+0000 7f07fad9d700 1 --2- 172.21.15.149:0/3997091802 >> v2:172.21.15.160:3300/0 conn(0x7f07fc0b2850 0x7f07fc0cabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:33.180 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.175+0000 7f07fad9d700 1 -- 172.21.15.149:0/3997091802 >> v1:172.21.15.160:6789/0 conn(0x7f07fc0b2cd0 legacy=0x7f07fc15d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:33.180 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.175+0000 7f07fad9d700 1 -- 172.21.15.149:0/3997091802 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07fc0b17b0 con 0x7f07fc0cc140 2023-11-08T19:26:33.180 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.175+0000 7f07fa59c700 1 --2- 172.21.15.149:0/3997091802 >> v2:172.21.15.160:3300/0 conn(0x7f07fc0b2850 0x7f07fc0cabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:26:33.180 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.175+0000 7f07fad9d700 1 --2- 172.21.15.149:0/3997091802 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07fc0cc140 0x7f07fc0cc910 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f07fc0b1330 tx=0x7f07ec009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73337c1d256675cb server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:33.181 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.175+0000 7f07f9d9b700 1 -- 172.21.15.149:0/3997091802 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ec005e30 con 0x7f07fc0cc140 2023-11-08T19:26:33.181 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.175+0000 7f07f9d9b700 1 -- 172.21.15.149:0/3997091802 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07ec006030 con 0x7f07fc0cc140 2023-11-08T19:26:33.181 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.175+0000 7f07f9d9b700 1 -- 172.21.15.149:0/3997091802 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ec0063e0 con 0x7f07fc0cc140 2023-11-08T19:26:33.181 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.176+0000 7f0801245700 1 -- 172.21.15.149:0/3997091802 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07fc0cc140 msgr2=0x7f07fc0cc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:33.181 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.176+0000 7f0801245700 1 --2- 172.21.15.149:0/3997091802 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07fc0cc140 0x7f07fc0cc910 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f07fc0b1330 tx=0x7f07ec009bd0 comp rx=0 tx=0).stop 2023-11-08T19:26:33.182 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.176+0000 7f0801245700 1 -- 172.21.15.149:0/3997091802 shutdown_connections 2023-11-08T19:26:33.182 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.176+0000 7f0801245700 1 --2- 172.21.15.149:0/3997091802 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07fc0cc140 0x7f07fc0cc910 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:33.182 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.176+0000 7f0801245700 1 --2- 172.21.15.149:0/3997091802 >> v2:172.21.15.160:3300/0 conn(0x7f07fc0b2850 0x7f07fc0cabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:33.182 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.176+0000 7f0801245700 1 -- 172.21.15.149:0/3997091802 >> 172.21.15.149:0/3997091802 conn(0x7f07fc099a40 msgr2=0x7f07fc0d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:33.182 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.176+0000 7f0801245700 1 -- 172.21.15.149:0/3997091802 shutdown_connections 2023-11-08T19:26:33.183 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.176+0000 7f0801245700 1 -- 172.21.15.149:0/3997091802 wait complete. 2023-11-08T19:26:33.185 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.177+0000 7f0801245700 1 Processor -- start 2023-11-08T19:26:33.185 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.177+0000 7f0801245700 1 -- start start 2023-11-08T19:26:33.186 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.178+0000 7f0801245700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f07fc0b2850 0x7f07fc09df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:33.186 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.178+0000 7f0801245700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07fc0b2cd0 0x7f07fc14f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:33.186 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.178+0000 7f0801245700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f07fc0cc140 0x7f07fc09c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:33.186 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.178+0000 7f0801245700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07fc09cec0 con 0x7f07fc0b2cd0 2023-11-08T19:26:33.186 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.178+0000 7f0801245700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07fc09d1a0 con 0x7f07fc0b2850 2023-11-08T19:26:33.187 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.178+0000 7f0801245700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07fc09d480 con 0x7f07fc0cc140 2023-11-08T19:26:33.187 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.178+0000 7f07fa59c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07fc0b2cd0 0x7f07fc14f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:33.187 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.178+0000 7f07fa59c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07fc0b2cd0 0x7f07fc14f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42958/0 (socket says 172.21.15.149:42958) 2023-11-08T19:26:33.187 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.178+0000 7f07fa59c700 1 -- 172.21.15.149:0/1939822717 learned_addr learned my addr 172.21.15.149:0/1939822717 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:33.187 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.178+0000 7f07fad9d700 1 --2- 172.21.15.149:0/1939822717 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f07fc0b2850 0x7f07fc09df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:33.188 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.178+0000 7f07fb59e700 1 --2- 172.21.15.149:0/1939822717 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f07fc0cc140 0x7f07fc09c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:33.188 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.178+0000 7f07fa59c700 1 -- 172.21.15.149:0/1939822717 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f07fc0cc140 msgr2=0x7f07fc09c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:33.188 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.178+0000 7f07fa59c700 1 --2- 172.21.15.149:0/1939822717 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f07fc0cc140 0x7f07fc09c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:33.188 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.178+0000 7f07fa59c700 1 -- 172.21.15.149:0/1939822717 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f07fc0b2850 msgr2=0x7f07fc09df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:33.188 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.178+0000 7f07fa59c700 1 --2- 172.21.15.149:0/1939822717 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f07fc0b2850 0x7f07fc09df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:33.189 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.179+0000 7f07fa59c700 1 -- 172.21.15.149:0/1939822717 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07ec009500 con 0x7f07fc0b2cd0 2023-11-08T19:26:33.189 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.179+0000 7f07fa59c700 1 --2- 172.21.15.149:0/1939822717 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07fc0b2cd0 0x7f07fc14f070 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f07f000c750 tx=0x7f07f000ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:33.189 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.179+0000 7f07e37fe700 1 -- 172.21.15.149:0/1939822717 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f0011800 con 0x7f07fc0b2cd0 2023-11-08T19:26:33.189 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.179+0000 7f07e37fe700 1 -- 172.21.15.149:0/1939822717 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f0011960 con 0x7f07fc0b2cd0 2023-11-08T19:26:33.189 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.179+0000 7f0801245700 1 -- 172.21.15.149:0/1939822717 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07fc09d760 con 0x7f07fc0b2cd0 2023-11-08T19:26:33.190 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.179+0000 7f07e37fe700 1 -- 172.21.15.149:0/1939822717 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f0011cd0 con 0x7f07fc0b2cd0 2023-11-08T19:26:33.190 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.179+0000 7f0801245700 1 -- 172.21.15.149:0/1939822717 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07fc14f5b0 con 0x7f07fc0b2cd0 2023-11-08T19:26:33.190 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.180+0000 7f0801245700 1 -- 172.21.15.149:0/1939822717 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07fc09dc80 con 0x7f07fc0b2cd0 2023-11-08T19:26:33.190 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.180+0000 7f07e37fe700 1 -- 172.21.15.149:0/1939822717 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f07f0021350 con 0x7f07fc0b2cd0 2023-11-08T19:26:33.190 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.181+0000 7f07e37fe700 1 --2- 172.21.15.149:0/1939822717 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f07e806af00 0x7f07e806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:33.190 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.181+0000 7f07e37fe700 1 -- 172.21.15.149:0/1939822717 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f07f0089ab0 con 0x7f07fc0b2cd0 2023-11-08T19:26:33.191 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.181+0000 7f07fad9d700 1 --2- 172.21.15.149:0/1939822717 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f07e806af00 0x7f07e806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:33.191 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.181+0000 7f07fad9d700 1 --2- 172.21.15.149:0/1939822717 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f07e806af00 0x7f07e806d3c0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f07fc0b1330 tx=0x7f07ec008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:33.191 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.186+0000 7f07e37fe700 1 -- 172.21.15.149:0/1939822717 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f07fc09dc80 con 0x7f07fc0b2cd0 2023-11-08T19:26:33.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.422+0000 7f0801245700 1 -- 172.21.15.149:0/1939822717 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f07fc09dc80 con 0x7f07fc0b2cd0 2023-11-08T19:26:33.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.422+0000 7f07e37fe700 1 -- 172.21.15.149:0/1939822717 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4912 (secure 0 0 0) 0x7f07fc09dc80 con 0x7f07fc0b2cd0 2023-11-08T19:26:33.424 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:26:33.424 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":46,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5681,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/1946892292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":1946892292},{"type":"v1","addr":"172.21.15.160:6835","nonce":1946892292}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39},{"gid":6145,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/84105573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":84105573},{"type":"v1","addr":"172.21.15.160:6833","nonce":84105573}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39},{"gid":6663,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/3243545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3243545},{"type":"v1","addr":"172.21.15.149:6836","nonce":3243545}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:11.529336+0000","modified":"2023-11-08T19:26:25.656271+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6666},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6666":{"gid":6666,"name":"a","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6837/1594746264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":1594746264},{"type":"v1","addr":"172.21.15.149:6837","nonce":1594746264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-08T19:26:33.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.424+0000 7f0801245700 1 -- 172.21.15.149:0/1939822717 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f07e806af00 msgr2=0x7f07e806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:33.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.424+0000 7f0801245700 1 --2- 172.21.15.149:0/1939822717 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f07e806af00 0x7f07e806d3c0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f07fc0b1330 tx=0x7f07ec008070 comp rx=0 tx=0).stop 2023-11-08T19:26:33.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.424+0000 7f0801245700 1 -- 172.21.15.149:0/1939822717 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07fc0b2cd0 msgr2=0x7f07fc14f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:33.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.424+0000 7f0801245700 1 --2- 172.21.15.149:0/1939822717 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07fc0b2cd0 0x7f07fc14f070 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f07f000c750 tx=0x7f07f000ca60 comp rx=0 tx=0).stop 2023-11-08T19:26:33.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.424+0000 7f0801245700 1 -- 172.21.15.149:0/1939822717 shutdown_connections 2023-11-08T19:26:33.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.424+0000 7f0801245700 1 --2- 172.21.15.149:0/1939822717 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f07e806af00 0x7f07e806d3c0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:33.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.424+0000 7f0801245700 1 --2- 172.21.15.149:0/1939822717 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f07fc0b2850 0x7f07fc09df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:33.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.424+0000 7f0801245700 1 --2- 172.21.15.149:0/1939822717 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f07fc0cc140 0x7f07fc09c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:33.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.424+0000 7f0801245700 1 --2- 172.21.15.149:0/1939822717 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07fc0b2cd0 0x7f07fc14f070 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:33.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.424+0000 7f0801245700 1 -- 172.21.15.149:0/1939822717 >> 172.21.15.149:0/1939822717 conn(0x7f07fc099a40 msgr2=0x7f07fc06b410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:33.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.424+0000 7f0801245700 1 -- 172.21.15.149:0/1939822717 shutdown_connections 2023-11-08T19:26:33.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.424+0000 7f0801245700 1 -- 172.21.15.149:0/1939822717 wait complete. 2023-11-08T19:26:33.428 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 46 2023-11-08T19:26:33.438 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:26:33.558 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.557+0000 7fc9eeb2e700 1 Processor -- start 2023-11-08T19:26:33.558 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.557+0000 7fc9eeb2e700 1 -- start start 2023-11-08T19:26:33.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.558+0000 7fc9eeb2e700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc9e80cc140 0x7fc9e80cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:33.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.558+0000 7fc9eeb2e700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fc9e80b2cd0 0x7fc9e815d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:33.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.558+0000 7fc9eeb2e700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9e80cce50 con 0x7fc9e80b2850 2023-11-08T19:26:33.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.558+0000 7fc9eeb2e700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9e80b2430 con 0x7fc9e80b2cd0 2023-11-08T19:26:33.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.558+0000 7fc9eeb2e700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e80cc520 con 0x7fc9e80cc140 2023-11-08T19:26:33.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.558+0000 7fc9ec8ca700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc9e80cc140 0x7fc9e80cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:33.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.558+0000 7fc9ed0cb700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fc9e80b2cd0 0x7fc9e815d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:33.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.558+0000 7fc9e7fff700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7fc9e80b2850 0x7fc9e80cabf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.149:56632/0 (socket says 172.21.15.149:56632) 2023-11-08T19:26:33.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.558+0000 7fc9e7fff700 1 -- 172.21.15.149:0/1207538083 learned_addr learned my addr 172.21.15.149:0/1207538083 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:26:33.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.558+0000 7fc9ec8ca700 1 -- 172.21.15.149:0/1207538083 >> v2:172.21.15.160:3300/0 conn(0x7fc9e80b2cd0 msgr2=0x7fc9e815d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:33.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.559+0000 7fc9ec8ca700 1 --2- 172.21.15.149:0/1207538083 >> v2:172.21.15.160:3300/0 conn(0x7fc9e80b2cd0 0x7fc9e815d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:33.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.559+0000 7fc9ec8ca700 1 -- 172.21.15.149:0/1207538083 >> v1:172.21.15.160:6789/0 conn(0x7fc9e80b2850 legacy=0x7fc9e80cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:33.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.559+0000 7fc9ec8ca700 1 -- 172.21.15.149:0/1207538083 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9e80b17b0 con 0x7fc9e80cc140 2023-11-08T19:26:33.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.559+0000 7fc9ed0cb700 1 --2- 172.21.15.149:0/1207538083 >> v2:172.21.15.160:3300/0 conn(0x7fc9e80b2cd0 0x7fc9e815d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:26:33.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.559+0000 7fc9ec8ca700 1 --2- 172.21.15.149:0/1207538083 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc9e80cc140 0x7fc9e80cc910 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc009820 tx=0x7fc9dc009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b62fef2ab140eb80 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:33.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.559+0000 7fc9e77fe700 1 -- 172.21.15.149:0/1207538083 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc005e30 con 0x7fc9e80cc140 2023-11-08T19:26:33.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.559+0000 7fc9e77fe700 1 -- 172.21.15.149:0/1207538083 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9dc006030 con 0x7fc9e80cc140 2023-11-08T19:26:33.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.559+0000 7fc9e77fe700 1 -- 172.21.15.149:0/1207538083 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc0063c0 con 0x7fc9e80cc140 2023-11-08T19:26:33.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.559+0000 7fc9eeb2e700 1 -- 172.21.15.149:0/1207538083 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc9e80cc140 msgr2=0x7fc9e80cc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:33.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.559+0000 7fc9eeb2e700 1 --2- 172.21.15.149:0/1207538083 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc9e80cc140 0x7fc9e80cc910 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc009820 tx=0x7fc9dc009b30 comp rx=0 tx=0).stop 2023-11-08T19:26:33.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.559+0000 7fc9eeb2e700 1 -- 172.21.15.149:0/1207538083 shutdown_connections 2023-11-08T19:26:33.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.559+0000 7fc9eeb2e700 1 --2- 172.21.15.149:0/1207538083 >> v2:172.21.15.160:3300/0 conn(0x7fc9e80b2cd0 0x7fc9e815d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:33.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.559+0000 7fc9eeb2e700 1 --2- 172.21.15.149:0/1207538083 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc9e80cc140 0x7fc9e80cc910 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:33.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.559+0000 7fc9eeb2e700 1 -- 172.21.15.149:0/1207538083 >> 172.21.15.149:0/1207538083 conn(0x7fc9e8099a40 msgr2=0x7fc9e80d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:33.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.560+0000 7fc9eeb2e700 1 -- 172.21.15.149:0/1207538083 shutdown_connections 2023-11-08T19:26:33.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.560+0000 7fc9eeb2e700 1 -- 172.21.15.149:0/1207538083 wait complete. 2023-11-08T19:26:33.568 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.561+0000 7fc9eeb2e700 1 Processor -- start 2023-11-08T19:26:33.568 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.561+0000 7fc9eeb2e700 1 -- start start 2023-11-08T19:26:33.569 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.562+0000 7fc9eeb2e700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc9e80b2850 0x7fc9e81f3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:33.569 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.562+0000 7fc9eeb2e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9e80b2cd0 0x7fc9e806e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:33.569 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.562+0000 7fc9eeb2e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc9e80cc140 0x7fc9e806e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:33.569 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.562+0000 7fc9eeb2e700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e81f4170 con 0x7fc9e80b2cd0 2023-11-08T19:26:33.570 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.562+0000 7fc9eeb2e700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e81f36a0 con 0x7fc9e80cc140 2023-11-08T19:26:33.570 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.562+0000 7fc9eeb2e700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e809c020 con 0x7fc9e80b2850 2023-11-08T19:26:33.570 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.562+0000 7fc9e7fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9e80b2cd0 0x7fc9e806e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:33.570 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.562+0000 7fc9e7fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9e80b2cd0 0x7fc9e806e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42972/0 (socket says 172.21.15.149:42972) 2023-11-08T19:26:33.570 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.562+0000 7fc9e7fff700 1 -- 172.21.15.149:0/2101850739 learned_addr learned my addr 172.21.15.149:0/2101850739 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:33.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.562+0000 7fc9ec8ca700 1 --2- 172.21.15.149:0/2101850739 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc9e80b2850 0x7fc9e81f3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:33.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.562+0000 7fc9ed0cb700 1 --2- 172.21.15.149:0/2101850739 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc9e80cc140 0x7fc9e806e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:33.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.562+0000 7fc9e7fff700 1 -- 172.21.15.149:0/2101850739 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc9e80b2850 msgr2=0x7fc9e81f3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:33.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.562+0000 7fc9e7fff700 1 --2- 172.21.15.149:0/2101850739 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc9e80b2850 0x7fc9e81f3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:33.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.562+0000 7fc9e7fff700 1 -- 172.21.15.149:0/2101850739 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc9e80cc140 msgr2=0x7fc9e806e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:33.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.562+0000 7fc9e7fff700 1 --2- 172.21.15.149:0/2101850739 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc9e80cc140 0x7fc9e806e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:33.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.562+0000 7fc9e7fff700 1 -- 172.21.15.149:0/2101850739 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9e0009a70 con 0x7fc9e80b2cd0 2023-11-08T19:26:33.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.562+0000 7fc9ed0cb700 1 --2- 172.21.15.149:0/2101850739 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc9e80cc140 0x7fc9e806e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:26:33.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.562+0000 7fc9e7fff700 1 --2- 172.21.15.149:0/2101850739 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9e80b2cd0 0x7fc9e806e040 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fc9d400c520 tx=0x7fc9d400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:33.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.562+0000 7fc9e57fa700 1 -- 172.21.15.149:0/2101850739 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d4005d70 con 0x7fc9e80b2cd0 2023-11-08T19:26:33.573 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.562+0000 7fc9e57fa700 1 -- 172.21.15.149:0/2101850739 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9d40070d0 con 0x7fc9e80b2cd0 2023-11-08T19:26:33.573 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.562+0000 7fc9eeb2e700 1 -- 172.21.15.149:0/2101850739 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9dc009430 con 0x7fc9e80b2cd0 2023-11-08T19:26:33.573 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.562+0000 7fc9e57fa700 1 -- 172.21.15.149:0/2101850739 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d4007440 con 0x7fc9e80b2cd0 2023-11-08T19:26:33.573 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.562+0000 7fc9eeb2e700 1 -- 172.21.15.149:0/2101850739 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9e81f3bb0 con 0x7fc9e80b2cd0 2023-11-08T19:26:33.573 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.563+0000 7fc9eeb2e700 1 -- 172.21.15.149:0/2101850739 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9e80745f0 con 0x7fc9e80b2cd0 2023-11-08T19:26:33.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.564+0000 7fc9e57fa700 1 -- 172.21.15.149:0/2101850739 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc9d40075a0 con 0x7fc9e80b2cd0 2023-11-08T19:26:33.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.564+0000 7fc9e57fa700 1 --2- 172.21.15.149:0/2101850739 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc9cc06af00 0x7fc9cc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:33.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.564+0000 7fc9e57fa700 1 -- 172.21.15.149:0/2101850739 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7148+0+0 (secure 0 0 0) 0x7fc9d4088f20 con 0x7fc9e80b2cd0 2023-11-08T19:26:33.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.564+0000 7fc9ec8ca700 1 --2- 172.21.15.149:0/2101850739 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc9cc06af00 0x7fc9cc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:33.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.565+0000 7fc9ec8ca700 1 --2- 172.21.15.149:0/2101850739 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc9cc06af00 0x7fc9cc06d3c0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc000c00 tx=0x7fc9dc008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:33.575 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.569+0000 7fc9e57fa700 1 -- 172.21.15.149:0/2101850739 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc9d4053a40 con 0x7fc9e80b2cd0 2023-11-08T19:26:33.799 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.798+0000 7fc9eeb2e700 1 -- 172.21.15.149:0/2101850739 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc9e81f3f50 con 0x7fc9e80b2cd0 2023-11-08T19:26:33.800 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.799+0000 7fc9e57fa700 1 -- 172.21.15.149:0/2101850739 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4912 (secure 0 0 0) 0x7fc9d4017090 con 0x7fc9e80b2cd0 2023-11-08T19:26:33.801 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:26:33.801 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":46,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5681,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/1946892292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":1946892292},{"type":"v1","addr":"172.21.15.160:6835","nonce":1946892292}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39},{"gid":6145,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/84105573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":84105573},{"type":"v1","addr":"172.21.15.160:6833","nonce":84105573}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39},{"gid":6663,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/3243545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3243545},{"type":"v1","addr":"172.21.15.149:6836","nonce":3243545}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:11.529336+0000","modified":"2023-11-08T19:26:25.656271+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6666},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6666":{"gid":6666,"name":"a","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6837/1594746264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":1594746264},{"type":"v1","addr":"172.21.15.149:6837","nonce":1594746264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-08T19:26:33.803 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.801+0000 7fc9eeb2e700 1 -- 172.21.15.149:0/2101850739 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc9cc06af00 msgr2=0x7fc9cc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:33.803 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.801+0000 7fc9eeb2e700 1 --2- 172.21.15.149:0/2101850739 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc9cc06af00 0x7fc9cc06d3c0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc000c00 tx=0x7fc9dc008070 comp rx=0 tx=0).stop 2023-11-08T19:26:33.803 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.801+0000 7fc9eeb2e700 1 -- 172.21.15.149:0/2101850739 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9e80b2cd0 msgr2=0x7fc9e806e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:33.803 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.801+0000 7fc9eeb2e700 1 --2- 172.21.15.149:0/2101850739 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9e80b2cd0 0x7fc9e806e040 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fc9d400c520 tx=0x7fc9d400c830 comp rx=0 tx=0).stop 2023-11-08T19:26:33.804 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.801+0000 7fc9eeb2e700 1 -- 172.21.15.149:0/2101850739 shutdown_connections 2023-11-08T19:26:33.804 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.801+0000 7fc9eeb2e700 1 --2- 172.21.15.149:0/2101850739 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc9cc06af00 0x7fc9cc06d3c0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:33.804 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.801+0000 7fc9eeb2e700 1 --2- 172.21.15.149:0/2101850739 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc9e80cc140 0x7fc9e806e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:33.804 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.801+0000 7fc9eeb2e700 1 --2- 172.21.15.149:0/2101850739 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc9e80b2850 0x7fc9e81f3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:33.804 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.801+0000 7fc9eeb2e700 1 --2- 172.21.15.149:0/2101850739 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9e80b2cd0 0x7fc9e806e040 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:33.805 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.801+0000 7fc9eeb2e700 1 -- 172.21.15.149:0/2101850739 >> 172.21.15.149:0/2101850739 conn(0x7fc9e8099a40 msgr2=0x7fc9e80c7670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:33.805 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.801+0000 7fc9eeb2e700 1 -- 172.21.15.149:0/2101850739 shutdown_connections 2023-11-08T19:26:33.805 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.801+0000 7fc9eeb2e700 1 -- 172.21.15.149:0/2101850739 wait complete. 2023-11-08T19:26:33.805 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 46 2023-11-08T19:26:33.815 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:26:33.936 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.934+0000 7f41e648b700 1 Processor -- start 2023-11-08T19:26:33.936 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.934+0000 7f41e648b700 1 -- start start 2023-11-08T19:26:33.939 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.935+0000 7f41e648b700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f41e006f0e0 0x7f41e00d2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:33.939 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.935+0000 7f41e648b700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41e006bd50 con 0x7f41e015dc30 2023-11-08T19:26:33.940 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.935+0000 7f41e648b700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41e00d04b0 con 0x7f41e006fe40 2023-11-08T19:26:33.940 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.935+0000 7f41e648b700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41e00d25a0 con 0x7f41e006f0e0 2023-11-08T19:26:33.940 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.935+0000 7f41dffff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f41e015dc30 0x7f41e006f730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:44980/0 (socket says 172.21.15.149:44980) 2023-11-08T19:26:33.940 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.935+0000 7f41dffff700 1 -- 172.21.15.149:0/1258969166 learned_addr learned my addr 172.21.15.149:0/1258969166 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:26:33.940 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.936+0000 7f41e4a28700 1 --2- 172.21.15.149:0/1258969166 >> v2:172.21.15.160:3300/0 conn(0x7f41e006f0e0 0x7f41e00d2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:33.941 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.936+0000 7f41deffd700 1 -- 172.21.15.149:0/1258969166 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3678346120 0 0) 0x7f41e006bd50 con 0x7f41e015dc30 2023-11-08T19:26:33.941 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.936+0000 7f41deffd700 1 -- 172.21.15.149:0/1258969166 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41cc0035b0 con 0x7f41e015dc30 2023-11-08T19:26:33.941 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.936+0000 7f41deffd700 1 -- 172.21.15.149:0/1258969166 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1521203628 0 0) 0x7f41cc0035b0 con 0x7f41e015dc30 2023-11-08T19:26:33.941 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.936+0000 7f41deffd700 1 -- 172.21.15.149:0/1258969166 >> v2:172.21.15.160:3300/0 conn(0x7f41e006f0e0 msgr2=0x7f41e00d2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:33.941 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.936+0000 7f41deffd700 1 --2- 172.21.15.149:0/1258969166 >> v2:172.21.15.160:3300/0 conn(0x7f41e006f0e0 0x7f41e00d2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:33.942 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.936+0000 7f41deffd700 1 -- 172.21.15.149:0/1258969166 >> v1:172.21.15.160:6789/0 conn(0x7f41e006fe40 legacy=0x7f41e006c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:33.942 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.936+0000 7f41deffd700 1 -- 172.21.15.149:0/1258969166 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e006f4f0 con 0x7f41e015dc30 2023-11-08T19:26:33.942 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.936+0000 7f41deffd700 1 -- 172.21.15.149:0/1258969166 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f41d00017f0 con 0x7f41e015dc30 2023-11-08T19:26:33.942 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.936+0000 7f41deffd700 1 -- 172.21.15.149:0/1258969166 >> v1:172.21.15.149:6789/0 conn(0x7f41e015dc30 legacy=0x7f41e006f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:33.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.936+0000 7f41deffd700 1 --2- 172.21.15.149:0/1258969166 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f41cc003a00 0x7f41cc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:33.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.936+0000 7f41deffd700 1 --2- 172.21.15.149:0/1258969166 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f41cc004850 0x7f41cc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:33.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.936+0000 7f41deffd700 1 --2- 172.21.15.149:0/1258969166 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41cc005210 0x7f41cc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:33.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.936+0000 7f41deffd700 1 -- 172.21.15.149:0/1258969166 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e00d25a0 con 0x7f41cc005210 2023-11-08T19:26:33.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.936+0000 7f41deffd700 1 -- 172.21.15.149:0/1258969166 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41cc00c0b0 con 0x7f41cc003a00 2023-11-08T19:26:33.944 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.936+0000 7f41deffd700 1 -- 172.21.15.149:0/1258969166 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41cc00c270 con 0x7f41cc004850 2023-11-08T19:26:33.944 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.936+0000 7f41e4a28700 1 --2- 172.21.15.149:0/1258969166 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41cc005210 0x7f41cc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:33.944 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.936+0000 7f41dffff700 1 --2- 172.21.15.149:0/1258969166 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f41cc003a00 0x7f41cc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:33.944 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.936+0000 7f41df7fe700 1 --2- 172.21.15.149:0/1258969166 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f41cc004850 0x7f41cc004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:33.944 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.936+0000 7f41e4a28700 1 -- 172.21.15.149:0/1258969166 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f41cc004850 msgr2=0x7f41cc004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:33.944 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.936+0000 7f41e4a28700 1 --2- 172.21.15.149:0/1258969166 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f41cc004850 0x7f41cc004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:33.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.936+0000 7f41e4a28700 1 -- 172.21.15.149:0/1258969166 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f41cc003a00 msgr2=0x7f41cc003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:33.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.936+0000 7f41e4a28700 1 --2- 172.21.15.149:0/1258969166 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f41cc003a00 0x7f41cc003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:33.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.936+0000 7f41e4a28700 1 -- 172.21.15.149:0/1258969166 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41cc0035b0 con 0x7f41cc005210 2023-11-08T19:26:33.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.936+0000 7f41e4a28700 1 -- 172.21.15.149:0/1258969166 reap_dead start 2023-11-08T19:26:33.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.937+0000 7f41e4a28700 1 --2- 172.21.15.149:0/1258969166 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41cc005210 0x7f41cc00ba10 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f41d8009fc0 tx=0x7f41cc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1d4ad037c06353c server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:33.946 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.937+0000 7f41deffd700 1 -- 172.21.15.149:0/1258969166 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d8003a20 con 0x7f41cc005210 2023-11-08T19:26:33.946 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.937+0000 7f41deffd700 1 -- 172.21.15.149:0/1258969166 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d800f040 con 0x7f41cc005210 2023-11-08T19:26:33.946 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.937+0000 7f41deffd700 1 -- 172.21.15.149:0/1258969166 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d8003de0 con 0x7f41cc005210 2023-11-08T19:26:33.946 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.937+0000 7f41e648b700 1 -- 172.21.15.149:0/1258969166 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41cc005210 msgr2=0x7f41cc00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:33.946 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.937+0000 7f41e648b700 1 --2- 172.21.15.149:0/1258969166 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41cc005210 0x7f41cc00ba10 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f41d8009fc0 tx=0x7f41cc005880 comp rx=0 tx=0).stop 2023-11-08T19:26:33.947 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.937+0000 7f41e648b700 1 -- 172.21.15.149:0/1258969166 shutdown_connections 2023-11-08T19:26:33.947 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.937+0000 7f41e648b700 1 --2- 172.21.15.149:0/1258969166 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41cc005210 0x7f41cc00ba10 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:33.947 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.937+0000 7f41e648b700 1 -- 172.21.15.149:0/1258969166 >> 172.21.15.149:0/1258969166 conn(0x7f41e008afd0 msgr2=0x7f41e00d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:33.947 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.937+0000 7f41e648b700 1 -- 172.21.15.149:0/1258969166 shutdown_connections 2023-11-08T19:26:33.947 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.937+0000 7f41e648b700 1 -- 172.21.15.149:0/1258969166 wait complete. 2023-11-08T19:26:33.948 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.938+0000 7f41e648b700 1 Processor -- start 2023-11-08T19:26:33.950 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.939+0000 7f41e648b700 1 -- start start 2023-11-08T19:26:33.950 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.939+0000 7f41e648b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41cc005210 0x7f41e00ce470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:33.951 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.939+0000 7f41e648b700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f41e00ccd10 0x7f41e0151b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:33.951 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.939+0000 7f41e648b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f41e00b6ac0 0x7f41e00cc070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:33.951 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.939+0000 7f41e648b700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e00cdfe0 con 0x7f41cc005210 2023-11-08T19:26:33.951 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.939+0000 7f41e648b700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e00cd3d0 con 0x7f41e00b6ac0 2023-11-08T19:26:33.951 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.939+0000 7f41e648b700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41e00cd6b0 con 0x7f41e00ccd10 2023-11-08T19:26:33.952 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.939+0000 7f41dffff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41cc005210 0x7f41e00ce470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:33.952 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.940+0000 7f41dffff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41cc005210 0x7f41e00ce470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42990/0 (socket says 172.21.15.149:42990) 2023-11-08T19:26:33.952 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.940+0000 7f41dffff700 1 -- 172.21.15.149:0/42530958 learned_addr learned my addr 172.21.15.149:0/42530958 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:33.952 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.940+0000 7f41df7fe700 1 --2- 172.21.15.149:0/42530958 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f41e00ccd10 0x7f41e0151b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:33.952 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.940+0000 7f41e4a28700 1 --2- 172.21.15.149:0/42530958 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f41e00b6ac0 0x7f41e00cc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:33.953 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.940+0000 7f41dffff700 1 -- 172.21.15.149:0/42530958 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f41e00ccd10 msgr2=0x7f41e0151b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:33.953 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.940+0000 7f41dffff700 1 --2- 172.21.15.149:0/42530958 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f41e00ccd10 0x7f41e0151b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:33.953 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.940+0000 7f41dffff700 1 -- 172.21.15.149:0/42530958 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f41e00b6ac0 msgr2=0x7f41e00cc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:33.953 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.940+0000 7f41dffff700 1 --2- 172.21.15.149:0/42530958 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f41e00b6ac0 0x7f41e00cc070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:33.953 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.940+0000 7f41dffff700 1 -- 172.21.15.149:0/42530958 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e00cd990 con 0x7f41cc005210 2023-11-08T19:26:33.954 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.940+0000 7f41e4a28700 1 --2- 172.21.15.149:0/42530958 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f41e00b6ac0 0x7f41e00cc070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:26:33.954 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.940+0000 7f41dffff700 1 --2- 172.21.15.149:0/42530958 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41cc005210 0x7f41e00ce470 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f41d0007fd0 tx=0x7f41d000fb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:33.954 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.940+0000 7f41dcff9700 1 -- 172.21.15.149:0/42530958 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d00072e0 con 0x7f41cc005210 2023-11-08T19:26:33.954 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.940+0000 7f41dcff9700 1 -- 172.21.15.149:0/42530958 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d0007440 con 0x7f41cc005210 2023-11-08T19:26:33.955 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.940+0000 7f41dcff9700 1 -- 172.21.15.149:0/42530958 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d0005830 con 0x7f41cc005210 2023-11-08T19:26:33.955 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.940+0000 7f41e648b700 1 -- 172.21.15.149:0/42530958 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41e00cdc70 con 0x7f41cc005210 2023-11-08T19:26:33.955 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.940+0000 7f41e648b700 1 -- 172.21.15.149:0/42530958 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41e00b6f50 con 0x7f41cc005210 2023-11-08T19:26:33.955 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.941+0000 7f41e648b700 1 -- 172.21.15.149:0/42530958 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41e00cde30 con 0x7f41cc005210 2023-11-08T19:26:33.955 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.942+0000 7f41dcff9700 1 -- 172.21.15.149:0/42530958 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f41d0005990 con 0x7f41cc005210 2023-11-08T19:26:33.956 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.942+0000 7f41dcff9700 1 --2- 172.21.15.149:0/42530958 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f41c006af00 0x7f41c006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:33.956 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.942+0000 7f41dcff9700 1 -- 172.21.15.149:0/42530958 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f41d0089ad0 con 0x7f41cc005210 2023-11-08T19:26:33.956 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.942+0000 7f41df7fe700 1 --2- 172.21.15.149:0/42530958 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f41c006af00 0x7f41c006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:33.956 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.942+0000 7f41df7fe700 1 --2- 172.21.15.149:0/42530958 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f41c006af00 0x7f41c006d3c0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f41e00cd0f0 tx=0x7f41c8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:33.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:33.947+0000 7f41dcff9700 1 -- 172.21.15.149:0/42530958 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f41d00545e0 con 0x7f41cc005210 2023-11-08T19:26:34.142 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.141+0000 7f41e648b700 1 -- 172.21.15.149:0/42530958 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f41e00b7650 con 0x7f41cc005210 2023-11-08T19:26:34.144 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.143+0000 7f41dcff9700 1 -- 172.21.15.149:0/42530958 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22099 (secure 0 0 0) 0x7f41d0057c00 con 0x7f41cc005210 2023-11-08T19:26:34.144 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:26:34.145 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":84,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:26:31.232739+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-08T19:24:29.516185+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-08T19:25:44.287064+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":71,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-08T19:25:45.623521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-11-08T19:26:09.267609+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-11-08T19:26:10.496194+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":84,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:26:34.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.145+0000 7f41e648b700 1 -- 172.21.15.149:0/42530958 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f41c006af00 msgr2=0x7f41c006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:34.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.146+0000 7f41e648b700 1 --2- 172.21.15.149:0/42530958 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f41c006af00 0x7f41c006d3c0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f41e00cd0f0 tx=0x7f41c8009040 comp rx=0 tx=0).stop 2023-11-08T19:26:34.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.146+0000 7f41e648b700 1 -- 172.21.15.149:0/42530958 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41cc005210 msgr2=0x7f41e00ce470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:34.148 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.146+0000 7f41e648b700 1 --2- 172.21.15.149:0/42530958 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41cc005210 0x7f41e00ce470 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f41d0007fd0 tx=0x7f41d000fb70 comp rx=0 tx=0).stop 2023-11-08T19:26:34.148 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.146+0000 7f41e648b700 1 -- 172.21.15.149:0/42530958 shutdown_connections 2023-11-08T19:26:34.148 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.146+0000 7f41e648b700 1 --2- 172.21.15.149:0/42530958 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f41c006af00 0x7f41c006d3c0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:34.148 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.146+0000 7f41e648b700 1 --2- 172.21.15.149:0/42530958 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f41e00b6ac0 0x7f41e00cc070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:34.148 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.146+0000 7f41e648b700 1 --2- 172.21.15.149:0/42530958 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41cc005210 0x7f41e00ce470 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:34.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.146+0000 7f41e648b700 1 --2- 172.21.15.149:0/42530958 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f41e00ccd10 0x7f41e0151b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:34.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.146+0000 7f41e648b700 1 -- 172.21.15.149:0/42530958 >> 172.21.15.149:0/42530958 conn(0x7f41e008afd0 msgr2=0x7f41e00b3750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:34.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.146+0000 7f41e648b700 1 -- 172.21.15.149:0/42530958 shutdown_connections 2023-11-08T19:26:34.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.146+0000 7f41e648b700 1 -- 172.21.15.149:0/42530958 wait complete. 2023-11-08T19:26:34.159 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-08T19:26:34.283 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.282+0000 7f2d40cce700 1 Processor -- start 2023-11-08T19:26:34.284 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.282+0000 7f2d40cce700 1 -- start start 2023-11-08T19:26:34.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.283+0000 7f2d40cce700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d3c0cc910 0x7f2d3c0cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:34.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.283+0000 7f2d40cce700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d3c0b2f60 con 0x7f2d3c0cb130 2023-11-08T19:26:34.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.283+0000 7f2d40cce700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d3c0cc520 con 0x7f2d3c0cc140 2023-11-08T19:26:34.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.283+0000 7f2d40cce700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3c0b2430 con 0x7f2d3c0cc910 2023-11-08T19:26:34.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.283+0000 7f2d3ad9d700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f2d3c0cb130 0x7f2d3c15d2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:45004/0 (socket says 172.21.15.149:45004) 2023-11-08T19:26:34.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.283+0000 7f2d3ad9d700 1 -- 172.21.15.149:0/546541523 learned_addr learned my addr 172.21.15.149:0/546541523 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:26:34.287 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.283+0000 7f2d39d9b700 1 --2- 172.21.15.149:0/546541523 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d3c0cc910 0x7f2d3c0cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:34.287 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.284+0000 7f2d3959a700 1 -- 172.21.15.149:0/546541523 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 103850170 0 0) 0x7f2d3c0b2f60 con 0x7f2d3c0cb130 2023-11-08T19:26:34.287 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.284+0000 7f2d3959a700 1 -- 172.21.15.149:0/546541523 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d240035b0 con 0x7f2d3c0cb130 2023-11-08T19:26:34.287 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.284+0000 7f2d3959a700 1 -- 172.21.15.149:0/546541523 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2673219606 0 0) 0x7f2d3c0cc520 con 0x7f2d3c0cc140 2023-11-08T19:26:34.287 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.284+0000 7f2d3959a700 1 -- 172.21.15.149:0/546541523 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d3c0b2f60 con 0x7f2d3c0cc140 2023-11-08T19:26:34.287 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.284+0000 7f2d39d9b700 1 -- 172.21.15.149:0/546541523 >> v1:172.21.15.160:6789/0 conn(0x7f2d3c0cc140 legacy=0x7f2d3c0b2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:34.288 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.284+0000 7f2d39d9b700 1 -- 172.21.15.149:0/546541523 >> v1:172.21.15.149:6789/0 conn(0x7f2d3c0cb130 legacy=0x7f2d3c15d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:34.288 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.284+0000 7f2d39d9b700 1 -- 172.21.15.149:0/546541523 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d3c0cb5b0 con 0x7f2d3c0cc910 2023-11-08T19:26:34.288 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.284+0000 7f2d39d9b700 1 --2- 172.21.15.149:0/546541523 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d3c0cc910 0x7f2d3c0cabf0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2d30009870 tx=0x7f2d30009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d4ea155d54b5d3a server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:34.288 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.284+0000 7f2d3959a700 1 -- 172.21.15.149:0/546541523 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d30011830 con 0x7f2d3c0cc910 2023-11-08T19:26:34.288 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.284+0000 7f2d3959a700 1 -- 172.21.15.149:0/546541523 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d30011990 con 0x7f2d3c0cc910 2023-11-08T19:26:34.289 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.284+0000 7f2d3959a700 1 -- 172.21.15.149:0/546541523 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d30011d00 con 0x7f2d3c0cc910 2023-11-08T19:26:34.292 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.285+0000 7f2d40cce700 1 -- 172.21.15.149:0/546541523 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d3c0cc910 msgr2=0x7f2d3c0cabf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:34.292 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.285+0000 7f2d40cce700 1 --2- 172.21.15.149:0/546541523 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d3c0cc910 0x7f2d3c0cabf0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2d30009870 tx=0x7f2d30009b80 comp rx=0 tx=0).stop 2023-11-08T19:26:34.292 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.285+0000 7f2d40cce700 1 -- 172.21.15.149:0/546541523 shutdown_connections 2023-11-08T19:26:34.292 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.285+0000 7f2d40cce700 1 --2- 172.21.15.149:0/546541523 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d3c0cc910 0x7f2d3c0cabf0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:34.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.285+0000 7f2d40cce700 1 -- 172.21.15.149:0/546541523 >> 172.21.15.149:0/546541523 conn(0x7f2d3c099a40 msgr2=0x7f2d3c0d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:34.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.285+0000 7f2d40cce700 1 -- 172.21.15.149:0/546541523 shutdown_connections 2023-11-08T19:26:34.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.285+0000 7f2d40cce700 1 -- 172.21.15.149:0/546541523 wait complete. 2023-11-08T19:26:34.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.287+0000 7f2d40cce700 1 Processor -- start 2023-11-08T19:26:34.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.287+0000 7f2d40cce700 1 -- start start 2023-11-08T19:26:34.294 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.287+0000 7f2d40cce700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d3c0cb130 0x7f2d3c0b47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:34.294 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.287+0000 7f2d40cce700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2d3c0cc140 0x7f2d3c0adbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:34.294 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.287+0000 7f2d40cce700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d3c0cc910 0x7f2d3c152980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:34.294 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.287+0000 7f2d40cce700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3c0b3710 con 0x7f2d3c0cb130 2023-11-08T19:26:34.294 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.287+0000 7f2d40cce700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3c0b39f0 con 0x7f2d3c0cc140 2023-11-08T19:26:34.295 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.287+0000 7f2d40cce700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3c0b3cd0 con 0x7f2d3c0cc910 2023-11-08T19:26:34.295 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.288+0000 7f2d3a59c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d3c0cb130 0x7f2d3c0b47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:34.295 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.288+0000 7f2d3a59c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d3c0cb130 0x7f2d3c0b47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43004/0 (socket says 172.21.15.149:43004) 2023-11-08T19:26:34.295 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.288+0000 7f2d3a59c700 1 -- 172.21.15.149:0/2197575735 learned_addr learned my addr 172.21.15.149:0/2197575735 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:34.295 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.288+0000 7f2d39d9b700 1 --2- 172.21.15.149:0/2197575735 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2d3c0cc140 0x7f2d3c0adbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:34.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.288+0000 7f2d3a59c700 1 -- 172.21.15.149:0/2197575735 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d3c0cc910 msgr2=0x7f2d3c152980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:34.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.288+0000 7f2d3a59c700 1 --2- 172.21.15.149:0/2197575735 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d3c0cc910 0x7f2d3c152980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:34.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.288+0000 7f2d3a59c700 1 -- 172.21.15.149:0/2197575735 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2d3c0cc140 msgr2=0x7f2d3c0adbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:34.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.288+0000 7f2d3a59c700 1 --2- 172.21.15.149:0/2197575735 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2d3c0cc140 0x7f2d3c0adbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:34.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.288+0000 7f2d3a59c700 1 -- 172.21.15.149:0/2197575735 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d300094a0 con 0x7f2d3c0cb130 2023-11-08T19:26:34.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.288+0000 7f2d39d9b700 1 --2- 172.21.15.149:0/2197575735 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2d3c0cc140 0x7f2d3c0adbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:26:34.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.288+0000 7f2d3a59c700 1 --2- 172.21.15.149:0/2197575735 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d3c0cb130 0x7f2d3c0b47b0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c00c500 tx=0x7f2d2c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:34.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.288+0000 7f2d2affd700 1 -- 172.21.15.149:0/2197575735 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c0052d0 con 0x7f2d3c0cb130 2023-11-08T19:26:34.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.288+0000 7f2d2affd700 1 -- 172.21.15.149:0/2197575735 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d2c005450 con 0x7f2d3c0cb130 2023-11-08T19:26:34.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.288+0000 7f2d40cce700 1 -- 172.21.15.149:0/2197575735 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d3c0b3fb0 con 0x7f2d3c0cb130 2023-11-08T19:26:34.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.288+0000 7f2d2affd700 1 -- 172.21.15.149:0/2197575735 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c003910 con 0x7f2d3c0cb130 2023-11-08T19:26:34.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.288+0000 7f2d40cce700 1 -- 172.21.15.149:0/2197575735 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d3c0ae110 con 0x7f2d3c0cb130 2023-11-08T19:26:34.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.289+0000 7f2d40cce700 1 -- 172.21.15.149:0/2197575735 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d3c0b2830 con 0x7f2d3c0cb130 2023-11-08T19:26:34.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.290+0000 7f2d2affd700 1 -- 172.21.15.149:0/2197575735 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2d2c003a70 con 0x7f2d3c0cb130 2023-11-08T19:26:34.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.290+0000 7f2d2affd700 1 --2- 172.21.15.149:0/2197575735 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2d1c06af00 0x7f2d1c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:34.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.290+0000 7f2d2affd700 1 -- 172.21.15.149:0/2197575735 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f2d2c089170 con 0x7f2d3c0cb130 2023-11-08T19:26:34.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.290+0000 7f2d39d9b700 1 --2- 172.21.15.149:0/2197575735 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2d1c06af00 0x7f2d1c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:34.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.291+0000 7f2d39d9b700 1 --2- 172.21.15.149:0/2197575735 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2d1c06af00 0x7f2d1c06d3c0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f2d30009870 tx=0x7f2d30008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:34.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.295+0000 7f2d2affd700 1 -- 172.21.15.149:0/2197575735 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2d2c053cc0 con 0x7f2d3c0cb130 2023-11-08T19:26:34.528 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.527+0000 7f2d40cce700 1 -- 172.21.15.149:0/2197575735 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f2d3c0cb880 con 0x7f2d3c0cb130 2023-11-08T19:26:34.529 INFO:tasks.ceph.mon.a.smithi149.stderr:2023-11-08T19:26:34.528+0000 7f2b592f2700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-08T19:26:34.530 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.529+0000 7f2d2affd700 1 -- 172.21.15.149:0/2197575735 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v47) v1 ==== 161+0+0 (secure 0 0 0) 0x7f2d2c0572e0 con 0x7f2d3c0cb130 2023-11-08T19:26:34.533 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.531+0000 7f2d40cce700 1 -- 172.21.15.149:0/2197575735 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2d1c06af00 msgr2=0x7f2d1c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:34.533 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.531+0000 7f2d40cce700 1 --2- 172.21.15.149:0/2197575735 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2d1c06af00 0x7f2d1c06d3c0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f2d30009870 tx=0x7f2d30008030 comp rx=0 tx=0).stop 2023-11-08T19:26:34.534 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.531+0000 7f2d40cce700 1 -- 172.21.15.149:0/2197575735 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d3c0cb130 msgr2=0x7f2d3c0b47b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:34.534 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.531+0000 7f2d40cce700 1 --2- 172.21.15.149:0/2197575735 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d3c0cb130 0x7f2d3c0b47b0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c00c500 tx=0x7f2d2c00c8c0 comp rx=0 tx=0).stop 2023-11-08T19:26:34.534 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.531+0000 7f2d40cce700 1 -- 172.21.15.149:0/2197575735 shutdown_connections 2023-11-08T19:26:34.534 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.531+0000 7f2d40cce700 1 --2- 172.21.15.149:0/2197575735 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2d1c06af00 0x7f2d1c06d3c0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:34.535 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.531+0000 7f2d40cce700 1 --2- 172.21.15.149:0/2197575735 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d3c0cc910 0x7f2d3c152980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:34.535 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.531+0000 7f2d40cce700 1 --2- 172.21.15.149:0/2197575735 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d3c0cb130 0x7f2d3c0b47b0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:34.535 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.531+0000 7f2d40cce700 1 --2- 172.21.15.149:0/2197575735 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2d3c0cc140 0x7f2d3c0adbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:34.536 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.532+0000 7f2d40cce700 1 -- 172.21.15.149:0/2197575735 >> 172.21.15.149:0/2197575735 conn(0x7f2d3c099a40 msgr2=0x7f2d3c0c7670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:34.536 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.532+0000 7f2d40cce700 1 -- 172.21.15.149:0/2197575735 shutdown_connections 2023-11-08T19:26:34.536 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.532+0000 7f2d40cce700 1 -- 172.21.15.149:0/2197575735 wait complete. 2023-11-08T19:26:34.537 INFO:teuthology.orchestra.run.smithi149.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-08T19:26:34.537 INFO:tasks.ceph.mds.a.smithi149.stderr: -4788> 2023-11-08T19:26:16.351+0000 7f4e903b6700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-08T19:26:34.548 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-08T19:26:34.568 INFO:tasks.ceph.mds.a.smithi149.stdout:starting mds.a at 2023-11-08T19:26:34.675 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.674+0000 7f0b8e15a700 1 Processor -- start 2023-11-08T19:26:34.675 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.674+0000 7f0b8e15a700 1 -- start start 2023-11-08T19:26:34.678 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.674+0000 7f0b8e15a700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f0b8815abf0 0x7f0b880b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:34.678 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.674+0000 7f0b8e15a700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0b880d1130 0x7f0b880cc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:34.679 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.674+0000 7f0b8e15a700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0b880cc6a0 0x7f0b880ce210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:34.679 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.674+0000 7f0b8e15a700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b880b66a0 con 0x7f0b880cc6a0 2023-11-08T19:26:34.679 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.674+0000 7f0b8e15a700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b880d04a0 con 0x7f0b8815abf0 2023-11-08T19:26:34.679 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.674+0000 7f0b8e15a700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b880b6470 con 0x7f0b880d1130 2023-11-08T19:26:34.680 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.675+0000 7f0b87fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0b880cc6a0 0x7f0b880ce210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:34.680 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.675+0000 7f0b87fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0b880cc6a0 0x7f0b880ce210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43026/0 (socket says 172.21.15.149:43026) 2023-11-08T19:26:34.680 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.675+0000 7f0b87fff700 1 -- 172.21.15.149:0/190486983 learned_addr learned my addr 172.21.15.149:0/190486983 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:34.680 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.675+0000 7f0b877fe700 1 --2- 172.21.15.149:0/190486983 >> v2:172.21.15.160:3300/0 conn(0x7f0b8815abf0 0x7f0b880b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:34.680 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.675+0000 7f0b87fff700 1 -- 172.21.15.149:0/190486983 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0b880d1130 msgr2=0x7f0b880cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:34.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.675+0000 7f0b87fff700 1 --2- 172.21.15.149:0/190486983 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0b880d1130 0x7f0b880cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:34.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.675+0000 7f0b87fff700 1 -- 172.21.15.149:0/190486983 >> v2:172.21.15.160:3300/0 conn(0x7f0b8815abf0 msgr2=0x7f0b880b5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:34.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.675+0000 7f0b87fff700 1 --2- 172.21.15.149:0/190486983 >> v2:172.21.15.160:3300/0 conn(0x7f0b8815abf0 0x7f0b880b5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:34.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.675+0000 7f0b87fff700 1 -- 172.21.15.149:0/190486983 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b8815afd0 con 0x7f0b880cc6a0 2023-11-08T19:26:34.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.675+0000 7f0b877fe700 1 --2- 172.21.15.149:0/190486983 >> v2:172.21.15.160:3300/0 conn(0x7f0b8815abf0 0x7f0b880b5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:26:34.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.675+0000 7f0b87fff700 1 --2- 172.21.15.149:0/190486983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b880cc6a0 0x7f0b880ce210 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f0b88067970 tx=0x7f0b8000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=732ea02da773540b server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:34.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.675+0000 7f0b867fc700 1 -- 172.21.15.149:0/190486983 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8000e070 con 0x7f0b880cc6a0 2023-11-08T19:26:34.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.675+0000 7f0b867fc700 1 -- 172.21.15.149:0/190486983 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b8000b9c0 con 0x7f0b880cc6a0 2023-11-08T19:26:34.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.675+0000 7f0b867fc700 1 -- 172.21.15.149:0/190486983 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8000bd70 con 0x7f0b880cc6a0 2023-11-08T19:26:34.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.676+0000 7f0b8e15a700 1 -- 172.21.15.149:0/190486983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b880cc6a0 msgr2=0x7f0b880ce210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:34.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.676+0000 7f0b8e15a700 1 --2- 172.21.15.149:0/190486983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b880cc6a0 0x7f0b880ce210 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f0b88067970 tx=0x7f0b8000b330 comp rx=0 tx=0).stop 2023-11-08T19:26:34.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.676+0000 7f0b8e15a700 1 -- 172.21.15.149:0/190486983 shutdown_connections 2023-11-08T19:26:34.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.676+0000 7f0b8e15a700 1 --2- 172.21.15.149:0/190486983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b880cc6a0 0x7f0b880ce210 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:34.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.676+0000 7f0b8e15a700 1 --2- 172.21.15.149:0/190486983 >> v2:172.21.15.160:3300/0 conn(0x7f0b8815abf0 0x7f0b880b5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:34.684 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.676+0000 7f0b8e15a700 1 --2- 172.21.15.149:0/190486983 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0b880d1130 0x7f0b880cc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:34.684 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.676+0000 7f0b8e15a700 1 -- 172.21.15.149:0/190486983 >> 172.21.15.149:0/190486983 conn(0x7f0b880d0640 msgr2=0x7f0b880d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:34.684 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.676+0000 7f0b8e15a700 1 -- 172.21.15.149:0/190486983 shutdown_connections 2023-11-08T19:26:34.684 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.676+0000 7f0b8e15a700 1 -- 172.21.15.149:0/190486983 wait complete. 2023-11-08T19:26:34.684 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.677+0000 7f0b8e15a700 1 Processor -- start 2023-11-08T19:26:34.685 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.677+0000 7f0b8e15a700 1 -- start start 2023-11-08T19:26:34.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.678+0000 7f0b8e15a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b880cc6a0 0x7f0b8814e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:34.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.678+0000 7f0b8e15a700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0b880d1130 0x7f0b8815b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:34.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.678+0000 7f0b8e15a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b8815abf0 0x7f0b880b0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:34.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.678+0000 7f0b8e15a700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b881f3620 con 0x7f0b880cc6a0 2023-11-08T19:26:34.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.678+0000 7f0b8e15a700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b88152150 con 0x7f0b8815abf0 2023-11-08T19:26:34.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.678+0000 7f0b8e15a700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b881f2a10 con 0x7f0b880d1130 2023-11-08T19:26:34.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.678+0000 7f0b877fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b880cc6a0 0x7f0b8814e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:34.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.678+0000 7f0b877fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b880cc6a0 0x7f0b8814e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43028/0 (socket says 172.21.15.149:43028) 2023-11-08T19:26:34.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.678+0000 7f0b877fe700 1 -- 172.21.15.149:0/3023806225 learned_addr learned my addr 172.21.15.149:0/3023806225 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:34.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.678+0000 7f0b87fff700 1 --2- 172.21.15.149:0/3023806225 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b8815abf0 0x7f0b880b0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:34.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.678+0000 7f0b86ffd700 1 --2- 172.21.15.149:0/3023806225 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0b880d1130 0x7f0b8815b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:34.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.678+0000 7f0b877fe700 1 -- 172.21.15.149:0/3023806225 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0b880d1130 msgr2=0x7f0b8815b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:34.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.678+0000 7f0b877fe700 1 --2- 172.21.15.149:0/3023806225 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0b880d1130 0x7f0b8815b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:34.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.678+0000 7f0b877fe700 1 -- 172.21.15.149:0/3023806225 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b8815abf0 msgr2=0x7f0b880b0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:34.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.678+0000 7f0b877fe700 1 --2- 172.21.15.149:0/3023806225 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b8815abf0 0x7f0b880b0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:34.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.678+0000 7f0b877fe700 1 -- 172.21.15.149:0/3023806225 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b80009b30 con 0x7f0b880cc6a0 2023-11-08T19:26:34.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.678+0000 7f0b87fff700 1 --2- 172.21.15.149:0/3023806225 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b8815abf0 0x7f0b880b0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:26:34.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.678+0000 7f0b877fe700 1 --2- 172.21.15.149:0/3023806225 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b880cc6a0 0x7f0b8814e440 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f0b7800c7f0 tx=0x7f0b7800cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:34.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.679+0000 7f0b7ffff700 1 -- 172.21.15.149:0/3023806225 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b78011800 con 0x7f0b880cc6a0 2023-11-08T19:26:34.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.679+0000 7f0b7ffff700 1 -- 172.21.15.149:0/3023806225 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b78011960 con 0x7f0b880cc6a0 2023-11-08T19:26:34.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.679+0000 7f0b7ffff700 1 -- 172.21.15.149:0/3023806225 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b78011d10 con 0x7f0b880cc6a0 2023-11-08T19:26:34.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.679+0000 7f0b8e15a700 1 -- 172.21.15.149:0/3023806225 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b881f2cf0 con 0x7f0b880cc6a0 2023-11-08T19:26:34.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.679+0000 7f0b8e15a700 1 -- 172.21.15.149:0/3023806225 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b881f32b0 con 0x7f0b880cc6a0 2023-11-08T19:26:34.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.680+0000 7f0b8e15a700 1 -- 172.21.15.149:0/3023806225 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b881f3440 con 0x7f0b880cc6a0 2023-11-08T19:26:34.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.680+0000 7f0b7ffff700 1 -- 172.21.15.149:0/3023806225 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0b78018360 con 0x7f0b880cc6a0 2023-11-08T19:26:34.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.680+0000 7f0b7ffff700 1 --2- 172.21.15.149:0/3023806225 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0b6806af00 0x7f0b6806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:34.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.680+0000 7f0b7ffff700 1 -- 172.21.15.149:0/3023806225 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7206+0+0 (secure 0 0 0) 0x7f0b78089ac0 con 0x7f0b880cc6a0 2023-11-08T19:26:34.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.680+0000 7f0b86ffd700 1 --2- 172.21.15.149:0/3023806225 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0b6806af00 0x7f0b6806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:34.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.681+0000 7f0b86ffd700 1 --2- 172.21.15.149:0/3023806225 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0b6806af00 0x7f0b6806d3c0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f0b70006fd0 tx=0x7f0b70008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:34.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.685+0000 7f0b7ffff700 1 -- 172.21.15.149:0/3023806225 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0b78054620 con 0x7f0b880cc6a0 2023-11-08T19:26:34.916 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:34.915+0000 7f0b8e15a700 1 -- 172.21.15.149:0/3023806225 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0b8804f730 con 0x7f0b880cc6a0 2023-11-08T19:26:35.533 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.532+0000 7f0b7ffff700 1 -- 172.21.15.149:0/3023806225 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v48) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0b7805e020 con 0x7f0b880cc6a0 2023-11-08T19:26:35.536 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.535+0000 7f0b8e15a700 1 -- 172.21.15.149:0/3023806225 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0b6806af00 msgr2=0x7f0b6806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:35.537 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.535+0000 7f0b8e15a700 1 --2- 172.21.15.149:0/3023806225 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0b6806af00 0x7f0b6806d3c0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f0b70006fd0 tx=0x7f0b70008040 comp rx=0 tx=0).stop 2023-11-08T19:26:35.537 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.535+0000 7f0b8e15a700 1 -- 172.21.15.149:0/3023806225 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b880cc6a0 msgr2=0x7f0b8814e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:35.537 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.535+0000 7f0b8e15a700 1 --2- 172.21.15.149:0/3023806225 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b880cc6a0 0x7f0b8814e440 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f0b7800c7f0 tx=0x7f0b7800cbb0 comp rx=0 tx=0).stop 2023-11-08T19:26:35.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.535+0000 7f0b8e15a700 1 -- 172.21.15.149:0/3023806225 shutdown_connections 2023-11-08T19:26:35.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.535+0000 7f0b8e15a700 1 --2- 172.21.15.149:0/3023806225 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0b6806af00 0x7f0b6806d3c0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:35.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.535+0000 7f0b8e15a700 1 --2- 172.21.15.149:0/3023806225 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b8815abf0 0x7f0b880b0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:35.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.535+0000 7f0b8e15a700 1 --2- 172.21.15.149:0/3023806225 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b880cc6a0 0x7f0b8814e440 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:35.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.535+0000 7f0b8e15a700 1 --2- 172.21.15.149:0/3023806225 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0b880d1130 0x7f0b8815b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:35.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.535+0000 7f0b8e15a700 1 -- 172.21.15.149:0/3023806225 >> 172.21.15.149:0/3023806225 conn(0x7f0b880d0640 msgr2=0x7f0b88071f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:35.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.535+0000 7f0b8e15a700 1 -- 172.21.15.149:0/3023806225 shutdown_connections 2023-11-08T19:26:35.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.535+0000 7f0b8e15a700 1 -- 172.21.15.149:0/3023806225 wait complete. 2023-11-08T19:26:35.550 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-08T19:26:35.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.716+0000 7f6b24009700 1 Processor -- start 2023-11-08T19:26:35.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.717+0000 7f6b24009700 1 -- start start 2023-11-08T19:26:35.721 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.717+0000 7f6b24009700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f6b1c15e8e0 0x7f6b1c06ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:35.721 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.717+0000 7f6b24009700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6b1c06c050 0x7f6b1c072050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:35.721 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.717+0000 7f6b24009700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6b1c072590 0x7f6b1c0729c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:35.721 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.717+0000 7f6b24009700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b1c06cc50 con 0x7f6b1c06c050 2023-11-08T19:26:35.721 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.717+0000 7f6b24009700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b1c06c640 con 0x7f6b1c15e8e0 2023-11-08T19:26:35.722 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.717+0000 7f6b24009700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1c15efd0 con 0x7f6b1c072590 2023-11-08T19:26:35.722 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.718+0000 7f6b215a4700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6b1c06c050 0x7f6b1c072050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:35.722 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.718+0000 7f6b215a4700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6b1c06c050 0x7f6b1c072050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43038/0 (socket says 172.21.15.149:43038) 2023-11-08T19:26:35.722 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.718+0000 7f6b215a4700 1 -- 172.21.15.149:0/2544799525 learned_addr learned my addr 172.21.15.149:0/2544799525 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:35.723 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.718+0000 7f6b225a6700 1 --2- 172.21.15.149:0/2544799525 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6b1c072590 0x7f6b1c0729c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:35.723 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.718+0000 7f6b215a4700 1 -- 172.21.15.149:0/2544799525 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6b1c072590 msgr2=0x7f6b1c0729c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:35.723 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.718+0000 7f6b21da5700 1 --2- 172.21.15.149:0/2544799525 >> v2:172.21.15.160:3300/0 conn(0x7f6b1c15e8e0 0x7f6b1c06ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:35.723 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.718+0000 7f6b215a4700 1 --2- 172.21.15.149:0/2544799525 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6b1c072590 0x7f6b1c0729c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:35.723 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.718+0000 7f6b215a4700 1 -- 172.21.15.149:0/2544799525 >> v2:172.21.15.160:3300/0 conn(0x7f6b1c15e8e0 msgr2=0x7f6b1c06ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:35.724 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.718+0000 7f6b215a4700 1 --2- 172.21.15.149:0/2544799525 >> v2:172.21.15.160:3300/0 conn(0x7f6b1c15e8e0 0x7f6b1c06ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:35.724 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.718+0000 7f6b215a4700 1 -- 172.21.15.149:0/2544799525 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b1c06c8e0 con 0x7f6b1c06c050 2023-11-08T19:26:35.724 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.718+0000 7f6b225a6700 1 --2- 172.21.15.149:0/2544799525 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6b1c072590 0x7f6b1c0729c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:26:35.724 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.718+0000 7f6b21da5700 1 --2- 172.21.15.149:0/2544799525 >> v2:172.21.15.160:3300/0 conn(0x7f6b1c15e8e0 0x7f6b1c06ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:26:35.725 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.718+0000 7f6b215a4700 1 --2- 172.21.15.149:0/2544799525 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b1c06c050 0x7f6b1c072050 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c0753b0 tx=0x7f6b18009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bf22f328229e102 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:35.725 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.718+0000 7f6b20da3700 1 -- 172.21.15.149:0/2544799525 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1800b870 con 0x7f6b1c06c050 2023-11-08T19:26:35.725 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.718+0000 7f6b20da3700 1 -- 172.21.15.149:0/2544799525 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b1800b9d0 con 0x7f6b1c06c050 2023-11-08T19:26:35.725 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.718+0000 7f6b20da3700 1 -- 172.21.15.149:0/2544799525 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1800bd60 con 0x7f6b1c06c050 2023-11-08T19:26:35.725 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.719+0000 7f6b24009700 1 -- 172.21.15.149:0/2544799525 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b1c06c050 msgr2=0x7f6b1c072050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:35.726 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.719+0000 7f6b24009700 1 --2- 172.21.15.149:0/2544799525 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b1c06c050 0x7f6b1c072050 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c0753b0 tx=0x7f6b18009bd0 comp rx=0 tx=0).stop 2023-11-08T19:26:35.726 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.719+0000 7f6b24009700 1 -- 172.21.15.149:0/2544799525 shutdown_connections 2023-11-08T19:26:35.726 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.719+0000 7f6b24009700 1 --2- 172.21.15.149:0/2544799525 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6b1c072590 0x7f6b1c0729c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:35.726 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.719+0000 7f6b24009700 1 --2- 172.21.15.149:0/2544799525 >> v2:172.21.15.160:3300/0 conn(0x7f6b1c15e8e0 0x7f6b1c06ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:35.727 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.719+0000 7f6b24009700 1 --2- 172.21.15.149:0/2544799525 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b1c06c050 0x7f6b1c072050 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:35.727 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.719+0000 7f6b24009700 1 -- 172.21.15.149:0/2544799525 >> 172.21.15.149:0/2544799525 conn(0x7f6b1c0d0740 msgr2=0x7f6b1c0d0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:35.727 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.719+0000 7f6b24009700 1 -- 172.21.15.149:0/2544799525 shutdown_connections 2023-11-08T19:26:35.727 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.719+0000 7f6b24009700 1 -- 172.21.15.149:0/2544799525 wait complete. 2023-11-08T19:26:35.731 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.720+0000 7f6b24009700 1 Processor -- start 2023-11-08T19:26:35.731 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.720+0000 7f6b24009700 1 -- start start 2023-11-08T19:26:35.731 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.721+0000 7f6b24009700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6b1c06c050 0x7f6b1c1489c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:35.732 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.721+0000 7f6b24009700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6b1c072590 0x7f6b1c161f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:35.732 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.721+0000 7f6b24009700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b1c15e8e0 0x7f6b1c0c99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:35.732 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.721+0000 7f6b24009700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1c148f00 con 0x7f6b1c15e8e0 2023-11-08T19:26:35.732 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.721+0000 7f6b24009700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1c14b370 con 0x7f6b1c06c050 2023-11-08T19:26:35.732 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.721+0000 7f6b24009700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1c14b610 con 0x7f6b1c072590 2023-11-08T19:26:35.733 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.721+0000 7f6b225a6700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b1c15e8e0 0x7f6b1c0c99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:35.733 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.721+0000 7f6b225a6700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b1c15e8e0 0x7f6b1c0c99e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43046/0 (socket says 172.21.15.149:43046) 2023-11-08T19:26:35.733 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.721+0000 7f6b225a6700 1 -- 172.21.15.149:0/1546521644 learned_addr learned my addr 172.21.15.149:0/1546521644 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:35.733 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.721+0000 7f6b215a4700 1 --2- 172.21.15.149:0/1546521644 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6b1c072590 0x7f6b1c161f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:35.733 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.721+0000 7f6b21da5700 1 --2- 172.21.15.149:0/1546521644 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6b1c06c050 0x7f6b1c1489c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:35.734 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.721+0000 7f6b225a6700 1 -- 172.21.15.149:0/1546521644 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6b1c072590 msgr2=0x7f6b1c161f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:35.734 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.721+0000 7f6b225a6700 1 --2- 172.21.15.149:0/1546521644 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6b1c072590 0x7f6b1c161f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:35.734 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.721+0000 7f6b225a6700 1 -- 172.21.15.149:0/1546521644 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6b1c06c050 msgr2=0x7f6b1c1489c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:35.734 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.721+0000 7f6b225a6700 1 --2- 172.21.15.149:0/1546521644 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6b1c06c050 0x7f6b1c1489c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:35.734 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.721+0000 7f6b225a6700 1 -- 172.21.15.149:0/1546521644 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b18009550 con 0x7f6b1c15e8e0 2023-11-08T19:26:35.735 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.721+0000 7f6b21da5700 1 --2- 172.21.15.149:0/1546521644 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6b1c06c050 0x7f6b1c1489c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:26:35.735 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.721+0000 7f6b225a6700 1 --2- 172.21.15.149:0/1546521644 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b1c15e8e0 0x7f6b1c0c99e0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f6b1400cef0 tx=0x7f6b1400cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:35.735 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.722+0000 7f6b127fc700 1 -- 172.21.15.149:0/1546521644 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1400ad30 con 0x7f6b1c15e8e0 2023-11-08T19:26:35.735 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.722+0000 7f6b127fc700 1 -- 172.21.15.149:0/1546521644 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b1400ae90 con 0x7f6b1c15e8e0 2023-11-08T19:26:35.735 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.722+0000 7f6b24009700 1 -- 172.21.15.149:0/1546521644 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b1c14b8f0 con 0x7f6b1c15e8e0 2023-11-08T19:26:35.736 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.722+0000 7f6b127fc700 1 -- 172.21.15.149:0/1546521644 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b14015680 con 0x7f6b1c15e8e0 2023-11-08T19:26:35.736 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.722+0000 7f6b24009700 1 -- 172.21.15.149:0/1546521644 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b1c14beb0 con 0x7f6b1c15e8e0 2023-11-08T19:26:35.736 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.723+0000 7f6b24009700 1 -- 172.21.15.149:0/1546521644 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b1c14c0a0 con 0x7f6b1c15e8e0 2023-11-08T19:26:35.736 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.723+0000 7f6b127fc700 1 -- 172.21.15.149:0/1546521644 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6b1400d430 con 0x7f6b1c15e8e0 2023-11-08T19:26:35.736 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.723+0000 7f6b127fc700 1 --2- 172.21.15.149:0/1546521644 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6b0006af00 0x7f6b0006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:35.737 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.724+0000 7f6b21da5700 1 --2- 172.21.15.149:0/1546521644 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6b0006af00 0x7f6b0006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:35.737 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.724+0000 7f6b127fc700 1 -- 172.21.15.149:0/1546521644 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7206+0+0 (secure 0 0 0) 0x7f6b1408a0d0 con 0x7f6b1c15e8e0 2023-11-08T19:26:35.737 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.724+0000 7f6b21da5700 1 --2- 172.21.15.149:0/1546521644 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6b0006af00 0x7f6b0006d3c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c00aa20 tx=0x7f6b0c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:35.737 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.728+0000 7f6b127fc700 1 -- 172.21.15.149:0/1546521644 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6b14054ba0 con 0x7f6b1c15e8e0 2023-11-08T19:26:35.917 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:35.916+0000 7f6b24009700 1 -- 172.21.15.149:0/1546521644 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6b1c0745f0 con 0x7f6b1c15e8e0 2023-11-08T19:26:36.542 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.541+0000 7f6b127fc700 1 -- 172.21.15.149:0/1546521644 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v86) v1 ==== 181+0+0 (secure 0 0 0) 0x7f6b140581c0 con 0x7f6b1c15e8e0 2023-11-08T19:26:36.545 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.543+0000 7f6b24009700 1 -- 172.21.15.149:0/1546521644 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6b0006af00 msgr2=0x7f6b0006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:36.545 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.543+0000 7f6b24009700 1 --2- 172.21.15.149:0/1546521644 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6b0006af00 0x7f6b0006d3c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c00aa20 tx=0x7f6b0c008040 comp rx=0 tx=0).stop 2023-11-08T19:26:36.545 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.543+0000 7f6b24009700 1 -- 172.21.15.149:0/1546521644 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b1c15e8e0 msgr2=0x7f6b1c0c99e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:36.545 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.543+0000 7f6b24009700 1 --2- 172.21.15.149:0/1546521644 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b1c15e8e0 0x7f6b1c0c99e0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f6b1400cef0 tx=0x7f6b1400cf20 comp rx=0 tx=0).stop 2023-11-08T19:26:36.545 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.544+0000 7f6b24009700 1 -- 172.21.15.149:0/1546521644 shutdown_connections 2023-11-08T19:26:36.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.544+0000 7f6b24009700 1 --2- 172.21.15.149:0/1546521644 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6b0006af00 0x7f6b0006d3c0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:36.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.544+0000 7f6b24009700 1 --2- 172.21.15.149:0/1546521644 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6b1c06c050 0x7f6b1c1489c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:36.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.544+0000 7f6b24009700 1 --2- 172.21.15.149:0/1546521644 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b1c15e8e0 0x7f6b1c0c99e0 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:36.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.544+0000 7f6b24009700 1 --2- 172.21.15.149:0/1546521644 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6b1c072590 0x7f6b1c161f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:36.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.544+0000 7f6b24009700 1 -- 172.21.15.149:0/1546521644 >> 172.21.15.149:0/1546521644 conn(0x7f6b1c0d0740 msgr2=0x7f6b1c0ce5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:36.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.544+0000 7f6b24009700 1 -- 172.21.15.149:0/1546521644 shutdown_connections 2023-11-08T19:26:36.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.544+0000 7f6b24009700 1 -- 172.21.15.149:0/1546521644 wait complete. 2023-11-08T19:26:36.547 INFO:teuthology.orchestra.run.smithi149.stderr:pool 'cephfs_metadata' removed 2023-11-08T19:26:36.560 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-08T19:26:36.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.687+0000 7f81f2c54700 1 Processor -- start 2023-11-08T19:26:36.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.687+0000 7f81f2c54700 1 -- start start 2023-11-08T19:26:36.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.688+0000 7f81f2c54700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f81ec15ab20 0x7f81ec0cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:36.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.688+0000 7f81f2c54700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f81ec06c2a0 0x7f81ec0cf340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:36.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.688+0000 7f81f2c54700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81ec0cac30 con 0x7f81ec0cb0c0 2023-11-08T19:26:36.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.688+0000 7f81f2c54700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81ec0cfc80 con 0x7f81ec15ab20 2023-11-08T19:26:36.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.688+0000 7f81f2c54700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81ec15af00 con 0x7f81ec06c2a0 2023-11-08T19:26:36.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.688+0000 7f81f09f0700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f81ec15ab20 0x7f81ec0cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:36.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.688+0000 7f81f09f0700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f81ec15ab20 0x7f81ec0cee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43050/0 (socket says 172.21.15.149:43050) 2023-11-08T19:26:36.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.688+0000 7f81f09f0700 1 -- 172.21.15.149:0/267192865 learned_addr learned my addr 172.21.15.149:0/267192865 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:36.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.688+0000 7f81f09f0700 1 -- 172.21.15.149:0/267192865 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f81ec06c2a0 msgr2=0x7f81ec0cf340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:36.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.688+0000 7f81f09f0700 1 --2- 172.21.15.149:0/267192865 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f81ec06c2a0 0x7f81ec0cf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:36.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.688+0000 7f81f09f0700 1 -- 172.21.15.149:0/267192865 >> v1:172.21.15.160:6789/0 conn(0x7f81ec0cb0c0 legacy=0x7f81ec06bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:36.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.688+0000 7f81f09f0700 1 -- 172.21.15.149:0/267192865 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81ec072a30 con 0x7f81ec15ab20 2023-11-08T19:26:36.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.688+0000 7f81f09f0700 1 --2- 172.21.15.149:0/267192865 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f81ec15ab20 0x7f81ec0cee00 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f81e000bb90 tx=0x7f81e000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=274f98931815ff1d server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:36.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.688+0000 7f81eb7fe700 1 -- 172.21.15.149:0/267192865 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e000dd10 con 0x7f81ec15ab20 2023-11-08T19:26:36.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.688+0000 7f81eb7fe700 1 -- 172.21.15.149:0/267192865 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e000de70 con 0x7f81ec15ab20 2023-11-08T19:26:36.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.688+0000 7f81eb7fe700 1 -- 172.21.15.149:0/267192865 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e0004230 con 0x7f81ec15ab20 2023-11-08T19:26:36.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.689+0000 7f81f2c54700 1 -- 172.21.15.149:0/267192865 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f81ec15ab20 msgr2=0x7f81ec0cee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:36.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.689+0000 7f81f2c54700 1 --2- 172.21.15.149:0/267192865 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f81ec15ab20 0x7f81ec0cee00 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f81e000bb90 tx=0x7f81e000bea0 comp rx=0 tx=0).stop 2023-11-08T19:26:36.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.689+0000 7f81f2c54700 1 -- 172.21.15.149:0/267192865 shutdown_connections 2023-11-08T19:26:36.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.689+0000 7f81f2c54700 1 --2- 172.21.15.149:0/267192865 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f81ec06c2a0 0x7f81ec0cf340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:36.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.689+0000 7f81f2c54700 1 --2- 172.21.15.149:0/267192865 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f81ec15ab20 0x7f81ec0cee00 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:36.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.689+0000 7f81f2c54700 1 -- 172.21.15.149:0/267192865 >> 172.21.15.149:0/267192865 conn(0x7f81ec071800 msgr2=0x7f81ec071c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:36.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.689+0000 7f81f2c54700 1 -- 172.21.15.149:0/267192865 shutdown_connections 2023-11-08T19:26:36.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.689+0000 7f81f2c54700 1 -- 172.21.15.149:0/267192865 wait complete. 2023-11-08T19:26:36.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.690+0000 7f81f2c54700 1 Processor -- start 2023-11-08T19:26:36.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.690+0000 7f81f2c54700 1 -- start start 2023-11-08T19:26:36.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.691+0000 7f81f2c54700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f81ec06c2a0 0x7f81ec0b0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:36.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.691+0000 7f81f2c54700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f81ec0cb0c0 0x7f81ec0b4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:36.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.691+0000 7f81f2c54700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f81ec15ab20 0x7f81ec1564b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:36.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.691+0000 7f81f2c54700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81ec0b4a90 con 0x7f81ec0cb0c0 2023-11-08T19:26:36.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.691+0000 7f81f2c54700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81ec0b4d70 con 0x7f81ec06c2a0 2023-11-08T19:26:36.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.691+0000 7f81f2c54700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81ec0b5050 con 0x7f81ec15ab20 2023-11-08T19:26:36.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.691+0000 7f81ebfff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f81ec0cb0c0 0x7f81ec0b4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:36.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.691+0000 7f81ebfff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f81ec0cb0c0 0x7f81ec0b4040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43060/0 (socket says 172.21.15.149:43060) 2023-11-08T19:26:36.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.691+0000 7f81ebfff700 1 -- 172.21.15.149:0/2889845682 learned_addr learned my addr 172.21.15.149:0/2889845682 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:36.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.691+0000 7f81f09f0700 1 --2- 172.21.15.149:0/2889845682 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f81ec06c2a0 0x7f81ec0b0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:36.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.691+0000 7f81f11f1700 1 --2- 172.21.15.149:0/2889845682 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f81ec15ab20 0x7f81ec1564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:36.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.692+0000 7f81ebfff700 1 -- 172.21.15.149:0/2889845682 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f81ec15ab20 msgr2=0x7f81ec1564b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:36.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.692+0000 7f81ebfff700 1 --2- 172.21.15.149:0/2889845682 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f81ec15ab20 0x7f81ec1564b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:36.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.692+0000 7f81ebfff700 1 -- 172.21.15.149:0/2889845682 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f81ec06c2a0 msgr2=0x7f81ec0b0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:36.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.692+0000 7f81ebfff700 1 --2- 172.21.15.149:0/2889845682 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f81ec06c2a0 0x7f81ec0b0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:36.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.692+0000 7f81ebfff700 1 -- 172.21.15.149:0/2889845682 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e000b7f0 con 0x7f81ec0cb0c0 2023-11-08T19:26:36.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.692+0000 7f81ebfff700 1 --2- 172.21.15.149:0/2889845682 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f81ec0cb0c0 0x7f81ec0b4040 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f81d800c4a0 tx=0x7f81d800c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:36.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.692+0000 7f81e97fa700 1 -- 172.21.15.149:0/2889845682 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d80054e0 con 0x7f81ec0cb0c0 2023-11-08T19:26:36.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.692+0000 7f81e97fa700 1 -- 172.21.15.149:0/2889845682 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d8003680 con 0x7f81ec0cb0c0 2023-11-08T19:26:36.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.692+0000 7f81e97fa700 1 -- 172.21.15.149:0/2889845682 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d8003a10 con 0x7f81ec0cb0c0 2023-11-08T19:26:36.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.692+0000 7f81f2c54700 1 -- 172.21.15.149:0/2889845682 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81ec0b5330 con 0x7f81ec0cb0c0 2023-11-08T19:26:36.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.692+0000 7f81f2c54700 1 -- 172.21.15.149:0/2889845682 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81ec154840 con 0x7f81ec0cb0c0 2023-11-08T19:26:36.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.693+0000 7f81f2c54700 1 -- 172.21.15.149:0/2889845682 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81ec0b5850 con 0x7f81ec0cb0c0 2023-11-08T19:26:36.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.693+0000 7f81e97fa700 1 -- 172.21.15.149:0/2889845682 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f81d8003b70 con 0x7f81ec0cb0c0 2023-11-08T19:26:36.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.694+0000 7f81e97fa700 1 --2- 172.21.15.149:0/2889845682 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f81d006af00 0x7f81d006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:36.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.694+0000 7f81e97fa700 1 -- 172.21.15.149:0/2889845682 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6768+0+0 (secure 0 0 0) 0x7f81d8088ab0 con 0x7f81ec0cb0c0 2023-11-08T19:26:36.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.694+0000 7f81f09f0700 1 --2- 172.21.15.149:0/2889845682 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f81d006af00 0x7f81d006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:36.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.694+0000 7f81f09f0700 1 --2- 172.21.15.149:0/2889845682 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f81d006af00 0x7f81d006d3c0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f81e000b340 tx=0x7f81e001c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:36.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.699+0000 7f81e97fa700 1 -- 172.21.15.149:0/2889845682 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f81ec0b5850 con 0x7f81ec0cb0c0 2023-11-08T19:26:36.890 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:36.889+0000 7f81f2c54700 1 -- 172.21.15.149:0/2889845682 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f81ec0b5850 con 0x7f81ec0cb0c0 2023-11-08T19:26:37.545 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.544+0000 7f81e97fa700 1 -- 172.21.15.149:0/2889845682 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v87) v1 ==== 169+0+0 (secure 0 0 0) 0x7f81ec0b5850 con 0x7f81ec0cb0c0 2023-11-08T19:26:37.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.547+0000 7f81f2c54700 1 -- 172.21.15.149:0/2889845682 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f81d006af00 msgr2=0x7f81d006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:37.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.547+0000 7f81f2c54700 1 --2- 172.21.15.149:0/2889845682 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f81d006af00 0x7f81d006d3c0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f81e000b340 tx=0x7f81e001c040 comp rx=0 tx=0).stop 2023-11-08T19:26:37.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.547+0000 7f81f2c54700 1 -- 172.21.15.149:0/2889845682 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f81ec0cb0c0 msgr2=0x7f81ec0b4040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:37.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.547+0000 7f81f2c54700 1 --2- 172.21.15.149:0/2889845682 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f81ec0cb0c0 0x7f81ec0b4040 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f81d800c4a0 tx=0x7f81d800c7b0 comp rx=0 tx=0).stop 2023-11-08T19:26:37.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.547+0000 7f81f2c54700 1 -- 172.21.15.149:0/2889845682 shutdown_connections 2023-11-08T19:26:37.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.547+0000 7f81f2c54700 1 --2- 172.21.15.149:0/2889845682 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f81d006af00 0x7f81d006d3c0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:37.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.547+0000 7f81f2c54700 1 --2- 172.21.15.149:0/2889845682 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f81ec06c2a0 0x7f81ec0b0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:37.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.547+0000 7f81f2c54700 1 --2- 172.21.15.149:0/2889845682 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f81ec15ab20 0x7f81ec1564b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:37.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.547+0000 7f81f2c54700 1 --2- 172.21.15.149:0/2889845682 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f81ec0cb0c0 0x7f81ec0b4040 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:37.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.547+0000 7f81f2c54700 1 -- 172.21.15.149:0/2889845682 >> 172.21.15.149:0/2889845682 conn(0x7f81ec071800 msgr2=0x7f81ec0b34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:37.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.547+0000 7f81f2c54700 1 -- 172.21.15.149:0/2889845682 shutdown_connections 2023-11-08T19:26:37.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.547+0000 7f81f2c54700 1 -- 172.21.15.149:0/2889845682 wait complete. 2023-11-08T19:26:37.551 INFO:teuthology.orchestra.run.smithi149.stderr:pool 'cephfs_data' removed 2023-11-08T19:26:37.564 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-08T19:26:37.687 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.686+0000 7f15d1664700 1 Processor -- start 2023-11-08T19:26:37.687 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.686+0000 7f15d1664700 1 -- start start 2023-11-08T19:26:37.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.686+0000 7f15d1664700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f15cc0ced10 0x7f15cc0d31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:37.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.686+0000 7f15d1664700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15cc0d2110 con 0x7f15cc0d1c10 2023-11-08T19:26:37.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.686+0000 7f15d1664700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15cc0d23f0 con 0x7f15cc15da50 2023-11-08T19:26:37.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.686+0000 7f15d1664700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15cc0d36f0 con 0x7f15cc0ced10 2023-11-08T19:26:37.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.687+0000 7f15cb7fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f15cc0ced10 0x7f15cc0d31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:37.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.687+0000 7f15ca7fc700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f15cc0d1c10 0x7f15cc0ce600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:45066/0 (socket says 172.21.15.149:45066) 2023-11-08T19:26:37.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.687+0000 7f15ca7fc700 1 -- 172.21.15.149:0/3592783211 learned_addr learned my addr 172.21.15.149:0/3592783211 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:26:37.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.687+0000 7f15cb7fe700 1 -- 172.21.15.149:0/3592783211 >> v1:172.21.15.160:6789/0 conn(0x7f15cc15da50 legacy=0x7f15cc0b9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:37.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.687+0000 7f15cb7fe700 1 -- 172.21.15.149:0/3592783211 >> v1:172.21.15.149:6789/0 conn(0x7f15cc0d1c10 legacy=0x7f15cc0ce600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:37.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.687+0000 7f15c9ffb700 1 -- 172.21.15.149:0/3592783211 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2679285439 0 0) 0x7f15cc0d2110 con 0x7f15cc0d1c10 2023-11-08T19:26:37.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.687+0000 7f15cb7fe700 1 -- 172.21.15.149:0/3592783211 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15cc0d26d0 con 0x7f15cc0ced10 2023-11-08T19:26:37.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.687+0000 7f15cb7fe700 1 --2- 172.21.15.149:0/3592783211 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15cc0ced10 0x7f15cc0d31b0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f15c4009d90 tx=0x7f15c400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6956bdc8d63229c0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:37.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.687+0000 7f15c9ffb700 1 -- 172.21.15.149:0/3592783211 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c400e070 con 0x7f15cc0ced10 2023-11-08T19:26:37.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.687+0000 7f15c9ffb700 1 -- 172.21.15.149:0/3592783211 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15c400bb90 con 0x7f15cc0ced10 2023-11-08T19:26:37.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.687+0000 7f15c9ffb700 1 -- 172.21.15.149:0/3592783211 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c4003a20 con 0x7f15cc0ced10 2023-11-08T19:26:37.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.688+0000 7f15d1664700 1 -- 172.21.15.149:0/3592783211 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15cc0ced10 msgr2=0x7f15cc0d31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:37.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.688+0000 7f15d1664700 1 --2- 172.21.15.149:0/3592783211 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15cc0ced10 0x7f15cc0d31b0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f15c4009d90 tx=0x7f15c400b330 comp rx=0 tx=0).stop 2023-11-08T19:26:37.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.688+0000 7f15d1664700 1 -- 172.21.15.149:0/3592783211 shutdown_connections 2023-11-08T19:26:37.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.688+0000 7f15d1664700 1 --2- 172.21.15.149:0/3592783211 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15cc0ced10 0x7f15cc0d31b0 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:37.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.688+0000 7f15d1664700 1 -- 172.21.15.149:0/3592783211 >> 172.21.15.149:0/3592783211 conn(0x7f15cc06bd60 msgr2=0x7f15cc06c140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:37.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.688+0000 7f15d1664700 1 -- 172.21.15.149:0/3592783211 shutdown_connections 2023-11-08T19:26:37.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.688+0000 7f15d1664700 1 -- 172.21.15.149:0/3592783211 wait complete. 2023-11-08T19:26:37.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.689+0000 7f15d1664700 1 Processor -- start 2023-11-08T19:26:37.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.689+0000 7f15d1664700 1 -- start start 2023-11-08T19:26:37.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.690+0000 7f15d1664700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f15cc0ced10 0x7f15cc15c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:37.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.690+0000 7f15d1664700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f15cc0d1c10 0x7f15cc1f65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:37.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.690+0000 7f15d1664700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15cc15da50 0x7f15cc15e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:37.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.690+0000 7f15d1664700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15cc15e5a0 con 0x7f15cc15da50 2023-11-08T19:26:37.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.690+0000 7f15d1664700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15cc160a60 con 0x7f15cc0d1c10 2023-11-08T19:26:37.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.690+0000 7f15d1664700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15cc160d40 con 0x7f15cc0ced10 2023-11-08T19:26:37.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.690+0000 7f15cb7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15cc15da50 0x7f15cc15e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:37.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.690+0000 7f15cb7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15cc15da50 0x7f15cc15e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43074/0 (socket says 172.21.15.149:43074) 2023-11-08T19:26:37.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.690+0000 7f15cb7fe700 1 -- 172.21.15.149:0/983000088 learned_addr learned my addr 172.21.15.149:0/983000088 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:37.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.690+0000 7f15ca7fc700 1 --2- 172.21.15.149:0/983000088 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f15cc0d1c10 0x7f15cc1f65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:37.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.690+0000 7f15cb7fe700 1 -- 172.21.15.149:0/983000088 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f15cc0ced10 msgr2=0x7f15cc15c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:37.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.690+0000 7f15caffd700 1 --2- 172.21.15.149:0/983000088 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f15cc0ced10 0x7f15cc15c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:37.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.690+0000 7f15cb7fe700 1 --2- 172.21.15.149:0/983000088 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f15cc0ced10 0x7f15cc15c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:37.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.690+0000 7f15cb7fe700 1 -- 172.21.15.149:0/983000088 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f15cc0d1c10 msgr2=0x7f15cc1f65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:37.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.690+0000 7f15cb7fe700 1 --2- 172.21.15.149:0/983000088 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f15cc0d1c10 0x7f15cc1f65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:37.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.690+0000 7f15cb7fe700 1 -- 172.21.15.149:0/983000088 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c4009a70 con 0x7f15cc15da50 2023-11-08T19:26:37.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.690+0000 7f15ca7fc700 1 --2- 172.21.15.149:0/983000088 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f15cc0d1c10 0x7f15cc1f65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:26:37.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.690+0000 7f15caffd700 1 --2- 172.21.15.149:0/983000088 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f15cc0ced10 0x7f15cc15c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:26:37.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.690+0000 7f15cb7fe700 1 --2- 172.21.15.149:0/983000088 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15cc15da50 0x7f15cc15e060 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f15cc06d2c0 tx=0x7f15c4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:37.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.691+0000 7f15b37fe700 1 -- 172.21.15.149:0/983000088 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c4012630 con 0x7f15cc15da50 2023-11-08T19:26:37.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.691+0000 7f15b37fe700 1 -- 172.21.15.149:0/983000088 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15c4012790 con 0x7f15cc15da50 2023-11-08T19:26:37.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.691+0000 7f15d1664700 1 -- 172.21.15.149:0/983000088 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15cc161020 con 0x7f15cc15da50 2023-11-08T19:26:37.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.691+0000 7f15b37fe700 1 -- 172.21.15.149:0/983000088 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c4012b40 con 0x7f15cc15da50 2023-11-08T19:26:37.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.691+0000 7f15d1664700 1 -- 172.21.15.149:0/983000088 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15cc15fb50 con 0x7f15cc15da50 2023-11-08T19:26:37.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.692+0000 7f15d1664700 1 -- 172.21.15.149:0/983000088 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15cc1559c0 con 0x7f15cc15da50 2023-11-08T19:26:37.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.692+0000 7f15b37fe700 1 -- 172.21.15.149:0/983000088 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f15c4012ca0 con 0x7f15cc15da50 2023-11-08T19:26:37.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.692+0000 7f15b37fe700 1 --2- 172.21.15.149:0/983000088 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f15b806af00 0x7f15b806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:37.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.693+0000 7f15b37fe700 1 -- 172.21.15.149:0/983000088 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6354+0+0 (secure 0 0 0) 0x7f15c408bab0 con 0x7f15cc15da50 2023-11-08T19:26:37.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.693+0000 7f15caffd700 1 --2- 172.21.15.149:0/983000088 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f15b806af00 0x7f15b806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:37.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.693+0000 7f15caffd700 1 --2- 172.21.15.149:0/983000088 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f15b806af00 0x7f15b806d3c0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f15c0001750 tx=0x7f15c0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:37.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.697+0000 7f15b37fe700 1 -- 172.21.15.149:0/983000088 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f15cc1559c0 con 0x7f15cc15da50 2023-11-08T19:26:37.889 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.888+0000 7f15d1664700 1 -- 172.21.15.149:0/983000088 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f15cc1559c0 con 0x7f15cc15da50 2023-11-08T19:26:37.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.891+0000 7f15b37fe700 1 -- 172.21.15.149:0/983000088 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v18) v1 ==== 104+0+0 (secure 0 0 0) 0x7f15cc1559c0 con 0x7f15cc15da50 2023-11-08T19:26:37.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.893+0000 7f15d1664700 1 -- 172.21.15.149:0/983000088 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f15b806af00 msgr2=0x7f15b806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:37.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.893+0000 7f15d1664700 1 --2- 172.21.15.149:0/983000088 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f15b806af00 0x7f15b806d3c0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f15c0001750 tx=0x7f15c0009040 comp rx=0 tx=0).stop 2023-11-08T19:26:37.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.893+0000 7f15d1664700 1 -- 172.21.15.149:0/983000088 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15cc15da50 msgr2=0x7f15cc15e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:37.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.893+0000 7f15d1664700 1 --2- 172.21.15.149:0/983000088 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15cc15da50 0x7f15cc15e060 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f15cc06d2c0 tx=0x7f15c4004ad0 comp rx=0 tx=0).stop 2023-11-08T19:26:37.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.893+0000 7f15d1664700 1 -- 172.21.15.149:0/983000088 shutdown_connections 2023-11-08T19:26:37.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.893+0000 7f15d1664700 1 --2- 172.21.15.149:0/983000088 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f15b806af00 0x7f15b806d3c0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:37.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.893+0000 7f15d1664700 1 --2- 172.21.15.149:0/983000088 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15cc15da50 0x7f15cc15e060 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:37.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.893+0000 7f15d1664700 1 --2- 172.21.15.149:0/983000088 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f15cc0ced10 0x7f15cc15c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:37.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.893+0000 7f15d1664700 1 --2- 172.21.15.149:0/983000088 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f15cc0d1c10 0x7f15cc1f65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:37.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.893+0000 7f15d1664700 1 -- 172.21.15.149:0/983000088 >> 172.21.15.149:0/983000088 conn(0x7f15cc06bd60 msgr2=0x7f15cc15b460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:37.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.894+0000 7f15d1664700 1 -- 172.21.15.149:0/983000088 shutdown_connections 2023-11-08T19:26:37.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:37.894+0000 7f15d1664700 1 -- 172.21.15.149:0/983000088 wait complete. 2023-11-08T19:26:37.907 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snapshots.TestSnapshots.test_allow_new_snaps_config' 2023-11-08T19:26:38.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.035+0000 7faf6fcd1700 1 Processor -- start 2023-11-08T19:26:38.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.035+0000 7faf6fcd1700 1 -- start start 2023-11-08T19:26:38.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.036+0000 7faf6fcd1700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7faf680b16b0 0x7faf680ce380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:38.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.036+0000 7faf6fcd1700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf680d1330 con 0x7faf680afb30 2023-11-08T19:26:38.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.036+0000 7faf6fcd1700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf680cb490 con 0x7faf680b20b0 2023-11-08T19:26:38.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.036+0000 7faf6fcd1700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf680cb770 con 0x7faf680b16b0 2023-11-08T19:26:38.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.036+0000 7faf6da6d700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7faf680afb30 0x7faf680cbf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:45080/0 (socket says 172.21.15.149:45080) 2023-11-08T19:26:38.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.036+0000 7faf6da6d700 1 -- 172.21.15.149:0/2153451216 learned_addr learned my addr 172.21.15.149:0/2153451216 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:26:38.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.036+0000 7faf6d26c700 1 --2- 172.21.15.149:0/2153451216 >> v2:172.21.15.160:3300/0 conn(0x7faf680b16b0 0x7faf680ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:38.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.036+0000 7faf6ca6b700 1 -- 172.21.15.149:0/2153451216 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4199286522 0 0) 0x7faf680d1330 con 0x7faf680afb30 2023-11-08T19:26:38.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.036+0000 7faf6ca6b700 1 -- 172.21.15.149:0/2153451216 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf540035b0 con 0x7faf680afb30 2023-11-08T19:26:38.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.037+0000 7faf6ca6b700 1 -- 172.21.15.149:0/2153451216 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3153096934 0 0) 0x7faf680cb490 con 0x7faf680b20b0 2023-11-08T19:26:38.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.037+0000 7faf6ca6b700 1 -- 172.21.15.149:0/2153451216 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf680d1330 con 0x7faf680b20b0 2023-11-08T19:26:38.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.037+0000 7faf6ca6b700 1 -- 172.21.15.149:0/2153451216 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3090889310 0 0) 0x7faf540035b0 con 0x7faf680afb30 2023-11-08T19:26:38.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.037+0000 7faf6ca6b700 1 -- 172.21.15.149:0/2153451216 >> v2:172.21.15.160:3300/0 conn(0x7faf680b16b0 msgr2=0x7faf680ce380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:38.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.037+0000 7faf6ca6b700 1 --2- 172.21.15.149:0/2153451216 >> v2:172.21.15.160:3300/0 conn(0x7faf680b16b0 0x7faf680ce380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:38.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.037+0000 7faf6ca6b700 1 -- 172.21.15.149:0/2153451216 >> v1:172.21.15.160:6789/0 conn(0x7faf680b20b0 legacy=0x7faf680aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:38.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.037+0000 7faf6ca6b700 1 -- 172.21.15.149:0/2153451216 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf680cba50 con 0x7faf680afb30 2023-11-08T19:26:38.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.037+0000 7faf6ca6b700 1 -- 172.21.15.149:0/2153451216 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7faf580017f0 con 0x7faf680afb30 2023-11-08T19:26:38.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.037+0000 7faf6ca6b700 1 -- 172.21.15.149:0/2153451216 >> v1:172.21.15.149:6789/0 conn(0x7faf680afb30 legacy=0x7faf680cbf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:38.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.037+0000 7faf6ca6b700 1 --2- 172.21.15.149:0/2153451216 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf54003b90 0x7faf54003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:38.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.037+0000 7faf6ca6b700 1 --2- 172.21.15.149:0/2153451216 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faf54004850 0x7faf54004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:38.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.037+0000 7faf6ca6b700 1 --2- 172.21.15.149:0/2153451216 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faf54005280 0x7faf5400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:38.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.037+0000 7faf6ca6b700 1 -- 172.21.15.149:0/2153451216 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf680cb770 con 0x7faf54003b90 2023-11-08T19:26:38.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.037+0000 7faf6ca6b700 1 -- 172.21.15.149:0/2153451216 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5400c1e0 con 0x7faf54005280 2023-11-08T19:26:38.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.037+0000 7faf6ca6b700 1 -- 172.21.15.149:0/2153451216 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf5400c3a0 con 0x7faf54004850 2023-11-08T19:26:38.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.037+0000 7faf6da6d700 1 --2- 172.21.15.149:0/2153451216 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf54003b90 0x7faf54003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:38.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.037+0000 7faf6e26e700 1 --2- 172.21.15.149:0/2153451216 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faf54005280 0x7faf5400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:38.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.037+0000 7faf6d26c700 1 --2- 172.21.15.149:0/2153451216 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faf54004850 0x7faf54004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:38.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.037+0000 7faf6da6d700 1 -- 172.21.15.149:0/2153451216 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faf54004850 msgr2=0x7faf54004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:38.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.037+0000 7faf6da6d700 1 --2- 172.21.15.149:0/2153451216 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faf54004850 0x7faf54004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:38.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.037+0000 7faf6da6d700 1 -- 172.21.15.149:0/2153451216 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faf54005280 msgr2=0x7faf5400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:38.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.037+0000 7faf6da6d700 1 --2- 172.21.15.149:0/2153451216 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faf54005280 0x7faf5400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:38.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.037+0000 7faf6e26e700 1 -- 172.21.15.149:0/2153451216 reap_dead start 2023-11-08T19:26:38.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.037+0000 7faf6da6d700 1 -- 172.21.15.149:0/2153451216 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf540035b0 con 0x7faf54003b90 2023-11-08T19:26:38.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.037+0000 7faf6d26c700 1 --2- 172.21.15.149:0/2153451216 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faf54004850 0x7faf54004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:26:38.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.037+0000 7faf6da6d700 1 --2- 172.21.15.149:0/2153451216 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf54003b90 0x7faf54003f90 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7faf5800c210 tx=0x7faf54005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8fff5701498a10a server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:38.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.037+0000 7faf6ca6b700 1 -- 172.21.15.149:0/2153451216 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5800cd50 con 0x7faf54003b90 2023-11-08T19:26:38.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.038+0000 7faf6ca6b700 1 -- 172.21.15.149:0/2153451216 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf58001c00 con 0x7faf54003b90 2023-11-08T19:26:38.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.038+0000 7faf6ca6b700 1 -- 172.21.15.149:0/2153451216 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf58007310 con 0x7faf54003b90 2023-11-08T19:26:38.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.038+0000 7faf6fcd1700 1 -- 172.21.15.149:0/2153451216 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf54003b90 msgr2=0x7faf54003f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:38.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.038+0000 7faf6fcd1700 1 --2- 172.21.15.149:0/2153451216 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf54003b90 0x7faf54003f90 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7faf5800c210 tx=0x7faf54005880 comp rx=0 tx=0).stop 2023-11-08T19:26:38.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.038+0000 7faf6fcd1700 1 -- 172.21.15.149:0/2153451216 shutdown_connections 2023-11-08T19:26:38.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.038+0000 7faf6fcd1700 1 --2- 172.21.15.149:0/2153451216 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf54003b90 0x7faf54003f90 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:38.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.038+0000 7faf6fcd1700 1 -- 172.21.15.149:0/2153451216 >> 172.21.15.149:0/2153451216 conn(0x7faf68099a40 msgr2=0x7faf680d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:38.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.038+0000 7faf6fcd1700 1 -- 172.21.15.149:0/2153451216 shutdown_connections 2023-11-08T19:26:38.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.038+0000 7faf6fcd1700 1 -- 172.21.15.149:0/2153451216 wait complete. 2023-11-08T19:26:38.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.039+0000 7faf6fcd1700 1 Processor -- start 2023-11-08T19:26:38.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.039+0000 7faf6fcd1700 1 -- start start 2023-11-08T19:26:38.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.040+0000 7faf6fcd1700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faf54003b90 0x7faf6806ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:38.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.040+0000 7faf6fcd1700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf68152010 0x7faf6806f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:38.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.040+0000 7faf6fcd1700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faf680c5e30 0x7faf680c62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:38.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.040+0000 7faf6fcd1700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf680c5950 con 0x7faf68152010 2023-11-08T19:26:38.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.040+0000 7faf6fcd1700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf680c6820 con 0x7faf680c5e30 2023-11-08T19:26:38.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.040+0000 7faf6fcd1700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf681f3e30 con 0x7faf54003b90 2023-11-08T19:26:38.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.040+0000 7faf6d26c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf68152010 0x7faf6806f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:38.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.040+0000 7faf6d26c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf68152010 0x7faf6806f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43092/0 (socket says 172.21.15.149:43092) 2023-11-08T19:26:38.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.040+0000 7faf6d26c700 1 -- 172.21.15.149:0/3500720748 learned_addr learned my addr 172.21.15.149:0/3500720748 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:38.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.040+0000 7faf6da6d700 1 --2- 172.21.15.149:0/3500720748 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faf54003b90 0x7faf6806ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:38.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.040+0000 7faf6e26e700 1 --2- 172.21.15.149:0/3500720748 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faf680c5e30 0x7faf680c62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:38.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.041+0000 7faf6d26c700 1 -- 172.21.15.149:0/3500720748 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faf54003b90 msgr2=0x7faf6806ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:38.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.041+0000 7faf6d26c700 1 --2- 172.21.15.149:0/3500720748 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faf54003b90 0x7faf6806ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:38.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.041+0000 7faf6d26c700 1 -- 172.21.15.149:0/3500720748 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faf680c5e30 msgr2=0x7faf680c62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:38.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.041+0000 7faf6d26c700 1 --2- 172.21.15.149:0/3500720748 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faf680c5e30 0x7faf680c62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:38.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.041+0000 7faf6d26c700 1 -- 172.21.15.149:0/3500720748 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf681f4110 con 0x7faf68152010 2023-11-08T19:26:38.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.041+0000 7faf6d26c700 1 --2- 172.21.15.149:0/3500720748 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf68152010 0x7faf6806f100 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7faf64011580 tx=0x7faf64011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:38.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.041+0000 7faf5e7fc700 1 -- 172.21.15.149:0/3500720748 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf64004220 con 0x7faf68152010 2023-11-08T19:26:38.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.041+0000 7faf5e7fc700 1 -- 172.21.15.149:0/3500720748 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf64004380 con 0x7faf68152010 2023-11-08T19:26:38.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.041+0000 7faf5e7fc700 1 -- 172.21.15.149:0/3500720748 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf640036a0 con 0x7faf68152010 2023-11-08T19:26:38.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.041+0000 7faf6fcd1700 1 -- 172.21.15.149:0/3500720748 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf681f43f0 con 0x7faf68152010 2023-11-08T19:26:38.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.041+0000 7faf6fcd1700 1 -- 172.21.15.149:0/3500720748 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf681f3b40 con 0x7faf68152010 2023-11-08T19:26:38.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.042+0000 7faf6fcd1700 1 -- 172.21.15.149:0/3500720748 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf680b3150 con 0x7faf68152010 2023-11-08T19:26:38.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.043+0000 7faf5e7fc700 1 -- 172.21.15.149:0/3500720748 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faf64003800 con 0x7faf68152010 2023-11-08T19:26:38.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.043+0000 7faf5e7fc700 1 --2- 172.21.15.149:0/3500720748 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7faf4c06af00 0x7faf4c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:38.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.043+0000 7faf5e7fc700 1 -- 172.21.15.149:0/3500720748 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6354+0+0 (secure 0 0 0) 0x7faf64089cd0 con 0x7faf68152010 2023-11-08T19:26:38.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.043+0000 7faf6da6d700 1 --2- 172.21.15.149:0/3500720748 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7faf4c06af00 0x7faf4c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:38.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.044+0000 7faf6da6d700 1 --2- 172.21.15.149:0/3500720748 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7faf4c06af00 0x7faf4c06d3c0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7faf58000c00 tx=0x7faf58007f90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:38.061 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.047+0000 7faf5e7fc700 1 -- 172.21.15.149:0/3500720748 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7faf64054b60 con 0x7faf68152010 2023-11-08T19:26:38.201 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T19:26:38.205 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T19:26:38.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.323+0000 7faf6fcd1700 1 -- 172.21.15.149:0/3500720748 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snapshots.TestSnapshots.test_allow_new_snaps_config"]} v 0) v1 -- 0x7faf680b3150 con 0x7faf68152010 2023-11-08T19:26:38.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.545+0000 7faf5e7fc700 1 -- 172.21.15.149:0/3500720748 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snapshots.TestSnapshots.test_allow_new_snaps_config"]}]=0 v224) v1 ==== 148+0+0 (secure 0 0 0) 0x7faf680b3150 con 0x7faf68152010 2023-11-08T19:26:38.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.548+0000 7faf6fcd1700 1 -- 172.21.15.149:0/3500720748 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7faf4c06af00 msgr2=0x7faf4c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:38.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.548+0000 7faf6fcd1700 1 --2- 172.21.15.149:0/3500720748 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7faf4c06af00 0x7faf4c06d3c0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7faf58000c00 tx=0x7faf58007f90 comp rx=0 tx=0).stop 2023-11-08T19:26:38.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.548+0000 7faf6fcd1700 1 -- 172.21.15.149:0/3500720748 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf68152010 msgr2=0x7faf6806f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:38.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.548+0000 7faf6fcd1700 1 --2- 172.21.15.149:0/3500720748 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf68152010 0x7faf6806f100 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7faf64011580 tx=0x7faf64011890 comp rx=0 tx=0).stop 2023-11-08T19:26:38.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.548+0000 7faf6fcd1700 1 -- 172.21.15.149:0/3500720748 shutdown_connections 2023-11-08T19:26:38.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.548+0000 7faf6fcd1700 1 --2- 172.21.15.149:0/3500720748 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7faf4c06af00 0x7faf4c06d3c0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:38.551 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.548+0000 7faf6fcd1700 1 --2- 172.21.15.149:0/3500720748 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faf680c5e30 0x7faf680c62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:38.551 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.548+0000 7faf6fcd1700 1 --2- 172.21.15.149:0/3500720748 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faf54003b90 0x7faf6806ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:38.551 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.548+0000 7faf6fcd1700 1 --2- 172.21.15.149:0/3500720748 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf68152010 0x7faf6806f100 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:38.551 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.548+0000 7faf6fcd1700 1 -- 172.21.15.149:0/3500720748 >> 172.21.15.149:0/3500720748 conn(0x7faf68099a40 msgr2=0x7faf6815bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:38.551 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.548+0000 7faf6fcd1700 1 -- 172.21.15.149:0/3500720748 shutdown_connections 2023-11-08T19:26:38.552 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.548+0000 7faf6fcd1700 1 -- 172.21.15.149:0/3500720748 wait complete. 2023-11-08T19:26:38.562 INFO:tasks.cephfs_test_runner:Check whether 'allow_new_snaps' setting works ... ok 2023-11-08T19:26:38.563 INFO:tasks.cephfs_test_runner:Starting test: test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots) check snaptable transcation 2023-11-08T19:26:38.563 INFO:tasks.cephfs_test_runner:test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots) 2023-11-08T19:26:38.564 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:26:38.685 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.684+0000 7fd0f8a66700 1 Processor -- start 2023-11-08T19:26:38.685 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.684+0000 7fd0f8a66700 1 -- start start 2023-11-08T19:26:38.688 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.685+0000 7fd0f8a66700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd0f40cc140 0x7fd0f40cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:38.688 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.685+0000 7fd0f8a66700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fd0f40b2cd0 0x7fd0f415d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:38.688 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.685+0000 7fd0f8a66700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0f40cce50 con 0x7fd0f40b2850 2023-11-08T19:26:38.688 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.685+0000 7fd0f8a66700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0f40b2430 con 0x7fd0f40b2cd0 2023-11-08T19:26:38.688 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.685+0000 7fd0f8a66700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f40cc520 con 0x7fd0f40cc140 2023-11-08T19:26:38.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.685+0000 7fd0f259c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd0f40cc140 0x7fd0f40cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:38.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.685+0000 7fd0f2d9d700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fd0f40b2cd0 0x7fd0f415d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:38.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.685+0000 7fd0f1d9b700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7fd0f40b2850 0x7fd0f40cabf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.149:56766/0 (socket says 172.21.15.149:56766) 2023-11-08T19:26:38.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.685+0000 7fd0f1d9b700 1 -- 172.21.15.149:0/2969331521 learned_addr learned my addr 172.21.15.149:0/2969331521 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:26:38.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.685+0000 7fd0f159a700 1 -- 172.21.15.149:0/2969331521 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 196322548 0 0) 0x7fd0f40cce50 con 0x7fd0f40b2850 2023-11-08T19:26:38.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.685+0000 7fd0f159a700 1 -- 172.21.15.149:0/2969331521 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0dc0035b0 con 0x7fd0f40b2850 2023-11-08T19:26:38.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.685+0000 7fd0f2d9d700 1 -- 172.21.15.149:0/2969331521 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd0f40cc140 msgr2=0x7fd0f40cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:38.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.685+0000 7fd0f2d9d700 1 --2- 172.21.15.149:0/2969331521 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd0f40cc140 0x7fd0f40cc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:38.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.685+0000 7fd0f2d9d700 1 -- 172.21.15.149:0/2969331521 >> v1:172.21.15.160:6789/0 conn(0x7fd0f40b2850 legacy=0x7fd0f40cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:38.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.685+0000 7fd0f2d9d700 1 -- 172.21.15.149:0/2969331521 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0f40b17b0 con 0x7fd0f40b2cd0 2023-11-08T19:26:38.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.685+0000 7fd0f259c700 1 --2- 172.21.15.149:0/2969331521 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd0f40cc140 0x7fd0f40cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:26:38.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.686+0000 7fd0f2d9d700 1 --2- 172.21.15.149:0/2969331521 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd0f40b2cd0 0x7fd0f415d2b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec009d90 tx=0x7fd0ec00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea65ad54c91a1a7e server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:38.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.686+0000 7fd0f159a700 1 -- 172.21.15.149:0/2969331521 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ec00e070 con 0x7fd0f40b2cd0 2023-11-08T19:26:38.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.686+0000 7fd0f159a700 1 -- 172.21.15.149:0/2969331521 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0ec00bb20 con 0x7fd0f40b2cd0 2023-11-08T19:26:38.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.686+0000 7fd0f159a700 1 -- 172.21.15.149:0/2969331521 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ec012430 con 0x7fd0f40b2cd0 2023-11-08T19:26:38.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.686+0000 7fd0f8a66700 1 -- 172.21.15.149:0/2969331521 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd0f40b2cd0 msgr2=0x7fd0f415d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:38.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.686+0000 7fd0f8a66700 1 --2- 172.21.15.149:0/2969331521 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd0f40b2cd0 0x7fd0f415d2b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec009d90 tx=0x7fd0ec00b330 comp rx=0 tx=0).stop 2023-11-08T19:26:38.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.686+0000 7fd0f8a66700 1 -- 172.21.15.149:0/2969331521 shutdown_connections 2023-11-08T19:26:38.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.686+0000 7fd0f8a66700 1 --2- 172.21.15.149:0/2969331521 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd0f40b2cd0 0x7fd0f415d2b0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:38.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.686+0000 7fd0f8a66700 1 --2- 172.21.15.149:0/2969331521 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd0f40cc140 0x7fd0f40cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:38.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.686+0000 7fd0f8a66700 1 -- 172.21.15.149:0/2969331521 >> 172.21.15.149:0/2969331521 conn(0x7fd0f4099a40 msgr2=0x7fd0f40d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:38.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.686+0000 7fd0f8a66700 1 -- 172.21.15.149:0/2969331521 shutdown_connections 2023-11-08T19:26:38.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.686+0000 7fd0f8a66700 1 -- 172.21.15.149:0/2969331521 wait complete. 2023-11-08T19:26:38.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.688+0000 7fd0f8a66700 1 Processor -- start 2023-11-08T19:26:38.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.688+0000 7fd0f8a66700 1 -- start start 2023-11-08T19:26:38.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.689+0000 7fd0f8a66700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0f40b2850 0x7fd0f415f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:38.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.689+0000 7fd0f8a66700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd0f40b2cd0 0x7fd0f40b4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:38.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.689+0000 7fd0f8a66700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd0f40cc140 0x7fd0f40b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:38.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.689+0000 7fd0f8a66700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f40adad0 con 0x7fd0f40b2850 2023-11-08T19:26:38.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.689+0000 7fd0f8a66700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f40ad1c0 con 0x7fd0f40cc140 2023-11-08T19:26:38.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.689+0000 7fd0f8a66700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f409dfb0 con 0x7fd0f40b2cd0 2023-11-08T19:26:38.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.689+0000 7fd0f259c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0f40b2850 0x7fd0f415f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:38.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.689+0000 7fd0f259c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0f40b2850 0x7fd0f415f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43104/0 (socket says 172.21.15.149:43104) 2023-11-08T19:26:38.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.689+0000 7fd0f259c700 1 -- 172.21.15.149:0/681642517 learned_addr learned my addr 172.21.15.149:0/681642517 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:38.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.689+0000 7fd0f1d9b700 1 --2- 172.21.15.149:0/681642517 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd0f40b2cd0 0x7fd0f40b4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:38.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.689+0000 7fd0f2d9d700 1 --2- 172.21.15.149:0/681642517 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd0f40cc140 0x7fd0f40b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:38.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.689+0000 7fd0f259c700 1 -- 172.21.15.149:0/681642517 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd0f40b2cd0 msgr2=0x7fd0f40b4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:38.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.689+0000 7fd0f259c700 1 --2- 172.21.15.149:0/681642517 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd0f40b2cd0 0x7fd0f40b4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:38.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.689+0000 7fd0f259c700 1 -- 172.21.15.149:0/681642517 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd0f40cc140 msgr2=0x7fd0f40b4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:38.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.689+0000 7fd0f259c700 1 --2- 172.21.15.149:0/681642517 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd0f40cc140 0x7fd0f40b4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:38.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.689+0000 7fd0f259c700 1 -- 172.21.15.149:0/681642517 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0e4009430 con 0x7fd0f40b2850 2023-11-08T19:26:38.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.689+0000 7fd0f259c700 1 --2- 172.21.15.149:0/681642517 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0f40b2850 0x7fd0f415f090 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fd0e400ebe0 tx=0x7fd0e4009e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:38.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.689+0000 7fd0e2ffd700 1 -- 172.21.15.149:0/681642517 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e4005a20 con 0x7fd0f40b2850 2023-11-08T19:26:38.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.689+0000 7fd0e2ffd700 1 -- 172.21.15.149:0/681642517 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0e4005b80 con 0x7fd0f40b2850 2023-11-08T19:26:38.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.689+0000 7fd0e2ffd700 1 -- 172.21.15.149:0/681642517 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e400c8b0 con 0x7fd0f40b2850 2023-11-08T19:26:38.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.689+0000 7fd0f8a66700 1 -- 172.21.15.149:0/681642517 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0ec009a70 con 0x7fd0f40b2850 2023-11-08T19:26:38.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.689+0000 7fd0f8a66700 1 -- 172.21.15.149:0/681642517 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0f40ad6f0 con 0x7fd0f40b2850 2023-11-08T19:26:38.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.690+0000 7fd0f8a66700 1 -- 172.21.15.149:0/681642517 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0f40ad880 con 0x7fd0f40b2850 2023-11-08T19:26:38.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.691+0000 7fd0e2ffd700 1 -- 172.21.15.149:0/681642517 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd0e400ca10 con 0x7fd0f40b2850 2023-11-08T19:26:38.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.691+0000 7fd0e2ffd700 1 --2- 172.21.15.149:0/681642517 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd0d406af00 0x7fd0d406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:38.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.691+0000 7fd0e2ffd700 1 -- 172.21.15.149:0/681642517 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6354+0+0 (secure 0 0 0) 0x7fd0e4089b00 con 0x7fd0f40b2850 2023-11-08T19:26:38.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.691+0000 7fd0f1d9b700 1 --2- 172.21.15.149:0/681642517 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd0d406af00 0x7fd0d406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:38.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.692+0000 7fd0f1d9b700 1 --2- 172.21.15.149:0/681642517 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd0d406af00 0x7fd0d406d3c0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fd0f40b0430 tx=0x7fd0e8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:38.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.696+0000 7fd0e2ffd700 1 -- 172.21.15.149:0/681642517 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd0e4054920 con 0x7fd0f40b2850 2023-11-08T19:26:38.887 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.886+0000 7fd0f8a66700 1 -- 172.21.15.149:0/681642517 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd0f40add40 con 0x7fd0f40b2850 2023-11-08T19:26:38.888 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.887+0000 7fd0e2ffd700 1 -- 172.21.15.149:0/681642517 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+18514 (secure 0 0 0) 0x7fd0e4020020 con 0x7fd0f40b2850 2023-11-08T19:26:38.889 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:26:38.889 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":87,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:26:37.541801+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-08T19:24:29.516185+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-08T19:25:44.287064+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":71,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-08T19:25:45.623521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.149:6837/1594746264":"2023-11-09T19:26:34.528524+0000","172.21.15.149:6835/1594746264":"2023-11-09T19:26:34.528524+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:26:38.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.890+0000 7fd0f8a66700 1 -- 172.21.15.149:0/681642517 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd0d406af00 msgr2=0x7fd0d406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:38.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.890+0000 7fd0f8a66700 1 --2- 172.21.15.149:0/681642517 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd0d406af00 0x7fd0d406d3c0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fd0f40b0430 tx=0x7fd0e8009040 comp rx=0 tx=0).stop 2023-11-08T19:26:38.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.890+0000 7fd0f8a66700 1 -- 172.21.15.149:0/681642517 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0f40b2850 msgr2=0x7fd0f415f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:38.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.890+0000 7fd0f8a66700 1 --2- 172.21.15.149:0/681642517 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0f40b2850 0x7fd0f415f090 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fd0e400ebe0 tx=0x7fd0e4009e00 comp rx=0 tx=0).stop 2023-11-08T19:26:38.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.890+0000 7fd0f8a66700 1 -- 172.21.15.149:0/681642517 shutdown_connections 2023-11-08T19:26:38.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.890+0000 7fd0f8a66700 1 --2- 172.21.15.149:0/681642517 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd0d406af00 0x7fd0d406d3c0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:38.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.890+0000 7fd0f8a66700 1 --2- 172.21.15.149:0/681642517 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd0f40cc140 0x7fd0f40b4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:38.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.890+0000 7fd0f8a66700 1 --2- 172.21.15.149:0/681642517 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0f40b2850 0x7fd0f415f090 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:38.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.890+0000 7fd0f8a66700 1 --2- 172.21.15.149:0/681642517 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd0f40b2cd0 0x7fd0f40b4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:38.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.890+0000 7fd0f8a66700 1 -- 172.21.15.149:0/681642517 >> 172.21.15.149:0/681642517 conn(0x7fd0f4099a40 msgr2=0x7fd0f40c7670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:38.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.890+0000 7fd0f8a66700 1 -- 172.21.15.149:0/681642517 shutdown_connections 2023-11-08T19:26:38.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:38.890+0000 7fd0f8a66700 1 -- 172.21.15.149:0/681642517 wait complete. 2023-11-08T19:26:38.904 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-08T19:22:56.023194+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-08T19:24:29.516185+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 42, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_data_pool', 'create_time': '2023-11-08T19:25:44.287064+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 71, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-08T19:25:45.623521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-08T19:26:38.905 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-08T19:26:39.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.028+0000 7f01df452700 1 Processor -- start 2023-11-08T19:26:39.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.028+0000 7f01df452700 1 -- start start 2023-11-08T19:26:39.032 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.029+0000 7f01df452700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f01d815f470 0x7f01d815c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:39.032 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.029+0000 7f01df452700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f01d815cb60 0x7f01d80cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:39.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.029+0000 7f01df452700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01d815be80 con 0x7f01d80cc0d0 2023-11-08T19:26:39.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.029+0000 7f01df452700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01d80ccbc0 con 0x7f01d815cb60 2023-11-08T19:26:39.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.029+0000 7f01df452700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01d815f8d0 con 0x7f01d815f470 2023-11-08T19:26:39.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.029+0000 7f01dd9ef700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f01d815cb60 0x7f01d80cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:39.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.029+0000 7f01dd9ef700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f01d815cb60 0x7f01d80cf320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43116/0 (socket says 172.21.15.149:43116) 2023-11-08T19:26:39.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.029+0000 7f01dd9ef700 1 -- 172.21.15.149:0/2132976517 learned_addr learned my addr 172.21.15.149:0/2132976517 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:39.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.030+0000 7f01dc9ed700 1 --2- 172.21.15.149:0/2132976517 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f01d815f470 0x7f01d815c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:39.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.030+0000 7f01dd9ef700 1 -- 172.21.15.149:0/2132976517 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f01d815f470 msgr2=0x7f01d815c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:39.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.030+0000 7f01dd9ef700 1 --2- 172.21.15.149:0/2132976517 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f01d815f470 0x7f01d815c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:39.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.030+0000 7f01dd9ef700 1 -- 172.21.15.149:0/2132976517 >> v1:172.21.15.160:6789/0 conn(0x7f01d80cc0d0 legacy=0x7f01d80cc4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:39.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.030+0000 7f01dd9ef700 1 -- 172.21.15.149:0/2132976517 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01d815fba0 con 0x7f01d815cb60 2023-11-08T19:26:39.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.030+0000 7f01dd9ef700 1 --2- 172.21.15.149:0/2132976517 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01d815cb60 0x7f01d80cf320 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f01d0009e50 tx=0x7f01d000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8e12bc20a7da67f server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:39.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.030+0000 7f01cffff700 1 -- 172.21.15.149:0/2132976517 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d000e070 con 0x7f01d815cb60 2023-11-08T19:26:39.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.030+0000 7f01cffff700 1 -- 172.21.15.149:0/2132976517 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01d000b910 con 0x7f01d815cb60 2023-11-08T19:26:39.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.030+0000 7f01cffff700 1 -- 172.21.15.149:0/2132976517 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d000bcc0 con 0x7f01d815cb60 2023-11-08T19:26:39.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.031+0000 7f01df452700 1 -- 172.21.15.149:0/2132976517 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01d815cb60 msgr2=0x7f01d80cf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:39.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.031+0000 7f01df452700 1 --2- 172.21.15.149:0/2132976517 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01d815cb60 0x7f01d80cf320 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f01d0009e50 tx=0x7f01d000b330 comp rx=0 tx=0).stop 2023-11-08T19:26:39.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.031+0000 7f01df452700 1 -- 172.21.15.149:0/2132976517 shutdown_connections 2023-11-08T19:26:39.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.031+0000 7f01df452700 1 --2- 172.21.15.149:0/2132976517 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01d815cb60 0x7f01d80cf320 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:39.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.031+0000 7f01df452700 1 --2- 172.21.15.149:0/2132976517 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f01d815f470 0x7f01d815c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:39.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.031+0000 7f01df452700 1 -- 172.21.15.149:0/2132976517 >> 172.21.15.149:0/2132976517 conn(0x7f01d806f120 msgr2=0x7f01d806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:39.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.031+0000 7f01df452700 1 -- 172.21.15.149:0/2132976517 shutdown_connections 2023-11-08T19:26:39.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.031+0000 7f01df452700 1 -- 172.21.15.149:0/2132976517 wait complete. 2023-11-08T19:26:39.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.032+0000 7f01df452700 1 Processor -- start 2023-11-08T19:26:39.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.032+0000 7f01df452700 1 -- start start 2023-11-08T19:26:39.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.033+0000 7f01df452700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01d80cc0d0 0x7f01d80c8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:39.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.033+0000 7f01df452700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f01d815cb60 0x7f01d81474d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:39.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.033+0000 7f01df452700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f01d815f470 0x7f01d80cb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:39.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.033+0000 7f01df452700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d80ca740 con 0x7f01d80cc0d0 2023-11-08T19:26:39.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.033+0000 7f01df452700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d80caa20 con 0x7f01d815cb60 2023-11-08T19:26:39.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.033+0000 7f01df452700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01d80cad00 con 0x7f01d815f470 2023-11-08T19:26:39.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.033+0000 7f01dd1ee700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01d80cc0d0 0x7f01d80c8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:39.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.033+0000 7f01dd1ee700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01d80cc0d0 0x7f01d80c8820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43118/0 (socket says 172.21.15.149:43118) 2023-11-08T19:26:39.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.033+0000 7f01dd1ee700 1 -- 172.21.15.149:0/2207924437 learned_addr learned my addr 172.21.15.149:0/2207924437 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:39.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.033+0000 7f01dc9ed700 1 --2- 172.21.15.149:0/2207924437 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f01d815cb60 0x7f01d81474d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:39.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.033+0000 7f01dd1ee700 1 -- 172.21.15.149:0/2207924437 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f01d815f470 msgr2=0x7f01d80cb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:39.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.033+0000 7f01dd9ef700 1 --2- 172.21.15.149:0/2207924437 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f01d815f470 0x7f01d80cb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:39.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.033+0000 7f01dd1ee700 1 --2- 172.21.15.149:0/2207924437 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f01d815f470 0x7f01d80cb7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:39.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.033+0000 7f01dd1ee700 1 -- 172.21.15.149:0/2207924437 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f01d815cb60 msgr2=0x7f01d81474d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:39.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.033+0000 7f01dd1ee700 1 --2- 172.21.15.149:0/2207924437 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f01d815cb60 0x7f01d81474d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:39.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.033+0000 7f01dd1ee700 1 -- 172.21.15.149:0/2207924437 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01d0009b30 con 0x7f01d80cc0d0 2023-11-08T19:26:39.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.033+0000 7f01dc9ed700 1 --2- 172.21.15.149:0/2207924437 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f01d815cb60 0x7f01d81474d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:26:39.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.033+0000 7f01dd9ef700 1 --2- 172.21.15.149:0/2207924437 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f01d815f470 0x7f01d80cb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:26:39.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.033+0000 7f01dd1ee700 1 --2- 172.21.15.149:0/2207924437 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01d80cc0d0 0x7f01d80c8820 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f01c800c4e0 tx=0x7f01c800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:39.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.033+0000 7f01cdffb700 1 -- 172.21.15.149:0/2207924437 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c80052d0 con 0x7f01d80cc0d0 2023-11-08T19:26:39.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.033+0000 7f01cdffb700 1 -- 172.21.15.149:0/2207924437 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c8005430 con 0x7f01d80cc0d0 2023-11-08T19:26:39.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.033+0000 7f01df452700 1 -- 172.21.15.149:0/2207924437 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01d80cafe0 con 0x7f01d80cc0d0 2023-11-08T19:26:39.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.033+0000 7f01cdffb700 1 -- 172.21.15.149:0/2207924437 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c80038c0 con 0x7f01d80cc0d0 2023-11-08T19:26:39.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.034+0000 7f01df452700 1 -- 172.21.15.149:0/2207924437 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01d814a970 con 0x7f01d80cc0d0 2023-11-08T19:26:39.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.035+0000 7f01df452700 1 -- 172.21.15.149:0/2207924437 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01d804f730 con 0x7f01d80cc0d0 2023-11-08T19:26:39.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.035+0000 7f01cdffb700 1 -- 172.21.15.149:0/2207924437 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f01c8003a20 con 0x7f01d80cc0d0 2023-11-08T19:26:39.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.035+0000 7f01cdffb700 1 --2- 172.21.15.149:0/2207924437 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f01bc06af00 0x7f01bc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:39.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.035+0000 7f01cdffb700 1 -- 172.21.15.149:0/2207924437 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6354+0+0 (secure 0 0 0) 0x7f01c8088d40 con 0x7f01d80cc0d0 2023-11-08T19:26:39.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.035+0000 7f01dc9ed700 1 --2- 172.21.15.149:0/2207924437 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f01bc06af00 0x7f01bc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:39.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.036+0000 7f01dc9ed700 1 --2- 172.21.15.149:0/2207924437 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f01bc06af00 0x7f01bc06d3c0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f01d814ad90 tx=0x7f01d4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:39.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.040+0000 7f01cdffb700 1 -- 172.21.15.149:0/2207924437 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f01c8053b60 con 0x7f01d80cc0d0 2023-11-08T19:26:39.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.232+0000 7f01df452700 1 -- 172.21.15.149:0/2207924437 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f01d806ff20 con 0x7f01d80cc0d0 2023-11-08T19:26:39.234 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.232+0000 7f01cdffb700 1 -- 172.21.15.149:0/2207924437 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) v1 ==== 93+0+10 (secure 0 0 0) 0x7f01c80170a0 con 0x7f01d80cc0d0 2023-11-08T19:26:39.234 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 1 2023-11-08T19:26:39.236 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.234+0000 7f01df452700 1 -- 172.21.15.149:0/2207924437 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f01bc06af00 msgr2=0x7f01bc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:39.236 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.234+0000 7f01df452700 1 --2- 172.21.15.149:0/2207924437 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f01bc06af00 0x7f01bc06d3c0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f01d814ad90 tx=0x7f01d4008040 comp rx=0 tx=0).stop 2023-11-08T19:26:39.236 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.234+0000 7f01df452700 1 -- 172.21.15.149:0/2207924437 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01d80cc0d0 msgr2=0x7f01d80c8820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:39.236 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.234+0000 7f01df452700 1 --2- 172.21.15.149:0/2207924437 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01d80cc0d0 0x7f01d80c8820 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f01c800c4e0 tx=0x7f01c800c8a0 comp rx=0 tx=0).stop 2023-11-08T19:26:39.237 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.234+0000 7f01df452700 1 -- 172.21.15.149:0/2207924437 shutdown_connections 2023-11-08T19:26:39.237 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.234+0000 7f01df452700 1 --2- 172.21.15.149:0/2207924437 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f01bc06af00 0x7f01bc06d3c0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:39.237 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.234+0000 7f01df452700 1 --2- 172.21.15.149:0/2207924437 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f01d815f470 0x7f01d80cb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:39.237 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.234+0000 7f01df452700 1 --2- 172.21.15.149:0/2207924437 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01d80cc0d0 0x7f01d80c8820 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:39.237 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.234+0000 7f01df452700 1 --2- 172.21.15.149:0/2207924437 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f01d815cb60 0x7f01d81474d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:39.238 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.234+0000 7f01df452700 1 -- 172.21.15.149:0/2207924437 >> 172.21.15.149:0/2207924437 conn(0x7f01d806f120 msgr2=0x7f01d80b6380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:39.238 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.235+0000 7f01df452700 1 -- 172.21.15.149:0/2207924437 shutdown_connections 2023-11-08T19:26:39.238 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.235+0000 7f01df452700 1 -- 172.21.15.149:0/2207924437 wait complete. 2023-11-08T19:26:39.248 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-08T19:26:39.373 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.372+0000 7f3cd28de700 1 Processor -- start 2023-11-08T19:26:39.373 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.372+0000 7f3cd28de700 1 -- start start 2023-11-08T19:26:39.376 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.372+0000 7f3cd28de700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3ccc15f470 0x7f3ccc15c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:39.376 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.372+0000 7f3cd28de700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ccc15cb60 0x7f3ccc0cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:39.376 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.372+0000 7f3cd28de700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ccc15be80 con 0x7f3ccc0cc0d0 2023-11-08T19:26:39.376 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.372+0000 7f3cd28de700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ccc0ccbc0 con 0x7f3ccc15f470 2023-11-08T19:26:39.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.372+0000 7f3cd28de700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ccc15f8d0 con 0x7f3ccc15cb60 2023-11-08T19:26:39.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.372+0000 7f3ccb7fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3ccc15f470 0x7f3ccc15c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:39.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.373+0000 7f3ccbfff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f3ccc0cc0d0 0x7f3ccc0cc4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:45128/0 (socket says 172.21.15.149:45128) 2023-11-08T19:26:39.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.373+0000 7f3ccbfff700 1 -- 172.21.15.149:0/3738502282 learned_addr learned my addr 172.21.15.149:0/3738502282 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:26:39.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.373+0000 7f3cd0e7b700 1 --2- 172.21.15.149:0/3738502282 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ccc15cb60 0x7f3ccc0cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:39.378 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.373+0000 7f3ccb7fe700 1 -- 172.21.15.149:0/3738502282 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ccc15cb60 msgr2=0x7f3ccc0cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:39.378 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.373+0000 7f3ccb7fe700 1 --2- 172.21.15.149:0/3738502282 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ccc15cb60 0x7f3ccc0cf320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:39.378 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.373+0000 7f3ccb7fe700 1 -- 172.21.15.149:0/3738502282 >> v1:172.21.15.149:6789/0 conn(0x7f3ccc0cc0d0 legacy=0x7f3ccc0cc4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:39.378 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.373+0000 7f3ccaffd700 1 -- 172.21.15.149:0/3738502282 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3167858593 0 0) 0x7f3ccc15be80 con 0x7f3ccc0cc0d0 2023-11-08T19:26:39.378 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.373+0000 7f3ccb7fe700 1 -- 172.21.15.149:0/3738502282 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ccc15fba0 con 0x7f3ccc15f470 2023-11-08T19:26:39.379 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.373+0000 7f3ccb7fe700 1 --2- 172.21.15.149:0/3738502282 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ccc15f470 0x7f3ccc15c620 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc009840 tx=0x7f3cbc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f99d9653cb7d7d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:39.379 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.373+0000 7f3ccaffd700 1 -- 172.21.15.149:0/3738502282 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cbc011830 con 0x7f3ccc15f470 2023-11-08T19:26:39.379 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.373+0000 7f3ccaffd700 1 -- 172.21.15.149:0/3738502282 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cbc011990 con 0x7f3ccc15f470 2023-11-08T19:26:39.379 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.373+0000 7f3ccaffd700 1 -- 172.21.15.149:0/3738502282 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cbc011d20 con 0x7f3ccc15f470 2023-11-08T19:26:39.379 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.374+0000 7f3cd28de700 1 -- 172.21.15.149:0/3738502282 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ccc15f470 msgr2=0x7f3ccc15c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:39.380 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.374+0000 7f3cd28de700 1 --2- 172.21.15.149:0/3738502282 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ccc15f470 0x7f3ccc15c620 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc009840 tx=0x7f3cbc009b50 comp rx=0 tx=0).stop 2023-11-08T19:26:39.380 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.374+0000 7f3cd28de700 1 -- 172.21.15.149:0/3738502282 shutdown_connections 2023-11-08T19:26:39.380 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.374+0000 7f3cd28de700 1 --2- 172.21.15.149:0/3738502282 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ccc15cb60 0x7f3ccc0cf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:39.380 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.374+0000 7f3cd28de700 1 --2- 172.21.15.149:0/3738502282 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ccc15f470 0x7f3ccc15c620 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:39.380 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.374+0000 7f3cd28de700 1 -- 172.21.15.149:0/3738502282 >> 172.21.15.149:0/3738502282 conn(0x7f3ccc06f120 msgr2=0x7f3ccc06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:39.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.374+0000 7f3cd28de700 1 -- 172.21.15.149:0/3738502282 shutdown_connections 2023-11-08T19:26:39.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.374+0000 7f3cd28de700 1 -- 172.21.15.149:0/3738502282 wait complete. 2023-11-08T19:26:39.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.375+0000 7f3cd28de700 1 Processor -- start 2023-11-08T19:26:39.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.375+0000 7f3cd28de700 1 -- start start 2023-11-08T19:26:39.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.376+0000 7f3cd28de700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ccc0cc0d0 0x7f3ccc15b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:39.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.376+0000 7f3cd28de700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ccc15cb60 0x7f3ccc151d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:39.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.376+0000 7f3cd28de700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ccc15f470 0x7f3ccc0b1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:39.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.376+0000 7f3cd28de700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ccc15bee0 con 0x7f3ccc15cb60 2023-11-08T19:26:39.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.376+0000 7f3cd28de700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ccc15a900 con 0x7f3ccc0cc0d0 2023-11-08T19:26:39.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.376+0000 7f3cd28de700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ccc15abe0 con 0x7f3ccc15f470 2023-11-08T19:26:39.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.376+0000 7f3ccb7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ccc15cb60 0x7f3ccc151d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:39.387 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.376+0000 7f3ccb7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ccc15cb60 0x7f3ccc151d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43134/0 (socket says 172.21.15.149:43134) 2023-11-08T19:26:39.387 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.376+0000 7f3ccb7fe700 1 -- 172.21.15.149:0/12494977 learned_addr learned my addr 172.21.15.149:0/12494977 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:39.387 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.376+0000 7f3ccbfff700 1 --2- 172.21.15.149:0/12494977 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ccc0cc0d0 0x7f3ccc15b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:39.387 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.376+0000 7f3cd0e7b700 1 --2- 172.21.15.149:0/12494977 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ccc15f470 0x7f3ccc0b1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:39.388 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.376+0000 7f3ccb7fe700 1 -- 172.21.15.149:0/12494977 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ccc15f470 msgr2=0x7f3ccc0b1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:39.388 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.376+0000 7f3ccb7fe700 1 --2- 172.21.15.149:0/12494977 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ccc15f470 0x7f3ccc0b1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:39.388 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.376+0000 7f3ccb7fe700 1 -- 172.21.15.149:0/12494977 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ccc0cc0d0 msgr2=0x7f3ccc15b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:39.388 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.376+0000 7f3ccb7fe700 1 --2- 172.21.15.149:0/12494977 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ccc0cc0d0 0x7f3ccc15b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:39.388 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.376+0000 7f3ccb7fe700 1 -- 172.21.15.149:0/12494977 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cbc0094a0 con 0x7f3ccc15cb60 2023-11-08T19:26:39.389 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.377+0000 7f3ccb7fe700 1 --2- 172.21.15.149:0/12494977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ccc15cb60 0x7f3ccc151d80 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc014040 tx=0x7f3cbc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:39.389 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.377+0000 7f3cc8ff9700 1 -- 172.21.15.149:0/12494977 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cbc0036a0 con 0x7f3ccc15cb60 2023-11-08T19:26:39.389 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.377+0000 7f3cc8ff9700 1 -- 172.21.15.149:0/12494977 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cbc01e070 con 0x7f3ccc15cb60 2023-11-08T19:26:39.389 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.377+0000 7f3cd28de700 1 -- 172.21.15.149:0/12494977 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ccc15aec0 con 0x7f3ccc15cb60 2023-11-08T19:26:39.389 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.377+0000 7f3cc8ff9700 1 -- 172.21.15.149:0/12494977 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cbc003a40 con 0x7f3ccc15cb60 2023-11-08T19:26:39.390 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.377+0000 7f3cd28de700 1 -- 172.21.15.149:0/12494977 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ccc15b480 con 0x7f3ccc15cb60 2023-11-08T19:26:39.390 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.378+0000 7f3cd28de700 1 -- 172.21.15.149:0/12494977 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ccc0684f0 con 0x7f3ccc15cb60 2023-11-08T19:26:39.390 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.378+0000 7f3cc8ff9700 1 -- 172.21.15.149:0/12494977 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3cbc003ba0 con 0x7f3ccc15cb60 2023-11-08T19:26:39.390 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.378+0000 7f3cc8ff9700 1 --2- 172.21.15.149:0/12494977 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3cb806af00 0x7f3cb806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:39.391 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.379+0000 7f3cc8ff9700 1 -- 172.21.15.149:0/12494977 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6354+0+0 (secure 0 0 0) 0x7f3cbc08a840 con 0x7f3ccc15cb60 2023-11-08T19:26:39.391 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.379+0000 7f3ccbfff700 1 --2- 172.21.15.149:0/12494977 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3cb806af00 0x7f3cb806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:39.391 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.379+0000 7f3ccbfff700 1 --2- 172.21.15.149:0/12494977 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3cb806af00 0x7f3cb806d3c0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0007fd0 tx=0x7f3cc0007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:39.391 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.384+0000 7f3cc8ff9700 1 -- 172.21.15.149:0/12494977 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3cbc0556f0 con 0x7f3ccc15cb60 2023-11-08T19:26:39.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.573+0000 7f3cd28de700 1 -- 172.21.15.149:0/12494977 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f3ccc15b670 con 0x7f3ccc15cb60 2023-11-08T19:26:39.575 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.573+0000 7f3cc8ff9700 1 -- 172.21.15.149:0/12494977 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v87) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3cbc015020 con 0x7f3ccc15cb60 2023-11-08T19:26:39.575 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:26:39.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.575+0000 7f3cd28de700 1 -- 172.21.15.149:0/12494977 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3cb806af00 msgr2=0x7f3cb806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:39.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.575+0000 7f3cd28de700 1 --2- 172.21.15.149:0/12494977 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3cb806af00 0x7f3cb806d3c0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0007fd0 tx=0x7f3cc0007de0 comp rx=0 tx=0).stop 2023-11-08T19:26:39.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.575+0000 7f3cd28de700 1 -- 172.21.15.149:0/12494977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ccc15cb60 msgr2=0x7f3ccc151d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:39.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.575+0000 7f3cd28de700 1 --2- 172.21.15.149:0/12494977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ccc15cb60 0x7f3ccc151d80 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc014040 tx=0x7f3cbc004750 comp rx=0 tx=0).stop 2023-11-08T19:26:39.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.576+0000 7f3cd28de700 1 -- 172.21.15.149:0/12494977 shutdown_connections 2023-11-08T19:26:39.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.576+0000 7f3cd28de700 1 --2- 172.21.15.149:0/12494977 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3cb806af00 0x7f3cb806d3c0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:39.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.576+0000 7f3cd28de700 1 --2- 172.21.15.149:0/12494977 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ccc0cc0d0 0x7f3ccc15b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:39.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.576+0000 7f3cd28de700 1 --2- 172.21.15.149:0/12494977 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ccc15f470 0x7f3ccc0b1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:39.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.576+0000 7f3cd28de700 1 --2- 172.21.15.149:0/12494977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ccc15cb60 0x7f3ccc151d80 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:39.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.576+0000 7f3cd28de700 1 -- 172.21.15.149:0/12494977 >> 172.21.15.149:0/12494977 conn(0x7f3ccc06f120 msgr2=0x7f3ccc158950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:39.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.576+0000 7f3cd28de700 1 -- 172.21.15.149:0/12494977 shutdown_connections 2023-11-08T19:26:39.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.576+0000 7f3cd28de700 1 -- 172.21.15.149:0/12494977 wait complete. 2023-11-08T19:26:39.589 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-08T19:26:39.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.712+0000 7fb92c064700 1 Processor -- start 2023-11-08T19:26:39.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.712+0000 7fb92c064700 1 -- start start 2023-11-08T19:26:39.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.713+0000 7fb92c064700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb92415df40 0x7fb92406c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:39.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.713+0000 7fb92c064700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb92406ab80 0x7fb92406c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:39.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.713+0000 7fb92c064700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fb9240cf1c0 0x7fb9240caf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:39.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.713+0000 7fb92c064700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb92415e320 con 0x7fb92415df40 2023-11-08T19:26:39.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.713+0000 7fb92c064700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb92406b020 con 0x7fb9240cf1c0 2023-11-08T19:26:39.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.713+0000 7fb92c064700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb92406b2e0 con 0x7fb92406ab80 2023-11-08T19:26:39.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.713+0000 7fb929e00700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb92415df40 0x7fb92406c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:39.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.713+0000 7fb929e00700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb92415df40 0x7fb92406c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43140/0 (socket says 172.21.15.149:43140) 2023-11-08T19:26:39.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.713+0000 7fb929e00700 1 -- 172.21.15.149:0/1656809386 learned_addr learned my addr 172.21.15.149:0/1656809386 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:39.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.713+0000 7fb9295ff700 1 --2- 172.21.15.149:0/1656809386 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb92406ab80 0x7fb92406c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:39.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.713+0000 7fb92a601700 1 --2- 172.21.15.149:0/1656809386 >> v2:172.21.15.160:3300/0 conn(0x7fb9240cf1c0 0x7fb9240caf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:39.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.713+0000 7fb929e00700 1 -- 172.21.15.149:0/1656809386 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb92406ab80 msgr2=0x7fb92406c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:39.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.713+0000 7fb929e00700 1 --2- 172.21.15.149:0/1656809386 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb92406ab80 0x7fb92406c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:39.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.713+0000 7fb929e00700 1 -- 172.21.15.149:0/1656809386 >> v2:172.21.15.160:3300/0 conn(0x7fb9240cf1c0 msgr2=0x7fb9240caf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:39.719 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.713+0000 7fb929e00700 1 --2- 172.21.15.149:0/1656809386 >> v2:172.21.15.160:3300/0 conn(0x7fb9240cf1c0 0x7fb9240caf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:39.719 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.713+0000 7fb929e00700 1 -- 172.21.15.149:0/1656809386 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb92406b5c0 con 0x7fb92415df40 2023-11-08T19:26:39.719 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.713+0000 7fb929e00700 1 --2- 172.21.15.149:0/1656809386 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb92415df40 0x7fb92406c0a0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fb92406cb20 tx=0x7fb920009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9f77d7166bf29d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:39.719 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.714+0000 7fb928dfe700 1 -- 172.21.15.149:0/1656809386 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92000b870 con 0x7fb92415df40 2023-11-08T19:26:39.719 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.714+0000 7fb928dfe700 1 -- 172.21.15.149:0/1656809386 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb92000b9d0 con 0x7fb92415df40 2023-11-08T19:26:39.720 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.714+0000 7fb928dfe700 1 -- 172.21.15.149:0/1656809386 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92000bd60 con 0x7fb92415df40 2023-11-08T19:26:39.720 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.714+0000 7fb92c064700 1 -- 172.21.15.149:0/1656809386 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb92415df40 msgr2=0x7fb92406c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:39.720 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.714+0000 7fb92c064700 1 --2- 172.21.15.149:0/1656809386 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb92415df40 0x7fb92406c0a0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fb92406cb20 tx=0x7fb920009bd0 comp rx=0 tx=0).stop 2023-11-08T19:26:39.720 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.714+0000 7fb92c064700 1 -- 172.21.15.149:0/1656809386 shutdown_connections 2023-11-08T19:26:39.720 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.714+0000 7fb92c064700 1 --2- 172.21.15.149:0/1656809386 >> v2:172.21.15.160:3300/0 conn(0x7fb9240cf1c0 0x7fb9240caf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:39.721 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.714+0000 7fb92c064700 1 --2- 172.21.15.149:0/1656809386 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb92415df40 0x7fb92406c0a0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:39.721 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.714+0000 7fb92c064700 1 --2- 172.21.15.149:0/1656809386 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb92406ab80 0x7fb92406c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:39.721 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.714+0000 7fb92c064700 1 -- 172.21.15.149:0/1656809386 >> 172.21.15.149:0/1656809386 conn(0x7fb9240d0640 msgr2=0x7fb9240d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:39.721 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.714+0000 7fb92c064700 1 -- 172.21.15.149:0/1656809386 shutdown_connections 2023-11-08T19:26:39.721 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.714+0000 7fb92c064700 1 -- 172.21.15.149:0/1656809386 wait complete. 2023-11-08T19:26:39.724 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.716+0000 7fb92c064700 1 Processor -- start 2023-11-08T19:26:39.725 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.716+0000 7fb92c064700 1 -- start start 2023-11-08T19:26:39.725 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.716+0000 7fb92c064700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb92406ab80 0x7fb9241f7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:39.725 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.716+0000 7fb92c064700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb9240cf1c0 0x7fb9241578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:39.725 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.716+0000 7fb92c064700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb92415df40 0x7fb9240c6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:39.725 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.716+0000 7fb92c064700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9241f7940 con 0x7fb92415df40 2023-11-08T19:26:39.726 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.716+0000 7fb92c064700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9240af070 con 0x7fb92406ab80 2023-11-08T19:26:39.726 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.716+0000 7fb92c064700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9240add80 con 0x7fb9240cf1c0 2023-11-08T19:26:39.726 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.716+0000 7fb92a601700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb92415df40 0x7fb9240c6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:39.726 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.716+0000 7fb92a601700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb92415df40 0x7fb9240c6180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43150/0 (socket says 172.21.15.149:43150) 2023-11-08T19:26:39.727 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.716+0000 7fb92a601700 1 -- 172.21.15.149:0/2890106405 learned_addr learned my addr 172.21.15.149:0/2890106405 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:39.727 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.716+0000 7fb929e00700 1 --2- 172.21.15.149:0/2890106405 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb92406ab80 0x7fb9241f7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:39.727 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.717+0000 7fb9295ff700 1 --2- 172.21.15.149:0/2890106405 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb9240cf1c0 0x7fb9241578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:39.727 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.717+0000 7fb92a601700 1 -- 172.21.15.149:0/2890106405 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb9240cf1c0 msgr2=0x7fb9241578b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:39.727 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.717+0000 7fb92a601700 1 --2- 172.21.15.149:0/2890106405 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb9240cf1c0 0x7fb9241578b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:39.728 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.717+0000 7fb92a601700 1 -- 172.21.15.149:0/2890106405 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb92406ab80 msgr2=0x7fb9241f7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:39.728 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.717+0000 7fb92a601700 1 --2- 172.21.15.149:0/2890106405 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb92406ab80 0x7fb9241f7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:39.728 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.717+0000 7fb92a601700 1 -- 172.21.15.149:0/2890106405 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb920009550 con 0x7fb92415df40 2023-11-08T19:26:39.728 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.717+0000 7fb92a601700 1 --2- 172.21.15.149:0/2890106405 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb92415df40 0x7fb9240c6180 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fb91c007e40 tx=0x7fb91c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:39.728 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.717+0000 7fb91a7fc700 1 -- 172.21.15.149:0/2890106405 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91c00ed30 con 0x7fb92415df40 2023-11-08T19:26:39.729 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.717+0000 7fb91a7fc700 1 -- 172.21.15.149:0/2890106405 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb91c014420 con 0x7fb92415df40 2023-11-08T19:26:39.729 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.717+0000 7fb92c064700 1 -- 172.21.15.149:0/2890106405 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9240ae060 con 0x7fb92415df40 2023-11-08T19:26:39.729 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.717+0000 7fb91a7fc700 1 -- 172.21.15.149:0/2890106405 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91c0147d0 con 0x7fb92415df40 2023-11-08T19:26:39.729 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.717+0000 7fb92c064700 1 -- 172.21.15.149:0/2890106405 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9240ae620 con 0x7fb92415df40 2023-11-08T19:26:39.729 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.718+0000 7fb92c064700 1 -- 172.21.15.149:0/2890106405 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb92415f960 con 0x7fb92415df40 2023-11-08T19:26:39.730 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.718+0000 7fb91a7fc700 1 -- 172.21.15.149:0/2890106405 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb91c014930 con 0x7fb92415df40 2023-11-08T19:26:39.730 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.719+0000 7fb91a7fc700 1 --2- 172.21.15.149:0/2890106405 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb90806af00 0x7fb90806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:39.730 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.719+0000 7fb91a7fc700 1 -- 172.21.15.149:0/2890106405 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6354+0+0 (secure 0 0 0) 0x7fb91c089e70 con 0x7fb92415df40 2023-11-08T19:26:39.730 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.719+0000 7fb929e00700 1 --2- 172.21.15.149:0/2890106405 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb90806af00 0x7fb90806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:39.731 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.719+0000 7fb929e00700 1 --2- 172.21.15.149:0/2890106405 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb90806af00 0x7fb90806d3c0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fb920014040 tx=0x7fb920008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:39.731 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.724+0000 7fb91a7fc700 1 -- 172.21.15.149:0/2890106405 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb92415f960 con 0x7fb92415df40 2023-11-08T19:26:39.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.912+0000 7fb92c064700 1 -- 172.21.15.149:0/2890106405 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7fb92415f960 con 0x7fb92415df40 2023-11-08T19:26:39.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.912+0000 7fb91a7fc700 1 -- 172.21.15.149:0/2890106405 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v87) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb92415f960 con 0x7fb92415df40 2023-11-08T19:26:39.914 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:26:39.915 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.914+0000 7fb92c064700 1 -- 172.21.15.149:0/2890106405 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb90806af00 msgr2=0x7fb90806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:39.916 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.914+0000 7fb92c064700 1 --2- 172.21.15.149:0/2890106405 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb90806af00 0x7fb90806d3c0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fb920014040 tx=0x7fb920008030 comp rx=0 tx=0).stop 2023-11-08T19:26:39.916 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.914+0000 7fb92c064700 1 -- 172.21.15.149:0/2890106405 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb92415df40 msgr2=0x7fb9240c6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:39.916 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.914+0000 7fb92c064700 1 --2- 172.21.15.149:0/2890106405 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb92415df40 0x7fb9240c6180 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fb91c007e40 tx=0x7fb91c00e3c0 comp rx=0 tx=0).stop 2023-11-08T19:26:39.916 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.914+0000 7fb92c064700 1 -- 172.21.15.149:0/2890106405 shutdown_connections 2023-11-08T19:26:39.917 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.914+0000 7fb92c064700 1 --2- 172.21.15.149:0/2890106405 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb90806af00 0x7fb90806d3c0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:39.917 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.914+0000 7fb92c064700 1 --2- 172.21.15.149:0/2890106405 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb92406ab80 0x7fb9241f7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:39.917 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.914+0000 7fb92c064700 1 --2- 172.21.15.149:0/2890106405 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb92415df40 0x7fb9240c6180 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:39.917 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.914+0000 7fb92c064700 1 --2- 172.21.15.149:0/2890106405 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb9240cf1c0 0x7fb9241578b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:39.917 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.914+0000 7fb92c064700 1 -- 172.21.15.149:0/2890106405 >> 172.21.15.149:0/2890106405 conn(0x7fb9240d0640 msgr2=0x7fb9240cb0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:39.918 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.914+0000 7fb92c064700 1 -- 172.21.15.149:0/2890106405 shutdown_connections 2023-11-08T19:26:39.918 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:39.914+0000 7fb92c064700 1 -- 172.21.15.149:0/2890106405 wait complete. 2023-11-08T19:26:39.928 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-08T19:26:40.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.051+0000 7f2f09524700 1 Processor -- start 2023-11-08T19:26:40.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.051+0000 7f2f09524700 1 -- start start 2023-11-08T19:26:40.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.051+0000 7f2f09524700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2f040d1c10 0x7f2f040d31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:40.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.051+0000 7f2f09524700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2f040ce600 0x7f2f040ceab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:40.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.051+0000 7f2f09524700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f040d2110 con 0x7f2f0415da50 2023-11-08T19:26:40.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.052+0000 7f2f09524700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f040ceff0 con 0x7f2f040ce600 2023-11-08T19:26:40.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.052+0000 7f2f09524700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f040d36f0 con 0x7f2f040d1c10 2023-11-08T19:26:40.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.052+0000 7f2f037fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2f040ce600 0x7f2f040ceab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:40.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.052+0000 7f2f02ffd700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f2f0415da50 0x7f2f040b9250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:45156/0 (socket says 172.21.15.149:45156) 2023-11-08T19:26:40.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.052+0000 7f2f02ffd700 1 -- 172.21.15.149:0/3530437061 learned_addr learned my addr 172.21.15.149:0/3530437061 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:26:40.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.052+0000 7f2f027fc700 1 --2- 172.21.15.149:0/3530437061 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2f040d1c10 0x7f2f040d31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:40.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.052+0000 7f2f037fe700 1 -- 172.21.15.149:0/3530437061 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2f040d1c10 msgr2=0x7f2f040d31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:40.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.052+0000 7f2f037fe700 1 --2- 172.21.15.149:0/3530437061 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2f040d1c10 0x7f2f040d31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:40.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.052+0000 7f2f037fe700 1 -- 172.21.15.149:0/3530437061 >> v1:172.21.15.149:6789/0 conn(0x7f2f0415da50 legacy=0x7f2f040b9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:40.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.052+0000 7f2f01ffb700 1 -- 172.21.15.149:0/3530437061 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1970660203 0 0) 0x7f2f040d2110 con 0x7f2f0415da50 2023-11-08T19:26:40.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.052+0000 7f2f037fe700 1 -- 172.21.15.149:0/3530437061 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f040d23f0 con 0x7f2f040ce600 2023-11-08T19:26:40.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.052+0000 7f2f037fe700 1 --2- 172.21.15.149:0/3530437061 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f040ce600 0x7f2f040ceab0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f2efc009d90 tx=0x7f2efc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7551092fe121f875 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:40.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.052+0000 7f2f01ffb700 1 -- 172.21.15.149:0/3530437061 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2efc00e070 con 0x7f2f040ce600 2023-11-08T19:26:40.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.052+0000 7f2f01ffb700 1 -- 172.21.15.149:0/3530437061 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2efc00bbd0 con 0x7f2f040ce600 2023-11-08T19:26:40.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.052+0000 7f2f01ffb700 1 -- 172.21.15.149:0/3530437061 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2efc012430 con 0x7f2f040ce600 2023-11-08T19:26:40.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.053+0000 7f2f09524700 1 -- 172.21.15.149:0/3530437061 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f040ce600 msgr2=0x7f2f040ceab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:40.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.053+0000 7f2f09524700 1 --2- 172.21.15.149:0/3530437061 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f040ce600 0x7f2f040ceab0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f2efc009d90 tx=0x7f2efc00b330 comp rx=0 tx=0).stop 2023-11-08T19:26:40.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.053+0000 7f2f09524700 1 -- 172.21.15.149:0/3530437061 shutdown_connections 2023-11-08T19:26:40.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.053+0000 7f2f09524700 1 --2- 172.21.15.149:0/3530437061 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f040ce600 0x7f2f040ceab0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:40.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.053+0000 7f2f09524700 1 --2- 172.21.15.149:0/3530437061 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2f040d1c10 0x7f2f040d31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:40.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.053+0000 7f2f09524700 1 -- 172.21.15.149:0/3530437061 >> 172.21.15.149:0/3530437061 conn(0x7f2f0406bd60 msgr2=0x7f2f0406c140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:40.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.053+0000 7f2f09524700 1 -- 172.21.15.149:0/3530437061 shutdown_connections 2023-11-08T19:26:40.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.053+0000 7f2f09524700 1 -- 172.21.15.149:0/3530437061 wait complete. 2023-11-08T19:26:40.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.055+0000 7f2f09524700 1 Processor -- start 2023-11-08T19:26:40.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.055+0000 7f2f09524700 1 -- start start 2023-11-08T19:26:40.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.055+0000 7f2f09524700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2f040ce600 0x7f2f04153a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:40.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.055+0000 7f2f09524700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f040d1c10 0x7f2f04160bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:40.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.055+0000 7f2f09524700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2f0415da50 0x7f2f04158300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:40.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.056+0000 7f2f09524700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f04154c20 con 0x7f2f040d1c10 2023-11-08T19:26:40.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.056+0000 7f2f09524700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f04161130 con 0x7f2f0415da50 2023-11-08T19:26:40.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.056+0000 7f2f09524700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f04158840 con 0x7f2f040ce600 2023-11-08T19:26:40.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.056+0000 7f2f027fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f040d1c10 0x7f2f04160bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:40.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.056+0000 7f2f027fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f040d1c10 0x7f2f04160bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43160/0 (socket says 172.21.15.149:43160) 2023-11-08T19:26:40.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.056+0000 7f2f027fc700 1 -- 172.21.15.149:0/1453747480 learned_addr learned my addr 172.21.15.149:0/1453747480 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:40.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.056+0000 7f2f037fe700 1 --2- 172.21.15.149:0/1453747480 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2f0415da50 0x7f2f04158300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:40.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.056+0000 7f2f02ffd700 1 --2- 172.21.15.149:0/1453747480 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2f040ce600 0x7f2f04153a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:40.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.056+0000 7f2f027fc700 1 -- 172.21.15.149:0/1453747480 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2f040ce600 msgr2=0x7f2f04153a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:40.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.056+0000 7f2f027fc700 1 --2- 172.21.15.149:0/1453747480 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2f040ce600 0x7f2f04153a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:40.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.056+0000 7f2f027fc700 1 -- 172.21.15.149:0/1453747480 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2f0415da50 msgr2=0x7f2f04158300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:40.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.056+0000 7f2f027fc700 1 --2- 172.21.15.149:0/1453747480 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2f0415da50 0x7f2f04158300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:40.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.056+0000 7f2f027fc700 1 -- 172.21.15.149:0/1453747480 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2efc009a70 con 0x7f2f040d1c10 2023-11-08T19:26:40.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.056+0000 7f2f027fc700 1 --2- 172.21.15.149:0/1453747480 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f040d1c10 0x7f2f04160bf0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f2ef800e840 tx=0x7f2ef800ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:40.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.056+0000 7f2eeb7fe700 1 -- 172.21.15.149:0/1453747480 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef8013610 con 0x7f2f040d1c10 2023-11-08T19:26:40.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.056+0000 7f2eeb7fe700 1 -- 172.21.15.149:0/1453747480 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef8013770 con 0x7f2f040d1c10 2023-11-08T19:26:40.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.056+0000 7f2f09524700 1 -- 172.21.15.149:0/1453747480 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f04154010 con 0x7f2f040d1c10 2023-11-08T19:26:40.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.056+0000 7f2eeb7fe700 1 -- 172.21.15.149:0/1453747480 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef8013b20 con 0x7f2f040d1c10 2023-11-08T19:26:40.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.056+0000 7f2f09524700 1 -- 172.21.15.149:0/1453747480 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f041545d0 con 0x7f2f040d1c10 2023-11-08T19:26:40.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.057+0000 7f2f09524700 1 -- 172.21.15.149:0/1453747480 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f0404f730 con 0x7f2f040d1c10 2023-11-08T19:26:40.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.058+0000 7f2eeb7fe700 1 -- 172.21.15.149:0/1453747480 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2ef8013c80 con 0x7f2f040d1c10 2023-11-08T19:26:40.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.058+0000 7f2eeb7fe700 1 --2- 172.21.15.149:0/1453747480 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2ef006af30 0x7f2ef006d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:40.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.059+0000 7f2eeb7fe700 1 -- 172.21.15.149:0/1453747480 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6354+0+0 (secure 0 0 0) 0x7f2ef8089950 con 0x7f2f040d1c10 2023-11-08T19:26:40.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.059+0000 7f2f02ffd700 1 --2- 172.21.15.149:0/1453747480 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2ef006af30 0x7f2ef006d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:40.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.059+0000 7f2f02ffd700 1 --2- 172.21.15.149:0/1453747480 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2ef006af30 0x7f2ef006d3f0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f2ef4000f60 tx=0x7f2ef4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:40.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.063+0000 7f2eeb7fe700 1 -- 172.21.15.149:0/1453747480 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2ef80547c0 con 0x7f2f040d1c10 2023-11-08T19:26:40.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.254+0000 7f2f09524700 1 -- 172.21.15.149:0/1453747480 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7f2f040d1490 con 0x7f2f040d1c10 2023-11-08T19:26:40.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.255+0000 7f2eeb7fe700 1 -- 172.21.15.149:0/1453747480 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v87) v1 ==== 107+0+11 (secure 0 0 0) 0x7f2ef80210b0 con 0x7f2f040d1c10 2023-11-08T19:26:40.256 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:26:40.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.257+0000 7f2f09524700 1 -- 172.21.15.149:0/1453747480 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2ef006af30 msgr2=0x7f2ef006d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:40.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.257+0000 7f2f09524700 1 --2- 172.21.15.149:0/1453747480 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2ef006af30 0x7f2ef006d3f0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f2ef4000f60 tx=0x7f2ef4009040 comp rx=0 tx=0).stop 2023-11-08T19:26:40.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.257+0000 7f2f09524700 1 -- 172.21.15.149:0/1453747480 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f040d1c10 msgr2=0x7f2f04160bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:40.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.257+0000 7f2f09524700 1 --2- 172.21.15.149:0/1453747480 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f040d1c10 0x7f2f04160bf0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f2ef800e840 tx=0x7f2ef800ec00 comp rx=0 tx=0).stop 2023-11-08T19:26:40.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.257+0000 7f2f09524700 1 -- 172.21.15.149:0/1453747480 shutdown_connections 2023-11-08T19:26:40.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.257+0000 7f2f09524700 1 --2- 172.21.15.149:0/1453747480 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2ef006af30 0x7f2ef006d3f0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:40.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.257+0000 7f2f09524700 1 --2- 172.21.15.149:0/1453747480 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2f0415da50 0x7f2f04158300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:40.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.257+0000 7f2f09524700 1 --2- 172.21.15.149:0/1453747480 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2f040ce600 0x7f2f04153a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:40.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.257+0000 7f2f09524700 1 --2- 172.21.15.149:0/1453747480 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f040d1c10 0x7f2f04160bf0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:40.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.257+0000 7f2f09524700 1 -- 172.21.15.149:0/1453747480 >> 172.21.15.149:0/1453747480 conn(0x7f2f0406bd60 msgr2=0x7f2f04151550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:40.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.257+0000 7f2f09524700 1 -- 172.21.15.149:0/1453747480 shutdown_connections 2023-11-08T19:26:40.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.257+0000 7f2f09524700 1 -- 172.21.15.149:0/1453747480 wait complete. 2023-11-08T19:26:40.270 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snapshots.TestSnapshots.test_kill_mdstable' 2023-11-08T19:26:40.393 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.392+0000 7fc6b1347700 1 Processor -- start 2023-11-08T19:26:40.393 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.392+0000 7fc6b1347700 1 -- start start 2023-11-08T19:26:40.396 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.393+0000 7fc6b1347700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc6ac071610 0x7fc6ac15add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:40.396 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.393+0000 7fc6b1347700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc6ac0c9a90 0x7fc6ac0c9f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:40.396 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.393+0000 7fc6b1347700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6ac0b1d70 con 0x7fc6ac06cde0 2023-11-08T19:26:40.397 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.393+0000 7fc6b1347700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6ac072830 con 0x7fc6ac0c9a90 2023-11-08T19:26:40.397 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.393+0000 7fc6b1347700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ac071bb0 con 0x7fc6ac071610 2023-11-08T19:26:40.397 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.393+0000 7fc6ab7fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc6ac0c9a90 0x7fc6ac0c9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:40.397 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.393+0000 7fc6ab7fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc6ac0c9a90 0x7fc6ac0c9f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43170/0 (socket says 172.21.15.149:43170) 2023-11-08T19:26:40.397 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.393+0000 7fc6ab7fe700 1 -- 172.21.15.149:0/2959397071 learned_addr learned my addr 172.21.15.149:0/2959397071 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:40.398 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.393+0000 7fc6ab7fe700 1 -- 172.21.15.149:0/2959397071 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc6ac071610 msgr2=0x7fc6ac15add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:40.398 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.393+0000 7fc6ab7fe700 1 --2- 172.21.15.149:0/2959397071 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc6ac071610 0x7fc6ac15add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:40.398 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.393+0000 7fc6ab7fe700 1 -- 172.21.15.149:0/2959397071 >> v1:172.21.15.160:6789/0 conn(0x7fc6ac06cde0 legacy=0x7fc6ac06d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:40.398 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.393+0000 7fc6ab7fe700 1 -- 172.21.15.149:0/2959397071 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6ac071e90 con 0x7fc6ac0c9a90 2023-11-08T19:26:40.398 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.393+0000 7fc6ab7fe700 1 --2- 172.21.15.149:0/2959397071 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6ac0c9a90 0x7fc6ac0c9f20 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fc6a4009e50 tx=0x7fc6a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=567c18c8808f22c4 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:40.399 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.393+0000 7fc6a9ffb700 1 -- 172.21.15.149:0/2959397071 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a400e070 con 0x7fc6ac0c9a90 2023-11-08T19:26:40.399 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.393+0000 7fc6a9ffb700 1 -- 172.21.15.149:0/2959397071 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6a4003a20 con 0x7fc6ac0c9a90 2023-11-08T19:26:40.399 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.394+0000 7fc6a9ffb700 1 -- 172.21.15.149:0/2959397071 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a4003dd0 con 0x7fc6ac0c9a90 2023-11-08T19:26:40.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.394+0000 7fc6b1347700 1 -- 172.21.15.149:0/2959397071 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6ac0c9a90 msgr2=0x7fc6ac0c9f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:40.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.394+0000 7fc6b1347700 1 --2- 172.21.15.149:0/2959397071 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6ac0c9a90 0x7fc6ac0c9f20 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fc6a4009e50 tx=0x7fc6a400b330 comp rx=0 tx=0).stop 2023-11-08T19:26:40.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.394+0000 7fc6b1347700 1 -- 172.21.15.149:0/2959397071 shutdown_connections 2023-11-08T19:26:40.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.394+0000 7fc6b1347700 1 --2- 172.21.15.149:0/2959397071 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6ac0c9a90 0x7fc6ac0c9f20 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:40.401 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.394+0000 7fc6b1347700 1 --2- 172.21.15.149:0/2959397071 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc6ac071610 0x7fc6ac15add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:40.401 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.394+0000 7fc6b1347700 1 -- 172.21.15.149:0/2959397071 >> 172.21.15.149:0/2959397071 conn(0x7fc6ac06b3d0 msgr2=0x7fc6ac0cf460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:40.401 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.394+0000 7fc6b1347700 1 -- 172.21.15.149:0/2959397071 shutdown_connections 2023-11-08T19:26:40.401 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.394+0000 7fc6b1347700 1 -- 172.21.15.149:0/2959397071 wait complete. 2023-11-08T19:26:40.404 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.395+0000 7fc6b1347700 1 Processor -- start 2023-11-08T19:26:40.405 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.395+0000 7fc6b1347700 1 -- start start 2023-11-08T19:26:40.405 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.396+0000 7fc6b1347700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc6ac06cde0 0x7fc6ac159870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:40.405 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.396+0000 7fc6b1347700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6ac071610 0x7fc6ac14f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:40.405 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.396+0000 7fc6b1347700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc6ac0c9a90 0x7fc6ac0c4080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:40.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.396+0000 7fc6b1347700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ac150230 con 0x7fc6ac071610 2023-11-08T19:26:40.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.396+0000 7fc6b1347700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ac158c20 con 0x7fc6ac06cde0 2023-11-08T19:26:40.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.396+0000 7fc6b1347700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ac158f00 con 0x7fc6ac0c9a90 2023-11-08T19:26:40.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.396+0000 7fc6aa7fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6ac071610 0x7fc6ac14f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:40.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.396+0000 7fc6aa7fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6ac071610 0x7fc6ac14f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43174/0 (socket says 172.21.15.149:43174) 2023-11-08T19:26:40.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.396+0000 7fc6aa7fc700 1 -- 172.21.15.149:0/148555748 learned_addr learned my addr 172.21.15.149:0/148555748 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:40.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.396+0000 7fc6aaffd700 1 --2- 172.21.15.149:0/148555748 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc6ac06cde0 0x7fc6ac159870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:40.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.396+0000 7fc6ab7fe700 1 --2- 172.21.15.149:0/148555748 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc6ac0c9a90 0x7fc6ac0c4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:40.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.397+0000 7fc6aa7fc700 1 -- 172.21.15.149:0/148555748 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc6ac0c9a90 msgr2=0x7fc6ac0c4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:40.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.397+0000 7fc6aa7fc700 1 --2- 172.21.15.149:0/148555748 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc6ac0c9a90 0x7fc6ac0c4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:40.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.397+0000 7fc6aa7fc700 1 -- 172.21.15.149:0/148555748 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc6ac06cde0 msgr2=0x7fc6ac159870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:40.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.397+0000 7fc6aa7fc700 1 --2- 172.21.15.149:0/148555748 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc6ac06cde0 0x7fc6ac159870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:40.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.397+0000 7fc6aa7fc700 1 -- 172.21.15.149:0/148555748 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a4009b30 con 0x7fc6ac071610 2023-11-08T19:26:40.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.397+0000 7fc6aa7fc700 1 --2- 172.21.15.149:0/148555748 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6ac071610 0x7fc6ac14f060 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fc69c00b4a0 tx=0x7fc69c00b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:40.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.397+0000 7fc6937fe700 1 -- 172.21.15.149:0/148555748 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69c011830 con 0x7fc6ac071610 2023-11-08T19:26:40.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.397+0000 7fc6937fe700 1 -- 172.21.15.149:0/148555748 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc69c011990 con 0x7fc6ac071610 2023-11-08T19:26:40.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.397+0000 7fc6b1347700 1 -- 172.21.15.149:0/148555748 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6ac0c35a0 con 0x7fc6ac071610 2023-11-08T19:26:40.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.397+0000 7fc6937fe700 1 -- 172.21.15.149:0/148555748 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69c011d40 con 0x7fc6ac071610 2023-11-08T19:26:40.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.397+0000 7fc6b1347700 1 -- 172.21.15.149:0/148555748 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6ac0c3930 con 0x7fc6ac071610 2023-11-08T19:26:40.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.398+0000 7fc6b1347700 1 -- 172.21.15.149:0/148555748 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6ac0c3d70 con 0x7fc6ac071610 2023-11-08T19:26:40.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.398+0000 7fc6937fe700 1 -- 172.21.15.149:0/148555748 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc69c01a400 con 0x7fc6ac071610 2023-11-08T19:26:40.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.399+0000 7fc6937fe700 1 --2- 172.21.15.149:0/148555748 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc69806af00 0x7fc69806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:40.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.399+0000 7fc6937fe700 1 -- 172.21.15.149:0/148555748 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6354+0+0 (secure 0 0 0) 0x7fc69c089770 con 0x7fc6ac071610 2023-11-08T19:26:40.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.399+0000 7fc6aaffd700 1 --2- 172.21.15.149:0/148555748 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc69806af00 0x7fc69806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:40.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.399+0000 7fc6aaffd700 1 --2- 172.21.15.149:0/148555748 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc69806af00 0x7fc69806d3c0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fc6a0009960 tx=0x7fc6a00090e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:40.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.403+0000 7fc6937fe700 1 -- 172.21.15.149:0/148555748 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc69c0545a0 con 0x7fc6ac071610 2023-11-08T19:26:40.675 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:40.674+0000 7fc6b1347700 1 -- 172.21.15.149:0/148555748 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestSnapshots.test_kill_mdstable"]} v 0) v1 -- 0x7fc6ac159e70 con 0x7fc6ac071610 2023-11-08T19:26:41.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.553+0000 7fc6937fe700 1 -- 172.21.15.149:0/148555748 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestSnapshots.test_kill_mdstable"]}]=0 v227) v1 ==== 142+0+0 (secure 0 0 0) 0x7fc69c057bc0 con 0x7fc6ac071610 2023-11-08T19:26:41.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.557+0000 7fc6b1347700 1 -- 172.21.15.149:0/148555748 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc69806af00 msgr2=0x7fc69806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:41.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.557+0000 7fc6b1347700 1 --2- 172.21.15.149:0/148555748 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc69806af00 0x7fc69806d3c0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fc6a0009960 tx=0x7fc6a00090e0 comp rx=0 tx=0).stop 2023-11-08T19:26:41.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.558+0000 7fc6b1347700 1 -- 172.21.15.149:0/148555748 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6ac071610 msgr2=0x7fc6ac14f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:41.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.558+0000 7fc6b1347700 1 --2- 172.21.15.149:0/148555748 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6ac071610 0x7fc6ac14f060 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fc69c00b4a0 tx=0x7fc69c00b7b0 comp rx=0 tx=0).stop 2023-11-08T19:26:41.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.558+0000 7fc6b1347700 1 -- 172.21.15.149:0/148555748 shutdown_connections 2023-11-08T19:26:41.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.558+0000 7fc6b1347700 1 --2- 172.21.15.149:0/148555748 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc69806af00 0x7fc69806d3c0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:41.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.558+0000 7fc6b1347700 1 --2- 172.21.15.149:0/148555748 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc6ac06cde0 0x7fc6ac159870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:41.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.558+0000 7fc6b1347700 1 --2- 172.21.15.149:0/148555748 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc6ac0c9a90 0x7fc6ac0c4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:41.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.558+0000 7fc6b1347700 1 --2- 172.21.15.149:0/148555748 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6ac071610 0x7fc6ac14f060 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:41.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.558+0000 7fc6b1347700 1 -- 172.21.15.149:0/148555748 >> 172.21.15.149:0/148555748 conn(0x7fc6ac06b3d0 msgr2=0x7fc6ac15c440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:41.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.558+0000 7fc6b1347700 1 -- 172.21.15.149:0/148555748 shutdown_connections 2023-11-08T19:26:41.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.558+0000 7fc6b1347700 1 -- 172.21.15.149:0/148555748 wait complete. 2023-11-08T19:26:41.574 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-08T19:26:41.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.701+0000 7fe59a6d4700 1 Processor -- start 2023-11-08T19:26:41.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.701+0000 7fe59a6d4700 1 -- start start 2023-11-08T19:26:41.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.701+0000 7fe59a6d4700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe59415abf0 0x7fe5940b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:41.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.701+0000 7fe59a6d4700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe5940cc870 0x7fe59406bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:41.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.701+0000 7fe59a6d4700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5940b6470 con 0x7fe5940d1130 2023-11-08T19:26:41.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.701+0000 7fe59a6d4700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5940b66a0 con 0x7fe59415abf0 2023-11-08T19:26:41.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.701+0000 7fe59a6d4700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5940d04a0 con 0x7fe5940cc870 2023-11-08T19:26:41.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.702+0000 7fe593fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe59415abf0 0x7fe5940b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:41.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.702+0000 7fe593fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe59415abf0 0x7fe5940b5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43180/0 (socket says 172.21.15.149:43180) 2023-11-08T19:26:41.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.702+0000 7fe593fff700 1 -- 172.21.15.149:0/524342373 learned_addr learned my addr 172.21.15.149:0/524342373 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:41.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.702+0000 7fe598c71700 1 --2- 172.21.15.149:0/524342373 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe5940cc870 0x7fe59406bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:41.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.702+0000 7fe593fff700 1 -- 172.21.15.149:0/524342373 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe5940cc870 msgr2=0x7fe59406bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:41.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.702+0000 7fe593fff700 1 --2- 172.21.15.149:0/524342373 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe5940cc870 0x7fe59406bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:41.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.702+0000 7fe593fff700 1 -- 172.21.15.149:0/524342373 >> v1:172.21.15.160:6789/0 conn(0x7fe5940d1130 legacy=0x7fe5940cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:41.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.702+0000 7fe593fff700 1 -- 172.21.15.149:0/524342373 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe59415afd0 con 0x7fe59415abf0 2023-11-08T19:26:41.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.702+0000 7fe593fff700 1 --2- 172.21.15.149:0/524342373 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe59415abf0 0x7fe5940b5f30 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fe5840098f0 tx=0x7fe584009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fd1aff83faad2b0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:41.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.702+0000 7fe592ffd700 1 -- 172.21.15.149:0/524342373 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe584004230 con 0x7fe59415abf0 2023-11-08T19:26:41.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.702+0000 7fe592ffd700 1 -- 172.21.15.149:0/524342373 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe584004390 con 0x7fe59415abf0 2023-11-08T19:26:41.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.702+0000 7fe592ffd700 1 -- 172.21.15.149:0/524342373 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5840036a0 con 0x7fe59415abf0 2023-11-08T19:26:41.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.703+0000 7fe59a6d4700 1 -- 172.21.15.149:0/524342373 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe59415abf0 msgr2=0x7fe5940b5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:41.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.703+0000 7fe59a6d4700 1 --2- 172.21.15.149:0/524342373 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe59415abf0 0x7fe5940b5f30 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fe5840098f0 tx=0x7fe584009c00 comp rx=0 tx=0).stop 2023-11-08T19:26:41.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.703+0000 7fe59a6d4700 1 -- 172.21.15.149:0/524342373 shutdown_connections 2023-11-08T19:26:41.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.703+0000 7fe59a6d4700 1 --2- 172.21.15.149:0/524342373 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe5940cc870 0x7fe59406bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:41.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.703+0000 7fe59a6d4700 1 --2- 172.21.15.149:0/524342373 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe59415abf0 0x7fe5940b5f30 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:41.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.703+0000 7fe59a6d4700 1 -- 172.21.15.149:0/524342373 >> 172.21.15.149:0/524342373 conn(0x7fe5940d0640 msgr2=0x7fe5940d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:41.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.703+0000 7fe59a6d4700 1 -- 172.21.15.149:0/524342373 shutdown_connections 2023-11-08T19:26:41.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.703+0000 7fe59a6d4700 1 -- 172.21.15.149:0/524342373 wait complete. 2023-11-08T19:26:41.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.704+0000 7fe59a6d4700 1 Processor -- start 2023-11-08T19:26:41.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.704+0000 7fe59a6d4700 1 -- start start 2023-11-08T19:26:41.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.705+0000 7fe59a6d4700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe5940cc870 0x7fe59415cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:41.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.705+0000 7fe59a6d4700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe5940d1130 0x7fe5940ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:41.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.705+0000 7fe59a6d4700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe59415abf0 0x7fe594150920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:41.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.705+0000 7fe59a6d4700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe59415d150 con 0x7fe59415abf0 2023-11-08T19:26:41.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.705+0000 7fe59a6d4700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5940ace00 con 0x7fe5940cc870 2023-11-08T19:26:41.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.705+0000 7fe59a6d4700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5940ad010 con 0x7fe5940d1130 2023-11-08T19:26:41.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.705+0000 7fe598c71700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe59415abf0 0x7fe594150920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:41.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.705+0000 7fe598c71700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe59415abf0 0x7fe594150920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43190/0 (socket says 172.21.15.149:43190) 2023-11-08T19:26:41.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.705+0000 7fe598c71700 1 -- 172.21.15.149:0/415922092 learned_addr learned my addr 172.21.15.149:0/415922092 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:41.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.705+0000 7fe598c71700 1 -- 172.21.15.149:0/415922092 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe5940d1130 msgr2=0x7fe5940ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:41.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.705+0000 7fe598c71700 1 --2- 172.21.15.149:0/415922092 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe5940d1130 0x7fe5940ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:41.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.705+0000 7fe598c71700 1 -- 172.21.15.149:0/415922092 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe5940cc870 msgr2=0x7fe59415cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:41.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.705+0000 7fe593fff700 1 --2- 172.21.15.149:0/415922092 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe5940cc870 0x7fe59415cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:41.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.705+0000 7fe598c71700 1 --2- 172.21.15.149:0/415922092 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe5940cc870 0x7fe59415cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:41.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.705+0000 7fe598c71700 1 -- 172.21.15.149:0/415922092 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe584009550 con 0x7fe59415abf0 2023-11-08T19:26:41.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.705+0000 7fe598c71700 1 --2- 172.21.15.149:0/415922092 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe59415abf0 0x7fe594150920 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fe58c00cd70 tx=0x7fe58c00a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:41.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.705+0000 7fe590ff9700 1 -- 172.21.15.149:0/415922092 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe58c003a20 con 0x7fe59415abf0 2023-11-08T19:26:41.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.705+0000 7fe590ff9700 1 -- 172.21.15.149:0/415922092 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe58c003b80 con 0x7fe59415abf0 2023-11-08T19:26:41.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.705+0000 7fe59a6d4700 1 -- 172.21.15.149:0/415922092 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5940ad2f0 con 0x7fe59415abf0 2023-11-08T19:26:41.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.705+0000 7fe590ff9700 1 -- 172.21.15.149:0/415922092 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe58c004020 con 0x7fe59415abf0 2023-11-08T19:26:41.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.706+0000 7fe59a6d4700 1 -- 172.21.15.149:0/415922092 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5940ad8b0 con 0x7fe59415abf0 2023-11-08T19:26:41.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.706+0000 7fe59a6d4700 1 -- 172.21.15.149:0/415922092 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5940afea0 con 0x7fe59415abf0 2023-11-08T19:26:41.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.707+0000 7fe590ff9700 1 -- 172.21.15.149:0/415922092 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe58c004180 con 0x7fe59415abf0 2023-11-08T19:26:41.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.707+0000 7fe590ff9700 1 --2- 172.21.15.149:0/415922092 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe58006af00 0x7fe58006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:41.719 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.707+0000 7fe590ff9700 1 -- 172.21.15.149:0/415922092 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6354+0+0 (secure 0 0 0) 0x7fe58c012070 con 0x7fe59415abf0 2023-11-08T19:26:41.719 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.707+0000 7fe593fff700 1 --2- 172.21.15.149:0/415922092 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe58006af00 0x7fe58006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:41.719 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.708+0000 7fe593fff700 1 --2- 172.21.15.149:0/415922092 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe58006af00 0x7fe58006d3c0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fe584000c00 tx=0x7fe584008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:41.719 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.712+0000 7fe590ff9700 1 -- 172.21.15.149:0/415922092 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe58c054ec0 con 0x7fe59415abf0 2023-11-08T19:26:41.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.902+0000 7fe59a6d4700 1 -- 172.21.15.149:0/415922092 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fe59404f730 con 0x7fe59415abf0 2023-11-08T19:26:41.907 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.906+0000 7fe590ff9700 1 -- 172.21.15.149:0/415922092 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v19)=0 v19) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe58c0584e0 con 0x7fe59415abf0 2023-11-08T19:26:41.910 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.908+0000 7fe59a6d4700 1 -- 172.21.15.149:0/415922092 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe58006af00 msgr2=0x7fe58006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:41.910 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.908+0000 7fe59a6d4700 1 --2- 172.21.15.149:0/415922092 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe58006af00 0x7fe58006d3c0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fe584000c00 tx=0x7fe584008030 comp rx=0 tx=0).stop 2023-11-08T19:26:41.910 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.908+0000 7fe59a6d4700 1 -- 172.21.15.149:0/415922092 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe59415abf0 msgr2=0x7fe594150920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:41.910 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.908+0000 7fe59a6d4700 1 --2- 172.21.15.149:0/415922092 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe59415abf0 0x7fe594150920 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fe58c00cd70 tx=0x7fe58c00a570 comp rx=0 tx=0).stop 2023-11-08T19:26:41.910 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.908+0000 7fe59a6d4700 1 -- 172.21.15.149:0/415922092 shutdown_connections 2023-11-08T19:26:41.911 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.908+0000 7fe59a6d4700 1 --2- 172.21.15.149:0/415922092 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe58006af00 0x7fe58006d3c0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:41.911 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.908+0000 7fe59a6d4700 1 --2- 172.21.15.149:0/415922092 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe5940cc870 0x7fe59415cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:41.911 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.908+0000 7fe59a6d4700 1 --2- 172.21.15.149:0/415922092 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe59415abf0 0x7fe594150920 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:41.911 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.908+0000 7fe59a6d4700 1 --2- 172.21.15.149:0/415922092 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe5940d1130 0x7fe5940ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:41.911 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.908+0000 7fe59a6d4700 1 -- 172.21.15.149:0/415922092 >> 172.21.15.149:0/415922092 conn(0x7fe5940d0640 msgr2=0x7fe5940b0140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:41.912 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.908+0000 7fe59a6d4700 1 -- 172.21.15.149:0/415922092 shutdown_connections 2023-11-08T19:26:41.912 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:41.908+0000 7fe59a6d4700 1 -- 172.21.15.149:0/415922092 wait complete. 2023-11-08T19:26:41.922 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-08T19:26:41.922 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-08T19:26:41.967 DEBUG:teuthology.orchestra.run.smithi160:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-08T19:26:42.018 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-08T19:26:42.018 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-11-08T19:26:42.019 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:26:42.036 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=8026740k,nr_inodes=2006685,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=31,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15303 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1609048k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-11-08T19:26:42.037 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-11-08T19:26:42.037 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:26:42.057 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284272k,nr_inodes=4071068,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16330 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-08T19:26:42.057 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-11-08T19:26:42.058 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:26:42.094 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=8026740k,nr_inodes=2006685,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=31,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15303 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1609048k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-11-08T19:26:42.094 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-11-08T19:26:42.095 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:26:42.116 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284272k,nr_inodes=4071068,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16330 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-08T19:26:42.117 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-08T19:26:42.117 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:26:42.253 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.252+0000 7fbf9f7a1700 1 Processor -- start 2023-11-08T19:26:42.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.253+0000 7fbf9f7a1700 1 -- start start 2023-11-08T19:26:42.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.253+0000 7fbf9f7a1700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fbf9815db70 0x7fbf98161dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:42.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.253+0000 7fbf9f7a1700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf98161940 con 0x7fbf980b2c00 2023-11-08T19:26:42.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.253+0000 7fbf9f7a1700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf9815e660 con 0x7fbf9806ab80 2023-11-08T19:26:42.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.253+0000 7fbf9f7a1700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf9815eeb0 con 0x7fbf9815db70 2023-11-08T19:26:42.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.253+0000 7fbf9d53d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fbf9815db70 0x7fbf98161dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:42.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.253+0000 7fbf9cd3c700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fbf980b2c00 0x7fbf9815df50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:45196/0 (socket says 172.21.15.149:45196) 2023-11-08T19:26:42.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.254+0000 7fbf9cd3c700 1 -- 172.21.15.149:0/1605395950 learned_addr learned my addr 172.21.15.149:0/1605395950 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:26:42.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.254+0000 7fbf9d53d700 1 -- 172.21.15.149:0/1605395950 >> v1:172.21.15.160:6789/0 conn(0x7fbf9806ab80 legacy=0x7fbf98071dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:42.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.254+0000 7fbf9d53d700 1 -- 172.21.15.149:0/1605395950 >> v1:172.21.15.149:6789/0 conn(0x7fbf980b2c00 legacy=0x7fbf9815df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:42.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.254+0000 7fbf9d53d700 1 -- 172.21.15.149:0/1605395950 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf9815e8f0 con 0x7fbf9815db70 2023-11-08T19:26:42.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.254+0000 7fbf8ffff700 1 -- 172.21.15.149:0/1605395950 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1393465075 0 0) 0x7fbf98161940 con 0x7fbf980b2c00 2023-11-08T19:26:42.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.254+0000 7fbf9d53d700 1 --2- 172.21.15.149:0/1605395950 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf9815db70 0x7fbf98161dd0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fbf88009840 tx=0x7fbf88009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e455ddf5f1733de server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:42.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.254+0000 7fbf8ffff700 1 -- 172.21.15.149:0/1605395950 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf88004230 con 0x7fbf9815db70 2023-11-08T19:26:42.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.254+0000 7fbf8ffff700 1 -- 172.21.15.149:0/1605395950 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf88004390 con 0x7fbf9815db70 2023-11-08T19:26:42.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.254+0000 7fbf8ffff700 1 -- 172.21.15.149:0/1605395950 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf880036a0 con 0x7fbf9815db70 2023-11-08T19:26:42.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.255+0000 7fbf9f7a1700 1 -- 172.21.15.149:0/1605395950 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf9815db70 msgr2=0x7fbf98161dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:42.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.255+0000 7fbf9f7a1700 1 --2- 172.21.15.149:0/1605395950 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf9815db70 0x7fbf98161dd0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fbf88009840 tx=0x7fbf88009b50 comp rx=0 tx=0).stop 2023-11-08T19:26:42.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.255+0000 7fbf9f7a1700 1 -- 172.21.15.149:0/1605395950 shutdown_connections 2023-11-08T19:26:42.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.255+0000 7fbf9f7a1700 1 --2- 172.21.15.149:0/1605395950 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf9815db70 0x7fbf98161dd0 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:42.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.255+0000 7fbf9f7a1700 1 -- 172.21.15.149:0/1605395950 >> 172.21.15.149:0/1605395950 conn(0x7fbf980ccff0 msgr2=0x7fbf980cd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:42.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.255+0000 7fbf9f7a1700 1 -- 172.21.15.149:0/1605395950 shutdown_connections 2023-11-08T19:26:42.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.255+0000 7fbf9f7a1700 1 -- 172.21.15.149:0/1605395950 wait complete. 2023-11-08T19:26:42.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.256+0000 7fbf9f7a1700 1 Processor -- start 2023-11-08T19:26:42.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.256+0000 7fbf9f7a1700 1 -- start start 2023-11-08T19:26:42.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.257+0000 7fbf9f7a1700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf9806ab80 0x7fbf98150a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:42.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.257+0000 7fbf9f7a1700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbf980b2c00 0x7fbf980b3190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:42.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.257+0000 7fbf9f7a1700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbf9815db70 0x7fbf98160030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:42.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.257+0000 7fbf9f7a1700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf98150fa0 con 0x7fbf9806ab80 2023-11-08T19:26:42.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.257+0000 7fbf9f7a1700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf980b41a0 con 0x7fbf9815db70 2023-11-08T19:26:42.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.257+0000 7fbf9f7a1700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf980b3be0 con 0x7fbf980b2c00 2023-11-08T19:26:42.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.257+0000 7fbf9d53d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf9806ab80 0x7fbf98150a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:42.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.257+0000 7fbf9d53d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf9806ab80 0x7fbf98150a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43200/0 (socket says 172.21.15.149:43200) 2023-11-08T19:26:42.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.257+0000 7fbf9d53d700 1 -- 172.21.15.149:0/3781963947 learned_addr learned my addr 172.21.15.149:0/3781963947 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:42.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.258+0000 7fbf9d53d700 1 -- 172.21.15.149:0/3781963947 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbf980b2c00 msgr2=0x7fbf980b3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:42.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.258+0000 7fbf9d53d700 1 --2- 172.21.15.149:0/3781963947 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbf980b2c00 0x7fbf980b3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:42.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.258+0000 7fbf9d53d700 1 -- 172.21.15.149:0/3781963947 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbf9815db70 msgr2=0x7fbf98160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:42.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.258+0000 7fbf9d53d700 1 --2- 172.21.15.149:0/3781963947 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbf9815db70 0x7fbf98160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:42.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.258+0000 7fbf9d53d700 1 -- 172.21.15.149:0/3781963947 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf880094a0 con 0x7fbf9806ab80 2023-11-08T19:26:42.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.258+0000 7fbf9d53d700 1 --2- 172.21.15.149:0/3781963947 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf9806ab80 0x7fbf98150a60 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fbf880090b0 tx=0x7fbf88004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:42.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.258+0000 7fbf8dffb700 1 -- 172.21.15.149:0/3781963947 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf88011630 con 0x7fbf9806ab80 2023-11-08T19:26:42.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.258+0000 7fbf8dffb700 1 -- 172.21.15.149:0/3781963947 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf8801e070 con 0x7fbf9806ab80 2023-11-08T19:26:42.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.258+0000 7fbf8dffb700 1 -- 172.21.15.149:0/3781963947 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf880119b0 con 0x7fbf9806ab80 2023-11-08T19:26:42.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.258+0000 7fbf9f7a1700 1 -- 172.21.15.149:0/3781963947 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf980b3ec0 con 0x7fbf9806ab80 2023-11-08T19:26:42.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.258+0000 7fbf9f7a1700 1 -- 172.21.15.149:0/3781963947 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf980b47f0 con 0x7fbf9806ab80 2023-11-08T19:26:42.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.259+0000 7fbf9f7a1700 1 -- 172.21.15.149:0/3781963947 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf980b49e0 con 0x7fbf9806ab80 2023-11-08T19:26:42.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.259+0000 7fbf8dffb700 1 -- 172.21.15.149:0/3781963947 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbf88011b10 con 0x7fbf9806ab80 2023-11-08T19:26:42.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.260+0000 7fbf8dffb700 1 --2- 172.21.15.149:0/3781963947 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fbf7c06af00 0x7fbf7c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:42.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.260+0000 7fbf8dffb700 1 -- 172.21.15.149:0/3781963947 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6354+0+0 (secure 0 0 0) 0x7fbf8808abd0 con 0x7fbf9806ab80 2023-11-08T19:26:42.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.260+0000 7fbf9cd3c700 1 --2- 172.21.15.149:0/3781963947 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fbf7c06af00 0x7fbf7c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:42.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.260+0000 7fbf9cd3c700 1 --2- 172.21.15.149:0/3781963947 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fbf7c06af00 0x7fbf7c06d3c0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fbf9815b4d0 tx=0x7fbf940079f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:42.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.265+0000 7fbf8dffb700 1 -- 172.21.15.149:0/3781963947 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbf88055a80 con 0x7fbf9806ab80 2023-11-08T19:26:42.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.500+0000 7fbf9f7a1700 1 -- 172.21.15.149:0/3781963947 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbf980745f0 con 0x7fbf9806ab80 2023-11-08T19:26:42.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.500+0000 7fbf8dffb700 1 -- 172.21.15.149:0/3781963947 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+3696 (secure 0 0 0) 0x7fbf88020020 con 0x7fbf9806ab80 2023-11-08T19:26:42.502 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:26:42.502 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":48,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5681,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/1946892292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":1946892292},{"type":"v1","addr":"172.21.15.160:6835","nonce":1946892292}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39},{"gid":6145,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/84105573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":84105573},{"type":"v1","addr":"172.21.15.160:6833","nonce":84105573}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39},{"gid":6663,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/3243545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3243545},{"type":"v1","addr":"172.21.15.149:6836","nonce":3243545}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39},{"gid":7023,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/3942557858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3942557858},{"type":"v1","addr":"172.21.15.149:6837","nonce":3942557858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48}],"filesystems":[]} 2023-11-08T19:26:42.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.503+0000 7fbf9f7a1700 1 -- 172.21.15.149:0/3781963947 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fbf7c06af00 msgr2=0x7fbf7c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:42.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.503+0000 7fbf9f7a1700 1 --2- 172.21.15.149:0/3781963947 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fbf7c06af00 0x7fbf7c06d3c0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fbf9815b4d0 tx=0x7fbf940079f0 comp rx=0 tx=0).stop 2023-11-08T19:26:42.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.503+0000 7fbf9f7a1700 1 -- 172.21.15.149:0/3781963947 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf9806ab80 msgr2=0x7fbf98150a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:42.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.503+0000 7fbf9f7a1700 1 --2- 172.21.15.149:0/3781963947 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf9806ab80 0x7fbf98150a60 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fbf880090b0 tx=0x7fbf88004750 comp rx=0 tx=0).stop 2023-11-08T19:26:42.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.503+0000 7fbf9f7a1700 1 -- 172.21.15.149:0/3781963947 shutdown_connections 2023-11-08T19:26:42.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.503+0000 7fbf9f7a1700 1 --2- 172.21.15.149:0/3781963947 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fbf7c06af00 0x7fbf7c06d3c0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:42.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.503+0000 7fbf9f7a1700 1 --2- 172.21.15.149:0/3781963947 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbf9815db70 0x7fbf98160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:42.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.503+0000 7fbf9f7a1700 1 --2- 172.21.15.149:0/3781963947 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf9806ab80 0x7fbf98150a60 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:42.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.503+0000 7fbf9f7a1700 1 --2- 172.21.15.149:0/3781963947 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbf980b2c00 0x7fbf980b3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:42.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.503+0000 7fbf9f7a1700 1 -- 172.21.15.149:0/3781963947 >> 172.21.15.149:0/3781963947 conn(0x7fbf980ccff0 msgr2=0x7fbf9815be70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:42.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.503+0000 7fbf9f7a1700 1 -- 172.21.15.149:0/3781963947 shutdown_connections 2023-11-08T19:26:42.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.503+0000 7fbf9f7a1700 1 -- 172.21.15.149:0/3781963947 wait complete. 2023-11-08T19:26:42.507 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 48 2023-11-08T19:26:42.516 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-08T19:26:42.517 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-08T19:26:42.517 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-08T19:26:42.517 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T19:26:42.517 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-08T19:26:42.518 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-08T19:26:42.518 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-08T19:26:42.518 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T19:26:42.519 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-08T19:26:42.519 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-08T19:26:42.519 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-08T19:26:42.519 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T19:26:42.520 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-08T19:26:42.520 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-08T19:26:42.520 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-08T19:26:42.520 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T19:26:42.526 INFO:tasks.ceph.mds.a:Stopped 2023-11-08T19:26:42.527 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-08T19:26:42.528 INFO:tasks.ceph.mds.c:Stopped 2023-11-08T19:26:42.528 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-08T19:26:42.531 INFO:tasks.ceph.mds.b:Stopped 2023-11-08T19:26:42.531 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-08T19:26:42.532 INFO:tasks.ceph.mds.d:Stopped 2023-11-08T19:26:42.532 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-08T19:26:42.569 INFO:tasks.ceph.mds.a:Started 2023-11-08T19:26:42.570 DEBUG:teuthology.parallel:result is None 2023-11-08T19:26:42.571 INFO:tasks.ceph.mds.c:Started 2023-11-08T19:26:42.571 DEBUG:teuthology.parallel:result is None 2023-11-08T19:26:42.573 INFO:tasks.ceph.mds.b:Started 2023-11-08T19:26:42.573 DEBUG:teuthology.parallel:result is None 2023-11-08T19:26:42.574 INFO:tasks.ceph.mds.d:Started 2023-11-08T19:26:42.574 DEBUG:teuthology.parallel:result is None 2023-11-08T19:26:42.575 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-08T19:26:42.650 INFO:tasks.ceph.mds.a.smithi149.stdout:starting mds.a at 2023-11-08T19:26:42.650 INFO:tasks.ceph.mds.c.smithi149.stdout:starting mds.c at 2023-11-08T19:26:42.658 INFO:tasks.ceph.mds.d.smithi160.stdout:starting mds.d at 2023-11-08T19:26:42.659 INFO:tasks.ceph.mds.b.smithi160.stdout:starting mds.b at 2023-11-08T19:26:42.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.703+0000 7f4d22de9700 1 Processor -- start 2023-11-08T19:26:42.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.703+0000 7f4d22de9700 1 -- start start 2023-11-08T19:26:42.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.704+0000 7f4d22de9700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f4d1c0b16b0 0x7f4d1c0ce380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:42.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.704+0000 7f4d22de9700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4d1c0b20b0 0x7f4d1c0b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:42.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.704+0000 7f4d22de9700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d1c0d1330 con 0x7f4d1c0afb30 2023-11-08T19:26:42.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.704+0000 7f4d22de9700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d1c0b2aa0 con 0x7f4d1c0b16b0 2023-11-08T19:26:42.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.704+0000 7f4d22de9700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1c0cb490 con 0x7f4d1c0b20b0 2023-11-08T19:26:42.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.704+0000 7f4d1bfff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f4d1c0b16b0 0x7f4d1c0ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:42.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.704+0000 7f4d20b85700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f4d1c0afb30 0x7f4d1c0cbf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:45232/0 (socket says 172.21.15.149:45232) 2023-11-08T19:26:42.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.704+0000 7f4d1bfff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f4d1c0b16b0 0x7f4d1c0ce380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43232/0 (socket says 172.21.15.149:43232) 2023-11-08T19:26:42.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.704+0000 7f4d20b85700 1 -- 172.21.15.149:0/3211794603 learned_addr learned my addr 172.21.15.149:0/3211794603 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:26:42.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.704+0000 7f4d21386700 1 --2- 172.21.15.149:0/3211794603 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4d1c0b20b0 0x7f4d1c0b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:42.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.704+0000 7f4d1bfff700 1 -- 172.21.15.149:0/3211794603 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4d1c0b20b0 msgr2=0x7f4d1c0b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:42.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.704+0000 7f4d1bfff700 1 --2- 172.21.15.149:0/3211794603 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4d1c0b20b0 0x7f4d1c0b2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:42.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.704+0000 7f4d1bfff700 1 -- 172.21.15.149:0/3211794603 >> v1:172.21.15.149:6789/0 conn(0x7f4d1c0afb30 legacy=0x7f4d1c0cbf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:42.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.705+0000 7f4d1bfff700 1 -- 172.21.15.149:0/3211794603 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d1c0cb770 con 0x7f4d1c0b16b0 2023-11-08T19:26:42.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.705+0000 7f4d1b7fe700 1 -- 172.21.15.149:0/3211794603 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3461155147 0 0) 0x7f4d1c0d1330 con 0x7f4d1c0afb30 2023-11-08T19:26:42.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.705+0000 7f4d1bfff700 1 --2- 172.21.15.149:0/3211794603 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d1c0b16b0 0x7f4d1c0ce380 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f4d04009840 tx=0x7f4d04009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18b670d9807c465f server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:42.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.705+0000 7f4d1b7fe700 1 -- 172.21.15.149:0/3211794603 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d04011830 con 0x7f4d1c0b16b0 2023-11-08T19:26:42.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.705+0000 7f4d1b7fe700 1 -- 172.21.15.149:0/3211794603 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d04011990 con 0x7f4d1c0b16b0 2023-11-08T19:26:42.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.705+0000 7f4d1b7fe700 1 -- 172.21.15.149:0/3211794603 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d04011d20 con 0x7f4d1c0b16b0 2023-11-08T19:26:42.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.705+0000 7f4d22de9700 1 -- 172.21.15.149:0/3211794603 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d1c0b16b0 msgr2=0x7f4d1c0ce380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:42.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.705+0000 7f4d22de9700 1 --2- 172.21.15.149:0/3211794603 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d1c0b16b0 0x7f4d1c0ce380 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f4d04009840 tx=0x7f4d04009b50 comp rx=0 tx=0).stop 2023-11-08T19:26:42.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.705+0000 7f4d22de9700 1 -- 172.21.15.149:0/3211794603 shutdown_connections 2023-11-08T19:26:42.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.705+0000 7f4d22de9700 1 --2- 172.21.15.149:0/3211794603 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4d1c0b20b0 0x7f4d1c0b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:42.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.705+0000 7f4d22de9700 1 --2- 172.21.15.149:0/3211794603 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d1c0b16b0 0x7f4d1c0ce380 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:42.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.705+0000 7f4d22de9700 1 -- 172.21.15.149:0/3211794603 >> 172.21.15.149:0/3211794603 conn(0x7f4d1c099a40 msgr2=0x7f4d1c0d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:42.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.705+0000 7f4d22de9700 1 -- 172.21.15.149:0/3211794603 shutdown_connections 2023-11-08T19:26:42.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.705+0000 7f4d22de9700 1 -- 172.21.15.149:0/3211794603 wait complete. 2023-11-08T19:26:42.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.707+0000 7f4d22de9700 1 Processor -- start 2023-11-08T19:26:42.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.707+0000 7f4d22de9700 1 -- start start 2023-11-08T19:26:42.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.708+0000 7f4d22de9700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4d1c0afb30 0x7f4d1c1efc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:42.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.708+0000 7f4d22de9700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4d1c0b16b0 0x7f4d1c0b3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:42.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.708+0000 7f4d22de9700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d1c0b20b0 0x7f4d1c15c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:42.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.708+0000 7f4d22de9700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1c0b4970 con 0x7f4d1c0b20b0 2023-11-08T19:26:42.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.708+0000 7f4d22de9700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1c0b4690 con 0x7f4d1c0afb30 2023-11-08T19:26:42.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.708+0000 7f4d22de9700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1c0c77f0 con 0x7f4d1c0b16b0 2023-11-08T19:26:42.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.708+0000 7f4d21386700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d1c0b20b0 0x7f4d1c15c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:42.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.708+0000 7f4d21386700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d1c0b20b0 0x7f4d1c15c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43238/0 (socket says 172.21.15.149:43238) 2023-11-08T19:26:42.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.708+0000 7f4d21386700 1 -- 172.21.15.149:0/3724592800 learned_addr learned my addr 172.21.15.149:0/3724592800 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:42.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.708+0000 7f4d1bfff700 1 --2- 172.21.15.149:0/3724592800 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4d1c0b16b0 0x7f4d1c0b3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:42.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.708+0000 7f4d20b85700 1 --2- 172.21.15.149:0/3724592800 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4d1c0afb30 0x7f4d1c1efc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:42.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.708+0000 7f4d21386700 1 -- 172.21.15.149:0/3724592800 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4d1c0b16b0 msgr2=0x7f4d1c0b3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:42.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.708+0000 7f4d21386700 1 --2- 172.21.15.149:0/3724592800 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4d1c0b16b0 0x7f4d1c0b3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:42.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.708+0000 7f4d21386700 1 -- 172.21.15.149:0/3724592800 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4d1c0afb30 msgr2=0x7f4d1c1efc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:42.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.708+0000 7f4d21386700 1 --2- 172.21.15.149:0/3724592800 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4d1c0afb30 0x7f4d1c1efc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:42.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.709+0000 7f4d21386700 1 -- 172.21.15.149:0/3724592800 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d040094a0 con 0x7f4d1c0b20b0 2023-11-08T19:26:42.719 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.709+0000 7f4d21386700 1 --2- 172.21.15.149:0/3724592800 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d1c0b20b0 0x7f4d1c15c1d0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c00e7d0 tx=0x7f4d0c00eae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:42.719 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.709+0000 7f4d197fa700 1 -- 172.21.15.149:0/3724592800 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c0095b0 con 0x7f4d1c0b20b0 2023-11-08T19:26:42.719 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.709+0000 7f4d197fa700 1 -- 172.21.15.149:0/3724592800 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d0c013680 con 0x7f4d1c0b20b0 2023-11-08T19:26:42.719 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.709+0000 7f4d22de9700 1 -- 172.21.15.149:0/3724592800 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d1c0c7ad0 con 0x7f4d1c0b20b0 2023-11-08T19:26:42.719 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.709+0000 7f4d197fa700 1 -- 172.21.15.149:0/3724592800 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c013a10 con 0x7f4d1c0b20b0 2023-11-08T19:26:42.720 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.709+0000 7f4d22de9700 1 -- 172.21.15.149:0/3724592800 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d1c1f1350 con 0x7f4d1c0b20b0 2023-11-08T19:26:42.720 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.710+0000 7f4d22de9700 1 -- 172.21.15.149:0/3724592800 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d1c0c7ff0 con 0x7f4d1c0b20b0 2023-11-08T19:26:42.720 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.710+0000 7f4d197fa700 1 -- 172.21.15.149:0/3724592800 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4d0c013b70 con 0x7f4d1c0b20b0 2023-11-08T19:26:42.720 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.711+0000 7f4d197fa700 1 --2- 172.21.15.149:0/3724592800 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4cfc06af00 0x7f4cfc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:42.720 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.711+0000 7f4d197fa700 1 -- 172.21.15.149:0/3724592800 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6354+0+0 (secure 0 0 0) 0x7f4d0c089670 con 0x7f4d1c0b20b0 2023-11-08T19:26:42.721 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.711+0000 7f4d20b85700 1 --2- 172.21.15.149:0/3724592800 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4cfc06af00 0x7f4cfc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:42.721 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.711+0000 7f4d20b85700 1 --2- 172.21.15.149:0/3724592800 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4cfc06af00 0x7f4cfc06d3c0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f4d14007fd0 tx=0x7f4d14009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:42.721 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.715+0000 7f4d197fa700 1 -- 172.21.15.149:0/3724592800 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4d1c0c7ff0 con 0x7f4d1c0b20b0 2023-11-08T19:26:42.923 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:42.922+0000 7f4d22de9700 1 -- 172.21.15.149:0/3724592800 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f4d1c0c7ff0 con 0x7f4d1c0b20b0 2023-11-08T19:26:43.926 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:43.925+0000 7f4d197fa700 1 -- 172.21.15.149:0/3724592800 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v92) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4d1c0c7ff0 con 0x7f4d1c0b20b0 2023-11-08T19:26:43.929 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:43.928+0000 7f4d22de9700 1 -- 172.21.15.149:0/3724592800 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4cfc06af00 msgr2=0x7f4cfc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:43.929 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:43.928+0000 7f4d22de9700 1 --2- 172.21.15.149:0/3724592800 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4cfc06af00 0x7f4cfc06d3c0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f4d14007fd0 tx=0x7f4d14009040 comp rx=0 tx=0).stop 2023-11-08T19:26:43.929 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:43.928+0000 7f4d22de9700 1 -- 172.21.15.149:0/3724592800 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d1c0b20b0 msgr2=0x7f4d1c15c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:43.930 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:43.928+0000 7f4d22de9700 1 --2- 172.21.15.149:0/3724592800 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d1c0b20b0 0x7f4d1c15c1d0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c00e7d0 tx=0x7f4d0c00eae0 comp rx=0 tx=0).stop 2023-11-08T19:26:43.930 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:43.928+0000 7f4d22de9700 1 -- 172.21.15.149:0/3724592800 shutdown_connections 2023-11-08T19:26:43.930 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:43.928+0000 7f4d22de9700 1 --2- 172.21.15.149:0/3724592800 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4cfc06af00 0x7f4cfc06d3c0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:43.930 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:43.928+0000 7f4d22de9700 1 --2- 172.21.15.149:0/3724592800 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4d1c0afb30 0x7f4d1c1efc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:43.931 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:43.928+0000 7f4d22de9700 1 --2- 172.21.15.149:0/3724592800 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d1c0b20b0 0x7f4d1c15c1d0 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:43.931 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:43.928+0000 7f4d22de9700 1 --2- 172.21.15.149:0/3724592800 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4d1c0b16b0 0x7f4d1c0b3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:43.931 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:43.928+0000 7f4d22de9700 1 -- 172.21.15.149:0/3724592800 >> 172.21.15.149:0/3724592800 conn(0x7f4d1c099a40 msgr2=0x7f4d1c0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:43.931 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:43.928+0000 7f4d22de9700 1 -- 172.21.15.149:0/3724592800 shutdown_connections 2023-11-08T19:26:43.932 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:43.928+0000 7f4d22de9700 1 -- 172.21.15.149:0/3724592800 wait complete. 2023-11-08T19:26:43.932 INFO:teuthology.orchestra.run.smithi149.stderr: removed all blocklist entries 2023-11-08T19:26:43.944 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-08T19:26:44.071 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.066+0000 7f4a308d1700 1 Processor -- start 2023-11-08T19:26:44.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.066+0000 7f4a308d1700 1 -- start start 2023-11-08T19:26:44.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.067+0000 7f4a308d1700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f4a2c15df40 0x7f4a2c0ce140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:44.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.067+0000 7f4a308d1700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f4a2c0d2250 0x7f4a2c0ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:44.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.067+0000 7f4a308d1700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a2c0d04f0 con 0x7f4a2c0b2b60 2023-11-08T19:26:44.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.067+0000 7f4a308d1700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a2c0cbeb0 con 0x7f4a2c15df40 2023-11-08T19:26:44.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.067+0000 7f4a308d1700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a2c0d0740 con 0x7f4a2c0d2250 2023-11-08T19:26:44.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.067+0000 7f4a2a59c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f4a2c15df40 0x7f4a2c0ce140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:44.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.067+0000 7f4a29d9b700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f4a2c0b2b60 0x7f4a2c06bfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:45250/0 (socket says 172.21.15.149:45250) 2023-11-08T19:26:44.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.067+0000 7f4a29d9b700 1 -- 172.21.15.149:0/11400482 learned_addr learned my addr 172.21.15.149:0/11400482 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:26:44.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.067+0000 7f4a2ad9d700 1 --2- 172.21.15.149:0/11400482 >> v2:172.21.15.160:3300/0 conn(0x7f4a2c0d2250 0x7f4a2c0ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:44.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.068+0000 7f4a2a59c700 1 -- 172.21.15.149:0/11400482 >> v2:172.21.15.160:3300/0 conn(0x7f4a2c0d2250 msgr2=0x7f4a2c0ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:44.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.068+0000 7f4a2a59c700 1 --2- 172.21.15.149:0/11400482 >> v2:172.21.15.160:3300/0 conn(0x7f4a2c0d2250 0x7f4a2c0ce680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:44.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.068+0000 7f4a2959a700 1 -- 172.21.15.149:0/11400482 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2034185743 0 0) 0x7f4a2c0d04f0 con 0x7f4a2c0b2b60 2023-11-08T19:26:44.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.068+0000 7f4a2a59c700 1 -- 172.21.15.149:0/11400482 >> v1:172.21.15.149:6789/0 conn(0x7f4a2c0b2b60 legacy=0x7f4a2c06bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:44.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.068+0000 7f4a2a59c700 1 -- 172.21.15.149:0/11400482 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a2c0d0a20 con 0x7f4a2c15df40 2023-11-08T19:26:44.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.068+0000 7f4a2a59c700 1 --2- 172.21.15.149:0/11400482 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a2c15df40 0x7f4a2c0ce140 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c0cf200 tx=0x7f4a20009b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=963a0d48a1965618 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:44.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.068+0000 7f4a2959a700 1 -- 172.21.15.149:0/11400482 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a20005e30 con 0x7f4a2c15df40 2023-11-08T19:26:44.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.068+0000 7f4a2959a700 1 -- 172.21.15.149:0/11400482 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a20006030 con 0x7f4a2c15df40 2023-11-08T19:26:44.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.068+0000 7f4a2959a700 1 -- 172.21.15.149:0/11400482 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a200063c0 con 0x7f4a2c15df40 2023-11-08T19:26:44.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.068+0000 7f4a308d1700 1 -- 172.21.15.149:0/11400482 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a2c15df40 msgr2=0x7f4a2c0ce140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:44.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.068+0000 7f4a308d1700 1 --2- 172.21.15.149:0/11400482 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a2c15df40 0x7f4a2c0ce140 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c0cf200 tx=0x7f4a20009b00 comp rx=0 tx=0).stop 2023-11-08T19:26:44.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.069+0000 7f4a308d1700 1 -- 172.21.15.149:0/11400482 shutdown_connections 2023-11-08T19:26:44.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.069+0000 7f4a308d1700 1 --2- 172.21.15.149:0/11400482 >> v2:172.21.15.160:3300/0 conn(0x7f4a2c0d2250 0x7f4a2c0ce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:44.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.069+0000 7f4a308d1700 1 --2- 172.21.15.149:0/11400482 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a2c15df40 0x7f4a2c0ce140 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:44.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.069+0000 7f4a308d1700 1 -- 172.21.15.149:0/11400482 >> 172.21.15.149:0/11400482 conn(0x7f4a2c0d1730 msgr2=0x7f4a2c0d1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:44.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.069+0000 7f4a308d1700 1 -- 172.21.15.149:0/11400482 shutdown_connections 2023-11-08T19:26:44.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.069+0000 7f4a308d1700 1 -- 172.21.15.149:0/11400482 wait complete. 2023-11-08T19:26:44.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.070+0000 7f4a308d1700 1 Processor -- start 2023-11-08T19:26:44.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.070+0000 7f4a308d1700 1 -- start start 2023-11-08T19:26:44.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.071+0000 7f4a308d1700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4a2c0b2b60 0x7f4a2c0b6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:44.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.071+0000 7f4a308d1700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4a2c0d2250 0x7f4a2c1f6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:44.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.071+0000 7f4a308d1700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a2c15df40 0x7f4a2c1f6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:44.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.071+0000 7f4a308d1700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2c0b7070 con 0x7f4a2c15df40 2023-11-08T19:26:44.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.071+0000 7f4a308d1700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2c15bcb0 con 0x7f4a2c0d2250 2023-11-08T19:26:44.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.071+0000 7f4a308d1700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2c15bf90 con 0x7f4a2c0b2b60 2023-11-08T19:26:44.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.071+0000 7f4a2a59c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4a2c0b2b60 0x7f4a2c0b6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:44.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.071+0000 7f4a2a59c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4a2c0b2b60 0x7f4a2c0b6b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.149:35310/0 (socket says 172.21.15.149:35310) 2023-11-08T19:26:44.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.071+0000 7f4a2ad9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a2c15df40 0x7f4a2c1f6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:44.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.071+0000 7f4a2a59c700 1 -- 172.21.15.149:0/1366811025 learned_addr learned my addr 172.21.15.149:0/1366811025 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:44.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.071+0000 7f4a29d9b700 1 --2- 172.21.15.149:0/1366811025 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4a2c0d2250 0x7f4a2c1f6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:44.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.071+0000 7f4a2ad9d700 1 -- 172.21.15.149:0/1366811025 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4a2c0b2b60 msgr2=0x7f4a2c0b6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:44.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.071+0000 7f4a2ad9d700 1 --2- 172.21.15.149:0/1366811025 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4a2c0b2b60 0x7f4a2c0b6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:44.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.071+0000 7f4a2ad9d700 1 -- 172.21.15.149:0/1366811025 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4a2c0d2250 msgr2=0x7f4a2c1f6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:44.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.071+0000 7f4a2ad9d700 1 --2- 172.21.15.149:0/1366811025 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4a2c0d2250 0x7f4a2c1f6850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:44.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.072+0000 7f4a2ad9d700 1 -- 172.21.15.149:0/1366811025 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a20009430 con 0x7f4a2c15df40 2023-11-08T19:26:44.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.072+0000 7f4a29d9b700 1 --2- 172.21.15.149:0/1366811025 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4a2c0d2250 0x7f4a2c1f6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:26:44.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.072+0000 7f4a2ad9d700 1 --2- 172.21.15.149:0/1366811025 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a2c15df40 0x7f4a2c1f6d90 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f4a2400ef90 tx=0x7f4a2400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:44.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.072+0000 7f4a1affd700 1 -- 172.21.15.149:0/1366811025 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2400cd40 con 0x7f4a2c15df40 2023-11-08T19:26:44.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.072+0000 7f4a1affd700 1 -- 172.21.15.149:0/1366811025 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a2400f040 con 0x7f4a2c15df40 2023-11-08T19:26:44.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.072+0000 7f4a308d1700 1 -- 172.21.15.149:0/1366811025 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a2c15e4a0 con 0x7f4a2c15df40 2023-11-08T19:26:44.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.072+0000 7f4a308d1700 1 -- 172.21.15.149:0/1366811025 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a2c15c550 con 0x7f4a2c15df40 2023-11-08T19:26:44.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.073+0000 7f4a1affd700 1 -- 172.21.15.149:0/1366811025 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a240146c0 con 0x7f4a2c15df40 2023-11-08T19:26:44.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.073+0000 7f4a308d1700 1 -- 172.21.15.149:0/1366811025 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a2c067560 con 0x7f4a2c15df40 2023-11-08T19:26:44.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.075+0000 7f4a1affd700 1 -- 172.21.15.149:0/1366811025 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4a24014820 con 0x7f4a2c15df40 2023-11-08T19:26:44.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.075+0000 7f4a1affd700 1 --2- 172.21.15.149:0/1366811025 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4a0c06af00 0x7f4a0c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:44.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.076+0000 7f4a1affd700 1 -- 172.21.15.149:0/1366811025 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6268+0+0 (secure 0 0 0) 0x7f4a2408a870 con 0x7f4a2c15df40 2023-11-08T19:26:44.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.076+0000 7f4a2a59c700 1 --2- 172.21.15.149:0/1366811025 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4a0c06af00 0x7f4a0c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:44.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.076+0000 7f4a2a59c700 1 --2- 172.21.15.149:0/1366811025 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4a0c06af00 0x7f4a0c06d3c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f4a20007fd0 tx=0x7f4a20008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:44.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.079+0000 7f4a1affd700 1 -- 172.21.15.149:0/1366811025 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4a240557d0 con 0x7f4a2c15df40 2023-11-08T19:26:44.347 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.346+0000 7f4a308d1700 1 -- 172.21.15.149:0/1366811025 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f4a2c0745f0 con 0x7f4a2c15df40 2023-11-08T19:26:44.348 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.346+0000 7f4a1affd700 1 -- 172.21.15.149:0/1366811025 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f4a24009e60 con 0x7f4a2c15df40 2023-11-08T19:26:44.348 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:26:44.348 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2023-11-08T19:26:44.348 INFO:teuthology.orchestra.run.smithi149.stdout: "auth_dump": [ 2023-11-08T19:26:44.349 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:26:44.349 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "mds.a", 2023-11-08T19:26:44.349 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDi30tlcD8lHxAAxmvMr1hdJWLyJ0wOQhILow==", 2023-11-08T19:26:44.349 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:26:44.349 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow", 2023-11-08T19:26:44.350 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow *", 2023-11-08T19:26:44.350 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow *", 2023-11-08T19:26:44.350 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:26:44.350 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:26:44.350 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:26:44.351 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:26:44.351 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "mds.b", 2023-11-08T19:26:44.351 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDi30tl0d56KxAA42ebu7JWPHSW2Y+aUT9G8Q==", 2023-11-08T19:26:44.351 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:26:44.351 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow", 2023-11-08T19:26:44.352 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow *", 2023-11-08T19:26:44.352 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow *", 2023-11-08T19:26:44.352 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:26:44.352 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:26:44.352 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:26:44.353 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:26:44.353 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "mds.c", 2023-11-08T19:26:44.353 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDi30tl+SliJhAAznNm6dtyajBE0T8WKqdhhw==", 2023-11-08T19:26:44.353 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:26:44.353 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow", 2023-11-08T19:26:44.354 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow *", 2023-11-08T19:26:44.354 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow *", 2023-11-08T19:26:44.354 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:26:44.354 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:26:44.354 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:26:44.355 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:26:44.355 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "mds.d", 2023-11-08T19:26:44.355 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDi30tl9sLWMhAACaIzwVjIgVky9P6tAK9/rw==", 2023-11-08T19:26:44.355 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:26:44.355 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow", 2023-11-08T19:26:44.356 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow *", 2023-11-08T19:26:44.356 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow *", 2023-11-08T19:26:44.356 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:26:44.356 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:26:44.356 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:26:44.357 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:26:44.357 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "osd.0", 2023-11-08T19:26:44.357 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDm30tl1SLuEBAA8gYyfPfXV+rd7sXTr5NytA==", 2023-11-08T19:26:44.357 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:26:44.357 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow profile osd", 2023-11-08T19:26:44.357 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile osd", 2023-11-08T19:26:44.358 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:26:44.358 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:26:44.358 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:26:44.358 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:26:44.358 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "osd.1", 2023-11-08T19:26:44.359 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDp30tllvSCEBAAgyXiQm+ld9zVjv2Uo2UilA==", 2023-11-08T19:26:44.359 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:26:44.359 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow profile osd", 2023-11-08T19:26:44.360 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile osd", 2023-11-08T19:26:44.360 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:26:44.360 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:26:44.360 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:26:44.360 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:26:44.361 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "osd.2", 2023-11-08T19:26:44.361 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDs30tlGvZ9DxAAzOPbDXlbk+oxHvXhNfPnNQ==", 2023-11-08T19:26:44.361 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:26:44.361 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow profile osd", 2023-11-08T19:26:44.361 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile osd", 2023-11-08T19:26:44.361 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:26:44.362 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:26:44.362 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:26:44.362 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:26:44.362 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "osd.3", 2023-11-08T19:26:44.363 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDv30tlg0i3DhAAKEy9WQ+VBcJMuKALuYVTEg==", 2023-11-08T19:26:44.363 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:26:44.363 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow profile osd", 2023-11-08T19:26:44.363 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile osd", 2023-11-08T19:26:44.363 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:26:44.364 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:26:44.364 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:26:44.364 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:26:44.364 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "osd.4", 2023-11-08T19:26:44.364 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQD130tlrd3gFRAA0IM+0Dr48SgjXRHcCzypfg==", 2023-11-08T19:26:44.365 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:26:44.365 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow profile osd", 2023-11-08T19:26:44.365 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile osd", 2023-11-08T19:26:44.365 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:26:44.365 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:26:44.366 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:26:44.366 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:26:44.366 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "osd.5", 2023-11-08T19:26:44.366 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQD430tlCMCRFRAAJwP6E9TRRNneQzL7TVU6jg==", 2023-11-08T19:26:44.366 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:26:44.367 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow profile osd", 2023-11-08T19:26:44.367 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile osd", 2023-11-08T19:26:44.367 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:26:44.367 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:26:44.367 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:26:44.368 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:26:44.368 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "osd.6", 2023-11-08T19:26:44.368 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQD730tl176/FBAADjNAIKgdn3bIRlN725KW7g==", 2023-11-08T19:26:44.368 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:26:44.368 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow profile osd", 2023-11-08T19:26:44.368 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile osd", 2023-11-08T19:26:44.369 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:26:44.369 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:26:44.369 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:26:44.369 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:26:44.369 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "osd.7", 2023-11-08T19:26:44.370 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQD+30tl6CCxFBAAcProM9OqTGE6LtReNxvljA==", 2023-11-08T19:26:44.370 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:26:44.370 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow profile osd", 2023-11-08T19:26:44.370 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile osd", 2023-11-08T19:26:44.370 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:26:44.371 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:26:44.371 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:26:44.371 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:26:44.371 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "client.0", 2023-11-08T19:26:44.372 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDi30tlQEEsNxAAiPozrOREh+IJXoj7ZkhvLg==", 2023-11-08T19:26:44.372 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:26:44.372 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow", 2023-11-08T19:26:44.372 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow r", 2023-11-08T19:26:44.372 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-08T19:26:44.373 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:26:44.373 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:26:44.373 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:26:44.373 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "client.1", 2023-11-08T19:26:44.373 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDj30tluO08AhAAKiNHfc6ETU6HU+0PSkRTdg==", 2023-11-08T19:26:44.374 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:26:44.374 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow", 2023-11-08T19:26:44.374 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow r", 2023-11-08T19:26:44.374 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow rw", 2023-11-08T19:26:44.374 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow rwx" 2023-11-08T19:26:44.375 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:26:44.375 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:26:44.375 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:26:44.375 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "client.2", 2023-11-08T19:26:44.375 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDi30tlZfZ+OhAAak0bEZA4XzCWwYINh0SvGQ==", 2023-11-08T19:26:44.376 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:26:44.376 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow", 2023-11-08T19:26:44.376 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow r", 2023-11-08T19:26:44.376 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow rw", 2023-11-08T19:26:44.376 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow rwx" 2023-11-08T19:26:44.377 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:26:44.377 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:26:44.377 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:26:44.377 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "client.3", 2023-11-08T19:26:44.377 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDj30tlLMAICBAAApxzbDjmCxzR32Puyeov6A==", 2023-11-08T19:26:44.377 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:26:44.378 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow", 2023-11-08T19:26:44.378 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow r", 2023-11-08T19:26:44.378 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow rw", 2023-11-08T19:26:44.378 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow rwx" 2023-11-08T19:26:44.378 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:26:44.379 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:26:44.379 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:26:44.379 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "client.admin", 2023-11-08T19:26:44.379 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDi30tltpwRARAAZZQDTm7CIC4J4HH6G378+w==", 2023-11-08T19:26:44.379 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:26:44.380 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow *", 2023-11-08T19:26:44.380 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow *", 2023-11-08T19:26:44.380 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow *", 2023-11-08T19:26:44.380 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:26:44.380 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:26:44.380 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:26:44.381 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:26:44.381 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "mgr.x", 2023-11-08T19:26:44.381 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDi30tluyy2GxAATC2v0iOLVbRrea6w+2Cy8g==", 2023-11-08T19:26:44.381 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:26:44.381 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow *", 2023-11-08T19:26:44.382 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile mgr", 2023-11-08T19:26:44.382 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:26:44.382 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:26:44.382 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:26:44.382 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:26:44.383 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "mgr.y", 2023-11-08T19:26:44.383 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQDi30tlxwfmFhAAfauMRZmdBm6TQXw07oVQJw==", 2023-11-08T19:26:44.383 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-11-08T19:26:44.383 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow *", 2023-11-08T19:26:44.383 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile mgr", 2023-11-08T19:26:44.384 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-11-08T19:26:44.384 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:26:44.384 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:26:44.384 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2023-11-08T19:26:44.384 INFO:teuthology.orchestra.run.smithi149.stdout:} 2023-11-08T19:26:44.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.348+0000 7f4a308d1700 1 -- 172.21.15.149:0/1366811025 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4a0c06af00 msgr2=0x7f4a0c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:44.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.348+0000 7f4a308d1700 1 --2- 172.21.15.149:0/1366811025 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4a0c06af00 0x7f4a0c06d3c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f4a20007fd0 tx=0x7f4a20008070 comp rx=0 tx=0).stop 2023-11-08T19:26:44.387 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.348+0000 7f4a308d1700 1 -- 172.21.15.149:0/1366811025 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a2c15df40 msgr2=0x7f4a2c1f6d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:44.387 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.348+0000 7f4a308d1700 1 --2- 172.21.15.149:0/1366811025 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a2c15df40 0x7f4a2c1f6d90 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f4a2400ef90 tx=0x7f4a2400c3a0 comp rx=0 tx=0).stop 2023-11-08T19:26:44.387 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.349+0000 7f4a308d1700 1 -- 172.21.15.149:0/1366811025 shutdown_connections 2023-11-08T19:26:44.387 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.349+0000 7f4a308d1700 1 --2- 172.21.15.149:0/1366811025 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4a0c06af00 0x7f4a0c06d3c0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:44.387 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.349+0000 7f4a308d1700 1 --2- 172.21.15.149:0/1366811025 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a2c15df40 0x7f4a2c1f6d90 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:44.388 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.349+0000 7f4a308d1700 1 --2- 172.21.15.149:0/1366811025 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4a2c0b2b60 0x7f4a2c0b6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:44.388 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.349+0000 7f4a308d1700 1 --2- 172.21.15.149:0/1366811025 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4a2c0d2250 0x7f4a2c1f6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:44.388 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.349+0000 7f4a308d1700 1 -- 172.21.15.149:0/1366811025 >> 172.21.15.149:0/1366811025 conn(0x7f4a2c0d1730 msgr2=0x7f4a2c0cc340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:44.388 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.349+0000 7f4a308d1700 1 -- 172.21.15.149:0/1366811025 shutdown_connections 2023-11-08T19:26:44.388 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.349+0000 7f4a308d1700 1 -- 172.21.15.149:0/1366811025 wait complete. 2023-11-08T19:26:44.389 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:26:44.509 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.508+0000 7f49acd88700 1 Processor -- start 2023-11-08T19:26:44.509 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.508+0000 7f49acd88700 1 -- start start 2023-11-08T19:26:44.512 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.509+0000 7f49acd88700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f49a815b950 0x7f49a80ce130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:44.512 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.509+0000 7f49acd88700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f49a80cd5e0 0x7f49a80ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:44.512 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.509+0000 7f49acd88700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f49a80cfd20 0x7f49a80d01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:44.513 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.509+0000 7f49acd88700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49a80cc2e0 con 0x7f49a815b950 2023-11-08T19:26:44.513 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.509+0000 7f49acd88700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49a80cc580 con 0x7f49a80cfd20 2023-11-08T19:26:44.513 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.509+0000 7f49acd88700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49a80cc820 con 0x7f49a80cd5e0 2023-11-08T19:26:44.513 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.509+0000 7f49a659c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f49a815b950 0x7f49a80ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:44.513 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.509+0000 7f49a659c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f49a815b950 0x7f49a80ce130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43262/0 (socket says 172.21.15.149:43262) 2023-11-08T19:26:44.514 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.509+0000 7f49a659c700 1 -- 172.21.15.149:0/763031003 learned_addr learned my addr 172.21.15.149:0/763031003 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:44.514 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.509+0000 7f49a5d9b700 1 --2- 172.21.15.149:0/763031003 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f49a80cd5e0 0x7f49a80ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:44.514 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.509+0000 7f49a6d9d700 1 --2- 172.21.15.149:0/763031003 >> v2:172.21.15.160:3300/0 conn(0x7f49a80cfd20 0x7f49a80d01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:44.514 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.509+0000 7f49a659c700 1 -- 172.21.15.149:0/763031003 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f49a80cd5e0 msgr2=0x7f49a80ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:44.515 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.509+0000 7f49a659c700 1 --2- 172.21.15.149:0/763031003 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f49a80cd5e0 0x7f49a80ce670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:44.515 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.509+0000 7f49a659c700 1 -- 172.21.15.149:0/763031003 >> v2:172.21.15.160:3300/0 conn(0x7f49a80cfd20 msgr2=0x7f49a80d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:44.515 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.509+0000 7f49a659c700 1 --2- 172.21.15.149:0/763031003 >> v2:172.21.15.160:3300/0 conn(0x7f49a80cfd20 0x7f49a80d01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:44.515 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.509+0000 7f49a659c700 1 -- 172.21.15.149:0/763031003 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a80ccb00 con 0x7f49a815b950 2023-11-08T19:26:44.515 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.509+0000 7f49a6d9d700 1 --2- 172.21.15.149:0/763031003 >> v2:172.21.15.160:3300/0 conn(0x7f49a80cfd20 0x7f49a80d01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:26:44.516 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.510+0000 7f49a659c700 1 --2- 172.21.15.149:0/763031003 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49a815b950 0x7f49a80ce130 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f49a808bf60 tx=0x7f499c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eccc07d25afebf61 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:44.516 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.510+0000 7f49a559a700 1 -- 172.21.15.149:0/763031003 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499c005e30 con 0x7f49a815b950 2023-11-08T19:26:44.516 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.510+0000 7f49a559a700 1 -- 172.21.15.149:0/763031003 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f499c004030 con 0x7f49a815b950 2023-11-08T19:26:44.516 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.510+0000 7f49a559a700 1 -- 172.21.15.149:0/763031003 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499c0043e0 con 0x7f49a815b950 2023-11-08T19:26:44.516 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.510+0000 7f49acd88700 1 -- 172.21.15.149:0/763031003 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49a815b950 msgr2=0x7f49a80ce130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:44.517 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.510+0000 7f49acd88700 1 --2- 172.21.15.149:0/763031003 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49a815b950 0x7f49a80ce130 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f49a808bf60 tx=0x7f499c009bd0 comp rx=0 tx=0).stop 2023-11-08T19:26:44.517 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.510+0000 7f49acd88700 1 -- 172.21.15.149:0/763031003 shutdown_connections 2023-11-08T19:26:44.517 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.510+0000 7f49acd88700 1 --2- 172.21.15.149:0/763031003 >> v2:172.21.15.160:3300/0 conn(0x7f49a80cfd20 0x7f49a80d01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:44.517 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.510+0000 7f49acd88700 1 --2- 172.21.15.149:0/763031003 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49a815b950 0x7f49a80ce130 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:44.518 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.510+0000 7f49acd88700 1 --2- 172.21.15.149:0/763031003 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f49a80cd5e0 0x7f49a80ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:44.518 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.510+0000 7f49acd88700 1 -- 172.21.15.149:0/763031003 >> 172.21.15.149:0/763031003 conn(0x7f49a808afd0 msgr2=0x7f49a80d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:44.518 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.510+0000 7f49acd88700 1 -- 172.21.15.149:0/763031003 shutdown_connections 2023-11-08T19:26:44.518 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.511+0000 7f49acd88700 1 -- 172.21.15.149:0/763031003 wait complete. 2023-11-08T19:26:44.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.512+0000 7f49acd88700 1 Processor -- start 2023-11-08T19:26:44.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.512+0000 7f49acd88700 1 -- start start 2023-11-08T19:26:44.522 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.513+0000 7f49acd88700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49a80cfd20 0x7f49a80cae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:44.522 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.513+0000 7f49acd88700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f49a815b950 0x7f49a80c7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:44.522 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.513+0000 7f49acd88700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49a81f47a0 0x7f49a81f4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:44.522 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.513+0000 7f49acd88700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a81f5170 con 0x7f49a80cfd20 2023-11-08T19:26:44.522 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.513+0000 7f49acd88700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a814ea10 con 0x7f49a81f47a0 2023-11-08T19:26:44.523 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.513+0000 7f49acd88700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49a80c83b0 con 0x7f49a815b950 2023-11-08T19:26:44.523 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.513+0000 7f49a659c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49a80cfd20 0x7f49a80cae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:44.523 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.513+0000 7f49a659c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49a80cfd20 0x7f49a80cae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43268/0 (socket says 172.21.15.149:43268) 2023-11-08T19:26:44.523 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.513+0000 7f49a659c700 1 -- 172.21.15.149:0/2766259288 learned_addr learned my addr 172.21.15.149:0/2766259288 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:44.523 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.513+0000 7f49a5d9b700 1 --2- 172.21.15.149:0/2766259288 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f49a815b950 0x7f49a80c7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:44.524 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.514+0000 7f49a6d9d700 1 --2- 172.21.15.149:0/2766259288 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49a81f47a0 0x7f49a81f4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:44.524 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.514+0000 7f49a659c700 1 -- 172.21.15.149:0/2766259288 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f49a815b950 msgr2=0x7f49a80c7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:44.524 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.514+0000 7f49a659c700 1 --2- 172.21.15.149:0/2766259288 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f49a815b950 0x7f49a80c7e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:44.524 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.514+0000 7f49a659c700 1 -- 172.21.15.149:0/2766259288 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49a81f47a0 msgr2=0x7f49a81f4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:44.524 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.514+0000 7f49a659c700 1 --2- 172.21.15.149:0/2766259288 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49a81f47a0 0x7f49a81f4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:44.525 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.514+0000 7f49a659c700 1 -- 172.21.15.149:0/2766259288 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f499c009500 con 0x7f49a80cfd20 2023-11-08T19:26:44.525 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.514+0000 7f49a5d9b700 1 --2- 172.21.15.149:0/2766259288 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f49a815b950 0x7f49a80c7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:26:44.525 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.514+0000 7f49a659c700 1 --2- 172.21.15.149:0/2766259288 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49a80cfd20 0x7f49a80cae80 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f499c000c00 tx=0x7f499c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:44.525 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.514+0000 7f4996ffd700 1 -- 172.21.15.149:0/2766259288 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499c003d90 con 0x7f49a80cfd20 2023-11-08T19:26:44.525 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.514+0000 7f4996ffd700 1 -- 172.21.15.149:0/2766259288 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f499c011420 con 0x7f49a80cfd20 2023-11-08T19:26:44.526 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.514+0000 7f49acd88700 1 -- 172.21.15.149:0/2766259288 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49a80b75b0 con 0x7f49a80cfd20 2023-11-08T19:26:44.526 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.514+0000 7f4996ffd700 1 -- 172.21.15.149:0/2766259288 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499c0117d0 con 0x7f49a80cfd20 2023-11-08T19:26:44.526 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.514+0000 7f49acd88700 1 -- 172.21.15.149:0/2766259288 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49a80ca9f0 con 0x7f49a80cfd20 2023-11-08T19:26:44.526 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.515+0000 7f49acd88700 1 -- 172.21.15.149:0/2766259288 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49a80745f0 con 0x7f49a80cfd20 2023-11-08T19:26:44.526 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.515+0000 7f4996ffd700 1 -- 172.21.15.149:0/2766259288 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f499c011930 con 0x7f49a80cfd20 2023-11-08T19:26:44.527 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.516+0000 7f4996ffd700 1 --2- 172.21.15.149:0/2766259288 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f498806af00 0x7f498806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:44.527 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.516+0000 7f4996ffd700 1 -- 172.21.15.149:0/2766259288 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6268+0+0 (secure 0 0 0) 0x7f499c08aa70 con 0x7f49a80cfd20 2023-11-08T19:26:44.527 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.516+0000 7f49a5d9b700 1 --2- 172.21.15.149:0/2766259288 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f498806af00 0x7f498806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:44.527 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.516+0000 7f49a5d9b700 1 --2- 172.21.15.149:0/2766259288 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f498806af00 0x7f498806d3c0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f49a81586f0 tx=0x7f4998008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:44.528 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.521+0000 7f4996ffd700 1 -- 172.21.15.149:0/2766259288 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f499c055980 con 0x7f49a80cfd20 2023-11-08T19:26:44.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.712+0000 7f49acd88700 1 -- 172.21.15.149:0/2766259288 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f49a808b760 con 0x7f49a80cfd20 2023-11-08T19:26:44.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.713+0000 7f4996ffd700 1 -- 172.21.15.149:0/2766259288 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+18383 (secure 0 0 0) 0x7f499c058fa0 con 0x7f49a80cfd20 2023-11-08T19:26:44.714 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:26:44.715 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":92,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:26:43.923027+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-08T19:24:29.516185+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-08T19:25:44.287064+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":71,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-08T19:25:45.623521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:26:44.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.715+0000 7f49acd88700 1 -- 172.21.15.149:0/2766259288 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f498806af00 msgr2=0x7f498806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:44.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.715+0000 7f49acd88700 1 --2- 172.21.15.149:0/2766259288 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f498806af00 0x7f498806d3c0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f49a81586f0 tx=0x7f4998008040 comp rx=0 tx=0).stop 2023-11-08T19:26:44.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.715+0000 7f49acd88700 1 -- 172.21.15.149:0/2766259288 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49a80cfd20 msgr2=0x7f49a80cae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:44.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.715+0000 7f49acd88700 1 --2- 172.21.15.149:0/2766259288 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49a80cfd20 0x7f49a80cae80 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f499c000c00 tx=0x7f499c004750 comp rx=0 tx=0).stop 2023-11-08T19:26:44.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.715+0000 7f49acd88700 1 -- 172.21.15.149:0/2766259288 shutdown_connections 2023-11-08T19:26:44.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.715+0000 7f49acd88700 1 --2- 172.21.15.149:0/2766259288 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f498806af00 0x7f498806d3c0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:44.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.715+0000 7f49acd88700 1 --2- 172.21.15.149:0/2766259288 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49a81f47a0 0x7f49a81f4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:44.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.715+0000 7f49acd88700 1 --2- 172.21.15.149:0/2766259288 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49a80cfd20 0x7f49a80cae80 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:44.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.715+0000 7f49acd88700 1 --2- 172.21.15.149:0/2766259288 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f49a815b950 0x7f49a80c7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:44.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.715+0000 7f49acd88700 1 -- 172.21.15.149:0/2766259288 >> 172.21.15.149:0/2766259288 conn(0x7f49a808afd0 msgr2=0x7f49a80b2ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:44.719 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.715+0000 7f49acd88700 1 -- 172.21.15.149:0/2766259288 shutdown_connections 2023-11-08T19:26:44.719 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.715+0000 7f49acd88700 1 -- 172.21.15.149:0/2766259288 wait complete. 2023-11-08T19:26:44.729 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-08T19:22:56.023194+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-08T19:24:29.516185+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 42, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_data_pool', 'create_time': '2023-11-08T19:25:44.287064+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 71, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-08T19:25:45.623521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-08T19:26:44.729 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-08T19:26:44.853 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.852+0000 7f3038b56700 1 Processor -- start 2023-11-08T19:26:44.853 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.852+0000 7f3038b56700 1 -- start start 2023-11-08T19:26:44.856 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.853+0000 7f3038b56700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f303415abf0 0x7f30340b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:44.856 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.853+0000 7f3038b56700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f30340cc870 0x7f303406bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:44.856 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.853+0000 7f3038b56700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30340b6470 con 0x7f30340d1130 2023-11-08T19:26:44.856 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.853+0000 7f3038b56700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30340b66a0 con 0x7f30340cc870 2023-11-08T19:26:44.857 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.853+0000 7f3038b56700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30340d04a0 con 0x7f303415abf0 2023-11-08T19:26:44.857 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.853+0000 7f303259c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f303415abf0 0x7f30340b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:44.857 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.853+0000 7f3032d9d700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f30340cc870 0x7f303406bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:44.857 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.853+0000 7f3031d9b700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f30340d1130 0x7f30340cc160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.149:56944/0 (socket says 172.21.15.149:56944) 2023-11-08T19:26:44.858 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.853+0000 7f303259c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f303415abf0 0x7f30340b5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.149:35332/0 (socket says 172.21.15.149:35332) 2023-11-08T19:26:44.858 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.853+0000 7f3031d9b700 1 -- 172.21.15.149:0/4075302855 learned_addr learned my addr 172.21.15.149:0/4075302855 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:26:44.858 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.854+0000 7f3032d9d700 1 -- 172.21.15.149:0/4075302855 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f303415abf0 msgr2=0x7f30340b5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:44.858 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.854+0000 7f3032d9d700 1 --2- 172.21.15.149:0/4075302855 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f303415abf0 0x7f30340b5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:44.858 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.854+0000 7f3032d9d700 1 -- 172.21.15.149:0/4075302855 >> v1:172.21.15.160:6789/0 conn(0x7f30340d1130 legacy=0x7f30340cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:44.859 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.854+0000 7f3032d9d700 1 -- 172.21.15.149:0/4075302855 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f303415afd0 con 0x7f30340cc870 2023-11-08T19:26:44.859 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.854+0000 7f303159a700 1 -- 172.21.15.149:0/4075302855 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3427672666 0 0) 0x7f30340b6470 con 0x7f30340d1130 2023-11-08T19:26:44.859 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.854+0000 7f303259c700 1 --2- 172.21.15.149:0/4075302855 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f303415abf0 0x7f30340b5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:26:44.859 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.854+0000 7f3032d9d700 1 --2- 172.21.15.149:0/4075302855 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f30340cc870 0x7f303406bc90 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f302c009d90 tx=0x7f302c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e769e8ac16bb88d server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:44.859 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.854+0000 7f303159a700 1 -- 172.21.15.149:0/4075302855 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302c00e070 con 0x7f30340cc870 2023-11-08T19:26:44.860 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.854+0000 7f303159a700 1 -- 172.21.15.149:0/4075302855 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f302c00bb20 con 0x7f30340cc870 2023-11-08T19:26:44.860 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.854+0000 7f303159a700 1 -- 172.21.15.149:0/4075302855 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302c012430 con 0x7f30340cc870 2023-11-08T19:26:44.860 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.854+0000 7f3038b56700 1 -- 172.21.15.149:0/4075302855 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f30340cc870 msgr2=0x7f303406bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:44.860 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.854+0000 7f3038b56700 1 --2- 172.21.15.149:0/4075302855 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f30340cc870 0x7f303406bc90 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f302c009d90 tx=0x7f302c00b330 comp rx=0 tx=0).stop 2023-11-08T19:26:44.860 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.855+0000 7f3038b56700 1 -- 172.21.15.149:0/4075302855 shutdown_connections 2023-11-08T19:26:44.861 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.855+0000 7f3038b56700 1 --2- 172.21.15.149:0/4075302855 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f30340cc870 0x7f303406bc90 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:44.861 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.855+0000 7f3038b56700 1 --2- 172.21.15.149:0/4075302855 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f303415abf0 0x7f30340b5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:44.861 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.855+0000 7f3038b56700 1 -- 172.21.15.149:0/4075302855 >> 172.21.15.149:0/4075302855 conn(0x7f30340d0640 msgr2=0x7f30340d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:44.861 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.855+0000 7f3038b56700 1 -- 172.21.15.149:0/4075302855 shutdown_connections 2023-11-08T19:26:44.861 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.855+0000 7f3038b56700 1 -- 172.21.15.149:0/4075302855 wait complete. 2023-11-08T19:26:44.864 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.856+0000 7f3038b56700 1 Processor -- start 2023-11-08T19:26:44.864 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.856+0000 7f3038b56700 1 -- start start 2023-11-08T19:26:44.865 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.857+0000 7f3038b56700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30340cc870 0x7f3034155d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:44.865 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.857+0000 7f3038b56700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f30340d1130 0x7f30340721a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:44.865 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.857+0000 7f3038b56700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f303415abf0 0x7f3034149560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:44.865 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.857+0000 7f3038b56700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30341558c0 con 0x7f30340cc870 2023-11-08T19:26:44.865 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.857+0000 7f3038b56700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3034155290 con 0x7f303415abf0 2023-11-08T19:26:44.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.857+0000 7f3038b56700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f303415c0c0 con 0x7f30340d1130 2023-11-08T19:26:44.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.857+0000 7f303259c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30340cc870 0x7f3034155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:44.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.857+0000 7f303259c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30340cc870 0x7f3034155d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43280/0 (socket says 172.21.15.149:43280) 2023-11-08T19:26:44.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.857+0000 7f303259c700 1 -- 172.21.15.149:0/988989125 learned_addr learned my addr 172.21.15.149:0/988989125 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:44.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.857+0000 7f3031d9b700 1 --2- 172.21.15.149:0/988989125 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f30340d1130 0x7f30340721a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:44.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.857+0000 7f3032d9d700 1 --2- 172.21.15.149:0/988989125 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f303415abf0 0x7f3034149560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:44.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.857+0000 7f303259c700 1 -- 172.21.15.149:0/988989125 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f30340d1130 msgr2=0x7f30340721a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:44.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.857+0000 7f303259c700 1 --2- 172.21.15.149:0/988989125 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f30340d1130 0x7f30340721a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:44.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.857+0000 7f303259c700 1 -- 172.21.15.149:0/988989125 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f303415abf0 msgr2=0x7f3034149560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:44.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.857+0000 7f303259c700 1 --2- 172.21.15.149:0/988989125 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f303415abf0 0x7f3034149560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:44.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.857+0000 7f303259c700 1 -- 172.21.15.149:0/988989125 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f302400b740 con 0x7f30340cc870 2023-11-08T19:26:44.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.857+0000 7f303259c700 1 --2- 172.21.15.149:0/988989125 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30340cc870 0x7f3034155d50 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f3024010f50 tx=0x7f302400e640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:44.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.857+0000 7f3022ffd700 1 -- 172.21.15.149:0/988989125 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3024011650 con 0x7f30340cc870 2023-11-08T19:26:44.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.857+0000 7f3022ffd700 1 -- 172.21.15.149:0/988989125 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30240117b0 con 0x7f30340cc870 2023-11-08T19:26:44.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.857+0000 7f3038b56700 1 -- 172.21.15.149:0/988989125 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f302c009a70 con 0x7f30340cc870 2023-11-08T19:26:44.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.857+0000 7f3022ffd700 1 -- 172.21.15.149:0/988989125 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3024011b40 con 0x7f30340cc870 2023-11-08T19:26:44.869 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.858+0000 7f3038b56700 1 -- 172.21.15.149:0/988989125 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3034156290 con 0x7f30340cc870 2023-11-08T19:26:44.869 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.858+0000 7f3038b56700 1 -- 172.21.15.149:0/988989125 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3034155ba0 con 0x7f30340cc870 2023-11-08T19:26:44.869 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.859+0000 7f3022ffd700 1 -- 172.21.15.149:0/988989125 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3024011ca0 con 0x7f30340cc870 2023-11-08T19:26:44.869 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.859+0000 7f3022ffd700 1 --2- 172.21.15.149:0/988989125 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f301406af00 0x7f301406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:44.869 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.860+0000 7f3031d9b700 1 --2- 172.21.15.149:0/988989125 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f301406af00 0x7f301406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:44.870 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.860+0000 7f3022ffd700 1 -- 172.21.15.149:0/988989125 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6268+0+0 (secure 0 0 0) 0x7f302408c570 con 0x7f30340cc870 2023-11-08T19:26:44.870 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.860+0000 7f3031d9b700 1 --2- 172.21.15.149:0/988989125 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f301406af00 0x7f301406d3c0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f303414a1f0 tx=0x7f3028007e70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:44.870 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:44.864+0000 7f3022ffd700 1 -- 172.21.15.149:0/988989125 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3024057350 con 0x7f30340cc870 2023-11-08T19:26:45.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.053+0000 7f3038b56700 1 -- 172.21.15.149:0/988989125 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f303404f730 con 0x7f30340cc870 2023-11-08T19:26:45.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.054+0000 7f3022ffd700 1 -- 172.21.15.149:0/988989125 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v92) v1 ==== 93+0+10 (secure 0 0 0) 0x7f302405a970 con 0x7f30340cc870 2023-11-08T19:26:45.056 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 1 2023-11-08T19:26:45.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.056+0000 7f3038b56700 1 -- 172.21.15.149:0/988989125 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f301406af00 msgr2=0x7f301406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:45.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.056+0000 7f3038b56700 1 --2- 172.21.15.149:0/988989125 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f301406af00 0x7f301406d3c0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f303414a1f0 tx=0x7f3028007e70 comp rx=0 tx=0).stop 2023-11-08T19:26:45.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.056+0000 7f3038b56700 1 -- 172.21.15.149:0/988989125 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30340cc870 msgr2=0x7f3034155d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:45.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.056+0000 7f3038b56700 1 --2- 172.21.15.149:0/988989125 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30340cc870 0x7f3034155d50 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f3024010f50 tx=0x7f302400e640 comp rx=0 tx=0).stop 2023-11-08T19:26:45.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.056+0000 7f3038b56700 1 -- 172.21.15.149:0/988989125 shutdown_connections 2023-11-08T19:26:45.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.056+0000 7f3038b56700 1 --2- 172.21.15.149:0/988989125 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f301406af00 0x7f301406d3c0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:45.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.056+0000 7f3038b56700 1 --2- 172.21.15.149:0/988989125 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f303415abf0 0x7f3034149560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:45.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.056+0000 7f3038b56700 1 --2- 172.21.15.149:0/988989125 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30340cc870 0x7f3034155d50 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:45.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.056+0000 7f3038b56700 1 --2- 172.21.15.149:0/988989125 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f30340d1130 0x7f30340721a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:45.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.056+0000 7f3038b56700 1 -- 172.21.15.149:0/988989125 >> 172.21.15.149:0/988989125 conn(0x7f30340d0640 msgr2=0x7f3034159a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:45.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.056+0000 7f3038b56700 1 -- 172.21.15.149:0/988989125 shutdown_connections 2023-11-08T19:26:45.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.056+0000 7f3038b56700 1 -- 172.21.15.149:0/988989125 wait complete. 2023-11-08T19:26:45.070 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-08T19:26:45.195 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.193+0000 7f05ffe8f700 1 Processor -- start 2023-11-08T19:26:45.195 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.194+0000 7f05ffe8f700 1 -- start start 2023-11-08T19:26:45.198 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.195+0000 7f05ffe8f700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f05f80c7250 0x7f05f806b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:45.198 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.195+0000 7f05ffe8f700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f05f80cb610 0x7f05f80b4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:45.198 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.195+0000 7f05ffe8f700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05f80b3710 con 0x7f05f80722a0 2023-11-08T19:26:45.198 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.195+0000 7f05ffe8f700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05f806cc00 con 0x7f05f80c7250 2023-11-08T19:26:45.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.195+0000 7f05ffe8f700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05f806c640 con 0x7f05f80cb610 2023-11-08T19:26:45.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.195+0000 7f05fd42a700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f05f80c7250 0x7f05f806b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:45.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.195+0000 7f05fd42a700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f05f80c7250 0x7f05f806b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43290/0 (socket says 172.21.15.149:43290) 2023-11-08T19:26:45.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.195+0000 7f05fd42a700 1 -- 172.21.15.149:0/152403927 learned_addr learned my addr 172.21.15.149:0/152403927 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:45.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.195+0000 7f05fe42c700 1 --2- 172.21.15.149:0/152403927 >> v2:172.21.15.160:3300/0 conn(0x7f05f80cb610 0x7f05f80b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:45.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.195+0000 7f05fd42a700 1 -- 172.21.15.149:0/152403927 >> v2:172.21.15.160:3300/0 conn(0x7f05f80cb610 msgr2=0x7f05f80b4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:45.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.195+0000 7f05fd42a700 1 --2- 172.21.15.149:0/152403927 >> v2:172.21.15.160:3300/0 conn(0x7f05f80cb610 0x7f05f80b4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:45.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.195+0000 7f05fd42a700 1 -- 172.21.15.149:0/152403927 >> v1:172.21.15.160:6789/0 conn(0x7f05f80722a0 legacy=0x7f05f806ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:45.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.195+0000 7f05fd42a700 1 -- 172.21.15.149:0/152403927 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f806c920 con 0x7f05f80c7250 2023-11-08T19:26:45.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.195+0000 7f05fd42a700 1 --2- 172.21.15.149:0/152403927 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05f80c7250 0x7f05f806b290 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f05f8071e80 tx=0x7f05f4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2e2228f4d10e532 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:45.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.195+0000 7f05fcc29700 1 -- 172.21.15.149:0/152403927 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f400b870 con 0x7f05f80c7250 2023-11-08T19:26:45.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.195+0000 7f05fcc29700 1 -- 172.21.15.149:0/152403927 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f400b9d0 con 0x7f05f80c7250 2023-11-08T19:26:45.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.195+0000 7f05fcc29700 1 -- 172.21.15.149:0/152403927 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f400bd60 con 0x7f05f80c7250 2023-11-08T19:26:45.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.196+0000 7f05ffe8f700 1 -- 172.21.15.149:0/152403927 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05f80c7250 msgr2=0x7f05f806b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:45.202 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.196+0000 7f05ffe8f700 1 --2- 172.21.15.149:0/152403927 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05f80c7250 0x7f05f806b290 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f05f8071e80 tx=0x7f05f4009bd0 comp rx=0 tx=0).stop 2023-11-08T19:26:45.202 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.196+0000 7f05ffe8f700 1 -- 172.21.15.149:0/152403927 shutdown_connections 2023-11-08T19:26:45.202 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.196+0000 7f05ffe8f700 1 --2- 172.21.15.149:0/152403927 >> v2:172.21.15.160:3300/0 conn(0x7f05f80cb610 0x7f05f80b4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:45.202 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.196+0000 7f05ffe8f700 1 --2- 172.21.15.149:0/152403927 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05f80c7250 0x7f05f806b290 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:45.203 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.196+0000 7f05ffe8f700 1 -- 172.21.15.149:0/152403927 >> 172.21.15.149:0/152403927 conn(0x7f05f80d0640 msgr2=0x7f05f80d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:45.203 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.196+0000 7f05ffe8f700 1 -- 172.21.15.149:0/152403927 shutdown_connections 2023-11-08T19:26:45.203 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.196+0000 7f05ffe8f700 1 -- 172.21.15.149:0/152403927 wait complete. 2023-11-08T19:26:45.206 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.197+0000 7f05ffe8f700 1 Processor -- start 2023-11-08T19:26:45.206 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.197+0000 7f05ffe8f700 1 -- start start 2023-11-08T19:26:45.206 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.198+0000 7f05ffe8f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05f80722a0 0x7f05f81f0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:45.206 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.198+0000 7f05ffe8f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05f80c7250 0x7f05f815e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:45.206 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.198+0000 7f05ffe8f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05f80cb610 0x7f05f80b13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:45.207 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.198+0000 7f05ffe8f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f80a8670 con 0x7f05f80cb610 2023-11-08T19:26:45.207 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.198+0000 7f05ffe8f700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f815f1f0 con 0x7f05f80c7250 2023-11-08T19:26:45.207 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.198+0000 7f05ffe8f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05f815e950 con 0x7f05f80722a0 2023-11-08T19:26:45.207 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.198+0000 7f05fe42c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05f80cb610 0x7f05f80b13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:45.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.198+0000 7f05fe42c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05f80cb610 0x7f05f80b13d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43298/0 (socket says 172.21.15.149:43298) 2023-11-08T19:26:45.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.198+0000 7f05fe42c700 1 -- 172.21.15.149:0/1688241734 learned_addr learned my addr 172.21.15.149:0/1688241734 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:45.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.198+0000 7f05fd42a700 1 --2- 172.21.15.149:0/1688241734 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05f80c7250 0x7f05f815e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:45.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.198+0000 7f05fdc2b700 1 --2- 172.21.15.149:0/1688241734 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05f80722a0 0x7f05f81f0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:45.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.198+0000 7f05fe42c700 1 -- 172.21.15.149:0/1688241734 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05f80722a0 msgr2=0x7f05f81f0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:45.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.198+0000 7f05fe42c700 1 --2- 172.21.15.149:0/1688241734 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05f80722a0 0x7f05f81f0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:45.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.198+0000 7f05fe42c700 1 -- 172.21.15.149:0/1688241734 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05f80c7250 msgr2=0x7f05f815e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:45.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.198+0000 7f05fe42c700 1 --2- 172.21.15.149:0/1688241734 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05f80c7250 0x7f05f815e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:45.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.198+0000 7f05fe42c700 1 -- 172.21.15.149:0/1688241734 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f4009550 con 0x7f05f80cb610 2023-11-08T19:26:45.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.198+0000 7f05fdc2b700 1 --2- 172.21.15.149:0/1688241734 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05f80722a0 0x7f05f81f0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:26:45.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.198+0000 7f05fe42c700 1 --2- 172.21.15.149:0/1688241734 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05f80cb610 0x7f05f80b13d0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f05f0007e60 tx=0x7f05f000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:45.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.199+0000 7f05ee7fc700 1 -- 172.21.15.149:0/1688241734 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f000ede0 con 0x7f05f80cb610 2023-11-08T19:26:45.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.199+0000 7f05ee7fc700 1 -- 172.21.15.149:0/1688241734 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f0014420 con 0x7f05f80cb610 2023-11-08T19:26:45.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.199+0000 7f05ffe8f700 1 -- 172.21.15.149:0/1688241734 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05f815ec30 con 0x7f05f80cb610 2023-11-08T19:26:45.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.199+0000 7f05ee7fc700 1 -- 172.21.15.149:0/1688241734 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f00147d0 con 0x7f05f80cb610 2023-11-08T19:26:45.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.199+0000 7f05ffe8f700 1 -- 172.21.15.149:0/1688241734 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05f81f1400 con 0x7f05f80cb610 2023-11-08T19:26:45.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.200+0000 7f05ffe8f700 1 -- 172.21.15.149:0/1688241734 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05f804f730 con 0x7f05f80cb610 2023-11-08T19:26:45.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.200+0000 7f05ee7fc700 1 -- 172.21.15.149:0/1688241734 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f05f0014930 con 0x7f05f80cb610 2023-11-08T19:26:45.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.200+0000 7f05ee7fc700 1 --2- 172.21.15.149:0/1688241734 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f05dc06af00 0x7f05dc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:45.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.201+0000 7f05fdc2b700 1 --2- 172.21.15.149:0/1688241734 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f05dc06af00 0x7f05dc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:45.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.201+0000 7f05ee7fc700 1 -- 172.21.15.149:0/1688241734 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6268+0+0 (secure 0 0 0) 0x7f05f0089e00 con 0x7f05f80cb610 2023-11-08T19:26:45.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.201+0000 7f05fdc2b700 1 --2- 172.21.15.149:0/1688241734 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f05dc06af00 0x7f05dc06d3c0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f05e8000f60 tx=0x7f05e8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:45.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.205+0000 7f05ee7fc700 1 -- 172.21.15.149:0/1688241734 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f05f0054d10 con 0x7f05f80cb610 2023-11-08T19:26:45.395 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.394+0000 7f05ffe8f700 1 -- 172.21.15.149:0/1688241734 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f05f80a87b0 con 0x7f05f80cb610 2023-11-08T19:26:45.396 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.395+0000 7f05ee7fc700 1 -- 172.21.15.149:0/1688241734 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v92) v1 ==== 103+0+11 (secure 0 0 0) 0x7f05f0058330 con 0x7f05f80cb610 2023-11-08T19:26:45.396 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:26:45.398 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.397+0000 7f05ffe8f700 1 -- 172.21.15.149:0/1688241734 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f05dc06af00 msgr2=0x7f05dc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:45.399 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.397+0000 7f05ffe8f700 1 --2- 172.21.15.149:0/1688241734 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f05dc06af00 0x7f05dc06d3c0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f05e8000f60 tx=0x7f05e8009040 comp rx=0 tx=0).stop 2023-11-08T19:26:45.399 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.397+0000 7f05ffe8f700 1 -- 172.21.15.149:0/1688241734 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05f80cb610 msgr2=0x7f05f80b13d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:45.399 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.397+0000 7f05ffe8f700 1 --2- 172.21.15.149:0/1688241734 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05f80cb610 0x7f05f80b13d0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f05f0007e60 tx=0x7f05f000e3c0 comp rx=0 tx=0).stop 2023-11-08T19:26:45.399 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.397+0000 7f05ffe8f700 1 -- 172.21.15.149:0/1688241734 shutdown_connections 2023-11-08T19:26:45.399 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.397+0000 7f05ffe8f700 1 --2- 172.21.15.149:0/1688241734 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f05dc06af00 0x7f05dc06d3c0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:45.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.397+0000 7f05ffe8f700 1 --2- 172.21.15.149:0/1688241734 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05f80cb610 0x7f05f80b13d0 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:45.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.397+0000 7f05ffe8f700 1 --2- 172.21.15.149:0/1688241734 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05f80722a0 0x7f05f81f0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:45.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.397+0000 7f05ffe8f700 1 --2- 172.21.15.149:0/1688241734 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05f80c7250 0x7f05f815e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:45.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.397+0000 7f05ffe8f700 1 -- 172.21.15.149:0/1688241734 >> 172.21.15.149:0/1688241734 conn(0x7f05f80d0640 msgr2=0x7f05f815be40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:45.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.397+0000 7f05ffe8f700 1 -- 172.21.15.149:0/1688241734 shutdown_connections 2023-11-08T19:26:45.401 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.397+0000 7f05ffe8f700 1 -- 172.21.15.149:0/1688241734 wait complete. 2023-11-08T19:26:45.411 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-08T19:26:45.535 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.533+0000 7f95f64ff700 1 Processor -- start 2023-11-08T19:26:45.535 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.534+0000 7f95f64ff700 1 -- start start 2023-11-08T19:26:45.537 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.535+0000 7f95f64ff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f95f00ce3f0 0x7f95f0066bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:45.537 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.535+0000 7f95f64ff700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95f015ced0 con 0x7f95f006ee60 2023-11-08T19:26:45.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.535+0000 7f95f64ff700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95f006dfa0 con 0x7f95f006c2d0 2023-11-08T19:26:45.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.535+0000 7f95f64ff700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95f006f710 con 0x7f95f00ce3f0 2023-11-08T19:26:45.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.535+0000 7f95f4a9c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f95f00ce3f0 0x7f95f0066bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:45.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.535+0000 7f95ef7fe700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f95f006ee60 0x7f95f00cdce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:45306/0 (socket says 172.21.15.149:45306) 2023-11-08T19:26:45.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.535+0000 7f95ef7fe700 1 -- 172.21.15.149:0/3836944742 learned_addr learned my addr 172.21.15.149:0/3836944742 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:26:45.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.535+0000 7f95f4a9c700 1 -- 172.21.15.149:0/3836944742 >> v1:172.21.15.160:6789/0 conn(0x7f95f006c2d0 legacy=0x7f95f006e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:45.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.535+0000 7f95f4a9c700 1 -- 172.21.15.149:0/3836944742 >> v1:172.21.15.149:6789/0 conn(0x7f95f006ee60 legacy=0x7f95f00cdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:45.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.535+0000 7f95f4a9c700 1 -- 172.21.15.149:0/3836944742 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f015c990 con 0x7f95f00ce3f0 2023-11-08T19:26:45.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.535+0000 7f95eeffd700 1 -- 172.21.15.149:0/3836944742 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3100243540 0 0) 0x7f95f015ced0 con 0x7f95f006ee60 2023-11-08T19:26:45.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.535+0000 7f95f4a9c700 1 --2- 172.21.15.149:0/3836944742 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95f00ce3f0 0x7f95f0066bc0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f95e8009d90 tx=0x7f95e800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b69e5d61d3b9e77 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:45.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.535+0000 7f95eeffd700 1 -- 172.21.15.149:0/3836944742 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e800e070 con 0x7f95f00ce3f0 2023-11-08T19:26:45.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.535+0000 7f95eeffd700 1 -- 172.21.15.149:0/3836944742 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e800bbd0 con 0x7f95f00ce3f0 2023-11-08T19:26:45.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.535+0000 7f95eeffd700 1 -- 172.21.15.149:0/3836944742 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e8012430 con 0x7f95f00ce3f0 2023-11-08T19:26:45.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.536+0000 7f95f64ff700 1 -- 172.21.15.149:0/3836944742 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95f00ce3f0 msgr2=0x7f95f0066bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:45.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.536+0000 7f95f64ff700 1 --2- 172.21.15.149:0/3836944742 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95f00ce3f0 0x7f95f0066bc0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f95e8009d90 tx=0x7f95e800b330 comp rx=0 tx=0).stop 2023-11-08T19:26:45.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.536+0000 7f95f64ff700 1 -- 172.21.15.149:0/3836944742 shutdown_connections 2023-11-08T19:26:45.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.536+0000 7f95f64ff700 1 --2- 172.21.15.149:0/3836944742 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95f00ce3f0 0x7f95f0066bc0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:45.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.536+0000 7f95f64ff700 1 -- 172.21.15.149:0/3836944742 >> 172.21.15.149:0/3836944742 conn(0x7f95f00cc860 msgr2=0x7f95f00ccc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:45.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.536+0000 7f95f64ff700 1 -- 172.21.15.149:0/3836944742 shutdown_connections 2023-11-08T19:26:45.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.536+0000 7f95f64ff700 1 -- 172.21.15.149:0/3836944742 wait complete. 2023-11-08T19:26:45.544 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.538+0000 7f95f64ff700 1 Processor -- start 2023-11-08T19:26:45.545 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.538+0000 7f95f64ff700 1 -- start start 2023-11-08T19:26:45.545 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.539+0000 7f95f64ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95f006ee60 0x7f95f01f0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:45.545 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.539+0000 7f95f64ff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95f00ce3f0 0x7f95f00c5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:45.545 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.539+0000 7f95f64ff700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95f00c6180 0x7f95f00b0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:45.545 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.539+0000 7f95f64ff700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f0153d90 con 0x7f95f00ce3f0 2023-11-08T19:26:45.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.539+0000 7f95f64ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f015ad00 con 0x7f95f006ee60 2023-11-08T19:26:45.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.539+0000 7f95f64ff700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95f00c67b0 con 0x7f95f00c6180 2023-11-08T19:26:45.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.539+0000 7f95ef7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95f00ce3f0 0x7f95f00c5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:45.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.539+0000 7f95ef7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95f00ce3f0 0x7f95f00c5c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43310/0 (socket says 172.21.15.149:43310) 2023-11-08T19:26:45.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.539+0000 7f95ef7fe700 1 -- 172.21.15.149:0/3627891889 learned_addr learned my addr 172.21.15.149:0/3627891889 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:45.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.539+0000 7f95effff700 1 --2- 172.21.15.149:0/3627891889 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95f006ee60 0x7f95f01f0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:45.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.539+0000 7f95f4a9c700 1 --2- 172.21.15.149:0/3627891889 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95f00c6180 0x7f95f00b0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:45.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.539+0000 7f95ef7fe700 1 -- 172.21.15.149:0/3627891889 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95f00c6180 msgr2=0x7f95f00b0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:45.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.539+0000 7f95ef7fe700 1 --2- 172.21.15.149:0/3627891889 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95f00c6180 0x7f95f00b0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:45.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.539+0000 7f95ef7fe700 1 -- 172.21.15.149:0/3627891889 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95f006ee60 msgr2=0x7f95f01f0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:45.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.539+0000 7f95ef7fe700 1 --2- 172.21.15.149:0/3627891889 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95f006ee60 0x7f95f01f0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:45.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.539+0000 7f95ef7fe700 1 -- 172.21.15.149:0/3627891889 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e8009a70 con 0x7f95f00ce3f0 2023-11-08T19:26:45.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.539+0000 7f95f4a9c700 1 --2- 172.21.15.149:0/3627891889 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95f00c6180 0x7f95f00b0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:26:45.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.539+0000 7f95ef7fe700 1 --2- 172.21.15.149:0/3627891889 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95f00ce3f0 0x7f95f00c5c40 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f95e000c520 tx=0x7f95e000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:45.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.539+0000 7f95ecff9700 1 -- 172.21.15.149:0/3627891889 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e0004c80 con 0x7f95f00ce3f0 2023-11-08T19:26:45.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.539+0000 7f95ecff9700 1 -- 172.21.15.149:0/3627891889 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e0004de0 con 0x7f95f00ce3f0 2023-11-08T19:26:45.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.539+0000 7f95f64ff700 1 -- 172.21.15.149:0/3627891889 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95f01f47e0 con 0x7f95f00ce3f0 2023-11-08T19:26:45.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.539+0000 7f95ecff9700 1 -- 172.21.15.149:0/3627891889 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e0007310 con 0x7f95f00ce3f0 2023-11-08T19:26:45.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.540+0000 7f95f64ff700 1 -- 172.21.15.149:0/3627891889 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95f01f4da0 con 0x7f95f00ce3f0 2023-11-08T19:26:45.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.540+0000 7f95f64ff700 1 -- 172.21.15.149:0/3627891889 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95f004f730 con 0x7f95f00ce3f0 2023-11-08T19:26:45.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.541+0000 7f95ecff9700 1 -- 172.21.15.149:0/3627891889 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f95e0007470 con 0x7f95f00ce3f0 2023-11-08T19:26:45.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.541+0000 7f95ecff9700 1 --2- 172.21.15.149:0/3627891889 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f95dc06af00 0x7f95dc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:45.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.541+0000 7f95ecff9700 1 -- 172.21.15.149:0/3627891889 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6268+0+0 (secure 0 0 0) 0x7f95e0089470 con 0x7f95f00ce3f0 2023-11-08T19:26:45.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.541+0000 7f95effff700 1 --2- 172.21.15.149:0/3627891889 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f95dc06af00 0x7f95dc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:45.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.542+0000 7f95effff700 1 --2- 172.21.15.149:0/3627891889 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f95dc06af00 0x7f95dc06d3c0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f95e4007fd0 tx=0x7f95e4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:45.551 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.546+0000 7f95ecff9700 1 -- 172.21.15.149:0/3627891889 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f95e00542e0 con 0x7f95f00ce3f0 2023-11-08T19:26:45.739 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.738+0000 7f95f64ff700 1 -- 172.21.15.149:0/3627891889 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7f95f00b01e0 con 0x7f95f00ce3f0 2023-11-08T19:26:45.740 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.738+0000 7f95ecff9700 1 -- 172.21.15.149:0/3627891889 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v92) v1 ==== 103+0+11 (secure 0 0 0) 0x7f95e0057900 con 0x7f95f00ce3f0 2023-11-08T19:26:45.740 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:26:45.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.740+0000 7f95f64ff700 1 -- 172.21.15.149:0/3627891889 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f95dc06af00 msgr2=0x7f95dc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:45.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.740+0000 7f95f64ff700 1 --2- 172.21.15.149:0/3627891889 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f95dc06af00 0x7f95dc06d3c0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f95e4007fd0 tx=0x7f95e4009040 comp rx=0 tx=0).stop 2023-11-08T19:26:45.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.740+0000 7f95f64ff700 1 -- 172.21.15.149:0/3627891889 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95f00ce3f0 msgr2=0x7f95f00c5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:45.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.740+0000 7f95f64ff700 1 --2- 172.21.15.149:0/3627891889 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95f00ce3f0 0x7f95f00c5c40 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f95e000c520 tx=0x7f95e000c830 comp rx=0 tx=0).stop 2023-11-08T19:26:45.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.740+0000 7f95f64ff700 1 -- 172.21.15.149:0/3627891889 shutdown_connections 2023-11-08T19:26:45.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.740+0000 7f95f64ff700 1 --2- 172.21.15.149:0/3627891889 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f95dc06af00 0x7f95dc06d3c0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:45.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.740+0000 7f95f64ff700 1 --2- 172.21.15.149:0/3627891889 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95f006ee60 0x7f95f01f0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:45.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.740+0000 7f95f64ff700 1 --2- 172.21.15.149:0/3627891889 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95f00c6180 0x7f95f00b0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:45.744 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.740+0000 7f95f64ff700 1 --2- 172.21.15.149:0/3627891889 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95f00ce3f0 0x7f95f00c5c40 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:45.744 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.740+0000 7f95f64ff700 1 -- 172.21.15.149:0/3627891889 >> 172.21.15.149:0/3627891889 conn(0x7f95f00cc860 msgr2=0x7f95f00b4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:45.744 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.741+0000 7f95f64ff700 1 -- 172.21.15.149:0/3627891889 shutdown_connections 2023-11-08T19:26:45.744 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.741+0000 7f95f64ff700 1 -- 172.21.15.149:0/3627891889 wait complete. 2023-11-08T19:26:45.754 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-08T19:26:45.878 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.877+0000 7f6a63b77700 1 Processor -- start 2023-11-08T19:26:45.878 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.877+0000 7f6a63b77700 1 -- start start 2023-11-08T19:26:45.881 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.878+0000 7f6a63b77700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6a5c0b38e0 0x7f6a5c0cfd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:45.881 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.878+0000 7f6a63b77700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f6a5c06d5e0 0x7f6a5c06c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:45.881 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.878+0000 7f6a63b77700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a5c0cdd30 con 0x7f6a5c15db10 2023-11-08T19:26:45.882 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.878+0000 7f6a63b77700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a5c0ced40 con 0x7f6a5c06d5e0 2023-11-08T19:26:45.882 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.878+0000 7f6a63b77700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5c0cbe50 con 0x7f6a5c0b38e0 2023-11-08T19:26:45.882 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.878+0000 7f6a61112700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6a5c0b38e0 0x7f6a5c0cfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:45.882 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.878+0000 7f6a62114700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f6a5c06d5e0 0x7f6a5c06c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:45.882 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.878+0000 7f6a61913700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f6a5c15db10 0x7f6a5c0b31d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.149:56984/0 (socket says 172.21.15.149:56984) 2023-11-08T19:26:45.883 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.878+0000 7f6a61913700 1 -- 172.21.15.149:0/3592594733 learned_addr learned my addr 172.21.15.149:0/3592594733 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:26:45.883 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.879+0000 7f6a61112700 1 -- 172.21.15.149:0/3592594733 >> v2:172.21.15.160:3300/0 conn(0x7f6a5c06d5e0 msgr2=0x7f6a5c06c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:45.883 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.879+0000 7f6a61112700 1 --2- 172.21.15.149:0/3592594733 >> v2:172.21.15.160:3300/0 conn(0x7f6a5c06d5e0 0x7f6a5c06c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:45.883 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.879+0000 7f6a61112700 1 -- 172.21.15.149:0/3592594733 >> v1:172.21.15.160:6789/0 conn(0x7f6a5c15db10 legacy=0x7f6a5c0b31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:45.884 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.879+0000 7f6a60911700 1 -- 172.21.15.149:0/3592594733 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3327694594 0 0) 0x7f6a5c0cdd30 con 0x7f6a5c15db10 2023-11-08T19:26:45.884 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.879+0000 7f6a61112700 1 -- 172.21.15.149:0/3592594733 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a5c06da70 con 0x7f6a5c0b38e0 2023-11-08T19:26:45.884 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.879+0000 7f6a62114700 1 --2- 172.21.15.149:0/3592594733 >> v2:172.21.15.160:3300/0 conn(0x7f6a5c06d5e0 0x7f6a5c06c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:26:45.884 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.879+0000 7f6a61112700 1 --2- 172.21.15.149:0/3592594733 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6a5c0b38e0 0x7f6a5c0cfd30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c009840 tx=0x7f6a4c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31149c5f3bfac7c0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:45.885 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.879+0000 7f6a60911700 1 -- 172.21.15.149:0/3592594733 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c011830 con 0x7f6a5c0b38e0 2023-11-08T19:26:45.885 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.879+0000 7f6a60911700 1 -- 172.21.15.149:0/3592594733 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a4c011990 con 0x7f6a5c0b38e0 2023-11-08T19:26:45.885 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.879+0000 7f6a60911700 1 -- 172.21.15.149:0/3592594733 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c011d20 con 0x7f6a5c0b38e0 2023-11-08T19:26:45.885 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.879+0000 7f6a63b77700 1 -- 172.21.15.149:0/3592594733 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6a5c0b38e0 msgr2=0x7f6a5c0cfd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:45.885 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.879+0000 7f6a63b77700 1 --2- 172.21.15.149:0/3592594733 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6a5c0b38e0 0x7f6a5c0cfd30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c009840 tx=0x7f6a4c009b50 comp rx=0 tx=0).stop 2023-11-08T19:26:45.886 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.879+0000 7f6a63b77700 1 -- 172.21.15.149:0/3592594733 shutdown_connections 2023-11-08T19:26:45.886 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.880+0000 7f6a63b77700 1 --2- 172.21.15.149:0/3592594733 >> v2:172.21.15.160:3300/0 conn(0x7f6a5c06d5e0 0x7f6a5c06c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:45.886 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.880+0000 7f6a63b77700 1 --2- 172.21.15.149:0/3592594733 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6a5c0b38e0 0x7f6a5c0cfd30 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:45.886 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.880+0000 7f6a63b77700 1 -- 172.21.15.149:0/3592594733 >> 172.21.15.149:0/3592594733 conn(0x7f6a5c06f120 msgr2=0x7f6a5c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:45.886 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.880+0000 7f6a63b77700 1 -- 172.21.15.149:0/3592594733 shutdown_connections 2023-11-08T19:26:45.887 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.880+0000 7f6a63b77700 1 -- 172.21.15.149:0/3592594733 wait complete. 2023-11-08T19:26:45.890 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.881+0000 7f6a63b77700 1 Processor -- start 2023-11-08T19:26:45.890 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.881+0000 7f6a63b77700 1 -- start start 2023-11-08T19:26:45.890 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.881+0000 7f6a63b77700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a5c06d5e0 0x7f6a5c0c8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:45.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.881+0000 7f6a63b77700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6a5c0b38e0 0x7f6a5c14db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:45.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.881+0000 7f6a63b77700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6a5c15db10 0x7f6a5c0c7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:45.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.881+0000 7f6a63b77700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5c0c8d60 con 0x7f6a5c06d5e0 2023-11-08T19:26:45.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.881+0000 7f6a63b77700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5c0c8fe0 con 0x7f6a5c15db10 2023-11-08T19:26:45.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.881+0000 7f6a63b77700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5c0c92c0 con 0x7f6a5c0b38e0 2023-11-08T19:26:45.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.882+0000 7f6a61913700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a5c06d5e0 0x7f6a5c0c8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:45.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.882+0000 7f6a61913700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a5c06d5e0 0x7f6a5c0c8820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43322/0 (socket says 172.21.15.149:43322) 2023-11-08T19:26:45.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.882+0000 7f6a61913700 1 -- 172.21.15.149:0/3125462995 learned_addr learned my addr 172.21.15.149:0/3125462995 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:45.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.882+0000 7f6a61112700 1 --2- 172.21.15.149:0/3125462995 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6a5c0b38e0 0x7f6a5c14db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:45.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.882+0000 7f6a62114700 1 --2- 172.21.15.149:0/3125462995 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6a5c15db10 0x7f6a5c0c7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:45.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.882+0000 7f6a61913700 1 -- 172.21.15.149:0/3125462995 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6a5c0b38e0 msgr2=0x7f6a5c14db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:45.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.882+0000 7f6a61913700 1 --2- 172.21.15.149:0/3125462995 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6a5c0b38e0 0x7f6a5c14db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:45.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.882+0000 7f6a61913700 1 -- 172.21.15.149:0/3125462995 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6a5c15db10 msgr2=0x7f6a5c0c7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:45.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.882+0000 7f6a61913700 1 --2- 172.21.15.149:0/3125462995 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6a5c15db10 0x7f6a5c0c7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:45.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.882+0000 7f6a61913700 1 -- 172.21.15.149:0/3125462995 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a54009a70 con 0x7f6a5c06d5e0 2023-11-08T19:26:45.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.882+0000 7f6a61913700 1 --2- 172.21.15.149:0/3125462995 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a5c06d5e0 0x7f6a5c0c8820 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f6a5800c550 tx=0x7f6a5800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:45.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.882+0000 7f6a527fc700 1 -- 172.21.15.149:0/3125462995 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a58004c80 con 0x7f6a5c06d5e0 2023-11-08T19:26:45.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.882+0000 7f6a527fc700 1 -- 172.21.15.149:0/3125462995 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a58004e00 con 0x7f6a5c06d5e0 2023-11-08T19:26:45.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.882+0000 7f6a63b77700 1 -- 172.21.15.149:0/3125462995 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a4c0094a0 con 0x7f6a5c06d5e0 2023-11-08T19:26:45.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.882+0000 7f6a527fc700 1 -- 172.21.15.149:0/3125462995 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a58007310 con 0x7f6a5c06d5e0 2023-11-08T19:26:45.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.882+0000 7f6a63b77700 1 -- 172.21.15.149:0/3125462995 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a5c0c9880 con 0x7f6a5c06d5e0 2023-11-08T19:26:45.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.883+0000 7f6a63b77700 1 -- 172.21.15.149:0/3125462995 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a5c04f730 con 0x7f6a5c06d5e0 2023-11-08T19:26:45.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.884+0000 7f6a527fc700 1 -- 172.21.15.149:0/3125462995 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6a58007470 con 0x7f6a5c06d5e0 2023-11-08T19:26:45.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.884+0000 7f6a527fc700 1 --2- 172.21.15.149:0/3125462995 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6a4006af00 0x7f6a4006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:45.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.884+0000 7f6a527fc700 1 -- 172.21.15.149:0/3125462995 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6268+0+0 (secure 0 0 0) 0x7f6a580899c0 con 0x7f6a5c06d5e0 2023-11-08T19:26:45.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.884+0000 7f6a61112700 1 --2- 172.21.15.149:0/3125462995 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6a4006af00 0x7f6a4006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:45.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.885+0000 7f6a61112700 1 --2- 172.21.15.149:0/3125462995 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6a4006af00 0x7f6a4006d3c0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c0090b0 tx=0x7f6a4c01c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:45.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:45.889+0000 7f6a527fc700 1 -- 172.21.15.149:0/3125462995 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6a58054920 con 0x7f6a5c06d5e0 2023-11-08T19:26:46.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.078+0000 7f6a63b77700 1 -- 172.21.15.149:0/3125462995 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7f6a5c06ff20 con 0x7f6a5c06d5e0 2023-11-08T19:26:46.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.079+0000 7f6a527fc700 1 -- 172.21.15.149:0/3125462995 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v92) v1 ==== 107+0+11 (secure 0 0 0) 0x7f6a58057f40 con 0x7f6a5c06d5e0 2023-11-08T19:26:46.080 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:26:46.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.081+0000 7f6a63b77700 1 -- 172.21.15.149:0/3125462995 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6a4006af00 msgr2=0x7f6a4006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:46.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.081+0000 7f6a63b77700 1 --2- 172.21.15.149:0/3125462995 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6a4006af00 0x7f6a4006d3c0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c0090b0 tx=0x7f6a4c01c040 comp rx=0 tx=0).stop 2023-11-08T19:26:46.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.081+0000 7f6a63b77700 1 -- 172.21.15.149:0/3125462995 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a5c06d5e0 msgr2=0x7f6a5c0c8820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:46.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.081+0000 7f6a63b77700 1 --2- 172.21.15.149:0/3125462995 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a5c06d5e0 0x7f6a5c0c8820 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f6a5800c550 tx=0x7f6a5800c860 comp rx=0 tx=0).stop 2023-11-08T19:26:46.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.081+0000 7f6a63b77700 1 -- 172.21.15.149:0/3125462995 shutdown_connections 2023-11-08T19:26:46.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.081+0000 7f6a63b77700 1 --2- 172.21.15.149:0/3125462995 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6a4006af00 0x7f6a4006d3c0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:46.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.081+0000 7f6a63b77700 1 --2- 172.21.15.149:0/3125462995 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6a5c15db10 0x7f6a5c0c7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:46.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.081+0000 7f6a63b77700 1 --2- 172.21.15.149:0/3125462995 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a5c06d5e0 0x7f6a5c0c8820 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:46.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.081+0000 7f6a63b77700 1 --2- 172.21.15.149:0/3125462995 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6a5c0b38e0 0x7f6a5c14db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:46.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.081+0000 7f6a63b77700 1 -- 172.21.15.149:0/3125462995 >> 172.21.15.149:0/3125462995 conn(0x7f6a5c06f120 msgr2=0x7f6a5c06c160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:46.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.081+0000 7f6a63b77700 1 -- 172.21.15.149:0/3125462995 shutdown_connections 2023-11-08T19:26:46.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.081+0000 7f6a63b77700 1 -- 172.21.15.149:0/3125462995 wait complete. 2023-11-08T19:26:46.095 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-08T19:26:46.216 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.215+0000 7f49b3336700 1 Processor -- start 2023-11-08T19:26:46.216 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.215+0000 7f49b3336700 1 -- start start 2023-11-08T19:26:46.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.216+0000 7f49b3336700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f49ac0668e0 0x7f49ac06bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:46.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.216+0000 7f49b3336700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49ac15f390 con 0x7f49ac15efb0 2023-11-08T19:26:46.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.216+0000 7f49b3336700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49ac0b3460 con 0x7f49ac0b5840 2023-11-08T19:26:46.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.216+0000 7f49b3336700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49ac0ce0a0 con 0x7f49ac0668e0 2023-11-08T19:26:46.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.216+0000 7f49b08d1700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f49ac0668e0 0x7f49ac06bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:46.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.216+0000 7f49b10d2700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f49ac15efb0 0x7f49ac0b2d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:45332/0 (socket says 172.21.15.149:45332) 2023-11-08T19:26:46.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.216+0000 7f49b10d2700 1 -- 172.21.15.149:0/2055643172 learned_addr learned my addr 172.21.15.149:0/2055643172 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:26:46.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.216+0000 7f49a3fff700 1 -- 172.21.15.149:0/2055643172 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3383417062 0 0) 0x7f49a8001110 con 0x7f49ac15efb0 2023-11-08T19:26:46.221 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.216+0000 7f49a3fff700 1 -- 172.21.15.149:0/2055643172 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49980035b0 con 0x7f49ac15efb0 2023-11-08T19:26:46.221 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.216+0000 7f49b08d1700 1 -- 172.21.15.149:0/2055643172 >> v1:172.21.15.160:6789/0 conn(0x7f49ac0b5840 legacy=0x7f49ac0cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:46.221 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.216+0000 7f49b08d1700 1 -- 172.21.15.149:0/2055643172 >> v1:172.21.15.149:6789/0 conn(0x7f49ac15efb0 legacy=0x7f49ac0b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:46.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.216+0000 7f49b08d1700 1 -- 172.21.15.149:0/2055643172 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49ac0ce380 con 0x7f49ac0668e0 2023-11-08T19:26:46.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.216+0000 7f49b08d1700 1 --2- 172.21.15.149:0/2055643172 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49ac0668e0 0x7f49ac06bb90 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f499c009840 tx=0x7f499c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae8b1611a08215c9 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:46.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.217+0000 7f49a3fff700 1 -- 172.21.15.149:0/2055643172 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499c004230 con 0x7f49ac0668e0 2023-11-08T19:26:46.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.217+0000 7f49a3fff700 1 -- 172.21.15.149:0/2055643172 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f499c004390 con 0x7f49ac0668e0 2023-11-08T19:26:46.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.217+0000 7f49a3fff700 1 -- 172.21.15.149:0/2055643172 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499c0036a0 con 0x7f49ac0668e0 2023-11-08T19:26:46.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.217+0000 7f49b3336700 1 -- 172.21.15.149:0/2055643172 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49ac0668e0 msgr2=0x7f49ac06bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:46.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.217+0000 7f49b3336700 1 --2- 172.21.15.149:0/2055643172 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49ac0668e0 0x7f49ac06bb90 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f499c009840 tx=0x7f499c009b50 comp rx=0 tx=0).stop 2023-11-08T19:26:46.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.217+0000 7f49b3336700 1 -- 172.21.15.149:0/2055643172 shutdown_connections 2023-11-08T19:26:46.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.217+0000 7f49b3336700 1 --2- 172.21.15.149:0/2055643172 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49ac0668e0 0x7f49ac06bb90 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:46.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.217+0000 7f49b3336700 1 -- 172.21.15.149:0/2055643172 >> 172.21.15.149:0/2055643172 conn(0x7f49ac071720 msgr2=0x7f49ac071b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:46.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.217+0000 7f49b3336700 1 -- 172.21.15.149:0/2055643172 shutdown_connections 2023-11-08T19:26:46.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.217+0000 7f49b3336700 1 -- 172.21.15.149:0/2055643172 wait complete. 2023-11-08T19:26:46.227 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.218+0000 7f49b3336700 1 Processor -- start 2023-11-08T19:26:46.227 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.219+0000 7f49b3336700 1 -- start start 2023-11-08T19:26:46.227 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.219+0000 7f49b3336700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f49ac0668e0 0x7f49ac1f6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:46.227 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.219+0000 7f49b3336700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49ac0b5840 0x7f49ac06de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:46.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.219+0000 7f49b3336700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49ac15efb0 0x7f49ac150bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:46.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.219+0000 7f49b3336700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49ac156750 con 0x7f49ac15efb0 2023-11-08T19:26:46.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.219+0000 7f49b3336700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49ac06e3a0 con 0x7f49ac0b5840 2023-11-08T19:26:46.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.219+0000 7f49b3336700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49ac06e670 con 0x7f49ac0668e0 2023-11-08T19:26:46.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.219+0000 7f49b18d3700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49ac15efb0 0x7f49ac150bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:46.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.219+0000 7f49b18d3700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49ac15efb0 0x7f49ac150bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43340/0 (socket says 172.21.15.149:43340) 2023-11-08T19:26:46.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.219+0000 7f49b18d3700 1 -- 172.21.15.149:0/2116176692 learned_addr learned my addr 172.21.15.149:0/2116176692 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:46.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.220+0000 7f49b10d2700 1 --2- 172.21.15.149:0/2116176692 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f49ac0668e0 0x7f49ac1f6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:46.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.220+0000 7f49b08d1700 1 --2- 172.21.15.149:0/2116176692 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49ac0b5840 0x7f49ac06de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:46.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.220+0000 7f49b18d3700 1 -- 172.21.15.149:0/2116176692 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f49ac0668e0 msgr2=0x7f49ac1f6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:46.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.220+0000 7f49b18d3700 1 --2- 172.21.15.149:0/2116176692 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f49ac0668e0 0x7f49ac1f6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:46.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.220+0000 7f49b18d3700 1 -- 172.21.15.149:0/2116176692 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49ac0b5840 msgr2=0x7f49ac06de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:46.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.220+0000 7f49b18d3700 1 --2- 172.21.15.149:0/2116176692 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49ac0b5840 0x7f49ac06de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:46.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.220+0000 7f49b18d3700 1 -- 172.21.15.149:0/2116176692 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f499c0094a0 con 0x7f49ac15efb0 2023-11-08T19:26:46.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.220+0000 7f49b18d3700 1 --2- 172.21.15.149:0/2116176692 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49ac15efb0 0x7f49ac150bc0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f49a400cc10 tx=0x7f49a400cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:46.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.220+0000 7f49a1ffb700 1 -- 172.21.15.149:0/2116176692 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a400aa60 con 0x7f49ac15efb0 2023-11-08T19:26:46.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.220+0000 7f49a1ffb700 1 -- 172.21.15.149:0/2116176692 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49a400abc0 con 0x7f49ac15efb0 2023-11-08T19:26:46.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.220+0000 7f49b3336700 1 -- 172.21.15.149:0/2116176692 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49ac06e950 con 0x7f49ac15efb0 2023-11-08T19:26:46.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.220+0000 7f49a1ffb700 1 -- 172.21.15.149:0/2116176692 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a4012420 con 0x7f49ac15efb0 2023-11-08T19:26:46.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.220+0000 7f49b3336700 1 -- 172.21.15.149:0/2116176692 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49ac156960 con 0x7f49ac15efb0 2023-11-08T19:26:46.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.221+0000 7f49b3336700 1 -- 172.21.15.149:0/2116176692 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49ac06ee70 con 0x7f49ac15efb0 2023-11-08T19:26:46.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.222+0000 7f49a1ffb700 1 -- 172.21.15.149:0/2116176692 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f49a4012580 con 0x7f49ac15efb0 2023-11-08T19:26:46.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.222+0000 7f49a1ffb700 1 --2- 172.21.15.149:0/2116176692 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f499006af00 0x7f499006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:46.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.222+0000 7f49a1ffb700 1 -- 172.21.15.149:0/2116176692 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6268+0+0 (secure 0 0 0) 0x7f49a4089b10 con 0x7f49ac15efb0 2023-11-08T19:26:46.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.222+0000 7f49b10d2700 1 --2- 172.21.15.149:0/2116176692 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f499006af00 0x7f499006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:46.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.223+0000 7f49b10d2700 1 --2- 172.21.15.149:0/2116176692 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f499006af00 0x7f499006d3c0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f49a8005910 tx=0x7f49a8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:46.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.227+0000 7f49a1ffb700 1 -- 172.21.15.149:0/2116176692 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f49a4054990 con 0x7f49ac15efb0 2023-11-08T19:26:46.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.422+0000 7f49b3336700 1 -- 172.21.15.149:0/2116176692 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f49ac156b50 con 0x7f49ac15efb0 2023-11-08T19:26:46.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.422+0000 7f49a1ffb700 1 -- 172.21.15.149:0/2116176692 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v92) v1 ==== 84+0+287 (secure 0 0 0) 0x7f49a4057fb0 con 0x7f49ac15efb0 2023-11-08T19:26:46.424 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:26:46.424 INFO:teuthology.orchestra.run.smithi149.stdout:[ 2023-11-08T19:26:46.424 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:26:46.424 INFO:teuthology.orchestra.run.smithi149.stdout: "poolnum": 1, 2023-11-08T19:26:46.425 INFO:teuthology.orchestra.run.smithi149.stdout: "poolname": ".mgr" 2023-11-08T19:26:46.425 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:26:46.425 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:26:46.425 INFO:teuthology.orchestra.run.smithi149.stdout: "poolnum": 7, 2023-11-08T19:26:46.425 INFO:teuthology.orchestra.run.smithi149.stdout: "poolname": "snap-test-pool" 2023-11-08T19:26:46.426 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:26:46.426 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:26:46.426 INFO:teuthology.orchestra.run.smithi149.stdout: "poolnum": 12, 2023-11-08T19:26:46.426 INFO:teuthology.orchestra.run.smithi149.stdout: "poolname": "test_data_pool" 2023-11-08T19:26:46.426 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-11-08T19:26:46.427 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-11-08T19:26:46.427 INFO:teuthology.orchestra.run.smithi149.stdout: "poolnum": 13, 2023-11-08T19:26:46.427 INFO:teuthology.orchestra.run.smithi149.stdout: "poolname": "test_metadata_pool" 2023-11-08T19:26:46.427 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-11-08T19:26:46.427 INFO:teuthology.orchestra.run.smithi149.stdout:] 2023-11-08T19:26:46.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.424+0000 7f49b3336700 1 -- 172.21.15.149:0/2116176692 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f499006af00 msgr2=0x7f499006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:46.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.424+0000 7f49b3336700 1 --2- 172.21.15.149:0/2116176692 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f499006af00 0x7f499006d3c0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f49a8005910 tx=0x7f49a8009040 comp rx=0 tx=0).stop 2023-11-08T19:26:46.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.424+0000 7f49b3336700 1 -- 172.21.15.149:0/2116176692 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49ac15efb0 msgr2=0x7f49ac150bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:46.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.424+0000 7f49b3336700 1 --2- 172.21.15.149:0/2116176692 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49ac15efb0 0x7f49ac150bc0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f49a400cc10 tx=0x7f49a400cf20 comp rx=0 tx=0).stop 2023-11-08T19:26:46.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.424+0000 7f49b3336700 1 -- 172.21.15.149:0/2116176692 shutdown_connections 2023-11-08T19:26:46.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.424+0000 7f49b3336700 1 --2- 172.21.15.149:0/2116176692 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f499006af00 0x7f499006d3c0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:46.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.424+0000 7f49b3336700 1 --2- 172.21.15.149:0/2116176692 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49ac15efb0 0x7f49ac150bc0 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:46.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.424+0000 7f49b3336700 1 --2- 172.21.15.149:0/2116176692 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f49ac0668e0 0x7f49ac1f6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:46.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.424+0000 7f49b3336700 1 --2- 172.21.15.149:0/2116176692 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49ac0b5840 0x7f49ac06de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:46.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.424+0000 7f49b3336700 1 -- 172.21.15.149:0/2116176692 >> 172.21.15.149:0/2116176692 conn(0x7f49ac071720 msgr2=0x7f49ac0b3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:46.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.424+0000 7f49b3336700 1 -- 172.21.15.149:0/2116176692 shutdown_connections 2023-11-08T19:26:46.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.424+0000 7f49b3336700 1 -- 172.21.15.149:0/2116176692 wait complete. 2023-11-08T19:26:46.438 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-08T19:26:46.438 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-08T19:26:46.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.562+0000 7fe4a4441700 1 Processor -- start 2023-11-08T19:26:46.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.562+0000 7fe4a4441700 1 -- start start 2023-11-08T19:26:46.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.563+0000 7fe4a4441700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe49c15a9a0 0x7fe49c0cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:46.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.563+0000 7fe4a4441700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe49c15e5b0 con 0x7fe49c0cff30 2023-11-08T19:26:46.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.563+0000 7fe4a4441700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe49c0ccbb0 con 0x7fe49c0cc750 2023-11-08T19:26:46.567 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.563+0000 7fe4a4441700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c0d03b0 con 0x7fe49c15a9a0 2023-11-08T19:26:46.567 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.564+0000 7fe4a19dc700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fe49c0cff30 0x7fe49c0cc040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:45346/0 (socket says 172.21.15.149:45346) 2023-11-08T19:26:46.567 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.564+0000 7fe4a19dc700 1 -- 172.21.15.149:0/3937120585 learned_addr learned my addr 172.21.15.149:0/3937120585 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:26:46.567 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.564+0000 7fe4a21dd700 1 --2- 172.21.15.149:0/3937120585 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe49c15a9a0 0x7fe49c0cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:46.567 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.564+0000 7fe4a11db700 1 -- 172.21.15.149:0/3937120585 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 976029675 0 0) 0x7fe49c15e5b0 con 0x7fe49c0cff30 2023-11-08T19:26:46.568 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.564+0000 7fe4a11db700 1 -- 172.21.15.149:0/3937120585 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4880035b0 con 0x7fe49c0cff30 2023-11-08T19:26:46.568 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.564+0000 7fe4a21dd700 1 -- 172.21.15.149:0/3937120585 >> v1:172.21.15.160:6789/0 conn(0x7fe49c0cc750 legacy=0x7fe49c072050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:46.568 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.564+0000 7fe4a11db700 1 -- 172.21.15.149:0/3937120585 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2657071089 0 0) 0x7fe49c0ccbb0 con 0x7fe49c0cc750 2023-11-08T19:26:46.568 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.564+0000 7fe4a21dd700 1 -- 172.21.15.149:0/3937120585 >> v1:172.21.15.149:6789/0 conn(0x7fe49c0cff30 legacy=0x7fe49c0cc040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:46.568 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.564+0000 7fe4a21dd700 1 -- 172.21.15.149:0/3937120585 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe49c0cce00 con 0x7fe49c15a9a0 2023-11-08T19:26:46.568 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.564+0000 7fe4a21dd700 1 --2- 172.21.15.149:0/3937120585 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe49c15a9a0 0x7fe49c0cf9f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe48c009870 tx=0x7fe48c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db86cf48f10db7c5 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:46.569 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.565+0000 7fe4a11db700 1 -- 172.21.15.149:0/3937120585 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48c011830 con 0x7fe49c15a9a0 2023-11-08T19:26:46.569 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.565+0000 7fe4a11db700 1 -- 172.21.15.149:0/3937120585 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe48c011990 con 0x7fe49c15a9a0 2023-11-08T19:26:46.569 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.565+0000 7fe4a11db700 1 -- 172.21.15.149:0/3937120585 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48c011d00 con 0x7fe49c15a9a0 2023-11-08T19:26:46.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.565+0000 7fe4a4441700 1 -- 172.21.15.149:0/3937120585 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe49c15a9a0 msgr2=0x7fe49c0cf9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:46.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.565+0000 7fe4a4441700 1 --2- 172.21.15.149:0/3937120585 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe49c15a9a0 0x7fe49c0cf9f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe48c009870 tx=0x7fe48c009b80 comp rx=0 tx=0).stop 2023-11-08T19:26:46.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.565+0000 7fe4a4441700 1 -- 172.21.15.149:0/3937120585 shutdown_connections 2023-11-08T19:26:46.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.565+0000 7fe4a4441700 1 --2- 172.21.15.149:0/3937120585 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe49c15a9a0 0x7fe49c0cf9f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:46.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.565+0000 7fe4a4441700 1 -- 172.21.15.149:0/3937120585 >> 172.21.15.149:0/3937120585 conn(0x7fe49c0d0740 msgr2=0x7fe49c0d0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:46.573 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.566+0000 7fe4a4441700 1 -- 172.21.15.149:0/3937120585 shutdown_connections 2023-11-08T19:26:46.573 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.566+0000 7fe4a4441700 1 -- 172.21.15.149:0/3937120585 wait complete. 2023-11-08T19:26:46.573 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.567+0000 7fe4a4441700 1 Processor -- start 2023-11-08T19:26:46.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.567+0000 7fe4a4441700 1 -- start start 2023-11-08T19:26:46.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.567+0000 7fe4a4441700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe49c0cc750 0x7fe49c14a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:46.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.567+0000 7fe4a4441700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe49c0cff30 0x7fe49c1f1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:46.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.567+0000 7fe4a4441700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe49c15a9a0 0x7fe49c1f4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:46.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.567+0000 7fe4a4441700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c1496d0 con 0x7fe49c0cff30 2023-11-08T19:26:46.575 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.567+0000 7fe4a4441700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c14b7b0 con 0x7fe49c15a9a0 2023-11-08T19:26:46.575 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.567+0000 7fe4a4441700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c14aba0 con 0x7fe49c0cc750 2023-11-08T19:26:46.575 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.568+0000 7fe4a19dc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe49c0cff30 0x7fe49c1f1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:46.575 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.568+0000 7fe4a19dc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe49c0cff30 0x7fe49c1f1a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43352/0 (socket says 172.21.15.149:43352) 2023-11-08T19:26:46.575 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.568+0000 7fe4a19dc700 1 -- 172.21.15.149:0/273162971 learned_addr learned my addr 172.21.15.149:0/273162971 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:46.576 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.568+0000 7fe4a21dd700 1 --2- 172.21.15.149:0/273162971 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe49c0cc750 0x7fe49c14a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:46.576 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.568+0000 7fe4a29de700 1 --2- 172.21.15.149:0/273162971 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe49c15a9a0 0x7fe49c1f4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:46.576 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.568+0000 7fe4a19dc700 1 -- 172.21.15.149:0/273162971 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe49c0cc750 msgr2=0x7fe49c14a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:46.576 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.568+0000 7fe4a19dc700 1 --2- 172.21.15.149:0/273162971 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe49c0cc750 0x7fe49c14a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:46.576 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.568+0000 7fe4a19dc700 1 -- 172.21.15.149:0/273162971 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe49c15a9a0 msgr2=0x7fe49c1f4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:46.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.568+0000 7fe4a19dc700 1 --2- 172.21.15.149:0/273162971 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe49c15a9a0 0x7fe49c1f4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:46.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.568+0000 7fe4a19dc700 1 -- 172.21.15.149:0/273162971 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe48c0094a0 con 0x7fe49c0cff30 2023-11-08T19:26:46.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.568+0000 7fe4a19dc700 1 --2- 172.21.15.149:0/273162971 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe49c0cff30 0x7fe49c1f1a90 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7fe49800c500 tx=0x7fe49800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:46.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.570+0000 7fe492ffd700 1 -- 172.21.15.149:0/273162971 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe498005d70 con 0x7fe49c0cff30 2023-11-08T19:26:46.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.570+0000 7fe492ffd700 1 -- 172.21.15.149:0/273162971 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4980070d0 con 0x7fe49c0cff30 2023-11-08T19:26:46.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.570+0000 7fe4a4441700 1 -- 172.21.15.149:0/273162971 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe49c14ae80 con 0x7fe49c0cff30 2023-11-08T19:26:46.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.570+0000 7fe492ffd700 1 -- 172.21.15.149:0/273162971 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe498007440 con 0x7fe49c0cff30 2023-11-08T19:26:46.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.570+0000 7fe4a4441700 1 -- 172.21.15.149:0/273162971 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe49c14b440 con 0x7fe49c0cff30 2023-11-08T19:26:46.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.571+0000 7fe4a4441700 1 -- 172.21.15.149:0/273162971 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe49c0745f0 con 0x7fe49c0cff30 2023-11-08T19:26:46.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.572+0000 7fe492ffd700 1 -- 172.21.15.149:0/273162971 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe4980075a0 con 0x7fe49c0cff30 2023-11-08T19:26:46.580 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.572+0000 7fe492ffd700 1 --2- 172.21.15.149:0/273162971 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe48006af00 0x7fe48006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:46.580 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.572+0000 7fe492ffd700 1 -- 172.21.15.149:0/273162971 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6268+0+0 (secure 0 0 0) 0x7fe498088ca0 con 0x7fe49c0cff30 2023-11-08T19:26:46.580 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.572+0000 7fe4a21dd700 1 --2- 172.21.15.149:0/273162971 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe48006af00 0x7fe48006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:46.580 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.572+0000 7fe4a21dd700 1 --2- 172.21.15.149:0/273162971 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe48006af00 0x7fe48006d3c0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fe48c0090b0 tx=0x7fe48c01c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:46.580 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.577+0000 7fe492ffd700 1 -- 172.21.15.149:0/273162971 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe498053aa0 con 0x7fe49c0cff30 2023-11-08T19:26:46.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:46.767+0000 7fe4a4441700 1 -- 172.21.15.149:0/273162971 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fe49c0d1490 con 0x7fe49c0cff30 2023-11-08T19:26:47.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.576+0000 7fe492ffd700 1 -- 172.21.15.149:0/273162971 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v93) v1 ==== 138+0+0 (secure 0 0 0) 0x7fe4980570c0 con 0x7fe49c0cff30 2023-11-08T19:26:47.581 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.579+0000 7fe4a4441700 1 -- 172.21.15.149:0/273162971 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe48006af00 msgr2=0x7fe48006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:47.581 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.579+0000 7fe4a4441700 1 --2- 172.21.15.149:0/273162971 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe48006af00 0x7fe48006d3c0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fe48c0090b0 tx=0x7fe48c01c040 comp rx=0 tx=0).stop 2023-11-08T19:26:47.581 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.579+0000 7fe4a4441700 1 -- 172.21.15.149:0/273162971 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe49c0cff30 msgr2=0x7fe49c1f1a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:47.581 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.579+0000 7fe4a4441700 1 --2- 172.21.15.149:0/273162971 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe49c0cff30 0x7fe49c1f1a90 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7fe49800c500 tx=0x7fe49800c810 comp rx=0 tx=0).stop 2023-11-08T19:26:47.581 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.579+0000 7fe4a4441700 1 -- 172.21.15.149:0/273162971 shutdown_connections 2023-11-08T19:26:47.582 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.579+0000 7fe4a4441700 1 --2- 172.21.15.149:0/273162971 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe48006af00 0x7fe48006d3c0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:47.582 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.579+0000 7fe4a4441700 1 --2- 172.21.15.149:0/273162971 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe49c15a9a0 0x7fe49c1f4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:47.582 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.579+0000 7fe4a4441700 1 --2- 172.21.15.149:0/273162971 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe49c0cc750 0x7fe49c14a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:47.582 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.579+0000 7fe4a4441700 1 --2- 172.21.15.149:0/273162971 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe49c0cff30 0x7fe49c1f1a90 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:47.582 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.579+0000 7fe4a4441700 1 -- 172.21.15.149:0/273162971 >> 172.21.15.149:0/273162971 conn(0x7fe49c0d0740 msgr2=0x7fe49c0b3390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:47.583 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.580+0000 7fe4a4441700 1 -- 172.21.15.149:0/273162971 shutdown_connections 2023-11-08T19:26:47.583 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.580+0000 7fe4a4441700 1 -- 172.21.15.149:0/273162971 wait complete. 2023-11-08T19:26:47.583 INFO:teuthology.orchestra.run.smithi149.stderr:pool 'cephfs_metadata' created 2023-11-08T19:26:47.601 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-08T19:26:47.731 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.730+0000 7f44100b3700 1 Processor -- start 2023-11-08T19:26:47.732 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.730+0000 7f44100b3700 1 -- start start 2023-11-08T19:26:47.734 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.731+0000 7f44100b3700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f440806d720 0x7f440806db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:47.734 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.731+0000 7f44100b3700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44080cc2d0 con 0x7f44080cace0 2023-11-08T19:26:47.734 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.731+0000 7f44100b3700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f440806e040 con 0x7f44080cd900 2023-11-08T19:26:47.735 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.731+0000 7f44100b3700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44080cb230 con 0x7f440806d720 2023-11-08T19:26:47.735 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.731+0000 7f440de4f700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f440806d720 0x7f440806db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:47.735 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.731+0000 7f440d64e700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f44080cace0 0x7f440815a400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:45360/0 (socket says 172.21.15.149:45360) 2023-11-08T19:26:47.735 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.731+0000 7f440d64e700 1 -- 172.21.15.149:0/3769775179 learned_addr learned my addr 172.21.15.149:0/3769775179 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:26:47.735 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.732+0000 7f440de4f700 1 -- 172.21.15.149:0/3769775179 >> v1:172.21.15.160:6789/0 conn(0x7f44080cd900 legacy=0x7f44080cdd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:47.736 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.732+0000 7f440de4f700 1 -- 172.21.15.149:0/3769775179 >> v1:172.21.15.149:6789/0 conn(0x7f44080cace0 legacy=0x7f440815a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:47.736 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.732+0000 7f440de4f700 1 -- 172.21.15.149:0/3769775179 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44080cb510 con 0x7f440806d720 2023-11-08T19:26:47.736 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.732+0000 7f440ce4d700 1 -- 172.21.15.149:0/3769775179 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4203930826 0 0) 0x7f4404001110 con 0x7f44080cace0 2023-11-08T19:26:47.736 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.732+0000 7f440de4f700 1 --2- 172.21.15.149:0/3769775179 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f440806d720 0x7f440806db00 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f43f8009840 tx=0x7f43f8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60fb9639c69a84d8 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:47.736 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.732+0000 7f440ce4d700 1 -- 172.21.15.149:0/3769775179 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f8011830 con 0x7f440806d720 2023-11-08T19:26:47.737 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.732+0000 7f440ce4d700 1 -- 172.21.15.149:0/3769775179 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43f8011990 con 0x7f440806d720 2023-11-08T19:26:47.737 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.732+0000 7f440ce4d700 1 -- 172.21.15.149:0/3769775179 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f8011d20 con 0x7f440806d720 2023-11-08T19:26:47.737 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.733+0000 7f44100b3700 1 -- 172.21.15.149:0/3769775179 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f440806d720 msgr2=0x7f440806db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:47.737 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.733+0000 7f44100b3700 1 --2- 172.21.15.149:0/3769775179 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f440806d720 0x7f440806db00 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f43f8009840 tx=0x7f43f8009b50 comp rx=0 tx=0).stop 2023-11-08T19:26:47.737 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.733+0000 7f44100b3700 1 -- 172.21.15.149:0/3769775179 shutdown_connections 2023-11-08T19:26:47.738 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.733+0000 7f44100b3700 1 --2- 172.21.15.149:0/3769775179 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f440806d720 0x7f440806db00 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:47.738 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.733+0000 7f44100b3700 1 -- 172.21.15.149:0/3769775179 >> 172.21.15.149:0/3769775179 conn(0x7f44080cc7b0 msgr2=0x7f44080ccbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:47.738 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.733+0000 7f44100b3700 1 -- 172.21.15.149:0/3769775179 shutdown_connections 2023-11-08T19:26:47.738 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.733+0000 7f44100b3700 1 -- 172.21.15.149:0/3769775179 wait complete. 2023-11-08T19:26:47.741 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.734+0000 7f44100b3700 1 Processor -- start 2023-11-08T19:26:47.741 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.734+0000 7f44100b3700 1 -- start start 2023-11-08T19:26:47.741 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.735+0000 7f44100b3700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f440806d720 0x7f44081f7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:47.741 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.735+0000 7f44100b3700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f44080cace0 0x7f44081f3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:47.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.735+0000 7f44100b3700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44080cd900 0x7f44080cdd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:47.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.735+0000 7f44100b3700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44081f4440 con 0x7f44080cd900 2023-11-08T19:26:47.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.735+0000 7f44100b3700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44080c7160 con 0x7f44080cace0 2023-11-08T19:26:47.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.735+0000 7f44100b3700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44081f7e80 con 0x7f440806d720 2023-11-08T19:26:47.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.735+0000 7f440e650700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44080cd900 0x7f44080cdd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:47.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.735+0000 7f440e650700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44080cd900 0x7f44080cdd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43368/0 (socket says 172.21.15.149:43368) 2023-11-08T19:26:47.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.735+0000 7f440e650700 1 -- 172.21.15.149:0/1521949087 learned_addr learned my addr 172.21.15.149:0/1521949087 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:47.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.735+0000 7f440de4f700 1 --2- 172.21.15.149:0/1521949087 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f440806d720 0x7f44081f7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:47.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.735+0000 7f440d64e700 1 --2- 172.21.15.149:0/1521949087 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f44080cace0 0x7f44081f3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:47.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.735+0000 7f440e650700 1 -- 172.21.15.149:0/1521949087 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f440806d720 msgr2=0x7f44081f7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:47.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.735+0000 7f440e650700 1 --2- 172.21.15.149:0/1521949087 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f440806d720 0x7f44081f7940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:47.744 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.735+0000 7f440e650700 1 -- 172.21.15.149:0/1521949087 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f44080cace0 msgr2=0x7f44081f3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:47.744 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.735+0000 7f440e650700 1 --2- 172.21.15.149:0/1521949087 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f44080cace0 0x7f44081f3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:47.744 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.735+0000 7f440e650700 1 -- 172.21.15.149:0/1521949087 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43f80094a0 con 0x7f44080cd900 2023-11-08T19:26:47.744 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.735+0000 7f440e650700 1 --2- 172.21.15.149:0/1521949087 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44080cd900 0x7f44080cdd30 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f440000cba0 tx=0x7f440000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:47.744 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.735+0000 7f43fe7fc700 1 -- 172.21.15.149:0/1521949087 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4400003c00 con 0x7f44080cd900 2023-11-08T19:26:47.745 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.735+0000 7f43fe7fc700 1 -- 172.21.15.149:0/1521949087 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4400003d60 con 0x7f44080cd900 2023-11-08T19:26:47.745 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.735+0000 7f44100b3700 1 -- 172.21.15.149:0/1521949087 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44081f3aa0 con 0x7f44080cd900 2023-11-08T19:26:47.745 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.735+0000 7f43fe7fc700 1 -- 172.21.15.149:0/1521949087 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440000aba0 con 0x7f44080cd900 2023-11-08T19:26:47.745 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.735+0000 7f44100b3700 1 -- 172.21.15.149:0/1521949087 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44081f4060 con 0x7f44080cd900 2023-11-08T19:26:47.745 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.736+0000 7f44100b3700 1 -- 172.21.15.149:0/1521949087 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f440804f730 con 0x7f44080cd900 2023-11-08T19:26:47.746 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.737+0000 7f43fe7fc700 1 -- 172.21.15.149:0/1521949087 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f440000ad00 con 0x7f44080cd900 2023-11-08T19:26:47.746 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.737+0000 7f43fe7fc700 1 --2- 172.21.15.149:0/1521949087 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f43ec06af00 0x7f43ec06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:47.746 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.737+0000 7f43fe7fc700 1 -- 172.21.15.149:0/1521949087 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6638+0+0 (secure 0 0 0) 0x7f4400089ac0 con 0x7f44080cd900 2023-11-08T19:26:47.746 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.737+0000 7f440de4f700 1 --2- 172.21.15.149:0/1521949087 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f43ec06af00 0x7f43ec06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:47.747 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.738+0000 7f440de4f700 1 --2- 172.21.15.149:0/1521949087 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f43ec06af00 0x7f43ec06d3c0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f43f8000c00 tx=0x7f43f801c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:47.747 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.742+0000 7f43fe7fc700 1 -- 172.21.15.149:0/1521949087 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f440008be60 con 0x7f44080cd900 2023-11-08T19:26:47.932 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:47.931+0000 7f44100b3700 1 -- 172.21.15.149:0/1521949087 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f44080cd2d0 con 0x7f44080cd900 2023-11-08T19:26:48.584 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.583+0000 7f43fe7fc700 1 -- 172.21.15.149:0/1521949087 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v94) v1 ==== 170+0+0 (secure 0 0 0) 0x7f440008be60 con 0x7f44080cd900 2023-11-08T19:26:48.587 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.586+0000 7f44100b3700 1 -- 172.21.15.149:0/1521949087 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f43ec06af00 msgr2=0x7f43ec06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:48.587 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.586+0000 7f44100b3700 1 --2- 172.21.15.149:0/1521949087 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f43ec06af00 0x7f43ec06d3c0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f43f8000c00 tx=0x7f43f801c040 comp rx=0 tx=0).stop 2023-11-08T19:26:48.588 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.586+0000 7f44100b3700 1 -- 172.21.15.149:0/1521949087 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44080cd900 msgr2=0x7f44080cdd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:48.588 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.586+0000 7f44100b3700 1 --2- 172.21.15.149:0/1521949087 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44080cd900 0x7f44080cdd30 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f440000cba0 tx=0x7f440000cf60 comp rx=0 tx=0).stop 2023-11-08T19:26:48.588 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.586+0000 7f44100b3700 1 -- 172.21.15.149:0/1521949087 shutdown_connections 2023-11-08T19:26:48.588 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.586+0000 7f44100b3700 1 --2- 172.21.15.149:0/1521949087 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f43ec06af00 0x7f43ec06d3c0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:48.588 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.586+0000 7f44100b3700 1 --2- 172.21.15.149:0/1521949087 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44080cd900 0x7f44080cdd30 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:48.589 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.586+0000 7f44100b3700 1 --2- 172.21.15.149:0/1521949087 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f440806d720 0x7f44081f7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:48.589 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.586+0000 7f44100b3700 1 --2- 172.21.15.149:0/1521949087 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f44080cace0 0x7f44081f3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:48.589 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.586+0000 7f44100b3700 1 -- 172.21.15.149:0/1521949087 >> 172.21.15.149:0/1521949087 conn(0x7f44080cc7b0 msgr2=0x7f44081596c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:48.589 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.586+0000 7f44100b3700 1 -- 172.21.15.149:0/1521949087 shutdown_connections 2023-11-08T19:26:48.589 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.586+0000 7f44100b3700 1 -- 172.21.15.149:0/1521949087 wait complete. 2023-11-08T19:26:48.590 INFO:teuthology.orchestra.run.smithi149.stderr:pool 'cephfs_data' created 2023-11-08T19:26:48.618 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-08T19:26:48.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.742+0000 7f9b75113700 1 Processor -- start 2023-11-08T19:26:48.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.742+0000 7f9b75113700 1 -- start start 2023-11-08T19:26:48.745 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.742+0000 7f9b75113700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9b7015abf0 0x7f9b700b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:48.746 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.742+0000 7f9b75113700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f9b700d1130 0x7f9b700cc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:48.746 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.742+0000 7f9b75113700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f9b700cc6a0 0x7f9b700ce210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:48.746 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.742+0000 7f9b75113700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b700b66a0 con 0x7f9b700cc6a0 2023-11-08T19:26:48.746 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.742+0000 7f9b75113700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b700d04a0 con 0x7f9b700d1130 2023-11-08T19:26:48.747 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.742+0000 7f9b75113700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b700b6470 con 0x7f9b7015abf0 2023-11-08T19:26:48.747 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.742+0000 7f9b6f59e700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f9b700cc6a0 0x7f9b700ce210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:48.747 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.742+0000 7f9b6f59e700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f9b700cc6a0 0x7f9b700ce210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43376/0 (socket says 172.21.15.149:43376) 2023-11-08T19:26:48.747 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.742+0000 7f9b6f59e700 1 -- 172.21.15.149:0/3459685441 learned_addr learned my addr 172.21.15.149:0/3459685441 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:48.747 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.743+0000 7f9b6ed9d700 1 --2- 172.21.15.149:0/3459685441 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9b7015abf0 0x7f9b700b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:48.748 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.743+0000 7f9b6e59c700 1 --2- 172.21.15.149:0/3459685441 >> v2:172.21.15.160:3300/0 conn(0x7f9b700d1130 0x7f9b700cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:48.748 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.743+0000 7f9b6f59e700 1 -- 172.21.15.149:0/3459685441 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9b7015abf0 msgr2=0x7f9b700b5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:48.748 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.743+0000 7f9b6f59e700 1 --2- 172.21.15.149:0/3459685441 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9b7015abf0 0x7f9b700b5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:48.748 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.743+0000 7f9b6f59e700 1 -- 172.21.15.149:0/3459685441 >> v2:172.21.15.160:3300/0 conn(0x7f9b700d1130 msgr2=0x7f9b700cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:48.748 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.743+0000 7f9b6f59e700 1 --2- 172.21.15.149:0/3459685441 >> v2:172.21.15.160:3300/0 conn(0x7f9b700d1130 0x7f9b700cc160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:48.749 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.743+0000 7f9b6f59e700 1 -- 172.21.15.149:0/3459685441 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b7015afd0 con 0x7f9b700cc6a0 2023-11-08T19:26:48.749 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.743+0000 7f9b6f59e700 1 --2- 172.21.15.149:0/3459685441 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9b700cc6a0 0x7f9b700ce210 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f9b7006d9a0 tx=0x7f9b6800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a83fb310bb0dee0a server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:48.749 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.743+0000 7f9b6dd9b700 1 -- 172.21.15.149:0/3459685441 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6800e070 con 0x7f9b700cc6a0 2023-11-08T19:26:48.749 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.743+0000 7f9b6dd9b700 1 -- 172.21.15.149:0/3459685441 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b6800b910 con 0x7f9b700cc6a0 2023-11-08T19:26:48.749 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.743+0000 7f9b6dd9b700 1 -- 172.21.15.149:0/3459685441 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6800bcc0 con 0x7f9b700cc6a0 2023-11-08T19:26:48.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.744+0000 7f9b75113700 1 -- 172.21.15.149:0/3459685441 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9b700cc6a0 msgr2=0x7f9b700ce210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:48.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.744+0000 7f9b75113700 1 --2- 172.21.15.149:0/3459685441 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9b700cc6a0 0x7f9b700ce210 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f9b7006d9a0 tx=0x7f9b6800b330 comp rx=0 tx=0).stop 2023-11-08T19:26:48.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.744+0000 7f9b75113700 1 -- 172.21.15.149:0/3459685441 shutdown_connections 2023-11-08T19:26:48.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.744+0000 7f9b75113700 1 --2- 172.21.15.149:0/3459685441 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9b700cc6a0 0x7f9b700ce210 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:48.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.744+0000 7f9b75113700 1 --2- 172.21.15.149:0/3459685441 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9b7015abf0 0x7f9b700b5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:48.751 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.744+0000 7f9b75113700 1 --2- 172.21.15.149:0/3459685441 >> v2:172.21.15.160:3300/0 conn(0x7f9b700d1130 0x7f9b700cc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:48.751 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.744+0000 7f9b75113700 1 -- 172.21.15.149:0/3459685441 >> 172.21.15.149:0/3459685441 conn(0x7f9b700d0640 msgr2=0x7f9b700d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:48.751 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.744+0000 7f9b75113700 1 -- 172.21.15.149:0/3459685441 shutdown_connections 2023-11-08T19:26:48.751 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.744+0000 7f9b75113700 1 -- 172.21.15.149:0/3459685441 wait complete. 2023-11-08T19:26:48.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.745+0000 7f9b75113700 1 Processor -- start 2023-11-08T19:26:48.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.745+0000 7f9b75113700 1 -- start start 2023-11-08T19:26:48.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.746+0000 7f9b75113700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9b700cc6a0 0x7f9b700ad9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:48.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.746+0000 7f9b75113700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9b700d1130 0x7f9b70150120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:48.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.746+0000 7f9b75113700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9b7015abf0 0x7f9b700b0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:48.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.746+0000 7f9b75113700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b700c7ff0 con 0x7f9b700d1130 2023-11-08T19:26:48.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.746+0000 7f9b75113700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b700adf00 con 0x7f9b7015abf0 2023-11-08T19:26:48.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.746+0000 7f9b75113700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b700c7970 con 0x7f9b700cc6a0 2023-11-08T19:26:48.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.746+0000 7f9b6e59c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9b700d1130 0x7f9b70150120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:48.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.746+0000 7f9b6e59c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9b700d1130 0x7f9b70150120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43380/0 (socket says 172.21.15.149:43380) 2023-11-08T19:26:48.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.746+0000 7f9b6e59c700 1 -- 172.21.15.149:0/61443976 learned_addr learned my addr 172.21.15.149:0/61443976 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:48.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.746+0000 7f9b6f59e700 1 --2- 172.21.15.149:0/61443976 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9b7015abf0 0x7f9b700b0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:48.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.746+0000 7f9b6ed9d700 1 --2- 172.21.15.149:0/61443976 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9b700cc6a0 0x7f9b700ad9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:48.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.746+0000 7f9b6e59c700 1 -- 172.21.15.149:0/61443976 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9b700cc6a0 msgr2=0x7f9b700ad9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:48.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.746+0000 7f9b6e59c700 1 --2- 172.21.15.149:0/61443976 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9b700cc6a0 0x7f9b700ad9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:48.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.746+0000 7f9b6e59c700 1 -- 172.21.15.149:0/61443976 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9b7015abf0 msgr2=0x7f9b700b0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:48.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.746+0000 7f9b6e59c700 1 --2- 172.21.15.149:0/61443976 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9b7015abf0 0x7f9b700b0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:48.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.746+0000 7f9b6e59c700 1 -- 172.21.15.149:0/61443976 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b68009b30 con 0x7f9b700d1130 2023-11-08T19:26:48.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.746+0000 7f9b6ed9d700 1 --2- 172.21.15.149:0/61443976 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9b700cc6a0 0x7f9b700ad9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:26:48.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.747+0000 7f9b6e59c700 1 --2- 172.21.15.149:0/61443976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9b700d1130 0x7f9b70150120 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f9b6000e9b0 tx=0x7f9b6000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:48.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.747+0000 7f9b577fe700 1 -- 172.21.15.149:0/61443976 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b60009710 con 0x7f9b700d1130 2023-11-08T19:26:48.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.747+0000 7f9b577fe700 1 -- 172.21.15.149:0/61443976 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b6000c7f0 con 0x7f9b700d1130 2023-11-08T19:26:48.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.747+0000 7f9b577fe700 1 -- 172.21.15.149:0/61443976 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6000cb60 con 0x7f9b700d1130 2023-11-08T19:26:48.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.747+0000 7f9b75113700 1 -- 172.21.15.149:0/61443976 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b700c6e60 con 0x7f9b700d1130 2023-11-08T19:26:48.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.747+0000 7f9b75113700 1 -- 172.21.15.149:0/61443976 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b700c7c10 con 0x7f9b700d1130 2023-11-08T19:26:48.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.748+0000 7f9b75113700 1 -- 172.21.15.149:0/61443976 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b7004f730 con 0x7f9b700d1130 2023-11-08T19:26:48.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.748+0000 7f9b577fe700 1 -- 172.21.15.149:0/61443976 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9b6000ccc0 con 0x7f9b700d1130 2023-11-08T19:26:48.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.749+0000 7f9b577fe700 1 --2- 172.21.15.149:0/61443976 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9b5c06af00 0x7f9b5c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:48.760 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.749+0000 7f9b577fe700 1 -- 172.21.15.149:0/61443976 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 7020+0+0 (secure 0 0 0) 0x7f9b60089b10 con 0x7f9b700d1130 2023-11-08T19:26:48.760 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.749+0000 7f9b6ed9d700 1 --2- 172.21.15.149:0/61443976 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9b5c06af00 0x7f9b5c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:48.760 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.749+0000 7f9b6ed9d700 1 --2- 172.21.15.149:0/61443976 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9b5c06af00 0x7f9b5c06d3c0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f9b64009b10 tx=0x7f9b64008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:48.760 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.754+0000 7f9b577fe700 1 -- 172.21.15.149:0/61443976 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9b600546a0 con 0x7f9b700d1130 2023-11-08T19:26:48.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:48.985+0000 7f9b75113700 1 -- 172.21.15.149:0/61443976 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f9b700ca950 con 0x7f9b700d1130 2023-11-08T19:26:49.588 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.587+0000 7f9b577fe700 1 -- 172.21.15.149:0/61443976 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 16 and data pool 17 v50) v1 ==== 174+0+0 (secure 0 0 0) 0x7f9b60057cc0 con 0x7f9b700d1130 2023-11-08T19:26:49.592 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.590+0000 7f9b75113700 1 -- 172.21.15.149:0/61443976 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9b5c06af00 msgr2=0x7f9b5c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:49.592 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.590+0000 7f9b75113700 1 --2- 172.21.15.149:0/61443976 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9b5c06af00 0x7f9b5c06d3c0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f9b64009b10 tx=0x7f9b64008040 comp rx=0 tx=0).stop 2023-11-08T19:26:49.592 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.590+0000 7f9b75113700 1 -- 172.21.15.149:0/61443976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9b700d1130 msgr2=0x7f9b70150120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:49.592 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.590+0000 7f9b75113700 1 --2- 172.21.15.149:0/61443976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9b700d1130 0x7f9b70150120 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f9b6000e9b0 tx=0x7f9b6000ecc0 comp rx=0 tx=0).stop 2023-11-08T19:26:49.593 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.590+0000 7f9b75113700 1 -- 172.21.15.149:0/61443976 shutdown_connections 2023-11-08T19:26:49.593 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.590+0000 7f9b75113700 1 --2- 172.21.15.149:0/61443976 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9b5c06af00 0x7f9b5c06d3c0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:49.593 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.590+0000 7f9b75113700 1 --2- 172.21.15.149:0/61443976 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9b7015abf0 0x7f9b700b0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:49.593 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.590+0000 7f9b75113700 1 --2- 172.21.15.149:0/61443976 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9b700cc6a0 0x7f9b700ad9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:49.594 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.590+0000 7f9b75113700 1 --2- 172.21.15.149:0/61443976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9b700d1130 0x7f9b70150120 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:49.594 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.590+0000 7f9b75113700 1 -- 172.21.15.149:0/61443976 >> 172.21.15.149:0/61443976 conn(0x7f9b700d0640 msgr2=0x7f9b70072b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:49.594 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.590+0000 7f9b75113700 1 -- 172.21.15.149:0/61443976 shutdown_connections 2023-11-08T19:26:49.594 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.590+0000 7f9b75113700 1 -- 172.21.15.149:0/61443976 wait complete. 2023-11-08T19:26:49.595 INFO:teuthology.orchestra.run.smithi149.stderr:new fs with metadata pool 16 and data pool 17 2023-11-08T19:26:49.611 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:26:49.734 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.732+0000 7f0311e2e700 1 Processor -- start 2023-11-08T19:26:49.734 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.733+0000 7f0311e2e700 1 -- start start 2023-11-08T19:26:49.736 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.733+0000 7f0311e2e700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f030c15b950 0x7f030c0ce130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:49.737 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.733+0000 7f0311e2e700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f030c0cc2e0 con 0x7f030c0cd5e0 2023-11-08T19:26:49.737 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.733+0000 7f0311e2e700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f030c0cc580 con 0x7f030c0d0430 2023-11-08T19:26:49.737 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.733+0000 7f0311e2e700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f030c0cc820 con 0x7f030c15b950 2023-11-08T19:26:49.737 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.733+0000 7f030b7fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f030c15b950 0x7f030c0ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:49.737 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.733+0000 7f030affd700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f030c0cd5e0 0x7f030c0cfd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:45388/0 (socket says 172.21.15.149:45388) 2023-11-08T19:26:49.738 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.733+0000 7f030affd700 1 -- 172.21.15.149:0/483415782 learned_addr learned my addr 172.21.15.149:0/483415782 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:26:49.738 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.734+0000 7f030b7fe700 1 -- 172.21.15.149:0/483415782 >> v1:172.21.15.160:6789/0 conn(0x7f030c0d0430 legacy=0x7f030c1658e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:49.738 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.734+0000 7f030b7fe700 1 -- 172.21.15.149:0/483415782 >> v1:172.21.15.149:6789/0 conn(0x7f030c0cd5e0 legacy=0x7f030c0cfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:49.738 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.734+0000 7f030b7fe700 1 -- 172.21.15.149:0/483415782 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f030c0ccb00 con 0x7f030c15b950 2023-11-08T19:26:49.738 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.734+0000 7f030b7fe700 1 --2- 172.21.15.149:0/483415782 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f030c15b950 0x7f030c0ce130 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f02fc009820 tx=0x7f02fc009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98d07e2c5cd7a6a8 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:49.739 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.734+0000 7f030a7fc700 1 -- 172.21.15.149:0/483415782 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02fc005e30 con 0x7f030c15b950 2023-11-08T19:26:49.739 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.734+0000 7f030a7fc700 1 -- 172.21.15.149:0/483415782 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02fc004030 con 0x7f030c15b950 2023-11-08T19:26:49.739 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.734+0000 7f030a7fc700 1 -- 172.21.15.149:0/483415782 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02fc0043c0 con 0x7f030c15b950 2023-11-08T19:26:49.739 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.735+0000 7f0311e2e700 1 -- 172.21.15.149:0/483415782 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f030c15b950 msgr2=0x7f030c0ce130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:49.739 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.735+0000 7f0311e2e700 1 --2- 172.21.15.149:0/483415782 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f030c15b950 0x7f030c0ce130 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f02fc009820 tx=0x7f02fc009b30 comp rx=0 tx=0).stop 2023-11-08T19:26:49.740 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.735+0000 7f0311e2e700 1 -- 172.21.15.149:0/483415782 shutdown_connections 2023-11-08T19:26:49.740 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.735+0000 7f0311e2e700 1 --2- 172.21.15.149:0/483415782 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f030c15b950 0x7f030c0ce130 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:49.740 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.735+0000 7f0311e2e700 1 -- 172.21.15.149:0/483415782 >> 172.21.15.149:0/483415782 conn(0x7f030c08afd0 msgr2=0x7f030c0d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:49.740 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.735+0000 7f0311e2e700 1 -- 172.21.15.149:0/483415782 shutdown_connections 2023-11-08T19:26:49.740 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.735+0000 7f0311e2e700 1 -- 172.21.15.149:0/483415782 wait complete. 2023-11-08T19:26:49.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.736+0000 7f0311e2e700 1 Processor -- start 2023-11-08T19:26:49.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.736+0000 7f0311e2e700 1 -- start start 2023-11-08T19:26:49.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.737+0000 7f0311e2e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f030c0d0430 0x7f030c157d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:49.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.737+0000 7f0311e2e700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f030c15b950 0x7f030c06cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:49.744 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.737+0000 7f0311e2e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f030c06d0c0 0x7f030c1f3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:49.744 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.737+0000 7f0311e2e700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f030c158280 con 0x7f030c0d0430 2023-11-08T19:26:49.744 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.737+0000 7f0311e2e700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f030c15eee0 con 0x7f030c06d0c0 2023-11-08T19:26:49.744 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.737+0000 7f0311e2e700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f030c06bdc0 con 0x7f030c15b950 2023-11-08T19:26:49.745 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.737+0000 7f030b7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f030c0d0430 0x7f030c157d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:49.745 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.737+0000 7f030b7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f030c0d0430 0x7f030c157d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43392/0 (socket says 172.21.15.149:43392) 2023-11-08T19:26:49.745 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.737+0000 7f030b7fe700 1 -- 172.21.15.149:0/2006280877 learned_addr learned my addr 172.21.15.149:0/2006280877 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:49.745 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.737+0000 7f030b7fe700 1 -- 172.21.15.149:0/2006280877 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f030c15b950 msgr2=0x7f030c06cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:49.745 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.737+0000 7f030b7fe700 1 --2- 172.21.15.149:0/2006280877 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f030c15b950 0x7f030c06cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:49.746 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.737+0000 7f030b7fe700 1 -- 172.21.15.149:0/2006280877 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f030c06d0c0 msgr2=0x7f030c1f3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:49.746 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.737+0000 7f030bfff700 1 --2- 172.21.15.149:0/2006280877 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f030c06d0c0 0x7f030c1f3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:49.746 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.737+0000 7f030b7fe700 1 --2- 172.21.15.149:0/2006280877 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f030c06d0c0 0x7f030c1f3b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:49.746 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.737+0000 7f030b7fe700 1 -- 172.21.15.149:0/2006280877 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02fc009430 con 0x7f030c0d0430 2023-11-08T19:26:49.746 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.737+0000 7f030b7fe700 1 --2- 172.21.15.149:0/2006280877 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f030c0d0430 0x7f030c157d40 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f02fc000c00 tx=0x7f02fc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:49.747 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.737+0000 7f02f3fff700 1 -- 172.21.15.149:0/2006280877 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02fc01c620 con 0x7f030c0d0430 2023-11-08T19:26:49.747 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.737+0000 7f02f3fff700 1 -- 172.21.15.149:0/2006280877 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02fc01c7a0 con 0x7f030c0d0430 2023-11-08T19:26:49.747 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.737+0000 7f0311e2e700 1 -- 172.21.15.149:0/2006280877 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f030c06c0a0 con 0x7f030c0d0430 2023-11-08T19:26:49.747 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.738+0000 7f02f3fff700 1 -- 172.21.15.149:0/2006280877 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02fc01cb50 con 0x7f030c0d0430 2023-11-08T19:26:49.747 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.738+0000 7f0311e2e700 1 -- 172.21.15.149:0/2006280877 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f030c06c660 con 0x7f030c0d0430 2023-11-08T19:26:49.748 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.738+0000 7f0311e2e700 1 -- 172.21.15.149:0/2006280877 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f030c06c850 con 0x7f030c0d0430 2023-11-08T19:26:49.748 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.740+0000 7f02f3fff700 1 -- 172.21.15.149:0/2006280877 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f02fc01ccb0 con 0x7f030c0d0430 2023-11-08T19:26:49.748 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.740+0000 7f02f3fff700 1 --2- 172.21.15.149:0/2006280877 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f02f806af00 0x7f02f806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:49.748 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.741+0000 7f02f3fff700 1 -- 172.21.15.149:0/2006280877 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f02fc08b410 con 0x7f030c0d0430 2023-11-08T19:26:49.748 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.741+0000 7f030affd700 1 --2- 172.21.15.149:0/2006280877 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f02f806af00 0x7f02f806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:49.748 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.741+0000 7f030affd700 1 --2- 172.21.15.149:0/2006280877 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f02f806af00 0x7f02f806d3c0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f0300000f60 tx=0x7f0300007b10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:49.749 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.744+0000 7f02f3fff700 1 -- 172.21.15.149:0/2006280877 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f02fc055fd0 con 0x7f030c0d0430 2023-11-08T19:26:49.937 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.936+0000 7f0311e2e700 1 -- 172.21.15.149:0/2006280877 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f030c0745f0 con 0x7f030c0d0430 2023-11-08T19:26:49.939 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.938+0000 7f02f3fff700 1 -- 172.21.15.149:0/2006280877 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+22054 (secure 0 0 0) 0x7f02fc016090 con 0x7f030c0d0430 2023-11-08T19:26:49.940 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:26:49.940 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":95,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:26:48.986812+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-08T19:24:29.516185+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-08T19:25:44.287064+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":71,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-08T19:25:45.623521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-11-08T19:26:46.785987+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-11-08T19:26:47.950353+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:26:49.942 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.940+0000 7f0311e2e700 1 -- 172.21.15.149:0/2006280877 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f02f806af00 msgr2=0x7f02f806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:49.942 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.940+0000 7f0311e2e700 1 --2- 172.21.15.149:0/2006280877 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f02f806af00 0x7f02f806d3c0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f0300000f60 tx=0x7f0300007b10 comp rx=0 tx=0).stop 2023-11-08T19:26:49.942 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.940+0000 7f0311e2e700 1 -- 172.21.15.149:0/2006280877 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f030c0d0430 msgr2=0x7f030c157d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:49.942 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.940+0000 7f0311e2e700 1 --2- 172.21.15.149:0/2006280877 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f030c0d0430 0x7f030c157d40 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f02fc000c00 tx=0x7f02fc004750 comp rx=0 tx=0).stop 2023-11-08T19:26:49.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.940+0000 7f0311e2e700 1 -- 172.21.15.149:0/2006280877 shutdown_connections 2023-11-08T19:26:49.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.940+0000 7f0311e2e700 1 --2- 172.21.15.149:0/2006280877 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f02f806af00 0x7f02f806d3c0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:49.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.940+0000 7f0311e2e700 1 --2- 172.21.15.149:0/2006280877 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f030c06d0c0 0x7f030c1f3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:49.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.940+0000 7f0311e2e700 1 --2- 172.21.15.149:0/2006280877 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f030c0d0430 0x7f030c157d40 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:49.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.940+0000 7f0311e2e700 1 --2- 172.21.15.149:0/2006280877 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f030c15b950 0x7f030c06cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:49.944 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.941+0000 7f0311e2e700 1 -- 172.21.15.149:0/2006280877 >> 172.21.15.149:0/2006280877 conn(0x7f030c08afd0 msgr2=0x7f030c0b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:49.944 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.941+0000 7f0311e2e700 1 -- 172.21.15.149:0/2006280877 shutdown_connections 2023-11-08T19:26:49.944 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:49.941+0000 7f0311e2e700 1 -- 172.21.15.149:0/2006280877 wait complete. 2023-11-08T19:26:49.955 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:26:50.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.077+0000 7f60af232700 1 Processor -- start 2023-11-08T19:26:50.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.078+0000 7f60af232700 1 -- start start 2023-11-08T19:26:50.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.078+0000 7f60af232700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f60a806e020 0x7f60a806bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:50.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.078+0000 7f60af232700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f60a806c0d0 0x7f60a80b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:50.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.078+0000 7f60af232700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60a815af90 con 0x7f60a815abb0 2023-11-08T19:26:50.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.078+0000 7f60af232700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60a806e480 con 0x7f60a806c0d0 2023-11-08T19:26:50.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.078+0000 7f60af232700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60a806c560 con 0x7f60a806e020 2023-11-08T19:26:50.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.079+0000 7f60a7fff700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f60a806e020 0x7f60a806bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:50.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.079+0000 7f60acfce700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f60a815abb0 0x7f60a806e7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.149:57068/0 (socket says 172.21.15.149:57068) 2023-11-08T19:26:50.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.079+0000 7f60ad7cf700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f60a806c0d0 0x7f60a80b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:50.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.079+0000 7f60acfce700 1 -- 172.21.15.149:0/4092251385 learned_addr learned my addr 172.21.15.149:0/4092251385 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:26:50.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.079+0000 7f60a7fff700 1 -- 172.21.15.149:0/4092251385 >> v2:172.21.15.160:3300/0 conn(0x7f60a806c0d0 msgr2=0x7f60a80b2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:50.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.079+0000 7f60a7fff700 1 --2- 172.21.15.149:0/4092251385 >> v2:172.21.15.160:3300/0 conn(0x7f60a806c0d0 0x7f60a80b2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:50.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.079+0000 7f60a7fff700 1 -- 172.21.15.149:0/4092251385 >> v1:172.21.15.160:6789/0 conn(0x7f60a815abb0 legacy=0x7f60a806e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:50.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.079+0000 7f60a77fe700 1 -- 172.21.15.149:0/4092251385 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1335197551 0 0) 0x7f60a815af90 con 0x7f60a815abb0 2023-11-08T19:26:50.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.079+0000 7f60a7fff700 1 -- 172.21.15.149:0/4092251385 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a806f260 con 0x7f60a806e020 2023-11-08T19:26:50.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.079+0000 7f60ad7cf700 1 --2- 172.21.15.149:0/4092251385 >> v2:172.21.15.160:3300/0 conn(0x7f60a806c0d0 0x7f60a80b2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:26:50.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.079+0000 7f60a7fff700 1 --2- 172.21.15.149:0/4092251385 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f60a806e020 0x7f60a806bb90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6094009840 tx=0x7f6094009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f52c408383d1be22 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:50.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.079+0000 7f60a77fe700 1 -- 172.21.15.149:0/4092251385 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6094011830 con 0x7f60a806e020 2023-11-08T19:26:50.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.079+0000 7f60a77fe700 1 -- 172.21.15.149:0/4092251385 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6094011990 con 0x7f60a806e020 2023-11-08T19:26:50.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.079+0000 7f60a77fe700 1 -- 172.21.15.149:0/4092251385 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6094011d20 con 0x7f60a806e020 2023-11-08T19:26:50.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.080+0000 7f60af232700 1 -- 172.21.15.149:0/4092251385 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f60a806e020 msgr2=0x7f60a806bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:50.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.080+0000 7f60af232700 1 --2- 172.21.15.149:0/4092251385 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f60a806e020 0x7f60a806bb90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6094009840 tx=0x7f6094009b50 comp rx=0 tx=0).stop 2023-11-08T19:26:50.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.080+0000 7f60af232700 1 -- 172.21.15.149:0/4092251385 shutdown_connections 2023-11-08T19:26:50.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.080+0000 7f60af232700 1 --2- 172.21.15.149:0/4092251385 >> v2:172.21.15.160:3300/0 conn(0x7f60a806c0d0 0x7f60a80b2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:50.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.080+0000 7f60af232700 1 --2- 172.21.15.149:0/4092251385 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f60a806e020 0x7f60a806bb90 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:50.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.080+0000 7f60af232700 1 -- 172.21.15.149:0/4092251385 >> 172.21.15.149:0/4092251385 conn(0x7f60a8071720 msgr2=0x7f60a8071b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:50.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.080+0000 7f60af232700 1 -- 172.21.15.149:0/4092251385 shutdown_connections 2023-11-08T19:26:50.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.080+0000 7f60af232700 1 -- 172.21.15.149:0/4092251385 wait complete. 2023-11-08T19:26:50.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.082+0000 7f60af232700 1 Processor -- start 2023-11-08T19:26:50.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.082+0000 7f60af232700 1 -- start start 2023-11-08T19:26:50.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.083+0000 7f60af232700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60a806c0d0 0x7f60a81f4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:50.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.083+0000 7f60af232700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f60a806e020 0x7f60a80cbe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:50.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.083+0000 7f60af232700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f60a815abb0 0x7f60a8156490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:50.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.083+0000 7f60af232700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a81f5530 con 0x7f60a806c0d0 2023-11-08T19:26:50.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.083+0000 7f60af232700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a80cc3d0 con 0x7f60a806e020 2023-11-08T19:26:50.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.083+0000 7f60af232700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60a81f4c90 con 0x7f60a815abb0 2023-11-08T19:26:50.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.083+0000 7f60acfce700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60a806c0d0 0x7f60a81f4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:50.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.083+0000 7f60acfce700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60a806c0d0 0x7f60a81f4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43406/0 (socket says 172.21.15.149:43406) 2023-11-08T19:26:50.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.083+0000 7f60acfce700 1 -- 172.21.15.149:0/3288252729 learned_addr learned my addr 172.21.15.149:0/3288252729 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:50.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.083+0000 7f60ad7cf700 1 --2- 172.21.15.149:0/3288252729 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f60a815abb0 0x7f60a8156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:50.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.083+0000 7f60a7fff700 1 --2- 172.21.15.149:0/3288252729 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f60a806e020 0x7f60a80cbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:50.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.083+0000 7f60acfce700 1 -- 172.21.15.149:0/3288252729 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f60a815abb0 msgr2=0x7f60a8156490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:50.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.083+0000 7f60acfce700 1 --2- 172.21.15.149:0/3288252729 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f60a815abb0 0x7f60a8156490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:50.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.083+0000 7f60acfce700 1 -- 172.21.15.149:0/3288252729 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f60a806e020 msgr2=0x7f60a80cbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:50.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.083+0000 7f60acfce700 1 --2- 172.21.15.149:0/3288252729 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f60a806e020 0x7f60a80cbe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:50.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.083+0000 7f60acfce700 1 -- 172.21.15.149:0/3288252729 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a0009a70 con 0x7f60a806c0d0 2023-11-08T19:26:50.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.083+0000 7f60ad7cf700 1 --2- 172.21.15.149:0/3288252729 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f60a815abb0 0x7f60a8156490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:26:50.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.083+0000 7f60acfce700 1 --2- 172.21.15.149:0/3288252729 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60a806c0d0 0x7f60a81f4640 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f609c00c550 tx=0x7f609c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:50.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.083+0000 7f60a57fa700 1 -- 172.21.15.149:0/3288252729 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609c004c80 con 0x7f60a806c0d0 2023-11-08T19:26:50.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.084+0000 7f60a57fa700 1 -- 172.21.15.149:0/3288252729 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f609c004e00 con 0x7f60a806c0d0 2023-11-08T19:26:50.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.084+0000 7f60af232700 1 -- 172.21.15.149:0/3288252729 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60940094a0 con 0x7f60a806c0d0 2023-11-08T19:26:50.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.084+0000 7f60a57fa700 1 -- 172.21.15.149:0/3288252729 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609c007310 con 0x7f60a806c0d0 2023-11-08T19:26:50.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.084+0000 7f60af232700 1 -- 172.21.15.149:0/3288252729 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60a81f5250 con 0x7f60a806c0d0 2023-11-08T19:26:50.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.084+0000 7f60af232700 1 -- 172.21.15.149:0/3288252729 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60a8072240 con 0x7f60a806c0d0 2023-11-08T19:26:50.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.085+0000 7f60a57fa700 1 -- 172.21.15.149:0/3288252729 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f609c007470 con 0x7f60a806c0d0 2023-11-08T19:26:50.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.085+0000 7f60a57fa700 1 --2- 172.21.15.149:0/3288252729 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f608c06af00 0x7f608c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:50.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.086+0000 7f60a7fff700 1 --2- 172.21.15.149:0/3288252729 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f608c06af00 0x7f608c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:50.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.086+0000 7f60a57fa700 1 -- 172.21.15.149:0/3288252729 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f609c089850 con 0x7f60a806c0d0 2023-11-08T19:26:50.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.086+0000 7f60a7fff700 1 --2- 172.21.15.149:0/3288252729 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f608c06af00 0x7f608c06d3c0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f6094000c00 tx=0x7f6094008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:50.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.090+0000 7f60a57fa700 1 -- 172.21.15.149:0/3288252729 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f609c054380 con 0x7f60a806c0d0 2023-11-08T19:26:50.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.284+0000 7f60af232700 1 -- 172.21.15.149:0/3288252729 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60a80745f0 con 0x7f60a806c0d0 2023-11-08T19:26:50.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.286+0000 7f60a57fa700 1 -- 172.21.15.149:0/3288252729 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) v1 ==== 74+0+22041 (secure 0 0 0) 0x7f609c0579a0 con 0x7f60a806c0d0 2023-11-08T19:26:50.287 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:26:50.287 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":96,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:26:50.125692+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-08T19:24:29.516185+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-08T19:25:44.287064+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":71,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-08T19:25:45.623521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-11-08T19:26:46.785987+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-11-08T19:26:47.950353+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:26:50.290 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.289+0000 7f60af232700 1 -- 172.21.15.149:0/3288252729 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f608c06af00 msgr2=0x7f608c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:50.290 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.289+0000 7f60af232700 1 --2- 172.21.15.149:0/3288252729 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f608c06af00 0x7f608c06d3c0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f6094000c00 tx=0x7f6094008030 comp rx=0 tx=0).stop 2023-11-08T19:26:50.291 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.289+0000 7f60af232700 1 -- 172.21.15.149:0/3288252729 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60a806c0d0 msgr2=0x7f60a81f4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:50.291 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.289+0000 7f60af232700 1 --2- 172.21.15.149:0/3288252729 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60a806c0d0 0x7f60a81f4640 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f609c00c550 tx=0x7f609c00c910 comp rx=0 tx=0).stop 2023-11-08T19:26:50.291 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.289+0000 7f60af232700 1 -- 172.21.15.149:0/3288252729 shutdown_connections 2023-11-08T19:26:50.291 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.289+0000 7f60af232700 1 --2- 172.21.15.149:0/3288252729 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f608c06af00 0x7f608c06d3c0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:50.291 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.289+0000 7f60af232700 1 --2- 172.21.15.149:0/3288252729 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f60a815abb0 0x7f60a8156490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:50.292 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.289+0000 7f60af232700 1 --2- 172.21.15.149:0/3288252729 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60a806c0d0 0x7f60a81f4640 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:50.292 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.289+0000 7f60af232700 1 --2- 172.21.15.149:0/3288252729 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f60a806e020 0x7f60a80cbe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:50.292 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.289+0000 7f60af232700 1 -- 172.21.15.149:0/3288252729 >> 172.21.15.149:0/3288252729 conn(0x7f60a8071720 msgr2=0x7f60a806ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:50.292 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.289+0000 7f60af232700 1 -- 172.21.15.149:0/3288252729 shutdown_connections 2023-11-08T19:26:50.292 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.289+0000 7f60af232700 1 -- 172.21.15.149:0/3288252729 wait complete. 2023-11-08T19:26:50.303 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-08T19:26:50.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.426+0000 7f3297536700 1 Processor -- start 2023-11-08T19:26:50.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.426+0000 7f3297536700 1 -- start start 2023-11-08T19:26:50.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.427+0000 7f3297536700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f329015df40 0x7f329006c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:50.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.427+0000 7f3297536700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f329006ab80 0x7f329006c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:50.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.427+0000 7f3297536700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f329015e320 con 0x7f32900cf1c0 2023-11-08T19:26:50.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.427+0000 7f3297536700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f329006b020 con 0x7f329006ab80 2023-11-08T19:26:50.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.427+0000 7f3297536700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f329006b2e0 con 0x7f329015df40 2023-11-08T19:26:50.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.427+0000 7f3294ad1700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f329006ab80 0x7f329006c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:50.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.427+0000 7f3295ad3700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f32900cf1c0 0x7f32900caf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:45418/0 (socket says 172.21.15.149:45418) 2023-11-08T19:26:50.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.427+0000 7f3295ad3700 1 -- 172.21.15.149:0/1423365538 learned_addr learned my addr 172.21.15.149:0/1423365538 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:26:50.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.428+0000 7f32952d2700 1 --2- 172.21.15.149:0/1423365538 >> v2:172.21.15.160:3300/0 conn(0x7f329015df40 0x7f329006c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:50.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.428+0000 7f3294ad1700 1 -- 172.21.15.149:0/1423365538 >> v2:172.21.15.160:3300/0 conn(0x7f329015df40 msgr2=0x7f329006c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:50.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.428+0000 7f3294ad1700 1 --2- 172.21.15.149:0/1423365538 >> v2:172.21.15.160:3300/0 conn(0x7f329015df40 0x7f329006c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:50.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.428+0000 7f3294ad1700 1 -- 172.21.15.149:0/1423365538 >> v1:172.21.15.149:6789/0 conn(0x7f32900cf1c0 legacy=0x7f32900caf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:50.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.428+0000 7f3294ad1700 1 -- 172.21.15.149:0/1423365538 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f329006b5c0 con 0x7f329006ab80 2023-11-08T19:26:50.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.428+0000 7f3287fff700 1 -- 172.21.15.149:0/1423365538 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 302897168 0 0) 0x7f329015e320 con 0x7f32900cf1c0 2023-11-08T19:26:50.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.428+0000 7f32952d2700 1 --2- 172.21.15.149:0/1423365538 >> v2:172.21.15.160:3300/0 conn(0x7f329015df40 0x7f329006c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:26:50.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.428+0000 7f3294ad1700 1 --2- 172.21.15.149:0/1423365538 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f329006ab80 0x7f329006c5e0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f32900ce190 tx=0x7f328c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e87fb69e0f61644b server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:50.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.428+0000 7f3287fff700 1 -- 172.21.15.149:0/1423365538 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f328c011830 con 0x7f329006ab80 2023-11-08T19:26:50.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.428+0000 7f3287fff700 1 -- 172.21.15.149:0/1423365538 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f328c011990 con 0x7f329006ab80 2023-11-08T19:26:50.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.428+0000 7f3287fff700 1 -- 172.21.15.149:0/1423365538 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f328c011d20 con 0x7f329006ab80 2023-11-08T19:26:50.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.429+0000 7f3297536700 1 -- 172.21.15.149:0/1423365538 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f329006ab80 msgr2=0x7f329006c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:50.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.429+0000 7f3297536700 1 --2- 172.21.15.149:0/1423365538 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f329006ab80 0x7f329006c5e0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f32900ce190 tx=0x7f328c009b20 comp rx=0 tx=0).stop 2023-11-08T19:26:50.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.429+0000 7f3297536700 1 -- 172.21.15.149:0/1423365538 shutdown_connections 2023-11-08T19:26:50.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.429+0000 7f3297536700 1 --2- 172.21.15.149:0/1423365538 >> v2:172.21.15.160:3300/0 conn(0x7f329015df40 0x7f329006c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:50.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.429+0000 7f3297536700 1 --2- 172.21.15.149:0/1423365538 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f329006ab80 0x7f329006c5e0 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:50.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.429+0000 7f3297536700 1 -- 172.21.15.149:0/1423365538 >> 172.21.15.149:0/1423365538 conn(0x7f32900d0640 msgr2=0x7f32900d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:50.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.429+0000 7f3297536700 1 -- 172.21.15.149:0/1423365538 shutdown_connections 2023-11-08T19:26:50.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.429+0000 7f3297536700 1 -- 172.21.15.149:0/1423365538 wait complete. 2023-11-08T19:26:50.440 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.430+0000 7f3297536700 1 Processor -- start 2023-11-08T19:26:50.440 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.430+0000 7f3297536700 1 -- start start 2023-11-08T19:26:50.440 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.431+0000 7f3297536700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f329006ab80 0x7f3290160c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:50.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.431+0000 7f3297536700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32900cf1c0 0x7f32901f7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:50.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.431+0000 7f3297536700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f329015df40 0x7f32900af380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:50.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.431+0000 7f3297536700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32900af8c0 con 0x7f329015df40 2023-11-08T19:26:50.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.431+0000 7f3297536700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32900ae5c0 con 0x7f32900cf1c0 2023-11-08T19:26:50.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.431+0000 7f3297536700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32900ae8a0 con 0x7f329006ab80 2023-11-08T19:26:50.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.431+0000 7f3295ad3700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f329015df40 0x7f32900af380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:50.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.431+0000 7f3295ad3700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f329015df40 0x7f32900af380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43422/0 (socket says 172.21.15.149:43422) 2023-11-08T19:26:50.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.431+0000 7f3295ad3700 1 -- 172.21.15.149:0/3500695277 learned_addr learned my addr 172.21.15.149:0/3500695277 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:50.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.432+0000 7f32952d2700 1 --2- 172.21.15.149:0/3500695277 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f329006ab80 0x7f3290160c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:50.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.432+0000 7f3294ad1700 1 --2- 172.21.15.149:0/3500695277 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32900cf1c0 0x7f32901f7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:50.443 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.432+0000 7f3295ad3700 1 -- 172.21.15.149:0/3500695277 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f329006ab80 msgr2=0x7f3290160c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:50.443 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.432+0000 7f3295ad3700 1 --2- 172.21.15.149:0/3500695277 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f329006ab80 0x7f3290160c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:50.443 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.432+0000 7f3295ad3700 1 -- 172.21.15.149:0/3500695277 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32900cf1c0 msgr2=0x7f32901f7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:50.443 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.432+0000 7f3295ad3700 1 --2- 172.21.15.149:0/3500695277 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32900cf1c0 0x7f32901f7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:50.443 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.432+0000 7f3295ad3700 1 -- 172.21.15.149:0/3500695277 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f328c0094a0 con 0x7f329015df40 2023-11-08T19:26:50.444 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.432+0000 7f32952d2700 1 --2- 172.21.15.149:0/3500695277 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f329006ab80 0x7f3290160c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:26:50.444 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.432+0000 7f3295ad3700 1 --2- 172.21.15.149:0/3500695277 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f329015df40 0x7f32900af380 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f328800cba0 tx=0x7f328800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:50.444 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.432+0000 7f3285ffb700 1 -- 172.21.15.149:0/3500695277 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f328800ab80 con 0x7f329015df40 2023-11-08T19:26:50.444 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.432+0000 7f3285ffb700 1 -- 172.21.15.149:0/3500695277 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f328800ace0 con 0x7f329015df40 2023-11-08T19:26:50.444 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.432+0000 7f3297536700 1 -- 172.21.15.149:0/3500695277 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32900aeb80 con 0x7f329015df40 2023-11-08T19:26:50.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.432+0000 7f3285ffb700 1 -- 172.21.15.149:0/3500695277 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3288007310 con 0x7f329015df40 2023-11-08T19:26:50.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.432+0000 7f3297536700 1 -- 172.21.15.149:0/3500695277 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32900ae220 con 0x7f329015df40 2023-11-08T19:26:50.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.433+0000 7f3297536700 1 -- 172.21.15.149:0/3500695277 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32900af0a0 con 0x7f329015df40 2023-11-08T19:26:50.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.434+0000 7f3285ffb700 1 -- 172.21.15.149:0/3500695277 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3288007470 con 0x7f329015df40 2023-11-08T19:26:50.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.434+0000 7f3285ffb700 1 --2- 172.21.15.149:0/3500695277 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f327406af00 0x7f327406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:50.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.434+0000 7f3285ffb700 1 -- 172.21.15.149:0/3500695277 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f3288089970 con 0x7f329015df40 2023-11-08T19:26:50.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.434+0000 7f32952d2700 1 --2- 172.21.15.149:0/3500695277 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f327406af00 0x7f327406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:50.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.434+0000 7f32952d2700 1 --2- 172.21.15.149:0/3500695277 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f327406af00 0x7f327406d3c0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f32800099b0 tx=0x7f3280008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:50.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.439+0000 7f3285ffb700 1 -- 172.21.15.149:0/3500695277 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f32900af0a0 con 0x7f329015df40 2023-11-08T19:26:50.678 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:50.677+0000 7f3297536700 1 -- 172.21.15.149:0/3500695277 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f32900af0a0 con 0x7f329015df40 2023-11-08T19:26:51.608 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.607+0000 7f3285ffb700 1 -- 172.21.15.149:0/3500695277 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v53) v1 ==== 118+0+0 (secure 0 0 0) 0x7f32900af0a0 con 0x7f329015df40 2023-11-08T19:26:51.611 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.610+0000 7f3297536700 1 -- 172.21.15.149:0/3500695277 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f327406af00 msgr2=0x7f327406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:51.611 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.610+0000 7f3297536700 1 --2- 172.21.15.149:0/3500695277 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f327406af00 0x7f327406d3c0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f32800099b0 tx=0x7f3280008040 comp rx=0 tx=0).stop 2023-11-08T19:26:51.612 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.610+0000 7f3297536700 1 -- 172.21.15.149:0/3500695277 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f329015df40 msgr2=0x7f32900af380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:51.612 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.610+0000 7f3297536700 1 --2- 172.21.15.149:0/3500695277 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f329015df40 0x7f32900af380 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f328800cba0 tx=0x7f328800cf60 comp rx=0 tx=0).stop 2023-11-08T19:26:51.612 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.610+0000 7f3297536700 1 -- 172.21.15.149:0/3500695277 shutdown_connections 2023-11-08T19:26:51.612 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.610+0000 7f3297536700 1 --2- 172.21.15.149:0/3500695277 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f327406af00 0x7f327406d3c0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:51.612 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.610+0000 7f3297536700 1 --2- 172.21.15.149:0/3500695277 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f329015df40 0x7f32900af380 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:51.613 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.610+0000 7f3297536700 1 --2- 172.21.15.149:0/3500695277 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f329006ab80 0x7f3290160c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:51.613 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.610+0000 7f3297536700 1 --2- 172.21.15.149:0/3500695277 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32900cf1c0 0x7f32901f7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:51.613 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.610+0000 7f3297536700 1 -- 172.21.15.149:0/3500695277 >> 172.21.15.149:0/3500695277 conn(0x7f32900d0640 msgr2=0x7f329015a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:51.613 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.610+0000 7f3297536700 1 -- 172.21.15.149:0/3500695277 shutdown_connections 2023-11-08T19:26:51.613 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.610+0000 7f3297536700 1 -- 172.21.15.149:0/3500695277 wait complete. 2023-11-08T19:26:51.626 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-08T19:26:51.626 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-08T19:26:51.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.754+0000 7feb8bfa2700 1 Processor -- start 2023-11-08T19:26:51.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.754+0000 7feb8bfa2700 1 -- start start 2023-11-08T19:26:51.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.755+0000 7feb8bfa2700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feb840722a0 0x7feb8406ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:51.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.755+0000 7feb8bfa2700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7feb840c7250 0x7feb8406b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:51.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.755+0000 7feb8bfa2700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7feb840cb610 0x7feb8406b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:51.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.755+0000 7feb8bfa2700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb8406cc00 con 0x7feb840cb610 2023-11-08T19:26:51.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.755+0000 7feb8bfa2700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb840b3710 con 0x7feb840c7250 2023-11-08T19:26:51.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.755+0000 7feb8bfa2700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb8406c640 con 0x7feb840722a0 2023-11-08T19:26:51.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.755+0000 7feb8a53f700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7feb840cb610 0x7feb8406b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:51.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.755+0000 7feb8a53f700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7feb840cb610 0x7feb8406b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43430/0 (socket says 172.21.15.149:43430) 2023-11-08T19:26:51.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.755+0000 7feb8a53f700 1 -- 172.21.15.149:0/3528004421 learned_addr learned my addr 172.21.15.149:0/3528004421 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:51.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.755+0000 7feb89d3e700 1 --2- 172.21.15.149:0/3528004421 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feb840722a0 0x7feb8406ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:51.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.755+0000 7feb8953d700 1 --2- 172.21.15.149:0/3528004421 >> v2:172.21.15.160:3300/0 conn(0x7feb840c7250 0x7feb8406b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:51.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.755+0000 7feb8a53f700 1 -- 172.21.15.149:0/3528004421 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feb840722a0 msgr2=0x7feb8406ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:51.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.755+0000 7feb8a53f700 1 --2- 172.21.15.149:0/3528004421 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feb840722a0 0x7feb8406ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:51.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.755+0000 7feb8a53f700 1 -- 172.21.15.149:0/3528004421 >> v2:172.21.15.160:3300/0 conn(0x7feb840c7250 msgr2=0x7feb8406b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:51.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.755+0000 7feb8a53f700 1 --2- 172.21.15.149:0/3528004421 >> v2:172.21.15.160:3300/0 conn(0x7feb840c7250 0x7feb8406b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:51.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.755+0000 7feb8a53f700 1 -- 172.21.15.149:0/3528004421 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb8406c920 con 0x7feb840cb610 2023-11-08T19:26:51.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.755+0000 7feb8a53f700 1 --2- 172.21.15.149:0/3528004421 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb840cb610 0x7feb8406b600 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7feb8406d9a0 tx=0x7feb7c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ec9de9a13458486 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:51.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.756+0000 7feb88d3c700 1 -- 172.21.15.149:0/3528004421 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7c00e070 con 0x7feb840cb610 2023-11-08T19:26:51.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.756+0000 7feb88d3c700 1 -- 172.21.15.149:0/3528004421 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb7c00b9c0 con 0x7feb840cb610 2023-11-08T19:26:51.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.756+0000 7feb88d3c700 1 -- 172.21.15.149:0/3528004421 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7c00bd70 con 0x7feb840cb610 2023-11-08T19:26:51.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.756+0000 7feb8bfa2700 1 -- 172.21.15.149:0/3528004421 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb840cb610 msgr2=0x7feb8406b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:51.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.756+0000 7feb8bfa2700 1 --2- 172.21.15.149:0/3528004421 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb840cb610 0x7feb8406b600 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7feb8406d9a0 tx=0x7feb7c00b330 comp rx=0 tx=0).stop 2023-11-08T19:26:51.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.756+0000 7feb8bfa2700 1 -- 172.21.15.149:0/3528004421 shutdown_connections 2023-11-08T19:26:51.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.756+0000 7feb8bfa2700 1 --2- 172.21.15.149:0/3528004421 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb840cb610 0x7feb8406b600 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:51.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.756+0000 7feb8bfa2700 1 --2- 172.21.15.149:0/3528004421 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feb840722a0 0x7feb8406ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:51.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.756+0000 7feb8bfa2700 1 --2- 172.21.15.149:0/3528004421 >> v2:172.21.15.160:3300/0 conn(0x7feb840c7250 0x7feb8406b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:51.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.756+0000 7feb8bfa2700 1 -- 172.21.15.149:0/3528004421 >> 172.21.15.149:0/3528004421 conn(0x7feb840d0640 msgr2=0x7feb840d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:51.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.756+0000 7feb8bfa2700 1 -- 172.21.15.149:0/3528004421 shutdown_connections 2023-11-08T19:26:51.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.756+0000 7feb8bfa2700 1 -- 172.21.15.149:0/3528004421 wait complete. 2023-11-08T19:26:51.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.757+0000 7feb8bfa2700 1 Processor -- start 2023-11-08T19:26:51.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.757+0000 7feb8bfa2700 1 -- start start 2023-11-08T19:26:51.770 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.758+0000 7feb8bfa2700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb840722a0 0x7feb841f44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:51.770 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.758+0000 7feb8bfa2700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feb840c7250 0x7feb841e5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:51.770 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.758+0000 7feb8bfa2700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feb840cb610 0x7feb841e61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:51.770 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.758+0000 7feb8bfa2700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb841f49f0 con 0x7feb840722a0 2023-11-08T19:26:51.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.758+0000 7feb8bfa2700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb841f7b40 con 0x7feb840cb610 2023-11-08T19:26:51.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.758+0000 7feb8bfa2700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb841f6f70 con 0x7feb840c7250 2023-11-08T19:26:51.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.758+0000 7feb89d3e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb840722a0 0x7feb841f44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:51.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.758+0000 7feb89d3e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb840722a0 0x7feb841f44b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43432/0 (socket says 172.21.15.149:43432) 2023-11-08T19:26:51.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.758+0000 7feb89d3e700 1 -- 172.21.15.149:0/4082638758 learned_addr learned my addr 172.21.15.149:0/4082638758 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:51.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.758+0000 7feb8953d700 1 --2- 172.21.15.149:0/4082638758 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feb840c7250 0x7feb841e5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:51.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.758+0000 7feb8a53f700 1 --2- 172.21.15.149:0/4082638758 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feb840cb610 0x7feb841e61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:51.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.759+0000 7feb89d3e700 1 -- 172.21.15.149:0/4082638758 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feb840c7250 msgr2=0x7feb841e5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:51.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.759+0000 7feb89d3e700 1 --2- 172.21.15.149:0/4082638758 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feb840c7250 0x7feb841e5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:51.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.759+0000 7feb89d3e700 1 -- 172.21.15.149:0/4082638758 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feb840cb610 msgr2=0x7feb841e61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:51.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.759+0000 7feb89d3e700 1 --2- 172.21.15.149:0/4082638758 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feb840cb610 0x7feb841e61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:51.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.759+0000 7feb89d3e700 1 -- 172.21.15.149:0/4082638758 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb7c009b30 con 0x7feb840722a0 2023-11-08T19:26:51.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.759+0000 7feb89d3e700 1 --2- 172.21.15.149:0/4082638758 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb840722a0 0x7feb841f44b0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7feb8000d800 tx=0x7feb8000db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:51.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.759+0000 7feb7a7fc700 1 -- 172.21.15.149:0/4082638758 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb800125f0 con 0x7feb840722a0 2023-11-08T19:26:51.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.759+0000 7feb7a7fc700 1 -- 172.21.15.149:0/4082638758 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb80012770 con 0x7feb840722a0 2023-11-08T19:26:51.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.759+0000 7feb7a7fc700 1 -- 172.21.15.149:0/4082638758 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb80012b20 con 0x7feb840722a0 2023-11-08T19:26:51.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.759+0000 7feb8bfa2700 1 -- 172.21.15.149:0/4082638758 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb841f7210 con 0x7feb840722a0 2023-11-08T19:26:51.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.759+0000 7feb8bfa2700 1 -- 172.21.15.149:0/4082638758 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb841f77d0 con 0x7feb840722a0 2023-11-08T19:26:51.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.760+0000 7feb8bfa2700 1 -- 172.21.15.149:0/4082638758 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb8404f730 con 0x7feb840722a0 2023-11-08T19:26:51.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.760+0000 7feb7a7fc700 1 -- 172.21.15.149:0/4082638758 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7feb80012c80 con 0x7feb840722a0 2023-11-08T19:26:51.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.761+0000 7feb7a7fc700 1 --2- 172.21.15.149:0/4082638758 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7feb6806af00 0x7feb6806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:51.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.761+0000 7feb7a7fc700 1 -- 172.21.15.149:0/4082638758 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7feb80089b40 con 0x7feb840722a0 2023-11-08T19:26:51.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.761+0000 7feb8953d700 1 --2- 172.21.15.149:0/4082638758 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7feb6806af00 0x7feb6806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:51.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.761+0000 7feb8953d700 1 --2- 172.21.15.149:0/4082638758 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7feb6806af00 0x7feb6806d3c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7feb841e68a0 tx=0x7feb74008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:51.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.766+0000 7feb7a7fc700 1 -- 172.21.15.149:0/4082638758 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7feb800545f0 con 0x7feb840722a0 2023-11-08T19:26:51.999 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:51.998+0000 7feb8bfa2700 1 -- 172.21.15.149:0/4082638758 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7feb840c3bd0 con 0x7feb840722a0 2023-11-08T19:26:52.612 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.611+0000 7feb7a7fc700 1 -- 172.21.15.149:0/4082638758 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v54) v1 ==== 122+0+0 (secure 0 0 0) 0x7feb80057c10 con 0x7feb840722a0 2023-11-08T19:26:52.644 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.614+0000 7feb8bfa2700 1 -- 172.21.15.149:0/4082638758 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7feb6806af00 msgr2=0x7feb6806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:52.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.614+0000 7feb8bfa2700 1 --2- 172.21.15.149:0/4082638758 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7feb6806af00 0x7feb6806d3c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7feb841e68a0 tx=0x7feb74008040 comp rx=0 tx=0).stop 2023-11-08T19:26:52.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.614+0000 7feb8bfa2700 1 -- 172.21.15.149:0/4082638758 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb840722a0 msgr2=0x7feb841f44b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:52.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.614+0000 7feb8bfa2700 1 --2- 172.21.15.149:0/4082638758 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb840722a0 0x7feb841f44b0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7feb8000d800 tx=0x7feb8000db10 comp rx=0 tx=0).stop 2023-11-08T19:26:52.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.614+0000 7feb8bfa2700 1 -- 172.21.15.149:0/4082638758 shutdown_connections 2023-11-08T19:26:52.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.614+0000 7feb8bfa2700 1 --2- 172.21.15.149:0/4082638758 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7feb6806af00 0x7feb6806d3c0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:52.646 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.614+0000 7feb8bfa2700 1 --2- 172.21.15.149:0/4082638758 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feb840cb610 0x7feb841e61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:52.646 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.614+0000 7feb8bfa2700 1 --2- 172.21.15.149:0/4082638758 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb840722a0 0x7feb841f44b0 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:52.646 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.614+0000 7feb8bfa2700 1 --2- 172.21.15.149:0/4082638758 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feb840c7250 0x7feb841e5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:52.646 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.614+0000 7feb8bfa2700 1 -- 172.21.15.149:0/4082638758 >> 172.21.15.149:0/4082638758 conn(0x7feb840d0640 msgr2=0x7feb8415bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:52.647 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.614+0000 7feb8bfa2700 1 -- 172.21.15.149:0/4082638758 shutdown_connections 2023-11-08T19:26:52.647 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.614+0000 7feb8bfa2700 1 -- 172.21.15.149:0/4082638758 wait complete. 2023-11-08T19:26:52.647 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-08T19:26:52.648 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:26:52.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.770+0000 7fd17177d700 1 Processor -- start 2023-11-08T19:26:52.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.770+0000 7fd17177d700 1 -- start start 2023-11-08T19:26:52.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.771+0000 7fd17177d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd16c0cd5e0 0x7fd16c0cfd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:52.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.771+0000 7fd17177d700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fd16c0ce840 0x7fd16c0d0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:52.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.771+0000 7fd17177d700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd16c0d07a0 con 0x7fd16c15b950 2023-11-08T19:26:52.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.771+0000 7fd17177d700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd16c0cc2e0 con 0x7fd16c0cd5e0 2023-11-08T19:26:52.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.771+0000 7fd17177d700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd16c0cc580 con 0x7fd16c0ce840 2023-11-08T19:26:52.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.771+0000 7fd16a7fc700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd16c0cd5e0 0x7fd16c0cfd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:52.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.771+0000 7fd16affd700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fd16c15b950 0x7fd16c0ce130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:45442/0 (socket says 172.21.15.149:45442) 2023-11-08T19:26:52.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.771+0000 7fd16affd700 1 -- 172.21.15.149:0/2063908558 learned_addr learned my addr 172.21.15.149:0/2063908558 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:26:52.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.772+0000 7fd16b7fe700 1 --2- 172.21.15.149:0/2063908558 >> v2:172.21.15.160:3300/0 conn(0x7fd16c0ce840 0x7fd16c0d0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:52.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.772+0000 7fd169ffb700 1 -- 172.21.15.149:0/2063908558 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4021482018 0 0) 0x7fd16c0d07a0 con 0x7fd16c15b950 2023-11-08T19:26:52.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.772+0000 7fd169ffb700 1 -- 172.21.15.149:0/2063908558 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1540035b0 con 0x7fd16c15b950 2023-11-08T19:26:52.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.772+0000 7fd16a7fc700 1 -- 172.21.15.149:0/2063908558 >> v2:172.21.15.160:3300/0 conn(0x7fd16c0ce840 msgr2=0x7fd16c0d0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:52.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.772+0000 7fd16a7fc700 1 --2- 172.21.15.149:0/2063908558 >> v2:172.21.15.160:3300/0 conn(0x7fd16c0ce840 0x7fd16c0d0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:52.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.772+0000 7fd16a7fc700 1 -- 172.21.15.149:0/2063908558 >> v1:172.21.15.149:6789/0 conn(0x7fd16c15b950 legacy=0x7fd16c0ce130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:52.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.772+0000 7fd16a7fc700 1 -- 172.21.15.149:0/2063908558 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd16c0cc820 con 0x7fd16c0cd5e0 2023-11-08T19:26:52.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.772+0000 7fd16a7fc700 1 --2- 172.21.15.149:0/2063908558 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd16c0cd5e0 0x7fd16c0cfd20 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7fd16c0cbd20 tx=0x7fd15c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d08f1d8f85c2bf server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:52.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.772+0000 7fd169ffb700 1 -- 172.21.15.149:0/2063908558 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd15c011830 con 0x7fd16c0cd5e0 2023-11-08T19:26:52.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.772+0000 7fd169ffb700 1 -- 172.21.15.149:0/2063908558 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd15c011990 con 0x7fd16c0cd5e0 2023-11-08T19:26:52.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.772+0000 7fd169ffb700 1 -- 172.21.15.149:0/2063908558 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd15c011d00 con 0x7fd16c0cd5e0 2023-11-08T19:26:52.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.773+0000 7fd17177d700 1 -- 172.21.15.149:0/2063908558 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd16c0cd5e0 msgr2=0x7fd16c0cfd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:52.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.773+0000 7fd17177d700 1 --2- 172.21.15.149:0/2063908558 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd16c0cd5e0 0x7fd16c0cfd20 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7fd16c0cbd20 tx=0x7fd15c009b20 comp rx=0 tx=0).stop 2023-11-08T19:26:52.779 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.773+0000 7fd17177d700 1 -- 172.21.15.149:0/2063908558 shutdown_connections 2023-11-08T19:26:52.779 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.773+0000 7fd17177d700 1 --2- 172.21.15.149:0/2063908558 >> v2:172.21.15.160:3300/0 conn(0x7fd16c0ce840 0x7fd16c0d0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:52.779 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.773+0000 7fd17177d700 1 --2- 172.21.15.149:0/2063908558 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd16c0cd5e0 0x7fd16c0cfd20 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:52.779 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.773+0000 7fd17177d700 1 -- 172.21.15.149:0/2063908558 >> 172.21.15.149:0/2063908558 conn(0x7fd16c08afd0 msgr2=0x7fd16c0d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:52.779 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.773+0000 7fd17177d700 1 -- 172.21.15.149:0/2063908558 shutdown_connections 2023-11-08T19:26:52.780 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.773+0000 7fd17177d700 1 -- 172.21.15.149:0/2063908558 wait complete. 2023-11-08T19:26:52.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.774+0000 7fd17177d700 1 Processor -- start 2023-11-08T19:26:52.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.774+0000 7fd17177d700 1 -- start start 2023-11-08T19:26:52.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.775+0000 7fd17177d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd16c0ce840 0x7fd16c158f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:52.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.775+0000 7fd17177d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd16c15b950 0x7fd16c0c8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:52.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.775+0000 7fd17177d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd16c1f1360 0x7fd16c0b4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:52.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.775+0000 7fd17177d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd16c0ca300 con 0x7fd16c0ce840 2023-11-08T19:26:52.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.775+0000 7fd17177d700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd16c0b57f0 con 0x7fd16c1f1360 2023-11-08T19:26:52.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.775+0000 7fd17177d700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd16c0b6000 con 0x7fd16c15b950 2023-11-08T19:26:52.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.775+0000 7fd16affd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd16c0ce840 0x7fd16c158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:52.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.775+0000 7fd16affd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd16c0ce840 0x7fd16c158f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43446/0 (socket says 172.21.15.149:43446) 2023-11-08T19:26:52.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.775+0000 7fd16affd700 1 -- 172.21.15.149:0/3515469139 learned_addr learned my addr 172.21.15.149:0/3515469139 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:52.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.776+0000 7fd16a7fc700 1 --2- 172.21.15.149:0/3515469139 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd16c15b950 0x7fd16c0c8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:52.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.776+0000 7fd16b7fe700 1 --2- 172.21.15.149:0/3515469139 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd16c1f1360 0x7fd16c0b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:52.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.776+0000 7fd16affd700 1 -- 172.21.15.149:0/3515469139 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd16c15b950 msgr2=0x7fd16c0c8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:52.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.776+0000 7fd16affd700 1 --2- 172.21.15.149:0/3515469139 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd16c15b950 0x7fd16c0c8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:52.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.776+0000 7fd16affd700 1 -- 172.21.15.149:0/3515469139 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd16c1f1360 msgr2=0x7fd16c0b4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:52.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.776+0000 7fd16affd700 1 --2- 172.21.15.149:0/3515469139 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd16c1f1360 0x7fd16c0b4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:52.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.776+0000 7fd16affd700 1 -- 172.21.15.149:0/3515469139 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd15c0094a0 con 0x7fd16c0ce840 2023-11-08T19:26:52.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.776+0000 7fd16a7fc700 1 --2- 172.21.15.149:0/3515469139 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd16c15b950 0x7fd16c0c8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:26:52.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.776+0000 7fd16affd700 1 --2- 172.21.15.149:0/3515469139 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd16c0ce840 0x7fd16c158f00 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7fd16000c4d0 tx=0x7fd16000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:52.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.776+0000 7fd1537fe700 1 -- 172.21.15.149:0/3515469139 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1600074e0 con 0x7fd16c0ce840 2023-11-08T19:26:52.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.776+0000 7fd1537fe700 1 -- 172.21.15.149:0/3515469139 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd160007640 con 0x7fd16c0ce840 2023-11-08T19:26:52.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.776+0000 7fd17177d700 1 -- 172.21.15.149:0/3515469139 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd16c0b5a40 con 0x7fd16c0ce840 2023-11-08T19:26:52.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.776+0000 7fd1537fe700 1 -- 172.21.15.149:0/3515469139 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd160005a70 con 0x7fd16c0ce840 2023-11-08T19:26:52.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.776+0000 7fd17177d700 1 -- 172.21.15.149:0/3515469139 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd16c0ca510 con 0x7fd16c0ce840 2023-11-08T19:26:52.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.777+0000 7fd17177d700 1 -- 172.21.15.149:0/3515469139 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd16c15f120 con 0x7fd16c0ce840 2023-11-08T19:26:52.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.777+0000 7fd1537fe700 1 -- 172.21.15.149:0/3515469139 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd160005bd0 con 0x7fd16c0ce840 2023-11-08T19:26:52.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.778+0000 7fd1537fe700 1 --2- 172.21.15.149:0/3515469139 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd15806af00 0x7fd15806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:52.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.778+0000 7fd1537fe700 1 -- 172.21.15.149:0/3515469139 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7fd160089080 con 0x7fd16c0ce840 2023-11-08T19:26:52.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.778+0000 7fd16a7fc700 1 --2- 172.21.15.149:0/3515469139 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd15806af00 0x7fd15806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:52.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.778+0000 7fd16a7fc700 1 --2- 172.21.15.149:0/3515469139 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd15806af00 0x7fd15806d3c0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fd16c160590 tx=0x7fd15c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:52.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:52.783+0000 7fd1537fe700 1 -- 172.21.15.149:0/3515469139 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd160053bc0 con 0x7fd16c0ce840 2023-11-08T19:26:53.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.012+0000 7fd17177d700 1 -- 172.21.15.149:0/3515469139 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd16c0745f0 con 0x7fd16c0ce840 2023-11-08T19:26:53.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.013+0000 7fd1537fe700 1 -- 172.21.15.149:0/3515469139 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4924 (secure 0 0 0) 0x7fd1600571e0 con 0x7fd16c0ce840 2023-11-08T19:26:53.014 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:26:53.014 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":54,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6451,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/2947079163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2947079163},{"type":"v1","addr":"172.21.15.160:6834","nonce":2947079163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49},{"gid":7122,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/589971879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":589971879},{"type":"v1","addr":"172.21.15.149:6836","nonce":589971879}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49},{"gid":7125,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/3917392643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3917392643},{"type":"v1","addr":"172.21.15.149:6837","nonce":3917392643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:26:51.999760+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7140},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7140":{"gid":7140,"name":"b","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.160:6835/2714564224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":2714564224},{"type":"v1","addr":"172.21.15.160:6835","nonce":2714564224}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:26:53.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.015+0000 7fd17177d700 1 -- 172.21.15.149:0/3515469139 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd15806af00 msgr2=0x7fd15806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:53.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.015+0000 7fd17177d700 1 --2- 172.21.15.149:0/3515469139 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd15806af00 0x7fd15806d3c0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fd16c160590 tx=0x7fd15c008030 comp rx=0 tx=0).stop 2023-11-08T19:26:53.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.015+0000 7fd17177d700 1 -- 172.21.15.149:0/3515469139 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd16c0ce840 msgr2=0x7fd16c158f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:53.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.015+0000 7fd17177d700 1 --2- 172.21.15.149:0/3515469139 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd16c0ce840 0x7fd16c158f00 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7fd16000c4d0 tx=0x7fd16000c890 comp rx=0 tx=0).stop 2023-11-08T19:26:53.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.015+0000 7fd17177d700 1 -- 172.21.15.149:0/3515469139 shutdown_connections 2023-11-08T19:26:53.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.015+0000 7fd17177d700 1 --2- 172.21.15.149:0/3515469139 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd15806af00 0x7fd15806d3c0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:53.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.015+0000 7fd17177d700 1 --2- 172.21.15.149:0/3515469139 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd16c1f1360 0x7fd16c0b4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:53.018 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.015+0000 7fd17177d700 1 --2- 172.21.15.149:0/3515469139 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd16c0ce840 0x7fd16c158f00 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:53.018 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.015+0000 7fd17177d700 1 --2- 172.21.15.149:0/3515469139 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd16c15b950 0x7fd16c0c8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:53.018 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.015+0000 7fd17177d700 1 -- 172.21.15.149:0/3515469139 >> 172.21.15.149:0/3515469139 conn(0x7fd16c08afd0 msgr2=0x7fd16c0ae5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:53.018 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.015+0000 7fd17177d700 1 -- 172.21.15.149:0/3515469139 shutdown_connections 2023-11-08T19:26:53.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.015+0000 7fd17177d700 1 -- 172.21.15.149:0/3515469139 wait complete. 2023-11-08T19:26:53.019 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 54 2023-11-08T19:26:53.029 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:26:53.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.149+0000 7f6bf503f700 1 Processor -- start 2023-11-08T19:26:53.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.149+0000 7f6bf503f700 1 -- start start 2023-11-08T19:26:53.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.150+0000 7f6bf503f700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6bf00668e0 0x7f6bf006bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:53.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.150+0000 7f6bf503f700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f6bf00b5840 0x7f6bf006c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:53.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.150+0000 7f6bf503f700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bf015f390 con 0x7f6bf015efb0 2023-11-08T19:26:53.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.150+0000 7f6bf503f700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bf00b3460 con 0x7f6bf00668e0 2023-11-08T19:26:53.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.150+0000 7f6bf503f700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bf00ce0a0 con 0x7f6bf00b5840 2023-11-08T19:26:53.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.150+0000 7f6bee59c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6bf00668e0 0x7f6bf006bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:53.154 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.150+0000 7f6beed9d700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f6bf015efb0 0x7f6bf00b2d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:45456/0 (socket says 172.21.15.149:45456) 2023-11-08T19:26:53.154 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.150+0000 7f6beed9d700 1 -- 172.21.15.149:0/2014440817 learned_addr learned my addr 172.21.15.149:0/2014440817 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:26:53.154 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.150+0000 7f6bee59c700 1 -- 172.21.15.149:0/2014440817 >> v2:172.21.15.160:3300/0 conn(0x7f6bf00b5840 msgr2=0x7f6bf006c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:53.154 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.150+0000 7f6bee59c700 1 --2- 172.21.15.149:0/2014440817 >> v2:172.21.15.160:3300/0 conn(0x7f6bf00b5840 0x7f6bf006c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:53.154 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.150+0000 7f6bee59c700 1 -- 172.21.15.149:0/2014440817 >> v1:172.21.15.149:6789/0 conn(0x7f6bf015efb0 legacy=0x7f6bf00b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:53.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.150+0000 7f6bedd9b700 1 -- 172.21.15.149:0/2014440817 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 597189907 0 0) 0x7f6be0001110 con 0x7f6bf015efb0 2023-11-08T19:26:53.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.150+0000 7f6bee59c700 1 -- 172.21.15.149:0/2014440817 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf00ce380 con 0x7f6bf00668e0 2023-11-08T19:26:53.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.150+0000 7f6bee59c700 1 --2- 172.21.15.149:0/2014440817 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6bf00668e0 0x7f6bf006bb90 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f6bf0067120 tx=0x7f6be4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29ac0d0a166890ef server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:53.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.150+0000 7f6bedd9b700 1 -- 172.21.15.149:0/2014440817 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be4011830 con 0x7f6bf00668e0 2023-11-08T19:26:53.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.150+0000 7f6bedd9b700 1 -- 172.21.15.149:0/2014440817 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be4011990 con 0x7f6bf00668e0 2023-11-08T19:26:53.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.150+0000 7f6bedd9b700 1 -- 172.21.15.149:0/2014440817 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be4011d20 con 0x7f6bf00668e0 2023-11-08T19:26:53.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.151+0000 7f6bf503f700 1 -- 172.21.15.149:0/2014440817 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6bf00668e0 msgr2=0x7f6bf006bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:53.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.151+0000 7f6bf503f700 1 --2- 172.21.15.149:0/2014440817 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6bf00668e0 0x7f6bf006bb90 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f6bf0067120 tx=0x7f6be4009b20 comp rx=0 tx=0).stop 2023-11-08T19:26:53.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.151+0000 7f6bf503f700 1 -- 172.21.15.149:0/2014440817 shutdown_connections 2023-11-08T19:26:53.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.151+0000 7f6bf503f700 1 --2- 172.21.15.149:0/2014440817 >> v2:172.21.15.160:3300/0 conn(0x7f6bf00b5840 0x7f6bf006c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:53.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.151+0000 7f6bf503f700 1 --2- 172.21.15.149:0/2014440817 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6bf00668e0 0x7f6bf006bb90 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:53.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.151+0000 7f6bf503f700 1 -- 172.21.15.149:0/2014440817 >> 172.21.15.149:0/2014440817 conn(0x7f6bf0071720 msgr2=0x7f6bf0071b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:53.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.151+0000 7f6bf503f700 1 -- 172.21.15.149:0/2014440817 shutdown_connections 2023-11-08T19:26:53.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.151+0000 7f6bf503f700 1 -- 172.21.15.149:0/2014440817 wait complete. 2023-11-08T19:26:53.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.152+0000 7f6bf503f700 1 Processor -- start 2023-11-08T19:26:53.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.152+0000 7f6bf503f700 1 -- start start 2023-11-08T19:26:53.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.153+0000 7f6bf503f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6bf00668e0 0x7f6bf01547c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:53.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.153+0000 7f6bf503f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6bf00b5840 0x7f6bf00c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:53.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.153+0000 7f6bf503f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6bf015efb0 0x7f6bf00c9950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:53.161 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.153+0000 7f6bf503f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf0155360 con 0x7f6bf015efb0 2023-11-08T19:26:53.161 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.153+0000 7f6bf503f700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf00c94c0 con 0x7f6bf00668e0 2023-11-08T19:26:53.161 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.153+0000 7f6bf503f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf00c88b0 con 0x7f6bf00b5840 2023-11-08T19:26:53.161 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.153+0000 7f6bef59e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6bf015efb0 0x7f6bf00c9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:53.161 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.153+0000 7f6bef59e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6bf015efb0 0x7f6bf00c9950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43464/0 (socket says 172.21.15.149:43464) 2023-11-08T19:26:53.162 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.153+0000 7f6bef59e700 1 -- 172.21.15.149:0/1657133834 learned_addr learned my addr 172.21.15.149:0/1657133834 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:53.162 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.153+0000 7f6beed9d700 1 --2- 172.21.15.149:0/1657133834 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6bf00668e0 0x7f6bf01547c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:53.162 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.153+0000 7f6bee59c700 1 --2- 172.21.15.149:0/1657133834 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6bf00b5840 0x7f6bf00c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:53.162 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.154+0000 7f6bef59e700 1 -- 172.21.15.149:0/1657133834 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6bf00b5840 msgr2=0x7f6bf00c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:53.162 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.154+0000 7f6bef59e700 1 --2- 172.21.15.149:0/1657133834 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6bf00b5840 0x7f6bf00c65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:53.163 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.154+0000 7f6bef59e700 1 -- 172.21.15.149:0/1657133834 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6bf00668e0 msgr2=0x7f6bf01547c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:53.163 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.154+0000 7f6bef59e700 1 --2- 172.21.15.149:0/1657133834 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6bf00668e0 0x7f6bf01547c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:53.163 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.154+0000 7f6bef59e700 1 -- 172.21.15.149:0/1657133834 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be40094a0 con 0x7f6bf015efb0 2023-11-08T19:26:53.163 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.154+0000 7f6bef59e700 1 --2- 172.21.15.149:0/1657133834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6bf015efb0 0x7f6bf00c9950 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f6be800b9a0 tx=0x7f6be800bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:53.163 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.154+0000 7f6bd77fe700 1 -- 172.21.15.149:0/1657133834 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be800d850 con 0x7f6bf015efb0 2023-11-08T19:26:53.164 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.154+0000 7f6bd77fe700 1 -- 172.21.15.149:0/1657133834 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be800d9d0 con 0x7f6bf015efb0 2023-11-08T19:26:53.164 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.154+0000 7f6bf503f700 1 -- 172.21.15.149:0/1657133834 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bf00c8b90 con 0x7f6bf015efb0 2023-11-08T19:26:53.164 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.154+0000 7f6bd77fe700 1 -- 172.21.15.149:0/1657133834 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be800dd80 con 0x7f6bf015efb0 2023-11-08T19:26:53.164 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.154+0000 7f6bf503f700 1 -- 172.21.15.149:0/1657133834 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bf00c9150 con 0x7f6bf015efb0 2023-11-08T19:26:53.164 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.155+0000 7f6bf503f700 1 -- 172.21.15.149:0/1657133834 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bf00745f0 con 0x7f6bf015efb0 2023-11-08T19:26:53.165 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.155+0000 7f6bd77fe700 1 -- 172.21.15.149:0/1657133834 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6be800e420 con 0x7f6bf015efb0 2023-11-08T19:26:53.165 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.156+0000 7f6bd77fe700 1 --2- 172.21.15.149:0/1657133834 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6bdc06af00 0x7f6bdc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:53.165 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.156+0000 7f6beed9d700 1 --2- 172.21.15.149:0/1657133834 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6bdc06af00 0x7f6bdc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:53.165 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.156+0000 7f6bd77fe700 1 -- 172.21.15.149:0/1657133834 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f6be8006e40 con 0x7f6bf015efb0 2023-11-08T19:26:53.165 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.156+0000 7f6beed9d700 1 --2- 172.21.15.149:0/1657133834 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6bdc06af00 0x7f6bdc06d3c0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f6be0000f60 tx=0x7f6be0007e70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:53.166 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.161+0000 7f6bd77fe700 1 -- 172.21.15.149:0/1657133834 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6be80547c0 con 0x7f6bf015efb0 2023-11-08T19:26:53.353 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.352+0000 7f6bf503f700 1 -- 172.21.15.149:0/1657133834 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6bf00c9600 con 0x7f6bf015efb0 2023-11-08T19:26:53.354 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.353+0000 7f6bd77fe700 1 -- 172.21.15.149:0/1657133834 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) v1 ==== 74+0+22041 (secure 0 0 0) 0x7f6be8057de0 con 0x7f6bf015efb0 2023-11-08T19:26:53.355 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:26:53.355 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":96,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:26:50.125692+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-08T19:24:29.516185+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-08T19:25:44.287064+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":71,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-08T19:25:45.623521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-11-08T19:26:46.785987+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-11-08T19:26:47.950353+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:26:53.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.355+0000 7f6bf503f700 1 -- 172.21.15.149:0/1657133834 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6bdc06af00 msgr2=0x7f6bdc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:53.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.355+0000 7f6bf503f700 1 --2- 172.21.15.149:0/1657133834 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6bdc06af00 0x7f6bdc06d3c0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f6be0000f60 tx=0x7f6be0007e70 comp rx=0 tx=0).stop 2023-11-08T19:26:53.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.355+0000 7f6bf503f700 1 -- 172.21.15.149:0/1657133834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6bf015efb0 msgr2=0x7f6bf00c9950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:53.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.355+0000 7f6bf503f700 1 --2- 172.21.15.149:0/1657133834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6bf015efb0 0x7f6bf00c9950 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f6be800b9a0 tx=0x7f6be800bcb0 comp rx=0 tx=0).stop 2023-11-08T19:26:53.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.356+0000 7f6bf503f700 1 -- 172.21.15.149:0/1657133834 shutdown_connections 2023-11-08T19:26:53.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.356+0000 7f6bf503f700 1 --2- 172.21.15.149:0/1657133834 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6bdc06af00 0x7f6bdc06d3c0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:53.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.356+0000 7f6bf503f700 1 --2- 172.21.15.149:0/1657133834 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6bf00668e0 0x7f6bf01547c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:53.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.356+0000 7f6bf503f700 1 --2- 172.21.15.149:0/1657133834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6bf015efb0 0x7f6bf00c9950 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:53.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.356+0000 7f6bf503f700 1 --2- 172.21.15.149:0/1657133834 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6bf00b5840 0x7f6bf00c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:53.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.356+0000 7f6bf503f700 1 -- 172.21.15.149:0/1657133834 >> 172.21.15.149:0/1657133834 conn(0x7f6bf0071720 msgr2=0x7f6bf00b4a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:53.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.356+0000 7f6bf503f700 1 -- 172.21.15.149:0/1657133834 shutdown_connections 2023-11-08T19:26:53.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.356+0000 7f6bf503f700 1 -- 172.21.15.149:0/1657133834 wait complete. 2023-11-08T19:26:53.369 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-08T19:26:53.370 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:26:53.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.491+0000 7f259c155700 1 Processor -- start 2023-11-08T19:26:53.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.491+0000 7f259c155700 1 -- start start 2023-11-08T19:26:53.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.492+0000 7f259c155700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f259415dc30 0x7f259406f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:53.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.492+0000 7f259c155700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f25940d2060 0x7f259406f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:53.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.492+0000 7f259c155700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f259406fc70 0x7f2594161790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:53.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.492+0000 7f259c155700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2594070100 con 0x7f25940d2060 2023-11-08T19:26:53.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.492+0000 7f259c155700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f259406bd50 con 0x7f259406fc70 2023-11-08T19:26:53.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.492+0000 7f259c155700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25940d04b0 con 0x7f259415dc30 2023-11-08T19:26:53.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.492+0000 7f25996f0700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f25940d2060 0x7f259406f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:53.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.492+0000 7f25996f0700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f25940d2060 0x7f259406f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43468/0 (socket says 172.21.15.149:43468) 2023-11-08T19:26:53.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.492+0000 7f25996f0700 1 -- 172.21.15.149:0/4077908490 learned_addr learned my addr 172.21.15.149:0/4077908490 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:53.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.492+0000 7f2599ef1700 1 --2- 172.21.15.149:0/4077908490 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f259415dc30 0x7f259406f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:53.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.492+0000 7f259a6f2700 1 --2- 172.21.15.149:0/4077908490 >> v2:172.21.15.160:3300/0 conn(0x7f259406fc70 0x7f2594161790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:53.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.492+0000 7f25996f0700 1 -- 172.21.15.149:0/4077908490 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f259415dc30 msgr2=0x7f259406f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:53.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.492+0000 7f25996f0700 1 --2- 172.21.15.149:0/4077908490 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f259415dc30 0x7f259406f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:53.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.492+0000 7f25996f0700 1 -- 172.21.15.149:0/4077908490 >> v2:172.21.15.160:3300/0 conn(0x7f259406fc70 msgr2=0x7f2594161790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:53.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.492+0000 7f25996f0700 1 --2- 172.21.15.149:0/4077908490 >> v2:172.21.15.160:3300/0 conn(0x7f259406fc70 0x7f2594161790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:53.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.492+0000 7f25996f0700 1 -- 172.21.15.149:0/4077908490 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25940d0730 con 0x7f25940d2060 2023-11-08T19:26:53.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.492+0000 7f259a6f2700 1 --2- 172.21.15.149:0/4077908490 >> v2:172.21.15.160:3300/0 conn(0x7f259406fc70 0x7f2594161790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:26:53.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.492+0000 7f25996f0700 1 --2- 172.21.15.149:0/4077908490 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25940d2060 0x7f259406f730 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f2594073050 tx=0x7f2584009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca18b6e710c07390 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:53.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.493+0000 7f2598eef700 1 -- 172.21.15.149:0/4077908490 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2584011830 con 0x7f25940d2060 2023-11-08T19:26:53.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.493+0000 7f2598eef700 1 -- 172.21.15.149:0/4077908490 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2584011990 con 0x7f25940d2060 2023-11-08T19:26:53.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.493+0000 7f2598eef700 1 -- 172.21.15.149:0/4077908490 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2584011d20 con 0x7f25940d2060 2023-11-08T19:26:53.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.493+0000 7f259c155700 1 -- 172.21.15.149:0/4077908490 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25940d2060 msgr2=0x7f259406f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:53.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.493+0000 7f259c155700 1 --2- 172.21.15.149:0/4077908490 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25940d2060 0x7f259406f730 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f2594073050 tx=0x7f2584009bd0 comp rx=0 tx=0).stop 2023-11-08T19:26:53.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.493+0000 7f259c155700 1 -- 172.21.15.149:0/4077908490 shutdown_connections 2023-11-08T19:26:53.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.493+0000 7f259c155700 1 --2- 172.21.15.149:0/4077908490 >> v2:172.21.15.160:3300/0 conn(0x7f259406fc70 0x7f2594161790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:53.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.493+0000 7f259c155700 1 --2- 172.21.15.149:0/4077908490 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f259415dc30 0x7f259406f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:53.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.493+0000 7f259c155700 1 --2- 172.21.15.149:0/4077908490 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25940d2060 0x7f259406f730 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:53.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.493+0000 7f259c155700 1 -- 172.21.15.149:0/4077908490 >> 172.21.15.149:0/4077908490 conn(0x7f259408afd0 msgr2=0x7f25940d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:53.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.493+0000 7f259c155700 1 -- 172.21.15.149:0/4077908490 shutdown_connections 2023-11-08T19:26:53.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.493+0000 7f259c155700 1 -- 172.21.15.149:0/4077908490 wait complete. 2023-11-08T19:26:53.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.494+0000 7f259c155700 1 Processor -- start 2023-11-08T19:26:53.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.495+0000 7f259c155700 1 -- start start 2023-11-08T19:26:53.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.495+0000 7f259c155700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f259406fc70 0x7f25940c9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:53.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.495+0000 7f259c155700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f25940d2060 0x7f25940b25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:53.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.495+0000 7f259c155700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f259415dc30 0x7f25940b2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:53.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.495+0000 7f259c155700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f259415f570 con 0x7f259406fc70 2023-11-08T19:26:53.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.495+0000 7f259c155700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25940c9dd0 con 0x7f259415dc30 2023-11-08T19:26:53.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.495+0000 7f259c155700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f259415f7c0 con 0x7f25940d2060 2023-11-08T19:26:53.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.495+0000 7f2599ef1700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f259406fc70 0x7f25940c9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:53.509 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.495+0000 7f2599ef1700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f259406fc70 0x7f25940c9330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43474/0 (socket says 172.21.15.149:43474) 2023-11-08T19:26:53.509 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.495+0000 7f2599ef1700 1 -- 172.21.15.149:0/2532042529 learned_addr learned my addr 172.21.15.149:0/2532042529 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:53.509 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.495+0000 7f25996f0700 1 --2- 172.21.15.149:0/2532042529 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f25940d2060 0x7f25940b25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:53.510 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.495+0000 7f259a6f2700 1 --2- 172.21.15.149:0/2532042529 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f259415dc30 0x7f25940b2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:53.510 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.496+0000 7f2599ef1700 1 -- 172.21.15.149:0/2532042529 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f25940d2060 msgr2=0x7f25940b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:53.510 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.496+0000 7f2599ef1700 1 --2- 172.21.15.149:0/2532042529 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f25940d2060 0x7f25940b25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:53.510 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.496+0000 7f2599ef1700 1 -- 172.21.15.149:0/2532042529 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f259415dc30 msgr2=0x7f25940b2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:53.510 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.496+0000 7f2599ef1700 1 --2- 172.21.15.149:0/2532042529 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f259415dc30 0x7f25940b2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:53.511 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.496+0000 7f2599ef1700 1 -- 172.21.15.149:0/2532042529 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2584009550 con 0x7f259406fc70 2023-11-08T19:26:53.511 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.496+0000 7f259a6f2700 1 --2- 172.21.15.149:0/2532042529 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f259415dc30 0x7f25940b2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:26:53.511 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.496+0000 7f2599ef1700 1 --2- 172.21.15.149:0/2532042529 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f259406fc70 0x7f25940c9330 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f259000e900 tx=0x7f259000ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:53.511 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.496+0000 7f258a7fc700 1 -- 172.21.15.149:0/2532042529 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2590009650 con 0x7f259406fc70 2023-11-08T19:26:53.511 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.496+0000 7f258a7fc700 1 -- 172.21.15.149:0/2532042529 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f259000ee50 con 0x7f259406fc70 2023-11-08T19:26:53.512 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.496+0000 7f259c155700 1 -- 172.21.15.149:0/2532042529 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f259415faa0 con 0x7f259406fc70 2023-11-08T19:26:53.512 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.496+0000 7f258a7fc700 1 -- 172.21.15.149:0/2532042529 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259000ca50 con 0x7f259406fc70 2023-11-08T19:26:53.512 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.496+0000 7f259c155700 1 -- 172.21.15.149:0/2532042529 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2594149610 con 0x7f259406fc70 2023-11-08T19:26:53.512 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.497+0000 7f259c155700 1 -- 172.21.15.149:0/2532042529 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25940745f0 con 0x7f259406fc70 2023-11-08T19:26:53.513 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.497+0000 7f258a7fc700 1 -- 172.21.15.149:0/2532042529 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f259000cbb0 con 0x7f259406fc70 2023-11-08T19:26:53.513 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.498+0000 7f258a7fc700 1 --2- 172.21.15.149:0/2532042529 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f257806af00 0x7f257806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:53.513 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.498+0000 7f258a7fc700 1 -- 172.21.15.149:0/2532042529 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f2590089e20 con 0x7f259406fc70 2023-11-08T19:26:53.513 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.498+0000 7f25996f0700 1 --2- 172.21.15.149:0/2532042529 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f257806af00 0x7f257806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:53.513 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.498+0000 7f25996f0700 1 --2- 172.21.15.149:0/2532042529 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f257806af00 0x7f257806d3c0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f2584014040 tx=0x7f2584008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:53.514 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.503+0000 7f258a7fc700 1 -- 172.21.15.149:0/2532042529 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f25900549e0 con 0x7f259406fc70 2023-11-08T19:26:53.569 INFO:tasks.ceph.mds.b.smithi160.stderr:2023-11-08T19:26:53.568+0000 7fdd43ebe700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-08T19:26:53.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.688+0000 7f259c155700 1 -- 172.21.15.149:0/2532042529 --> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f25940d24c0 con 0x7f257806af00 2023-11-08T19:26:53.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.701+0000 7f258a7fc700 1 -- 172.21.15.149:0/2532042529 <== mgr.4104 v2:172.21.15.149:6832/1929837472 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+531940 (secure 0 0 0) 0x7f2584004040 con 0x7f257806af00 2023-11-08T19:26:53.710 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:26:53.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.706+0000 7f259c155700 1 -- 172.21.15.149:0/2532042529 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f257806af00 msgr2=0x7f257806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:53.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.706+0000 7f259c155700 1 --2- 172.21.15.149:0/2532042529 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f257806af00 0x7f257806d3c0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f2584014040 tx=0x7f2584008030 comp rx=0 tx=0).stop 2023-11-08T19:26:53.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.706+0000 7f259c155700 1 -- 172.21.15.149:0/2532042529 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f259406fc70 msgr2=0x7f25940c9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:53.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.706+0000 7f259c155700 1 --2- 172.21.15.149:0/2532042529 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f259406fc70 0x7f25940c9330 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f259000e900 tx=0x7f259000ec10 comp rx=0 tx=0).stop 2023-11-08T19:26:53.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.706+0000 7f259c155700 1 -- 172.21.15.149:0/2532042529 shutdown_connections 2023-11-08T19:26:53.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.706+0000 7f259c155700 1 --2- 172.21.15.149:0/2532042529 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f257806af00 0x7f257806d3c0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:53.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.706+0000 7f259c155700 1 --2- 172.21.15.149:0/2532042529 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f259415dc30 0x7f25940b2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:53.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.706+0000 7f259c155700 1 --2- 172.21.15.149:0/2532042529 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f259406fc70 0x7f25940c9330 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:53.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.706+0000 7f259c155700 1 --2- 172.21.15.149:0/2532042529 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f25940d2060 0x7f25940b25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:53.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.706+0000 7f259c155700 1 -- 172.21.15.149:0/2532042529 >> 172.21.15.149:0/2532042529 conn(0x7f259408afd0 msgr2=0x7f259415ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:53.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.706+0000 7f259c155700 1 -- 172.21.15.149:0/2532042529 shutdown_connections 2023-11-08T19:26:53.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.706+0000 7f259c155700 1 -- 172.21.15.149:0/2532042529 wait complete. 2023-11-08T19:26:53.717 INFO:teuthology.orchestra.run.smithi149.stderr:dumped all 2023-11-08T19:26:53.720 INFO:teuthology.orchestra.run.smithi149.stdout:{"pg_ready":true,"pg_map":{"version":207,"stamp":"2023-11-08T19:26:52.037363+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":324,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226640,"kb_used_data":10448,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754748080,"statfs":{"total":773094113280,"available":772862033920,"internally_reserved":0,"allocated":10698752,"data_stored":5854382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.456967"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.289526+0000","last_change":"2023-11-08T19:26:49.141588+0000","last_active":"2023-11-08T19:26:50.289526+0000","last_peered":"2023-11-08T19:26:50.289526+0000","last_clean":"2023-11-08T19:26:50.289526+0000","last_became_active":"2023-11-08T19:26:49.141048+0000","last_became_peered":"2023-11-08T19:26:49.141048+0000","last_unstale":"2023-11-08T19:26:50.289526+0000","last_undegraded":"2023-11-08T19:26:50.289526+0000","last_fullsized":"2023-11-08T19:26:50.289526+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:25:06.629338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.131249+0000","last_change":"2023-11-08T19:26:49.143458+0000","last_active":"2023-11-08T19:26:50.131249+0000","last_peered":"2023-11-08T19:26:50.131249+0000","last_clean":"2023-11-08T19:26:50.131249+0000","last_became_active":"2023-11-08T19:26:49.143163+0000","last_became_peered":"2023-11-08T19:26:49.143163+0000","last_unstale":"2023-11-08T19:26:50.131249+0000","last_undegraded":"2023-11-08T19:26:50.131249+0000","last_fullsized":"2023-11-08T19:26:50.131249+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:44:31.157988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.161020+0000","last_change":"2023-11-08T19:26:49.153293+0000","last_active":"2023-11-08T19:26:49.161020+0000","last_peered":"2023-11-08T19:26:49.161020+0000","last_clean":"2023-11-08T19:26:49.161020+0000","last_became_active":"2023-11-08T19:26:49.153056+0000","last_became_peered":"2023-11-08T19:26:49.153056+0000","last_unstale":"2023-11-08T19:26:49.161020+0000","last_undegraded":"2023-11-08T19:26:49.161020+0000","last_fullsized":"2023-11-08T19:26:49.161020+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:24:09.541354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.289275+0000","last_change":"2023-11-08T19:26:49.138198+0000","last_active":"2023-11-08T19:26:50.289275+0000","last_peered":"2023-11-08T19:26:50.289275+0000","last_clean":"2023-11-08T19:26:50.289275+0000","last_became_active":"2023-11-08T19:26:49.137469+0000","last_became_peered":"2023-11-08T19:26:49.137469+0000","last_unstale":"2023-11-08T19:26:50.289275+0000","last_undegraded":"2023-11-08T19:26:50.289275+0000","last_fullsized":"2023-11-08T19:26:50.289275+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:25:23.445518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.129439+0000","last_change":"2023-11-08T19:26:49.140455+0000","last_active":"2023-11-08T19:26:50.129439+0000","last_peered":"2023-11-08T19:26:50.129439+0000","last_clean":"2023-11-08T19:26:50.129439+0000","last_became_active":"2023-11-08T19:26:49.140021+0000","last_became_peered":"2023-11-08T19:26:49.140021+0000","last_unstale":"2023-11-08T19:26:50.129439+0000","last_undegraded":"2023-11-08T19:26:50.129439+0000","last_fullsized":"2023-11-08T19:26:50.129439+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:19:38.633880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.447483+0000","last_change":"2023-11-08T19:26:49.146106+0000","last_active":"2023-11-08T19:26:50.447483+0000","last_peered":"2023-11-08T19:26:50.447483+0000","last_clean":"2023-11-08T19:26:50.447483+0000","last_became_active":"2023-11-08T19:26:49.145425+0000","last_became_peered":"2023-11-08T19:26:49.145425+0000","last_unstale":"2023-11-08T19:26:50.447483+0000","last_undegraded":"2023-11-08T19:26:50.447483+0000","last_fullsized":"2023-11-08T19:26:50.447483+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:19:57.938315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.447775+0000","last_change":"2023-11-08T19:26:49.141727+0000","last_active":"2023-11-08T19:26:50.447775+0000","last_peered":"2023-11-08T19:26:50.447775+0000","last_clean":"2023-11-08T19:26:50.447775+0000","last_became_active":"2023-11-08T19:26:49.141455+0000","last_became_peered":"2023-11-08T19:26:49.141455+0000","last_unstale":"2023-11-08T19:26:50.447775+0000","last_undegraded":"2023-11-08T19:26:50.447775+0000","last_fullsized":"2023-11-08T19:26:50.447775+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:06:34.319906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.155570+0000","last_change":"2023-11-08T19:26:49.150022+0000","last_active":"2023-11-08T19:26:49.155570+0000","last_peered":"2023-11-08T19:26:49.155570+0000","last_clean":"2023-11-08T19:26:49.155570+0000","last_became_active":"2023-11-08T19:26:49.149752+0000","last_became_peered":"2023-11-08T19:26:49.149752+0000","last_unstale":"2023-11-08T19:26:49.155570+0000","last_undegraded":"2023-11-08T19:26:49.155570+0000","last_fullsized":"2023-11-08T19:26:49.155570+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:44:31.157988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.289563+0000","last_change":"2023-11-08T19:26:49.141763+0000","last_active":"2023-11-08T19:26:50.289563+0000","last_peered":"2023-11-08T19:26:50.289563+0000","last_clean":"2023-11-08T19:26:50.289563+0000","last_became_active":"2023-11-08T19:26:49.141356+0000","last_became_peered":"2023-11-08T19:26:49.141356+0000","last_unstale":"2023-11-08T19:26:50.289563+0000","last_undegraded":"2023-11-08T19:26:50.289563+0000","last_fullsized":"2023-11-08T19:26:50.289563+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:22:29.583551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.289672+0000","last_change":"2023-11-08T19:26:49.139612+0000","last_active":"2023-11-08T19:26:50.289672+0000","last_peered":"2023-11-08T19:26:50.289672+0000","last_clean":"2023-11-08T19:26:50.289672+0000","last_became_active":"2023-11-08T19:26:49.139365+0000","last_became_peered":"2023-11-08T19:26:49.139365+0000","last_unstale":"2023-11-08T19:26:50.289672+0000","last_undegraded":"2023-11-08T19:26:50.289672+0000","last_fullsized":"2023-11-08T19:26:50.289672+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:10:08.972100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.130564+0000","last_change":"2023-11-08T19:26:49.143362+0000","last_active":"2023-11-08T19:26:50.130564+0000","last_peered":"2023-11-08T19:26:50.130564+0000","last_clean":"2023-11-08T19:26:50.130564+0000","last_became_active":"2023-11-08T19:26:49.143051+0000","last_became_peered":"2023-11-08T19:26:49.143051+0000","last_unstale":"2023-11-08T19:26:50.130564+0000","last_undegraded":"2023-11-08T19:26:50.130564+0000","last_fullsized":"2023-11-08T19:26:50.130564+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:36:02.486688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.289392+0000","last_change":"2023-11-08T19:26:49.139979+0000","last_active":"2023-11-08T19:26:50.289392+0000","last_peered":"2023-11-08T19:26:50.289392+0000","last_clean":"2023-11-08T19:26:50.289392+0000","last_became_active":"2023-11-08T19:26:49.139729+0000","last_became_peered":"2023-11-08T19:26:49.139729+0000","last_unstale":"2023-11-08T19:26:50.289392+0000","last_undegraded":"2023-11-08T19:26:50.289392+0000","last_fullsized":"2023-11-08T19:26:50.289392+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:23:14.448610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.155695+0000","last_change":"2023-11-08T19:26:49.150513+0000","last_active":"2023-11-08T19:26:49.155695+0000","last_peered":"2023-11-08T19:26:49.155695+0000","last_clean":"2023-11-08T19:26:49.155695+0000","last_became_active":"2023-11-08T19:26:49.147156+0000","last_became_peered":"2023-11-08T19:26:49.147156+0000","last_unstale":"2023-11-08T19:26:49.155695+0000","last_undegraded":"2023-11-08T19:26:49.155695+0000","last_fullsized":"2023-11-08T19:26:49.155695+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:34:42.233255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.152692+0000","last_change":"2023-11-08T19:26:49.141582+0000","last_active":"2023-11-08T19:26:49.152692+0000","last_peered":"2023-11-08T19:26:49.152692+0000","last_clean":"2023-11-08T19:26:49.152692+0000","last_became_active":"2023-11-08T19:26:49.141085+0000","last_became_peered":"2023-11-08T19:26:49.141085+0000","last_unstale":"2023-11-08T19:26:49.152692+0000","last_undegraded":"2023-11-08T19:26:49.152692+0000","last_fullsized":"2023-11-08T19:26:49.152692+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:16:35.810867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.447512+0000","last_change":"2023-11-08T19:26:49.145336+0000","last_active":"2023-11-08T19:26:50.447512+0000","last_peered":"2023-11-08T19:26:50.447512+0000","last_clean":"2023-11-08T19:26:50.447512+0000","last_became_active":"2023-11-08T19:26:49.145063+0000","last_became_peered":"2023-11-08T19:26:49.145063+0000","last_unstale":"2023-11-08T19:26:50.447512+0000","last_undegraded":"2023-11-08T19:26:50.447512+0000","last_fullsized":"2023-11-08T19:26:50.447512+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:11:31.614270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.288761+0000","last_change":"2023-11-08T19:26:49.150887+0000","last_active":"2023-11-08T19:26:50.288761+0000","last_peered":"2023-11-08T19:26:50.288761+0000","last_clean":"2023-11-08T19:26:50.288761+0000","last_became_active":"2023-11-08T19:26:49.150610+0000","last_became_peered":"2023-11-08T19:26:49.150610+0000","last_unstale":"2023-11-08T19:26:50.288761+0000","last_undegraded":"2023-11-08T19:26:50.288761+0000","last_fullsized":"2023-11-08T19:26:50.288761+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:19:42.823034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.131367+0000","last_change":"2023-11-08T19:26:49.143444+0000","last_active":"2023-11-08T19:26:50.131367+0000","last_peered":"2023-11-08T19:26:50.131367+0000","last_clean":"2023-11-08T19:26:50.131367+0000","last_became_active":"2023-11-08T19:26:49.143136+0000","last_became_peered":"2023-11-08T19:26:49.143136+0000","last_unstale":"2023-11-08T19:26:50.131367+0000","last_undegraded":"2023-11-08T19:26:50.131367+0000","last_fullsized":"2023-11-08T19:26:50.131367+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:20:04.364566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.131640+0000","last_change":"2023-11-08T19:26:49.140054+0000","last_active":"2023-11-08T19:26:50.131640+0000","last_peered":"2023-11-08T19:26:50.131640+0000","last_clean":"2023-11-08T19:26:50.131640+0000","last_became_active":"2023-11-08T19:26:49.139661+0000","last_became_peered":"2023-11-08T19:26:49.139661+0000","last_unstale":"2023-11-08T19:26:50.131640+0000","last_undegraded":"2023-11-08T19:26:50.131640+0000","last_fullsized":"2023-11-08T19:26:50.131640+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:09:28.305701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.161058+0000","last_change":"2023-11-08T19:26:49.154115+0000","last_active":"2023-11-08T19:26:49.161058+0000","last_peered":"2023-11-08T19:26:49.161058+0000","last_clean":"2023-11-08T19:26:49.161058+0000","last_became_active":"2023-11-08T19:26:49.153880+0000","last_became_peered":"2023-11-08T19:26:49.153880+0000","last_unstale":"2023-11-08T19:26:49.161058+0000","last_undegraded":"2023-11-08T19:26:49.161058+0000","last_fullsized":"2023-11-08T19:26:49.161058+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:33:14.130283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.130872+0000","last_change":"2023-11-08T19:26:49.147552+0000","last_active":"2023-11-08T19:26:50.130872+0000","last_peered":"2023-11-08T19:26:50.130872+0000","last_clean":"2023-11-08T19:26:50.130872+0000","last_became_active":"2023-11-08T19:26:49.146930+0000","last_became_peered":"2023-11-08T19:26:49.146930+0000","last_unstale":"2023-11-08T19:26:50.130872+0000","last_undegraded":"2023-11-08T19:26:50.130872+0000","last_fullsized":"2023-11-08T19:26:50.130872+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:16:35.810867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.130372+0000","last_change":"2023-11-08T19:26:49.139447+0000","last_active":"2023-11-08T19:26:50.130372+0000","last_peered":"2023-11-08T19:26:50.130372+0000","last_clean":"2023-11-08T19:26:50.130372+0000","last_became_active":"2023-11-08T19:26:49.138964+0000","last_became_peered":"2023-11-08T19:26:49.138964+0000","last_unstale":"2023-11-08T19:26:50.130372+0000","last_undegraded":"2023-11-08T19:26:50.130372+0000","last_fullsized":"2023-11-08T19:26:50.130372+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:35:44.695221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.448577+0000","last_change":"2023-11-08T19:26:49.142471+0000","last_active":"2023-11-08T19:26:50.448577+0000","last_peered":"2023-11-08T19:26:50.448577+0000","last_clean":"2023-11-08T19:26:50.448577+0000","last_became_active":"2023-11-08T19:26:49.141854+0000","last_became_peered":"2023-11-08T19:26:49.141854+0000","last_unstale":"2023-11-08T19:26:50.448577+0000","last_undegraded":"2023-11-08T19:26:50.448577+0000","last_fullsized":"2023-11-08T19:26:50.448577+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:26:31.761196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.130298+0000","last_change":"2023-11-08T19:26:49.138590+0000","last_active":"2023-11-08T19:26:50.130298+0000","last_peered":"2023-11-08T19:26:50.130298+0000","last_clean":"2023-11-08T19:26:50.130298+0000","last_became_active":"2023-11-08T19:26:49.138307+0000","last_became_peered":"2023-11-08T19:26:49.138307+0000","last_unstale":"2023-11-08T19:26:50.130298+0000","last_undegraded":"2023-11-08T19:26:50.130298+0000","last_fullsized":"2023-11-08T19:26:50.130298+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:03:19.403078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.447758+0000","last_change":"2023-11-08T19:26:49.150791+0000","last_active":"2023-11-08T19:26:50.447758+0000","last_peered":"2023-11-08T19:26:50.447758+0000","last_clean":"2023-11-08T19:26:50.447758+0000","last_became_active":"2023-11-08T19:26:49.150494+0000","last_became_peered":"2023-11-08T19:26:49.150494+0000","last_unstale":"2023-11-08T19:26:50.447758+0000","last_undegraded":"2023-11-08T19:26:50.447758+0000","last_fullsized":"2023-11-08T19:26:50.447758+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:32:51.649781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.131513+0000","last_change":"2023-11-08T19:26:49.143071+0000","last_active":"2023-11-08T19:26:50.131513+0000","last_peered":"2023-11-08T19:26:50.131513+0000","last_clean":"2023-11-08T19:26:50.131513+0000","last_became_active":"2023-11-08T19:26:49.142787+0000","last_became_peered":"2023-11-08T19:26:49.142787+0000","last_unstale":"2023-11-08T19:26:50.131513+0000","last_undegraded":"2023-11-08T19:26:50.131513+0000","last_fullsized":"2023-11-08T19:26:50.131513+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:54:36.305399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.289448+0000","last_change":"2023-11-08T19:26:49.138209+0000","last_active":"2023-11-08T19:26:50.289448+0000","last_peered":"2023-11-08T19:26:50.289448+0000","last_clean":"2023-11-08T19:26:50.289448+0000","last_became_active":"2023-11-08T19:26:49.137935+0000","last_became_peered":"2023-11-08T19:26:49.137935+0000","last_unstale":"2023-11-08T19:26:50.289448+0000","last_undegraded":"2023-11-08T19:26:50.289448+0000","last_fullsized":"2023-11-08T19:26:50.289448+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:50:38.044081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.448733+0000","last_change":"2023-11-08T19:26:49.145939+0000","last_active":"2023-11-08T19:26:50.448733+0000","last_peered":"2023-11-08T19:26:50.448733+0000","last_clean":"2023-11-08T19:26:50.448733+0000","last_became_active":"2023-11-08T19:26:49.145688+0000","last_became_peered":"2023-11-08T19:26:49.145688+0000","last_unstale":"2023-11-08T19:26:50.448733+0000","last_undegraded":"2023-11-08T19:26:50.448733+0000","last_fullsized":"2023-11-08T19:26:50.448733+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:08:19.420005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.448904+0000","last_change":"2023-11-08T19:26:49.141037+0000","last_active":"2023-11-08T19:26:50.448904+0000","last_peered":"2023-11-08T19:26:50.448904+0000","last_clean":"2023-11-08T19:26:50.448904+0000","last_became_active":"2023-11-08T19:26:49.140707+0000","last_became_peered":"2023-11-08T19:26:49.140707+0000","last_unstale":"2023-11-08T19:26:50.448904+0000","last_undegraded":"2023-11-08T19:26:50.448904+0000","last_fullsized":"2023-11-08T19:26:50.448904+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:26:03.712317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.130349+0000","last_change":"2023-11-08T19:26:49.139256+0000","last_active":"2023-11-08T19:26:50.130349+0000","last_peered":"2023-11-08T19:26:50.130349+0000","last_clean":"2023-11-08T19:26:50.130349+0000","last_became_active":"2023-11-08T19:26:49.138584+0000","last_became_peered":"2023-11-08T19:26:49.138584+0000","last_unstale":"2023-11-08T19:26:50.130349+0000","last_undegraded":"2023-11-08T19:26:50.130349+0000","last_fullsized":"2023-11-08T19:26:50.130349+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:11:32.570964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.447801+0000","last_change":"2023-11-08T19:26:49.141825+0000","last_active":"2023-11-08T19:26:50.447801+0000","last_peered":"2023-11-08T19:26:50.447801+0000","last_clean":"2023-11-08T19:26:50.447801+0000","last_became_active":"2023-11-08T19:26:49.141541+0000","last_became_peered":"2023-11-08T19:26:49.141541+0000","last_unstale":"2023-11-08T19:26:50.447801+0000","last_undegraded":"2023-11-08T19:26:50.447801+0000","last_fullsized":"2023-11-08T19:26:50.447801+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:11:28.367601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.288852+0000","last_change":"2023-11-08T19:26:49.141270+0000","last_active":"2023-11-08T19:26:50.288852+0000","last_peered":"2023-11-08T19:26:50.288852+0000","last_clean":"2023-11-08T19:26:50.288852+0000","last_became_active":"2023-11-08T19:26:49.141002+0000","last_became_peered":"2023-11-08T19:26:49.141002+0000","last_unstale":"2023-11-08T19:26:50.288852+0000","last_undegraded":"2023-11-08T19:26:50.288852+0000","last_fullsized":"2023-11-08T19:26:50.288852+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:32:36.037246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.447419+0000","last_change":"2023-11-08T19:26:49.139787+0000","last_active":"2023-11-08T19:26:50.447419+0000","last_peered":"2023-11-08T19:26:50.447419+0000","last_clean":"2023-11-08T19:26:50.447419+0000","last_became_active":"2023-11-08T19:26:49.139557+0000","last_became_peered":"2023-11-08T19:26:49.139557+0000","last_unstale":"2023-11-08T19:26:50.447419+0000","last_undegraded":"2023-11-08T19:26:50.447419+0000","last_fullsized":"2023-11-08T19:26:50.447419+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:46:00.327628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.447687+0000","last_change":"2023-11-08T19:26:49.150960+0000","last_active":"2023-11-08T19:26:50.447687+0000","last_peered":"2023-11-08T19:26:50.447687+0000","last_clean":"2023-11-08T19:26:50.447687+0000","last_became_active":"2023-11-08T19:26:49.150712+0000","last_became_peered":"2023-11-08T19:26:49.150712+0000","last_unstale":"2023-11-08T19:26:50.447687+0000","last_undegraded":"2023-11-08T19:26:50.447687+0000","last_fullsized":"2023-11-08T19:26:50.447687+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:15:55.235941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.447907+0000","last_change":"2023-11-08T19:26:48.607008+0000","last_active":"2023-11-08T19:26:50.447907+0000","last_peered":"2023-11-08T19:26:50.447907+0000","last_clean":"2023-11-08T19:26:50.447907+0000","last_became_active":"2023-11-08T19:26:48.606566+0000","last_became_peered":"2023-11-08T19:26:48.606566+0000","last_unstale":"2023-11-08T19:26:50.447907+0000","last_undegraded":"2023-11-08T19:26:50.447907+0000","last_fullsized":"2023-11-08T19:26:50.447907+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_clean_scrub_stamp":"2023-11-08T19:26:47.569818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:11:30.606713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.134458+0000","last_change":"2023-11-08T19:25:47.285071+0000","last_active":"2023-11-08T19:26:49.134458+0000","last_peered":"2023-11-08T19:26:49.134458+0000","last_clean":"2023-11-08T19:26:49.134458+0000","last_became_active":"2023-11-08T19:25:47.284788+0000","last_became_peered":"2023-11-08T19:25:47.284788+0000","last_unstale":"2023-11-08T19:26:49.134458+0000","last_undegraded":"2023-11-08T19:26:49.134458+0000","last_fullsized":"2023-11-08T19:26:49.134458+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:50:50.522780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":226,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-08T19:26:48.598028+0000","last_change":"2023-11-08T19:22:58.054283+0000","last_active":"2023-11-08T19:26:48.598028+0000","last_peered":"2023-11-08T19:26:48.598028+0000","last_clean":"2023-11-08T19:26:48.598028+0000","last_became_active":"2023-11-08T19:22:58.053337+0000","last_became_peered":"2023-11-08T19:22:58.053337+0000","last_unstale":"2023-11-08T19:26:48.598028+0000","last_undegraded":"2023-11-08T19:26:48.598028+0000","last_fullsized":"2023-11-08T19:26:48.598028+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:22:56.479654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:22:56.479654+0000","last_clean_scrub_stamp":"2023-11-08T19:22:56.479654+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:16:05.317001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.131267+0000","last_change":"2023-11-08T19:24:32.530665+0000","last_active":"2023-11-08T19:26:49.131267+0000","last_peered":"2023-11-08T19:26:49.131267+0000","last_clean":"2023-11-08T19:26:49.131267+0000","last_became_active":"2023-11-08T19:24:31.148363+0000","last_became_peered":"2023-11-08T19:24:31.148363+0000","last_unstale":"2023-11-08T19:26:49.131267+0000","last_undegraded":"2023-11-08T19:26:49.131267+0000","last_fullsized":"2023-11-08T19:26:49.131267+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:02:27.987795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075444200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-08T19:26:48.598273+0000","last_change":"2023-11-08T19:25:48.371346+0000","last_active":"2023-11-08T19:26:48.598273+0000","last_peered":"2023-11-08T19:26:48.598273+0000","last_clean":"2023-11-08T19:26:48.598273+0000","last_became_active":"2023-11-08T19:25:46.289470+0000","last_became_peered":"2023-11-08T19:25:46.289470+0000","last_unstale":"2023-11-08T19:26:48.598273+0000","last_undegraded":"2023-11-08T19:26:48.598273+0000","last_fullsized":"2023-11-08T19:26:48.598273+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:25:34.010085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000371219,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.448571+0000","last_change":"2023-11-08T19:26:49.148430+0000","last_active":"2023-11-08T19:26:50.448571+0000","last_peered":"2023-11-08T19:26:50.448571+0000","last_clean":"2023-11-08T19:26:50.448571+0000","last_became_active":"2023-11-08T19:26:49.148111+0000","last_became_peered":"2023-11-08T19:26:49.148111+0000","last_unstale":"2023-11-08T19:26:50.448571+0000","last_undegraded":"2023-11-08T19:26:50.448571+0000","last_fullsized":"2023-11-08T19:26:50.448571+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:21:42.870172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"95'3","reported_seq":15,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.289505+0000","last_change":"2023-11-08T19:26:48.606002+0000","last_active":"2023-11-08T19:26:50.289505+0000","last_peered":"2023-11-08T19:26:50.289505+0000","last_clean":"2023-11-08T19:26:50.289505+0000","last_became_active":"2023-11-08T19:26:48.605700+0000","last_became_peered":"2023-11-08T19:26:48.605700+0000","last_unstale":"2023-11-08T19:26:50.289505+0000","last_undegraded":"2023-11-08T19:26:50.289505+0000","last_fullsized":"2023-11-08T19:26:50.289505+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_clean_scrub_stamp":"2023-11-08T19:26:47.569818+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:37:17.021877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":33,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.128055+0000","last_change":"2023-11-08T19:25:47.283242+0000","last_active":"2023-11-08T19:26:49.128055+0000","last_peered":"2023-11-08T19:26:49.128055+0000","last_clean":"2023-11-08T19:26:49.128055+0000","last_became_active":"2023-11-08T19:25:47.282922+0000","last_became_peered":"2023-11-08T19:25:47.282922+0000","last_unstale":"2023-11-08T19:26:49.128055+0000","last_undegraded":"2023-11-08T19:26:49.128055+0000","last_fullsized":"2023-11-08T19:26:49.128055+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:26:23.400596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.136754+0000","last_change":"2023-11-08T19:24:32.544333+0000","last_active":"2023-11-08T19:26:49.136754+0000","last_peered":"2023-11-08T19:26:49.136754+0000","last_clean":"2023-11-08T19:26:49.136754+0000","last_became_active":"2023-11-08T19:24:31.138598+0000","last_became_peered":"2023-11-08T19:24:31.138598+0000","last_unstale":"2023-11-08T19:26:49.136754+0000","last_undegraded":"2023-11-08T19:26:49.136754+0000","last_fullsized":"2023-11-08T19:26:49.136754+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:11.860580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015114824000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.127941+0000","last_change":"2023-11-08T19:25:48.374357+0000","last_active":"2023-11-08T19:26:49.127941+0000","last_peered":"2023-11-08T19:26:49.127941+0000","last_clean":"2023-11-08T19:26:49.127941+0000","last_became_active":"2023-11-08T19:25:46.279007+0000","last_became_peered":"2023-11-08T19:25:46.279007+0000","last_unstale":"2023-11-08T19:26:49.127941+0000","last_undegraded":"2023-11-08T19:26:49.127941+0000","last_fullsized":"2023-11-08T19:26:49.127941+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:59:30.845191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036813240000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.448155+0000","last_change":"2023-11-08T19:26:49.140757+0000","last_active":"2023-11-08T19:26:50.448155+0000","last_peered":"2023-11-08T19:26:50.448155+0000","last_clean":"2023-11-08T19:26:50.448155+0000","last_became_active":"2023-11-08T19:26:49.140501+0000","last_became_peered":"2023-11-08T19:26:49.140501+0000","last_unstale":"2023-11-08T19:26:50.448155+0000","last_undegraded":"2023-11-08T19:26:50.448155+0000","last_fullsized":"2023-11-08T19:26:50.448155+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:51:29.963135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"95'6","reported_seq":18,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.289257+0000","last_change":"2023-11-08T19:26:48.607302+0000","last_active":"2023-11-08T19:26:50.289257+0000","last_peered":"2023-11-08T19:26:50.289257+0000","last_clean":"2023-11-08T19:26:50.289257+0000","last_became_active":"2023-11-08T19:26:48.606913+0000","last_became_peered":"2023-11-08T19:26:48.606913+0000","last_unstale":"2023-11-08T19:26:50.289257+0000","last_undegraded":"2023-11-08T19:26:50.289257+0000","last_fullsized":"2023-11-08T19:26:50.289257+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_clean_scrub_stamp":"2023-11-08T19:26:47.569818+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:16:03.290041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":31,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.134687+0000","last_change":"2023-11-08T19:25:47.285093+0000","last_active":"2023-11-08T19:26:49.134687+0000","last_peered":"2023-11-08T19:26:49.134687+0000","last_clean":"2023-11-08T19:26:49.134687+0000","last_became_active":"2023-11-08T19:25:47.284796+0000","last_became_peered":"2023-11-08T19:25:47.284796+0000","last_unstale":"2023-11-08T19:26:49.134687+0000","last_undegraded":"2023-11-08T19:26:49.134687+0000","last_fullsized":"2023-11-08T19:26:49.134687+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:46:36.504650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.136089+0000","last_change":"2023-11-08T19:24:32.544285+0000","last_active":"2023-11-08T19:26:49.136089+0000","last_peered":"2023-11-08T19:26:49.136089+0000","last_clean":"2023-11-08T19:26:49.136089+0000","last_became_active":"2023-11-08T19:24:31.142028+0000","last_became_peered":"2023-11-08T19:24:31.142028+0000","last_unstale":"2023-11-08T19:26:49.136089+0000","last_undegraded":"2023-11-08T19:26:49.136089+0000","last_fullsized":"2023-11-08T19:26:49.136089+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:01:24.198196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067537399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.135219+0000","last_change":"2023-11-08T19:25:48.372192+0000","last_active":"2023-11-08T19:26:49.135219+0000","last_peered":"2023-11-08T19:26:49.135219+0000","last_clean":"2023-11-08T19:26:49.135219+0000","last_became_active":"2023-11-08T19:25:46.288739+0000","last_became_peered":"2023-11-08T19:25:46.288739+0000","last_unstale":"2023-11-08T19:26:49.135219+0000","last_undegraded":"2023-11-08T19:26:49.135219+0000","last_fullsized":"2023-11-08T19:26:49.135219+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:45:04.839053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015057530000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.448283+0000","last_change":"2023-11-08T19:26:49.143078+0000","last_active":"2023-11-08T19:26:50.448283+0000","last_peered":"2023-11-08T19:26:50.448283+0000","last_clean":"2023-11-08T19:26:50.448283+0000","last_became_active":"2023-11-08T19:26:49.139387+0000","last_became_peered":"2023-11-08T19:26:49.139387+0000","last_unstale":"2023-11-08T19:26:50.448283+0000","last_undegraded":"2023-11-08T19:26:50.448283+0000","last_fullsized":"2023-11-08T19:26:50.448283+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:20:47.065925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.130084+0000","last_change":"2023-11-08T19:26:48.615811+0000","last_active":"2023-11-08T19:26:50.130084+0000","last_peered":"2023-11-08T19:26:50.130084+0000","last_clean":"2023-11-08T19:26:50.130084+0000","last_became_active":"2023-11-08T19:26:48.615533+0000","last_became_peered":"2023-11-08T19:26:48.615533+0000","last_unstale":"2023-11-08T19:26:50.130084+0000","last_undegraded":"2023-11-08T19:26:50.130084+0000","last_fullsized":"2023-11-08T19:26:50.130084+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_clean_scrub_stamp":"2023-11-08T19:26:47.569818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:24:33.093083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":33,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.127854+0000","last_change":"2023-11-08T19:25:47.287920+0000","last_active":"2023-11-08T19:26:49.127854+0000","last_peered":"2023-11-08T19:26:49.127854+0000","last_clean":"2023-11-08T19:26:49.127854+0000","last_became_active":"2023-11-08T19:25:47.287494+0000","last_became_peered":"2023-11-08T19:25:47.287494+0000","last_unstale":"2023-11-08T19:26:49.127854+0000","last_undegraded":"2023-11-08T19:26:49.127854+0000","last_fullsized":"2023-11-08T19:26:49.127854+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:42:18.942062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":62,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.133305+0000","last_change":"2023-11-08T19:24:32.142836+0000","last_active":"2023-11-08T19:26:49.133305+0000","last_peered":"2023-11-08T19:26:49.133305+0000","last_clean":"2023-11-08T19:26:49.133305+0000","last_became_active":"2023-11-08T19:24:31.141367+0000","last_became_peered":"2023-11-08T19:24:31.141367+0000","last_unstale":"2023-11-08T19:26:49.133305+0000","last_undegraded":"2023-11-08T19:26:49.133305+0000","last_fullsized":"2023-11-08T19:26:49.133305+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:39.214888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001335136,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.136012+0000","last_change":"2023-11-08T19:25:48.372718+0000","last_active":"2023-11-08T19:26:49.136012+0000","last_peered":"2023-11-08T19:26:49.136012+0000","last_clean":"2023-11-08T19:26:49.136012+0000","last_became_active":"2023-11-08T19:25:46.289283+0000","last_became_peered":"2023-11-08T19:25:46.289283+0000","last_unstale":"2023-11-08T19:26:49.136012+0000","last_undegraded":"2023-11-08T19:26:49.136012+0000","last_fullsized":"2023-11-08T19:26:49.136012+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:15:51.881891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001274049,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.132311+0000","last_change":"2023-11-08T19:26:49.145395+0000","last_active":"2023-11-08T19:26:50.132311+0000","last_peered":"2023-11-08T19:26:50.132311+0000","last_clean":"2023-11-08T19:26:50.132311+0000","last_became_active":"2023-11-08T19:26:49.145018+0000","last_became_peered":"2023-11-08T19:26:49.145018+0000","last_unstale":"2023-11-08T19:26:50.132311+0000","last_undegraded":"2023-11-08T19:26:50.132311+0000","last_fullsized":"2023-11-08T19:26:50.132311+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:59:07.418680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.449078+0000","last_change":"2023-11-08T19:26:48.606392+0000","last_active":"2023-11-08T19:26:50.449078+0000","last_peered":"2023-11-08T19:26:50.449078+0000","last_clean":"2023-11-08T19:26:50.449078+0000","last_became_active":"2023-11-08T19:26:48.606075+0000","last_became_peered":"2023-11-08T19:26:48.606075+0000","last_unstale":"2023-11-08T19:26:50.449078+0000","last_undegraded":"2023-11-08T19:26:50.449078+0000","last_fullsized":"2023-11-08T19:26:50.449078+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_clean_scrub_stamp":"2023-11-08T19:26:47.569818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:51:12.842624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":31,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.134983+0000","last_change":"2023-11-08T19:25:47.285353+0000","last_active":"2023-11-08T19:26:49.134983+0000","last_peered":"2023-11-08T19:26:49.134983+0000","last_clean":"2023-11-08T19:26:49.134983+0000","last_became_active":"2023-11-08T19:25:47.285075+0000","last_became_peered":"2023-11-08T19:25:47.285075+0000","last_unstale":"2023-11-08T19:26:49.134983+0000","last_undegraded":"2023-11-08T19:26:49.134983+0000","last_fullsized":"2023-11-08T19:26:49.134983+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:20:50.791463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":71,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.129626+0000","last_change":"2023-11-08T19:24:32.139885+0000","last_active":"2023-11-08T19:26:49.129626+0000","last_peered":"2023-11-08T19:26:49.129626+0000","last_clean":"2023-11-08T19:26:49.129626+0000","last_became_active":"2023-11-08T19:24:31.145329+0000","last_became_peered":"2023-11-08T19:24:31.145329+0000","last_unstale":"2023-11-08T19:26:49.129626+0000","last_undegraded":"2023-11-08T19:26:49.129626+0000","last_fullsized":"2023-11-08T19:26:49.129626+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:25:18.356784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049012999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.127672+0000","last_change":"2023-11-08T19:25:48.373848+0000","last_active":"2023-11-08T19:26:49.127672+0000","last_peered":"2023-11-08T19:26:49.127672+0000","last_clean":"2023-11-08T19:26:49.127672+0000","last_became_active":"2023-11-08T19:25:46.282174+0000","last_became_peered":"2023-11-08T19:25:46.282174+0000","last_unstale":"2023-11-08T19:26:49.127672+0000","last_undegraded":"2023-11-08T19:26:49.127672+0000","last_fullsized":"2023-11-08T19:26:49.127672+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:00:06.938052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000727792,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.448090+0000","last_change":"2023-11-08T19:26:49.148016+0000","last_active":"2023-11-08T19:26:50.448090+0000","last_peered":"2023-11-08T19:26:50.448090+0000","last_clean":"2023-11-08T19:26:50.448090+0000","last_became_active":"2023-11-08T19:26:49.147811+0000","last_became_peered":"2023-11-08T19:26:49.147811+0000","last_unstale":"2023-11-08T19:26:50.448090+0000","last_undegraded":"2023-11-08T19:26:50.448090+0000","last_fullsized":"2023-11-08T19:26:50.448090+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:40:18.977322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"95'8","reported_seq":20,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.128911+0000","last_change":"2023-11-08T19:26:48.609692+0000","last_active":"2023-11-08T19:26:50.128911+0000","last_peered":"2023-11-08T19:26:50.128911+0000","last_clean":"2023-11-08T19:26:50.128911+0000","last_became_active":"2023-11-08T19:26:48.609425+0000","last_became_peered":"2023-11-08T19:26:48.609425+0000","last_unstale":"2023-11-08T19:26:50.128911+0000","last_undegraded":"2023-11-08T19:26:50.128911+0000","last_fullsized":"2023-11-08T19:26:50.128911+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_clean_scrub_stamp":"2023-11-08T19:26:47.569818+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:51:13.620842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.130492+0000","last_change":"2023-11-08T19:25:47.287677+0000","last_active":"2023-11-08T19:26:49.130492+0000","last_peered":"2023-11-08T19:26:49.130492+0000","last_clean":"2023-11-08T19:26:49.130492+0000","last_became_active":"2023-11-08T19:25:47.287419+0000","last_became_peered":"2023-11-08T19:25:47.287419+0000","last_unstale":"2023-11-08T19:26:49.130492+0000","last_undegraded":"2023-11-08T19:26:49.130492+0000","last_fullsized":"2023-11-08T19:26:49.130492+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:22:08.770702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":70,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.136593+0000","last_change":"2023-11-08T19:24:32.140880+0000","last_active":"2023-11-08T19:26:49.136593+0000","last_peered":"2023-11-08T19:26:49.136593+0000","last_clean":"2023-11-08T19:26:49.136593+0000","last_became_active":"2023-11-08T19:24:31.146063+0000","last_became_peered":"2023-11-08T19:24:31.146063+0000","last_unstale":"2023-11-08T19:26:49.136593+0000","last_undegraded":"2023-11-08T19:26:49.136593+0000","last_fullsized":"2023-11-08T19:26:49.136593+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:54:08.985813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089896300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.131430+0000","last_change":"2023-11-08T19:25:48.374690+0000","last_active":"2023-11-08T19:26:49.131430+0000","last_peered":"2023-11-08T19:26:49.131430+0000","last_clean":"2023-11-08T19:26:49.131430+0000","last_became_active":"2023-11-08T19:25:46.281986+0000","last_became_peered":"2023-11-08T19:25:46.281986+0000","last_unstale":"2023-11-08T19:26:49.131430+0000","last_undegraded":"2023-11-08T19:26:49.131430+0000","last_fullsized":"2023-11-08T19:26:49.131430+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:21:00.981136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003067771,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.448338+0000","last_change":"2023-11-08T19:26:49.142811+0000","last_active":"2023-11-08T19:26:50.448338+0000","last_peered":"2023-11-08T19:26:50.448338+0000","last_clean":"2023-11-08T19:26:50.448338+0000","last_became_active":"2023-11-08T19:26:49.142234+0000","last_became_peered":"2023-11-08T19:26:49.142234+0000","last_unstale":"2023-11-08T19:26:50.448338+0000","last_undegraded":"2023-11-08T19:26:50.448338+0000","last_fullsized":"2023-11-08T19:26:50.448338+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:41:47.767607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"95'2","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.447984+0000","last_change":"2023-11-08T19:26:48.611270+0000","last_active":"2023-11-08T19:26:50.447984+0000","last_peered":"2023-11-08T19:26:50.447984+0000","last_clean":"2023-11-08T19:26:50.447984+0000","last_became_active":"2023-11-08T19:26:48.610875+0000","last_became_peered":"2023-11-08T19:26:48.610875+0000","last_unstale":"2023-11-08T19:26:50.447984+0000","last_undegraded":"2023-11-08T19:26:50.447984+0000","last_fullsized":"2023-11-08T19:26:50.447984+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_clean_scrub_stamp":"2023-11-08T19:26:47.569818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:32:51.799794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":28,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-08T19:26:48.598366+0000","last_change":"2023-11-08T19:25:47.287986+0000","last_active":"2023-11-08T19:26:48.598366+0000","last_peered":"2023-11-08T19:26:48.598366+0000","last_clean":"2023-11-08T19:26:48.598366+0000","last_became_active":"2023-11-08T19:25:47.287560+0000","last_became_peered":"2023-11-08T19:25:47.287560+0000","last_unstale":"2023-11-08T19:26:48.598366+0000","last_undegraded":"2023-11-08T19:26:48.598366+0000","last_fullsized":"2023-11-08T19:26:48.598366+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:35:31.433056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.131351+0000","last_change":"2023-11-08T19:24:32.530620+0000","last_active":"2023-11-08T19:26:49.131351+0000","last_peered":"2023-11-08T19:26:49.131351+0000","last_clean":"2023-11-08T19:26:49.131351+0000","last_became_active":"2023-11-08T19:24:31.144223+0000","last_became_peered":"2023-11-08T19:24:31.144223+0000","last_unstale":"2023-11-08T19:26:49.131351+0000","last_undegraded":"2023-11-08T19:26:49.131351+0000","last_fullsized":"2023-11-08T19:26:49.131351+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:01:25.647952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071879799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.136744+0000","last_change":"2023-11-08T19:25:48.285326+0000","last_active":"2023-11-08T19:26:49.136744+0000","last_peered":"2023-11-08T19:26:49.136744+0000","last_clean":"2023-11-08T19:26:49.136744+0000","last_became_active":"2023-11-08T19:25:46.278686+0000","last_became_peered":"2023-11-08T19:25:46.278686+0000","last_unstale":"2023-11-08T19:26:49.136744+0000","last_undegraded":"2023-11-08T19:26:49.136744+0000","last_fullsized":"2023-11-08T19:26:49.136744+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:25:34.010085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078409499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.448402+0000","last_change":"2023-11-08T19:26:49.138972+0000","last_active":"2023-11-08T19:26:50.448402+0000","last_peered":"2023-11-08T19:26:50.448402+0000","last_clean":"2023-11-08T19:26:50.448402+0000","last_became_active":"2023-11-08T19:26:49.138703+0000","last_became_peered":"2023-11-08T19:26:49.138703+0000","last_unstale":"2023-11-08T19:26:50.448402+0000","last_undegraded":"2023-11-08T19:26:50.448402+0000","last_fullsized":"2023-11-08T19:26:50.448402+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:16:49.803024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.131940+0000","last_change":"2023-11-08T19:26:48.596313+0000","last_active":"2023-11-08T19:26:50.131940+0000","last_peered":"2023-11-08T19:26:50.131940+0000","last_clean":"2023-11-08T19:26:50.131940+0000","last_became_active":"2023-11-08T19:26:48.596025+0000","last_became_peered":"2023-11-08T19:26:48.596025+0000","last_unstale":"2023-11-08T19:26:50.131940+0000","last_undegraded":"2023-11-08T19:26:50.131940+0000","last_fullsized":"2023-11-08T19:26:50.131940+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_clean_scrub_stamp":"2023-11-08T19:26:47.569818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:24:08.533796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.136372+0000","last_change":"2023-11-08T19:25:47.289726+0000","last_active":"2023-11-08T19:26:49.136372+0000","last_peered":"2023-11-08T19:26:49.136372+0000","last_clean":"2023-11-08T19:26:49.136372+0000","last_became_active":"2023-11-08T19:25:47.289362+0000","last_became_peered":"2023-11-08T19:25:47.289362+0000","last_unstale":"2023-11-08T19:26:49.136372+0000","last_undegraded":"2023-11-08T19:26:49.136372+0000","last_fullsized":"2023-11-08T19:26:49.136372+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:38:55.785104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":59,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-08T19:26:48.598985+0000","last_change":"2023-11-08T19:24:32.147025+0000","last_active":"2023-11-08T19:26:48.598985+0000","last_peered":"2023-11-08T19:26:48.598985+0000","last_clean":"2023-11-08T19:26:48.598985+0000","last_became_active":"2023-11-08T19:24:31.147082+0000","last_became_peered":"2023-11-08T19:24:31.147082+0000","last_unstale":"2023-11-08T19:26:48.598985+0000","last_undegraded":"2023-11-08T19:26:48.598985+0000","last_fullsized":"2023-11-08T19:26:48.598985+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:02:27.987795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043701599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.133318+0000","last_change":"2023-11-08T19:25:48.374739+0000","last_active":"2023-11-08T19:26:49.133318+0000","last_peered":"2023-11-08T19:26:49.133318+0000","last_clean":"2023-11-08T19:26:49.133318+0000","last_became_active":"2023-11-08T19:25:46.282071+0000","last_became_peered":"2023-11-08T19:25:46.282071+0000","last_unstale":"2023-11-08T19:26:49.133318+0000","last_undegraded":"2023-11-08T19:26:49.133318+0000","last_fullsized":"2023-11-08T19:26:49.133318+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:42:47.677504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023654909999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.448086+0000","last_change":"2023-11-08T19:26:49.145498+0000","last_active":"2023-11-08T19:26:50.448086+0000","last_peered":"2023-11-08T19:26:50.448086+0000","last_clean":"2023-11-08T19:26:50.448086+0000","last_became_active":"2023-11-08T19:26:49.145172+0000","last_became_peered":"2023-11-08T19:26:49.145172+0000","last_unstale":"2023-11-08T19:26:50.448086+0000","last_undegraded":"2023-11-08T19:26:50.448086+0000","last_fullsized":"2023-11-08T19:26:50.448086+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:03:02.752773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"95'2","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.129976+0000","last_change":"2023-11-08T19:26:48.615466+0000","last_active":"2023-11-08T19:26:50.129976+0000","last_peered":"2023-11-08T19:26:50.129976+0000","last_clean":"2023-11-08T19:26:50.129976+0000","last_became_active":"2023-11-08T19:26:48.615157+0000","last_became_peered":"2023-11-08T19:26:48.615157+0000","last_unstale":"2023-11-08T19:26:50.129976+0000","last_undegraded":"2023-11-08T19:26:50.129976+0000","last_fullsized":"2023-11-08T19:26:50.129976+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_clean_scrub_stamp":"2023-11-08T19:26:47.569818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:59:37.487128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.136833+0000","last_change":"2023-11-08T19:24:32.544063+0000","last_active":"2023-11-08T19:26:49.136833+0000","last_peered":"2023-11-08T19:26:49.136833+0000","last_clean":"2023-11-08T19:26:49.136833+0000","last_became_active":"2023-11-08T19:24:31.144795+0000","last_became_peered":"2023-11-08T19:24:31.144795+0000","last_unstale":"2023-11-08T19:26:49.136833+0000","last_undegraded":"2023-11-08T19:26:49.136833+0000","last_fullsized":"2023-11-08T19:26:49.136833+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:12:42.248307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01495431,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.131500+0000","last_change":"2023-11-08T19:25:48.283673+0000","last_active":"2023-11-08T19:26:49.131500+0000","last_peered":"2023-11-08T19:26:49.131500+0000","last_clean":"2023-11-08T19:26:49.131500+0000","last_became_active":"2023-11-08T19:25:46.285766+0000","last_became_peered":"2023-11-08T19:25:46.285766+0000","last_unstale":"2023-11-08T19:26:49.131500+0000","last_undegraded":"2023-11-08T19:26:49.131500+0000","last_fullsized":"2023-11-08T19:26:49.131500+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:46:35.498766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001756748,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":28,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-08T19:26:48.598115+0000","last_change":"2023-11-08T19:25:47.288301+0000","last_active":"2023-11-08T19:26:48.598115+0000","last_peered":"2023-11-08T19:26:48.598115+0000","last_clean":"2023-11-08T19:26:48.598115+0000","last_became_active":"2023-11-08T19:25:47.288027+0000","last_became_peered":"2023-11-08T19:25:47.288027+0000","last_unstale":"2023-11-08T19:26:48.598115+0000","last_undegraded":"2023-11-08T19:26:48.598115+0000","last_fullsized":"2023-11-08T19:26:48.598115+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:23:13.428596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.161047+0000","last_change":"2023-11-08T19:26:49.153935+0000","last_active":"2023-11-08T19:26:49.161047+0000","last_peered":"2023-11-08T19:26:49.161047+0000","last_clean":"2023-11-08T19:26:49.161047+0000","last_became_active":"2023-11-08T19:26:49.153679+0000","last_became_peered":"2023-11-08T19:26:49.153679+0000","last_unstale":"2023-11-08T19:26:49.161047+0000","last_undegraded":"2023-11-08T19:26:49.161047+0000","last_fullsized":"2023-11-08T19:26:49.161047+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:50:00.221115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"95'2","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.129767+0000","last_change":"2023-11-08T19:26:48.615745+0000","last_active":"2023-11-08T19:26:50.129767+0000","last_peered":"2023-11-08T19:26:50.129767+0000","last_clean":"2023-11-08T19:26:50.129767+0000","last_became_active":"2023-11-08T19:26:48.615472+0000","last_became_peered":"2023-11-08T19:26:48.615472+0000","last_unstale":"2023-11-08T19:26:50.129767+0000","last_undegraded":"2023-11-08T19:26:50.129767+0000","last_fullsized":"2023-11-08T19:26:50.129767+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_clean_scrub_stamp":"2023-11-08T19:26:47.569818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:41:45.199134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.134853+0000","last_change":"2023-11-08T19:24:32.263810+0000","last_active":"2023-11-08T19:26:49.134853+0000","last_peered":"2023-11-08T19:26:49.134853+0000","last_clean":"2023-11-08T19:26:49.134853+0000","last_became_active":"2023-11-08T19:24:31.138814+0000","last_became_peered":"2023-11-08T19:24:31.138814+0000","last_unstale":"2023-11-08T19:26:49.134853+0000","last_undegraded":"2023-11-08T19:26:49.134853+0000","last_fullsized":"2023-11-08T19:26:49.134853+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:21:55.985548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048136000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.130205+0000","last_change":"2023-11-08T19:25:48.283572+0000","last_active":"2023-11-08T19:26:49.130205+0000","last_peered":"2023-11-08T19:26:49.130205+0000","last_clean":"2023-11-08T19:26:49.130205+0000","last_became_active":"2023-11-08T19:25:46.271936+0000","last_became_peered":"2023-11-08T19:25:46.271936+0000","last_unstale":"2023-11-08T19:26:49.130205+0000","last_undegraded":"2023-11-08T19:26:49.130205+0000","last_fullsized":"2023-11-08T19:26:49.130205+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:46:11.541748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00186835,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.131263+0000","last_change":"2023-11-08T19:25:47.282856+0000","last_active":"2023-11-08T19:26:49.131263+0000","last_peered":"2023-11-08T19:26:49.131263+0000","last_clean":"2023-11-08T19:26:49.131263+0000","last_became_active":"2023-11-08T19:25:47.282594+0000","last_became_peered":"2023-11-08T19:25:47.282594+0000","last_unstale":"2023-11-08T19:26:49.131263+0000","last_undegraded":"2023-11-08T19:26:49.131263+0000","last_fullsized":"2023-11-08T19:26:49.131263+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:14:12.111756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.448708+0000","last_change":"2023-11-08T19:26:49.145756+0000","last_active":"2023-11-08T19:26:50.448708+0000","last_peered":"2023-11-08T19:26:50.448708+0000","last_clean":"2023-11-08T19:26:50.448708+0000","last_became_active":"2023-11-08T19:26:49.145481+0000","last_became_peered":"2023-11-08T19:26:49.145481+0000","last_unstale":"2023-11-08T19:26:50.448708+0000","last_undegraded":"2023-11-08T19:26:50.448708+0000","last_fullsized":"2023-11-08T19:26:50.448708+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:54:44.096661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"95'4","reported_seq":16,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.448153+0000","last_change":"2023-11-08T19:26:48.603250+0000","last_active":"2023-11-08T19:26:50.448153+0000","last_peered":"2023-11-08T19:26:50.448153+0000","last_clean":"2023-11-08T19:26:50.448153+0000","last_became_active":"2023-11-08T19:26:48.602946+0000","last_became_peered":"2023-11-08T19:26:48.602946+0000","last_unstale":"2023-11-08T19:26:50.448153+0000","last_undegraded":"2023-11-08T19:26:50.448153+0000","last_fullsized":"2023-11-08T19:26:50.448153+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_clean_scrub_stamp":"2023-11-08T19:26:47.569818+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:08:18.412447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":64,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.127384+0000","last_change":"2023-11-08T19:24:32.333096+0000","last_active":"2023-11-08T19:26:49.127384+0000","last_peered":"2023-11-08T19:26:49.127384+0000","last_clean":"2023-11-08T19:26:49.127384+0000","last_became_active":"2023-11-08T19:24:31.142985+0000","last_became_peered":"2023-11-08T19:24:31.142985+0000","last_unstale":"2023-11-08T19:26:49.127384+0000","last_undegraded":"2023-11-08T19:26:49.127384+0000","last_fullsized":"2023-11-08T19:26:49.127384+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:36:33.274496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000386048,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.134852+0000","last_change":"2023-11-08T19:25:48.372963+0000","last_active":"2023-11-08T19:26:49.134852+0000","last_peered":"2023-11-08T19:26:49.134852+0000","last_clean":"2023-11-08T19:26:49.134852+0000","last_became_active":"2023-11-08T19:25:46.283263+0000","last_became_peered":"2023-11-08T19:25:46.283263+0000","last_unstale":"2023-11-08T19:26:49.134852+0000","last_undegraded":"2023-11-08T19:26:49.134852+0000","last_fullsized":"2023-11-08T19:26:49.134852+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:25:34.010085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019848779999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":31,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.134727+0000","last_change":"2023-11-08T19:25:47.284816+0000","last_active":"2023-11-08T19:26:49.134727+0000","last_peered":"2023-11-08T19:26:49.134727+0000","last_clean":"2023-11-08T19:26:49.134727+0000","last_became_active":"2023-11-08T19:25:47.284522+0000","last_became_peered":"2023-11-08T19:25:47.284522+0000","last_unstale":"2023-11-08T19:26:49.134727+0000","last_undegraded":"2023-11-08T19:26:49.134727+0000","last_fullsized":"2023-11-08T19:26:49.134727+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:39:28.223686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.132338+0000","last_change":"2023-11-08T19:26:49.141787+0000","last_active":"2023-11-08T19:26:50.132338+0000","last_peered":"2023-11-08T19:26:50.132338+0000","last_clean":"2023-11-08T19:26:50.132338+0000","last_became_active":"2023-11-08T19:26:49.141417+0000","last_became_peered":"2023-11-08T19:26:49.141417+0000","last_unstale":"2023-11-08T19:26:50.132338+0000","last_undegraded":"2023-11-08T19:26:50.132338+0000","last_fullsized":"2023-11-08T19:26:50.132338+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:38:09.479582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"95'1","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.595825+0000","last_change":"2023-11-08T19:26:48.602448+0000","last_active":"2023-11-08T19:26:49.595825+0000","last_peered":"2023-11-08T19:26:49.595825+0000","last_clean":"2023-11-08T19:26:49.595825+0000","last_became_active":"2023-11-08T19:26:48.602137+0000","last_became_peered":"2023-11-08T19:26:48.602137+0000","last_unstale":"2023-11-08T19:26:49.595825+0000","last_undegraded":"2023-11-08T19:26:49.595825+0000","last_fullsized":"2023-11-08T19:26:49.595825+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_clean_scrub_stamp":"2023-11-08T19:26:47.569818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:56:49.852638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.134931+0000","last_change":"2023-11-08T19:24:32.530333+0000","last_active":"2023-11-08T19:26:49.134931+0000","last_peered":"2023-11-08T19:26:49.134931+0000","last_clean":"2023-11-08T19:26:49.134931+0000","last_became_active":"2023-11-08T19:24:31.144838+0000","last_became_peered":"2023-11-08T19:24:31.144838+0000","last_unstale":"2023-11-08T19:26:49.134931+0000","last_undegraded":"2023-11-08T19:26:49.134931+0000","last_fullsized":"2023-11-08T19:26:49.134931+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:39:48.473183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081588799999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.132103+0000","last_change":"2023-11-08T19:25:48.284699+0000","last_active":"2023-11-08T19:26:49.132103+0000","last_peered":"2023-11-08T19:26:49.132103+0000","last_clean":"2023-11-08T19:26:49.132103+0000","last_became_active":"2023-11-08T19:25:46.285588+0000","last_became_peered":"2023-11-08T19:25:46.285588+0000","last_unstale":"2023-11-08T19:26:49.132103+0000","last_undegraded":"2023-11-08T19:26:49.132103+0000","last_fullsized":"2023-11-08T19:26:49.132103+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:43:02.001903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023282350000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":31,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.134771+0000","last_change":"2023-11-08T19:25:47.283526+0000","last_active":"2023-11-08T19:26:49.134771+0000","last_peered":"2023-11-08T19:26:49.134771+0000","last_clean":"2023-11-08T19:26:49.134771+0000","last_became_active":"2023-11-08T19:25:47.283266+0000","last_became_peered":"2023-11-08T19:25:47.283266+0000","last_unstale":"2023-11-08T19:26:49.134771+0000","last_undegraded":"2023-11-08T19:26:49.134771+0000","last_fullsized":"2023-11-08T19:26:49.134771+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:35:31.433056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.288613+0000","last_change":"2023-11-08T19:26:49.146115+0000","last_active":"2023-11-08T19:26:50.288613+0000","last_peered":"2023-11-08T19:26:50.288613+0000","last_clean":"2023-11-08T19:26:50.288613+0000","last_became_active":"2023-11-08T19:26:49.145895+0000","last_became_peered":"2023-11-08T19:26:49.145895+0000","last_unstale":"2023-11-08T19:26:50.288613+0000","last_undegraded":"2023-11-08T19:26:50.288613+0000","last_fullsized":"2023-11-08T19:26:50.288613+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:43:29.378700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.130414+0000","last_change":"2023-11-08T19:26:48.606980+0000","last_active":"2023-11-08T19:26:50.130414+0000","last_peered":"2023-11-08T19:26:50.130414+0000","last_clean":"2023-11-08T19:26:50.130414+0000","last_became_active":"2023-11-08T19:26:48.606679+0000","last_became_peered":"2023-11-08T19:26:48.606679+0000","last_unstale":"2023-11-08T19:26:50.130414+0000","last_undegraded":"2023-11-08T19:26:50.130414+0000","last_fullsized":"2023-11-08T19:26:50.130414+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_clean_scrub_stamp":"2023-11-08T19:26:47.569818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:54:43.089103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":64,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.127930+0000","last_change":"2023-11-08T19:24:32.333430+0000","last_active":"2023-11-08T19:26:49.127930+0000","last_peered":"2023-11-08T19:26:49.127930+0000","last_clean":"2023-11-08T19:26:49.127930+0000","last_became_active":"2023-11-08T19:24:31.141710+0000","last_became_peered":"2023-11-08T19:24:31.141710+0000","last_unstale":"2023-11-08T19:26:49.127930+0000","last_undegraded":"2023-11-08T19:26:49.127930+0000","last_fullsized":"2023-11-08T19:26:49.127930+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:32:51.214551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000430438,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.133064+0000","last_change":"2023-11-08T19:25:48.283855+0000","last_active":"2023-11-08T19:26:49.133064+0000","last_peered":"2023-11-08T19:26:49.133064+0000","last_clean":"2023-11-08T19:26:49.133064+0000","last_became_active":"2023-11-08T19:25:46.273336+0000","last_became_peered":"2023-11-08T19:25:46.273336+0000","last_unstale":"2023-11-08T19:26:49.133064+0000","last_undegraded":"2023-11-08T19:26:49.133064+0000","last_fullsized":"2023-11-08T19:26:49.133064+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:33:35.492889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092577200000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.131351+0000","last_change":"2023-11-08T19:25:47.282840+0000","last_active":"2023-11-08T19:26:49.131351+0000","last_peered":"2023-11-08T19:26:49.131351+0000","last_clean":"2023-11-08T19:26:49.131351+0000","last_became_active":"2023-11-08T19:25:47.282600+0000","last_became_peered":"2023-11-08T19:25:47.282600+0000","last_unstale":"2023-11-08T19:26:49.131351+0000","last_undegraded":"2023-11-08T19:26:49.131351+0000","last_fullsized":"2023-11-08T19:26:49.131351+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:53:37.482245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.447838+0000","last_change":"2023-11-08T19:26:49.142299+0000","last_active":"2023-11-08T19:26:50.447838+0000","last_peered":"2023-11-08T19:26:50.447838+0000","last_clean":"2023-11-08T19:26:50.447838+0000","last_became_active":"2023-11-08T19:26:49.142002+0000","last_became_peered":"2023-11-08T19:26:49.142002+0000","last_unstale":"2023-11-08T19:26:50.447838+0000","last_undegraded":"2023-11-08T19:26:50.447838+0000","last_fullsized":"2023-11-08T19:26:50.447838+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:27:39.006698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.288606+0000","last_change":"2023-11-08T19:26:48.607415+0000","last_active":"2023-11-08T19:26:50.288606+0000","last_peered":"2023-11-08T19:26:50.288606+0000","last_clean":"2023-11-08T19:26:50.288606+0000","last_became_active":"2023-11-08T19:26:48.607080+0000","last_became_peered":"2023-11-08T19:26:48.607080+0000","last_unstale":"2023-11-08T19:26:50.288606+0000","last_undegraded":"2023-11-08T19:26:50.288606+0000","last_fullsized":"2023-11-08T19:26:50.288606+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_clean_scrub_stamp":"2023-11-08T19:26:47.569818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:58:01.414094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.130504+0000","last_change":"2023-11-08T19:25:47.285890+0000","last_active":"2023-11-08T19:26:49.130504+0000","last_peered":"2023-11-08T19:26:49.130504+0000","last_clean":"2023-11-08T19:26:49.130504+0000","last_became_active":"2023-11-08T19:25:47.285641+0000","last_became_peered":"2023-11-08T19:25:47.285641+0000","last_unstale":"2023-11-08T19:26:49.130504+0000","last_undegraded":"2023-11-08T19:26:49.130504+0000","last_fullsized":"2023-11-08T19:26:49.130504+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:27:18.335142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.136387+0000","last_change":"2023-11-08T19:24:32.530895+0000","last_active":"2023-11-08T19:26:49.136387+0000","last_peered":"2023-11-08T19:26:49.136387+0000","last_clean":"2023-11-08T19:26:49.136387+0000","last_became_active":"2023-11-08T19:24:31.146715+0000","last_became_peered":"2023-11-08T19:24:31.146715+0000","last_unstale":"2023-11-08T19:26:49.136387+0000","last_undegraded":"2023-11-08T19:26:49.136387+0000","last_fullsized":"2023-11-08T19:26:49.136387+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:39.214888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081671599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.131514+0000","last_change":"2023-11-08T19:25:48.284137+0000","last_active":"2023-11-08T19:26:49.131514+0000","last_peered":"2023-11-08T19:26:49.131514+0000","last_clean":"2023-11-08T19:26:49.131514+0000","last_became_active":"2023-11-08T19:25:46.285960+0000","last_became_peered":"2023-11-08T19:25:46.285960+0000","last_unstale":"2023-11-08T19:26:49.131514+0000","last_undegraded":"2023-11-08T19:26:49.131514+0000","last_fullsized":"2023-11-08T19:26:49.131514+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:26:01.141206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091649099999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.288904+0000","last_change":"2023-11-08T19:26:49.141444+0000","last_active":"2023-11-08T19:26:50.288904+0000","last_peered":"2023-11-08T19:26:50.288904+0000","last_clean":"2023-11-08T19:26:50.288904+0000","last_became_active":"2023-11-08T19:26:49.141179+0000","last_became_peered":"2023-11-08T19:26:49.141179+0000","last_unstale":"2023-11-08T19:26:50.288904+0000","last_undegraded":"2023-11-08T19:26:50.288904+0000","last_fullsized":"2023-11-08T19:26:50.288904+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:10:24.255286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"95'1","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.448159+0000","last_change":"2023-11-08T19:26:48.609017+0000","last_active":"2023-11-08T19:26:50.448159+0000","last_peered":"2023-11-08T19:26:50.448159+0000","last_clean":"2023-11-08T19:26:50.448159+0000","last_became_active":"2023-11-08T19:26:48.608780+0000","last_became_peered":"2023-11-08T19:26:48.608780+0000","last_unstale":"2023-11-08T19:26:50.448159+0000","last_undegraded":"2023-11-08T19:26:50.448159+0000","last_fullsized":"2023-11-08T19:26:50.448159+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_clean_scrub_stamp":"2023-11-08T19:26:47.569818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:16:26.682818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.130982+0000","last_change":"2023-11-08T19:25:47.283642+0000","last_active":"2023-11-08T19:26:49.130982+0000","last_peered":"2023-11-08T19:26:49.130982+0000","last_clean":"2023-11-08T19:26:49.130982+0000","last_became_active":"2023-11-08T19:25:47.283360+0000","last_became_peered":"2023-11-08T19:25:47.283360+0000","last_unstale":"2023-11-08T19:26:49.130982+0000","last_undegraded":"2023-11-08T19:26:49.130982+0000","last_fullsized":"2023-11-08T19:26:49.130982+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:02:27.950152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":70,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.131619+0000","last_change":"2023-11-08T19:24:32.140167+0000","last_active":"2023-11-08T19:26:49.131619+0000","last_peered":"2023-11-08T19:26:49.131619+0000","last_clean":"2023-11-08T19:26:49.131619+0000","last_became_active":"2023-11-08T19:24:31.147181+0000","last_became_peered":"2023-11-08T19:24:31.147181+0000","last_unstale":"2023-11-08T19:26:49.131619+0000","last_undegraded":"2023-11-08T19:26:49.131619+0000","last_fullsized":"2023-11-08T19:26:49.131619+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:26.080042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057135200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.134912+0000","last_change":"2023-11-08T19:25:48.277705+0000","last_active":"2023-11-08T19:26:49.134912+0000","last_peered":"2023-11-08T19:26:49.134912+0000","last_clean":"2023-11-08T19:26:49.134912+0000","last_became_active":"2023-11-08T19:25:46.288848+0000","last_became_peered":"2023-11-08T19:25:46.288848+0000","last_unstale":"2023-11-08T19:26:49.134912+0000","last_undegraded":"2023-11-08T19:26:49.134912+0000","last_fullsized":"2023-11-08T19:26:49.134912+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:12:24.483185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097653099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.130632+0000","last_change":"2023-11-08T19:26:49.146440+0000","last_active":"2023-11-08T19:26:50.130632+0000","last_peered":"2023-11-08T19:26:50.130632+0000","last_clean":"2023-11-08T19:26:50.130632+0000","last_became_active":"2023-11-08T19:26:49.145628+0000","last_became_peered":"2023-11-08T19:26:49.145628+0000","last_unstale":"2023-11-08T19:26:50.130632+0000","last_undegraded":"2023-11-08T19:26:50.130632+0000","last_fullsized":"2023-11-08T19:26:50.130632+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:51:25.212618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"95'1","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.448426+0000","last_change":"2023-11-08T19:26:48.610661+0000","last_active":"2023-11-08T19:26:50.448426+0000","last_peered":"2023-11-08T19:26:50.448426+0000","last_clean":"2023-11-08T19:26:50.448426+0000","last_became_active":"2023-11-08T19:26:48.610400+0000","last_became_peered":"2023-11-08T19:26:48.610400+0000","last_unstale":"2023-11-08T19:26:50.448426+0000","last_undegraded":"2023-11-08T19:26:50.448426+0000","last_fullsized":"2023-11-08T19:26:50.448426+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_clean_scrub_stamp":"2023-11-08T19:26:47.569818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:38:08.472024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":28,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-08T19:26:48.597820+0000","last_change":"2023-11-08T19:25:47.289456+0000","last_active":"2023-11-08T19:26:48.597820+0000","last_peered":"2023-11-08T19:26:48.597820+0000","last_clean":"2023-11-08T19:26:48.597820+0000","last_became_active":"2023-11-08T19:25:47.289177+0000","last_became_peered":"2023-11-08T19:25:47.289177+0000","last_unstale":"2023-11-08T19:26:48.597820+0000","last_undegraded":"2023-11-08T19:26:48.597820+0000","last_fullsized":"2023-11-08T19:26:48.597820+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:07:11.838364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":70,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.132930+0000","last_change":"2023-11-08T19:24:32.141188+0000","last_active":"2023-11-08T19:26:49.132930+0000","last_peered":"2023-11-08T19:26:49.132930+0000","last_clean":"2023-11-08T19:26:49.132930+0000","last_became_active":"2023-11-08T19:24:31.148857+0000","last_became_peered":"2023-11-08T19:24:31.148857+0000","last_unstale":"2023-11-08T19:26:49.132930+0000","last_undegraded":"2023-11-08T19:26:49.132930+0000","last_fullsized":"2023-11-08T19:26:49.132930+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:45:34.425432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065078599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.135359+0000","last_change":"2023-11-08T19:25:48.277423+0000","last_active":"2023-11-08T19:26:49.135359+0000","last_peered":"2023-11-08T19:26:49.135359+0000","last_clean":"2023-11-08T19:26:49.135359+0000","last_became_active":"2023-11-08T19:25:46.286211+0000","last_became_peered":"2023-11-08T19:25:46.286211+0000","last_unstale":"2023-11-08T19:26:49.135359+0000","last_undegraded":"2023-11-08T19:26:49.135359+0000","last_fullsized":"2023-11-08T19:26:49.135359+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:44:05.347800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073775700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.289192+0000","last_change":"2023-11-08T19:26:49.146600+0000","last_active":"2023-11-08T19:26:50.289192+0000","last_peered":"2023-11-08T19:26:50.289192+0000","last_clean":"2023-11-08T19:26:50.289192+0000","last_became_active":"2023-11-08T19:26:49.146400+0000","last_became_peered":"2023-11-08T19:26:49.146400+0000","last_unstale":"2023-11-08T19:26:50.289192+0000","last_undegraded":"2023-11-08T19:26:50.289192+0000","last_fullsized":"2023-11-08T19:26:50.289192+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:55:43.751284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.289416+0000","last_change":"2023-11-08T19:26:48.601104+0000","last_active":"2023-11-08T19:26:50.289416+0000","last_peered":"2023-11-08T19:26:50.289416+0000","last_clean":"2023-11-08T19:26:50.289416+0000","last_became_active":"2023-11-08T19:26:48.600826+0000","last_became_peered":"2023-11-08T19:26:48.600826+0000","last_unstale":"2023-11-08T19:26:50.289416+0000","last_undegraded":"2023-11-08T19:26:50.289416+0000","last_fullsized":"2023-11-08T19:26:50.289416+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_clean_scrub_stamp":"2023-11-08T19:26:47.569818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:15:49.938251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":28,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-08T19:26:48.597876+0000","last_change":"2023-11-08T19:25:47.286020+0000","last_active":"2023-11-08T19:26:48.597876+0000","last_peered":"2023-11-08T19:26:48.597876+0000","last_clean":"2023-11-08T19:26:48.597876+0000","last_became_active":"2023-11-08T19:25:47.285728+0000","last_became_peered":"2023-11-08T19:25:47.285728+0000","last_unstale":"2023-11-08T19:26:48.597876+0000","last_undegraded":"2023-11-08T19:26:48.597876+0000","last_fullsized":"2023-11-08T19:26:48.597876+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:26:02.147090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":70,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.132034+0000","last_change":"2023-11-08T19:24:32.140832+0000","last_active":"2023-11-08T19:26:50.132034+0000","last_peered":"2023-11-08T19:26:50.132034+0000","last_clean":"2023-11-08T19:26:50.132034+0000","last_became_active":"2023-11-08T19:24:31.146557+0000","last_became_peered":"2023-11-08T19:24:31.146557+0000","last_unstale":"2023-11-08T19:26:50.132034+0000","last_undegraded":"2023-11-08T19:26:50.132034+0000","last_fullsized":"2023-11-08T19:26:50.132034+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:40:04.258107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099450100000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.134787+0000","last_change":"2023-11-08T19:25:48.372913+0000","last_active":"2023-11-08T19:26:49.134787+0000","last_peered":"2023-11-08T19:26:49.134787+0000","last_clean":"2023-11-08T19:26:49.134787+0000","last_became_active":"2023-11-08T19:25:46.281273+0000","last_became_peered":"2023-11-08T19:25:46.281273+0000","last_unstale":"2023-11-08T19:26:49.134787+0000","last_undegraded":"2023-11-08T19:26:49.134787+0000","last_fullsized":"2023-11-08T19:26:49.134787+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:07:10.832480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020904819999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.132085+0000","last_change":"2023-11-08T19:26:49.144781+0000","last_active":"2023-11-08T19:26:50.132085+0000","last_peered":"2023-11-08T19:26:50.132085+0000","last_clean":"2023-11-08T19:26:50.132085+0000","last_became_active":"2023-11-08T19:26:49.144490+0000","last_became_peered":"2023-11-08T19:26:49.144490+0000","last_unstale":"2023-11-08T19:26:50.132085+0000","last_undegraded":"2023-11-08T19:26:50.132085+0000","last_fullsized":"2023-11-08T19:26:50.132085+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:50:23.420859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.448726+0000","last_change":"2023-11-08T19:26:48.615880+0000","last_active":"2023-11-08T19:26:50.448726+0000","last_peered":"2023-11-08T19:26:50.448726+0000","last_clean":"2023-11-08T19:26:50.448726+0000","last_became_active":"2023-11-08T19:26:48.615681+0000","last_became_peered":"2023-11-08T19:26:48.615681+0000","last_unstale":"2023-11-08T19:26:50.448726+0000","last_undegraded":"2023-11-08T19:26:50.448726+0000","last_fullsized":"2023-11-08T19:26:50.448726+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_clean_scrub_stamp":"2023-11-08T19:26:47.569818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:22:48.262249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":30,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.136130+0000","last_change":"2023-11-08T19:25:47.288256+0000","last_active":"2023-11-08T19:26:49.136130+0000","last_peered":"2023-11-08T19:26:49.136130+0000","last_clean":"2023-11-08T19:26:49.136130+0000","last_became_active":"2023-11-08T19:25:47.287905+0000","last_became_peered":"2023-11-08T19:25:47.287905+0000","last_unstale":"2023-11-08T19:26:49.136130+0000","last_undegraded":"2023-11-08T19:26:49.136130+0000","last_fullsized":"2023-11-08T19:26:49.136130+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:50:12.309248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":61,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.289113+0000","last_change":"2023-11-08T19:24:32.530378+0000","last_active":"2023-11-08T19:26:50.289113+0000","last_peered":"2023-11-08T19:26:50.289113+0000","last_clean":"2023-11-08T19:26:50.289113+0000","last_became_active":"2023-11-08T19:24:31.144341+0000","last_became_peered":"2023-11-08T19:24:31.144341+0000","last_unstale":"2023-11-08T19:26:50.289113+0000","last_undegraded":"2023-11-08T19:26:50.289113+0000","last_fullsized":"2023-11-08T19:26:50.289113+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:30:21.946303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058308299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.130911+0000","last_change":"2023-11-08T19:25:48.277150+0000","last_active":"2023-11-08T19:26:49.130911+0000","last_peered":"2023-11-08T19:26:49.130911+0000","last_clean":"2023-11-08T19:26:49.130911+0000","last_became_active":"2023-11-08T19:25:46.286933+0000","last_became_peered":"2023-11-08T19:25:46.286933+0000","last_unstale":"2023-11-08T19:26:49.130911+0000","last_undegraded":"2023-11-08T19:26:49.130911+0000","last_fullsized":"2023-11-08T19:26:49.130911+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:38:38.890354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080507500000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.131858+0000","last_change":"2023-11-08T19:26:49.144657+0000","last_active":"2023-11-08T19:26:50.131858+0000","last_peered":"2023-11-08T19:26:50.131858+0000","last_clean":"2023-11-08T19:26:50.131858+0000","last_became_active":"2023-11-08T19:26:49.144370+0000","last_became_peered":"2023-11-08T19:26:49.144370+0000","last_unstale":"2023-11-08T19:26:50.131858+0000","last_undegraded":"2023-11-08T19:26:50.131858+0000","last_fullsized":"2023-11-08T19:26:50.131858+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:17:55.740401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"95'2","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.449149+0000","last_change":"2023-11-08T19:26:48.608150+0000","last_active":"2023-11-08T19:26:50.449149+0000","last_peered":"2023-11-08T19:26:50.449149+0000","last_clean":"2023-11-08T19:26:50.449149+0000","last_became_active":"2023-11-08T19:26:48.607838+0000","last_became_peered":"2023-11-08T19:26:48.607838+0000","last_unstale":"2023-11-08T19:26:50.449149+0000","last_undegraded":"2023-11-08T19:26:50.449149+0000","last_fullsized":"2023-11-08T19:26:50.449149+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_clean_scrub_stamp":"2023-11-08T19:26:47.569818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:38:52.153674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.134195+0000","last_change":"2023-11-08T19:25:47.282986+0000","last_active":"2023-11-08T19:26:49.134195+0000","last_peered":"2023-11-08T19:26:49.134195+0000","last_clean":"2023-11-08T19:26:49.134195+0000","last_became_active":"2023-11-08T19:25:47.282705+0000","last_became_peered":"2023-11-08T19:25:47.282705+0000","last_unstale":"2023-11-08T19:26:49.134195+0000","last_undegraded":"2023-11-08T19:26:49.134195+0000","last_fullsized":"2023-11-08T19:26:49.134195+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:34:17.838942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":61,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.447799+0000","last_change":"2023-11-08T19:24:32.544108+0000","last_active":"2023-11-08T19:26:50.447799+0000","last_peered":"2023-11-08T19:26:50.447799+0000","last_clean":"2023-11-08T19:26:50.447799+0000","last_became_active":"2023-11-08T19:24:31.143812+0000","last_became_peered":"2023-11-08T19:24:31.143812+0000","last_unstale":"2023-11-08T19:26:50.447799+0000","last_undegraded":"2023-11-08T19:26:50.447799+0000","last_fullsized":"2023-11-08T19:26:50.447799+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:27:59.135977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014956126,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.131514+0000","last_change":"2023-11-08T19:25:48.284435+0000","last_active":"2023-11-08T19:26:49.131514+0000","last_peered":"2023-11-08T19:26:49.131514+0000","last_clean":"2023-11-08T19:26:49.131514+0000","last_became_active":"2023-11-08T19:25:46.284288+0000","last_became_peered":"2023-11-08T19:25:46.284288+0000","last_unstale":"2023-11-08T19:26:49.131514+0000","last_undegraded":"2023-11-08T19:26:49.131514+0000","last_fullsized":"2023-11-08T19:26:49.131514+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:57:53.083448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001250894,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.289705+0000","last_change":"2023-11-08T19:26:49.148728+0000","last_active":"2023-11-08T19:26:50.289705+0000","last_peered":"2023-11-08T19:26:50.289705+0000","last_clean":"2023-11-08T19:26:50.289705+0000","last_became_active":"2023-11-08T19:26:49.148473+0000","last_became_peered":"2023-11-08T19:26:49.148473+0000","last_unstale":"2023-11-08T19:26:50.289705+0000","last_undegraded":"2023-11-08T19:26:50.289705+0000","last_fullsized":"2023-11-08T19:26:50.289705+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:13:12.906471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.131964+0000","last_change":"2023-11-08T19:26:48.601794+0000","last_active":"2023-11-08T19:26:50.131964+0000","last_peered":"2023-11-08T19:26:50.131964+0000","last_clean":"2023-11-08T19:26:50.131964+0000","last_became_active":"2023-11-08T19:26:48.601483+0000","last_became_peered":"2023-11-08T19:26:48.601483+0000","last_unstale":"2023-11-08T19:26:50.131964+0000","last_undegraded":"2023-11-08T19:26:50.131964+0000","last_fullsized":"2023-11-08T19:26:50.131964+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_clean_scrub_stamp":"2023-11-08T19:26:47.569818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:33:13.122725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.131429+0000","last_change":"2023-11-08T19:25:47.282612+0000","last_active":"2023-11-08T19:26:49.131429+0000","last_peered":"2023-11-08T19:26:49.131429+0000","last_clean":"2023-11-08T19:26:49.131429+0000","last_became_active":"2023-11-08T19:25:47.282299+0000","last_became_peered":"2023-11-08T19:25:47.282299+0000","last_unstale":"2023-11-08T19:26:49.131429+0000","last_undegraded":"2023-11-08T19:26:49.131429+0000","last_fullsized":"2023-11-08T19:26:49.131429+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:43:18.319773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":59,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.134182+0000","last_change":"2023-11-08T19:24:32.146639+0000","last_active":"2023-11-08T19:26:49.134182+0000","last_peered":"2023-11-08T19:26:49.134182+0000","last_clean":"2023-11-08T19:26:49.134182+0000","last_became_active":"2023-11-08T19:24:31.147384+0000","last_became_peered":"2023-11-08T19:24:31.147384+0000","last_unstale":"2023-11-08T19:26:49.134182+0000","last_undegraded":"2023-11-08T19:26:49.134182+0000","last_fullsized":"2023-11-08T19:26:49.134182+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:30:21.946303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043834899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.131970+0000","last_change":"2023-11-08T19:25:48.283541+0000","last_active":"2023-11-08T19:26:49.131970+0000","last_peered":"2023-11-08T19:26:49.131970+0000","last_clean":"2023-11-08T19:26:49.131970+0000","last_became_active":"2023-11-08T19:25:46.285626+0000","last_became_peered":"2023-11-08T19:25:46.285626+0000","last_unstale":"2023-11-08T19:26:49.131970+0000","last_undegraded":"2023-11-08T19:26:49.131970+0000","last_fullsized":"2023-11-08T19:26:49.131970+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:48:17.033319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019032459999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.152978+0000","last_change":"2023-11-08T19:26:49.146461+0000","last_active":"2023-11-08T19:26:49.152978+0000","last_peered":"2023-11-08T19:26:49.152978+0000","last_clean":"2023-11-08T19:26:49.152978+0000","last_became_active":"2023-11-08T19:26:49.141785+0000","last_became_peered":"2023-11-08T19:26:49.141785+0000","last_unstale":"2023-11-08T19:26:49.152978+0000","last_undegraded":"2023-11-08T19:26:49.152978+0000","last_fullsized":"2023-11-08T19:26:49.152978+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:54:36.305399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.128983+0000","last_change":"2023-11-08T19:26:48.615391+0000","last_active":"2023-11-08T19:26:50.128983+0000","last_peered":"2023-11-08T19:26:50.128983+0000","last_clean":"2023-11-08T19:26:50.128983+0000","last_became_active":"2023-11-08T19:26:48.615117+0000","last_became_peered":"2023-11-08T19:26:48.615117+0000","last_unstale":"2023-11-08T19:26:50.128983+0000","last_undegraded":"2023-11-08T19:26:50.128983+0000","last_fullsized":"2023-11-08T19:26:50.128983+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_clean_scrub_stamp":"2023-11-08T19:26:47.569818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:50:38.526254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.131227+0000","last_change":"2023-11-08T19:25:47.287878+0000","last_active":"2023-11-08T19:26:49.131227+0000","last_peered":"2023-11-08T19:26:49.131227+0000","last_clean":"2023-11-08T19:26:49.131227+0000","last_became_active":"2023-11-08T19:25:47.287617+0000","last_became_peered":"2023-11-08T19:25:47.287617+0000","last_unstale":"2023-11-08T19:26:49.131227+0000","last_undegraded":"2023-11-08T19:26:49.131227+0000","last_fullsized":"2023-11-08T19:26:49.131227+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:20:50.791463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":70,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.131298+0000","last_change":"2023-11-08T19:24:32.142376+0000","last_active":"2023-11-08T19:26:49.131298+0000","last_peered":"2023-11-08T19:26:49.131298+0000","last_clean":"2023-11-08T19:26:49.131298+0000","last_became_active":"2023-11-08T19:24:31.144614+0000","last_became_peered":"2023-11-08T19:24:31.144614+0000","last_unstale":"2023-11-08T19:26:49.131298+0000","last_undegraded":"2023-11-08T19:26:49.131298+0000","last_fullsized":"2023-11-08T19:26:49.131298+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:09:04.880374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050362200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.130311+0000","last_change":"2023-11-08T19:25:48.373636+0000","last_active":"2023-11-08T19:26:49.130311+0000","last_peered":"2023-11-08T19:26:49.130311+0000","last_clean":"2023-11-08T19:26:49.130311+0000","last_became_active":"2023-11-08T19:25:46.283803+0000","last_became_peered":"2023-11-08T19:25:46.283803+0000","last_unstale":"2023-11-08T19:26:49.130311+0000","last_undegraded":"2023-11-08T19:26:49.130311+0000","last_fullsized":"2023-11-08T19:26:49.130311+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:00:34.691748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002404855,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.288724+0000","last_change":"2023-11-08T19:26:49.146632+0000","last_active":"2023-11-08T19:26:50.288724+0000","last_peered":"2023-11-08T19:26:50.288724+0000","last_clean":"2023-11-08T19:26:50.288724+0000","last_became_active":"2023-11-08T19:26:49.146374+0000","last_became_peered":"2023-11-08T19:26:49.146374+0000","last_unstale":"2023-11-08T19:26:50.288724+0000","last_undegraded":"2023-11-08T19:26:50.288724+0000","last_fullsized":"2023-11-08T19:26:50.288724+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:04:21.182881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.288743+0000","last_change":"2023-11-08T19:26:48.605537+0000","last_active":"2023-11-08T19:26:50.288743+0000","last_peered":"2023-11-08T19:26:50.288743+0000","last_clean":"2023-11-08T19:26:50.288743+0000","last_became_active":"2023-11-08T19:26:48.601422+0000","last_became_peered":"2023-11-08T19:26:48.601422+0000","last_unstale":"2023-11-08T19:26:50.288743+0000","last_undegraded":"2023-11-08T19:26:50.288743+0000","last_fullsized":"2023-11-08T19:26:50.288743+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_clean_scrub_stamp":"2023-11-08T19:26:47.569818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:21:13.057813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":28,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-08T19:26:48.598249+0000","last_change":"2023-11-08T19:25:47.287741+0000","last_active":"2023-11-08T19:26:48.598249+0000","last_peered":"2023-11-08T19:26:48.598249+0000","last_clean":"2023-11-08T19:26:48.598249+0000","last_became_active":"2023-11-08T19:25:47.287428+0000","last_became_peered":"2023-11-08T19:25:47.287428+0000","last_unstale":"2023-11-08T19:26:48.598249+0000","last_undegraded":"2023-11-08T19:26:48.598249+0000","last_fullsized":"2023-11-08T19:26:48.598249+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:38:55.785104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":58,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-08T19:26:48.597965+0000","last_change":"2023-11-08T19:24:32.147235+0000","last_active":"2023-11-08T19:26:48.597965+0000","last_peered":"2023-11-08T19:26:48.597965+0000","last_clean":"2023-11-08T19:26:48.597965+0000","last_became_active":"2023-11-08T19:24:31.146176+0000","last_became_peered":"2023-11-08T19:24:31.146176+0000","last_unstale":"2023-11-08T19:26:48.597965+0000","last_undegraded":"2023-11-08T19:26:48.597965+0000","last_fullsized":"2023-11-08T19:26:48.597965+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:39.214888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048481000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.131579+0000","last_change":"2023-11-08T19:25:48.373345+0000","last_active":"2023-11-08T19:26:49.131579+0000","last_peered":"2023-11-08T19:26:49.131579+0000","last_clean":"2023-11-08T19:26:49.131579+0000","last_became_active":"2023-11-08T19:25:46.282460+0000","last_became_peered":"2023-11-08T19:25:46.282460+0000","last_unstale":"2023-11-08T19:26:49.131579+0000","last_undegraded":"2023-11-08T19:26:49.131579+0000","last_fullsized":"2023-11-08T19:26:49.131579+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:25:30.927920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001972863,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.130297+0000","last_change":"2023-11-08T19:26:49.144522+0000","last_active":"2023-11-08T19:26:50.130297+0000","last_peered":"2023-11-08T19:26:50.130297+0000","last_clean":"2023-11-08T19:26:50.130297+0000","last_became_active":"2023-11-08T19:26:49.144202+0000","last_became_peered":"2023-11-08T19:26:49.144202+0000","last_unstale":"2023-11-08T19:26:50.130297+0000","last_undegraded":"2023-11-08T19:26:50.130297+0000","last_fullsized":"2023-11-08T19:26:50.130297+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:58:35.156133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.447935+0000","last_change":"2023-11-08T19:26:48.600457+0000","last_active":"2023-11-08T19:26:50.447935+0000","last_peered":"2023-11-08T19:26:50.447935+0000","last_clean":"2023-11-08T19:26:50.447935+0000","last_became_active":"2023-11-08T19:26:48.600174+0000","last_became_peered":"2023-11-08T19:26:48.600174+0000","last_unstale":"2023-11-08T19:26:50.447935+0000","last_undegraded":"2023-11-08T19:26:50.447935+0000","last_fullsized":"2023-11-08T19:26:50.447935+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_clean_scrub_stamp":"2023-11-08T19:26:47.569818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:54:43.089103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.131168+0000","last_change":"2023-11-08T19:25:47.283708+0000","last_active":"2023-11-08T19:26:49.131168+0000","last_peered":"2023-11-08T19:26:49.131168+0000","last_clean":"2023-11-08T19:26:49.131168+0000","last_became_active":"2023-11-08T19:25:47.283433+0000","last_became_peered":"2023-11-08T19:25:47.283433+0000","last_unstale":"2023-11-08T19:26:49.131168+0000","last_undegraded":"2023-11-08T19:26:49.131168+0000","last_fullsized":"2023-11-08T19:26:49.131168+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:30:17.627967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":61,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.448942+0000","last_change":"2023-11-08T19:24:32.543880+0000","last_active":"2023-11-08T19:26:50.448942+0000","last_peered":"2023-11-08T19:26:50.448942+0000","last_clean":"2023-11-08T19:26:50.448942+0000","last_became_active":"2023-11-08T19:24:31.142052+0000","last_became_peered":"2023-11-08T19:24:31.142052+0000","last_unstale":"2023-11-08T19:26:50.448942+0000","last_undegraded":"2023-11-08T19:26:50.448942+0000","last_fullsized":"2023-11-08T19:26:50.448942+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:18:42.371676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014881058000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.136456+0000","last_change":"2023-11-08T19:25:48.284890+0000","last_active":"2023-11-08T19:26:49.136456+0000","last_peered":"2023-11-08T19:26:49.136456+0000","last_clean":"2023-11-08T19:26:49.136456+0000","last_became_active":"2023-11-08T19:25:46.279287+0000","last_became_peered":"2023-11-08T19:25:46.279287+0000","last_unstale":"2023-11-08T19:26:49.136456+0000","last_undegraded":"2023-11-08T19:26:49.136456+0000","last_fullsized":"2023-11-08T19:26:49.136456+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:35:30.427172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076856899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.130697+0000","last_change":"2023-11-08T19:26:49.136124+0000","last_active":"2023-11-08T19:26:50.130697+0000","last_peered":"2023-11-08T19:26:50.130697+0000","last_clean":"2023-11-08T19:26:50.130697+0000","last_became_active":"2023-11-08T19:26:49.135834+0000","last_became_peered":"2023-11-08T19:26:49.135834+0000","last_unstale":"2023-11-08T19:26:50.130697+0000","last_undegraded":"2023-11-08T19:26:50.130697+0000","last_fullsized":"2023-11-08T19:26:50.130697+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:15:11.670708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.130369+0000","last_change":"2023-11-08T19:26:48.606019+0000","last_active":"2023-11-08T19:26:50.130369+0000","last_peered":"2023-11-08T19:26:50.130369+0000","last_clean":"2023-11-08T19:26:50.130369+0000","last_became_active":"2023-11-08T19:26:48.605731+0000","last_became_peered":"2023-11-08T19:26:48.605731+0000","last_unstale":"2023-11-08T19:26:50.130369+0000","last_undegraded":"2023-11-08T19:26:50.130369+0000","last_fullsized":"2023-11-08T19:26:50.130369+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_clean_scrub_stamp":"2023-11-08T19:26:47.569818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:00:48.625310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.136284+0000","last_change":"2023-11-08T19:25:47.285867+0000","last_active":"2023-11-08T19:26:49.136284+0000","last_peered":"2023-11-08T19:26:49.136284+0000","last_clean":"2023-11-08T19:26:49.136284+0000","last_became_active":"2023-11-08T19:25:47.285533+0000","last_became_peered":"2023-11-08T19:25:47.285533+0000","last_unstale":"2023-11-08T19:26:49.136284+0000","last_undegraded":"2023-11-08T19:26:49.136284+0000","last_fullsized":"2023-11-08T19:26:49.136284+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:26:59.852338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":58,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-08T19:26:48.598985+0000","last_change":"2023-11-08T19:24:32.147011+0000","last_active":"2023-11-08T19:26:48.598985+0000","last_peered":"2023-11-08T19:26:48.598985+0000","last_clean":"2023-11-08T19:26:48.598985+0000","last_became_active":"2023-11-08T19:24:31.148250+0000","last_became_peered":"2023-11-08T19:24:31.148250+0000","last_unstale":"2023-11-08T19:26:48.598985+0000","last_undegraded":"2023-11-08T19:26:48.598985+0000","last_fullsized":"2023-11-08T19:26:48.598985+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:01:25.647952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043061299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.131256+0000","last_change":"2023-11-08T19:25:48.284869+0000","last_active":"2023-11-08T19:26:49.131256+0000","last_peered":"2023-11-08T19:26:49.131256+0000","last_clean":"2023-11-08T19:26:49.131256+0000","last_became_active":"2023-11-08T19:25:46.285478+0000","last_became_peered":"2023-11-08T19:25:46.285478+0000","last_unstale":"2023-11-08T19:26:49.131256+0000","last_undegraded":"2023-11-08T19:26:49.131256+0000","last_fullsized":"2023-11-08T19:26:49.131256+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:49:51.368808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000376339,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.161081+0000","last_change":"2023-11-08T19:26:49.154173+0000","last_active":"2023-11-08T19:26:49.161081+0000","last_peered":"2023-11-08T19:26:49.161081+0000","last_clean":"2023-11-08T19:26:49.161081+0000","last_became_active":"2023-11-08T19:26:49.153876+0000","last_became_peered":"2023-11-08T19:26:49.153876+0000","last_unstale":"2023-11-08T19:26:49.161081+0000","last_undegraded":"2023-11-08T19:26:49.161081+0000","last_fullsized":"2023-11-08T19:26:49.161081+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:14:02.380051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"95'1","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.132195+0000","last_change":"2023-11-08T19:26:48.606778+0000","last_active":"2023-11-08T19:26:50.132195+0000","last_peered":"2023-11-08T19:26:50.132195+0000","last_clean":"2023-11-08T19:26:50.132195+0000","last_became_active":"2023-11-08T19:26:48.606437+0000","last_became_peered":"2023-11-08T19:26:48.606437+0000","last_unstale":"2023-11-08T19:26:50.132195+0000","last_undegraded":"2023-11-08T19:26:50.132195+0000","last_fullsized":"2023-11-08T19:26:50.132195+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_clean_scrub_stamp":"2023-11-08T19:26:47.569818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:49:59.213557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.130833+0000","last_change":"2023-11-08T19:25:47.284429+0000","last_active":"2023-11-08T19:26:49.130833+0000","last_peered":"2023-11-08T19:26:49.130833+0000","last_clean":"2023-11-08T19:26:49.130833+0000","last_became_active":"2023-11-08T19:25:47.283990+0000","last_became_peered":"2023-11-08T19:25:47.283990+0000","last_unstale":"2023-11-08T19:26:49.130833+0000","last_undegraded":"2023-11-08T19:26:49.130833+0000","last_fullsized":"2023-11-08T19:26:49.130833+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:59:08.628317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":70,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.132184+0000","last_change":"2023-11-08T19:24:32.141190+0000","last_active":"2023-11-08T19:26:49.132184+0000","last_peered":"2023-11-08T19:26:49.132184+0000","last_clean":"2023-11-08T19:26:49.132184+0000","last_became_active":"2023-11-08T19:24:31.147651+0000","last_became_peered":"2023-11-08T19:24:31.147651+0000","last_unstale":"2023-11-08T19:26:49.132184+0000","last_undegraded":"2023-11-08T19:26:49.132184+0000","last_fullsized":"2023-11-08T19:26:49.132184+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:21:55.985548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043673300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.135510+0000","last_change":"2023-11-08T19:25:48.320707+0000","last_active":"2023-11-08T19:26:49.135510+0000","last_peered":"2023-11-08T19:26:49.135510+0000","last_clean":"2023-11-08T19:26:49.135510+0000","last_became_active":"2023-11-08T19:25:46.282307+0000","last_became_peered":"2023-11-08T19:25:46.282307+0000","last_unstale":"2023-11-08T19:26:49.135510+0000","last_undegraded":"2023-11-08T19:26:49.135510+0000","last_fullsized":"2023-11-08T19:26:49.135510+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:53:36.476361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047078400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.161037+0000","last_change":"2023-11-08T19:26:49.153625+0000","last_active":"2023-11-08T19:26:49.161037+0000","last_peered":"2023-11-08T19:26:49.161037+0000","last_clean":"2023-11-08T19:26:49.161037+0000","last_became_active":"2023-11-08T19:26:49.153361+0000","last_became_peered":"2023-11-08T19:26:49.153361+0000","last_unstale":"2023-11-08T19:26:49.161037+0000","last_undegraded":"2023-11-08T19:26:49.161037+0000","last_fullsized":"2023-11-08T19:26:49.161037+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:08:52.578249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.448157+0000","last_change":"2023-11-08T19:26:48.609568+0000","last_active":"2023-11-08T19:26:50.448157+0000","last_peered":"2023-11-08T19:26:50.448157+0000","last_clean":"2023-11-08T19:26:50.448157+0000","last_became_active":"2023-11-08T19:26:48.609373+0000","last_became_peered":"2023-11-08T19:26:48.609373+0000","last_unstale":"2023-11-08T19:26:50.448157+0000","last_undegraded":"2023-11-08T19:26:50.448157+0000","last_fullsized":"2023-11-08T19:26:50.448157+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_clean_scrub_stamp":"2023-11-08T19:26:47.569818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:03:01.745215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.131640+0000","last_change":"2023-11-08T19:25:47.284227+0000","last_active":"2023-11-08T19:26:49.131640+0000","last_peered":"2023-11-08T19:26:49.131640+0000","last_clean":"2023-11-08T19:26:49.131640+0000","last_became_active":"2023-11-08T19:25:47.283927+0000","last_became_peered":"2023-11-08T19:25:47.283927+0000","last_unstale":"2023-11-08T19:26:49.131640+0000","last_undegraded":"2023-11-08T19:26:49.131640+0000","last_fullsized":"2023-11-08T19:26:49.131640+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:15:23.188047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":60,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.134923+0000","last_change":"2023-11-08T19:24:32.530168+0000","last_active":"2023-11-08T19:26:49.134923+0000","last_peered":"2023-11-08T19:26:49.134923+0000","last_clean":"2023-11-08T19:26:49.134923+0000","last_became_active":"2023-11-08T19:24:31.144329+0000","last_became_peered":"2023-11-08T19:24:31.144329+0000","last_unstale":"2023-11-08T19:26:49.134923+0000","last_undegraded":"2023-11-08T19:26:49.134923+0000","last_fullsized":"2023-11-08T19:26:49.134923+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:05:36.085920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043484799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.135656+0000","last_change":"2023-11-08T19:25:48.371291+0000","last_active":"2023-11-08T19:26:49.135656+0000","last_peered":"2023-11-08T19:26:49.135656+0000","last_clean":"2023-11-08T19:26:49.135656+0000","last_became_active":"2023-11-08T19:25:46.281425+0000","last_became_peered":"2023-11-08T19:25:46.281425+0000","last_unstale":"2023-11-08T19:26:49.135656+0000","last_undegraded":"2023-11-08T19:26:49.135656+0000","last_fullsized":"2023-11-08T19:26:49.135656+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:23:12.422712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00124314,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.130192+0000","last_change":"2023-11-08T19:26:49.138708+0000","last_active":"2023-11-08T19:26:50.130192+0000","last_peered":"2023-11-08T19:26:50.130192+0000","last_clean":"2023-11-08T19:26:50.130192+0000","last_became_active":"2023-11-08T19:26:49.138415+0000","last_became_peered":"2023-11-08T19:26:49.138415+0000","last_unstale":"2023-11-08T19:26:50.130192+0000","last_undegraded":"2023-11-08T19:26:50.130192+0000","last_fullsized":"2023-11-08T19:26:50.130192+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:30:27.677139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"95'1","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.289757+0000","last_change":"2023-11-08T19:26:48.604230+0000","last_active":"2023-11-08T19:26:50.289757+0000","last_peered":"2023-11-08T19:26:50.289757+0000","last_clean":"2023-11-08T19:26:50.289757+0000","last_became_active":"2023-11-08T19:26:48.603981+0000","last_became_peered":"2023-11-08T19:26:48.603981+0000","last_unstale":"2023-11-08T19:26:50.289757+0000","last_undegraded":"2023-11-08T19:26:50.289757+0000","last_fullsized":"2023-11-08T19:26:50.289757+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_clean_scrub_stamp":"2023-11-08T19:26:47.569818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:23:41.123045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":31,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.131005+0000","last_change":"2023-11-08T19:25:47.281724+0000","last_active":"2023-11-08T19:26:49.131005+0000","last_peered":"2023-11-08T19:26:49.131005+0000","last_clean":"2023-11-08T19:26:49.131005+0000","last_became_active":"2023-11-08T19:25:47.281425+0000","last_became_peered":"2023-11-08T19:25:47.281425+0000","last_unstale":"2023-11-08T19:26:49.131005+0000","last_undegraded":"2023-11-08T19:26:49.131005+0000","last_fullsized":"2023-11-08T19:26:49.131005+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:38:55.785104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":60,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.133405+0000","last_change":"2023-11-08T19:24:32.529486+0000","last_active":"2023-11-08T19:26:49.133405+0000","last_peered":"2023-11-08T19:26:49.133405+0000","last_clean":"2023-11-08T19:26:49.133405+0000","last_became_active":"2023-11-08T19:24:31.146260+0000","last_became_peered":"2023-11-08T19:24:31.146260+0000","last_unstale":"2023-11-08T19:26:49.133405+0000","last_undegraded":"2023-11-08T19:26:49.133405+0000","last_fullsized":"2023-11-08T19:26:49.133405+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:45:34.425432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059842900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.134926+0000","last_change":"2023-11-08T19:25:48.277457+0000","last_active":"2023-11-08T19:26:49.134926+0000","last_peered":"2023-11-08T19:26:49.134926+0000","last_clean":"2023-11-08T19:26:49.134926+0000","last_became_active":"2023-11-08T19:25:46.286239+0000","last_became_peered":"2023-11-08T19:25:46.286239+0000","last_unstale":"2023-11-08T19:26:49.134926+0000","last_undegraded":"2023-11-08T19:26:49.134926+0000","last_fullsized":"2023-11-08T19:26:49.134926+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:09:43.662108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000722421,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.448949+0000","last_change":"2023-11-08T19:26:49.145596+0000","last_active":"2023-11-08T19:26:50.448949+0000","last_peered":"2023-11-08T19:26:50.448949+0000","last_clean":"2023-11-08T19:26:50.448949+0000","last_became_active":"2023-11-08T19:26:49.145272+0000","last_became_peered":"2023-11-08T19:26:49.145272+0000","last_unstale":"2023-11-08T19:26:50.448949+0000","last_undegraded":"2023-11-08T19:26:50.448949+0000","last_fullsized":"2023-11-08T19:26:50.448949+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:16:27.690375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"95'2","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.130161+0000","last_change":"2023-11-08T19:26:48.609238+0000","last_active":"2023-11-08T19:26:50.130161+0000","last_peered":"2023-11-08T19:26:50.130161+0000","last_clean":"2023-11-08T19:26:50.130161+0000","last_became_active":"2023-11-08T19:26:48.609027+0000","last_became_peered":"2023-11-08T19:26:48.609027+0000","last_unstale":"2023-11-08T19:26:50.130161+0000","last_undegraded":"2023-11-08T19:26:50.130161+0000","last_fullsized":"2023-11-08T19:26:50.130161+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_clean_scrub_stamp":"2023-11-08T19:26:47.569818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:45:48.688005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":28,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-08T19:26:48.597466+0000","last_change":"2023-11-08T19:25:47.287874+0000","last_active":"2023-11-08T19:26:48.597466+0000","last_peered":"2023-11-08T19:26:48.597466+0000","last_clean":"2023-11-08T19:26:48.597466+0000","last_became_active":"2023-11-08T19:25:47.287456+0000","last_became_peered":"2023-11-08T19:25:47.287456+0000","last_unstale":"2023-11-08T19:26:48.597466+0000","last_undegraded":"2023-11-08T19:26:48.597466+0000","last_fullsized":"2023-11-08T19:26:48.597466+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:26:59.852338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":69,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.131361+0000","last_change":"2023-11-08T19:24:32.141131+0000","last_active":"2023-11-08T19:26:49.131361+0000","last_peered":"2023-11-08T19:26:49.131361+0000","last_clean":"2023-11-08T19:26:49.131361+0000","last_became_active":"2023-11-08T19:24:31.146154+0000","last_became_peered":"2023-11-08T19:24:31.146154+0000","last_unstale":"2023-11-08T19:26:49.131361+0000","last_undegraded":"2023-11-08T19:26:49.131361+0000","last_fullsized":"2023-11-08T19:26:49.131361+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:18:40.271560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082432800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.136923+0000","last_change":"2023-11-08T19:25:48.372729+0000","last_active":"2023-11-08T19:26:49.136923+0000","last_peered":"2023-11-08T19:26:49.136923+0000","last_clean":"2023-11-08T19:26:49.136923+0000","last_became_active":"2023-11-08T19:25:46.290114+0000","last_became_peered":"2023-11-08T19:25:46.290114+0000","last_unstale":"2023-11-08T19:26:49.136923+0000","last_undegraded":"2023-11-08T19:26:49.136923+0000","last_fullsized":"2023-11-08T19:26:49.136923+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:49:36.208776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061009499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.155708+0000","last_change":"2023-11-08T19:26:49.150927+0000","last_active":"2023-11-08T19:26:49.155708+0000","last_peered":"2023-11-08T19:26:49.155708+0000","last_clean":"2023-11-08T19:26:49.155708+0000","last_became_active":"2023-11-08T19:26:49.150531+0000","last_became_peered":"2023-11-08T19:26:49.150531+0000","last_unstale":"2023-11-08T19:26:49.155708+0000","last_undegraded":"2023-11-08T19:26:49.155708+0000","last_fullsized":"2023-11-08T19:26:49.155708+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:20:04.364566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.447601+0000","last_change":"2023-11-08T19:26:48.615392+0000","last_active":"2023-11-08T19:26:50.447601+0000","last_peered":"2023-11-08T19:26:50.447601+0000","last_clean":"2023-11-08T19:26:50.447601+0000","last_became_active":"2023-11-08T19:26:48.615101+0000","last_became_peered":"2023-11-08T19:26:48.615101+0000","last_unstale":"2023-11-08T19:26:50.447601+0000","last_undegraded":"2023-11-08T19:26:50.447601+0000","last_fullsized":"2023-11-08T19:26:50.447601+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_clean_scrub_stamp":"2023-11-08T19:26:47.569818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:04:48.064349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":31,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.131503+0000","last_change":"2023-11-08T19:25:47.283046+0000","last_active":"2023-11-08T19:26:49.131503+0000","last_peered":"2023-11-08T19:26:49.131503+0000","last_clean":"2023-11-08T19:26:49.131503+0000","last_became_active":"2023-11-08T19:25:47.282763+0000","last_became_peered":"2023-11-08T19:25:47.282763+0000","last_unstale":"2023-11-08T19:26:49.131503+0000","last_undegraded":"2023-11-08T19:26:49.131503+0000","last_fullsized":"2023-11-08T19:26:49.131503+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:12:51.389167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.135431+0000","last_change":"2023-11-08T19:24:32.263963+0000","last_active":"2023-11-08T19:26:49.135431+0000","last_peered":"2023-11-08T19:26:49.135431+0000","last_clean":"2023-11-08T19:26:49.135431+0000","last_became_active":"2023-11-08T19:24:31.139062+0000","last_became_peered":"2023-11-08T19:24:31.139062+0000","last_unstale":"2023-11-08T19:26:49.135431+0000","last_undegraded":"2023-11-08T19:26:49.135431+0000","last_fullsized":"2023-11-08T19:26:49.135431+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:26.080042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033682599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.132329+0000","last_change":"2023-11-08T19:25:48.283302+0000","last_active":"2023-11-08T19:26:49.132329+0000","last_peered":"2023-11-08T19:26:49.132329+0000","last_clean":"2023-11-08T19:26:49.132329+0000","last_became_active":"2023-11-08T19:25:46.284287+0000","last_became_peered":"2023-11-08T19:25:46.284287+0000","last_unstale":"2023-11-08T19:26:49.132329+0000","last_undegraded":"2023-11-08T19:26:49.132329+0000","last_fullsized":"2023-11-08T19:26:49.132329+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:39:27.217802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097880800000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.448110+0000","last_change":"2023-11-08T19:26:49.141709+0000","last_active":"2023-11-08T19:26:50.448110+0000","last_peered":"2023-11-08T19:26:50.448110+0000","last_clean":"2023-11-08T19:26:50.448110+0000","last_became_active":"2023-11-08T19:26:49.141457+0000","last_became_peered":"2023-11-08T19:26:49.141457+0000","last_unstale":"2023-11-08T19:26:50.448110+0000","last_undegraded":"2023-11-08T19:26:50.448110+0000","last_fullsized":"2023-11-08T19:26:50.448110+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:49:56.291414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.288689+0000","last_change":"2023-11-08T19:26:48.606259+0000","last_active":"2023-11-08T19:26:50.288689+0000","last_peered":"2023-11-08T19:26:50.288689+0000","last_clean":"2023-11-08T19:26:50.288689+0000","last_became_active":"2023-11-08T19:26:48.601066+0000","last_became_peered":"2023-11-08T19:26:48.601066+0000","last_unstale":"2023-11-08T19:26:50.288689+0000","last_undegraded":"2023-11-08T19:26:50.288689+0000","last_fullsized":"2023-11-08T19:26:50.288689+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_clean_scrub_stamp":"2023-11-08T19:26:47.569818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:13:24.253999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.130584+0000","last_change":"2023-11-08T19:25:47.286434+0000","last_active":"2023-11-08T19:26:49.130584+0000","last_peered":"2023-11-08T19:26:49.130584+0000","last_clean":"2023-11-08T19:26:49.130584+0000","last_became_active":"2023-11-08T19:25:47.286181+0000","last_became_peered":"2023-11-08T19:25:47.286181+0000","last_unstale":"2023-11-08T19:26:49.130584+0000","last_undegraded":"2023-11-08T19:26:49.130584+0000","last_fullsized":"2023-11-08T19:26:49.130584+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:13:27.285648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":70,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.136660+0000","last_change":"2023-11-08T19:24:32.140514+0000","last_active":"2023-11-08T19:26:49.136660+0000","last_peered":"2023-11-08T19:26:49.136660+0000","last_clean":"2023-11-08T19:26:49.136660+0000","last_became_active":"2023-11-08T19:24:31.146668+0000","last_became_peered":"2023-11-08T19:24:31.146668+0000","last_unstale":"2023-11-08T19:26:49.136660+0000","last_undegraded":"2023-11-08T19:26:49.136660+0000","last_fullsized":"2023-11-08T19:26:49.136660+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:31:24.539374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071576699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.135212+0000","last_change":"2023-11-08T19:25:48.320667+0000","last_active":"2023-11-08T19:26:49.135212+0000","last_peered":"2023-11-08T19:26:49.135212+0000","last_clean":"2023-11-08T19:26:49.135212+0000","last_became_active":"2023-11-08T19:25:46.290246+0000","last_became_peered":"2023-11-08T19:25:46.290246+0000","last_unstale":"2023-11-08T19:26:49.135212+0000","last_undegraded":"2023-11-08T19:26:49.135212+0000","last_fullsized":"2023-11-08T19:26:49.135212+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:33:35.492889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000423211,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.153002+0000","last_change":"2023-11-08T19:26:49.148000+0000","last_active":"2023-11-08T19:26:49.153002+0000","last_peered":"2023-11-08T19:26:49.153002+0000","last_clean":"2023-11-08T19:26:49.153002+0000","last_became_active":"2023-11-08T19:26:49.147832+0000","last_became_peered":"2023-11-08T19:26:49.147832+0000","last_unstale":"2023-11-08T19:26:49.153002+0000","last_undegraded":"2023-11-08T19:26:49.153002+0000","last_fullsized":"2023-11-08T19:26:49.153002+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:50:46.630219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"95'2","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.448154+0000","last_change":"2023-11-08T19:26:48.615384+0000","last_active":"2023-11-08T19:26:50.448154+0000","last_peered":"2023-11-08T19:26:50.448154+0000","last_clean":"2023-11-08T19:26:50.448154+0000","last_became_active":"2023-11-08T19:26:48.615113+0000","last_became_peered":"2023-11-08T19:26:48.615113+0000","last_unstale":"2023-11-08T19:26:50.448154+0000","last_undegraded":"2023-11-08T19:26:50.448154+0000","last_fullsized":"2023-11-08T19:26:50.448154+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_clean_scrub_stamp":"2023-11-08T19:26:47.569818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:16:14.877916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":30,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.137585+0000","last_change":"2023-11-08T19:25:47.287717+0000","last_active":"2023-11-08T19:26:49.137585+0000","last_peered":"2023-11-08T19:26:49.137585+0000","last_clean":"2023-11-08T19:26:49.137585+0000","last_became_active":"2023-11-08T19:25:47.287412+0000","last_became_peered":"2023-11-08T19:25:47.287412+0000","last_unstale":"2023-11-08T19:26:49.137585+0000","last_undegraded":"2023-11-08T19:26:49.137585+0000","last_fullsized":"2023-11-08T19:26:49.137585+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:18:04.478139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.135309+0000","last_change":"2023-11-08T19:24:32.142892+0000","last_active":"2023-11-08T19:26:49.135309+0000","last_peered":"2023-11-08T19:26:49.135309+0000","last_clean":"2023-11-08T19:26:49.135309+0000","last_became_active":"2023-11-08T19:24:31.144912+0000","last_became_peered":"2023-11-08T19:24:31.144912+0000","last_unstale":"2023-11-08T19:26:49.135309+0000","last_undegraded":"2023-11-08T19:26:49.135309+0000","last_fullsized":"2023-11-08T19:26:49.135309+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:04:21.151484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056686900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.136572+0000","last_change":"2023-11-08T19:25:48.285205+0000","last_active":"2023-11-08T19:26:49.136572+0000","last_peered":"2023-11-08T19:26:49.136572+0000","last_clean":"2023-11-08T19:26:49.136572+0000","last_became_active":"2023-11-08T19:25:46.285848+0000","last_became_peered":"2023-11-08T19:25:46.285848+0000","last_unstale":"2023-11-08T19:26:49.136572+0000","last_undegraded":"2023-11-08T19:26:49.136572+0000","last_fullsized":"2023-11-08T19:26:49.136572+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:07:10.832480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089732199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.288979+0000","last_change":"2023-11-08T19:26:49.141968+0000","last_active":"2023-11-08T19:26:50.288979+0000","last_peered":"2023-11-08T19:26:50.288979+0000","last_clean":"2023-11-08T19:26:50.288979+0000","last_became_active":"2023-11-08T19:26:49.141726+0000","last_became_peered":"2023-11-08T19:26:49.141726+0000","last_unstale":"2023-11-08T19:26:50.288979+0000","last_undegraded":"2023-11-08T19:26:50.288979+0000","last_fullsized":"2023-11-08T19:26:50.288979+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:33:13.222981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.129113+0000","last_change":"2023-11-08T19:26:48.616337+0000","last_active":"2023-11-08T19:26:50.129113+0000","last_peered":"2023-11-08T19:26:50.129113+0000","last_clean":"2023-11-08T19:26:50.129113+0000","last_became_active":"2023-11-08T19:26:48.615230+0000","last_became_peered":"2023-11-08T19:26:48.615230+0000","last_unstale":"2023-11-08T19:26:50.129113+0000","last_undegraded":"2023-11-08T19:26:50.129113+0000","last_fullsized":"2023-11-08T19:26:50.129113+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_clean_scrub_stamp":"2023-11-08T19:26:47.569818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:41:00.315816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":31,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.135235+0000","last_change":"2023-11-08T19:25:47.280177+0000","last_active":"2023-11-08T19:26:49.135235+0000","last_peered":"2023-11-08T19:26:49.135235+0000","last_clean":"2023-11-08T19:26:49.135235+0000","last_became_active":"2023-11-08T19:25:47.279913+0000","last_became_peered":"2023-11-08T19:25:47.279913+0000","last_unstale":"2023-11-08T19:26:49.135235+0000","last_undegraded":"2023-11-08T19:26:49.135235+0000","last_fullsized":"2023-11-08T19:26:49.135235+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:26:02.147090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":60,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.134702+0000","last_change":"2023-11-08T19:24:32.263958+0000","last_active":"2023-11-08T19:26:49.134702+0000","last_peered":"2023-11-08T19:26:49.134702+0000","last_clean":"2023-11-08T19:26:49.134702+0000","last_became_active":"2023-11-08T19:24:31.149011+0000","last_became_peered":"2023-11-08T19:24:31.149011+0000","last_unstale":"2023-11-08T19:26:49.134702+0000","last_undegraded":"2023-11-08T19:26:49.134702+0000","last_fullsized":"2023-11-08T19:26:49.134702+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:09:04.880374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033496900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.132360+0000","last_change":"2023-11-08T19:25:48.285075+0000","last_active":"2023-11-08T19:26:49.132360+0000","last_peered":"2023-11-08T19:26:49.132360+0000","last_clean":"2023-11-08T19:26:49.132360+0000","last_became_active":"2023-11-08T19:25:46.272479+0000","last_became_peered":"2023-11-08T19:25:46.272479+0000","last_unstale":"2023-11-08T19:26:49.132360+0000","last_undegraded":"2023-11-08T19:26:49.132360+0000","last_fullsized":"2023-11-08T19:26:49.132360+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:23:12.422712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001158117,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28752,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343088,"statfs":{"total":96636764160,"available":96607322112,"internally_reserved":0,"allocated":1773568,"data_stored":1168804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55200000000000005,"15min":0.53800000000000003},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.41399999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.71299999999999997,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.54800000000000004}]},{"osd":1,"last update":"Wed Nov 8 19:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.54800000000000004,"15min":0.54700000000000004},"min":{"1min":0.40799999999999997,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.69499999999999995,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.53800000000000003,"15min":0.53200000000000003},"min":{"1min":0.40600000000000003,"5min":0.37,"15min":0.37},"max":{"1min":0.75900000000000001,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.60699999999999998}]},{"osd":2,"last update":"Wed Nov 8 19:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.51400000000000001,"15min":0.50800000000000001},"min":{"1min":0.42899999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.75800000000000001,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.54000000000000004,"15min":0.53600000000000003},"min":{"1min":0.379,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.77800000000000002,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.45500000000000002}]},{"osd":3,"last update":"Wed Nov 8 19:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.53600000000000003,"15min":0.53400000000000003},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.56899999999999995,"15min":0.55900000000000005},"min":{"1min":0.42399999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76100000000000001,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.57299999999999995}]},{"osd":4,"last update":"Wed Nov 8 19:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.496,"15min":0.48599999999999999},"min":{"1min":0.35999999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.376},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.51900000000000002,"15min":0.51800000000000002},"min":{"1min":0.378,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.71399999999999997,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.495}]},{"osd":5,"last update":"Wed Nov 8 19:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.55900000000000005,"15min":0.54800000000000004},"min":{"1min":0.39200000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.76300000000000001,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.623},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.58199999999999996,"15min":0.57799999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.68700000000000006,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.67100000000000004}]},{"osd":6,"last update":"Wed Nov 8 19:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.45600000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.80400000000000005,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57299999999999995,"15min":0.56399999999999995},"min":{"1min":0.441,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.69199999999999995,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.59199999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574900,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28188,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343652,"statfs":{"total":96636764160,"available":96607899648,"internally_reserved":0,"allocated":1187840,"data_stored":585601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.57299999999999995,"15min":0.59699999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.69799999999999995,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.57299999999999995,"15min":0.59099999999999997},"min":{"1min":0.313,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.754,"5min":1.478,"15min":1.478},"last":0.55700000000000005}]},{"osd":1,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.59599999999999997,"15min":0.60599999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.77500000000000002,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.627},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.65200000000000002,"15min":0.66600000000000004},"min":{"1min":0.435,"5min":0.433,"15min":0.433},"max":{"1min":0.78700000000000003,"5min":1.649,"15min":1.649},"last":0.63700000000000001}]},{"osd":2,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.37},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.621,"15min":0.63200000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76400000000000001,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.67600000000000005}]},{"osd":3,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.60399999999999998,"15min":0.63},"min":{"1min":0.42299999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.747,"5min":1.766,"15min":1.766},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.59499999999999997,"15min":0.61899999999999999},"min":{"1min":0.39300000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.82799999999999996,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":0.45200000000000001}]},{"osd":4,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53700000000000003,"15min":0.54200000000000004},"min":{"1min":0.36399999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57299999999999995,"15min":0.58099999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.81699999999999995,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.61099999999999999}]},{"osd":5,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.55500000000000005,"15min":0.56799999999999995},"min":{"1min":0.38800000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.73499999999999999,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.498},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.623,"15min":0.63600000000000001},"min":{"1min":0.41399999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.80200000000000005,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.59099999999999997}]},{"osd":7,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.60599999999999998,"15min":0.61299999999999999},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.77700000000000002,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.63600000000000001,"15min":0.64600000000000002},"min":{"1min":0.44400000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.71599999999999997,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.47899999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574899,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28184,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343656,"statfs":{"total":96636764160,"available":96607903744,"internally_reserved":0,"allocated":1191936,"data_stored":585655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.35699999999999998,"15min":0.36299999999999999},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.51200000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.38900000000000001,"15min":0.41299999999999998},"min":{"1min":0.22900000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.51700000000000002,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":0.32200000000000001}]},{"osd":2,"last update":"Wed Nov 8 19:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.33800000000000002,"15min":0.34499999999999997},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.53000000000000003,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.38100000000000001,"15min":0.39400000000000002},"min":{"1min":0.253,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.46400000000000002,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.38800000000000001}]},{"osd":3,"last update":"Wed Nov 8 19:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.40799999999999997,"15min":0.41699999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.432,"5min":1.24,"15min":1.24},"last":0.432},{"interface":"front","average":{"1min":0.371,"5min":0.438,"15min":0.46200000000000002},"min":{"1min":0.26100000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.47999999999999998,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.373}]},{"osd":4,"last update":"Wed Nov 8 19:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.60599999999999998,"15min":0.61399999999999999},"min":{"1min":0.46500000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72499999999999998,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57599999999999996,"15min":0.56599999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.76200000000000001,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.59999999999999998}]},{"osd":5,"last update":"Wed Nov 8 19:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.56999999999999995,"15min":0.55800000000000005},"min":{"1min":0.41399999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.72799999999999998,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.60199999999999998,"15min":0.60699999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.68700000000000006,"5min":1.115,"15min":1.115},"last":0.52900000000000003}]},{"osd":6,"last update":"Wed Nov 8 19:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.63,"15min":0.63800000000000001},"min":{"1min":0.439,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.746,"5min":2.093,"15min":2.093},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.59899999999999998,"15min":0.60299999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.76100000000000001,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.67700000000000005}]},{"osd":7,"last update":"Wed Nov 8 19:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.64700000000000002,"15min":0.67100000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.77600000000000002,"5min":1.591,"15min":1.591},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.66500000000000004,"15min":0.69199999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.70199999999999996,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.57899999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574899,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28764,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343076,"statfs":{"total":96636764160,"available":96607309824,"internally_reserved":0,"allocated":1785856,"data_stored":1169912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:26:00 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.879,"15min":1.1180000000000001},"min":{"1min":0.23799999999999999,"5min":0.192,"15min":0.192},"max":{"1min":0.60699999999999998,"5min":19.295999999999999,"15min":19.295999999999999},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.379,"5min":0.81999999999999995,"15min":1.024},"min":{"1min":0.24299999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.56000000000000005,"5min":17.204000000000001,"15min":17.204000000000001},"last":0.33000000000000002}]},{"osd":2,"last update":"Wed Nov 8 19:26:00 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.54200000000000004,"15min":0.61799999999999999},"min":{"1min":0.28299999999999997,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.54700000000000004,"5min":6.524,"15min":6.524},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.85399999999999998,"15min":1.0640000000000001},"min":{"1min":0.29499999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.60699999999999998,"5min":17.175000000000001,"15min":17.175000000000001},"last":0.371}]},{"osd":3,"last update":"Wed Nov 8 19:26:00 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.746,"15min":0.91000000000000003},"min":{"1min":0.27100000000000002,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.55800000000000005,"5min":14.324,"15min":14.324},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.40799999999999997,"15min":0.40400000000000003},"min":{"1min":0.34699999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.30399999999999999}]},{"osd":4,"last update":"Wed Nov 8 19:26:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":1.028,"15min":1.212},"min":{"1min":0.52000000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.98999999999999999,"5min":17.056000000000001,"15min":17.056000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.70699999999999996,"15min":0.745},"min":{"1min":0.49099999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.82299999999999995,"5min":5.0289999999999999,"15min":5.0289999999999999},"last":0.56699999999999995}]},{"osd":5,"last update":"Wed Nov 8 19:26:00 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.69999999999999996,"15min":0.746},"min":{"1min":0.53400000000000003,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.85099999999999998,"5min":5.0590000000000002,"15min":5.0590000000000002},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.58399999999999996,"15min":0.56999999999999995},"min":{"1min":0.47199999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.59499999999999997}]},{"osd":6,"last update":"Wed Nov 8 19:26:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.61299999999999999,"15min":0.60799999999999998},"min":{"1min":0.505,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":1.0649999999999999,"15min":1.2589999999999999},"min":{"1min":0.50800000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.0389999999999999,"5min":17.111999999999998,"15min":17.111999999999998},"last":0.624}]},{"osd":7,"last update":"Wed Nov 8 19:26:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":1.0820000000000001,"15min":1.274},"min":{"1min":0.48099999999999998,"5min":0.376,"15min":0.376},"max":{"1min":1.0760000000000001,"5min":17.146000000000001,"15min":17.146000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.63,"5min":0.71099999999999997,"15min":0.75700000000000001},"min":{"1min":0.47099999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.91700000000000004,"5min":4.9829999999999997,"15min":4.9829999999999997},"last":0.64700000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574899,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28184,"kb_used_data":1156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343656,"statfs":{"total":96636764160,"available":96607903744,"internally_reserved":0,"allocated":1183744,"data_stored":585531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.433,"15min":0.47499999999999998},"min":{"1min":0.23300000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.61299999999999999,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":0.248},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.46200000000000002,"15min":0.50800000000000001},"min":{"1min":0.23999999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.65100000000000002,"5min":3.4369999999999998,"15min":3.4369999999999998},"last":0.26800000000000002}]},{"osd":1,"last update":"Wed Nov 8 19:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.49099999999999999,"15min":0.54900000000000004},"min":{"1min":0.27000000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.48399999999999999,"5min":4.0679999999999996,"15min":4.0679999999999996},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.54400000000000004,"15min":0.59599999999999997},"min":{"1min":0.32300000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.58599999999999997,"5min":4.3499999999999996,"15min":4.3499999999999996},"last":0.32600000000000001}]},{"osd":3,"last update":"Wed Nov 8 19:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.495,"15min":0.53700000000000003},"min":{"1min":0.27800000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.47099999999999997,"5min":3.8580000000000001,"15min":3.8580000000000001},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.46300000000000002,"15min":0.51200000000000001},"min":{"1min":0.29599999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.55700000000000005,"5min":3.476,"15min":3.476},"last":0.309}]},{"osd":4,"last update":"Wed Nov 8 19:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.68799999999999994,"15min":0.71799999999999997},"min":{"1min":0.44,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.98799999999999999,"5min":4.0090000000000003,"15min":4.0090000000000003},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.68899999999999995,"15min":0.73399999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.69099999999999995,"5min":4.1040000000000001,"15min":4.1040000000000001},"last":0.42599999999999999}]},{"osd":5,"last update":"Wed Nov 8 19:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.69299999999999995,"15min":0.74299999999999999},"min":{"1min":0.47999999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.874,"5min":4.0869999999999997,"15min":4.0869999999999997},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.69599999999999995,"15min":0.746},"min":{"1min":0.435,"5min":0.433,"15min":0.433},"max":{"1min":0.78100000000000003,"5min":3.843,"15min":3.843},"last":0.46200000000000002}]},{"osd":6,"last update":"Wed Nov 8 19:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.70799999999999996,"15min":0.75900000000000001},"min":{"1min":0.45300000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.72699999999999998,"5min":4.1399999999999997,"15min":4.1399999999999997},"last":0.375},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.68799999999999994,"15min":0.73399999999999999},"min":{"1min":0.49199999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.81499999999999995,"5min":4.0499999999999998,"15min":4.0499999999999998},"last":0.47299999999999998}]},{"osd":7,"last update":"Wed Nov 8 19:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.72799999999999998,"15min":0.76800000000000002},"min":{"1min":0.48799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.754,"5min":4.157,"15min":4.157},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.754,"15min":0.80000000000000004},"min":{"1min":0.505,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.93000000000000005,"5min":4.1710000000000003,"15min":4.1710000000000003},"last":0.44400000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574899,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28192,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343648,"statfs":{"total":96636764160,"available":96607895552,"internally_reserved":0,"allocated":1200128,"data_stored":587213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.38100000000000001,"15min":0.38500000000000001},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.64600000000000002,"5min":1.458,"15min":1.458},"last":0.373},{"interface":"front","average":{"1min":0.372,"5min":0.38900000000000001,"15min":0.39800000000000002},"min":{"1min":0.29499999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.53400000000000003,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.38900000000000001}]},{"osd":1,"last update":"Wed Nov 8 19:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.40500000000000003,"15min":0.41099999999999998},"min":{"1min":0.29599999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.61199999999999999,"5min":1.512,"15min":1.512},"last":0.318},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.435,"15min":0.44700000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.59999999999999998,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.35699999999999998}]},{"osd":2,"last update":"Wed Nov 8 19:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.371,"15min":0.376},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.54800000000000004,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.41899999999999998,"15min":0.42699999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.60899999999999999,"5min":1.536,"15min":1.536},"last":0.40000000000000002}]},{"osd":4,"last update":"Wed Nov 8 19:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.60799999999999998,"15min":0.62},"min":{"1min":0.44900000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.77000000000000002,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.623,"5min":0.61299999999999999,"15min":0.61099999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.80200000000000005,"5min":1.153,"15min":1.153},"last":0.53400000000000003}]},{"osd":5,"last update":"Wed Nov 8 19:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.58899999999999997,"15min":0.59099999999999997},"min":{"1min":0.42399999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.69599999999999995,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.58899999999999997,"15min":0.60299999999999998},"min":{"1min":0.39300000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.73699999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.45000000000000001}]},{"osd":6,"last update":"Wed Nov 8 19:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57399999999999995,"15min":0.57999999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78500000000000003,"5min":1.113,"15min":1.113},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60799999999999998,"15min":0.61199999999999999},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72299999999999998,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.52500000000000002}]},{"osd":7,"last update":"Wed Nov 8 19:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.63500000000000001,"15min":0.64700000000000002},"min":{"1min":0.433,"5min":0.432,"15min":0.432},"max":{"1min":0.73999999999999999,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.62,"15min":0.61799999999999999},"min":{"1min":0.46300000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.754,"5min":1.179,"15min":1.179},"last":0.59499999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574899,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28184,"kb_used_data":1156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343656,"statfs":{"total":96636764160,"available":96607903744,"internally_reserved":0,"allocated":1183744,"data_stored":585531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:25:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.54500000000000004,"15min":0.53800000000000003},"min":{"1min":0.36799999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.80100000000000005,"5min":1.399,"15min":1.399},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58499999999999996,"15min":0.59499999999999997},"min":{"1min":0.44400000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73499999999999999,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.439}]},{"osd":1,"last update":"Wed Nov 8 19:25:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.51400000000000001,"15min":0.51100000000000001},"min":{"1min":0.42199999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.502,"15min":0.497},"min":{"1min":0.40999999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.32700000000000001}]},{"osd":2,"last update":"Wed Nov 8 19:25:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.61899999999999999,"15min":0.63500000000000001},"min":{"1min":0.38200000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.80800000000000005,"5min":2.8490000000000002,"15min":2.8490000000000002},"last":0.504},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.53800000000000003,"15min":0.52400000000000002},"min":{"1min":0.40799999999999997,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.71799999999999997,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.35999999999999999}]},{"osd":3,"last update":"Wed Nov 8 19:25:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57799999999999996,"15min":0.56599999999999995},"min":{"1min":0.47099999999999997,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.75700000000000001,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.70099999999999996,"15min":0.72399999999999998},"min":{"1min":0.48299999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.83199999999999996,"5min":3.4849999999999999,"15min":3.4849999999999999},"last":0.47599999999999998}]},{"osd":5,"last update":"Wed Nov 8 19:25:59 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.51800000000000002,"15min":0.52000000000000002},"min":{"1min":0.38,"5min":0.313,"15min":0.313},"max":{"1min":0.67200000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.56899999999999995,"15min":0.56100000000000005},"min":{"1min":0.39700000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.79100000000000004,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.51800000000000002}]},{"osd":6,"last update":"Wed Nov 8 19:25:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.67300000000000004,"15min":0.71499999999999997},"min":{"1min":0.38,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.71599999999999997,"5min":4.1529999999999996,"15min":4.1529999999999996},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.624,"5min":0.61599999999999999,"15min":0.61399999999999999},"min":{"1min":0.41699999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.73999999999999999,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.40899999999999997}]},{"osd":7,"last update":"Wed Nov 8 19:25:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57399999999999995,"15min":0.57199999999999995},"min":{"1min":0.47399999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.69999999999999996,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.80200000000000005,"15min":0.85199999999999998},"min":{"1min":0.52700000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.83899999999999997,"5min":5.5359999999999996,"15min":5.5359999999999996},"last":0.57599999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574899,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28192,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343648,"statfs":{"total":96636764160,"available":96607895552,"internally_reserved":0,"allocated":1191936,"data_stored":586135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53700000000000003,"15min":0.54700000000000004},"min":{"1min":0.40600000000000003,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.63800000000000001,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.52500000000000002,"15min":0.51900000000000002},"min":{"1min":0.32800000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.68799999999999994,"5min":0.878,"15min":0.878},"last":0.378}]},{"osd":1,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55300000000000005,"15min":0.54700000000000004},"min":{"1min":0.47199999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.68200000000000005,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.44},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.59299999999999997,"15min":0.60699999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.73899999999999999,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":0.40699999999999997}]},{"osd":2,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.34699999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.65300000000000002,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.53600000000000003,"15min":0.53000000000000003},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.70699999999999996,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.54500000000000004}]},{"osd":3,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.41299999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71799999999999997,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57699999999999996,"15min":0.57299999999999995},"min":{"1min":0.42199999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.73599999999999999,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.64200000000000002}]},{"osd":4,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.57499999999999996,"15min":0.59899999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.748,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.63700000000000001,"15min":0.63500000000000001},"min":{"1min":0.46500000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.77300000000000002,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.58099999999999996}]},{"osd":6,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.57899999999999996,"15min":0.57799999999999996},"min":{"1min":0.38200000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.73599999999999999,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.63800000000000001,"15min":0.66600000000000004},"min":{"1min":0.41799999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.80500000000000005,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":0.56599999999999995}]},{"osd":7,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.623,"15min":0.629},"min":{"1min":0.42499999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.82799999999999996,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.626},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.64200000000000002,"15min":0.64800000000000002},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.80700000000000005,"5min":0.873,"15min":0.873},"last":0.67000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:26:53.731 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:26:53.882 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.880+0000 7f19c2b68700 1 Processor -- start 2023-11-08T19:26:53.882 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.880+0000 7f19c2b68700 1 -- start start 2023-11-08T19:26:53.884 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.880+0000 7f19c2b68700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f19bc0cc140 0x7f19bc0cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:53.884 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.880+0000 7f19c2b68700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f19bc0b2850 0x7f19bc0cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:53.885 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.880+0000 7f19c2b68700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19bc0cce50 con 0x7f19bc0b2cd0 2023-11-08T19:26:53.885 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.880+0000 7f19c2b68700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19bc0b2430 con 0x7f19bc0cc140 2023-11-08T19:26:53.885 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.880+0000 7f19c2b68700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19bc0cc520 con 0x7f19bc0b2850 2023-11-08T19:26:53.885 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.880+0000 7f19c0904700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f19bc0cc140 0x7f19bc0cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:53.886 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.881+0000 7f19c0904700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f19bc0cc140 0x7f19bc0cc910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43482/0 (socket says 172.21.15.149:43482) 2023-11-08T19:26:53.886 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.881+0000 7f19c0904700 1 -- 172.21.15.149:0/3348148358 learned_addr learned my addr 172.21.15.149:0/3348148358 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:53.886 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.881+0000 7f19bbfff700 1 --2- 172.21.15.149:0/3348148358 >> v2:172.21.15.160:3300/0 conn(0x7f19bc0b2850 0x7f19bc0cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:53.886 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.881+0000 7f19c0904700 1 -- 172.21.15.149:0/3348148358 >> v2:172.21.15.160:3300/0 conn(0x7f19bc0b2850 msgr2=0x7f19bc0cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:53.886 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.881+0000 7f19c0904700 1 --2- 172.21.15.149:0/3348148358 >> v2:172.21.15.160:3300/0 conn(0x7f19bc0b2850 0x7f19bc0cabf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:53.887 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.881+0000 7f19c0904700 1 -- 172.21.15.149:0/3348148358 >> v1:172.21.15.160:6789/0 conn(0x7f19bc0b2cd0 legacy=0x7f19bc15d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:53.887 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.881+0000 7f19c0904700 1 -- 172.21.15.149:0/3348148358 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19bc0b17b0 con 0x7f19bc0cc140 2023-11-08T19:26:53.887 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.881+0000 7f19c0904700 1 --2- 172.21.15.149:0/3348148358 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19bc0cc140 0x7f19bc0cc910 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f19bc0b1330 tx=0x7f19b0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffdc47fbae869b6e server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:53.887 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.881+0000 7f19bb7fe700 1 -- 172.21.15.149:0/3348148358 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b0005e30 con 0x7f19bc0cc140 2023-11-08T19:26:53.887 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.881+0000 7f19bb7fe700 1 -- 172.21.15.149:0/3348148358 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b0006030 con 0x7f19bc0cc140 2023-11-08T19:26:53.888 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.881+0000 7f19bb7fe700 1 -- 172.21.15.149:0/3348148358 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b00063e0 con 0x7f19bc0cc140 2023-11-08T19:26:53.888 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.882+0000 7f19c2b68700 1 -- 172.21.15.149:0/3348148358 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19bc0cc140 msgr2=0x7f19bc0cc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:53.888 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.882+0000 7f19c2b68700 1 --2- 172.21.15.149:0/3348148358 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19bc0cc140 0x7f19bc0cc910 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f19bc0b1330 tx=0x7f19b0009bd0 comp rx=0 tx=0).stop 2023-11-08T19:26:53.888 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.882+0000 7f19c2b68700 1 -- 172.21.15.149:0/3348148358 shutdown_connections 2023-11-08T19:26:53.888 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.882+0000 7f19c2b68700 1 --2- 172.21.15.149:0/3348148358 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19bc0cc140 0x7f19bc0cc910 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:53.889 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.882+0000 7f19c2b68700 1 --2- 172.21.15.149:0/3348148358 >> v2:172.21.15.160:3300/0 conn(0x7f19bc0b2850 0x7f19bc0cabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:53.889 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.882+0000 7f19c2b68700 1 -- 172.21.15.149:0/3348148358 >> 172.21.15.149:0/3348148358 conn(0x7f19bc099a40 msgr2=0x7f19bc0d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:53.889 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.882+0000 7f19c2b68700 1 -- 172.21.15.149:0/3348148358 shutdown_connections 2023-11-08T19:26:53.889 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.882+0000 7f19c2b68700 1 -- 172.21.15.149:0/3348148358 wait complete. 2023-11-08T19:26:53.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.883+0000 7f19c2b68700 1 Processor -- start 2023-11-08T19:26:53.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.883+0000 7f19c2b68700 1 -- start start 2023-11-08T19:26:53.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.884+0000 7f19c2b68700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f19bc0b2850 0x7f19bc0af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:53.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.884+0000 7f19c2b68700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f19bc0b2cd0 0x7f19bc0af9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:53.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.884+0000 7f19c2b68700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19bc0cc140 0x7f19bc152370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:53.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.884+0000 7f19c2b68700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19bc09d610 con 0x7f19bc0cc140 2023-11-08T19:26:53.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.884+0000 7f19c2b68700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19bc0b0d00 con 0x7f19bc0b2cd0 2023-11-08T19:26:53.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.884+0000 7f19c2b68700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19bc14ffa0 con 0x7f19bc0b2850 2023-11-08T19:26:53.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.884+0000 7f19c1105700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19bc0cc140 0x7f19bc152370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:53.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.884+0000 7f19c1105700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19bc0cc140 0x7f19bc152370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43492/0 (socket says 172.21.15.149:43492) 2023-11-08T19:26:53.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.884+0000 7f19c1105700 1 -- 172.21.15.149:0/2726723396 learned_addr learned my addr 172.21.15.149:0/2726723396 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:53.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.884+0000 7f19c0904700 1 --2- 172.21.15.149:0/2726723396 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f19bc0b2850 0x7f19bc0af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:53.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.884+0000 7f19bbfff700 1 --2- 172.21.15.149:0/2726723396 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f19bc0b2cd0 0x7f19bc0af9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:53.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.884+0000 7f19c1105700 1 -- 172.21.15.149:0/2726723396 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f19bc0b2850 msgr2=0x7f19bc0af4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:53.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.884+0000 7f19c1105700 1 --2- 172.21.15.149:0/2726723396 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f19bc0b2850 0x7f19bc0af4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:53.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.884+0000 7f19c1105700 1 -- 172.21.15.149:0/2726723396 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f19bc0b2cd0 msgr2=0x7f19bc0af9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:53.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.884+0000 7f19c1105700 1 --2- 172.21.15.149:0/2726723396 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f19bc0b2cd0 0x7f19bc0af9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:53.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.884+0000 7f19c1105700 1 -- 172.21.15.149:0/2726723396 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b0009500 con 0x7f19bc0cc140 2023-11-08T19:26:53.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.884+0000 7f19c1105700 1 --2- 172.21.15.149:0/2726723396 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19bc0cc140 0x7f19bc152370 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f19b400cba0 tx=0x7f19b400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:53.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.884+0000 7f19b97fa700 1 -- 172.21.15.149:0/2726723396 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b400ab80 con 0x7f19bc0cc140 2023-11-08T19:26:53.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.885+0000 7f19c2b68700 1 -- 172.21.15.149:0/2726723396 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19bc0b00f0 con 0x7f19bc0cc140 2023-11-08T19:26:53.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.885+0000 7f19b97fa700 1 -- 172.21.15.149:0/2726723396 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b400ace0 con 0x7f19bc0cc140 2023-11-08T19:26:53.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.885+0000 7f19b97fa700 1 -- 172.21.15.149:0/2726723396 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b4012660 con 0x7f19bc0cc140 2023-11-08T19:26:53.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.885+0000 7f19c2b68700 1 -- 172.21.15.149:0/2726723396 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19bc0b06b0 con 0x7f19bc0cc140 2023-11-08T19:26:53.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.886+0000 7f19c2b68700 1 -- 172.21.15.149:0/2726723396 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19bc0745f0 con 0x7f19bc0cc140 2023-11-08T19:26:53.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.886+0000 7f19b97fa700 1 -- 172.21.15.149:0/2726723396 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f19b40127c0 con 0x7f19bc0cc140 2023-11-08T19:26:53.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.886+0000 7f19b97fa700 1 --2- 172.21.15.149:0/2726723396 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f19a006af00 0x7f19a006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:53.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.886+0000 7f19b97fa700 1 -- 172.21.15.149:0/2726723396 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f19b408a2b0 con 0x7f19bc0cc140 2023-11-08T19:26:53.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.886+0000 7f19c0904700 1 --2- 172.21.15.149:0/2726723396 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f19a006af00 0x7f19a006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:53.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.887+0000 7f19c0904700 1 --2- 172.21.15.149:0/2726723396 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f19a006af00 0x7f19a006d3c0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f19bc0b1330 tx=0x7f19b0008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:53.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:53.891+0000 7f19b97fa700 1 -- 172.21.15.149:0/2726723396 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f19b4054df0 con 0x7f19bc0cc140 2023-11-08T19:26:54.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.079+0000 7f19c2b68700 1 -- 172.21.15.149:0/2726723396 --> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f19bc0b1d70 con 0x7f19a006af00 2023-11-08T19:26:54.094 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.092+0000 7f19b97fa700 1 -- 172.21.15.149:0/2726723396 <== mgr.4104 v2:172.21.15.149:6832/1929837472 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+531940 (secure 0 0 0) 0x7f19b00062a0 con 0x7f19a006af00 2023-11-08T19:26:54.101 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:26:54.105 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.097+0000 7f19c2b68700 1 -- 172.21.15.149:0/2726723396 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f19a006af00 msgr2=0x7f19a006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:54.106 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.097+0000 7f19c2b68700 1 --2- 172.21.15.149:0/2726723396 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f19a006af00 0x7f19a006d3c0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f19bc0b1330 tx=0x7f19b0008070 comp rx=0 tx=0).stop 2023-11-08T19:26:54.106 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.097+0000 7f19c2b68700 1 -- 172.21.15.149:0/2726723396 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19bc0cc140 msgr2=0x7f19bc152370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:54.106 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.097+0000 7f19c2b68700 1 --2- 172.21.15.149:0/2726723396 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19bc0cc140 0x7f19bc152370 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f19b400cba0 tx=0x7f19b400cf60 comp rx=0 tx=0).stop 2023-11-08T19:26:54.106 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.097+0000 7f19c2b68700 1 -- 172.21.15.149:0/2726723396 shutdown_connections 2023-11-08T19:26:54.106 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.097+0000 7f19c2b68700 1 --2- 172.21.15.149:0/2726723396 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f19a006af00 0x7f19a006d3c0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:54.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.097+0000 7f19c2b68700 1 --2- 172.21.15.149:0/2726723396 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19bc0cc140 0x7f19bc152370 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:54.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.097+0000 7f19c2b68700 1 --2- 172.21.15.149:0/2726723396 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f19bc0b2850 0x7f19bc0af4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:54.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.097+0000 7f19c2b68700 1 --2- 172.21.15.149:0/2726723396 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f19bc0b2cd0 0x7f19bc0af9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:54.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.097+0000 7f19c2b68700 1 -- 172.21.15.149:0/2726723396 >> 172.21.15.149:0/2726723396 conn(0x7f19bc099a40 msgr2=0x7f19bc0c84d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:54.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.097+0000 7f19c2b68700 1 -- 172.21.15.149:0/2726723396 shutdown_connections 2023-11-08T19:26:54.108 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.097+0000 7f19c2b68700 1 -- 172.21.15.149:0/2726723396 wait complete. 2023-11-08T19:26:54.108 INFO:teuthology.orchestra.run.smithi149.stderr:dumped all 2023-11-08T19:26:54.114 INFO:teuthology.orchestra.run.smithi149.stdout:{"pg_ready":true,"pg_map":{"version":208,"stamp":"2023-11-08T19:26:54.038054+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":324,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226640,"kb_used_data":10448,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754748080,"statfs":{"total":773094113280,"available":772862033920,"internally_reserved":0,"allocated":10698752,"data_stored":5854382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001467"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.289526+0000","last_change":"2023-11-08T19:26:49.141588+0000","last_active":"2023-11-08T19:26:50.289526+0000","last_peered":"2023-11-08T19:26:50.289526+0000","last_clean":"2023-11-08T19:26:50.289526+0000","last_became_active":"2023-11-08T19:26:49.141048+0000","last_became_peered":"2023-11-08T19:26:49.141048+0000","last_unstale":"2023-11-08T19:26:50.289526+0000","last_undegraded":"2023-11-08T19:26:50.289526+0000","last_fullsized":"2023-11-08T19:26:50.289526+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:25:06.629338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.131249+0000","last_change":"2023-11-08T19:26:49.143458+0000","last_active":"2023-11-08T19:26:50.131249+0000","last_peered":"2023-11-08T19:26:50.131249+0000","last_clean":"2023-11-08T19:26:50.131249+0000","last_became_active":"2023-11-08T19:26:49.143163+0000","last_became_peered":"2023-11-08T19:26:49.143163+0000","last_unstale":"2023-11-08T19:26:50.131249+0000","last_undegraded":"2023-11-08T19:26:50.131249+0000","last_fullsized":"2023-11-08T19:26:50.131249+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:44:31.157988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.161020+0000","last_change":"2023-11-08T19:26:49.153293+0000","last_active":"2023-11-08T19:26:49.161020+0000","last_peered":"2023-11-08T19:26:49.161020+0000","last_clean":"2023-11-08T19:26:49.161020+0000","last_became_active":"2023-11-08T19:26:49.153056+0000","last_became_peered":"2023-11-08T19:26:49.153056+0000","last_unstale":"2023-11-08T19:26:49.161020+0000","last_undegraded":"2023-11-08T19:26:49.161020+0000","last_fullsized":"2023-11-08T19:26:49.161020+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:24:09.541354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.289275+0000","last_change":"2023-11-08T19:26:49.138198+0000","last_active":"2023-11-08T19:26:50.289275+0000","last_peered":"2023-11-08T19:26:50.289275+0000","last_clean":"2023-11-08T19:26:50.289275+0000","last_became_active":"2023-11-08T19:26:49.137469+0000","last_became_peered":"2023-11-08T19:26:49.137469+0000","last_unstale":"2023-11-08T19:26:50.289275+0000","last_undegraded":"2023-11-08T19:26:50.289275+0000","last_fullsized":"2023-11-08T19:26:50.289275+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:25:23.445518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.129439+0000","last_change":"2023-11-08T19:26:49.140455+0000","last_active":"2023-11-08T19:26:50.129439+0000","last_peered":"2023-11-08T19:26:50.129439+0000","last_clean":"2023-11-08T19:26:50.129439+0000","last_became_active":"2023-11-08T19:26:49.140021+0000","last_became_peered":"2023-11-08T19:26:49.140021+0000","last_unstale":"2023-11-08T19:26:50.129439+0000","last_undegraded":"2023-11-08T19:26:50.129439+0000","last_fullsized":"2023-11-08T19:26:50.129439+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:19:38.633880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.447483+0000","last_change":"2023-11-08T19:26:49.146106+0000","last_active":"2023-11-08T19:26:50.447483+0000","last_peered":"2023-11-08T19:26:50.447483+0000","last_clean":"2023-11-08T19:26:50.447483+0000","last_became_active":"2023-11-08T19:26:49.145425+0000","last_became_peered":"2023-11-08T19:26:49.145425+0000","last_unstale":"2023-11-08T19:26:50.447483+0000","last_undegraded":"2023-11-08T19:26:50.447483+0000","last_fullsized":"2023-11-08T19:26:50.447483+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:19:57.938315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.447775+0000","last_change":"2023-11-08T19:26:49.141727+0000","last_active":"2023-11-08T19:26:50.447775+0000","last_peered":"2023-11-08T19:26:50.447775+0000","last_clean":"2023-11-08T19:26:50.447775+0000","last_became_active":"2023-11-08T19:26:49.141455+0000","last_became_peered":"2023-11-08T19:26:49.141455+0000","last_unstale":"2023-11-08T19:26:50.447775+0000","last_undegraded":"2023-11-08T19:26:50.447775+0000","last_fullsized":"2023-11-08T19:26:50.447775+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:06:34.319906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.155570+0000","last_change":"2023-11-08T19:26:49.150022+0000","last_active":"2023-11-08T19:26:49.155570+0000","last_peered":"2023-11-08T19:26:49.155570+0000","last_clean":"2023-11-08T19:26:49.155570+0000","last_became_active":"2023-11-08T19:26:49.149752+0000","last_became_peered":"2023-11-08T19:26:49.149752+0000","last_unstale":"2023-11-08T19:26:49.155570+0000","last_undegraded":"2023-11-08T19:26:49.155570+0000","last_fullsized":"2023-11-08T19:26:49.155570+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:44:31.157988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.289563+0000","last_change":"2023-11-08T19:26:49.141763+0000","last_active":"2023-11-08T19:26:50.289563+0000","last_peered":"2023-11-08T19:26:50.289563+0000","last_clean":"2023-11-08T19:26:50.289563+0000","last_became_active":"2023-11-08T19:26:49.141356+0000","last_became_peered":"2023-11-08T19:26:49.141356+0000","last_unstale":"2023-11-08T19:26:50.289563+0000","last_undegraded":"2023-11-08T19:26:50.289563+0000","last_fullsized":"2023-11-08T19:26:50.289563+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:22:29.583551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.289672+0000","last_change":"2023-11-08T19:26:49.139612+0000","last_active":"2023-11-08T19:26:50.289672+0000","last_peered":"2023-11-08T19:26:50.289672+0000","last_clean":"2023-11-08T19:26:50.289672+0000","last_became_active":"2023-11-08T19:26:49.139365+0000","last_became_peered":"2023-11-08T19:26:49.139365+0000","last_unstale":"2023-11-08T19:26:50.289672+0000","last_undegraded":"2023-11-08T19:26:50.289672+0000","last_fullsized":"2023-11-08T19:26:50.289672+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:10:08.972100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.130564+0000","last_change":"2023-11-08T19:26:49.143362+0000","last_active":"2023-11-08T19:26:50.130564+0000","last_peered":"2023-11-08T19:26:50.130564+0000","last_clean":"2023-11-08T19:26:50.130564+0000","last_became_active":"2023-11-08T19:26:49.143051+0000","last_became_peered":"2023-11-08T19:26:49.143051+0000","last_unstale":"2023-11-08T19:26:50.130564+0000","last_undegraded":"2023-11-08T19:26:50.130564+0000","last_fullsized":"2023-11-08T19:26:50.130564+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:36:02.486688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.289392+0000","last_change":"2023-11-08T19:26:49.139979+0000","last_active":"2023-11-08T19:26:50.289392+0000","last_peered":"2023-11-08T19:26:50.289392+0000","last_clean":"2023-11-08T19:26:50.289392+0000","last_became_active":"2023-11-08T19:26:49.139729+0000","last_became_peered":"2023-11-08T19:26:49.139729+0000","last_unstale":"2023-11-08T19:26:50.289392+0000","last_undegraded":"2023-11-08T19:26:50.289392+0000","last_fullsized":"2023-11-08T19:26:50.289392+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:23:14.448610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.155695+0000","last_change":"2023-11-08T19:26:49.150513+0000","last_active":"2023-11-08T19:26:49.155695+0000","last_peered":"2023-11-08T19:26:49.155695+0000","last_clean":"2023-11-08T19:26:49.155695+0000","last_became_active":"2023-11-08T19:26:49.147156+0000","last_became_peered":"2023-11-08T19:26:49.147156+0000","last_unstale":"2023-11-08T19:26:49.155695+0000","last_undegraded":"2023-11-08T19:26:49.155695+0000","last_fullsized":"2023-11-08T19:26:49.155695+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:34:42.233255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.152692+0000","last_change":"2023-11-08T19:26:49.141582+0000","last_active":"2023-11-08T19:26:49.152692+0000","last_peered":"2023-11-08T19:26:49.152692+0000","last_clean":"2023-11-08T19:26:49.152692+0000","last_became_active":"2023-11-08T19:26:49.141085+0000","last_became_peered":"2023-11-08T19:26:49.141085+0000","last_unstale":"2023-11-08T19:26:49.152692+0000","last_undegraded":"2023-11-08T19:26:49.152692+0000","last_fullsized":"2023-11-08T19:26:49.152692+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:16:35.810867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.447512+0000","last_change":"2023-11-08T19:26:49.145336+0000","last_active":"2023-11-08T19:26:50.447512+0000","last_peered":"2023-11-08T19:26:50.447512+0000","last_clean":"2023-11-08T19:26:50.447512+0000","last_became_active":"2023-11-08T19:26:49.145063+0000","last_became_peered":"2023-11-08T19:26:49.145063+0000","last_unstale":"2023-11-08T19:26:50.447512+0000","last_undegraded":"2023-11-08T19:26:50.447512+0000","last_fullsized":"2023-11-08T19:26:50.447512+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:11:31.614270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.288761+0000","last_change":"2023-11-08T19:26:49.150887+0000","last_active":"2023-11-08T19:26:50.288761+0000","last_peered":"2023-11-08T19:26:50.288761+0000","last_clean":"2023-11-08T19:26:50.288761+0000","last_became_active":"2023-11-08T19:26:49.150610+0000","last_became_peered":"2023-11-08T19:26:49.150610+0000","last_unstale":"2023-11-08T19:26:50.288761+0000","last_undegraded":"2023-11-08T19:26:50.288761+0000","last_fullsized":"2023-11-08T19:26:50.288761+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:19:42.823034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.131367+0000","last_change":"2023-11-08T19:26:49.143444+0000","last_active":"2023-11-08T19:26:50.131367+0000","last_peered":"2023-11-08T19:26:50.131367+0000","last_clean":"2023-11-08T19:26:50.131367+0000","last_became_active":"2023-11-08T19:26:49.143136+0000","last_became_peered":"2023-11-08T19:26:49.143136+0000","last_unstale":"2023-11-08T19:26:50.131367+0000","last_undegraded":"2023-11-08T19:26:50.131367+0000","last_fullsized":"2023-11-08T19:26:50.131367+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:20:04.364566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.131640+0000","last_change":"2023-11-08T19:26:49.140054+0000","last_active":"2023-11-08T19:26:50.131640+0000","last_peered":"2023-11-08T19:26:50.131640+0000","last_clean":"2023-11-08T19:26:50.131640+0000","last_became_active":"2023-11-08T19:26:49.139661+0000","last_became_peered":"2023-11-08T19:26:49.139661+0000","last_unstale":"2023-11-08T19:26:50.131640+0000","last_undegraded":"2023-11-08T19:26:50.131640+0000","last_fullsized":"2023-11-08T19:26:50.131640+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:09:28.305701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.161058+0000","last_change":"2023-11-08T19:26:49.154115+0000","last_active":"2023-11-08T19:26:49.161058+0000","last_peered":"2023-11-08T19:26:49.161058+0000","last_clean":"2023-11-08T19:26:49.161058+0000","last_became_active":"2023-11-08T19:26:49.153880+0000","last_became_peered":"2023-11-08T19:26:49.153880+0000","last_unstale":"2023-11-08T19:26:49.161058+0000","last_undegraded":"2023-11-08T19:26:49.161058+0000","last_fullsized":"2023-11-08T19:26:49.161058+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:33:14.130283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.130872+0000","last_change":"2023-11-08T19:26:49.147552+0000","last_active":"2023-11-08T19:26:50.130872+0000","last_peered":"2023-11-08T19:26:50.130872+0000","last_clean":"2023-11-08T19:26:50.130872+0000","last_became_active":"2023-11-08T19:26:49.146930+0000","last_became_peered":"2023-11-08T19:26:49.146930+0000","last_unstale":"2023-11-08T19:26:50.130872+0000","last_undegraded":"2023-11-08T19:26:50.130872+0000","last_fullsized":"2023-11-08T19:26:50.130872+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:16:35.810867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.130372+0000","last_change":"2023-11-08T19:26:49.139447+0000","last_active":"2023-11-08T19:26:50.130372+0000","last_peered":"2023-11-08T19:26:50.130372+0000","last_clean":"2023-11-08T19:26:50.130372+0000","last_became_active":"2023-11-08T19:26:49.138964+0000","last_became_peered":"2023-11-08T19:26:49.138964+0000","last_unstale":"2023-11-08T19:26:50.130372+0000","last_undegraded":"2023-11-08T19:26:50.130372+0000","last_fullsized":"2023-11-08T19:26:50.130372+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:35:44.695221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.448577+0000","last_change":"2023-11-08T19:26:49.142471+0000","last_active":"2023-11-08T19:26:50.448577+0000","last_peered":"2023-11-08T19:26:50.448577+0000","last_clean":"2023-11-08T19:26:50.448577+0000","last_became_active":"2023-11-08T19:26:49.141854+0000","last_became_peered":"2023-11-08T19:26:49.141854+0000","last_unstale":"2023-11-08T19:26:50.448577+0000","last_undegraded":"2023-11-08T19:26:50.448577+0000","last_fullsized":"2023-11-08T19:26:50.448577+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:26:31.761196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.130298+0000","last_change":"2023-11-08T19:26:49.138590+0000","last_active":"2023-11-08T19:26:50.130298+0000","last_peered":"2023-11-08T19:26:50.130298+0000","last_clean":"2023-11-08T19:26:50.130298+0000","last_became_active":"2023-11-08T19:26:49.138307+0000","last_became_peered":"2023-11-08T19:26:49.138307+0000","last_unstale":"2023-11-08T19:26:50.130298+0000","last_undegraded":"2023-11-08T19:26:50.130298+0000","last_fullsized":"2023-11-08T19:26:50.130298+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:03:19.403078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.447758+0000","last_change":"2023-11-08T19:26:49.150791+0000","last_active":"2023-11-08T19:26:50.447758+0000","last_peered":"2023-11-08T19:26:50.447758+0000","last_clean":"2023-11-08T19:26:50.447758+0000","last_became_active":"2023-11-08T19:26:49.150494+0000","last_became_peered":"2023-11-08T19:26:49.150494+0000","last_unstale":"2023-11-08T19:26:50.447758+0000","last_undegraded":"2023-11-08T19:26:50.447758+0000","last_fullsized":"2023-11-08T19:26:50.447758+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:32:51.649781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.131513+0000","last_change":"2023-11-08T19:26:49.143071+0000","last_active":"2023-11-08T19:26:50.131513+0000","last_peered":"2023-11-08T19:26:50.131513+0000","last_clean":"2023-11-08T19:26:50.131513+0000","last_became_active":"2023-11-08T19:26:49.142787+0000","last_became_peered":"2023-11-08T19:26:49.142787+0000","last_unstale":"2023-11-08T19:26:50.131513+0000","last_undegraded":"2023-11-08T19:26:50.131513+0000","last_fullsized":"2023-11-08T19:26:50.131513+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:54:36.305399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.289448+0000","last_change":"2023-11-08T19:26:49.138209+0000","last_active":"2023-11-08T19:26:50.289448+0000","last_peered":"2023-11-08T19:26:50.289448+0000","last_clean":"2023-11-08T19:26:50.289448+0000","last_became_active":"2023-11-08T19:26:49.137935+0000","last_became_peered":"2023-11-08T19:26:49.137935+0000","last_unstale":"2023-11-08T19:26:50.289448+0000","last_undegraded":"2023-11-08T19:26:50.289448+0000","last_fullsized":"2023-11-08T19:26:50.289448+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:50:38.044081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.448733+0000","last_change":"2023-11-08T19:26:49.145939+0000","last_active":"2023-11-08T19:26:50.448733+0000","last_peered":"2023-11-08T19:26:50.448733+0000","last_clean":"2023-11-08T19:26:50.448733+0000","last_became_active":"2023-11-08T19:26:49.145688+0000","last_became_peered":"2023-11-08T19:26:49.145688+0000","last_unstale":"2023-11-08T19:26:50.448733+0000","last_undegraded":"2023-11-08T19:26:50.448733+0000","last_fullsized":"2023-11-08T19:26:50.448733+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:08:19.420005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.448904+0000","last_change":"2023-11-08T19:26:49.141037+0000","last_active":"2023-11-08T19:26:50.448904+0000","last_peered":"2023-11-08T19:26:50.448904+0000","last_clean":"2023-11-08T19:26:50.448904+0000","last_became_active":"2023-11-08T19:26:49.140707+0000","last_became_peered":"2023-11-08T19:26:49.140707+0000","last_unstale":"2023-11-08T19:26:50.448904+0000","last_undegraded":"2023-11-08T19:26:50.448904+0000","last_fullsized":"2023-11-08T19:26:50.448904+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:26:03.712317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.130349+0000","last_change":"2023-11-08T19:26:49.139256+0000","last_active":"2023-11-08T19:26:50.130349+0000","last_peered":"2023-11-08T19:26:50.130349+0000","last_clean":"2023-11-08T19:26:50.130349+0000","last_became_active":"2023-11-08T19:26:49.138584+0000","last_became_peered":"2023-11-08T19:26:49.138584+0000","last_unstale":"2023-11-08T19:26:50.130349+0000","last_undegraded":"2023-11-08T19:26:50.130349+0000","last_fullsized":"2023-11-08T19:26:50.130349+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:11:32.570964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.447801+0000","last_change":"2023-11-08T19:26:49.141825+0000","last_active":"2023-11-08T19:26:50.447801+0000","last_peered":"2023-11-08T19:26:50.447801+0000","last_clean":"2023-11-08T19:26:50.447801+0000","last_became_active":"2023-11-08T19:26:49.141541+0000","last_became_peered":"2023-11-08T19:26:49.141541+0000","last_unstale":"2023-11-08T19:26:50.447801+0000","last_undegraded":"2023-11-08T19:26:50.447801+0000","last_fullsized":"2023-11-08T19:26:50.447801+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:11:28.367601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.288852+0000","last_change":"2023-11-08T19:26:49.141270+0000","last_active":"2023-11-08T19:26:50.288852+0000","last_peered":"2023-11-08T19:26:50.288852+0000","last_clean":"2023-11-08T19:26:50.288852+0000","last_became_active":"2023-11-08T19:26:49.141002+0000","last_became_peered":"2023-11-08T19:26:49.141002+0000","last_unstale":"2023-11-08T19:26:50.288852+0000","last_undegraded":"2023-11-08T19:26:50.288852+0000","last_fullsized":"2023-11-08T19:26:50.288852+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:32:36.037246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.447419+0000","last_change":"2023-11-08T19:26:49.139787+0000","last_active":"2023-11-08T19:26:50.447419+0000","last_peered":"2023-11-08T19:26:50.447419+0000","last_clean":"2023-11-08T19:26:50.447419+0000","last_became_active":"2023-11-08T19:26:49.139557+0000","last_became_peered":"2023-11-08T19:26:49.139557+0000","last_unstale":"2023-11-08T19:26:50.447419+0000","last_undegraded":"2023-11-08T19:26:50.447419+0000","last_fullsized":"2023-11-08T19:26:50.447419+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:46:00.327628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.447687+0000","last_change":"2023-11-08T19:26:49.150960+0000","last_active":"2023-11-08T19:26:50.447687+0000","last_peered":"2023-11-08T19:26:50.447687+0000","last_clean":"2023-11-08T19:26:50.447687+0000","last_became_active":"2023-11-08T19:26:49.150712+0000","last_became_peered":"2023-11-08T19:26:49.150712+0000","last_unstale":"2023-11-08T19:26:50.447687+0000","last_undegraded":"2023-11-08T19:26:50.447687+0000","last_fullsized":"2023-11-08T19:26:50.447687+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:15:55.235941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.447907+0000","last_change":"2023-11-08T19:26:48.607008+0000","last_active":"2023-11-08T19:26:50.447907+0000","last_peered":"2023-11-08T19:26:50.447907+0000","last_clean":"2023-11-08T19:26:50.447907+0000","last_became_active":"2023-11-08T19:26:48.606566+0000","last_became_peered":"2023-11-08T19:26:48.606566+0000","last_unstale":"2023-11-08T19:26:50.447907+0000","last_undegraded":"2023-11-08T19:26:50.447907+0000","last_fullsized":"2023-11-08T19:26:50.447907+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_clean_scrub_stamp":"2023-11-08T19:26:47.569818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:11:30.606713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.134458+0000","last_change":"2023-11-08T19:25:47.285071+0000","last_active":"2023-11-08T19:26:49.134458+0000","last_peered":"2023-11-08T19:26:49.134458+0000","last_clean":"2023-11-08T19:26:49.134458+0000","last_became_active":"2023-11-08T19:25:47.284788+0000","last_became_peered":"2023-11-08T19:25:47.284788+0000","last_unstale":"2023-11-08T19:26:49.134458+0000","last_undegraded":"2023-11-08T19:26:49.134458+0000","last_fullsized":"2023-11-08T19:26:49.134458+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:50:50.522780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":226,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-08T19:26:48.598028+0000","last_change":"2023-11-08T19:22:58.054283+0000","last_active":"2023-11-08T19:26:48.598028+0000","last_peered":"2023-11-08T19:26:48.598028+0000","last_clean":"2023-11-08T19:26:48.598028+0000","last_became_active":"2023-11-08T19:22:58.053337+0000","last_became_peered":"2023-11-08T19:22:58.053337+0000","last_unstale":"2023-11-08T19:26:48.598028+0000","last_undegraded":"2023-11-08T19:26:48.598028+0000","last_fullsized":"2023-11-08T19:26:48.598028+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:22:56.479654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:22:56.479654+0000","last_clean_scrub_stamp":"2023-11-08T19:22:56.479654+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:16:05.317001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.131267+0000","last_change":"2023-11-08T19:24:32.530665+0000","last_active":"2023-11-08T19:26:49.131267+0000","last_peered":"2023-11-08T19:26:49.131267+0000","last_clean":"2023-11-08T19:26:49.131267+0000","last_became_active":"2023-11-08T19:24:31.148363+0000","last_became_peered":"2023-11-08T19:24:31.148363+0000","last_unstale":"2023-11-08T19:26:49.131267+0000","last_undegraded":"2023-11-08T19:26:49.131267+0000","last_fullsized":"2023-11-08T19:26:49.131267+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:02:27.987795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075444200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-08T19:26:48.598273+0000","last_change":"2023-11-08T19:25:48.371346+0000","last_active":"2023-11-08T19:26:48.598273+0000","last_peered":"2023-11-08T19:26:48.598273+0000","last_clean":"2023-11-08T19:26:48.598273+0000","last_became_active":"2023-11-08T19:25:46.289470+0000","last_became_peered":"2023-11-08T19:25:46.289470+0000","last_unstale":"2023-11-08T19:26:48.598273+0000","last_undegraded":"2023-11-08T19:26:48.598273+0000","last_fullsized":"2023-11-08T19:26:48.598273+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:25:34.010085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000371219,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.448571+0000","last_change":"2023-11-08T19:26:49.148430+0000","last_active":"2023-11-08T19:26:50.448571+0000","last_peered":"2023-11-08T19:26:50.448571+0000","last_clean":"2023-11-08T19:26:50.448571+0000","last_became_active":"2023-11-08T19:26:49.148111+0000","last_became_peered":"2023-11-08T19:26:49.148111+0000","last_unstale":"2023-11-08T19:26:50.448571+0000","last_undegraded":"2023-11-08T19:26:50.448571+0000","last_fullsized":"2023-11-08T19:26:50.448571+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:21:42.870172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"95'3","reported_seq":15,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.289505+0000","last_change":"2023-11-08T19:26:48.606002+0000","last_active":"2023-11-08T19:26:50.289505+0000","last_peered":"2023-11-08T19:26:50.289505+0000","last_clean":"2023-11-08T19:26:50.289505+0000","last_became_active":"2023-11-08T19:26:48.605700+0000","last_became_peered":"2023-11-08T19:26:48.605700+0000","last_unstale":"2023-11-08T19:26:50.289505+0000","last_undegraded":"2023-11-08T19:26:50.289505+0000","last_fullsized":"2023-11-08T19:26:50.289505+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_clean_scrub_stamp":"2023-11-08T19:26:47.569818+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:37:17.021877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":33,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.128055+0000","last_change":"2023-11-08T19:25:47.283242+0000","last_active":"2023-11-08T19:26:49.128055+0000","last_peered":"2023-11-08T19:26:49.128055+0000","last_clean":"2023-11-08T19:26:49.128055+0000","last_became_active":"2023-11-08T19:25:47.282922+0000","last_became_peered":"2023-11-08T19:25:47.282922+0000","last_unstale":"2023-11-08T19:26:49.128055+0000","last_undegraded":"2023-11-08T19:26:49.128055+0000","last_fullsized":"2023-11-08T19:26:49.128055+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:26:23.400596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.136754+0000","last_change":"2023-11-08T19:24:32.544333+0000","last_active":"2023-11-08T19:26:49.136754+0000","last_peered":"2023-11-08T19:26:49.136754+0000","last_clean":"2023-11-08T19:26:49.136754+0000","last_became_active":"2023-11-08T19:24:31.138598+0000","last_became_peered":"2023-11-08T19:24:31.138598+0000","last_unstale":"2023-11-08T19:26:49.136754+0000","last_undegraded":"2023-11-08T19:26:49.136754+0000","last_fullsized":"2023-11-08T19:26:49.136754+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:11.860580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015114824000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.127941+0000","last_change":"2023-11-08T19:25:48.374357+0000","last_active":"2023-11-08T19:26:49.127941+0000","last_peered":"2023-11-08T19:26:49.127941+0000","last_clean":"2023-11-08T19:26:49.127941+0000","last_became_active":"2023-11-08T19:25:46.279007+0000","last_became_peered":"2023-11-08T19:25:46.279007+0000","last_unstale":"2023-11-08T19:26:49.127941+0000","last_undegraded":"2023-11-08T19:26:49.127941+0000","last_fullsized":"2023-11-08T19:26:49.127941+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:59:30.845191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036813240000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.448155+0000","last_change":"2023-11-08T19:26:49.140757+0000","last_active":"2023-11-08T19:26:50.448155+0000","last_peered":"2023-11-08T19:26:50.448155+0000","last_clean":"2023-11-08T19:26:50.448155+0000","last_became_active":"2023-11-08T19:26:49.140501+0000","last_became_peered":"2023-11-08T19:26:49.140501+0000","last_unstale":"2023-11-08T19:26:50.448155+0000","last_undegraded":"2023-11-08T19:26:50.448155+0000","last_fullsized":"2023-11-08T19:26:50.448155+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:51:29.963135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"95'6","reported_seq":18,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.289257+0000","last_change":"2023-11-08T19:26:48.607302+0000","last_active":"2023-11-08T19:26:50.289257+0000","last_peered":"2023-11-08T19:26:50.289257+0000","last_clean":"2023-11-08T19:26:50.289257+0000","last_became_active":"2023-11-08T19:26:48.606913+0000","last_became_peered":"2023-11-08T19:26:48.606913+0000","last_unstale":"2023-11-08T19:26:50.289257+0000","last_undegraded":"2023-11-08T19:26:50.289257+0000","last_fullsized":"2023-11-08T19:26:50.289257+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_clean_scrub_stamp":"2023-11-08T19:26:47.569818+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:16:03.290041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":31,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.134687+0000","last_change":"2023-11-08T19:25:47.285093+0000","last_active":"2023-11-08T19:26:49.134687+0000","last_peered":"2023-11-08T19:26:49.134687+0000","last_clean":"2023-11-08T19:26:49.134687+0000","last_became_active":"2023-11-08T19:25:47.284796+0000","last_became_peered":"2023-11-08T19:25:47.284796+0000","last_unstale":"2023-11-08T19:26:49.134687+0000","last_undegraded":"2023-11-08T19:26:49.134687+0000","last_fullsized":"2023-11-08T19:26:49.134687+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:46:36.504650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.136089+0000","last_change":"2023-11-08T19:24:32.544285+0000","last_active":"2023-11-08T19:26:49.136089+0000","last_peered":"2023-11-08T19:26:49.136089+0000","last_clean":"2023-11-08T19:26:49.136089+0000","last_became_active":"2023-11-08T19:24:31.142028+0000","last_became_peered":"2023-11-08T19:24:31.142028+0000","last_unstale":"2023-11-08T19:26:49.136089+0000","last_undegraded":"2023-11-08T19:26:49.136089+0000","last_fullsized":"2023-11-08T19:26:49.136089+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:01:24.198196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067537399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.135219+0000","last_change":"2023-11-08T19:25:48.372192+0000","last_active":"2023-11-08T19:26:49.135219+0000","last_peered":"2023-11-08T19:26:49.135219+0000","last_clean":"2023-11-08T19:26:49.135219+0000","last_became_active":"2023-11-08T19:25:46.288739+0000","last_became_peered":"2023-11-08T19:25:46.288739+0000","last_unstale":"2023-11-08T19:26:49.135219+0000","last_undegraded":"2023-11-08T19:26:49.135219+0000","last_fullsized":"2023-11-08T19:26:49.135219+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:45:04.839053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015057530000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.448283+0000","last_change":"2023-11-08T19:26:49.143078+0000","last_active":"2023-11-08T19:26:50.448283+0000","last_peered":"2023-11-08T19:26:50.448283+0000","last_clean":"2023-11-08T19:26:50.448283+0000","last_became_active":"2023-11-08T19:26:49.139387+0000","last_became_peered":"2023-11-08T19:26:49.139387+0000","last_unstale":"2023-11-08T19:26:50.448283+0000","last_undegraded":"2023-11-08T19:26:50.448283+0000","last_fullsized":"2023-11-08T19:26:50.448283+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:20:47.065925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.130084+0000","last_change":"2023-11-08T19:26:48.615811+0000","last_active":"2023-11-08T19:26:50.130084+0000","last_peered":"2023-11-08T19:26:50.130084+0000","last_clean":"2023-11-08T19:26:50.130084+0000","last_became_active":"2023-11-08T19:26:48.615533+0000","last_became_peered":"2023-11-08T19:26:48.615533+0000","last_unstale":"2023-11-08T19:26:50.130084+0000","last_undegraded":"2023-11-08T19:26:50.130084+0000","last_fullsized":"2023-11-08T19:26:50.130084+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_clean_scrub_stamp":"2023-11-08T19:26:47.569818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:24:33.093083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":33,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.127854+0000","last_change":"2023-11-08T19:25:47.287920+0000","last_active":"2023-11-08T19:26:49.127854+0000","last_peered":"2023-11-08T19:26:49.127854+0000","last_clean":"2023-11-08T19:26:49.127854+0000","last_became_active":"2023-11-08T19:25:47.287494+0000","last_became_peered":"2023-11-08T19:25:47.287494+0000","last_unstale":"2023-11-08T19:26:49.127854+0000","last_undegraded":"2023-11-08T19:26:49.127854+0000","last_fullsized":"2023-11-08T19:26:49.127854+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:42:18.942062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":62,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.133305+0000","last_change":"2023-11-08T19:24:32.142836+0000","last_active":"2023-11-08T19:26:49.133305+0000","last_peered":"2023-11-08T19:26:49.133305+0000","last_clean":"2023-11-08T19:26:49.133305+0000","last_became_active":"2023-11-08T19:24:31.141367+0000","last_became_peered":"2023-11-08T19:24:31.141367+0000","last_unstale":"2023-11-08T19:26:49.133305+0000","last_undegraded":"2023-11-08T19:26:49.133305+0000","last_fullsized":"2023-11-08T19:26:49.133305+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:39.214888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001335136,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.136012+0000","last_change":"2023-11-08T19:25:48.372718+0000","last_active":"2023-11-08T19:26:49.136012+0000","last_peered":"2023-11-08T19:26:49.136012+0000","last_clean":"2023-11-08T19:26:49.136012+0000","last_became_active":"2023-11-08T19:25:46.289283+0000","last_became_peered":"2023-11-08T19:25:46.289283+0000","last_unstale":"2023-11-08T19:26:49.136012+0000","last_undegraded":"2023-11-08T19:26:49.136012+0000","last_fullsized":"2023-11-08T19:26:49.136012+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:15:51.881891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001274049,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.132311+0000","last_change":"2023-11-08T19:26:49.145395+0000","last_active":"2023-11-08T19:26:50.132311+0000","last_peered":"2023-11-08T19:26:50.132311+0000","last_clean":"2023-11-08T19:26:50.132311+0000","last_became_active":"2023-11-08T19:26:49.145018+0000","last_became_peered":"2023-11-08T19:26:49.145018+0000","last_unstale":"2023-11-08T19:26:50.132311+0000","last_undegraded":"2023-11-08T19:26:50.132311+0000","last_fullsized":"2023-11-08T19:26:50.132311+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:59:07.418680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.449078+0000","last_change":"2023-11-08T19:26:48.606392+0000","last_active":"2023-11-08T19:26:50.449078+0000","last_peered":"2023-11-08T19:26:50.449078+0000","last_clean":"2023-11-08T19:26:50.449078+0000","last_became_active":"2023-11-08T19:26:48.606075+0000","last_became_peered":"2023-11-08T19:26:48.606075+0000","last_unstale":"2023-11-08T19:26:50.449078+0000","last_undegraded":"2023-11-08T19:26:50.449078+0000","last_fullsized":"2023-11-08T19:26:50.449078+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_clean_scrub_stamp":"2023-11-08T19:26:47.569818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:51:12.842624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":31,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.134983+0000","last_change":"2023-11-08T19:25:47.285353+0000","last_active":"2023-11-08T19:26:49.134983+0000","last_peered":"2023-11-08T19:26:49.134983+0000","last_clean":"2023-11-08T19:26:49.134983+0000","last_became_active":"2023-11-08T19:25:47.285075+0000","last_became_peered":"2023-11-08T19:25:47.285075+0000","last_unstale":"2023-11-08T19:26:49.134983+0000","last_undegraded":"2023-11-08T19:26:49.134983+0000","last_fullsized":"2023-11-08T19:26:49.134983+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:20:50.791463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":71,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.129626+0000","last_change":"2023-11-08T19:24:32.139885+0000","last_active":"2023-11-08T19:26:49.129626+0000","last_peered":"2023-11-08T19:26:49.129626+0000","last_clean":"2023-11-08T19:26:49.129626+0000","last_became_active":"2023-11-08T19:24:31.145329+0000","last_became_peered":"2023-11-08T19:24:31.145329+0000","last_unstale":"2023-11-08T19:26:49.129626+0000","last_undegraded":"2023-11-08T19:26:49.129626+0000","last_fullsized":"2023-11-08T19:26:49.129626+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:25:18.356784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049012999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.127672+0000","last_change":"2023-11-08T19:25:48.373848+0000","last_active":"2023-11-08T19:26:49.127672+0000","last_peered":"2023-11-08T19:26:49.127672+0000","last_clean":"2023-11-08T19:26:49.127672+0000","last_became_active":"2023-11-08T19:25:46.282174+0000","last_became_peered":"2023-11-08T19:25:46.282174+0000","last_unstale":"2023-11-08T19:26:49.127672+0000","last_undegraded":"2023-11-08T19:26:49.127672+0000","last_fullsized":"2023-11-08T19:26:49.127672+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:00:06.938052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000727792,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.448090+0000","last_change":"2023-11-08T19:26:49.148016+0000","last_active":"2023-11-08T19:26:50.448090+0000","last_peered":"2023-11-08T19:26:50.448090+0000","last_clean":"2023-11-08T19:26:50.448090+0000","last_became_active":"2023-11-08T19:26:49.147811+0000","last_became_peered":"2023-11-08T19:26:49.147811+0000","last_unstale":"2023-11-08T19:26:50.448090+0000","last_undegraded":"2023-11-08T19:26:50.448090+0000","last_fullsized":"2023-11-08T19:26:50.448090+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:40:18.977322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"95'8","reported_seq":20,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.128911+0000","last_change":"2023-11-08T19:26:48.609692+0000","last_active":"2023-11-08T19:26:50.128911+0000","last_peered":"2023-11-08T19:26:50.128911+0000","last_clean":"2023-11-08T19:26:50.128911+0000","last_became_active":"2023-11-08T19:26:48.609425+0000","last_became_peered":"2023-11-08T19:26:48.609425+0000","last_unstale":"2023-11-08T19:26:50.128911+0000","last_undegraded":"2023-11-08T19:26:50.128911+0000","last_fullsized":"2023-11-08T19:26:50.128911+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_clean_scrub_stamp":"2023-11-08T19:26:47.569818+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:51:13.620842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.130492+0000","last_change":"2023-11-08T19:25:47.287677+0000","last_active":"2023-11-08T19:26:49.130492+0000","last_peered":"2023-11-08T19:26:49.130492+0000","last_clean":"2023-11-08T19:26:49.130492+0000","last_became_active":"2023-11-08T19:25:47.287419+0000","last_became_peered":"2023-11-08T19:25:47.287419+0000","last_unstale":"2023-11-08T19:26:49.130492+0000","last_undegraded":"2023-11-08T19:26:49.130492+0000","last_fullsized":"2023-11-08T19:26:49.130492+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:22:08.770702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":70,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.136593+0000","last_change":"2023-11-08T19:24:32.140880+0000","last_active":"2023-11-08T19:26:49.136593+0000","last_peered":"2023-11-08T19:26:49.136593+0000","last_clean":"2023-11-08T19:26:49.136593+0000","last_became_active":"2023-11-08T19:24:31.146063+0000","last_became_peered":"2023-11-08T19:24:31.146063+0000","last_unstale":"2023-11-08T19:26:49.136593+0000","last_undegraded":"2023-11-08T19:26:49.136593+0000","last_fullsized":"2023-11-08T19:26:49.136593+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:54:08.985813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089896300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.131430+0000","last_change":"2023-11-08T19:25:48.374690+0000","last_active":"2023-11-08T19:26:49.131430+0000","last_peered":"2023-11-08T19:26:49.131430+0000","last_clean":"2023-11-08T19:26:49.131430+0000","last_became_active":"2023-11-08T19:25:46.281986+0000","last_became_peered":"2023-11-08T19:25:46.281986+0000","last_unstale":"2023-11-08T19:26:49.131430+0000","last_undegraded":"2023-11-08T19:26:49.131430+0000","last_fullsized":"2023-11-08T19:26:49.131430+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:21:00.981136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003067771,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.448338+0000","last_change":"2023-11-08T19:26:49.142811+0000","last_active":"2023-11-08T19:26:50.448338+0000","last_peered":"2023-11-08T19:26:50.448338+0000","last_clean":"2023-11-08T19:26:50.448338+0000","last_became_active":"2023-11-08T19:26:49.142234+0000","last_became_peered":"2023-11-08T19:26:49.142234+0000","last_unstale":"2023-11-08T19:26:50.448338+0000","last_undegraded":"2023-11-08T19:26:50.448338+0000","last_fullsized":"2023-11-08T19:26:50.448338+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:41:47.767607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"95'2","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.447984+0000","last_change":"2023-11-08T19:26:48.611270+0000","last_active":"2023-11-08T19:26:50.447984+0000","last_peered":"2023-11-08T19:26:50.447984+0000","last_clean":"2023-11-08T19:26:50.447984+0000","last_became_active":"2023-11-08T19:26:48.610875+0000","last_became_peered":"2023-11-08T19:26:48.610875+0000","last_unstale":"2023-11-08T19:26:50.447984+0000","last_undegraded":"2023-11-08T19:26:50.447984+0000","last_fullsized":"2023-11-08T19:26:50.447984+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_clean_scrub_stamp":"2023-11-08T19:26:47.569818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:32:51.799794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":28,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-08T19:26:48.598366+0000","last_change":"2023-11-08T19:25:47.287986+0000","last_active":"2023-11-08T19:26:48.598366+0000","last_peered":"2023-11-08T19:26:48.598366+0000","last_clean":"2023-11-08T19:26:48.598366+0000","last_became_active":"2023-11-08T19:25:47.287560+0000","last_became_peered":"2023-11-08T19:25:47.287560+0000","last_unstale":"2023-11-08T19:26:48.598366+0000","last_undegraded":"2023-11-08T19:26:48.598366+0000","last_fullsized":"2023-11-08T19:26:48.598366+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:35:31.433056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.131351+0000","last_change":"2023-11-08T19:24:32.530620+0000","last_active":"2023-11-08T19:26:49.131351+0000","last_peered":"2023-11-08T19:26:49.131351+0000","last_clean":"2023-11-08T19:26:49.131351+0000","last_became_active":"2023-11-08T19:24:31.144223+0000","last_became_peered":"2023-11-08T19:24:31.144223+0000","last_unstale":"2023-11-08T19:26:49.131351+0000","last_undegraded":"2023-11-08T19:26:49.131351+0000","last_fullsized":"2023-11-08T19:26:49.131351+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:01:25.647952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071879799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.136744+0000","last_change":"2023-11-08T19:25:48.285326+0000","last_active":"2023-11-08T19:26:49.136744+0000","last_peered":"2023-11-08T19:26:49.136744+0000","last_clean":"2023-11-08T19:26:49.136744+0000","last_became_active":"2023-11-08T19:25:46.278686+0000","last_became_peered":"2023-11-08T19:25:46.278686+0000","last_unstale":"2023-11-08T19:26:49.136744+0000","last_undegraded":"2023-11-08T19:26:49.136744+0000","last_fullsized":"2023-11-08T19:26:49.136744+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:25:34.010085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078409499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.448402+0000","last_change":"2023-11-08T19:26:49.138972+0000","last_active":"2023-11-08T19:26:50.448402+0000","last_peered":"2023-11-08T19:26:50.448402+0000","last_clean":"2023-11-08T19:26:50.448402+0000","last_became_active":"2023-11-08T19:26:49.138703+0000","last_became_peered":"2023-11-08T19:26:49.138703+0000","last_unstale":"2023-11-08T19:26:50.448402+0000","last_undegraded":"2023-11-08T19:26:50.448402+0000","last_fullsized":"2023-11-08T19:26:50.448402+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:16:49.803024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.131940+0000","last_change":"2023-11-08T19:26:48.596313+0000","last_active":"2023-11-08T19:26:50.131940+0000","last_peered":"2023-11-08T19:26:50.131940+0000","last_clean":"2023-11-08T19:26:50.131940+0000","last_became_active":"2023-11-08T19:26:48.596025+0000","last_became_peered":"2023-11-08T19:26:48.596025+0000","last_unstale":"2023-11-08T19:26:50.131940+0000","last_undegraded":"2023-11-08T19:26:50.131940+0000","last_fullsized":"2023-11-08T19:26:50.131940+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_clean_scrub_stamp":"2023-11-08T19:26:47.569818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:24:08.533796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.136372+0000","last_change":"2023-11-08T19:25:47.289726+0000","last_active":"2023-11-08T19:26:49.136372+0000","last_peered":"2023-11-08T19:26:49.136372+0000","last_clean":"2023-11-08T19:26:49.136372+0000","last_became_active":"2023-11-08T19:25:47.289362+0000","last_became_peered":"2023-11-08T19:25:47.289362+0000","last_unstale":"2023-11-08T19:26:49.136372+0000","last_undegraded":"2023-11-08T19:26:49.136372+0000","last_fullsized":"2023-11-08T19:26:49.136372+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:38:55.785104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":59,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-08T19:26:48.598985+0000","last_change":"2023-11-08T19:24:32.147025+0000","last_active":"2023-11-08T19:26:48.598985+0000","last_peered":"2023-11-08T19:26:48.598985+0000","last_clean":"2023-11-08T19:26:48.598985+0000","last_became_active":"2023-11-08T19:24:31.147082+0000","last_became_peered":"2023-11-08T19:24:31.147082+0000","last_unstale":"2023-11-08T19:26:48.598985+0000","last_undegraded":"2023-11-08T19:26:48.598985+0000","last_fullsized":"2023-11-08T19:26:48.598985+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:02:27.987795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043701599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.133318+0000","last_change":"2023-11-08T19:25:48.374739+0000","last_active":"2023-11-08T19:26:49.133318+0000","last_peered":"2023-11-08T19:26:49.133318+0000","last_clean":"2023-11-08T19:26:49.133318+0000","last_became_active":"2023-11-08T19:25:46.282071+0000","last_became_peered":"2023-11-08T19:25:46.282071+0000","last_unstale":"2023-11-08T19:26:49.133318+0000","last_undegraded":"2023-11-08T19:26:49.133318+0000","last_fullsized":"2023-11-08T19:26:49.133318+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:42:47.677504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023654909999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.448086+0000","last_change":"2023-11-08T19:26:49.145498+0000","last_active":"2023-11-08T19:26:50.448086+0000","last_peered":"2023-11-08T19:26:50.448086+0000","last_clean":"2023-11-08T19:26:50.448086+0000","last_became_active":"2023-11-08T19:26:49.145172+0000","last_became_peered":"2023-11-08T19:26:49.145172+0000","last_unstale":"2023-11-08T19:26:50.448086+0000","last_undegraded":"2023-11-08T19:26:50.448086+0000","last_fullsized":"2023-11-08T19:26:50.448086+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:03:02.752773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"95'2","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.129976+0000","last_change":"2023-11-08T19:26:48.615466+0000","last_active":"2023-11-08T19:26:50.129976+0000","last_peered":"2023-11-08T19:26:50.129976+0000","last_clean":"2023-11-08T19:26:50.129976+0000","last_became_active":"2023-11-08T19:26:48.615157+0000","last_became_peered":"2023-11-08T19:26:48.615157+0000","last_unstale":"2023-11-08T19:26:50.129976+0000","last_undegraded":"2023-11-08T19:26:50.129976+0000","last_fullsized":"2023-11-08T19:26:50.129976+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_clean_scrub_stamp":"2023-11-08T19:26:47.569818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:59:37.487128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.136833+0000","last_change":"2023-11-08T19:24:32.544063+0000","last_active":"2023-11-08T19:26:49.136833+0000","last_peered":"2023-11-08T19:26:49.136833+0000","last_clean":"2023-11-08T19:26:49.136833+0000","last_became_active":"2023-11-08T19:24:31.144795+0000","last_became_peered":"2023-11-08T19:24:31.144795+0000","last_unstale":"2023-11-08T19:26:49.136833+0000","last_undegraded":"2023-11-08T19:26:49.136833+0000","last_fullsized":"2023-11-08T19:26:49.136833+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:12:42.248307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01495431,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.131500+0000","last_change":"2023-11-08T19:25:48.283673+0000","last_active":"2023-11-08T19:26:49.131500+0000","last_peered":"2023-11-08T19:26:49.131500+0000","last_clean":"2023-11-08T19:26:49.131500+0000","last_became_active":"2023-11-08T19:25:46.285766+0000","last_became_peered":"2023-11-08T19:25:46.285766+0000","last_unstale":"2023-11-08T19:26:49.131500+0000","last_undegraded":"2023-11-08T19:26:49.131500+0000","last_fullsized":"2023-11-08T19:26:49.131500+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:46:35.498766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001756748,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":28,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-08T19:26:48.598115+0000","last_change":"2023-11-08T19:25:47.288301+0000","last_active":"2023-11-08T19:26:48.598115+0000","last_peered":"2023-11-08T19:26:48.598115+0000","last_clean":"2023-11-08T19:26:48.598115+0000","last_became_active":"2023-11-08T19:25:47.288027+0000","last_became_peered":"2023-11-08T19:25:47.288027+0000","last_unstale":"2023-11-08T19:26:48.598115+0000","last_undegraded":"2023-11-08T19:26:48.598115+0000","last_fullsized":"2023-11-08T19:26:48.598115+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:23:13.428596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.161047+0000","last_change":"2023-11-08T19:26:49.153935+0000","last_active":"2023-11-08T19:26:49.161047+0000","last_peered":"2023-11-08T19:26:49.161047+0000","last_clean":"2023-11-08T19:26:49.161047+0000","last_became_active":"2023-11-08T19:26:49.153679+0000","last_became_peered":"2023-11-08T19:26:49.153679+0000","last_unstale":"2023-11-08T19:26:49.161047+0000","last_undegraded":"2023-11-08T19:26:49.161047+0000","last_fullsized":"2023-11-08T19:26:49.161047+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:50:00.221115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"95'2","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.129767+0000","last_change":"2023-11-08T19:26:48.615745+0000","last_active":"2023-11-08T19:26:50.129767+0000","last_peered":"2023-11-08T19:26:50.129767+0000","last_clean":"2023-11-08T19:26:50.129767+0000","last_became_active":"2023-11-08T19:26:48.615472+0000","last_became_peered":"2023-11-08T19:26:48.615472+0000","last_unstale":"2023-11-08T19:26:50.129767+0000","last_undegraded":"2023-11-08T19:26:50.129767+0000","last_fullsized":"2023-11-08T19:26:50.129767+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_clean_scrub_stamp":"2023-11-08T19:26:47.569818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:41:45.199134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.134853+0000","last_change":"2023-11-08T19:24:32.263810+0000","last_active":"2023-11-08T19:26:49.134853+0000","last_peered":"2023-11-08T19:26:49.134853+0000","last_clean":"2023-11-08T19:26:49.134853+0000","last_became_active":"2023-11-08T19:24:31.138814+0000","last_became_peered":"2023-11-08T19:24:31.138814+0000","last_unstale":"2023-11-08T19:26:49.134853+0000","last_undegraded":"2023-11-08T19:26:49.134853+0000","last_fullsized":"2023-11-08T19:26:49.134853+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:21:55.985548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048136000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.130205+0000","last_change":"2023-11-08T19:25:48.283572+0000","last_active":"2023-11-08T19:26:49.130205+0000","last_peered":"2023-11-08T19:26:49.130205+0000","last_clean":"2023-11-08T19:26:49.130205+0000","last_became_active":"2023-11-08T19:25:46.271936+0000","last_became_peered":"2023-11-08T19:25:46.271936+0000","last_unstale":"2023-11-08T19:26:49.130205+0000","last_undegraded":"2023-11-08T19:26:49.130205+0000","last_fullsized":"2023-11-08T19:26:49.130205+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:46:11.541748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00186835,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.131263+0000","last_change":"2023-11-08T19:25:47.282856+0000","last_active":"2023-11-08T19:26:49.131263+0000","last_peered":"2023-11-08T19:26:49.131263+0000","last_clean":"2023-11-08T19:26:49.131263+0000","last_became_active":"2023-11-08T19:25:47.282594+0000","last_became_peered":"2023-11-08T19:25:47.282594+0000","last_unstale":"2023-11-08T19:26:49.131263+0000","last_undegraded":"2023-11-08T19:26:49.131263+0000","last_fullsized":"2023-11-08T19:26:49.131263+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:14:12.111756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.448708+0000","last_change":"2023-11-08T19:26:49.145756+0000","last_active":"2023-11-08T19:26:50.448708+0000","last_peered":"2023-11-08T19:26:50.448708+0000","last_clean":"2023-11-08T19:26:50.448708+0000","last_became_active":"2023-11-08T19:26:49.145481+0000","last_became_peered":"2023-11-08T19:26:49.145481+0000","last_unstale":"2023-11-08T19:26:50.448708+0000","last_undegraded":"2023-11-08T19:26:50.448708+0000","last_fullsized":"2023-11-08T19:26:50.448708+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:54:44.096661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"95'4","reported_seq":16,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.448153+0000","last_change":"2023-11-08T19:26:48.603250+0000","last_active":"2023-11-08T19:26:50.448153+0000","last_peered":"2023-11-08T19:26:50.448153+0000","last_clean":"2023-11-08T19:26:50.448153+0000","last_became_active":"2023-11-08T19:26:48.602946+0000","last_became_peered":"2023-11-08T19:26:48.602946+0000","last_unstale":"2023-11-08T19:26:50.448153+0000","last_undegraded":"2023-11-08T19:26:50.448153+0000","last_fullsized":"2023-11-08T19:26:50.448153+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_clean_scrub_stamp":"2023-11-08T19:26:47.569818+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:08:18.412447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":64,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.127384+0000","last_change":"2023-11-08T19:24:32.333096+0000","last_active":"2023-11-08T19:26:49.127384+0000","last_peered":"2023-11-08T19:26:49.127384+0000","last_clean":"2023-11-08T19:26:49.127384+0000","last_became_active":"2023-11-08T19:24:31.142985+0000","last_became_peered":"2023-11-08T19:24:31.142985+0000","last_unstale":"2023-11-08T19:26:49.127384+0000","last_undegraded":"2023-11-08T19:26:49.127384+0000","last_fullsized":"2023-11-08T19:26:49.127384+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:36:33.274496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000386048,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.134852+0000","last_change":"2023-11-08T19:25:48.372963+0000","last_active":"2023-11-08T19:26:49.134852+0000","last_peered":"2023-11-08T19:26:49.134852+0000","last_clean":"2023-11-08T19:26:49.134852+0000","last_became_active":"2023-11-08T19:25:46.283263+0000","last_became_peered":"2023-11-08T19:25:46.283263+0000","last_unstale":"2023-11-08T19:26:49.134852+0000","last_undegraded":"2023-11-08T19:26:49.134852+0000","last_fullsized":"2023-11-08T19:26:49.134852+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:25:34.010085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019848779999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":31,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.134727+0000","last_change":"2023-11-08T19:25:47.284816+0000","last_active":"2023-11-08T19:26:49.134727+0000","last_peered":"2023-11-08T19:26:49.134727+0000","last_clean":"2023-11-08T19:26:49.134727+0000","last_became_active":"2023-11-08T19:25:47.284522+0000","last_became_peered":"2023-11-08T19:25:47.284522+0000","last_unstale":"2023-11-08T19:26:49.134727+0000","last_undegraded":"2023-11-08T19:26:49.134727+0000","last_fullsized":"2023-11-08T19:26:49.134727+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:39:28.223686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.132338+0000","last_change":"2023-11-08T19:26:49.141787+0000","last_active":"2023-11-08T19:26:50.132338+0000","last_peered":"2023-11-08T19:26:50.132338+0000","last_clean":"2023-11-08T19:26:50.132338+0000","last_became_active":"2023-11-08T19:26:49.141417+0000","last_became_peered":"2023-11-08T19:26:49.141417+0000","last_unstale":"2023-11-08T19:26:50.132338+0000","last_undegraded":"2023-11-08T19:26:50.132338+0000","last_fullsized":"2023-11-08T19:26:50.132338+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:38:09.479582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"95'1","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.595825+0000","last_change":"2023-11-08T19:26:48.602448+0000","last_active":"2023-11-08T19:26:49.595825+0000","last_peered":"2023-11-08T19:26:49.595825+0000","last_clean":"2023-11-08T19:26:49.595825+0000","last_became_active":"2023-11-08T19:26:48.602137+0000","last_became_peered":"2023-11-08T19:26:48.602137+0000","last_unstale":"2023-11-08T19:26:49.595825+0000","last_undegraded":"2023-11-08T19:26:49.595825+0000","last_fullsized":"2023-11-08T19:26:49.595825+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_clean_scrub_stamp":"2023-11-08T19:26:47.569818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:56:49.852638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.134931+0000","last_change":"2023-11-08T19:24:32.530333+0000","last_active":"2023-11-08T19:26:49.134931+0000","last_peered":"2023-11-08T19:26:49.134931+0000","last_clean":"2023-11-08T19:26:49.134931+0000","last_became_active":"2023-11-08T19:24:31.144838+0000","last_became_peered":"2023-11-08T19:24:31.144838+0000","last_unstale":"2023-11-08T19:26:49.134931+0000","last_undegraded":"2023-11-08T19:26:49.134931+0000","last_fullsized":"2023-11-08T19:26:49.134931+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:39:48.473183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081588799999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.132103+0000","last_change":"2023-11-08T19:25:48.284699+0000","last_active":"2023-11-08T19:26:49.132103+0000","last_peered":"2023-11-08T19:26:49.132103+0000","last_clean":"2023-11-08T19:26:49.132103+0000","last_became_active":"2023-11-08T19:25:46.285588+0000","last_became_peered":"2023-11-08T19:25:46.285588+0000","last_unstale":"2023-11-08T19:26:49.132103+0000","last_undegraded":"2023-11-08T19:26:49.132103+0000","last_fullsized":"2023-11-08T19:26:49.132103+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:43:02.001903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023282350000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":31,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.134771+0000","last_change":"2023-11-08T19:25:47.283526+0000","last_active":"2023-11-08T19:26:49.134771+0000","last_peered":"2023-11-08T19:26:49.134771+0000","last_clean":"2023-11-08T19:26:49.134771+0000","last_became_active":"2023-11-08T19:25:47.283266+0000","last_became_peered":"2023-11-08T19:25:47.283266+0000","last_unstale":"2023-11-08T19:26:49.134771+0000","last_undegraded":"2023-11-08T19:26:49.134771+0000","last_fullsized":"2023-11-08T19:26:49.134771+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:35:31.433056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.288613+0000","last_change":"2023-11-08T19:26:49.146115+0000","last_active":"2023-11-08T19:26:50.288613+0000","last_peered":"2023-11-08T19:26:50.288613+0000","last_clean":"2023-11-08T19:26:50.288613+0000","last_became_active":"2023-11-08T19:26:49.145895+0000","last_became_peered":"2023-11-08T19:26:49.145895+0000","last_unstale":"2023-11-08T19:26:50.288613+0000","last_undegraded":"2023-11-08T19:26:50.288613+0000","last_fullsized":"2023-11-08T19:26:50.288613+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:43:29.378700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.130414+0000","last_change":"2023-11-08T19:26:48.606980+0000","last_active":"2023-11-08T19:26:50.130414+0000","last_peered":"2023-11-08T19:26:50.130414+0000","last_clean":"2023-11-08T19:26:50.130414+0000","last_became_active":"2023-11-08T19:26:48.606679+0000","last_became_peered":"2023-11-08T19:26:48.606679+0000","last_unstale":"2023-11-08T19:26:50.130414+0000","last_undegraded":"2023-11-08T19:26:50.130414+0000","last_fullsized":"2023-11-08T19:26:50.130414+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_clean_scrub_stamp":"2023-11-08T19:26:47.569818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:54:43.089103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":64,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.127930+0000","last_change":"2023-11-08T19:24:32.333430+0000","last_active":"2023-11-08T19:26:49.127930+0000","last_peered":"2023-11-08T19:26:49.127930+0000","last_clean":"2023-11-08T19:26:49.127930+0000","last_became_active":"2023-11-08T19:24:31.141710+0000","last_became_peered":"2023-11-08T19:24:31.141710+0000","last_unstale":"2023-11-08T19:26:49.127930+0000","last_undegraded":"2023-11-08T19:26:49.127930+0000","last_fullsized":"2023-11-08T19:26:49.127930+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:32:51.214551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000430438,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.133064+0000","last_change":"2023-11-08T19:25:48.283855+0000","last_active":"2023-11-08T19:26:49.133064+0000","last_peered":"2023-11-08T19:26:49.133064+0000","last_clean":"2023-11-08T19:26:49.133064+0000","last_became_active":"2023-11-08T19:25:46.273336+0000","last_became_peered":"2023-11-08T19:25:46.273336+0000","last_unstale":"2023-11-08T19:26:49.133064+0000","last_undegraded":"2023-11-08T19:26:49.133064+0000","last_fullsized":"2023-11-08T19:26:49.133064+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:33:35.492889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092577200000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.131351+0000","last_change":"2023-11-08T19:25:47.282840+0000","last_active":"2023-11-08T19:26:49.131351+0000","last_peered":"2023-11-08T19:26:49.131351+0000","last_clean":"2023-11-08T19:26:49.131351+0000","last_became_active":"2023-11-08T19:25:47.282600+0000","last_became_peered":"2023-11-08T19:25:47.282600+0000","last_unstale":"2023-11-08T19:26:49.131351+0000","last_undegraded":"2023-11-08T19:26:49.131351+0000","last_fullsized":"2023-11-08T19:26:49.131351+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:53:37.482245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.447838+0000","last_change":"2023-11-08T19:26:49.142299+0000","last_active":"2023-11-08T19:26:50.447838+0000","last_peered":"2023-11-08T19:26:50.447838+0000","last_clean":"2023-11-08T19:26:50.447838+0000","last_became_active":"2023-11-08T19:26:49.142002+0000","last_became_peered":"2023-11-08T19:26:49.142002+0000","last_unstale":"2023-11-08T19:26:50.447838+0000","last_undegraded":"2023-11-08T19:26:50.447838+0000","last_fullsized":"2023-11-08T19:26:50.447838+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:27:39.006698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.288606+0000","last_change":"2023-11-08T19:26:48.607415+0000","last_active":"2023-11-08T19:26:50.288606+0000","last_peered":"2023-11-08T19:26:50.288606+0000","last_clean":"2023-11-08T19:26:50.288606+0000","last_became_active":"2023-11-08T19:26:48.607080+0000","last_became_peered":"2023-11-08T19:26:48.607080+0000","last_unstale":"2023-11-08T19:26:50.288606+0000","last_undegraded":"2023-11-08T19:26:50.288606+0000","last_fullsized":"2023-11-08T19:26:50.288606+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_clean_scrub_stamp":"2023-11-08T19:26:47.569818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:58:01.414094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.130504+0000","last_change":"2023-11-08T19:25:47.285890+0000","last_active":"2023-11-08T19:26:49.130504+0000","last_peered":"2023-11-08T19:26:49.130504+0000","last_clean":"2023-11-08T19:26:49.130504+0000","last_became_active":"2023-11-08T19:25:47.285641+0000","last_became_peered":"2023-11-08T19:25:47.285641+0000","last_unstale":"2023-11-08T19:26:49.130504+0000","last_undegraded":"2023-11-08T19:26:49.130504+0000","last_fullsized":"2023-11-08T19:26:49.130504+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:27:18.335142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.136387+0000","last_change":"2023-11-08T19:24:32.530895+0000","last_active":"2023-11-08T19:26:49.136387+0000","last_peered":"2023-11-08T19:26:49.136387+0000","last_clean":"2023-11-08T19:26:49.136387+0000","last_became_active":"2023-11-08T19:24:31.146715+0000","last_became_peered":"2023-11-08T19:24:31.146715+0000","last_unstale":"2023-11-08T19:26:49.136387+0000","last_undegraded":"2023-11-08T19:26:49.136387+0000","last_fullsized":"2023-11-08T19:26:49.136387+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:39.214888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081671599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.131514+0000","last_change":"2023-11-08T19:25:48.284137+0000","last_active":"2023-11-08T19:26:49.131514+0000","last_peered":"2023-11-08T19:26:49.131514+0000","last_clean":"2023-11-08T19:26:49.131514+0000","last_became_active":"2023-11-08T19:25:46.285960+0000","last_became_peered":"2023-11-08T19:25:46.285960+0000","last_unstale":"2023-11-08T19:26:49.131514+0000","last_undegraded":"2023-11-08T19:26:49.131514+0000","last_fullsized":"2023-11-08T19:26:49.131514+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:26:01.141206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091649099999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.288904+0000","last_change":"2023-11-08T19:26:49.141444+0000","last_active":"2023-11-08T19:26:50.288904+0000","last_peered":"2023-11-08T19:26:50.288904+0000","last_clean":"2023-11-08T19:26:50.288904+0000","last_became_active":"2023-11-08T19:26:49.141179+0000","last_became_peered":"2023-11-08T19:26:49.141179+0000","last_unstale":"2023-11-08T19:26:50.288904+0000","last_undegraded":"2023-11-08T19:26:50.288904+0000","last_fullsized":"2023-11-08T19:26:50.288904+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:10:24.255286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"95'1","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.448159+0000","last_change":"2023-11-08T19:26:48.609017+0000","last_active":"2023-11-08T19:26:50.448159+0000","last_peered":"2023-11-08T19:26:50.448159+0000","last_clean":"2023-11-08T19:26:50.448159+0000","last_became_active":"2023-11-08T19:26:48.608780+0000","last_became_peered":"2023-11-08T19:26:48.608780+0000","last_unstale":"2023-11-08T19:26:50.448159+0000","last_undegraded":"2023-11-08T19:26:50.448159+0000","last_fullsized":"2023-11-08T19:26:50.448159+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_clean_scrub_stamp":"2023-11-08T19:26:47.569818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:16:26.682818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.130982+0000","last_change":"2023-11-08T19:25:47.283642+0000","last_active":"2023-11-08T19:26:49.130982+0000","last_peered":"2023-11-08T19:26:49.130982+0000","last_clean":"2023-11-08T19:26:49.130982+0000","last_became_active":"2023-11-08T19:25:47.283360+0000","last_became_peered":"2023-11-08T19:25:47.283360+0000","last_unstale":"2023-11-08T19:26:49.130982+0000","last_undegraded":"2023-11-08T19:26:49.130982+0000","last_fullsized":"2023-11-08T19:26:49.130982+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:02:27.950152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":70,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.131619+0000","last_change":"2023-11-08T19:24:32.140167+0000","last_active":"2023-11-08T19:26:49.131619+0000","last_peered":"2023-11-08T19:26:49.131619+0000","last_clean":"2023-11-08T19:26:49.131619+0000","last_became_active":"2023-11-08T19:24:31.147181+0000","last_became_peered":"2023-11-08T19:24:31.147181+0000","last_unstale":"2023-11-08T19:26:49.131619+0000","last_undegraded":"2023-11-08T19:26:49.131619+0000","last_fullsized":"2023-11-08T19:26:49.131619+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:26.080042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057135200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.134912+0000","last_change":"2023-11-08T19:25:48.277705+0000","last_active":"2023-11-08T19:26:49.134912+0000","last_peered":"2023-11-08T19:26:49.134912+0000","last_clean":"2023-11-08T19:26:49.134912+0000","last_became_active":"2023-11-08T19:25:46.288848+0000","last_became_peered":"2023-11-08T19:25:46.288848+0000","last_unstale":"2023-11-08T19:26:49.134912+0000","last_undegraded":"2023-11-08T19:26:49.134912+0000","last_fullsized":"2023-11-08T19:26:49.134912+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:12:24.483185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097653099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.130632+0000","last_change":"2023-11-08T19:26:49.146440+0000","last_active":"2023-11-08T19:26:50.130632+0000","last_peered":"2023-11-08T19:26:50.130632+0000","last_clean":"2023-11-08T19:26:50.130632+0000","last_became_active":"2023-11-08T19:26:49.145628+0000","last_became_peered":"2023-11-08T19:26:49.145628+0000","last_unstale":"2023-11-08T19:26:50.130632+0000","last_undegraded":"2023-11-08T19:26:50.130632+0000","last_fullsized":"2023-11-08T19:26:50.130632+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:51:25.212618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"95'1","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.448426+0000","last_change":"2023-11-08T19:26:48.610661+0000","last_active":"2023-11-08T19:26:50.448426+0000","last_peered":"2023-11-08T19:26:50.448426+0000","last_clean":"2023-11-08T19:26:50.448426+0000","last_became_active":"2023-11-08T19:26:48.610400+0000","last_became_peered":"2023-11-08T19:26:48.610400+0000","last_unstale":"2023-11-08T19:26:50.448426+0000","last_undegraded":"2023-11-08T19:26:50.448426+0000","last_fullsized":"2023-11-08T19:26:50.448426+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_clean_scrub_stamp":"2023-11-08T19:26:47.569818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:38:08.472024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":28,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-08T19:26:48.597820+0000","last_change":"2023-11-08T19:25:47.289456+0000","last_active":"2023-11-08T19:26:48.597820+0000","last_peered":"2023-11-08T19:26:48.597820+0000","last_clean":"2023-11-08T19:26:48.597820+0000","last_became_active":"2023-11-08T19:25:47.289177+0000","last_became_peered":"2023-11-08T19:25:47.289177+0000","last_unstale":"2023-11-08T19:26:48.597820+0000","last_undegraded":"2023-11-08T19:26:48.597820+0000","last_fullsized":"2023-11-08T19:26:48.597820+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:07:11.838364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":70,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.132930+0000","last_change":"2023-11-08T19:24:32.141188+0000","last_active":"2023-11-08T19:26:49.132930+0000","last_peered":"2023-11-08T19:26:49.132930+0000","last_clean":"2023-11-08T19:26:49.132930+0000","last_became_active":"2023-11-08T19:24:31.148857+0000","last_became_peered":"2023-11-08T19:24:31.148857+0000","last_unstale":"2023-11-08T19:26:49.132930+0000","last_undegraded":"2023-11-08T19:26:49.132930+0000","last_fullsized":"2023-11-08T19:26:49.132930+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:45:34.425432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065078599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.135359+0000","last_change":"2023-11-08T19:25:48.277423+0000","last_active":"2023-11-08T19:26:49.135359+0000","last_peered":"2023-11-08T19:26:49.135359+0000","last_clean":"2023-11-08T19:26:49.135359+0000","last_became_active":"2023-11-08T19:25:46.286211+0000","last_became_peered":"2023-11-08T19:25:46.286211+0000","last_unstale":"2023-11-08T19:26:49.135359+0000","last_undegraded":"2023-11-08T19:26:49.135359+0000","last_fullsized":"2023-11-08T19:26:49.135359+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:44:05.347800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073775700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.289192+0000","last_change":"2023-11-08T19:26:49.146600+0000","last_active":"2023-11-08T19:26:50.289192+0000","last_peered":"2023-11-08T19:26:50.289192+0000","last_clean":"2023-11-08T19:26:50.289192+0000","last_became_active":"2023-11-08T19:26:49.146400+0000","last_became_peered":"2023-11-08T19:26:49.146400+0000","last_unstale":"2023-11-08T19:26:50.289192+0000","last_undegraded":"2023-11-08T19:26:50.289192+0000","last_fullsized":"2023-11-08T19:26:50.289192+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:55:43.751284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.289416+0000","last_change":"2023-11-08T19:26:48.601104+0000","last_active":"2023-11-08T19:26:50.289416+0000","last_peered":"2023-11-08T19:26:50.289416+0000","last_clean":"2023-11-08T19:26:50.289416+0000","last_became_active":"2023-11-08T19:26:48.600826+0000","last_became_peered":"2023-11-08T19:26:48.600826+0000","last_unstale":"2023-11-08T19:26:50.289416+0000","last_undegraded":"2023-11-08T19:26:50.289416+0000","last_fullsized":"2023-11-08T19:26:50.289416+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_clean_scrub_stamp":"2023-11-08T19:26:47.569818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:15:49.938251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":28,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-08T19:26:48.597876+0000","last_change":"2023-11-08T19:25:47.286020+0000","last_active":"2023-11-08T19:26:48.597876+0000","last_peered":"2023-11-08T19:26:48.597876+0000","last_clean":"2023-11-08T19:26:48.597876+0000","last_became_active":"2023-11-08T19:25:47.285728+0000","last_became_peered":"2023-11-08T19:25:47.285728+0000","last_unstale":"2023-11-08T19:26:48.597876+0000","last_undegraded":"2023-11-08T19:26:48.597876+0000","last_fullsized":"2023-11-08T19:26:48.597876+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:26:02.147090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":70,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.132034+0000","last_change":"2023-11-08T19:24:32.140832+0000","last_active":"2023-11-08T19:26:50.132034+0000","last_peered":"2023-11-08T19:26:50.132034+0000","last_clean":"2023-11-08T19:26:50.132034+0000","last_became_active":"2023-11-08T19:24:31.146557+0000","last_became_peered":"2023-11-08T19:24:31.146557+0000","last_unstale":"2023-11-08T19:26:50.132034+0000","last_undegraded":"2023-11-08T19:26:50.132034+0000","last_fullsized":"2023-11-08T19:26:50.132034+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:40:04.258107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099450100000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.134787+0000","last_change":"2023-11-08T19:25:48.372913+0000","last_active":"2023-11-08T19:26:49.134787+0000","last_peered":"2023-11-08T19:26:49.134787+0000","last_clean":"2023-11-08T19:26:49.134787+0000","last_became_active":"2023-11-08T19:25:46.281273+0000","last_became_peered":"2023-11-08T19:25:46.281273+0000","last_unstale":"2023-11-08T19:26:49.134787+0000","last_undegraded":"2023-11-08T19:26:49.134787+0000","last_fullsized":"2023-11-08T19:26:49.134787+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:07:10.832480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020904819999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.132085+0000","last_change":"2023-11-08T19:26:49.144781+0000","last_active":"2023-11-08T19:26:50.132085+0000","last_peered":"2023-11-08T19:26:50.132085+0000","last_clean":"2023-11-08T19:26:50.132085+0000","last_became_active":"2023-11-08T19:26:49.144490+0000","last_became_peered":"2023-11-08T19:26:49.144490+0000","last_unstale":"2023-11-08T19:26:50.132085+0000","last_undegraded":"2023-11-08T19:26:50.132085+0000","last_fullsized":"2023-11-08T19:26:50.132085+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:50:23.420859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.448726+0000","last_change":"2023-11-08T19:26:48.615880+0000","last_active":"2023-11-08T19:26:50.448726+0000","last_peered":"2023-11-08T19:26:50.448726+0000","last_clean":"2023-11-08T19:26:50.448726+0000","last_became_active":"2023-11-08T19:26:48.615681+0000","last_became_peered":"2023-11-08T19:26:48.615681+0000","last_unstale":"2023-11-08T19:26:50.448726+0000","last_undegraded":"2023-11-08T19:26:50.448726+0000","last_fullsized":"2023-11-08T19:26:50.448726+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_clean_scrub_stamp":"2023-11-08T19:26:47.569818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:22:48.262249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":30,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.136130+0000","last_change":"2023-11-08T19:25:47.288256+0000","last_active":"2023-11-08T19:26:49.136130+0000","last_peered":"2023-11-08T19:26:49.136130+0000","last_clean":"2023-11-08T19:26:49.136130+0000","last_became_active":"2023-11-08T19:25:47.287905+0000","last_became_peered":"2023-11-08T19:25:47.287905+0000","last_unstale":"2023-11-08T19:26:49.136130+0000","last_undegraded":"2023-11-08T19:26:49.136130+0000","last_fullsized":"2023-11-08T19:26:49.136130+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:50:12.309248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":61,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.289113+0000","last_change":"2023-11-08T19:24:32.530378+0000","last_active":"2023-11-08T19:26:50.289113+0000","last_peered":"2023-11-08T19:26:50.289113+0000","last_clean":"2023-11-08T19:26:50.289113+0000","last_became_active":"2023-11-08T19:24:31.144341+0000","last_became_peered":"2023-11-08T19:24:31.144341+0000","last_unstale":"2023-11-08T19:26:50.289113+0000","last_undegraded":"2023-11-08T19:26:50.289113+0000","last_fullsized":"2023-11-08T19:26:50.289113+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:30:21.946303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058308299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.130911+0000","last_change":"2023-11-08T19:25:48.277150+0000","last_active":"2023-11-08T19:26:49.130911+0000","last_peered":"2023-11-08T19:26:49.130911+0000","last_clean":"2023-11-08T19:26:49.130911+0000","last_became_active":"2023-11-08T19:25:46.286933+0000","last_became_peered":"2023-11-08T19:25:46.286933+0000","last_unstale":"2023-11-08T19:26:49.130911+0000","last_undegraded":"2023-11-08T19:26:49.130911+0000","last_fullsized":"2023-11-08T19:26:49.130911+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:38:38.890354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080507500000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.131858+0000","last_change":"2023-11-08T19:26:49.144657+0000","last_active":"2023-11-08T19:26:50.131858+0000","last_peered":"2023-11-08T19:26:50.131858+0000","last_clean":"2023-11-08T19:26:50.131858+0000","last_became_active":"2023-11-08T19:26:49.144370+0000","last_became_peered":"2023-11-08T19:26:49.144370+0000","last_unstale":"2023-11-08T19:26:50.131858+0000","last_undegraded":"2023-11-08T19:26:50.131858+0000","last_fullsized":"2023-11-08T19:26:50.131858+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:17:55.740401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"95'2","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.449149+0000","last_change":"2023-11-08T19:26:48.608150+0000","last_active":"2023-11-08T19:26:50.449149+0000","last_peered":"2023-11-08T19:26:50.449149+0000","last_clean":"2023-11-08T19:26:50.449149+0000","last_became_active":"2023-11-08T19:26:48.607838+0000","last_became_peered":"2023-11-08T19:26:48.607838+0000","last_unstale":"2023-11-08T19:26:50.449149+0000","last_undegraded":"2023-11-08T19:26:50.449149+0000","last_fullsized":"2023-11-08T19:26:50.449149+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_clean_scrub_stamp":"2023-11-08T19:26:47.569818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:38:52.153674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.134195+0000","last_change":"2023-11-08T19:25:47.282986+0000","last_active":"2023-11-08T19:26:49.134195+0000","last_peered":"2023-11-08T19:26:49.134195+0000","last_clean":"2023-11-08T19:26:49.134195+0000","last_became_active":"2023-11-08T19:25:47.282705+0000","last_became_peered":"2023-11-08T19:25:47.282705+0000","last_unstale":"2023-11-08T19:26:49.134195+0000","last_undegraded":"2023-11-08T19:26:49.134195+0000","last_fullsized":"2023-11-08T19:26:49.134195+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:34:17.838942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":61,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.447799+0000","last_change":"2023-11-08T19:24:32.544108+0000","last_active":"2023-11-08T19:26:50.447799+0000","last_peered":"2023-11-08T19:26:50.447799+0000","last_clean":"2023-11-08T19:26:50.447799+0000","last_became_active":"2023-11-08T19:24:31.143812+0000","last_became_peered":"2023-11-08T19:24:31.143812+0000","last_unstale":"2023-11-08T19:26:50.447799+0000","last_undegraded":"2023-11-08T19:26:50.447799+0000","last_fullsized":"2023-11-08T19:26:50.447799+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:27:59.135977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014956126,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.131514+0000","last_change":"2023-11-08T19:25:48.284435+0000","last_active":"2023-11-08T19:26:49.131514+0000","last_peered":"2023-11-08T19:26:49.131514+0000","last_clean":"2023-11-08T19:26:49.131514+0000","last_became_active":"2023-11-08T19:25:46.284288+0000","last_became_peered":"2023-11-08T19:25:46.284288+0000","last_unstale":"2023-11-08T19:26:49.131514+0000","last_undegraded":"2023-11-08T19:26:49.131514+0000","last_fullsized":"2023-11-08T19:26:49.131514+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:57:53.083448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001250894,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.289705+0000","last_change":"2023-11-08T19:26:49.148728+0000","last_active":"2023-11-08T19:26:50.289705+0000","last_peered":"2023-11-08T19:26:50.289705+0000","last_clean":"2023-11-08T19:26:50.289705+0000","last_became_active":"2023-11-08T19:26:49.148473+0000","last_became_peered":"2023-11-08T19:26:49.148473+0000","last_unstale":"2023-11-08T19:26:50.289705+0000","last_undegraded":"2023-11-08T19:26:50.289705+0000","last_fullsized":"2023-11-08T19:26:50.289705+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:13:12.906471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.131964+0000","last_change":"2023-11-08T19:26:48.601794+0000","last_active":"2023-11-08T19:26:50.131964+0000","last_peered":"2023-11-08T19:26:50.131964+0000","last_clean":"2023-11-08T19:26:50.131964+0000","last_became_active":"2023-11-08T19:26:48.601483+0000","last_became_peered":"2023-11-08T19:26:48.601483+0000","last_unstale":"2023-11-08T19:26:50.131964+0000","last_undegraded":"2023-11-08T19:26:50.131964+0000","last_fullsized":"2023-11-08T19:26:50.131964+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_clean_scrub_stamp":"2023-11-08T19:26:47.569818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:33:13.122725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.131429+0000","last_change":"2023-11-08T19:25:47.282612+0000","last_active":"2023-11-08T19:26:49.131429+0000","last_peered":"2023-11-08T19:26:49.131429+0000","last_clean":"2023-11-08T19:26:49.131429+0000","last_became_active":"2023-11-08T19:25:47.282299+0000","last_became_peered":"2023-11-08T19:25:47.282299+0000","last_unstale":"2023-11-08T19:26:49.131429+0000","last_undegraded":"2023-11-08T19:26:49.131429+0000","last_fullsized":"2023-11-08T19:26:49.131429+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:43:18.319773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":59,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.134182+0000","last_change":"2023-11-08T19:24:32.146639+0000","last_active":"2023-11-08T19:26:49.134182+0000","last_peered":"2023-11-08T19:26:49.134182+0000","last_clean":"2023-11-08T19:26:49.134182+0000","last_became_active":"2023-11-08T19:24:31.147384+0000","last_became_peered":"2023-11-08T19:24:31.147384+0000","last_unstale":"2023-11-08T19:26:49.134182+0000","last_undegraded":"2023-11-08T19:26:49.134182+0000","last_fullsized":"2023-11-08T19:26:49.134182+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:30:21.946303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043834899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.131970+0000","last_change":"2023-11-08T19:25:48.283541+0000","last_active":"2023-11-08T19:26:49.131970+0000","last_peered":"2023-11-08T19:26:49.131970+0000","last_clean":"2023-11-08T19:26:49.131970+0000","last_became_active":"2023-11-08T19:25:46.285626+0000","last_became_peered":"2023-11-08T19:25:46.285626+0000","last_unstale":"2023-11-08T19:26:49.131970+0000","last_undegraded":"2023-11-08T19:26:49.131970+0000","last_fullsized":"2023-11-08T19:26:49.131970+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:48:17.033319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019032459999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.152978+0000","last_change":"2023-11-08T19:26:49.146461+0000","last_active":"2023-11-08T19:26:49.152978+0000","last_peered":"2023-11-08T19:26:49.152978+0000","last_clean":"2023-11-08T19:26:49.152978+0000","last_became_active":"2023-11-08T19:26:49.141785+0000","last_became_peered":"2023-11-08T19:26:49.141785+0000","last_unstale":"2023-11-08T19:26:49.152978+0000","last_undegraded":"2023-11-08T19:26:49.152978+0000","last_fullsized":"2023-11-08T19:26:49.152978+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:54:36.305399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.128983+0000","last_change":"2023-11-08T19:26:48.615391+0000","last_active":"2023-11-08T19:26:50.128983+0000","last_peered":"2023-11-08T19:26:50.128983+0000","last_clean":"2023-11-08T19:26:50.128983+0000","last_became_active":"2023-11-08T19:26:48.615117+0000","last_became_peered":"2023-11-08T19:26:48.615117+0000","last_unstale":"2023-11-08T19:26:50.128983+0000","last_undegraded":"2023-11-08T19:26:50.128983+0000","last_fullsized":"2023-11-08T19:26:50.128983+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_clean_scrub_stamp":"2023-11-08T19:26:47.569818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:50:38.526254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.131227+0000","last_change":"2023-11-08T19:25:47.287878+0000","last_active":"2023-11-08T19:26:49.131227+0000","last_peered":"2023-11-08T19:26:49.131227+0000","last_clean":"2023-11-08T19:26:49.131227+0000","last_became_active":"2023-11-08T19:25:47.287617+0000","last_became_peered":"2023-11-08T19:25:47.287617+0000","last_unstale":"2023-11-08T19:26:49.131227+0000","last_undegraded":"2023-11-08T19:26:49.131227+0000","last_fullsized":"2023-11-08T19:26:49.131227+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:20:50.791463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":70,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.131298+0000","last_change":"2023-11-08T19:24:32.142376+0000","last_active":"2023-11-08T19:26:49.131298+0000","last_peered":"2023-11-08T19:26:49.131298+0000","last_clean":"2023-11-08T19:26:49.131298+0000","last_became_active":"2023-11-08T19:24:31.144614+0000","last_became_peered":"2023-11-08T19:24:31.144614+0000","last_unstale":"2023-11-08T19:26:49.131298+0000","last_undegraded":"2023-11-08T19:26:49.131298+0000","last_fullsized":"2023-11-08T19:26:49.131298+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:09:04.880374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050362200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.130311+0000","last_change":"2023-11-08T19:25:48.373636+0000","last_active":"2023-11-08T19:26:49.130311+0000","last_peered":"2023-11-08T19:26:49.130311+0000","last_clean":"2023-11-08T19:26:49.130311+0000","last_became_active":"2023-11-08T19:25:46.283803+0000","last_became_peered":"2023-11-08T19:25:46.283803+0000","last_unstale":"2023-11-08T19:26:49.130311+0000","last_undegraded":"2023-11-08T19:26:49.130311+0000","last_fullsized":"2023-11-08T19:26:49.130311+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:00:34.691748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002404855,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.288724+0000","last_change":"2023-11-08T19:26:49.146632+0000","last_active":"2023-11-08T19:26:50.288724+0000","last_peered":"2023-11-08T19:26:50.288724+0000","last_clean":"2023-11-08T19:26:50.288724+0000","last_became_active":"2023-11-08T19:26:49.146374+0000","last_became_peered":"2023-11-08T19:26:49.146374+0000","last_unstale":"2023-11-08T19:26:50.288724+0000","last_undegraded":"2023-11-08T19:26:50.288724+0000","last_fullsized":"2023-11-08T19:26:50.288724+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:04:21.182881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.288743+0000","last_change":"2023-11-08T19:26:48.605537+0000","last_active":"2023-11-08T19:26:50.288743+0000","last_peered":"2023-11-08T19:26:50.288743+0000","last_clean":"2023-11-08T19:26:50.288743+0000","last_became_active":"2023-11-08T19:26:48.601422+0000","last_became_peered":"2023-11-08T19:26:48.601422+0000","last_unstale":"2023-11-08T19:26:50.288743+0000","last_undegraded":"2023-11-08T19:26:50.288743+0000","last_fullsized":"2023-11-08T19:26:50.288743+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_clean_scrub_stamp":"2023-11-08T19:26:47.569818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:21:13.057813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":28,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-08T19:26:48.598249+0000","last_change":"2023-11-08T19:25:47.287741+0000","last_active":"2023-11-08T19:26:48.598249+0000","last_peered":"2023-11-08T19:26:48.598249+0000","last_clean":"2023-11-08T19:26:48.598249+0000","last_became_active":"2023-11-08T19:25:47.287428+0000","last_became_peered":"2023-11-08T19:25:47.287428+0000","last_unstale":"2023-11-08T19:26:48.598249+0000","last_undegraded":"2023-11-08T19:26:48.598249+0000","last_fullsized":"2023-11-08T19:26:48.598249+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:38:55.785104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":58,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-08T19:26:48.597965+0000","last_change":"2023-11-08T19:24:32.147235+0000","last_active":"2023-11-08T19:26:48.597965+0000","last_peered":"2023-11-08T19:26:48.597965+0000","last_clean":"2023-11-08T19:26:48.597965+0000","last_became_active":"2023-11-08T19:24:31.146176+0000","last_became_peered":"2023-11-08T19:24:31.146176+0000","last_unstale":"2023-11-08T19:26:48.597965+0000","last_undegraded":"2023-11-08T19:26:48.597965+0000","last_fullsized":"2023-11-08T19:26:48.597965+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:39.214888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048481000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.131579+0000","last_change":"2023-11-08T19:25:48.373345+0000","last_active":"2023-11-08T19:26:49.131579+0000","last_peered":"2023-11-08T19:26:49.131579+0000","last_clean":"2023-11-08T19:26:49.131579+0000","last_became_active":"2023-11-08T19:25:46.282460+0000","last_became_peered":"2023-11-08T19:25:46.282460+0000","last_unstale":"2023-11-08T19:26:49.131579+0000","last_undegraded":"2023-11-08T19:26:49.131579+0000","last_fullsized":"2023-11-08T19:26:49.131579+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:25:30.927920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001972863,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.130297+0000","last_change":"2023-11-08T19:26:49.144522+0000","last_active":"2023-11-08T19:26:50.130297+0000","last_peered":"2023-11-08T19:26:50.130297+0000","last_clean":"2023-11-08T19:26:50.130297+0000","last_became_active":"2023-11-08T19:26:49.144202+0000","last_became_peered":"2023-11-08T19:26:49.144202+0000","last_unstale":"2023-11-08T19:26:50.130297+0000","last_undegraded":"2023-11-08T19:26:50.130297+0000","last_fullsized":"2023-11-08T19:26:50.130297+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:58:35.156133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.447935+0000","last_change":"2023-11-08T19:26:48.600457+0000","last_active":"2023-11-08T19:26:50.447935+0000","last_peered":"2023-11-08T19:26:50.447935+0000","last_clean":"2023-11-08T19:26:50.447935+0000","last_became_active":"2023-11-08T19:26:48.600174+0000","last_became_peered":"2023-11-08T19:26:48.600174+0000","last_unstale":"2023-11-08T19:26:50.447935+0000","last_undegraded":"2023-11-08T19:26:50.447935+0000","last_fullsized":"2023-11-08T19:26:50.447935+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_clean_scrub_stamp":"2023-11-08T19:26:47.569818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:54:43.089103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.131168+0000","last_change":"2023-11-08T19:25:47.283708+0000","last_active":"2023-11-08T19:26:49.131168+0000","last_peered":"2023-11-08T19:26:49.131168+0000","last_clean":"2023-11-08T19:26:49.131168+0000","last_became_active":"2023-11-08T19:25:47.283433+0000","last_became_peered":"2023-11-08T19:25:47.283433+0000","last_unstale":"2023-11-08T19:26:49.131168+0000","last_undegraded":"2023-11-08T19:26:49.131168+0000","last_fullsized":"2023-11-08T19:26:49.131168+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:30:17.627967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":61,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.448942+0000","last_change":"2023-11-08T19:24:32.543880+0000","last_active":"2023-11-08T19:26:50.448942+0000","last_peered":"2023-11-08T19:26:50.448942+0000","last_clean":"2023-11-08T19:26:50.448942+0000","last_became_active":"2023-11-08T19:24:31.142052+0000","last_became_peered":"2023-11-08T19:24:31.142052+0000","last_unstale":"2023-11-08T19:26:50.448942+0000","last_undegraded":"2023-11-08T19:26:50.448942+0000","last_fullsized":"2023-11-08T19:26:50.448942+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:18:42.371676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014881058000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.136456+0000","last_change":"2023-11-08T19:25:48.284890+0000","last_active":"2023-11-08T19:26:49.136456+0000","last_peered":"2023-11-08T19:26:49.136456+0000","last_clean":"2023-11-08T19:26:49.136456+0000","last_became_active":"2023-11-08T19:25:46.279287+0000","last_became_peered":"2023-11-08T19:25:46.279287+0000","last_unstale":"2023-11-08T19:26:49.136456+0000","last_undegraded":"2023-11-08T19:26:49.136456+0000","last_fullsized":"2023-11-08T19:26:49.136456+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:35:30.427172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076856899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.130697+0000","last_change":"2023-11-08T19:26:49.136124+0000","last_active":"2023-11-08T19:26:50.130697+0000","last_peered":"2023-11-08T19:26:50.130697+0000","last_clean":"2023-11-08T19:26:50.130697+0000","last_became_active":"2023-11-08T19:26:49.135834+0000","last_became_peered":"2023-11-08T19:26:49.135834+0000","last_unstale":"2023-11-08T19:26:50.130697+0000","last_undegraded":"2023-11-08T19:26:50.130697+0000","last_fullsized":"2023-11-08T19:26:50.130697+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:15:11.670708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.130369+0000","last_change":"2023-11-08T19:26:48.606019+0000","last_active":"2023-11-08T19:26:50.130369+0000","last_peered":"2023-11-08T19:26:50.130369+0000","last_clean":"2023-11-08T19:26:50.130369+0000","last_became_active":"2023-11-08T19:26:48.605731+0000","last_became_peered":"2023-11-08T19:26:48.605731+0000","last_unstale":"2023-11-08T19:26:50.130369+0000","last_undegraded":"2023-11-08T19:26:50.130369+0000","last_fullsized":"2023-11-08T19:26:50.130369+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_clean_scrub_stamp":"2023-11-08T19:26:47.569818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:00:48.625310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.136284+0000","last_change":"2023-11-08T19:25:47.285867+0000","last_active":"2023-11-08T19:26:49.136284+0000","last_peered":"2023-11-08T19:26:49.136284+0000","last_clean":"2023-11-08T19:26:49.136284+0000","last_became_active":"2023-11-08T19:25:47.285533+0000","last_became_peered":"2023-11-08T19:25:47.285533+0000","last_unstale":"2023-11-08T19:26:49.136284+0000","last_undegraded":"2023-11-08T19:26:49.136284+0000","last_fullsized":"2023-11-08T19:26:49.136284+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:26:59.852338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":58,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-08T19:26:48.598985+0000","last_change":"2023-11-08T19:24:32.147011+0000","last_active":"2023-11-08T19:26:48.598985+0000","last_peered":"2023-11-08T19:26:48.598985+0000","last_clean":"2023-11-08T19:26:48.598985+0000","last_became_active":"2023-11-08T19:24:31.148250+0000","last_became_peered":"2023-11-08T19:24:31.148250+0000","last_unstale":"2023-11-08T19:26:48.598985+0000","last_undegraded":"2023-11-08T19:26:48.598985+0000","last_fullsized":"2023-11-08T19:26:48.598985+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:01:25.647952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043061299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.131256+0000","last_change":"2023-11-08T19:25:48.284869+0000","last_active":"2023-11-08T19:26:49.131256+0000","last_peered":"2023-11-08T19:26:49.131256+0000","last_clean":"2023-11-08T19:26:49.131256+0000","last_became_active":"2023-11-08T19:25:46.285478+0000","last_became_peered":"2023-11-08T19:25:46.285478+0000","last_unstale":"2023-11-08T19:26:49.131256+0000","last_undegraded":"2023-11-08T19:26:49.131256+0000","last_fullsized":"2023-11-08T19:26:49.131256+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:49:51.368808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000376339,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.161081+0000","last_change":"2023-11-08T19:26:49.154173+0000","last_active":"2023-11-08T19:26:49.161081+0000","last_peered":"2023-11-08T19:26:49.161081+0000","last_clean":"2023-11-08T19:26:49.161081+0000","last_became_active":"2023-11-08T19:26:49.153876+0000","last_became_peered":"2023-11-08T19:26:49.153876+0000","last_unstale":"2023-11-08T19:26:49.161081+0000","last_undegraded":"2023-11-08T19:26:49.161081+0000","last_fullsized":"2023-11-08T19:26:49.161081+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:14:02.380051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"95'1","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.132195+0000","last_change":"2023-11-08T19:26:48.606778+0000","last_active":"2023-11-08T19:26:50.132195+0000","last_peered":"2023-11-08T19:26:50.132195+0000","last_clean":"2023-11-08T19:26:50.132195+0000","last_became_active":"2023-11-08T19:26:48.606437+0000","last_became_peered":"2023-11-08T19:26:48.606437+0000","last_unstale":"2023-11-08T19:26:50.132195+0000","last_undegraded":"2023-11-08T19:26:50.132195+0000","last_fullsized":"2023-11-08T19:26:50.132195+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_clean_scrub_stamp":"2023-11-08T19:26:47.569818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:49:59.213557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.130833+0000","last_change":"2023-11-08T19:25:47.284429+0000","last_active":"2023-11-08T19:26:49.130833+0000","last_peered":"2023-11-08T19:26:49.130833+0000","last_clean":"2023-11-08T19:26:49.130833+0000","last_became_active":"2023-11-08T19:25:47.283990+0000","last_became_peered":"2023-11-08T19:25:47.283990+0000","last_unstale":"2023-11-08T19:26:49.130833+0000","last_undegraded":"2023-11-08T19:26:49.130833+0000","last_fullsized":"2023-11-08T19:26:49.130833+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:59:08.628317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":70,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.132184+0000","last_change":"2023-11-08T19:24:32.141190+0000","last_active":"2023-11-08T19:26:49.132184+0000","last_peered":"2023-11-08T19:26:49.132184+0000","last_clean":"2023-11-08T19:26:49.132184+0000","last_became_active":"2023-11-08T19:24:31.147651+0000","last_became_peered":"2023-11-08T19:24:31.147651+0000","last_unstale":"2023-11-08T19:26:49.132184+0000","last_undegraded":"2023-11-08T19:26:49.132184+0000","last_fullsized":"2023-11-08T19:26:49.132184+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:21:55.985548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043673300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.135510+0000","last_change":"2023-11-08T19:25:48.320707+0000","last_active":"2023-11-08T19:26:49.135510+0000","last_peered":"2023-11-08T19:26:49.135510+0000","last_clean":"2023-11-08T19:26:49.135510+0000","last_became_active":"2023-11-08T19:25:46.282307+0000","last_became_peered":"2023-11-08T19:25:46.282307+0000","last_unstale":"2023-11-08T19:26:49.135510+0000","last_undegraded":"2023-11-08T19:26:49.135510+0000","last_fullsized":"2023-11-08T19:26:49.135510+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:53:36.476361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047078400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.161037+0000","last_change":"2023-11-08T19:26:49.153625+0000","last_active":"2023-11-08T19:26:49.161037+0000","last_peered":"2023-11-08T19:26:49.161037+0000","last_clean":"2023-11-08T19:26:49.161037+0000","last_became_active":"2023-11-08T19:26:49.153361+0000","last_became_peered":"2023-11-08T19:26:49.153361+0000","last_unstale":"2023-11-08T19:26:49.161037+0000","last_undegraded":"2023-11-08T19:26:49.161037+0000","last_fullsized":"2023-11-08T19:26:49.161037+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:08:52.578249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.448157+0000","last_change":"2023-11-08T19:26:48.609568+0000","last_active":"2023-11-08T19:26:50.448157+0000","last_peered":"2023-11-08T19:26:50.448157+0000","last_clean":"2023-11-08T19:26:50.448157+0000","last_became_active":"2023-11-08T19:26:48.609373+0000","last_became_peered":"2023-11-08T19:26:48.609373+0000","last_unstale":"2023-11-08T19:26:50.448157+0000","last_undegraded":"2023-11-08T19:26:50.448157+0000","last_fullsized":"2023-11-08T19:26:50.448157+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_clean_scrub_stamp":"2023-11-08T19:26:47.569818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:03:01.745215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.131640+0000","last_change":"2023-11-08T19:25:47.284227+0000","last_active":"2023-11-08T19:26:49.131640+0000","last_peered":"2023-11-08T19:26:49.131640+0000","last_clean":"2023-11-08T19:26:49.131640+0000","last_became_active":"2023-11-08T19:25:47.283927+0000","last_became_peered":"2023-11-08T19:25:47.283927+0000","last_unstale":"2023-11-08T19:26:49.131640+0000","last_undegraded":"2023-11-08T19:26:49.131640+0000","last_fullsized":"2023-11-08T19:26:49.131640+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:15:23.188047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":60,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.134923+0000","last_change":"2023-11-08T19:24:32.530168+0000","last_active":"2023-11-08T19:26:49.134923+0000","last_peered":"2023-11-08T19:26:49.134923+0000","last_clean":"2023-11-08T19:26:49.134923+0000","last_became_active":"2023-11-08T19:24:31.144329+0000","last_became_peered":"2023-11-08T19:24:31.144329+0000","last_unstale":"2023-11-08T19:26:49.134923+0000","last_undegraded":"2023-11-08T19:26:49.134923+0000","last_fullsized":"2023-11-08T19:26:49.134923+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:05:36.085920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043484799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.135656+0000","last_change":"2023-11-08T19:25:48.371291+0000","last_active":"2023-11-08T19:26:49.135656+0000","last_peered":"2023-11-08T19:26:49.135656+0000","last_clean":"2023-11-08T19:26:49.135656+0000","last_became_active":"2023-11-08T19:25:46.281425+0000","last_became_peered":"2023-11-08T19:25:46.281425+0000","last_unstale":"2023-11-08T19:26:49.135656+0000","last_undegraded":"2023-11-08T19:26:49.135656+0000","last_fullsized":"2023-11-08T19:26:49.135656+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:23:12.422712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00124314,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.130192+0000","last_change":"2023-11-08T19:26:49.138708+0000","last_active":"2023-11-08T19:26:50.130192+0000","last_peered":"2023-11-08T19:26:50.130192+0000","last_clean":"2023-11-08T19:26:50.130192+0000","last_became_active":"2023-11-08T19:26:49.138415+0000","last_became_peered":"2023-11-08T19:26:49.138415+0000","last_unstale":"2023-11-08T19:26:50.130192+0000","last_undegraded":"2023-11-08T19:26:50.130192+0000","last_fullsized":"2023-11-08T19:26:50.130192+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:30:27.677139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"95'1","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.289757+0000","last_change":"2023-11-08T19:26:48.604230+0000","last_active":"2023-11-08T19:26:50.289757+0000","last_peered":"2023-11-08T19:26:50.289757+0000","last_clean":"2023-11-08T19:26:50.289757+0000","last_became_active":"2023-11-08T19:26:48.603981+0000","last_became_peered":"2023-11-08T19:26:48.603981+0000","last_unstale":"2023-11-08T19:26:50.289757+0000","last_undegraded":"2023-11-08T19:26:50.289757+0000","last_fullsized":"2023-11-08T19:26:50.289757+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_clean_scrub_stamp":"2023-11-08T19:26:47.569818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:23:41.123045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":31,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.131005+0000","last_change":"2023-11-08T19:25:47.281724+0000","last_active":"2023-11-08T19:26:49.131005+0000","last_peered":"2023-11-08T19:26:49.131005+0000","last_clean":"2023-11-08T19:26:49.131005+0000","last_became_active":"2023-11-08T19:25:47.281425+0000","last_became_peered":"2023-11-08T19:25:47.281425+0000","last_unstale":"2023-11-08T19:26:49.131005+0000","last_undegraded":"2023-11-08T19:26:49.131005+0000","last_fullsized":"2023-11-08T19:26:49.131005+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:38:55.785104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":60,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.133405+0000","last_change":"2023-11-08T19:24:32.529486+0000","last_active":"2023-11-08T19:26:49.133405+0000","last_peered":"2023-11-08T19:26:49.133405+0000","last_clean":"2023-11-08T19:26:49.133405+0000","last_became_active":"2023-11-08T19:24:31.146260+0000","last_became_peered":"2023-11-08T19:24:31.146260+0000","last_unstale":"2023-11-08T19:26:49.133405+0000","last_undegraded":"2023-11-08T19:26:49.133405+0000","last_fullsized":"2023-11-08T19:26:49.133405+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:45:34.425432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059842900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.134926+0000","last_change":"2023-11-08T19:25:48.277457+0000","last_active":"2023-11-08T19:26:49.134926+0000","last_peered":"2023-11-08T19:26:49.134926+0000","last_clean":"2023-11-08T19:26:49.134926+0000","last_became_active":"2023-11-08T19:25:46.286239+0000","last_became_peered":"2023-11-08T19:25:46.286239+0000","last_unstale":"2023-11-08T19:26:49.134926+0000","last_undegraded":"2023-11-08T19:26:49.134926+0000","last_fullsized":"2023-11-08T19:26:49.134926+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:09:43.662108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000722421,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.448949+0000","last_change":"2023-11-08T19:26:49.145596+0000","last_active":"2023-11-08T19:26:50.448949+0000","last_peered":"2023-11-08T19:26:50.448949+0000","last_clean":"2023-11-08T19:26:50.448949+0000","last_became_active":"2023-11-08T19:26:49.145272+0000","last_became_peered":"2023-11-08T19:26:49.145272+0000","last_unstale":"2023-11-08T19:26:50.448949+0000","last_undegraded":"2023-11-08T19:26:50.448949+0000","last_fullsized":"2023-11-08T19:26:50.448949+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:16:27.690375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"95'2","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.130161+0000","last_change":"2023-11-08T19:26:48.609238+0000","last_active":"2023-11-08T19:26:50.130161+0000","last_peered":"2023-11-08T19:26:50.130161+0000","last_clean":"2023-11-08T19:26:50.130161+0000","last_became_active":"2023-11-08T19:26:48.609027+0000","last_became_peered":"2023-11-08T19:26:48.609027+0000","last_unstale":"2023-11-08T19:26:50.130161+0000","last_undegraded":"2023-11-08T19:26:50.130161+0000","last_fullsized":"2023-11-08T19:26:50.130161+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_clean_scrub_stamp":"2023-11-08T19:26:47.569818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:45:48.688005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":28,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-08T19:26:48.597466+0000","last_change":"2023-11-08T19:25:47.287874+0000","last_active":"2023-11-08T19:26:48.597466+0000","last_peered":"2023-11-08T19:26:48.597466+0000","last_clean":"2023-11-08T19:26:48.597466+0000","last_became_active":"2023-11-08T19:25:47.287456+0000","last_became_peered":"2023-11-08T19:25:47.287456+0000","last_unstale":"2023-11-08T19:26:48.597466+0000","last_undegraded":"2023-11-08T19:26:48.597466+0000","last_fullsized":"2023-11-08T19:26:48.597466+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:26:59.852338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":69,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.131361+0000","last_change":"2023-11-08T19:24:32.141131+0000","last_active":"2023-11-08T19:26:49.131361+0000","last_peered":"2023-11-08T19:26:49.131361+0000","last_clean":"2023-11-08T19:26:49.131361+0000","last_became_active":"2023-11-08T19:24:31.146154+0000","last_became_peered":"2023-11-08T19:24:31.146154+0000","last_unstale":"2023-11-08T19:26:49.131361+0000","last_undegraded":"2023-11-08T19:26:49.131361+0000","last_fullsized":"2023-11-08T19:26:49.131361+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:18:40.271560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082432800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.136923+0000","last_change":"2023-11-08T19:25:48.372729+0000","last_active":"2023-11-08T19:26:49.136923+0000","last_peered":"2023-11-08T19:26:49.136923+0000","last_clean":"2023-11-08T19:26:49.136923+0000","last_became_active":"2023-11-08T19:25:46.290114+0000","last_became_peered":"2023-11-08T19:25:46.290114+0000","last_unstale":"2023-11-08T19:26:49.136923+0000","last_undegraded":"2023-11-08T19:26:49.136923+0000","last_fullsized":"2023-11-08T19:26:49.136923+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:49:36.208776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061009499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.155708+0000","last_change":"2023-11-08T19:26:49.150927+0000","last_active":"2023-11-08T19:26:49.155708+0000","last_peered":"2023-11-08T19:26:49.155708+0000","last_clean":"2023-11-08T19:26:49.155708+0000","last_became_active":"2023-11-08T19:26:49.150531+0000","last_became_peered":"2023-11-08T19:26:49.150531+0000","last_unstale":"2023-11-08T19:26:49.155708+0000","last_undegraded":"2023-11-08T19:26:49.155708+0000","last_fullsized":"2023-11-08T19:26:49.155708+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:20:04.364566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.447601+0000","last_change":"2023-11-08T19:26:48.615392+0000","last_active":"2023-11-08T19:26:50.447601+0000","last_peered":"2023-11-08T19:26:50.447601+0000","last_clean":"2023-11-08T19:26:50.447601+0000","last_became_active":"2023-11-08T19:26:48.615101+0000","last_became_peered":"2023-11-08T19:26:48.615101+0000","last_unstale":"2023-11-08T19:26:50.447601+0000","last_undegraded":"2023-11-08T19:26:50.447601+0000","last_fullsized":"2023-11-08T19:26:50.447601+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_clean_scrub_stamp":"2023-11-08T19:26:47.569818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:04:48.064349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":31,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.131503+0000","last_change":"2023-11-08T19:25:47.283046+0000","last_active":"2023-11-08T19:26:49.131503+0000","last_peered":"2023-11-08T19:26:49.131503+0000","last_clean":"2023-11-08T19:26:49.131503+0000","last_became_active":"2023-11-08T19:25:47.282763+0000","last_became_peered":"2023-11-08T19:25:47.282763+0000","last_unstale":"2023-11-08T19:26:49.131503+0000","last_undegraded":"2023-11-08T19:26:49.131503+0000","last_fullsized":"2023-11-08T19:26:49.131503+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:12:51.389167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.135431+0000","last_change":"2023-11-08T19:24:32.263963+0000","last_active":"2023-11-08T19:26:49.135431+0000","last_peered":"2023-11-08T19:26:49.135431+0000","last_clean":"2023-11-08T19:26:49.135431+0000","last_became_active":"2023-11-08T19:24:31.139062+0000","last_became_peered":"2023-11-08T19:24:31.139062+0000","last_unstale":"2023-11-08T19:26:49.135431+0000","last_undegraded":"2023-11-08T19:26:49.135431+0000","last_fullsized":"2023-11-08T19:26:49.135431+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:26.080042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033682599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.132329+0000","last_change":"2023-11-08T19:25:48.283302+0000","last_active":"2023-11-08T19:26:49.132329+0000","last_peered":"2023-11-08T19:26:49.132329+0000","last_clean":"2023-11-08T19:26:49.132329+0000","last_became_active":"2023-11-08T19:25:46.284287+0000","last_became_peered":"2023-11-08T19:25:46.284287+0000","last_unstale":"2023-11-08T19:26:49.132329+0000","last_undegraded":"2023-11-08T19:26:49.132329+0000","last_fullsized":"2023-11-08T19:26:49.132329+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:39:27.217802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097880800000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.448110+0000","last_change":"2023-11-08T19:26:49.141709+0000","last_active":"2023-11-08T19:26:50.448110+0000","last_peered":"2023-11-08T19:26:50.448110+0000","last_clean":"2023-11-08T19:26:50.448110+0000","last_became_active":"2023-11-08T19:26:49.141457+0000","last_became_peered":"2023-11-08T19:26:49.141457+0000","last_unstale":"2023-11-08T19:26:50.448110+0000","last_undegraded":"2023-11-08T19:26:50.448110+0000","last_fullsized":"2023-11-08T19:26:50.448110+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:49:56.291414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.288689+0000","last_change":"2023-11-08T19:26:48.606259+0000","last_active":"2023-11-08T19:26:50.288689+0000","last_peered":"2023-11-08T19:26:50.288689+0000","last_clean":"2023-11-08T19:26:50.288689+0000","last_became_active":"2023-11-08T19:26:48.601066+0000","last_became_peered":"2023-11-08T19:26:48.601066+0000","last_unstale":"2023-11-08T19:26:50.288689+0000","last_undegraded":"2023-11-08T19:26:50.288689+0000","last_fullsized":"2023-11-08T19:26:50.288689+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_clean_scrub_stamp":"2023-11-08T19:26:47.569818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:13:24.253999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.130584+0000","last_change":"2023-11-08T19:25:47.286434+0000","last_active":"2023-11-08T19:26:49.130584+0000","last_peered":"2023-11-08T19:26:49.130584+0000","last_clean":"2023-11-08T19:26:49.130584+0000","last_became_active":"2023-11-08T19:25:47.286181+0000","last_became_peered":"2023-11-08T19:25:47.286181+0000","last_unstale":"2023-11-08T19:26:49.130584+0000","last_undegraded":"2023-11-08T19:26:49.130584+0000","last_fullsized":"2023-11-08T19:26:49.130584+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:13:27.285648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":70,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.136660+0000","last_change":"2023-11-08T19:24:32.140514+0000","last_active":"2023-11-08T19:26:49.136660+0000","last_peered":"2023-11-08T19:26:49.136660+0000","last_clean":"2023-11-08T19:26:49.136660+0000","last_became_active":"2023-11-08T19:24:31.146668+0000","last_became_peered":"2023-11-08T19:24:31.146668+0000","last_unstale":"2023-11-08T19:26:49.136660+0000","last_undegraded":"2023-11-08T19:26:49.136660+0000","last_fullsized":"2023-11-08T19:26:49.136660+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:31:24.539374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071576699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.135212+0000","last_change":"2023-11-08T19:25:48.320667+0000","last_active":"2023-11-08T19:26:49.135212+0000","last_peered":"2023-11-08T19:26:49.135212+0000","last_clean":"2023-11-08T19:26:49.135212+0000","last_became_active":"2023-11-08T19:25:46.290246+0000","last_became_peered":"2023-11-08T19:25:46.290246+0000","last_unstale":"2023-11-08T19:26:49.135212+0000","last_undegraded":"2023-11-08T19:26:49.135212+0000","last_fullsized":"2023-11-08T19:26:49.135212+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:33:35.492889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000423211,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.153002+0000","last_change":"2023-11-08T19:26:49.148000+0000","last_active":"2023-11-08T19:26:49.153002+0000","last_peered":"2023-11-08T19:26:49.153002+0000","last_clean":"2023-11-08T19:26:49.153002+0000","last_became_active":"2023-11-08T19:26:49.147832+0000","last_became_peered":"2023-11-08T19:26:49.147832+0000","last_unstale":"2023-11-08T19:26:49.153002+0000","last_undegraded":"2023-11-08T19:26:49.153002+0000","last_fullsized":"2023-11-08T19:26:49.153002+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:50:46.630219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"95'2","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.448154+0000","last_change":"2023-11-08T19:26:48.615384+0000","last_active":"2023-11-08T19:26:50.448154+0000","last_peered":"2023-11-08T19:26:50.448154+0000","last_clean":"2023-11-08T19:26:50.448154+0000","last_became_active":"2023-11-08T19:26:48.615113+0000","last_became_peered":"2023-11-08T19:26:48.615113+0000","last_unstale":"2023-11-08T19:26:50.448154+0000","last_undegraded":"2023-11-08T19:26:50.448154+0000","last_fullsized":"2023-11-08T19:26:50.448154+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_clean_scrub_stamp":"2023-11-08T19:26:47.569818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:16:14.877916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":30,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.137585+0000","last_change":"2023-11-08T19:25:47.287717+0000","last_active":"2023-11-08T19:26:49.137585+0000","last_peered":"2023-11-08T19:26:49.137585+0000","last_clean":"2023-11-08T19:26:49.137585+0000","last_became_active":"2023-11-08T19:25:47.287412+0000","last_became_peered":"2023-11-08T19:25:47.287412+0000","last_unstale":"2023-11-08T19:26:49.137585+0000","last_undegraded":"2023-11-08T19:26:49.137585+0000","last_fullsized":"2023-11-08T19:26:49.137585+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:18:04.478139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.135309+0000","last_change":"2023-11-08T19:24:32.142892+0000","last_active":"2023-11-08T19:26:49.135309+0000","last_peered":"2023-11-08T19:26:49.135309+0000","last_clean":"2023-11-08T19:26:49.135309+0000","last_became_active":"2023-11-08T19:24:31.144912+0000","last_became_peered":"2023-11-08T19:24:31.144912+0000","last_unstale":"2023-11-08T19:26:49.135309+0000","last_undegraded":"2023-11-08T19:26:49.135309+0000","last_fullsized":"2023-11-08T19:26:49.135309+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:04:21.151484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056686900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.136572+0000","last_change":"2023-11-08T19:25:48.285205+0000","last_active":"2023-11-08T19:26:49.136572+0000","last_peered":"2023-11-08T19:26:49.136572+0000","last_clean":"2023-11-08T19:26:49.136572+0000","last_became_active":"2023-11-08T19:25:46.285848+0000","last_became_peered":"2023-11-08T19:25:46.285848+0000","last_unstale":"2023-11-08T19:26:49.136572+0000","last_undegraded":"2023-11-08T19:26:49.136572+0000","last_fullsized":"2023-11-08T19:26:49.136572+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:07:10.832480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089732199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.288979+0000","last_change":"2023-11-08T19:26:49.141968+0000","last_active":"2023-11-08T19:26:50.288979+0000","last_peered":"2023-11-08T19:26:50.288979+0000","last_clean":"2023-11-08T19:26:50.288979+0000","last_became_active":"2023-11-08T19:26:49.141726+0000","last_became_peered":"2023-11-08T19:26:49.141726+0000","last_unstale":"2023-11-08T19:26:50.288979+0000","last_undegraded":"2023-11-08T19:26:50.288979+0000","last_fullsized":"2023-11-08T19:26:50.288979+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:48.577375+0000","last_clean_scrub_stamp":"2023-11-08T19:26:48.577375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:33:13.222981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-11-08T19:26:50.129113+0000","last_change":"2023-11-08T19:26:48.616337+0000","last_active":"2023-11-08T19:26:50.129113+0000","last_peered":"2023-11-08T19:26:50.129113+0000","last_clean":"2023-11-08T19:26:50.129113+0000","last_became_active":"2023-11-08T19:26:48.615230+0000","last_became_peered":"2023-11-08T19:26:48.615230+0000","last_unstale":"2023-11-08T19:26:50.129113+0000","last_undegraded":"2023-11-08T19:26:50.129113+0000","last_fullsized":"2023-11-08T19:26:50.129113+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:26:47.569818+0000","last_clean_scrub_stamp":"2023-11-08T19:26:47.569818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:41:00.315816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":31,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.135235+0000","last_change":"2023-11-08T19:25:47.280177+0000","last_active":"2023-11-08T19:26:49.135235+0000","last_peered":"2023-11-08T19:26:49.135235+0000","last_clean":"2023-11-08T19:26:49.135235+0000","last_became_active":"2023-11-08T19:25:47.279913+0000","last_became_peered":"2023-11-08T19:25:47.279913+0000","last_unstale":"2023-11-08T19:26:49.135235+0000","last_undegraded":"2023-11-08T19:26:49.135235+0000","last_fullsized":"2023-11-08T19:26:49.135235+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:26:02.147090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":60,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.134702+0000","last_change":"2023-11-08T19:24:32.263958+0000","last_active":"2023-11-08T19:26:49.134702+0000","last_peered":"2023-11-08T19:26:49.134702+0000","last_clean":"2023-11-08T19:26:49.134702+0000","last_became_active":"2023-11-08T19:24:31.149011+0000","last_became_peered":"2023-11-08T19:24:31.149011+0000","last_unstale":"2023-11-08T19:26:49.134702+0000","last_undegraded":"2023-11-08T19:26:49.134702+0000","last_fullsized":"2023-11-08T19:26:49.134702+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:09:04.880374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033496900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-08T19:26:49.132360+0000","last_change":"2023-11-08T19:25:48.285075+0000","last_active":"2023-11-08T19:26:49.132360+0000","last_peered":"2023-11-08T19:26:49.132360+0000","last_clean":"2023-11-08T19:26:49.132360+0000","last_became_active":"2023-11-08T19:25:46.272479+0000","last_became_peered":"2023-11-08T19:25:46.272479+0000","last_unstale":"2023-11-08T19:26:49.132360+0000","last_undegraded":"2023-11-08T19:26:49.132360+0000","last_fullsized":"2023-11-08T19:26:49.132360+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:23:12.422712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001158117,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28752,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343088,"statfs":{"total":96636764160,"available":96607322112,"internally_reserved":0,"allocated":1773568,"data_stored":1168804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55200000000000005,"15min":0.53800000000000003},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.41399999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.71299999999999997,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.54800000000000004}]},{"osd":1,"last update":"Wed Nov 8 19:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.54800000000000004,"15min":0.54700000000000004},"min":{"1min":0.40799999999999997,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.69499999999999995,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.53800000000000003,"15min":0.53200000000000003},"min":{"1min":0.40600000000000003,"5min":0.37,"15min":0.37},"max":{"1min":0.75900000000000001,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.60699999999999998}]},{"osd":2,"last update":"Wed Nov 8 19:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.51400000000000001,"15min":0.50800000000000001},"min":{"1min":0.42899999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.75800000000000001,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.54000000000000004,"15min":0.53600000000000003},"min":{"1min":0.379,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.77800000000000002,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.45500000000000002}]},{"osd":3,"last update":"Wed Nov 8 19:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.53600000000000003,"15min":0.53400000000000003},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.56899999999999995,"15min":0.55900000000000005},"min":{"1min":0.42399999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76100000000000001,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.57299999999999995}]},{"osd":4,"last update":"Wed Nov 8 19:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.496,"15min":0.48599999999999999},"min":{"1min":0.35999999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.376},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.51900000000000002,"15min":0.51800000000000002},"min":{"1min":0.378,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.71399999999999997,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.495}]},{"osd":5,"last update":"Wed Nov 8 19:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.55900000000000005,"15min":0.54800000000000004},"min":{"1min":0.39200000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.76300000000000001,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.623},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.58199999999999996,"15min":0.57799999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.68700000000000006,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.67100000000000004}]},{"osd":6,"last update":"Wed Nov 8 19:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.45600000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.80400000000000005,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57299999999999995,"15min":0.56399999999999995},"min":{"1min":0.441,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.69199999999999995,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.59199999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574900,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28188,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343652,"statfs":{"total":96636764160,"available":96607899648,"internally_reserved":0,"allocated":1187840,"data_stored":585601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.57299999999999995,"15min":0.59699999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.69799999999999995,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.57299999999999995,"15min":0.59099999999999997},"min":{"1min":0.313,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.754,"5min":1.478,"15min":1.478},"last":0.55700000000000005}]},{"osd":1,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.59599999999999997,"15min":0.60599999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.77500000000000002,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.627},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.65200000000000002,"15min":0.66600000000000004},"min":{"1min":0.435,"5min":0.433,"15min":0.433},"max":{"1min":0.78700000000000003,"5min":1.649,"15min":1.649},"last":0.63700000000000001}]},{"osd":2,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.37},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.621,"15min":0.63200000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76400000000000001,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.67600000000000005}]},{"osd":3,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.60399999999999998,"15min":0.63},"min":{"1min":0.42299999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.747,"5min":1.766,"15min":1.766},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.59499999999999997,"15min":0.61899999999999999},"min":{"1min":0.39300000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.82799999999999996,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":0.45200000000000001}]},{"osd":4,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53700000000000003,"15min":0.54200000000000004},"min":{"1min":0.36399999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57299999999999995,"15min":0.58099999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.81699999999999995,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.61099999999999999}]},{"osd":5,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.55500000000000005,"15min":0.56799999999999995},"min":{"1min":0.38800000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.73499999999999999,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.498},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.623,"15min":0.63600000000000001},"min":{"1min":0.41399999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.80200000000000005,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.59099999999999997}]},{"osd":7,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.60599999999999998,"15min":0.61299999999999999},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.77700000000000002,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.63600000000000001,"15min":0.64600000000000002},"min":{"1min":0.44400000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.71599999999999997,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.47899999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574899,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28184,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343656,"statfs":{"total":96636764160,"available":96607903744,"internally_reserved":0,"allocated":1191936,"data_stored":585655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.35699999999999998,"15min":0.36299999999999999},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.51200000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.38900000000000001,"15min":0.41299999999999998},"min":{"1min":0.22900000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.51700000000000002,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":0.32200000000000001}]},{"osd":2,"last update":"Wed Nov 8 19:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.33800000000000002,"15min":0.34499999999999997},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.53000000000000003,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.38100000000000001,"15min":0.39400000000000002},"min":{"1min":0.253,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.46400000000000002,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.38800000000000001}]},{"osd":3,"last update":"Wed Nov 8 19:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.40799999999999997,"15min":0.41699999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.432,"5min":1.24,"15min":1.24},"last":0.432},{"interface":"front","average":{"1min":0.371,"5min":0.438,"15min":0.46200000000000002},"min":{"1min":0.26100000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.47999999999999998,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.373}]},{"osd":4,"last update":"Wed Nov 8 19:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.60599999999999998,"15min":0.61399999999999999},"min":{"1min":0.46500000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72499999999999998,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57599999999999996,"15min":0.56599999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.76200000000000001,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.59999999999999998}]},{"osd":5,"last update":"Wed Nov 8 19:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.56999999999999995,"15min":0.55800000000000005},"min":{"1min":0.41399999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.72799999999999998,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.60199999999999998,"15min":0.60699999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.68700000000000006,"5min":1.115,"15min":1.115},"last":0.52900000000000003}]},{"osd":6,"last update":"Wed Nov 8 19:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.63,"15min":0.63800000000000001},"min":{"1min":0.439,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.746,"5min":2.093,"15min":2.093},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.59899999999999998,"15min":0.60299999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.76100000000000001,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.67700000000000005}]},{"osd":7,"last update":"Wed Nov 8 19:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.64700000000000002,"15min":0.67100000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.77600000000000002,"5min":1.591,"15min":1.591},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.66500000000000004,"15min":0.69199999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.70199999999999996,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.57899999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574899,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28764,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343076,"statfs":{"total":96636764160,"available":96607309824,"internally_reserved":0,"allocated":1785856,"data_stored":1169912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:26:00 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.879,"15min":1.1180000000000001},"min":{"1min":0.23799999999999999,"5min":0.192,"15min":0.192},"max":{"1min":0.60699999999999998,"5min":19.295999999999999,"15min":19.295999999999999},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.379,"5min":0.81999999999999995,"15min":1.024},"min":{"1min":0.24299999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.56000000000000005,"5min":17.204000000000001,"15min":17.204000000000001},"last":0.33000000000000002}]},{"osd":2,"last update":"Wed Nov 8 19:26:00 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.54200000000000004,"15min":0.61799999999999999},"min":{"1min":0.28299999999999997,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.54700000000000004,"5min":6.524,"15min":6.524},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.85399999999999998,"15min":1.0640000000000001},"min":{"1min":0.29499999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.60699999999999998,"5min":17.175000000000001,"15min":17.175000000000001},"last":0.371}]},{"osd":3,"last update":"Wed Nov 8 19:26:00 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.746,"15min":0.91000000000000003},"min":{"1min":0.27100000000000002,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.55800000000000005,"5min":14.324,"15min":14.324},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.40799999999999997,"15min":0.40400000000000003},"min":{"1min":0.34699999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.30399999999999999}]},{"osd":4,"last update":"Wed Nov 8 19:26:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":1.028,"15min":1.212},"min":{"1min":0.52000000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.98999999999999999,"5min":17.056000000000001,"15min":17.056000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.70699999999999996,"15min":0.745},"min":{"1min":0.49099999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.82299999999999995,"5min":5.0289999999999999,"15min":5.0289999999999999},"last":0.56699999999999995}]},{"osd":5,"last update":"Wed Nov 8 19:26:00 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.69999999999999996,"15min":0.746},"min":{"1min":0.53400000000000003,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.85099999999999998,"5min":5.0590000000000002,"15min":5.0590000000000002},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.58399999999999996,"15min":0.56999999999999995},"min":{"1min":0.47199999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.59499999999999997}]},{"osd":6,"last update":"Wed Nov 8 19:26:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.61299999999999999,"15min":0.60799999999999998},"min":{"1min":0.505,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":1.0649999999999999,"15min":1.2589999999999999},"min":{"1min":0.50800000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.0389999999999999,"5min":17.111999999999998,"15min":17.111999999999998},"last":0.624}]},{"osd":7,"last update":"Wed Nov 8 19:26:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":1.0820000000000001,"15min":1.274},"min":{"1min":0.48099999999999998,"5min":0.376,"15min":0.376},"max":{"1min":1.0760000000000001,"5min":17.146000000000001,"15min":17.146000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.63,"5min":0.71099999999999997,"15min":0.75700000000000001},"min":{"1min":0.47099999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.91700000000000004,"5min":4.9829999999999997,"15min":4.9829999999999997},"last":0.64700000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574899,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28184,"kb_used_data":1156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343656,"statfs":{"total":96636764160,"available":96607903744,"internally_reserved":0,"allocated":1183744,"data_stored":585531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.433,"15min":0.47499999999999998},"min":{"1min":0.23300000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.61299999999999999,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":0.248},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.46200000000000002,"15min":0.50800000000000001},"min":{"1min":0.23999999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.65100000000000002,"5min":3.4369999999999998,"15min":3.4369999999999998},"last":0.26800000000000002}]},{"osd":1,"last update":"Wed Nov 8 19:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.49099999999999999,"15min":0.54900000000000004},"min":{"1min":0.27000000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.48399999999999999,"5min":4.0679999999999996,"15min":4.0679999999999996},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.54400000000000004,"15min":0.59599999999999997},"min":{"1min":0.32300000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.58599999999999997,"5min":4.3499999999999996,"15min":4.3499999999999996},"last":0.32600000000000001}]},{"osd":3,"last update":"Wed Nov 8 19:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.495,"15min":0.53700000000000003},"min":{"1min":0.27800000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.47099999999999997,"5min":3.8580000000000001,"15min":3.8580000000000001},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.46300000000000002,"15min":0.51200000000000001},"min":{"1min":0.29599999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.55700000000000005,"5min":3.476,"15min":3.476},"last":0.309}]},{"osd":4,"last update":"Wed Nov 8 19:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.68799999999999994,"15min":0.71799999999999997},"min":{"1min":0.44,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.98799999999999999,"5min":4.0090000000000003,"15min":4.0090000000000003},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.68899999999999995,"15min":0.73399999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.69099999999999995,"5min":4.1040000000000001,"15min":4.1040000000000001},"last":0.42599999999999999}]},{"osd":5,"last update":"Wed Nov 8 19:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.69299999999999995,"15min":0.74299999999999999},"min":{"1min":0.47999999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.874,"5min":4.0869999999999997,"15min":4.0869999999999997},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.69599999999999995,"15min":0.746},"min":{"1min":0.435,"5min":0.433,"15min":0.433},"max":{"1min":0.78100000000000003,"5min":3.843,"15min":3.843},"last":0.46200000000000002}]},{"osd":6,"last update":"Wed Nov 8 19:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.70799999999999996,"15min":0.75900000000000001},"min":{"1min":0.45300000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.72699999999999998,"5min":4.1399999999999997,"15min":4.1399999999999997},"last":0.375},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.68799999999999994,"15min":0.73399999999999999},"min":{"1min":0.49199999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.81499999999999995,"5min":4.0499999999999998,"15min":4.0499999999999998},"last":0.47299999999999998}]},{"osd":7,"last update":"Wed Nov 8 19:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.72799999999999998,"15min":0.76800000000000002},"min":{"1min":0.48799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.754,"5min":4.157,"15min":4.157},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.754,"15min":0.80000000000000004},"min":{"1min":0.505,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.93000000000000005,"5min":4.1710000000000003,"15min":4.1710000000000003},"last":0.44400000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574899,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28192,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343648,"statfs":{"total":96636764160,"available":96607895552,"internally_reserved":0,"allocated":1200128,"data_stored":587213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.38100000000000001,"15min":0.38500000000000001},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.64600000000000002,"5min":1.458,"15min":1.458},"last":0.373},{"interface":"front","average":{"1min":0.372,"5min":0.38900000000000001,"15min":0.39800000000000002},"min":{"1min":0.29499999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.53400000000000003,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.38900000000000001}]},{"osd":1,"last update":"Wed Nov 8 19:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.40500000000000003,"15min":0.41099999999999998},"min":{"1min":0.29599999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.61199999999999999,"5min":1.512,"15min":1.512},"last":0.318},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.435,"15min":0.44700000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.59999999999999998,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.35699999999999998}]},{"osd":2,"last update":"Wed Nov 8 19:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.371,"15min":0.376},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.54800000000000004,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.41899999999999998,"15min":0.42699999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.60899999999999999,"5min":1.536,"15min":1.536},"last":0.40000000000000002}]},{"osd":4,"last update":"Wed Nov 8 19:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.60799999999999998,"15min":0.62},"min":{"1min":0.44900000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.77000000000000002,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.623,"5min":0.61299999999999999,"15min":0.61099999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.80200000000000005,"5min":1.153,"15min":1.153},"last":0.53400000000000003}]},{"osd":5,"last update":"Wed Nov 8 19:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.58899999999999997,"15min":0.59099999999999997},"min":{"1min":0.42399999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.69599999999999995,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.58899999999999997,"15min":0.60299999999999998},"min":{"1min":0.39300000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.73699999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.45000000000000001}]},{"osd":6,"last update":"Wed Nov 8 19:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57399999999999995,"15min":0.57999999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78500000000000003,"5min":1.113,"15min":1.113},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60799999999999998,"15min":0.61199999999999999},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72299999999999998,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.52500000000000002}]},{"osd":7,"last update":"Wed Nov 8 19:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.63500000000000001,"15min":0.64700000000000002},"min":{"1min":0.433,"5min":0.432,"15min":0.432},"max":{"1min":0.73999999999999999,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.62,"15min":0.61799999999999999},"min":{"1min":0.46300000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.754,"5min":1.179,"15min":1.179},"last":0.59499999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574899,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28184,"kb_used_data":1156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343656,"statfs":{"total":96636764160,"available":96607903744,"internally_reserved":0,"allocated":1183744,"data_stored":585531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:25:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.54500000000000004,"15min":0.53800000000000003},"min":{"1min":0.36799999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.80100000000000005,"5min":1.399,"15min":1.399},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58499999999999996,"15min":0.59499999999999997},"min":{"1min":0.44400000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73499999999999999,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.439}]},{"osd":1,"last update":"Wed Nov 8 19:25:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.51400000000000001,"15min":0.51100000000000001},"min":{"1min":0.42199999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.502,"15min":0.497},"min":{"1min":0.40999999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.32700000000000001}]},{"osd":2,"last update":"Wed Nov 8 19:25:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.61899999999999999,"15min":0.63500000000000001},"min":{"1min":0.38200000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.80800000000000005,"5min":2.8490000000000002,"15min":2.8490000000000002},"last":0.504},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.53800000000000003,"15min":0.52400000000000002},"min":{"1min":0.40799999999999997,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.71799999999999997,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.35999999999999999}]},{"osd":3,"last update":"Wed Nov 8 19:25:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57799999999999996,"15min":0.56599999999999995},"min":{"1min":0.47099999999999997,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.75700000000000001,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.70099999999999996,"15min":0.72399999999999998},"min":{"1min":0.48299999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.83199999999999996,"5min":3.4849999999999999,"15min":3.4849999999999999},"last":0.47599999999999998}]},{"osd":5,"last update":"Wed Nov 8 19:25:59 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.51800000000000002,"15min":0.52000000000000002},"min":{"1min":0.38,"5min":0.313,"15min":0.313},"max":{"1min":0.67200000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.56899999999999995,"15min":0.56100000000000005},"min":{"1min":0.39700000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.79100000000000004,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.51800000000000002}]},{"osd":6,"last update":"Wed Nov 8 19:25:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.67300000000000004,"15min":0.71499999999999997},"min":{"1min":0.38,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.71599999999999997,"5min":4.1529999999999996,"15min":4.1529999999999996},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.624,"5min":0.61599999999999999,"15min":0.61399999999999999},"min":{"1min":0.41699999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.73999999999999999,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.40899999999999997}]},{"osd":7,"last update":"Wed Nov 8 19:25:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57399999999999995,"15min":0.57199999999999995},"min":{"1min":0.47399999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.69999999999999996,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.80200000000000005,"15min":0.85199999999999998},"min":{"1min":0.52700000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.83899999999999997,"5min":5.5359999999999996,"15min":5.5359999999999996},"last":0.57599999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574899,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28192,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343648,"statfs":{"total":96636764160,"available":96607895552,"internally_reserved":0,"allocated":1191936,"data_stored":586135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53700000000000003,"15min":0.54700000000000004},"min":{"1min":0.40600000000000003,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.63800000000000001,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.52500000000000002,"15min":0.51900000000000002},"min":{"1min":0.32800000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.68799999999999994,"5min":0.878,"15min":0.878},"last":0.378}]},{"osd":1,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55300000000000005,"15min":0.54700000000000004},"min":{"1min":0.47199999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.68200000000000005,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.44},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.59299999999999997,"15min":0.60699999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.73899999999999999,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":0.40699999999999997}]},{"osd":2,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.34699999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.65300000000000002,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.53600000000000003,"15min":0.53000000000000003},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.70699999999999996,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.54500000000000004}]},{"osd":3,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.41299999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71799999999999997,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57699999999999996,"15min":0.57299999999999995},"min":{"1min":0.42199999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.73599999999999999,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.64200000000000002}]},{"osd":4,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.57499999999999996,"15min":0.59899999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.748,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.63700000000000001,"15min":0.63500000000000001},"min":{"1min":0.46500000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.77300000000000002,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.58099999999999996}]},{"osd":6,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.57899999999999996,"15min":0.57799999999999996},"min":{"1min":0.38200000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.73599999999999999,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.63800000000000001,"15min":0.66600000000000004},"min":{"1min":0.41799999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.80500000000000005,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":0.56599999999999995}]},{"osd":7,"last update":"Wed Nov 8 19:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.623,"15min":0.629},"min":{"1min":0.42499999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.82799999999999996,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.626},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.64200000000000002,"15min":0.64800000000000002},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.80700000000000005,"5min":0.873,"15min":0.873},"last":0.67000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:26:54.124 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-08T19:26:54.125 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-08T19:26:54.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.279+0000 7f156b77c700 1 Processor -- start 2023-11-08T19:26:54.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.280+0000 7f156b77c700 1 -- start start 2023-11-08T19:26:54.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.280+0000 7f156b77c700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f156415b8e0 0x7f15640c5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:54.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.280+0000 7f156b77c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f156415bcc0 0x7f15640d0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:54.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.280+0000 7f156b77c700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1564070cb0 con 0x7f15640d12d0 2023-11-08T19:26:54.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.280+0000 7f156b77c700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1564070f90 con 0x7f156415b8e0 2023-11-08T19:26:54.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.280+0000 7f156b77c700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1564071270 con 0x7f156415bcc0 2023-11-08T19:26:54.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.281+0000 7f1568d17700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f156415bcc0 0x7f15640d0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:54.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.281+0000 7f1569518700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f156415b8e0 0x7f15640c5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:54.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.281+0000 7f1568d17700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f156415bcc0 0x7f15640d0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.149:35556/0 (socket says 172.21.15.149:35556) 2023-11-08T19:26:54.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.281+0000 7f1569d19700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f15640d12d0 0x7f15640b3150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.149:57166/0 (socket says 172.21.15.149:57166) 2023-11-08T19:26:54.287 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.281+0000 7f1568d17700 1 -- 172.21.15.149:0/3251021744 learned_addr learned my addr 172.21.15.149:0/3251021744 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:54.287 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.281+0000 7f1568d17700 1 -- 172.21.15.149:0/3251021744 >> v2:172.21.15.160:3300/0 conn(0x7f156415b8e0 msgr2=0x7f15640c5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:54.287 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.281+0000 7f1568d17700 1 --2- 172.21.15.149:0/3251021744 >> v2:172.21.15.160:3300/0 conn(0x7f156415b8e0 0x7f15640c5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:54.287 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.281+0000 7f1568d17700 1 -- 172.21.15.149:0/3251021744 >> v1:172.21.15.160:6789/0 conn(0x7f15640d12d0 legacy=0x7f15640b3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:54.287 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.281+0000 7f1568d17700 1 -- 172.21.15.149:0/3251021744 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1564071550 con 0x7f156415bcc0 2023-11-08T19:26:54.287 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.281+0000 7f1568d17700 1 --2- 172.21.15.149:0/3251021744 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f156415bcc0 0x7f15640d0d90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f15600098f0 tx=0x7f1560009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae0c81a1b5f5dce7 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:54.288 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.281+0000 7f155bfff700 1 -- 172.21.15.149:0/3251021744 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1560011830 con 0x7f156415bcc0 2023-11-08T19:26:54.288 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.281+0000 7f155bfff700 1 -- 172.21.15.149:0/3251021744 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1560011990 con 0x7f156415bcc0 2023-11-08T19:26:54.288 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.281+0000 7f155bfff700 1 -- 172.21.15.149:0/3251021744 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1560011d20 con 0x7f156415bcc0 2023-11-08T19:26:54.288 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.282+0000 7f156b77c700 1 -- 172.21.15.149:0/3251021744 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f156415bcc0 msgr2=0x7f15640d0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:54.288 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.282+0000 7f156b77c700 1 --2- 172.21.15.149:0/3251021744 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f156415bcc0 0x7f15640d0d90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f15600098f0 tx=0x7f1560009c00 comp rx=0 tx=0).stop 2023-11-08T19:26:54.289 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.282+0000 7f156b77c700 1 -- 172.21.15.149:0/3251021744 shutdown_connections 2023-11-08T19:26:54.289 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.282+0000 7f156b77c700 1 --2- 172.21.15.149:0/3251021744 >> v2:172.21.15.160:3300/0 conn(0x7f156415b8e0 0x7f15640c5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:54.289 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.282+0000 7f156b77c700 1 --2- 172.21.15.149:0/3251021744 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f156415bcc0 0x7f15640d0d90 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:54.289 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.282+0000 7f156b77c700 1 -- 172.21.15.149:0/3251021744 >> 172.21.15.149:0/3251021744 conn(0x7f15640ce150 msgr2=0x7f15640ce560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:54.289 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.282+0000 7f156b77c700 1 -- 172.21.15.149:0/3251021744 shutdown_connections 2023-11-08T19:26:54.290 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.282+0000 7f156b77c700 1 -- 172.21.15.149:0/3251021744 wait complete. 2023-11-08T19:26:54.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.283+0000 7f156b77c700 1 Processor -- start 2023-11-08T19:26:54.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.283+0000 7f156b77c700 1 -- start start 2023-11-08T19:26:54.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.284+0000 7f156b77c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f15640d12d0 0x7f15641f2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:54.294 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.284+0000 7f156b77c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f156415b8e0 0x7f15640b5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:54.294 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.284+0000 7f156b77c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15640c9fa0 0x7f15640ca450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:54.294 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.284+0000 7f156b77c700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15640b3c80 con 0x7f15640c9fa0 2023-11-08T19:26:54.294 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.284+0000 7f156b77c700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15641f25c0 con 0x7f15640d12d0 2023-11-08T19:26:54.294 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.284+0000 7f156b77c700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15640ca990 con 0x7f156415b8e0 2023-11-08T19:26:54.295 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.284+0000 7f1569d19700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15640c9fa0 0x7f15640ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:54.295 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.284+0000 7f1568d17700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f156415b8e0 0x7f15640b5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:54.295 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.284+0000 7f1569518700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f15640d12d0 0x7f15641f2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:54.295 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.284+0000 7f1569d19700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15640c9fa0 0x7f15640ca450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43506/0 (socket says 172.21.15.149:43506) 2023-11-08T19:26:54.295 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.284+0000 7f1568d17700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f156415b8e0 0x7f15640b5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.149:35560/0 (socket says 172.21.15.149:35560) 2023-11-08T19:26:54.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.284+0000 7f1569d19700 1 -- 172.21.15.149:0/533636118 learned_addr learned my addr 172.21.15.149:0/533636118 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:54.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.284+0000 7f1569d19700 1 -- 172.21.15.149:0/533636118 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f156415b8e0 msgr2=0x7f15640b5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:54.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.284+0000 7f1569d19700 1 --2- 172.21.15.149:0/533636118 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f156415b8e0 0x7f15640b5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:54.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.284+0000 7f1569d19700 1 -- 172.21.15.149:0/533636118 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f15640d12d0 msgr2=0x7f15641f2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:54.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.284+0000 7f1569d19700 1 --2- 172.21.15.149:0/533636118 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f15640d12d0 0x7f15641f2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:54.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.284+0000 7f1569d19700 1 -- 172.21.15.149:0/533636118 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1560009550 con 0x7f15640c9fa0 2023-11-08T19:26:54.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.284+0000 7f1568d17700 1 --2- 172.21.15.149:0/533636118 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f156415b8e0 0x7f15640b5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:26:54.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.285+0000 7f1569d19700 1 --2- 172.21.15.149:0/533636118 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15640c9fa0 0x7f15640ca450 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f155c00cbd0 tx=0x7f155c00cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:54.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.285+0000 7f1559ffb700 1 -- 172.21.15.149:0/533636118 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155c00aaa0 con 0x7f15640c9fa0 2023-11-08T19:26:54.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.285+0000 7f156b77c700 1 -- 172.21.15.149:0/533636118 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15640b3f20 con 0x7f15640c9fa0 2023-11-08T19:26:54.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.285+0000 7f1559ffb700 1 -- 172.21.15.149:0/533636118 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f155c00ac00 con 0x7f15640c9fa0 2023-11-08T19:26:54.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.285+0000 7f1559ffb700 1 -- 172.21.15.149:0/533636118 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155c007070 con 0x7f15640c9fa0 2023-11-08T19:26:54.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.285+0000 7f156b77c700 1 -- 172.21.15.149:0/533636118 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15640b44e0 con 0x7f15640c9fa0 2023-11-08T19:26:54.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.286+0000 7f156b77c700 1 -- 172.21.15.149:0/533636118 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f156404f730 con 0x7f15640c9fa0 2023-11-08T19:26:54.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.286+0000 7f1559ffb700 1 -- 172.21.15.149:0/533636118 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f155c0071d0 con 0x7f15640c9fa0 2023-11-08T19:26:54.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.287+0000 7f1559ffb700 1 --2- 172.21.15.149:0/533636118 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f154806af00 0x7f154806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:54.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.287+0000 7f1559ffb700 1 -- 172.21.15.149:0/533636118 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f155c0897f0 con 0x7f15640c9fa0 2023-11-08T19:26:54.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.287+0000 7f1569518700 1 --2- 172.21.15.149:0/533636118 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f154806af00 0x7f154806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:54.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.287+0000 7f1569518700 1 --2- 172.21.15.149:0/533636118 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f154806af00 0x7f154806d3c0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f15641f5ce0 tx=0x7f15540091c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:54.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.292+0000 7f1559ffb700 1 -- 172.21.15.149:0/533636118 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f155c054350 con 0x7f15640c9fa0 2023-11-08T19:26:54.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.564+0000 7f156b77c700 1 -- 172.21.15.149:0/533636118 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f156415eec0 con 0x7f15640c9fa0 2023-11-08T19:26:54.568 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.566+0000 7f1559ffb700 1 -- 172.21.15.149:0/533636118 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) v1 ==== 190+0+147 (secure 0 0 0) 0x7f155c0170b0 con 0x7f15640c9fa0 2023-11-08T19:26:54.569 INFO:teuthology.orchestra.run.smithi149.stdout:[client.0] 2023-11-08T19:26:54.569 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDi30tlQEEsNxAAiPozrOREh+IJXoj7ZkhvLg== 2023-11-08T19:26:54.569 INFO:teuthology.orchestra.run.smithi149.stdout: caps mds = "allow" 2023-11-08T19:26:54.570 INFO:teuthology.orchestra.run.smithi149.stdout: caps mon = "allow r" 2023-11-08T19:26:54.570 INFO:teuthology.orchestra.run.smithi149.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-08T19:26:54.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.569+0000 7f156b77c700 1 -- 172.21.15.149:0/533636118 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f154806af00 msgr2=0x7f154806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:54.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.569+0000 7f156b77c700 1 --2- 172.21.15.149:0/533636118 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f154806af00 0x7f154806d3c0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f15641f5ce0 tx=0x7f15540091c0 comp rx=0 tx=0).stop 2023-11-08T19:26:54.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.569+0000 7f156b77c700 1 -- 172.21.15.149:0/533636118 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15640c9fa0 msgr2=0x7f15640ca450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:54.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.569+0000 7f156b77c700 1 --2- 172.21.15.149:0/533636118 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15640c9fa0 0x7f15640ca450 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f155c00cbd0 tx=0x7f155c00cee0 comp rx=0 tx=0).stop 2023-11-08T19:26:54.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.569+0000 7f156b77c700 1 -- 172.21.15.149:0/533636118 shutdown_connections 2023-11-08T19:26:54.573 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.569+0000 7f156b77c700 1 --2- 172.21.15.149:0/533636118 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f154806af00 0x7f154806d3c0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:54.573 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.569+0000 7f156b77c700 1 --2- 172.21.15.149:0/533636118 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f15640d12d0 0x7f15641f2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:54.573 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.569+0000 7f156b77c700 1 --2- 172.21.15.149:0/533636118 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15640c9fa0 0x7f15640ca450 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:54.573 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.569+0000 7f156b77c700 1 --2- 172.21.15.149:0/533636118 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f156415b8e0 0x7f15640b5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:54.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.569+0000 7f156b77c700 1 -- 172.21.15.149:0/533636118 >> 172.21.15.149:0/533636118 conn(0x7f15640ce150 msgr2=0x7f15640d0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:54.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.569+0000 7f156b77c700 1 -- 172.21.15.149:0/533636118 shutdown_connections 2023-11-08T19:26:54.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.569+0000 7f156b77c700 1 -- 172.21.15.149:0/533636118 wait complete. 2023-11-08T19:26:54.575 INFO:teuthology.orchestra.run.smithi149.stderr:updated caps for client.0 2023-11-08T19:26:54.583 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:26:54.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.705+0000 7fce7c3cc700 1 Processor -- start 2023-11-08T19:26:54.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.705+0000 7fce7c3cc700 1 -- start start 2023-11-08T19:26:54.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.706+0000 7fce7c3cc700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fce7415a1a0 0x7fce7406e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:54.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.706+0000 7fce7c3cc700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fce7406da50 0x7fce7406bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:54.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.706+0000 7fce7c3cc700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce740cb220 con 0x7fce7406c0d0 2023-11-08T19:26:54.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.706+0000 7fce7c3cc700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce7415a580 con 0x7fce7415a1a0 2023-11-08T19:26:54.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.706+0000 7fce7c3cc700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce7406c560 con 0x7fce7406da50 2023-11-08T19:26:54.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.706+0000 7fce7a168700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fce7415a1a0 0x7fce7406e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:54.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.706+0000 7fce7a168700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fce7415a1a0 0x7fce7406e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43510/0 (socket says 172.21.15.149:43510) 2023-11-08T19:26:54.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.706+0000 7fce7a168700 1 -- 172.21.15.149:0/4277495156 learned_addr learned my addr 172.21.15.149:0/4277495156 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:54.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.706+0000 7fce79967700 1 --2- 172.21.15.149:0/4277495156 >> v2:172.21.15.160:3300/0 conn(0x7fce7406da50 0x7fce7406bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:54.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.706+0000 7fce7a168700 1 -- 172.21.15.149:0/4277495156 >> v2:172.21.15.160:3300/0 conn(0x7fce7406da50 msgr2=0x7fce7406bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:54.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.706+0000 7fce7a168700 1 --2- 172.21.15.149:0/4277495156 >> v2:172.21.15.160:3300/0 conn(0x7fce7406da50 0x7fce7406bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:54.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.706+0000 7fce7a168700 1 -- 172.21.15.149:0/4277495156 >> v1:172.21.15.160:6789/0 conn(0x7fce7406c0d0 legacy=0x7fce7415dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:54.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.706+0000 7fce7a168700 1 -- 172.21.15.149:0/4277495156 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce740cb500 con 0x7fce7415a1a0 2023-11-08T19:26:54.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.706+0000 7fce7a168700 1 --2- 172.21.15.149:0/4277495156 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce7415a1a0 0x7fce7406e940 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fce7406d240 tx=0x7fce70009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db298320181cfa31 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:54.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.706+0000 7fce79166700 1 -- 172.21.15.149:0/4277495156 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7000b870 con 0x7fce7415a1a0 2023-11-08T19:26:54.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.706+0000 7fce79166700 1 -- 172.21.15.149:0/4277495156 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce7000b9d0 con 0x7fce7415a1a0 2023-11-08T19:26:54.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.706+0000 7fce79166700 1 -- 172.21.15.149:0/4277495156 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7000bd60 con 0x7fce7415a1a0 2023-11-08T19:26:54.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.707+0000 7fce7c3cc700 1 -- 172.21.15.149:0/4277495156 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce7415a1a0 msgr2=0x7fce7406e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:54.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.707+0000 7fce7c3cc700 1 --2- 172.21.15.149:0/4277495156 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce7415a1a0 0x7fce7406e940 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fce7406d240 tx=0x7fce70009bd0 comp rx=0 tx=0).stop 2023-11-08T19:26:54.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.707+0000 7fce7c3cc700 1 -- 172.21.15.149:0/4277495156 shutdown_connections 2023-11-08T19:26:54.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.707+0000 7fce7c3cc700 1 --2- 172.21.15.149:0/4277495156 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce7415a1a0 0x7fce7406e940 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:54.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.707+0000 7fce7c3cc700 1 --2- 172.21.15.149:0/4277495156 >> v2:172.21.15.160:3300/0 conn(0x7fce7406da50 0x7fce7406bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:54.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.707+0000 7fce7c3cc700 1 -- 172.21.15.149:0/4277495156 >> 172.21.15.149:0/4277495156 conn(0x7fce74071720 msgr2=0x7fce74071b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:54.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.707+0000 7fce7c3cc700 1 -- 172.21.15.149:0/4277495156 shutdown_connections 2023-11-08T19:26:54.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.707+0000 7fce7c3cc700 1 -- 172.21.15.149:0/4277495156 wait complete. 2023-11-08T19:26:54.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.708+0000 7fce7c3cc700 1 Processor -- start 2023-11-08T19:26:54.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.708+0000 7fce7c3cc700 1 -- start start 2023-11-08T19:26:54.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.709+0000 7fce7c3cc700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce7406c0d0 0x7fce74156fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:54.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.709+0000 7fce7c3cc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce7406da50 0x7fce741485b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:54.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.709+0000 7fce7c3cc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce7415a1a0 0x7fce74157c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:54.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.709+0000 7fce7c3cc700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce740c64d0 con 0x7fce7406da50 2023-11-08T19:26:54.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.709+0000 7fce7c3cc700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce74157520 con 0x7fce7415a1a0 2023-11-08T19:26:54.719 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.709+0000 7fce7c3cc700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce740c6ca0 con 0x7fce7406c0d0 2023-11-08T19:26:54.719 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.709+0000 7fce79967700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce7406da50 0x7fce741485b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:54.719 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.709+0000 7fce79967700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce7406da50 0x7fce741485b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43516/0 (socket says 172.21.15.149:43516) 2023-11-08T19:26:54.719 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.709+0000 7fce79967700 1 -- 172.21.15.149:0/2822968745 learned_addr learned my addr 172.21.15.149:0/2822968745 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:54.719 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.709+0000 7fce7a969700 1 --2- 172.21.15.149:0/2822968745 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce7415a1a0 0x7fce74157c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:54.720 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.709+0000 7fce7a168700 1 --2- 172.21.15.149:0/2822968745 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce7406c0d0 0x7fce74156fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:54.720 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.709+0000 7fce79967700 1 -- 172.21.15.149:0/2822968745 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce7406c0d0 msgr2=0x7fce74156fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:54.720 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.709+0000 7fce79967700 1 --2- 172.21.15.149:0/2822968745 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce7406c0d0 0x7fce74156fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:54.720 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.709+0000 7fce79967700 1 -- 172.21.15.149:0/2822968745 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce7415a1a0 msgr2=0x7fce74157c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:54.721 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.709+0000 7fce79967700 1 --2- 172.21.15.149:0/2822968745 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce7415a1a0 0x7fce74157c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:54.721 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.709+0000 7fce79967700 1 -- 172.21.15.149:0/2822968745 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce70009550 con 0x7fce7406da50 2023-11-08T19:26:54.721 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.709+0000 7fce7a168700 1 --2- 172.21.15.149:0/2822968745 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce7406c0d0 0x7fce74156fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:26:54.721 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.710+0000 7fce79967700 1 --2- 172.21.15.149:0/2822968745 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce7406da50 0x7fce741485b0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fce6400e810 tx=0x7fce6400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:54.721 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.710+0000 7fce6affd700 1 -- 172.21.15.149:0/2822968745 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce64013610 con 0x7fce7406da50 2023-11-08T19:26:54.722 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.710+0000 7fce6affd700 1 -- 172.21.15.149:0/2822968745 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce64013770 con 0x7fce7406da50 2023-11-08T19:26:54.722 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.710+0000 7fce7c3cc700 1 -- 172.21.15.149:0/2822968745 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce74150d20 con 0x7fce7406da50 2023-11-08T19:26:54.722 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.710+0000 7fce6affd700 1 -- 172.21.15.149:0/2822968745 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce64013b20 con 0x7fce7406da50 2023-11-08T19:26:54.722 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.710+0000 7fce7c3cc700 1 -- 172.21.15.149:0/2822968745 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce740c69c0 con 0x7fce7406da50 2023-11-08T19:26:54.722 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.711+0000 7fce7c3cc700 1 -- 172.21.15.149:0/2822968745 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce74151330 con 0x7fce7406da50 2023-11-08T19:26:54.723 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.711+0000 7fce6affd700 1 -- 172.21.15.149:0/2822968745 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fce64013c80 con 0x7fce7406da50 2023-11-08T19:26:54.723 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.712+0000 7fce6affd700 1 --2- 172.21.15.149:0/2822968745 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fce5806af00 0x7fce5806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:54.723 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.712+0000 7fce6affd700 1 -- 172.21.15.149:0/2822968745 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7fce64089790 con 0x7fce7406da50 2023-11-08T19:26:54.723 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.712+0000 7fce7a168700 1 --2- 172.21.15.149:0/2822968745 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fce5806af00 0x7fce5806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:54.723 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.712+0000 7fce7a168700 1 --2- 172.21.15.149:0/2822968745 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fce5806af00 0x7fce5806d3c0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fce70014040 tx=0x7fce70008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:54.726 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.717+0000 7fce6affd700 1 -- 172.21.15.149:0/2822968745 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fce640542d0 con 0x7fce7406da50 2023-11-08T19:26:54.948 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.946+0000 7fce7c3cc700 1 -- 172.21.15.149:0/2822968745 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fce740745f0 con 0x7fce7406da50 2023-11-08T19:26:54.949 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.946+0000 7fce6affd700 1 -- 172.21.15.149:0/2822968745 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4924 (secure 0 0 0) 0x7fce640578f0 con 0x7fce7406da50 2023-11-08T19:26:54.949 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:26:54.949 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":54,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6451,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/2947079163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2947079163},{"type":"v1","addr":"172.21.15.160:6834","nonce":2947079163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49},{"gid":7122,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/589971879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":589971879},{"type":"v1","addr":"172.21.15.149:6836","nonce":589971879}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49},{"gid":7125,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/3917392643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3917392643},{"type":"v1","addr":"172.21.15.149:6837","nonce":3917392643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:26:51.999760+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7140},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7140":{"gid":7140,"name":"b","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.160:6835/2714564224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":2714564224},{"type":"v1","addr":"172.21.15.160:6835","nonce":2714564224}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:26:54.951 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.948+0000 7fce7c3cc700 1 -- 172.21.15.149:0/2822968745 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fce5806af00 msgr2=0x7fce5806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:54.952 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.948+0000 7fce7c3cc700 1 --2- 172.21.15.149:0/2822968745 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fce5806af00 0x7fce5806d3c0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fce70014040 tx=0x7fce70008030 comp rx=0 tx=0).stop 2023-11-08T19:26:54.952 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.948+0000 7fce7c3cc700 1 -- 172.21.15.149:0/2822968745 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce7406da50 msgr2=0x7fce741485b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:54.952 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.948+0000 7fce7c3cc700 1 --2- 172.21.15.149:0/2822968745 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce7406da50 0x7fce741485b0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fce6400e810 tx=0x7fce6400eb20 comp rx=0 tx=0).stop 2023-11-08T19:26:54.952 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.948+0000 7fce7c3cc700 1 -- 172.21.15.149:0/2822968745 shutdown_connections 2023-11-08T19:26:54.952 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.948+0000 7fce7c3cc700 1 --2- 172.21.15.149:0/2822968745 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fce5806af00 0x7fce5806d3c0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:54.952 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.948+0000 7fce7c3cc700 1 --2- 172.21.15.149:0/2822968745 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce7415a1a0 0x7fce74157c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:54.953 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.948+0000 7fce7c3cc700 1 --2- 172.21.15.149:0/2822968745 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce7406c0d0 0x7fce74156fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:54.953 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.948+0000 7fce7c3cc700 1 --2- 172.21.15.149:0/2822968745 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce7406da50 0x7fce741485b0 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:54.953 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.948+0000 7fce7c3cc700 1 -- 172.21.15.149:0/2822968745 >> 172.21.15.149:0/2822968745 conn(0x7fce74071720 msgr2=0x7fce7406ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:54.953 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.948+0000 7fce7c3cc700 1 -- 172.21.15.149:0/2822968745 shutdown_connections 2023-11-08T19:26:54.953 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:54.949+0000 7fce7c3cc700 1 -- 172.21.15.149:0/2822968745 wait complete. 2023-11-08T19:26:54.954 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 54 2023-11-08T19:26:55.365 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 54, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-08T19:26:48.987203+0000', 'modified': '2023-11-08T19:26:51.999760+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7140}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7140': {'gid': 7140, 'name': 'b', 'rank': 0, 'incarnation': 50, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.160:6835/2714564224', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6833', 'nonce': 2714564224}, {'type': 'v1', 'addr': '172.21.15.160:6835', 'nonce': 2714564224}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-08T19:26:55.366 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-08T19:26:55.366 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-11-08T19:26:55.490 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.488+0000 7fc3777dd700 1 Processor -- start 2023-11-08T19:26:55.490 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.488+0000 7fc3777dd700 1 -- start start 2023-11-08T19:26:55.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.489+0000 7fc3777dd700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fc3700d0fe0 0x7fc3700c8680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:55.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.489+0000 7fc3777dd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc3700cc9a0 0x7fc3700c8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:55.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.489+0000 7fc3777dd700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc37015bd30 con 0x7fc37015b950 2023-11-08T19:26:55.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.489+0000 7fc3777dd700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3700caa90 con 0x7fc3700cc9a0 2023-11-08T19:26:55.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.489+0000 7fc3777dd700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3700c7670 con 0x7fc3700d0fe0 2023-11-08T19:26:55.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.489+0000 7fc375d7a700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc3700cc9a0 0x7fc3700c8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:55.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.489+0000 7fc375d7a700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc3700cc9a0 0x7fc3700c8bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43528/0 (socket says 172.21.15.149:43528) 2023-11-08T19:26:55.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.489+0000 7fc375579700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fc37015b950 0x7fc3700cc290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:45526/0 (socket says 172.21.15.149:45526) 2023-11-08T19:26:55.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.489+0000 7fc375d7a700 1 -- 172.21.15.149:0/2497325765 learned_addr learned my addr 172.21.15.149:0/2497325765 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:55.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.489+0000 7fc374d78700 1 --2- 172.21.15.149:0/2497325765 >> v2:172.21.15.160:3300/0 conn(0x7fc3700d0fe0 0x7fc3700c8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:55.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.489+0000 7fc375d7a700 1 -- 172.21.15.149:0/2497325765 >> v2:172.21.15.160:3300/0 conn(0x7fc3700d0fe0 msgr2=0x7fc3700c8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:55.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.489+0000 7fc375d7a700 1 --2- 172.21.15.149:0/2497325765 >> v2:172.21.15.160:3300/0 conn(0x7fc3700d0fe0 0x7fc3700c8680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:55.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.489+0000 7fc375d7a700 1 -- 172.21.15.149:0/2497325765 >> v1:172.21.15.149:6789/0 conn(0x7fc37015b950 legacy=0x7fc3700cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:55.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.489+0000 7fc367fff700 1 -- 172.21.15.149:0/2497325765 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3604540541 0 0) 0x7fc37015bd30 con 0x7fc37015b950 2023-11-08T19:26:55.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.489+0000 7fc375d7a700 1 -- 172.21.15.149:0/2497325765 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3700c81f0 con 0x7fc3700cc9a0 2023-11-08T19:26:55.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.490+0000 7fc375d7a700 1 --2- 172.21.15.149:0/2497325765 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3700cc9a0 0x7fc3700c8bc0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fc3700b31c0 tx=0x7fc36800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e6fec1dd22f649c server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:55.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.490+0000 7fc367fff700 1 -- 172.21.15.149:0/2497325765 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36800e070 con 0x7fc3700cc9a0 2023-11-08T19:26:55.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.490+0000 7fc367fff700 1 -- 172.21.15.149:0/2497325765 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc36800b9c0 con 0x7fc3700cc9a0 2023-11-08T19:26:55.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.490+0000 7fc367fff700 1 -- 172.21.15.149:0/2497325765 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36800bd70 con 0x7fc3700cc9a0 2023-11-08T19:26:55.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.490+0000 7fc3777dd700 1 -- 172.21.15.149:0/2497325765 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3700cc9a0 msgr2=0x7fc3700c8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:55.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.490+0000 7fc3777dd700 1 --2- 172.21.15.149:0/2497325765 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3700cc9a0 0x7fc3700c8bc0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fc3700b31c0 tx=0x7fc36800b330 comp rx=0 tx=0).stop 2023-11-08T19:26:55.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.490+0000 7fc3777dd700 1 -- 172.21.15.149:0/2497325765 shutdown_connections 2023-11-08T19:26:55.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.490+0000 7fc3777dd700 1 --2- 172.21.15.149:0/2497325765 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3700cc9a0 0x7fc3700c8bc0 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:55.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.490+0000 7fc3777dd700 1 --2- 172.21.15.149:0/2497325765 >> v2:172.21.15.160:3300/0 conn(0x7fc3700d0fe0 0x7fc3700c8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:55.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.490+0000 7fc3777dd700 1 -- 172.21.15.149:0/2497325765 >> 172.21.15.149:0/2497325765 conn(0x7fc370099a40 msgr2=0x7fc3700d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:55.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.490+0000 7fc3777dd700 1 -- 172.21.15.149:0/2497325765 shutdown_connections 2023-11-08T19:26:55.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.490+0000 7fc3777dd700 1 -- 172.21.15.149:0/2497325765 wait complete. 2023-11-08T19:26:55.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.491+0000 7fc3777dd700 1 Processor -- start 2023-11-08T19:26:55.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.492+0000 7fc3777dd700 1 -- start start 2023-11-08T19:26:55.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.492+0000 7fc3777dd700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc3700cc9a0 0x7fc370153ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:55.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.492+0000 7fc3777dd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3700d0fe0 0x7fc370145340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:55.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.492+0000 7fc3777dd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc37015b950 0x7fc37009d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:55.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.492+0000 7fc3777dd700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3700c3a30 con 0x7fc3700d0fe0 2023-11-08T19:26:55.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.492+0000 7fc3777dd700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc370145880 con 0x7fc37015b950 2023-11-08T19:26:55.509 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.492+0000 7fc3777dd700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3701f0dd0 con 0x7fc3700cc9a0 2023-11-08T19:26:55.509 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.492+0000 7fc374d78700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3700d0fe0 0x7fc370145340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:55.510 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.492+0000 7fc374d78700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3700d0fe0 0x7fc370145340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43532/0 (socket says 172.21.15.149:43532) 2023-11-08T19:26:55.510 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.492+0000 7fc374d78700 1 -- 172.21.15.149:0/4293991441 learned_addr learned my addr 172.21.15.149:0/4293991441 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:55.510 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.493+0000 7fc375579700 1 --2- 172.21.15.149:0/4293991441 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc3700cc9a0 0x7fc370153ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:55.511 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.493+0000 7fc375d7a700 1 --2- 172.21.15.149:0/4293991441 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc37015b950 0x7fc37009d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:55.511 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.493+0000 7fc374d78700 1 -- 172.21.15.149:0/4293991441 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc3700cc9a0 msgr2=0x7fc370153ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:55.511 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.493+0000 7fc374d78700 1 --2- 172.21.15.149:0/4293991441 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc3700cc9a0 0x7fc370153ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:55.512 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.493+0000 7fc374d78700 1 -- 172.21.15.149:0/4293991441 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc37015b950 msgr2=0x7fc37009d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:55.512 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.493+0000 7fc374d78700 1 --2- 172.21.15.149:0/4293991441 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc37015b950 0x7fc37009d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:55.512 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.493+0000 7fc374d78700 1 -- 172.21.15.149:0/4293991441 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc368009b30 con 0x7fc3700d0fe0 2023-11-08T19:26:55.513 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.493+0000 7fc375579700 1 --2- 172.21.15.149:0/4293991441 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc3700cc9a0 0x7fc370153ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:26:55.513 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.493+0000 7fc375d7a700 1 --2- 172.21.15.149:0/4293991441 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc37015b950 0x7fc37009d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:26:55.513 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.493+0000 7fc374d78700 1 --2- 172.21.15.149:0/4293991441 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3700d0fe0 0x7fc370145340 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fc36000c7f0 tx=0x7fc36000cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:55.513 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.493+0000 7fc365ffb700 1 -- 172.21.15.149:0/4293991441 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc360011800 con 0x7fc3700d0fe0 2023-11-08T19:26:55.514 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.493+0000 7fc365ffb700 1 -- 172.21.15.149:0/4293991441 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc360011960 con 0x7fc3700d0fe0 2023-11-08T19:26:55.514 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.493+0000 7fc3777dd700 1 -- 172.21.15.149:0/4293991441 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc37009de50 con 0x7fc3700d0fe0 2023-11-08T19:26:55.514 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.493+0000 7fc365ffb700 1 -- 172.21.15.149:0/4293991441 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc360011cf0 con 0x7fc3700d0fe0 2023-11-08T19:26:55.514 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.493+0000 7fc3777dd700 1 -- 172.21.15.149:0/4293991441 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3701460c0 con 0x7fc3700d0fe0 2023-11-08T19:26:55.514 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.494+0000 7fc365ffb700 1 -- 172.21.15.149:0/4293991441 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc360018360 con 0x7fc3700d0fe0 2023-11-08T19:26:55.515 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.495+0000 7fc365ffb700 1 --2- 172.21.15.149:0/4293991441 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc35406af00 0x7fc35406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:55.515 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.495+0000 7fc365ffb700 1 -- 172.21.15.149:0/4293991441 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7fc360089b20 con 0x7fc3700d0fe0 2023-11-08T19:26:55.515 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.495+0000 7fc375579700 1 --2- 172.21.15.149:0/4293991441 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc35406af00 0x7fc35406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:55.515 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.495+0000 7fc375579700 1 --2- 172.21.15.149:0/4293991441 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc35406af00 0x7fc35406d3c0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fc36c007fd0 tx=0x7fc36c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:55.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.497+0000 7fc3839d6b80 1 Processor -- start 2023-11-08T19:26:55.522 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.497+0000 7fc3839d6b80 1 -- start start 2023-11-08T19:26:55.522 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.498+0000 7fc3839d6b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b0f3c49b30 0x55b0f3c2c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:55.522 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.498+0000 7fc3839d6b80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55b0f3c4a5d0 0x55b0f3c2c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:55.523 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.498+0000 7fc3839d6b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b0f3c00450 0x55b0f3bfc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:55.523 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.498+0000 7fc3839d6b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0f3b686e0 con 0x55b0f3c00450 2023-11-08T19:26:55.523 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.498+0000 7fc3839d6b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0f3b5c3b0 con 0x55b0f3c49b30 2023-11-08T19:26:55.523 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.498+0000 7fc3839d6b80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b0f3b59cd0 con 0x55b0f3c4a5d0 2023-11-08T19:26:55.523 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.498+0000 7fc375d7a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b0f3c00450 0x55b0f3bfc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:55.524 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.498+0000 7fc375d7a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b0f3c00450 0x55b0f3bfc4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43542/0 (socket says 172.21.15.149:43542) 2023-11-08T19:26:55.524 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.498+0000 7fc375d7a700 1 -- 172.21.15.149:0/1854600138 learned_addr learned my addr 172.21.15.149:0/1854600138 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:55.524 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.498+0000 7fc375579700 1 --2- 172.21.15.149:0/1854600138 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b0f3c49b30 0x55b0f3c2c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:55.524 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.498+0000 7fc374d78700 1 --2- 172.21.15.149:0/1854600138 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55b0f3c4a5d0 0x55b0f3c2c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:55.525 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.498+0000 7fc375d7a700 1 -- 172.21.15.149:0/1854600138 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55b0f3c4a5d0 msgr2=0x55b0f3c2c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:55.525 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.498+0000 7fc375d7a700 1 --2- 172.21.15.149:0/1854600138 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55b0f3c4a5d0 0x55b0f3c2c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:55.525 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.498+0000 7fc375d7a700 1 -- 172.21.15.149:0/1854600138 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b0f3c49b30 msgr2=0x55b0f3c2c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:55.525 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.498+0000 7fc375d7a700 1 --2- 172.21.15.149:0/1854600138 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b0f3c49b30 0x55b0f3c2c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:55.526 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.498+0000 7fc375d7a700 1 -- 172.21.15.149:0/1854600138 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b0f39d25e0 con 0x55b0f3c00450 2023-11-08T19:26:55.526 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.498+0000 7fc375d7a700 1 --2- 172.21.15.149:0/1854600138 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b0f3c00450 0x55b0f3bfc4c0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fc3700b3220 tx=0x7fc368010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48f667642e236058 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:55.526 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.498+0000 7fc35affd700 1 -- 172.21.15.149:0/1854600138 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc368003a20 con 0x55b0f3c00450 2023-11-08T19:26:55.526 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.498+0000 7fc35affd700 1 -- 172.21.15.149:0/1854600138 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc368003b80 con 0x55b0f3c00450 2023-11-08T19:26:55.527 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.498+0000 7fc35affd700 1 -- 172.21.15.149:0/1854600138 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc368004040 con 0x55b0f3c00450 2023-11-08T19:26:55.527 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.499+0000 7fc3839d6b80 1 -- 172.21.15.149:0/1854600138 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b0f3c00450 msgr2=0x55b0f3bfc4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:55.527 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.499+0000 7fc3839d6b80 1 --2- 172.21.15.149:0/1854600138 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b0f3c00450 0x55b0f3bfc4c0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fc3700b3220 tx=0x7fc368010000 comp rx=0 tx=0).stop 2023-11-08T19:26:55.528 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.499+0000 7fc3839d6b80 1 -- 172.21.15.149:0/1854600138 shutdown_connections 2023-11-08T19:26:55.528 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.499+0000 7fc3839d6b80 1 --2- 172.21.15.149:0/1854600138 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b0f3c49b30 0x55b0f3c2c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:55.528 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.499+0000 7fc3839d6b80 1 --2- 172.21.15.149:0/1854600138 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b0f3c00450 0x55b0f3bfc4c0 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:55.528 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.499+0000 7fc3839d6b80 1 --2- 172.21.15.149:0/1854600138 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55b0f3c4a5d0 0x55b0f3c2c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:55.528 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.499+0000 7fc3839d6b80 1 -- 172.21.15.149:0/1854600138 >> 172.21.15.149:0/1854600138 conn(0x55b0f3b77660 msgr2=0x55b0f3c023c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:55.529 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.499+0000 7fc3839d6b80 1 -- 172.21.15.149:0/1854600138 shutdown_connections 2023-11-08T19:26:55.529 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.499+0000 7fc3839d6b80 1 -- 172.21.15.149:0/1854600138 wait complete. 2023-11-08T19:26:55.529 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.500+0000 7fc3839d6b80 1 -- start start 2023-11-08T19:26:55.529 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.500+0000 7fc3839d6b80 1 Processor -- start 2023-11-08T19:26:55.529 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.501+0000 7fc3839d6b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b0f3c00450 0x55b0f3c0fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:55.530 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.501+0000 7fc3839d6b80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55b0f3c49b30 0x55b0f3c2f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:55.530 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.501+0000 7fc3839d6b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b0f3c4a5d0 0x55b0f3c2d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:55.530 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.501+0000 7fc3839d6b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0f3b555c0 con 0x55b0f3c4a5d0 2023-11-08T19:26:55.530 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.501+0000 7fc3839d6b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0f3af10d0 con 0x55b0f3c00450 2023-11-08T19:26:55.530 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.501+0000 7fc3839d6b80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b0f3af0d70 con 0x55b0f3c49b30 2023-11-08T19:26:55.531 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.501+0000 7fc3839d6b80 10 client.0 _ll_register_callbacks cb 0x55b0f394d7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-08T19:26:55.531 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.501+0000 7fc375d7a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b0f3c4a5d0 0x55b0f3c2d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:55.531 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.501+0000 7fc375d7a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b0f3c4a5d0 0x55b0f3c2d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43548/0 (socket says 172.21.15.149:43548) 2023-11-08T19:26:55.531 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.501+0000 7fc375d7a700 1 -- 172.21.15.149:0/2754815983 learned_addr learned my addr 172.21.15.149:0/2754815983 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:55.531 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.501+0000 7fc374d78700 1 --2- 172.21.15.149:0/2754815983 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55b0f3c49b30 0x55b0f3c2f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:55.532 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.501+0000 7fc375579700 1 --2- 172.21.15.149:0/2754815983 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b0f3c00450 0x55b0f3c0fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:55.532 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.501+0000 7fc375d7a700 1 -- 172.21.15.149:0/2754815983 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55b0f3c49b30 msgr2=0x55b0f3c2f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:55.533 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.501+0000 7fc375d7a700 1 --2- 172.21.15.149:0/2754815983 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55b0f3c49b30 0x55b0f3c2f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:55.533 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.501+0000 7fc375d7a700 1 -- 172.21.15.149:0/2754815983 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b0f3c00450 msgr2=0x55b0f3c0fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:55.534 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.501+0000 7fc375d7a700 1 --2- 172.21.15.149:0/2754815983 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b0f3c00450 0x55b0f3c0fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:55.534 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.501+0000 7fc375d7a700 1 -- 172.21.15.149:0/2754815983 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3700c81f0 con 0x55b0f3c4a5d0 2023-11-08T19:26:55.535 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.501+0000 7fc375d7a700 1 --2- 172.21.15.149:0/2754815983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b0f3c4a5d0 0x55b0f3c2d650 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fc36800b730 tx=0x7fc368004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1e3492dda28c705 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:55.535 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.501+0000 7fc34ffff700 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2023-11-08T19:26:55.535 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.501+0000 7fc34ffff700 1 -- 172.21.15.149:0/2754815983 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc368029070 con 0x55b0f3c4a5d0 2023-11-08T19:26:55.536 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.501+0000 7fc34ffff700 1 -- 172.21.15.149:0/2754815983 <== mon.0 v2:172.21.15.149:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7fc36801c900 con 0x55b0f3c4a5d0 2023-11-08T19:26:55.536 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.502+0000 7fc3839d6b80 1 -- 172.21.15.149:0/2754815983 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b0f3bf4880 con 0x55b0f3c4a5d0 2023-11-08T19:26:55.537 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.502+0000 7fc34ffff700 1 -- 172.21.15.149:0/2754815983 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc36801cac0 con 0x55b0f3c4a5d0 2023-11-08T19:26:55.537 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.502+0000 7fc3839d6b80 10 client.7296 fetch_fsmap learned FSMap version 54 2023-11-08T19:26:55.537 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.502+0000 7fc3839d6b80 1 -- 172.21.15.149:0/2754815983 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) v3 -- 0x55b0f397ed90 con 0x55b0f3c4a5d0 2023-11-08T19:26:55.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.502+0000 7fc34ffff700 1 -- 172.21.15.149:0/2754815983 <== mon.0 v2:172.21.15.149:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b0f3bf4880 con 0x55b0f3c4a5d0 2023-11-08T19:26:55.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.502+0000 7fc34ffff700 1 -- 172.21.15.149:0/2754815983 <== mon.0 v2:172.21.15.149:3300/0 5 ==== fsmap(e 54) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc368022030 con 0x55b0f3c4a5d0 2023-11-08T19:26:55.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.502+0000 7fc3839d6b80 10 client.7296 fetch_fsmap finished waiting for FSMap version 54 2023-11-08T19:26:55.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.502+0000 7fc3839d6b80 10 client.7296 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-08T19:26:55.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.502+0000 7fc3839d6b80 20 client.7296 populate_metadata read hostname 'smithi149' 2023-11-08T19:26:55.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.502+0000 7fc3839d6b80 1 --2- 172.21.15.149:0/2754815983 >> [v2:172.21.15.160:6833/2714564224,v1:172.21.15.160:6835/2714564224] conn(0x55b0f3c406a0 0x55b0f3c40a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:55.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.502+0000 7fc3839d6b80 4 client.7296 mds_command: new command op to 7140 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-08T19:26:55.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.502+0000 7fc3839d6b80 1 -- 172.21.15.149:0/2754815983 --> [v2:172.21.15.160:6833/2714564224,v1:172.21.15.160:6835/2714564224] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b0f3bd0a30 con 0x55b0f3c406a0 2023-11-08T19:26:55.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.502+0000 7fc375579700 1 --2- 172.21.15.149:0/2754815983 >> [v2:172.21.15.160:6833/2714564224,v1:172.21.15.160:6835/2714564224] conn(0x55b0f3c406a0 0x55b0f3c40a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:55.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.503+0000 7fc34ffff700 10 client.7296 ms_handle_connect on v2:172.21.15.160:6833/2714564224 2023-11-08T19:26:55.542 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.503+0000 7fc375579700 1 --2- 172.21.15.149:0/2754815983 >> [v2:172.21.15.160:6833/2714564224,v1:172.21.15.160:6835/2714564224] conn(0x55b0f3c406a0 0x55b0f3c40a80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e74ff06e45278933 server_cookie=958ec66c4ad145d1 in_seq=0 out_seq=0 2023-11-08T19:26:55.542 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.503+0000 7fc34ffff700 1 -- 172.21.15.149:0/2754815983 <== mds.0 v2:172.21.15.160:6833/2714564224 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b0f3bd0a30 con 0x55b0f3c406a0 2023-11-08T19:26:55.543 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.503+0000 7fc34ffff700 10 client.7296 handle_command_reply: tid=0 2023-11-08T19:26:55.543 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.503+0000 7fc3839d6b80 1 client.7296 shutdown 2023-11-08T19:26:55.544 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.503+0000 7fc3839d6b80 1 -- 172.21.15.149:0/2754815983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b0f3c4a5d0 msgr2=0x55b0f3c2d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:55.544 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.503+0000 7fc3839d6b80 1 --2- 172.21.15.149:0/2754815983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b0f3c4a5d0 0x55b0f3c2d650 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fc36800b730 tx=0x7fc368004b40 comp rx=0 tx=0).stop 2023-11-08T19:26:55.545 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.503+0000 7fc3839d6b80 1 -- 172.21.15.149:0/2754815983 shutdown_connections 2023-11-08T19:26:55.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.503+0000 7fc3839d6b80 1 --2- 172.21.15.149:0/2754815983 >> [v2:172.21.15.160:6833/2714564224,v1:172.21.15.160:6835/2714564224] conn(0x55b0f3c406a0 0x55b0f3c40a80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:55.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.503+0000 7fc3839d6b80 1 --2- 172.21.15.149:0/2754815983 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b0f3c00450 0x55b0f3c0fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:55.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.503+0000 7fc3839d6b80 1 --2- 172.21.15.149:0/2754815983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b0f3c4a5d0 0x55b0f3c2d650 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:55.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.503+0000 7fc3839d6b80 1 --2- 172.21.15.149:0/2754815983 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55b0f3c49b30 0x55b0f3c2f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:55.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.504+0000 7fc3839d6b80 1 -- 172.21.15.149:0/2754815983 >> 172.21.15.149:0/2754815983 conn(0x55b0f3b77660 msgr2=0x55b0f3bff8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:55.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.504+0000 7fc34ffff700 0 client.7296 ms_handle_reset on v2:172.21.15.160:6833/2714564224 2023-11-08T19:26:55.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.504+0000 7fc3839d6b80 1 -- 172.21.15.149:0/2754815983 shutdown_connections 2023-11-08T19:26:55.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.504+0000 7fc3839d6b80 1 -- 172.21.15.149:0/2754815983 wait complete. 2023-11-08T19:26:55.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.504+0000 7fc3839d6b80 20 client.7296 trim_cache size 0 max 16384 2023-11-08T19:26:55.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.521+0000 7fc3839d6b80 1 Processor -- start 2023-11-08T19:26:55.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.522+0000 7fc3839d6b80 1 -- start start 2023-11-08T19:26:55.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.522+0000 7fc3839d6b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b0f3c00450 0x55b0f3c16c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:55.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.522+0000 7fc3839d6b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b0f3c49b30 0x55b0f3c48fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:55.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.522+0000 7fc3839d6b80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55b0f3c4a5d0 0x55b0f3c494e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:55.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.522+0000 7fc3839d6b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0f39d48d0 con 0x55b0f3c49b30 2023-11-08T19:26:55.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.522+0000 7fc3839d6b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0f3c29f50 con 0x55b0f3c00450 2023-11-08T19:26:55.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.522+0000 7fc3839d6b80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b0f3c01320 con 0x55b0f3c4a5d0 2023-11-08T19:26:55.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.522+0000 7fc374d78700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b0f3c49b30 0x55b0f3c48fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:55.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.522+0000 7fc374d78700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b0f3c49b30 0x55b0f3c48fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43554/0 (socket says 172.21.15.149:43554) 2023-11-08T19:26:55.567 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.522+0000 7fc374d78700 1 -- 172.21.15.149:0/1861200370 learned_addr learned my addr 172.21.15.149:0/1861200370 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:55.567 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.522+0000 7fc375579700 1 --2- 172.21.15.149:0/1861200370 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b0f3c00450 0x55b0f3c16c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:55.568 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.522+0000 7fc375d7a700 1 --2- 172.21.15.149:0/1861200370 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55b0f3c4a5d0 0x55b0f3c494e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:55.568 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.523+0000 7fc374d78700 1 -- 172.21.15.149:0/1861200370 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55b0f3c4a5d0 msgr2=0x55b0f3c494e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:55.569 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.523+0000 7fc374d78700 1 --2- 172.21.15.149:0/1861200370 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55b0f3c4a5d0 0x55b0f3c494e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:55.569 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.523+0000 7fc374d78700 1 -- 172.21.15.149:0/1861200370 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b0f3c00450 msgr2=0x55b0f3c16c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:55.570 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.523+0000 7fc374d78700 1 --2- 172.21.15.149:0/1861200370 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b0f3c00450 0x55b0f3c16c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:55.570 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.523+0000 7fc374d78700 1 -- 172.21.15.149:0/1861200370 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b0f3967c10 con 0x55b0f3c49b30 2023-11-08T19:26:55.570 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.523+0000 7fc375579700 1 --2- 172.21.15.149:0/1861200370 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b0f3c00450 0x55b0f3c16c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:26:55.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.523+0000 7fc374d78700 1 --2- 172.21.15.149:0/1861200370 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b0f3c49b30 0x55b0f3c48fa0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fc360087b80 tx=0x7fc360089040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14ad533dabb2df23 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:55.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.523+0000 7fc35b7fe700 1 -- 172.21.15.149:0/1861200370 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc360060620 con 0x55b0f3c49b30 2023-11-08T19:26:55.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.523+0000 7fc35b7fe700 1 -- 172.21.15.149:0/1861200370 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3600566c0 con 0x55b0f3c49b30 2023-11-08T19:26:55.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.523+0000 7fc35b7fe700 1 -- 172.21.15.149:0/1861200370 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc360057810 con 0x55b0f3c49b30 2023-11-08T19:26:55.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.523+0000 7fc3839d6b80 1 -- 172.21.15.149:0/1861200370 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b0f3c49b30 msgr2=0x55b0f3c48fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:55.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.523+0000 7fc3839d6b80 1 --2- 172.21.15.149:0/1861200370 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b0f3c49b30 0x55b0f3c48fa0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fc360087b80 tx=0x7fc360089040 comp rx=0 tx=0).stop 2023-11-08T19:26:55.573 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.523+0000 7fc3839d6b80 1 -- 172.21.15.149:0/1861200370 shutdown_connections 2023-11-08T19:26:55.573 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.523+0000 7fc3839d6b80 1 --2- 172.21.15.149:0/1861200370 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b0f3c00450 0x55b0f3c16c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:55.573 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.523+0000 7fc3839d6b80 1 --2- 172.21.15.149:0/1861200370 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55b0f3c4a5d0 0x55b0f3c494e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:55.573 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.523+0000 7fc3839d6b80 1 --2- 172.21.15.149:0/1861200370 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b0f3c49b30 0x55b0f3c48fa0 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:55.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.523+0000 7fc3839d6b80 1 -- 172.21.15.149:0/1861200370 >> 172.21.15.149:0/1861200370 conn(0x55b0f3b77660 msgr2=0x55b0f3bf87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:55.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.523+0000 7fc3839d6b80 1 -- 172.21.15.149:0/1861200370 shutdown_connections 2023-11-08T19:26:55.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.523+0000 7fc3839d6b80 1 -- 172.21.15.149:0/1861200370 wait complete. 2023-11-08T19:26:55.575 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.524+0000 7fc3839d6b80 1 -- start start 2023-11-08T19:26:55.575 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.524+0000 7fc3839d6b80 1 Processor -- start 2023-11-08T19:26:55.575 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.525+0000 7fc3839d6b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b0f3c00450 0x55b0f3cb3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:55.575 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.525+0000 7fc3839d6b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b0f3c49b30 0x55b0f3c642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:55.575 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.525+0000 7fc3839d6b80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55b0f3c4a5d0 0x55b0f3c64800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:55.576 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.525+0000 7fc3839d6b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0f3c0f090 con 0x55b0f3c00450 2023-11-08T19:26:55.576 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.525+0000 7fc3839d6b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0f3bf8b00 con 0x55b0f3c49b30 2023-11-08T19:26:55.576 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.525+0000 7fc3839d6b80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b0f3c15f60 con 0x55b0f3c4a5d0 2023-11-08T19:26:55.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.525+0000 7fc3839d6b80 10 client.0 _ll_register_callbacks cb 0x7fc3680092e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-08T19:26:55.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.525+0000 7fc375579700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b0f3c00450 0x55b0f3cb3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:55.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.525+0000 7fc375579700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b0f3c00450 0x55b0f3cb3910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43558/0 (socket says 172.21.15.149:43558) 2023-11-08T19:26:55.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.525+0000 7fc375579700 1 -- 172.21.15.149:0/2000824498 learned_addr learned my addr 172.21.15.149:0/2000824498 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:55.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.525+0000 7fc375d7a700 1 --2- 172.21.15.149:0/2000824498 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55b0f3c4a5d0 0x55b0f3c64800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:55.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.525+0000 7fc374d78700 1 --2- 172.21.15.149:0/2000824498 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b0f3c49b30 0x55b0f3c642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:55.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.525+0000 7fc375579700 1 -- 172.21.15.149:0/2000824498 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55b0f3c4a5d0 msgr2=0x55b0f3c64800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:55.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.525+0000 7fc375579700 1 --2- 172.21.15.149:0/2000824498 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55b0f3c4a5d0 0x55b0f3c64800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:55.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.525+0000 7fc375579700 1 -- 172.21.15.149:0/2000824498 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b0f3c49b30 msgr2=0x55b0f3c642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:55.580 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.525+0000 7fc375579700 1 --2- 172.21.15.149:0/2000824498 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b0f3c49b30 0x55b0f3c642c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:55.580 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.525+0000 7fc375579700 1 -- 172.21.15.149:0/2000824498 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3701460c0 con 0x55b0f3c00450 2023-11-08T19:26:55.580 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.525+0000 7fc375d7a700 1 --2- 172.21.15.149:0/2000824498 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55b0f3c4a5d0 0x55b0f3c64800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:26:55.581 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.525+0000 7fc375579700 1 --2- 172.21.15.149:0/2000824498 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b0f3c00450 0x55b0f3cb3910 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x55b0f3c03b10 tx=0x7fc36c007980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a57fd87742bc2e59 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:55.581 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.525+0000 7fc34ffff700 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2023-11-08T19:26:55.581 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.526+0000 7fc34ffff700 1 -- 172.21.15.149:0/2000824498 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36c005d00 con 0x55b0f3c00450 2023-11-08T19:26:55.582 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.526+0000 7fc34ffff700 1 -- 172.21.15.149:0/2000824498 <== mon.0 v2:172.21.15.149:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7fc36c012410 con 0x55b0f3c00450 2023-11-08T19:26:55.582 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.526+0000 7fc3839d6b80 1 -- 172.21.15.149:0/2000824498 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc368003b80 con 0x55b0f3c00450 2023-11-08T19:26:55.582 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.526+0000 7fc34ffff700 1 -- 172.21.15.149:0/2000824498 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc36c032070 con 0x55b0f3c00450 2023-11-08T19:26:55.583 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.526+0000 7fc3839d6b80 10 client.7302 fetch_fsmap learned FSMap version 54 2023-11-08T19:26:55.583 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.526+0000 7fc3839d6b80 1 -- 172.21.15.149:0/2000824498 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) v3 -- 0x55b0f39a5200 con 0x55b0f3c00450 2023-11-08T19:26:55.583 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.526+0000 7fc34ffff700 1 -- 172.21.15.149:0/2000824498 <== mon.0 v2:172.21.15.149:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc368003b80 con 0x55b0f3c00450 2023-11-08T19:26:55.584 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.526+0000 7fc34ffff700 1 -- 172.21.15.149:0/2000824498 <== mon.0 v2:172.21.15.149:3300/0 5 ==== fsmap(e 54) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc36c0125d0 con 0x55b0f3c00450 2023-11-08T19:26:55.584 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.526+0000 7fc3839d6b80 10 client.7302 fetch_fsmap finished waiting for FSMap version 54 2023-11-08T19:26:55.584 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.526+0000 7fc3839d6b80 10 client.7302 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-08T19:26:55.585 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.526+0000 7fc3839d6b80 20 client.7302 populate_metadata read hostname 'smithi149' 2023-11-08T19:26:55.585 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.526+0000 7fc3839d6b80 1 --2- 172.21.15.149:0/2000824498 >> [v2:172.21.15.160:6833/2714564224,v1:172.21.15.160:6835/2714564224] conn(0x55b0f3cb4610 0x55b0f3cb49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:55.585 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.526+0000 7fc3839d6b80 4 client.7302 mds_command: new command op to 7140 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-08T19:26:55.586 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.526+0000 7fc3839d6b80 1 -- 172.21.15.149:0/2000824498 --> [v2:172.21.15.160:6833/2714564224,v1:172.21.15.160:6835/2714564224] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b0f3b4e5a0 con 0x55b0f3cb4610 2023-11-08T19:26:55.586 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.526+0000 7fc374d78700 1 --2- 172.21.15.149:0/2000824498 >> [v2:172.21.15.160:6833/2714564224,v1:172.21.15.160:6835/2714564224] conn(0x55b0f3cb4610 0x55b0f3cb49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:55.586 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.527+0000 7fc34ffff700 10 client.7302 ms_handle_connect on v2:172.21.15.160:6833/2714564224 2023-11-08T19:26:55.587 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.527+0000 7fc374d78700 1 --2- 172.21.15.149:0/2000824498 >> [v2:172.21.15.160:6833/2714564224,v1:172.21.15.160:6835/2714564224] conn(0x55b0f3cb4610 0x55b0f3cb49f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b99a60e3a63da11 server_cookie=be6b25d45f577d70 in_seq=0 out_seq=0 2023-11-08T19:26:55.587 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.527+0000 7fc34ffff700 1 -- 172.21.15.149:0/2000824498 <== mds.0 v2:172.21.15.160:6833/2714564224 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55b0f3b4e5a0 con 0x55b0f3cb4610 2023-11-08T19:26:55.587 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.527+0000 7fc34ffff700 10 client.7302 handle_command_reply: tid=0 2023-11-08T19:26:55.588 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.527+0000 7fc3839d6b80 1 client.7302 shutdown 2023-11-08T19:26:55.588 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.527+0000 7fc3839d6b80 1 -- 172.21.15.149:0/2000824498 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b0f3c00450 msgr2=0x55b0f3cb3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:55.588 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.527+0000 7fc3839d6b80 1 --2- 172.21.15.149:0/2000824498 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b0f3c00450 0x55b0f3cb3910 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x55b0f3c03b10 tx=0x7fc36c007980 comp rx=0 tx=0).stop 2023-11-08T19:26:55.589 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.527+0000 7fc3839d6b80 1 -- 172.21.15.149:0/2000824498 shutdown_connections 2023-11-08T19:26:55.589 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.527+0000 7fc3839d6b80 1 --2- 172.21.15.149:0/2000824498 >> [v2:172.21.15.160:6833/2714564224,v1:172.21.15.160:6835/2714564224] conn(0x55b0f3cb4610 0x55b0f3cb49f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:55.589 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.527+0000 7fc3839d6b80 1 --2- 172.21.15.149:0/2000824498 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55b0f3c4a5d0 0x55b0f3c64800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:55.590 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.527+0000 7fc34ffff700 0 client.7302 ms_handle_reset on v2:172.21.15.160:6833/2714564224 2023-11-08T19:26:55.590 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.527+0000 7fc3839d6b80 1 --2- 172.21.15.149:0/2000824498 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b0f3c00450 0x55b0f3cb3910 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:55.590 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.527+0000 7fc3839d6b80 1 --2- 172.21.15.149:0/2000824498 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b0f3c49b30 0x55b0f3c642c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:55.590 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.527+0000 7fc3839d6b80 1 -- 172.21.15.149:0/2000824498 >> 172.21.15.149:0/2000824498 conn(0x55b0f3b77660 msgr2=0x55b0f3c406a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:55.591 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.527+0000 7fc3839d6b80 1 -- 172.21.15.149:0/2000824498 shutdown_connections 2023-11-08T19:26:55.591 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.527+0000 7fc3839d6b80 1 -- 172.21.15.149:0/2000824498 wait complete. 2023-11-08T19:26:55.591 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.527+0000 7fc3839d6b80 20 client.7302 trim_cache size 0 max 16384 2023-11-08T19:26:55.592 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2023-11-08T19:26:55.593 INFO:teuthology.orchestra.run.smithi149.stdout: "cluster_fsid": "0aba7c70-fe80-4446-a2f5-7502ac3adfb4", 2023-11-08T19:26:55.593 INFO:teuthology.orchestra.run.smithi149.stdout: "whoami": 0, 2023-11-08T19:26:55.593 INFO:teuthology.orchestra.run.smithi149.stdout: "id": 7140, 2023-11-08T19:26:55.593 INFO:teuthology.orchestra.run.smithi149.stdout: "want_state": "up:active", 2023-11-08T19:26:55.594 INFO:teuthology.orchestra.run.smithi149.stdout: "state": "up:active", 2023-11-08T19:26:55.594 INFO:teuthology.orchestra.run.smithi149.stdout: "fs_name": "cephfs", 2023-11-08T19:26:55.595 INFO:teuthology.orchestra.run.smithi149.stdout: "rank_uptime": 5.9405324039999998, 2023-11-08T19:26:55.595 INFO:teuthology.orchestra.run.smithi149.stdout: "mdsmap_epoch": 54, 2023-11-08T19:26:55.595 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_epoch": 96, 2023-11-08T19:26:55.595 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_epoch_barrier": 96, 2023-11-08T19:26:55.596 INFO:teuthology.orchestra.run.smithi149.stdout: "uptime": 12.868304628000001 2023-11-08T19:26:55.596 INFO:teuthology.orchestra.run.smithi149.stdout:} 2023-11-08T19:26:55.599 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.528+0000 7fc3777dd700 1 -- 172.21.15.149:0/4293991441 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc35406af00 msgr2=0x7fc35406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:55.599 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.528+0000 7fc3777dd700 1 --2- 172.21.15.149:0/4293991441 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc35406af00 0x7fc35406d3c0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fc36c007fd0 tx=0x7fc36c009040 comp rx=0 tx=0).stop 2023-11-08T19:26:55.599 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.528+0000 7fc3777dd700 1 -- 172.21.15.149:0/4293991441 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3700d0fe0 msgr2=0x7fc370145340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:55.600 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.528+0000 7fc3777dd700 1 --2- 172.21.15.149:0/4293991441 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3700d0fe0 0x7fc370145340 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fc36000c7f0 tx=0x7fc36000cbb0 comp rx=0 tx=0).stop 2023-11-08T19:26:55.600 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.528+0000 7fc3777dd700 1 -- 172.21.15.149:0/4293991441 shutdown_connections 2023-11-08T19:26:55.601 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.528+0000 7fc3777dd700 1 --2- 172.21.15.149:0/4293991441 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc35406af00 0x7fc35406d3c0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:55.601 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.528+0000 7fc3777dd700 1 --2- 172.21.15.149:0/4293991441 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc37015b950 0x7fc37009d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:55.601 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.528+0000 7fc3777dd700 1 --2- 172.21.15.149:0/4293991441 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc3700cc9a0 0x7fc370153ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:55.601 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.528+0000 7fc3777dd700 1 --2- 172.21.15.149:0/4293991441 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3700d0fe0 0x7fc370145340 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:55.602 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.528+0000 7fc3777dd700 1 -- 172.21.15.149:0/4293991441 >> 172.21.15.149:0/4293991441 conn(0x7fc370099a40 msgr2=0x7fc37006f490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:55.602 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.528+0000 7fc3777dd700 1 -- 172.21.15.149:0/4293991441 shutdown_connections 2023-11-08T19:26:55.602 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.528+0000 7fc3777dd700 1 -- 172.21.15.149:0/4293991441 wait complete. 2023-11-08T19:26:55.603 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-08T19:26:55.725 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.723+0000 7f44bbc72700 1 Processor -- start 2023-11-08T19:26:55.725 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.723+0000 7f44bbc72700 1 -- start start 2023-11-08T19:26:55.728 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.724+0000 7f44bbc72700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f44b415b950 0x7f44b40ce130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:55.729 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.724+0000 7f44bbc72700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f44b40d0430 0x7f44b40ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:55.729 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.724+0000 7f44bbc72700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44b40cc2e0 con 0x7f44b40cd5e0 2023-11-08T19:26:55.729 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.724+0000 7f44bbc72700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44b40cc580 con 0x7f44b40d0430 2023-11-08T19:26:55.729 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.724+0000 7f44bbc72700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44b40cc820 con 0x7f44b415b950 2023-11-08T19:26:55.729 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.724+0000 7f44ba20f700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f44b40d0430 0x7f44b40ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:55.730 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.724+0000 7f44ba20f700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f44b40d0430 0x7f44b40ce670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43568/0 (socket says 172.21.15.149:43568) 2023-11-08T19:26:55.730 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.724+0000 7f44ba20f700 1 -- 172.21.15.149:0/2047799888 learned_addr learned my addr 172.21.15.149:0/2047799888 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:55.730 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.724+0000 7f44b9a0e700 1 --2- 172.21.15.149:0/2047799888 >> v2:172.21.15.160:3300/0 conn(0x7f44b415b950 0x7f44b40ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:55.730 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.724+0000 7f44ba20f700 1 -- 172.21.15.149:0/2047799888 >> v2:172.21.15.160:3300/0 conn(0x7f44b415b950 msgr2=0x7f44b40ce130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:55.730 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.724+0000 7f44ba20f700 1 --2- 172.21.15.149:0/2047799888 >> v2:172.21.15.160:3300/0 conn(0x7f44b415b950 0x7f44b40ce130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:55.731 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.724+0000 7f44ba20f700 1 -- 172.21.15.149:0/2047799888 >> v1:172.21.15.160:6789/0 conn(0x7f44b40cd5e0 legacy=0x7f44b40cfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:55.731 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.724+0000 7f44ba20f700 1 -- 172.21.15.149:0/2047799888 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b40ccb00 con 0x7f44b40d0430 2023-11-08T19:26:55.731 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.724+0000 7f44b9a0e700 1 --2- 172.21.15.149:0/2047799888 >> v2:172.21.15.160:3300/0 conn(0x7f44b415b950 0x7f44b40ce130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:26:55.731 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.724+0000 7f44ba20f700 1 --2- 172.21.15.149:0/2047799888 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44b40d0430 0x7f44b40ce670 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f44b4072960 tx=0x7f44ac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac4d210d46376f7 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:55.731 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.725+0000 7f44b8a0c700 1 -- 172.21.15.149:0/2047799888 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ac00e070 con 0x7f44b40d0430 2023-11-08T19:26:55.732 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.725+0000 7f44b8a0c700 1 -- 172.21.15.149:0/2047799888 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44ac003a20 con 0x7f44b40d0430 2023-11-08T19:26:55.732 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.725+0000 7f44b8a0c700 1 -- 172.21.15.149:0/2047799888 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ac003dd0 con 0x7f44b40d0430 2023-11-08T19:26:55.732 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.725+0000 7f44bbc72700 1 -- 172.21.15.149:0/2047799888 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44b40d0430 msgr2=0x7f44b40ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:55.732 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.725+0000 7f44bbc72700 1 --2- 172.21.15.149:0/2047799888 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44b40d0430 0x7f44b40ce670 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f44b4072960 tx=0x7f44ac00b330 comp rx=0 tx=0).stop 2023-11-08T19:26:55.732 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.725+0000 7f44bbc72700 1 -- 172.21.15.149:0/2047799888 shutdown_connections 2023-11-08T19:26:55.733 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.725+0000 7f44bbc72700 1 --2- 172.21.15.149:0/2047799888 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44b40d0430 0x7f44b40ce670 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:55.733 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.725+0000 7f44bbc72700 1 --2- 172.21.15.149:0/2047799888 >> v2:172.21.15.160:3300/0 conn(0x7f44b415b950 0x7f44b40ce130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:55.733 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.725+0000 7f44bbc72700 1 -- 172.21.15.149:0/2047799888 >> 172.21.15.149:0/2047799888 conn(0x7f44b408afd0 msgr2=0x7f44b40d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:55.733 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.725+0000 7f44bbc72700 1 -- 172.21.15.149:0/2047799888 shutdown_connections 2023-11-08T19:26:55.733 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.725+0000 7f44bbc72700 1 -- 172.21.15.149:0/2047799888 wait complete. 2023-11-08T19:26:55.734 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.726+0000 7f44bbc72700 1 Processor -- start 2023-11-08T19:26:55.734 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.727+0000 7f44bbc72700 1 -- start start 2023-11-08T19:26:55.737 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.727+0000 7f44bbc72700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f44b40d0430 0x7f44b40c6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:55.737 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.727+0000 7f44bbc72700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44b415b950 0x7f44b40b6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:55.737 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.727+0000 7f44bbc72700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f44b40c7500 0x7f44b40b6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:55.737 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.727+0000 7f44bbc72700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b415c730 con 0x7f44b415b950 2023-11-08T19:26:55.737 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.727+0000 7f44bbc72700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b40c9620 con 0x7f44b40d0430 2023-11-08T19:26:55.738 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.727+0000 7f44bbc72700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44b415c9f0 con 0x7f44b40c7500 2023-11-08T19:26:55.738 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.727+0000 7f44b920d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44b415b950 0x7f44b40b6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:55.738 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.727+0000 7f44b920d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44b415b950 0x7f44b40b6530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43572/0 (socket says 172.21.15.149:43572) 2023-11-08T19:26:55.738 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.727+0000 7f44b920d700 1 -- 172.21.15.149:0/3403156950 learned_addr learned my addr 172.21.15.149:0/3403156950 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:55.738 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.728+0000 7f44b9a0e700 1 --2- 172.21.15.149:0/3403156950 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f44b40d0430 0x7f44b40c6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:55.739 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.728+0000 7f44ba20f700 1 --2- 172.21.15.149:0/3403156950 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f44b40c7500 0x7f44b40b6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:55.739 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.728+0000 7f44b920d700 1 -- 172.21.15.149:0/3403156950 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f44b40c7500 msgr2=0x7f44b40b6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:55.739 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.728+0000 7f44b920d700 1 --2- 172.21.15.149:0/3403156950 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f44b40c7500 0x7f44b40b6a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:55.739 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.728+0000 7f44b920d700 1 -- 172.21.15.149:0/3403156950 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f44b40d0430 msgr2=0x7f44b40c6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:55.740 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.728+0000 7f44b920d700 1 --2- 172.21.15.149:0/3403156950 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f44b40d0430 0x7f44b40c6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:55.740 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.728+0000 7f44b920d700 1 -- 172.21.15.149:0/3403156950 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44ac009b30 con 0x7f44b415b950 2023-11-08T19:26:55.740 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.728+0000 7f44b920d700 1 --2- 172.21.15.149:0/3403156950 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44b415b950 0x7f44b40b6530 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f44a400c500 tx=0x7f44a400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:55.740 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.728+0000 7f44aa7fc700 1 -- 172.21.15.149:0/3403156950 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a4011790 con 0x7f44b415b950 2023-11-08T19:26:55.740 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.728+0000 7f44aa7fc700 1 -- 172.21.15.149:0/3403156950 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44a40118f0 con 0x7f44b415b950 2023-11-08T19:26:55.741 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.728+0000 7f44bbc72700 1 -- 172.21.15.149:0/3403156950 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44b40c8d80 con 0x7f44b415b950 2023-11-08T19:26:55.741 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.728+0000 7f44aa7fc700 1 -- 172.21.15.149:0/3403156950 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a4011ca0 con 0x7f44b415b950 2023-11-08T19:26:55.741 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.728+0000 7f44bbc72700 1 -- 172.21.15.149:0/3403156950 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44b40c9340 con 0x7f44b415b950 2023-11-08T19:26:55.741 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.729+0000 7f44bbc72700 1 -- 172.21.15.149:0/3403156950 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44b40745f0 con 0x7f44b415b950 2023-11-08T19:26:55.741 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.729+0000 7f44aa7fc700 1 -- 172.21.15.149:0/3403156950 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f44a401c460 con 0x7f44b415b950 2023-11-08T19:26:55.741 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.730+0000 7f44aa7fc700 1 --2- 172.21.15.149:0/3403156950 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f449806af00 0x7f449806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:55.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.730+0000 7f44aa7fc700 1 -- 172.21.15.149:0/3403156950 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f44a40899e0 con 0x7f44b415b950 2023-11-08T19:26:55.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.730+0000 7f44b9a0e700 1 --2- 172.21.15.149:0/3403156950 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f449806af00 0x7f449806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:55.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.730+0000 7f44b9a0e700 1 --2- 172.21.15.149:0/3403156950 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f449806af00 0x7f449806d3c0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f44b415f290 tx=0x7f44b0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:55.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.735+0000 7f44aa7fc700 1 -- 172.21.15.149:0/3403156950 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f44a4054510 con 0x7f44b415b950 2023-11-08T19:26:55.972 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.969+0000 7f44bbc72700 1 -- 172.21.15.149:0/3403156950 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f44b415cb30 con 0x7f44b415b950 2023-11-08T19:26:55.972 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.970+0000 7f44aa7fc700 1 -- 172.21.15.149:0/3403156950 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v54) v1 ==== 53+0+73 (secure 0 0 0) 0x7f44a4057b30 con 0x7f44b415b950 2023-11-08T19:26:55.972 INFO:teuthology.orchestra.run.smithi149.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-08T19:26:55.975 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.972+0000 7f44bbc72700 1 -- 172.21.15.149:0/3403156950 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f449806af00 msgr2=0x7f449806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:55.975 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.972+0000 7f44bbc72700 1 --2- 172.21.15.149:0/3403156950 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f449806af00 0x7f449806d3c0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f44b415f290 tx=0x7f44b0008040 comp rx=0 tx=0).stop 2023-11-08T19:26:55.975 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.972+0000 7f44bbc72700 1 -- 172.21.15.149:0/3403156950 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44b415b950 msgr2=0x7f44b40b6530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:55.976 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.972+0000 7f44bbc72700 1 --2- 172.21.15.149:0/3403156950 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44b415b950 0x7f44b40b6530 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f44a400c500 tx=0x7f44a400c8c0 comp rx=0 tx=0).stop 2023-11-08T19:26:55.976 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.972+0000 7f44bbc72700 1 -- 172.21.15.149:0/3403156950 shutdown_connections 2023-11-08T19:26:55.976 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.972+0000 7f44bbc72700 1 --2- 172.21.15.149:0/3403156950 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f449806af00 0x7f449806d3c0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:55.977 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.972+0000 7f44bbc72700 1 --2- 172.21.15.149:0/3403156950 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f44b40d0430 0x7f44b40c6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:55.977 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.972+0000 7f44bbc72700 1 --2- 172.21.15.149:0/3403156950 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f44b40c7500 0x7f44b40b6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:55.977 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.972+0000 7f44bbc72700 1 --2- 172.21.15.149:0/3403156950 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44b415b950 0x7f44b40b6530 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:55.977 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.972+0000 7f44bbc72700 1 -- 172.21.15.149:0/3403156950 >> 172.21.15.149:0/3403156950 conn(0x7f44b408afd0 msgr2=0x7f44b40cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:55.977 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.972+0000 7f44bbc72700 1 -- 172.21.15.149:0/3403156950 shutdown_connections 2023-11-08T19:26:55.978 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:55.972+0000 7f44bbc72700 1 -- 172.21.15.149:0/3403156950 wait complete. 2023-11-08T19:26:55.987 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-08T19:26:55.988 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-08T19:26:55.988 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi149.front.sepia.ceph.com 2023-11-08T19:26:55.989 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-08T19:26:55.989 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-08T19:26:55.990 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-08T19:26:55.991 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-08T19:26:55.991 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-08T19:26:55.992 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-08T19:26:55.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:26:55.993 DEBUG:teuthology.orchestra.run.smithi149:> ip addr 2023-11-08T19:26:56.012 INFO:teuthology.orchestra.run.smithi149.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-08T19:26:56.013 INFO:teuthology.orchestra.run.smithi149.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-08T19:26:56.013 INFO:teuthology.orchestra.run.smithi149.stdout: inet 127.0.0.1/8 scope host lo 2023-11-08T19:26:56.013 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:26:56.013 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 ::1/128 scope host 2023-11-08T19:26:56.014 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:26:56.014 INFO:teuthology.orchestra.run.smithi149.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-08T19:26:56.014 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a4 brd ff:ff:ff:ff:ff:ff 2023-11-08T19:26:56.015 INFO:teuthology.orchestra.run.smithi149.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-08T19:26:56.015 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a5 brd ff:ff:ff:ff:ff:ff 2023-11-08T19:26:56.015 INFO:teuthology.orchestra.run.smithi149.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-08T19:26:56.015 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:56 brd ff:ff:ff:ff:ff:ff 2023-11-08T19:26:56.015 INFO:teuthology.orchestra.run.smithi149.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-08T19:26:56.016 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:57 brd ff:ff:ff:ff:ff:ff 2023-11-08T19:26:56.016 INFO:teuthology.orchestra.run.smithi149.stdout: inet 172.21.15.149/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-08T19:26:56.016 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft 42178sec preferred_lft 42178sec 2023-11-08T19:26:56.016 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::a27d:6f0d:7890:36f/64 scope link noprefixroute 2023-11-08T19:26:56.017 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:26:56.017 INFO:teuthology.orchestra.run.smithi149.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-08T19:26:56.017 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 82:12:e7:85:4e:11 brd ff:ff:ff:ff:ff:ff 2023-11-08T19:26:56.018 INFO:teuthology.orchestra.run.smithi149.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-08T19:26:56.018 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:26:56.019 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::4c22:cdff:fed4:d829/64 scope link 2023-11-08T19:26:56.019 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:26:56.019 INFO:teuthology.orchestra.run.smithi149.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-08T19:26:56.020 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether e6:a6:23:51:6c:ef brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-08T19:26:56.020 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::e4a6:23ff:fe51:6cef/64 scope link 2023-11-08T19:26:56.020 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:26:56.021 INFO:teuthology.orchestra.run.smithi149.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-08T19:26:56.021 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 82:12:e7:85:4e:11 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-08T19:26:56.021 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::8012:e7ff:fe85:4e11/64 scope link 2023-11-08T19:26:56.021 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-11-08T19:26:56.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:26:56.023 DEBUG:teuthology.orchestra.run.smithi149:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-08T19:26:56.078 INFO:teuthology.orchestra.run.smithi149.stdout:1 2023-11-08T19:26:56.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:26:56.081 DEBUG:teuthology.orchestra.run.smithi149:> route 2023-11-08T19:26:56.139 INFO:teuthology.orchestra.run.smithi149.stdout:Kernel IP routing table 2023-11-08T19:26:56.139 INFO:teuthology.orchestra.run.smithi149.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-08T19:26:56.140 INFO:teuthology.orchestra.run.smithi149.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-08T19:26:56.140 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-08T19:26:56.140 INFO:teuthology.orchestra.run.smithi149.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-08T19:26:56.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:26:56.142 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec bash -c ' 2023-11-08T19:26:56.142 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2023-11-08T19:26:56.143 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-08T19:26:56.144 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-08T19:26:56.144 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-08T19:26:56.145 DEBUG:teuthology.orchestra.run.smithi149:> ') 2023-11-08T19:26:56.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:26:56.244 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2023-11-08T19:26:56.261 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-08T19:26:56.261 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-08T19:26:56.261 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-08T19:26:56.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:26:56.262 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set brx.0 up 2023-11-08T19:26:56.327 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-08T19:26:56.328 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-08T19:26:56.385 INFO:teuthology.orchestra.run.smithi149.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-08T19:26:56.385 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-08T19:26:56.386 DEBUG:teuthology.orchestra.run.smithi149:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-08T19:26:56.441 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-08T19:26:56.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:26:56.443 DEBUG:teuthology.orchestra.run.smithi149:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-08T19:26:56.527 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-08T19:26:56.527 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-08T19:26:56.527 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2023-11-08T19:26:56.536 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-08T19:26:56.536 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-08T19:26:56.536 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2023-11-08T19:26:56.536 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.149:3300,172.21.15.160:3300,172.21.15.160:3301" 2023-11-08T19:26:56.536 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-08T19:26:56.563 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-08T19:26:56.564 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-08T19:26:56.564 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2023-11-08T19:26:56.564 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.149:3300,172.21.15.160:3300,172.21.15.160:3301" 2023-11-08T19:26:56.564 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-08T19:26:56.565 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.149:6789,172.21.15.160:6789,172.21.15.160:6790" 2023-11-08T19:26:56.565 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.149:6789,172.21.15.160:6789,172.21.15.160:6790:/ 2023-11-08T19:26:56.565 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=0aba7c70-fe80-4446-a2f5-7502ac3adfb4" will pass to kernel 2023-11-08T19:26:56.567 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-08T19:26:56.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:26:56.568 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-08T19:26:56.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:26:56.603 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-08T19:26:56.691 INFO:teuthology.orchestra.run.smithi149.stdout:client7311 2023-11-08T19:26:56.692 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-11-08T19:26:56.692 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:26:56.710 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config get mds_max_snaps_per_dir 2023-11-08T19:26:56.886 INFO:teuthology.orchestra.run.smithi149.stdout:{"mds_max_snaps_per_dir":"100"} 2023-11-08T19:26:56.887 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_max_snaps_per_dir": "100" } 2023-11-08T19:26:56.888 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2023-11-08T19:26:57.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.011+0000 7fb339052700 1 Processor -- start 2023-11-08T19:26:57.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.011+0000 7fb339052700 1 -- start start 2023-11-08T19:26:57.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.012+0000 7fb339052700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fb33415dbc0 0x7fb3340b93d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:57.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.012+0000 7fb339052700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb334161710 0x7fb3340ce760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:57.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.012+0000 7fb339052700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb3340ceca0 0x7fb3340b54c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:57.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.012+0000 7fb339052700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3340d1ea0 con 0x7fb3340ceca0 2023-11-08T19:26:57.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.012+0000 7fb339052700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3340cf130 con 0x7fb33415dbc0 2023-11-08T19:26:57.018 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.012+0000 7fb339052700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb334161c80 con 0x7fb334161710 2023-11-08T19:26:57.018 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.012+0000 7fb33359e700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb3340ceca0 0x7fb3340b54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:57.018 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.012+0000 7fb33359e700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb3340ceca0 0x7fb3340b54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43586/0 (socket says 172.21.15.149:43586) 2023-11-08T19:26:57.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.012+0000 7fb33359e700 1 -- 172.21.15.149:0/1338618477 learned_addr learned my addr 172.21.15.149:0/1338618477 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:57.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.012+0000 7fb33259c700 1 --2- 172.21.15.149:0/1338618477 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb334161710 0x7fb3340ce760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:57.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.012+0000 7fb332d9d700 1 --2- 172.21.15.149:0/1338618477 >> v2:172.21.15.160:3300/0 conn(0x7fb33415dbc0 0x7fb3340b93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:57.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.012+0000 7fb33359e700 1 -- 172.21.15.149:0/1338618477 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb334161710 msgr2=0x7fb3340ce760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:57.020 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.012+0000 7fb33359e700 1 --2- 172.21.15.149:0/1338618477 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb334161710 0x7fb3340ce760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:57.020 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.012+0000 7fb33359e700 1 -- 172.21.15.149:0/1338618477 >> v2:172.21.15.160:3300/0 conn(0x7fb33415dbc0 msgr2=0x7fb3340b93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:57.020 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.012+0000 7fb33359e700 1 --2- 172.21.15.149:0/1338618477 >> v2:172.21.15.160:3300/0 conn(0x7fb33415dbc0 0x7fb3340b93d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:57.020 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.012+0000 7fb33359e700 1 -- 172.21.15.149:0/1338618477 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb334161f60 con 0x7fb3340ceca0 2023-11-08T19:26:57.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.012+0000 7fb33359e700 1 --2- 172.21.15.149:0/1338618477 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3340ceca0 0x7fb3340b54c0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fb33406cb50 tx=0x7fb32c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd87e4771334a4c5 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:57.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.012+0000 7fb331d9b700 1 -- 172.21.15.149:0/1338618477 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb32c00e070 con 0x7fb3340ceca0 2023-11-08T19:26:57.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.012+0000 7fb331d9b700 1 -- 172.21.15.149:0/1338618477 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb32c00b9c0 con 0x7fb3340ceca0 2023-11-08T19:26:57.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.012+0000 7fb331d9b700 1 -- 172.21.15.149:0/1338618477 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb32c00bd70 con 0x7fb3340ceca0 2023-11-08T19:26:57.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.013+0000 7fb339052700 1 -- 172.21.15.149:0/1338618477 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3340ceca0 msgr2=0x7fb3340b54c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:57.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.013+0000 7fb339052700 1 --2- 172.21.15.149:0/1338618477 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3340ceca0 0x7fb3340b54c0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fb33406cb50 tx=0x7fb32c00b330 comp rx=0 tx=0).stop 2023-11-08T19:26:57.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.013+0000 7fb339052700 1 -- 172.21.15.149:0/1338618477 shutdown_connections 2023-11-08T19:26:57.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.013+0000 7fb339052700 1 --2- 172.21.15.149:0/1338618477 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3340ceca0 0x7fb3340b54c0 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:57.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.013+0000 7fb339052700 1 --2- 172.21.15.149:0/1338618477 >> v2:172.21.15.160:3300/0 conn(0x7fb33415dbc0 0x7fb3340b93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:57.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.013+0000 7fb339052700 1 --2- 172.21.15.149:0/1338618477 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb334161710 0x7fb3340ce760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:57.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.013+0000 7fb339052700 1 -- 172.21.15.149:0/1338618477 >> 172.21.15.149:0/1338618477 conn(0x7fb33406bdf0 msgr2=0x7fb33406c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:57.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.013+0000 7fb339052700 1 -- 172.21.15.149:0/1338618477 shutdown_connections 2023-11-08T19:26:57.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.013+0000 7fb339052700 1 -- 172.21.15.149:0/1338618477 wait complete. 2023-11-08T19:26:57.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.015+0000 7fb339052700 1 Processor -- start 2023-11-08T19:26:57.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.015+0000 7fb339052700 1 -- start start 2023-11-08T19:26:57.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.016+0000 7fb339052700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3340ceca0 0x7fb33415a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:57.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.016+0000 7fb339052700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb33415dbc0 0x7fb3340b5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:57.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.016+0000 7fb339052700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb334161710 0x7fb3341f4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:57.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.016+0000 7fb339052700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3340b34a0 con 0x7fb3340ceca0 2023-11-08T19:26:57.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.016+0000 7fb339052700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3340b3780 con 0x7fb33415dbc0 2023-11-08T19:26:57.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.016+0000 7fb339052700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3340b3a60 con 0x7fb334161710 2023-11-08T19:26:57.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.016+0000 7fb332d9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3340ceca0 0x7fb33415a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:57.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.016+0000 7fb332d9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3340ceca0 0x7fb33415a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43588/0 (socket says 172.21.15.149:43588) 2023-11-08T19:26:57.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.016+0000 7fb332d9d700 1 -- 172.21.15.149:0/688424032 learned_addr learned my addr 172.21.15.149:0/688424032 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:57.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.016+0000 7fb33359e700 1 --2- 172.21.15.149:0/688424032 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb334161710 0x7fb3341f4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:57.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.016+0000 7fb33259c700 1 --2- 172.21.15.149:0/688424032 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb33415dbc0 0x7fb3340b5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:57.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.016+0000 7fb332d9d700 1 -- 172.21.15.149:0/688424032 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb334161710 msgr2=0x7fb3341f4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:57.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.016+0000 7fb332d9d700 1 --2- 172.21.15.149:0/688424032 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb334161710 0x7fb3341f4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:57.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.016+0000 7fb332d9d700 1 -- 172.21.15.149:0/688424032 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb33415dbc0 msgr2=0x7fb3340b5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:57.032 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.016+0000 7fb332d9d700 1 --2- 172.21.15.149:0/688424032 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb33415dbc0 0x7fb3340b5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:57.032 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.016+0000 7fb332d9d700 1 -- 172.21.15.149:0/688424032 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb32c009b30 con 0x7fb3340ceca0 2023-11-08T19:26:57.032 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.016+0000 7fb332d9d700 1 --2- 172.21.15.149:0/688424032 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3340ceca0 0x7fb33415a0d0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fb32400e810 tx=0x7fb32400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:57.032 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.016+0000 7fb31b7fe700 1 -- 172.21.15.149:0/688424032 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb324013610 con 0x7fb3340ceca0 2023-11-08T19:26:57.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.017+0000 7fb31b7fe700 1 -- 172.21.15.149:0/688424032 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb324013770 con 0x7fb3340ceca0 2023-11-08T19:26:57.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.017+0000 7fb339052700 1 -- 172.21.15.149:0/688424032 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3340b3d40 con 0x7fb3340ceca0 2023-11-08T19:26:57.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.017+0000 7fb31b7fe700 1 -- 172.21.15.149:0/688424032 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb324013b00 con 0x7fb3340ceca0 2023-11-08T19:26:57.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.017+0000 7fb339052700 1 -- 172.21.15.149:0/688424032 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3340b60e0 con 0x7fb3340ceca0 2023-11-08T19:26:57.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.018+0000 7fb339052700 1 -- 172.21.15.149:0/688424032 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3340b4390 con 0x7fb3340ceca0 2023-11-08T19:26:57.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.018+0000 7fb31b7fe700 1 -- 172.21.15.149:0/688424032 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb324013c60 con 0x7fb3340ceca0 2023-11-08T19:26:57.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.019+0000 7fb31b7fe700 1 --2- 172.21.15.149:0/688424032 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb32006af00 0x7fb32006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:57.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.019+0000 7fb31b7fe700 1 -- 172.21.15.149:0/688424032 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7fb324089730 con 0x7fb3340ceca0 2023-11-08T19:26:57.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.019+0000 7fb33259c700 1 --2- 172.21.15.149:0/688424032 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb32006af00 0x7fb32006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:57.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.019+0000 7fb33259c700 1 --2- 172.21.15.149:0/688424032 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb32006af00 0x7fb32006d3c0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fb3340c7d40 tx=0x7fb328008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:57.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.023+0000 7fb31b7fe700 1 -- 172.21.15.149:0/688424032 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb3240542f0 con 0x7fb3340ceca0 2023-11-08T19:26:57.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.261+0000 7fb339052700 1 -- 172.21.15.149:0/688424032 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb3340b62d0 con 0x7fb3340ceca0 2023-11-08T19:26:57.634 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.632+0000 7fb31b7fe700 1 -- 172.21.15.149:0/688424032 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v55) v1 ==== 167+0+0 (secure 0 0 0) 0x7fb324057910 con 0x7fb3340ceca0 2023-11-08T19:26:57.637 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.635+0000 7fb339052700 1 -- 172.21.15.149:0/688424032 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb32006af00 msgr2=0x7fb32006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:57.638 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.635+0000 7fb339052700 1 --2- 172.21.15.149:0/688424032 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb32006af00 0x7fb32006d3c0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fb3340c7d40 tx=0x7fb328008040 comp rx=0 tx=0).stop 2023-11-08T19:26:57.638 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.635+0000 7fb339052700 1 -- 172.21.15.149:0/688424032 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3340ceca0 msgr2=0x7fb33415a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:57.638 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.635+0000 7fb339052700 1 --2- 172.21.15.149:0/688424032 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3340ceca0 0x7fb33415a0d0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fb32400e810 tx=0x7fb32400ebd0 comp rx=0 tx=0).stop 2023-11-08T19:26:57.638 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.635+0000 7fb339052700 1 -- 172.21.15.149:0/688424032 shutdown_connections 2023-11-08T19:26:57.638 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.635+0000 7fb339052700 1 --2- 172.21.15.149:0/688424032 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb32006af00 0x7fb32006d3c0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:57.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.635+0000 7fb339052700 1 --2- 172.21.15.149:0/688424032 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb334161710 0x7fb3341f4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:57.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.635+0000 7fb339052700 1 --2- 172.21.15.149:0/688424032 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3340ceca0 0x7fb33415a0d0 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:57.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.635+0000 7fb339052700 1 --2- 172.21.15.149:0/688424032 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb33415dbc0 0x7fb3340b5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:57.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.635+0000 7fb339052700 1 -- 172.21.15.149:0/688424032 >> 172.21.15.149:0/688424032 conn(0x7fb33406bdf0 msgr2=0x7fb3340ce2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:57.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.635+0000 7fb339052700 1 -- 172.21.15.149:0/688424032 shutdown_connections 2023-11-08T19:26:57.640 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.635+0000 7fb339052700 1 -- 172.21.15.149:0/688424032 wait complete. 2023-11-08T19:26:57.640 INFO:teuthology.orchestra.run.smithi149.stderr:enabled new snapshots 2023-11-08T19:26:57.651 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 2 2023-11-08T19:26:57.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.773+0000 7f82eca6f700 1 Processor -- start 2023-11-08T19:26:57.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.773+0000 7f82eca6f700 1 -- start start 2023-11-08T19:26:57.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.774+0000 7f82eca6f700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f82e80c7250 0x7f82e806b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:57.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.774+0000 7f82eca6f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f82e80cb610 0x7f82e80b4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:57.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.774+0000 7f82eca6f700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82e80b3710 con 0x7f82e80722a0 2023-11-08T19:26:57.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.774+0000 7f82eca6f700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82e806cc00 con 0x7f82e80c7250 2023-11-08T19:26:57.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.774+0000 7f82eca6f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82e806c640 con 0x7f82e80cb610 2023-11-08T19:26:57.779 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.774+0000 7f82e6d9d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f82e80cb610 0x7f82e80b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:57.779 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.775+0000 7f82e5d9b700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f82e80c7250 0x7f82e806b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:57.779 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.775+0000 7f82e6d9d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f82e80cb610 0x7f82e80b4140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.149:35656/0 (socket says 172.21.15.149:35656) 2023-11-08T19:26:57.779 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.775+0000 7f82e6d9d700 1 -- 172.21.15.149:0/1918205397 learned_addr learned my addr 172.21.15.149:0/1918205397 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:57.779 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.775+0000 7f82e659c700 1 --1- 172.21.15.149:0/1918205397 >> v1:172.21.15.160:6789/0 conn(0x7f82e80722a0 0x7f82e806ab80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.149:57264/0 (socket says 172.21.15.149:57264) 2023-11-08T19:26:57.780 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.775+0000 7f82e559a700 1 -- 172.21.15.149:0/1918205397 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1311343064 0 0) 0x7f82e80b3710 con 0x7f82e80722a0 2023-11-08T19:26:57.780 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.775+0000 7f82e559a700 1 -- 172.21.15.149:0/1918205397 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82d40035b0 con 0x7f82e80722a0 2023-11-08T19:26:57.780 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.775+0000 7f82e6d9d700 1 -- 172.21.15.149:0/1918205397 >> v2:172.21.15.160:3300/0 conn(0x7f82e80c7250 msgr2=0x7f82e806b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:57.780 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.775+0000 7f82e6d9d700 1 --2- 172.21.15.149:0/1918205397 >> v2:172.21.15.160:3300/0 conn(0x7f82e80c7250 0x7f82e806b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:57.780 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.775+0000 7f82e6d9d700 1 -- 172.21.15.149:0/1918205397 >> v1:172.21.15.160:6789/0 conn(0x7f82e80722a0 legacy=0x7f82e806ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:57.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.775+0000 7f82e6d9d700 1 -- 172.21.15.149:0/1918205397 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e806c920 con 0x7f82e80cb610 2023-11-08T19:26:57.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.775+0000 7f82e5d9b700 1 --2- 172.21.15.149:0/1918205397 >> v2:172.21.15.160:3300/0 conn(0x7f82e80c7250 0x7f82e806b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:26:57.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.775+0000 7f82e6d9d700 1 --2- 172.21.15.149:0/1918205397 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f82e80cb610 0x7f82e80b4140 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f82e0009e50 tx=0x7f82e000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac559c4b9fbc8e49 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:57.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.775+0000 7f82e559a700 1 -- 172.21.15.149:0/1918205397 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e000e070 con 0x7f82e80cb610 2023-11-08T19:26:57.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.775+0000 7f82e559a700 1 -- 172.21.15.149:0/1918205397 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82e000b910 con 0x7f82e80cb610 2023-11-08T19:26:57.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.775+0000 7f82e559a700 1 -- 172.21.15.149:0/1918205397 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e000bcc0 con 0x7f82e80cb610 2023-11-08T19:26:57.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.776+0000 7f82eca6f700 1 -- 172.21.15.149:0/1918205397 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f82e80cb610 msgr2=0x7f82e80b4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:57.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.776+0000 7f82eca6f700 1 --2- 172.21.15.149:0/1918205397 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f82e80cb610 0x7f82e80b4140 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f82e0009e50 tx=0x7f82e000b330 comp rx=0 tx=0).stop 2023-11-08T19:26:57.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.776+0000 7f82eca6f700 1 -- 172.21.15.149:0/1918205397 shutdown_connections 2023-11-08T19:26:57.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.776+0000 7f82eca6f700 1 --2- 172.21.15.149:0/1918205397 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f82e80cb610 0x7f82e80b4140 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:57.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.776+0000 7f82eca6f700 1 --2- 172.21.15.149:0/1918205397 >> v2:172.21.15.160:3300/0 conn(0x7f82e80c7250 0x7f82e806b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:57.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.776+0000 7f82eca6f700 1 -- 172.21.15.149:0/1918205397 >> 172.21.15.149:0/1918205397 conn(0x7f82e80d0640 msgr2=0x7f82e80d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:57.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.776+0000 7f82eca6f700 1 -- 172.21.15.149:0/1918205397 shutdown_connections 2023-11-08T19:26:57.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.776+0000 7f82eca6f700 1 -- 172.21.15.149:0/1918205397 wait complete. 2023-11-08T19:26:57.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.777+0000 7f82eca6f700 1 Processor -- start 2023-11-08T19:26:57.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.777+0000 7f82eca6f700 1 -- start start 2023-11-08T19:26:57.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.778+0000 7f82eca6f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f82e80722a0 0x7f82e81f4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:57.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.778+0000 7f82eca6f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f82e80c7250 0x7f82e81f6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:57.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.778+0000 7f82eca6f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82e80cb610 0x7f82e80ced10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:57.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.778+0000 7f82eca6f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e80ac8c0 con 0x7f82e80cb610 2023-11-08T19:26:57.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.778+0000 7f82eca6f700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e80ad440 con 0x7f82e80722a0 2023-11-08T19:26:57.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.778+0000 7f82eca6f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82e80acb10 con 0x7f82e80c7250 2023-11-08T19:26:57.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.778+0000 7f82e6d9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82e80cb610 0x7f82e80ced10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:57.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.778+0000 7f82e6d9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82e80cb610 0x7f82e80ced10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43606/0 (socket says 172.21.15.149:43606) 2023-11-08T19:26:57.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.778+0000 7f82e6d9d700 1 -- 172.21.15.149:0/2766739989 learned_addr learned my addr 172.21.15.149:0/2766739989 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:57.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.778+0000 7f82e659c700 1 --2- 172.21.15.149:0/2766739989 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f82e80722a0 0x7f82e81f4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:57.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.778+0000 7f82e5d9b700 1 --2- 172.21.15.149:0/2766739989 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f82e80c7250 0x7f82e81f6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:57.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.779+0000 7f82e6d9d700 1 -- 172.21.15.149:0/2766739989 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f82e80c7250 msgr2=0x7f82e81f6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:57.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.779+0000 7f82e6d9d700 1 --2- 172.21.15.149:0/2766739989 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f82e80c7250 0x7f82e81f6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:57.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.779+0000 7f82e6d9d700 1 -- 172.21.15.149:0/2766739989 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f82e80722a0 msgr2=0x7f82e81f4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:57.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.779+0000 7f82e6d9d700 1 --2- 172.21.15.149:0/2766739989 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f82e80722a0 0x7f82e81f4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:57.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.779+0000 7f82e6d9d700 1 -- 172.21.15.149:0/2766739989 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d80094a0 con 0x7f82e80cb610 2023-11-08T19:26:57.791 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.779+0000 7f82e6d9d700 1 --2- 172.21.15.149:0/2766739989 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82e80cb610 0x7f82e80ced10 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f82e000b680 tx=0x7f82e0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:57.791 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.779+0000 7f82deffd700 1 -- 172.21.15.149:0/2766739989 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e0004830 con 0x7f82e80cb610 2023-11-08T19:26:57.791 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.779+0000 7f82deffd700 1 -- 172.21.15.149:0/2766739989 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82e00099b0 con 0x7f82e80cb610 2023-11-08T19:26:57.791 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.779+0000 7f82eca6f700 1 -- 172.21.15.149:0/2766739989 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82e0009b30 con 0x7f82e80cb610 2023-11-08T19:26:57.791 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.779+0000 7f82deffd700 1 -- 172.21.15.149:0/2766739989 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e001c680 con 0x7f82e80cb610 2023-11-08T19:26:57.792 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.779+0000 7f82eca6f700 1 -- 172.21.15.149:0/2766739989 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82e80ad0d0 con 0x7f82e80cb610 2023-11-08T19:26:57.792 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.780+0000 7f82eca6f700 1 -- 172.21.15.149:0/2766739989 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82e80ad5b0 con 0x7f82e80cb610 2023-11-08T19:26:57.792 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.780+0000 7f82deffd700 1 -- 172.21.15.149:0/2766739989 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f82e001c7e0 con 0x7f82e80cb610 2023-11-08T19:26:57.792 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.781+0000 7f82deffd700 1 --2- 172.21.15.149:0/2766739989 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f82c806af00 0x7f82c806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:57.792 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.781+0000 7f82e659c700 1 --2- 172.21.15.149:0/2766739989 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f82c806af00 0x7f82c806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:57.793 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.781+0000 7f82deffd700 1 -- 172.21.15.149:0/2766739989 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f82e008b240 con 0x7f82e80cb610 2023-11-08T19:26:57.793 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.781+0000 7f82e659c700 1 --2- 172.21.15.149:0/2766739989 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f82c806af00 0x7f82c806d3c0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f82d0007fd0 tx=0x7f82d0007dc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:57.793 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:57.786+0000 7f82deffd700 1 -- 172.21.15.149:0/2766739989 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f82e0055d70 con 0x7f82e80cb610 2023-11-08T19:26:58.020 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.018+0000 7f82eca6f700 1 -- 172.21.15.149:0/2766739989 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7f82e804f730 con 0x7f82e80cb610 2023-11-08T19:26:58.640 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.638+0000 7f82deffd700 1 -- 172.21.15.149:0/2766739989 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v56) v1 ==== 105+0+0 (secure 0 0 0) 0x7f82e0059390 con 0x7f82e80cb610 2023-11-08T19:26:58.643 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.640+0000 7f82eca6f700 1 -- 172.21.15.149:0/2766739989 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f82c806af00 msgr2=0x7f82c806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:58.643 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.640+0000 7f82eca6f700 1 --2- 172.21.15.149:0/2766739989 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f82c806af00 0x7f82c806d3c0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f82d0007fd0 tx=0x7f82d0007dc0 comp rx=0 tx=0).stop 2023-11-08T19:26:58.643 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.640+0000 7f82eca6f700 1 -- 172.21.15.149:0/2766739989 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82e80cb610 msgr2=0x7f82e80ced10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:58.643 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.640+0000 7f82eca6f700 1 --2- 172.21.15.149:0/2766739989 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82e80cb610 0x7f82e80ced10 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f82e000b680 tx=0x7f82e0004ad0 comp rx=0 tx=0).stop 2023-11-08T19:26:58.644 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.640+0000 7f82eca6f700 1 -- 172.21.15.149:0/2766739989 shutdown_connections 2023-11-08T19:26:58.644 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.640+0000 7f82eca6f700 1 --2- 172.21.15.149:0/2766739989 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f82c806af00 0x7f82c806d3c0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:58.644 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.640+0000 7f82eca6f700 1 --2- 172.21.15.149:0/2766739989 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f82e80722a0 0x7f82e81f4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:58.644 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.640+0000 7f82eca6f700 1 --2- 172.21.15.149:0/2766739989 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82e80cb610 0x7f82e80ced10 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:58.644 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.640+0000 7f82eca6f700 1 --2- 172.21.15.149:0/2766739989 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f82e80c7250 0x7f82e81f6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:58.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.640+0000 7f82eca6f700 1 -- 172.21.15.149:0/2766739989 >> 172.21.15.149:0/2766739989 conn(0x7f82e80d0640 msgr2=0x7f82e815b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:58.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.640+0000 7f82eca6f700 1 -- 172.21.15.149:0/2766739989 shutdown_connections 2023-11-08T19:26:58.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.640+0000 7f82eca6f700 1 -- 172.21.15.149:0/2766739989 wait complete. 2023-11-08T19:26:58.661 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:26:58.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.780+0000 7f44bac79700 1 Processor -- start 2023-11-08T19:26:58.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.780+0000 7f44bac79700 1 -- start start 2023-11-08T19:26:58.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.781+0000 7f44bac79700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f44b415dc30 0x7f44b406f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:58.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.781+0000 7f44bac79700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f44b40d2060 0x7f44b406f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:58.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.781+0000 7f44bac79700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f44b406fc70 0x7f44b4161790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:58.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.781+0000 7f44bac79700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44b4070100 con 0x7f44b40d2060 2023-11-08T19:26:58.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.781+0000 7f44bac79700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44b406bd50 con 0x7f44b415dc30 2023-11-08T19:26:58.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.781+0000 7f44bac79700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44b40d04b0 con 0x7f44b406fc70 2023-11-08T19:26:58.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.781+0000 7f44b3fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f44b40d2060 0x7f44b406f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:58.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.781+0000 7f44b3fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f44b40d2060 0x7f44b406f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43622/0 (socket says 172.21.15.149:43622) 2023-11-08T19:26:58.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.781+0000 7f44b3fff700 1 -- 172.21.15.149:0/521123602 learned_addr learned my addr 172.21.15.149:0/521123602 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:58.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.782+0000 7f44b8a15700 1 --2- 172.21.15.149:0/521123602 >> v2:172.21.15.160:3300/0 conn(0x7f44b415dc30 0x7f44b406f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:58.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.782+0000 7f44b9216700 1 --2- 172.21.15.149:0/521123602 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f44b406fc70 0x7f44b4161790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:58.791 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.782+0000 7f44b3fff700 1 -- 172.21.15.149:0/521123602 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f44b406fc70 msgr2=0x7f44b4161790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:58.791 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.782+0000 7f44b3fff700 1 --2- 172.21.15.149:0/521123602 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f44b406fc70 0x7f44b4161790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:58.792 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.782+0000 7f44b3fff700 1 -- 172.21.15.149:0/521123602 >> v2:172.21.15.160:3300/0 conn(0x7f44b415dc30 msgr2=0x7f44b406f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:26:58.792 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.782+0000 7f44b3fff700 1 --2- 172.21.15.149:0/521123602 >> v2:172.21.15.160:3300/0 conn(0x7f44b415dc30 0x7f44b406f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:58.792 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.782+0000 7f44b3fff700 1 -- 172.21.15.149:0/521123602 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b40d24f0 con 0x7f44b40d2060 2023-11-08T19:26:58.793 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.782+0000 7f44b3fff700 1 --2- 172.21.15.149:0/521123602 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44b40d2060 0x7f44b406f730 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f44a00098f0 tx=0x7f44a0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eaf371d47dbd138 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:58.793 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.782+0000 7f44b37fe700 1 -- 172.21.15.149:0/521123602 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a000b860 con 0x7f44b40d2060 2023-11-08T19:26:58.793 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.782+0000 7f44b37fe700 1 -- 172.21.15.149:0/521123602 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44a000b9c0 con 0x7f44b40d2060 2023-11-08T19:26:58.794 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.782+0000 7f44b37fe700 1 -- 172.21.15.149:0/521123602 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a000bd50 con 0x7f44b40d2060 2023-11-08T19:26:58.794 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.782+0000 7f44bac79700 1 -- 172.21.15.149:0/521123602 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44b40d2060 msgr2=0x7f44b406f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:58.795 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.782+0000 7f44bac79700 1 --2- 172.21.15.149:0/521123602 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44b40d2060 0x7f44b406f730 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f44a00098f0 tx=0x7f44a0009c00 comp rx=0 tx=0).stop 2023-11-08T19:26:58.795 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.783+0000 7f44bac79700 1 -- 172.21.15.149:0/521123602 shutdown_connections 2023-11-08T19:26:58.795 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.783+0000 7f44bac79700 1 --2- 172.21.15.149:0/521123602 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f44b406fc70 0x7f44b4161790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:58.796 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.783+0000 7f44bac79700 1 --2- 172.21.15.149:0/521123602 >> v2:172.21.15.160:3300/0 conn(0x7f44b415dc30 0x7f44b406f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:58.796 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.783+0000 7f44bac79700 1 --2- 172.21.15.149:0/521123602 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44b40d2060 0x7f44b406f730 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:58.797 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.783+0000 7f44bac79700 1 -- 172.21.15.149:0/521123602 >> 172.21.15.149:0/521123602 conn(0x7f44b408afd0 msgr2=0x7f44b40d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:58.797 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.783+0000 7f44bac79700 1 -- 172.21.15.149:0/521123602 shutdown_connections 2023-11-08T19:26:58.797 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.783+0000 7f44bac79700 1 -- 172.21.15.149:0/521123602 wait complete. 2023-11-08T19:26:58.798 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.784+0000 7f44bac79700 1 Processor -- start 2023-11-08T19:26:58.798 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.784+0000 7f44bac79700 1 -- start start 2023-11-08T19:26:58.803 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.785+0000 7f44bac79700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44b406fc70 0x7f44b41494e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:58.803 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.785+0000 7f44bac79700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f44b40d2060 0x7f44b415fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:58.804 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.785+0000 7f44bac79700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f44b415dc30 0x7f44b4149ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:58.804 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.785+0000 7f44bac79700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b415a2e0 con 0x7f44b406fc70 2023-11-08T19:26:58.805 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.785+0000 7f44bac79700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b415f370 con 0x7f44b415dc30 2023-11-08T19:26:58.805 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.785+0000 7f44bac79700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44b40cbca0 con 0x7f44b40d2060 2023-11-08T19:26:58.805 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.785+0000 7f44b8a15700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44b406fc70 0x7f44b41494e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:58.806 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.785+0000 7f44b8a15700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44b406fc70 0x7f44b41494e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43628/0 (socket says 172.21.15.149:43628) 2023-11-08T19:26:58.806 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.785+0000 7f44b8a15700 1 -- 172.21.15.149:0/3086021925 learned_addr learned my addr 172.21.15.149:0/3086021925 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:26:58.806 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.785+0000 7f44b8a15700 1 -- 172.21.15.149:0/3086021925 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f44b40d2060 msgr2=0x7f44b415fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:58.807 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.785+0000 7f44b8a15700 1 --2- 172.21.15.149:0/3086021925 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f44b40d2060 0x7f44b415fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:58.807 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.785+0000 7f44b8a15700 1 -- 172.21.15.149:0/3086021925 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f44b415dc30 msgr2=0x7f44b4149ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:58.807 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.785+0000 7f44b8a15700 1 --2- 172.21.15.149:0/3086021925 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f44b415dc30 0x7f44b4149ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:58.807 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.785+0000 7f44b8a15700 1 -- 172.21.15.149:0/3086021925 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a0009550 con 0x7f44b406fc70 2023-11-08T19:26:58.808 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.785+0000 7f44b8a15700 1 --2- 172.21.15.149:0/3086021925 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44b406fc70 0x7f44b41494e0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f44a800d7d0 tx=0x7f44a800db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:58.808 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.785+0000 7f44b17fa700 1 -- 172.21.15.149:0/3086021925 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a80125f0 con 0x7f44b406fc70 2023-11-08T19:26:58.808 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.785+0000 7f44b17fa700 1 -- 172.21.15.149:0/3086021925 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44a8012750 con 0x7f44b406fc70 2023-11-08T19:26:58.808 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.785+0000 7f44bac79700 1 -- 172.21.15.149:0/3086021925 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44b40cbf80 con 0x7f44b406fc70 2023-11-08T19:26:58.809 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.785+0000 7f44b17fa700 1 -- 172.21.15.149:0/3086021925 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a8012b00 con 0x7f44b406fc70 2023-11-08T19:26:58.809 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.785+0000 7f44bac79700 1 -- 172.21.15.149:0/3086021925 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44b40cc260 con 0x7f44b406fc70 2023-11-08T19:26:58.809 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.786+0000 7f44bac79700 1 -- 172.21.15.149:0/3086021925 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44b40745f0 con 0x7f44b406fc70 2023-11-08T19:26:58.809 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.787+0000 7f44b17fa700 1 -- 172.21.15.149:0/3086021925 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f44a8012c60 con 0x7f44b406fc70 2023-11-08T19:26:58.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.787+0000 7f44b17fa700 1 --2- 172.21.15.149:0/3086021925 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f449806af00 0x7f449806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:26:58.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.787+0000 7f44b17fa700 1 -- 172.21.15.149:0/3086021925 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f44a8089bb0 con 0x7f44b406fc70 2023-11-08T19:26:58.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.787+0000 7f44b3fff700 1 --2- 172.21.15.149:0/3086021925 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f449806af00 0x7f449806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:26:58.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.788+0000 7f44b3fff700 1 --2- 172.21.15.149:0/3086021925 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f449806af00 0x7f449806d3c0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f44b415d4d0 tx=0x7f44a0010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:26:58.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:58.792+0000 7f44b17fa700 1 -- 172.21.15.149:0/3086021925 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f44a80546f0 con 0x7f44b406fc70 2023-11-08T19:26:59.025 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:59.022+0000 7f44bac79700 1 -- 172.21.15.149:0/3086021925 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f44b415afb0 con 0x7f44b406fc70 2023-11-08T19:26:59.025 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:59.023+0000 7f44b17fa700 1 -- 172.21.15.149:0/3086021925 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+4940 (secure 0 0 0) 0x7f44a8057d10 con 0x7f44b406fc70 2023-11-08T19:26:59.026 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:26:59.026 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":57,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6451,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/2947079163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2947079163},{"type":"v1","addr":"172.21.15.160:6834","nonce":2947079163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49},{"gid":7122,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/589971879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":589971879},{"type":"v1","addr":"172.21.15.149:6836","nonce":589971879}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:26:58.642644+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7140,"mds_1":7125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7125":{"gid":7125,"name":"c","rank":1,"incarnation":57,"state":"up:creating","state_seq":1,"addr":"172.21.15.149:6837/3917392643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3917392643},{"type":"v1","addr":"172.21.15.149:6837","nonce":3917392643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7140":{"gid":7140,"name":"b","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.160:6835/2714564224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":2714564224},{"type":"v1","addr":"172.21.15.160:6835","nonce":2714564224}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:26:59.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:59.025+0000 7f44bac79700 1 -- 172.21.15.149:0/3086021925 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f449806af00 msgr2=0x7f449806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:59.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:59.025+0000 7f44bac79700 1 --2- 172.21.15.149:0/3086021925 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f449806af00 0x7f449806d3c0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f44b415d4d0 tx=0x7f44a0010000 comp rx=0 tx=0).stop 2023-11-08T19:26:59.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:59.025+0000 7f44bac79700 1 -- 172.21.15.149:0/3086021925 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44b406fc70 msgr2=0x7f44b41494e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:26:59.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:59.025+0000 7f44bac79700 1 --2- 172.21.15.149:0/3086021925 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44b406fc70 0x7f44b41494e0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f44a800d7d0 tx=0x7f44a800db90 comp rx=0 tx=0).stop 2023-11-08T19:26:59.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:59.025+0000 7f44bac79700 1 -- 172.21.15.149:0/3086021925 shutdown_connections 2023-11-08T19:26:59.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:59.025+0000 7f44bac79700 1 --2- 172.21.15.149:0/3086021925 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f449806af00 0x7f449806d3c0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:59.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:59.025+0000 7f44bac79700 1 --2- 172.21.15.149:0/3086021925 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f44b415dc30 0x7f44b4149ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:59.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:59.025+0000 7f44bac79700 1 --2- 172.21.15.149:0/3086021925 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44b406fc70 0x7f44b41494e0 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:59.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:59.025+0000 7f44bac79700 1 --2- 172.21.15.149:0/3086021925 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f44b40d2060 0x7f44b415fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:26:59.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:59.025+0000 7f44bac79700 1 -- 172.21.15.149:0/3086021925 >> 172.21.15.149:0/3086021925 conn(0x7f44b408afd0 msgr2=0x7f44b406ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:26:59.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:59.025+0000 7f44bac79700 1 -- 172.21.15.149:0/3086021925 shutdown_connections 2023-11-08T19:26:59.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:26:59.025+0000 7f44bac79700 1 -- 172.21.15.149:0/3086021925 wait complete. 2023-11-08T19:26:59.031 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 57 2023-11-08T19:26:59.443 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 57, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 2, 'explicitly_allowed_features': 2, 'created': '2023-11-08T19:26:48.987203+0000', 'modified': '2023-11-08T19:26:58.642644+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 7140, 'mds_1': 7125}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7125': {'gid': 7125, 'name': 'c', 'rank': 1, 'incarnation': 57, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.149:6837/3917392643', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6835', 'nonce': 3917392643}, {'type': 'v1', 'addr': '172.21.15.149:6837', 'nonce': 3917392643}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_7140': {'gid': 7140, 'name': 'b', 'rank': 0, 'incarnation': 50, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.160:6835/2714564224', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6833', 'nonce': 2714564224}, {'type': 'v1', 'addr': '172.21.15.160:6835', 'nonce': 2714564224}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-08T19:26:59.443 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7125:up:creating 2023-11-08T19:27:00.444 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:27:00.580 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.578+0000 7fef9f1df700 1 Processor -- start 2023-11-08T19:27:00.580 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.578+0000 7fef9f1df700 1 -- start start 2023-11-08T19:27:00.586 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.578+0000 7fef9f1df700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fef980cc910 0x7fef980cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:00.586 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.578+0000 7fef9f1df700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef980b2f60 con 0x7fef980cc140 2023-11-08T19:27:00.587 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.578+0000 7fef9f1df700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef980cc520 con 0x7fef980cb130 2023-11-08T19:27:00.587 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.578+0000 7fef9f1df700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef980b2430 con 0x7fef980cc910 2023-11-08T19:27:00.587 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.579+0000 7fef9cf7b700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fef980cc140 0x7fef980b2850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:45640/0 (socket says 172.21.15.149:45640) 2023-11-08T19:27:00.587 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.579+0000 7fef9cf7b700 1 -- 172.21.15.149:0/637999206 learned_addr learned my addr 172.21.15.149:0/637999206 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:27:00.588 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.579+0000 7fef97fff700 1 --2- 172.21.15.149:0/637999206 >> v2:172.21.15.160:3300/0 conn(0x7fef980cc910 0x7fef980cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:00.588 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.579+0000 7fef977fe700 1 -- 172.21.15.149:0/637999206 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 922668121 0 0) 0x7fef980b2f60 con 0x7fef980cc140 2023-11-08T19:27:00.588 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.579+0000 7fef977fe700 1 -- 172.21.15.149:0/637999206 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef880035b0 con 0x7fef980cc140 2023-11-08T19:27:00.588 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.579+0000 7fef977fe700 1 -- 172.21.15.149:0/637999206 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3706629791 0 0) 0x7fef880035b0 con 0x7fef980cc140 2023-11-08T19:27:00.589 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.579+0000 7fef977fe700 1 -- 172.21.15.149:0/637999206 >> v2:172.21.15.160:3300/0 conn(0x7fef980cc910 msgr2=0x7fef980cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:00.589 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.579+0000 7fef977fe700 1 --2- 172.21.15.149:0/637999206 >> v2:172.21.15.160:3300/0 conn(0x7fef980cc910 0x7fef980cabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:00.589 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.579+0000 7fef977fe700 1 -- 172.21.15.149:0/637999206 >> v1:172.21.15.160:6789/0 conn(0x7fef980cb130 legacy=0x7fef9815d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:00.590 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.579+0000 7fef977fe700 1 -- 172.21.15.149:0/637999206 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef980cb5e0 con 0x7fef980cc140 2023-11-08T19:27:00.590 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.579+0000 7fef977fe700 1 -- 172.21.15.149:0/637999206 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7fef8c0017f0 con 0x7fef980cc140 2023-11-08T19:27:00.591 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.579+0000 7fef977fe700 1 -- 172.21.15.149:0/637999206 >> v1:172.21.15.149:6789/0 conn(0x7fef980cc140 legacy=0x7fef980b2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:00.591 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.579+0000 7fef977fe700 1 --2- 172.21.15.149:0/637999206 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fef88003a00 0x7fef88003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:00.591 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.579+0000 7fef977fe700 1 --2- 172.21.15.149:0/637999206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef88004850 0x7fef88004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:00.592 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.579+0000 7fef977fe700 1 --2- 172.21.15.149:0/637999206 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fef88005210 0x7fef8800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:00.592 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.579+0000 7fef977fe700 1 -- 172.21.15.149:0/637999206 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef980b2430 con 0x7fef88004850 2023-11-08T19:27:00.592 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.579+0000 7fef977fe700 1 -- 172.21.15.149:0/637999206 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef8800c0b0 con 0x7fef88003a00 2023-11-08T19:27:00.593 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.579+0000 7fef977fe700 1 -- 172.21.15.149:0/637999206 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef8800c270 con 0x7fef88005210 2023-11-08T19:27:00.593 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.579+0000 7fef97fff700 1 --2- 172.21.15.149:0/637999206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef88004850 0x7fef88004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:00.593 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.579+0000 7fef9cf7b700 1 --2- 172.21.15.149:0/637999206 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fef88003a00 0x7fef88003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:00.594 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.579+0000 7fef9d77c700 1 --2- 172.21.15.149:0/637999206 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fef88005210 0x7fef8800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:00.594 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.580+0000 7fef97fff700 1 -- 172.21.15.149:0/637999206 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fef88005210 msgr2=0x7fef8800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:00.594 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.580+0000 7fef97fff700 1 --2- 172.21.15.149:0/637999206 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fef88005210 0x7fef8800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:00.595 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.580+0000 7fef97fff700 1 -- 172.21.15.149:0/637999206 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fef88003a00 msgr2=0x7fef88003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:00.595 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.580+0000 7fef97fff700 1 --2- 172.21.15.149:0/637999206 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fef88003a00 0x7fef88003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:00.596 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.580+0000 7fef97fff700 1 -- 172.21.15.149:0/637999206 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef880035b0 con 0x7fef88004850 2023-11-08T19:27:00.596 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.580+0000 7fef9d77c700 1 --2- 172.21.15.149:0/637999206 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fef88005210 0x7fef8800ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:27:00.596 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.580+0000 7fef9d77c700 1 -- 172.21.15.149:0/637999206 reap_dead start 2023-11-08T19:27:00.596 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.580+0000 7fef97fff700 1 --2- 172.21.15.149:0/637999206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef88004850 0x7fef88004cd0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fef84009b30 tx=0x7fef88005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=569c4e63854cf2b3 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:00.597 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.580+0000 7fef977fe700 1 -- 172.21.15.149:0/637999206 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef8400e6c0 con 0x7fef88004850 2023-11-08T19:27:00.597 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.580+0000 7fef977fe700 1 -- 172.21.15.149:0/637999206 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef8400e820 con 0x7fef88004850 2023-11-08T19:27:00.597 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.580+0000 7fef977fe700 1 -- 172.21.15.149:0/637999206 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef8400eb90 con 0x7fef88004850 2023-11-08T19:27:00.597 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.580+0000 7fef9f1df700 1 -- 172.21.15.149:0/637999206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef88004850 msgr2=0x7fef88004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:00.598 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.580+0000 7fef9f1df700 1 --2- 172.21.15.149:0/637999206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef88004850 0x7fef88004cd0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fef84009b30 tx=0x7fef88005880 comp rx=0 tx=0).stop 2023-11-08T19:27:00.598 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.580+0000 7fef9f1df700 1 -- 172.21.15.149:0/637999206 shutdown_connections 2023-11-08T19:27:00.598 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.580+0000 7fef9f1df700 1 --2- 172.21.15.149:0/637999206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef88004850 0x7fef88004cd0 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:00.599 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.580+0000 7fef9f1df700 1 -- 172.21.15.149:0/637999206 >> 172.21.15.149:0/637999206 conn(0x7fef98099a40 msgr2=0x7fef980d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:00.599 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.580+0000 7fef9f1df700 1 -- 172.21.15.149:0/637999206 shutdown_connections 2023-11-08T19:27:00.599 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.580+0000 7fef9f1df700 1 -- 172.21.15.149:0/637999206 wait complete. 2023-11-08T19:27:00.599 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.582+0000 7fef9f1df700 1 Processor -- start 2023-11-08T19:27:00.599 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.582+0000 7fef9f1df700 1 -- start start 2023-11-08T19:27:00.600 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.583+0000 7fef9f1df700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fef88004850 0x7fef9814eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:00.600 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.583+0000 7fef9f1df700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef9806ee00 0x7fef9806f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:00.600 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.583+0000 7fef9f1df700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fef980c41f0 0x7fef980c4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:00.600 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.583+0000 7fef9f1df700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef9806f7c0 con 0x7fef9806ee00 2023-11-08T19:27:00.600 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.583+0000 7fef9f1df700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef980c6f40 con 0x7fef980c41f0 2023-11-08T19:27:00.601 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.583+0000 7fef9f1df700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef980c73d0 con 0x7fef88004850 2023-11-08T19:27:00.601 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.583+0000 7fef97fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef9806ee00 0x7fef9806f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:00.601 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.583+0000 7fef97fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef9806ee00 0x7fef9806f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43652/0 (socket says 172.21.15.149:43652) 2023-11-08T19:27:00.601 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.583+0000 7fef97fff700 1 -- 172.21.15.149:0/2835898455 learned_addr learned my addr 172.21.15.149:0/2835898455 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:27:00.602 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.583+0000 7fef9cf7b700 1 --2- 172.21.15.149:0/2835898455 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fef88004850 0x7fef9814eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:00.602 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.583+0000 7fef97fff700 1 -- 172.21.15.149:0/2835898455 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fef88004850 msgr2=0x7fef9814eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:00.602 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.583+0000 7fef97fff700 1 --2- 172.21.15.149:0/2835898455 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fef88004850 0x7fef9814eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:00.602 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.583+0000 7fef97fff700 1 -- 172.21.15.149:0/2835898455 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fef980c41f0 msgr2=0x7fef980c4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:00.603 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.583+0000 7fef97fff700 1 --2- 172.21.15.149:0/2835898455 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fef980c41f0 0x7fef980c4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:00.603 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.583+0000 7fef97fff700 1 -- 172.21.15.149:0/2835898455 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef980c6610 con 0x7fef9806ee00 2023-11-08T19:27:00.603 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.583+0000 7fef97fff700 1 --2- 172.21.15.149:0/2835898455 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef9806ee00 0x7fef9806f280 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fef8800c080 tx=0x7fef840047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:00.603 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.583+0000 7fef957fa700 1 -- 172.21.15.149:0/2835898455 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef8400e6c0 con 0x7fef9806ee00 2023-11-08T19:27:00.604 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.583+0000 7fef957fa700 1 -- 172.21.15.149:0/2835898455 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef84013b80 con 0x7fef9806ee00 2023-11-08T19:27:00.604 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.583+0000 7fef9f1df700 1 -- 172.21.15.149:0/2835898455 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef980c68f0 con 0x7fef9806ee00 2023-11-08T19:27:00.604 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.583+0000 7fef957fa700 1 -- 172.21.15.149:0/2835898455 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef8401c450 con 0x7fef9806ee00 2023-11-08T19:27:00.604 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.583+0000 7fef9f1df700 1 -- 172.21.15.149:0/2835898455 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef980c4ba0 con 0x7fef9806ee00 2023-11-08T19:27:00.605 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.584+0000 7fef9f1df700 1 -- 172.21.15.149:0/2835898455 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef980c70d0 con 0x7fef9806ee00 2023-11-08T19:27:00.606 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.585+0000 7fef957fa700 1 -- 172.21.15.149:0/2835898455 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fef84024070 con 0x7fef9806ee00 2023-11-08T19:27:00.606 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.585+0000 7fef957fa700 1 --2- 172.21.15.149:0/2835898455 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fef7c06af00 0x7fef7c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:00.606 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.585+0000 7fef957fa700 1 -- 172.21.15.149:0/2835898455 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7fef8408b1f0 con 0x7fef9806ee00 2023-11-08T19:27:00.607 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.585+0000 7fef9cf7b700 1 --2- 172.21.15.149:0/2835898455 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fef7c06af00 0x7fef7c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:00.607 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.586+0000 7fef9cf7b700 1 --2- 172.21.15.149:0/2835898455 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fef7c06af00 0x7fef7c06d3c0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fef8c000ef0 tx=0x7fef8c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:00.607 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.590+0000 7fef957fa700 1 -- 172.21.15.149:0/2835898455 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fef84055ed0 con 0x7fef9806ee00 2023-11-08T19:27:00.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.827+0000 7fef9f1df700 1 -- 172.21.15.149:0/2835898455 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fef980745f0 con 0x7fef9806ee00 2023-11-08T19:27:00.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.827+0000 7fef957fa700 1 -- 172.21.15.149:0/2835898455 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4938 (secure 0 0 0) 0x7fef840594f0 con 0x7fef9806ee00 2023-11-08T19:27:00.830 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:27:00.830 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":58,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6451,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/2947079163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2947079163},{"type":"v1","addr":"172.21.15.160:6834","nonce":2947079163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49},{"gid":7122,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/589971879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":589971879},{"type":"v1","addr":"172.21.15.149:6836","nonce":589971879}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:26:58.660035+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7140,"mds_1":7125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7125":{"gid":7125,"name":"c","rank":1,"incarnation":57,"state":"up:active","state_seq":6,"addr":"172.21.15.149:6837/3917392643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3917392643},{"type":"v1","addr":"172.21.15.149:6837","nonce":3917392643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7140":{"gid":7140,"name":"b","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.160:6835/2714564224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":2714564224},{"type":"v1","addr":"172.21.15.160:6835","nonce":2714564224}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:27:00.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.829+0000 7fef9f1df700 1 -- 172.21.15.149:0/2835898455 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fef7c06af00 msgr2=0x7fef7c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:00.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.829+0000 7fef9f1df700 1 --2- 172.21.15.149:0/2835898455 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fef7c06af00 0x7fef7c06d3c0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fef8c000ef0 tx=0x7fef8c009040 comp rx=0 tx=0).stop 2023-11-08T19:27:00.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.829+0000 7fef9f1df700 1 -- 172.21.15.149:0/2835898455 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef9806ee00 msgr2=0x7fef9806f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:00.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.829+0000 7fef9f1df700 1 --2- 172.21.15.149:0/2835898455 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef9806ee00 0x7fef9806f280 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fef8800c080 tx=0x7fef840047c0 comp rx=0 tx=0).stop 2023-11-08T19:27:00.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.829+0000 7fef9f1df700 1 -- 172.21.15.149:0/2835898455 shutdown_connections 2023-11-08T19:27:00.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.829+0000 7fef9f1df700 1 --2- 172.21.15.149:0/2835898455 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fef7c06af00 0x7fef7c06d3c0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:00.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.829+0000 7fef9f1df700 1 --2- 172.21.15.149:0/2835898455 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fef980c41f0 0x7fef980c4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:00.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.829+0000 7fef9f1df700 1 --2- 172.21.15.149:0/2835898455 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fef88004850 0x7fef9814eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:00.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.829+0000 7fef9f1df700 1 --2- 172.21.15.149:0/2835898455 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef9806ee00 0x7fef9806f280 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:00.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.829+0000 7fef9f1df700 1 -- 172.21.15.149:0/2835898455 >> 172.21.15.149:0/2835898455 conn(0x7fef98099a40 msgr2=0x7fef980ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:00.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.830+0000 7fef9f1df700 1 -- 172.21.15.149:0/2835898455 shutdown_connections 2023-11-08T19:27:00.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:00.830+0000 7fef9f1df700 1 -- 172.21.15.149:0/2835898455 wait complete. 2023-11-08T19:27:00.834 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 58 2023-11-08T19:27:01.246 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 58, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 2, 'explicitly_allowed_features': 2, 'created': '2023-11-08T19:26:48.987203+0000', 'modified': '2023-11-08T19:26:58.660035+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 7140, 'mds_1': 7125}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7125': {'gid': 7125, 'name': 'c', 'rank': 1, 'incarnation': 57, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.149:6837/3917392643', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6835', 'nonce': 3917392643}, {'type': 'v1', 'addr': '172.21.15.149:6837', 'nonce': 3917392643}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_7140': {'gid': 7140, 'name': 'b', 'rank': 0, 'incarnation': 50, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.160:6835/2714564224', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6833', 'nonce': 2714564224}, {'type': 'v1', 'addr': '172.21.15.160:6835', 'nonce': 2714564224}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-08T19:27:01.247 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 2/2 2023-11-08T19:27:01.247 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-08T19:27:01.370 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.368+0000 7f37aad19700 1 Processor -- start 2023-11-08T19:27:01.371 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.368+0000 7f37aad19700 1 -- start start 2023-11-08T19:27:01.373 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.369+0000 7f37aad19700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f37a40cc140 0x7f37a40cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:01.373 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.369+0000 7f37aad19700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37a40cce50 con 0x7f37a40b2cd0 2023-11-08T19:27:01.373 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.369+0000 7f37aad19700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37a40cc520 con 0x7f37a40b2850 2023-11-08T19:27:01.374 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.369+0000 7f37aad19700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37a40b2430 con 0x7f37a40cc140 2023-11-08T19:27:01.374 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.369+0000 7f37a8ab5700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f37a40cc140 0x7f37a40cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:01.374 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.369+0000 7f37a92b6700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f37a40b2cd0 0x7f37a415d2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:45664/0 (socket says 172.21.15.149:45664) 2023-11-08T19:27:01.375 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.369+0000 7f37a92b6700 1 -- 172.21.15.149:0/4190018027 learned_addr learned my addr 172.21.15.149:0/4190018027 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:27:01.375 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.370+0000 7f37a8ab5700 1 -- 172.21.15.149:0/4190018027 >> v1:172.21.15.160:6789/0 conn(0x7f37a40b2850 legacy=0x7f37a40cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:01.375 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.370+0000 7f37a37fe700 1 -- 172.21.15.149:0/4190018027 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2776043390 0 0) 0x7f37a40cce50 con 0x7f37a40b2cd0 2023-11-08T19:27:01.375 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.370+0000 7f37a8ab5700 1 -- 172.21.15.149:0/4190018027 >> v1:172.21.15.149:6789/0 conn(0x7f37a40b2cd0 legacy=0x7f37a415d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:01.376 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.370+0000 7f37a8ab5700 1 -- 172.21.15.149:0/4190018027 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a40b17b0 con 0x7f37a40cc140 2023-11-08T19:27:01.376 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.370+0000 7f37a8ab5700 1 --2- 172.21.15.149:0/4190018027 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f37a40cc140 0x7f37a40cc910 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f3798009820 tx=0x7f3798009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a2a0f28d5eb1bd0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:01.376 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.370+0000 7f37a37fe700 1 -- 172.21.15.149:0/4190018027 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3798005e30 con 0x7f37a40cc140 2023-11-08T19:27:01.376 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.370+0000 7f37a37fe700 1 -- 172.21.15.149:0/4190018027 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3798004030 con 0x7f37a40cc140 2023-11-08T19:27:01.376 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.370+0000 7f37a37fe700 1 -- 172.21.15.149:0/4190018027 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37980043c0 con 0x7f37a40cc140 2023-11-08T19:27:01.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.370+0000 7f37aad19700 1 -- 172.21.15.149:0/4190018027 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f37a40cc140 msgr2=0x7f37a40cc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:01.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.370+0000 7f37aad19700 1 --2- 172.21.15.149:0/4190018027 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f37a40cc140 0x7f37a40cc910 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f3798009820 tx=0x7f3798009b30 comp rx=0 tx=0).stop 2023-11-08T19:27:01.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.371+0000 7f37aad19700 1 -- 172.21.15.149:0/4190018027 shutdown_connections 2023-11-08T19:27:01.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.371+0000 7f37aad19700 1 --2- 172.21.15.149:0/4190018027 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f37a40cc140 0x7f37a40cc910 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.371+0000 7f37aad19700 1 -- 172.21.15.149:0/4190018027 >> 172.21.15.149:0/4190018027 conn(0x7f37a4099a40 msgr2=0x7f37a40d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:01.378 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.371+0000 7f37aad19700 1 -- 172.21.15.149:0/4190018027 shutdown_connections 2023-11-08T19:27:01.378 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.371+0000 7f37aad19700 1 -- 172.21.15.149:0/4190018027 wait complete. 2023-11-08T19:27:01.387 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.372+0000 7f37aad19700 1 Processor -- start 2023-11-08T19:27:01.387 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.372+0000 7f37aad19700 1 -- start start 2023-11-08T19:27:01.387 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.373+0000 7f37aad19700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f37a40b2850 0x7f37a40afdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:01.388 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.373+0000 7f37aad19700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f37a40b2cd0 0x7f37a414e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:01.388 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.373+0000 7f37aad19700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f37a40cc140 0x7f37a414db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:01.388 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.373+0000 7f37aad19700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a414e070 con 0x7f37a40cc140 2023-11-08T19:27:01.388 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.373+0000 7f37aad19700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a40b46f0 con 0x7f37a40b2cd0 2023-11-08T19:27:01.388 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.373+0000 7f37aad19700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37a40b04b0 con 0x7f37a40b2850 2023-11-08T19:27:01.389 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.373+0000 7f37a92b6700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f37a40cc140 0x7f37a414db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:01.389 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.373+0000 7f37a92b6700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f37a40cc140 0x7f37a414db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43668/0 (socket says 172.21.15.149:43668) 2023-11-08T19:27:01.389 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.373+0000 7f37a92b6700 1 -- 172.21.15.149:0/2586960342 learned_addr learned my addr 172.21.15.149:0/2586960342 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:27:01.389 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.373+0000 7f37a8ab5700 1 --2- 172.21.15.149:0/2586960342 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f37a40b2850 0x7f37a40afdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:01.390 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.373+0000 7f37a92b6700 1 -- 172.21.15.149:0/2586960342 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f37a40b2850 msgr2=0x7f37a40afdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:01.390 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.373+0000 7f37a92b6700 1 --2- 172.21.15.149:0/2586960342 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f37a40b2850 0x7f37a40afdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.390 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.373+0000 7f37a3fff700 1 --2- 172.21.15.149:0/2586960342 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f37a40b2cd0 0x7f37a414e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:01.390 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.373+0000 7f37a92b6700 1 -- 172.21.15.149:0/2586960342 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f37a40b2cd0 msgr2=0x7f37a414e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:01.391 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.373+0000 7f37a92b6700 1 --2- 172.21.15.149:0/2586960342 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f37a40b2cd0 0x7f37a414e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.391 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.373+0000 7f37a92b6700 1 -- 172.21.15.149:0/2586960342 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3798009430 con 0x7f37a40cc140 2023-11-08T19:27:01.391 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.373+0000 7f37a3fff700 1 --2- 172.21.15.149:0/2586960342 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f37a40b2cd0 0x7f37a414e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:27:01.391 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.373+0000 7f37a92b6700 1 --2- 172.21.15.149:0/2586960342 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f37a40cc140 0x7f37a414db30 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f379c00cc10 tx=0x7f379c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:01.391 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.373+0000 7f37a17fa700 1 -- 172.21.15.149:0/2586960342 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379c00abb0 con 0x7f37a40cc140 2023-11-08T19:27:01.392 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.373+0000 7f37a17fa700 1 -- 172.21.15.149:0/2586960342 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f379c00ad10 con 0x7f37a40cc140 2023-11-08T19:27:01.392 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.373+0000 7f37aad19700 1 -- 172.21.15.149:0/2586960342 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37a40b4940 con 0x7f37a40cc140 2023-11-08T19:27:01.392 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.373+0000 7f37a17fa700 1 -- 172.21.15.149:0/2586960342 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379c007310 con 0x7f37a40cc140 2023-11-08T19:27:01.392 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.373+0000 7f37aad19700 1 -- 172.21.15.149:0/2586960342 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37a40b4f00 con 0x7f37a40cc140 2023-11-08T19:27:01.392 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.375+0000 7f37a17fa700 1 -- 172.21.15.149:0/2586960342 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f379c007470 con 0x7f37a40cc140 2023-11-08T19:27:01.393 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.375+0000 7f37a17fa700 1 --2- 172.21.15.149:0/2586960342 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f378806af00 0x7f378806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:01.393 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.376+0000 7f37a17fa700 1 -- 172.21.15.149:0/2586960342 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f379c089940 con 0x7f37a40cc140 2023-11-08T19:27:01.393 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.376+0000 7f37a8ab5700 1 --2- 172.21.15.149:0/2586960342 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f378806af00 0x7f378806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:01.393 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.376+0000 7f37a8ab5700 1 --2- 172.21.15.149:0/2586960342 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f378806af00 0x7f378806d3c0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f37a40d0680 tx=0x7f3798008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:01.393 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.377+0000 7f37b6f12b80 1 Processor -- start 2023-11-08T19:27:01.394 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.377+0000 7f37b6f12b80 1 -- start start 2023-11-08T19:27:01.394 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.378+0000 7f37b6f12b80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55f3d9d0d6f0 0x55f3d9d3d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:01.394 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.378+0000 7f37b6f12b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f3d9d0fc30 0x55f3d9d3d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:01.394 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.378+0000 7f37b6f12b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f3d9d0dad0 0x55f3d9d27f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:01.395 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.378+0000 7f37b6f12b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3d9c796e0 con 0x55f3d9d0fc30 2023-11-08T19:27:01.395 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.378+0000 7f37b6f12b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3d9c6d3b0 con 0x55f3d9d0dad0 2023-11-08T19:27:01.395 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.378+0000 7f37b6f12b80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f3d9c6acd0 con 0x55f3d9d0d6f0 2023-11-08T19:27:01.395 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.378+0000 7f37a3fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f3d9d0fc30 0x55f3d9d3d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:01.396 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.379+0000 7f37a3fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f3d9d0fc30 0x55f3d9d3d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43674/0 (socket says 172.21.15.149:43674) 2023-11-08T19:27:01.396 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.379+0000 7f37a3fff700 1 -- 172.21.15.149:0/4079330688 learned_addr learned my addr 172.21.15.149:0/4079330688 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:27:01.396 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.379+0000 7f37a8ab5700 1 --2- 172.21.15.149:0/4079330688 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55f3d9d0d6f0 0x55f3d9d3d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:01.396 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.379+0000 7f37a92b6700 1 --2- 172.21.15.149:0/4079330688 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f3d9d0dad0 0x55f3d9d27f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:01.396 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.379+0000 7f37a3fff700 1 -- 172.21.15.149:0/4079330688 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55f3d9d0d6f0 msgr2=0x55f3d9d3d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:01.397 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.379+0000 7f37a3fff700 1 --2- 172.21.15.149:0/4079330688 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55f3d9d0d6f0 0x55f3d9d3d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.397 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.379+0000 7f37a3fff700 1 -- 172.21.15.149:0/4079330688 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f3d9d0dad0 msgr2=0x55f3d9d27f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:01.397 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.379+0000 7f37a3fff700 1 --2- 172.21.15.149:0/4079330688 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f3d9d0dad0 0x55f3d9d27f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.397 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.379+0000 7f37a3fff700 1 -- 172.21.15.149:0/4079330688 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f3d9ae35e0 con 0x55f3d9d0fc30 2023-11-08T19:27:01.398 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.379+0000 7f37a92b6700 1 --2- 172.21.15.149:0/4079330688 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f3d9d0dad0 0x55f3d9d27f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:27:01.398 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.379+0000 7f37a3fff700 1 --2- 172.21.15.149:0/4079330688 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f3d9d0fc30 0x55f3d9d3d990 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f3790003fe0 tx=0x7f37900042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b845ddd584b92a6c server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:01.398 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.379+0000 7f378e7fc700 1 -- 172.21.15.149:0/4079330688 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3790005270 con 0x55f3d9d0fc30 2023-11-08T19:27:01.398 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.379+0000 7f378e7fc700 1 -- 172.21.15.149:0/4079330688 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37900053d0 con 0x55f3d9d0fc30 2023-11-08T19:27:01.399 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.379+0000 7f378e7fc700 1 -- 172.21.15.149:0/4079330688 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3790006aa0 con 0x55f3d9d0fc30 2023-11-08T19:27:01.399 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.380+0000 7f37b6f12b80 1 -- 172.21.15.149:0/4079330688 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f3d9d0fc30 msgr2=0x55f3d9d3d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:01.399 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.380+0000 7f37b6f12b80 1 --2- 172.21.15.149:0/4079330688 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f3d9d0fc30 0x55f3d9d3d990 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f3790003fe0 tx=0x7f37900042f0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.399 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.380+0000 7f37b6f12b80 1 -- 172.21.15.149:0/4079330688 shutdown_connections 2023-11-08T19:27:01.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.380+0000 7f37b6f12b80 1 --2- 172.21.15.149:0/4079330688 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f3d9d0dad0 0x55f3d9d27f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.380+0000 7f37b6f12b80 1 --2- 172.21.15.149:0/4079330688 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55f3d9d0d6f0 0x55f3d9d3d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.380+0000 7f37b6f12b80 1 --2- 172.21.15.149:0/4079330688 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f3d9d0fc30 0x55f3d9d3d990 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.380+0000 7f37b6f12b80 1 -- 172.21.15.149:0/4079330688 >> 172.21.15.149:0/4079330688 conn(0x55f3d9c88660 msgr2=0x55f3d9d133c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:01.401 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.380+0000 7f37b6f12b80 1 -- 172.21.15.149:0/4079330688 shutdown_connections 2023-11-08T19:27:01.401 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.380+0000 7f37b6f12b80 1 -- 172.21.15.149:0/4079330688 wait complete. 2023-11-08T19:27:01.401 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.380+0000 7f37b6f12b80 1 -- start start 2023-11-08T19:27:01.401 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.381+0000 7f37b6f12b80 1 Processor -- start 2023-11-08T19:27:01.402 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.381+0000 7f37b6f12b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f3d9d0d6f0 0x55f3d9d68440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:01.402 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.381+0000 7f37b6f12b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f3d9d0dad0 0x55f3d9d6af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:01.402 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.381+0000 7f37b6f12b80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55f3d9d67640 0x55f3d9d6b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:01.402 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.381+0000 7f37b6f12b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3d9c665c0 con 0x55f3d9d0d6f0 2023-11-08T19:27:01.403 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.381+0000 7f37b6f12b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3d9c020d0 con 0x55f3d9d0dad0 2023-11-08T19:27:01.403 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.381+0000 7f37b6f12b80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f3d9c01d70 con 0x55f3d9d67640 2023-11-08T19:27:01.403 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.381+0000 7f37a8ab5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f3d9d0d6f0 0x55f3d9d68440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:01.403 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.381+0000 7f37b6f12b80 10 client.0 _ll_register_callbacks cb 0x55f3d9a5e7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-08T19:27:01.404 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.381+0000 7f37a8ab5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f3d9d0d6f0 0x55f3d9d68440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43678/0 (socket says 172.21.15.149:43678) 2023-11-08T19:27:01.404 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.382+0000 7f37a8ab5700 1 -- 172.21.15.149:0/3916806757 learned_addr learned my addr 172.21.15.149:0/3916806757 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:27:01.404 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.382+0000 7f37a92b6700 1 --2- 172.21.15.149:0/3916806757 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55f3d9d67640 0x55f3d9d6b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:01.404 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.382+0000 7f37a3fff700 1 --2- 172.21.15.149:0/3916806757 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f3d9d0dad0 0x55f3d9d6af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:01.405 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.382+0000 7f37a8ab5700 1 -- 172.21.15.149:0/3916806757 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55f3d9d67640 msgr2=0x55f3d9d6b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:01.405 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.382+0000 7f37a8ab5700 1 --2- 172.21.15.149:0/3916806757 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55f3d9d67640 0x55f3d9d6b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.405 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.382+0000 7f37a8ab5700 1 -- 172.21.15.149:0/3916806757 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f3d9d0dad0 msgr2=0x55f3d9d6af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:01.405 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.382+0000 7f37a8ab5700 1 --2- 172.21.15.149:0/3916806757 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f3d9d0dad0 0x55f3d9d6af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.405 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.382+0000 7f37a8ab5700 1 -- 172.21.15.149:0/3916806757 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3790003be0 con 0x55f3d9d0d6f0 2023-11-08T19:27:01.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.382+0000 7f37a3fff700 1 --2- 172.21.15.149:0/3916806757 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f3d9d0dad0 0x55f3d9d6af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:27:01.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.382+0000 7f37a8ab5700 1 --2- 172.21.15.149:0/3916806757 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f3d9d0d6f0 0x55f3d9d68440 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f37a40b3220 tx=0x7f37980047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17ded845ef17756 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:01.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.382+0000 7f37837fe700 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2023-11-08T19:27:01.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.382+0000 7f37837fe700 1 -- 172.21.15.149:0/3916806757 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379801d890 con 0x55f3d9d0d6f0 2023-11-08T19:27:01.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.382+0000 7f37837fe700 1 -- 172.21.15.149:0/3916806757 <== mon.0 v2:172.21.15.149:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f3798023040 con 0x55f3d9d0d6f0 2023-11-08T19:27:01.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.382+0000 7f37b6f12b80 1 -- 172.21.15.149:0/3916806757 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f3d9d05880 con 0x55f3d9d0d6f0 2023-11-08T19:27:01.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.382+0000 7f37837fe700 1 -- 172.21.15.149:0/3916806757 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f379801d9f0 con 0x55f3d9d0d6f0 2023-11-08T19:27:01.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.382+0000 7f37b6f12b80 10 client.7347 fetch_fsmap learned FSMap version 58 2023-11-08T19:27:01.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.382+0000 7f37b6f12b80 1 -- 172.21.15.149:0/3916806757 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=2+}) v3 -- 0x55f3d9a8fd90 con 0x55f3d9d0d6f0 2023-11-08T19:27:01.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.382+0000 7f37837fe700 1 -- 172.21.15.149:0/3916806757 <== mon.0 v2:172.21.15.149:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f3d9d05880 con 0x55f3d9d0d6f0 2023-11-08T19:27:01.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.382+0000 7f37837fe700 1 -- 172.21.15.149:0/3916806757 <== mon.0 v2:172.21.15.149:3300/0 5 ==== fsmap(e 58) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f379801db50 con 0x55f3d9d0d6f0 2023-11-08T19:27:01.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.382+0000 7f37b6f12b80 10 client.7347 fetch_fsmap finished waiting for FSMap version 58 2023-11-08T19:27:01.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.382+0000 7f37b6f12b80 10 client.7347 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-08T19:27:01.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.382+0000 7f37b6f12b80 20 client.7347 populate_metadata read hostname 'smithi149' 2023-11-08T19:27:01.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.382+0000 7f37b6f12b80 1 --2- 172.21.15.149:0/3916806757 >> [v2:172.21.15.149:6835/3917392643,v1:172.21.15.149:6837/3917392643] conn(0x55f3d9d54680 0x55f3d9d54a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:01.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.383+0000 7f37b6f12b80 4 client.7347 mds_command: new command op to 7125 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-08T19:27:01.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.383+0000 7f37b6f12b80 1 -- 172.21.15.149:0/3916806757 --> [v2:172.21.15.149:6835/3917392643,v1:172.21.15.149:6837/3917392643] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f3d9ce1a30 con 0x55f3d9d54680 2023-11-08T19:27:01.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.383+0000 7f37a3fff700 1 --2- 172.21.15.149:0/3916806757 >> [v2:172.21.15.149:6835/3917392643,v1:172.21.15.149:6837/3917392643] conn(0x55f3d9d54680 0x55f3d9d54a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:01.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.383+0000 7f37837fe700 10 client.7347 ms_handle_connect on v2:172.21.15.149:6835/3917392643 2023-11-08T19:27:01.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.383+0000 7f37a3fff700 1 --2- 172.21.15.149:0/3916806757 >> [v2:172.21.15.149:6835/3917392643,v1:172.21.15.149:6837/3917392643] conn(0x55f3d9d54680 0x55f3d9d54a60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d5fe82749856bf2b server_cookie=ae1ccb4b105d67d in_seq=0 out_seq=0 2023-11-08T19:27:01.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.383+0000 7f37837fe700 1 -- 172.21.15.149:0/3916806757 <== mds.1 v2:172.21.15.149:6835/3917392643 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f3d9ce1a30 con 0x55f3d9d54680 2023-11-08T19:27:01.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.383+0000 7f37837fe700 10 client.7347 handle_command_reply: tid=0 2023-11-08T19:27:01.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.384+0000 7f37b6f12b80 1 client.7347 shutdown 2023-11-08T19:27:01.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.384+0000 7f37b6f12b80 1 -- 172.21.15.149:0/3916806757 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f3d9d0d6f0 msgr2=0x55f3d9d68440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:01.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.384+0000 7f37b6f12b80 1 --2- 172.21.15.149:0/3916806757 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f3d9d0d6f0 0x55f3d9d68440 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f37a40b3220 tx=0x7f37980047c0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.384+0000 7f37b6f12b80 1 -- 172.21.15.149:0/3916806757 shutdown_connections 2023-11-08T19:27:01.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.384+0000 7f37b6f12b80 1 --2- 172.21.15.149:0/3916806757 >> [v2:172.21.15.149:6835/3917392643,v1:172.21.15.149:6837/3917392643] conn(0x55f3d9d54680 0x55f3d9d54a60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.384+0000 7f37b6f12b80 1 --2- 172.21.15.149:0/3916806757 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55f3d9d67640 0x55f3d9d6b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.384+0000 7f37b6f12b80 1 --2- 172.21.15.149:0/3916806757 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f3d9d0d6f0 0x55f3d9d68440 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.384+0000 7f37837fe700 0 client.7347 ms_handle_reset on v2:172.21.15.149:6835/3917392643 2023-11-08T19:27:01.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.384+0000 7f37b6f12b80 1 --2- 172.21.15.149:0/3916806757 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f3d9d0dad0 0x55f3d9d6af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.384+0000 7f37b6f12b80 1 -- 172.21.15.149:0/3916806757 >> 172.21.15.149:0/3916806757 conn(0x55f3d9c88660 msgr2=0x55f3d9d3da80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:01.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.384+0000 7f37b6f12b80 1 -- 172.21.15.149:0/3916806757 shutdown_connections 2023-11-08T19:27:01.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.384+0000 7f37b6f12b80 1 -- 172.21.15.149:0/3916806757 wait complete. 2023-11-08T19:27:01.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.384+0000 7f37b6f12b80 20 client.7347 trim_cache size 0 max 16384 2023-11-08T19:27:01.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.402+0000 7f37b6f12b80 1 Processor -- start 2023-11-08T19:27:01.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.402+0000 7f37b6f12b80 1 -- start start 2023-11-08T19:27:01.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.403+0000 7f37b6f12b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f3d9d0d6f0 0x55f3d9d10c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:01.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.403+0000 7f37b6f12b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f3d9d0dad0 0x55f3d9d53b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:01.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.403+0000 7f37b6f12b80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55f3d9d724f0 0x55f3d9d0c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:01.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.403+0000 7f37b6f12b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3d9ae58d0 con 0x55f3d9d0dad0 2023-11-08T19:27:01.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.403+0000 7f37b6f12b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3d9ce8440 con 0x55f3d9d0d6f0 2023-11-08T19:27:01.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.403+0000 7f37b6f12b80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f3d9d111b0 con 0x55f3d9d724f0 2023-11-08T19:27:01.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.403+0000 7f37a3fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f3d9d0dad0 0x55f3d9d53b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:01.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.403+0000 7f37a3fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f3d9d0dad0 0x55f3d9d53b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43688/0 (socket says 172.21.15.149:43688) 2023-11-08T19:27:01.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.403+0000 7f37a3fff700 1 -- 172.21.15.149:0/2860130929 learned_addr learned my addr 172.21.15.149:0/2860130929 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:27:01.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.403+0000 7f37a3fff700 1 -- 172.21.15.149:0/2860130929 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55f3d9d724f0 msgr2=0x55f3d9d0c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:01.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.403+0000 7f37a3fff700 1 --2- 172.21.15.149:0/2860130929 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55f3d9d724f0 0x55f3d9d0c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.403+0000 7f37a3fff700 1 -- 172.21.15.149:0/2860130929 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f3d9d0d6f0 msgr2=0x55f3d9d10c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:01.422 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.403+0000 7f37a3fff700 1 --2- 172.21.15.149:0/2860130929 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f3d9d0d6f0 0x55f3d9d10c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.422 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.403+0000 7f37a3fff700 1 -- 172.21.15.149:0/2860130929 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f3d9a78c10 con 0x55f3d9d0dad0 2023-11-08T19:27:01.422 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.403+0000 7f37a3fff700 1 --2- 172.21.15.149:0/2860130929 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f3d9d0dad0 0x55f3d9d53b90 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f3790007000 tx=0x7f3790012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31a588278e864824 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:01.422 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.403+0000 7f378effd700 1 -- 172.21.15.149:0/2860130929 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3790024070 con 0x55f3d9d0dad0 2023-11-08T19:27:01.422 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.403+0000 7f378effd700 1 -- 172.21.15.149:0/2860130929 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3790005540 con 0x55f3d9d0dad0 2023-11-08T19:27:01.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.403+0000 7f378effd700 1 -- 172.21.15.149:0/2860130929 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3790026d40 con 0x55f3d9d0dad0 2023-11-08T19:27:01.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.404+0000 7f37b6f12b80 1 -- 172.21.15.149:0/2860130929 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f3d9d0dad0 msgr2=0x55f3d9d53b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:01.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.404+0000 7f37b6f12b80 1 --2- 172.21.15.149:0/2860130929 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f3d9d0dad0 0x55f3d9d53b90 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f3790007000 tx=0x7f3790012000 comp rx=0 tx=0).stop 2023-11-08T19:27:01.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.404+0000 7f37b6f12b80 1 -- 172.21.15.149:0/2860130929 shutdown_connections 2023-11-08T19:27:01.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.404+0000 7f37b6f12b80 1 --2- 172.21.15.149:0/2860130929 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f3d9d0d6f0 0x55f3d9d10c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.404+0000 7f37b6f12b80 1 --2- 172.21.15.149:0/2860130929 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55f3d9d724f0 0x55f3d9d0c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.404+0000 7f37b6f12b80 1 --2- 172.21.15.149:0/2860130929 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f3d9d0dad0 0x55f3d9d53b90 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.404+0000 7f37b6f12b80 1 -- 172.21.15.149:0/2860130929 >> 172.21.15.149:0/2860130929 conn(0x55f3d9c88660 msgr2=0x55f3d9d3d270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:01.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.404+0000 7f37b6f12b80 1 -- 172.21.15.149:0/2860130929 shutdown_connections 2023-11-08T19:27:01.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.404+0000 7f37b6f12b80 1 -- 172.21.15.149:0/2860130929 wait complete. 2023-11-08T19:27:01.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.405+0000 7f37b6f12b80 1 -- start start 2023-11-08T19:27:01.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.405+0000 7f37b6f12b80 1 Processor -- start 2023-11-08T19:27:01.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.406+0000 7f37b6f12b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f3d9d0d6f0 0x55f3d9d51a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:01.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.406+0000 7f37b6f12b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f3d9d0dad0 0x55f3d9dc1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:01.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.406+0000 7f37b6f12b80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55f3d9d724f0 0x55f3d9d4dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:01.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.406+0000 7f37b6f12b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3d9d3ee00 con 0x55f3d9d0dad0 2023-11-08T19:27:01.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.406+0000 7f37b6f12b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3d9dc1fe0 con 0x55f3d9d0d6f0 2023-11-08T19:27:01.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.406+0000 7f37b6f12b80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f3d9dc56c0 con 0x55f3d9d724f0 2023-11-08T19:27:01.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.406+0000 7f37b6f12b80 10 client.0 _ll_register_callbacks cb 0x7f37980038b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-08T19:27:01.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.406+0000 7f37a3fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f3d9d0dad0 0x55f3d9dc1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:01.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.406+0000 7f37a3fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f3d9d0dad0 0x55f3d9dc1aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43694/0 (socket says 172.21.15.149:43694) 2023-11-08T19:27:01.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.406+0000 7f37a3fff700 1 -- 172.21.15.149:0/3994767854 learned_addr learned my addr 172.21.15.149:0/3994767854 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:27:01.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.406+0000 7f37a92b6700 1 --2- 172.21.15.149:0/3994767854 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55f3d9d724f0 0x55f3d9d4dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:01.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.406+0000 7f37a8ab5700 1 --2- 172.21.15.149:0/3994767854 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f3d9d0d6f0 0x55f3d9d51a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:01.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.406+0000 7f37a3fff700 1 -- 172.21.15.149:0/3994767854 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55f3d9d724f0 msgr2=0x55f3d9d4dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:01.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.406+0000 7f37a3fff700 1 --2- 172.21.15.149:0/3994767854 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55f3d9d724f0 0x55f3d9d4dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.406+0000 7f37a3fff700 1 -- 172.21.15.149:0/3994767854 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f3d9d0d6f0 msgr2=0x55f3d9d51a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:01.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.406+0000 7f37a3fff700 1 --2- 172.21.15.149:0/3994767854 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f3d9d0d6f0 0x55f3d9d51a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.406+0000 7f37a3fff700 1 -- 172.21.15.149:0/3994767854 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f3d9ae35e0 con 0x55f3d9d0dad0 2023-11-08T19:27:01.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.406+0000 7f37a3fff700 1 --2- 172.21.15.149:0/3994767854 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f3d9d0dad0 0x55f3d9dc1aa0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f3790003ed0 tx=0x7f3790003780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cf5122d4725ef9a server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:01.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.406+0000 7f37837fe700 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2023-11-08T19:27:01.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.406+0000 7f37837fe700 1 -- 172.21.15.149:0/3994767854 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37900264c0 con 0x55f3d9d0dad0 2023-11-08T19:27:01.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.406+0000 7f37837fe700 1 -- 172.21.15.149:0/3994767854 <== mon.0 v2:172.21.15.149:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f3790026620 con 0x55f3d9d0dad0 2023-11-08T19:27:01.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.406+0000 7f37b6f12b80 1 -- 172.21.15.149:0/3994767854 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f37900053d0 con 0x55f3d9d0dad0 2023-11-08T19:27:01.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.406+0000 7f37837fe700 1 -- 172.21.15.149:0/3994767854 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3790026e90 con 0x55f3d9d0dad0 2023-11-08T19:27:01.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.406+0000 7f37b6f12b80 10 client.7353 fetch_fsmap learned FSMap version 58 2023-11-08T19:27:01.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.406+0000 7f37b6f12b80 1 -- 172.21.15.149:0/3994767854 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=2+}) v3 -- 0x55f3d9ab6200 con 0x55f3d9d0dad0 2023-11-08T19:27:01.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.407+0000 7f37837fe700 1 -- 172.21.15.149:0/3994767854 <== mon.0 v2:172.21.15.149:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37900053d0 con 0x55f3d9d0dad0 2023-11-08T19:27:01.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.407+0000 7f37837fe700 1 -- 172.21.15.149:0/3994767854 <== mon.0 v2:172.21.15.149:3300/0 5 ==== fsmap(e 58) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f3790004010 con 0x55f3d9d0dad0 2023-11-08T19:27:01.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.407+0000 7f37b6f12b80 10 client.7353 fetch_fsmap finished waiting for FSMap version 58 2023-11-08T19:27:01.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.407+0000 7f37b6f12b80 10 client.7353 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-08T19:27:01.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.407+0000 7f37b6f12b80 20 client.7353 populate_metadata read hostname 'smithi149' 2023-11-08T19:27:01.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.407+0000 7f37b6f12b80 1 --2- 172.21.15.149:0/3994767854 >> [v2:172.21.15.149:6835/3917392643,v1:172.21.15.149:6837/3917392643] conn(0x55f3d9d0deb0 0x55f3d9d0e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:01.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.407+0000 7f37b6f12b80 4 client.7353 mds_command: new command op to 7125 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-08T19:27:01.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.407+0000 7f37b6f12b80 1 -- 172.21.15.149:0/3994767854 --> [v2:172.21.15.149:6835/3917392643,v1:172.21.15.149:6837/3917392643] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f3d9c5f5a0 con 0x55f3d9d0deb0 2023-11-08T19:27:01.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.407+0000 7f37a8ab5700 1 --2- 172.21.15.149:0/3994767854 >> [v2:172.21.15.149:6835/3917392643,v1:172.21.15.149:6837/3917392643] conn(0x55f3d9d0deb0 0x55f3d9d0e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:01.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.407+0000 7f37837fe700 10 client.7353 ms_handle_connect on v2:172.21.15.149:6835/3917392643 2023-11-08T19:27:01.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.407+0000 7f37a8ab5700 1 --2- 172.21.15.149:0/3994767854 >> [v2:172.21.15.149:6835/3917392643,v1:172.21.15.149:6837/3917392643] conn(0x55f3d9d0deb0 0x55f3d9d0e290 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f61304e55d04a963 server_cookie=6c8c187611052bb2 in_seq=0 out_seq=0 2023-11-08T19:27:01.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.407+0000 7f37837fe700 1 -- 172.21.15.149:0/3994767854 <== mds.1 v2:172.21.15.149:6835/3917392643 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55f3d9c5f5a0 con 0x55f3d9d0deb0 2023-11-08T19:27:01.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.407+0000 7f37837fe700 10 client.7353 handle_command_reply: tid=0 2023-11-08T19:27:01.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.407+0000 7f37b6f12b80 1 client.7353 shutdown 2023-11-08T19:27:01.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.408+0000 7f37b6f12b80 1 -- 172.21.15.149:0/3994767854 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f3d9d0dad0 msgr2=0x55f3d9dc1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:01.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.408+0000 7f37b6f12b80 1 --2- 172.21.15.149:0/3994767854 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f3d9d0dad0 0x55f3d9dc1aa0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f3790003ed0 tx=0x7f3790003780 comp rx=0 tx=0).stop 2023-11-08T19:27:01.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.408+0000 7f37b6f12b80 1 -- 172.21.15.149:0/3994767854 shutdown_connections 2023-11-08T19:27:01.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.408+0000 7f37b6f12b80 1 --2- 172.21.15.149:0/3994767854 >> [v2:172.21.15.149:6835/3917392643,v1:172.21.15.149:6837/3917392643] conn(0x55f3d9d0deb0 0x55f3d9d0e290 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.408+0000 7f37b6f12b80 1 --2- 172.21.15.149:0/3994767854 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f3d9d0d6f0 0x55f3d9d51a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.408+0000 7f37b6f12b80 1 --2- 172.21.15.149:0/3994767854 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55f3d9d724f0 0x55f3d9d4dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.408+0000 7f37837fe700 0 client.7353 ms_handle_reset on v2:172.21.15.149:6835/3917392643 2023-11-08T19:27:01.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.408+0000 7f37b6f12b80 1 --2- 172.21.15.149:0/3994767854 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f3d9d0dad0 0x55f3d9dc1aa0 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.408+0000 7f37b6f12b80 1 -- 172.21.15.149:0/3994767854 >> 172.21.15.149:0/3994767854 conn(0x55f3d9c88660 msgr2=0x55f3d9d3d270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:01.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.408+0000 7f37b6f12b80 1 -- 172.21.15.149:0/3994767854 shutdown_connections 2023-11-08T19:27:01.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.408+0000 7f37b6f12b80 1 -- 172.21.15.149:0/3994767854 wait complete. 2023-11-08T19:27:01.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.408+0000 7f37b6f12b80 20 client.7353 trim_cache size 0 max 16384 2023-11-08T19:27:01.435 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2023-11-08T19:27:01.435 INFO:teuthology.orchestra.run.smithi149.stdout: "cluster_fsid": "0aba7c70-fe80-4446-a2f5-7502ac3adfb4", 2023-11-08T19:27:01.436 INFO:teuthology.orchestra.run.smithi149.stdout: "whoami": 1, 2023-11-08T19:27:01.436 INFO:teuthology.orchestra.run.smithi149.stdout: "id": 7125, 2023-11-08T19:27:01.436 INFO:teuthology.orchestra.run.smithi149.stdout: "want_state": "up:active", 2023-11-08T19:27:01.436 INFO:teuthology.orchestra.run.smithi149.stdout: "state": "up:active", 2023-11-08T19:27:01.436 INFO:teuthology.orchestra.run.smithi149.stdout: "fs_name": "cephfs", 2023-11-08T19:27:01.436 INFO:teuthology.orchestra.run.smithi149.stdout: "rank_uptime": 2.7645853150000002, 2023-11-08T19:27:01.437 INFO:teuthology.orchestra.run.smithi149.stdout: "mdsmap_epoch": 58, 2023-11-08T19:27:01.437 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_epoch": 96, 2023-11-08T19:27:01.437 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_epoch_barrier": 96, 2023-11-08T19:27:01.437 INFO:teuthology.orchestra.run.smithi149.stdout: "uptime": 18.757543607999999 2023-11-08T19:27:01.437 INFO:teuthology.orchestra.run.smithi149.stdout:} 2023-11-08T19:27:01.439 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.408+0000 7f37aad19700 1 -- 172.21.15.149:0/2586960342 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f378806af00 msgr2=0x7f378806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:01.439 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.408+0000 7f37aad19700 1 --2- 172.21.15.149:0/2586960342 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f378806af00 0x7f378806d3c0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f37a40d0680 tx=0x7f3798008070 comp rx=0 tx=0).stop 2023-11-08T19:27:01.439 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.408+0000 7f37aad19700 1 -- 172.21.15.149:0/2586960342 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f37a40cc140 msgr2=0x7f37a414db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:01.439 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.408+0000 7f37aad19700 1 --2- 172.21.15.149:0/2586960342 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f37a40cc140 0x7f37a414db30 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f379c00cc10 tx=0x7f379c00a060 comp rx=0 tx=0).stop 2023-11-08T19:27:01.440 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.408+0000 7f37aad19700 1 -- 172.21.15.149:0/2586960342 shutdown_connections 2023-11-08T19:27:01.440 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.408+0000 7f37aad19700 1 --2- 172.21.15.149:0/2586960342 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f378806af00 0x7f378806d3c0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.440 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.408+0000 7f37aad19700 1 --2- 172.21.15.149:0/2586960342 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f37a40cc140 0x7f37a414db30 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.440 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.408+0000 7f37aad19700 1 --2- 172.21.15.149:0/2586960342 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f37a40b2850 0x7f37a40afdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.440 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.408+0000 7f37aad19700 1 --2- 172.21.15.149:0/2586960342 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f37a40b2cd0 0x7f37a414e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.408+0000 7f37aad19700 1 -- 172.21.15.149:0/2586960342 >> 172.21.15.149:0/2586960342 conn(0x7f37a4099a40 msgr2=0x7f37a406ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:01.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.408+0000 7f37aad19700 1 -- 172.21.15.149:0/2586960342 shutdown_connections 2023-11-08T19:27:01.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.408+0000 7f37aad19700 1 -- 172.21.15.149:0/2586960342 wait complete. 2023-11-08T19:27:01.441 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-11-08T19:27:01.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.562+0000 7fdfbc1a3700 1 Processor -- start 2023-11-08T19:27:01.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.562+0000 7fdfbc1a3700 1 -- start start 2023-11-08T19:27:01.567 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.563+0000 7fdfbc1a3700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fdfb40afb30 0x7fdfb40ce380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:01.567 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.563+0000 7fdfbc1a3700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfb40d1330 con 0x7fdfb40b20b0 2023-11-08T19:27:01.568 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.563+0000 7fdfbc1a3700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfb40cb490 con 0x7fdfb40b16b0 2023-11-08T19:27:01.568 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.563+0000 7fdfbc1a3700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfb40cb770 con 0x7fdfb40afb30 2023-11-08T19:27:01.568 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.563+0000 7fdfba740700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fdfb40b20b0 0x7fdfb40aff90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:45706/0 (socket says 172.21.15.149:45706) 2023-11-08T19:27:01.568 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.563+0000 7fdfba740700 1 -- 172.21.15.149:0/412986001 learned_addr learned my addr 172.21.15.149:0/412986001 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:27:01.568 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.564+0000 7fdfb9f3f700 1 --2- 172.21.15.149:0/412986001 >> v2:172.21.15.160:3300/0 conn(0x7fdfb40afb30 0x7fdfb40ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:01.569 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.564+0000 7fdfb8f3d700 1 -- 172.21.15.149:0/412986001 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1049839126 0 0) 0x7fdfb40d1330 con 0x7fdfb40b20b0 2023-11-08T19:27:01.569 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.564+0000 7fdfb8f3d700 1 -- 172.21.15.149:0/412986001 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfa00035b0 con 0x7fdfb40b20b0 2023-11-08T19:27:01.569 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.564+0000 7fdfb8f3d700 1 -- 172.21.15.149:0/412986001 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 239752113 0 0) 0x7fdfb40cb490 con 0x7fdfb40b16b0 2023-11-08T19:27:01.569 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.564+0000 7fdfb8f3d700 1 -- 172.21.15.149:0/412986001 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfb40d1330 con 0x7fdfb40b16b0 2023-11-08T19:27:01.570 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.564+0000 7fdfb9f3f700 1 -- 172.21.15.149:0/412986001 >> v1:172.21.15.160:6789/0 conn(0x7fdfb40b16b0 legacy=0x7fdfb40cbf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:01.570 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.564+0000 7fdfb9f3f700 1 -- 172.21.15.149:0/412986001 >> v1:172.21.15.149:6789/0 conn(0x7fdfb40b20b0 legacy=0x7fdfb40aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:01.570 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.564+0000 7fdfb9f3f700 1 -- 172.21.15.149:0/412986001 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb40cba50 con 0x7fdfb40afb30 2023-11-08T19:27:01.570 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.564+0000 7fdfb9f3f700 1 --2- 172.21.15.149:0/412986001 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdfb40afb30 0x7fdfb40ce380 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fdfa4009820 tx=0x7fdfa4009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec7ef21952994ff server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:01.570 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.564+0000 7fdfb8f3d700 1 -- 172.21.15.149:0/412986001 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa4005e30 con 0x7fdfb40afb30 2023-11-08T19:27:01.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.564+0000 7fdfb8f3d700 1 -- 172.21.15.149:0/412986001 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfa4006030 con 0x7fdfb40afb30 2023-11-08T19:27:01.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.564+0000 7fdfb8f3d700 1 -- 172.21.15.149:0/412986001 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa40063c0 con 0x7fdfb40afb30 2023-11-08T19:27:01.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.565+0000 7fdfbc1a3700 1 -- 172.21.15.149:0/412986001 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdfb40afb30 msgr2=0x7fdfb40ce380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:01.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.565+0000 7fdfbc1a3700 1 --2- 172.21.15.149:0/412986001 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdfb40afb30 0x7fdfb40ce380 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fdfa4009820 tx=0x7fdfa4009b30 comp rx=0 tx=0).stop 2023-11-08T19:27:01.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.565+0000 7fdfbc1a3700 1 -- 172.21.15.149:0/412986001 shutdown_connections 2023-11-08T19:27:01.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.565+0000 7fdfbc1a3700 1 --2- 172.21.15.149:0/412986001 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdfb40afb30 0x7fdfb40ce380 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.565+0000 7fdfbc1a3700 1 -- 172.21.15.149:0/412986001 >> 172.21.15.149:0/412986001 conn(0x7fdfb4099a40 msgr2=0x7fdfb40d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:01.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.565+0000 7fdfbc1a3700 1 -- 172.21.15.149:0/412986001 shutdown_connections 2023-11-08T19:27:01.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.565+0000 7fdfbc1a3700 1 -- 172.21.15.149:0/412986001 wait complete. 2023-11-08T19:27:01.583 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.566+0000 7fdfbc1a3700 1 Processor -- start 2023-11-08T19:27:01.584 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.566+0000 7fdfbc1a3700 1 -- start start 2023-11-08T19:27:01.584 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.567+0000 7fdfbc1a3700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdfb40afb30 0x7fdfb4155f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:01.584 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.567+0000 7fdfbc1a3700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdfb40b16b0 0x7fdfb40c41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:01.584 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.567+0000 7fdfbc1a3700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdfb40b20b0 0x7fdfb40b5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:01.584 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.567+0000 7fdfbc1a3700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb4156480 con 0x7fdfb40b16b0 2023-11-08T19:27:01.585 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.567+0000 7fdfbc1a3700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb40c46f0 con 0x7fdfb40b20b0 2023-11-08T19:27:01.585 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.567+0000 7fdfbc1a3700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb40c7a50 con 0x7fdfb40afb30 2023-11-08T19:27:01.585 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.567+0000 7fdfb973e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdfb40b16b0 0x7fdfb40c41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:01.585 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.567+0000 7fdfb973e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdfb40b16b0 0x7fdfb40c41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43708/0 (socket says 172.21.15.149:43708) 2023-11-08T19:27:01.585 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.567+0000 7fdfb973e700 1 -- 172.21.15.149:0/3274427517 learned_addr learned my addr 172.21.15.149:0/3274427517 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:27:01.586 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.567+0000 7fdfb9f3f700 1 --2- 172.21.15.149:0/3274427517 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdfb40afb30 0x7fdfb4155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:01.586 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.567+0000 7fdfba740700 1 --2- 172.21.15.149:0/3274427517 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdfb40b20b0 0x7fdfb40b5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:01.586 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.567+0000 7fdfb973e700 1 -- 172.21.15.149:0/3274427517 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdfb40afb30 msgr2=0x7fdfb4155f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:01.586 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.567+0000 7fdfb973e700 1 --2- 172.21.15.149:0/3274427517 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdfb40afb30 0x7fdfb4155f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.587 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.567+0000 7fdfb973e700 1 -- 172.21.15.149:0/3274427517 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdfb40b20b0 msgr2=0x7fdfb40b5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:01.587 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.567+0000 7fdfb973e700 1 --2- 172.21.15.149:0/3274427517 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdfb40b20b0 0x7fdfb40b5380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.587 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.567+0000 7fdfb973e700 1 -- 172.21.15.149:0/3274427517 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfa4009430 con 0x7fdfb40b16b0 2023-11-08T19:27:01.587 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.567+0000 7fdfba740700 1 --2- 172.21.15.149:0/3274427517 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdfb40b20b0 0x7fdfb40b5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:27:01.588 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.567+0000 7fdfb9f3f700 1 --2- 172.21.15.149:0/3274427517 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdfb40afb30 0x7fdfb4155f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:27:01.588 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.567+0000 7fdfb973e700 1 --2- 172.21.15.149:0/3274427517 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdfb40b16b0 0x7fdfb40c41b0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fdfb000c4f0 tx=0x7fdfb000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:01.588 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.568+0000 7fdfaa7fc700 1 -- 172.21.15.149:0/3274427517 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb00052d0 con 0x7fdfb40b16b0 2023-11-08T19:27:01.588 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.568+0000 7fdfaa7fc700 1 -- 172.21.15.149:0/3274427517 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb0005430 con 0x7fdfb40b16b0 2023-11-08T19:27:01.589 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.568+0000 7fdfbc1a3700 1 -- 172.21.15.149:0/3274427517 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfb40c7d30 con 0x7fdfb40b16b0 2023-11-08T19:27:01.589 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.568+0000 7fdfaa7fc700 1 -- 172.21.15.149:0/3274427517 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb0003880 con 0x7fdfb40b16b0 2023-11-08T19:27:01.589 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.568+0000 7fdfbc1a3700 1 -- 172.21.15.149:0/3274427517 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfb40c82f0 con 0x7fdfb40b16b0 2023-11-08T19:27:01.589 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.569+0000 7fdfaa7fc700 1 -- 172.21.15.149:0/3274427517 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdfb00039e0 con 0x7fdfb40b16b0 2023-11-08T19:27:01.590 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.569+0000 7fdfaa7fc700 1 --2- 172.21.15.149:0/3274427517 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fdf9806af00 0x7fdf9806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:01.590 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.570+0000 7fdfaa7fc700 1 -- 172.21.15.149:0/3274427517 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7fdfb0088f80 con 0x7fdfb40b16b0 2023-11-08T19:27:01.590 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.570+0000 7fdfb9f3f700 1 --2- 172.21.15.149:0/3274427517 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fdf9806af00 0x7fdf9806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:01.590 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.570+0000 7fdfb9f3f700 1 --2- 172.21.15.149:0/3274427517 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fdf9806af00 0x7fdf9806d3c0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fdfa4013040 tx=0x7fdfa4008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:01.590 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.572+0000 7fdfc839cb80 1 Processor -- start 2023-11-08T19:27:01.591 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.572+0000 7fdfc839cb80 1 -- start start 2023-11-08T19:27:01.591 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.572+0000 7fdfc839cb80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55e4ca89b6f0 0x55e4ca8cb450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:01.591 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.572+0000 7fdfc839cb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e4ca89dc30 0x55e4ca8cb990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:01.591 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.572+0000 7fdfc839cb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e4ca89bad0 0x55e4ca8b5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:01.592 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.572+0000 7fdfc839cb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4ca8076e0 con 0x55e4ca89dc30 2023-11-08T19:27:01.592 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.572+0000 7fdfc839cb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4ca7fb3b0 con 0x55e4ca89bad0 2023-11-08T19:27:01.592 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.572+0000 7fdfc839cb80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e4ca7f8cd0 con 0x55e4ca89b6f0 2023-11-08T19:27:01.592 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.572+0000 7fdfb973e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e4ca89dc30 0x55e4ca8cb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:01.592 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.572+0000 7fdfb973e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e4ca89dc30 0x55e4ca8cb990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43716/0 (socket says 172.21.15.149:43716) 2023-11-08T19:27:01.593 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.572+0000 7fdfb973e700 1 -- 172.21.15.149:0/248798459 learned_addr learned my addr 172.21.15.149:0/248798459 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:27:01.593 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.573+0000 7fdfb9f3f700 1 --2- 172.21.15.149:0/248798459 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55e4ca89b6f0 0x55e4ca8cb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:01.593 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.573+0000 7fdfba740700 1 --2- 172.21.15.149:0/248798459 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e4ca89bad0 0x55e4ca8b5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:01.593 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.573+0000 7fdfb973e700 1 -- 172.21.15.149:0/248798459 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55e4ca89b6f0 msgr2=0x55e4ca8cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:01.594 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.573+0000 7fdfb973e700 1 --2- 172.21.15.149:0/248798459 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55e4ca89b6f0 0x55e4ca8cb450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.594 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.573+0000 7fdfb973e700 1 -- 172.21.15.149:0/248798459 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e4ca89bad0 msgr2=0x55e4ca8b5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:01.594 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.573+0000 7fdfb973e700 1 --2- 172.21.15.149:0/248798459 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e4ca89bad0 0x55e4ca8b5f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.594 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.573+0000 7fdfb973e700 1 -- 172.21.15.149:0/248798459 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e4ca6715e0 con 0x55e4ca89dc30 2023-11-08T19:27:01.594 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.573+0000 7fdfb9f3f700 1 --2- 172.21.15.149:0/248798459 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55e4ca89b6f0 0x55e4ca8cb450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:27:01.595 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.573+0000 7fdfb973e700 1 --2- 172.21.15.149:0/248798459 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e4ca89dc30 0x55e4ca8cb990 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fdfb0086f60 tx=0x7fdfb000a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f56c2153c6536c29 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:01.595 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.573+0000 7fdf977fe700 1 -- 172.21.15.149:0/248798459 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb005b8d0 con 0x55e4ca89dc30 2023-11-08T19:27:01.595 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.573+0000 7fdf977fe700 1 -- 172.21.15.149:0/248798459 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb005fa80 con 0x55e4ca89dc30 2023-11-08T19:27:01.595 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.573+0000 7fdf977fe700 1 -- 172.21.15.149:0/248798459 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb0057a90 con 0x55e4ca89dc30 2023-11-08T19:27:01.595 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.574+0000 7fdfc839cb80 1 -- 172.21.15.149:0/248798459 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e4ca89dc30 msgr2=0x55e4ca8cb990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:01.596 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.574+0000 7fdfc839cb80 1 --2- 172.21.15.149:0/248798459 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e4ca89dc30 0x55e4ca8cb990 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fdfb0086f60 tx=0x7fdfb000a000 comp rx=0 tx=0).stop 2023-11-08T19:27:01.596 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.574+0000 7fdfc839cb80 1 -- 172.21.15.149:0/248798459 shutdown_connections 2023-11-08T19:27:01.596 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.574+0000 7fdfc839cb80 1 --2- 172.21.15.149:0/248798459 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e4ca89bad0 0x55e4ca8b5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.596 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.574+0000 7fdfc839cb80 1 --2- 172.21.15.149:0/248798459 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55e4ca89b6f0 0x55e4ca8cb450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.596 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.574+0000 7fdfc839cb80 1 --2- 172.21.15.149:0/248798459 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e4ca89dc30 0x55e4ca8cb990 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.596 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.574+0000 7fdfc839cb80 1 -- 172.21.15.149:0/248798459 >> 172.21.15.149:0/248798459 conn(0x55e4ca816660 msgr2=0x55e4ca8a13c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:01.597 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.574+0000 7fdfc839cb80 1 -- 172.21.15.149:0/248798459 shutdown_connections 2023-11-08T19:27:01.597 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.574+0000 7fdfc839cb80 1 -- 172.21.15.149:0/248798459 wait complete. 2023-11-08T19:27:01.597 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.574+0000 7fdfc839cb80 1 -- start start 2023-11-08T19:27:01.597 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.574+0000 7fdfc839cb80 1 Processor -- start 2023-11-08T19:27:01.597 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.575+0000 7fdfc839cb80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55e4ca89b6f0 0x55e4ca8ce1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:01.598 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.575+0000 7fdfc839cb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e4ca89bad0 0x55e4ca8f5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:01.598 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.575+0000 7fdfc839cb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e4ca8cf3f0 0x55e4ca89c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:01.598 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.575+0000 7fdfc839cb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4ca7f45c0 con 0x55e4ca8cf3f0 2023-11-08T19:27:01.598 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.575+0000 7fdfc839cb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4ca7900d0 con 0x55e4ca89bad0 2023-11-08T19:27:01.598 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.575+0000 7fdfc839cb80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e4ca78fd70 con 0x55e4ca89b6f0 2023-11-08T19:27:01.599 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.575+0000 7fdfc839cb80 10 client.0 _ll_register_callbacks cb 0x55e4ca5ec7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-08T19:27:01.599 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.575+0000 7fdfba740700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e4ca8cf3f0 0x55e4ca89c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:01.599 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.576+0000 7fdfba740700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e4ca8cf3f0 0x55e4ca89c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43724/0 (socket says 172.21.15.149:43724) 2023-11-08T19:27:01.599 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.576+0000 7fdfba740700 1 -- 172.21.15.149:0/4190714645 learned_addr learned my addr 172.21.15.149:0/4190714645 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:27:01.600 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.576+0000 7fdfb9f3f700 1 --2- 172.21.15.149:0/4190714645 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55e4ca89b6f0 0x55e4ca8ce1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:01.600 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.576+0000 7fdfb973e700 1 --2- 172.21.15.149:0/4190714645 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e4ca89bad0 0x55e4ca8f5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:01.600 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.576+0000 7fdfba740700 1 -- 172.21.15.149:0/4190714645 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55e4ca89b6f0 msgr2=0x55e4ca8ce1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:01.600 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.576+0000 7fdfba740700 1 --2- 172.21.15.149:0/4190714645 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55e4ca89b6f0 0x55e4ca8ce1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.601 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.576+0000 7fdfba740700 1 -- 172.21.15.149:0/4190714645 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e4ca89bad0 msgr2=0x55e4ca8f5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:01.601 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.576+0000 7fdfba740700 1 --2- 172.21.15.149:0/4190714645 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e4ca89bad0 0x55e4ca8f5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.601 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.576+0000 7fdfba740700 1 -- 172.21.15.149:0/4190714645 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfb40c82f0 con 0x55e4ca8cf3f0 2023-11-08T19:27:01.601 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.576+0000 7fdfba740700 1 --2- 172.21.15.149:0/4190714645 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e4ca8cf3f0 0x55e4ca89c020 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7fdfac00f770 tx=0x7fdfac00fa80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cb0fb3f1bbbe701 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:01.601 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.576+0000 7fdf94ff9700 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2023-11-08T19:27:01.602 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.576+0000 7fdf94ff9700 1 -- 172.21.15.149:0/4190714645 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfac0072e0 con 0x55e4ca8cf3f0 2023-11-08T19:27:01.602 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.576+0000 7fdf94ff9700 1 -- 172.21.15.149:0/4190714645 <== mon.0 v2:172.21.15.149:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7fdfac007440 con 0x55e4ca8cf3f0 2023-11-08T19:27:01.602 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.576+0000 7fdfc839cb80 1 -- 172.21.15.149:0/4190714645 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e4ca893880 con 0x55e4ca8cf3f0 2023-11-08T19:27:01.602 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.576+0000 7fdf94ff9700 1 -- 172.21.15.149:0/4190714645 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdfac007600 con 0x55e4ca8cf3f0 2023-11-08T19:27:01.603 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.576+0000 7fdfc839cb80 10 client.7365 fetch_fsmap learned FSMap version 58 2023-11-08T19:27:01.603 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.576+0000 7fdfc839cb80 1 -- 172.21.15.149:0/4190714645 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=2+}) v3 -- 0x55e4ca61dd90 con 0x55e4ca8cf3f0 2023-11-08T19:27:01.603 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.576+0000 7fdf94ff9700 1 -- 172.21.15.149:0/4190714645 <== mon.0 v2:172.21.15.149:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e4ca893880 con 0x55e4ca8cf3f0 2023-11-08T19:27:01.603 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.577+0000 7fdf94ff9700 1 -- 172.21.15.149:0/4190714645 <== mon.0 v2:172.21.15.149:3300/0 5 ==== fsmap(e 58) v1 ==== 3306+0+0 (secure 0 0 0) 0x7fdfac012070 con 0x55e4ca8cf3f0 2023-11-08T19:27:01.603 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.577+0000 7fdfc839cb80 10 client.7365 fetch_fsmap finished waiting for FSMap version 58 2023-11-08T19:27:01.604 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.577+0000 7fdfc839cb80 10 client.7365 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-08T19:27:01.604 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.577+0000 7fdfc839cb80 20 client.7365 populate_metadata read hostname 'smithi149' 2023-11-08T19:27:01.604 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.577+0000 7fdfc839cb80 1 --2- 172.21.15.149:0/4190714645 >> [v2:172.21.15.160:6833/2714564224,v1:172.21.15.160:6835/2714564224] conn(0x55e4ca8f6380 0x55e4ca8dd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:01.604 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.577+0000 7fdfc839cb80 4 client.7365 mds_command: new command op to 7140 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-08T19:27:01.605 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.577+0000 7fdfc839cb80 1 -- 172.21.15.149:0/4190714645 --> [v2:172.21.15.160:6833/2714564224,v1:172.21.15.160:6835/2714564224] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e4ca86fa30 con 0x55e4ca8f6380 2023-11-08T19:27:01.605 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.577+0000 7fdfb9f3f700 1 --2- 172.21.15.149:0/4190714645 >> [v2:172.21.15.160:6833/2714564224,v1:172.21.15.160:6835/2714564224] conn(0x55e4ca8f6380 0x55e4ca8dd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:01.605 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.577+0000 7fdf94ff9700 10 client.7365 ms_handle_connect on v2:172.21.15.160:6833/2714564224 2023-11-08T19:27:01.605 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.577+0000 7fdfb9f3f700 1 --2- 172.21.15.149:0/4190714645 >> [v2:172.21.15.160:6833/2714564224,v1:172.21.15.160:6835/2714564224] conn(0x55e4ca8f6380 0x55e4ca8dd9d0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=513a3d3d482d8632 server_cookie=ef996d2a453a15b1 in_seq=0 out_seq=0 2023-11-08T19:27:01.605 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.578+0000 7fdf94ff9700 1 -- 172.21.15.149:0/4190714645 <== mds.0 v2:172.21.15.160:6833/2714564224 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e4ca86fa30 con 0x55e4ca8f6380 2023-11-08T19:27:01.606 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.578+0000 7fdf94ff9700 10 client.7365 handle_command_reply: tid=0 2023-11-08T19:27:01.606 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.578+0000 7fdfc839cb80 1 client.7365 shutdown 2023-11-08T19:27:01.606 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.578+0000 7fdfc839cb80 1 -- 172.21.15.149:0/4190714645 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e4ca8cf3f0 msgr2=0x55e4ca89c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:01.606 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.578+0000 7fdfc839cb80 1 --2- 172.21.15.149:0/4190714645 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e4ca8cf3f0 0x55e4ca89c020 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7fdfac00f770 tx=0x7fdfac00fa80 comp rx=0 tx=0).stop 2023-11-08T19:27:01.607 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.578+0000 7fdfc839cb80 1 -- 172.21.15.149:0/4190714645 shutdown_connections 2023-11-08T19:27:01.607 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.578+0000 7fdfc839cb80 1 --2- 172.21.15.149:0/4190714645 >> [v2:172.21.15.160:6833/2714564224,v1:172.21.15.160:6835/2714564224] conn(0x55e4ca8f6380 0x55e4ca8dd9d0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.607 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.578+0000 7fdfc839cb80 1 --2- 172.21.15.149:0/4190714645 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e4ca8cf3f0 0x55e4ca89c020 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.607 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.578+0000 7fdfc839cb80 1 --2- 172.21.15.149:0/4190714645 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55e4ca89b6f0 0x55e4ca8ce1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.608 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.578+0000 7fdf94ff9700 0 client.7365 ms_handle_reset on v2:172.21.15.160:6833/2714564224 2023-11-08T19:27:01.608 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.578+0000 7fdfc839cb80 1 --2- 172.21.15.149:0/4190714645 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e4ca89bad0 0x55e4ca8f5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.608 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.578+0000 7fdfc839cb80 1 -- 172.21.15.149:0/4190714645 >> 172.21.15.149:0/4190714645 conn(0x55e4ca816660 msgr2=0x55e4ca8a0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:01.608 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.578+0000 7fdfc839cb80 1 -- 172.21.15.149:0/4190714645 shutdown_connections 2023-11-08T19:27:01.609 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.578+0000 7fdfc839cb80 1 -- 172.21.15.149:0/4190714645 wait complete. 2023-11-08T19:27:01.609 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.578+0000 7fdfc839cb80 20 client.7365 trim_cache size 0 max 16384 2023-11-08T19:27:01.616 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.596+0000 7fdfc839cb80 1 Processor -- start 2023-11-08T19:27:01.617 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.596+0000 7fdfc839cb80 1 -- start start 2023-11-08T19:27:01.617 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.597+0000 7fdfc839cb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e4ca89b6f0 0x55e4ca8ff880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:01.617 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.597+0000 7fdfc839cb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e4ca89bad0 0x55e4ca8b5190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:01.617 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.597+0000 7fdfc839cb80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55e4ca8cf3f0 0x55e4ca8b56d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:01.618 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.597+0000 7fdfc839cb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4ca89ca70 con 0x55e4ca89bad0 2023-11-08T19:27:01.618 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.597+0000 7fdfc839cb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4ca6738d0 con 0x55e4ca89b6f0 2023-11-08T19:27:01.618 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.597+0000 7fdfc839cb80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e4ca89fe00 con 0x55e4ca8cf3f0 2023-11-08T19:27:01.618 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.597+0000 7fdfb973e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e4ca89bad0 0x55e4ca8b5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:01.618 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.597+0000 7fdfb973e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e4ca89bad0 0x55e4ca8b5190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43730/0 (socket says 172.21.15.149:43730) 2023-11-08T19:27:01.619 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.597+0000 7fdfb973e700 1 -- 172.21.15.149:0/2782823838 learned_addr learned my addr 172.21.15.149:0/2782823838 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:27:01.619 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.597+0000 7fdfb9f3f700 1 --2- 172.21.15.149:0/2782823838 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e4ca89b6f0 0x55e4ca8ff880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:01.619 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.597+0000 7fdfba740700 1 --2- 172.21.15.149:0/2782823838 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55e4ca8cf3f0 0x55e4ca8b56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:01.619 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.597+0000 7fdfb973e700 1 -- 172.21.15.149:0/2782823838 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55e4ca8cf3f0 msgr2=0x55e4ca8b56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:01.620 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.597+0000 7fdfb973e700 1 --2- 172.21.15.149:0/2782823838 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55e4ca8cf3f0 0x55e4ca8b56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.620 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.597+0000 7fdfb973e700 1 -- 172.21.15.149:0/2782823838 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e4ca89b6f0 msgr2=0x55e4ca8ff880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:01.620 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.597+0000 7fdfb973e700 1 --2- 172.21.15.149:0/2782823838 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e4ca89b6f0 0x55e4ca8ff880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.620 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.597+0000 7fdfb973e700 1 -- 172.21.15.149:0/2782823838 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e4ca606c10 con 0x55e4ca89bad0 2023-11-08T19:27:01.621 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.598+0000 7fdfb973e700 1 --2- 172.21.15.149:0/2782823838 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e4ca89bad0 0x55e4ca8b5190 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7fdfb00579f0 tx=0x7fdfb00572c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5179535ea2e8a8e server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:01.621 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.598+0000 7fdf97fff700 1 -- 172.21.15.149:0/2782823838 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb005b8d0 con 0x55e4ca89bad0 2023-11-08T19:27:01.621 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.598+0000 7fdf97fff700 1 -- 172.21.15.149:0/2782823838 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb0055bd0 con 0x55e4ca89bad0 2023-11-08T19:27:01.621 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.598+0000 7fdf97fff700 1 -- 172.21.15.149:0/2782823838 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb0057cd0 con 0x55e4ca89bad0 2023-11-08T19:27:01.622 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.598+0000 7fdfc839cb80 1 -- 172.21.15.149:0/2782823838 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e4ca89bad0 msgr2=0x55e4ca8b5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:01.622 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.598+0000 7fdfc839cb80 1 --2- 172.21.15.149:0/2782823838 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e4ca89bad0 0x55e4ca8b5190 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7fdfb00579f0 tx=0x7fdfb00572c0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.622 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.598+0000 7fdfc839cb80 1 -- 172.21.15.149:0/2782823838 shutdown_connections 2023-11-08T19:27:01.622 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.598+0000 7fdfc839cb80 1 --2- 172.21.15.149:0/2782823838 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e4ca89b6f0 0x55e4ca8ff880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.622 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.598+0000 7fdfc839cb80 1 --2- 172.21.15.149:0/2782823838 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55e4ca8cf3f0 0x55e4ca8b56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.623 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.598+0000 7fdfc839cb80 1 --2- 172.21.15.149:0/2782823838 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e4ca89bad0 0x55e4ca8b5190 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.623 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.598+0000 7fdfc839cb80 1 -- 172.21.15.149:0/2782823838 >> 172.21.15.149:0/2782823838 conn(0x55e4ca816660 msgr2=0x55e4ca8977e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:01.623 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.598+0000 7fdfc839cb80 1 -- 172.21.15.149:0/2782823838 shutdown_connections 2023-11-08T19:27:01.623 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.598+0000 7fdfc839cb80 1 -- 172.21.15.149:0/2782823838 wait complete. 2023-11-08T19:27:01.624 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.599+0000 7fdfc839cb80 1 -- start start 2023-11-08T19:27:01.624 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.599+0000 7fdfc839cb80 1 Processor -- start 2023-11-08T19:27:01.624 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.600+0000 7fdfc839cb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e4ca89b6f0 0x55e4ca94caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:01.624 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.600+0000 7fdfc839cb80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55e4ca89bad0 0x55e4ca8e7c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:01.625 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.600+0000 7fdfc839cb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e4ca8cf3f0 0x55e4ca8e8180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:01.625 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.600+0000 7fdfc839cb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4ca89c480 con 0x55e4ca89b6f0 2023-11-08T19:27:01.625 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.600+0000 7fdfc839cb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4ca8ea490 con 0x55e4ca8cf3f0 2023-11-08T19:27:01.625 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.601+0000 7fdfc839cb80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e4ca89c260 con 0x55e4ca89bad0 2023-11-08T19:27:01.626 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.601+0000 7fdfc839cb80 10 client.0 _ll_register_callbacks cb 0x7fdfac0021b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-08T19:27:01.626 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.601+0000 7fdfb9f3f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e4ca89b6f0 0x55e4ca94caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:01.626 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.601+0000 7fdfb9f3f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e4ca89b6f0 0x55e4ca94caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43734/0 (socket says 172.21.15.149:43734) 2023-11-08T19:27:01.626 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.601+0000 7fdfb9f3f700 1 -- 172.21.15.149:0/2460016479 learned_addr learned my addr 172.21.15.149:0/2460016479 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:27:01.627 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.601+0000 7fdfb973e700 1 --2- 172.21.15.149:0/2460016479 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55e4ca89bad0 0x55e4ca8e7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:01.627 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.601+0000 7fdfba740700 1 --2- 172.21.15.149:0/2460016479 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e4ca8cf3f0 0x55e4ca8e8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:01.627 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.601+0000 7fdfb9f3f700 1 -- 172.21.15.149:0/2460016479 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55e4ca89bad0 msgr2=0x55e4ca8e7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:01.627 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.601+0000 7fdfb9f3f700 1 --2- 172.21.15.149:0/2460016479 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55e4ca89bad0 0x55e4ca8e7c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.627 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.601+0000 7fdfb9f3f700 1 -- 172.21.15.149:0/2460016479 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e4ca8cf3f0 msgr2=0x55e4ca8e8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:01.628 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.601+0000 7fdfb9f3f700 1 --2- 172.21.15.149:0/2460016479 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e4ca8cf3f0 0x55e4ca8e8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.628 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.601+0000 7fdfb9f3f700 1 -- 172.21.15.149:0/2460016479 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e4ca6715e0 con 0x55e4ca89b6f0 2023-11-08T19:27:01.628 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.601+0000 7fdfba740700 1 --2- 172.21.15.149:0/2460016479 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e4ca8cf3f0 0x55e4ca8e8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:27:01.628 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.601+0000 7fdfb9f3f700 1 --2- 172.21.15.149:0/2460016479 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e4ca89b6f0 0x55e4ca94caa0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fdfa4009820 tx=0x7fdfa40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=990db3f9c1115cce server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:01.628 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.601+0000 7fdf94ff9700 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2023-11-08T19:27:01.629 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.601+0000 7fdf94ff9700 1 -- 172.21.15.149:0/2460016479 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa402c030 con 0x55e4ca89b6f0 2023-11-08T19:27:01.629 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.601+0000 7fdf94ff9700 1 -- 172.21.15.149:0/2460016479 <== mon.0 v2:172.21.15.149:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7fdfa403c6f0 con 0x55e4ca89b6f0 2023-11-08T19:27:01.629 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.601+0000 7fdfc839cb80 1 -- 172.21.15.149:0/2460016479 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdfb005fa80 con 0x55e4ca89b6f0 2023-11-08T19:27:01.629 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.601+0000 7fdf94ff9700 1 -- 172.21.15.149:0/2460016479 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdfa4004020 con 0x55e4ca89b6f0 2023-11-08T19:27:01.629 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.601+0000 7fdfc839cb80 10 client.7371 fetch_fsmap learned FSMap version 58 2023-11-08T19:27:01.630 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.601+0000 7fdfc839cb80 1 -- 172.21.15.149:0/2460016479 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=2+}) v3 -- 0x55e4ca644200 con 0x55e4ca89b6f0 2023-11-08T19:27:01.630 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.601+0000 7fdf94ff9700 1 -- 172.21.15.149:0/2460016479 <== mon.0 v2:172.21.15.149:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfa404c070 con 0x55e4ca89b6f0 2023-11-08T19:27:01.630 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.602+0000 7fdf94ff9700 1 -- 172.21.15.149:0/2460016479 <== mon.0 v2:172.21.15.149:3300/0 5 ==== fsmap(e 58) v1 ==== 3306+0+0 (secure 0 0 0) 0x7fdfa4004180 con 0x55e4ca89b6f0 2023-11-08T19:27:01.630 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.602+0000 7fdfc839cb80 10 client.7371 fetch_fsmap finished waiting for FSMap version 58 2023-11-08T19:27:01.631 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.602+0000 7fdfc839cb80 10 client.7371 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-08T19:27:01.631 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.602+0000 7fdfc839cb80 20 client.7371 populate_metadata read hostname 'smithi149' 2023-11-08T19:27:01.631 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.602+0000 7fdfc839cb80 1 --2- 172.21.15.149:0/2460016479 >> [v2:172.21.15.160:6833/2714564224,v1:172.21.15.160:6835/2714564224] conn(0x55e4ca8cb630 0x55e4ca8cba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:01.631 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.602+0000 7fdfc839cb80 4 client.7371 mds_command: new command op to 7140 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-08T19:27:01.631 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.602+0000 7fdfc839cb80 1 -- 172.21.15.149:0/2460016479 --> [v2:172.21.15.160:6833/2714564224,v1:172.21.15.160:6835/2714564224] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e4ca7ed5a0 con 0x55e4ca8cb630 2023-11-08T19:27:01.632 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.602+0000 7fdfb973e700 1 --2- 172.21.15.149:0/2460016479 >> [v2:172.21.15.160:6833/2714564224,v1:172.21.15.160:6835/2714564224] conn(0x55e4ca8cb630 0x55e4ca8cba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:01.632 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.602+0000 7fdf94ff9700 10 client.7371 ms_handle_connect on v2:172.21.15.160:6833/2714564224 2023-11-08T19:27:01.632 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.602+0000 7fdfb973e700 1 --2- 172.21.15.149:0/2460016479 >> [v2:172.21.15.160:6833/2714564224,v1:172.21.15.160:6835/2714564224] conn(0x55e4ca8cb630 0x55e4ca8cba10 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8c0257d9ac0603 server_cookie=3ecd549d39a7d1bf in_seq=0 out_seq=0 2023-11-08T19:27:01.632 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.602+0000 7fdf94ff9700 1 -- 172.21.15.149:0/2460016479 <== mds.0 v2:172.21.15.160:6833/2714564224 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55e4ca7ed5a0 con 0x55e4ca8cb630 2023-11-08T19:27:01.632 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.602+0000 7fdf94ff9700 10 client.7371 handle_command_reply: tid=0 2023-11-08T19:27:01.633 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.602+0000 7fdfc839cb80 1 client.7371 shutdown 2023-11-08T19:27:01.633 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.603+0000 7fdfc839cb80 1 -- 172.21.15.149:0/2460016479 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e4ca89b6f0 msgr2=0x55e4ca94caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:01.633 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.603+0000 7fdfc839cb80 1 --2- 172.21.15.149:0/2460016479 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e4ca89b6f0 0x55e4ca94caa0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fdfa4009820 tx=0x7fdfa40047c0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.633 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.603+0000 7fdfc839cb80 1 -- 172.21.15.149:0/2460016479 shutdown_connections 2023-11-08T19:27:01.633 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.603+0000 7fdfc839cb80 1 --2- 172.21.15.149:0/2460016479 >> [v2:172.21.15.160:6833/2714564224,v1:172.21.15.160:6835/2714564224] conn(0x55e4ca8cb630 0x55e4ca8cba10 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.634 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.603+0000 7fdfc839cb80 1 --2- 172.21.15.149:0/2460016479 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e4ca8cf3f0 0x55e4ca8e8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.634 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.603+0000 7fdf94ff9700 0 client.7371 ms_handle_reset on v2:172.21.15.160:6833/2714564224 2023-11-08T19:27:01.634 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.603+0000 7fdfc839cb80 1 --2- 172.21.15.149:0/2460016479 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e4ca89b6f0 0x55e4ca94caa0 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.634 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.603+0000 7fdfc839cb80 1 --2- 172.21.15.149:0/2460016479 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55e4ca89bad0 0x55e4ca8e7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.634 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.603+0000 7fdfc839cb80 1 -- 172.21.15.149:0/2460016479 >> 172.21.15.149:0/2460016479 conn(0x55e4ca816660 msgr2=0x55e4ca8e0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:01.635 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.603+0000 7fdfc839cb80 1 -- 172.21.15.149:0/2460016479 shutdown_connections 2023-11-08T19:27:01.635 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.603+0000 7fdfc839cb80 1 -- 172.21.15.149:0/2460016479 wait complete. 2023-11-08T19:27:01.635 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.603+0000 7fdfc839cb80 20 client.7371 trim_cache size 0 max 16384 2023-11-08T19:27:01.635 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2023-11-08T19:27:01.636 INFO:teuthology.orchestra.run.smithi149.stdout: "cluster_fsid": "0aba7c70-fe80-4446-a2f5-7502ac3adfb4", 2023-11-08T19:27:01.636 INFO:teuthology.orchestra.run.smithi149.stdout: "whoami": 0, 2023-11-08T19:27:01.636 INFO:teuthology.orchestra.run.smithi149.stdout: "id": 7140, 2023-11-08T19:27:01.636 INFO:teuthology.orchestra.run.smithi149.stdout: "want_state": "up:active", 2023-11-08T19:27:01.636 INFO:teuthology.orchestra.run.smithi149.stdout: "state": "up:active", 2023-11-08T19:27:01.637 INFO:teuthology.orchestra.run.smithi149.stdout: "fs_name": "cephfs", 2023-11-08T19:27:01.637 INFO:teuthology.orchestra.run.smithi149.stdout: "rank_uptime": 12.016178526999999, 2023-11-08T19:27:01.637 INFO:teuthology.orchestra.run.smithi149.stdout: "mdsmap_epoch": 58, 2023-11-08T19:27:01.637 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_epoch": 96, 2023-11-08T19:27:01.637 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_epoch_barrier": 96, 2023-11-08T19:27:01.638 INFO:teuthology.orchestra.run.smithi149.stdout: "uptime": 18.943951374000001 2023-11-08T19:27:01.638 INFO:teuthology.orchestra.run.smithi149.stdout:} 2023-11-08T19:27:01.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.603+0000 7fdfbc1a3700 1 -- 172.21.15.149:0/3274427517 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fdf9806af00 msgr2=0x7fdf9806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:01.640 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.603+0000 7fdfbc1a3700 1 --2- 172.21.15.149:0/3274427517 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fdf9806af00 0x7fdf9806d3c0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fdfa4013040 tx=0x7fdfa4008070 comp rx=0 tx=0).stop 2023-11-08T19:27:01.640 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.603+0000 7fdfbc1a3700 1 -- 172.21.15.149:0/3274427517 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdfb40b16b0 msgr2=0x7fdfb40c41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:01.640 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.603+0000 7fdfbc1a3700 1 --2- 172.21.15.149:0/3274427517 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdfb40b16b0 0x7fdfb40c41b0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fdfb000c4f0 tx=0x7fdfb000c8b0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.640 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.603+0000 7fdfbc1a3700 1 -- 172.21.15.149:0/3274427517 shutdown_connections 2023-11-08T19:27:01.641 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.603+0000 7fdfbc1a3700 1 --2- 172.21.15.149:0/3274427517 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fdf9806af00 0x7fdf9806d3c0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.641 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.603+0000 7fdfbc1a3700 1 --2- 172.21.15.149:0/3274427517 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdfb40b20b0 0x7fdfb40b5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.641 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.603+0000 7fdfbc1a3700 1 --2- 172.21.15.149:0/3274427517 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdfb40afb30 0x7fdfb4155f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.641 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.603+0000 7fdfbc1a3700 1 --2- 172.21.15.149:0/3274427517 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdfb40b16b0 0x7fdfb40c41b0 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.641 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.603+0000 7fdfbc1a3700 1 -- 172.21.15.149:0/3274427517 >> 172.21.15.149:0/3274427517 conn(0x7fdfb4099a40 msgr2=0x7fdfb40adba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:01.642 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.603+0000 7fdfbc1a3700 1 -- 172.21.15.149:0/3274427517 shutdown_connections 2023-11-08T19:27:01.642 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.603+0000 7fdfbc1a3700 1 -- 172.21.15.149:0/3274427517 wait complete. 2023-11-08T19:27:01.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:27:01.643 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p d1/dir) 2023-11-08T19:27:01.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:27:01.666 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 1 d1) 2023-11-08T19:27:01.728 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:27:01.889 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.887+0000 7fa37d8a2700 1 Processor -- start 2023-11-08T19:27:01.889 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.887+0000 7fa37d8a2700 1 -- start start 2023-11-08T19:27:01.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.888+0000 7fa37d8a2700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa37815db70 0x7fa378161dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:01.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.888+0000 7fa37d8a2700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa3780b2c00 0x7fa37815df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:01.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.888+0000 7fa37d8a2700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fa37806ab80 0x7fa37806b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:01.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.888+0000 7fa37d8a2700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa37806b550 con 0x7fa37815db70 2023-11-08T19:27:01.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.888+0000 7fa37d8a2700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa378161940 con 0x7fa37806ab80 2023-11-08T19:27:01.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.888+0000 7fa37d8a2700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa37815eeb0 con 0x7fa3780b2c00 2023-11-08T19:27:01.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.888+0000 7fa376ffd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa37815db70 0x7fa378161dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:01.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.888+0000 7fa376ffd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa37815db70 0x7fa378161dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43742/0 (socket says 172.21.15.149:43742) 2023-11-08T19:27:01.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.888+0000 7fa376ffd700 1 -- 172.21.15.149:0/1243443806 learned_addr learned my addr 172.21.15.149:0/1243443806 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:27:01.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.888+0000 7fa3777fe700 1 --2- 172.21.15.149:0/1243443806 >> v2:172.21.15.160:3300/0 conn(0x7fa37806ab80 0x7fa37806b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:01.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.888+0000 7fa3767fc700 1 --2- 172.21.15.149:0/1243443806 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa3780b2c00 0x7fa37815df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:01.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.888+0000 7fa376ffd700 1 -- 172.21.15.149:0/1243443806 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa3780b2c00 msgr2=0x7fa37815df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:01.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.888+0000 7fa376ffd700 1 --2- 172.21.15.149:0/1243443806 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa3780b2c00 0x7fa37815df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.888+0000 7fa376ffd700 1 -- 172.21.15.149:0/1243443806 >> v2:172.21.15.160:3300/0 conn(0x7fa37806ab80 msgr2=0x7fa37806b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:01.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.888+0000 7fa376ffd700 1 --2- 172.21.15.149:0/1243443806 >> v2:172.21.15.160:3300/0 conn(0x7fa37806ab80 0x7fa37806b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.888+0000 7fa376ffd700 1 -- 172.21.15.149:0/1243443806 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa37815e8f0 con 0x7fa37815db70 2023-11-08T19:27:01.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.888+0000 7fa3777fe700 1 --2- 172.21.15.149:0/1243443806 >> v2:172.21.15.160:3300/0 conn(0x7fa37806ab80 0x7fa37806b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:27:01.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.888+0000 7fa376ffd700 1 --2- 172.21.15.149:0/1243443806 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa37815db70 0x7fa378161dd0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fa37806cc10 tx=0x7fa36c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=836fb3b32740dd1b server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:01.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.889+0000 7fa375ffb700 1 -- 172.21.15.149:0/1243443806 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36c00b870 con 0x7fa37815db70 2023-11-08T19:27:01.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.889+0000 7fa375ffb700 1 -- 172.21.15.149:0/1243443806 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa36c00b9d0 con 0x7fa37815db70 2023-11-08T19:27:01.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.889+0000 7fa375ffb700 1 -- 172.21.15.149:0/1243443806 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36c00bd60 con 0x7fa37815db70 2023-11-08T19:27:01.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.889+0000 7fa37d8a2700 1 -- 172.21.15.149:0/1243443806 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa37815db70 msgr2=0x7fa378161dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:01.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.889+0000 7fa37d8a2700 1 --2- 172.21.15.149:0/1243443806 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa37815db70 0x7fa378161dd0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fa37806cc10 tx=0x7fa36c009bd0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.889+0000 7fa37d8a2700 1 -- 172.21.15.149:0/1243443806 shutdown_connections 2023-11-08T19:27:01.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.889+0000 7fa37d8a2700 1 --2- 172.21.15.149:0/1243443806 >> v2:172.21.15.160:3300/0 conn(0x7fa37806ab80 0x7fa37806b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.889+0000 7fa37d8a2700 1 --2- 172.21.15.149:0/1243443806 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa37815db70 0x7fa378161dd0 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.889+0000 7fa37d8a2700 1 --2- 172.21.15.149:0/1243443806 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa3780b2c00 0x7fa37815df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.889+0000 7fa37d8a2700 1 -- 172.21.15.149:0/1243443806 >> 172.21.15.149:0/1243443806 conn(0x7fa3780ccff0 msgr2=0x7fa3780cd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:01.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.889+0000 7fa37d8a2700 1 -- 172.21.15.149:0/1243443806 shutdown_connections 2023-11-08T19:27:01.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.889+0000 7fa37d8a2700 1 -- 172.21.15.149:0/1243443806 wait complete. 2023-11-08T19:27:01.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.890+0000 7fa37d8a2700 1 Processor -- start 2023-11-08T19:27:01.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.891+0000 7fa37d8a2700 1 -- start start 2023-11-08T19:27:01.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.891+0000 7fa37d8a2700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa37806ab80 0x7fa378149550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:01.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.891+0000 7fa37d8a2700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa3780b2c00 0x7fa378149c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:01.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.891+0000 7fa37d8a2700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa378159e20 0x7fa3780c6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:01.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.891+0000 7fa37d8a2700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3780c5ca0 con 0x7fa378159e20 2023-11-08T19:27:01.902 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.891+0000 7fa37d8a2700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa37814cc10 con 0x7fa37806ab80 2023-11-08T19:27:01.902 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.891+0000 7fa37d8a2700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3780ac960 con 0x7fa3780b2c00 2023-11-08T19:27:01.902 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.891+0000 7fa3777fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa378159e20 0x7fa3780c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:01.902 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.891+0000 7fa3777fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa378159e20 0x7fa3780c6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43752/0 (socket says 172.21.15.149:43752) 2023-11-08T19:27:01.902 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.891+0000 7fa3777fe700 1 -- 172.21.15.149:0/3587420022 learned_addr learned my addr 172.21.15.149:0/3587420022 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:27:01.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.892+0000 7fa3767fc700 1 --2- 172.21.15.149:0/3587420022 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa3780b2c00 0x7fa378149c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:01.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.892+0000 7fa376ffd700 1 --2- 172.21.15.149:0/3587420022 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa37806ab80 0x7fa378149550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:01.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.892+0000 7fa3777fe700 1 -- 172.21.15.149:0/3587420022 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa3780b2c00 msgr2=0x7fa378149c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:01.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.892+0000 7fa3777fe700 1 --2- 172.21.15.149:0/3587420022 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa3780b2c00 0x7fa378149c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.892+0000 7fa3777fe700 1 -- 172.21.15.149:0/3587420022 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa37806ab80 msgr2=0x7fa378149550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:01.904 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.892+0000 7fa3777fe700 1 --2- 172.21.15.149:0/3587420022 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa37806ab80 0x7fa378149550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:01.904 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.892+0000 7fa3777fe700 1 -- 172.21.15.149:0/3587420022 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa36c009550 con 0x7fa378159e20 2023-11-08T19:27:01.904 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.892+0000 7fa3777fe700 1 --2- 172.21.15.149:0/3587420022 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa378159e20 0x7fa3780c6130 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fa370007db0 tx=0x7fa37000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:01.904 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.892+0000 7fa35ffff700 1 -- 172.21.15.149:0/3587420022 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37000dd20 con 0x7fa378159e20 2023-11-08T19:27:01.904 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.892+0000 7fa35ffff700 1 -- 172.21.15.149:0/3587420022 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa37000f040 con 0x7fa378159e20 2023-11-08T19:27:01.905 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.892+0000 7fa37d8a2700 1 -- 172.21.15.149:0/3587420022 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3780acc40 con 0x7fa378159e20 2023-11-08T19:27:01.905 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.892+0000 7fa35ffff700 1 -- 172.21.15.149:0/3587420022 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37000dea0 con 0x7fa378159e20 2023-11-08T19:27:01.905 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.892+0000 7fa37d8a2700 1 -- 172.21.15.149:0/3587420022 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa37814a1b0 con 0x7fa378159e20 2023-11-08T19:27:01.905 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.893+0000 7fa37d8a2700 1 -- 172.21.15.149:0/3587420022 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3780c5e50 con 0x7fa378159e20 2023-11-08T19:27:01.905 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.894+0000 7fa35ffff700 1 -- 172.21.15.149:0/3587420022 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa370003c60 con 0x7fa378159e20 2023-11-08T19:27:01.905 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.894+0000 7fa35ffff700 1 --2- 172.21.15.149:0/3587420022 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa36406af00 0x7fa36406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:01.906 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.894+0000 7fa376ffd700 1 --2- 172.21.15.149:0/3587420022 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa36406af00 0x7fa36406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:01.906 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.894+0000 7fa35ffff700 1 -- 172.21.15.149:0/3587420022 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7fa370089b20 con 0x7fa378159e20 2023-11-08T19:27:01.906 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.895+0000 7fa376ffd700 1 --2- 172.21.15.149:0/3587420022 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa36406af00 0x7fa36406d3c0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fa3780d1590 tx=0x7fa36c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:01.906 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:01.899+0000 7fa35ffff700 1 -- 172.21.15.149:0/3587420022 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa3780c5e50 con 0x7fa378159e20 2023-11-08T19:27:02.132 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:02.129+0000 7fa37d8a2700 1 -- 172.21.15.149:0/3587420022 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa3780c5a50 con 0x7fa378159e20 2023-11-08T19:27:02.132 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:02.130+0000 7fa35ffff700 1 -- 172.21.15.149:0/3587420022 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4938 (secure 0 0 0) 0x7fa37001a090 con 0x7fa378159e20 2023-11-08T19:27:02.132 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:27:02.133 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":58,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6451,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/2947079163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2947079163},{"type":"v1","addr":"172.21.15.160:6834","nonce":2947079163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49},{"gid":7122,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/589971879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":589971879},{"type":"v1","addr":"172.21.15.149:6836","nonce":589971879}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:26:58.660035+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7140,"mds_1":7125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7125":{"gid":7125,"name":"c","rank":1,"incarnation":57,"state":"up:active","state_seq":6,"addr":"172.21.15.149:6837/3917392643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3917392643},{"type":"v1","addr":"172.21.15.149:6837","nonce":3917392643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7140":{"gid":7140,"name":"b","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.160:6835/2714564224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":2714564224},{"type":"v1","addr":"172.21.15.160:6835","nonce":2714564224}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:27:02.135 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:02.132+0000 7fa37d8a2700 1 -- 172.21.15.149:0/3587420022 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa36406af00 msgr2=0x7fa36406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:02.135 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:02.132+0000 7fa37d8a2700 1 --2- 172.21.15.149:0/3587420022 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa36406af00 0x7fa36406d3c0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fa3780d1590 tx=0x7fa36c008030 comp rx=0 tx=0).stop 2023-11-08T19:27:02.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:02.132+0000 7fa37d8a2700 1 -- 172.21.15.149:0/3587420022 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa378159e20 msgr2=0x7fa3780c6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:02.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:02.132+0000 7fa37d8a2700 1 --2- 172.21.15.149:0/3587420022 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa378159e20 0x7fa3780c6130 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fa370007db0 tx=0x7fa37000d3b0 comp rx=0 tx=0).stop 2023-11-08T19:27:02.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:02.133+0000 7fa37d8a2700 1 -- 172.21.15.149:0/3587420022 shutdown_connections 2023-11-08T19:27:02.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:02.133+0000 7fa37d8a2700 1 --2- 172.21.15.149:0/3587420022 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa36406af00 0x7fa36406d3c0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:02.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:02.133+0000 7fa37d8a2700 1 --2- 172.21.15.149:0/3587420022 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa37806ab80 0x7fa378149550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:02.137 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:02.133+0000 7fa37d8a2700 1 --2- 172.21.15.149:0/3587420022 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa378159e20 0x7fa3780c6130 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:02.137 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:02.133+0000 7fa37d8a2700 1 --2- 172.21.15.149:0/3587420022 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa3780b2c00 0x7fa378149c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:02.137 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:02.133+0000 7fa37d8a2700 1 -- 172.21.15.149:0/3587420022 >> 172.21.15.149:0/3587420022 conn(0x7fa3780ccff0 msgr2=0x7fa37815df50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:02.137 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:02.133+0000 7fa37d8a2700 1 -- 172.21.15.149:0/3587420022 shutdown_connections 2023-11-08T19:27:02.137 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:02.133+0000 7fa37d8a2700 1 -- 172.21.15.149:0/3587420022 wait complete. 2023-11-08T19:27:02.138 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 58 2023-11-08T19:27:02.147 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2023-11-08T19:27:02.285 INFO:teuthology.orchestra.run.smithi149.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-11-08T19:27:02.286 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-11-08T19:27:02.286 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1', 1)] 2023-11-08T19:27:04.288 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:27:04.422 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.420+0000 7f8d1eb35700 1 Processor -- start 2023-11-08T19:27:04.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.420+0000 7f8d1eb35700 1 -- start start 2023-11-08T19:27:04.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.421+0000 7f8d1eb35700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f8d1806da50 0x7f8d1806e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:04.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.421+0000 7f8d1eb35700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d180cb220 con 0x7f8d1815a1a0 2023-11-08T19:27:04.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.421+0000 7f8d1eb35700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d180cb500 con 0x7f8d1806c2a0 2023-11-08T19:27:04.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.421+0000 7f8d1eb35700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d1815a580 con 0x7f8d1806da50 2023-11-08T19:27:04.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.421+0000 7f8d1c8d1700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f8d1815a1a0 0x7f8d1806bb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:45758/0 (socket says 172.21.15.149:45758) 2023-11-08T19:27:04.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.421+0000 7f8d1c8d1700 1 -- 172.21.15.149:0/3042116091 learned_addr learned my addr 172.21.15.149:0/3042116091 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:27:04.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.421+0000 7f8d1d0d2700 1 --2- 172.21.15.149:0/3042116091 >> v2:172.21.15.160:3300/0 conn(0x7f8d1806da50 0x7f8d1806e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:04.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.422+0000 7f8d177fe700 1 -- 172.21.15.149:0/3042116091 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 771923062 0 0) 0x7f8d180cb220 con 0x7f8d1815a1a0 2023-11-08T19:27:04.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.422+0000 7f8d177fe700 1 -- 172.21.15.149:0/3042116091 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d080035b0 con 0x7f8d1815a1a0 2023-11-08T19:27:04.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.422+0000 7f8d177fe700 1 -- 172.21.15.149:0/3042116091 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4103271263 0 0) 0x7f8d180cb500 con 0x7f8d1806c2a0 2023-11-08T19:27:04.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.422+0000 7f8d177fe700 1 -- 172.21.15.149:0/3042116091 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d180cb220 con 0x7f8d1806c2a0 2023-11-08T19:27:04.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.422+0000 7f8d1d0d2700 1 -- 172.21.15.149:0/3042116091 >> v1:172.21.15.160:6789/0 conn(0x7f8d1806c2a0 legacy=0x7f8d180cdd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:04.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.422+0000 7f8d1d0d2700 1 -- 172.21.15.149:0/3042116091 >> v1:172.21.15.149:6789/0 conn(0x7f8d1815a1a0 legacy=0x7f8d1806bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:04.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.422+0000 7f8d177fe700 1 -- 172.21.15.149:0/3042116091 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3129662713 0 0) 0x7f8d080035b0 con 0x7f8d1815a1a0 2023-11-08T19:27:04.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.422+0000 7f8d1d0d2700 1 -- 172.21.15.149:0/3042116091 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d180cb7e0 con 0x7f8d1806da50 2023-11-08T19:27:04.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.422+0000 7f8d1d0d2700 1 --2- 172.21.15.149:0/3042116091 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d1806da50 0x7f8d1806e940 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f8d1000aea0 tx=0x7f8d1000c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c0162194d99c640 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:04.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.422+0000 7f8d177fe700 1 -- 172.21.15.149:0/3042116091 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d1000f070 con 0x7f8d1806da50 2023-11-08T19:27:04.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.422+0000 7f8d177fe700 1 -- 172.21.15.149:0/3042116091 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d10003a20 con 0x7f8d1806da50 2023-11-08T19:27:04.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.422+0000 7f8d177fe700 1 -- 172.21.15.149:0/3042116091 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c001670 con 0x7f8d1806da50 2023-11-08T19:27:04.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.423+0000 7f8d1eb35700 1 -- 172.21.15.149:0/3042116091 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d1806da50 msgr2=0x7f8d1806e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:04.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.423+0000 7f8d1eb35700 1 --2- 172.21.15.149:0/3042116091 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d1806da50 0x7f8d1806e940 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f8d1000aea0 tx=0x7f8d1000c330 comp rx=0 tx=0).stop 2023-11-08T19:27:04.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.423+0000 7f8d1eb35700 1 -- 172.21.15.149:0/3042116091 shutdown_connections 2023-11-08T19:27:04.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.423+0000 7f8d1eb35700 1 --2- 172.21.15.149:0/3042116091 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d1806da50 0x7f8d1806e940 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:04.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.423+0000 7f8d1eb35700 1 -- 172.21.15.149:0/3042116091 >> 172.21.15.149:0/3042116091 conn(0x7f8d18071720 msgr2=0x7f8d18071b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:04.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.423+0000 7f8d1eb35700 1 -- 172.21.15.149:0/3042116091 shutdown_connections 2023-11-08T19:27:04.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.423+0000 7f8d1eb35700 1 -- 172.21.15.149:0/3042116091 wait complete. 2023-11-08T19:27:04.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.424+0000 7f8d1eb35700 1 Processor -- start 2023-11-08T19:27:04.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.424+0000 7f8d1eb35700 1 -- start start 2023-11-08T19:27:04.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.425+0000 7f8d1eb35700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d1806c2a0 0x7f8d181f1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:04.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.425+0000 7f8d1eb35700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d1806da50 0x7f8d180c6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:04.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.425+0000 7f8d1eb35700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8d1815a1a0 0x7f8d180c6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:04.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.425+0000 7f8d1eb35700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d180c41d0 con 0x7f8d1806c2a0 2023-11-08T19:27:04.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.425+0000 7f8d1eb35700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d180c35c0 con 0x7f8d1806da50 2023-11-08T19:27:04.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.425+0000 7f8d1eb35700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d180c38a0 con 0x7f8d1815a1a0 2023-11-08T19:27:04.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.425+0000 7f8d1c8d1700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d1806c2a0 0x7f8d181f1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:04.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.425+0000 7f8d1c8d1700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d1806c2a0 0x7f8d181f1280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43762/0 (socket says 172.21.15.149:43762) 2023-11-08T19:27:04.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.425+0000 7f8d1c8d1700 1 -- 172.21.15.149:0/3400624919 learned_addr learned my addr 172.21.15.149:0/3400624919 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:27:04.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.425+0000 7f8d1d0d2700 1 --2- 172.21.15.149:0/3400624919 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8d1815a1a0 0x7f8d180c6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:04.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.425+0000 7f8d17fff700 1 --2- 172.21.15.149:0/3400624919 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d1806da50 0x7f8d180c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:04.438 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.425+0000 7f8d1c8d1700 1 -- 172.21.15.149:0/3400624919 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8d1815a1a0 msgr2=0x7f8d180c6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:04.438 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.425+0000 7f8d1c8d1700 1 --2- 172.21.15.149:0/3400624919 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8d1815a1a0 0x7f8d180c6690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:04.438 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.425+0000 7f8d1c8d1700 1 -- 172.21.15.149:0/3400624919 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d1806da50 msgr2=0x7f8d180c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:04.438 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.425+0000 7f8d1c8d1700 1 --2- 172.21.15.149:0/3400624919 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d1806da50 0x7f8d180c6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:04.438 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.425+0000 7f8d1c8d1700 1 -- 172.21.15.149:0/3400624919 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d1000ab80 con 0x7f8d1806c2a0 2023-11-08T19:27:04.439 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.425+0000 7f8d17fff700 1 --2- 172.21.15.149:0/3400624919 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d1806da50 0x7f8d180c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:27:04.439 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.426+0000 7f8d1c8d1700 1 --2- 172.21.15.149:0/3400624919 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d1806c2a0 0x7f8d181f1280 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c00c6b0 tx=0x7f8d0c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:04.439 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.426+0000 7f8d157fa700 1 -- 172.21.15.149:0/3400624919 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c007620 con 0x7f8d1806c2a0 2023-11-08T19:27:04.440 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.426+0000 7f8d157fa700 1 -- 172.21.15.149:0/3400624919 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d0c004870 con 0x7f8d1806c2a0 2023-11-08T19:27:04.440 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.426+0000 7f8d1eb35700 1 -- 172.21.15.149:0/3400624919 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d180c3b80 con 0x7f8d1806c2a0 2023-11-08T19:27:04.440 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.426+0000 7f8d157fa700 1 -- 172.21.15.149:0/3400624919 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c004c20 con 0x7f8d1806c2a0 2023-11-08T19:27:04.440 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.426+0000 7f8d1eb35700 1 -- 172.21.15.149:0/3400624919 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d180a8740 con 0x7f8d1806c2a0 2023-11-08T19:27:04.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.427+0000 7f8d1eb35700 1 -- 172.21.15.149:0/3400624919 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d180745f0 con 0x7f8d1806c2a0 2023-11-08T19:27:04.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.427+0000 7f8d157fa700 1 -- 172.21.15.149:0/3400624919 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8d0c0133c0 con 0x7f8d1806c2a0 2023-11-08T19:27:04.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.428+0000 7f8d157fa700 1 --2- 172.21.15.149:0/3400624919 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f8cfc06af00 0x7f8cfc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:04.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.428+0000 7f8d157fa700 1 -- 172.21.15.149:0/3400624919 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f8d0c0898a0 con 0x7f8d1806c2a0 2023-11-08T19:27:04.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.428+0000 7f8d17fff700 1 --2- 172.21.15.149:0/3400624919 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f8cfc06af00 0x7f8cfc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:04.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.428+0000 7f8d17fff700 1 --2- 172.21.15.149:0/3400624919 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f8cfc06af00 0x7f8cfc06d3c0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f8d1806bee0 tx=0x7f8d04009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:04.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.432+0000 7f8d157fa700 1 -- 172.21.15.149:0/3400624919 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8d0c054460 con 0x7f8d1806c2a0 2023-11-08T19:27:04.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.668+0000 7f8d1eb35700 1 -- 172.21.15.149:0/3400624919 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8d180b5d80 con 0x7f8d1806c2a0 2023-11-08T19:27:04.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.668+0000 7f8d157fa700 1 -- 172.21.15.149:0/3400624919 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4938 (secure 0 0 0) 0x7f8d0c057a80 con 0x7f8d1806c2a0 2023-11-08T19:27:04.671 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:27:04.671 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":58,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6451,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/2947079163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2947079163},{"type":"v1","addr":"172.21.15.160:6834","nonce":2947079163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49},{"gid":7122,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/589971879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":589971879},{"type":"v1","addr":"172.21.15.149:6836","nonce":589971879}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:26:58.660035+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7140,"mds_1":7125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7125":{"gid":7125,"name":"c","rank":1,"incarnation":57,"state":"up:active","state_seq":6,"addr":"172.21.15.149:6837/3917392643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3917392643},{"type":"v1","addr":"172.21.15.149:6837","nonce":3917392643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7140":{"gid":7140,"name":"b","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.160:6835/2714564224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":2714564224},{"type":"v1","addr":"172.21.15.160:6835","nonce":2714564224}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:27:04.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.671+0000 7f8d1eb35700 1 -- 172.21.15.149:0/3400624919 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f8cfc06af00 msgr2=0x7f8cfc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:04.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.671+0000 7f8d1eb35700 1 --2- 172.21.15.149:0/3400624919 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f8cfc06af00 0x7f8cfc06d3c0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f8d1806bee0 tx=0x7f8d04009040 comp rx=0 tx=0).stop 2023-11-08T19:27:04.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.671+0000 7f8d1eb35700 1 -- 172.21.15.149:0/3400624919 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d1806c2a0 msgr2=0x7f8d181f1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:04.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.671+0000 7f8d1eb35700 1 --2- 172.21.15.149:0/3400624919 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d1806c2a0 0x7f8d181f1280 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c00c6b0 tx=0x7f8d0c00c9c0 comp rx=0 tx=0).stop 2023-11-08T19:27:04.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.671+0000 7f8d1eb35700 1 -- 172.21.15.149:0/3400624919 shutdown_connections 2023-11-08T19:27:04.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.671+0000 7f8d1eb35700 1 --2- 172.21.15.149:0/3400624919 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f8cfc06af00 0x7f8cfc06d3c0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:04.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.671+0000 7f8d1eb35700 1 --2- 172.21.15.149:0/3400624919 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8d1815a1a0 0x7f8d180c6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:04.675 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.671+0000 7f8d1eb35700 1 --2- 172.21.15.149:0/3400624919 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d1806c2a0 0x7f8d181f1280 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:04.675 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.671+0000 7f8d1eb35700 1 --2- 172.21.15.149:0/3400624919 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d1806da50 0x7f8d180c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:04.675 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.671+0000 7f8d1eb35700 1 -- 172.21.15.149:0/3400624919 >> 172.21.15.149:0/3400624919 conn(0x7f8d18071720 msgr2=0x7f8d18073800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:04.675 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.671+0000 7f8d1eb35700 1 -- 172.21.15.149:0/3400624919 shutdown_connections 2023-11-08T19:27:04.675 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:04.671+0000 7f8d1eb35700 1 -- 172.21.15.149:0/3400624919 wait complete. 2023-11-08T19:27:04.676 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 58 2023-11-08T19:27:04.685 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2023-11-08T19:27:04.823 INFO:teuthology.orchestra.run.smithi149.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-11-08T19:27:04.824 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-11-08T19:27:04.825 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1', 1)] 2023-11-08T19:27:06.826 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:27:06.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:06.957+0000 7fc079813700 1 Processor -- start 2023-11-08T19:27:06.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:06.957+0000 7fc079813700 1 -- start start 2023-11-08T19:27:06.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:06.957+0000 7fc079813700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fc07415db70 0x7fc074161dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:06.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:06.957+0000 7fc079813700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc07406ab80 0x7fc07406afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:06.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:06.957+0000 7fc079813700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc074161940 con 0x7fc0740b2c00 2023-11-08T19:27:06.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:06.957+0000 7fc079813700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc07406b4f0 con 0x7fc07406ab80 2023-11-08T19:27:06.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:06.957+0000 7fc079813700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc07415e660 con 0x7fc07415db70 2023-11-08T19:27:06.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:06.958+0000 7fc0737fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc07406ab80 0x7fc07406afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:06.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:06.958+0000 7fc0727fc700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fc0740b2c00 0x7fc07415df50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:45774/0 (socket says 172.21.15.149:45774) 2023-11-08T19:27:06.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:06.958+0000 7fc0727fc700 1 -- 172.21.15.149:0/1658687941 learned_addr learned my addr 172.21.15.149:0/1658687941 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:27:06.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:06.958+0000 7fc0737fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc07406ab80 0x7fc07406afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43772/0 (socket says 172.21.15.149:43772) 2023-11-08T19:27:06.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:06.958+0000 7fc072ffd700 1 --2- 172.21.15.149:0/1658687941 >> v2:172.21.15.160:3300/0 conn(0x7fc07415db70 0x7fc074161dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:06.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:06.958+0000 7fc071ffb700 1 -- 172.21.15.149:0/1658687941 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1238949694 0 0) 0x7fc074161940 con 0x7fc0740b2c00 2023-11-08T19:27:06.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:06.958+0000 7fc071ffb700 1 -- 172.21.15.149:0/1658687941 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc05c0035b0 con 0x7fc0740b2c00 2023-11-08T19:27:06.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:06.958+0000 7fc0737fe700 1 -- 172.21.15.149:0/1658687941 >> v2:172.21.15.160:3300/0 conn(0x7fc07415db70 msgr2=0x7fc074161dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:06.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:06.958+0000 7fc0737fe700 1 --2- 172.21.15.149:0/1658687941 >> v2:172.21.15.160:3300/0 conn(0x7fc07415db70 0x7fc074161dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:06.965 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:06.958+0000 7fc0737fe700 1 -- 172.21.15.149:0/1658687941 >> v1:172.21.15.149:6789/0 conn(0x7fc0740b2c00 legacy=0x7fc07415df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:06.965 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:06.958+0000 7fc0737fe700 1 -- 172.21.15.149:0/1658687941 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc07415eeb0 con 0x7fc07406ab80 2023-11-08T19:27:06.965 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:06.958+0000 7fc0737fe700 1 --2- 172.21.15.149:0/1658687941 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc07406ab80 0x7fc07406afb0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7fc0740d15e0 tx=0x7fc06c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cba130465851b82 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:06.965 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:06.958+0000 7fc071ffb700 1 -- 172.21.15.149:0/1658687941 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06c00e070 con 0x7fc07406ab80 2023-11-08T19:27:06.965 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:06.958+0000 7fc071ffb700 1 -- 172.21.15.149:0/1658687941 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc06c00bb20 con 0x7fc07406ab80 2023-11-08T19:27:06.966 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:06.958+0000 7fc071ffb700 1 -- 172.21.15.149:0/1658687941 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06c012430 con 0x7fc07406ab80 2023-11-08T19:27:06.966 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:06.959+0000 7fc079813700 1 -- 172.21.15.149:0/1658687941 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc07406ab80 msgr2=0x7fc07406afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:06.966 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:06.959+0000 7fc079813700 1 --2- 172.21.15.149:0/1658687941 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc07406ab80 0x7fc07406afb0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7fc0740d15e0 tx=0x7fc06c00b330 comp rx=0 tx=0).stop 2023-11-08T19:27:06.966 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:06.959+0000 7fc079813700 1 -- 172.21.15.149:0/1658687941 shutdown_connections 2023-11-08T19:27:06.966 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:06.959+0000 7fc079813700 1 --2- 172.21.15.149:0/1658687941 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc07406ab80 0x7fc07406afb0 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:06.967 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:06.959+0000 7fc079813700 1 --2- 172.21.15.149:0/1658687941 >> v2:172.21.15.160:3300/0 conn(0x7fc07415db70 0x7fc074161dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:06.967 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:06.959+0000 7fc079813700 1 -- 172.21.15.149:0/1658687941 >> 172.21.15.149:0/1658687941 conn(0x7fc0740ccff0 msgr2=0x7fc0740cd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:06.967 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:06.959+0000 7fc079813700 1 -- 172.21.15.149:0/1658687941 shutdown_connections 2023-11-08T19:27:06.967 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:06.959+0000 7fc079813700 1 -- 172.21.15.149:0/1658687941 wait complete. 2023-11-08T19:27:06.970 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:06.960+0000 7fc079813700 1 Processor -- start 2023-11-08T19:27:06.970 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:06.960+0000 7fc079813700 1 -- start start 2023-11-08T19:27:06.970 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:06.961+0000 7fc079813700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc07406ab80 0x7fc07414f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:06.971 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:06.961+0000 7fc079813700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc0740b2c00 0x7fc0740b2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:06.971 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:06.961+0000 7fc079813700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc07415db70 0x7fc0740c61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:06.971 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:06.961+0000 7fc079813700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0740ad6a0 con 0x7fc07415db70 2023-11-08T19:27:06.971 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:06.961+0000 7fc079813700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0740aca60 con 0x7fc07406ab80 2023-11-08T19:27:06.971 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:06.961+0000 7fc079813700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0740acd00 con 0x7fc0740b2c00 2023-11-08T19:27:06.972 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:06.961+0000 7fc0737fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc07415db70 0x7fc0740c61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:06.972 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:06.961+0000 7fc0737fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc07415db70 0x7fc0740c61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43780/0 (socket says 172.21.15.149:43780) 2023-11-08T19:27:06.972 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:06.961+0000 7fc0737fe700 1 -- 172.21.15.149:0/1125857052 learned_addr learned my addr 172.21.15.149:0/1125857052 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:27:06.972 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:06.961+0000 7fc0727fc700 1 --2- 172.21.15.149:0/1125857052 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc0740b2c00 0x7fc0740b2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:06.972 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:06.961+0000 7fc072ffd700 1 --2- 172.21.15.149:0/1125857052 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc07406ab80 0x7fc07414f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:06.973 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:06.961+0000 7fc0737fe700 1 -- 172.21.15.149:0/1125857052 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc0740b2c00 msgr2=0x7fc0740b2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:06.973 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:06.961+0000 7fc0737fe700 1 --2- 172.21.15.149:0/1125857052 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc0740b2c00 0x7fc0740b2280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:06.973 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:06.961+0000 7fc0737fe700 1 -- 172.21.15.149:0/1125857052 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc07406ab80 msgr2=0x7fc07414f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:06.973 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:06.961+0000 7fc0737fe700 1 --2- 172.21.15.149:0/1125857052 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc07406ab80 0x7fc07414f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:06.973 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:06.961+0000 7fc0737fe700 1 -- 172.21.15.149:0/1125857052 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc06c009a70 con 0x7fc07415db70 2023-11-08T19:27:06.974 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:06.961+0000 7fc072ffd700 1 --2- 172.21.15.149:0/1125857052 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc07406ab80 0x7fc07414f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:27:06.974 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:06.962+0000 7fc0737fe700 1 --2- 172.21.15.149:0/1125857052 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc07415db70 0x7fc0740c61e0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fc06c014040 tx=0x7fc06c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:06.974 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:06.962+0000 7fc05bfff700 1 -- 172.21.15.149:0/1125857052 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06c012430 con 0x7fc07415db70 2023-11-08T19:27:06.974 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:06.962+0000 7fc05bfff700 1 -- 172.21.15.149:0/1125857052 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc06c020070 con 0x7fc07415db70 2023-11-08T19:27:06.975 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:06.962+0000 7fc079813700 1 -- 172.21.15.149:0/1125857052 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0740acfe0 con 0x7fc07415db70 2023-11-08T19:27:06.975 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:06.962+0000 7fc05bfff700 1 -- 172.21.15.149:0/1125857052 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06c004280 con 0x7fc07415db70 2023-11-08T19:27:06.975 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:06.962+0000 7fc079813700 1 -- 172.21.15.149:0/1125857052 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc07414fed0 con 0x7fc07415db70 2023-11-08T19:27:06.975 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:06.963+0000 7fc079813700 1 -- 172.21.15.149:0/1125857052 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0740745f0 con 0x7fc07415db70 2023-11-08T19:27:06.975 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:06.963+0000 7fc05bfff700 1 -- 172.21.15.149:0/1125857052 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc06c0043e0 con 0x7fc07415db70 2023-11-08T19:27:06.976 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:06.964+0000 7fc05bfff700 1 --2- 172.21.15.149:0/1125857052 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc06006af00 0x7fc06006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:06.976 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:06.964+0000 7fc072ffd700 1 --2- 172.21.15.149:0/1125857052 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc06006af00 0x7fc06006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:06.976 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:06.964+0000 7fc05bfff700 1 -- 172.21.15.149:0/1125857052 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7fc06c022070 con 0x7fc07415db70 2023-11-08T19:27:06.976 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:06.964+0000 7fc072ffd700 1 --2- 172.21.15.149:0/1125857052 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc06006af00 0x7fc06006d3c0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fc064007a50 tx=0x7fc064008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:06.977 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:06.969+0000 7fc05bfff700 1 -- 172.21.15.149:0/1125857052 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc06c056670 con 0x7fc07415db70 2023-11-08T19:27:07.204 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:07.202+0000 7fc079813700 1 -- 172.21.15.149:0/1125857052 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc074073200 con 0x7fc07415db70 2023-11-08T19:27:07.205 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:07.202+0000 7fc05bfff700 1 -- 172.21.15.149:0/1125857052 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4938 (secure 0 0 0) 0x7fc06c01ae60 con 0x7fc07415db70 2023-11-08T19:27:07.205 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:27:07.205 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":58,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6451,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/2947079163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2947079163},{"type":"v1","addr":"172.21.15.160:6834","nonce":2947079163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49},{"gid":7122,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/589971879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":589971879},{"type":"v1","addr":"172.21.15.149:6836","nonce":589971879}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:26:58.660035+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7140,"mds_1":7125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7125":{"gid":7125,"name":"c","rank":1,"incarnation":57,"state":"up:active","state_seq":6,"addr":"172.21.15.149:6837/3917392643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3917392643},{"type":"v1","addr":"172.21.15.149:6837","nonce":3917392643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7140":{"gid":7140,"name":"b","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.160:6835/2714564224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":2714564224},{"type":"v1","addr":"172.21.15.160:6835","nonce":2714564224}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:27:07.207 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:07.204+0000 7fc079813700 1 -- 172.21.15.149:0/1125857052 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc06006af00 msgr2=0x7fc06006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:07.207 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:07.205+0000 7fc079813700 1 --2- 172.21.15.149:0/1125857052 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc06006af00 0x7fc06006d3c0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fc064007a50 tx=0x7fc064008040 comp rx=0 tx=0).stop 2023-11-08T19:27:07.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:07.205+0000 7fc079813700 1 -- 172.21.15.149:0/1125857052 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc07415db70 msgr2=0x7fc0740c61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:07.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:07.205+0000 7fc079813700 1 --2- 172.21.15.149:0/1125857052 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc07415db70 0x7fc0740c61e0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fc06c014040 tx=0x7fc06c004ad0 comp rx=0 tx=0).stop 2023-11-08T19:27:07.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:07.205+0000 7fc079813700 1 -- 172.21.15.149:0/1125857052 shutdown_connections 2023-11-08T19:27:07.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:07.205+0000 7fc079813700 1 --2- 172.21.15.149:0/1125857052 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc06006af00 0x7fc06006d3c0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:07.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:07.205+0000 7fc079813700 1 --2- 172.21.15.149:0/1125857052 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc07406ab80 0x7fc07414f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:07.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:07.205+0000 7fc079813700 1 --2- 172.21.15.149:0/1125857052 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc07415db70 0x7fc0740c61e0 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:07.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:07.205+0000 7fc079813700 1 --2- 172.21.15.149:0/1125857052 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc0740b2c00 0x7fc0740b2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:07.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:07.205+0000 7fc079813700 1 -- 172.21.15.149:0/1125857052 >> 172.21.15.149:0/1125857052 conn(0x7fc0740ccff0 msgr2=0x7fc0740b51a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:07.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:07.205+0000 7fc079813700 1 -- 172.21.15.149:0/1125857052 shutdown_connections 2023-11-08T19:27:07.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:07.205+0000 7fc079813700 1 -- 172.21.15.149:0/1125857052 wait complete. 2023-11-08T19:27:07.210 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 58 2023-11-08T19:27:07.219 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2023-11-08T19:27:07.370 INFO:teuthology.orchestra.run.smithi149.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-11-08T19:27:07.370 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-11-08T19:27:07.371 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1', 1)] 2023-11-08T19:27:08.278 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T19:27:08.283 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T19:27:09.372 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:27:09.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.505+0000 7f6f4944b700 1 Processor -- start 2023-11-08T19:27:09.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.505+0000 7f6f4944b700 1 -- start start 2023-11-08T19:27:09.511 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.506+0000 7f6f4944b700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6f4415b950 0x7f6f440ce130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:09.511 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.506+0000 7f6f4944b700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6f440cd5e0 0x7f6f440ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:09.511 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.506+0000 7f6f4944b700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f6f440cfd20 0x7f6f440d01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:09.511 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.506+0000 7f6f4944b700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f440cc2e0 con 0x7f6f4415b950 2023-11-08T19:27:09.511 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.506+0000 7f6f4944b700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f440cc580 con 0x7f6f440cfd20 2023-11-08T19:27:09.512 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.506+0000 7f6f4944b700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f440cc820 con 0x7f6f440cd5e0 2023-11-08T19:27:09.512 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.506+0000 7f6f42ffd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6f4415b950 0x7f6f440ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:09.512 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.506+0000 7f6f42ffd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6f4415b950 0x7f6f440ce130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43786/0 (socket says 172.21.15.149:43786) 2023-11-08T19:27:09.512 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.506+0000 7f6f42ffd700 1 -- 172.21.15.149:0/2729510188 learned_addr learned my addr 172.21.15.149:0/2729510188 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:27:09.513 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.507+0000 7f6f437fe700 1 --2- 172.21.15.149:0/2729510188 >> v2:172.21.15.160:3300/0 conn(0x7f6f440cfd20 0x7f6f440d01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:09.513 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.507+0000 7f6f427fc700 1 --2- 172.21.15.149:0/2729510188 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6f440cd5e0 0x7f6f440ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:09.513 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.507+0000 7f6f42ffd700 1 -- 172.21.15.149:0/2729510188 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6f440cd5e0 msgr2=0x7f6f440ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:09.513 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.507+0000 7f6f42ffd700 1 --2- 172.21.15.149:0/2729510188 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6f440cd5e0 0x7f6f440ce670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:09.514 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.507+0000 7f6f42ffd700 1 -- 172.21.15.149:0/2729510188 >> v2:172.21.15.160:3300/0 conn(0x7f6f440cfd20 msgr2=0x7f6f440d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:09.514 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.507+0000 7f6f42ffd700 1 --2- 172.21.15.149:0/2729510188 >> v2:172.21.15.160:3300/0 conn(0x7f6f440cfd20 0x7f6f440d01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:09.514 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.507+0000 7f6f42ffd700 1 -- 172.21.15.149:0/2729510188 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f440ccb00 con 0x7f6f4415b950 2023-11-08T19:27:09.514 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.507+0000 7f6f42ffd700 1 --2- 172.21.15.149:0/2729510188 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f4415b950 0x7f6f440ce130 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f6f4408bf60 tx=0x7f6f2c009bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e786d97c6e49531d server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:09.514 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.507+0000 7f6f41ffb700 1 -- 172.21.15.149:0/2729510188 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2c00b8a0 con 0x7f6f4415b950 2023-11-08T19:27:09.515 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.507+0000 7f6f41ffb700 1 -- 172.21.15.149:0/2729510188 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f2c00ba00 con 0x7f6f4415b950 2023-11-08T19:27:09.515 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.507+0000 7f6f41ffb700 1 -- 172.21.15.149:0/2729510188 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2c00bdb0 con 0x7f6f4415b950 2023-11-08T19:27:09.515 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.508+0000 7f6f4944b700 1 -- 172.21.15.149:0/2729510188 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f4415b950 msgr2=0x7f6f440ce130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:09.515 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.508+0000 7f6f4944b700 1 --2- 172.21.15.149:0/2729510188 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f4415b950 0x7f6f440ce130 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f6f4408bf60 tx=0x7f6f2c009bc0 comp rx=0 tx=0).stop 2023-11-08T19:27:09.515 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.508+0000 7f6f4944b700 1 -- 172.21.15.149:0/2729510188 shutdown_connections 2023-11-08T19:27:09.516 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.508+0000 7f6f4944b700 1 --2- 172.21.15.149:0/2729510188 >> v2:172.21.15.160:3300/0 conn(0x7f6f440cfd20 0x7f6f440d01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:09.516 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.508+0000 7f6f4944b700 1 --2- 172.21.15.149:0/2729510188 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f4415b950 0x7f6f440ce130 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:09.516 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.508+0000 7f6f4944b700 1 --2- 172.21.15.149:0/2729510188 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6f440cd5e0 0x7f6f440ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:09.516 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.508+0000 7f6f4944b700 1 -- 172.21.15.149:0/2729510188 >> 172.21.15.149:0/2729510188 conn(0x7f6f4408afd0 msgr2=0x7f6f440d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:09.516 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.508+0000 7f6f4944b700 1 -- 172.21.15.149:0/2729510188 shutdown_connections 2023-11-08T19:27:09.517 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.508+0000 7f6f4944b700 1 -- 172.21.15.149:0/2729510188 wait complete. 2023-11-08T19:27:09.519 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.509+0000 7f6f4944b700 1 Processor -- start 2023-11-08T19:27:09.520 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.509+0000 7f6f4944b700 1 -- start start 2023-11-08T19:27:09.520 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.510+0000 7f6f4944b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6f440cfd20 0x7f6f4414c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:09.520 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.510+0000 7f6f4944b700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6f4415b950 0x7f6f440b53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:09.520 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.510+0000 7f6f4944b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f44159ce0 0x7f6f4414cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:09.520 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.510+0000 7f6f4944b700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f440b6480 con 0x7f6f44159ce0 2023-11-08T19:27:09.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.510+0000 7f6f4944b700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f440c7380 con 0x7f6f440cfd20 2023-11-08T19:27:09.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.510+0000 7f6f4944b700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f440b5be0 con 0x7f6f4415b950 2023-11-08T19:27:09.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.510+0000 7f6f437fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f44159ce0 0x7f6f4414cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:09.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.510+0000 7f6f437fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f44159ce0 0x7f6f4414cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43792/0 (socket says 172.21.15.149:43792) 2023-11-08T19:27:09.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.510+0000 7f6f437fe700 1 -- 172.21.15.149:0/3183241858 learned_addr learned my addr 172.21.15.149:0/3183241858 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:27:09.522 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.510+0000 7f6f427fc700 1 --2- 172.21.15.149:0/3183241858 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6f4415b950 0x7f6f440b53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:09.522 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.510+0000 7f6f42ffd700 1 --2- 172.21.15.149:0/3183241858 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6f440cfd20 0x7f6f4414c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:09.522 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.510+0000 7f6f437fe700 1 -- 172.21.15.149:0/3183241858 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6f4415b950 msgr2=0x7f6f440b53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:09.522 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.510+0000 7f6f437fe700 1 --2- 172.21.15.149:0/3183241858 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6f4415b950 0x7f6f440b53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:09.522 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.510+0000 7f6f437fe700 1 -- 172.21.15.149:0/3183241858 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6f440cfd20 msgr2=0x7f6f4414c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:09.523 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.510+0000 7f6f437fe700 1 --2- 172.21.15.149:0/3183241858 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6f440cfd20 0x7f6f4414c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:09.523 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.510+0000 7f6f437fe700 1 -- 172.21.15.149:0/3183241858 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f2c0094f0 con 0x7f6f44159ce0 2023-11-08T19:27:09.523 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.511+0000 7f6f437fe700 1 --2- 172.21.15.149:0/3183241858 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f44159ce0 0x7f6f4414cc40 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c007e40 tx=0x7f6f3c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:09.523 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.511+0000 7f6f3b7fe700 1 -- 172.21.15.149:0/3183241858 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3c00ed30 con 0x7f6f44159ce0 2023-11-08T19:27:09.524 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.511+0000 7f6f3b7fe700 1 -- 172.21.15.149:0/3183241858 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f3c014420 con 0x7f6f44159ce0 2023-11-08T19:27:09.524 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.511+0000 7f6f4944b700 1 -- 172.21.15.149:0/3183241858 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f440b5ec0 con 0x7f6f44159ce0 2023-11-08T19:27:09.524 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.511+0000 7f6f3b7fe700 1 -- 172.21.15.149:0/3183241858 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3c0147d0 con 0x7f6f44159ce0 2023-11-08T19:27:09.524 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.511+0000 7f6f4944b700 1 -- 172.21.15.149:0/3183241858 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f440c7620 con 0x7f6f44159ce0 2023-11-08T19:27:09.524 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.512+0000 7f6f4944b700 1 -- 172.21.15.149:0/3183241858 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f440745f0 con 0x7f6f44159ce0 2023-11-08T19:27:09.525 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.512+0000 7f6f3b7fe700 1 -- 172.21.15.149:0/3183241858 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6f3c014930 con 0x7f6f44159ce0 2023-11-08T19:27:09.525 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.513+0000 7f6f3b7fe700 1 --2- 172.21.15.149:0/3183241858 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6f2406af30 0x7f6f2406d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:09.525 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.513+0000 7f6f42ffd700 1 --2- 172.21.15.149:0/3183241858 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6f2406af30 0x7f6f2406d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:09.525 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.513+0000 7f6f3b7fe700 1 -- 172.21.15.149:0/3183241858 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f6f3c08a1f0 con 0x7f6f44159ce0 2023-11-08T19:27:09.525 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.513+0000 7f6f42ffd700 1 --2- 172.21.15.149:0/3183241858 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6f2406af30 0x7f6f2406d3f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c009c00 tx=0x7f6f2c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:09.526 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.518+0000 7f6f3b7fe700 1 -- 172.21.15.149:0/3183241858 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6f3c054c90 con 0x7f6f44159ce0 2023-11-08T19:27:09.752 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.750+0000 7f6f4944b700 1 -- 172.21.15.149:0/3183241858 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6f440b02b0 con 0x7f6f44159ce0 2023-11-08T19:27:09.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.750+0000 7f6f3b7fe700 1 -- 172.21.15.149:0/3183241858 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+4939 (secure 0 0 0) 0x7f6f3c0582b0 con 0x7f6f44159ce0 2023-11-08T19:27:09.753 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:27:09.753 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":59,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6451,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/2947079163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2947079163},{"type":"v1","addr":"172.21.15.160:6834","nonce":2947079163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49},{"gid":7122,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/589971879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":589971879},{"type":"v1","addr":"172.21.15.149:6836","nonce":589971879}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:27:07.663218+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7140,"mds_1":7125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7125":{"gid":7125,"name":"c","rank":1,"incarnation":57,"state":"up:active","state_seq":6,"addr":"172.21.15.149:6837/3917392643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3917392643},{"type":"v1","addr":"172.21.15.149:6837","nonce":3917392643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7140":{"gid":7140,"name":"b","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.160:6835/2714564224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":2714564224},{"type":"v1","addr":"172.21.15.160:6835","nonce":2714564224}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:27:09.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.753+0000 7f6f4944b700 1 -- 172.21.15.149:0/3183241858 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6f2406af30 msgr2=0x7f6f2406d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:09.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.753+0000 7f6f4944b700 1 --2- 172.21.15.149:0/3183241858 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6f2406af30 0x7f6f2406d3f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c009c00 tx=0x7f6f2c008030 comp rx=0 tx=0).stop 2023-11-08T19:27:09.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.753+0000 7f6f4944b700 1 -- 172.21.15.149:0/3183241858 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f44159ce0 msgr2=0x7f6f4414cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:09.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.753+0000 7f6f4944b700 1 --2- 172.21.15.149:0/3183241858 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f44159ce0 0x7f6f4414cc40 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c007e40 tx=0x7f6f3c00e3c0 comp rx=0 tx=0).stop 2023-11-08T19:27:09.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.753+0000 7f6f4944b700 1 -- 172.21.15.149:0/3183241858 shutdown_connections 2023-11-08T19:27:09.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.753+0000 7f6f4944b700 1 --2- 172.21.15.149:0/3183241858 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6f2406af30 0x7f6f2406d3f0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:09.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.753+0000 7f6f4944b700 1 --2- 172.21.15.149:0/3183241858 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6f440cfd20 0x7f6f4414c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:09.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.753+0000 7f6f4944b700 1 --2- 172.21.15.149:0/3183241858 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f44159ce0 0x7f6f4414cc40 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:09.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.753+0000 7f6f4944b700 1 --2- 172.21.15.149:0/3183241858 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6f4415b950 0x7f6f440b53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:09.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.753+0000 7f6f4944b700 1 -- 172.21.15.149:0/3183241858 >> 172.21.15.149:0/3183241858 conn(0x7f6f4408afd0 msgr2=0x7f6f440b2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:09.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.753+0000 7f6f4944b700 1 -- 172.21.15.149:0/3183241858 shutdown_connections 2023-11-08T19:27:09.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:09.753+0000 7f6f4944b700 1 -- 172.21.15.149:0/3183241858 wait complete. 2023-11-08T19:27:09.758 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 59 2023-11-08T19:27:09.767 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2023-11-08T19:27:09.906 INFO:teuthology.orchestra.run.smithi149.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"8","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1","dirfrag":"0x10000000000","snapid_first":2,"projected_version":"3","version":"3","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2023-11-08T19:27:09.907 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "8" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000000", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "3", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "3" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-11-08T19:27:09.907 INFO:tasks.cephfs.cephfs_test_case:[('/d1', 1)] =?= [('/d1', 1)] 2023-11-08T19:27:09.908 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json dump snaps --server 2023-11-08T19:27:10.058 INFO:teuthology.orchestra.run.smithi160.stdout:{"last_snap":1,"last_created":1,"last_destroyed":1,"pending_noop":[],"snaps":[],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-08T19:27:10.059 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 1, "last_destroyed": 1, "last_snap": 1, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [] } 2023-11-08T19:27:10.059 INFO:tasks.cephfs.test_snapshots:testing snapserver mds_kill_mdstable_at=1 2023-11-08T19:27:10.060 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:27:10.184 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.182+0000 7f16692af700 1 Processor -- start 2023-11-08T19:27:10.184 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.182+0000 7f16692af700 1 -- start start 2023-11-08T19:27:10.187 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.182+0000 7f16692af700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f166406bb90 0x7f166406bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:10.187 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.182+0000 7f16692af700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f166406eb00 0x7f166406ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:10.187 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.183+0000 7f16692af700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16640cea30 con 0x7f16640cc0a0 2023-11-08T19:27:10.187 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.183+0000 7f16692af700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f166406e670 con 0x7f166406eb00 2023-11-08T19:27:10.188 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.183+0000 7f16692af700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f166406c4b0 con 0x7f166406bb90 2023-11-08T19:27:10.188 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.183+0000 7f16637fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f166406eb00 0x7f166406ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:10.188 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.183+0000 7f16627fc700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f16640cc0a0 0x7f16640ce320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:45804/0 (socket says 172.21.15.149:45804) 2023-11-08T19:27:10.188 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.183+0000 7f16627fc700 1 -- 172.21.15.149:0/2723212993 learned_addr learned my addr 172.21.15.149:0/2723212993 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:27:10.188 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.183+0000 7f1662ffd700 1 --2- 172.21.15.149:0/2723212993 >> v2:172.21.15.160:3300/0 conn(0x7f166406bb90 0x7f166406bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:10.189 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.183+0000 7f1661ffb700 1 -- 172.21.15.149:0/2723212993 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3596995701 0 0) 0x7f1658001110 con 0x7f16640cc0a0 2023-11-08T19:27:10.189 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.183+0000 7f1661ffb700 1 -- 172.21.15.149:0/2723212993 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f164c0035b0 con 0x7f16640cc0a0 2023-11-08T19:27:10.189 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.183+0000 7f16637fe700 1 -- 172.21.15.149:0/2723212993 >> v2:172.21.15.160:3300/0 conn(0x7f166406bb90 msgr2=0x7f166406bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:10.189 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.183+0000 7f16637fe700 1 --2- 172.21.15.149:0/2723212993 >> v2:172.21.15.160:3300/0 conn(0x7f166406bb90 0x7f166406bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:10.189 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.183+0000 7f16637fe700 1 -- 172.21.15.149:0/2723212993 >> v1:172.21.15.149:6789/0 conn(0x7f16640cc0a0 legacy=0x7f16640ce320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:10.190 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.183+0000 7f16637fe700 1 -- 172.21.15.149:0/2723212993 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16640cec70 con 0x7f166406eb00 2023-11-08T19:27:10.190 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.183+0000 7f16637fe700 1 --2- 172.21.15.149:0/2723212993 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f166406eb00 0x7f166406ef70 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f1664066c90 tx=0x7f165c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fcac62c9407c947 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:10.190 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.183+0000 7f1661ffb700 1 -- 172.21.15.149:0/2723212993 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f165c00e070 con 0x7f166406eb00 2023-11-08T19:27:10.190 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.183+0000 7f1661ffb700 1 -- 172.21.15.149:0/2723212993 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f165c00bb20 con 0x7f166406eb00 2023-11-08T19:27:10.190 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.183+0000 7f1661ffb700 1 -- 172.21.15.149:0/2723212993 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f165c012430 con 0x7f166406eb00 2023-11-08T19:27:10.191 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.184+0000 7f16692af700 1 -- 172.21.15.149:0/2723212993 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f166406eb00 msgr2=0x7f166406ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:10.191 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.184+0000 7f16692af700 1 --2- 172.21.15.149:0/2723212993 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f166406eb00 0x7f166406ef70 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f1664066c90 tx=0x7f165c00b330 comp rx=0 tx=0).stop 2023-11-08T19:27:10.191 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.184+0000 7f16692af700 1 -- 172.21.15.149:0/2723212993 shutdown_connections 2023-11-08T19:27:10.192 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.184+0000 7f16692af700 1 --2- 172.21.15.149:0/2723212993 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f166406eb00 0x7f166406ef70 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:10.192 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.184+0000 7f16692af700 1 --2- 172.21.15.149:0/2723212993 >> v2:172.21.15.160:3300/0 conn(0x7f166406bb90 0x7f166406bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:10.192 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.184+0000 7f16692af700 1 -- 172.21.15.149:0/2723212993 >> 172.21.15.149:0/2723212993 conn(0x7f1664071670 msgr2=0x7f1664071a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:10.192 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.184+0000 7f16692af700 1 -- 172.21.15.149:0/2723212993 shutdown_connections 2023-11-08T19:27:10.192 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.184+0000 7f16692af700 1 -- 172.21.15.149:0/2723212993 wait complete. 2023-11-08T19:27:10.195 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.186+0000 7f16692af700 1 Processor -- start 2023-11-08T19:27:10.195 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.186+0000 7f16692af700 1 -- start start 2023-11-08T19:27:10.195 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.187+0000 7f16692af700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f166406bb90 0x7f1664156dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:10.196 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.187+0000 7f16692af700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f166406eb00 0x7f166415a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:10.196 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.187+0000 7f16692af700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f16640cc0a0 0x7f16640c7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:10.196 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.187+0000 7f16692af700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16641f7f40 con 0x7f166406eb00 2023-11-08T19:27:10.196 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.187+0000 7f16692af700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16641578b0 con 0x7f166406bb90 2023-11-08T19:27:10.196 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.187+0000 7f16692af700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16641f7050 con 0x7f16640cc0a0 2023-11-08T19:27:10.197 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.187+0000 7f16627fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f166406eb00 0x7f166415a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:10.197 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.187+0000 7f16627fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f166406eb00 0x7f166415a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43808/0 (socket says 172.21.15.149:43808) 2023-11-08T19:27:10.197 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.187+0000 7f16627fc700 1 -- 172.21.15.149:0/1390250711 learned_addr learned my addr 172.21.15.149:0/1390250711 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:27:10.197 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.187+0000 7f1662ffd700 1 --2- 172.21.15.149:0/1390250711 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f166406bb90 0x7f1664156dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:10.197 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.187+0000 7f16637fe700 1 --2- 172.21.15.149:0/1390250711 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f16640cc0a0 0x7f16640c7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:10.198 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.187+0000 7f16627fc700 1 -- 172.21.15.149:0/1390250711 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f16640cc0a0 msgr2=0x7f16640c7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:10.198 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.187+0000 7f16627fc700 1 --2- 172.21.15.149:0/1390250711 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f16640cc0a0 0x7f16640c7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:10.198 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.187+0000 7f16627fc700 1 -- 172.21.15.149:0/1390250711 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f166406bb90 msgr2=0x7f1664156dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:10.198 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.187+0000 7f16627fc700 1 --2- 172.21.15.149:0/1390250711 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f166406bb90 0x7f1664156dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:10.198 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.187+0000 7f16627fc700 1 -- 172.21.15.149:0/1390250711 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f165c009a70 con 0x7f166406eb00 2023-11-08T19:27:10.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.187+0000 7f16637fe700 1 --2- 172.21.15.149:0/1390250711 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f16640cc0a0 0x7f16640c7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:27:10.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.187+0000 7f1662ffd700 1 --2- 172.21.15.149:0/1390250711 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f166406bb90 0x7f1664156dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:27:10.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.187+0000 7f16627fc700 1 --2- 172.21.15.149:0/1390250711 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f166406eb00 0x7f166415a970 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f165800c530 tx=0x7f165800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:10.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.187+0000 7f164b7fe700 1 -- 172.21.15.149:0/1390250711 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1658005d70 con 0x7f166406eb00 2023-11-08T19:27:10.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.187+0000 7f164b7fe700 1 -- 172.21.15.149:0/1390250711 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16580070d0 con 0x7f166406eb00 2023-11-08T19:27:10.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.187+0000 7f16692af700 1 -- 172.21.15.149:0/1390250711 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16641f7330 con 0x7f166406eb00 2023-11-08T19:27:10.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.187+0000 7f164b7fe700 1 -- 172.21.15.149:0/1390250711 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1658007460 con 0x7f166406eb00 2023-11-08T19:27:10.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.187+0000 7f16692af700 1 -- 172.21.15.149:0/1390250711 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16641f78f0 con 0x7f166406eb00 2023-11-08T19:27:10.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.188+0000 7f16692af700 1 -- 172.21.15.149:0/1390250711 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16640745f0 con 0x7f166406eb00 2023-11-08T19:27:10.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.189+0000 7f164b7fe700 1 -- 172.21.15.149:0/1390250711 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f16580075c0 con 0x7f166406eb00 2023-11-08T19:27:10.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.189+0000 7f164b7fe700 1 --2- 172.21.15.149:0/1390250711 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f165006af00 0x7f165006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:10.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.189+0000 7f164b7fe700 1 -- 172.21.15.149:0/1390250711 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f1658088f20 con 0x7f166406eb00 2023-11-08T19:27:10.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.189+0000 7f1662ffd700 1 --2- 172.21.15.149:0/1390250711 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f165006af00 0x7f165006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:10.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.190+0000 7f1662ffd700 1 --2- 172.21.15.149:0/1390250711 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f165006af00 0x7f165006d3c0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f1654009b60 tx=0x7f1654008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:10.202 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.194+0000 7f164b7fe700 1 -- 172.21.15.149:0/1390250711 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f16580539d0 con 0x7f166406eb00 2023-11-08T19:27:10.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.427+0000 7f16692af700 1 -- 172.21.15.149:0/1390250711 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f16640cea30 con 0x7f166406eb00 2023-11-08T19:27:10.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.427+0000 7f164b7fe700 1 -- 172.21.15.149:0/1390250711 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+4939 (secure 0 0 0) 0x7f16640cea30 con 0x7f166406eb00 2023-11-08T19:27:10.430 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:27:10.430 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":59,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6451,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/2947079163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2947079163},{"type":"v1","addr":"172.21.15.160:6834","nonce":2947079163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49},{"gid":7122,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/589971879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":589971879},{"type":"v1","addr":"172.21.15.149:6836","nonce":589971879}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:27:07.663218+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7140,"mds_1":7125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7125":{"gid":7125,"name":"c","rank":1,"incarnation":57,"state":"up:active","state_seq":6,"addr":"172.21.15.149:6837/3917392643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3917392643},{"type":"v1","addr":"172.21.15.149:6837","nonce":3917392643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7140":{"gid":7140,"name":"b","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.160:6835/2714564224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":2714564224},{"type":"v1","addr":"172.21.15.160:6835","nonce":2714564224}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:27:10.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.429+0000 7f16692af700 1 -- 172.21.15.149:0/1390250711 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f165006af00 msgr2=0x7f165006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:10.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.429+0000 7f16692af700 1 --2- 172.21.15.149:0/1390250711 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f165006af00 0x7f165006d3c0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f1654009b60 tx=0x7f1654008040 comp rx=0 tx=0).stop 2023-11-08T19:27:10.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.429+0000 7f16692af700 1 -- 172.21.15.149:0/1390250711 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f166406eb00 msgr2=0x7f166415a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:10.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.429+0000 7f16692af700 1 --2- 172.21.15.149:0/1390250711 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f166406eb00 0x7f166415a970 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f165800c530 tx=0x7f165800c8f0 comp rx=0 tx=0).stop 2023-11-08T19:27:10.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.429+0000 7f16692af700 1 -- 172.21.15.149:0/1390250711 shutdown_connections 2023-11-08T19:27:10.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.429+0000 7f16692af700 1 --2- 172.21.15.149:0/1390250711 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f165006af00 0x7f165006d3c0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:10.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.429+0000 7f16692af700 1 --2- 172.21.15.149:0/1390250711 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f166406bb90 0x7f1664156dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:10.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.429+0000 7f16692af700 1 --2- 172.21.15.149:0/1390250711 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f16640cc0a0 0x7f16640c7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:10.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.429+0000 7f16692af700 1 --2- 172.21.15.149:0/1390250711 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f166406eb00 0x7f166415a970 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:10.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.429+0000 7f16692af700 1 -- 172.21.15.149:0/1390250711 >> 172.21.15.149:0/1390250711 conn(0x7f1664071670 msgr2=0x7f16640af7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:10.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.429+0000 7f16692af700 1 -- 172.21.15.149:0/1390250711 shutdown_connections 2023-11-08T19:27:10.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.429+0000 7f16692af700 1 -- 172.21.15.149:0/1390250711 wait complete. 2023-11-08T19:27:10.435 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 59 2023-11-08T19:27:10.444 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:0 true 2023-11-08T19:27:10.567 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.565+0000 7fea894b8700 1 Processor -- start 2023-11-08T19:27:10.567 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.565+0000 7fea894b8700 1 -- start start 2023-11-08T19:27:10.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.566+0000 7fea894b8700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fea840ce720 0x7fea840cf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:10.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.566+0000 7fea894b8700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea84157e90 con 0x7fea840cf920 2023-11-08T19:27:10.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.566+0000 7fea894b8700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea8415a5b0 con 0x7fea84157ab0 2023-11-08T19:27:10.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.566+0000 7fea894b8700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea8415b230 con 0x7fea840ce720 2023-11-08T19:27:10.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.566+0000 7fea827fc700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fea840ce720 0x7fea840cf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:10.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.566+0000 7fea837fe700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fea840cf920 0x7fea8415da90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:45820/0 (socket says 172.21.15.149:45820) 2023-11-08T19:27:10.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.566+0000 7fea837fe700 1 -- 172.21.15.149:0/3519203267 learned_addr learned my addr 172.21.15.149:0/3519203267 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:27:10.573 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.566+0000 7fea827fc700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fea840ce720 0x7fea840cf3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43816/0 (socket says 172.21.15.149:43816) 2023-11-08T19:27:10.573 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.566+0000 7fea827fc700 1 -- 172.21.15.149:0/3519203267 >> v1:172.21.15.160:6789/0 conn(0x7fea84157ab0 legacy=0x7fea840ae9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:10.573 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.566+0000 7fea827fc700 1 -- 172.21.15.149:0/3519203267 >> v1:172.21.15.149:6789/0 conn(0x7fea840cf920 legacy=0x7fea8415da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:10.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.566+0000 7fea827fc700 1 -- 172.21.15.149:0/3519203267 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea8415a890 con 0x7fea840ce720 2023-11-08T19:27:10.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.566+0000 7fea81ffb700 1 -- 172.21.15.149:0/3519203267 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 709045862 0 0) 0x7fea84157e90 con 0x7fea840cf920 2023-11-08T19:27:10.575 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.566+0000 7fea827fc700 1 --2- 172.21.15.149:0/3519203267 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea840ce720 0x7fea840cf3e0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fea78009840 tx=0x7fea78009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=131da75e3337d06e server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:10.575 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.567+0000 7fea81ffb700 1 -- 172.21.15.149:0/3519203267 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea78011830 con 0x7fea840ce720 2023-11-08T19:27:10.575 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.567+0000 7fea81ffb700 1 -- 172.21.15.149:0/3519203267 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea78011990 con 0x7fea840ce720 2023-11-08T19:27:10.576 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.567+0000 7fea81ffb700 1 -- 172.21.15.149:0/3519203267 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea78011d20 con 0x7fea840ce720 2023-11-08T19:27:10.576 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.567+0000 7fea894b8700 1 -- 172.21.15.149:0/3519203267 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea840ce720 msgr2=0x7fea840cf3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:10.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.567+0000 7fea894b8700 1 --2- 172.21.15.149:0/3519203267 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea840ce720 0x7fea840cf3e0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fea78009840 tx=0x7fea78009b50 comp rx=0 tx=0).stop 2023-11-08T19:27:10.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.567+0000 7fea894b8700 1 -- 172.21.15.149:0/3519203267 shutdown_connections 2023-11-08T19:27:10.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.567+0000 7fea894b8700 1 --2- 172.21.15.149:0/3519203267 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea840ce720 0x7fea840cf3e0 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:10.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.567+0000 7fea894b8700 1 -- 172.21.15.149:0/3519203267 >> 172.21.15.149:0/3519203267 conn(0x7fea8406b1b0 msgr2=0x7fea840b13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:10.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.567+0000 7fea894b8700 1 -- 172.21.15.149:0/3519203267 shutdown_connections 2023-11-08T19:27:10.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.567+0000 7fea894b8700 1 -- 172.21.15.149:0/3519203267 wait complete. 2023-11-08T19:27:10.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.568+0000 7fea894b8700 1 Processor -- start 2023-11-08T19:27:10.580 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.569+0000 7fea894b8700 1 -- start start 2023-11-08T19:27:10.584 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.569+0000 7fea894b8700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fea840ce720 0x7fea8414ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:10.585 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.569+0000 7fea894b8700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fea840cf920 0x7fea84158ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:10.585 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.569+0000 7fea894b8700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea84157ab0 0x7fea84154280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:10.585 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.569+0000 7fea894b8700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea84156fb0 con 0x7fea84157ab0 2023-11-08T19:27:10.586 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.569+0000 7fea894b8700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea84159530 con 0x7fea840cf920 2023-11-08T19:27:10.586 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.569+0000 7fea894b8700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea8414f4e0 con 0x7fea840ce720 2023-11-08T19:27:10.587 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.569+0000 7fea837fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea84157ab0 0x7fea84154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:10.587 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.569+0000 7fea837fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea84157ab0 0x7fea84154280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43822/0 (socket says 172.21.15.149:43822) 2023-11-08T19:27:10.587 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.569+0000 7fea837fe700 1 -- 172.21.15.149:0/2977498893 learned_addr learned my addr 172.21.15.149:0/2977498893 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:27:10.588 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.569+0000 7fea82ffd700 1 --2- 172.21.15.149:0/2977498893 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fea840ce720 0x7fea8414ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:10.588 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.569+0000 7fea827fc700 1 --2- 172.21.15.149:0/2977498893 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fea840cf920 0x7fea84158ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:10.589 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.570+0000 7fea837fe700 1 -- 172.21.15.149:0/2977498893 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fea840ce720 msgr2=0x7fea8414ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:10.589 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.570+0000 7fea837fe700 1 --2- 172.21.15.149:0/2977498893 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fea840ce720 0x7fea8414ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:10.589 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.570+0000 7fea837fe700 1 -- 172.21.15.149:0/2977498893 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fea840cf920 msgr2=0x7fea84158ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:10.590 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.570+0000 7fea837fe700 1 --2- 172.21.15.149:0/2977498893 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fea840cf920 0x7fea84158ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:10.590 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.570+0000 7fea837fe700 1 -- 172.21.15.149:0/2977498893 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea780094a0 con 0x7fea84157ab0 2023-11-08T19:27:10.591 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.570+0000 7fea837fe700 1 --2- 172.21.15.149:0/2977498893 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea84157ab0 0x7fea84154280 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fea7c002230 tx=0x7fea7c00cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:10.591 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.570+0000 7fea6b7fe700 1 -- 172.21.15.149:0/2977498893 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea7c00aac0 con 0x7fea84157ab0 2023-11-08T19:27:10.591 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.570+0000 7fea6b7fe700 1 -- 172.21.15.149:0/2977498893 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea7c00ac40 con 0x7fea84157ab0 2023-11-08T19:27:10.592 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.570+0000 7fea894b8700 1 -- 172.21.15.149:0/2977498893 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea8414f7c0 con 0x7fea84157ab0 2023-11-08T19:27:10.592 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.570+0000 7fea6b7fe700 1 -- 172.21.15.149:0/2977498893 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea7c0070d0 con 0x7fea84157ab0 2023-11-08T19:27:10.593 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.570+0000 7fea894b8700 1 -- 172.21.15.149:0/2977498893 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea840b37d0 con 0x7fea84157ab0 2023-11-08T19:27:10.593 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.571+0000 7fea894b8700 1 -- 172.21.15.149:0/2977498893 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea840b3350 con 0x7fea84157ab0 2023-11-08T19:27:10.593 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.571+0000 7fea6b7fe700 1 -- 172.21.15.149:0/2977498893 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fea7c007250 con 0x7fea84157ab0 2023-11-08T19:27:10.594 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.572+0000 7fea6b7fe700 1 --2- 172.21.15.149:0/2977498893 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fea7006af00 0x7fea7006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:10.594 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.572+0000 7fea6b7fe700 1 -- 172.21.15.149:0/2977498893 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7fea7c089910 con 0x7fea84157ab0 2023-11-08T19:27:10.595 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.572+0000 7fea82ffd700 1 --2- 172.21.15.149:0/2977498893 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fea7006af00 0x7fea7006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:10.595 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.572+0000 7fea82ffd700 1 --2- 172.21.15.149:0/2977498893 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fea7006af00 0x7fea7006d3c0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fea74007fd0 tx=0x7fea74009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:10.595 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.577+0000 7fea6b7fe700 1 -- 172.21.15.149:0/2977498893 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fea840b3350 con 0x7fea84157ab0 2023-11-08T19:27:10.850 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:10.848+0000 7fea894b8700 1 -- 172.21.15.149:0/2977498893 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"} v 0) v1 -- 0x7fea840b3350 con 0x7fea84157ab0 2023-11-08T19:27:11.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.144+0000 7fea6b7fe700 1 -- 172.21.15.149:0/2977498893 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"}]=0 freezing mds.7140 v60) v1 ==== 112+0+0 (secure 0 0 0) 0x7fea840b3350 con 0x7fea84157ab0 2023-11-08T19:27:11.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.147+0000 7fea894b8700 1 -- 172.21.15.149:0/2977498893 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fea7006af00 msgr2=0x7fea7006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:11.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.147+0000 7fea894b8700 1 --2- 172.21.15.149:0/2977498893 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fea7006af00 0x7fea7006d3c0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fea74007fd0 tx=0x7fea74009040 comp rx=0 tx=0).stop 2023-11-08T19:27:11.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.147+0000 7fea894b8700 1 -- 172.21.15.149:0/2977498893 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea84157ab0 msgr2=0x7fea84154280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:11.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.147+0000 7fea894b8700 1 --2- 172.21.15.149:0/2977498893 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea84157ab0 0x7fea84154280 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fea7c002230 tx=0x7fea7c00cf50 comp rx=0 tx=0).stop 2023-11-08T19:27:11.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.147+0000 7fea894b8700 1 -- 172.21.15.149:0/2977498893 shutdown_connections 2023-11-08T19:27:11.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.147+0000 7fea894b8700 1 --2- 172.21.15.149:0/2977498893 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fea7006af00 0x7fea7006d3c0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:11.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.147+0000 7fea894b8700 1 --2- 172.21.15.149:0/2977498893 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea84157ab0 0x7fea84154280 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:11.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.147+0000 7fea894b8700 1 --2- 172.21.15.149:0/2977498893 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fea840ce720 0x7fea8414ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:11.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.147+0000 7fea894b8700 1 --2- 172.21.15.149:0/2977498893 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fea840cf920 0x7fea84158ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:11.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.147+0000 7fea894b8700 1 -- 172.21.15.149:0/2977498893 >> 172.21.15.149:0/2977498893 conn(0x7fea8406b1b0 msgr2=0x7fea840c8a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:11.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.147+0000 7fea894b8700 1 -- 172.21.15.149:0/2977498893 shutdown_connections 2023-11-08T19:27:11.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.148+0000 7fea894b8700 1 -- 172.21.15.149:0/2977498893 wait complete. 2023-11-08T19:27:11.153 INFO:teuthology.orchestra.run.smithi149.stderr:freezing mds.7140 2023-11-08T19:27:11.163 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json config set mds_kill_mdstable_at 1 2023-11-08T19:27:11.312 INFO:teuthology.orchestra.run.smithi160.stdout:{"success":"mds_kill_mdstable_at = '1' (not observed, change may require restart) "} 2023-11-08T19:27:11.312 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_kill_mdstable_at = '1' (not observed, change may require restart) " } 2023-11-08T19:27:11.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:27:11.313 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir d1/dir/.snap/s11) 2023-11-08T19:27:11.316 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2023-11-08T19:27:11.333 INFO:tasks.ceph.mds.b.smithi160.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el8/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_prepare(ceph::cref_t&)' thread 7fdd466c3700 time 2023-11-08T19:27:11.332355+0000 2023-11-08T19:27:11.333 INFO:tasks.ceph.mds.b.smithi160.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el8/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 61: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 1) 2023-11-08T19:27:11.334 INFO:tasks.ceph.mds.b.smithi160.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-08T19:27:11.334 INFO:tasks.ceph.mds.b.smithi160.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fdd51f8bf5b] 2023-11-08T19:27:11.334 INFO:tasks.ceph.mds.b.smithi160.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2ba121) [0x7fdd51f8c121] 2023-11-08T19:27:11.334 INFO:tasks.ceph.mds.b.smithi160.stderr: 3: (MDSTableServer::handle_prepare(boost::intrusive_ptr const&)+0x3e0) [0x55bd9da69340] 2023-11-08T19:27:11.334 INFO:tasks.ceph.mds.b.smithi160.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55bd9d72a099] 2023-11-08T19:27:11.335 INFO:tasks.ceph.mds.b.smithi160.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x593) [0x55bd9d72d1c3] 2023-11-08T19:27:11.335 INFO:tasks.ceph.mds.b.smithi160.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55bd9d72d7bc] 2023-11-08T19:27:11.335 INFO:tasks.ceph.mds.b.smithi160.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55bd9d71756f] 2023-11-08T19:27:11.335 INFO:tasks.ceph.mds.b.smithi160.stderr: 8: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fdd522139c8] 2023-11-08T19:27:11.335 INFO:tasks.ceph.mds.b.smithi160.stderr: 9: (DispatchQueue::entry()+0x51f) [0x7fdd52210b4f] 2023-11-08T19:27:11.336 INFO:tasks.ceph.mds.b.smithi160.stderr: 10: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fdd522de351] 2023-11-08T19:27:11.336 INFO:tasks.ceph.mds.b.smithi160.stderr: 11: /lib64/libpthread.so.0(+0x81cf) [0x7fdd50d241cf] 2023-11-08T19:27:11.336 INFO:tasks.ceph.mds.b.smithi160.stderr: 12: clone() 2023-11-08T19:27:11.336 INFO:tasks.ceph.mds.b.smithi160.stderr:2023-11-08T19:27:11.332+0000 7fdd466c3700 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el8/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_prepare(ceph::cref_t&)' thread 7fdd466c3700 time 2023-11-08T19:27:11.332355+0000 2023-11-08T19:27:11.336 INFO:tasks.ceph.mds.b.smithi160.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el8/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 61: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 1) 2023-11-08T19:27:11.336 INFO:tasks.ceph.mds.b.smithi160.stderr: 2023-11-08T19:27:11.337 INFO:tasks.ceph.mds.b.smithi160.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-08T19:27:11.337 INFO:tasks.ceph.mds.b.smithi160.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fdd51f8bf5b] 2023-11-08T19:27:11.337 INFO:tasks.ceph.mds.b.smithi160.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2ba121) [0x7fdd51f8c121] 2023-11-08T19:27:11.337 INFO:tasks.ceph.mds.b.smithi160.stderr: 3: (MDSTableServer::handle_prepare(boost::intrusive_ptr const&)+0x3e0) [0x55bd9da69340] 2023-11-08T19:27:11.337 INFO:tasks.ceph.mds.b.smithi160.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55bd9d72a099] 2023-11-08T19:27:11.338 INFO:tasks.ceph.mds.b.smithi160.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x593) [0x55bd9d72d1c3] 2023-11-08T19:27:11.338 INFO:tasks.ceph.mds.b.smithi160.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55bd9d72d7bc] 2023-11-08T19:27:11.338 INFO:tasks.ceph.mds.b.smithi160.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55bd9d71756f] 2023-11-08T19:27:11.338 INFO:tasks.ceph.mds.b.smithi160.stderr: 8: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fdd522139c8] 2023-11-08T19:27:11.338 INFO:tasks.ceph.mds.b.smithi160.stderr: 9: (DispatchQueue::entry()+0x51f) [0x7fdd52210b4f] 2023-11-08T19:27:11.339 INFO:tasks.ceph.mds.b.smithi160.stderr: 10: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fdd522de351] 2023-11-08T19:27:11.339 INFO:tasks.ceph.mds.b.smithi160.stderr: 11: /lib64/libpthread.so.0(+0x81cf) [0x7fdd50d241cf] 2023-11-08T19:27:11.339 INFO:tasks.ceph.mds.b.smithi160.stderr: 12: clone() 2023-11-08T19:27:11.339 INFO:tasks.ceph.mds.b.smithi160.stderr: 2023-11-08T19:27:11.339 INFO:tasks.ceph.mds.b.smithi160.stderr:*** Caught signal (Aborted) ** 2023-11-08T19:27:11.340 INFO:tasks.ceph.mds.b.smithi160.stderr: in thread 7fdd466c3700 thread_name:ms_dispatch 2023-11-08T19:27:11.340 INFO:tasks.ceph.mds.b.smithi160.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-08T19:27:11.340 INFO:tasks.ceph.mds.b.smithi160.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7fdd50d2ece0] 2023-11-08T19:27:11.341 INFO:tasks.ceph.mds.b.smithi160.stderr: 2: gsignal() 2023-11-08T19:27:11.341 INFO:tasks.ceph.mds.b.smithi160.stderr: 3: abort() 2023-11-08T19:27:11.341 INFO:tasks.ceph.mds.b.smithi160.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fdd51f8bfb5] 2023-11-08T19:27:11.341 INFO:tasks.ceph.mds.b.smithi160.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2ba121) [0x7fdd51f8c121] 2023-11-08T19:27:11.341 INFO:tasks.ceph.mds.b.smithi160.stderr: 6: (MDSTableServer::handle_prepare(boost::intrusive_ptr const&)+0x3e0) [0x55bd9da69340] 2023-11-08T19:27:11.342 INFO:tasks.ceph.mds.b.smithi160.stderr: 7: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55bd9d72a099] 2023-11-08T19:27:11.342 INFO:tasks.ceph.mds.b.smithi160.stderr: 8: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x593) [0x55bd9d72d1c3] 2023-11-08T19:27:11.342 INFO:tasks.ceph.mds.b.smithi160.stderr: 9: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55bd9d72d7bc] 2023-11-08T19:27:11.342 INFO:tasks.ceph.mds.b.smithi160.stderr: 10: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55bd9d71756f] 2023-11-08T19:27:11.342 INFO:tasks.ceph.mds.b.smithi160.stderr: 11: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fdd522139c8] 2023-11-08T19:27:11.343 INFO:tasks.ceph.mds.b.smithi160.stderr: 12: (DispatchQueue::entry()+0x51f) [0x7fdd52210b4f] 2023-11-08T19:27:11.343 INFO:tasks.ceph.mds.b.smithi160.stderr: 13: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fdd522de351] 2023-11-08T19:27:11.343 INFO:tasks.ceph.mds.b.smithi160.stderr: 14: /lib64/libpthread.so.0(+0x81cf) [0x7fdd50d241cf] 2023-11-08T19:27:11.343 INFO:tasks.ceph.mds.b.smithi160.stderr: 15: clone() 2023-11-08T19:27:11.343 INFO:tasks.ceph.mds.b.smithi160.stderr:2023-11-08T19:27:11.333+0000 7fdd466c3700 -1 *** Caught signal (Aborted) ** 2023-11-08T19:27:11.344 INFO:tasks.ceph.mds.b.smithi160.stderr: in thread 7fdd466c3700 thread_name:ms_dispatch 2023-11-08T19:27:11.344 INFO:tasks.ceph.mds.b.smithi160.stderr: 2023-11-08T19:27:11.344 INFO:tasks.ceph.mds.b.smithi160.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-08T19:27:11.344 INFO:tasks.ceph.mds.b.smithi160.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7fdd50d2ece0] 2023-11-08T19:27:11.344 INFO:tasks.ceph.mds.b.smithi160.stderr: 2: gsignal() 2023-11-08T19:27:11.345 INFO:tasks.ceph.mds.b.smithi160.stderr: 3: abort() 2023-11-08T19:27:11.345 INFO:tasks.ceph.mds.b.smithi160.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fdd51f8bfb5] 2023-11-08T19:27:11.345 INFO:tasks.ceph.mds.b.smithi160.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2ba121) [0x7fdd51f8c121] 2023-11-08T19:27:11.345 INFO:tasks.ceph.mds.b.smithi160.stderr: 6: (MDSTableServer::handle_prepare(boost::intrusive_ptr const&)+0x3e0) [0x55bd9da69340] 2023-11-08T19:27:11.345 INFO:tasks.ceph.mds.b.smithi160.stderr: 7: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55bd9d72a099] 2023-11-08T19:27:11.346 INFO:tasks.ceph.mds.b.smithi160.stderr: 8: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x593) [0x55bd9d72d1c3] 2023-11-08T19:27:11.346 INFO:tasks.ceph.mds.b.smithi160.stderr: 9: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55bd9d72d7bc] 2023-11-08T19:27:11.346 INFO:tasks.ceph.mds.b.smithi160.stderr: 10: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55bd9d71756f] 2023-11-08T19:27:11.346 INFO:tasks.ceph.mds.b.smithi160.stderr: 11: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fdd522139c8] 2023-11-08T19:27:11.346 INFO:tasks.ceph.mds.b.smithi160.stderr: 12: (DispatchQueue::entry()+0x51f) [0x7fdd52210b4f] 2023-11-08T19:27:11.347 INFO:tasks.ceph.mds.b.smithi160.stderr: 13: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fdd522de351] 2023-11-08T19:27:11.347 INFO:tasks.ceph.mds.b.smithi160.stderr: 14: /lib64/libpthread.so.0(+0x81cf) [0x7fdd50d241cf] 2023-11-08T19:27:11.347 INFO:tasks.ceph.mds.b.smithi160.stderr: 15: clone() 2023-11-08T19:27:11.347 INFO:tasks.ceph.mds.b.smithi160.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-08T19:27:11.347 INFO:tasks.ceph.mds.b.smithi160.stderr: 2023-11-08T19:27:11.348 INFO:tasks.ceph.mds.b.smithi160.stderr: -4513> 2023-11-08T19:26:53.568+0000 7fdd43ebe700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-08T19:27:11.348 INFO:tasks.ceph.mds.b.smithi160.stderr: -1> 2023-11-08T19:27:11.332+0000 7fdd466c3700 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el8/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_prepare(ceph::cref_t&)' thread 7fdd466c3700 time 2023-11-08T19:27:11.332355+0000 2023-11-08T19:27:11.348 INFO:tasks.ceph.mds.b.smithi160.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el8/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 61: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 1) 2023-11-08T19:27:11.349 INFO:tasks.ceph.mds.b.smithi160.stderr: 2023-11-08T19:27:11.349 INFO:tasks.ceph.mds.b.smithi160.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-08T19:27:11.349 INFO:tasks.ceph.mds.b.smithi160.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fdd51f8bf5b] 2023-11-08T19:27:11.349 INFO:tasks.ceph.mds.b.smithi160.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2ba121) [0x7fdd51f8c121] 2023-11-08T19:27:11.349 INFO:tasks.ceph.mds.b.smithi160.stderr: 3: (MDSTableServer::handle_prepare(boost::intrusive_ptr const&)+0x3e0) [0x55bd9da69340] 2023-11-08T19:27:11.350 INFO:tasks.ceph.mds.b.smithi160.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55bd9d72a099] 2023-11-08T19:27:11.350 INFO:tasks.ceph.mds.b.smithi160.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x593) [0x55bd9d72d1c3] 2023-11-08T19:27:11.350 INFO:tasks.ceph.mds.b.smithi160.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55bd9d72d7bc] 2023-11-08T19:27:11.350 INFO:tasks.ceph.mds.b.smithi160.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55bd9d71756f] 2023-11-08T19:27:11.350 INFO:tasks.ceph.mds.b.smithi160.stderr: 8: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fdd522139c8] 2023-11-08T19:27:11.351 INFO:tasks.ceph.mds.b.smithi160.stderr: 9: (DispatchQueue::entry()+0x51f) [0x7fdd52210b4f] 2023-11-08T19:27:11.351 INFO:tasks.ceph.mds.b.smithi160.stderr: 10: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fdd522de351] 2023-11-08T19:27:11.351 INFO:tasks.ceph.mds.b.smithi160.stderr: 11: /lib64/libpthread.so.0(+0x81cf) [0x7fdd50d241cf] 2023-11-08T19:27:11.351 INFO:tasks.ceph.mds.b.smithi160.stderr: 12: clone() 2023-11-08T19:27:11.351 INFO:tasks.ceph.mds.b.smithi160.stderr: 2023-11-08T19:27:11.352 INFO:tasks.ceph.mds.b.smithi160.stderr: 0> 2023-11-08T19:27:11.333+0000 7fdd466c3700 -1 *** Caught signal (Aborted) ** 2023-11-08T19:27:11.352 INFO:tasks.ceph.mds.b.smithi160.stderr: in thread 7fdd466c3700 thread_name:ms_dispatch 2023-11-08T19:27:11.352 INFO:tasks.ceph.mds.b.smithi160.stderr: 2023-11-08T19:27:11.352 INFO:tasks.ceph.mds.b.smithi160.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-08T19:27:11.352 INFO:tasks.ceph.mds.b.smithi160.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7fdd50d2ece0] 2023-11-08T19:27:11.353 INFO:tasks.ceph.mds.b.smithi160.stderr: 2: gsignal() 2023-11-08T19:27:11.353 INFO:tasks.ceph.mds.b.smithi160.stderr: 3: abort() 2023-11-08T19:27:11.353 INFO:tasks.ceph.mds.b.smithi160.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fdd51f8bfb5] 2023-11-08T19:27:11.353 INFO:tasks.ceph.mds.b.smithi160.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2ba121) [0x7fdd51f8c121] 2023-11-08T19:27:11.353 INFO:tasks.ceph.mds.b.smithi160.stderr: 6: (MDSTableServer::handle_prepare(boost::intrusive_ptr const&)+0x3e0) [0x55bd9da69340] 2023-11-08T19:27:11.353 INFO:tasks.ceph.mds.b.smithi160.stderr: 7: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55bd9d72a099] 2023-11-08T19:27:11.354 INFO:tasks.ceph.mds.b.smithi160.stderr: 8: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x593) [0x55bd9d72d1c3] 2023-11-08T19:27:11.354 INFO:tasks.ceph.mds.b.smithi160.stderr: 9: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55bd9d72d7bc] 2023-11-08T19:27:11.354 INFO:tasks.ceph.mds.b.smithi160.stderr: 10: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55bd9d71756f] 2023-11-08T19:27:11.354 INFO:tasks.ceph.mds.b.smithi160.stderr: 11: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fdd522139c8] 2023-11-08T19:27:11.354 INFO:tasks.ceph.mds.b.smithi160.stderr: 12: (DispatchQueue::entry()+0x51f) [0x7fdd52210b4f] 2023-11-08T19:27:11.355 INFO:tasks.ceph.mds.b.smithi160.stderr: 13: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fdd522de351] 2023-11-08T19:27:11.355 INFO:tasks.ceph.mds.b.smithi160.stderr: 14: /lib64/libpthread.so.0(+0x81cf) [0x7fdd50d241cf] 2023-11-08T19:27:11.355 INFO:tasks.ceph.mds.b.smithi160.stderr: 15: clone() 2023-11-08T19:27:11.355 INFO:tasks.ceph.mds.b.smithi160.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-08T19:27:11.355 INFO:tasks.ceph.mds.b.smithi160.stderr: 2023-11-08T19:27:11.356 INFO:tasks.ceph.mds.b.smithi160.stderr: -4513> 2023-11-08T19:26:53.568+0000 7fdd43ebe700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-08T19:27:11.356 INFO:tasks.ceph.mds.b.smithi160.stderr: -1> 2023-11-08T19:27:11.332+0000 7fdd466c3700 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el8/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_prepare(ceph::cref_t&)' thread 7fdd466c3700 time 2023-11-08T19:27:11.332355+0000 2023-11-08T19:27:11.356 INFO:tasks.ceph.mds.b.smithi160.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el8/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 61: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 1) 2023-11-08T19:27:11.357 INFO:tasks.ceph.mds.b.smithi160.stderr: 2023-11-08T19:27:11.357 INFO:tasks.ceph.mds.b.smithi160.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-08T19:27:11.357 INFO:tasks.ceph.mds.b.smithi160.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fdd51f8bf5b] 2023-11-08T19:27:11.357 INFO:tasks.ceph.mds.b.smithi160.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2ba121) [0x7fdd51f8c121] 2023-11-08T19:27:11.357 INFO:tasks.ceph.mds.b.smithi160.stderr: 3: (MDSTableServer::handle_prepare(boost::intrusive_ptr const&)+0x3e0) [0x55bd9da69340] 2023-11-08T19:27:11.358 INFO:tasks.ceph.mds.b.smithi160.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55bd9d72a099] 2023-11-08T19:27:11.358 INFO:tasks.ceph.mds.b.smithi160.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x593) [0x55bd9d72d1c3] 2023-11-08T19:27:11.358 INFO:tasks.ceph.mds.b.smithi160.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55bd9d72d7bc] 2023-11-08T19:27:11.358 INFO:tasks.ceph.mds.b.smithi160.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55bd9d71756f] 2023-11-08T19:27:11.358 INFO:tasks.ceph.mds.b.smithi160.stderr: 8: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fdd522139c8] 2023-11-08T19:27:11.358 INFO:tasks.ceph.mds.b.smithi160.stderr: 9: (DispatchQueue::entry()+0x51f) [0x7fdd52210b4f] 2023-11-08T19:27:11.359 INFO:tasks.ceph.mds.b.smithi160.stderr: 10: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fdd522de351] 2023-11-08T19:27:11.359 INFO:tasks.ceph.mds.b.smithi160.stderr: 11: /lib64/libpthread.so.0(+0x81cf) [0x7fdd50d241cf] 2023-11-08T19:27:11.359 INFO:tasks.ceph.mds.b.smithi160.stderr: 12: clone() 2023-11-08T19:27:11.359 INFO:tasks.ceph.mds.b.smithi160.stderr: 2023-11-08T19:27:11.359 INFO:tasks.ceph.mds.b.smithi160.stderr: 0> 2023-11-08T19:27:11.333+0000 7fdd466c3700 -1 *** Caught signal (Aborted) ** 2023-11-08T19:27:11.360 INFO:tasks.ceph.mds.b.smithi160.stderr: in thread 7fdd466c3700 thread_name:ms_dispatch 2023-11-08T19:27:11.360 INFO:tasks.ceph.mds.b.smithi160.stderr: 2023-11-08T19:27:11.360 INFO:tasks.ceph.mds.b.smithi160.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-08T19:27:11.360 INFO:tasks.ceph.mds.b.smithi160.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7fdd50d2ece0] 2023-11-08T19:27:11.360 INFO:tasks.ceph.mds.b.smithi160.stderr: 2: gsignal() 2023-11-08T19:27:11.361 INFO:tasks.ceph.mds.b.smithi160.stderr: 3: abort() 2023-11-08T19:27:11.361 INFO:tasks.ceph.mds.b.smithi160.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fdd51f8bfb5] 2023-11-08T19:27:11.361 INFO:tasks.ceph.mds.b.smithi160.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2ba121) [0x7fdd51f8c121] 2023-11-08T19:27:11.361 INFO:tasks.ceph.mds.b.smithi160.stderr: 6: (MDSTableServer::handle_prepare(boost::intrusive_ptr const&)+0x3e0) [0x55bd9da69340] 2023-11-08T19:27:11.361 INFO:tasks.ceph.mds.b.smithi160.stderr: 7: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55bd9d72a099] 2023-11-08T19:27:11.361 INFO:tasks.ceph.mds.b.smithi160.stderr: 8: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x593) [0x55bd9d72d1c3] 2023-11-08T19:27:11.362 INFO:tasks.ceph.mds.b.smithi160.stderr: 9: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55bd9d72d7bc] 2023-11-08T19:27:11.362 INFO:tasks.ceph.mds.b.smithi160.stderr: 10: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55bd9d71756f] 2023-11-08T19:27:11.362 INFO:tasks.ceph.mds.b.smithi160.stderr: 11: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fdd522139c8] 2023-11-08T19:27:11.362 INFO:tasks.ceph.mds.b.smithi160.stderr: 12: (DispatchQueue::entry()+0x51f) [0x7fdd52210b4f] 2023-11-08T19:27:11.362 INFO:tasks.ceph.mds.b.smithi160.stderr: 13: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fdd522de351] 2023-11-08T19:27:11.363 INFO:tasks.ceph.mds.b.smithi160.stderr: 14: /lib64/libpthread.so.0(+0x81cf) [0x7fdd50d241cf] 2023-11-08T19:27:11.363 INFO:tasks.ceph.mds.b.smithi160.stderr: 15: clone() 2023-11-08T19:27:11.363 INFO:tasks.ceph.mds.b.smithi160.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-08T19:27:11.363 INFO:tasks.ceph.mds.b.smithi160.stderr: 2023-11-08T19:27:11.493 INFO:teuthology.orchestra.run.smithi149.stdout:{"mds_beacon_grace":"15.000000"} 2023-11-08T19:27:11.494 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2023-11-08T19:27:11.495 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:27:11.617 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.615+0000 7f4cb28a9700 1 Processor -- start 2023-11-08T19:27:11.617 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.615+0000 7f4cb28a9700 1 -- start start 2023-11-08T19:27:11.620 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.616+0000 7f4cb28a9700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f4cac15b950 0x7f4cac0ce130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:11.621 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.616+0000 7f4cb28a9700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4cac0cd5e0 0x7f4cac0ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:11.621 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.616+0000 7f4cb28a9700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cac0cc2e0 con 0x7f4cac0cfd20 2023-11-08T19:27:11.621 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.616+0000 7f4cb28a9700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cac0cc580 con 0x7f4cac15b950 2023-11-08T19:27:11.622 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.616+0000 7f4cb28a9700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cac0cc820 con 0x7f4cac0cd5e0 2023-11-08T19:27:11.622 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.616+0000 7f4cabfff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f4cac15b950 0x7f4cac0ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:11.622 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.616+0000 7f4cabfff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f4cac15b950 0x7f4cac0ce130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43828/0 (socket says 172.21.15.149:43828) 2023-11-08T19:27:11.622 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.616+0000 7f4cabfff700 1 -- 172.21.15.149:0/2626691922 learned_addr learned my addr 172.21.15.149:0/2626691922 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:27:11.622 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.616+0000 7f4cab7fe700 1 --2- 172.21.15.149:0/2626691922 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4cac0cd5e0 0x7f4cac0ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:11.623 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.616+0000 7f4cabfff700 1 -- 172.21.15.149:0/2626691922 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4cac0cd5e0 msgr2=0x7f4cac0ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:11.623 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.616+0000 7f4cabfff700 1 --2- 172.21.15.149:0/2626691922 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4cac0cd5e0 0x7f4cac0ce670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:11.623 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.616+0000 7f4cabfff700 1 -- 172.21.15.149:0/2626691922 >> v1:172.21.15.160:6789/0 conn(0x7f4cac0cfd20 legacy=0x7f4cac0d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:11.623 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.616+0000 7f4cabfff700 1 -- 172.21.15.149:0/2626691922 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cac0ccb00 con 0x7f4cac15b950 2023-11-08T19:27:11.624 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.616+0000 7f4cabfff700 1 --2- 172.21.15.149:0/2626691922 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4cac15b950 0x7f4cac0ce130 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c006fd0 tx=0x7f4c9c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc8339dd248ee7ae server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:11.624 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.616+0000 7f4caaffd700 1 -- 172.21.15.149:0/2626691922 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9c005e30 con 0x7f4cac15b950 2023-11-08T19:27:11.624 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.616+0000 7f4caaffd700 1 -- 172.21.15.149:0/2626691922 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c9c004030 con 0x7f4cac15b950 2023-11-08T19:27:11.624 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.616+0000 7f4caaffd700 1 -- 172.21.15.149:0/2626691922 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9c0043e0 con 0x7f4cac15b950 2023-11-08T19:27:11.624 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.617+0000 7f4cb28a9700 1 -- 172.21.15.149:0/2626691922 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4cac15b950 msgr2=0x7f4cac0ce130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:11.625 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.617+0000 7f4cb28a9700 1 --2- 172.21.15.149:0/2626691922 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4cac15b950 0x7f4cac0ce130 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c006fd0 tx=0x7f4c9c009bd0 comp rx=0 tx=0).stop 2023-11-08T19:27:11.625 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.617+0000 7f4cb28a9700 1 -- 172.21.15.149:0/2626691922 shutdown_connections 2023-11-08T19:27:11.625 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.617+0000 7f4cb28a9700 1 --2- 172.21.15.149:0/2626691922 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4cac15b950 0x7f4cac0ce130 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:11.625 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.617+0000 7f4cb28a9700 1 --2- 172.21.15.149:0/2626691922 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4cac0cd5e0 0x7f4cac0ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:11.626 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.617+0000 7f4cb28a9700 1 -- 172.21.15.149:0/2626691922 >> 172.21.15.149:0/2626691922 conn(0x7f4cac08afd0 msgr2=0x7f4cac0d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:11.626 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.617+0000 7f4cb28a9700 1 -- 172.21.15.149:0/2626691922 shutdown_connections 2023-11-08T19:27:11.626 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.617+0000 7f4cb28a9700 1 -- 172.21.15.149:0/2626691922 wait complete. 2023-11-08T19:27:11.626 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.618+0000 7f4cb28a9700 1 Processor -- start 2023-11-08T19:27:11.626 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.618+0000 7f4cb28a9700 1 -- start start 2023-11-08T19:27:11.630 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.619+0000 7f4cb28a9700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4cac0cfd20 0x7f4cac159b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:11.630 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.619+0000 7f4cb28a9700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4cac15b950 0x7f4cac0c8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:11.631 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.619+0000 7f4cb28a9700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4cac0b3320 0x7f4cac15df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:11.631 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.619+0000 7f4cb28a9700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cac0c9b70 con 0x7f4cac0b3320 2023-11-08T19:27:11.631 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.619+0000 7f4cb28a9700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cac0b37b0 con 0x7f4cac15b950 2023-11-08T19:27:11.632 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.619+0000 7f4cb28a9700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cac0c8ef0 con 0x7f4cac0cfd20 2023-11-08T19:27:11.632 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.619+0000 7f4cb0e46700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4cac0b3320 0x7f4cac15df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:11.632 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.619+0000 7f4cab7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4cac15b950 0x7f4cac0c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:11.632 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.619+0000 7f4cabfff700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4cac0cfd20 0x7f4cac159b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:11.633 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.619+0000 7f4cb0e46700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4cac0b3320 0x7f4cac15df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43838/0 (socket says 172.21.15.149:43838) 2023-11-08T19:27:11.633 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.619+0000 7f4cab7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4cac15b950 0x7f4cac0c8810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.149:44828/0 (socket says 172.21.15.149:44828) 2023-11-08T19:27:11.633 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.619+0000 7f4cb0e46700 1 -- 172.21.15.149:0/3641748414 learned_addr learned my addr 172.21.15.149:0/3641748414 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:27:11.634 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.620+0000 7f4cb0e46700 1 -- 172.21.15.149:0/3641748414 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4cac0cfd20 msgr2=0x7f4cac159b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:11.634 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.620+0000 7f4cb0e46700 1 --2- 172.21.15.149:0/3641748414 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4cac0cfd20 0x7f4cac159b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:11.634 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.620+0000 7f4cb0e46700 1 -- 172.21.15.149:0/3641748414 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4cac15b950 msgr2=0x7f4cac0c8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:11.634 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.620+0000 7f4cb0e46700 1 --2- 172.21.15.149:0/3641748414 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4cac15b950 0x7f4cac0c8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:11.634 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.620+0000 7f4cb0e46700 1 -- 172.21.15.149:0/3641748414 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c9c009500 con 0x7f4cac0b3320 2023-11-08T19:27:11.635 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.620+0000 7f4cab7fe700 1 --2- 172.21.15.149:0/3641748414 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4cac15b950 0x7f4cac0c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:27:11.635 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.620+0000 7f4cb0e46700 1 --2- 172.21.15.149:0/3641748414 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4cac0b3320 0x7f4cac15df20 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f4ca400cc50 tx=0x7f4ca400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:11.636 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.620+0000 7f4ca8ff9700 1 -- 172.21.15.149:0/3641748414 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca4003c00 con 0x7f4cac0b3320 2023-11-08T19:27:11.636 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.620+0000 7f4ca8ff9700 1 -- 172.21.15.149:0/3641748414 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ca4003d60 con 0x7f4cac0b3320 2023-11-08T19:27:11.637 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.620+0000 7f4cb28a9700 1 -- 172.21.15.149:0/3641748414 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cac0c91d0 con 0x7f4cac0b3320 2023-11-08T19:27:11.637 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.620+0000 7f4ca8ff9700 1 -- 172.21.15.149:0/3641748414 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca400aab0 con 0x7f4cac0b3320 2023-11-08T19:27:11.637 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.620+0000 7f4cb28a9700 1 -- 172.21.15.149:0/3641748414 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cac0c9790 con 0x7f4cac0b3320 2023-11-08T19:27:11.637 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.621+0000 7f4cb28a9700 1 -- 172.21.15.149:0/3641748414 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cac0c9920 con 0x7f4cac0b3320 2023-11-08T19:27:11.637 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.621+0000 7f4ca8ff9700 1 -- 172.21.15.149:0/3641748414 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4ca400ac10 con 0x7f4cac0b3320 2023-11-08T19:27:11.638 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.622+0000 7f4ca8ff9700 1 --2- 172.21.15.149:0/3641748414 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4c9806af00 0x7f4c9806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:11.638 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.622+0000 7f4cabfff700 1 --2- 172.21.15.149:0/3641748414 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4c9806af00 0x7f4c9806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:11.638 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.622+0000 7f4ca8ff9700 1 -- 172.21.15.149:0/3641748414 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f4ca4089b30 con 0x7f4cac0b3320 2023-11-08T19:27:11.638 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.622+0000 7f4cabfff700 1 --2- 172.21.15.149:0/3641748414 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4c9806af00 0x7f4c9806d3c0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c000c00 tx=0x7f4c9c008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:11.638 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.628+0000 7f4ca8ff9700 1 -- 172.21.15.149:0/3641748414 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4ca4054660 con 0x7f4cac0b3320 2023-11-08T19:27:11.678 INFO:tasks.ceph.mds.b.smithi160.stderr:daemon-helper: command crashed with signal 6 2023-11-08T19:27:11.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.861+0000 7f4cb28a9700 1 -- 172.21.15.149:0/3641748414 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4cac0745f0 con 0x7f4cac0b3320 2023-11-08T19:27:11.864 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.862+0000 7f4ca8ff9700 1 -- 172.21.15.149:0/3641748414 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4939 (secure 0 0 0) 0x7f4ca4057c80 con 0x7f4cac0b3320 2023-11-08T19:27:11.864 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:27:11.865 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":60,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6451,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/2947079163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2947079163},{"type":"v1","addr":"172.21.15.160:6834","nonce":2947079163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49},{"gid":7122,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/589971879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":589971879},{"type":"v1","addr":"172.21.15.149:6836","nonce":589971879}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:27:10.850431+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7140,"mds_1":7125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7125":{"gid":7125,"name":"c","rank":1,"incarnation":57,"state":"up:active","state_seq":6,"addr":"172.21.15.149:6837/3917392643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3917392643},{"type":"v1","addr":"172.21.15.149:6837","nonce":3917392643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7140":{"gid":7140,"name":"b","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.160:6835/2714564224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":2714564224},{"type":"v1","addr":"172.21.15.160:6835","nonce":2714564224}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:27:11.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.864+0000 7f4cb28a9700 1 -- 172.21.15.149:0/3641748414 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4c9806af00 msgr2=0x7f4c9806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:11.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.864+0000 7f4cb28a9700 1 --2- 172.21.15.149:0/3641748414 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4c9806af00 0x7f4c9806d3c0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c000c00 tx=0x7f4c9c008070 comp rx=0 tx=0).stop 2023-11-08T19:27:11.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.864+0000 7f4cb28a9700 1 -- 172.21.15.149:0/3641748414 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4cac0b3320 msgr2=0x7f4cac15df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:11.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.864+0000 7f4cb28a9700 1 --2- 172.21.15.149:0/3641748414 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4cac0b3320 0x7f4cac15df20 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f4ca400cc50 tx=0x7f4ca400cf60 comp rx=0 tx=0).stop 2023-11-08T19:27:11.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.864+0000 7f4cb28a9700 1 -- 172.21.15.149:0/3641748414 shutdown_connections 2023-11-08T19:27:11.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.864+0000 7f4cb28a9700 1 --2- 172.21.15.149:0/3641748414 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4c9806af00 0x7f4c9806d3c0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:11.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.864+0000 7f4cb28a9700 1 --2- 172.21.15.149:0/3641748414 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4cac0b3320 0x7f4cac15df20 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:11.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.864+0000 7f4cb28a9700 1 --2- 172.21.15.149:0/3641748414 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4cac0cfd20 0x7f4cac159b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:11.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.864+0000 7f4cb28a9700 1 --2- 172.21.15.149:0/3641748414 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4cac15b950 0x7f4cac0c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:11.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.864+0000 7f4cb28a9700 1 -- 172.21.15.149:0/3641748414 >> 172.21.15.149:0/3641748414 conn(0x7f4cac08afd0 msgr2=0x7f4cac15c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:11.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.864+0000 7f4cb28a9700 1 -- 172.21.15.149:0/3641748414 shutdown_connections 2023-11-08T19:27:11.869 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:11.864+0000 7f4cb28a9700 1 -- 172.21.15.149:0/3641748414 wait complete. 2023-11-08T19:27:11.869 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 60 2023-11-08T19:27:11.878 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-08T19:27:16.879 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:27:17.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.013+0000 7fa3ea8d3700 1 Processor -- start 2023-11-08T19:27:17.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.013+0000 7fa3ea8d3700 1 -- start start 2023-11-08T19:27:17.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.014+0000 7fa3ea8d3700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fa3e415db70 0x7fa3e4161dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:17.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.014+0000 7fa3ea8d3700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa3e40b2c00 0x7fa3e415df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:17.018 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.014+0000 7fa3ea8d3700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa3e406ab80 0x7fa3e406b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:17.018 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.014+0000 7fa3ea8d3700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3e406b550 con 0x7fa3e406ab80 2023-11-08T19:27:17.018 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.014+0000 7fa3ea8d3700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3e4161940 con 0x7fa3e415db70 2023-11-08T19:27:17.018 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.014+0000 7fa3ea8d3700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e415eeb0 con 0x7fa3e40b2c00 2023-11-08T19:27:17.018 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.014+0000 7fa3e8e70700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa3e406ab80 0x7fa3e406b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:17.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.014+0000 7fa3e8e70700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa3e406ab80 0x7fa3e406b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43862/0 (socket says 172.21.15.149:43862) 2023-11-08T19:27:17.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.014+0000 7fa3e8e70700 1 -- 172.21.15.149:0/3350355351 learned_addr learned my addr 172.21.15.149:0/3350355351 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:27:17.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.014+0000 7fa3e3fff700 1 --2- 172.21.15.149:0/3350355351 >> v2:172.21.15.160:3300/0 conn(0x7fa3e415db70 0x7fa3e4161dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:17.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.014+0000 7fa3e8e70700 1 -- 172.21.15.149:0/3350355351 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa3e40b2c00 msgr2=0x7fa3e415df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:17.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.014+0000 7fa3e37fe700 1 --2- 172.21.15.149:0/3350355351 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa3e40b2c00 0x7fa3e415df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:17.020 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.014+0000 7fa3e8e70700 1 --2- 172.21.15.149:0/3350355351 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa3e40b2c00 0x7fa3e415df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:17.020 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.014+0000 7fa3e8e70700 1 -- 172.21.15.149:0/3350355351 >> v2:172.21.15.160:3300/0 conn(0x7fa3e415db70 msgr2=0x7fa3e4161dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:17.020 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.014+0000 7fa3e8e70700 1 --2- 172.21.15.149:0/3350355351 >> v2:172.21.15.160:3300/0 conn(0x7fa3e415db70 0x7fa3e4161dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:17.020 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.014+0000 7fa3e8e70700 1 -- 172.21.15.149:0/3350355351 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e415e8f0 con 0x7fa3e406ab80 2023-11-08T19:27:17.020 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.014+0000 7fa3e3fff700 1 --2- 172.21.15.149:0/3350355351 >> v2:172.21.15.160:3300/0 conn(0x7fa3e415db70 0x7fa3e4161dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:27:17.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.014+0000 7fa3e37fe700 1 --2- 172.21.15.149:0/3350355351 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa3e40b2c00 0x7fa3e415df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:27:17.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.014+0000 7fa3e8e70700 1 --2- 172.21.15.149:0/3350355351 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3e406ab80 0x7fa3e406b010 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fa3e40d15e0 tx=0x7fa3dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac0d4bca89a345b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:17.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.015+0000 7fa3e2ffd700 1 -- 172.21.15.149:0/3350355351 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc00e070 con 0x7fa3e406ab80 2023-11-08T19:27:17.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.015+0000 7fa3e2ffd700 1 -- 172.21.15.149:0/3350355351 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3dc00b9c0 con 0x7fa3e406ab80 2023-11-08T19:27:17.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.015+0000 7fa3e2ffd700 1 -- 172.21.15.149:0/3350355351 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc00bd70 con 0x7fa3e406ab80 2023-11-08T19:27:17.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.015+0000 7fa3ea8d3700 1 -- 172.21.15.149:0/3350355351 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3e406ab80 msgr2=0x7fa3e406b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:17.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.015+0000 7fa3ea8d3700 1 --2- 172.21.15.149:0/3350355351 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3e406ab80 0x7fa3e406b010 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fa3e40d15e0 tx=0x7fa3dc00b330 comp rx=0 tx=0).stop 2023-11-08T19:27:17.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.015+0000 7fa3ea8d3700 1 -- 172.21.15.149:0/3350355351 shutdown_connections 2023-11-08T19:27:17.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.015+0000 7fa3ea8d3700 1 --2- 172.21.15.149:0/3350355351 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3e406ab80 0x7fa3e406b010 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:17.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.015+0000 7fa3ea8d3700 1 --2- 172.21.15.149:0/3350355351 >> v2:172.21.15.160:3300/0 conn(0x7fa3e415db70 0x7fa3e4161dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:17.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.015+0000 7fa3ea8d3700 1 --2- 172.21.15.149:0/3350355351 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa3e40b2c00 0x7fa3e415df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:17.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.015+0000 7fa3ea8d3700 1 -- 172.21.15.149:0/3350355351 >> 172.21.15.149:0/3350355351 conn(0x7fa3e40ccff0 msgr2=0x7fa3e40cd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:17.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.015+0000 7fa3ea8d3700 1 -- 172.21.15.149:0/3350355351 shutdown_connections 2023-11-08T19:27:17.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.015+0000 7fa3ea8d3700 1 -- 172.21.15.149:0/3350355351 wait complete. 2023-11-08T19:27:17.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.016+0000 7fa3ea8d3700 1 Processor -- start 2023-11-08T19:27:17.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.017+0000 7fa3ea8d3700 1 -- start start 2023-11-08T19:27:17.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.017+0000 7fa3ea8d3700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa3e406ab80 0x7fa3e41f7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:17.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.017+0000 7fa3ea8d3700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3e40b2c00 0x7fa3e40c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:17.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.017+0000 7fa3ea8d3700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa3e415db70 0x7fa3e40c4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:17.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.017+0000 7fa3ea8d3700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e40c7190 con 0x7fa3e40b2c00 2023-11-08T19:27:17.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.017+0000 7fa3ea8d3700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e40c47f0 con 0x7fa3e415db70 2023-11-08T19:27:17.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.017+0000 7fa3ea8d3700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e40c67c0 con 0x7fa3e406ab80 2023-11-08T19:27:17.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.017+0000 7fa3e37fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3e40b2c00 0x7fa3e40c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:17.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.018+0000 7fa3e37fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3e40b2c00 0x7fa3e40c6c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43866/0 (socket says 172.21.15.149:43866) 2023-11-08T19:27:17.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.018+0000 7fa3e37fe700 1 -- 172.21.15.149:0/2037957680 learned_addr learned my addr 172.21.15.149:0/2037957680 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:27:17.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.018+0000 7fa3e3fff700 1 --2- 172.21.15.149:0/2037957680 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa3e406ab80 0x7fa3e41f7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:17.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.018+0000 7fa3e8e70700 1 --2- 172.21.15.149:0/2037957680 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa3e415db70 0x7fa3e40c4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:17.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.018+0000 7fa3e37fe700 1 -- 172.21.15.149:0/2037957680 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa3e406ab80 msgr2=0x7fa3e41f7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:17.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.018+0000 7fa3e37fe700 1 --2- 172.21.15.149:0/2037957680 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa3e406ab80 0x7fa3e41f7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:17.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.018+0000 7fa3e37fe700 1 -- 172.21.15.149:0/2037957680 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa3e415db70 msgr2=0x7fa3e40c4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:17.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.018+0000 7fa3e37fe700 1 --2- 172.21.15.149:0/2037957680 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa3e415db70 0x7fa3e40c4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:17.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.018+0000 7fa3e37fe700 1 -- 172.21.15.149:0/2037957680 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3dc009b30 con 0x7fa3e40b2c00 2023-11-08T19:27:17.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.018+0000 7fa3e8e70700 1 --2- 172.21.15.149:0/2037957680 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa3e415db70 0x7fa3e40c4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:27:17.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.018+0000 7fa3e37fe700 1 --2- 172.21.15.149:0/2037957680 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3e40b2c00 0x7fa3e40c6c50 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7fa3d400c820 tx=0x7fa3d400cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:17.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.018+0000 7fa3e0ff9700 1 -- 172.21.15.149:0/2037957680 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d4004220 con 0x7fa3e40b2c00 2023-11-08T19:27:17.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.018+0000 7fa3e0ff9700 1 -- 172.21.15.149:0/2037957680 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d4004380 con 0x7fa3e40b2c00 2023-11-08T19:27:17.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.018+0000 7fa3ea8d3700 1 -- 172.21.15.149:0/2037957680 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3e40c5c10 con 0x7fa3e40b2c00 2023-11-08T19:27:17.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.018+0000 7fa3e0ff9700 1 -- 172.21.15.149:0/2037957680 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d40036a0 con 0x7fa3e40b2c00 2023-11-08T19:27:17.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.018+0000 7fa3ea8d3700 1 -- 172.21.15.149:0/2037957680 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3e40c5e90 con 0x7fa3e40b2c00 2023-11-08T19:27:17.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.019+0000 7fa3ea8d3700 1 -- 172.21.15.149:0/2037957680 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3e40c6970 con 0x7fa3e40b2c00 2023-11-08T19:27:17.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.020+0000 7fa3e0ff9700 1 -- 172.21.15.149:0/2037957680 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa3d4003800 con 0x7fa3e40b2c00 2023-11-08T19:27:17.032 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.020+0000 7fa3e0ff9700 1 --2- 172.21.15.149:0/2037957680 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa3d006af00 0x7fa3d006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:17.032 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.020+0000 7fa3e3fff700 1 --2- 172.21.15.149:0/2037957680 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa3d006af00 0x7fa3d006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:17.032 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.020+0000 7fa3e0ff9700 1 -- 172.21.15.149:0/2037957680 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7fa3d40895c0 con 0x7fa3e40b2c00 2023-11-08T19:27:17.032 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.021+0000 7fa3e3fff700 1 --2- 172.21.15.149:0/2037957680 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa3d006af00 0x7fa3d006d3c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8006fd0 tx=0x7fa3d8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:17.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.025+0000 7fa3e0ff9700 1 -- 172.21.15.149:0/2037957680 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa3e40c6970 con 0x7fa3e40b2c00 2023-11-08T19:27:17.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.255+0000 7fa3ea8d3700 1 -- 172.21.15.149:0/2037957680 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa3e4161ab0 con 0x7fa3e40b2c00 2023-11-08T19:27:17.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.256+0000 7fa3e0ff9700 1 -- 172.21.15.149:0/2037957680 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4939 (secure 0 0 0) 0x7fa3d40540f0 con 0x7fa3e40b2c00 2023-11-08T19:27:17.258 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:27:17.258 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":60,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6451,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/2947079163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2947079163},{"type":"v1","addr":"172.21.15.160:6834","nonce":2947079163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49},{"gid":7122,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/589971879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":589971879},{"type":"v1","addr":"172.21.15.149:6836","nonce":589971879}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:27:10.850431+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7140,"mds_1":7125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7125":{"gid":7125,"name":"c","rank":1,"incarnation":57,"state":"up:active","state_seq":6,"addr":"172.21.15.149:6837/3917392643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3917392643},{"type":"v1","addr":"172.21.15.149:6837","nonce":3917392643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7140":{"gid":7140,"name":"b","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.160:6835/2714564224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":2714564224},{"type":"v1","addr":"172.21.15.160:6835","nonce":2714564224}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:27:17.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.258+0000 7fa3ea8d3700 1 -- 172.21.15.149:0/2037957680 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa3d006af00 msgr2=0x7fa3d006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:17.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.258+0000 7fa3ea8d3700 1 --2- 172.21.15.149:0/2037957680 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa3d006af00 0x7fa3d006d3c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8006fd0 tx=0x7fa3d8008040 comp rx=0 tx=0).stop 2023-11-08T19:27:17.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.258+0000 7fa3ea8d3700 1 -- 172.21.15.149:0/2037957680 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3e40b2c00 msgr2=0x7fa3e40c6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:17.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.258+0000 7fa3ea8d3700 1 --2- 172.21.15.149:0/2037957680 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3e40b2c00 0x7fa3e40c6c50 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7fa3d400c820 tx=0x7fa3d400cb30 comp rx=0 tx=0).stop 2023-11-08T19:27:17.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.258+0000 7fa3ea8d3700 1 -- 172.21.15.149:0/2037957680 shutdown_connections 2023-11-08T19:27:17.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.258+0000 7fa3ea8d3700 1 --2- 172.21.15.149:0/2037957680 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa3d006af00 0x7fa3d006d3c0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:17.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.258+0000 7fa3ea8d3700 1 --2- 172.21.15.149:0/2037957680 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa3e415db70 0x7fa3e40c4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:17.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.258+0000 7fa3ea8d3700 1 --2- 172.21.15.149:0/2037957680 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa3e406ab80 0x7fa3e41f7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:17.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.258+0000 7fa3ea8d3700 1 --2- 172.21.15.149:0/2037957680 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3e40b2c00 0x7fa3e40c6c50 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:17.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.258+0000 7fa3ea8d3700 1 -- 172.21.15.149:0/2037957680 >> 172.21.15.149:0/2037957680 conn(0x7fa3e40ccff0 msgr2=0x7fa3e406ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:17.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.258+0000 7fa3ea8d3700 1 -- 172.21.15.149:0/2037957680 shutdown_connections 2023-11-08T19:27:17.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:17.258+0000 7fa3ea8d3700 1 -- 172.21.15.149:0/2037957680 wait complete. 2023-11-08T19:27:17.263 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 60 2023-11-08T19:27:17.272 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-08T19:27:18.479 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-11-08T19:27:22.273 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:27:22.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.407+0000 7fc88f339700 1 Processor -- start 2023-11-08T19:27:22.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.407+0000 7fc88f339700 1 -- start start 2023-11-08T19:27:22.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.408+0000 7fc88f339700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fc8880cc910 0x7fc8880cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:22.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.408+0000 7fc88f339700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8880b2f60 con 0x7fc8880cc140 2023-11-08T19:27:22.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.408+0000 7fc88f339700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8880cc520 con 0x7fc8880cb130 2023-11-08T19:27:22.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.408+0000 7fc88f339700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8880b2430 con 0x7fc8880cc910 2023-11-08T19:27:22.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.408+0000 7fc88d0d5700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fc8880cc140 0x7fc8880b2850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:45878/0 (socket says 172.21.15.149:45878) 2023-11-08T19:27:22.414 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.408+0000 7fc88d0d5700 1 -- 172.21.15.149:0/3134902296 learned_addr learned my addr 172.21.15.149:0/3134902296 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:27:22.414 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.409+0000 7fc88c8d4700 1 --2- 172.21.15.149:0/3134902296 >> v2:172.21.15.160:3300/0 conn(0x7fc8880cc910 0x7fc8880cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:22.414 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.409+0000 7fc87ffff700 1 -- 172.21.15.149:0/3134902296 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3325976688 0 0) 0x7fc8880b2f60 con 0x7fc8880cc140 2023-11-08T19:27:22.414 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.409+0000 7fc87ffff700 1 -- 172.21.15.149:0/3134902296 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8740035b0 con 0x7fc8880cc140 2023-11-08T19:27:22.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.409+0000 7fc87ffff700 1 -- 172.21.15.149:0/3134902296 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 443898779 0 0) 0x7fc8880cc520 con 0x7fc8880cb130 2023-11-08T19:27:22.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.409+0000 7fc87ffff700 1 -- 172.21.15.149:0/3134902296 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8880b2f60 con 0x7fc8880cb130 2023-11-08T19:27:22.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.409+0000 7fc87ffff700 1 -- 172.21.15.149:0/3134902296 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3849843283 0 0) 0x7fc8740035b0 con 0x7fc8880cc140 2023-11-08T19:27:22.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.409+0000 7fc87ffff700 1 -- 172.21.15.149:0/3134902296 >> v2:172.21.15.160:3300/0 conn(0x7fc8880cc910 msgr2=0x7fc8880cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:22.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.409+0000 7fc87ffff700 1 --2- 172.21.15.149:0/3134902296 >> v2:172.21.15.160:3300/0 conn(0x7fc8880cc910 0x7fc8880cabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:22.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.409+0000 7fc87ffff700 1 -- 172.21.15.149:0/3134902296 >> v1:172.21.15.160:6789/0 conn(0x7fc8880cb130 legacy=0x7fc88815d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:22.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.409+0000 7fc87ffff700 1 -- 172.21.15.149:0/3134902296 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8880cb5e0 con 0x7fc8880cc140 2023-11-08T19:27:22.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.409+0000 7fc87ffff700 1 -- 172.21.15.149:0/3134902296 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7fc8780017f0 con 0x7fc8880cc140 2023-11-08T19:27:22.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.409+0000 7fc88c8d4700 1 --2- 172.21.15.149:0/3134902296 >> v2:172.21.15.160:3300/0 conn(0x7fc8880cc910 0x7fc8880cabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:27:22.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.409+0000 7fc87ffff700 1 -- 172.21.15.149:0/3134902296 >> v1:172.21.15.149:6789/0 conn(0x7fc8880cc140 legacy=0x7fc8880b2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:22.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.409+0000 7fc87ffff700 1 --2- 172.21.15.149:0/3134902296 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc874003b90 0x7fc874003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:22.417 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.409+0000 7fc87ffff700 1 --2- 172.21.15.149:0/3134902296 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc874004850 0x7fc874004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:22.417 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.409+0000 7fc87ffff700 1 --2- 172.21.15.149:0/3134902296 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc874005210 0x7fc87400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:22.417 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.409+0000 7fc87ffff700 1 -- 172.21.15.149:0/3134902296 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8880b2430 con 0x7fc874005210 2023-11-08T19:27:22.417 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.409+0000 7fc87ffff700 1 -- 172.21.15.149:0/3134902296 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc87400c090 con 0x7fc874004850 2023-11-08T19:27:22.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.409+0000 7fc87ffff700 1 -- 172.21.15.149:0/3134902296 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc87400c250 con 0x7fc874003b90 2023-11-08T19:27:22.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.409+0000 7fc88d8d6700 1 --2- 172.21.15.149:0/3134902296 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc874005210 0x7fc87400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:22.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.409+0000 7fc88d0d5700 1 --2- 172.21.15.149:0/3134902296 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc874003b90 0x7fc874003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:22.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.409+0000 7fc88c8d4700 1 --2- 172.21.15.149:0/3134902296 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc874004850 0x7fc874004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:22.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.409+0000 7fc88d8d6700 1 -- 172.21.15.149:0/3134902296 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc874003b90 msgr2=0x7fc874003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:22.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.409+0000 7fc88d8d6700 1 --2- 172.21.15.149:0/3134902296 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc874003b90 0x7fc874003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:22.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.409+0000 7fc88d8d6700 1 -- 172.21.15.149:0/3134902296 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc874004850 msgr2=0x7fc874004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:22.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.409+0000 7fc88d8d6700 1 --2- 172.21.15.149:0/3134902296 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc874004850 0x7fc874004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:22.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.409+0000 7fc88d8d6700 1 -- 172.21.15.149:0/3134902296 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8740035b0 con 0x7fc874005210 2023-11-08T19:27:22.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.410+0000 7fc88d8d6700 1 -- 172.21.15.149:0/3134902296 reap_dead start 2023-11-08T19:27:22.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.410+0000 7fc88d8d6700 1 --2- 172.21.15.149:0/3134902296 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc874005210 0x7fc87400ba10 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fc88000c2f0 tx=0x7fc874005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13d30fcb3c180950 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:22.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.410+0000 7fc87ffff700 1 -- 172.21.15.149:0/3134902296 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc880001f30 con 0x7fc874005210 2023-11-08T19:27:22.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.410+0000 7fc87ffff700 1 -- 172.21.15.149:0/3134902296 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc880003a00 con 0x7fc874005210 2023-11-08T19:27:22.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.410+0000 7fc87ffff700 1 -- 172.21.15.149:0/3134902296 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc880003db0 con 0x7fc874005210 2023-11-08T19:27:22.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.410+0000 7fc88f339700 1 -- 172.21.15.149:0/3134902296 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc874005210 msgr2=0x7fc87400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:22.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.410+0000 7fc88f339700 1 --2- 172.21.15.149:0/3134902296 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc874005210 0x7fc87400ba10 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fc88000c2f0 tx=0x7fc874005880 comp rx=0 tx=0).stop 2023-11-08T19:27:22.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.410+0000 7fc88f339700 1 -- 172.21.15.149:0/3134902296 shutdown_connections 2023-11-08T19:27:22.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.410+0000 7fc88f339700 1 --2- 172.21.15.149:0/3134902296 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc874005210 0x7fc87400ba10 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:22.422 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.410+0000 7fc88f339700 1 -- 172.21.15.149:0/3134902296 >> 172.21.15.149:0/3134902296 conn(0x7fc888099a40 msgr2=0x7fc8880d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:22.422 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.410+0000 7fc88f339700 1 -- 172.21.15.149:0/3134902296 shutdown_connections 2023-11-08T19:27:22.422 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.410+0000 7fc88f339700 1 -- 172.21.15.149:0/3134902296 wait complete. 2023-11-08T19:27:22.422 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.412+0000 7fc88f339700 1 Processor -- start 2023-11-08T19:27:22.422 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.412+0000 7fc88f339700 1 -- start start 2023-11-08T19:27:22.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.412+0000 7fc88f339700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc874005210 0x7fc8880c6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:22.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.412+0000 7fc88f339700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc8881f3570 0x7fc8881f39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:22.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.412+0000 7fc88f339700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8881f3f30 0x7fc8880b45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:22.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.412+0000 7fc88f339700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8881f43e0 con 0x7fc8881f3f30 2023-11-08T19:27:22.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.412+0000 7fc88f339700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8880c5620 con 0x7fc874005210 2023-11-08T19:27:22.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.412+0000 7fc88f339700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8880c5900 con 0x7fc8881f3570 2023-11-08T19:27:22.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.412+0000 7fc88d8d6700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8881f3f30 0x7fc8880b45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:22.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.412+0000 7fc88d8d6700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8881f3f30 0x7fc8880b45d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43892/0 (socket says 172.21.15.149:43892) 2023-11-08T19:27:22.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.412+0000 7fc88d8d6700 1 -- 172.21.15.149:0/707261437 learned_addr learned my addr 172.21.15.149:0/707261437 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:27:22.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.413+0000 7fc88c8d4700 1 --2- 172.21.15.149:0/707261437 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc8881f3570 0x7fc8881f39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:22.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.413+0000 7fc88d0d5700 1 --2- 172.21.15.149:0/707261437 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc874005210 0x7fc8880c6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:22.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.413+0000 7fc88d8d6700 1 -- 172.21.15.149:0/707261437 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc8881f3570 msgr2=0x7fc8881f39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:22.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.413+0000 7fc88d8d6700 1 --2- 172.21.15.149:0/707261437 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc8881f3570 0x7fc8881f39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:22.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.413+0000 7fc88d8d6700 1 -- 172.21.15.149:0/707261437 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc874005210 msgr2=0x7fc8880c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:22.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.413+0000 7fc88d8d6700 1 --2- 172.21.15.149:0/707261437 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc874005210 0x7fc8880c6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:22.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.413+0000 7fc88d8d6700 1 -- 172.21.15.149:0/707261437 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8880c5be0 con 0x7fc8881f3f30 2023-11-08T19:27:22.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.413+0000 7fc88c8d4700 1 --2- 172.21.15.149:0/707261437 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc8881f3570 0x7fc8881f39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:27:22.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.413+0000 7fc88d8d6700 1 --2- 172.21.15.149:0/707261437 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8881f3f30 0x7fc8880b45d0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fc888070850 tx=0x7fc880001650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:22.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.413+0000 7fc87dffb700 1 -- 172.21.15.149:0/707261437 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8800052d0 con 0x7fc8881f3f30 2023-11-08T19:27:22.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.413+0000 7fc87dffb700 1 -- 172.21.15.149:0/707261437 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc880005430 con 0x7fc8881f3f30 2023-11-08T19:27:22.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.413+0000 7fc88f339700 1 -- 172.21.15.149:0/707261437 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8880c5ec0 con 0x7fc8881f3f30 2023-11-08T19:27:22.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.413+0000 7fc87dffb700 1 -- 172.21.15.149:0/707261437 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8800057a0 con 0x7fc8881f3f30 2023-11-08T19:27:22.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.413+0000 7fc88f339700 1 -- 172.21.15.149:0/707261437 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc888155010 con 0x7fc8881f3f30 2023-11-08T19:27:22.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.414+0000 7fc88f339700 1 -- 172.21.15.149:0/707261437 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8880745f0 con 0x7fc8881f3f30 2023-11-08T19:27:22.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.415+0000 7fc87dffb700 1 -- 172.21.15.149:0/707261437 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc88001e470 con 0x7fc8881f3f30 2023-11-08T19:27:22.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.415+0000 7fc87dffb700 1 --2- 172.21.15.149:0/707261437 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc86c06af00 0x7fc86c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:22.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.415+0000 7fc87dffb700 1 -- 172.21.15.149:0/707261437 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7fc880003e40 con 0x7fc8881f3f30 2023-11-08T19:27:22.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.415+0000 7fc88d0d5700 1 --2- 172.21.15.149:0/707261437 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc86c06af00 0x7fc86c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:22.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.415+0000 7fc88d0d5700 1 --2- 172.21.15.149:0/707261437 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc86c06af00 0x7fc86c06d3c0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fc878000c00 tx=0x7fc878009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:22.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.420+0000 7fc87dffb700 1 -- 172.21.15.149:0/707261437 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc8800555e0 con 0x7fc8881f3f30 2023-11-08T19:27:22.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.654+0000 7fc88f339700 1 -- 172.21.15.149:0/707261437 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc8880b0d20 con 0x7fc8881f3f30 2023-11-08T19:27:22.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.654+0000 7fc87dffb700 1 -- 172.21.15.149:0/707261437 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4939 (secure 0 0 0) 0x7fc880058c00 con 0x7fc8881f3f30 2023-11-08T19:27:22.656 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:27:22.656 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":60,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6451,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/2947079163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2947079163},{"type":"v1","addr":"172.21.15.160:6834","nonce":2947079163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49},{"gid":7122,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/589971879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":589971879},{"type":"v1","addr":"172.21.15.149:6836","nonce":589971879}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:27:10.850431+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7140,"mds_1":7125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7125":{"gid":7125,"name":"c","rank":1,"incarnation":57,"state":"up:active","state_seq":6,"addr":"172.21.15.149:6837/3917392643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3917392643},{"type":"v1","addr":"172.21.15.149:6837","nonce":3917392643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7140":{"gid":7140,"name":"b","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.160:6835/2714564224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":2714564224},{"type":"v1","addr":"172.21.15.160:6835","nonce":2714564224}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:27:22.658 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.656+0000 7fc88f339700 1 -- 172.21.15.149:0/707261437 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc86c06af00 msgr2=0x7fc86c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:22.658 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.656+0000 7fc88f339700 1 --2- 172.21.15.149:0/707261437 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc86c06af00 0x7fc86c06d3c0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fc878000c00 tx=0x7fc878009040 comp rx=0 tx=0).stop 2023-11-08T19:27:22.658 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.656+0000 7fc88f339700 1 -- 172.21.15.149:0/707261437 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8881f3f30 msgr2=0x7fc8880b45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:22.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.656+0000 7fc88f339700 1 --2- 172.21.15.149:0/707261437 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8881f3f30 0x7fc8880b45d0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fc888070850 tx=0x7fc880001650 comp rx=0 tx=0).stop 2023-11-08T19:27:22.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.657+0000 7fc88f339700 1 -- 172.21.15.149:0/707261437 shutdown_connections 2023-11-08T19:27:22.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.657+0000 7fc88f339700 1 --2- 172.21.15.149:0/707261437 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc86c06af00 0x7fc86c06d3c0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:22.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.657+0000 7fc88f339700 1 --2- 172.21.15.149:0/707261437 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc874005210 0x7fc8880c6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:22.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.657+0000 7fc88f339700 1 --2- 172.21.15.149:0/707261437 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8881f3f30 0x7fc8880b45d0 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:22.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.657+0000 7fc88f339700 1 --2- 172.21.15.149:0/707261437 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc8881f3570 0x7fc8881f39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:22.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.657+0000 7fc88f339700 1 -- 172.21.15.149:0/707261437 >> 172.21.15.149:0/707261437 conn(0x7fc888099a40 msgr2=0x7fc88806f890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:22.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.657+0000 7fc88f339700 1 -- 172.21.15.149:0/707261437 shutdown_connections 2023-11-08T19:27:22.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:22.657+0000 7fc88f339700 1 -- 172.21.15.149:0/707261437 wait complete. 2023-11-08T19:27:22.661 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 60 2023-11-08T19:27:22.670 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-08T19:27:25.092 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~7s 2023-11-08T19:27:27.671 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:27:27.800 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:27.799+0000 7f912a1a0700 1 Processor -- start 2023-11-08T19:27:27.801 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:27.799+0000 7f912a1a0700 1 -- start start 2023-11-08T19:27:27.806 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:27.800+0000 7f912a1a0700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f912406ab80 0x7f912406df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:27.806 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:27.800+0000 7f912a1a0700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9124161570 con 0x7f91240b1e70 2023-11-08T19:27:27.807 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:27.800+0000 7f912a1a0700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f912406e4b0 con 0x7f912415dae0 2023-11-08T19:27:27.807 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:27.800+0000 7f912a1a0700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f912406eba0 con 0x7f912406ab80 2023-11-08T19:27:27.807 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:27.800+0000 7f912999f700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f91240b1e70 0x7f91240caa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:45904/0 (socket says 172.21.15.149:45904) 2023-11-08T19:27:27.807 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:27.800+0000 7f912999f700 1 -- 172.21.15.149:0/12458864 learned_addr learned my addr 172.21.15.149:0/12458864 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:27:27.808 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:27.800+0000 7f912919e700 1 --2- 172.21.15.149:0/12458864 >> v2:172.21.15.160:3300/0 conn(0x7f912406ab80 0x7f912406df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:27.808 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:27.801+0000 7f911bfff700 1 -- 172.21.15.149:0/12458864 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2377473268 0 0) 0x7f9124161570 con 0x7f91240b1e70 2023-11-08T19:27:27.808 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:27.801+0000 7f911bfff700 1 -- 172.21.15.149:0/12458864 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91100035b0 con 0x7f91240b1e70 2023-11-08T19:27:27.808 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:27.801+0000 7f911bfff700 1 -- 172.21.15.149:0/12458864 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 547792772 0 0) 0x7f912406e4b0 con 0x7f912415dae0 2023-11-08T19:27:27.808 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:27.801+0000 7f911bfff700 1 -- 172.21.15.149:0/12458864 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9124161570 con 0x7f912415dae0 2023-11-08T19:27:27.809 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:27.801+0000 7f912919e700 1 -- 172.21.15.149:0/12458864 >> v1:172.21.15.160:6789/0 conn(0x7f912415dae0 legacy=0x7f912406af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:27.809 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:27.801+0000 7f912919e700 1 -- 172.21.15.149:0/12458864 >> v1:172.21.15.149:6789/0 conn(0x7f91240b1e70 legacy=0x7f91240caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:27.809 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:27.801+0000 7f911bfff700 1 -- 172.21.15.149:0/12458864 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1825195521 0 0) 0x7f91100035b0 con 0x7f91240b1e70 2023-11-08T19:27:27.809 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:27.801+0000 7f912919e700 1 -- 172.21.15.149:0/12458864 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91240b23e0 con 0x7f912406ab80 2023-11-08T19:27:27.809 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:27.801+0000 7f912919e700 1 --2- 172.21.15.149:0/12458864 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f912406ab80 0x7f912406df70 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f9114009840 tx=0x7f9114009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c26f50012a20fb38 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:27.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:27.801+0000 7f911bfff700 1 -- 172.21.15.149:0/12458864 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911c0019f0 con 0x7f912406ab80 2023-11-08T19:27:27.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:27.801+0000 7f911bfff700 1 -- 172.21.15.149:0/12458864 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9114004030 con 0x7f912406ab80 2023-11-08T19:27:27.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:27.801+0000 7f911bfff700 1 -- 172.21.15.149:0/12458864 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91140043a0 con 0x7f912406ab80 2023-11-08T19:27:27.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:27.802+0000 7f912a1a0700 1 -- 172.21.15.149:0/12458864 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f912406ab80 msgr2=0x7f912406df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:27.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:27.802+0000 7f912a1a0700 1 --2- 172.21.15.149:0/12458864 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f912406ab80 0x7f912406df70 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f9114009840 tx=0x7f9114009b50 comp rx=0 tx=0).stop 2023-11-08T19:27:27.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:27.802+0000 7f912a1a0700 1 -- 172.21.15.149:0/12458864 shutdown_connections 2023-11-08T19:27:27.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:27.802+0000 7f912a1a0700 1 --2- 172.21.15.149:0/12458864 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f912406ab80 0x7f912406df70 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:27.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:27.802+0000 7f912a1a0700 1 -- 172.21.15.149:0/12458864 >> 172.21.15.149:0/12458864 conn(0x7f91240cce70 msgr2=0x7f91240cd280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:27.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:27.802+0000 7f912a1a0700 1 -- 172.21.15.149:0/12458864 shutdown_connections 2023-11-08T19:27:27.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:27.802+0000 7f912a1a0700 1 -- 172.21.15.149:0/12458864 wait complete. 2023-11-08T19:27:27.812 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:27.803+0000 7f912a1a0700 1 Processor -- start 2023-11-08T19:27:27.812 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:27.803+0000 7f912a1a0700 1 -- start start 2023-11-08T19:27:27.812 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:27.804+0000 7f912a1a0700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f912406ab80 0x7f91240c9b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:27.812 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:27.804+0000 7f912a1a0700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91240b1e70 0x7f9124160870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:27.812 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:27.804+0000 7f912a1a0700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f912415dae0 0x7f9124160db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:27.813 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:27.804+0000 7f912a1a0700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91240b4150 con 0x7f912415dae0 2023-11-08T19:27:27.813 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:27.804+0000 7f912a1a0700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91240ca600 con 0x7f91240b1e70 2023-11-08T19:27:27.813 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:27.804+0000 7f912a1a0700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91240b43a0 con 0x7f912406ab80 2023-11-08T19:27:27.813 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:27.804+0000 7f912999f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f912415dae0 0x7f9124160db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:27.813 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:27.804+0000 7f912999f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f912415dae0 0x7f9124160db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43908/0 (socket says 172.21.15.149:43908) 2023-11-08T19:27:27.814 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:27.804+0000 7f912999f700 1 -- 172.21.15.149:0/314512297 learned_addr learned my addr 172.21.15.149:0/314512297 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:27:27.814 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:27.804+0000 7f912919e700 1 --2- 172.21.15.149:0/314512297 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f912406ab80 0x7f91240c9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:27.814 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:27.804+0000 7f912999f700 1 -- 172.21.15.149:0/314512297 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f912406ab80 msgr2=0x7f91240c9b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:27.814 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:27.804+0000 7f912999f700 1 --2- 172.21.15.149:0/314512297 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f912406ab80 0x7f91240c9b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:27.814 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:27.804+0000 7f912999f700 1 -- 172.21.15.149:0/314512297 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91240b1e70 msgr2=0x7f9124160870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:27.815 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:27.804+0000 7f912899d700 1 --2- 172.21.15.149:0/314512297 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91240b1e70 0x7f9124160870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:27.815 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:27.804+0000 7f912999f700 1 --2- 172.21.15.149:0/314512297 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91240b1e70 0x7f9124160870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:27.815 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:27.804+0000 7f912999f700 1 -- 172.21.15.149:0/314512297 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91140094a0 con 0x7f912415dae0 2023-11-08T19:27:27.815 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:27.804+0000 7f912919e700 1 --2- 172.21.15.149:0/314512297 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f912406ab80 0x7f91240c9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:27:27.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:27.804+0000 7f912899d700 1 --2- 172.21.15.149:0/314512297 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91240b1e70 0x7f9124160870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:27:27.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:27.804+0000 7f912999f700 1 --2- 172.21.15.149:0/314512297 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f912415dae0 0x7f9124160db0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f911c00cc70 tx=0x7f911c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:27.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:27.804+0000 7f9119ffb700 1 -- 172.21.15.149:0/314512297 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911c00ade0 con 0x7f912415dae0 2023-11-08T19:27:27.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:27.805+0000 7f9119ffb700 1 -- 172.21.15.149:0/314512297 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f911c00ce70 con 0x7f912415dae0 2023-11-08T19:27:27.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:27.805+0000 7f912a1a0700 1 -- 172.21.15.149:0/314512297 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91240b4680 con 0x7f912415dae0 2023-11-08T19:27:27.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:27.805+0000 7f9119ffb700 1 -- 172.21.15.149:0/314512297 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911c0072f0 con 0x7f912415dae0 2023-11-08T19:27:27.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:27.805+0000 7f912a1a0700 1 -- 172.21.15.149:0/314512297 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91240c7db0 con 0x7f912415dae0 2023-11-08T19:27:27.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:27.806+0000 7f912a1a0700 1 -- 172.21.15.149:0/314512297 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91240b4ba0 con 0x7f912415dae0 2023-11-08T19:27:27.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:27.806+0000 7f9119ffb700 1 -- 172.21.15.149:0/314512297 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f911c007450 con 0x7f912415dae0 2023-11-08T19:27:27.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:27.806+0000 7f9119ffb700 1 --2- 172.21.15.149:0/314512297 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f910806af00 0x7f910806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:27.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:27.806+0000 7f9119ffb700 1 -- 172.21.15.149:0/314512297 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f911c089790 con 0x7f912415dae0 2023-11-08T19:27:27.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:27.806+0000 7f912919e700 1 --2- 172.21.15.149:0/314512297 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f910806af00 0x7f910806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:27.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:27.807+0000 7f912919e700 1 --2- 172.21.15.149:0/314512297 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f910806af00 0x7f910806d3c0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f911400a010 tx=0x7f9114008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:27.820 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:27.811+0000 7f9119ffb700 1 -- 172.21.15.149:0/314512297 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f911c0542d0 con 0x7f912415dae0 2023-11-08T19:27:28.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:28.044+0000 7f912a1a0700 1 -- 172.21.15.149:0/314512297 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f912404f730 con 0x7f912415dae0 2023-11-08T19:27:28.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:28.044+0000 7f9119ffb700 1 -- 172.21.15.149:0/314512297 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4939 (secure 0 0 0) 0x7f911c0578f0 con 0x7f912415dae0 2023-11-08T19:27:28.046 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:27:28.046 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":60,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6451,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/2947079163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2947079163},{"type":"v1","addr":"172.21.15.160:6834","nonce":2947079163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49},{"gid":7122,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/589971879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":589971879},{"type":"v1","addr":"172.21.15.149:6836","nonce":589971879}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:27:10.850431+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7140,"mds_1":7125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7125":{"gid":7125,"name":"c","rank":1,"incarnation":57,"state":"up:active","state_seq":6,"addr":"172.21.15.149:6837/3917392643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3917392643},{"type":"v1","addr":"172.21.15.149:6837","nonce":3917392643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7140":{"gid":7140,"name":"b","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.160:6835/2714564224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":2714564224},{"type":"v1","addr":"172.21.15.160:6835","nonce":2714564224}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:27:28.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:28.046+0000 7f912a1a0700 1 -- 172.21.15.149:0/314512297 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f910806af00 msgr2=0x7f910806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:28.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:28.046+0000 7f912a1a0700 1 --2- 172.21.15.149:0/314512297 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f910806af00 0x7f910806d3c0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f911400a010 tx=0x7f9114008030 comp rx=0 tx=0).stop 2023-11-08T19:27:28.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:28.046+0000 7f912a1a0700 1 -- 172.21.15.149:0/314512297 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f912415dae0 msgr2=0x7f9124160db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:28.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:28.046+0000 7f912a1a0700 1 --2- 172.21.15.149:0/314512297 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f912415dae0 0x7f9124160db0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f911c00cc70 tx=0x7f911c00a340 comp rx=0 tx=0).stop 2023-11-08T19:27:28.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:28.046+0000 7f912a1a0700 1 -- 172.21.15.149:0/314512297 shutdown_connections 2023-11-08T19:27:28.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:28.047+0000 7f912a1a0700 1 --2- 172.21.15.149:0/314512297 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f910806af00 0x7f910806d3c0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:28.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:28.047+0000 7f912a1a0700 1 --2- 172.21.15.149:0/314512297 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f912415dae0 0x7f9124160db0 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:28.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:28.047+0000 7f912a1a0700 1 --2- 172.21.15.149:0/314512297 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f912406ab80 0x7f91240c9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:28.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:28.047+0000 7f912a1a0700 1 --2- 172.21.15.149:0/314512297 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91240b1e70 0x7f9124160870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:28.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:28.047+0000 7f912a1a0700 1 -- 172.21.15.149:0/314512297 >> 172.21.15.149:0/314512297 conn(0x7f91240cce70 msgr2=0x7f9124155ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:28.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:28.047+0000 7f912a1a0700 1 -- 172.21.15.149:0/314512297 shutdown_connections 2023-11-08T19:27:28.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:28.047+0000 7f912a1a0700 1 -- 172.21.15.149:0/314512297 wait complete. 2023-11-08T19:27:28.052 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 60 2023-11-08T19:27:28.060 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-08T19:27:31.704 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~13s 2023-11-08T19:27:33.062 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:27:33.196 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.195+0000 7fa166f8a700 1 Processor -- start 2023-11-08T19:27:33.196 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.195+0000 7fa166f8a700 1 -- start start 2023-11-08T19:27:33.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.195+0000 7fa166f8a700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa16015db70 0x7fa160161dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:33.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.196+0000 7fa166f8a700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fa1600b2c00 0x7fa16015df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:33.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.196+0000 7fa166f8a700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa16006ab80 0x7fa16006b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:33.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.196+0000 7fa166f8a700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa16006b570 con 0x7fa16006ab80 2023-11-08T19:27:33.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.196+0000 7fa166f8a700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa160161940 con 0x7fa1600b2c00 2023-11-08T19:27:33.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.196+0000 7fa166f8a700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa16015eeb0 con 0x7fa16015db70 2023-11-08T19:27:33.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.196+0000 7fa165527700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa16006ab80 0x7fa16006b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:33.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.196+0000 7fa165527700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa16006ab80 0x7fa16006b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43918/0 (socket says 172.21.15.149:43918) 2023-11-08T19:27:33.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.196+0000 7fa165527700 1 -- 172.21.15.149:0/422565225 learned_addr learned my addr 172.21.15.149:0/422565225 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:27:33.202 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.196+0000 7fa15ffff700 1 --2- 172.21.15.149:0/422565225 >> v2:172.21.15.160:3300/0 conn(0x7fa1600b2c00 0x7fa16015df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:33.202 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.196+0000 7fa164d26700 1 --2- 172.21.15.149:0/422565225 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa16015db70 0x7fa160161dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:33.202 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.196+0000 7fa165527700 1 -- 172.21.15.149:0/422565225 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa16015db70 msgr2=0x7fa160161dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:33.202 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.196+0000 7fa165527700 1 --2- 172.21.15.149:0/422565225 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa16015db70 0x7fa160161dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:33.202 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.196+0000 7fa165527700 1 -- 172.21.15.149:0/422565225 >> v2:172.21.15.160:3300/0 conn(0x7fa1600b2c00 msgr2=0x7fa16015df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:33.203 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.196+0000 7fa165527700 1 --2- 172.21.15.149:0/422565225 >> v2:172.21.15.160:3300/0 conn(0x7fa1600b2c00 0x7fa16015df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:33.203 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.196+0000 7fa165527700 1 -- 172.21.15.149:0/422565225 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa16015e8f0 con 0x7fa16006ab80 2023-11-08T19:27:33.203 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.196+0000 7fa164d26700 1 --2- 172.21.15.149:0/422565225 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa16015db70 0x7fa160161dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:27:33.203 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.196+0000 7fa15ffff700 1 --2- 172.21.15.149:0/422565225 >> v2:172.21.15.160:3300/0 conn(0x7fa1600b2c00 0x7fa16015df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:27:33.203 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.196+0000 7fa165527700 1 --2- 172.21.15.149:0/422565225 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa16006ab80 0x7fa16006b030 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7fa160070a70 tx=0x7fa15800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4625738970f410cc server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:33.204 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.196+0000 7fa15f7fe700 1 -- 172.21.15.149:0/422565225 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15800e070 con 0x7fa16006ab80 2023-11-08T19:27:33.204 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.196+0000 7fa15f7fe700 1 -- 172.21.15.149:0/422565225 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa15800b9c0 con 0x7fa16006ab80 2023-11-08T19:27:33.204 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.196+0000 7fa15f7fe700 1 -- 172.21.15.149:0/422565225 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15800bd70 con 0x7fa16006ab80 2023-11-08T19:27:33.204 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.197+0000 7fa166f8a700 1 -- 172.21.15.149:0/422565225 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa16006ab80 msgr2=0x7fa16006b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:33.204 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.197+0000 7fa166f8a700 1 --2- 172.21.15.149:0/422565225 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa16006ab80 0x7fa16006b030 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7fa160070a70 tx=0x7fa15800b330 comp rx=0 tx=0).stop 2023-11-08T19:27:33.205 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.197+0000 7fa166f8a700 1 -- 172.21.15.149:0/422565225 shutdown_connections 2023-11-08T19:27:33.205 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.197+0000 7fa166f8a700 1 --2- 172.21.15.149:0/422565225 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa16006ab80 0x7fa16006b030 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:33.205 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.197+0000 7fa166f8a700 1 --2- 172.21.15.149:0/422565225 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa16015db70 0x7fa160161dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:33.205 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.197+0000 7fa166f8a700 1 --2- 172.21.15.149:0/422565225 >> v2:172.21.15.160:3300/0 conn(0x7fa1600b2c00 0x7fa16015df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:33.205 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.197+0000 7fa166f8a700 1 -- 172.21.15.149:0/422565225 >> 172.21.15.149:0/422565225 conn(0x7fa1600ccff0 msgr2=0x7fa1600cd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:33.206 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.197+0000 7fa166f8a700 1 -- 172.21.15.149:0/422565225 shutdown_connections 2023-11-08T19:27:33.206 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.197+0000 7fa166f8a700 1 -- 172.21.15.149:0/422565225 wait complete. 2023-11-08T19:27:33.206 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.198+0000 7fa166f8a700 1 Processor -- start 2023-11-08T19:27:33.206 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.198+0000 7fa166f8a700 1 -- start start 2023-11-08T19:27:33.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.199+0000 7fa166f8a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa16006ab80 0x7fa1600b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:33.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.199+0000 7fa166f8a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa1600b2c00 0x7fa1600b44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:33.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.199+0000 7fa166f8a700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa16015db70 0x7fa16015b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:33.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.199+0000 7fa166f8a700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1600c6d90 con 0x7fa16006ab80 2023-11-08T19:27:33.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.199+0000 7fa166f8a700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1600b60c0 con 0x7fa1600b2c00 2023-11-08T19:27:33.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.199+0000 7fa166f8a700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1600c67d0 con 0x7fa16015db70 2023-11-08T19:27:33.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.199+0000 7fa164d26700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa16006ab80 0x7fa1600b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:33.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.199+0000 7fa164d26700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa16006ab80 0x7fa1600b5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43920/0 (socket says 172.21.15.149:43920) 2023-11-08T19:27:33.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.199+0000 7fa164d26700 1 -- 172.21.15.149:0/3019506331 learned_addr learned my addr 172.21.15.149:0/3019506331 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:27:33.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.199+0000 7fa15ffff700 1 --2- 172.21.15.149:0/3019506331 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa1600b2c00 0x7fa1600b44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:33.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.199+0000 7fa165527700 1 --2- 172.21.15.149:0/3019506331 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa16015db70 0x7fa16015b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:33.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.200+0000 7fa164d26700 1 -- 172.21.15.149:0/3019506331 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa16015db70 msgr2=0x7fa16015b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:33.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.200+0000 7fa164d26700 1 --2- 172.21.15.149:0/3019506331 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa16015db70 0x7fa16015b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:33.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.200+0000 7fa164d26700 1 -- 172.21.15.149:0/3019506331 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa1600b2c00 msgr2=0x7fa1600b44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:33.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.200+0000 7fa164d26700 1 --2- 172.21.15.149:0/3019506331 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa1600b2c00 0x7fa1600b44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:33.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.200+0000 7fa164d26700 1 -- 172.21.15.149:0/3019506331 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa158009b30 con 0x7fa16006ab80 2023-11-08T19:27:33.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.200+0000 7fa164d26700 1 --2- 172.21.15.149:0/3019506331 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa16006ab80 0x7fa1600b5b80 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7fa15400e810 tx=0x7fa15400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:33.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.200+0000 7fa15d7fa700 1 -- 172.21.15.149:0/3019506331 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15400c020 con 0x7fa16006ab80 2023-11-08T19:27:33.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.200+0000 7fa15d7fa700 1 -- 172.21.15.149:0/3019506331 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa154004250 con 0x7fa16006ab80 2023-11-08T19:27:33.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.200+0000 7fa166f8a700 1 -- 172.21.15.149:0/3019506331 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1600c6ab0 con 0x7fa16006ab80 2023-11-08T19:27:33.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.200+0000 7fa15d7fa700 1 -- 172.21.15.149:0/3019506331 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1540036a0 con 0x7fa16006ab80 2023-11-08T19:27:33.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.200+0000 7fa166f8a700 1 -- 172.21.15.149:0/3019506331 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1600b3fb0 con 0x7fa16006ab80 2023-11-08T19:27:33.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.201+0000 7fa166f8a700 1 -- 172.21.15.149:0/3019506331 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1600745f0 con 0x7fa16006ab80 2023-11-08T19:27:33.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.206+0000 7fa15d7fa700 1 -- 172.21.15.149:0/3019506331 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa154003800 con 0x7fa16006ab80 2023-11-08T19:27:33.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.206+0000 7fa15d7fa700 1 --2- 172.21.15.149:0/3019506331 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa14406af00 0x7fa14406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:33.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.206+0000 7fa15d7fa700 1 -- 172.21.15.149:0/3019506331 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7fa154089c90 con 0x7fa16006ab80 2023-11-08T19:27:33.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.206+0000 7fa15ffff700 1 --2- 172.21.15.149:0/3019506331 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa14406af00 0x7fa14406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:33.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.207+0000 7fa15ffff700 1 --2- 172.21.15.149:0/3019506331 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa14406af00 0x7fa14406d3c0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fa1601f6ce0 tx=0x7fa14c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:33.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.210+0000 7fa15d7fa700 1 -- 172.21.15.149:0/3019506331 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa154054850 con 0x7fa16006ab80 2023-11-08T19:27:33.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.441+0000 7fa166f8a700 1 -- 172.21.15.149:0/3019506331 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa1600b64f0 con 0x7fa16006ab80 2023-11-08T19:27:33.443 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.442+0000 7fa15d7fa700 1 -- 172.21.15.149:0/3019506331 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) v1 ==== 94+0+4987 (secure 0 0 0) 0x7fa154057e70 con 0x7fa16006ab80 2023-11-08T19:27:33.443 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:27:33.444 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":61,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6451,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/2947079163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2947079163},{"type":"v1","addr":"172.21.15.160:6834","nonce":2947079163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49},{"gid":7122,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/589971879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":589971879},{"type":"v1","addr":"172.21.15.149:6836","nonce":589971879}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:27:29.131854+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7140,"mds_1":7125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7125":{"gid":7125,"name":"c","rank":1,"incarnation":57,"state":"up:active","state_seq":6,"addr":"172.21.15.149:6837/3917392643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3917392643},{"type":"v1","addr":"172.21.15.149:6837","nonce":3917392643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7140":{"gid":7140,"name":"b","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.160:6835/2714564224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":2714564224},{"type":"v1","addr":"172.21.15.160:6835","nonce":2714564224}]},"join_fscid":-1,"laggy_since":"2023-11-08T19:27:29.131854+0000","export_targets":[1],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:27:33.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.444+0000 7fa166f8a700 1 -- 172.21.15.149:0/3019506331 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa14406af00 msgr2=0x7fa14406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:33.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.444+0000 7fa166f8a700 1 --2- 172.21.15.149:0/3019506331 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa14406af00 0x7fa14406d3c0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fa1601f6ce0 tx=0x7fa14c008040 comp rx=0 tx=0).stop 2023-11-08T19:27:33.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.444+0000 7fa166f8a700 1 -- 172.21.15.149:0/3019506331 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa16006ab80 msgr2=0x7fa1600b5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:33.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.444+0000 7fa166f8a700 1 --2- 172.21.15.149:0/3019506331 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa16006ab80 0x7fa1600b5b80 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7fa15400e810 tx=0x7fa15400eb20 comp rx=0 tx=0).stop 2023-11-08T19:27:33.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.444+0000 7fa166f8a700 1 -- 172.21.15.149:0/3019506331 shutdown_connections 2023-11-08T19:27:33.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.444+0000 7fa166f8a700 1 --2- 172.21.15.149:0/3019506331 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa14406af00 0x7fa14406d3c0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:33.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.444+0000 7fa166f8a700 1 --2- 172.21.15.149:0/3019506331 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa16015db70 0x7fa16015b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:33.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.444+0000 7fa166f8a700 1 --2- 172.21.15.149:0/3019506331 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa16006ab80 0x7fa1600b5b80 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:33.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.444+0000 7fa166f8a700 1 --2- 172.21.15.149:0/3019506331 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa1600b2c00 0x7fa1600b44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:33.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.444+0000 7fa166f8a700 1 -- 172.21.15.149:0/3019506331 >> 172.21.15.149:0/3019506331 conn(0x7fa1600ccff0 msgr2=0x7fa16006ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:33.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.444+0000 7fa166f8a700 1 -- 172.21.15.149:0/3019506331 shutdown_connections 2023-11-08T19:27:33.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.444+0000 7fa166f8a700 1 -- 172.21.15.149:0/3019506331 wait complete. 2023-11-08T19:27:33.448 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 61 2023-11-08T19:27:33.457 DEBUG:tasks.ceph_test_case:wait_until_true: success in 20s and 0 retries 2023-11-08T19:27:33.458 DEBUG:teuthology.orchestra.run.smithi160:> sudo sysctl -n kernel.core_pattern 2023-11-08T19:27:33.490 INFO:teuthology.orchestra.run.smithi160.stdout:/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-08T19:27:33.492 INFO:tasks.cephfs.cephfs_test_case:Clearing core from directory: /home/ubuntu/cephtest/archive/coredump 2023-11-08T19:27:33.492 DEBUG:teuthology.orchestra.run.smithi160:> cd /home/ubuntu/cephtest/archive/coredump && sudo ls | sudo xargs file 2023-11-08T19:27:33.566 INFO:teuthology.orchestra.run.smithi160.stdout:1699471631.113321.core: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i b', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/bin/ceph-mds', platform: 'x86_64' 2023-11-08T19:27:33.568 INFO:tasks.cephfs.cephfs_test_case:Enumerated cores: ['1699471631.113321.core'] 2023-11-08T19:27:33.569 INFO:tasks.cephfs.cephfs_test_case:Found core file 1699471631.113321.core, deleting it 2023-11-08T19:27:33.569 DEBUG:teuthology.orchestra.run.smithi160:> cd /home/ubuntu/cephtest/archive/coredump && sudo rm -f 1699471631.113321.core 2023-11-08T19:27:33.641 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 6:0 2023-11-08T19:27:33.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.763+0000 7fd08c564700 1 Processor -- start 2023-11-08T19:27:33.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.763+0000 7fd08c564700 1 -- start start 2023-11-08T19:27:33.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.764+0000 7fd08c564700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd08415b950 0x7fd0840ce130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:33.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.764+0000 7fd08c564700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0840cc2e0 con 0x7fd0840cd5e0 2023-11-08T19:27:33.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.764+0000 7fd08c564700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0840cc580 con 0x7fd0840d0430 2023-11-08T19:27:33.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.764+0000 7fd08c564700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0840cc820 con 0x7fd08415b950 2023-11-08T19:27:33.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.764+0000 7fd08a300700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd08415b950 0x7fd0840ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:33.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.764+0000 7fd089aff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fd0840cd5e0 0x7fd0840cfd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:45930/0 (socket says 172.21.15.149:45930) 2023-11-08T19:27:33.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.764+0000 7fd089aff700 1 -- 172.21.15.149:0/1193992953 learned_addr learned my addr 172.21.15.149:0/1193992953 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:27:33.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.764+0000 7fd08a300700 1 -- 172.21.15.149:0/1193992953 >> v1:172.21.15.160:6789/0 conn(0x7fd0840d0430 legacy=0x7fd0841658e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:33.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.764+0000 7fd08a300700 1 -- 172.21.15.149:0/1193992953 >> v1:172.21.15.149:6789/0 conn(0x7fd0840cd5e0 legacy=0x7fd0840cfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:33.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.764+0000 7fd0892fe700 1 -- 172.21.15.149:0/1193992953 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2816524741 0 0) 0x7fd0840cc2e0 con 0x7fd0840cd5e0 2023-11-08T19:27:33.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.764+0000 7fd08a300700 1 -- 172.21.15.149:0/1193992953 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0840ccb00 con 0x7fd08415b950 2023-11-08T19:27:33.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.764+0000 7fd08a300700 1 --2- 172.21.15.149:0/1193992953 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd08415b950 0x7fd0840ce130 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fd080009820 tx=0x7fd080009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b6714d96b791a32 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:33.770 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.764+0000 7fd0892fe700 1 -- 172.21.15.149:0/1193992953 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd080005e30 con 0x7fd08415b950 2023-11-08T19:27:33.770 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.764+0000 7fd0892fe700 1 -- 172.21.15.149:0/1193992953 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd080006030 con 0x7fd08415b950 2023-11-08T19:27:33.770 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.764+0000 7fd0892fe700 1 -- 172.21.15.149:0/1193992953 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0800063e0 con 0x7fd08415b950 2023-11-08T19:27:33.770 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.765+0000 7fd08c564700 1 -- 172.21.15.149:0/1193992953 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd08415b950 msgr2=0x7fd0840ce130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:33.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.765+0000 7fd08c564700 1 --2- 172.21.15.149:0/1193992953 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd08415b950 0x7fd0840ce130 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fd080009820 tx=0x7fd080009b30 comp rx=0 tx=0).stop 2023-11-08T19:27:33.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.765+0000 7fd08c564700 1 -- 172.21.15.149:0/1193992953 shutdown_connections 2023-11-08T19:27:33.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.765+0000 7fd08c564700 1 --2- 172.21.15.149:0/1193992953 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd08415b950 0x7fd0840ce130 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:33.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.765+0000 7fd08c564700 1 -- 172.21.15.149:0/1193992953 >> 172.21.15.149:0/1193992953 conn(0x7fd08408afd0 msgr2=0x7fd0840d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:33.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.765+0000 7fd08c564700 1 -- 172.21.15.149:0/1193992953 shutdown_connections 2023-11-08T19:27:33.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.765+0000 7fd08c564700 1 -- 172.21.15.149:0/1193992953 wait complete. 2023-11-08T19:27:33.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.766+0000 7fd08c564700 1 Processor -- start 2023-11-08T19:27:33.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.766+0000 7fd08c564700 1 -- start start 2023-11-08T19:27:33.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.767+0000 7fd08c564700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd0840d0430 0x7fd08414f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:33.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.767+0000 7fd08c564700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd08415b950 0x7fd0840b2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:33.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.767+0000 7fd08c564700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd08414c2a0 0x7fd0840b0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:33.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.767+0000 7fd08c564700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0840b3ff0 con 0x7fd08415b950 2023-11-08T19:27:33.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.767+0000 7fd08c564700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0840b3750 con 0x7fd0840d0430 2023-11-08T19:27:33.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.767+0000 7fd08c564700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0840b3a30 con 0x7fd08414c2a0 2023-11-08T19:27:33.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.767+0000 7fd089aff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd08415b950 0x7fd0840b2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:33.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.767+0000 7fd089aff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd08415b950 0x7fd0840b2ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43932/0 (socket says 172.21.15.149:43932) 2023-11-08T19:27:33.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.767+0000 7fd089aff700 1 -- 172.21.15.149:0/990218234 learned_addr learned my addr 172.21.15.149:0/990218234 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:27:33.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.767+0000 7fd08a300700 1 --2- 172.21.15.149:0/990218234 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd0840d0430 0x7fd08414f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:33.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.767+0000 7fd08ab01700 1 --2- 172.21.15.149:0/990218234 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd08414c2a0 0x7fd0840b0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:33.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.767+0000 7fd089aff700 1 -- 172.21.15.149:0/990218234 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd08414c2a0 msgr2=0x7fd0840b0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:33.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.767+0000 7fd089aff700 1 --2- 172.21.15.149:0/990218234 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd08414c2a0 0x7fd0840b0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:33.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.767+0000 7fd089aff700 1 -- 172.21.15.149:0/990218234 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd0840d0430 msgr2=0x7fd08414f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:33.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.767+0000 7fd089aff700 1 --2- 172.21.15.149:0/990218234 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd0840d0430 0x7fd08414f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:33.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.767+0000 7fd089aff700 1 -- 172.21.15.149:0/990218234 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd080009430 con 0x7fd08415b950 2023-11-08T19:27:33.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.767+0000 7fd08ab01700 1 --2- 172.21.15.149:0/990218234 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd08414c2a0 0x7fd0840b0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:27:33.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.768+0000 7fd089aff700 1 --2- 172.21.15.149:0/990218234 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd08415b950 0x7fd0840b2ee0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fd07400c520 tx=0x7fd07400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:33.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.768+0000 7fd07affd700 1 -- 172.21.15.149:0/990218234 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd074004c80 con 0x7fd08415b950 2023-11-08T19:27:33.779 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.768+0000 7fd07affd700 1 -- 172.21.15.149:0/990218234 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd074004de0 con 0x7fd08415b950 2023-11-08T19:27:33.779 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.768+0000 7fd08c564700 1 -- 172.21.15.149:0/990218234 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0840b3d10 con 0x7fd08415b950 2023-11-08T19:27:33.779 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.768+0000 7fd07affd700 1 -- 172.21.15.149:0/990218234 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd074007310 con 0x7fd08415b950 2023-11-08T19:27:33.779 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.768+0000 7fd08c564700 1 -- 172.21.15.149:0/990218234 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0840b3420 con 0x7fd08415b950 2023-11-08T19:27:33.779 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.769+0000 7fd08c564700 1 -- 172.21.15.149:0/990218234 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd08406bf70 con 0x7fd08415b950 2023-11-08T19:27:33.780 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.769+0000 7fd07affd700 1 -- 172.21.15.149:0/990218234 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd074007470 con 0x7fd08415b950 2023-11-08T19:27:33.780 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.770+0000 7fd07affd700 1 --2- 172.21.15.149:0/990218234 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd06806af00 0x7fd06806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:33.780 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.770+0000 7fd08a300700 1 --2- 172.21.15.149:0/990218234 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd06806af00 0x7fd06806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:33.780 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.770+0000 7fd07affd700 1 -- 172.21.15.149:0/990218234 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7fd074089740 con 0x7fd08415b950 2023-11-08T19:27:33.780 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.770+0000 7fd08a300700 1 --2- 172.21.15.149:0/990218234 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd06806af00 0x7fd06806d3c0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fd080013040 tx=0x7fd080008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:33.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:33.774+0000 7fd07affd700 1 -- 172.21.15.149:0/990218234 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd08406bf70 con 0x7fd08415b950 2023-11-08T19:27:34.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.045+0000 7fd08c564700 1 -- 172.21.15.149:0/990218234 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "6:0"} v 0) v1 -- 0x7fd08406bf70 con 0x7fd08415b950 2023-11-08T19:27:34.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.047+0000 7fd07affd700 1 -- 172.21.15.149:0/990218234 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "6:0"}]=0 failed mds gid 7140 v62) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd08406bf70 con 0x7fd08415b950 2023-11-08T19:27:34.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.050+0000 7fd08c564700 1 -- 172.21.15.149:0/990218234 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd06806af00 msgr2=0x7fd06806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:34.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.050+0000 7fd08c564700 1 --2- 172.21.15.149:0/990218234 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd06806af00 0x7fd06806d3c0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fd080013040 tx=0x7fd080008070 comp rx=0 tx=0).stop 2023-11-08T19:27:34.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.050+0000 7fd08c564700 1 -- 172.21.15.149:0/990218234 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd08415b950 msgr2=0x7fd0840b2ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:34.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.050+0000 7fd08c564700 1 --2- 172.21.15.149:0/990218234 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd08415b950 0x7fd0840b2ee0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fd07400c520 tx=0x7fd07400c830 comp rx=0 tx=0).stop 2023-11-08T19:27:34.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.050+0000 7fd08c564700 1 -- 172.21.15.149:0/990218234 shutdown_connections 2023-11-08T19:27:34.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.050+0000 7fd08c564700 1 --2- 172.21.15.149:0/990218234 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd06806af00 0x7fd06806d3c0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:34.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.050+0000 7fd08c564700 1 --2- 172.21.15.149:0/990218234 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd0840d0430 0x7fd08414f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:34.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.050+0000 7fd08c564700 1 --2- 172.21.15.149:0/990218234 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd08414c2a0 0x7fd0840b0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:34.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.050+0000 7fd08c564700 1 --2- 172.21.15.149:0/990218234 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd08415b950 0x7fd0840b2ee0 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:34.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.050+0000 7fd08c564700 1 -- 172.21.15.149:0/990218234 >> 172.21.15.149:0/990218234 conn(0x7fd08408afd0 msgr2=0x7fd08415def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:34.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.050+0000 7fd08c564700 1 -- 172.21.15.149:0/990218234 shutdown_connections 2023-11-08T19:27:34.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.050+0000 7fd08c564700 1 -- 172.21.15.149:0/990218234 wait complete. 2023-11-08T19:27:34.054 INFO:teuthology.orchestra.run.smithi149.stderr:failed mds gid 7140 2023-11-08T19:27:34.066 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-08T19:27:34.067 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-08T19:27:34.067 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-08T19:27:34.067 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T19:27:34.068 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-08T19:27:34.068 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi160 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b' 2023-11-08T19:27:34.069 INFO:tasks.ceph.mds.b:Stopped 2023-11-08T19:27:34.069 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-08T19:27:34.073 INFO:tasks.ceph.mds.b:Started 2023-11-08T19:27:34.073 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:27:34.158 INFO:tasks.ceph.mds.b.smithi160.stdout:starting mds.b at 2023-11-08T19:27:34.198 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.197+0000 7f2325be0700 1 Processor -- start 2023-11-08T19:27:34.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.197+0000 7f2325be0700 1 -- start start 2023-11-08T19:27:34.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.198+0000 7f2325be0700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f232015b950 0x7f23200ce130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:34.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.198+0000 7f2325be0700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23200cc2e0 con 0x7f23200d0430 2023-11-08T19:27:34.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.198+0000 7f2325be0700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23200cc580 con 0x7f23200cd5e0 2023-11-08T19:27:34.202 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.198+0000 7f2325be0700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23200cc820 con 0x7f232015b950 2023-11-08T19:27:34.202 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.198+0000 7f231f7fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f232015b950 0x7f23200ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:34.202 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.198+0000 7f231f7fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f232015b950 0x7f23200ce130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43954/0 (socket says 172.21.15.149:43954) 2023-11-08T19:27:34.202 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.198+0000 7f231ffff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f23200d0430 0x7f23201658e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:45958/0 (socket says 172.21.15.149:45958) 2023-11-08T19:27:34.202 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.198+0000 7f231f7fe700 1 -- 172.21.15.149:0/1480567882 learned_addr learned my addr 172.21.15.149:0/1480567882 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:27:34.203 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.198+0000 7f231f7fe700 1 -- 172.21.15.149:0/1480567882 >> v1:172.21.15.160:6789/0 conn(0x7f23200cd5e0 legacy=0x7f23200cfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:34.203 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.198+0000 7f231f7fe700 1 -- 172.21.15.149:0/1480567882 >> v1:172.21.15.149:6789/0 conn(0x7f23200d0430 legacy=0x7f23201658e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:34.203 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.198+0000 7f231e7fc700 1 -- 172.21.15.149:0/1480567882 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2559656282 0 0) 0x7f23200cc2e0 con 0x7f23200d0430 2023-11-08T19:27:34.203 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.198+0000 7f231f7fe700 1 -- 172.21.15.149:0/1480567882 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23200ccb00 con 0x7f232015b950 2023-11-08T19:27:34.203 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.199+0000 7f231f7fe700 1 --2- 172.21.15.149:0/1480567882 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f232015b950 0x7f23200ce130 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f2308009ea0 tx=0x7f230800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fdbd94715bd7c09 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:34.204 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.199+0000 7f231e7fc700 1 -- 172.21.15.149:0/1480567882 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230800e070 con 0x7f232015b950 2023-11-08T19:27:34.204 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.199+0000 7f231e7fc700 1 -- 172.21.15.149:0/1480567882 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2308003a20 con 0x7f232015b950 2023-11-08T19:27:34.204 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.199+0000 7f231e7fc700 1 -- 172.21.15.149:0/1480567882 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2308003dd0 con 0x7f232015b950 2023-11-08T19:27:34.204 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.199+0000 7f2325be0700 1 -- 172.21.15.149:0/1480567882 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f232015b950 msgr2=0x7f23200ce130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:34.205 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.199+0000 7f2325be0700 1 --2- 172.21.15.149:0/1480567882 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f232015b950 0x7f23200ce130 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f2308009ea0 tx=0x7f230800b330 comp rx=0 tx=0).stop 2023-11-08T19:27:34.205 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.199+0000 7f2325be0700 1 -- 172.21.15.149:0/1480567882 shutdown_connections 2023-11-08T19:27:34.205 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.199+0000 7f2325be0700 1 --2- 172.21.15.149:0/1480567882 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f232015b950 0x7f23200ce130 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:34.205 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.199+0000 7f2325be0700 1 -- 172.21.15.149:0/1480567882 >> 172.21.15.149:0/1480567882 conn(0x7f232008afd0 msgr2=0x7f23200d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:34.205 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.199+0000 7f2325be0700 1 -- 172.21.15.149:0/1480567882 shutdown_connections 2023-11-08T19:27:34.206 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.199+0000 7f2325be0700 1 -- 172.21.15.149:0/1480567882 wait complete. 2023-11-08T19:27:34.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.200+0000 7f2325be0700 1 Processor -- start 2023-11-08T19:27:34.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.201+0000 7f2325be0700 1 -- start start 2023-11-08T19:27:34.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.201+0000 7f2325be0700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23200d0430 0x7f2320150930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:34.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.201+0000 7f2325be0700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f232015b950 0x7f232006bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:34.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.201+0000 7f2325be0700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f23200c57a0 0x7f23200c5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:34.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.201+0000 7f2325be0700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23200c6190 con 0x7f23200d0430 2023-11-08T19:27:34.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.201+0000 7f2325be0700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2320150e70 con 0x7f232015b950 2023-11-08T19:27:34.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.201+0000 7f2325be0700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f232006d700 con 0x7f23200c57a0 2023-11-08T19:27:34.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.201+0000 7f231f7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23200d0430 0x7f2320150930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:34.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.201+0000 7f231f7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23200d0430 0x7f2320150930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43960/0 (socket says 172.21.15.149:43960) 2023-11-08T19:27:34.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.201+0000 7f231f7fe700 1 -- 172.21.15.149:0/4244707608 learned_addr learned my addr 172.21.15.149:0/4244707608 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:27:34.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.202+0000 7f231effd700 1 --2- 172.21.15.149:0/4244707608 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f232015b950 0x7f232006bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:34.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.202+0000 7f231ffff700 1 --2- 172.21.15.149:0/4244707608 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f23200c57a0 0x7f23200c5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:34.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.202+0000 7f231f7fe700 1 -- 172.21.15.149:0/4244707608 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f23200c57a0 msgr2=0x7f23200c5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:34.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.202+0000 7f231f7fe700 1 --2- 172.21.15.149:0/4244707608 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f23200c57a0 0x7f23200c5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:34.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.202+0000 7f231f7fe700 1 -- 172.21.15.149:0/4244707608 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f232015b950 msgr2=0x7f232006bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:34.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.202+0000 7f231f7fe700 1 --2- 172.21.15.149:0/4244707608 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f232015b950 0x7f232006bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:34.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.202+0000 7f231f7fe700 1 -- 172.21.15.149:0/4244707608 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2308009b30 con 0x7f23200d0430 2023-11-08T19:27:34.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.202+0000 7f231f7fe700 1 --2- 172.21.15.149:0/4244707608 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23200d0430 0x7f2320150930 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f2308015040 tx=0x7f2308004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:34.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.204+0000 7f2317fff700 1 -- 172.21.15.149:0/4244707608 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2308004300 con 0x7f23200d0430 2023-11-08T19:27:34.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.204+0000 7f2317fff700 1 -- 172.21.15.149:0/4244707608 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2308004480 con 0x7f23200d0430 2023-11-08T19:27:34.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.204+0000 7f2325be0700 1 -- 172.21.15.149:0/4244707608 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f232006c660 con 0x7f23200d0430 2023-11-08T19:27:34.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.204+0000 7f2317fff700 1 -- 172.21.15.149:0/4244707608 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2308004830 con 0x7f23200d0430 2023-11-08T19:27:34.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.204+0000 7f2325be0700 1 -- 172.21.15.149:0/4244707608 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f232006cc20 con 0x7f23200d0430 2023-11-08T19:27:34.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.205+0000 7f2325be0700 1 -- 172.21.15.149:0/4244707608 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23200745f0 con 0x7f23200d0430 2023-11-08T19:27:34.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.205+0000 7f2317fff700 1 -- 172.21.15.149:0/4244707608 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2308019070 con 0x7f23200d0430 2023-11-08T19:27:34.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.206+0000 7f2317fff700 1 --2- 172.21.15.149:0/4244707608 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f230006af30 0x7f230006d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:34.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.206+0000 7f2317fff700 1 -- 172.21.15.149:0/4244707608 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 7206+0+0 (secure 0 0 0) 0x7f230808abc0 con 0x7f23200d0430 2023-11-08T19:27:34.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.206+0000 7f231effd700 1 --2- 172.21.15.149:0/4244707608 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f230006af30 0x7f230006d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:34.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.206+0000 7f231effd700 1 --2- 172.21.15.149:0/4244707608 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f230006af30 0x7f230006d3f0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f23200cbcd0 tx=0x7f2310007ec0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:34.216 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.211+0000 7f2317fff700 1 -- 172.21.15.149:0/4244707608 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2308055690 con 0x7f23200d0430 2023-11-08T19:27:34.444 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.443+0000 7f2325be0700 1 -- 172.21.15.149:0/4244707608 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f23200aeb20 con 0x7f23200d0430 2023-11-08T19:27:34.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.443+0000 7f2317fff700 1 -- 172.21.15.149:0/4244707608 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4145 (secure 0 0 0) 0x7f2308020020 con 0x7f23200d0430 2023-11-08T19:27:34.445 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:27:34.445 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":63,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6451,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/2947079163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2947079163},{"type":"v1","addr":"172.21.15.160:6834","nonce":2947079163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:27:34.053264+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7122,"mds_1":7125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7122":{"gid":7122,"name":"a","rank":0,"incarnation":63,"state":"up:replay","state_seq":1,"addr":"172.21.15.149:6836/589971879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":589971879},{"type":"v1","addr":"172.21.15.149:6836","nonce":589971879}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7125":{"gid":7125,"name":"c","rank":1,"incarnation":57,"state":"up:active","state_seq":6,"addr":"172.21.15.149:6837/3917392643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3917392643},{"type":"v1","addr":"172.21.15.149:6837","nonce":3917392643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:27:34.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.446+0000 7f2325be0700 1 -- 172.21.15.149:0/4244707608 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f230006af30 msgr2=0x7f230006d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:34.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.446+0000 7f2325be0700 1 --2- 172.21.15.149:0/4244707608 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f230006af30 0x7f230006d3f0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f23200cbcd0 tx=0x7f2310007ec0 comp rx=0 tx=0).stop 2023-11-08T19:27:34.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.446+0000 7f2325be0700 1 -- 172.21.15.149:0/4244707608 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23200d0430 msgr2=0x7f2320150930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:34.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.446+0000 7f2325be0700 1 --2- 172.21.15.149:0/4244707608 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23200d0430 0x7f2320150930 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f2308015040 tx=0x7f2308004ad0 comp rx=0 tx=0).stop 2023-11-08T19:27:34.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.446+0000 7f2325be0700 1 -- 172.21.15.149:0/4244707608 shutdown_connections 2023-11-08T19:27:34.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.446+0000 7f2325be0700 1 --2- 172.21.15.149:0/4244707608 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f230006af30 0x7f230006d3f0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:34.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.446+0000 7f2325be0700 1 --2- 172.21.15.149:0/4244707608 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f23200c57a0 0x7f23200c5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:34.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.446+0000 7f2325be0700 1 --2- 172.21.15.149:0/4244707608 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23200d0430 0x7f2320150930 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:34.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.446+0000 7f2325be0700 1 --2- 172.21.15.149:0/4244707608 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f232015b950 0x7f232006bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:34.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.446+0000 7f2325be0700 1 -- 172.21.15.149:0/4244707608 >> 172.21.15.149:0/4244707608 conn(0x7f232008afd0 msgr2=0x7f23200b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:34.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.446+0000 7f2325be0700 1 -- 172.21.15.149:0/4244707608 shutdown_connections 2023-11-08T19:27:34.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:34.446+0000 7f2325be0700 1 -- 172.21.15.149:0/4244707608 wait complete. 2023-11-08T19:27:34.450 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 63 2023-11-08T19:27:34.459 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-11-08T19:27:38.359 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T19:27:38.362 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T19:27:38.418 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-11-08T19:27:38.570 INFO:tasks.ceph.mds.a.smithi149.stderr:2023-11-08T19:27:38.569+0000 7fbc80f92700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-08T19:27:38.571 INFO:tasks.ceph.mds.a.smithi149.stderr:2023-11-08T19:27:38.569+0000 7fbc80f92700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-08T19:27:39.461 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:27:39.595 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.594+0000 7f15fcb25700 1 Processor -- start 2023-11-08T19:27:39.595 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.594+0000 7f15fcb25700 1 -- start start 2023-11-08T19:27:39.596 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.595+0000 7f15fcb25700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f15f80cc140 0x7f15f80cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:39.596 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.595+0000 7f15fcb25700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f15f80b2cd0 0x7f15f815d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:39.597 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.595+0000 7f15fcb25700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15f80cce50 con 0x7f15f80b2850 2023-11-08T19:27:39.597 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.595+0000 7f15fcb25700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15f80b2430 con 0x7f15f80cc140 2023-11-08T19:27:39.597 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.595+0000 7f15fcb25700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15f80cc520 con 0x7f15f80b2cd0 2023-11-08T19:27:39.597 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.595+0000 7f15f659c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f15f80cc140 0x7f15f80cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:39.599 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.595+0000 7f15f659c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f15f80cc140 0x7f15f80cc910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43972/0 (socket says 172.21.15.149:43972) 2023-11-08T19:27:39.599 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.595+0000 7f15f659c700 1 -- 172.21.15.149:0/1867990116 learned_addr learned my addr 172.21.15.149:0/1867990116 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:27:39.600 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.595+0000 7f15f6d9d700 1 --2- 172.21.15.149:0/1867990116 >> v2:172.21.15.160:3300/0 conn(0x7f15f80b2cd0 0x7f15f815d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:39.600 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.595+0000 7f15f659c700 1 -- 172.21.15.149:0/1867990116 >> v2:172.21.15.160:3300/0 conn(0x7f15f80b2cd0 msgr2=0x7f15f815d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:39.600 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.595+0000 7f15f659c700 1 --2- 172.21.15.149:0/1867990116 >> v2:172.21.15.160:3300/0 conn(0x7f15f80b2cd0 0x7f15f815d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:39.600 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.595+0000 7f15f659c700 1 -- 172.21.15.149:0/1867990116 >> v1:172.21.15.160:6789/0 conn(0x7f15f80b2850 legacy=0x7f15f80cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:39.600 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.595+0000 7f15f659c700 1 -- 172.21.15.149:0/1867990116 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f80b17b0 con 0x7f15f80cc140 2023-11-08T19:27:39.601 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.596+0000 7f15f659c700 1 --2- 172.21.15.149:0/1867990116 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15f80cc140 0x7f15f80cc910 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f15f80c7600 tx=0x7f15ec009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea3f219f84781905 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:39.602 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.596+0000 7f15f559a700 1 -- 172.21.15.149:0/1867990116 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ec005e30 con 0x7f15f80cc140 2023-11-08T19:27:39.602 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.596+0000 7f15f559a700 1 -- 172.21.15.149:0/1867990116 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15ec004030 con 0x7f15f80cc140 2023-11-08T19:27:39.602 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.596+0000 7f15f559a700 1 -- 172.21.15.149:0/1867990116 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ec0043e0 con 0x7f15f80cc140 2023-11-08T19:27:39.602 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.596+0000 7f15fcb25700 1 -- 172.21.15.149:0/1867990116 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15f80cc140 msgr2=0x7f15f80cc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:39.603 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.596+0000 7f15fcb25700 1 --2- 172.21.15.149:0/1867990116 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15f80cc140 0x7f15f80cc910 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f15f80c7600 tx=0x7f15ec009bd0 comp rx=0 tx=0).stop 2023-11-08T19:27:39.603 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.596+0000 7f15fcb25700 1 -- 172.21.15.149:0/1867990116 shutdown_connections 2023-11-08T19:27:39.603 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.596+0000 7f15fcb25700 1 --2- 172.21.15.149:0/1867990116 >> v2:172.21.15.160:3300/0 conn(0x7f15f80b2cd0 0x7f15f815d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:39.603 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.596+0000 7f15fcb25700 1 --2- 172.21.15.149:0/1867990116 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15f80cc140 0x7f15f80cc910 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:39.603 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.596+0000 7f15fcb25700 1 -- 172.21.15.149:0/1867990116 >> 172.21.15.149:0/1867990116 conn(0x7f15f8099a40 msgr2=0x7f15f80d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:39.604 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.596+0000 7f15fcb25700 1 -- 172.21.15.149:0/1867990116 shutdown_connections 2023-11-08T19:27:39.604 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.596+0000 7f15fcb25700 1 -- 172.21.15.149:0/1867990116 wait complete. 2023-11-08T19:27:39.604 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.598+0000 7f15fcb25700 1 Processor -- start 2023-11-08T19:27:39.604 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.598+0000 7f15fcb25700 1 -- start start 2023-11-08T19:27:39.608 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.599+0000 7f15fcb25700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15f80b2850 0x7f15f815b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:39.608 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.599+0000 7f15fcb25700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f15f80b2cd0 0x7f15f815bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:39.608 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.599+0000 7f15fcb25700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f15f80cc140 0x7f15f80b0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:39.608 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.599+0000 7f15fcb25700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f80ae340 con 0x7f15f80b2850 2023-11-08T19:27:39.609 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.599+0000 7f15fcb25700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f80ad770 con 0x7f15f80cc140 2023-11-08T19:27:39.609 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.599+0000 7f15fcb25700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15f815ba40 con 0x7f15f80b2cd0 2023-11-08T19:27:39.609 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.599+0000 7f15f659c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15f80b2850 0x7f15f815b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:39.610 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.599+0000 7f15f659c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15f80b2850 0x7f15f815b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43978/0 (socket says 172.21.15.149:43978) 2023-11-08T19:27:39.610 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.599+0000 7f15f659c700 1 -- 172.21.15.149:0/4179232647 learned_addr learned my addr 172.21.15.149:0/4179232647 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:27:39.610 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.600+0000 7f15f5d9b700 1 --2- 172.21.15.149:0/4179232647 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f15f80b2cd0 0x7f15f815bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:39.610 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.600+0000 7f15f6d9d700 1 --2- 172.21.15.149:0/4179232647 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f15f80cc140 0x7f15f80b0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:39.611 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.600+0000 7f15f659c700 1 -- 172.21.15.149:0/4179232647 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f15f80b2cd0 msgr2=0x7f15f815bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:39.611 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.600+0000 7f15f659c700 1 --2- 172.21.15.149:0/4179232647 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f15f80b2cd0 0x7f15f815bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:39.611 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.600+0000 7f15f659c700 1 -- 172.21.15.149:0/4179232647 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f15f80cc140 msgr2=0x7f15f80b0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:39.611 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.600+0000 7f15f659c700 1 --2- 172.21.15.149:0/4179232647 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f15f80cc140 0x7f15f80b0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:39.612 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.600+0000 7f15f659c700 1 -- 172.21.15.149:0/4179232647 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15ec009500 con 0x7f15f80b2850 2023-11-08T19:27:39.612 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.600+0000 7f15f5d9b700 1 --2- 172.21.15.149:0/4179232647 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f15f80b2cd0 0x7f15f815bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:27:39.612 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.600+0000 7f15f6d9d700 1 --2- 172.21.15.149:0/4179232647 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f15f80cc140 0x7f15f80b0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:27:39.612 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.600+0000 7f15f659c700 1 --2- 172.21.15.149:0/4179232647 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15f80b2850 0x7f15f815b500 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f15ec009c10 tx=0x7f15ec004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:39.612 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.600+0000 7f15e6ffd700 1 -- 172.21.15.149:0/4179232647 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ec003e10 con 0x7f15f80b2850 2023-11-08T19:27:39.613 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.600+0000 7f15e6ffd700 1 -- 172.21.15.149:0/4179232647 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15ec01d430 con 0x7f15f80b2850 2023-11-08T19:27:39.613 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.600+0000 7f15fcb25700 1 -- 172.21.15.149:0/4179232647 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15f80ada10 con 0x7f15f80b2850 2023-11-08T19:27:39.613 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.600+0000 7f15e6ffd700 1 -- 172.21.15.149:0/4179232647 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ec01d7e0 con 0x7f15f80b2850 2023-11-08T19:27:39.613 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.600+0000 7f15fcb25700 1 -- 172.21.15.149:0/4179232647 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15f80adfd0 con 0x7f15f80b2850 2023-11-08T19:27:39.613 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.601+0000 7f15fcb25700 1 -- 172.21.15.149:0/4179232647 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15f80ae190 con 0x7f15f80b2850 2023-11-08T19:27:39.614 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.601+0000 7f15e6ffd700 1 -- 172.21.15.149:0/4179232647 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f15ec01d940 con 0x7f15f80b2850 2023-11-08T19:27:39.614 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.602+0000 7f15e6ffd700 1 --2- 172.21.15.149:0/4179232647 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f15d806af00 0x7f15d806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:39.614 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.602+0000 7f15e6ffd700 1 -- 172.21.15.149:0/4179232647 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 7206+0+0 (secure 0 0 0) 0x7f15ec08b0e0 con 0x7f15f80b2850 2023-11-08T19:27:39.614 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.602+0000 7f15f5d9b700 1 --2- 172.21.15.149:0/4179232647 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f15d806af00 0x7f15d806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:39.615 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.602+0000 7f15f5d9b700 1 --2- 172.21.15.149:0/4179232647 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f15d806af00 0x7f15d806d3c0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f15f81f6a80 tx=0x7f15e8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:39.615 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.607+0000 7f15e6ffd700 1 -- 172.21.15.149:0/4179232647 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f15ec055c40 con 0x7f15f80b2850 2023-11-08T19:27:39.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.838+0000 7f15fcb25700 1 -- 172.21.15.149:0/4179232647 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f15f80745f0 con 0x7f15f80b2850 2023-11-08T19:27:39.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.838+0000 7f15e6ffd700 1 -- 172.21.15.149:0/4179232647 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4937 (secure 0 0 0) 0x7f15ec059260 con 0x7f15f80b2850 2023-11-08T19:27:39.840 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:27:39.840 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":67,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6095,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/852710262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":852710262},{"type":"v1","addr":"172.21.15.160:6835","nonce":852710262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64},{"gid":6451,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/2947079163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2947079163},{"type":"v1","addr":"172.21.15.160:6834","nonce":2947079163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:27:37.067249+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7122,"mds_1":7125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7122":{"gid":7122,"name":"a","rank":0,"incarnation":63,"state":"up:active","state_seq":17,"addr":"172.21.15.149:6836/589971879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":589971879},{"type":"v1","addr":"172.21.15.149:6836","nonce":589971879}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7125":{"gid":7125,"name":"c","rank":1,"incarnation":57,"state":"up:active","state_seq":6,"addr":"172.21.15.149:6837/3917392643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3917392643},{"type":"v1","addr":"172.21.15.149:6837","nonce":3917392643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:27:39.842 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.840+0000 7f15fcb25700 1 -- 172.21.15.149:0/4179232647 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f15d806af00 msgr2=0x7f15d806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:39.842 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.840+0000 7f15fcb25700 1 --2- 172.21.15.149:0/4179232647 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f15d806af00 0x7f15d806d3c0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f15f81f6a80 tx=0x7f15e8009040 comp rx=0 tx=0).stop 2023-11-08T19:27:39.842 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.840+0000 7f15fcb25700 1 -- 172.21.15.149:0/4179232647 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15f80b2850 msgr2=0x7f15f815b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:39.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.840+0000 7f15fcb25700 1 --2- 172.21.15.149:0/4179232647 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15f80b2850 0x7f15f815b500 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f15ec009c10 tx=0x7f15ec004750 comp rx=0 tx=0).stop 2023-11-08T19:27:39.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.840+0000 7f15fcb25700 1 -- 172.21.15.149:0/4179232647 shutdown_connections 2023-11-08T19:27:39.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.840+0000 7f15fcb25700 1 --2- 172.21.15.149:0/4179232647 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f15d806af00 0x7f15d806d3c0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:39.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.840+0000 7f15fcb25700 1 --2- 172.21.15.149:0/4179232647 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f15f80cc140 0x7f15f80b0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:39.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.840+0000 7f15fcb25700 1 --2- 172.21.15.149:0/4179232647 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15f80b2850 0x7f15f815b500 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:39.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.840+0000 7f15fcb25700 1 --2- 172.21.15.149:0/4179232647 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f15f80b2cd0 0x7f15f815bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:39.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.840+0000 7f15fcb25700 1 -- 172.21.15.149:0/4179232647 >> 172.21.15.149:0/4179232647 conn(0x7f15f8099a40 msgr2=0x7f15f806e040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:39.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.841+0000 7f15fcb25700 1 -- 172.21.15.149:0/4179232647 shutdown_connections 2023-11-08T19:27:39.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.841+0000 7f15fcb25700 1 -- 172.21.15.149:0/4179232647 wait complete. 2023-11-08T19:27:39.844 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 67 2023-11-08T19:27:39.854 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-11-08T19:27:39.855 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:27:39.975 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.974+0000 7fd71f634700 1 Processor -- start 2023-11-08T19:27:39.976 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.974+0000 7fd71f634700 1 -- start start 2023-11-08T19:27:39.979 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.975+0000 7fd71f634700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd7180cc910 0x7fd7180cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:39.979 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.975+0000 7fd71f634700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7180b2f60 con 0x7fd7180cb130 2023-11-08T19:27:39.979 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.975+0000 7fd71f634700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7180cc520 con 0x7fd7180cc140 2023-11-08T19:27:39.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.975+0000 7fd71f634700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7180b2430 con 0x7fd7180cc910 2023-11-08T19:27:39.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.975+0000 7fd71dbd1700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fd7180cb130 0x7fd71815d2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:45990/0 (socket says 172.21.15.149:45990) 2023-11-08T19:27:39.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.975+0000 7fd71dbd1700 1 -- 172.21.15.149:0/4036319091 learned_addr learned my addr 172.21.15.149:0/4036319091 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:27:39.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.976+0000 7fd70ffff700 1 -- 172.21.15.149:0/4036319091 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1722722297 0 0) 0x7fd7180b2f60 con 0x7fd7180cb130 2023-11-08T19:27:39.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.976+0000 7fd71cbcf700 1 --2- 172.21.15.149:0/4036319091 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd7180cc910 0x7fd7180cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:39.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.976+0000 7fd70ffff700 1 -- 172.21.15.149:0/4036319091 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7040035b0 con 0x7fd7180cb130 2023-11-08T19:27:39.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.976+0000 7fd70ffff700 1 -- 172.21.15.149:0/4036319091 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2912912667 0 0) 0x7fd7040035b0 con 0x7fd7180cb130 2023-11-08T19:27:39.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.976+0000 7fd70ffff700 1 -- 172.21.15.149:0/4036319091 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd7180cc910 msgr2=0x7fd7180cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:39.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.976+0000 7fd70ffff700 1 --2- 172.21.15.149:0/4036319091 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd7180cc910 0x7fd7180cabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:39.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.976+0000 7fd70ffff700 1 -- 172.21.15.149:0/4036319091 >> v1:172.21.15.160:6789/0 conn(0x7fd7180cc140 legacy=0x7fd7180b2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:39.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.976+0000 7fd70ffff700 1 -- 172.21.15.149:0/4036319091 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7180cb5b0 con 0x7fd7180cb130 2023-11-08T19:27:39.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.976+0000 7fd70ffff700 1 -- 172.21.15.149:0/4036319091 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7fd7100019f0 con 0x7fd7180cb130 2023-11-08T19:27:39.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.976+0000 7fd70ffff700 1 -- 172.21.15.149:0/4036319091 >> v1:172.21.15.149:6789/0 conn(0x7fd7180cb130 legacy=0x7fd71815d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:39.983 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.976+0000 7fd70ffff700 1 --2- 172.21.15.149:0/4036319091 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd7180cc910 0x7fd704003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:39.983 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.976+0000 7fd70ffff700 1 --2- 172.21.15.149:0/4036319091 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd704003fb0 0x7fd704004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:39.983 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.976+0000 7fd70ffff700 1 --2- 172.21.15.149:0/4036319091 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd704004d90 0x7fd704005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:39.983 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.976+0000 7fd70ffff700 1 -- 172.21.15.149:0/4036319091 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7180b2430 con 0x7fd704003fb0 2023-11-08T19:27:39.983 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.976+0000 7fd70ffff700 1 -- 172.21.15.149:0/4036319091 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd70400baf0 con 0x7fd704004d90 2023-11-08T19:27:39.984 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.976+0000 7fd70ffff700 1 -- 172.21.15.149:0/4036319091 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd70400bcb0 con 0x7fd7180cc910 2023-11-08T19:27:39.984 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.976+0000 7fd71cbcf700 1 --2- 172.21.15.149:0/4036319091 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd704003fb0 0x7fd704004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:39.984 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.976+0000 7fd71d3d0700 1 --2- 172.21.15.149:0/4036319091 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd7180cc910 0x7fd704003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:39.984 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.976+0000 7fd71dbd1700 1 --2- 172.21.15.149:0/4036319091 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd704004d90 0x7fd704005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:39.984 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.976+0000 7fd71cbcf700 1 -- 172.21.15.149:0/4036319091 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd7180cc910 msgr2=0x7fd704003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:39.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.976+0000 7fd71cbcf700 1 --2- 172.21.15.149:0/4036319091 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd7180cc910 0x7fd704003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:39.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.976+0000 7fd71cbcf700 1 -- 172.21.15.149:0/4036319091 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd704004d90 msgr2=0x7fd704005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:39.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.976+0000 7fd71cbcf700 1 --2- 172.21.15.149:0/4036319091 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd704004d90 0x7fd704005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:39.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.976+0000 7fd71cbcf700 1 -- 172.21.15.149:0/4036319091 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7040035b0 con 0x7fd704003fb0 2023-11-08T19:27:39.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.977+0000 7fd71cbcf700 1 --2- 172.21.15.149:0/4036319091 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd704003fb0 0x7fd704004850 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fd714009b30 tx=0x7fd704005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57012c9f402de473 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:39.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.977+0000 7fd70ffff700 1 -- 172.21.15.149:0/4036319091 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71400e6c0 con 0x7fd704003fb0 2023-11-08T19:27:39.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.977+0000 7fd70ffff700 1 -- 172.21.15.149:0/4036319091 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd71400e820 con 0x7fd704003fb0 2023-11-08T19:27:39.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.977+0000 7fd70ffff700 1 -- 172.21.15.149:0/4036319091 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71400eb90 con 0x7fd704003fb0 2023-11-08T19:27:39.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.977+0000 7fd71f634700 1 -- 172.21.15.149:0/4036319091 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd704003fb0 msgr2=0x7fd704004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:39.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.977+0000 7fd71f634700 1 --2- 172.21.15.149:0/4036319091 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd704003fb0 0x7fd704004850 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fd714009b30 tx=0x7fd704005880 comp rx=0 tx=0).stop 2023-11-08T19:27:39.987 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.977+0000 7fd71dbd1700 1 -- 172.21.15.149:0/4036319091 reap_dead start 2023-11-08T19:27:39.987 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.977+0000 7fd71f634700 1 -- 172.21.15.149:0/4036319091 shutdown_connections 2023-11-08T19:27:39.987 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.977+0000 7fd71f634700 1 -- 172.21.15.149:0/4036319091 >> 172.21.15.149:0/4036319091 conn(0x7fd718099a40 msgr2=0x7fd7180d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:39.987 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.977+0000 7fd71f634700 1 -- 172.21.15.149:0/4036319091 shutdown_connections 2023-11-08T19:27:39.987 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.977+0000 7fd71f634700 1 -- 172.21.15.149:0/4036319091 wait complete. 2023-11-08T19:27:39.990 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.979+0000 7fd71f634700 1 Processor -- start 2023-11-08T19:27:39.991 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.979+0000 7fd71f634700 1 -- start start 2023-11-08T19:27:39.991 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.979+0000 7fd71f634700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd704003fb0 0x7fd7180b6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:39.991 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.979+0000 7fd71f634700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd71815c330 0x7fd7180b3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:39.991 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.979+0000 7fd71f634700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd71815bb60 0x7fd7180c8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:39.991 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.979+0000 7fd71f634700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7180b4790 con 0x7fd71815bb60 2023-11-08T19:27:39.992 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.979+0000 7fd71f634700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7180c5730 con 0x7fd71815c330 2023-11-08T19:27:39.992 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.979+0000 7fd71f634700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd71815c7b0 con 0x7fd704003fb0 2023-11-08T19:27:39.992 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.979+0000 7fd71dbd1700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd71815bb60 0x7fd7180c8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:39.992 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.979+0000 7fd71dbd1700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd71815bb60 0x7fd7180c8430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44002/0 (socket says 172.21.15.149:44002) 2023-11-08T19:27:39.992 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.979+0000 7fd71dbd1700 1 -- 172.21.15.149:0/2463879912 learned_addr learned my addr 172.21.15.149:0/2463879912 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:27:39.993 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.980+0000 7fd71d3d0700 1 --2- 172.21.15.149:0/2463879912 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd704003fb0 0x7fd7180b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:39.993 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.980+0000 7fd71cbcf700 1 --2- 172.21.15.149:0/2463879912 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd71815c330 0x7fd7180b3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:39.993 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.980+0000 7fd71dbd1700 1 -- 172.21.15.149:0/2463879912 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd704003fb0 msgr2=0x7fd7180b6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:39.993 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.980+0000 7fd71dbd1700 1 --2- 172.21.15.149:0/2463879912 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd704003fb0 0x7fd7180b6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:39.993 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.980+0000 7fd71dbd1700 1 -- 172.21.15.149:0/2463879912 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd71815c330 msgr2=0x7fd7180b3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:39.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.980+0000 7fd71dbd1700 1 --2- 172.21.15.149:0/2463879912 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd71815c330 0x7fd7180b3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:39.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.980+0000 7fd71dbd1700 1 -- 172.21.15.149:0/2463879912 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7180b44b0 con 0x7fd71815bb60 2023-11-08T19:27:39.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.980+0000 7fd71cbcf700 1 --2- 172.21.15.149:0/2463879912 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd71815c330 0x7fd7180b3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:27:39.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.980+0000 7fd71dbd1700 1 --2- 172.21.15.149:0/2463879912 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd71815bb60 0x7fd7180c8430 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fd7180b3190 tx=0x7fd71000a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:39.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.980+0000 7fd70dffb700 1 -- 172.21.15.149:0/2463879912 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71000ad00 con 0x7fd71815bb60 2023-11-08T19:27:39.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.980+0000 7fd70dffb700 1 -- 172.21.15.149:0/2463879912 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd71000ae60 con 0x7fd71815bb60 2023-11-08T19:27:39.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.980+0000 7fd71f634700 1 -- 172.21.15.149:0/2463879912 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7180c5980 con 0x7fd71815bb60 2023-11-08T19:27:39.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.980+0000 7fd70dffb700 1 -- 172.21.15.149:0/2463879912 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd710013630 con 0x7fd71815bb60 2023-11-08T19:27:39.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.980+0000 7fd71f634700 1 -- 172.21.15.149:0/2463879912 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7180c5f40 con 0x7fd71815bb60 2023-11-08T19:27:39.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.981+0000 7fd71f634700 1 -- 172.21.15.149:0/2463879912 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7180745f0 con 0x7fd71815bb60 2023-11-08T19:27:39.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.981+0000 7fd70dffb700 1 -- 172.21.15.149:0/2463879912 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd710013790 con 0x7fd71815bb60 2023-11-08T19:27:39.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.982+0000 7fd70dffb700 1 --2- 172.21.15.149:0/2463879912 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd6fc06af00 0x7fd6fc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:39.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.982+0000 7fd70dffb700 1 -- 172.21.15.149:0/2463879912 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 7206+0+0 (secure 0 0 0) 0x7fd71008a6e0 con 0x7fd71815bb60 2023-11-08T19:27:39.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.982+0000 7fd71d3d0700 1 --2- 172.21.15.149:0/2463879912 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd6fc06af00 0x7fd6fc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:39.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.982+0000 7fd71d3d0700 1 --2- 172.21.15.149:0/2463879912 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd6fc06af00 0x7fd6fc06d3c0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fd7080018b0 tx=0x7fd708009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:39.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:39.987+0000 7fd70dffb700 1 -- 172.21.15.149:0/2463879912 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd710055240 con 0x7fd71815bb60 2023-11-08T19:27:40.221 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.220+0000 7fd71f634700 1 -- 172.21.15.149:0/2463879912 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd7180c3e80 con 0x7fd71815bb60 2023-11-08T19:27:40.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.220+0000 7fd70dffb700 1 -- 172.21.15.149:0/2463879912 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4937 (secure 0 0 0) 0x7fd710058860 con 0x7fd71815bb60 2023-11-08T19:27:40.222 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:27:40.222 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":67,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6095,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/852710262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":852710262},{"type":"v1","addr":"172.21.15.160:6835","nonce":852710262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64},{"gid":6451,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/2947079163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2947079163},{"type":"v1","addr":"172.21.15.160:6834","nonce":2947079163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:27:37.067249+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7122,"mds_1":7125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7122":{"gid":7122,"name":"a","rank":0,"incarnation":63,"state":"up:active","state_seq":17,"addr":"172.21.15.149:6836/589971879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":589971879},{"type":"v1","addr":"172.21.15.149:6836","nonce":589971879}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7125":{"gid":7125,"name":"c","rank":1,"incarnation":57,"state":"up:active","state_seq":6,"addr":"172.21.15.149:6837/3917392643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3917392643},{"type":"v1","addr":"172.21.15.149:6837","nonce":3917392643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:27:40.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.223+0000 7fd71f634700 1 -- 172.21.15.149:0/2463879912 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd6fc06af00 msgr2=0x7fd6fc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:40.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.223+0000 7fd71f634700 1 --2- 172.21.15.149:0/2463879912 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd6fc06af00 0x7fd6fc06d3c0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fd7080018b0 tx=0x7fd708009040 comp rx=0 tx=0).stop 2023-11-08T19:27:40.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.223+0000 7fd71f634700 1 -- 172.21.15.149:0/2463879912 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd71815bb60 msgr2=0x7fd7180c8430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:40.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.223+0000 7fd71f634700 1 --2- 172.21.15.149:0/2463879912 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd71815bb60 0x7fd7180c8430 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fd7180b3190 tx=0x7fd71000a5f0 comp rx=0 tx=0).stop 2023-11-08T19:27:40.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.223+0000 7fd71f634700 1 -- 172.21.15.149:0/2463879912 shutdown_connections 2023-11-08T19:27:40.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.223+0000 7fd71f634700 1 --2- 172.21.15.149:0/2463879912 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd6fc06af00 0x7fd6fc06d3c0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:40.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.223+0000 7fd71f634700 1 --2- 172.21.15.149:0/2463879912 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd71815bb60 0x7fd7180c8430 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:40.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.223+0000 7fd71f634700 1 --2- 172.21.15.149:0/2463879912 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd704003fb0 0x7fd7180b6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:40.226 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.223+0000 7fd71f634700 1 --2- 172.21.15.149:0/2463879912 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd71815c330 0x7fd7180b3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:40.226 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.223+0000 7fd71f634700 1 -- 172.21.15.149:0/2463879912 >> 172.21.15.149:0/2463879912 conn(0x7fd718099a40 msgr2=0x7fd7180d0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:40.226 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.223+0000 7fd71f634700 1 -- 172.21.15.149:0/2463879912 shutdown_connections 2023-11-08T19:27:40.226 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.223+0000 7fd71f634700 1 -- 172.21.15.149:0/2463879912 wait complete. 2023-11-08T19:27:40.227 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 67 2023-11-08T19:27:40.639 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 67, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 2, 'explicitly_allowed_features': 2, 'created': '2023-11-08T19:26:48.987203+0000', 'modified': '2023-11-08T19:27:37.067249+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 97, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 7122, 'mds_1': 7125}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7122': {'gid': 7122, 'name': 'a', 'rank': 0, 'incarnation': 63, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.149:6836/589971879', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6834', 'nonce': 589971879}, {'type': 'v1', 'addr': '172.21.15.149:6836', 'nonce': 589971879}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_7125': {'gid': 7125, 'name': 'c', 'rank': 1, 'incarnation': 57, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.149:6837/3917392643', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6835', 'nonce': 3917392643}, {'type': 'v1', 'addr': '172.21.15.149:6837', 'nonce': 3917392643}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-08T19:27:40.640 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 2/2 2023-11-08T19:27:40.640 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-08T19:27:40.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.762+0000 7f2fe58c7700 1 Processor -- start 2023-11-08T19:27:40.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.762+0000 7f2fe58c7700 1 -- start start 2023-11-08T19:27:40.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.763+0000 7f2fe58c7700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f2fe006c2a0 0x7f2fe006e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:40.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.763+0000 7f2fe58c7700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fe00cb220 con 0x7f2fe015a1a0 2023-11-08T19:27:40.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.763+0000 7f2fe58c7700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fe00cb500 con 0x7f2fe006da50 2023-11-08T19:27:40.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.763+0000 7f2fe58c7700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fe015a580 con 0x7f2fe006c2a0 2023-11-08T19:27:40.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.763+0000 7f2fdeffd700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f2fe015a1a0 0x7f2fe006bb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:46008/0 (socket says 172.21.15.149:46008) 2023-11-08T19:27:40.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.763+0000 7f2fdeffd700 1 -- 172.21.15.149:0/2609837092 learned_addr learned my addr 172.21.15.149:0/2609837092 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:27:40.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.764+0000 7f2fddffb700 1 -- 172.21.15.149:0/2609837092 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 546623782 0 0) 0x7f2fe00cb220 con 0x7f2fe015a1a0 2023-11-08T19:27:40.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.764+0000 7f2fddffb700 1 -- 172.21.15.149:0/2609837092 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fc80035b0 con 0x7f2fe015a1a0 2023-11-08T19:27:40.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.764+0000 7f2fde7fc700 1 --2- 172.21.15.149:0/2609837092 >> v2:172.21.15.160:3300/0 conn(0x7f2fe006c2a0 0x7f2fe006e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:40.770 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.764+0000 7f2fddffb700 1 -- 172.21.15.149:0/2609837092 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2807191087 0 0) 0x7f2fc80035b0 con 0x7f2fe015a1a0 2023-11-08T19:27:40.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.764+0000 7f2fddffb700 1 -- 172.21.15.149:0/2609837092 >> v2:172.21.15.160:3300/0 conn(0x7f2fe006c2a0 msgr2=0x7f2fe006e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:40.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.764+0000 7f2fddffb700 1 --2- 172.21.15.149:0/2609837092 >> v2:172.21.15.160:3300/0 conn(0x7f2fe006c2a0 0x7f2fe006e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:40.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.764+0000 7f2fddffb700 1 -- 172.21.15.149:0/2609837092 >> v1:172.21.15.160:6789/0 conn(0x7f2fe006da50 legacy=0x7f2fe00cdd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:40.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.764+0000 7f2fddffb700 1 -- 172.21.15.149:0/2609837092 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fe00cb7e0 con 0x7f2fe015a1a0 2023-11-08T19:27:40.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.764+0000 7f2fddffb700 1 -- 172.21.15.149:0/2609837092 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f2fd4001670 con 0x7f2fe015a1a0 2023-11-08T19:27:40.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.764+0000 7f2fddffb700 1 -- 172.21.15.149:0/2609837092 >> v1:172.21.15.149:6789/0 conn(0x7f2fe015a1a0 legacy=0x7f2fe006bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:40.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.764+0000 7f2fddffb700 1 --2- 172.21.15.149:0/2609837092 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2fc8003a00 0x7f2fc8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:40.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.764+0000 7f2fddffb700 1 --2- 172.21.15.149:0/2609837092 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fc8004850 0x7f2fc8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:40.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.764+0000 7f2fddffb700 1 --2- 172.21.15.149:0/2609837092 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2fc8005210 0x7f2fc800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:40.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.764+0000 7f2fddffb700 1 -- 172.21.15.149:0/2609837092 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe015a580 con 0x7f2fc8004850 2023-11-08T19:27:40.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.764+0000 7f2fddffb700 1 -- 172.21.15.149:0/2609837092 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc800c0b0 con 0x7f2fc8003a00 2023-11-08T19:27:40.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.764+0000 7f2fddffb700 1 -- 172.21.15.149:0/2609837092 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc800e480 con 0x7f2fc8005210 2023-11-08T19:27:40.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.764+0000 7f2fde7fc700 1 --2- 172.21.15.149:0/2609837092 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fc8004850 0x7f2fc8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:40.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.764+0000 7f2fdeffd700 1 --2- 172.21.15.149:0/2609837092 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2fc8003a00 0x7f2fc8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:40.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.764+0000 7f2fdf7fe700 1 --2- 172.21.15.149:0/2609837092 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2fc8005210 0x7f2fc800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:40.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.764+0000 7f2fde7fc700 1 -- 172.21.15.149:0/2609837092 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2fc8005210 msgr2=0x7f2fc800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:40.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.764+0000 7f2fde7fc700 1 --2- 172.21.15.149:0/2609837092 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2fc8005210 0x7f2fc800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:40.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.764+0000 7f2fde7fc700 1 -- 172.21.15.149:0/2609837092 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2fc8003a00 msgr2=0x7f2fc8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:40.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.764+0000 7f2fde7fc700 1 --2- 172.21.15.149:0/2609837092 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2fc8003a00 0x7f2fc8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:40.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.764+0000 7f2fde7fc700 1 -- 172.21.15.149:0/2609837092 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc80035b0 con 0x7f2fc8004850 2023-11-08T19:27:40.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.764+0000 7f2fdf7fe700 1 -- 172.21.15.149:0/2609837092 reap_dead start 2023-11-08T19:27:40.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.764+0000 7f2fde7fc700 1 --2- 172.21.15.149:0/2609837092 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fc8004850 0x7f2fc8004cd0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f2fd000aae0 tx=0x7f2fc8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5030b9171ccd9e80 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:40.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.765+0000 7f2fddffb700 1 -- 172.21.15.149:0/2609837092 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd000e960 con 0x7f2fc8004850 2023-11-08T19:27:40.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.765+0000 7f2fddffb700 1 -- 172.21.15.149:0/2609837092 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fd000eac0 con 0x7f2fc8004850 2023-11-08T19:27:40.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.765+0000 7f2fddffb700 1 -- 172.21.15.149:0/2609837092 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd000ee50 con 0x7f2fc8004850 2023-11-08T19:27:40.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.765+0000 7f2fe58c7700 1 -- 172.21.15.149:0/2609837092 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fc8004850 msgr2=0x7f2fc8004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:40.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.765+0000 7f2fe58c7700 1 --2- 172.21.15.149:0/2609837092 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fc8004850 0x7f2fc8004cd0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f2fd000aae0 tx=0x7f2fc8005880 comp rx=0 tx=0).stop 2023-11-08T19:27:40.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.765+0000 7f2fe58c7700 1 -- 172.21.15.149:0/2609837092 shutdown_connections 2023-11-08T19:27:40.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.765+0000 7f2fe58c7700 1 --2- 172.21.15.149:0/2609837092 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fc8004850 0x7f2fc8004cd0 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:40.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.765+0000 7f2fe58c7700 1 -- 172.21.15.149:0/2609837092 >> 172.21.15.149:0/2609837092 conn(0x7f2fe0071720 msgr2=0x7f2fe0071b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:40.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.765+0000 7f2fe58c7700 1 -- 172.21.15.149:0/2609837092 shutdown_connections 2023-11-08T19:27:40.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.765+0000 7f2fe58c7700 1 -- 172.21.15.149:0/2609837092 wait complete. 2023-11-08T19:27:40.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.766+0000 7f2fe58c7700 1 Processor -- start 2023-11-08T19:27:40.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.767+0000 7f2fe58c7700 1 -- start start 2023-11-08T19:27:40.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.767+0000 7f2fe58c7700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2fc8004850 0x7f2fe01f3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:40.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.767+0000 7f2fe58c7700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fe00c5d50 0x7f2fe0158300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:40.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.767+0000 7f2fe58c7700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2fe015a6c0 0x7f2fe00cdd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:40.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.767+0000 7f2fe58c7700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe01f41a0 con 0x7f2fe00c5d50 2023-11-08T19:27:40.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.767+0000 7f2fe58c7700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe015b010 con 0x7f2fc8004850 2023-11-08T19:27:40.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.767+0000 7f2fe58c7700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe015b2f0 con 0x7f2fe015a6c0 2023-11-08T19:27:40.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.767+0000 7f2fde7fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fe00c5d50 0x7f2fe0158300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:40.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.767+0000 7f2fde7fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fe00c5d50 0x7f2fe0158300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44020/0 (socket says 172.21.15.149:44020) 2023-11-08T19:27:40.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.767+0000 7f2fde7fc700 1 -- 172.21.15.149:0/3296634051 learned_addr learned my addr 172.21.15.149:0/3296634051 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:27:40.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.767+0000 7f2fdeffd700 1 --2- 172.21.15.149:0/3296634051 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2fc8004850 0x7f2fe01f3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:40.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.767+0000 7f2fdf7fe700 1 --2- 172.21.15.149:0/3296634051 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2fe015a6c0 0x7f2fe00cdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:40.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.768+0000 7f2fde7fc700 1 -- 172.21.15.149:0/3296634051 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2fe015a6c0 msgr2=0x7f2fe00cdd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:40.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.768+0000 7f2fde7fc700 1 --2- 172.21.15.149:0/3296634051 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2fe015a6c0 0x7f2fe00cdd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:40.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.768+0000 7f2fde7fc700 1 -- 172.21.15.149:0/3296634051 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2fc8004850 msgr2=0x7f2fe01f3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:40.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.768+0000 7f2fde7fc700 1 --2- 172.21.15.149:0/3296634051 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2fc8004850 0x7f2fe01f3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:40.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.768+0000 7f2fde7fc700 1 -- 172.21.15.149:0/3296634051 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fe015b5d0 con 0x7f2fe00c5d50 2023-11-08T19:27:40.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.768+0000 7f2fde7fc700 1 --2- 172.21.15.149:0/3296634051 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fe00c5d50 0x7f2fe0158300 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f2fd000e550 tx=0x7f2fd00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:40.791 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.768+0000 7f2fc7fff700 1 -- 172.21.15.149:0/3296634051 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd0020070 con 0x7f2fe00c5d50 2023-11-08T19:27:40.791 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.768+0000 7f2fc7fff700 1 -- 172.21.15.149:0/3296634051 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fd0004250 con 0x7f2fe00c5d50 2023-11-08T19:27:40.791 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.768+0000 7f2fc7fff700 1 -- 172.21.15.149:0/3296634051 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd00036a0 con 0x7f2fe00c5d50 2023-11-08T19:27:40.792 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.768+0000 7f2fe58c7700 1 -- 172.21.15.149:0/3296634051 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fe015b8b0 con 0x7f2fe00c5d50 2023-11-08T19:27:40.792 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.768+0000 7f2fe58c7700 1 -- 172.21.15.149:0/3296634051 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fe0158840 con 0x7f2fe00c5d50 2023-11-08T19:27:40.792 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.769+0000 7f2fc7fff700 1 -- 172.21.15.149:0/3296634051 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2fd0003800 con 0x7f2fe00c5d50 2023-11-08T19:27:40.792 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.770+0000 7f2fc7fff700 1 --2- 172.21.15.149:0/3296634051 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2fcc06af00 0x7f2fcc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:40.792 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.770+0000 7f2fc7fff700 1 -- 172.21.15.149:0/3296634051 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 7206+0+0 (secure 0 0 0) 0x7f2fd008a800 con 0x7f2fe00c5d50 2023-11-08T19:27:40.793 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.770+0000 7f2fdeffd700 1 --2- 172.21.15.149:0/3296634051 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2fcc06af00 0x7f2fcc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:40.793 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.770+0000 7f2fdeffd700 1 --2- 172.21.15.149:0/3296634051 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2fcc06af00 0x7f2fcc06d3c0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f2fd4001050 tx=0x7f2fd4000f80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:40.793 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.772+0000 7f2ff1ac0b80 1 Processor -- start 2023-11-08T19:27:40.793 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.772+0000 7f2ff1ac0b80 1 -- start start 2023-11-08T19:27:40.793 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.773+0000 7f2ff1ac0b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564f637186f0 0x564f63748450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:40.794 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.773+0000 7f2ff1ac0b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564f6371ac30 0x564f63748990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:40.794 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.773+0000 7f2ff1ac0b80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x564f63718ad0 0x564f63732f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:40.794 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.773+0000 7f2ff1ac0b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f636846e0 con 0x564f637186f0 2023-11-08T19:27:40.794 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.773+0000 7f2ff1ac0b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f636783b0 con 0x564f6371ac30 2023-11-08T19:27:40.795 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.773+0000 7f2ff1ac0b80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x564f63675cd0 con 0x564f63718ad0 2023-11-08T19:27:40.795 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.773+0000 7f2fdeffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564f637186f0 0x564f63748450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:40.795 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.773+0000 7f2fdeffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564f637186f0 0x564f63748450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44026/0 (socket says 172.21.15.149:44026) 2023-11-08T19:27:40.795 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.773+0000 7f2fdeffd700 1 -- 172.21.15.149:0/2247286066 learned_addr learned my addr 172.21.15.149:0/2247286066 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:27:40.795 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.773+0000 7f2fdeffd700 1 -- 172.21.15.149:0/2247286066 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x564f63718ad0 msgr2=0x564f63732f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:40.796 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.773+0000 7f2fdeffd700 1 --2- 172.21.15.149:0/2247286066 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x564f63718ad0 0x564f63732f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:40.796 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.773+0000 7f2fdeffd700 1 -- 172.21.15.149:0/2247286066 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564f6371ac30 msgr2=0x564f63748990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:40.796 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.773+0000 7f2fde7fc700 1 --2- 172.21.15.149:0/2247286066 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564f6371ac30 0x564f63748990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:40.796 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.773+0000 7f2fdeffd700 1 --2- 172.21.15.149:0/2247286066 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564f6371ac30 0x564f63748990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:40.796 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.773+0000 7f2fdeffd700 1 -- 172.21.15.149:0/2247286066 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564f634ee5e0 con 0x564f637186f0 2023-11-08T19:27:40.797 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.773+0000 7f2fdeffd700 1 --2- 172.21.15.149:0/2247286066 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564f637186f0 0x564f63748450 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f2fd4007350 tx=0x7f2fd4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=680517cbaca7b644 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:40.797 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.773+0000 7f2fc57fa700 1 -- 172.21.15.149:0/2247286066 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd401a040 con 0x564f637186f0 2023-11-08T19:27:40.797 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.774+0000 7f2fc57fa700 1 -- 172.21.15.149:0/2247286066 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fd40158d0 con 0x564f637186f0 2023-11-08T19:27:40.797 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.774+0000 7f2fc57fa700 1 -- 172.21.15.149:0/2247286066 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd4015c40 con 0x564f637186f0 2023-11-08T19:27:40.797 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.774+0000 7f2ff1ac0b80 1 -- 172.21.15.149:0/2247286066 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564f637186f0 msgr2=0x564f63748450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:40.798 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.774+0000 7f2ff1ac0b80 1 --2- 172.21.15.149:0/2247286066 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564f637186f0 0x564f63748450 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f2fd4007350 tx=0x7f2fd4015000 comp rx=0 tx=0).stop 2023-11-08T19:27:40.798 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.774+0000 7f2ff1ac0b80 1 -- 172.21.15.149:0/2247286066 shutdown_connections 2023-11-08T19:27:40.798 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.774+0000 7f2ff1ac0b80 1 --2- 172.21.15.149:0/2247286066 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x564f63718ad0 0x564f63732f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:40.798 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.774+0000 7f2ff1ac0b80 1 --2- 172.21.15.149:0/2247286066 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564f637186f0 0x564f63748450 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:40.799 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.774+0000 7f2ff1ac0b80 1 --2- 172.21.15.149:0/2247286066 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564f6371ac30 0x564f63748990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:40.799 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.774+0000 7f2ff1ac0b80 1 -- 172.21.15.149:0/2247286066 >> 172.21.15.149:0/2247286066 conn(0x564f63693660 msgr2=0x564f6371e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:40.799 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.774+0000 7f2ff1ac0b80 1 -- 172.21.15.149:0/2247286066 shutdown_connections 2023-11-08T19:27:40.799 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.774+0000 7f2ff1ac0b80 1 -- 172.21.15.149:0/2247286066 wait complete. 2023-11-08T19:27:40.799 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.775+0000 7f2ff1ac0b80 1 -- start start 2023-11-08T19:27:40.800 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.775+0000 7f2ff1ac0b80 1 Processor -- start 2023-11-08T19:27:40.800 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.776+0000 7f2ff1ac0b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564f637186f0 0x564f6375a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:40.800 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.776+0000 7f2ff1ac0b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564f63718ad0 0x564f637723a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:40.800 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.776+0000 7f2ff1ac0b80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x564f637339a0 0x564f6374a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:40.800 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.776+0000 7f2ff1ac0b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f636715c0 con 0x564f637186f0 2023-11-08T19:27:40.801 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.776+0000 7f2ff1ac0b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f6360d0d0 con 0x564f63718ad0 2023-11-08T19:27:40.801 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.776+0000 7f2ff1ac0b80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x564f6360cd70 con 0x564f637339a0 2023-11-08T19:27:40.801 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.776+0000 7f2ff1ac0b80 10 client.0 _ll_register_callbacks cb 0x564f634697b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-08T19:27:40.801 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.776+0000 7f2fdeffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564f637186f0 0x564f6375a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:40.802 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.776+0000 7f2fdeffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564f637186f0 0x564f6375a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44032/0 (socket says 172.21.15.149:44032) 2023-11-08T19:27:40.802 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.776+0000 7f2fdeffd700 1 -- 172.21.15.149:0/3433698511 learned_addr learned my addr 172.21.15.149:0/3433698511 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:27:40.802 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.776+0000 7f2fde7fc700 1 --2- 172.21.15.149:0/3433698511 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564f63718ad0 0x564f637723a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:40.802 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.776+0000 7f2fdf7fe700 1 --2- 172.21.15.149:0/3433698511 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x564f637339a0 0x564f6374a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:40.802 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.776+0000 7f2fdeffd700 1 -- 172.21.15.149:0/3433698511 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x564f637339a0 msgr2=0x564f6374a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:40.803 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.776+0000 7f2fdeffd700 1 --2- 172.21.15.149:0/3433698511 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x564f637339a0 0x564f6374a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:40.803 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.776+0000 7f2fdeffd700 1 -- 172.21.15.149:0/3433698511 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564f63718ad0 msgr2=0x564f637723a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:40.803 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.776+0000 7f2fdeffd700 1 --2- 172.21.15.149:0/3433698511 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564f63718ad0 0x564f637723a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:40.803 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.776+0000 7f2fdeffd700 1 -- 172.21.15.149:0/3433698511 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fe00cb7e0 con 0x564f637186f0 2023-11-08T19:27:40.803 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.776+0000 7f2fdeffd700 1 --2- 172.21.15.149:0/3433698511 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564f637186f0 0x564f6375a500 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x564f63749590 tx=0x7f2fd4004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8c7699754b08b8e server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:40.804 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.776+0000 7f2fbe7fc700 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2023-11-08T19:27:40.804 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.776+0000 7f2fbe7fc700 1 -- 172.21.15.149:0/3433698511 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd4023be0 con 0x564f637186f0 2023-11-08T19:27:40.804 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.776+0000 7f2fbe7fc700 1 -- 172.21.15.149:0/3433698511 <== mon.0 v2:172.21.15.149:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 7206+0+0 (secure 0 0 0) 0x7f2fd4023d40 con 0x564f637186f0 2023-11-08T19:27:40.804 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.776+0000 7f2ff1ac0b80 1 -- 172.21.15.149:0/3433698511 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564f63710880 con 0x564f637186f0 2023-11-08T19:27:40.804 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.776+0000 7f2fbe7fc700 1 -- 172.21.15.149:0/3433698511 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2fd402d440 con 0x564f637186f0 2023-11-08T19:27:40.805 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.776+0000 7f2ff1ac0b80 10 client.7497 fetch_fsmap learned FSMap version 67 2023-11-08T19:27:40.805 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.777+0000 7f2ff1ac0b80 1 -- 172.21.15.149:0/3433698511 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=2+}) v3 -- 0x564f6349ad90 con 0x564f637186f0 2023-11-08T19:27:40.805 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.777+0000 7f2fbe7fc700 1 -- 172.21.15.149:0/3433698511 <== mon.0 v2:172.21.15.149:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564f63710880 con 0x564f637186f0 2023-11-08T19:27:40.805 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.777+0000 7f2fbe7fc700 1 -- 172.21.15.149:0/3433698511 <== mon.0 v2:172.21.15.149:3300/0 5 ==== fsmap(e 67) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f2fd4020040 con 0x564f637186f0 2023-11-08T19:27:40.805 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.777+0000 7f2ff1ac0b80 10 client.7497 fetch_fsmap finished waiting for FSMap version 67 2023-11-08T19:27:40.806 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.777+0000 7f2ff1ac0b80 10 client.7497 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-08T19:27:40.806 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.777+0000 7f2ff1ac0b80 20 client.7497 populate_metadata read hostname 'smithi149' 2023-11-08T19:27:40.806 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.777+0000 7f2ff1ac0b80 1 --2- 172.21.15.149:0/3433698511 >> [v2:172.21.15.149:6834/589971879,v1:172.21.15.149:6836/589971879] conn(0x564f63765550 0x564f63776090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:40.806 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.777+0000 7f2ff1ac0b80 4 client.7497 mds_command: new command op to 7122 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-08T19:27:40.806 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.777+0000 7f2ff1ac0b80 1 -- 172.21.15.149:0/3433698511 --> [v2:172.21.15.149:6834/589971879,v1:172.21.15.149:6836/589971879] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564f636eca30 con 0x564f63765550 2023-11-08T19:27:40.807 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.777+0000 7f2fde7fc700 1 --2- 172.21.15.149:0/3433698511 >> [v2:172.21.15.149:6834/589971879,v1:172.21.15.149:6836/589971879] conn(0x564f63765550 0x564f63776090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:40.807 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.777+0000 7f2fbe7fc700 10 client.7497 ms_handle_connect on v2:172.21.15.149:6834/589971879 2023-11-08T19:27:40.807 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.777+0000 7f2fde7fc700 1 --2- 172.21.15.149:0/3433698511 >> [v2:172.21.15.149:6834/589971879,v1:172.21.15.149:6836/589971879] conn(0x564f63765550 0x564f63776090 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d4d95e2ec238db server_cookie=99018a480437394d in_seq=0 out_seq=0 2023-11-08T19:27:40.807 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.778+0000 7f2fbe7fc700 1 -- 172.21.15.149:0/3433698511 <== mds.0 v2:172.21.15.149:6834/589971879 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564f636eca30 con 0x564f63765550 2023-11-08T19:27:40.807 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.778+0000 7f2fbe7fc700 10 client.7497 handle_command_reply: tid=0 2023-11-08T19:27:40.808 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.778+0000 7f2ff1ac0b80 1 client.7497 shutdown 2023-11-08T19:27:40.808 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.778+0000 7f2ff1ac0b80 1 -- 172.21.15.149:0/3433698511 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564f637186f0 msgr2=0x564f6375a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:40.808 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.778+0000 7f2ff1ac0b80 1 --2- 172.21.15.149:0/3433698511 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564f637186f0 0x564f6375a500 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x564f63749590 tx=0x7f2fd4004f90 comp rx=0 tx=0).stop 2023-11-08T19:27:40.808 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.778+0000 7f2ff1ac0b80 1 -- 172.21.15.149:0/3433698511 shutdown_connections 2023-11-08T19:27:40.808 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.778+0000 7f2ff1ac0b80 1 --2- 172.21.15.149:0/3433698511 >> [v2:172.21.15.149:6834/589971879,v1:172.21.15.149:6836/589971879] conn(0x564f63765550 0x564f63776090 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:40.809 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.778+0000 7f2ff1ac0b80 1 --2- 172.21.15.149:0/3433698511 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x564f637339a0 0x564f6374a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:40.809 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.778+0000 7f2fbe7fc700 0 client.7497 ms_handle_reset on v2:172.21.15.149:6834/589971879 2023-11-08T19:27:40.809 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.778+0000 7f2ff1ac0b80 1 --2- 172.21.15.149:0/3433698511 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564f637186f0 0x564f6375a500 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:40.809 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.778+0000 7f2ff1ac0b80 1 --2- 172.21.15.149:0/3433698511 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564f63718ad0 0x564f637723a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:40.809 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.778+0000 7f2ff1ac0b80 1 -- 172.21.15.149:0/3433698511 >> 172.21.15.149:0/3433698511 conn(0x564f63693660 msgr2=0x564f63764580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:40.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.778+0000 7f2ff1ac0b80 1 -- 172.21.15.149:0/3433698511 shutdown_connections 2023-11-08T19:27:40.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.778+0000 7f2ff1ac0b80 1 -- 172.21.15.149:0/3433698511 wait complete. 2023-11-08T19:27:40.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.778+0000 7f2ff1ac0b80 20 client.7497 trim_cache size 0 max 16384 2023-11-08T19:27:40.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.796+0000 7f2ff1ac0b80 1 Processor -- start 2023-11-08T19:27:40.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.796+0000 7f2ff1ac0b80 1 -- start start 2023-11-08T19:27:40.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.797+0000 7f2ff1ac0b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564f637186f0 0x564f6375d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:40.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.797+0000 7f2ff1ac0b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564f63718ad0 0x564f63732570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:40.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.797+0000 7f2ff1ac0b80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x564f637339a0 0x564f63717500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:40.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.797+0000 7f2ff1ac0b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f634f08d0 con 0x564f637186f0 2023-11-08T19:27:40.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.797+0000 7f2ff1ac0b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f63763f90 con 0x564f63718ad0 2023-11-08T19:27:40.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.797+0000 7f2ff1ac0b80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x564f63765f10 con 0x564f637339a0 2023-11-08T19:27:40.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.797+0000 7f2fdeffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564f637186f0 0x564f6375d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:40.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.797+0000 7f2fdeffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564f637186f0 0x564f6375d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44040/0 (socket says 172.21.15.149:44040) 2023-11-08T19:27:40.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.797+0000 7f2fdeffd700 1 -- 172.21.15.149:0/887130446 learned_addr learned my addr 172.21.15.149:0/887130446 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:27:40.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.798+0000 7f2fde7fc700 1 --2- 172.21.15.149:0/887130446 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564f63718ad0 0x564f63732570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:40.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.798+0000 7f2fdf7fe700 1 --2- 172.21.15.149:0/887130446 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x564f637339a0 0x564f63717500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:40.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.798+0000 7f2fdeffd700 1 -- 172.21.15.149:0/887130446 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x564f637339a0 msgr2=0x564f63717500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:40.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.798+0000 7f2fdeffd700 1 --2- 172.21.15.149:0/887130446 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x564f637339a0 0x564f63717500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:40.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.798+0000 7f2fdeffd700 1 -- 172.21.15.149:0/887130446 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564f63718ad0 msgr2=0x564f63732570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:40.820 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.798+0000 7f2fdeffd700 1 --2- 172.21.15.149:0/887130446 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564f63718ad0 0x564f63732570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:40.820 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.798+0000 7f2fdeffd700 1 -- 172.21.15.149:0/887130446 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564f63483c10 con 0x564f637186f0 2023-11-08T19:27:40.820 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.798+0000 7f2fdf7fe700 1 --2- 172.21.15.149:0/887130446 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x564f637339a0 0x564f63717500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:27:40.820 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.798+0000 7f2fdeffd700 1 --2- 172.21.15.149:0/887130446 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564f637186f0 0x564f6375d9d0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f2fd40332a0 tx=0x7f2fd4021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=365cdd953c3c48c7 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:40.820 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.798+0000 7f2fc5ffb700 1 -- 172.21.15.149:0/887130446 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd40239e0 con 0x564f637186f0 2023-11-08T19:27:40.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.798+0000 7f2fc5ffb700 1 -- 172.21.15.149:0/887130446 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fd4033e90 con 0x564f637186f0 2023-11-08T19:27:40.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.798+0000 7f2fc5ffb700 1 -- 172.21.15.149:0/887130446 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd4023d60 con 0x564f637186f0 2023-11-08T19:27:40.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.799+0000 7f2ff1ac0b80 1 -- 172.21.15.149:0/887130446 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564f637186f0 msgr2=0x564f6375d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:40.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.799+0000 7f2ff1ac0b80 1 --2- 172.21.15.149:0/887130446 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564f637186f0 0x564f6375d9d0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f2fd40332a0 tx=0x7f2fd4021000 comp rx=0 tx=0).stop 2023-11-08T19:27:40.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.799+0000 7f2ff1ac0b80 1 -- 172.21.15.149:0/887130446 shutdown_connections 2023-11-08T19:27:40.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.799+0000 7f2ff1ac0b80 1 --2- 172.21.15.149:0/887130446 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x564f637339a0 0x564f63717500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:40.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.799+0000 7f2ff1ac0b80 1 --2- 172.21.15.149:0/887130446 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564f637186f0 0x564f6375d9d0 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:40.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.799+0000 7f2ff1ac0b80 1 --2- 172.21.15.149:0/887130446 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564f63718ad0 0x564f63732570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:40.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.799+0000 7f2ff1ac0b80 1 -- 172.21.15.149:0/887130446 >> 172.21.15.149:0/887130446 conn(0x564f63693660 msgr2=0x564f63764580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:40.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.799+0000 7f2ff1ac0b80 1 -- 172.21.15.149:0/887130446 shutdown_connections 2023-11-08T19:27:40.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.799+0000 7f2ff1ac0b80 1 -- 172.21.15.149:0/887130446 wait complete. 2023-11-08T19:27:40.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.799+0000 7f2ff1ac0b80 1 -- start start 2023-11-08T19:27:40.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.799+0000 7f2ff1ac0b80 1 Processor -- start 2023-11-08T19:27:40.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.800+0000 7f2ff1ac0b80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x564f637186f0 0x564f637719c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:40.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.800+0000 7f2ff1ac0b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564f63718ad0 0x564f63749510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:40.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.800+0000 7f2ff1ac0b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564f637339a0 0x564f637cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:40.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.800+0000 7f2ff1ac0b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f63749e10 con 0x564f63718ad0 2023-11-08T19:27:40.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.800+0000 7f2ff1ac0b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f63748be0 con 0x564f637339a0 2023-11-08T19:27:40.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.800+0000 7f2ff1ac0b80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x564f63748e30 con 0x564f637186f0 2023-11-08T19:27:40.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.800+0000 7f2ff1ac0b80 10 client.0 _ll_register_callbacks cb 0x7f2fd4026070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-08T19:27:40.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.800+0000 7f2fde7fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564f63718ad0 0x564f63749510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:40.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.800+0000 7f2fde7fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564f63718ad0 0x564f63749510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44048/0 (socket says 172.21.15.149:44048) 2023-11-08T19:27:40.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.800+0000 7f2fde7fc700 1 -- 172.21.15.149:0/3556199296 learned_addr learned my addr 172.21.15.149:0/3556199296 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:27:40.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.800+0000 7f2fdeffd700 1 --2- 172.21.15.149:0/3556199296 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x564f637186f0 0x564f637719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:40.826 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.800+0000 7f2fdf7fe700 1 --2- 172.21.15.149:0/3556199296 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564f637339a0 0x564f637cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:40.826 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.800+0000 7f2fde7fc700 1 -- 172.21.15.149:0/3556199296 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x564f637186f0 msgr2=0x564f637719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:40.826 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.800+0000 7f2fde7fc700 1 --2- 172.21.15.149:0/3556199296 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x564f637186f0 0x564f637719c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:40.826 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.800+0000 7f2fde7fc700 1 -- 172.21.15.149:0/3556199296 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564f637339a0 msgr2=0x564f637cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:40.826 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.800+0000 7f2fde7fc700 1 --2- 172.21.15.149:0/3556199296 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564f637339a0 0x564f637cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:40.827 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.800+0000 7f2fde7fc700 1 -- 172.21.15.149:0/3556199296 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564f6349ad90 con 0x564f63718ad0 2023-11-08T19:27:40.827 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.800+0000 7f2fdf7fe700 1 --2- 172.21.15.149:0/3556199296 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564f637339a0 0x564f637cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:27:40.827 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.801+0000 7f2fde7fc700 1 --2- 172.21.15.149:0/3556199296 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564f63718ad0 0x564f63749510 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f2fd0059030 tx=0x7f2fd0058cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6ad83b2988f31ab server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:40.827 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.801+0000 7f2fbe7fc700 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2023-11-08T19:27:40.828 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.801+0000 7f2fbe7fc700 1 -- 172.21.15.149:0/3556199296 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd000a7d0 con 0x564f63718ad0 2023-11-08T19:27:40.828 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.801+0000 7f2fbe7fc700 1 -- 172.21.15.149:0/3556199296 <== mon.0 v2:172.21.15.149:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 7206+0+0 (secure 0 0 0) 0x7f2fd00590a0 con 0x564f63718ad0 2023-11-08T19:27:40.828 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.801+0000 7f2ff1ac0b80 1 -- 172.21.15.149:0/3556199296 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2fd40158d0 con 0x564f63718ad0 2023-11-08T19:27:40.828 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.801+0000 7f2fbe7fc700 1 -- 172.21.15.149:0/3556199296 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2fd005d1f0 con 0x564f63718ad0 2023-11-08T19:27:40.828 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.801+0000 7f2ff1ac0b80 10 client.7503 fetch_fsmap learned FSMap version 67 2023-11-08T19:27:40.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.801+0000 7f2ff1ac0b80 1 -- 172.21.15.149:0/3556199296 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=2+}) v3 -- 0x564f634c1200 con 0x564f63718ad0 2023-11-08T19:27:40.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.801+0000 7f2fbe7fc700 1 -- 172.21.15.149:0/3556199296 <== mon.0 v2:172.21.15.149:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fd40158d0 con 0x564f63718ad0 2023-11-08T19:27:40.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.801+0000 7f2fbe7fc700 1 -- 172.21.15.149:0/3556199296 <== mon.0 v2:172.21.15.149:3300/0 5 ==== fsmap(e 67) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f2fd0059300 con 0x564f63718ad0 2023-11-08T19:27:40.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.801+0000 7f2ff1ac0b80 10 client.7503 fetch_fsmap finished waiting for FSMap version 67 2023-11-08T19:27:40.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.801+0000 7f2ff1ac0b80 10 client.7503 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-08T19:27:40.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.801+0000 7f2ff1ac0b80 20 client.7503 populate_metadata read hostname 'smithi149' 2023-11-08T19:27:40.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.801+0000 7f2ff1ac0b80 1 --2- 172.21.15.149:0/3556199296 >> [v2:172.21.15.149:6834/589971879,v1:172.21.15.149:6836/589971879] conn(0x564f6377c370 0x564f63717500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:40.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.801+0000 7f2ff1ac0b80 4 client.7503 mds_command: new command op to 7122 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-08T19:27:40.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.801+0000 7f2ff1ac0b80 1 -- 172.21.15.149:0/3556199296 --> [v2:172.21.15.149:6834/589971879,v1:172.21.15.149:6836/589971879] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564f6366a5a0 con 0x564f6377c370 2023-11-08T19:27:40.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.801+0000 7f2fdeffd700 1 --2- 172.21.15.149:0/3556199296 >> [v2:172.21.15.149:6834/589971879,v1:172.21.15.149:6836/589971879] conn(0x564f6377c370 0x564f63717500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:40.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.802+0000 7f2fbe7fc700 10 client.7503 ms_handle_connect on v2:172.21.15.149:6834/589971879 2023-11-08T19:27:40.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.802+0000 7f2fdeffd700 1 --2- 172.21.15.149:0/3556199296 >> [v2:172.21.15.149:6834/589971879,v1:172.21.15.149:6836/589971879] conn(0x564f6377c370 0x564f63717500 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a1eff13097e2997 server_cookie=1ace2a893f5d0565 in_seq=0 out_seq=0 2023-11-08T19:27:40.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.802+0000 7f2fbe7fc700 1 -- 172.21.15.149:0/3556199296 <== mds.0 v2:172.21.15.149:6834/589971879 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x564f6366a5a0 con 0x564f6377c370 2023-11-08T19:27:40.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.802+0000 7f2fbe7fc700 10 client.7503 handle_command_reply: tid=0 2023-11-08T19:27:40.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.802+0000 7f2ff1ac0b80 1 client.7503 shutdown 2023-11-08T19:27:40.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.802+0000 7f2ff1ac0b80 1 -- 172.21.15.149:0/3556199296 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564f63718ad0 msgr2=0x564f63749510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:40.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.802+0000 7f2ff1ac0b80 1 --2- 172.21.15.149:0/3556199296 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564f63718ad0 0x564f63749510 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f2fd0059030 tx=0x7f2fd0058cb0 comp rx=0 tx=0).stop 2023-11-08T19:27:40.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.802+0000 7f2ff1ac0b80 1 -- 172.21.15.149:0/3556199296 shutdown_connections 2023-11-08T19:27:40.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.802+0000 7f2ff1ac0b80 1 --2- 172.21.15.149:0/3556199296 >> [v2:172.21.15.149:6834/589971879,v1:172.21.15.149:6836/589971879] conn(0x564f6377c370 0x564f63717500 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:40.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.802+0000 7f2ff1ac0b80 1 --2- 172.21.15.149:0/3556199296 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564f637339a0 0x564f637cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:40.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.802+0000 7f2fbe7fc700 0 client.7503 ms_handle_reset on v2:172.21.15.149:6834/589971879 2023-11-08T19:27:40.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.802+0000 7f2ff1ac0b80 1 --2- 172.21.15.149:0/3556199296 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x564f637186f0 0x564f637719c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:40.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.802+0000 7f2ff1ac0b80 1 --2- 172.21.15.149:0/3556199296 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564f63718ad0 0x564f63749510 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:40.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.802+0000 7f2ff1ac0b80 1 -- 172.21.15.149:0/3556199296 >> 172.21.15.149:0/3556199296 conn(0x564f63693660 msgr2=0x564f63764530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:40.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.802+0000 7f2ff1ac0b80 1 -- 172.21.15.149:0/3556199296 shutdown_connections 2023-11-08T19:27:40.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.802+0000 7f2ff1ac0b80 1 -- 172.21.15.149:0/3556199296 wait complete. 2023-11-08T19:27:40.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.802+0000 7f2ff1ac0b80 20 client.7503 trim_cache size 0 max 16384 2023-11-08T19:27:40.835 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2023-11-08T19:27:40.835 INFO:teuthology.orchestra.run.smithi149.stdout: "cluster_fsid": "0aba7c70-fe80-4446-a2f5-7502ac3adfb4", 2023-11-08T19:27:40.835 INFO:teuthology.orchestra.run.smithi149.stdout: "whoami": 0, 2023-11-08T19:27:40.836 INFO:teuthology.orchestra.run.smithi149.stdout: "id": 7122, 2023-11-08T19:27:40.836 INFO:teuthology.orchestra.run.smithi149.stdout: "want_state": "up:active", 2023-11-08T19:27:40.836 INFO:teuthology.orchestra.run.smithi149.stdout: "state": "up:active", 2023-11-08T19:27:40.836 INFO:teuthology.orchestra.run.smithi149.stdout: "fs_name": "cephfs", 2023-11-08T19:27:40.836 INFO:teuthology.orchestra.run.smithi149.stdout: "rank_uptime": 6.7461607079999997, 2023-11-08T19:27:40.837 INFO:teuthology.orchestra.run.smithi149.stdout: "mdsmap_epoch": 67, 2023-11-08T19:27:40.837 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_epoch": 97, 2023-11-08T19:27:40.837 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_epoch_barrier": 97, 2023-11-08T19:27:40.837 INFO:teuthology.orchestra.run.smithi149.stdout: "uptime": 58.151675048000001 2023-11-08T19:27:40.838 INFO:teuthology.orchestra.run.smithi149.stdout:} 2023-11-08T19:27:40.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.803+0000 7f2fe58c7700 1 -- 172.21.15.149:0/3296634051 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2fcc06af00 msgr2=0x7f2fcc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:40.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.803+0000 7f2fe58c7700 1 --2- 172.21.15.149:0/3296634051 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2fcc06af00 0x7f2fcc06d3c0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f2fd4001050 tx=0x7f2fd4000f80 comp rx=0 tx=0).stop 2023-11-08T19:27:40.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.803+0000 7f2fe58c7700 1 -- 172.21.15.149:0/3296634051 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fe00c5d50 msgr2=0x7f2fe0158300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:40.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.803+0000 7f2fe58c7700 1 --2- 172.21.15.149:0/3296634051 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fe00c5d50 0x7f2fe0158300 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f2fd000e550 tx=0x7f2fd00047c0 comp rx=0 tx=0).stop 2023-11-08T19:27:40.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.803+0000 7f2fe58c7700 1 -- 172.21.15.149:0/3296634051 shutdown_connections 2023-11-08T19:27:40.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.803+0000 7f2fe58c7700 1 --2- 172.21.15.149:0/3296634051 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2fcc06af00 0x7f2fcc06d3c0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:40.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.803+0000 7f2fe58c7700 1 --2- 172.21.15.149:0/3296634051 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2fc8004850 0x7f2fe01f3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:40.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.803+0000 7f2fe58c7700 1 --2- 172.21.15.149:0/3296634051 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2fe015a6c0 0x7f2fe00cdd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:40.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.803+0000 7f2fe58c7700 1 --2- 172.21.15.149:0/3296634051 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fe00c5d50 0x7f2fe0158300 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:40.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.803+0000 7f2fe58c7700 1 -- 172.21.15.149:0/3296634051 >> 172.21.15.149:0/3296634051 conn(0x7f2fe0071720 msgr2=0x7f2fe00c6760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:40.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.803+0000 7f2fe58c7700 1 -- 172.21.15.149:0/3296634051 shutdown_connections 2023-11-08T19:27:40.842 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.803+0000 7f2fe58c7700 1 -- 172.21.15.149:0/3296634051 wait complete. 2023-11-08T19:27:40.842 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-08T19:27:40.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.963+0000 7f5683b05700 1 Processor -- start 2023-11-08T19:27:40.965 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.963+0000 7f5683b05700 1 -- start start 2023-11-08T19:27:40.967 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.964+0000 7f5683b05700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f567c0cc140 0x7f567c0cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:40.967 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.964+0000 7f5683b05700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f567c0b2850 0x7f567c0cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:40.967 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.964+0000 7f5683b05700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f567c0cce50 con 0x7f567c0b2cd0 2023-11-08T19:27:40.968 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.964+0000 7f5683b05700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f567c0b2430 con 0x7f567c0cc140 2023-11-08T19:27:40.968 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.964+0000 7f5683b05700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f567c0cc520 con 0x7f567c0b2850 2023-11-08T19:27:40.968 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.964+0000 7f56810a0700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f567c0b2850 0x7f567c0cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:40.968 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.964+0000 7f56818a1700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f567c0cc140 0x7f567c0cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:40.969 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.964+0000 7f56820a2700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f567c0b2cd0 0x7f567c15d2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.149:57726/0 (socket says 172.21.15.149:57726) 2023-11-08T19:27:40.969 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.964+0000 7f56820a2700 1 -- 172.21.15.149:0/943913782 learned_addr learned my addr 172.21.15.149:0/943913782 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:27:40.969 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.965+0000 7f56810a0700 1 -- 172.21.15.149:0/943913782 >> v2:172.21.15.160:3300/0 conn(0x7f567c0cc140 msgr2=0x7f567c0cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:40.969 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.965+0000 7f56810a0700 1 --2- 172.21.15.149:0/943913782 >> v2:172.21.15.160:3300/0 conn(0x7f567c0cc140 0x7f567c0cc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:40.969 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.965+0000 7f56810a0700 1 -- 172.21.15.149:0/943913782 >> v1:172.21.15.160:6789/0 conn(0x7f567c0b2cd0 legacy=0x7f567c15d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:40.970 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.965+0000 7f56810a0700 1 -- 172.21.15.149:0/943913782 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f567c0b17b0 con 0x7f567c0b2850 2023-11-08T19:27:40.970 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.965+0000 7f56810a0700 1 --2- 172.21.15.149:0/943913782 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f567c0b2850 0x7f567c0cabf0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5678009840 tx=0x7f5678009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2fb2aa9036edb1d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:40.970 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.965+0000 7f568089f700 1 -- 172.21.15.149:0/943913782 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5678011830 con 0x7f567c0b2850 2023-11-08T19:27:40.970 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.965+0000 7f568089f700 1 -- 172.21.15.149:0/943913782 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5678011990 con 0x7f567c0b2850 2023-11-08T19:27:40.970 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.965+0000 7f568089f700 1 -- 172.21.15.149:0/943913782 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5678011d20 con 0x7f567c0b2850 2023-11-08T19:27:40.971 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.966+0000 7f5683b05700 1 -- 172.21.15.149:0/943913782 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f567c0b2850 msgr2=0x7f567c0cabf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:40.971 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.966+0000 7f5683b05700 1 --2- 172.21.15.149:0/943913782 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f567c0b2850 0x7f567c0cabf0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5678009840 tx=0x7f5678009b50 comp rx=0 tx=0).stop 2023-11-08T19:27:40.971 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.966+0000 7f5683b05700 1 -- 172.21.15.149:0/943913782 shutdown_connections 2023-11-08T19:27:40.971 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.966+0000 7f5683b05700 1 --2- 172.21.15.149:0/943913782 >> v2:172.21.15.160:3300/0 conn(0x7f567c0cc140 0x7f567c0cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:40.971 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.966+0000 7f5683b05700 1 --2- 172.21.15.149:0/943913782 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f567c0b2850 0x7f567c0cabf0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:40.972 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.966+0000 7f5683b05700 1 -- 172.21.15.149:0/943913782 >> 172.21.15.149:0/943913782 conn(0x7f567c099a40 msgr2=0x7f567c0d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:40.972 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.966+0000 7f5683b05700 1 -- 172.21.15.149:0/943913782 shutdown_connections 2023-11-08T19:27:40.972 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.966+0000 7f5683b05700 1 -- 172.21.15.149:0/943913782 wait complete. 2023-11-08T19:27:40.977 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.967+0000 7f5683b05700 1 Processor -- start 2023-11-08T19:27:40.977 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.967+0000 7f5683b05700 1 -- start start 2023-11-08T19:27:40.978 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.968+0000 7f5683b05700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f567c0b2850 0x7f567c14eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:40.978 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.968+0000 7f5683b05700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f567c0b2cd0 0x7f567c09a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:40.978 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.968+0000 7f5683b05700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f567c0cc140 0x7f567c15f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:40.978 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.968+0000 7f5683b05700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f567c14f410 con 0x7f567c0cc140 2023-11-08T19:27:40.978 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.968+0000 7f5683b05700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f567c1526c0 con 0x7f567c0b2cd0 2023-11-08T19:27:40.979 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.968+0000 7f5683b05700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f567c151b40 con 0x7f567c0b2850 2023-11-08T19:27:40.979 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.968+0000 7f56820a2700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f567c0cc140 0x7f567c15f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:40.979 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.968+0000 7f56820a2700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f567c0cc140 0x7f567c15f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44064/0 (socket says 172.21.15.149:44064) 2023-11-08T19:27:40.979 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.968+0000 7f56810a0700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f567c0b2cd0 0x7f567c09a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:40.979 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.968+0000 7f56820a2700 1 -- 172.21.15.149:0/2374314595 learned_addr learned my addr 172.21.15.149:0/2374314595 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:27:40.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.968+0000 7f56818a1700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f567c0b2850 0x7f567c14eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:40.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.968+0000 7f56820a2700 1 -- 172.21.15.149:0/2374314595 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f567c0b2850 msgr2=0x7f567c14eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:40.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.968+0000 7f56820a2700 1 --2- 172.21.15.149:0/2374314595 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f567c0b2850 0x7f567c14eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:40.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.968+0000 7f56820a2700 1 -- 172.21.15.149:0/2374314595 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f567c0b2cd0 msgr2=0x7f567c09a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:40.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.968+0000 7f56820a2700 1 --2- 172.21.15.149:0/2374314595 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f567c0b2cd0 0x7f567c09a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:40.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.968+0000 7f56820a2700 1 -- 172.21.15.149:0/2374314595 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56780094a0 con 0x7f567c0cc140 2023-11-08T19:27:40.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.968+0000 7f56820a2700 1 --2- 172.21.15.149:0/2374314595 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f567c0cc140 0x7f567c15f5f0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f567400cbc0 tx=0x7f567400ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:40.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.968+0000 7f56727fc700 1 -- 172.21.15.149:0/2374314595 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f567400a9e0 con 0x7f567c0cc140 2023-11-08T19:27:40.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.968+0000 7f56727fc700 1 -- 172.21.15.149:0/2374314595 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f567400ab40 con 0x7f567c0cc140 2023-11-08T19:27:40.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.968+0000 7f5683b05700 1 -- 172.21.15.149:0/2374314595 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f567c151e20 con 0x7f567c0cc140 2023-11-08T19:27:40.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.968+0000 7f56727fc700 1 -- 172.21.15.149:0/2374314595 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5674012400 con 0x7f567c0cc140 2023-11-08T19:27:40.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.969+0000 7f5683b05700 1 -- 172.21.15.149:0/2374314595 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f567c1523e0 con 0x7f567c0cc140 2023-11-08T19:27:40.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.970+0000 7f56727fc700 1 -- 172.21.15.149:0/2374314595 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f567401b3b0 con 0x7f567c0cc140 2023-11-08T19:27:40.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.970+0000 7f56727fc700 1 --2- 172.21.15.149:0/2374314595 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f566006af30 0x7f566006d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:40.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.970+0000 7f56727fc700 1 -- 172.21.15.149:0/2374314595 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 7206+0+0 (secure 0 0 0) 0x7f5674089670 con 0x7f567c0cc140 2023-11-08T19:27:40.983 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.971+0000 7f56818a1700 1 --2- 172.21.15.149:0/2374314595 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f566006af30 0x7f566006d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:40.983 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.971+0000 7f56818a1700 1 --2- 172.21.15.149:0/2374314595 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f566006af30 0x7f566006d3f0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f566c009b20 tx=0x7f566c0091c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:40.983 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.972+0000 7f568fcfeb80 1 Processor -- start 2023-11-08T19:27:40.983 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.972+0000 7f568fcfeb80 1 -- start start 2023-11-08T19:27:40.983 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.973+0000 7f568fcfeb80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5589535e46f0 0x558953614450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:40.984 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.973+0000 7f568fcfeb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5589535e6c30 0x558953614990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:40.984 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.973+0000 7f568fcfeb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5589535e4ad0 0x5589535fef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:40.984 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.973+0000 7f568fcfeb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589535506e0 con 0x5589535e6c30 2023-11-08T19:27:40.984 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.973+0000 7f568fcfeb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589535443b0 con 0x5589535e4ad0 2023-11-08T19:27:40.984 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.973+0000 7f568fcfeb80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x558953541cd0 con 0x5589535e46f0 2023-11-08T19:27:40.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.973+0000 7f56810a0700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5589535e6c30 0x558953614990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:40.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.973+0000 7f56810a0700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5589535e6c30 0x558953614990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44068/0 (socket says 172.21.15.149:44068) 2023-11-08T19:27:40.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.973+0000 7f56810a0700 1 -- 172.21.15.149:0/230512059 learned_addr learned my addr 172.21.15.149:0/230512059 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:27:40.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.973+0000 7f56818a1700 1 --2- 172.21.15.149:0/230512059 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5589535e46f0 0x558953614450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:40.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.973+0000 7f56820a2700 1 --2- 172.21.15.149:0/230512059 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5589535e4ad0 0x5589535fef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:40.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.974+0000 7f56810a0700 1 -- 172.21.15.149:0/230512059 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5589535e46f0 msgr2=0x558953614450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:40.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.974+0000 7f56810a0700 1 --2- 172.21.15.149:0/230512059 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5589535e46f0 0x558953614450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:40.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.974+0000 7f56810a0700 1 -- 172.21.15.149:0/230512059 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5589535e4ad0 msgr2=0x5589535fef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:40.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.974+0000 7f56810a0700 1 --2- 172.21.15.149:0/230512059 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5589535e4ad0 0x5589535fef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:40.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.974+0000 7f56810a0700 1 -- 172.21.15.149:0/230512059 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5589533ba5e0 con 0x5589535e6c30 2023-11-08T19:27:40.987 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.974+0000 7f56818a1700 1 --2- 172.21.15.149:0/230512059 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5589535e46f0 0x558953614450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:27:40.987 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.974+0000 7f56820a2700 1 --2- 172.21.15.149:0/230512059 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5589535e4ad0 0x5589535fef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:27:40.987 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.974+0000 7f56810a0700 1 --2- 172.21.15.149:0/230512059 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5589535e6c30 0x558953614990 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f567c0cc660 tx=0x7f5678010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e031d4324e114fc server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:40.987 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.974+0000 7f565f7fe700 1 -- 172.21.15.149:0/230512059 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5678020070 con 0x5589535e6c30 2023-11-08T19:27:40.987 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.974+0000 7f565f7fe700 1 -- 172.21.15.149:0/230512059 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5678011b00 con 0x5589535e6c30 2023-11-08T19:27:40.988 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.974+0000 7f565f7fe700 1 -- 172.21.15.149:0/230512059 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5678004040 con 0x5589535e6c30 2023-11-08T19:27:40.988 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.975+0000 7f568fcfeb80 1 -- 172.21.15.149:0/230512059 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5589535e6c30 msgr2=0x558953614990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:40.988 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.975+0000 7f568fcfeb80 1 --2- 172.21.15.149:0/230512059 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5589535e6c30 0x558953614990 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f567c0cc660 tx=0x7f5678010000 comp rx=0 tx=0).stop 2023-11-08T19:27:40.988 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.975+0000 7f568fcfeb80 1 -- 172.21.15.149:0/230512059 shutdown_connections 2023-11-08T19:27:40.988 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.975+0000 7f568fcfeb80 1 --2- 172.21.15.149:0/230512059 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5589535e4ad0 0x5589535fef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:40.989 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.975+0000 7f568fcfeb80 1 --2- 172.21.15.149:0/230512059 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5589535e46f0 0x558953614450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:40.989 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.975+0000 7f568fcfeb80 1 --2- 172.21.15.149:0/230512059 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5589535e6c30 0x558953614990 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:40.989 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.975+0000 7f568fcfeb80 1 -- 172.21.15.149:0/230512059 >> 172.21.15.149:0/230512059 conn(0x55895355f660 msgr2=0x5589535ea3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:40.989 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.975+0000 7f568fcfeb80 1 -- 172.21.15.149:0/230512059 shutdown_connections 2023-11-08T19:27:40.989 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.975+0000 7f568fcfeb80 1 -- 172.21.15.149:0/230512059 wait complete. 2023-11-08T19:27:40.989 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.975+0000 7f568fcfeb80 1 -- start start 2023-11-08T19:27:40.990 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.975+0000 7f568fcfeb80 1 Processor -- start 2023-11-08T19:27:40.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.977+0000 7f568fcfeb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5589535e46f0 0x558953611ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:40.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.977+0000 7f568fcfeb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5589535e4ad0 0x558953626f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:40.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.977+0000 7f568fcfeb80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x558953614000 0x558953614480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:40.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.977+0000 7f568fcfeb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55895353d5c0 con 0x5589535e4ad0 2023-11-08T19:27:40.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.977+0000 7f568fcfeb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589534d90d0 con 0x5589535e46f0 2023-11-08T19:27:40.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.977+0000 7f568fcfeb80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x5589534d8d70 con 0x558953614000 2023-11-08T19:27:40.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.977+0000 7f568fcfeb80 10 client.0 _ll_register_callbacks cb 0x5589533357b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-08T19:27:40.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.977+0000 7f56810a0700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5589535e4ad0 0x558953626f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:40.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.977+0000 7f56810a0700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5589535e4ad0 0x558953626f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44076/0 (socket says 172.21.15.149:44076) 2023-11-08T19:27:40.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.977+0000 7f56810a0700 1 -- 172.21.15.149:0/116999830 learned_addr learned my addr 172.21.15.149:0/116999830 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:27:40.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.977+0000 7f56818a1700 1 --2- 172.21.15.149:0/116999830 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5589535e46f0 0x558953611ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:40.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.977+0000 7f56820a2700 1 --2- 172.21.15.149:0/116999830 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x558953614000 0x558953614480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:40.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.977+0000 7f56810a0700 1 -- 172.21.15.149:0/116999830 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x558953614000 msgr2=0x558953614480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:40.997 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.977+0000 7f56810a0700 1 --2- 172.21.15.149:0/116999830 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x558953614000 0x558953614480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:40.997 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.977+0000 7f56810a0700 1 -- 172.21.15.149:0/116999830 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5589535e46f0 msgr2=0x558953611ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:40.997 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.977+0000 7f56810a0700 1 --2- 172.21.15.149:0/116999830 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5589535e46f0 0x558953611ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:40.997 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.977+0000 7f56810a0700 1 -- 172.21.15.149:0/116999830 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f567c0b17b0 con 0x5589535e4ad0 2023-11-08T19:27:40.997 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.977+0000 7f56818a1700 1 --2- 172.21.15.149:0/116999830 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5589535e46f0 0x558953611ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:27:40.998 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.977+0000 7f56810a0700 1 --2- 172.21.15.149:0/116999830 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5589535e4ad0 0x558953626f10 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f5678000c00 tx=0x7f56780047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14cd26c97e26a9bc server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:40.998 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.977+0000 7f565cff9700 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2023-11-08T19:27:40.998 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.977+0000 7f565cff9700 1 -- 172.21.15.149:0/116999830 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5678004550 con 0x5589535e4ad0 2023-11-08T19:27:40.998 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.977+0000 7f565cff9700 1 -- 172.21.15.149:0/116999830 <== mon.0 v2:172.21.15.149:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 7206+0+0 (secure 0 0 0) 0x7f56780036a0 con 0x5589535e4ad0 2023-11-08T19:27:40.998 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.977+0000 7f568fcfeb80 1 -- 172.21.15.149:0/116999830 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5589535dc880 con 0x5589535e4ad0 2023-11-08T19:27:40.999 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.978+0000 7f565cff9700 1 -- 172.21.15.149:0/116999830 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5678003860 con 0x5589535e4ad0 2023-11-08T19:27:40.999 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.978+0000 7f568fcfeb80 10 client.7512 fetch_fsmap learned FSMap version 67 2023-11-08T19:27:40.999 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.978+0000 7f568fcfeb80 1 -- 172.21.15.149:0/116999830 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=2+}) v3 -- 0x558953366d90 con 0x5589535e4ad0 2023-11-08T19:27:40.999 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.978+0000 7f565cff9700 1 -- 172.21.15.149:0/116999830 <== mon.0 v2:172.21.15.149:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5589535dc880 con 0x5589535e4ad0 2023-11-08T19:27:40.999 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.978+0000 7f565cff9700 1 -- 172.21.15.149:0/116999830 <== mon.0 v2:172.21.15.149:3300/0 5 ==== fsmap(e 67) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f56780039c0 con 0x5589535e4ad0 2023-11-08T19:27:41.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.978+0000 7f568fcfeb80 10 client.7512 fetch_fsmap finished waiting for FSMap version 67 2023-11-08T19:27:41.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.978+0000 7f568fcfeb80 10 client.7512 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-08T19:27:41.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.978+0000 7f568fcfeb80 20 client.7512 populate_metadata read hostname 'smithi149' 2023-11-08T19:27:41.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.978+0000 7f568fcfeb80 1 --2- 172.21.15.149:0/116999830 >> [v2:172.21.15.149:6835/3917392643,v1:172.21.15.149:6837/3917392643] conn(0x558953617060 0x558953641c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:41.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.978+0000 7f568fcfeb80 4 client.7512 mds_command: new command op to 7125 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-08T19:27:41.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.978+0000 7f568fcfeb80 1 -- 172.21.15.149:0/116999830 --> [v2:172.21.15.149:6835/3917392643,v1:172.21.15.149:6837/3917392643] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5589535b8a30 con 0x558953617060 2023-11-08T19:27:41.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.978+0000 7f56818a1700 1 --2- 172.21.15.149:0/116999830 >> [v2:172.21.15.149:6835/3917392643,v1:172.21.15.149:6837/3917392643] conn(0x558953617060 0x558953641c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:41.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.978+0000 7f565cff9700 10 client.7512 ms_handle_connect on v2:172.21.15.149:6835/3917392643 2023-11-08T19:27:41.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.978+0000 7f56818a1700 1 --2- 172.21.15.149:0/116999830 >> [v2:172.21.15.149:6835/3917392643,v1:172.21.15.149:6837/3917392643] conn(0x558953617060 0x558953641c70 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d5ed031f9f1f7187 server_cookie=aa264f1dc991b2bf in_seq=0 out_seq=0 2023-11-08T19:27:41.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.979+0000 7f565cff9700 1 -- 172.21.15.149:0/116999830 <== mds.1 v2:172.21.15.149:6835/3917392643 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5589535b8a30 con 0x558953617060 2023-11-08T19:27:41.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.979+0000 7f565cff9700 10 client.7512 handle_command_reply: tid=0 2023-11-08T19:27:41.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.979+0000 7f568fcfeb80 1 client.7512 shutdown 2023-11-08T19:27:41.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.979+0000 7f568fcfeb80 1 -- 172.21.15.149:0/116999830 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5589535e4ad0 msgr2=0x558953626f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:41.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.979+0000 7f568fcfeb80 1 --2- 172.21.15.149:0/116999830 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5589535e4ad0 0x558953626f10 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f5678000c00 tx=0x7f56780047c0 comp rx=0 tx=0).stop 2023-11-08T19:27:41.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.979+0000 7f568fcfeb80 1 -- 172.21.15.149:0/116999830 shutdown_connections 2023-11-08T19:27:41.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.979+0000 7f568fcfeb80 1 --2- 172.21.15.149:0/116999830 >> [v2:172.21.15.149:6835/3917392643,v1:172.21.15.149:6837/3917392643] conn(0x558953617060 0x558953641c70 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:41.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.979+0000 7f568fcfeb80 1 --2- 172.21.15.149:0/116999830 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5589535e46f0 0x558953611ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:41.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.979+0000 7f568fcfeb80 1 --2- 172.21.15.149:0/116999830 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x558953614000 0x558953614480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:41.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.979+0000 7f565cff9700 0 client.7512 ms_handle_reset on v2:172.21.15.149:6835/3917392643 2023-11-08T19:27:41.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.979+0000 7f568fcfeb80 1 --2- 172.21.15.149:0/116999830 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5589535e4ad0 0x558953626f10 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:41.004 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.979+0000 7f568fcfeb80 1 -- 172.21.15.149:0/116999830 >> 172.21.15.149:0/116999830 conn(0x55895355f660 msgr2=0x5589535e5020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:41.004 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.979+0000 7f568fcfeb80 1 -- 172.21.15.149:0/116999830 shutdown_connections 2023-11-08T19:27:41.004 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.979+0000 7f568fcfeb80 1 -- 172.21.15.149:0/116999830 wait complete. 2023-11-08T19:27:41.004 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.979+0000 7f568fcfeb80 20 client.7512 trim_cache size 0 max 16384 2023-11-08T19:27:41.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.997+0000 7f568fcfeb80 1 Processor -- start 2023-11-08T19:27:41.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.997+0000 7f568fcfeb80 1 -- start start 2023-11-08T19:27:41.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.998+0000 7f568fcfeb80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5589535e46f0 0x558953648880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:41.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.998+0000 7f568fcfeb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5589535e4ad0 0x558953628de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:41.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.998+0000 7f568fcfeb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558953614000 0x558953613440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:41.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.998+0000 7f568fcfeb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589533bc8d0 con 0x5589535e4ad0 2023-11-08T19:27:41.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.998+0000 7f568fcfeb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55895363f650 con 0x558953614000 2023-11-08T19:27:41.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.998+0000 7f568fcfeb80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55895363f160 con 0x5589535e46f0 2023-11-08T19:27:41.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.998+0000 7f56810a0700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5589535e4ad0 0x558953628de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:41.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.998+0000 7f56810a0700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5589535e4ad0 0x558953628de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44082/0 (socket says 172.21.15.149:44082) 2023-11-08T19:27:41.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.998+0000 7f56810a0700 1 -- 172.21.15.149:0/1477170024 learned_addr learned my addr 172.21.15.149:0/1477170024 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:27:41.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.998+0000 7f56820a2700 1 --2- 172.21.15.149:0/1477170024 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558953614000 0x558953613440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:41.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.998+0000 7f56818a1700 1 --2- 172.21.15.149:0/1477170024 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5589535e46f0 0x558953648880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:41.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.998+0000 7f56810a0700 1 -- 172.21.15.149:0/1477170024 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5589535e46f0 msgr2=0x558953648880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:41.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.998+0000 7f56810a0700 1 --2- 172.21.15.149:0/1477170024 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5589535e46f0 0x558953648880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:41.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.998+0000 7f56810a0700 1 -- 172.21.15.149:0/1477170024 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558953614000 msgr2=0x558953613440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:41.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.998+0000 7f56810a0700 1 --2- 172.21.15.149:0/1477170024 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558953614000 0x558953613440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:41.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.998+0000 7f56810a0700 1 -- 172.21.15.149:0/1477170024 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55895334fc10 con 0x5589535e4ad0 2023-11-08T19:27:41.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.998+0000 7f56820a2700 1 --2- 172.21.15.149:0/1477170024 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558953614000 0x558953613440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:27:41.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.998+0000 7f56818a1700 1 --2- 172.21.15.149:0/1477170024 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5589535e46f0 0x558953648880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:27:41.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.999+0000 7f56810a0700 1 --2- 172.21.15.149:0/1477170024 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5589535e4ad0 0x558953628de0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f5678009f20 tx=0x7f567800b050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78984f744cb1591f server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:41.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.999+0000 7f565ffff700 1 -- 172.21.15.149:0/1477170024 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5678004550 con 0x5589535e4ad0 2023-11-08T19:27:41.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.999+0000 7f565ffff700 1 -- 172.21.15.149:0/1477170024 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56780036a0 con 0x5589535e4ad0 2023-11-08T19:27:41.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.999+0000 7f565ffff700 1 -- 172.21.15.149:0/1477170024 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5678003a50 con 0x5589535e4ad0 2023-11-08T19:27:41.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.999+0000 7f568fcfeb80 1 -- 172.21.15.149:0/1477170024 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5589535e4ad0 msgr2=0x558953628de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:41.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.999+0000 7f568fcfeb80 1 --2- 172.21.15.149:0/1477170024 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5589535e4ad0 0x558953628de0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f5678009f20 tx=0x7f567800b050 comp rx=0 tx=0).stop 2023-11-08T19:27:41.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.999+0000 7f568fcfeb80 1 -- 172.21.15.149:0/1477170024 shutdown_connections 2023-11-08T19:27:41.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.999+0000 7f568fcfeb80 1 --2- 172.21.15.149:0/1477170024 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558953614000 0x558953613440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:41.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.999+0000 7f568fcfeb80 1 --2- 172.21.15.149:0/1477170024 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5589535e46f0 0x558953648880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:41.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.999+0000 7f568fcfeb80 1 --2- 172.21.15.149:0/1477170024 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5589535e4ad0 0x558953628de0 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:41.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.999+0000 7f568fcfeb80 1 -- 172.21.15.149:0/1477170024 >> 172.21.15.149:0/1477170024 conn(0x55895355f660 msgr2=0x5589536286d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:41.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.999+0000 7f568fcfeb80 1 -- 172.21.15.149:0/1477170024 shutdown_connections 2023-11-08T19:27:41.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:40.999+0000 7f568fcfeb80 1 -- 172.21.15.149:0/1477170024 wait complete. 2023-11-08T19:27:41.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.000+0000 7f568fcfeb80 1 -- start start 2023-11-08T19:27:41.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.000+0000 7f568fcfeb80 1 Processor -- start 2023-11-08T19:27:41.018 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.001+0000 7f568fcfeb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5589535e46f0 0x5589536973e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:41.018 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.001+0000 7f568fcfeb80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5589535e4ad0 0x558953628850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:41.018 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.001+0000 7f568fcfeb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558953614000 0x558953628d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:41.018 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.001+0000 7f568fcfeb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589536408a0 con 0x558953614000 2023-11-08T19:27:41.018 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.001+0000 7f568fcfeb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x558953640cc0 con 0x5589535e46f0 2023-11-08T19:27:41.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.001+0000 7f568fcfeb80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x558953697960 con 0x5589535e4ad0 2023-11-08T19:27:41.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.001+0000 7f568fcfeb80 10 client.0 _ll_register_callbacks cb 0x7f5678027070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-08T19:27:41.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.001+0000 7f56820a2700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558953614000 0x558953628d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:41.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.001+0000 7f56820a2700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558953614000 0x558953628d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44090/0 (socket says 172.21.15.149:44090) 2023-11-08T19:27:41.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.001+0000 7f56820a2700 1 -- 172.21.15.149:0/832650346 learned_addr learned my addr 172.21.15.149:0/832650346 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:27:41.020 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.002+0000 7f56818a1700 1 --2- 172.21.15.149:0/832650346 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5589535e46f0 0x5589536973e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:41.020 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.002+0000 7f56810a0700 1 --2- 172.21.15.149:0/832650346 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5589535e4ad0 0x558953628850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:41.020 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.002+0000 7f56820a2700 1 -- 172.21.15.149:0/832650346 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5589535e4ad0 msgr2=0x558953628850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:41.020 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.002+0000 7f56820a2700 1 --2- 172.21.15.149:0/832650346 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5589535e4ad0 0x558953628850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:41.020 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.002+0000 7f56820a2700 1 -- 172.21.15.149:0/832650346 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5589535e46f0 msgr2=0x5589536973e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:41.020 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.002+0000 7f56820a2700 1 --2- 172.21.15.149:0/832650346 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5589535e46f0 0x5589536973e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:41.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.002+0000 7f56820a2700 1 -- 172.21.15.149:0/832650346 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558953366d90 con 0x558953614000 2023-11-08T19:27:41.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.002+0000 7f56820a2700 1 --2- 172.21.15.149:0/832650346 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558953614000 0x558953628d90 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f5674087560 tx=0x7f56740583f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e70fcb825fb818b9 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:41.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.002+0000 7f565cff9700 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2023-11-08T19:27:41.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.002+0000 7f565cff9700 1 -- 172.21.15.149:0/832650346 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f567405a070 con 0x558953614000 2023-11-08T19:27:41.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.002+0000 7f565cff9700 1 -- 172.21.15.149:0/832650346 <== mon.0 v2:172.21.15.149:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 7206+0+0 (secure 0 0 0) 0x7f567405bf50 con 0x558953614000 2023-11-08T19:27:41.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.002+0000 7f568fcfeb80 1 -- 172.21.15.149:0/832650346 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5678011b00 con 0x558953614000 2023-11-08T19:27:41.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.002+0000 7f565cff9700 1 -- 172.21.15.149:0/832650346 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5674060100 con 0x558953614000 2023-11-08T19:27:41.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.002+0000 7f568fcfeb80 10 client.7518 fetch_fsmap learned FSMap version 67 2023-11-08T19:27:41.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.002+0000 7f568fcfeb80 1 -- 172.21.15.149:0/832650346 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=2+}) v3 -- 0x55895338d200 con 0x558953614000 2023-11-08T19:27:41.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.002+0000 7f565cff9700 1 -- 172.21.15.149:0/832650346 <== mon.0 v2:172.21.15.149:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5678011b00 con 0x558953614000 2023-11-08T19:27:41.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.002+0000 7f565cff9700 1 -- 172.21.15.149:0/832650346 <== mon.0 v2:172.21.15.149:3300/0 5 ==== fsmap(e 67) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f5674087170 con 0x558953614000 2023-11-08T19:27:41.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.002+0000 7f568fcfeb80 10 client.7518 fetch_fsmap finished waiting for FSMap version 67 2023-11-08T19:27:41.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.002+0000 7f568fcfeb80 10 client.7518 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-08T19:27:41.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.002+0000 7f568fcfeb80 20 client.7518 populate_metadata read hostname 'smithi149' 2023-11-08T19:27:41.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.003+0000 7f568fcfeb80 1 --2- 172.21.15.149:0/832650346 >> [v2:172.21.15.149:6835/3917392643,v1:172.21.15.149:6837/3917392643] conn(0x55895363e3a0 0x55895363e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:41.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.003+0000 7f568fcfeb80 4 client.7518 mds_command: new command op to 7125 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-08T19:27:41.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.003+0000 7f568fcfeb80 1 -- 172.21.15.149:0/832650346 --> [v2:172.21.15.149:6835/3917392643,v1:172.21.15.149:6837/3917392643] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5589535365a0 con 0x55895363e3a0 2023-11-08T19:27:41.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.003+0000 7f56818a1700 1 --2- 172.21.15.149:0/832650346 >> [v2:172.21.15.149:6835/3917392643,v1:172.21.15.149:6837/3917392643] conn(0x55895363e3a0 0x55895363e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:41.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.003+0000 7f565cff9700 10 client.7518 ms_handle_connect on v2:172.21.15.149:6835/3917392643 2023-11-08T19:27:41.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.003+0000 7f56818a1700 1 --2- 172.21.15.149:0/832650346 >> [v2:172.21.15.149:6835/3917392643,v1:172.21.15.149:6837/3917392643] conn(0x55895363e3a0 0x55895363e780 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7589d6f302d83c0d server_cookie=d926f941b6d44250 in_seq=0 out_seq=0 2023-11-08T19:27:41.025 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.003+0000 7f565cff9700 1 -- 172.21.15.149:0/832650346 <== mds.1 v2:172.21.15.149:6835/3917392643 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x5589535365a0 con 0x55895363e3a0 2023-11-08T19:27:41.025 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.003+0000 7f565cff9700 10 client.7518 handle_command_reply: tid=0 2023-11-08T19:27:41.025 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.003+0000 7f568fcfeb80 1 client.7518 shutdown 2023-11-08T19:27:41.025 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.003+0000 7f568fcfeb80 1 -- 172.21.15.149:0/832650346 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558953614000 msgr2=0x558953628d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:41.025 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.003+0000 7f568fcfeb80 1 --2- 172.21.15.149:0/832650346 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558953614000 0x558953628d90 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f5674087560 tx=0x7f56740583f0 comp rx=0 tx=0).stop 2023-11-08T19:27:41.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.003+0000 7f568fcfeb80 1 -- 172.21.15.149:0/832650346 shutdown_connections 2023-11-08T19:27:41.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.003+0000 7f568fcfeb80 1 --2- 172.21.15.149:0/832650346 >> [v2:172.21.15.149:6835/3917392643,v1:172.21.15.149:6837/3917392643] conn(0x55895363e3a0 0x55895363e780 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:41.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.003+0000 7f568fcfeb80 1 --2- 172.21.15.149:0/832650346 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5589535e46f0 0x5589536973e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:41.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.003+0000 7f565cff9700 0 client.7518 ms_handle_reset on v2:172.21.15.149:6835/3917392643 2023-11-08T19:27:41.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.003+0000 7f568fcfeb80 1 --2- 172.21.15.149:0/832650346 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558953614000 0x558953628d90 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:41.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.003+0000 7f568fcfeb80 1 --2- 172.21.15.149:0/832650346 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5589535e4ad0 0x558953628850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:41.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.003+0000 7f568fcfeb80 1 -- 172.21.15.149:0/832650346 >> 172.21.15.149:0/832650346 conn(0x55895355f660 msgr2=0x558953617440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:41.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.003+0000 7f568fcfeb80 1 -- 172.21.15.149:0/832650346 shutdown_connections 2023-11-08T19:27:41.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.003+0000 7f568fcfeb80 1 -- 172.21.15.149:0/832650346 wait complete. 2023-11-08T19:27:41.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.004+0000 7f568fcfeb80 20 client.7518 trim_cache size 0 max 16384 2023-11-08T19:27:41.028 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2023-11-08T19:27:41.028 INFO:teuthology.orchestra.run.smithi149.stdout: "cluster_fsid": "0aba7c70-fe80-4446-a2f5-7502ac3adfb4", 2023-11-08T19:27:41.028 INFO:teuthology.orchestra.run.smithi149.stdout: "whoami": 1, 2023-11-08T19:27:41.029 INFO:teuthology.orchestra.run.smithi149.stdout: "id": 7125, 2023-11-08T19:27:41.029 INFO:teuthology.orchestra.run.smithi149.stdout: "want_state": "up:active", 2023-11-08T19:27:41.029 INFO:teuthology.orchestra.run.smithi149.stdout: "state": "up:active", 2023-11-08T19:27:41.029 INFO:teuthology.orchestra.run.smithi149.stdout: "fs_name": "cephfs", 2023-11-08T19:27:41.029 INFO:teuthology.orchestra.run.smithi149.stdout: "rank_uptime": 42.359294915, 2023-11-08T19:27:41.030 INFO:teuthology.orchestra.run.smithi149.stdout: "mdsmap_epoch": 67, 2023-11-08T19:27:41.030 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_epoch": 97, 2023-11-08T19:27:41.030 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_epoch_barrier": 97, 2023-11-08T19:27:41.030 INFO:teuthology.orchestra.run.smithi149.stdout: "uptime": 58.352252487000001 2023-11-08T19:27:41.030 INFO:teuthology.orchestra.run.smithi149.stdout:} 2023-11-08T19:27:41.032 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.004+0000 7f5683b05700 1 -- 172.21.15.149:0/2374314595 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f566006af30 msgr2=0x7f566006d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:41.032 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.004+0000 7f5683b05700 1 --2- 172.21.15.149:0/2374314595 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f566006af30 0x7f566006d3f0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f566c009b20 tx=0x7f566c0091c0 comp rx=0 tx=0).stop 2023-11-08T19:27:41.032 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.004+0000 7f5683b05700 1 -- 172.21.15.149:0/2374314595 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f567c0cc140 msgr2=0x7f567c15f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:41.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.004+0000 7f5683b05700 1 --2- 172.21.15.149:0/2374314595 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f567c0cc140 0x7f567c15f5f0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f567400cbc0 tx=0x7f567400ced0 comp rx=0 tx=0).stop 2023-11-08T19:27:41.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.004+0000 7f5683b05700 1 -- 172.21.15.149:0/2374314595 shutdown_connections 2023-11-08T19:27:41.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.004+0000 7f5683b05700 1 --2- 172.21.15.149:0/2374314595 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f566006af30 0x7f566006d3f0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:41.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.004+0000 7f5683b05700 1 --2- 172.21.15.149:0/2374314595 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f567c0cc140 0x7f567c15f5f0 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:41.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.004+0000 7f5683b05700 1 --2- 172.21.15.149:0/2374314595 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f567c0b2850 0x7f567c14eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:41.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.004+0000 7f5683b05700 1 --2- 172.21.15.149:0/2374314595 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f567c0b2cd0 0x7f567c09a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:41.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.004+0000 7f5683b05700 1 -- 172.21.15.149:0/2374314595 >> 172.21.15.149:0/2374314595 conn(0x7f567c099a40 msgr2=0x7f567c0c7670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:41.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.004+0000 7f5683b05700 1 -- 172.21.15.149:0/2374314595 shutdown_connections 2023-11-08T19:27:41.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.004+0000 7f5683b05700 1 -- 172.21.15.149:0/2374314595 wait complete. 2023-11-08T19:27:41.035 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:27:41.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.156+0000 7ff040887700 1 Processor -- start 2023-11-08T19:27:41.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.156+0000 7ff040887700 1 -- start start 2023-11-08T19:27:41.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.157+0000 7ff040887700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff03c0b27c0 0x7ff03c0ce380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:41.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.157+0000 7ff040887700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff03c0d1330 con 0x7ff03c0b16b0 2023-11-08T19:27:41.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.157+0000 7ff040887700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff03c0cb490 con 0x7ff03c0afb30 2023-11-08T19:27:41.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.157+0000 7ff040887700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff03c0cb770 con 0x7ff03c0b27c0 2023-11-08T19:27:41.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.157+0000 7ff03ad9d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff03c0b27c0 0x7ff03c0ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:41.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.157+0000 7ff039d9b700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7ff03c0b16b0 0x7ff03c0b20b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:46098/0 (socket says 172.21.15.149:46098) 2023-11-08T19:27:41.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.157+0000 7ff03ad9d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff03c0b27c0 0x7ff03c0ce380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44098/0 (socket says 172.21.15.149:44098) 2023-11-08T19:27:41.161 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.157+0000 7ff039d9b700 1 -- 172.21.15.149:0/1850192052 learned_addr learned my addr 172.21.15.149:0/1850192052 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:27:41.161 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.157+0000 7ff03ad9d700 1 -- 172.21.15.149:0/1850192052 >> v1:172.21.15.160:6789/0 conn(0x7ff03c0afb30 legacy=0x7ff03c0cbf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:41.161 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.157+0000 7ff03ad9d700 1 -- 172.21.15.149:0/1850192052 >> v1:172.21.15.149:6789/0 conn(0x7ff03c0b16b0 legacy=0x7ff03c0b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:41.161 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.157+0000 7ff03ad9d700 1 -- 172.21.15.149:0/1850192052 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff03c0cba50 con 0x7ff03c0b27c0 2023-11-08T19:27:41.161 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.157+0000 7ff03ad9d700 1 --2- 172.21.15.149:0/1850192052 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff03c0b27c0 0x7ff03c0ce380 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7ff034009d90 tx=0x7ff03400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39592ca535a05677 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:41.162 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.157+0000 7ff03959a700 1 -- 172.21.15.149:0/1850192052 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03400e070 con 0x7ff03c0b27c0 2023-11-08T19:27:41.162 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.157+0000 7ff03959a700 1 -- 172.21.15.149:0/1850192052 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff03400bb90 con 0x7ff03c0b27c0 2023-11-08T19:27:41.162 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.157+0000 7ff03959a700 1 -- 172.21.15.149:0/1850192052 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff034003a20 con 0x7ff03c0b27c0 2023-11-08T19:27:41.162 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.158+0000 7ff040887700 1 -- 172.21.15.149:0/1850192052 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff03c0b27c0 msgr2=0x7ff03c0ce380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:41.162 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.158+0000 7ff040887700 1 --2- 172.21.15.149:0/1850192052 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff03c0b27c0 0x7ff03c0ce380 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7ff034009d90 tx=0x7ff03400b330 comp rx=0 tx=0).stop 2023-11-08T19:27:41.163 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.158+0000 7ff040887700 1 -- 172.21.15.149:0/1850192052 shutdown_connections 2023-11-08T19:27:41.163 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.158+0000 7ff040887700 1 --2- 172.21.15.149:0/1850192052 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff03c0b27c0 0x7ff03c0ce380 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:41.163 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.158+0000 7ff040887700 1 -- 172.21.15.149:0/1850192052 >> 172.21.15.149:0/1850192052 conn(0x7ff03c099a40 msgr2=0x7ff03c0d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:41.163 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.158+0000 7ff040887700 1 -- 172.21.15.149:0/1850192052 shutdown_connections 2023-11-08T19:27:41.163 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.158+0000 7ff040887700 1 -- 172.21.15.149:0/1850192052 wait complete. 2023-11-08T19:27:41.166 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.159+0000 7ff040887700 1 Processor -- start 2023-11-08T19:27:41.166 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.159+0000 7ff040887700 1 -- start start 2023-11-08T19:27:41.167 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.160+0000 7ff040887700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff03c0afb30 0x7ff03c0c7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:41.167 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.160+0000 7ff040887700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff03c0b16b0 0x7ff03c0c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:41.167 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.160+0000 7ff040887700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff03c0b27c0 0x7ff03c1e42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:41.167 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.160+0000 7ff040887700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff03c0c4640 con 0x7ff03c0b16b0 2023-11-08T19:27:41.168 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.160+0000 7ff040887700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff03c0c4920 con 0x7ff03c0afb30 2023-11-08T19:27:41.168 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.160+0000 7ff040887700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff03c0c4c00 con 0x7ff03c0b27c0 2023-11-08T19:27:41.168 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.160+0000 7ff039d9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff03c0b16b0 0x7ff03c0c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:41.168 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.160+0000 7ff039d9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff03c0b16b0 0x7ff03c0c7fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44102/0 (socket says 172.21.15.149:44102) 2023-11-08T19:27:41.168 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.160+0000 7ff039d9b700 1 -- 172.21.15.149:0/753354295 learned_addr learned my addr 172.21.15.149:0/753354295 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:27:41.169 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.160+0000 7ff03a59c700 1 --2- 172.21.15.149:0/753354295 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff03c0afb30 0x7ff03c0c7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:41.169 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.160+0000 7ff03ad9d700 1 --2- 172.21.15.149:0/753354295 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff03c0b27c0 0x7ff03c1e42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:41.169 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.160+0000 7ff039d9b700 1 -- 172.21.15.149:0/753354295 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff03c0b27c0 msgr2=0x7ff03c1e42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:41.169 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.160+0000 7ff039d9b700 1 --2- 172.21.15.149:0/753354295 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff03c0b27c0 0x7ff03c1e42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:41.169 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.160+0000 7ff039d9b700 1 -- 172.21.15.149:0/753354295 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff03c0afb30 msgr2=0x7ff03c0c7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:41.169 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.160+0000 7ff039d9b700 1 --2- 172.21.15.149:0/753354295 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff03c0afb30 0x7ff03c0c7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:41.170 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.160+0000 7ff039d9b700 1 -- 172.21.15.149:0/753354295 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff034009a70 con 0x7ff03c0b16b0 2023-11-08T19:27:41.170 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.160+0000 7ff03ad9d700 1 --2- 172.21.15.149:0/753354295 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff03c0b27c0 0x7ff03c1e42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:27:41.170 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.161+0000 7ff039d9b700 1 --2- 172.21.15.149:0/753354295 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff03c0b16b0 0x7ff03c0c7fb0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7ff03000c500 tx=0x7ff03000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:41.170 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.161+0000 7ff02affd700 1 -- 172.21.15.149:0/753354295 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff030005d70 con 0x7ff03c0b16b0 2023-11-08T19:27:41.171 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.161+0000 7ff02affd700 1 -- 172.21.15.149:0/753354295 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0300070d0 con 0x7ff03c0b16b0 2023-11-08T19:27:41.171 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.161+0000 7ff040887700 1 -- 172.21.15.149:0/753354295 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff03c0c4ee0 con 0x7ff03c0b16b0 2023-11-08T19:27:41.171 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.161+0000 7ff02affd700 1 -- 172.21.15.149:0/753354295 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff030007460 con 0x7ff03c0b16b0 2023-11-08T19:27:41.171 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.161+0000 7ff040887700 1 -- 172.21.15.149:0/753354295 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff03c0c40d0 con 0x7ff03c0b16b0 2023-11-08T19:27:41.171 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.162+0000 7ff040887700 1 -- 172.21.15.149:0/753354295 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff03c0745f0 con 0x7ff03c0b16b0 2023-11-08T19:27:41.172 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.162+0000 7ff02affd700 1 -- 172.21.15.149:0/753354295 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff0300075c0 con 0x7ff03c0b16b0 2023-11-08T19:27:41.172 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.163+0000 7ff02affd700 1 --2- 172.21.15.149:0/753354295 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff01c06af00 0x7ff01c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:41.172 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.163+0000 7ff02affd700 1 -- 172.21.15.149:0/753354295 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 7206+0+0 (secure 0 0 0) 0x7ff030088fc0 con 0x7ff03c0b16b0 2023-11-08T19:27:41.172 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.163+0000 7ff03a59c700 1 --2- 172.21.15.149:0/753354295 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff01c06af00 0x7ff01c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:41.172 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.163+0000 7ff03a59c700 1 --2- 172.21.15.149:0/753354295 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff01c06af00 0x7ff01c06d3c0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7ff03c0b6430 tx=0x7ff02c007f10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:41.173 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.168+0000 7ff02affd700 1 -- 172.21.15.149:0/753354295 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff0300bbca0 con 0x7ff03c0b16b0 2023-11-08T19:27:41.402 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.401+0000 7ff040887700 1 -- 172.21.15.149:0/753354295 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff03c0c3eb0 con 0x7ff03c0b16b0 2023-11-08T19:27:41.402 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.401+0000 7ff02affd700 1 -- 172.21.15.149:0/753354295 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4937 (secure 0 0 0) 0x7ff030017020 con 0x7ff03c0b16b0 2023-11-08T19:27:41.403 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:27:41.403 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":67,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6095,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/852710262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":852710262},{"type":"v1","addr":"172.21.15.160:6835","nonce":852710262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64},{"gid":6451,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/2947079163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2947079163},{"type":"v1","addr":"172.21.15.160:6834","nonce":2947079163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:27:37.067249+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7122,"mds_1":7125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7122":{"gid":7122,"name":"a","rank":0,"incarnation":63,"state":"up:active","state_seq":17,"addr":"172.21.15.149:6836/589971879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":589971879},{"type":"v1","addr":"172.21.15.149:6836","nonce":589971879}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7125":{"gid":7125,"name":"c","rank":1,"incarnation":57,"state":"up:active","state_seq":6,"addr":"172.21.15.149:6837/3917392643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3917392643},{"type":"v1","addr":"172.21.15.149:6837","nonce":3917392643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:27:41.405 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.403+0000 7ff040887700 1 -- 172.21.15.149:0/753354295 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff01c06af00 msgr2=0x7ff01c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:41.405 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.403+0000 7ff040887700 1 --2- 172.21.15.149:0/753354295 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff01c06af00 0x7ff01c06d3c0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7ff03c0b6430 tx=0x7ff02c007f10 comp rx=0 tx=0).stop 2023-11-08T19:27:41.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.403+0000 7ff040887700 1 -- 172.21.15.149:0/753354295 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff03c0b16b0 msgr2=0x7ff03c0c7fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:41.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.403+0000 7ff040887700 1 --2- 172.21.15.149:0/753354295 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff03c0b16b0 0x7ff03c0c7fb0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7ff03000c500 tx=0x7ff03000c810 comp rx=0 tx=0).stop 2023-11-08T19:27:41.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.403+0000 7ff040887700 1 -- 172.21.15.149:0/753354295 shutdown_connections 2023-11-08T19:27:41.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.403+0000 7ff040887700 1 --2- 172.21.15.149:0/753354295 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff01c06af00 0x7ff01c06d3c0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:41.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.403+0000 7ff040887700 1 --2- 172.21.15.149:0/753354295 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff03c0afb30 0x7ff03c0c7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:41.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.403+0000 7ff040887700 1 --2- 172.21.15.149:0/753354295 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff03c0b27c0 0x7ff03c1e42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:41.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.403+0000 7ff040887700 1 --2- 172.21.15.149:0/753354295 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff03c0b16b0 0x7ff03c0c7fb0 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:41.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.403+0000 7ff040887700 1 -- 172.21.15.149:0/753354295 >> 172.21.15.149:0/753354295 conn(0x7ff03c099a40 msgr2=0x7ff03c0ad1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:41.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.403+0000 7ff040887700 1 -- 172.21.15.149:0/753354295 shutdown_connections 2023-11-08T19:27:41.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.403+0000 7ff040887700 1 -- 172.21.15.149:0/753354295 wait complete. 2023-11-08T19:27:41.408 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 67 2023-11-08T19:27:41.417 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump snaps --server 2023-11-08T19:27:41.553 INFO:teuthology.orchestra.run.smithi149.stdout:{"last_snap":2,"last_created":2,"last_destroyed":1,"pending_noop":[],"snaps":[{"snapid":2,"ino":1099511627777,"stamp":"2023-11-08T19:27:11.331978+0000","name":"s11","metadata":{}}],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-08T19:27:41.553 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 2, "last_destroyed": 1, "last_snap": 2, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s11", "snapid": 2, "stamp": "2023-11-08T19:27:11.331978+0000" } ] } 2023-11-08T19:27:41.554 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-11-08T19:27:41.554 INFO:tasks.cephfs.test_snapshots:testing snapserver mds_kill_mdstable_at=2 2023-11-08T19:27:41.555 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:27:41.676 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.674+0000 7f07a72f6700 1 Processor -- start 2023-11-08T19:27:41.676 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.675+0000 7f07a72f6700 1 -- start start 2023-11-08T19:27:41.679 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.675+0000 7f07a72f6700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f07a00cc140 0x7f07a00cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:41.679 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.675+0000 7f07a72f6700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07a00cce50 con 0x7f07a00b2cd0 2023-11-08T19:27:41.679 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.675+0000 7f07a72f6700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07a00cc520 con 0x7f07a00b2850 2023-11-08T19:27:41.679 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.675+0000 7f07a72f6700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07a00b2430 con 0x7f07a00cc140 2023-11-08T19:27:41.680 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.676+0000 7f07a5893700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f07a00b2cd0 0x7f07a015d2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:46114/0 (socket says 172.21.15.149:46114) 2023-11-08T19:27:41.680 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.676+0000 7f07a5893700 1 -- 172.21.15.149:0/2614487879 learned_addr learned my addr 172.21.15.149:0/2614487879 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:27:41.680 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.676+0000 7f07a5092700 1 --2- 172.21.15.149:0/2614487879 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f07a00cc140 0x7f07a00cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:41.680 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.676+0000 7f0797fff700 1 -- 172.21.15.149:0/2614487879 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3026050317 0 0) 0x7f07a00cce50 con 0x7f07a00b2cd0 2023-11-08T19:27:41.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.676+0000 7f0797fff700 1 -- 172.21.15.149:0/2614487879 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f078c0035b0 con 0x7f07a00b2cd0 2023-11-08T19:27:41.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.676+0000 7f0797fff700 1 -- 172.21.15.149:0/2614487879 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3498494943 0 0) 0x7f07a00cc520 con 0x7f07a00b2850 2023-11-08T19:27:41.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.676+0000 7f0797fff700 1 -- 172.21.15.149:0/2614487879 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07a00cce50 con 0x7f07a00b2850 2023-11-08T19:27:41.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.676+0000 7f07a5092700 1 -- 172.21.15.149:0/2614487879 >> v1:172.21.15.160:6789/0 conn(0x7f07a00b2850 legacy=0x7f07a00cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:41.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.676+0000 7f0797fff700 1 -- 172.21.15.149:0/2614487879 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3962272243 0 0) 0x7f078c0035b0 con 0x7f07a00b2cd0 2023-11-08T19:27:41.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.676+0000 7f07a5092700 1 -- 172.21.15.149:0/2614487879 >> v1:172.21.15.149:6789/0 conn(0x7f07a00b2cd0 legacy=0x7f07a015d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:41.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.676+0000 7f07a5092700 1 -- 172.21.15.149:0/2614487879 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a00b17b0 con 0x7f07a00cc140 2023-11-08T19:27:41.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.676+0000 7f07a5092700 1 --2- 172.21.15.149:0/2614487879 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f07a00cc140 0x7f07a00cc910 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0790009850 tx=0x7f0790009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46f512e16b822911 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:41.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.676+0000 7f0797fff700 1 -- 172.21.15.149:0/2614487879 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07980019f0 con 0x7f07a00cc140 2023-11-08T19:27:41.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.676+0000 7f0797fff700 1 -- 172.21.15.149:0/2614487879 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0790005c30 con 0x7f07a00cc140 2023-11-08T19:27:41.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.676+0000 7f0797fff700 1 -- 172.21.15.149:0/2614487879 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0790004030 con 0x7f07a00cc140 2023-11-08T19:27:41.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.677+0000 7f07a72f6700 1 -- 172.21.15.149:0/2614487879 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f07a00cc140 msgr2=0x7f07a00cc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:41.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.677+0000 7f07a72f6700 1 --2- 172.21.15.149:0/2614487879 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f07a00cc140 0x7f07a00cc910 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0790009850 tx=0x7f0790009b60 comp rx=0 tx=0).stop 2023-11-08T19:27:41.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.677+0000 7f07a72f6700 1 -- 172.21.15.149:0/2614487879 shutdown_connections 2023-11-08T19:27:41.684 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.677+0000 7f07a72f6700 1 --2- 172.21.15.149:0/2614487879 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f07a00cc140 0x7f07a00cc910 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:41.684 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.677+0000 7f07a72f6700 1 -- 172.21.15.149:0/2614487879 >> 172.21.15.149:0/2614487879 conn(0x7f07a0099a40 msgr2=0x7f07a00d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:41.684 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.677+0000 7f07a72f6700 1 -- 172.21.15.149:0/2614487879 shutdown_connections 2023-11-08T19:27:41.684 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.677+0000 7f07a72f6700 1 -- 172.21.15.149:0/2614487879 wait complete. 2023-11-08T19:27:41.687 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.678+0000 7f07a72f6700 1 Processor -- start 2023-11-08T19:27:41.687 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.678+0000 7f07a72f6700 1 -- start start 2023-11-08T19:27:41.687 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.679+0000 7f07a72f6700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f07a00b2850 0x7f07a01f2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:41.687 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.679+0000 7f07a72f6700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07a00b2cd0 0x7f07a009a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:41.688 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.679+0000 7f07a72f6700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f07a00cc140 0x7f07a006ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:41.688 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.679+0000 7f07a72f6700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a01f6be0 con 0x7f07a00b2cd0 2023-11-08T19:27:41.688 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.679+0000 7f07a72f6700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a01f6ec0 con 0x7f07a00cc140 2023-11-08T19:27:41.688 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.679+0000 7f07a72f6700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07a01f71a0 con 0x7f07a00b2850 2023-11-08T19:27:41.688 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.679+0000 7f07a4891700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07a00b2cd0 0x7f07a009a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:41.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.679+0000 7f07a4891700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07a00b2cd0 0x7f07a009a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44116/0 (socket says 172.21.15.149:44116) 2023-11-08T19:27:41.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.679+0000 7f07a5092700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f07a00b2850 0x7f07a01f2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:41.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.679+0000 7f07a4891700 1 -- 172.21.15.149:0/3598309446 learned_addr learned my addr 172.21.15.149:0/3598309446 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:27:41.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.679+0000 7f07a5893700 1 --2- 172.21.15.149:0/3598309446 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f07a00cc140 0x7f07a006ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:41.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.680+0000 7f07a4891700 1 -- 172.21.15.149:0/3598309446 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f07a00b2850 msgr2=0x7f07a01f2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:41.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.680+0000 7f07a4891700 1 --2- 172.21.15.149:0/3598309446 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f07a00b2850 0x7f07a01f2e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:41.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.680+0000 7f07a4891700 1 -- 172.21.15.149:0/3598309446 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f07a00cc140 msgr2=0x7f07a006ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:41.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.680+0000 7f07a4891700 1 --2- 172.21.15.149:0/3598309446 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f07a00cc140 0x7f07a006ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:41.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.680+0000 7f07a4891700 1 -- 172.21.15.149:0/3598309446 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0790009430 con 0x7f07a00b2cd0 2023-11-08T19:27:41.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.680+0000 7f07a4891700 1 --2- 172.21.15.149:0/3598309446 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07a00b2cd0 0x7f07a009a700 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f079c00c520 tx=0x7f079c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:41.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.680+0000 7f0795ffb700 1 -- 172.21.15.149:0/3598309446 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f079c0052d0 con 0x7f07a00b2cd0 2023-11-08T19:27:41.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.680+0000 7f0795ffb700 1 -- 172.21.15.149:0/3598309446 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f079c005430 con 0x7f07a00b2cd0 2023-11-08T19:27:41.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.680+0000 7f07a72f6700 1 -- 172.21.15.149:0/3598309446 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07a01f7480 con 0x7f07a00b2cd0 2023-11-08T19:27:41.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.680+0000 7f0795ffb700 1 -- 172.21.15.149:0/3598309446 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f079c0038c0 con 0x7f07a00b2cd0 2023-11-08T19:27:41.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.680+0000 7f07a72f6700 1 -- 172.21.15.149:0/3598309446 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07a009ac40 con 0x7f07a00b2cd0 2023-11-08T19:27:41.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.681+0000 7f07a72f6700 1 -- 172.21.15.149:0/3598309446 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07a01f79a0 con 0x7f07a00b2cd0 2023-11-08T19:27:41.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.681+0000 7f0795ffb700 1 -- 172.21.15.149:0/3598309446 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f079c003a20 con 0x7f07a00b2cd0 2023-11-08T19:27:41.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.682+0000 7f0795ffb700 1 --2- 172.21.15.149:0/3598309446 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f078406af00 0x7f078406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:41.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.682+0000 7f0795ffb700 1 -- 172.21.15.149:0/3598309446 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 7206+0+0 (secure 0 0 0) 0x7f079c089080 con 0x7f07a00b2cd0 2023-11-08T19:27:41.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.682+0000 7f07a5092700 1 --2- 172.21.15.149:0/3598309446 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f078406af00 0x7f078406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:41.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.682+0000 7f07a5092700 1 --2- 172.21.15.149:0/3598309446 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f078406af00 0x7f078406d3c0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f07900097a0 tx=0x7f0790008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:41.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.687+0000 7f0795ffb700 1 -- 172.21.15.149:0/3598309446 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f07a01f79a0 con 0x7f07a00b2cd0 2023-11-08T19:27:41.922 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.921+0000 7f07a72f6700 1 -- 172.21.15.149:0/3598309446 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f07a01f79a0 con 0x7f07a00b2cd0 2023-11-08T19:27:41.923 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.921+0000 7f0795ffb700 1 -- 172.21.15.149:0/3598309446 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4937 (secure 0 0 0) 0x7f07a01f79a0 con 0x7f07a00b2cd0 2023-11-08T19:27:41.923 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:27:41.923 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":67,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6095,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/852710262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":852710262},{"type":"v1","addr":"172.21.15.160:6835","nonce":852710262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64},{"gid":6451,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/2947079163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2947079163},{"type":"v1","addr":"172.21.15.160:6834","nonce":2947079163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:27:37.067249+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7122,"mds_1":7125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7122":{"gid":7122,"name":"a","rank":0,"incarnation":63,"state":"up:active","state_seq":17,"addr":"172.21.15.149:6836/589971879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":589971879},{"type":"v1","addr":"172.21.15.149:6836","nonce":589971879}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7125":{"gid":7125,"name":"c","rank":1,"incarnation":57,"state":"up:active","state_seq":6,"addr":"172.21.15.149:6837/3917392643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3917392643},{"type":"v1","addr":"172.21.15.149:6837","nonce":3917392643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:27:41.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.923+0000 7f07a72f6700 1 -- 172.21.15.149:0/3598309446 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f078406af00 msgr2=0x7f078406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:41.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.923+0000 7f07a72f6700 1 --2- 172.21.15.149:0/3598309446 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f078406af00 0x7f078406d3c0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f07900097a0 tx=0x7f0790008070 comp rx=0 tx=0).stop 2023-11-08T19:27:41.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.923+0000 7f07a72f6700 1 -- 172.21.15.149:0/3598309446 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07a00b2cd0 msgr2=0x7f07a009a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:41.926 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.923+0000 7f07a72f6700 1 --2- 172.21.15.149:0/3598309446 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07a00b2cd0 0x7f07a009a700 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f079c00c520 tx=0x7f079c00c830 comp rx=0 tx=0).stop 2023-11-08T19:27:41.926 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.924+0000 7f07a72f6700 1 -- 172.21.15.149:0/3598309446 shutdown_connections 2023-11-08T19:27:41.926 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.924+0000 7f07a72f6700 1 --2- 172.21.15.149:0/3598309446 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f078406af00 0x7f078406d3c0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:41.926 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.924+0000 7f07a72f6700 1 --2- 172.21.15.149:0/3598309446 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f07a00cc140 0x7f07a006ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:41.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.924+0000 7f07a72f6700 1 --2- 172.21.15.149:0/3598309446 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f07a00b2850 0x7f07a01f2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:41.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.924+0000 7f07a72f6700 1 --2- 172.21.15.149:0/3598309446 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07a00b2cd0 0x7f07a009a700 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:41.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.924+0000 7f07a72f6700 1 -- 172.21.15.149:0/3598309446 >> 172.21.15.149:0/3598309446 conn(0x7f07a0099a40 msgr2=0x7f07a00c9720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:41.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.924+0000 7f07a72f6700 1 -- 172.21.15.149:0/3598309446 shutdown_connections 2023-11-08T19:27:41.928 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:41.924+0000 7f07a72f6700 1 -- 172.21.15.149:0/3598309446 wait complete. 2023-11-08T19:27:41.928 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 67 2023-11-08T19:27:41.937 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:0 true 2023-11-08T19:27:42.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:42.058+0000 7f80e69a6700 1 Processor -- start 2023-11-08T19:27:42.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:42.058+0000 7f80e69a6700 1 -- start start 2023-11-08T19:27:42.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:42.059+0000 7f80e69a6700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f80e00cb610 0x7f80e0166e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:42.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:42.059+0000 7f80e69a6700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80e00b3710 con 0x7f80e00722a0 2023-11-08T19:27:42.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:42.059+0000 7f80e69a6700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80e006b9a0 con 0x7f80e00c7250 2023-11-08T19:27:42.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:42.059+0000 7f80e69a6700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80e006cc00 con 0x7f80e00cb610 2023-11-08T19:27:42.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:42.059+0000 7f80e4f43700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f80e00cb610 0x7f80e0166e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:42.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:42.059+0000 7f80dffff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f80e00722a0 0x7f80e006ab80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:46124/0 (socket says 172.21.15.149:46124) 2023-11-08T19:27:42.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:42.059+0000 7f80e4f43700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f80e00cb610 0x7f80e0166e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44126/0 (socket says 172.21.15.149:44126) 2023-11-08T19:27:42.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:42.059+0000 7f80dffff700 1 -- 172.21.15.149:0/1770922401 learned_addr learned my addr 172.21.15.149:0/1770922401 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:27:42.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:42.060+0000 7f80e4f43700 1 -- 172.21.15.149:0/1770922401 >> v1:172.21.15.160:6789/0 conn(0x7f80e00c7250 legacy=0x7f80e006b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:42.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:42.060+0000 7f80e4f43700 1 -- 172.21.15.149:0/1770922401 >> v1:172.21.15.149:6789/0 conn(0x7f80e00722a0 legacy=0x7f80e006ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:42.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:42.060+0000 7f80deffd700 1 -- 172.21.15.149:0/1770922401 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2521749297 0 0) 0x7f80e00b3710 con 0x7f80e00722a0 2023-11-08T19:27:42.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:42.060+0000 7f80e4f43700 1 -- 172.21.15.149:0/1770922401 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e006c640 con 0x7f80e00cb610 2023-11-08T19:27:42.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:42.060+0000 7f80e4f43700 1 --2- 172.21.15.149:0/1770922401 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80e00cb610 0x7f80e0166e60 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f80d8009d90 tx=0x7f80d800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a176e84885522cf server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:42.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:42.060+0000 7f80deffd700 1 -- 172.21.15.149:0/1770922401 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d800e070 con 0x7f80e00cb610 2023-11-08T19:27:42.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:42.060+0000 7f80deffd700 1 -- 172.21.15.149:0/1770922401 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80d800bbd0 con 0x7f80e00cb610 2023-11-08T19:27:42.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:42.060+0000 7f80deffd700 1 -- 172.21.15.149:0/1770922401 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d8012430 con 0x7f80e00cb610 2023-11-08T19:27:42.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:42.061+0000 7f80e69a6700 1 -- 172.21.15.149:0/1770922401 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80e00cb610 msgr2=0x7f80e0166e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:42.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:42.061+0000 7f80e69a6700 1 --2- 172.21.15.149:0/1770922401 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80e00cb610 0x7f80e0166e60 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f80d8009d90 tx=0x7f80d800b330 comp rx=0 tx=0).stop 2023-11-08T19:27:42.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:42.061+0000 7f80e69a6700 1 -- 172.21.15.149:0/1770922401 shutdown_connections 2023-11-08T19:27:42.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:42.061+0000 7f80e69a6700 1 --2- 172.21.15.149:0/1770922401 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80e00cb610 0x7f80e0166e60 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:42.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:42.061+0000 7f80e69a6700 1 -- 172.21.15.149:0/1770922401 >> 172.21.15.149:0/1770922401 conn(0x7f80e00d0640 msgr2=0x7f80e00d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:42.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:42.061+0000 7f80e69a6700 1 -- 172.21.15.149:0/1770922401 shutdown_connections 2023-11-08T19:27:42.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:42.061+0000 7f80e69a6700 1 -- 172.21.15.149:0/1770922401 wait complete. 2023-11-08T19:27:42.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:42.062+0000 7f80e69a6700 1 Processor -- start 2023-11-08T19:27:42.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:42.062+0000 7f80e69a6700 1 -- start start 2023-11-08T19:27:42.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:42.063+0000 7f80e69a6700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f80e00722a0 0x7f80e00cfc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:42.070 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:42.063+0000 7f80e69a6700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f80e00c7250 0x7f80e015e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:42.070 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:42.063+0000 7f80e69a6700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80e00cb610 0x7f80e00ce210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:42.070 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:42.063+0000 7f80e69a6700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e00ac8c0 con 0x7f80e00cb610 2023-11-08T19:27:42.070 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:42.063+0000 7f80e69a6700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e00c9bd0 con 0x7f80e00c7250 2023-11-08T19:27:42.070 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:42.063+0000 7f80e69a6700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80e00c9eb0 con 0x7f80e00722a0 2023-11-08T19:27:42.071 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:42.063+0000 7f80e4f43700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80e00cb610 0x7f80e00ce210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:42.071 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:42.063+0000 7f80e4f43700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80e00cb610 0x7f80e00ce210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44132/0 (socket says 172.21.15.149:44132) 2023-11-08T19:27:42.071 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:42.063+0000 7f80e4f43700 1 -- 172.21.15.149:0/2363884678 learned_addr learned my addr 172.21.15.149:0/2363884678 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:27:42.071 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:42.063+0000 7f80dffff700 1 --2- 172.21.15.149:0/2363884678 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f80e00722a0 0x7f80e00cfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:42.071 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:42.063+0000 7f80df7fe700 1 --2- 172.21.15.149:0/2363884678 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f80e00c7250 0x7f80e015e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:42.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:42.063+0000 7f80e4f43700 1 -- 172.21.15.149:0/2363884678 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f80e00722a0 msgr2=0x7f80e00cfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:42.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:42.063+0000 7f80e4f43700 1 --2- 172.21.15.149:0/2363884678 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f80e00722a0 0x7f80e00cfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:42.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:42.063+0000 7f80e4f43700 1 -- 172.21.15.149:0/2363884678 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f80e00c7250 msgr2=0x7f80e015e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:42.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:42.063+0000 7f80e4f43700 1 --2- 172.21.15.149:0/2363884678 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f80e00c7250 0x7f80e015e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:42.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:42.063+0000 7f80e4f43700 1 -- 172.21.15.149:0/2363884678 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d8009a70 con 0x7f80e00cb610 2023-11-08T19:27:42.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:42.063+0000 7f80e4f43700 1 --2- 172.21.15.149:0/2363884678 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80e00cb610 0x7f80e00ce210 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f80d8014040 tx=0x7f80d8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:42.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:42.064+0000 7f80dcff9700 1 -- 172.21.15.149:0/2363884678 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d801b810 con 0x7f80e00cb610 2023-11-08T19:27:42.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:42.064+0000 7f80dcff9700 1 -- 172.21.15.149:0/2363884678 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80d8020070 con 0x7f80e00cb610 2023-11-08T19:27:42.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:42.064+0000 7f80e69a6700 1 -- 172.21.15.149:0/2363884678 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80e00ca190 con 0x7f80e00cb610 2023-11-08T19:27:42.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:42.064+0000 7f80dcff9700 1 -- 172.21.15.149:0/2363884678 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d801bbb0 con 0x7f80e00cb610 2023-11-08T19:27:42.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:42.064+0000 7f80e69a6700 1 -- 172.21.15.149:0/2363884678 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80e00d01c0 con 0x7f80e00cb610 2023-11-08T19:27:42.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:42.065+0000 7f80e69a6700 1 -- 172.21.15.149:0/2363884678 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80e00acd50 con 0x7f80e00cb610 2023-11-08T19:27:42.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:42.065+0000 7f80dcff9700 1 -- 172.21.15.149:0/2363884678 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f80d801bd10 con 0x7f80e00cb610 2023-11-08T19:27:42.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:42.065+0000 7f80dcff9700 1 --2- 172.21.15.149:0/2363884678 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f80cc06af00 0x7f80cc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:42.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:42.065+0000 7f80dcff9700 1 -- 172.21.15.149:0/2363884678 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 7206+0+0 (secure 0 0 0) 0x7f80d8022070 con 0x7f80e00cb610 2023-11-08T19:27:42.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:42.065+0000 7f80dffff700 1 --2- 172.21.15.149:0/2363884678 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f80cc06af00 0x7f80cc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:42.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:42.066+0000 7f80dffff700 1 --2- 172.21.15.149:0/2363884678 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f80cc06af00 0x7f80cc06d3c0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f80d4007fd0 tx=0x7f80d4007c20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:42.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:42.070+0000 7f80dcff9700 1 -- 172.21.15.149:0/2363884678 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f80d805a530 con 0x7f80e00cb610 2023-11-08T19:27:42.347 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:42.346+0000 7f80e69a6700 1 -- 172.21.15.149:0/2363884678 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"} v 0) v1 -- 0x7f80e004f730 con 0x7f80e00cb610 2023-11-08T19:27:43.154 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.153+0000 7f80dcff9700 1 -- 172.21.15.149:0/2363884678 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"}]=0 freezing mds.7122 v68) v1 ==== 112+0+0 (secure 0 0 0) 0x7f80d805a0c0 con 0x7f80e00cb610 2023-11-08T19:27:43.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.156+0000 7f80e69a6700 1 -- 172.21.15.149:0/2363884678 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f80cc06af00 msgr2=0x7f80cc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:43.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.156+0000 7f80e69a6700 1 --2- 172.21.15.149:0/2363884678 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f80cc06af00 0x7f80cc06d3c0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f80d4007fd0 tx=0x7f80d4007c20 comp rx=0 tx=0).stop 2023-11-08T19:27:43.158 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.156+0000 7f80e69a6700 1 -- 172.21.15.149:0/2363884678 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80e00cb610 msgr2=0x7f80e00ce210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:43.158 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.156+0000 7f80e69a6700 1 --2- 172.21.15.149:0/2363884678 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80e00cb610 0x7f80e00ce210 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f80d8014040 tx=0x7f80d8004ad0 comp rx=0 tx=0).stop 2023-11-08T19:27:43.158 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.156+0000 7f80e69a6700 1 -- 172.21.15.149:0/2363884678 shutdown_connections 2023-11-08T19:27:43.158 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.156+0000 7f80e69a6700 1 --2- 172.21.15.149:0/2363884678 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f80cc06af00 0x7f80cc06d3c0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:43.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.156+0000 7f80e69a6700 1 --2- 172.21.15.149:0/2363884678 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80e00cb610 0x7f80e00ce210 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:43.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.156+0000 7f80e69a6700 1 --2- 172.21.15.149:0/2363884678 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f80e00722a0 0x7f80e00cfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:43.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.156+0000 7f80e69a6700 1 --2- 172.21.15.149:0/2363884678 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f80e00c7250 0x7f80e015e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:43.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.156+0000 7f80e69a6700 1 -- 172.21.15.149:0/2363884678 >> 172.21.15.149:0/2363884678 conn(0x7f80e00d0640 msgr2=0x7f80e00ca960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:43.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.156+0000 7f80e69a6700 1 -- 172.21.15.149:0/2363884678 shutdown_connections 2023-11-08T19:27:43.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.156+0000 7f80e69a6700 1 -- 172.21.15.149:0/2363884678 wait complete. 2023-11-08T19:27:43.161 INFO:teuthology.orchestra.run.smithi149.stderr:freezing mds.7122 2023-11-08T19:27:43.171 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_kill_mdstable_at 2 2023-11-08T19:27:43.311 INFO:teuthology.orchestra.run.smithi149.stdout:{"success":"mds_kill_mdstable_at = '2' (not observed, change may require restart) "} 2023-11-08T19:27:43.312 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_kill_mdstable_at = '2' (not observed, change may require restart) " } 2023-11-08T19:27:43.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:27:43.313 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir d1/dir/.snap/s12) 2023-11-08T19:27:43.315 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2023-11-08T19:27:43.332 INFO:tasks.ceph.mds.a.smithi149.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el8/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_prepare_logged(ceph::cref_t&, version_t)' thread 7fbc7d78b700 time 2023-11-08T19:27:43.332283+0000 2023-11-08T19:27:43.333 INFO:tasks.ceph.mds.a.smithi149.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el8/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 77: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 2) 2023-11-08T19:27:43.334 INFO:tasks.ceph.mds.a.smithi149.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-08T19:27:43.335 INFO:tasks.ceph.mds.a.smithi149.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fbc8f05ff5b] 2023-11-08T19:27:43.335 INFO:tasks.ceph.mds.a.smithi149.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2ba121) [0x7fbc8f060121] 2023-11-08T19:27:43.335 INFO:tasks.ceph.mds.a.smithi149.stderr: 3: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x6ad) [0x5646154e6f5d] 2023-11-08T19:27:43.335 INFO:tasks.ceph.mds.a.smithi149.stderr: 4: (MDSContext::complete(int)+0x5f) [0x564615531ecf] 2023-11-08T19:27:43.335 INFO:tasks.ceph.mds.a.smithi149.stderr: 5: (MDSIOContextBase::complete(int)+0x574) [0x5646155326b4] 2023-11-08T19:27:43.336 INFO:tasks.ceph.mds.a.smithi149.stderr: 6: (MDSLogContextBase::complete(int)+0x5b) [0x564615532a7b] 2023-11-08T19:27:43.336 INFO:tasks.ceph.mds.a.smithi149.stderr: 7: (Finisher::finisher_thread_entry()+0x19d) [0x7fbc8f0fd8cd] 2023-11-08T19:27:43.336 INFO:tasks.ceph.mds.a.smithi149.stderr: 8: /lib64/libpthread.so.0(+0x81cf) [0x7fbc8ddf81cf] 2023-11-08T19:27:43.336 INFO:tasks.ceph.mds.a.smithi149.stderr: 9: clone() 2023-11-08T19:27:43.336 INFO:tasks.ceph.mds.a.smithi149.stderr:*** Caught signal (Aborted) ** 2023-11-08T19:27:43.337 INFO:tasks.ceph.mds.a.smithi149.stderr: in thread 7fbc7d78b700 thread_name:MR_Finisher 2023-11-08T19:27:43.337 INFO:tasks.ceph.mds.a.smithi149.stderr:2023-11-08T19:27:43.332+0000 7fbc7d78b700 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el8/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_prepare_logged(ceph::cref_t&, version_t)' thread 7fbc7d78b700 time 2023-11-08T19:27:43.332283+0000 2023-11-08T19:27:43.337 INFO:tasks.ceph.mds.a.smithi149.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el8/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 77: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 2) 2023-11-08T19:27:43.337 INFO:tasks.ceph.mds.a.smithi149.stderr: 2023-11-08T19:27:43.337 INFO:tasks.ceph.mds.a.smithi149.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-08T19:27:43.338 INFO:tasks.ceph.mds.a.smithi149.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fbc8f05ff5b] 2023-11-08T19:27:43.338 INFO:tasks.ceph.mds.a.smithi149.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2ba121) [0x7fbc8f060121] 2023-11-08T19:27:43.338 INFO:tasks.ceph.mds.a.smithi149.stderr: 3: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x6ad) [0x5646154e6f5d] 2023-11-08T19:27:43.338 INFO:tasks.ceph.mds.a.smithi149.stderr: 4: (MDSContext::complete(int)+0x5f) [0x564615531ecf] 2023-11-08T19:27:43.339 INFO:tasks.ceph.mds.a.smithi149.stderr: 5: (MDSIOContextBase::complete(int)+0x574) [0x5646155326b4] 2023-11-08T19:27:43.339 INFO:tasks.ceph.mds.a.smithi149.stderr: 6: (MDSLogContextBase::complete(int)+0x5b) [0x564615532a7b] 2023-11-08T19:27:43.339 INFO:tasks.ceph.mds.a.smithi149.stderr: 7: (Finisher::finisher_thread_entry()+0x19d) [0x7fbc8f0fd8cd] 2023-11-08T19:27:43.339 INFO:tasks.ceph.mds.a.smithi149.stderr: 8: /lib64/libpthread.so.0(+0x81cf) [0x7fbc8ddf81cf] 2023-11-08T19:27:43.339 INFO:tasks.ceph.mds.a.smithi149.stderr: 9: clone() 2023-11-08T19:27:43.340 INFO:tasks.ceph.mds.a.smithi149.stderr: 2023-11-08T19:27:43.340 INFO:tasks.ceph.mds.a.smithi149.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-08T19:27:43.340 INFO:tasks.ceph.mds.a.smithi149.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7fbc8de02ce0] 2023-11-08T19:27:43.340 INFO:tasks.ceph.mds.a.smithi149.stderr: 2: gsignal() 2023-11-08T19:27:43.340 INFO:tasks.ceph.mds.a.smithi149.stderr: 3: abort() 2023-11-08T19:27:43.341 INFO:tasks.ceph.mds.a.smithi149.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fbc8f05ffb5] 2023-11-08T19:27:43.341 INFO:tasks.ceph.mds.a.smithi149.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2ba121) [0x7fbc8f060121] 2023-11-08T19:27:43.341 INFO:tasks.ceph.mds.a.smithi149.stderr: 6: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x6ad) [0x5646154e6f5d] 2023-11-08T19:27:43.341 INFO:tasks.ceph.mds.a.smithi149.stderr: 7: (MDSContext::complete(int)+0x5f) [0x564615531ecf] 2023-11-08T19:27:43.341 INFO:tasks.ceph.mds.a.smithi149.stderr: 8: (MDSIOContextBase::complete(int)+0x574) [0x5646155326b4] 2023-11-08T19:27:43.341 INFO:tasks.ceph.mds.a.smithi149.stderr: 9: (MDSLogContextBase::complete(int)+0x5b) [0x564615532a7b] 2023-11-08T19:27:43.342 INFO:tasks.ceph.mds.a.smithi149.stderr: 10: (Finisher::finisher_thread_entry()+0x19d) [0x7fbc8f0fd8cd] 2023-11-08T19:27:43.342 INFO:tasks.ceph.mds.a.smithi149.stderr: 11: /lib64/libpthread.so.0(+0x81cf) [0x7fbc8ddf81cf] 2023-11-08T19:27:43.342 INFO:tasks.ceph.mds.a.smithi149.stderr: 12: clone() 2023-11-08T19:27:43.342 INFO:tasks.ceph.mds.a.smithi149.stderr:2023-11-08T19:27:43.333+0000 7fbc7d78b700 -1 *** Caught signal (Aborted) ** 2023-11-08T19:27:43.343 INFO:tasks.ceph.mds.a.smithi149.stderr: in thread 7fbc7d78b700 thread_name:MR_Finisher 2023-11-08T19:27:43.343 INFO:tasks.ceph.mds.a.smithi149.stderr: 2023-11-08T19:27:43.343 INFO:tasks.ceph.mds.a.smithi149.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-08T19:27:43.343 INFO:tasks.ceph.mds.a.smithi149.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7fbc8de02ce0] 2023-11-08T19:27:43.343 INFO:tasks.ceph.mds.a.smithi149.stderr: 2: gsignal() 2023-11-08T19:27:43.344 INFO:tasks.ceph.mds.a.smithi149.stderr: 3: abort() 2023-11-08T19:27:43.344 INFO:tasks.ceph.mds.a.smithi149.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fbc8f05ffb5] 2023-11-08T19:27:43.344 INFO:tasks.ceph.mds.a.smithi149.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2ba121) [0x7fbc8f060121] 2023-11-08T19:27:43.344 INFO:tasks.ceph.mds.a.smithi149.stderr: 6: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x6ad) [0x5646154e6f5d] 2023-11-08T19:27:43.344 INFO:tasks.ceph.mds.a.smithi149.stderr: 7: (MDSContext::complete(int)+0x5f) [0x564615531ecf] 2023-11-08T19:27:43.344 INFO:tasks.ceph.mds.a.smithi149.stderr: 8: (MDSIOContextBase::complete(int)+0x574) [0x5646155326b4] 2023-11-08T19:27:43.345 INFO:tasks.ceph.mds.a.smithi149.stderr: 9: (MDSLogContextBase::complete(int)+0x5b) [0x564615532a7b] 2023-11-08T19:27:43.345 INFO:tasks.ceph.mds.a.smithi149.stderr: 10: (Finisher::finisher_thread_entry()+0x19d) [0x7fbc8f0fd8cd] 2023-11-08T19:27:43.345 INFO:tasks.ceph.mds.a.smithi149.stderr: 11: /lib64/libpthread.so.0(+0x81cf) [0x7fbc8ddf81cf] 2023-11-08T19:27:43.345 INFO:tasks.ceph.mds.a.smithi149.stderr: 12: clone() 2023-11-08T19:27:43.345 INFO:tasks.ceph.mds.a.smithi149.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-08T19:27:43.346 INFO:tasks.ceph.mds.a.smithi149.stderr: 2023-11-08T19:27:43.347 INFO:tasks.ceph.mds.a.smithi149.stderr: -507> 2023-11-08T19:27:38.569+0000 7fbc80f92700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-08T19:27:43.347 INFO:tasks.ceph.mds.a.smithi149.stderr: -505> 2023-11-08T19:27:38.569+0000 7fbc80f92700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-08T19:27:43.347 INFO:tasks.ceph.mds.a.smithi149.stderr: -1> 2023-11-08T19:27:43.332+0000 7fbc7d78b700 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el8/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_prepare_logged(ceph::cref_t&, version_t)' thread 7fbc7d78b700 time 2023-11-08T19:27:43.332283+0000 2023-11-08T19:27:43.347 INFO:tasks.ceph.mds.a.smithi149.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el8/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 77: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 2) 2023-11-08T19:27:43.348 INFO:tasks.ceph.mds.a.smithi149.stderr: 2023-11-08T19:27:43.348 INFO:tasks.ceph.mds.a.smithi149.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-08T19:27:43.348 INFO:tasks.ceph.mds.a.smithi149.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fbc8f05ff5b] 2023-11-08T19:27:43.348 INFO:tasks.ceph.mds.a.smithi149.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2ba121) [0x7fbc8f060121] 2023-11-08T19:27:43.348 INFO:tasks.ceph.mds.a.smithi149.stderr: 3: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x6ad) [0x5646154e6f5d] 2023-11-08T19:27:43.349 INFO:tasks.ceph.mds.a.smithi149.stderr: 4: (MDSContext::complete(int)+0x5f) [0x564615531ecf] 2023-11-08T19:27:43.349 INFO:tasks.ceph.mds.a.smithi149.stderr: 5: (MDSIOContextBase::complete(int)+0x574) [0x5646155326b4] 2023-11-08T19:27:43.349 INFO:tasks.ceph.mds.a.smithi149.stderr: 6: (MDSLogContextBase::complete(int)+0x5b) [0x564615532a7b] 2023-11-08T19:27:43.349 INFO:tasks.ceph.mds.a.smithi149.stderr: 7: (Finisher::finisher_thread_entry()+0x19d) [0x7fbc8f0fd8cd] 2023-11-08T19:27:43.350 INFO:tasks.ceph.mds.a.smithi149.stderr: 8: /lib64/libpthread.so.0(+0x81cf) [0x7fbc8ddf81cf] 2023-11-08T19:27:43.350 INFO:tasks.ceph.mds.a.smithi149.stderr: 9: clone() 2023-11-08T19:27:43.350 INFO:tasks.ceph.mds.a.smithi149.stderr: 2023-11-08T19:27:43.350 INFO:tasks.ceph.mds.a.smithi149.stderr: 0> 2023-11-08T19:27:43.333+0000 7fbc7d78b700 -1 *** Caught signal (Aborted) ** 2023-11-08T19:27:43.350 INFO:tasks.ceph.mds.a.smithi149.stderr: in thread 7fbc7d78b700 thread_name:MR_Finisher 2023-11-08T19:27:43.350 INFO:tasks.ceph.mds.a.smithi149.stderr: 2023-11-08T19:27:43.351 INFO:tasks.ceph.mds.a.smithi149.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-08T19:27:43.351 INFO:tasks.ceph.mds.a.smithi149.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7fbc8de02ce0] 2023-11-08T19:27:43.351 INFO:tasks.ceph.mds.a.smithi149.stderr: 2: gsignal() 2023-11-08T19:27:43.351 INFO:tasks.ceph.mds.a.smithi149.stderr: 3: abort() 2023-11-08T19:27:43.352 INFO:tasks.ceph.mds.a.smithi149.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fbc8f05ffb5] 2023-11-08T19:27:43.352 INFO:tasks.ceph.mds.a.smithi149.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2ba121) [0x7fbc8f060121] 2023-11-08T19:27:43.352 INFO:tasks.ceph.mds.a.smithi149.stderr: 6: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x6ad) [0x5646154e6f5d] 2023-11-08T19:27:43.352 INFO:tasks.ceph.mds.a.smithi149.stderr: 7: (MDSContext::complete(int)+0x5f) [0x564615531ecf] 2023-11-08T19:27:43.352 INFO:tasks.ceph.mds.a.smithi149.stderr: 8: (MDSIOContextBase::complete(int)+0x574) [0x5646155326b4] 2023-11-08T19:27:43.353 INFO:tasks.ceph.mds.a.smithi149.stderr: 9: (MDSLogContextBase::complete(int)+0x5b) [0x564615532a7b] 2023-11-08T19:27:43.353 INFO:tasks.ceph.mds.a.smithi149.stderr: 10: (Finisher::finisher_thread_entry()+0x19d) [0x7fbc8f0fd8cd] 2023-11-08T19:27:43.353 INFO:tasks.ceph.mds.a.smithi149.stderr: 11: /lib64/libpthread.so.0(+0x81cf) [0x7fbc8ddf81cf] 2023-11-08T19:27:43.353 INFO:tasks.ceph.mds.a.smithi149.stderr: 12: clone() 2023-11-08T19:27:43.354 INFO:tasks.ceph.mds.a.smithi149.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-08T19:27:43.354 INFO:tasks.ceph.mds.a.smithi149.stderr: 2023-11-08T19:27:43.354 INFO:tasks.ceph.mds.a.smithi149.stderr: -507> 2023-11-08T19:27:38.569+0000 7fbc80f92700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-08T19:27:43.355 INFO:tasks.ceph.mds.a.smithi149.stderr: -505> 2023-11-08T19:27:38.569+0000 7fbc80f92700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-08T19:27:43.355 INFO:tasks.ceph.mds.a.smithi149.stderr: -1> 2023-11-08T19:27:43.332+0000 7fbc7d78b700 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el8/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_prepare_logged(ceph::cref_t&, version_t)' thread 7fbc7d78b700 time 2023-11-08T19:27:43.332283+0000 2023-11-08T19:27:43.355 INFO:tasks.ceph.mds.a.smithi149.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el8/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 77: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 2) 2023-11-08T19:27:43.355 INFO:tasks.ceph.mds.a.smithi149.stderr: 2023-11-08T19:27:43.355 INFO:tasks.ceph.mds.a.smithi149.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-08T19:27:43.356 INFO:tasks.ceph.mds.a.smithi149.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fbc8f05ff5b] 2023-11-08T19:27:43.356 INFO:tasks.ceph.mds.a.smithi149.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2ba121) [0x7fbc8f060121] 2023-11-08T19:27:43.356 INFO:tasks.ceph.mds.a.smithi149.stderr: 3: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x6ad) [0x5646154e6f5d] 2023-11-08T19:27:43.356 INFO:tasks.ceph.mds.a.smithi149.stderr: 4: (MDSContext::complete(int)+0x5f) [0x564615531ecf] 2023-11-08T19:27:43.356 INFO:tasks.ceph.mds.a.smithi149.stderr: 5: (MDSIOContextBase::complete(int)+0x574) [0x5646155326b4] 2023-11-08T19:27:43.356 INFO:tasks.ceph.mds.a.smithi149.stderr: 6: (MDSLogContextBase::complete(int)+0x5b) [0x564615532a7b] 2023-11-08T19:27:43.357 INFO:tasks.ceph.mds.a.smithi149.stderr: 7: (Finisher::finisher_thread_entry()+0x19d) [0x7fbc8f0fd8cd] 2023-11-08T19:27:43.357 INFO:tasks.ceph.mds.a.smithi149.stderr: 8: /lib64/libpthread.so.0(+0x81cf) [0x7fbc8ddf81cf] 2023-11-08T19:27:43.357 INFO:tasks.ceph.mds.a.smithi149.stderr: 9: clone() 2023-11-08T19:27:43.357 INFO:tasks.ceph.mds.a.smithi149.stderr: 2023-11-08T19:27:43.358 INFO:tasks.ceph.mds.a.smithi149.stderr: 0> 2023-11-08T19:27:43.333+0000 7fbc7d78b700 -1 *** Caught signal (Aborted) ** 2023-11-08T19:27:43.358 INFO:tasks.ceph.mds.a.smithi149.stderr: in thread 7fbc7d78b700 thread_name:MR_Finisher 2023-11-08T19:27:43.358 INFO:tasks.ceph.mds.a.smithi149.stderr: 2023-11-08T19:27:43.358 INFO:tasks.ceph.mds.a.smithi149.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-08T19:27:43.358 INFO:tasks.ceph.mds.a.smithi149.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7fbc8de02ce0] 2023-11-08T19:27:43.359 INFO:tasks.ceph.mds.a.smithi149.stderr: 2: gsignal() 2023-11-08T19:27:43.359 INFO:tasks.ceph.mds.a.smithi149.stderr: 3: abort() 2023-11-08T19:27:43.359 INFO:tasks.ceph.mds.a.smithi149.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fbc8f05ffb5] 2023-11-08T19:27:43.359 INFO:tasks.ceph.mds.a.smithi149.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2ba121) [0x7fbc8f060121] 2023-11-08T19:27:43.359 INFO:tasks.ceph.mds.a.smithi149.stderr: 6: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x6ad) [0x5646154e6f5d] 2023-11-08T19:27:43.360 INFO:tasks.ceph.mds.a.smithi149.stderr: 7: (MDSContext::complete(int)+0x5f) [0x564615531ecf] 2023-11-08T19:27:43.360 INFO:tasks.ceph.mds.a.smithi149.stderr: 8: (MDSIOContextBase::complete(int)+0x574) [0x5646155326b4] 2023-11-08T19:27:43.360 INFO:tasks.ceph.mds.a.smithi149.stderr: 9: (MDSLogContextBase::complete(int)+0x5b) [0x564615532a7b] 2023-11-08T19:27:43.360 INFO:tasks.ceph.mds.a.smithi149.stderr: 10: (Finisher::finisher_thread_entry()+0x19d) [0x7fbc8f0fd8cd] 2023-11-08T19:27:43.360 INFO:tasks.ceph.mds.a.smithi149.stderr: 11: /lib64/libpthread.so.0(+0x81cf) [0x7fbc8ddf81cf] 2023-11-08T19:27:43.361 INFO:tasks.ceph.mds.a.smithi149.stderr: 12: clone() 2023-11-08T19:27:43.361 INFO:tasks.ceph.mds.a.smithi149.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-08T19:27:43.361 INFO:tasks.ceph.mds.a.smithi149.stderr: 2023-11-08T19:27:43.484 INFO:teuthology.orchestra.run.smithi149.stdout:{"mds_beacon_grace":"15.000000"} 2023-11-08T19:27:43.484 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2023-11-08T19:27:43.485 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:27:43.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.643+0000 7fc9c6dca700 1 Processor -- start 2023-11-08T19:27:43.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.643+0000 7fc9c6dca700 1 -- start start 2023-11-08T19:27:43.648 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.644+0000 7fc9c6dca700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc9c015b950 0x7fc9c00ce130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:43.648 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.644+0000 7fc9c6dca700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fc9c00d0430 0x7fc9c00ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:43.648 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.644+0000 7fc9c6dca700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9c00cc2e0 con 0x7fc9c00cd5e0 2023-11-08T19:27:43.649 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.644+0000 7fc9c6dca700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9c00cc580 con 0x7fc9c015b950 2023-11-08T19:27:43.649 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.644+0000 7fc9c6dca700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9c00cc820 con 0x7fc9c00d0430 2023-11-08T19:27:43.649 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.644+0000 7fc9c4b66700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc9c015b950 0x7fc9c00ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:43.649 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.644+0000 7fc9bffff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fc9c00cd5e0 0x7fc9c00cfd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:46140/0 (socket says 172.21.15.149:46140) 2023-11-08T19:27:43.650 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.644+0000 7fc9bffff700 1 -- 172.21.15.149:0/337507684 learned_addr learned my addr 172.21.15.149:0/337507684 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:27:43.650 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.645+0000 7fc9c4b66700 1 -- 172.21.15.149:0/337507684 >> v2:172.21.15.160:3300/0 conn(0x7fc9c00d0430 msgr2=0x7fc9c00ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:43.650 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.645+0000 7fc9c5367700 1 --2- 172.21.15.149:0/337507684 >> v2:172.21.15.160:3300/0 conn(0x7fc9c00d0430 0x7fc9c00ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:43.650 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.645+0000 7fc9bf7fe700 1 -- 172.21.15.149:0/337507684 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2886903004 0 0) 0x7fc9c00cc2e0 con 0x7fc9c00cd5e0 2023-11-08T19:27:43.651 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.645+0000 7fc9c4b66700 1 --2- 172.21.15.149:0/337507684 >> v2:172.21.15.160:3300/0 conn(0x7fc9c00d0430 0x7fc9c00ce670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:43.651 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.645+0000 7fc9c4b66700 1 -- 172.21.15.149:0/337507684 >> v1:172.21.15.149:6789/0 conn(0x7fc9c00cd5e0 legacy=0x7fc9c00cfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:43.651 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.645+0000 7fc9c4b66700 1 -- 172.21.15.149:0/337507684 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c00ccb00 con 0x7fc9c015b950 2023-11-08T19:27:43.651 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.645+0000 7fc9c5367700 1 --2- 172.21.15.149:0/337507684 >> v2:172.21.15.160:3300/0 conn(0x7fc9c00d0430 0x7fc9c00ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:27:43.651 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.645+0000 7fc9c4b66700 1 --2- 172.21.15.149:0/337507684 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9c015b950 0x7fc9c00ce130 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fc9c00cbd20 tx=0x7fc9b4009b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16304a6420070551 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:43.652 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.645+0000 7fc9bf7fe700 1 -- 172.21.15.149:0/337507684 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b4005e30 con 0x7fc9c015b950 2023-11-08T19:27:43.652 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.645+0000 7fc9bf7fe700 1 -- 172.21.15.149:0/337507684 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b4006030 con 0x7fc9c015b950 2023-11-08T19:27:43.652 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.645+0000 7fc9bf7fe700 1 -- 172.21.15.149:0/337507684 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b40063c0 con 0x7fc9c015b950 2023-11-08T19:27:43.652 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.645+0000 7fc9c6dca700 1 -- 172.21.15.149:0/337507684 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9c015b950 msgr2=0x7fc9c00ce130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:43.652 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.645+0000 7fc9c6dca700 1 --2- 172.21.15.149:0/337507684 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9c015b950 0x7fc9c00ce130 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fc9c00cbd20 tx=0x7fc9b4009b00 comp rx=0 tx=0).stop 2023-11-08T19:27:43.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.646+0000 7fc9c6dca700 1 -- 172.21.15.149:0/337507684 shutdown_connections 2023-11-08T19:27:43.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.646+0000 7fc9c6dca700 1 --2- 172.21.15.149:0/337507684 >> v2:172.21.15.160:3300/0 conn(0x7fc9c00d0430 0x7fc9c00ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:43.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.646+0000 7fc9c6dca700 1 --2- 172.21.15.149:0/337507684 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9c015b950 0x7fc9c00ce130 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:43.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.646+0000 7fc9c6dca700 1 -- 172.21.15.149:0/337507684 >> 172.21.15.149:0/337507684 conn(0x7fc9c008afd0 msgr2=0x7fc9c00d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:43.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.646+0000 7fc9c6dca700 1 -- 172.21.15.149:0/337507684 shutdown_connections 2023-11-08T19:27:43.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.646+0000 7fc9c6dca700 1 -- 172.21.15.149:0/337507684 wait complete. 2023-11-08T19:27:43.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.647+0000 7fc9c6dca700 1 Processor -- start 2023-11-08T19:27:43.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.647+0000 7fc9c6dca700 1 -- start start 2023-11-08T19:27:43.657 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.648+0000 7fc9c6dca700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc9c00d0430 0x7fc9c006bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:43.657 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.648+0000 7fc9c6dca700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9c015b950 0x7fc9c01f72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:43.658 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.648+0000 7fc9c6dca700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc9c006c1d0 0x7fc9c01f77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:43.658 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.648+0000 7fc9c6dca700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c0155910 con 0x7fc9c015b950 2023-11-08T19:27:43.658 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.648+0000 7fc9c6dca700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c015d880 con 0x7fc9c00d0430 2023-11-08T19:27:43.658 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.648+0000 7fc9c6dca700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c015db20 con 0x7fc9c006c1d0 2023-11-08T19:27:43.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.648+0000 7fc9bffff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9c015b950 0x7fc9c01f72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:43.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.648+0000 7fc9bffff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9c015b950 0x7fc9c01f72b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44144/0 (socket says 172.21.15.149:44144) 2023-11-08T19:27:43.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.648+0000 7fc9bffff700 1 -- 172.21.15.149:0/1623639895 learned_addr learned my addr 172.21.15.149:0/1623639895 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:27:43.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.648+0000 7fc9c4b66700 1 --2- 172.21.15.149:0/1623639895 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc9c00d0430 0x7fc9c006bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:43.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.648+0000 7fc9c5367700 1 --2- 172.21.15.149:0/1623639895 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc9c006c1d0 0x7fc9c01f77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:43.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.648+0000 7fc9bffff700 1 -- 172.21.15.149:0/1623639895 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc9c006c1d0 msgr2=0x7fc9c01f77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:43.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.648+0000 7fc9bffff700 1 --2- 172.21.15.149:0/1623639895 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc9c006c1d0 0x7fc9c01f77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:43.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.648+0000 7fc9bffff700 1 -- 172.21.15.149:0/1623639895 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc9c00d0430 msgr2=0x7fc9c006bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:43.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.648+0000 7fc9bffff700 1 --2- 172.21.15.149:0/1623639895 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc9c00d0430 0x7fc9c006bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:43.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.648+0000 7fc9bffff700 1 -- 172.21.15.149:0/1623639895 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b4009430 con 0x7fc9c015b950 2023-11-08T19:27:43.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.648+0000 7fc9c5367700 1 --2- 172.21.15.149:0/1623639895 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc9c006c1d0 0x7fc9c01f77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:27:43.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.648+0000 7fc9bffff700 1 --2- 172.21.15.149:0/1623639895 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9c015b950 0x7fc9c01f72b0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac0011e0 tx=0x7fc9ac00ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:43.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.648+0000 7fc9bd7fa700 1 -- 172.21.15.149:0/1623639895 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac004c80 con 0x7fc9c015b950 2023-11-08T19:27:43.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.648+0000 7fc9bd7fa700 1 -- 172.21.15.149:0/1623639895 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9ac004de0 con 0x7fc9c015b950 2023-11-08T19:27:43.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.648+0000 7fc9bd7fa700 1 -- 172.21.15.149:0/1623639895 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac007310 con 0x7fc9c015b950 2023-11-08T19:27:43.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.648+0000 7fc9c6dca700 1 -- 172.21.15.149:0/1623639895 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9c015de00 con 0x7fc9c015b950 2023-11-08T19:27:43.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.649+0000 7fc9c6dca700 1 -- 172.21.15.149:0/1623639895 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9c01555a0 con 0x7fc9c015b950 2023-11-08T19:27:43.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.649+0000 7fc9c6dca700 1 -- 172.21.15.149:0/1623639895 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9c0155a80 con 0x7fc9c015b950 2023-11-08T19:27:43.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.650+0000 7fc9bd7fa700 1 -- 172.21.15.149:0/1623639895 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc9ac007470 con 0x7fc9c015b950 2023-11-08T19:27:43.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.651+0000 7fc9bd7fa700 1 --2- 172.21.15.149:0/1623639895 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc9a406af00 0x7fc9a406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:43.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.651+0000 7fc9bd7fa700 1 -- 172.21.15.149:0/1623639895 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 7206+0+0 (secure 0 0 0) 0x7fc9ac089eb0 con 0x7fc9c015b950 2023-11-08T19:27:43.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.651+0000 7fc9c4b66700 1 --2- 172.21.15.149:0/1623639895 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc9a406af00 0x7fc9a406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:43.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.651+0000 7fc9c4b66700 1 --2- 172.21.15.149:0/1623639895 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc9a406af00 0x7fc9a406d3c0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4000c00 tx=0x7fc9b4008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:43.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.655+0000 7fc9bd7fa700 1 -- 172.21.15.149:0/1623639895 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc9ac054a60 con 0x7fc9c015b950 2023-11-08T19:27:43.709 INFO:tasks.ceph.mds.a.smithi149.stderr:daemon-helper: command crashed with signal 6 2023-11-08T19:27:43.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.890+0000 7fc9c6dca700 1 -- 172.21.15.149:0/1623639895 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc9c00745f0 con 0x7fc9c015b950 2023-11-08T19:27:43.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.890+0000 7fc9bd7fa700 1 -- 172.21.15.149:0/1623639895 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4937 (secure 0 0 0) 0x7fc9ac058080 con 0x7fc9c015b950 2023-11-08T19:27:43.893 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:27:43.893 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":68,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6095,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/852710262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":852710262},{"type":"v1","addr":"172.21.15.160:6835","nonce":852710262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64},{"gid":6451,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/2947079163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2947079163},{"type":"v1","addr":"172.21.15.160:6834","nonce":2947079163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:27:42.347290+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7122,"mds_1":7125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7122":{"gid":7122,"name":"a","rank":0,"incarnation":63,"state":"up:active","state_seq":17,"addr":"172.21.15.149:6836/589971879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":589971879},{"type":"v1","addr":"172.21.15.149:6836","nonce":589971879}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7125":{"gid":7125,"name":"c","rank":1,"incarnation":57,"state":"up:active","state_seq":6,"addr":"172.21.15.149:6837/3917392643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3917392643},{"type":"v1","addr":"172.21.15.149:6837","nonce":3917392643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:27:43.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.892+0000 7fc9c6dca700 1 -- 172.21.15.149:0/1623639895 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc9a406af00 msgr2=0x7fc9a406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:43.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.892+0000 7fc9c6dca700 1 --2- 172.21.15.149:0/1623639895 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc9a406af00 0x7fc9a406d3c0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4000c00 tx=0x7fc9b4008070 comp rx=0 tx=0).stop 2023-11-08T19:27:43.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.892+0000 7fc9c6dca700 1 -- 172.21.15.149:0/1623639895 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9c015b950 msgr2=0x7fc9c01f72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:43.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.892+0000 7fc9c6dca700 1 --2- 172.21.15.149:0/1623639895 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9c015b950 0x7fc9c01f72b0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac0011e0 tx=0x7fc9ac00ca30 comp rx=0 tx=0).stop 2023-11-08T19:27:43.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.893+0000 7fc9c6dca700 1 -- 172.21.15.149:0/1623639895 shutdown_connections 2023-11-08T19:27:43.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.893+0000 7fc9c6dca700 1 --2- 172.21.15.149:0/1623639895 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc9a406af00 0x7fc9a406d3c0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:43.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.893+0000 7fc9c6dca700 1 --2- 172.21.15.149:0/1623639895 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc9c00d0430 0x7fc9c006bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:43.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.893+0000 7fc9c6dca700 1 --2- 172.21.15.149:0/1623639895 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc9c006c1d0 0x7fc9c01f77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:43.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.893+0000 7fc9c6dca700 1 --2- 172.21.15.149:0/1623639895 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9c015b950 0x7fc9c01f72b0 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:43.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.893+0000 7fc9c6dca700 1 -- 172.21.15.149:0/1623639895 >> 172.21.15.149:0/1623639895 conn(0x7fc9c008afd0 msgr2=0x7fc9c00b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:43.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.893+0000 7fc9c6dca700 1 -- 172.21.15.149:0/1623639895 shutdown_connections 2023-11-08T19:27:43.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:43.893+0000 7fc9c6dca700 1 -- 172.21.15.149:0/1623639895 wait complete. 2023-11-08T19:27:43.899 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 68 2023-11-08T19:27:43.906 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-08T19:27:45.031 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-11-08T19:27:48.908 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:27:49.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.039+0000 7f1f50032700 1 Processor -- start 2023-11-08T19:27:49.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.040+0000 7f1f50032700 1 -- start start 2023-11-08T19:27:49.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.040+0000 7f1f50032700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1f480cb300 0x7f1f4815d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:49.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.040+0000 7f1f50032700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f480b2f60 con 0x7f1f480cc140 2023-11-08T19:27:49.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.040+0000 7f1f50032700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f480cc520 con 0x7f1f480cc910 2023-11-08T19:27:49.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.040+0000 7f1f50032700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f480b2430 con 0x7f1f480cb300 2023-11-08T19:27:49.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.041+0000 7f1f4ddce700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f1f480cc140 0x7f1f480b2850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:46170/0 (socket says 172.21.15.149:46170) 2023-11-08T19:27:49.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.041+0000 7f1f4ddce700 1 -- 172.21.15.149:0/398189250 learned_addr learned my addr 172.21.15.149:0/398189250 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:27:49.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.041+0000 7f1f4e5cf700 1 --2- 172.21.15.149:0/398189250 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1f480cb300 0x7f1f4815d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:49.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.041+0000 7f1f4cdcc700 1 -- 172.21.15.149:0/398189250 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 760835584 0 0) 0x7f1f480b2f60 con 0x7f1f480cc140 2023-11-08T19:27:49.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.041+0000 7f1f4cdcc700 1 -- 172.21.15.149:0/398189250 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f340035b0 con 0x7f1f480cc140 2023-11-08T19:27:49.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.041+0000 7f1f4cdcc700 1 -- 172.21.15.149:0/398189250 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2383253508 0 0) 0x7f1f340035b0 con 0x7f1f480cc140 2023-11-08T19:27:49.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.041+0000 7f1f4cdcc700 1 -- 172.21.15.149:0/398189250 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1f480cb300 msgr2=0x7f1f4815d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:49.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.041+0000 7f1f4cdcc700 1 --2- 172.21.15.149:0/398189250 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1f480cb300 0x7f1f4815d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:49.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.041+0000 7f1f4cdcc700 1 -- 172.21.15.149:0/398189250 >> v1:172.21.15.160:6789/0 conn(0x7f1f480cc910 legacy=0x7f1f480cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:49.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.041+0000 7f1f4cdcc700 1 -- 172.21.15.149:0/398189250 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f480b17b0 con 0x7f1f480cc140 2023-11-08T19:27:49.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.041+0000 7f1f4cdcc700 1 -- 172.21.15.149:0/398189250 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f1f3c0017f0 con 0x7f1f480cc140 2023-11-08T19:27:49.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.041+0000 7f1f4cdcc700 1 -- 172.21.15.149:0/398189250 >> v1:172.21.15.149:6789/0 conn(0x7f1f480cc140 legacy=0x7f1f480b2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:49.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.041+0000 7f1f4cdcc700 1 --2- 172.21.15.149:0/398189250 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f34003a30 0x7f1f34003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:49.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.041+0000 7f1f4cdcc700 1 --2- 172.21.15.149:0/398189250 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1f340043e0 0x7f1f340048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:49.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.041+0000 7f1f4cdcc700 1 --2- 172.21.15.149:0/398189250 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1f480cb300 0x7f1f34005110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:49.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.041+0000 7f1f4cdcc700 1 -- 172.21.15.149:0/398189250 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f480b2430 con 0x7f1f34003a30 2023-11-08T19:27:49.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.041+0000 7f1f4cdcc700 1 -- 172.21.15.149:0/398189250 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3400ba40 con 0x7f1f340043e0 2023-11-08T19:27:49.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.041+0000 7f1f4cdcc700 1 -- 172.21.15.149:0/398189250 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3400bc00 con 0x7f1f480cb300 2023-11-08T19:27:49.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.041+0000 7f1f4ddce700 1 --2- 172.21.15.149:0/398189250 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f34003a30 0x7f1f34003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:49.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.041+0000 7f1f4d5cd700 1 --2- 172.21.15.149:0/398189250 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1f340043e0 0x7f1f340048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:49.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.041+0000 7f1f4e5cf700 1 --2- 172.21.15.149:0/398189250 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1f480cb300 0x7f1f34005110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:49.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.042+0000 7f1f4ddce700 1 -- 172.21.15.149:0/398189250 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1f480cb300 msgr2=0x7f1f34005110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:49.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.042+0000 7f1f4ddce700 1 --2- 172.21.15.149:0/398189250 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1f480cb300 0x7f1f34005110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:49.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.042+0000 7f1f4ddce700 1 -- 172.21.15.149:0/398189250 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1f340043e0 msgr2=0x7f1f340048b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:49.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.042+0000 7f1f4ddce700 1 --2- 172.21.15.149:0/398189250 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1f340043e0 0x7f1f340048b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:49.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.042+0000 7f1f4ddce700 1 -- 172.21.15.149:0/398189250 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f340035b0 con 0x7f1f34003a30 2023-11-08T19:27:49.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.042+0000 7f1f4e5cf700 1 --2- 172.21.15.149:0/398189250 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1f480cb300 0x7f1f34005110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:27:49.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.042+0000 7f1f4ddce700 1 --2- 172.21.15.149:0/398189250 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f34003a30 0x7f1f34003e10 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c00c1c0 tx=0x7f1f34005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2993bff6a028f47 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:49.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.042+0000 7f1f4cdcc700 1 -- 172.21.15.149:0/398189250 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c00cd60 con 0x7f1f34003a30 2023-11-08T19:27:49.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.042+0000 7f1f4cdcc700 1 -- 172.21.15.149:0/398189250 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f3c007b20 con 0x7f1f34003a30 2023-11-08T19:27:49.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.042+0000 7f1f4cdcc700 1 -- 172.21.15.149:0/398189250 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c0072f0 con 0x7f1f34003a30 2023-11-08T19:27:49.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.042+0000 7f1f50032700 1 -- 172.21.15.149:0/398189250 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f34003a30 msgr2=0x7f1f34003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:49.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.042+0000 7f1f50032700 1 --2- 172.21.15.149:0/398189250 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f34003a30 0x7f1f34003e10 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c00c1c0 tx=0x7f1f34005880 comp rx=0 tx=0).stop 2023-11-08T19:27:49.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.042+0000 7f1f4e5cf700 1 -- 172.21.15.149:0/398189250 reap_dead start 2023-11-08T19:27:49.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.042+0000 7f1f50032700 1 -- 172.21.15.149:0/398189250 shutdown_connections 2023-11-08T19:27:49.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.042+0000 7f1f50032700 1 -- 172.21.15.149:0/398189250 >> 172.21.15.149:0/398189250 conn(0x7f1f48099a40 msgr2=0x7f1f480d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:49.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.043+0000 7f1f50032700 1 -- 172.21.15.149:0/398189250 shutdown_connections 2023-11-08T19:27:49.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.043+0000 7f1f50032700 1 -- 172.21.15.149:0/398189250 wait complete. 2023-11-08T19:27:49.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.044+0000 7f1f50032700 1 Processor -- start 2023-11-08T19:27:49.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.044+0000 7f1f50032700 1 -- start start 2023-11-08T19:27:49.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.044+0000 7f1f50032700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1f34003a30 0x7f1f4815f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:49.061 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.045+0000 7f1f50032700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f480b31c0 0x7f1f480b3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:49.061 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.045+0000 7f1f50032700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1f480ad1c0 0x7f1f480ad640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:49.061 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.045+0000 7f1f50032700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4815feb0 con 0x7f1f480b31c0 2023-11-08T19:27:49.061 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.045+0000 7f1f50032700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f480adb80 con 0x7f1f34003a30 2023-11-08T19:27:49.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.045+0000 7f1f50032700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f480b4200 con 0x7f1f480ad1c0 2023-11-08T19:27:49.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.045+0000 7f1f4d5cd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f480b31c0 0x7f1f480b3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:49.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.045+0000 7f1f4d5cd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f480b31c0 0x7f1f480b3640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44182/0 (socket says 172.21.15.149:44182) 2023-11-08T19:27:49.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.045+0000 7f1f4d5cd700 1 -- 172.21.15.149:0/63647100 learned_addr learned my addr 172.21.15.149:0/63647100 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:27:49.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.045+0000 7f1f4e5cf700 1 --2- 172.21.15.149:0/63647100 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1f480ad1c0 0x7f1f480ad640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:49.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.045+0000 7f1f4ddce700 1 --2- 172.21.15.149:0/63647100 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1f34003a30 0x7f1f4815f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:49.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.045+0000 7f1f4d5cd700 1 -- 172.21.15.149:0/63647100 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1f480ad1c0 msgr2=0x7f1f480ad640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:49.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.045+0000 7f1f4d5cd700 1 --2- 172.21.15.149:0/63647100 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1f480ad1c0 0x7f1f480ad640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:49.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.045+0000 7f1f4d5cd700 1 -- 172.21.15.149:0/63647100 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1f34003a30 msgr2=0x7f1f4815f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:49.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.045+0000 7f1f4d5cd700 1 --2- 172.21.15.149:0/63647100 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1f34003a30 0x7f1f4815f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:49.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.045+0000 7f1f4d5cd700 1 -- 172.21.15.149:0/63647100 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f480b4540 con 0x7f1f480b31c0 2023-11-08T19:27:49.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.045+0000 7f1f4e5cf700 1 --2- 172.21.15.149:0/63647100 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1f480ad1c0 0x7f1f480ad640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:27:49.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.045+0000 7f1f4ddce700 1 --2- 172.21.15.149:0/63647100 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1f34003a30 0x7f1f4815f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:27:49.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.045+0000 7f1f4d5cd700 1 --2- 172.21.15.149:0/63647100 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f480b31c0 0x7f1f480b3640 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f1f4400f840 tx=0x7f1f4400fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:49.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.045+0000 7f1f3a7fc700 1 -- 172.21.15.149:0/63647100 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f440053e0 con 0x7f1f480b31c0 2023-11-08T19:27:49.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.045+0000 7f1f3a7fc700 1 -- 172.21.15.149:0/63647100 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f44005560 con 0x7f1f480b31c0 2023-11-08T19:27:49.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.045+0000 7f1f50032700 1 -- 172.21.15.149:0/63647100 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f480b3c40 con 0x7f1f480b31c0 2023-11-08T19:27:49.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.045+0000 7f1f3a7fc700 1 -- 172.21.15.149:0/63647100 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f44006aa0 con 0x7f1f480b31c0 2023-11-08T19:27:49.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.045+0000 7f1f50032700 1 -- 172.21.15.149:0/63647100 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f480b47e0 con 0x7f1f480b31c0 2023-11-08T19:27:49.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.046+0000 7f1f50032700 1 -- 172.21.15.149:0/63647100 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f480745f0 con 0x7f1f480b31c0 2023-11-08T19:27:49.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.047+0000 7f1f3a7fc700 1 -- 172.21.15.149:0/63647100 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1f44006c00 con 0x7f1f480b31c0 2023-11-08T19:27:49.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.047+0000 7f1f3a7fc700 1 --2- 172.21.15.149:0/63647100 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1f2c06af00 0x7f1f2c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:49.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.047+0000 7f1f3a7fc700 1 -- 172.21.15.149:0/63647100 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 7206+0+0 (secure 0 0 0) 0x7f1f440892f0 con 0x7f1f480b31c0 2023-11-08T19:27:49.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.047+0000 7f1f4ddce700 1 --2- 172.21.15.149:0/63647100 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1f2c06af00 0x7f1f2c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:49.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.048+0000 7f1f4ddce700 1 --2- 172.21.15.149:0/63647100 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1f2c06af00 0x7f1f2c06d3c0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c015040 tx=0x7f1f3c007000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:49.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.052+0000 7f1f3a7fc700 1 -- 172.21.15.149:0/63647100 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1f44053e50 con 0x7f1f480b31c0 2023-11-08T19:27:49.289 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.287+0000 7f1f50032700 1 -- 172.21.15.149:0/63647100 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1f480c3e80 con 0x7f1f480b31c0 2023-11-08T19:27:49.290 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.287+0000 7f1f3a7fc700 1 -- 172.21.15.149:0/63647100 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4937 (secure 0 0 0) 0x7f1f44057470 con 0x7f1f480b31c0 2023-11-08T19:27:49.290 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:27:49.290 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":68,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6095,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/852710262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":852710262},{"type":"v1","addr":"172.21.15.160:6835","nonce":852710262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64},{"gid":6451,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/2947079163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2947079163},{"type":"v1","addr":"172.21.15.160:6834","nonce":2947079163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:27:42.347290+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7122,"mds_1":7125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7122":{"gid":7122,"name":"a","rank":0,"incarnation":63,"state":"up:active","state_seq":17,"addr":"172.21.15.149:6836/589971879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":589971879},{"type":"v1","addr":"172.21.15.149:6836","nonce":589971879}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7125":{"gid":7125,"name":"c","rank":1,"incarnation":57,"state":"up:active","state_seq":6,"addr":"172.21.15.149:6837/3917392643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3917392643},{"type":"v1","addr":"172.21.15.149:6837","nonce":3917392643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:27:49.292 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.289+0000 7f1f50032700 1 -- 172.21.15.149:0/63647100 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1f2c06af00 msgr2=0x7f1f2c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:49.292 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.290+0000 7f1f50032700 1 --2- 172.21.15.149:0/63647100 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1f2c06af00 0x7f1f2c06d3c0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c015040 tx=0x7f1f3c007000 comp rx=0 tx=0).stop 2023-11-08T19:27:49.292 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.290+0000 7f1f50032700 1 -- 172.21.15.149:0/63647100 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f480b31c0 msgr2=0x7f1f480b3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:49.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.290+0000 7f1f50032700 1 --2- 172.21.15.149:0/63647100 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f480b31c0 0x7f1f480b3640 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f1f4400f840 tx=0x7f1f4400fc00 comp rx=0 tx=0).stop 2023-11-08T19:27:49.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.290+0000 7f1f50032700 1 -- 172.21.15.149:0/63647100 shutdown_connections 2023-11-08T19:27:49.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.290+0000 7f1f50032700 1 --2- 172.21.15.149:0/63647100 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1f2c06af00 0x7f1f2c06d3c0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:49.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.290+0000 7f1f50032700 1 --2- 172.21.15.149:0/63647100 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1f34003a30 0x7f1f4815f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:49.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.290+0000 7f1f50032700 1 --2- 172.21.15.149:0/63647100 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1f480ad1c0 0x7f1f480ad640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:49.294 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.290+0000 7f1f50032700 1 --2- 172.21.15.149:0/63647100 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f480b31c0 0x7f1f480b3640 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:49.294 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.290+0000 7f1f50032700 1 -- 172.21.15.149:0/63647100 >> 172.21.15.149:0/63647100 conn(0x7f1f48099a40 msgr2=0x7f1f480cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:49.294 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.290+0000 7f1f50032700 1 -- 172.21.15.149:0/63647100 shutdown_connections 2023-11-08T19:27:49.294 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:49.290+0000 7f1f50032700 1 -- 172.21.15.149:0/63647100 wait complete. 2023-11-08T19:27:49.295 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 68 2023-11-08T19:27:49.304 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-08T19:27:51.645 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~7s 2023-11-08T19:27:54.305 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:27:54.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.435+0000 7feaf6d01700 1 Processor -- start 2023-11-08T19:27:54.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.435+0000 7feaf6d01700 1 -- start start 2023-11-08T19:27:54.444 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.435+0000 7feaf6d01700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7feaf00caaa0 0x7feaf0164e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:54.444 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.435+0000 7feaf6d01700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaf00b1d70 con 0x7feaf006cde0 2023-11-08T19:27:54.444 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.435+0000 7feaf6d01700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaf0071bb0 con 0x7feaf0071610 2023-11-08T19:27:54.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.435+0000 7feaf6d01700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaf0072830 con 0x7feaf00caaa0 2023-11-08T19:27:54.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.435+0000 7feaf4a9d700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7feaf006cde0 0x7feaf006d1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:46196/0 (socket says 172.21.15.149:46196) 2023-11-08T19:27:54.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.435+0000 7feaf4a9d700 1 -- 172.21.15.149:0/3813603625 learned_addr learned my addr 172.21.15.149:0/3813603625 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:27:54.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.436+0000 7feaf529e700 1 --2- 172.21.15.149:0/3813603625 >> v2:172.21.15.160:3300/0 conn(0x7feaf00caaa0 0x7feaf0164e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:54.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.436+0000 7feaef7fe700 1 -- 172.21.15.149:0/3813603625 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2912719016 0 0) 0x7feaf00b1d70 con 0x7feaf006cde0 2023-11-08T19:27:54.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.436+0000 7feaef7fe700 1 -- 172.21.15.149:0/3813603625 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feae00035b0 con 0x7feaf006cde0 2023-11-08T19:27:54.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.436+0000 7feaef7fe700 1 -- 172.21.15.149:0/3813603625 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 500486639 0 0) 0x7feaf0071bb0 con 0x7feaf0071610 2023-11-08T19:27:54.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.436+0000 7feaef7fe700 1 -- 172.21.15.149:0/3813603625 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feaf00b1d70 con 0x7feaf0071610 2023-11-08T19:27:54.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.436+0000 7feaef7fe700 1 -- 172.21.15.149:0/3813603625 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4026388207 0 0) 0x7feae00035b0 con 0x7feaf006cde0 2023-11-08T19:27:54.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.436+0000 7feaef7fe700 1 -- 172.21.15.149:0/3813603625 >> v2:172.21.15.160:3300/0 conn(0x7feaf00caaa0 msgr2=0x7feaf0164e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:54.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.436+0000 7feaef7fe700 1 --2- 172.21.15.149:0/3813603625 >> v2:172.21.15.160:3300/0 conn(0x7feaf00caaa0 0x7feaf0164e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:54.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.436+0000 7feaef7fe700 1 -- 172.21.15.149:0/3813603625 >> v1:172.21.15.160:6789/0 conn(0x7feaf0071610 legacy=0x7feaf015add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:54.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.436+0000 7feaef7fe700 1 -- 172.21.15.149:0/3813603625 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf0071e90 con 0x7feaf006cde0 2023-11-08T19:27:54.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.436+0000 7feaef7fe700 1 -- 172.21.15.149:0/3813603625 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7feae4001670 con 0x7feaf006cde0 2023-11-08T19:27:54.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.436+0000 7feaef7fe700 1 -- 172.21.15.149:0/3813603625 >> v1:172.21.15.149:6789/0 conn(0x7feaf006cde0 legacy=0x7feaf006d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:54.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.436+0000 7feaef7fe700 1 --2- 172.21.15.149:0/3813603625 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feae0003be0 0x7feae0003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:54.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.436+0000 7feaef7fe700 1 --2- 172.21.15.149:0/3813603625 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feae0004850 0x7feae0004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:54.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.436+0000 7feaef7fe700 1 --2- 172.21.15.149:0/3813603625 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feae0005260 0x7feae000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:54.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.436+0000 7feaef7fe700 1 -- 172.21.15.149:0/3813603625 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf0072830 con 0x7feae0003be0 2023-11-08T19:27:54.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.436+0000 7feaef7fe700 1 -- 172.21.15.149:0/3813603625 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae000c190 con 0x7feae0004850 2023-11-08T19:27:54.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.436+0000 7feaef7fe700 1 -- 172.21.15.149:0/3813603625 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feae000c350 con 0x7feae0005260 2023-11-08T19:27:54.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.436+0000 7feaf4a9d700 1 --2- 172.21.15.149:0/3813603625 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feae0003be0 0x7feae0003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:54.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.436+0000 7feaeffff700 1 --2- 172.21.15.149:0/3813603625 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feae0004850 0x7feae0004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:54.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.436+0000 7feaf529e700 1 --2- 172.21.15.149:0/3813603625 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feae0005260 0x7feae000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:54.450 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.436+0000 7feaf4a9d700 1 -- 172.21.15.149:0/3813603625 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feae0005260 msgr2=0x7feae000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:54.450 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.436+0000 7feaf4a9d700 1 --2- 172.21.15.149:0/3813603625 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feae0005260 0x7feae000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:54.450 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.436+0000 7feaf4a9d700 1 -- 172.21.15.149:0/3813603625 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feae0004850 msgr2=0x7feae0004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:27:54.450 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.437+0000 7feaf4a9d700 1 --2- 172.21.15.149:0/3813603625 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feae0004850 0x7feae0004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:54.450 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.437+0000 7feaf4a9d700 1 -- 172.21.15.149:0/3813603625 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae00035b0 con 0x7feae0003be0 2023-11-08T19:27:54.451 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.437+0000 7feaf529e700 1 -- 172.21.15.149:0/3813603625 reap_dead start 2023-11-08T19:27:54.451 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.437+0000 7feaeffff700 1 --2- 172.21.15.149:0/3813603625 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feae0004850 0x7feae0004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:27:54.451 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.437+0000 7feaf4a9d700 1 --2- 172.21.15.149:0/3813603625 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feae0003be0 0x7feae0003fe0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7feae400c160 tx=0x7feae0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a819a187b513c149 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:54.451 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.437+0000 7feaef7fe700 1 -- 172.21.15.149:0/3813603625 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae400cca0 con 0x7feae0003be0 2023-11-08T19:27:54.451 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.437+0000 7feaef7fe700 1 -- 172.21.15.149:0/3813603625 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae400ce20 con 0x7feae0003be0 2023-11-08T19:27:54.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.437+0000 7feaef7fe700 1 -- 172.21.15.149:0/3813603625 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae4005ba0 con 0x7feae0003be0 2023-11-08T19:27:54.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.437+0000 7feaf6d01700 1 -- 172.21.15.149:0/3813603625 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feae0003be0 msgr2=0x7feae0003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:54.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.437+0000 7feaf6d01700 1 --2- 172.21.15.149:0/3813603625 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feae0003be0 0x7feae0003fe0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7feae400c160 tx=0x7feae0005880 comp rx=0 tx=0).stop 2023-11-08T19:27:54.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.437+0000 7feaf6d01700 1 -- 172.21.15.149:0/3813603625 shutdown_connections 2023-11-08T19:27:54.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.437+0000 7feaf6d01700 1 --2- 172.21.15.149:0/3813603625 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feae0003be0 0x7feae0003fe0 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:54.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.437+0000 7feaf6d01700 1 -- 172.21.15.149:0/3813603625 >> 172.21.15.149:0/3813603625 conn(0x7feaf006b3d0 msgr2=0x7feaf00cf460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:54.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.437+0000 7feaf6d01700 1 -- 172.21.15.149:0/3813603625 shutdown_connections 2023-11-08T19:27:54.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.437+0000 7feaf6d01700 1 -- 172.21.15.149:0/3813603625 wait complete. 2023-11-08T19:27:54.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.439+0000 7feaf6d01700 1 Processor -- start 2023-11-08T19:27:54.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.439+0000 7feaf6d01700 1 -- start start 2023-11-08T19:27:54.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.440+0000 7feaf6d01700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feae0003be0 0x7feaf00c6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:54.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.440+0000 7feaf6d01700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feaf01f0bc0 0x7feaf014fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:54.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.440+0000 7feaf6d01700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feaf01f30d0 0x7feaf015bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:54.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.440+0000 7feaf6d01700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf00c3f60 con 0x7feae0003be0 2023-11-08T19:27:54.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.440+0000 7feaf6d01700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf0150160 con 0x7feaf01f30d0 2023-11-08T19:27:54.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.440+0000 7feaf6d01700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaf00c3c50 con 0x7feaf01f0bc0 2023-11-08T19:27:54.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.440+0000 7feaf4a9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feae0003be0 0x7feaf00c6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:54.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.440+0000 7feaf4a9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feae0003be0 0x7feaf00c6750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44204/0 (socket says 172.21.15.149:44204) 2023-11-08T19:27:54.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.440+0000 7feaf4a9d700 1 -- 172.21.15.149:0/1605091771 learned_addr learned my addr 172.21.15.149:0/1605091771 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:27:54.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.440+0000 7feaf529e700 1 --2- 172.21.15.149:0/1605091771 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feaf01f30d0 0x7feaf015bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:54.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.440+0000 7feaeffff700 1 --2- 172.21.15.149:0/1605091771 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feaf01f0bc0 0x7feaf014fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:54.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.440+0000 7feaf4a9d700 1 -- 172.21.15.149:0/1605091771 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feaf01f0bc0 msgr2=0x7feaf014fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:54.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.440+0000 7feaf4a9d700 1 --2- 172.21.15.149:0/1605091771 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feaf01f0bc0 0x7feaf014fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:54.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.440+0000 7feaf4a9d700 1 -- 172.21.15.149:0/1605091771 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feaf01f30d0 msgr2=0x7feaf015bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:54.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.440+0000 7feaf4a9d700 1 --2- 172.21.15.149:0/1605091771 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feaf01f30d0 0x7feaf015bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:54.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.440+0000 7feaf4a9d700 1 -- 172.21.15.149:0/1605091771 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf01f3560 con 0x7feae0003be0 2023-11-08T19:27:54.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.441+0000 7feaf4a9d700 1 --2- 172.21.15.149:0/1605091771 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feae0003be0 0x7feaf00c6750 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7feae4000c00 tx=0x7feae4001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:54.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.441+0000 7feaed7fa700 1 -- 172.21.15.149:0/1605091771 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae4004c80 con 0x7feae0003be0 2023-11-08T19:27:54.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.441+0000 7feaed7fa700 1 -- 172.21.15.149:0/1605091771 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae4004de0 con 0x7feae0003be0 2023-11-08T19:27:54.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.441+0000 7feaed7fa700 1 -- 172.21.15.149:0/1605091771 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae4007310 con 0x7feae0003be0 2023-11-08T19:27:54.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.441+0000 7feaf6d01700 1 -- 172.21.15.149:0/1605091771 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaf01f3820 con 0x7feae0003be0 2023-11-08T19:27:54.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.441+0000 7feaf6d01700 1 -- 172.21.15.149:0/1605091771 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaf01f3de0 con 0x7feae0003be0 2023-11-08T19:27:54.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.442+0000 7feaf6d01700 1 -- 172.21.15.149:0/1605091771 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaf00b5470 con 0x7feae0003be0 2023-11-08T19:27:54.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.442+0000 7feaed7fa700 1 -- 172.21.15.149:0/1605091771 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7feae4007470 con 0x7feae0003be0 2023-11-08T19:27:54.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.442+0000 7feaed7fa700 1 --2- 172.21.15.149:0/1605091771 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fead406af00 0x7fead406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:54.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.443+0000 7feaed7fa700 1 -- 172.21.15.149:0/1605091771 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 7264+0+0 (secure 0 0 0) 0x7feae408a5d0 con 0x7feae0003be0 2023-11-08T19:27:54.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.443+0000 7feaeffff700 1 --2- 172.21.15.149:0/1605091771 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fead406af00 0x7fead406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:54.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.443+0000 7feaeffff700 1 --2- 172.21.15.149:0/1605091771 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fead406af00 0x7fead406d3c0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7feadc007b70 tx=0x7feadc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:54.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.447+0000 7feaed7fa700 1 -- 172.21.15.149:0/1605091771 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7feae4055080 con 0x7feae0003be0 2023-11-08T19:27:54.685 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.683+0000 7feaf6d01700 1 -- 172.21.15.149:0/1605091771 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feaf0071bb0 con 0x7feae0003be0 2023-11-08T19:27:54.686 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.684+0000 7feaed7fa700 1 -- 172.21.15.149:0/1605091771 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4937 (secure 0 0 0) 0x7feae40586a0 con 0x7feae0003be0 2023-11-08T19:27:54.686 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:27:54.686 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":68,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6095,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/852710262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":852710262},{"type":"v1","addr":"172.21.15.160:6835","nonce":852710262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64},{"gid":6451,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/2947079163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2947079163},{"type":"v1","addr":"172.21.15.160:6834","nonce":2947079163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:27:42.347290+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7122,"mds_1":7125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7122":{"gid":7122,"name":"a","rank":0,"incarnation":63,"state":"up:active","state_seq":17,"addr":"172.21.15.149:6836/589971879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":589971879},{"type":"v1","addr":"172.21.15.149:6836","nonce":589971879}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7125":{"gid":7125,"name":"c","rank":1,"incarnation":57,"state":"up:active","state_seq":6,"addr":"172.21.15.149:6837/3917392643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3917392643},{"type":"v1","addr":"172.21.15.149:6837","nonce":3917392643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:27:54.688 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.686+0000 7feaf6d01700 1 -- 172.21.15.149:0/1605091771 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fead406af00 msgr2=0x7fead406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:54.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.686+0000 7feaf6d01700 1 --2- 172.21.15.149:0/1605091771 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fead406af00 0x7fead406d3c0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7feadc007b70 tx=0x7feadc009040 comp rx=0 tx=0).stop 2023-11-08T19:27:54.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.686+0000 7feaf6d01700 1 -- 172.21.15.149:0/1605091771 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feae0003be0 msgr2=0x7feaf00c6750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:54.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.686+0000 7feaf6d01700 1 --2- 172.21.15.149:0/1605091771 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feae0003be0 0x7feaf00c6750 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7feae4000c00 tx=0x7feae4001930 comp rx=0 tx=0).stop 2023-11-08T19:27:54.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.686+0000 7feaf6d01700 1 -- 172.21.15.149:0/1605091771 shutdown_connections 2023-11-08T19:27:54.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.686+0000 7feaf6d01700 1 --2- 172.21.15.149:0/1605091771 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fead406af00 0x7fead406d3c0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:54.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.686+0000 7feaf6d01700 1 --2- 172.21.15.149:0/1605091771 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feaf01f30d0 0x7feaf015bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:54.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.686+0000 7feaf6d01700 1 --2- 172.21.15.149:0/1605091771 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feae0003be0 0x7feaf00c6750 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:54.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.686+0000 7feaf6d01700 1 --2- 172.21.15.149:0/1605091771 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feaf01f0bc0 0x7feaf014fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:54.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.686+0000 7feaf6d01700 1 -- 172.21.15.149:0/1605091771 >> 172.21.15.149:0/1605091771 conn(0x7feaf006b3d0 msgr2=0x7feaf00cbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:54.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.686+0000 7feaf6d01700 1 -- 172.21.15.149:0/1605091771 shutdown_connections 2023-11-08T19:27:54.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:54.686+0000 7feaf6d01700 1 -- 172.21.15.149:0/1605091771 wait complete. 2023-11-08T19:27:54.691 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 68 2023-11-08T19:27:54.701 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-08T19:27:58.259 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~13s 2023-11-08T19:27:59.702 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:27:59.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:59.835+0000 7f813750c700 1 Processor -- start 2023-11-08T19:27:59.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:59.835+0000 7f813750c700 1 -- start start 2023-11-08T19:27:59.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:59.836+0000 7f813750c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f81300cc910 0x7f81300cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:59.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:59.836+0000 7f813750c700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81300b2f60 con 0x7f81300cc140 2023-11-08T19:27:59.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:59.836+0000 7f813750c700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81300cc520 con 0x7f81300cb130 2023-11-08T19:27:59.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:59.836+0000 7f813750c700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81300b2430 con 0x7f81300cc910 2023-11-08T19:27:59.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:59.836+0000 7f81352a8700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f81300cc140 0x7f81300b2850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:46216/0 (socket says 172.21.15.149:46216) 2023-11-08T19:27:59.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:59.836+0000 7f81352a8700 1 -- 172.21.15.149:0/4177717192 learned_addr learned my addr 172.21.15.149:0/4177717192 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:27:59.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:59.836+0000 7f8134aa7700 1 --2- 172.21.15.149:0/4177717192 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f81300cc910 0x7f81300cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:59.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:59.836+0000 7f8127fff700 1 -- 172.21.15.149:0/4177717192 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3110611265 0 0) 0x7f81300b2f60 con 0x7f81300cc140 2023-11-08T19:27:59.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:59.836+0000 7f8127fff700 1 -- 172.21.15.149:0/4177717192 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f811c0035b0 con 0x7f81300cc140 2023-11-08T19:27:59.842 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:59.837+0000 7f8127fff700 1 -- 172.21.15.149:0/4177717192 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1887597141 0 0) 0x7f81300cc520 con 0x7f81300cb130 2023-11-08T19:27:59.842 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:59.837+0000 7f8127fff700 1 -- 172.21.15.149:0/4177717192 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81300b2f60 con 0x7f81300cb130 2023-11-08T19:27:59.842 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:59.837+0000 7f8127fff700 1 -- 172.21.15.149:0/4177717192 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1238459613 0 0) 0x7f811c0035b0 con 0x7f81300cc140 2023-11-08T19:27:59.842 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:59.837+0000 7f8134aa7700 1 -- 172.21.15.149:0/4177717192 >> v1:172.21.15.160:6789/0 conn(0x7f81300cb130 legacy=0x7f813015d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:59.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:59.837+0000 7f8134aa7700 1 -- 172.21.15.149:0/4177717192 >> v1:172.21.15.149:6789/0 conn(0x7f81300cc140 legacy=0x7f81300b2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:59.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:59.837+0000 7f8134aa7700 1 -- 172.21.15.149:0/4177717192 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81300cb5b0 con 0x7f81300cc910 2023-11-08T19:27:59.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:59.837+0000 7f8134aa7700 1 --2- 172.21.15.149:0/4177717192 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f81300cc910 0x7f81300cabf0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8120009870 tx=0x7f8120009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8e19afee38b1c23 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:59.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:59.837+0000 7f8127fff700 1 -- 172.21.15.149:0/4177717192 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812c0017f0 con 0x7f81300cc910 2023-11-08T19:27:59.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:59.837+0000 7f8127fff700 1 -- 172.21.15.149:0/4177717192 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8120004030 con 0x7f81300cc910 2023-11-08T19:27:59.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:59.837+0000 7f8127fff700 1 -- 172.21.15.149:0/4177717192 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81200043c0 con 0x7f81300cc910 2023-11-08T19:27:59.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:59.838+0000 7f813750c700 1 -- 172.21.15.149:0/4177717192 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f81300cc910 msgr2=0x7f81300cabf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:59.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:59.838+0000 7f813750c700 1 --2- 172.21.15.149:0/4177717192 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f81300cc910 0x7f81300cabf0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8120009870 tx=0x7f8120009b80 comp rx=0 tx=0).stop 2023-11-08T19:27:59.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:59.838+0000 7f813750c700 1 -- 172.21.15.149:0/4177717192 shutdown_connections 2023-11-08T19:27:59.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:59.838+0000 7f813750c700 1 --2- 172.21.15.149:0/4177717192 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f81300cc910 0x7f81300cabf0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:59.845 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:59.838+0000 7f813750c700 1 -- 172.21.15.149:0/4177717192 >> 172.21.15.149:0/4177717192 conn(0x7f8130099a40 msgr2=0x7f81300d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:27:59.845 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:59.838+0000 7f813750c700 1 -- 172.21.15.149:0/4177717192 shutdown_connections 2023-11-08T19:27:59.845 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:59.838+0000 7f813750c700 1 -- 172.21.15.149:0/4177717192 wait complete. 2023-11-08T19:27:59.849 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:59.839+0000 7f813750c700 1 Processor -- start 2023-11-08T19:27:59.849 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:59.839+0000 7f813750c700 1 -- start start 2023-11-08T19:27:59.849 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:59.840+0000 7f813750c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f81300cb130 0x7f813014da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:59.849 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:59.840+0000 7f813750c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f81300cc140 0x7f81301f3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:59.849 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:59.840+0000 7f813750c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f81300cc910 0x7f813015db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:59.850 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:59.840+0000 7f813750c700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81300b4740 con 0x7f81300cc910 2023-11-08T19:27:59.850 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:59.840+0000 7f813750c700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81300b4950 con 0x7f81300cc140 2023-11-08T19:27:59.850 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:59.840+0000 7f813750c700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81300b4c30 con 0x7f81300cb130 2023-11-08T19:27:59.850 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:59.840+0000 7f8135aa9700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f81300cc910 0x7f813015db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:59.851 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:59.840+0000 7f8135aa9700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f81300cc910 0x7f813015db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44222/0 (socket says 172.21.15.149:44222) 2023-11-08T19:27:59.851 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:59.840+0000 7f8135aa9700 1 -- 172.21.15.149:0/1217214476 learned_addr learned my addr 172.21.15.149:0/1217214476 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:27:59.851 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:59.840+0000 7f8134aa7700 1 --2- 172.21.15.149:0/1217214476 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f81300cc140 0x7f81301f3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:59.851 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:59.840+0000 7f81352a8700 1 --2- 172.21.15.149:0/1217214476 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f81300cb130 0x7f813014da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:59.851 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:59.840+0000 7f8135aa9700 1 -- 172.21.15.149:0/1217214476 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f81300cb130 msgr2=0x7f813014da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:59.852 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:59.840+0000 7f8135aa9700 1 --2- 172.21.15.149:0/1217214476 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f81300cb130 0x7f813014da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:59.852 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:59.840+0000 7f8135aa9700 1 -- 172.21.15.149:0/1217214476 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f81300cc140 msgr2=0x7f81301f3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:27:59.852 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:59.840+0000 7f8135aa9700 1 --2- 172.21.15.149:0/1217214476 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f81300cc140 0x7f81301f3680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:27:59.852 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:59.840+0000 7f8135aa9700 1 -- 172.21.15.149:0/1217214476 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81200094a0 con 0x7f81300cc910 2023-11-08T19:27:59.852 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:59.840+0000 7f8134aa7700 1 --2- 172.21.15.149:0/1217214476 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f81300cc140 0x7f81301f3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:27:59.853 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:59.840+0000 7f8135aa9700 1 --2- 172.21.15.149:0/1217214476 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f81300cc910 0x7f813015db70 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f812800cc20 tx=0x7f812800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:59.853 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:59.840+0000 7f8125ffb700 1 -- 172.21.15.149:0/1217214476 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812800ac20 con 0x7f81300cc910 2023-11-08T19:27:59.853 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:59.840+0000 7f8125ffb700 1 -- 172.21.15.149:0/1217214476 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f812800ad80 con 0x7f81300cc910 2023-11-08T19:27:59.853 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:59.840+0000 7f813750c700 1 -- 172.21.15.149:0/1217214476 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81300b4f10 con 0x7f81300cc910 2023-11-08T19:27:59.853 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:59.840+0000 7f8125ffb700 1 -- 172.21.15.149:0/1217214476 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8128003c20 con 0x7f81300cc910 2023-11-08T19:27:59.854 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:59.841+0000 7f813750c700 1 -- 172.21.15.149:0/1217214476 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f813014df50 con 0x7f81300cc910 2023-11-08T19:27:59.854 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:59.842+0000 7f813750c700 1 -- 172.21.15.149:0/1217214476 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81300b5430 con 0x7f81300cc910 2023-11-08T19:27:59.854 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:59.842+0000 7f8125ffb700 1 -- 172.21.15.149:0/1217214476 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f81280050d0 con 0x7f81300cc910 2023-11-08T19:27:59.854 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:59.842+0000 7f8125ffb700 1 --2- 172.21.15.149:0/1217214476 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f811406af00 0x7f811406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:27:59.854 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:59.843+0000 7f8125ffb700 1 -- 172.21.15.149:0/1217214476 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 7264+0+0 (secure 0 0 0) 0x7f8128089e60 con 0x7f81300cc910 2023-11-08T19:27:59.855 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:59.843+0000 7f81352a8700 1 --2- 172.21.15.149:0/1217214476 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f811406af00 0x7f811406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:27:59.855 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:59.843+0000 7f81352a8700 1 --2- 172.21.15.149:0/1217214476 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f811406af00 0x7f811406d3c0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f812c001eb0 tx=0x7f812c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:27:59.855 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:27:59.848+0000 7f8125ffb700 1 -- 172.21.15.149:0/1217214476 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f81300b5430 con 0x7f81300cc910 2023-11-08T19:28:00.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.081+0000 7f813750c700 1 -- 172.21.15.149:0/1217214476 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f81300b5430 con 0x7f81300cc910 2023-11-08T19:28:00.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.081+0000 7f8125ffb700 1 -- 172.21.15.149:0/1217214476 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+4985 (secure 0 0 0) 0x7f81300b5430 con 0x7f81300cc910 2023-11-08T19:28:00.084 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:28:00.084 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":69,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6095,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/852710262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":852710262},{"type":"v1","addr":"172.21.15.160:6835","nonce":852710262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64},{"gid":6451,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/2947079163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2947079163},{"type":"v1","addr":"172.21.15.160:6834","nonce":2947079163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:27:59.137611+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7122,"mds_1":7125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7122":{"gid":7122,"name":"a","rank":0,"incarnation":63,"state":"up:active","state_seq":17,"addr":"172.21.15.149:6836/589971879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":589971879},{"type":"v1","addr":"172.21.15.149:6836","nonce":589971879}]},"join_fscid":-1,"laggy_since":"2023-11-08T19:27:59.137611+0000","export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7125":{"gid":7125,"name":"c","rank":1,"incarnation":57,"state":"up:active","state_seq":6,"addr":"172.21.15.149:6837/3917392643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3917392643},{"type":"v1","addr":"172.21.15.149:6837","nonce":3917392643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:28:00.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.083+0000 7f813750c700 1 -- 172.21.15.149:0/1217214476 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f811406af00 msgr2=0x7f811406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:00.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.083+0000 7f813750c700 1 --2- 172.21.15.149:0/1217214476 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f811406af00 0x7f811406d3c0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f812c001eb0 tx=0x7f812c009040 comp rx=0 tx=0).stop 2023-11-08T19:28:00.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.083+0000 7f813750c700 1 -- 172.21.15.149:0/1217214476 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f81300cc910 msgr2=0x7f813015db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:00.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.083+0000 7f813750c700 1 --2- 172.21.15.149:0/1217214476 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f81300cc910 0x7f813015db70 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f812800cc20 tx=0x7f812800a060 comp rx=0 tx=0).stop 2023-11-08T19:28:00.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.083+0000 7f813750c700 1 -- 172.21.15.149:0/1217214476 shutdown_connections 2023-11-08T19:28:00.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.083+0000 7f813750c700 1 --2- 172.21.15.149:0/1217214476 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f811406af00 0x7f811406d3c0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:00.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.083+0000 7f813750c700 1 --2- 172.21.15.149:0/1217214476 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f81300cc910 0x7f813015db70 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:00.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.083+0000 7f813750c700 1 --2- 172.21.15.149:0/1217214476 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f81300cb130 0x7f813014da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:00.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.083+0000 7f813750c700 1 --2- 172.21.15.149:0/1217214476 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f81300cc140 0x7f81301f3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:00.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.083+0000 7f813750c700 1 -- 172.21.15.149:0/1217214476 >> 172.21.15.149:0/1217214476 conn(0x7f8130099a40 msgr2=0x7f81300b2850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:00.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.083+0000 7f813750c700 1 -- 172.21.15.149:0/1217214476 shutdown_connections 2023-11-08T19:28:00.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.083+0000 7f813750c700 1 -- 172.21.15.149:0/1217214476 wait complete. 2023-11-08T19:28:00.088 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 69 2023-11-08T19:28:00.098 DEBUG:tasks.ceph_test_case:wait_until_true: success in 15s and 0 retries 2023-11-08T19:28:00.098 DEBUG:teuthology.orchestra.run.smithi149:> sudo sysctl -n kernel.core_pattern 2023-11-08T19:28:00.125 INFO:teuthology.orchestra.run.smithi149.stdout:/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-08T19:28:00.126 INFO:tasks.cephfs.cephfs_test_case:Clearing core from directory: /home/ubuntu/cephtest/archive/coredump 2023-11-08T19:28:00.185 DEBUG:teuthology.orchestra.run.smithi149:> cd /home/ubuntu/cephtest/archive/coredump && sudo ls | sudo xargs file 2023-11-08T19:28:00.215 INFO:teuthology.orchestra.run.smithi149.stdout:1699471663.134497.core: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i a', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/bin/ceph-mds', platform: 'x86_64' 2023-11-08T19:28:00.217 INFO:tasks.cephfs.cephfs_test_case:Enumerated cores: ['1699471663.134497.core'] 2023-11-08T19:28:00.218 INFO:tasks.cephfs.cephfs_test_case:Found core file 1699471663.134497.core, deleting it 2023-11-08T19:28:00.218 DEBUG:teuthology.orchestra.run.smithi149:> cd /home/ubuntu/cephtest/archive/coredump && sudo rm -f 1699471663.134497.core 2023-11-08T19:28:00.287 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 6:0 2023-11-08T19:28:00.451 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.448+0000 7fb5f76ec700 1 Processor -- start 2023-11-08T19:28:00.451 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.449+0000 7fb5f76ec700 1 -- start start 2023-11-08T19:28:00.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.449+0000 7fb5f76ec700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb5f00b16b0 0x7fb5f00ce380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:00.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.449+0000 7fb5f76ec700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fb5f00b20b0 0x7fb5f00b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:00.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.449+0000 7fb5f76ec700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5f00d1330 con 0x7fb5f00afb30 2023-11-08T19:28:00.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.449+0000 7fb5f76ec700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5f00b2aa0 con 0x7fb5f00b20b0 2023-11-08T19:28:00.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.449+0000 7fb5f76ec700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f00cb490 con 0x7fb5f00b16b0 2023-11-08T19:28:00.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.450+0000 7fb5f4c87700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb5f00b16b0 0x7fb5f00ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:00.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.450+0000 7fb5f5c89700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fb5f00b20b0 0x7fb5f00b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:00.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.450+0000 7fb5f5488700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7fb5f00afb30 0x7fb5f00cbf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.149:57894/0 (socket says 172.21.15.149:57894) 2023-11-08T19:28:00.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.450+0000 7fb5f5488700 1 -- 172.21.15.149:0/3995267853 learned_addr learned my addr 172.21.15.149:0/3995267853 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:28:00.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.450+0000 7fb5f4c87700 1 -- 172.21.15.149:0/3995267853 >> v2:172.21.15.160:3300/0 conn(0x7fb5f00b20b0 msgr2=0x7fb5f00b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:00.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.450+0000 7fb5f4c87700 1 --2- 172.21.15.149:0/3995267853 >> v2:172.21.15.160:3300/0 conn(0x7fb5f00b20b0 0x7fb5f00b2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:00.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.450+0000 7fb5f4c87700 1 -- 172.21.15.149:0/3995267853 >> v1:172.21.15.160:6789/0 conn(0x7fb5f00afb30 legacy=0x7fb5f00cbf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:00.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.450+0000 7fb5f4c87700 1 -- 172.21.15.149:0/3995267853 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f00cb770 con 0x7fb5f00b16b0 2023-11-08T19:28:00.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.450+0000 7fb5f5c89700 1 --2- 172.21.15.149:0/3995267853 >> v2:172.21.15.160:3300/0 conn(0x7fb5f00b20b0 0x7fb5f00b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:28:00.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.451+0000 7fb5f4c87700 1 --2- 172.21.15.149:0/3995267853 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb5f00b16b0 0x7fb5f00ce380 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0009840 tx=0x7fb5e0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf9459cf6ada89e5 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:00.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.451+0000 7fb5e7fff700 1 -- 172.21.15.149:0/3995267853 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e0011830 con 0x7fb5f00b16b0 2023-11-08T19:28:00.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.451+0000 7fb5e7fff700 1 -- 172.21.15.149:0/3995267853 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5e0011990 con 0x7fb5f00b16b0 2023-11-08T19:28:00.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.451+0000 7fb5e7fff700 1 -- 172.21.15.149:0/3995267853 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e0011d20 con 0x7fb5f00b16b0 2023-11-08T19:28:00.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.451+0000 7fb5f76ec700 1 -- 172.21.15.149:0/3995267853 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb5f00b16b0 msgr2=0x7fb5f00ce380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:00.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.451+0000 7fb5f76ec700 1 --2- 172.21.15.149:0/3995267853 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb5f00b16b0 0x7fb5f00ce380 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0009840 tx=0x7fb5e0009b50 comp rx=0 tx=0).stop 2023-11-08T19:28:00.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.451+0000 7fb5f76ec700 1 -- 172.21.15.149:0/3995267853 shutdown_connections 2023-11-08T19:28:00.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.451+0000 7fb5f76ec700 1 --2- 172.21.15.149:0/3995267853 >> v2:172.21.15.160:3300/0 conn(0x7fb5f00b20b0 0x7fb5f00b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:00.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.451+0000 7fb5f76ec700 1 --2- 172.21.15.149:0/3995267853 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb5f00b16b0 0x7fb5f00ce380 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:00.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.451+0000 7fb5f76ec700 1 -- 172.21.15.149:0/3995267853 >> 172.21.15.149:0/3995267853 conn(0x7fb5f0099a40 msgr2=0x7fb5f00d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:00.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.451+0000 7fb5f76ec700 1 -- 172.21.15.149:0/3995267853 shutdown_connections 2023-11-08T19:28:00.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.451+0000 7fb5f76ec700 1 -- 172.21.15.149:0/3995267853 wait complete. 2023-11-08T19:28:00.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.452+0000 7fb5f76ec700 1 Processor -- start 2023-11-08T19:28:00.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.453+0000 7fb5f76ec700 1 -- start start 2023-11-08T19:28:00.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.453+0000 7fb5f76ec700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb5f00afb30 0x7fb5f00c94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:00.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.453+0000 7fb5f76ec700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb5f00b16b0 0x7fb5f00c6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:00.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.453+0000 7fb5f76ec700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb5f00b20b0 0x7fb5f01e6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:00.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.453+0000 7fb5f76ec700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f00ca040 con 0x7fb5f00b16b0 2023-11-08T19:28:00.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.453+0000 7fb5f76ec700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f00c9d60 con 0x7fb5f00afb30 2023-11-08T19:28:00.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.453+0000 7fb5f76ec700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f00c4200 con 0x7fb5f00b20b0 2023-11-08T19:28:00.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.453+0000 7fb5f4c87700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb5f00b16b0 0x7fb5f00c6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:00.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.453+0000 7fb5f4c87700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb5f00b16b0 0x7fb5f00c6880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44236/0 (socket says 172.21.15.149:44236) 2023-11-08T19:28:00.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.453+0000 7fb5f4c87700 1 -- 172.21.15.149:0/75350771 learned_addr learned my addr 172.21.15.149:0/75350771 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:28:00.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.453+0000 7fb5f5c89700 1 --2- 172.21.15.149:0/75350771 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb5f00b20b0 0x7fb5f01e6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:00.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.454+0000 7fb5f5488700 1 --2- 172.21.15.149:0/75350771 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb5f00afb30 0x7fb5f00c94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:00.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.454+0000 7fb5f4c87700 1 -- 172.21.15.149:0/75350771 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb5f00b20b0 msgr2=0x7fb5f01e6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:00.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.454+0000 7fb5f4c87700 1 --2- 172.21.15.149:0/75350771 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb5f00b20b0 0x7fb5f01e6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:00.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.454+0000 7fb5f4c87700 1 -- 172.21.15.149:0/75350771 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb5f00afb30 msgr2=0x7fb5f00c94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:00.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.454+0000 7fb5f4c87700 1 --2- 172.21.15.149:0/75350771 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb5f00afb30 0x7fb5f00c94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:00.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.454+0000 7fb5f4c87700 1 -- 172.21.15.149:0/75350771 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5e8009a70 con 0x7fb5f00b16b0 2023-11-08T19:28:00.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.454+0000 7fb5f4c87700 1 --2- 172.21.15.149:0/75350771 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb5f00b16b0 0x7fb5f00c6880 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7fb5e00090b0 tx=0x7fb5e0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:00.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.454+0000 7fb5e5ffb700 1 -- 172.21.15.149:0/75350771 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e00045d0 con 0x7fb5f00b16b0 2023-11-08T19:28:00.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.454+0000 7fb5f76ec700 1 -- 172.21.15.149:0/75350771 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5e00094a0 con 0x7fb5f00b16b0 2023-11-08T19:28:00.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.454+0000 7fb5f76ec700 1 -- 172.21.15.149:0/75350771 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5f00c47c0 con 0x7fb5f00b16b0 2023-11-08T19:28:00.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.454+0000 7fb5e5ffb700 1 -- 172.21.15.149:0/75350771 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5e001e070 con 0x7fb5f00b16b0 2023-11-08T19:28:00.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.454+0000 7fb5e5ffb700 1 -- 172.21.15.149:0/75350771 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e00038a0 con 0x7fb5f00b16b0 2023-11-08T19:28:00.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.455+0000 7fb5f76ec700 1 -- 172.21.15.149:0/75350771 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5d00052f0 con 0x7fb5f00b16b0 2023-11-08T19:28:00.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.456+0000 7fb5e5ffb700 1 -- 172.21.15.149:0/75350771 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb5e0003a00 con 0x7fb5f00b16b0 2023-11-08T19:28:00.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.456+0000 7fb5e5ffb700 1 --2- 172.21.15.149:0/75350771 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb5d406af00 0x7fb5d406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:00.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.456+0000 7fb5e5ffb700 1 -- 172.21.15.149:0/75350771 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 7264+0+0 (secure 0 0 0) 0x7fb5e008ab70 con 0x7fb5f00b16b0 2023-11-08T19:28:00.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.456+0000 7fb5f5488700 1 --2- 172.21.15.149:0/75350771 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb5d406af00 0x7fb5d406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:00.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.456+0000 7fb5f5488700 1 --2- 172.21.15.149:0/75350771 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb5d406af00 0x7fb5d406d3c0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec005960 tx=0x7fb5ec009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:00.468 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.461+0000 7fb5e5ffb700 1 -- 172.21.15.149:0/75350771 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb5e0055620 con 0x7fb5f00b16b0 2023-11-08T19:28:00.736 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.734+0000 7fb5f76ec700 1 -- 172.21.15.149:0/75350771 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "6:0"} v 0) v1 -- 0x7fb5d0005870 con 0x7fb5f00b16b0 2023-11-08T19:28:00.737 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.736+0000 7fb5e5ffb700 1 -- 172.21.15.149:0/75350771 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "6:0"}]=0 failed mds gid 7122 v70) v1 ==== 97+0+0 (secure 0 0 0) 0x7fb5e005f030 con 0x7fb5f00b16b0 2023-11-08T19:28:00.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.739+0000 7fb5f76ec700 1 -- 172.21.15.149:0/75350771 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb5d406af00 msgr2=0x7fb5d406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:00.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.739+0000 7fb5f76ec700 1 --2- 172.21.15.149:0/75350771 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb5d406af00 0x7fb5d406d3c0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec005960 tx=0x7fb5ec009040 comp rx=0 tx=0).stop 2023-11-08T19:28:00.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.739+0000 7fb5f76ec700 1 -- 172.21.15.149:0/75350771 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb5f00b16b0 msgr2=0x7fb5f00c6880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:00.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.739+0000 7fb5f76ec700 1 --2- 172.21.15.149:0/75350771 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb5f00b16b0 0x7fb5f00c6880 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7fb5e00090b0 tx=0x7fb5e0004750 comp rx=0 tx=0).stop 2023-11-08T19:28:00.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.740+0000 7fb5f76ec700 1 -- 172.21.15.149:0/75350771 shutdown_connections 2023-11-08T19:28:00.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.740+0000 7fb5f76ec700 1 --2- 172.21.15.149:0/75350771 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb5d406af00 0x7fb5d406d3c0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:00.744 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.740+0000 7fb5f76ec700 1 --2- 172.21.15.149:0/75350771 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb5f00afb30 0x7fb5f00c94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:00.744 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.740+0000 7fb5f76ec700 1 --2- 172.21.15.149:0/75350771 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb5f00b20b0 0x7fb5f01e6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:00.744 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.740+0000 7fb5f76ec700 1 --2- 172.21.15.149:0/75350771 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb5f00b16b0 0x7fb5f00c6880 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:00.744 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.740+0000 7fb5f76ec700 1 -- 172.21.15.149:0/75350771 >> 172.21.15.149:0/75350771 conn(0x7fb5f0099a40 msgr2=0x7fb5f00cfb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:00.744 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.740+0000 7fb5f76ec700 1 -- 172.21.15.149:0/75350771 shutdown_connections 2023-11-08T19:28:00.745 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.740+0000 7fb5f76ec700 1 -- 172.21.15.149:0/75350771 wait complete. 2023-11-08T19:28:00.745 INFO:teuthology.orchestra.run.smithi149.stderr:failed mds gid 7122 2023-11-08T19:28:00.756 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-08T19:28:00.757 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-08T19:28:00.757 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-08T19:28:00.757 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T19:28:00.758 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-08T19:28:00.758 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi149 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a' 2023-11-08T19:28:00.759 INFO:tasks.ceph.mds.a:Stopped 2023-11-08T19:28:00.759 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-08T19:28:00.762 INFO:tasks.ceph.mds.a:Started 2023-11-08T19:28:00.762 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:28:00.841 INFO:tasks.ceph.mds.a.smithi149.stdout:starting mds.a at 2023-11-08T19:28:00.886 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.884+0000 7f9f33e9d700 1 Processor -- start 2023-11-08T19:28:00.886 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.884+0000 7f9f33e9d700 1 -- start start 2023-11-08T19:28:00.890 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.885+0000 7f9f33e9d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9f2c15db70 0x7f9f2c161dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:00.890 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.885+0000 7f9f33e9d700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f9f2c0b2c00 0x7f9f2c15df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:00.890 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.885+0000 7f9f33e9d700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f2c161940 con 0x7f9f2c06ab80 2023-11-08T19:28:00.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.885+0000 7f9f33e9d700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f2c15eeb0 con 0x7f9f2c0b2c00 2023-11-08T19:28:00.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.885+0000 7f9f33e9d700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2c15e8f0 con 0x7f9f2c15db70 2023-11-08T19:28:00.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.885+0000 7f9f3243a700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f9f2c06ab80 0x7f9f2c071dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:46256/0 (socket says 172.21.15.149:46256) 2023-11-08T19:28:00.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.885+0000 7f9f3243a700 1 -- 172.21.15.149:0/3637082244 learned_addr learned my addr 172.21.15.149:0/3637082244 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:28:00.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.885+0000 7f9f31c39700 1 --2- 172.21.15.149:0/3637082244 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9f2c15db70 0x7f9f2c161dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:00.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.885+0000 7f9f31438700 1 --2- 172.21.15.149:0/3637082244 >> v2:172.21.15.160:3300/0 conn(0x7f9f2c0b2c00 0x7f9f2c15df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:00.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.885+0000 7f9f30c37700 1 -- 172.21.15.149:0/3637082244 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 573597067 0 0) 0x7f9f2c161940 con 0x7f9f2c06ab80 2023-11-08T19:28:00.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.885+0000 7f9f30c37700 1 -- 172.21.15.149:0/3637082244 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f140035b0 con 0x7f9f2c06ab80 2023-11-08T19:28:00.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.885+0000 7f9f30c37700 1 -- 172.21.15.149:0/3637082244 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3815746849 0 0) 0x7f9f140035b0 con 0x7f9f2c06ab80 2023-11-08T19:28:00.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.885+0000 7f9f30c37700 1 -- 172.21.15.149:0/3637082244 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9f2c15db70 msgr2=0x7f9f2c161dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:00.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.885+0000 7f9f30c37700 1 --2- 172.21.15.149:0/3637082244 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9f2c15db70 0x7f9f2c161dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:00.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.885+0000 7f9f30c37700 1 -- 172.21.15.149:0/3637082244 >> v2:172.21.15.160:3300/0 conn(0x7f9f2c0b2c00 msgr2=0x7f9f2c15df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:00.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.885+0000 7f9f30c37700 1 --2- 172.21.15.149:0/3637082244 >> v2:172.21.15.160:3300/0 conn(0x7f9f2c0b2c00 0x7f9f2c15df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:00.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.885+0000 7f9f30c37700 1 -- 172.21.15.149:0/3637082244 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f2c15ebd0 con 0x7f9f2c06ab80 2023-11-08T19:28:00.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.885+0000 7f9f30c37700 1 -- 172.21.15.149:0/3637082244 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f9f1c001670 con 0x7f9f2c06ab80 2023-11-08T19:28:00.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.885+0000 7f9f30c37700 1 -- 172.21.15.149:0/3637082244 >> v1:172.21.15.149:6789/0 conn(0x7f9f2c06ab80 legacy=0x7f9f2c071dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:00.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.885+0000 7f9f30c37700 1 --2- 172.21.15.149:0/3637082244 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9f2c15db70 0x7f9f14003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:00.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.885+0000 7f9f30c37700 1 --2- 172.21.15.149:0/3637082244 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f14003f80 0x7f9f14004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:00.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.885+0000 7f9f30c37700 1 --2- 172.21.15.149:0/3637082244 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9f14004d90 0x7f9f14005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:00.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.885+0000 7f9f30c37700 1 -- 172.21.15.149:0/3637082244 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2c15eeb0 con 0x7f9f14003f80 2023-11-08T19:28:00.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.885+0000 7f9f30c37700 1 -- 172.21.15.149:0/3637082244 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2c15e8f0 con 0x7f9f14004d90 2023-11-08T19:28:00.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.885+0000 7f9f30c37700 1 -- 172.21.15.149:0/3637082244 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1400ba60 con 0x7f9f2c15db70 2023-11-08T19:28:00.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.885+0000 7f9f31438700 1 --2- 172.21.15.149:0/3637082244 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f14003f80 0x7f9f14004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:00.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.886+0000 7f9f31c39700 1 --2- 172.21.15.149:0/3637082244 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9f2c15db70 0x7f9f14003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:00.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.886+0000 7f9f3243a700 1 --2- 172.21.15.149:0/3637082244 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9f14004d90 0x7f9f14005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:00.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.886+0000 7f9f31438700 1 -- 172.21.15.149:0/3637082244 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9f2c15db70 msgr2=0x7f9f14003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:00.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.886+0000 7f9f31438700 1 --2- 172.21.15.149:0/3637082244 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9f2c15db70 0x7f9f14003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:00.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.886+0000 7f9f31438700 1 -- 172.21.15.149:0/3637082244 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9f14004d90 msgr2=0x7f9f14005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:00.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.886+0000 7f9f31438700 1 --2- 172.21.15.149:0/3637082244 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9f14004d90 0x7f9f14005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:00.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.886+0000 7f9f31438700 1 -- 172.21.15.149:0/3637082244 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f140035b0 con 0x7f9f14003f80 2023-11-08T19:28:00.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.886+0000 7f9f3243a700 1 --2- 172.21.15.149:0/3637082244 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9f14004d90 0x7f9f14005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:28:00.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.886+0000 7f9f31438700 1 --2- 172.21.15.149:0/3637082244 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f14003f80 0x7f9f14004850 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f9f20009b60 tx=0x7f9f14005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7f6629921b08b4c server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:00.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.886+0000 7f9f30c37700 1 -- 172.21.15.149:0/3637082244 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2000e6c0 con 0x7f9f14003f80 2023-11-08T19:28:00.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.886+0000 7f9f30c37700 1 -- 172.21.15.149:0/3637082244 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f2000e820 con 0x7f9f14003f80 2023-11-08T19:28:00.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.886+0000 7f9f30c37700 1 -- 172.21.15.149:0/3637082244 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2000eb90 con 0x7f9f14003f80 2023-11-08T19:28:00.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.886+0000 7f9f33e9d700 1 -- 172.21.15.149:0/3637082244 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f14003f80 msgr2=0x7f9f14004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:00.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.886+0000 7f9f33e9d700 1 --2- 172.21.15.149:0/3637082244 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f14003f80 0x7f9f14004850 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f9f20009b60 tx=0x7f9f14005880 comp rx=0 tx=0).stop 2023-11-08T19:28:00.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.887+0000 7f9f3243a700 1 -- 172.21.15.149:0/3637082244 reap_dead start 2023-11-08T19:28:00.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.887+0000 7f9f33e9d700 1 -- 172.21.15.149:0/3637082244 shutdown_connections 2023-11-08T19:28:00.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.887+0000 7f9f33e9d700 1 -- 172.21.15.149:0/3637082244 >> 172.21.15.149:0/3637082244 conn(0x7f9f2c0ccff0 msgr2=0x7f9f2c0cd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:00.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.887+0000 7f9f33e9d700 1 -- 172.21.15.149:0/3637082244 shutdown_connections 2023-11-08T19:28:00.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.887+0000 7f9f33e9d700 1 -- 172.21.15.149:0/3637082244 wait complete. 2023-11-08T19:28:00.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.888+0000 7f9f33e9d700 1 Processor -- start 2023-11-08T19:28:00.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.888+0000 7f9f33e9d700 1 -- start start 2023-11-08T19:28:00.902 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.889+0000 7f9f33e9d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9f14003f80 0x7f9f2c153bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:00.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.889+0000 7f9f33e9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f2c06ded0 0x7f9f2c06e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:00.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.889+0000 7f9f33e9d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9f2c0b4e60 0x7f9f2c0b52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:00.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.889+0000 7f9f33e9d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2c0b4730 con 0x7f9f2c06ded0 2023-11-08T19:28:00.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.889+0000 7f9f33e9d700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2c06e890 con 0x7f9f2c0b4e60 2023-11-08T19:28:00.904 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.889+0000 7f9f33e9d700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2c0b5a70 con 0x7f9f14003f80 2023-11-08T19:28:00.904 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.889+0000 7f9f31438700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f2c06ded0 0x7f9f2c06e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:00.904 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.889+0000 7f9f31438700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f2c06ded0 0x7f9f2c06e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44264/0 (socket says 172.21.15.149:44264) 2023-11-08T19:28:00.904 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.889+0000 7f9f31438700 1 -- 172.21.15.149:0/3255146939 learned_addr learned my addr 172.21.15.149:0/3255146939 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:28:00.904 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.889+0000 7f9f31438700 1 -- 172.21.15.149:0/3255146939 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9f14003f80 msgr2=0x7f9f2c153bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:00.905 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.889+0000 7f9f31438700 1 --2- 172.21.15.149:0/3255146939 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9f14003f80 0x7f9f2c153bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:00.905 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.889+0000 7f9f31438700 1 -- 172.21.15.149:0/3255146939 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9f2c0b4e60 msgr2=0x7f9f2c0b52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:00.905 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.889+0000 7f9f3243a700 1 --2- 172.21.15.149:0/3255146939 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9f2c0b4e60 0x7f9f2c0b52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:00.905 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.889+0000 7f9f31438700 1 --2- 172.21.15.149:0/3255146939 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9f2c0b4e60 0x7f9f2c0b52f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:00.905 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.889+0000 7f9f31438700 1 -- 172.21.15.149:0/3255146939 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f2c0b5830 con 0x7f9f2c06ded0 2023-11-08T19:28:00.906 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.889+0000 7f9f31438700 1 --2- 172.21.15.149:0/3255146939 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f2c06ded0 0x7f9f2c06e350 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f9f200090b0 tx=0x7f9f200047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:00.906 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.889+0000 7f9f2a7fc700 1 -- 172.21.15.149:0/3255146939 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2000e6c0 con 0x7f9f2c06ded0 2023-11-08T19:28:00.906 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.889+0000 7f9f2a7fc700 1 -- 172.21.15.149:0/3255146939 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f20003ad0 con 0x7f9f2c06ded0 2023-11-08T19:28:00.906 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.889+0000 7f9f33e9d700 1 -- 172.21.15.149:0/3255146939 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f2c159be0 con 0x7f9f2c06ded0 2023-11-08T19:28:00.906 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.889+0000 7f9f2a7fc700 1 -- 172.21.15.149:0/3255146939 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f20003e80 con 0x7f9f2c06ded0 2023-11-08T19:28:00.907 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.889+0000 7f9f33e9d700 1 -- 172.21.15.149:0/3255146939 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f2c154110 con 0x7f9f2c06ded0 2023-11-08T19:28:00.907 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.890+0000 7f9f33e9d700 1 -- 172.21.15.149:0/3255146939 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f2c0745f0 con 0x7f9f2c06ded0 2023-11-08T19:28:00.907 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.891+0000 7f9f2a7fc700 1 -- 172.21.15.149:0/3255146939 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9f20013470 con 0x7f9f2c06ded0 2023-11-08T19:28:00.907 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.891+0000 7f9f2a7fc700 1 --2- 172.21.15.149:0/3255146939 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9f1806af00 0x7f9f1806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:00.907 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.891+0000 7f9f2a7fc700 1 -- 172.21.15.149:0/3255146939 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7350+0+0 (secure 0 0 0) 0x7f9f2008b630 con 0x7f9f2c06ded0 2023-11-08T19:28:00.908 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.891+0000 7f9f31c39700 1 --2- 172.21.15.149:0/3255146939 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9f1806af00 0x7f9f1806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:00.908 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.892+0000 7f9f31c39700 1 --2- 172.21.15.149:0/3255146939 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9f1806af00 0x7f9f1806d3c0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c06ea70 tx=0x7f9f24009750 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:00.908 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:00.896+0000 7f9f2a7fc700 1 -- 172.21.15.149:0/3255146939 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9f20056220 con 0x7f9f2c06ded0 2023-11-08T19:28:01.131 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:01.128+0000 7f9f33e9d700 1 -- 172.21.15.149:0/3255146939 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9f2c0b5830 con 0x7f9f2c06ded0 2023-11-08T19:28:01.131 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:01.129+0000 7f9f2a7fc700 1 -- 172.21.15.149:0/3255146939 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+4146 (secure 0 0 0) 0x7f9f2c0b5830 con 0x7f9f2c06ded0 2023-11-08T19:28:01.132 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:28:01.132 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":71,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6095,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/852710262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":852710262},{"type":"v1","addr":"172.21.15.160:6835","nonce":852710262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:28:00.740584+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6451,"mds_1":7125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6451":{"gid":6451,"name":"d","rank":0,"incarnation":71,"state":"up:replay","state_seq":1,"addr":"172.21.15.160:6834/2947079163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2947079163},{"type":"v1","addr":"172.21.15.160:6834","nonce":2947079163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7125":{"gid":7125,"name":"c","rank":1,"incarnation":57,"state":"up:active","state_seq":6,"addr":"172.21.15.149:6837/3917392643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3917392643},{"type":"v1","addr":"172.21.15.149:6837","nonce":3917392643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:28:01.133 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:01.131+0000 7f9f33e9d700 1 -- 172.21.15.149:0/3255146939 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9f1806af00 msgr2=0x7f9f1806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:01.134 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:01.131+0000 7f9f33e9d700 1 --2- 172.21.15.149:0/3255146939 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9f1806af00 0x7f9f1806d3c0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c06ea70 tx=0x7f9f24009750 comp rx=0 tx=0).stop 2023-11-08T19:28:01.134 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:01.131+0000 7f9f33e9d700 1 -- 172.21.15.149:0/3255146939 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f2c06ded0 msgr2=0x7f9f2c06e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:01.134 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:01.131+0000 7f9f33e9d700 1 --2- 172.21.15.149:0/3255146939 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f2c06ded0 0x7f9f2c06e350 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f9f200090b0 tx=0x7f9f200047c0 comp rx=0 tx=0).stop 2023-11-08T19:28:01.134 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:01.131+0000 7f9f33e9d700 1 -- 172.21.15.149:0/3255146939 shutdown_connections 2023-11-08T19:28:01.135 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:01.131+0000 7f9f33e9d700 1 --2- 172.21.15.149:0/3255146939 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9f1806af00 0x7f9f1806d3c0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:01.135 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:01.131+0000 7f9f33e9d700 1 --2- 172.21.15.149:0/3255146939 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9f2c0b4e60 0x7f9f2c0b52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:01.135 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:01.131+0000 7f9f33e9d700 1 --2- 172.21.15.149:0/3255146939 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9f14003f80 0x7f9f2c153bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:01.135 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:01.131+0000 7f9f33e9d700 1 --2- 172.21.15.149:0/3255146939 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f2c06ded0 0x7f9f2c06e350 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:01.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:01.131+0000 7f9f33e9d700 1 -- 172.21.15.149:0/3255146939 >> 172.21.15.149:0/3255146939 conn(0x7f9f2c0ccff0 msgr2=0x7f9f2c1609a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:01.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:01.131+0000 7f9f33e9d700 1 -- 172.21.15.149:0/3255146939 shutdown_connections 2023-11-08T19:28:01.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:01.131+0000 7f9f33e9d700 1 -- 172.21.15.149:0/3255146939 wait complete. 2023-11-08T19:28:01.136 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 71 2023-11-08T19:28:01.146 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-11-08T19:28:04.973 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-11-08T19:28:06.148 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:28:06.277 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.276+0000 7f364b134700 1 Processor -- start 2023-11-08T19:28:06.278 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.276+0000 7f364b134700 1 -- start start 2023-11-08T19:28:06.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.277+0000 7f364b134700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f36440cc140 0x7f36440cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:06.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.277+0000 7f364b134700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f36440b2850 0x7f36440cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:06.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.277+0000 7f364b134700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36440cce50 con 0x7f36440b2cd0 2023-11-08T19:28:06.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.277+0000 7f364b134700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36440b2430 con 0x7f36440b2850 2023-11-08T19:28:06.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.277+0000 7f364b134700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36440cc520 con 0x7f36440cc140 2023-11-08T19:28:06.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.277+0000 7f3643fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f36440b2850 0x7f36440cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:06.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.277+0000 7f36496d1700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f36440b2cd0 0x7f364415d2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:46280/0 (socket says 172.21.15.149:46280) 2023-11-08T19:28:06.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.277+0000 7f36496d1700 1 -- 172.21.15.149:0/1204360503 learned_addr learned my addr 172.21.15.149:0/1204360503 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:28:06.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.277+0000 7f3643fff700 1 --2- 172.21.15.149:0/1204360503 >> v2:172.21.15.149:3300/0 conn(0x7f36440b2850 0x7f36440cabf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44276/0 (socket says 172.21.15.149:44276) 2023-11-08T19:28:06.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.277+0000 7f3648ed0700 1 --2- 172.21.15.149:0/1204360503 >> v2:172.21.15.160:3300/0 conn(0x7f36440cc140 0x7f36440cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:06.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.277+0000 7f3643fff700 1 -- 172.21.15.149:0/1204360503 >> v2:172.21.15.160:3300/0 conn(0x7f36440cc140 msgr2=0x7f36440cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:06.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.277+0000 7f3643fff700 1 --2- 172.21.15.149:0/1204360503 >> v2:172.21.15.160:3300/0 conn(0x7f36440cc140 0x7f36440cc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:06.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.277+0000 7f3643fff700 1 -- 172.21.15.149:0/1204360503 >> v1:172.21.15.149:6789/0 conn(0x7f36440b2cd0 legacy=0x7f364415d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:06.283 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.277+0000 7f3643fff700 1 -- 172.21.15.149:0/1204360503 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36440b17b0 con 0x7f36440b2850 2023-11-08T19:28:06.283 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.277+0000 7f36437fe700 1 -- 172.21.15.149:0/1204360503 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3798790560 0 0) 0x7f36440cce50 con 0x7f36440b2cd0 2023-11-08T19:28:06.283 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.278+0000 7f3643fff700 1 --2- 172.21.15.149:0/1204360503 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36440b2850 0x7f36440cabf0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f36440ce120 tx=0x7f3630009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ee8bd5e882ebbd2 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:06.284 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.278+0000 7f36437fe700 1 -- 172.21.15.149:0/1204360503 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3630011830 con 0x7f36440b2850 2023-11-08T19:28:06.284 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.278+0000 7f36437fe700 1 -- 172.21.15.149:0/1204360503 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3630011990 con 0x7f36440b2850 2023-11-08T19:28:06.284 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.278+0000 7f36437fe700 1 -- 172.21.15.149:0/1204360503 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3630011d20 con 0x7f36440b2850 2023-11-08T19:28:06.284 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.278+0000 7f364b134700 1 -- 172.21.15.149:0/1204360503 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36440b2850 msgr2=0x7f36440cabf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:06.284 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.278+0000 7f364b134700 1 --2- 172.21.15.149:0/1204360503 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36440b2850 0x7f36440cabf0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f36440ce120 tx=0x7f3630009b20 comp rx=0 tx=0).stop 2023-11-08T19:28:06.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.278+0000 7f364b134700 1 -- 172.21.15.149:0/1204360503 shutdown_connections 2023-11-08T19:28:06.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.278+0000 7f364b134700 1 --2- 172.21.15.149:0/1204360503 >> v2:172.21.15.160:3300/0 conn(0x7f36440cc140 0x7f36440cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:06.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.278+0000 7f364b134700 1 --2- 172.21.15.149:0/1204360503 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36440b2850 0x7f36440cabf0 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:06.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.278+0000 7f364b134700 1 -- 172.21.15.149:0/1204360503 >> 172.21.15.149:0/1204360503 conn(0x7f3644099a40 msgr2=0x7f36440d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:06.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.278+0000 7f364b134700 1 -- 172.21.15.149:0/1204360503 shutdown_connections 2023-11-08T19:28:06.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.278+0000 7f364b134700 1 -- 172.21.15.149:0/1204360503 wait complete. 2023-11-08T19:28:06.288 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.280+0000 7f364b134700 1 Processor -- start 2023-11-08T19:28:06.288 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.280+0000 7f364b134700 1 -- start start 2023-11-08T19:28:06.289 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.280+0000 7f364b134700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f36440b2850 0x7f36440c6660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:06.289 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.280+0000 7f364b134700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f36440b2cd0 0x7f364415fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:06.289 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.280+0000 7f364b134700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36440cc140 0x7f36440adab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:06.289 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.281+0000 7f364b134700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36440c7300 con 0x7f36440cc140 2023-11-08T19:28:06.289 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.281+0000 7f364b134700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36440b0650 con 0x7f36440b2850 2023-11-08T19:28:06.290 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.281+0000 7f364b134700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36440c6d40 con 0x7f36440b2cd0 2023-11-08T19:28:06.290 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.281+0000 7f36496d1700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36440cc140 0x7f36440adab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:06.290 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.281+0000 7f36496d1700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36440cc140 0x7f36440adab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44284/0 (socket says 172.21.15.149:44284) 2023-11-08T19:28:06.290 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.281+0000 7f36496d1700 1 -- 172.21.15.149:0/1329399814 learned_addr learned my addr 172.21.15.149:0/1329399814 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:28:06.291 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.281+0000 7f3648ed0700 1 --2- 172.21.15.149:0/1329399814 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f36440b2850 0x7f36440c6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:06.291 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.281+0000 7f3643fff700 1 --2- 172.21.15.149:0/1329399814 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f36440b2cd0 0x7f364415fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:06.291 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.281+0000 7f36496d1700 1 -- 172.21.15.149:0/1329399814 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f36440b2cd0 msgr2=0x7f364415fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:06.291 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.281+0000 7f36496d1700 1 --2- 172.21.15.149:0/1329399814 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f36440b2cd0 0x7f364415fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:06.291 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.281+0000 7f36496d1700 1 -- 172.21.15.149:0/1329399814 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f36440b2850 msgr2=0x7f36440c6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:06.292 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.281+0000 7f36496d1700 1 --2- 172.21.15.149:0/1329399814 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f36440b2850 0x7f36440c6660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:06.292 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.281+0000 7f36496d1700 1 -- 172.21.15.149:0/1329399814 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36300094a0 con 0x7f36440cc140 2023-11-08T19:28:06.292 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.281+0000 7f36496d1700 1 --2- 172.21.15.149:0/1329399814 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36440cc140 0x7f36440adab0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f363c00cc10 tx=0x7f363c00cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:06.292 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.281+0000 7f36417fa700 1 -- 172.21.15.149:0/1329399814 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363c00aa60 con 0x7f36440cc140 2023-11-08T19:28:06.292 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.281+0000 7f36417fa700 1 -- 172.21.15.149:0/1329399814 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f363c00abc0 con 0x7f36440cc140 2023-11-08T19:28:06.292 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.281+0000 7f364b134700 1 -- 172.21.15.149:0/1329399814 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36440c7020 con 0x7f36440cc140 2023-11-08T19:28:06.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.281+0000 7f36417fa700 1 -- 172.21.15.149:0/1329399814 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363c0070d0 con 0x7f36440cc140 2023-11-08T19:28:06.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.281+0000 7f364b134700 1 -- 172.21.15.149:0/1329399814 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36440c4550 con 0x7f36440cc140 2023-11-08T19:28:06.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.282+0000 7f364b134700 1 -- 172.21.15.149:0/1329399814 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36440c40d0 con 0x7f36440cc140 2023-11-08T19:28:06.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.283+0000 7f36417fa700 1 -- 172.21.15.149:0/1329399814 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f363c007230 con 0x7f36440cc140 2023-11-08T19:28:06.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.283+0000 7f36417fa700 1 --2- 172.21.15.149:0/1329399814 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f362806af00 0x7f362806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:06.294 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.283+0000 7f36417fa700 1 -- 172.21.15.149:0/1329399814 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7350+0+0 (secure 0 0 0) 0x7f363c0898d0 con 0x7f36440cc140 2023-11-08T19:28:06.294 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.283+0000 7f3648ed0700 1 --2- 172.21.15.149:0/1329399814 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f362806af00 0x7f362806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:06.294 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.284+0000 7f3648ed0700 1 --2- 172.21.15.149:0/1329399814 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f362806af00 0x7f362806d3c0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f3638006fd0 tx=0x7f3638008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:06.295 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.288+0000 7f36417fa700 1 -- 172.21.15.149:0/1329399814 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f36440c40d0 con 0x7f36440cc140 2023-11-08T19:28:06.520 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.519+0000 7f364b134700 1 -- 172.21.15.149:0/1329399814 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f36440c40d0 con 0x7f36440cc140 2023-11-08T19:28:06.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.520+0000 7f36417fa700 1 -- 172.21.15.149:0/1329399814 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+4938 (secure 0 0 0) 0x7f36440c40d0 con 0x7f36440cc140 2023-11-08T19:28:06.521 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:28:06.521 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":75,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6095,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/852710262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":852710262},{"type":"v1","addr":"172.21.15.160:6835","nonce":852710262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64},{"gid":7578,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/295381437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":295381437},{"type":"v1","addr":"172.21.15.149:6836","nonce":295381437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:28:03.760142+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6451,"mds_1":7125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6451":{"gid":6451,"name":"d","rank":0,"incarnation":71,"state":"up:active","state_seq":24,"addr":"172.21.15.160:6834/2947079163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2947079163},{"type":"v1","addr":"172.21.15.160:6834","nonce":2947079163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7125":{"gid":7125,"name":"c","rank":1,"incarnation":57,"state":"up:active","state_seq":6,"addr":"172.21.15.149:6837/3917392643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3917392643},{"type":"v1","addr":"172.21.15.149:6837","nonce":3917392643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:28:06.523 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.522+0000 7f364b134700 1 -- 172.21.15.149:0/1329399814 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f362806af00 msgr2=0x7f362806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:06.523 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.522+0000 7f364b134700 1 --2- 172.21.15.149:0/1329399814 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f362806af00 0x7f362806d3c0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f3638006fd0 tx=0x7f3638008040 comp rx=0 tx=0).stop 2023-11-08T19:28:06.523 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.522+0000 7f364b134700 1 -- 172.21.15.149:0/1329399814 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36440cc140 msgr2=0x7f36440adab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:06.524 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.522+0000 7f364b134700 1 --2- 172.21.15.149:0/1329399814 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36440cc140 0x7f36440adab0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f363c00cc10 tx=0x7f363c00cf20 comp rx=0 tx=0).stop 2023-11-08T19:28:06.524 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.522+0000 7f364b134700 1 -- 172.21.15.149:0/1329399814 shutdown_connections 2023-11-08T19:28:06.524 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.522+0000 7f364b134700 1 --2- 172.21.15.149:0/1329399814 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f362806af00 0x7f362806d3c0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:06.524 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.522+0000 7f364b134700 1 --2- 172.21.15.149:0/1329399814 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f36440b2850 0x7f36440c6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:06.524 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.522+0000 7f364b134700 1 --2- 172.21.15.149:0/1329399814 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36440cc140 0x7f36440adab0 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:06.525 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.522+0000 7f364b134700 1 --2- 172.21.15.149:0/1329399814 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f36440b2cd0 0x7f364415fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:06.525 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.522+0000 7f364b134700 1 -- 172.21.15.149:0/1329399814 >> 172.21.15.149:0/1329399814 conn(0x7f3644099a40 msgr2=0x7f36440c7670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:06.525 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.522+0000 7f364b134700 1 -- 172.21.15.149:0/1329399814 shutdown_connections 2023-11-08T19:28:06.525 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.522+0000 7f364b134700 1 -- 172.21.15.149:0/1329399814 wait complete. 2023-11-08T19:28:06.526 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 75 2023-11-08T19:28:06.535 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-11-08T19:28:06.535 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:28:06.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.655+0000 7fc3a22e5700 1 Processor -- start 2023-11-08T19:28:06.657 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.655+0000 7fc3a22e5700 1 -- start start 2023-11-08T19:28:06.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.656+0000 7fc3a22e5700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fc39c0cc910 0x7fc39c0cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:06.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.656+0000 7fc3a22e5700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc39c0cb130 0x7fc39c15d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:06.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.656+0000 7fc3a22e5700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc39c0b2f60 con 0x7fc39c0cc140 2023-11-08T19:28:06.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.656+0000 7fc3a22e5700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc39c0b2430 con 0x7fc39c0cc910 2023-11-08T19:28:06.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.656+0000 7fc3a22e5700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc39c0cc520 con 0x7fc39c0cb130 2023-11-08T19:28:06.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.656+0000 7fc39bfff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fc39c0cc140 0x7fc39c0b2850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:46290/0 (socket says 172.21.15.149:46290) 2023-11-08T19:28:06.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.656+0000 7fc39bfff700 1 -- 172.21.15.149:0/30316063 learned_addr learned my addr 172.21.15.149:0/30316063 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:28:06.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.656+0000 7fc39affd700 1 -- 172.21.15.149:0/30316063 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1741870096 0 0) 0x7fc39c0b2f60 con 0x7fc39c0cc140 2023-11-08T19:28:06.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.656+0000 7fc39affd700 1 -- 172.21.15.149:0/30316063 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3840035b0 con 0x7fc39c0cc140 2023-11-08T19:28:06.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.656+0000 7fc3a0882700 1 --2- 172.21.15.149:0/30316063 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc39c0cb130 0x7fc39c15d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:06.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.657+0000 7fc39affd700 1 -- 172.21.15.149:0/30316063 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3865568774 0 0) 0x7fc3840035b0 con 0x7fc39c0cc140 2023-11-08T19:28:06.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.656+0000 7fc39b7fe700 1 --2- 172.21.15.149:0/30316063 >> v2:172.21.15.160:3300/0 conn(0x7fc39c0cc910 0x7fc39c0cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:06.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.657+0000 7fc39affd700 1 -- 172.21.15.149:0/30316063 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc39c0cb130 msgr2=0x7fc39c15d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:06.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.657+0000 7fc39affd700 1 --2- 172.21.15.149:0/30316063 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc39c0cb130 0x7fc39c15d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:06.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.657+0000 7fc39affd700 1 -- 172.21.15.149:0/30316063 >> v2:172.21.15.160:3300/0 conn(0x7fc39c0cc910 msgr2=0x7fc39c0cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:06.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.657+0000 7fc39affd700 1 --2- 172.21.15.149:0/30316063 >> v2:172.21.15.160:3300/0 conn(0x7fc39c0cc910 0x7fc39c0cabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:06.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.657+0000 7fc39affd700 1 -- 172.21.15.149:0/30316063 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc39c0cb5e0 con 0x7fc39c0cc140 2023-11-08T19:28:06.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.657+0000 7fc39affd700 1 -- 172.21.15.149:0/30316063 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7fc3900017f0 con 0x7fc39c0cc140 2023-11-08T19:28:06.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.657+0000 7fc39affd700 1 -- 172.21.15.149:0/30316063 >> v1:172.21.15.149:6789/0 conn(0x7fc39c0cc140 legacy=0x7fc39c0b2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:06.672 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.657+0000 7fc39affd700 1 --2- 172.21.15.149:0/30316063 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc39c0cb130 0x7fc384003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:06.672 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.657+0000 7fc39affd700 1 --2- 172.21.15.149:0/30316063 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc384003f80 0x7fc384004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:06.672 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.657+0000 7fc39affd700 1 --2- 172.21.15.149:0/30316063 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc384004d90 0x7fc384005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:06.672 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.657+0000 7fc39affd700 1 -- 172.21.15.149:0/30316063 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc39c0b2430 con 0x7fc384003f80 2023-11-08T19:28:06.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.657+0000 7fc39affd700 1 -- 172.21.15.149:0/30316063 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc39c0cc520 con 0x7fc384004d90 2023-11-08T19:28:06.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.657+0000 7fc39affd700 1 -- 172.21.15.149:0/30316063 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc38400bb40 con 0x7fc39c0cb130 2023-11-08T19:28:06.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.657+0000 7fc39b7fe700 1 --2- 172.21.15.149:0/30316063 >> v2:172.21.15.160:3300/0 conn(0x7fc39c0cc910 0x7fc39c0cabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:28:06.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.657+0000 7fc39b7fe700 1 --2- 172.21.15.149:0/30316063 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc384003f80 0x7fc384004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:06.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.657+0000 7fc39bfff700 1 --2- 172.21.15.149:0/30316063 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc39c0cb130 0x7fc384003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:06.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.657+0000 7fc3a0882700 1 --2- 172.21.15.149:0/30316063 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc384004d90 0x7fc384005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:06.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.657+0000 7fc39b7fe700 1 -- 172.21.15.149:0/30316063 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc39c0cb130 msgr2=0x7fc384003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:06.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.657+0000 7fc39b7fe700 1 --2- 172.21.15.149:0/30316063 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc39c0cb130 0x7fc384003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:06.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.657+0000 7fc39b7fe700 1 -- 172.21.15.149:0/30316063 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc384004d90 msgr2=0x7fc384005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:06.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.657+0000 7fc39b7fe700 1 --2- 172.21.15.149:0/30316063 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc384004d90 0x7fc384005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:06.675 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.657+0000 7fc39b7fe700 1 -- 172.21.15.149:0/30316063 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3840035b0 con 0x7fc384003f80 2023-11-08T19:28:06.675 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.657+0000 7fc39b7fe700 1 --2- 172.21.15.149:0/30316063 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc384003f80 0x7fc384004850 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fc38c00ab10 tx=0x7fc384005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13779d40560bcbc4 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:06.675 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.657+0000 7fc39affd700 1 -- 172.21.15.149:0/30316063 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38c00a5b0 con 0x7fc384003f80 2023-11-08T19:28:06.675 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.658+0000 7fc39affd700 1 -- 172.21.15.149:0/30316063 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc38c004220 con 0x7fc384003f80 2023-11-08T19:28:06.675 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.658+0000 7fc39affd700 1 -- 172.21.15.149:0/30316063 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38c0036a0 con 0x7fc384003f80 2023-11-08T19:28:06.676 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.658+0000 7fc3a22e5700 1 -- 172.21.15.149:0/30316063 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc384003f80 msgr2=0x7fc384004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:06.676 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.658+0000 7fc3a22e5700 1 --2- 172.21.15.149:0/30316063 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc384003f80 0x7fc384004850 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fc38c00ab10 tx=0x7fc384005880 comp rx=0 tx=0).stop 2023-11-08T19:28:06.676 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.658+0000 7fc3a0882700 1 -- 172.21.15.149:0/30316063 reap_dead start 2023-11-08T19:28:06.676 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.658+0000 7fc3a22e5700 1 -- 172.21.15.149:0/30316063 shutdown_connections 2023-11-08T19:28:06.677 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.658+0000 7fc3a22e5700 1 -- 172.21.15.149:0/30316063 >> 172.21.15.149:0/30316063 conn(0x7fc39c099a40 msgr2=0x7fc39c0d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:06.677 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.658+0000 7fc3a22e5700 1 -- 172.21.15.149:0/30316063 shutdown_connections 2023-11-08T19:28:06.677 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.658+0000 7fc3a22e5700 1 -- 172.21.15.149:0/30316063 wait complete. 2023-11-08T19:28:06.677 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.659+0000 7fc3a22e5700 1 Processor -- start 2023-11-08T19:28:06.677 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.660+0000 7fc3a22e5700 1 -- start start 2023-11-08T19:28:06.678 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.660+0000 7fc3a22e5700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc384003f80 0x7fc39c15c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:06.678 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.660+0000 7fc3a22e5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc39c0ae210 0x7fc39c06f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:06.678 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.660+0000 7fc3a22e5700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc39c15a720 0x7fc39c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:06.679 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.660+0000 7fc3a22e5700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc39c15b110 con 0x7fc39c0ae210 2023-11-08T19:28:06.679 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.660+0000 7fc3a22e5700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc39c0aff80 con 0x7fc384003f80 2023-11-08T19:28:06.679 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.660+0000 7fc3a22e5700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc39c15cca0 con 0x7fc39c15a720 2023-11-08T19:28:06.679 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.660+0000 7fc39b7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc39c0ae210 0x7fc39c06f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:06.679 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.660+0000 7fc39b7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc39c0ae210 0x7fc39c06f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44302/0 (socket says 172.21.15.149:44302) 2023-11-08T19:28:06.680 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.660+0000 7fc39b7fe700 1 -- 172.21.15.149:0/2232500992 learned_addr learned my addr 172.21.15.149:0/2232500992 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:28:06.680 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.661+0000 7fc39bfff700 1 --2- 172.21.15.149:0/2232500992 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc384003f80 0x7fc39c15c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:06.680 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.661+0000 7fc3a0882700 1 --2- 172.21.15.149:0/2232500992 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc39c15a720 0x7fc39c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:06.680 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.661+0000 7fc39b7fe700 1 -- 172.21.15.149:0/2232500992 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc39c15a720 msgr2=0x7fc39c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:06.680 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.661+0000 7fc39b7fe700 1 --2- 172.21.15.149:0/2232500992 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc39c15a720 0x7fc39c15abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:06.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.661+0000 7fc39b7fe700 1 -- 172.21.15.149:0/2232500992 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc384003f80 msgr2=0x7fc39c15c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:06.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.661+0000 7fc39b7fe700 1 --2- 172.21.15.149:0/2232500992 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc384003f80 0x7fc39c15c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:06.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.661+0000 7fc39b7fe700 1 -- 172.21.15.149:0/2232500992 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc39c15cf80 con 0x7fc39c0ae210 2023-11-08T19:28:06.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.661+0000 7fc3a0882700 1 --2- 172.21.15.149:0/2232500992 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc39c15a720 0x7fc39c15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:28:06.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.661+0000 7fc39b7fe700 1 --2- 172.21.15.149:0/2232500992 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc39c0ae210 0x7fc39c06f410 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fc3840047d0 tx=0x7fc38c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:06.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.661+0000 7fc398ff9700 1 -- 172.21.15.149:0/2232500992 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38c01f070 con 0x7fc39c0ae210 2023-11-08T19:28:06.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.661+0000 7fc398ff9700 1 -- 172.21.15.149:0/2232500992 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc38c0036a0 con 0x7fc39c0ae210 2023-11-08T19:28:06.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.661+0000 7fc3a22e5700 1 -- 172.21.15.149:0/2232500992 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc39c15d260 con 0x7fc39c0ae210 2023-11-08T19:28:06.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.661+0000 7fc398ff9700 1 -- 172.21.15.149:0/2232500992 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38c003a30 con 0x7fc39c0ae210 2023-11-08T19:28:06.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.661+0000 7fc3a22e5700 1 -- 172.21.15.149:0/2232500992 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc39c15d820 con 0x7fc39c0ae210 2023-11-08T19:28:06.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.662+0000 7fc3a22e5700 1 -- 172.21.15.149:0/2232500992 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc39c0b3380 con 0x7fc39c0ae210 2023-11-08T19:28:06.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.662+0000 7fc398ff9700 1 -- 172.21.15.149:0/2232500992 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc38c003b90 con 0x7fc39c0ae210 2023-11-08T19:28:06.684 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.663+0000 7fc398ff9700 1 --2- 172.21.15.149:0/2232500992 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc38806af00 0x7fc38806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:06.684 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.663+0000 7fc398ff9700 1 -- 172.21.15.149:0/2232500992 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7350+0+0 (secure 0 0 0) 0x7fc38c08a7f0 con 0x7fc39c0ae210 2023-11-08T19:28:06.685 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.663+0000 7fc39bfff700 1 --2- 172.21.15.149:0/2232500992 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc38806af00 0x7fc38806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:06.685 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.663+0000 7fc39bfff700 1 --2- 172.21.15.149:0/2232500992 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc38806af00 0x7fc38806d3c0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fc39c15e850 tx=0x7fc390009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:06.686 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.668+0000 7fc398ff9700 1 -- 172.21.15.149:0/2232500992 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc38c0552c0 con 0x7fc39c0ae210 2023-11-08T19:28:06.902 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.901+0000 7fc3a22e5700 1 -- 172.21.15.149:0/2232500992 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc39c15b110 con 0x7fc39c0ae210 2023-11-08T19:28:06.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.902+0000 7fc398ff9700 1 -- 172.21.15.149:0/2232500992 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+4938 (secure 0 0 0) 0x7fc38c0588e0 con 0x7fc39c0ae210 2023-11-08T19:28:06.903 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:28:06.904 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":75,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6095,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/852710262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":852710262},{"type":"v1","addr":"172.21.15.160:6835","nonce":852710262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64},{"gid":7578,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/295381437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":295381437},{"type":"v1","addr":"172.21.15.149:6836","nonce":295381437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:28:03.760142+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6451,"mds_1":7125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6451":{"gid":6451,"name":"d","rank":0,"incarnation":71,"state":"up:active","state_seq":24,"addr":"172.21.15.160:6834/2947079163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2947079163},{"type":"v1","addr":"172.21.15.160:6834","nonce":2947079163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7125":{"gid":7125,"name":"c","rank":1,"incarnation":57,"state":"up:active","state_seq":6,"addr":"172.21.15.149:6837/3917392643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3917392643},{"type":"v1","addr":"172.21.15.149:6837","nonce":3917392643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:28:06.906 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.904+0000 7fc3a22e5700 1 -- 172.21.15.149:0/2232500992 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc38806af00 msgr2=0x7fc38806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:06.906 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.904+0000 7fc3a22e5700 1 --2- 172.21.15.149:0/2232500992 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc38806af00 0x7fc38806d3c0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fc39c15e850 tx=0x7fc390009040 comp rx=0 tx=0).stop 2023-11-08T19:28:06.906 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.904+0000 7fc3a22e5700 1 -- 172.21.15.149:0/2232500992 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc39c0ae210 msgr2=0x7fc39c06f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:06.906 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.904+0000 7fc3a22e5700 1 --2- 172.21.15.149:0/2232500992 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc39c0ae210 0x7fc39c06f410 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fc3840047d0 tx=0x7fc38c0047c0 comp rx=0 tx=0).stop 2023-11-08T19:28:06.906 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.904+0000 7fc3a22e5700 1 -- 172.21.15.149:0/2232500992 shutdown_connections 2023-11-08T19:28:06.907 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.904+0000 7fc3a22e5700 1 --2- 172.21.15.149:0/2232500992 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc38806af00 0x7fc38806d3c0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:06.907 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.904+0000 7fc3a22e5700 1 --2- 172.21.15.149:0/2232500992 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc384003f80 0x7fc39c15c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:06.907 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.904+0000 7fc3a22e5700 1 --2- 172.21.15.149:0/2232500992 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc39c15a720 0x7fc39c15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:06.907 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.904+0000 7fc3a22e5700 1 --2- 172.21.15.149:0/2232500992 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc39c0ae210 0x7fc39c06f410 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:06.907 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.904+0000 7fc3a22e5700 1 -- 172.21.15.149:0/2232500992 >> 172.21.15.149:0/2232500992 conn(0x7fc39c099a40 msgr2=0x7fc39c06e040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:06.908 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.904+0000 7fc3a22e5700 1 -- 172.21.15.149:0/2232500992 shutdown_connections 2023-11-08T19:28:06.908 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:06.904+0000 7fc3a22e5700 1 -- 172.21.15.149:0/2232500992 wait complete. 2023-11-08T19:28:06.908 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 75 2023-11-08T19:28:07.320 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 75, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 2, 'explicitly_allowed_features': 2, 'created': '2023-11-08T19:26:48.987203+0000', 'modified': '2023-11-08T19:28:03.760142+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 100, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 6451, 'mds_1': 7125}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6451': {'gid': 6451, 'name': 'd', 'rank': 0, 'incarnation': 71, 'state': 'up:active', 'state_seq': 24, 'addr': '172.21.15.160:6834/2947079163', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6832', 'nonce': 2947079163}, {'type': 'v1', 'addr': '172.21.15.160:6834', 'nonce': 2947079163}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_7125': {'gid': 7125, 'name': 'c', 'rank': 1, 'incarnation': 57, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.149:6837/3917392643', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6835', 'nonce': 3917392643}, {'type': 'v1', 'addr': '172.21.15.149:6837', 'nonce': 3917392643}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-08T19:28:07.320 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 2/2 2023-11-08T19:28:07.321 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-11-08T19:28:07.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.444+0000 7f71c9c1b700 1 Processor -- start 2023-11-08T19:28:07.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.444+0000 7f71c9c1b700 1 -- start start 2023-11-08T19:28:07.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.445+0000 7f71c9c1b700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f71c40b2c00 0x7f71c415df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:07.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.445+0000 7f71c9c1b700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f71c406ab80 0x7f71c406b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:07.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.445+0000 7f71c9c1b700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71c41624e0 con 0x7f71c415db70 2023-11-08T19:28:07.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.445+0000 7f71c9c1b700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71c406b550 con 0x7f71c406ab80 2023-11-08T19:28:07.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.445+0000 7f71c9c1b700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71c4161940 con 0x7f71c40b2c00 2023-11-08T19:28:07.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.445+0000 7f71c3fff700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f71c406ab80 0x7f71c406b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:07.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.445+0000 7f71c2ffd700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f71c40b2c00 0x7f71c415df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:07.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.445+0000 7f71c2ffd700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f71c40b2c00 0x7f71c415df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.149:36366/0 (socket says 172.21.15.149:36366) 2023-11-08T19:28:07.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.445+0000 7f71c3fff700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f71c406ab80 0x7f71c406b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.149:45304/0 (socket says 172.21.15.149:45304) 2023-11-08T19:28:07.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.445+0000 7f71c2ffd700 1 -- 172.21.15.149:0/326328215 learned_addr learned my addr 172.21.15.149:0/326328215 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:28:07.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.445+0000 7f71c37fe700 1 --1- 172.21.15.149:0/326328215 >> v1:172.21.15.160:6789/0 conn(0x7f71c415db70 0x7f71c4161dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.149:57976/0 (socket says 172.21.15.149:57976) 2023-11-08T19:28:07.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.446+0000 7f71c3fff700 1 -- 172.21.15.149:0/326328215 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f71c40b2c00 msgr2=0x7f71c415df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:07.450 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.446+0000 7f71c3fff700 1 --2- 172.21.15.149:0/326328215 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f71c40b2c00 0x7f71c415df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.450 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.446+0000 7f71c3fff700 1 -- 172.21.15.149:0/326328215 >> v1:172.21.15.160:6789/0 conn(0x7f71c415db70 legacy=0x7f71c4161dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:07.450 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.446+0000 7f71c3fff700 1 -- 172.21.15.149:0/326328215 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c415eeb0 con 0x7f71c406ab80 2023-11-08T19:28:07.450 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.446+0000 7f71c2ffd700 1 --2- 172.21.15.149:0/326328215 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f71c40b2c00 0x7f71c415df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:28:07.451 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.446+0000 7f71c3fff700 1 --2- 172.21.15.149:0/326328215 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71c406ab80 0x7f71c406b010 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f71bc009d90 tx=0x7f71bc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47c277a3c1708ff7 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:07.451 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.446+0000 7f71c27fc700 1 -- 172.21.15.149:0/326328215 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71bc00e070 con 0x7f71c406ab80 2023-11-08T19:28:07.451 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.446+0000 7f71c27fc700 1 -- 172.21.15.149:0/326328215 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71bc00bb20 con 0x7f71c406ab80 2023-11-08T19:28:07.451 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.446+0000 7f71c27fc700 1 -- 172.21.15.149:0/326328215 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71bc012430 con 0x7f71c406ab80 2023-11-08T19:28:07.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.447+0000 7f71c9c1b700 1 -- 172.21.15.149:0/326328215 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71c406ab80 msgr2=0x7f71c406b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:07.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.447+0000 7f71c9c1b700 1 --2- 172.21.15.149:0/326328215 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71c406ab80 0x7f71c406b010 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f71bc009d90 tx=0x7f71bc00b330 comp rx=0 tx=0).stop 2023-11-08T19:28:07.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.447+0000 7f71c9c1b700 1 -- 172.21.15.149:0/326328215 shutdown_connections 2023-11-08T19:28:07.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.447+0000 7f71c9c1b700 1 --2- 172.21.15.149:0/326328215 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71c406ab80 0x7f71c406b010 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.447+0000 7f71c9c1b700 1 --2- 172.21.15.149:0/326328215 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f71c40b2c00 0x7f71c415df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.447+0000 7f71c9c1b700 1 -- 172.21.15.149:0/326328215 >> 172.21.15.149:0/326328215 conn(0x7f71c40ccff0 msgr2=0x7f71c40cd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:07.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.447+0000 7f71c9c1b700 1 -- 172.21.15.149:0/326328215 shutdown_connections 2023-11-08T19:28:07.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.447+0000 7f71c9c1b700 1 -- 172.21.15.149:0/326328215 wait complete. 2023-11-08T19:28:07.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.448+0000 7f71c9c1b700 1 Processor -- start 2023-11-08T19:28:07.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.448+0000 7f71c9c1b700 1 -- start start 2023-11-08T19:28:07.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.449+0000 7f71c9c1b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71c406ab80 0x7f71c41563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:07.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.449+0000 7f71c9c1b700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f71c40b2c00 0x7f71c40c5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:07.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.449+0000 7f71c9c1b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71c415db70 0x7f71c40c5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:07.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.449+0000 7f71c9c1b700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c4156930 con 0x7f71c406ab80 2023-11-08T19:28:07.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.449+0000 7f71c9c1b700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c40b4310 con 0x7f71c415db70 2023-11-08T19:28:07.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.449+0000 7f71c9c1b700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71c40b3700 con 0x7f71c40b2c00 2023-11-08T19:28:07.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.449+0000 7f71c37fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71c406ab80 0x7f71c41563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:07.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.449+0000 7f71c37fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71c406ab80 0x7f71c41563f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44314/0 (socket says 172.21.15.149:44314) 2023-11-08T19:28:07.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.449+0000 7f71c37fe700 1 -- 172.21.15.149:0/458564837 learned_addr learned my addr 172.21.15.149:0/458564837 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:28:07.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.449+0000 7f71c2ffd700 1 --2- 172.21.15.149:0/458564837 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f71c40b2c00 0x7f71c40c5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:07.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.449+0000 7f71c3fff700 1 --2- 172.21.15.149:0/458564837 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71c415db70 0x7f71c40c5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:07.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.449+0000 7f71c37fe700 1 -- 172.21.15.149:0/458564837 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f71c40b2c00 msgr2=0x7f71c40c5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:07.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.449+0000 7f71c37fe700 1 --2- 172.21.15.149:0/458564837 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f71c40b2c00 0x7f71c40c5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.449+0000 7f71c37fe700 1 -- 172.21.15.149:0/458564837 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71c415db70 msgr2=0x7f71c40c5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:07.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.449+0000 7f71c37fe700 1 --2- 172.21.15.149:0/458564837 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71c415db70 0x7f71c40c5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.449+0000 7f71c37fe700 1 -- 172.21.15.149:0/458564837 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b4009550 con 0x7f71c406ab80 2023-11-08T19:28:07.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.450+0000 7f71c37fe700 1 --2- 172.21.15.149:0/458564837 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71c406ab80 0x7f71c41563f0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f71b800c430 tx=0x7f71b800c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:07.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.450+0000 7f71abfff700 1 -- 172.21.15.149:0/458564837 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b8005ab0 con 0x7f71c406ab80 2023-11-08T19:28:07.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.450+0000 7f71abfff700 1 -- 172.21.15.149:0/458564837 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71b8005c10 con 0x7f71c406ab80 2023-11-08T19:28:07.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.450+0000 7f71c9c1b700 1 -- 172.21.15.149:0/458564837 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71bc009a70 con 0x7f71c406ab80 2023-11-08T19:28:07.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.450+0000 7f71abfff700 1 -- 172.21.15.149:0/458564837 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b80070d0 con 0x7f71c406ab80 2023-11-08T19:28:07.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.450+0000 7f71c9c1b700 1 -- 172.21.15.149:0/458564837 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71c40b3cc0 con 0x7f71c406ab80 2023-11-08T19:28:07.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.451+0000 7f71abfff700 1 -- 172.21.15.149:0/458564837 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f71b8007230 con 0x7f71c406ab80 2023-11-08T19:28:07.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.452+0000 7f71abfff700 1 --2- 172.21.15.149:0/458564837 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f71b006af00 0x7f71b006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:07.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.452+0000 7f71abfff700 1 -- 172.21.15.149:0/458564837 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7350+0+0 (secure 0 0 0) 0x7f71b8088c00 con 0x7f71c406ab80 2023-11-08T19:28:07.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.452+0000 7f71c2ffd700 1 --2- 172.21.15.149:0/458564837 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f71b006af00 0x7f71b006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:07.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.452+0000 7f71c2ffd700 1 --2- 172.21.15.149:0/458564837 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f71b006af00 0x7f71b006d3c0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f71c40b1c50 tx=0x7f71b40092c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:07.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.453+0000 7f71d5e14b80 1 Processor -- start 2023-11-08T19:28:07.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.454+0000 7f71d5e14b80 1 -- start start 2023-11-08T19:28:07.468 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.454+0000 7f71d5e14b80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5582286ec6f0 0x55822871c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:07.468 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.454+0000 7f71d5e14b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582286eec30 0x55822871c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:07.468 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.454+0000 7f71d5e14b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5582286ecad0 0x558228706f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:07.469 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.454+0000 7f71d5e14b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582286586e0 con 0x5582286eec30 2023-11-08T19:28:07.469 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.454+0000 7f71d5e14b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55822864c3b0 con 0x5582286ecad0 2023-11-08T19:28:07.469 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.454+0000 7f71d5e14b80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x558228649cd0 con 0x5582286ec6f0 2023-11-08T19:28:07.470 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.455+0000 7f71c2ffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582286eec30 0x55822871c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:07.470 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.455+0000 7f71c2ffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582286eec30 0x55822871c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44322/0 (socket says 172.21.15.149:44322) 2023-11-08T19:28:07.470 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.455+0000 7f71c2ffd700 1 -- 172.21.15.149:0/3691265168 learned_addr learned my addr 172.21.15.149:0/3691265168 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:28:07.470 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.455+0000 7f71c2ffd700 1 -- 172.21.15.149:0/3691265168 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5582286ec6f0 msgr2=0x55822871c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:07.470 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.455+0000 7f71c3fff700 1 --2- 172.21.15.149:0/3691265168 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5582286ecad0 0x558228706f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:07.471 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.455+0000 7f71c37fe700 1 --2- 172.21.15.149:0/3691265168 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5582286ec6f0 0x55822871c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:07.471 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.455+0000 7f71c2ffd700 1 --2- 172.21.15.149:0/3691265168 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5582286ec6f0 0x55822871c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.471 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.455+0000 7f71c2ffd700 1 -- 172.21.15.149:0/3691265168 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5582286ecad0 msgr2=0x558228706f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:07.471 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.455+0000 7f71c2ffd700 1 --2- 172.21.15.149:0/3691265168 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5582286ecad0 0x558228706f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.471 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.455+0000 7f71c2ffd700 1 -- 172.21.15.149:0/3691265168 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5582284c25e0 con 0x5582286eec30 2023-11-08T19:28:07.472 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.455+0000 7f71c3fff700 1 --2- 172.21.15.149:0/3691265168 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5582286ecad0 0x558228706f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:28:07.472 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.455+0000 7f71c2ffd700 1 --2- 172.21.15.149:0/3691265168 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582286eec30 0x55822871c990 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f71b4011e30 tx=0x7f71b4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0783ba0894826b1 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:07.472 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.455+0000 7f71a97fa700 1 -- 172.21.15.149:0/3691265168 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b4014e70 con 0x5582286eec30 2023-11-08T19:28:07.472 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.455+0000 7f71a97fa700 1 -- 172.21.15.149:0/3691265168 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71b4009e00 con 0x5582286eec30 2023-11-08T19:28:07.472 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.455+0000 7f71a97fa700 1 -- 172.21.15.149:0/3691265168 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b40215f0 con 0x5582286eec30 2023-11-08T19:28:07.473 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.456+0000 7f71d5e14b80 1 -- 172.21.15.149:0/3691265168 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582286eec30 msgr2=0x55822871c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:07.473 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.456+0000 7f71d5e14b80 1 --2- 172.21.15.149:0/3691265168 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582286eec30 0x55822871c990 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f71b4011e30 tx=0x7f71b4014000 comp rx=0 tx=0).stop 2023-11-08T19:28:07.473 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.456+0000 7f71d5e14b80 1 -- 172.21.15.149:0/3691265168 shutdown_connections 2023-11-08T19:28:07.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.456+0000 7f71d5e14b80 1 --2- 172.21.15.149:0/3691265168 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5582286ecad0 0x558228706f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.456+0000 7f71d5e14b80 1 --2- 172.21.15.149:0/3691265168 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5582286ec6f0 0x55822871c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.456+0000 7f71d5e14b80 1 --2- 172.21.15.149:0/3691265168 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582286eec30 0x55822871c990 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.456+0000 7f71d5e14b80 1 -- 172.21.15.149:0/3691265168 >> 172.21.15.149:0/3691265168 conn(0x558228667660 msgr2=0x5582286f23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:07.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.456+0000 7f71d5e14b80 1 -- 172.21.15.149:0/3691265168 shutdown_connections 2023-11-08T19:28:07.475 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.456+0000 7f71d5e14b80 1 -- 172.21.15.149:0/3691265168 wait complete. 2023-11-08T19:28:07.475 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.457+0000 7f71d5e14b80 1 -- start start 2023-11-08T19:28:07.475 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.457+0000 7f71d5e14b80 1 Processor -- start 2023-11-08T19:28:07.475 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.457+0000 7f71d5e14b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582286ec6f0 0x558228719760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:07.475 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.457+0000 7f71d5e14b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5582286ecad0 0x558228720080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:07.476 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.457+0000 7f71d5e14b80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5582287205c0 0x55822871bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:07.476 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.457+0000 7f71d5e14b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582286455c0 con 0x5582286ec6f0 2023-11-08T19:28:07.476 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.457+0000 7f71d5e14b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582285e10d0 con 0x5582286ecad0 2023-11-08T19:28:07.476 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.457+0000 7f71d5e14b80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x5582285e0d70 con 0x5582287205c0 2023-11-08T19:28:07.476 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.457+0000 7f71d5e14b80 10 client.0 _ll_register_callbacks cb 0x55822843d7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-08T19:28:07.477 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.457+0000 7f71c37fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582286ec6f0 0x558228719760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:07.477 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.457+0000 7f71c37fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582286ec6f0 0x558228719760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44328/0 (socket says 172.21.15.149:44328) 2023-11-08T19:28:07.477 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.458+0000 7f71c37fe700 1 -- 172.21.15.149:0/3970673231 learned_addr learned my addr 172.21.15.149:0/3970673231 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:28:07.477 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.458+0000 7f71c2ffd700 1 --2- 172.21.15.149:0/3970673231 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5582286ecad0 0x558228720080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:07.477 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.458+0000 7f71c3fff700 1 --2- 172.21.15.149:0/3970673231 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5582287205c0 0x55822871bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:07.477 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.458+0000 7f71c37fe700 1 -- 172.21.15.149:0/3970673231 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5582287205c0 msgr2=0x55822871bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:07.478 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.458+0000 7f71c37fe700 1 --2- 172.21.15.149:0/3970673231 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5582287205c0 0x55822871bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.478 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.458+0000 7f71c37fe700 1 -- 172.21.15.149:0/3970673231 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5582286ecad0 msgr2=0x558228720080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:07.478 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.458+0000 7f71c37fe700 1 --2- 172.21.15.149:0/3970673231 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5582286ecad0 0x558228720080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.478 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.458+0000 7f71c37fe700 1 -- 172.21.15.149:0/3970673231 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71b4011b10 con 0x5582286ec6f0 2023-11-08T19:28:07.479 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.458+0000 7f71c2ffd700 1 --2- 172.21.15.149:0/3970673231 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5582286ecad0 0x558228720080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:28:07.479 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.458+0000 7f71c37fe700 1 --2- 172.21.15.149:0/3970673231 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582286ec6f0 0x558228719760 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f71b800c400 tx=0x7f71b80077c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5affbe0cac2efab3 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:07.479 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.458+0000 7f71a27fc700 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2023-11-08T19:28:07.479 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.458+0000 7f71a27fc700 1 -- 172.21.15.149:0/3970673231 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b805f600 con 0x5582286ec6f0 2023-11-08T19:28:07.479 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.458+0000 7f71a27fc700 1 -- 172.21.15.149:0/3970673231 <== mon.0 v2:172.21.15.149:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 7350+0+0 (secure 0 0 0) 0x7f71b805d040 con 0x5582286ec6f0 2023-11-08T19:28:07.479 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.458+0000 7f71d5e14b80 1 -- 172.21.15.149:0/3970673231 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5582286e4880 con 0x5582286ec6f0 2023-11-08T19:28:07.480 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.458+0000 7f71a27fc700 1 -- 172.21.15.149:0/3970673231 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7f71b80568a0 con 0x5582286ec6f0 2023-11-08T19:28:07.480 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.458+0000 7f71d5e14b80 10 client.7608 fetch_fsmap learned FSMap version 75 2023-11-08T19:28:07.480 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.458+0000 7f71d5e14b80 1 -- 172.21.15.149:0/3970673231 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=2+}) v3 -- 0x55822846ed90 con 0x5582286ec6f0 2023-11-08T19:28:07.480 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.458+0000 7f71a27fc700 1 -- 172.21.15.149:0/3970673231 <== mon.0 v2:172.21.15.149:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5582286e4880 con 0x5582286ec6f0 2023-11-08T19:28:07.481 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.458+0000 7f71a27fc700 1 -- 172.21.15.149:0/3970673231 <== mon.0 v2:172.21.15.149:3300/0 5 ==== fsmap(e 75) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f71b805f170 con 0x5582286ec6f0 2023-11-08T19:28:07.481 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.458+0000 7f71d5e14b80 10 client.7608 fetch_fsmap finished waiting for FSMap version 75 2023-11-08T19:28:07.481 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.458+0000 7f71d5e14b80 10 client.7608 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-08T19:28:07.481 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.458+0000 7f71d5e14b80 20 client.7608 populate_metadata read hostname 'smithi149' 2023-11-08T19:28:07.481 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.459+0000 7f71d5e14b80 1 --2- 172.21.15.149:0/3970673231 >> [v2:172.21.15.160:6832/2947079163,v1:172.21.15.160:6834/2947079163] conn(0x558228749d30 0x55822874a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:07.482 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.459+0000 7f71d5e14b80 4 client.7608 mds_command: new command op to 6451 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-08T19:28:07.482 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.459+0000 7f71d5e14b80 1 -- 172.21.15.149:0/3970673231 --> [v2:172.21.15.160:6832/2947079163,v1:172.21.15.160:6834/2947079163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5582286c0a30 con 0x558228749d30 2023-11-08T19:28:07.482 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.459+0000 7f71c2ffd700 1 --2- 172.21.15.149:0/3970673231 >> [v2:172.21.15.160:6832/2947079163,v1:172.21.15.160:6834/2947079163] conn(0x558228749d30 0x55822874a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:07.482 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.459+0000 7f71a27fc700 10 client.7608 ms_handle_connect on v2:172.21.15.160:6832/2947079163 2023-11-08T19:28:07.482 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.459+0000 7f71c2ffd700 1 --2- 172.21.15.149:0/3970673231 >> [v2:172.21.15.160:6832/2947079163,v1:172.21.15.160:6834/2947079163] conn(0x558228749d30 0x55822874a5d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52953ac13c355bbe server_cookie=fde249e82f3f2d44 in_seq=0 out_seq=0 2023-11-08T19:28:07.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.460+0000 7f71a27fc700 1 -- 172.21.15.149:0/3970673231 <== mds.0 v2:172.21.15.160:6832/2947079163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5582286c0a30 con 0x558228749d30 2023-11-08T19:28:07.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.460+0000 7f71a27fc700 10 client.7608 handle_command_reply: tid=0 2023-11-08T19:28:07.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.460+0000 7f71d5e14b80 1 client.7608 shutdown 2023-11-08T19:28:07.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.460+0000 7f71d5e14b80 1 -- 172.21.15.149:0/3970673231 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582286ec6f0 msgr2=0x558228719760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:07.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.460+0000 7f71d5e14b80 1 --2- 172.21.15.149:0/3970673231 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582286ec6f0 0x558228719760 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f71b800c400 tx=0x7f71b80077c0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.484 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.460+0000 7f71d5e14b80 1 -- 172.21.15.149:0/3970673231 shutdown_connections 2023-11-08T19:28:07.484 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.460+0000 7f71d5e14b80 1 --2- 172.21.15.149:0/3970673231 >> [v2:172.21.15.160:6832/2947079163,v1:172.21.15.160:6834/2947079163] conn(0x558228749d30 0x55822874a5d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.484 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.460+0000 7f71d5e14b80 1 --2- 172.21.15.149:0/3970673231 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5582287205c0 0x55822871bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.484 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.460+0000 7f71d5e14b80 1 --2- 172.21.15.149:0/3970673231 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582286ec6f0 0x558228719760 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.484 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.460+0000 7f71a27fc700 0 client.7608 ms_handle_reset on v2:172.21.15.160:6832/2947079163 2023-11-08T19:28:07.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.460+0000 7f71d5e14b80 1 --2- 172.21.15.149:0/3970673231 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5582286ecad0 0x558228720080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.460+0000 7f71d5e14b80 1 -- 172.21.15.149:0/3970673231 >> 172.21.15.149:0/3970673231 conn(0x558228667660 msgr2=0x5582286ef8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:07.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.460+0000 7f71d5e14b80 1 -- 172.21.15.149:0/3970673231 shutdown_connections 2023-11-08T19:28:07.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.460+0000 7f71d5e14b80 1 -- 172.21.15.149:0/3970673231 wait complete. 2023-11-08T19:28:07.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.460+0000 7f71d5e14b80 20 client.7608 trim_cache size 0 max 16384 2023-11-08T19:28:07.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.478+0000 7f71d5e14b80 1 Processor -- start 2023-11-08T19:28:07.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.478+0000 7f71d5e14b80 1 -- start start 2023-11-08T19:28:07.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.479+0000 7f71d5e14b80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5582286ec6f0 0x55822871e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:07.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.479+0000 7f71d5e14b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5582286ecad0 0x55822871bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:07.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.479+0000 7f71d5e14b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582287205c0 0x5582286ef4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:07.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.479+0000 7f71d5e14b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582284c48d0 con 0x5582287205c0 2023-11-08T19:28:07.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.479+0000 7f71d5e14b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55822872e7d0 con 0x5582286ecad0 2023-11-08T19:28:07.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.479+0000 7f71d5e14b80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55822871ed70 con 0x5582286ec6f0 2023-11-08T19:28:07.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.479+0000 7f71c3fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582287205c0 0x5582286ef4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:07.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.479+0000 7f71c3fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582287205c0 0x5582286ef4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44340/0 (socket says 172.21.15.149:44340) 2023-11-08T19:28:07.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.479+0000 7f71c3fff700 1 -- 172.21.15.149:0/1566138472 learned_addr learned my addr 172.21.15.149:0/1566138472 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:28:07.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.479+0000 7f71c3fff700 1 -- 172.21.15.149:0/1566138472 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5582286ec6f0 msgr2=0x55822871e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:07.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.479+0000 7f71c2ffd700 1 --2- 172.21.15.149:0/1566138472 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5582286ecad0 0x55822871bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:07.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.479+0000 7f71c37fe700 1 --2- 172.21.15.149:0/1566138472 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5582286ec6f0 0x55822871e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:07.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.479+0000 7f71c3fff700 1 --2- 172.21.15.149:0/1566138472 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5582286ec6f0 0x55822871e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.479+0000 7f71c3fff700 1 -- 172.21.15.149:0/1566138472 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5582286ecad0 msgr2=0x55822871bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:07.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.479+0000 7f71c3fff700 1 --2- 172.21.15.149:0/1566138472 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5582286ecad0 0x55822871bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.479+0000 7f71c3fff700 1 -- 172.21.15.149:0/1566138472 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558228457c10 con 0x5582287205c0 2023-11-08T19:28:07.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.479+0000 7f71c3fff700 1 --2- 172.21.15.149:0/1566138472 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582287205c0 0x5582286ef4c0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f71bc013000 tx=0x7f71bc011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e483ca40fe9b7653 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:07.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.479+0000 7f71a9ffb700 1 -- 172.21.15.149:0/1566138472 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71bc02b070 con 0x5582287205c0 2023-11-08T19:28:07.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.480+0000 7f71a9ffb700 1 -- 172.21.15.149:0/1566138472 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71bc003aa0 con 0x5582287205c0 2023-11-08T19:28:07.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.480+0000 7f71a9ffb700 1 -- 172.21.15.149:0/1566138472 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71bc003e10 con 0x5582287205c0 2023-11-08T19:28:07.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.480+0000 7f71d5e14b80 1 -- 172.21.15.149:0/1566138472 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582287205c0 msgr2=0x5582286ef4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:07.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.480+0000 7f71d5e14b80 1 --2- 172.21.15.149:0/1566138472 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582287205c0 0x5582286ef4c0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f71bc013000 tx=0x7f71bc011000 comp rx=0 tx=0).stop 2023-11-08T19:28:07.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.480+0000 7f71d5e14b80 1 -- 172.21.15.149:0/1566138472 shutdown_connections 2023-11-08T19:28:07.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.480+0000 7f71d5e14b80 1 --2- 172.21.15.149:0/1566138472 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582287205c0 0x5582286ef4c0 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.480+0000 7f71d5e14b80 1 --2- 172.21.15.149:0/1566138472 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5582286ec6f0 0x55822871e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.480+0000 7f71d5e14b80 1 --2- 172.21.15.149:0/1566138472 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5582286ecad0 0x55822871bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.480+0000 7f71d5e14b80 1 -- 172.21.15.149:0/1566138472 >> 172.21.15.149:0/1566138472 conn(0x558228667660 msgr2=0x5582286f2390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:07.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.480+0000 7f71d5e14b80 1 -- 172.21.15.149:0/1566138472 shutdown_connections 2023-11-08T19:28:07.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.480+0000 7f71d5e14b80 1 -- 172.21.15.149:0/1566138472 wait complete. 2023-11-08T19:28:07.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.481+0000 7f71d5e14b80 1 -- start start 2023-11-08T19:28:07.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.481+0000 7f71d5e14b80 1 Processor -- start 2023-11-08T19:28:07.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.482+0000 7f71d5e14b80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5582286ec6f0 0x5582287a0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:07.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.482+0000 7f71d5e14b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582286ecad0 0x5582286eb500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:07.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.482+0000 7f71d5e14b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5582287205c0 0x5582286eba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:07.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.482+0000 7f71d5e14b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x558228720430 con 0x5582286ecad0 2023-11-08T19:28:07.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.482+0000 7f71d5e14b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x558228749b30 con 0x5582287205c0 2023-11-08T19:28:07.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.482+0000 7f71d5e14b80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x5582287a28d0 con 0x5582286ec6f0 2023-11-08T19:28:07.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.482+0000 7f71d5e14b80 10 client.0 _ll_register_callbacks cb 0x7f71b8001110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-08T19:28:07.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.482+0000 7f71c2ffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582286ecad0 0x5582286eb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:07.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.482+0000 7f71c2ffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582286ecad0 0x5582286eb500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44344/0 (socket says 172.21.15.149:44344) 2023-11-08T19:28:07.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.482+0000 7f71c2ffd700 1 -- 172.21.15.149:0/3062179583 learned_addr learned my addr 172.21.15.149:0/3062179583 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:28:07.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.482+0000 7f71c37fe700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5582286ec6f0 0x5582287a0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:07.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.482+0000 7f71c3fff700 1 --2- 172.21.15.149:0/3062179583 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5582287205c0 0x5582286eba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:07.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.482+0000 7f71c2ffd700 1 -- 172.21.15.149:0/3062179583 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5582286ec6f0 msgr2=0x5582287a0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:07.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.482+0000 7f71c2ffd700 1 --2- 172.21.15.149:0/3062179583 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5582286ec6f0 0x5582287a0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.482+0000 7f71c2ffd700 1 -- 172.21.15.149:0/3062179583 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5582287205c0 msgr2=0x5582286eba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:07.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.482+0000 7f71c2ffd700 1 --2- 172.21.15.149:0/3062179583 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5582287205c0 0x5582286eba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.482+0000 7f71c2ffd700 1 -- 172.21.15.149:0/3062179583 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71c415eeb0 con 0x5582286ecad0 2023-11-08T19:28:07.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.483+0000 7f71c2ffd700 1 --2- 172.21.15.149:0/3062179583 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582286ecad0 0x5582286eb500 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f71b4009bb0 tx=0x7f71b40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=febc4961fbfe33c2 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:07.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.483+0000 7f71a27fc700 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2023-11-08T19:28:07.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.483+0000 7f71a27fc700 1 -- 172.21.15.149:0/3062179583 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b4030040 con 0x5582286ecad0 2023-11-08T19:28:07.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.483+0000 7f71a27fc700 1 -- 172.21.15.149:0/3062179583 <== mon.0 v2:172.21.15.149:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 7350+0+0 (secure 0 0 0) 0x7f71b401c040 con 0x5582286ecad0 2023-11-08T19:28:07.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.483+0000 7f71d5e14b80 1 -- 172.21.15.149:0/3062179583 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f71b4009e00 con 0x5582286ecad0 2023-11-08T19:28:07.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.483+0000 7f71a27fc700 1 -- 172.21.15.149:0/3062179583 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7f71b4005e30 con 0x5582286ecad0 2023-11-08T19:28:07.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.483+0000 7f71d5e14b80 10 client.7614 fetch_fsmap learned FSMap version 75 2023-11-08T19:28:07.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.483+0000 7f71d5e14b80 1 -- 172.21.15.149:0/3062179583 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=2+}) v3 -- 0x558228495200 con 0x5582286ecad0 2023-11-08T19:28:07.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.483+0000 7f71a27fc700 1 -- 172.21.15.149:0/3062179583 <== mon.0 v2:172.21.15.149:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71b4009e00 con 0x5582286ecad0 2023-11-08T19:28:07.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.483+0000 7f71a27fc700 1 -- 172.21.15.149:0/3062179583 <== mon.0 v2:172.21.15.149:3300/0 5 ==== fsmap(e 75) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f71b4037470 con 0x5582286ecad0 2023-11-08T19:28:07.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.483+0000 7f71d5e14b80 10 client.7614 fetch_fsmap finished waiting for FSMap version 75 2023-11-08T19:28:07.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.483+0000 7f71d5e14b80 10 client.7614 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-08T19:28:07.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.483+0000 7f71d5e14b80 20 client.7614 populate_metadata read hostname 'smithi149' 2023-11-08T19:28:07.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.483+0000 7f71d5e14b80 1 --2- 172.21.15.149:0/3062179583 >> [v2:172.21.15.160:6832/2947079163,v1:172.21.15.160:6834/2947079163] conn(0x55822872d2b0 0x55822872d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:07.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.483+0000 7f71d5e14b80 4 client.7614 mds_command: new command op to 6451 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-08T19:28:07.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.483+0000 7f71d5e14b80 1 -- 172.21.15.149:0/3062179583 --> [v2:172.21.15.160:6832/2947079163,v1:172.21.15.160:6834/2947079163] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55822863e5a0 con 0x55822872d2b0 2023-11-08T19:28:07.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.483+0000 7f71c37fe700 1 --2- 172.21.15.149:0/3062179583 >> [v2:172.21.15.160:6832/2947079163,v1:172.21.15.160:6834/2947079163] conn(0x55822872d2b0 0x55822872d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:07.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.484+0000 7f71a27fc700 10 client.7614 ms_handle_connect on v2:172.21.15.160:6832/2947079163 2023-11-08T19:28:07.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.484+0000 7f71c37fe700 1 --2- 172.21.15.149:0/3062179583 >> [v2:172.21.15.160:6832/2947079163,v1:172.21.15.160:6834/2947079163] conn(0x55822872d2b0 0x55822872d690 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad60048a4017b39 server_cookie=57749a8b72cb6f21 in_seq=0 out_seq=0 2023-11-08T19:28:07.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.484+0000 7f71a27fc700 1 -- 172.21.15.149:0/3062179583 <== mds.0 v2:172.21.15.160:6832/2947079163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55822863e5a0 con 0x55822872d2b0 2023-11-08T19:28:07.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.484+0000 7f71a27fc700 10 client.7614 handle_command_reply: tid=0 2023-11-08T19:28:07.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.484+0000 7f71d5e14b80 1 client.7614 shutdown 2023-11-08T19:28:07.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.484+0000 7f71d5e14b80 1 -- 172.21.15.149:0/3062179583 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582286ecad0 msgr2=0x5582286eb500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:07.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.484+0000 7f71d5e14b80 1 --2- 172.21.15.149:0/3062179583 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582286ecad0 0x5582286eb500 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f71b4009bb0 tx=0x7f71b40047c0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.484+0000 7f71d5e14b80 1 -- 172.21.15.149:0/3062179583 shutdown_connections 2023-11-08T19:28:07.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.484+0000 7f71d5e14b80 1 --2- 172.21.15.149:0/3062179583 >> [v2:172.21.15.160:6832/2947079163,v1:172.21.15.160:6834/2947079163] conn(0x55822872d2b0 0x55822872d690 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.484+0000 7f71d5e14b80 1 --2- 172.21.15.149:0/3062179583 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5582287205c0 0x5582286eba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.484+0000 7f71d5e14b80 1 --2- 172.21.15.149:0/3062179583 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5582286ec6f0 0x5582287a0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.484+0000 7f71a27fc700 0 client.7614 ms_handle_reset on v2:172.21.15.160:6832/2947079163 2023-11-08T19:28:07.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.484+0000 7f71d5e14b80 1 --2- 172.21.15.149:0/3062179583 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582286ecad0 0x5582286eb500 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.484+0000 7f71d5e14b80 1 -- 172.21.15.149:0/3062179583 >> 172.21.15.149:0/3062179583 conn(0x558228667660 msgr2=0x558228719570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:07.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.484+0000 7f71d5e14b80 1 -- 172.21.15.149:0/3062179583 shutdown_connections 2023-11-08T19:28:07.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.484+0000 7f71d5e14b80 1 -- 172.21.15.149:0/3062179583 wait complete. 2023-11-08T19:28:07.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.484+0000 7f71d5e14b80 20 client.7614 trim_cache size 0 max 16384 2023-11-08T19:28:07.509 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2023-11-08T19:28:07.510 INFO:teuthology.orchestra.run.smithi149.stdout: "cluster_fsid": "0aba7c70-fe80-4446-a2f5-7502ac3adfb4", 2023-11-08T19:28:07.510 INFO:teuthology.orchestra.run.smithi149.stdout: "whoami": 0, 2023-11-08T19:28:07.510 INFO:teuthology.orchestra.run.smithi149.stdout: "id": 6451, 2023-11-08T19:28:07.510 INFO:teuthology.orchestra.run.smithi149.stdout: "want_state": "up:active", 2023-11-08T19:28:07.511 INFO:teuthology.orchestra.run.smithi149.stdout: "state": "up:active", 2023-11-08T19:28:07.511 INFO:teuthology.orchestra.run.smithi149.stdout: "fs_name": "cephfs", 2023-11-08T19:28:07.511 INFO:teuthology.orchestra.run.smithi149.stdout: "rank_uptime": 6.7366786269999999, 2023-11-08T19:28:07.511 INFO:teuthology.orchestra.run.smithi149.stdout: "mdsmap_epoch": 75, 2023-11-08T19:28:07.511 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_epoch": 100, 2023-11-08T19:28:07.512 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_epoch_barrier": 100, 2023-11-08T19:28:07.512 INFO:teuthology.orchestra.run.smithi149.stdout: "uptime": 84.824832293 2023-11-08T19:28:07.512 INFO:teuthology.orchestra.run.smithi149.stdout:} 2023-11-08T19:28:07.513 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.485+0000 7f71c9c1b700 1 -- 172.21.15.149:0/458564837 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f71b006af00 msgr2=0x7f71b006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:07.514 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.485+0000 7f71c9c1b700 1 --2- 172.21.15.149:0/458564837 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f71b006af00 0x7f71b006d3c0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f71c40b1c50 tx=0x7f71b40092c0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.514 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.485+0000 7f71c9c1b700 1 -- 172.21.15.149:0/458564837 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71c406ab80 msgr2=0x7f71c41563f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:07.514 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.485+0000 7f71c9c1b700 1 --2- 172.21.15.149:0/458564837 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71c406ab80 0x7f71c41563f0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f71b800c430 tx=0x7f71b800c740 comp rx=0 tx=0).stop 2023-11-08T19:28:07.514 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.485+0000 7f71c9c1b700 1 -- 172.21.15.149:0/458564837 shutdown_connections 2023-11-08T19:28:07.515 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.485+0000 7f71c9c1b700 1 --2- 172.21.15.149:0/458564837 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f71b006af00 0x7f71b006d3c0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.515 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.485+0000 7f71c9c1b700 1 --2- 172.21.15.149:0/458564837 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71c415db70 0x7f71c40c5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.515 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.485+0000 7f71c9c1b700 1 --2- 172.21.15.149:0/458564837 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71c406ab80 0x7f71c41563f0 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.515 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.485+0000 7f71c9c1b700 1 --2- 172.21.15.149:0/458564837 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f71c40b2c00 0x7f71c40c5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.515 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.485+0000 7f71c9c1b700 1 -- 172.21.15.149:0/458564837 >> 172.21.15.149:0/458564837 conn(0x7f71c40ccff0 msgr2=0x7f71c4160160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:07.516 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.485+0000 7f71c9c1b700 1 -- 172.21.15.149:0/458564837 shutdown_connections 2023-11-08T19:28:07.516 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.485+0000 7f71c9c1b700 1 -- 172.21.15.149:0/458564837 wait complete. 2023-11-08T19:28:07.516 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-08T19:28:07.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.637+0000 7fbdc598a700 1 Processor -- start 2023-11-08T19:28:07.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.638+0000 7fbdc598a700 1 -- start start 2023-11-08T19:28:07.641 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.638+0000 7fbdc598a700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fbdc015db70 0x7fbdc0161dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:07.641 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.638+0000 7fbdc598a700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fbdc006ab80 0x7fbdc006afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:07.642 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.638+0000 7fbdc598a700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdc0161940 con 0x7fbdc00b2c00 2023-11-08T19:28:07.642 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.638+0000 7fbdc598a700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdc006b4f0 con 0x7fbdc006ab80 2023-11-08T19:28:07.642 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.638+0000 7fbdc598a700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdc015e660 con 0x7fbdc015db70 2023-11-08T19:28:07.642 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.639+0000 7fbdbf7fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fbdc006ab80 0x7fbdc006afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:07.643 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.639+0000 7fbdbf7fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fbdc006ab80 0x7fbdc006afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44352/0 (socket says 172.21.15.149:44352) 2023-11-08T19:28:07.643 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.639+0000 7fbdbf7fe700 1 -- 172.21.15.149:0/1618532482 learned_addr learned my addr 172.21.15.149:0/1618532482 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:28:07.643 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.639+0000 7fbdbeffd700 1 --2- 172.21.15.149:0/1618532482 >> v2:172.21.15.160:3300/0 conn(0x7fbdc015db70 0x7fbdc0161dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:07.643 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.639+0000 7fbdbf7fe700 1 -- 172.21.15.149:0/1618532482 >> v2:172.21.15.160:3300/0 conn(0x7fbdc015db70 msgr2=0x7fbdc0161dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:07.643 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.639+0000 7fbdbf7fe700 1 --2- 172.21.15.149:0/1618532482 >> v2:172.21.15.160:3300/0 conn(0x7fbdc015db70 0x7fbdc0161dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.644 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.639+0000 7fbdbf7fe700 1 -- 172.21.15.149:0/1618532482 >> v1:172.21.15.160:6789/0 conn(0x7fbdc00b2c00 legacy=0x7fbdc015df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:07.644 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.639+0000 7fbdbdffb700 1 -- 172.21.15.149:0/1618532482 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2494575870 0 0) 0x7fbdc0161940 con 0x7fbdc00b2c00 2023-11-08T19:28:07.644 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.639+0000 7fbdbf7fe700 1 -- 172.21.15.149:0/1618532482 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc015eeb0 con 0x7fbdc006ab80 2023-11-08T19:28:07.644 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.639+0000 7fbdbf7fe700 1 --2- 172.21.15.149:0/1618532482 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbdc006ab80 0x7fbdc006afb0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7fbdc00d15e0 tx=0x7fbdb800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa211b66be9b737b server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:07.644 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.639+0000 7fbdbdffb700 1 -- 172.21.15.149:0/1618532482 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb800e070 con 0x7fbdc006ab80 2023-11-08T19:28:07.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.639+0000 7fbdbdffb700 1 -- 172.21.15.149:0/1618532482 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdb800b910 con 0x7fbdc006ab80 2023-11-08T19:28:07.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.639+0000 7fbdbdffb700 1 -- 172.21.15.149:0/1618532482 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb800bcc0 con 0x7fbdc006ab80 2023-11-08T19:28:07.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.640+0000 7fbdc598a700 1 -- 172.21.15.149:0/1618532482 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbdc006ab80 msgr2=0x7fbdc006afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:07.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.640+0000 7fbdc598a700 1 --2- 172.21.15.149:0/1618532482 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbdc006ab80 0x7fbdc006afb0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7fbdc00d15e0 tx=0x7fbdb800b330 comp rx=0 tx=0).stop 2023-11-08T19:28:07.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.640+0000 7fbdc598a700 1 -- 172.21.15.149:0/1618532482 shutdown_connections 2023-11-08T19:28:07.646 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.640+0000 7fbdc598a700 1 --2- 172.21.15.149:0/1618532482 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbdc006ab80 0x7fbdc006afb0 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.646 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.640+0000 7fbdc598a700 1 --2- 172.21.15.149:0/1618532482 >> v2:172.21.15.160:3300/0 conn(0x7fbdc015db70 0x7fbdc0161dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.646 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.640+0000 7fbdc598a700 1 -- 172.21.15.149:0/1618532482 >> 172.21.15.149:0/1618532482 conn(0x7fbdc00ccff0 msgr2=0x7fbdc00cd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:07.646 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.640+0000 7fbdc598a700 1 -- 172.21.15.149:0/1618532482 shutdown_connections 2023-11-08T19:28:07.646 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.640+0000 7fbdc598a700 1 -- 172.21.15.149:0/1618532482 wait complete. 2023-11-08T19:28:07.657 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.641+0000 7fbdc598a700 1 Processor -- start 2023-11-08T19:28:07.658 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.641+0000 7fbdc598a700 1 -- start start 2023-11-08T19:28:07.658 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.642+0000 7fbdc598a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbdc006ab80 0x7fbdc015aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:07.658 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.642+0000 7fbdc598a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbdc00b2c00 0x7fbdc01f32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:07.658 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.642+0000 7fbdc598a700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbdc015db70 0x7fbdc015b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:07.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.642+0000 7fbdc598a700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc00c5980 con 0x7fbdc006ab80 2023-11-08T19:28:07.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.642+0000 7fbdc598a700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc00c43d0 con 0x7fbdc00b2c00 2023-11-08T19:28:07.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.642+0000 7fbdc598a700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc015afd0 con 0x7fbdc015db70 2023-11-08T19:28:07.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.642+0000 7fbdbeffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbdc006ab80 0x7fbdc015aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:07.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.642+0000 7fbdbeffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbdc006ab80 0x7fbdc015aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44354/0 (socket says 172.21.15.149:44354) 2023-11-08T19:28:07.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.642+0000 7fbdbeffd700 1 -- 172.21.15.149:0/71996917 learned_addr learned my addr 172.21.15.149:0/71996917 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:28:07.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.642+0000 7fbdbe7fc700 1 --2- 172.21.15.149:0/71996917 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbdc00b2c00 0x7fbdc01f32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:07.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.642+0000 7fbdbf7fe700 1 --2- 172.21.15.149:0/71996917 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbdc015db70 0x7fbdc015b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:07.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.642+0000 7fbdbeffd700 1 -- 172.21.15.149:0/71996917 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbdc015db70 msgr2=0x7fbdc015b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:07.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.642+0000 7fbdbeffd700 1 --2- 172.21.15.149:0/71996917 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbdc015db70 0x7fbdc015b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.642+0000 7fbdbeffd700 1 -- 172.21.15.149:0/71996917 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbdc00b2c00 msgr2=0x7fbdc01f32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:07.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.642+0000 7fbdbeffd700 1 --2- 172.21.15.149:0/71996917 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbdc00b2c00 0x7fbdc01f32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.642+0000 7fbdbeffd700 1 -- 172.21.15.149:0/71996917 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdb8009b30 con 0x7fbdc006ab80 2023-11-08T19:28:07.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.642+0000 7fbdbf7fe700 1 --2- 172.21.15.149:0/71996917 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbdc015db70 0x7fbdc015b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:28:07.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.643+0000 7fbdbeffd700 1 --2- 172.21.15.149:0/71996917 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbdc006ab80 0x7fbdc015aa90 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7fbdb400e870 tx=0x7fbdb400eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:07.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.643+0000 7fbda7fff700 1 -- 172.21.15.149:0/71996917 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb4009590 con 0x7fbdc006ab80 2023-11-08T19:28:07.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.643+0000 7fbda7fff700 1 -- 172.21.15.149:0/71996917 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdb4013680 con 0x7fbdc006ab80 2023-11-08T19:28:07.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.643+0000 7fbdc598a700 1 -- 172.21.15.149:0/71996917 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdc00b4940 con 0x7fbdc006ab80 2023-11-08T19:28:07.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.643+0000 7fbda7fff700 1 -- 172.21.15.149:0/71996917 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb40139f0 con 0x7fbdc006ab80 2023-11-08T19:28:07.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.643+0000 7fbdc598a700 1 -- 172.21.15.149:0/71996917 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdc00b4f00 con 0x7fbdc006ab80 2023-11-08T19:28:07.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.644+0000 7fbda7fff700 1 -- 172.21.15.149:0/71996917 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbdb4013b50 con 0x7fbdc006ab80 2023-11-08T19:28:07.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.645+0000 7fbda7fff700 1 --2- 172.21.15.149:0/71996917 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fbdac06af00 0x7fbdac06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:07.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.645+0000 7fbdbe7fc700 1 --2- 172.21.15.149:0/71996917 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fbdac06af00 0x7fbdac06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:07.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.645+0000 7fbda7fff700 1 -- 172.21.15.149:0/71996917 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7350+0+0 (secure 0 0 0) 0x7fbdb4089bc0 con 0x7fbdc006ab80 2023-11-08T19:28:07.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.645+0000 7fbdbe7fc700 1 --2- 172.21.15.149:0/71996917 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fbdac06af00 0x7fbdac06d3c0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fbdc015c5c0 tx=0x7fbdb0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:07.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.647+0000 7fbdd1b83b80 1 Processor -- start 2023-11-08T19:28:07.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.647+0000 7fbdd1b83b80 1 -- start start 2023-11-08T19:28:07.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.648+0000 7fbdd1b83b80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55ff588126f0 0x55ff58842450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:07.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.648+0000 7fbdd1b83b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff58814c30 0x55ff58842990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:07.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.648+0000 7fbdd1b83b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ff58812ad0 0x55ff5882cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:07.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.648+0000 7fbdd1b83b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff5877e6e0 con 0x55ff58812ad0 2023-11-08T19:28:07.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.648+0000 7fbdd1b83b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff587723b0 con 0x55ff58814c30 2023-11-08T19:28:07.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.648+0000 7fbdd1b83b80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ff5876fcd0 con 0x55ff588126f0 2023-11-08T19:28:07.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.648+0000 7fbdbf7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ff58812ad0 0x55ff5882cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:07.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.648+0000 7fbdbf7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ff58812ad0 0x55ff5882cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44366/0 (socket says 172.21.15.149:44366) 2023-11-08T19:28:07.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.648+0000 7fbdbf7fe700 1 -- 172.21.15.149:0/3636539133 learned_addr learned my addr 172.21.15.149:0/3636539133 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:28:07.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.648+0000 7fbdbe7fc700 1 --2- 172.21.15.149:0/3636539133 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff58814c30 0x55ff58842990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:07.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.648+0000 7fbdbeffd700 1 --2- 172.21.15.149:0/3636539133 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55ff588126f0 0x55ff58842450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:07.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.648+0000 7fbdbf7fe700 1 -- 172.21.15.149:0/3636539133 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55ff588126f0 msgr2=0x55ff58842450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:07.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.648+0000 7fbdbf7fe700 1 --2- 172.21.15.149:0/3636539133 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55ff588126f0 0x55ff58842450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.648+0000 7fbdbf7fe700 1 -- 172.21.15.149:0/3636539133 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff58814c30 msgr2=0x55ff58842990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:07.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.648+0000 7fbdbf7fe700 1 --2- 172.21.15.149:0/3636539133 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff58814c30 0x55ff58842990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.648+0000 7fbdbf7fe700 1 -- 172.21.15.149:0/3636539133 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ff585e85e0 con 0x55ff58812ad0 2023-11-08T19:28:07.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.648+0000 7fbdbf7fe700 1 --2- 172.21.15.149:0/3636539133 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ff58812ad0 0x55ff5882cf90 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7fbdc00b3160 tx=0x7fbdb8010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=148774d7bff2a526 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:07.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.648+0000 7fbda57fa700 1 -- 172.21.15.149:0/3636539133 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb8003a20 con 0x55ff58812ad0 2023-11-08T19:28:07.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.648+0000 7fbda57fa700 1 -- 172.21.15.149:0/3636539133 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdb8003b80 con 0x55ff58812ad0 2023-11-08T19:28:07.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.648+0000 7fbda57fa700 1 -- 172.21.15.149:0/3636539133 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb8004040 con 0x55ff58812ad0 2023-11-08T19:28:07.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.649+0000 7fbdd1b83b80 1 -- 172.21.15.149:0/3636539133 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ff58812ad0 msgr2=0x55ff5882cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:07.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.649+0000 7fbdd1b83b80 1 --2- 172.21.15.149:0/3636539133 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ff58812ad0 0x55ff5882cf90 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7fbdc00b3160 tx=0x7fbdb8010000 comp rx=0 tx=0).stop 2023-11-08T19:28:07.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.649+0000 7fbdd1b83b80 1 -- 172.21.15.149:0/3636539133 shutdown_connections 2023-11-08T19:28:07.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.649+0000 7fbdd1b83b80 1 --2- 172.21.15.149:0/3636539133 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ff58812ad0 0x55ff5882cf90 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.649+0000 7fbdd1b83b80 1 --2- 172.21.15.149:0/3636539133 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55ff588126f0 0x55ff58842450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.649+0000 7fbdd1b83b80 1 --2- 172.21.15.149:0/3636539133 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff58814c30 0x55ff58842990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.649+0000 7fbdd1b83b80 1 -- 172.21.15.149:0/3636539133 >> 172.21.15.149:0/3636539133 conn(0x55ff5878d660 msgr2=0x55ff588183c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:07.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.649+0000 7fbdd1b83b80 1 -- 172.21.15.149:0/3636539133 shutdown_connections 2023-11-08T19:28:07.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.649+0000 7fbdd1b83b80 1 -- 172.21.15.149:0/3636539133 wait complete. 2023-11-08T19:28:07.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.650+0000 7fbdd1b83b80 1 -- start start 2023-11-08T19:28:07.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.650+0000 7fbdd1b83b80 1 Processor -- start 2023-11-08T19:28:07.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.651+0000 7fbdd1b83b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff588126f0 0x55ff5886c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:07.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.651+0000 7fbdd1b83b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ff58812ad0 0x55ff58856df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:07.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.651+0000 7fbdd1b83b80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55ff58856170 0x55ff58813020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:07.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.651+0000 7fbdd1b83b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff5876b5c0 con 0x55ff58812ad0 2023-11-08T19:28:07.672 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.651+0000 7fbdd1b83b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff587070d0 con 0x55ff588126f0 2023-11-08T19:28:07.672 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.651+0000 7fbdd1b83b80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ff58706d70 con 0x55ff58856170 2023-11-08T19:28:07.672 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.651+0000 7fbdd1b83b80 10 client.0 _ll_register_callbacks cb 0x55ff585637b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-08T19:28:07.672 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.651+0000 7fbdbe7fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ff58812ad0 0x55ff58856df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:07.672 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.651+0000 7fbdbe7fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ff58812ad0 0x55ff58856df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44370/0 (socket says 172.21.15.149:44370) 2023-11-08T19:28:07.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.651+0000 7fbdbe7fc700 1 -- 172.21.15.149:0/226300170 learned_addr learned my addr 172.21.15.149:0/226300170 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:28:07.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.651+0000 7fbdbeffd700 1 --2- 172.21.15.149:0/226300170 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff588126f0 0x55ff5886c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:07.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.651+0000 7fbdbf7fe700 1 --2- 172.21.15.149:0/226300170 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55ff58856170 0x55ff58813020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:07.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.651+0000 7fbdbe7fc700 1 -- 172.21.15.149:0/226300170 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55ff58856170 msgr2=0x55ff58813020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:07.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.651+0000 7fbdbe7fc700 1 --2- 172.21.15.149:0/226300170 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55ff58856170 0x55ff58813020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.651+0000 7fbdbe7fc700 1 -- 172.21.15.149:0/226300170 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff588126f0 msgr2=0x55ff5886c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:07.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.651+0000 7fbdbe7fc700 1 --2- 172.21.15.149:0/226300170 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff588126f0 0x55ff5886c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.651+0000 7fbdbe7fc700 1 -- 172.21.15.149:0/226300170 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdb800be70 con 0x55ff58812ad0 2023-11-08T19:28:07.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.651+0000 7fbdbe7fc700 1 --2- 172.21.15.149:0/226300170 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ff58812ad0 0x55ff58856df0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fbdb0001600 tx=0x7fbdb0001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5d1d3ab0dfb0bd5 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:07.675 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.651+0000 7fbd9e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2023-11-08T19:28:07.675 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.651+0000 7fbd9e7fc700 1 -- 172.21.15.149:0/226300170 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb0014af0 con 0x55ff58812ad0 2023-11-08T19:28:07.675 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.651+0000 7fbd9e7fc700 1 -- 172.21.15.149:0/226300170 <== mon.0 v2:172.21.15.149:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 7350+0+0 (secure 0 0 0) 0x7fbdb001c040 con 0x55ff58812ad0 2023-11-08T19:28:07.676 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.651+0000 7fbdd1b83b80 1 -- 172.21.15.149:0/226300170 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ff5880a880 con 0x55ff58812ad0 2023-11-08T19:28:07.676 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.652+0000 7fbd9e7fc700 1 -- 172.21.15.149:0/226300170 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbdb0014c50 con 0x55ff58812ad0 2023-11-08T19:28:07.676 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.652+0000 7fbdd1b83b80 10 client.7626 fetch_fsmap learned FSMap version 75 2023-11-08T19:28:07.677 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.652+0000 7fbdd1b83b80 1 -- 172.21.15.149:0/226300170 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=2+}) v3 -- 0x55ff58594d90 con 0x55ff58812ad0 2023-11-08T19:28:07.677 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.652+0000 7fbd9e7fc700 1 -- 172.21.15.149:0/226300170 <== mon.0 v2:172.21.15.149:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ff5880a880 con 0x55ff58812ad0 2023-11-08T19:28:07.677 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.652+0000 7fbd9e7fc700 1 -- 172.21.15.149:0/226300170 <== mon.0 v2:172.21.15.149:3300/0 5 ==== fsmap(e 75) v1 ==== 3306+0+0 (secure 0 0 0) 0x7fbdb0021400 con 0x55ff58812ad0 2023-11-08T19:28:07.678 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.652+0000 7fbdd1b83b80 10 client.7626 fetch_fsmap finished waiting for FSMap version 75 2023-11-08T19:28:07.678 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.652+0000 7fbdd1b83b80 10 client.7626 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-08T19:28:07.678 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.652+0000 7fbdd1b83b80 20 client.7626 populate_metadata read hostname 'smithi149' 2023-11-08T19:28:07.679 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.652+0000 7fbdd1b83b80 1 --2- 172.21.15.149:0/226300170 >> [v2:172.21.15.149:6835/3917392643,v1:172.21.15.149:6837/3917392643] conn(0x55ff5881d840 0x55ff588448c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:07.679 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.652+0000 7fbdd1b83b80 4 client.7626 mds_command: new command op to 7125 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-08T19:28:07.679 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.652+0000 7fbdd1b83b80 1 -- 172.21.15.149:0/226300170 --> [v2:172.21.15.149:6835/3917392643,v1:172.21.15.149:6837/3917392643] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ff587e6a30 con 0x55ff5881d840 2023-11-08T19:28:07.680 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.652+0000 7fbdbeffd700 1 --2- 172.21.15.149:0/226300170 >> [v2:172.21.15.149:6835/3917392643,v1:172.21.15.149:6837/3917392643] conn(0x55ff5881d840 0x55ff588448c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:07.680 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.652+0000 7fbd9e7fc700 10 client.7626 ms_handle_connect on v2:172.21.15.149:6835/3917392643 2023-11-08T19:28:07.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.652+0000 7fbdbeffd700 1 --2- 172.21.15.149:0/226300170 >> [v2:172.21.15.149:6835/3917392643,v1:172.21.15.149:6837/3917392643] conn(0x55ff5881d840 0x55ff588448c0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=efbbfbf2fe47f549 server_cookie=f75ad712fc54b45a in_seq=0 out_seq=0 2023-11-08T19:28:07.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.653+0000 7fbd9e7fc700 1 -- 172.21.15.149:0/226300170 <== mds.1 v2:172.21.15.149:6835/3917392643 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ff587e6a30 con 0x55ff5881d840 2023-11-08T19:28:07.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.653+0000 7fbd9e7fc700 10 client.7626 handle_command_reply: tid=0 2023-11-08T19:28:07.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.653+0000 7fbdd1b83b80 1 client.7626 shutdown 2023-11-08T19:28:07.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.653+0000 7fbdd1b83b80 1 -- 172.21.15.149:0/226300170 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ff58812ad0 msgr2=0x55ff58856df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:07.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.653+0000 7fbdd1b83b80 1 --2- 172.21.15.149:0/226300170 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ff58812ad0 0x55ff58856df0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fbdb0001600 tx=0x7fbdb0001080 comp rx=0 tx=0).stop 2023-11-08T19:28:07.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.653+0000 7fbdd1b83b80 1 -- 172.21.15.149:0/226300170 shutdown_connections 2023-11-08T19:28:07.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.653+0000 7fbdd1b83b80 1 --2- 172.21.15.149:0/226300170 >> [v2:172.21.15.149:6835/3917392643,v1:172.21.15.149:6837/3917392643] conn(0x55ff5881d840 0x55ff588448c0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.653+0000 7fbdd1b83b80 1 --2- 172.21.15.149:0/226300170 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff588126f0 0x55ff5886c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.653+0000 7fbd9e7fc700 0 client.7626 ms_handle_reset on v2:172.21.15.149:6835/3917392643 2023-11-08T19:28:07.684 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.653+0000 7fbdd1b83b80 1 --2- 172.21.15.149:0/226300170 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55ff58856170 0x55ff58813020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.684 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.653+0000 7fbdd1b83b80 1 --2- 172.21.15.149:0/226300170 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ff58812ad0 0x55ff58856df0 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.684 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.653+0000 7fbdd1b83b80 1 -- 172.21.15.149:0/226300170 >> 172.21.15.149:0/226300170 conn(0x55ff5878d660 msgr2=0x55ff58817bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:07.684 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.653+0000 7fbdd1b83b80 1 -- 172.21.15.149:0/226300170 shutdown_connections 2023-11-08T19:28:07.684 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.653+0000 7fbdd1b83b80 1 -- 172.21.15.149:0/226300170 wait complete. 2023-11-08T19:28:07.685 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.653+0000 7fbdd1b83b80 20 client.7626 trim_cache size 0 max 16384 2023-11-08T19:28:07.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.672+0000 7fbdd1b83b80 1 Processor -- start 2023-11-08T19:28:07.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.672+0000 7fbdd1b83b80 1 -- start start 2023-11-08T19:28:07.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.673+0000 7fbdd1b83b80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55ff588126f0 0x55ff58817da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:07.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.673+0000 7fbdd1b83b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff58812ad0 0x55ff5886ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:07.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.673+0000 7fbdd1b83b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ff58856170 0x55ff5886f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:07.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.673+0000 7fbdd1b83b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff585ea8d0 con 0x55ff58856170 2023-11-08T19:28:07.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.673+0000 7fbdd1b83b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff5880a540 con 0x55ff58812ad0 2023-11-08T19:28:07.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.673+0000 7fbdd1b83b80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ff58815020 con 0x55ff588126f0 2023-11-08T19:28:07.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.673+0000 7fbdbf7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ff58856170 0x55ff5886f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:07.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.673+0000 7fbdbf7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ff58856170 0x55ff5886f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44378/0 (socket says 172.21.15.149:44378) 2023-11-08T19:28:07.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.673+0000 7fbdbf7fe700 1 -- 172.21.15.149:0/2239334974 learned_addr learned my addr 172.21.15.149:0/2239334974 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:28:07.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.673+0000 7fbdbe7fc700 1 --2- 172.21.15.149:0/2239334974 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff58812ad0 0x55ff5886ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:07.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.673+0000 7fbdbeffd700 1 --2- 172.21.15.149:0/2239334974 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55ff588126f0 0x55ff58817da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:07.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.674+0000 7fbdbf7fe700 1 -- 172.21.15.149:0/2239334974 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55ff588126f0 msgr2=0x55ff58817da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:07.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.674+0000 7fbdbf7fe700 1 --2- 172.21.15.149:0/2239334974 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55ff588126f0 0x55ff58817da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.674+0000 7fbdbf7fe700 1 -- 172.21.15.149:0/2239334974 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff58812ad0 msgr2=0x55ff5886ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:07.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.674+0000 7fbdbf7fe700 1 --2- 172.21.15.149:0/2239334974 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff58812ad0 0x55ff5886ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.674+0000 7fbdbf7fe700 1 -- 172.21.15.149:0/2239334974 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ff5857dc10 con 0x55ff58856170 2023-11-08T19:28:07.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.674+0000 7fbdbf7fe700 1 --2- 172.21.15.149:0/2239334974 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ff58856170 0x55ff5886f240 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x55ff58843590 tx=0x7fbdb8014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0c8670306a701fb server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:07.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.674+0000 7fbda5ffb700 1 -- 172.21.15.149:0/2239334974 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb8003a20 con 0x55ff58856170 2023-11-08T19:28:07.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.674+0000 7fbda5ffb700 1 -- 172.21.15.149:0/2239334974 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdb800bb80 con 0x55ff58856170 2023-11-08T19:28:07.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.674+0000 7fbda5ffb700 1 -- 172.21.15.149:0/2239334974 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb8030680 con 0x55ff58856170 2023-11-08T19:28:07.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.675+0000 7fbdd1b83b80 1 -- 172.21.15.149:0/2239334974 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ff58856170 msgr2=0x55ff5886f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:07.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.675+0000 7fbdd1b83b80 1 --2- 172.21.15.149:0/2239334974 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ff58856170 0x55ff5886f240 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x55ff58843590 tx=0x7fbdb8014040 comp rx=0 tx=0).stop 2023-11-08T19:28:07.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.675+0000 7fbdd1b83b80 1 -- 172.21.15.149:0/2239334974 shutdown_connections 2023-11-08T19:28:07.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.675+0000 7fbdd1b83b80 1 --2- 172.21.15.149:0/2239334974 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ff58856170 0x55ff5886f240 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.675+0000 7fbdd1b83b80 1 --2- 172.21.15.149:0/2239334974 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55ff588126f0 0x55ff58817da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.675+0000 7fbdd1b83b80 1 --2- 172.21.15.149:0/2239334974 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff58812ad0 0x55ff5886ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.675+0000 7fbdd1b83b80 1 -- 172.21.15.149:0/2239334974 >> 172.21.15.149:0/2239334974 conn(0x55ff5878d660 msgr2=0x55ff5880e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:07.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.675+0000 7fbdd1b83b80 1 -- 172.21.15.149:0/2239334974 shutdown_connections 2023-11-08T19:28:07.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.675+0000 7fbdd1b83b80 1 -- 172.21.15.149:0/2239334974 wait complete. 2023-11-08T19:28:07.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.675+0000 7fbdd1b83b80 1 -- start start 2023-11-08T19:28:07.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.676+0000 7fbdd1b83b80 1 Processor -- start 2023-11-08T19:28:07.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.677+0000 7fbdd1b83b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ff588126f0 0x55ff5886f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:07.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.677+0000 7fbdd1b83b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff58812ad0 0x55ff5882d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:07.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.677+0000 7fbdd1b83b80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55ff58856170 0x55ff5882df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:07.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.677+0000 7fbdd1b83b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff5885f1c0 con 0x55ff588126f0 2023-11-08T19:28:07.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.677+0000 7fbdd1b83b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff58818080 con 0x55ff58812ad0 2023-11-08T19:28:07.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.677+0000 7fbdd1b83b80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ff5886f600 con 0x55ff58856170 2023-11-08T19:28:07.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.677+0000 7fbdd1b83b80 10 client.0 _ll_register_callbacks cb 0x7fbdb000fd10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-08T19:28:07.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.677+0000 7fbdbeffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ff588126f0 0x55ff5886f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:07.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.677+0000 7fbdbeffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ff588126f0 0x55ff5886f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44380/0 (socket says 172.21.15.149:44380) 2023-11-08T19:28:07.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.677+0000 7fbdbeffd700 1 -- 172.21.15.149:0/2668547148 learned_addr learned my addr 172.21.15.149:0/2668547148 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:28:07.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.677+0000 7fbdbe7fc700 1 --2- 172.21.15.149:0/2668547148 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff58812ad0 0x55ff5882d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:07.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.677+0000 7fbdbf7fe700 1 --2- 172.21.15.149:0/2668547148 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55ff58856170 0x55ff5882df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:07.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.677+0000 7fbdbeffd700 1 -- 172.21.15.149:0/2668547148 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55ff58856170 msgr2=0x55ff5882df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:07.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.677+0000 7fbdbeffd700 1 --2- 172.21.15.149:0/2668547148 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55ff58856170 0x55ff5882df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.677+0000 7fbdbeffd700 1 -- 172.21.15.149:0/2668547148 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff58812ad0 msgr2=0x55ff5882d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:07.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.677+0000 7fbdbeffd700 1 --2- 172.21.15.149:0/2668547148 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff58812ad0 0x55ff5882d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.677+0000 7fbdbeffd700 1 -- 172.21.15.149:0/2668547148 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ff585e85e0 con 0x55ff588126f0 2023-11-08T19:28:07.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.677+0000 7fbdbeffd700 1 --2- 172.21.15.149:0/2668547148 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ff588126f0 0x55ff5886f0c0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7fbdb4054720 tx=0x7fbdb4089040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8904701860a748ac server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:07.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.677+0000 7fbd9e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2023-11-08T19:28:07.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.677+0000 7fbd9e7fc700 1 -- 172.21.15.149:0/2668547148 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb40565c0 con 0x55ff588126f0 2023-11-08T19:28:07.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.677+0000 7fbd9e7fc700 1 -- 172.21.15.149:0/2668547148 <== mon.0 v2:172.21.15.149:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 7350+0+0 (secure 0 0 0) 0x7fbdb4087e40 con 0x55ff588126f0 2023-11-08T19:28:07.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.677+0000 7fbdd1b83b80 1 -- 172.21.15.149:0/2668547148 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbdb8003b80 con 0x55ff588126f0 2023-11-08T19:28:07.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.678+0000 7fbd9e7fc700 1 -- 172.21.15.149:0/2668547148 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbdb4058480 con 0x55ff588126f0 2023-11-08T19:28:07.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.678+0000 7fbdd1b83b80 10 client.7632 fetch_fsmap learned FSMap version 75 2023-11-08T19:28:07.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.678+0000 7fbdd1b83b80 1 -- 172.21.15.149:0/2668547148 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=2+}) v3 -- 0x55ff585bb200 con 0x55ff588126f0 2023-11-08T19:28:07.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.678+0000 7fbd9e7fc700 1 -- 172.21.15.149:0/2668547148 <== mon.0 v2:172.21.15.149:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdb8003b80 con 0x55ff588126f0 2023-11-08T19:28:07.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.678+0000 7fbd9e7fc700 1 -- 172.21.15.149:0/2668547148 <== mon.0 v2:172.21.15.149:3300/0 5 ==== fsmap(e 75) v1 ==== 3306+0+0 (secure 0 0 0) 0x7fbdb4057710 con 0x55ff588126f0 2023-11-08T19:28:07.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.678+0000 7fbdd1b83b80 10 client.7632 fetch_fsmap finished waiting for FSMap version 75 2023-11-08T19:28:07.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.678+0000 7fbdd1b83b80 10 client.7632 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-08T19:28:07.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.678+0000 7fbdd1b83b80 20 client.7632 populate_metadata read hostname 'smithi149' 2023-11-08T19:28:07.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.678+0000 7fbdd1b83b80 1 --2- 172.21.15.149:0/2668547148 >> [v2:172.21.15.149:6835/3917392643,v1:172.21.15.149:6837/3917392643] conn(0x55ff58860d50 0x55ff58852de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:07.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.678+0000 7fbdd1b83b80 4 client.7632 mds_command: new command op to 7125 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-08T19:28:07.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.678+0000 7fbdd1b83b80 1 -- 172.21.15.149:0/2668547148 --> [v2:172.21.15.149:6835/3917392643,v1:172.21.15.149:6837/3917392643] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ff587645a0 con 0x55ff58860d50 2023-11-08T19:28:07.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.678+0000 7fbdbe7fc700 1 --2- 172.21.15.149:0/2668547148 >> [v2:172.21.15.149:6835/3917392643,v1:172.21.15.149:6837/3917392643] conn(0x55ff58860d50 0x55ff58852de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:07.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.678+0000 7fbd9e7fc700 10 client.7632 ms_handle_connect on v2:172.21.15.149:6835/3917392643 2023-11-08T19:28:07.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.678+0000 7fbdbe7fc700 1 --2- 172.21.15.149:0/2668547148 >> [v2:172.21.15.149:6835/3917392643,v1:172.21.15.149:6837/3917392643] conn(0x55ff58860d50 0x55ff58852de0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9ba1bfbe41e253c0 server_cookie=e1ef5cf64bc67aff in_seq=0 out_seq=0 2023-11-08T19:28:07.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.678+0000 7fbd9e7fc700 1 -- 172.21.15.149:0/2668547148 <== mds.1 v2:172.21.15.149:6835/3917392643 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x55ff587645a0 con 0x55ff58860d50 2023-11-08T19:28:07.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.678+0000 7fbd9e7fc700 10 client.7632 handle_command_reply: tid=0 2023-11-08T19:28:07.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.678+0000 7fbdd1b83b80 1 client.7632 shutdown 2023-11-08T19:28:07.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.679+0000 7fbdd1b83b80 1 -- 172.21.15.149:0/2668547148 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ff588126f0 msgr2=0x55ff5886f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:07.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.679+0000 7fbdd1b83b80 1 --2- 172.21.15.149:0/2668547148 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ff588126f0 0x55ff5886f0c0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7fbdb4054720 tx=0x7fbdb4089040 comp rx=0 tx=0).stop 2023-11-08T19:28:07.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.679+0000 7fbdd1b83b80 1 -- 172.21.15.149:0/2668547148 shutdown_connections 2023-11-08T19:28:07.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.679+0000 7fbdd1b83b80 1 --2- 172.21.15.149:0/2668547148 >> [v2:172.21.15.149:6835/3917392643,v1:172.21.15.149:6837/3917392643] conn(0x55ff58860d50 0x55ff58852de0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.679+0000 7fbdd1b83b80 1 --2- 172.21.15.149:0/2668547148 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55ff58856170 0x55ff5882df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.679+0000 7fbd9e7fc700 0 client.7632 ms_handle_reset on v2:172.21.15.149:6835/3917392643 2023-11-08T19:28:07.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.679+0000 7fbdd1b83b80 1 --2- 172.21.15.149:0/2668547148 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ff588126f0 0x55ff5886f0c0 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.679+0000 7fbdd1b83b80 1 --2- 172.21.15.149:0/2668547148 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff58812ad0 0x55ff5882d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.679+0000 7fbdd1b83b80 1 -- 172.21.15.149:0/2668547148 >> 172.21.15.149:0/2668547148 conn(0x55ff5878d660 msgr2=0x55ff58811500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:07.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.679+0000 7fbdd1b83b80 1 -- 172.21.15.149:0/2668547148 shutdown_connections 2023-11-08T19:28:07.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.679+0000 7fbdd1b83b80 1 -- 172.21.15.149:0/2668547148 wait complete. 2023-11-08T19:28:07.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.679+0000 7fbdd1b83b80 20 client.7632 trim_cache size 0 max 16384 2023-11-08T19:28:07.719 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2023-11-08T19:28:07.719 INFO:teuthology.orchestra.run.smithi149.stdout: "cluster_fsid": "0aba7c70-fe80-4446-a2f5-7502ac3adfb4", 2023-11-08T19:28:07.720 INFO:teuthology.orchestra.run.smithi149.stdout: "whoami": 1, 2023-11-08T19:28:07.720 INFO:teuthology.orchestra.run.smithi149.stdout: "id": 7125, 2023-11-08T19:28:07.720 INFO:teuthology.orchestra.run.smithi149.stdout: "want_state": "up:active", 2023-11-08T19:28:07.721 INFO:teuthology.orchestra.run.smithi149.stdout: "state": "up:active", 2023-11-08T19:28:07.721 INFO:teuthology.orchestra.run.smithi149.stdout: "fs_name": "cephfs", 2023-11-08T19:28:07.721 INFO:teuthology.orchestra.run.smithi149.stdout: "rank_uptime": 69.034647081000003, 2023-11-08T19:28:07.722 INFO:teuthology.orchestra.run.smithi149.stdout: "mdsmap_epoch": 75, 2023-11-08T19:28:07.722 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_epoch": 100, 2023-11-08T19:28:07.722 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_epoch_barrier": 100, 2023-11-08T19:28:07.723 INFO:teuthology.orchestra.run.smithi149.stdout: "uptime": 85.027604159999996 2023-11-08T19:28:07.723 INFO:teuthology.orchestra.run.smithi149.stdout:} 2023-11-08T19:28:07.725 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.679+0000 7fbdc598a700 1 -- 172.21.15.149:0/71996917 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fbdac06af00 msgr2=0x7fbdac06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:07.726 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.679+0000 7fbdc598a700 1 --2- 172.21.15.149:0/71996917 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fbdac06af00 0x7fbdac06d3c0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fbdc015c5c0 tx=0x7fbdb0009040 comp rx=0 tx=0).stop 2023-11-08T19:28:07.726 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.679+0000 7fbdc598a700 1 -- 172.21.15.149:0/71996917 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbdc006ab80 msgr2=0x7fbdc015aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:07.726 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.679+0000 7fbdc598a700 1 --2- 172.21.15.149:0/71996917 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbdc006ab80 0x7fbdc015aa90 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7fbdb400e870 tx=0x7fbdb400eb80 comp rx=0 tx=0).stop 2023-11-08T19:28:07.727 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.679+0000 7fbdc598a700 1 -- 172.21.15.149:0/71996917 shutdown_connections 2023-11-08T19:28:07.727 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.679+0000 7fbdc598a700 1 --2- 172.21.15.149:0/71996917 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fbdac06af00 0x7fbdac06d3c0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.727 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.679+0000 7fbdc598a700 1 --2- 172.21.15.149:0/71996917 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbdc015db70 0x7fbdc015b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.728 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.679+0000 7fbdc598a700 1 --2- 172.21.15.149:0/71996917 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbdc006ab80 0x7fbdc015aa90 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.728 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.679+0000 7fbdc598a700 1 --2- 172.21.15.149:0/71996917 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbdc00b2c00 0x7fbdc01f32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.728 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.679+0000 7fbdc598a700 1 -- 172.21.15.149:0/71996917 >> 172.21.15.149:0/71996917 conn(0x7fbdc00ccff0 msgr2=0x7fbdc015cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:07.729 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.679+0000 7fbdc598a700 1 -- 172.21.15.149:0/71996917 shutdown_connections 2023-11-08T19:28:07.729 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.680+0000 7fbdc598a700 1 -- 172.21.15.149:0/71996917 wait complete. 2023-11-08T19:28:07.730 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:28:07.852 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.851+0000 7f734e0f1700 1 Processor -- start 2023-11-08T19:28:07.853 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.851+0000 7f734e0f1700 1 -- start start 2023-11-08T19:28:07.855 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.852+0000 7f734e0f1700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f73480cd5e0 0x7f73480cfd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:07.856 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.852+0000 7f734e0f1700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f73480ce840 0x7f73480d0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:07.856 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.852+0000 7f734e0f1700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73480d07a0 con 0x7f734815b950 2023-11-08T19:28:07.856 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.852+0000 7f734e0f1700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73480cc2e0 con 0x7f73480cd5e0 2023-11-08T19:28:07.856 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.852+0000 7f734e0f1700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73480cc580 con 0x7f73480ce840 2023-11-08T19:28:07.857 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.853+0000 7f7346ffd700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f73480cd5e0 0x7f73480cfd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:07.857 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.853+0000 7f7347fff700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f73480ce840 0x7f73480d0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:07.857 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.853+0000 7f73477fe700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f734815b950 0x7f73480ce130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.149:58056/0 (socket says 172.21.15.149:58056) 2023-11-08T19:28:07.857 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.853+0000 7f73477fe700 1 -- 172.21.15.149:0/4193936271 learned_addr learned my addr 172.21.15.149:0/4193936271 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:28:07.858 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.853+0000 7f73467fc700 1 -- 172.21.15.149:0/4193936271 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1072107804 0 0) 0x7f73480d07a0 con 0x7f734815b950 2023-11-08T19:28:07.858 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.853+0000 7f73467fc700 1 -- 172.21.15.149:0/4193936271 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73340035b0 con 0x7f734815b950 2023-11-08T19:28:07.858 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.853+0000 7f7346ffd700 1 -- 172.21.15.149:0/4193936271 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f73480ce840 msgr2=0x7f73480d0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:07.859 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.853+0000 7f7346ffd700 1 --2- 172.21.15.149:0/4193936271 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f73480ce840 0x7f73480d0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.859 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.853+0000 7f7346ffd700 1 -- 172.21.15.149:0/4193936271 >> v1:172.21.15.160:6789/0 conn(0x7f734815b950 legacy=0x7f73480ce130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:07.859 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.853+0000 7f7346ffd700 1 -- 172.21.15.149:0/4193936271 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73480cc820 con 0x7f73480cd5e0 2023-11-08T19:28:07.859 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.853+0000 7f7346ffd700 1 --2- 172.21.15.149:0/4193936271 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f73480cd5e0 0x7f73480cfd20 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f7330009840 tx=0x7f7330009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8e8e70cc1918daf server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:07.860 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.853+0000 7f73467fc700 1 -- 172.21.15.149:0/4193936271 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7330011830 con 0x7f73480cd5e0 2023-11-08T19:28:07.860 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.854+0000 7f73467fc700 1 -- 172.21.15.149:0/4193936271 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7330011990 con 0x7f73480cd5e0 2023-11-08T19:28:07.860 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.854+0000 7f73467fc700 1 -- 172.21.15.149:0/4193936271 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7330011d20 con 0x7f73480cd5e0 2023-11-08T19:28:07.860 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.854+0000 7f734e0f1700 1 -- 172.21.15.149:0/4193936271 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f73480cd5e0 msgr2=0x7f73480cfd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:07.860 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.854+0000 7f734e0f1700 1 --2- 172.21.15.149:0/4193936271 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f73480cd5e0 0x7f73480cfd20 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f7330009840 tx=0x7f7330009b50 comp rx=0 tx=0).stop 2023-11-08T19:28:07.861 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.854+0000 7f734e0f1700 1 -- 172.21.15.149:0/4193936271 shutdown_connections 2023-11-08T19:28:07.864 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.854+0000 7f734e0f1700 1 --2- 172.21.15.149:0/4193936271 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f73480ce840 0x7f73480d0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.864 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.854+0000 7f734e0f1700 1 --2- 172.21.15.149:0/4193936271 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f73480cd5e0 0x7f73480cfd20 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.864 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.854+0000 7f734e0f1700 1 -- 172.21.15.149:0/4193936271 >> 172.21.15.149:0/4193936271 conn(0x7f734808afd0 msgr2=0x7f73480d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:07.864 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.854+0000 7f734e0f1700 1 -- 172.21.15.149:0/4193936271 shutdown_connections 2023-11-08T19:28:07.865 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.854+0000 7f734e0f1700 1 -- 172.21.15.149:0/4193936271 wait complete. 2023-11-08T19:28:07.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.855+0000 7f734e0f1700 1 Processor -- start 2023-11-08T19:28:07.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.855+0000 7f734e0f1700 1 -- start start 2023-11-08T19:28:07.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.856+0000 7f734e0f1700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f73480ce840 0x7f734815d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:07.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.856+0000 7f734e0f1700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f734815b950 0x7f73481f6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:07.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.856+0000 7f734e0f1700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73480b3d90 0x7f73481f7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:07.869 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.856+0000 7f734e0f1700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73480c6570 con 0x7f73480b3d90 2023-11-08T19:28:07.869 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.856+0000 7f734e0f1700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73481f7570 con 0x7f734815b950 2023-11-08T19:28:07.870 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.856+0000 7f734e0f1700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f734815e240 con 0x7f73480ce840 2023-11-08T19:28:07.870 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.856+0000 7f7346ffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f734815b950 0x7f73481f6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:07.870 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.856+0000 7f7347fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73480b3d90 0x7f73481f7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:07.871 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.856+0000 7f73477fe700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f73480ce840 0x7f734815d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:07.871 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.856+0000 7f7346ffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f734815b950 0x7f73481f6af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.149:45388/0 (socket says 172.21.15.149:45388) 2023-11-08T19:28:07.872 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.856+0000 7f7347fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73480b3d90 0x7f73481f7030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44398/0 (socket says 172.21.15.149:44398) 2023-11-08T19:28:07.872 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.856+0000 7f73477fe700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f73480ce840 0x7f734815d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.149:36450/0 (socket says 172.21.15.149:36450) 2023-11-08T19:28:07.872 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.856+0000 7f7346ffd700 1 -- 172.21.15.149:0/2726334890 learned_addr learned my addr 172.21.15.149:0/2726334890 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:28:07.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.857+0000 7f7347fff700 1 -- 172.21.15.149:0/2726334890 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f73480ce840 msgr2=0x7f734815d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:07.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.857+0000 7f7347fff700 1 --2- 172.21.15.149:0/2726334890 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f73480ce840 0x7f734815d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.857+0000 7f7347fff700 1 -- 172.21.15.149:0/2726334890 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f734815b950 msgr2=0x7f73481f6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:07.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.857+0000 7f7347fff700 1 --2- 172.21.15.149:0/2726334890 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f734815b950 0x7f73481f6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:07.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.857+0000 7f7347fff700 1 -- 172.21.15.149:0/2726334890 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73300094a0 con 0x7f73480b3d90 2023-11-08T19:28:07.874 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.857+0000 7f7347fff700 1 --2- 172.21.15.149:0/2726334890 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73480b3d90 0x7f73481f7030 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f73480b0fa0 tx=0x7f734000ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:07.874 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.857+0000 7f733ffff700 1 -- 172.21.15.149:0/2726334890 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f734000cc20 con 0x7f73480b3d90 2023-11-08T19:28:07.874 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.857+0000 7f733ffff700 1 -- 172.21.15.149:0/2726334890 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f734000f040 con 0x7f73480b3d90 2023-11-08T19:28:07.874 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.857+0000 7f734e0f1700 1 -- 172.21.15.149:0/2726334890 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f734815e520 con 0x7f73480b3d90 2023-11-08T19:28:07.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.857+0000 7f733ffff700 1 -- 172.21.15.149:0/2726334890 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7340009e60 con 0x7f73480b3d90 2023-11-08T19:28:07.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.857+0000 7f734e0f1700 1 -- 172.21.15.149:0/2726334890 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73480c6ad0 con 0x7f73480b3d90 2023-11-08T19:28:07.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.858+0000 7f734e0f1700 1 -- 172.21.15.149:0/2726334890 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73480c6cf0 con 0x7f73480b3d90 2023-11-08T19:28:07.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.859+0000 7f733ffff700 1 -- 172.21.15.149:0/2726334890 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7340014480 con 0x7f73480b3d90 2023-11-08T19:28:07.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.859+0000 7f733ffff700 1 --2- 172.21.15.149:0/2726334890 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f732806af00 0x7f732806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:07.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.859+0000 7f733ffff700 1 -- 172.21.15.149:0/2726334890 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7350+0+0 (secure 0 0 0) 0x7f734008a640 con 0x7f73480b3d90 2023-11-08T19:28:07.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.859+0000 7f73477fe700 1 --2- 172.21.15.149:0/2726334890 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f732806af00 0x7f732806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:07.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.859+0000 7f73477fe700 1 --2- 172.21.15.149:0/2726334890 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f732806af00 0x7f732806d3c0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f7338001230 tx=0x7f7338007df0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:07.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:07.864+0000 7f733ffff700 1 -- 172.21.15.149:0/2726334890 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7340055110 con 0x7f73480b3d90 2023-11-08T19:28:08.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.097+0000 7f734e0f1700 1 -- 172.21.15.149:0/2726334890 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f73480745f0 con 0x7f73480b3d90 2023-11-08T19:28:08.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.098+0000 7f733ffff700 1 -- 172.21.15.149:0/2726334890 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+4938 (secure 0 0 0) 0x7f7340058730 con 0x7f73480b3d90 2023-11-08T19:28:08.099 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:28:08.100 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":75,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6095,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/852710262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":852710262},{"type":"v1","addr":"172.21.15.160:6835","nonce":852710262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64},{"gid":7578,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/295381437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":295381437},{"type":"v1","addr":"172.21.15.149:6836","nonce":295381437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:28:03.760142+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6451,"mds_1":7125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6451":{"gid":6451,"name":"d","rank":0,"incarnation":71,"state":"up:active","state_seq":24,"addr":"172.21.15.160:6834/2947079163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2947079163},{"type":"v1","addr":"172.21.15.160:6834","nonce":2947079163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7125":{"gid":7125,"name":"c","rank":1,"incarnation":57,"state":"up:active","state_seq":6,"addr":"172.21.15.149:6837/3917392643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3917392643},{"type":"v1","addr":"172.21.15.149:6837","nonce":3917392643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:28:08.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.100+0000 7f734e0f1700 1 -- 172.21.15.149:0/2726334890 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f732806af00 msgr2=0x7f732806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:08.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.100+0000 7f734e0f1700 1 --2- 172.21.15.149:0/2726334890 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f732806af00 0x7f732806d3c0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f7338001230 tx=0x7f7338007df0 comp rx=0 tx=0).stop 2023-11-08T19:28:08.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.100+0000 7f734e0f1700 1 -- 172.21.15.149:0/2726334890 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73480b3d90 msgr2=0x7f73481f7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:08.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.100+0000 7f734e0f1700 1 --2- 172.21.15.149:0/2726334890 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73480b3d90 0x7f73481f7030 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f73480b0fa0 tx=0x7f734000ef90 comp rx=0 tx=0).stop 2023-11-08T19:28:08.103 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.100+0000 7f734e0f1700 1 -- 172.21.15.149:0/2726334890 shutdown_connections 2023-11-08T19:28:08.103 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.100+0000 7f734e0f1700 1 --2- 172.21.15.149:0/2726334890 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f732806af00 0x7f732806d3c0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:08.103 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.100+0000 7f734e0f1700 1 --2- 172.21.15.149:0/2726334890 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73480b3d90 0x7f73481f7030 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:08.103 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.100+0000 7f734e0f1700 1 --2- 172.21.15.149:0/2726334890 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f73480ce840 0x7f734815d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:08.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.100+0000 7f734e0f1700 1 --2- 172.21.15.149:0/2726334890 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f734815b950 0x7f73481f6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:08.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.100+0000 7f734e0f1700 1 -- 172.21.15.149:0/2726334890 >> 172.21.15.149:0/2726334890 conn(0x7f734808afd0 msgr2=0x7f734815f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:08.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.100+0000 7f734e0f1700 1 -- 172.21.15.149:0/2726334890 shutdown_connections 2023-11-08T19:28:08.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.100+0000 7f734e0f1700 1 -- 172.21.15.149:0/2726334890 wait complete. 2023-11-08T19:28:08.105 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 75 2023-11-08T19:28:08.114 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json dump snaps --server 2023-11-08T19:28:08.264 INFO:teuthology.orchestra.run.smithi160.stdout:{"last_snap":3,"last_created":3,"last_destroyed":1,"pending_noop":[],"snaps":[{"snapid":2,"ino":1099511627777,"stamp":"2023-11-08T19:27:11.331978+0000","name":"s11","metadata":{}},{"snapid":3,"ino":1099511627777,"stamp":"2023-11-08T19:27:43.330783+0000","name":"s12","metadata":{}}],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-08T19:28:08.264 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 3, "last_destroyed": 1, "last_snap": 3, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s11", "snapid": 2, "stamp": "2023-11-08T19:27:11.331978+0000" }, { "ino": 1099511627777, "metadata": {}, "name": "s12", "snapid": 3, "stamp": "2023-11-08T19:27:43.330783+0000" } ] } 2023-11-08T19:28:08.265 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-11-08T19:28:08.265 INFO:tasks.cephfs.test_snapshots:testing snapserver mds_kill_mdstable_at=5 2023-11-08T19:28:08.265 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:28:08.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.385+0000 7f79a7ee0700 1 Processor -- start 2023-11-08T19:28:08.387 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.386+0000 7f79a7ee0700 1 -- start start 2023-11-08T19:28:08.389 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.386+0000 7f79a7ee0700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f79a00b16b0 0x7f79a00ce380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:08.390 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.386+0000 7f79a7ee0700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f79a00b20b0 0x7f79a00b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:08.390 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.386+0000 7f79a7ee0700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79a00d1330 con 0x7f79a00afb30 2023-11-08T19:28:08.390 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.386+0000 7f79a7ee0700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79a00b2aa0 con 0x7f79a00b20b0 2023-11-08T19:28:08.390 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.386+0000 7f79a7ee0700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a00cb490 con 0x7f79a00b16b0 2023-11-08T19:28:08.390 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.386+0000 7f79a647d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f79a00b20b0 0x7f79a00b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:08.391 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.387+0000 7f79a5c7c700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f79a00afb30 0x7f79a00cbf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:46404/0 (socket says 172.21.15.149:46404) 2023-11-08T19:28:08.391 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.387+0000 7f79a5c7c700 1 -- 172.21.15.149:0/2880038589 learned_addr learned my addr 172.21.15.149:0/2880038589 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:28:08.391 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.387+0000 7f79a547b700 1 --2- 172.21.15.149:0/2880038589 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f79a00b16b0 0x7f79a00ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:08.391 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.387+0000 7f79a4c7a700 1 -- 172.21.15.149:0/2880038589 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 437873875 0 0) 0x7f79a00d1330 con 0x7f79a00afb30 2023-11-08T19:28:08.391 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.387+0000 7f79a4c7a700 1 -- 172.21.15.149:0/2880038589 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f798c0035b0 con 0x7f79a00afb30 2023-11-08T19:28:08.392 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.387+0000 7f79a647d700 1 -- 172.21.15.149:0/2880038589 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f79a00b16b0 msgr2=0x7f79a00ce380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:08.392 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.387+0000 7f79a647d700 1 --2- 172.21.15.149:0/2880038589 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f79a00b16b0 0x7f79a00ce380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:08.392 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.387+0000 7f79a647d700 1 -- 172.21.15.149:0/2880038589 >> v1:172.21.15.149:6789/0 conn(0x7f79a00afb30 legacy=0x7f79a00cbf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:08.392 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.387+0000 7f79a647d700 1 -- 172.21.15.149:0/2880038589 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a00cb770 con 0x7f79a00b20b0 2023-11-08T19:28:08.392 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.387+0000 7f79a647d700 1 --2- 172.21.15.149:0/2880038589 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f79a00b20b0 0x7f79a00b2560 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f799800bfa0 tx=0x7f799800d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3da658e271925b82 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:08.393 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.387+0000 7f79a4c7a700 1 -- 172.21.15.149:0/2880038589 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7998010070 con 0x7f79a00b20b0 2023-11-08T19:28:08.393 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.387+0000 7f79a4c7a700 1 -- 172.21.15.149:0/2880038589 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f799800b2e0 con 0x7f79a00b20b0 2023-11-08T19:28:08.393 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.387+0000 7f79a4c7a700 1 -- 172.21.15.149:0/2880038589 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799800dc40 con 0x7f79a00b20b0 2023-11-08T19:28:08.393 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.388+0000 7f79a7ee0700 1 -- 172.21.15.149:0/2880038589 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f79a00b20b0 msgr2=0x7f79a00b2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:08.393 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.388+0000 7f79a7ee0700 1 --2- 172.21.15.149:0/2880038589 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f79a00b20b0 0x7f79a00b2560 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f799800bfa0 tx=0x7f799800d330 comp rx=0 tx=0).stop 2023-11-08T19:28:08.394 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.388+0000 7f79a7ee0700 1 -- 172.21.15.149:0/2880038589 shutdown_connections 2023-11-08T19:28:08.394 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.388+0000 7f79a7ee0700 1 --2- 172.21.15.149:0/2880038589 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f79a00b20b0 0x7f79a00b2560 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:08.394 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.388+0000 7f79a7ee0700 1 --2- 172.21.15.149:0/2880038589 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f79a00b16b0 0x7f79a00ce380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:08.394 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.388+0000 7f79a7ee0700 1 -- 172.21.15.149:0/2880038589 >> 172.21.15.149:0/2880038589 conn(0x7f79a0099a40 msgr2=0x7f79a00d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:08.394 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.388+0000 7f79a7ee0700 1 -- 172.21.15.149:0/2880038589 shutdown_connections 2023-11-08T19:28:08.395 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.388+0000 7f79a7ee0700 1 -- 172.21.15.149:0/2880038589 wait complete. 2023-11-08T19:28:08.397 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.389+0000 7f79a7ee0700 1 Processor -- start 2023-11-08T19:28:08.397 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.389+0000 7f79a7ee0700 1 -- start start 2023-11-08T19:28:08.398 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.390+0000 7f79a7ee0700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f79a00afb30 0x7f79a015bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:08.398 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.390+0000 7f79a7ee0700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f79a00b16b0 0x7f79a00c4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:08.398 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.390+0000 7f79a7ee0700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79a00b20b0 0x7f79a01ef610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:08.398 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.390+0000 7f79a7ee0700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a00b46f0 con 0x7f79a00b16b0 2023-11-08T19:28:08.399 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.390+0000 7f79a7ee0700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a00b49d0 con 0x7f79a00b20b0 2023-11-08T19:28:08.399 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.390+0000 7f79a7ee0700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a00b4cb0 con 0x7f79a00afb30 2023-11-08T19:28:08.399 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.390+0000 7f79a547b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f79a00b16b0 0x7f79a00c4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:08.399 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.390+0000 7f79a547b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f79a00b16b0 0x7f79a00c4a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44410/0 (socket says 172.21.15.149:44410) 2023-11-08T19:28:08.399 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.390+0000 7f79a547b700 1 -- 172.21.15.149:0/803802013 learned_addr learned my addr 172.21.15.149:0/803802013 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:28:08.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.390+0000 7f79a5c7c700 1 --2- 172.21.15.149:0/803802013 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f79a00afb30 0x7f79a015bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:08.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.390+0000 7f79a647d700 1 --2- 172.21.15.149:0/803802013 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79a00b20b0 0x7f79a01ef610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:08.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.390+0000 7f79a547b700 1 -- 172.21.15.149:0/803802013 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f79a00afb30 msgr2=0x7f79a015bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:08.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.390+0000 7f79a547b700 1 --2- 172.21.15.149:0/803802013 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f79a00afb30 0x7f79a015bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:08.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.390+0000 7f79a547b700 1 -- 172.21.15.149:0/803802013 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79a00b20b0 msgr2=0x7f79a01ef610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:08.401 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.390+0000 7f79a547b700 1 --2- 172.21.15.149:0/803802013 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79a00b20b0 0x7f79a01ef610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:08.401 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.390+0000 7f79a547b700 1 -- 172.21.15.149:0/803802013 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f799800bc80 con 0x7f79a00b16b0 2023-11-08T19:28:08.401 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.390+0000 7f79a647d700 1 --2- 172.21.15.149:0/803802013 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79a00b20b0 0x7f79a01ef610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:28:08.401 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.390+0000 7f79a547b700 1 --2- 172.21.15.149:0/803802013 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f79a00b16b0 0x7f79a00c4a00 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f799c00e840 tx=0x7f799c00eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:08.401 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.390+0000 7f79967fc700 1 -- 172.21.15.149:0/803802013 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799c009590 con 0x7f79a00b16b0 2023-11-08T19:28:08.402 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.391+0000 7f79967fc700 1 -- 172.21.15.149:0/803802013 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f799c013680 con 0x7f79a00b16b0 2023-11-08T19:28:08.402 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.391+0000 7f79a7ee0700 1 -- 172.21.15.149:0/803802013 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79a00b4f90 con 0x7f79a00b16b0 2023-11-08T19:28:08.402 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.391+0000 7f79967fc700 1 -- 172.21.15.149:0/803802013 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799c013a30 con 0x7f79a00b16b0 2023-11-08T19:28:08.402 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.391+0000 7f79a7ee0700 1 -- 172.21.15.149:0/803802013 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79a00c4f40 con 0x7f79a00b16b0 2023-11-08T19:28:08.402 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.391+0000 7f79a7ee0700 1 -- 172.21.15.149:0/803802013 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79a00745f0 con 0x7f79a00b16b0 2023-11-08T19:28:08.403 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.392+0000 7f79967fc700 1 -- 172.21.15.149:0/803802013 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f799c013b90 con 0x7f79a00b16b0 2023-11-08T19:28:08.403 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.392+0000 7f79967fc700 1 --2- 172.21.15.149:0/803802013 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f798406af00 0x7f798406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:08.403 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.392+0000 7f79967fc700 1 -- 172.21.15.149:0/803802013 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7350+0+0 (secure 0 0 0) 0x7f799c089b20 con 0x7f79a00b16b0 2023-11-08T19:28:08.403 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.392+0000 7f79a5c7c700 1 --2- 172.21.15.149:0/803802013 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f798406af00 0x7f798406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:08.403 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.393+0000 7f79a5c7c700 1 --2- 172.21.15.149:0/803802013 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f798406af00 0x7f798406d3c0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f79900010e0 tx=0x7f7990007c70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:08.404 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.397+0000 7f79967fc700 1 -- 172.21.15.149:0/803802013 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f799c054560 con 0x7f79a00b16b0 2023-11-08T19:28:08.430 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T19:28:08.433 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T19:28:08.572 INFO:tasks.ceph.mds.d.smithi160.stderr:2023-11-08T19:28:08.570+0000 7f8de381e700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-08T19:28:08.572 INFO:tasks.ceph.mds.d.smithi160.stderr:2023-11-08T19:28:08.570+0000 7f8de381e700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-08T19:28:08.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.638+0000 7f79a7ee0700 1 -- 172.21.15.149:0/803802013 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f79a00b2880 con 0x7f79a00b16b0 2023-11-08T19:28:08.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.638+0000 7f79967fc700 1 -- 172.21.15.149:0/803802013 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+4938 (secure 0 0 0) 0x7f799c057b80 con 0x7f79a00b16b0 2023-11-08T19:28:08.640 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:28:08.640 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":75,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6095,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/852710262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":852710262},{"type":"v1","addr":"172.21.15.160:6835","nonce":852710262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64},{"gid":7578,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/295381437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":295381437},{"type":"v1","addr":"172.21.15.149:6836","nonce":295381437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:28:03.760142+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6451,"mds_1":7125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6451":{"gid":6451,"name":"d","rank":0,"incarnation":71,"state":"up:active","state_seq":24,"addr":"172.21.15.160:6834/2947079163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2947079163},{"type":"v1","addr":"172.21.15.160:6834","nonce":2947079163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7125":{"gid":7125,"name":"c","rank":1,"incarnation":57,"state":"up:active","state_seq":6,"addr":"172.21.15.149:6837/3917392643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3917392643},{"type":"v1","addr":"172.21.15.149:6837","nonce":3917392643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:28:08.642 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.641+0000 7f79a7ee0700 1 -- 172.21.15.149:0/803802013 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f798406af00 msgr2=0x7f798406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:08.642 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.641+0000 7f79a7ee0700 1 --2- 172.21.15.149:0/803802013 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f798406af00 0x7f798406d3c0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f79900010e0 tx=0x7f7990007c70 comp rx=0 tx=0).stop 2023-11-08T19:28:08.643 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.641+0000 7f79a7ee0700 1 -- 172.21.15.149:0/803802013 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f79a00b16b0 msgr2=0x7f79a00c4a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:08.643 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.641+0000 7f79a7ee0700 1 --2- 172.21.15.149:0/803802013 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f79a00b16b0 0x7f79a00c4a00 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f799c00e840 tx=0x7f799c00eb50 comp rx=0 tx=0).stop 2023-11-08T19:28:08.643 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.641+0000 7f79a7ee0700 1 -- 172.21.15.149:0/803802013 shutdown_connections 2023-11-08T19:28:08.643 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.641+0000 7f79a7ee0700 1 --2- 172.21.15.149:0/803802013 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f798406af00 0x7f798406d3c0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:08.643 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.641+0000 7f79a7ee0700 1 --2- 172.21.15.149:0/803802013 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79a00b20b0 0x7f79a01ef610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:08.644 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.641+0000 7f79a7ee0700 1 --2- 172.21.15.149:0/803802013 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f79a00afb30 0x7f79a015bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:08.644 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.641+0000 7f79a7ee0700 1 --2- 172.21.15.149:0/803802013 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f79a00b16b0 0x7f79a00c4a00 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:08.644 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.641+0000 7f79a7ee0700 1 -- 172.21.15.149:0/803802013 >> 172.21.15.149:0/803802013 conn(0x7f79a0099a40 msgr2=0x7f79a00cbe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:08.644 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.641+0000 7f79a7ee0700 1 -- 172.21.15.149:0/803802013 shutdown_connections 2023-11-08T19:28:08.644 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.641+0000 7f79a7ee0700 1 -- 172.21.15.149:0/803802013 wait complete. 2023-11-08T19:28:08.645 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 75 2023-11-08T19:28:08.654 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:0 true 2023-11-08T19:28:08.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.776+0000 7fb7d87cd700 1 Processor -- start 2023-11-08T19:28:08.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.776+0000 7fb7d87cd700 1 -- start start 2023-11-08T19:28:08.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.777+0000 7fb7d87cd700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fb7d015abf0 0x7fb7d00b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:08.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.777+0000 7fb7d87cd700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb7d00cc870 0x7fb7d006bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:08.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.777+0000 7fb7d87cd700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7d00b6470 con 0x7fb7d00d1130 2023-11-08T19:28:08.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.777+0000 7fb7d87cd700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7d00b66a0 con 0x7fb7d015abf0 2023-11-08T19:28:08.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.777+0000 7fb7d87cd700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d00d04a0 con 0x7fb7d00cc870 2023-11-08T19:28:08.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.777+0000 7fb7d5d68700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fb7d00d1130 0x7fb7d00cc160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:46418/0 (socket says 172.21.15.149:46418) 2023-11-08T19:28:08.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.777+0000 7fb7d5d68700 1 -- 172.21.15.149:0/902310818 learned_addr learned my addr 172.21.15.149:0/902310818 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:28:08.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.778+0000 7fb7d6569700 1 --2- 172.21.15.149:0/902310818 >> v2:172.21.15.160:3300/0 conn(0x7fb7d015abf0 0x7fb7d00b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:08.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.778+0000 7fb7d6d6a700 1 --2- 172.21.15.149:0/902310818 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb7d00cc870 0x7fb7d006bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:08.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.778+0000 7fb7d5567700 1 -- 172.21.15.149:0/902310818 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3097603224 0 0) 0x7fb7d00b6470 con 0x7fb7d00d1130 2023-11-08T19:28:08.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.778+0000 7fb7d5567700 1 -- 172.21.15.149:0/902310818 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7bc0035b0 con 0x7fb7d00d1130 2023-11-08T19:28:08.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.778+0000 7fb7d5567700 1 -- 172.21.15.149:0/902310818 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2760441317 0 0) 0x7fb7bc0035b0 con 0x7fb7d00d1130 2023-11-08T19:28:08.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.778+0000 7fb7d5567700 1 -- 172.21.15.149:0/902310818 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb7d00cc870 msgr2=0x7fb7d006bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:08.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.778+0000 7fb7d5567700 1 --2- 172.21.15.149:0/902310818 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb7d00cc870 0x7fb7d006bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:08.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.778+0000 7fb7d5567700 1 -- 172.21.15.149:0/902310818 >> v2:172.21.15.160:3300/0 conn(0x7fb7d015abf0 msgr2=0x7fb7d00b5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:08.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.778+0000 7fb7d5567700 1 --2- 172.21.15.149:0/902310818 >> v2:172.21.15.160:3300/0 conn(0x7fb7d015abf0 0x7fb7d00b5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:08.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.778+0000 7fb7d5567700 1 -- 172.21.15.149:0/902310818 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d015afd0 con 0x7fb7d00d1130 2023-11-08T19:28:08.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.778+0000 7fb7d5567700 1 -- 172.21.15.149:0/902310818 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7fb7cc001670 con 0x7fb7d00d1130 2023-11-08T19:28:08.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.778+0000 7fb7d5567700 1 -- 172.21.15.149:0/902310818 >> v1:172.21.15.149:6789/0 conn(0x7fb7d00d1130 legacy=0x7fb7d00cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:08.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.778+0000 7fb7d5567700 1 --2- 172.21.15.149:0/902310818 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb7d00cc870 0x7fb7bc003a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:08.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.778+0000 7fb7d5567700 1 --2- 172.21.15.149:0/902310818 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7bc003ff0 0x7fb7bc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:08.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.778+0000 7fb7d5567700 1 --2- 172.21.15.149:0/902310818 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb7bc004d90 0x7fb7bc005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:08.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.778+0000 7fb7d5567700 1 -- 172.21.15.149:0/902310818 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d00b66a0 con 0x7fb7bc003ff0 2023-11-08T19:28:08.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.778+0000 7fb7d5567700 1 -- 172.21.15.149:0/902310818 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d00d04a0 con 0x7fb7bc004d90 2023-11-08T19:28:08.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.778+0000 7fb7d5567700 1 -- 172.21.15.149:0/902310818 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7bc00bac0 con 0x7fb7d00cc870 2023-11-08T19:28:08.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.778+0000 7fb7d5d68700 1 --2- 172.21.15.149:0/902310818 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7bc003ff0 0x7fb7bc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:08.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.778+0000 7fb7d6569700 1 --2- 172.21.15.149:0/902310818 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb7d00cc870 0x7fb7bc003a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:08.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.778+0000 7fb7d6d6a700 1 --2- 172.21.15.149:0/902310818 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb7bc004d90 0x7fb7bc005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:08.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.778+0000 7fb7d6569700 1 -- 172.21.15.149:0/902310818 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb7bc004d90 msgr2=0x7fb7bc005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:08.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.778+0000 7fb7d6569700 1 --2- 172.21.15.149:0/902310818 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb7bc004d90 0x7fb7bc005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:08.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.778+0000 7fb7d6569700 1 -- 172.21.15.149:0/902310818 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7bc003ff0 msgr2=0x7fb7bc004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:08.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.778+0000 7fb7d6569700 1 --2- 172.21.15.149:0/902310818 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7bc003ff0 0x7fb7bc004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:08.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.778+0000 7fb7d6569700 1 -- 172.21.15.149:0/902310818 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7bc0035b0 con 0x7fb7d00cc870 2023-11-08T19:28:08.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.778+0000 7fb7d5d68700 1 --2- 172.21.15.149:0/902310818 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7bc003ff0 0x7fb7bc004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:28:08.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.778+0000 7fb7d6d6a700 1 --2- 172.21.15.149:0/902310818 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb7bc004d90 0x7fb7bc005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:28:08.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.779+0000 7fb7d6569700 1 --2- 172.21.15.149:0/902310818 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb7d00cc870 0x7fb7bc003a70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb7c0009b60 tx=0x7fb7bc005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9cd8fb2c5f42cccb server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:08.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.779+0000 7fb7d5567700 1 -- 172.21.15.149:0/902310818 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c000e6c0 con 0x7fb7d00cc870 2023-11-08T19:28:08.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.779+0000 7fb7d5567700 1 -- 172.21.15.149:0/902310818 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7c000e820 con 0x7fb7d00cc870 2023-11-08T19:28:08.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.779+0000 7fb7d5567700 1 -- 172.21.15.149:0/902310818 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c000eb90 con 0x7fb7d00cc870 2023-11-08T19:28:08.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.779+0000 7fb7d87cd700 1 -- 172.21.15.149:0/902310818 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb7d00cc870 msgr2=0x7fb7bc003a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:08.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.779+0000 7fb7d87cd700 1 --2- 172.21.15.149:0/902310818 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb7d00cc870 0x7fb7bc003a70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb7c0009b60 tx=0x7fb7bc005880 comp rx=0 tx=0).stop 2023-11-08T19:28:08.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.779+0000 7fb7d6d6a700 1 -- 172.21.15.149:0/902310818 reap_dead start 2023-11-08T19:28:08.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.779+0000 7fb7d87cd700 1 -- 172.21.15.149:0/902310818 shutdown_connections 2023-11-08T19:28:08.791 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.779+0000 7fb7d87cd700 1 -- 172.21.15.149:0/902310818 >> 172.21.15.149:0/902310818 conn(0x7fb7d00d0640 msgr2=0x7fb7d00d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:08.791 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.779+0000 7fb7d87cd700 1 -- 172.21.15.149:0/902310818 shutdown_connections 2023-11-08T19:28:08.791 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.779+0000 7fb7d87cd700 1 -- 172.21.15.149:0/902310818 wait complete. 2023-11-08T19:28:08.791 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.781+0000 7fb7d87cd700 1 Processor -- start 2023-11-08T19:28:08.791 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.781+0000 7fb7d87cd700 1 -- start start 2023-11-08T19:28:08.794 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.782+0000 7fb7d87cd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb7d00cc870 0x7fb7d0157ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:08.794 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.782+0000 7fb7d87cd700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb7d0159af0 0x7fb7d0159f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:08.795 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.782+0000 7fb7d87cd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7d015d5d0 0x7fb7d015da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:08.795 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.782+0000 7fb7d87cd700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d015a4b0 con 0x7fb7d015d5d0 2023-11-08T19:28:08.795 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.782+0000 7fb7d87cd700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d0158000 con 0x7fb7d00cc870 2023-11-08T19:28:08.795 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.782+0000 7fb7d87cd700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d015df90 con 0x7fb7d0159af0 2023-11-08T19:28:08.795 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.782+0000 7fb7d6d6a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7d015d5d0 0x7fb7d015da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:08.796 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.782+0000 7fb7d5d68700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb7d0159af0 0x7fb7d0159f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:08.796 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.782+0000 7fb7d6569700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb7d00cc870 0x7fb7d0157ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:08.796 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.782+0000 7fb7d6d6a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7d015d5d0 0x7fb7d015da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44430/0 (socket says 172.21.15.149:44430) 2023-11-08T19:28:08.796 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.782+0000 7fb7d6d6a700 1 -- 172.21.15.149:0/3814960640 learned_addr learned my addr 172.21.15.149:0/3814960640 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:28:08.796 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.782+0000 7fb7d6d6a700 1 -- 172.21.15.149:0/3814960640 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb7d0159af0 msgr2=0x7fb7d0159f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:08.797 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.782+0000 7fb7d6d6a700 1 --2- 172.21.15.149:0/3814960640 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb7d0159af0 0x7fb7d0159f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:08.797 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.782+0000 7fb7d6d6a700 1 -- 172.21.15.149:0/3814960640 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb7d00cc870 msgr2=0x7fb7d0157ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:08.797 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.782+0000 7fb7d6d6a700 1 --2- 172.21.15.149:0/3814960640 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb7d00cc870 0x7fb7d0157ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:08.797 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.782+0000 7fb7d6d6a700 1 -- 172.21.15.149:0/3814960640 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d00b3e50 con 0x7fb7d015d5d0 2023-11-08T19:28:08.797 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.782+0000 7fb7d5d68700 1 --2- 172.21.15.149:0/3814960640 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb7d0159af0 0x7fb7d0159f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:28:08.798 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.782+0000 7fb7d6569700 1 --2- 172.21.15.149:0/3814960640 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb7d00cc870 0x7fb7d0157ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:28:08.798 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.783+0000 7fb7d6d6a700 1 --2- 172.21.15.149:0/3814960640 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7d015d5d0 0x7fb7d015da50 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7fb7d006d970 tx=0x7fb7c800f490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:08.798 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.783+0000 7fb7c6ffd700 1 -- 172.21.15.149:0/3814960640 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c801c070 con 0x7fb7d015d5d0 2023-11-08T19:28:08.798 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.783+0000 7fb7c6ffd700 1 -- 172.21.15.149:0/3814960640 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7c800f040 con 0x7fb7d015d5d0 2023-11-08T19:28:08.798 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.783+0000 7fb7c6ffd700 1 -- 172.21.15.149:0/3814960640 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c800e040 con 0x7fb7d015d5d0 2023-11-08T19:28:08.799 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.783+0000 7fb7d87cd700 1 -- 172.21.15.149:0/3814960640 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7d00b4130 con 0x7fb7d015d5d0 2023-11-08T19:28:08.799 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.783+0000 7fb7d87cd700 1 -- 172.21.15.149:0/3814960640 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7d00b46f0 con 0x7fb7d015d5d0 2023-11-08T19:28:08.799 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.784+0000 7fb7d87cd700 1 -- 172.21.15.149:0/3814960640 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7d0073e70 con 0x7fb7d015d5d0 2023-11-08T19:28:08.799 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.784+0000 7fb7c6ffd700 1 -- 172.21.15.149:0/3814960640 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb7c8015430 con 0x7fb7d015d5d0 2023-11-08T19:28:08.799 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.784+0000 7fb7c6ffd700 1 --2- 172.21.15.149:0/3814960640 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb7b406af00 0x7fb7b406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:08.800 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.785+0000 7fb7c6ffd700 1 -- 172.21.15.149:0/3814960640 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7350+0+0 (secure 0 0 0) 0x7fb7c8089740 con 0x7fb7d015d5d0 2023-11-08T19:28:08.800 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.785+0000 7fb7d6569700 1 --2- 172.21.15.149:0/3814960640 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb7b406af00 0x7fb7b406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:08.800 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.785+0000 7fb7d6569700 1 --2- 172.21.15.149:0/3814960640 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb7b406af00 0x7fb7b406d3c0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fb7c00090b0 tx=0x7fb7c001e040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:08.800 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:08.789+0000 7fb7c6ffd700 1 -- 172.21.15.149:0/3814960640 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb7c80540f0 con 0x7fb7d015d5d0 2023-11-08T19:28:09.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:09.061+0000 7fb7d87cd700 1 -- 172.21.15.149:0/3814960640 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"} v 0) v1 -- 0x7fb7d004f730 con 0x7fb7d015d5d0 2023-11-08T19:28:09.805 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:09.804+0000 7fb7c6ffd700 1 -- 172.21.15.149:0/3814960640 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"}]=0 freezing mds.6451 v76) v1 ==== 112+0+0 (secure 0 0 0) 0x7fb7c8057710 con 0x7fb7d015d5d0 2023-11-08T19:28:09.809 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:09.807+0000 7fb7d87cd700 1 -- 172.21.15.149:0/3814960640 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb7b406af00 msgr2=0x7fb7b406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:09.809 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:09.807+0000 7fb7d87cd700 1 --2- 172.21.15.149:0/3814960640 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb7b406af00 0x7fb7b406d3c0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fb7c00090b0 tx=0x7fb7c001e040 comp rx=0 tx=0).stop 2023-11-08T19:28:09.809 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:09.807+0000 7fb7d87cd700 1 -- 172.21.15.149:0/3814960640 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7d015d5d0 msgr2=0x7fb7d015da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:09.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:09.807+0000 7fb7d87cd700 1 --2- 172.21.15.149:0/3814960640 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7d015d5d0 0x7fb7d015da50 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7fb7d006d970 tx=0x7fb7c800f490 comp rx=0 tx=0).stop 2023-11-08T19:28:09.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:09.807+0000 7fb7d87cd700 1 -- 172.21.15.149:0/3814960640 shutdown_connections 2023-11-08T19:28:09.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:09.807+0000 7fb7d87cd700 1 --2- 172.21.15.149:0/3814960640 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb7b406af00 0x7fb7b406d3c0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:09.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:09.807+0000 7fb7d87cd700 1 --2- 172.21.15.149:0/3814960640 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb7d00cc870 0x7fb7d0157ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:09.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:09.807+0000 7fb7d87cd700 1 --2- 172.21.15.149:0/3814960640 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7d015d5d0 0x7fb7d015da50 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:09.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:09.807+0000 7fb7d87cd700 1 --2- 172.21.15.149:0/3814960640 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb7d0159af0 0x7fb7d0159f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:09.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:09.807+0000 7fb7d87cd700 1 -- 172.21.15.149:0/3814960640 >> 172.21.15.149:0/3814960640 conn(0x7fb7d00d0640 msgr2=0x7fb7d00d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:09.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:09.808+0000 7fb7d87cd700 1 -- 172.21.15.149:0/3814960640 shutdown_connections 2023-11-08T19:28:09.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:09.808+0000 7fb7d87cd700 1 -- 172.21.15.149:0/3814960640 wait complete. 2023-11-08T19:28:09.812 INFO:teuthology.orchestra.run.smithi149.stderr:freezing mds.6451 2023-11-08T19:28:09.823 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json config set mds_kill_mdstable_at 5 2023-11-08T19:28:09.970 INFO:teuthology.orchestra.run.smithi160.stdout:{"success":"mds_kill_mdstable_at = '5' (not observed, change may require restart) "} 2023-11-08T19:28:09.971 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_kill_mdstable_at = '5' (not observed, change may require restart) " } 2023-11-08T19:28:09.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:28:09.972 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir d1/dir/.snap/s15) 2023-11-08T19:28:09.975 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2023-11-08T19:28:09.999 INFO:tasks.ceph.mds.d.smithi160.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el8/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_commit(ceph::cref_t&)' thread 7f8de6023700 time 2023-11-08T19:28:09.999317+0000 2023-11-08T19:28:09.999 INFO:tasks.ceph.mds.d.smithi160.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el8/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 145: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 5) 2023-11-08T19:28:10.000 INFO:tasks.ceph.mds.d.smithi160.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-08T19:28:10.000 INFO:tasks.ceph.mds.d.smithi160.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f8df18ebf5b] 2023-11-08T19:28:10.001 INFO:tasks.ceph.mds.d.smithi160.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2ba121) [0x7f8df18ec121] 2023-11-08T19:28:10.001 INFO:tasks.ceph.mds.d.smithi160.stderr: 3: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x84c) [0x56407c50b7ec] 2023-11-08T19:28:10.001 INFO:tasks.ceph.mds.d.smithi160.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x56407c1ca099] 2023-11-08T19:28:10.001 INFO:tasks.ceph.mds.d.smithi160.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x593) [0x56407c1cd1c3] 2023-11-08T19:28:10.001 INFO:tasks.ceph.mds.d.smithi160.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56407c1cd7bc] 2023-11-08T19:28:10.002 INFO:tasks.ceph.mds.d.smithi160.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x56407c1b756f] 2023-11-08T19:28:10.002 INFO:tasks.ceph.mds.d.smithi160.stderr: 8: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f8df1b739c8] 2023-11-08T19:28:10.002 INFO:tasks.ceph.mds.d.smithi160.stderr: 9: (DispatchQueue::entry()+0x51f) [0x7f8df1b70b4f] 2023-11-08T19:28:10.002 INFO:tasks.ceph.mds.d.smithi160.stderr: 10: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f8df1c3e351] 2023-11-08T19:28:10.002 INFO:tasks.ceph.mds.d.smithi160.stderr: 11: /lib64/libpthread.so.0(+0x81cf) [0x7f8df06841cf] 2023-11-08T19:28:10.003 INFO:tasks.ceph.mds.d.smithi160.stderr: 12: clone() 2023-11-08T19:28:10.003 INFO:tasks.ceph.mds.d.smithi160.stderr:*** Caught signal (Aborted) ** 2023-11-08T19:28:10.003 INFO:tasks.ceph.mds.d.smithi160.stderr: in thread 7f8de6023700 thread_name:ms_dispatch 2023-11-08T19:28:10.003 INFO:tasks.ceph.mds.d.smithi160.stderr:2023-11-08T19:28:09.999+0000 7f8de6023700 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el8/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_commit(ceph::cref_t&)' thread 7f8de6023700 time 2023-11-08T19:28:09.999317+0000 2023-11-08T19:28:10.003 INFO:tasks.ceph.mds.d.smithi160.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el8/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 145: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 5) 2023-11-08T19:28:10.004 INFO:tasks.ceph.mds.d.smithi160.stderr: 2023-11-08T19:28:10.004 INFO:tasks.ceph.mds.d.smithi160.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-08T19:28:10.004 INFO:tasks.ceph.mds.d.smithi160.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f8df18ebf5b] 2023-11-08T19:28:10.004 INFO:tasks.ceph.mds.d.smithi160.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2ba121) [0x7f8df18ec121] 2023-11-08T19:28:10.004 INFO:tasks.ceph.mds.d.smithi160.stderr: 3: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x84c) [0x56407c50b7ec] 2023-11-08T19:28:10.005 INFO:tasks.ceph.mds.d.smithi160.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x56407c1ca099] 2023-11-08T19:28:10.005 INFO:tasks.ceph.mds.d.smithi160.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x593) [0x56407c1cd1c3] 2023-11-08T19:28:10.005 INFO:tasks.ceph.mds.d.smithi160.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56407c1cd7bc] 2023-11-08T19:28:10.005 INFO:tasks.ceph.mds.d.smithi160.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x56407c1b756f] 2023-11-08T19:28:10.005 INFO:tasks.ceph.mds.d.smithi160.stderr: 8: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f8df1b739c8] 2023-11-08T19:28:10.006 INFO:tasks.ceph.mds.d.smithi160.stderr: 9: (DispatchQueue::entry()+0x51f) [0x7f8df1b70b4f] 2023-11-08T19:28:10.006 INFO:tasks.ceph.mds.d.smithi160.stderr: 10: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f8df1c3e351] 2023-11-08T19:28:10.006 INFO:tasks.ceph.mds.d.smithi160.stderr: 11: /lib64/libpthread.so.0(+0x81cf) [0x7f8df06841cf] 2023-11-08T19:28:10.006 INFO:tasks.ceph.mds.d.smithi160.stderr: 12: clone() 2023-11-08T19:28:10.006 INFO:tasks.ceph.mds.d.smithi160.stderr: 2023-11-08T19:28:10.007 INFO:tasks.ceph.mds.d.smithi160.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-08T19:28:10.007 INFO:tasks.ceph.mds.d.smithi160.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f8df068ece0] 2023-11-08T19:28:10.008 INFO:tasks.ceph.mds.d.smithi160.stderr: 2: gsignal() 2023-11-08T19:28:10.008 INFO:tasks.ceph.mds.d.smithi160.stderr: 3: abort() 2023-11-08T19:28:10.008 INFO:tasks.ceph.mds.d.smithi160.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f8df18ebfb5] 2023-11-08T19:28:10.008 INFO:tasks.ceph.mds.d.smithi160.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2ba121) [0x7f8df18ec121] 2023-11-08T19:28:10.008 INFO:tasks.ceph.mds.d.smithi160.stderr: 6: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x84c) [0x56407c50b7ec] 2023-11-08T19:28:10.009 INFO:tasks.ceph.mds.d.smithi160.stderr: 7: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x56407c1ca099] 2023-11-08T19:28:10.009 INFO:tasks.ceph.mds.d.smithi160.stderr: 8: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x593) [0x56407c1cd1c3] 2023-11-08T19:28:10.009 INFO:tasks.ceph.mds.d.smithi160.stderr: 9: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56407c1cd7bc] 2023-11-08T19:28:10.009 INFO:tasks.ceph.mds.d.smithi160.stderr: 10: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x56407c1b756f] 2023-11-08T19:28:10.009 INFO:tasks.ceph.mds.d.smithi160.stderr: 11: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f8df1b739c8] 2023-11-08T19:28:10.010 INFO:tasks.ceph.mds.d.smithi160.stderr: 12: (DispatchQueue::entry()+0x51f) [0x7f8df1b70b4f] 2023-11-08T19:28:10.010 INFO:tasks.ceph.mds.d.smithi160.stderr: 13: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f8df1c3e351] 2023-11-08T19:28:10.010 INFO:tasks.ceph.mds.d.smithi160.stderr: 14: /lib64/libpthread.so.0(+0x81cf) [0x7f8df06841cf] 2023-11-08T19:28:10.010 INFO:tasks.ceph.mds.d.smithi160.stderr: 15: clone() 2023-11-08T19:28:10.011 INFO:tasks.ceph.mds.d.smithi160.stderr:2023-11-08T19:28:10.000+0000 7f8de6023700 -1 *** Caught signal (Aborted) ** 2023-11-08T19:28:10.011 INFO:tasks.ceph.mds.d.smithi160.stderr: in thread 7f8de6023700 thread_name:ms_dispatch 2023-11-08T19:28:10.011 INFO:tasks.ceph.mds.d.smithi160.stderr: 2023-11-08T19:28:10.011 INFO:tasks.ceph.mds.d.smithi160.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-08T19:28:10.012 INFO:tasks.ceph.mds.d.smithi160.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f8df068ece0] 2023-11-08T19:28:10.012 INFO:tasks.ceph.mds.d.smithi160.stderr: 2: gsignal() 2023-11-08T19:28:10.012 INFO:tasks.ceph.mds.d.smithi160.stderr: 3: abort() 2023-11-08T19:28:10.012 INFO:tasks.ceph.mds.d.smithi160.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f8df18ebfb5] 2023-11-08T19:28:10.012 INFO:tasks.ceph.mds.d.smithi160.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2ba121) [0x7f8df18ec121] 2023-11-08T19:28:10.013 INFO:tasks.ceph.mds.d.smithi160.stderr: 6: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x84c) [0x56407c50b7ec] 2023-11-08T19:28:10.013 INFO:tasks.ceph.mds.d.smithi160.stderr: 7: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x56407c1ca099] 2023-11-08T19:28:10.013 INFO:tasks.ceph.mds.d.smithi160.stderr: 8: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x593) [0x56407c1cd1c3] 2023-11-08T19:28:10.013 INFO:tasks.ceph.mds.d.smithi160.stderr: 9: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56407c1cd7bc] 2023-11-08T19:28:10.013 INFO:tasks.ceph.mds.d.smithi160.stderr: 10: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x56407c1b756f] 2023-11-08T19:28:10.014 INFO:tasks.ceph.mds.d.smithi160.stderr: 11: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f8df1b739c8] 2023-11-08T19:28:10.014 INFO:tasks.ceph.mds.d.smithi160.stderr: 12: (DispatchQueue::entry()+0x51f) [0x7f8df1b70b4f] 2023-11-08T19:28:10.014 INFO:tasks.ceph.mds.d.smithi160.stderr: 13: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f8df1c3e351] 2023-11-08T19:28:10.014 INFO:tasks.ceph.mds.d.smithi160.stderr: 14: /lib64/libpthread.so.0(+0x81cf) [0x7f8df06841cf] 2023-11-08T19:28:10.014 INFO:tasks.ceph.mds.d.smithi160.stderr: 15: clone() 2023-11-08T19:28:10.015 INFO:tasks.ceph.mds.d.smithi160.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-08T19:28:10.015 INFO:tasks.ceph.mds.d.smithi160.stderr: 2023-11-08T19:28:10.015 INFO:tasks.ceph.mds.d.smithi160.stderr: -213> 2023-11-08T19:28:08.570+0000 7f8de381e700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-08T19:28:10.015 INFO:tasks.ceph.mds.d.smithi160.stderr: -211> 2023-11-08T19:28:08.570+0000 7f8de381e700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-08T19:28:10.015 INFO:tasks.ceph.mds.d.smithi160.stderr: -1> 2023-11-08T19:28:09.999+0000 7f8de6023700 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el8/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_commit(ceph::cref_t&)' thread 7f8de6023700 time 2023-11-08T19:28:09.999317+0000 2023-11-08T19:28:10.016 INFO:tasks.ceph.mds.d.smithi160.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el8/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 145: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 5) 2023-11-08T19:28:10.016 INFO:tasks.ceph.mds.d.smithi160.stderr: 2023-11-08T19:28:10.016 INFO:tasks.ceph.mds.d.smithi160.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-08T19:28:10.016 INFO:tasks.ceph.mds.d.smithi160.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f8df18ebf5b] 2023-11-08T19:28:10.017 INFO:tasks.ceph.mds.d.smithi160.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2ba121) [0x7f8df18ec121] 2023-11-08T19:28:10.017 INFO:tasks.ceph.mds.d.smithi160.stderr: 3: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x84c) [0x56407c50b7ec] 2023-11-08T19:28:10.017 INFO:tasks.ceph.mds.d.smithi160.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x56407c1ca099] 2023-11-08T19:28:10.017 INFO:tasks.ceph.mds.d.smithi160.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x593) [0x56407c1cd1c3] 2023-11-08T19:28:10.017 INFO:tasks.ceph.mds.d.smithi160.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56407c1cd7bc] 2023-11-08T19:28:10.018 INFO:tasks.ceph.mds.d.smithi160.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x56407c1b756f] 2023-11-08T19:28:10.018 INFO:tasks.ceph.mds.d.smithi160.stderr: 8: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f8df1b739c8] 2023-11-08T19:28:10.018 INFO:tasks.ceph.mds.d.smithi160.stderr: 9: (DispatchQueue::entry()+0x51f) [0x7f8df1b70b4f] 2023-11-08T19:28:10.018 INFO:tasks.ceph.mds.d.smithi160.stderr: 10: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f8df1c3e351] 2023-11-08T19:28:10.018 INFO:tasks.ceph.mds.d.smithi160.stderr: 11: /lib64/libpthread.so.0(+0x81cf) [0x7f8df06841cf] 2023-11-08T19:28:10.019 INFO:tasks.ceph.mds.d.smithi160.stderr: 12: clone() 2023-11-08T19:28:10.019 INFO:tasks.ceph.mds.d.smithi160.stderr: 2023-11-08T19:28:10.019 INFO:tasks.ceph.mds.d.smithi160.stderr: 0> 2023-11-08T19:28:10.000+0000 7f8de6023700 -1 *** Caught signal (Aborted) ** 2023-11-08T19:28:10.019 INFO:tasks.ceph.mds.d.smithi160.stderr: in thread 7f8de6023700 thread_name:ms_dispatch 2023-11-08T19:28:10.019 INFO:tasks.ceph.mds.d.smithi160.stderr: 2023-11-08T19:28:10.019 INFO:tasks.ceph.mds.d.smithi160.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-08T19:28:10.020 INFO:tasks.ceph.mds.d.smithi160.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f8df068ece0] 2023-11-08T19:28:10.020 INFO:tasks.ceph.mds.d.smithi160.stderr: 2: gsignal() 2023-11-08T19:28:10.020 INFO:tasks.ceph.mds.d.smithi160.stderr: 3: abort() 2023-11-08T19:28:10.020 INFO:tasks.ceph.mds.d.smithi160.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f8df18ebfb5] 2023-11-08T19:28:10.021 INFO:tasks.ceph.mds.d.smithi160.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2ba121) [0x7f8df18ec121] 2023-11-08T19:28:10.021 INFO:tasks.ceph.mds.d.smithi160.stderr: 6: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x84c) [0x56407c50b7ec] 2023-11-08T19:28:10.021 INFO:tasks.ceph.mds.d.smithi160.stderr: 7: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x56407c1ca099] 2023-11-08T19:28:10.021 INFO:tasks.ceph.mds.d.smithi160.stderr: 8: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x593) [0x56407c1cd1c3] 2023-11-08T19:28:10.021 INFO:tasks.ceph.mds.d.smithi160.stderr: 9: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56407c1cd7bc] 2023-11-08T19:28:10.022 INFO:tasks.ceph.mds.d.smithi160.stderr: 10: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x56407c1b756f] 2023-11-08T19:28:10.022 INFO:tasks.ceph.mds.d.smithi160.stderr: 11: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f8df1b739c8] 2023-11-08T19:28:10.022 INFO:tasks.ceph.mds.d.smithi160.stderr: 12: (DispatchQueue::entry()+0x51f) [0x7f8df1b70b4f] 2023-11-08T19:28:10.022 INFO:tasks.ceph.mds.d.smithi160.stderr: 13: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f8df1c3e351] 2023-11-08T19:28:10.022 INFO:tasks.ceph.mds.d.smithi160.stderr: 14: /lib64/libpthread.so.0(+0x81cf) [0x7f8df06841cf] 2023-11-08T19:28:10.023 INFO:tasks.ceph.mds.d.smithi160.stderr: 15: clone() 2023-11-08T19:28:10.023 INFO:tasks.ceph.mds.d.smithi160.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-08T19:28:10.023 INFO:tasks.ceph.mds.d.smithi160.stderr: 2023-11-08T19:28:10.024 INFO:tasks.ceph.mds.d.smithi160.stderr: -213> 2023-11-08T19:28:08.570+0000 7f8de381e700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-08T19:28:10.024 INFO:tasks.ceph.mds.d.smithi160.stderr: -211> 2023-11-08T19:28:08.570+0000 7f8de381e700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-08T19:28:10.025 INFO:tasks.ceph.mds.d.smithi160.stderr: -1> 2023-11-08T19:28:09.999+0000 7f8de6023700 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el8/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_commit(ceph::cref_t&)' thread 7f8de6023700 time 2023-11-08T19:28:09.999317+0000 2023-11-08T19:28:10.025 INFO:tasks.ceph.mds.d.smithi160.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el8/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 145: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 5) 2023-11-08T19:28:10.025 INFO:tasks.ceph.mds.d.smithi160.stderr: 2023-11-08T19:28:10.025 INFO:tasks.ceph.mds.d.smithi160.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-08T19:28:10.025 INFO:tasks.ceph.mds.d.smithi160.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f8df18ebf5b] 2023-11-08T19:28:10.026 INFO:tasks.ceph.mds.d.smithi160.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2ba121) [0x7f8df18ec121] 2023-11-08T19:28:10.026 INFO:tasks.ceph.mds.d.smithi160.stderr: 3: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x84c) [0x56407c50b7ec] 2023-11-08T19:28:10.026 INFO:tasks.ceph.mds.d.smithi160.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x56407c1ca099] 2023-11-08T19:28:10.026 INFO:tasks.ceph.mds.d.smithi160.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x593) [0x56407c1cd1c3] 2023-11-08T19:28:10.026 INFO:tasks.ceph.mds.d.smithi160.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56407c1cd7bc] 2023-11-08T19:28:10.027 INFO:tasks.ceph.mds.d.smithi160.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x56407c1b756f] 2023-11-08T19:28:10.027 INFO:tasks.ceph.mds.d.smithi160.stderr: 8: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f8df1b739c8] 2023-11-08T19:28:10.027 INFO:tasks.ceph.mds.d.smithi160.stderr: 9: (DispatchQueue::entry()+0x51f) [0x7f8df1b70b4f] 2023-11-08T19:28:10.027 INFO:tasks.ceph.mds.d.smithi160.stderr: 10: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f8df1c3e351] 2023-11-08T19:28:10.027 INFO:tasks.ceph.mds.d.smithi160.stderr: 11: /lib64/libpthread.so.0(+0x81cf) [0x7f8df06841cf] 2023-11-08T19:28:10.028 INFO:tasks.ceph.mds.d.smithi160.stderr: 12: clone() 2023-11-08T19:28:10.028 INFO:tasks.ceph.mds.d.smithi160.stderr: 2023-11-08T19:28:10.028 INFO:tasks.ceph.mds.d.smithi160.stderr: 0> 2023-11-08T19:28:10.000+0000 7f8de6023700 -1 *** Caught signal (Aborted) ** 2023-11-08T19:28:10.028 INFO:tasks.ceph.mds.d.smithi160.stderr: in thread 7f8de6023700 thread_name:ms_dispatch 2023-11-08T19:28:10.028 INFO:tasks.ceph.mds.d.smithi160.stderr: 2023-11-08T19:28:10.029 INFO:tasks.ceph.mds.d.smithi160.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-08T19:28:10.029 INFO:tasks.ceph.mds.d.smithi160.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f8df068ece0] 2023-11-08T19:28:10.029 INFO:tasks.ceph.mds.d.smithi160.stderr: 2: gsignal() 2023-11-08T19:28:10.029 INFO:tasks.ceph.mds.d.smithi160.stderr: 3: abort() 2023-11-08T19:28:10.029 INFO:tasks.ceph.mds.d.smithi160.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f8df18ebfb5] 2023-11-08T19:28:10.030 INFO:tasks.ceph.mds.d.smithi160.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2ba121) [0x7f8df18ec121] 2023-11-08T19:28:10.030 INFO:tasks.ceph.mds.d.smithi160.stderr: 6: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x84c) [0x56407c50b7ec] 2023-11-08T19:28:10.030 INFO:tasks.ceph.mds.d.smithi160.stderr: 7: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x56407c1ca099] 2023-11-08T19:28:10.030 INFO:tasks.ceph.mds.d.smithi160.stderr: 8: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x593) [0x56407c1cd1c3] 2023-11-08T19:28:10.030 INFO:tasks.ceph.mds.d.smithi160.stderr: 9: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56407c1cd7bc] 2023-11-08T19:28:10.031 INFO:tasks.ceph.mds.d.smithi160.stderr: 10: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x56407c1b756f] 2023-11-08T19:28:10.031 INFO:tasks.ceph.mds.d.smithi160.stderr: 11: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f8df1b739c8] 2023-11-08T19:28:10.031 INFO:tasks.ceph.mds.d.smithi160.stderr: 12: (DispatchQueue::entry()+0x51f) [0x7f8df1b70b4f] 2023-11-08T19:28:10.031 INFO:tasks.ceph.mds.d.smithi160.stderr: 13: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f8df1c3e351] 2023-11-08T19:28:10.031 INFO:tasks.ceph.mds.d.smithi160.stderr: 14: /lib64/libpthread.so.0(+0x81cf) [0x7f8df06841cf] 2023-11-08T19:28:10.031 INFO:tasks.ceph.mds.d.smithi160.stderr: 15: clone() 2023-11-08T19:28:10.032 INFO:tasks.ceph.mds.d.smithi160.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-08T19:28:10.032 INFO:tasks.ceph.mds.d.smithi160.stderr: 2023-11-08T19:28:10.159 INFO:tasks.ceph.mds.d.smithi160.stderr:daemon-helper: command crashed with signal 6 2023-11-08T19:28:10.162 INFO:teuthology.orchestra.run.smithi149.stdout:{"mds_beacon_grace":"15.000000"} 2023-11-08T19:28:10.162 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2023-11-08T19:28:10.163 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:28:10.283 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.282+0000 7f4dbfa1f700 1 Processor -- start 2023-11-08T19:28:10.284 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.282+0000 7f4dbfa1f700 1 -- start start 2023-11-08T19:28:10.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.283+0000 7f4dbfa1f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4db80afb30 0x7f4db80ce380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:10.294 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.283+0000 7f4dbfa1f700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f4db80b16b0 0x7f4db80cbf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:10.294 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.283+0000 7f4dbfa1f700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4db80d1330 con 0x7f4db80b20b0 2023-11-08T19:28:10.295 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.283+0000 7f4dbfa1f700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4db80cb490 con 0x7f4db80b16b0 2023-11-08T19:28:10.295 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.283+0000 7f4dbfa1f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4db80cb770 con 0x7f4db80afb30 2023-11-08T19:28:10.295 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.283+0000 7f4dbcfba700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f4db80b16b0 0x7f4db80cbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:10.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.283+0000 7f4dbcfba700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f4db80b16b0 0x7f4db80cbf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44434/0 (socket says 172.21.15.149:44434) 2023-11-08T19:28:10.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.283+0000 7f4dbcfba700 1 -- 172.21.15.149:0/3246077844 learned_addr learned my addr 172.21.15.149:0/3246077844 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:28:10.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.283+0000 7f4dbd7bb700 1 --2- 172.21.15.149:0/3246077844 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4db80afb30 0x7f4db80ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:10.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.283+0000 7f4dbcfba700 1 -- 172.21.15.149:0/3246077844 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4db80afb30 msgr2=0x7f4db80ce380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:10.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.283+0000 7f4dbcfba700 1 --2- 172.21.15.149:0/3246077844 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4db80afb30 0x7f4db80ce380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:10.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.283+0000 7f4dbcfba700 1 -- 172.21.15.149:0/3246077844 >> v1:172.21.15.160:6789/0 conn(0x7f4db80b20b0 legacy=0x7f4db80aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:10.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.283+0000 7f4dbcfba700 1 -- 172.21.15.149:0/3246077844 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db80cba50 con 0x7f4db80b16b0 2023-11-08T19:28:10.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.283+0000 7f4dbcfba700 1 --2- 172.21.15.149:0/3246077844 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4db80b16b0 0x7f4db80cbf70 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f4db40098f0 tx=0x7f4db4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edbff50273e0e03b server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:10.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.284+0000 7f4daffff700 1 -- 172.21.15.149:0/3246077844 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db4011830 con 0x7f4db80b16b0 2023-11-08T19:28:10.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.284+0000 7f4daffff700 1 -- 172.21.15.149:0/3246077844 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db4011990 con 0x7f4db80b16b0 2023-11-08T19:28:10.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.284+0000 7f4daffff700 1 -- 172.21.15.149:0/3246077844 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db4011d20 con 0x7f4db80b16b0 2023-11-08T19:28:10.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.284+0000 7f4dbfa1f700 1 -- 172.21.15.149:0/3246077844 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4db80b16b0 msgr2=0x7f4db80cbf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:10.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.284+0000 7f4dbfa1f700 1 --2- 172.21.15.149:0/3246077844 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4db80b16b0 0x7f4db80cbf70 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f4db40098f0 tx=0x7f4db4009c00 comp rx=0 tx=0).stop 2023-11-08T19:28:10.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.284+0000 7f4dbfa1f700 1 -- 172.21.15.149:0/3246077844 shutdown_connections 2023-11-08T19:28:10.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.284+0000 7f4dbfa1f700 1 --2- 172.21.15.149:0/3246077844 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4db80afb30 0x7f4db80ce380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:10.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.284+0000 7f4dbfa1f700 1 --2- 172.21.15.149:0/3246077844 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4db80b16b0 0x7f4db80cbf70 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:10.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.284+0000 7f4dbfa1f700 1 -- 172.21.15.149:0/3246077844 >> 172.21.15.149:0/3246077844 conn(0x7f4db8099a40 msgr2=0x7f4db80d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:10.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.284+0000 7f4dbfa1f700 1 -- 172.21.15.149:0/3246077844 shutdown_connections 2023-11-08T19:28:10.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.284+0000 7f4dbfa1f700 1 -- 172.21.15.149:0/3246077844 wait complete. 2023-11-08T19:28:10.302 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.286+0000 7f4dbfa1f700 1 Processor -- start 2023-11-08T19:28:10.302 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.286+0000 7f4dbfa1f700 1 -- start start 2023-11-08T19:28:10.302 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.287+0000 7f4dbfa1f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4db80afb30 0x7f4db80c58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:10.303 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.287+0000 7f4dbfa1f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4db80b16b0 0x7f4db81541e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:10.303 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.287+0000 7f4dbfa1f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4db80b20b0 0x7f4db8156520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:10.303 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.287+0000 7f4dbfa1f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db80c5410 con 0x7f4db80b16b0 2023-11-08T19:28:10.303 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.287+0000 7f4dbfa1f700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db80c89d0 con 0x7f4db80afb30 2023-11-08T19:28:10.304 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.287+0000 7f4dbfa1f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4db80c6e40 con 0x7f4db80b20b0 2023-11-08T19:28:10.304 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.287+0000 7f4dbcfba700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4db80b16b0 0x7f4db81541e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:10.304 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.287+0000 7f4dbcfba700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4db80b16b0 0x7f4db81541e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44442/0 (socket says 172.21.15.149:44442) 2023-11-08T19:28:10.304 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.287+0000 7f4dbcfba700 1 -- 172.21.15.149:0/2353843196 learned_addr learned my addr 172.21.15.149:0/2353843196 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:28:10.304 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.287+0000 7f4dbd7bb700 1 --2- 172.21.15.149:0/2353843196 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4db80afb30 0x7f4db80c58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:10.305 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.287+0000 7f4dbdfbc700 1 --2- 172.21.15.149:0/2353843196 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4db80b20b0 0x7f4db8156520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:10.305 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.287+0000 7f4dbcfba700 1 -- 172.21.15.149:0/2353843196 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4db80b20b0 msgr2=0x7f4db8156520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:10.305 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.287+0000 7f4dbcfba700 1 --2- 172.21.15.149:0/2353843196 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4db80b20b0 0x7f4db8156520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:10.305 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.287+0000 7f4dbcfba700 1 -- 172.21.15.149:0/2353843196 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4db80afb30 msgr2=0x7f4db80c58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:10.305 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.287+0000 7f4dbcfba700 1 --2- 172.21.15.149:0/2353843196 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4db80afb30 0x7f4db80c58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:10.306 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.287+0000 7f4dbcfba700 1 -- 172.21.15.149:0/2353843196 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db4009550 con 0x7f4db80b16b0 2023-11-08T19:28:10.306 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.287+0000 7f4dbcfba700 1 --2- 172.21.15.149:0/2353843196 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4db80b16b0 0x7f4db81541e0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f4db4000c00 tx=0x7f4db4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:10.306 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.288+0000 7f4dadffb700 1 -- 172.21.15.149:0/2353843196 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db4004400 con 0x7f4db80b16b0 2023-11-08T19:28:10.306 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.288+0000 7f4dadffb700 1 -- 172.21.15.149:0/2353843196 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db401f070 con 0x7f4db80b16b0 2023-11-08T19:28:10.307 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.288+0000 7f4dadffb700 1 -- 172.21.15.149:0/2353843196 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db40038e0 con 0x7f4db80b16b0 2023-11-08T19:28:10.307 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.288+0000 7f4dbfa1f700 1 -- 172.21.15.149:0/2353843196 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4db80c4ae0 con 0x7f4db80b16b0 2023-11-08T19:28:10.307 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.288+0000 7f4dbfa1f700 1 -- 172.21.15.149:0/2353843196 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4db80c50a0 con 0x7f4db80b16b0 2023-11-08T19:28:10.307 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.289+0000 7f4dbfa1f700 1 -- 172.21.15.149:0/2353843196 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4db80c5580 con 0x7f4db80b16b0 2023-11-08T19:28:10.307 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.289+0000 7f4dadffb700 1 -- 172.21.15.149:0/2353843196 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4db4021030 con 0x7f4db80b16b0 2023-11-08T19:28:10.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.290+0000 7f4dadffb700 1 --2- 172.21.15.149:0/2353843196 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4d9c06af00 0x7f4d9c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:10.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.290+0000 7f4dbd7bb700 1 --2- 172.21.15.149:0/2353843196 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4d9c06af00 0x7f4d9c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:10.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.290+0000 7f4dadffb700 1 -- 172.21.15.149:0/2353843196 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7350+0+0 (secure 0 0 0) 0x7f4db408b010 con 0x7f4db80b16b0 2023-11-08T19:28:10.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.290+0000 7f4dbd7bb700 1 --2- 172.21.15.149:0/2353843196 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4d9c06af00 0x7f4d9c06d3c0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f4da8009bc0 tx=0x7f4da80091c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:10.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.295+0000 7f4dadffb700 1 -- 172.21.15.149:0/2353843196 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4db4055ae0 con 0x7f4db80b16b0 2023-11-08T19:28:10.532 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.530+0000 7f4dbfa1f700 1 -- 172.21.15.149:0/2353843196 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4db80745f0 con 0x7f4db80b16b0 2023-11-08T19:28:10.533 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.531+0000 7f4dadffb700 1 -- 172.21.15.149:0/2353843196 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4938 (secure 0 0 0) 0x7f4db4015020 con 0x7f4db80b16b0 2023-11-08T19:28:10.534 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:28:10.534 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":76,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6095,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/852710262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":852710262},{"type":"v1","addr":"172.21.15.160:6835","nonce":852710262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64},{"gid":7578,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/295381437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":295381437},{"type":"v1","addr":"172.21.15.149:6836","nonce":295381437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:28:09.062237+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6451,"mds_1":7125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6451":{"gid":6451,"name":"d","rank":0,"incarnation":71,"state":"up:active","state_seq":24,"addr":"172.21.15.160:6834/2947079163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2947079163},{"type":"v1","addr":"172.21.15.160:6834","nonce":2947079163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7125":{"gid":7125,"name":"c","rank":1,"incarnation":57,"state":"up:active","state_seq":6,"addr":"172.21.15.149:6837/3917392643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3917392643},{"type":"v1","addr":"172.21.15.149:6837","nonce":3917392643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:28:10.535 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.533+0000 7f4dbfa1f700 1 -- 172.21.15.149:0/2353843196 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4d9c06af00 msgr2=0x7f4d9c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:10.535 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.533+0000 7f4dbfa1f700 1 --2- 172.21.15.149:0/2353843196 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4d9c06af00 0x7f4d9c06d3c0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f4da8009bc0 tx=0x7f4da80091c0 comp rx=0 tx=0).stop 2023-11-08T19:28:10.536 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.533+0000 7f4dbfa1f700 1 -- 172.21.15.149:0/2353843196 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4db80b16b0 msgr2=0x7f4db81541e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:10.536 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.533+0000 7f4dbfa1f700 1 --2- 172.21.15.149:0/2353843196 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4db80b16b0 0x7f4db81541e0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f4db4000c00 tx=0x7f4db4004750 comp rx=0 tx=0).stop 2023-11-08T19:28:10.536 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.533+0000 7f4dbfa1f700 1 -- 172.21.15.149:0/2353843196 shutdown_connections 2023-11-08T19:28:10.536 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.533+0000 7f4dbfa1f700 1 --2- 172.21.15.149:0/2353843196 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4d9c06af00 0x7f4d9c06d3c0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:10.536 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.533+0000 7f4dbfa1f700 1 --2- 172.21.15.149:0/2353843196 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4db80afb30 0x7f4db80c58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:10.537 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.533+0000 7f4dbfa1f700 1 --2- 172.21.15.149:0/2353843196 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4db80b20b0 0x7f4db8156520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:10.537 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.533+0000 7f4dbfa1f700 1 --2- 172.21.15.149:0/2353843196 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4db80b16b0 0x7f4db81541e0 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:10.537 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.533+0000 7f4dbfa1f700 1 -- 172.21.15.149:0/2353843196 >> 172.21.15.149:0/2353843196 conn(0x7f4db8099a40 msgr2=0x7f4db80b5460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:10.537 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.533+0000 7f4dbfa1f700 1 -- 172.21.15.149:0/2353843196 shutdown_connections 2023-11-08T19:28:10.537 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:10.533+0000 7f4dbfa1f700 1 -- 172.21.15.149:0/2353843196 wait complete. 2023-11-08T19:28:10.538 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 76 2023-11-08T19:28:10.547 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-08T19:28:11.587 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-11-08T19:28:15.548 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:28:15.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.680+0000 7f763b1c8700 1 Processor -- start 2023-11-08T19:28:15.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.681+0000 7f763b1c8700 1 -- start start 2023-11-08T19:28:15.684 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.681+0000 7f763b1c8700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f76340cc140 0x7f76340cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:15.684 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.681+0000 7f763b1c8700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f76340b2cd0 0x7f763415d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:15.685 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.681+0000 7f763b1c8700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76340cce50 con 0x7f76340b2850 2023-11-08T19:28:15.685 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.681+0000 7f763b1c8700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76340b2430 con 0x7f76340cc140 2023-11-08T19:28:15.685 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.681+0000 7f763b1c8700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76340cc520 con 0x7f76340b2cd0 2023-11-08T19:28:15.685 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.682+0000 7f7638f64700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f76340cc140 0x7f76340cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:15.685 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.682+0000 7f7638f64700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f76340cc140 0x7f76340cc910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44464/0 (socket says 172.21.15.149:44464) 2023-11-08T19:28:15.686 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.682+0000 7f7638f64700 1 -- 172.21.15.149:0/2472254459 learned_addr learned my addr 172.21.15.149:0/2472254459 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:28:15.686 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.682+0000 7f7633fff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f76340b2850 0x7f76340cabf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:46468/0 (socket says 172.21.15.149:46468) 2023-11-08T19:28:15.686 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.682+0000 7f7639765700 1 --2- 172.21.15.149:0/2472254459 >> v2:172.21.15.160:3300/0 conn(0x7f76340b2cd0 0x7f763415d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:15.686 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.682+0000 7f7638f64700 1 -- 172.21.15.149:0/2472254459 >> v2:172.21.15.160:3300/0 conn(0x7f76340b2cd0 msgr2=0x7f763415d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:15.687 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.682+0000 7f7638f64700 1 --2- 172.21.15.149:0/2472254459 >> v2:172.21.15.160:3300/0 conn(0x7f76340b2cd0 0x7f763415d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:15.688 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.682+0000 7f7638f64700 1 -- 172.21.15.149:0/2472254459 >> v1:172.21.15.149:6789/0 conn(0x7f76340b2850 legacy=0x7f76340cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:15.688 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.682+0000 7f7638f64700 1 -- 172.21.15.149:0/2472254459 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76340b17b0 con 0x7f76340cc140 2023-11-08T19:28:15.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.682+0000 7f76337fe700 1 -- 172.21.15.149:0/2472254459 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3823984539 0 0) 0x7f76340cce50 con 0x7f76340b2850 2023-11-08T19:28:15.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.682+0000 7f7638f64700 1 --2- 172.21.15.149:0/2472254459 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76340cc140 0x7f76340cc910 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f76340c7600 tx=0x7f7628009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81be848cfee8c863 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:15.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.682+0000 7f76337fe700 1 -- 172.21.15.149:0/2472254459 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7628005e30 con 0x7f76340cc140 2023-11-08T19:28:15.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.682+0000 7f76337fe700 1 -- 172.21.15.149:0/2472254459 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7628004030 con 0x7f76340cc140 2023-11-08T19:28:15.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.682+0000 7f76337fe700 1 -- 172.21.15.149:0/2472254459 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76280043e0 con 0x7f76340cc140 2023-11-08T19:28:15.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.683+0000 7f763b1c8700 1 -- 172.21.15.149:0/2472254459 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76340cc140 msgr2=0x7f76340cc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:15.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.683+0000 7f763b1c8700 1 --2- 172.21.15.149:0/2472254459 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76340cc140 0x7f76340cc910 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f76340c7600 tx=0x7f7628009bd0 comp rx=0 tx=0).stop 2023-11-08T19:28:15.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.683+0000 7f763b1c8700 1 -- 172.21.15.149:0/2472254459 shutdown_connections 2023-11-08T19:28:15.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.683+0000 7f763b1c8700 1 --2- 172.21.15.149:0/2472254459 >> v2:172.21.15.160:3300/0 conn(0x7f76340b2cd0 0x7f763415d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:15.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.683+0000 7f763b1c8700 1 --2- 172.21.15.149:0/2472254459 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76340cc140 0x7f76340cc910 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:15.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.683+0000 7f763b1c8700 1 -- 172.21.15.149:0/2472254459 >> 172.21.15.149:0/2472254459 conn(0x7f7634099a40 msgr2=0x7f76340d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:15.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.683+0000 7f763b1c8700 1 -- 172.21.15.149:0/2472254459 shutdown_connections 2023-11-08T19:28:15.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.683+0000 7f763b1c8700 1 -- 172.21.15.149:0/2472254459 wait complete. 2023-11-08T19:28:15.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.684+0000 7f763b1c8700 1 Processor -- start 2023-11-08T19:28:15.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.684+0000 7f763b1c8700 1 -- start start 2023-11-08T19:28:15.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.685+0000 7f763b1c8700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f76340b2850 0x7f76340afa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:15.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.685+0000 7f763b1c8700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76340b2cd0 0x7f763406b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:15.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.685+0000 7f763b1c8700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f76340cc140 0x7f763406b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:15.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.685+0000 7f763b1c8700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76340c9f40 con 0x7f76340b2cd0 2023-11-08T19:28:15.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.685+0000 7f763b1c8700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7634151410 con 0x7f76340cc140 2023-11-08T19:28:15.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.685+0000 7f763b1c8700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76340aff80 con 0x7f76340b2850 2023-11-08T19:28:15.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.685+0000 7f7633fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76340b2cd0 0x7f763406b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:15.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.685+0000 7f7633fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76340b2cd0 0x7f763406b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44472/0 (socket says 172.21.15.149:44472) 2023-11-08T19:28:15.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.685+0000 7f7633fff700 1 -- 172.21.15.149:0/3657261863 learned_addr learned my addr 172.21.15.149:0/3657261863 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:28:15.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.685+0000 7f7639765700 1 --2- 172.21.15.149:0/3657261863 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f76340cc140 0x7f763406b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:15.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.685+0000 7f7638f64700 1 --2- 172.21.15.149:0/3657261863 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f76340b2850 0x7f76340afa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:15.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.685+0000 7f7633fff700 1 -- 172.21.15.149:0/3657261863 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f76340b2850 msgr2=0x7f76340afa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:15.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.685+0000 7f7633fff700 1 --2- 172.21.15.149:0/3657261863 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f76340b2850 0x7f76340afa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:15.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.685+0000 7f7633fff700 1 -- 172.21.15.149:0/3657261863 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f76340cc140 msgr2=0x7f763406b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:15.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.685+0000 7f7633fff700 1 --2- 172.21.15.149:0/3657261863 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f76340cc140 0x7f763406b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:15.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.685+0000 7f7633fff700 1 -- 172.21.15.149:0/3657261863 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7628009500 con 0x7f76340b2cd0 2023-11-08T19:28:15.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.686+0000 7f7639765700 1 --2- 172.21.15.149:0/3657261863 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f76340cc140 0x7f763406b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:28:15.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.686+0000 7f7633fff700 1 --2- 172.21.15.149:0/3657261863 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76340b2cd0 0x7f763406b120 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f762000c550 tx=0x7f762000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:15.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.686+0000 7f76317fa700 1 -- 172.21.15.149:0/3657261863 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7620004c80 con 0x7f76340b2cd0 2023-11-08T19:28:15.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.686+0000 7f76317fa700 1 -- 172.21.15.149:0/3657261863 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7620004e00 con 0x7f76340b2cd0 2023-11-08T19:28:15.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.686+0000 7f763b1c8700 1 -- 172.21.15.149:0/3657261863 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76340c8fb0 con 0x7f76340b2cd0 2023-11-08T19:28:15.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.686+0000 7f76317fa700 1 -- 172.21.15.149:0/3657261863 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7620007310 con 0x7f76340b2cd0 2023-11-08T19:28:15.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.686+0000 7f763b1c8700 1 -- 172.21.15.149:0/3657261863 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76341f4390 con 0x7f76340b2cd0 2023-11-08T19:28:15.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.687+0000 7f763b1c8700 1 -- 172.21.15.149:0/3657261863 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76340745f0 con 0x7f76340b2cd0 2023-11-08T19:28:15.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.687+0000 7f76317fa700 1 -- 172.21.15.149:0/3657261863 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7620007470 con 0x7f76340b2cd0 2023-11-08T19:28:15.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.688+0000 7f76317fa700 1 --2- 172.21.15.149:0/3657261863 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f761806af00 0x7f761806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:15.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.688+0000 7f7638f64700 1 --2- 172.21.15.149:0/3657261863 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f761806af00 0x7f761806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:15.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.688+0000 7f76317fa700 1 -- 172.21.15.149:0/3657261863 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7350+0+0 (secure 0 0 0) 0x7f76200898d0 con 0x7f76340b2cd0 2023-11-08T19:28:15.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.688+0000 7f7638f64700 1 --2- 172.21.15.149:0/3657261863 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f761806af00 0x7f761806d3c0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f76340c7600 tx=0x7f7628008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:15.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.693+0000 7f76317fa700 1 -- 172.21.15.149:0/3657261863 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f76200543a0 con 0x7f76340b2cd0 2023-11-08T19:28:15.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.926+0000 7f763b1c8700 1 -- 172.21.15.149:0/3657261863 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f76340d0f20 con 0x7f76340b2cd0 2023-11-08T19:28:15.928 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.926+0000 7f76317fa700 1 -- 172.21.15.149:0/3657261863 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4938 (secure 0 0 0) 0x7f76200579c0 con 0x7f76340b2cd0 2023-11-08T19:28:15.928 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:28:15.929 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":76,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6095,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/852710262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":852710262},{"type":"v1","addr":"172.21.15.160:6835","nonce":852710262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64},{"gid":7578,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/295381437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":295381437},{"type":"v1","addr":"172.21.15.149:6836","nonce":295381437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:28:09.062237+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6451,"mds_1":7125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6451":{"gid":6451,"name":"d","rank":0,"incarnation":71,"state":"up:active","state_seq":24,"addr":"172.21.15.160:6834/2947079163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2947079163},{"type":"v1","addr":"172.21.15.160:6834","nonce":2947079163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7125":{"gid":7125,"name":"c","rank":1,"incarnation":57,"state":"up:active","state_seq":6,"addr":"172.21.15.149:6837/3917392643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3917392643},{"type":"v1","addr":"172.21.15.149:6837","nonce":3917392643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:28:15.931 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.928+0000 7f763b1c8700 1 -- 172.21.15.149:0/3657261863 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f761806af00 msgr2=0x7f761806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:15.931 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.928+0000 7f763b1c8700 1 --2- 172.21.15.149:0/3657261863 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f761806af00 0x7f761806d3c0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f76340c7600 tx=0x7f7628008070 comp rx=0 tx=0).stop 2023-11-08T19:28:15.931 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.928+0000 7f763b1c8700 1 -- 172.21.15.149:0/3657261863 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76340b2cd0 msgr2=0x7f763406b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:15.931 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.928+0000 7f763b1c8700 1 --2- 172.21.15.149:0/3657261863 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76340b2cd0 0x7f763406b120 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f762000c550 tx=0x7f762000c910 comp rx=0 tx=0).stop 2023-11-08T19:28:15.932 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.929+0000 7f763b1c8700 1 -- 172.21.15.149:0/3657261863 shutdown_connections 2023-11-08T19:28:15.932 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.929+0000 7f763b1c8700 1 --2- 172.21.15.149:0/3657261863 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f761806af00 0x7f761806d3c0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:15.932 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.929+0000 7f763b1c8700 1 --2- 172.21.15.149:0/3657261863 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f76340cc140 0x7f763406b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:15.933 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.929+0000 7f763b1c8700 1 --2- 172.21.15.149:0/3657261863 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f76340b2850 0x7f76340afa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:15.933 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.929+0000 7f763b1c8700 1 --2- 172.21.15.149:0/3657261863 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76340b2cd0 0x7f763406b120 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:15.934 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.929+0000 7f763b1c8700 1 -- 172.21.15.149:0/3657261863 >> 172.21.15.149:0/3657261863 conn(0x7f7634099a40 msgr2=0x7f763406e040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:15.934 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.929+0000 7f763b1c8700 1 -- 172.21.15.149:0/3657261863 shutdown_connections 2023-11-08T19:28:15.934 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:15.929+0000 7f763b1c8700 1 -- 172.21.15.149:0/3657261863 wait complete. 2023-11-08T19:28:15.935 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 76 2023-11-08T19:28:15.943 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-08T19:28:18.200 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~7s 2023-11-08T19:28:20.944 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:28:21.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.078+0000 7fb2a16e5700 1 Processor -- start 2023-11-08T19:28:21.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.078+0000 7fb2a16e5700 1 -- start start 2023-11-08T19:28:21.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.079+0000 7fb2a16e5700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fb29c161670 0x7fb29c0b5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:21.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.079+0000 7fb2a16e5700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb29c0d1a10 con 0x7fb29c161a50 2023-11-08T19:28:21.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.079+0000 7fb2a16e5700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb29c0d1cf0 con 0x7fb29c0ce500 2023-11-08T19:28:21.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.079+0000 7fb2a16e5700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb29c0d1fd0 con 0x7fb29c161670 2023-11-08T19:28:21.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.079+0000 7fb29a7fc700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fb29c161a50 0x7fb29c161f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:46488/0 (socket says 172.21.15.149:46488) 2023-11-08T19:28:21.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.079+0000 7fb29a7fc700 1 -- 172.21.15.149:0/1437072407 learned_addr learned my addr 172.21.15.149:0/1437072407 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:28:21.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.079+0000 7fb29affd700 1 --2- 172.21.15.149:0/1437072407 >> v2:172.21.15.160:3300/0 conn(0x7fb29c161670 0x7fb29c0b5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:21.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.079+0000 7fb299ffb700 1 -- 172.21.15.149:0/1437072407 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3407172661 0 0) 0x7fb29c0d1a10 con 0x7fb29c161a50 2023-11-08T19:28:21.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.079+0000 7fb299ffb700 1 -- 172.21.15.149:0/1437072407 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2840035b0 con 0x7fb29c161a50 2023-11-08T19:28:21.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.079+0000 7fb299ffb700 1 -- 172.21.15.149:0/1437072407 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2663512621 0 0) 0x7fb2840035b0 con 0x7fb29c161a50 2023-11-08T19:28:21.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.079+0000 7fb299ffb700 1 -- 172.21.15.149:0/1437072407 >> v2:172.21.15.160:3300/0 conn(0x7fb29c161670 msgr2=0x7fb29c0b5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:21.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.079+0000 7fb299ffb700 1 --2- 172.21.15.149:0/1437072407 >> v2:172.21.15.160:3300/0 conn(0x7fb29c161670 0x7fb29c0b5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:21.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.079+0000 7fb299ffb700 1 -- 172.21.15.149:0/1437072407 >> v1:172.21.15.160:6789/0 conn(0x7fb29c0ce500 legacy=0x7fb29c0ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:21.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.079+0000 7fb299ffb700 1 -- 172.21.15.149:0/1437072407 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb29c0d22b0 con 0x7fb29c161a50 2023-11-08T19:28:21.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.079+0000 7fb299ffb700 1 -- 172.21.15.149:0/1437072407 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7fb28c001670 con 0x7fb29c161a50 2023-11-08T19:28:21.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.080+0000 7fb299ffb700 1 -- 172.21.15.149:0/1437072407 >> v1:172.21.15.149:6789/0 conn(0x7fb29c161a50 legacy=0x7fb29c161f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:21.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.080+0000 7fb299ffb700 1 --2- 172.21.15.149:0/1437072407 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb284003a00 0x7fb284003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:21.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.080+0000 7fb299ffb700 1 --2- 172.21.15.149:0/1437072407 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb284004850 0x7fb284004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:21.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.080+0000 7fb299ffb700 1 --2- 172.21.15.149:0/1437072407 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb284005210 0x7fb28400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:21.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.080+0000 7fb299ffb700 1 -- 172.21.15.149:0/1437072407 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb29c0d1fd0 con 0x7fb284003a00 2023-11-08T19:28:21.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.080+0000 7fb299ffb700 1 -- 172.21.15.149:0/1437072407 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb28400c0b0 con 0x7fb284005210 2023-11-08T19:28:21.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.080+0000 7fb299ffb700 1 -- 172.21.15.149:0/1437072407 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb28400c270 con 0x7fb284004850 2023-11-08T19:28:21.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.080+0000 7fb29affd700 1 --2- 172.21.15.149:0/1437072407 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb284003a00 0x7fb284003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:21.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.080+0000 7fb29a7fc700 1 --2- 172.21.15.149:0/1437072407 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb284004850 0x7fb284004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:21.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.080+0000 7fb29b7fe700 1 --2- 172.21.15.149:0/1437072407 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb284005210 0x7fb28400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:21.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.080+0000 7fb29affd700 1 -- 172.21.15.149:0/1437072407 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb284004850 msgr2=0x7fb284004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:21.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.080+0000 7fb29affd700 1 --2- 172.21.15.149:0/1437072407 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb284004850 0x7fb284004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:21.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.080+0000 7fb29affd700 1 -- 172.21.15.149:0/1437072407 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb284005210 msgr2=0x7fb28400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:21.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.080+0000 7fb29affd700 1 --2- 172.21.15.149:0/1437072407 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb284005210 0x7fb28400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:21.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.080+0000 7fb29affd700 1 -- 172.21.15.149:0/1437072407 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2840035b0 con 0x7fb284003a00 2023-11-08T19:28:21.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.080+0000 7fb29b7fe700 1 --2- 172.21.15.149:0/1437072407 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb284005210 0x7fb28400ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:28:21.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.080+0000 7fb29b7fe700 1 -- 172.21.15.149:0/1437072407 reap_dead start 2023-11-08T19:28:21.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.080+0000 7fb29affd700 1 --2- 172.21.15.149:0/1437072407 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb284003a00 0x7fb284003e20 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fb290009b40 tx=0x7fb284005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cde74cfae1441540 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:21.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.080+0000 7fb299ffb700 1 -- 172.21.15.149:0/1437072407 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb290005a20 con 0x7fb284003a00 2023-11-08T19:28:21.092 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.080+0000 7fb299ffb700 1 -- 172.21.15.149:0/1437072407 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb290005b80 con 0x7fb284003a00 2023-11-08T19:28:21.092 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.080+0000 7fb299ffb700 1 -- 172.21.15.149:0/1437072407 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29000e6c0 con 0x7fb284003a00 2023-11-08T19:28:21.092 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.081+0000 7fb2a16e5700 1 -- 172.21.15.149:0/1437072407 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb284003a00 msgr2=0x7fb284003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:21.092 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.081+0000 7fb2a16e5700 1 --2- 172.21.15.149:0/1437072407 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb284003a00 0x7fb284003e20 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fb290009b40 tx=0x7fb284005880 comp rx=0 tx=0).stop 2023-11-08T19:28:21.093 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.081+0000 7fb2a16e5700 1 -- 172.21.15.149:0/1437072407 shutdown_connections 2023-11-08T19:28:21.093 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.081+0000 7fb2a16e5700 1 --2- 172.21.15.149:0/1437072407 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb284003a00 0x7fb284003e20 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:21.093 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.081+0000 7fb2a16e5700 1 -- 172.21.15.149:0/1437072407 >> 172.21.15.149:0/1437072407 conn(0x7fb29c0d3980 msgr2=0x7fb29c0d3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:21.093 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.081+0000 7fb2a16e5700 1 -- 172.21.15.149:0/1437072407 shutdown_connections 2023-11-08T19:28:21.093 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.081+0000 7fb2a16e5700 1 -- 172.21.15.149:0/1437072407 wait complete. 2023-11-08T19:28:21.094 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.082+0000 7fb2a16e5700 1 Processor -- start 2023-11-08T19:28:21.094 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.082+0000 7fb2a16e5700 1 -- start start 2023-11-08T19:28:21.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.083+0000 7fb2a16e5700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb284003a00 0x7fb29c0c6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:21.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.083+0000 7fb2a16e5700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb29c157890 0x7fb29c157d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:21.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.083+0000 7fb2a16e5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb29c1e8df0 0x7fb29c1e9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:21.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.083+0000 7fb2a16e5700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb29c1e9e00 con 0x7fb29c1e8df0 2023-11-08T19:28:21.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.083+0000 7fb2a16e5700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb29c158250 con 0x7fb29c157890 2023-11-08T19:28:21.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.083+0000 7fb2a16e5700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb29c1e9b20 con 0x7fb284003a00 2023-11-08T19:28:21.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.083+0000 7fb29b7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb29c1e8df0 0x7fb29c1e9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:21.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.083+0000 7fb29b7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb29c1e8df0 0x7fb29c1e9270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44500/0 (socket says 172.21.15.149:44500) 2023-11-08T19:28:21.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.083+0000 7fb29b7fe700 1 -- 172.21.15.149:0/90286768 learned_addr learned my addr 172.21.15.149:0/90286768 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:28:21.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.083+0000 7fb29affd700 1 --2- 172.21.15.149:0/90286768 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb284003a00 0x7fb29c0c6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:21.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.083+0000 7fb29a7fc700 1 --2- 172.21.15.149:0/90286768 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb29c157890 0x7fb29c157d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:21.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.083+0000 7fb29b7fe700 1 -- 172.21.15.149:0/90286768 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb284003a00 msgr2=0x7fb29c0c6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:21.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.083+0000 7fb29b7fe700 1 --2- 172.21.15.149:0/90286768 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb284003a00 0x7fb29c0c6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:21.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.083+0000 7fb29b7fe700 1 -- 172.21.15.149:0/90286768 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb29c157890 msgr2=0x7fb29c157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:21.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.083+0000 7fb29b7fe700 1 --2- 172.21.15.149:0/90286768 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb29c157890 0x7fb29c157d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:21.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.083+0000 7fb29b7fe700 1 -- 172.21.15.149:0/90286768 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb29c0cb840 con 0x7fb29c1e8df0 2023-11-08T19:28:21.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.083+0000 7fb29a7fc700 1 --2- 172.21.15.149:0/90286768 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb29c157890 0x7fb29c157d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:28:21.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.084+0000 7fb29b7fe700 1 --2- 172.21.15.149:0/90286768 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb29c1e8df0 0x7fb29c1e9270 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fb29c08b830 tx=0x7fb29400ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:21.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.084+0000 7fb2837fe700 1 -- 172.21.15.149:0/90286768 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb294003c10 con 0x7fb29c1e8df0 2023-11-08T19:28:21.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.084+0000 7fb2837fe700 1 -- 172.21.15.149:0/90286768 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb294003d70 con 0x7fb29c1e8df0 2023-11-08T19:28:21.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.084+0000 7fb2a16e5700 1 -- 172.21.15.149:0/90286768 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb29c0cbb20 con 0x7fb29c1e8df0 2023-11-08T19:28:21.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.084+0000 7fb2837fe700 1 -- 172.21.15.149:0/90286768 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb294005310 con 0x7fb29c1e8df0 2023-11-08T19:28:21.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.084+0000 7fb2a16e5700 1 -- 172.21.15.149:0/90286768 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb29c1e97b0 con 0x7fb29c1e8df0 2023-11-08T19:28:21.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.085+0000 7fb2a16e5700 1 -- 172.21.15.149:0/90286768 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb29c0cb6a0 con 0x7fb29c1e8df0 2023-11-08T19:28:21.103 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.085+0000 7fb2837fe700 1 -- 172.21.15.149:0/90286768 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb294005470 con 0x7fb29c1e8df0 2023-11-08T19:28:21.103 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.086+0000 7fb2837fe700 1 --2- 172.21.15.149:0/90286768 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb28806af00 0x7fb28806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:21.103 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.086+0000 7fb2837fe700 1 -- 172.21.15.149:0/90286768 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7350+0+0 (secure 0 0 0) 0x7fb294089bd0 con 0x7fb29c1e8df0 2023-11-08T19:28:21.103 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.086+0000 7fb29affd700 1 --2- 172.21.15.149:0/90286768 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb28806af00 0x7fb28806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:21.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.086+0000 7fb29affd700 1 --2- 172.21.15.149:0/90286768 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb28806af00 0x7fb28806d3c0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fb290000c00 tx=0x7fb290008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:21.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.091+0000 7fb2837fe700 1 -- 172.21.15.149:0/90286768 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb29c0cb6a0 con 0x7fb29c1e8df0 2023-11-08T19:28:21.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.325+0000 7fb2a16e5700 1 -- 172.21.15.149:0/90286768 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb29c0cc040 con 0x7fb29c1e8df0 2023-11-08T19:28:21.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.326+0000 7fb2837fe700 1 -- 172.21.15.149:0/90286768 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4938 (secure 0 0 0) 0x7fb29c0cc040 con 0x7fb29c1e8df0 2023-11-08T19:28:21.328 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:28:21.328 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":76,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6095,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/852710262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":852710262},{"type":"v1","addr":"172.21.15.160:6835","nonce":852710262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64},{"gid":7578,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/295381437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":295381437},{"type":"v1","addr":"172.21.15.149:6836","nonce":295381437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:28:09.062237+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6451,"mds_1":7125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6451":{"gid":6451,"name":"d","rank":0,"incarnation":71,"state":"up:active","state_seq":24,"addr":"172.21.15.160:6834/2947079163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2947079163},{"type":"v1","addr":"172.21.15.160:6834","nonce":2947079163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7125":{"gid":7125,"name":"c","rank":1,"incarnation":57,"state":"up:active","state_seq":6,"addr":"172.21.15.149:6837/3917392643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3917392643},{"type":"v1","addr":"172.21.15.149:6837","nonce":3917392643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:28:21.330 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.328+0000 7fb2a16e5700 1 -- 172.21.15.149:0/90286768 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb28806af00 msgr2=0x7fb28806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:21.330 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.328+0000 7fb2a16e5700 1 --2- 172.21.15.149:0/90286768 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb28806af00 0x7fb28806d3c0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fb290000c00 tx=0x7fb290008030 comp rx=0 tx=0).stop 2023-11-08T19:28:21.330 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.328+0000 7fb2a16e5700 1 -- 172.21.15.149:0/90286768 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb29c1e8df0 msgr2=0x7fb29c1e9270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:21.330 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.328+0000 7fb2a16e5700 1 --2- 172.21.15.149:0/90286768 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb29c1e8df0 0x7fb29c1e9270 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fb29c08b830 tx=0x7fb29400ee00 comp rx=0 tx=0).stop 2023-11-08T19:28:21.330 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.328+0000 7fb2a16e5700 1 -- 172.21.15.149:0/90286768 shutdown_connections 2023-11-08T19:28:21.331 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.328+0000 7fb2a16e5700 1 --2- 172.21.15.149:0/90286768 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb28806af00 0x7fb28806d3c0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:21.331 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.328+0000 7fb2a16e5700 1 --2- 172.21.15.149:0/90286768 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb29c1e8df0 0x7fb29c1e9270 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:21.331 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.328+0000 7fb2a16e5700 1 --2- 172.21.15.149:0/90286768 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb284003a00 0x7fb29c0c6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:21.331 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.328+0000 7fb2a16e5700 1 --2- 172.21.15.149:0/90286768 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb29c157890 0x7fb29c157d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:21.331 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.328+0000 7fb2a16e5700 1 -- 172.21.15.149:0/90286768 >> 172.21.15.149:0/90286768 conn(0x7fb29c0d3980 msgr2=0x7fb29c0b04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:21.332 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.328+0000 7fb2a16e5700 1 -- 172.21.15.149:0/90286768 shutdown_connections 2023-11-08T19:28:21.332 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:21.328+0000 7fb2a16e5700 1 -- 172.21.15.149:0/90286768 wait complete. 2023-11-08T19:28:21.332 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 76 2023-11-08T19:28:21.342 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-08T19:28:24.812 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~13s 2023-11-08T19:28:26.343 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:28:26.473 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.472+0000 7f536f6f2700 1 Processor -- start 2023-11-08T19:28:26.473 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.472+0000 7f536f6f2700 1 -- start start 2023-11-08T19:28:26.476 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.473+0000 7f536f6f2700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f53680cc140 0x7f53680cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:26.476 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.473+0000 7f536f6f2700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53680cce50 con 0x7f53680b2850 2023-11-08T19:28:26.476 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.473+0000 7f536f6f2700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53680cc520 con 0x7f53680b2cd0 2023-11-08T19:28:26.476 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.473+0000 7f536f6f2700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53680b2430 con 0x7f53680cc140 2023-11-08T19:28:26.476 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.473+0000 7f536d48e700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f53680cc140 0x7f53680cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:26.477 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.473+0000 7f536cc8d700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f53680b2850 0x7f53680cabf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:46510/0 (socket says 172.21.15.149:46510) 2023-11-08T19:28:26.477 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.473+0000 7f536cc8d700 1 -- 172.21.15.149:0/1629522393 learned_addr learned my addr 172.21.15.149:0/1629522393 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:28:26.477 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.473+0000 7f535ffff700 1 -- 172.21.15.149:0/1629522393 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3458123364 0 0) 0x7f53680cce50 con 0x7f53680b2850 2023-11-08T19:28:26.477 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.473+0000 7f535ffff700 1 -- 172.21.15.149:0/1629522393 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53540035b0 con 0x7f53680b2850 2023-11-08T19:28:26.477 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.473+0000 7f536d48e700 1 -- 172.21.15.149:0/1629522393 >> v1:172.21.15.160:6789/0 conn(0x7f53680b2cd0 legacy=0x7f536815d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:26.478 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.473+0000 7f536d48e700 1 -- 172.21.15.149:0/1629522393 >> v1:172.21.15.149:6789/0 conn(0x7f53680b2850 legacy=0x7f53680cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:26.478 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.473+0000 7f536d48e700 1 -- 172.21.15.149:0/1629522393 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53680b17b0 con 0x7f53680cc140 2023-11-08T19:28:26.478 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.473+0000 7f536d48e700 1 --2- 172.21.15.149:0/1629522393 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53680cc140 0x7f53680cc910 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f5364009820 tx=0x7f5364009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c12b49f2fd739a6 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:26.478 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.474+0000 7f535ffff700 1 -- 172.21.15.149:0/1629522393 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5364005e30 con 0x7f53680cc140 2023-11-08T19:28:26.478 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.474+0000 7f535ffff700 1 -- 172.21.15.149:0/1629522393 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5364004030 con 0x7f53680cc140 2023-11-08T19:28:26.479 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.474+0000 7f535ffff700 1 -- 172.21.15.149:0/1629522393 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53640043c0 con 0x7f53680cc140 2023-11-08T19:28:26.479 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.474+0000 7f536f6f2700 1 -- 172.21.15.149:0/1629522393 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53680cc140 msgr2=0x7f53680cc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:26.479 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.474+0000 7f536f6f2700 1 --2- 172.21.15.149:0/1629522393 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53680cc140 0x7f53680cc910 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f5364009820 tx=0x7f5364009b30 comp rx=0 tx=0).stop 2023-11-08T19:28:26.479 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.474+0000 7f536f6f2700 1 -- 172.21.15.149:0/1629522393 shutdown_connections 2023-11-08T19:28:26.479 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.474+0000 7f536f6f2700 1 --2- 172.21.15.149:0/1629522393 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53680cc140 0x7f53680cc910 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:26.480 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.474+0000 7f536f6f2700 1 -- 172.21.15.149:0/1629522393 >> 172.21.15.149:0/1629522393 conn(0x7f5368099a40 msgr2=0x7f53680d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:26.480 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.474+0000 7f536f6f2700 1 -- 172.21.15.149:0/1629522393 shutdown_connections 2023-11-08T19:28:26.480 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.474+0000 7f536f6f2700 1 -- 172.21.15.149:0/1629522393 wait complete. 2023-11-08T19:28:26.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.475+0000 7f536f6f2700 1 Processor -- start 2023-11-08T19:28:26.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.475+0000 7f536f6f2700 1 -- start start 2023-11-08T19:28:26.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.476+0000 7f536f6f2700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53680b2850 0x7f5368156a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:26.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.476+0000 7f536f6f2700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53680b2cd0 0x7f5368155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:26.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.476+0000 7f536f6f2700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53680cc140 0x7f536809c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:26.484 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.476+0000 7f536f6f2700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f536809b510 con 0x7f53680b2850 2023-11-08T19:28:26.484 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.476+0000 7f536f6f2700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f536809a890 con 0x7f53680b2cd0 2023-11-08T19:28:26.484 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.476+0000 7f536f6f2700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f536809ab70 con 0x7f53680cc140 2023-11-08T19:28:26.484 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.476+0000 7f536d48e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53680b2850 0x7f5368156a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:26.484 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.476+0000 7f536d48e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53680b2850 0x7f5368156a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44512/0 (socket says 172.21.15.149:44512) 2023-11-08T19:28:26.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.476+0000 7f536d48e700 1 -- 172.21.15.149:0/591794768 learned_addr learned my addr 172.21.15.149:0/591794768 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:28:26.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.476+0000 7f536dc8f700 1 --2- 172.21.15.149:0/591794768 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53680cc140 0x7f536809c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:26.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.476+0000 7f536cc8d700 1 --2- 172.21.15.149:0/591794768 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53680b2cd0 0x7f5368155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:26.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.477+0000 7f536d48e700 1 -- 172.21.15.149:0/591794768 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53680cc140 msgr2=0x7f536809c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:26.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.477+0000 7f536d48e700 1 --2- 172.21.15.149:0/591794768 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53680cc140 0x7f536809c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:26.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.477+0000 7f536d48e700 1 -- 172.21.15.149:0/591794768 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53680b2cd0 msgr2=0x7f5368155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:26.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.477+0000 7f536d48e700 1 --2- 172.21.15.149:0/591794768 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53680b2cd0 0x7f5368155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:26.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.477+0000 7f536d48e700 1 -- 172.21.15.149:0/591794768 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5364009430 con 0x7f53680b2850 2023-11-08T19:28:26.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.477+0000 7f536dc8f700 1 --2- 172.21.15.149:0/591794768 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53680cc140 0x7f536809c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:28:26.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.477+0000 7f536d48e700 1 --2- 172.21.15.149:0/591794768 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53680b2850 0x7f5368156a40 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f5364000c00 tx=0x7f5364004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:26.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.477+0000 7f535dffb700 1 -- 172.21.15.149:0/591794768 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f536401c620 con 0x7f53680b2850 2023-11-08T19:28:26.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.477+0000 7f535dffb700 1 -- 172.21.15.149:0/591794768 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f536401c780 con 0x7f53680b2850 2023-11-08T19:28:26.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.477+0000 7f536f6f2700 1 -- 172.21.15.149:0/591794768 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f536809ae50 con 0x7f53680b2850 2023-11-08T19:28:26.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.477+0000 7f535dffb700 1 -- 172.21.15.149:0/591794768 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f536401caf0 con 0x7f53680b2850 2023-11-08T19:28:26.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.477+0000 7f536f6f2700 1 -- 172.21.15.149:0/591794768 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5368156f80 con 0x7f53680b2850 2023-11-08T19:28:26.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.478+0000 7f536f6f2700 1 -- 172.21.15.149:0/591794768 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f536809b650 con 0x7f53680b2850 2023-11-08T19:28:26.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.478+0000 7f535dffb700 1 -- 172.21.15.149:0/591794768 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f536401cc50 con 0x7f53680b2850 2023-11-08T19:28:26.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.479+0000 7f535dffb700 1 --2- 172.21.15.149:0/591794768 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f534c06af00 0x7f534c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:26.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.479+0000 7f535dffb700 1 -- 172.21.15.149:0/591794768 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7350+0+0 (secure 0 0 0) 0x7f536408aed0 con 0x7f53680b2850 2023-11-08T19:28:26.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.479+0000 7f536cc8d700 1 --2- 172.21.15.149:0/591794768 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f534c06af00 0x7f534c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:26.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.479+0000 7f536cc8d700 1 --2- 172.21.15.149:0/591794768 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f534c06af00 0x7f534c06d3c0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f5368157260 tx=0x7f5358009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:26.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.484+0000 7f535dffb700 1 -- 172.21.15.149:0/591794768 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f536809b650 con 0x7f53680b2850 2023-11-08T19:28:26.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.714+0000 7f536f6f2700 1 -- 172.21.15.149:0/591794768 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f536809b650 con 0x7f53680b2850 2023-11-08T19:28:26.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.715+0000 7f535dffb700 1 -- 172.21.15.149:0/591794768 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) v1 ==== 94+0+4986 (secure 0 0 0) 0x7f536809b650 con 0x7f53680b2850 2023-11-08T19:28:26.716 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:28:26.717 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":77,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6095,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/852710262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":852710262},{"type":"v1","addr":"172.21.15.160:6835","nonce":852710262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64},{"gid":7578,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/295381437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":295381437},{"type":"v1","addr":"172.21.15.149:6836","nonce":295381437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:28:24.142779+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6451,"mds_1":7125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6451":{"gid":6451,"name":"d","rank":0,"incarnation":71,"state":"up:active","state_seq":24,"addr":"172.21.15.160:6834/2947079163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2947079163},{"type":"v1","addr":"172.21.15.160:6834","nonce":2947079163}]},"join_fscid":-1,"laggy_since":"2023-11-08T19:28:24.142779+0000","export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7125":{"gid":7125,"name":"c","rank":1,"incarnation":57,"state":"up:active","state_seq":6,"addr":"172.21.15.149:6837/3917392643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3917392643},{"type":"v1","addr":"172.21.15.149:6837","nonce":3917392643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:28:26.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.717+0000 7f536f6f2700 1 -- 172.21.15.149:0/591794768 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f534c06af00 msgr2=0x7f534c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:26.719 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.717+0000 7f536f6f2700 1 --2- 172.21.15.149:0/591794768 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f534c06af00 0x7f534c06d3c0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f5368157260 tx=0x7f5358009040 comp rx=0 tx=0).stop 2023-11-08T19:28:26.719 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.717+0000 7f536f6f2700 1 -- 172.21.15.149:0/591794768 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53680b2850 msgr2=0x7f5368156a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:26.719 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.717+0000 7f536f6f2700 1 --2- 172.21.15.149:0/591794768 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53680b2850 0x7f5368156a40 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f5364000c00 tx=0x7f5364004750 comp rx=0 tx=0).stop 2023-11-08T19:28:26.719 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.717+0000 7f536f6f2700 1 -- 172.21.15.149:0/591794768 shutdown_connections 2023-11-08T19:28:26.719 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.717+0000 7f536f6f2700 1 --2- 172.21.15.149:0/591794768 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f534c06af00 0x7f534c06d3c0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:26.720 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.717+0000 7f536f6f2700 1 --2- 172.21.15.149:0/591794768 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53680cc140 0x7f536809c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:26.720 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.717+0000 7f536f6f2700 1 --2- 172.21.15.149:0/591794768 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53680b2850 0x7f5368156a40 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:26.720 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.717+0000 7f536f6f2700 1 --2- 172.21.15.149:0/591794768 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53680b2cd0 0x7f5368155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:26.720 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.717+0000 7f536f6f2700 1 -- 172.21.15.149:0/591794768 >> 172.21.15.149:0/591794768 conn(0x7f5368099a40 msgr2=0x7f536806ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:26.720 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.717+0000 7f536f6f2700 1 -- 172.21.15.149:0/591794768 shutdown_connections 2023-11-08T19:28:26.721 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:26.717+0000 7f536f6f2700 1 -- 172.21.15.149:0/591794768 wait complete. 2023-11-08T19:28:26.721 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 77 2023-11-08T19:28:26.731 DEBUG:tasks.ceph_test_case:wait_until_true: success in 15s and 0 retries 2023-11-08T19:28:26.731 DEBUG:teuthology.orchestra.run.smithi160:> sudo sysctl -n kernel.core_pattern 2023-11-08T19:28:26.764 INFO:teuthology.orchestra.run.smithi160.stdout:/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-08T19:28:26.766 INFO:tasks.cephfs.cephfs_test_case:Clearing core from directory: /home/ubuntu/cephtest/archive/coredump 2023-11-08T19:28:26.766 DEBUG:teuthology.orchestra.run.smithi160:> cd /home/ubuntu/cephtest/archive/coredump && sudo ls | sudo xargs file 2023-11-08T19:28:26.842 INFO:teuthology.orchestra.run.smithi160.stdout:1699471690.113320.core: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i d', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/bin/ceph-mds', platform: 'x86_64' 2023-11-08T19:28:26.844 INFO:tasks.cephfs.cephfs_test_case:Enumerated cores: ['1699471690.113320.core'] 2023-11-08T19:28:26.844 INFO:tasks.cephfs.cephfs_test_case:Found core file 1699471690.113320.core, deleting it 2023-11-08T19:28:26.845 DEBUG:teuthology.orchestra.run.smithi160:> cd /home/ubuntu/cephtest/archive/coredump && sudo rm -f 1699471690.113320.core 2023-11-08T19:28:26.918 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 6:0 2023-11-08T19:28:27.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.041+0000 7f3460825700 1 Processor -- start 2023-11-08T19:28:27.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.041+0000 7f3460825700 1 -- start start 2023-11-08T19:28:27.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.042+0000 7f3460825700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f345c0ce850 0x7f345c0cca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:27.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.042+0000 7f3460825700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f345c0d04f0 con 0x7f345c0b2b60 2023-11-08T19:28:27.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.042+0000 7f3460825700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f345c0cbeb0 con 0x7f345c15df40 2023-11-08T19:28:27.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.042+0000 7f3460825700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f345c0d0740 con 0x7f345c0ce850 2023-11-08T19:28:27.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.042+0000 7f3459d9b700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f345c0b2b60 0x7f345c0cc340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:46524/0 (socket says 172.21.15.149:46524) 2023-11-08T19:28:27.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.042+0000 7f3459d9b700 1 -- 172.21.15.149:0/978909443 learned_addr learned my addr 172.21.15.149:0/978909443 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:28:27.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.042+0000 7f345ad9d700 1 --2- 172.21.15.149:0/978909443 >> v2:172.21.15.160:3300/0 conn(0x7f345c0ce850 0x7f345c0cca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:27.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.043+0000 7f345959a700 1 -- 172.21.15.149:0/978909443 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 902553651 0 0) 0x7f345c0d04f0 con 0x7f345c0b2b60 2023-11-08T19:28:27.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.043+0000 7f345959a700 1 -- 172.21.15.149:0/978909443 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34440035b0 con 0x7f345c0b2b60 2023-11-08T19:28:27.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.043+0000 7f345959a700 1 -- 172.21.15.149:0/978909443 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1447111003 0 0) 0x7f345c0cbeb0 con 0x7f345c15df40 2023-11-08T19:28:27.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.043+0000 7f345959a700 1 -- 172.21.15.149:0/978909443 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f345c0d04f0 con 0x7f345c15df40 2023-11-08T19:28:27.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.043+0000 7f345959a700 1 -- 172.21.15.149:0/978909443 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1319802222 0 0) 0x7f34440035b0 con 0x7f345c0b2b60 2023-11-08T19:28:27.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.043+0000 7f345ad9d700 1 -- 172.21.15.149:0/978909443 >> v1:172.21.15.160:6789/0 conn(0x7f345c15df40 legacy=0x7f345c0ce140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:27.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.043+0000 7f345ad9d700 1 -- 172.21.15.149:0/978909443 >> v1:172.21.15.149:6789/0 conn(0x7f345c0b2b60 legacy=0x7f345c0cc340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:27.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.043+0000 7f345ad9d700 1 -- 172.21.15.149:0/978909443 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f345c0d0a20 con 0x7f345c0ce850 2023-11-08T19:28:27.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.043+0000 7f345ad9d700 1 --2- 172.21.15.149:0/978909443 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f345c0ce850 0x7f345c0cca50 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f3454009d90 tx=0x7f345400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b7cd7b5547898d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:27.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.043+0000 7f345959a700 1 -- 172.21.15.149:0/978909443 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345400e070 con 0x7f345c0ce850 2023-11-08T19:28:27.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.043+0000 7f345959a700 1 -- 172.21.15.149:0/978909443 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3454003a20 con 0x7f345c0ce850 2023-11-08T19:28:27.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.043+0000 7f345959a700 1 -- 172.21.15.149:0/978909443 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344c001670 con 0x7f345c0ce850 2023-11-08T19:28:27.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.044+0000 7f3460825700 1 -- 172.21.15.149:0/978909443 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f345c0ce850 msgr2=0x7f345c0cca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:27.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.044+0000 7f3460825700 1 --2- 172.21.15.149:0/978909443 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f345c0ce850 0x7f345c0cca50 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f3454009d90 tx=0x7f345400b330 comp rx=0 tx=0).stop 2023-11-08T19:28:27.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.044+0000 7f3460825700 1 -- 172.21.15.149:0/978909443 shutdown_connections 2023-11-08T19:28:27.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.044+0000 7f3460825700 1 --2- 172.21.15.149:0/978909443 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f345c0ce850 0x7f345c0cca50 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:27.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.044+0000 7f3460825700 1 -- 172.21.15.149:0/978909443 >> 172.21.15.149:0/978909443 conn(0x7f345c0d1730 msgr2=0x7f345c0d1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:27.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.044+0000 7f3460825700 1 -- 172.21.15.149:0/978909443 shutdown_connections 2023-11-08T19:28:27.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.044+0000 7f3460825700 1 -- 172.21.15.149:0/978909443 wait complete. 2023-11-08T19:28:27.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.045+0000 7f3460825700 1 Processor -- start 2023-11-08T19:28:27.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.045+0000 7f3460825700 1 -- start start 2023-11-08T19:28:27.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.046+0000 7f3460825700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f345c0b2b60 0x7f345c0b5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:27.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.046+0000 7f3460825700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f345c0ce850 0x7f345c0c5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:27.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.046+0000 7f3460825700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f345c15df40 0x7f345c1e3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:27.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.046+0000 7f3460825700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f345c0c64a0 con 0x7f345c0ce850 2023-11-08T19:28:27.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.046+0000 7f3460825700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f345c0c6780 con 0x7f345c0b2b60 2023-11-08T19:28:27.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.046+0000 7f3460825700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f345c0c6a60 con 0x7f345c15df40 2023-11-08T19:28:27.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.046+0000 7f3459d9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f345c0ce850 0x7f345c0c5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:27.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.046+0000 7f3459d9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f345c0ce850 0x7f345c0c5c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44528/0 (socket says 172.21.15.149:44528) 2023-11-08T19:28:27.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.046+0000 7f3459d9b700 1 -- 172.21.15.149:0/54747147 learned_addr learned my addr 172.21.15.149:0/54747147 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:28:27.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.046+0000 7f345a59c700 1 --2- 172.21.15.149:0/54747147 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f345c0b2b60 0x7f345c0b5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:27.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.046+0000 7f345ad9d700 1 --2- 172.21.15.149:0/54747147 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f345c15df40 0x7f345c1e3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:27.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.046+0000 7f3459d9b700 1 -- 172.21.15.149:0/54747147 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f345c15df40 msgr2=0x7f345c1e3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:27.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.046+0000 7f3459d9b700 1 --2- 172.21.15.149:0/54747147 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f345c15df40 0x7f345c1e3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:27.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.046+0000 7f3459d9b700 1 -- 172.21.15.149:0/54747147 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f345c0b2b60 msgr2=0x7f345c0b5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:27.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.046+0000 7f3459d9b700 1 --2- 172.21.15.149:0/54747147 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f345c0b2b60 0x7f345c0b5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:27.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.046+0000 7f3459d9b700 1 -- 172.21.15.149:0/54747147 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3454009a70 con 0x7f345c0ce850 2023-11-08T19:28:27.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.046+0000 7f345a59c700 1 --2- 172.21.15.149:0/54747147 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f345c0b2b60 0x7f345c0b5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:28:27.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.047+0000 7f3459d9b700 1 --2- 172.21.15.149:0/54747147 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f345c0ce850 0x7f345c0c5c70 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f344c00c750 tx=0x7f344c00cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:27.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.047+0000 7f344affd700 1 -- 172.21.15.149:0/54747147 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344c007560 con 0x7f345c0ce850 2023-11-08T19:28:27.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.047+0000 7f344affd700 1 -- 172.21.15.149:0/54747147 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f344c0076c0 con 0x7f345c0ce850 2023-11-08T19:28:27.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.047+0000 7f344affd700 1 -- 172.21.15.149:0/54747147 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344c004a70 con 0x7f345c0ce850 2023-11-08T19:28:27.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.047+0000 7f3460825700 1 -- 172.21.15.149:0/54747147 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f345c15e4a0 con 0x7f345c0ce850 2023-11-08T19:28:27.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.047+0000 7f3460825700 1 -- 172.21.15.149:0/54747147 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f345c0c61b0 con 0x7f345c0ce850 2023-11-08T19:28:27.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.048+0000 7f3460825700 1 -- 172.21.15.149:0/54747147 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f345c0745f0 con 0x7f345c0ce850 2023-11-08T19:28:27.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.048+0000 7f344affd700 1 -- 172.21.15.149:0/54747147 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f344c004bd0 con 0x7f345c0ce850 2023-11-08T19:28:27.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.049+0000 7f344affd700 1 --2- 172.21.15.149:0/54747147 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f343c06af00 0x7f343c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:27.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.049+0000 7f344affd700 1 -- 172.21.15.149:0/54747147 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7350+0+0 (secure 0 0 0) 0x7f344c089120 con 0x7f345c0ce850 2023-11-08T19:28:27.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.049+0000 7f345a59c700 1 --2- 172.21.15.149:0/54747147 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f343c06af00 0x7f343c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:27.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.049+0000 7f345a59c700 1 --2- 172.21.15.149:0/54747147 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f343c06af00 0x7f343c06d3c0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f3450001230 tx=0x7f3450009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:27.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.053+0000 7f344affd700 1 -- 172.21.15.149:0/54747147 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f344c053bf0 con 0x7f345c0ce850 2023-11-08T19:28:27.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.324+0000 7f3460825700 1 -- 172.21.15.149:0/54747147 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "6:0"} v 0) v1 -- 0x7f345c0cff80 con 0x7f345c0ce850 2023-11-08T19:28:27.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.326+0000 7f344affd700 1 -- 172.21.15.149:0/54747147 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "6:0"}]=0 failed mds gid 6451 v78) v1 ==== 97+0+0 (secure 0 0 0) 0x7f344c057210 con 0x7f345c0ce850 2023-11-08T19:28:27.330 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.329+0000 7f3460825700 1 -- 172.21.15.149:0/54747147 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f343c06af00 msgr2=0x7f343c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:27.330 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.329+0000 7f3460825700 1 --2- 172.21.15.149:0/54747147 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f343c06af00 0x7f343c06d3c0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f3450001230 tx=0x7f3450009040 comp rx=0 tx=0).stop 2023-11-08T19:28:27.331 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.329+0000 7f3460825700 1 -- 172.21.15.149:0/54747147 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f345c0ce850 msgr2=0x7f345c0c5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:27.331 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.329+0000 7f3460825700 1 --2- 172.21.15.149:0/54747147 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f345c0ce850 0x7f345c0c5c70 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f344c00c750 tx=0x7f344c00cb10 comp rx=0 tx=0).stop 2023-11-08T19:28:27.331 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.329+0000 7f3460825700 1 -- 172.21.15.149:0/54747147 shutdown_connections 2023-11-08T19:28:27.331 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.329+0000 7f3460825700 1 --2- 172.21.15.149:0/54747147 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f343c06af00 0x7f343c06d3c0 secure :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f3450001230 tx=0x7f3450009040 comp rx=0 tx=0).stop 2023-11-08T19:28:27.331 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.329+0000 7f3460825700 1 --2- 172.21.15.149:0/54747147 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f345c0b2b60 0x7f345c0b5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:27.332 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.329+0000 7f3460825700 1 --2- 172.21.15.149:0/54747147 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f345c15df40 0x7f345c1e3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:27.332 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.329+0000 7f3460825700 1 --2- 172.21.15.149:0/54747147 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f345c0ce850 0x7f345c0c5c70 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:27.332 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.329+0000 7f3460825700 1 -- 172.21.15.149:0/54747147 >> 172.21.15.149:0/54747147 conn(0x7f345c0d1730 msgr2=0x7f345c15cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:27.332 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.329+0000 7f3460825700 1 -- 172.21.15.149:0/54747147 shutdown_connections 2023-11-08T19:28:27.332 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.329+0000 7f3460825700 1 -- 172.21.15.149:0/54747147 wait complete. 2023-11-08T19:28:27.333 INFO:teuthology.orchestra.run.smithi149.stderr:failed mds gid 6451 2023-11-08T19:28:27.345 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-08T19:28:27.345 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-08T19:28:27.346 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-08T19:28:27.346 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T19:28:27.347 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-08T19:28:27.347 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi160 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' 2023-11-08T19:28:27.348 INFO:tasks.ceph.mds.d:Stopped 2023-11-08T19:28:27.348 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-08T19:28:27.350 INFO:tasks.ceph.mds.d:Started 2023-11-08T19:28:27.351 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:28:27.435 INFO:tasks.ceph.mds.d.smithi160.stdout:starting mds.d at 2023-11-08T19:28:27.473 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.472+0000 7fe1d9332700 1 Processor -- start 2023-11-08T19:28:27.473 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.472+0000 7fe1d9332700 1 -- start start 2023-11-08T19:28:27.476 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.473+0000 7fe1d9332700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1d4161670 0x7fe1d40b5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:27.477 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.473+0000 7fe1d9332700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe1d40ce500 0x7fe1d40ce990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:27.477 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.473+0000 7fe1d9332700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1d40d1a10 con 0x7fe1d4161a50 2023-11-08T19:28:27.477 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.473+0000 7fe1d9332700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1d40d1cf0 con 0x7fe1d40ce500 2023-11-08T19:28:27.477 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.473+0000 7fe1d9332700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d40d1fd0 con 0x7fe1d4161670 2023-11-08T19:28:27.477 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.473+0000 7fe1d37fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe1d40ce500 0x7fe1d40ce990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:27.478 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.473+0000 7fe1d27fc700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fe1d4161a50 0x7fe1d4161ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:46550/0 (socket says 172.21.15.149:46550) 2023-11-08T19:28:27.478 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.473+0000 7fe1d27fc700 1 -- 172.21.15.149:0/1110525037 learned_addr learned my addr 172.21.15.149:0/1110525037 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:28:27.478 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.473+0000 7fe1d2ffd700 1 --2- 172.21.15.149:0/1110525037 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1d4161670 0x7fe1d40b5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:27.478 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.473+0000 7fe1d37fe700 1 -- 172.21.15.149:0/1110525037 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1d4161670 msgr2=0x7fe1d40b5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:27.479 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.473+0000 7fe1d37fe700 1 --2- 172.21.15.149:0/1110525037 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1d4161670 0x7fe1d40b5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:27.479 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.473+0000 7fe1d37fe700 1 -- 172.21.15.149:0/1110525037 >> v1:172.21.15.149:6789/0 conn(0x7fe1d4161a50 legacy=0x7fe1d4161ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:27.479 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.473+0000 7fe1d1ffb700 1 -- 172.21.15.149:0/1110525037 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 977968684 0 0) 0x7fe1d40d1a10 con 0x7fe1d4161a50 2023-11-08T19:28:27.480 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.473+0000 7fe1d37fe700 1 -- 172.21.15.149:0/1110525037 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d40d22b0 con 0x7fe1d40ce500 2023-11-08T19:28:27.480 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.473+0000 7fe1d37fe700 1 --2- 172.21.15.149:0/1110525037 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1d40ce500 0x7fe1d40ce990 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc009d90 tx=0x7fe1cc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bb03be32f992581 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:27.481 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.474+0000 7fe1d1ffb700 1 -- 172.21.15.149:0/1110525037 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc00e070 con 0x7fe1d40ce500 2023-11-08T19:28:27.481 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.474+0000 7fe1d1ffb700 1 -- 172.21.15.149:0/1110525037 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1cc00bbd0 con 0x7fe1d40ce500 2023-11-08T19:28:27.481 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.474+0000 7fe1d1ffb700 1 -- 172.21.15.149:0/1110525037 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc012430 con 0x7fe1d40ce500 2023-11-08T19:28:27.482 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.474+0000 7fe1d9332700 1 -- 172.21.15.149:0/1110525037 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1d40ce500 msgr2=0x7fe1d40ce990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:27.482 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.474+0000 7fe1d9332700 1 --2- 172.21.15.149:0/1110525037 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1d40ce500 0x7fe1d40ce990 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc009d90 tx=0x7fe1cc00b330 comp rx=0 tx=0).stop 2023-11-08T19:28:27.482 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.474+0000 7fe1d9332700 1 -- 172.21.15.149:0/1110525037 shutdown_connections 2023-11-08T19:28:27.482 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.474+0000 7fe1d9332700 1 --2- 172.21.15.149:0/1110525037 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1d40ce500 0x7fe1d40ce990 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:27.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.474+0000 7fe1d9332700 1 --2- 172.21.15.149:0/1110525037 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1d4161670 0x7fe1d40b5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:27.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.474+0000 7fe1d9332700 1 -- 172.21.15.149:0/1110525037 >> 172.21.15.149:0/1110525037 conn(0x7fe1d40d3980 msgr2=0x7fe1d40d3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:27.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.474+0000 7fe1d9332700 1 -- 172.21.15.149:0/1110525037 shutdown_connections 2023-11-08T19:28:27.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.474+0000 7fe1d9332700 1 -- 172.21.15.149:0/1110525037 wait complete. 2023-11-08T19:28:27.484 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.475+0000 7fe1d9332700 1 Processor -- start 2023-11-08T19:28:27.484 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.476+0000 7fe1d9332700 1 -- start start 2023-11-08T19:28:27.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.476+0000 7fe1d9332700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1d40ce500 0x7fe1d415b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:27.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.476+0000 7fe1d9332700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1d4161670 0x7fe1d40b77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:27.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.476+0000 7fe1d9332700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe1d4161a50 0x7fe1d40cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:27.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.476+0000 7fe1d9332700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d40b8780 con 0x7fe1d4161670 2023-11-08T19:28:27.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.476+0000 7fe1d9332700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d40b64d0 con 0x7fe1d4161a50 2023-11-08T19:28:27.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.476+0000 7fe1d9332700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d40b7330 con 0x7fe1d40ce500 2023-11-08T19:28:27.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.476+0000 7fe1d27fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1d4161670 0x7fe1d40b77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:27.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.476+0000 7fe1d27fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1d4161670 0x7fe1d40b77c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44554/0 (socket says 172.21.15.149:44554) 2023-11-08T19:28:27.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.476+0000 7fe1d27fc700 1 -- 172.21.15.149:0/947545596 learned_addr learned my addr 172.21.15.149:0/947545596 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:28:27.490 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.476+0000 7fe1d2ffd700 1 --2- 172.21.15.149:0/947545596 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1d40ce500 0x7fe1d415b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:27.490 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.476+0000 7fe1d37fe700 1 --2- 172.21.15.149:0/947545596 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe1d4161a50 0x7fe1d40cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:27.490 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.477+0000 7fe1d27fc700 1 -- 172.21.15.149:0/947545596 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1d40ce500 msgr2=0x7fe1d415b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:27.490 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.477+0000 7fe1d27fc700 1 --2- 172.21.15.149:0/947545596 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1d40ce500 0x7fe1d415b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:27.490 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.477+0000 7fe1d27fc700 1 -- 172.21.15.149:0/947545596 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe1d4161a50 msgr2=0x7fe1d40cbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:27.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.477+0000 7fe1d27fc700 1 --2- 172.21.15.149:0/947545596 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe1d4161a50 0x7fe1d40cbf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:27.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.477+0000 7fe1d27fc700 1 -- 172.21.15.149:0/947545596 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1cc009a70 con 0x7fe1d4161670 2023-11-08T19:28:27.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.477+0000 7fe1d27fc700 1 --2- 172.21.15.149:0/947545596 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1d4161670 0x7fe1d40b77c0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7fe1c400c550 tx=0x7fe1c400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:27.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.477+0000 7fe1bb7fe700 1 -- 172.21.15.149:0/947545596 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c4004c80 con 0x7fe1d4161670 2023-11-08T19:28:27.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.477+0000 7fe1bb7fe700 1 -- 172.21.15.149:0/947545596 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1c4004e00 con 0x7fe1d4161670 2023-11-08T19:28:27.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.477+0000 7fe1d9332700 1 -- 172.21.15.149:0/947545596 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1d40b6720 con 0x7fe1d4161670 2023-11-08T19:28:27.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.477+0000 7fe1bb7fe700 1 -- 172.21.15.149:0/947545596 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c4007310 con 0x7fe1d4161670 2023-11-08T19:28:27.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.477+0000 7fe1d9332700 1 -- 172.21.15.149:0/947545596 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1d40b6ce0 con 0x7fe1d4161670 2023-11-08T19:28:27.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.478+0000 7fe1d9332700 1 -- 172.21.15.149:0/947545596 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1d40745f0 con 0x7fe1d4161670 2023-11-08T19:28:27.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.478+0000 7fe1bb7fe700 1 -- 172.21.15.149:0/947545596 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe1c4007470 con 0x7fe1d4161670 2023-11-08T19:28:27.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.479+0000 7fe1bb7fe700 1 --2- 172.21.15.149:0/947545596 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe1c006af00 0x7fe1c006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:27.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.479+0000 7fe1d2ffd700 1 --2- 172.21.15.149:0/947545596 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe1c006af00 0x7fe1c006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:27.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.479+0000 7fe1bb7fe700 1 -- 172.21.15.149:0/947545596 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7436+0+0 (secure 0 0 0) 0x7fe1c40897b0 con 0x7fe1d4161670 2023-11-08T19:28:27.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.479+0000 7fe1d2ffd700 1 --2- 172.21.15.149:0/947545596 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe1c006af00 0x7fe1c006d3c0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fe1c8006fd0 tx=0x7fe1c8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:27.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.484+0000 7fe1bb7fe700 1 -- 172.21.15.149:0/947545596 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe1c4054230 con 0x7fe1d4161670 2023-11-08T19:28:27.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.713+0000 7fe1d9332700 1 -- 172.21.15.149:0/947545596 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe1d408b060 con 0x7fe1d4161670 2023-11-08T19:28:27.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.714+0000 7fe1bb7fe700 1 -- 172.21.15.149:0/947545596 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) v1 ==== 94+0+4143 (secure 0 0 0) 0x7fe1c4057850 con 0x7fe1d4161670 2023-11-08T19:28:27.715 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:28:27.715 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":79,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6095,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/852710262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":852710262},{"type":"v1","addr":"172.21.15.160:6835","nonce":852710262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:28:27.329991+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7578,"mds_1":7125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7125":{"gid":7125,"name":"c","rank":1,"incarnation":57,"state":"up:active","state_seq":6,"addr":"172.21.15.149:6837/3917392643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3917392643},{"type":"v1","addr":"172.21.15.149:6837","nonce":3917392643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7578":{"gid":7578,"name":"a","rank":0,"incarnation":79,"state":"up:replay","state_seq":1,"addr":"172.21.15.149:6836/295381437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":295381437},{"type":"v1","addr":"172.21.15.149:6836","nonce":295381437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:28:27.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.716+0000 7fe1d9332700 1 -- 172.21.15.149:0/947545596 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe1c006af00 msgr2=0x7fe1c006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:27.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.716+0000 7fe1d9332700 1 --2- 172.21.15.149:0/947545596 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe1c006af00 0x7fe1c006d3c0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fe1c8006fd0 tx=0x7fe1c8008040 comp rx=0 tx=0).stop 2023-11-08T19:28:27.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.716+0000 7fe1d9332700 1 -- 172.21.15.149:0/947545596 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1d4161670 msgr2=0x7fe1d40b77c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:27.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.716+0000 7fe1d9332700 1 --2- 172.21.15.149:0/947545596 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1d4161670 0x7fe1d40b77c0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7fe1c400c550 tx=0x7fe1c400c860 comp rx=0 tx=0).stop 2023-11-08T19:28:27.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.716+0000 7fe1d9332700 1 -- 172.21.15.149:0/947545596 shutdown_connections 2023-11-08T19:28:27.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.716+0000 7fe1d9332700 1 --2- 172.21.15.149:0/947545596 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe1c006af00 0x7fe1c006d3c0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:27.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.716+0000 7fe1d9332700 1 --2- 172.21.15.149:0/947545596 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe1d4161a50 0x7fe1d40cbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:27.719 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.716+0000 7fe1d9332700 1 --2- 172.21.15.149:0/947545596 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1d40ce500 0x7fe1d415b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:27.719 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.716+0000 7fe1d9332700 1 --2- 172.21.15.149:0/947545596 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1d4161670 0x7fe1d40b77c0 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:27.719 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.716+0000 7fe1d9332700 1 -- 172.21.15.149:0/947545596 >> 172.21.15.149:0/947545596 conn(0x7fe1d40d3980 msgr2=0x7fe1d40d3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:27.720 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.716+0000 7fe1d9332700 1 -- 172.21.15.149:0/947545596 shutdown_connections 2023-11-08T19:28:27.721 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:27.716+0000 7fe1d9332700 1 -- 172.21.15.149:0/947545596 wait complete. 2023-11-08T19:28:27.721 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 79 2023-11-08T19:28:27.729 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-11-08T19:28:31.525 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-11-08T19:28:31.754 INFO:tasks.ceph.mds.a.smithi149.stderr:2023-11-08T19:28:31.753+0000 7f62ea02f700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-08T19:28:31.755 INFO:tasks.ceph.mds.a.smithi149.stderr:2023-11-08T19:28:31.753+0000 7f62ea02f700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-08T19:28:32.730 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:28:32.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:32.861+0000 7fd6e47e0700 1 Processor -- start 2023-11-08T19:28:32.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:32.861+0000 7fd6e47e0700 1 -- start start 2023-11-08T19:28:32.865 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:32.862+0000 7fd6e47e0700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd6dc15abb0 0x7fd6dc06e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:32.865 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:32.862+0000 7fd6e47e0700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fd6dc06c2a0 0x7fd6dc06ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:32.865 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:32.862+0000 7fd6e47e0700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6dc15af90 con 0x7fd6dc06e7e0 2023-11-08T19:28:32.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:32.862+0000 7fd6e47e0700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6dc06f260 con 0x7fd6dc06c2a0 2023-11-08T19:28:32.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:32.862+0000 7fd6e47e0700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc06d540 con 0x7fd6dc15abb0 2023-11-08T19:28:32.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:32.862+0000 7fd6e2d7d700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fd6dc06c2a0 0x7fd6dc06ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:32.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:32.862+0000 7fd6e257c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd6dc15abb0 0x7fd6dc06e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:32.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:32.862+0000 7fd6e2d7d700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fd6dc06c2a0 0x7fd6dc06ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.149:45558/0 (socket says 172.21.15.149:45558) 2023-11-08T19:28:32.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:32.862+0000 7fd6e2d7d700 1 -- 172.21.15.149:0/646032085 learned_addr learned my addr 172.21.15.149:0/646032085 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:28:32.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:32.862+0000 7fd6e257c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd6dc15abb0 0x7fd6dc06e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.149:36620/0 (socket says 172.21.15.149:36620) 2023-11-08T19:28:32.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:32.862+0000 7fd6e1d7b700 1 --1- 172.21.15.149:0/646032085 >> v1:172.21.15.160:6789/0 conn(0x7fd6dc06e7e0 0x7fd6dc06bb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.149:58232/0 (socket says 172.21.15.149:58232) 2023-11-08T19:28:32.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:32.863+0000 7fd6e2d7d700 1 -- 172.21.15.149:0/646032085 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd6dc15abb0 msgr2=0x7fd6dc06e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:32.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:32.863+0000 7fd6e2d7d700 1 --2- 172.21.15.149:0/646032085 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd6dc15abb0 0x7fd6dc06e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:32.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:32.863+0000 7fd6e2d7d700 1 -- 172.21.15.149:0/646032085 >> v1:172.21.15.160:6789/0 conn(0x7fd6dc06e7e0 legacy=0x7fd6dc06bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:32.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:32.863+0000 7fd6e2d7d700 1 -- 172.21.15.149:0/646032085 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6dc06d820 con 0x7fd6dc06c2a0 2023-11-08T19:28:32.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:32.863+0000 7fd6e2d7d700 1 --2- 172.21.15.149:0/646032085 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd6dc06c2a0 0x7fd6dc06ec60 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd6d400d150 tx=0x7fd6d400d460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99b6dd1e8204ef88 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:32.869 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:32.863+0000 7fd6e157a700 1 -- 172.21.15.149:0/646032085 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d4010070 con 0x7fd6dc06c2a0 2023-11-08T19:28:32.869 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:32.863+0000 7fd6e157a700 1 -- 172.21.15.149:0/646032085 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6d400dd10 con 0x7fd6dc06c2a0 2023-11-08T19:28:32.869 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:32.863+0000 7fd6e157a700 1 -- 172.21.15.149:0/646032085 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d400b310 con 0x7fd6dc06c2a0 2023-11-08T19:28:32.869 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:32.863+0000 7fd6e47e0700 1 -- 172.21.15.149:0/646032085 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd6dc06c2a0 msgr2=0x7fd6dc06ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:32.869 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:32.863+0000 7fd6e47e0700 1 --2- 172.21.15.149:0/646032085 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd6dc06c2a0 0x7fd6dc06ec60 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd6d400d150 tx=0x7fd6d400d460 comp rx=0 tx=0).stop 2023-11-08T19:28:32.870 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:32.864+0000 7fd6e47e0700 1 -- 172.21.15.149:0/646032085 shutdown_connections 2023-11-08T19:28:32.870 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:32.864+0000 7fd6e47e0700 1 --2- 172.21.15.149:0/646032085 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd6dc06c2a0 0x7fd6dc06ec60 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:32.870 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:32.864+0000 7fd6e47e0700 1 --2- 172.21.15.149:0/646032085 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd6dc15abb0 0x7fd6dc06e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:32.870 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:32.864+0000 7fd6e47e0700 1 -- 172.21.15.149:0/646032085 >> 172.21.15.149:0/646032085 conn(0x7fd6dc071720 msgr2=0x7fd6dc071b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:32.871 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:32.864+0000 7fd6e47e0700 1 -- 172.21.15.149:0/646032085 shutdown_connections 2023-11-08T19:28:32.871 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:32.864+0000 7fd6e47e0700 1 -- 172.21.15.149:0/646032085 wait complete. 2023-11-08T19:28:32.874 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:32.865+0000 7fd6e47e0700 1 Processor -- start 2023-11-08T19:28:32.874 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:32.865+0000 7fd6e47e0700 1 -- start start 2023-11-08T19:28:32.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:32.866+0000 7fd6e47e0700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd6dc06c2a0 0x7fd6dc156b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:32.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:32.866+0000 7fd6e47e0700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6dc06e7e0 0x7fd6dc15ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:32.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:32.866+0000 7fd6e47e0700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd6dc15abb0 0x7fd6dc0b3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:32.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:32.866+0000 7fd6e47e0700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc158610 con 0x7fd6dc06e7e0 2023-11-08T19:28:32.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:32.866+0000 7fd6e47e0700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc158840 con 0x7fd6dc15abb0 2023-11-08T19:28:32.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:32.866+0000 7fd6e47e0700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc158b20 con 0x7fd6dc06c2a0 2023-11-08T19:28:32.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:32.866+0000 7fd6e1d7b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6dc06e7e0 0x7fd6dc15ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:32.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:32.866+0000 7fd6e1d7b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6dc06e7e0 0x7fd6dc15ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44570/0 (socket says 172.21.15.149:44570) 2023-11-08T19:28:32.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:32.866+0000 7fd6e1d7b700 1 -- 172.21.15.149:0/2102705982 learned_addr learned my addr 172.21.15.149:0/2102705982 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:28:32.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:32.866+0000 7fd6e257c700 1 --2- 172.21.15.149:0/2102705982 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd6dc06c2a0 0x7fd6dc156b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:32.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:32.866+0000 7fd6e2d7d700 1 --2- 172.21.15.149:0/2102705982 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd6dc15abb0 0x7fd6dc0b3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:32.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:32.866+0000 7fd6e1d7b700 1 -- 172.21.15.149:0/2102705982 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd6dc06c2a0 msgr2=0x7fd6dc156b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:32.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:32.866+0000 7fd6e1d7b700 1 --2- 172.21.15.149:0/2102705982 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd6dc06c2a0 0x7fd6dc156b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:32.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:32.866+0000 7fd6e1d7b700 1 -- 172.21.15.149:0/2102705982 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd6dc15abb0 msgr2=0x7fd6dc0b3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:32.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:32.866+0000 7fd6e1d7b700 1 --2- 172.21.15.149:0/2102705982 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd6dc15abb0 0x7fd6dc0b3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:32.878 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:32.866+0000 7fd6e1d7b700 1 -- 172.21.15.149:0/2102705982 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d400bd40 con 0x7fd6dc06e7e0 2023-11-08T19:28:32.878 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:32.866+0000 7fd6e1d7b700 1 --2- 172.21.15.149:0/2102705982 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6dc06e7e0 0x7fd6dc15ca20 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7fd6d800c490 tx=0x7fd6d800c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:32.878 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:32.866+0000 7fd6d2ffd700 1 -- 172.21.15.149:0/2102705982 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d800cea0 con 0x7fd6dc06e7e0 2023-11-08T19:28:32.878 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:32.866+0000 7fd6d2ffd700 1 -- 172.21.15.149:0/2102705982 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6d8005cb0 con 0x7fd6dc06e7e0 2023-11-08T19:28:32.879 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:32.866+0000 7fd6e47e0700 1 -- 172.21.15.149:0/2102705982 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6dc158e00 con 0x7fd6dc06e7e0 2023-11-08T19:28:32.879 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:32.866+0000 7fd6d2ffd700 1 -- 172.21.15.149:0/2102705982 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d80072d0 con 0x7fd6dc06e7e0 2023-11-08T19:28:32.879 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:32.867+0000 7fd6e47e0700 1 -- 172.21.15.149:0/2102705982 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6dc159190 con 0x7fd6dc06e7e0 2023-11-08T19:28:32.879 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:32.867+0000 7fd6e47e0700 1 -- 172.21.15.149:0/2102705982 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6dc1595d0 con 0x7fd6dc06e7e0 2023-11-08T19:28:32.879 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:32.868+0000 7fd6d2ffd700 1 -- 172.21.15.149:0/2102705982 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd6d8007430 con 0x7fd6dc06e7e0 2023-11-08T19:28:32.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:32.868+0000 7fd6d2ffd700 1 --2- 172.21.15.149:0/2102705982 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd6c006af00 0x7fd6c006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:32.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:32.868+0000 7fd6d2ffd700 1 -- 172.21.15.149:0/2102705982 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7436+0+0 (secure 0 0 0) 0x7fd6d8088e40 con 0x7fd6dc06e7e0 2023-11-08T19:28:32.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:32.868+0000 7fd6e257c700 1 --2- 172.21.15.149:0/2102705982 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd6c006af00 0x7fd6c006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:32.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:32.869+0000 7fd6e257c700 1 --2- 172.21.15.149:0/2102705982 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd6c006af00 0x7fd6c006d3c0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc009b40 tx=0x7fd6cc009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:32.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:32.873+0000 7fd6d2ffd700 1 -- 172.21.15.149:0/2102705982 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd6d8053970 con 0x7fd6dc06e7e0 2023-11-08T19:28:33.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.106+0000 7fd6e47e0700 1 -- 172.21.15.149:0/2102705982 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd6dc0745f0 con 0x7fd6dc06e7e0 2023-11-08T19:28:33.108 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.107+0000 7fd6d2ffd700 1 -- 172.21.15.149:0/2102705982 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+4938 (secure 0 0 0) 0x7fd6d8017020 con 0x7fd6dc06e7e0 2023-11-08T19:28:33.108 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:28:33.108 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":83,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6095,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/852710262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":852710262},{"type":"v1","addr":"172.21.15.160:6835","nonce":852710262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64},{"gid":6236,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/1313631099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":1313631099},{"type":"v1","addr":"172.21.15.160:6834","nonce":1313631099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:28:30.352933+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7578,"mds_1":7125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7125":{"gid":7125,"name":"c","rank":1,"incarnation":57,"state":"up:active","state_seq":6,"addr":"172.21.15.149:6837/3917392643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3917392643},{"type":"v1","addr":"172.21.15.149:6837","nonce":3917392643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7578":{"gid":7578,"name":"a","rank":0,"incarnation":79,"state":"up:active","state_seq":11,"addr":"172.21.15.149:6836/295381437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":295381437},{"type":"v1","addr":"172.21.15.149:6836","nonce":295381437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:28:33.110 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.109+0000 7fd6e47e0700 1 -- 172.21.15.149:0/2102705982 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd6c006af00 msgr2=0x7fd6c006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:33.111 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.109+0000 7fd6e47e0700 1 --2- 172.21.15.149:0/2102705982 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd6c006af00 0x7fd6c006d3c0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc009b40 tx=0x7fd6cc009210 comp rx=0 tx=0).stop 2023-11-08T19:28:33.111 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.109+0000 7fd6e47e0700 1 -- 172.21.15.149:0/2102705982 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6dc06e7e0 msgr2=0x7fd6dc15ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:33.111 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.109+0000 7fd6e47e0700 1 --2- 172.21.15.149:0/2102705982 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6dc06e7e0 0x7fd6dc15ca20 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7fd6d800c490 tx=0x7fd6d800c7a0 comp rx=0 tx=0).stop 2023-11-08T19:28:33.111 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.109+0000 7fd6e47e0700 1 -- 172.21.15.149:0/2102705982 shutdown_connections 2023-11-08T19:28:33.111 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.109+0000 7fd6e47e0700 1 --2- 172.21.15.149:0/2102705982 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd6c006af00 0x7fd6c006d3c0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:33.112 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.109+0000 7fd6e47e0700 1 --2- 172.21.15.149:0/2102705982 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd6dc15abb0 0x7fd6dc0b3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:33.112 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.109+0000 7fd6e47e0700 1 --2- 172.21.15.149:0/2102705982 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd6dc06c2a0 0x7fd6dc156b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:33.112 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.109+0000 7fd6e47e0700 1 --2- 172.21.15.149:0/2102705982 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6dc06e7e0 0x7fd6dc15ca20 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:33.112 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.109+0000 7fd6e47e0700 1 -- 172.21.15.149:0/2102705982 >> 172.21.15.149:0/2102705982 conn(0x7fd6dc071720 msgr2=0x7fd6dc0cdd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:33.112 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.109+0000 7fd6e47e0700 1 -- 172.21.15.149:0/2102705982 shutdown_connections 2023-11-08T19:28:33.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.109+0000 7fd6e47e0700 1 -- 172.21.15.149:0/2102705982 wait complete. 2023-11-08T19:28:33.113 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 83 2023-11-08T19:28:33.122 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-11-08T19:28:33.123 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:28:33.245 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.244+0000 7f47bb81b700 1 Processor -- start 2023-11-08T19:28:33.245 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.244+0000 7f47bb81b700 1 -- start start 2023-11-08T19:28:33.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.245+0000 7f47bb81b700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f47b40cc140 0x7f47b40cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:33.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.245+0000 7f47bb81b700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f47b40b2cd0 0x7f47b415d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:33.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.245+0000 7f47bb81b700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47b40cce50 con 0x7f47b40b2850 2023-11-08T19:28:33.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.245+0000 7f47bb81b700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47b40b2430 con 0x7f47b40cc140 2023-11-08T19:28:33.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.245+0000 7f47bb81b700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47b40cc520 con 0x7f47b40b2cd0 2023-11-08T19:28:33.249 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.245+0000 7f47b95b7700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f47b40cc140 0x7f47b40cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:33.249 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.245+0000 7f47b95b7700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f47b40cc140 0x7f47b40cc910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44576/0 (socket says 172.21.15.149:44576) 2023-11-08T19:28:33.249 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.245+0000 7f47b95b7700 1 -- 172.21.15.149:0/3212112490 learned_addr learned my addr 172.21.15.149:0/3212112490 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:28:33.249 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.245+0000 7f47b9db8700 1 --2- 172.21.15.149:0/3212112490 >> v2:172.21.15.160:3300/0 conn(0x7f47b40b2cd0 0x7f47b415d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:33.250 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.245+0000 7f47b95b7700 1 -- 172.21.15.149:0/3212112490 >> v2:172.21.15.160:3300/0 conn(0x7f47b40b2cd0 msgr2=0x7f47b415d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:33.250 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.245+0000 7f47b95b7700 1 --2- 172.21.15.149:0/3212112490 >> v2:172.21.15.160:3300/0 conn(0x7f47b40b2cd0 0x7f47b415d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:33.250 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.245+0000 7f47b95b7700 1 -- 172.21.15.149:0/3212112490 >> v1:172.21.15.160:6789/0 conn(0x7f47b40b2850 legacy=0x7f47b40cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:33.250 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.245+0000 7f47b95b7700 1 -- 172.21.15.149:0/3212112490 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b40b17b0 con 0x7f47b40cc140 2023-11-08T19:28:33.250 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.245+0000 7f47b95b7700 1 --2- 172.21.15.149:0/3212112490 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47b40cc140 0x7f47b40cc910 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f47b40c7600 tx=0x7f47b0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aa3892c42798478 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:33.251 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.245+0000 7f47abfff700 1 -- 172.21.15.149:0/3212112490 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b0005e30 con 0x7f47b40cc140 2023-11-08T19:28:33.251 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.246+0000 7f47abfff700 1 -- 172.21.15.149:0/3212112490 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b0006030 con 0x7f47b40cc140 2023-11-08T19:28:33.251 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.246+0000 7f47abfff700 1 -- 172.21.15.149:0/3212112490 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b00063e0 con 0x7f47b40cc140 2023-11-08T19:28:33.251 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.246+0000 7f47bb81b700 1 -- 172.21.15.149:0/3212112490 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47b40cc140 msgr2=0x7f47b40cc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:33.251 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.246+0000 7f47bb81b700 1 --2- 172.21.15.149:0/3212112490 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47b40cc140 0x7f47b40cc910 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f47b40c7600 tx=0x7f47b0009bd0 comp rx=0 tx=0).stop 2023-11-08T19:28:33.252 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.246+0000 7f47bb81b700 1 -- 172.21.15.149:0/3212112490 shutdown_connections 2023-11-08T19:28:33.252 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.246+0000 7f47bb81b700 1 --2- 172.21.15.149:0/3212112490 >> v2:172.21.15.160:3300/0 conn(0x7f47b40b2cd0 0x7f47b415d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:33.252 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.246+0000 7f47bb81b700 1 --2- 172.21.15.149:0/3212112490 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47b40cc140 0x7f47b40cc910 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:33.252 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.246+0000 7f47bb81b700 1 -- 172.21.15.149:0/3212112490 >> 172.21.15.149:0/3212112490 conn(0x7f47b4099a40 msgr2=0x7f47b40d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:33.252 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.246+0000 7f47bb81b700 1 -- 172.21.15.149:0/3212112490 shutdown_connections 2023-11-08T19:28:33.253 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.246+0000 7f47bb81b700 1 -- 172.21.15.149:0/3212112490 wait complete. 2023-11-08T19:28:33.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.247+0000 7f47bb81b700 1 Processor -- start 2023-11-08T19:28:33.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.247+0000 7f47bb81b700 1 -- start start 2023-11-08T19:28:33.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.248+0000 7f47bb81b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f47b40b2850 0x7f47b406ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:33.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.248+0000 7f47bb81b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47b40b2cd0 0x7f47b409a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:33.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.248+0000 7f47bb81b700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f47b40cc140 0x7f47b409a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:33.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.248+0000 7f47bb81b700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b409d050 con 0x7f47b40b2cd0 2023-11-08T19:28:33.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.248+0000 7f47bb81b700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b409c480 con 0x7f47b40b2850 2023-11-08T19:28:33.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.248+0000 7f47bb81b700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b409c6b0 con 0x7f47b40cc140 2023-11-08T19:28:33.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.248+0000 7f47b8db6700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47b40b2cd0 0x7f47b409a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:33.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.248+0000 7f47b8db6700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47b40b2cd0 0x7f47b409a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44584/0 (socket says 172.21.15.149:44584) 2023-11-08T19:28:33.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.248+0000 7f47b8db6700 1 -- 172.21.15.149:0/1955754501 learned_addr learned my addr 172.21.15.149:0/1955754501 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:28:33.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.248+0000 7f47b9db8700 1 --2- 172.21.15.149:0/1955754501 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f47b40cc140 0x7f47b409a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:33.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.248+0000 7f47b95b7700 1 --2- 172.21.15.149:0/1955754501 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f47b40b2850 0x7f47b406ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:33.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.248+0000 7f47b8db6700 1 -- 172.21.15.149:0/1955754501 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f47b40cc140 msgr2=0x7f47b409a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:33.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.248+0000 7f47b8db6700 1 --2- 172.21.15.149:0/1955754501 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f47b40cc140 0x7f47b409a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:33.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.248+0000 7f47b8db6700 1 -- 172.21.15.149:0/1955754501 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f47b40b2850 msgr2=0x7f47b406ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:33.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.248+0000 7f47b8db6700 1 --2- 172.21.15.149:0/1955754501 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f47b40b2850 0x7f47b406ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:33.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.248+0000 7f47b8db6700 1 -- 172.21.15.149:0/1955754501 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b0009500 con 0x7f47b40b2cd0 2023-11-08T19:28:33.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.248+0000 7f47b9db8700 1 --2- 172.21.15.149:0/1955754501 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f47b40cc140 0x7f47b409a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:28:33.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.248+0000 7f47b95b7700 1 --2- 172.21.15.149:0/1955754501 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f47b40b2850 0x7f47b406ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:28:33.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.249+0000 7f47b8db6700 1 --2- 172.21.15.149:0/1955754501 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47b40b2cd0 0x7f47b409a460 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f47a400b4a0 tx=0x7f47a400b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:33.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.249+0000 7f47a9ffb700 1 -- 172.21.15.149:0/1955754501 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a4011830 con 0x7f47b40b2cd0 2023-11-08T19:28:33.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.249+0000 7f47a9ffb700 1 -- 172.21.15.149:0/1955754501 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a4011990 con 0x7f47b40b2cd0 2023-11-08T19:28:33.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.249+0000 7f47bb81b700 1 -- 172.21.15.149:0/1955754501 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47b409c990 con 0x7f47b40b2cd0 2023-11-08T19:28:33.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.249+0000 7f47a9ffb700 1 -- 172.21.15.149:0/1955754501 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a4011d40 con 0x7f47b40b2cd0 2023-11-08T19:28:33.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.249+0000 7f47bb81b700 1 -- 172.21.15.149:0/1955754501 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47b409afa0 con 0x7f47b40b2cd0 2023-11-08T19:28:33.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.250+0000 7f47bb81b700 1 -- 172.21.15.149:0/1955754501 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47b409d190 con 0x7f47b40b2cd0 2023-11-08T19:28:33.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.250+0000 7f47a9ffb700 1 -- 172.21.15.149:0/1955754501 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f47a401a400 con 0x7f47b40b2cd0 2023-11-08T19:28:33.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.250+0000 7f47a9ffb700 1 --2- 172.21.15.149:0/1955754501 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f479806af00 0x7f479806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:33.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.251+0000 7f47a9ffb700 1 -- 172.21.15.149:0/1955754501 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7436+0+0 (secure 0 0 0) 0x7f47a4089960 con 0x7f47b40b2cd0 2023-11-08T19:28:33.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.251+0000 7f47b95b7700 1 --2- 172.21.15.149:0/1955754501 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f479806af00 0x7f479806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:33.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.251+0000 7f47b95b7700 1 --2- 172.21.15.149:0/1955754501 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f479806af00 0x7f479806d3c0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f47b40c7600 tx=0x7f47b0008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:33.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.255+0000 7f47a9ffb700 1 -- 172.21.15.149:0/1955754501 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f47b409d190 con 0x7f47b40b2cd0 2023-11-08T19:28:33.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.490+0000 7f47bb81b700 1 -- 172.21.15.149:0/1955754501 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f47b409d190 con 0x7f47b40b2cd0 2023-11-08T19:28:33.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.491+0000 7f47a9ffb700 1 -- 172.21.15.149:0/1955754501 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+4938 (secure 0 0 0) 0x7f47b409d190 con 0x7f47b40b2cd0 2023-11-08T19:28:33.493 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:28:33.494 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":83,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6095,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/852710262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":852710262},{"type":"v1","addr":"172.21.15.160:6835","nonce":852710262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64},{"gid":6236,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/1313631099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":1313631099},{"type":"v1","addr":"172.21.15.160:6834","nonce":1313631099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:28:30.352933+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7578,"mds_1":7125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7125":{"gid":7125,"name":"c","rank":1,"incarnation":57,"state":"up:active","state_seq":6,"addr":"172.21.15.149:6837/3917392643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3917392643},{"type":"v1","addr":"172.21.15.149:6837","nonce":3917392643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7578":{"gid":7578,"name":"a","rank":0,"incarnation":79,"state":"up:active","state_seq":11,"addr":"172.21.15.149:6836/295381437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":295381437},{"type":"v1","addr":"172.21.15.149:6836","nonce":295381437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:28:33.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.493+0000 7f47bb81b700 1 -- 172.21.15.149:0/1955754501 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f479806af00 msgr2=0x7f479806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:33.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.493+0000 7f47bb81b700 1 --2- 172.21.15.149:0/1955754501 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f479806af00 0x7f479806d3c0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f47b40c7600 tx=0x7f47b0008070 comp rx=0 tx=0).stop 2023-11-08T19:28:33.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.493+0000 7f47bb81b700 1 -- 172.21.15.149:0/1955754501 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47b40b2cd0 msgr2=0x7f47b409a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:33.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.493+0000 7f47bb81b700 1 --2- 172.21.15.149:0/1955754501 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47b40b2cd0 0x7f47b409a460 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f47a400b4a0 tx=0x7f47a400b860 comp rx=0 tx=0).stop 2023-11-08T19:28:33.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.493+0000 7f47bb81b700 1 -- 172.21.15.149:0/1955754501 shutdown_connections 2023-11-08T19:28:33.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.493+0000 7f47bb81b700 1 --2- 172.21.15.149:0/1955754501 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f479806af00 0x7f479806d3c0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:33.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.493+0000 7f47bb81b700 1 --2- 172.21.15.149:0/1955754501 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f47b40b2850 0x7f47b406ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:33.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.493+0000 7f47bb81b700 1 --2- 172.21.15.149:0/1955754501 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f47b40cc140 0x7f47b409a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:33.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.493+0000 7f47bb81b700 1 --2- 172.21.15.149:0/1955754501 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47b40b2cd0 0x7f47b409a460 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:33.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.493+0000 7f47bb81b700 1 -- 172.21.15.149:0/1955754501 >> 172.21.15.149:0/1955754501 conn(0x7f47b4099a40 msgr2=0x7f47b406b410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:33.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.493+0000 7f47bb81b700 1 -- 172.21.15.149:0/1955754501 shutdown_connections 2023-11-08T19:28:33.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:33.493+0000 7f47bb81b700 1 -- 172.21.15.149:0/1955754501 wait complete. 2023-11-08T19:28:33.499 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 83 2023-11-08T19:28:33.909 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 83, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 2, 'explicitly_allowed_features': 2, 'created': '2023-11-08T19:26:48.987203+0000', 'modified': '2023-11-08T19:28:30.352933+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 101, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 7578, 'mds_1': 7125}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7125': {'gid': 7125, 'name': 'c', 'rank': 1, 'incarnation': 57, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.149:6837/3917392643', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6835', 'nonce': 3917392643}, {'type': 'v1', 'addr': '172.21.15.149:6837', 'nonce': 3917392643}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_7578': {'gid': 7578, 'name': 'a', 'rank': 0, 'incarnation': 79, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.149:6836/295381437', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6834', 'nonce': 295381437}, {'type': 'v1', 'addr': '172.21.15.149:6836', 'nonce': 295381437}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-08T19:28:33.910 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 2/2 2023-11-08T19:28:33.911 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-08T19:28:34.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.033+0000 7f45f1b1d700 1 Processor -- start 2023-11-08T19:28:34.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.034+0000 7f45f1b1d700 1 -- start start 2023-11-08T19:28:34.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.034+0000 7f45f1b1d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f45ec0cc910 0x7f45ec0cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:34.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.034+0000 7f45f1b1d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f45ec0cb130 0x7f45ec15d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:34.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.034+0000 7f45f1b1d700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45ec0b2f60 con 0x7f45ec0cc140 2023-11-08T19:28:34.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.034+0000 7f45f1b1d700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45ec0b2430 con 0x7f45ec0cc910 2023-11-08T19:28:34.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.034+0000 7f45f1b1d700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45ec0cc520 con 0x7f45ec0cb130 2023-11-08T19:28:34.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.034+0000 7f45eaffd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f45ec0cc910 0x7f45ec0cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:34.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.034+0000 7f45eaffd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f45ec0cc910 0x7f45ec0cabf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44592/0 (socket says 172.21.15.149:44592) 2023-11-08T19:28:34.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.034+0000 7f45eaffd700 1 -- 172.21.15.149:0/4010989304 learned_addr learned my addr 172.21.15.149:0/4010989304 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:28:34.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.035+0000 7f45eaffd700 1 -- 172.21.15.149:0/4010989304 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f45ec0cb130 msgr2=0x7f45ec15d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:34.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.035+0000 7f45eaffd700 1 --2- 172.21.15.149:0/4010989304 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f45ec0cb130 0x7f45ec15d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.035+0000 7f45eaffd700 1 -- 172.21.15.149:0/4010989304 >> v1:172.21.15.160:6789/0 conn(0x7f45ec0cc140 legacy=0x7f45ec0b2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:34.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.035+0000 7f45eaffd700 1 -- 172.21.15.149:0/4010989304 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45ec0cb5e0 con 0x7f45ec0cc910 2023-11-08T19:28:34.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.035+0000 7f45eaffd700 1 --2- 172.21.15.149:0/4010989304 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45ec0cc910 0x7f45ec0cabf0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f45dc0098f0 tx=0x7f45dc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=638df2cd6a48c49e server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:34.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.035+0000 7f45ea7fc700 1 -- 172.21.15.149:0/4010989304 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45dc004230 con 0x7f45ec0cc910 2023-11-08T19:28:34.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.035+0000 7f45ea7fc700 1 -- 172.21.15.149:0/4010989304 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45dc004390 con 0x7f45ec0cc910 2023-11-08T19:28:34.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.035+0000 7f45ea7fc700 1 -- 172.21.15.149:0/4010989304 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45dc0036a0 con 0x7f45ec0cc910 2023-11-08T19:28:34.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.036+0000 7f45f1b1d700 1 -- 172.21.15.149:0/4010989304 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45ec0cc910 msgr2=0x7f45ec0cabf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:34.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.036+0000 7f45f1b1d700 1 --2- 172.21.15.149:0/4010989304 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45ec0cc910 0x7f45ec0cabf0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f45dc0098f0 tx=0x7f45dc009c00 comp rx=0 tx=0).stop 2023-11-08T19:28:34.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.036+0000 7f45f1b1d700 1 -- 172.21.15.149:0/4010989304 shutdown_connections 2023-11-08T19:28:34.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.036+0000 7f45f1b1d700 1 --2- 172.21.15.149:0/4010989304 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f45ec0cb130 0x7f45ec15d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.036+0000 7f45f1b1d700 1 --2- 172.21.15.149:0/4010989304 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45ec0cc910 0x7f45ec0cabf0 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.036+0000 7f45f1b1d700 1 -- 172.21.15.149:0/4010989304 >> 172.21.15.149:0/4010989304 conn(0x7f45ec099a40 msgr2=0x7f45ec0d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:34.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.036+0000 7f45f1b1d700 1 -- 172.21.15.149:0/4010989304 shutdown_connections 2023-11-08T19:28:34.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.036+0000 7f45f1b1d700 1 -- 172.21.15.149:0/4010989304 wait complete. 2023-11-08T19:28:34.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.037+0000 7f45f1b1d700 1 Processor -- start 2023-11-08T19:28:34.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.037+0000 7f45f1b1d700 1 -- start start 2023-11-08T19:28:34.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.038+0000 7f45f1b1d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f45ec0cb130 0x7f45ec15ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:34.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.038+0000 7f45f1b1d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f45ec0cc140 0x7f45ec0afd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:34.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.038+0000 7f45f1b1d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45ec0cc910 0x7f45ec0b02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:34.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.038+0000 7f45f1b1d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45ec15f270 con 0x7f45ec0cc910 2023-11-08T19:28:34.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.038+0000 7f45f1b1d700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45ec0c40d0 con 0x7f45ec0cb130 2023-11-08T19:28:34.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.038+0000 7f45f1b1d700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45ec0c43b0 con 0x7f45ec0cc140 2023-11-08T19:28:34.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.038+0000 7f45ebfff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45ec0cc910 0x7f45ec0b02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:34.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.038+0000 7f45ebfff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45ec0cc910 0x7f45ec0b02b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44600/0 (socket says 172.21.15.149:44600) 2023-11-08T19:28:34.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.038+0000 7f45ebfff700 1 -- 172.21.15.149:0/1397518870 learned_addr learned my addr 172.21.15.149:0/1397518870 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:28:34.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.038+0000 7f45eaffd700 1 --2- 172.21.15.149:0/1397518870 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f45ec0cc140 0x7f45ec0afd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:34.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.038+0000 7f45eb7fe700 1 --2- 172.21.15.149:0/1397518870 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f45ec0cb130 0x7f45ec15ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:34.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.038+0000 7f45ebfff700 1 -- 172.21.15.149:0/1397518870 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f45ec0cc140 msgr2=0x7f45ec0afd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:34.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.038+0000 7f45ebfff700 1 --2- 172.21.15.149:0/1397518870 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f45ec0cc140 0x7f45ec0afd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.038+0000 7f45ebfff700 1 -- 172.21.15.149:0/1397518870 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f45ec0cb130 msgr2=0x7f45ec15ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:34.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.038+0000 7f45ebfff700 1 --2- 172.21.15.149:0/1397518870 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f45ec0cb130 0x7f45ec15ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.038+0000 7f45ebfff700 1 -- 172.21.15.149:0/1397518870 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45dc009550 con 0x7f45ec0cc910 2023-11-08T19:28:34.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.038+0000 7f45ebfff700 1 --2- 172.21.15.149:0/1397518870 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45ec0cc910 0x7f45ec0b02b0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f45e400b970 tx=0x7f45e400bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:34.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.038+0000 7f45d3fff700 1 -- 172.21.15.149:0/1397518870 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e400c9b0 con 0x7f45ec0cc910 2023-11-08T19:28:34.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.038+0000 7f45d3fff700 1 -- 172.21.15.149:0/1397518870 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e400cb30 con 0x7f45ec0cc910 2023-11-08T19:28:34.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.039+0000 7f45f1b1d700 1 -- 172.21.15.149:0/1397518870 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45ec0c4690 con 0x7f45ec0cc910 2023-11-08T19:28:34.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.039+0000 7f45d3fff700 1 -- 172.21.15.149:0/1397518870 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e4014440 con 0x7f45ec0cc910 2023-11-08T19:28:34.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.039+0000 7f45f1b1d700 1 -- 172.21.15.149:0/1397518870 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45ec0c4c50 con 0x7f45ec0cc910 2023-11-08T19:28:34.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.040+0000 7f45d3fff700 1 -- 172.21.15.149:0/1397518870 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f45e401d3b0 con 0x7f45ec0cc910 2023-11-08T19:28:34.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.040+0000 7f45d3fff700 1 --2- 172.21.15.149:0/1397518870 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f45d806af00 0x7f45d806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:34.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.040+0000 7f45d3fff700 1 -- 172.21.15.149:0/1397518870 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7436+0+0 (secure 0 0 0) 0x7f45e4006e40 con 0x7f45ec0cc910 2023-11-08T19:28:34.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.041+0000 7f45eb7fe700 1 --2- 172.21.15.149:0/1397518870 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f45d806af00 0x7f45d806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:34.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.041+0000 7f45eb7fe700 1 --2- 172.21.15.149:0/1397518870 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f45d806af00 0x7f45d806d3c0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f45e0001780 tx=0x7f45e0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:34.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.042+0000 7f45fdd16b80 1 Processor -- start 2023-11-08T19:28:34.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.042+0000 7f45fdd16b80 1 -- start start 2023-11-08T19:28:34.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.043+0000 7f45fdd16b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff803946f0 0x55ff803c4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:34.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.043+0000 7f45fdd16b80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55ff80396c30 0x55ff803c4990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:34.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.043+0000 7f45fdd16b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ff80394ad0 0x55ff803aef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:34.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.043+0000 7f45fdd16b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff803006e0 con 0x55ff80394ad0 2023-11-08T19:28:34.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.043+0000 7f45fdd16b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff802f43b0 con 0x55ff803946f0 2023-11-08T19:28:34.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.043+0000 7f45fdd16b80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ff802f1cd0 con 0x55ff80396c30 2023-11-08T19:28:34.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.043+0000 7f45ebfff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ff80394ad0 0x55ff803aef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:34.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.043+0000 7f45ebfff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ff80394ad0 0x55ff803aef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44608/0 (socket says 172.21.15.149:44608) 2023-11-08T19:28:34.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.043+0000 7f45ebfff700 1 -- 172.21.15.149:0/679723153 learned_addr learned my addr 172.21.15.149:0/679723153 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:28:34.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.043+0000 7f45eaffd700 1 --2- 172.21.15.149:0/679723153 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55ff80396c30 0x55ff803c4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:34.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.043+0000 7f45eb7fe700 1 --2- 172.21.15.149:0/679723153 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff803946f0 0x55ff803c4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:34.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.044+0000 7f45ebfff700 1 -- 172.21.15.149:0/679723153 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55ff80396c30 msgr2=0x55ff803c4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:34.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.044+0000 7f45ebfff700 1 --2- 172.21.15.149:0/679723153 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55ff80396c30 0x55ff803c4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.044+0000 7f45ebfff700 1 -- 172.21.15.149:0/679723153 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff803946f0 msgr2=0x55ff803c4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:34.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.044+0000 7f45ebfff700 1 --2- 172.21.15.149:0/679723153 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff803946f0 0x55ff803c4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.044+0000 7f45ebfff700 1 -- 172.21.15.149:0/679723153 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ff8016a5e0 con 0x55ff80394ad0 2023-11-08T19:28:34.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.044+0000 7f45eb7fe700 1 --2- 172.21.15.149:0/679723153 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff803946f0 0x55ff803c4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:28:34.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.044+0000 7f45ebfff700 1 --2- 172.21.15.149:0/679723153 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ff80394ad0 0x55ff803aef90 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f45e405ff00 tx=0x7f45e4058830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d75c92ae9fedff4 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:34.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.044+0000 7f45d17fa700 1 -- 172.21.15.149:0/679723153 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e405c280 con 0x55ff80394ad0 2023-11-08T19:28:34.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.044+0000 7f45d17fa700 1 -- 172.21.15.149:0/679723153 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e4060430 con 0x55ff80394ad0 2023-11-08T19:28:34.061 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.044+0000 7f45d17fa700 1 -- 172.21.15.149:0/679723153 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e4057620 con 0x55ff80394ad0 2023-11-08T19:28:34.061 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.045+0000 7f45fdd16b80 1 -- 172.21.15.149:0/679723153 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ff80394ad0 msgr2=0x55ff803aef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:34.061 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.045+0000 7f45fdd16b80 1 --2- 172.21.15.149:0/679723153 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ff80394ad0 0x55ff803aef90 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f45e405ff00 tx=0x7f45e4058830 comp rx=0 tx=0).stop 2023-11-08T19:28:34.061 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.045+0000 7f45fdd16b80 1 -- 172.21.15.149:0/679723153 shutdown_connections 2023-11-08T19:28:34.061 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.045+0000 7f45fdd16b80 1 --2- 172.21.15.149:0/679723153 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff803946f0 0x55ff803c4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.045+0000 7f45fdd16b80 1 --2- 172.21.15.149:0/679723153 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ff80394ad0 0x55ff803aef90 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.045+0000 7f45fdd16b80 1 --2- 172.21.15.149:0/679723153 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55ff80396c30 0x55ff803c4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.045+0000 7f45fdd16b80 1 -- 172.21.15.149:0/679723153 >> 172.21.15.149:0/679723153 conn(0x55ff8030f660 msgr2=0x55ff8039a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:34.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.045+0000 7f45fdd16b80 1 -- 172.21.15.149:0/679723153 shutdown_connections 2023-11-08T19:28:34.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.045+0000 7f45fdd16b80 1 -- 172.21.15.149:0/679723153 wait complete. 2023-11-08T19:28:34.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.045+0000 7f45fdd16b80 1 -- start start 2023-11-08T19:28:34.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.045+0000 7f45fdd16b80 1 Processor -- start 2023-11-08T19:28:34.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.046+0000 7f45fdd16b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff803946f0 0x55ff803c1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:34.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.046+0000 7f45fdd16b80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55ff80394ad0 0x55ff803d8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:34.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.046+0000 7f45fdd16b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ff803d6590 0x55ff803c4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:34.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.046+0000 7f45fdd16b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff802ed5c0 con 0x55ff803d6590 2023-11-08T19:28:34.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.046+0000 7f45fdd16b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff802890d0 con 0x55ff803946f0 2023-11-08T19:28:34.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.046+0000 7f45fdd16b80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ff80288d70 con 0x55ff80394ad0 2023-11-08T19:28:34.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.046+0000 7f45fdd16b80 10 client.0 _ll_register_callbacks cb 0x55ff800e57b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-08T19:28:34.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.046+0000 7f45ebfff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ff803d6590 0x55ff803c4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:34.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.046+0000 7f45ebfff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ff803d6590 0x55ff803c4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44614/0 (socket says 172.21.15.149:44614) 2023-11-08T19:28:34.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.046+0000 7f45ebfff700 1 -- 172.21.15.149:0/2679978538 learned_addr learned my addr 172.21.15.149:0/2679978538 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:28:34.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.047+0000 7f45eaffd700 1 --2- 172.21.15.149:0/2679978538 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55ff80394ad0 0x55ff803d8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:34.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.047+0000 7f45eb7fe700 1 --2- 172.21.15.149:0/2679978538 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff803946f0 0x55ff803c1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:34.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.047+0000 7f45ebfff700 1 -- 172.21.15.149:0/2679978538 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55ff80394ad0 msgr2=0x55ff803d8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:34.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.047+0000 7f45ebfff700 1 --2- 172.21.15.149:0/2679978538 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55ff80394ad0 0x55ff803d8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.047+0000 7f45ebfff700 1 -- 172.21.15.149:0/2679978538 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff803946f0 msgr2=0x55ff803c1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:34.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.047+0000 7f45ebfff700 1 --2- 172.21.15.149:0/2679978538 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff803946f0 0x55ff803c1610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.047+0000 7f45ebfff700 1 -- 172.21.15.149:0/2679978538 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45ec0c4c50 con 0x55ff803d6590 2023-11-08T19:28:34.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.047+0000 7f45ebfff700 1 --2- 172.21.15.149:0/2679978538 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ff803d6590 0x55ff803c4480 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f45e4020040 tx=0x7f45e400e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a5e8b26808b5684 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:34.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.047+0000 7f45ca7fc700 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2023-11-08T19:28:34.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.047+0000 7f45ca7fc700 1 -- 172.21.15.149:0/2679978538 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e40601a0 con 0x55ff803d6590 2023-11-08T19:28:34.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.047+0000 7f45ca7fc700 1 -- 172.21.15.149:0/2679978538 <== mon.0 v2:172.21.15.149:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 7436+0+0 (secure 0 0 0) 0x7f45e405e070 con 0x55ff803d6590 2023-11-08T19:28:34.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.047+0000 7f45fdd16b80 1 -- 172.21.15.149:0/2679978538 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ff8038c880 con 0x55ff803d6590 2023-11-08T19:28:34.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.047+0000 7f45ca7fc700 1 -- 172.21.15.149:0/2679978538 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f45e405e230 con 0x55ff803d6590 2023-11-08T19:28:34.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.047+0000 7f45fdd16b80 10 client.7722 fetch_fsmap learned FSMap version 83 2023-11-08T19:28:34.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.047+0000 7f45fdd16b80 1 -- 172.21.15.149:0/2679978538 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) v3 -- 0x55ff80116d90 con 0x55ff803d6590 2023-11-08T19:28:34.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.047+0000 7f45ca7fc700 1 -- 172.21.15.149:0/2679978538 <== mon.0 v2:172.21.15.149:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ff8038c880 con 0x55ff803d6590 2023-11-08T19:28:34.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.047+0000 7f45ca7fc700 1 -- 172.21.15.149:0/2679978538 <== mon.0 v2:172.21.15.149:3300/0 5 ==== fsmap(e 83) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f45e40872c0 con 0x55ff803d6590 2023-11-08T19:28:34.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.047+0000 7f45fdd16b80 10 client.7722 fetch_fsmap finished waiting for FSMap version 83 2023-11-08T19:28:34.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.047+0000 7f45fdd16b80 10 client.7722 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-08T19:28:34.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.047+0000 7f45fdd16b80 20 client.7722 populate_metadata read hostname 'smithi149' 2023-11-08T19:28:34.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.047+0000 7f45fdd16b80 1 --2- 172.21.15.149:0/2679978538 >> [v2:172.21.15.149:6835/3917392643,v1:172.21.15.149:6837/3917392643] conn(0x55ff803c49c0 0x55ff803a1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:34.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.047+0000 7f45fdd16b80 4 client.7722 mds_command: new command op to 7125 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-08T19:28:34.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.047+0000 7f45fdd16b80 1 -- 172.21.15.149:0/2679978538 --> [v2:172.21.15.149:6835/3917392643,v1:172.21.15.149:6837/3917392643] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ff80368a30 con 0x55ff803c49c0 2023-11-08T19:28:34.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.048+0000 7f45eb7fe700 1 --2- 172.21.15.149:0/2679978538 >> [v2:172.21.15.149:6835/3917392643,v1:172.21.15.149:6837/3917392643] conn(0x55ff803c49c0 0x55ff803a1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:34.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.048+0000 7f45ca7fc700 10 client.7722 ms_handle_connect on v2:172.21.15.149:6835/3917392643 2023-11-08T19:28:34.070 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.048+0000 7f45eb7fe700 1 --2- 172.21.15.149:0/2679978538 >> [v2:172.21.15.149:6835/3917392643,v1:172.21.15.149:6837/3917392643] conn(0x55ff803c49c0 0x55ff803a1150 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6a898f50301b12a6 server_cookie=e9876b21ccfadddc in_seq=0 out_seq=0 2023-11-08T19:28:34.070 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.048+0000 7f45ca7fc700 1 -- 172.21.15.149:0/2679978538 <== mds.1 v2:172.21.15.149:6835/3917392643 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ff80368a30 con 0x55ff803c49c0 2023-11-08T19:28:34.070 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.048+0000 7f45ca7fc700 10 client.7722 handle_command_reply: tid=0 2023-11-08T19:28:34.070 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.048+0000 7f45fdd16b80 1 client.7722 shutdown 2023-11-08T19:28:34.070 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.048+0000 7f45fdd16b80 1 -- 172.21.15.149:0/2679978538 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ff803d6590 msgr2=0x55ff803c4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:34.071 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.048+0000 7f45fdd16b80 1 --2- 172.21.15.149:0/2679978538 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ff803d6590 0x55ff803c4480 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f45e4020040 tx=0x7f45e400e040 comp rx=0 tx=0).stop 2023-11-08T19:28:34.071 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.049+0000 7f45fdd16b80 1 -- 172.21.15.149:0/2679978538 shutdown_connections 2023-11-08T19:28:34.071 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.049+0000 7f45fdd16b80 1 --2- 172.21.15.149:0/2679978538 >> [v2:172.21.15.149:6835/3917392643,v1:172.21.15.149:6837/3917392643] conn(0x55ff803c49c0 0x55ff803a1150 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.071 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.049+0000 7f45fdd16b80 1 --2- 172.21.15.149:0/2679978538 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff803946f0 0x55ff803c1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.071 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.049+0000 7f45ca7fc700 0 client.7722 ms_handle_reset on v2:172.21.15.149:6835/3917392643 2023-11-08T19:28:34.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.049+0000 7f45fdd16b80 1 --2- 172.21.15.149:0/2679978538 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ff803d6590 0x55ff803c4480 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.049+0000 7f45fdd16b80 1 --2- 172.21.15.149:0/2679978538 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55ff80394ad0 0x55ff803d8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.049+0000 7f45fdd16b80 1 -- 172.21.15.149:0/2679978538 >> 172.21.15.149:0/2679978538 conn(0x55ff8030f660 msgr2=0x55ff803978a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:34.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.049+0000 7f45fdd16b80 1 -- 172.21.15.149:0/2679978538 shutdown_connections 2023-11-08T19:28:34.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.049+0000 7f45fdd16b80 1 -- 172.21.15.149:0/2679978538 wait complete. 2023-11-08T19:28:34.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.049+0000 7f45fdd16b80 20 client.7722 trim_cache size 0 max 16384 2023-11-08T19:28:34.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.067+0000 7f45fdd16b80 1 Processor -- start 2023-11-08T19:28:34.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.067+0000 7f45fdd16b80 1 -- start start 2023-11-08T19:28:34.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.068+0000 7f45fdd16b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ff803946f0 0x55ff80398ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:34.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.068+0000 7f45fdd16b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff80394ad0 0x55ff803ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:34.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.068+0000 7f45fdd16b80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55ff803d6590 0x55ff803ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:34.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.068+0000 7f45fdd16b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff8016c8d0 con 0x55ff803946f0 2023-11-08T19:28:34.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.068+0000 7f45fdd16b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff803e3530 con 0x55ff80394ad0 2023-11-08T19:28:34.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.068+0000 7f45fdd16b80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ff803d6060 con 0x55ff803d6590 2023-11-08T19:28:34.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.068+0000 7f45eb7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ff803946f0 0x55ff80398ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:34.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.068+0000 7f45eb7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ff803946f0 0x55ff80398ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44618/0 (socket says 172.21.15.149:44618) 2023-11-08T19:28:34.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.068+0000 7f45eb7fe700 1 -- 172.21.15.149:0/3040541488 learned_addr learned my addr 172.21.15.149:0/3040541488 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:28:34.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.069+0000 7f45ebfff700 1 --2- 172.21.15.149:0/3040541488 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55ff803d6590 0x55ff803ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:34.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.069+0000 7f45eb7fe700 1 -- 172.21.15.149:0/3040541488 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55ff803d6590 msgr2=0x55ff803ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:34.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.069+0000 7f45eaffd700 1 --2- 172.21.15.149:0/3040541488 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff80394ad0 0x55ff803ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:34.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.069+0000 7f45eb7fe700 1 --2- 172.21.15.149:0/3040541488 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55ff803d6590 0x55ff803ad6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.069+0000 7f45eb7fe700 1 -- 172.21.15.149:0/3040541488 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff80394ad0 msgr2=0x55ff803ad1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:34.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.069+0000 7f45eb7fe700 1 --2- 172.21.15.149:0/3040541488 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff80394ad0 0x55ff803ad1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.069+0000 7f45eb7fe700 1 -- 172.21.15.149:0/3040541488 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ff800ffc10 con 0x55ff803946f0 2023-11-08T19:28:34.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.069+0000 7f45eb7fe700 1 --2- 172.21.15.149:0/3040541488 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ff803946f0 0x55ff80398ae0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f45e0001f00 tx=0x7f45e0017040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fea5a90ae1675585 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:34.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.069+0000 7f45d1ffb700 1 -- 172.21.15.149:0/3040541488 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e0024740 con 0x55ff803946f0 2023-11-08T19:28:34.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.069+0000 7f45d1ffb700 1 -- 172.21.15.149:0/3040541488 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e0028070 con 0x55ff803946f0 2023-11-08T19:28:34.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.069+0000 7f45d1ffb700 1 -- 172.21.15.149:0/3040541488 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e00038d0 con 0x55ff803946f0 2023-11-08T19:28:34.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.070+0000 7f45fdd16b80 1 -- 172.21.15.149:0/3040541488 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ff803946f0 msgr2=0x55ff80398ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:34.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.070+0000 7f45fdd16b80 1 --2- 172.21.15.149:0/3040541488 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ff803946f0 0x55ff80398ae0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f45e0001f00 tx=0x7f45e0017040 comp rx=0 tx=0).stop 2023-11-08T19:28:34.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.070+0000 7f45fdd16b80 1 -- 172.21.15.149:0/3040541488 shutdown_connections 2023-11-08T19:28:34.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.070+0000 7f45fdd16b80 1 --2- 172.21.15.149:0/3040541488 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55ff803d6590 0x55ff803ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.070+0000 7f45fdd16b80 1 --2- 172.21.15.149:0/3040541488 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ff803946f0 0x55ff80398ae0 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.070+0000 7f45fdd16b80 1 --2- 172.21.15.149:0/3040541488 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff80394ad0 0x55ff803ad1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.070+0000 7f45fdd16b80 1 -- 172.21.15.149:0/3040541488 >> 172.21.15.149:0/3040541488 conn(0x55ff8030f660 msgr2=0x55ff803907e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:34.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.070+0000 7f45fdd16b80 1 -- 172.21.15.149:0/3040541488 shutdown_connections 2023-11-08T19:28:34.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.070+0000 7f45fdd16b80 1 -- 172.21.15.149:0/3040541488 wait complete. 2023-11-08T19:28:34.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.070+0000 7f45fdd16b80 1 -- start start 2023-11-08T19:28:34.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.070+0000 7f45fdd16b80 1 Processor -- start 2023-11-08T19:28:34.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.072+0000 7f45fdd16b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ff803946f0 0x55ff80395930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:34.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.072+0000 7f45fdd16b80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55ff80394ad0 0x55ff803936f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:34.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.072+0000 7f45fdd16b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff803d6590 0x55ff803c02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:34.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.072+0000 7f45fdd16b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff803aed50 con 0x55ff803946f0 2023-11-08T19:28:34.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.072+0000 7f45fdd16b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff80448d90 con 0x55ff803d6590 2023-11-08T19:28:34.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.072+0000 7f45fdd16b80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ff803be690 con 0x55ff80394ad0 2023-11-08T19:28:34.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.072+0000 7f45fdd16b80 10 client.0 _ll_register_callbacks cb 0x7f45e405c170 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-08T19:28:34.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.072+0000 7f45eb7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ff803946f0 0x55ff80395930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:34.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.072+0000 7f45eb7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ff803946f0 0x55ff80395930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44624/0 (socket says 172.21.15.149:44624) 2023-11-08T19:28:34.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.072+0000 7f45eb7fe700 1 -- 172.21.15.149:0/807340490 learned_addr learned my addr 172.21.15.149:0/807340490 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:28:34.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.072+0000 7f45eaffd700 1 --2- 172.21.15.149:0/807340490 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55ff80394ad0 0x55ff803936f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:34.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.072+0000 7f45ebfff700 1 --2- 172.21.15.149:0/807340490 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff803d6590 0x55ff803c02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:34.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.072+0000 7f45eb7fe700 1 -- 172.21.15.149:0/807340490 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55ff80394ad0 msgr2=0x55ff803936f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:34.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.072+0000 7f45eb7fe700 1 --2- 172.21.15.149:0/807340490 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55ff80394ad0 0x55ff803936f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.072+0000 7f45eb7fe700 1 -- 172.21.15.149:0/807340490 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff803d6590 msgr2=0x55ff803c02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:34.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.072+0000 7f45eb7fe700 1 --2- 172.21.15.149:0/807340490 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff803d6590 0x55ff803c02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.072+0000 7f45eb7fe700 1 -- 172.21.15.149:0/807340490 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45e000f040 con 0x55ff803946f0 2023-11-08T19:28:34.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.072+0000 7f45ebfff700 1 --2- 172.21.15.149:0/807340490 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff803d6590 0x55ff803c02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:28:34.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.072+0000 7f45eb7fe700 1 --2- 172.21.15.149:0/807340490 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ff803946f0 0x55ff80395930 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f45e00013c0 tx=0x7f45e0011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=168e6bf3e6696952 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:34.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.072+0000 7f45ca7fc700 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2023-11-08T19:28:34.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.072+0000 7f45ca7fc700 1 -- 172.21.15.149:0/807340490 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e0003a40 con 0x55ff803946f0 2023-11-08T19:28:34.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.072+0000 7f45ca7fc700 1 -- 172.21.15.149:0/807340490 <== mon.0 v2:172.21.15.149:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 7436+0+0 (secure 0 0 0) 0x7f45e0003ba0 con 0x55ff803946f0 2023-11-08T19:28:34.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.072+0000 7f45fdd16b80 1 -- 172.21.15.149:0/807340490 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ff8039a030 con 0x55ff803946f0 2023-11-08T19:28:34.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.073+0000 7f45ca7fc700 1 -- 172.21.15.149:0/807340490 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f45e0003d60 con 0x55ff803946f0 2023-11-08T19:28:34.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.073+0000 7f45fdd16b80 10 client.7728 fetch_fsmap learned FSMap version 83 2023-11-08T19:28:34.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.073+0000 7f45fdd16b80 1 -- 172.21.15.149:0/807340490 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) v3 -- 0x55ff8013d200 con 0x55ff803946f0 2023-11-08T19:28:34.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.073+0000 7f45ca7fc700 1 -- 172.21.15.149:0/807340490 <== mon.0 v2:172.21.15.149:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ff8039a030 con 0x55ff803946f0 2023-11-08T19:28:34.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.073+0000 7f45ca7fc700 1 -- 172.21.15.149:0/807340490 <== mon.0 v2:172.21.15.149:3300/0 5 ==== fsmap(e 83) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f45e0013420 con 0x55ff803946f0 2023-11-08T19:28:34.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.073+0000 7f45fdd16b80 10 client.7728 fetch_fsmap finished waiting for FSMap version 83 2023-11-08T19:28:34.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.073+0000 7f45fdd16b80 10 client.7728 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-08T19:28:34.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.073+0000 7f45fdd16b80 20 client.7728 populate_metadata read hostname 'smithi149' 2023-11-08T19:28:34.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.073+0000 7f45fdd16b80 1 --2- 172.21.15.149:0/807340490 >> [v2:172.21.15.149:6835/3917392643,v1:172.21.15.149:6837/3917392643] conn(0x55ff803c0b30 0x55ff803d4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:34.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.073+0000 7f45fdd16b80 4 client.7728 mds_command: new command op to 7125 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-08T19:28:34.092 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.073+0000 7f45fdd16b80 1 -- 172.21.15.149:0/807340490 --> [v2:172.21.15.149:6835/3917392643,v1:172.21.15.149:6837/3917392643] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f45e4060430 con 0x55ff803c0b30 2023-11-08T19:28:34.092 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.073+0000 7f45eaffd700 1 --2- 172.21.15.149:0/807340490 >> [v2:172.21.15.149:6835/3917392643,v1:172.21.15.149:6837/3917392643] conn(0x55ff803c0b30 0x55ff803d4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:34.092 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.073+0000 7f45ca7fc700 10 client.7728 ms_handle_connect on v2:172.21.15.149:6835/3917392643 2023-11-08T19:28:34.092 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.073+0000 7f45eaffd700 1 --2- 172.21.15.149:0/807340490 >> [v2:172.21.15.149:6835/3917392643,v1:172.21.15.149:6837/3917392643] conn(0x55ff803c0b30 0x55ff803d4de0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b0040d5af4042f0b server_cookie=d91db35bf5615bca in_seq=0 out_seq=0 2023-11-08T19:28:34.092 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.073+0000 7f45ca7fc700 1 -- 172.21.15.149:0/807340490 <== mds.1 v2:172.21.15.149:6835/3917392643 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x7f45e4060430 con 0x55ff803c0b30 2023-11-08T19:28:34.093 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.073+0000 7f45ca7fc700 10 client.7728 handle_command_reply: tid=0 2023-11-08T19:28:34.093 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.073+0000 7f45fdd16b80 1 client.7728 shutdown 2023-11-08T19:28:34.093 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.074+0000 7f45fdd16b80 1 -- 172.21.15.149:0/807340490 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ff803946f0 msgr2=0x55ff80395930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:34.093 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.074+0000 7f45fdd16b80 1 --2- 172.21.15.149:0/807340490 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ff803946f0 0x55ff80395930 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f45e00013c0 tx=0x7f45e0011000 comp rx=0 tx=0).stop 2023-11-08T19:28:34.093 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.074+0000 7f45fdd16b80 1 -- 172.21.15.149:0/807340490 shutdown_connections 2023-11-08T19:28:34.093 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.074+0000 7f45fdd16b80 1 --2- 172.21.15.149:0/807340490 >> [v2:172.21.15.149:6835/3917392643,v1:172.21.15.149:6837/3917392643] conn(0x55ff803c0b30 0x55ff803d4de0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.094 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.074+0000 7f45fdd16b80 1 --2- 172.21.15.149:0/807340490 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff803d6590 0x55ff803c02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.094 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.074+0000 7f45ca7fc700 0 client.7728 ms_handle_reset on v2:172.21.15.149:6835/3917392643 2023-11-08T19:28:34.094 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.074+0000 7f45fdd16b80 1 --2- 172.21.15.149:0/807340490 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ff803946f0 0x55ff80395930 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.094 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.074+0000 7f45fdd16b80 1 --2- 172.21.15.149:0/807340490 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55ff80394ad0 0x55ff803936f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.074+0000 7f45fdd16b80 1 -- 172.21.15.149:0/807340490 >> 172.21.15.149:0/807340490 conn(0x55ff8030f660 msgr2=0x55ff80401300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:34.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.074+0000 7f45fdd16b80 1 -- 172.21.15.149:0/807340490 shutdown_connections 2023-11-08T19:28:34.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.074+0000 7f45fdd16b80 1 -- 172.21.15.149:0/807340490 wait complete. 2023-11-08T19:28:34.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.074+0000 7f45fdd16b80 20 client.7728 trim_cache size 0 max 16384 2023-11-08T19:28:34.095 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2023-11-08T19:28:34.096 INFO:teuthology.orchestra.run.smithi149.stdout: "cluster_fsid": "0aba7c70-fe80-4446-a2f5-7502ac3adfb4", 2023-11-08T19:28:34.096 INFO:teuthology.orchestra.run.smithi149.stdout: "whoami": 1, 2023-11-08T19:28:34.096 INFO:teuthology.orchestra.run.smithi149.stdout: "id": 7125, 2023-11-08T19:28:34.096 INFO:teuthology.orchestra.run.smithi149.stdout: "want_state": "up:active", 2023-11-08T19:28:34.097 INFO:teuthology.orchestra.run.smithi149.stdout: "state": "up:active", 2023-11-08T19:28:34.097 INFO:teuthology.orchestra.run.smithi149.stdout: "fs_name": "cephfs", 2023-11-08T19:28:34.097 INFO:teuthology.orchestra.run.smithi149.stdout: "rank_uptime": 95.429626184, 2023-11-08T19:28:34.097 INFO:teuthology.orchestra.run.smithi149.stdout: "mdsmap_epoch": 83, 2023-11-08T19:28:34.097 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_epoch": 101, 2023-11-08T19:28:34.097 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_epoch_barrier": 101, 2023-11-08T19:28:34.098 INFO:teuthology.orchestra.run.smithi149.stdout: "uptime": 111.42258329000001 2023-11-08T19:28:34.098 INFO:teuthology.orchestra.run.smithi149.stdout:} 2023-11-08T19:28:34.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.074+0000 7f45f1b1d700 1 -- 172.21.15.149:0/1397518870 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f45d806af00 msgr2=0x7f45d806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:34.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.074+0000 7f45f1b1d700 1 --2- 172.21.15.149:0/1397518870 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f45d806af00 0x7f45d806d3c0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f45e0001780 tx=0x7f45e0009040 comp rx=0 tx=0).stop 2023-11-08T19:28:34.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.074+0000 7f45f1b1d700 1 -- 172.21.15.149:0/1397518870 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45ec0cc910 msgr2=0x7f45ec0b02b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:34.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.074+0000 7f45f1b1d700 1 --2- 172.21.15.149:0/1397518870 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45ec0cc910 0x7f45ec0b02b0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f45e400b970 tx=0x7f45e400bd30 comp rx=0 tx=0).stop 2023-11-08T19:28:34.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.074+0000 7f45f1b1d700 1 -- 172.21.15.149:0/1397518870 shutdown_connections 2023-11-08T19:28:34.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.074+0000 7f45f1b1d700 1 --2- 172.21.15.149:0/1397518870 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f45d806af00 0x7f45d806d3c0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.074+0000 7f45f1b1d700 1 --2- 172.21.15.149:0/1397518870 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f45ec0cb130 0x7f45ec15ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.074+0000 7f45f1b1d700 1 --2- 172.21.15.149:0/1397518870 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45ec0cc910 0x7f45ec0b02b0 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.074+0000 7f45f1b1d700 1 --2- 172.21.15.149:0/1397518870 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f45ec0cc140 0x7f45ec0afd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.074+0000 7f45f1b1d700 1 -- 172.21.15.149:0/1397518870 >> 172.21.15.149:0/1397518870 conn(0x7f45ec099a40 msgr2=0x7f45ec0c7670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:34.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.074+0000 7f45f1b1d700 1 -- 172.21.15.149:0/1397518870 shutdown_connections 2023-11-08T19:28:34.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.074+0000 7f45f1b1d700 1 -- 172.21.15.149:0/1397518870 wait complete. 2023-11-08T19:28:34.102 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-08T19:28:34.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.224+0000 7f882d5a5700 1 Processor -- start 2023-11-08T19:28:34.226 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.224+0000 7f882d5a5700 1 -- start start 2023-11-08T19:28:34.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.225+0000 7f882d5a5700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f8828161670 0x7f88280b5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:34.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.225+0000 7f882d5a5700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f8828161a50 0x7f8828161f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:34.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.225+0000 7f882d5a5700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f882815dd90 0x7f882815e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:34.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.225+0000 7f882d5a5700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88280d1a10 con 0x7f8828161670 2023-11-08T19:28:34.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.225+0000 7f882d5a5700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88280d1cf0 con 0x7f8828161a50 2023-11-08T19:28:34.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.225+0000 7f882d5a5700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88280d1fd0 con 0x7f882815dd90 2023-11-08T19:28:34.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.225+0000 7f8826ffd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f8828161670 0x7f88280b5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:34.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.225+0000 7f8826ffd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f8828161670 0x7f88280b5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44632/0 (socket says 172.21.15.149:44632) 2023-11-08T19:28:34.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.225+0000 7f8826ffd700 1 -- 172.21.15.149:0/4124494449 learned_addr learned my addr 172.21.15.149:0/4124494449 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:28:34.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.225+0000 7f8826ffd700 1 -- 172.21.15.149:0/4124494449 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f882815dd90 msgr2=0x7f882815e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:34.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.225+0000 7f88277fe700 1 --2- 172.21.15.149:0/4124494449 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f882815dd90 0x7f882815e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:34.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.225+0000 7f88267fc700 1 --2- 172.21.15.149:0/4124494449 >> v2:172.21.15.160:3300/0 conn(0x7f8828161a50 0x7f8828161f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:34.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.225+0000 7f8826ffd700 1 --2- 172.21.15.149:0/4124494449 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f882815dd90 0x7f882815e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.225+0000 7f8826ffd700 1 -- 172.21.15.149:0/4124494449 >> v2:172.21.15.160:3300/0 conn(0x7f8828161a50 msgr2=0x7f8828161f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:34.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.225+0000 7f8826ffd700 1 --2- 172.21.15.149:0/4124494449 >> v2:172.21.15.160:3300/0 conn(0x7f8828161a50 0x7f8828161f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.225+0000 7f8826ffd700 1 -- 172.21.15.149:0/4124494449 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88280d22b0 con 0x7f8828161670 2023-11-08T19:28:34.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.226+0000 7f8826ffd700 1 --2- 172.21.15.149:0/4124494449 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8828161670 0x7f88280b5e10 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f88280d1470 tx=0x7f881c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2afa7f739ba1a145 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:34.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.226+0000 7f8825ffb700 1 -- 172.21.15.149:0/4124494449 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881c005e30 con 0x7f8828161670 2023-11-08T19:28:34.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.226+0000 7f8825ffb700 1 -- 172.21.15.149:0/4124494449 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f881c004030 con 0x7f8828161670 2023-11-08T19:28:34.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.226+0000 7f8825ffb700 1 -- 172.21.15.149:0/4124494449 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881c0043e0 con 0x7f8828161670 2023-11-08T19:28:34.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.226+0000 7f882d5a5700 1 -- 172.21.15.149:0/4124494449 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8828161670 msgr2=0x7f88280b5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:34.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.226+0000 7f882d5a5700 1 --2- 172.21.15.149:0/4124494449 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8828161670 0x7f88280b5e10 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f88280d1470 tx=0x7f881c009bd0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.226+0000 7f882d5a5700 1 -- 172.21.15.149:0/4124494449 shutdown_connections 2023-11-08T19:28:34.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.226+0000 7f882d5a5700 1 --2- 172.21.15.149:0/4124494449 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f882815dd90 0x7f882815e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.226+0000 7f882d5a5700 1 --2- 172.21.15.149:0/4124494449 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8828161670 0x7f88280b5e10 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.226+0000 7f882d5a5700 1 --2- 172.21.15.149:0/4124494449 >> v2:172.21.15.160:3300/0 conn(0x7f8828161a50 0x7f8828161f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.226+0000 7f882d5a5700 1 -- 172.21.15.149:0/4124494449 >> 172.21.15.149:0/4124494449 conn(0x7f88280d3980 msgr2=0x7f88280d3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:34.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.226+0000 7f882d5a5700 1 -- 172.21.15.149:0/4124494449 shutdown_connections 2023-11-08T19:28:34.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.226+0000 7f882d5a5700 1 -- 172.21.15.149:0/4124494449 wait complete. 2023-11-08T19:28:34.238 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.228+0000 7f882d5a5700 1 Processor -- start 2023-11-08T19:28:34.238 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.228+0000 7f882d5a5700 1 -- start start 2023-11-08T19:28:34.238 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.229+0000 7f882d5a5700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f882815dd90 0x7f88281e7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:34.239 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.229+0000 7f882d5a5700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8828161670 0x7f8828158db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:34.239 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.229+0000 7f882d5a5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8828161a50 0x7f88281585d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:34.239 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.229+0000 7f882d5a5700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88280cbde0 con 0x7f8828161a50 2023-11-08T19:28:34.239 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.229+0000 7f882d5a5700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88281592f0 con 0x7f8828161670 2023-11-08T19:28:34.239 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.229+0000 7f882d5a5700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8828158b10 con 0x7f882815dd90 2023-11-08T19:28:34.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.229+0000 7f88277fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8828161a50 0x7f88281585d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:34.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.229+0000 7f88277fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8828161a50 0x7f88281585d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44642/0 (socket says 172.21.15.149:44642) 2023-11-08T19:28:34.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.229+0000 7f88277fe700 1 -- 172.21.15.149:0/2111896554 learned_addr learned my addr 172.21.15.149:0/2111896554 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:28:34.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.229+0000 7f88277fe700 1 -- 172.21.15.149:0/2111896554 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f882815dd90 msgr2=0x7f88281e7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:34.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.229+0000 7f88277fe700 1 --2- 172.21.15.149:0/2111896554 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f882815dd90 0x7f88281e7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.229+0000 7f88277fe700 1 -- 172.21.15.149:0/2111896554 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8828161670 msgr2=0x7f8828158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:34.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.229+0000 7f88277fe700 1 --2- 172.21.15.149:0/2111896554 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8828161670 0x7f8828158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.229+0000 7f88277fe700 1 -- 172.21.15.149:0/2111896554 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f881c009500 con 0x7f8828161a50 2023-11-08T19:28:34.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.229+0000 7f88277fe700 1 --2- 172.21.15.149:0/2111896554 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8828161a50 0x7f88281585d0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f882000cd20 tx=0x7f882000a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:34.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.229+0000 7f880f7fe700 1 -- 172.21.15.149:0/2111896554 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8820003a20 con 0x7f8828161a50 2023-11-08T19:28:34.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.229+0000 7f880f7fe700 1 -- 172.21.15.149:0/2111896554 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8820003b80 con 0x7f8828161a50 2023-11-08T19:28:34.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.229+0000 7f880f7fe700 1 -- 172.21.15.149:0/2111896554 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8820004020 con 0x7f8828161a50 2023-11-08T19:28:34.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.229+0000 7f882d5a5700 1 -- 172.21.15.149:0/2111896554 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88280cc080 con 0x7f8828161a50 2023-11-08T19:28:34.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.229+0000 7f882d5a5700 1 -- 172.21.15.149:0/2111896554 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88281e8cd0 con 0x7f8828161a50 2023-11-08T19:28:34.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.231+0000 7f880f7fe700 1 -- 172.21.15.149:0/2111896554 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8820004180 con 0x7f8828161a50 2023-11-08T19:28:34.243 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.231+0000 7f880f7fe700 1 --2- 172.21.15.149:0/2111896554 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f881406af00 0x7f881406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:34.243 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.231+0000 7f880f7fe700 1 -- 172.21.15.149:0/2111896554 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7436+0+0 (secure 0 0 0) 0x7f8820012070 con 0x7f8828161a50 2023-11-08T19:28:34.243 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.231+0000 7f8826ffd700 1 --2- 172.21.15.149:0/2111896554 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f881406af00 0x7f881406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:34.243 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.231+0000 7f8826ffd700 1 --2- 172.21.15.149:0/2111896554 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f881406af00 0x7f881406d3c0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f88280d1470 tx=0x7f881c010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:34.243 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.233+0000 7f883979eb80 1 Processor -- start 2023-11-08T19:28:34.244 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.233+0000 7f883979eb80 1 -- start start 2023-11-08T19:28:34.244 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.234+0000 7f883979eb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c90efee6f0 0x55c90f01e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:34.244 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.234+0000 7f883979eb80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c90eff0c30 0x55c90f01e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:34.244 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.234+0000 7f883979eb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c90efeead0 0x55c90f008f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:34.244 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.234+0000 7f883979eb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c90ef5a6e0 con 0x55c90efee6f0 2023-11-08T19:28:34.244 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.234+0000 7f883979eb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c90ef4e3b0 con 0x55c90efeead0 2023-11-08T19:28:34.245 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.234+0000 7f883979eb80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c90ef4bcd0 con 0x55c90eff0c30 2023-11-08T19:28:34.245 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.234+0000 7f8826ffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c90efee6f0 0x55c90f01e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:34.245 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.234+0000 7f8826ffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c90efee6f0 0x55c90f01e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44646/0 (socket says 172.21.15.149:44646) 2023-11-08T19:28:34.245 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.234+0000 7f8826ffd700 1 -- 172.21.15.149:0/599419451 learned_addr learned my addr 172.21.15.149:0/599419451 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:28:34.245 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.234+0000 7f88277fe700 1 --2- 172.21.15.149:0/599419451 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c90efeead0 0x55c90f008f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:34.246 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.234+0000 7f88267fc700 1 --2- 172.21.15.149:0/599419451 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c90eff0c30 0x55c90f01e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:34.246 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.235+0000 7f8826ffd700 1 -- 172.21.15.149:0/599419451 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c90eff0c30 msgr2=0x55c90f01e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:34.246 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.235+0000 7f8826ffd700 1 --2- 172.21.15.149:0/599419451 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c90eff0c30 0x55c90f01e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.246 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.235+0000 7f8826ffd700 1 -- 172.21.15.149:0/599419451 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c90efeead0 msgr2=0x55c90f008f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:34.246 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.235+0000 7f8826ffd700 1 --2- 172.21.15.149:0/599419451 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c90efeead0 0x55c90f008f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.247 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.235+0000 7f8826ffd700 1 -- 172.21.15.149:0/599419451 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c90edc45e0 con 0x55c90efee6f0 2023-11-08T19:28:34.247 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.235+0000 7f8826ffd700 1 --2- 172.21.15.149:0/599419451 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c90efee6f0 0x55c90f01e450 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f881c006fd0 tx=0x7f881c008000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6860e1163f3105ab server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:34.247 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.235+0000 7f880cff9700 1 -- 172.21.15.149:0/599419451 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881c028660 con 0x55c90efee6f0 2023-11-08T19:28:34.247 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.235+0000 7f880cff9700 1 -- 172.21.15.149:0/599419451 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f881c0287c0 con 0x55c90efee6f0 2023-11-08T19:28:34.247 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.235+0000 7f880cff9700 1 -- 172.21.15.149:0/599419451 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881c028b50 con 0x55c90efee6f0 2023-11-08T19:28:34.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.236+0000 7f883979eb80 1 -- 172.21.15.149:0/599419451 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c90efee6f0 msgr2=0x55c90f01e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:34.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.236+0000 7f883979eb80 1 --2- 172.21.15.149:0/599419451 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c90efee6f0 0x55c90f01e450 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f881c006fd0 tx=0x7f881c008000 comp rx=0 tx=0).stop 2023-11-08T19:28:34.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.236+0000 7f883979eb80 1 -- 172.21.15.149:0/599419451 shutdown_connections 2023-11-08T19:28:34.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.236+0000 7f883979eb80 1 --2- 172.21.15.149:0/599419451 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c90efeead0 0x55c90f008f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.236+0000 7f883979eb80 1 --2- 172.21.15.149:0/599419451 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c90efee6f0 0x55c90f01e450 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.249 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.236+0000 7f883979eb80 1 --2- 172.21.15.149:0/599419451 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c90eff0c30 0x55c90f01e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.249 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.236+0000 7f883979eb80 1 -- 172.21.15.149:0/599419451 >> 172.21.15.149:0/599419451 conn(0x55c90ef69660 msgr2=0x55c90eff43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:34.249 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.236+0000 7f883979eb80 1 -- 172.21.15.149:0/599419451 shutdown_connections 2023-11-08T19:28:34.249 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.236+0000 7f883979eb80 1 -- 172.21.15.149:0/599419451 wait complete. 2023-11-08T19:28:34.249 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.236+0000 7f883979eb80 1 -- start start 2023-11-08T19:28:34.249 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.236+0000 7f883979eb80 1 Processor -- start 2023-11-08T19:28:34.253 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.238+0000 7f883979eb80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c90efee6f0 0x55c90f0492b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:34.253 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.238+0000 7f883979eb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c90efeead0 0x55c90f021990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:34.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.238+0000 7f883979eb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c90f021ed0 0x55c90f032820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:34.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.238+0000 7f883979eb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c90ef475c0 con 0x55c90f021ed0 2023-11-08T19:28:34.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.238+0000 7f883979eb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c90eee30d0 con 0x55c90efeead0 2023-11-08T19:28:34.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.238+0000 7f883979eb80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c90eee2d70 con 0x55c90efee6f0 2023-11-08T19:28:34.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.238+0000 7f883979eb80 10 client.0 _ll_register_callbacks cb 0x55c90ed3f7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-08T19:28:34.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.238+0000 7f88277fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c90f021ed0 0x55c90f032820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:34.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.238+0000 7f88277fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c90f021ed0 0x55c90f032820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44656/0 (socket says 172.21.15.149:44656) 2023-11-08T19:28:34.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.238+0000 7f88277fe700 1 -- 172.21.15.149:0/4014061401 learned_addr learned my addr 172.21.15.149:0/4014061401 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:28:34.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.238+0000 7f88267fc700 1 --2- 172.21.15.149:0/4014061401 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c90efeead0 0x55c90f021990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:34.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.238+0000 7f8826ffd700 1 --2- 172.21.15.149:0/4014061401 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c90efee6f0 0x55c90f0492b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:34.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.238+0000 7f88277fe700 1 -- 172.21.15.149:0/4014061401 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c90efee6f0 msgr2=0x55c90f0492b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:34.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.238+0000 7f88277fe700 1 --2- 172.21.15.149:0/4014061401 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c90efee6f0 0x55c90f0492b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.238+0000 7f88277fe700 1 -- 172.21.15.149:0/4014061401 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c90efeead0 msgr2=0x55c90f021990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:34.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.238+0000 7f88277fe700 1 --2- 172.21.15.149:0/4014061401 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c90efeead0 0x55c90f021990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.238+0000 7f88277fe700 1 -- 172.21.15.149:0/4014061401 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88280d22b0 con 0x55c90f021ed0 2023-11-08T19:28:34.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.238+0000 7f88277fe700 1 --2- 172.21.15.149:0/4014061401 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c90f021ed0 0x55c90f032820 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f88200589a0 tx=0x7f882005cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49ca012232fa0c1d server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:34.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.238+0000 7f8805ffb700 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2023-11-08T19:28:34.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.238+0000 7f8805ffb700 1 -- 172.21.15.149:0/4014061401 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8820070300 con 0x55c90f021ed0 2023-11-08T19:28:34.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.238+0000 7f8805ffb700 1 -- 172.21.15.149:0/4014061401 <== mon.0 v2:172.21.15.149:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 7436+0+0 (secure 0 0 0) 0x7f882008a110 con 0x55c90f021ed0 2023-11-08T19:28:34.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.238+0000 7f883979eb80 1 -- 172.21.15.149:0/4014061401 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c90efe6880 con 0x55c90f021ed0 2023-11-08T19:28:34.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.238+0000 7f8805ffb700 1 -- 172.21.15.149:0/4014061401 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8820057f00 con 0x55c90f021ed0 2023-11-08T19:28:34.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.238+0000 7f883979eb80 10 client.7740 fetch_fsmap learned FSMap version 83 2023-11-08T19:28:34.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.238+0000 7f883979eb80 1 -- 172.21.15.149:0/4014061401 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) v3 -- 0x55c90ed70d90 con 0x55c90f021ed0 2023-11-08T19:28:34.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.239+0000 7f8805ffb700 1 -- 172.21.15.149:0/4014061401 <== mon.0 v2:172.21.15.149:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c90efe6880 con 0x55c90f021ed0 2023-11-08T19:28:34.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.239+0000 7f8805ffb700 1 -- 172.21.15.149:0/4014061401 <== mon.0 v2:172.21.15.149:3300/0 5 ==== fsmap(e 83) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f8820060880 con 0x55c90f021ed0 2023-11-08T19:28:34.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.239+0000 7f883979eb80 10 client.7740 fetch_fsmap finished waiting for FSMap version 83 2023-11-08T19:28:34.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.239+0000 7f883979eb80 10 client.7740 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-08T19:28:34.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.239+0000 7f883979eb80 20 client.7740 populate_metadata read hostname 'smithi149' 2023-11-08T19:28:34.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.239+0000 7f883979eb80 1 --2- 172.21.15.149:0/4014061401 >> [v2:172.21.15.149:6834/295381437,v1:172.21.15.149:6836/295381437] conn(0x55c90f01f5f0 0x55c90f055ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:34.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.239+0000 7f883979eb80 4 client.7740 mds_command: new command op to 7578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-08T19:28:34.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.239+0000 7f883979eb80 1 -- 172.21.15.149:0/4014061401 --> [v2:172.21.15.149:6834/295381437,v1:172.21.15.149:6836/295381437] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c90efc2a30 con 0x55c90f01f5f0 2023-11-08T19:28:34.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.239+0000 7f8826ffd700 1 --2- 172.21.15.149:0/4014061401 >> [v2:172.21.15.149:6834/295381437,v1:172.21.15.149:6836/295381437] conn(0x55c90f01f5f0 0x55c90f055ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:34.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.239+0000 7f8805ffb700 10 client.7740 ms_handle_connect on v2:172.21.15.149:6834/295381437 2023-11-08T19:28:34.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.239+0000 7f8826ffd700 1 --2- 172.21.15.149:0/4014061401 >> [v2:172.21.15.149:6834/295381437,v1:172.21.15.149:6836/295381437] conn(0x55c90f01f5f0 0x55c90f055ec0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5167543e67fbafaa server_cookie=b217860d846bc1c in_seq=0 out_seq=0 2023-11-08T19:28:34.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.240+0000 7f8805ffb700 1 -- 172.21.15.149:0/4014061401 <== mds.0 v2:172.21.15.149:6834/295381437 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c90efc2a30 con 0x55c90f01f5f0 2023-11-08T19:28:34.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.240+0000 7f8805ffb700 10 client.7740 handle_command_reply: tid=0 2023-11-08T19:28:34.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.240+0000 7f883979eb80 1 client.7740 shutdown 2023-11-08T19:28:34.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.240+0000 7f883979eb80 1 -- 172.21.15.149:0/4014061401 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c90f021ed0 msgr2=0x55c90f032820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:34.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.240+0000 7f883979eb80 1 --2- 172.21.15.149:0/4014061401 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c90f021ed0 0x55c90f032820 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f88200589a0 tx=0x7f882005cb60 comp rx=0 tx=0).stop 2023-11-08T19:28:34.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.240+0000 7f883979eb80 1 -- 172.21.15.149:0/4014061401 shutdown_connections 2023-11-08T19:28:34.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.240+0000 7f883979eb80 1 --2- 172.21.15.149:0/4014061401 >> [v2:172.21.15.149:6834/295381437,v1:172.21.15.149:6836/295381437] conn(0x55c90f01f5f0 0x55c90f055ec0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.240+0000 7f883979eb80 1 --2- 172.21.15.149:0/4014061401 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c90f021ed0 0x55c90f032820 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.240+0000 7f883979eb80 1 --2- 172.21.15.149:0/4014061401 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c90efee6f0 0x55c90f0492b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.240+0000 7f883979eb80 1 --2- 172.21.15.149:0/4014061401 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c90efeead0 0x55c90f021990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.240+0000 7f8805ffb700 0 client.7740 ms_handle_reset on v2:172.21.15.149:6834/295381437 2023-11-08T19:28:34.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.240+0000 7f883979eb80 1 -- 172.21.15.149:0/4014061401 >> 172.21.15.149:0/4014061401 conn(0x55c90ef69660 msgr2=0x55c90f01e440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:34.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.240+0000 7f883979eb80 1 -- 172.21.15.149:0/4014061401 shutdown_connections 2023-11-08T19:28:34.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.240+0000 7f883979eb80 1 -- 172.21.15.149:0/4014061401 wait complete. 2023-11-08T19:28:34.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.240+0000 7f883979eb80 20 client.7740 trim_cache size 0 max 16384 2023-11-08T19:28:34.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.258+0000 7f883979eb80 1 Processor -- start 2023-11-08T19:28:34.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.258+0000 7f883979eb80 1 -- start start 2023-11-08T19:28:34.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.259+0000 7f883979eb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c90efee6f0 0x55c90f0322d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:34.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.259+0000 7f883979eb80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c90efeead0 0x55c90f047b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:34.270 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.259+0000 7f883979eb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c90f021ed0 0x55c90f0480b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:34.270 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.259+0000 7f883979eb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c90edc68d0 con 0x55c90f021ed0 2023-11-08T19:28:34.270 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.259+0000 7f883979eb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c90eff4de0 con 0x55c90efee6f0 2023-11-08T19:28:34.270 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.259+0000 7f883979eb80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c90efee580 con 0x55c90efeead0 2023-11-08T19:28:34.270 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.259+0000 7f88277fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c90f021ed0 0x55c90f0480b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:34.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.259+0000 7f88277fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c90f021ed0 0x55c90f0480b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44662/0 (socket says 172.21.15.149:44662) 2023-11-08T19:28:34.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.259+0000 7f88277fe700 1 -- 172.21.15.149:0/4179938428 learned_addr learned my addr 172.21.15.149:0/4179938428 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:28:34.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.259+0000 7f8826ffd700 1 --2- 172.21.15.149:0/4179938428 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c90efee6f0 0x55c90f0322d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:34.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.259+0000 7f88267fc700 1 --2- 172.21.15.149:0/4179938428 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c90efeead0 0x55c90f047b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:34.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.259+0000 7f88277fe700 1 -- 172.21.15.149:0/4179938428 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c90efeead0 msgr2=0x55c90f047b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:34.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.259+0000 7f88277fe700 1 --2- 172.21.15.149:0/4179938428 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c90efeead0 0x55c90f047b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.259+0000 7f88277fe700 1 -- 172.21.15.149:0/4179938428 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c90efee6f0 msgr2=0x55c90f0322d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:34.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.259+0000 7f88277fe700 1 --2- 172.21.15.149:0/4179938428 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c90efee6f0 0x55c90f0322d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.259+0000 7f88277fe700 1 -- 172.21.15.149:0/4179938428 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c90eff1ee0 con 0x55c90f021ed0 2023-11-08T19:28:34.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.259+0000 7f88277fe700 1 --2- 172.21.15.149:0/4179938428 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c90f021ed0 0x55c90f0480b0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f8820055430 tx=0x7f882006d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfc3279e0bb30555 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:34.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.259+0000 7f880d7fa700 1 -- 172.21.15.149:0/4179938428 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88200078f0 con 0x55c90f021ed0 2023-11-08T19:28:34.273 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.260+0000 7f880d7fa700 1 -- 172.21.15.149:0/4179938428 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8820084030 con 0x55c90f021ed0 2023-11-08T19:28:34.273 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.260+0000 7f880d7fa700 1 -- 172.21.15.149:0/4179938428 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8820057f00 con 0x55c90f021ed0 2023-11-08T19:28:34.273 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.260+0000 7f883979eb80 1 -- 172.21.15.149:0/4179938428 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c90f021ed0 msgr2=0x55c90f0480b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:34.273 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.260+0000 7f883979eb80 1 --2- 172.21.15.149:0/4179938428 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c90f021ed0 0x55c90f0480b0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f8820055430 tx=0x7f882006d000 comp rx=0 tx=0).stop 2023-11-08T19:28:34.274 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.260+0000 7f883979eb80 1 -- 172.21.15.149:0/4179938428 shutdown_connections 2023-11-08T19:28:34.274 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.260+0000 7f883979eb80 1 --2- 172.21.15.149:0/4179938428 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c90efee6f0 0x55c90f0322d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.274 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.260+0000 7f883979eb80 1 --2- 172.21.15.149:0/4179938428 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c90f021ed0 0x55c90f0480b0 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.274 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.260+0000 7f883979eb80 1 --2- 172.21.15.149:0/4179938428 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c90efeead0 0x55c90f047b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.274 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.260+0000 7f883979eb80 1 -- 172.21.15.149:0/4179938428 >> 172.21.15.149:0/4179938428 conn(0x55c90ef69660 msgr2=0x55c90efea7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:34.275 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.260+0000 7f883979eb80 1 -- 172.21.15.149:0/4179938428 shutdown_connections 2023-11-08T19:28:34.275 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.260+0000 7f883979eb80 1 -- 172.21.15.149:0/4179938428 wait complete. 2023-11-08T19:28:34.275 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.261+0000 7f883979eb80 1 -- start start 2023-11-08T19:28:34.275 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.261+0000 7f883979eb80 1 Processor -- start 2023-11-08T19:28:34.275 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.262+0000 7f883979eb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c90efee6f0 0x55c90f008ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:34.276 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.262+0000 7f883979eb80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c90efeead0 0x55c90f047b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:34.276 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.262+0000 7f883979eb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c90f021ed0 0x55c90f0480b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:34.276 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.262+0000 7f883979eb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c90f01afb0 con 0x55c90f021ed0 2023-11-08T19:28:34.276 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.262+0000 7f883979eb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c90f0329f0 con 0x55c90efee6f0 2023-11-08T19:28:34.276 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.262+0000 7f883979eb80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c90f051ce0 con 0x55c90efeead0 2023-11-08T19:28:34.276 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.262+0000 7f883979eb80 10 client.0 _ll_register_callbacks cb 0x7f88200591e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-08T19:28:34.277 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.262+0000 7f88277fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c90f021ed0 0x55c90f0480b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:34.277 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.262+0000 7f88277fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c90f021ed0 0x55c90f0480b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44670/0 (socket says 172.21.15.149:44670) 2023-11-08T19:28:34.277 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.262+0000 7f88277fe700 1 -- 172.21.15.149:0/3386746706 learned_addr learned my addr 172.21.15.149:0/3386746706 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:28:34.277 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.262+0000 7f88267fc700 1 --2- 172.21.15.149:0/3386746706 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c90efeead0 0x55c90f047b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:34.277 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.262+0000 7f8826ffd700 1 --2- 172.21.15.149:0/3386746706 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c90efee6f0 0x55c90f008ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:34.278 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.262+0000 7f88277fe700 1 -- 172.21.15.149:0/3386746706 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c90efeead0 msgr2=0x55c90f047b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:34.278 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.262+0000 7f88277fe700 1 --2- 172.21.15.149:0/3386746706 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c90efeead0 0x55c90f047b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.278 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.262+0000 7f88277fe700 1 -- 172.21.15.149:0/3386746706 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c90efee6f0 msgr2=0x55c90f008ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:34.278 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.262+0000 7f88277fe700 1 --2- 172.21.15.149:0/3386746706 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c90efee6f0 0x55c90f008ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.278 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.262+0000 7f88277fe700 1 -- 172.21.15.149:0/3386746706 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c90ed70d90 con 0x55c90f021ed0 2023-11-08T19:28:34.279 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.263+0000 7f88277fe700 1 --2- 172.21.15.149:0/3386746706 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c90f021ed0 0x55c90f0480b0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f88200589a0 tx=0x7f88200880a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=810bdeffe08d8444 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:34.279 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.263+0000 7f8805ffb700 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2023-11-08T19:28:34.279 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.263+0000 7f8805ffb700 1 -- 172.21.15.149:0/3386746706 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88200078f0 con 0x55c90f021ed0 2023-11-08T19:28:34.279 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.263+0000 7f8805ffb700 1 -- 172.21.15.149:0/3386746706 <== mon.0 v2:172.21.15.149:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 7436+0+0 (secure 0 0 0) 0x7f8820060880 con 0x55c90f021ed0 2023-11-08T19:28:34.279 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.263+0000 7f883979eb80 1 -- 172.21.15.149:0/3386746706 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f881c0287c0 con 0x55c90f021ed0 2023-11-08T19:28:34.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.263+0000 7f8805ffb700 1 -- 172.21.15.149:0/3386746706 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8820057f00 con 0x55c90f021ed0 2023-11-08T19:28:34.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.263+0000 7f883979eb80 10 client.7746 fetch_fsmap learned FSMap version 83 2023-11-08T19:28:34.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.263+0000 7f883979eb80 1 -- 172.21.15.149:0/3386746706 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) v3 -- 0x55c90ed59c10 con 0x55c90f021ed0 2023-11-08T19:28:34.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.263+0000 7f8805ffb700 1 -- 172.21.15.149:0/3386746706 <== mon.0 v2:172.21.15.149:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f881c0287c0 con 0x55c90f021ed0 2023-11-08T19:28:34.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.263+0000 7f8805ffb700 1 -- 172.21.15.149:0/3386746706 <== mon.0 v2:172.21.15.149:3300/0 5 ==== fsmap(e 83) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f88200770d0 con 0x55c90f021ed0 2023-11-08T19:28:34.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.263+0000 7f883979eb80 10 client.7746 fetch_fsmap finished waiting for FSMap version 83 2023-11-08T19:28:34.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.263+0000 7f883979eb80 10 client.7746 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-08T19:28:34.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.263+0000 7f883979eb80 20 client.7746 populate_metadata read hostname 'smithi149' 2023-11-08T19:28:34.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.263+0000 7f883979eb80 1 --2- 172.21.15.149:0/3386746706 >> [v2:172.21.15.149:6834/295381437,v1:172.21.15.149:6836/295381437] conn(0x55c90f052190 0x55c90f052570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:34.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.263+0000 7f883979eb80 4 client.7746 mds_command: new command op to 7578 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-08T19:28:34.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.263+0000 7f883979eb80 1 -- 172.21.15.149:0/3386746706 --> [v2:172.21.15.149:6834/295381437,v1:172.21.15.149:6836/295381437] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c90ef405a0 con 0x55c90f052190 2023-11-08T19:28:34.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.263+0000 7f8826ffd700 1 --2- 172.21.15.149:0/3386746706 >> [v2:172.21.15.149:6834/295381437,v1:172.21.15.149:6836/295381437] conn(0x55c90f052190 0x55c90f052570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:34.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.263+0000 7f8805ffb700 10 client.7746 ms_handle_connect on v2:172.21.15.149:6834/295381437 2023-11-08T19:28:34.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.263+0000 7f8826ffd700 1 --2- 172.21.15.149:0/3386746706 >> [v2:172.21.15.149:6834/295381437,v1:172.21.15.149:6836/295381437] conn(0x55c90f052190 0x55c90f052570 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afceb5c818c8a556 server_cookie=125c1fcff2e8f69c in_seq=0 out_seq=0 2023-11-08T19:28:34.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.264+0000 7f8805ffb700 1 -- 172.21.15.149:0/3386746706 <== mds.0 v2:172.21.15.149:6834/295381437 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+320 (crc 0 0 0) 0x55c90ef405a0 con 0x55c90f052190 2023-11-08T19:28:34.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.264+0000 7f8805ffb700 10 client.7746 handle_command_reply: tid=0 2023-11-08T19:28:34.283 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.264+0000 7f883979eb80 1 client.7746 shutdown 2023-11-08T19:28:34.283 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.264+0000 7f883979eb80 1 -- 172.21.15.149:0/3386746706 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c90f021ed0 msgr2=0x55c90f0480b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:34.283 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.264+0000 7f883979eb80 1 --2- 172.21.15.149:0/3386746706 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c90f021ed0 0x55c90f0480b0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f88200589a0 tx=0x7f88200880a0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.283 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.264+0000 7f883979eb80 1 -- 172.21.15.149:0/3386746706 shutdown_connections 2023-11-08T19:28:34.283 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.264+0000 7f883979eb80 1 --2- 172.21.15.149:0/3386746706 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c90efee6f0 0x55c90f008ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.284 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.264+0000 7f883979eb80 1 --2- 172.21.15.149:0/3386746706 >> [v2:172.21.15.149:6834/295381437,v1:172.21.15.149:6836/295381437] conn(0x55c90f052190 0x55c90f052570 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.284 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.264+0000 7f883979eb80 1 --2- 172.21.15.149:0/3386746706 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c90f021ed0 0x55c90f0480b0 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.284 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.264+0000 7f8805ffb700 0 client.7746 ms_handle_reset on v2:172.21.15.149:6834/295381437 2023-11-08T19:28:34.284 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.264+0000 7f883979eb80 1 --2- 172.21.15.149:0/3386746706 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55c90efeead0 0x55c90f047b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.284 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.264+0000 7f883979eb80 1 -- 172.21.15.149:0/3386746706 >> 172.21.15.149:0/3386746706 conn(0x55c90ef69660 msgr2=0x55c90efea7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:34.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.264+0000 7f883979eb80 1 -- 172.21.15.149:0/3386746706 shutdown_connections 2023-11-08T19:28:34.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.264+0000 7f883979eb80 1 -- 172.21.15.149:0/3386746706 wait complete. 2023-11-08T19:28:34.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.264+0000 7f883979eb80 20 client.7746 trim_cache size 0 max 16384 2023-11-08T19:28:34.285 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2023-11-08T19:28:34.286 INFO:teuthology.orchestra.run.smithi149.stdout: "cluster_fsid": "0aba7c70-fe80-4446-a2f5-7502ac3adfb4", 2023-11-08T19:28:34.286 INFO:teuthology.orchestra.run.smithi149.stdout: "whoami": 0, 2023-11-08T19:28:34.286 INFO:teuthology.orchestra.run.smithi149.stdout: "id": 7578, 2023-11-08T19:28:34.286 INFO:teuthology.orchestra.run.smithi149.stdout: "want_state": "up:active", 2023-11-08T19:28:34.286 INFO:teuthology.orchestra.run.smithi149.stdout: "state": "up:active", 2023-11-08T19:28:34.287 INFO:teuthology.orchestra.run.smithi149.stdout: "fs_name": "cephfs", 2023-11-08T19:28:34.287 INFO:teuthology.orchestra.run.smithi149.stdout: "rank_uptime": 6.929715345, 2023-11-08T19:28:34.287 INFO:teuthology.orchestra.run.smithi149.stdout: "mdsmap_epoch": 83, 2023-11-08T19:28:34.287 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_epoch": 101, 2023-11-08T19:28:34.287 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_epoch_barrier": 101, 2023-11-08T19:28:34.288 INFO:teuthology.orchestra.run.smithi149.stdout: "uptime": 33.422611687 2023-11-08T19:28:34.288 INFO:teuthology.orchestra.run.smithi149.stdout:} 2023-11-08T19:28:34.289 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.264+0000 7f882d5a5700 1 -- 172.21.15.149:0/2111896554 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f881406af00 msgr2=0x7f881406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:34.289 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.264+0000 7f882d5a5700 1 --2- 172.21.15.149:0/2111896554 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f881406af00 0x7f881406d3c0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f88280d1470 tx=0x7f881c010000 comp rx=0 tx=0).stop 2023-11-08T19:28:34.290 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.264+0000 7f882d5a5700 1 -- 172.21.15.149:0/2111896554 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8828161a50 msgr2=0x7f88281585d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:34.290 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.264+0000 7f882d5a5700 1 --2- 172.21.15.149:0/2111896554 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8828161a50 0x7f88281585d0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f882000cd20 tx=0x7f882000a570 comp rx=0 tx=0).stop 2023-11-08T19:28:34.290 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.264+0000 7f882d5a5700 1 -- 172.21.15.149:0/2111896554 shutdown_connections 2023-11-08T19:28:34.290 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.264+0000 7f882d5a5700 1 --2- 172.21.15.149:0/2111896554 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f881406af00 0x7f881406d3c0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.290 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.264+0000 7f882d5a5700 1 --2- 172.21.15.149:0/2111896554 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8828161a50 0x7f88281585d0 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.291 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.264+0000 7f882d5a5700 1 --2- 172.21.15.149:0/2111896554 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f882815dd90 0x7f88281e7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.291 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.264+0000 7f882d5a5700 1 --2- 172.21.15.149:0/2111896554 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8828161670 0x7f8828158db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.291 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.264+0000 7f882d5a5700 1 -- 172.21.15.149:0/2111896554 >> 172.21.15.149:0/2111896554 conn(0x7f88280d3980 msgr2=0x7f882815f670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:34.291 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.265+0000 7f882d5a5700 1 -- 172.21.15.149:0/2111896554 shutdown_connections 2023-11-08T19:28:34.291 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.265+0000 7f882d5a5700 1 -- 172.21.15.149:0/2111896554 wait complete. 2023-11-08T19:28:34.292 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:28:34.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.412+0000 7fcb97493700 1 Processor -- start 2023-11-08T19:28:34.414 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.413+0000 7fcb97493700 1 -- start start 2023-11-08T19:28:34.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.413+0000 7fcb97493700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcb900cd5e0 0x7fcb900cfd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:34.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.413+0000 7fcb97493700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb900cc2e0 con 0x7fcb900ce840 2023-11-08T19:28:34.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.413+0000 7fcb97493700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb900cc580 con 0x7fcb9015b950 2023-11-08T19:28:34.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.413+0000 7fcb97493700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb900cc820 con 0x7fcb900cd5e0 2023-11-08T19:28:34.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.414+0000 7fcb95a30700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fcb900ce840 0x7fcb900d0260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:46680/0 (socket says 172.21.15.149:46680) 2023-11-08T19:28:34.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.414+0000 7fcb95a30700 1 -- 172.21.15.149:0/517109435 learned_addr learned my addr 172.21.15.149:0/517109435 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:28:34.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.414+0000 7fcb94a2e700 1 --2- 172.21.15.149:0/517109435 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcb900cd5e0 0x7fcb900cfd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:34.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.414+0000 7fcb87fff700 1 -- 172.21.15.149:0/517109435 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2112497214 0 0) 0x7fcb900cc2e0 con 0x7fcb900ce840 2023-11-08T19:28:34.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.414+0000 7fcb87fff700 1 -- 172.21.15.149:0/517109435 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb7c0035b0 con 0x7fcb900ce840 2023-11-08T19:28:34.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.414+0000 7fcb87fff700 1 -- 172.21.15.149:0/517109435 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2433527125 0 0) 0x7fcb7c0035b0 con 0x7fcb900ce840 2023-11-08T19:28:34.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.414+0000 7fcb87fff700 1 -- 172.21.15.149:0/517109435 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcb900cd5e0 msgr2=0x7fcb900cfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:34.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.414+0000 7fcb87fff700 1 --2- 172.21.15.149:0/517109435 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcb900cd5e0 0x7fcb900cfd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.414+0000 7fcb87fff700 1 -- 172.21.15.149:0/517109435 >> v1:172.21.15.160:6789/0 conn(0x7fcb9015b950 legacy=0x7fcb900ce130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:34.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.414+0000 7fcb87fff700 1 -- 172.21.15.149:0/517109435 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb900ccb00 con 0x7fcb900ce840 2023-11-08T19:28:34.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.414+0000 7fcb87fff700 1 -- 172.21.15.149:0/517109435 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7fcb880019f0 con 0x7fcb900ce840 2023-11-08T19:28:34.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.414+0000 7fcb87fff700 1 -- 172.21.15.149:0/517109435 >> v1:172.21.15.149:6789/0 conn(0x7fcb900ce840 legacy=0x7fcb900d0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:34.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.414+0000 7fcb87fff700 1 --2- 172.21.15.149:0/517109435 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb7c003a30 0x7fcb7c003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:34.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.414+0000 7fcb87fff700 1 --2- 172.21.15.149:0/517109435 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcb7c004850 0x7fcb7c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:34.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.414+0000 7fcb87fff700 1 --2- 172.21.15.149:0/517109435 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcb7c0051d0 0x7fcb7c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:34.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.414+0000 7fcb87fff700 1 -- 172.21.15.149:0/517109435 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb900cc820 con 0x7fcb7c003a30 2023-11-08T19:28:34.422 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.414+0000 7fcb87fff700 1 -- 172.21.15.149:0/517109435 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7c00bf50 con 0x7fcb7c0051d0 2023-11-08T19:28:34.422 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.414+0000 7fcb87fff700 1 -- 172.21.15.149:0/517109435 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7c00c0c0 con 0x7fcb7c004850 2023-11-08T19:28:34.422 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.414+0000 7fcb9522f700 1 --2- 172.21.15.149:0/517109435 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb7c003a30 0x7fcb7c003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:34.422 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.414+0000 7fcb94a2e700 1 --2- 172.21.15.149:0/517109435 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcb7c004850 0x7fcb7c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:34.422 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.414+0000 7fcb95a30700 1 --2- 172.21.15.149:0/517109435 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcb7c0051d0 0x7fcb7c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:34.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.415+0000 7fcb9522f700 1 -- 172.21.15.149:0/517109435 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcb7c004850 msgr2=0x7fcb7c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:34.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.415+0000 7fcb9522f700 1 --2- 172.21.15.149:0/517109435 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcb7c004850 0x7fcb7c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.415+0000 7fcb9522f700 1 -- 172.21.15.149:0/517109435 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcb7c0051d0 msgr2=0x7fcb7c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:34.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.415+0000 7fcb9522f700 1 --2- 172.21.15.149:0/517109435 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcb7c0051d0 0x7fcb7c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.415+0000 7fcb9522f700 1 -- 172.21.15.149:0/517109435 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb7c0035b0 con 0x7fcb7c003a30 2023-11-08T19:28:34.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.415+0000 7fcb95a30700 1 --2- 172.21.15.149:0/517109435 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcb7c0051d0 0x7fcb7c00ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:28:34.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.415+0000 7fcb9522f700 1 --2- 172.21.15.149:0/517109435 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb7c003a30 0x7fcb7c003e50 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7fcb80001820 tx=0x7fcb7c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a5c1434dcf5a512 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:34.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.415+0000 7fcb87fff700 1 -- 172.21.15.149:0/517109435 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb800012e0 con 0x7fcb7c003a30 2023-11-08T19:28:34.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.415+0000 7fcb87fff700 1 -- 172.21.15.149:0/517109435 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb800052d0 con 0x7fcb7c003a30 2023-11-08T19:28:34.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.415+0000 7fcb87fff700 1 -- 172.21.15.149:0/517109435 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb800036d0 con 0x7fcb7c003a30 2023-11-08T19:28:34.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.415+0000 7fcb97493700 1 -- 172.21.15.149:0/517109435 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb7c003a30 msgr2=0x7fcb7c003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:34.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.415+0000 7fcb97493700 1 --2- 172.21.15.149:0/517109435 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb7c003a30 0x7fcb7c003e50 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7fcb80001820 tx=0x7fcb7c005880 comp rx=0 tx=0).stop 2023-11-08T19:28:34.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.415+0000 7fcb95a30700 1 -- 172.21.15.149:0/517109435 reap_dead start 2023-11-08T19:28:34.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.415+0000 7fcb97493700 1 -- 172.21.15.149:0/517109435 shutdown_connections 2023-11-08T19:28:34.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.415+0000 7fcb97493700 1 -- 172.21.15.149:0/517109435 >> 172.21.15.149:0/517109435 conn(0x7fcb9008afd0 msgr2=0x7fcb900d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:34.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.415+0000 7fcb97493700 1 -- 172.21.15.149:0/517109435 shutdown_connections 2023-11-08T19:28:34.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.415+0000 7fcb97493700 1 -- 172.21.15.149:0/517109435 wait complete. 2023-11-08T19:28:34.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.417+0000 7fcb97493700 1 Processor -- start 2023-11-08T19:28:34.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.417+0000 7fcb97493700 1 -- start start 2023-11-08T19:28:34.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.417+0000 7fcb97493700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcb7c003a30 0x7fcb900cad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:34.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.417+0000 7fcb97493700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb900c9860 0x7fcb900c7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:34.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.417+0000 7fcb97493700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcb9015e8b0 0x7fcb900b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:34.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.417+0000 7fcb97493700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb900c9cf0 con 0x7fcb900c9860 2023-11-08T19:28:34.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.417+0000 7fcb97493700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb900c9fd0 con 0x7fcb9015e8b0 2023-11-08T19:28:34.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.417+0000 7fcb97493700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb900ca2b0 con 0x7fcb7c003a30 2023-11-08T19:28:34.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.418+0000 7fcb94a2e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb900c9860 0x7fcb900c7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:34.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.418+0000 7fcb94a2e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb900c9860 0x7fcb900c7ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44688/0 (socket says 172.21.15.149:44688) 2023-11-08T19:28:34.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.418+0000 7fcb94a2e700 1 -- 172.21.15.149:0/1427630125 learned_addr learned my addr 172.21.15.149:0/1427630125 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:28:34.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.418+0000 7fcb9522f700 1 --2- 172.21.15.149:0/1427630125 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcb7c003a30 0x7fcb900cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:34.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.418+0000 7fcb95a30700 1 --2- 172.21.15.149:0/1427630125 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcb9015e8b0 0x7fcb900b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:34.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.418+0000 7fcb94a2e700 1 -- 172.21.15.149:0/1427630125 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcb7c003a30 msgr2=0x7fcb900cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:34.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.418+0000 7fcb94a2e700 1 --2- 172.21.15.149:0/1427630125 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcb7c003a30 0x7fcb900cad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.418+0000 7fcb94a2e700 1 -- 172.21.15.149:0/1427630125 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcb9015e8b0 msgr2=0x7fcb900b32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:34.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.418+0000 7fcb94a2e700 1 --2- 172.21.15.149:0/1427630125 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcb9015e8b0 0x7fcb900b32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.418+0000 7fcb94a2e700 1 -- 172.21.15.149:0/1427630125 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb900ca590 con 0x7fcb900c9860 2023-11-08T19:28:34.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.418+0000 7fcb94a2e700 1 --2- 172.21.15.149:0/1427630125 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb900c9860 0x7fcb900c7ca0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c0119c0 tx=0x7fcb8c011cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:34.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.418+0000 7fcb85ffb700 1 -- 172.21.15.149:0/1427630125 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8c011e50 con 0x7fcb900c9860 2023-11-08T19:28:34.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.418+0000 7fcb85ffb700 1 -- 172.21.15.149:0/1427630125 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb8c004240 con 0x7fcb900c9860 2023-11-08T19:28:34.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.418+0000 7fcb97493700 1 -- 172.21.15.149:0/1427630125 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb900ca870 con 0x7fcb900c9860 2023-11-08T19:28:34.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.418+0000 7fcb85ffb700 1 -- 172.21.15.149:0/1427630125 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8c00f730 con 0x7fcb900c9860 2023-11-08T19:28:34.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.418+0000 7fcb97493700 1 -- 172.21.15.149:0/1427630125 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb9015ed30 con 0x7fcb900c9860 2023-11-08T19:28:34.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.419+0000 7fcb97493700 1 -- 172.21.15.149:0/1427630125 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb900caab0 con 0x7fcb900c9860 2023-11-08T19:28:34.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.420+0000 7fcb85ffb700 1 -- 172.21.15.149:0/1427630125 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcb8c00f890 con 0x7fcb900c9860 2023-11-08T19:28:34.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.420+0000 7fcb85ffb700 1 --2- 172.21.15.149:0/1427630125 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fcb7406af00 0x7fcb7406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:34.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.421+0000 7fcb9522f700 1 --2- 172.21.15.149:0/1427630125 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fcb7406af00 0x7fcb7406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:34.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.421+0000 7fcb85ffb700 1 -- 172.21.15.149:0/1427630125 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7436+0+0 (secure 0 0 0) 0x7fcb8c08a0f0 con 0x7fcb900c9860 2023-11-08T19:28:34.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.421+0000 7fcb9522f700 1 --2- 172.21.15.149:0/1427630125 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fcb7406af00 0x7fcb7406d3c0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fcb80008fd0 tx=0x7fcb80009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:34.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.425+0000 7fcb85ffb700 1 -- 172.21.15.149:0/1427630125 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcb900caab0 con 0x7fcb900c9860 2023-11-08T19:28:34.658 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.657+0000 7fcb97493700 1 -- 172.21.15.149:0/1427630125 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcb900caab0 con 0x7fcb900c9860 2023-11-08T19:28:34.658 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.657+0000 7fcb85ffb700 1 -- 172.21.15.149:0/1427630125 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+4938 (secure 0 0 0) 0x7fcb900caab0 con 0x7fcb900c9860 2023-11-08T19:28:34.659 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:28:34.659 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":83,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6095,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/852710262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":852710262},{"type":"v1","addr":"172.21.15.160:6835","nonce":852710262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64},{"gid":6236,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/1313631099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":1313631099},{"type":"v1","addr":"172.21.15.160:6834","nonce":1313631099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:28:30.352933+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7578,"mds_1":7125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7125":{"gid":7125,"name":"c","rank":1,"incarnation":57,"state":"up:active","state_seq":6,"addr":"172.21.15.149:6837/3917392643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3917392643},{"type":"v1","addr":"172.21.15.149:6837","nonce":3917392643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7578":{"gid":7578,"name":"a","rank":0,"incarnation":79,"state":"up:active","state_seq":11,"addr":"172.21.15.149:6836/295381437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":295381437},{"type":"v1","addr":"172.21.15.149:6836","nonce":295381437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:28:34.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.660+0000 7fcb97493700 1 -- 172.21.15.149:0/1427630125 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fcb7406af00 msgr2=0x7fcb7406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:34.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.660+0000 7fcb97493700 1 --2- 172.21.15.149:0/1427630125 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fcb7406af00 0x7fcb7406d3c0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fcb80008fd0 tx=0x7fcb80009030 comp rx=0 tx=0).stop 2023-11-08T19:28:34.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.660+0000 7fcb97493700 1 -- 172.21.15.149:0/1427630125 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb900c9860 msgr2=0x7fcb900c7ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:34.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.660+0000 7fcb97493700 1 --2- 172.21.15.149:0/1427630125 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb900c9860 0x7fcb900c7ca0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c0119c0 tx=0x7fcb8c011cd0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.660+0000 7fcb97493700 1 -- 172.21.15.149:0/1427630125 shutdown_connections 2023-11-08T19:28:34.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.660+0000 7fcb97493700 1 --2- 172.21.15.149:0/1427630125 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fcb7406af00 0x7fcb7406d3c0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.660+0000 7fcb97493700 1 --2- 172.21.15.149:0/1427630125 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcb9015e8b0 0x7fcb900b32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.660+0000 7fcb97493700 1 --2- 172.21.15.149:0/1427630125 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcb7c003a30 0x7fcb900cad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.660+0000 7fcb97493700 1 --2- 172.21.15.149:0/1427630125 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb900c9860 0x7fcb900c7ca0 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.660+0000 7fcb97493700 1 -- 172.21.15.149:0/1427630125 >> 172.21.15.149:0/1427630125 conn(0x7fcb9008afd0 msgr2=0x7fcb900cf960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:34.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.660+0000 7fcb97493700 1 -- 172.21.15.149:0/1427630125 shutdown_connections 2023-11-08T19:28:34.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.660+0000 7fcb97493700 1 -- 172.21.15.149:0/1427630125 wait complete. 2023-11-08T19:28:34.664 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 83 2023-11-08T19:28:34.673 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump snaps --server 2023-11-08T19:28:34.810 INFO:teuthology.orchestra.run.smithi149.stdout:{"last_snap":4,"last_created":4,"last_destroyed":1,"pending_noop":[],"snaps":[{"snapid":2,"ino":1099511627777,"stamp":"2023-11-08T19:27:11.331978+0000","name":"s11","metadata":{}},{"snapid":3,"ino":1099511627777,"stamp":"2023-11-08T19:27:43.330783+0000","name":"s12","metadata":{}},{"snapid":4,"ino":1099511627777,"stamp":"2023-11-08T19:28:09.994390+0000","name":"s15","metadata":{}}],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-08T19:28:34.811 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 4, "last_destroyed": 1, "last_snap": 4, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s11", "snapid": 2, "stamp": "2023-11-08T19:27:11.331978+0000" }, { "ino": 1099511627777, "metadata": {}, "name": "s12", "snapid": 3, "stamp": "2023-11-08T19:27:43.330783+0000" }, { "ino": 1099511627777, "metadata": {}, "name": "s15", "snapid": 4, "stamp": "2023-11-08T19:28:09.994390+0000" } ] } 2023-11-08T19:28:34.811 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-11-08T19:28:34.812 INFO:tasks.cephfs.test_snapshots:testing snapserver mds_kill_mdstable_at=6 2023-11-08T19:28:34.812 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:28:34.934 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.933+0000 7f7371c09700 1 Processor -- start 2023-11-08T19:28:34.934 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.933+0000 7f7371c09700 1 -- start start 2023-11-08T19:28:34.937 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.934+0000 7f7371c09700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f736c0cc140 0x7f736c0cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:34.937 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.934+0000 7f7371c09700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f736c0b2cd0 0x7f736c15d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:34.938 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.934+0000 7f7371c09700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f736c0cce50 con 0x7f736c0b2850 2023-11-08T19:28:34.938 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.934+0000 7f7371c09700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f736c0b2430 con 0x7f736c0cc140 2023-11-08T19:28:34.938 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.934+0000 7f7371c09700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f736c0cc520 con 0x7f736c0b2cd0 2023-11-08T19:28:34.938 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.934+0000 7f736b7fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f736c0cc140 0x7f736c0cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:34.939 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.934+0000 7f736affd700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f736c0b2850 0x7f736c0cabf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:46698/0 (socket says 172.21.15.149:46698) 2023-11-08T19:28:34.939 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.934+0000 7f736affd700 1 -- 172.21.15.149:0/1419887522 learned_addr learned my addr 172.21.15.149:0/1419887522 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:28:34.939 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.934+0000 7f736bfff700 1 --2- 172.21.15.149:0/1419887522 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f736c0b2cd0 0x7f736c15d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:34.942 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.934+0000 7f736b7fe700 1 -- 172.21.15.149:0/1419887522 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f736c0b2cd0 msgr2=0x7f736c15d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:34.942 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.934+0000 7f736b7fe700 1 --2- 172.21.15.149:0/1419887522 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f736c0b2cd0 0x7f736c15d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.942 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.934+0000 7f736b7fe700 1 -- 172.21.15.149:0/1419887522 >> v1:172.21.15.149:6789/0 conn(0x7f736c0b2850 legacy=0x7f736c0cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:34.942 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.934+0000 7f736b7fe700 1 -- 172.21.15.149:0/1419887522 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f736c0b17b0 con 0x7f736c0cc140 2023-11-08T19:28:34.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.934+0000 7f736a7fc700 1 -- 172.21.15.149:0/1419887522 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2226939409 0 0) 0x7f736c0cce50 con 0x7f736c0b2850 2023-11-08T19:28:34.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.934+0000 7f736bfff700 1 --2- 172.21.15.149:0/1419887522 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f736c0b2cd0 0x7f736c15d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:28:34.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.934+0000 7f736b7fe700 1 --2- 172.21.15.149:0/1419887522 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f736c0cc140 0x7f736c0cc910 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f7360009820 tx=0x7f7360009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf9be69b2a150d2f server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:34.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.935+0000 7f736a7fc700 1 -- 172.21.15.149:0/1419887522 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7360005e30 con 0x7f736c0cc140 2023-11-08T19:28:34.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.935+0000 7f736a7fc700 1 -- 172.21.15.149:0/1419887522 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7360006030 con 0x7f736c0cc140 2023-11-08T19:28:34.944 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.935+0000 7f736a7fc700 1 -- 172.21.15.149:0/1419887522 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73600063e0 con 0x7f736c0cc140 2023-11-08T19:28:34.944 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.935+0000 7f7371c09700 1 -- 172.21.15.149:0/1419887522 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f736c0cc140 msgr2=0x7f736c0cc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:34.944 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.935+0000 7f7371c09700 1 --2- 172.21.15.149:0/1419887522 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f736c0cc140 0x7f736c0cc910 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f7360009820 tx=0x7f7360009b30 comp rx=0 tx=0).stop 2023-11-08T19:28:34.944 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.935+0000 7f7371c09700 1 -- 172.21.15.149:0/1419887522 shutdown_connections 2023-11-08T19:28:34.944 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.935+0000 7f7371c09700 1 --2- 172.21.15.149:0/1419887522 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f736c0b2cd0 0x7f736c15d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.935+0000 7f7371c09700 1 --2- 172.21.15.149:0/1419887522 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f736c0cc140 0x7f736c0cc910 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.935+0000 7f7371c09700 1 -- 172.21.15.149:0/1419887522 >> 172.21.15.149:0/1419887522 conn(0x7f736c099a40 msgr2=0x7f736c0d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:34.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.935+0000 7f7371c09700 1 -- 172.21.15.149:0/1419887522 shutdown_connections 2023-11-08T19:28:34.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.935+0000 7f7371c09700 1 -- 172.21.15.149:0/1419887522 wait complete. 2023-11-08T19:28:34.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.936+0000 7f7371c09700 1 Processor -- start 2023-11-08T19:28:34.946 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.936+0000 7f7371c09700 1 -- start start 2023-11-08T19:28:34.948 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.937+0000 7f7371c09700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f736c0b2850 0x7f736c0aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:34.948 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.937+0000 7f7371c09700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f736c0b2cd0 0x7f736c0ad1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:34.949 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.937+0000 7f7371c09700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f736c0cc140 0x7f736c0b54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:34.949 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.937+0000 7f7371c09700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f736c0af030 con 0x7f736c0b2850 2023-11-08T19:28:34.949 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.937+0000 7f7371c09700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f736c0ada50 con 0x7f736c0b2cd0 2023-11-08T19:28:34.949 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.937+0000 7f7371c09700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f736c0add30 con 0x7f736c0cc140 2023-11-08T19:28:34.949 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.937+0000 7f736b7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f736c0b2850 0x7f736c0aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:34.950 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.937+0000 7f736b7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f736c0b2850 0x7f736c0aeaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44700/0 (socket says 172.21.15.149:44700) 2023-11-08T19:28:34.950 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.937+0000 7f736b7fe700 1 -- 172.21.15.149:0/4215602360 learned_addr learned my addr 172.21.15.149:0/4215602360 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:28:34.950 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.937+0000 7f736affd700 1 --2- 172.21.15.149:0/4215602360 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f736c0b2cd0 0x7f736c0ad1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:34.950 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.937+0000 7f736bfff700 1 --2- 172.21.15.149:0/4215602360 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f736c0cc140 0x7f736c0b54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:34.950 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.938+0000 7f736b7fe700 1 -- 172.21.15.149:0/4215602360 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f736c0cc140 msgr2=0x7f736c0b54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:34.951 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.938+0000 7f736b7fe700 1 --2- 172.21.15.149:0/4215602360 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f736c0cc140 0x7f736c0b54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.951 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.938+0000 7f736b7fe700 1 -- 172.21.15.149:0/4215602360 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f736c0b2cd0 msgr2=0x7f736c0ad1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:34.951 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.938+0000 7f736b7fe700 1 --2- 172.21.15.149:0/4215602360 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f736c0b2cd0 0x7f736c0ad1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:34.951 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.938+0000 7f736b7fe700 1 -- 172.21.15.149:0/4215602360 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7360009430 con 0x7f736c0b2850 2023-11-08T19:28:34.951 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.938+0000 7f736b7fe700 1 --2- 172.21.15.149:0/4215602360 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f736c0b2850 0x7f736c0aeaf0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f7360013040 tx=0x7f7360004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:34.952 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.938+0000 7f7353fff700 1 -- 172.21.15.149:0/4215602360 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7360025430 con 0x7f736c0b2850 2023-11-08T19:28:34.952 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.938+0000 7f7353fff700 1 -- 172.21.15.149:0/4215602360 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7360020070 con 0x7f736c0b2850 2023-11-08T19:28:34.952 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.938+0000 7f7371c09700 1 -- 172.21.15.149:0/4215602360 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f736c0ae010 con 0x7f736c0b2850 2023-11-08T19:28:34.952 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.938+0000 7f7353fff700 1 -- 172.21.15.149:0/4215602360 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7360025810 con 0x7f736c0b2850 2023-11-08T19:28:34.953 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.938+0000 7f7371c09700 1 -- 172.21.15.149:0/4215602360 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f736c0ae5d0 con 0x7f736c0b2850 2023-11-08T19:28:34.953 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.939+0000 7f7371c09700 1 -- 172.21.15.149:0/4215602360 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f736c0745f0 con 0x7f736c0b2850 2023-11-08T19:28:34.953 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.939+0000 7f7353fff700 1 -- 172.21.15.149:0/4215602360 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7360022030 con 0x7f736c0b2850 2023-11-08T19:28:34.953 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.940+0000 7f7353fff700 1 --2- 172.21.15.149:0/4215602360 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f735806af00 0x7f735806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:34.953 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.940+0000 7f7353fff700 1 -- 172.21.15.149:0/4215602360 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7436+0+0 (secure 0 0 0) 0x7f736008b290 con 0x7f736c0b2850 2023-11-08T19:28:34.954 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.940+0000 7f736affd700 1 --2- 172.21.15.149:0/4215602360 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f735806af00 0x7f735806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:34.954 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.940+0000 7f736affd700 1 --2- 172.21.15.149:0/4215602360 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f735806af00 0x7f735806d3c0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f736c0ccec0 tx=0x7f735c007be0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:34.954 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:34.945+0000 7f7353fff700 1 -- 172.21.15.149:0/4215602360 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7360055d10 con 0x7f736c0b2850 2023-11-08T19:28:35.177 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.176+0000 7f7371c09700 1 -- 172.21.15.149:0/4215602360 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f736c0d1050 con 0x7f736c0b2850 2023-11-08T19:28:35.178 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.177+0000 7f7353fff700 1 -- 172.21.15.149:0/4215602360 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+4938 (secure 0 0 0) 0x7f7360059330 con 0x7f736c0b2850 2023-11-08T19:28:35.179 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:28:35.179 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":83,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6095,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/852710262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":852710262},{"type":"v1","addr":"172.21.15.160:6835","nonce":852710262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64},{"gid":6236,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/1313631099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":1313631099},{"type":"v1","addr":"172.21.15.160:6834","nonce":1313631099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:28:30.352933+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7578,"mds_1":7125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7125":{"gid":7125,"name":"c","rank":1,"incarnation":57,"state":"up:active","state_seq":6,"addr":"172.21.15.149:6837/3917392643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3917392643},{"type":"v1","addr":"172.21.15.149:6837","nonce":3917392643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7578":{"gid":7578,"name":"a","rank":0,"incarnation":79,"state":"up:active","state_seq":11,"addr":"172.21.15.149:6836/295381437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":295381437},{"type":"v1","addr":"172.21.15.149:6836","nonce":295381437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:28:35.181 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.179+0000 7f7371c09700 1 -- 172.21.15.149:0/4215602360 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f735806af00 msgr2=0x7f735806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:35.181 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.179+0000 7f7371c09700 1 --2- 172.21.15.149:0/4215602360 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f735806af00 0x7f735806d3c0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f736c0ccec0 tx=0x7f735c007be0 comp rx=0 tx=0).stop 2023-11-08T19:28:35.181 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.179+0000 7f7371c09700 1 -- 172.21.15.149:0/4215602360 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f736c0b2850 msgr2=0x7f736c0aeaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:35.181 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.179+0000 7f7371c09700 1 --2- 172.21.15.149:0/4215602360 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f736c0b2850 0x7f736c0aeaf0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f7360013040 tx=0x7f7360004750 comp rx=0 tx=0).stop 2023-11-08T19:28:35.182 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.179+0000 7f7371c09700 1 -- 172.21.15.149:0/4215602360 shutdown_connections 2023-11-08T19:28:35.182 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.179+0000 7f7371c09700 1 --2- 172.21.15.149:0/4215602360 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f735806af00 0x7f735806d3c0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:35.182 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.179+0000 7f7371c09700 1 --2- 172.21.15.149:0/4215602360 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f736c0cc140 0x7f736c0b54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:35.182 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.179+0000 7f7371c09700 1 --2- 172.21.15.149:0/4215602360 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f736c0b2850 0x7f736c0aeaf0 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:35.182 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.179+0000 7f7371c09700 1 --2- 172.21.15.149:0/4215602360 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f736c0b2cd0 0x7f736c0ad1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:35.183 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.179+0000 7f7371c09700 1 -- 172.21.15.149:0/4215602360 >> 172.21.15.149:0/4215602360 conn(0x7f736c099a40 msgr2=0x7f736c0cb420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:35.183 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.180+0000 7f7371c09700 1 -- 172.21.15.149:0/4215602360 shutdown_connections 2023-11-08T19:28:35.183 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.180+0000 7f7371c09700 1 -- 172.21.15.149:0/4215602360 wait complete. 2023-11-08T19:28:35.183 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 83 2023-11-08T19:28:35.193 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:0 true 2023-11-08T19:28:35.317 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.316+0000 7f20f80d4700 1 Processor -- start 2023-11-08T19:28:35.317 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.316+0000 7f20f80d4700 1 -- start start 2023-11-08T19:28:35.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.317+0000 7f20f80d4700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f20f00b3210 0x7f20f00cbe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:35.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.317+0000 7f20f80d4700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f20f00cff40 0x7f20f0161720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:35.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.317+0000 7f20f80d4700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20f006cea0 con 0x7f20f00b35f0 2023-11-08T19:28:35.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.317+0000 7f20f80d4700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20f0161390 con 0x7f20f00b3210 2023-11-08T19:28:35.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.317+0000 7f20f80d4700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20f006c290 con 0x7f20f00cff40 2023-11-08T19:28:35.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.317+0000 7f20f566f700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f20f00b35f0 0x7f20f00cf830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:46710/0 (socket says 172.21.15.149:46710) 2023-11-08T19:28:35.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.317+0000 7f20f566f700 1 -- 172.21.15.149:0/2276569855 learned_addr learned my addr 172.21.15.149:0/2276569855 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:28:35.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.317+0000 7f20f4e6e700 1 -- 172.21.15.149:0/2276569855 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 201050392 0 0) 0x7f20f006cea0 con 0x7f20f00b35f0 2023-11-08T19:28:35.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.317+0000 7f20f4e6e700 1 -- 172.21.15.149:0/2276569855 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20dc0035b0 con 0x7f20f00b35f0 2023-11-08T19:28:35.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.317+0000 7f20f5e70700 1 --2- 172.21.15.149:0/2276569855 >> v2:172.21.15.160:3300/0 conn(0x7f20f00b3210 0x7f20f00cbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:35.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.317+0000 7f20f6671700 1 --2- 172.21.15.149:0/2276569855 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f20f00cff40 0x7f20f0161720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:35.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.317+0000 7f20f4e6e700 1 -- 172.21.15.149:0/2276569855 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3616071155 0 0) 0x7f20dc0035b0 con 0x7f20f00b35f0 2023-11-08T19:28:35.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.317+0000 7f20f4e6e700 1 -- 172.21.15.149:0/2276569855 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f20f00cff40 msgr2=0x7f20f0161720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:35.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.317+0000 7f20f4e6e700 1 --2- 172.21.15.149:0/2276569855 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f20f00cff40 0x7f20f0161720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:35.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.317+0000 7f20f4e6e700 1 -- 172.21.15.149:0/2276569855 >> v2:172.21.15.160:3300/0 conn(0x7f20f00b3210 msgr2=0x7f20f00cbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:35.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.317+0000 7f20f4e6e700 1 --2- 172.21.15.149:0/2276569855 >> v2:172.21.15.160:3300/0 conn(0x7f20f00b3210 0x7f20f00cbe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:35.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.317+0000 7f20f4e6e700 1 -- 172.21.15.149:0/2276569855 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f006c570 con 0x7f20f00b35f0 2023-11-08T19:28:35.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.317+0000 7f20f4e6e700 1 -- 172.21.15.149:0/2276569855 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f20e0001670 con 0x7f20f00b35f0 2023-11-08T19:28:35.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.317+0000 7f20f4e6e700 1 -- 172.21.15.149:0/2276569855 >> v1:172.21.15.149:6789/0 conn(0x7f20f00b35f0 legacy=0x7f20f00cf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:35.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.317+0000 7f20f4e6e700 1 --2- 172.21.15.149:0/2276569855 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f20f00cff40 0x7f20dc003a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:35.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.317+0000 7f20f4e6e700 1 --2- 172.21.15.149:0/2276569855 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20dc003ff0 0x7f20dc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:35.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.317+0000 7f20f4e6e700 1 --2- 172.21.15.149:0/2276569855 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f20dc004d90 0x7f20dc005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:35.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.317+0000 7f20f4e6e700 1 -- 172.21.15.149:0/2276569855 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f0161390 con 0x7f20dc003ff0 2023-11-08T19:28:35.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.317+0000 7f20f4e6e700 1 -- 172.21.15.149:0/2276569855 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f006c290 con 0x7f20dc004d90 2023-11-08T19:28:35.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.317+0000 7f20f4e6e700 1 -- 172.21.15.149:0/2276569855 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20dc00ba40 con 0x7f20f00cff40 2023-11-08T19:28:35.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.318+0000 7f20f566f700 1 --2- 172.21.15.149:0/2276569855 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20dc003ff0 0x7f20dc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:35.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.318+0000 7f20f5e70700 1 --2- 172.21.15.149:0/2276569855 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f20f00cff40 0x7f20dc003a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:35.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.318+0000 7f20f6671700 1 --2- 172.21.15.149:0/2276569855 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f20dc004d90 0x7f20dc005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:35.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.318+0000 7f20f566f700 1 -- 172.21.15.149:0/2276569855 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f20f00cff40 msgr2=0x7f20dc003a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:35.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.318+0000 7f20f566f700 1 --2- 172.21.15.149:0/2276569855 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f20f00cff40 0x7f20dc003a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:35.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.318+0000 7f20f566f700 1 -- 172.21.15.149:0/2276569855 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f20dc004d90 msgr2=0x7f20dc005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:35.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.318+0000 7f20f566f700 1 --2- 172.21.15.149:0/2276569855 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f20dc004d90 0x7f20dc005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:35.328 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.318+0000 7f20f566f700 1 -- 172.21.15.149:0/2276569855 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20dc0035b0 con 0x7f20dc003ff0 2023-11-08T19:28:35.328 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.318+0000 7f20f566f700 1 --2- 172.21.15.149:0/2276569855 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20dc003ff0 0x7f20dc004850 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f20e000c320 tx=0x7f20dc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c5d2ef621f877f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:35.328 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.318+0000 7f20f4e6e700 1 -- 172.21.15.149:0/2276569855 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e000ce60 con 0x7f20dc003ff0 2023-11-08T19:28:35.328 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.318+0000 7f20f4e6e700 1 -- 172.21.15.149:0/2276569855 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20e0005960 con 0x7f20dc003ff0 2023-11-08T19:28:35.328 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.318+0000 7f20f4e6e700 1 -- 172.21.15.149:0/2276569855 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e0005cf0 con 0x7f20dc003ff0 2023-11-08T19:28:35.329 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.319+0000 7f20f80d4700 1 -- 172.21.15.149:0/2276569855 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20dc003ff0 msgr2=0x7f20dc004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:35.329 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.319+0000 7f20f80d4700 1 --2- 172.21.15.149:0/2276569855 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20dc003ff0 0x7f20dc004850 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f20e000c320 tx=0x7f20dc005880 comp rx=0 tx=0).stop 2023-11-08T19:28:35.329 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.319+0000 7f20f6671700 1 -- 172.21.15.149:0/2276569855 reap_dead start 2023-11-08T19:28:35.329 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.319+0000 7f20f80d4700 1 -- 172.21.15.149:0/2276569855 shutdown_connections 2023-11-08T19:28:35.329 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.319+0000 7f20f80d4700 1 -- 172.21.15.149:0/2276569855 >> 172.21.15.149:0/2276569855 conn(0x7f20f00ce210 msgr2=0x7f20f00ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:35.330 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.319+0000 7f20f80d4700 1 -- 172.21.15.149:0/2276569855 shutdown_connections 2023-11-08T19:28:35.330 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.319+0000 7f20f80d4700 1 -- 172.21.15.149:0/2276569855 wait complete. 2023-11-08T19:28:35.330 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.320+0000 7f20f80d4700 1 Processor -- start 2023-11-08T19:28:35.330 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.320+0000 7f20f80d4700 1 -- start start 2023-11-08T19:28:35.333 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.321+0000 7f20f80d4700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f20dc003ff0 0x7f20f0155f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:35.333 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.321+0000 7f20f80d4700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20f0152860 0x7f20f0152ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:35.334 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.321+0000 7f20f80d4700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f20f00c8860 0x7f20f00c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:35.334 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.321+0000 7f20f80d4700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f0153220 con 0x7f20f0152860 2023-11-08T19:28:35.334 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.321+0000 7f20f80d4700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f00c9b50 con 0x7f20f00c8860 2023-11-08T19:28:35.334 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.321+0000 7f20f80d4700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20f00ca290 con 0x7f20dc003ff0 2023-11-08T19:28:35.334 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.321+0000 7f20f566f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20f0152860 0x7f20f0152ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:35.335 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.321+0000 7f20f566f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20f0152860 0x7f20f0152ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44722/0 (socket says 172.21.15.149:44722) 2023-11-08T19:28:35.335 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.321+0000 7f20f566f700 1 -- 172.21.15.149:0/3264087338 learned_addr learned my addr 172.21.15.149:0/3264087338 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:28:35.335 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.321+0000 7f20f5e70700 1 --2- 172.21.15.149:0/3264087338 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f20dc003ff0 0x7f20f0155f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:35.335 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.321+0000 7f20f6671700 1 --2- 172.21.15.149:0/3264087338 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f20f00c8860 0x7f20f00c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:35.335 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.321+0000 7f20f566f700 1 -- 172.21.15.149:0/3264087338 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f20dc003ff0 msgr2=0x7f20f0155f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:35.336 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.321+0000 7f20f566f700 1 --2- 172.21.15.149:0/3264087338 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f20dc003ff0 0x7f20f0155f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:35.336 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.321+0000 7f20f566f700 1 -- 172.21.15.149:0/3264087338 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f20f00c8860 msgr2=0x7f20f00c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:35.336 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.321+0000 7f20f566f700 1 --2- 172.21.15.149:0/3264087338 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f20f00c8860 0x7f20f00c8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:35.336 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.321+0000 7f20f566f700 1 -- 172.21.15.149:0/3264087338 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f00c9590 con 0x7f20f0152860 2023-11-08T19:28:35.336 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.321+0000 7f20f566f700 1 --2- 172.21.15.149:0/3264087338 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20f0152860 0x7f20f0152ce0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f20e0000c00 tx=0x7f20e0001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:35.337 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.321+0000 7f20e67fc700 1 -- 172.21.15.149:0/3264087338 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e0007c20 con 0x7f20f0152860 2023-11-08T19:28:35.337 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.321+0000 7f20e67fc700 1 -- 172.21.15.149:0/3264087338 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20e0004870 con 0x7f20f0152860 2023-11-08T19:28:35.337 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.321+0000 7f20f80d4700 1 -- 172.21.15.149:0/3264087338 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20f00c9870 con 0x7f20f0152860 2023-11-08T19:28:35.337 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.321+0000 7f20e67fc700 1 -- 172.21.15.149:0/3264087338 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e0004c00 con 0x7f20f0152860 2023-11-08T19:28:35.337 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.322+0000 7f20f80d4700 1 -- 172.21.15.149:0/3264087338 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20f00c9230 con 0x7f20f0152860 2023-11-08T19:28:35.338 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.322+0000 7f20f80d4700 1 -- 172.21.15.149:0/3264087338 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20f00ca0d0 con 0x7f20f0152860 2023-11-08T19:28:35.338 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.323+0000 7f20e67fc700 1 -- 172.21.15.149:0/3264087338 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f20e00070d0 con 0x7f20f0152860 2023-11-08T19:28:35.338 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.323+0000 7f20e67fc700 1 --2- 172.21.15.149:0/3264087338 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f20d406af00 0x7f20d406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:35.338 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.323+0000 7f20e67fc700 1 -- 172.21.15.149:0/3264087338 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7436+0+0 (secure 0 0 0) 0x7f20e008b0e0 con 0x7f20f0152860 2023-11-08T19:28:35.338 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.323+0000 7f20f5e70700 1 --2- 172.21.15.149:0/3264087338 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f20d406af00 0x7f20d406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:35.339 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.324+0000 7f20f5e70700 1 --2- 172.21.15.149:0/3264087338 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f20d406af00 0x7f20d406d3c0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f20f00c9e70 tx=0x7f20ec009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:35.339 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.328+0000 7f20e67fc700 1 -- 172.21.15.149:0/3264087338 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f20e0055ba0 con 0x7f20f0152860 2023-11-08T19:28:35.605 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:35.604+0000 7f20f80d4700 1 -- 172.21.15.149:0/3264087338 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"} v 0) v1 -- 0x7f20f0153220 con 0x7f20f0152860 2023-11-08T19:28:36.372 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.371+0000 7f20e67fc700 1 -- 172.21.15.149:0/3264087338 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"}]=0 freezing mds.7578 v84) v1 ==== 112+0+0 (secure 0 0 0) 0x7f20e00263b0 con 0x7f20f0152860 2023-11-08T19:28:36.375 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.374+0000 7f20f80d4700 1 -- 172.21.15.149:0/3264087338 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f20d406af00 msgr2=0x7f20d406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:36.375 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.374+0000 7f20f80d4700 1 --2- 172.21.15.149:0/3264087338 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f20d406af00 0x7f20d406d3c0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f20f00c9e70 tx=0x7f20ec009210 comp rx=0 tx=0).stop 2023-11-08T19:28:36.376 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.374+0000 7f20f80d4700 1 -- 172.21.15.149:0/3264087338 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20f0152860 msgr2=0x7f20f0152ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:36.376 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.374+0000 7f20f80d4700 1 --2- 172.21.15.149:0/3264087338 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20f0152860 0x7f20f0152ce0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f20e0000c00 tx=0x7f20e0001a00 comp rx=0 tx=0).stop 2023-11-08T19:28:36.376 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.374+0000 7f20f80d4700 1 -- 172.21.15.149:0/3264087338 shutdown_connections 2023-11-08T19:28:36.376 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.374+0000 7f20f80d4700 1 --2- 172.21.15.149:0/3264087338 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f20d406af00 0x7f20d406d3c0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:36.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.374+0000 7f20f80d4700 1 --2- 172.21.15.149:0/3264087338 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f20f00c8860 0x7f20f00c8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:36.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.374+0000 7f20f80d4700 1 --2- 172.21.15.149:0/3264087338 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f20dc003ff0 0x7f20f0155f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:36.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.374+0000 7f20f80d4700 1 --2- 172.21.15.149:0/3264087338 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20f0152860 0x7f20f0152ce0 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:36.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.374+0000 7f20f80d4700 1 -- 172.21.15.149:0/3264087338 >> 172.21.15.149:0/3264087338 conn(0x7f20f00ce210 msgr2=0x7f20f006d220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:36.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.374+0000 7f20f80d4700 1 -- 172.21.15.149:0/3264087338 shutdown_connections 2023-11-08T19:28:36.378 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.374+0000 7f20f80d4700 1 -- 172.21.15.149:0/3264087338 wait complete. 2023-11-08T19:28:36.378 INFO:teuthology.orchestra.run.smithi149.stderr:freezing mds.7578 2023-11-08T19:28:36.388 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_kill_mdstable_at 6 2023-11-08T19:28:36.526 INFO:teuthology.orchestra.run.smithi149.stdout:{"success":"mds_kill_mdstable_at = '6' (not observed, change may require restart) "} 2023-11-08T19:28:36.526 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_kill_mdstable_at = '6' (not observed, change may require restart) " } 2023-11-08T19:28:36.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:28:36.527 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir d1/dir/.snap/s16) 2023-11-08T19:28:36.530 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2023-11-08T19:28:36.700 INFO:teuthology.orchestra.run.smithi149.stdout:{"mds_beacon_grace":"15.000000"} 2023-11-08T19:28:36.701 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2023-11-08T19:28:36.701 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:28:36.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.820+0000 7fe6277f4700 1 Processor -- start 2023-11-08T19:28:36.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.820+0000 7fe6277f4700 1 -- start start 2023-11-08T19:28:36.826 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.821+0000 7fe6277f4700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe6200cc910 0x7fe6200cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:36.826 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.821+0000 7fe6277f4700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6200b2f60 con 0x7fe6200cc140 2023-11-08T19:28:36.826 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.821+0000 7fe6277f4700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6200cc520 con 0x7fe6200cb130 2023-11-08T19:28:36.827 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.821+0000 7fe6277f4700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6200b2430 con 0x7fe6200cc910 2023-11-08T19:28:36.827 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.821+0000 7fe624d8f700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe6200cc910 0x7fe6200cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:36.828 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.821+0000 7fe624d8f700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe6200cc910 0x7fe6200cabf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44732/0 (socket says 172.21.15.149:44732) 2023-11-08T19:28:36.828 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.821+0000 7fe625590700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fe6200cc140 0x7fe6200b2850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:46730/0 (socket says 172.21.15.149:46730) 2023-11-08T19:28:36.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.821+0000 7fe624d8f700 1 -- 172.21.15.149:0/929916082 learned_addr learned my addr 172.21.15.149:0/929916082 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:28:36.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.822+0000 7fe624d8f700 1 -- 172.21.15.149:0/929916082 >> v1:172.21.15.160:6789/0 conn(0x7fe6200cb130 legacy=0x7fe62015d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:36.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.822+0000 7fe624d8f700 1 -- 172.21.15.149:0/929916082 >> v1:172.21.15.149:6789/0 conn(0x7fe6200cc140 legacy=0x7fe6200b2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:36.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.822+0000 7fe617fff700 1 -- 172.21.15.149:0/929916082 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3090288234 0 0) 0x7fe6200b2f60 con 0x7fe6200cc140 2023-11-08T19:28:36.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.822+0000 7fe624d8f700 1 -- 172.21.15.149:0/929916082 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6200cb5e0 con 0x7fe6200cc910 2023-11-08T19:28:36.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.822+0000 7fe624d8f700 1 --2- 172.21.15.149:0/929916082 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6200cc910 0x7fe6200cabf0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fe61c0098f0 tx=0x7fe61c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3d25f12c1794c33 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:36.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.822+0000 7fe617fff700 1 -- 172.21.15.149:0/929916082 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61c004230 con 0x7fe6200cc910 2023-11-08T19:28:36.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.822+0000 7fe617fff700 1 -- 172.21.15.149:0/929916082 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe61c004390 con 0x7fe6200cc910 2023-11-08T19:28:36.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.822+0000 7fe617fff700 1 -- 172.21.15.149:0/929916082 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61c0036a0 con 0x7fe6200cc910 2023-11-08T19:28:36.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.823+0000 7fe6277f4700 1 -- 172.21.15.149:0/929916082 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6200cc910 msgr2=0x7fe6200cabf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:36.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.823+0000 7fe6277f4700 1 --2- 172.21.15.149:0/929916082 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6200cc910 0x7fe6200cabf0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fe61c0098f0 tx=0x7fe61c009c00 comp rx=0 tx=0).stop 2023-11-08T19:28:36.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.823+0000 7fe6277f4700 1 -- 172.21.15.149:0/929916082 shutdown_connections 2023-11-08T19:28:36.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.823+0000 7fe6277f4700 1 --2- 172.21.15.149:0/929916082 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6200cc910 0x7fe6200cabf0 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:36.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.823+0000 7fe6277f4700 1 -- 172.21.15.149:0/929916082 >> 172.21.15.149:0/929916082 conn(0x7fe620099a40 msgr2=0x7fe6200d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:36.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.823+0000 7fe6277f4700 1 -- 172.21.15.149:0/929916082 shutdown_connections 2023-11-08T19:28:36.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.823+0000 7fe6277f4700 1 -- 172.21.15.149:0/929916082 wait complete. 2023-11-08T19:28:36.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.824+0000 7fe6277f4700 1 Processor -- start 2023-11-08T19:28:36.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.824+0000 7fe6277f4700 1 -- start start 2023-11-08T19:28:36.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.825+0000 7fe6277f4700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe6200cb130 0x7fe62009dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:36.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.825+0000 7fe6277f4700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6200cc140 0x7fe62014f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:36.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.825+0000 7fe6277f4700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6200cc910 0x7fe6200b5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:36.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.825+0000 7fe6277f4700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe62009d7c0 con 0x7fe6200cc910 2023-11-08T19:28:36.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.825+0000 7fe6277f4700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe62009cf00 con 0x7fe6200cc140 2023-11-08T19:28:36.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.825+0000 7fe6277f4700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6200ae200 con 0x7fe6200cb130 2023-11-08T19:28:36.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.825+0000 7fe625d91700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6200cc910 0x7fe6200b5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:36.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.825+0000 7fe625d91700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6200cc910 0x7fe6200b5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44738/0 (socket says 172.21.15.149:44738) 2023-11-08T19:28:36.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.825+0000 7fe625d91700 1 -- 172.21.15.149:0/3942103091 learned_addr learned my addr 172.21.15.149:0/3942103091 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:28:36.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.825+0000 7fe624d8f700 1 --2- 172.21.15.149:0/3942103091 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6200cc140 0x7fe62014f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:36.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.825+0000 7fe625590700 1 --2- 172.21.15.149:0/3942103091 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe6200cb130 0x7fe62009dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:36.842 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.825+0000 7fe625d91700 1 -- 172.21.15.149:0/3942103091 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe6200cb130 msgr2=0x7fe62009dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:36.842 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.825+0000 7fe625d91700 1 --2- 172.21.15.149:0/3942103091 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe6200cb130 0x7fe62009dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:36.842 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.825+0000 7fe625d91700 1 -- 172.21.15.149:0/3942103091 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6200cc140 msgr2=0x7fe62014f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:36.842 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.825+0000 7fe625d91700 1 --2- 172.21.15.149:0/3942103091 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6200cc140 0x7fe62014f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:36.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.825+0000 7fe625d91700 1 -- 172.21.15.149:0/3942103091 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe61c009550 con 0x7fe6200cc910 2023-11-08T19:28:36.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.825+0000 7fe625590700 1 --2- 172.21.15.149:0/3942103091 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe6200cb130 0x7fe62009dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:28:36.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.825+0000 7fe624d8f700 1 --2- 172.21.15.149:0/3942103091 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6200cc140 0x7fe62014f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:28:36.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.825+0000 7fe625d91700 1 --2- 172.21.15.149:0/3942103091 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6200cc910 0x7fe6200b5420 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fe61800c7d0 tx=0x7fe61800cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:36.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.825+0000 7fe615ffb700 1 -- 172.21.15.149:0/3942103091 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe618003e10 con 0x7fe6200cc910 2023-11-08T19:28:36.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.825+0000 7fe615ffb700 1 -- 172.21.15.149:0/3942103091 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe618005070 con 0x7fe6200cc910 2023-11-08T19:28:36.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.825+0000 7fe6277f4700 1 -- 172.21.15.149:0/3942103091 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe62009d170 con 0x7fe6200cc910 2023-11-08T19:28:36.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.825+0000 7fe615ffb700 1 -- 172.21.15.149:0/3942103091 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe618005420 con 0x7fe6200cc910 2023-11-08T19:28:36.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.826+0000 7fe6277f4700 1 -- 172.21.15.149:0/3942103091 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe62009e190 con 0x7fe6200cc910 2023-11-08T19:28:36.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.826+0000 7fe6277f4700 1 -- 172.21.15.149:0/3942103091 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe62009e3b0 con 0x7fe6200cc910 2023-11-08T19:28:36.845 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.827+0000 7fe615ffb700 1 -- 172.21.15.149:0/3942103091 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe618005580 con 0x7fe6200cc910 2023-11-08T19:28:36.845 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.827+0000 7fe615ffb700 1 --2- 172.21.15.149:0/3942103091 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe60406af00 0x7fe60406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:36.845 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.827+0000 7fe615ffb700 1 -- 172.21.15.149:0/3942103091 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7436+0+0 (secure 0 0 0) 0x7fe618089360 con 0x7fe6200cc910 2023-11-08T19:28:36.845 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.827+0000 7fe625590700 1 --2- 172.21.15.149:0/3942103091 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe60406af00 0x7fe60406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:36.845 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.828+0000 7fe625590700 1 --2- 172.21.15.149:0/3942103091 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe60406af00 0x7fe60406d3c0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fe62009ca20 tx=0x7fe610009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:36.846 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:36.832+0000 7fe615ffb700 1 -- 172.21.15.149:0/3942103091 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe618053d50 con 0x7fe6200cc910 2023-11-08T19:28:37.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:37.065+0000 7fe6277f4700 1 -- 172.21.15.149:0/3942103091 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe6200b1790 con 0x7fe6200cc910 2023-11-08T19:28:37.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:37.066+0000 7fe615ffb700 1 -- 172.21.15.149:0/3942103091 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4938 (secure 0 0 0) 0x7fe6200b1790 con 0x7fe6200cc910 2023-11-08T19:28:37.068 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:28:37.069 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":84,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6095,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/852710262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":852710262},{"type":"v1","addr":"172.21.15.160:6835","nonce":852710262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64},{"gid":6236,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/1313631099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":1313631099},{"type":"v1","addr":"172.21.15.160:6834","nonce":1313631099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:28:35.605104+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7578,"mds_1":7125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7125":{"gid":7125,"name":"c","rank":1,"incarnation":57,"state":"up:active","state_seq":6,"addr":"172.21.15.149:6837/3917392643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3917392643},{"type":"v1","addr":"172.21.15.149:6837","nonce":3917392643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7578":{"gid":7578,"name":"a","rank":0,"incarnation":79,"state":"up:active","state_seq":11,"addr":"172.21.15.149:6836/295381437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":295381437},{"type":"v1","addr":"172.21.15.149:6836","nonce":295381437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:28:37.071 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:37.068+0000 7fe6277f4700 1 -- 172.21.15.149:0/3942103091 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe60406af00 msgr2=0x7fe60406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:37.071 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:37.068+0000 7fe6277f4700 1 --2- 172.21.15.149:0/3942103091 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe60406af00 0x7fe60406d3c0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fe62009ca20 tx=0x7fe610009040 comp rx=0 tx=0).stop 2023-11-08T19:28:37.071 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:37.068+0000 7fe6277f4700 1 -- 172.21.15.149:0/3942103091 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6200cc910 msgr2=0x7fe6200b5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:37.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:37.068+0000 7fe6277f4700 1 --2- 172.21.15.149:0/3942103091 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6200cc910 0x7fe6200b5420 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fe61800c7d0 tx=0x7fe61800cb90 comp rx=0 tx=0).stop 2023-11-08T19:28:37.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:37.068+0000 7fe6277f4700 1 -- 172.21.15.149:0/3942103091 shutdown_connections 2023-11-08T19:28:37.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:37.068+0000 7fe6277f4700 1 --2- 172.21.15.149:0/3942103091 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe60406af00 0x7fe60406d3c0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:37.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:37.068+0000 7fe6277f4700 1 --2- 172.21.15.149:0/3942103091 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6200cc910 0x7fe6200b5420 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:37.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:37.068+0000 7fe6277f4700 1 --2- 172.21.15.149:0/3942103091 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe6200cb130 0x7fe62009dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:37.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:37.068+0000 7fe6277f4700 1 --2- 172.21.15.149:0/3942103091 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6200cc140 0x7fe62014f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:37.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:37.068+0000 7fe6277f4700 1 -- 172.21.15.149:0/3942103091 >> 172.21.15.149:0/3942103091 conn(0x7fe620099a40 msgr2=0x7fe620160c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:37.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:37.069+0000 7fe6277f4700 1 -- 172.21.15.149:0/3942103091 shutdown_connections 2023-11-08T19:28:37.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:37.069+0000 7fe6277f4700 1 -- 172.21.15.149:0/3942103091 wait complete. 2023-11-08T19:28:37.074 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 84 2023-11-08T19:28:37.083 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-08T19:28:38.505 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T19:28:38.508 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T19:28:40.846 INFO:tasks.ceph.mds.a.smithi149.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el8/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_commit_logged(ceph::cref_t&)' thread 7f62e6828700 time 2023-11-08T19:28:40.846273+0000 2023-11-08T19:28:40.847 INFO:tasks.ceph.mds.a.smithi149.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el8/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 171: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 6) 2023-11-08T19:28:40.847 INFO:tasks.ceph.mds.a.smithi149.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-08T19:28:40.848 INFO:tasks.ceph.mds.a.smithi149.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f62f80fcf5b] 2023-11-08T19:28:40.848 INFO:tasks.ceph.mds.a.smithi149.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2ba121) [0x7f62f80fd121] 2023-11-08T19:28:40.848 INFO:tasks.ceph.mds.a.smithi149.stderr: 3: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x2ab) [0x558f3d9a9f2b] 2023-11-08T19:28:40.848 INFO:tasks.ceph.mds.a.smithi149.stderr: 4: (MDSContext::complete(int)+0x5f) [0x558f3d9f6ecf] 2023-11-08T19:28:40.848 INFO:tasks.ceph.mds.a.smithi149.stderr: 5: (MDSIOContextBase::complete(int)+0x574) [0x558f3d9f76b4] 2023-11-08T19:28:40.849 INFO:tasks.ceph.mds.a.smithi149.stderr: 6: (MDSLogContextBase::complete(int)+0x5b) [0x558f3d9f7a7b] 2023-11-08T19:28:40.849 INFO:tasks.ceph.mds.a.smithi149.stderr: 7: (Finisher::finisher_thread_entry()+0x19d) [0x7f62f819a8cd] 2023-11-08T19:28:40.849 INFO:tasks.ceph.mds.a.smithi149.stderr: 8: /lib64/libpthread.so.0(+0x81cf) [0x7f62f6e951cf] 2023-11-08T19:28:40.849 INFO:tasks.ceph.mds.a.smithi149.stderr: 9: clone() 2023-11-08T19:28:40.849 INFO:tasks.ceph.mds.a.smithi149.stderr:2023-11-08T19:28:40.845+0000 7f62e6828700 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el8/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_commit_logged(ceph::cref_t&)' thread 7f62e6828700 time 2023-11-08T19:28:40.846273+0000 2023-11-08T19:28:40.850 INFO:tasks.ceph.mds.a.smithi149.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el8/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 171: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 6) 2023-11-08T19:28:40.850 INFO:tasks.ceph.mds.a.smithi149.stderr: 2023-11-08T19:28:40.850 INFO:tasks.ceph.mds.a.smithi149.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-08T19:28:40.850 INFO:tasks.ceph.mds.a.smithi149.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f62f80fcf5b] 2023-11-08T19:28:40.850 INFO:tasks.ceph.mds.a.smithi149.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2ba121) [0x7f62f80fd121] 2023-11-08T19:28:40.851 INFO:tasks.ceph.mds.a.smithi149.stderr: 3: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x2ab) [0x558f3d9a9f2b] 2023-11-08T19:28:40.851 INFO:tasks.ceph.mds.a.smithi149.stderr: 4: (MDSContext::complete(int)+0x5f) [0x558f3d9f6ecf] 2023-11-08T19:28:40.851 INFO:tasks.ceph.mds.a.smithi149.stderr: 5: (MDSIOContextBase::complete(int)+0x574) [0x558f3d9f76b4] 2023-11-08T19:28:40.851 INFO:tasks.ceph.mds.a.smithi149.stderr: 6: (MDSLogContextBase::complete(int)+0x5b) [0x558f3d9f7a7b] 2023-11-08T19:28:40.851 INFO:tasks.ceph.mds.a.smithi149.stderr: 7: (Finisher::finisher_thread_entry()+0x19d) [0x7f62f819a8cd] 2023-11-08T19:28:40.852 INFO:tasks.ceph.mds.a.smithi149.stderr: 8: /lib64/libpthread.so.0(+0x81cf) [0x7f62f6e951cf] 2023-11-08T19:28:40.852 INFO:tasks.ceph.mds.a.smithi149.stderr: 9: clone() 2023-11-08T19:28:40.852 INFO:tasks.ceph.mds.a.smithi149.stderr: 2023-11-08T19:28:40.852 INFO:tasks.ceph.mds.a.smithi149.stderr:*** Caught signal (Aborted) ** 2023-11-08T19:28:40.852 INFO:tasks.ceph.mds.a.smithi149.stderr: in thread 7f62e6828700 thread_name:MR_Finisher 2023-11-08T19:28:40.853 INFO:tasks.ceph.mds.a.smithi149.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-08T19:28:40.853 INFO:tasks.ceph.mds.a.smithi149.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f62f6e9fce0] 2023-11-08T19:28:40.854 INFO:tasks.ceph.mds.a.smithi149.stderr: 2: gsignal() 2023-11-08T19:28:40.854 INFO:tasks.ceph.mds.a.smithi149.stderr: 3: abort() 2023-11-08T19:28:40.854 INFO:tasks.ceph.mds.a.smithi149.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f62f80fcfb5] 2023-11-08T19:28:40.854 INFO:tasks.ceph.mds.a.smithi149.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2ba121) [0x7f62f80fd121] 2023-11-08T19:28:40.854 INFO:tasks.ceph.mds.a.smithi149.stderr: 6: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x2ab) [0x558f3d9a9f2b] 2023-11-08T19:28:40.855 INFO:tasks.ceph.mds.a.smithi149.stderr: 7: (MDSContext::complete(int)+0x5f) [0x558f3d9f6ecf] 2023-11-08T19:28:40.855 INFO:tasks.ceph.mds.a.smithi149.stderr: 8: (MDSIOContextBase::complete(int)+0x574) [0x558f3d9f76b4] 2023-11-08T19:28:40.855 INFO:tasks.ceph.mds.a.smithi149.stderr: 9: (MDSLogContextBase::complete(int)+0x5b) [0x558f3d9f7a7b] 2023-11-08T19:28:40.855 INFO:tasks.ceph.mds.a.smithi149.stderr: 10: (Finisher::finisher_thread_entry()+0x19d) [0x7f62f819a8cd] 2023-11-08T19:28:40.855 INFO:tasks.ceph.mds.a.smithi149.stderr: 11: /lib64/libpthread.so.0(+0x81cf) [0x7f62f6e951cf] 2023-11-08T19:28:40.855 INFO:tasks.ceph.mds.a.smithi149.stderr: 12: clone() 2023-11-08T19:28:40.856 INFO:tasks.ceph.mds.a.smithi149.stderr:2023-11-08T19:28:40.846+0000 7f62e6828700 -1 *** Caught signal (Aborted) ** 2023-11-08T19:28:40.856 INFO:tasks.ceph.mds.a.smithi149.stderr: in thread 7f62e6828700 thread_name:MR_Finisher 2023-11-08T19:28:40.856 INFO:tasks.ceph.mds.a.smithi149.stderr: 2023-11-08T19:28:40.856 INFO:tasks.ceph.mds.a.smithi149.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-08T19:28:40.856 INFO:tasks.ceph.mds.a.smithi149.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f62f6e9fce0] 2023-11-08T19:28:40.857 INFO:tasks.ceph.mds.a.smithi149.stderr: 2: gsignal() 2023-11-08T19:28:40.857 INFO:tasks.ceph.mds.a.smithi149.stderr: 3: abort() 2023-11-08T19:28:40.857 INFO:tasks.ceph.mds.a.smithi149.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f62f80fcfb5] 2023-11-08T19:28:40.857 INFO:tasks.ceph.mds.a.smithi149.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2ba121) [0x7f62f80fd121] 2023-11-08T19:28:40.857 INFO:tasks.ceph.mds.a.smithi149.stderr: 6: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x2ab) [0x558f3d9a9f2b] 2023-11-08T19:28:40.858 INFO:tasks.ceph.mds.a.smithi149.stderr: 7: (MDSContext::complete(int)+0x5f) [0x558f3d9f6ecf] 2023-11-08T19:28:40.858 INFO:tasks.ceph.mds.a.smithi149.stderr: 8: (MDSIOContextBase::complete(int)+0x574) [0x558f3d9f76b4] 2023-11-08T19:28:40.858 INFO:tasks.ceph.mds.a.smithi149.stderr: 9: (MDSLogContextBase::complete(int)+0x5b) [0x558f3d9f7a7b] 2023-11-08T19:28:40.858 INFO:tasks.ceph.mds.a.smithi149.stderr: 10: (Finisher::finisher_thread_entry()+0x19d) [0x7f62f819a8cd] 2023-11-08T19:28:40.859 INFO:tasks.ceph.mds.a.smithi149.stderr: 11: /lib64/libpthread.so.0(+0x81cf) [0x7f62f6e951cf] 2023-11-08T19:28:40.859 INFO:tasks.ceph.mds.a.smithi149.stderr: 12: clone() 2023-11-08T19:28:40.859 INFO:tasks.ceph.mds.a.smithi149.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-08T19:28:40.859 INFO:tasks.ceph.mds.a.smithi149.stderr: 2023-11-08T19:28:40.859 INFO:tasks.ceph.mds.a.smithi149.stderr: -704> 2023-11-08T19:28:31.753+0000 7f62ea02f700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-08T19:28:40.860 INFO:tasks.ceph.mds.a.smithi149.stderr: -702> 2023-11-08T19:28:31.753+0000 7f62ea02f700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-08T19:28:40.860 INFO:tasks.ceph.mds.a.smithi149.stderr: -4> 2023-11-08T19:28:40.845+0000 7f62e6828700 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el8/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_commit_logged(ceph::cref_t&)' thread 7f62e6828700 time 2023-11-08T19:28:40.846273+0000 2023-11-08T19:28:40.860 INFO:tasks.ceph.mds.a.smithi149.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el8/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 171: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 6) 2023-11-08T19:28:40.860 INFO:tasks.ceph.mds.a.smithi149.stderr: 2023-11-08T19:28:40.860 INFO:tasks.ceph.mds.a.smithi149.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-08T19:28:40.861 INFO:tasks.ceph.mds.a.smithi149.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f62f80fcf5b] 2023-11-08T19:28:40.861 INFO:tasks.ceph.mds.a.smithi149.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2ba121) [0x7f62f80fd121] 2023-11-08T19:28:40.861 INFO:tasks.ceph.mds.a.smithi149.stderr: 3: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x2ab) [0x558f3d9a9f2b] 2023-11-08T19:28:40.861 INFO:tasks.ceph.mds.a.smithi149.stderr: 4: (MDSContext::complete(int)+0x5f) [0x558f3d9f6ecf] 2023-11-08T19:28:40.861 INFO:tasks.ceph.mds.a.smithi149.stderr: 5: (MDSIOContextBase::complete(int)+0x574) [0x558f3d9f76b4] 2023-11-08T19:28:40.862 INFO:tasks.ceph.mds.a.smithi149.stderr: 6: (MDSLogContextBase::complete(int)+0x5b) [0x558f3d9f7a7b] 2023-11-08T19:28:40.862 INFO:tasks.ceph.mds.a.smithi149.stderr: 7: (Finisher::finisher_thread_entry()+0x19d) [0x7f62f819a8cd] 2023-11-08T19:28:40.862 INFO:tasks.ceph.mds.a.smithi149.stderr: 8: /lib64/libpthread.so.0(+0x81cf) [0x7f62f6e951cf] 2023-11-08T19:28:40.862 INFO:tasks.ceph.mds.a.smithi149.stderr: 9: clone() 2023-11-08T19:28:40.862 INFO:tasks.ceph.mds.a.smithi149.stderr: 2023-11-08T19:28:40.863 INFO:tasks.ceph.mds.a.smithi149.stderr: 0> 2023-11-08T19:28:40.846+0000 7f62e6828700 -1 *** Caught signal (Aborted) ** 2023-11-08T19:28:40.863 INFO:tasks.ceph.mds.a.smithi149.stderr: in thread 7f62e6828700 thread_name:MR_Finisher 2023-11-08T19:28:40.863 INFO:tasks.ceph.mds.a.smithi149.stderr: 2023-11-08T19:28:40.863 INFO:tasks.ceph.mds.a.smithi149.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-08T19:28:40.863 INFO:tasks.ceph.mds.a.smithi149.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f62f6e9fce0] 2023-11-08T19:28:40.864 INFO:tasks.ceph.mds.a.smithi149.stderr: 2: gsignal() 2023-11-08T19:28:40.864 INFO:tasks.ceph.mds.a.smithi149.stderr: 3: abort() 2023-11-08T19:28:40.864 INFO:tasks.ceph.mds.a.smithi149.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f62f80fcfb5] 2023-11-08T19:28:40.864 INFO:tasks.ceph.mds.a.smithi149.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2ba121) [0x7f62f80fd121] 2023-11-08T19:28:40.864 INFO:tasks.ceph.mds.a.smithi149.stderr: 6: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x2ab) [0x558f3d9a9f2b] 2023-11-08T19:28:40.864 INFO:tasks.ceph.mds.a.smithi149.stderr: 7: (MDSContext::complete(int)+0x5f) [0x558f3d9f6ecf] 2023-11-08T19:28:40.865 INFO:tasks.ceph.mds.a.smithi149.stderr: 8: (MDSIOContextBase::complete(int)+0x574) [0x558f3d9f76b4] 2023-11-08T19:28:40.865 INFO:tasks.ceph.mds.a.smithi149.stderr: 9: (MDSLogContextBase::complete(int)+0x5b) [0x558f3d9f7a7b] 2023-11-08T19:28:40.865 INFO:tasks.ceph.mds.a.smithi149.stderr: 10: (Finisher::finisher_thread_entry()+0x19d) [0x7f62f819a8cd] 2023-11-08T19:28:40.865 INFO:tasks.ceph.mds.a.smithi149.stderr: 11: /lib64/libpthread.so.0(+0x81cf) [0x7f62f6e951cf] 2023-11-08T19:28:40.865 INFO:tasks.ceph.mds.a.smithi149.stderr: 12: clone() 2023-11-08T19:28:40.866 INFO:tasks.ceph.mds.a.smithi149.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-08T19:28:40.866 INFO:tasks.ceph.mds.a.smithi149.stderr: 2023-11-08T19:28:40.866 INFO:tasks.ceph.mds.a.smithi149.stderr: -704> 2023-11-08T19:28:31.753+0000 7f62ea02f700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-08T19:28:40.867 INFO:tasks.ceph.mds.a.smithi149.stderr: -702> 2023-11-08T19:28:31.753+0000 7f62ea02f700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-08T19:28:40.867 INFO:tasks.ceph.mds.a.smithi149.stderr: -4> 2023-11-08T19:28:40.845+0000 7f62e6828700 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el8/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_commit_logged(ceph::cref_t&)' thread 7f62e6828700 time 2023-11-08T19:28:40.846273+0000 2023-11-08T19:28:40.867 INFO:tasks.ceph.mds.a.smithi149.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el8/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 171: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 6) 2023-11-08T19:28:40.867 INFO:tasks.ceph.mds.a.smithi149.stderr: 2023-11-08T19:28:40.867 INFO:tasks.ceph.mds.a.smithi149.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-08T19:28:40.868 INFO:tasks.ceph.mds.a.smithi149.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f62f80fcf5b] 2023-11-08T19:28:40.868 INFO:tasks.ceph.mds.a.smithi149.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2ba121) [0x7f62f80fd121] 2023-11-08T19:28:40.868 INFO:tasks.ceph.mds.a.smithi149.stderr: 3: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x2ab) [0x558f3d9a9f2b] 2023-11-08T19:28:40.868 INFO:tasks.ceph.mds.a.smithi149.stderr: 4: (MDSContext::complete(int)+0x5f) [0x558f3d9f6ecf] 2023-11-08T19:28:40.868 INFO:tasks.ceph.mds.a.smithi149.stderr: 5: (MDSIOContextBase::complete(int)+0x574) [0x558f3d9f76b4] 2023-11-08T19:28:40.869 INFO:tasks.ceph.mds.a.smithi149.stderr: 6: (MDSLogContextBase::complete(int)+0x5b) [0x558f3d9f7a7b] 2023-11-08T19:28:40.869 INFO:tasks.ceph.mds.a.smithi149.stderr: 7: (Finisher::finisher_thread_entry()+0x19d) [0x7f62f819a8cd] 2023-11-08T19:28:40.869 INFO:tasks.ceph.mds.a.smithi149.stderr: 8: /lib64/libpthread.so.0(+0x81cf) [0x7f62f6e951cf] 2023-11-08T19:28:40.869 INFO:tasks.ceph.mds.a.smithi149.stderr: 9: clone() 2023-11-08T19:28:40.869 INFO:tasks.ceph.mds.a.smithi149.stderr: 2023-11-08T19:28:40.870 INFO:tasks.ceph.mds.a.smithi149.stderr: 0> 2023-11-08T19:28:40.846+0000 7f62e6828700 -1 *** Caught signal (Aborted) ** 2023-11-08T19:28:40.870 INFO:tasks.ceph.mds.a.smithi149.stderr: in thread 7f62e6828700 thread_name:MR_Finisher 2023-11-08T19:28:40.870 INFO:tasks.ceph.mds.a.smithi149.stderr: 2023-11-08T19:28:40.870 INFO:tasks.ceph.mds.a.smithi149.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-08T19:28:40.870 INFO:tasks.ceph.mds.a.smithi149.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f62f6e9fce0] 2023-11-08T19:28:40.871 INFO:tasks.ceph.mds.a.smithi149.stderr: 2: gsignal() 2023-11-08T19:28:40.871 INFO:tasks.ceph.mds.a.smithi149.stderr: 3: abort() 2023-11-08T19:28:40.871 INFO:tasks.ceph.mds.a.smithi149.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f62f80fcfb5] 2023-11-08T19:28:40.871 INFO:tasks.ceph.mds.a.smithi149.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2ba121) [0x7f62f80fd121] 2023-11-08T19:28:40.871 INFO:tasks.ceph.mds.a.smithi149.stderr: 6: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x2ab) [0x558f3d9a9f2b] 2023-11-08T19:28:40.871 INFO:tasks.ceph.mds.a.smithi149.stderr: 7: (MDSContext::complete(int)+0x5f) [0x558f3d9f6ecf] 2023-11-08T19:28:40.872 INFO:tasks.ceph.mds.a.smithi149.stderr: 8: (MDSIOContextBase::complete(int)+0x574) [0x558f3d9f76b4] 2023-11-08T19:28:40.872 INFO:tasks.ceph.mds.a.smithi149.stderr: 9: (MDSLogContextBase::complete(int)+0x5b) [0x558f3d9f7a7b] 2023-11-08T19:28:40.872 INFO:tasks.ceph.mds.a.smithi149.stderr: 10: (Finisher::finisher_thread_entry()+0x19d) [0x7f62f819a8cd] 2023-11-08T19:28:40.872 INFO:tasks.ceph.mds.a.smithi149.stderr: 11: /lib64/libpthread.so.0(+0x81cf) [0x7f62f6e951cf] 2023-11-08T19:28:40.872 INFO:tasks.ceph.mds.a.smithi149.stderr: 12: clone() 2023-11-08T19:28:40.873 INFO:tasks.ceph.mds.a.smithi149.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-08T19:28:40.873 INFO:tasks.ceph.mds.a.smithi149.stderr: 2023-11-08T19:28:41.076 INFO:tasks.ceph.mds.a.smithi149.stderr:daemon-helper: command crashed with signal 6 2023-11-08T19:28:42.084 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:28:42.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.216+0000 7fa164a68700 1 Processor -- start 2023-11-08T19:28:42.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.216+0000 7fa164a68700 1 -- start start 2023-11-08T19:28:42.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.217+0000 7fa164a68700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa1600cc140 0x7fa1600cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:42.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.217+0000 7fa164a68700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fa1600b2850 0x7fa1600cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:42.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.217+0000 7fa164a68700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1600cce50 con 0x7fa1600b2cd0 2023-11-08T19:28:42.221 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.217+0000 7fa164a68700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1600b2430 con 0x7fa1600b2850 2023-11-08T19:28:42.221 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.217+0000 7fa164a68700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1600cc520 con 0x7fa1600cc140 2023-11-08T19:28:42.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.218+0000 7fa15e59c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa1600cc140 0x7fa1600cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:42.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.218+0000 7fa15dd9b700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fa1600b2850 0x7fa1600cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:42.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.218+0000 7fa15e59c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa1600cc140 0x7fa1600cc910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.149:36808/0 (socket says 172.21.15.149:36808) 2023-11-08T19:28:42.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.218+0000 7fa15dd9b700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fa1600b2850 0x7fa1600cabf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.149:45744/0 (socket says 172.21.15.149:45744) 2023-11-08T19:28:42.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.218+0000 7fa15e59c700 1 -- 172.21.15.149:0/794386283 learned_addr learned my addr 172.21.15.149:0/794386283 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:28:42.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.218+0000 7fa15ed9d700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7fa1600b2cd0 0x7fa16015d2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.149:58424/0 (socket says 172.21.15.149:58424) 2023-11-08T19:28:42.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.218+0000 7fa15e59c700 1 -- 172.21.15.149:0/794386283 >> v2:172.21.15.160:3300/0 conn(0x7fa1600b2850 msgr2=0x7fa1600cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:42.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.218+0000 7fa15e59c700 1 --2- 172.21.15.149:0/794386283 >> v2:172.21.15.160:3300/0 conn(0x7fa1600b2850 0x7fa1600cabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:42.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.218+0000 7fa15e59c700 1 -- 172.21.15.149:0/794386283 >> v1:172.21.15.160:6789/0 conn(0x7fa1600b2cd0 legacy=0x7fa16015d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:42.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.218+0000 7fa15e59c700 1 -- 172.21.15.149:0/794386283 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1600b17b0 con 0x7fa1600cc140 2023-11-08T19:28:42.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.218+0000 7fa15dd9b700 1 --2- 172.21.15.149:0/794386283 >> v2:172.21.15.160:3300/0 conn(0x7fa1600b2850 0x7fa1600cabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:28:42.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.219+0000 7fa15e59c700 1 --2- 172.21.15.149:0/794386283 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa1600cc140 0x7fa1600cc910 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa154006fd0 tx=0x7fa154009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3b34db8f29d8c1e server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:42.226 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.219+0000 7fa15d59a700 1 -- 172.21.15.149:0/794386283 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa154005e30 con 0x7fa1600cc140 2023-11-08T19:28:42.226 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.219+0000 7fa15d59a700 1 -- 172.21.15.149:0/794386283 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa154004030 con 0x7fa1600cc140 2023-11-08T19:28:42.226 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.219+0000 7fa15d59a700 1 -- 172.21.15.149:0/794386283 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1540043e0 con 0x7fa1600cc140 2023-11-08T19:28:42.226 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.219+0000 7fa164a68700 1 -- 172.21.15.149:0/794386283 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa1600cc140 msgr2=0x7fa1600cc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:42.227 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.219+0000 7fa164a68700 1 --2- 172.21.15.149:0/794386283 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa1600cc140 0x7fa1600cc910 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa154006fd0 tx=0x7fa154009bd0 comp rx=0 tx=0).stop 2023-11-08T19:28:42.227 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.219+0000 7fa164a68700 1 -- 172.21.15.149:0/794386283 shutdown_connections 2023-11-08T19:28:42.227 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.219+0000 7fa164a68700 1 --2- 172.21.15.149:0/794386283 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa1600cc140 0x7fa1600cc910 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:42.227 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.219+0000 7fa164a68700 1 --2- 172.21.15.149:0/794386283 >> v2:172.21.15.160:3300/0 conn(0x7fa1600b2850 0x7fa1600cabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:42.227 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.219+0000 7fa164a68700 1 -- 172.21.15.149:0/794386283 >> 172.21.15.149:0/794386283 conn(0x7fa160099a40 msgr2=0x7fa1600d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:42.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.219+0000 7fa164a68700 1 -- 172.21.15.149:0/794386283 shutdown_connections 2023-11-08T19:28:42.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.219+0000 7fa164a68700 1 -- 172.21.15.149:0/794386283 wait complete. 2023-11-08T19:28:42.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.221+0000 7fa164a68700 1 Processor -- start 2023-11-08T19:28:42.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.221+0000 7fa164a68700 1 -- start start 2023-11-08T19:28:42.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.222+0000 7fa164a68700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa1600b2850 0x7fa160151e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:42.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.222+0000 7fa164a68700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa1600b2cd0 0x7fa16009a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:42.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.222+0000 7fa164a68700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa1600cc140 0x7fa16015f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:42.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.222+0000 7fa164a68700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1601523d0 con 0x7fa1600b2850 2023-11-08T19:28:42.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.222+0000 7fa164a68700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa160152880 con 0x7fa1600cc140 2023-11-08T19:28:42.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.222+0000 7fa164a68700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa16009dec0 con 0x7fa1600b2cd0 2023-11-08T19:28:42.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.222+0000 7fa15e59c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa1600b2850 0x7fa160151e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:42.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.222+0000 7fa15e59c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa1600b2850 0x7fa160151e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44758/0 (socket says 172.21.15.149:44758) 2023-11-08T19:28:42.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.222+0000 7fa15e59c700 1 -- 172.21.15.149:0/3870451016 learned_addr learned my addr 172.21.15.149:0/3870451016 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:28:42.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.222+0000 7fa15dd9b700 1 --2- 172.21.15.149:0/3870451016 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa1600b2cd0 0x7fa16009a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:42.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.222+0000 7fa15ed9d700 1 --2- 172.21.15.149:0/3870451016 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa1600cc140 0x7fa16015f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:42.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.223+0000 7fa15e59c700 1 -- 172.21.15.149:0/3870451016 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa1600b2cd0 msgr2=0x7fa16009a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:42.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.223+0000 7fa15e59c700 1 --2- 172.21.15.149:0/3870451016 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa1600b2cd0 0x7fa16009a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:42.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.223+0000 7fa15e59c700 1 -- 172.21.15.149:0/3870451016 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa1600cc140 msgr2=0x7fa16015f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:42.234 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.223+0000 7fa15e59c700 1 --2- 172.21.15.149:0/3870451016 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa1600cc140 0x7fa16015f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:42.234 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.223+0000 7fa15e59c700 1 -- 172.21.15.149:0/3870451016 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1500094a0 con 0x7fa1600b2850 2023-11-08T19:28:42.234 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.223+0000 7fa15e59c700 1 --2- 172.21.15.149:0/3870451016 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa1600b2850 0x7fa160151e90 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fa154009c10 tx=0x7fa154004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:42.234 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.223+0000 7fa14effd700 1 -- 172.21.15.149:0/3870451016 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa154003ab0 con 0x7fa1600b2850 2023-11-08T19:28:42.234 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.223+0000 7fa14effd700 1 -- 172.21.15.149:0/3870451016 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa154003c30 con 0x7fa1600b2850 2023-11-08T19:28:42.235 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.223+0000 7fa14effd700 1 -- 172.21.15.149:0/3870451016 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa154006030 con 0x7fa1600b2850 2023-11-08T19:28:42.235 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.223+0000 7fa164a68700 1 -- 172.21.15.149:0/3870451016 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa154009500 con 0x7fa1600b2850 2023-11-08T19:28:42.235 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.223+0000 7fa164a68700 1 -- 172.21.15.149:0/3870451016 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa160152b40 con 0x7fa1600b2850 2023-11-08T19:28:42.235 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.224+0000 7fa164a68700 1 -- 172.21.15.149:0/3870451016 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1600745f0 con 0x7fa1600b2850 2023-11-08T19:28:42.236 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.224+0000 7fa14effd700 1 -- 172.21.15.149:0/3870451016 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa154006190 con 0x7fa1600b2850 2023-11-08T19:28:42.236 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.225+0000 7fa14effd700 1 --2- 172.21.15.149:0/3870451016 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa14006af00 0x7fa14006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:42.236 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.225+0000 7fa14effd700 1 -- 172.21.15.149:0/3870451016 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7436+0+0 (secure 0 0 0) 0x7fa15408af10 con 0x7fa1600b2850 2023-11-08T19:28:42.236 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.225+0000 7fa15dd9b700 1 --2- 172.21.15.149:0/3870451016 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa14006af00 0x7fa14006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:42.236 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.225+0000 7fa15dd9b700 1 --2- 172.21.15.149:0/3870451016 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa14006af00 0x7fa14006d3c0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fa16015f410 tx=0x7fa150009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:42.237 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.230+0000 7fa14effd700 1 -- 172.21.15.149:0/3870451016 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa154055ab0 con 0x7fa1600b2850 2023-11-08T19:28:42.469 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.467+0000 7fa164a68700 1 -- 172.21.15.149:0/3870451016 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa1600cb5d0 con 0x7fa1600b2850 2023-11-08T19:28:42.470 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.467+0000 7fa14effd700 1 -- 172.21.15.149:0/3870451016 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4938 (secure 0 0 0) 0x7fa1540590d0 con 0x7fa1600b2850 2023-11-08T19:28:42.470 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:28:42.470 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":84,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6095,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/852710262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":852710262},{"type":"v1","addr":"172.21.15.160:6835","nonce":852710262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64},{"gid":6236,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/1313631099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":1313631099},{"type":"v1","addr":"172.21.15.160:6834","nonce":1313631099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:28:35.605104+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7578,"mds_1":7125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7125":{"gid":7125,"name":"c","rank":1,"incarnation":57,"state":"up:active","state_seq":6,"addr":"172.21.15.149:6837/3917392643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3917392643},{"type":"v1","addr":"172.21.15.149:6837","nonce":3917392643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7578":{"gid":7578,"name":"a","rank":0,"incarnation":79,"state":"up:active","state_seq":11,"addr":"172.21.15.149:6836/295381437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":295381437},{"type":"v1","addr":"172.21.15.149:6836","nonce":295381437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:28:42.472 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.470+0000 7fa164a68700 1 -- 172.21.15.149:0/3870451016 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa14006af00 msgr2=0x7fa14006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:42.472 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.470+0000 7fa164a68700 1 --2- 172.21.15.149:0/3870451016 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa14006af00 0x7fa14006d3c0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fa16015f410 tx=0x7fa150009210 comp rx=0 tx=0).stop 2023-11-08T19:28:42.472 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.470+0000 7fa164a68700 1 -- 172.21.15.149:0/3870451016 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa1600b2850 msgr2=0x7fa160151e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:42.473 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.470+0000 7fa164a68700 1 --2- 172.21.15.149:0/3870451016 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa1600b2850 0x7fa160151e90 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fa154009c10 tx=0x7fa154004750 comp rx=0 tx=0).stop 2023-11-08T19:28:42.473 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.470+0000 7fa164a68700 1 -- 172.21.15.149:0/3870451016 shutdown_connections 2023-11-08T19:28:42.473 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.470+0000 7fa164a68700 1 --2- 172.21.15.149:0/3870451016 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa14006af00 0x7fa14006d3c0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:42.473 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.470+0000 7fa164a68700 1 --2- 172.21.15.149:0/3870451016 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa1600cc140 0x7fa16015f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:42.473 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.470+0000 7fa164a68700 1 --2- 172.21.15.149:0/3870451016 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa1600b2850 0x7fa160151e90 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:42.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.470+0000 7fa164a68700 1 --2- 172.21.15.149:0/3870451016 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa1600b2cd0 0x7fa16009a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:42.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.470+0000 7fa164a68700 1 -- 172.21.15.149:0/3870451016 >> 172.21.15.149:0/3870451016 conn(0x7fa160099a40 msgr2=0x7fa16006ec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:42.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.470+0000 7fa164a68700 1 -- 172.21.15.149:0/3870451016 shutdown_connections 2023-11-08T19:28:42.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:42.470+0000 7fa164a68700 1 -- 172.21.15.149:0/3870451016 wait complete. 2023-11-08T19:28:42.475 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 84 2023-11-08T19:28:42.484 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-08T19:28:44.861 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-11-08T19:28:47.486 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:28:47.620 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.617+0000 7ff95c224700 1 Processor -- start 2023-11-08T19:28:47.620 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.618+0000 7ff95c224700 1 -- start start 2023-11-08T19:28:47.622 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.618+0000 7ff95c224700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7ff9540cc140 0x7ff9540cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:47.622 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.618+0000 7ff95c224700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff9540b2850 0x7ff9540cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:47.622 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.618+0000 7ff95c224700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9540cce50 con 0x7ff9540b2cd0 2023-11-08T19:28:47.622 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.619+0000 7ff95c224700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9540b2430 con 0x7ff9540cc140 2023-11-08T19:28:47.623 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.619+0000 7ff95c224700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9540cc520 con 0x7ff9540b2850 2023-11-08T19:28:47.623 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.619+0000 7ff9597bf700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff9540b2850 0x7ff9540cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:47.623 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.619+0000 7ff959fc0700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7ff9540cc140 0x7ff9540cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:47.623 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.619+0000 7ff95a7c1700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7ff9540b2cd0 0x7ff95415d2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.149:58448/0 (socket says 172.21.15.149:58448) 2023-11-08T19:28:47.623 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.619+0000 7ff9597bf700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff9540b2850 0x7ff9540cabf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.149:36832/0 (socket says 172.21.15.149:36832) 2023-11-08T19:28:47.624 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.619+0000 7ff95a7c1700 1 -- 172.21.15.149:0/2280179413 learned_addr learned my addr 172.21.15.149:0/2280179413 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:28:47.624 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.619+0000 7ff9597bf700 1 -- 172.21.15.149:0/2280179413 >> v2:172.21.15.160:3300/0 conn(0x7ff9540cc140 msgr2=0x7ff9540cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:47.624 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.619+0000 7ff9597bf700 1 --2- 172.21.15.149:0/2280179413 >> v2:172.21.15.160:3300/0 conn(0x7ff9540cc140 0x7ff9540cc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:47.624 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.619+0000 7ff9597bf700 1 -- 172.21.15.149:0/2280179413 >> v1:172.21.15.160:6789/0 conn(0x7ff9540b2cd0 legacy=0x7ff95415d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:47.624 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.619+0000 7ff9597bf700 1 -- 172.21.15.149:0/2280179413 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9540b17b0 con 0x7ff9540b2850 2023-11-08T19:28:47.625 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.619+0000 7ff959fc0700 1 --2- 172.21.15.149:0/2280179413 >> v2:172.21.15.160:3300/0 conn(0x7ff9540cc140 0x7ff9540cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:28:47.625 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.620+0000 7ff9597bf700 1 --2- 172.21.15.149:0/2280179413 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff9540b2850 0x7ff9540cabf0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff950009840 tx=0x7ff950009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf753cbbd5fa93ec server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:47.625 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.620+0000 7ff958fbe700 1 -- 172.21.15.149:0/2280179413 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff950011830 con 0x7ff9540b2850 2023-11-08T19:28:47.626 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.620+0000 7ff958fbe700 1 -- 172.21.15.149:0/2280179413 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff950011990 con 0x7ff9540b2850 2023-11-08T19:28:47.627 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.620+0000 7ff958fbe700 1 -- 172.21.15.149:0/2280179413 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff950011d20 con 0x7ff9540b2850 2023-11-08T19:28:47.631 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.620+0000 7ff95c224700 1 -- 172.21.15.149:0/2280179413 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff9540b2850 msgr2=0x7ff9540cabf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:47.631 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.620+0000 7ff95c224700 1 --2- 172.21.15.149:0/2280179413 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff9540b2850 0x7ff9540cabf0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff950009840 tx=0x7ff950009b50 comp rx=0 tx=0).stop 2023-11-08T19:28:47.631 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.620+0000 7ff95c224700 1 -- 172.21.15.149:0/2280179413 shutdown_connections 2023-11-08T19:28:47.632 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.620+0000 7ff95c224700 1 --2- 172.21.15.149:0/2280179413 >> v2:172.21.15.160:3300/0 conn(0x7ff9540cc140 0x7ff9540cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:47.632 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.620+0000 7ff95c224700 1 --2- 172.21.15.149:0/2280179413 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff9540b2850 0x7ff9540cabf0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:47.632 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.620+0000 7ff95c224700 1 -- 172.21.15.149:0/2280179413 >> 172.21.15.149:0/2280179413 conn(0x7ff954099a40 msgr2=0x7ff9540d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:47.633 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.620+0000 7ff95c224700 1 -- 172.21.15.149:0/2280179413 shutdown_connections 2023-11-08T19:28:47.633 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.620+0000 7ff95c224700 1 -- 172.21.15.149:0/2280179413 wait complete. 2023-11-08T19:28:47.633 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.622+0000 7ff95c224700 1 Processor -- start 2023-11-08T19:28:47.633 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.622+0000 7ff95c224700 1 -- start start 2023-11-08T19:28:47.633 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.622+0000 7ff95c224700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff9540b2850 0x7ff95409c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:47.634 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.622+0000 7ff95c224700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff9540b2cd0 0x7ff9541f2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:47.634 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.622+0000 7ff95c224700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9540cc140 0x7ff95409a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:47.634 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.622+0000 7ff95c224700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff95409e360 con 0x7ff9540cc140 2023-11-08T19:28:47.634 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.622+0000 7ff95c224700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff95414f620 con 0x7ff9540b2850 2023-11-08T19:28:47.635 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.622+0000 7ff95c224700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff954152640 con 0x7ff9540b2cd0 2023-11-08T19:28:47.635 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.623+0000 7ff95a7c1700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9540cc140 0x7ff95409a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:47.635 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.623+0000 7ff95a7c1700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9540cc140 0x7ff95409a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44784/0 (socket says 172.21.15.149:44784) 2023-11-08T19:28:47.635 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.623+0000 7ff95a7c1700 1 -- 172.21.15.149:0/1574340623 learned_addr learned my addr 172.21.15.149:0/1574340623 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:28:47.635 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.623+0000 7ff9597bf700 1 --2- 172.21.15.149:0/1574340623 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff9540b2cd0 0x7ff9541f2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:47.636 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.623+0000 7ff959fc0700 1 --2- 172.21.15.149:0/1574340623 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff9540b2850 0x7ff95409c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:47.636 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.623+0000 7ff95a7c1700 1 -- 172.21.15.149:0/1574340623 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff9540b2cd0 msgr2=0x7ff9541f2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:47.636 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.623+0000 7ff95a7c1700 1 --2- 172.21.15.149:0/1574340623 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff9540b2cd0 0x7ff9541f2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:47.636 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.623+0000 7ff95a7c1700 1 -- 172.21.15.149:0/1574340623 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff9540b2850 msgr2=0x7ff95409c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:47.636 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.623+0000 7ff95a7c1700 1 --2- 172.21.15.149:0/1574340623 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff9540b2850 0x7ff95409c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:47.637 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.623+0000 7ff95a7c1700 1 -- 172.21.15.149:0/1574340623 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff948009430 con 0x7ff9540cc140 2023-11-08T19:28:47.637 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.623+0000 7ff95a7c1700 1 --2- 172.21.15.149:0/1574340623 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9540cc140 0x7ff95409a530 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7ff94c00cbc0 tx=0x7ff94c00ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:47.637 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.623+0000 7ff9467fc700 1 -- 172.21.15.149:0/1574340623 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94c00a9e0 con 0x7ff9540cc140 2023-11-08T19:28:47.637 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.623+0000 7ff9467fc700 1 -- 172.21.15.149:0/1574340623 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff94c00ab40 con 0x7ff9540cc140 2023-11-08T19:28:47.637 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.623+0000 7ff95c224700 1 -- 172.21.15.149:0/1574340623 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9500094a0 con 0x7ff9540cc140 2023-11-08T19:28:47.637 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.623+0000 7ff9467fc700 1 -- 172.21.15.149:0/1574340623 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94c012400 con 0x7ff9540cc140 2023-11-08T19:28:47.638 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.623+0000 7ff95c224700 1 -- 172.21.15.149:0/1574340623 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff95414fb50 con 0x7ff9540cc140 2023-11-08T19:28:47.638 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.624+0000 7ff95c224700 1 -- 172.21.15.149:0/1574340623 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9540745f0 con 0x7ff9540cc140 2023-11-08T19:28:47.638 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.625+0000 7ff9467fc700 1 -- 172.21.15.149:0/1574340623 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff94c01b3b0 con 0x7ff9540cc140 2023-11-08T19:28:47.638 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.625+0000 7ff9467fc700 1 --2- 172.21.15.149:0/1574340623 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff93806af00 0x7ff93806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:47.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.625+0000 7ff9467fc700 1 -- 172.21.15.149:0/1574340623 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7436+0+0 (secure 0 0 0) 0x7ff94c089750 con 0x7ff9540cc140 2023-11-08T19:28:47.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.625+0000 7ff959fc0700 1 --2- 172.21.15.149:0/1574340623 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff93806af00 0x7ff93806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:47.641 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.626+0000 7ff959fc0700 1 --2- 172.21.15.149:0/1574340623 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff93806af00 0x7ff93806d3c0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7ff948009cb0 tx=0x7ff9480091c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:47.642 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.630+0000 7ff9467fc700 1 -- 172.21.15.149:0/1574340623 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff94c0541f0 con 0x7ff9540cc140 2023-11-08T19:28:47.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.860+0000 7ff95c224700 1 -- 172.21.15.149:0/1574340623 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff9540cb5d0 con 0x7ff9540cc140 2023-11-08T19:28:47.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.861+0000 7ff9467fc700 1 -- 172.21.15.149:0/1574340623 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4938 (secure 0 0 0) 0x7ff94c057810 con 0x7ff9540cc140 2023-11-08T19:28:47.863 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:28:47.864 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":84,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6095,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/852710262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":852710262},{"type":"v1","addr":"172.21.15.160:6835","nonce":852710262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64},{"gid":6236,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/1313631099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":1313631099},{"type":"v1","addr":"172.21.15.160:6834","nonce":1313631099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:28:35.605104+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7578,"mds_1":7125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7125":{"gid":7125,"name":"c","rank":1,"incarnation":57,"state":"up:active","state_seq":6,"addr":"172.21.15.149:6837/3917392643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3917392643},{"type":"v1","addr":"172.21.15.149:6837","nonce":3917392643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7578":{"gid":7578,"name":"a","rank":0,"incarnation":79,"state":"up:active","state_seq":11,"addr":"172.21.15.149:6836/295381437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":295381437},{"type":"v1","addr":"172.21.15.149:6836","nonce":295381437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:28:47.865 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.863+0000 7ff95c224700 1 -- 172.21.15.149:0/1574340623 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff93806af00 msgr2=0x7ff93806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:47.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.863+0000 7ff95c224700 1 --2- 172.21.15.149:0/1574340623 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff93806af00 0x7ff93806d3c0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7ff948009cb0 tx=0x7ff9480091c0 comp rx=0 tx=0).stop 2023-11-08T19:28:47.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.863+0000 7ff95c224700 1 -- 172.21.15.149:0/1574340623 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9540cc140 msgr2=0x7ff95409a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:47.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.863+0000 7ff95c224700 1 --2- 172.21.15.149:0/1574340623 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9540cc140 0x7ff95409a530 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7ff94c00cbc0 tx=0x7ff94c00ced0 comp rx=0 tx=0).stop 2023-11-08T19:28:47.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.863+0000 7ff95c224700 1 -- 172.21.15.149:0/1574340623 shutdown_connections 2023-11-08T19:28:47.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.863+0000 7ff95c224700 1 --2- 172.21.15.149:0/1574340623 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff93806af00 0x7ff93806d3c0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:47.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.863+0000 7ff95c224700 1 --2- 172.21.15.149:0/1574340623 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff9540b2850 0x7ff95409c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:47.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.863+0000 7ff95c224700 1 --2- 172.21.15.149:0/1574340623 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9540cc140 0x7ff95409a530 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:47.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.863+0000 7ff95c224700 1 --2- 172.21.15.149:0/1574340623 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff9540b2cd0 0x7ff9541f2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:47.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.863+0000 7ff95c224700 1 -- 172.21.15.149:0/1574340623 >> 172.21.15.149:0/1574340623 conn(0x7ff954099a40 msgr2=0x7ff95406ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:47.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.863+0000 7ff95c224700 1 -- 172.21.15.149:0/1574340623 shutdown_connections 2023-11-08T19:28:47.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:47.863+0000 7ff95c224700 1 -- 172.21.15.149:0/1574340623 wait complete. 2023-11-08T19:28:47.868 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 84 2023-11-08T19:28:47.878 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-08T19:28:51.474 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~7s 2023-11-08T19:28:52.879 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:28:53.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.012+0000 7f02ab390700 1 Processor -- start 2023-11-08T19:28:53.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.012+0000 7f02ab390700 1 -- start start 2023-11-08T19:28:53.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.013+0000 7f02ab390700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f02a415b950 0x7f02a40ce130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:53.025 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.013+0000 7f02ab390700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f02a40cd5e0 0x7f02a40ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:53.025 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.013+0000 7f02ab390700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02a40cc2e0 con 0x7f02a40cfd20 2023-11-08T19:28:53.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.013+0000 7f02ab390700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02a40cc580 con 0x7f02a40cd5e0 2023-11-08T19:28:53.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.013+0000 7f02ab390700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02a40cc820 con 0x7f02a415b950 2023-11-08T19:28:53.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.013+0000 7f02a892b700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f02a40cd5e0 0x7f02a40ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:53.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.013+0000 7f02a992d700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f02a40cfd20 0x7f02a40d0170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:46796/0 (socket says 172.21.15.149:46796) 2023-11-08T19:28:53.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.013+0000 7f02a992d700 1 -- 172.21.15.149:0/1437477200 learned_addr learned my addr 172.21.15.149:0/1437477200 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:28:53.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.014+0000 7f02a912c700 1 --2- 172.21.15.149:0/1437477200 >> v2:172.21.15.160:3300/0 conn(0x7f02a415b950 0x7f02a40ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:53.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.014+0000 7f02a892b700 1 -- 172.21.15.149:0/1437477200 >> v2:172.21.15.160:3300/0 conn(0x7f02a415b950 msgr2=0x7f02a40ce130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:53.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.014+0000 7f02a892b700 1 --2- 172.21.15.149:0/1437477200 >> v2:172.21.15.160:3300/0 conn(0x7f02a415b950 0x7f02a40ce130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:53.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.014+0000 7f02a892b700 1 -- 172.21.15.149:0/1437477200 >> v1:172.21.15.149:6789/0 conn(0x7f02a40cfd20 legacy=0x7f02a40d0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:53.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.014+0000 7f02a892b700 1 -- 172.21.15.149:0/1437477200 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a40ccb00 con 0x7f02a40cd5e0 2023-11-08T19:28:53.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.014+0000 7f029bfff700 1 -- 172.21.15.149:0/1437477200 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4119765925 0 0) 0x7f02a40cc2e0 con 0x7f02a40cfd20 2023-11-08T19:28:53.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.014+0000 7f02a912c700 1 --2- 172.21.15.149:0/1437477200 >> v2:172.21.15.160:3300/0 conn(0x7f02a415b950 0x7f02a40ce130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:28:53.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.014+0000 7f02a892b700 1 --2- 172.21.15.149:0/1437477200 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02a40cd5e0 0x7f02a40ce670 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f02a4072960 tx=0x7f02a0009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=317907bfbbf4338c server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:53.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.014+0000 7f029bfff700 1 -- 172.21.15.149:0/1437477200 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a0011830 con 0x7f02a40cd5e0 2023-11-08T19:28:53.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.014+0000 7f029bfff700 1 -- 172.21.15.149:0/1437477200 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02a0011990 con 0x7f02a40cd5e0 2023-11-08T19:28:53.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.014+0000 7f029bfff700 1 -- 172.21.15.149:0/1437477200 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a0011d20 con 0x7f02a40cd5e0 2023-11-08T19:28:53.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.015+0000 7f02ab390700 1 -- 172.21.15.149:0/1437477200 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02a40cd5e0 msgr2=0x7f02a40ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:53.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.015+0000 7f02ab390700 1 --2- 172.21.15.149:0/1437477200 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02a40cd5e0 0x7f02a40ce670 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f02a4072960 tx=0x7f02a0009b20 comp rx=0 tx=0).stop 2023-11-08T19:28:53.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.015+0000 7f02ab390700 1 -- 172.21.15.149:0/1437477200 shutdown_connections 2023-11-08T19:28:53.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.015+0000 7f02ab390700 1 --2- 172.21.15.149:0/1437477200 >> v2:172.21.15.160:3300/0 conn(0x7f02a415b950 0x7f02a40ce130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:53.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.015+0000 7f02ab390700 1 --2- 172.21.15.149:0/1437477200 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02a40cd5e0 0x7f02a40ce670 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:53.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.015+0000 7f02ab390700 1 -- 172.21.15.149:0/1437477200 >> 172.21.15.149:0/1437477200 conn(0x7f02a408afd0 msgr2=0x7f02a40d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:53.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.015+0000 7f02ab390700 1 -- 172.21.15.149:0/1437477200 shutdown_connections 2023-11-08T19:28:53.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.015+0000 7f02ab390700 1 -- 172.21.15.149:0/1437477200 wait complete. 2023-11-08T19:28:53.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.016+0000 7f02ab390700 1 Processor -- start 2023-11-08T19:28:53.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.016+0000 7f02ab390700 1 -- start start 2023-11-08T19:28:53.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.017+0000 7f02ab390700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02a40cfd20 0x7f02a41f0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:53.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.017+0000 7f02ab390700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02a415b950 0x7f02a40b3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:53.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.017+0000 7f02ab390700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f02a40b3990 0x7f02a40c8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:53.032 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.017+0000 7f02ab390700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a40b3e10 con 0x7f02a415b950 2023-11-08T19:28:53.032 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.017+0000 7f02ab390700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a41f1060 con 0x7f02a40cfd20 2023-11-08T19:28:53.032 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.017+0000 7f02ab390700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02a41f6c80 con 0x7f02a40b3990 2023-11-08T19:28:53.032 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.017+0000 7f02a892b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02a415b950 0x7f02a40b3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:53.032 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.017+0000 7f02a892b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02a415b950 0x7f02a40b3450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44798/0 (socket says 172.21.15.149:44798) 2023-11-08T19:28:53.032 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.017+0000 7f02a892b700 1 -- 172.21.15.149:0/2214367102 learned_addr learned my addr 172.21.15.149:0/2214367102 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:28:53.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.017+0000 7f02a912c700 1 --2- 172.21.15.149:0/2214367102 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02a40cfd20 0x7f02a41f0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:53.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.017+0000 7f02a992d700 1 --2- 172.21.15.149:0/2214367102 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f02a40b3990 0x7f02a40c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:53.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.017+0000 7f02a892b700 1 -- 172.21.15.149:0/2214367102 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f02a40b3990 msgr2=0x7f02a40c8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:53.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.017+0000 7f02a892b700 1 --2- 172.21.15.149:0/2214367102 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f02a40b3990 0x7f02a40c8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:53.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.017+0000 7f02a892b700 1 -- 172.21.15.149:0/2214367102 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02a40cfd20 msgr2=0x7f02a41f0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:53.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.017+0000 7f02a892b700 1 --2- 172.21.15.149:0/2214367102 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02a40cfd20 0x7f02a41f0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:53.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.017+0000 7f02a892b700 1 -- 172.21.15.149:0/2214367102 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a00094a0 con 0x7f02a415b950 2023-11-08T19:28:53.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.017+0000 7f02a992d700 1 --2- 172.21.15.149:0/2214367102 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f02a40b3990 0x7f02a40c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:28:53.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.017+0000 7f02a892b700 1 --2- 172.21.15.149:0/2214367102 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02a415b950 0x7f02a40b3450 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f02a00090b0 tx=0x7f02a0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:53.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.017+0000 7f0299ffb700 1 -- 172.21.15.149:0/2214367102 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a00038a0 con 0x7f02a415b950 2023-11-08T19:28:53.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.017+0000 7f0299ffb700 1 -- 172.21.15.149:0/2214367102 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02a001f070 con 0x7f02a415b950 2023-11-08T19:28:53.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.017+0000 7f0299ffb700 1 -- 172.21.15.149:0/2214367102 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a0003c20 con 0x7f02a415b950 2023-11-08T19:28:53.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.017+0000 7f02ab390700 1 -- 172.21.15.149:0/2214367102 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02a41f6f20 con 0x7f02a415b950 2023-11-08T19:28:53.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.018+0000 7f02ab390700 1 -- 172.21.15.149:0/2214367102 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02a41f74e0 con 0x7f02a415b950 2023-11-08T19:28:53.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.019+0000 7f02ab390700 1 -- 172.21.15.149:0/2214367102 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02a40745f0 con 0x7f02a415b950 2023-11-08T19:28:53.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.019+0000 7f0299ffb700 1 -- 172.21.15.149:0/2214367102 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f02a001a430 con 0x7f02a415b950 2023-11-08T19:28:53.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.019+0000 7f0299ffb700 1 --2- 172.21.15.149:0/2214367102 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f028806af00 0x7f028806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:53.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.020+0000 7f0299ffb700 1 -- 172.21.15.149:0/2214367102 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7436+0+0 (secure 0 0 0) 0x7f02a0021070 con 0x7f02a415b950 2023-11-08T19:28:53.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.020+0000 7f02a912c700 1 --2- 172.21.15.149:0/2214367102 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f028806af00 0x7f028806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:53.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.020+0000 7f02a912c700 1 --2- 172.21.15.149:0/2214367102 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f028806af00 0x7f028806d3c0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f02a40ce9e0 tx=0x7f0294008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:53.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.024+0000 7f0299ffb700 1 -- 172.21.15.149:0/2214367102 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f02a00560f0 con 0x7f02a415b950 2023-11-08T19:28:53.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.257+0000 7f02ab390700 1 -- 172.21.15.149:0/2214367102 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f02a408b760 con 0x7f02a415b950 2023-11-08T19:28:53.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.258+0000 7f0299ffb700 1 -- 172.21.15.149:0/2214367102 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4938 (secure 0 0 0) 0x7f02a0059710 con 0x7f02a415b950 2023-11-08T19:28:53.261 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:28:53.262 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":84,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6095,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/852710262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":852710262},{"type":"v1","addr":"172.21.15.160:6835","nonce":852710262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64},{"gid":6236,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/1313631099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":1313631099},{"type":"v1","addr":"172.21.15.160:6834","nonce":1313631099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:28:35.605104+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7578,"mds_1":7125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7125":{"gid":7125,"name":"c","rank":1,"incarnation":57,"state":"up:active","state_seq":6,"addr":"172.21.15.149:6837/3917392643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3917392643},{"type":"v1","addr":"172.21.15.149:6837","nonce":3917392643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7578":{"gid":7578,"name":"a","rank":0,"incarnation":79,"state":"up:active","state_seq":11,"addr":"172.21.15.149:6836/295381437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":295381437},{"type":"v1","addr":"172.21.15.149:6836","nonce":295381437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:28:53.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.260+0000 7f02ab390700 1 -- 172.21.15.149:0/2214367102 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f028806af00 msgr2=0x7f028806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:53.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.260+0000 7f02ab390700 1 --2- 172.21.15.149:0/2214367102 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f028806af00 0x7f028806d3c0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f02a40ce9e0 tx=0x7f0294008040 comp rx=0 tx=0).stop 2023-11-08T19:28:53.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.260+0000 7f02ab390700 1 -- 172.21.15.149:0/2214367102 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02a415b950 msgr2=0x7f02a40b3450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:53.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.260+0000 7f02ab390700 1 --2- 172.21.15.149:0/2214367102 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02a415b950 0x7f02a40b3450 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f02a00090b0 tx=0x7f02a0004750 comp rx=0 tx=0).stop 2023-11-08T19:28:53.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.260+0000 7f02ab390700 1 -- 172.21.15.149:0/2214367102 shutdown_connections 2023-11-08T19:28:53.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.260+0000 7f02ab390700 1 --2- 172.21.15.149:0/2214367102 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f028806af00 0x7f028806d3c0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:53.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.260+0000 7f02ab390700 1 --2- 172.21.15.149:0/2214367102 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02a40cfd20 0x7f02a41f0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:53.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.260+0000 7f02ab390700 1 --2- 172.21.15.149:0/2214367102 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f02a40b3990 0x7f02a40c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:53.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.260+0000 7f02ab390700 1 --2- 172.21.15.149:0/2214367102 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02a415b950 0x7f02a40b3450 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:53.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.260+0000 7f02ab390700 1 -- 172.21.15.149:0/2214367102 >> 172.21.15.149:0/2214367102 conn(0x7f02a408afd0 msgr2=0x7f02a40af450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:53.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.260+0000 7f02ab390700 1 -- 172.21.15.149:0/2214367102 shutdown_connections 2023-11-08T19:28:53.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:53.260+0000 7f02ab390700 1 -- 172.21.15.149:0/2214367102 wait complete. 2023-11-08T19:28:53.268 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 84 2023-11-08T19:28:53.275 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-08T19:28:58.087 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~13s 2023-11-08T19:28:58.277 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:28:58.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.411+0000 7f9d94b65700 1 Processor -- start 2023-11-08T19:28:58.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.411+0000 7f9d94b65700 1 -- start start 2023-11-08T19:28:58.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.412+0000 7f9d94b65700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9d900b2700 0x7f9d900cfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:58.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.412+0000 7f9d94b65700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d90072df0 con 0x7f9d9006f7e0 2023-11-08T19:28:58.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.412+0000 7f9d94b65700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d90070660 con 0x7f9d9015a780 2023-11-08T19:28:58.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.412+0000 7f9d94b65700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9006fdc0 con 0x7f9d900b2700 2023-11-08T19:28:58.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.412+0000 7f9d8dd9b700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f9d9006f7e0 0x7f9d900b1ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:46812/0 (socket says 172.21.15.149:46812) 2023-11-08T19:28:58.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.412+0000 7f9d8dd9b700 1 -- 172.21.15.149:0/1816019285 learned_addr learned my addr 172.21.15.149:0/1816019285 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:28:58.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.412+0000 7f9d8ed9d700 1 --2- 172.21.15.149:0/1816019285 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9d900b2700 0x7f9d900cfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:58.417 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.413+0000 7f9d8d59a700 1 -- 172.21.15.149:0/1816019285 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 522657139 0 0) 0x7f9d90072df0 con 0x7f9d9006f7e0 2023-11-08T19:28:58.417 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.413+0000 7f9d8d59a700 1 -- 172.21.15.149:0/1816019285 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d780035b0 con 0x7f9d9006f7e0 2023-11-08T19:28:58.417 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.413+0000 7f9d8d59a700 1 -- 172.21.15.149:0/1816019285 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2570755429 0 0) 0x7f9d90070660 con 0x7f9d9015a780 2023-11-08T19:28:58.417 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.413+0000 7f9d8d59a700 1 -- 172.21.15.149:0/1816019285 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d90072df0 con 0x7f9d9015a780 2023-11-08T19:28:58.417 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.413+0000 7f9d8ed9d700 1 -- 172.21.15.149:0/1816019285 >> v1:172.21.15.160:6789/0 conn(0x7f9d9015a780 legacy=0x7f9d9015ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:58.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.413+0000 7f9d8ed9d700 1 -- 172.21.15.149:0/1816019285 >> v1:172.21.15.149:6789/0 conn(0x7f9d9006f7e0 legacy=0x7f9d900b1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:58.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.413+0000 7f9d8ed9d700 1 -- 172.21.15.149:0/1816019285 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d900700a0 con 0x7f9d900b2700 2023-11-08T19:28:58.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.413+0000 7f9d8ed9d700 1 --2- 172.21.15.149:0/1816019285 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9d900b2700 0x7f9d900cfce0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9d88009dc0 tx=0x7f9d8800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45839c667114b57 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:58.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.413+0000 7f9d8d59a700 1 -- 172.21.15.149:0/1816019285 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8800e070 con 0x7f9d900b2700 2023-11-08T19:28:58.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.413+0000 7f9d8d59a700 1 -- 172.21.15.149:0/1816019285 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d8800bb20 con 0x7f9d900b2700 2023-11-08T19:28:58.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.413+0000 7f9d8d59a700 1 -- 172.21.15.149:0/1816019285 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d88012430 con 0x7f9d900b2700 2023-11-08T19:28:58.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.414+0000 7f9d94b65700 1 -- 172.21.15.149:0/1816019285 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9d900b2700 msgr2=0x7f9d900cfce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:58.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.414+0000 7f9d94b65700 1 --2- 172.21.15.149:0/1816019285 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9d900b2700 0x7f9d900cfce0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9d88009dc0 tx=0x7f9d8800b330 comp rx=0 tx=0).stop 2023-11-08T19:28:58.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.414+0000 7f9d94b65700 1 -- 172.21.15.149:0/1816019285 shutdown_connections 2023-11-08T19:28:58.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.414+0000 7f9d94b65700 1 --2- 172.21.15.149:0/1816019285 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9d900b2700 0x7f9d900cfce0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:58.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.414+0000 7f9d94b65700 1 -- 172.21.15.149:0/1816019285 >> 172.21.15.149:0/1816019285 conn(0x7f9d900ccff0 msgr2=0x7f9d900cd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:58.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.414+0000 7f9d94b65700 1 -- 172.21.15.149:0/1816019285 shutdown_connections 2023-11-08T19:28:58.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.414+0000 7f9d94b65700 1 -- 172.21.15.149:0/1816019285 wait complete. 2023-11-08T19:28:58.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.415+0000 7f9d94b65700 1 Processor -- start 2023-11-08T19:28:58.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.415+0000 7f9d94b65700 1 -- start start 2023-11-08T19:28:58.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.416+0000 7f9d94b65700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9d9006f7e0 0x7f9d901ef2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:58.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.416+0000 7f9d94b65700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d900b2700 0x7f9d900c3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:58.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.416+0000 7f9d94b65700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9d9015a780 0x7f9d900c6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:58.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.416+0000 7f9d94b65700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d900c4250 con 0x7f9d900b2700 2023-11-08T19:28:58.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.416+0000 7f9d94b65700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d900c44f0 con 0x7f9d9015a780 2023-11-08T19:28:58.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.416+0000 7f9d94b65700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d900c47d0 con 0x7f9d9006f7e0 2023-11-08T19:28:58.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.416+0000 7f9d8dd9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d900b2700 0x7f9d900c3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:58.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.416+0000 7f9d8dd9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d900b2700 0x7f9d900c3d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44816/0 (socket says 172.21.15.149:44816) 2023-11-08T19:28:58.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.416+0000 7f9d8dd9b700 1 -- 172.21.15.149:0/3361164616 learned_addr learned my addr 172.21.15.149:0/3361164616 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:28:58.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.416+0000 7f9d8ed9d700 1 --2- 172.21.15.149:0/3361164616 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9d9015a780 0x7f9d900c6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:58.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.416+0000 7f9d8e59c700 1 --2- 172.21.15.149:0/3361164616 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9d9006f7e0 0x7f9d901ef2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:58.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.416+0000 7f9d8dd9b700 1 -- 172.21.15.149:0/3361164616 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9d9006f7e0 msgr2=0x7f9d901ef2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:58.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.416+0000 7f9d8dd9b700 1 --2- 172.21.15.149:0/3361164616 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9d9006f7e0 0x7f9d901ef2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:58.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.416+0000 7f9d8dd9b700 1 -- 172.21.15.149:0/3361164616 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9d9015a780 msgr2=0x7f9d900c6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:58.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.416+0000 7f9d8dd9b700 1 --2- 172.21.15.149:0/3361164616 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9d9015a780 0x7f9d900c6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:58.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.416+0000 7f9d8dd9b700 1 -- 172.21.15.149:0/3361164616 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d88009a70 con 0x7f9d900b2700 2023-11-08T19:28:58.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.417+0000 7f9d8dd9b700 1 --2- 172.21.15.149:0/3361164616 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d900b2700 0x7f9d900c3d10 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f9d80001eb0 tx=0x7f9d8000c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:58.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.417+0000 7f9d7effd700 1 -- 172.21.15.149:0/3361164616 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d80005d70 con 0x7f9d900b2700 2023-11-08T19:28:58.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.417+0000 7f9d7effd700 1 -- 172.21.15.149:0/3361164616 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d800070d0 con 0x7f9d900b2700 2023-11-08T19:28:58.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.417+0000 7f9d94b65700 1 -- 172.21.15.149:0/3361164616 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d900c4ab0 con 0x7f9d900b2700 2023-11-08T19:28:58.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.417+0000 7f9d7effd700 1 -- 172.21.15.149:0/3361164616 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d80007460 con 0x7f9d900b2700 2023-11-08T19:28:58.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.417+0000 7f9d94b65700 1 -- 172.21.15.149:0/3361164616 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d900c5070 con 0x7f9d900b2700 2023-11-08T19:28:58.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.418+0000 7f9d94b65700 1 -- 172.21.15.149:0/3361164616 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d900b1c00 con 0x7f9d900b2700 2023-11-08T19:28:58.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.418+0000 7f9d7effd700 1 -- 172.21.15.149:0/3361164616 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9d800075c0 con 0x7f9d900b2700 2023-11-08T19:28:58.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.419+0000 7f9d7effd700 1 --2- 172.21.15.149:0/3361164616 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9d7006af00 0x7f9d7006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:58.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.419+0000 7f9d8e59c700 1 --2- 172.21.15.149:0/3361164616 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9d7006af00 0x7f9d7006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:58.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.419+0000 7f9d7effd700 1 -- 172.21.15.149:0/3361164616 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7436+0+0 (secure 0 0 0) 0x7f9d80088fe0 con 0x7f9d900b2700 2023-11-08T19:28:58.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.419+0000 7f9d8e59c700 1 --2- 172.21.15.149:0/3361164616 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9d7006af00 0x7f9d7006d3c0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f9d840011e0 tx=0x7f9d84009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:58.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.424+0000 7f9d7effd700 1 -- 172.21.15.149:0/3361164616 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9d80053a60 con 0x7f9d900b2700 2023-11-08T19:28:58.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.658+0000 7f9d94b65700 1 -- 172.21.15.149:0/3361164616 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9d900745f0 con 0x7f9d900b2700 2023-11-08T19:28:58.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.659+0000 7f9d7effd700 1 -- 172.21.15.149:0/3361164616 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4986 (secure 0 0 0) 0x7f9d80057080 con 0x7f9d900b2700 2023-11-08T19:28:58.660 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:28:58.660 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":85,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6095,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/852710262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":852710262},{"type":"v1","addr":"172.21.15.160:6835","nonce":852710262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64},{"gid":6236,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/1313631099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":1313631099},{"type":"v1","addr":"172.21.15.160:6834","nonce":1313631099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:28:54.149012+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7578,"mds_1":7125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7125":{"gid":7125,"name":"c","rank":1,"incarnation":57,"state":"up:active","state_seq":6,"addr":"172.21.15.149:6837/3917392643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3917392643},{"type":"v1","addr":"172.21.15.149:6837","nonce":3917392643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7578":{"gid":7578,"name":"a","rank":0,"incarnation":79,"state":"up:active","state_seq":11,"addr":"172.21.15.149:6836/295381437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":295381437},{"type":"v1","addr":"172.21.15.149:6836","nonce":295381437}]},"join_fscid":-1,"laggy_since":"2023-11-08T19:28:54.149012+0000","export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:28:58.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.661+0000 7f9d94b65700 1 -- 172.21.15.149:0/3361164616 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9d7006af00 msgr2=0x7f9d7006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:58.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.661+0000 7f9d94b65700 1 --2- 172.21.15.149:0/3361164616 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9d7006af00 0x7f9d7006d3c0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f9d840011e0 tx=0x7f9d84009040 comp rx=0 tx=0).stop 2023-11-08T19:28:58.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.661+0000 7f9d94b65700 1 -- 172.21.15.149:0/3361164616 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d900b2700 msgr2=0x7f9d900c3d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:58.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.661+0000 7f9d94b65700 1 --2- 172.21.15.149:0/3361164616 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d900b2700 0x7f9d900c3d10 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f9d80001eb0 tx=0x7f9d8000c7b0 comp rx=0 tx=0).stop 2023-11-08T19:28:58.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.661+0000 7f9d94b65700 1 -- 172.21.15.149:0/3361164616 shutdown_connections 2023-11-08T19:28:58.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.661+0000 7f9d94b65700 1 --2- 172.21.15.149:0/3361164616 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9d7006af00 0x7f9d7006d3c0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:58.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.661+0000 7f9d94b65700 1 --2- 172.21.15.149:0/3361164616 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9d9015a780 0x7f9d900c6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:58.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.661+0000 7f9d94b65700 1 --2- 172.21.15.149:0/3361164616 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9d9006f7e0 0x7f9d901ef2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:58.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.661+0000 7f9d94b65700 1 --2- 172.21.15.149:0/3361164616 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d900b2700 0x7f9d900c3d10 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:58.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.661+0000 7f9d94b65700 1 -- 172.21.15.149:0/3361164616 >> 172.21.15.149:0/3361164616 conn(0x7f9d900ccff0 msgr2=0x7f9d900af8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:58.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.661+0000 7f9d94b65700 1 -- 172.21.15.149:0/3361164616 shutdown_connections 2023-11-08T19:28:58.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:58.661+0000 7f9d94b65700 1 -- 172.21.15.149:0/3361164616 wait complete. 2023-11-08T19:28:58.665 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 85 2023-11-08T19:28:58.675 DEBUG:tasks.ceph_test_case:wait_until_true: success in 20s and 0 retries 2023-11-08T19:28:58.675 DEBUG:teuthology.orchestra.run.smithi149:> sudo sysctl -n kernel.core_pattern 2023-11-08T19:28:58.702 INFO:teuthology.orchestra.run.smithi149.stdout:/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-08T19:28:58.703 INFO:tasks.cephfs.cephfs_test_case:Clearing core from directory: /home/ubuntu/cephtest/archive/coredump 2023-11-08T19:28:58.703 DEBUG:teuthology.orchestra.run.smithi149:> cd /home/ubuntu/cephtest/archive/coredump && sudo ls | sudo xargs file 2023-11-08T19:28:58.772 INFO:teuthology.orchestra.run.smithi149.stdout:1699471720.137907.core: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i a', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/bin/ceph-mds', platform: 'x86_64' 2023-11-08T19:28:58.774 INFO:tasks.cephfs.cephfs_test_case:Enumerated cores: ['1699471720.137907.core'] 2023-11-08T19:28:58.774 INFO:tasks.cephfs.cephfs_test_case:Found core file 1699471720.137907.core, deleting it 2023-11-08T19:28:58.775 DEBUG:teuthology.orchestra.run.smithi149:> cd /home/ubuntu/cephtest/archive/coredump && sudo rm -f 1699471720.137907.core 2023-11-08T19:28:58.843 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 6:0 2023-11-08T19:28:59.005 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.003+0000 7f536deff700 1 Processor -- start 2023-11-08T19:28:59.005 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.003+0000 7f536deff700 1 -- start start 2023-11-08T19:28:59.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.004+0000 7f536deff700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f53680cc140 0x7f53680cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:59.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.004+0000 7f536deff700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53680cce50 con 0x7f53680b2cd0 2023-11-08T19:28:59.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.004+0000 7f536deff700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53680cc520 con 0x7f53680b2850 2023-11-08T19:28:59.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.004+0000 7f536deff700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53680b2430 con 0x7f53680cc140 2023-11-08T19:28:59.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.004+0000 7f5367fff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f53680b2cd0 0x7f536815d2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:46824/0 (socket says 172.21.15.149:46824) 2023-11-08T19:28:59.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.004+0000 7f5367fff700 1 -- 172.21.15.149:0/714508889 learned_addr learned my addr 172.21.15.149:0/714508889 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:28:59.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.005+0000 7f53677fe700 1 --2- 172.21.15.149:0/714508889 >> v2:172.21.15.160:3300/0 conn(0x7f53680cc140 0x7f53680cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:59.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.005+0000 7f53667fc700 1 -- 172.21.15.149:0/714508889 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2329395710 0 0) 0x7f53680cce50 con 0x7f53680b2cd0 2023-11-08T19:28:59.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.005+0000 7f53667fc700 1 -- 172.21.15.149:0/714508889 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53540035b0 con 0x7f53680b2cd0 2023-11-08T19:28:59.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.005+0000 7f53667fc700 1 -- 172.21.15.149:0/714508889 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4270556639 0 0) 0x7f53540035b0 con 0x7f53680b2cd0 2023-11-08T19:28:59.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.005+0000 7f53667fc700 1 -- 172.21.15.149:0/714508889 >> v2:172.21.15.160:3300/0 conn(0x7f53680cc140 msgr2=0x7f53680cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:59.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.005+0000 7f53667fc700 1 --2- 172.21.15.149:0/714508889 >> v2:172.21.15.160:3300/0 conn(0x7f53680cc140 0x7f53680cc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:59.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.005+0000 7f53667fc700 1 -- 172.21.15.149:0/714508889 >> v1:172.21.15.160:6789/0 conn(0x7f53680b2850 legacy=0x7f53680cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:59.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.005+0000 7f53667fc700 1 -- 172.21.15.149:0/714508889 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53680b17b0 con 0x7f53680b2cd0 2023-11-08T19:28:59.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.005+0000 7f53667fc700 1 -- 172.21.15.149:0/714508889 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f53600019f0 con 0x7f53680b2cd0 2023-11-08T19:28:59.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.005+0000 7f53667fc700 1 -- 172.21.15.149:0/714508889 >> v1:172.21.15.149:6789/0 conn(0x7f53680b2cd0 legacy=0x7f536815d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:59.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.005+0000 7f53667fc700 1 --2- 172.21.15.149:0/714508889 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5354003a00 0x7f5354003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:59.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.005+0000 7f53667fc700 1 --2- 172.21.15.149:0/714508889 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5354004850 0x7f5354004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:59.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.005+0000 7f53667fc700 1 --2- 172.21.15.149:0/714508889 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5354005210 0x7f535400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:59.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.005+0000 7f53667fc700 1 -- 172.21.15.149:0/714508889 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53680b2430 con 0x7f5354004850 2023-11-08T19:28:59.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.005+0000 7f53667fc700 1 -- 172.21.15.149:0/714508889 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f535400c0b0 con 0x7f5354003a00 2023-11-08T19:28:59.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.005+0000 7f53667fc700 1 -- 172.21.15.149:0/714508889 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f535400c270 con 0x7f5354005210 2023-11-08T19:28:59.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.005+0000 7f5366ffd700 1 --2- 172.21.15.149:0/714508889 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5354004850 0x7f5354004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:59.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.005+0000 7f53677fe700 1 --2- 172.21.15.149:0/714508889 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5354003a00 0x7f5354003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:59.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.005+0000 7f5367fff700 1 --2- 172.21.15.149:0/714508889 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5354005210 0x7f535400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:59.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.005+0000 7f5366ffd700 1 -- 172.21.15.149:0/714508889 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5354005210 msgr2=0x7f535400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:59.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.005+0000 7f5366ffd700 1 --2- 172.21.15.149:0/714508889 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5354005210 0x7f535400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:59.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.006+0000 7f5366ffd700 1 -- 172.21.15.149:0/714508889 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5354003a00 msgr2=0x7f5354003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:59.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.006+0000 7f5366ffd700 1 --2- 172.21.15.149:0/714508889 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5354003a00 0x7f5354003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:59.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.006+0000 7f5366ffd700 1 -- 172.21.15.149:0/714508889 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53540035b0 con 0x7f5354004850 2023-11-08T19:28:59.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.006+0000 7f5367fff700 1 -- 172.21.15.149:0/714508889 reap_dead start 2023-11-08T19:28:59.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.006+0000 7f5366ffd700 1 --2- 172.21.15.149:0/714508889 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5354004850 0x7f5354004cd0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f53580017c0 tx=0x7f5354005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de5f2493773b81b9 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:59.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.006+0000 7f53667fc700 1 -- 172.21.15.149:0/714508889 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53580052d0 con 0x7f5354004850 2023-11-08T19:28:59.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.006+0000 7f53667fc700 1 -- 172.21.15.149:0/714508889 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5358005450 con 0x7f5354004850 2023-11-08T19:28:59.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.006+0000 7f53667fc700 1 -- 172.21.15.149:0/714508889 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53580038c0 con 0x7f5354004850 2023-11-08T19:28:59.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.006+0000 7f536deff700 1 -- 172.21.15.149:0/714508889 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5354004850 msgr2=0x7f5354004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:59.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.006+0000 7f536deff700 1 --2- 172.21.15.149:0/714508889 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5354004850 0x7f5354004cd0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f53580017c0 tx=0x7f5354005880 comp rx=0 tx=0).stop 2023-11-08T19:28:59.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.006+0000 7f536deff700 1 -- 172.21.15.149:0/714508889 shutdown_connections 2023-11-08T19:28:59.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.006+0000 7f536deff700 1 --2- 172.21.15.149:0/714508889 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5354004850 0x7f5354004cd0 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:59.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.006+0000 7f536deff700 1 -- 172.21.15.149:0/714508889 >> 172.21.15.149:0/714508889 conn(0x7f5368099a40 msgr2=0x7f53680d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:59.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.006+0000 7f536deff700 1 -- 172.21.15.149:0/714508889 shutdown_connections 2023-11-08T19:28:59.018 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.006+0000 7f536deff700 1 -- 172.21.15.149:0/714508889 wait complete. 2023-11-08T19:28:59.020 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.009+0000 7f536deff700 1 Processor -- start 2023-11-08T19:28:59.020 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.009+0000 7f536deff700 1 -- start start 2023-11-08T19:28:59.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.010+0000 7f536deff700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5354004850 0x7f536815edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:59.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.010+0000 7f536deff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53680b4a70 0x7f53680b0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:59.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.010+0000 7f536deff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53680b08a0 0x7f536815fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:59.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.010+0000 7f536deff700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53680aeb50 con 0x7f53680b08a0 2023-11-08T19:28:59.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.010+0000 7f536deff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53681f4630 con 0x7f53680b4a70 2023-11-08T19:28:59.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.010+0000 7f536deff700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53681f3a20 con 0x7f5354004850 2023-11-08T19:28:59.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.010+0000 7f5367fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53680b08a0 0x7f536815fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:59.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.010+0000 7f5367fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53680b08a0 0x7f536815fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44836/0 (socket says 172.21.15.149:44836) 2023-11-08T19:28:59.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.010+0000 7f5367fff700 1 -- 172.21.15.149:0/37031781 learned_addr learned my addr 172.21.15.149:0/37031781 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:28:59.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.010+0000 7f5367fff700 1 -- 172.21.15.149:0/37031781 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5354004850 msgr2=0x7f536815edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:59.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.010+0000 7f5366ffd700 1 --2- 172.21.15.149:0/37031781 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53680b4a70 0x7f53680b0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:59.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.010+0000 7f53677fe700 1 --2- 172.21.15.149:0/37031781 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5354004850 0x7f536815edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:59.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.010+0000 7f5367fff700 1 --2- 172.21.15.149:0/37031781 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5354004850 0x7f536815edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:59.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.010+0000 7f5367fff700 1 -- 172.21.15.149:0/37031781 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53680b4a70 msgr2=0x7f53680b0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:59.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.010+0000 7f5367fff700 1 --2- 172.21.15.149:0/37031781 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53680b4a70 0x7f53680b0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:59.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.010+0000 7f5367fff700 1 -- 172.21.15.149:0/37031781 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53681f3d00 con 0x7f53680b08a0 2023-11-08T19:28:59.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.010+0000 7f53677fe700 1 --2- 172.21.15.149:0/37031781 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5354004850 0x7f536815edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:28:59.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.010+0000 7f5367fff700 1 --2- 172.21.15.149:0/37031781 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53680b08a0 0x7f536815fa70 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f53680b3100 tx=0x7f5360007c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:59.025 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.010+0000 7f535ffff700 1 -- 172.21.15.149:0/37031781 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5360017070 con 0x7f53680b08a0 2023-11-08T19:28:59.025 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.010+0000 7f535ffff700 1 -- 172.21.15.149:0/37031781 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f536000ecb0 con 0x7f53680b08a0 2023-11-08T19:28:59.025 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.010+0000 7f536deff700 1 -- 172.21.15.149:0/37031781 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53681f3fe0 con 0x7f53680b08a0 2023-11-08T19:28:59.025 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.011+0000 7f535ffff700 1 -- 172.21.15.149:0/37031781 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f536000ee40 con 0x7f53680b08a0 2023-11-08T19:28:59.025 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.011+0000 7f536deff700 1 -- 172.21.15.149:0/37031781 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53680b4ef0 con 0x7f53680b08a0 2023-11-08T19:28:59.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.012+0000 7f536deff700 1 -- 172.21.15.149:0/37031781 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53680b1230 con 0x7f53680b08a0 2023-11-08T19:28:59.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.012+0000 7f535ffff700 1 -- 172.21.15.149:0/37031781 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5360013420 con 0x7f53680b08a0 2023-11-08T19:28:59.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.012+0000 7f535ffff700 1 --2- 172.21.15.149:0/37031781 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f534806af00 0x7f534806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:59.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.012+0000 7f535ffff700 1 -- 172.21.15.149:0/37031781 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7436+0+0 (secure 0 0 0) 0x7f5360089a40 con 0x7f53680b08a0 2023-11-08T19:28:59.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.012+0000 7f53677fe700 1 --2- 172.21.15.149:0/37031781 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f534806af00 0x7f534806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:59.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.013+0000 7f53677fe700 1 --2- 172.21.15.149:0/37031781 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f534806af00 0x7f534806d3c0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f53680afd00 tx=0x7f5350008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:59.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.017+0000 7f535ffff700 1 -- 172.21.15.149:0/37031781 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f536008be60 con 0x7f53680b08a0 2023-11-08T19:28:59.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.292+0000 7f536deff700 1 -- 172.21.15.149:0/37031781 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "6:0"} v 0) v1 -- 0x7f53680745f0 con 0x7f53680b08a0 2023-11-08T19:28:59.295 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.294+0000 7f535ffff700 1 -- 172.21.15.149:0/37031781 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "6:0"}]=0 failed mds gid 7578 v86) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5360057ec0 con 0x7f53680b08a0 2023-11-08T19:28:59.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.297+0000 7f536deff700 1 -- 172.21.15.149:0/37031781 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f534806af00 msgr2=0x7f534806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:59.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.297+0000 7f536deff700 1 --2- 172.21.15.149:0/37031781 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f534806af00 0x7f534806d3c0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f53680afd00 tx=0x7f5350008040 comp rx=0 tx=0).stop 2023-11-08T19:28:59.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.297+0000 7f536deff700 1 -- 172.21.15.149:0/37031781 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53680b08a0 msgr2=0x7f536815fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:59.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.297+0000 7f536deff700 1 --2- 172.21.15.149:0/37031781 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53680b08a0 0x7f536815fa70 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f53680b3100 tx=0x7f5360007c90 comp rx=0 tx=0).stop 2023-11-08T19:28:59.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.298+0000 7f536deff700 1 -- 172.21.15.149:0/37031781 shutdown_connections 2023-11-08T19:28:59.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.298+0000 7f536deff700 1 --2- 172.21.15.149:0/37031781 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f534806af00 0x7f534806d3c0 secure :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f53680afd00 tx=0x7f5350008040 comp rx=0 tx=0).stop 2023-11-08T19:28:59.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.298+0000 7f536deff700 1 --2- 172.21.15.149:0/37031781 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53680b08a0 0x7f536815fa70 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:59.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.298+0000 7f536deff700 1 --2- 172.21.15.149:0/37031781 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5354004850 0x7f536815edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:59.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.298+0000 7f536deff700 1 --2- 172.21.15.149:0/37031781 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53680b4a70 0x7f53680b0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:59.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.298+0000 7f536deff700 1 -- 172.21.15.149:0/37031781 >> 172.21.15.149:0/37031781 conn(0x7f5368099a40 msgr2=0x7f53680c7700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:59.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.298+0000 7f536deff700 1 -- 172.21.15.149:0/37031781 shutdown_connections 2023-11-08T19:28:59.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.298+0000 7f536deff700 1 -- 172.21.15.149:0/37031781 wait complete. 2023-11-08T19:28:59.301 INFO:teuthology.orchestra.run.smithi149.stderr:failed mds gid 7578 2023-11-08T19:28:59.314 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-08T19:28:59.315 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-08T19:28:59.315 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-08T19:28:59.316 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T19:28:59.316 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-08T19:28:59.316 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi149 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a' 2023-11-08T19:28:59.317 INFO:tasks.ceph.mds.a:Stopped 2023-11-08T19:28:59.317 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-08T19:28:59.320 INFO:tasks.ceph.mds.a:Started 2023-11-08T19:28:59.320 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:28:59.398 INFO:tasks.ceph.mds.a.smithi149.stdout:starting mds.a at 2023-11-08T19:28:59.444 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.442+0000 7f363157a700 1 Processor -- start 2023-11-08T19:28:59.444 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.443+0000 7f363157a700 1 -- start start 2023-11-08T19:28:59.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.444+0000 7f363157a700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f362c15b950 0x7f362c0cc290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:59.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.444+0000 7f363157a700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f362c15bd30 con 0x7f362c0d0fe0 2023-11-08T19:28:59.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.444+0000 7f363157a700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f362c0c7670 con 0x7f362c0c9690 2023-11-08T19:28:59.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.444+0000 7f363157a700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f362c0caa90 con 0x7f362c15b950 2023-11-08T19:28:59.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.444+0000 7f362a7fc700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f362c0d0fe0 0x7f362c15f440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:46856/0 (socket says 172.21.15.149:46856) 2023-11-08T19:28:59.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.444+0000 7f362a7fc700 1 -- 172.21.15.149:0/4069824477 learned_addr learned my addr 172.21.15.149:0/4069824477 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:28:59.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.444+0000 7f3629ffb700 1 -- 172.21.15.149:0/4069824477 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 793193090 0 0) 0x7f362c15bd30 con 0x7f362c0d0fe0 2023-11-08T19:28:59.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.444+0000 7f3629ffb700 1 -- 172.21.15.149:0/4069824477 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36140035b0 con 0x7f362c0d0fe0 2023-11-08T19:28:59.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.444+0000 7f362affd700 1 --2- 172.21.15.149:0/4069824477 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f362c15b950 0x7f362c0cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:59.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.444+0000 7f3629ffb700 1 -- 172.21.15.149:0/4069824477 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 505332514 0 0) 0x7f36140035b0 con 0x7f362c0d0fe0 2023-11-08T19:28:59.450 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.444+0000 7f3629ffb700 1 -- 172.21.15.149:0/4069824477 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f362c15b950 msgr2=0x7f362c0cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:59.450 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.444+0000 7f3629ffb700 1 --2- 172.21.15.149:0/4069824477 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f362c15b950 0x7f362c0cc290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:59.450 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.444+0000 7f3629ffb700 1 -- 172.21.15.149:0/4069824477 >> v1:172.21.15.160:6789/0 conn(0x7f362c0c9690 legacy=0x7f362c15fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:59.450 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.444+0000 7f3629ffb700 1 -- 172.21.15.149:0/4069824477 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f362c0c81f0 con 0x7f362c0d0fe0 2023-11-08T19:28:59.450 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.444+0000 7f3629ffb700 1 -- 172.21.15.149:0/4069824477 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f361c001670 con 0x7f362c0d0fe0 2023-11-08T19:28:59.451 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.444+0000 7f3629ffb700 1 -- 172.21.15.149:0/4069824477 >> v1:172.21.15.149:6789/0 conn(0x7f362c0d0fe0 legacy=0x7f362c15f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:59.451 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.444+0000 7f3629ffb700 1 --2- 172.21.15.149:0/4069824477 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3614003a30 0x7f3614003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:59.451 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.444+0000 7f3629ffb700 1 --2- 172.21.15.149:0/4069824477 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f362c15b950 0x7f3614004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:59.451 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.444+0000 7f3629ffb700 1 --2- 172.21.15.149:0/4069824477 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3614004d90 0x7f3614005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:59.451 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.444+0000 7f3629ffb700 1 -- 172.21.15.149:0/4069824477 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f362c0caa90 con 0x7f3614004d90 2023-11-08T19:28:59.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.444+0000 7f3629ffb700 1 -- 172.21.15.149:0/4069824477 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f361400bba0 con 0x7f3614003a30 2023-11-08T19:28:59.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.444+0000 7f3629ffb700 1 -- 172.21.15.149:0/4069824477 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f361400bd30 con 0x7f362c15b950 2023-11-08T19:28:59.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.445+0000 7f362b7fe700 1 --2- 172.21.15.149:0/4069824477 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3614004d90 0x7f3614005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:59.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.445+0000 7f362affd700 1 --2- 172.21.15.149:0/4069824477 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3614003a30 0x7f3614003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:59.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.445+0000 7f362a7fc700 1 --2- 172.21.15.149:0/4069824477 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f362c15b950 0x7f3614004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:59.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.445+0000 7f362b7fe700 1 -- 172.21.15.149:0/4069824477 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f362c15b950 msgr2=0x7f3614004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:59.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.445+0000 7f362b7fe700 1 --2- 172.21.15.149:0/4069824477 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f362c15b950 0x7f3614004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:59.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.445+0000 7f362b7fe700 1 -- 172.21.15.149:0/4069824477 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3614003a30 msgr2=0x7f3614003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:28:59.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.445+0000 7f362b7fe700 1 --2- 172.21.15.149:0/4069824477 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3614003a30 0x7f3614003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:59.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.445+0000 7f362b7fe700 1 -- 172.21.15.149:0/4069824477 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36140035b0 con 0x7f3614004d90 2023-11-08T19:28:59.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.445+0000 7f362b7fe700 1 --2- 172.21.15.149:0/4069824477 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3614004d90 0x7f3614005210 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f362400c190 tx=0x7f3614005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c07c974f65768d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:59.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.445+0000 7f3629ffb700 1 -- 172.21.15.149:0/4069824477 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3624001db0 con 0x7f3614004d90 2023-11-08T19:28:59.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.445+0000 7f3629ffb700 1 -- 172.21.15.149:0/4069824477 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f362400cc90 con 0x7f3614004d90 2023-11-08T19:28:59.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.445+0000 7f3629ffb700 1 -- 172.21.15.149:0/4069824477 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3624003a00 con 0x7f3614004d90 2023-11-08T19:28:59.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.446+0000 7f363157a700 1 -- 172.21.15.149:0/4069824477 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3614004d90 msgr2=0x7f3614005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:59.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.446+0000 7f363157a700 1 --2- 172.21.15.149:0/4069824477 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3614004d90 0x7f3614005210 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f362400c190 tx=0x7f3614005880 comp rx=0 tx=0).stop 2023-11-08T19:28:59.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.446+0000 7f362b7fe700 1 -- 172.21.15.149:0/4069824477 reap_dead start 2023-11-08T19:28:59.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.446+0000 7f363157a700 1 -- 172.21.15.149:0/4069824477 shutdown_connections 2023-11-08T19:28:59.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.446+0000 7f363157a700 1 -- 172.21.15.149:0/4069824477 >> 172.21.15.149:0/4069824477 conn(0x7f362c099a40 msgr2=0x7f362c0d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:59.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.446+0000 7f363157a700 1 -- 172.21.15.149:0/4069824477 shutdown_connections 2023-11-08T19:28:59.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.446+0000 7f363157a700 1 -- 172.21.15.149:0/4069824477 wait complete. 2023-11-08T19:28:59.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.447+0000 7f363157a700 1 Processor -- start 2023-11-08T19:28:59.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.447+0000 7f363157a700 1 -- start start 2023-11-08T19:28:59.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.448+0000 7f363157a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3614004d90 0x7f362c0c40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:59.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.448+0000 7f363157a700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f362c0cff50 0x7f362c14e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:59.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.448+0000 7f363157a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f362c0ce760 0x7f362c0b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:59.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.448+0000 7f363157a700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f362c157390 con 0x7f362c0ce760 2023-11-08T19:28:59.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.448+0000 7f363157a700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f362c0cf190 con 0x7f3614004d90 2023-11-08T19:28:59.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.448+0000 7f363157a700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f362c0cf470 con 0x7f362c0cff50 2023-11-08T19:28:59.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.448+0000 7f362b7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f362c0ce760 0x7f362c0b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:59.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.448+0000 7f362b7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f362c0ce760 0x7f362c0b15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44868/0 (socket says 172.21.15.149:44868) 2023-11-08T19:28:59.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.448+0000 7f362b7fe700 1 -- 172.21.15.149:0/426052827 learned_addr learned my addr 172.21.15.149:0/426052827 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:28:59.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.448+0000 7f362a7fc700 1 --2- 172.21.15.149:0/426052827 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f362c0cff50 0x7f362c14e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:59.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.448+0000 7f362affd700 1 --2- 172.21.15.149:0/426052827 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3614004d90 0x7f362c0c40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:59.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.448+0000 7f362b7fe700 1 -- 172.21.15.149:0/426052827 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f362c0cff50 msgr2=0x7f362c14e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:59.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.448+0000 7f362b7fe700 1 --2- 172.21.15.149:0/426052827 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f362c0cff50 0x7f362c14e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:59.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.448+0000 7f362b7fe700 1 -- 172.21.15.149:0/426052827 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3614004d90 msgr2=0x7f362c0c40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:59.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.448+0000 7f362b7fe700 1 --2- 172.21.15.149:0/426052827 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3614004d90 0x7f362c0c40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:59.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.448+0000 7f362b7fe700 1 -- 172.21.15.149:0/426052827 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f362c0cf750 con 0x7f362c0ce760 2023-11-08T19:28:59.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.448+0000 7f362affd700 1 --2- 172.21.15.149:0/426052827 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3614004d90 0x7f362c0c40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:28:59.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.448+0000 7f362b7fe700 1 --2- 172.21.15.149:0/426052827 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f362c0ce760 0x7f362c0b15d0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f3624001220 tx=0x7f36240014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:59.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.449+0000 7f36137fe700 1 -- 172.21.15.149:0/426052827 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3624003e10 con 0x7f362c0ce760 2023-11-08T19:28:59.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.449+0000 7f36137fe700 1 -- 172.21.15.149:0/426052827 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36240050d0 con 0x7f362c0ce760 2023-11-08T19:28:59.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.449+0000 7f363157a700 1 -- 172.21.15.149:0/426052827 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f362c0cfa30 con 0x7f362c0ce760 2023-11-08T19:28:59.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.449+0000 7f36137fe700 1 -- 172.21.15.149:0/426052827 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3624005480 con 0x7f362c0ce760 2023-11-08T19:28:59.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.449+0000 7f363157a700 1 -- 172.21.15.149:0/426052827 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f362c14eec0 con 0x7f362c0ce760 2023-11-08T19:28:59.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.449+0000 7f363157a700 1 -- 172.21.15.149:0/426052827 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f362c0cef00 con 0x7f362c0ce760 2023-11-08T19:28:59.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.450+0000 7f36137fe700 1 -- 172.21.15.149:0/426052827 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3624019070 con 0x7f362c0ce760 2023-11-08T19:28:59.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.450+0000 7f36137fe700 1 --2- 172.21.15.149:0/426052827 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f361806af00 0x7f361806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:28:59.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.451+0000 7f36137fe700 1 -- 172.21.15.149:0/426052827 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 7522+0+0 (secure 0 0 0) 0x7f362408b030 con 0x7f362c0ce760 2023-11-08T19:28:59.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.451+0000 7f362affd700 1 --2- 172.21.15.149:0/426052827 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f361806af00 0x7f361806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:28:59.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.451+0000 7f362affd700 1 --2- 172.21.15.149:0/426052827 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f361806af00 0x7f361806d3c0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f3620006fd0 tx=0x7f3620008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:28:59.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.455+0000 7f36137fe700 1 -- 172.21.15.149:0/426052827 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3624055b10 con 0x7f362c0ce760 2023-11-08T19:28:59.688 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.687+0000 7f363157a700 1 -- 172.21.15.149:0/426052827 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f362c0cfc20 con 0x7f362c0ce760 2023-11-08T19:28:59.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.687+0000 7f36137fe700 1 -- 172.21.15.149:0/426052827 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 87 v87) v1 ==== 94+0+4146 (secure 0 0 0) 0x7f3624059130 con 0x7f362c0ce760 2023-11-08T19:28:59.689 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:28:59.689 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":87,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6095,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/852710262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":852710262},{"type":"v1","addr":"172.21.15.160:6835","nonce":852710262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":87,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:28:59.298542+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6236,"mds_1":7125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6236":{"gid":6236,"name":"d","rank":0,"incarnation":87,"state":"up:replay","state_seq":1,"addr":"172.21.15.160:6834/1313631099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":1313631099},{"type":"v1","addr":"172.21.15.160:6834","nonce":1313631099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7125":{"gid":7125,"name":"c","rank":1,"incarnation":57,"state":"up:active","state_seq":6,"addr":"172.21.15.149:6837/3917392643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3917392643},{"type":"v1","addr":"172.21.15.149:6837","nonce":3917392643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:28:59.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.690+0000 7f363157a700 1 -- 172.21.15.149:0/426052827 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f361806af00 msgr2=0x7f361806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:59.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.690+0000 7f363157a700 1 --2- 172.21.15.149:0/426052827 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f361806af00 0x7f361806d3c0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f3620006fd0 tx=0x7f3620008040 comp rx=0 tx=0).stop 2023-11-08T19:28:59.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.690+0000 7f363157a700 1 -- 172.21.15.149:0/426052827 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f362c0ce760 msgr2=0x7f362c0b15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:28:59.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.690+0000 7f363157a700 1 --2- 172.21.15.149:0/426052827 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f362c0ce760 0x7f362c0b15d0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f3624001220 tx=0x7f36240014a0 comp rx=0 tx=0).stop 2023-11-08T19:28:59.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.690+0000 7f363157a700 1 -- 172.21.15.149:0/426052827 shutdown_connections 2023-11-08T19:28:59.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.690+0000 7f363157a700 1 --2- 172.21.15.149:0/426052827 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f361806af00 0x7f361806d3c0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:59.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.690+0000 7f363157a700 1 --2- 172.21.15.149:0/426052827 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3614004d90 0x7f362c0c40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:59.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.690+0000 7f363157a700 1 --2- 172.21.15.149:0/426052827 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f362c0ce760 0x7f362c0b15d0 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:59.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.690+0000 7f363157a700 1 --2- 172.21.15.149:0/426052827 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f362c0cff50 0x7f362c14e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:28:59.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.690+0000 7f363157a700 1 -- 172.21.15.149:0/426052827 >> 172.21.15.149:0/426052827 conn(0x7f362c099a40 msgr2=0x7f362c06b060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:28:59.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.690+0000 7f363157a700 1 -- 172.21.15.149:0/426052827 shutdown_connections 2023-11-08T19:28:59.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:28:59.690+0000 7f363157a700 1 -- 172.21.15.149:0/426052827 wait complete. 2023-11-08T19:28:59.694 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 87 2023-11-08T19:28:59.703 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-11-08T19:29:03.346 INFO:tasks.ceph.mds.d.smithi160.stderr:2023-11-08T19:29:03.345+0000 7fbfcc0e2700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-08T19:29:03.346 INFO:tasks.ceph.mds.d.smithi160.stderr:2023-11-08T19:29:03.345+0000 7fbfcc0e2700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-08T19:29:04.704 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:29:04.800 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-11-08T19:29:04.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:04.837+0000 7f9e6b373700 1 Processor -- start 2023-11-08T19:29:04.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:04.837+0000 7f9e6b373700 1 -- start start 2023-11-08T19:29:04.846 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:04.838+0000 7f9e6b373700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f9e640cc140 0x7f9e640cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:04.846 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:04.838+0000 7f9e6b373700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f9e640b2850 0x7f9e640cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:04.846 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:04.838+0000 7f9e6b373700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9e640b2cd0 0x7f9e640cb130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:04.846 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:04.838+0000 7f9e6b373700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e640b2430 con 0x7f9e640cc140 2023-11-08T19:29:04.847 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:04.838+0000 7f9e6b373700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e640cb670 con 0x7f9e640b2850 2023-11-08T19:29:04.847 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:04.838+0000 7f9e6b373700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e640cce50 con 0x7f9e640b2cd0 2023-11-08T19:29:04.847 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:04.838+0000 7f9e6910f700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f9e640cc140 0x7f9e640cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:04.847 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:04.838+0000 7f9e6910f700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f9e640cc140 0x7f9e640cc910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44876/0 (socket says 172.21.15.149:44876) 2023-11-08T19:29:04.847 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:04.838+0000 7f9e6910f700 1 -- 172.21.15.149:0/273801222 learned_addr learned my addr 172.21.15.149:0/273801222 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:04.848 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:04.839+0000 7f9e6910f700 1 -- 172.21.15.149:0/273801222 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9e640b2cd0 msgr2=0x7f9e640cb130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:04.848 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:04.839+0000 7f9e6910f700 1 --2- 172.21.15.149:0/273801222 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9e640b2cd0 0x7f9e640cb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:04.848 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:04.839+0000 7f9e6910f700 1 -- 172.21.15.149:0/273801222 >> v2:172.21.15.160:3300/0 conn(0x7f9e640b2850 msgr2=0x7f9e640cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:04.848 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:04.839+0000 7f9e6890e700 1 --2- 172.21.15.149:0/273801222 >> v2:172.21.15.160:3300/0 conn(0x7f9e640b2850 0x7f9e640cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:04.848 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:04.839+0000 7f9e6910f700 1 --2- 172.21.15.149:0/273801222 >> v2:172.21.15.160:3300/0 conn(0x7f9e640b2850 0x7f9e640cabf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:04.849 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:04.839+0000 7f9e6910f700 1 -- 172.21.15.149:0/273801222 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e640cc520 con 0x7f9e640cc140 2023-11-08T19:29:04.849 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:04.839+0000 7f9e6910f700 1 --2- 172.21.15.149:0/273801222 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e640cc140 0x7f9e640cc910 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f9e640b1330 tx=0x7f9e54009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c2bd9cd7523793a server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:04.849 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:04.839+0000 7f9e5bfff700 1 -- 172.21.15.149:0/273801222 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e54005e30 con 0x7f9e640cc140 2023-11-08T19:29:04.849 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:04.839+0000 7f9e5bfff700 1 -- 172.21.15.149:0/273801222 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e54004030 con 0x7f9e640cc140 2023-11-08T19:29:04.849 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:04.839+0000 7f9e5bfff700 1 -- 172.21.15.149:0/273801222 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e540043e0 con 0x7f9e640cc140 2023-11-08T19:29:04.849 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:04.840+0000 7f9e6b373700 1 -- 172.21.15.149:0/273801222 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e640cc140 msgr2=0x7f9e640cc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:04.850 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:04.840+0000 7f9e6b373700 1 --2- 172.21.15.149:0/273801222 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e640cc140 0x7f9e640cc910 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f9e640b1330 tx=0x7f9e54009bd0 comp rx=0 tx=0).stop 2023-11-08T19:29:04.850 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:04.840+0000 7f9e6b373700 1 -- 172.21.15.149:0/273801222 shutdown_connections 2023-11-08T19:29:04.850 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:04.840+0000 7f9e6b373700 1 --2- 172.21.15.149:0/273801222 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9e640b2cd0 0x7f9e640cb130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:04.850 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:04.840+0000 7f9e6b373700 1 --2- 172.21.15.149:0/273801222 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e640cc140 0x7f9e640cc910 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:04.850 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:04.840+0000 7f9e6b373700 1 --2- 172.21.15.149:0/273801222 >> v2:172.21.15.160:3300/0 conn(0x7f9e640b2850 0x7f9e640cabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:04.851 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:04.840+0000 7f9e6b373700 1 -- 172.21.15.149:0/273801222 >> 172.21.15.149:0/273801222 conn(0x7f9e64099a40 msgr2=0x7f9e640d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:04.851 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:04.840+0000 7f9e6b373700 1 -- 172.21.15.149:0/273801222 shutdown_connections 2023-11-08T19:29:04.851 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:04.840+0000 7f9e6b373700 1 -- 172.21.15.149:0/273801222 wait complete. 2023-11-08T19:29:04.851 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:04.841+0000 7f9e6b373700 1 Processor -- start 2023-11-08T19:29:04.851 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:04.841+0000 7f9e6b373700 1 -- start start 2023-11-08T19:29:04.852 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:04.842+0000 7f9e6b373700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9e640b2850 0x7f9e640b4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:04.852 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:04.842+0000 7f9e6b373700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9e640b2cd0 0x7f9e641f6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:04.852 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:04.842+0000 7f9e6b373700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e640cc140 0x7f9e6409db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:04.852 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:04.842+0000 7f9e6b373700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e640ae280 con 0x7f9e640cc140 2023-11-08T19:29:04.852 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:04.842+0000 7f9e6b373700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e641f73b0 con 0x7f9e640b2cd0 2023-11-08T19:29:04.853 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:04.842+0000 7f9e6b373700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e641f7650 con 0x7f9e640b2850 2023-11-08T19:29:04.853 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:04.842+0000 7f9e69910700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e640cc140 0x7f9e6409db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:04.853 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:04.842+0000 7f9e69910700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e640cc140 0x7f9e6409db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44886/0 (socket says 172.21.15.149:44886) 2023-11-08T19:29:04.853 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:04.842+0000 7f9e69910700 1 -- 172.21.15.149:0/2122206284 learned_addr learned my addr 172.21.15.149:0/2122206284 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:04.853 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:04.842+0000 7f9e69910700 1 -- 172.21.15.149:0/2122206284 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9e640b2850 msgr2=0x7f9e640b4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:04.854 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:04.842+0000 7f9e69910700 1 --2- 172.21.15.149:0/2122206284 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9e640b2850 0x7f9e640b4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:04.854 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:04.842+0000 7f9e69910700 1 -- 172.21.15.149:0/2122206284 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9e640b2cd0 msgr2=0x7f9e641f6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:04.854 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:04.842+0000 7f9e6890e700 1 --2- 172.21.15.149:0/2122206284 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9e640b2cd0 0x7f9e641f6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:04.854 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:04.842+0000 7f9e69910700 1 --2- 172.21.15.149:0/2122206284 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9e640b2cd0 0x7f9e641f6e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:04.854 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:04.842+0000 7f9e69910700 1 -- 172.21.15.149:0/2122206284 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e54009500 con 0x7f9e640cc140 2023-11-08T19:29:04.855 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:04.842+0000 7f9e69910700 1 --2- 172.21.15.149:0/2122206284 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e640cc140 0x7f9e6409db30 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c00b9e0 tx=0x7f9e5c00bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:04.855 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:04.842+0000 7f9e59ffb700 1 -- 172.21.15.149:0/2122206284 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e5c00c9b0 con 0x7f9e640cc140 2023-11-08T19:29:04.855 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:04.842+0000 7f9e59ffb700 1 -- 172.21.15.149:0/2122206284 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e5c00cb30 con 0x7f9e640cc140 2023-11-08T19:29:04.855 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:04.842+0000 7f9e6b373700 1 -- 172.21.15.149:0/2122206284 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e641f7930 con 0x7f9e640cc140 2023-11-08T19:29:04.855 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:04.842+0000 7f9e59ffb700 1 -- 172.21.15.149:0/2122206284 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e5c014440 con 0x7f9e640cc140 2023-11-08T19:29:04.856 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:04.843+0000 7f9e6b373700 1 -- 172.21.15.149:0/2122206284 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e640ae490 con 0x7f9e640cc140 2023-11-08T19:29:04.856 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:04.844+0000 7f9e6b373700 1 -- 172.21.15.149:0/2122206284 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e640ae6b0 con 0x7f9e640cc140 2023-11-08T19:29:04.856 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:04.844+0000 7f9e59ffb700 1 -- 172.21.15.149:0/2122206284 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9e5c01d3b0 con 0x7f9e640cc140 2023-11-08T19:29:04.856 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:04.844+0000 7f9e59ffb700 1 --2- 172.21.15.149:0/2122206284 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9e4806af00 0x7f9e4806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:04.856 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:04.845+0000 7f9e6910f700 1 --2- 172.21.15.149:0/2122206284 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9e4806af00 0x7f9e4806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:04.856 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:04.845+0000 7f9e59ffb700 1 -- 172.21.15.149:0/2122206284 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 7522+0+0 (secure 0 0 0) 0x7f9e5c006e40 con 0x7f9e640cc140 2023-11-08T19:29:04.857 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:04.845+0000 7f9e6910f700 1 --2- 172.21.15.149:0/2122206284 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9e4806af00 0x7f9e4806d3c0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f9e640b1330 tx=0x7f9e54010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:04.857 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:04.849+0000 7f9e59ffb700 1 -- 172.21.15.149:0/2122206284 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9e5c0543e0 con 0x7f9e640cc140 2023-11-08T19:29:05.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.081+0000 7f9e6b373700 1 -- 172.21.15.149:0/2122206284 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9e640745f0 con 0x7f9e640cc140 2023-11-08T19:29:05.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.082+0000 7f9e59ffb700 1 -- 172.21.15.149:0/2122206284 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+4941 (secure 0 0 0) 0x7f9e5c057a00 con 0x7f9e640cc140 2023-11-08T19:29:05.084 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:29:05.084 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":91,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6095,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/852710262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":852710262},{"type":"v1","addr":"172.21.15.160:6835","nonce":852710262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64},{"gid":7812,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/2818321595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2818321595},{"type":"v1","addr":"172.21.15.149:6836","nonce":2818321595}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:29:02.319250+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6236,"mds_1":7125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6236":{"gid":6236,"name":"d","rank":0,"incarnation":87,"state":"up:active","state_seq":12,"addr":"172.21.15.160:6834/1313631099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":1313631099},{"type":"v1","addr":"172.21.15.160:6834","nonce":1313631099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7125":{"gid":7125,"name":"c","rank":1,"incarnation":57,"state":"up:active","state_seq":6,"addr":"172.21.15.149:6837/3917392643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3917392643},{"type":"v1","addr":"172.21.15.149:6837","nonce":3917392643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:29:05.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.084+0000 7f9e6b373700 1 -- 172.21.15.149:0/2122206284 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9e4806af00 msgr2=0x7f9e4806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:05.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.084+0000 7f9e6b373700 1 --2- 172.21.15.149:0/2122206284 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9e4806af00 0x7f9e4806d3c0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f9e640b1330 tx=0x7f9e54010000 comp rx=0 tx=0).stop 2023-11-08T19:29:05.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.084+0000 7f9e6b373700 1 -- 172.21.15.149:0/2122206284 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e640cc140 msgr2=0x7f9e6409db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:05.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.084+0000 7f9e6b373700 1 --2- 172.21.15.149:0/2122206284 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e640cc140 0x7f9e6409db30 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c00b9e0 tx=0x7f9e5c00bda0 comp rx=0 tx=0).stop 2023-11-08T19:29:05.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.084+0000 7f9e6b373700 1 -- 172.21.15.149:0/2122206284 shutdown_connections 2023-11-08T19:29:05.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.084+0000 7f9e6b373700 1 --2- 172.21.15.149:0/2122206284 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f9e4806af00 0x7f9e4806d3c0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:05.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.084+0000 7f9e6b373700 1 --2- 172.21.15.149:0/2122206284 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e640cc140 0x7f9e6409db30 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:05.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.084+0000 7f9e6b373700 1 --2- 172.21.15.149:0/2122206284 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9e640b2850 0x7f9e640b4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:05.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.084+0000 7f9e6b373700 1 --2- 172.21.15.149:0/2122206284 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9e640b2cd0 0x7f9e641f6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:05.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.084+0000 7f9e6b373700 1 -- 172.21.15.149:0/2122206284 >> 172.21.15.149:0/2122206284 conn(0x7f9e64099a40 msgr2=0x7f9e640c7670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:05.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.084+0000 7f9e6b373700 1 -- 172.21.15.149:0/2122206284 shutdown_connections 2023-11-08T19:29:05.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.084+0000 7f9e6b373700 1 -- 172.21.15.149:0/2122206284 wait complete. 2023-11-08T19:29:05.088 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 91 2023-11-08T19:29:05.098 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-11-08T19:29:05.098 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:29:05.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.221+0000 7eff13234700 1 Processor -- start 2023-11-08T19:29:05.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.221+0000 7eff13234700 1 -- start start 2023-11-08T19:29:05.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.222+0000 7eff13234700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7eff0c15b950 0x7eff0c0ce130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:05.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.222+0000 7eff13234700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7eff0c0cd5e0 0x7eff0c0ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:05.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.222+0000 7eff13234700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff0c0cc2e0 con 0x7eff0c0cfd20 2023-11-08T19:29:05.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.222+0000 7eff13234700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff0c0cc580 con 0x7eff0c15b950 2023-11-08T19:29:05.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.222+0000 7eff13234700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff0c0cc820 con 0x7eff0c0cd5e0 2023-11-08T19:29:05.226 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.222+0000 7eff0bfff700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7eff0c0cd5e0 0x7eff0c0ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:05.226 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.222+0000 7eff10fd0700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7eff0c15b950 0x7eff0c0ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:05.226 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.222+0000 7eff0bfff700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7eff0c0cd5e0 0x7eff0c0ce670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.149:36948/0 (socket says 172.21.15.149:36948) 2023-11-08T19:29:05.226 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.222+0000 7eff10fd0700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7eff0c15b950 0x7eff0c0ce130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.149:45882/0 (socket says 172.21.15.149:45882) 2023-11-08T19:29:05.227 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.222+0000 7eff0bfff700 1 -- 172.21.15.149:0/888315298 learned_addr learned my addr 172.21.15.149:0/888315298 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:05.227 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.222+0000 7eff117d1700 1 --1- 172.21.15.149:0/888315298 >> v1:172.21.15.160:6789/0 conn(0x7eff0c0cfd20 0x7eff0c0d01b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.149:58562/0 (socket says 172.21.15.149:58562) 2023-11-08T19:29:05.227 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.222+0000 7eff10fd0700 1 -- 172.21.15.149:0/888315298 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7eff0c0cd5e0 msgr2=0x7eff0c0ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:05.227 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.222+0000 7eff10fd0700 1 --2- 172.21.15.149:0/888315298 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7eff0c0cd5e0 0x7eff0c0ce670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:05.227 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.222+0000 7eff10fd0700 1 -- 172.21.15.149:0/888315298 >> v1:172.21.15.160:6789/0 conn(0x7eff0c0cfd20 legacy=0x7eff0c0d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:05.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.222+0000 7eff10fd0700 1 -- 172.21.15.149:0/888315298 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff0c0ccb00 con 0x7eff0c15b950 2023-11-08T19:29:05.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.222+0000 7eff0bfff700 1 --2- 172.21.15.149:0/888315298 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7eff0c0cd5e0 0x7eff0c0ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:29:05.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.223+0000 7eff10fd0700 1 --2- 172.21.15.149:0/888315298 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7eff0c15b950 0x7eff0c0ce130 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7eff00009820 tx=0x7eff00009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a74b7a7efb831e81 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:05.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.223+0000 7eff0b7fe700 1 -- 172.21.15.149:0/888315298 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff00005e30 con 0x7eff0c15b950 2023-11-08T19:29:05.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.223+0000 7eff0b7fe700 1 -- 172.21.15.149:0/888315298 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff00006030 con 0x7eff0c15b950 2023-11-08T19:29:05.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.223+0000 7eff0b7fe700 1 -- 172.21.15.149:0/888315298 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff000063c0 con 0x7eff0c15b950 2023-11-08T19:29:05.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.223+0000 7eff13234700 1 -- 172.21.15.149:0/888315298 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7eff0c15b950 msgr2=0x7eff0c0ce130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:05.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.223+0000 7eff13234700 1 --2- 172.21.15.149:0/888315298 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7eff0c15b950 0x7eff0c0ce130 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7eff00009820 tx=0x7eff00009b30 comp rx=0 tx=0).stop 2023-11-08T19:29:05.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.223+0000 7eff13234700 1 -- 172.21.15.149:0/888315298 shutdown_connections 2023-11-08T19:29:05.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.223+0000 7eff13234700 1 --2- 172.21.15.149:0/888315298 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7eff0c15b950 0x7eff0c0ce130 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:05.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.223+0000 7eff13234700 1 --2- 172.21.15.149:0/888315298 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7eff0c0cd5e0 0x7eff0c0ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:05.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.223+0000 7eff13234700 1 -- 172.21.15.149:0/888315298 >> 172.21.15.149:0/888315298 conn(0x7eff0c08afd0 msgr2=0x7eff0c0d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:05.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.223+0000 7eff13234700 1 -- 172.21.15.149:0/888315298 shutdown_connections 2023-11-08T19:29:05.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.223+0000 7eff13234700 1 -- 172.21.15.149:0/888315298 wait complete. 2023-11-08T19:29:05.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.225+0000 7eff13234700 1 Processor -- start 2023-11-08T19:29:05.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.225+0000 7eff13234700 1 -- start start 2023-11-08T19:29:05.234 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.225+0000 7eff13234700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7eff0c0cfd20 0x7eff0c0b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:05.234 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.225+0000 7eff13234700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7eff0c15b950 0x7eff0c0b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:05.234 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.225+0000 7eff13234700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff0c1f23f0 0x7eff0c159850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:05.234 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.225+0000 7eff13234700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff0c0c5270 con 0x7eff0c1f23f0 2023-11-08T19:29:05.235 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.225+0000 7eff13234700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff0c0c54c0 con 0x7eff0c0cfd20 2023-11-08T19:29:05.235 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.225+0000 7eff13234700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff0c0c57a0 con 0x7eff0c15b950 2023-11-08T19:29:05.235 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.226+0000 7eff117d1700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff0c1f23f0 0x7eff0c159850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:05.235 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.226+0000 7eff117d1700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff0c1f23f0 0x7eff0c159850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44900/0 (socket says 172.21.15.149:44900) 2023-11-08T19:29:05.235 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.226+0000 7eff117d1700 1 -- 172.21.15.149:0/3054655963 learned_addr learned my addr 172.21.15.149:0/3054655963 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:05.235 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.226+0000 7eff0bfff700 1 --2- 172.21.15.149:0/3054655963 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7eff0c15b950 0x7eff0c0b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:05.236 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.226+0000 7eff10fd0700 1 --2- 172.21.15.149:0/3054655963 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7eff0c0cfd20 0x7eff0c0b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:05.236 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.226+0000 7eff117d1700 1 -- 172.21.15.149:0/3054655963 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7eff0c15b950 msgr2=0x7eff0c0b6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:05.236 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.226+0000 7eff117d1700 1 --2- 172.21.15.149:0/3054655963 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7eff0c15b950 0x7eff0c0b6190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:05.236 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.226+0000 7eff117d1700 1 -- 172.21.15.149:0/3054655963 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7eff0c0cfd20 msgr2=0x7eff0c0b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:05.236 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.226+0000 7eff117d1700 1 --2- 172.21.15.149:0/3054655963 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7eff0c0cfd20 0x7eff0c0b4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:05.237 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.226+0000 7eff117d1700 1 -- 172.21.15.149:0/3054655963 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efef8009550 con 0x7eff0c1f23f0 2023-11-08T19:29:05.237 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.226+0000 7eff117d1700 1 --2- 172.21.15.149:0/3054655963 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff0c1f23f0 0x7eff0c159850 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7eff0400cbd0 tx=0x7eff0400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:05.237 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.226+0000 7eff097fa700 1 -- 172.21.15.149:0/3054655963 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0400abb0 con 0x7eff0c1f23f0 2023-11-08T19:29:05.237 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.226+0000 7eff097fa700 1 -- 172.21.15.149:0/3054655963 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff0400ad10 con 0x7eff0c1f23f0 2023-11-08T19:29:05.237 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.226+0000 7eff097fa700 1 -- 172.21.15.149:0/3054655963 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff04007270 con 0x7eff0c1f23f0 2023-11-08T19:29:05.238 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.226+0000 7eff13234700 1 -- 172.21.15.149:0/3054655963 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff00009430 con 0x7eff0c1f23f0 2023-11-08T19:29:05.238 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.226+0000 7eff13234700 1 -- 172.21.15.149:0/3054655963 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff0c0c5d60 con 0x7eff0c1f23f0 2023-11-08T19:29:05.238 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.227+0000 7eff13234700 1 -- 172.21.15.149:0/3054655963 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff0c0745f0 con 0x7eff0c1f23f0 2023-11-08T19:29:05.238 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.228+0000 7eff097fa700 1 -- 172.21.15.149:0/3054655963 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7eff040073d0 con 0x7eff0c1f23f0 2023-11-08T19:29:05.238 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.228+0000 7eff097fa700 1 --2- 172.21.15.149:0/3054655963 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7efef006af00 0x7efef006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:05.239 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.228+0000 7eff097fa700 1 -- 172.21.15.149:0/3054655963 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 7522+0+0 (secure 0 0 0) 0x7eff04089970 con 0x7eff0c1f23f0 2023-11-08T19:29:05.239 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.228+0000 7eff10fd0700 1 --2- 172.21.15.149:0/3054655963 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7efef006af00 0x7efef006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:05.239 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.229+0000 7eff10fd0700 1 --2- 172.21.15.149:0/3054655963 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7efef006af00 0x7efef006d3c0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7eff00013040 tx=0x7eff00008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:05.239 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.233+0000 7eff097fa700 1 -- 172.21.15.149:0/3054655963 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7eff04054440 con 0x7eff0c1f23f0 2023-11-08T19:29:05.469 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.468+0000 7eff13234700 1 -- 172.21.15.149:0/3054655963 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7eff0c08b760 con 0x7eff0c1f23f0 2023-11-08T19:29:05.470 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.469+0000 7eff097fa700 1 -- 172.21.15.149:0/3054655963 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+4941 (secure 0 0 0) 0x7eff04017090 con 0x7eff0c1f23f0 2023-11-08T19:29:05.471 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:29:05.471 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":91,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6095,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/852710262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":852710262},{"type":"v1","addr":"172.21.15.160:6835","nonce":852710262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64},{"gid":7812,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/2818321595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2818321595},{"type":"v1","addr":"172.21.15.149:6836","nonce":2818321595}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:29:02.319250+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6236,"mds_1":7125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6236":{"gid":6236,"name":"d","rank":0,"incarnation":87,"state":"up:active","state_seq":12,"addr":"172.21.15.160:6834/1313631099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":1313631099},{"type":"v1","addr":"172.21.15.160:6834","nonce":1313631099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7125":{"gid":7125,"name":"c","rank":1,"incarnation":57,"state":"up:active","state_seq":6,"addr":"172.21.15.149:6837/3917392643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3917392643},{"type":"v1","addr":"172.21.15.149:6837","nonce":3917392643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:29:05.473 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.471+0000 7eff13234700 1 -- 172.21.15.149:0/3054655963 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7efef006af00 msgr2=0x7efef006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:05.473 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.471+0000 7eff13234700 1 --2- 172.21.15.149:0/3054655963 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7efef006af00 0x7efef006d3c0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7eff00013040 tx=0x7eff00008070 comp rx=0 tx=0).stop 2023-11-08T19:29:05.473 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.471+0000 7eff13234700 1 -- 172.21.15.149:0/3054655963 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff0c1f23f0 msgr2=0x7eff0c159850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:05.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.471+0000 7eff13234700 1 --2- 172.21.15.149:0/3054655963 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff0c1f23f0 0x7eff0c159850 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7eff0400cbd0 tx=0x7eff0400cf90 comp rx=0 tx=0).stop 2023-11-08T19:29:05.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.471+0000 7eff13234700 1 -- 172.21.15.149:0/3054655963 shutdown_connections 2023-11-08T19:29:05.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.471+0000 7eff13234700 1 --2- 172.21.15.149:0/3054655963 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7efef006af00 0x7efef006d3c0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:05.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.471+0000 7eff13234700 1 --2- 172.21.15.149:0/3054655963 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7eff0c0cfd20 0x7eff0c0b4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:05.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.471+0000 7eff13234700 1 --2- 172.21.15.149:0/3054655963 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff0c1f23f0 0x7eff0c159850 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:05.475 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.471+0000 7eff13234700 1 --2- 172.21.15.149:0/3054655963 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7eff0c15b950 0x7eff0c0b6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:05.475 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.471+0000 7eff13234700 1 -- 172.21.15.149:0/3054655963 >> 172.21.15.149:0/3054655963 conn(0x7eff0c08afd0 msgr2=0x7eff0c0b0100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:05.475 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.471+0000 7eff13234700 1 -- 172.21.15.149:0/3054655963 shutdown_connections 2023-11-08T19:29:05.475 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:05.471+0000 7eff13234700 1 -- 172.21.15.149:0/3054655963 wait complete. 2023-11-08T19:29:05.476 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 91 2023-11-08T19:29:05.887 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 91, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 2, 'explicitly_allowed_features': 2, 'created': '2023-11-08T19:26:48.987203+0000', 'modified': '2023-11-08T19:29:02.319250+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 102, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 6236, 'mds_1': 7125}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6236': {'gid': 6236, 'name': 'd', 'rank': 0, 'incarnation': 87, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.160:6834/1313631099', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6832', 'nonce': 1313631099}, {'type': 'v1', 'addr': '172.21.15.160:6834', 'nonce': 1313631099}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_7125': {'gid': 7125, 'name': 'c', 'rank': 1, 'incarnation': 57, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.149:6837/3917392643', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6835', 'nonce': 3917392643}, {'type': 'v1', 'addr': '172.21.15.149:6837', 'nonce': 3917392643}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-08T19:29:05.887 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 2/2 2023-11-08T19:29:05.888 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-11-08T19:29:06.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.011+0000 7fb117988700 1 Processor -- start 2023-11-08T19:29:06.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.012+0000 7fb117988700 1 -- start start 2023-11-08T19:29:06.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.013+0000 7fb117988700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fb11006fe40 0x7fb11006f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:06.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.013+0000 7fb117988700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb1100d2060 0x7fb11006c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:06.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.013+0000 7fb117988700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb11006bd50 con 0x7fb11015dc30 2023-11-08T19:29:06.018 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.013+0000 7fb117988700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1100d04b0 con 0x7fb11006fe40 2023-11-08T19:29:06.018 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.013+0000 7fb117988700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1100d0730 con 0x7fb1100d2060 2023-11-08T19:29:06.018 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.013+0000 7fb115724700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fb11015dc30 0x7fb11006f730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:46906/0 (socket says 172.21.15.149:46906) 2023-11-08T19:29:06.018 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.013+0000 7fb115724700 1 -- 172.21.15.149:0/2763393817 learned_addr learned my addr 172.21.15.149:0/2763393817 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:29:06.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.013+0000 7fb107fff700 1 -- 172.21.15.149:0/2763393817 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2759866530 0 0) 0x7fb11006bd50 con 0x7fb11015dc30 2023-11-08T19:29:06.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.013+0000 7fb115f25700 1 --2- 172.21.15.149:0/2763393817 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb1100d2060 0x7fb11006c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:06.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.013+0000 7fb114f23700 1 --2- 172.21.15.149:0/2763393817 >> v2:172.21.15.160:3300/0 conn(0x7fb11006fe40 0x7fb11006f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:06.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.013+0000 7fb107fff700 1 -- 172.21.15.149:0/2763393817 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0fc0035b0 con 0x7fb11015dc30 2023-11-08T19:29:06.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.013+0000 7fb107fff700 1 -- 172.21.15.149:0/2763393817 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 749107155 0 0) 0x7fb0fc0035b0 con 0x7fb11015dc30 2023-11-08T19:29:06.020 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.013+0000 7fb107fff700 1 -- 172.21.15.149:0/2763393817 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb1100d2060 msgr2=0x7fb11006c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:06.020 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.013+0000 7fb107fff700 1 --2- 172.21.15.149:0/2763393817 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb1100d2060 0x7fb11006c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.020 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.013+0000 7fb107fff700 1 -- 172.21.15.149:0/2763393817 >> v2:172.21.15.160:3300/0 conn(0x7fb11006fe40 msgr2=0x7fb11006f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:06.020 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.013+0000 7fb107fff700 1 --2- 172.21.15.149:0/2763393817 >> v2:172.21.15.160:3300/0 conn(0x7fb11006fe40 0x7fb11006f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.013+0000 7fb107fff700 1 -- 172.21.15.149:0/2763393817 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1100d0a10 con 0x7fb11015dc30 2023-11-08T19:29:06.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.013+0000 7fb107fff700 1 -- 172.21.15.149:0/2763393817 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7fb10c0017f0 con 0x7fb11015dc30 2023-11-08T19:29:06.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.013+0000 7fb107fff700 1 -- 172.21.15.149:0/2763393817 >> v1:172.21.15.149:6789/0 conn(0x7fb11015dc30 legacy=0x7fb11006f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:06.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.013+0000 7fb107fff700 1 --2- 172.21.15.149:0/2763393817 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb0fc003a00 0x7fb0fc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:06.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.013+0000 7fb107fff700 1 --2- 172.21.15.149:0/2763393817 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb1100d2060 0x7fb0fc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:06.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.013+0000 7fb107fff700 1 --2- 172.21.15.149:0/2763393817 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0fc004d90 0x7fb0fc005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:06.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.013+0000 7fb107fff700 1 -- 172.21.15.149:0/2763393817 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1100d04b0 con 0x7fb0fc004d90 2023-11-08T19:29:06.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.013+0000 7fb107fff700 1 -- 172.21.15.149:0/2763393817 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1100d0730 con 0x7fb0fc003a00 2023-11-08T19:29:06.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.013+0000 7fb107fff700 1 -- 172.21.15.149:0/2763393817 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc00ba10 con 0x7fb1100d2060 2023-11-08T19:29:06.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.014+0000 7fb115f25700 1 --2- 172.21.15.149:0/2763393817 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0fc004d90 0x7fb0fc005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:06.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.014+0000 7fb115724700 1 --2- 172.21.15.149:0/2763393817 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb0fc003a00 0x7fb0fc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:06.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.014+0000 7fb114f23700 1 --2- 172.21.15.149:0/2763393817 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb1100d2060 0x7fb0fc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:06.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.014+0000 7fb115f25700 1 -- 172.21.15.149:0/2763393817 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb1100d2060 msgr2=0x7fb0fc004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:06.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.014+0000 7fb115f25700 1 --2- 172.21.15.149:0/2763393817 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb1100d2060 0x7fb0fc004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.014+0000 7fb115f25700 1 -- 172.21.15.149:0/2763393817 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb0fc003a00 msgr2=0x7fb0fc003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:06.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.014+0000 7fb115f25700 1 --2- 172.21.15.149:0/2763393817 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb0fc003a00 0x7fb0fc003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.014+0000 7fb115f25700 1 -- 172.21.15.149:0/2763393817 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0fc0035b0 con 0x7fb0fc004d90 2023-11-08T19:29:06.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.014+0000 7fb114f23700 1 --2- 172.21.15.149:0/2763393817 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb1100d2060 0x7fb0fc004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:29:06.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.014+0000 7fb115f25700 1 --2- 172.21.15.149:0/2763393817 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0fc004d90 0x7fb0fc005210 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fb108009fc0 tx=0x7fb0fc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe90222857287076 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:06.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.014+0000 7fb107fff700 1 -- 172.21.15.149:0/2763393817 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10800ec30 con 0x7fb0fc004d90 2023-11-08T19:29:06.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.014+0000 7fb107fff700 1 -- 172.21.15.149:0/2763393817 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb10800f040 con 0x7fb0fc004d90 2023-11-08T19:29:06.025 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.014+0000 7fb107fff700 1 -- 172.21.15.149:0/2763393817 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb108014480 con 0x7fb0fc004d90 2023-11-08T19:29:06.025 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.015+0000 7fb117988700 1 -- 172.21.15.149:0/2763393817 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0fc004d90 msgr2=0x7fb0fc005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:06.025 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.015+0000 7fb117988700 1 --2- 172.21.15.149:0/2763393817 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0fc004d90 0x7fb0fc005210 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fb108009fc0 tx=0x7fb0fc005880 comp rx=0 tx=0).stop 2023-11-08T19:29:06.025 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.015+0000 7fb115f25700 1 -- 172.21.15.149:0/2763393817 reap_dead start 2023-11-08T19:29:06.025 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.015+0000 7fb117988700 1 -- 172.21.15.149:0/2763393817 shutdown_connections 2023-11-08T19:29:06.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.015+0000 7fb117988700 1 -- 172.21.15.149:0/2763393817 >> 172.21.15.149:0/2763393817 conn(0x7fb11008afd0 msgr2=0x7fb1100d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:06.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.015+0000 7fb117988700 1 -- 172.21.15.149:0/2763393817 shutdown_connections 2023-11-08T19:29:06.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.015+0000 7fb117988700 1 -- 172.21.15.149:0/2763393817 wait complete. 2023-11-08T19:29:06.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.016+0000 7fb117988700 1 Processor -- start 2023-11-08T19:29:06.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.016+0000 7fb117988700 1 -- start start 2023-11-08T19:29:06.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.017+0000 7fb117988700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0fc004d90 0x7fb110157ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:06.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.017+0000 7fb117988700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb1100cbc00 0x7fb1100b5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:06.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.017+0000 7fb117988700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb1101f47b0 0x7fb1100af4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:06.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.017+0000 7fb117988700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1100ccdf0 con 0x7fb0fc004d90 2023-11-08T19:29:06.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.017+0000 7fb117988700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1100cc170 con 0x7fb1100cbc00 2023-11-08T19:29:06.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.017+0000 7fb117988700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1100cc450 con 0x7fb1101f47b0 2023-11-08T19:29:06.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.017+0000 7fb115724700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0fc004d90 0x7fb110157ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:06.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.017+0000 7fb115724700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0fc004d90 0x7fb110157ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44916/0 (socket says 172.21.15.149:44916) 2023-11-08T19:29:06.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.017+0000 7fb115724700 1 -- 172.21.15.149:0/657598538 learned_addr learned my addr 172.21.15.149:0/657598538 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:06.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.017+0000 7fb114f23700 1 --2- 172.21.15.149:0/657598538 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb1100cbc00 0x7fb1100b5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:06.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.017+0000 7fb115724700 1 -- 172.21.15.149:0/657598538 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb1101f47b0 msgr2=0x7fb1100af4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:06.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.017+0000 7fb115f25700 1 --2- 172.21.15.149:0/657598538 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb1101f47b0 0x7fb1100af4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:06.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.017+0000 7fb115724700 1 --2- 172.21.15.149:0/657598538 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb1101f47b0 0x7fb1100af4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.017+0000 7fb115724700 1 -- 172.21.15.149:0/657598538 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb1100cbc00 msgr2=0x7fb1100b5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:06.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.017+0000 7fb115724700 1 --2- 172.21.15.149:0/657598538 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb1100cbc00 0x7fb1100b5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.017+0000 7fb115724700 1 -- 172.21.15.149:0/657598538 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1100cc730 con 0x7fb0fc004d90 2023-11-08T19:29:06.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.017+0000 7fb114f23700 1 --2- 172.21.15.149:0/657598538 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb1100cbc00 0x7fb1100b5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:29:06.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.017+0000 7fb115724700 1 --2- 172.21.15.149:0/657598538 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0fc004d90 0x7fb110157ef0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7fb10c00f930 tx=0x7fb10c00fcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:06.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.017+0000 7fb105ffb700 1 -- 172.21.15.149:0/657598538 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10c0010a0 con 0x7fb0fc004d90 2023-11-08T19:29:06.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.017+0000 7fb105ffb700 1 -- 172.21.15.149:0/657598538 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb10c0072e0 con 0x7fb0fc004d90 2023-11-08T19:29:06.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.017+0000 7fb117988700 1 -- 172.21.15.149:0/657598538 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1100cca10 con 0x7fb0fc004d90 2023-11-08T19:29:06.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.017+0000 7fb105ffb700 1 -- 172.21.15.149:0/657598538 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10c007690 con 0x7fb0fc004d90 2023-11-08T19:29:06.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.018+0000 7fb117988700 1 -- 172.21.15.149:0/657598538 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1101f4c30 con 0x7fb0fc004d90 2023-11-08T19:29:06.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.019+0000 7fb105ffb700 1 -- 172.21.15.149:0/657598538 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb10c005830 con 0x7fb0fc004d90 2023-11-08T19:29:06.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.019+0000 7fb105ffb700 1 --2- 172.21.15.149:0/657598538 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb0f406af30 0x7fb0f406d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:06.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.020+0000 7fb114f23700 1 --2- 172.21.15.149:0/657598538 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb0f406af30 0x7fb0f406d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:06.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.020+0000 7fb105ffb700 1 -- 172.21.15.149:0/657598538 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 7522+0+0 (secure 0 0 0) 0x7fb10c089e30 con 0x7fb0fc004d90 2023-11-08T19:29:06.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.020+0000 7fb114f23700 1 --2- 172.21.15.149:0/657598538 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb0f406af30 0x7fb0f406d3f0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fb1100b02f0 tx=0x7fb100008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:06.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.021+0000 7fb123b81b80 1 Processor -- start 2023-11-08T19:29:06.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.021+0000 7fb123b81b80 1 -- start start 2023-11-08T19:29:06.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.022+0000 7fb123b81b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5625cc93b6f0 0x5625cc96b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:06.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.022+0000 7fb123b81b80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5625cc93dc30 0x5625cc96b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:06.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.022+0000 7fb123b81b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5625cc93bad0 0x5625cc955f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:06.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.022+0000 7fb123b81b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625cc8a76e0 con 0x5625cc93bad0 2023-11-08T19:29:06.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.022+0000 7fb123b81b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625cc89b3b0 con 0x5625cc93b6f0 2023-11-08T19:29:06.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.022+0000 7fb123b81b80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x5625cc898cd0 con 0x5625cc93dc30 2023-11-08T19:29:06.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.022+0000 7fb115f25700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5625cc93bad0 0x5625cc955f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:06.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.022+0000 7fb115f25700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5625cc93bad0 0x5625cc955f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44928/0 (socket says 172.21.15.149:44928) 2023-11-08T19:29:06.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.022+0000 7fb115f25700 1 -- 172.21.15.149:0/2819873922 learned_addr learned my addr 172.21.15.149:0/2819873922 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:06.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.022+0000 7fb114f23700 1 --2- 172.21.15.149:0/2819873922 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5625cc93dc30 0x5625cc96b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:06.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.022+0000 7fb115724700 1 --2- 172.21.15.149:0/2819873922 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5625cc93b6f0 0x5625cc96b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:06.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.023+0000 7fb115f25700 1 -- 172.21.15.149:0/2819873922 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5625cc93dc30 msgr2=0x5625cc96b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:06.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.023+0000 7fb115f25700 1 --2- 172.21.15.149:0/2819873922 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5625cc93dc30 0x5625cc96b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.023+0000 7fb115f25700 1 -- 172.21.15.149:0/2819873922 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5625cc93b6f0 msgr2=0x5625cc96b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:06.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.023+0000 7fb115f25700 1 --2- 172.21.15.149:0/2819873922 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5625cc93b6f0 0x5625cc96b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.023+0000 7fb115f25700 1 -- 172.21.15.149:0/2819873922 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5625cc7115e0 con 0x5625cc93bad0 2023-11-08T19:29:06.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.023+0000 7fb114f23700 1 --2- 172.21.15.149:0/2819873922 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5625cc93dc30 0x5625cc96b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:29:06.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.023+0000 7fb115724700 1 --2- 172.21.15.149:0/2819873922 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5625cc93b6f0 0x5625cc96b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:29:06.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.023+0000 7fb115f25700 1 --2- 172.21.15.149:0/2819873922 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5625cc93bad0 0x5625cc955f90 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc0046e0 tx=0x7fb108011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a870943e4c82f2c server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:06.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.023+0000 7fb0faffd700 1 -- 172.21.15.149:0/2819873922 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb108007000 con 0x5625cc93bad0 2023-11-08T19:29:06.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.023+0000 7fb0faffd700 1 -- 172.21.15.149:0/2819873922 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb108003a20 con 0x5625cc93bad0 2023-11-08T19:29:06.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.023+0000 7fb0faffd700 1 -- 172.21.15.149:0/2819873922 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb108003dd0 con 0x5625cc93bad0 2023-11-08T19:29:06.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.024+0000 7fb123b81b80 1 -- 172.21.15.149:0/2819873922 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5625cc93bad0 msgr2=0x5625cc955f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:06.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.024+0000 7fb123b81b80 1 --2- 172.21.15.149:0/2819873922 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5625cc93bad0 0x5625cc955f90 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc0046e0 tx=0x7fb108011000 comp rx=0 tx=0).stop 2023-11-08T19:29:06.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.024+0000 7fb123b81b80 1 -- 172.21.15.149:0/2819873922 shutdown_connections 2023-11-08T19:29:06.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.024+0000 7fb123b81b80 1 --2- 172.21.15.149:0/2819873922 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5625cc93b6f0 0x5625cc96b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.024+0000 7fb123b81b80 1 --2- 172.21.15.149:0/2819873922 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5625cc93bad0 0x5625cc955f90 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.024+0000 7fb123b81b80 1 --2- 172.21.15.149:0/2819873922 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5625cc93dc30 0x5625cc96b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.024+0000 7fb123b81b80 1 -- 172.21.15.149:0/2819873922 >> 172.21.15.149:0/2819873922 conn(0x5625cc8b6660 msgr2=0x5625cc9413c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:06.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.024+0000 7fb123b81b80 1 -- 172.21.15.149:0/2819873922 shutdown_connections 2023-11-08T19:29:06.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.024+0000 7fb123b81b80 1 -- 172.21.15.149:0/2819873922 wait complete. 2023-11-08T19:29:06.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.024+0000 7fb123b81b80 1 -- start start 2023-11-08T19:29:06.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.024+0000 7fb123b81b80 1 Processor -- start 2023-11-08T19:29:06.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.026+0000 7fb123b81b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5625cc93b6f0 0x5625cc980240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:06.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.026+0000 7fb123b81b80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5625cc93bad0 0x5625cc96b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:06.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.026+0000 7fb123b81b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5625cc9686c0 0x5625cc96ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:06.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.026+0000 7fb123b81b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625cc8945c0 con 0x5625cc9686c0 2023-11-08T19:29:06.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.026+0000 7fb123b81b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625cc8300d0 con 0x5625cc93b6f0 2023-11-08T19:29:06.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.026+0000 7fb123b81b80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x5625cc82fd70 con 0x5625cc93bad0 2023-11-08T19:29:06.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.026+0000 7fb123b81b80 10 client.0 _ll_register_callbacks cb 0x5625cc68c7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-08T19:29:06.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.026+0000 7fb115f25700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5625cc9686c0 0x5625cc96ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:06.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.026+0000 7fb115f25700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5625cc9686c0 0x5625cc96ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44934/0 (socket says 172.21.15.149:44934) 2023-11-08T19:29:06.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.026+0000 7fb115f25700 1 -- 172.21.15.149:0/3599734585 learned_addr learned my addr 172.21.15.149:0/3599734585 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:06.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.026+0000 7fb114f23700 1 --2- 172.21.15.149:0/3599734585 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5625cc93bad0 0x5625cc96b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:06.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.026+0000 7fb115724700 1 --2- 172.21.15.149:0/3599734585 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5625cc93b6f0 0x5625cc980240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:06.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.026+0000 7fb115f25700 1 -- 172.21.15.149:0/3599734585 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5625cc93bad0 msgr2=0x5625cc96b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:06.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.026+0000 7fb115f25700 1 --2- 172.21.15.149:0/3599734585 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5625cc93bad0 0x5625cc96b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.026+0000 7fb115f25700 1 -- 172.21.15.149:0/3599734585 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5625cc93b6f0 msgr2=0x5625cc980240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:06.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.026+0000 7fb115f25700 1 --2- 172.21.15.149:0/3599734585 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5625cc93b6f0 0x5625cc980240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.026+0000 7fb115f25700 1 -- 172.21.15.149:0/3599734585 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb100012880 con 0x5625cc9686c0 2023-11-08T19:29:06.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.026+0000 7fb115724700 1 --2- 172.21.15.149:0/3599734585 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5625cc93b6f0 0x5625cc980240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:29:06.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.026+0000 7fb115f25700 1 --2- 172.21.15.149:0/3599734585 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5625cc9686c0 0x5625cc96ba80 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fb10800b010 tx=0x7fb108004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c5f8680d572ac1c server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:06.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.026+0000 7fb0effff700 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2023-11-08T19:29:06.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.026+0000 7fb0effff700 1 -- 172.21.15.149:0/3599734585 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb108007000 con 0x5625cc9686c0 2023-11-08T19:29:06.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.026+0000 7fb0effff700 1 -- 172.21.15.149:0/3599734585 <== mon.0 v2:172.21.15.149:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 7522+0+0 (secure 0 0 0) 0x7fb108004230 con 0x5625cc9686c0 2023-11-08T19:29:06.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.026+0000 7fb123b81b80 1 -- 172.21.15.149:0/3599734585 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5625cc933880 con 0x5625cc9686c0 2023-11-08T19:29:06.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.027+0000 7fb0effff700 1 -- 172.21.15.149:0/3599734585 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb1080043f0 con 0x5625cc9686c0 2023-11-08T19:29:06.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.027+0000 7fb123b81b80 10 client.7839 fetch_fsmap learned FSMap version 91 2023-11-08T19:29:06.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.027+0000 7fb123b81b80 1 -- 172.21.15.149:0/3599734585 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=2+}) v3 -- 0x7fb0fc0035b0 con 0x5625cc9686c0 2023-11-08T19:29:06.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.027+0000 7fb0effff700 1 -- 172.21.15.149:0/3599734585 <== mon.0 v2:172.21.15.149:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5625cc933880 con 0x5625cc9686c0 2023-11-08T19:29:06.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.027+0000 7fb0effff700 1 -- 172.21.15.149:0/3599734585 <== mon.0 v2:172.21.15.149:3300/0 5 ==== fsmap(e 91) v1 ==== 3306+0+0 (secure 0 0 0) 0x7fb10802f030 con 0x5625cc9686c0 2023-11-08T19:29:06.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.027+0000 7fb123b81b80 10 client.7839 fetch_fsmap finished waiting for FSMap version 91 2023-11-08T19:29:06.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.027+0000 7fb123b81b80 10 client.7839 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-08T19:29:06.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.027+0000 7fb123b81b80 20 client.7839 populate_metadata read hostname 'smithi149' 2023-11-08T19:29:06.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.027+0000 7fb123b81b80 1 --2- 172.21.15.149:0/3599734585 >> [v2:172.21.15.160:6832/1313631099,v1:172.21.15.160:6834/1313631099] conn(0x5625cc96d640 0x5625cc96dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:06.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.027+0000 7fb123b81b80 4 client.7839 mds_command: new command op to 6236 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-08T19:29:06.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.027+0000 7fb123b81b80 1 -- 172.21.15.149:0/3599734585 --> [v2:172.21.15.160:6832/1313631099,v1:172.21.15.160:6834/1313631099] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5625cc90fa30 con 0x5625cc96d640 2023-11-08T19:29:06.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.027+0000 7fb115724700 1 --2- 172.21.15.149:0/3599734585 >> [v2:172.21.15.160:6832/1313631099,v1:172.21.15.160:6834/1313631099] conn(0x5625cc96d640 0x5625cc96dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:06.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.028+0000 7fb0effff700 10 client.7839 ms_handle_connect on v2:172.21.15.160:6832/1313631099 2023-11-08T19:29:06.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.028+0000 7fb115724700 1 --2- 172.21.15.149:0/3599734585 >> [v2:172.21.15.160:6832/1313631099,v1:172.21.15.160:6834/1313631099] conn(0x5625cc96d640 0x5625cc96dd50 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8156143def3fa27c server_cookie=7eac50094ac5c96d in_seq=0 out_seq=0 2023-11-08T19:29:06.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.028+0000 7fb0effff700 1 -- 172.21.15.149:0/3599734585 <== mds.0 v2:172.21.15.160:6832/1313631099 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5625cc90fa30 con 0x5625cc96d640 2023-11-08T19:29:06.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.028+0000 7fb0effff700 10 client.7839 handle_command_reply: tid=0 2023-11-08T19:29:06.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.028+0000 7fb123b81b80 1 client.7839 shutdown 2023-11-08T19:29:06.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.028+0000 7fb123b81b80 1 -- 172.21.15.149:0/3599734585 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5625cc9686c0 msgr2=0x5625cc96ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:06.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.028+0000 7fb123b81b80 1 --2- 172.21.15.149:0/3599734585 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5625cc9686c0 0x5625cc96ba80 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fb10800b010 tx=0x7fb108004ad0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.028+0000 7fb123b81b80 1 -- 172.21.15.149:0/3599734585 shutdown_connections 2023-11-08T19:29:06.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.028+0000 7fb123b81b80 1 --2- 172.21.15.149:0/3599734585 >> [v2:172.21.15.160:6832/1313631099,v1:172.21.15.160:6834/1313631099] conn(0x5625cc96d640 0x5625cc96dd50 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.028+0000 7fb123b81b80 1 --2- 172.21.15.149:0/3599734585 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5625cc93b6f0 0x5625cc980240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.028+0000 7fb123b81b80 1 --2- 172.21.15.149:0/3599734585 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5625cc9686c0 0x5625cc96ba80 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.028+0000 7fb0effff700 0 client.7839 ms_handle_reset on v2:172.21.15.160:6832/1313631099 2023-11-08T19:29:06.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.028+0000 7fb123b81b80 1 --2- 172.21.15.149:0/3599734585 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5625cc93bad0 0x5625cc96b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.028+0000 7fb123b81b80 1 -- 172.21.15.149:0/3599734585 >> 172.21.15.149:0/3599734585 conn(0x5625cc8b6660 msgr2=0x5625cc93e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:06.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.029+0000 7fb123b81b80 1 -- 172.21.15.149:0/3599734585 shutdown_connections 2023-11-08T19:29:06.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.029+0000 7fb123b81b80 1 -- 172.21.15.149:0/3599734585 wait complete. 2023-11-08T19:29:06.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.029+0000 7fb123b81b80 20 client.7839 trim_cache size 0 max 16384 2023-11-08T19:29:06.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.046+0000 7fb123b81b80 1 Processor -- start 2023-11-08T19:29:06.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.047+0000 7fb123b81b80 1 -- start start 2023-11-08T19:29:06.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.047+0000 7fb123b81b80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5625cc93b6f0 0x5625cc9403e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:06.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.047+0000 7fb123b81b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5625cc93bad0 0x5625cc956e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:06.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.047+0000 7fb123b81b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5625cc9686c0 0x5625cc941390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:06.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.047+0000 7fb123b81b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625cc7138d0 con 0x5625cc9686c0 2023-11-08T19:29:06.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.047+0000 7fb123b81b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625cc93ae20 con 0x5625cc93bad0 2023-11-08T19:29:06.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.047+0000 7fb123b81b80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x5625cc981410 con 0x5625cc93b6f0 2023-11-08T19:29:06.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.047+0000 7fb115f25700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5625cc9686c0 0x5625cc941390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:06.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.047+0000 7fb115f25700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5625cc9686c0 0x5625cc941390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44942/0 (socket says 172.21.15.149:44942) 2023-11-08T19:29:06.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.047+0000 7fb115f25700 1 -- 172.21.15.149:0/3492435414 learned_addr learned my addr 172.21.15.149:0/3492435414 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:06.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.047+0000 7fb114f23700 1 --2- 172.21.15.149:0/3492435414 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5625cc93bad0 0x5625cc956e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:06.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.047+0000 7fb115724700 1 --2- 172.21.15.149:0/3492435414 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5625cc93b6f0 0x5625cc9403e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:06.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.048+0000 7fb115f25700 1 -- 172.21.15.149:0/3492435414 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5625cc93b6f0 msgr2=0x5625cc9403e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:06.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.048+0000 7fb115f25700 1 --2- 172.21.15.149:0/3492435414 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5625cc93b6f0 0x5625cc9403e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.048+0000 7fb115f25700 1 -- 172.21.15.149:0/3492435414 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5625cc93bad0 msgr2=0x5625cc956e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:06.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.048+0000 7fb115f25700 1 --2- 172.21.15.149:0/3492435414 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5625cc93bad0 0x5625cc956e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.048+0000 7fb115f25700 1 -- 172.21.15.149:0/3492435414 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5625cc6bdd90 con 0x5625cc9686c0 2023-11-08T19:29:06.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.048+0000 7fb115f25700 1 --2- 172.21.15.149:0/3492435414 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5625cc9686c0 0x5625cc941390 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fb108000f80 tx=0x7fb108020070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d79250ef2fb96158 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:06.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.048+0000 7fb0fb7fe700 1 -- 172.21.15.149:0/3492435414 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb108007000 con 0x5625cc9686c0 2023-11-08T19:29:06.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.048+0000 7fb0fb7fe700 1 -- 172.21.15.149:0/3492435414 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb10802b070 con 0x5625cc9686c0 2023-11-08T19:29:06.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.048+0000 7fb0fb7fe700 1 -- 172.21.15.149:0/3492435414 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1080041c0 con 0x5625cc9686c0 2023-11-08T19:29:06.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.048+0000 7fb123b81b80 1 -- 172.21.15.149:0/3492435414 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5625cc9686c0 msgr2=0x5625cc941390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:06.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.048+0000 7fb123b81b80 1 --2- 172.21.15.149:0/3492435414 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5625cc9686c0 0x5625cc941390 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fb108000f80 tx=0x7fb108020070 comp rx=0 tx=0).stop 2023-11-08T19:29:06.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.048+0000 7fb123b81b80 1 -- 172.21.15.149:0/3492435414 shutdown_connections 2023-11-08T19:29:06.070 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.048+0000 7fb123b81b80 1 --2- 172.21.15.149:0/3492435414 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5625cc9686c0 0x5625cc941390 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.070 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.048+0000 7fb123b81b80 1 --2- 172.21.15.149:0/3492435414 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5625cc93b6f0 0x5625cc9403e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.070 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.048+0000 7fb123b81b80 1 --2- 172.21.15.149:0/3492435414 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5625cc93bad0 0x5625cc956e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.070 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.048+0000 7fb123b81b80 1 -- 172.21.15.149:0/3492435414 >> 172.21.15.149:0/3492435414 conn(0x5625cc8b6660 msgr2=0x5625cc9377e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:06.070 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.049+0000 7fb123b81b80 1 -- 172.21.15.149:0/3492435414 shutdown_connections 2023-11-08T19:29:06.071 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.049+0000 7fb123b81b80 1 -- 172.21.15.149:0/3492435414 wait complete. 2023-11-08T19:29:06.071 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.049+0000 7fb123b81b80 1 -- start start 2023-11-08T19:29:06.071 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.049+0000 7fb123b81b80 1 Processor -- start 2023-11-08T19:29:06.071 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.050+0000 7fb123b81b80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5625cc93b6f0 0x5625cc96be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:06.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.050+0000 7fb123b81b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5625cc93bad0 0x5625cc93e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:06.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.050+0000 7fb123b81b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5625cc9686c0 0x5625cc93ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:06.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.050+0000 7fb123b81b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625cc997aa0 con 0x5625cc93bad0 2023-11-08T19:29:06.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.050+0000 7fb123b81b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625cc93cc50 con 0x5625cc9686c0 2023-11-08T19:29:06.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.050+0000 7fb123b81b80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x5625cc9658a0 con 0x5625cc93b6f0 2023-11-08T19:29:06.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.050+0000 7fb123b81b80 10 client.0 _ll_register_callbacks cb 0x7fb0fc003740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-08T19:29:06.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.050+0000 7fb114f23700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5625cc93bad0 0x5625cc93e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:06.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.050+0000 7fb114f23700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5625cc93bad0 0x5625cc93e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44946/0 (socket says 172.21.15.149:44946) 2023-11-08T19:29:06.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.050+0000 7fb114f23700 1 -- 172.21.15.149:0/420845980 learned_addr learned my addr 172.21.15.149:0/420845980 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:06.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.050+0000 7fb115724700 1 --2- 172.21.15.149:0/420845980 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5625cc93b6f0 0x5625cc96be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:06.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.050+0000 7fb115f25700 1 --2- 172.21.15.149:0/420845980 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5625cc9686c0 0x5625cc93ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:06.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.050+0000 7fb114f23700 1 -- 172.21.15.149:0/420845980 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5625cc93b6f0 msgr2=0x5625cc96be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:06.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.050+0000 7fb114f23700 1 --2- 172.21.15.149:0/420845980 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5625cc93b6f0 0x5625cc96be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.050+0000 7fb114f23700 1 -- 172.21.15.149:0/420845980 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5625cc9686c0 msgr2=0x5625cc93ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:06.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.050+0000 7fb114f23700 1 --2- 172.21.15.149:0/420845980 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5625cc9686c0 0x5625cc93ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.050+0000 7fb114f23700 1 -- 172.21.15.149:0/420845980 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0fc0035b0 con 0x5625cc93bad0 2023-11-08T19:29:06.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.050+0000 7fb115f25700 1 --2- 172.21.15.149:0/420845980 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5625cc9686c0 0x5625cc93ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:29:06.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.051+0000 7fb114f23700 1 --2- 172.21.15.149:0/420845980 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5625cc93bad0 0x5625cc93e4c0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fb1000125b0 tx=0x7fb1000047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=892bb15202608ff3 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:06.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.051+0000 7fb0effff700 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2023-11-08T19:29:06.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.051+0000 7fb0effff700 1 -- 172.21.15.149:0/420845980 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb100029070 con 0x5625cc93bad0 2023-11-08T19:29:06.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.051+0000 7fb0effff700 1 -- 172.21.15.149:0/420845980 <== mon.0 v2:172.21.15.149:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 7522+0+0 (secure 0 0 0) 0x7fb100024a20 con 0x5625cc93bad0 2023-11-08T19:29:06.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.051+0000 7fb123b81b80 1 -- 172.21.15.149:0/420845980 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb108003a20 con 0x5625cc93bad0 2023-11-08T19:29:06.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.051+0000 7fb0effff700 1 -- 172.21.15.149:0/420845980 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb100024be0 con 0x5625cc93bad0 2023-11-08T19:29:06.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.051+0000 7fb123b81b80 10 client.7845 fetch_fsmap learned FSMap version 91 2023-11-08T19:29:06.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.051+0000 7fb123b81b80 1 -- 172.21.15.149:0/420845980 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=2+}) v3 -- 0x5625cc6a6c10 con 0x5625cc93bad0 2023-11-08T19:29:06.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.051+0000 7fb0effff700 1 -- 172.21.15.149:0/420845980 <== mon.0 v2:172.21.15.149:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb108003a20 con 0x5625cc93bad0 2023-11-08T19:29:06.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.051+0000 7fb0effff700 1 -- 172.21.15.149:0/420845980 <== mon.0 v2:172.21.15.149:3300/0 5 ==== fsmap(e 91) v1 ==== 3306+0+0 (secure 0 0 0) 0x7fb100004030 con 0x5625cc93bad0 2023-11-08T19:29:06.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.051+0000 7fb123b81b80 10 client.7845 fetch_fsmap finished waiting for FSMap version 91 2023-11-08T19:29:06.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.051+0000 7fb123b81b80 10 client.7845 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-08T19:29:06.078 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.051+0000 7fb123b81b80 20 client.7845 populate_metadata read hostname 'smithi149' 2023-11-08T19:29:06.078 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.051+0000 7fb123b81b80 1 --2- 172.21.15.149:0/420845980 >> [v2:172.21.15.160:6832/1313631099,v1:172.21.15.160:6834/1313631099] conn(0x5625cc996f30 0x5625cc9889d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:06.078 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.051+0000 7fb123b81b80 4 client.7845 mds_command: new command op to 6236 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-08T19:29:06.078 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.051+0000 7fb123b81b80 1 -- 172.21.15.149:0/420845980 --> [v2:172.21.15.160:6832/1313631099,v1:172.21.15.160:6834/1313631099] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5625cc88d5a0 con 0x5625cc996f30 2023-11-08T19:29:06.078 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.051+0000 7fb115724700 1 --2- 172.21.15.149:0/420845980 >> [v2:172.21.15.160:6832/1313631099,v1:172.21.15.160:6834/1313631099] conn(0x5625cc996f30 0x5625cc9889d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:06.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.052+0000 7fb0effff700 10 client.7845 ms_handle_connect on v2:172.21.15.160:6832/1313631099 2023-11-08T19:29:06.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.052+0000 7fb115724700 1 --2- 172.21.15.149:0/420845980 >> [v2:172.21.15.160:6832/1313631099,v1:172.21.15.160:6834/1313631099] conn(0x5625cc996f30 0x5625cc9889d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ecdcac696428ee7 server_cookie=3e22eb9cd4aa356b in_seq=0 out_seq=0 2023-11-08T19:29:06.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.052+0000 7fb0effff700 1 -- 172.21.15.149:0/420845980 <== mds.0 v2:172.21.15.160:6832/1313631099 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x5625cc88d5a0 con 0x5625cc996f30 2023-11-08T19:29:06.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.052+0000 7fb0effff700 10 client.7845 handle_command_reply: tid=0 2023-11-08T19:29:06.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.052+0000 7fb123b81b80 1 client.7845 shutdown 2023-11-08T19:29:06.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.052+0000 7fb123b81b80 1 -- 172.21.15.149:0/420845980 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5625cc93bad0 msgr2=0x5625cc93e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:06.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.052+0000 7fb123b81b80 1 --2- 172.21.15.149:0/420845980 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5625cc93bad0 0x5625cc93e4c0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fb1000125b0 tx=0x7fb1000047c0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.052+0000 7fb123b81b80 1 -- 172.21.15.149:0/420845980 shutdown_connections 2023-11-08T19:29:06.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.052+0000 7fb123b81b80 1 --2- 172.21.15.149:0/420845980 >> [v2:172.21.15.160:6832/1313631099,v1:172.21.15.160:6834/1313631099] conn(0x5625cc996f30 0x5625cc9889d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.052+0000 7fb123b81b80 1 --2- 172.21.15.149:0/420845980 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5625cc9686c0 0x5625cc93ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.052+0000 7fb123b81b80 1 --2- 172.21.15.149:0/420845980 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5625cc93b6f0 0x5625cc96be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.052+0000 7fb123b81b80 1 --2- 172.21.15.149:0/420845980 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5625cc93bad0 0x5625cc93e4c0 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.052+0000 7fb0effff700 0 client.7845 ms_handle_reset on v2:172.21.15.160:6832/1313631099 2023-11-08T19:29:06.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.052+0000 7fb123b81b80 1 -- 172.21.15.149:0/420845980 >> 172.21.15.149:0/420845980 conn(0x5625cc8b6660 msgr2=0x5625cc941390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:06.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.052+0000 7fb123b81b80 1 -- 172.21.15.149:0/420845980 shutdown_connections 2023-11-08T19:29:06.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.052+0000 7fb123b81b80 1 -- 172.21.15.149:0/420845980 wait complete. 2023-11-08T19:29:06.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.052+0000 7fb123b81b80 20 client.7845 trim_cache size 0 max 16384 2023-11-08T19:29:06.084 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2023-11-08T19:29:06.084 INFO:teuthology.orchestra.run.smithi149.stdout: "cluster_fsid": "0aba7c70-fe80-4446-a2f5-7502ac3adfb4", 2023-11-08T19:29:06.084 INFO:teuthology.orchestra.run.smithi149.stdout: "whoami": 0, 2023-11-08T19:29:06.084 INFO:teuthology.orchestra.run.smithi149.stdout: "id": 6236, 2023-11-08T19:29:06.085 INFO:teuthology.orchestra.run.smithi149.stdout: "want_state": "up:active", 2023-11-08T19:29:06.085 INFO:teuthology.orchestra.run.smithi149.stdout: "state": "up:active", 2023-11-08T19:29:06.085 INFO:teuthology.orchestra.run.smithi149.stdout: "fs_name": "cephfs", 2023-11-08T19:29:06.085 INFO:teuthology.orchestra.run.smithi149.stdout: "rank_uptime": 6.7504903279999997, 2023-11-08T19:29:06.085 INFO:teuthology.orchestra.run.smithi149.stdout: "mdsmap_epoch": 91, 2023-11-08T19:29:06.086 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_epoch": 102, 2023-11-08T19:29:06.086 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_epoch_barrier": 102, 2023-11-08T19:29:06.086 INFO:teuthology.orchestra.run.smithi149.stdout: "uptime": 38.616190420000002 2023-11-08T19:29:06.086 INFO:teuthology.orchestra.run.smithi149.stdout:} 2023-11-08T19:29:06.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.053+0000 7fb117988700 1 -- 172.21.15.149:0/657598538 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb0f406af30 msgr2=0x7fb0f406d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:06.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.053+0000 7fb117988700 1 --2- 172.21.15.149:0/657598538 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb0f406af30 0x7fb0f406d3f0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fb1100b02f0 tx=0x7fb100008040 comp rx=0 tx=0).stop 2023-11-08T19:29:06.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.053+0000 7fb117988700 1 -- 172.21.15.149:0/657598538 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0fc004d90 msgr2=0x7fb110157ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:06.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.053+0000 7fb117988700 1 --2- 172.21.15.149:0/657598538 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0fc004d90 0x7fb110157ef0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7fb10c00f930 tx=0x7fb10c00fcf0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.053+0000 7fb117988700 1 -- 172.21.15.149:0/657598538 shutdown_connections 2023-11-08T19:29:06.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.053+0000 7fb117988700 1 --2- 172.21.15.149:0/657598538 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb0f406af30 0x7fb0f406d3f0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.053+0000 7fb117988700 1 --2- 172.21.15.149:0/657598538 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb1101f47b0 0x7fb1100af4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.053+0000 7fb117988700 1 --2- 172.21.15.149:0/657598538 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0fc004d90 0x7fb110157ef0 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.053+0000 7fb117988700 1 --2- 172.21.15.149:0/657598538 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb1100cbc00 0x7fb1100b5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.053+0000 7fb117988700 1 -- 172.21.15.149:0/657598538 >> 172.21.15.149:0/657598538 conn(0x7fb11008afd0 msgr2=0x7fb1100b36c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:06.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.053+0000 7fb117988700 1 -- 172.21.15.149:0/657598538 shutdown_connections 2023-11-08T19:29:06.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.053+0000 7fb117988700 1 -- 172.21.15.149:0/657598538 wait complete. 2023-11-08T19:29:06.091 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-08T19:29:06.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.213+0000 7f95657d2700 1 Processor -- start 2023-11-08T19:29:06.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.213+0000 7f95657d2700 1 -- start start 2023-11-08T19:29:06.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.214+0000 7f95657d2700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f956015df40 0x7f95600ce140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:06.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.214+0000 7f95657d2700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f95600b2b60 0x7f95600ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:06.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.214+0000 7f95657d2700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95600d04f0 con 0x7f95600d2250 2023-11-08T19:29:06.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.214+0000 7f95657d2700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95600cbeb0 con 0x7f95600b2b60 2023-11-08T19:29:06.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.214+0000 7f95657d2700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95600d0740 con 0x7f956015df40 2023-11-08T19:29:06.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.214+0000 7f955e7fc700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f95600b2b60 0x7f95600ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:06.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.214+0000 7f955e7fc700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f95600b2b60 0x7f95600ce680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44954/0 (socket says 172.21.15.149:44954) 2023-11-08T19:29:06.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.214+0000 7f955f7fe700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f95600d2250 0x7f956006bfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:46958/0 (socket says 172.21.15.149:46958) 2023-11-08T19:29:06.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.214+0000 7f955e7fc700 1 -- 172.21.15.149:0/278173302 learned_addr learned my addr 172.21.15.149:0/278173302 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:06.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.214+0000 7f955effd700 1 --2- 172.21.15.149:0/278173302 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f956015df40 0x7f95600ce140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:06.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.214+0000 7f955e7fc700 1 -- 172.21.15.149:0/278173302 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f956015df40 msgr2=0x7f95600ce140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:06.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.214+0000 7f955e7fc700 1 --2- 172.21.15.149:0/278173302 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f956015df40 0x7f95600ce140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.214+0000 7f955e7fc700 1 -- 172.21.15.149:0/278173302 >> v1:172.21.15.149:6789/0 conn(0x7f95600d2250 legacy=0x7f956006bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:06.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.214+0000 7f955e7fc700 1 -- 172.21.15.149:0/278173302 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95600d0a20 con 0x7f95600b2b60 2023-11-08T19:29:06.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.214+0000 7f955dffb700 1 -- 172.21.15.149:0/278173302 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 381061308 0 0) 0x7f95600d04f0 con 0x7f95600d2250 2023-11-08T19:29:06.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.214+0000 7f955e7fc700 1 --2- 172.21.15.149:0/278173302 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95600b2b60 0x7f95600ce680 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f95540098f0 tx=0x7f9554009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d07dea7933651853 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:06.221 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.214+0000 7f955dffb700 1 -- 172.21.15.149:0/278173302 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f955400b8a0 con 0x7f95600b2b60 2023-11-08T19:29:06.221 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.214+0000 7f955dffb700 1 -- 172.21.15.149:0/278173302 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f955400ba00 con 0x7f95600b2b60 2023-11-08T19:29:06.221 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.214+0000 7f955dffb700 1 -- 172.21.15.149:0/278173302 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f955400bd90 con 0x7f95600b2b60 2023-11-08T19:29:06.221 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.215+0000 7f95657d2700 1 -- 172.21.15.149:0/278173302 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95600b2b60 msgr2=0x7f95600ce680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:06.221 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.215+0000 7f95657d2700 1 --2- 172.21.15.149:0/278173302 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95600b2b60 0x7f95600ce680 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f95540098f0 tx=0x7f9554009c00 comp rx=0 tx=0).stop 2023-11-08T19:29:06.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.215+0000 7f95657d2700 1 -- 172.21.15.149:0/278173302 shutdown_connections 2023-11-08T19:29:06.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.215+0000 7f95657d2700 1 --2- 172.21.15.149:0/278173302 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f956015df40 0x7f95600ce140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.215+0000 7f95657d2700 1 --2- 172.21.15.149:0/278173302 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95600b2b60 0x7f95600ce680 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.215+0000 7f95657d2700 1 -- 172.21.15.149:0/278173302 >> 172.21.15.149:0/278173302 conn(0x7f95600d1730 msgr2=0x7f95600d1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:06.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.215+0000 7f95657d2700 1 -- 172.21.15.149:0/278173302 shutdown_connections 2023-11-08T19:29:06.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.215+0000 7f95657d2700 1 -- 172.21.15.149:0/278173302 wait complete. 2023-11-08T19:29:06.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.216+0000 7f95657d2700 1 Processor -- start 2023-11-08T19:29:06.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.216+0000 7f95657d2700 1 -- start start 2023-11-08T19:29:06.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.217+0000 7f95657d2700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95600b2b60 0x7f9560153600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:06.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.217+0000 7f95657d2700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95600d2250 0x7f9560152f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:06.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.217+0000 7f95657d2700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f956015df40 0x7f95600b4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:06.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.217+0000 7f95657d2700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9560153440 con 0x7f956015df40 2023-11-08T19:29:06.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.217+0000 7f95657d2700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95600c8920 con 0x7f95600d2250 2023-11-08T19:29:06.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.217+0000 7f95657d2700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95600c8ee0 con 0x7f95600b2b60 2023-11-08T19:29:06.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.217+0000 7f955f7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f956015df40 0x7f95600b4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:06.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.217+0000 7f955f7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f956015df40 0x7f95600b4300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44962/0 (socket says 172.21.15.149:44962) 2023-11-08T19:29:06.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.217+0000 7f955f7fe700 1 -- 172.21.15.149:0/4236030979 learned_addr learned my addr 172.21.15.149:0/4236030979 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:06.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.217+0000 7f955effd700 1 --2- 172.21.15.149:0/4236030979 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95600b2b60 0x7f9560153600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:06.234 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.217+0000 7f955e7fc700 1 --2- 172.21.15.149:0/4236030979 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95600d2250 0x7f9560152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:06.234 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.217+0000 7f955f7fe700 1 -- 172.21.15.149:0/4236030979 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95600b2b60 msgr2=0x7f9560153600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:06.234 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.217+0000 7f955f7fe700 1 --2- 172.21.15.149:0/4236030979 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95600b2b60 0x7f9560153600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.234 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.217+0000 7f955f7fe700 1 -- 172.21.15.149:0/4236030979 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95600d2250 msgr2=0x7f9560152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:06.234 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.217+0000 7f955f7fe700 1 --2- 172.21.15.149:0/4236030979 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95600d2250 0x7f9560152f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.235 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.217+0000 7f955f7fe700 1 -- 172.21.15.149:0/4236030979 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9554009550 con 0x7f956015df40 2023-11-08T19:29:06.235 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.217+0000 7f955e7fc700 1 --2- 172.21.15.149:0/4236030979 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95600d2250 0x7f9560152f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:29:06.235 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.218+0000 7f955f7fe700 1 --2- 172.21.15.149:0/4236030979 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f956015df40 0x7f95600b4300 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f9558002230 tx=0x7f955800cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:06.235 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.218+0000 7f95477fe700 1 -- 172.21.15.149:0/4236030979 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f955800ab70 con 0x7f956015df40 2023-11-08T19:29:06.235 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.218+0000 7f95477fe700 1 -- 172.21.15.149:0/4236030979 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f955800acf0 con 0x7f956015df40 2023-11-08T19:29:06.236 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.218+0000 7f95657d2700 1 -- 172.21.15.149:0/4236030979 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f956015e4a0 con 0x7f956015df40 2023-11-08T19:29:06.236 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.218+0000 7f95477fe700 1 -- 172.21.15.149:0/4236030979 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9558007310 con 0x7f956015df40 2023-11-08T19:29:06.236 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.218+0000 7f95657d2700 1 -- 172.21.15.149:0/4236030979 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95600ca170 con 0x7f956015df40 2023-11-08T19:29:06.236 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.219+0000 7f95477fe700 1 -- 172.21.15.149:0/4236030979 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9558007470 con 0x7f956015df40 2023-11-08T19:29:06.236 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.219+0000 7f95477fe700 1 --2- 172.21.15.149:0/4236030979 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f954c06af00 0x7f954c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:06.237 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.220+0000 7f95477fe700 1 -- 172.21.15.149:0/4236030979 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 7522+0+0 (secure 0 0 0) 0x7f9558089bb0 con 0x7f956015df40 2023-11-08T19:29:06.237 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.220+0000 7f955effd700 1 --2- 172.21.15.149:0/4236030979 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f954c06af00 0x7f954c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:06.237 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.220+0000 7f955effd700 1 --2- 172.21.15.149:0/4236030979 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f954c06af00 0x7f954c06d3c0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f95601e72a0 tx=0x7f9550008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:06.237 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.222+0000 7f95719cbb80 1 Processor -- start 2023-11-08T19:29:06.237 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.222+0000 7f95719cbb80 1 -- start start 2023-11-08T19:29:06.238 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.223+0000 7f95719cbb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564caa9886f0 0x564caa9b8450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:06.238 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.223+0000 7f95719cbb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564caa98ac30 0x564caa9b8990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:06.238 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.223+0000 7f95719cbb80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x564caa988ad0 0x564caa9a2f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:06.238 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.223+0000 7f95719cbb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x564caa8f46e0 con 0x564caa98ac30 2023-11-08T19:29:06.238 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.223+0000 7f95719cbb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x564caa8e83b0 con 0x564caa9886f0 2023-11-08T19:29:06.239 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.223+0000 7f95719cbb80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x564caa8e5cd0 con 0x564caa988ad0 2023-11-08T19:29:06.239 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.223+0000 7f955e7fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564caa98ac30 0x564caa9b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:06.239 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.223+0000 7f955e7fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564caa98ac30 0x564caa9b8990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44968/0 (socket says 172.21.15.149:44968) 2023-11-08T19:29:06.239 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.223+0000 7f955e7fc700 1 -- 172.21.15.149:0/4232532167 learned_addr learned my addr 172.21.15.149:0/4232532167 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:06.239 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.223+0000 7f955effd700 1 --2- 172.21.15.149:0/4232532167 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564caa9886f0 0x564caa9b8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:06.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.223+0000 7f955f7fe700 1 --2- 172.21.15.149:0/4232532167 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x564caa988ad0 0x564caa9a2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:06.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.223+0000 7f955e7fc700 1 -- 172.21.15.149:0/4232532167 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x564caa988ad0 msgr2=0x564caa9a2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:06.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.223+0000 7f955e7fc700 1 --2- 172.21.15.149:0/4232532167 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x564caa988ad0 0x564caa9a2f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.223+0000 7f955e7fc700 1 -- 172.21.15.149:0/4232532167 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564caa9886f0 msgr2=0x564caa9b8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:06.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.223+0000 7f955e7fc700 1 --2- 172.21.15.149:0/4232532167 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564caa9886f0 0x564caa9b8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.223+0000 7f955e7fc700 1 -- 172.21.15.149:0/4232532167 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564caa75e5e0 con 0x564caa98ac30 2023-11-08T19:29:06.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.223+0000 7f955e7fc700 1 --2- 172.21.15.149:0/4232532167 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564caa98ac30 0x564caa9b8990 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f956006e7c0 tx=0x7f9554010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0a933f8668495db server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:06.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.223+0000 7f9544ff9700 1 -- 172.21.15.149:0/4232532167 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f955400bd70 con 0x564caa98ac30 2023-11-08T19:29:06.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.223+0000 7f9544ff9700 1 -- 172.21.15.149:0/4232532167 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9554004040 con 0x564caa98ac30 2023-11-08T19:29:06.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.223+0000 7f9544ff9700 1 -- 172.21.15.149:0/4232532167 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95540043b0 con 0x564caa98ac30 2023-11-08T19:29:06.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.224+0000 7f95719cbb80 1 -- 172.21.15.149:0/4232532167 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564caa98ac30 msgr2=0x564caa9b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:06.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.224+0000 7f95719cbb80 1 --2- 172.21.15.149:0/4232532167 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564caa98ac30 0x564caa9b8990 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f956006e7c0 tx=0x7f9554010000 comp rx=0 tx=0).stop 2023-11-08T19:29:06.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.224+0000 7f95719cbb80 1 -- 172.21.15.149:0/4232532167 shutdown_connections 2023-11-08T19:29:06.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.224+0000 7f95719cbb80 1 --2- 172.21.15.149:0/4232532167 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564caa9886f0 0x564caa9b8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.224+0000 7f95719cbb80 1 --2- 172.21.15.149:0/4232532167 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x564caa988ad0 0x564caa9a2f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.224+0000 7f95719cbb80 1 --2- 172.21.15.149:0/4232532167 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564caa98ac30 0x564caa9b8990 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.243 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.224+0000 7f95719cbb80 1 -- 172.21.15.149:0/4232532167 >> 172.21.15.149:0/4232532167 conn(0x564caa903660 msgr2=0x564caa98e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:06.243 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.224+0000 7f95719cbb80 1 -- 172.21.15.149:0/4232532167 shutdown_connections 2023-11-08T19:29:06.243 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.224+0000 7f95719cbb80 1 -- 172.21.15.149:0/4232532167 wait complete. 2023-11-08T19:29:06.243 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.225+0000 7f95719cbb80 1 -- start start 2023-11-08T19:29:06.243 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.225+0000 7f95719cbb80 1 Processor -- start 2023-11-08T19:29:06.244 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.226+0000 7f95719cbb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564caa9886f0 0x564caa9b95f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:06.244 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.226+0000 7f95719cbb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564caa988ad0 0x564caa9a3c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:06.244 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.226+0000 7f95719cbb80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x564caa989020 0x564caa9894a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:06.244 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.226+0000 7f95719cbb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x564caa8e15c0 con 0x564caa9886f0 2023-11-08T19:29:06.244 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.226+0000 7f95719cbb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x564caa87d0d0 con 0x564caa988ad0 2023-11-08T19:29:06.244 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.226+0000 7f95719cbb80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x564caa87cd70 con 0x564caa989020 2023-11-08T19:29:06.245 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.226+0000 7f95719cbb80 10 client.0 _ll_register_callbacks cb 0x564caa6d97b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-08T19:29:06.245 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.226+0000 7f955effd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564caa9886f0 0x564caa9b95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:06.245 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.226+0000 7f955effd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564caa9886f0 0x564caa9b95f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44972/0 (socket says 172.21.15.149:44972) 2023-11-08T19:29:06.245 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.226+0000 7f955effd700 1 -- 172.21.15.149:0/3606942135 learned_addr learned my addr 172.21.15.149:0/3606942135 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:06.245 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.226+0000 7f955e7fc700 1 --2- 172.21.15.149:0/3606942135 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564caa988ad0 0x564caa9a3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:06.246 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.226+0000 7f955f7fe700 1 --2- 172.21.15.149:0/3606942135 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x564caa989020 0x564caa9894a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:06.246 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.226+0000 7f955effd700 1 -- 172.21.15.149:0/3606942135 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x564caa989020 msgr2=0x564caa9894a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:06.246 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.226+0000 7f955effd700 1 --2- 172.21.15.149:0/3606942135 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x564caa989020 0x564caa9894a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.246 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.226+0000 7f955effd700 1 -- 172.21.15.149:0/3606942135 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564caa988ad0 msgr2=0x564caa9a3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:06.246 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.226+0000 7f955effd700 1 --2- 172.21.15.149:0/3606942135 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564caa988ad0 0x564caa9a3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.247 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.226+0000 7f955effd700 1 -- 172.21.15.149:0/3606942135 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95600d0a20 con 0x564caa9886f0 2023-11-08T19:29:06.247 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.226+0000 7f955effd700 1 --2- 172.21.15.149:0/3606942135 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564caa9886f0 0x564caa9b95f0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f9550010cf0 tx=0x7f95500047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=170f68380cc9217e server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:06.247 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.226+0000 7f953dffb700 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2023-11-08T19:29:06.247 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.226+0000 7f953dffb700 1 -- 172.21.15.149:0/3606942135 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9550005e60 con 0x564caa9886f0 2023-11-08T19:29:06.247 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.226+0000 7f953dffb700 1 -- 172.21.15.149:0/3606942135 <== mon.0 v2:172.21.15.149:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 7522+0+0 (secure 0 0 0) 0x7f95500066d0 con 0x564caa9886f0 2023-11-08T19:29:06.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.226+0000 7f95719cbb80 1 -- 172.21.15.149:0/3606942135 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564caa980880 con 0x564caa9886f0 2023-11-08T19:29:06.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.226+0000 7f953dffb700 1 -- 172.21.15.149:0/3606942135 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9550006890 con 0x564caa9886f0 2023-11-08T19:29:06.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.227+0000 7f95719cbb80 10 client.7860 fetch_fsmap learned FSMap version 91 2023-11-08T19:29:06.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.227+0000 7f95719cbb80 1 -- 172.21.15.149:0/3606942135 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=2+}) v3 -- 0x564caa70ad90 con 0x564caa9886f0 2023-11-08T19:29:06.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.227+0000 7f953dffb700 1 -- 172.21.15.149:0/3606942135 <== mon.0 v2:172.21.15.149:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564caa980880 con 0x564caa9886f0 2023-11-08T19:29:06.249 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.227+0000 7f953dffb700 1 -- 172.21.15.149:0/3606942135 <== mon.0 v2:172.21.15.149:3300/0 5 ==== fsmap(e 91) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f9550004020 con 0x564caa9886f0 2023-11-08T19:29:06.249 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.227+0000 7f95719cbb80 10 client.7860 fetch_fsmap finished waiting for FSMap version 91 2023-11-08T19:29:06.249 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.227+0000 7f95719cbb80 10 client.7860 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-08T19:29:06.249 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.227+0000 7f95719cbb80 20 client.7860 populate_metadata read hostname 'smithi149' 2023-11-08T19:29:06.249 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.227+0000 7f95719cbb80 1 --2- 172.21.15.149:0/3606942135 >> [v2:172.21.15.149:6835/3917392643,v1:172.21.15.149:6837/3917392643] conn(0x564caa9bbcc0 0x564caa9f01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:06.250 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.227+0000 7f95719cbb80 4 client.7860 mds_command: new command op to 7125 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-08T19:29:06.250 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.227+0000 7f95719cbb80 1 -- 172.21.15.149:0/3606942135 --> [v2:172.21.15.149:6835/3917392643,v1:172.21.15.149:6837/3917392643] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564caa95ca30 con 0x564caa9bbcc0 2023-11-08T19:29:06.250 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.227+0000 7f955e7fc700 1 --2- 172.21.15.149:0/3606942135 >> [v2:172.21.15.149:6835/3917392643,v1:172.21.15.149:6837/3917392643] conn(0x564caa9bbcc0 0x564caa9f01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:06.250 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.227+0000 7f953dffb700 10 client.7860 ms_handle_connect on v2:172.21.15.149:6835/3917392643 2023-11-08T19:29:06.250 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.227+0000 7f955e7fc700 1 --2- 172.21.15.149:0/3606942135 >> [v2:172.21.15.149:6835/3917392643,v1:172.21.15.149:6837/3917392643] conn(0x564caa9bbcc0 0x564caa9f01d0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ba17acfae85f3da1 server_cookie=fbaaf9ad3d33c8f0 in_seq=0 out_seq=0 2023-11-08T19:29:06.251 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.228+0000 7f953dffb700 1 -- 172.21.15.149:0/3606942135 <== mds.1 v2:172.21.15.149:6835/3917392643 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564caa95ca30 con 0x564caa9bbcc0 2023-11-08T19:29:06.251 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.228+0000 7f953dffb700 10 client.7860 handle_command_reply: tid=0 2023-11-08T19:29:06.251 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.228+0000 7f95719cbb80 1 client.7860 shutdown 2023-11-08T19:29:06.251 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.228+0000 7f95719cbb80 1 -- 172.21.15.149:0/3606942135 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564caa9886f0 msgr2=0x564caa9b95f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:06.251 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.228+0000 7f95719cbb80 1 --2- 172.21.15.149:0/3606942135 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564caa9886f0 0x564caa9b95f0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f9550010cf0 tx=0x7f95500047c0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.252 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.228+0000 7f95719cbb80 1 -- 172.21.15.149:0/3606942135 shutdown_connections 2023-11-08T19:29:06.252 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.228+0000 7f95719cbb80 1 --2- 172.21.15.149:0/3606942135 >> [v2:172.21.15.149:6835/3917392643,v1:172.21.15.149:6837/3917392643] conn(0x564caa9bbcc0 0x564caa9f01d0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.252 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.228+0000 7f95719cbb80 1 --2- 172.21.15.149:0/3606942135 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x564caa989020 0x564caa9894a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.252 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.228+0000 7f95719cbb80 1 --2- 172.21.15.149:0/3606942135 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564caa9886f0 0x564caa9b95f0 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.252 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.228+0000 7f95719cbb80 1 --2- 172.21.15.149:0/3606942135 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564caa988ad0 0x564caa9a3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.253 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.228+0000 7f953dffb700 0 client.7860 ms_handle_reset on v2:172.21.15.149:6835/3917392643 2023-11-08T19:29:06.253 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.228+0000 7f95719cbb80 1 -- 172.21.15.149:0/3606942135 >> 172.21.15.149:0/3606942135 conn(0x564caa903660 msgr2=0x564caa98b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:06.253 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.228+0000 7f95719cbb80 1 -- 172.21.15.149:0/3606942135 shutdown_connections 2023-11-08T19:29:06.253 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.228+0000 7f95719cbb80 1 -- 172.21.15.149:0/3606942135 wait complete. 2023-11-08T19:29:06.253 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.228+0000 7f95719cbb80 20 client.7860 trim_cache size 0 max 16384 2023-11-08T19:29:06.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.246+0000 7f95719cbb80 1 Processor -- start 2023-11-08T19:29:06.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.246+0000 7f95719cbb80 1 -- start start 2023-11-08T19:29:06.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.247+0000 7f95719cbb80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x564caa9886f0 0x564caa987ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:06.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.247+0000 7f95719cbb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564caa988ad0 0x564caa9d5850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:06.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.247+0000 7f95719cbb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564caa989020 0x564caa9d39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:06.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.247+0000 7f95719cbb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x564caa7608d0 con 0x564caa989020 2023-11-08T19:29:06.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.247+0000 7f95719cbb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x564caa98f2a0 con 0x564caa988ad0 2023-11-08T19:29:06.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.247+0000 7f95719cbb80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x564caa98daf0 con 0x564caa9886f0 2023-11-08T19:29:06.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.247+0000 7f955f7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564caa989020 0x564caa9d39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:06.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.247+0000 7f955f7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564caa989020 0x564caa9d39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44984/0 (socket says 172.21.15.149:44984) 2023-11-08T19:29:06.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.247+0000 7f955f7fe700 1 -- 172.21.15.149:0/3793054798 learned_addr learned my addr 172.21.15.149:0/3793054798 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:06.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.247+0000 7f955f7fe700 1 -- 172.21.15.149:0/3793054798 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x564caa9886f0 msgr2=0x564caa987ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:06.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.247+0000 7f955f7fe700 1 --2- 172.21.15.149:0/3793054798 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x564caa9886f0 0x564caa987ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.247+0000 7f955f7fe700 1 -- 172.21.15.149:0/3793054798 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564caa988ad0 msgr2=0x564caa9d5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:06.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.247+0000 7f955f7fe700 1 --2- 172.21.15.149:0/3793054798 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564caa988ad0 0x564caa9d5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.247+0000 7f955f7fe700 1 -- 172.21.15.149:0/3793054798 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564caa6f3c10 con 0x564caa989020 2023-11-08T19:29:06.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.247+0000 7f955f7fe700 1 --2- 172.21.15.149:0/3793054798 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564caa989020 0x564caa9d39e0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f9558001560 tx=0x7f9558009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77efcb4ce05aee87 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:06.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.247+0000 7f95457fa700 1 -- 172.21.15.149:0/3793054798 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95580581f0 con 0x564caa989020 2023-11-08T19:29:06.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.247+0000 7f95457fa700 1 -- 172.21.15.149:0/3793054798 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f955805c340 con 0x564caa989020 2023-11-08T19:29:06.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.247+0000 7f95457fa700 1 -- 172.21.15.149:0/3793054798 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95580604f0 con 0x564caa989020 2023-11-08T19:29:06.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.248+0000 7f95719cbb80 1 -- 172.21.15.149:0/3793054798 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564caa989020 msgr2=0x564caa9d39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:06.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.248+0000 7f95719cbb80 1 --2- 172.21.15.149:0/3793054798 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564caa989020 0x564caa9d39e0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f9558001560 tx=0x7f9558009040 comp rx=0 tx=0).stop 2023-11-08T19:29:06.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.248+0000 7f95719cbb80 1 -- 172.21.15.149:0/3793054798 shutdown_connections 2023-11-08T19:29:06.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.248+0000 7f95719cbb80 1 --2- 172.21.15.149:0/3793054798 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564caa989020 0x564caa9d39e0 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.248+0000 7f95719cbb80 1 --2- 172.21.15.149:0/3793054798 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x564caa9886f0 0x564caa987ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.248+0000 7f95719cbb80 1 --2- 172.21.15.149:0/3793054798 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564caa988ad0 0x564caa9d5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.248+0000 7f95719cbb80 1 -- 172.21.15.149:0/3793054798 >> 172.21.15.149:0/3793054798 conn(0x564caa903660 msgr2=0x564caa98e390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:06.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.248+0000 7f95719cbb80 1 -- 172.21.15.149:0/3793054798 shutdown_connections 2023-11-08T19:29:06.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.248+0000 7f95719cbb80 1 -- 172.21.15.149:0/3793054798 wait complete. 2023-11-08T19:29:06.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.248+0000 7f95719cbb80 1 -- start start 2023-11-08T19:29:06.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.248+0000 7f95719cbb80 1 Processor -- start 2023-11-08T19:29:06.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.249+0000 7f95719cbb80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x564caa9886f0 0x564caa98b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:06.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.249+0000 7f95719cbb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564caa988ad0 0x564caa98ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:06.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.249+0000 7f95719cbb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564caa989020 0x564caaa40100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:06.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.249+0000 7f95719cbb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x564caa9eac80 con 0x564caa988ad0 2023-11-08T19:29:06.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.249+0000 7f95719cbb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x564caa9d06b0 con 0x564caa989020 2023-11-08T19:29:06.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.249+0000 7f95719cbb80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x564caa9d0850 con 0x564caa9886f0 2023-11-08T19:29:06.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.249+0000 7f95719cbb80 10 client.0 _ll_register_callbacks cb 0x7f9550010940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-08T19:29:06.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.249+0000 7f955e7fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564caa988ad0 0x564caa98ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:06.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.249+0000 7f955e7fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564caa988ad0 0x564caa98ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44988/0 (socket says 172.21.15.149:44988) 2023-11-08T19:29:06.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.249+0000 7f955e7fc700 1 -- 172.21.15.149:0/1029483716 learned_addr learned my addr 172.21.15.149:0/1029483716 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:06.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.249+0000 7f955effd700 1 --2- 172.21.15.149:0/1029483716 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x564caa9886f0 0x564caa98b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:06.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.249+0000 7f955f7fe700 1 --2- 172.21.15.149:0/1029483716 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564caa989020 0x564caaa40100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:06.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.250+0000 7f955e7fc700 1 -- 172.21.15.149:0/1029483716 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x564caa9886f0 msgr2=0x564caa98b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:06.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.250+0000 7f955e7fc700 1 --2- 172.21.15.149:0/1029483716 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x564caa9886f0 0x564caa98b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.250+0000 7f955e7fc700 1 -- 172.21.15.149:0/1029483716 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564caa989020 msgr2=0x564caaa40100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:06.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.250+0000 7f955e7fc700 1 --2- 172.21.15.149:0/1029483716 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564caa989020 0x564caaa40100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.250+0000 7f955e7fc700 1 -- 172.21.15.149:0/1029483716 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95600ca170 con 0x564caa988ad0 2023-11-08T19:29:06.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.250+0000 7f955e7fc700 1 --2- 172.21.15.149:0/1029483716 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564caa988ad0 0x564caa98ba00 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f95540098f0 tx=0x7f9554004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6897237f9316acc server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:06.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.250+0000 7f953dffb700 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2023-11-08T19:29:06.270 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.250+0000 7f953dffb700 1 -- 172.21.15.149:0/1029483716 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f955402a030 con 0x564caa988ad0 2023-11-08T19:29:06.270 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.250+0000 7f953dffb700 1 -- 172.21.15.149:0/1029483716 <== mon.0 v2:172.21.15.149:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 7522+0+0 (secure 0 0 0) 0x7f95540043b0 con 0x564caa988ad0 2023-11-08T19:29:06.270 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.250+0000 7f95719cbb80 1 -- 172.21.15.149:0/1029483716 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9554004040 con 0x564caa988ad0 2023-11-08T19:29:06.270 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.250+0000 7f953dffb700 1 -- 172.21.15.149:0/1029483716 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f95540045d0 con 0x564caa988ad0 2023-11-08T19:29:06.270 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.250+0000 7f95719cbb80 10 client.7866 fetch_fsmap learned FSMap version 91 2023-11-08T19:29:06.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.250+0000 7f95719cbb80 1 -- 172.21.15.149:0/1029483716 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=2+}) v3 -- 0x564caa731200 con 0x564caa988ad0 2023-11-08T19:29:06.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.250+0000 7f953dffb700 1 -- 172.21.15.149:0/1029483716 <== mon.0 v2:172.21.15.149:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9554004040 con 0x564caa988ad0 2023-11-08T19:29:06.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.250+0000 7f953dffb700 1 -- 172.21.15.149:0/1029483716 <== mon.0 v2:172.21.15.149:3300/0 5 ==== fsmap(e 91) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f95540036a0 con 0x564caa988ad0 2023-11-08T19:29:06.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.250+0000 7f95719cbb80 10 client.7866 fetch_fsmap finished waiting for FSMap version 91 2023-11-08T19:29:06.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.250+0000 7f95719cbb80 10 client.7866 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-08T19:29:06.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.250+0000 7f95719cbb80 20 client.7866 populate_metadata read hostname 'smithi149' 2023-11-08T19:29:06.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.250+0000 7f95719cbb80 1 --2- 172.21.15.149:0/1029483716 >> [v2:172.21.15.149:6835/3917392643,v1:172.21.15.149:6837/3917392643] conn(0x564caaa40640 0x564caaa40a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:06.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.250+0000 7f95719cbb80 4 client.7866 mds_command: new command op to 7125 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-08T19:29:06.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.250+0000 7f95719cbb80 1 -- 172.21.15.149:0/1029483716 --> [v2:172.21.15.149:6835/3917392643,v1:172.21.15.149:6837/3917392643] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564caa8da5a0 con 0x564caaa40640 2023-11-08T19:29:06.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.250+0000 7f955effd700 1 --2- 172.21.15.149:0/1029483716 >> [v2:172.21.15.149:6835/3917392643,v1:172.21.15.149:6837/3917392643] conn(0x564caaa40640 0x564caaa40a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:06.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.251+0000 7f953dffb700 10 client.7866 ms_handle_connect on v2:172.21.15.149:6835/3917392643 2023-11-08T19:29:06.273 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.251+0000 7f955effd700 1 --2- 172.21.15.149:0/1029483716 >> [v2:172.21.15.149:6835/3917392643,v1:172.21.15.149:6837/3917392643] conn(0x564caaa40640 0x564caaa40a20 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b12581ece6569868 server_cookie=a2a956caac5f6a13 in_seq=0 out_seq=0 2023-11-08T19:29:06.273 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.251+0000 7f953dffb700 1 -- 172.21.15.149:0/1029483716 <== mds.1 v2:172.21.15.149:6835/3917392643 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+328 (crc 0 0 0) 0x564caa8da5a0 con 0x564caaa40640 2023-11-08T19:29:06.273 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.251+0000 7f953dffb700 10 client.7866 handle_command_reply: tid=0 2023-11-08T19:29:06.273 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.251+0000 7f95719cbb80 1 client.7866 shutdown 2023-11-08T19:29:06.273 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.251+0000 7f95719cbb80 1 -- 172.21.15.149:0/1029483716 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564caa988ad0 msgr2=0x564caa98ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:06.274 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.251+0000 7f95719cbb80 1 --2- 172.21.15.149:0/1029483716 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564caa988ad0 0x564caa98ba00 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f95540098f0 tx=0x7f9554004750 comp rx=0 tx=0).stop 2023-11-08T19:29:06.274 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.251+0000 7f95719cbb80 1 -- 172.21.15.149:0/1029483716 shutdown_connections 2023-11-08T19:29:06.274 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.251+0000 7f95719cbb80 1 --2- 172.21.15.149:0/1029483716 >> [v2:172.21.15.149:6835/3917392643,v1:172.21.15.149:6837/3917392643] conn(0x564caaa40640 0x564caaa40a20 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.274 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.251+0000 7f95719cbb80 1 --2- 172.21.15.149:0/1029483716 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564caa989020 0x564caaa40100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.274 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.251+0000 7f95719cbb80 1 --2- 172.21.15.149:0/1029483716 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x564caa9886f0 0x564caa98b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.275 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.251+0000 7f95719cbb80 1 --2- 172.21.15.149:0/1029483716 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564caa988ad0 0x564caa98ba00 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.275 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.251+0000 7f953dffb700 0 client.7866 ms_handle_reset on v2:172.21.15.149:6835/3917392643 2023-11-08T19:29:06.275 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.251+0000 7f95719cbb80 1 -- 172.21.15.149:0/1029483716 >> 172.21.15.149:0/1029483716 conn(0x564caa903660 msgr2=0x564caa98d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:06.275 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.251+0000 7f95719cbb80 1 -- 172.21.15.149:0/1029483716 shutdown_connections 2023-11-08T19:29:06.275 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.251+0000 7f95719cbb80 1 -- 172.21.15.149:0/1029483716 wait complete. 2023-11-08T19:29:06.276 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.251+0000 7f95719cbb80 20 client.7866 trim_cache size 0 max 16384 2023-11-08T19:29:06.276 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2023-11-08T19:29:06.276 INFO:teuthology.orchestra.run.smithi149.stdout: "cluster_fsid": "0aba7c70-fe80-4446-a2f5-7502ac3adfb4", 2023-11-08T19:29:06.276 INFO:teuthology.orchestra.run.smithi149.stdout: "whoami": 1, 2023-11-08T19:29:06.277 INFO:teuthology.orchestra.run.smithi149.stdout: "id": 7125, 2023-11-08T19:29:06.277 INFO:teuthology.orchestra.run.smithi149.stdout: "want_state": "up:active", 2023-11-08T19:29:06.277 INFO:teuthology.orchestra.run.smithi149.stdout: "state": "up:active", 2023-11-08T19:29:06.277 INFO:teuthology.orchestra.run.smithi149.stdout: "fs_name": "cephfs", 2023-11-08T19:29:06.277 INFO:teuthology.orchestra.run.smithi149.stdout: "rank_uptime": 127.606998741, 2023-11-08T19:29:06.278 INFO:teuthology.orchestra.run.smithi149.stdout: "mdsmap_epoch": 91, 2023-11-08T19:29:06.278 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_epoch": 102, 2023-11-08T19:29:06.278 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_epoch_barrier": 102, 2023-11-08T19:29:06.278 INFO:teuthology.orchestra.run.smithi149.stdout: "uptime": 143.59995649499999 2023-11-08T19:29:06.278 INFO:teuthology.orchestra.run.smithi149.stdout:} 2023-11-08T19:29:06.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.252+0000 7f95657d2700 1 -- 172.21.15.149:0/4236030979 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f954c06af00 msgr2=0x7f954c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:06.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.252+0000 7f95657d2700 1 --2- 172.21.15.149:0/4236030979 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f954c06af00 0x7f954c06d3c0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f95601e72a0 tx=0x7f9550008040 comp rx=0 tx=0).stop 2023-11-08T19:29:06.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.252+0000 7f95657d2700 1 -- 172.21.15.149:0/4236030979 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f956015df40 msgr2=0x7f95600b4300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:06.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.252+0000 7f95657d2700 1 --2- 172.21.15.149:0/4236030979 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f956015df40 0x7f95600b4300 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f9558002230 tx=0x7f955800cf50 comp rx=0 tx=0).stop 2023-11-08T19:29:06.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.252+0000 7f95657d2700 1 -- 172.21.15.149:0/4236030979 shutdown_connections 2023-11-08T19:29:06.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.252+0000 7f95657d2700 1 --2- 172.21.15.149:0/4236030979 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f954c06af00 0x7f954c06d3c0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.252+0000 7f95657d2700 1 --2- 172.21.15.149:0/4236030979 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f956015df40 0x7f95600b4300 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.252+0000 7f95657d2700 1 --2- 172.21.15.149:0/4236030979 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95600b2b60 0x7f9560153600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.252+0000 7f95657d2700 1 --2- 172.21.15.149:0/4236030979 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95600d2250 0x7f9560152f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.252+0000 7f95657d2700 1 -- 172.21.15.149:0/4236030979 >> 172.21.15.149:0/4236030979 conn(0x7f95600d1730 msgr2=0x7f95600d1b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:06.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.252+0000 7f95657d2700 1 -- 172.21.15.149:0/4236030979 shutdown_connections 2023-11-08T19:29:06.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.252+0000 7f95657d2700 1 -- 172.21.15.149:0/4236030979 wait complete. 2023-11-08T19:29:06.285 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:29:06.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.406+0000 7ff4b7f92700 1 Processor -- start 2023-11-08T19:29:06.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.406+0000 7ff4b7f92700 1 -- start start 2023-11-08T19:29:06.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.407+0000 7ff4b7f92700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff4b006f7e0 0x7ff4b00cfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:06.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.407+0000 7ff4b7f92700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4b0072df0 con 0x7ff4b00b1ff0 2023-11-08T19:29:06.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.407+0000 7ff4b7f92700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4b0070660 con 0x7ff4b015a780 2023-11-08T19:29:06.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.407+0000 7ff4b7f92700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b006fdc0 con 0x7ff4b006f7e0 2023-11-08T19:29:06.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.407+0000 7ff4b652f700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7ff4b00b1ff0 0x7ff4b00cbc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:47000/0 (socket says 172.21.15.149:47000) 2023-11-08T19:29:06.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.407+0000 7ff4b652f700 1 -- 172.21.15.149:0/292328189 learned_addr learned my addr 172.21.15.149:0/292328189 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:29:06.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.407+0000 7ff4b552d700 1 --2- 172.21.15.149:0/292328189 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff4b006f7e0 0x7ff4b00cfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:06.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.407+0000 7ff4b4d2c700 1 -- 172.21.15.149:0/292328189 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 114277509 0 0) 0x7ff4b0072df0 con 0x7ff4b00b1ff0 2023-11-08T19:29:06.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.407+0000 7ff4b4d2c700 1 -- 172.21.15.149:0/292328189 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff49c0057c0 con 0x7ff4b00b1ff0 2023-11-08T19:29:06.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.407+0000 7ff4b4d2c700 1 -- 172.21.15.149:0/292328189 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1295976700 0 0) 0x7ff49c0057c0 con 0x7ff4b00b1ff0 2023-11-08T19:29:06.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.407+0000 7ff4b4d2c700 1 -- 172.21.15.149:0/292328189 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff4b006f7e0 msgr2=0x7ff4b00cfce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:06.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.407+0000 7ff4b4d2c700 1 --2- 172.21.15.149:0/292328189 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff4b006f7e0 0x7ff4b00cfce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.407+0000 7ff4b4d2c700 1 -- 172.21.15.149:0/292328189 >> v1:172.21.15.160:6789/0 conn(0x7ff4b015a780 legacy=0x7ff4b015ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:06.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.407+0000 7ff4b4d2c700 1 -- 172.21.15.149:0/292328189 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b00700a0 con 0x7ff4b00b1ff0 2023-11-08T19:29:06.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.407+0000 7ff4b4d2c700 1 -- 172.21.15.149:0/292328189 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7ff4a80019f0 con 0x7ff4b00b1ff0 2023-11-08T19:29:06.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.407+0000 7ff4b4d2c700 1 -- 172.21.15.149:0/292328189 >> v1:172.21.15.149:6789/0 conn(0x7ff4b00b1ff0 legacy=0x7ff4b00cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:06.414 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.407+0000 7ff4b4d2c700 1 --2- 172.21.15.149:0/292328189 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff49c005c40 0x7ff49c006060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:06.414 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.407+0000 7ff4b4d2c700 1 --2- 172.21.15.149:0/292328189 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff49c006a60 0x7ff49c006ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:06.414 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.407+0000 7ff4b4d2c700 1 --2- 172.21.15.149:0/292328189 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff4b006f7e0 0x7ff49c007420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:06.414 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.407+0000 7ff4b4d2c700 1 -- 172.21.15.149:0/292328189 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b006fdc0 con 0x7ff49c006a60 2023-11-08T19:29:06.414 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.407+0000 7ff4b4d2c700 1 -- 172.21.15.149:0/292328189 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff49c00dd00 con 0x7ff49c005c40 2023-11-08T19:29:06.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.407+0000 7ff4b4d2c700 1 -- 172.21.15.149:0/292328189 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff49c00dec0 con 0x7ff4b006f7e0 2023-11-08T19:29:06.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.408+0000 7ff4b552d700 1 --2- 172.21.15.149:0/292328189 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff49c006a60 0x7ff49c006ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:06.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.408+0000 7ff4b652f700 1 --2- 172.21.15.149:0/292328189 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff4b006f7e0 0x7ff49c007420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:06.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.408+0000 7ff4b5d2e700 1 --2- 172.21.15.149:0/292328189 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff49c005c40 0x7ff49c006060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:06.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.408+0000 7ff4b552d700 1 -- 172.21.15.149:0/292328189 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff4b006f7e0 msgr2=0x7ff49c007420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:06.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.408+0000 7ff4b552d700 1 --2- 172.21.15.149:0/292328189 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff4b006f7e0 0x7ff49c007420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.408+0000 7ff4b552d700 1 -- 172.21.15.149:0/292328189 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff49c005c40 msgr2=0x7ff49c006060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:06.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.408+0000 7ff4b552d700 1 --2- 172.21.15.149:0/292328189 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff49c005c40 0x7ff49c006060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.417 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.408+0000 7ff4b552d700 1 -- 172.21.15.149:0/292328189 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff49c0057c0 con 0x7ff49c006a60 2023-11-08T19:29:06.417 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.408+0000 7ff4b552d700 1 --2- 172.21.15.149:0/292328189 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff49c006a60 0x7ff49c006ee0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7ff4a0009b30 tx=0x7ff49c007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5caa1221d0ab7ac server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:06.417 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.408+0000 7ff4b4d2c700 1 -- 172.21.15.149:0/292328189 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a000e6c0 con 0x7ff49c006a60 2023-11-08T19:29:06.417 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.408+0000 7ff4b4d2c700 1 -- 172.21.15.149:0/292328189 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a000e820 con 0x7ff49c006a60 2023-11-08T19:29:06.417 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.408+0000 7ff4b4d2c700 1 -- 172.21.15.149:0/292328189 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a000eb90 con 0x7ff49c006a60 2023-11-08T19:29:06.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.409+0000 7ff4b7f92700 1 -- 172.21.15.149:0/292328189 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff49c006a60 msgr2=0x7ff49c006ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:06.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.409+0000 7ff4b7f92700 1 --2- 172.21.15.149:0/292328189 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff49c006a60 0x7ff49c006ee0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7ff4a0009b30 tx=0x7ff49c007a90 comp rx=0 tx=0).stop 2023-11-08T19:29:06.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.409+0000 7ff4b652f700 1 -- 172.21.15.149:0/292328189 reap_dead start 2023-11-08T19:29:06.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.409+0000 7ff4b7f92700 1 -- 172.21.15.149:0/292328189 shutdown_connections 2023-11-08T19:29:06.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.409+0000 7ff4b7f92700 1 -- 172.21.15.149:0/292328189 >> 172.21.15.149:0/292328189 conn(0x7ff4b00ccff0 msgr2=0x7ff4b00cd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:06.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.409+0000 7ff4b7f92700 1 -- 172.21.15.149:0/292328189 shutdown_connections 2023-11-08T19:29:06.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.409+0000 7ff4b7f92700 1 -- 172.21.15.149:0/292328189 wait complete. 2023-11-08T19:29:06.422 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.410+0000 7ff4b7f92700 1 Processor -- start 2023-11-08T19:29:06.422 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.410+0000 7ff4b7f92700 1 -- start start 2023-11-08T19:29:06.422 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.411+0000 7ff4b7f92700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff49c006a60 0x7ff4b0143600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:06.422 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.411+0000 7ff4b7f92700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff4b01519c0 0x7ff4b0152670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:06.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.411+0000 7ff4b7f92700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff4b0154080 0x7ff4b006ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:06.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.411+0000 7ff4b7f92700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b0143b40 con 0x7ff49c006a60 2023-11-08T19:29:06.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.411+0000 7ff4b7f92700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b0152fe0 con 0x7ff4b0154080 2023-11-08T19:29:06.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.411+0000 7ff4b7f92700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b01532c0 con 0x7ff4b01519c0 2023-11-08T19:29:06.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.411+0000 7ff4b5d2e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff49c006a60 0x7ff4b0143600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:06.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.411+0000 7ff4b5d2e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff49c006a60 0x7ff4b0143600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45006/0 (socket says 172.21.15.149:45006) 2023-11-08T19:29:06.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.411+0000 7ff4b5d2e700 1 -- 172.21.15.149:0/1986046402 learned_addr learned my addr 172.21.15.149:0/1986046402 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:06.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.411+0000 7ff4b652f700 1 --2- 172.21.15.149:0/1986046402 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff4b0154080 0x7ff4b006ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:06.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.411+0000 7ff4b552d700 1 --2- 172.21.15.149:0/1986046402 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff4b01519c0 0x7ff4b0152670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:06.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.411+0000 7ff4b5d2e700 1 -- 172.21.15.149:0/1986046402 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff4b01519c0 msgr2=0x7ff4b0152670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:06.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.411+0000 7ff4b5d2e700 1 --2- 172.21.15.149:0/1986046402 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff4b01519c0 0x7ff4b0152670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.411+0000 7ff4b5d2e700 1 -- 172.21.15.149:0/1986046402 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff4b0154080 msgr2=0x7ff4b006ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:06.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.411+0000 7ff4b5d2e700 1 --2- 172.21.15.149:0/1986046402 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff4b0154080 0x7ff4b006ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.411+0000 7ff4b5d2e700 1 -- 172.21.15.149:0/1986046402 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b01535a0 con 0x7ff49c006a60 2023-11-08T19:29:06.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.411+0000 7ff4b652f700 1 --2- 172.21.15.149:0/1986046402 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff4b0154080 0x7ff4b006ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:29:06.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.411+0000 7ff4b552d700 1 --2- 172.21.15.149:0/1986046402 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff4b01519c0 0x7ff4b0152670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:29:06.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.411+0000 7ff4b5d2e700 1 --2- 172.21.15.149:0/1986046402 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff49c006a60 0x7ff4b0143600 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac00f7f0 tx=0x7ff4ac00fbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:06.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.411+0000 7ff4a67fc700 1 -- 172.21.15.149:0/1986046402 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac0052e0 con 0x7ff49c006a60 2023-11-08T19:29:06.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.411+0000 7ff4a67fc700 1 -- 172.21.15.149:0/1986046402 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4ac005440 con 0x7ff49c006a60 2023-11-08T19:29:06.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.411+0000 7ff4b7f92700 1 -- 172.21.15.149:0/1986046402 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4b0153880 con 0x7ff49c006a60 2023-11-08T19:29:06.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.411+0000 7ff4a67fc700 1 -- 172.21.15.149:0/1986046402 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac0038a0 con 0x7ff49c006a60 2023-11-08T19:29:06.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.411+0000 7ff4b7f92700 1 -- 172.21.15.149:0/1986046402 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4b0152bb0 con 0x7ff49c006a60 2023-11-08T19:29:06.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.412+0000 7ff4b7f92700 1 -- 172.21.15.149:0/1986046402 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4b0152d40 con 0x7ff49c006a60 2023-11-08T19:29:06.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.413+0000 7ff4a67fc700 1 -- 172.21.15.149:0/1986046402 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff4ac003a00 con 0x7ff49c006a60 2023-11-08T19:29:06.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.413+0000 7ff4a67fc700 1 --2- 172.21.15.149:0/1986046402 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff49406af00 0x7ff49406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:06.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.413+0000 7ff4a67fc700 1 -- 172.21.15.149:0/1986046402 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 7522+0+0 (secure 0 0 0) 0x7ff4ac089b40 con 0x7ff49c006a60 2023-11-08T19:29:06.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.413+0000 7ff4b552d700 1 --2- 172.21.15.149:0/1986046402 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff49406af00 0x7ff49406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:06.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.414+0000 7ff4b552d700 1 --2- 172.21.15.149:0/1986046402 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff49406af00 0x7ff49406d3c0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7ff4b015dc50 tx=0x7ff4a0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:06.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.418+0000 7ff4a67fc700 1 -- 172.21.15.149:0/1986046402 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff4ac054440 con 0x7ff49c006a60 2023-11-08T19:29:06.650 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.649+0000 7ff4b7f92700 1 -- 172.21.15.149:0/1986046402 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff4b00745f0 con 0x7ff49c006a60 2023-11-08T19:29:06.651 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.650+0000 7ff4a67fc700 1 -- 172.21.15.149:0/1986046402 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+4941 (secure 0 0 0) 0x7ff4ac003cb0 con 0x7ff49c006a60 2023-11-08T19:29:06.651 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:29:06.651 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":91,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6095,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/852710262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":852710262},{"type":"v1","addr":"172.21.15.160:6835","nonce":852710262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64},{"gid":7812,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/2818321595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2818321595},{"type":"v1","addr":"172.21.15.149:6836","nonce":2818321595}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:29:02.319250+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6236,"mds_1":7125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6236":{"gid":6236,"name":"d","rank":0,"incarnation":87,"state":"up:active","state_seq":12,"addr":"172.21.15.160:6834/1313631099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":1313631099},{"type":"v1","addr":"172.21.15.160:6834","nonce":1313631099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7125":{"gid":7125,"name":"c","rank":1,"incarnation":57,"state":"up:active","state_seq":6,"addr":"172.21.15.149:6837/3917392643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3917392643},{"type":"v1","addr":"172.21.15.149:6837","nonce":3917392643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:29:06.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.652+0000 7ff4b7f92700 1 -- 172.21.15.149:0/1986046402 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff49406af00 msgr2=0x7ff49406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:06.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.652+0000 7ff4b7f92700 1 --2- 172.21.15.149:0/1986046402 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff49406af00 0x7ff49406d3c0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7ff4b015dc50 tx=0x7ff4a0008030 comp rx=0 tx=0).stop 2023-11-08T19:29:06.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.652+0000 7ff4b7f92700 1 -- 172.21.15.149:0/1986046402 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff49c006a60 msgr2=0x7ff4b0143600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:06.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.652+0000 7ff4b7f92700 1 --2- 172.21.15.149:0/1986046402 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff49c006a60 0x7ff4b0143600 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac00f7f0 tx=0x7ff4ac00fbb0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.652+0000 7ff4b7f92700 1 -- 172.21.15.149:0/1986046402 shutdown_connections 2023-11-08T19:29:06.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.652+0000 7ff4b7f92700 1 --2- 172.21.15.149:0/1986046402 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff49406af00 0x7ff49406d3c0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.652+0000 7ff4b7f92700 1 --2- 172.21.15.149:0/1986046402 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff4b0154080 0x7ff4b006ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.652+0000 7ff4b7f92700 1 --2- 172.21.15.149:0/1986046402 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff49c006a60 0x7ff4b0143600 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.652+0000 7ff4b7f92700 1 --2- 172.21.15.149:0/1986046402 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff4b01519c0 0x7ff4b0152670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:06.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.652+0000 7ff4b7f92700 1 -- 172.21.15.149:0/1986046402 >> 172.21.15.149:0/1986046402 conn(0x7ff4b00ccff0 msgr2=0x7ff4b01589c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:06.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.652+0000 7ff4b7f92700 1 -- 172.21.15.149:0/1986046402 shutdown_connections 2023-11-08T19:29:06.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:06.652+0000 7ff4b7f92700 1 -- 172.21.15.149:0/1986046402 wait complete. 2023-11-08T19:29:06.656 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 91 2023-11-08T19:29:06.665 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json dump snaps --server 2023-11-08T19:29:06.815 INFO:teuthology.orchestra.run.smithi160.stdout:{"last_snap":5,"last_created":5,"last_destroyed":1,"pending_noop":[],"snaps":[{"snapid":2,"ino":1099511627777,"stamp":"2023-11-08T19:27:11.331978+0000","name":"s11","metadata":{}},{"snapid":3,"ino":1099511627777,"stamp":"2023-11-08T19:27:43.330783+0000","name":"s12","metadata":{}},{"snapid":4,"ino":1099511627777,"stamp":"2023-11-08T19:28:09.994390+0000","name":"s15","metadata":{}},{"snapid":5,"ino":1099511627777,"stamp":"2023-11-08T19:28:36.545901+0000","name":"s16","metadata":{}}],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-08T19:29:06.815 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 5, "last_destroyed": 1, "last_snap": 5, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s11", "snapid": 2, "stamp": "2023-11-08T19:27:11.331978+0000" }, { "ino": 1099511627777, "metadata": {}, "name": "s12", "snapid": 3, "stamp": "2023-11-08T19:27:43.330783+0000" }, { "ino": 1099511627777, "metadata": {}, "name": "s15", "snapid": 4, "stamp": "2023-11-08T19:28:09.994390+0000" }, { "ino": 1099511627777, "metadata": {}, "name": "s16", "snapid": 5, "stamp": "2023-11-08T19:28:36.545901+0000" } ] } 2023-11-08T19:29:06.816 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-11-08T19:29:06.817 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-08T19:29:06.820 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-08T19:29:06.864 INFO:teuthology.orchestra.run.smithi149.stdout:[global] 2023-11-08T19:29:06.865 INFO:teuthology.orchestra.run.smithi149.stdout: chdir = "" 2023-11-08T19:29:06.865 INFO:teuthology.orchestra.run.smithi149.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-08T19:29:06.865 INFO:teuthology.orchestra.run.smithi149.stdout: auth supported = cephx 2023-11-08T19:29:06.865 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:29:06.865 INFO:teuthology.orchestra.run.smithi149.stdout: filestore xattr use omap = true 2023-11-08T19:29:06.866 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:29:06.866 INFO:teuthology.orchestra.run.smithi149.stdout: mon clock drift allowed = 1.000 2023-11-08T19:29:06.866 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:29:06.866 INFO:teuthology.orchestra.run.smithi149.stdout: osd crush chooseleaf type = 0 2023-11-08T19:29:06.866 INFO:teuthology.orchestra.run.smithi149.stdout: auth debug = true 2023-11-08T19:29:06.867 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:29:06.867 INFO:teuthology.orchestra.run.smithi149.stdout: ms die on old message = true 2023-11-08T19:29:06.867 INFO:teuthology.orchestra.run.smithi149.stdout: ms die on bug = true 2023-11-08T19:29:06.867 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:29:06.867 INFO:teuthology.orchestra.run.smithi149.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-08T19:29:06.868 INFO:teuthology.orchestra.run.smithi149.stdout: mon pg warn max object skew = 0 2023-11-08T19:29:06.868 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:29:06.868 INFO:teuthology.orchestra.run.smithi149.stdout: # disable pg_autoscaler by default for new pools 2023-11-08T19:29:06.868 INFO:teuthology.orchestra.run.smithi149.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-08T19:29:06.868 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:29:06.869 INFO:teuthology.orchestra.run.smithi149.stdout: osd pool default size = 2 2023-11-08T19:29:06.869 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:29:06.869 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd allow primary affinity = true 2023-11-08T19:29:06.869 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd allow pg remap = true 2023-11-08T19:29:06.869 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on legacy crush tunables = false 2023-11-08T19:29:06.869 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on crush straw calc version zero = false 2023-11-08T19:29:06.870 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on no sortbitwise = false 2023-11-08T19:29:06.870 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on osd down out interval zero = false 2023-11-08T19:29:06.870 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on too few osds = false 2023-11-08T19:29:06.870 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-08T19:29:06.870 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-08T19:29:06.871 INFO:teuthology.orchestra.run.smithi149.stdout: mon_allow_pool_size_one = true 2023-11-08T19:29:06.871 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:29:06.871 INFO:teuthology.orchestra.run.smithi149.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-08T19:29:06.871 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:29:06.871 INFO:teuthology.orchestra.run.smithi149.stdout: osd default data pool replay window = 5 2023-11-08T19:29:06.872 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:29:06.872 INFO:teuthology.orchestra.run.smithi149.stdout: mon allow pool delete = true 2023-11-08T19:29:06.872 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:29:06.872 INFO:teuthology.orchestra.run.smithi149.stdout: mon cluster log file level = debug 2023-11-08T19:29:06.872 INFO:teuthology.orchestra.run.smithi149.stdout: debug asserts on shutdown = true 2023-11-08T19:29:06.873 INFO:teuthology.orchestra.run.smithi149.stdout: mon health detail to clog = false 2023-11-08T19:29:06.873 INFO:teuthology.orchestra.run.smithi149.stdout: mon host = "172.21.15.149,172.21.15.160,[v2:172.21.15.160:3301,v1:172.21.15.160:6790]" 2023-11-08T19:29:06.873 INFO:teuthology.orchestra.run.smithi149.stdout: ms die on skipped message = False 2023-11-08T19:29:06.873 INFO:teuthology.orchestra.run.smithi149.stdout: fsid = 0aba7c70-fe80-4446-a2f5-7502ac3adfb4 2023-11-08T19:29:06.873 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:29:06.873 INFO:teuthology.orchestra.run.smithi149.stdout:[osd] 2023-11-08T19:29:06.874 INFO:teuthology.orchestra.run.smithi149.stdout: osd journal size = 100 2023-11-08T19:29:06.874 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:29:06.874 INFO:teuthology.orchestra.run.smithi149.stdout: osd scrub load threshold = 5.0 2023-11-08T19:29:06.874 INFO:teuthology.orchestra.run.smithi149.stdout: osd scrub max interval = 600 2023-11-08T19:29:06.874 INFO:teuthology.orchestra.run.smithi149.stdout: osd mclock profile = high_recovery_ops 2023-11-08T19:29:06.875 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:29:06.875 INFO:teuthology.orchestra.run.smithi149.stdout: osd recover clone overlap = true 2023-11-08T19:29:06.875 INFO:teuthology.orchestra.run.smithi149.stdout: osd recovery max chunk = 1048576 2023-11-08T19:29:06.875 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:29:06.875 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug shutdown = true 2023-11-08T19:29:06.876 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug op order = true 2023-11-08T19:29:06.876 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug verify stray on activate = true 2023-11-08T19:29:06.876 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug trim objects = true 2023-11-08T19:29:06.876 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:29:06.876 INFO:teuthology.orchestra.run.smithi149.stdout: osd open classes on start = true 2023-11-08T19:29:06.876 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug pg log writeout = true 2023-11-08T19:29:06.877 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:29:06.877 INFO:teuthology.orchestra.run.smithi149.stdout: osd deep scrub update digest min age = 30 2023-11-08T19:29:06.877 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:29:06.877 INFO:teuthology.orchestra.run.smithi149.stdout: osd map max advance = 10 2023-11-08T19:29:06.877 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:29:06.878 INFO:teuthology.orchestra.run.smithi149.stdout: journal zero on create = true 2023-11-08T19:29:06.878 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:29:06.878 INFO:teuthology.orchestra.run.smithi149.stdout: filestore ondisk finisher threads = 3 2023-11-08T19:29:06.878 INFO:teuthology.orchestra.run.smithi149.stdout: filestore apply finisher threads = 3 2023-11-08T19:29:06.878 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:29:06.879 INFO:teuthology.orchestra.run.smithi149.stdout: bdev debug aio = true 2023-11-08T19:29:06.879 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug misdirected ops = true 2023-11-08T19:29:06.879 INFO:teuthology.orchestra.run.smithi149.stdout: bluestore block size = 96636764160 2023-11-08T19:29:06.879 INFO:teuthology.orchestra.run.smithi149.stdout: bluestore fsck on mount = True 2023-11-08T19:29:06.879 INFO:teuthology.orchestra.run.smithi149.stdout: debug bluefs = 20 2023-11-08T19:29:06.879 INFO:teuthology.orchestra.run.smithi149.stdout: debug bluestore = 20 2023-11-08T19:29:06.880 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2023-11-08T19:29:06.880 INFO:teuthology.orchestra.run.smithi149.stdout: debug osd = 20 2023-11-08T19:29:06.880 INFO:teuthology.orchestra.run.smithi149.stdout: debug rocksdb = 10 2023-11-08T19:29:06.880 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd backfillfull_ratio = 0.85 2023-11-08T19:29:06.880 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd full ratio = 0.9 2023-11-08T19:29:06.881 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd nearfull ratio = 0.8 2023-11-08T19:29:06.881 INFO:teuthology.orchestra.run.smithi149.stdout: osd failsafe full ratio = 0.95 2023-11-08T19:29:06.881 INFO:teuthology.orchestra.run.smithi149.stdout: osd objectstore = bluestore 2023-11-08T19:29:06.881 INFO:teuthology.orchestra.run.smithi149.stdout: osd op complaint time = 180 2023-11-08T19:29:06.881 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:29:06.882 INFO:teuthology.orchestra.run.smithi149.stdout:[mgr] 2023-11-08T19:29:06.882 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2023-11-08T19:29:06.882 INFO:teuthology.orchestra.run.smithi149.stdout: debug mgr = 20 2023-11-08T19:29:06.882 INFO:teuthology.orchestra.run.smithi149.stdout: debug mon = 20 2023-11-08T19:29:06.882 INFO:teuthology.orchestra.run.smithi149.stdout: debug auth = 20 2023-11-08T19:29:06.883 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min pgs per osd = 4 2023-11-08T19:29:06.883 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min bytes per osd = 10 2023-11-08T19:29:06.883 INFO:teuthology.orchestra.run.smithi149.stdout: mgr/telemetry/nag = false 2023-11-08T19:29:06.883 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:29:06.883 INFO:teuthology.orchestra.run.smithi149.stdout:[mon] 2023-11-08T19:29:06.883 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2023-11-08T19:29:06.884 INFO:teuthology.orchestra.run.smithi149.stdout: debug mon = 20 2023-11-08T19:29:06.884 INFO:teuthology.orchestra.run.smithi149.stdout: debug paxos = 20 2023-11-08T19:29:06.884 INFO:teuthology.orchestra.run.smithi149.stdout: debug auth = 20 2023-11-08T19:29:06.884 INFO:teuthology.orchestra.run.smithi149.stdout: mon data avail warn = 5 2023-11-08T19:29:06.884 INFO:teuthology.orchestra.run.smithi149.stdout: mon mgr mkfs grace = 240 2023-11-08T19:29:06.885 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min pgs per osd = 4 2023-11-08T19:29:06.885 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd reporter subtree level = osd 2023-11-08T19:29:06.885 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd prime pg temp = true 2023-11-08T19:29:06.885 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min bytes per osd = 10 2023-11-08T19:29:06.885 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:29:06.886 INFO:teuthology.orchestra.run.smithi149.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-08T19:29:06.886 INFO:teuthology.orchestra.run.smithi149.stdout: auth mon ticket ttl = 660 # 11m 2023-11-08T19:29:06.886 INFO:teuthology.orchestra.run.smithi149.stdout: auth service ticket ttl = 240 # 4m 2023-11-08T19:29:06.886 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:29:06.886 INFO:teuthology.orchestra.run.smithi149.stdout: # don't complain about insecure global_id in the test suite 2023-11-08T19:29:06.887 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-08T19:29:06.887 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-08T19:29:06.887 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:29:06.887 INFO:teuthology.orchestra.run.smithi149.stdout: # 1m isn't quite enough 2023-11-08T19:29:06.887 INFO:teuthology.orchestra.run.smithi149.stdout: mon_down_mkfs_grace = 2m 2023-11-08T19:29:06.888 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:29:06.888 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_filestore_osds = false 2023-11-08T19:29:06.888 INFO:teuthology.orchestra.run.smithi149.stdout: mon op complaint time = 120 2023-11-08T19:29:06.888 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:29:06.888 INFO:teuthology.orchestra.run.smithi149.stdout:[client] 2023-11-08T19:29:06.888 INFO:teuthology.orchestra.run.smithi149.stdout: rgw cache enabled = true 2023-11-08T19:29:06.889 INFO:teuthology.orchestra.run.smithi149.stdout: rgw enable ops log = true 2023-11-08T19:29:06.889 INFO:teuthology.orchestra.run.smithi149.stdout: rgw enable usage log = true 2023-11-08T19:29:06.889 INFO:teuthology.orchestra.run.smithi149.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-08T19:29:06.889 INFO:teuthology.orchestra.run.smithi149.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-08T19:29:06.889 INFO:teuthology.orchestra.run.smithi149.stdout: client mount timeout = 600 2023-11-08T19:29:06.890 INFO:teuthology.orchestra.run.smithi149.stdout: debug client = 20 2023-11-08T19:29:06.890 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2023-11-08T19:29:06.890 INFO:teuthology.orchestra.run.smithi149.stdout: pid file = "" 2023-11-08T19:29:06.890 INFO:teuthology.orchestra.run.smithi149.stdout: rados mon op timeout = 900 2023-11-08T19:29:06.890 INFO:teuthology.orchestra.run.smithi149.stdout: rados osd op timeout = 900 2023-11-08T19:29:06.891 INFO:teuthology.orchestra.run.smithi149.stdout:[mon.a] 2023-11-08T19:29:06.891 INFO:teuthology.orchestra.run.smithi149.stdout:[mon.b] 2023-11-08T19:29:06.891 INFO:teuthology.orchestra.run.smithi149.stdout:[mon.c] 2023-11-08T19:29:06.891 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.a] 2023-11-08T19:29:06.891 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.c] 2023-11-08T19:29:06.891 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.b] 2023-11-08T19:29:06.892 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.d] 2023-11-08T19:29:06.892 INFO:teuthology.orchestra.run.smithi149.stdout:[mds] 2023-11-08T19:29:06.892 INFO:teuthology.orchestra.run.smithi149.stdout: debug mds = 20 2023-11-08T19:29:06.892 INFO:teuthology.orchestra.run.smithi149.stdout: debug mds balancer = 20 2023-11-08T19:29:06.892 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2023-11-08T19:29:06.893 INFO:teuthology.orchestra.run.smithi149.stdout: mds debug frag = True 2023-11-08T19:29:06.893 INFO:teuthology.orchestra.run.smithi149.stdout: mds debug scatterstat = True 2023-11-08T19:29:06.893 INFO:teuthology.orchestra.run.smithi149.stdout: mds op complaint time = 180 2023-11-08T19:29:06.893 INFO:teuthology.orchestra.run.smithi149.stdout: mds verify scatter = True 2023-11-08T19:29:06.893 INFO:teuthology.orchestra.run.smithi149.stdout: osd op complaint time = 180 2023-11-08T19:29:06.894 INFO:teuthology.orchestra.run.smithi149.stdout: rados mon op timeout = 900 2023-11-08T19:29:06.894 INFO:teuthology.orchestra.run.smithi149.stdout: rados osd op timeout = 900 2023-11-08T19:29:06.894 INFO:teuthology.orchestra.run.smithi149.stdout: mds_reconnect_timeout = 5 2023-11-08T19:29:06.896 INFO:teuthology.orchestra.run.smithi160.stdout:[global] 2023-11-08T19:29:06.896 INFO:teuthology.orchestra.run.smithi160.stdout: chdir = "" 2023-11-08T19:29:06.896 INFO:teuthology.orchestra.run.smithi160.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-08T19:29:06.896 INFO:teuthology.orchestra.run.smithi160.stdout: auth supported = cephx 2023-11-08T19:29:06.896 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:29:06.897 INFO:teuthology.orchestra.run.smithi160.stdout: filestore xattr use omap = true 2023-11-08T19:29:06.897 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:29:06.897 INFO:teuthology.orchestra.run.smithi160.stdout: mon clock drift allowed = 1.000 2023-11-08T19:29:06.897 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:29:06.897 INFO:teuthology.orchestra.run.smithi160.stdout: osd crush chooseleaf type = 0 2023-11-08T19:29:06.898 INFO:teuthology.orchestra.run.smithi160.stdout: auth debug = true 2023-11-08T19:29:06.898 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:29:06.898 INFO:teuthology.orchestra.run.smithi160.stdout: ms die on old message = true 2023-11-08T19:29:06.898 INFO:teuthology.orchestra.run.smithi160.stdout: ms die on bug = true 2023-11-08T19:29:06.898 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:29:06.899 INFO:teuthology.orchestra.run.smithi160.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-08T19:29:06.899 INFO:teuthology.orchestra.run.smithi160.stdout: mon pg warn max object skew = 0 2023-11-08T19:29:06.899 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:29:06.899 INFO:teuthology.orchestra.run.smithi160.stdout: # disable pg_autoscaler by default for new pools 2023-11-08T19:29:06.899 INFO:teuthology.orchestra.run.smithi160.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-08T19:29:06.900 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:29:06.900 INFO:teuthology.orchestra.run.smithi160.stdout: osd pool default size = 2 2023-11-08T19:29:06.900 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:29:06.900 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd allow primary affinity = true 2023-11-08T19:29:06.900 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd allow pg remap = true 2023-11-08T19:29:06.901 INFO:teuthology.orchestra.run.smithi160.stdout: mon warn on legacy crush tunables = false 2023-11-08T19:29:06.901 INFO:teuthology.orchestra.run.smithi160.stdout: mon warn on crush straw calc version zero = false 2023-11-08T19:29:06.901 INFO:teuthology.orchestra.run.smithi160.stdout: mon warn on no sortbitwise = false 2023-11-08T19:29:06.901 INFO:teuthology.orchestra.run.smithi160.stdout: mon warn on osd down out interval zero = false 2023-11-08T19:29:06.901 INFO:teuthology.orchestra.run.smithi160.stdout: mon warn on too few osds = false 2023-11-08T19:29:06.902 INFO:teuthology.orchestra.run.smithi160.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-08T19:29:06.902 INFO:teuthology.orchestra.run.smithi160.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-08T19:29:06.902 INFO:teuthology.orchestra.run.smithi160.stdout: mon_allow_pool_size_one = true 2023-11-08T19:29:06.902 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:29:06.902 INFO:teuthology.orchestra.run.smithi160.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-08T19:29:06.902 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:29:06.903 INFO:teuthology.orchestra.run.smithi160.stdout: osd default data pool replay window = 5 2023-11-08T19:29:06.903 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:29:06.903 INFO:teuthology.orchestra.run.smithi160.stdout: mon allow pool delete = true 2023-11-08T19:29:06.903 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:29:06.903 INFO:teuthology.orchestra.run.smithi160.stdout: mon cluster log file level = debug 2023-11-08T19:29:06.904 INFO:teuthology.orchestra.run.smithi160.stdout: debug asserts on shutdown = true 2023-11-08T19:29:06.904 INFO:teuthology.orchestra.run.smithi160.stdout: mon health detail to clog = false 2023-11-08T19:29:06.904 INFO:teuthology.orchestra.run.smithi160.stdout: mon host = "172.21.15.149,172.21.15.160,[v2:172.21.15.160:3301,v1:172.21.15.160:6790]" 2023-11-08T19:29:06.904 INFO:teuthology.orchestra.run.smithi160.stdout: ms die on skipped message = False 2023-11-08T19:29:06.904 INFO:teuthology.orchestra.run.smithi160.stdout: fsid = 0aba7c70-fe80-4446-a2f5-7502ac3adfb4 2023-11-08T19:29:06.905 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:29:06.905 INFO:teuthology.orchestra.run.smithi160.stdout:[osd] 2023-11-08T19:29:06.905 INFO:teuthology.orchestra.run.smithi160.stdout: osd journal size = 100 2023-11-08T19:29:06.905 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:29:06.905 INFO:teuthology.orchestra.run.smithi160.stdout: osd scrub load threshold = 5.0 2023-11-08T19:29:06.906 INFO:teuthology.orchestra.run.smithi160.stdout: osd scrub max interval = 600 2023-11-08T19:29:06.906 INFO:teuthology.orchestra.run.smithi160.stdout: osd mclock profile = high_recovery_ops 2023-11-08T19:29:06.906 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:29:06.906 INFO:teuthology.orchestra.run.smithi160.stdout: osd recover clone overlap = true 2023-11-08T19:29:06.906 INFO:teuthology.orchestra.run.smithi160.stdout: osd recovery max chunk = 1048576 2023-11-08T19:29:06.907 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:29:06.907 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug shutdown = true 2023-11-08T19:29:06.907 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug op order = true 2023-11-08T19:29:06.907 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug verify stray on activate = true 2023-11-08T19:29:06.907 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug trim objects = true 2023-11-08T19:29:06.907 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:29:06.908 INFO:teuthology.orchestra.run.smithi160.stdout: osd open classes on start = true 2023-11-08T19:29:06.908 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug pg log writeout = true 2023-11-08T19:29:06.908 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:29:06.908 INFO:teuthology.orchestra.run.smithi160.stdout: osd deep scrub update digest min age = 30 2023-11-08T19:29:06.908 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:29:06.909 INFO:teuthology.orchestra.run.smithi160.stdout: osd map max advance = 10 2023-11-08T19:29:06.909 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:29:06.909 INFO:teuthology.orchestra.run.smithi160.stdout: journal zero on create = true 2023-11-08T19:29:06.909 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:29:06.909 INFO:teuthology.orchestra.run.smithi160.stdout: filestore ondisk finisher threads = 3 2023-11-08T19:29:06.910 INFO:teuthology.orchestra.run.smithi160.stdout: filestore apply finisher threads = 3 2023-11-08T19:29:06.910 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:29:06.910 INFO:teuthology.orchestra.run.smithi160.stdout: bdev debug aio = true 2023-11-08T19:29:06.910 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug misdirected ops = true 2023-11-08T19:29:06.910 INFO:teuthology.orchestra.run.smithi160.stdout: bluestore block size = 96636764160 2023-11-08T19:29:06.911 INFO:teuthology.orchestra.run.smithi160.stdout: bluestore fsck on mount = True 2023-11-08T19:29:06.911 INFO:teuthology.orchestra.run.smithi160.stdout: debug bluefs = 20 2023-11-08T19:29:06.911 INFO:teuthology.orchestra.run.smithi160.stdout: debug bluestore = 20 2023-11-08T19:29:06.911 INFO:teuthology.orchestra.run.smithi160.stdout: debug ms = 1 2023-11-08T19:29:06.911 INFO:teuthology.orchestra.run.smithi160.stdout: debug osd = 20 2023-11-08T19:29:06.911 INFO:teuthology.orchestra.run.smithi160.stdout: debug rocksdb = 10 2023-11-08T19:29:06.912 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd backfillfull_ratio = 0.85 2023-11-08T19:29:06.912 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd full ratio = 0.9 2023-11-08T19:29:06.912 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd nearfull ratio = 0.8 2023-11-08T19:29:06.912 INFO:teuthology.orchestra.run.smithi160.stdout: osd failsafe full ratio = 0.95 2023-11-08T19:29:06.912 INFO:teuthology.orchestra.run.smithi160.stdout: osd objectstore = bluestore 2023-11-08T19:29:06.913 INFO:teuthology.orchestra.run.smithi160.stdout: osd op complaint time = 180 2023-11-08T19:29:06.913 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:29:06.913 INFO:teuthology.orchestra.run.smithi160.stdout:[mgr] 2023-11-08T19:29:06.913 INFO:teuthology.orchestra.run.smithi160.stdout: debug ms = 1 2023-11-08T19:29:06.913 INFO:teuthology.orchestra.run.smithi160.stdout: debug mgr = 20 2023-11-08T19:29:06.913 INFO:teuthology.orchestra.run.smithi160.stdout: debug mon = 20 2023-11-08T19:29:06.914 INFO:teuthology.orchestra.run.smithi160.stdout: debug auth = 20 2023-11-08T19:29:06.914 INFO:teuthology.orchestra.run.smithi160.stdout: mon reweight min pgs per osd = 4 2023-11-08T19:29:06.914 INFO:teuthology.orchestra.run.smithi160.stdout: mon reweight min bytes per osd = 10 2023-11-08T19:29:06.914 INFO:teuthology.orchestra.run.smithi160.stdout: mgr/telemetry/nag = false 2023-11-08T19:29:06.914 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:29:06.915 INFO:teuthology.orchestra.run.smithi160.stdout:[mon] 2023-11-08T19:29:06.915 INFO:teuthology.orchestra.run.smithi160.stdout: debug ms = 1 2023-11-08T19:29:06.915 INFO:teuthology.orchestra.run.smithi160.stdout: debug mon = 20 2023-11-08T19:29:06.915 INFO:teuthology.orchestra.run.smithi160.stdout: debug paxos = 20 2023-11-08T19:29:06.915 INFO:teuthology.orchestra.run.smithi160.stdout: debug auth = 20 2023-11-08T19:29:06.916 INFO:teuthology.orchestra.run.smithi160.stdout: mon data avail warn = 5 2023-11-08T19:29:06.916 INFO:teuthology.orchestra.run.smithi160.stdout: mon mgr mkfs grace = 240 2023-11-08T19:29:06.916 INFO:teuthology.orchestra.run.smithi160.stdout: mon reweight min pgs per osd = 4 2023-11-08T19:29:06.916 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd reporter subtree level = osd 2023-11-08T19:29:06.916 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd prime pg temp = true 2023-11-08T19:29:06.916 INFO:teuthology.orchestra.run.smithi160.stdout: mon reweight min bytes per osd = 10 2023-11-08T19:29:06.917 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:29:06.917 INFO:teuthology.orchestra.run.smithi160.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-08T19:29:06.917 INFO:teuthology.orchestra.run.smithi160.stdout: auth mon ticket ttl = 660 # 11m 2023-11-08T19:29:06.917 INFO:teuthology.orchestra.run.smithi160.stdout: auth service ticket ttl = 240 # 4m 2023-11-08T19:29:06.917 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:29:06.918 INFO:teuthology.orchestra.run.smithi160.stdout: # don't complain about insecure global_id in the test suite 2023-11-08T19:29:06.918 INFO:teuthology.orchestra.run.smithi160.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-08T19:29:06.918 INFO:teuthology.orchestra.run.smithi160.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-08T19:29:06.918 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:29:06.918 INFO:teuthology.orchestra.run.smithi160.stdout: # 1m isn't quite enough 2023-11-08T19:29:06.919 INFO:teuthology.orchestra.run.smithi160.stdout: mon_down_mkfs_grace = 2m 2023-11-08T19:29:06.919 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:29:06.919 INFO:teuthology.orchestra.run.smithi160.stdout: mon_warn_on_filestore_osds = false 2023-11-08T19:29:06.919 INFO:teuthology.orchestra.run.smithi160.stdout: mon op complaint time = 120 2023-11-08T19:29:06.919 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:29:06.919 INFO:teuthology.orchestra.run.smithi160.stdout:[client] 2023-11-08T19:29:06.920 INFO:teuthology.orchestra.run.smithi160.stdout: rgw cache enabled = true 2023-11-08T19:29:06.920 INFO:teuthology.orchestra.run.smithi160.stdout: rgw enable ops log = true 2023-11-08T19:29:06.920 INFO:teuthology.orchestra.run.smithi160.stdout: rgw enable usage log = true 2023-11-08T19:29:06.920 INFO:teuthology.orchestra.run.smithi160.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-08T19:29:06.920 INFO:teuthology.orchestra.run.smithi160.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-08T19:29:06.921 INFO:teuthology.orchestra.run.smithi160.stdout: client mount timeout = 600 2023-11-08T19:29:06.921 INFO:teuthology.orchestra.run.smithi160.stdout: debug client = 20 2023-11-08T19:29:06.921 INFO:teuthology.orchestra.run.smithi160.stdout: debug ms = 1 2023-11-08T19:29:06.921 INFO:teuthology.orchestra.run.smithi160.stdout: pid file = "" 2023-11-08T19:29:06.921 INFO:teuthology.orchestra.run.smithi160.stdout: rados mon op timeout = 900 2023-11-08T19:29:06.922 INFO:teuthology.orchestra.run.smithi160.stdout: rados osd op timeout = 900 2023-11-08T19:29:06.922 INFO:teuthology.orchestra.run.smithi160.stdout:[mon.a] 2023-11-08T19:29:06.922 INFO:teuthology.orchestra.run.smithi160.stdout:[mon.b] 2023-11-08T19:29:06.922 INFO:teuthology.orchestra.run.smithi160.stdout:[mon.c] 2023-11-08T19:29:06.922 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.a] 2023-11-08T19:29:06.923 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.c] 2023-11-08T19:29:06.923 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.b] 2023-11-08T19:29:06.923 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.d] 2023-11-08T19:29:06.923 INFO:teuthology.orchestra.run.smithi160.stdout:[mds] 2023-11-08T19:29:06.923 INFO:teuthology.orchestra.run.smithi160.stdout: debug mds = 20 2023-11-08T19:29:06.923 INFO:teuthology.orchestra.run.smithi160.stdout: debug mds balancer = 20 2023-11-08T19:29:06.924 INFO:teuthology.orchestra.run.smithi160.stdout: debug ms = 1 2023-11-08T19:29:06.924 INFO:teuthology.orchestra.run.smithi160.stdout: mds debug frag = True 2023-11-08T19:29:06.924 INFO:teuthology.orchestra.run.smithi160.stdout: mds debug scatterstat = True 2023-11-08T19:29:06.924 INFO:teuthology.orchestra.run.smithi160.stdout: mds op complaint time = 180 2023-11-08T19:29:06.924 INFO:teuthology.orchestra.run.smithi160.stdout: mds verify scatter = True 2023-11-08T19:29:06.925 INFO:teuthology.orchestra.run.smithi160.stdout: osd op complaint time = 180 2023-11-08T19:29:06.925 INFO:teuthology.orchestra.run.smithi160.stdout: rados mon op timeout = 900 2023-11-08T19:29:06.925 INFO:teuthology.orchestra.run.smithi160.stdout: rados osd op timeout = 900 2023-11-08T19:29:06.925 INFO:teuthology.orchestra.run.smithi160.stdout: mds_reconnect_timeout = 5 2023-11-08T19:29:06.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:29:06.926 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir d1/dir/.snap/*) 2023-11-08T19:29:06.970 INFO:tasks.cephfs.test_snapshots:testing snapserver mds_kill_mdstable_at=2, also kill snapclient 2023-11-08T19:29:06.971 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:29:07.131 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.130+0000 7f9835157700 1 Processor -- start 2023-11-08T19:29:07.132 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.130+0000 7f9835157700 1 -- start start 2023-11-08T19:29:07.135 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.131+0000 7f9835157700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f98300b20f0 0x7f983006fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:07.135 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.131+0000 7f9835157700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f9830072b70 0x7f98300b24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:07.135 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.131+0000 7f9835157700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f983006ffd0 con 0x7f983015ebe0 2023-11-08T19:29:07.135 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.131+0000 7f9835157700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98300b2a10 con 0x7f9830072b70 2023-11-08T19:29:07.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.131+0000 7f9835157700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9830070200 con 0x7f98300b20f0 2023-11-08T19:29:07.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.131+0000 7f982e59c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f9830072b70 0x7f98300b24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:07.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.131+0000 7f982e59c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f9830072b70 0x7f98300b24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45016/0 (socket says 172.21.15.149:45016) 2023-11-08T19:29:07.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.131+0000 7f982e59c700 1 -- 172.21.15.149:0/1433965399 learned_addr learned my addr 172.21.15.149:0/1433965399 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:07.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.131+0000 7f982ed9d700 1 --2- 172.21.15.149:0/1433965399 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f98300b20f0 0x7f983006fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:07.137 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.131+0000 7f982e59c700 1 -- 172.21.15.149:0/1433965399 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f98300b20f0 msgr2=0x7f983006fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:07.137 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.131+0000 7f982e59c700 1 --2- 172.21.15.149:0/1433965399 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f98300b20f0 0x7f983006fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:07.137 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.131+0000 7f982e59c700 1 -- 172.21.15.149:0/1433965399 >> v1:172.21.15.160:6789/0 conn(0x7f983015ebe0 legacy=0x7f98300cbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:07.138 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.131+0000 7f982e59c700 1 -- 172.21.15.149:0/1433965399 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98300704e0 con 0x7f9830072b70 2023-11-08T19:29:07.138 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.131+0000 7f982ed9d700 1 --2- 172.21.15.149:0/1433965399 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f98300b20f0 0x7f983006fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:29:07.138 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.131+0000 7f982e59c700 1 --2- 172.21.15.149:0/1433965399 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9830072b70 0x7f98300b24d0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f982000bb90 tx=0x7f982000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff653b72a0b29ec server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:07.138 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.132+0000 7f982dd9b700 1 -- 172.21.15.149:0/1433965399 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982000dd50 con 0x7f9830072b70 2023-11-08T19:29:07.139 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.132+0000 7f982dd9b700 1 -- 172.21.15.149:0/1433965399 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9820010470 con 0x7f9830072b70 2023-11-08T19:29:07.139 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.132+0000 7f982dd9b700 1 -- 172.21.15.149:0/1433965399 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9820010800 con 0x7f9830072b70 2023-11-08T19:29:07.139 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.132+0000 7f9835157700 1 -- 172.21.15.149:0/1433965399 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9830072b70 msgr2=0x7f98300b24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:07.139 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.132+0000 7f9835157700 1 --2- 172.21.15.149:0/1433965399 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9830072b70 0x7f98300b24d0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f982000bb90 tx=0x7f982000bea0 comp rx=0 tx=0).stop 2023-11-08T19:29:07.139 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.132+0000 7f9835157700 1 -- 172.21.15.149:0/1433965399 shutdown_connections 2023-11-08T19:29:07.140 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.132+0000 7f9835157700 1 --2- 172.21.15.149:0/1433965399 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f98300b20f0 0x7f983006fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:07.140 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.132+0000 7f9835157700 1 --2- 172.21.15.149:0/1433965399 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9830072b70 0x7f98300b24d0 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:07.140 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.132+0000 7f9835157700 1 -- 172.21.15.149:0/1433965399 >> 172.21.15.149:0/1433965399 conn(0x7f98300cd0f0 msgr2=0x7f98300cd500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:07.141 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.132+0000 7f9835157700 1 -- 172.21.15.149:0/1433965399 shutdown_connections 2023-11-08T19:29:07.141 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.132+0000 7f9835157700 1 -- 172.21.15.149:0/1433965399 wait complete. 2023-11-08T19:29:07.141 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.134+0000 7f9835157700 1 Processor -- start 2023-11-08T19:29:07.141 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.134+0000 7f9835157700 1 -- start start 2023-11-08T19:29:07.144 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.134+0000 7f9835157700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9830072b70 0x7f98300b3220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:07.144 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.134+0000 7f9835157700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f98300b20f0 0x7f98301561b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:07.144 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.134+0000 7f9835157700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f983015ebe0 0x7f983015b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:07.144 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.134+0000 7f9835157700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98301566f0 con 0x7f98300b20f0 2023-11-08T19:29:07.145 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.134+0000 7f9835157700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98300c9330 con 0x7f983015ebe0 2023-11-08T19:29:07.145 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.134+0000 7f9835157700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f983015c2d0 con 0x7f9830072b70 2023-11-08T19:29:07.145 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.134+0000 7f982e59c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f98300b20f0 0x7f98301561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:07.145 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.135+0000 7f982e59c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f98300b20f0 0x7f98301561b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45022/0 (socket says 172.21.15.149:45022) 2023-11-08T19:29:07.145 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.135+0000 7f982e59c700 1 -- 172.21.15.149:0/1084597770 learned_addr learned my addr 172.21.15.149:0/1084597770 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:07.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.135+0000 7f982ed9d700 1 --2- 172.21.15.149:0/1084597770 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9830072b70 0x7f98300b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:07.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.135+0000 7f982f59e700 1 --2- 172.21.15.149:0/1084597770 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f983015ebe0 0x7f983015b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:07.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.135+0000 7f982e59c700 1 -- 172.21.15.149:0/1084597770 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9830072b70 msgr2=0x7f98300b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:07.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.135+0000 7f982e59c700 1 --2- 172.21.15.149:0/1084597770 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9830072b70 0x7f98300b3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:07.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.135+0000 7f982e59c700 1 -- 172.21.15.149:0/1084597770 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f983015ebe0 msgr2=0x7f983015b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:07.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.135+0000 7f982e59c700 1 --2- 172.21.15.149:0/1084597770 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f983015ebe0 0x7f983015b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:07.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.135+0000 7f982e59c700 1 -- 172.21.15.149:0/1084597770 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f982000b7f0 con 0x7f98300b20f0 2023-11-08T19:29:07.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.135+0000 7f982f59e700 1 --2- 172.21.15.149:0/1084597770 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f983015ebe0 0x7f983015b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:29:07.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.135+0000 7f982e59c700 1 --2- 172.21.15.149:0/1084597770 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f98300b20f0 0x7f98301561b0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f982000bee0 tx=0x7f9820004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:07.148 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.135+0000 7f98177fe700 1 -- 172.21.15.149:0/1084597770 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982001f070 con 0x7f98300b20f0 2023-11-08T19:29:07.148 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.135+0000 7f98177fe700 1 -- 172.21.15.149:0/1084597770 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98200038b0 con 0x7f98300b20f0 2023-11-08T19:29:07.148 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.135+0000 7f98177fe700 1 -- 172.21.15.149:0/1084597770 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9820003c40 con 0x7f98300b20f0 2023-11-08T19:29:07.148 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.135+0000 7f9835157700 1 -- 172.21.15.149:0/1084597770 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f983015c5b0 con 0x7f98300b20f0 2023-11-08T19:29:07.148 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.135+0000 7f9835157700 1 -- 172.21.15.149:0/1084597770 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98300c8fc0 con 0x7f98300b20f0 2023-11-08T19:29:07.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.136+0000 7f9835157700 1 -- 172.21.15.149:0/1084597770 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98300c8b40 con 0x7f98300b20f0 2023-11-08T19:29:07.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.137+0000 7f98177fe700 1 -- 172.21.15.149:0/1084597770 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9820019400 con 0x7f98300b20f0 2023-11-08T19:29:07.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.137+0000 7f98177fe700 1 --2- 172.21.15.149:0/1084597770 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f981c06af00 0x7f981c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:07.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.137+0000 7f98177fe700 1 -- 172.21.15.149:0/1084597770 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 7522+0+0 (secure 0 0 0) 0x7f982008d1f0 con 0x7f98300b20f0 2023-11-08T19:29:07.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.137+0000 7f982ed9d700 1 --2- 172.21.15.149:0/1084597770 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f981c06af00 0x7f981c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:07.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.138+0000 7f982ed9d700 1 --2- 172.21.15.149:0/1084597770 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f981c06af00 0x7f981c06d3c0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f98240099d0 tx=0x7f9824008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:07.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.142+0000 7f98177fe700 1 -- 172.21.15.149:0/1084597770 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f98300c8b40 con 0x7f98300b20f0 2023-11-08T19:29:07.379 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.378+0000 7f9835157700 1 -- 172.21.15.149:0/1084597770 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f98300c8b40 con 0x7f98300b20f0 2023-11-08T19:29:07.380 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.378+0000 7f98177fe700 1 -- 172.21.15.149:0/1084597770 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+4941 (secure 0 0 0) 0x7f98300c8b40 con 0x7f98300b20f0 2023-11-08T19:29:07.380 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:29:07.380 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":91,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6095,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/852710262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":852710262},{"type":"v1","addr":"172.21.15.160:6835","nonce":852710262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64},{"gid":7812,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/2818321595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2818321595},{"type":"v1","addr":"172.21.15.149:6836","nonce":2818321595}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:29:02.319250+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6236,"mds_1":7125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6236":{"gid":6236,"name":"d","rank":0,"incarnation":87,"state":"up:active","state_seq":12,"addr":"172.21.15.160:6834/1313631099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":1313631099},{"type":"v1","addr":"172.21.15.160:6834","nonce":1313631099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7125":{"gid":7125,"name":"c","rank":1,"incarnation":57,"state":"up:active","state_seq":6,"addr":"172.21.15.149:6837/3917392643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3917392643},{"type":"v1","addr":"172.21.15.149:6837","nonce":3917392643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:29:07.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.381+0000 7f9835157700 1 -- 172.21.15.149:0/1084597770 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f981c06af00 msgr2=0x7f981c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:07.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.381+0000 7f9835157700 1 --2- 172.21.15.149:0/1084597770 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f981c06af00 0x7f981c06d3c0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f98240099d0 tx=0x7f9824008040 comp rx=0 tx=0).stop 2023-11-08T19:29:07.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.381+0000 7f9835157700 1 -- 172.21.15.149:0/1084597770 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f98300b20f0 msgr2=0x7f98301561b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:07.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.381+0000 7f9835157700 1 --2- 172.21.15.149:0/1084597770 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f98300b20f0 0x7f98301561b0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f982000bee0 tx=0x7f9820004750 comp rx=0 tx=0).stop 2023-11-08T19:29:07.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.381+0000 7f9835157700 1 -- 172.21.15.149:0/1084597770 shutdown_connections 2023-11-08T19:29:07.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.381+0000 7f9835157700 1 --2- 172.21.15.149:0/1084597770 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f981c06af00 0x7f981c06d3c0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:07.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.381+0000 7f9835157700 1 --2- 172.21.15.149:0/1084597770 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f983015ebe0 0x7f983015b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:07.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.381+0000 7f9835157700 1 --2- 172.21.15.149:0/1084597770 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9830072b70 0x7f98300b3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:07.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.381+0000 7f9835157700 1 --2- 172.21.15.149:0/1084597770 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f98300b20f0 0x7f98301561b0 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:07.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.381+0000 7f9835157700 1 -- 172.21.15.149:0/1084597770 >> 172.21.15.149:0/1084597770 conn(0x7f98300cd0f0 msgr2=0x7f98300cf9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:07.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.381+0000 7f9835157700 1 -- 172.21.15.149:0/1084597770 shutdown_connections 2023-11-08T19:29:07.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.381+0000 7f9835157700 1 -- 172.21.15.149:0/1084597770 wait complete. 2023-11-08T19:29:07.385 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 91 2023-11-08T19:29:07.394 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json dump snaps --server 2023-11-08T19:29:07.533 INFO:teuthology.orchestra.run.smithi160.stdout:{"last_snap":9,"last_created":5,"last_destroyed":9,"pending_noop":[],"snaps":[],"need_to_purge":{"17":[2,3,4,5,6,7,8,9]},"pending_update":[],"pending_destroy":[]} 2023-11-08T19:29:07.533 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 5, "last_destroyed": 9, "last_snap": 9, "need_to_purge": { "17": [ 2, 3, 4, 5, 6, 7, 8, 9 ] }, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [] } 2023-11-08T19:29:07.534 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:0 true 2023-11-08T19:29:07.657 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.656+0000 7f3043e79700 1 Processor -- start 2023-11-08T19:29:07.658 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.657+0000 7f3043e79700 1 -- start start 2023-11-08T19:29:07.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.658+0000 7f3043e79700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f303c0ce530 0x7f303c072ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:07.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.658+0000 7f3043e79700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f303c0cb1a0 con 0x7f303c15d900 2023-11-08T19:29:07.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.658+0000 7f3043e79700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f303c0cea60 con 0x7f303c0cd0b0 2023-11-08T19:29:07.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.658+0000 7f3043e79700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f303c0ced40 con 0x7f303c0ce530 2023-11-08T19:29:07.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.658+0000 7f3041414700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f303c0ce530 0x7f303c072ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:07.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.658+0000 7f3041c15700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f303c15d900 0x7f303c06ab20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:47030/0 (socket says 172.21.15.149:47030) 2023-11-08T19:29:07.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.658+0000 7f3041414700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f303c0ce530 0x7f303c072ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45030/0 (socket says 172.21.15.149:45030) 2023-11-08T19:29:07.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.658+0000 7f3041c15700 1 -- 172.21.15.149:0/2051232336 learned_addr learned my addr 172.21.15.149:0/2051232336 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:29:07.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.658+0000 7f3042416700 1 --1- 172.21.15.149:0/2051232336 >> v1:172.21.15.160:6789/0 conn(0x7f303c0cd0b0 0x7f303c0cb630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.149:58700/0 (socket says 172.21.15.149:58700) 2023-11-08T19:29:07.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.658+0000 7f3041414700 1 -- 172.21.15.149:0/2051232336 >> v1:172.21.15.160:6789/0 conn(0x7f303c0cd0b0 legacy=0x7f303c0cb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:07.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.658+0000 7f3041414700 1 -- 172.21.15.149:0/2051232336 >> v1:172.21.15.149:6789/0 conn(0x7f303c15d900 legacy=0x7f303c06ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:07.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.658+0000 7f3040c13700 1 -- 172.21.15.149:0/2051232336 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1499464873 0 0) 0x7f303c0cb1a0 con 0x7f303c15d900 2023-11-08T19:29:07.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.658+0000 7f3041414700 1 -- 172.21.15.149:0/2051232336 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f303c0cf020 con 0x7f303c0ce530 2023-11-08T19:29:07.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.658+0000 7f3041414700 1 --2- 172.21.15.149:0/2051232336 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f303c0ce530 0x7f303c072ae0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f3038009840 tx=0x7f3038009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1636c3c6f203c4f6 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:07.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.659+0000 7f3040c13700 1 -- 172.21.15.149:0/2051232336 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3038011830 con 0x7f303c0ce530 2023-11-08T19:29:07.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.659+0000 7f3040c13700 1 -- 172.21.15.149:0/2051232336 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3038011990 con 0x7f303c0ce530 2023-11-08T19:29:07.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.659+0000 7f3040c13700 1 -- 172.21.15.149:0/2051232336 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3038011d20 con 0x7f303c0ce530 2023-11-08T19:29:07.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.659+0000 7f3043e79700 1 -- 172.21.15.149:0/2051232336 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f303c0ce530 msgr2=0x7f303c072ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:07.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.659+0000 7f3043e79700 1 --2- 172.21.15.149:0/2051232336 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f303c0ce530 0x7f303c072ae0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f3038009840 tx=0x7f3038009b50 comp rx=0 tx=0).stop 2023-11-08T19:29:07.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.659+0000 7f3043e79700 1 -- 172.21.15.149:0/2051232336 shutdown_connections 2023-11-08T19:29:07.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.659+0000 7f3043e79700 1 --2- 172.21.15.149:0/2051232336 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f303c0ce530 0x7f303c072ae0 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:07.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.659+0000 7f3043e79700 1 -- 172.21.15.149:0/2051232336 >> 172.21.15.149:0/2051232336 conn(0x7f303c06e0d0 msgr2=0x7f303c06e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:07.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.659+0000 7f3043e79700 1 -- 172.21.15.149:0/2051232336 shutdown_connections 2023-11-08T19:29:07.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.659+0000 7f3043e79700 1 -- 172.21.15.149:0/2051232336 wait complete. 2023-11-08T19:29:07.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.661+0000 7f3043e79700 1 Processor -- start 2023-11-08T19:29:07.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.661+0000 7f3043e79700 1 -- start start 2023-11-08T19:29:07.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.662+0000 7f3043e79700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f303c0cd0b0 0x7f303c0c6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:07.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.662+0000 7f3043e79700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f303c0ce530 0x7f303c1593a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:07.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.662+0000 7f3043e79700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f303c15d900 0x7f303c0c41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:07.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.662+0000 7f3043e79700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f303c0c7170 con 0x7f303c0ce530 2023-11-08T19:29:07.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.662+0000 7f3043e79700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f303c0c61e0 con 0x7f303c0cd0b0 2023-11-08T19:29:07.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.662+0000 7f3043e79700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f303c0c4c40 con 0x7f303c15d900 2023-11-08T19:29:07.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.662+0000 7f3041414700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f303c0ce530 0x7f303c1593a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:07.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.662+0000 7f3041414700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f303c0ce530 0x7f303c1593a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45036/0 (socket says 172.21.15.149:45036) 2023-11-08T19:29:07.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.662+0000 7f3041414700 1 -- 172.21.15.149:0/1827322624 learned_addr learned my addr 172.21.15.149:0/1827322624 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:07.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.662+0000 7f3041c15700 1 --2- 172.21.15.149:0/1827322624 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f303c0cd0b0 0x7f303c0c6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:07.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.662+0000 7f3042416700 1 --2- 172.21.15.149:0/1827322624 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f303c15d900 0x7f303c0c41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:07.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.662+0000 7f3041414700 1 -- 172.21.15.149:0/1827322624 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f303c15d900 msgr2=0x7f303c0c41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:07.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.662+0000 7f3041414700 1 --2- 172.21.15.149:0/1827322624 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f303c15d900 0x7f303c0c41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:07.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.662+0000 7f3041414700 1 -- 172.21.15.149:0/1827322624 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f303c0cd0b0 msgr2=0x7f303c0c6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:07.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.662+0000 7f3041414700 1 --2- 172.21.15.149:0/1827322624 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f303c0cd0b0 0x7f303c0c6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:07.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.662+0000 7f3041414700 1 -- 172.21.15.149:0/1827322624 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30380094a0 con 0x7f303c0ce530 2023-11-08T19:29:07.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.662+0000 7f3041c15700 1 --2- 172.21.15.149:0/1827322624 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f303c0cd0b0 0x7f303c0c6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:29:07.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.662+0000 7f3042416700 1 --2- 172.21.15.149:0/1827322624 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f303c15d900 0x7f303c0c41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:29:07.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.662+0000 7f3041414700 1 --2- 172.21.15.149:0/1827322624 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f303c0ce530 0x7f303c1593a0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f30380090b0 tx=0x7f3038004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:07.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.663+0000 7f30327fc700 1 -- 172.21.15.149:0/1827322624 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303801a900 con 0x7f303c0ce530 2023-11-08T19:29:07.672 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.663+0000 7f30327fc700 1 -- 172.21.15.149:0/1827322624 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f303801aa60 con 0x7f303c0ce530 2023-11-08T19:29:07.672 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.663+0000 7f3043e79700 1 -- 172.21.15.149:0/1827322624 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f303c0c4f20 con 0x7f303c0ce530 2023-11-08T19:29:07.672 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.663+0000 7f30327fc700 1 -- 172.21.15.149:0/1827322624 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303801add0 con 0x7f303c0ce530 2023-11-08T19:29:07.672 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.663+0000 7f3043e79700 1 -- 172.21.15.149:0/1827322624 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f303c0c6710 con 0x7f303c0ce530 2023-11-08T19:29:07.672 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.664+0000 7f3043e79700 1 -- 172.21.15.149:0/1827322624 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f303c074f10 con 0x7f303c0ce530 2023-11-08T19:29:07.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.664+0000 7f30327fc700 1 -- 172.21.15.149:0/1827322624 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3038022070 con 0x7f303c0ce530 2023-11-08T19:29:07.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.665+0000 7f30327fc700 1 --2- 172.21.15.149:0/1827322624 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f302006af00 0x7f302006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:07.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.665+0000 7f30327fc700 1 -- 172.21.15.149:0/1827322624 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 7522+0+0 (secure 0 0 0) 0x7f303808afa0 con 0x7f303c0ce530 2023-11-08T19:29:07.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.665+0000 7f3041c15700 1 --2- 172.21.15.149:0/1827322624 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f302006af00 0x7f302006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:07.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.665+0000 7f3041c15700 1 --2- 172.21.15.149:0/1827322624 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f302006af00 0x7f302006d3c0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f302c000f60 tx=0x7f302c007e50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:07.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.670+0000 7f30327fc700 1 -- 172.21.15.149:0/1827322624 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f30380bdca0 con 0x7f303c0ce530 2023-11-08T19:29:07.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:07.942+0000 7f3043e79700 1 -- 172.21.15.149:0/1827322624 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"} v 0) v1 -- 0x7f303c0b6640 con 0x7f303c0ce530 2023-11-08T19:29:08.334 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.333+0000 7f30327fc700 1 -- 172.21.15.149:0/1827322624 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"}]=0 freezing mds.6236 v92) v1 ==== 112+0+0 (secure 0 0 0) 0x7f3038055a60 con 0x7f303c0ce530 2023-11-08T19:29:08.337 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.336+0000 7f3043e79700 1 -- 172.21.15.149:0/1827322624 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f302006af00 msgr2=0x7f302006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:08.337 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.336+0000 7f3043e79700 1 --2- 172.21.15.149:0/1827322624 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f302006af00 0x7f302006d3c0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f302c000f60 tx=0x7f302c007e50 comp rx=0 tx=0).stop 2023-11-08T19:29:08.338 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.336+0000 7f3043e79700 1 -- 172.21.15.149:0/1827322624 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f303c0ce530 msgr2=0x7f303c1593a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:08.338 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.336+0000 7f3043e79700 1 --2- 172.21.15.149:0/1827322624 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f303c0ce530 0x7f303c1593a0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f30380090b0 tx=0x7f3038004750 comp rx=0 tx=0).stop 2023-11-08T19:29:08.338 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.336+0000 7f3043e79700 1 -- 172.21.15.149:0/1827322624 shutdown_connections 2023-11-08T19:29:08.338 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.336+0000 7f3043e79700 1 --2- 172.21.15.149:0/1827322624 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f302006af00 0x7f302006d3c0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:08.338 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.336+0000 7f3043e79700 1 --2- 172.21.15.149:0/1827322624 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f303c0cd0b0 0x7f303c0c6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:08.339 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.336+0000 7f3043e79700 1 --2- 172.21.15.149:0/1827322624 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f303c15d900 0x7f303c0c41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:08.339 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.336+0000 7f3043e79700 1 --2- 172.21.15.149:0/1827322624 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f303c0ce530 0x7f303c1593a0 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:08.339 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.336+0000 7f3043e79700 1 -- 172.21.15.149:0/1827322624 >> 172.21.15.149:0/1827322624 conn(0x7f303c06e0d0 msgr2=0x7f303c06c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:08.339 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.336+0000 7f3043e79700 1 -- 172.21.15.149:0/1827322624 shutdown_connections 2023-11-08T19:29:08.339 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.336+0000 7f3043e79700 1 -- 172.21.15.149:0/1827322624 wait complete. 2023-11-08T19:29:08.340 INFO:teuthology.orchestra.run.smithi149.stderr:freezing mds.6236 2023-11-08T19:29:08.355 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:1 true 2023-11-08T19:29:08.481 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.479+0000 7fc71edb5700 1 Processor -- start 2023-11-08T19:29:08.481 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.480+0000 7fc71edb5700 1 -- start start 2023-11-08T19:29:08.482 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.481+0000 7fc71edb5700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc7180ca5b0 0x7fc7180caa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:08.482 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.481+0000 7fc71edb5700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc71806e8f0 con 0x7fc71815f1b0 2023-11-08T19:29:08.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.481+0000 7fc71edb5700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc71806e330 con 0x7fc71815edd0 2023-11-08T19:29:08.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.481+0000 7fc71edb5700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc718071c20 con 0x7fc7180ca5b0 2023-11-08T19:29:08.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.481+0000 7fc717fff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fc71815f1b0 0x7fc71806d8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:47046/0 (socket says 172.21.15.149:47046) 2023-11-08T19:29:08.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.481+0000 7fc717fff700 1 -- 172.21.15.149:0/2113314011 learned_addr learned my addr 172.21.15.149:0/2113314011 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:29:08.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.481+0000 7fc71d352700 1 --2- 172.21.15.149:0/2113314011 >> v2:172.21.15.149:3300/0 conn(0x7fc7180ca5b0 0x7fc7180caa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:08.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.481+0000 7fc7177fe700 1 -- 172.21.15.149:0/2113314011 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2217964656 0 0) 0x7fc71806e8f0 con 0x7fc71815f1b0 2023-11-08T19:29:08.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.481+0000 7fc7177fe700 1 -- 172.21.15.149:0/2113314011 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7080035b0 con 0x7fc71815f1b0 2023-11-08T19:29:08.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.482+0000 7fc7177fe700 1 -- 172.21.15.149:0/2113314011 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4085262481 0 0) 0x7fc71806e330 con 0x7fc71815edd0 2023-11-08T19:29:08.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.482+0000 7fc7177fe700 1 -- 172.21.15.149:0/2113314011 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc71806e8f0 con 0x7fc71815edd0 2023-11-08T19:29:08.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.482+0000 7fc71d352700 1 -- 172.21.15.149:0/2113314011 >> v1:172.21.15.160:6789/0 conn(0x7fc71815edd0 legacy=0x7fc718072040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:08.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.482+0000 7fc71d352700 1 -- 172.21.15.149:0/2113314011 >> v1:172.21.15.149:6789/0 conn(0x7fc71815f1b0 legacy=0x7fc71806d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:08.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.482+0000 7fc71d352700 1 -- 172.21.15.149:0/2113314011 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc71806e610 con 0x7fc7180ca5b0 2023-11-08T19:29:08.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.482+0000 7fc71d352700 1 --2- 172.21.15.149:0/2113314011 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc7180ca5b0 0x7fc7180caa20 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7fc710009d90 tx=0x7fc71000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5d10b09e716cb1d server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:08.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.482+0000 7fc7177fe700 1 -- 172.21.15.149:0/2113314011 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc71000e070 con 0x7fc7180ca5b0 2023-11-08T19:29:08.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.482+0000 7fc7177fe700 1 -- 172.21.15.149:0/2113314011 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc71000bb20 con 0x7fc7180ca5b0 2023-11-08T19:29:08.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.482+0000 7fc7177fe700 1 -- 172.21.15.149:0/2113314011 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc710012430 con 0x7fc7180ca5b0 2023-11-08T19:29:08.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.483+0000 7fc71edb5700 1 -- 172.21.15.149:0/2113314011 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc7180ca5b0 msgr2=0x7fc7180caa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:08.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.483+0000 7fc71edb5700 1 --2- 172.21.15.149:0/2113314011 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc7180ca5b0 0x7fc7180caa20 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7fc710009d90 tx=0x7fc71000b330 comp rx=0 tx=0).stop 2023-11-08T19:29:08.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.483+0000 7fc71edb5700 1 -- 172.21.15.149:0/2113314011 shutdown_connections 2023-11-08T19:29:08.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.483+0000 7fc71edb5700 1 --2- 172.21.15.149:0/2113314011 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc7180ca5b0 0x7fc7180caa20 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:08.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.483+0000 7fc71edb5700 1 -- 172.21.15.149:0/2113314011 >> 172.21.15.149:0/2113314011 conn(0x7fc7180b1ad0 msgr2=0x7fc7180b1eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:08.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.483+0000 7fc71edb5700 1 -- 172.21.15.149:0/2113314011 shutdown_connections 2023-11-08T19:29:08.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.484+0000 7fc71edb5700 1 -- 172.21.15.149:0/2113314011 wait complete. 2023-11-08T19:29:08.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.485+0000 7fc71edb5700 1 Processor -- start 2023-11-08T19:29:08.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.485+0000 7fc71edb5700 1 -- start start 2023-11-08T19:29:08.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.486+0000 7fc71edb5700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7180ca5b0 0x7fc718153fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:08.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.486+0000 7fc71edb5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc71815edd0 0x7fc7180ad290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:08.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.486+0000 7fc71edb5700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc71815f1b0 0x7fc7180ad7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:08.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.486+0000 7fc71edb5700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc718072750 con 0x7fc71815edd0 2023-11-08T19:29:08.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.486+0000 7fc71edb5700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7180cf890 con 0x7fc7180ca5b0 2023-11-08T19:29:08.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.486+0000 7fc71edb5700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc718154510 con 0x7fc71815f1b0 2023-11-08T19:29:08.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.486+0000 7fc717fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc71815edd0 0x7fc7180ad290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:08.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.486+0000 7fc717fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc71815edd0 0x7fc7180ad290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45050/0 (socket says 172.21.15.149:45050) 2023-11-08T19:29:08.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.486+0000 7fc717fff700 1 -- 172.21.15.149:0/3441253399 learned_addr learned my addr 172.21.15.149:0/3441253399 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:08.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.486+0000 7fc71cb51700 1 --2- 172.21.15.149:0/3441253399 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7180ca5b0 0x7fc718153fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:08.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.486+0000 7fc71d352700 1 --2- 172.21.15.149:0/3441253399 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc71815f1b0 0x7fc7180ad7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:08.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.487+0000 7fc717fff700 1 -- 172.21.15.149:0/3441253399 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc71815f1b0 msgr2=0x7fc7180ad7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:08.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.487+0000 7fc717fff700 1 --2- 172.21.15.149:0/3441253399 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc71815f1b0 0x7fc7180ad7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:08.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.487+0000 7fc717fff700 1 -- 172.21.15.149:0/3441253399 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7180ca5b0 msgr2=0x7fc718153fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:08.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.487+0000 7fc717fff700 1 --2- 172.21.15.149:0/3441253399 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7180ca5b0 0x7fc718153fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:08.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.487+0000 7fc717fff700 1 -- 172.21.15.149:0/3441253399 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc710009a70 con 0x7fc71815edd0 2023-11-08T19:29:08.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.487+0000 7fc717fff700 1 --2- 172.21.15.149:0/3441253399 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc71815edd0 0x7fc7180ad290 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7fc70400c700 tx=0x7fc70400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:08.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.487+0000 7fc7157fa700 1 -- 172.21.15.149:0/3441253399 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc704005d70 con 0x7fc71815edd0 2023-11-08T19:29:08.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.487+0000 7fc7157fa700 1 -- 172.21.15.149:0/3441253399 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7040070d0 con 0x7fc71815edd0 2023-11-08T19:29:08.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.487+0000 7fc7157fa700 1 -- 172.21.15.149:0/3441253399 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc704007440 con 0x7fc71815edd0 2023-11-08T19:29:08.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.487+0000 7fc71edb5700 1 -- 172.21.15.149:0/3441253399 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7180cec10 con 0x7fc71815edd0 2023-11-08T19:29:08.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.487+0000 7fc71edb5700 1 -- 172.21.15.149:0/3441253399 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7180cf1d0 con 0x7fc71815edd0 2023-11-08T19:29:08.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.488+0000 7fc71edb5700 1 -- 172.21.15.149:0/3441253399 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc718074f10 con 0x7fc71815edd0 2023-11-08T19:29:08.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.488+0000 7fc7157fa700 1 -- 172.21.15.149:0/3441253399 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc7040075a0 con 0x7fc71815edd0 2023-11-08T19:29:08.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.489+0000 7fc7157fa700 1 --2- 172.21.15.149:0/3441253399 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc6fc06af00 0x7fc6fc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:08.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.489+0000 7fc7157fa700 1 -- 172.21.15.149:0/3441253399 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 7610+0+0 (secure 0 0 0) 0x7fc704088f20 con 0x7fc71815edd0 2023-11-08T19:29:08.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.489+0000 7fc71cb51700 1 --2- 172.21.15.149:0/3441253399 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc6fc06af00 0x7fc6fc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:08.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.489+0000 7fc71cb51700 1 --2- 172.21.15.149:0/3441253399 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc6fc06af00 0x7fc6fc06d3c0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fc70c0011e0 tx=0x7fc70c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:08.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.494+0000 7fc7157fa700 1 -- 172.21.15.149:0/3441253399 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc7040539a0 con 0x7fc71815edd0 2023-11-08T19:29:08.592 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T19:29:08.595 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T19:29:08.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:08.786+0000 7fc71edb5700 1 -- 172.21.15.149:0/3441253399 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:1", "val": "true"} v 0) v1 -- 0x7fc71815e5f0 con 0x7fc71815edd0 2023-11-08T19:29:09.337 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.335+0000 7fc7157fa700 1 -- 172.21.15.149:0/3441253399 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:1", "val": "true"}]=0 freezing mds.7125 v93) v1 ==== 112+0+0 (secure 0 0 0) 0x7fc7040170a0 con 0x7fc71815edd0 2023-11-08T19:29:09.340 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.338+0000 7fc71edb5700 1 -- 172.21.15.149:0/3441253399 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc6fc06af00 msgr2=0x7fc6fc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:09.340 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.338+0000 7fc71edb5700 1 --2- 172.21.15.149:0/3441253399 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc6fc06af00 0x7fc6fc06d3c0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fc70c0011e0 tx=0x7fc70c009040 comp rx=0 tx=0).stop 2023-11-08T19:29:09.340 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.338+0000 7fc71edb5700 1 -- 172.21.15.149:0/3441253399 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc71815edd0 msgr2=0x7fc7180ad290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:09.341 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.338+0000 7fc71edb5700 1 --2- 172.21.15.149:0/3441253399 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc71815edd0 0x7fc7180ad290 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7fc70400c700 tx=0x7fc70400ca10 comp rx=0 tx=0).stop 2023-11-08T19:29:09.341 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.339+0000 7fc71edb5700 1 -- 172.21.15.149:0/3441253399 shutdown_connections 2023-11-08T19:29:09.341 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.339+0000 7fc71edb5700 1 --2- 172.21.15.149:0/3441253399 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc6fc06af00 0x7fc6fc06d3c0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:09.341 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.339+0000 7fc71edb5700 1 --2- 172.21.15.149:0/3441253399 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7180ca5b0 0x7fc718153fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:09.341 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.339+0000 7fc71edb5700 1 --2- 172.21.15.149:0/3441253399 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc71815f1b0 0x7fc7180ad7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:09.342 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.339+0000 7fc71edb5700 1 --2- 172.21.15.149:0/3441253399 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc71815edd0 0x7fc7180ad290 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:09.342 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.339+0000 7fc71edb5700 1 -- 172.21.15.149:0/3441253399 >> 172.21.15.149:0/3441253399 conn(0x7fc7180b1ad0 msgr2=0x7fc718071f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:09.342 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.339+0000 7fc71edb5700 1 -- 172.21.15.149:0/3441253399 shutdown_connections 2023-11-08T19:29:09.342 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.339+0000 7fc71edb5700 1 -- 172.21.15.149:0/3441253399 wait complete. 2023-11-08T19:29:09.343 INFO:teuthology.orchestra.run.smithi149.stderr:freezing mds.7125 2023-11-08T19:29:09.357 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json config set mds_kill_mdstable_at 2 2023-11-08T19:29:09.503 INFO:teuthology.orchestra.run.smithi160.stdout:{"success":"mds_kill_mdstable_at = '2' (not observed, change may require restart) "} 2023-11-08T19:29:09.504 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_kill_mdstable_at = '2' (not observed, change may require restart) " } 2023-11-08T19:29:09.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:29:09.504 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir d1/dir/.snap/s22) 2023-11-08T19:29:09.508 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2023-11-08T19:29:09.525 INFO:tasks.ceph.mds.d.smithi160.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el8/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_prepare_logged(ceph::cref_t&, version_t)' thread 7fbfc88db700 time 2023-11-08T19:29:09.525400+0000 2023-11-08T19:29:09.525 INFO:tasks.ceph.mds.d.smithi160.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el8/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 77: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 2) 2023-11-08T19:29:09.526 INFO:tasks.ceph.mds.d.smithi160.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-08T19:29:09.526 INFO:tasks.ceph.mds.d.smithi160.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fbfda1aff5b] 2023-11-08T19:29:09.526 INFO:tasks.ceph.mds.d.smithi160.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2ba121) [0x7fbfda1b0121] 2023-11-08T19:29:09.527 INFO:tasks.ceph.mds.d.smithi160.stderr: 3: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x6ad) [0x55778ce95f5d] 2023-11-08T19:29:09.527 INFO:tasks.ceph.mds.d.smithi160.stderr: 4: (MDSContext::complete(int)+0x5f) [0x55778cee0ecf] 2023-11-08T19:29:09.527 INFO:tasks.ceph.mds.d.smithi160.stderr: 5: (MDSIOContextBase::complete(int)+0x574) [0x55778cee16b4] 2023-11-08T19:29:09.527 INFO:tasks.ceph.mds.d.smithi160.stderr: 6: (MDSLogContextBase::complete(int)+0x5b) [0x55778cee1a7b] 2023-11-08T19:29:09.528 INFO:tasks.ceph.mds.d.smithi160.stderr: 7: (Finisher::finisher_thread_entry()+0x19d) [0x7fbfda24d8cd] 2023-11-08T19:29:09.528 INFO:tasks.ceph.mds.d.smithi160.stderr: 8: /lib64/libpthread.so.0(+0x81cf) [0x7fbfd8f481cf] 2023-11-08T19:29:09.528 INFO:tasks.ceph.mds.d.smithi160.stderr: 9: clone() 2023-11-08T19:29:09.528 INFO:tasks.ceph.mds.d.smithi160.stderr:2023-11-08T19:29:09.525+0000 7fbfc88db700 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el8/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_prepare_logged(ceph::cref_t&, version_t)' thread 7fbfc88db700 time 2023-11-08T19:29:09.525400+0000 2023-11-08T19:29:09.528 INFO:tasks.ceph.mds.d.smithi160.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el8/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 77: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 2) 2023-11-08T19:29:09.529 INFO:tasks.ceph.mds.d.smithi160.stderr: 2023-11-08T19:29:09.529 INFO:tasks.ceph.mds.d.smithi160.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-08T19:29:09.529 INFO:tasks.ceph.mds.d.smithi160.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fbfda1aff5b] 2023-11-08T19:29:09.529 INFO:tasks.ceph.mds.d.smithi160.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2ba121) [0x7fbfda1b0121] 2023-11-08T19:29:09.529 INFO:tasks.ceph.mds.d.smithi160.stderr: 3: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x6ad) [0x55778ce95f5d] 2023-11-08T19:29:09.529 INFO:tasks.ceph.mds.d.smithi160.stderr: 4: (MDSContext::complete(int)+0x5f) [0x55778cee0ecf] 2023-11-08T19:29:09.530 INFO:tasks.ceph.mds.d.smithi160.stderr: 5: (MDSIOContextBase::complete(int)+0x574) [0x55778cee16b4] 2023-11-08T19:29:09.530 INFO:tasks.ceph.mds.d.smithi160.stderr: 6: (MDSLogContextBase::complete(int)+0x5b) [0x55778cee1a7b] 2023-11-08T19:29:09.530 INFO:tasks.ceph.mds.d.smithi160.stderr: 7: (Finisher::finisher_thread_entry()+0x19d) [0x7fbfda24d8cd] 2023-11-08T19:29:09.530 INFO:tasks.ceph.mds.d.smithi160.stderr: 8: /lib64/libpthread.so.0(+0x81cf) [0x7fbfd8f481cf] 2023-11-08T19:29:09.530 INFO:tasks.ceph.mds.d.smithi160.stderr: 9: clone() 2023-11-08T19:29:09.531 INFO:tasks.ceph.mds.d.smithi160.stderr: 2023-11-08T19:29:09.531 INFO:tasks.ceph.mds.d.smithi160.stderr:*** Caught signal (Aborted) ** 2023-11-08T19:29:09.531 INFO:tasks.ceph.mds.d.smithi160.stderr: in thread 7fbfc88db700 thread_name:MR_Finisher 2023-11-08T19:29:09.532 INFO:tasks.ceph.mds.d.smithi160.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-08T19:29:09.532 INFO:tasks.ceph.mds.d.smithi160.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7fbfd8f52ce0] 2023-11-08T19:29:09.532 INFO:tasks.ceph.mds.d.smithi160.stderr: 2: gsignal() 2023-11-08T19:29:09.532 INFO:tasks.ceph.mds.d.smithi160.stderr: 3: abort() 2023-11-08T19:29:09.532 INFO:tasks.ceph.mds.d.smithi160.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fbfda1affb5] 2023-11-08T19:29:09.533 INFO:tasks.ceph.mds.d.smithi160.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2ba121) [0x7fbfda1b0121] 2023-11-08T19:29:09.533 INFO:tasks.ceph.mds.d.smithi160.stderr: 6: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x6ad) [0x55778ce95f5d] 2023-11-08T19:29:09.533 INFO:tasks.ceph.mds.d.smithi160.stderr: 7: (MDSContext::complete(int)+0x5f) [0x55778cee0ecf] 2023-11-08T19:29:09.533 INFO:tasks.ceph.mds.d.smithi160.stderr: 8: (MDSIOContextBase::complete(int)+0x574) [0x55778cee16b4] 2023-11-08T19:29:09.533 INFO:tasks.ceph.mds.d.smithi160.stderr: 9: (MDSLogContextBase::complete(int)+0x5b) [0x55778cee1a7b] 2023-11-08T19:29:09.534 INFO:tasks.ceph.mds.d.smithi160.stderr: 10: (Finisher::finisher_thread_entry()+0x19d) [0x7fbfda24d8cd] 2023-11-08T19:29:09.534 INFO:tasks.ceph.mds.d.smithi160.stderr: 11: /lib64/libpthread.so.0(+0x81cf) [0x7fbfd8f481cf] 2023-11-08T19:29:09.534 INFO:tasks.ceph.mds.d.smithi160.stderr: 12: clone() 2023-11-08T19:29:09.534 INFO:tasks.ceph.mds.d.smithi160.stderr:2023-11-08T19:29:09.527+0000 7fbfc88db700 -1 *** Caught signal (Aborted) ** 2023-11-08T19:29:09.534 INFO:tasks.ceph.mds.d.smithi160.stderr: in thread 7fbfc88db700 thread_name:MR_Finisher 2023-11-08T19:29:09.535 INFO:tasks.ceph.mds.d.smithi160.stderr: 2023-11-08T19:29:09.535 INFO:tasks.ceph.mds.d.smithi160.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-08T19:29:09.535 INFO:tasks.ceph.mds.d.smithi160.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7fbfd8f52ce0] 2023-11-08T19:29:09.535 INFO:tasks.ceph.mds.d.smithi160.stderr: 2: gsignal() 2023-11-08T19:29:09.535 INFO:tasks.ceph.mds.d.smithi160.stderr: 3: abort() 2023-11-08T19:29:09.535 INFO:tasks.ceph.mds.d.smithi160.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fbfda1affb5] 2023-11-08T19:29:09.536 INFO:tasks.ceph.mds.d.smithi160.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2ba121) [0x7fbfda1b0121] 2023-11-08T19:29:09.536 INFO:tasks.ceph.mds.d.smithi160.stderr: 6: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x6ad) [0x55778ce95f5d] 2023-11-08T19:29:09.536 INFO:tasks.ceph.mds.d.smithi160.stderr: 7: (MDSContext::complete(int)+0x5f) [0x55778cee0ecf] 2023-11-08T19:29:09.536 INFO:tasks.ceph.mds.d.smithi160.stderr: 8: (MDSIOContextBase::complete(int)+0x574) [0x55778cee16b4] 2023-11-08T19:29:09.536 INFO:tasks.ceph.mds.d.smithi160.stderr: 9: (MDSLogContextBase::complete(int)+0x5b) [0x55778cee1a7b] 2023-11-08T19:29:09.536 INFO:tasks.ceph.mds.d.smithi160.stderr: 10: (Finisher::finisher_thread_entry()+0x19d) [0x7fbfda24d8cd] 2023-11-08T19:29:09.537 INFO:tasks.ceph.mds.d.smithi160.stderr: 11: /lib64/libpthread.so.0(+0x81cf) [0x7fbfd8f481cf] 2023-11-08T19:29:09.537 INFO:tasks.ceph.mds.d.smithi160.stderr: 12: clone() 2023-11-08T19:29:09.537 INFO:tasks.ceph.mds.d.smithi160.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-08T19:29:09.537 INFO:tasks.ceph.mds.d.smithi160.stderr: 2023-11-08T19:29:09.537 INFO:tasks.ceph.mds.d.smithi160.stderr: -828> 2023-11-08T19:29:03.345+0000 7fbfcc0e2700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-08T19:29:09.537 INFO:tasks.ceph.mds.d.smithi160.stderr: -826> 2023-11-08T19:29:03.345+0000 7fbfcc0e2700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-08T19:29:09.538 INFO:tasks.ceph.mds.d.smithi160.stderr: -1> 2023-11-08T19:29:09.525+0000 7fbfc88db700 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el8/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_prepare_logged(ceph::cref_t&, version_t)' thread 7fbfc88db700 time 2023-11-08T19:29:09.525400+0000 2023-11-08T19:29:09.538 INFO:tasks.ceph.mds.d.smithi160.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el8/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 77: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 2) 2023-11-08T19:29:09.539 INFO:tasks.ceph.mds.d.smithi160.stderr: 2023-11-08T19:29:09.539 INFO:tasks.ceph.mds.d.smithi160.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-08T19:29:09.539 INFO:tasks.ceph.mds.d.smithi160.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fbfda1aff5b] 2023-11-08T19:29:09.539 INFO:tasks.ceph.mds.d.smithi160.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2ba121) [0x7fbfda1b0121] 2023-11-08T19:29:09.539 INFO:tasks.ceph.mds.d.smithi160.stderr: 3: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x6ad) [0x55778ce95f5d] 2023-11-08T19:29:09.540 INFO:tasks.ceph.mds.d.smithi160.stderr: 4: (MDSContext::complete(int)+0x5f) [0x55778cee0ecf] 2023-11-08T19:29:09.540 INFO:tasks.ceph.mds.d.smithi160.stderr: 5: (MDSIOContextBase::complete(int)+0x574) [0x55778cee16b4] 2023-11-08T19:29:09.540 INFO:tasks.ceph.mds.d.smithi160.stderr: 6: (MDSLogContextBase::complete(int)+0x5b) [0x55778cee1a7b] 2023-11-08T19:29:09.540 INFO:tasks.ceph.mds.d.smithi160.stderr: 7: (Finisher::finisher_thread_entry()+0x19d) [0x7fbfda24d8cd] 2023-11-08T19:29:09.540 INFO:tasks.ceph.mds.d.smithi160.stderr: 8: /lib64/libpthread.so.0(+0x81cf) [0x7fbfd8f481cf] 2023-11-08T19:29:09.541 INFO:tasks.ceph.mds.d.smithi160.stderr: 9: clone() 2023-11-08T19:29:09.541 INFO:tasks.ceph.mds.d.smithi160.stderr: 2023-11-08T19:29:09.541 INFO:tasks.ceph.mds.d.smithi160.stderr: 0> 2023-11-08T19:29:09.527+0000 7fbfc88db700 -1 *** Caught signal (Aborted) ** 2023-11-08T19:29:09.541 INFO:tasks.ceph.mds.d.smithi160.stderr: in thread 7fbfc88db700 thread_name:MR_Finisher 2023-11-08T19:29:09.541 INFO:tasks.ceph.mds.d.smithi160.stderr: 2023-11-08T19:29:09.541 INFO:tasks.ceph.mds.d.smithi160.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-08T19:29:09.542 INFO:tasks.ceph.mds.d.smithi160.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7fbfd8f52ce0] 2023-11-08T19:29:09.542 INFO:tasks.ceph.mds.d.smithi160.stderr: 2: gsignal() 2023-11-08T19:29:09.542 INFO:tasks.ceph.mds.d.smithi160.stderr: 3: abort() 2023-11-08T19:29:09.542 INFO:tasks.ceph.mds.d.smithi160.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fbfda1affb5] 2023-11-08T19:29:09.543 INFO:tasks.ceph.mds.d.smithi160.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2ba121) [0x7fbfda1b0121] 2023-11-08T19:29:09.543 INFO:tasks.ceph.mds.d.smithi160.stderr: 6: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x6ad) [0x55778ce95f5d] 2023-11-08T19:29:09.543 INFO:tasks.ceph.mds.d.smithi160.stderr: 7: (MDSContext::complete(int)+0x5f) [0x55778cee0ecf] 2023-11-08T19:29:09.543 INFO:tasks.ceph.mds.d.smithi160.stderr: 8: (MDSIOContextBase::complete(int)+0x574) [0x55778cee16b4] 2023-11-08T19:29:09.544 INFO:tasks.ceph.mds.d.smithi160.stderr: 9: (MDSLogContextBase::complete(int)+0x5b) [0x55778cee1a7b] 2023-11-08T19:29:09.544 INFO:tasks.ceph.mds.d.smithi160.stderr: 10: (Finisher::finisher_thread_entry()+0x19d) [0x7fbfda24d8cd] 2023-11-08T19:29:09.544 INFO:tasks.ceph.mds.d.smithi160.stderr: 11: /lib64/libpthread.so.0(+0x81cf) [0x7fbfd8f481cf] 2023-11-08T19:29:09.544 INFO:tasks.ceph.mds.d.smithi160.stderr: 12: clone() 2023-11-08T19:29:09.544 INFO:tasks.ceph.mds.d.smithi160.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-08T19:29:09.545 INFO:tasks.ceph.mds.d.smithi160.stderr: 2023-11-08T19:29:09.545 INFO:tasks.ceph.mds.d.smithi160.stderr: -828> 2023-11-08T19:29:03.345+0000 7fbfcc0e2700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-08T19:29:09.545 INFO:tasks.ceph.mds.d.smithi160.stderr: -826> 2023-11-08T19:29:03.345+0000 7fbfcc0e2700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-08T19:29:09.545 INFO:tasks.ceph.mds.d.smithi160.stderr: -1> 2023-11-08T19:29:09.525+0000 7fbfc88db700 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el8/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_prepare_logged(ceph::cref_t&, version_t)' thread 7fbfc88db700 time 2023-11-08T19:29:09.525400+0000 2023-11-08T19:29:09.545 INFO:tasks.ceph.mds.d.smithi160.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el8/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 77: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 2) 2023-11-08T19:29:09.545 INFO:tasks.ceph.mds.d.smithi160.stderr: 2023-11-08T19:29:09.546 INFO:tasks.ceph.mds.d.smithi160.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-08T19:29:09.546 INFO:tasks.ceph.mds.d.smithi160.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fbfda1aff5b] 2023-11-08T19:29:09.546 INFO:tasks.ceph.mds.d.smithi160.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2ba121) [0x7fbfda1b0121] 2023-11-08T19:29:09.546 INFO:tasks.ceph.mds.d.smithi160.stderr: 3: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x6ad) [0x55778ce95f5d] 2023-11-08T19:29:09.547 INFO:tasks.ceph.mds.d.smithi160.stderr: 4: (MDSContext::complete(int)+0x5f) [0x55778cee0ecf] 2023-11-08T19:29:09.547 INFO:tasks.ceph.mds.d.smithi160.stderr: 5: (MDSIOContextBase::complete(int)+0x574) [0x55778cee16b4] 2023-11-08T19:29:09.547 INFO:tasks.ceph.mds.d.smithi160.stderr: 6: (MDSLogContextBase::complete(int)+0x5b) [0x55778cee1a7b] 2023-11-08T19:29:09.547 INFO:tasks.ceph.mds.d.smithi160.stderr: 7: (Finisher::finisher_thread_entry()+0x19d) [0x7fbfda24d8cd] 2023-11-08T19:29:09.547 INFO:tasks.ceph.mds.d.smithi160.stderr: 8: /lib64/libpthread.so.0(+0x81cf) [0x7fbfd8f481cf] 2023-11-08T19:29:09.547 INFO:tasks.ceph.mds.d.smithi160.stderr: 9: clone() 2023-11-08T19:29:09.548 INFO:tasks.ceph.mds.d.smithi160.stderr: 2023-11-08T19:29:09.548 INFO:tasks.ceph.mds.d.smithi160.stderr: 0> 2023-11-08T19:29:09.527+0000 7fbfc88db700 -1 *** Caught signal (Aborted) ** 2023-11-08T19:29:09.548 INFO:tasks.ceph.mds.d.smithi160.stderr: in thread 7fbfc88db700 thread_name:MR_Finisher 2023-11-08T19:29:09.548 INFO:tasks.ceph.mds.d.smithi160.stderr: 2023-11-08T19:29:09.548 INFO:tasks.ceph.mds.d.smithi160.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-08T19:29:09.549 INFO:tasks.ceph.mds.d.smithi160.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7fbfd8f52ce0] 2023-11-08T19:29:09.549 INFO:tasks.ceph.mds.d.smithi160.stderr: 2: gsignal() 2023-11-08T19:29:09.549 INFO:tasks.ceph.mds.d.smithi160.stderr: 3: abort() 2023-11-08T19:29:09.549 INFO:tasks.ceph.mds.d.smithi160.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fbfda1affb5] 2023-11-08T19:29:09.549 INFO:tasks.ceph.mds.d.smithi160.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2ba121) [0x7fbfda1b0121] 2023-11-08T19:29:09.550 INFO:tasks.ceph.mds.d.smithi160.stderr: 6: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x6ad) [0x55778ce95f5d] 2023-11-08T19:29:09.550 INFO:tasks.ceph.mds.d.smithi160.stderr: 7: (MDSContext::complete(int)+0x5f) [0x55778cee0ecf] 2023-11-08T19:29:09.550 INFO:tasks.ceph.mds.d.smithi160.stderr: 8: (MDSIOContextBase::complete(int)+0x574) [0x55778cee16b4] 2023-11-08T19:29:09.550 INFO:tasks.ceph.mds.d.smithi160.stderr: 9: (MDSLogContextBase::complete(int)+0x5b) [0x55778cee1a7b] 2023-11-08T19:29:09.550 INFO:tasks.ceph.mds.d.smithi160.stderr: 10: (Finisher::finisher_thread_entry()+0x19d) [0x7fbfda24d8cd] 2023-11-08T19:29:09.551 INFO:tasks.ceph.mds.d.smithi160.stderr: 11: /lib64/libpthread.so.0(+0x81cf) [0x7fbfd8f481cf] 2023-11-08T19:29:09.551 INFO:tasks.ceph.mds.d.smithi160.stderr: 12: clone() 2023-11-08T19:29:09.551 INFO:tasks.ceph.mds.d.smithi160.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-08T19:29:09.551 INFO:tasks.ceph.mds.d.smithi160.stderr: 2023-11-08T19:29:09.685 INFO:teuthology.orchestra.run.smithi149.stdout:{"mds_beacon_grace":"15.000000"} 2023-11-08T19:29:09.685 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2023-11-08T19:29:09.686 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:29:09.806 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.805+0000 7f98a760c700 1 Processor -- start 2023-11-08T19:29:09.807 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.806+0000 7f98a760c700 1 -- start start 2023-11-08T19:29:09.809 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.806+0000 7f98a760c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f98a015db30 0x7f98a0162190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:09.809 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.806+0000 7f98a760c700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f98a00701b0 0x7f98a006ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:09.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.806+0000 7f98a760c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f98a0070700 0x7f98a006b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:09.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.806+0000 7f98a760c700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98a015df10 con 0x7f98a015db30 2023-11-08T19:29:09.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.806+0000 7f98a760c700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98a006ffd0 con 0x7f98a00701b0 2023-11-08T19:29:09.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.806+0000 7f98a760c700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98a00cc9f0 con 0x7f98a0070700 2023-11-08T19:29:09.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.806+0000 7f98a53a8700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f98a015db30 0x7f98a0162190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:09.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.807+0000 7f98a53a8700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f98a015db30 0x7f98a0162190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45058/0 (socket says 172.21.15.149:45058) 2023-11-08T19:29:09.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.807+0000 7f98a53a8700 1 -- 172.21.15.149:0/1809303353 learned_addr learned my addr 172.21.15.149:0/1809303353 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:09.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.807+0000 7f98a4ba7700 1 --2- 172.21.15.149:0/1809303353 >> v2:172.21.15.160:3300/0 conn(0x7f98a00701b0 0x7f98a006ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:09.812 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.807+0000 7f98a5ba9700 1 --2- 172.21.15.149:0/1809303353 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f98a0070700 0x7f98a006b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:09.812 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.807+0000 7f98a53a8700 1 -- 172.21.15.149:0/1809303353 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f98a0070700 msgr2=0x7f98a006b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:09.812 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.807+0000 7f98a53a8700 1 --2- 172.21.15.149:0/1809303353 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f98a0070700 0x7f98a006b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:09.812 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.807+0000 7f98a53a8700 1 -- 172.21.15.149:0/1809303353 >> v2:172.21.15.160:3300/0 conn(0x7f98a00701b0 msgr2=0x7f98a006ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:09.812 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.807+0000 7f98a53a8700 1 --2- 172.21.15.149:0/1809303353 >> v2:172.21.15.160:3300/0 conn(0x7f98a00701b0 0x7f98a006ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:09.813 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.807+0000 7f98a53a8700 1 -- 172.21.15.149:0/1809303353 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98a00cccd0 con 0x7f98a015db30 2023-11-08T19:29:09.813 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.807+0000 7f98a53a8700 1 --2- 172.21.15.149:0/1809303353 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f98a015db30 0x7f98a0162190 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f98a00c40b0 tx=0x7f989c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=535147ecad4e2bec server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:09.813 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.807+0000 7f9897fff700 1 -- 172.21.15.149:0/1809303353 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989c00b870 con 0x7f98a015db30 2023-11-08T19:29:09.813 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.807+0000 7f9897fff700 1 -- 172.21.15.149:0/1809303353 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f989c00b9d0 con 0x7f98a015db30 2023-11-08T19:29:09.813 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.807+0000 7f9897fff700 1 -- 172.21.15.149:0/1809303353 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989c00bd60 con 0x7f98a015db30 2023-11-08T19:29:09.814 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.808+0000 7f98a760c700 1 -- 172.21.15.149:0/1809303353 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f98a015db30 msgr2=0x7f98a0162190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:09.814 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.808+0000 7f98a760c700 1 --2- 172.21.15.149:0/1809303353 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f98a015db30 0x7f98a0162190 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f98a00c40b0 tx=0x7f989c009bd0 comp rx=0 tx=0).stop 2023-11-08T19:29:09.814 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.808+0000 7f98a760c700 1 -- 172.21.15.149:0/1809303353 shutdown_connections 2023-11-08T19:29:09.814 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.808+0000 7f98a760c700 1 --2- 172.21.15.149:0/1809303353 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f98a0070700 0x7f98a006b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:09.815 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.808+0000 7f98a760c700 1 --2- 172.21.15.149:0/1809303353 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f98a015db30 0x7f98a0162190 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:09.815 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.808+0000 7f98a760c700 1 --2- 172.21.15.149:0/1809303353 >> v2:172.21.15.160:3300/0 conn(0x7f98a00701b0 0x7f98a006ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:09.815 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.808+0000 7f98a760c700 1 -- 172.21.15.149:0/1809303353 >> 172.21.15.149:0/1809303353 conn(0x7f98a006e040 msgr2=0x7f98a006e420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:09.815 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.808+0000 7f98a760c700 1 -- 172.21.15.149:0/1809303353 shutdown_connections 2023-11-08T19:29:09.815 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.808+0000 7f98a760c700 1 -- 172.21.15.149:0/1809303353 wait complete. 2023-11-08T19:29:09.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.809+0000 7f98a760c700 1 Processor -- start 2023-11-08T19:29:09.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.809+0000 7f98a760c700 1 -- start start 2023-11-08T19:29:09.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.810+0000 7f98a760c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f98a00701b0 0x7f98a0155a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:09.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.810+0000 7f98a760c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f98a0070700 0x7f98a00b4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:09.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.810+0000 7f98a760c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f98a015db30 0x7f98a015fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:09.820 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.810+0000 7f98a760c700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a00b4980 con 0x7f98a00701b0 2023-11-08T19:29:09.820 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.810+0000 7f98a760c700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a00b33a0 con 0x7f98a015db30 2023-11-08T19:29:09.820 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.810+0000 7f98a760c700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98a00b3680 con 0x7f98a0070700 2023-11-08T19:29:09.820 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.810+0000 7f98a53a8700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f98a00701b0 0x7f98a0155a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:09.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.810+0000 7f98a53a8700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f98a00701b0 0x7f98a0155a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45064/0 (socket says 172.21.15.149:45064) 2023-11-08T19:29:09.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.810+0000 7f98a53a8700 1 -- 172.21.15.149:0/3083927648 learned_addr learned my addr 172.21.15.149:0/3083927648 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:09.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.810+0000 7f98a5ba9700 1 --2- 172.21.15.149:0/3083927648 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f98a015db30 0x7f98a015fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:09.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.810+0000 7f98a4ba7700 1 --2- 172.21.15.149:0/3083927648 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f98a0070700 0x7f98a00b4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:09.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.810+0000 7f98a53a8700 1 -- 172.21.15.149:0/3083927648 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f98a0070700 msgr2=0x7f98a00b4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:09.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.810+0000 7f98a53a8700 1 --2- 172.21.15.149:0/3083927648 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f98a0070700 0x7f98a00b4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:09.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.810+0000 7f98a53a8700 1 -- 172.21.15.149:0/3083927648 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f98a015db30 msgr2=0x7f98a015fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:09.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.810+0000 7f98a53a8700 1 --2- 172.21.15.149:0/3083927648 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f98a015db30 0x7f98a015fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:09.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.810+0000 7f98a53a8700 1 -- 172.21.15.149:0/3083927648 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f989c009550 con 0x7f98a00701b0 2023-11-08T19:29:09.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.810+0000 7f98a4ba7700 1 --2- 172.21.15.149:0/3083927648 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f98a0070700 0x7f98a00b4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:29:09.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.810+0000 7f98a53a8700 1 --2- 172.21.15.149:0/3083927648 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f98a00701b0 0x7f98a0155a10 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f989c000c00 tx=0x7f989c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:09.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.810+0000 7f9895ffb700 1 -- 172.21.15.149:0/3083927648 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989c004540 con 0x7f98a00701b0 2023-11-08T19:29:09.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.810+0000 7f9895ffb700 1 -- 172.21.15.149:0/3083927648 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f989c0036a0 con 0x7f98a00701b0 2023-11-08T19:29:09.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.810+0000 7f98a760c700 1 -- 172.21.15.149:0/3083927648 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98a00b3960 con 0x7f98a00701b0 2023-11-08T19:29:09.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.810+0000 7f9895ffb700 1 -- 172.21.15.149:0/3083927648 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989c003a50 con 0x7f98a00701b0 2023-11-08T19:29:09.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.811+0000 7f98a760c700 1 -- 172.21.15.149:0/3083927648 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98a00b3f20 con 0x7f98a00701b0 2023-11-08T19:29:09.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.811+0000 7f98a760c700 1 -- 172.21.15.149:0/3083927648 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98a0067810 con 0x7f98a00701b0 2023-11-08T19:29:09.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.812+0000 7f9895ffb700 1 -- 172.21.15.149:0/3083927648 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f989c021070 con 0x7f98a00701b0 2023-11-08T19:29:09.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.812+0000 7f9895ffb700 1 --2- 172.21.15.149:0/3083927648 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f988406af00 0x7f988406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:09.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.813+0000 7f9895ffb700 1 -- 172.21.15.149:0/3083927648 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 7594+0+0 (secure 0 0 0) 0x7f989c08b3c0 con 0x7f98a00701b0 2023-11-08T19:29:09.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.813+0000 7f98a4ba7700 1 --2- 172.21.15.149:0/3083927648 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f988406af00 0x7f988406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:09.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.813+0000 7f98a4ba7700 1 --2- 172.21.15.149:0/3083927648 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f988406af00 0x7f988406d3c0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f98a0156330 tx=0x7f9890008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:09.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:09.817+0000 7f9895ffb700 1 -- 172.21.15.149:0/3083927648 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f989c055da0 con 0x7f98a00701b0 2023-11-08T19:29:09.873 INFO:tasks.ceph.mds.d.smithi160.stderr:daemon-helper: command crashed with signal 6 2023-11-08T19:29:10.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:10.052+0000 7f98a760c700 1 -- 172.21.15.149:0/3083927648 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f98a0074f10 con 0x7f98a00701b0 2023-11-08T19:29:10.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:10.053+0000 7f9895ffb700 1 -- 172.21.15.149:0/3083927648 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4941 (secure 0 0 0) 0x7f989c019e60 con 0x7f98a00701b0 2023-11-08T19:29:10.054 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:29:10.055 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":93,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6095,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/852710262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":852710262},{"type":"v1","addr":"172.21.15.160:6835","nonce":852710262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64},{"gid":7812,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/2818321595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2818321595},{"type":"v1","addr":"172.21.15.149:6836","nonce":2818321595}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:29:08.787414+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6236,"mds_1":7125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6236":{"gid":6236,"name":"d","rank":0,"incarnation":87,"state":"up:active","state_seq":12,"addr":"172.21.15.160:6834/1313631099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":1313631099},{"type":"v1","addr":"172.21.15.160:6834","nonce":1313631099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7125":{"gid":7125,"name":"c","rank":1,"incarnation":57,"state":"up:active","state_seq":6,"addr":"172.21.15.149:6837/3917392643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3917392643},{"type":"v1","addr":"172.21.15.149:6837","nonce":3917392643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:29:10.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:10.055+0000 7f98a760c700 1 -- 172.21.15.149:0/3083927648 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f988406af00 msgr2=0x7f988406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:10.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:10.055+0000 7f98a760c700 1 --2- 172.21.15.149:0/3083927648 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f988406af00 0x7f988406d3c0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f98a0156330 tx=0x7f9890008040 comp rx=0 tx=0).stop 2023-11-08T19:29:10.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:10.055+0000 7f98a760c700 1 -- 172.21.15.149:0/3083927648 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f98a00701b0 msgr2=0x7f98a0155a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:10.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:10.055+0000 7f98a760c700 1 --2- 172.21.15.149:0/3083927648 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f98a00701b0 0x7f98a0155a10 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f989c000c00 tx=0x7f989c004750 comp rx=0 tx=0).stop 2023-11-08T19:29:10.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:10.055+0000 7f98a760c700 1 -- 172.21.15.149:0/3083927648 shutdown_connections 2023-11-08T19:29:10.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:10.055+0000 7f98a760c700 1 --2- 172.21.15.149:0/3083927648 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f988406af00 0x7f988406d3c0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:10.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:10.055+0000 7f98a760c700 1 --2- 172.21.15.149:0/3083927648 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f98a015db30 0x7f98a015fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:10.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:10.055+0000 7f98a760c700 1 --2- 172.21.15.149:0/3083927648 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f98a00701b0 0x7f98a0155a10 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:10.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:10.055+0000 7f98a760c700 1 --2- 172.21.15.149:0/3083927648 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f98a0070700 0x7f98a00b4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:10.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:10.055+0000 7f98a760c700 1 -- 172.21.15.149:0/3083927648 >> 172.21.15.149:0/3083927648 conn(0x7f98a006e040 msgr2=0x7f98a00728b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:10.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:10.055+0000 7f98a760c700 1 -- 172.21.15.149:0/3083927648 shutdown_connections 2023-11-08T19:29:10.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:10.055+0000 7f98a760c700 1 -- 172.21.15.149:0/3083927648 wait complete. 2023-11-08T19:29:10.059 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 93 2023-11-08T19:29:10.068 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-08T19:29:11.413 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-11-08T19:29:15.070 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:29:15.206 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.205+0000 7fd000a9d700 1 Processor -- start 2023-11-08T19:29:15.207 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.205+0000 7fd000a9d700 1 -- start start 2023-11-08T19:29:15.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.206+0000 7fd000a9d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcffc15b940 0x7fcffc0ce800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:15.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.206+0000 7fd000a9d700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcffc0b12c0 con 0x7fcffc0d04b0 2023-11-08T19:29:15.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.206+0000 7fd000a9d700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcffc0b15a0 con 0x7fcffc15bd20 2023-11-08T19:29:15.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.206+0000 7fd000a9d700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcffc0cf150 con 0x7fcffc15b940 2023-11-08T19:29:15.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.206+0000 7fcffad9d700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fcffc0d04b0 0x7fcffc0b2080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:47086/0 (socket says 172.21.15.149:47086) 2023-11-08T19:29:15.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.206+0000 7fcffad9d700 1 -- 172.21.15.149:0/3979296038 learned_addr learned my addr 172.21.15.149:0/3979296038 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:29:15.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.207+0000 7fcffa59c700 1 --2- 172.21.15.149:0/3979296038 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcffc15b940 0x7fcffc0ce800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:15.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.207+0000 7fcff959a700 1 -- 172.21.15.149:0/3979296038 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1104493173 0 0) 0x7fcffc0b12c0 con 0x7fcffc0d04b0 2023-11-08T19:29:15.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.207+0000 7fcff959a700 1 -- 172.21.15.149:0/3979296038 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfe40035b0 con 0x7fcffc0d04b0 2023-11-08T19:29:15.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.207+0000 7fcff959a700 1 -- 172.21.15.149:0/3979296038 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3362747808 0 0) 0x7fcffc0b15a0 con 0x7fcffc15bd20 2023-11-08T19:29:15.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.207+0000 7fcff959a700 1 -- 172.21.15.149:0/3979296038 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcffc0b12c0 con 0x7fcffc15bd20 2023-11-08T19:29:15.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.207+0000 7fcff959a700 1 -- 172.21.15.149:0/3979296038 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 583215591 0 0) 0x7fcfe40035b0 con 0x7fcffc0d04b0 2023-11-08T19:29:15.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.207+0000 7fcffa59c700 1 -- 172.21.15.149:0/3979296038 >> v1:172.21.15.160:6789/0 conn(0x7fcffc15bd20 legacy=0x7fcffc0cfda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:15.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.207+0000 7fcffa59c700 1 -- 172.21.15.149:0/3979296038 >> v1:172.21.15.149:6789/0 conn(0x7fcffc0d04b0 legacy=0x7fcffc0b2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:15.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.207+0000 7fcffa59c700 1 -- 172.21.15.149:0/3979296038 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcffc0b1880 con 0x7fcffc15b940 2023-11-08T19:29:15.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.207+0000 7fcffa59c700 1 --2- 172.21.15.149:0/3979296038 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcffc15b940 0x7fcffc0ce800 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcff0009870 tx=0x7fcff0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=529f3e6edefc346f server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:15.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.207+0000 7fcff959a700 1 -- 172.21.15.149:0/3979296038 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff40019f0 con 0x7fcffc15b940 2023-11-08T19:29:15.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.207+0000 7fcff959a700 1 -- 172.21.15.149:0/3979296038 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcff0004030 con 0x7fcffc15b940 2023-11-08T19:29:15.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.207+0000 7fcff959a700 1 -- 172.21.15.149:0/3979296038 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff00043c0 con 0x7fcffc15b940 2023-11-08T19:29:15.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.208+0000 7fd000a9d700 1 -- 172.21.15.149:0/3979296038 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcffc15b940 msgr2=0x7fcffc0ce800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:15.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.208+0000 7fd000a9d700 1 --2- 172.21.15.149:0/3979296038 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcffc15b940 0x7fcffc0ce800 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcff0009870 tx=0x7fcff0009b80 comp rx=0 tx=0).stop 2023-11-08T19:29:15.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.208+0000 7fd000a9d700 1 -- 172.21.15.149:0/3979296038 shutdown_connections 2023-11-08T19:29:15.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.208+0000 7fd000a9d700 1 --2- 172.21.15.149:0/3979296038 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcffc15b940 0x7fcffc0ce800 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:15.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.208+0000 7fd000a9d700 1 -- 172.21.15.149:0/3979296038 >> 172.21.15.149:0/3979296038 conn(0x7fcffc0d17c0 msgr2=0x7fcffc0d1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:15.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.208+0000 7fd000a9d700 1 -- 172.21.15.149:0/3979296038 shutdown_connections 2023-11-08T19:29:15.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.208+0000 7fd000a9d700 1 -- 172.21.15.149:0/3979296038 wait complete. 2023-11-08T19:29:15.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.209+0000 7fd000a9d700 1 Processor -- start 2023-11-08T19:29:15.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.210+0000 7fd000a9d700 1 -- start start 2023-11-08T19:29:15.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.210+0000 7fd000a9d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcffc0d04b0 0x7fcffc150d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:15.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.210+0000 7fd000a9d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcffc15b940 0x7fcffc15c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:15.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.210+0000 7fd000a9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcffc15bd20 0x7fcffc1f69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:15.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.210+0000 7fd000a9d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcffc06c640 con 0x7fcffc15bd20 2023-11-08T19:29:15.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.210+0000 7fd000a9d700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcffc151290 con 0x7fcffc0d04b0 2023-11-08T19:29:15.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.210+0000 7fd000a9d700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcffc06c890 con 0x7fcffc15b940 2023-11-08T19:29:15.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.210+0000 7fcffad9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcffc15bd20 0x7fcffc1f69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:15.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.210+0000 7fcffad9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcffc15bd20 0x7fcffc1f69e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45090/0 (socket says 172.21.15.149:45090) 2023-11-08T19:29:15.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.210+0000 7fcffad9d700 1 -- 172.21.15.149:0/2843128071 learned_addr learned my addr 172.21.15.149:0/2843128071 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:15.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.211+0000 7fcff9d9b700 1 --2- 172.21.15.149:0/2843128071 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcffc15b940 0x7fcffc15c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:15.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.211+0000 7fcffa59c700 1 --2- 172.21.15.149:0/2843128071 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcffc0d04b0 0x7fcffc150d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:15.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.211+0000 7fcffad9d700 1 -- 172.21.15.149:0/2843128071 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcffc15b940 msgr2=0x7fcffc15c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:15.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.211+0000 7fcffad9d700 1 --2- 172.21.15.149:0/2843128071 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcffc15b940 0x7fcffc15c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:15.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.211+0000 7fcffad9d700 1 -- 172.21.15.149:0/2843128071 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcffc0d04b0 msgr2=0x7fcffc150d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:15.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.211+0000 7fcffad9d700 1 --2- 172.21.15.149:0/2843128071 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcffc0d04b0 0x7fcffc150d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:15.221 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.211+0000 7fcffad9d700 1 -- 172.21.15.149:0/2843128071 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff00094a0 con 0x7fcffc15bd20 2023-11-08T19:29:15.221 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.211+0000 7fcffa59c700 1 --2- 172.21.15.149:0/2843128071 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcffc0d04b0 0x7fcffc150d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:29:15.221 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.211+0000 7fcffad9d700 1 --2- 172.21.15.149:0/2843128071 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcffc15bd20 0x7fcffc1f69e0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7fcff4001560 tx=0x7fcff4001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:15.221 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.211+0000 7fcfeaffd700 1 -- 172.21.15.149:0/2843128071 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff400abb0 con 0x7fcffc15bd20 2023-11-08T19:29:15.221 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.211+0000 7fcfeaffd700 1 -- 172.21.15.149:0/2843128071 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcff400ad30 con 0x7fcffc15bd20 2023-11-08T19:29:15.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.211+0000 7fd000a9d700 1 -- 172.21.15.149:0/2843128071 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcffc06cb70 con 0x7fcffc15bd20 2023-11-08T19:29:15.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.211+0000 7fcfeaffd700 1 -- 172.21.15.149:0/2843128071 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff400aea0 con 0x7fcffc15bd20 2023-11-08T19:29:15.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.211+0000 7fd000a9d700 1 -- 172.21.15.149:0/2843128071 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcffc06d130 con 0x7fcffc15bd20 2023-11-08T19:29:15.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.212+0000 7fd000a9d700 1 -- 172.21.15.149:0/2843128071 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcffc074f10 con 0x7fcffc15bd20 2023-11-08T19:29:15.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.212+0000 7fcfeaffd700 1 -- 172.21.15.149:0/2843128071 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcff4007310 con 0x7fcffc15bd20 2023-11-08T19:29:15.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.213+0000 7fcfeaffd700 1 --2- 172.21.15.149:0/2843128071 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fcfdc06af00 0x7fcfdc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:15.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.213+0000 7fcfeaffd700 1 -- 172.21.15.149:0/2843128071 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 7550+0+0 (secure 0 0 0) 0x7fcff4089b70 con 0x7fcffc15bd20 2023-11-08T19:29:15.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.213+0000 7fcffa59c700 1 --2- 172.21.15.149:0/2843128071 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fcfdc06af00 0x7fcfdc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:15.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.213+0000 7fcffa59c700 1 --2- 172.21.15.149:0/2843128071 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fcfdc06af00 0x7fcfdc06d3c0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fcff00090b0 tx=0x7fcff0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:15.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.218+0000 7fcfeaffd700 1 -- 172.21.15.149:0/2843128071 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcff4054580 con 0x7fcffc15bd20 2023-11-08T19:29:15.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.457+0000 7fd000a9d700 1 -- 172.21.15.149:0/2843128071 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcffc070d70 con 0x7fcffc15bd20 2023-11-08T19:29:15.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.457+0000 7fcfeaffd700 1 -- 172.21.15.149:0/2843128071 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4941 (secure 0 0 0) 0x7fcff4018090 con 0x7fcffc15bd20 2023-11-08T19:29:15.459 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:29:15.459 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":93,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6095,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/852710262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":852710262},{"type":"v1","addr":"172.21.15.160:6835","nonce":852710262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64},{"gid":7812,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/2818321595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2818321595},{"type":"v1","addr":"172.21.15.149:6836","nonce":2818321595}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:29:08.787414+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6236,"mds_1":7125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6236":{"gid":6236,"name":"d","rank":0,"incarnation":87,"state":"up:active","state_seq":12,"addr":"172.21.15.160:6834/1313631099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":1313631099},{"type":"v1","addr":"172.21.15.160:6834","nonce":1313631099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7125":{"gid":7125,"name":"c","rank":1,"incarnation":57,"state":"up:active","state_seq":6,"addr":"172.21.15.149:6837/3917392643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3917392643},{"type":"v1","addr":"172.21.15.149:6837","nonce":3917392643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:29:15.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.460+0000 7fd000a9d700 1 -- 172.21.15.149:0/2843128071 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fcfdc06af00 msgr2=0x7fcfdc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:15.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.460+0000 7fd000a9d700 1 --2- 172.21.15.149:0/2843128071 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fcfdc06af00 0x7fcfdc06d3c0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fcff00090b0 tx=0x7fcff0008030 comp rx=0 tx=0).stop 2023-11-08T19:29:15.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.460+0000 7fd000a9d700 1 -- 172.21.15.149:0/2843128071 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcffc15bd20 msgr2=0x7fcffc1f69e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:15.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.460+0000 7fd000a9d700 1 --2- 172.21.15.149:0/2843128071 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcffc15bd20 0x7fcffc1f69e0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7fcff4001560 tx=0x7fcff4001ad0 comp rx=0 tx=0).stop 2023-11-08T19:29:15.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.460+0000 7fd000a9d700 1 -- 172.21.15.149:0/2843128071 shutdown_connections 2023-11-08T19:29:15.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.460+0000 7fd000a9d700 1 --2- 172.21.15.149:0/2843128071 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fcfdc06af00 0x7fcfdc06d3c0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:15.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.460+0000 7fd000a9d700 1 --2- 172.21.15.149:0/2843128071 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcffc0d04b0 0x7fcffc150d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:15.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.460+0000 7fd000a9d700 1 --2- 172.21.15.149:0/2843128071 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcffc15bd20 0x7fcffc1f69e0 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:15.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.460+0000 7fd000a9d700 1 --2- 172.21.15.149:0/2843128071 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcffc15b940 0x7fcffc15c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:15.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.460+0000 7fd000a9d700 1 -- 172.21.15.149:0/2843128071 >> 172.21.15.149:0/2843128071 conn(0x7fcffc0d17c0 msgr2=0x7fcffc15ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:15.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.460+0000 7fd000a9d700 1 -- 172.21.15.149:0/2843128071 shutdown_connections 2023-11-08T19:29:15.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:15.460+0000 7fd000a9d700 1 -- 172.21.15.149:0/2843128071 wait complete. 2023-11-08T19:29:15.464 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 93 2023-11-08T19:29:15.473 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-08T19:29:18.026 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~7s 2023-11-08T19:29:20.474 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:29:20.610 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.608+0000 7ff57873e700 1 Processor -- start 2023-11-08T19:29:20.610 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.609+0000 7ff57873e700 1 -- start start 2023-11-08T19:29:20.612 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.610+0000 7ff57873e700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7ff57015db30 0x7ff570162190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:20.612 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.610+0000 7ff57873e700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff5700701b0 0x7ff57006ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:20.612 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.610+0000 7ff57873e700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff570070700 0x7ff57006b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:20.612 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.610+0000 7ff57873e700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff57015df10 con 0x7ff570070700 2023-11-08T19:29:20.613 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.610+0000 7ff57873e700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff57006ffd0 con 0x7ff57015db30 2023-11-08T19:29:20.613 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.610+0000 7ff57873e700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5700cc9f0 con 0x7ff5700701b0 2023-11-08T19:29:20.613 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.610+0000 7ff576cdb700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff570070700 0x7ff57006b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:20.613 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.610+0000 7ff576cdb700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff570070700 0x7ff57006b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45106/0 (socket says 172.21.15.149:45106) 2023-11-08T19:29:20.613 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.610+0000 7ff576cdb700 1 -- 172.21.15.149:0/959960880 learned_addr learned my addr 172.21.15.149:0/959960880 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:20.614 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.610+0000 7ff575cd9700 1 --2- 172.21.15.149:0/959960880 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff5700701b0 0x7ff57006ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:20.614 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.610+0000 7ff5764da700 1 --2- 172.21.15.149:0/959960880 >> v2:172.21.15.160:3300/0 conn(0x7ff57015db30 0x7ff570162190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:20.614 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.610+0000 7ff576cdb700 1 -- 172.21.15.149:0/959960880 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff5700701b0 msgr2=0x7ff57006ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:20.614 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.610+0000 7ff576cdb700 1 --2- 172.21.15.149:0/959960880 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff5700701b0 0x7ff57006ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:20.614 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.610+0000 7ff576cdb700 1 -- 172.21.15.149:0/959960880 >> v2:172.21.15.160:3300/0 conn(0x7ff57015db30 msgr2=0x7ff570162190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:20.615 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.610+0000 7ff576cdb700 1 --2- 172.21.15.149:0/959960880 >> v2:172.21.15.160:3300/0 conn(0x7ff57015db30 0x7ff570162190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:20.615 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.610+0000 7ff576cdb700 1 -- 172.21.15.149:0/959960880 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5700cccd0 con 0x7ff570070700 2023-11-08T19:29:20.615 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.610+0000 7ff576cdb700 1 --2- 172.21.15.149:0/959960880 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff570070700 0x7ff57006b060 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7ff5700ce170 tx=0x7ff56800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2393ac5ad9e2c973 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:20.615 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.611+0000 7ff5754d8700 1 -- 172.21.15.149:0/959960880 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56800e070 con 0x7ff570070700 2023-11-08T19:29:20.615 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.611+0000 7ff5754d8700 1 -- 172.21.15.149:0/959960880 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff56800b910 con 0x7ff570070700 2023-11-08T19:29:20.616 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.611+0000 7ff5754d8700 1 -- 172.21.15.149:0/959960880 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56800bcc0 con 0x7ff570070700 2023-11-08T19:29:20.619 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.611+0000 7ff57873e700 1 -- 172.21.15.149:0/959960880 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff570070700 msgr2=0x7ff57006b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:20.619 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.611+0000 7ff57873e700 1 --2- 172.21.15.149:0/959960880 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff570070700 0x7ff57006b060 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7ff5700ce170 tx=0x7ff56800b330 comp rx=0 tx=0).stop 2023-11-08T19:29:20.619 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.611+0000 7ff57873e700 1 -- 172.21.15.149:0/959960880 shutdown_connections 2023-11-08T19:29:20.620 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.611+0000 7ff57873e700 1 --2- 172.21.15.149:0/959960880 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff570070700 0x7ff57006b060 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:20.620 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.611+0000 7ff57873e700 1 --2- 172.21.15.149:0/959960880 >> v2:172.21.15.160:3300/0 conn(0x7ff57015db30 0x7ff570162190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:20.620 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.611+0000 7ff57873e700 1 --2- 172.21.15.149:0/959960880 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff5700701b0 0x7ff57006ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:20.620 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.611+0000 7ff57873e700 1 -- 172.21.15.149:0/959960880 >> 172.21.15.149:0/959960880 conn(0x7ff57006e040 msgr2=0x7ff57006e420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:20.620 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.611+0000 7ff57873e700 1 -- 172.21.15.149:0/959960880 shutdown_connections 2023-11-08T19:29:20.621 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.611+0000 7ff57873e700 1 -- 172.21.15.149:0/959960880 wait complete. 2023-11-08T19:29:20.621 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.613+0000 7ff57873e700 1 Processor -- start 2023-11-08T19:29:20.621 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.613+0000 7ff57873e700 1 -- start start 2023-11-08T19:29:20.621 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.614+0000 7ff57873e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff5700701b0 0x7ff57015c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:20.621 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.614+0000 7ff57873e700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff570070700 0x7ff5700c98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:20.622 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.614+0000 7ff57873e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff57015db30 0x7ff5700aea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:20.622 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.614+0000 7ff57873e700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5700b4340 con 0x7ff57015db30 2023-11-08T19:29:20.622 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.614+0000 7ff57873e700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5700b3730 con 0x7ff5700701b0 2023-11-08T19:29:20.622 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.614+0000 7ff57873e700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5700b3a10 con 0x7ff570070700 2023-11-08T19:29:20.622 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.614+0000 7ff576cdb700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff57015db30 0x7ff5700aea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:20.623 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.614+0000 7ff576cdb700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff57015db30 0x7ff5700aea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45110/0 (socket says 172.21.15.149:45110) 2023-11-08T19:29:20.623 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.614+0000 7ff576cdb700 1 -- 172.21.15.149:0/2682209270 learned_addr learned my addr 172.21.15.149:0/2682209270 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:20.623 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.614+0000 7ff575cd9700 1 --2- 172.21.15.149:0/2682209270 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff570070700 0x7ff5700c98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:20.623 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.614+0000 7ff5764da700 1 --2- 172.21.15.149:0/2682209270 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff5700701b0 0x7ff57015c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:20.623 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.614+0000 7ff576cdb700 1 -- 172.21.15.149:0/2682209270 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff570070700 msgr2=0x7ff5700c98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:20.623 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.614+0000 7ff576cdb700 1 --2- 172.21.15.149:0/2682209270 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff570070700 0x7ff5700c98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:20.624 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.614+0000 7ff576cdb700 1 -- 172.21.15.149:0/2682209270 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff5700701b0 msgr2=0x7ff57015c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:20.624 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.614+0000 7ff576cdb700 1 --2- 172.21.15.149:0/2682209270 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff5700701b0 0x7ff57015c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:20.624 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.615+0000 7ff576cdb700 1 -- 172.21.15.149:0/2682209270 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff568009b30 con 0x7ff57015db30 2023-11-08T19:29:20.624 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.615+0000 7ff576cdb700 1 --2- 172.21.15.149:0/2682209270 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff57015db30 0x7ff5700aea70 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7ff5700ce1d0 tx=0x7ff568004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:20.624 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.615+0000 7ff566ffd700 1 -- 172.21.15.149:0/2682209270 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5680099b0 con 0x7ff57015db30 2023-11-08T19:29:20.625 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.615+0000 7ff566ffd700 1 -- 172.21.15.149:0/2682209270 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff56800ce80 con 0x7ff57015db30 2023-11-08T19:29:20.625 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.615+0000 7ff57873e700 1 -- 172.21.15.149:0/2682209270 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5700b3cf0 con 0x7ff57015db30 2023-11-08T19:29:20.625 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.615+0000 7ff566ffd700 1 -- 172.21.15.149:0/2682209270 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff568004490 con 0x7ff57015db30 2023-11-08T19:29:20.625 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.615+0000 7ff57873e700 1 -- 172.21.15.149:0/2682209270 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5700c9e20 con 0x7ff57015db30 2023-11-08T19:29:20.625 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.616+0000 7ff57873e700 1 -- 172.21.15.149:0/2682209270 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5700c9fe0 con 0x7ff57015db30 2023-11-08T19:29:20.626 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.616+0000 7ff566ffd700 1 -- 172.21.15.149:0/2682209270 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff5680045f0 con 0x7ff57015db30 2023-11-08T19:29:20.626 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.617+0000 7ff566ffd700 1 --2- 172.21.15.149:0/2682209270 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff55406af00 0x7ff55406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:20.626 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.617+0000 7ff566ffd700 1 -- 172.21.15.149:0/2682209270 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 7550+0+0 (secure 0 0 0) 0x7ff56808ac40 con 0x7ff57015db30 2023-11-08T19:29:20.626 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.617+0000 7ff5764da700 1 --2- 172.21.15.149:0/2682209270 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff55406af00 0x7ff55406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:20.627 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.617+0000 7ff5764da700 1 --2- 172.21.15.149:0/2682209270 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff55406af00 0x7ff55406d3c0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7ff5700ca2b0 tx=0x7ff56c009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:20.627 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.622+0000 7ff566ffd700 1 -- 172.21.15.149:0/2682209270 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff568055650 con 0x7ff57015db30 2023-11-08T19:29:20.852 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.851+0000 7ff57873e700 1 -- 172.21.15.149:0/2682209270 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff570161660 con 0x7ff57015db30 2023-11-08T19:29:20.853 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.852+0000 7ff566ffd700 1 -- 172.21.15.149:0/2682209270 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4941 (secure 0 0 0) 0x7ff568088e60 con 0x7ff57015db30 2023-11-08T19:29:20.853 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:29:20.853 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":93,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6095,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/852710262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":852710262},{"type":"v1","addr":"172.21.15.160:6835","nonce":852710262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64},{"gid":7812,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/2818321595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2818321595},{"type":"v1","addr":"172.21.15.149:6836","nonce":2818321595}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:29:08.787414+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6236,"mds_1":7125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6236":{"gid":6236,"name":"d","rank":0,"incarnation":87,"state":"up:active","state_seq":12,"addr":"172.21.15.160:6834/1313631099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":1313631099},{"type":"v1","addr":"172.21.15.160:6834","nonce":1313631099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7125":{"gid":7125,"name":"c","rank":1,"incarnation":57,"state":"up:active","state_seq":6,"addr":"172.21.15.149:6837/3917392643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3917392643},{"type":"v1","addr":"172.21.15.149:6837","nonce":3917392643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:29:20.855 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.854+0000 7ff57873e700 1 -- 172.21.15.149:0/2682209270 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff55406af00 msgr2=0x7ff55406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:20.855 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.854+0000 7ff57873e700 1 --2- 172.21.15.149:0/2682209270 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff55406af00 0x7ff55406d3c0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7ff5700ca2b0 tx=0x7ff56c009210 comp rx=0 tx=0).stop 2023-11-08T19:29:20.856 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.854+0000 7ff57873e700 1 -- 172.21.15.149:0/2682209270 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff57015db30 msgr2=0x7ff5700aea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:20.856 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.854+0000 7ff57873e700 1 --2- 172.21.15.149:0/2682209270 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff57015db30 0x7ff5700aea70 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7ff5700ce1d0 tx=0x7ff568004ad0 comp rx=0 tx=0).stop 2023-11-08T19:29:20.856 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.854+0000 7ff57873e700 1 -- 172.21.15.149:0/2682209270 shutdown_connections 2023-11-08T19:29:20.856 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.854+0000 7ff57873e700 1 --2- 172.21.15.149:0/2682209270 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff55406af00 0x7ff55406d3c0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:20.856 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.854+0000 7ff57873e700 1 --2- 172.21.15.149:0/2682209270 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff5700701b0 0x7ff57015c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:20.857 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.854+0000 7ff57873e700 1 --2- 172.21.15.149:0/2682209270 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff57015db30 0x7ff5700aea70 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:20.857 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.854+0000 7ff57873e700 1 --2- 172.21.15.149:0/2682209270 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff570070700 0x7ff5700c98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:20.857 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.854+0000 7ff57873e700 1 -- 172.21.15.149:0/2682209270 >> 172.21.15.149:0/2682209270 conn(0x7ff57006e040 msgr2=0x7ff5700b0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:20.857 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.854+0000 7ff57873e700 1 -- 172.21.15.149:0/2682209270 shutdown_connections 2023-11-08T19:29:20.857 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:20.854+0000 7ff57873e700 1 -- 172.21.15.149:0/2682209270 wait complete. 2023-11-08T19:29:20.858 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 93 2023-11-08T19:29:20.867 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-08T19:29:24.639 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~13s 2023-11-08T19:29:25.869 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:29:26.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.001+0000 7f50df3c6700 1 Processor -- start 2023-11-08T19:29:26.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.001+0000 7f50df3c6700 1 -- start start 2023-11-08T19:29:26.005 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.002+0000 7f50df3c6700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f50d815dce0 0x7f50d80b20f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:26.005 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.002+0000 7f50df3c6700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f50d8070770 0x7f50d80ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:26.005 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.002+0000 7f50df3c6700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50d80ce6e0 con 0x7f50d806ab20 2023-11-08T19:29:26.005 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.002+0000 7f50df3c6700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50d80b2fb0 con 0x7f50d815dce0 2023-11-08T19:29:26.006 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.002+0000 7f50df3c6700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50d80b29f0 con 0x7f50d8070770 2023-11-08T19:29:26.006 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.002+0000 7f50dd162700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f50d815dce0 0x7f50d80b20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:26.006 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.002+0000 7f50dd162700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f50d815dce0 0x7f50d80b20f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45118/0 (socket says 172.21.15.149:45118) 2023-11-08T19:29:26.006 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.002+0000 7f50dd162700 1 -- 172.21.15.149:0/1079511380 learned_addr learned my addr 172.21.15.149:0/1079511380 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:26.006 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.002+0000 7f50dc961700 1 --2- 172.21.15.149:0/1079511380 >> v2:172.21.15.160:3300/0 conn(0x7f50d8070770 0x7f50d80ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:26.007 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.002+0000 7f50dd162700 1 -- 172.21.15.149:0/1079511380 >> v2:172.21.15.160:3300/0 conn(0x7f50d8070770 msgr2=0x7f50d80ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:26.007 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.002+0000 7f50dd162700 1 --2- 172.21.15.149:0/1079511380 >> v2:172.21.15.160:3300/0 conn(0x7f50d8070770 0x7f50d80ceb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:26.007 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.002+0000 7f50dd162700 1 -- 172.21.15.149:0/1079511380 >> v1:172.21.15.160:6789/0 conn(0x7f50d806ab20 legacy=0x7f50d8161660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:26.007 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.002+0000 7f50dd162700 1 -- 172.21.15.149:0/1079511380 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d80b2cd0 con 0x7f50d815dce0 2023-11-08T19:29:26.007 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.002+0000 7f50dc961700 1 --2- 172.21.15.149:0/1079511380 >> v2:172.21.15.160:3300/0 conn(0x7f50d8070770 0x7f50d80ceb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:29:26.008 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.003+0000 7f50dd162700 1 --2- 172.21.15.149:0/1079511380 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50d815dce0 0x7f50d80b20f0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f50d80b3230 tx=0x7f50d4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e373009d98928178 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:26.008 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.003+0000 7f50cffff700 1 -- 172.21.15.149:0/1079511380 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d4004230 con 0x7f50d815dce0 2023-11-08T19:29:26.008 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.003+0000 7f50cffff700 1 -- 172.21.15.149:0/1079511380 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50d4004390 con 0x7f50d815dce0 2023-11-08T19:29:26.008 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.003+0000 7f50cffff700 1 -- 172.21.15.149:0/1079511380 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d40036a0 con 0x7f50d815dce0 2023-11-08T19:29:26.008 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.003+0000 7f50df3c6700 1 -- 172.21.15.149:0/1079511380 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50d815dce0 msgr2=0x7f50d80b20f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:26.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.003+0000 7f50df3c6700 1 --2- 172.21.15.149:0/1079511380 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50d815dce0 0x7f50d80b20f0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f50d80b3230 tx=0x7f50d4009bd0 comp rx=0 tx=0).stop 2023-11-08T19:29:26.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.003+0000 7f50df3c6700 1 -- 172.21.15.149:0/1079511380 shutdown_connections 2023-11-08T19:29:26.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.003+0000 7f50df3c6700 1 --2- 172.21.15.149:0/1079511380 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50d815dce0 0x7f50d80b20f0 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:26.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.003+0000 7f50df3c6700 1 --2- 172.21.15.149:0/1079511380 >> v2:172.21.15.160:3300/0 conn(0x7f50d8070770 0x7f50d80ceb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:26.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.003+0000 7f50df3c6700 1 -- 172.21.15.149:0/1079511380 >> 172.21.15.149:0/1079511380 conn(0x7f50d80cd0f0 msgr2=0x7f50d80cd500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:26.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.003+0000 7f50df3c6700 1 -- 172.21.15.149:0/1079511380 shutdown_connections 2023-11-08T19:29:26.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.003+0000 7f50df3c6700 1 -- 172.21.15.149:0/1079511380 wait complete. 2023-11-08T19:29:26.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.004+0000 7f50df3c6700 1 Processor -- start 2023-11-08T19:29:26.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.005+0000 7f50df3c6700 1 -- start start 2023-11-08T19:29:26.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.005+0000 7f50df3c6700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50d806ab20 0x7f50d80c8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:26.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.005+0000 7f50df3c6700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f50d8070770 0x7f50d814fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:26.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.005+0000 7f50df3c6700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f50d815dce0 0x7f50d80b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:26.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.005+0000 7f50df3c6700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d815f5c0 con 0x7f50d806ab20 2023-11-08T19:29:26.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.005+0000 7f50df3c6700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d81610c0 con 0x7f50d815dce0 2023-11-08T19:29:26.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.005+0000 7f50df3c6700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50d8160860 con 0x7f50d8070770 2023-11-08T19:29:26.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.005+0000 7f50dd162700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50d806ab20 0x7f50d80c8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:26.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.005+0000 7f50dd162700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50d806ab20 0x7f50d80c8410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45124/0 (socket says 172.21.15.149:45124) 2023-11-08T19:29:26.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.005+0000 7f50dd162700 1 -- 172.21.15.149:0/591064302 learned_addr learned my addr 172.21.15.149:0/591064302 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:26.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.006+0000 7f50dd963700 1 --2- 172.21.15.149:0/591064302 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f50d815dce0 0x7f50d80b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:26.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.006+0000 7f50dc961700 1 --2- 172.21.15.149:0/591064302 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f50d8070770 0x7f50d814fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:26.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.006+0000 7f50dd162700 1 -- 172.21.15.149:0/591064302 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f50d8070770 msgr2=0x7f50d814fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:26.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.006+0000 7f50dd162700 1 --2- 172.21.15.149:0/591064302 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f50d8070770 0x7f50d814fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:26.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.006+0000 7f50dd162700 1 -- 172.21.15.149:0/591064302 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f50d815dce0 msgr2=0x7f50d80b3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:26.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.006+0000 7f50dd162700 1 --2- 172.21.15.149:0/591064302 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f50d815dce0 0x7f50d80b3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:26.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.006+0000 7f50dd162700 1 -- 172.21.15.149:0/591064302 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d4009550 con 0x7f50d806ab20 2023-11-08T19:29:26.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.006+0000 7f50dc961700 1 --2- 172.21.15.149:0/591064302 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f50d8070770 0x7f50d814fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:29:26.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.006+0000 7f50dd162700 1 --2- 172.21.15.149:0/591064302 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50d806ab20 0x7f50d80c8410 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f50d806ccc0 tx=0x7f50d4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:26.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.006+0000 7f50cdffb700 1 -- 172.21.15.149:0/591064302 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d4011630 con 0x7f50d806ab20 2023-11-08T19:29:26.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.006+0000 7f50cdffb700 1 -- 172.21.15.149:0/591064302 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50d4011790 con 0x7f50d806ab20 2023-11-08T19:29:26.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.006+0000 7f50df3c6700 1 -- 172.21.15.149:0/591064302 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50d8160b00 con 0x7f50d806ab20 2023-11-08T19:29:26.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.006+0000 7f50cdffb700 1 -- 172.21.15.149:0/591064302 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d4011b40 con 0x7f50d806ab20 2023-11-08T19:29:26.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.006+0000 7f50df3c6700 1 -- 172.21.15.149:0/591064302 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50d80c7740 con 0x7f50d806ab20 2023-11-08T19:29:26.018 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.007+0000 7f50df3c6700 1 -- 172.21.15.149:0/591064302 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50d8067810 con 0x7f50d806ab20 2023-11-08T19:29:26.018 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.008+0000 7f50cdffb700 1 -- 172.21.15.149:0/591064302 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f50d4011ca0 con 0x7f50d806ab20 2023-11-08T19:29:26.018 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.008+0000 7f50cdffb700 1 --2- 172.21.15.149:0/591064302 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f50bc06af00 0x7f50bc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:26.018 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.008+0000 7f50cdffb700 1 -- 172.21.15.149:0/591064302 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 7550+0+0 (secure 0 0 0) 0x7f50d408b3c0 con 0x7f50d806ab20 2023-11-08T19:29:26.018 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.008+0000 7f50dc961700 1 --2- 172.21.15.149:0/591064302 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f50bc06af00 0x7f50bc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:26.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.008+0000 7f50dc961700 1 --2- 172.21.15.149:0/591064302 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f50bc06af00 0x7f50bc06d3c0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f50d815f2d0 tx=0x7f50c8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:26.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.013+0000 7f50cdffb700 1 -- 172.21.15.149:0/591064302 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f50d4055dd0 con 0x7f50d806ab20 2023-11-08T19:29:26.251 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.250+0000 7f50df3c6700 1 -- 172.21.15.149:0/591064302 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f50d8074f10 con 0x7f50d806ab20 2023-11-08T19:29:26.251 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.250+0000 7f50cdffb700 1 -- 172.21.15.149:0/591064302 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+4989 (secure 0 0 0) 0x7f50d40593f0 con 0x7f50d806ab20 2023-11-08T19:29:26.252 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:29:26.252 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":94,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6095,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/852710262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":852710262},{"type":"v1","addr":"172.21.15.160:6835","nonce":852710262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64},{"gid":7812,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/2818321595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2818321595},{"type":"v1","addr":"172.21.15.149:6836","nonce":2818321595}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:29:24.155849+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6236,"mds_1":7125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6236":{"gid":6236,"name":"d","rank":0,"incarnation":87,"state":"up:active","state_seq":12,"addr":"172.21.15.160:6834/1313631099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":1313631099},{"type":"v1","addr":"172.21.15.160:6834","nonce":1313631099}]},"join_fscid":-1,"laggy_since":"2023-11-08T19:29:24.155849+0000","export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7125":{"gid":7125,"name":"c","rank":1,"incarnation":57,"state":"up:active","state_seq":6,"addr":"172.21.15.149:6837/3917392643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3917392643},{"type":"v1","addr":"172.21.15.149:6837","nonce":3917392643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:29:26.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.252+0000 7f50df3c6700 1 -- 172.21.15.149:0/591064302 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f50bc06af00 msgr2=0x7f50bc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:26.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.252+0000 7f50df3c6700 1 --2- 172.21.15.149:0/591064302 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f50bc06af00 0x7f50bc06d3c0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f50d815f2d0 tx=0x7f50c8008040 comp rx=0 tx=0).stop 2023-11-08T19:29:26.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.252+0000 7f50df3c6700 1 -- 172.21.15.149:0/591064302 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50d806ab20 msgr2=0x7f50d80c8410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:26.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.252+0000 7f50df3c6700 1 --2- 172.21.15.149:0/591064302 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50d806ab20 0x7f50d80c8410 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f50d806ccc0 tx=0x7f50d4004750 comp rx=0 tx=0).stop 2023-11-08T19:29:26.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.252+0000 7f50df3c6700 1 -- 172.21.15.149:0/591064302 shutdown_connections 2023-11-08T19:29:26.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.252+0000 7f50df3c6700 1 --2- 172.21.15.149:0/591064302 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f50bc06af00 0x7f50bc06d3c0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:26.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.252+0000 7f50df3c6700 1 --2- 172.21.15.149:0/591064302 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f50d815dce0 0x7f50d80b3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:26.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.252+0000 7f50df3c6700 1 --2- 172.21.15.149:0/591064302 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50d806ab20 0x7f50d80c8410 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:26.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.252+0000 7f50df3c6700 1 --2- 172.21.15.149:0/591064302 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f50d8070770 0x7f50d814fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:26.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.252+0000 7f50df3c6700 1 -- 172.21.15.149:0/591064302 >> 172.21.15.149:0/591064302 conn(0x7f50d80cd0f0 msgr2=0x7f50d80afaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:26.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.253+0000 7f50df3c6700 1 -- 172.21.15.149:0/591064302 shutdown_connections 2023-11-08T19:29:26.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.253+0000 7f50df3c6700 1 -- 172.21.15.149:0/591064302 wait complete. 2023-11-08T19:29:26.256 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 94 2023-11-08T19:29:26.266 DEBUG:tasks.ceph_test_case:wait_until_true: success in 15s and 0 retries 2023-11-08T19:29:26.266 DEBUG:teuthology.orchestra.run.smithi160:> sudo sysctl -n kernel.core_pattern 2023-11-08T19:29:26.299 INFO:teuthology.orchestra.run.smithi160.stdout:/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-08T19:29:26.300 INFO:tasks.cephfs.cephfs_test_case:Clearing core from directory: /home/ubuntu/cephtest/archive/coredump 2023-11-08T19:29:26.300 DEBUG:teuthology.orchestra.run.smithi160:> cd /home/ubuntu/cephtest/archive/coredump && sudo ls | sudo xargs file 2023-11-08T19:29:26.374 INFO:teuthology.orchestra.run.smithi160.stdout:1699471749.113757.core: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i d', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/bin/ceph-mds', platform: 'x86_64' 2023-11-08T19:29:26.377 INFO:tasks.cephfs.cephfs_test_case:Enumerated cores: ['1699471749.113757.core'] 2023-11-08T19:29:26.377 INFO:tasks.cephfs.cephfs_test_case:Found core file 1699471749.113757.core, deleting it 2023-11-08T19:29:26.378 DEBUG:teuthology.orchestra.run.smithi160:> cd /home/ubuntu/cephtest/archive/coredump && sudo rm -f 1699471749.113757.core 2023-11-08T19:29:26.448 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:29:26.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.570+0000 7f3d86b4f700 1 Processor -- start 2023-11-08T19:29:26.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.570+0000 7f3d86b4f700 1 -- start start 2023-11-08T19:29:26.573 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.571+0000 7f3d86b4f700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f3d8006b230 0x7f3d800cb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:26.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.571+0000 7f3d86b4f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3d80070310 0x7f3d800b37e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:26.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.571+0000 7f3d86b4f700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d800afea0 con 0x7f3d8015ba90 2023-11-08T19:29:26.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.571+0000 7f3d86b4f700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d8015be70 con 0x7f3d8006b230 2023-11-08T19:29:26.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.571+0000 7f3d86b4f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d800b2290 con 0x7f3d80070310 2023-11-08T19:29:26.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.571+0000 7f3d850ec700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3d80070310 0x7f3d800b37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:26.575 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.571+0000 7f3d7ffff700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f3d8006b230 0x7f3d800cb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:26.575 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.571+0000 7f3d850ec700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3d80070310 0x7f3d800b37e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.149:37192/0 (socket says 172.21.15.149:37192) 2023-11-08T19:29:26.575 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.571+0000 7f3d850ec700 1 -- 172.21.15.149:0/1789374519 learned_addr learned my addr 172.21.15.149:0/1789374519 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:26.575 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.571+0000 7f3d848eb700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f3d8015ba90 0x7f3d8006ab20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.149:58800/0 (socket says 172.21.15.149:58800) 2023-11-08T19:29:26.576 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.571+0000 7f3d850ec700 1 -- 172.21.15.149:0/1789374519 >> v2:172.21.15.160:3300/0 conn(0x7f3d8006b230 msgr2=0x7f3d800cb6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:26.576 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.571+0000 7f3d850ec700 1 --2- 172.21.15.149:0/1789374519 >> v2:172.21.15.160:3300/0 conn(0x7f3d8006b230 0x7f3d800cb6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:26.576 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.571+0000 7f3d850ec700 1 -- 172.21.15.149:0/1789374519 >> v1:172.21.15.160:6789/0 conn(0x7f3d8015ba90 legacy=0x7f3d8006ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:26.576 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.571+0000 7f3d7f7fe700 1 -- 172.21.15.149:0/1789374519 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2758618860 0 0) 0x7f3d800afea0 con 0x7f3d8015ba90 2023-11-08T19:29:26.576 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.571+0000 7f3d850ec700 1 -- 172.21.15.149:0/1789374519 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d800b2570 con 0x7f3d80070310 2023-11-08T19:29:26.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.571+0000 7f3d7ffff700 1 --2- 172.21.15.149:0/1789374519 >> v2:172.21.15.160:3300/0 conn(0x7f3d8006b230 0x7f3d800cb6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:29:26.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.572+0000 7f3d850ec700 1 --2- 172.21.15.149:0/1789374519 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3d80070310 0x7f3d800b37e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3d78009e50 tx=0x7f3d7800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84e2a39fe3403e74 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:26.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.572+0000 7f3d7f7fe700 1 -- 172.21.15.149:0/1789374519 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7800e070 con 0x7f3d80070310 2023-11-08T19:29:26.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.572+0000 7f3d7f7fe700 1 -- 172.21.15.149:0/1789374519 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d7800b910 con 0x7f3d80070310 2023-11-08T19:29:26.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.572+0000 7f3d7f7fe700 1 -- 172.21.15.149:0/1789374519 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7800bcc0 con 0x7f3d80070310 2023-11-08T19:29:26.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.572+0000 7f3d86b4f700 1 -- 172.21.15.149:0/1789374519 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3d80070310 msgr2=0x7f3d800b37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:26.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.572+0000 7f3d86b4f700 1 --2- 172.21.15.149:0/1789374519 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3d80070310 0x7f3d800b37e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3d78009e50 tx=0x7f3d7800b330 comp rx=0 tx=0).stop 2023-11-08T19:29:26.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.572+0000 7f3d86b4f700 1 -- 172.21.15.149:0/1789374519 shutdown_connections 2023-11-08T19:29:26.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.572+0000 7f3d86b4f700 1 --2- 172.21.15.149:0/1789374519 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3d80070310 0x7f3d800b37e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:26.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.572+0000 7f3d86b4f700 1 --2- 172.21.15.149:0/1789374519 >> v2:172.21.15.160:3300/0 conn(0x7f3d8006b230 0x7f3d800cb6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:26.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.572+0000 7f3d86b4f700 1 -- 172.21.15.149:0/1789374519 >> 172.21.15.149:0/1789374519 conn(0x7f3d800cd0f0 msgr2=0x7f3d800cd500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:26.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.572+0000 7f3d86b4f700 1 -- 172.21.15.149:0/1789374519 shutdown_connections 2023-11-08T19:29:26.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.572+0000 7f3d86b4f700 1 -- 172.21.15.149:0/1789374519 wait complete. 2023-11-08T19:29:26.584 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.573+0000 7f3d86b4f700 1 Processor -- start 2023-11-08T19:29:26.585 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.574+0000 7f3d86b4f700 1 -- start start 2023-11-08T19:29:26.585 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.574+0000 7f3d86b4f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3d8006b230 0x7f3d8014f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:26.585 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.574+0000 7f3d86b4f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3d80070310 0x7f3d801f4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:26.585 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.574+0000 7f3d86b4f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d8015ba90 0x7f3d80150440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:26.586 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.574+0000 7f3d86b4f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8014fea0 con 0x7f3d8015ba90 2023-11-08T19:29:26.586 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.574+0000 7f3d86b4f700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d801f5400 con 0x7f3d8006b230 2023-11-08T19:29:26.586 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.574+0000 7f3d86b4f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d80152df0 con 0x7f3d80070310 2023-11-08T19:29:26.586 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.575+0000 7f3d850ec700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d8015ba90 0x7f3d80150440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:26.586 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.575+0000 7f3d850ec700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d8015ba90 0x7f3d80150440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45142/0 (socket says 172.21.15.149:45142) 2023-11-08T19:29:26.587 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.575+0000 7f3d850ec700 1 -- 172.21.15.149:0/956418279 learned_addr learned my addr 172.21.15.149:0/956418279 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:26.587 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.575+0000 7f3d7ffff700 1 --2- 172.21.15.149:0/956418279 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3d80070310 0x7f3d801f4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:26.587 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.575+0000 7f3d848eb700 1 --2- 172.21.15.149:0/956418279 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3d8006b230 0x7f3d8014f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:26.587 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.575+0000 7f3d850ec700 1 -- 172.21.15.149:0/956418279 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3d80070310 msgr2=0x7f3d801f4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:26.587 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.575+0000 7f3d850ec700 1 --2- 172.21.15.149:0/956418279 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3d80070310 0x7f3d801f4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:26.588 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.575+0000 7f3d850ec700 1 -- 172.21.15.149:0/956418279 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3d8006b230 msgr2=0x7f3d8014f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:26.588 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.575+0000 7f3d850ec700 1 --2- 172.21.15.149:0/956418279 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3d8006b230 0x7f3d8014f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:26.588 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.575+0000 7f3d850ec700 1 -- 172.21.15.149:0/956418279 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d6c0094a0 con 0x7f3d8015ba90 2023-11-08T19:29:26.588 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.575+0000 7f3d7ffff700 1 --2- 172.21.15.149:0/956418279 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3d80070310 0x7f3d801f4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:29:26.588 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.575+0000 7f3d850ec700 1 --2- 172.21.15.149:0/956418279 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d8015ba90 0x7f3d80150440 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f3d800b23d0 tx=0x7f3d78004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:26.589 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.575+0000 7f3d7d7fa700 1 -- 172.21.15.149:0/956418279 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d78003ea0 con 0x7f3d8015ba90 2023-11-08T19:29:26.589 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.575+0000 7f3d7d7fa700 1 -- 172.21.15.149:0/956418279 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d780048e0 con 0x7f3d8015ba90 2023-11-08T19:29:26.589 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.575+0000 7f3d86b4f700 1 -- 172.21.15.149:0/956418279 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d78009b30 con 0x7f3d8015ba90 2023-11-08T19:29:26.589 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.575+0000 7f3d7d7fa700 1 -- 172.21.15.149:0/956418279 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7801c680 con 0x7f3d8015ba90 2023-11-08T19:29:26.589 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.575+0000 7f3d86b4f700 1 -- 172.21.15.149:0/956418279 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d801533b0 con 0x7f3d8015ba90 2023-11-08T19:29:26.590 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.576+0000 7f3d86b4f700 1 -- 172.21.15.149:0/956418279 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d80067810 con 0x7f3d8015ba90 2023-11-08T19:29:26.590 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.577+0000 7f3d7d7fa700 1 -- 172.21.15.149:0/956418279 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3d7801c7e0 con 0x7f3d8015ba90 2023-11-08T19:29:26.590 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.577+0000 7f3d7d7fa700 1 --2- 172.21.15.149:0/956418279 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3d6406af00 0x7f3d6406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:26.590 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.577+0000 7f3d7d7fa700 1 -- 172.21.15.149:0/956418279 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 7550+0+0 (secure 0 0 0) 0x7f3d7808b880 con 0x7f3d8015ba90 2023-11-08T19:29:26.590 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.577+0000 7f3d848eb700 1 --2- 172.21.15.149:0/956418279 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3d6406af00 0x7f3d6406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:26.591 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.577+0000 7f3d848eb700 1 --2- 172.21.15.149:0/956418279 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3d6406af00 0x7f3d6406d3c0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f3d74000f60 tx=0x7f3d74007e70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:26.591 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.582+0000 7f3d7d7fa700 1 -- 172.21.15.149:0/956418279 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3d78056290 con 0x7f3d8015ba90 2023-11-08T19:29:26.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.815+0000 7f3d86b4f700 1 -- 172.21.15.149:0/956418279 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3d80074f10 con 0x7f3d8015ba90 2023-11-08T19:29:26.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.815+0000 7f3d7d7fa700 1 -- 172.21.15.149:0/956418279 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+4989 (secure 0 0 0) 0x7f3d780598b0 con 0x7f3d8015ba90 2023-11-08T19:29:26.817 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:29:26.817 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":94,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6095,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/852710262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":852710262},{"type":"v1","addr":"172.21.15.160:6835","nonce":852710262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64},{"gid":7812,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/2818321595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2818321595},{"type":"v1","addr":"172.21.15.149:6836","nonce":2818321595}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:29:24.155849+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6236,"mds_1":7125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6236":{"gid":6236,"name":"d","rank":0,"incarnation":87,"state":"up:active","state_seq":12,"addr":"172.21.15.160:6834/1313631099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":1313631099},{"type":"v1","addr":"172.21.15.160:6834","nonce":1313631099}]},"join_fscid":-1,"laggy_since":"2023-11-08T19:29:24.155849+0000","export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7125":{"gid":7125,"name":"c","rank":1,"incarnation":57,"state":"up:active","state_seq":6,"addr":"172.21.15.149:6837/3917392643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3917392643},{"type":"v1","addr":"172.21.15.149:6837","nonce":3917392643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:29:26.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.817+0000 7f3d86b4f700 1 -- 172.21.15.149:0/956418279 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3d6406af00 msgr2=0x7f3d6406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:26.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.817+0000 7f3d86b4f700 1 --2- 172.21.15.149:0/956418279 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3d6406af00 0x7f3d6406d3c0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f3d74000f60 tx=0x7f3d74007e70 comp rx=0 tx=0).stop 2023-11-08T19:29:26.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.817+0000 7f3d86b4f700 1 -- 172.21.15.149:0/956418279 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d8015ba90 msgr2=0x7f3d80150440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:26.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.817+0000 7f3d86b4f700 1 --2- 172.21.15.149:0/956418279 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d8015ba90 0x7f3d80150440 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f3d800b23d0 tx=0x7f3d78004ad0 comp rx=0 tx=0).stop 2023-11-08T19:29:26.820 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.817+0000 7f3d86b4f700 1 -- 172.21.15.149:0/956418279 shutdown_connections 2023-11-08T19:29:26.820 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.817+0000 7f3d86b4f700 1 --2- 172.21.15.149:0/956418279 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3d6406af00 0x7f3d6406d3c0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:26.820 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.817+0000 7f3d86b4f700 1 --2- 172.21.15.149:0/956418279 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3d8006b230 0x7f3d8014f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:26.820 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.817+0000 7f3d86b4f700 1 --2- 172.21.15.149:0/956418279 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d8015ba90 0x7f3d80150440 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:26.820 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.817+0000 7f3d86b4f700 1 --2- 172.21.15.149:0/956418279 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3d80070310 0x7f3d801f4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:26.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.818+0000 7f3d86b4f700 1 -- 172.21.15.149:0/956418279 >> 172.21.15.149:0/956418279 conn(0x7f3d800cd0f0 msgr2=0x7f3d8006ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:26.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.818+0000 7f3d86b4f700 1 -- 172.21.15.149:0/956418279 shutdown_connections 2023-11-08T19:29:26.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:26.818+0000 7f3d86b4f700 1 -- 172.21.15.149:0/956418279 wait complete. 2023-11-08T19:29:26.821 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 94 2023-11-08T19:29:26.832 INFO:tasks.ceph.mds.c:Sent signal 9 2023-11-08T19:29:26.833 INFO:tasks.cephfs.mount:Suspending the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-08T19:29:26.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:29:26.834 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set brx.0 down 2023-11-08T19:29:26.875 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 6:0 2023-11-08T19:29:27.033 INFO:tasks.ceph.mds.c.smithi149.stderr:daemon-helper: command crashed with signal 9 2023-11-08T19:29:27.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.036+0000 7f73cc5fc700 1 Processor -- start 2023-11-08T19:29:27.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.036+0000 7f73cc5fc700 1 -- start start 2023-11-08T19:29:27.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.037+0000 7f73cc5fc700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f73c415a740 0x7f73c40cbce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:27.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.037+0000 7f73cc5fc700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f73c40720b0 0x7f73c40cd460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:27.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.037+0000 7f73cc5fc700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73c40ccfd0 con 0x7f73c40cd9a0 2023-11-08T19:29:27.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.037+0000 7f73cc5fc700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73c40cc3c0 con 0x7f73c40720b0 2023-11-08T19:29:27.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.037+0000 7f73cc5fc700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73c40cc6a0 con 0x7f73c415a740 2023-11-08T19:29:27.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.038+0000 7f73ca398700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f73c415a740 0x7f73c40cbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:27.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.038+0000 7f73c9b97700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f73c40720b0 0x7f73c40cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:27.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.038+0000 7f73ca398700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f73c415a740 0x7f73c40cbce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.149:37202/0 (socket says 172.21.15.149:37202) 2023-11-08T19:29:27.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.038+0000 7f73ca398700 1 -- 172.21.15.149:0/1696299138 learned_addr learned my addr 172.21.15.149:0/1696299138 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:27.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.038+0000 7f73c9b97700 1 -- 172.21.15.149:0/1696299138 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f73c415a740 msgr2=0x7f73c40cbce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:27.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.038+0000 7f73c9b97700 1 --2- 172.21.15.149:0/1696299138 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f73c415a740 0x7f73c40cbce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:27.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.038+0000 7f73c9b97700 1 -- 172.21.15.149:0/1696299138 >> v1:172.21.15.160:6789/0 conn(0x7f73c40cd9a0 legacy=0x7f73c40ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:27.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.038+0000 7f73c9b97700 1 -- 172.21.15.149:0/1696299138 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73c40cc980 con 0x7f73c40720b0 2023-11-08T19:29:27.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.038+0000 7f73c9396700 1 -- 172.21.15.149:0/1696299138 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1420587809 0 0) 0x7f73c40ccfd0 con 0x7f73c40cd9a0 2023-11-08T19:29:27.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.038+0000 7f73ca398700 1 --2- 172.21.15.149:0/1696299138 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f73c415a740 0x7f73c40cbce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:29:27.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.038+0000 7f73c9b97700 1 --2- 172.21.15.149:0/1696299138 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f73c40720b0 0x7f73c40cd460 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f73b4009840 tx=0x7f73b4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7643eb1670f0398f server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:27.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.039+0000 7f73c9396700 1 -- 172.21.15.149:0/1696299138 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b4011830 con 0x7f73c40720b0 2023-11-08T19:29:27.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.039+0000 7f73c9396700 1 -- 172.21.15.149:0/1696299138 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73b4011990 con 0x7f73c40720b0 2023-11-08T19:29:27.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.039+0000 7f73c9396700 1 -- 172.21.15.149:0/1696299138 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b4011d20 con 0x7f73c40720b0 2023-11-08T19:29:27.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.039+0000 7f73cc5fc700 1 -- 172.21.15.149:0/1696299138 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f73c40720b0 msgr2=0x7f73c40cd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:27.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.039+0000 7f73cc5fc700 1 --2- 172.21.15.149:0/1696299138 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f73c40720b0 0x7f73c40cd460 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f73b4009840 tx=0x7f73b4009b50 comp rx=0 tx=0).stop 2023-11-08T19:29:27.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.039+0000 7f73cc5fc700 1 -- 172.21.15.149:0/1696299138 shutdown_connections 2023-11-08T19:29:27.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.039+0000 7f73cc5fc700 1 --2- 172.21.15.149:0/1696299138 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f73c415a740 0x7f73c40cbce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:27.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.039+0000 7f73cc5fc700 1 --2- 172.21.15.149:0/1696299138 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f73c40720b0 0x7f73c40cd460 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:27.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.039+0000 7f73cc5fc700 1 -- 172.21.15.149:0/1696299138 >> 172.21.15.149:0/1696299138 conn(0x7f73c406e040 msgr2=0x7f73c406e420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:27.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.039+0000 7f73cc5fc700 1 -- 172.21.15.149:0/1696299138 shutdown_connections 2023-11-08T19:29:27.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.039+0000 7f73cc5fc700 1 -- 172.21.15.149:0/1696299138 wait complete. 2023-11-08T19:29:27.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.041+0000 7f73cc5fc700 1 Processor -- start 2023-11-08T19:29:27.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.041+0000 7f73cc5fc700 1 -- start start 2023-11-08T19:29:27.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.041+0000 7f73cc5fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73c40720b0 0x7f73c41469c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:27.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.041+0000 7f73cc5fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f73c40cd9a0 0x7f73c40b3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:27.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.041+0000 7f73cc5fc700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f73c415a740 0x7f73c40b37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:27.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.041+0000 7f73cc5fc700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73c40ca390 con 0x7f73c40720b0 2023-11-08T19:29:27.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.041+0000 7f73cc5fc700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73c40ca0b0 con 0x7f73c40cd9a0 2023-11-08T19:29:27.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.041+0000 7f73cc5fc700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73c40b45a0 con 0x7f73c415a740 2023-11-08T19:29:27.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.041+0000 7f73ca398700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73c40720b0 0x7f73c41469c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:27.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.041+0000 7f73ca398700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73c40720b0 0x7f73c41469c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45152/0 (socket says 172.21.15.149:45152) 2023-11-08T19:29:27.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.041+0000 7f73ca398700 1 -- 172.21.15.149:0/4191977879 learned_addr learned my addr 172.21.15.149:0/4191977879 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:27.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.042+0000 7f73cab99700 1 --2- 172.21.15.149:0/4191977879 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f73c415a740 0x7f73c40b37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:27.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.042+0000 7f73c9b97700 1 --2- 172.21.15.149:0/4191977879 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f73c40cd9a0 0x7f73c40b3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:27.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.042+0000 7f73ca398700 1 -- 172.21.15.149:0/4191977879 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f73c415a740 msgr2=0x7f73c40b37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:27.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.042+0000 7f73ca398700 1 --2- 172.21.15.149:0/4191977879 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f73c415a740 0x7f73c40b37b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:27.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.042+0000 7f73ca398700 1 -- 172.21.15.149:0/4191977879 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f73c40cd9a0 msgr2=0x7f73c40b3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:27.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.042+0000 7f73ca398700 1 --2- 172.21.15.149:0/4191977879 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f73c40cd9a0 0x7f73c40b3270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:27.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.042+0000 7f73ca398700 1 -- 172.21.15.149:0/4191977879 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73c0009550 con 0x7f73c40720b0 2023-11-08T19:29:27.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.042+0000 7f73ca398700 1 --2- 172.21.15.149:0/4191977879 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73c40720b0 0x7f73c41469c0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f73c000e9b0 tx=0x7f73c000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:27.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.042+0000 7f73baffd700 1 -- 172.21.15.149:0/4191977879 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c000ee50 con 0x7f73c40720b0 2023-11-08T19:29:27.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.042+0000 7f73baffd700 1 -- 172.21.15.149:0/4191977879 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73c000c850 con 0x7f73c40720b0 2023-11-08T19:29:27.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.042+0000 7f73cc5fc700 1 -- 172.21.15.149:0/4191977879 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73b40094a0 con 0x7f73c40720b0 2023-11-08T19:29:27.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.042+0000 7f73baffd700 1 -- 172.21.15.149:0/4191977879 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c000cbc0 con 0x7f73c40720b0 2023-11-08T19:29:27.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.042+0000 7f73cc5fc700 1 -- 172.21.15.149:0/4191977879 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73c4146f00 con 0x7f73c40720b0 2023-11-08T19:29:27.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.043+0000 7f73cc5fc700 1 -- 172.21.15.149:0/4191977879 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73c40b4f00 con 0x7f73c40720b0 2023-11-08T19:29:27.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.044+0000 7f73baffd700 1 -- 172.21.15.149:0/4191977879 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f73c000cd20 con 0x7f73c40720b0 2023-11-08T19:29:27.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.044+0000 7f73baffd700 1 --2- 172.21.15.149:0/4191977879 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f73a806af00 0x7f73a806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:27.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.044+0000 7f73baffd700 1 -- 172.21.15.149:0/4191977879 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 7550+0+0 (secure 0 0 0) 0x7f73c008a0a0 con 0x7f73c40720b0 2023-11-08T19:29:27.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.044+0000 7f73c9b97700 1 --2- 172.21.15.149:0/4191977879 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f73a806af00 0x7f73a806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:27.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.044+0000 7f73c9b97700 1 --2- 172.21.15.149:0/4191977879 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f73a806af00 0x7f73a806d3c0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f73b4000c00 tx=0x7f73b4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:27.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.049+0000 7f73baffd700 1 -- 172.21.15.149:0/4191977879 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f73c00549a0 con 0x7f73c40720b0 2023-11-08T19:29:27.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.321+0000 7f73cc5fc700 1 -- 172.21.15.149:0/4191977879 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "6:0"} v 0) v1 -- 0x7f73c40b4c20 con 0x7f73c40720b0 2023-11-08T19:29:27.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.324+0000 7f73baffd700 1 -- 172.21.15.149:0/4191977879 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "6:0"}]=0 failed mds gid 6236 v95) v1 ==== 97+0+0 (secure 0 0 0) 0x7f73c0057fc0 con 0x7f73c40720b0 2023-11-08T19:29:27.328 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.327+0000 7f73cc5fc700 1 -- 172.21.15.149:0/4191977879 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f73a806af00 msgr2=0x7f73a806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:27.328 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.327+0000 7f73cc5fc700 1 --2- 172.21.15.149:0/4191977879 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f73a806af00 0x7f73a806d3c0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f73b4000c00 tx=0x7f73b4008030 comp rx=0 tx=0).stop 2023-11-08T19:29:27.329 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.327+0000 7f73cc5fc700 1 -- 172.21.15.149:0/4191977879 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73c40720b0 msgr2=0x7f73c41469c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:27.329 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.327+0000 7f73cc5fc700 1 --2- 172.21.15.149:0/4191977879 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73c40720b0 0x7f73c41469c0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f73c000e9b0 tx=0x7f73c000ecc0 comp rx=0 tx=0).stop 2023-11-08T19:29:27.329 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.327+0000 7f73cc5fc700 1 -- 172.21.15.149:0/4191977879 shutdown_connections 2023-11-08T19:29:27.329 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.327+0000 7f73cc5fc700 1 --2- 172.21.15.149:0/4191977879 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f73a806af00 0x7f73a806d3c0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:27.329 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.327+0000 7f73cc5fc700 1 --2- 172.21.15.149:0/4191977879 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f73c415a740 0x7f73c40b37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:27.330 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.327+0000 7f73cc5fc700 1 --2- 172.21.15.149:0/4191977879 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73c40720b0 0x7f73c41469c0 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:27.330 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.327+0000 7f73cc5fc700 1 --2- 172.21.15.149:0/4191977879 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f73c40cd9a0 0x7f73c40b3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:27.330 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.327+0000 7f73cc5fc700 1 -- 172.21.15.149:0/4191977879 >> 172.21.15.149:0/4191977879 conn(0x7f73c406e040 msgr2=0x7f73c40b01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:27.330 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.327+0000 7f73cc5fc700 1 -- 172.21.15.149:0/4191977879 shutdown_connections 2023-11-08T19:29:27.330 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.327+0000 7f73cc5fc700 1 -- 172.21.15.149:0/4191977879 wait complete. 2023-11-08T19:29:27.331 INFO:teuthology.orchestra.run.smithi149.stderr:failed mds gid 6236 2023-11-08T19:29:27.343 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-08T19:29:27.344 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-08T19:29:27.344 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-08T19:29:27.344 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T19:29:27.345 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-08T19:29:27.345 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi160 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' 2023-11-08T19:29:27.346 INFO:tasks.ceph.mds.d:Stopped 2023-11-08T19:29:27.346 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-08T19:29:27.349 INFO:tasks.ceph.mds.d:Started 2023-11-08T19:29:27.350 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:29:27.433 INFO:tasks.ceph.mds.d.smithi160.stdout:starting mds.d at 2023-11-08T19:29:27.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.504+0000 7faf2ec9c700 1 Processor -- start 2023-11-08T19:29:27.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.504+0000 7faf2ec9c700 1 -- start start 2023-11-08T19:29:27.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.505+0000 7faf2ec9c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7faf2815ba90 0x7faf280cb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:27.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.505+0000 7faf2ec9c700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7faf28070310 0x7faf2806ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:27.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.505+0000 7faf2ec9c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faf2806b060 0x7faf28072040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:27.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.505+0000 7faf2ec9c700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf2815be70 con 0x7faf2815ba90 2023-11-08T19:29:27.509 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.505+0000 7faf2ec9c700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf2806b490 con 0x7faf28070310 2023-11-08T19:29:27.509 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.505+0000 7faf2ec9c700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf280afea0 con 0x7faf2806b060 2023-11-08T19:29:27.509 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.505+0000 7faf2ca38700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7faf2815ba90 0x7faf280cb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:27.509 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.505+0000 7faf2ca38700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7faf2815ba90 0x7faf280cb6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45176/0 (socket says 172.21.15.149:45176) 2023-11-08T19:29:27.509 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.505+0000 7faf2ca38700 1 -- 172.21.15.149:0/3748144252 learned_addr learned my addr 172.21.15.149:0/3748144252 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:27.510 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.505+0000 7faf2ca38700 1 -- 172.21.15.149:0/3748144252 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faf2806b060 msgr2=0x7faf28072040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:27.510 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.505+0000 7faf2d239700 1 --2- 172.21.15.149:0/3748144252 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faf2806b060 0x7faf28072040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:27.510 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.505+0000 7faf27fff700 1 --2- 172.21.15.149:0/3748144252 >> v2:172.21.15.160:3300/0 conn(0x7faf28070310 0x7faf2806ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:27.510 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.505+0000 7faf2ca38700 1 --2- 172.21.15.149:0/3748144252 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faf2806b060 0x7faf28072040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:27.510 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.505+0000 7faf2ca38700 1 -- 172.21.15.149:0/3748144252 >> v2:172.21.15.160:3300/0 conn(0x7faf28070310 msgr2=0x7faf2806ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:27.511 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.505+0000 7faf2ca38700 1 --2- 172.21.15.149:0/3748144252 >> v2:172.21.15.160:3300/0 conn(0x7faf28070310 0x7faf2806ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:27.511 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.505+0000 7faf2ca38700 1 -- 172.21.15.149:0/3748144252 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf280b2290 con 0x7faf2815ba90 2023-11-08T19:29:27.511 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.505+0000 7faf27fff700 1 --2- 172.21.15.149:0/3748144252 >> v2:172.21.15.160:3300/0 conn(0x7faf28070310 0x7faf2806ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:29:27.511 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.505+0000 7faf2ca38700 1 --2- 172.21.15.149:0/3748144252 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf2815ba90 0x7faf280cb6d0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7faf280c76d0 tx=0x7faf1c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bd9000eb7c3268f server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:27.511 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.506+0000 7faf277fe700 1 -- 172.21.15.149:0/3748144252 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1c00b870 con 0x7faf2815ba90 2023-11-08T19:29:27.511 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.506+0000 7faf277fe700 1 -- 172.21.15.149:0/3748144252 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf1c00b9d0 con 0x7faf2815ba90 2023-11-08T19:29:27.512 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.506+0000 7faf277fe700 1 -- 172.21.15.149:0/3748144252 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1c00bd60 con 0x7faf2815ba90 2023-11-08T19:29:27.512 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.506+0000 7faf2ec9c700 1 -- 172.21.15.149:0/3748144252 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf2815ba90 msgr2=0x7faf280cb6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:27.512 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.506+0000 7faf2ec9c700 1 --2- 172.21.15.149:0/3748144252 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf2815ba90 0x7faf280cb6d0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7faf280c76d0 tx=0x7faf1c009bd0 comp rx=0 tx=0).stop 2023-11-08T19:29:27.512 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.506+0000 7faf2ec9c700 1 -- 172.21.15.149:0/3748144252 shutdown_connections 2023-11-08T19:29:27.513 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.506+0000 7faf2ec9c700 1 --2- 172.21.15.149:0/3748144252 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faf2806b060 0x7faf28072040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:27.513 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.506+0000 7faf2ec9c700 1 --2- 172.21.15.149:0/3748144252 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf2815ba90 0x7faf280cb6d0 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:27.513 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.506+0000 7faf2ec9c700 1 --2- 172.21.15.149:0/3748144252 >> v2:172.21.15.160:3300/0 conn(0x7faf28070310 0x7faf2806ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:27.513 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.506+0000 7faf2ec9c700 1 -- 172.21.15.149:0/3748144252 >> 172.21.15.149:0/3748144252 conn(0x7faf280cd0f0 msgr2=0x7faf280cd500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:27.514 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.506+0000 7faf2ec9c700 1 -- 172.21.15.149:0/3748144252 shutdown_connections 2023-11-08T19:29:27.514 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.506+0000 7faf2ec9c700 1 -- 172.21.15.149:0/3748144252 wait complete. 2023-11-08T19:29:27.517 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.507+0000 7faf2ec9c700 1 Processor -- start 2023-11-08T19:29:27.517 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.507+0000 7faf2ec9c700 1 -- start start 2023-11-08T19:29:27.517 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.508+0000 7faf2ec9c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf2806b060 0x7faf281f2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:27.517 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.508+0000 7faf2ec9c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faf28070310 0x7faf280a8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:27.517 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.508+0000 7faf2ec9c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faf2815ba90 0x7faf280b1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:27.518 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.508+0000 7faf2ec9c700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf281f32d0 con 0x7faf2806b060 2023-11-08T19:29:27.518 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.508+0000 7faf2ec9c700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf28158a90 con 0x7faf2815ba90 2023-11-08T19:29:27.518 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.508+0000 7faf2ec9c700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf28158d70 con 0x7faf28070310 2023-11-08T19:29:27.518 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.508+0000 7faf2ca38700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf2806b060 0x7faf281f2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:27.518 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.508+0000 7faf2ca38700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf2806b060 0x7faf281f2990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45180/0 (socket says 172.21.15.149:45180) 2023-11-08T19:29:27.519 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.508+0000 7faf2ca38700 1 -- 172.21.15.149:0/1309682834 learned_addr learned my addr 172.21.15.149:0/1309682834 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:27.519 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.509+0000 7faf2d239700 1 --2- 172.21.15.149:0/1309682834 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faf2815ba90 0x7faf280b1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:27.519 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.509+0000 7faf27fff700 1 --2- 172.21.15.149:0/1309682834 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faf28070310 0x7faf280a8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:27.519 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.509+0000 7faf2ca38700 1 -- 172.21.15.149:0/1309682834 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faf28070310 msgr2=0x7faf280a8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:27.519 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.509+0000 7faf2ca38700 1 --2- 172.21.15.149:0/1309682834 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faf28070310 0x7faf280a8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:27.520 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.509+0000 7faf2ca38700 1 -- 172.21.15.149:0/1309682834 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faf2815ba90 msgr2=0x7faf280b1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:27.520 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.509+0000 7faf2ca38700 1 --2- 172.21.15.149:0/1309682834 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faf2815ba90 0x7faf280b1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:27.520 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.509+0000 7faf2ca38700 1 -- 172.21.15.149:0/1309682834 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf1c009550 con 0x7faf2806b060 2023-11-08T19:29:27.520 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.509+0000 7faf2ca38700 1 --2- 172.21.15.149:0/1309682834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf2806b060 0x7faf281f2990 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7faf1c014040 tx=0x7faf1c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:27.520 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.509+0000 7faf257fa700 1 -- 172.21.15.149:0/1309682834 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1c004520 con 0x7faf2806b060 2023-11-08T19:29:27.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.509+0000 7faf257fa700 1 -- 172.21.15.149:0/1309682834 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf1c01e070 con 0x7faf2806b060 2023-11-08T19:29:27.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.509+0000 7faf2ec9c700 1 -- 172.21.15.149:0/1309682834 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf28159050 con 0x7faf2806b060 2023-11-08T19:29:27.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.509+0000 7faf257fa700 1 -- 172.21.15.149:0/1309682834 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1c0038e0 con 0x7faf2806b060 2023-11-08T19:29:27.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.509+0000 7faf2ec9c700 1 -- 172.21.15.149:0/1309682834 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf281f2ed0 con 0x7faf2806b060 2023-11-08T19:29:27.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.510+0000 7faf2ec9c700 1 -- 172.21.15.149:0/1309682834 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf28067810 con 0x7faf2806b060 2023-11-08T19:29:27.522 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.510+0000 7faf257fa700 1 -- 172.21.15.149:0/1309682834 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faf1c003a40 con 0x7faf2806b060 2023-11-08T19:29:27.522 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.511+0000 7faf257fa700 1 --2- 172.21.15.149:0/1309682834 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7faf0c06af00 0x7faf0c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:27.522 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.511+0000 7faf257fa700 1 -- 172.21.15.149:0/1309682834 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 7608+0+0 (secure 0 0 0) 0x7faf1c020070 con 0x7faf2806b060 2023-11-08T19:29:27.522 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.511+0000 7faf27fff700 1 --2- 172.21.15.149:0/1309682834 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7faf0c06af00 0x7faf0c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:27.522 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.511+0000 7faf27fff700 1 --2- 172.21.15.149:0/1309682834 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7faf0c06af00 0x7faf0c06d3c0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7faf28159d40 tx=0x7faf14008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:27.523 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.516+0000 7faf257fa700 1 -- 172.21.15.149:0/1309682834 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7faf1c055d50 con 0x7faf2806b060 2023-11-08T19:29:27.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.749+0000 7faf2ec9c700 1 -- 172.21.15.149:0/1309682834 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf281f30c0 con 0x7faf2806b060 2023-11-08T19:29:27.751 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.750+0000 7faf257fa700 1 -- 172.21.15.149:0/1309682834 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 96 v96) v1 ==== 94+0+4146 (secure 0 0 0) 0x7faf1c015020 con 0x7faf2806b060 2023-11-08T19:29:27.751 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:29:27.751 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":96,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6095,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/852710262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":852710262},{"type":"v1","addr":"172.21.15.160:6835","nonce":852710262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":96,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:29:27.327889+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7812,"mds_1":7125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7125":{"gid":7125,"name":"c","rank":1,"incarnation":57,"state":"up:active","state_seq":6,"addr":"172.21.15.149:6837/3917392643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3917392643},{"type":"v1","addr":"172.21.15.149:6837","nonce":3917392643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7812":{"gid":7812,"name":"a","rank":0,"incarnation":96,"state":"up:replay","state_seq":1,"addr":"172.21.15.149:6836/2818321595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2818321595},{"type":"v1","addr":"172.21.15.149:6836","nonce":2818321595}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:29:27.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.752+0000 7faf2ec9c700 1 -- 172.21.15.149:0/1309682834 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7faf0c06af00 msgr2=0x7faf0c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:27.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.752+0000 7faf2ec9c700 1 --2- 172.21.15.149:0/1309682834 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7faf0c06af00 0x7faf0c06d3c0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7faf28159d40 tx=0x7faf14008040 comp rx=0 tx=0).stop 2023-11-08T19:29:27.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.752+0000 7faf2ec9c700 1 -- 172.21.15.149:0/1309682834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf2806b060 msgr2=0x7faf281f2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:27.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.752+0000 7faf2ec9c700 1 --2- 172.21.15.149:0/1309682834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf2806b060 0x7faf281f2990 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7faf1c014040 tx=0x7faf1c004750 comp rx=0 tx=0).stop 2023-11-08T19:29:27.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.752+0000 7faf2ec9c700 1 -- 172.21.15.149:0/1309682834 shutdown_connections 2023-11-08T19:29:27.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.752+0000 7faf2ec9c700 1 --2- 172.21.15.149:0/1309682834 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7faf0c06af00 0x7faf0c06d3c0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:27.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.752+0000 7faf2ec9c700 1 --2- 172.21.15.149:0/1309682834 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faf2815ba90 0x7faf280b1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:27.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.752+0000 7faf2ec9c700 1 --2- 172.21.15.149:0/1309682834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf2806b060 0x7faf281f2990 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:27.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.752+0000 7faf2ec9c700 1 --2- 172.21.15.149:0/1309682834 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faf28070310 0x7faf280a8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:27.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.752+0000 7faf2ec9c700 1 -- 172.21.15.149:0/1309682834 >> 172.21.15.149:0/1309682834 conn(0x7faf280cd0f0 msgr2=0x7faf2815ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:27.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.752+0000 7faf2ec9c700 1 -- 172.21.15.149:0/1309682834 shutdown_connections 2023-11-08T19:29:27.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:27.752+0000 7faf2ec9c700 1 -- 172.21.15.149:0/1309682834 wait complete. 2023-11-08T19:29:27.756 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 96 2023-11-08T19:29:27.765 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-11-08T19:29:31.252 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-11-08T19:29:31.253 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-11-08T19:29:32.766 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:29:32.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.899+0000 7faf7330d700 1 Processor -- start 2023-11-08T19:29:32.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.899+0000 7faf7330d700 1 -- start start 2023-11-08T19:29:32.906 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.900+0000 7faf7330d700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7faf6c15dce0 0x7faf6c0b20f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:32.906 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.900+0000 7faf7330d700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf6c0ce6e0 con 0x7faf6c06ab20 2023-11-08T19:29:32.906 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.900+0000 7faf7330d700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf6c0b2fb0 con 0x7faf6c070770 2023-11-08T19:29:32.906 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.900+0000 7faf7330d700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf6c0cf280 con 0x7faf6c15dce0 2023-11-08T19:29:32.907 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.900+0000 7faf718aa700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7faf6c06ab20 0x7faf6c161660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:47206/0 (socket says 172.21.15.149:47206) 2023-11-08T19:29:32.907 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.900+0000 7faf718aa700 1 -- 172.21.15.149:0/1836973099 learned_addr learned my addr 172.21.15.149:0/1836973099 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:29:32.907 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.900+0000 7faf63fff700 1 -- 172.21.15.149:0/1836973099 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 446899971 0 0) 0x7faf6c0ce6e0 con 0x7faf6c06ab20 2023-11-08T19:29:32.907 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.900+0000 7faf710a9700 1 --2- 172.21.15.149:0/1836973099 >> v2:172.21.15.160:3300/0 conn(0x7faf6c15dce0 0x7faf6c0b20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:32.908 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.900+0000 7faf63fff700 1 -- 172.21.15.149:0/1836973099 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf580035b0 con 0x7faf6c06ab20 2023-11-08T19:29:32.908 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.901+0000 7faf63fff700 1 -- 172.21.15.149:0/1836973099 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3450931001 0 0) 0x7faf580035b0 con 0x7faf6c06ab20 2023-11-08T19:29:32.908 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.901+0000 7faf63fff700 1 -- 172.21.15.149:0/1836973099 >> v2:172.21.15.160:3300/0 conn(0x7faf6c15dce0 msgr2=0x7faf6c0b20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:32.908 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.901+0000 7faf63fff700 1 --2- 172.21.15.149:0/1836973099 >> v2:172.21.15.160:3300/0 conn(0x7faf6c15dce0 0x7faf6c0b20f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:32.908 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.901+0000 7faf63fff700 1 -- 172.21.15.149:0/1836973099 >> v1:172.21.15.160:6789/0 conn(0x7faf6c070770 legacy=0x7faf6c0ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:32.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.901+0000 7faf63fff700 1 -- 172.21.15.149:0/1836973099 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf6c0b29f0 con 0x7faf6c06ab20 2023-11-08T19:29:32.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.901+0000 7faf63fff700 1 -- 172.21.15.149:0/1836973099 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7faf640019f0 con 0x7faf6c06ab20 2023-11-08T19:29:32.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.901+0000 7faf63fff700 1 -- 172.21.15.149:0/1836973099 >> v1:172.21.15.149:6789/0 conn(0x7faf6c06ab20 legacy=0x7faf6c161660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:32.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.901+0000 7faf63fff700 1 --2- 172.21.15.149:0/1836973099 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf58003a00 0x7faf58003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:32.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.901+0000 7faf63fff700 1 --2- 172.21.15.149:0/1836973099 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faf58004850 0x7faf58004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:32.910 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.901+0000 7faf63fff700 1 --2- 172.21.15.149:0/1836973099 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faf58005210 0x7faf5800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:32.910 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.901+0000 7faf63fff700 1 -- 172.21.15.149:0/1836973099 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5800c080 con 0x7faf58003a00 2023-11-08T19:29:32.910 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.901+0000 7faf63fff700 1 -- 172.21.15.149:0/1836973099 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5800c1f0 con 0x7faf58005210 2023-11-08T19:29:32.910 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.901+0000 7faf63fff700 1 -- 172.21.15.149:0/1836973099 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf5800c3b0 con 0x7faf58004850 2023-11-08T19:29:32.911 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.901+0000 7faf710a9700 1 --2- 172.21.15.149:0/1836973099 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf58003a00 0x7faf58003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:32.911 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.901+0000 7faf708a8700 1 --2- 172.21.15.149:0/1836973099 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faf58004850 0x7faf58004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:32.911 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.901+0000 7faf718aa700 1 --2- 172.21.15.149:0/1836973099 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faf58005210 0x7faf5800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:32.911 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.901+0000 7faf710a9700 1 -- 172.21.15.149:0/1836973099 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faf58004850 msgr2=0x7faf58004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:32.911 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.901+0000 7faf710a9700 1 --2- 172.21.15.149:0/1836973099 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faf58004850 0x7faf58004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:32.912 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.901+0000 7faf710a9700 1 -- 172.21.15.149:0/1836973099 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faf58005210 msgr2=0x7faf5800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:32.912 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.901+0000 7faf710a9700 1 --2- 172.21.15.149:0/1836973099 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faf58005210 0x7faf5800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:32.912 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.901+0000 7faf710a9700 1 -- 172.21.15.149:0/1836973099 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf580035b0 con 0x7faf58003a00 2023-11-08T19:29:32.912 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.901+0000 7faf718aa700 1 --2- 172.21.15.149:0/1836973099 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faf58005210 0x7faf5800ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:29:32.912 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.901+0000 7faf718aa700 1 -- 172.21.15.149:0/1836973099 reap_dead start 2023-11-08T19:29:32.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.901+0000 7faf710a9700 1 --2- 172.21.15.149:0/1836973099 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf58003a00 0x7faf58003e20 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7faf5c009b60 tx=0x7faf58005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29f738d4a38bd945 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:32.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.901+0000 7faf63fff700 1 -- 172.21.15.149:0/1836973099 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c00e6c0 con 0x7faf58003a00 2023-11-08T19:29:32.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.901+0000 7faf63fff700 1 -- 172.21.15.149:0/1836973099 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf5c00e820 con 0x7faf58003a00 2023-11-08T19:29:32.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.901+0000 7faf63fff700 1 -- 172.21.15.149:0/1836973099 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c00eb90 con 0x7faf58003a00 2023-11-08T19:29:32.914 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.902+0000 7faf7330d700 1 -- 172.21.15.149:0/1836973099 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf58003a00 msgr2=0x7faf58003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:32.914 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.902+0000 7faf7330d700 1 --2- 172.21.15.149:0/1836973099 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf58003a00 0x7faf58003e20 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7faf5c009b60 tx=0x7faf58005880 comp rx=0 tx=0).stop 2023-11-08T19:29:32.914 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.902+0000 7faf7330d700 1 -- 172.21.15.149:0/1836973099 shutdown_connections 2023-11-08T19:29:32.914 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.902+0000 7faf7330d700 1 --2- 172.21.15.149:0/1836973099 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf58003a00 0x7faf58003e20 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:32.914 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.902+0000 7faf7330d700 1 -- 172.21.15.149:0/1836973099 >> 172.21.15.149:0/1836973099 conn(0x7faf6c0cd0f0 msgr2=0x7faf6c0cd500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:32.915 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.902+0000 7faf7330d700 1 -- 172.21.15.149:0/1836973099 shutdown_connections 2023-11-08T19:29:32.915 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.902+0000 7faf7330d700 1 -- 172.21.15.149:0/1836973099 wait complete. 2023-11-08T19:29:32.915 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.903+0000 7faf7330d700 1 Processor -- start 2023-11-08T19:29:32.915 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.903+0000 7faf7330d700 1 -- start start 2023-11-08T19:29:32.918 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.904+0000 7faf7330d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf58003a00 0x7faf6c0b5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:32.918 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.904+0000 7faf7330d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faf6c0b3ca0 0x7faf6c151230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:32.918 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.904+0000 7faf7330d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faf6c151770 0x7faf6c15f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:32.919 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.904+0000 7faf7330d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf6c0b4260 con 0x7faf58003a00 2023-11-08T19:29:32.919 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.904+0000 7faf7330d700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf6c0b4540 con 0x7faf6c0b3ca0 2023-11-08T19:29:32.919 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.904+0000 7faf7330d700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf6c0b4820 con 0x7faf6c151770 2023-11-08T19:29:32.919 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.904+0000 7faf710a9700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf58003a00 0x7faf6c0b5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:32.919 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.904+0000 7faf710a9700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf58003a00 0x7faf6c0b5e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45214/0 (socket says 172.21.15.149:45214) 2023-11-08T19:29:32.920 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.904+0000 7faf710a9700 1 -- 172.21.15.149:0/2290694401 learned_addr learned my addr 172.21.15.149:0/2290694401 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:32.920 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.904+0000 7faf708a8700 1 --2- 172.21.15.149:0/2290694401 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faf6c0b3ca0 0x7faf6c151230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:32.920 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.904+0000 7faf718aa700 1 --2- 172.21.15.149:0/2290694401 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faf6c151770 0x7faf6c15f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:32.920 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.905+0000 7faf710a9700 1 -- 172.21.15.149:0/2290694401 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faf6c151770 msgr2=0x7faf6c15f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:32.920 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.905+0000 7faf710a9700 1 --2- 172.21.15.149:0/2290694401 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faf6c151770 0x7faf6c15f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:32.921 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.905+0000 7faf710a9700 1 -- 172.21.15.149:0/2290694401 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faf6c0b3ca0 msgr2=0x7faf6c151230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:32.921 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.905+0000 7faf710a9700 1 --2- 172.21.15.149:0/2290694401 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faf6c0b3ca0 0x7faf6c151230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:32.921 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.905+0000 7faf710a9700 1 -- 172.21.15.149:0/2290694401 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf6c0adbc0 con 0x7faf58003a00 2023-11-08T19:29:32.921 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.905+0000 7faf710a9700 1 --2- 172.21.15.149:0/2290694401 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf58003a00 0x7faf6c0b5e50 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7faf5800c1c0 tx=0x7faf5c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:32.921 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.905+0000 7faf61ffb700 1 -- 172.21.15.149:0/2290694401 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c00e6c0 con 0x7faf58003a00 2023-11-08T19:29:32.922 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.905+0000 7faf61ffb700 1 -- 172.21.15.149:0/2290694401 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf5c0038c0 con 0x7faf58003a00 2023-11-08T19:29:32.922 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.905+0000 7faf7330d700 1 -- 172.21.15.149:0/2290694401 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf6c0adea0 con 0x7faf58003a00 2023-11-08T19:29:32.922 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.905+0000 7faf61ffb700 1 -- 172.21.15.149:0/2290694401 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c003c70 con 0x7faf58003a00 2023-11-08T19:29:32.922 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.905+0000 7faf7330d700 1 -- 172.21.15.149:0/2290694401 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf6c15fb10 con 0x7faf58003a00 2023-11-08T19:29:32.922 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.906+0000 7faf7330d700 1 -- 172.21.15.149:0/2290694401 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf6c0ae210 con 0x7faf58003a00 2023-11-08T19:29:32.923 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.907+0000 7faf61ffb700 1 -- 172.21.15.149:0/2290694401 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faf5c013470 con 0x7faf58003a00 2023-11-08T19:29:32.923 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.907+0000 7faf61ffb700 1 --2- 172.21.15.149:0/2290694401 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7faf5006af00 0x7faf5006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:32.923 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.907+0000 7faf61ffb700 1 -- 172.21.15.149:0/2290694401 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 7608+0+0 (secure 0 0 0) 0x7faf5c08b3d0 con 0x7faf58003a00 2023-11-08T19:29:32.923 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.907+0000 7faf708a8700 1 --2- 172.21.15.149:0/2290694401 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7faf5006af00 0x7faf5006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:32.924 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.907+0000 7faf708a8700 1 --2- 172.21.15.149:0/2290694401 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7faf5006af00 0x7faf5006d3c0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7faf6c0c73f0 tx=0x7faf68009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:32.924 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:32.912+0000 7faf61ffb700 1 -- 172.21.15.149:0/2290694401 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7faf5c055ec0 con 0x7faf58003a00 2023-11-08T19:29:33.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.144+0000 7faf7330d700 1 -- 172.21.15.149:0/2290694401 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf6c067810 con 0x7faf58003a00 2023-11-08T19:29:33.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.145+0000 7faf61ffb700 1 -- 172.21.15.149:0/2290694401 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 97 v97) v1 ==== 94+0+4941 (secure 0 0 0) 0x7faf5c0594e0 con 0x7faf58003a00 2023-11-08T19:29:33.148 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:29:33.148 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":97,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6095,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/852710262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":852710262},{"type":"v1","addr":"172.21.15.160:6835","nonce":852710262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64},{"gid":6398,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/2282522167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2282522167},{"type":"v1","addr":"172.21.15.160:6834","nonce":2282522167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":97}],"filesystems":[{"mdsmap":{"epoch":97,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:29:27.345274+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7812,"mds_1":7125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7125":{"gid":7125,"name":"c","rank":1,"incarnation":57,"state":"up:active","state_seq":6,"addr":"172.21.15.149:6837/3917392643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3917392643},{"type":"v1","addr":"172.21.15.149:6837","nonce":3917392643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7812":{"gid":7812,"name":"a","rank":0,"incarnation":96,"state":"up:resolve","state_seq":8,"addr":"172.21.15.149:6836/2818321595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2818321595},{"type":"v1","addr":"172.21.15.149:6836","nonce":2818321595}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:29:33.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.147+0000 7faf7330d700 1 -- 172.21.15.149:0/2290694401 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7faf5006af00 msgr2=0x7faf5006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:33.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.147+0000 7faf7330d700 1 --2- 172.21.15.149:0/2290694401 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7faf5006af00 0x7faf5006d3c0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7faf6c0c73f0 tx=0x7faf68009040 comp rx=0 tx=0).stop 2023-11-08T19:29:33.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.147+0000 7faf7330d700 1 -- 172.21.15.149:0/2290694401 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf58003a00 msgr2=0x7faf6c0b5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:33.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.147+0000 7faf7330d700 1 --2- 172.21.15.149:0/2290694401 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf58003a00 0x7faf6c0b5e50 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7faf5800c1c0 tx=0x7faf5c0047c0 comp rx=0 tx=0).stop 2023-11-08T19:29:33.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.147+0000 7faf7330d700 1 -- 172.21.15.149:0/2290694401 shutdown_connections 2023-11-08T19:29:33.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.147+0000 7faf7330d700 1 --2- 172.21.15.149:0/2290694401 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7faf5006af00 0x7faf5006d3c0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:33.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.147+0000 7faf7330d700 1 --2- 172.21.15.149:0/2290694401 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faf6c151770 0x7faf6c15f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:33.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.147+0000 7faf7330d700 1 --2- 172.21.15.149:0/2290694401 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf58003a00 0x7faf6c0b5e50 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:33.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.147+0000 7faf7330d700 1 --2- 172.21.15.149:0/2290694401 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faf6c0b3ca0 0x7faf6c151230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:33.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.147+0000 7faf7330d700 1 -- 172.21.15.149:0/2290694401 >> 172.21.15.149:0/2290694401 conn(0x7faf6c0cd0f0 msgr2=0x7faf6c0cea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:33.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.147+0000 7faf7330d700 1 -- 172.21.15.149:0/2290694401 shutdown_connections 2023-11-08T19:29:33.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.147+0000 7faf7330d700 1 -- 172.21.15.149:0/2290694401 wait complete. 2023-11-08T19:29:33.152 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 97 2023-11-08T19:29:33.162 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-11-08T19:29:33.162 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:29:33.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.283+0000 7f5303564700 1 Processor -- start 2023-11-08T19:29:33.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.283+0000 7f5303564700 1 -- start start 2023-11-08T19:29:33.287 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.284+0000 7f5303564700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f52fc0cbce0 0x7f52fc0cd460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:33.288 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.284+0000 7f5303564700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f52fc0cd9a0 0x7f52fc0ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:33.288 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.284+0000 7f5303564700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52fc0ccfd0 con 0x7f52fc15a740 2023-11-08T19:29:33.288 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.284+0000 7f5303564700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52fc0cc160 con 0x7f52fc0cbce0 2023-11-08T19:29:33.288 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.284+0000 7f5303564700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52fc0cc3c0 con 0x7f52fc0cd9a0 2023-11-08T19:29:33.289 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.284+0000 7f5300aff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f52fc0cbce0 0x7f52fc0cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:33.289 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.284+0000 7f5300aff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f52fc0cbce0 0x7f52fc0cd460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45224/0 (socket says 172.21.15.149:45224) 2023-11-08T19:29:33.289 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.284+0000 7f5301300700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f52fc15a740 0x7f52fc0720b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:47224/0 (socket says 172.21.15.149:47224) 2023-11-08T19:29:33.289 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.284+0000 7f5300aff700 1 -- 172.21.15.149:0/841043152 learned_addr learned my addr 172.21.15.149:0/841043152 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:33.289 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.284+0000 7f5301b01700 1 --2- 172.21.15.149:0/841043152 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f52fc0cd9a0 0x7f52fc0ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:33.290 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.284+0000 7f5300aff700 1 -- 172.21.15.149:0/841043152 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f52fc0cd9a0 msgr2=0x7f52fc0ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:33.290 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.284+0000 7f5300aff700 1 --2- 172.21.15.149:0/841043152 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f52fc0cd9a0 0x7f52fc0ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:33.290 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.284+0000 7f5300aff700 1 -- 172.21.15.149:0/841043152 >> v1:172.21.15.149:6789/0 conn(0x7f52fc15a740 legacy=0x7f52fc0720b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:33.290 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.284+0000 7f52f3fff700 1 -- 172.21.15.149:0/841043152 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2876524596 0 0) 0x7f52fc0ccfd0 con 0x7f52fc15a740 2023-11-08T19:29:33.290 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.284+0000 7f5300aff700 1 -- 172.21.15.149:0/841043152 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52fc0cc6a0 con 0x7f52fc0cbce0 2023-11-08T19:29:33.291 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.284+0000 7f5300aff700 1 --2- 172.21.15.149:0/841043152 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52fc0cbce0 0x7f52fc0cd460 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f52ec0098f0 tx=0x7f52ec009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98d8e4152b6b570b server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:33.291 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.284+0000 7f52f3fff700 1 -- 172.21.15.149:0/841043152 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ec00b8a0 con 0x7f52fc0cbce0 2023-11-08T19:29:33.291 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.284+0000 7f52f3fff700 1 -- 172.21.15.149:0/841043152 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52ec00ba00 con 0x7f52fc0cbce0 2023-11-08T19:29:33.291 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.284+0000 7f52f3fff700 1 -- 172.21.15.149:0/841043152 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ec00bd90 con 0x7f52fc0cbce0 2023-11-08T19:29:33.291 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.285+0000 7f5303564700 1 -- 172.21.15.149:0/841043152 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52fc0cbce0 msgr2=0x7f52fc0cd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:33.292 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.285+0000 7f5303564700 1 --2- 172.21.15.149:0/841043152 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52fc0cbce0 0x7f52fc0cd460 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f52ec0098f0 tx=0x7f52ec009c00 comp rx=0 tx=0).stop 2023-11-08T19:29:33.292 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.285+0000 7f5303564700 1 -- 172.21.15.149:0/841043152 shutdown_connections 2023-11-08T19:29:33.292 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.285+0000 7f5303564700 1 --2- 172.21.15.149:0/841043152 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f52fc0cd9a0 0x7f52fc0ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:33.292 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.285+0000 7f5303564700 1 --2- 172.21.15.149:0/841043152 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52fc0cbce0 0x7f52fc0cd460 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:33.292 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.285+0000 7f5303564700 1 -- 172.21.15.149:0/841043152 >> 172.21.15.149:0/841043152 conn(0x7f52fc06e040 msgr2=0x7f52fc06e420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:33.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.285+0000 7f5303564700 1 -- 172.21.15.149:0/841043152 shutdown_connections 2023-11-08T19:29:33.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.285+0000 7f5303564700 1 -- 172.21.15.149:0/841043152 wait complete. 2023-11-08T19:29:33.295 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.286+0000 7f5303564700 1 Processor -- start 2023-11-08T19:29:33.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.286+0000 7f5303564700 1 -- start start 2023-11-08T19:29:33.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.287+0000 7f5303564700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f52fc0cbce0 0x7f52fc1f1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:33.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.287+0000 7f5303564700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f52fc0cd9a0 0x7f52fc1f0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:33.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.287+0000 7f5303564700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52fc15a740 0x7f52fc0ca070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:33.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.287+0000 7f5303564700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52fc14e370 con 0x7f52fc15a740 2023-11-08T19:29:33.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.287+0000 7f5303564700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52fc0ca5b0 con 0x7f52fc0cd9a0 2023-11-08T19:29:33.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.287+0000 7f5303564700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52fc1f4970 con 0x7f52fc0cbce0 2023-11-08T19:29:33.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.287+0000 7f5301b01700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52fc15a740 0x7f52fc0ca070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:33.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.287+0000 7f5301b01700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52fc15a740 0x7f52fc0ca070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45232/0 (socket says 172.21.15.149:45232) 2023-11-08T19:29:33.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.287+0000 7f5301b01700 1 -- 172.21.15.149:0/2343508077 learned_addr learned my addr 172.21.15.149:0/2343508077 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:33.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.287+0000 7f5301300700 1 --2- 172.21.15.149:0/2343508077 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f52fc0cbce0 0x7f52fc1f1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:33.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.287+0000 7f5300aff700 1 --2- 172.21.15.149:0/2343508077 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f52fc0cd9a0 0x7f52fc1f0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:33.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.287+0000 7f5301b01700 1 -- 172.21.15.149:0/2343508077 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f52fc0cbce0 msgr2=0x7f52fc1f1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:33.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.287+0000 7f5301b01700 1 --2- 172.21.15.149:0/2343508077 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f52fc0cbce0 0x7f52fc1f1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:33.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.287+0000 7f5301b01700 1 -- 172.21.15.149:0/2343508077 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f52fc0cd9a0 msgr2=0x7f52fc1f0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:33.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.287+0000 7f5301b01700 1 --2- 172.21.15.149:0/2343508077 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f52fc0cd9a0 0x7f52fc1f0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:33.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.287+0000 7f5301b01700 1 -- 172.21.15.149:0/2343508077 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52ec009550 con 0x7f52fc15a740 2023-11-08T19:29:33.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.288+0000 7f5301b01700 1 --2- 172.21.15.149:0/2343508077 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52fc15a740 0x7f52fc0ca070 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f52f4007e40 tx=0x7f52f400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:33.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.288+0000 7f52f1ffb700 1 -- 172.21.15.149:0/2343508077 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f400ed30 con 0x7f52fc15a740 2023-11-08T19:29:33.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.288+0000 7f52f1ffb700 1 -- 172.21.15.149:0/2343508077 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52f4014420 con 0x7f52fc15a740 2023-11-08T19:29:33.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.288+0000 7f52f1ffb700 1 -- 172.21.15.149:0/2343508077 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f40147d0 con 0x7f52fc15a740 2023-11-08T19:29:33.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.288+0000 7f5303564700 1 -- 172.21.15.149:0/2343508077 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52fc1f4c50 con 0x7f52fc15a740 2023-11-08T19:29:33.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.288+0000 7f5303564700 1 -- 172.21.15.149:0/2343508077 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52fc1f5210 con 0x7f52fc15a740 2023-11-08T19:29:33.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.289+0000 7f5303564700 1 -- 172.21.15.149:0/2343508077 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52fc1e47f0 con 0x7f52fc15a740 2023-11-08T19:29:33.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.290+0000 7f52f1ffb700 1 -- 172.21.15.149:0/2343508077 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f52f4014930 con 0x7f52fc15a740 2023-11-08T19:29:33.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.290+0000 7f52f1ffb700 1 --2- 172.21.15.149:0/2343508077 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f52e006af00 0x7f52e006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:33.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.291+0000 7f52f1ffb700 1 -- 172.21.15.149:0/2343508077 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 7608+0+0 (secure 0 0 0) 0x7f52f408a360 con 0x7f52fc15a740 2023-11-08T19:29:33.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.291+0000 7f5301300700 1 --2- 172.21.15.149:0/2343508077 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f52e006af00 0x7f52e006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:33.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.291+0000 7f5301300700 1 --2- 172.21.15.149:0/2343508077 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f52e006af00 0x7f52e006d3c0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f52f8000f60 tx=0x7f52f8007e70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:33.302 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.297+0000 7f52f1ffb700 1 -- 172.21.15.149:0/2343508077 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f52f4054d30 con 0x7f52fc15a740 2023-11-08T19:29:33.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.537+0000 7f5303564700 1 -- 172.21.15.149:0/2343508077 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f52fc067810 con 0x7f52fc15a740 2023-11-08T19:29:33.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.537+0000 7f52f1ffb700 1 -- 172.21.15.149:0/2343508077 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 97 v97) v1 ==== 94+0+4941 (secure 0 0 0) 0x7f52f4058350 con 0x7f52fc15a740 2023-11-08T19:29:33.540 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:29:33.540 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":97,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6095,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/852710262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":852710262},{"type":"v1","addr":"172.21.15.160:6835","nonce":852710262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64},{"gid":6398,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/2282522167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2282522167},{"type":"v1","addr":"172.21.15.160:6834","nonce":2282522167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":97}],"filesystems":[{"mdsmap":{"epoch":97,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:29:27.345274+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7812,"mds_1":7125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7125":{"gid":7125,"name":"c","rank":1,"incarnation":57,"state":"up:active","state_seq":6,"addr":"172.21.15.149:6837/3917392643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3917392643},{"type":"v1","addr":"172.21.15.149:6837","nonce":3917392643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7812":{"gid":7812,"name":"a","rank":0,"incarnation":96,"state":"up:resolve","state_seq":8,"addr":"172.21.15.149:6836/2818321595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2818321595},{"type":"v1","addr":"172.21.15.149:6836","nonce":2818321595}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:29:33.542 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.540+0000 7f5303564700 1 -- 172.21.15.149:0/2343508077 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f52e006af00 msgr2=0x7f52e006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:33.542 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.540+0000 7f5303564700 1 --2- 172.21.15.149:0/2343508077 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f52e006af00 0x7f52e006d3c0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f52f8000f60 tx=0x7f52f8007e70 comp rx=0 tx=0).stop 2023-11-08T19:29:33.542 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.540+0000 7f5303564700 1 -- 172.21.15.149:0/2343508077 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52fc15a740 msgr2=0x7f52fc0ca070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:33.543 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.540+0000 7f5303564700 1 --2- 172.21.15.149:0/2343508077 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52fc15a740 0x7f52fc0ca070 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f52f4007e40 tx=0x7f52f400e3c0 comp rx=0 tx=0).stop 2023-11-08T19:29:33.543 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.540+0000 7f5303564700 1 -- 172.21.15.149:0/2343508077 shutdown_connections 2023-11-08T19:29:33.543 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.540+0000 7f5303564700 1 --2- 172.21.15.149:0/2343508077 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f52e006af00 0x7f52e006d3c0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:33.543 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.540+0000 7f5303564700 1 --2- 172.21.15.149:0/2343508077 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52fc15a740 0x7f52fc0ca070 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:33.544 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.540+0000 7f5303564700 1 --2- 172.21.15.149:0/2343508077 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f52fc0cbce0 0x7f52fc1f1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:33.544 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.540+0000 7f5303564700 1 --2- 172.21.15.149:0/2343508077 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f52fc0cd9a0 0x7f52fc1f0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:33.544 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.540+0000 7f5303564700 1 -- 172.21.15.149:0/2343508077 >> 172.21.15.149:0/2343508077 conn(0x7f52fc06e040 msgr2=0x7f52fc159ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:33.544 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.540+0000 7f5303564700 1 -- 172.21.15.149:0/2343508077 shutdown_connections 2023-11-08T19:29:33.544 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.540+0000 7f5303564700 1 -- 172.21.15.149:0/2343508077 wait complete. 2023-11-08T19:29:33.545 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 97 2023-11-08T19:29:33.555 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:resolve 2023-11-08T19:29:33.555 DEBUG:tasks.cephfs.filesystem:reached state 'up:resolve' in 0.39279937744140625s 2023-11-08T19:29:33.556 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:29:33.676 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.674+0000 7ff7695fe700 1 Processor -- start 2023-11-08T19:29:33.677 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.674+0000 7ff7695fe700 1 -- start start 2023-11-08T19:29:33.679 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.675+0000 7ff7695fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff76415dda0 0x7ff7640d4320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:33.679 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.675+0000 7ff7695fe700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff764161e80 0x7ff7640b0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:33.679 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.675+0000 7ff7695fe700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7640d1f50 con 0x7ff7641623c0 2023-11-08T19:29:33.680 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.675+0000 7ff7695fe700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7640d21a0 con 0x7ff76415dda0 2023-11-08T19:29:33.680 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.675+0000 7ff7695fe700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7640d2480 con 0x7ff764161e80 2023-11-08T19:29:33.680 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.675+0000 7ff762ffd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff76415dda0 0x7ff7640d4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:33.680 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.675+0000 7ff762ffd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff76415dda0 0x7ff7640d4320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45236/0 (socket says 172.21.15.149:45236) 2023-11-08T19:29:33.680 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.675+0000 7ff762ffd700 1 -- 172.21.15.149:0/2339283178 learned_addr learned my addr 172.21.15.149:0/2339283178 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:33.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.675+0000 7ff7637fe700 1 --2- 172.21.15.149:0/2339283178 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff764161e80 0x7ff7640b0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:33.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.675+0000 7ff762ffd700 1 -- 172.21.15.149:0/2339283178 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff764161e80 msgr2=0x7ff7640b0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:33.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.675+0000 7ff762ffd700 1 --2- 172.21.15.149:0/2339283178 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff764161e80 0x7ff7640b0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:33.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.675+0000 7ff762ffd700 1 -- 172.21.15.149:0/2339283178 >> v1:172.21.15.160:6789/0 conn(0x7ff7641623c0 legacy=0x7ff764161770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:33.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.675+0000 7ff762ffd700 1 -- 172.21.15.149:0/2339283178 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7640d2760 con 0x7ff76415dda0 2023-11-08T19:29:33.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.676+0000 7ff762ffd700 1 --2- 172.21.15.149:0/2339283178 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff76415dda0 0x7ff7640d4320 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7ff7580098f0 tx=0x7ff758009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88bb66be6bc1865d server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:33.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.676+0000 7ff761ffb700 1 -- 172.21.15.149:0/2339283178 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75800b8a0 con 0x7ff76415dda0 2023-11-08T19:29:33.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.676+0000 7ff761ffb700 1 -- 172.21.15.149:0/2339283178 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff75800ba00 con 0x7ff76415dda0 2023-11-08T19:29:33.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.676+0000 7ff761ffb700 1 -- 172.21.15.149:0/2339283178 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75800bd90 con 0x7ff76415dda0 2023-11-08T19:29:33.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.676+0000 7ff7695fe700 1 -- 172.21.15.149:0/2339283178 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff76415dda0 msgr2=0x7ff7640d4320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:33.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.676+0000 7ff7695fe700 1 --2- 172.21.15.149:0/2339283178 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff76415dda0 0x7ff7640d4320 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7ff7580098f0 tx=0x7ff758009c00 comp rx=0 tx=0).stop 2023-11-08T19:29:33.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.676+0000 7ff7695fe700 1 -- 172.21.15.149:0/2339283178 shutdown_connections 2023-11-08T19:29:33.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.676+0000 7ff7695fe700 1 --2- 172.21.15.149:0/2339283178 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff764161e80 0x7ff7640b0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:33.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.676+0000 7ff7695fe700 1 --2- 172.21.15.149:0/2339283178 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff76415dda0 0x7ff7640d4320 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:33.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.676+0000 7ff7695fe700 1 -- 172.21.15.149:0/2339283178 >> 172.21.15.149:0/2339283178 conn(0x7ff76409cc30 msgr2=0x7ff7640d3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:33.684 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.676+0000 7ff7695fe700 1 -- 172.21.15.149:0/2339283178 shutdown_connections 2023-11-08T19:29:33.684 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.676+0000 7ff7695fe700 1 -- 172.21.15.149:0/2339283178 wait complete. 2023-11-08T19:29:33.687 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.678+0000 7ff7695fe700 1 Processor -- start 2023-11-08T19:29:33.687 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.678+0000 7ff7695fe700 1 -- start start 2023-11-08T19:29:33.687 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.678+0000 7ff7695fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff76415dda0 0x7ff7640caa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:33.687 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.678+0000 7ff7695fe700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff764161e80 0x7ff764155840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:33.688 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.678+0000 7ff7695fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff7640c7d70 0x7ff76406bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:33.688 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.678+0000 7ff7695fe700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7640cb020 con 0x7ff76415dda0 2023-11-08T19:29:33.688 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.678+0000 7ff7695fe700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7640cb300 con 0x7ff7640c7d70 2023-11-08T19:29:33.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.678+0000 7ff7695fe700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7640cb5e0 con 0x7ff764161e80 2023-11-08T19:29:33.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.679+0000 7ff762ffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff76415dda0 0x7ff7640caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:33.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.679+0000 7ff762ffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff76415dda0 0x7ff7640caa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45242/0 (socket says 172.21.15.149:45242) 2023-11-08T19:29:33.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.679+0000 7ff762ffd700 1 -- 172.21.15.149:0/2327939772 learned_addr learned my addr 172.21.15.149:0/2327939772 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:33.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.679+0000 7ff7637fe700 1 --2- 172.21.15.149:0/2327939772 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff7640c7d70 0x7ff76406bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:33.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.679+0000 7ff7627fc700 1 --2- 172.21.15.149:0/2327939772 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff764161e80 0x7ff764155840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:33.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.679+0000 7ff762ffd700 1 -- 172.21.15.149:0/2327939772 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff764161e80 msgr2=0x7ff764155840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:33.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.679+0000 7ff762ffd700 1 --2- 172.21.15.149:0/2327939772 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff764161e80 0x7ff764155840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:33.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.679+0000 7ff762ffd700 1 -- 172.21.15.149:0/2327939772 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff7640c7d70 msgr2=0x7ff76406bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:33.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.679+0000 7ff762ffd700 1 --2- 172.21.15.149:0/2327939772 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff7640c7d70 0x7ff76406bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:33.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.679+0000 7ff762ffd700 1 -- 172.21.15.149:0/2327939772 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff758009550 con 0x7ff76415dda0 2023-11-08T19:29:33.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.679+0000 7ff7637fe700 1 --2- 172.21.15.149:0/2327939772 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff7640c7d70 0x7ff76406bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:29:33.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.679+0000 7ff762ffd700 1 --2- 172.21.15.149:0/2327939772 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff76415dda0 0x7ff7640caa40 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7ff758000c00 tx=0x7ff758004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:33.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.679+0000 7ff74b7fe700 1 -- 172.21.15.149:0/2327939772 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff758004480 con 0x7ff76415dda0 2023-11-08T19:29:33.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.679+0000 7ff74b7fe700 1 -- 172.21.15.149:0/2327939772 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff75801f070 con 0x7ff76415dda0 2023-11-08T19:29:33.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.679+0000 7ff74b7fe700 1 -- 172.21.15.149:0/2327939772 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7580038c0 con 0x7ff76415dda0 2023-11-08T19:29:33.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.679+0000 7ff7695fe700 1 -- 172.21.15.149:0/2327939772 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7640cb8c0 con 0x7ff76415dda0 2023-11-08T19:29:33.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.679+0000 7ff7695fe700 1 -- 172.21.15.149:0/2327939772 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7640cd800 con 0x7ff76415dda0 2023-11-08T19:29:33.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.680+0000 7ff7695fe700 1 -- 172.21.15.149:0/2327939772 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7640cbde0 con 0x7ff76415dda0 2023-11-08T19:29:33.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.681+0000 7ff74b7fe700 1 -- 172.21.15.149:0/2327939772 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff758021030 con 0x7ff76415dda0 2023-11-08T19:29:33.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.681+0000 7ff74b7fe700 1 --2- 172.21.15.149:0/2327939772 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff75006af00 0x7ff75006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:33.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.681+0000 7ff74b7fe700 1 -- 172.21.15.149:0/2327939772 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 7608+0+0 (secure 0 0 0) 0x7ff75808b290 con 0x7ff76415dda0 2023-11-08T19:29:33.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.681+0000 7ff7627fc700 1 --2- 172.21.15.149:0/2327939772 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff75006af00 0x7ff75006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:33.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.681+0000 7ff7627fc700 1 --2- 172.21.15.149:0/2327939772 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff75006af00 0x7ff75006d3c0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7ff7640b3f70 tx=0x7ff754009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:33.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.686+0000 7ff74b7fe700 1 -- 172.21.15.149:0/2327939772 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff7640cbde0 con 0x7ff76415dda0 2023-11-08T19:29:33.917 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.915+0000 7ff7695fe700 1 -- 172.21.15.149:0/2327939772 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff764074f10 con 0x7ff76415dda0 2023-11-08T19:29:33.918 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.915+0000 7ff74b7fe700 1 -- 172.21.15.149:0/2327939772 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 97 v97) v1 ==== 94+0+4941 (secure 0 0 0) 0x7ff758055d80 con 0x7ff76415dda0 2023-11-08T19:29:33.918 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:29:33.918 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":97,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6095,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/852710262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":852710262},{"type":"v1","addr":"172.21.15.160:6835","nonce":852710262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64},{"gid":6398,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/2282522167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2282522167},{"type":"v1","addr":"172.21.15.160:6834","nonce":2282522167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":97}],"filesystems":[{"mdsmap":{"epoch":97,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:29:27.345274+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7812,"mds_1":7125},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7125":{"gid":7125,"name":"c","rank":1,"incarnation":57,"state":"up:active","state_seq":6,"addr":"172.21.15.149:6837/3917392643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3917392643},{"type":"v1","addr":"172.21.15.149:6837","nonce":3917392643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7812":{"gid":7812,"name":"a","rank":0,"incarnation":96,"state":"up:resolve","state_seq":8,"addr":"172.21.15.149:6836/2818321595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2818321595},{"type":"v1","addr":"172.21.15.149:6836","nonce":2818321595}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:29:33.920 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.917+0000 7ff7695fe700 1 -- 172.21.15.149:0/2327939772 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff75006af00 msgr2=0x7ff75006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:33.920 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.917+0000 7ff7695fe700 1 --2- 172.21.15.149:0/2327939772 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff75006af00 0x7ff75006d3c0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7ff7640b3f70 tx=0x7ff754009040 comp rx=0 tx=0).stop 2023-11-08T19:29:33.920 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.917+0000 7ff7695fe700 1 -- 172.21.15.149:0/2327939772 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff76415dda0 msgr2=0x7ff7640caa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:33.921 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.917+0000 7ff7695fe700 1 --2- 172.21.15.149:0/2327939772 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff76415dda0 0x7ff7640caa40 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7ff758000c00 tx=0x7ff758004750 comp rx=0 tx=0).stop 2023-11-08T19:29:33.921 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.917+0000 7ff7695fe700 1 -- 172.21.15.149:0/2327939772 shutdown_connections 2023-11-08T19:29:33.921 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.917+0000 7ff7695fe700 1 --2- 172.21.15.149:0/2327939772 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff75006af00 0x7ff75006d3c0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:33.921 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.917+0000 7ff7695fe700 1 --2- 172.21.15.149:0/2327939772 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff7640c7d70 0x7ff76406bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:33.922 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.917+0000 7ff7695fe700 1 --2- 172.21.15.149:0/2327939772 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff76415dda0 0x7ff7640caa40 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:33.922 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.917+0000 7ff7695fe700 1 --2- 172.21.15.149:0/2327939772 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff764161e80 0x7ff764155840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:33.922 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.917+0000 7ff7695fe700 1 -- 172.21.15.149:0/2327939772 >> 172.21.15.149:0/2327939772 conn(0x7ff76409cc30 msgr2=0x7ff7640b4b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:33.922 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.918+0000 7ff7695fe700 1 -- 172.21.15.149:0/2327939772 shutdown_connections 2023-11-08T19:29:33.922 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:33.918+0000 7ff7695fe700 1 -- 172.21.15.149:0/2327939772 wait complete. 2023-11-08T19:29:33.923 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 97 2023-11-08T19:29:33.932 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump snaps --server 2023-11-08T19:29:34.069 INFO:teuthology.orchestra.run.smithi149.stdout:{"last_snap":10,"last_created":5,"last_destroyed":9,"pending_noop":[],"snaps":[],"need_to_purge":{},"pending_update":[{"version":19,"snapinfo":{"snapid":10,"ino":1099511627777,"stamp":"2023-11-08T19:29:09.523028+0000","name":"s22","metadata":{}}}],"pending_destroy":[]} 2023-11-08T19:29:34.070 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 5, "last_destroyed": 9, "last_snap": 10, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [ { "snapInfinityo": { "ino": 1099511627777, "metadata": {}, "name": "s22", "snapid": 10, "stamp": "2023-11-08T19:29:09.523028+0000" }, "version": 19 } ], "snaps": [] } 2023-11-08T19:29:34.071 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 6:1 2023-11-08T19:29:34.193 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.191+0000 7f1eafe49700 1 Processor -- start 2023-11-08T19:29:34.194 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.191+0000 7f1eafe49700 1 -- start start 2023-11-08T19:29:34.196 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.192+0000 7f1eafe49700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f1ea815dce0 0x7f1ea80b20f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:34.196 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.192+0000 7f1eafe49700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f1ea8070770 0x7f1ea80ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:34.196 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.192+0000 7f1eafe49700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ea80ce6e0 con 0x7f1ea806ab20 2023-11-08T19:29:34.197 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.192+0000 7f1eafe49700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ea80b2fb0 con 0x7f1ea815dce0 2023-11-08T19:29:34.197 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.192+0000 7f1eafe49700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ea80b29f0 con 0x7f1ea8070770 2023-11-08T19:29:34.197 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.192+0000 7f1eadbe5700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f1ea815dce0 0x7f1ea80b20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:34.197 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.193+0000 7f1eadbe5700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f1ea815dce0 0x7f1ea80b20f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45252/0 (socket says 172.21.15.149:45252) 2023-11-08T19:29:34.197 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.193+0000 7f1eadbe5700 1 -- 172.21.15.149:0/4010178379 learned_addr learned my addr 172.21.15.149:0/4010178379 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:34.198 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.193+0000 7f1ead3e4700 1 --2- 172.21.15.149:0/4010178379 >> v2:172.21.15.160:3300/0 conn(0x7f1ea8070770 0x7f1ea80ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:34.198 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.193+0000 7f1eadbe5700 1 -- 172.21.15.149:0/4010178379 >> v2:172.21.15.160:3300/0 conn(0x7f1ea8070770 msgr2=0x7f1ea80ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:34.198 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.193+0000 7f1eadbe5700 1 --2- 172.21.15.149:0/4010178379 >> v2:172.21.15.160:3300/0 conn(0x7f1ea8070770 0x7f1ea80ceb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:34.198 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.193+0000 7f1eadbe5700 1 -- 172.21.15.149:0/4010178379 >> v1:172.21.15.160:6789/0 conn(0x7f1ea806ab20 legacy=0x7f1ea8161660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:34.198 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.193+0000 7f1eadbe5700 1 -- 172.21.15.149:0/4010178379 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ea80b2cd0 con 0x7f1ea815dce0 2023-11-08T19:29:34.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.193+0000 7f1eadbe5700 1 --2- 172.21.15.149:0/4010178379 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ea815dce0 0x7f1ea80b20f0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f1ea80b3230 tx=0x7f1e98009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e513499d1667074 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:34.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.193+0000 7f1eacbe3700 1 -- 172.21.15.149:0/4010178379 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e98011830 con 0x7f1ea815dce0 2023-11-08T19:29:34.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.193+0000 7f1eacbe3700 1 -- 172.21.15.149:0/4010178379 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e98011990 con 0x7f1ea815dce0 2023-11-08T19:29:34.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.193+0000 7f1eacbe3700 1 -- 172.21.15.149:0/4010178379 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e98011d20 con 0x7f1ea815dce0 2023-11-08T19:29:34.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.194+0000 7f1eafe49700 1 -- 172.21.15.149:0/4010178379 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ea815dce0 msgr2=0x7f1ea80b20f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:34.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.194+0000 7f1eafe49700 1 --2- 172.21.15.149:0/4010178379 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ea815dce0 0x7f1ea80b20f0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f1ea80b3230 tx=0x7f1e98009bd0 comp rx=0 tx=0).stop 2023-11-08T19:29:34.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.194+0000 7f1eafe49700 1 -- 172.21.15.149:0/4010178379 shutdown_connections 2023-11-08T19:29:34.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.194+0000 7f1eafe49700 1 --2- 172.21.15.149:0/4010178379 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ea815dce0 0x7f1ea80b20f0 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:34.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.194+0000 7f1eafe49700 1 --2- 172.21.15.149:0/4010178379 >> v2:172.21.15.160:3300/0 conn(0x7f1ea8070770 0x7f1ea80ceb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:34.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.194+0000 7f1eafe49700 1 -- 172.21.15.149:0/4010178379 >> 172.21.15.149:0/4010178379 conn(0x7f1ea80cd0f0 msgr2=0x7f1ea80cd500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:34.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.194+0000 7f1eafe49700 1 -- 172.21.15.149:0/4010178379 shutdown_connections 2023-11-08T19:29:34.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.194+0000 7f1eafe49700 1 -- 172.21.15.149:0/4010178379 wait complete. 2023-11-08T19:29:34.204 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.195+0000 7f1eafe49700 1 Processor -- start 2023-11-08T19:29:34.204 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.195+0000 7f1eafe49700 1 -- start start 2023-11-08T19:29:34.204 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.196+0000 7f1eafe49700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1ea806ab20 0x7f1ea814d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:34.204 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.196+0000 7f1eafe49700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ea8070770 0x7f1ea80ca1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:34.204 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.196+0000 7f1eafe49700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ea815dce0 0x7f1ea814cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:34.205 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.196+0000 7f1eafe49700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea814d080 con 0x7f1ea815dce0 2023-11-08T19:29:34.205 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.196+0000 7f1eafe49700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea815fe50 con 0x7f1ea8070770 2023-11-08T19:29:34.205 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.196+0000 7f1eafe49700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea815f410 con 0x7f1ea806ab20 2023-11-08T19:29:34.205 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.196+0000 7f1eae3e6700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ea815dce0 0x7f1ea814cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:34.206 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.196+0000 7f1eae3e6700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ea815dce0 0x7f1ea814cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45260/0 (socket says 172.21.15.149:45260) 2023-11-08T19:29:34.206 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.196+0000 7f1eae3e6700 1 -- 172.21.15.149:0/1394578700 learned_addr learned my addr 172.21.15.149:0/1394578700 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:34.206 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.196+0000 7f1ead3e4700 1 --2- 172.21.15.149:0/1394578700 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ea8070770 0x7f1ea80ca1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:34.206 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.196+0000 7f1eadbe5700 1 --2- 172.21.15.149:0/1394578700 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1ea806ab20 0x7f1ea814d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:34.206 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.196+0000 7f1eae3e6700 1 -- 172.21.15.149:0/1394578700 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1ea806ab20 msgr2=0x7f1ea814d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:34.207 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.196+0000 7f1eae3e6700 1 --2- 172.21.15.149:0/1394578700 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1ea806ab20 0x7f1ea814d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:34.207 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.196+0000 7f1eae3e6700 1 -- 172.21.15.149:0/1394578700 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ea8070770 msgr2=0x7f1ea80ca1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:34.207 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.196+0000 7f1eae3e6700 1 --2- 172.21.15.149:0/1394578700 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ea8070770 0x7f1ea80ca1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:34.207 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.196+0000 7f1eae3e6700 1 -- 172.21.15.149:0/1394578700 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e98009550 con 0x7f1ea815dce0 2023-11-08T19:29:34.207 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.196+0000 7f1eae3e6700 1 --2- 172.21.15.149:0/1394578700 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ea815dce0 0x7f1ea814cb40 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f1ea000cc50 tx=0x7f1ea000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:34.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.197+0000 7f1e9e7fc700 1 -- 172.21.15.149:0/1394578700 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea0003c00 con 0x7f1ea815dce0 2023-11-08T19:29:34.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.197+0000 7f1e9e7fc700 1 -- 172.21.15.149:0/1394578700 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ea0003d60 con 0x7f1ea815dce0 2023-11-08T19:29:34.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.197+0000 7f1e9e7fc700 1 -- 172.21.15.149:0/1394578700 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea000aab0 con 0x7f1ea815dce0 2023-11-08T19:29:34.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.197+0000 7f1eafe49700 1 -- 172.21.15.149:0/1394578700 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ea815f6f0 con 0x7f1ea815dce0 2023-11-08T19:29:34.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.197+0000 7f1eafe49700 1 -- 172.21.15.149:0/1394578700 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ea8159e40 con 0x7f1ea815dce0 2023-11-08T19:29:34.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.198+0000 7f1eafe49700 1 -- 172.21.15.149:0/1394578700 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ea8160000 con 0x7f1ea815dce0 2023-11-08T19:29:34.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.198+0000 7f1e9e7fc700 1 -- 172.21.15.149:0/1394578700 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1ea000ac10 con 0x7f1ea815dce0 2023-11-08T19:29:34.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.198+0000 7f1e9e7fc700 1 --2- 172.21.15.149:0/1394578700 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1e8c06af00 0x7f1e8c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:34.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.199+0000 7f1e9e7fc700 1 -- 172.21.15.149:0/1394578700 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 7608+0+0 (secure 0 0 0) 0x7f1ea0089c20 con 0x7f1ea815dce0 2023-11-08T19:29:34.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.199+0000 7f1eadbe5700 1 --2- 172.21.15.149:0/1394578700 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1e8c06af00 0x7f1e8c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:34.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.199+0000 7f1eadbe5700 1 --2- 172.21.15.149:0/1394578700 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1e8c06af00 0x7f1e8c06d3c0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f1e98000c00 tx=0x7f1e98008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:34.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.203+0000 7f1e9e7fc700 1 -- 172.21.15.149:0/1394578700 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1ea8160000 con 0x7f1ea815dce0 2023-11-08T19:29:34.481 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.479+0000 7f1eafe49700 1 -- 172.21.15.149:0/1394578700 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "6:1"} v 0) v1 -- 0x7f1ea8067810 con 0x7f1ea815dce0 2023-11-08T19:29:34.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.481+0000 7f1e9e7fc700 1 -- 172.21.15.149:0/1394578700 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "6:1"}]=0 failed mds gid 7125 v98) v1 ==== 97+0+0 (secure 0 0 0) 0x7f1ea00545f0 con 0x7f1ea815dce0 2023-11-08T19:29:34.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.483+0000 7f1eafe49700 1 -- 172.21.15.149:0/1394578700 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1e8c06af00 msgr2=0x7f1e8c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:34.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.483+0000 7f1eafe49700 1 --2- 172.21.15.149:0/1394578700 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1e8c06af00 0x7f1e8c06d3c0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f1e98000c00 tx=0x7f1e98008030 comp rx=0 tx=0).stop 2023-11-08T19:29:34.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.483+0000 7f1eafe49700 1 -- 172.21.15.149:0/1394578700 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ea815dce0 msgr2=0x7f1ea814cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:34.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.483+0000 7f1eafe49700 1 --2- 172.21.15.149:0/1394578700 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ea815dce0 0x7f1ea814cb40 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f1ea000cc50 tx=0x7f1ea000cf60 comp rx=0 tx=0).stop 2023-11-08T19:29:34.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.483+0000 7f1eafe49700 1 -- 172.21.15.149:0/1394578700 shutdown_connections 2023-11-08T19:29:34.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.483+0000 7f1eafe49700 1 --2- 172.21.15.149:0/1394578700 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1e8c06af00 0x7f1e8c06d3c0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:34.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.483+0000 7f1eafe49700 1 --2- 172.21.15.149:0/1394578700 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ea815dce0 0x7f1ea814cb40 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:34.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.483+0000 7f1eafe49700 1 --2- 172.21.15.149:0/1394578700 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1ea806ab20 0x7f1ea814d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:34.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.483+0000 7f1eafe49700 1 --2- 172.21.15.149:0/1394578700 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ea8070770 0x7f1ea80ca1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:34.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.483+0000 7f1eafe49700 1 -- 172.21.15.149:0/1394578700 >> 172.21.15.149:0/1394578700 conn(0x7f1ea80cd0f0 msgr2=0x7f1ea81615f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:34.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.483+0000 7f1eafe49700 1 -- 172.21.15.149:0/1394578700 shutdown_connections 2023-11-08T19:29:34.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.484+0000 7f1eafe49700 1 -- 172.21.15.149:0/1394578700 wait complete. 2023-11-08T19:29:34.488 INFO:teuthology.orchestra.run.smithi149.stderr:failed mds gid 7125 2023-11-08T19:29:34.501 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-08T19:29:34.502 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-08T19:29:34.502 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-08T19:29:34.502 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T19:29:34.503 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-08T19:29:34.503 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi149 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c' 2023-11-08T19:29:34.504 INFO:tasks.ceph.mds.c:Stopped 2023-11-08T19:29:34.504 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-08T19:29:34.507 INFO:tasks.ceph.mds.c:Started 2023-11-08T19:29:34.507 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:29:34.586 INFO:tasks.ceph.mds.c.smithi149.stdout:starting mds.c at 2023-11-08T19:29:34.632 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.630+0000 7fcd4d95c700 1 Processor -- start 2023-11-08T19:29:34.632 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.630+0000 7fcd4d95c700 1 -- start start 2023-11-08T19:29:34.635 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.631+0000 7fcd4d95c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fcd480b0d60 0x7fcd4806bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:34.635 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.631+0000 7fcd4d95c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd4806c410 0x7fcd480cd270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:34.635 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.631+0000 7fcd4d95c700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd480cc7d0 con 0x7fcd480ce1d0 2023-11-08T19:29:34.635 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.631+0000 7fcd4d95c700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd480cce50 con 0x7fcd480b0d60 2023-11-08T19:29:34.636 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.631+0000 7fcd4d95c700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd480cf590 con 0x7fcd4806c410 2023-11-08T19:29:34.636 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.631+0000 7fcd467fc700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fcd480b0d60 0x7fcd4806bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:34.636 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.631+0000 7fcd467fc700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fcd480b0d60 0x7fcd4806bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45284/0 (socket says 172.21.15.149:45284) 2023-11-08T19:29:34.636 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.631+0000 7fcd467fc700 1 -- 172.21.15.149:0/95823434 learned_addr learned my addr 172.21.15.149:0/95823434 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:34.636 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.631+0000 7fcd467fc700 1 -- 172.21.15.149:0/95823434 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd4806c410 msgr2=0x7fcd480cd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:34.637 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.631+0000 7fcd477fe700 1 --2- 172.21.15.149:0/95823434 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd4806c410 0x7fcd480cd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:34.637 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.631+0000 7fcd467fc700 1 --2- 172.21.15.149:0/95823434 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd4806c410 0x7fcd480cd270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:34.637 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.631+0000 7fcd467fc700 1 -- 172.21.15.149:0/95823434 >> v1:172.21.15.149:6789/0 conn(0x7fcd480ce1d0 legacy=0x7fcd480ce5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:34.637 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.631+0000 7fcd467fc700 1 -- 172.21.15.149:0/95823434 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd4806c920 con 0x7fcd480b0d60 2023-11-08T19:29:34.637 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.631+0000 7fcd477fe700 1 --2- 172.21.15.149:0/95823434 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd4806c410 0x7fcd480cd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:29:34.638 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.631+0000 7fcd467fc700 1 --2- 172.21.15.149:0/95823434 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd480b0d60 0x7fcd4806bed0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7fcd38009920 tx=0x7fcd38009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d779ccdf1d0ec2f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:34.638 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.632+0000 7fcd45ffb700 1 -- 172.21.15.149:0/95823434 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3800ba20 con 0x7fcd480b0d60 2023-11-08T19:29:34.638 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.632+0000 7fcd45ffb700 1 -- 172.21.15.149:0/95823434 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd3800bb80 con 0x7fcd480b0d60 2023-11-08T19:29:34.638 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.632+0000 7fcd45ffb700 1 -- 172.21.15.149:0/95823434 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd38009e70 con 0x7fcd480b0d60 2023-11-08T19:29:34.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.632+0000 7fcd4d95c700 1 -- 172.21.15.149:0/95823434 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd480b0d60 msgr2=0x7fcd4806bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:34.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.632+0000 7fcd4d95c700 1 --2- 172.21.15.149:0/95823434 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd480b0d60 0x7fcd4806bed0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7fcd38009920 tx=0x7fcd38009c30 comp rx=0 tx=0).stop 2023-11-08T19:29:34.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.632+0000 7fcd4d95c700 1 -- 172.21.15.149:0/95823434 shutdown_connections 2023-11-08T19:29:34.640 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.632+0000 7fcd4d95c700 1 --2- 172.21.15.149:0/95823434 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd4806c410 0x7fcd480cd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:34.640 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.632+0000 7fcd4d95c700 1 --2- 172.21.15.149:0/95823434 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd480b0d60 0x7fcd4806bed0 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:34.640 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.632+0000 7fcd4d95c700 1 -- 172.21.15.149:0/95823434 >> 172.21.15.149:0/95823434 conn(0x7fcd480d17c0 msgr2=0x7fcd480d1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:34.640 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.632+0000 7fcd4d95c700 1 -- 172.21.15.149:0/95823434 shutdown_connections 2023-11-08T19:29:34.641 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.632+0000 7fcd4d95c700 1 -- 172.21.15.149:0/95823434 wait complete. 2023-11-08T19:29:34.643 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.633+0000 7fcd4d95c700 1 Processor -- start 2023-11-08T19:29:34.644 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.634+0000 7fcd4d95c700 1 -- start start 2023-11-08T19:29:34.644 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.634+0000 7fcd4d95c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcd4806c410 0x7fcd480b5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:34.644 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.634+0000 7fcd4d95c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd480b0d60 0x7fcd480cb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:34.644 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.634+0000 7fcd4d95c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd480ce1d0 0x7fcd480b6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:34.644 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.634+0000 7fcd4d95c700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd480cbb20 con 0x7fcd480ce1d0 2023-11-08T19:29:34.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.634+0000 7fcd4d95c700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd480b5d00 con 0x7fcd4806c410 2023-11-08T19:29:34.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.634+0000 7fcd4d95c700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd480b5fe0 con 0x7fcd480b0d60 2023-11-08T19:29:34.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.634+0000 7fcd477fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd480ce1d0 0x7fcd480b6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:34.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.634+0000 7fcd477fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd480ce1d0 0x7fcd480b6da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45292/0 (socket says 172.21.15.149:45292) 2023-11-08T19:29:34.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.634+0000 7fcd477fe700 1 -- 172.21.15.149:0/4077073553 learned_addr learned my addr 172.21.15.149:0/4077073553 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:34.646 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.634+0000 7fcd467fc700 1 --2- 172.21.15.149:0/4077073553 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd480b0d60 0x7fcd480cb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:34.646 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.634+0000 7fcd46ffd700 1 --2- 172.21.15.149:0/4077073553 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcd4806c410 0x7fcd480b5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:34.646 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.635+0000 7fcd477fe700 1 -- 172.21.15.149:0/4077073553 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd480b0d60 msgr2=0x7fcd480cb5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:34.646 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.635+0000 7fcd477fe700 1 --2- 172.21.15.149:0/4077073553 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd480b0d60 0x7fcd480cb5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:34.647 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.635+0000 7fcd477fe700 1 -- 172.21.15.149:0/4077073553 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcd4806c410 msgr2=0x7fcd480b5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:34.647 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.635+0000 7fcd477fe700 1 --2- 172.21.15.149:0/4077073553 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcd4806c410 0x7fcd480b5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:34.647 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.635+0000 7fcd477fe700 1 -- 172.21.15.149:0/4077073553 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd38009550 con 0x7fcd480ce1d0 2023-11-08T19:29:34.647 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.635+0000 7fcd46ffd700 1 --2- 172.21.15.149:0/4077073553 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcd4806c410 0x7fcd480b5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:29:34.647 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.635+0000 7fcd477fe700 1 --2- 172.21.15.149:0/4077073553 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd480ce1d0 0x7fcd480b6da0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7fcd4000cea0 tx=0x7fcd4000ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:34.648 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.635+0000 7fcd2ffff700 1 -- 172.21.15.149:0/4077073553 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4000ada0 con 0x7fcd480ce1d0 2023-11-08T19:29:34.648 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.635+0000 7fcd2ffff700 1 -- 172.21.15.149:0/4077073553 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd40003a20 con 0x7fcd480ce1d0 2023-11-08T19:29:34.648 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.635+0000 7fcd4d95c700 1 -- 172.21.15.149:0/4077073553 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd480b62c0 con 0x7fcd480ce1d0 2023-11-08T19:29:34.648 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.635+0000 7fcd2ffff700 1 -- 172.21.15.149:0/4077073553 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd40003dd0 con 0x7fcd480ce1d0 2023-11-08T19:29:34.648 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.635+0000 7fcd4d95c700 1 -- 172.21.15.149:0/4077073553 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd480b6880 con 0x7fcd480ce1d0 2023-11-08T19:29:34.649 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.636+0000 7fcd4d95c700 1 -- 172.21.15.149:0/4077073553 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd48074f10 con 0x7fcd480ce1d0 2023-11-08T19:29:34.649 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.637+0000 7fcd2ffff700 1 -- 172.21.15.149:0/4077073553 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcd40003f30 con 0x7fcd480ce1d0 2023-11-08T19:29:34.649 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.637+0000 7fcd2ffff700 1 --2- 172.21.15.149:0/4077073553 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fcd3406af00 0x7fcd3406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:34.649 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.637+0000 7fcd46ffd700 1 --2- 172.21.15.149:0/4077073553 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fcd3406af00 0x7fcd3406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:34.650 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.637+0000 7fcd2ffff700 1 -- 172.21.15.149:0/4077073553 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7694+0+0 (secure 0 0 0) 0x7fcd4008a210 con 0x7fcd480ce1d0 2023-11-08T19:29:34.650 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.637+0000 7fcd46ffd700 1 --2- 172.21.15.149:0/4077073553 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fcd3406af00 0x7fcd3406d3c0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c000f60 tx=0x7fcd3c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:34.650 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.642+0000 7fcd2ffff700 1 -- 172.21.15.149:0/4077073553 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcd40054a70 con 0x7fcd480ce1d0 2023-11-08T19:29:34.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.875+0000 7fcd4d95c700 1 -- 172.21.15.149:0/4077073553 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcd480ce860 con 0x7fcd480ce1d0 2023-11-08T19:29:34.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.875+0000 7fcd2ffff700 1 -- 172.21.15.149:0/4077073553 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 99 v99) v1 ==== 94+0+4147 (secure 0 0 0) 0x7fcd40058090 con 0x7fcd480ce1d0 2023-11-08T19:29:34.878 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:29:34.878 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":99,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6095,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/852710262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":852710262},{"type":"v1","addr":"172.21.15.160:6835","nonce":852710262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":99,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:29:34.485434+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7812,"mds_1":6398},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6398":{"gid":6398,"name":"d","rank":1,"incarnation":99,"state":"up:replay","state_seq":1,"addr":"172.21.15.160:6834/2282522167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2282522167},{"type":"v1","addr":"172.21.15.160:6834","nonce":2282522167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7812":{"gid":7812,"name":"a","rank":0,"incarnation":96,"state":"up:resolve","state_seq":8,"addr":"172.21.15.149:6836/2818321595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2818321595},{"type":"v1","addr":"172.21.15.149:6836","nonce":2818321595}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:29:34.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.877+0000 7fcd4d95c700 1 -- 172.21.15.149:0/4077073553 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fcd3406af00 msgr2=0x7fcd3406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:34.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.877+0000 7fcd4d95c700 1 --2- 172.21.15.149:0/4077073553 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fcd3406af00 0x7fcd3406d3c0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c000f60 tx=0x7fcd3c009040 comp rx=0 tx=0).stop 2023-11-08T19:29:34.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.877+0000 7fcd4d95c700 1 -- 172.21.15.149:0/4077073553 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd480ce1d0 msgr2=0x7fcd480b6da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:34.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.877+0000 7fcd4d95c700 1 --2- 172.21.15.149:0/4077073553 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd480ce1d0 0x7fcd480b6da0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7fcd4000cea0 tx=0x7fcd4000ced0 comp rx=0 tx=0).stop 2023-11-08T19:29:34.881 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.877+0000 7fcd4d95c700 1 -- 172.21.15.149:0/4077073553 shutdown_connections 2023-11-08T19:29:34.881 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.877+0000 7fcd4d95c700 1 --2- 172.21.15.149:0/4077073553 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fcd3406af00 0x7fcd3406d3c0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:34.881 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.877+0000 7fcd4d95c700 1 --2- 172.21.15.149:0/4077073553 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcd4806c410 0x7fcd480b5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:34.881 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.877+0000 7fcd4d95c700 1 --2- 172.21.15.149:0/4077073553 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd480ce1d0 0x7fcd480b6da0 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:34.881 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.877+0000 7fcd4d95c700 1 --2- 172.21.15.149:0/4077073553 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd480b0d60 0x7fcd480cb5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:34.882 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.877+0000 7fcd4d95c700 1 -- 172.21.15.149:0/4077073553 >> 172.21.15.149:0/4077073553 conn(0x7fcd480d17c0 msgr2=0x7fcd480cfa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:34.882 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.877+0000 7fcd4d95c700 1 -- 172.21.15.149:0/4077073553 shutdown_connections 2023-11-08T19:29:34.882 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:34.877+0000 7fcd4d95c700 1 -- 172.21.15.149:0/4077073553 wait complete. 2023-11-08T19:29:34.883 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 99 2023-11-08T19:29:34.892 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-11-08T19:29:37.965 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-11-08T19:29:38.670 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T19:29:38.674 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T19:29:39.894 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:29:40.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.026+0000 7fa965e3b700 1 Processor -- start 2023-11-08T19:29:40.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.026+0000 7fa965e3b700 1 -- start start 2023-11-08T19:29:40.032 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.027+0000 7fa965e3b700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa96015dda0 0x7fa9600d4320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:40.032 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.027+0000 7fa965e3b700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fa960161e80 0x7fa9600b0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:40.032 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.027+0000 7fa965e3b700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9600d1f50 con 0x7fa9601623c0 2023-11-08T19:29:40.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.027+0000 7fa965e3b700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9600d21a0 con 0x7fa960161e80 2023-11-08T19:29:40.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.027+0000 7fa965e3b700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9600d2480 con 0x7fa96015dda0 2023-11-08T19:29:40.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.027+0000 7fa95effd700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fa9601623c0 0x7fa960161770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:47306/0 (socket says 172.21.15.149:47306) 2023-11-08T19:29:40.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.027+0000 7fa95effd700 1 -- 172.21.15.149:0/3909540348 learned_addr learned my addr 172.21.15.149:0/3909540348 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:29:40.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.027+0000 7fa95f7fe700 1 --2- 172.21.15.149:0/3909540348 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa96015dda0 0x7fa9600d4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:40.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.027+0000 7fa95ffff700 1 --2- 172.21.15.149:0/3909540348 >> v2:172.21.15.160:3300/0 conn(0x7fa960161e80 0x7fa9600b0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:40.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.027+0000 7fa95e7fc700 1 -- 172.21.15.149:0/3909540348 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1622776014 0 0) 0x7fa9600d1f50 con 0x7fa9601623c0 2023-11-08T19:29:40.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.027+0000 7fa95e7fc700 1 -- 172.21.15.149:0/3909540348 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9480035b0 con 0x7fa9601623c0 2023-11-08T19:29:40.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.027+0000 7fa95e7fc700 1 -- 172.21.15.149:0/3909540348 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2674575248 0 0) 0x7fa9480035b0 con 0x7fa9601623c0 2023-11-08T19:29:40.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.027+0000 7fa95e7fc700 1 -- 172.21.15.149:0/3909540348 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa96015dda0 msgr2=0x7fa9600d4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:40.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.027+0000 7fa95e7fc700 1 --2- 172.21.15.149:0/3909540348 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa96015dda0 0x7fa9600d4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:40.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.027+0000 7fa95e7fc700 1 -- 172.21.15.149:0/3909540348 >> v2:172.21.15.160:3300/0 conn(0x7fa960161e80 msgr2=0x7fa9600b0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:40.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.027+0000 7fa95e7fc700 1 --2- 172.21.15.149:0/3909540348 >> v2:172.21.15.160:3300/0 conn(0x7fa960161e80 0x7fa9600b0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:40.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.027+0000 7fa95e7fc700 1 -- 172.21.15.149:0/3909540348 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9600d2760 con 0x7fa9601623c0 2023-11-08T19:29:40.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.027+0000 7fa95e7fc700 1 -- 172.21.15.149:0/3909540348 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7fa954001670 con 0x7fa9601623c0 2023-11-08T19:29:40.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.027+0000 7fa95e7fc700 1 -- 172.21.15.149:0/3909540348 >> v1:172.21.15.149:6789/0 conn(0x7fa9601623c0 legacy=0x7fa960161770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:40.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.027+0000 7fa95e7fc700 1 --2- 172.21.15.149:0/3909540348 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa948003a00 0x7fa948003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:40.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.027+0000 7fa95e7fc700 1 --2- 172.21.15.149:0/3909540348 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa96015dda0 0x7fa948004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:40.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.027+0000 7fa95e7fc700 1 --2- 172.21.15.149:0/3909540348 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa948004d90 0x7fa948005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:40.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.027+0000 7fa95e7fc700 1 -- 172.21.15.149:0/3909540348 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9600d21a0 con 0x7fa948003a00 2023-11-08T19:29:40.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.027+0000 7fa95e7fc700 1 -- 172.21.15.149:0/3909540348 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9600d2480 con 0x7fa948004d90 2023-11-08T19:29:40.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.027+0000 7fa95e7fc700 1 -- 172.21.15.149:0/3909540348 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa94800ba10 con 0x7fa96015dda0 2023-11-08T19:29:40.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.027+0000 7fa95f7fe700 1 --2- 172.21.15.149:0/3909540348 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa948003a00 0x7fa948003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:40.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.028+0000 7fa95effd700 1 --2- 172.21.15.149:0/3909540348 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa96015dda0 0x7fa948004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:40.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.028+0000 7fa95ffff700 1 --2- 172.21.15.149:0/3909540348 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa948004d90 0x7fa948005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:40.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.028+0000 7fa95f7fe700 1 -- 172.21.15.149:0/3909540348 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa96015dda0 msgr2=0x7fa948004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:40.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.028+0000 7fa95f7fe700 1 --2- 172.21.15.149:0/3909540348 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa96015dda0 0x7fa948004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:40.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.028+0000 7fa95f7fe700 1 -- 172.21.15.149:0/3909540348 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa948004d90 msgr2=0x7fa948005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:40.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.028+0000 7fa95f7fe700 1 --2- 172.21.15.149:0/3909540348 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa948004d90 0x7fa948005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:40.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.028+0000 7fa95f7fe700 1 -- 172.21.15.149:0/3909540348 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9480035b0 con 0x7fa948003a00 2023-11-08T19:29:40.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.028+0000 7fa95effd700 1 --2- 172.21.15.149:0/3909540348 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa96015dda0 0x7fa948004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:29:40.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.028+0000 7fa95f7fe700 1 --2- 172.21.15.149:0/3909540348 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa948003a00 0x7fa948003e20 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7fa950009b60 tx=0x7fa948005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72a77749d675173e server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:40.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.028+0000 7fa95e7fc700 1 -- 172.21.15.149:0/3909540348 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa95000e6c0 con 0x7fa948003a00 2023-11-08T19:29:40.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.028+0000 7fa95e7fc700 1 -- 172.21.15.149:0/3909540348 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa95000e820 con 0x7fa948003a00 2023-11-08T19:29:40.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.028+0000 7fa95e7fc700 1 -- 172.21.15.149:0/3909540348 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa95000eb90 con 0x7fa948003a00 2023-11-08T19:29:40.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.029+0000 7fa965e3b700 1 -- 172.21.15.149:0/3909540348 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa948003a00 msgr2=0x7fa948003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:40.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.029+0000 7fa965e3b700 1 --2- 172.21.15.149:0/3909540348 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa948003a00 0x7fa948003e20 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7fa950009b60 tx=0x7fa948005880 comp rx=0 tx=0).stop 2023-11-08T19:29:40.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.029+0000 7fa95ffff700 1 -- 172.21.15.149:0/3909540348 reap_dead start 2023-11-08T19:29:40.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.029+0000 7fa965e3b700 1 -- 172.21.15.149:0/3909540348 shutdown_connections 2023-11-08T19:29:40.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.029+0000 7fa965e3b700 1 -- 172.21.15.149:0/3909540348 >> 172.21.15.149:0/3909540348 conn(0x7fa96009cc30 msgr2=0x7fa9600d3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:40.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.029+0000 7fa965e3b700 1 -- 172.21.15.149:0/3909540348 shutdown_connections 2023-11-08T19:29:40.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.029+0000 7fa965e3b700 1 -- 172.21.15.149:0/3909540348 wait complete. 2023-11-08T19:29:40.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.030+0000 7fa965e3b700 1 Processor -- start 2023-11-08T19:29:40.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.030+0000 7fa965e3b700 1 -- start start 2023-11-08T19:29:40.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.031+0000 7fa965e3b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa948003a00 0x7fa960151e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:40.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.031+0000 7fa965e3b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9600cdf20 0x7fa9600b3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:40.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.031+0000 7fa965e3b700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa96015e6d0 0x7fa96015eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:40.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.031+0000 7fa965e3b700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa96015f0a0 con 0x7fa9600cdf20 2023-11-08T19:29:40.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.031+0000 7fa965e3b700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9600b4710 con 0x7fa948003a00 2023-11-08T19:29:40.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.031+0000 7fa965e3b700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9600b49f0 con 0x7fa96015e6d0 2023-11-08T19:29:40.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.031+0000 7fa95effd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9600cdf20 0x7fa9600b3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:40.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.031+0000 7fa95effd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9600cdf20 0x7fa9600b3e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45316/0 (socket says 172.21.15.149:45316) 2023-11-08T19:29:40.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.031+0000 7fa95effd700 1 -- 172.21.15.149:0/563931449 learned_addr learned my addr 172.21.15.149:0/563931449 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:40.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.031+0000 7fa95f7fe700 1 --2- 172.21.15.149:0/563931449 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa948003a00 0x7fa960151e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:40.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.031+0000 7fa95ffff700 1 --2- 172.21.15.149:0/563931449 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa96015e6d0 0x7fa96015eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:40.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.031+0000 7fa95effd700 1 -- 172.21.15.149:0/563931449 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa96015e6d0 msgr2=0x7fa96015eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:40.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.031+0000 7fa95effd700 1 --2- 172.21.15.149:0/563931449 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa96015e6d0 0x7fa96015eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:40.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.031+0000 7fa95effd700 1 -- 172.21.15.149:0/563931449 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa948003a00 msgr2=0x7fa960151e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:40.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.031+0000 7fa95effd700 1 --2- 172.21.15.149:0/563931449 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa948003a00 0x7fa960151e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:40.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.031+0000 7fa95effd700 1 -- 172.21.15.149:0/563931449 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9600b4cd0 con 0x7fa9600cdf20 2023-11-08T19:29:40.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.031+0000 7fa95f7fe700 1 --2- 172.21.15.149:0/563931449 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa948003a00 0x7fa960151e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:29:40.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.031+0000 7fa95ffff700 1 --2- 172.21.15.149:0/563931449 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa96015e6d0 0x7fa96015eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:29:40.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.031+0000 7fa95effd700 1 --2- 172.21.15.149:0/563931449 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9600cdf20 0x7fa9600b3e10 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fa954000ff0 tx=0x7fa95400eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:40.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.032+0000 7fa947fff700 1 -- 172.21.15.149:0/563931449 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa954012590 con 0x7fa9600cdf20 2023-11-08T19:29:40.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.032+0000 7fa947fff700 1 -- 172.21.15.149:0/563931449 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9540126f0 con 0x7fa9600cdf20 2023-11-08T19:29:40.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.032+0000 7fa947fff700 1 -- 172.21.15.149:0/563931449 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa954012a60 con 0x7fa9600cdf20 2023-11-08T19:29:40.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.032+0000 7fa965e3b700 1 -- 172.21.15.149:0/563931449 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9600b4fb0 con 0x7fa9600cdf20 2023-11-08T19:29:40.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.032+0000 7fa965e3b700 1 -- 172.21.15.149:0/563931449 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9601523c0 con 0x7fa9600cdf20 2023-11-08T19:29:40.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.033+0000 7fa965e3b700 1 -- 172.21.15.149:0/563931449 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9600b54d0 con 0x7fa9600cdf20 2023-11-08T19:29:40.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.033+0000 7fa947fff700 1 -- 172.21.15.149:0/563931449 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa954012bc0 con 0x7fa9600cdf20 2023-11-08T19:29:40.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.033+0000 7fa947fff700 1 --2- 172.21.15.149:0/563931449 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa94c06af00 0x7fa94c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:40.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.034+0000 7fa947fff700 1 -- 172.21.15.149:0/563931449 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7694+0+0 (secure 0 0 0) 0x7fa954089b30 con 0x7fa9600cdf20 2023-11-08T19:29:40.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.034+0000 7fa95f7fe700 1 --2- 172.21.15.149:0/563931449 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa94c06af00 0x7fa94c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:40.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.034+0000 7fa95f7fe700 1 --2- 172.21.15.149:0/563931449 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa94c06af00 0x7fa94c06d3c0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fa9500090b0 tx=0x7fa950008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:40.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.039+0000 7fa947fff700 1 -- 172.21.15.149:0/563931449 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa9600b54d0 con 0x7fa9600cdf20 2023-11-08T19:29:40.276 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.274+0000 7fa965e3b700 1 -- 172.21.15.149:0/563931449 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa9600b54d0 con 0x7fa9600cdf20 2023-11-08T19:29:40.276 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.274+0000 7fa947fff700 1 -- 172.21.15.149:0/563931449 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) v1 ==== 95+0+4950 (secure 0 0 0) 0x7fa9600b54d0 con 0x7fa9600cdf20 2023-11-08T19:29:40.277 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:29:40.277 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":101,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6095,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/852710262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":852710262},{"type":"v1","addr":"172.21.15.160:6835","nonce":852710262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64},{"gid":6425,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/2137508069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":2137508069},{"type":"v1","addr":"172.21.15.149:6837","nonce":2137508069}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":100}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:29:35.492388+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7812,"mds_1":6398},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6398":{"gid":6398,"name":"d","rank":1,"incarnation":99,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.160:6834/2282522167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2282522167},{"type":"v1","addr":"172.21.15.160:6834","nonce":2282522167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7812":{"gid":7812,"name":"a","rank":0,"incarnation":96,"state":"up:reconnect","state_seq":11,"addr":"172.21.15.149:6836/2818321595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2818321595},{"type":"v1","addr":"172.21.15.149:6836","nonce":2818321595}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:29:40.279 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.276+0000 7fa965e3b700 1 -- 172.21.15.149:0/563931449 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa94c06af00 msgr2=0x7fa94c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:40.279 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.276+0000 7fa965e3b700 1 --2- 172.21.15.149:0/563931449 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa94c06af00 0x7fa94c06d3c0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fa9500090b0 tx=0x7fa950008030 comp rx=0 tx=0).stop 2023-11-08T19:29:40.279 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.276+0000 7fa965e3b700 1 -- 172.21.15.149:0/563931449 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9600cdf20 msgr2=0x7fa9600b3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:40.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.276+0000 7fa965e3b700 1 --2- 172.21.15.149:0/563931449 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9600cdf20 0x7fa9600b3e10 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fa954000ff0 tx=0x7fa95400eb10 comp rx=0 tx=0).stop 2023-11-08T19:29:40.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.276+0000 7fa965e3b700 1 -- 172.21.15.149:0/563931449 shutdown_connections 2023-11-08T19:29:40.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.276+0000 7fa965e3b700 1 --2- 172.21.15.149:0/563931449 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa94c06af00 0x7fa94c06d3c0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:40.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.276+0000 7fa965e3b700 1 --2- 172.21.15.149:0/563931449 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa948003a00 0x7fa960151e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:40.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.277+0000 7fa965e3b700 1 --2- 172.21.15.149:0/563931449 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa96015e6d0 0x7fa96015eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:40.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.277+0000 7fa965e3b700 1 --2- 172.21.15.149:0/563931449 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9600cdf20 0x7fa9600b3e10 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:40.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.277+0000 7fa965e3b700 1 -- 172.21.15.149:0/563931449 >> 172.21.15.149:0/563931449 conn(0x7fa96009cc30 msgr2=0x7fa9600d1540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:40.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.277+0000 7fa965e3b700 1 -- 172.21.15.149:0/563931449 shutdown_connections 2023-11-08T19:29:40.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.277+0000 7fa965e3b700 1 -- 172.21.15.149:0/563931449 wait complete. 2023-11-08T19:29:40.282 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 101 2023-11-08T19:29:40.291 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-11-08T19:29:40.291 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:29:40.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.410+0000 7fad21816700 1 Processor -- start 2023-11-08T19:29:40.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.410+0000 7fad21816700 1 -- start start 2023-11-08T19:29:40.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.411+0000 7fad21816700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fad1c0ce8f0 0x7fad1c0b7de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:40.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.411+0000 7fad21816700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fad1c0b2a50 0x7fad1c0b8320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:40.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.411+0000 7fad21816700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad1c15dee0 con 0x7fad1c15db00 2023-11-08T19:29:40.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.411+0000 7fad21816700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad1c0cefb0 con 0x7fad1c0ce8f0 2023-11-08T19:29:40.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.411+0000 7fad21816700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad1c0b6a60 con 0x7fad1c0b2a50 2023-11-08T19:29:40.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.411+0000 7fad1a7fc700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fad1c0ce8f0 0x7fad1c0b7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:40.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.411+0000 7fad1a7fc700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fad1c0ce8f0 0x7fad1c0b7de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45324/0 (socket says 172.21.15.149:45324) 2023-11-08T19:29:40.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.411+0000 7fad1a7fc700 1 -- 172.21.15.149:0/2790310524 learned_addr learned my addr 172.21.15.149:0/2790310524 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:40.417 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.411+0000 7fad1b7fe700 1 --2- 172.21.15.149:0/2790310524 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fad1c0b2a50 0x7fad1c0b8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:40.417 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.411+0000 7fad1a7fc700 1 -- 172.21.15.149:0/2790310524 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fad1c0b2a50 msgr2=0x7fad1c0b8320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:40.417 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.411+0000 7fad1a7fc700 1 --2- 172.21.15.149:0/2790310524 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fad1c0b2a50 0x7fad1c0b8320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:40.417 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.411+0000 7fad1a7fc700 1 -- 172.21.15.149:0/2790310524 >> v1:172.21.15.160:6789/0 conn(0x7fad1c15db00 legacy=0x7fad1c0ce1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:40.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.411+0000 7fad1a7fc700 1 -- 172.21.15.149:0/2790310524 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad1c0b6d40 con 0x7fad1c0ce8f0 2023-11-08T19:29:40.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.411+0000 7fad1b7fe700 1 --2- 172.21.15.149:0/2790310524 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fad1c0b2a50 0x7fad1c0b8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:29:40.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.411+0000 7fad1a7fc700 1 --2- 172.21.15.149:0/2790310524 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad1c0ce8f0 0x7fad1c0b7de0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fad0c0098f0 tx=0x7fad0c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2539ba02ccdfb5b4 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:40.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.411+0000 7fad19ffb700 1 -- 172.21.15.149:0/2790310524 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0c00b8a0 con 0x7fad1c0ce8f0 2023-11-08T19:29:40.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.411+0000 7fad19ffb700 1 -- 172.21.15.149:0/2790310524 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad0c00ba00 con 0x7fad1c0ce8f0 2023-11-08T19:29:40.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.411+0000 7fad19ffb700 1 -- 172.21.15.149:0/2790310524 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0c00bd90 con 0x7fad1c0ce8f0 2023-11-08T19:29:40.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.412+0000 7fad21816700 1 -- 172.21.15.149:0/2790310524 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad1c0ce8f0 msgr2=0x7fad1c0b7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:40.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.412+0000 7fad21816700 1 --2- 172.21.15.149:0/2790310524 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad1c0ce8f0 0x7fad1c0b7de0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fad0c0098f0 tx=0x7fad0c009c00 comp rx=0 tx=0).stop 2023-11-08T19:29:40.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.412+0000 7fad21816700 1 -- 172.21.15.149:0/2790310524 shutdown_connections 2023-11-08T19:29:40.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.412+0000 7fad21816700 1 --2- 172.21.15.149:0/2790310524 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fad1c0b2a50 0x7fad1c0b8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:40.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.412+0000 7fad21816700 1 --2- 172.21.15.149:0/2790310524 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad1c0ce8f0 0x7fad1c0b7de0 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:40.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.412+0000 7fad21816700 1 -- 172.21.15.149:0/2790310524 >> 172.21.15.149:0/2790310524 conn(0x7fad1c072670 msgr2=0x7fad1c072a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:40.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.412+0000 7fad21816700 1 -- 172.21.15.149:0/2790310524 shutdown_connections 2023-11-08T19:29:40.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.412+0000 7fad21816700 1 -- 172.21.15.149:0/2790310524 wait complete. 2023-11-08T19:29:40.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.413+0000 7fad21816700 1 Processor -- start 2023-11-08T19:29:40.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.413+0000 7fad21816700 1 -- start start 2023-11-08T19:29:40.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.414+0000 7fad21816700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad1c0b2a50 0x7fad1c0cb460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:40.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.414+0000 7fad21816700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fad1c0ce8f0 0x7fad1c1f2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:40.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.414+0000 7fad21816700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fad1c15db00 0x7fad1c0b4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:40.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.414+0000 7fad21816700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad1c15a7c0 con 0x7fad1c0b2a50 2023-11-08T19:29:40.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.414+0000 7fad21816700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad1c0cc4e0 con 0x7fad1c0ce8f0 2023-11-08T19:29:40.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.414+0000 7fad21816700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad1c0cb9a0 con 0x7fad1c15db00 2023-11-08T19:29:40.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.414+0000 7fad1affd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad1c0b2a50 0x7fad1c0cb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:40.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.414+0000 7fad1affd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad1c0b2a50 0x7fad1c0cb460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45328/0 (socket says 172.21.15.149:45328) 2023-11-08T19:29:40.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.414+0000 7fad1affd700 1 -- 172.21.15.149:0/524836487 learned_addr learned my addr 172.21.15.149:0/524836487 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:40.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.414+0000 7fad1b7fe700 1 --2- 172.21.15.149:0/524836487 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fad1c15db00 0x7fad1c0b4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:40.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.414+0000 7fad1a7fc700 1 --2- 172.21.15.149:0/524836487 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fad1c0ce8f0 0x7fad1c1f2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:40.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.414+0000 7fad1affd700 1 -- 172.21.15.149:0/524836487 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fad1c15db00 msgr2=0x7fad1c0b4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:40.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.414+0000 7fad1affd700 1 --2- 172.21.15.149:0/524836487 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fad1c15db00 0x7fad1c0b4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:40.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.414+0000 7fad1affd700 1 -- 172.21.15.149:0/524836487 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fad1c0ce8f0 msgr2=0x7fad1c1f2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:40.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.414+0000 7fad1affd700 1 --2- 172.21.15.149:0/524836487 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fad1c0ce8f0 0x7fad1c1f2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:40.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.414+0000 7fad1affd700 1 -- 172.21.15.149:0/524836487 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad0c009550 con 0x7fad1c0b2a50 2023-11-08T19:29:40.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.415+0000 7fad1affd700 1 --2- 172.21.15.149:0/524836487 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad1c0b2a50 0x7fad1c0cb460 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7fad1000c450 tx=0x7fad1000c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:40.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.415+0000 7fad03fff700 1 -- 172.21.15.149:0/524836487 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad100052d0 con 0x7fad1c0b2a50 2023-11-08T19:29:40.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.415+0000 7fad03fff700 1 -- 172.21.15.149:0/524836487 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad10005430 con 0x7fad1c0b2a50 2023-11-08T19:29:40.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.415+0000 7fad21816700 1 -- 172.21.15.149:0/524836487 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad1c0cbca0 con 0x7fad1c0b2a50 2023-11-08T19:29:40.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.415+0000 7fad03fff700 1 -- 172.21.15.149:0/524836487 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad100038c0 con 0x7fad1c0b2a50 2023-11-08T19:29:40.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.415+0000 7fad21816700 1 -- 172.21.15.149:0/524836487 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad1c1f3480 con 0x7fad1c0b2a50 2023-11-08T19:29:40.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.416+0000 7fad21816700 1 -- 172.21.15.149:0/524836487 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad1c074f10 con 0x7fad1c0b2a50 2023-11-08T19:29:40.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.416+0000 7fad03fff700 1 -- 172.21.15.149:0/524836487 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fad10003a20 con 0x7fad1c0b2a50 2023-11-08T19:29:40.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.417+0000 7fad03fff700 1 --2- 172.21.15.149:0/524836487 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fad0806af00 0x7fad0806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:40.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.417+0000 7fad03fff700 1 -- 172.21.15.149:0/524836487 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7694+0+0 (secure 0 0 0) 0x7fad100890c0 con 0x7fad1c0b2a50 2023-11-08T19:29:40.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.417+0000 7fad1a7fc700 1 --2- 172.21.15.149:0/524836487 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fad0806af00 0x7fad0806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:40.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.417+0000 7fad1a7fc700 1 --2- 172.21.15.149:0/524836487 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fad0806af00 0x7fad0806d3c0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fad0c009c40 tx=0x7fad0c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:40.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.422+0000 7fad03fff700 1 -- 172.21.15.149:0/524836487 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fad100539b0 con 0x7fad1c0b2a50 2023-11-08T19:29:40.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.653+0000 7fad21816700 1 -- 172.21.15.149:0/524836487 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fad1c0cf790 con 0x7fad1c0b2a50 2023-11-08T19:29:40.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.653+0000 7fad03fff700 1 -- 172.21.15.149:0/524836487 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) v1 ==== 95+0+4950 (secure 0 0 0) 0x7fad1000ce60 con 0x7fad1c0b2a50 2023-11-08T19:29:40.656 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:29:40.656 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":101,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6095,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/852710262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":852710262},{"type":"v1","addr":"172.21.15.160:6835","nonce":852710262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64},{"gid":6425,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/2137508069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":2137508069},{"type":"v1","addr":"172.21.15.149:6837","nonce":2137508069}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":100}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:29:35.492388+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7812,"mds_1":6398},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6398":{"gid":6398,"name":"d","rank":1,"incarnation":99,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.160:6834/2282522167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2282522167},{"type":"v1","addr":"172.21.15.160:6834","nonce":2282522167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7812":{"gid":7812,"name":"a","rank":0,"incarnation":96,"state":"up:reconnect","state_seq":11,"addr":"172.21.15.149:6836/2818321595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2818321595},{"type":"v1","addr":"172.21.15.149:6836","nonce":2818321595}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:29:40.658 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.655+0000 7fad21816700 1 -- 172.21.15.149:0/524836487 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fad0806af00 msgr2=0x7fad0806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:40.658 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.655+0000 7fad21816700 1 --2- 172.21.15.149:0/524836487 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fad0806af00 0x7fad0806d3c0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fad0c009c40 tx=0x7fad0c008030 comp rx=0 tx=0).stop 2023-11-08T19:29:40.658 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.655+0000 7fad21816700 1 -- 172.21.15.149:0/524836487 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad1c0b2a50 msgr2=0x7fad1c0cb460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:40.658 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.655+0000 7fad21816700 1 --2- 172.21.15.149:0/524836487 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad1c0b2a50 0x7fad1c0cb460 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7fad1000c450 tx=0x7fad1000c760 comp rx=0 tx=0).stop 2023-11-08T19:29:40.658 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.655+0000 7fad21816700 1 -- 172.21.15.149:0/524836487 shutdown_connections 2023-11-08T19:29:40.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.655+0000 7fad21816700 1 --2- 172.21.15.149:0/524836487 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fad0806af00 0x7fad0806d3c0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:40.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.655+0000 7fad21816700 1 --2- 172.21.15.149:0/524836487 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fad1c15db00 0x7fad1c0b4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:40.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.655+0000 7fad21816700 1 --2- 172.21.15.149:0/524836487 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad1c0b2a50 0x7fad1c0cb460 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:40.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.655+0000 7fad21816700 1 --2- 172.21.15.149:0/524836487 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fad1c0ce8f0 0x7fad1c1f2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:40.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.655+0000 7fad21816700 1 -- 172.21.15.149:0/524836487 >> 172.21.15.149:0/524836487 conn(0x7fad1c072670 msgr2=0x7fad1c15fcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:40.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.655+0000 7fad21816700 1 -- 172.21.15.149:0/524836487 shutdown_connections 2023-11-08T19:29:40.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:40.655+0000 7fad21816700 1 -- 172.21.15.149:0/524836487 wait complete. 2023-11-08T19:29:40.660 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 101 2023-11-08T19:29:40.670 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:reconnect 2023-11-08T19:29:41.671 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:29:41.805 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.803+0000 7fd0b9e6c700 1 Processor -- start 2023-11-08T19:29:41.806 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.803+0000 7fd0b9e6c700 1 -- start start 2023-11-08T19:29:41.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.804+0000 7fd0b9e6c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd0b4071a20 0x7fd0b406ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:41.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.804+0000 7fd0b9e6c700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fd0b40cdc50 0x7fd0b415a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:41.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.804+0000 7fd0b9e6c700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0b415ad90 con 0x7fd0b4071e00 2023-11-08T19:29:41.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.804+0000 7fd0b9e6c700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0b415b070 con 0x7fd0b40cdc50 2023-11-08T19:29:41.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.804+0000 7fd0b9e6c700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b415b350 con 0x7fd0b4071a20 2023-11-08T19:29:41.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.804+0000 7fd0b3fff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fd0b4071e00 0x7fd0b41574a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:47340/0 (socket says 172.21.15.149:47340) 2023-11-08T19:29:41.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.804+0000 7fd0b3fff700 1 -- 172.21.15.149:0/1070285525 learned_addr learned my addr 172.21.15.149:0/1070285525 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:29:41.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.804+0000 7fd0aaffd700 1 --2- 172.21.15.149:0/1070285525 >> v2:172.21.15.160:3300/0 conn(0x7fd0b40cdc50 0x7fd0b415a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:41.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.804+0000 7fd0b37fe700 1 --2- 172.21.15.149:0/1070285525 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd0b4071a20 0x7fd0b406ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:41.812 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.804+0000 7fd0b2ffd700 1 -- 172.21.15.149:0/1070285525 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 700340045 0 0) 0x7fd0b415ad90 con 0x7fd0b4071e00 2023-11-08T19:29:41.812 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.804+0000 7fd0b2ffd700 1 -- 172.21.15.149:0/1070285525 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0a00035b0 con 0x7fd0b4071e00 2023-11-08T19:29:41.812 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.805+0000 7fd0b2ffd700 1 -- 172.21.15.149:0/1070285525 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 925075962 0 0) 0x7fd0a00035b0 con 0x7fd0b4071e00 2023-11-08T19:29:41.812 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.805+0000 7fd0b2ffd700 1 -- 172.21.15.149:0/1070285525 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd0b4071a20 msgr2=0x7fd0b406ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:41.813 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.805+0000 7fd0b2ffd700 1 --2- 172.21.15.149:0/1070285525 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd0b4071a20 0x7fd0b406ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:41.813 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.805+0000 7fd0b2ffd700 1 -- 172.21.15.149:0/1070285525 >> v2:172.21.15.160:3300/0 conn(0x7fd0b40cdc50 msgr2=0x7fd0b415a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:41.813 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.805+0000 7fd0b2ffd700 1 --2- 172.21.15.149:0/1070285525 >> v2:172.21.15.160:3300/0 conn(0x7fd0b40cdc50 0x7fd0b415a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:41.813 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.805+0000 7fd0b2ffd700 1 -- 172.21.15.149:0/1070285525 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b40cae50 con 0x7fd0b4071e00 2023-11-08T19:29:41.813 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.805+0000 7fd0b2ffd700 1 -- 172.21.15.149:0/1070285525 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7fd0ac0019f0 con 0x7fd0b4071e00 2023-11-08T19:29:41.814 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.805+0000 7fd0b2ffd700 1 -- 172.21.15.149:0/1070285525 >> v1:172.21.15.149:6789/0 conn(0x7fd0b4071e00 legacy=0x7fd0b41574a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:41.814 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.805+0000 7fd0b2ffd700 1 --2- 172.21.15.149:0/1070285525 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0a0003a00 0x7fd0a0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:41.814 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.805+0000 7fd0b2ffd700 1 --2- 172.21.15.149:0/1070285525 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd0b4071a20 0x7fd0a0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:41.814 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.805+0000 7fd0b2ffd700 1 --2- 172.21.15.149:0/1070285525 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd0a0004d90 0x7fd0a0005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:41.814 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.805+0000 7fd0b2ffd700 1 -- 172.21.15.149:0/1070285525 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b415b070 con 0x7fd0a0003a00 2023-11-08T19:29:41.815 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.805+0000 7fd0b2ffd700 1 -- 172.21.15.149:0/1070285525 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b415b350 con 0x7fd0a0004d90 2023-11-08T19:29:41.815 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.805+0000 7fd0b2ffd700 1 -- 172.21.15.149:0/1070285525 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a000ba10 con 0x7fd0b4071a20 2023-11-08T19:29:41.815 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.805+0000 7fd0b37fe700 1 --2- 172.21.15.149:0/1070285525 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0a0003a00 0x7fd0a0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:41.815 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.805+0000 7fd0b3fff700 1 --2- 172.21.15.149:0/1070285525 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd0a0004d90 0x7fd0a0005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:41.815 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.805+0000 7fd0aaffd700 1 --2- 172.21.15.149:0/1070285525 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd0b4071a20 0x7fd0a0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:41.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.805+0000 7fd0b37fe700 1 -- 172.21.15.149:0/1070285525 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd0b4071a20 msgr2=0x7fd0a0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:41.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.805+0000 7fd0b37fe700 1 --2- 172.21.15.149:0/1070285525 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd0b4071a20 0x7fd0a0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:41.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.805+0000 7fd0b37fe700 1 -- 172.21.15.149:0/1070285525 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd0a0004d90 msgr2=0x7fd0a0005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:41.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.805+0000 7fd0b37fe700 1 --2- 172.21.15.149:0/1070285525 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd0a0004d90 0x7fd0a0005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:41.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.805+0000 7fd0b37fe700 1 -- 172.21.15.149:0/1070285525 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a00035b0 con 0x7fd0a0003a00 2023-11-08T19:29:41.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.805+0000 7fd0aaffd700 1 --2- 172.21.15.149:0/1070285525 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd0b4071a20 0x7fd0a0004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:29:41.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.805+0000 7fd0b37fe700 1 --2- 172.21.15.149:0/1070285525 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0a0003a00 0x7fd0a0003e20 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7fd0a4009b60 tx=0x7fd0a0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc36d33975f2495f server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:41.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.805+0000 7fd0b2ffd700 1 -- 172.21.15.149:0/1070285525 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a400e6c0 con 0x7fd0a0003a00 2023-11-08T19:29:41.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.806+0000 7fd0b2ffd700 1 -- 172.21.15.149:0/1070285525 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0a400e820 con 0x7fd0a0003a00 2023-11-08T19:29:41.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.806+0000 7fd0b2ffd700 1 -- 172.21.15.149:0/1070285525 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a400eb90 con 0x7fd0a0003a00 2023-11-08T19:29:41.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.806+0000 7fd0b9e6c700 1 -- 172.21.15.149:0/1070285525 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0a0003a00 msgr2=0x7fd0a0003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:41.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.806+0000 7fd0b9e6c700 1 --2- 172.21.15.149:0/1070285525 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0a0003a00 0x7fd0a0003e20 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7fd0a4009b60 tx=0x7fd0a0005880 comp rx=0 tx=0).stop 2023-11-08T19:29:41.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.806+0000 7fd0b3fff700 1 -- 172.21.15.149:0/1070285525 reap_dead start 2023-11-08T19:29:41.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.806+0000 7fd0b9e6c700 1 -- 172.21.15.149:0/1070285525 shutdown_connections 2023-11-08T19:29:41.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.806+0000 7fd0b9e6c700 1 -- 172.21.15.149:0/1070285525 >> 172.21.15.149:0/1070285525 conn(0x7fd0b40cfe00 msgr2=0x7fd0b40d01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:41.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.806+0000 7fd0b9e6c700 1 -- 172.21.15.149:0/1070285525 shutdown_connections 2023-11-08T19:29:41.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.806+0000 7fd0b9e6c700 1 -- 172.21.15.149:0/1070285525 wait complete. 2023-11-08T19:29:41.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.808+0000 7fd0b9e6c700 1 Processor -- start 2023-11-08T19:29:41.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.808+0000 7fd0b9e6c700 1 -- start start 2023-11-08T19:29:41.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.809+0000 7fd0b9e6c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0a0003a00 0x7fd0b414dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:41.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.809+0000 7fd0b9e6c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd0b40c9950 0x7fd0b40c2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:41.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.809+0000 7fd0b9e6c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd0b40c80c0 0x7fd0b40c2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:41.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.809+0000 7fd0b9e6c700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b40c78e0 con 0x7fd0a0003a00 2023-11-08T19:29:41.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.809+0000 7fd0b9e6c700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b414cfe0 con 0x7fd0b40c9950 2023-11-08T19:29:41.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.809+0000 7fd0b9e6c700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b414d2c0 con 0x7fd0b40c80c0 2023-11-08T19:29:41.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.809+0000 7fd0b37fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0a0003a00 0x7fd0b414dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:41.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.809+0000 7fd0b37fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0a0003a00 0x7fd0b414dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45348/0 (socket says 172.21.15.149:45348) 2023-11-08T19:29:41.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.809+0000 7fd0b37fe700 1 -- 172.21.15.149:0/2576722159 learned_addr learned my addr 172.21.15.149:0/2576722159 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:41.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.809+0000 7fd0b3fff700 1 --2- 172.21.15.149:0/2576722159 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd0b40c80c0 0x7fd0b40c2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:41.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.809+0000 7fd0aaffd700 1 --2- 172.21.15.149:0/2576722159 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd0b40c9950 0x7fd0b40c2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:41.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.809+0000 7fd0b37fe700 1 -- 172.21.15.149:0/2576722159 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd0b40c80c0 msgr2=0x7fd0b40c2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:41.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.809+0000 7fd0b37fe700 1 --2- 172.21.15.149:0/2576722159 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd0b40c80c0 0x7fd0b40c2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:41.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.809+0000 7fd0b37fe700 1 -- 172.21.15.149:0/2576722159 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd0b40c9950 msgr2=0x7fd0b40c2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:41.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.809+0000 7fd0b37fe700 1 --2- 172.21.15.149:0/2576722159 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd0b40c9950 0x7fd0b40c2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:41.826 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.809+0000 7fd0b37fe700 1 -- 172.21.15.149:0/2576722159 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b414d5a0 con 0x7fd0a0003a00 2023-11-08T19:29:41.826 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.809+0000 7fd0b37fe700 1 --2- 172.21.15.149:0/2576722159 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0a0003a00 0x7fd0b414dab0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7fd0a00046e0 tx=0x7fd0a40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:41.826 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.810+0000 7fd0b0ff9700 1 -- 172.21.15.149:0/2576722159 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a400e6c0 con 0x7fd0a0003a00 2023-11-08T19:29:41.826 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.810+0000 7fd0b0ff9700 1 -- 172.21.15.149:0/2576722159 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0a40038a0 con 0x7fd0a0003a00 2023-11-08T19:29:41.827 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.810+0000 7fd0b9e6c700 1 -- 172.21.15.149:0/2576722159 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0b40c78e0 con 0x7fd0a0003a00 2023-11-08T19:29:41.827 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.810+0000 7fd0b0ff9700 1 -- 172.21.15.149:0/2576722159 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a4003c50 con 0x7fd0a0003a00 2023-11-08T19:29:41.827 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.810+0000 7fd0b9e6c700 1 -- 172.21.15.149:0/2576722159 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0b414dff0 con 0x7fd0a0003a00 2023-11-08T19:29:41.827 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.811+0000 7fd0b9e6c700 1 -- 172.21.15.149:0/2576722159 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0b4074f10 con 0x7fd0a0003a00 2023-11-08T19:29:41.828 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.812+0000 7fd0b0ff9700 1 -- 172.21.15.149:0/2576722159 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd0a401e660 con 0x7fd0a0003a00 2023-11-08T19:29:41.828 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.812+0000 7fd0b0ff9700 1 --2- 172.21.15.149:0/2576722159 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd09406af00 0x7fd09406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:41.828 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.812+0000 7fd0b0ff9700 1 -- 172.21.15.149:0/2576722159 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7694+0+0 (secure 0 0 0) 0x7fd0a408da70 con 0x7fd0a0003a00 2023-11-08T19:29:41.828 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.812+0000 7fd0aaffd700 1 --2- 172.21.15.149:0/2576722159 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd09406af00 0x7fd09406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:41.828 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.813+0000 7fd0aaffd700 1 --2- 172.21.15.149:0/2576722159 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd09406af00 0x7fd09406d3c0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fd0b40b1820 tx=0x7fd09c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:41.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:41.817+0000 7fd0b0ff9700 1 -- 172.21.15.149:0/2576722159 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd0a4058510 con 0x7fd0a0003a00 2023-11-08T19:29:42.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:42.049+0000 7fd0b9e6c700 1 -- 172.21.15.149:0/2576722159 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd0b40ca230 con 0x7fd0a0003a00 2023-11-08T19:29:42.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:42.050+0000 7fd0b0ff9700 1 -- 172.21.15.149:0/2576722159 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) v1 ==== 95+0+4950 (secure 0 0 0) 0x7fd0a405bb30 con 0x7fd0a0003a00 2023-11-08T19:29:42.052 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:29:42.052 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":101,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6095,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/852710262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":852710262},{"type":"v1","addr":"172.21.15.160:6835","nonce":852710262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64},{"gid":6425,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/2137508069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":2137508069},{"type":"v1","addr":"172.21.15.149:6837","nonce":2137508069}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":100}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:29:35.492388+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7812,"mds_1":6398},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6398":{"gid":6398,"name":"d","rank":1,"incarnation":99,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.160:6834/2282522167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2282522167},{"type":"v1","addr":"172.21.15.160:6834","nonce":2282522167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7812":{"gid":7812,"name":"a","rank":0,"incarnation":96,"state":"up:reconnect","state_seq":11,"addr":"172.21.15.149:6836/2818321595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2818321595},{"type":"v1","addr":"172.21.15.149:6836","nonce":2818321595}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:29:42.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:42.052+0000 7fd0b9e6c700 1 -- 172.21.15.149:0/2576722159 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd09406af00 msgr2=0x7fd09406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:42.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:42.052+0000 7fd0b9e6c700 1 --2- 172.21.15.149:0/2576722159 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd09406af00 0x7fd09406d3c0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fd0b40b1820 tx=0x7fd09c008040 comp rx=0 tx=0).stop 2023-11-08T19:29:42.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:42.052+0000 7fd0b9e6c700 1 -- 172.21.15.149:0/2576722159 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0a0003a00 msgr2=0x7fd0b414dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:42.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:42.052+0000 7fd0b9e6c700 1 --2- 172.21.15.149:0/2576722159 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0a0003a00 0x7fd0b414dab0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7fd0a00046e0 tx=0x7fd0a40047c0 comp rx=0 tx=0).stop 2023-11-08T19:29:42.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:42.052+0000 7fd0b9e6c700 1 -- 172.21.15.149:0/2576722159 shutdown_connections 2023-11-08T19:29:42.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:42.052+0000 7fd0b9e6c700 1 --2- 172.21.15.149:0/2576722159 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fd09406af00 0x7fd09406d3c0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:42.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:42.052+0000 7fd0b9e6c700 1 --2- 172.21.15.149:0/2576722159 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd0b40c80c0 0x7fd0b40c2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:42.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:42.052+0000 7fd0b9e6c700 1 --2- 172.21.15.149:0/2576722159 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0a0003a00 0x7fd0b414dab0 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:42.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:42.052+0000 7fd0b9e6c700 1 --2- 172.21.15.149:0/2576722159 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd0b40c9950 0x7fd0b40c2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:42.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:42.052+0000 7fd0b9e6c700 1 -- 172.21.15.149:0/2576722159 >> 172.21.15.149:0/2576722159 conn(0x7fd0b40cfe00 msgr2=0x7fd0b4159280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:42.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:42.052+0000 7fd0b9e6c700 1 -- 172.21.15.149:0/2576722159 shutdown_connections 2023-11-08T19:29:42.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:42.052+0000 7fd0b9e6c700 1 -- 172.21.15.149:0/2576722159 wait complete. 2023-11-08T19:29:42.057 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 101 2023-11-08T19:29:42.066 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:reconnect 2023-11-08T19:29:43.067 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:29:43.206 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.203+0000 7f56f24ad700 1 Processor -- start 2023-11-08T19:29:43.206 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.204+0000 7f56f24ad700 1 -- start start 2023-11-08T19:29:43.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.204+0000 7f56f24ad700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f56ec15b940 0x7f56ec0ce800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:43.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.204+0000 7f56f24ad700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f56ec15bd20 0x7f56ec0cfda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:43.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.204+0000 7f56f24ad700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f56ec0cf8d0 0x7f56ec0d02e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:43.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.204+0000 7f56f24ad700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56ec0cf150 con 0x7f56ec15bd20 2023-11-08T19:29:43.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.204+0000 7f56f24ad700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56ec0b12c0 con 0x7f56ec15b940 2023-11-08T19:29:43.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.204+0000 7f56f24ad700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56ec0b15a0 con 0x7f56ec0cf8d0 2023-11-08T19:29:43.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.204+0000 7f56eb7fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f56ec15bd20 0x7f56ec0cfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:43.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.204+0000 7f56eb7fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f56ec15bd20 0x7f56ec0cfda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45356/0 (socket says 172.21.15.149:45356) 2023-11-08T19:29:43.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.204+0000 7f56eb7fe700 1 -- 172.21.15.149:0/1115899076 learned_addr learned my addr 172.21.15.149:0/1115899076 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:43.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.205+0000 7f56f0a4a700 1 --2- 172.21.15.149:0/1115899076 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f56ec0cf8d0 0x7f56ec0d02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:43.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.205+0000 7f56ebfff700 1 --2- 172.21.15.149:0/1115899076 >> v2:172.21.15.160:3300/0 conn(0x7f56ec15b940 0x7f56ec0ce800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:43.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.205+0000 7f56eb7fe700 1 -- 172.21.15.149:0/1115899076 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f56ec0cf8d0 msgr2=0x7f56ec0d02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:43.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.205+0000 7f56eb7fe700 1 --2- 172.21.15.149:0/1115899076 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f56ec0cf8d0 0x7f56ec0d02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:43.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.205+0000 7f56eb7fe700 1 -- 172.21.15.149:0/1115899076 >> v2:172.21.15.160:3300/0 conn(0x7f56ec15b940 msgr2=0x7f56ec0ce800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:43.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.205+0000 7f56eb7fe700 1 --2- 172.21.15.149:0/1115899076 >> v2:172.21.15.160:3300/0 conn(0x7f56ec15b940 0x7f56ec0ce800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:43.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.205+0000 7f56eb7fe700 1 -- 172.21.15.149:0/1115899076 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56ec0b1880 con 0x7f56ec15bd20 2023-11-08T19:29:43.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.205+0000 7f56eb7fe700 1 --2- 172.21.15.149:0/1115899076 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56ec15bd20 0x7f56ec0cfda0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f56ec0719a0 tx=0x7f56e0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e6573449350b650 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:43.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.205+0000 7f56eaffd700 1 -- 172.21.15.149:0/1115899076 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e000b870 con 0x7f56ec15bd20 2023-11-08T19:29:43.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.205+0000 7f56eaffd700 1 -- 172.21.15.149:0/1115899076 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56e000b9d0 con 0x7f56ec15bd20 2023-11-08T19:29:43.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.205+0000 7f56eaffd700 1 -- 172.21.15.149:0/1115899076 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e000bd60 con 0x7f56ec15bd20 2023-11-08T19:29:43.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.206+0000 7f56f24ad700 1 -- 172.21.15.149:0/1115899076 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56ec15bd20 msgr2=0x7f56ec0cfda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:43.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.206+0000 7f56f24ad700 1 --2- 172.21.15.149:0/1115899076 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56ec15bd20 0x7f56ec0cfda0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f56ec0719a0 tx=0x7f56e0009bd0 comp rx=0 tx=0).stop 2023-11-08T19:29:43.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.206+0000 7f56f24ad700 1 -- 172.21.15.149:0/1115899076 shutdown_connections 2023-11-08T19:29:43.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.206+0000 7f56f24ad700 1 --2- 172.21.15.149:0/1115899076 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f56ec0cf8d0 0x7f56ec0d02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:43.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.206+0000 7f56f24ad700 1 --2- 172.21.15.149:0/1115899076 >> v2:172.21.15.160:3300/0 conn(0x7f56ec15b940 0x7f56ec0ce800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:43.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.206+0000 7f56f24ad700 1 --2- 172.21.15.149:0/1115899076 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56ec15bd20 0x7f56ec0cfda0 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:43.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.206+0000 7f56f24ad700 1 -- 172.21.15.149:0/1115899076 >> 172.21.15.149:0/1115899076 conn(0x7f56ec0d17c0 msgr2=0x7f56ec0d1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:43.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.206+0000 7f56f24ad700 1 -- 172.21.15.149:0/1115899076 shutdown_connections 2023-11-08T19:29:43.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.206+0000 7f56f24ad700 1 -- 172.21.15.149:0/1115899076 wait complete. 2023-11-08T19:29:43.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.207+0000 7f56f24ad700 1 Processor -- start 2023-11-08T19:29:43.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.207+0000 7f56f24ad700 1 -- start start 2023-11-08T19:29:43.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.208+0000 7f56f24ad700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f56ec0cf8d0 0x7f56ec157900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:43.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.208+0000 7f56f24ad700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f56ec15b940 0x7f56ec0b2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:43.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.208+0000 7f56f24ad700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56ec15bd20 0x7f56ec0b2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:43.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.208+0000 7f56f24ad700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56ec157e40 con 0x7f56ec15bd20 2023-11-08T19:29:43.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.208+0000 7f56f24ad700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56ec0c8890 con 0x7f56ec15b940 2023-11-08T19:29:43.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.208+0000 7f56f24ad700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56ec0c98a0 con 0x7f56ec0cf8d0 2023-11-08T19:29:43.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.208+0000 7f56f0a4a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56ec15bd20 0x7f56ec0b2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:43.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.208+0000 7f56f0a4a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56ec15bd20 0x7f56ec0b2e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45364/0 (socket says 172.21.15.149:45364) 2023-11-08T19:29:43.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.208+0000 7f56f0a4a700 1 -- 172.21.15.149:0/1339256472 learned_addr learned my addr 172.21.15.149:0/1339256472 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:43.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.209+0000 7f56ebfff700 1 --2- 172.21.15.149:0/1339256472 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f56ec0cf8d0 0x7f56ec157900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:43.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.209+0000 7f56eb7fe700 1 --2- 172.21.15.149:0/1339256472 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f56ec15b940 0x7f56ec0b2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:43.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.209+0000 7f56f0a4a700 1 -- 172.21.15.149:0/1339256472 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f56ec0cf8d0 msgr2=0x7f56ec157900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:43.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.209+0000 7f56f0a4a700 1 --2- 172.21.15.149:0/1339256472 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f56ec0cf8d0 0x7f56ec157900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:43.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.209+0000 7f56f0a4a700 1 -- 172.21.15.149:0/1339256472 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f56ec15b940 msgr2=0x7f56ec0b2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:43.221 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.209+0000 7f56f0a4a700 1 --2- 172.21.15.149:0/1339256472 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f56ec15b940 0x7f56ec0b2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:43.221 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.209+0000 7f56f0a4a700 1 -- 172.21.15.149:0/1339256472 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e0009550 con 0x7f56ec15bd20 2023-11-08T19:29:43.221 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.209+0000 7f56f0a4a700 1 --2- 172.21.15.149:0/1339256472 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56ec15bd20 0x7f56ec0b2e70 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f56e4007e60 tx=0x7f56e400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:43.221 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.209+0000 7f56e8ff9700 1 -- 172.21.15.149:0/1339256472 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e400ecd0 con 0x7f56ec15bd20 2023-11-08T19:29:43.221 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.209+0000 7f56e8ff9700 1 -- 172.21.15.149:0/1339256472 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56e400ee50 con 0x7f56ec15bd20 2023-11-08T19:29:43.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.209+0000 7f56f24ad700 1 -- 172.21.15.149:0/1339256472 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56ec0c8ae0 con 0x7f56ec15bd20 2023-11-08T19:29:43.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.209+0000 7f56e8ff9700 1 -- 172.21.15.149:0/1339256472 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e4014660 con 0x7f56ec15bd20 2023-11-08T19:29:43.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.209+0000 7f56f24ad700 1 -- 172.21.15.149:0/1339256472 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56ec0c90a0 con 0x7f56ec15bd20 2023-11-08T19:29:43.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.210+0000 7f56f24ad700 1 -- 172.21.15.149:0/1339256472 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56ec074f10 con 0x7f56ec15bd20 2023-11-08T19:29:43.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.211+0000 7f56e8ff9700 1 -- 172.21.15.149:0/1339256472 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f56e40147c0 con 0x7f56ec15bd20 2023-11-08T19:29:43.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.211+0000 7f56e8ff9700 1 --2- 172.21.15.149:0/1339256472 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f56d806af00 0x7f56d806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:43.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.211+0000 7f56e8ff9700 1 -- 172.21.15.149:0/1339256472 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7737+0+0 (secure 0 0 0) 0x7f56e408a2e0 con 0x7f56ec15bd20 2023-11-08T19:29:43.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.211+0000 7f56ebfff700 1 --2- 172.21.15.149:0/1339256472 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f56d806af00 0x7f56d806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:43.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.211+0000 7f56ebfff700 1 --2- 172.21.15.149:0/1339256472 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f56d806af00 0x7f56d806d3c0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f56dc006b20 tx=0x7f56dc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:43.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.216+0000 7f56e8ff9700 1 -- 172.21.15.149:0/1339256472 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f56e4054c30 con 0x7f56ec15bd20 2023-11-08T19:29:43.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.452+0000 7f56f24ad700 1 -- 172.21.15.149:0/1339256472 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f56ec1e62e0 con 0x7f56ec15bd20 2023-11-08T19:29:43.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.452+0000 7f56e8ff9700 1 -- 172.21.15.149:0/1339256472 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) v1 ==== 95+0+4950 (secure 0 0 0) 0x7f56e4058250 con 0x7f56ec15bd20 2023-11-08T19:29:43.455 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:29:43.455 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":101,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6095,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/852710262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":852710262},{"type":"v1","addr":"172.21.15.160:6835","nonce":852710262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64},{"gid":6425,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/2137508069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":2137508069},{"type":"v1","addr":"172.21.15.149:6837","nonce":2137508069}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":100}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:29:35.492388+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7812,"mds_1":6398},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6398":{"gid":6398,"name":"d","rank":1,"incarnation":99,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.160:6834/2282522167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2282522167},{"type":"v1","addr":"172.21.15.160:6834","nonce":2282522167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7812":{"gid":7812,"name":"a","rank":0,"incarnation":96,"state":"up:reconnect","state_seq":11,"addr":"172.21.15.149:6836/2818321595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2818321595},{"type":"v1","addr":"172.21.15.149:6836","nonce":2818321595}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:29:43.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.455+0000 7f56f24ad700 1 -- 172.21.15.149:0/1339256472 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f56d806af00 msgr2=0x7f56d806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:43.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.455+0000 7f56f24ad700 1 --2- 172.21.15.149:0/1339256472 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f56d806af00 0x7f56d806d3c0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f56dc006b20 tx=0x7f56dc008040 comp rx=0 tx=0).stop 2023-11-08T19:29:43.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.455+0000 7f56f24ad700 1 -- 172.21.15.149:0/1339256472 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56ec15bd20 msgr2=0x7f56ec0b2e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:43.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.455+0000 7f56f24ad700 1 --2- 172.21.15.149:0/1339256472 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56ec15bd20 0x7f56ec0b2e70 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f56e4007e60 tx=0x7f56e400e3c0 comp rx=0 tx=0).stop 2023-11-08T19:29:43.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.455+0000 7f56f24ad700 1 -- 172.21.15.149:0/1339256472 shutdown_connections 2023-11-08T19:29:43.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.455+0000 7f56f24ad700 1 --2- 172.21.15.149:0/1339256472 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f56d806af00 0x7f56d806d3c0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:43.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.455+0000 7f56f24ad700 1 --2- 172.21.15.149:0/1339256472 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56ec15bd20 0x7f56ec0b2e70 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:43.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.455+0000 7f56f24ad700 1 --2- 172.21.15.149:0/1339256472 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f56ec0cf8d0 0x7f56ec157900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:43.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.455+0000 7f56f24ad700 1 --2- 172.21.15.149:0/1339256472 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f56ec15b940 0x7f56ec0b2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:43.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.455+0000 7f56f24ad700 1 -- 172.21.15.149:0/1339256472 >> 172.21.15.149:0/1339256472 conn(0x7f56ec0d17c0 msgr2=0x7f56ec0b1f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:43.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.455+0000 7f56f24ad700 1 -- 172.21.15.149:0/1339256472 shutdown_connections 2023-11-08T19:29:43.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:43.455+0000 7f56f24ad700 1 -- 172.21.15.149:0/1339256472 wait complete. 2023-11-08T19:29:43.460 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 101 2023-11-08T19:29:43.469 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:reconnect 2023-11-08T19:29:44.471 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:29:44.605 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.603+0000 7f52e8695700 1 Processor -- start 2023-11-08T19:29:44.606 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.603+0000 7f52e8695700 1 -- start start 2023-11-08T19:29:44.609 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.604+0000 7f52e8695700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f52e00b20f0 0x7f52e006fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:44.609 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.604+0000 7f52e8695700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52e006ffd0 con 0x7f52e0072b70 2023-11-08T19:29:44.610 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.604+0000 7f52e8695700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52e0070200 con 0x7f52e015ebe0 2023-11-08T19:29:44.610 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.604+0000 7f52e8695700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52e00704e0 con 0x7f52e00b20f0 2023-11-08T19:29:44.610 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.604+0000 7f52e5c30700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f52e0072b70 0x7f52e00b24d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:47370/0 (socket says 172.21.15.149:47370) 2023-11-08T19:29:44.610 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.604+0000 7f52e5c30700 1 -- 172.21.15.149:0/1299416532 learned_addr learned my addr 172.21.15.149:0/1299416532 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:29:44.611 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.605+0000 7f52e542f700 1 -- 172.21.15.149:0/1299416532 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3335401830 0 0) 0x7f52e006ffd0 con 0x7f52e0072b70 2023-11-08T19:29:44.611 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.605+0000 7f52e542f700 1 -- 172.21.15.149:0/1299416532 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52cc0035b0 con 0x7f52e0072b70 2023-11-08T19:29:44.611 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.605+0000 7f52e6431700 1 --2- 172.21.15.149:0/1299416532 >> v2:172.21.15.160:3300/0 conn(0x7f52e00b20f0 0x7f52e006fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:44.611 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.605+0000 7f52e542f700 1 -- 172.21.15.149:0/1299416532 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2923488532 0 0) 0x7f52cc0035b0 con 0x7f52e0072b70 2023-11-08T19:29:44.611 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.605+0000 7f52e542f700 1 -- 172.21.15.149:0/1299416532 >> v2:172.21.15.160:3300/0 conn(0x7f52e00b20f0 msgr2=0x7f52e006fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:44.612 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.605+0000 7f52e542f700 1 --2- 172.21.15.149:0/1299416532 >> v2:172.21.15.160:3300/0 conn(0x7f52e00b20f0 0x7f52e006fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:44.612 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.605+0000 7f52e542f700 1 -- 172.21.15.149:0/1299416532 >> v1:172.21.15.160:6789/0 conn(0x7f52e015ebe0 legacy=0x7f52e00cbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:44.612 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.605+0000 7f52e542f700 1 -- 172.21.15.149:0/1299416532 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e00707c0 con 0x7f52e0072b70 2023-11-08T19:29:44.612 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.605+0000 7f52e542f700 1 -- 172.21.15.149:0/1299416532 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f52dc001670 con 0x7f52e0072b70 2023-11-08T19:29:44.612 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.605+0000 7f52e6431700 1 --2- 172.21.15.149:0/1299416532 >> v2:172.21.15.160:3300/0 conn(0x7f52e00b20f0 0x7f52e006fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:29:44.613 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.605+0000 7f52e542f700 1 -- 172.21.15.149:0/1299416532 >> v1:172.21.15.149:6789/0 conn(0x7f52e0072b70 legacy=0x7f52e00b24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:44.613 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.605+0000 7f52e542f700 1 --2- 172.21.15.149:0/1299416532 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f52cc003a00 0x7f52cc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:44.613 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.605+0000 7f52e542f700 1 --2- 172.21.15.149:0/1299416532 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52cc004850 0x7f52cc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:44.613 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.605+0000 7f52e542f700 1 --2- 172.21.15.149:0/1299416532 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f52cc005330 0x7f52cc00dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:44.614 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.605+0000 7f52e542f700 1 -- 172.21.15.149:0/1299416532 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52e00704e0 con 0x7f52cc004850 2023-11-08T19:29:44.614 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.605+0000 7f52e542f700 1 -- 172.21.15.149:0/1299416532 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52cc005a10 con 0x7f52cc005330 2023-11-08T19:29:44.614 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.605+0000 7f52e542f700 1 -- 172.21.15.149:0/1299416532 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52cc005bd0 con 0x7f52cc003a00 2023-11-08T19:29:44.614 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.605+0000 7f52e5c30700 1 --2- 172.21.15.149:0/1299416532 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52cc004850 0x7f52cc004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:44.615 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.605+0000 7f52e6431700 1 --2- 172.21.15.149:0/1299416532 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f52cc003a00 0x7f52cc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:44.615 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.605+0000 7f52e6c32700 1 --2- 172.21.15.149:0/1299416532 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f52cc005330 0x7f52cc00dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:44.616 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.605+0000 7f52e5c30700 1 -- 172.21.15.149:0/1299416532 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f52cc003a00 msgr2=0x7f52cc003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:44.616 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.605+0000 7f52e5c30700 1 --2- 172.21.15.149:0/1299416532 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f52cc003a00 0x7f52cc003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:44.617 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.605+0000 7f52e5c30700 1 -- 172.21.15.149:0/1299416532 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f52cc005330 msgr2=0x7f52cc00dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:44.617 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.605+0000 7f52e5c30700 1 --2- 172.21.15.149:0/1299416532 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f52cc005330 0x7f52cc00dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:44.617 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.605+0000 7f52e5c30700 1 -- 172.21.15.149:0/1299416532 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52cc0035b0 con 0x7f52cc004850 2023-11-08T19:29:44.617 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.605+0000 7f52e6c32700 1 -- 172.21.15.149:0/1299416532 reap_dead start 2023-11-08T19:29:44.618 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.605+0000 7f52e6431700 1 --2- 172.21.15.149:0/1299416532 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f52cc003a00 0x7f52cc003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:29:44.622 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.606+0000 7f52e5c30700 1 --2- 172.21.15.149:0/1299416532 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52cc004850 0x7f52cc004cd0 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f52dc00c210 tx=0x7f52cc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee7eb7aec8a36c5c server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:44.622 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.606+0000 7f52e542f700 1 -- 172.21.15.149:0/1299416532 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52dc007c10 con 0x7f52cc004850 2023-11-08T19:29:44.623 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.606+0000 7f52e542f700 1 -- 172.21.15.149:0/1299416532 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52dc00cdd0 con 0x7f52cc004850 2023-11-08T19:29:44.623 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.606+0000 7f52e542f700 1 -- 172.21.15.149:0/1299416532 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52dc005ba0 con 0x7f52cc004850 2023-11-08T19:29:44.623 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.606+0000 7f52e8695700 1 -- 172.21.15.149:0/1299416532 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52cc004850 msgr2=0x7f52cc004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:44.623 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.606+0000 7f52e8695700 1 --2- 172.21.15.149:0/1299416532 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52cc004850 0x7f52cc004cd0 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f52dc00c210 tx=0x7f52cc005880 comp rx=0 tx=0).stop 2023-11-08T19:29:44.623 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.606+0000 7f52e8695700 1 -- 172.21.15.149:0/1299416532 shutdown_connections 2023-11-08T19:29:44.624 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.606+0000 7f52e8695700 1 --2- 172.21.15.149:0/1299416532 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52cc004850 0x7f52cc004cd0 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:44.624 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.606+0000 7f52e8695700 1 -- 172.21.15.149:0/1299416532 >> 172.21.15.149:0/1299416532 conn(0x7f52e00cd0f0 msgr2=0x7f52e00cd500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:44.624 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.606+0000 7f52e8695700 1 -- 172.21.15.149:0/1299416532 shutdown_connections 2023-11-08T19:29:44.624 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.606+0000 7f52e8695700 1 -- 172.21.15.149:0/1299416532 wait complete. 2023-11-08T19:29:44.627 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.608+0000 7f52e8695700 1 Processor -- start 2023-11-08T19:29:44.627 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.608+0000 7f52e8695700 1 -- start start 2023-11-08T19:29:44.627 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.609+0000 7f52e8695700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f52cc004850 0x7f52e01ef9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:44.627 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.609+0000 7f52e8695700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52e015ba30 0x7f52e0159300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:44.628 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.609+0000 7f52e8695700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f52e015be90 0x7f52e0159840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:44.628 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.609+0000 7f52e8695700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52e0159e50 con 0x7f52e015ba30 2023-11-08T19:29:44.628 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.609+0000 7f52e8695700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52e00c8ab0 con 0x7f52e015be90 2023-11-08T19:29:44.629 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.609+0000 7f52e8695700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52e00c8d90 con 0x7f52cc004850 2023-11-08T19:29:44.630 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.609+0000 7f52e5c30700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52e015ba30 0x7f52e0159300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:44.630 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.609+0000 7f52e5c30700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52e015ba30 0x7f52e0159300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45382/0 (socket says 172.21.15.149:45382) 2023-11-08T19:29:44.631 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.609+0000 7f52e5c30700 1 -- 172.21.15.149:0/2450068341 learned_addr learned my addr 172.21.15.149:0/2450068341 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:44.631 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.609+0000 7f52e6431700 1 --2- 172.21.15.149:0/2450068341 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f52cc004850 0x7f52e01ef9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:44.631 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.609+0000 7f52e6c32700 1 --2- 172.21.15.149:0/2450068341 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f52e015be90 0x7f52e0159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:44.631 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.609+0000 7f52e5c30700 1 -- 172.21.15.149:0/2450068341 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f52cc004850 msgr2=0x7f52e01ef9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:44.632 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.609+0000 7f52e5c30700 1 --2- 172.21.15.149:0/2450068341 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f52cc004850 0x7f52e01ef9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:44.632 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.609+0000 7f52e5c30700 1 -- 172.21.15.149:0/2450068341 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f52e015be90 msgr2=0x7f52e0159840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:44.632 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.609+0000 7f52e5c30700 1 --2- 172.21.15.149:0/2450068341 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f52e015be90 0x7f52e0159840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:44.632 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.609+0000 7f52e5c30700 1 -- 172.21.15.149:0/2450068341 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e00c9070 con 0x7f52e015ba30 2023-11-08T19:29:44.633 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.609+0000 7f52e5c30700 1 --2- 172.21.15.149:0/2450068341 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52e015ba30 0x7f52e0159300 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f52cc0059e0 tx=0x7f52dc001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:44.633 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.609+0000 7f52d6ffd700 1 -- 172.21.15.149:0/2450068341 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52dc001670 con 0x7f52e015ba30 2023-11-08T19:29:44.633 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.609+0000 7f52d6ffd700 1 -- 172.21.15.149:0/2450068341 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52dc0070d0 con 0x7f52e015ba30 2023-11-08T19:29:44.633 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.609+0000 7f52d6ffd700 1 -- 172.21.15.149:0/2450068341 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52dc007460 con 0x7f52e015ba30 2023-11-08T19:29:44.634 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.609+0000 7f52e8695700 1 -- 172.21.15.149:0/2450068341 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52e00c9350 con 0x7f52e015ba30 2023-11-08T19:29:44.634 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.610+0000 7f52e8695700 1 -- 172.21.15.149:0/2450068341 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52e0152790 con 0x7f52e015ba30 2023-11-08T19:29:44.634 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.611+0000 7f52e8695700 1 -- 172.21.15.149:0/2450068341 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52e0067810 con 0x7f52e015ba30 2023-11-08T19:29:44.634 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.611+0000 7f52d6ffd700 1 -- 172.21.15.149:0/2450068341 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f52dc0075c0 con 0x7f52e015ba30 2023-11-08T19:29:44.634 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.611+0000 7f52d6ffd700 1 --2- 172.21.15.149:0/2450068341 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f52c406af30 0x7f52c406d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:44.635 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.612+0000 7f52d6ffd700 1 -- 172.21.15.149:0/2450068341 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7737+0+0 (secure 0 0 0) 0x7f52dc08ad50 con 0x7f52e015ba30 2023-11-08T19:29:44.635 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.612+0000 7f52e6431700 1 --2- 172.21.15.149:0/2450068341 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f52c406af30 0x7f52c406d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:44.635 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.612+0000 7f52e6431700 1 --2- 172.21.15.149:0/2450068341 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f52c406af30 0x7f52c406d3f0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f52d0006f10 tx=0x7f52d0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:44.635 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.616+0000 7f52d6ffd700 1 -- 172.21.15.149:0/2450068341 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f52dc08e030 con 0x7f52e015ba30 2023-11-08T19:29:44.851 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.849+0000 7f52e8695700 1 -- 172.21.15.149:0/2450068341 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f52e00ce220 con 0x7f52e015ba30 2023-11-08T19:29:44.852 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.850+0000 7f52d6ffd700 1 -- 172.21.15.149:0/2450068341 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 102 v102) v1 ==== 95+0+4944 (secure 0 0 0) 0x7f52dc0556a0 con 0x7f52e015ba30 2023-11-08T19:29:44.852 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:29:44.853 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":102,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6095,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/852710262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":852710262},{"type":"v1","addr":"172.21.15.160:6835","nonce":852710262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64},{"gid":6425,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/2137508069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":2137508069},{"type":"v1","addr":"172.21.15.149:6837","nonce":2137508069}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":100}],"filesystems":[{"mdsmap":{"epoch":102,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:29:43.187469+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7812,"mds_1":6398},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6398":{"gid":6398,"name":"d","rank":1,"incarnation":99,"state":"up:rejoin","state_seq":6,"addr":"172.21.15.160:6834/2282522167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2282522167},{"type":"v1","addr":"172.21.15.160:6834","nonce":2282522167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7812":{"gid":7812,"name":"a","rank":0,"incarnation":96,"state":"up:rejoin","state_seq":13,"addr":"172.21.15.149:6836/2818321595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2818321595},{"type":"v1","addr":"172.21.15.149:6836","nonce":2818321595}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:29:44.854 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.852+0000 7f52e8695700 1 -- 172.21.15.149:0/2450068341 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f52c406af30 msgr2=0x7f52c406d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:44.855 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.852+0000 7f52e8695700 1 --2- 172.21.15.149:0/2450068341 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f52c406af30 0x7f52c406d3f0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f52d0006f10 tx=0x7f52d0008040 comp rx=0 tx=0).stop 2023-11-08T19:29:44.855 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.852+0000 7f52e8695700 1 -- 172.21.15.149:0/2450068341 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52e015ba30 msgr2=0x7f52e0159300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:44.855 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.852+0000 7f52e8695700 1 --2- 172.21.15.149:0/2450068341 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52e015ba30 0x7f52e0159300 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f52cc0059e0 tx=0x7f52dc001a00 comp rx=0 tx=0).stop 2023-11-08T19:29:44.855 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.852+0000 7f52e8695700 1 -- 172.21.15.149:0/2450068341 shutdown_connections 2023-11-08T19:29:44.855 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.852+0000 7f52e8695700 1 --2- 172.21.15.149:0/2450068341 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f52c406af30 0x7f52c406d3f0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:44.856 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.852+0000 7f52e8695700 1 --2- 172.21.15.149:0/2450068341 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f52e015be90 0x7f52e0159840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:44.856 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.852+0000 7f52e8695700 1 --2- 172.21.15.149:0/2450068341 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f52cc004850 0x7f52e01ef9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:44.856 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.852+0000 7f52e8695700 1 --2- 172.21.15.149:0/2450068341 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52e015ba30 0x7f52e0159300 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:44.856 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.852+0000 7f52e8695700 1 -- 172.21.15.149:0/2450068341 >> 172.21.15.149:0/2450068341 conn(0x7f52e00cd0f0 msgr2=0x7f52e00cc760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:44.856 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.852+0000 7f52e8695700 1 -- 172.21.15.149:0/2450068341 shutdown_connections 2023-11-08T19:29:44.857 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:44.852+0000 7f52e8695700 1 -- 172.21.15.149:0/2450068341 wait complete. 2023-11-08T19:29:44.857 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 102 2023-11-08T19:29:44.866 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:rejoin 2023-11-08T19:29:45.311 INFO:tasks.ceph.mds.a.smithi149.stderr:2023-11-08T19:29:45.309+0000 7f8c106be700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-08T19:29:45.312 INFO:tasks.ceph.mds.a.smithi149.stderr:2023-11-08T19:29:45.309+0000 7f8c106be700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-08T19:29:45.867 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:29:46.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:45.999+0000 7f7272820700 1 Processor -- start 2023-11-08T19:29:46.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:45.999+0000 7f7272820700 1 -- start start 2023-11-08T19:29:46.005 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.000+0000 7f7272820700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f726c15db30 0x7f726c162190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:46.005 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.000+0000 7f7272820700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f726c15df10 con 0x7f726c0701b0 2023-11-08T19:29:46.005 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.000+0000 7f7272820700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f726c06ffd0 con 0x7f726c06b230 2023-11-08T19:29:46.005 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.000+0000 7f7272820700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f726c0cc9f0 con 0x7f726c15db30 2023-11-08T19:29:46.006 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.000+0000 7f726b7fe700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f726c0701b0 0x7f726c06ab20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:47392/0 (socket says 172.21.15.149:47392) 2023-11-08T19:29:46.006 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.000+0000 7f726b7fe700 1 -- 172.21.15.149:0/3836583253 learned_addr learned my addr 172.21.15.149:0/3836583253 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:29:46.006 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.000+0000 7f726affd700 1 -- 172.21.15.149:0/3836583253 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1707287997 0 0) 0x7f726c15df10 con 0x7f726c0701b0 2023-11-08T19:29:46.006 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.000+0000 7f726affd700 1 -- 172.21.15.149:0/3836583253 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72540035b0 con 0x7f726c0701b0 2023-11-08T19:29:46.006 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.000+0000 7f726bfff700 1 --2- 172.21.15.149:0/3836583253 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f726c15db30 0x7f726c162190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:46.007 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.000+0000 7f726affd700 1 -- 172.21.15.149:0/3836583253 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2130023930 0 0) 0x7f72540035b0 con 0x7f726c0701b0 2023-11-08T19:29:46.007 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.000+0000 7f726affd700 1 -- 172.21.15.149:0/3836583253 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f726c15db30 msgr2=0x7f726c162190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:46.007 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.000+0000 7f726affd700 1 --2- 172.21.15.149:0/3836583253 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f726c15db30 0x7f726c162190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:46.007 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.000+0000 7f726affd700 1 -- 172.21.15.149:0/3836583253 >> v1:172.21.15.160:6789/0 conn(0x7f726c06b230 legacy=0x7f726c0ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:46.007 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.000+0000 7f726affd700 1 -- 172.21.15.149:0/3836583253 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f726c0cccd0 con 0x7f726c0701b0 2023-11-08T19:29:46.008 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.000+0000 7f726affd700 1 -- 172.21.15.149:0/3836583253 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f725c001670 con 0x7f726c0701b0 2023-11-08T19:29:46.008 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.000+0000 7f726bfff700 1 --2- 172.21.15.149:0/3836583253 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f726c15db30 0x7f726c162190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:29:46.008 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.000+0000 7f726affd700 1 -- 172.21.15.149:0/3836583253 >> v1:172.21.15.149:6789/0 conn(0x7f726c0701b0 legacy=0x7f726c06ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:46.008 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.001+0000 7f726affd700 1 --2- 172.21.15.149:0/3836583253 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7254003a30 0x7f7254003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:46.008 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.001+0000 7f726affd700 1 --2- 172.21.15.149:0/3836583253 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7254004850 0x7f7254004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:46.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.001+0000 7f726affd700 1 --2- 172.21.15.149:0/3836583253 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f726c15db30 0x7f7254005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:46.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.001+0000 7f726affd700 1 -- 172.21.15.149:0/3836583253 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f726c0cc9f0 con 0x7f7254004850 2023-11-08T19:29:46.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.001+0000 7f726affd700 1 -- 172.21.15.149:0/3836583253 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f725400bb10 con 0x7f7254003a30 2023-11-08T19:29:46.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.001+0000 7f726affd700 1 -- 172.21.15.149:0/3836583253 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f725400bcd0 con 0x7f726c15db30 2023-11-08T19:29:46.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.001+0000 7f726b7fe700 1 --2- 172.21.15.149:0/3836583253 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7254004850 0x7f7254004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:46.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.001+0000 7f726bfff700 1 --2- 172.21.15.149:0/3836583253 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7254003a30 0x7f7254003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:46.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.001+0000 7f7270dbd700 1 --2- 172.21.15.149:0/3836583253 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f726c15db30 0x7f7254005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:46.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.001+0000 7f726b7fe700 1 -- 172.21.15.149:0/3836583253 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f726c15db30 msgr2=0x7f7254005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:46.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.001+0000 7f726b7fe700 1 --2- 172.21.15.149:0/3836583253 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f726c15db30 0x7f7254005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:46.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.001+0000 7f726b7fe700 1 -- 172.21.15.149:0/3836583253 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7254003a30 msgr2=0x7f7254003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:46.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.001+0000 7f726b7fe700 1 --2- 172.21.15.149:0/3836583253 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7254003a30 0x7f7254003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:46.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.001+0000 7f726b7fe700 1 -- 172.21.15.149:0/3836583253 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72540035b0 con 0x7f7254004850 2023-11-08T19:29:46.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.001+0000 7f726b7fe700 1 --2- 172.21.15.149:0/3836583253 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7254004850 0x7f7254004cd0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f725c00c2a0 tx=0x7f7254005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c413d9cfd6357e18 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:46.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.001+0000 7f726affd700 1 -- 172.21.15.149:0/3836583253 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725c007c10 con 0x7f7254004850 2023-11-08T19:29:46.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.001+0000 7f726affd700 1 -- 172.21.15.149:0/3836583253 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f725c00cde0 con 0x7f7254004850 2023-11-08T19:29:46.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.001+0000 7f726affd700 1 -- 172.21.15.149:0/3836583253 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725c005ba0 con 0x7f7254004850 2023-11-08T19:29:46.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.002+0000 7f7272820700 1 -- 172.21.15.149:0/3836583253 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7254004850 msgr2=0x7f7254004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:46.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.002+0000 7f7272820700 1 --2- 172.21.15.149:0/3836583253 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7254004850 0x7f7254004cd0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f725c00c2a0 tx=0x7f7254005880 comp rx=0 tx=0).stop 2023-11-08T19:29:46.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.002+0000 7f7270dbd700 1 -- 172.21.15.149:0/3836583253 reap_dead start 2023-11-08T19:29:46.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.002+0000 7f7272820700 1 -- 172.21.15.149:0/3836583253 shutdown_connections 2023-11-08T19:29:46.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.002+0000 7f7272820700 1 -- 172.21.15.149:0/3836583253 >> 172.21.15.149:0/3836583253 conn(0x7f726c06e040 msgr2=0x7f726c06e420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:46.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.002+0000 7f7272820700 1 -- 172.21.15.149:0/3836583253 shutdown_connections 2023-11-08T19:29:46.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.002+0000 7f7272820700 1 -- 172.21.15.149:0/3836583253 wait complete. 2023-11-08T19:29:46.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.003+0000 7f7272820700 1 Processor -- start 2023-11-08T19:29:46.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.003+0000 7f7272820700 1 -- start start 2023-11-08T19:29:46.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.004+0000 7f7272820700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7254004850 0x7f726c1553a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:46.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.004+0000 7f7272820700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f726c0aefd0 0x7f726c0af450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:46.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.004+0000 7f7272820700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f726c0c98f0 0x7f726c0c9d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:46.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.004+0000 7f7272820700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f726c0ca2b0 con 0x7f7254004850 2023-11-08T19:29:46.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.004+0000 7f7272820700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f726c0b3db0 con 0x7f726c0aefd0 2023-11-08T19:29:46.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.004+0000 7f7272820700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f726c0b4050 con 0x7f726c0c98f0 2023-11-08T19:29:46.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.004+0000 7f726bfff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7254004850 0x7f726c1553a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:46.018 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.004+0000 7f726bfff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7254004850 0x7f726c1553a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45400/0 (socket says 172.21.15.149:45400) 2023-11-08T19:29:46.018 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.004+0000 7f726bfff700 1 -- 172.21.15.149:0/2075094353 learned_addr learned my addr 172.21.15.149:0/2075094353 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:46.018 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.004+0000 7f726b7fe700 1 --2- 172.21.15.149:0/2075094353 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f726c0aefd0 0x7f726c0af450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:46.018 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.004+0000 7f7270dbd700 1 --2- 172.21.15.149:0/2075094353 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f726c0c98f0 0x7f726c0c9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:46.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.004+0000 7f726bfff700 1 -- 172.21.15.149:0/2075094353 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f726c0c98f0 msgr2=0x7f726c0c9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:46.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.004+0000 7f726bfff700 1 --2- 172.21.15.149:0/2075094353 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f726c0c98f0 0x7f726c0c9d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:46.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.004+0000 7f726bfff700 1 -- 172.21.15.149:0/2075094353 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f726c0aefd0 msgr2=0x7f726c0af450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:46.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.004+0000 7f726bfff700 1 --2- 172.21.15.149:0/2075094353 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f726c0aefd0 0x7f726c0af450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:46.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.004+0000 7f726bfff700 1 -- 172.21.15.149:0/2075094353 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f726c0b4330 con 0x7f7254004850 2023-11-08T19:29:46.020 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.005+0000 7f726b7fe700 1 --2- 172.21.15.149:0/2075094353 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f726c0aefd0 0x7f726c0af450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:29:46.020 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.005+0000 7f7270dbd700 1 --2- 172.21.15.149:0/2075094353 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f726c0c98f0 0x7f726c0c9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:29:46.020 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.005+0000 7f726bfff700 1 --2- 172.21.15.149:0/2075094353 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7254004850 0x7f726c1553a0 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f72600098b0 tx=0x7f7260009c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:46.020 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.005+0000 7f7268ff9700 1 -- 172.21.15.149:0/2075094353 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7260010880 con 0x7f7254004850 2023-11-08T19:29:46.020 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.005+0000 7f7268ff9700 1 -- 172.21.15.149:0/2075094353 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72600109e0 con 0x7f7254004850 2023-11-08T19:29:46.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.005+0000 7f7272820700 1 -- 172.21.15.149:0/2075094353 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f726c0b4610 con 0x7f7254004850 2023-11-08T19:29:46.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.005+0000 7f7268ff9700 1 -- 172.21.15.149:0/2075094353 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7260010d70 con 0x7f7254004850 2023-11-08T19:29:46.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.005+0000 7f7272820700 1 -- 172.21.15.149:0/2075094353 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f726c1558e0 con 0x7f7254004850 2023-11-08T19:29:46.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.006+0000 7f7272820700 1 -- 172.21.15.149:0/2075094353 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f726c0b4c60 con 0x7f7254004850 2023-11-08T19:29:46.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.006+0000 7f7268ff9700 1 -- 172.21.15.149:0/2075094353 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7260015470 con 0x7f7254004850 2023-11-08T19:29:46.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.007+0000 7f7268ff9700 1 --2- 172.21.15.149:0/2075094353 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f725806af00 0x7f725806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:46.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.007+0000 7f726b7fe700 1 --2- 172.21.15.149:0/2075094353 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f725806af00 0x7f725806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:46.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.007+0000 7f7268ff9700 1 -- 172.21.15.149:0/2075094353 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7737+0+0 (secure 0 0 0) 0x7f726008a890 con 0x7f7254004850 2023-11-08T19:29:46.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.007+0000 7f726b7fe700 1 --2- 172.21.15.149:0/2075094353 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f725806af00 0x7f725806d3c0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f725c001930 tx=0x7f725c007000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:46.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.012+0000 7f7268ff9700 1 -- 172.21.15.149:0/2075094353 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7260054e50 con 0x7f7254004850 2023-11-08T19:29:46.253 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.251+0000 7f7272820700 1 -- 172.21.15.149:0/2075094353 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f726c067810 con 0x7f7254004850 2023-11-08T19:29:46.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.252+0000 7f7268ff9700 1 -- 172.21.15.149:0/2075094353 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) v1 ==== 95+0+4944 (secure 0 0 0) 0x7f7260058470 con 0x7f7254004850 2023-11-08T19:29:46.254 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:29:46.254 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":103,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6095,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/852710262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":852710262},{"type":"v1","addr":"172.21.15.160:6835","nonce":852710262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64},{"gid":6425,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/2137508069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":2137508069},{"type":"v1","addr":"172.21.15.149:6837","nonce":2137508069}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":100}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:29:44.194817+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7812,"mds_1":6398},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6398":{"gid":6398,"name":"d","rank":1,"incarnation":99,"state":"up:active","state_seq":7,"addr":"172.21.15.160:6834/2282522167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2282522167},{"type":"v1","addr":"172.21.15.160:6834","nonce":2282522167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7812":{"gid":7812,"name":"a","rank":0,"incarnation":96,"state":"up:active","state_seq":14,"addr":"172.21.15.149:6836/2818321595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2818321595},{"type":"v1","addr":"172.21.15.149:6836","nonce":2818321595}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:29:46.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.254+0000 7f7272820700 1 -- 172.21.15.149:0/2075094353 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f725806af00 msgr2=0x7f725806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:46.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.254+0000 7f7272820700 1 --2- 172.21.15.149:0/2075094353 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f725806af00 0x7f725806d3c0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f725c001930 tx=0x7f725c007000 comp rx=0 tx=0).stop 2023-11-08T19:29:46.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.254+0000 7f7272820700 1 -- 172.21.15.149:0/2075094353 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7254004850 msgr2=0x7f726c1553a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:46.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.254+0000 7f7272820700 1 --2- 172.21.15.149:0/2075094353 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7254004850 0x7f726c1553a0 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f72600098b0 tx=0x7f7260009c70 comp rx=0 tx=0).stop 2023-11-08T19:29:46.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.254+0000 7f7272820700 1 -- 172.21.15.149:0/2075094353 shutdown_connections 2023-11-08T19:29:46.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.254+0000 7f7272820700 1 --2- 172.21.15.149:0/2075094353 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f725806af00 0x7f725806d3c0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:46.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.254+0000 7f7272820700 1 --2- 172.21.15.149:0/2075094353 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f726c0c98f0 0x7f726c0c9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:46.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.254+0000 7f7272820700 1 --2- 172.21.15.149:0/2075094353 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7254004850 0x7f726c1553a0 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:46.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.254+0000 7f7272820700 1 --2- 172.21.15.149:0/2075094353 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f726c0aefd0 0x7f726c0af450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:46.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.254+0000 7f7272820700 1 -- 172.21.15.149:0/2075094353 >> 172.21.15.149:0/2075094353 conn(0x7f726c06e040 msgr2=0x7f726c072000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:46.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.254+0000 7f7272820700 1 -- 172.21.15.149:0/2075094353 shutdown_connections 2023-11-08T19:29:46.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.254+0000 7f7272820700 1 -- 172.21.15.149:0/2075094353 wait complete. 2023-11-08T19:29:46.259 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 103 2023-11-08T19:29:46.270 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:active 2023-11-08T19:29:46.270 DEBUG:tasks.cephfs.filesystem:reached state 'up:active' in 5.979037046432495s 2023-11-08T19:29:46.271 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:29:46.393 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.391+0000 7f0680d81700 1 Processor -- start 2023-11-08T19:29:46.393 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.391+0000 7f0680d81700 1 -- start start 2023-11-08T19:29:46.395 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.392+0000 7f0680d81700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f067c0b20f0 0x7f067c06fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:46.396 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.392+0000 7f0680d81700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f067c15ebe0 0x7f067c0cbd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:46.396 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.392+0000 7f0680d81700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f067c06ffd0 con 0x7f067c072b70 2023-11-08T19:29:46.396 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.392+0000 7f0680d81700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f067c070200 con 0x7f067c0b20f0 2023-11-08T19:29:46.396 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.392+0000 7f0680d81700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f067c0704e0 con 0x7f067c15ebe0 2023-11-08T19:29:46.396 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.392+0000 7f067a59c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f067c0b20f0 0x7f067c06fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:46.397 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.392+0000 7f067a59c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f067c0b20f0 0x7f067c06fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45408/0 (socket says 172.21.15.149:45408) 2023-11-08T19:29:46.397 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.392+0000 7f067a59c700 1 -- 172.21.15.149:0/2673168651 learned_addr learned my addr 172.21.15.149:0/2673168651 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:46.397 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.392+0000 7f067ad9d700 1 --2- 172.21.15.149:0/2673168651 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f067c15ebe0 0x7f067c0cbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:46.397 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.392+0000 7f067a59c700 1 -- 172.21.15.149:0/2673168651 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f067c15ebe0 msgr2=0x7f067c0cbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:46.397 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.392+0000 7f067a59c700 1 --2- 172.21.15.149:0/2673168651 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f067c15ebe0 0x7f067c0cbd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:46.398 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.392+0000 7f067a59c700 1 -- 172.21.15.149:0/2673168651 >> v1:172.21.15.160:6789/0 conn(0x7f067c072b70 legacy=0x7f067c0b24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:46.398 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.392+0000 7f067a59c700 1 -- 172.21.15.149:0/2673168651 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f067c0707c0 con 0x7f067c0b20f0 2023-11-08T19:29:46.398 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.393+0000 7f067a59c700 1 --2- 172.21.15.149:0/2673168651 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f067c0b20f0 0x7f067c06fa90 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f066c00bb90 tx=0x7f066c00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92e964ad65fe44e4 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:46.398 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.393+0000 7f067959a700 1 -- 172.21.15.149:0/2673168651 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066c00dd50 con 0x7f067c0b20f0 2023-11-08T19:29:46.398 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.393+0000 7f067959a700 1 -- 172.21.15.149:0/2673168651 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f066c010470 con 0x7f067c0b20f0 2023-11-08T19:29:46.399 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.393+0000 7f067959a700 1 -- 172.21.15.149:0/2673168651 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066c010800 con 0x7f067c0b20f0 2023-11-08T19:29:46.399 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.393+0000 7f0680d81700 1 -- 172.21.15.149:0/2673168651 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f067c0b20f0 msgr2=0x7f067c06fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:46.399 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.393+0000 7f0680d81700 1 --2- 172.21.15.149:0/2673168651 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f067c0b20f0 0x7f067c06fa90 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f066c00bb90 tx=0x7f066c00bea0 comp rx=0 tx=0).stop 2023-11-08T19:29:46.399 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.393+0000 7f0680d81700 1 -- 172.21.15.149:0/2673168651 shutdown_connections 2023-11-08T19:29:46.399 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.393+0000 7f0680d81700 1 --2- 172.21.15.149:0/2673168651 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f067c15ebe0 0x7f067c0cbd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:46.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.393+0000 7f0680d81700 1 --2- 172.21.15.149:0/2673168651 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f067c0b20f0 0x7f067c06fa90 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:46.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.393+0000 7f0680d81700 1 -- 172.21.15.149:0/2673168651 >> 172.21.15.149:0/2673168651 conn(0x7f067c0cd0f0 msgr2=0x7f067c0cd500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:46.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.393+0000 7f0680d81700 1 -- 172.21.15.149:0/2673168651 shutdown_connections 2023-11-08T19:29:46.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.393+0000 7f0680d81700 1 -- 172.21.15.149:0/2673168651 wait complete. 2023-11-08T19:29:46.403 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.395+0000 7f0680d81700 1 Processor -- start 2023-11-08T19:29:46.403 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.395+0000 7f0680d81700 1 -- start start 2023-11-08T19:29:46.404 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.395+0000 7f0680d81700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f067c072b70 0x7f067c15aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:46.404 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.395+0000 7f0680d81700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f067c0b20f0 0x7f067c149c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:46.404 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.395+0000 7f0680d81700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f067c15ebe0 0x7f067c0c9e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:46.404 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.395+0000 7f0680d81700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f067c156310 con 0x7f067c15ebe0 2023-11-08T19:29:46.405 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.395+0000 7f0680d81700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f067c0c8d60 con 0x7f067c072b70 2023-11-08T19:29:46.405 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.395+0000 7f0680d81700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f067c0c9040 con 0x7f067c0b20f0 2023-11-08T19:29:46.405 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.396+0000 7f067ad9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f067c15ebe0 0x7f067c0c9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:46.405 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.396+0000 7f067ad9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f067c15ebe0 0x7f067c0c9e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45418/0 (socket says 172.21.15.149:45418) 2023-11-08T19:29:46.405 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.396+0000 7f067ad9d700 1 -- 172.21.15.149:0/2715415999 learned_addr learned my addr 172.21.15.149:0/2715415999 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:46.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.396+0000 7f0679d9b700 1 --2- 172.21.15.149:0/2715415999 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f067c0b20f0 0x7f067c149c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:46.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.396+0000 7f067a59c700 1 --2- 172.21.15.149:0/2715415999 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f067c072b70 0x7f067c15aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:46.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.396+0000 7f067ad9d700 1 -- 172.21.15.149:0/2715415999 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f067c0b20f0 msgr2=0x7f067c149c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:46.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.396+0000 7f067ad9d700 1 --2- 172.21.15.149:0/2715415999 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f067c0b20f0 0x7f067c149c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:46.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.396+0000 7f067ad9d700 1 -- 172.21.15.149:0/2715415999 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f067c072b70 msgr2=0x7f067c15aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:46.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.396+0000 7f067ad9d700 1 --2- 172.21.15.149:0/2715415999 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f067c072b70 0x7f067c15aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:46.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.396+0000 7f067ad9d700 1 -- 172.21.15.149:0/2715415999 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f066c00b7f0 con 0x7f067c15ebe0 2023-11-08T19:29:46.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.396+0000 7f067a59c700 1 --2- 172.21.15.149:0/2715415999 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f067c072b70 0x7f067c15aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:29:46.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.396+0000 7f067ad9d700 1 --2- 172.21.15.149:0/2715415999 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f067c15ebe0 0x7f067c0c9e00 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f0674007e60 tx=0x7f067400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:46.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.396+0000 7f066affd700 1 -- 172.21.15.149:0/2715415999 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067400ede0 con 0x7f067c15ebe0 2023-11-08T19:29:46.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.396+0000 7f066affd700 1 -- 172.21.15.149:0/2715415999 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0674014420 con 0x7f067c15ebe0 2023-11-08T19:29:46.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.396+0000 7f0680d81700 1 -- 172.21.15.149:0/2715415999 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f067c0c9320 con 0x7f067c15ebe0 2023-11-08T19:29:46.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.396+0000 7f066affd700 1 -- 172.21.15.149:0/2715415999 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06740147d0 con 0x7f067c15ebe0 2023-11-08T19:29:46.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.396+0000 7f0680d81700 1 -- 172.21.15.149:0/2715415999 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f067c0c98e0 con 0x7f067c15ebe0 2023-11-08T19:29:46.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.397+0000 7f0680d81700 1 -- 172.21.15.149:0/2715415999 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f067c067810 con 0x7f067c15ebe0 2023-11-08T19:29:46.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.398+0000 7f066affd700 1 -- 172.21.15.149:0/2715415999 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0674014930 con 0x7f067c15ebe0 2023-11-08T19:29:46.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.398+0000 7f066affd700 1 --2- 172.21.15.149:0/2715415999 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f065c06af00 0x7f065c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:46.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.398+0000 7f067a59c700 1 --2- 172.21.15.149:0/2715415999 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f065c06af00 0x7f065c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:46.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.398+0000 7f066affd700 1 -- 172.21.15.149:0/2715415999 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7737+0+0 (secure 0 0 0) 0x7f067408a450 con 0x7f067c15ebe0 2023-11-08T19:29:46.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.398+0000 7f067a59c700 1 --2- 172.21.15.149:0/2715415999 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f065c06af00 0x7f065c06d3c0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f066c00bee0 tx=0x7f066c01b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:46.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.404+0000 7f066affd700 1 -- 172.21.15.149:0/2715415999 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0674054da0 con 0x7f067c15ebe0 2023-11-08T19:29:46.638 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.636+0000 7f0680d81700 1 -- 172.21.15.149:0/2715415999 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f067c074f10 con 0x7f067c15ebe0 2023-11-08T19:29:46.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.637+0000 7f066affd700 1 -- 172.21.15.149:0/2715415999 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) v1 ==== 95+0+4944 (secure 0 0 0) 0x7f06740583c0 con 0x7f067c15ebe0 2023-11-08T19:29:46.639 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:29:46.640 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":103,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6095,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/852710262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":852710262},{"type":"v1","addr":"172.21.15.160:6835","nonce":852710262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64},{"gid":6425,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/2137508069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":2137508069},{"type":"v1","addr":"172.21.15.149:6837","nonce":2137508069}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":100}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:29:44.194817+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7812,"mds_1":6398},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6398":{"gid":6398,"name":"d","rank":1,"incarnation":99,"state":"up:active","state_seq":7,"addr":"172.21.15.160:6834/2282522167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2282522167},{"type":"v1","addr":"172.21.15.160:6834","nonce":2282522167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7812":{"gid":7812,"name":"a","rank":0,"incarnation":96,"state":"up:active","state_seq":14,"addr":"172.21.15.149:6836/2818321595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2818321595},{"type":"v1","addr":"172.21.15.149:6836","nonce":2818321595}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:29:46.641 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.639+0000 7f0680d81700 1 -- 172.21.15.149:0/2715415999 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f065c06af00 msgr2=0x7f065c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:46.641 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.639+0000 7f0680d81700 1 --2- 172.21.15.149:0/2715415999 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f065c06af00 0x7f065c06d3c0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f066c00bee0 tx=0x7f066c01b040 comp rx=0 tx=0).stop 2023-11-08T19:29:46.642 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.639+0000 7f0680d81700 1 -- 172.21.15.149:0/2715415999 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f067c15ebe0 msgr2=0x7f067c0c9e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:46.642 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.639+0000 7f0680d81700 1 --2- 172.21.15.149:0/2715415999 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f067c15ebe0 0x7f067c0c9e00 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f0674007e60 tx=0x7f067400e3c0 comp rx=0 tx=0).stop 2023-11-08T19:29:46.642 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.639+0000 7f0680d81700 1 -- 172.21.15.149:0/2715415999 shutdown_connections 2023-11-08T19:29:46.642 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.639+0000 7f0680d81700 1 --2- 172.21.15.149:0/2715415999 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f065c06af00 0x7f065c06d3c0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:46.643 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.639+0000 7f0680d81700 1 --2- 172.21.15.149:0/2715415999 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f067c072b70 0x7f067c15aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:46.643 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.639+0000 7f0680d81700 1 --2- 172.21.15.149:0/2715415999 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f067c15ebe0 0x7f067c0c9e00 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:46.643 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.639+0000 7f0680d81700 1 --2- 172.21.15.149:0/2715415999 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f067c0b20f0 0x7f067c149c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:46.643 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.639+0000 7f0680d81700 1 -- 172.21.15.149:0/2715415999 >> 172.21.15.149:0/2715415999 conn(0x7f067c0cd0f0 msgr2=0x7f067c157bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:46.643 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.639+0000 7f0680d81700 1 -- 172.21.15.149:0/2715415999 shutdown_connections 2023-11-08T19:29:46.644 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.639+0000 7f0680d81700 1 -- 172.21.15.149:0/2715415999 wait complete. 2023-11-08T19:29:46.644 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 103 2023-11-08T19:29:46.654 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump snaps --server 2023-11-08T19:29:46.791 INFO:teuthology.orchestra.run.smithi149.stdout:{"last_snap":10,"last_created":5,"last_destroyed":9,"pending_noop":[],"snaps":[],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-08T19:29:46.792 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 5, "last_destroyed": 9, "last_snap": 10, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [] } 2023-11-08T19:29:46.792 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-11-08T19:29:46.793 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:29:46.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.912+0000 7f8dc7281700 1 Processor -- start 2023-11-08T19:29:46.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.912+0000 7f8dc7281700 1 -- start start 2023-11-08T19:29:46.916 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.912+0000 7f8dc7281700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f8dc015dce0 0x7f8dc00b20f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:46.916 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.912+0000 7f8dc7281700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f8dc006ab20 0x7f8dc006afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:46.916 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.912+0000 7f8dc7281700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dc00ce6e0 con 0x7f8dc0070770 2023-11-08T19:29:46.916 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.912+0000 7f8dc7281700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dc00cf280 con 0x7f8dc006ab20 2023-11-08T19:29:46.916 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.912+0000 7f8dc7281700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dc006b4f0 con 0x7f8dc015dce0 2023-11-08T19:29:46.917 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.912+0000 7f8dc581e700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f8dc006ab20 0x7f8dc006afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:46.917 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.912+0000 7f8dc581e700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f8dc006ab20 0x7f8dc006afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45426/0 (socket says 172.21.15.149:45426) 2023-11-08T19:29:46.917 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.912+0000 7f8dc581e700 1 -- 172.21.15.149:0/1874008182 learned_addr learned my addr 172.21.15.149:0/1874008182 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:46.917 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.912+0000 7f8dc501d700 1 --2- 172.21.15.149:0/1874008182 >> v2:172.21.15.160:3300/0 conn(0x7f8dc015dce0 0x7f8dc00b20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:46.918 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.912+0000 7f8dc581e700 1 -- 172.21.15.149:0/1874008182 >> v2:172.21.15.160:3300/0 conn(0x7f8dc015dce0 msgr2=0x7f8dc00b20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:46.918 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.912+0000 7f8dc581e700 1 --2- 172.21.15.149:0/1874008182 >> v2:172.21.15.160:3300/0 conn(0x7f8dc015dce0 0x7f8dc00b20f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:46.918 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.912+0000 7f8dc581e700 1 -- 172.21.15.149:0/1874008182 >> v1:172.21.15.149:6789/0 conn(0x7f8dc0070770 legacy=0x7f8dc00ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:46.918 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.912+0000 7f8db7fff700 1 -- 172.21.15.149:0/1874008182 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1667354784 0 0) 0x7f8dc00ce6e0 con 0x7f8dc0070770 2023-11-08T19:29:46.918 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.912+0000 7f8dc581e700 1 -- 172.21.15.149:0/1874008182 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dc00b2fb0 con 0x7f8dc006ab20 2023-11-08T19:29:46.919 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.912+0000 7f8dc501d700 1 --2- 172.21.15.149:0/1874008182 >> v2:172.21.15.160:3300/0 conn(0x7f8dc015dce0 0x7f8dc00b20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:29:46.919 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.912+0000 7f8dc581e700 1 --2- 172.21.15.149:0/1874008182 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8dc006ab20 0x7f8dc006afb0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f8dc00cdf70 tx=0x7f8db800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8540201c5536b70 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:46.919 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.913+0000 7f8db7fff700 1 -- 172.21.15.149:0/1874008182 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db800e070 con 0x7f8dc006ab20 2023-11-08T19:29:46.919 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.913+0000 7f8db7fff700 1 -- 172.21.15.149:0/1874008182 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8db800b9c0 con 0x7f8dc006ab20 2023-11-08T19:29:46.919 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.913+0000 7f8db7fff700 1 -- 172.21.15.149:0/1874008182 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db800bd70 con 0x7f8dc006ab20 2023-11-08T19:29:46.920 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.913+0000 7f8dc7281700 1 -- 172.21.15.149:0/1874008182 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8dc006ab20 msgr2=0x7f8dc006afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:46.920 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.913+0000 7f8dc7281700 1 --2- 172.21.15.149:0/1874008182 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8dc006ab20 0x7f8dc006afb0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f8dc00cdf70 tx=0x7f8db800b330 comp rx=0 tx=0).stop 2023-11-08T19:29:46.920 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.913+0000 7f8dc7281700 1 -- 172.21.15.149:0/1874008182 shutdown_connections 2023-11-08T19:29:46.920 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.913+0000 7f8dc7281700 1 --2- 172.21.15.149:0/1874008182 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8dc006ab20 0x7f8dc006afb0 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:46.920 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.913+0000 7f8dc7281700 1 --2- 172.21.15.149:0/1874008182 >> v2:172.21.15.160:3300/0 conn(0x7f8dc015dce0 0x7f8dc00b20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:46.921 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.913+0000 7f8dc7281700 1 -- 172.21.15.149:0/1874008182 >> 172.21.15.149:0/1874008182 conn(0x7f8dc00cd0f0 msgr2=0x7f8dc00cd500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:46.921 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.913+0000 7f8dc7281700 1 -- 172.21.15.149:0/1874008182 shutdown_connections 2023-11-08T19:29:46.921 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.913+0000 7f8dc7281700 1 -- 172.21.15.149:0/1874008182 wait complete. 2023-11-08T19:29:46.924 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.914+0000 7f8dc7281700 1 Processor -- start 2023-11-08T19:29:46.924 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.914+0000 7f8dc7281700 1 -- start start 2023-11-08T19:29:46.924 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.915+0000 7f8dc7281700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8dc006ab20 0x7f8dc00b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:46.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.915+0000 7f8dc7281700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8dc0070770 0x7f8dc015abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:46.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.915+0000 7f8dc7281700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8dc015dce0 0x7f8dc01f66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:46.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.915+0000 7f8dc7281700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc00b37a0 con 0x7f8dc006ab20 2023-11-08T19:29:46.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.915+0000 7f8dc7281700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc015e650 con 0x7f8dc015dce0 2023-11-08T19:29:46.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.915+0000 7f8dc7281700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc01f7080 con 0x7f8dc0070770 2023-11-08T19:29:46.926 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.915+0000 7f8dc501d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8dc006ab20 0x7f8dc00b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:46.926 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.915+0000 7f8dc501d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8dc006ab20 0x7f8dc00b3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45428/0 (socket says 172.21.15.149:45428) 2023-11-08T19:29:46.926 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.915+0000 7f8dc501d700 1 -- 172.21.15.149:0/860353137 learned_addr learned my addr 172.21.15.149:0/860353137 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:46.926 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.915+0000 7f8dc581e700 1 --2- 172.21.15.149:0/860353137 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8dc015dce0 0x7f8dc01f66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:46.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.915+0000 7f8dc481c700 1 --2- 172.21.15.149:0/860353137 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8dc0070770 0x7f8dc015abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:46.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.915+0000 7f8dc501d700 1 -- 172.21.15.149:0/860353137 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8dc0070770 msgr2=0x7f8dc015abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:46.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.915+0000 7f8dc501d700 1 --2- 172.21.15.149:0/860353137 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8dc0070770 0x7f8dc015abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:46.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.915+0000 7f8dc501d700 1 -- 172.21.15.149:0/860353137 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8dc015dce0 msgr2=0x7f8dc01f66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:46.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.915+0000 7f8dc501d700 1 --2- 172.21.15.149:0/860353137 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8dc015dce0 0x7f8dc01f66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:46.928 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.916+0000 7f8dc501d700 1 -- 172.21.15.149:0/860353137 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8db8009b30 con 0x7f8dc006ab20 2023-11-08T19:29:46.928 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.916+0000 7f8dc481c700 1 --2- 172.21.15.149:0/860353137 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8dc0070770 0x7f8dc015abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:29:46.928 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.916+0000 7f8dc501d700 1 --2- 172.21.15.149:0/860353137 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8dc006ab20 0x7f8dc00b3260 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc00c7f0 tx=0x7f8dbc00cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:46.928 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.916+0000 7f8db5ffb700 1 -- 172.21.15.149:0/860353137 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dbc011800 con 0x7f8dc006ab20 2023-11-08T19:29:46.928 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.916+0000 7f8db5ffb700 1 -- 172.21.15.149:0/860353137 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dbc011960 con 0x7f8dc006ab20 2023-11-08T19:29:46.929 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.916+0000 7f8db5ffb700 1 -- 172.21.15.149:0/860353137 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dbc011cf0 con 0x7f8dc006ab20 2023-11-08T19:29:46.929 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.916+0000 7f8dc7281700 1 -- 172.21.15.149:0/860353137 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dc01f7360 con 0x7f8dc006ab20 2023-11-08T19:29:46.929 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.916+0000 7f8dc7281700 1 -- 172.21.15.149:0/860353137 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dc015b0f0 con 0x7f8dc006ab20 2023-11-08T19:29:46.929 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.917+0000 7f8dc7281700 1 -- 172.21.15.149:0/860353137 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dc01f75a0 con 0x7f8dc006ab20 2023-11-08T19:29:46.929 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.917+0000 7f8db5ffb700 1 -- 172.21.15.149:0/860353137 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8dbc018360 con 0x7f8dc006ab20 2023-11-08T19:29:46.929 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.918+0000 7f8db5ffb700 1 --2- 172.21.15.149:0/860353137 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f8da406af00 0x7f8da406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:46.930 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.918+0000 7f8db5ffb700 1 -- 172.21.15.149:0/860353137 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7737+0+0 (secure 0 0 0) 0x7f8dbc089c70 con 0x7f8dc006ab20 2023-11-08T19:29:46.930 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.918+0000 7f8dc481c700 1 --2- 172.21.15.149:0/860353137 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f8da406af00 0x7f8da406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:46.930 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.918+0000 7f8dc481c700 1 --2- 172.21.15.149:0/860353137 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f8da406af00 0x7f8da406d3c0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f8dc015c0f0 tx=0x7f8db0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:46.931 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:46.923+0000 7f8db5ffb700 1 -- 172.21.15.149:0/860353137 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8dbc054540 con 0x7f8dc006ab20 2023-11-08T19:29:47.158 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:47.156+0000 7f8dc7281700 1 -- 172.21.15.149:0/860353137 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8dc015e120 con 0x7f8dc006ab20 2023-11-08T19:29:47.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:47.157+0000 7f8db5ffb700 1 -- 172.21.15.149:0/860353137 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) v1 ==== 95+0+4944 (secure 0 0 0) 0x7f8dbc057b60 con 0x7f8dc006ab20 2023-11-08T19:29:47.160 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:29:47.160 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":103,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6095,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/852710262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":852710262},{"type":"v1","addr":"172.21.15.160:6835","nonce":852710262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64},{"gid":6425,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/2137508069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":2137508069},{"type":"v1","addr":"172.21.15.149:6837","nonce":2137508069}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":100}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:29:44.194817+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7812,"mds_1":6398},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6398":{"gid":6398,"name":"d","rank":1,"incarnation":99,"state":"up:active","state_seq":7,"addr":"172.21.15.160:6834/2282522167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2282522167},{"type":"v1","addr":"172.21.15.160:6834","nonce":2282522167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7812":{"gid":7812,"name":"a","rank":0,"incarnation":96,"state":"up:active","state_seq":14,"addr":"172.21.15.149:6836/2818321595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2818321595},{"type":"v1","addr":"172.21.15.149:6836","nonce":2818321595}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:29:47.162 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:47.159+0000 7f8dc7281700 1 -- 172.21.15.149:0/860353137 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f8da406af00 msgr2=0x7f8da406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:47.162 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:47.159+0000 7f8dc7281700 1 --2- 172.21.15.149:0/860353137 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f8da406af00 0x7f8da406d3c0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f8dc015c0f0 tx=0x7f8db0009040 comp rx=0 tx=0).stop 2023-11-08T19:29:47.162 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:47.159+0000 7f8dc7281700 1 -- 172.21.15.149:0/860353137 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8dc006ab20 msgr2=0x7f8dc00b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:47.163 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:47.159+0000 7f8dc7281700 1 --2- 172.21.15.149:0/860353137 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8dc006ab20 0x7f8dc00b3260 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc00c7f0 tx=0x7f8dbc00cb00 comp rx=0 tx=0).stop 2023-11-08T19:29:47.163 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:47.159+0000 7f8dc7281700 1 -- 172.21.15.149:0/860353137 shutdown_connections 2023-11-08T19:29:47.163 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:47.159+0000 7f8dc7281700 1 --2- 172.21.15.149:0/860353137 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f8da406af00 0x7f8da406d3c0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:47.163 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:47.159+0000 7f8dc7281700 1 --2- 172.21.15.149:0/860353137 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8dc015dce0 0x7f8dc01f66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:47.163 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:47.159+0000 7f8dc7281700 1 --2- 172.21.15.149:0/860353137 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8dc006ab20 0x7f8dc00b3260 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:47.164 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:47.159+0000 7f8dc7281700 1 --2- 172.21.15.149:0/860353137 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8dc0070770 0x7f8dc015abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:47.164 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:47.159+0000 7f8dc7281700 1 -- 172.21.15.149:0/860353137 >> 172.21.15.149:0/860353137 conn(0x7f8dc00cd0f0 msgr2=0x7f8dc00b0530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:47.164 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:47.160+0000 7f8dc7281700 1 -- 172.21.15.149:0/860353137 shutdown_connections 2023-11-08T19:29:47.164 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:47.160+0000 7f8dc7281700 1 -- 172.21.15.149:0/860353137 wait complete. 2023-11-08T19:29:47.165 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 103 2023-11-08T19:29:47.174 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump snaps --server 2023-11-08T19:29:47.313 INFO:teuthology.orchestra.run.smithi149.stdout:{"last_snap":10,"last_created":5,"last_destroyed":9,"pending_noop":[],"snaps":[],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-08T19:29:47.314 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 5, "last_destroyed": 9, "last_snap": 10, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [] } 2023-11-08T19:29:47.314 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-08T19:29:47.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:29:47.315 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set brx.0 up 2023-11-08T19:29:54.325 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-08T19:29:54.326 INFO:teuthology.orchestra.run.smithi149.stderr:mkdir: cannot create directory ‘d1/dir/.snap/s22’: Permission denied 2023-11-08T19:29:54.327 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-08T19:29:54.327 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-08T19:29:54.377 DEBUG:teuthology.orchestra.run.smithi160:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-08T19:29:54.425 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-08T19:29:54.426 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-11-08T19:29:54.426 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:29:54.444 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-11-08T19:29:54.445 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:29:54.503 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:29:54.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.664+0000 7f3697f40700 1 Processor -- start 2023-11-08T19:29:54.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.664+0000 7f3697f40700 1 -- start start 2023-11-08T19:29:54.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.665+0000 7f3697f40700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f369015a160 0x7f36900719b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:54.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.665+0000 7f3697f40700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f36900c9b90 0x7f36900ca010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:54.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.665+0000 7f3697f40700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f369006ab20 0x7f369006afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:54.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.665+0000 7f3697f40700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36900ca650 con 0x7f369015a160 2023-11-08T19:29:54.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.665+0000 7f3697f40700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f369006b4f0 con 0x7f36900c9b90 2023-11-08T19:29:54.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.665+0000 7f3697f40700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36900cb310 con 0x7f369006ab20 2023-11-08T19:29:54.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.665+0000 7f3695cdc700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f369015a160 0x7f36900719b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:54.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.665+0000 7f3695cdc700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f369015a160 0x7f36900719b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45448/0 (socket says 172.21.15.149:45448) 2023-11-08T19:29:54.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.665+0000 7f3695cdc700 1 -- 172.21.15.149:0/2345205450 learned_addr learned my addr 172.21.15.149:0/2345205450 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:54.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.665+0000 7f36964dd700 1 --2- 172.21.15.149:0/2345205450 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f369006ab20 0x7f369006afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:54.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.665+0000 7f3695cdc700 1 -- 172.21.15.149:0/2345205450 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f369006ab20 msgr2=0x7f369006afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:54.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.665+0000 7f3695cdc700 1 --2- 172.21.15.149:0/2345205450 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f369006ab20 0x7f369006afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:54.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.665+0000 7f3695cdc700 1 -- 172.21.15.149:0/2345205450 >> v2:172.21.15.160:3300/0 conn(0x7f36900c9b90 msgr2=0x7f36900ca010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:54.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.665+0000 7f3695cdc700 1 --2- 172.21.15.149:0/2345205450 >> v2:172.21.15.160:3300/0 conn(0x7f36900c9b90 0x7f36900ca010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:54.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.665+0000 7f3695cdc700 1 -- 172.21.15.149:0/2345205450 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3690071ef0 con 0x7f369015a160 2023-11-08T19:29:54.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.665+0000 7f3695cdc700 1 --2- 172.21.15.149:0/2345205450 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f369015a160 0x7f36900719b0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f36900c2ea0 tx=0x7f368000ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f54fa64fab24d0e4 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:54.672 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.665+0000 7f3694cda700 1 -- 172.21.15.149:0/2345205450 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368000cb30 con 0x7f369015a160 2023-11-08T19:29:54.672 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.665+0000 7f3694cda700 1 -- 172.21.15.149:0/2345205450 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f368000cc90 con 0x7f369015a160 2023-11-08T19:29:54.672 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.665+0000 7f3694cda700 1 -- 172.21.15.149:0/2345205450 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3680018400 con 0x7f369015a160 2023-11-08T19:29:54.672 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.666+0000 7f3697f40700 1 -- 172.21.15.149:0/2345205450 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f369015a160 msgr2=0x7f36900719b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:54.672 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.666+0000 7f3697f40700 1 --2- 172.21.15.149:0/2345205450 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f369015a160 0x7f36900719b0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f36900c2ea0 tx=0x7f368000ada0 comp rx=0 tx=0).stop 2023-11-08T19:29:54.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.666+0000 7f3697f40700 1 -- 172.21.15.149:0/2345205450 shutdown_connections 2023-11-08T19:29:54.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.666+0000 7f3697f40700 1 --2- 172.21.15.149:0/2345205450 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f369006ab20 0x7f369006afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:54.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.666+0000 7f3697f40700 1 --2- 172.21.15.149:0/2345205450 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f369015a160 0x7f36900719b0 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:54.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.666+0000 7f3697f40700 1 --2- 172.21.15.149:0/2345205450 >> v2:172.21.15.160:3300/0 conn(0x7f36900c9b90 0x7f36900ca010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:54.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.666+0000 7f3697f40700 1 -- 172.21.15.149:0/2345205450 >> 172.21.15.149:0/2345205450 conn(0x7f369006cf30 msgr2=0x7f369006d310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:54.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.666+0000 7f3697f40700 1 -- 172.21.15.149:0/2345205450 shutdown_connections 2023-11-08T19:29:54.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.666+0000 7f3697f40700 1 -- 172.21.15.149:0/2345205450 wait complete. 2023-11-08T19:29:54.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.667+0000 7f3697f40700 1 Processor -- start 2023-11-08T19:29:54.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.667+0000 7f3697f40700 1 -- start start 2023-11-08T19:29:54.677 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.668+0000 7f3697f40700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f369006ab20 0x7f36900c8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:54.677 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.668+0000 7f3697f40700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f36900c9b90 0x7f36901559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:54.677 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.668+0000 7f3697f40700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f369015a160 0x7f369015d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:54.678 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.668+0000 7f3697f40700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36900b2490 con 0x7f369006ab20 2023-11-08T19:29:54.678 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.668+0000 7f3697f40700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3690155ef0 con 0x7f369015a160 2023-11-08T19:29:54.678 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.668+0000 7f3697f40700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f369015da00 con 0x7f36900c9b90 2023-11-08T19:29:54.678 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.668+0000 7f3695cdc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f369006ab20 0x7f36900c8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:54.679 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.668+0000 7f3695cdc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f369006ab20 0x7f36900c8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45454/0 (socket says 172.21.15.149:45454) 2023-11-08T19:29:54.679 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.668+0000 7f3695cdc700 1 -- 172.21.15.149:0/2468719808 learned_addr learned my addr 172.21.15.149:0/2468719808 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:54.679 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.668+0000 7f36964dd700 1 --2- 172.21.15.149:0/2468719808 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f369015a160 0x7f369015d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:54.679 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.668+0000 7f36954db700 1 --2- 172.21.15.149:0/2468719808 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f36900c9b90 0x7f36901559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:54.679 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.668+0000 7f3695cdc700 1 -- 172.21.15.149:0/2468719808 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f36900c9b90 msgr2=0x7f36901559b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:54.680 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.668+0000 7f3695cdc700 1 --2- 172.21.15.149:0/2468719808 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f36900c9b90 0x7f36901559b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:54.680 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.668+0000 7f3695cdc700 1 -- 172.21.15.149:0/2468719808 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f369015a160 msgr2=0x7f369015d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:54.680 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.668+0000 7f3695cdc700 1 --2- 172.21.15.149:0/2468719808 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f369015a160 0x7f369015d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:54.680 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.668+0000 7f3695cdc700 1 -- 172.21.15.149:0/2468719808 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f368000a6f0 con 0x7f369006ab20 2023-11-08T19:29:54.680 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.668+0000 7f36964dd700 1 --2- 172.21.15.149:0/2468719808 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f369015a160 0x7f369015d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:29:54.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.669+0000 7f3695cdc700 1 --2- 172.21.15.149:0/2468719808 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f369006ab20 0x7f36900c8d20 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f368000ade0 tx=0x7f36800047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:54.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.669+0000 7f36867fc700 1 -- 172.21.15.149:0/2468719808 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3680003b70 con 0x7f369006ab20 2023-11-08T19:29:54.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.669+0000 7f36867fc700 1 -- 172.21.15.149:0/2468719808 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3680003cd0 con 0x7f369006ab20 2023-11-08T19:29:54.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.669+0000 7f3697f40700 1 -- 172.21.15.149:0/2468719808 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36900c9300 con 0x7f369006ab20 2023-11-08T19:29:54.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.669+0000 7f36867fc700 1 -- 172.21.15.149:0/2468719808 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3680020600 con 0x7f369006ab20 2023-11-08T19:29:54.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.669+0000 7f3697f40700 1 -- 172.21.15.149:0/2468719808 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36900b3cd0 con 0x7f369006ab20 2023-11-08T19:29:54.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.670+0000 7f3697f40700 1 -- 172.21.15.149:0/2468719808 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3690074f10 con 0x7f369006ab20 2023-11-08T19:29:54.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.670+0000 7f36867fc700 1 -- 172.21.15.149:0/2468719808 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3680018400 con 0x7f369006ab20 2023-11-08T19:29:54.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.670+0000 7f36867fc700 1 --2- 172.21.15.149:0/2468719808 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f367406af00 0x7f367406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:54.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.671+0000 7f36867fc700 1 -- 172.21.15.149:0/2468719808 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7737+0+0 (secure 0 0 0) 0x7f368008b3f0 con 0x7f369006ab20 2023-11-08T19:29:54.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.671+0000 7f36954db700 1 --2- 172.21.15.149:0/2468719808 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f367406af00 0x7f367406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:54.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.671+0000 7f36954db700 1 --2- 172.21.15.149:0/2468719808 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f367406af00 0x7f367406d3c0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f368c006fd0 tx=0x7f368c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:54.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.675+0000 7f36867fc700 1 -- 172.21.15.149:0/2468719808 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3680055d40 con 0x7f369006ab20 2023-11-08T19:29:54.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.866+0000 7f3697f40700 1 -- 172.21.15.149:0/2468719808 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f36900cc990 con 0x7f369006ab20 2023-11-08T19:29:54.869 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.868+0000 7f36867fc700 1 -- 172.21.15.149:0/2468719808 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) v1 ==== 74+0+23067 (secure 0 0 0) 0x7f3680059360 con 0x7f369006ab20 2023-11-08T19:29:54.869 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:29:54.870 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":108,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:29:43.171791+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-08T19:24:29.516185+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-08T19:25:44.287064+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":71,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-08T19:25:45.623521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-11-08T19:26:46.785987+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-11-08T19:26:47.950353+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":9,"snap_epoch":104,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.f","mappings":[{"from":0,"to":5}]},{"pgid":"17.26","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.160:6834/1313631099":"2023-11-09T19:29:27.322904+0000","172.21.15.149:6835/3917392643":"2023-11-09T19:29:34.481449+0000","172.21.15.160:6832/1313631099":"2023-11-09T19:29:27.322904+0000","172.21.15.149:6834/295381437":"2023-11-09T19:28:59.293725+0000","172.21.15.149:6836/295381437":"2023-11-09T19:28:59.293725+0000","172.21.15.160:6835/2714564224":"2023-11-09T19:27:34.046425+0000","172.21.15.149:6837/3917392643":"2023-11-09T19:29:34.481449+0000","172.21.15.149:6834/589971879":"2023-11-09T19:28:00.736319+0000","172.21.15.160:6833/2714564224":"2023-11-09T19:27:34.046425+0000","172.21.15.160:6832/2947079163":"2023-11-09T19:28:27.325108+0000","192.168.0.1:0/1017303916":"2023-11-08T20:29:42.437736+0000","172.21.15.149:6836/589971879":"2023-11-09T19:28:00.736319+0000","172.21.15.160:6834/2947079163":"2023-11-09T19:28:27.325108+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:29:54.871 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.870+0000 7f3697f40700 1 -- 172.21.15.149:0/2468719808 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f367406af00 msgr2=0x7f367406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:54.872 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.870+0000 7f3697f40700 1 --2- 172.21.15.149:0/2468719808 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f367406af00 0x7f367406d3c0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f368c006fd0 tx=0x7f368c008040 comp rx=0 tx=0).stop 2023-11-08T19:29:54.872 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.870+0000 7f3697f40700 1 -- 172.21.15.149:0/2468719808 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f369006ab20 msgr2=0x7f36900c8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:54.872 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.870+0000 7f3697f40700 1 --2- 172.21.15.149:0/2468719808 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f369006ab20 0x7f36900c8d20 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f368000ade0 tx=0x7f36800047c0 comp rx=0 tx=0).stop 2023-11-08T19:29:54.872 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.870+0000 7f3697f40700 1 -- 172.21.15.149:0/2468719808 shutdown_connections 2023-11-08T19:29:54.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.870+0000 7f3697f40700 1 --2- 172.21.15.149:0/2468719808 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f367406af00 0x7f367406d3c0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:54.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.870+0000 7f3697f40700 1 --2- 172.21.15.149:0/2468719808 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f369015a160 0x7f369015d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:54.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.870+0000 7f3697f40700 1 --2- 172.21.15.149:0/2468719808 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f369006ab20 0x7f36900c8d20 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:54.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.870+0000 7f3697f40700 1 --2- 172.21.15.149:0/2468719808 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f36900c9b90 0x7f36901559b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:54.874 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.870+0000 7f3697f40700 1 -- 172.21.15.149:0/2468719808 >> 172.21.15.149:0/2468719808 conn(0x7f369006cf30 msgr2=0x7f36900b4350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:54.874 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.870+0000 7f3697f40700 1 -- 172.21.15.149:0/2468719808 shutdown_connections 2023-11-08T19:29:54.874 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:54.870+0000 7f3697f40700 1 -- 172.21.15.149:0/2468719808 wait complete. 2023-11-08T19:29:54.885 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-08T19:22:56.023194+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-08T19:24:29.516185+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 42, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_data_pool', 'create_time': '2023-11-08T19:25:44.287064+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 71, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-08T19:25:45.623521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-08T19:26:46.785987+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '95', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-11-08T19:26:47.950353+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '104', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 9, 'snap_epoch': 104, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-08T19:29:54.886 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-08T19:29:55.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.009+0000 7f6e4bc05700 1 Processor -- start 2023-11-08T19:29:55.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.009+0000 7f6e4bc05700 1 -- start start 2023-11-08T19:29:55.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.009+0000 7f6e4bc05700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f6e440ce530 0x7f6e44072ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:55.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.010+0000 7f6e4bc05700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6e440cd0b0 0x7f6e440cd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:55.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.010+0000 7f6e4bc05700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e440cb1a0 con 0x7f6e4415d900 2023-11-08T19:29:55.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.010+0000 7f6e4bc05700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e440cda20 con 0x7f6e440ce530 2023-11-08T19:29:55.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.010+0000 7f6e4bc05700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e440cea60 con 0x7f6e440cd0b0 2023-11-08T19:29:55.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.010+0000 7f6e4a1a2700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6e440cd0b0 0x7f6e440cd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:55.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.010+0000 7f6e491a0700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f6e440ce530 0x7f6e44072ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:55.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.010+0000 7f6e4a1a2700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6e440cd0b0 0x7f6e440cd4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.149:37522/0 (socket says 172.21.15.149:37522) 2023-11-08T19:29:55.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.010+0000 7f6e4a1a2700 1 -- 172.21.15.149:0/3436909794 learned_addr learned my addr 172.21.15.149:0/3436909794 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:55.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.010+0000 7f6e4a1a2700 1 -- 172.21.15.149:0/3436909794 >> v2:172.21.15.160:3300/0 conn(0x7f6e440ce530 msgr2=0x7f6e44072ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:55.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.010+0000 7f6e4a1a2700 1 --2- 172.21.15.149:0/3436909794 >> v2:172.21.15.160:3300/0 conn(0x7f6e440ce530 0x7f6e44072ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:55.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.010+0000 7f6e4a1a2700 1 -- 172.21.15.149:0/3436909794 >> v1:172.21.15.160:6789/0 conn(0x7f6e4415d900 legacy=0x7f6e4406ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:55.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.010+0000 7f6e4a1a2700 1 -- 172.21.15.149:0/3436909794 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e440ced40 con 0x7f6e440cd0b0 2023-11-08T19:29:55.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.010+0000 7f6e491a0700 1 --2- 172.21.15.149:0/3436909794 >> v2:172.21.15.160:3300/0 conn(0x7f6e440ce530 0x7f6e44072ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:29:55.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.010+0000 7f6e4a1a2700 1 --2- 172.21.15.149:0/3436909794 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6e440cd0b0 0x7f6e440cd4e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c009e50 tx=0x7f6e3c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37146dc7601966c server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:55.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.011+0000 7f6e4899f700 1 -- 172.21.15.149:0/3436909794 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3c00e070 con 0x7f6e440cd0b0 2023-11-08T19:29:55.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.011+0000 7f6e4899f700 1 -- 172.21.15.149:0/3436909794 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e3c00b910 con 0x7f6e440cd0b0 2023-11-08T19:29:55.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.011+0000 7f6e4899f700 1 -- 172.21.15.149:0/3436909794 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3c00bcc0 con 0x7f6e440cd0b0 2023-11-08T19:29:55.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.011+0000 7f6e4bc05700 1 -- 172.21.15.149:0/3436909794 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6e440cd0b0 msgr2=0x7f6e440cd4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:55.018 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.011+0000 7f6e4bc05700 1 --2- 172.21.15.149:0/3436909794 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6e440cd0b0 0x7f6e440cd4e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c009e50 tx=0x7f6e3c00b330 comp rx=0 tx=0).stop 2023-11-08T19:29:55.018 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.011+0000 7f6e4bc05700 1 -- 172.21.15.149:0/3436909794 shutdown_connections 2023-11-08T19:29:55.018 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.011+0000 7f6e4bc05700 1 --2- 172.21.15.149:0/3436909794 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6e440cd0b0 0x7f6e440cd4e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:55.018 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.011+0000 7f6e4bc05700 1 --2- 172.21.15.149:0/3436909794 >> v2:172.21.15.160:3300/0 conn(0x7f6e440ce530 0x7f6e44072ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:55.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.011+0000 7f6e4bc05700 1 -- 172.21.15.149:0/3436909794 >> 172.21.15.149:0/3436909794 conn(0x7f6e4406e0d0 msgr2=0x7f6e4406e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:55.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.011+0000 7f6e4bc05700 1 -- 172.21.15.149:0/3436909794 shutdown_connections 2023-11-08T19:29:55.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.011+0000 7f6e4bc05700 1 -- 172.21.15.149:0/3436909794 wait complete. 2023-11-08T19:29:55.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.012+0000 7f6e4bc05700 1 Processor -- start 2023-11-08T19:29:55.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.012+0000 7f6e4bc05700 1 -- start start 2023-11-08T19:29:55.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.013+0000 7f6e4bc05700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6e440cd0b0 0x7f6e440b5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:55.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.013+0000 7f6e4bc05700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6e440ce530 0x7f6e44159830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:55.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.013+0000 7f6e4bc05700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e4415d900 0x7f6e440c41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:55.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.013+0000 7f6e4bc05700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e440c5020 con 0x7f6e4415d900 2023-11-08T19:29:55.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.013+0000 7f6e4bc05700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e440c5ec0 con 0x7f6e440cd0b0 2023-11-08T19:29:55.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.013+0000 7f6e4bc05700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e440c61a0 con 0x7f6e440ce530 2023-11-08T19:29:55.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.013+0000 7f6e4a1a2700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e4415d900 0x7f6e440c41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:55.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.013+0000 7f6e499a1700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6e440cd0b0 0x7f6e440b5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:55.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.013+0000 7f6e491a0700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6e440ce530 0x7f6e44159830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:55.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.013+0000 7f6e4a1a2700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e4415d900 0x7f6e440c41f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45472/0 (socket says 172.21.15.149:45472) 2023-11-08T19:29:55.025 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.013+0000 7f6e4a1a2700 1 -- 172.21.15.149:0/393787106 learned_addr learned my addr 172.21.15.149:0/393787106 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:55.025 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.013+0000 7f6e4a1a2700 1 -- 172.21.15.149:0/393787106 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6e440ce530 msgr2=0x7f6e44159830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:55.025 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.013+0000 7f6e4a1a2700 1 --2- 172.21.15.149:0/393787106 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6e440ce530 0x7f6e44159830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:55.025 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.013+0000 7f6e4a1a2700 1 -- 172.21.15.149:0/393787106 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6e440cd0b0 msgr2=0x7f6e440b5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:55.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.013+0000 7f6e4a1a2700 1 --2- 172.21.15.149:0/393787106 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6e440cd0b0 0x7f6e440b5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:55.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.013+0000 7f6e4a1a2700 1 -- 172.21.15.149:0/393787106 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e340094a0 con 0x7f6e4415d900 2023-11-08T19:29:55.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.014+0000 7f6e4a1a2700 1 --2- 172.21.15.149:0/393787106 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e4415d900 0x7f6e440c41f0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f6e440cced0 tx=0x7f6e3c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:55.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.014+0000 7f6e3a7fc700 1 -- 172.21.15.149:0/393787106 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3c004800 con 0x7f6e4415d900 2023-11-08T19:29:55.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.014+0000 7f6e3a7fc700 1 -- 172.21.15.149:0/393787106 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e3c004960 con 0x7f6e4415d900 2023-11-08T19:29:55.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.014+0000 7f6e3a7fc700 1 -- 172.21.15.149:0/393787106 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3c01c680 con 0x7f6e4415d900 2023-11-08T19:29:55.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.014+0000 7f6e4bc05700 1 -- 172.21.15.149:0/393787106 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e3c009b30 con 0x7f6e4415d900 2023-11-08T19:29:55.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.014+0000 7f6e4bc05700 1 -- 172.21.15.149:0/393787106 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e440c6760 con 0x7f6e4415d900 2023-11-08T19:29:55.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.015+0000 7f6e4bc05700 1 -- 172.21.15.149:0/393787106 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e44074f10 con 0x7f6e4415d900 2023-11-08T19:29:55.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.015+0000 7f6e3a7fc700 1 -- 172.21.15.149:0/393787106 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6e3c01c7e0 con 0x7f6e4415d900 2023-11-08T19:29:55.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.016+0000 7f6e3a7fc700 1 --2- 172.21.15.149:0/393787106 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6e2806af00 0x7f6e2806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:55.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.016+0000 7f6e499a1700 1 --2- 172.21.15.149:0/393787106 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6e2806af00 0x7f6e2806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:55.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.016+0000 7f6e3a7fc700 1 -- 172.21.15.149:0/393787106 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7737+0+0 (secure 0 0 0) 0x7f6e3c08b900 con 0x7f6e4415d900 2023-11-08T19:29:55.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.016+0000 7f6e499a1700 1 --2- 172.21.15.149:0/393787106 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6e2806af00 0x7f6e2806d3c0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f6e440c7360 tx=0x7f6e40009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:55.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.021+0000 7f6e3a7fc700 1 -- 172.21.15.149:0/393787106 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6e3c0561c0 con 0x7f6e4415d900 2023-11-08T19:29:55.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.210+0000 7f6e4bc05700 1 -- 172.21.15.149:0/393787106 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6e440afab0 con 0x7f6e4415d900 2023-11-08T19:29:55.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.210+0000 7f6e3a7fc700 1 -- 172.21.15.149:0/393787106 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v108) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6e3c0597e0 con 0x7f6e4415d900 2023-11-08T19:29:55.212 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 1 2023-11-08T19:29:55.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.212+0000 7f6e4bc05700 1 -- 172.21.15.149:0/393787106 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6e2806af00 msgr2=0x7f6e2806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:55.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.212+0000 7f6e4bc05700 1 --2- 172.21.15.149:0/393787106 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6e2806af00 0x7f6e2806d3c0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f6e440c7360 tx=0x7f6e40009040 comp rx=0 tx=0).stop 2023-11-08T19:29:55.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.212+0000 7f6e4bc05700 1 -- 172.21.15.149:0/393787106 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e4415d900 msgr2=0x7f6e440c41f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:55.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.212+0000 7f6e4bc05700 1 --2- 172.21.15.149:0/393787106 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e4415d900 0x7f6e440c41f0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f6e440cced0 tx=0x7f6e3c004ad0 comp rx=0 tx=0).stop 2023-11-08T19:29:55.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.212+0000 7f6e4bc05700 1 -- 172.21.15.149:0/393787106 shutdown_connections 2023-11-08T19:29:55.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.213+0000 7f6e4bc05700 1 --2- 172.21.15.149:0/393787106 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6e2806af00 0x7f6e2806d3c0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:55.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.213+0000 7f6e4bc05700 1 --2- 172.21.15.149:0/393787106 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6e440cd0b0 0x7f6e440b5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:55.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.213+0000 7f6e4bc05700 1 --2- 172.21.15.149:0/393787106 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e4415d900 0x7f6e440c41f0 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:55.216 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.213+0000 7f6e4bc05700 1 --2- 172.21.15.149:0/393787106 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6e440ce530 0x7f6e44159830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:55.216 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.213+0000 7f6e4bc05700 1 -- 172.21.15.149:0/393787106 >> 172.21.15.149:0/393787106 conn(0x7f6e4406e0d0 msgr2=0x7f6e4406c1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:55.216 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.213+0000 7f6e4bc05700 1 -- 172.21.15.149:0/393787106 shutdown_connections 2023-11-08T19:29:55.216 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.213+0000 7f6e4bc05700 1 -- 172.21.15.149:0/393787106 wait complete. 2023-11-08T19:29:55.227 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-08T19:29:55.351 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.350+0000 7fcc4021f700 1 Processor -- start 2023-11-08T19:29:55.352 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.350+0000 7fcc4021f700 1 -- start start 2023-11-08T19:29:55.356 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.351+0000 7fcc4021f700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fcc380cb650 0x7fcc3806ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:55.356 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.351+0000 7fcc4021f700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc380b66c0 con 0x7fcc380ccf60 2023-11-08T19:29:55.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.351+0000 7fcc4021f700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc3815f420 con 0x7fcc3815be30 2023-11-08T19:29:55.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.351+0000 7fcc4021f700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc3815c360 con 0x7fcc380cb650 2023-11-08T19:29:55.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.351+0000 7fcc3e7bc700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fcc380ccf60 0x7fcc380cd3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:47482/0 (socket says 172.21.15.149:47482) 2023-11-08T19:29:55.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.351+0000 7fcc3e7bc700 1 -- 172.21.15.149:0/2365554251 learned_addr learned my addr 172.21.15.149:0/2365554251 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:29:55.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.352+0000 7fcc3cfb9700 1 -- 172.21.15.149:0/2365554251 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 427281653 0 0) 0x7fcc30001490 con 0x7fcc380ccf60 2023-11-08T19:29:55.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.352+0000 7fcc3dfbb700 1 --2- 172.21.15.149:0/2365554251 >> v2:172.21.15.160:3300/0 conn(0x7fcc380cb650 0x7fcc3806ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:55.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.352+0000 7fcc3cfb9700 1 -- 172.21.15.149:0/2365554251 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc240035b0 con 0x7fcc380ccf60 2023-11-08T19:29:55.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.352+0000 7fcc3cfb9700 1 -- 172.21.15.149:0/2365554251 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 59018519 0 0) 0x7fcc240035b0 con 0x7fcc380ccf60 2023-11-08T19:29:55.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.352+0000 7fcc3cfb9700 1 -- 172.21.15.149:0/2365554251 >> v2:172.21.15.160:3300/0 conn(0x7fcc380cb650 msgr2=0x7fcc3806ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:55.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.352+0000 7fcc3cfb9700 1 --2- 172.21.15.149:0/2365554251 >> v2:172.21.15.160:3300/0 conn(0x7fcc380cb650 0x7fcc3806ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:55.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.352+0000 7fcc3cfb9700 1 -- 172.21.15.149:0/2365554251 >> v1:172.21.15.160:6789/0 conn(0x7fcc3815be30 legacy=0x7fcc380b5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:55.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.352+0000 7fcc3cfb9700 1 -- 172.21.15.149:0/2365554251 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc3815c640 con 0x7fcc380ccf60 2023-11-08T19:29:55.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.352+0000 7fcc3cfb9700 1 -- 172.21.15.149:0/2365554251 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7fcc30001b80 con 0x7fcc380ccf60 2023-11-08T19:29:55.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.352+0000 7fcc3cfb9700 1 -- 172.21.15.149:0/2365554251 >> v1:172.21.15.149:6789/0 conn(0x7fcc380ccf60 legacy=0x7fcc380cd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:55.360 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.352+0000 7fcc3cfb9700 1 --2- 172.21.15.149:0/2365554251 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcc24003a00 0x7fcc24003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:55.360 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.352+0000 7fcc3cfb9700 1 --2- 172.21.15.149:0/2365554251 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc24004850 0x7fcc24004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:55.360 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.352+0000 7fcc3cfb9700 1 --2- 172.21.15.149:0/2365554251 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc24005210 0x7fcc2400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:55.360 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.352+0000 7fcc3cfb9700 1 -- 172.21.15.149:0/2365554251 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3815c360 con 0x7fcc24005210 2023-11-08T19:29:55.361 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.352+0000 7fcc3cfb9700 1 -- 172.21.15.149:0/2365554251 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2400c1b0 con 0x7fcc24004850 2023-11-08T19:29:55.361 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.352+0000 7fcc3cfb9700 1 -- 172.21.15.149:0/2365554251 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2400c370 con 0x7fcc24003a00 2023-11-08T19:29:55.361 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.352+0000 7fcc3e7bc700 1 --2- 172.21.15.149:0/2365554251 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc24005210 0x7fcc2400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:55.361 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.352+0000 7fcc3d7ba700 1 --2- 172.21.15.149:0/2365554251 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc24004850 0x7fcc24004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:55.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.352+0000 7fcc3dfbb700 1 --2- 172.21.15.149:0/2365554251 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcc24003a00 0x7fcc24003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:55.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.352+0000 7fcc3e7bc700 1 -- 172.21.15.149:0/2365554251 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcc24003a00 msgr2=0x7fcc24003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:55.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.352+0000 7fcc3e7bc700 1 --2- 172.21.15.149:0/2365554251 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcc24003a00 0x7fcc24003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:55.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.352+0000 7fcc3e7bc700 1 -- 172.21.15.149:0/2365554251 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc24004850 msgr2=0x7fcc24004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:55.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.352+0000 7fcc3e7bc700 1 --2- 172.21.15.149:0/2365554251 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc24004850 0x7fcc24004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:55.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.352+0000 7fcc3e7bc700 1 -- 172.21.15.149:0/2365554251 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc240035b0 con 0x7fcc24005210 2023-11-08T19:29:55.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.353+0000 7fcc3e7bc700 1 -- 172.21.15.149:0/2365554251 reap_dead start 2023-11-08T19:29:55.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.353+0000 7fcc3e7bc700 1 --2- 172.21.15.149:0/2365554251 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc24005210 0x7fcc2400ba10 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7fcc3000a830 tx=0x7fcc24005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d849a3b634374d1 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:55.364 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.353+0000 7fcc3cfb9700 1 -- 172.21.15.149:0/2365554251 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc3000a490 con 0x7fcc24005210 2023-11-08T19:29:55.364 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.353+0000 7fcc3cfb9700 1 -- 172.21.15.149:0/2365554251 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc30012620 con 0x7fcc24005210 2023-11-08T19:29:55.364 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.353+0000 7fcc3cfb9700 1 -- 172.21.15.149:0/2365554251 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc300129d0 con 0x7fcc24005210 2023-11-08T19:29:55.364 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.353+0000 7fcc4021f700 1 -- 172.21.15.149:0/2365554251 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc24005210 msgr2=0x7fcc2400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:55.365 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.353+0000 7fcc4021f700 1 --2- 172.21.15.149:0/2365554251 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc24005210 0x7fcc2400ba10 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7fcc3000a830 tx=0x7fcc24005880 comp rx=0 tx=0).stop 2023-11-08T19:29:55.365 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.353+0000 7fcc4021f700 1 -- 172.21.15.149:0/2365554251 shutdown_connections 2023-11-08T19:29:55.365 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.353+0000 7fcc4021f700 1 --2- 172.21.15.149:0/2365554251 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc24005210 0x7fcc2400ba10 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:55.365 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.353+0000 7fcc4021f700 1 -- 172.21.15.149:0/2365554251 >> 172.21.15.149:0/2365554251 conn(0x7fcc3806e0d0 msgr2=0x7fcc3806e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:55.366 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.353+0000 7fcc4021f700 1 -- 172.21.15.149:0/2365554251 shutdown_connections 2023-11-08T19:29:55.366 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.354+0000 7fcc4021f700 1 -- 172.21.15.149:0/2365554251 wait complete. 2023-11-08T19:29:55.366 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.355+0000 7fcc4021f700 1 Processor -- start 2023-11-08T19:29:55.366 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.355+0000 7fcc4021f700 1 -- start start 2023-11-08T19:29:55.370 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.356+0000 7fcc4021f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc24005210 0x7fcc380c7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:55.370 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.356+0000 7fcc4021f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc381514f0 0x7fcc38156fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:55.370 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.356+0000 7fcc4021f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcc380c9c20 0x7fcc380ca0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:55.370 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.356+0000 7fcc4021f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc380c8850 con 0x7fcc381514f0 2023-11-08T19:29:55.371 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.356+0000 7fcc4021f700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc38151970 con 0x7fcc24005210 2023-11-08T19:29:55.371 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.356+0000 7fcc4021f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc381552e0 con 0x7fcc380c9c20 2023-11-08T19:29:55.371 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.356+0000 7fcc3d7ba700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc381514f0 0x7fcc38156fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:55.371 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.356+0000 7fcc3d7ba700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc381514f0 0x7fcc38156fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45490/0 (socket says 172.21.15.149:45490) 2023-11-08T19:29:55.372 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.356+0000 7fcc3d7ba700 1 -- 172.21.15.149:0/3618567843 learned_addr learned my addr 172.21.15.149:0/3618567843 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:55.372 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.356+0000 7fcc3e7bc700 1 --2- 172.21.15.149:0/3618567843 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcc380c9c20 0x7fcc380ca0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:55.372 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.356+0000 7fcc3dfbb700 1 --2- 172.21.15.149:0/3618567843 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc24005210 0x7fcc380c7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:55.372 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.356+0000 7fcc3d7ba700 1 -- 172.21.15.149:0/3618567843 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcc380c9c20 msgr2=0x7fcc380ca0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:55.373 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.356+0000 7fcc3d7ba700 1 --2- 172.21.15.149:0/3618567843 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcc380c9c20 0x7fcc380ca0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:55.373 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.356+0000 7fcc3d7ba700 1 -- 172.21.15.149:0/3618567843 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc24005210 msgr2=0x7fcc380c7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:55.373 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.356+0000 7fcc3d7ba700 1 --2- 172.21.15.149:0/3618567843 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc24005210 0x7fcc380c7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:55.373 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.356+0000 7fcc3d7ba700 1 -- 172.21.15.149:0/3618567843 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc380c8570 con 0x7fcc381514f0 2023-11-08T19:29:55.373 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.356+0000 7fcc3e7bc700 1 --2- 172.21.15.149:0/3618567843 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcc380c9c20 0x7fcc380ca0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:29:55.374 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.356+0000 7fcc3dfbb700 1 --2- 172.21.15.149:0/3618567843 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc24005210 0x7fcc380c7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:29:55.374 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.357+0000 7fcc3d7ba700 1 --2- 172.21.15.149:0/3618567843 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc381514f0 0x7fcc38156fc0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7fcc3400f5c0 tx=0x7fcc3400f980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:55.374 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.357+0000 7fcc2e7fc700 1 -- 172.21.15.149:0/3618567843 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc34017070 con 0x7fcc381514f0 2023-11-08T19:29:55.374 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.357+0000 7fcc2e7fc700 1 -- 172.21.15.149:0/3618567843 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc340052e0 con 0x7fcc381514f0 2023-11-08T19:29:55.375 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.357+0000 7fcc4021f700 1 -- 172.21.15.149:0/3618567843 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc381554f0 con 0x7fcc381514f0 2023-11-08T19:29:55.375 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.357+0000 7fcc2e7fc700 1 -- 172.21.15.149:0/3618567843 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc34005490 con 0x7fcc381514f0 2023-11-08T19:29:55.375 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.357+0000 7fcc4021f700 1 -- 172.21.15.149:0/3618567843 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc380ca5e0 con 0x7fcc381514f0 2023-11-08T19:29:55.375 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.358+0000 7fcc4021f700 1 -- 172.21.15.149:0/3618567843 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc38155a10 con 0x7fcc381514f0 2023-11-08T19:29:55.375 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.358+0000 7fcc2e7fc700 1 -- 172.21.15.149:0/3618567843 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcc34006860 con 0x7fcc381514f0 2023-11-08T19:29:55.376 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.358+0000 7fcc2e7fc700 1 --2- 172.21.15.149:0/3618567843 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fcc1c06af00 0x7fcc1c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:55.376 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.358+0000 7fcc2e7fc700 1 -- 172.21.15.149:0/3618567843 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7737+0+0 (secure 0 0 0) 0x7fcc34089350 con 0x7fcc381514f0 2023-11-08T19:29:55.376 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.358+0000 7fcc3dfbb700 1 --2- 172.21.15.149:0/3618567843 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fcc1c06af00 0x7fcc1c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:55.376 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.359+0000 7fcc3dfbb700 1 --2- 172.21.15.149:0/3618567843 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fcc1c06af00 0x7fcc1c06d3c0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fcc28009be0 tx=0x7fcc28008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:55.376 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.363+0000 7fcc2e7fc700 1 -- 172.21.15.149:0/3618567843 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcc34053ca0 con 0x7fcc381514f0 2023-11-08T19:29:55.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.552+0000 7fcc4021f700 1 -- 172.21.15.149:0/3618567843 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7fcc3815a140 con 0x7fcc381514f0 2023-11-08T19:29:55.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.553+0000 7fcc2e7fc700 1 -- 172.21.15.149:0/3618567843 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v108) v1 ==== 103+0+11 (secure 0 0 0) 0x7fcc340572c0 con 0x7fcc381514f0 2023-11-08T19:29:55.555 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:29:55.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.555+0000 7fcc4021f700 1 -- 172.21.15.149:0/3618567843 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fcc1c06af00 msgr2=0x7fcc1c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:55.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.555+0000 7fcc4021f700 1 --2- 172.21.15.149:0/3618567843 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fcc1c06af00 0x7fcc1c06d3c0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fcc28009be0 tx=0x7fcc28008040 comp rx=0 tx=0).stop 2023-11-08T19:29:55.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.555+0000 7fcc4021f700 1 -- 172.21.15.149:0/3618567843 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc381514f0 msgr2=0x7fcc38156fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:55.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.555+0000 7fcc4021f700 1 --2- 172.21.15.149:0/3618567843 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc381514f0 0x7fcc38156fc0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7fcc3400f5c0 tx=0x7fcc3400f980 comp rx=0 tx=0).stop 2023-11-08T19:29:55.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.555+0000 7fcc4021f700 1 -- 172.21.15.149:0/3618567843 shutdown_connections 2023-11-08T19:29:55.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.555+0000 7fcc4021f700 1 --2- 172.21.15.149:0/3618567843 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fcc1c06af00 0x7fcc1c06d3c0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:55.558 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.555+0000 7fcc4021f700 1 --2- 172.21.15.149:0/3618567843 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc24005210 0x7fcc380c7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:55.558 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.555+0000 7fcc4021f700 1 --2- 172.21.15.149:0/3618567843 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcc380c9c20 0x7fcc380ca0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:55.558 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.555+0000 7fcc4021f700 1 --2- 172.21.15.149:0/3618567843 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc381514f0 0x7fcc38156fc0 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:55.558 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.555+0000 7fcc4021f700 1 -- 172.21.15.149:0/3618567843 >> 172.21.15.149:0/3618567843 conn(0x7fcc3806e0d0 msgr2=0x7fcc380ce570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:55.558 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.555+0000 7fcc4021f700 1 -- 172.21.15.149:0/3618567843 shutdown_connections 2023-11-08T19:29:55.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.555+0000 7fcc4021f700 1 -- 172.21.15.149:0/3618567843 wait complete. 2023-11-08T19:29:55.568 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-08T19:29:55.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.691+0000 7fabf3f95700 1 Processor -- start 2023-11-08T19:29:55.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.691+0000 7fabf3f95700 1 -- start start 2023-11-08T19:29:55.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.692+0000 7fabf3f95700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fabec15da00 0x7fabec15bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:55.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.692+0000 7fabf3f95700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabec15f740 con 0x7fabec0cdc30 2023-11-08T19:29:55.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.692+0000 7fabf3f95700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabec0ce090 con 0x7fabec0cc990 2023-11-08T19:29:55.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.692+0000 7fabf3f95700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabec15c480 con 0x7fabec15da00 2023-11-08T19:29:55.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.692+0000 7fabf1530700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fabec0cdc30 0x7fabec15d2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:47500/0 (socket says 172.21.15.149:47500) 2023-11-08T19:29:55.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.692+0000 7fabf1530700 1 -- 172.21.15.149:0/881087016 learned_addr learned my addr 172.21.15.149:0/881087016 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:29:55.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.692+0000 7fabf0d2f700 1 -- 172.21.15.149:0/881087016 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2232251295 0 0) 0x7fabec15f740 con 0x7fabec0cdc30 2023-11-08T19:29:55.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.692+0000 7fabf0d2f700 1 -- 172.21.15.149:0/881087016 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabd80035b0 con 0x7fabec0cdc30 2023-11-08T19:29:55.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.692+0000 7fabf2532700 1 --2- 172.21.15.149:0/881087016 >> v2:172.21.15.160:3300/0 conn(0x7fabec15da00 0x7fabec15bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:55.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.692+0000 7fabf0d2f700 1 -- 172.21.15.149:0/881087016 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3477103050 0 0) 0x7fabd80035b0 con 0x7fabec0cdc30 2023-11-08T19:29:55.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.692+0000 7fabf0d2f700 1 -- 172.21.15.149:0/881087016 >> v2:172.21.15.160:3300/0 conn(0x7fabec15da00 msgr2=0x7fabec15bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:55.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.692+0000 7fabf0d2f700 1 --2- 172.21.15.149:0/881087016 >> v2:172.21.15.160:3300/0 conn(0x7fabec15da00 0x7fabec15bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:55.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.692+0000 7fabf0d2f700 1 -- 172.21.15.149:0/881087016 >> v1:172.21.15.160:6789/0 conn(0x7fabec0cc990 legacy=0x7fabec15fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:55.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.692+0000 7fabf0d2f700 1 -- 172.21.15.149:0/881087016 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabec15c690 con 0x7fabec0cdc30 2023-11-08T19:29:55.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.692+0000 7fabf0d2f700 1 -- 172.21.15.149:0/881087016 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7fabdc001670 con 0x7fabec0cdc30 2023-11-08T19:29:55.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.692+0000 7fabf0d2f700 1 -- 172.21.15.149:0/881087016 >> v1:172.21.15.149:6789/0 conn(0x7fabec0cdc30 legacy=0x7fabec15d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:55.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.693+0000 7fabf0d2f700 1 --2- 172.21.15.149:0/881087016 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fabd8003a00 0x7fabd8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:55.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.693+0000 7fabf0d2f700 1 --2- 172.21.15.149:0/881087016 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fabd8004850 0x7fabd8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:55.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.693+0000 7fabf0d2f700 1 --2- 172.21.15.149:0/881087016 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabd8005210 0x7fabd800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:55.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.693+0000 7fabf0d2f700 1 -- 172.21.15.149:0/881087016 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabec15c480 con 0x7fabd8005210 2023-11-08T19:29:55.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.693+0000 7fabf0d2f700 1 -- 172.21.15.149:0/881087016 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd800c0b0 con 0x7fabd8004850 2023-11-08T19:29:55.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.693+0000 7fabf0d2f700 1 -- 172.21.15.149:0/881087016 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabd800c270 con 0x7fabd8003a00 2023-11-08T19:29:55.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.693+0000 7fabf2532700 1 --2- 172.21.15.149:0/881087016 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabd8005210 0x7fabd800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:55.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.693+0000 7fabf1530700 1 --2- 172.21.15.149:0/881087016 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fabd8004850 0x7fabd8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:55.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.693+0000 7fabf1d31700 1 --2- 172.21.15.149:0/881087016 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fabd8003a00 0x7fabd8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:55.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.693+0000 7fabf2532700 1 -- 172.21.15.149:0/881087016 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fabd8003a00 msgr2=0x7fabd8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:55.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.693+0000 7fabf2532700 1 --2- 172.21.15.149:0/881087016 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fabd8003a00 0x7fabd8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:55.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.693+0000 7fabf2532700 1 -- 172.21.15.149:0/881087016 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fabd8004850 msgr2=0x7fabd8004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:55.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.693+0000 7fabf2532700 1 --2- 172.21.15.149:0/881087016 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fabd8004850 0x7fabd8004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:55.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.693+0000 7fabf2532700 1 -- 172.21.15.149:0/881087016 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd80035b0 con 0x7fabd8005210 2023-11-08T19:29:55.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.693+0000 7fabf2532700 1 -- 172.21.15.149:0/881087016 reap_dead start 2023-11-08T19:29:55.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.693+0000 7fabf2532700 1 --2- 172.21.15.149:0/881087016 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabd8005210 0x7fabd800ba10 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7fabe4009f90 tx=0x7fabd8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fc0d6e8dbb7bc93 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:55.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.693+0000 7fabf0d2f700 1 -- 172.21.15.149:0/881087016 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe400ec30 con 0x7fabd8005210 2023-11-08T19:29:55.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.693+0000 7fabf0d2f700 1 -- 172.21.15.149:0/881087016 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabe400f040 con 0x7fabd8005210 2023-11-08T19:29:55.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.693+0000 7fabf0d2f700 1 -- 172.21.15.149:0/881087016 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe4014480 con 0x7fabd8005210 2023-11-08T19:29:55.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.694+0000 7fabf3f95700 1 -- 172.21.15.149:0/881087016 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabd8005210 msgr2=0x7fabd800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:55.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.694+0000 7fabf3f95700 1 --2- 172.21.15.149:0/881087016 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabd8005210 0x7fabd800ba10 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7fabe4009f90 tx=0x7fabd8005880 comp rx=0 tx=0).stop 2023-11-08T19:29:55.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.694+0000 7fabf3f95700 1 -- 172.21.15.149:0/881087016 shutdown_connections 2023-11-08T19:29:55.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.694+0000 7fabf3f95700 1 --2- 172.21.15.149:0/881087016 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabd8005210 0x7fabd800ba10 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:55.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.694+0000 7fabf3f95700 1 -- 172.21.15.149:0/881087016 >> 172.21.15.149:0/881087016 conn(0x7fabec072680 msgr2=0x7fabec099a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:55.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.694+0000 7fabf3f95700 1 -- 172.21.15.149:0/881087016 shutdown_connections 2023-11-08T19:29:55.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.694+0000 7fabf3f95700 1 -- 172.21.15.149:0/881087016 wait complete. 2023-11-08T19:29:55.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.695+0000 7fabf3f95700 1 Processor -- start 2023-11-08T19:29:55.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.695+0000 7fabf3f95700 1 -- start start 2023-11-08T19:29:55.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.696+0000 7fabf3f95700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fabd8005210 0x7fabec1f2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:55.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.696+0000 7fabf3f95700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabec1f5a60 0x7fabec0b0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:55.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.696+0000 7fabf3f95700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fabec0adea0 0x7fabec0c8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:55.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.696+0000 7fabf3f95700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabec0ae720 con 0x7fabec1f5a60 2023-11-08T19:29:55.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.696+0000 7fabf3f95700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabec1f27b0 con 0x7fabec0adea0 2023-11-08T19:29:55.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.696+0000 7fabf3f95700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabec0ae440 con 0x7fabd8005210 2023-11-08T19:29:55.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.696+0000 7fabf1530700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabec1f5a60 0x7fabec0b0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:55.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.696+0000 7fabf1530700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabec1f5a60 0x7fabec0b0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45510/0 (socket says 172.21.15.149:45510) 2023-11-08T19:29:55.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.696+0000 7fabf1530700 1 -- 172.21.15.149:0/1827369165 learned_addr learned my addr 172.21.15.149:0/1827369165 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:55.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.696+0000 7fabf1d31700 1 --2- 172.21.15.149:0/1827369165 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fabd8005210 0x7fabec1f2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:55.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.696+0000 7fabf2532700 1 --2- 172.21.15.149:0/1827369165 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fabec0adea0 0x7fabec0c8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:55.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.696+0000 7fabf1530700 1 -- 172.21.15.149:0/1827369165 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fabd8005210 msgr2=0x7fabec1f2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:55.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.696+0000 7fabf1530700 1 --2- 172.21.15.149:0/1827369165 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fabd8005210 0x7fabec1f2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:55.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.696+0000 7fabf1530700 1 -- 172.21.15.149:0/1827369165 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fabec0adea0 msgr2=0x7fabec0c8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:55.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.696+0000 7fabf1530700 1 --2- 172.21.15.149:0/1827369165 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fabec0adea0 0x7fabec0c8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:55.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.696+0000 7fabf1530700 1 -- 172.21.15.149:0/1827369165 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabec1f4f80 con 0x7fabec1f5a60 2023-11-08T19:29:55.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.696+0000 7fabf1530700 1 --2- 172.21.15.149:0/1827369165 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabec1f5a60 0x7fabec0b0f90 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7fabdc0072c0 tx=0x7fabdc0075d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:55.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.696+0000 7fabe27fc700 1 -- 172.21.15.149:0/1827369165 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabdc011580 con 0x7fabec1f5a60 2023-11-08T19:29:55.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.696+0000 7fabe27fc700 1 -- 172.21.15.149:0/1827369165 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabdc0116e0 con 0x7fabec1f5a60 2023-11-08T19:29:55.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.696+0000 7fabe27fc700 1 -- 172.21.15.149:0/1827369165 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabdc011a50 con 0x7fabec1f5a60 2023-11-08T19:29:55.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.697+0000 7fabf3f95700 1 -- 172.21.15.149:0/1827369165 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabec1f5260 con 0x7fabec1f5a60 2023-11-08T19:29:55.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.697+0000 7fabf3f95700 1 -- 172.21.15.149:0/1827369165 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabec0b14d0 con 0x7fabec1f5a60 2023-11-08T19:29:55.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.697+0000 7fabf3f95700 1 -- 172.21.15.149:0/1827369165 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabec1f4de0 con 0x7fabec1f5a60 2023-11-08T19:29:55.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.698+0000 7fabe27fc700 1 -- 172.21.15.149:0/1827369165 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fabdc011bb0 con 0x7fabec1f5a60 2023-11-08T19:29:55.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.698+0000 7fabe27fc700 1 --2- 172.21.15.149:0/1827369165 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fabd006af00 0x7fabd006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:55.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.698+0000 7fabe27fc700 1 -- 172.21.15.149:0/1827369165 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7737+0+0 (secure 0 0 0) 0x7fabdc0896d0 con 0x7fabec1f5a60 2023-11-08T19:29:55.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.698+0000 7fabf1d31700 1 --2- 172.21.15.149:0/1827369165 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fabd006af00 0x7fabd006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:55.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.699+0000 7fabf1d31700 1 --2- 172.21.15.149:0/1827369165 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fabd006af00 0x7fabd006d3c0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fabec1535e0 tx=0x7fabe8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:55.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.703+0000 7fabe27fc700 1 -- 172.21.15.149:0/1827369165 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fabec1f4de0 con 0x7fabec1f5a60 2023-11-08T19:29:55.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.892+0000 7fabf3f95700 1 -- 172.21.15.149:0/1827369165 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7fabec1f5780 con 0x7fabec1f5a60 2023-11-08T19:29:55.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.892+0000 7fabe27fc700 1 -- 172.21.15.149:0/1827369165 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v108) v1 ==== 103+0+11 (secure 0 0 0) 0x7fabdc019020 con 0x7fabec1f5a60 2023-11-08T19:29:55.894 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:29:55.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.894+0000 7fabf3f95700 1 -- 172.21.15.149:0/1827369165 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fabd006af00 msgr2=0x7fabd006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:55.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.894+0000 7fabf3f95700 1 --2- 172.21.15.149:0/1827369165 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fabd006af00 0x7fabd006d3c0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fabec1535e0 tx=0x7fabe8009040 comp rx=0 tx=0).stop 2023-11-08T19:29:55.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.894+0000 7fabf3f95700 1 -- 172.21.15.149:0/1827369165 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabec1f5a60 msgr2=0x7fabec0b0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:55.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.894+0000 7fabf3f95700 1 --2- 172.21.15.149:0/1827369165 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabec1f5a60 0x7fabec0b0f90 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7fabdc0072c0 tx=0x7fabdc0075d0 comp rx=0 tx=0).stop 2023-11-08T19:29:55.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.894+0000 7fabf3f95700 1 -- 172.21.15.149:0/1827369165 shutdown_connections 2023-11-08T19:29:55.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.894+0000 7fabf3f95700 1 --2- 172.21.15.149:0/1827369165 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fabd006af00 0x7fabd006d3c0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:55.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.894+0000 7fabf3f95700 1 --2- 172.21.15.149:0/1827369165 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fabec0adea0 0x7fabec0c8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:55.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.894+0000 7fabf3f95700 1 --2- 172.21.15.149:0/1827369165 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fabd8005210 0x7fabec1f2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:55.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.894+0000 7fabf3f95700 1 --2- 172.21.15.149:0/1827369165 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabec1f5a60 0x7fabec0b0f90 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:55.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.894+0000 7fabf3f95700 1 -- 172.21.15.149:0/1827369165 >> 172.21.15.149:0/1827369165 conn(0x7fabec072680 msgr2=0x7fabec06ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:55.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.895+0000 7fabf3f95700 1 -- 172.21.15.149:0/1827369165 shutdown_connections 2023-11-08T19:29:55.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:55.895+0000 7fabf3f95700 1 -- 172.21.15.149:0/1827369165 wait complete. 2023-11-08T19:29:55.908 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-08T19:29:56.032 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.031+0000 7f41eb395700 1 Processor -- start 2023-11-08T19:29:56.032 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.031+0000 7f41eb395700 1 -- start start 2023-11-08T19:29:56.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.032+0000 7f41eb395700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f41e415d900 0x7f41e406ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:56.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.032+0000 7f41eb395700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f41e40cd0b0 0x7f41e40cd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:56.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.032+0000 7f41eb395700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41e40cb1a0 con 0x7f41e40ce530 2023-11-08T19:29:56.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.032+0000 7f41eb395700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41e40cda20 con 0x7f41e415d900 2023-11-08T19:29:56.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.032+0000 7f41eb395700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41e40cea60 con 0x7f41e40cd0b0 2023-11-08T19:29:56.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.032+0000 7f41e9131700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f41e415d900 0x7f41e406ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:56.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.032+0000 7f41e9131700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f41e415d900 0x7f41e406ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45516/0 (socket says 172.21.15.149:45516) 2023-11-08T19:29:56.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.032+0000 7f41e9131700 1 -- 172.21.15.149:0/931783314 learned_addr learned my addr 172.21.15.149:0/931783314 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:56.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.032+0000 7f41e9932700 1 --2- 172.21.15.149:0/931783314 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f41e40cd0b0 0x7f41e40cd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:56.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.032+0000 7f41e9131700 1 -- 172.21.15.149:0/931783314 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f41e40cd0b0 msgr2=0x7f41e40cd4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:56.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.032+0000 7f41e9131700 1 --2- 172.21.15.149:0/931783314 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f41e40cd0b0 0x7f41e40cd4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:56.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.032+0000 7f41e9131700 1 -- 172.21.15.149:0/931783314 >> v1:172.21.15.149:6789/0 conn(0x7f41e40ce530 legacy=0x7f41e4072ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:56.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.032+0000 7f41e9131700 1 -- 172.21.15.149:0/931783314 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e40ced40 con 0x7f41e415d900 2023-11-08T19:29:56.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.032+0000 7f41e9131700 1 --2- 172.21.15.149:0/931783314 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41e415d900 0x7f41e406ab20 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f41d40098f0 tx=0x7f41d4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a1e88530c983a36 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:56.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.032+0000 7f41dbfff700 1 -- 172.21.15.149:0/931783314 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d400b8a0 con 0x7f41e415d900 2023-11-08T19:29:56.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.032+0000 7f41dbfff700 1 -- 172.21.15.149:0/931783314 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d400ba00 con 0x7f41e415d900 2023-11-08T19:29:56.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.032+0000 7f41dbfff700 1 -- 172.21.15.149:0/931783314 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d400bd90 con 0x7f41e415d900 2023-11-08T19:29:56.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.033+0000 7f41eb395700 1 -- 172.21.15.149:0/931783314 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41e415d900 msgr2=0x7f41e406ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:56.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.033+0000 7f41eb395700 1 --2- 172.21.15.149:0/931783314 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41e415d900 0x7f41e406ab20 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f41d40098f0 tx=0x7f41d4009c00 comp rx=0 tx=0).stop 2023-11-08T19:29:56.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.033+0000 7f41eb395700 1 -- 172.21.15.149:0/931783314 shutdown_connections 2023-11-08T19:29:56.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.033+0000 7f41eb395700 1 --2- 172.21.15.149:0/931783314 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f41e40cd0b0 0x7f41e40cd4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:56.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.033+0000 7f41eb395700 1 --2- 172.21.15.149:0/931783314 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41e415d900 0x7f41e406ab20 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:56.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.033+0000 7f41eb395700 1 -- 172.21.15.149:0/931783314 >> 172.21.15.149:0/931783314 conn(0x7f41e406e0d0 msgr2=0x7f41e406e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:56.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.033+0000 7f41eb395700 1 -- 172.21.15.149:0/931783314 shutdown_connections 2023-11-08T19:29:56.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.033+0000 7f41eb395700 1 -- 172.21.15.149:0/931783314 wait complete. 2023-11-08T19:29:56.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.034+0000 7f41eb395700 1 Processor -- start 2023-11-08T19:29:56.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.034+0000 7f41eb395700 1 -- start start 2023-11-08T19:29:56.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.035+0000 7f41eb395700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f41e40cd0b0 0x7f41e415bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:56.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.035+0000 7f41eb395700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f41e40ce530 0x7f41e40c6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:56.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.035+0000 7f41eb395700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41e415d900 0x7f41e40c9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:56.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.035+0000 7f41eb395700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e415e310 con 0x7f41e415d900 2023-11-08T19:29:56.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.035+0000 7f41eb395700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e415dce0 con 0x7f41e40ce530 2023-11-08T19:29:56.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.035+0000 7f41eb395700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41e415caf0 con 0x7f41e40cd0b0 2023-11-08T19:29:56.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.035+0000 7f41e9932700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41e415d900 0x7f41e40c9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:56.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.035+0000 7f41e9932700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41e415d900 0x7f41e40c9960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45526/0 (socket says 172.21.15.149:45526) 2023-11-08T19:29:56.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.035+0000 7f41e9932700 1 -- 172.21.15.149:0/3034177946 learned_addr learned my addr 172.21.15.149:0/3034177946 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:56.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.035+0000 7f41e9131700 1 --2- 172.21.15.149:0/3034177946 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f41e40cd0b0 0x7f41e415bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:56.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.035+0000 7f41e9932700 1 -- 172.21.15.149:0/3034177946 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f41e40cd0b0 msgr2=0x7f41e415bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:56.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.035+0000 7f41e9932700 1 --2- 172.21.15.149:0/3034177946 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f41e40cd0b0 0x7f41e415bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:56.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.035+0000 7f41e9932700 1 -- 172.21.15.149:0/3034177946 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f41e40ce530 msgr2=0x7f41e40c6fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:56.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.035+0000 7f41e9932700 1 --2- 172.21.15.149:0/3034177946 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f41e40ce530 0x7f41e40c6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:56.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.035+0000 7f41e9932700 1 -- 172.21.15.149:0/3034177946 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d4009550 con 0x7f41e415d900 2023-11-08T19:29:56.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.036+0000 7f41e9932700 1 --2- 172.21.15.149:0/3034177946 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41e415d900 0x7f41e40c9960 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f41dc00cc80 tx=0x7f41dc00a4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:56.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.036+0000 7f41d9ffb700 1 -- 172.21.15.149:0/3034177946 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41dc00ce20 con 0x7f41e415d900 2023-11-08T19:29:56.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.036+0000 7f41d9ffb700 1 -- 172.21.15.149:0/3034177946 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41dc00ad30 con 0x7f41e415d900 2023-11-08T19:29:56.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.036+0000 7f41eb395700 1 -- 172.21.15.149:0/3034177946 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41e40c7520 con 0x7f41e415d900 2023-11-08T19:29:56.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.036+0000 7f41d9ffb700 1 -- 172.21.15.149:0/3034177946 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41dc00aea0 con 0x7f41e415d900 2023-11-08T19:29:56.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.036+0000 7f41eb395700 1 -- 172.21.15.149:0/3034177946 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41e40b5d40 con 0x7f41e415d900 2023-11-08T19:29:56.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.037+0000 7f41eb395700 1 -- 172.21.15.149:0/3034177946 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41e415e450 con 0x7f41e415d900 2023-11-08T19:29:56.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.037+0000 7f41d9ffb700 1 -- 172.21.15.149:0/3034177946 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f41dc00f3f0 con 0x7f41e415d900 2023-11-08T19:29:56.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.038+0000 7f41d9ffb700 1 --2- 172.21.15.149:0/3034177946 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f41c806af30 0x7f41c806d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:56.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.038+0000 7f41d9ffb700 1 -- 172.21.15.149:0/3034177946 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7737+0+0 (secure 0 0 0) 0x7f41dc089f30 con 0x7f41e415d900 2023-11-08T19:29:56.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.038+0000 7f41e9131700 1 --2- 172.21.15.149:0/3034177946 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f41c806af30 0x7f41c806d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:56.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.038+0000 7f41e9131700 1 --2- 172.21.15.149:0/3034177946 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f41c806af30 0x7f41c806d3f0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f41d4009c40 tx=0x7f41d4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:56.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.043+0000 7f41d9ffb700 1 -- 172.21.15.149:0/3034177946 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f41e415e450 con 0x7f41e415d900 2023-11-08T19:29:56.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.239+0000 7f41eb395700 1 -- 172.21.15.149:0/3034177946 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7f41e415e450 con 0x7f41e415d900 2023-11-08T19:29:56.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.239+0000 7f41d9ffb700 1 -- 172.21.15.149:0/3034177946 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v108) v1 ==== 107+0+11 (secure 0 0 0) 0x7f41e415e450 con 0x7f41e415d900 2023-11-08T19:29:56.241 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:29:56.243 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.241+0000 7f41eb395700 1 -- 172.21.15.149:0/3034177946 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f41c806af30 msgr2=0x7f41c806d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:56.243 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.241+0000 7f41eb395700 1 --2- 172.21.15.149:0/3034177946 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f41c806af30 0x7f41c806d3f0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f41d4009c40 tx=0x7f41d4008030 comp rx=0 tx=0).stop 2023-11-08T19:29:56.243 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.241+0000 7f41eb395700 1 -- 172.21.15.149:0/3034177946 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41e415d900 msgr2=0x7f41e40c9960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:56.244 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.241+0000 7f41eb395700 1 --2- 172.21.15.149:0/3034177946 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41e415d900 0x7f41e40c9960 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f41dc00cc80 tx=0x7f41dc00a4d0 comp rx=0 tx=0).stop 2023-11-08T19:29:56.244 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.241+0000 7f41eb395700 1 -- 172.21.15.149:0/3034177946 shutdown_connections 2023-11-08T19:29:56.244 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.241+0000 7f41eb395700 1 --2- 172.21.15.149:0/3034177946 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f41c806af30 0x7f41c806d3f0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:56.244 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.241+0000 7f41eb395700 1 --2- 172.21.15.149:0/3034177946 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41e415d900 0x7f41e40c9960 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:56.244 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.241+0000 7f41eb395700 1 --2- 172.21.15.149:0/3034177946 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f41e40cd0b0 0x7f41e415bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:56.245 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.241+0000 7f41eb395700 1 --2- 172.21.15.149:0/3034177946 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f41e40ce530 0x7f41e40c6fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:56.245 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.241+0000 7f41eb395700 1 -- 172.21.15.149:0/3034177946 >> 172.21.15.149:0/3034177946 conn(0x7f41e406e0d0 msgr2=0x7f41e40b18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:56.245 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.241+0000 7f41eb395700 1 -- 172.21.15.149:0/3034177946 shutdown_connections 2023-11-08T19:29:56.245 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.241+0000 7f41eb395700 1 -- 172.21.15.149:0/3034177946 wait complete. 2023-11-08T19:29:56.254 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-08T19:29:56.378 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.377+0000 7fefae6e2700 1 Processor -- start 2023-11-08T19:29:56.379 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.377+0000 7fefae6e2700 1 -- start start 2023-11-08T19:29:56.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.378+0000 7fefae6e2700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fefa815db00 0x7fefa80cbec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:56.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.378+0000 7fefae6e2700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fefa815dee0 0x7fefa8072a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:56.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.378+0000 7fefae6e2700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefa806bdd0 con 0x7fefa8072f70 2023-11-08T19:29:56.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.378+0000 7fefae6e2700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefa80cc400 con 0x7fefa815db00 2023-11-08T19:29:56.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.378+0000 7fefae6e2700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefa806c070 con 0x7fefa815dee0 2023-11-08T19:29:56.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.378+0000 7fefa7fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fefa815db00 0x7fefa80cbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:56.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.378+0000 7fefa7fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fefa815db00 0x7fefa80cbec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45530/0 (socket says 172.21.15.149:45530) 2023-11-08T19:29:56.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.378+0000 7fefa7fff700 1 -- 172.21.15.149:0/2748564676 learned_addr learned my addr 172.21.15.149:0/2748564676 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:56.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.379+0000 7fefa77fe700 1 --2- 172.21.15.149:0/2748564676 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fefa815dee0 0x7fefa8072a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:56.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.379+0000 7fefa7fff700 1 -- 172.21.15.149:0/2748564676 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fefa815dee0 msgr2=0x7fefa8072a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:56.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.379+0000 7fefa7fff700 1 --2- 172.21.15.149:0/2748564676 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fefa815dee0 0x7fefa8072a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:56.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.379+0000 7fefa7fff700 1 -- 172.21.15.149:0/2748564676 >> v1:172.21.15.160:6789/0 conn(0x7fefa8072f70 legacy=0x7fefa80cd0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:56.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.379+0000 7fefa7fff700 1 -- 172.21.15.149:0/2748564676 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefa806c350 con 0x7fefa815db00 2023-11-08T19:29:56.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.379+0000 7fefa7fff700 1 --2- 172.21.15.149:0/2748564676 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fefa815db00 0x7fefa80cbec0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7fef980098f0 tx=0x7fef98009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d49cfa31496b1163 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:56.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.379+0000 7fefa6ffd700 1 -- 172.21.15.149:0/2748564676 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef98011830 con 0x7fefa815db00 2023-11-08T19:29:56.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.379+0000 7fefa6ffd700 1 -- 172.21.15.149:0/2748564676 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef98011990 con 0x7fefa815db00 2023-11-08T19:29:56.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.379+0000 7fefa6ffd700 1 -- 172.21.15.149:0/2748564676 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef98011d20 con 0x7fefa815db00 2023-11-08T19:29:56.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.380+0000 7fefae6e2700 1 -- 172.21.15.149:0/2748564676 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fefa815db00 msgr2=0x7fefa80cbec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:56.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.380+0000 7fefae6e2700 1 --2- 172.21.15.149:0/2748564676 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fefa815db00 0x7fefa80cbec0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7fef980098f0 tx=0x7fef98009c00 comp rx=0 tx=0).stop 2023-11-08T19:29:56.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.380+0000 7fefae6e2700 1 -- 172.21.15.149:0/2748564676 shutdown_connections 2023-11-08T19:29:56.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.380+0000 7fefae6e2700 1 --2- 172.21.15.149:0/2748564676 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fefa815db00 0x7fefa80cbec0 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:56.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.380+0000 7fefae6e2700 1 --2- 172.21.15.149:0/2748564676 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fefa815dee0 0x7fefa8072a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:56.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.380+0000 7fefae6e2700 1 -- 172.21.15.149:0/2748564676 >> 172.21.15.149:0/2748564676 conn(0x7fefa806e0d0 msgr2=0x7fefa806e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:56.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.380+0000 7fefae6e2700 1 -- 172.21.15.149:0/2748564676 shutdown_connections 2023-11-08T19:29:56.387 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.380+0000 7fefae6e2700 1 -- 172.21.15.149:0/2748564676 wait complete. 2023-11-08T19:29:56.389 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.381+0000 7fefae6e2700 1 Processor -- start 2023-11-08T19:29:56.389 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.381+0000 7fefae6e2700 1 -- start start 2023-11-08T19:29:56.390 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.382+0000 7fefae6e2700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fefa8072f70 0x7fefa81f3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:56.390 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.382+0000 7fefae6e2700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fefa815db00 0x7fefa80ca010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:56.390 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.382+0000 7fefae6e2700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fefa815dee0 0x7fefa81f69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:56.390 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.382+0000 7fefae6e2700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa80b4f60 con 0x7fefa8072f70 2023-11-08T19:29:56.390 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.382+0000 7fefae6e2700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa80ca550 con 0x7fefa815dee0 2023-11-08T19:29:56.391 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.382+0000 7fefae6e2700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefa81f6f20 con 0x7fefa815db00 2023-11-08T19:29:56.391 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.382+0000 7fefa7fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fefa8072f70 0x7fefa81f3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:56.391 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.382+0000 7fefa7fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fefa8072f70 0x7fefa81f3400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45536/0 (socket says 172.21.15.149:45536) 2023-11-08T19:29:56.391 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.382+0000 7fefa7fff700 1 -- 172.21.15.149:0/582415975 learned_addr learned my addr 172.21.15.149:0/582415975 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:56.391 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.382+0000 7fefa7fff700 1 -- 172.21.15.149:0/582415975 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fefa815db00 msgr2=0x7fefa80ca010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:56.392 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.382+0000 7fefa7fff700 1 --2- 172.21.15.149:0/582415975 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fefa815db00 0x7fefa80ca010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:56.392 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.382+0000 7fefa7fff700 1 -- 172.21.15.149:0/582415975 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fefa815dee0 msgr2=0x7fefa81f69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:56.392 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.382+0000 7fefa7fff700 1 --2- 172.21.15.149:0/582415975 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fefa815dee0 0x7fefa81f69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:56.392 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.382+0000 7fefa7fff700 1 -- 172.21.15.149:0/582415975 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef98009550 con 0x7fefa8072f70 2023-11-08T19:29:56.392 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.382+0000 7fefa7fff700 1 --2- 172.21.15.149:0/582415975 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fefa8072f70 0x7fefa81f3400 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7fef98000c00 tx=0x7fef98004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:56.393 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.382+0000 7fefa4ff9700 1 -- 172.21.15.149:0/582415975 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef98004570 con 0x7fefa8072f70 2023-11-08T19:29:56.393 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.382+0000 7fefa4ff9700 1 -- 172.21.15.149:0/582415975 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef9801f070 con 0x7fefa8072f70 2023-11-08T19:29:56.393 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.382+0000 7fefae6e2700 1 -- 172.21.15.149:0/582415975 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefa81f71c0 con 0x7fefa8072f70 2023-11-08T19:29:56.393 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.382+0000 7fefa4ff9700 1 -- 172.21.15.149:0/582415975 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef980038c0 con 0x7fefa8072f70 2023-11-08T19:29:56.393 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.383+0000 7fefae6e2700 1 -- 172.21.15.149:0/582415975 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefa81f7780 con 0x7fefa8072f70 2023-11-08T19:29:56.393 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.383+0000 7fefae6e2700 1 -- 172.21.15.149:0/582415975 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefa81f7940 con 0x7fefa8072f70 2023-11-08T19:29:56.394 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.384+0000 7fefa4ff9700 1 -- 172.21.15.149:0/582415975 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fef98021030 con 0x7fefa8072f70 2023-11-08T19:29:56.394 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.384+0000 7fefa4ff9700 1 --2- 172.21.15.149:0/582415975 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fef9406af00 0x7fef9406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:56.394 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.384+0000 7fefa4ff9700 1 -- 172.21.15.149:0/582415975 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7737+0+0 (secure 0 0 0) 0x7fef9808b1e0 con 0x7fefa8072f70 2023-11-08T19:29:56.394 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.384+0000 7fefa77fe700 1 --2- 172.21.15.149:0/582415975 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fef9406af00 0x7fef9406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:56.395 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.385+0000 7fefa77fe700 1 --2- 172.21.15.149:0/582415975 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fef9406af00 0x7fef9406d3c0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fef9c006b20 tx=0x7fef9c006ab0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:56.395 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.389+0000 7fefa4ff9700 1 -- 172.21.15.149:0/582415975 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fef98055bd0 con 0x7fefa8072f70 2023-11-08T19:29:56.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.576+0000 7fefae6e2700 1 -- 172.21.15.149:0/582415975 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fefa8074f10 con 0x7fefa8072f70 2023-11-08T19:29:56.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.576+0000 7fefa4ff9700 1 -- 172.21.15.149:0/582415975 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v108) v1 ==== 104+0+11 (secure 0 0 0) 0x7fef980150a0 con 0x7fefa8072f70 2023-11-08T19:29:56.578 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:29:56.580 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.579+0000 7fefae6e2700 1 -- 172.21.15.149:0/582415975 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fef9406af00 msgr2=0x7fef9406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:56.581 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.579+0000 7fefae6e2700 1 --2- 172.21.15.149:0/582415975 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fef9406af00 0x7fef9406d3c0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fef9c006b20 tx=0x7fef9c006ab0 comp rx=0 tx=0).stop 2023-11-08T19:29:56.581 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.579+0000 7fefae6e2700 1 -- 172.21.15.149:0/582415975 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fefa8072f70 msgr2=0x7fefa81f3400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:56.581 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.579+0000 7fefae6e2700 1 --2- 172.21.15.149:0/582415975 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fefa8072f70 0x7fefa81f3400 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7fef98000c00 tx=0x7fef98004750 comp rx=0 tx=0).stop 2023-11-08T19:29:56.581 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.579+0000 7fefae6e2700 1 -- 172.21.15.149:0/582415975 shutdown_connections 2023-11-08T19:29:56.582 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.579+0000 7fefae6e2700 1 --2- 172.21.15.149:0/582415975 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fef9406af00 0x7fef9406d3c0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:56.582 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.579+0000 7fefae6e2700 1 --2- 172.21.15.149:0/582415975 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fefa815dee0 0x7fefa81f69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:56.582 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.579+0000 7fefae6e2700 1 --2- 172.21.15.149:0/582415975 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fefa8072f70 0x7fefa81f3400 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:56.582 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.579+0000 7fefae6e2700 1 --2- 172.21.15.149:0/582415975 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fefa815db00 0x7fefa80ca010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:56.583 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.579+0000 7fefae6e2700 1 -- 172.21.15.149:0/582415975 >> 172.21.15.149:0/582415975 conn(0x7fefa806e0d0 msgr2=0x7fefa815cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:56.583 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.579+0000 7fefae6e2700 1 -- 172.21.15.149:0/582415975 shutdown_connections 2023-11-08T19:29:56.583 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.579+0000 7fefae6e2700 1 -- 172.21.15.149:0/582415975 wait complete. 2023-11-08T19:29:56.592 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-08T19:29:56.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.715+0000 7f3a4a663700 1 Processor -- start 2023-11-08T19:29:56.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.716+0000 7f3a4a663700 1 -- start start 2023-11-08T19:29:56.719 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.717+0000 7f3a4a663700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3a440c3dd0 0x7f3a44072bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:56.720 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.717+0000 7f3a4a663700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a44072720 con 0x7f3a440c39f0 2023-11-08T19:29:56.720 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.717+0000 7f3a4a663700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a440cd020 con 0x7f3a440cec40 2023-11-08T19:29:56.720 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.717+0000 7f3a4a663700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a440730f0 con 0x7f3a440c3dd0 2023-11-08T19:29:56.720 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.717+0000 7f3a43fff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f3a440c39f0 0x7f3a440ce530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:47546/0 (socket says 172.21.15.149:47546) 2023-11-08T19:29:56.721 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.717+0000 7f3a43fff700 1 -- 172.21.15.149:0/1618124492 learned_addr learned my addr 172.21.15.149:0/1618124492 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:29:56.721 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.717+0000 7f3a48c00700 1 --2- 172.21.15.149:0/1618124492 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3a440c3dd0 0x7f3a44072bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:56.721 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.717+0000 7f3a42ffd700 1 -- 172.21.15.149:0/1618124492 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2906411452 0 0) 0x7f3a44072720 con 0x7f3a440c39f0 2023-11-08T19:29:56.721 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.717+0000 7f3a42ffd700 1 -- 172.21.15.149:0/1618124492 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a300035b0 con 0x7f3a440c39f0 2023-11-08T19:29:56.721 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.717+0000 7f3a48c00700 1 -- 172.21.15.149:0/1618124492 >> v1:172.21.15.160:6789/0 conn(0x7f3a440cec40 legacy=0x7f3a44162420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:56.722 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.717+0000 7f3a42ffd700 1 -- 172.21.15.149:0/1618124492 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3237451717 0 0) 0x7f3a440cd020 con 0x7f3a440cec40 2023-11-08T19:29:56.722 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.717+0000 7f3a48c00700 1 -- 172.21.15.149:0/1618124492 >> v1:172.21.15.149:6789/0 conn(0x7f3a440c39f0 legacy=0x7f3a440ce530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:56.722 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.717+0000 7f3a48c00700 1 -- 172.21.15.149:0/1618124492 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a44163000 con 0x7f3a440c3dd0 2023-11-08T19:29:56.722 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.717+0000 7f3a48c00700 1 --2- 172.21.15.149:0/1618124492 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3a440c3dd0 0x7f3a44072bb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c009dc0 tx=0x7f3a3c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d782f0facd2d871b server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:56.723 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.717+0000 7f3a42ffd700 1 -- 172.21.15.149:0/1618124492 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c00e070 con 0x7f3a440c3dd0 2023-11-08T19:29:56.723 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.718+0000 7f3a42ffd700 1 -- 172.21.15.149:0/1618124492 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a3c00bb20 con 0x7f3a440c3dd0 2023-11-08T19:29:56.723 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.718+0000 7f3a42ffd700 1 -- 172.21.15.149:0/1618124492 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c00bed0 con 0x7f3a440c3dd0 2023-11-08T19:29:56.723 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.718+0000 7f3a4a663700 1 -- 172.21.15.149:0/1618124492 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3a440c3dd0 msgr2=0x7f3a44072bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:56.723 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.718+0000 7f3a4a663700 1 --2- 172.21.15.149:0/1618124492 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3a440c3dd0 0x7f3a44072bb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c009dc0 tx=0x7f3a3c00b330 comp rx=0 tx=0).stop 2023-11-08T19:29:56.724 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.718+0000 7f3a4a663700 1 -- 172.21.15.149:0/1618124492 shutdown_connections 2023-11-08T19:29:56.724 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.718+0000 7f3a4a663700 1 --2- 172.21.15.149:0/1618124492 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3a440c3dd0 0x7f3a44072bb0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:56.724 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.718+0000 7f3a4a663700 1 -- 172.21.15.149:0/1618124492 >> 172.21.15.149:0/1618124492 conn(0x7f3a4406e0d0 msgr2=0x7f3a4406e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:56.724 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.718+0000 7f3a4a663700 1 -- 172.21.15.149:0/1618124492 shutdown_connections 2023-11-08T19:29:56.724 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.718+0000 7f3a4a663700 1 -- 172.21.15.149:0/1618124492 wait complete. 2023-11-08T19:29:56.729 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.719+0000 7f3a4a663700 1 Processor -- start 2023-11-08T19:29:56.729 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.720+0000 7f3a4a663700 1 -- start start 2023-11-08T19:29:56.729 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.720+0000 7f3a4a663700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a440c39f0 0x7f3a440b3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:56.730 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.720+0000 7f3a4a663700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3a440c3dd0 0x7f3a44152a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:56.730 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.720+0000 7f3a4a663700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3a440cec40 0x7f3a44160280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:56.730 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.720+0000 7f3a4a663700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a440b32a0 con 0x7f3a440c39f0 2023-11-08T19:29:56.730 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.720+0000 7f3a4a663700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a440b44d0 con 0x7f3a440cec40 2023-11-08T19:29:56.730 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.720+0000 7f3a4a663700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4415c0e0 con 0x7f3a440c3dd0 2023-11-08T19:29:56.731 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.720+0000 7f3a43fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a440c39f0 0x7f3a440b3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:56.731 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.720+0000 7f3a43fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a440c39f0 0x7f3a440b3f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45550/0 (socket says 172.21.15.149:45550) 2023-11-08T19:29:56.731 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.720+0000 7f3a43fff700 1 -- 172.21.15.149:0/3474894456 learned_addr learned my addr 172.21.15.149:0/3474894456 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:56.731 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.721+0000 7f3a437fe700 1 --2- 172.21.15.149:0/3474894456 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3a440c3dd0 0x7f3a44152a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:56.731 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.721+0000 7f3a48c00700 1 --2- 172.21.15.149:0/3474894456 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3a440cec40 0x7f3a44160280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:56.732 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.721+0000 7f3a43fff700 1 -- 172.21.15.149:0/3474894456 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3a440c3dd0 msgr2=0x7f3a44152a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:56.732 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.721+0000 7f3a43fff700 1 --2- 172.21.15.149:0/3474894456 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3a440c3dd0 0x7f3a44152a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:56.732 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.721+0000 7f3a43fff700 1 -- 172.21.15.149:0/3474894456 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3a440cec40 msgr2=0x7f3a44160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:56.732 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.721+0000 7f3a43fff700 1 --2- 172.21.15.149:0/3474894456 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3a440cec40 0x7f3a44160280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:56.733 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.721+0000 7f3a43fff700 1 -- 172.21.15.149:0/3474894456 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a3c009a70 con 0x7f3a440c39f0 2023-11-08T19:29:56.733 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.721+0000 7f3a43fff700 1 --2- 172.21.15.149:0/3474894456 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a440c39f0 0x7f3a440b3f90 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c00c500 tx=0x7f3a2c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:56.733 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.721+0000 7f3a40ff9700 1 -- 172.21.15.149:0/3474894456 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2c005d70 con 0x7f3a440c39f0 2023-11-08T19:29:56.733 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.721+0000 7f3a4a663700 1 -- 172.21.15.149:0/3474894456 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a44163390 con 0x7f3a440c39f0 2023-11-08T19:29:56.733 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.721+0000 7f3a40ff9700 1 -- 172.21.15.149:0/3474894456 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a2c0070d0 con 0x7f3a440c39f0 2023-11-08T19:29:56.734 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.721+0000 7f3a40ff9700 1 -- 172.21.15.149:0/3474894456 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2c007440 con 0x7f3a440c39f0 2023-11-08T19:29:56.734 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.721+0000 7f3a4a663700 1 -- 172.21.15.149:0/3474894456 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a440b34b0 con 0x7f3a440c39f0 2023-11-08T19:29:56.734 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.722+0000 7f3a4a663700 1 -- 172.21.15.149:0/3474894456 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a44074f10 con 0x7f3a440c39f0 2023-11-08T19:29:56.734 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.722+0000 7f3a40ff9700 1 -- 172.21.15.149:0/3474894456 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3a2c0075a0 con 0x7f3a440c39f0 2023-11-08T19:29:56.735 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.723+0000 7f3a40ff9700 1 --2- 172.21.15.149:0/3474894456 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3a2406af00 0x7f3a2406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:56.735 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.723+0000 7f3a40ff9700 1 -- 172.21.15.149:0/3474894456 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7737+0+0 (secure 0 0 0) 0x7f3a2c0891d0 con 0x7f3a440c39f0 2023-11-08T19:29:56.735 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.723+0000 7f3a437fe700 1 --2- 172.21.15.149:0/3474894456 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3a2406af00 0x7f3a2406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:56.735 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.723+0000 7f3a437fe700 1 --2- 172.21.15.149:0/3474894456 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3a2406af00 0x7f3a2406d3c0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f3a440c3420 tx=0x7f3a34009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:56.736 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.728+0000 7f3a40ff9700 1 -- 172.21.15.149:0/3474894456 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3a2c053b50 con 0x7f3a440c39f0 2023-11-08T19:29:56.917 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.916+0000 7f3a4a663700 1 -- 172.21.15.149:0/3474894456 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3a440b6640 con 0x7f3a440c39f0 2023-11-08T19:29:56.917 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.916+0000 7f3a40ff9700 1 -- 172.21.15.149:0/3474894456 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v108) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3a2c057170 con 0x7f3a440c39f0 2023-11-08T19:29:56.917 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 64 2023-11-08T19:29:56.919 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.918+0000 7f3a4a663700 1 -- 172.21.15.149:0/3474894456 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3a2406af00 msgr2=0x7f3a2406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:56.920 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.918+0000 7f3a4a663700 1 --2- 172.21.15.149:0/3474894456 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3a2406af00 0x7f3a2406d3c0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f3a440c3420 tx=0x7f3a34009040 comp rx=0 tx=0).stop 2023-11-08T19:29:56.920 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.918+0000 7f3a4a663700 1 -- 172.21.15.149:0/3474894456 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a440c39f0 msgr2=0x7f3a440b3f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:56.920 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.918+0000 7f3a4a663700 1 --2- 172.21.15.149:0/3474894456 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a440c39f0 0x7f3a440b3f90 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c00c500 tx=0x7f3a2c00c8c0 comp rx=0 tx=0).stop 2023-11-08T19:29:56.920 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.918+0000 7f3a4a663700 1 -- 172.21.15.149:0/3474894456 shutdown_connections 2023-11-08T19:29:56.920 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.918+0000 7f3a4a663700 1 --2- 172.21.15.149:0/3474894456 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3a2406af00 0x7f3a2406d3c0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:56.921 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.918+0000 7f3a4a663700 1 --2- 172.21.15.149:0/3474894456 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3a440cec40 0x7f3a44160280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:56.921 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.918+0000 7f3a4a663700 1 --2- 172.21.15.149:0/3474894456 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a440c39f0 0x7f3a440b3f90 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:56.921 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.918+0000 7f3a4a663700 1 --2- 172.21.15.149:0/3474894456 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3a440c3dd0 0x7f3a44152a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:56.921 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.918+0000 7f3a4a663700 1 -- 172.21.15.149:0/3474894456 >> 172.21.15.149:0/3474894456 conn(0x7f3a4406e0d0 msgr2=0x7f3a4406ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:56.922 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.918+0000 7f3a4a663700 1 -- 172.21.15.149:0/3474894456 shutdown_connections 2023-11-08T19:29:56.922 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:56.918+0000 7f3a4a663700 1 -- 172.21.15.149:0/3474894456 wait complete. 2023-11-08T19:29:56.933 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-08T19:29:57.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.055+0000 7fc0922f7700 1 Processor -- start 2023-11-08T19:29:57.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.055+0000 7fc0922f7700 1 -- start start 2023-11-08T19:29:57.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.055+0000 7fc0922f7700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc08c070770 0x7fc08c0ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:57.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.055+0000 7fc0922f7700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fc08c06ab20 0x7fc08c06afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:57.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.055+0000 7fc0922f7700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc08c0ce6e0 con 0x7fc08c15dce0 2023-11-08T19:29:57.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.055+0000 7fc0922f7700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc08c0b2800 con 0x7fc08c06ab20 2023-11-08T19:29:57.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.055+0000 7fc0922f7700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc08c06b4f0 con 0x7fc08c070770 2023-11-08T19:29:57.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.056+0000 7fc08bfff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fc08c15dce0 0x7fc08c0b20f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:47560/0 (socket says 172.21.15.149:47560) 2023-11-08T19:29:57.061 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.056+0000 7fc08bfff700 1 -- 172.21.15.149:0/1137139911 learned_addr learned my addr 172.21.15.149:0/1137139911 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:29:57.061 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.056+0000 7fc08b7fe700 1 --2- 172.21.15.149:0/1137139911 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc08c070770 0x7fc08c0ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:57.061 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.056+0000 7fc090894700 1 --2- 172.21.15.149:0/1137139911 >> v2:172.21.15.160:3300/0 conn(0x7fc08c06ab20 0x7fc08c06afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:57.061 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.056+0000 7fc08affd700 1 -- 172.21.15.149:0/1137139911 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2948694647 0 0) 0x7fc08c0ce6e0 con 0x7fc08c15dce0 2023-11-08T19:29:57.061 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.056+0000 7fc08affd700 1 -- 172.21.15.149:0/1137139911 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0740035b0 con 0x7fc08c15dce0 2023-11-08T19:29:57.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.056+0000 7fc090894700 1 -- 172.21.15.149:0/1137139911 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc08c070770 msgr2=0x7fc08c0ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:57.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.056+0000 7fc090894700 1 --2- 172.21.15.149:0/1137139911 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc08c070770 0x7fc08c0ceb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:57.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.056+0000 7fc090894700 1 -- 172.21.15.149:0/1137139911 >> v1:172.21.15.149:6789/0 conn(0x7fc08c15dce0 legacy=0x7fc08c0b20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:57.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.056+0000 7fc08affd700 1 -- 172.21.15.149:0/1137139911 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3374480775 0 0) 0x7fc0740035b0 con 0x7fc08c15dce0 2023-11-08T19:29:57.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.056+0000 7fc090894700 1 -- 172.21.15.149:0/1137139911 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc08c0b2fb0 con 0x7fc08c06ab20 2023-11-08T19:29:57.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.056+0000 7fc08b7fe700 1 --2- 172.21.15.149:0/1137139911 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc08c070770 0x7fc08c0ceb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:29:57.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.056+0000 7fc090894700 1 --2- 172.21.15.149:0/1137139911 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc08c06ab20 0x7fc08c06afb0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fc084009d90 tx=0x7fc08400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5f3a396c5275d12 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:57.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.056+0000 7fc08affd700 1 -- 172.21.15.149:0/1137139911 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08400e070 con 0x7fc08c06ab20 2023-11-08T19:29:57.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.056+0000 7fc08affd700 1 -- 172.21.15.149:0/1137139911 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc08400bb20 con 0x7fc08c06ab20 2023-11-08T19:29:57.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.056+0000 7fc08affd700 1 -- 172.21.15.149:0/1137139911 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc084012430 con 0x7fc08c06ab20 2023-11-08T19:29:57.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.057+0000 7fc0922f7700 1 -- 172.21.15.149:0/1137139911 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc08c06ab20 msgr2=0x7fc08c06afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:57.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.057+0000 7fc0922f7700 1 --2- 172.21.15.149:0/1137139911 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc08c06ab20 0x7fc08c06afb0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fc084009d90 tx=0x7fc08400b330 comp rx=0 tx=0).stop 2023-11-08T19:29:57.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.057+0000 7fc0922f7700 1 -- 172.21.15.149:0/1137139911 shutdown_connections 2023-11-08T19:29:57.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.057+0000 7fc0922f7700 1 --2- 172.21.15.149:0/1137139911 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc08c06ab20 0x7fc08c06afb0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:57.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.057+0000 7fc0922f7700 1 --2- 172.21.15.149:0/1137139911 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc08c070770 0x7fc08c0ceb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:57.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.057+0000 7fc0922f7700 1 -- 172.21.15.149:0/1137139911 >> 172.21.15.149:0/1137139911 conn(0x7fc08c0cd0f0 msgr2=0x7fc08c0cd500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:57.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.057+0000 7fc0922f7700 1 -- 172.21.15.149:0/1137139911 shutdown_connections 2023-11-08T19:29:57.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.057+0000 7fc0922f7700 1 -- 172.21.15.149:0/1137139911 wait complete. 2023-11-08T19:29:57.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.058+0000 7fc0922f7700 1 Processor -- start 2023-11-08T19:29:57.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.058+0000 7fc0922f7700 1 -- start start 2023-11-08T19:29:57.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.059+0000 7fc0922f7700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc08c06ab20 0x7fc08c1f2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:57.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.059+0000 7fc0922f7700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc08c070770 0x7fc08c0c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:57.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.059+0000 7fc0922f7700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc08c15dce0 0x7fc08c0c63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:57.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.059+0000 7fc0922f7700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc08c15e160 con 0x7fc08c06ab20 2023-11-08T19:29:57.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.059+0000 7fc0922f7700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc08c0c6920 con 0x7fc08c15dce0 2023-11-08T19:29:57.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.059+0000 7fc0922f7700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc08c15e3b0 con 0x7fc08c070770 2023-11-08T19:29:57.070 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.059+0000 7fc08bfff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc08c06ab20 0x7fc08c1f2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:57.070 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.059+0000 7fc08bfff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc08c06ab20 0x7fc08c1f2b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45564/0 (socket says 172.21.15.149:45564) 2023-11-08T19:29:57.070 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.059+0000 7fc08bfff700 1 -- 172.21.15.149:0/1213694297 learned_addr learned my addr 172.21.15.149:0/1213694297 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:57.070 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.059+0000 7fc08b7fe700 1 --2- 172.21.15.149:0/1213694297 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc08c070770 0x7fc08c0c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:57.071 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.059+0000 7fc090894700 1 --2- 172.21.15.149:0/1213694297 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc08c15dce0 0x7fc08c0c63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:57.071 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.060+0000 7fc08bfff700 1 -- 172.21.15.149:0/1213694297 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc08c070770 msgr2=0x7fc08c0c5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:57.071 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.060+0000 7fc08bfff700 1 --2- 172.21.15.149:0/1213694297 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc08c070770 0x7fc08c0c5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:57.071 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.060+0000 7fc08bfff700 1 -- 172.21.15.149:0/1213694297 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc08c15dce0 msgr2=0x7fc08c0c63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:57.071 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.060+0000 7fc08bfff700 1 --2- 172.21.15.149:0/1213694297 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc08c15dce0 0x7fc08c0c63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:57.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.060+0000 7fc08bfff700 1 -- 172.21.15.149:0/1213694297 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0800094a0 con 0x7fc08c06ab20 2023-11-08T19:29:57.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.060+0000 7fc08b7fe700 1 --2- 172.21.15.149:0/1213694297 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc08c070770 0x7fc08c0c5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:29:57.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.060+0000 7fc08bfff700 1 --2- 172.21.15.149:0/1213694297 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc08c06ab20 0x7fc08c1f2b10 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7fc07c00c4d0 tx=0x7fc07c00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:57.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.060+0000 7fc088ff9700 1 -- 172.21.15.149:0/1213694297 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07c005d70 con 0x7fc08c06ab20 2023-11-08T19:29:57.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.060+0000 7fc088ff9700 1 -- 172.21.15.149:0/1213694297 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc07c0070d0 con 0x7fc08c06ab20 2023-11-08T19:29:57.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.060+0000 7fc0922f7700 1 -- 172.21.15.149:0/1213694297 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc084009a70 con 0x7fc08c06ab20 2023-11-08T19:29:57.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.060+0000 7fc088ff9700 1 -- 172.21.15.149:0/1213694297 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07c007460 con 0x7fc08c06ab20 2023-11-08T19:29:57.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.060+0000 7fc0922f7700 1 -- 172.21.15.149:0/1213694297 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc08c15e970 con 0x7fc08c06ab20 2023-11-08T19:29:57.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.061+0000 7fc0922f7700 1 -- 172.21.15.149:0/1213694297 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc08c067810 con 0x7fc08c06ab20 2023-11-08T19:29:57.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.061+0000 7fc088ff9700 1 -- 172.21.15.149:0/1213694297 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc07c0075c0 con 0x7fc08c06ab20 2023-11-08T19:29:57.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.062+0000 7fc088ff9700 1 --2- 172.21.15.149:0/1213694297 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc07806af00 0x7fc07806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:57.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.062+0000 7fc088ff9700 1 -- 172.21.15.149:0/1213694297 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7737+0+0 (secure 0 0 0) 0x7fc07c089120 con 0x7fc08c06ab20 2023-11-08T19:29:57.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.062+0000 7fc08b7fe700 1 --2- 172.21.15.149:0/1213694297 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc07806af00 0x7fc07806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:57.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.062+0000 7fc08b7fe700 1 --2- 172.21.15.149:0/1213694297 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc07806af00 0x7fc07806d3c0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fc08c0cc3c0 tx=0x7fc080009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:57.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.067+0000 7fc088ff9700 1 -- 172.21.15.149:0/1213694297 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc07c053a70 con 0x7fc08c06ab20 2023-11-08T19:29:57.276 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.275+0000 7fc0922f7700 1 -- 172.21.15.149:0/1213694297 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc08c074f10 con 0x7fc08c06ab20 2023-11-08T19:29:57.276 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.275+0000 7fc088ff9700 1 -- 172.21.15.149:0/1213694297 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 13 entries v108) v1 ==== 81+0+797 (secure 0 0 0) 0x7fc07c017330 con 0x7fc08c06ab20 2023-11-08T19:29:57.277 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.15.160:6834/1313631099 2023-11-09T19:29:27.322904+0000 2023-11-08T19:29:57.277 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.15.149:6835/3917392643 2023-11-09T19:29:34.481449+0000 2023-11-08T19:29:57.277 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.15.160:6832/1313631099 2023-11-09T19:29:27.322904+0000 2023-11-08T19:29:57.277 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.15.149:6834/295381437 2023-11-09T19:28:59.293725+0000 2023-11-08T19:29:57.278 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.15.149:6836/295381437 2023-11-09T19:28:59.293725+0000 2023-11-08T19:29:57.278 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.15.160:6835/2714564224 2023-11-09T19:27:34.046425+0000 2023-11-08T19:29:57.278 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.15.149:6837/3917392643 2023-11-09T19:29:34.481449+0000 2023-11-08T19:29:57.278 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.15.149:6834/589971879 2023-11-09T19:28:00.736319+0000 2023-11-08T19:29:57.278 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.15.160:6833/2714564224 2023-11-09T19:27:34.046425+0000 2023-11-08T19:29:57.279 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.15.160:6832/2947079163 2023-11-09T19:28:27.325108+0000 2023-11-08T19:29:57.279 INFO:teuthology.orchestra.run.smithi149.stdout:192.168.0.1:0/1017303916 2023-11-08T20:29:42.437736+0000 2023-11-08T19:29:57.279 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.15.149:6836/589971879 2023-11-09T19:28:00.736319+0000 2023-11-08T19:29:57.279 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.15.160:6834/2947079163 2023-11-09T19:28:27.325108+0000 2023-11-08T19:29:57.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.277+0000 7fc0922f7700 1 -- 172.21.15.149:0/1213694297 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc07806af00 msgr2=0x7fc07806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:57.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.277+0000 7fc0922f7700 1 --2- 172.21.15.149:0/1213694297 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc07806af00 0x7fc07806d3c0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fc08c0cc3c0 tx=0x7fc080009210 comp rx=0 tx=0).stop 2023-11-08T19:29:57.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.277+0000 7fc0922f7700 1 -- 172.21.15.149:0/1213694297 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc08c06ab20 msgr2=0x7fc08c1f2b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:57.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.277+0000 7fc0922f7700 1 --2- 172.21.15.149:0/1213694297 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc08c06ab20 0x7fc08c1f2b10 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7fc07c00c4d0 tx=0x7fc07c00c7e0 comp rx=0 tx=0).stop 2023-11-08T19:29:57.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.277+0000 7fc0922f7700 1 -- 172.21.15.149:0/1213694297 shutdown_connections 2023-11-08T19:29:57.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.277+0000 7fc0922f7700 1 --2- 172.21.15.149:0/1213694297 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc07806af00 0x7fc07806d3c0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:57.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.278+0000 7fc0922f7700 1 --2- 172.21.15.149:0/1213694297 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc08c15dce0 0x7fc08c0c63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:57.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.278+0000 7fc0922f7700 1 --2- 172.21.15.149:0/1213694297 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc08c06ab20 0x7fc08c1f2b10 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:57.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.278+0000 7fc0922f7700 1 --2- 172.21.15.149:0/1213694297 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc08c070770 0x7fc08c0c5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:57.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.278+0000 7fc0922f7700 1 -- 172.21.15.149:0/1213694297 >> 172.21.15.149:0/1213694297 conn(0x7fc08c0cd0f0 msgr2=0x7fc08c15b820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:57.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.278+0000 7fc0922f7700 1 -- 172.21.15.149:0/1213694297 shutdown_connections 2023-11-08T19:29:57.283 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.278+0000 7fc0922f7700 1 -- 172.21.15.149:0/1213694297 wait complete. 2023-11-08T19:29:57.283 INFO:teuthology.orchestra.run.smithi149.stderr:listed 13 entries 2023-11-08T19:29:57.291 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-08T19:29:57.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:29:57.291 DEBUG:teuthology.orchestra.run.smithi149:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-08T19:29:57.633 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi149.front.sepia.ceph.com 2023-11-08T19:29:57.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:29:57.634 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-08T19:29:57.651 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-11-08T19:29:57.651 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:29:57.673 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284272k,nr_inodes=4071068,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16330 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-08T19:29:57.673 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-11-08T19:29:57.674 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:29:57.709 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=8026740k,nr_inodes=2006685,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=31,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15303 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1609048k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-11-08T19:29:57.710 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-11-08T19:29:57.710 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:29:57.735 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284272k,nr_inodes=4071068,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16330 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-08T19:29:57.735 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:29:57.870 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.868+0000 7f4a32e86700 1 Processor -- start 2023-11-08T19:29:57.870 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.869+0000 7f4a32e86700 1 -- start start 2023-11-08T19:29:57.872 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.869+0000 7f4a32e86700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f4a2c0b20f0 0x7f4a2c06fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:57.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.869+0000 7f4a32e86700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4a2c15ebe0 0x7f4a2c0cbd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:57.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.869+0000 7f4a32e86700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a2c06ffd0 con 0x7f4a2c072b70 2023-11-08T19:29:57.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.869+0000 7f4a32e86700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a2c070200 con 0x7f4a2c0b20f0 2023-11-08T19:29:57.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.869+0000 7f4a32e86700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2c0704e0 con 0x7f4a2c15ebe0 2023-11-08T19:29:57.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.869+0000 7f4a30c22700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f4a2c0b20f0 0x7f4a2c06fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:57.874 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.869+0000 7f4a30c22700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f4a2c0b20f0 0x7f4a2c06fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45576/0 (socket says 172.21.15.149:45576) 2023-11-08T19:29:57.874 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.869+0000 7f4a30c22700 1 -- 172.21.15.149:0/974502388 learned_addr learned my addr 172.21.15.149:0/974502388 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:57.874 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.870+0000 7f4a31423700 1 --2- 172.21.15.149:0/974502388 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4a2c15ebe0 0x7f4a2c0cbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:57.874 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.870+0000 7f4a30c22700 1 -- 172.21.15.149:0/974502388 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4a2c15ebe0 msgr2=0x7f4a2c0cbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:57.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.870+0000 7f4a30c22700 1 --2- 172.21.15.149:0/974502388 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4a2c15ebe0 0x7f4a2c0cbd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:57.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.870+0000 7f4a30c22700 1 -- 172.21.15.149:0/974502388 >> v1:172.21.15.160:6789/0 conn(0x7f4a2c072b70 legacy=0x7f4a2c0b24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:57.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.870+0000 7f4a30c22700 1 -- 172.21.15.149:0/974502388 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a2c0707c0 con 0x7f4a2c0b20f0 2023-11-08T19:29:57.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.870+0000 7f4a30c22700 1 --2- 172.21.15.149:0/974502388 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a2c0b20f0 0x7f4a2c06fa90 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f4a2000bb90 tx=0x7f4a2000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b0bd5e09fdeb5e8 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:57.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.870+0000 7f4a2b7fe700 1 -- 172.21.15.149:0/974502388 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2000dd10 con 0x7f4a2c0b20f0 2023-11-08T19:29:57.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.870+0000 7f4a2b7fe700 1 -- 172.21.15.149:0/974502388 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a2000de70 con 0x7f4a2c0b20f0 2023-11-08T19:29:57.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.870+0000 7f4a2b7fe700 1 -- 172.21.15.149:0/974502388 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a20004230 con 0x7f4a2c0b20f0 2023-11-08T19:29:57.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.871+0000 7f4a32e86700 1 -- 172.21.15.149:0/974502388 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a2c0b20f0 msgr2=0x7f4a2c06fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:57.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.871+0000 7f4a32e86700 1 --2- 172.21.15.149:0/974502388 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a2c0b20f0 0x7f4a2c06fa90 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f4a2000bb90 tx=0x7f4a2000bea0 comp rx=0 tx=0).stop 2023-11-08T19:29:57.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.871+0000 7f4a32e86700 1 -- 172.21.15.149:0/974502388 shutdown_connections 2023-11-08T19:29:57.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.871+0000 7f4a32e86700 1 --2- 172.21.15.149:0/974502388 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4a2c15ebe0 0x7f4a2c0cbd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:57.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.871+0000 7f4a32e86700 1 --2- 172.21.15.149:0/974502388 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a2c0b20f0 0x7f4a2c06fa90 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:57.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.871+0000 7f4a32e86700 1 -- 172.21.15.149:0/974502388 >> 172.21.15.149:0/974502388 conn(0x7f4a2c0cd0f0 msgr2=0x7f4a2c0cd500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:57.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.871+0000 7f4a32e86700 1 -- 172.21.15.149:0/974502388 shutdown_connections 2023-11-08T19:29:57.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.871+0000 7f4a32e86700 1 -- 172.21.15.149:0/974502388 wait complete. 2023-11-08T19:29:57.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.872+0000 7f4a32e86700 1 Processor -- start 2023-11-08T19:29:57.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.872+0000 7f4a32e86700 1 -- start start 2023-11-08T19:29:57.881 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.873+0000 7f4a32e86700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4a2c072b70 0x7f4a2c0c8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:57.881 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.873+0000 7f4a32e86700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a2c0b20f0 0x7f4a2c15d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:57.881 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.873+0000 7f4a32e86700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4a2c15ebe0 0x7f4a2c0c9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:57.881 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.873+0000 7f4a32e86700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2c15d3a0 con 0x7f4a2c0b20f0 2023-11-08T19:29:57.881 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.873+0000 7f4a32e86700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2c15ca70 con 0x7f4a2c15ebe0 2023-11-08T19:29:57.882 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.873+0000 7f4a32e86700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2c15cd50 con 0x7f4a2c072b70 2023-11-08T19:29:57.882 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.873+0000 7f4a2bfff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a2c0b20f0 0x7f4a2c15d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:57.882 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.873+0000 7f4a2bfff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a2c0b20f0 0x7f4a2c15d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45584/0 (socket says 172.21.15.149:45584) 2023-11-08T19:29:57.882 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.873+0000 7f4a2bfff700 1 -- 172.21.15.149:0/2237033921 learned_addr learned my addr 172.21.15.149:0/2237033921 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:57.882 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.873+0000 7f4a30c22700 1 --2- 172.21.15.149:0/2237033921 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4a2c072b70 0x7f4a2c0c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:57.883 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.873+0000 7f4a31423700 1 --2- 172.21.15.149:0/2237033921 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4a2c15ebe0 0x7f4a2c0c9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:57.883 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.873+0000 7f4a2bfff700 1 -- 172.21.15.149:0/2237033921 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4a2c072b70 msgr2=0x7f4a2c0c8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:57.883 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.873+0000 7f4a2bfff700 1 --2- 172.21.15.149:0/2237033921 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4a2c072b70 0x7f4a2c0c8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:57.883 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.873+0000 7f4a2bfff700 1 -- 172.21.15.149:0/2237033921 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4a2c15ebe0 msgr2=0x7f4a2c0c9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:57.883 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.873+0000 7f4a2bfff700 1 --2- 172.21.15.149:0/2237033921 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4a2c15ebe0 0x7f4a2c0c9e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:57.884 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.873+0000 7f4a2bfff700 1 -- 172.21.15.149:0/2237033921 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a2000b7f0 con 0x7f4a2c0b20f0 2023-11-08T19:29:57.884 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.873+0000 7f4a30c22700 1 --2- 172.21.15.149:0/2237033921 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4a2c072b70 0x7f4a2c0c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:29:57.884 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.873+0000 7f4a2bfff700 1 --2- 172.21.15.149:0/2237033921 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a2c0b20f0 0x7f4a2c15d830 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f4a1800c4d0 tx=0x7f4a1800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:57.884 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.873+0000 7f4a297fa700 1 -- 172.21.15.149:0/2237033921 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a18011790 con 0x7f4a2c0b20f0 2023-11-08T19:29:57.884 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.873+0000 7f4a297fa700 1 -- 172.21.15.149:0/2237033921 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a180118f0 con 0x7f4a2c0b20f0 2023-11-08T19:29:57.885 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.873+0000 7f4a32e86700 1 -- 172.21.15.149:0/2237033921 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a2c15d030 con 0x7f4a2c0b20f0 2023-11-08T19:29:57.885 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.873+0000 7f4a297fa700 1 -- 172.21.15.149:0/2237033921 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a18011ca0 con 0x7f4a2c0b20f0 2023-11-08T19:29:57.885 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.874+0000 7f4a32e86700 1 -- 172.21.15.149:0/2237033921 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a2c15dd70 con 0x7f4a2c0b20f0 2023-11-08T19:29:57.885 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.875+0000 7f4a32e86700 1 -- 172.21.15.149:0/2237033921 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a2c067810 con 0x7f4a2c0b20f0 2023-11-08T19:29:57.885 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.875+0000 7f4a297fa700 1 -- 172.21.15.149:0/2237033921 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4a1801c460 con 0x7f4a2c0b20f0 2023-11-08T19:29:57.886 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.875+0000 7f4a297fa700 1 --2- 172.21.15.149:0/2237033921 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4a1006af00 0x7f4a1006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:57.886 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.875+0000 7f4a30c22700 1 --2- 172.21.15.149:0/2237033921 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4a1006af00 0x7f4a1006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:57.886 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.875+0000 7f4a297fa700 1 -- 172.21.15.149:0/2237033921 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7737+0+0 (secure 0 0 0) 0x7f4a18089ca0 con 0x7f4a2c0b20f0 2023-11-08T19:29:57.886 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.876+0000 7f4a30c22700 1 --2- 172.21.15.149:0/2237033921 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4a1006af00 0x7f4a1006d3c0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f4a2000b340 tx=0x7f4a20013000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:57.887 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:57.880+0000 7f4a297fa700 1 -- 172.21.15.149:0/2237033921 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4a18054560 con 0x7f4a2c0b20f0 2023-11-08T19:29:58.118 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.117+0000 7f4a32e86700 1 -- 172.21.15.149:0/2237033921 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4a2c074f10 con 0x7f4a2c0b20f0 2023-11-08T19:29:58.119 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.118+0000 7f4a297fa700 1 -- 172.21.15.149:0/2237033921 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) v1 ==== 95+0+4944 (secure 0 0 0) 0x7f4a18057b80 con 0x7f4a2c0b20f0 2023-11-08T19:29:58.120 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:29:58.120 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":103,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6095,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/852710262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":852710262},{"type":"v1","addr":"172.21.15.160:6835","nonce":852710262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64},{"gid":6425,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/2137508069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":2137508069},{"type":"v1","addr":"172.21.15.149:6837","nonce":2137508069}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":100}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:29:44.194817+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7812,"mds_1":6398},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6398":{"gid":6398,"name":"d","rank":1,"incarnation":99,"state":"up:active","state_seq":7,"addr":"172.21.15.160:6834/2282522167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2282522167},{"type":"v1","addr":"172.21.15.160:6834","nonce":2282522167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7812":{"gid":7812,"name":"a","rank":0,"incarnation":96,"state":"up:active","state_seq":14,"addr":"172.21.15.149:6836/2818321595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2818321595},{"type":"v1","addr":"172.21.15.149:6836","nonce":2818321595}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:29:58.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.120+0000 7f4a32e86700 1 -- 172.21.15.149:0/2237033921 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4a1006af00 msgr2=0x7f4a1006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:58.122 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.120+0000 7f4a32e86700 1 --2- 172.21.15.149:0/2237033921 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4a1006af00 0x7f4a1006d3c0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f4a2000b340 tx=0x7f4a20013000 comp rx=0 tx=0).stop 2023-11-08T19:29:58.122 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.120+0000 7f4a32e86700 1 -- 172.21.15.149:0/2237033921 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a2c0b20f0 msgr2=0x7f4a2c15d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:58.122 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.120+0000 7f4a32e86700 1 --2- 172.21.15.149:0/2237033921 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a2c0b20f0 0x7f4a2c15d830 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f4a1800c4d0 tx=0x7f4a1800c890 comp rx=0 tx=0).stop 2023-11-08T19:29:58.122 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.120+0000 7f4a32e86700 1 -- 172.21.15.149:0/2237033921 shutdown_connections 2023-11-08T19:29:58.122 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.120+0000 7f4a32e86700 1 --2- 172.21.15.149:0/2237033921 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f4a1006af00 0x7f4a1006d3c0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:58.123 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.120+0000 7f4a32e86700 1 --2- 172.21.15.149:0/2237033921 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4a2c15ebe0 0x7f4a2c0c9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:58.123 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.120+0000 7f4a32e86700 1 --2- 172.21.15.149:0/2237033921 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4a2c072b70 0x7f4a2c0c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:58.123 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.120+0000 7f4a32e86700 1 --2- 172.21.15.149:0/2237033921 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a2c0b20f0 0x7f4a2c15d830 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:58.123 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.120+0000 7f4a32e86700 1 -- 172.21.15.149:0/2237033921 >> 172.21.15.149:0/2237033921 conn(0x7f4a2c0cd0f0 msgr2=0x7f4a2c0b24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:58.123 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.120+0000 7f4a32e86700 1 -- 172.21.15.149:0/2237033921 shutdown_connections 2023-11-08T19:29:58.124 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.120+0000 7f4a32e86700 1 -- 172.21.15.149:0/2237033921 wait complete. 2023-11-08T19:29:58.124 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 103 2023-11-08T19:29:58.134 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:29:58.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.255+0000 7fc84e69f700 1 Processor -- start 2023-11-08T19:29:58.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.255+0000 7fc84e69f700 1 -- start start 2023-11-08T19:29:58.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.256+0000 7fc84e69f700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc84815db00 0x7fc8480ce1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:58.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.256+0000 7fc84e69f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc8480b2a50 0x7fc8480ce720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:58.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.256+0000 7fc84e69f700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fc8481615f0 0x7fc8480b5400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:58.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.256+0000 7fc84e69f700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc84815dee0 con 0x7fc84815db00 2023-11-08T19:29:58.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.256+0000 7fc84e69f700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8480cefb0 con 0x7fc8481615f0 2023-11-08T19:29:58.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.256+0000 7fc84e69f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8480b6a60 con 0x7fc8480b2a50 2023-11-08T19:29:58.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.256+0000 7fc847fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc84815db00 0x7fc8480ce1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:58.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.256+0000 7fc847fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc84815db00 0x7fc8480ce1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45590/0 (socket says 172.21.15.149:45590) 2023-11-08T19:29:58.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.256+0000 7fc847fff700 1 -- 172.21.15.149:0/2789833713 learned_addr learned my addr 172.21.15.149:0/2789833713 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:58.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.256+0000 7fc8477fe700 1 --2- 172.21.15.149:0/2789833713 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc8480b2a50 0x7fc8480ce720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:58.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.256+0000 7fc84cc3c700 1 --2- 172.21.15.149:0/2789833713 >> v2:172.21.15.160:3300/0 conn(0x7fc8481615f0 0x7fc8480b5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:58.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.256+0000 7fc847fff700 1 -- 172.21.15.149:0/2789833713 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc8480b2a50 msgr2=0x7fc8480ce720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:58.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.256+0000 7fc847fff700 1 --2- 172.21.15.149:0/2789833713 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc8480b2a50 0x7fc8480ce720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:58.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.256+0000 7fc847fff700 1 -- 172.21.15.149:0/2789833713 >> v2:172.21.15.160:3300/0 conn(0x7fc8481615f0 msgr2=0x7fc8480b5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:58.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.256+0000 7fc847fff700 1 --2- 172.21.15.149:0/2789833713 >> v2:172.21.15.160:3300/0 conn(0x7fc8481615f0 0x7fc8480b5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:58.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.256+0000 7fc847fff700 1 -- 172.21.15.149:0/2789833713 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8480b6d40 con 0x7fc84815db00 2023-11-08T19:29:58.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.256+0000 7fc847fff700 1 --2- 172.21.15.149:0/2789833713 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc84815db00 0x7fc8480ce1e0 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7fc8480d1160 tx=0x7fc838009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3ef4d9a97e5d7a1 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:58.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.256+0000 7fc846ffd700 1 -- 172.21.15.149:0/2789833713 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc838011830 con 0x7fc84815db00 2023-11-08T19:29:58.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.256+0000 7fc846ffd700 1 -- 172.21.15.149:0/2789833713 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc838011990 con 0x7fc84815db00 2023-11-08T19:29:58.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.256+0000 7fc846ffd700 1 -- 172.21.15.149:0/2789833713 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc838011d20 con 0x7fc84815db00 2023-11-08T19:29:58.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.257+0000 7fc84e69f700 1 -- 172.21.15.149:0/2789833713 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc84815db00 msgr2=0x7fc8480ce1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:58.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.257+0000 7fc84e69f700 1 --2- 172.21.15.149:0/2789833713 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc84815db00 0x7fc8480ce1e0 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7fc8480d1160 tx=0x7fc838009bd0 comp rx=0 tx=0).stop 2023-11-08T19:29:58.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.257+0000 7fc84e69f700 1 -- 172.21.15.149:0/2789833713 shutdown_connections 2023-11-08T19:29:58.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.257+0000 7fc84e69f700 1 --2- 172.21.15.149:0/2789833713 >> v2:172.21.15.160:3300/0 conn(0x7fc8481615f0 0x7fc8480b5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:58.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.257+0000 7fc84e69f700 1 --2- 172.21.15.149:0/2789833713 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc84815db00 0x7fc8480ce1e0 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:58.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.257+0000 7fc84e69f700 1 --2- 172.21.15.149:0/2789833713 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc8480b2a50 0x7fc8480ce720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:58.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.257+0000 7fc84e69f700 1 -- 172.21.15.149:0/2789833713 >> 172.21.15.149:0/2789833713 conn(0x7fc848072670 msgr2=0x7fc848072a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:58.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.257+0000 7fc84e69f700 1 -- 172.21.15.149:0/2789833713 shutdown_connections 2023-11-08T19:29:58.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.257+0000 7fc84e69f700 1 -- 172.21.15.149:0/2789833713 wait complete. 2023-11-08T19:29:58.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.258+0000 7fc84e69f700 1 Processor -- start 2023-11-08T19:29:58.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.258+0000 7fc84e69f700 1 -- start start 2023-11-08T19:29:58.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.259+0000 7fc84e69f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc8480b2a50 0x7fc8480caa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:58.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.259+0000 7fc84e69f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc84815db00 0x7fc8480b52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:58.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.259+0000 7fc84e69f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8481615f0 0x7fc8480b5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:58.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.259+0000 7fc84e69f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc848148960 con 0x7fc8481615f0 2023-11-08T19:29:58.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.259+0000 7fc84e69f700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc848148bb0 con 0x7fc84815db00 2023-11-08T19:29:58.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.259+0000 7fc84e69f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc848148e90 con 0x7fc8480b2a50 2023-11-08T19:29:58.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.259+0000 7fc84cc3c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8481615f0 0x7fc8480b5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:58.270 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.259+0000 7fc84cc3c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8481615f0 0x7fc8480b5820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45600/0 (socket says 172.21.15.149:45600) 2023-11-08T19:29:58.270 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.259+0000 7fc84cc3c700 1 -- 172.21.15.149:0/2692740399 learned_addr learned my addr 172.21.15.149:0/2692740399 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:58.270 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.259+0000 7fc847fff700 1 --2- 172.21.15.149:0/2692740399 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc8480b2a50 0x7fc8480caa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:58.270 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.259+0000 7fc8477fe700 1 --2- 172.21.15.149:0/2692740399 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc84815db00 0x7fc8480b52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:58.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.260+0000 7fc84cc3c700 1 -- 172.21.15.149:0/2692740399 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc8480b2a50 msgr2=0x7fc8480caa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:58.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.260+0000 7fc84cc3c700 1 --2- 172.21.15.149:0/2692740399 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc8480b2a50 0x7fc8480caa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:58.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.260+0000 7fc84cc3c700 1 -- 172.21.15.149:0/2692740399 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc84815db00 msgr2=0x7fc8480b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:58.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.260+0000 7fc84cc3c700 1 --2- 172.21.15.149:0/2692740399 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc84815db00 0x7fc8480b52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:58.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.260+0000 7fc84cc3c700 1 -- 172.21.15.149:0/2692740399 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc838009550 con 0x7fc8481615f0 2023-11-08T19:29:58.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.260+0000 7fc84cc3c700 1 --2- 172.21.15.149:0/2692740399 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8481615f0 0x7fc8480b5820 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7fc84000efc0 tx=0x7fc840009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:58.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.260+0000 7fc844ff9700 1 -- 172.21.15.149:0/2692740399 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc840009b20 con 0x7fc8481615f0 2023-11-08T19:29:58.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.260+0000 7fc844ff9700 1 -- 172.21.15.149:0/2692740399 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc84000f040 con 0x7fc8481615f0 2023-11-08T19:29:58.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.260+0000 7fc84e69f700 1 -- 172.21.15.149:0/2692740399 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc848149170 con 0x7fc8481615f0 2023-11-08T19:29:58.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.260+0000 7fc844ff9700 1 -- 172.21.15.149:0/2692740399 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84000cc90 con 0x7fc8481615f0 2023-11-08T19:29:58.273 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.260+0000 7fc84e69f700 1 -- 172.21.15.149:0/2692740399 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc848149730 con 0x7fc8481615f0 2023-11-08T19:29:58.273 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.261+0000 7fc84e69f700 1 -- 172.21.15.149:0/2692740399 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc848149950 con 0x7fc8481615f0 2023-11-08T19:29:58.273 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.261+0000 7fc844ff9700 1 -- 172.21.15.149:0/2692740399 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc840014480 con 0x7fc8481615f0 2023-11-08T19:29:58.273 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.262+0000 7fc844ff9700 1 --2- 172.21.15.149:0/2692740399 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc83406af00 0x7fc83406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:58.273 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.262+0000 7fc844ff9700 1 -- 172.21.15.149:0/2692740399 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7737+0+0 (secure 0 0 0) 0x7fc84008a7b0 con 0x7fc8481615f0 2023-11-08T19:29:58.274 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.262+0000 7fc847fff700 1 --2- 172.21.15.149:0/2692740399 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc83406af00 0x7fc83406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:58.274 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.262+0000 7fc847fff700 1 --2- 172.21.15.149:0/2692740399 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc83406af00 0x7fc83406d3c0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fc838009c10 tx=0x7fc838008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:58.274 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.266+0000 7fc844ff9700 1 -- 172.21.15.149:0/2692740399 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc840055070 con 0x7fc8481615f0 2023-11-08T19:29:58.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.459+0000 7fc84e69f700 1 -- 172.21.15.149:0/2692740399 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc848074f10 con 0x7fc8481615f0 2023-11-08T19:29:58.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.461+0000 7fc844ff9700 1 -- 172.21.15.149:0/2692740399 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) v1 ==== 74+0+23067 (secure 0 0 0) 0x7fc840058690 con 0x7fc8481615f0 2023-11-08T19:29:58.462 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:29:58.463 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":108,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:29:43.171791+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-08T19:24:29.516185+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-08T19:25:44.287064+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":71,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-08T19:25:45.623521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-11-08T19:26:46.785987+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-11-08T19:26:47.950353+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":9,"snap_epoch":104,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.f","mappings":[{"from":0,"to":5}]},{"pgid":"17.26","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.160:6834/1313631099":"2023-11-09T19:29:27.322904+0000","172.21.15.149:6835/3917392643":"2023-11-09T19:29:34.481449+0000","172.21.15.160:6832/1313631099":"2023-11-09T19:29:27.322904+0000","172.21.15.149:6834/295381437":"2023-11-09T19:28:59.293725+0000","172.21.15.149:6836/295381437":"2023-11-09T19:28:59.293725+0000","172.21.15.160:6835/2714564224":"2023-11-09T19:27:34.046425+0000","172.21.15.149:6837/3917392643":"2023-11-09T19:29:34.481449+0000","172.21.15.149:6834/589971879":"2023-11-09T19:28:00.736319+0000","172.21.15.160:6833/2714564224":"2023-11-09T19:27:34.046425+0000","172.21.15.160:6832/2947079163":"2023-11-09T19:28:27.325108+0000","192.168.0.1:0/1017303916":"2023-11-08T20:29:42.437736+0000","172.21.15.149:6836/589971879":"2023-11-09T19:28:00.736319+0000","172.21.15.160:6834/2947079163":"2023-11-09T19:28:27.325108+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:29:58.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.463+0000 7fc84e69f700 1 -- 172.21.15.149:0/2692740399 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc83406af00 msgr2=0x7fc83406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:58.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.463+0000 7fc84e69f700 1 --2- 172.21.15.149:0/2692740399 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc83406af00 0x7fc83406d3c0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fc838009c10 tx=0x7fc838008030 comp rx=0 tx=0).stop 2023-11-08T19:29:58.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.463+0000 7fc84e69f700 1 -- 172.21.15.149:0/2692740399 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8481615f0 msgr2=0x7fc8480b5820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:58.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.463+0000 7fc84e69f700 1 --2- 172.21.15.149:0/2692740399 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8481615f0 0x7fc8480b5820 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7fc84000efc0 tx=0x7fc840009f60 comp rx=0 tx=0).stop 2023-11-08T19:29:58.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.463+0000 7fc84e69f700 1 -- 172.21.15.149:0/2692740399 shutdown_connections 2023-11-08T19:29:58.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.463+0000 7fc84e69f700 1 --2- 172.21.15.149:0/2692740399 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fc83406af00 0x7fc83406d3c0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:58.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.463+0000 7fc84e69f700 1 --2- 172.21.15.149:0/2692740399 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8481615f0 0x7fc8480b5820 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:58.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.463+0000 7fc84e69f700 1 --2- 172.21.15.149:0/2692740399 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc8480b2a50 0x7fc8480caa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:58.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.463+0000 7fc84e69f700 1 --2- 172.21.15.149:0/2692740399 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc84815db00 0x7fc8480b52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:58.466 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.463+0000 7fc84e69f700 1 -- 172.21.15.149:0/2692740399 >> 172.21.15.149:0/2692740399 conn(0x7fc848072670 msgr2=0x7fc8480d2750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:58.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.463+0000 7fc84e69f700 1 -- 172.21.15.149:0/2692740399 shutdown_connections 2023-11-08T19:29:58.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.463+0000 7fc84e69f700 1 -- 172.21.15.149:0/2692740399 wait complete. 2023-11-08T19:29:58.477 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-08T19:22:56.023194+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-08T19:24:29.516185+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 42, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_data_pool', 'create_time': '2023-11-08T19:25:44.287064+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 71, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-08T19:25:45.623521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-08T19:26:46.785987+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '95', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-11-08T19:26:47.950353+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '104', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 9, 'snap_epoch': 104, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-08T19:29:58.478 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-08T19:29:58.601 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.600+0000 7ff281aa0700 1 Processor -- start 2023-11-08T19:29:58.602 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.600+0000 7ff281aa0700 1 -- start start 2023-11-08T19:29:58.604 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.601+0000 7ff281aa0700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff27c0d1060 0x7ff27c0b1860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:58.605 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.601+0000 7ff281aa0700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff27c06b230 0x7ff27c0cb130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:58.605 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.601+0000 7ff281aa0700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff27c0b0a70 con 0x7ff27c0ccb90 2023-11-08T19:29:58.605 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.601+0000 7ff281aa0700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff27c0b0d30 con 0x7ff27c06b230 2023-11-08T19:29:58.605 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.601+0000 7ff281aa0700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff27c0b1010 con 0x7ff27c0d1060 2023-11-08T19:29:58.605 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.601+0000 7ff27bfff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff27c06b230 0x7ff27c0cb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:58.606 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.601+0000 7ff27bfff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff27c06b230 0x7ff27c0cb130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45608/0 (socket says 172.21.15.149:45608) 2023-11-08T19:29:58.606 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.601+0000 7ff27bfff700 1 -- 172.21.15.149:0/1199123615 learned_addr learned my addr 172.21.15.149:0/1199123615 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:58.606 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.602+0000 7ff27b7fe700 1 --2- 172.21.15.149:0/1199123615 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff27c0d1060 0x7ff27c0b1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:58.606 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.602+0000 7ff27bfff700 1 -- 172.21.15.149:0/1199123615 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff27c0d1060 msgr2=0x7ff27c0b1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:58.607 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.602+0000 7ff27bfff700 1 --2- 172.21.15.149:0/1199123615 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff27c0d1060 0x7ff27c0b1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:58.607 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.602+0000 7ff27bfff700 1 -- 172.21.15.149:0/1199123615 >> v1:172.21.15.160:6789/0 conn(0x7ff27c0ccb90 legacy=0x7ff27c06ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:58.607 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.602+0000 7ff27bfff700 1 -- 172.21.15.149:0/1199123615 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff27c0b12f0 con 0x7ff27c06b230 2023-11-08T19:29:58.607 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.602+0000 7ff27bfff700 1 --2- 172.21.15.149:0/1199123615 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff27c06b230 0x7ff27c0cb130 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7ff274009e50 tx=0x7ff27400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a56096873af54ed9 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:58.607 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.602+0000 7ff27a7fc700 1 -- 172.21.15.149:0/1199123615 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27400e070 con 0x7ff27c06b230 2023-11-08T19:29:58.608 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.602+0000 7ff27a7fc700 1 -- 172.21.15.149:0/1199123615 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff274003a20 con 0x7ff27c06b230 2023-11-08T19:29:58.608 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.602+0000 7ff27a7fc700 1 -- 172.21.15.149:0/1199123615 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff274003dd0 con 0x7ff27c06b230 2023-11-08T19:29:58.608 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.602+0000 7ff281aa0700 1 -- 172.21.15.149:0/1199123615 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff27c06b230 msgr2=0x7ff27c0cb130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:58.608 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.602+0000 7ff281aa0700 1 --2- 172.21.15.149:0/1199123615 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff27c06b230 0x7ff27c0cb130 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7ff274009e50 tx=0x7ff27400b330 comp rx=0 tx=0).stop 2023-11-08T19:29:58.608 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.603+0000 7ff281aa0700 1 -- 172.21.15.149:0/1199123615 shutdown_connections 2023-11-08T19:29:58.609 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.603+0000 7ff281aa0700 1 --2- 172.21.15.149:0/1199123615 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff27c06b230 0x7ff27c0cb130 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:58.609 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.603+0000 7ff281aa0700 1 --2- 172.21.15.149:0/1199123615 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff27c0d1060 0x7ff27c0b1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:58.609 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.603+0000 7ff281aa0700 1 -- 172.21.15.149:0/1199123615 >> 172.21.15.149:0/1199123615 conn(0x7ff27c072680 msgr2=0x7ff27c099a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:58.609 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.603+0000 7ff281aa0700 1 -- 172.21.15.149:0/1199123615 shutdown_connections 2023-11-08T19:29:58.609 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.603+0000 7ff281aa0700 1 -- 172.21.15.149:0/1199123615 wait complete. 2023-11-08T19:29:58.612 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.604+0000 7ff281aa0700 1 Processor -- start 2023-11-08T19:29:58.612 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.604+0000 7ff281aa0700 1 -- start start 2023-11-08T19:29:58.612 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.605+0000 7ff281aa0700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff27c06b230 0x7ff27c150970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:58.613 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.605+0000 7ff281aa0700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff27c0ccb90 0x7ff27c0b5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:58.613 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.605+0000 7ff281aa0700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff27c0d1060 0x7ff27c1f3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:58.613 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.605+0000 7ff281aa0700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff27c0b5090 con 0x7ff27c06b230 2023-11-08T19:29:58.613 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.605+0000 7ff281aa0700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff27c15ded0 con 0x7ff27c0d1060 2023-11-08T19:29:58.613 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.605+0000 7ff281aa0700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff27c0b4480 con 0x7ff27c0ccb90 2023-11-08T19:29:58.614 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.605+0000 7ff27b7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff27c06b230 0x7ff27c150970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:58.614 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.605+0000 7ff27b7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff27c06b230 0x7ff27c150970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45610/0 (socket says 172.21.15.149:45610) 2023-11-08T19:29:58.614 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.605+0000 7ff27b7fe700 1 -- 172.21.15.149:0/2474093234 learned_addr learned my addr 172.21.15.149:0/2474093234 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:58.614 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.605+0000 7ff27affd700 1 --2- 172.21.15.149:0/2474093234 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff27c0ccb90 0x7ff27c0b5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:58.615 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.605+0000 7ff27bfff700 1 --2- 172.21.15.149:0/2474093234 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff27c0d1060 0x7ff27c1f3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:58.615 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.605+0000 7ff27b7fe700 1 -- 172.21.15.149:0/2474093234 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff27c0ccb90 msgr2=0x7ff27c0b5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:58.615 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.605+0000 7ff27b7fe700 1 --2- 172.21.15.149:0/2474093234 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff27c0ccb90 0x7ff27c0b5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:58.615 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.605+0000 7ff27b7fe700 1 -- 172.21.15.149:0/2474093234 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff27c0d1060 msgr2=0x7ff27c1f3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:58.615 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.605+0000 7ff27b7fe700 1 --2- 172.21.15.149:0/2474093234 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff27c0d1060 0x7ff27c1f3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:58.616 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.605+0000 7ff27b7fe700 1 -- 172.21.15.149:0/2474093234 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff274009b30 con 0x7ff27c06b230 2023-11-08T19:29:58.616 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.605+0000 7ff27affd700 1 --2- 172.21.15.149:0/2474093234 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff27c0ccb90 0x7ff27c0b5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:29:58.616 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.605+0000 7ff27bfff700 1 --2- 172.21.15.149:0/2474093234 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff27c0d1060 0x7ff27c1f3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:29:58.616 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.605+0000 7ff27b7fe700 1 --2- 172.21.15.149:0/2474093234 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff27c06b230 0x7ff27c150970 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7ff27000e810 tx=0x7ff27000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:58.616 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.605+0000 7ff263fff700 1 -- 172.21.15.149:0/2474093234 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff270013610 con 0x7ff27c06b230 2023-11-08T19:29:58.617 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.605+0000 7ff263fff700 1 -- 172.21.15.149:0/2474093234 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff270013770 con 0x7ff27c06b230 2023-11-08T19:29:58.617 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.606+0000 7ff263fff700 1 -- 172.21.15.149:0/2474093234 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff270013b20 con 0x7ff27c06b230 2023-11-08T19:29:58.617 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.606+0000 7ff281aa0700 1 -- 172.21.15.149:0/2474093234 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff27c0b4760 con 0x7ff27c06b230 2023-11-08T19:29:58.617 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.606+0000 7ff281aa0700 1 -- 172.21.15.149:0/2474093234 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff27c0b4d20 con 0x7ff27c06b230 2023-11-08T19:29:58.617 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.606+0000 7ff281aa0700 1 -- 172.21.15.149:0/2474093234 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff27c074f10 con 0x7ff27c06b230 2023-11-08T19:29:58.618 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.607+0000 7ff263fff700 1 -- 172.21.15.149:0/2474093234 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff270013c80 con 0x7ff27c06b230 2023-11-08T19:29:58.618 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.607+0000 7ff263fff700 1 --2- 172.21.15.149:0/2474093234 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff26806af00 0x7ff26806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:58.618 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.607+0000 7ff27affd700 1 --2- 172.21.15.149:0/2474093234 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff26806af00 0x7ff26806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:58.618 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.607+0000 7ff263fff700 1 -- 172.21.15.149:0/2474093234 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7737+0+0 (secure 0 0 0) 0x7ff270089b10 con 0x7ff27c06b230 2023-11-08T19:29:58.618 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.608+0000 7ff27affd700 1 --2- 172.21.15.149:0/2474093234 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff26806af00 0x7ff26806d3c0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7ff27c0ca560 tx=0x7ff26c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:58.619 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.612+0000 7ff263fff700 1 -- 172.21.15.149:0/2474093234 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff2700543e0 con 0x7ff27c06b230 2023-11-08T19:29:58.803 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.801+0000 7ff281aa0700 1 -- 172.21.15.149:0/2474093234 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff27c0afe40 con 0x7ff27c06b230 2023-11-08T19:29:58.803 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.802+0000 7ff263fff700 1 -- 172.21.15.149:0/2474093234 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v108) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff270057a00 con 0x7ff27c06b230 2023-11-08T19:29:58.803 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 1 2023-11-08T19:29:58.805 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.804+0000 7ff281aa0700 1 -- 172.21.15.149:0/2474093234 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff26806af00 msgr2=0x7ff26806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:58.805 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.804+0000 7ff281aa0700 1 --2- 172.21.15.149:0/2474093234 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff26806af00 0x7ff26806d3c0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7ff27c0ca560 tx=0x7ff26c009040 comp rx=0 tx=0).stop 2023-11-08T19:29:58.805 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.804+0000 7ff281aa0700 1 -- 172.21.15.149:0/2474093234 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff27c06b230 msgr2=0x7ff27c150970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:58.806 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.804+0000 7ff281aa0700 1 --2- 172.21.15.149:0/2474093234 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff27c06b230 0x7ff27c150970 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7ff27000e810 tx=0x7ff27000ebd0 comp rx=0 tx=0).stop 2023-11-08T19:29:58.806 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.804+0000 7ff281aa0700 1 -- 172.21.15.149:0/2474093234 shutdown_connections 2023-11-08T19:29:58.806 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.804+0000 7ff281aa0700 1 --2- 172.21.15.149:0/2474093234 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff26806af00 0x7ff26806d3c0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:58.806 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.804+0000 7ff281aa0700 1 --2- 172.21.15.149:0/2474093234 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff27c0d1060 0x7ff27c1f3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:58.807 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.804+0000 7ff281aa0700 1 --2- 172.21.15.149:0/2474093234 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff27c06b230 0x7ff27c150970 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:58.807 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.804+0000 7ff281aa0700 1 --2- 172.21.15.149:0/2474093234 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff27c0ccb90 0x7ff27c0b5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:58.807 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.804+0000 7ff281aa0700 1 -- 172.21.15.149:0/2474093234 >> 172.21.15.149:0/2474093234 conn(0x7ff27c072680 msgr2=0x7ff27c06ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:58.807 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.804+0000 7ff281aa0700 1 -- 172.21.15.149:0/2474093234 shutdown_connections 2023-11-08T19:29:58.807 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.804+0000 7ff281aa0700 1 -- 172.21.15.149:0/2474093234 wait complete. 2023-11-08T19:29:58.817 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-08T19:29:58.941 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.940+0000 7f0422139700 1 Processor -- start 2023-11-08T19:29:58.942 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.940+0000 7f0422139700 1 -- start start 2023-11-08T19:29:58.944 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.941+0000 7f0422139700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f041c0ce110 0x7f041c0ce5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:58.944 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.941+0000 7f0422139700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f041c0cfca0 0x7f041c0d0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:58.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.941+0000 7f0422139700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f041c15f980 con 0x7f041c15bac0 2023-11-08T19:29:58.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.941+0000 7f0422139700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f041c15bea0 con 0x7f041c0ce110 2023-11-08T19:29:58.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.941+0000 7f0422139700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f041c15fc60 con 0x7f041c0cfca0 2023-11-08T19:29:58.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.941+0000 7f041affd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f041c0ce110 0x7f041c0ce5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:58.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.941+0000 7f041b7fe700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f041c15bac0 0x7f041c0b7080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:47620/0 (socket says 172.21.15.149:47620) 2023-11-08T19:29:58.946 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.941+0000 7f041b7fe700 1 -- 172.21.15.149:0/3438536825 learned_addr learned my addr 172.21.15.149:0/3438536825 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:29:58.946 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.942+0000 7f041bfff700 1 --2- 172.21.15.149:0/3438536825 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f041c0cfca0 0x7f041c0d0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:58.946 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.942+0000 7f041affd700 1 -- 172.21.15.149:0/3438536825 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f041c0cfca0 msgr2=0x7f041c0d0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:58.947 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.942+0000 7f041affd700 1 --2- 172.21.15.149:0/3438536825 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f041c0cfca0 0x7f041c0d0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:58.947 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.942+0000 7f041affd700 1 -- 172.21.15.149:0/3438536825 >> v1:172.21.15.149:6789/0 conn(0x7f041c15bac0 legacy=0x7f041c0b7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:58.947 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.942+0000 7f041affd700 1 -- 172.21.15.149:0/3438536825 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f041c15ff40 con 0x7f041c0ce110 2023-11-08T19:29:58.947 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.942+0000 7f041a7fc700 1 -- 172.21.15.149:0/3438536825 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4220278304 0 0) 0x7f041c15f980 con 0x7f041c15bac0 2023-11-08T19:29:58.948 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.942+0000 7f041affd700 1 --2- 172.21.15.149:0/3438536825 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f041c0ce110 0x7f041c0ce5c0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f040c009840 tx=0x7f040c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fa321a8ff628e23 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:58.948 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.942+0000 7f041a7fc700 1 -- 172.21.15.149:0/3438536825 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040c011830 con 0x7f041c0ce110 2023-11-08T19:29:58.948 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.942+0000 7f041a7fc700 1 -- 172.21.15.149:0/3438536825 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f040c011990 con 0x7f041c0ce110 2023-11-08T19:29:58.948 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.942+0000 7f041a7fc700 1 -- 172.21.15.149:0/3438536825 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040c011d20 con 0x7f041c0ce110 2023-11-08T19:29:58.949 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.942+0000 7f0422139700 1 -- 172.21.15.149:0/3438536825 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f041c0ce110 msgr2=0x7f041c0ce5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:58.949 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.942+0000 7f0422139700 1 --2- 172.21.15.149:0/3438536825 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f041c0ce110 0x7f041c0ce5c0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f040c009840 tx=0x7f040c009b50 comp rx=0 tx=0).stop 2023-11-08T19:29:58.949 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.942+0000 7f0422139700 1 -- 172.21.15.149:0/3438536825 shutdown_connections 2023-11-08T19:29:58.949 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.942+0000 7f0422139700 1 --2- 172.21.15.149:0/3438536825 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f041c0cfca0 0x7f041c0d0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:58.949 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.942+0000 7f0422139700 1 --2- 172.21.15.149:0/3438536825 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f041c0ce110 0x7f041c0ce5c0 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:58.950 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.943+0000 7f0422139700 1 -- 172.21.15.149:0/3438536825 >> 172.21.15.149:0/3438536825 conn(0x7f041c06f260 msgr2=0x7f041c06f640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:58.950 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.943+0000 7f0422139700 1 -- 172.21.15.149:0/3438536825 shutdown_connections 2023-11-08T19:29:58.950 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.943+0000 7f0422139700 1 -- 172.21.15.149:0/3438536825 wait complete. 2023-11-08T19:29:58.952 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.944+0000 7f0422139700 1 Processor -- start 2023-11-08T19:29:58.953 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.944+0000 7f0422139700 1 -- start start 2023-11-08T19:29:58.953 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.945+0000 7f0422139700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f041c0ce110 0x7f041c159fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:58.953 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.945+0000 7f0422139700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f041c0cfca0 0x7f041c15a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:58.953 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.945+0000 7f0422139700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f041c15bac0 0x7f041c1f0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:58.953 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.945+0000 7f0422139700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041c0b1c90 con 0x7f041c15bac0 2023-11-08T19:29:58.954 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.945+0000 7f0422139700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041c0b1f70 con 0x7f041c0cfca0 2023-11-08T19:29:58.954 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.945+0000 7f0422139700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f041c0b2250 con 0x7f041c0ce110 2023-11-08T19:29:58.954 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.945+0000 7f041bfff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f041c15bac0 0x7f041c1f0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:58.954 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.945+0000 7f041bfff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f041c15bac0 0x7f041c1f0d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45626/0 (socket says 172.21.15.149:45626) 2023-11-08T19:29:58.955 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.945+0000 7f041bfff700 1 -- 172.21.15.149:0/2672273527 learned_addr learned my addr 172.21.15.149:0/2672273527 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:58.955 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.945+0000 7f041b7fe700 1 --2- 172.21.15.149:0/2672273527 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f041c0ce110 0x7f041c159fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:58.955 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.945+0000 7f041affd700 1 --2- 172.21.15.149:0/2672273527 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f041c0cfca0 0x7f041c15a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:58.955 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.945+0000 7f041bfff700 1 -- 172.21.15.149:0/2672273527 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f041c0ce110 msgr2=0x7f041c159fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:58.955 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.945+0000 7f041bfff700 1 --2- 172.21.15.149:0/2672273527 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f041c0ce110 0x7f041c159fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:58.956 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.945+0000 7f041bfff700 1 -- 172.21.15.149:0/2672273527 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f041c0cfca0 msgr2=0x7f041c15a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:58.956 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.945+0000 7f041bfff700 1 --2- 172.21.15.149:0/2672273527 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f041c0cfca0 0x7f041c15a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:58.956 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.945+0000 7f041bfff700 1 -- 172.21.15.149:0/2672273527 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f040c0094a0 con 0x7f041c15bac0 2023-11-08T19:29:58.956 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.945+0000 7f041b7fe700 1 --2- 172.21.15.149:0/2672273527 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f041c0ce110 0x7f041c159fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:29:58.956 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.945+0000 7f041bfff700 1 --2- 172.21.15.149:0/2672273527 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f041c15bac0 0x7f041c1f0d60 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f0414007e40 tx=0x7f041400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:58.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.945+0000 7f0403fff700 1 -- 172.21.15.149:0/2672273527 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041400eea0 con 0x7f041c15bac0 2023-11-08T19:29:58.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.945+0000 7f0403fff700 1 -- 172.21.15.149:0/2672273527 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0414014420 con 0x7f041c15bac0 2023-11-08T19:29:58.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.945+0000 7f0422139700 1 -- 172.21.15.149:0/2672273527 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f041c0b2530 con 0x7f041c15bac0 2023-11-08T19:29:58.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.945+0000 7f0403fff700 1 -- 172.21.15.149:0/2672273527 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04140147b0 con 0x7f041c15bac0 2023-11-08T19:29:58.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.945+0000 7f0422139700 1 -- 172.21.15.149:0/2672273527 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f041c15abb0 con 0x7f041c15bac0 2023-11-08T19:29:58.958 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.946+0000 7f0422139700 1 -- 172.21.15.149:0/2672273527 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f041c1f21d0 con 0x7f041c15bac0 2023-11-08T19:29:58.958 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.947+0000 7f0403fff700 1 -- 172.21.15.149:0/2672273527 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0414014910 con 0x7f041c15bac0 2023-11-08T19:29:58.958 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.947+0000 7f0403fff700 1 --2- 172.21.15.149:0/2672273527 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f040806af00 0x7f040806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:58.958 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.947+0000 7f0403fff700 1 -- 172.21.15.149:0/2672273527 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7737+0+0 (secure 0 0 0) 0x7f041408a610 con 0x7f041c15bac0 2023-11-08T19:29:58.958 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.947+0000 7f041b7fe700 1 --2- 172.21.15.149:0/2672273527 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f040806af00 0x7f040806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:58.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.948+0000 7f041b7fe700 1 --2- 172.21.15.149:0/2672273527 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f040806af00 0x7f040806d3c0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f0410007fd0 tx=0x7f0410009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:58.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:58.952+0000 7f0403fff700 1 -- 172.21.15.149:0/2672273527 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f041c1f21d0 con 0x7f041c15bac0 2023-11-08T19:29:59.142 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.141+0000 7f0422139700 1 -- 172.21.15.149:0/2672273527 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f041c1f21d0 con 0x7f041c15bac0 2023-11-08T19:29:59.142 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.141+0000 7f0403fff700 1 -- 172.21.15.149:0/2672273527 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v108) v1 ==== 103+0+11 (secure 0 0 0) 0x7f041c1f21d0 con 0x7f041c15bac0 2023-11-08T19:29:59.143 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:29:59.145 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.143+0000 7f0422139700 1 -- 172.21.15.149:0/2672273527 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f040806af00 msgr2=0x7f040806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:59.145 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.143+0000 7f0422139700 1 --2- 172.21.15.149:0/2672273527 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f040806af00 0x7f040806d3c0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f0410007fd0 tx=0x7f0410009040 comp rx=0 tx=0).stop 2023-11-08T19:29:59.145 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.143+0000 7f0422139700 1 -- 172.21.15.149:0/2672273527 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f041c15bac0 msgr2=0x7f041c1f0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:59.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.143+0000 7f0422139700 1 --2- 172.21.15.149:0/2672273527 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f041c15bac0 0x7f041c1f0d60 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f0414007e40 tx=0x7f041400e3c0 comp rx=0 tx=0).stop 2023-11-08T19:29:59.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.144+0000 7f0422139700 1 -- 172.21.15.149:0/2672273527 shutdown_connections 2023-11-08T19:29:59.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.144+0000 7f0422139700 1 --2- 172.21.15.149:0/2672273527 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f040806af00 0x7f040806d3c0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:59.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.144+0000 7f0422139700 1 --2- 172.21.15.149:0/2672273527 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f041c15bac0 0x7f041c1f0d60 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:59.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.144+0000 7f0422139700 1 --2- 172.21.15.149:0/2672273527 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f041c0ce110 0x7f041c159fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:59.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.144+0000 7f0422139700 1 --2- 172.21.15.149:0/2672273527 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f041c0cfca0 0x7f041c15a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:59.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.144+0000 7f0422139700 1 -- 172.21.15.149:0/2672273527 >> 172.21.15.149:0/2672273527 conn(0x7f041c06f260 msgr2=0x7f041c15c310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:59.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.144+0000 7f0422139700 1 -- 172.21.15.149:0/2672273527 shutdown_connections 2023-11-08T19:29:59.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.144+0000 7f0422139700 1 -- 172.21.15.149:0/2672273527 wait complete. 2023-11-08T19:29:59.157 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-08T19:29:59.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.281+0000 7f30fc989700 1 Processor -- start 2023-11-08T19:29:59.283 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.281+0000 7f30fc989700 1 -- start start 2023-11-08T19:29:59.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.282+0000 7f30fc989700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f30f815bac0 0x7f30f80b7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:59.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.282+0000 7f30fc989700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f30f80ce820 0x7f30f80cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:59.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.282+0000 7f30fc989700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30f815f980 con 0x7f30f80b75c0 2023-11-08T19:29:59.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.282+0000 7f30fc989700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30f815bea0 con 0x7f30f80ce820 2023-11-08T19:29:59.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.282+0000 7f30fc989700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30f815fc60 con 0x7f30f815bac0 2023-11-08T19:29:59.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.282+0000 7f30f6d9d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f30f80ce820 0x7f30f80cfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:59.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.282+0000 7f30f5d9b700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f30f80b75c0 0x7f30f80ce110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:47632/0 (socket says 172.21.15.149:47632) 2023-11-08T19:29:59.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.282+0000 7f30f5d9b700 1 -- 172.21.15.149:0/1987780332 learned_addr learned my addr 172.21.15.149:0/1987780332 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:29:59.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.282+0000 7f30f659c700 1 --2- 172.21.15.149:0/1987780332 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f30f815bac0 0x7f30f80b7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:59.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.282+0000 7f30f6d9d700 1 -- 172.21.15.149:0/1987780332 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f30f815bac0 msgr2=0x7f30f80b7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:59.287 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.282+0000 7f30f6d9d700 1 --2- 172.21.15.149:0/1987780332 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f30f815bac0 0x7f30f80b7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:59.287 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.282+0000 7f30f6d9d700 1 -- 172.21.15.149:0/1987780332 >> v1:172.21.15.149:6789/0 conn(0x7f30f80b75c0 legacy=0x7f30f80ce110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:59.287 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.282+0000 7f30f559a700 1 -- 172.21.15.149:0/1987780332 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1641312615 0 0) 0x7f30f815f980 con 0x7f30f80b75c0 2023-11-08T19:29:59.287 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.283+0000 7f30f6d9d700 1 -- 172.21.15.149:0/1987780332 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f815ff40 con 0x7f30f80ce820 2023-11-08T19:29:59.287 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.283+0000 7f30f6d9d700 1 --2- 172.21.15.149:0/1987780332 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30f80ce820 0x7f30f80cfca0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f30f0009d90 tx=0x7f30f000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd6d15b8b3a91409 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:59.288 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.283+0000 7f30f559a700 1 -- 172.21.15.149:0/1987780332 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f000e070 con 0x7f30f80ce820 2023-11-08T19:29:59.288 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.283+0000 7f30f559a700 1 -- 172.21.15.149:0/1987780332 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30f000bbd0 con 0x7f30f80ce820 2023-11-08T19:29:59.288 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.283+0000 7f30f559a700 1 -- 172.21.15.149:0/1987780332 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f0012430 con 0x7f30f80ce820 2023-11-08T19:29:59.288 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.283+0000 7f30fc989700 1 -- 172.21.15.149:0/1987780332 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30f80ce820 msgr2=0x7f30f80cfca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:59.289 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.283+0000 7f30fc989700 1 --2- 172.21.15.149:0/1987780332 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30f80ce820 0x7f30f80cfca0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f30f0009d90 tx=0x7f30f000b330 comp rx=0 tx=0).stop 2023-11-08T19:29:59.289 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.283+0000 7f30fc989700 1 -- 172.21.15.149:0/1987780332 shutdown_connections 2023-11-08T19:29:59.289 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.283+0000 7f30fc989700 1 --2- 172.21.15.149:0/1987780332 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30f80ce820 0x7f30f80cfca0 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:59.289 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.283+0000 7f30fc989700 1 --2- 172.21.15.149:0/1987780332 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f30f815bac0 0x7f30f80b7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:59.289 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.283+0000 7f30fc989700 1 -- 172.21.15.149:0/1987780332 >> 172.21.15.149:0/1987780332 conn(0x7f30f806f260 msgr2=0x7f30f806f640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:59.290 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.283+0000 7f30fc989700 1 -- 172.21.15.149:0/1987780332 shutdown_connections 2023-11-08T19:29:59.290 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.283+0000 7f30fc989700 1 -- 172.21.15.149:0/1987780332 wait complete. 2023-11-08T19:29:59.292 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.285+0000 7f30fc989700 1 Processor -- start 2023-11-08T19:29:59.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.285+0000 7f30fc989700 1 -- start start 2023-11-08T19:29:59.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.285+0000 7f30fc989700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f30f80b75c0 0x7f30f80b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:59.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.285+0000 7f30fc989700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30f80ce820 0x7f30f80d0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:59.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.286+0000 7f30fc989700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f30f815bac0 0x7f30f80d05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:59.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.286+0000 7f30fc989700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f80b3bd0 con 0x7f30f80ce820 2023-11-08T19:29:59.294 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.286+0000 7f30fc989700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f81f40f0 con 0x7f30f80b75c0 2023-11-08T19:29:59.294 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.286+0000 7f30fc989700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30f81f43d0 con 0x7f30f815bac0 2023-11-08T19:29:59.294 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.286+0000 7f30f5d9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30f80ce820 0x7f30f80d0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:59.294 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.286+0000 7f30f5d9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30f80ce820 0x7f30f80d0090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45638/0 (socket says 172.21.15.149:45638) 2023-11-08T19:29:59.294 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.286+0000 7f30f5d9b700 1 -- 172.21.15.149:0/3608155190 learned_addr learned my addr 172.21.15.149:0/3608155190 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:59.295 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.286+0000 7f30f6d9d700 1 --2- 172.21.15.149:0/3608155190 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f30f815bac0 0x7f30f80d05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:59.295 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.286+0000 7f30f659c700 1 --2- 172.21.15.149:0/3608155190 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f30f80b75c0 0x7f30f80b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:59.295 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.286+0000 7f30f5d9b700 1 -- 172.21.15.149:0/3608155190 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f30f815bac0 msgr2=0x7f30f80d05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:59.295 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.286+0000 7f30f5d9b700 1 --2- 172.21.15.149:0/3608155190 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f30f815bac0 0x7f30f80d05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:59.295 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.286+0000 7f30f5d9b700 1 -- 172.21.15.149:0/3608155190 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f30f80b75c0 msgr2=0x7f30f80b1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:59.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.286+0000 7f30f5d9b700 1 --2- 172.21.15.149:0/3608155190 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f30f80b75c0 0x7f30f80b1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:59.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.286+0000 7f30f5d9b700 1 -- 172.21.15.149:0/3608155190 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f0009a70 con 0x7f30f80ce820 2023-11-08T19:29:59.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.286+0000 7f30f6d9d700 1 --2- 172.21.15.149:0/3608155190 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f30f815bac0 0x7f30f80d05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:29:59.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.286+0000 7f30f5d9b700 1 --2- 172.21.15.149:0/3608155190 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30f80ce820 0x7f30f80d0090 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f30e80011e0 tx=0x7f30e800cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:59.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.286+0000 7f30e6ffd700 1 -- 172.21.15.149:0/3608155190 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e8004c80 con 0x7f30f80ce820 2023-11-08T19:29:59.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.286+0000 7f30e6ffd700 1 -- 172.21.15.149:0/3608155190 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e8004e00 con 0x7f30f80ce820 2023-11-08T19:29:59.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.286+0000 7f30fc989700 1 -- 172.21.15.149:0/3608155190 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30f806bfb0 con 0x7f30f80ce820 2023-11-08T19:29:59.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.286+0000 7f30e6ffd700 1 -- 172.21.15.149:0/3608155190 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e8007310 con 0x7f30f80ce820 2023-11-08T19:29:59.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.286+0000 7f30fc989700 1 -- 172.21.15.149:0/3608155190 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30f806c570 con 0x7f30f80ce820 2023-11-08T19:29:59.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.287+0000 7f30fc989700 1 -- 172.21.15.149:0/3608155190 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30f806c790 con 0x7f30f80ce820 2023-11-08T19:29:59.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.288+0000 7f30e6ffd700 1 -- 172.21.15.149:0/3608155190 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f30e8007470 con 0x7f30f80ce820 2023-11-08T19:29:59.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.288+0000 7f30e6ffd700 1 --2- 172.21.15.149:0/3608155190 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f30d806af00 0x7f30d806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:59.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.288+0000 7f30e6ffd700 1 -- 172.21.15.149:0/3608155190 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7737+0+0 (secure 0 0 0) 0x7f30e808a0a0 con 0x7f30f80ce820 2023-11-08T19:29:59.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.288+0000 7f30f659c700 1 --2- 172.21.15.149:0/3608155190 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f30d806af00 0x7f30d806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:59.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.289+0000 7f30f659c700 1 --2- 172.21.15.149:0/3608155190 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f30d806af00 0x7f30d806d3c0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f30f80caa50 tx=0x7f30ec008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:59.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.293+0000 7f30e6ffd700 1 -- 172.21.15.149:0/3608155190 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f30e8054ad0 con 0x7f30f80ce820 2023-11-08T19:29:59.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.482+0000 7f30fc989700 1 -- 172.21.15.149:0/3608155190 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7f30f8074f10 con 0x7f30f80ce820 2023-11-08T19:29:59.484 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.482+0000 7f30e6ffd700 1 -- 172.21.15.149:0/3608155190 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v108) v1 ==== 103+0+11 (secure 0 0 0) 0x7f30e80580f0 con 0x7f30f80ce820 2023-11-08T19:29:59.484 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:29:59.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.485+0000 7f30fc989700 1 -- 172.21.15.149:0/3608155190 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f30d806af00 msgr2=0x7f30d806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:59.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.485+0000 7f30fc989700 1 --2- 172.21.15.149:0/3608155190 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f30d806af00 0x7f30d806d3c0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f30f80caa50 tx=0x7f30ec008040 comp rx=0 tx=0).stop 2023-11-08T19:29:59.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.485+0000 7f30fc989700 1 -- 172.21.15.149:0/3608155190 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30f80ce820 msgr2=0x7f30f80d0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:59.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.485+0000 7f30fc989700 1 --2- 172.21.15.149:0/3608155190 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30f80ce820 0x7f30f80d0090 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f30e80011e0 tx=0x7f30e800cae0 comp rx=0 tx=0).stop 2023-11-08T19:29:59.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.485+0000 7f30fc989700 1 -- 172.21.15.149:0/3608155190 shutdown_connections 2023-11-08T19:29:59.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.485+0000 7f30fc989700 1 --2- 172.21.15.149:0/3608155190 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f30d806af00 0x7f30d806d3c0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:59.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.485+0000 7f30fc989700 1 --2- 172.21.15.149:0/3608155190 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f30f80b75c0 0x7f30f80b1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:59.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.485+0000 7f30fc989700 1 --2- 172.21.15.149:0/3608155190 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f30f815bac0 0x7f30f80d05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:59.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.485+0000 7f30fc989700 1 --2- 172.21.15.149:0/3608155190 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30f80ce820 0x7f30f80d0090 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:59.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.485+0000 7f30fc989700 1 -- 172.21.15.149:0/3608155190 >> 172.21.15.149:0/3608155190 conn(0x7f30f806f260 msgr2=0x7f30f815e7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:59.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.485+0000 7f30fc989700 1 -- 172.21.15.149:0/3608155190 shutdown_connections 2023-11-08T19:29:59.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.485+0000 7f30fc989700 1 -- 172.21.15.149:0/3608155190 wait complete. 2023-11-08T19:29:59.498 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-08T19:29:59.621 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.620+0000 7f974d225700 1 Processor -- start 2023-11-08T19:29:59.622 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.620+0000 7f974d225700 1 -- start start 2023-11-08T19:29:59.624 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.621+0000 7f974d225700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f974815bac0 0x7f97480b7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:59.624 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.621+0000 7f974d225700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97480b75c0 0x7f97480ce110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:59.624 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.621+0000 7f974d225700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f974815f980 con 0x7f97480ce650 2023-11-08T19:29:59.624 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.621+0000 7f974d225700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f974815bea0 con 0x7f974815bac0 2023-11-08T19:29:59.625 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.621+0000 7f974d225700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f974815fc60 con 0x7f97480b75c0 2023-11-08T19:29:59.625 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.621+0000 7f9746d9d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f974815bac0 0x7f97480b7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:59.625 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.622+0000 7f9746d9d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f974815bac0 0x7f97480b7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45644/0 (socket says 172.21.15.149:45644) 2023-11-08T19:29:59.625 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.622+0000 7f9746d9d700 1 -- 172.21.15.149:0/780523746 learned_addr learned my addr 172.21.15.149:0/780523746 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:59.625 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.622+0000 7f974659c700 1 --2- 172.21.15.149:0/780523746 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97480b75c0 0x7f97480ce110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:59.626 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.622+0000 7f9746d9d700 1 -- 172.21.15.149:0/780523746 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97480b75c0 msgr2=0x7f97480ce110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:59.626 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.622+0000 7f9746d9d700 1 --2- 172.21.15.149:0/780523746 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97480b75c0 0x7f97480ce110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:59.626 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.622+0000 7f9746d9d700 1 -- 172.21.15.149:0/780523746 >> v1:172.21.15.160:6789/0 conn(0x7f97480ce650 legacy=0x7f97480b32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:59.626 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.622+0000 7f9746d9d700 1 -- 172.21.15.149:0/780523746 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f974815ff40 con 0x7f974815bac0 2023-11-08T19:29:59.627 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.622+0000 7f9746d9d700 1 --2- 172.21.15.149:0/780523746 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f974815bac0 0x7f97480b7080 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f973c0098f0 tx=0x7f973c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81872e0d9da6059 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:59.627 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.622+0000 7f9745d9b700 1 -- 172.21.15.149:0/780523746 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973c004230 con 0x7f974815bac0 2023-11-08T19:29:59.627 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.622+0000 7f9745d9b700 1 -- 172.21.15.149:0/780523746 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f973c004390 con 0x7f974815bac0 2023-11-08T19:29:59.627 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.622+0000 7f9745d9b700 1 -- 172.21.15.149:0/780523746 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973c0036a0 con 0x7f974815bac0 2023-11-08T19:29:59.627 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.623+0000 7f974d225700 1 -- 172.21.15.149:0/780523746 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f974815bac0 msgr2=0x7f97480b7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:59.627 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.623+0000 7f974d225700 1 --2- 172.21.15.149:0/780523746 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f974815bac0 0x7f97480b7080 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f973c0098f0 tx=0x7f973c009c00 comp rx=0 tx=0).stop 2023-11-08T19:29:59.628 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.623+0000 7f974d225700 1 -- 172.21.15.149:0/780523746 shutdown_connections 2023-11-08T19:29:59.628 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.623+0000 7f974d225700 1 --2- 172.21.15.149:0/780523746 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f974815bac0 0x7f97480b7080 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:59.628 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.623+0000 7f974d225700 1 --2- 172.21.15.149:0/780523746 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97480b75c0 0x7f97480ce110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:59.628 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.623+0000 7f974d225700 1 -- 172.21.15.149:0/780523746 >> 172.21.15.149:0/780523746 conn(0x7f974806f260 msgr2=0x7f974806f640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:59.628 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.623+0000 7f974d225700 1 -- 172.21.15.149:0/780523746 shutdown_connections 2023-11-08T19:29:59.629 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.623+0000 7f974d225700 1 -- 172.21.15.149:0/780523746 wait complete. 2023-11-08T19:29:59.631 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.624+0000 7f974d225700 1 Processor -- start 2023-11-08T19:29:59.631 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.624+0000 7f974d225700 1 -- start start 2023-11-08T19:29:59.632 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.625+0000 7f974d225700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97480b75c0 0x7f974814ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:59.632 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.625+0000 7f974d225700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97480ce650 0x7f97480b3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:59.632 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.625+0000 7f974d225700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f974815bac0 0x7f97481f17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:59.632 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.625+0000 7f974d225700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97480c6320 con 0x7f97480ce650 2023-11-08T19:29:59.632 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.625+0000 7f974d225700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f974814f260 con 0x7f97480b75c0 2023-11-08T19:29:59.633 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.625+0000 7f974d225700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9748158ef0 con 0x7f974815bac0 2023-11-08T19:29:59.633 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.625+0000 7f974659c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97480ce650 0x7f97480b3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:59.633 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.625+0000 7f974659c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97480ce650 0x7f97480b3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45652/0 (socket says 172.21.15.149:45652) 2023-11-08T19:29:59.633 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.625+0000 7f974659c700 1 -- 172.21.15.149:0/1491243230 learned_addr learned my addr 172.21.15.149:0/1491243230 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:59.633 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.625+0000 7f9746d9d700 1 --2- 172.21.15.149:0/1491243230 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97480b75c0 0x7f974814ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:59.634 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.625+0000 7f974759e700 1 --2- 172.21.15.149:0/1491243230 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f974815bac0 0x7f97481f17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:59.634 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.625+0000 7f974659c700 1 -- 172.21.15.149:0/1491243230 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f974815bac0 msgr2=0x7f97481f17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:59.634 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.625+0000 7f974659c700 1 --2- 172.21.15.149:0/1491243230 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f974815bac0 0x7f97481f17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:59.634 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.625+0000 7f974659c700 1 -- 172.21.15.149:0/1491243230 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97480b75c0 msgr2=0x7f974814ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:59.634 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.625+0000 7f974659c700 1 --2- 172.21.15.149:0/1491243230 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97480b75c0 0x7f974814ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:59.635 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.625+0000 7f974659c700 1 -- 172.21.15.149:0/1491243230 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f973c009550 con 0x7f97480ce650 2023-11-08T19:29:59.635 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.625+0000 7f974759e700 1 --2- 172.21.15.149:0/1491243230 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f974815bac0 0x7f97481f17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:29:59.635 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.626+0000 7f974659c700 1 --2- 172.21.15.149:0/1491243230 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97480ce650 0x7f97480b3c20 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f973800e810 tx=0x7f973800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:59.635 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.626+0000 7f972f7fe700 1 -- 172.21.15.149:0/1491243230 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9738013610 con 0x7f97480ce650 2023-11-08T19:29:59.635 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.626+0000 7f972f7fe700 1 -- 172.21.15.149:0/1491243230 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9738013770 con 0x7f97480ce650 2023-11-08T19:29:59.636 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.626+0000 7f972f7fe700 1 -- 172.21.15.149:0/1491243230 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9738013b20 con 0x7f97480ce650 2023-11-08T19:29:59.636 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.626+0000 7f974d225700 1 -- 172.21.15.149:0/1491243230 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97480b4160 con 0x7f97480ce650 2023-11-08T19:29:59.636 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.626+0000 7f974d225700 1 -- 172.21.15.149:0/1491243230 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97480c6dd0 con 0x7f97480ce650 2023-11-08T19:29:59.636 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.627+0000 7f974d225700 1 -- 172.21.15.149:0/1491243230 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97480c7700 con 0x7f97480ce650 2023-11-08T19:29:59.636 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.628+0000 7f972f7fe700 1 -- 172.21.15.149:0/1491243230 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9738013c80 con 0x7f97480ce650 2023-11-08T19:29:59.636 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.628+0000 7f972f7fe700 1 --2- 172.21.15.149:0/1491243230 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f973406af00 0x7f973406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:59.637 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.628+0000 7f972f7fe700 1 -- 172.21.15.149:0/1491243230 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7737+0+0 (secure 0 0 0) 0x7f9738089ab0 con 0x7f97480ce650 2023-11-08T19:29:59.637 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.628+0000 7f9746d9d700 1 --2- 172.21.15.149:0/1491243230 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f973406af00 0x7f973406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:59.637 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.629+0000 7f9746d9d700 1 --2- 172.21.15.149:0/1491243230 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f973406af00 0x7f973406d3c0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f973c009c40 tx=0x7f973c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:59.637 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.633+0000 7f972f7fe700 1 -- 172.21.15.149:0/1491243230 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f97380542f0 con 0x7f97480ce650 2023-11-08T19:29:59.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.823+0000 7f974d225700 1 -- 172.21.15.149:0/1491243230 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7f9748074f10 con 0x7f97480ce650 2023-11-08T19:29:59.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.823+0000 7f972f7fe700 1 -- 172.21.15.149:0/1491243230 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v108) v1 ==== 107+0+11 (secure 0 0 0) 0x7f9738057910 con 0x7f97480ce650 2023-11-08T19:29:59.825 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:29:59.827 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.826+0000 7f974d225700 1 -- 172.21.15.149:0/1491243230 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f973406af00 msgr2=0x7f973406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:59.827 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.826+0000 7f974d225700 1 --2- 172.21.15.149:0/1491243230 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f973406af00 0x7f973406d3c0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f973c009c40 tx=0x7f973c008030 comp rx=0 tx=0).stop 2023-11-08T19:29:59.827 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.826+0000 7f974d225700 1 -- 172.21.15.149:0/1491243230 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97480ce650 msgr2=0x7f97480b3c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:59.827 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.826+0000 7f974d225700 1 --2- 172.21.15.149:0/1491243230 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97480ce650 0x7f97480b3c20 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f973800e810 tx=0x7f973800ebd0 comp rx=0 tx=0).stop 2023-11-08T19:29:59.828 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.826+0000 7f974d225700 1 -- 172.21.15.149:0/1491243230 shutdown_connections 2023-11-08T19:29:59.828 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.826+0000 7f974d225700 1 --2- 172.21.15.149:0/1491243230 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f973406af00 0x7f973406d3c0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:59.828 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.826+0000 7f974d225700 1 --2- 172.21.15.149:0/1491243230 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97480b75c0 0x7f974814ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:59.828 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.826+0000 7f974d225700 1 --2- 172.21.15.149:0/1491243230 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f974815bac0 0x7f97481f17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:59.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.826+0000 7f974d225700 1 --2- 172.21.15.149:0/1491243230 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97480ce650 0x7f97480b3c20 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:59.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.826+0000 7f974d225700 1 -- 172.21.15.149:0/1491243230 >> 172.21.15.149:0/1491243230 conn(0x7f974806f260 msgr2=0x7f974815c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:59.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.826+0000 7f974d225700 1 -- 172.21.15.149:0/1491243230 shutdown_connections 2023-11-08T19:29:59.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.826+0000 7f974d225700 1 -- 172.21.15.149:0/1491243230 wait complete. 2023-11-08T19:29:59.839 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-08T19:29:59.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.962+0000 7f5096b75700 1 Processor -- start 2023-11-08T19:29:59.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.962+0000 7f5096b75700 1 -- start start 2023-11-08T19:29:59.967 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.963+0000 7f5096b75700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f509015dee0 0x7f50900cbec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:59.968 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.963+0000 7f5096b75700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f509006bdd0 con 0x7f50900cd0a0 2023-11-08T19:29:59.968 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.963+0000 7f5096b75700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f509006c070 con 0x7f509015db00 2023-11-08T19:29:59.968 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.963+0000 7f5096b75700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50900cc400 con 0x7f509015dee0 2023-11-08T19:29:59.968 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.963+0000 7f5095112700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f50900cd0a0 0x7f509015e5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:47664/0 (socket says 172.21.15.149:47664) 2023-11-08T19:29:59.968 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.963+0000 7f5095112700 1 -- 172.21.15.149:0/1405369834 learned_addr learned my addr 172.21.15.149:0/1405369834 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:29:59.969 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.963+0000 7f508ffff700 1 --2- 172.21.15.149:0/1405369834 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f509015dee0 0x7f50900cbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:59.969 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.964+0000 7f508f7fe700 1 -- 172.21.15.149:0/1405369834 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1988353678 0 0) 0x7f509006bdd0 con 0x7f50900cd0a0 2023-11-08T19:29:59.969 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.964+0000 7f508f7fe700 1 -- 172.21.15.149:0/1405369834 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50800035b0 con 0x7f50900cd0a0 2023-11-08T19:29:59.969 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.964+0000 7f508f7fe700 1 -- 172.21.15.149:0/1405369834 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3076961636 0 0) 0x7f50800035b0 con 0x7f50900cd0a0 2023-11-08T19:29:59.969 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.964+0000 7f508f7fe700 1 -- 172.21.15.149:0/1405369834 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f509015dee0 msgr2=0x7f50900cbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:59.970 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.964+0000 7f508f7fe700 1 --2- 172.21.15.149:0/1405369834 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f509015dee0 0x7f50900cbec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:59.970 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.964+0000 7f508f7fe700 1 -- 172.21.15.149:0/1405369834 >> v1:172.21.15.160:6789/0 conn(0x7f509015db00 legacy=0x7f5090072a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:59.970 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.964+0000 7f508f7fe700 1 -- 172.21.15.149:0/1405369834 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f509006c350 con 0x7f50900cd0a0 2023-11-08T19:29:59.971 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.964+0000 7f508f7fe700 1 -- 172.21.15.149:0/1405369834 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f50880019f0 con 0x7f50900cd0a0 2023-11-08T19:29:59.971 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.964+0000 7f508f7fe700 1 -- 172.21.15.149:0/1405369834 >> v1:172.21.15.149:6789/0 conn(0x7f50900cd0a0 legacy=0x7f509015e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:59.971 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.964+0000 7f508f7fe700 1 --2- 172.21.15.149:0/1405369834 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f509015dee0 0x7f5080003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:59.971 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.964+0000 7f508f7fe700 1 --2- 172.21.15.149:0/1405369834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5080003fb0 0x7f5080004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:59.971 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.964+0000 7f508f7fe700 1 --2- 172.21.15.149:0/1405369834 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5080004d90 0x7f5080005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:59.971 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.964+0000 7f508f7fe700 1 -- 172.21.15.149:0/1405369834 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50900cc400 con 0x7f5080003fb0 2023-11-08T19:29:59.972 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.964+0000 7f508f7fe700 1 -- 172.21.15.149:0/1405369834 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f508000dd00 con 0x7f5080004d90 2023-11-08T19:29:59.972 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.964+0000 7f508f7fe700 1 -- 172.21.15.149:0/1405369834 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f508000dec0 con 0x7f509015dee0 2023-11-08T19:29:59.974 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.964+0000 7f508ffff700 1 --2- 172.21.15.149:0/1405369834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5080003fb0 0x7f5080004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:59.974 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.964+0000 7f5094911700 1 --2- 172.21.15.149:0/1405369834 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f509015dee0 0x7f5080003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:59.974 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.964+0000 7f5095112700 1 --2- 172.21.15.149:0/1405369834 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5080004d90 0x7f5080005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:59.975 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.964+0000 7f508ffff700 1 -- 172.21.15.149:0/1405369834 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f509015dee0 msgr2=0x7f5080003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:59.975 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.964+0000 7f508ffff700 1 --2- 172.21.15.149:0/1405369834 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f509015dee0 0x7f5080003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:59.976 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.964+0000 7f508ffff700 1 -- 172.21.15.149:0/1405369834 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5080004d90 msgr2=0x7f5080005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:29:59.976 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.964+0000 7f508ffff700 1 --2- 172.21.15.149:0/1405369834 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5080004d90 0x7f5080005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:59.977 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.964+0000 7f508ffff700 1 -- 172.21.15.149:0/1405369834 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50800035b0 con 0x7f5080003fb0 2023-11-08T19:29:59.977 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.964+0000 7f508ffff700 1 --2- 172.21.15.149:0/1405369834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5080003fb0 0x7f5080004850 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f507c009b60 tx=0x7f5080005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a36924d60a40dcab server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:59.977 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.965+0000 7f508f7fe700 1 -- 172.21.15.149:0/1405369834 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507c00e6c0 con 0x7f5080003fb0 2023-11-08T19:29:59.978 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.965+0000 7f508f7fe700 1 -- 172.21.15.149:0/1405369834 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f507c00e820 con 0x7f5080003fb0 2023-11-08T19:29:59.978 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.965+0000 7f508f7fe700 1 -- 172.21.15.149:0/1405369834 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507c00eb90 con 0x7f5080003fb0 2023-11-08T19:29:59.978 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.965+0000 7f5096b75700 1 -- 172.21.15.149:0/1405369834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5080003fb0 msgr2=0x7f5080004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:59.979 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.965+0000 7f5096b75700 1 --2- 172.21.15.149:0/1405369834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5080003fb0 0x7f5080004850 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f507c009b60 tx=0x7f5080005880 comp rx=0 tx=0).stop 2023-11-08T19:29:59.979 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.965+0000 7f5095112700 1 -- 172.21.15.149:0/1405369834 reap_dead start 2023-11-08T19:29:59.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.965+0000 7f5096b75700 1 -- 172.21.15.149:0/1405369834 shutdown_connections 2023-11-08T19:29:59.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.965+0000 7f5096b75700 1 -- 172.21.15.149:0/1405369834 >> 172.21.15.149:0/1405369834 conn(0x7f509006e0d0 msgr2=0x7f509006e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:29:59.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.965+0000 7f5096b75700 1 -- 172.21.15.149:0/1405369834 shutdown_connections 2023-11-08T19:29:59.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.965+0000 7f5096b75700 1 -- 172.21.15.149:0/1405369834 wait complete. 2023-11-08T19:29:59.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.966+0000 7f5096b75700 1 Processor -- start 2023-11-08T19:29:59.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.966+0000 7f5096b75700 1 -- start start 2023-11-08T19:29:59.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.967+0000 7f5096b75700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5080003fb0 0x7f50900af3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:59.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.967+0000 7f5096b75700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f50900c7790 0x7f509015a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:59.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.967+0000 7f5096b75700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50900c9260 0x7f50900c96e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:59.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.967+0000 7f5096b75700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50900c9f30 con 0x7f50900c9260 2023-11-08T19:29:59.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.967+0000 7f5096b75700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50900ca1d0 con 0x7f50900c7790 2023-11-08T19:29:59.987 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.967+0000 7f5096b75700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50900ca4b0 con 0x7f5080003fb0 2023-11-08T19:29:59.987 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.967+0000 7f5095112700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50900c9260 0x7f50900c96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:59.987 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.967+0000 7f5095112700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50900c9260 0x7f50900c96e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45674/0 (socket says 172.21.15.149:45674) 2023-11-08T19:29:59.987 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.967+0000 7f5095112700 1 -- 172.21.15.149:0/3627354211 learned_addr learned my addr 172.21.15.149:0/3627354211 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:29:59.988 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.968+0000 7f508ffff700 1 --2- 172.21.15.149:0/3627354211 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f50900c7790 0x7f509015a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:59.988 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.968+0000 7f5094911700 1 --2- 172.21.15.149:0/3627354211 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5080003fb0 0x7f50900af3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:59.988 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.968+0000 7f5095112700 1 -- 172.21.15.149:0/3627354211 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5080003fb0 msgr2=0x7f50900af3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:59.988 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.968+0000 7f5095112700 1 --2- 172.21.15.149:0/3627354211 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5080003fb0 0x7f50900af3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:59.988 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.968+0000 7f5095112700 1 -- 172.21.15.149:0/3627354211 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f50900c7790 msgr2=0x7f509015a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:29:59.989 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.968+0000 7f5095112700 1 --2- 172.21.15.149:0/3627354211 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f50900c7790 0x7f509015a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:29:59.989 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.968+0000 7f5095112700 1 -- 172.21.15.149:0/3627354211 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50900ca790 con 0x7f50900c9260 2023-11-08T19:29:59.989 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.968+0000 7f5095112700 1 --2- 172.21.15.149:0/3627354211 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50900c9260 0x7f50900c96e0 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f5088000f80 tx=0x7f508800a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:59.989 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.968+0000 7f508d7fa700 1 -- 172.21.15.149:0/3627354211 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508800ad60 con 0x7f50900c9260 2023-11-08T19:29:59.989 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.968+0000 7f508d7fa700 1 -- 172.21.15.149:0/3627354211 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50880133f0 con 0x7f50900c9260 2023-11-08T19:29:59.990 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.968+0000 7f508d7fa700 1 -- 172.21.15.149:0/3627354211 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50880137a0 con 0x7f50900c9260 2023-11-08T19:29:59.990 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.968+0000 7f5096b75700 1 -- 172.21.15.149:0/3627354211 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f509015b180 con 0x7f50900c9260 2023-11-08T19:29:59.990 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.968+0000 7f5096b75700 1 -- 172.21.15.149:0/3627354211 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f509015a660 con 0x7f50900c9260 2023-11-08T19:29:59.990 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.969+0000 7f5096b75700 1 -- 172.21.15.149:0/3627354211 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50900ca980 con 0x7f50900c9260 2023-11-08T19:29:59.991 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.969+0000 7f508d7fa700 1 -- 172.21.15.149:0/3627354211 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5088013900 con 0x7f50900c9260 2023-11-08T19:29:59.991 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.970+0000 7f508d7fa700 1 --2- 172.21.15.149:0/3627354211 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f507406af00 0x7f507406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:29:59.991 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.970+0000 7f508d7fa700 1 -- 172.21.15.149:0/3627354211 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7737+0+0 (secure 0 0 0) 0x7f508808aa20 con 0x7f50900c9260 2023-11-08T19:29:59.991 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.970+0000 7f5094911700 1 --2- 172.21.15.149:0/3627354211 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f507406af00 0x7f507406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:29:59.992 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.970+0000 7f5094911700 1 --2- 172.21.15.149:0/3627354211 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f507406af00 0x7f507406d3c0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f5084007fd0 tx=0x7f5084009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:29:59.992 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:29:59.975+0000 7f508d7fa700 1 -- 172.21.15.149:0/3627354211 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f50880552e0 con 0x7f50900c9260 2023-11-08T19:30:00.165 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.164+0000 7f5096b75700 1 -- 172.21.15.149:0/3627354211 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5090074f10 con 0x7f50900c9260 2023-11-08T19:30:00.166 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.165+0000 7f508d7fa700 1 -- 172.21.15.149:0/3627354211 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v108) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5088058900 con 0x7f50900c9260 2023-11-08T19:30:00.166 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-11-08T19:30:00.168 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.167+0000 7f5096b75700 1 -- 172.21.15.149:0/3627354211 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f507406af00 msgr2=0x7f507406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:00.168 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.167+0000 7f5096b75700 1 --2- 172.21.15.149:0/3627354211 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f507406af00 0x7f507406d3c0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f5084007fd0 tx=0x7f5084009040 comp rx=0 tx=0).stop 2023-11-08T19:30:00.168 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.167+0000 7f5096b75700 1 -- 172.21.15.149:0/3627354211 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50900c9260 msgr2=0x7f50900c96e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:00.169 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.167+0000 7f5096b75700 1 --2- 172.21.15.149:0/3627354211 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50900c9260 0x7f50900c96e0 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f5088000f80 tx=0x7f508800a5f0 comp rx=0 tx=0).stop 2023-11-08T19:30:00.169 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.167+0000 7f5096b75700 1 -- 172.21.15.149:0/3627354211 shutdown_connections 2023-11-08T19:30:00.169 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.167+0000 7f5096b75700 1 --2- 172.21.15.149:0/3627354211 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f507406af00 0x7f507406d3c0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:00.169 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.167+0000 7f5096b75700 1 --2- 172.21.15.149:0/3627354211 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50900c9260 0x7f50900c96e0 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:00.169 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.167+0000 7f5096b75700 1 --2- 172.21.15.149:0/3627354211 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5080003fb0 0x7f50900af3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:00.170 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.167+0000 7f5096b75700 1 --2- 172.21.15.149:0/3627354211 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f50900c7790 0x7f509015a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:00.170 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.167+0000 7f5096b75700 1 -- 172.21.15.149:0/3627354211 >> 172.21.15.149:0/3627354211 conn(0x7f509006e0d0 msgr2=0x7f509015cba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:00.170 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.167+0000 7f5096b75700 1 -- 172.21.15.149:0/3627354211 shutdown_connections 2023-11-08T19:30:00.170 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.167+0000 7f5096b75700 1 -- 172.21.15.149:0/3627354211 wait complete. 2023-11-08T19:30:00.180 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-08T19:30:00.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.308+0000 7f2d84473700 1 Processor -- start 2023-11-08T19:30:00.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.308+0000 7f2d84473700 1 -- start start 2023-11-08T19:30:00.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.308+0000 7f2d84473700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d7c15bac0 0x7f2d7c0b7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:00.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.308+0000 7f2d84473700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f2d7c0b75c0 0x7f2d7c0ce110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:00.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.309+0000 7f2d84473700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2d7c0ce650 0x7f2d7c0b32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:00.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.309+0000 7f2d84473700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d7c15bea0 con 0x7f2d7c0ce650 2023-11-08T19:30:00.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.309+0000 7f2d84473700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d7c15f980 con 0x7f2d7c0b75c0 2023-11-08T19:30:00.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.309+0000 7f2d84473700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7c15fc60 con 0x7f2d7c15bac0 2023-11-08T19:30:00.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.309+0000 7f2d82a10700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2d7c0ce650 0x7f2d7c0b32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:00.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.309+0000 7f2d82a10700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2d7c0ce650 0x7f2d7c0b32c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45682/0 (socket says 172.21.15.149:45682) 2023-11-08T19:30:00.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.309+0000 7f2d82a10700 1 -- 172.21.15.149:0/545072206 learned_addr learned my addr 172.21.15.149:0/545072206 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:30:00.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.309+0000 7f2d8220f700 1 --2- 172.21.15.149:0/545072206 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d7c15bac0 0x7f2d7c0b7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:00.314 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.309+0000 7f2d81a0e700 1 --2- 172.21.15.149:0/545072206 >> v2:172.21.15.160:3300/0 conn(0x7f2d7c0b75c0 0x7f2d7c0ce110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:00.314 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.309+0000 7f2d82a10700 1 -- 172.21.15.149:0/545072206 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d7c15bac0 msgr2=0x7f2d7c0b7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:30:00.314 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.309+0000 7f2d82a10700 1 --2- 172.21.15.149:0/545072206 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d7c15bac0 0x7f2d7c0b7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:00.314 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.309+0000 7f2d82a10700 1 -- 172.21.15.149:0/545072206 >> v2:172.21.15.160:3300/0 conn(0x7f2d7c0b75c0 msgr2=0x7f2d7c0ce110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:30:00.314 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.309+0000 7f2d82a10700 1 --2- 172.21.15.149:0/545072206 >> v2:172.21.15.160:3300/0 conn(0x7f2d7c0b75c0 0x7f2d7c0ce110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:00.315 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.309+0000 7f2d82a10700 1 -- 172.21.15.149:0/545072206 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d7c15ff40 con 0x7f2d7c0ce650 2023-11-08T19:30:00.315 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.309+0000 7f2d82a10700 1 --2- 172.21.15.149:0/545072206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d7c0ce650 0x7f2d7c0b32c0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c0cf3c0 tx=0x7f2d7400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec072d8966644a7d server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:00.315 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.309+0000 7f2d8120d700 1 -- 172.21.15.149:0/545072206 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7400e070 con 0x7f2d7c0ce650 2023-11-08T19:30:00.315 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.309+0000 7f2d8120d700 1 -- 172.21.15.149:0/545072206 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d7400b9c0 con 0x7f2d7c0ce650 2023-11-08T19:30:00.315 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.309+0000 7f2d8120d700 1 -- 172.21.15.149:0/545072206 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7400bd70 con 0x7f2d7c0ce650 2023-11-08T19:30:00.316 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.310+0000 7f2d84473700 1 -- 172.21.15.149:0/545072206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d7c0ce650 msgr2=0x7f2d7c0b32c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:00.316 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.310+0000 7f2d84473700 1 --2- 172.21.15.149:0/545072206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d7c0ce650 0x7f2d7c0b32c0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c0cf3c0 tx=0x7f2d7400b330 comp rx=0 tx=0).stop 2023-11-08T19:30:00.316 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.310+0000 7f2d84473700 1 -- 172.21.15.149:0/545072206 shutdown_connections 2023-11-08T19:30:00.316 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.310+0000 7f2d84473700 1 --2- 172.21.15.149:0/545072206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d7c0ce650 0x7f2d7c0b32c0 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:00.316 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.310+0000 7f2d84473700 1 --2- 172.21.15.149:0/545072206 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d7c15bac0 0x7f2d7c0b7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:00.316 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.310+0000 7f2d84473700 1 --2- 172.21.15.149:0/545072206 >> v2:172.21.15.160:3300/0 conn(0x7f2d7c0b75c0 0x7f2d7c0ce110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:00.317 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.310+0000 7f2d84473700 1 -- 172.21.15.149:0/545072206 >> 172.21.15.149:0/545072206 conn(0x7f2d7c06f260 msgr2=0x7f2d7c06f640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:00.317 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.310+0000 7f2d84473700 1 -- 172.21.15.149:0/545072206 shutdown_connections 2023-11-08T19:30:00.317 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.310+0000 7f2d84473700 1 -- 172.21.15.149:0/545072206 wait complete. 2023-11-08T19:30:00.319 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.311+0000 7f2d84473700 1 Processor -- start 2023-11-08T19:30:00.320 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.311+0000 7f2d84473700 1 -- start start 2023-11-08T19:30:00.320 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.312+0000 7f2d84473700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2d7c0b75c0 0x7f2d7c0b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:00.320 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.312+0000 7f2d84473700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d7c0ce650 0x7f2d7c0b29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:00.320 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.312+0000 7f2d84473700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d7c15bac0 0x7f2d7c157ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:00.320 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.312+0000 7f2d84473700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7c1f33f0 con 0x7f2d7c0ce650 2023-11-08T19:30:00.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.312+0000 7f2d84473700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7c06cb70 con 0x7f2d7c0b75c0 2023-11-08T19:30:00.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.312+0000 7f2d84473700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7c06bff0 con 0x7f2d7c15bac0 2023-11-08T19:30:00.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.312+0000 7f2d81a0e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d7c0ce650 0x7f2d7c0b29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:00.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.312+0000 7f2d81a0e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d7c0ce650 0x7f2d7c0b29b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45686/0 (socket says 172.21.15.149:45686) 2023-11-08T19:30:00.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.312+0000 7f2d81a0e700 1 -- 172.21.15.149:0/72455299 learned_addr learned my addr 172.21.15.149:0/72455299 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:30:00.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.312+0000 7f2d82a10700 1 --2- 172.21.15.149:0/72455299 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d7c15bac0 0x7f2d7c157ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:00.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.312+0000 7f2d8220f700 1 --2- 172.21.15.149:0/72455299 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2d7c0b75c0 0x7f2d7c0b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:00.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.312+0000 7f2d81a0e700 1 -- 172.21.15.149:0/72455299 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d7c15bac0 msgr2=0x7f2d7c157ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:00.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.312+0000 7f2d81a0e700 1 --2- 172.21.15.149:0/72455299 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d7c15bac0 0x7f2d7c157ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:00.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.312+0000 7f2d81a0e700 1 -- 172.21.15.149:0/72455299 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2d7c0b75c0 msgr2=0x7f2d7c0b02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:00.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.312+0000 7f2d81a0e700 1 --2- 172.21.15.149:0/72455299 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2d7c0b75c0 0x7f2d7c0b02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:00.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.312+0000 7f2d81a0e700 1 -- 172.21.15.149:0/72455299 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d74009b30 con 0x7f2d7c0ce650 2023-11-08T19:30:00.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.312+0000 7f2d82a10700 1 --2- 172.21.15.149:0/72455299 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d7c15bac0 0x7f2d7c157ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:30:00.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.312+0000 7f2d8220f700 1 --2- 172.21.15.149:0/72455299 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2d7c0b75c0 0x7f2d7c0b02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:30:00.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.312+0000 7f2d81a0e700 1 --2- 172.21.15.149:0/72455299 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d7c0ce650 0x7f2d7c0b29b0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f2d7000e810 tx=0x7f2d7000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:00.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.313+0000 7f2d6effd700 1 -- 172.21.15.149:0/72455299 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d70013610 con 0x7f2d7c0ce650 2023-11-08T19:30:00.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.313+0000 7f2d6effd700 1 -- 172.21.15.149:0/72455299 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d70013770 con 0x7f2d7c0ce650 2023-11-08T19:30:00.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.313+0000 7f2d84473700 1 -- 172.21.15.149:0/72455299 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d7c06c2d0 con 0x7f2d7c0ce650 2023-11-08T19:30:00.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.313+0000 7f2d6effd700 1 -- 172.21.15.149:0/72455299 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d70013b20 con 0x7f2d7c0ce650 2023-11-08T19:30:00.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.313+0000 7f2d84473700 1 -- 172.21.15.149:0/72455299 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d7c06c890 con 0x7f2d7c0ce650 2023-11-08T19:30:00.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.314+0000 7f2d84473700 1 -- 172.21.15.149:0/72455299 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d7c15f4f0 con 0x7f2d7c0ce650 2023-11-08T19:30:00.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.314+0000 7f2d6effd700 1 -- 172.21.15.149:0/72455299 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2d70013c80 con 0x7f2d7c0ce650 2023-11-08T19:30:00.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.315+0000 7f2d6effd700 1 --2- 172.21.15.149:0/72455299 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2d6006af00 0x7f2d6006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:00.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.315+0000 7f2d6effd700 1 -- 172.21.15.149:0/72455299 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7737+0+0 (secure 0 0 0) 0x7f2d70089ac0 con 0x7f2d7c0ce650 2023-11-08T19:30:00.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.315+0000 7f2d8220f700 1 --2- 172.21.15.149:0/72455299 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2d6006af00 0x7f2d6006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:00.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.315+0000 7f2d8220f700 1 --2- 172.21.15.149:0/72455299 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2d6006af00 0x7f2d6006d3c0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f2d780079d0 tx=0x7f2d78008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:00.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.319+0000 7f2d6effd700 1 -- 172.21.15.149:0/72455299 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2d7c15f4f0 con 0x7f2d7c0ce650 2023-11-08T19:30:00.511 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.510+0000 7f2d84473700 1 -- 172.21.15.149:0/72455299 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2d7c15f4f0 con 0x7f2d7c0ce650 2023-11-08T19:30:00.511 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.510+0000 7f2d6effd700 1 -- 172.21.15.149:0/72455299 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v108) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2d7c15f4f0 con 0x7f2d7c0ce650 2023-11-08T19:30:00.512 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 64 2023-11-08T19:30:00.514 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.512+0000 7f2d84473700 1 -- 172.21.15.149:0/72455299 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2d6006af00 msgr2=0x7f2d6006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:00.514 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.512+0000 7f2d84473700 1 --2- 172.21.15.149:0/72455299 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2d6006af00 0x7f2d6006d3c0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f2d780079d0 tx=0x7f2d78008040 comp rx=0 tx=0).stop 2023-11-08T19:30:00.514 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.512+0000 7f2d84473700 1 -- 172.21.15.149:0/72455299 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d7c0ce650 msgr2=0x7f2d7c0b29b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:00.514 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.512+0000 7f2d84473700 1 --2- 172.21.15.149:0/72455299 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d7c0ce650 0x7f2d7c0b29b0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f2d7000e810 tx=0x7f2d7000ebd0 comp rx=0 tx=0).stop 2023-11-08T19:30:00.515 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.512+0000 7f2d84473700 1 -- 172.21.15.149:0/72455299 shutdown_connections 2023-11-08T19:30:00.515 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.512+0000 7f2d84473700 1 --2- 172.21.15.149:0/72455299 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2d6006af00 0x7f2d6006d3c0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:00.515 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.512+0000 7f2d84473700 1 --2- 172.21.15.149:0/72455299 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2d7c0b75c0 0x7f2d7c0b02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:00.515 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.512+0000 7f2d84473700 1 --2- 172.21.15.149:0/72455299 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d7c15bac0 0x7f2d7c157ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:00.515 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.512+0000 7f2d84473700 1 --2- 172.21.15.149:0/72455299 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d7c0ce650 0x7f2d7c0b29b0 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:00.516 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.512+0000 7f2d84473700 1 -- 172.21.15.149:0/72455299 >> 172.21.15.149:0/72455299 conn(0x7f2d7c06f260 msgr2=0x7f2d7c0cc4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:00.516 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.512+0000 7f2d84473700 1 -- 172.21.15.149:0/72455299 shutdown_connections 2023-11-08T19:30:00.516 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.513+0000 7f2d84473700 1 -- 172.21.15.149:0/72455299 wait complete. 2023-11-08T19:30:00.526 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:30:00.649 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.647+0000 7f0db84a0700 1 Processor -- start 2023-11-08T19:30:00.649 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.647+0000 7f0db84a0700 1 -- start start 2023-11-08T19:30:00.651 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.648+0000 7f0db84a0700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f0db015b940 0x7f0db00ce800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:00.652 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.648+0000 7f0db84a0700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0db015bd20 0x7f0db00cfda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:00.652 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.648+0000 7f0db84a0700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0db00b3090 con 0x7f0db00cf8d0 2023-11-08T19:30:00.652 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.648+0000 7f0db84a0700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0db00cf150 con 0x7f0db015b940 2023-11-08T19:30:00.652 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.648+0000 7f0db84a0700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db00b12c0 con 0x7f0db015bd20 2023-11-08T19:30:00.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.649+0000 7f0db5a3b700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0db015bd20 0x7f0db00cfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:00.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.649+0000 7f0db623c700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f0db015b940 0x7f0db00ce800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:00.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.649+0000 7f0db5a3b700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0db015bd20 0x7f0db00cfda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.149:37750/0 (socket says 172.21.15.149:37750) 2023-11-08T19:30:00.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.649+0000 7f0db623c700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f0db015b940 0x7f0db00ce800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.149:46684/0 (socket says 172.21.15.149:46684) 2023-11-08T19:30:00.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.649+0000 7f0db5a3b700 1 -- 172.21.15.149:0/1678326519 learned_addr learned my addr 172.21.15.149:0/1678326519 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:30:00.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.649+0000 7f0db5a3b700 1 -- 172.21.15.149:0/1678326519 >> v2:172.21.15.160:3300/0 conn(0x7f0db015b940 msgr2=0x7f0db00ce800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:30:00.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.649+0000 7f0db5a3b700 1 --2- 172.21.15.149:0/1678326519 >> v2:172.21.15.160:3300/0 conn(0x7f0db015b940 0x7f0db00ce800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:00.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.649+0000 7f0db5a3b700 1 -- 172.21.15.149:0/1678326519 >> v1:172.21.15.160:6789/0 conn(0x7f0db00cf8d0 legacy=0x7f0db00cc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:00.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.649+0000 7f0db5a3b700 1 -- 172.21.15.149:0/1678326519 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db00b15a0 con 0x7f0db015bd20 2023-11-08T19:30:00.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.649+0000 7f0db623c700 1 --2- 172.21.15.149:0/1678326519 >> v2:172.21.15.160:3300/0 conn(0x7f0db015b940 0x7f0db00ce800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:30:00.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.649+0000 7f0db5a3b700 1 --2- 172.21.15.149:0/1678326519 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0db015bd20 0x7f0db00cfda0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0dac0098f0 tx=0x7f0dac009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=512094499f4dd38f server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:00.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.650+0000 7f0db523a700 1 -- 172.21.15.149:0/1678326519 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac011830 con 0x7f0db015bd20 2023-11-08T19:30:00.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.650+0000 7f0db523a700 1 -- 172.21.15.149:0/1678326519 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dac011990 con 0x7f0db015bd20 2023-11-08T19:30:00.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.650+0000 7f0db523a700 1 -- 172.21.15.149:0/1678326519 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac011d20 con 0x7f0db015bd20 2023-11-08T19:30:00.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.650+0000 7f0db84a0700 1 -- 172.21.15.149:0/1678326519 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0db015bd20 msgr2=0x7f0db00cfda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:00.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.650+0000 7f0db84a0700 1 --2- 172.21.15.149:0/1678326519 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0db015bd20 0x7f0db00cfda0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0dac0098f0 tx=0x7f0dac009c00 comp rx=0 tx=0).stop 2023-11-08T19:30:00.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.650+0000 7f0db84a0700 1 -- 172.21.15.149:0/1678326519 shutdown_connections 2023-11-08T19:30:00.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.650+0000 7f0db84a0700 1 --2- 172.21.15.149:0/1678326519 >> v2:172.21.15.160:3300/0 conn(0x7f0db015b940 0x7f0db00ce800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:00.657 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.650+0000 7f0db84a0700 1 --2- 172.21.15.149:0/1678326519 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0db015bd20 0x7f0db00cfda0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:00.657 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.650+0000 7f0db84a0700 1 -- 172.21.15.149:0/1678326519 >> 172.21.15.149:0/1678326519 conn(0x7f0db00d17c0 msgr2=0x7f0db00d1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:00.657 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.650+0000 7f0db84a0700 1 -- 172.21.15.149:0/1678326519 shutdown_connections 2023-11-08T19:30:00.657 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.650+0000 7f0db84a0700 1 -- 172.21.15.149:0/1678326519 wait complete. 2023-11-08T19:30:00.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.651+0000 7f0db84a0700 1 Processor -- start 2023-11-08T19:30:00.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.652+0000 7f0db84a0700 1 -- start start 2023-11-08T19:30:00.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.652+0000 7f0db84a0700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0db00cf8d0 0x7f0db00c98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:00.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.652+0000 7f0db84a0700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0db015b940 0x7f0db01f1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:00.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.652+0000 7f0db84a0700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0db015bd20 0x7f0db0150d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:00.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.652+0000 7f0db84a0700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db015d680 con 0x7f0db00cf8d0 2023-11-08T19:30:00.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.652+0000 7f0db84a0700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db01f2470 con 0x7f0db015b940 2023-11-08T19:30:00.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.652+0000 7f0db84a0700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db0151290 con 0x7f0db015bd20 2023-11-08T19:30:00.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.652+0000 7f0db623c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0db00cf8d0 0x7f0db00c98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:00.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.652+0000 7f0db623c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0db00cf8d0 0x7f0db00c98e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45696/0 (socket says 172.21.15.149:45696) 2023-11-08T19:30:00.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.652+0000 7f0db623c700 1 -- 172.21.15.149:0/1869701472 learned_addr learned my addr 172.21.15.149:0/1869701472 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:30:00.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.653+0000 7f0db5a3b700 1 --2- 172.21.15.149:0/1869701472 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0db015b940 0x7f0db01f1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:00.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.653+0000 7f0db6a3d700 1 --2- 172.21.15.149:0/1869701472 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0db015bd20 0x7f0db0150d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:00.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.653+0000 7f0db623c700 1 -- 172.21.15.149:0/1869701472 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0db015bd20 msgr2=0x7f0db0150d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:00.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.653+0000 7f0db623c700 1 --2- 172.21.15.149:0/1869701472 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0db015bd20 0x7f0db0150d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:00.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.653+0000 7f0db623c700 1 -- 172.21.15.149:0/1869701472 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0db015b940 msgr2=0x7f0db01f1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:00.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.653+0000 7f0db623c700 1 --2- 172.21.15.149:0/1869701472 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0db015b940 0x7f0db01f1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:00.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.653+0000 7f0db623c700 1 -- 172.21.15.149:0/1869701472 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da00094a0 con 0x7f0db00cf8d0 2023-11-08T19:30:00.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.653+0000 7f0db6a3d700 1 --2- 172.21.15.149:0/1869701472 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0db015bd20 0x7f0db0150d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:30:00.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.653+0000 7f0db623c700 1 --2- 172.21.15.149:0/1869701472 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0db00cf8d0 0x7f0db00c98e0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f0da000ec10 tx=0x7f0da0009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:00.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.653+0000 7f0da6ffd700 1 -- 172.21.15.149:0/1869701472 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da000c940 con 0x7f0db00cf8d0 2023-11-08T19:30:00.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.653+0000 7f0da6ffd700 1 -- 172.21.15.149:0/1869701472 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da000caa0 con 0x7f0db00cf8d0 2023-11-08T19:30:00.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.653+0000 7f0db84a0700 1 -- 172.21.15.149:0/1869701472 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dac009550 con 0x7f0db00cf8d0 2023-11-08T19:30:00.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.653+0000 7f0da6ffd700 1 -- 172.21.15.149:0/1869701472 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da000ce10 con 0x7f0db00cf8d0 2023-11-08T19:30:00.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.653+0000 7f0db84a0700 1 -- 172.21.15.149:0/1869701472 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0db00c9f70 con 0x7f0db00cf8d0 2023-11-08T19:30:00.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.654+0000 7f0db84a0700 1 -- 172.21.15.149:0/1869701472 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0db0074f10 con 0x7f0db00cf8d0 2023-11-08T19:30:00.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.655+0000 7f0da6ffd700 1 -- 172.21.15.149:0/1869701472 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0da0013470 con 0x7f0db00cf8d0 2023-11-08T19:30:00.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.655+0000 7f0da6ffd700 1 --2- 172.21.15.149:0/1869701472 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0d9406af00 0x7f0d9406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:00.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.655+0000 7f0da6ffd700 1 -- 172.21.15.149:0/1869701472 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7737+0+0 (secure 0 0 0) 0x7f0da008a010 con 0x7f0db00cf8d0 2023-11-08T19:30:00.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.655+0000 7f0db5a3b700 1 --2- 172.21.15.149:0/1869701472 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0d9406af00 0x7f0d9406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:00.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.655+0000 7f0db5a3b700 1 --2- 172.21.15.149:0/1869701472 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0d9406af00 0x7f0d9406d3c0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f0db015c100 tx=0x7f0dac008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:00.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.660+0000 7f0da6ffd700 1 -- 172.21.15.149:0/1869701472 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0da00548d0 con 0x7f0db00cf8d0 2023-11-08T19:30:00.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.893+0000 7f0db84a0700 1 -- 172.21.15.149:0/1869701472 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0db015d450 con 0x7f0db00cf8d0 2023-11-08T19:30:00.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.894+0000 7f0da6ffd700 1 -- 172.21.15.149:0/1869701472 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) v1 ==== 95+0+4944 (secure 0 0 0) 0x7f0da0017090 con 0x7f0db00cf8d0 2023-11-08T19:30:00.895 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:30:00.896 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":103,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6095,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/852710262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":852710262},{"type":"v1","addr":"172.21.15.160:6835","nonce":852710262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64},{"gid":6425,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/2137508069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":2137508069},{"type":"v1","addr":"172.21.15.149:6837","nonce":2137508069}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":100}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:29:44.194817+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7812,"mds_1":6398},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6398":{"gid":6398,"name":"d","rank":1,"incarnation":99,"state":"up:active","state_seq":7,"addr":"172.21.15.160:6834/2282522167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2282522167},{"type":"v1","addr":"172.21.15.160:6834","nonce":2282522167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7812":{"gid":7812,"name":"a","rank":0,"incarnation":96,"state":"up:active","state_seq":14,"addr":"172.21.15.149:6836/2818321595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2818321595},{"type":"v1","addr":"172.21.15.149:6836","nonce":2818321595}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:30:00.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.897+0000 7f0db84a0700 1 -- 172.21.15.149:0/1869701472 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0d9406af00 msgr2=0x7f0d9406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:00.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.897+0000 7f0db84a0700 1 --2- 172.21.15.149:0/1869701472 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0d9406af00 0x7f0d9406d3c0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f0db015c100 tx=0x7f0dac008030 comp rx=0 tx=0).stop 2023-11-08T19:30:00.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.897+0000 7f0db84a0700 1 -- 172.21.15.149:0/1869701472 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0db00cf8d0 msgr2=0x7f0db00c98e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:00.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.897+0000 7f0db84a0700 1 --2- 172.21.15.149:0/1869701472 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0db00cf8d0 0x7f0db00c98e0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f0da000ec10 tx=0x7f0da0009ec0 comp rx=0 tx=0).stop 2023-11-08T19:30:00.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.897+0000 7f0db84a0700 1 -- 172.21.15.149:0/1869701472 shutdown_connections 2023-11-08T19:30:00.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.897+0000 7f0db84a0700 1 --2- 172.21.15.149:0/1869701472 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f0d9406af00 0x7f0d9406d3c0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:00.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.897+0000 7f0db84a0700 1 --2- 172.21.15.149:0/1869701472 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0db015bd20 0x7f0db0150d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:00.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.897+0000 7f0db84a0700 1 --2- 172.21.15.149:0/1869701472 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0db00cf8d0 0x7f0db00c98e0 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:00.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.897+0000 7f0db84a0700 1 --2- 172.21.15.149:0/1869701472 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0db015b940 0x7f0db01f1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:00.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.897+0000 7f0db84a0700 1 -- 172.21.15.149:0/1869701472 >> 172.21.15.149:0/1869701472 conn(0x7f0db00d17c0 msgr2=0x7f0db00cfda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:00.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.897+0000 7f0db84a0700 1 -- 172.21.15.149:0/1869701472 shutdown_connections 2023-11-08T19:30:00.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:00.897+0000 7f0db84a0700 1 -- 172.21.15.149:0/1869701472 wait complete. 2023-11-08T19:30:00.901 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 103 2023-11-08T19:30:00.910 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:30:01.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.030+0000 7f5ed6e04700 1 Processor -- start 2023-11-08T19:30:01.032 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.030+0000 7f5ed6e04700 1 -- start start 2023-11-08T19:30:01.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.031+0000 7f5ed6e04700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f5ed015b940 0x7f5ed00ce800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:01.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.031+0000 7f5ed6e04700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5ed015bd20 0x7f5ed00cfda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:01.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.031+0000 7f5ed6e04700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ed00b3090 con 0x7f5ed00cf8d0 2023-11-08T19:30:01.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.031+0000 7f5ed6e04700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ed00cf150 con 0x7f5ed015b940 2023-11-08T19:30:01.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.031+0000 7f5ed6e04700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed00b12c0 con 0x7f5ed015bd20 2023-11-08T19:30:01.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.031+0000 7f5ed53a1700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f5ed00cf8d0 0x7f5ed00cc360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:47710/0 (socket says 172.21.15.149:47710) 2023-11-08T19:30:01.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.031+0000 7f5ed53a1700 1 -- 172.21.15.149:0/1041882964 learned_addr learned my addr 172.21.15.149:0/1041882964 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:30:01.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.031+0000 7f5ed4ba0700 1 --2- 172.21.15.149:0/1041882964 >> v2:172.21.15.160:3300/0 conn(0x7f5ed015b940 0x7f5ed00ce800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:01.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.031+0000 7f5ecffff700 1 --2- 172.21.15.149:0/1041882964 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5ed015bd20 0x7f5ed00cfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:01.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.031+0000 7f5ecf7fe700 1 -- 172.21.15.149:0/1041882964 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1099466689 0 0) 0x7f5ed00b3090 con 0x7f5ed00cf8d0 2023-11-08T19:30:01.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.031+0000 7f5ecf7fe700 1 -- 172.21.15.149:0/1041882964 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ec00035b0 con 0x7f5ed00cf8d0 2023-11-08T19:30:01.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.032+0000 7f5ed4ba0700 1 -- 172.21.15.149:0/1041882964 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5ed015bd20 msgr2=0x7f5ed00cfda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:30:01.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.032+0000 7f5ed4ba0700 1 --2- 172.21.15.149:0/1041882964 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5ed015bd20 0x7f5ed00cfda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:01.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.032+0000 7f5ed4ba0700 1 -- 172.21.15.149:0/1041882964 >> v1:172.21.15.149:6789/0 conn(0x7f5ed00cf8d0 legacy=0x7f5ed00cc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:01.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.032+0000 7f5ed4ba0700 1 -- 172.21.15.149:0/1041882964 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed00b15a0 con 0x7f5ed015b940 2023-11-08T19:30:01.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.032+0000 7f5ed4ba0700 1 --2- 172.21.15.149:0/1041882964 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5ed015b940 0x7f5ed00ce800 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f5ec4009840 tx=0x7f5ec4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71baffdc10fd467f server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:01.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.032+0000 7f5ecf7fe700 1 -- 172.21.15.149:0/1041882964 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec4011830 con 0x7f5ed015b940 2023-11-08T19:30:01.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.032+0000 7f5ecf7fe700 1 -- 172.21.15.149:0/1041882964 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ec4011990 con 0x7f5ed015b940 2023-11-08T19:30:01.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.032+0000 7f5ecf7fe700 1 -- 172.21.15.149:0/1041882964 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec4011d00 con 0x7f5ed015b940 2023-11-08T19:30:01.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.032+0000 7f5ed6e04700 1 -- 172.21.15.149:0/1041882964 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5ed015b940 msgr2=0x7f5ed00ce800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:01.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.032+0000 7f5ed6e04700 1 --2- 172.21.15.149:0/1041882964 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5ed015b940 0x7f5ed00ce800 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f5ec4009840 tx=0x7f5ec4009b50 comp rx=0 tx=0).stop 2023-11-08T19:30:01.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.032+0000 7f5ed6e04700 1 -- 172.21.15.149:0/1041882964 shutdown_connections 2023-11-08T19:30:01.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.032+0000 7f5ed6e04700 1 --2- 172.21.15.149:0/1041882964 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5ed015b940 0x7f5ed00ce800 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:01.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.032+0000 7f5ed6e04700 1 --2- 172.21.15.149:0/1041882964 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5ed015bd20 0x7f5ed00cfda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:01.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.032+0000 7f5ed6e04700 1 -- 172.21.15.149:0/1041882964 >> 172.21.15.149:0/1041882964 conn(0x7f5ed00d17c0 msgr2=0x7f5ed00d1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:01.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.033+0000 7f5ed6e04700 1 -- 172.21.15.149:0/1041882964 shutdown_connections 2023-11-08T19:30:01.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.033+0000 7f5ed6e04700 1 -- 172.21.15.149:0/1041882964 wait complete. 2023-11-08T19:30:01.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.034+0000 7f5ed6e04700 1 Processor -- start 2023-11-08T19:30:01.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.034+0000 7f5ed6e04700 1 -- start start 2023-11-08T19:30:01.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.035+0000 7f5ed6e04700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ed00cf8d0 0x7f5ed0157f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:01.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.035+0000 7f5ed6e04700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5ed015b940 0x7f5ed015d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:01.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.035+0000 7f5ed6e04700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5ed015bd20 0x7f5ed015d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:01.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.035+0000 7f5ed6e04700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed00c8bc0 con 0x7f5ed00cf8d0 2023-11-08T19:30:01.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.035+0000 7f5ed6e04700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed0150ce0 con 0x7f5ed015bd20 2023-11-08T19:30:01.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.035+0000 7f5ed6e04700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed00cb8a0 con 0x7f5ed015b940 2023-11-08T19:30:01.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.035+0000 7f5ed4ba0700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ed00cf8d0 0x7f5ed0157f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:01.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.035+0000 7f5ed4ba0700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ed00cf8d0 0x7f5ed0157f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45710/0 (socket says 172.21.15.149:45710) 2023-11-08T19:30:01.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.035+0000 7f5ed4ba0700 1 -- 172.21.15.149:0/363148671 learned_addr learned my addr 172.21.15.149:0/363148671 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:30:01.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.035+0000 7f5ecffff700 1 --2- 172.21.15.149:0/363148671 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5ed015b940 0x7f5ed015d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:01.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.035+0000 7f5ed53a1700 1 --2- 172.21.15.149:0/363148671 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5ed015bd20 0x7f5ed015d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:01.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.036+0000 7f5ed4ba0700 1 -- 172.21.15.149:0/363148671 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5ed015b940 msgr2=0x7f5ed015d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:01.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.036+0000 7f5ed4ba0700 1 --2- 172.21.15.149:0/363148671 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5ed015b940 0x7f5ed015d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:01.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.036+0000 7f5ed4ba0700 1 -- 172.21.15.149:0/363148671 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5ed015bd20 msgr2=0x7f5ed015d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:01.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.036+0000 7f5ed4ba0700 1 --2- 172.21.15.149:0/363148671 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5ed015bd20 0x7f5ed015d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:01.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.036+0000 7f5ed4ba0700 1 -- 172.21.15.149:0/363148671 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec40094a0 con 0x7f5ed00cf8d0 2023-11-08T19:30:01.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.036+0000 7f5ed53a1700 1 --2- 172.21.15.149:0/363148671 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5ed015bd20 0x7f5ed015d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:30:01.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.036+0000 7f5ed4ba0700 1 --2- 172.21.15.149:0/363148671 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ed00cf8d0 0x7f5ed0157f00 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f5ec40090b0 tx=0x7f5ec4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:01.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.036+0000 7f5ecd7fa700 1 -- 172.21.15.149:0/363148671 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec4004550 con 0x7f5ed00cf8d0 2023-11-08T19:30:01.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.036+0000 7f5ecd7fa700 1 -- 172.21.15.149:0/363148671 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ec401f070 con 0x7f5ed00cf8d0 2023-11-08T19:30:01.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.036+0000 7f5ed6e04700 1 -- 172.21.15.149:0/363148671 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ed015c280 con 0x7f5ed00cf8d0 2023-11-08T19:30:01.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.036+0000 7f5ecd7fa700 1 -- 172.21.15.149:0/363148671 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec40038a0 con 0x7f5ed00cf8d0 2023-11-08T19:30:01.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.036+0000 7f5ed6e04700 1 -- 172.21.15.149:0/363148671 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ed015c840 con 0x7f5ed00cf8d0 2023-11-08T19:30:01.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.037+0000 7f5ed6e04700 1 -- 172.21.15.149:0/363148671 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ed0074f10 con 0x7f5ed00cf8d0 2023-11-08T19:30:01.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.038+0000 7f5ecd7fa700 1 -- 172.21.15.149:0/363148671 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5ec4003a00 con 0x7f5ed00cf8d0 2023-11-08T19:30:01.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.038+0000 7f5ecd7fa700 1 --2- 172.21.15.149:0/363148671 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5eb406af00 0x7f5eb406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:01.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.038+0000 7f5ecd7fa700 1 -- 172.21.15.149:0/363148671 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7737+0+0 (secure 0 0 0) 0x7f5ec4021070 con 0x7f5ed00cf8d0 2023-11-08T19:30:01.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.038+0000 7f5ecffff700 1 --2- 172.21.15.149:0/363148671 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5eb406af00 0x7f5eb406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:01.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.038+0000 7f5ecffff700 1 --2- 172.21.15.149:0/363148671 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5eb406af00 0x7f5eb406d3c0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f5ed00704b0 tx=0x7f5ebc009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:01.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.043+0000 7f5ecd7fa700 1 -- 172.21.15.149:0/363148671 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5ec4055e60 con 0x7f5ed00cf8d0 2023-11-08T19:30:01.239 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.238+0000 7f5ed6e04700 1 -- 172.21.15.149:0/363148671 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5ed0070200 con 0x7f5ed00cf8d0 2023-11-08T19:30:01.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.240+0000 7f5ecd7fa700 1 -- 172.21.15.149:0/363148671 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) v1 ==== 74+0+23067 (secure 0 0 0) 0x7f5ec4015020 con 0x7f5ed00cf8d0 2023-11-08T19:30:01.241 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:30:01.242 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":108,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:29:43.171791+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-08T19:24:29.516185+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-08T19:25:44.287064+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":71,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-08T19:25:45.623521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-11-08T19:26:46.785987+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-11-08T19:26:47.950353+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":9,"snap_epoch":104,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.f","mappings":[{"from":0,"to":5}]},{"pgid":"17.26","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.160:6834/1313631099":"2023-11-09T19:29:27.322904+0000","172.21.15.149:6835/3917392643":"2023-11-09T19:29:34.481449+0000","172.21.15.160:6832/1313631099":"2023-11-09T19:29:27.322904+0000","172.21.15.149:6834/295381437":"2023-11-09T19:28:59.293725+0000","172.21.15.149:6836/295381437":"2023-11-09T19:28:59.293725+0000","172.21.15.160:6835/2714564224":"2023-11-09T19:27:34.046425+0000","172.21.15.149:6837/3917392643":"2023-11-09T19:29:34.481449+0000","172.21.15.149:6834/589971879":"2023-11-09T19:28:00.736319+0000","172.21.15.160:6833/2714564224":"2023-11-09T19:27:34.046425+0000","172.21.15.160:6832/2947079163":"2023-11-09T19:28:27.325108+0000","192.168.0.1:0/1017303916":"2023-11-08T20:29:42.437736+0000","172.21.15.149:6836/589971879":"2023-11-09T19:28:00.736319+0000","172.21.15.160:6834/2947079163":"2023-11-09T19:28:27.325108+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:30:01.243 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.242+0000 7f5ed6e04700 1 -- 172.21.15.149:0/363148671 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5eb406af00 msgr2=0x7f5eb406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:01.244 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.242+0000 7f5ed6e04700 1 --2- 172.21.15.149:0/363148671 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5eb406af00 0x7f5eb406d3c0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f5ed00704b0 tx=0x7f5ebc009210 comp rx=0 tx=0).stop 2023-11-08T19:30:01.244 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.242+0000 7f5ed6e04700 1 -- 172.21.15.149:0/363148671 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ed00cf8d0 msgr2=0x7f5ed0157f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:01.244 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.242+0000 7f5ed6e04700 1 --2- 172.21.15.149:0/363148671 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ed00cf8d0 0x7f5ed0157f00 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f5ec40090b0 tx=0x7f5ec4004750 comp rx=0 tx=0).stop 2023-11-08T19:30:01.244 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.242+0000 7f5ed6e04700 1 -- 172.21.15.149:0/363148671 shutdown_connections 2023-11-08T19:30:01.244 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.242+0000 7f5ed6e04700 1 --2- 172.21.15.149:0/363148671 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f5eb406af00 0x7f5eb406d3c0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:01.245 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.242+0000 7f5ed6e04700 1 --2- 172.21.15.149:0/363148671 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5ed015bd20 0x7f5ed015d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:01.245 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.242+0000 7f5ed6e04700 1 --2- 172.21.15.149:0/363148671 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ed00cf8d0 0x7f5ed0157f00 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:01.245 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.242+0000 7f5ed6e04700 1 --2- 172.21.15.149:0/363148671 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5ed015b940 0x7f5ed015d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:01.245 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.242+0000 7f5ed6e04700 1 -- 172.21.15.149:0/363148671 >> 172.21.15.149:0/363148671 conn(0x7f5ed00d17c0 msgr2=0x7f5ed00cd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:01.245 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.242+0000 7f5ed6e04700 1 -- 172.21.15.149:0/363148671 shutdown_connections 2023-11-08T19:30:01.246 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.242+0000 7f5ed6e04700 1 -- 172.21.15.149:0/363148671 wait complete. 2023-11-08T19:30:01.257 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-08T19:30:01.257 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:30:01.379 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.378+0000 7fb14a357700 1 Processor -- start 2023-11-08T19:30:01.380 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.378+0000 7fb14a357700 1 -- start start 2023-11-08T19:30:01.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.379+0000 7fb14a357700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb14415dce0 0x7fb1440b20f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:01.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.379+0000 7fb14a357700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb14406ab20 0x7fb14406afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:01.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.379+0000 7fb14a357700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1440ce6e0 con 0x7fb144070770 2023-11-08T19:30:01.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.379+0000 7fb14a357700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1440cf280 con 0x7fb14415dce0 2023-11-08T19:30:01.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.379+0000 7fb14a357700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb14406b4f0 con 0x7fb14406ab20 2023-11-08T19:30:01.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.379+0000 7fb143fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb14415dce0 0x7fb1440b20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:01.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.379+0000 7fb1437fe700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fb144070770 0x7fb1440ceb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:47720/0 (socket says 172.21.15.149:47720) 2023-11-08T19:30:01.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.379+0000 7fb1437fe700 1 -- 172.21.15.149:0/1454668178 learned_addr learned my addr 172.21.15.149:0/1454668178 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:30:01.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.379+0000 7fb1488f4700 1 --2- 172.21.15.149:0/1454668178 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb14406ab20 0x7fb14406afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:01.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.379+0000 7fb143fff700 1 -- 172.21.15.149:0/1454668178 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb14406ab20 msgr2=0x7fb14406afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:30:01.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.379+0000 7fb143fff700 1 --2- 172.21.15.149:0/1454668178 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb14406ab20 0x7fb14406afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:01.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.379+0000 7fb143fff700 1 -- 172.21.15.149:0/1454668178 >> v1:172.21.15.149:6789/0 conn(0x7fb144070770 legacy=0x7fb1440ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:01.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.379+0000 7fb142ffd700 1 -- 172.21.15.149:0/1454668178 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2190261789 0 0) 0x7fb1440ce6e0 con 0x7fb144070770 2023-11-08T19:30:01.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.379+0000 7fb143fff700 1 -- 172.21.15.149:0/1454668178 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1440b2fb0 con 0x7fb14415dce0 2023-11-08T19:30:01.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.379+0000 7fb143fff700 1 --2- 172.21.15.149:0/1454668178 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb14415dce0 0x7fb1440b20f0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fb134009840 tx=0x7fb134009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd1f2a161d8e7d30 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:01.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.380+0000 7fb142ffd700 1 -- 172.21.15.149:0/1454668178 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb134011830 con 0x7fb14415dce0 2023-11-08T19:30:01.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.380+0000 7fb142ffd700 1 -- 172.21.15.149:0/1454668178 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb134011990 con 0x7fb14415dce0 2023-11-08T19:30:01.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.380+0000 7fb142ffd700 1 -- 172.21.15.149:0/1454668178 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb134011d20 con 0x7fb14415dce0 2023-11-08T19:30:01.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.380+0000 7fb14a357700 1 -- 172.21.15.149:0/1454668178 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb14415dce0 msgr2=0x7fb1440b20f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:01.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.380+0000 7fb14a357700 1 --2- 172.21.15.149:0/1454668178 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb14415dce0 0x7fb1440b20f0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fb134009840 tx=0x7fb134009b50 comp rx=0 tx=0).stop 2023-11-08T19:30:01.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.380+0000 7fb14a357700 1 -- 172.21.15.149:0/1454668178 shutdown_connections 2023-11-08T19:30:01.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.380+0000 7fb14a357700 1 --2- 172.21.15.149:0/1454668178 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb14406ab20 0x7fb14406afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:01.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.380+0000 7fb14a357700 1 --2- 172.21.15.149:0/1454668178 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb14415dce0 0x7fb1440b20f0 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:01.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.380+0000 7fb14a357700 1 -- 172.21.15.149:0/1454668178 >> 172.21.15.149:0/1454668178 conn(0x7fb1440cd0f0 msgr2=0x7fb1440cd500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:01.387 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.380+0000 7fb14a357700 1 -- 172.21.15.149:0/1454668178 shutdown_connections 2023-11-08T19:30:01.387 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.380+0000 7fb14a357700 1 -- 172.21.15.149:0/1454668178 wait complete. 2023-11-08T19:30:01.389 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.381+0000 7fb14a357700 1 Processor -- start 2023-11-08T19:30:01.390 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.382+0000 7fb14a357700 1 -- start start 2023-11-08T19:30:01.390 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.382+0000 7fb14a357700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb14406ab20 0x7fb14415e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:01.390 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.382+0000 7fb14a357700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb144070770 0x7fb1440b5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:01.390 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.382+0000 7fb14a357700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb14415dce0 0x7fb14414e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:01.391 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.382+0000 7fb14a357700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb14415e730 con 0x7fb14406ab20 2023-11-08T19:30:01.391 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.382+0000 7fb14a357700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1440b6080 con 0x7fb14415dce0 2023-11-08T19:30:01.391 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.382+0000 7fb14a357700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1440b3290 con 0x7fb144070770 2023-11-08T19:30:01.391 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.382+0000 7fb143fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb14406ab20 0x7fb14415e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:01.391 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.383+0000 7fb143fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb14406ab20 0x7fb14415e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45724/0 (socket says 172.21.15.149:45724) 2023-11-08T19:30:01.392 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.383+0000 7fb143fff700 1 -- 172.21.15.149:0/3272988522 learned_addr learned my addr 172.21.15.149:0/3272988522 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:30:01.392 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.383+0000 7fb1437fe700 1 --2- 172.21.15.149:0/3272988522 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb144070770 0x7fb1440b5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:01.392 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.383+0000 7fb1488f4700 1 --2- 172.21.15.149:0/3272988522 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb14415dce0 0x7fb14414e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:01.392 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.383+0000 7fb143fff700 1 -- 172.21.15.149:0/3272988522 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb144070770 msgr2=0x7fb1440b5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:01.392 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.383+0000 7fb143fff700 1 --2- 172.21.15.149:0/3272988522 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb144070770 0x7fb1440b5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:01.393 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.383+0000 7fb143fff700 1 -- 172.21.15.149:0/3272988522 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb14415dce0 msgr2=0x7fb14414e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:01.393 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.383+0000 7fb143fff700 1 --2- 172.21.15.149:0/3272988522 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb14415dce0 0x7fb14414e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:01.393 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.383+0000 7fb143fff700 1 -- 172.21.15.149:0/3272988522 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1340094a0 con 0x7fb14406ab20 2023-11-08T19:30:01.393 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.383+0000 7fb1488f4700 1 --2- 172.21.15.149:0/3272988522 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb14415dce0 0x7fb14414e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:30:01.393 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.383+0000 7fb143fff700 1 --2- 172.21.15.149:0/3272988522 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb14406ab20 0x7fb14415e1f0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7fb1340090b0 tx=0x7fb134004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:01.394 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.383+0000 7fb140ff9700 1 -- 172.21.15.149:0/3272988522 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1340038a0 con 0x7fb14406ab20 2023-11-08T19:30:01.394 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.383+0000 7fb140ff9700 1 -- 172.21.15.149:0/3272988522 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb13401f070 con 0x7fb14406ab20 2023-11-08T19:30:01.394 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.383+0000 7fb14a357700 1 -- 172.21.15.149:0/3272988522 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb14414ee70 con 0x7fb14406ab20 2023-11-08T19:30:01.394 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.383+0000 7fb140ff9700 1 -- 172.21.15.149:0/3272988522 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb134003c20 con 0x7fb14406ab20 2023-11-08T19:30:01.394 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.383+0000 7fb14a357700 1 -- 172.21.15.149:0/3272988522 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1440adde0 con 0x7fb14406ab20 2023-11-08T19:30:01.395 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.384+0000 7fb14a357700 1 -- 172.21.15.149:0/3272988522 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb144067810 con 0x7fb14406ab20 2023-11-08T19:30:01.395 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.384+0000 7fb140ff9700 1 -- 172.21.15.149:0/3272988522 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb13401a430 con 0x7fb14406ab20 2023-11-08T19:30:01.395 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.385+0000 7fb140ff9700 1 --2- 172.21.15.149:0/3272988522 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb13006af00 0x7fb13006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:01.395 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.385+0000 7fb140ff9700 1 -- 172.21.15.149:0/3272988522 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7737+0+0 (secure 0 0 0) 0x7fb134021070 con 0x7fb14406ab20 2023-11-08T19:30:01.395 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.385+0000 7fb1437fe700 1 --2- 172.21.15.149:0/3272988522 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb13006af00 0x7fb13006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:01.396 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.385+0000 7fb1437fe700 1 --2- 172.21.15.149:0/3272988522 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb13006af00 0x7fb13006d3c0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fb1440c7390 tx=0x7fb138007be0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:01.396 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.390+0000 7fb140ff9700 1 -- 172.21.15.149:0/3272988522 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb1340560c0 con 0x7fb14406ab20 2023-11-08T19:30:01.624 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.623+0000 7fb14a357700 1 -- 172.21.15.149:0/3272988522 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb144074f10 con 0x7fb14406ab20 2023-11-08T19:30:01.625 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.624+0000 7fb140ff9700 1 -- 172.21.15.149:0/3272988522 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) v1 ==== 95+0+4944 (secure 0 0 0) 0x7fb134015090 con 0x7fb14406ab20 2023-11-08T19:30:01.625 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:30:01.626 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":103,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6095,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/852710262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":852710262},{"type":"v1","addr":"172.21.15.160:6835","nonce":852710262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64},{"gid":6425,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/2137508069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":2137508069},{"type":"v1","addr":"172.21.15.149:6837","nonce":2137508069}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":100}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:29:44.194817+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7812,"mds_1":6398},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6398":{"gid":6398,"name":"d","rank":1,"incarnation":99,"state":"up:active","state_seq":7,"addr":"172.21.15.160:6834/2282522167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2282522167},{"type":"v1","addr":"172.21.15.160:6834","nonce":2282522167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7812":{"gid":7812,"name":"a","rank":0,"incarnation":96,"state":"up:active","state_seq":14,"addr":"172.21.15.149:6836/2818321595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2818321595},{"type":"v1","addr":"172.21.15.149:6836","nonce":2818321595}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:30:01.628 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.626+0000 7fb14a357700 1 -- 172.21.15.149:0/3272988522 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb13006af00 msgr2=0x7fb13006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:01.628 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.626+0000 7fb14a357700 1 --2- 172.21.15.149:0/3272988522 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb13006af00 0x7fb13006d3c0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fb1440c7390 tx=0x7fb138007be0 comp rx=0 tx=0).stop 2023-11-08T19:30:01.628 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.626+0000 7fb14a357700 1 -- 172.21.15.149:0/3272988522 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb14406ab20 msgr2=0x7fb14415e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:01.629 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.626+0000 7fb14a357700 1 --2- 172.21.15.149:0/3272988522 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb14406ab20 0x7fb14415e1f0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7fb1340090b0 tx=0x7fb134004750 comp rx=0 tx=0).stop 2023-11-08T19:30:01.629 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.626+0000 7fb14a357700 1 -- 172.21.15.149:0/3272988522 shutdown_connections 2023-11-08T19:30:01.629 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.626+0000 7fb14a357700 1 --2- 172.21.15.149:0/3272988522 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb13006af00 0x7fb13006d3c0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:01.629 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.626+0000 7fb14a357700 1 --2- 172.21.15.149:0/3272988522 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb14415dce0 0x7fb14414e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:01.629 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.626+0000 7fb14a357700 1 --2- 172.21.15.149:0/3272988522 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb14406ab20 0x7fb14415e1f0 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:01.630 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.626+0000 7fb14a357700 1 --2- 172.21.15.149:0/3272988522 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb144070770 0x7fb1440b5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:01.630 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.626+0000 7fb14a357700 1 -- 172.21.15.149:0/3272988522 >> 172.21.15.149:0/3272988522 conn(0x7fb1440cd0f0 msgr2=0x7fb1440b0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:01.630 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.626+0000 7fb14a357700 1 -- 172.21.15.149:0/3272988522 shutdown_connections 2023-11-08T19:30:01.630 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.626+0000 7fb14a357700 1 -- 172.21.15.149:0/3272988522 wait complete. 2023-11-08T19:30:01.631 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 103 2023-11-08T19:30:01.640 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:30:01.760 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.759+0000 7f8723c83700 1 Processor -- start 2023-11-08T19:30:01.760 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.759+0000 7f8723c83700 1 -- start start 2023-11-08T19:30:01.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.760+0000 7f8723c83700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f871c0ca450 0x7f871c0af260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:01.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.760+0000 7f8723c83700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f871c0aed10 0x7f871c06ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:01.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.760+0000 7f8723c83700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f871c072560 con 0x7f871c0cdc40 2023-11-08T19:30:01.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.760+0000 7f8723c83700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f871c071950 con 0x7f871c0aed10 2023-11-08T19:30:01.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.760+0000 7f8723c83700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f871c071c30 con 0x7f871c0ca450 2023-11-08T19:30:01.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.760+0000 7f8722220700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f871c0aed10 0x7f871c06ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:01.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.760+0000 7f8721a1f700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f871c0cdc40 0x7f871c15d750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:47734/0 (socket says 172.21.15.149:47734) 2023-11-08T19:30:01.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.760+0000 7f8721a1f700 1 -- 172.21.15.149:0/1145340873 learned_addr learned my addr 172.21.15.149:0/1145340873 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:30:01.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.760+0000 7f872121e700 1 --2- 172.21.15.149:0/1145340873 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f871c0ca450 0x7f871c0af260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:01.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.760+0000 7f8722220700 1 -- 172.21.15.149:0/1145340873 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f871c0ca450 msgr2=0x7f871c0af260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:30:01.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.760+0000 7f8722220700 1 --2- 172.21.15.149:0/1145340873 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f871c0ca450 0x7f871c0af260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:01.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.760+0000 7f8722220700 1 -- 172.21.15.149:0/1145340873 >> v1:172.21.15.149:6789/0 conn(0x7f871c0cdc40 legacy=0x7f871c15d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:01.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.760+0000 7f8722220700 1 -- 172.21.15.149:0/1145340873 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f871c071f10 con 0x7f871c0aed10 2023-11-08T19:30:01.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.760+0000 7f8720a1d700 1 -- 172.21.15.149:0/1145340873 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 747171474 0 0) 0x7f871c072560 con 0x7f871c0cdc40 2023-11-08T19:30:01.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.761+0000 7f8722220700 1 --2- 172.21.15.149:0/1145340873 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f871c0aed10 0x7f871c06ac20 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f8714009d90 tx=0x7f871400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a902265cf463b83 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:01.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.761+0000 7f8720a1d700 1 -- 172.21.15.149:0/1145340873 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871400e070 con 0x7f871c0aed10 2023-11-08T19:30:01.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.761+0000 7f8720a1d700 1 -- 172.21.15.149:0/1145340873 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f871400bb20 con 0x7f871c0aed10 2023-11-08T19:30:01.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.761+0000 7f8720a1d700 1 -- 172.21.15.149:0/1145340873 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8714012430 con 0x7f871c0aed10 2023-11-08T19:30:01.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.761+0000 7f8723c83700 1 -- 172.21.15.149:0/1145340873 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f871c0aed10 msgr2=0x7f871c06ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:01.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.761+0000 7f8723c83700 1 --2- 172.21.15.149:0/1145340873 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f871c0aed10 0x7f871c06ac20 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f8714009d90 tx=0x7f871400b330 comp rx=0 tx=0).stop 2023-11-08T19:30:01.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.761+0000 7f8723c83700 1 -- 172.21.15.149:0/1145340873 shutdown_connections 2023-11-08T19:30:01.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.761+0000 7f8723c83700 1 --2- 172.21.15.149:0/1145340873 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f871c0aed10 0x7f871c06ac20 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:01.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.761+0000 7f8723c83700 1 --2- 172.21.15.149:0/1145340873 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f871c0ca450 0x7f871c0af260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:01.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.761+0000 7f8723c83700 1 -- 172.21.15.149:0/1145340873 >> 172.21.15.149:0/1145340873 conn(0x7f871c0cfe00 msgr2=0x7f871c0d01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:01.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.761+0000 7f8723c83700 1 -- 172.21.15.149:0/1145340873 shutdown_connections 2023-11-08T19:30:01.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.761+0000 7f8723c83700 1 -- 172.21.15.149:0/1145340873 wait complete. 2023-11-08T19:30:01.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.763+0000 7f8723c83700 1 Processor -- start 2023-11-08T19:30:01.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.763+0000 7f8723c83700 1 -- start start 2023-11-08T19:30:01.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.763+0000 7f8723c83700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f871c0aed10 0x7f871c1574a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:01.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.763+0000 7f8723c83700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f871c0ca450 0x7f871c1e7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:01.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.763+0000 7f8723c83700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f871c0cdc40 0x7f871c0afe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:01.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.763+0000 7f8723c83700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871c1579e0 con 0x7f871c0aed10 2023-11-08T19:30:01.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.763+0000 7f8723c83700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871c1e6cb0 con 0x7f871c0ca450 2023-11-08T19:30:01.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.763+0000 7f8723c83700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f871c1e6380 con 0x7f871c0cdc40 2023-11-08T19:30:01.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.763+0000 7f8721a1f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f871c0aed10 0x7f871c1574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:01.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.763+0000 7f8721a1f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f871c0aed10 0x7f871c1574a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45738/0 (socket says 172.21.15.149:45738) 2023-11-08T19:30:01.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.763+0000 7f8721a1f700 1 -- 172.21.15.149:0/1021729307 learned_addr learned my addr 172.21.15.149:0/1021729307 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:30:01.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.764+0000 7f8722220700 1 --2- 172.21.15.149:0/1021729307 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f871c0cdc40 0x7f871c0afe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:01.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.764+0000 7f872121e700 1 --2- 172.21.15.149:0/1021729307 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f871c0ca450 0x7f871c1e7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:01.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.764+0000 7f8721a1f700 1 -- 172.21.15.149:0/1021729307 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f871c0cdc40 msgr2=0x7f871c0afe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:01.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.764+0000 7f8721a1f700 1 --2- 172.21.15.149:0/1021729307 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f871c0cdc40 0x7f871c0afe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:01.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.764+0000 7f8721a1f700 1 -- 172.21.15.149:0/1021729307 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f871c0ca450 msgr2=0x7f871c1e7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:01.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.764+0000 7f8721a1f700 1 --2- 172.21.15.149:0/1021729307 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f871c0ca450 0x7f871c1e7140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:01.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.764+0000 7f8721a1f700 1 -- 172.21.15.149:0/1021729307 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8714009a70 con 0x7f871c0aed10 2023-11-08T19:30:01.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.764+0000 7f8721a1f700 1 --2- 172.21.15.149:0/1021729307 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f871c0aed10 0x7f871c1574a0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f870c0011e0 tx=0x7f870c00cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:01.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.764+0000 7f87127fc700 1 -- 172.21.15.149:0/1021729307 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870c004c80 con 0x7f871c0aed10 2023-11-08T19:30:01.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.764+0000 7f87127fc700 1 -- 172.21.15.149:0/1021729307 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f870c004e00 con 0x7f871c0aed10 2023-11-08T19:30:01.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.764+0000 7f8723c83700 1 -- 172.21.15.149:0/1021729307 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f871c1e6660 con 0x7f871c0aed10 2023-11-08T19:30:01.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.764+0000 7f87127fc700 1 -- 172.21.15.149:0/1021729307 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870c007310 con 0x7f871c0aed10 2023-11-08T19:30:01.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.764+0000 7f8723c83700 1 -- 172.21.15.149:0/1021729307 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f871c0cd6f0 con 0x7f871c0aed10 2023-11-08T19:30:01.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.765+0000 7f8723c83700 1 -- 172.21.15.149:0/1021729307 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f871c1e6f90 con 0x7f871c0aed10 2023-11-08T19:30:01.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.765+0000 7f87127fc700 1 -- 172.21.15.149:0/1021729307 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f870c007470 con 0x7f871c0aed10 2023-11-08T19:30:01.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.766+0000 7f87127fc700 1 --2- 172.21.15.149:0/1021729307 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f870006af00 0x7f870006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:01.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.766+0000 7f872121e700 1 --2- 172.21.15.149:0/1021729307 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f870006af00 0x7f870006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:01.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.766+0000 7f87127fc700 1 -- 172.21.15.149:0/1021729307 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7737+0+0 (secure 0 0 0) 0x7f870c089be0 con 0x7f871c0aed10 2023-11-08T19:30:01.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.766+0000 7f872121e700 1 --2- 172.21.15.149:0/1021729307 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f870006af00 0x7f870006d3c0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f871c0b09c0 tx=0x7f8718008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:01.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:01.771+0000 7f87127fc700 1 -- 172.21.15.149:0/1021729307 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f870c0544a0 con 0x7f871c0aed10 2023-11-08T19:30:02.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.002+0000 7f8723c83700 1 -- 172.21.15.149:0/1021729307 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f871c074f10 con 0x7f871c0aed10 2023-11-08T19:30:02.004 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.003+0000 7f87127fc700 1 -- 172.21.15.149:0/1021729307 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) v1 ==== 95+0+4944 (secure 0 0 0) 0x7f870c057ac0 con 0x7f871c0aed10 2023-11-08T19:30:02.005 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:30:02.005 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":103,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6095,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/852710262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":852710262},{"type":"v1","addr":"172.21.15.160:6835","nonce":852710262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64},{"gid":6425,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/2137508069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":2137508069},{"type":"v1","addr":"172.21.15.149:6837","nonce":2137508069}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":100}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-08T19:26:48.987203+0000","modified":"2023-11-08T19:29:44.194817+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7812,"mds_1":6398},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6398":{"gid":6398,"name":"d","rank":1,"incarnation":99,"state":"up:active","state_seq":7,"addr":"172.21.15.160:6834/2282522167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2282522167},{"type":"v1","addr":"172.21.15.160:6834","nonce":2282522167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7812":{"gid":7812,"name":"a","rank":0,"incarnation":96,"state":"up:active","state_seq":14,"addr":"172.21.15.149:6836/2818321595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2818321595},{"type":"v1","addr":"172.21.15.149:6836","nonce":2818321595}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-08T19:30:02.006 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.005+0000 7f8723c83700 1 -- 172.21.15.149:0/1021729307 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f870006af00 msgr2=0x7f870006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:02.007 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.005+0000 7f8723c83700 1 --2- 172.21.15.149:0/1021729307 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f870006af00 0x7f870006d3c0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f871c0b09c0 tx=0x7f8718008040 comp rx=0 tx=0).stop 2023-11-08T19:30:02.007 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.005+0000 7f8723c83700 1 -- 172.21.15.149:0/1021729307 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f871c0aed10 msgr2=0x7f871c1574a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:02.007 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.005+0000 7f8723c83700 1 --2- 172.21.15.149:0/1021729307 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f871c0aed10 0x7f871c1574a0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f870c0011e0 tx=0x7f870c00cae0 comp rx=0 tx=0).stop 2023-11-08T19:30:02.007 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.005+0000 7f8723c83700 1 -- 172.21.15.149:0/1021729307 shutdown_connections 2023-11-08T19:30:02.007 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.005+0000 7f8723c83700 1 --2- 172.21.15.149:0/1021729307 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f870006af00 0x7f870006d3c0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:02.008 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.005+0000 7f8723c83700 1 --2- 172.21.15.149:0/1021729307 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f871c0cdc40 0x7f871c0afe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:02.008 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.005+0000 7f8723c83700 1 --2- 172.21.15.149:0/1021729307 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f871c0aed10 0x7f871c1574a0 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:02.008 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.005+0000 7f8723c83700 1 --2- 172.21.15.149:0/1021729307 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f871c0ca450 0x7f871c1e7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:02.008 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.005+0000 7f8723c83700 1 -- 172.21.15.149:0/1021729307 >> 172.21.15.149:0/1021729307 conn(0x7f871c0cfe00 msgr2=0x7f871c15b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:02.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.005+0000 7f8723c83700 1 -- 172.21.15.149:0/1021729307 shutdown_connections 2023-11-08T19:30:02.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.005+0000 7f8723c83700 1 -- 172.21.15.149:0/1021729307 wait complete. 2023-11-08T19:30:02.009 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 103 2023-11-08T19:30:02.018 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:30:02.139 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.138+0000 7f9496edb700 1 Processor -- start 2023-11-08T19:30:02.140 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.138+0000 7f9496edb700 1 -- start start 2023-11-08T19:30:02.142 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.139+0000 7f9496edb700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f949015db00 0x7f94900ce1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:02.142 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.139+0000 7f9496edb700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f94900b8df0 0x7f94900ce720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:02.142 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.139+0000 7f9496edb700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f949015dee0 con 0x7f94900b2a50 2023-11-08T19:30:02.143 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.139+0000 7f9496edb700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94900cefb0 con 0x7f94900b8df0 2023-11-08T19:30:02.143 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.139+0000 7f9496edb700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94900b6a60 con 0x7f949015db00 2023-11-08T19:30:02.143 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.139+0000 7f9495478700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f94900b8df0 0x7f94900ce720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:02.143 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.139+0000 7f948ffff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f94900b2a50 0x7f94900b5400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:47748/0 (socket says 172.21.15.149:47748) 2023-11-08T19:30:02.143 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.139+0000 7f948ffff700 1 -- 172.21.15.149:0/607667445 learned_addr learned my addr 172.21.15.149:0/607667445 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:30:02.144 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.139+0000 7f9494c77700 1 --2- 172.21.15.149:0/607667445 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f949015db00 0x7f94900ce1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:02.144 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.140+0000 7f9495478700 1 -- 172.21.15.149:0/607667445 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f949015db00 msgr2=0x7f94900ce1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:30:02.144 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.140+0000 7f9495478700 1 --2- 172.21.15.149:0/607667445 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f949015db00 0x7f94900ce1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:02.144 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.140+0000 7f9495478700 1 -- 172.21.15.149:0/607667445 >> v1:172.21.15.149:6789/0 conn(0x7f94900b2a50 legacy=0x7f94900b5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:02.144 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.140+0000 7f9495478700 1 -- 172.21.15.149:0/607667445 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94900b6d40 con 0x7f94900b8df0 2023-11-08T19:30:02.145 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.140+0000 7f948f7fe700 1 -- 172.21.15.149:0/607667445 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3814565006 0 0) 0x7f949015dee0 con 0x7f94900b2a50 2023-11-08T19:30:02.145 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.140+0000 7f9495478700 1 --2- 172.21.15.149:0/607667445 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94900b8df0 0x7f94900ce720 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f9488009d90 tx=0x7f948800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f18e6cc1b4e72b3 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:02.145 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.140+0000 7f948f7fe700 1 -- 172.21.15.149:0/607667445 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948800e070 con 0x7f94900b8df0 2023-11-08T19:30:02.145 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.140+0000 7f948f7fe700 1 -- 172.21.15.149:0/607667445 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f948800bbd0 con 0x7f94900b8df0 2023-11-08T19:30:02.145 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.140+0000 7f948f7fe700 1 -- 172.21.15.149:0/607667445 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9488012430 con 0x7f94900b8df0 2023-11-08T19:30:02.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.140+0000 7f9496edb700 1 -- 172.21.15.149:0/607667445 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94900b8df0 msgr2=0x7f94900ce720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:02.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.140+0000 7f9496edb700 1 --2- 172.21.15.149:0/607667445 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94900b8df0 0x7f94900ce720 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f9488009d90 tx=0x7f948800b330 comp rx=0 tx=0).stop 2023-11-08T19:30:02.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.140+0000 7f9496edb700 1 -- 172.21.15.149:0/607667445 shutdown_connections 2023-11-08T19:30:02.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.140+0000 7f9496edb700 1 --2- 172.21.15.149:0/607667445 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94900b8df0 0x7f94900ce720 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:02.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.140+0000 7f9496edb700 1 --2- 172.21.15.149:0/607667445 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f949015db00 0x7f94900ce1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:02.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.140+0000 7f9496edb700 1 -- 172.21.15.149:0/607667445 >> 172.21.15.149:0/607667445 conn(0x7f9490072670 msgr2=0x7f9490072a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:02.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.140+0000 7f9496edb700 1 -- 172.21.15.149:0/607667445 shutdown_connections 2023-11-08T19:30:02.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.140+0000 7f9496edb700 1 -- 172.21.15.149:0/607667445 wait complete. 2023-11-08T19:30:02.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.142+0000 7f9496edb700 1 Processor -- start 2023-11-08T19:30:02.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.142+0000 7f9496edb700 1 -- start start 2023-11-08T19:30:02.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.142+0000 7f9496edb700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f94900b2a50 0x7f949014f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:02.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.142+0000 7f9496edb700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f94900b8df0 0x7f94901547f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:02.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.142+0000 7f9496edb700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f949015db00 0x7f94900b5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:02.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.142+0000 7f9496edb700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9490153200 con 0x7f949015db00 2023-11-08T19:30:02.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.142+0000 7f9496edb700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f949014f5c0 con 0x7f94900b8df0 2023-11-08T19:30:02.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.142+0000 7f9496edb700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94901558f0 con 0x7f94900b2a50 2023-11-08T19:30:02.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.143+0000 7f9495478700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f949015db00 0x7f94900b5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:02.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.143+0000 7f9495478700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f949015db00 0x7f94900b5600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45754/0 (socket says 172.21.15.149:45754) 2023-11-08T19:30:02.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.143+0000 7f9495478700 1 -- 172.21.15.149:0/3889205237 learned_addr learned my addr 172.21.15.149:0/3889205237 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:30:02.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.143+0000 7f9494c77700 1 --2- 172.21.15.149:0/3889205237 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f94900b2a50 0x7f949014f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:02.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.143+0000 7f948ffff700 1 --2- 172.21.15.149:0/3889205237 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f94900b8df0 0x7f94901547f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:02.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.143+0000 7f9495478700 1 -- 172.21.15.149:0/3889205237 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f94900b2a50 msgr2=0x7f949014f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:02.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.143+0000 7f9495478700 1 --2- 172.21.15.149:0/3889205237 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f94900b2a50 0x7f949014f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:02.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.143+0000 7f9495478700 1 -- 172.21.15.149:0/3889205237 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f94900b8df0 msgr2=0x7f94901547f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:02.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.143+0000 7f9495478700 1 --2- 172.21.15.149:0/3889205237 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f94900b8df0 0x7f94901547f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:02.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.143+0000 7f9495478700 1 -- 172.21.15.149:0/3889205237 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9488009a70 con 0x7f949015db00 2023-11-08T19:30:02.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.143+0000 7f948ffff700 1 --2- 172.21.15.149:0/3889205237 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f94900b8df0 0x7f94901547f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:30:02.154 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.143+0000 7f9495478700 1 --2- 172.21.15.149:0/3889205237 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f949015db00 0x7f94900b5600 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f94900b6570 tx=0x7f9488004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:02.154 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.143+0000 7f948d7fa700 1 -- 172.21.15.149:0/3889205237 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9488012430 con 0x7f949015db00 2023-11-08T19:30:02.154 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.143+0000 7f948d7fa700 1 -- 172.21.15.149:0/3889205237 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9488020070 con 0x7f949015db00 2023-11-08T19:30:02.154 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.143+0000 7f9496edb700 1 -- 172.21.15.149:0/3889205237 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94900d16f0 con 0x7f949015db00 2023-11-08T19:30:02.154 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.143+0000 7f948d7fa700 1 -- 172.21.15.149:0/3889205237 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9488004280 con 0x7f949015db00 2023-11-08T19:30:02.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.143+0000 7f9496edb700 1 -- 172.21.15.149:0/3889205237 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9490155330 con 0x7f949015db00 2023-11-08T19:30:02.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.144+0000 7f9496edb700 1 -- 172.21.15.149:0/3889205237 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94900d1880 con 0x7f949015db00 2023-11-08T19:30:02.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.145+0000 7f948d7fa700 1 -- 172.21.15.149:0/3889205237 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f94880043e0 con 0x7f949015db00 2023-11-08T19:30:02.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.145+0000 7f948d7fa700 1 --2- 172.21.15.149:0/3889205237 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f947406af00 0x7f947406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:02.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.145+0000 7f9494c77700 1 --2- 172.21.15.149:0/3889205237 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f947406af00 0x7f947406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:02.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.145+0000 7f948d7fa700 1 -- 172.21.15.149:0/3889205237 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7737+0+0 (secure 0 0 0) 0x7f9488022070 con 0x7f949015db00 2023-11-08T19:30:02.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.146+0000 7f9494c77700 1 --2- 172.21.15.149:0/3889205237 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f947406af00 0x7f947406d3c0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f9484006b20 tx=0x7f9484008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:02.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.150+0000 7f948d7fa700 1 -- 172.21.15.149:0/3889205237 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9488056840 con 0x7f949015db00 2023-11-08T19:30:02.345 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.344+0000 7f9496edb700 1 -- 172.21.15.149:0/3889205237 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9490074f10 con 0x7f949015db00 2023-11-08T19:30:02.346 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.345+0000 7f948d7fa700 1 -- 172.21.15.149:0/3889205237 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) v1 ==== 74+0+23067 (secure 0 0 0) 0x7f9488059e60 con 0x7f949015db00 2023-11-08T19:30:02.347 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:30:02.347 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":108,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:29:43.171791+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-08T19:24:29.516185+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-08T19:25:44.287064+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":71,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-08T19:25:45.623521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-11-08T19:26:46.785987+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-11-08T19:26:47.950353+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":9,"snap_epoch":104,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.f","mappings":[{"from":0,"to":5}]},{"pgid":"17.26","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.160:6834/1313631099":"2023-11-09T19:29:27.322904+0000","172.21.15.149:6835/3917392643":"2023-11-09T19:29:34.481449+0000","172.21.15.160:6832/1313631099":"2023-11-09T19:29:27.322904+0000","172.21.15.149:6834/295381437":"2023-11-09T19:28:59.293725+0000","172.21.15.149:6836/295381437":"2023-11-09T19:28:59.293725+0000","172.21.15.160:6835/2714564224":"2023-11-09T19:27:34.046425+0000","172.21.15.149:6837/3917392643":"2023-11-09T19:29:34.481449+0000","172.21.15.149:6834/589971879":"2023-11-09T19:28:00.736319+0000","172.21.15.160:6833/2714564224":"2023-11-09T19:27:34.046425+0000","172.21.15.160:6832/2947079163":"2023-11-09T19:28:27.325108+0000","192.168.0.1:0/1017303916":"2023-11-08T20:29:42.437736+0000","172.21.15.149:6836/589971879":"2023-11-09T19:28:00.736319+0000","172.21.15.160:6834/2947079163":"2023-11-09T19:28:27.325108+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:30:02.349 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.348+0000 7f9496edb700 1 -- 172.21.15.149:0/3889205237 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f947406af00 msgr2=0x7f947406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:02.349 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.348+0000 7f9496edb700 1 --2- 172.21.15.149:0/3889205237 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f947406af00 0x7f947406d3c0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f9484006b20 tx=0x7f9484008040 comp rx=0 tx=0).stop 2023-11-08T19:30:02.350 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.348+0000 7f9496edb700 1 -- 172.21.15.149:0/3889205237 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f949015db00 msgr2=0x7f94900b5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:02.350 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.348+0000 7f9496edb700 1 --2- 172.21.15.149:0/3889205237 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f949015db00 0x7f94900b5600 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f94900b6570 tx=0x7f9488004ad0 comp rx=0 tx=0).stop 2023-11-08T19:30:02.350 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.348+0000 7f9496edb700 1 -- 172.21.15.149:0/3889205237 shutdown_connections 2023-11-08T19:30:02.350 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.348+0000 7f9496edb700 1 --2- 172.21.15.149:0/3889205237 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f947406af00 0x7f947406d3c0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:02.350 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.348+0000 7f9496edb700 1 --2- 172.21.15.149:0/3889205237 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f949015db00 0x7f94900b5600 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:02.351 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.348+0000 7f9496edb700 1 --2- 172.21.15.149:0/3889205237 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f94900b2a50 0x7f949014f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:02.351 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.348+0000 7f9496edb700 1 --2- 172.21.15.149:0/3889205237 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f94900b8df0 0x7f94901547f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:02.351 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.348+0000 7f9496edb700 1 -- 172.21.15.149:0/3889205237 >> 172.21.15.149:0/3889205237 conn(0x7f9490072670 msgr2=0x7f949015e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:02.351 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.348+0000 7f9496edb700 1 -- 172.21.15.149:0/3889205237 shutdown_connections 2023-11-08T19:30:02.352 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.348+0000 7f9496edb700 1 -- 172.21.15.149:0/3889205237 wait complete. 2023-11-08T19:30:02.361 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-08T19:30:02.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.482+0000 7f34ebe2f700 1 Processor -- start 2023-11-08T19:30:02.484 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.482+0000 7f34ebe2f700 1 -- start start 2023-11-08T19:30:02.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.483+0000 7f34ebe2f700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f34e40721c0 0x7f34e415f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:02.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.483+0000 7f34ebe2f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f34e40cab60 0x7f34e415f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:02.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.483+0000 7f34ebe2f700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34e40cb1a0 con 0x7f34e415b8a0 2023-11-08T19:30:02.490 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.483+0000 7f34ebe2f700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34e406d9c0 con 0x7f34e40721c0 2023-11-08T19:30:02.490 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.483+0000 7f34ebe2f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34e406dca0 con 0x7f34e40cab60 2023-11-08T19:30:02.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.483+0000 7f34e9bcb700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f34e415b8a0 0x7f34e40ca450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:47760/0 (socket says 172.21.15.149:47760) 2023-11-08T19:30:02.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.483+0000 7f34e9bcb700 1 -- 172.21.15.149:0/1979043936 learned_addr learned my addr 172.21.15.149:0/1979043936 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:30:02.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.483+0000 7f34ea3cc700 1 --2- 172.21.15.149:0/1979043936 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f34e40cab60 0x7f34e415f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:02.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.483+0000 7f34e93ca700 1 --2- 172.21.15.149:0/1979043936 >> v2:172.21.15.160:3300/0 conn(0x7f34e40721c0 0x7f34e415f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:02.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.483+0000 7f34e8bc9700 1 -- 172.21.15.149:0/1979043936 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3010624228 0 0) 0x7f34d4001110 con 0x7f34e415b8a0 2023-11-08T19:30:02.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.484+0000 7f34e8bc9700 1 -- 172.21.15.149:0/1979043936 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34d00035b0 con 0x7f34e415b8a0 2023-11-08T19:30:02.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.484+0000 7f34e8bc9700 1 -- 172.21.15.149:0/1979043936 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3846505264 0 0) 0x7f34d00035b0 con 0x7f34e415b8a0 2023-11-08T19:30:02.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.484+0000 7f34e8bc9700 1 -- 172.21.15.149:0/1979043936 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f34e40cab60 msgr2=0x7f34e415f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:30:02.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.484+0000 7f34e8bc9700 1 --2- 172.21.15.149:0/1979043936 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f34e40cab60 0x7f34e415f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:02.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.484+0000 7f34e8bc9700 1 -- 172.21.15.149:0/1979043936 >> v2:172.21.15.160:3300/0 conn(0x7f34e40721c0 msgr2=0x7f34e415f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:30:02.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.484+0000 7f34e8bc9700 1 --2- 172.21.15.149:0/1979043936 >> v2:172.21.15.160:3300/0 conn(0x7f34e40721c0 0x7f34e415f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:02.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.484+0000 7f34e8bc9700 1 -- 172.21.15.149:0/1979043936 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e406df80 con 0x7f34e415b8a0 2023-11-08T19:30:02.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.484+0000 7f34e8bc9700 1 -- 172.21.15.149:0/1979043936 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f34d4001800 con 0x7f34e415b8a0 2023-11-08T19:30:02.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.484+0000 7f34e8bc9700 1 -- 172.21.15.149:0/1979043936 >> v1:172.21.15.149:6789/0 conn(0x7f34e415b8a0 legacy=0x7f34e40ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:02.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.484+0000 7f34e8bc9700 1 --2- 172.21.15.149:0/1979043936 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34d0003a00 0x7f34d0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:02.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.484+0000 7f34e8bc9700 1 --2- 172.21.15.149:0/1979043936 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f34e40cab60 0x7f34d0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:02.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.484+0000 7f34e8bc9700 1 --2- 172.21.15.149:0/1979043936 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f34d0004d90 0x7f34d0005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:02.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.484+0000 7f34e8bc9700 1 -- 172.21.15.149:0/1979043936 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e406d9c0 con 0x7f34d0003a00 2023-11-08T19:30:02.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.484+0000 7f34e8bc9700 1 -- 172.21.15.149:0/1979043936 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e406dca0 con 0x7f34d0004d90 2023-11-08T19:30:02.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.484+0000 7f34e8bc9700 1 -- 172.21.15.149:0/1979043936 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34d000ba10 con 0x7f34e40cab60 2023-11-08T19:30:02.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.484+0000 7f34e9bcb700 1 --2- 172.21.15.149:0/1979043936 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34d0003a00 0x7f34d0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:02.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.484+0000 7f34e93ca700 1 --2- 172.21.15.149:0/1979043936 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f34e40cab60 0x7f34d0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:02.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.484+0000 7f34ea3cc700 1 --2- 172.21.15.149:0/1979043936 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f34d0004d90 0x7f34d0005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:02.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.484+0000 7f34e9bcb700 1 -- 172.21.15.149:0/1979043936 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f34e40cab60 msgr2=0x7f34d0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:30:02.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.484+0000 7f34e9bcb700 1 --2- 172.21.15.149:0/1979043936 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f34e40cab60 0x7f34d0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:02.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.484+0000 7f34e9bcb700 1 -- 172.21.15.149:0/1979043936 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f34d0004d90 msgr2=0x7f34d0005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:30:02.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.484+0000 7f34e9bcb700 1 --2- 172.21.15.149:0/1979043936 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f34d0004d90 0x7f34d0005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:02.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.484+0000 7f34e9bcb700 1 -- 172.21.15.149:0/1979043936 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d00035b0 con 0x7f34d0003a00 2023-11-08T19:30:02.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.484+0000 7f34e9bcb700 1 --2- 172.21.15.149:0/1979043936 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34d0003a00 0x7f34d0003e20 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f34d400c320 tx=0x7f34d0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23df24d30e594616 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:02.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.485+0000 7f34e8bc9700 1 -- 172.21.15.149:0/1979043936 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d400ce20 con 0x7f34d0003a00 2023-11-08T19:30:02.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.485+0000 7f34e8bc9700 1 -- 172.21.15.149:0/1979043936 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34d4005960 con 0x7f34d0003a00 2023-11-08T19:30:02.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.485+0000 7f34e8bc9700 1 -- 172.21.15.149:0/1979043936 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d4005d10 con 0x7f34d0003a00 2023-11-08T19:30:02.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.485+0000 7f34ebe2f700 1 -- 172.21.15.149:0/1979043936 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34d0003a00 msgr2=0x7f34d0003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:02.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.485+0000 7f34ebe2f700 1 --2- 172.21.15.149:0/1979043936 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34d0003a00 0x7f34d0003e20 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f34d400c320 tx=0x7f34d0005880 comp rx=0 tx=0).stop 2023-11-08T19:30:02.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.485+0000 7f34ea3cc700 1 -- 172.21.15.149:0/1979043936 reap_dead start 2023-11-08T19:30:02.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.485+0000 7f34ebe2f700 1 -- 172.21.15.149:0/1979043936 shutdown_connections 2023-11-08T19:30:02.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.485+0000 7f34ebe2f700 1 -- 172.21.15.149:0/1979043936 >> 172.21.15.149:0/1979043936 conn(0x7f34e40cfe00 msgr2=0x7f34e40d01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:02.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.485+0000 7f34ebe2f700 1 -- 172.21.15.149:0/1979043936 shutdown_connections 2023-11-08T19:30:02.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.485+0000 7f34ebe2f700 1 -- 172.21.15.149:0/1979043936 wait complete. 2023-11-08T19:30:02.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.487+0000 7f34ebe2f700 1 Processor -- start 2023-11-08T19:30:02.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.487+0000 7f34ebe2f700 1 -- start start 2023-11-08T19:30:02.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.487+0000 7f34ebe2f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f34d0003a00 0x7f34e40cf530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:02.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.487+0000 7f34ebe2f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f34e40c78e0 0x7f34e4155030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:02.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.487+0000 7f34ebe2f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34e4157dd0 0x7f34e4158250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:02.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.487+0000 7f34ebe2f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e40cfa70 con 0x7f34e4157dd0 2023-11-08T19:30:02.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.487+0000 7f34ebe2f700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e4158790 con 0x7f34e40c78e0 2023-11-08T19:30:02.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.487+0000 7f34ebe2f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34e41e59f0 con 0x7f34d0003a00 2023-11-08T19:30:02.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.487+0000 7f34ea3cc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34e4157dd0 0x7f34e4158250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:02.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.488+0000 7f34ea3cc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34e4157dd0 0x7f34e4158250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45774/0 (socket says 172.21.15.149:45774) 2023-11-08T19:30:02.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.488+0000 7f34ea3cc700 1 -- 172.21.15.149:0/2836680328 learned_addr learned my addr 172.21.15.149:0/2836680328 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:30:02.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.488+0000 7f34e93ca700 1 --2- 172.21.15.149:0/2836680328 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f34e40c78e0 0x7f34e4155030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:02.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.488+0000 7f34e9bcb700 1 --2- 172.21.15.149:0/2836680328 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f34d0003a00 0x7f34e40cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:02.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.488+0000 7f34ea3cc700 1 -- 172.21.15.149:0/2836680328 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f34d0003a00 msgr2=0x7f34e40cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:02.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.488+0000 7f34ea3cc700 1 --2- 172.21.15.149:0/2836680328 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f34d0003a00 0x7f34e40cf530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:02.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.488+0000 7f34ea3cc700 1 -- 172.21.15.149:0/2836680328 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f34e40c78e0 msgr2=0x7f34e4155030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:02.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.488+0000 7f34ea3cc700 1 --2- 172.21.15.149:0/2836680328 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f34e40c78e0 0x7f34e4155030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:02.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.488+0000 7f34ea3cc700 1 -- 172.21.15.149:0/2836680328 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e4155a70 con 0x7f34e4157dd0 2023-11-08T19:30:02.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.488+0000 7f34ea3cc700 1 --2- 172.21.15.149:0/2836680328 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34e4157dd0 0x7f34e4158250 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f34e40cfd30 tx=0x7f34dc011f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:02.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.488+0000 7f34da7fc700 1 -- 172.21.15.149:0/2836680328 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34dc00e040 con 0x7f34e4157dd0 2023-11-08T19:30:02.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.488+0000 7f34da7fc700 1 -- 172.21.15.149:0/2836680328 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34dc00f040 con 0x7f34e4157dd0 2023-11-08T19:30:02.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.488+0000 7f34ebe2f700 1 -- 172.21.15.149:0/2836680328 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34e4155570 con 0x7f34e4157dd0 2023-11-08T19:30:02.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.488+0000 7f34da7fc700 1 -- 172.21.15.149:0/2836680328 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34dc00fdb0 con 0x7f34e4157dd0 2023-11-08T19:30:02.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.488+0000 7f34ebe2f700 1 -- 172.21.15.149:0/2836680328 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34e40c7e10 con 0x7f34e4157dd0 2023-11-08T19:30:02.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.489+0000 7f34ebe2f700 1 -- 172.21.15.149:0/2836680328 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34e406c4d0 con 0x7f34e4157dd0 2023-11-08T19:30:02.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.490+0000 7f34da7fc700 1 -- 172.21.15.149:0/2836680328 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f34dc022460 con 0x7f34e4157dd0 2023-11-08T19:30:02.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.490+0000 7f34da7fc700 1 --2- 172.21.15.149:0/2836680328 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f34c806af00 0x7f34c806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:02.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.490+0000 7f34e9bcb700 1 --2- 172.21.15.149:0/2836680328 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f34c806af00 0x7f34c806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:02.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.490+0000 7f34da7fc700 1 -- 172.21.15.149:0/2836680328 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7737+0+0 (secure 0 0 0) 0x7f34dc08a3b0 con 0x7f34e4157dd0 2023-11-08T19:30:02.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.490+0000 7f34e9bcb700 1 --2- 172.21.15.149:0/2836680328 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f34c806af00 0x7f34c806d3c0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f34d4001050 tx=0x7f34d400a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:02.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.495+0000 7f34da7fc700 1 -- 172.21.15.149:0/2836680328 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f34dc054c70 con 0x7f34e4157dd0 2023-11-08T19:30:02.730 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.729+0000 7f34ebe2f700 1 -- 172.21.15.149:0/2836680328 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f34e41e5b80 con 0x7f34e4157dd0 2023-11-08T19:30:02.731 INFO:tasks.ceph.mon.a.smithi149.stderr:2023-11-08T19:30:02.730+0000 7f2b592f2700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-08T19:30:02.732 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.731+0000 7f34da7fc700 1 -- 172.21.15.149:0/2836680328 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v104) v1 ==== 161+0+0 (secure 0 0 0) 0x7f34dc058290 con 0x7f34e4157dd0 2023-11-08T19:30:02.736 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.735+0000 7f34ebe2f700 1 -- 172.21.15.149:0/2836680328 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f34c806af00 msgr2=0x7f34c806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:02.737 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.735+0000 7f34ebe2f700 1 --2- 172.21.15.149:0/2836680328 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f34c806af00 0x7f34c806d3c0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f34d4001050 tx=0x7f34d400a000 comp rx=0 tx=0).stop 2023-11-08T19:30:02.737 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.735+0000 7f34ebe2f700 1 -- 172.21.15.149:0/2836680328 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34e4157dd0 msgr2=0x7f34e4158250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:02.738 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.735+0000 7f34ebe2f700 1 --2- 172.21.15.149:0/2836680328 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34e4157dd0 0x7f34e4158250 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f34e40cfd30 tx=0x7f34dc011f80 comp rx=0 tx=0).stop 2023-11-08T19:30:02.738 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.735+0000 7f34ebe2f700 1 -- 172.21.15.149:0/2836680328 shutdown_connections 2023-11-08T19:30:02.738 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.735+0000 7f34ebe2f700 1 --2- 172.21.15.149:0/2836680328 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f34c806af00 0x7f34c806d3c0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:02.738 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.735+0000 7f34ebe2f700 1 --2- 172.21.15.149:0/2836680328 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34e4157dd0 0x7f34e4158250 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:02.739 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.735+0000 7f34ebe2f700 1 --2- 172.21.15.149:0/2836680328 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f34d0003a00 0x7f34e40cf530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:02.739 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.735+0000 7f34ebe2f700 1 --2- 172.21.15.149:0/2836680328 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f34e40c78e0 0x7f34e4155030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:02.739 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.735+0000 7f34ebe2f700 1 -- 172.21.15.149:0/2836680328 >> 172.21.15.149:0/2836680328 conn(0x7f34e40cfe00 msgr2=0x7f34e4157410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:02.739 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.735+0000 7f34ebe2f700 1 -- 172.21.15.149:0/2836680328 shutdown_connections 2023-11-08T19:30:02.739 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.735+0000 7f34ebe2f700 1 -- 172.21.15.149:0/2836680328 wait complete. 2023-11-08T19:30:02.740 INFO:teuthology.orchestra.run.smithi149.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-08T19:30:02.740 INFO:tasks.ceph.mds.a.smithi149.stderr: -755> 2023-11-08T19:29:45.309+0000 7f8c106be700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-08T19:30:02.741 INFO:tasks.ceph.mds.a.smithi149.stderr: -753> 2023-11-08T19:29:45.309+0000 7f8c106be700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-08T19:30:02.750 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-08T19:30:02.765 INFO:tasks.ceph.mds.d.smithi160.stdout:starting mds.d at 2023-11-08T19:30:02.765 INFO:tasks.ceph.mds.a.smithi149.stdout:starting mds.a at 2023-11-08T19:30:02.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.872+0000 7f1b511bd700 1 Processor -- start 2023-11-08T19:30:02.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.872+0000 7f1b511bd700 1 -- start start 2023-11-08T19:30:02.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.873+0000 7f1b511bd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f1b4c0ce530 0x7f1b4c072ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:02.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.873+0000 7f1b511bd700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1b4c0cd0b0 0x7f1b4c0cd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:02.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.873+0000 7f1b511bd700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b4c0cb1a0 con 0x7f1b4c15d900 2023-11-08T19:30:02.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.873+0000 7f1b511bd700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b4c0cda20 con 0x7f1b4c0ce530 2023-11-08T19:30:02.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.873+0000 7f1b511bd700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4c0cea60 con 0x7f1b4c0cd0b0 2023-11-08T19:30:02.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.873+0000 7f1b4a59c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f1b4c0ce530 0x7f1b4c072ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:02.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.873+0000 7f1b4a59c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f1b4c0ce530 0x7f1b4c072ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45792/0 (socket says 172.21.15.149:45792) 2023-11-08T19:30:02.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.873+0000 7f1b4a59c700 1 -- 172.21.15.149:0/2233796301 learned_addr learned my addr 172.21.15.149:0/2233796301 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:30:02.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.873+0000 7f1b4ad9d700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f1b4c15d900 0x7f1b4c06ab20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:47792/0 (socket says 172.21.15.149:47792) 2023-11-08T19:30:02.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.873+0000 7f1b4b59e700 1 --2- 172.21.15.149:0/2233796301 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1b4c0cd0b0 0x7f1b4c0cd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:02.878 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.873+0000 7f1b4a59c700 1 -- 172.21.15.149:0/2233796301 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1b4c0cd0b0 msgr2=0x7f1b4c0cd4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:30:02.878 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.873+0000 7f1b4a59c700 1 --2- 172.21.15.149:0/2233796301 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1b4c0cd0b0 0x7f1b4c0cd4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:02.878 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.873+0000 7f1b4a59c700 1 -- 172.21.15.149:0/2233796301 >> v1:172.21.15.149:6789/0 conn(0x7f1b4c15d900 legacy=0x7f1b4c06ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:02.878 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.873+0000 7f1b4a59c700 1 -- 172.21.15.149:0/2233796301 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b4c0ced40 con 0x7f1b4c0ce530 2023-11-08T19:30:02.878 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.873+0000 7f1b4a59c700 1 --2- 172.21.15.149:0/2233796301 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b4c0ce530 0x7f1b4c072ae0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f1b400098f0 tx=0x7f1b40009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd4a86331a3a98de server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:02.879 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.873+0000 7f1b49d9b700 1 -- 172.21.15.149:0/2233796301 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4000b8a0 con 0x7f1b4c0ce530 2023-11-08T19:30:02.879 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.873+0000 7f1b49d9b700 1 -- 172.21.15.149:0/2233796301 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b4000ba00 con 0x7f1b4c0ce530 2023-11-08T19:30:02.879 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.873+0000 7f1b49d9b700 1 -- 172.21.15.149:0/2233796301 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4000bd90 con 0x7f1b4c0ce530 2023-11-08T19:30:02.879 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.874+0000 7f1b511bd700 1 -- 172.21.15.149:0/2233796301 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b4c0ce530 msgr2=0x7f1b4c072ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:02.879 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.874+0000 7f1b511bd700 1 --2- 172.21.15.149:0/2233796301 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b4c0ce530 0x7f1b4c072ae0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f1b400098f0 tx=0x7f1b40009c00 comp rx=0 tx=0).stop 2023-11-08T19:30:02.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.874+0000 7f1b511bd700 1 -- 172.21.15.149:0/2233796301 shutdown_connections 2023-11-08T19:30:02.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.874+0000 7f1b511bd700 1 --2- 172.21.15.149:0/2233796301 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1b4c0cd0b0 0x7f1b4c0cd4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:02.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.874+0000 7f1b511bd700 1 --2- 172.21.15.149:0/2233796301 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b4c0ce530 0x7f1b4c072ae0 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:02.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.874+0000 7f1b511bd700 1 -- 172.21.15.149:0/2233796301 >> 172.21.15.149:0/2233796301 conn(0x7f1b4c06e0d0 msgr2=0x7f1b4c06e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:02.881 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.874+0000 7f1b511bd700 1 -- 172.21.15.149:0/2233796301 shutdown_connections 2023-11-08T19:30:02.881 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.874+0000 7f1b511bd700 1 -- 172.21.15.149:0/2233796301 wait complete. 2023-11-08T19:30:02.884 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.876+0000 7f1b511bd700 1 Processor -- start 2023-11-08T19:30:02.884 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.876+0000 7f1b511bd700 1 -- start start 2023-11-08T19:30:02.884 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.876+0000 7f1b511bd700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1b4c0cd0b0 0x7f1b4c1f2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:02.885 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.876+0000 7f1b511bd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b4c0ce530 0x7f1b4c0c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:02.885 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.876+0000 7f1b511bd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1b4c15d900 0x7f1b4c0c7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:02.885 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.876+0000 7f1b511bd700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4c0ca770 con 0x7f1b4c0ce530 2023-11-08T19:30:02.885 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.876+0000 7f1b511bd700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4c0ca1b0 con 0x7f1b4c15d900 2023-11-08T19:30:02.885 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.876+0000 7f1b511bd700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4c0ca490 con 0x7f1b4c0cd0b0 2023-11-08T19:30:02.886 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.876+0000 7f1b4a59c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b4c0ce530 0x7f1b4c0c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:02.886 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.876+0000 7f1b4a59c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b4c0ce530 0x7f1b4c0c96a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45798/0 (socket says 172.21.15.149:45798) 2023-11-08T19:30:02.886 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.876+0000 7f1b4a59c700 1 -- 172.21.15.149:0/3153284366 learned_addr learned my addr 172.21.15.149:0/3153284366 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:30:02.886 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.876+0000 7f1b4ad9d700 1 --2- 172.21.15.149:0/3153284366 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1b4c0cd0b0 0x7f1b4c1f2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:02.887 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.877+0000 7f1b4b59e700 1 --2- 172.21.15.149:0/3153284366 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1b4c15d900 0x7f1b4c0c7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:02.887 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.877+0000 7f1b4a59c700 1 -- 172.21.15.149:0/3153284366 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1b4c0cd0b0 msgr2=0x7f1b4c1f2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:02.887 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.877+0000 7f1b4a59c700 1 --2- 172.21.15.149:0/3153284366 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1b4c0cd0b0 0x7f1b4c1f2c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:02.887 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.877+0000 7f1b4a59c700 1 -- 172.21.15.149:0/3153284366 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1b4c15d900 msgr2=0x7f1b4c0c7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:02.887 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.877+0000 7f1b4a59c700 1 --2- 172.21.15.149:0/3153284366 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1b4c15d900 0x7f1b4c0c7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:02.888 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.877+0000 7f1b4a59c700 1 -- 172.21.15.149:0/3153284366 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b40009550 con 0x7f1b4c0ce530 2023-11-08T19:30:02.888 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.877+0000 7f1b4a59c700 1 --2- 172.21.15.149:0/3153284366 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b4c0ce530 0x7f1b4c0c96a0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f1b40000c00 tx=0x7f1b40004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:02.888 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.877+0000 7f1b337fe700 1 -- 172.21.15.149:0/3153284366 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b40004300 con 0x7f1b4c0ce530 2023-11-08T19:30:02.888 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.877+0000 7f1b337fe700 1 -- 172.21.15.149:0/3153284366 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b4001f070 con 0x7f1b4c0ce530 2023-11-08T19:30:02.888 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.877+0000 7f1b511bd700 1 -- 172.21.15.149:0/3153284366 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b4c0b4250 con 0x7f1b4c0ce530 2023-11-08T19:30:02.889 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.877+0000 7f1b337fe700 1 -- 172.21.15.149:0/3153284366 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b400036a0 con 0x7f1b4c0ce530 2023-11-08T19:30:02.889 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.877+0000 7f1b511bd700 1 -- 172.21.15.149:0/3153284366 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b4c1f31a0 con 0x7f1b4c0ce530 2023-11-08T19:30:02.889 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.878+0000 7f1b511bd700 1 -- 172.21.15.149:0/3153284366 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b4c0b4770 con 0x7f1b4c0ce530 2023-11-08T19:30:02.889 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.878+0000 7f1b337fe700 1 -- 172.21.15.149:0/3153284366 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1b40021030 con 0x7f1b4c0ce530 2023-11-08T19:30:02.889 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.879+0000 7f1b337fe700 1 --2- 172.21.15.149:0/3153284366 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1b3806af00 0x7f1b3806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:02.890 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.879+0000 7f1b4ad9d700 1 --2- 172.21.15.149:0/3153284366 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1b3806af00 0x7f1b3806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:02.890 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.879+0000 7f1b337fe700 1 -- 172.21.15.149:0/3153284366 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7909+0+0 (secure 0 0 0) 0x7f1b4008b1a0 con 0x7f1b4c0ce530 2023-11-08T19:30:02.890 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.879+0000 7f1b4ad9d700 1 --2- 172.21.15.149:0/3153284366 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1b3806af00 0x7f1b3806d3c0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c000f60 tx=0x7f1b3c007ed0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:02.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:02.884+0000 7f1b337fe700 1 -- 172.21.15.149:0/3153284366 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1b4c0b4770 con 0x7f1b4c0ce530 2023-11-08T19:30:03.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.119+0000 7f1b511bd700 1 -- 172.21.15.149:0/3153284366 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f1b4c0b4770 con 0x7f1b4c0ce530 2023-11-08T19:30:03.735 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.734+0000 7f1b337fe700 1 -- 172.21.15.149:0/3153284366 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v105) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1b4c0b4770 con 0x7f1b4c0ce530 2023-11-08T19:30:03.738 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.737+0000 7f1b511bd700 1 -- 172.21.15.149:0/3153284366 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1b3806af00 msgr2=0x7f1b3806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:03.739 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.737+0000 7f1b511bd700 1 --2- 172.21.15.149:0/3153284366 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1b3806af00 0x7f1b3806d3c0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c000f60 tx=0x7f1b3c007ed0 comp rx=0 tx=0).stop 2023-11-08T19:30:03.739 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.737+0000 7f1b511bd700 1 -- 172.21.15.149:0/3153284366 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b4c0ce530 msgr2=0x7f1b4c0c96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:03.739 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.737+0000 7f1b511bd700 1 --2- 172.21.15.149:0/3153284366 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b4c0ce530 0x7f1b4c0c96a0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f1b40000c00 tx=0x7f1b40004750 comp rx=0 tx=0).stop 2023-11-08T19:30:03.739 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.737+0000 7f1b511bd700 1 -- 172.21.15.149:0/3153284366 shutdown_connections 2023-11-08T19:30:03.739 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.737+0000 7f1b511bd700 1 --2- 172.21.15.149:0/3153284366 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f1b3806af00 0x7f1b3806d3c0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:03.740 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.737+0000 7f1b511bd700 1 --2- 172.21.15.149:0/3153284366 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1b4c15d900 0x7f1b4c0c7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:03.740 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.737+0000 7f1b511bd700 1 --2- 172.21.15.149:0/3153284366 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1b4c0cd0b0 0x7f1b4c1f2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:03.740 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.737+0000 7f1b511bd700 1 --2- 172.21.15.149:0/3153284366 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b4c0ce530 0x7f1b4c0c96a0 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:03.740 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.737+0000 7f1b511bd700 1 -- 172.21.15.149:0/3153284366 >> 172.21.15.149:0/3153284366 conn(0x7f1b4c06e0d0 msgr2=0x7f1b4c0acae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:03.740 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.737+0000 7f1b511bd700 1 -- 172.21.15.149:0/3153284366 shutdown_connections 2023-11-08T19:30:03.741 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.737+0000 7f1b511bd700 1 -- 172.21.15.149:0/3153284366 wait complete. 2023-11-08T19:30:03.752 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-08T19:30:03.919 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.918+0000 7f8473ca8700 1 Processor -- start 2023-11-08T19:30:03.919 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.918+0000 7f8473ca8700 1 -- start start 2023-11-08T19:30:03.922 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.919+0000 7f8473ca8700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f846c0cb650 0x7f846c06ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:03.922 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.919+0000 7f8473ca8700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f846c15be30 0x7f846c0b5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:03.922 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.919+0000 7f8473ca8700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f846c15f420 con 0x7f846c0ccf60 2023-11-08T19:30:03.923 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.919+0000 7f8473ca8700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f846c15c360 con 0x7f846c0cb650 2023-11-08T19:30:03.923 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.919+0000 7f8473ca8700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f846c15c640 con 0x7f846c15be30 2023-11-08T19:30:03.923 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.919+0000 7f8471a44700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f846c0cb650 0x7f846c06ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:03.923 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.919+0000 7f8471243700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f846c15be30 0x7f846c0b5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:03.923 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.919+0000 7f8471a44700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f846c0cb650 0x7f846c06ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.149:46798/0 (socket says 172.21.15.149:46798) 2023-11-08T19:30:03.924 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.919+0000 7f8472245700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f846c0ccf60 0x7f846c0cd3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.149:59478/0 (socket says 172.21.15.149:59478) 2023-11-08T19:30:03.924 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.919+0000 7f8471243700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f846c15be30 0x7f846c0b5fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.149:37862/0 (socket says 172.21.15.149:37862) 2023-11-08T19:30:03.924 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.919+0000 7f8471a44700 1 -- 172.21.15.149:0/3595267895 learned_addr learned my addr 172.21.15.149:0/3595267895 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:30:03.924 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.920+0000 7f8471243700 1 -- 172.21.15.149:0/3595267895 >> v2:172.21.15.160:3300/0 conn(0x7f846c0cb650 msgr2=0x7f846c06ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:30:03.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.920+0000 7f8471243700 1 --2- 172.21.15.149:0/3595267895 >> v2:172.21.15.160:3300/0 conn(0x7f846c0cb650 0x7f846c06ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:03.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.920+0000 7f8471243700 1 -- 172.21.15.149:0/3595267895 >> v1:172.21.15.160:6789/0 conn(0x7f846c0ccf60 legacy=0x7f846c0cd3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:03.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.920+0000 7f8471243700 1 -- 172.21.15.149:0/3595267895 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f846c15c920 con 0x7f846c15be30 2023-11-08T19:30:03.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.920+0000 7f8471a44700 1 --2- 172.21.15.149:0/3595267895 >> v2:172.21.15.160:3300/0 conn(0x7f846c0cb650 0x7f846c06ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:30:03.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.920+0000 7f8470a42700 1 -- 172.21.15.149:0/3595267895 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1312468405 0 0) 0x7f846c15f420 con 0x7f846c0ccf60 2023-11-08T19:30:03.926 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.920+0000 7f8471243700 1 --2- 172.21.15.149:0/3595267895 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f846c15be30 0x7f846c0b5fb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f845c009840 tx=0x7f845c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23c0146e9ffb1b69 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:03.926 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.920+0000 7f8470a42700 1 -- 172.21.15.149:0/3595267895 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845c011830 con 0x7f846c15be30 2023-11-08T19:30:03.926 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.920+0000 7f8470a42700 1 -- 172.21.15.149:0/3595267895 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f845c011990 con 0x7f846c15be30 2023-11-08T19:30:03.926 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.920+0000 7f8470a42700 1 -- 172.21.15.149:0/3595267895 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845c011d20 con 0x7f846c15be30 2023-11-08T19:30:03.926 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.920+0000 7f8473ca8700 1 -- 172.21.15.149:0/3595267895 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f846c15be30 msgr2=0x7f846c0b5fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:03.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.920+0000 7f8473ca8700 1 --2- 172.21.15.149:0/3595267895 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f846c15be30 0x7f846c0b5fb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f845c009840 tx=0x7f845c009b50 comp rx=0 tx=0).stop 2023-11-08T19:30:03.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.920+0000 7f8473ca8700 1 -- 172.21.15.149:0/3595267895 shutdown_connections 2023-11-08T19:30:03.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.920+0000 7f8473ca8700 1 --2- 172.21.15.149:0/3595267895 >> v2:172.21.15.160:3300/0 conn(0x7f846c0cb650 0x7f846c06ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:03.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.920+0000 7f8473ca8700 1 --2- 172.21.15.149:0/3595267895 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f846c15be30 0x7f846c0b5fb0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:03.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.920+0000 7f8473ca8700 1 -- 172.21.15.149:0/3595267895 >> 172.21.15.149:0/3595267895 conn(0x7f846c06e0d0 msgr2=0x7f846c06e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:03.928 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.921+0000 7f8473ca8700 1 -- 172.21.15.149:0/3595267895 shutdown_connections 2023-11-08T19:30:03.928 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.921+0000 7f8473ca8700 1 -- 172.21.15.149:0/3595267895 wait complete. 2023-11-08T19:30:03.931 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.922+0000 7f8473ca8700 1 Processor -- start 2023-11-08T19:30:03.931 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.922+0000 7f8473ca8700 1 -- start start 2023-11-08T19:30:03.931 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.922+0000 7f8473ca8700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f846c0cb650 0x7f846c14aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:03.931 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.922+0000 7f8473ca8700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f846c0ccf60 0x7f846c157330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:03.932 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.922+0000 7f8473ca8700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f846c15be30 0x7f846c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:03.932 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.922+0000 7f8473ca8700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f846c158910 con 0x7f846c15be30 2023-11-08T19:30:03.932 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.922+0000 7f8473ca8700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f846c1e4e50 con 0x7f846c0ccf60 2023-11-08T19:30:03.932 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.922+0000 7f8473ca8700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f846c1e5130 con 0x7f846c0cb650 2023-11-08T19:30:03.932 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.923+0000 7f8472245700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f846c15be30 0x7f846c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:03.933 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.923+0000 7f8472245700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f846c15be30 0x7f846c15abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45816/0 (socket says 172.21.15.149:45816) 2023-11-08T19:30:03.933 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.923+0000 7f8472245700 1 -- 172.21.15.149:0/1433924761 learned_addr learned my addr 172.21.15.149:0/1433924761 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:30:03.933 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.923+0000 7f8471a44700 1 --2- 172.21.15.149:0/1433924761 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f846c0cb650 0x7f846c14aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:03.933 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.923+0000 7f8471243700 1 --2- 172.21.15.149:0/1433924761 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f846c0ccf60 0x7f846c157330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:03.933 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.923+0000 7f8472245700 1 -- 172.21.15.149:0/1433924761 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f846c0cb650 msgr2=0x7f846c14aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:03.934 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.923+0000 7f8472245700 1 --2- 172.21.15.149:0/1433924761 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f846c0cb650 0x7f846c14aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:03.934 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.923+0000 7f8472245700 1 -- 172.21.15.149:0/1433924761 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f846c0ccf60 msgr2=0x7f846c157330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:03.934 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.923+0000 7f8472245700 1 --2- 172.21.15.149:0/1433924761 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f846c0ccf60 0x7f846c157330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:03.934 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.923+0000 7f8472245700 1 -- 172.21.15.149:0/1433924761 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8468009550 con 0x7f846c15be30 2023-11-08T19:30:03.934 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.923+0000 7f8471243700 1 --2- 172.21.15.149:0/1433924761 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f846c0ccf60 0x7f846c157330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:30:03.935 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.923+0000 7f8472245700 1 --2- 172.21.15.149:0/1433924761 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f846c15be30 0x7f846c15abd0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f846400cb90 tx=0x7f846400cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:03.935 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.923+0000 7f84627fc700 1 -- 172.21.15.149:0/1433924761 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846400ab70 con 0x7f846c15be30 2023-11-08T19:30:03.935 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.923+0000 7f84627fc700 1 -- 172.21.15.149:0/1433924761 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f846400acf0 con 0x7f846c15be30 2023-11-08T19:30:03.935 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.923+0000 7f8473ca8700 1 -- 172.21.15.149:0/1433924761 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f845c0094a0 con 0x7f846c15be30 2023-11-08T19:30:03.935 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.923+0000 7f84627fc700 1 -- 172.21.15.149:0/1433924761 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8464007310 con 0x7f846c15be30 2023-11-08T19:30:03.936 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.923+0000 7f8473ca8700 1 -- 172.21.15.149:0/1433924761 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f846c1e56f0 con 0x7f846c15be30 2023-11-08T19:30:03.936 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.924+0000 7f8473ca8700 1 -- 172.21.15.149:0/1433924761 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f846c074f10 con 0x7f846c15be30 2023-11-08T19:30:03.936 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.925+0000 7f84627fc700 1 -- 172.21.15.149:0/1433924761 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8464007470 con 0x7f846c15be30 2023-11-08T19:30:03.936 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.925+0000 7f84627fc700 1 --2- 172.21.15.149:0/1433924761 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f845006af00 0x7f845006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:03.936 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.925+0000 7f84627fc700 1 -- 172.21.15.149:0/1433924761 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7909+0+0 (secure 0 0 0) 0x7f8464089cd0 con 0x7f846c15be30 2023-11-08T19:30:03.937 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.925+0000 7f8471a44700 1 --2- 172.21.15.149:0/1433924761 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f845006af00 0x7f845006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:03.937 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.926+0000 7f8471a44700 1 --2- 172.21.15.149:0/1433924761 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f845006af00 0x7f845006d3c0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f8468009cf0 tx=0x7f8468008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:03.937 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:03.930+0000 7f84627fc700 1 -- 172.21.15.149:0/1433924761 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f84640544e0 con 0x7f846c15be30 2023-11-08T19:30:04.122 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.120+0000 7f8473ca8700 1 -- 172.21.15.149:0/1433924761 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f846c06bb50 con 0x7f846c15be30 2023-11-08T19:30:04.741 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.740+0000 7f84627fc700 1 -- 172.21.15.149:0/1433924761 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v110) v1 ==== 181+0+0 (secure 0 0 0) 0x7f8464018070 con 0x7f846c15be30 2023-11-08T19:30:04.744 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.743+0000 7f8473ca8700 1 -- 172.21.15.149:0/1433924761 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f845006af00 msgr2=0x7f845006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:04.745 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.743+0000 7f8473ca8700 1 --2- 172.21.15.149:0/1433924761 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f845006af00 0x7f845006d3c0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f8468009cf0 tx=0x7f8468008040 comp rx=0 tx=0).stop 2023-11-08T19:30:04.745 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.743+0000 7f8473ca8700 1 -- 172.21.15.149:0/1433924761 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f846c15be30 msgr2=0x7f846c15abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:04.745 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.743+0000 7f8473ca8700 1 --2- 172.21.15.149:0/1433924761 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f846c15be30 0x7f846c15abd0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f846400cb90 tx=0x7f846400cf50 comp rx=0 tx=0).stop 2023-11-08T19:30:04.746 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.744+0000 7f8473ca8700 1 -- 172.21.15.149:0/1433924761 shutdown_connections 2023-11-08T19:30:04.746 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.744+0000 7f8473ca8700 1 --2- 172.21.15.149:0/1433924761 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f845006af00 0x7f845006d3c0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:04.746 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.744+0000 7f8473ca8700 1 --2- 172.21.15.149:0/1433924761 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f846c15be30 0x7f846c15abd0 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:04.746 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.744+0000 7f8473ca8700 1 --2- 172.21.15.149:0/1433924761 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f846c0cb650 0x7f846c14aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:04.747 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.744+0000 7f8473ca8700 1 --2- 172.21.15.149:0/1433924761 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f846c0ccf60 0x7f846c157330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:04.747 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.744+0000 7f8473ca8700 1 -- 172.21.15.149:0/1433924761 >> 172.21.15.149:0/1433924761 conn(0x7f846c06e0d0 msgr2=0x7f846c15e750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:04.747 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.745+0000 7f8473ca8700 1 -- 172.21.15.149:0/1433924761 shutdown_connections 2023-11-08T19:30:04.747 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.745+0000 7f8473ca8700 1 -- 172.21.15.149:0/1433924761 wait complete. 2023-11-08T19:30:04.748 INFO:teuthology.orchestra.run.smithi149.stderr:pool 'cephfs_metadata' removed 2023-11-08T19:30:04.761 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-08T19:30:04.888 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.887+0000 7f19ba20c700 1 Processor -- start 2023-11-08T19:30:04.888 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.887+0000 7f19ba20c700 1 -- start start 2023-11-08T19:30:04.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.888+0000 7f19ba20c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f19b415db00 0x7f19b40cbec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:04.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.888+0000 7f19ba20c700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19b406bdd0 con 0x7f19b415dee0 2023-11-08T19:30:04.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.888+0000 7f19ba20c700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19b406c070 con 0x7f19b40cd0a0 2023-11-08T19:30:04.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.888+0000 7f19ba20c700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19b40cc400 con 0x7f19b415db00 2023-11-08T19:30:04.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.888+0000 7f19b37fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f19b415db00 0x7f19b40cbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:04.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.888+0000 7f19b37fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f19b415db00 0x7f19b40cbec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45820/0 (socket says 172.21.15.149:45820) 2023-11-08T19:30:04.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.888+0000 7f19b37fe700 1 -- 172.21.15.149:0/159119541 learned_addr learned my addr 172.21.15.149:0/159119541 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:30:04.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.888+0000 7f19b2ffd700 1 --1- 172.21.15.149:0/159119541 >> v1:172.21.15.149:6789/0 conn(0x7f19b415dee0 0x7f19b4072a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:47822/0 (socket says 172.21.15.149:47822) 2023-11-08T19:30:04.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.888+0000 7f19b37fe700 1 -- 172.21.15.149:0/159119541 >> v1:172.21.15.160:6789/0 conn(0x7f19b40cd0a0 legacy=0x7f19b415e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:30:04.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.888+0000 7f19b37fe700 1 -- 172.21.15.149:0/159119541 >> v1:172.21.15.149:6789/0 conn(0x7f19b415dee0 legacy=0x7f19b4072a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:04.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.888+0000 7f19b37fe700 1 -- 172.21.15.149:0/159119541 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b406c350 con 0x7f19b415db00 2023-11-08T19:30:04.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.888+0000 7f19b37fe700 1 --2- 172.21.15.149:0/159119541 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19b415db00 0x7f19b40cbec0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f19a80098f0 tx=0x7f19a8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb23dbb851d06e84 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:04.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.888+0000 7f19b27fc700 1 -- 172.21.15.149:0/159119541 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a8004230 con 0x7f19b415db00 2023-11-08T19:30:04.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.888+0000 7f19b27fc700 1 -- 172.21.15.149:0/159119541 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a8004390 con 0x7f19b415db00 2023-11-08T19:30:04.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.888+0000 7f19b27fc700 1 -- 172.21.15.149:0/159119541 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a80036a0 con 0x7f19b415db00 2023-11-08T19:30:04.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.889+0000 7f19ba20c700 1 -- 172.21.15.149:0/159119541 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19b415db00 msgr2=0x7f19b40cbec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:04.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.889+0000 7f19ba20c700 1 --2- 172.21.15.149:0/159119541 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19b415db00 0x7f19b40cbec0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f19a80098f0 tx=0x7f19a8009c00 comp rx=0 tx=0).stop 2023-11-08T19:30:04.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.889+0000 7f19ba20c700 1 -- 172.21.15.149:0/159119541 shutdown_connections 2023-11-08T19:30:04.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.889+0000 7f19ba20c700 1 --2- 172.21.15.149:0/159119541 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19b415db00 0x7f19b40cbec0 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:04.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.889+0000 7f19ba20c700 1 -- 172.21.15.149:0/159119541 >> 172.21.15.149:0/159119541 conn(0x7f19b406e0d0 msgr2=0x7f19b406e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:04.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.889+0000 7f19ba20c700 1 -- 172.21.15.149:0/159119541 shutdown_connections 2023-11-08T19:30:04.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.889+0000 7f19ba20c700 1 -- 172.21.15.149:0/159119541 wait complete. 2023-11-08T19:30:04.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.890+0000 7f19ba20c700 1 Processor -- start 2023-11-08T19:30:04.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.890+0000 7f19ba20c700 1 -- start start 2023-11-08T19:30:04.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.891+0000 7f19ba20c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19b40cd0a0 0x7f19b415a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:04.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.891+0000 7f19ba20c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f19b415dee0 0x7f19b414e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:04.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.891+0000 7f19ba20c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f19b4157600 0x7f19b40b5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:04.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.891+0000 7f19ba20c700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b40b46e0 con 0x7f19b40cd0a0 2023-11-08T19:30:04.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.891+0000 7f19ba20c700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b40b48c0 con 0x7f19b415dee0 2023-11-08T19:30:04.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.891+0000 7f19ba20c700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19b40b4ba0 con 0x7f19b4157600 2023-11-08T19:30:04.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.891+0000 7f19b37fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19b40cd0a0 0x7f19b415a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:04.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.891+0000 7f19b37fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19b40cd0a0 0x7f19b415a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45824/0 (socket says 172.21.15.149:45824) 2023-11-08T19:30:04.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.891+0000 7f19b37fe700 1 -- 172.21.15.149:0/3293424207 learned_addr learned my addr 172.21.15.149:0/3293424207 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:30:04.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.891+0000 7f19b3fff700 1 --2- 172.21.15.149:0/3293424207 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f19b4157600 0x7f19b40b5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:04.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.891+0000 7f19b2ffd700 1 --2- 172.21.15.149:0/3293424207 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f19b415dee0 0x7f19b414e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:04.902 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.891+0000 7f19b37fe700 1 -- 172.21.15.149:0/3293424207 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f19b4157600 msgr2=0x7f19b40b5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:04.902 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.891+0000 7f19b37fe700 1 --2- 172.21.15.149:0/3293424207 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f19b4157600 0x7f19b40b5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:04.902 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.891+0000 7f19b37fe700 1 -- 172.21.15.149:0/3293424207 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f19b415dee0 msgr2=0x7f19b414e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:04.902 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.891+0000 7f19b37fe700 1 --2- 172.21.15.149:0/3293424207 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f19b415dee0 0x7f19b414e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:04.902 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.891+0000 7f19b37fe700 1 -- 172.21.15.149:0/3293424207 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a8009550 con 0x7f19b40cd0a0 2023-11-08T19:30:04.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.892+0000 7f19b37fe700 1 --2- 172.21.15.149:0/3293424207 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19b40cd0a0 0x7f19b415a3c0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f19a8004000 tx=0x7f19a8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:04.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.892+0000 7f199bfff700 1 -- 172.21.15.149:0/3293424207 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a8003cc0 con 0x7f19b40cd0a0 2023-11-08T19:30:04.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.892+0000 7f199bfff700 1 -- 172.21.15.149:0/3293424207 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a801f070 con 0x7f19b40cd0a0 2023-11-08T19:30:04.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.892+0000 7f19ba20c700 1 -- 172.21.15.149:0/3293424207 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19b40b4e80 con 0x7f19b40cd0a0 2023-11-08T19:30:04.904 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.892+0000 7f199bfff700 1 -- 172.21.15.149:0/3293424207 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a800b8e0 con 0x7f19b40cd0a0 2023-11-08T19:30:04.904 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.892+0000 7f19ba20c700 1 -- 172.21.15.149:0/3293424207 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19b40b5440 con 0x7f19b40cd0a0 2023-11-08T19:30:04.904 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.893+0000 7f19ba20c700 1 -- 172.21.15.149:0/3293424207 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19b4074f10 con 0x7f19b40cd0a0 2023-11-08T19:30:04.904 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.893+0000 7f199bfff700 1 -- 172.21.15.149:0/3293424207 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f19a8021030 con 0x7f19b40cd0a0 2023-11-08T19:30:04.904 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.894+0000 7f199bfff700 1 --2- 172.21.15.149:0/3293424207 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f19a006af30 0x7f19a006d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:04.905 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.894+0000 7f199bfff700 1 -- 172.21.15.149:0/3293424207 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 7471+0+0 (secure 0 0 0) 0x7f19a808b3c0 con 0x7f19b40cd0a0 2023-11-08T19:30:04.905 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.894+0000 7f19b2ffd700 1 --2- 172.21.15.149:0/3293424207 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f19a006af30 0x7f19a006d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:04.905 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.894+0000 7f19b2ffd700 1 --2- 172.21.15.149:0/3293424207 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f19a006af30 0x7f19a006d3f0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f19b40af8c0 tx=0x7f19a4007d10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:04.905 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:04.898+0000 7f199bfff700 1 -- 172.21.15.149:0/3293424207 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f19a8055d80 con 0x7f19b40cd0a0 2023-11-08T19:30:05.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:05.087+0000 7f19ba20c700 1 -- 172.21.15.149:0/3293424207 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f19b4074f10 con 0x7f19b40cd0a0 2023-11-08T19:30:05.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:05.741+0000 7f199bfff700 1 -- 172.21.15.149:0/3293424207 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v111) v1 ==== 169+0+0 (secure 0 0 0) 0x7f19a80593a0 con 0x7f19b40cd0a0 2023-11-08T19:30:05.745 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:05.744+0000 7f19ba20c700 1 -- 172.21.15.149:0/3293424207 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f19a006af30 msgr2=0x7f19a006d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:05.746 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:05.744+0000 7f19ba20c700 1 --2- 172.21.15.149:0/3293424207 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f19a006af30 0x7f19a006d3f0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f19b40af8c0 tx=0x7f19a4007d10 comp rx=0 tx=0).stop 2023-11-08T19:30:05.746 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:05.744+0000 7f19ba20c700 1 -- 172.21.15.149:0/3293424207 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19b40cd0a0 msgr2=0x7f19b415a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:05.746 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:05.744+0000 7f19ba20c700 1 --2- 172.21.15.149:0/3293424207 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19b40cd0a0 0x7f19b415a3c0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f19a8004000 tx=0x7f19a8004750 comp rx=0 tx=0).stop 2023-11-08T19:30:05.746 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:05.744+0000 7f19ba20c700 1 -- 172.21.15.149:0/3293424207 shutdown_connections 2023-11-08T19:30:05.747 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:05.744+0000 7f19ba20c700 1 --2- 172.21.15.149:0/3293424207 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f19a006af30 0x7f19a006d3f0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:05.747 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:05.744+0000 7f19ba20c700 1 --2- 172.21.15.149:0/3293424207 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f19b4157600 0x7f19b40b5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:05.747 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:05.744+0000 7f19ba20c700 1 --2- 172.21.15.149:0/3293424207 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19b40cd0a0 0x7f19b415a3c0 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:05.747 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:05.744+0000 7f19ba20c700 1 --2- 172.21.15.149:0/3293424207 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f19b415dee0 0x7f19b414e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:05.747 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:05.744+0000 7f19ba20c700 1 -- 172.21.15.149:0/3293424207 >> 172.21.15.149:0/3293424207 conn(0x7f19b406e0d0 msgr2=0x7f19b40b0620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:05.748 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:05.744+0000 7f19ba20c700 1 -- 172.21.15.149:0/3293424207 shutdown_connections 2023-11-08T19:30:05.748 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:05.744+0000 7f19ba20c700 1 -- 172.21.15.149:0/3293424207 wait complete. 2023-11-08T19:30:05.748 INFO:teuthology.orchestra.run.smithi149.stderr:pool 'cephfs_data' removed 2023-11-08T19:30:05.760 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-08T19:30:05.763 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-08T19:30:05.808 INFO:teuthology.orchestra.run.smithi149.stdout:[global] 2023-11-08T19:30:05.808 INFO:teuthology.orchestra.run.smithi149.stdout: chdir = "" 2023-11-08T19:30:05.809 INFO:teuthology.orchestra.run.smithi149.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-08T19:30:05.809 INFO:teuthology.orchestra.run.smithi149.stdout: auth supported = cephx 2023-11-08T19:30:05.809 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:30:05.809 INFO:teuthology.orchestra.run.smithi149.stdout: filestore xattr use omap = true 2023-11-08T19:30:05.809 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:30:05.810 INFO:teuthology.orchestra.run.smithi149.stdout: mon clock drift allowed = 1.000 2023-11-08T19:30:05.810 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:30:05.810 INFO:teuthology.orchestra.run.smithi149.stdout: osd crush chooseleaf type = 0 2023-11-08T19:30:05.810 INFO:teuthology.orchestra.run.smithi149.stdout: auth debug = true 2023-11-08T19:30:05.811 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:30:05.811 INFO:teuthology.orchestra.run.smithi149.stdout: ms die on old message = true 2023-11-08T19:30:05.811 INFO:teuthology.orchestra.run.smithi149.stdout: ms die on bug = true 2023-11-08T19:30:05.811 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:30:05.811 INFO:teuthology.orchestra.run.smithi149.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-08T19:30:05.812 INFO:teuthology.orchestra.run.smithi149.stdout: mon pg warn max object skew = 0 2023-11-08T19:30:05.812 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:30:05.812 INFO:teuthology.orchestra.run.smithi149.stdout: # disable pg_autoscaler by default for new pools 2023-11-08T19:30:05.812 INFO:teuthology.orchestra.run.smithi149.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-08T19:30:05.812 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:30:05.813 INFO:teuthology.orchestra.run.smithi149.stdout: osd pool default size = 2 2023-11-08T19:30:05.813 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:30:05.813 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd allow primary affinity = true 2023-11-08T19:30:05.813 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd allow pg remap = true 2023-11-08T19:30:05.813 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on legacy crush tunables = false 2023-11-08T19:30:05.814 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on crush straw calc version zero = false 2023-11-08T19:30:05.814 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on no sortbitwise = false 2023-11-08T19:30:05.814 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on osd down out interval zero = false 2023-11-08T19:30:05.814 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on too few osds = false 2023-11-08T19:30:05.814 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-08T19:30:05.815 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-08T19:30:05.815 INFO:teuthology.orchestra.run.smithi149.stdout: mon_allow_pool_size_one = true 2023-11-08T19:30:05.815 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:30:05.815 INFO:teuthology.orchestra.run.smithi149.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-08T19:30:05.815 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:30:05.816 INFO:teuthology.orchestra.run.smithi149.stdout: osd default data pool replay window = 5 2023-11-08T19:30:05.816 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:30:05.816 INFO:teuthology.orchestra.run.smithi149.stdout: mon allow pool delete = true 2023-11-08T19:30:05.816 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:30:05.816 INFO:teuthology.orchestra.run.smithi149.stdout: mon cluster log file level = debug 2023-11-08T19:30:05.817 INFO:teuthology.orchestra.run.smithi149.stdout: debug asserts on shutdown = true 2023-11-08T19:30:05.817 INFO:teuthology.orchestra.run.smithi149.stdout: mon health detail to clog = false 2023-11-08T19:30:05.817 INFO:teuthology.orchestra.run.smithi149.stdout: mon host = "172.21.15.149,172.21.15.160,[v2:172.21.15.160:3301,v1:172.21.15.160:6790]" 2023-11-08T19:30:05.817 INFO:teuthology.orchestra.run.smithi149.stdout: ms die on skipped message = False 2023-11-08T19:30:05.817 INFO:teuthology.orchestra.run.smithi149.stdout: fsid = 0aba7c70-fe80-4446-a2f5-7502ac3adfb4 2023-11-08T19:30:05.818 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:30:05.818 INFO:teuthology.orchestra.run.smithi149.stdout:[osd] 2023-11-08T19:30:05.818 INFO:teuthology.orchestra.run.smithi149.stdout: osd journal size = 100 2023-11-08T19:30:05.818 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:30:05.818 INFO:teuthology.orchestra.run.smithi149.stdout: osd scrub load threshold = 5.0 2023-11-08T19:30:05.819 INFO:teuthology.orchestra.run.smithi149.stdout: osd scrub max interval = 600 2023-11-08T19:30:05.819 INFO:teuthology.orchestra.run.smithi149.stdout: osd mclock profile = high_recovery_ops 2023-11-08T19:30:05.819 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:30:05.819 INFO:teuthology.orchestra.run.smithi149.stdout: osd recover clone overlap = true 2023-11-08T19:30:05.819 INFO:teuthology.orchestra.run.smithi149.stdout: osd recovery max chunk = 1048576 2023-11-08T19:30:05.820 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:30:05.820 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug shutdown = true 2023-11-08T19:30:05.820 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug op order = true 2023-11-08T19:30:05.820 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug verify stray on activate = true 2023-11-08T19:30:05.821 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug trim objects = true 2023-11-08T19:30:05.821 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:30:05.821 INFO:teuthology.orchestra.run.smithi149.stdout: osd open classes on start = true 2023-11-08T19:30:05.821 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug pg log writeout = true 2023-11-08T19:30:05.821 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:30:05.822 INFO:teuthology.orchestra.run.smithi149.stdout: osd deep scrub update digest min age = 30 2023-11-08T19:30:05.822 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:30:05.822 INFO:teuthology.orchestra.run.smithi149.stdout: osd map max advance = 10 2023-11-08T19:30:05.822 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:30:05.822 INFO:teuthology.orchestra.run.smithi149.stdout: journal zero on create = true 2023-11-08T19:30:05.823 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:30:05.823 INFO:teuthology.orchestra.run.smithi149.stdout: filestore ondisk finisher threads = 3 2023-11-08T19:30:05.823 INFO:teuthology.orchestra.run.smithi149.stdout: filestore apply finisher threads = 3 2023-11-08T19:30:05.823 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:30:05.823 INFO:teuthology.orchestra.run.smithi149.stdout: bdev debug aio = true 2023-11-08T19:30:05.824 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug misdirected ops = true 2023-11-08T19:30:05.824 INFO:teuthology.orchestra.run.smithi149.stdout: bluestore block size = 96636764160 2023-11-08T19:30:05.824 INFO:teuthology.orchestra.run.smithi149.stdout: bluestore fsck on mount = True 2023-11-08T19:30:05.824 INFO:teuthology.orchestra.run.smithi149.stdout: debug bluefs = 20 2023-11-08T19:30:05.824 INFO:teuthology.orchestra.run.smithi149.stdout: debug bluestore = 20 2023-11-08T19:30:05.825 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2023-11-08T19:30:05.825 INFO:teuthology.orchestra.run.smithi149.stdout: debug osd = 20 2023-11-08T19:30:05.825 INFO:teuthology.orchestra.run.smithi149.stdout: debug rocksdb = 10 2023-11-08T19:30:05.825 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd backfillfull_ratio = 0.85 2023-11-08T19:30:05.825 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd full ratio = 0.9 2023-11-08T19:30:05.826 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd nearfull ratio = 0.8 2023-11-08T19:30:05.826 INFO:teuthology.orchestra.run.smithi149.stdout: osd failsafe full ratio = 0.95 2023-11-08T19:30:05.826 INFO:teuthology.orchestra.run.smithi149.stdout: osd objectstore = bluestore 2023-11-08T19:30:05.826 INFO:teuthology.orchestra.run.smithi149.stdout: osd op complaint time = 180 2023-11-08T19:30:05.826 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:30:05.827 INFO:teuthology.orchestra.run.smithi149.stdout:[mgr] 2023-11-08T19:30:05.827 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2023-11-08T19:30:05.827 INFO:teuthology.orchestra.run.smithi149.stdout: debug mgr = 20 2023-11-08T19:30:05.827 INFO:teuthology.orchestra.run.smithi149.stdout: debug mon = 20 2023-11-08T19:30:05.827 INFO:teuthology.orchestra.run.smithi149.stdout: debug auth = 20 2023-11-08T19:30:05.828 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min pgs per osd = 4 2023-11-08T19:30:05.828 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min bytes per osd = 10 2023-11-08T19:30:05.828 INFO:teuthology.orchestra.run.smithi149.stdout: mgr/telemetry/nag = false 2023-11-08T19:30:05.828 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:30:05.828 INFO:teuthology.orchestra.run.smithi149.stdout:[mon] 2023-11-08T19:30:05.828 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2023-11-08T19:30:05.829 INFO:teuthology.orchestra.run.smithi149.stdout: debug mon = 20 2023-11-08T19:30:05.829 INFO:teuthology.orchestra.run.smithi149.stdout: debug paxos = 20 2023-11-08T19:30:05.829 INFO:teuthology.orchestra.run.smithi149.stdout: debug auth = 20 2023-11-08T19:30:05.829 INFO:teuthology.orchestra.run.smithi149.stdout: mon data avail warn = 5 2023-11-08T19:30:05.829 INFO:teuthology.orchestra.run.smithi149.stdout: mon mgr mkfs grace = 240 2023-11-08T19:30:05.830 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min pgs per osd = 4 2023-11-08T19:30:05.830 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd reporter subtree level = osd 2023-11-08T19:30:05.830 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd prime pg temp = true 2023-11-08T19:30:05.830 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min bytes per osd = 10 2023-11-08T19:30:05.830 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:30:05.831 INFO:teuthology.orchestra.run.smithi149.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-08T19:30:05.831 INFO:teuthology.orchestra.run.smithi149.stdout: auth mon ticket ttl = 660 # 11m 2023-11-08T19:30:05.831 INFO:teuthology.orchestra.run.smithi149.stdout: auth service ticket ttl = 240 # 4m 2023-11-08T19:30:05.831 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:30:05.831 INFO:teuthology.orchestra.run.smithi149.stdout: # don't complain about insecure global_id in the test suite 2023-11-08T19:30:05.832 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-08T19:30:05.832 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-08T19:30:05.832 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:30:05.832 INFO:teuthology.orchestra.run.smithi149.stdout: # 1m isn't quite enough 2023-11-08T19:30:05.832 INFO:teuthology.orchestra.run.smithi149.stdout: mon_down_mkfs_grace = 2m 2023-11-08T19:30:05.832 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:30:05.833 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_filestore_osds = false 2023-11-08T19:30:05.833 INFO:teuthology.orchestra.run.smithi149.stdout: mon op complaint time = 120 2023-11-08T19:30:05.833 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:30:05.833 INFO:teuthology.orchestra.run.smithi149.stdout:[client] 2023-11-08T19:30:05.833 INFO:teuthology.orchestra.run.smithi149.stdout: rgw cache enabled = true 2023-11-08T19:30:05.834 INFO:teuthology.orchestra.run.smithi149.stdout: rgw enable ops log = true 2023-11-08T19:30:05.834 INFO:teuthology.orchestra.run.smithi149.stdout: rgw enable usage log = true 2023-11-08T19:30:05.834 INFO:teuthology.orchestra.run.smithi149.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-08T19:30:05.834 INFO:teuthology.orchestra.run.smithi149.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-08T19:30:05.834 INFO:teuthology.orchestra.run.smithi149.stdout: client mount timeout = 600 2023-11-08T19:30:05.835 INFO:teuthology.orchestra.run.smithi149.stdout: debug client = 20 2023-11-08T19:30:05.835 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2023-11-08T19:30:05.835 INFO:teuthology.orchestra.run.smithi149.stdout: pid file = "" 2023-11-08T19:30:05.835 INFO:teuthology.orchestra.run.smithi149.stdout: rados mon op timeout = 900 2023-11-08T19:30:05.835 INFO:teuthology.orchestra.run.smithi149.stdout: rados osd op timeout = 900 2023-11-08T19:30:05.836 INFO:teuthology.orchestra.run.smithi149.stdout:[mon.a] 2023-11-08T19:30:05.836 INFO:teuthology.orchestra.run.smithi149.stdout:[mon.b] 2023-11-08T19:30:05.836 INFO:teuthology.orchestra.run.smithi149.stdout:[mon.c] 2023-11-08T19:30:05.836 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.a] 2023-11-08T19:30:05.836 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.c] 2023-11-08T19:30:05.837 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.b] 2023-11-08T19:30:05.837 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.d] 2023-11-08T19:30:05.837 INFO:teuthology.orchestra.run.smithi149.stdout:[mds] 2023-11-08T19:30:05.837 INFO:teuthology.orchestra.run.smithi149.stdout: debug mds = 20 2023-11-08T19:30:05.837 INFO:teuthology.orchestra.run.smithi149.stdout: debug mds balancer = 20 2023-11-08T19:30:05.838 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2023-11-08T19:30:05.838 INFO:teuthology.orchestra.run.smithi149.stdout: mds debug frag = True 2023-11-08T19:30:05.838 INFO:teuthology.orchestra.run.smithi149.stdout: mds debug scatterstat = True 2023-11-08T19:30:05.838 INFO:teuthology.orchestra.run.smithi149.stdout: mds op complaint time = 180 2023-11-08T19:30:05.838 INFO:teuthology.orchestra.run.smithi149.stdout: mds verify scatter = True 2023-11-08T19:30:05.839 INFO:teuthology.orchestra.run.smithi149.stdout: osd op complaint time = 180 2023-11-08T19:30:05.839 INFO:teuthology.orchestra.run.smithi149.stdout: rados mon op timeout = 900 2023-11-08T19:30:05.839 INFO:teuthology.orchestra.run.smithi149.stdout: rados osd op timeout = 900 2023-11-08T19:30:05.841 INFO:teuthology.orchestra.run.smithi160.stdout:[global] 2023-11-08T19:30:05.841 INFO:teuthology.orchestra.run.smithi160.stdout: chdir = "" 2023-11-08T19:30:05.841 INFO:teuthology.orchestra.run.smithi160.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-08T19:30:05.841 INFO:teuthology.orchestra.run.smithi160.stdout: auth supported = cephx 2023-11-08T19:30:05.841 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:30:05.842 INFO:teuthology.orchestra.run.smithi160.stdout: filestore xattr use omap = true 2023-11-08T19:30:05.842 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:30:05.842 INFO:teuthology.orchestra.run.smithi160.stdout: mon clock drift allowed = 1.000 2023-11-08T19:30:05.842 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:30:05.842 INFO:teuthology.orchestra.run.smithi160.stdout: osd crush chooseleaf type = 0 2023-11-08T19:30:05.843 INFO:teuthology.orchestra.run.smithi160.stdout: auth debug = true 2023-11-08T19:30:05.843 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:30:05.843 INFO:teuthology.orchestra.run.smithi160.stdout: ms die on old message = true 2023-11-08T19:30:05.843 INFO:teuthology.orchestra.run.smithi160.stdout: ms die on bug = true 2023-11-08T19:30:05.843 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:30:05.844 INFO:teuthology.orchestra.run.smithi160.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-08T19:30:05.844 INFO:teuthology.orchestra.run.smithi160.stdout: mon pg warn max object skew = 0 2023-11-08T19:30:05.844 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:30:05.844 INFO:teuthology.orchestra.run.smithi160.stdout: # disable pg_autoscaler by default for new pools 2023-11-08T19:30:05.844 INFO:teuthology.orchestra.run.smithi160.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-08T19:30:05.844 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:30:05.845 INFO:teuthology.orchestra.run.smithi160.stdout: osd pool default size = 2 2023-11-08T19:30:05.845 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:30:05.845 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd allow primary affinity = true 2023-11-08T19:30:05.845 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd allow pg remap = true 2023-11-08T19:30:05.845 INFO:teuthology.orchestra.run.smithi160.stdout: mon warn on legacy crush tunables = false 2023-11-08T19:30:05.846 INFO:teuthology.orchestra.run.smithi160.stdout: mon warn on crush straw calc version zero = false 2023-11-08T19:30:05.846 INFO:teuthology.orchestra.run.smithi160.stdout: mon warn on no sortbitwise = false 2023-11-08T19:30:05.846 INFO:teuthology.orchestra.run.smithi160.stdout: mon warn on osd down out interval zero = false 2023-11-08T19:30:05.846 INFO:teuthology.orchestra.run.smithi160.stdout: mon warn on too few osds = false 2023-11-08T19:30:05.846 INFO:teuthology.orchestra.run.smithi160.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-08T19:30:05.847 INFO:teuthology.orchestra.run.smithi160.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-08T19:30:05.847 INFO:teuthology.orchestra.run.smithi160.stdout: mon_allow_pool_size_one = true 2023-11-08T19:30:05.847 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:30:05.847 INFO:teuthology.orchestra.run.smithi160.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-08T19:30:05.847 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:30:05.848 INFO:teuthology.orchestra.run.smithi160.stdout: osd default data pool replay window = 5 2023-11-08T19:30:05.848 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:30:05.848 INFO:teuthology.orchestra.run.smithi160.stdout: mon allow pool delete = true 2023-11-08T19:30:05.848 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:30:05.848 INFO:teuthology.orchestra.run.smithi160.stdout: mon cluster log file level = debug 2023-11-08T19:30:05.849 INFO:teuthology.orchestra.run.smithi160.stdout: debug asserts on shutdown = true 2023-11-08T19:30:05.849 INFO:teuthology.orchestra.run.smithi160.stdout: mon health detail to clog = false 2023-11-08T19:30:05.849 INFO:teuthology.orchestra.run.smithi160.stdout: mon host = "172.21.15.149,172.21.15.160,[v2:172.21.15.160:3301,v1:172.21.15.160:6790]" 2023-11-08T19:30:05.849 INFO:teuthology.orchestra.run.smithi160.stdout: ms die on skipped message = False 2023-11-08T19:30:05.849 INFO:teuthology.orchestra.run.smithi160.stdout: fsid = 0aba7c70-fe80-4446-a2f5-7502ac3adfb4 2023-11-08T19:30:05.850 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:30:05.850 INFO:teuthology.orchestra.run.smithi160.stdout:[osd] 2023-11-08T19:30:05.850 INFO:teuthology.orchestra.run.smithi160.stdout: osd journal size = 100 2023-11-08T19:30:05.850 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:30:05.850 INFO:teuthology.orchestra.run.smithi160.stdout: osd scrub load threshold = 5.0 2023-11-08T19:30:05.851 INFO:teuthology.orchestra.run.smithi160.stdout: osd scrub max interval = 600 2023-11-08T19:30:05.851 INFO:teuthology.orchestra.run.smithi160.stdout: osd mclock profile = high_recovery_ops 2023-11-08T19:30:05.851 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:30:05.851 INFO:teuthology.orchestra.run.smithi160.stdout: osd recover clone overlap = true 2023-11-08T19:30:05.851 INFO:teuthology.orchestra.run.smithi160.stdout: osd recovery max chunk = 1048576 2023-11-08T19:30:05.852 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:30:05.852 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug shutdown = true 2023-11-08T19:30:05.852 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug op order = true 2023-11-08T19:30:05.852 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug verify stray on activate = true 2023-11-08T19:30:05.852 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug trim objects = true 2023-11-08T19:30:05.852 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:30:05.853 INFO:teuthology.orchestra.run.smithi160.stdout: osd open classes on start = true 2023-11-08T19:30:05.853 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug pg log writeout = true 2023-11-08T19:30:05.853 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:30:05.853 INFO:teuthology.orchestra.run.smithi160.stdout: osd deep scrub update digest min age = 30 2023-11-08T19:30:05.853 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:30:05.854 INFO:teuthology.orchestra.run.smithi160.stdout: osd map max advance = 10 2023-11-08T19:30:05.854 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:30:05.854 INFO:teuthology.orchestra.run.smithi160.stdout: journal zero on create = true 2023-11-08T19:30:05.854 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:30:05.854 INFO:teuthology.orchestra.run.smithi160.stdout: filestore ondisk finisher threads = 3 2023-11-08T19:30:05.855 INFO:teuthology.orchestra.run.smithi160.stdout: filestore apply finisher threads = 3 2023-11-08T19:30:05.855 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:30:05.855 INFO:teuthology.orchestra.run.smithi160.stdout: bdev debug aio = true 2023-11-08T19:30:05.855 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug misdirected ops = true 2023-11-08T19:30:05.855 INFO:teuthology.orchestra.run.smithi160.stdout: bluestore block size = 96636764160 2023-11-08T19:30:05.856 INFO:teuthology.orchestra.run.smithi160.stdout: bluestore fsck on mount = True 2023-11-08T19:30:05.856 INFO:teuthology.orchestra.run.smithi160.stdout: debug bluefs = 20 2023-11-08T19:30:05.856 INFO:teuthology.orchestra.run.smithi160.stdout: debug bluestore = 20 2023-11-08T19:30:05.856 INFO:teuthology.orchestra.run.smithi160.stdout: debug ms = 1 2023-11-08T19:30:05.856 INFO:teuthology.orchestra.run.smithi160.stdout: debug osd = 20 2023-11-08T19:30:05.857 INFO:teuthology.orchestra.run.smithi160.stdout: debug rocksdb = 10 2023-11-08T19:30:05.857 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd backfillfull_ratio = 0.85 2023-11-08T19:30:05.857 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd full ratio = 0.9 2023-11-08T19:30:05.857 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd nearfull ratio = 0.8 2023-11-08T19:30:05.857 INFO:teuthology.orchestra.run.smithi160.stdout: osd failsafe full ratio = 0.95 2023-11-08T19:30:05.858 INFO:teuthology.orchestra.run.smithi160.stdout: osd objectstore = bluestore 2023-11-08T19:30:05.858 INFO:teuthology.orchestra.run.smithi160.stdout: osd op complaint time = 180 2023-11-08T19:30:05.858 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:30:05.858 INFO:teuthology.orchestra.run.smithi160.stdout:[mgr] 2023-11-08T19:30:05.858 INFO:teuthology.orchestra.run.smithi160.stdout: debug ms = 1 2023-11-08T19:30:05.859 INFO:teuthology.orchestra.run.smithi160.stdout: debug mgr = 20 2023-11-08T19:30:05.859 INFO:teuthology.orchestra.run.smithi160.stdout: debug mon = 20 2023-11-08T19:30:05.859 INFO:teuthology.orchestra.run.smithi160.stdout: debug auth = 20 2023-11-08T19:30:05.859 INFO:teuthology.orchestra.run.smithi160.stdout: mon reweight min pgs per osd = 4 2023-11-08T19:30:05.859 INFO:teuthology.orchestra.run.smithi160.stdout: mon reweight min bytes per osd = 10 2023-11-08T19:30:05.860 INFO:teuthology.orchestra.run.smithi160.stdout: mgr/telemetry/nag = false 2023-11-08T19:30:05.860 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:30:05.860 INFO:teuthology.orchestra.run.smithi160.stdout:[mon] 2023-11-08T19:30:05.860 INFO:teuthology.orchestra.run.smithi160.stdout: debug ms = 1 2023-11-08T19:30:05.860 INFO:teuthology.orchestra.run.smithi160.stdout: debug mon = 20 2023-11-08T19:30:05.860 INFO:teuthology.orchestra.run.smithi160.stdout: debug paxos = 20 2023-11-08T19:30:05.861 INFO:teuthology.orchestra.run.smithi160.stdout: debug auth = 20 2023-11-08T19:30:05.861 INFO:teuthology.orchestra.run.smithi160.stdout: mon data avail warn = 5 2023-11-08T19:30:05.861 INFO:teuthology.orchestra.run.smithi160.stdout: mon mgr mkfs grace = 240 2023-11-08T19:30:05.861 INFO:teuthology.orchestra.run.smithi160.stdout: mon reweight min pgs per osd = 4 2023-11-08T19:30:05.861 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd reporter subtree level = osd 2023-11-08T19:30:05.862 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd prime pg temp = true 2023-11-08T19:30:05.862 INFO:teuthology.orchestra.run.smithi160.stdout: mon reweight min bytes per osd = 10 2023-11-08T19:30:05.862 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:30:05.862 INFO:teuthology.orchestra.run.smithi160.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-08T19:30:05.862 INFO:teuthology.orchestra.run.smithi160.stdout: auth mon ticket ttl = 660 # 11m 2023-11-08T19:30:05.863 INFO:teuthology.orchestra.run.smithi160.stdout: auth service ticket ttl = 240 # 4m 2023-11-08T19:30:05.863 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:30:05.863 INFO:teuthology.orchestra.run.smithi160.stdout: # don't complain about insecure global_id in the test suite 2023-11-08T19:30:05.863 INFO:teuthology.orchestra.run.smithi160.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-08T19:30:05.863 INFO:teuthology.orchestra.run.smithi160.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-08T19:30:05.863 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:30:05.864 INFO:teuthology.orchestra.run.smithi160.stdout: # 1m isn't quite enough 2023-11-08T19:30:05.864 INFO:teuthology.orchestra.run.smithi160.stdout: mon_down_mkfs_grace = 2m 2023-11-08T19:30:05.864 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:30:05.864 INFO:teuthology.orchestra.run.smithi160.stdout: mon_warn_on_filestore_osds = false 2023-11-08T19:30:05.864 INFO:teuthology.orchestra.run.smithi160.stdout: mon op complaint time = 120 2023-11-08T19:30:05.865 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-08T19:30:05.865 INFO:teuthology.orchestra.run.smithi160.stdout:[client] 2023-11-08T19:30:05.865 INFO:teuthology.orchestra.run.smithi160.stdout: rgw cache enabled = true 2023-11-08T19:30:05.865 INFO:teuthology.orchestra.run.smithi160.stdout: rgw enable ops log = true 2023-11-08T19:30:05.865 INFO:teuthology.orchestra.run.smithi160.stdout: rgw enable usage log = true 2023-11-08T19:30:05.866 INFO:teuthology.orchestra.run.smithi160.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-08T19:30:05.866 INFO:teuthology.orchestra.run.smithi160.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-08T19:30:05.866 INFO:teuthology.orchestra.run.smithi160.stdout: client mount timeout = 600 2023-11-08T19:30:05.866 INFO:teuthology.orchestra.run.smithi160.stdout: debug client = 20 2023-11-08T19:30:05.866 INFO:teuthology.orchestra.run.smithi160.stdout: debug ms = 1 2023-11-08T19:30:05.867 INFO:teuthology.orchestra.run.smithi160.stdout: pid file = "" 2023-11-08T19:30:05.867 INFO:teuthology.orchestra.run.smithi160.stdout: rados mon op timeout = 900 2023-11-08T19:30:05.867 INFO:teuthology.orchestra.run.smithi160.stdout: rados osd op timeout = 900 2023-11-08T19:30:05.867 INFO:teuthology.orchestra.run.smithi160.stdout:[mon.a] 2023-11-08T19:30:05.867 INFO:teuthology.orchestra.run.smithi160.stdout:[mon.b] 2023-11-08T19:30:05.868 INFO:teuthology.orchestra.run.smithi160.stdout:[mon.c] 2023-11-08T19:30:05.868 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.a] 2023-11-08T19:30:05.868 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.c] 2023-11-08T19:30:05.868 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.b] 2023-11-08T19:30:05.868 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.d] 2023-11-08T19:30:05.869 INFO:teuthology.orchestra.run.smithi160.stdout:[mds] 2023-11-08T19:30:05.869 INFO:teuthology.orchestra.run.smithi160.stdout: debug mds = 20 2023-11-08T19:30:05.869 INFO:teuthology.orchestra.run.smithi160.stdout: debug mds balancer = 20 2023-11-08T19:30:05.869 INFO:teuthology.orchestra.run.smithi160.stdout: debug ms = 1 2023-11-08T19:30:05.869 INFO:teuthology.orchestra.run.smithi160.stdout: mds debug frag = True 2023-11-08T19:30:05.869 INFO:teuthology.orchestra.run.smithi160.stdout: mds debug scatterstat = True 2023-11-08T19:30:05.870 INFO:teuthology.orchestra.run.smithi160.stdout: mds op complaint time = 180 2023-11-08T19:30:05.870 INFO:teuthology.orchestra.run.smithi160.stdout: mds verify scatter = True 2023-11-08T19:30:05.870 INFO:teuthology.orchestra.run.smithi160.stdout: osd op complaint time = 180 2023-11-08T19:30:05.870 INFO:teuthology.orchestra.run.smithi160.stdout: rados mon op timeout = 900 2023-11-08T19:30:05.870 INFO:teuthology.orchestra.run.smithi160.stdout: rados osd op timeout = 900 2023-11-08T19:30:05.871 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-08T19:30:06.004 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.003+0000 7ff8aea73700 1 Processor -- start 2023-11-08T19:30:06.004 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.003+0000 7ff8aea73700 1 -- start start 2023-11-08T19:30:06.008 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.003+0000 7ff8aea73700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7ff8a80cc0d0 0x7ff8a815f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:06.008 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.004+0000 7ff8aea73700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8a80cc910 0x7ff8a80cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:06.008 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.004+0000 7ff8aea73700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8a815be80 con 0x7ff8a80cc4b0 2023-11-08T19:30:06.008 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.004+0000 7ff8aea73700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8a815f9b0 con 0x7ff8a80cc0d0 2023-11-08T19:30:06.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.004+0000 7ff8aea73700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a815fba0 con 0x7ff8a80cc910 2023-11-08T19:30:06.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.004+0000 7ff8a7fff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7ff8a80cc4b0 0x7ff8a815c620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:47836/0 (socket says 172.21.15.149:47836) 2023-11-08T19:30:06.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.004+0000 7ff8a7fff700 1 -- 172.21.15.149:0/2540472841 learned_addr learned my addr 172.21.15.149:0/2540472841 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:30:06.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.004+0000 7ff8ad010700 1 --2- 172.21.15.149:0/2540472841 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8a80cc910 0x7ff8a80cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:06.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.004+0000 7ff8a77fe700 1 -- 172.21.15.149:0/2540472841 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3431463076 0 0) 0x7ff8a815be80 con 0x7ff8a80cc4b0 2023-11-08T19:30:06.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.004+0000 7ff8a77fe700 1 -- 172.21.15.149:0/2540472841 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8980035b0 con 0x7ff8a80cc4b0 2023-11-08T19:30:06.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.004+0000 7ff8ac80f700 1 --2- 172.21.15.149:0/2540472841 >> v2:172.21.15.160:3300/0 conn(0x7ff8a80cc0d0 0x7ff8a815f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:06.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.004+0000 7ff8a77fe700 1 -- 172.21.15.149:0/2540472841 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3328968813 0 0) 0x7ff8980035b0 con 0x7ff8a80cc4b0 2023-11-08T19:30:06.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.004+0000 7ff8a77fe700 1 -- 172.21.15.149:0/2540472841 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8a80cc910 msgr2=0x7ff8a80cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:30:06.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.004+0000 7ff8a77fe700 1 --2- 172.21.15.149:0/2540472841 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8a80cc910 0x7ff8a80cf320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:06.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.004+0000 7ff8a77fe700 1 -- 172.21.15.149:0/2540472841 >> v2:172.21.15.160:3300/0 conn(0x7ff8a80cc0d0 msgr2=0x7ff8a815f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:30:06.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.004+0000 7ff8a77fe700 1 --2- 172.21.15.149:0/2540472841 >> v2:172.21.15.160:3300/0 conn(0x7ff8a80cc0d0 0x7ff8a815f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:06.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.004+0000 7ff8a77fe700 1 -- 172.21.15.149:0/2540472841 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a815fe80 con 0x7ff8a80cc4b0 2023-11-08T19:30:06.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.004+0000 7ff8a77fe700 1 -- 172.21.15.149:0/2540472841 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7ff894001670 con 0x7ff8a80cc4b0 2023-11-08T19:30:06.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.004+0000 7ff8a77fe700 1 -- 172.21.15.149:0/2540472841 >> v1:172.21.15.149:6789/0 conn(0x7ff8a80cc4b0 legacy=0x7ff8a815c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:06.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.004+0000 7ff8a77fe700 1 --2- 172.21.15.149:0/2540472841 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff898003a70 0x7ff898003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:06.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.004+0000 7ff8a77fe700 1 --2- 172.21.15.149:0/2540472841 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff898004850 0x7ff898004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:06.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.004+0000 7ff8a77fe700 1 --2- 172.21.15.149:0/2540472841 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8a80cc910 0x7ff898005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:06.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.004+0000 7ff8a77fe700 1 -- 172.21.15.149:0/2540472841 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a815fba0 con 0x7ff898003a70 2023-11-08T19:30:06.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.004+0000 7ff8a77fe700 1 -- 172.21.15.149:0/2540472841 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff89800ba10 con 0x7ff898004850 2023-11-08T19:30:06.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.004+0000 7ff8a77fe700 1 -- 172.21.15.149:0/2540472841 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff89800bb50 con 0x7ff8a80cc910 2023-11-08T19:30:06.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.004+0000 7ff8ac80f700 1 --2- 172.21.15.149:0/2540472841 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff898003a70 0x7ff898003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:06.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.004+0000 7ff8ad010700 1 --2- 172.21.15.149:0/2540472841 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8a80cc910 0x7ff898005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:06.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.004+0000 7ff8a7fff700 1 --2- 172.21.15.149:0/2540472841 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff898004850 0x7ff898004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:06.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.005+0000 7ff8ac80f700 1 -- 172.21.15.149:0/2540472841 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8a80cc910 msgr2=0x7ff898005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:30:06.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.005+0000 7ff8ac80f700 1 --2- 172.21.15.149:0/2540472841 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8a80cc910 0x7ff898005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:06.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.005+0000 7ff8ac80f700 1 -- 172.21.15.149:0/2540472841 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff898004850 msgr2=0x7ff898004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:30:06.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.005+0000 7ff8ac80f700 1 --2- 172.21.15.149:0/2540472841 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff898004850 0x7ff898004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:06.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.005+0000 7ff8ac80f700 1 -- 172.21.15.149:0/2540472841 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8980035b0 con 0x7ff898003a70 2023-11-08T19:30:06.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.005+0000 7ff8ac80f700 1 --2- 172.21.15.149:0/2540472841 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff898003a70 0x7ff898003e90 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7ff89c009b90 tx=0x7ff898005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75eaab012b58f422 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:06.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.005+0000 7ff8a77fe700 1 -- 172.21.15.149:0/2540472841 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89c00e6c0 con 0x7ff898003a70 2023-11-08T19:30:06.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.005+0000 7ff8a77fe700 1 -- 172.21.15.149:0/2540472841 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff89c00e820 con 0x7ff898003a70 2023-11-08T19:30:06.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.005+0000 7ff8a77fe700 1 -- 172.21.15.149:0/2540472841 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89c00eb90 con 0x7ff898003a70 2023-11-08T19:30:06.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.005+0000 7ff8aea73700 1 -- 172.21.15.149:0/2540472841 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff898003a70 msgr2=0x7ff898003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:06.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.005+0000 7ff8aea73700 1 --2- 172.21.15.149:0/2540472841 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff898003a70 0x7ff898003e90 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7ff89c009b90 tx=0x7ff898005880 comp rx=0 tx=0).stop 2023-11-08T19:30:06.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.005+0000 7ff8ad010700 1 -- 172.21.15.149:0/2540472841 reap_dead start 2023-11-08T19:30:06.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.005+0000 7ff8aea73700 1 -- 172.21.15.149:0/2540472841 shutdown_connections 2023-11-08T19:30:06.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.005+0000 7ff8aea73700 1 -- 172.21.15.149:0/2540472841 >> 172.21.15.149:0/2540472841 conn(0x7ff8a806f120 msgr2=0x7ff8a806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:06.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.006+0000 7ff8aea73700 1 -- 172.21.15.149:0/2540472841 shutdown_connections 2023-11-08T19:30:06.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.006+0000 7ff8aea73700 1 -- 172.21.15.149:0/2540472841 wait complete. 2023-11-08T19:30:06.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.007+0000 7ff8aea73700 1 Processor -- start 2023-11-08T19:30:06.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.007+0000 7ff8aea73700 1 -- start start 2023-11-08T19:30:06.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.008+0000 7ff8aea73700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff898003a70 0x7ff8a8147570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:06.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.008+0000 7ff8aea73700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff8a8147ab0 0x7ff8a80c8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:06.020 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.008+0000 7ff8aea73700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8a80c8d60 0x7ff8a80b2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:06.020 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.008+0000 7ff8aea73700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a80c91f0 con 0x7ff898003a70 2023-11-08T19:30:06.020 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.008+0000 7ff8aea73700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a80b1c20 con 0x7ff8a8147ab0 2023-11-08T19:30:06.020 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.008+0000 7ff8aea73700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a80b27a0 con 0x7ff8a80c8d60 2023-11-08T19:30:06.020 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.008+0000 7ff8ac80f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff898003a70 0x7ff8a8147570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:06.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.008+0000 7ff8ac80f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff898003a70 0x7ff8a8147570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45844/0 (socket says 172.21.15.149:45844) 2023-11-08T19:30:06.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.008+0000 7ff8ac80f700 1 -- 172.21.15.149:0/4285267548 learned_addr learned my addr 172.21.15.149:0/4285267548 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:30:06.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.008+0000 7ff8ad010700 1 --2- 172.21.15.149:0/4285267548 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8a80c8d60 0x7ff8a80b2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:06.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.008+0000 7ff8a7fff700 1 --2- 172.21.15.149:0/4285267548 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff8a8147ab0 0x7ff8a80c8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:06.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.009+0000 7ff8ac80f700 1 -- 172.21.15.149:0/4285267548 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8a80c8d60 msgr2=0x7ff8a80b2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:06.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.009+0000 7ff8ac80f700 1 --2- 172.21.15.149:0/4285267548 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8a80c8d60 0x7ff8a80b2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:06.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.009+0000 7ff8ac80f700 1 -- 172.21.15.149:0/4285267548 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff8a8147ab0 msgr2=0x7ff8a80c8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:06.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.009+0000 7ff8ac80f700 1 --2- 172.21.15.149:0/4285267548 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff8a8147ab0 0x7ff8a80c8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:06.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.009+0000 7ff8ac80f700 1 -- 172.21.15.149:0/4285267548 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a80c8110 con 0x7ff898003a70 2023-11-08T19:30:06.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.009+0000 7ff8ac80f700 1 --2- 172.21.15.149:0/4285267548 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff898003a70 0x7ff8a8147570 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7ff898004740 tx=0x7ff89c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:06.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.009+0000 7ff8a57fa700 1 -- 172.21.15.149:0/4285267548 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89c00e6c0 con 0x7ff898003a70 2023-11-08T19:30:06.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.009+0000 7ff8a57fa700 1 -- 172.21.15.149:0/4285267548 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff89c0038a0 con 0x7ff898003a70 2023-11-08T19:30:06.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.009+0000 7ff8aea73700 1 -- 172.21.15.149:0/4285267548 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8a80b1e70 con 0x7ff898003a70 2023-11-08T19:30:06.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.009+0000 7ff8a57fa700 1 -- 172.21.15.149:0/4285267548 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89c003c50 con 0x7ff898003a70 2023-11-08T19:30:06.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.009+0000 7ff8aea73700 1 -- 172.21.15.149:0/4285267548 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8a80b2430 con 0x7ff898003a70 2023-11-08T19:30:06.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.010+0000 7ff8aea73700 1 -- 172.21.15.149:0/4285267548 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8a80c9170 con 0x7ff898003a70 2023-11-08T19:30:06.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.010+0000 7ff8a57fa700 1 -- 172.21.15.149:0/4285267548 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff89c013470 con 0x7ff898003a70 2023-11-08T19:30:06.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.011+0000 7ff8a57fa700 1 --2- 172.21.15.149:0/4285267548 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff88c06af00 0x7ff88c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:06.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.011+0000 7ff8a57fa700 1 -- 172.21.15.149:0/4285267548 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6999+0+0 (secure 0 0 0) 0x7ff89c08b0c0 con 0x7ff898003a70 2023-11-08T19:30:06.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.011+0000 7ff8a7fff700 1 --2- 172.21.15.149:0/4285267548 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff88c06af00 0x7ff88c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:06.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.011+0000 7ff8a7fff700 1 --2- 172.21.15.149:0/4285267548 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff88c06af00 0x7ff88c06d3c0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7ff8a8147eb0 tx=0x7ff894007980 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:06.025 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.016+0000 7ff8a57fa700 1 -- 172.21.15.149:0/4285267548 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff89c055e10 con 0x7ff898003a70 2023-11-08T19:30:06.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.208+0000 7ff8aea73700 1 -- 172.21.15.149:0/4285267548 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7ff8a804f730 con 0x7ff898003a70 2023-11-08T19:30:06.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.213+0000 7ff8a57fa700 1 -- 172.21.15.149:0/4285267548 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v20) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff89c059430 con 0x7ff898003a70 2023-11-08T19:30:06.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.215+0000 7ff8aea73700 1 -- 172.21.15.149:0/4285267548 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff88c06af00 msgr2=0x7ff88c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:06.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.215+0000 7ff8aea73700 1 --2- 172.21.15.149:0/4285267548 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff88c06af00 0x7ff88c06d3c0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7ff8a8147eb0 tx=0x7ff894007980 comp rx=0 tx=0).stop 2023-11-08T19:30:06.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.215+0000 7ff8aea73700 1 -- 172.21.15.149:0/4285267548 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff898003a70 msgr2=0x7ff8a8147570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:06.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.215+0000 7ff8aea73700 1 --2- 172.21.15.149:0/4285267548 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff898003a70 0x7ff8a8147570 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7ff898004740 tx=0x7ff89c0047c0 comp rx=0 tx=0).stop 2023-11-08T19:30:06.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.215+0000 7ff8aea73700 1 -- 172.21.15.149:0/4285267548 shutdown_connections 2023-11-08T19:30:06.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.215+0000 7ff8aea73700 1 --2- 172.21.15.149:0/4285267548 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff88c06af00 0x7ff88c06d3c0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:06.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.215+0000 7ff8aea73700 1 --2- 172.21.15.149:0/4285267548 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8a80c8d60 0x7ff8a80b2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:06.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.215+0000 7ff8aea73700 1 --2- 172.21.15.149:0/4285267548 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff898003a70 0x7ff8a8147570 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:06.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.215+0000 7ff8aea73700 1 --2- 172.21.15.149:0/4285267548 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff8a8147ab0 0x7ff8a80c8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:06.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.215+0000 7ff8aea73700 1 -- 172.21.15.149:0/4285267548 >> 172.21.15.149:0/4285267548 conn(0x7ff8a806f120 msgr2=0x7ff8a80d00a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:06.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.215+0000 7ff8aea73700 1 -- 172.21.15.149:0/4285267548 shutdown_connections 2023-11-08T19:30:06.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.215+0000 7ff8aea73700 1 -- 172.21.15.149:0/4285267548 wait complete. 2023-11-08T19:30:06.229 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snapshots.TestSnapshots.test_kill_mdstable' 2023-11-08T19:30:06.350 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.349+0000 7f811728f700 1 Processor -- start 2023-11-08T19:30:06.350 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.349+0000 7f811728f700 1 -- start start 2023-11-08T19:30:06.354 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.350+0000 7f811728f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f81100cc140 0x7f81100cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:06.354 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.350+0000 7f811728f700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81100cce50 con 0x7f81100b2cd0 2023-11-08T19:30:06.354 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.350+0000 7f811728f700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81100cc520 con 0x7f81100b2850 2023-11-08T19:30:06.355 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.350+0000 7f811728f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81100b2430 con 0x7f81100cc140 2023-11-08T19:30:06.355 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.350+0000 7f811582c700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f81100b2cd0 0x7f811015d2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:47858/0 (socket says 172.21.15.149:47858) 2023-11-08T19:30:06.355 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.350+0000 7f811582c700 1 -- 172.21.15.149:0/1466769450 learned_addr learned my addr 172.21.15.149:0/1466769450 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:30:06.355 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.350+0000 7f811502b700 1 --2- 172.21.15.149:0/1466769450 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f81100cc140 0x7f81100cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:06.355 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.350+0000 7f8107fff700 1 -- 172.21.15.149:0/1466769450 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 529826886 0 0) 0x7f81100cce50 con 0x7f81100b2cd0 2023-11-08T19:30:06.356 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.350+0000 7f8107fff700 1 -- 172.21.15.149:0/1466769450 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80fc0035b0 con 0x7f81100b2cd0 2023-11-08T19:30:06.356 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.350+0000 7f8107fff700 1 -- 172.21.15.149:0/1466769450 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1526446136 0 0) 0x7f80fc0035b0 con 0x7f81100b2cd0 2023-11-08T19:30:06.356 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.350+0000 7f8107fff700 1 -- 172.21.15.149:0/1466769450 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f81100cc140 msgr2=0x7f81100cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:30:06.356 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.350+0000 7f8107fff700 1 --2- 172.21.15.149:0/1466769450 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f81100cc140 0x7f81100cc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:06.356 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.350+0000 7f8107fff700 1 -- 172.21.15.149:0/1466769450 >> v1:172.21.15.160:6789/0 conn(0x7f81100b2850 legacy=0x7f81100cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:06.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.350+0000 7f8107fff700 1 -- 172.21.15.149:0/1466769450 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81100b17b0 con 0x7f81100b2cd0 2023-11-08T19:30:06.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.350+0000 7f8107fff700 1 -- 172.21.15.149:0/1466769450 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f81080019f0 con 0x7f81100b2cd0 2023-11-08T19:30:06.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.350+0000 7f8107fff700 1 -- 172.21.15.149:0/1466769450 >> v1:172.21.15.149:6789/0 conn(0x7f81100b2cd0 legacy=0x7f811015d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:06.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.350+0000 7f8107fff700 1 --2- 172.21.15.149:0/1466769450 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80fc003a30 0x7f80fc003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:06.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.350+0000 7f8107fff700 1 --2- 172.21.15.149:0/1466769450 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f80fc004850 0x7f80fc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:06.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.350+0000 7f8107fff700 1 --2- 172.21.15.149:0/1466769450 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f81100cc140 0x7f80fc005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:06.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.350+0000 7f8107fff700 1 -- 172.21.15.149:0/1466769450 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81100b2430 con 0x7f80fc003a30 2023-11-08T19:30:06.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.350+0000 7f8107fff700 1 -- 172.21.15.149:0/1466769450 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80fc00bac0 con 0x7f80fc004850 2023-11-08T19:30:06.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.350+0000 7f8107fff700 1 -- 172.21.15.149:0/1466769450 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80fc00bc80 con 0x7f81100cc140 2023-11-08T19:30:06.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.350+0000 7f811502b700 1 --2- 172.21.15.149:0/1466769450 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80fc003a30 0x7f80fc003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:06.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.351+0000 7f811582c700 1 --2- 172.21.15.149:0/1466769450 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f81100cc140 0x7f80fc005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:06.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.351+0000 7f811482a700 1 --2- 172.21.15.149:0/1466769450 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f80fc004850 0x7f80fc004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:06.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.351+0000 7f811502b700 1 -- 172.21.15.149:0/1466769450 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f81100cc140 msgr2=0x7f80fc005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:30:06.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.351+0000 7f811502b700 1 --2- 172.21.15.149:0/1466769450 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f81100cc140 0x7f80fc005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:06.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.351+0000 7f811502b700 1 -- 172.21.15.149:0/1466769450 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f80fc004850 msgr2=0x7f80fc004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:30:06.360 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.351+0000 7f811502b700 1 --2- 172.21.15.149:0/1466769450 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f80fc004850 0x7f80fc004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:06.360 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.351+0000 7f811502b700 1 -- 172.21.15.149:0/1466769450 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80fc0035b0 con 0x7f80fc003a30 2023-11-08T19:30:06.360 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.351+0000 7f811482a700 1 --2- 172.21.15.149:0/1466769450 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f80fc004850 0x7f80fc004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:30:06.360 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.351+0000 7f811502b700 1 --2- 172.21.15.149:0/1466769450 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80fc003a30 0x7f80fc003e50 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f810c009b10 tx=0x7f80fc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd8c7834cc2141a7 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:06.361 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.351+0000 7f8107fff700 1 -- 172.21.15.149:0/1466769450 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810c005a20 con 0x7f80fc003a30 2023-11-08T19:30:06.361 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.351+0000 7f8107fff700 1 -- 172.21.15.149:0/1466769450 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f810c005b80 con 0x7f80fc003a30 2023-11-08T19:30:06.361 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.351+0000 7f8107fff700 1 -- 172.21.15.149:0/1466769450 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810c00e6c0 con 0x7f80fc003a30 2023-11-08T19:30:06.361 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.351+0000 7f811728f700 1 -- 172.21.15.149:0/1466769450 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80fc003a30 msgr2=0x7f80fc003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:06.361 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.351+0000 7f811728f700 1 --2- 172.21.15.149:0/1466769450 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80fc003a30 0x7f80fc003e50 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f810c009b10 tx=0x7f80fc005880 comp rx=0 tx=0).stop 2023-11-08T19:30:06.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.351+0000 7f811582c700 1 -- 172.21.15.149:0/1466769450 reap_dead start 2023-11-08T19:30:06.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.352+0000 7f811728f700 1 -- 172.21.15.149:0/1466769450 shutdown_connections 2023-11-08T19:30:06.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.352+0000 7f811728f700 1 -- 172.21.15.149:0/1466769450 >> 172.21.15.149:0/1466769450 conn(0x7f8110099a40 msgr2=0x7f81100d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:06.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.352+0000 7f811728f700 1 -- 172.21.15.149:0/1466769450 shutdown_connections 2023-11-08T19:30:06.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.352+0000 7f811728f700 1 -- 172.21.15.149:0/1466769450 wait complete. 2023-11-08T19:30:06.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.353+0000 7f811728f700 1 Processor -- start 2023-11-08T19:30:06.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.353+0000 7f811728f700 1 -- start start 2023-11-08T19:30:06.366 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.353+0000 7f811728f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f80fc003a30 0x7f81100b54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:06.366 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.353+0000 7f811728f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8110156790 0x7f8110156c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:06.366 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.354+0000 7f811728f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f811009ba70 0x7f811009bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:06.369 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.354+0000 7f811728f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811009df30 con 0x7f811009ba70 2023-11-08T19:30:06.370 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.354+0000 7f811728f700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811009c460 con 0x7f80fc003a30 2023-11-08T19:30:06.370 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.354+0000 7f811728f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8110157150 con 0x7f8110156790 2023-11-08T19:30:06.370 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.354+0000 7f811582c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f811009ba70 0x7f811009bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:06.370 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.354+0000 7f811582c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f811009ba70 0x7f811009bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45868/0 (socket says 172.21.15.149:45868) 2023-11-08T19:30:06.371 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.354+0000 7f811582c700 1 -- 172.21.15.149:0/637863765 learned_addr learned my addr 172.21.15.149:0/637863765 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:30:06.371 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.354+0000 7f811502b700 1 --2- 172.21.15.149:0/637863765 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f80fc003a30 0x7f81100b54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:06.371 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.354+0000 7f811482a700 1 --2- 172.21.15.149:0/637863765 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8110156790 0x7f8110156c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:06.371 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.354+0000 7f811582c700 1 -- 172.21.15.149:0/637863765 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8110156790 msgr2=0x7f8110156c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:06.371 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.354+0000 7f811582c700 1 --2- 172.21.15.149:0/637863765 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8110156790 0x7f8110156c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:06.372 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.354+0000 7f811582c700 1 -- 172.21.15.149:0/637863765 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f80fc003a30 msgr2=0x7f81100b54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:06.372 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.354+0000 7f811582c700 1 --2- 172.21.15.149:0/637863765 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f80fc003a30 0x7f81100b54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:06.372 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.354+0000 7f811582c700 1 -- 172.21.15.149:0/637863765 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f811009c680 con 0x7f811009ba70 2023-11-08T19:30:06.372 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.354+0000 7f811502b700 1 --2- 172.21.15.149:0/637863765 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f80fc003a30 0x7f81100b54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:30:06.372 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.354+0000 7f811582c700 1 --2- 172.21.15.149:0/637863765 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f811009ba70 0x7f811009bf20 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f81100b3190 tx=0x7f810800a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:06.373 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.354+0000 7f8105ffb700 1 -- 172.21.15.149:0/637863765 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810800add0 con 0x7f811009ba70 2023-11-08T19:30:06.373 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.354+0000 7f8105ffb700 1 -- 172.21.15.149:0/637863765 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81080133f0 con 0x7f811009ba70 2023-11-08T19:30:06.373 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.354+0000 7f811728f700 1 -- 172.21.15.149:0/637863765 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81101f3480 con 0x7f811009ba70 2023-11-08T19:30:06.373 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.354+0000 7f8105ffb700 1 -- 172.21.15.149:0/637863765 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81080137a0 con 0x7f811009ba70 2023-11-08T19:30:06.374 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.355+0000 7f811728f700 1 -- 172.21.15.149:0/637863765 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81101f39b0 con 0x7f811009ba70 2023-11-08T19:30:06.374 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.355+0000 7f811728f700 1 -- 172.21.15.149:0/637863765 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81100745f0 con 0x7f811009ba70 2023-11-08T19:30:06.374 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.356+0000 7f8105ffb700 1 -- 172.21.15.149:0/637863765 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8108013900 con 0x7f811009ba70 2023-11-08T19:30:06.374 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.356+0000 7f8105ffb700 1 --2- 172.21.15.149:0/637863765 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f80f406af00 0x7f80f406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:06.374 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.356+0000 7f8105ffb700 1 -- 172.21.15.149:0/637863765 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6999+0+0 (secure 0 0 0) 0x7f810808a330 con 0x7f811009ba70 2023-11-08T19:30:06.375 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.356+0000 7f811502b700 1 --2- 172.21.15.149:0/637863765 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f80f406af00 0x7f80f406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:06.375 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.357+0000 7f811502b700 1 --2- 172.21.15.149:0/637863765 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f80f406af00 0x7f80f406d3c0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f810c000c00 tx=0x7f810c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:06.375 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.361+0000 7f8105ffb700 1 -- 172.21.15.149:0/637863765 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8108054ed0 con 0x7f811009ba70 2023-11-08T19:30:06.635 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.634+0000 7f811728f700 1 -- 172.21.15.149:0/637863765 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snapshots.TestSnapshots.test_kill_mdstable"]} v 0) v1 -- 0x7f811009c680 con 0x7f811009ba70 2023-11-08T19:30:06.746 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.746+0000 7f8105ffb700 1 -- 172.21.15.149:0/637863765 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snapshots.TestSnapshots.test_kill_mdstable"]}]=0 v383) v1 ==== 139+0+0 (secure 0 0 0) 0x7f811009c680 con 0x7f811009ba70 2023-11-08T19:30:06.749 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.748+0000 7f811728f700 1 -- 172.21.15.149:0/637863765 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f80f406af00 msgr2=0x7f80f406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:06.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.748+0000 7f811728f700 1 --2- 172.21.15.149:0/637863765 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f80f406af00 0x7f80f406d3c0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f810c000c00 tx=0x7f810c008030 comp rx=0 tx=0).stop 2023-11-08T19:30:06.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.748+0000 7f811728f700 1 -- 172.21.15.149:0/637863765 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f811009ba70 msgr2=0x7f811009bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:06.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.748+0000 7f811728f700 1 --2- 172.21.15.149:0/637863765 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f811009ba70 0x7f811009bf20 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f81100b3190 tx=0x7f810800a6a0 comp rx=0 tx=0).stop 2023-11-08T19:30:06.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.748+0000 7f811728f700 1 -- 172.21.15.149:0/637863765 shutdown_connections 2023-11-08T19:30:06.751 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.748+0000 7f811728f700 1 --2- 172.21.15.149:0/637863765 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f80f406af00 0x7f80f406d3c0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:06.751 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.748+0000 7f811728f700 1 --2- 172.21.15.149:0/637863765 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f80fc003a30 0x7f81100b54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:06.751 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.748+0000 7f811728f700 1 --2- 172.21.15.149:0/637863765 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f811009ba70 0x7f811009bf20 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:06.751 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.748+0000 7f811728f700 1 --2- 172.21.15.149:0/637863765 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8110156790 0x7f8110156c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:06.751 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.748+0000 7f811728f700 1 -- 172.21.15.149:0/637863765 >> 172.21.15.149:0/637863765 conn(0x7f8110099a40 msgr2=0x7f81100ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:06.752 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.748+0000 7f811728f700 1 -- 172.21.15.149:0/637863765 shutdown_connections 2023-11-08T19:30:06.752 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:06.748+0000 7f811728f700 1 -- 172.21.15.149:0/637863765 wait complete. 2023-11-08T19:30:06.762 INFO:tasks.cephfs_test_runner:check snaptable transcation ... ERROR 2023-11-08T19:30:06.762 INFO:tasks.cephfs_test_runner: 2023-11-08T19:30:06.763 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-08T19:30:06.763 INFO:tasks.cephfs_test_runner:ERROR: test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots) 2023-11-08T19:30:06.763 INFO:tasks.cephfs_test_runner:check snaptable transcation 2023-11-08T19:30:06.764 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-08T19:30:06.764 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-08T19:30:06.764 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_e797689ab88984658d73bbc928b2ed06c676d14a/qa/tasks/cephfs/test_snapshots.py", line 149, in test_kill_mdstable 2023-11-08T19:30:06.764 INFO:tasks.cephfs_test_runner: proc.wait() 2023-11-08T19:30:06.765 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait 2023-11-08T19:30:06.765 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-11-08T19:30:06.765 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-11-08T19:30:06.765 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-11-08T19:30:06.766 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi149 with status 1: '(cd /home/ubuntu/cephtest/mnt.0 && exec mkdir d1/dir/.snap/s22)' 2023-11-08T19:30:06.766 INFO:tasks.cephfs_test_runner: 2023-11-08T19:30:06.766 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-08T19:30:06.767 INFO:tasks.cephfs_test_runner:Ran 5 tests in 378.566s 2023-11-08T19:30:06.767 INFO:tasks.cephfs_test_runner: 2023-11-08T19:30:06.767 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2023-11-08T19:30:06.767 INFO:tasks.cephfs_test_runner: 2023-11-08T19:30:06.768 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-08T19:30:06.768 INFO:tasks.cephfs_test_runner:ERROR: test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots) 2023-11-08T19:30:06.768 INFO:tasks.cephfs_test_runner:check snaptable transcation 2023-11-08T19:30:06.768 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-08T19:30:06.769 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-08T19:30:06.769 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_e797689ab88984658d73bbc928b2ed06c676d14a/qa/tasks/cephfs/test_snapshots.py", line 149, in test_kill_mdstable 2023-11-08T19:30:06.769 INFO:tasks.cephfs_test_runner: proc.wait() 2023-11-08T19:30:06.770 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait 2023-11-08T19:30:06.770 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-11-08T19:30:06.770 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-11-08T19:30:06.770 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-11-08T19:30:06.771 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi149 with status 1: '(cd /home/ubuntu/cephtest/mnt.0 && exec mkdir d1/dir/.snap/s22)' 2023-11-08T19:30:06.771 INFO:tasks.cephfs_test_runner: 2023-11-08T19:30:06.771 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_batrick_ceph_e797689ab88984658d73bbc928b2ed06c676d14a/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots) 2023-11-08T19:30:06.847 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=29d22ec5852948c3a881d39d0ce52a5b Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_batrick_ceph_e797689ab88984658d73bbc928b2ed06c676d14a/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots) 2023-11-08T19:30:06.849 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-11-08T19:30:06.860 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-11-08T19:30:06.909 INFO:tasks.kclient:Unmounting kernel clients... 2023-11-08T19:30:06.909 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-11-08T19:30:06.910 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:30:06.932 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=8026740k,nr_inodes=2006685,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=31,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15303 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1609048k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-11-08T19:30:06.932 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-11-08T19:30:06.933 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:30:06.990 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=8026740k,nr_inodes=2006685,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=31,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15303 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1609048k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-11-08T19:30:06.991 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-11-08T19:30:06.991 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:30:07.012 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284272k,nr_inodes=4071068,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16330 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-08T19:30:07.013 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-11-08T19:30:07.013 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T19:30:07.072 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284272k,nr_inodes=4071068,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16330 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-08T19:30:07.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:30:07.073 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2023-11-08T19:30:07.091 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-08T19:30:07.091 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-08T19:30:07.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:30:07.092 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-08T19:30:07.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:30:07.169 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-08T19:30:07.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:30:07.255 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link delete ceph-brx 2023-11-08T19:30:07.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:30:07.415 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2023-11-08T19:30:07.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:30:07.433 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link delete ceph-brx 2023-11-08T19:30:07.504 INFO:teuthology.orchestra.run.smithi149.stderr:Cannot find device "ceph-brx" 2023-11-08T19:30:07.505 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-08T19:30:07.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:30:07.507 DEBUG:teuthology.orchestra.run.smithi160:> ip netns list 2023-11-08T19:30:07.528 INFO:teuthology.orchestra.run.smithi160.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-08T19:30:07.529 INFO:teuthology.orchestra.run.smithi160.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-08T19:30:07.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:30:07.530 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-08T19:30:07.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:30:07.612 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-08T19:30:07.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:30:07.700 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip link delete ceph-brx 2023-11-08T19:30:07.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:30:07.792 DEBUG:teuthology.orchestra.run.smithi160:> ip netns list 2023-11-08T19:30:07.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T19:30:07.810 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip link delete ceph-brx 2023-11-08T19:30:07.880 INFO:teuthology.orchestra.run.smithi160.stderr:Cannot find device "ceph-brx" 2023-11-08T19:30:07.881 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-08T19:30:07.882 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-11-08T19:30:07.891 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-08T19:30:07.892 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:30:08.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.013+0000 7fb953ed3700 1 Processor -- start 2023-11-08T19:30:08.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.013+0000 7fb953ed3700 1 -- start start 2023-11-08T19:30:08.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.014+0000 7fb953ed3700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb94c071610 0x7fb94c15add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:08.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.014+0000 7fb953ed3700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb94c0b1d70 con 0x7fb94c06cde0 2023-11-08T19:30:08.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.014+0000 7fb953ed3700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb94c071bb0 con 0x7fb94c0c9a90 2023-11-08T19:30:08.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.014+0000 7fb953ed3700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb94c072830 con 0x7fb94c071610 2023-11-08T19:30:08.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.014+0000 7fb951c6f700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fb94c06cde0 0x7fb94c06d1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:47874/0 (socket says 172.21.15.149:47874) 2023-11-08T19:30:08.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.014+0000 7fb951c6f700 1 -- 172.21.15.149:0/1482379895 learned_addr learned my addr 172.21.15.149:0/1482379895 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:30:08.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.015+0000 7fb95146e700 1 --2- 172.21.15.149:0/1482379895 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb94c071610 0x7fb94c15add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:08.025 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.015+0000 7fb950c6d700 1 -- 172.21.15.149:0/1482379895 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 8393911 0 0) 0x7fb94c0b1d70 con 0x7fb94c06cde0 2023-11-08T19:30:08.025 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.015+0000 7fb950c6d700 1 -- 172.21.15.149:0/1482379895 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9380046c0 con 0x7fb94c06cde0 2023-11-08T19:30:08.025 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.015+0000 7fb950c6d700 1 -- 172.21.15.149:0/1482379895 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1156763396 0 0) 0x7fb94c071bb0 con 0x7fb94c0c9a90 2023-11-08T19:30:08.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.015+0000 7fb950c6d700 1 -- 172.21.15.149:0/1482379895 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb94c0b1d70 con 0x7fb94c0c9a90 2023-11-08T19:30:08.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.015+0000 7fb950c6d700 1 -- 172.21.15.149:0/1482379895 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3144946541 0 0) 0x7fb9380046c0 con 0x7fb94c06cde0 2023-11-08T19:30:08.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.015+0000 7fb950c6d700 1 -- 172.21.15.149:0/1482379895 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb94c071610 msgr2=0x7fb94c15add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:30:08.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.015+0000 7fb950c6d700 1 --2- 172.21.15.149:0/1482379895 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb94c071610 0x7fb94c15add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:08.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.015+0000 7fb950c6d700 1 -- 172.21.15.149:0/1482379895 >> v1:172.21.15.160:6789/0 conn(0x7fb94c0c9a90 legacy=0x7fb94c0c9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:08.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.015+0000 7fb950c6d700 1 -- 172.21.15.149:0/1482379895 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb94c071e90 con 0x7fb94c06cde0 2023-11-08T19:30:08.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.015+0000 7fb950c6d700 1 -- 172.21.15.149:0/1482379895 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7fb93c001670 con 0x7fb94c06cde0 2023-11-08T19:30:08.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.015+0000 7fb950c6d700 1 -- 172.21.15.149:0/1482379895 >> v1:172.21.15.149:6789/0 conn(0x7fb94c06cde0 legacy=0x7fb94c06d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:08.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.015+0000 7fb950c6d700 1 --2- 172.21.15.149:0/1482379895 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb938004cd0 0x7fb9380050d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:08.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.015+0000 7fb950c6d700 1 --2- 172.21.15.149:0/1482379895 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb938005960 0x7fb938005de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:08.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.015+0000 7fb950c6d700 1 --2- 172.21.15.149:0/1482379895 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb94c071610 0x7fb938006380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:08.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.015+0000 7fb950c6d700 1 -- 172.21.15.149:0/1482379895 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb94c072830 con 0x7fb938005960 2023-11-08T19:30:08.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.015+0000 7fb950c6d700 1 -- 172.21.15.149:0/1482379895 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb93800ccb0 con 0x7fb938004cd0 2023-11-08T19:30:08.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.015+0000 7fb950c6d700 1 -- 172.21.15.149:0/1482379895 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb93800ce40 con 0x7fb94c071610 2023-11-08T19:30:08.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.015+0000 7fb95146e700 1 --2- 172.21.15.149:0/1482379895 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb938005960 0x7fb938005de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:08.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.015+0000 7fb951c6f700 1 --2- 172.21.15.149:0/1482379895 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb938004cd0 0x7fb9380050d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:08.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.015+0000 7fb952470700 1 --2- 172.21.15.149:0/1482379895 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb94c071610 0x7fb938006380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:08.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.015+0000 7fb95146e700 1 -- 172.21.15.149:0/1482379895 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb94c071610 msgr2=0x7fb938006380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:30:08.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.015+0000 7fb95146e700 1 --2- 172.21.15.149:0/1482379895 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb94c071610 0x7fb938006380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:08.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.015+0000 7fb95146e700 1 -- 172.21.15.149:0/1482379895 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb938004cd0 msgr2=0x7fb9380050d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:30:08.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.015+0000 7fb95146e700 1 --2- 172.21.15.149:0/1482379895 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb938004cd0 0x7fb9380050d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:08.032 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.015+0000 7fb95146e700 1 -- 172.21.15.149:0/1482379895 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9380046c0 con 0x7fb938005960 2023-11-08T19:30:08.032 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.016+0000 7fb95146e700 1 --2- 172.21.15.149:0/1482379895 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb938005960 0x7fb938005de0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7fb948009b90 tx=0x7fb938006990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=817f0c857223fdd1 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:08.032 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.016+0000 7fb950c6d700 1 -- 172.21.15.149:0/1482379895 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94800e6c0 con 0x7fb938005960 2023-11-08T19:30:08.032 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.016+0000 7fb950c6d700 1 -- 172.21.15.149:0/1482379895 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb94800e820 con 0x7fb938005960 2023-11-08T19:30:08.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.016+0000 7fb950c6d700 1 -- 172.21.15.149:0/1482379895 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94800eb90 con 0x7fb938005960 2023-11-08T19:30:08.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.016+0000 7fb953ed3700 1 -- 172.21.15.149:0/1482379895 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb938005960 msgr2=0x7fb938005de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:08.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.016+0000 7fb953ed3700 1 --2- 172.21.15.149:0/1482379895 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb938005960 0x7fb938005de0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7fb948009b90 tx=0x7fb938006990 comp rx=0 tx=0).stop 2023-11-08T19:30:08.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.016+0000 7fb952470700 1 -- 172.21.15.149:0/1482379895 reap_dead start 2023-11-08T19:30:08.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.016+0000 7fb953ed3700 1 -- 172.21.15.149:0/1482379895 shutdown_connections 2023-11-08T19:30:08.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.016+0000 7fb953ed3700 1 -- 172.21.15.149:0/1482379895 >> 172.21.15.149:0/1482379895 conn(0x7fb94c06b3d0 msgr2=0x7fb94c0cf460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:08.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.016+0000 7fb953ed3700 1 -- 172.21.15.149:0/1482379895 shutdown_connections 2023-11-08T19:30:08.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.016+0000 7fb953ed3700 1 -- 172.21.15.149:0/1482379895 wait complete. 2023-11-08T19:30:08.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.018+0000 7fb953ed3700 1 Processor -- start 2023-11-08T19:30:08.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.018+0000 7fb953ed3700 1 -- start start 2023-11-08T19:30:08.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.018+0000 7fb953ed3700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb938005960 0x7fb94c0b3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:08.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.018+0000 7fb953ed3700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb94c0ae930 0x7fb94c0c8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:08.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.018+0000 7fb953ed3700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb94c14f640 0x7fb94c0c4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:08.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.018+0000 7fb953ed3700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb94c0a86c0 con 0x7fb938005960 2023-11-08T19:30:08.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.018+0000 7fb953ed3700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb94c0b2b30 con 0x7fb94c0ae930 2023-11-08T19:30:08.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.018+0000 7fb953ed3700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb94c0b2e10 con 0x7fb94c14f640 2023-11-08T19:30:08.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.018+0000 7fb951c6f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb938005960 0x7fb94c0b3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:08.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.018+0000 7fb951c6f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb938005960 0x7fb94c0b3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45884/0 (socket says 172.21.15.149:45884) 2023-11-08T19:30:08.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.018+0000 7fb951c6f700 1 -- 172.21.15.149:0/3577071847 learned_addr learned my addr 172.21.15.149:0/3577071847 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:30:08.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.018+0000 7fb95146e700 1 --2- 172.21.15.149:0/3577071847 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb94c0ae930 0x7fb94c0c8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:08.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.018+0000 7fb952470700 1 --2- 172.21.15.149:0/3577071847 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb94c14f640 0x7fb94c0c4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:08.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.019+0000 7fb951c6f700 1 -- 172.21.15.149:0/3577071847 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb94c14f640 msgr2=0x7fb94c0c4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:08.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.019+0000 7fb951c6f700 1 --2- 172.21.15.149:0/3577071847 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb94c14f640 0x7fb94c0c4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:08.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.019+0000 7fb951c6f700 1 -- 172.21.15.149:0/3577071847 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb94c0ae930 msgr2=0x7fb94c0c8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:08.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.019+0000 7fb951c6f700 1 --2- 172.21.15.149:0/3577071847 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb94c0ae930 0x7fb94c0c8cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:08.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.019+0000 7fb951c6f700 1 -- 172.21.15.149:0/3577071847 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb94c0b30f0 con 0x7fb938005960 2023-11-08T19:30:08.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.019+0000 7fb951c6f700 1 --2- 172.21.15.149:0/3577071847 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb938005960 0x7fb94c0b3bd0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7fb93c004f80 tx=0x7fb93c007340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:08.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.019+0000 7fb9427fc700 1 -- 172.21.15.149:0/3577071847 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb93c0010d0 con 0x7fb938005960 2023-11-08T19:30:08.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.019+0000 7fb9427fc700 1 -- 172.21.15.149:0/3577071847 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb93c012560 con 0x7fb938005960 2023-11-08T19:30:08.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.019+0000 7fb953ed3700 1 -- 172.21.15.149:0/3577071847 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb94c0b33d0 con 0x7fb938005960 2023-11-08T19:30:08.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.019+0000 7fb9427fc700 1 -- 172.21.15.149:0/3577071847 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb93c0128f0 con 0x7fb938005960 2023-11-08T19:30:08.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.019+0000 7fb953ed3700 1 -- 172.21.15.149:0/3577071847 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb94c0c91f0 con 0x7fb938005960 2023-11-08T19:30:08.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.020+0000 7fb953ed3700 1 -- 172.21.15.149:0/3577071847 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb94c0745f0 con 0x7fb938005960 2023-11-08T19:30:08.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.020+0000 7fb9427fc700 1 -- 172.21.15.149:0/3577071847 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb93c012a50 con 0x7fb938005960 2023-11-08T19:30:08.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.021+0000 7fb9427fc700 1 --2- 172.21.15.149:0/3577071847 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb93006af00 0x7fb93006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:08.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.021+0000 7fb9427fc700 1 -- 172.21.15.149:0/3577071847 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6999+0+0 (secure 0 0 0) 0x7fb93c089a80 con 0x7fb938005960 2023-11-08T19:30:08.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.021+0000 7fb95146e700 1 --2- 172.21.15.149:0/3577071847 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb93006af00 0x7fb93006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:08.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.021+0000 7fb95146e700 1 --2- 172.21.15.149:0/3577071847 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb93006af00 0x7fb93006d3c0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fb9480090b0 tx=0x7fb948008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:08.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.026+0000 7fb9427fc700 1 -- 172.21.15.149:0/3577071847 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb93c058020 con 0x7fb938005960 2023-11-08T19:30:08.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.213+0000 7fb953ed3700 1 -- 172.21.15.149:0/3577071847 --> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb94c072450 con 0x7fb93006af00 2023-11-08T19:30:08.221 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.221+0000 7fb9427fc700 1 -- 172.21.15.149:0/3577071847 <== mgr.4104 v2:172.21.15.149:6832/1929837472 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+293755 (secure 0 0 0) 0x7fb948022040 con 0x7fb93006af00 2023-11-08T19:30:08.225 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:30:08.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.224+0000 7fb953ed3700 1 -- 172.21.15.149:0/3577071847 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb93006af00 msgr2=0x7fb93006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:08.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.224+0000 7fb953ed3700 1 --2- 172.21.15.149:0/3577071847 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb93006af00 0x7fb93006d3c0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fb9480090b0 tx=0x7fb948008030 comp rx=0 tx=0).stop 2023-11-08T19:30:08.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.224+0000 7fb953ed3700 1 -- 172.21.15.149:0/3577071847 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb938005960 msgr2=0x7fb94c0b3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:08.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.224+0000 7fb953ed3700 1 --2- 172.21.15.149:0/3577071847 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb938005960 0x7fb94c0b3bd0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7fb93c004f80 tx=0x7fb93c007340 comp rx=0 tx=0).stop 2023-11-08T19:30:08.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.224+0000 7fb953ed3700 1 -- 172.21.15.149:0/3577071847 shutdown_connections 2023-11-08T19:30:08.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.224+0000 7fb953ed3700 1 --2- 172.21.15.149:0/3577071847 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb93006af00 0x7fb93006d3c0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:08.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.224+0000 7fb953ed3700 1 --2- 172.21.15.149:0/3577071847 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb94c14f640 0x7fb94c0c4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:08.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.224+0000 7fb953ed3700 1 --2- 172.21.15.149:0/3577071847 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb938005960 0x7fb94c0b3bd0 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:08.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.224+0000 7fb953ed3700 1 --2- 172.21.15.149:0/3577071847 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb94c0ae930 0x7fb94c0c8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:08.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.224+0000 7fb953ed3700 1 -- 172.21.15.149:0/3577071847 >> 172.21.15.149:0/3577071847 conn(0x7fb94c06b3d0 msgr2=0x7fb94c0aef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:08.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.224+0000 7fb953ed3700 1 -- 172.21.15.149:0/3577071847 shutdown_connections 2023-11-08T19:30:08.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.224+0000 7fb953ed3700 1 -- 172.21.15.149:0/3577071847 wait complete. 2023-11-08T19:30:08.232 INFO:teuthology.orchestra.run.smithi149.stderr:dumped all 2023-11-08T19:30:08.237 INFO:teuthology.orchestra.run.smithi149.stdout:{"pg_ready":true,"pg_map":{"version":320,"stamp":"2023-11-08T19:30:08.097499+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":378,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":232176,"kb_used_data":11844,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754742544,"statfs":{"total":773094113280,"available":772856365056,"internally_reserved":0,"allocated":12128256,"data_stored":6772730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-75424,"num_objects":-41,"num_object_clones":0,"num_object_copies":-82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-41,"num_whiteouts":0,"num_read":-469,"num_read_kb":-619,"num_write":-181,"num_write_kb":-152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001505"},"pg_stats":[{"pgid":"13.c","version":"0'0","reported_seq":44,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.066566+0000","last_change":"2023-11-08T19:25:47.285071+0000","last_active":"2023-11-08T19:30:03.066566+0000","last_peered":"2023-11-08T19:30:03.066566+0000","last_clean":"2023-11-08T19:30:03.066566+0000","last_became_active":"2023-11-08T19:25:47.284788+0000","last_became_peered":"2023-11-08T19:25:47.284788+0000","last_unstale":"2023-11-08T19:30:03.066566+0000","last_undegraded":"2023-11-08T19:30:03.066566+0000","last_fullsized":"2023-11-08T19:30:03.066566+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:50:50.522780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":243,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.066125+0000","last_change":"2023-11-08T19:22:58.054283+0000","last_active":"2023-11-08T19:30:03.066125+0000","last_peered":"2023-11-08T19:30:03.066125+0000","last_clean":"2023-11-08T19:30:03.066125+0000","last_became_active":"2023-11-08T19:22:58.053337+0000","last_became_peered":"2023-11-08T19:22:58.053337+0000","last_unstale":"2023-11-08T19:30:03.066125+0000","last_undegraded":"2023-11-08T19:30:03.066125+0000","last_fullsized":"2023-11-08T19:30:03.066125+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:22:56.479654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:22:56.479654+0000","last_clean_scrub_stamp":"2023-11-08T19:22:56.479654+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:16:05.317001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":76,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:02.736304+0000","last_change":"2023-11-08T19:24:32.530665+0000","last_active":"2023-11-08T19:30:02.736304+0000","last_peered":"2023-11-08T19:30:02.736304+0000","last_clean":"2023-11-08T19:30:02.736304+0000","last_became_active":"2023-11-08T19:24:31.148363+0000","last_became_peered":"2023-11-08T19:24:31.148363+0000","last_unstale":"2023-11-08T19:30:02.736304+0000","last_undegraded":"2023-11-08T19:30:02.736304+0000","last_fullsized":"2023-11-08T19:30:02.736304+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:02:27.987795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075444200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":51,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.066383+0000","last_change":"2023-11-08T19:25:48.371346+0000","last_active":"2023-11-08T19:30:03.066383+0000","last_peered":"2023-11-08T19:30:03.066383+0000","last_clean":"2023-11-08T19:30:03.066383+0000","last_became_active":"2023-11-08T19:25:46.289470+0000","last_became_peered":"2023-11-08T19:25:46.289470+0000","last_unstale":"2023-11-08T19:30:03.066383+0000","last_undegraded":"2023-11-08T19:30:03.066383+0000","last_fullsized":"2023-11-08T19:30:03.066383+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:25:34.010085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000371219,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":48,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.068164+0000","last_change":"2023-11-08T19:25:47.283242+0000","last_active":"2023-11-08T19:30:03.068164+0000","last_peered":"2023-11-08T19:30:03.068164+0000","last_clean":"2023-11-08T19:30:03.068164+0000","last_became_active":"2023-11-08T19:25:47.282922+0000","last_became_peered":"2023-11-08T19:25:47.282922+0000","last_unstale":"2023-11-08T19:30:03.068164+0000","last_undegraded":"2023-11-08T19:30:03.068164+0000","last_fullsized":"2023-11-08T19:30:03.068164+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:26:23.400596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":76,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.065856+0000","last_change":"2023-11-08T19:24:32.544333+0000","last_active":"2023-11-08T19:30:03.065856+0000","last_peered":"2023-11-08T19:30:03.065856+0000","last_clean":"2023-11-08T19:30:03.065856+0000","last_became_active":"2023-11-08T19:24:31.138598+0000","last_became_peered":"2023-11-08T19:24:31.138598+0000","last_unstale":"2023-11-08T19:30:03.065856+0000","last_undegraded":"2023-11-08T19:30:03.065856+0000","last_fullsized":"2023-11-08T19:30:03.065856+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:11.860580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015114824000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":56,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.293214+0000","last_change":"2023-11-08T19:25:48.374357+0000","last_active":"2023-11-08T19:30:05.293214+0000","last_peered":"2023-11-08T19:30:05.293214+0000","last_clean":"2023-11-08T19:30:05.293214+0000","last_became_active":"2023-11-08T19:25:46.279007+0000","last_became_peered":"2023-11-08T19:25:46.279007+0000","last_unstale":"2023-11-08T19:30:05.293214+0000","last_undegraded":"2023-11-08T19:30:05.293214+0000","last_fullsized":"2023-11-08T19:30:05.293214+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:59:30.845191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036813240000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":47,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.292523+0000","last_change":"2023-11-08T19:25:47.285093+0000","last_active":"2023-11-08T19:30:05.292523+0000","last_peered":"2023-11-08T19:30:05.292523+0000","last_clean":"2023-11-08T19:30:05.292523+0000","last_became_active":"2023-11-08T19:25:47.284796+0000","last_became_peered":"2023-11-08T19:25:47.284796+0000","last_unstale":"2023-11-08T19:30:05.292523+0000","last_undegraded":"2023-11-08T19:30:05.292523+0000","last_fullsized":"2023-11-08T19:30:05.292523+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:46:36.504650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":76,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.065703+0000","last_change":"2023-11-08T19:24:32.544285+0000","last_active":"2023-11-08T19:30:03.065703+0000","last_peered":"2023-11-08T19:30:03.065703+0000","last_clean":"2023-11-08T19:30:03.065703+0000","last_became_active":"2023-11-08T19:24:31.142028+0000","last_became_peered":"2023-11-08T19:24:31.142028+0000","last_unstale":"2023-11-08T19:30:03.065703+0000","last_undegraded":"2023-11-08T19:30:03.065703+0000","last_fullsized":"2023-11-08T19:30:03.065703+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:01:24.198196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067537399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":53,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.291868+0000","last_change":"2023-11-08T19:25:48.372192+0000","last_active":"2023-11-08T19:30:05.291868+0000","last_peered":"2023-11-08T19:30:05.291868+0000","last_clean":"2023-11-08T19:30:05.291868+0000","last_became_active":"2023-11-08T19:25:46.288739+0000","last_became_peered":"2023-11-08T19:25:46.288739+0000","last_unstale":"2023-11-08T19:30:05.291868+0000","last_undegraded":"2023-11-08T19:30:05.291868+0000","last_fullsized":"2023-11-08T19:30:05.291868+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:45:04.839053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015057530000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":48,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.068129+0000","last_change":"2023-11-08T19:25:47.287920+0000","last_active":"2023-11-08T19:30:03.068129+0000","last_peered":"2023-11-08T19:30:03.068129+0000","last_clean":"2023-11-08T19:30:03.068129+0000","last_became_active":"2023-11-08T19:25:47.287494+0000","last_became_peered":"2023-11-08T19:25:47.287494+0000","last_unstale":"2023-11-08T19:30:03.068129+0000","last_undegraded":"2023-11-08T19:30:03.068129+0000","last_fullsized":"2023-11-08T19:30:03.068129+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:42:18.942062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":78,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.292283+0000","last_change":"2023-11-08T19:24:32.142836+0000","last_active":"2023-11-08T19:30:05.292283+0000","last_peered":"2023-11-08T19:30:05.292283+0000","last_clean":"2023-11-08T19:30:05.292283+0000","last_became_active":"2023-11-08T19:24:31.141367+0000","last_became_peered":"2023-11-08T19:24:31.141367+0000","last_unstale":"2023-11-08T19:30:05.292283+0000","last_undegraded":"2023-11-08T19:30:05.292283+0000","last_fullsized":"2023-11-08T19:30:05.292283+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:39.214888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001335136,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":52,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.065661+0000","last_change":"2023-11-08T19:25:48.372718+0000","last_active":"2023-11-08T19:30:03.065661+0000","last_peered":"2023-11-08T19:30:03.065661+0000","last_clean":"2023-11-08T19:30:03.065661+0000","last_became_active":"2023-11-08T19:25:46.289283+0000","last_became_peered":"2023-11-08T19:25:46.289283+0000","last_unstale":"2023-11-08T19:30:03.065661+0000","last_undegraded":"2023-11-08T19:30:03.065661+0000","last_fullsized":"2023-11-08T19:30:03.065661+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:15:51.881891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001274049,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":47,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.292492+0000","last_change":"2023-11-08T19:25:47.285353+0000","last_active":"2023-11-08T19:30:05.292492+0000","last_peered":"2023-11-08T19:30:05.292492+0000","last_clean":"2023-11-08T19:30:05.292492+0000","last_became_active":"2023-11-08T19:25:47.285075+0000","last_became_peered":"2023-11-08T19:25:47.285075+0000","last_unstale":"2023-11-08T19:30:05.292492+0000","last_undegraded":"2023-11-08T19:30:05.292492+0000","last_fullsized":"2023-11-08T19:30:05.292492+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:20:50.791463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":87,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.744154+0000","last_change":"2023-11-08T19:24:32.139885+0000","last_active":"2023-11-08T19:30:04.744154+0000","last_peered":"2023-11-08T19:30:04.744154+0000","last_clean":"2023-11-08T19:30:04.744154+0000","last_became_active":"2023-11-08T19:24:31.145329+0000","last_became_peered":"2023-11-08T19:24:31.145329+0000","last_unstale":"2023-11-08T19:30:04.744154+0000","last_undegraded":"2023-11-08T19:30:04.744154+0000","last_fullsized":"2023-11-08T19:30:04.744154+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:25:18.356784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049012999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":56,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.293375+0000","last_change":"2023-11-08T19:25:48.373848+0000","last_active":"2023-11-08T19:30:05.293375+0000","last_peered":"2023-11-08T19:30:05.293375+0000","last_clean":"2023-11-08T19:30:05.293375+0000","last_became_active":"2023-11-08T19:25:46.282174+0000","last_became_peered":"2023-11-08T19:25:46.282174+0000","last_unstale":"2023-11-08T19:30:05.293375+0000","last_undegraded":"2023-11-08T19:30:05.293375+0000","last_fullsized":"2023-11-08T19:30:05.293375+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:00:06.938052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000727792,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":52,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.743231+0000","last_change":"2023-11-08T19:25:47.287677+0000","last_active":"2023-11-08T19:30:04.743231+0000","last_peered":"2023-11-08T19:30:04.743231+0000","last_clean":"2023-11-08T19:30:04.743231+0000","last_became_active":"2023-11-08T19:25:47.287419+0000","last_became_peered":"2023-11-08T19:25:47.287419+0000","last_unstale":"2023-11-08T19:30:04.743231+0000","last_undegraded":"2023-11-08T19:30:04.743231+0000","last_fullsized":"2023-11-08T19:30:04.743231+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:22:08.770702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":86,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.746427+0000","last_change":"2023-11-08T19:24:32.140880+0000","last_active":"2023-11-08T19:30:04.746427+0000","last_peered":"2023-11-08T19:30:04.746427+0000","last_clean":"2023-11-08T19:30:04.746427+0000","last_became_active":"2023-11-08T19:24:31.146063+0000","last_became_peered":"2023-11-08T19:24:31.146063+0000","last_unstale":"2023-11-08T19:30:04.746427+0000","last_undegraded":"2023-11-08T19:30:04.746427+0000","last_fullsized":"2023-11-08T19:30:04.746427+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:54:08.985813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089896300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":53,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:02.735574+0000","last_change":"2023-11-08T19:25:48.374690+0000","last_active":"2023-11-08T19:30:02.735574+0000","last_peered":"2023-11-08T19:30:02.735574+0000","last_clean":"2023-11-08T19:30:02.735574+0000","last_became_active":"2023-11-08T19:25:46.281986+0000","last_became_peered":"2023-11-08T19:25:46.281986+0000","last_unstale":"2023-11-08T19:30:02.735574+0000","last_undegraded":"2023-11-08T19:30:02.735574+0000","last_fullsized":"2023-11-08T19:30:02.735574+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:21:00.981136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003067771,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":44,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.066376+0000","last_change":"2023-11-08T19:25:47.287986+0000","last_active":"2023-11-08T19:30:03.066376+0000","last_peered":"2023-11-08T19:30:03.066376+0000","last_clean":"2023-11-08T19:30:03.066376+0000","last_became_active":"2023-11-08T19:25:47.287560+0000","last_became_peered":"2023-11-08T19:25:47.287560+0000","last_unstale":"2023-11-08T19:30:03.066376+0000","last_undegraded":"2023-11-08T19:30:03.066376+0000","last_fullsized":"2023-11-08T19:30:03.066376+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:35:31.433056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":76,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:02.735507+0000","last_change":"2023-11-08T19:24:32.530620+0000","last_active":"2023-11-08T19:30:02.735507+0000","last_peered":"2023-11-08T19:30:02.735507+0000","last_clean":"2023-11-08T19:30:02.735507+0000","last_became_active":"2023-11-08T19:24:31.144223+0000","last_became_peered":"2023-11-08T19:24:31.144223+0000","last_unstale":"2023-11-08T19:30:02.735507+0000","last_undegraded":"2023-11-08T19:30:02.735507+0000","last_fullsized":"2023-11-08T19:30:02.735507+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:01:25.647952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071879799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":59,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.746498+0000","last_change":"2023-11-08T19:25:48.285326+0000","last_active":"2023-11-08T19:30:04.746498+0000","last_peered":"2023-11-08T19:30:04.746498+0000","last_clean":"2023-11-08T19:30:04.746498+0000","last_became_active":"2023-11-08T19:25:46.278686+0000","last_became_peered":"2023-11-08T19:25:46.278686+0000","last_unstale":"2023-11-08T19:30:04.746498+0000","last_undegraded":"2023-11-08T19:30:04.746498+0000","last_fullsized":"2023-11-08T19:30:04.746498+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:25:34.010085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078409499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":52,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.746273+0000","last_change":"2023-11-08T19:25:47.289726+0000","last_active":"2023-11-08T19:30:04.746273+0000","last_peered":"2023-11-08T19:30:04.746273+0000","last_clean":"2023-11-08T19:30:04.746273+0000","last_became_active":"2023-11-08T19:25:47.289362+0000","last_became_peered":"2023-11-08T19:25:47.289362+0000","last_unstale":"2023-11-08T19:30:04.746273+0000","last_undegraded":"2023-11-08T19:30:04.746273+0000","last_fullsized":"2023-11-08T19:30:04.746273+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:38:55.785104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":75,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.066507+0000","last_change":"2023-11-08T19:24:32.147025+0000","last_active":"2023-11-08T19:30:03.066507+0000","last_peered":"2023-11-08T19:30:03.066507+0000","last_clean":"2023-11-08T19:30:03.066507+0000","last_became_active":"2023-11-08T19:24:31.147082+0000","last_became_peered":"2023-11-08T19:24:31.147082+0000","last_unstale":"2023-11-08T19:30:03.066507+0000","last_undegraded":"2023-11-08T19:30:03.066507+0000","last_fullsized":"2023-11-08T19:30:03.066507+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:02:27.987795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043701599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":53,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:02.736356+0000","last_change":"2023-11-08T19:25:48.374739+0000","last_active":"2023-11-08T19:30:02.736356+0000","last_peered":"2023-11-08T19:30:02.736356+0000","last_clean":"2023-11-08T19:30:02.736356+0000","last_became_active":"2023-11-08T19:25:46.282071+0000","last_became_peered":"2023-11-08T19:25:46.282071+0000","last_unstale":"2023-11-08T19:30:02.736356+0000","last_undegraded":"2023-11-08T19:30:02.736356+0000","last_fullsized":"2023-11-08T19:30:02.736356+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:42:47.677504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023654909999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":76,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.065926+0000","last_change":"2023-11-08T19:24:32.544063+0000","last_active":"2023-11-08T19:30:03.065926+0000","last_peered":"2023-11-08T19:30:03.065926+0000","last_clean":"2023-11-08T19:30:03.065926+0000","last_became_active":"2023-11-08T19:24:31.144795+0000","last_became_peered":"2023-11-08T19:24:31.144795+0000","last_unstale":"2023-11-08T19:30:03.065926+0000","last_undegraded":"2023-11-08T19:30:03.065926+0000","last_fullsized":"2023-11-08T19:30:03.065926+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:12:42.248307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01495431,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":60,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.744117+0000","last_change":"2023-11-08T19:25:48.283673+0000","last_active":"2023-11-08T19:30:04.744117+0000","last_peered":"2023-11-08T19:30:04.744117+0000","last_clean":"2023-11-08T19:30:04.744117+0000","last_became_active":"2023-11-08T19:25:46.285766+0000","last_became_peered":"2023-11-08T19:25:46.285766+0000","last_unstale":"2023-11-08T19:30:04.744117+0000","last_undegraded":"2023-11-08T19:30:04.744117+0000","last_fullsized":"2023-11-08T19:30:04.744117+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:46:35.498766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001756748,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":45,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.066146+0000","last_change":"2023-11-08T19:25:47.288301+0000","last_active":"2023-11-08T19:30:03.066146+0000","last_peered":"2023-11-08T19:30:03.066146+0000","last_clean":"2023-11-08T19:30:03.066146+0000","last_became_active":"2023-11-08T19:25:47.288027+0000","last_became_peered":"2023-11-08T19:25:47.288027+0000","last_unstale":"2023-11-08T19:30:03.066146+0000","last_undegraded":"2023-11-08T19:30:03.066146+0000","last_fullsized":"2023-11-08T19:30:03.066146+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:23:13.428596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":76,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.066506+0000","last_change":"2023-11-08T19:24:32.263810+0000","last_active":"2023-11-08T19:30:03.066506+0000","last_peered":"2023-11-08T19:30:03.066506+0000","last_clean":"2023-11-08T19:30:03.066506+0000","last_became_active":"2023-11-08T19:24:31.138814+0000","last_became_peered":"2023-11-08T19:24:31.138814+0000","last_unstale":"2023-11-08T19:30:03.066506+0000","last_undegraded":"2023-11-08T19:30:03.066506+0000","last_fullsized":"2023-11-08T19:30:03.066506+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:21:55.985548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048136000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":60,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.742995+0000","last_change":"2023-11-08T19:25:48.283572+0000","last_active":"2023-11-08T19:30:04.742995+0000","last_peered":"2023-11-08T19:30:04.742995+0000","last_clean":"2023-11-08T19:30:04.742995+0000","last_became_active":"2023-11-08T19:25:46.271936+0000","last_became_peered":"2023-11-08T19:25:46.271936+0000","last_unstale":"2023-11-08T19:30:04.742995+0000","last_undegraded":"2023-11-08T19:30:04.742995+0000","last_fullsized":"2023-11-08T19:30:04.742995+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:46:11.541748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00186835,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":53,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.743957+0000","last_change":"2023-11-08T19:25:47.282856+0000","last_active":"2023-11-08T19:30:04.743957+0000","last_peered":"2023-11-08T19:30:04.743957+0000","last_clean":"2023-11-08T19:30:04.743957+0000","last_became_active":"2023-11-08T19:25:47.282594+0000","last_became_peered":"2023-11-08T19:25:47.282594+0000","last_unstale":"2023-11-08T19:30:04.743957+0000","last_undegraded":"2023-11-08T19:30:04.743957+0000","last_fullsized":"2023-11-08T19:30:04.743957+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:14:12.111756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":79,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.068077+0000","last_change":"2023-11-08T19:24:32.333096+0000","last_active":"2023-11-08T19:30:03.068077+0000","last_peered":"2023-11-08T19:30:03.068077+0000","last_clean":"2023-11-08T19:30:03.068077+0000","last_became_active":"2023-11-08T19:24:31.142985+0000","last_became_peered":"2023-11-08T19:24:31.142985+0000","last_unstale":"2023-11-08T19:30:03.068077+0000","last_undegraded":"2023-11-08T19:30:03.068077+0000","last_fullsized":"2023-11-08T19:30:03.068077+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:36:33.274496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000386048,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":54,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:02.735104+0000","last_change":"2023-11-08T19:25:48.372963+0000","last_active":"2023-11-08T19:30:02.735104+0000","last_peered":"2023-11-08T19:30:02.735104+0000","last_clean":"2023-11-08T19:30:02.735104+0000","last_became_active":"2023-11-08T19:25:46.283263+0000","last_became_peered":"2023-11-08T19:25:46.283263+0000","last_unstale":"2023-11-08T19:30:02.735104+0000","last_undegraded":"2023-11-08T19:30:02.735104+0000","last_fullsized":"2023-11-08T19:30:02.735104+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:25:34.010085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019848779999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":48,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.292775+0000","last_change":"2023-11-08T19:25:47.284816+0000","last_active":"2023-11-08T19:30:05.292775+0000","last_peered":"2023-11-08T19:30:05.292775+0000","last_clean":"2023-11-08T19:30:05.292775+0000","last_became_active":"2023-11-08T19:25:47.284522+0000","last_became_peered":"2023-11-08T19:25:47.284522+0000","last_unstale":"2023-11-08T19:30:05.292775+0000","last_undegraded":"2023-11-08T19:30:05.292775+0000","last_fullsized":"2023-11-08T19:30:05.292775+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:39:28.223686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":76,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:02.734732+0000","last_change":"2023-11-08T19:24:32.530333+0000","last_active":"2023-11-08T19:30:02.734732+0000","last_peered":"2023-11-08T19:30:02.734732+0000","last_clean":"2023-11-08T19:30:02.734732+0000","last_became_active":"2023-11-08T19:24:31.144838+0000","last_became_peered":"2023-11-08T19:24:31.144838+0000","last_unstale":"2023-11-08T19:30:02.734732+0000","last_undegraded":"2023-11-08T19:30:02.734732+0000","last_fullsized":"2023-11-08T19:30:02.734732+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:39:48.473183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081588799999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":60,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.744392+0000","last_change":"2023-11-08T19:25:48.284699+0000","last_active":"2023-11-08T19:30:04.744392+0000","last_peered":"2023-11-08T19:30:04.744392+0000","last_clean":"2023-11-08T19:30:04.744392+0000","last_became_active":"2023-11-08T19:25:46.285588+0000","last_became_peered":"2023-11-08T19:25:46.285588+0000","last_unstale":"2023-11-08T19:30:04.744392+0000","last_undegraded":"2023-11-08T19:30:04.744392+0000","last_fullsized":"2023-11-08T19:30:04.744392+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:43:02.001903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023282350000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":47,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:02.735054+0000","last_change":"2023-11-08T19:25:47.283526+0000","last_active":"2023-11-08T19:30:02.735054+0000","last_peered":"2023-11-08T19:30:02.735054+0000","last_clean":"2023-11-08T19:30:02.735054+0000","last_became_active":"2023-11-08T19:25:47.283266+0000","last_became_peered":"2023-11-08T19:25:47.283266+0000","last_unstale":"2023-11-08T19:30:02.735054+0000","last_undegraded":"2023-11-08T19:30:02.735054+0000","last_fullsized":"2023-11-08T19:30:02.735054+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:35:31.433056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":79,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.068573+0000","last_change":"2023-11-08T19:24:32.333430+0000","last_active":"2023-11-08T19:30:03.068573+0000","last_peered":"2023-11-08T19:30:03.068573+0000","last_clean":"2023-11-08T19:30:03.068573+0000","last_became_active":"2023-11-08T19:24:31.141710+0000","last_became_peered":"2023-11-08T19:24:31.141710+0000","last_unstale":"2023-11-08T19:30:03.068573+0000","last_undegraded":"2023-11-08T19:30:03.068573+0000","last_fullsized":"2023-11-08T19:30:03.068573+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:32:51.214551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000430438,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":60,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.746468+0000","last_change":"2023-11-08T19:25:48.283855+0000","last_active":"2023-11-08T19:30:04.746468+0000","last_peered":"2023-11-08T19:30:04.746468+0000","last_clean":"2023-11-08T19:30:04.746468+0000","last_became_active":"2023-11-08T19:25:46.273336+0000","last_became_peered":"2023-11-08T19:25:46.273336+0000","last_unstale":"2023-11-08T19:30:04.746468+0000","last_undegraded":"2023-11-08T19:30:04.746468+0000","last_fullsized":"2023-11-08T19:30:04.746468+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:33:35.492889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092577200000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":53,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.743373+0000","last_change":"2023-11-08T19:25:47.282840+0000","last_active":"2023-11-08T19:30:04.743373+0000","last_peered":"2023-11-08T19:30:04.743373+0000","last_clean":"2023-11-08T19:30:04.743373+0000","last_became_active":"2023-11-08T19:25:47.282600+0000","last_became_peered":"2023-11-08T19:25:47.282600+0000","last_unstale":"2023-11-08T19:30:04.743373+0000","last_undegraded":"2023-11-08T19:30:04.743373+0000","last_fullsized":"2023-11-08T19:30:04.743373+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:53:37.482245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":53,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.743282+0000","last_change":"2023-11-08T19:25:47.285890+0000","last_active":"2023-11-08T19:30:04.743282+0000","last_peered":"2023-11-08T19:30:04.743282+0000","last_clean":"2023-11-08T19:30:04.743282+0000","last_became_active":"2023-11-08T19:25:47.285641+0000","last_became_peered":"2023-11-08T19:25:47.285641+0000","last_unstale":"2023-11-08T19:30:04.743282+0000","last_undegraded":"2023-11-08T19:30:04.743282+0000","last_fullsized":"2023-11-08T19:30:04.743282+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:27:18.335142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":76,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:02.736362+0000","last_change":"2023-11-08T19:24:32.530895+0000","last_active":"2023-11-08T19:30:02.736362+0000","last_peered":"2023-11-08T19:30:02.736362+0000","last_clean":"2023-11-08T19:30:02.736362+0000","last_became_active":"2023-11-08T19:24:31.146715+0000","last_became_peered":"2023-11-08T19:24:31.146715+0000","last_unstale":"2023-11-08T19:30:02.736362+0000","last_undegraded":"2023-11-08T19:30:02.736362+0000","last_fullsized":"2023-11-08T19:30:02.736362+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:39.214888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081671599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":60,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.743568+0000","last_change":"2023-11-08T19:25:48.284137+0000","last_active":"2023-11-08T19:30:04.743568+0000","last_peered":"2023-11-08T19:30:04.743568+0000","last_clean":"2023-11-08T19:30:04.743568+0000","last_became_active":"2023-11-08T19:25:46.285960+0000","last_became_peered":"2023-11-08T19:25:46.285960+0000","last_unstale":"2023-11-08T19:30:04.743568+0000","last_undegraded":"2023-11-08T19:30:04.743568+0000","last_fullsized":"2023-11-08T19:30:04.743568+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:26:01.141206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091649099999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":52,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.744689+0000","last_change":"2023-11-08T19:25:47.283642+0000","last_active":"2023-11-08T19:30:04.744689+0000","last_peered":"2023-11-08T19:30:04.744689+0000","last_clean":"2023-11-08T19:30:04.744689+0000","last_became_active":"2023-11-08T19:25:47.283360+0000","last_became_peered":"2023-11-08T19:25:47.283360+0000","last_unstale":"2023-11-08T19:30:04.744689+0000","last_undegraded":"2023-11-08T19:30:04.744689+0000","last_fullsized":"2023-11-08T19:30:04.744689+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:02:27.950152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":86,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.743654+0000","last_change":"2023-11-08T19:24:32.140167+0000","last_active":"2023-11-08T19:30:04.743654+0000","last_peered":"2023-11-08T19:30:04.743654+0000","last_clean":"2023-11-08T19:30:04.743654+0000","last_became_active":"2023-11-08T19:24:31.147181+0000","last_became_peered":"2023-11-08T19:24:31.147181+0000","last_unstale":"2023-11-08T19:30:04.743654+0000","last_undegraded":"2023-11-08T19:30:04.743654+0000","last_fullsized":"2023-11-08T19:30:04.743654+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:26.080042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057135200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":52,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.295903+0000","last_change":"2023-11-08T19:25:48.277705+0000","last_active":"2023-11-08T19:30:05.295903+0000","last_peered":"2023-11-08T19:30:05.295903+0000","last_clean":"2023-11-08T19:30:05.295903+0000","last_became_active":"2023-11-08T19:25:46.288848+0000","last_became_peered":"2023-11-08T19:25:46.288848+0000","last_unstale":"2023-11-08T19:30:05.295903+0000","last_undegraded":"2023-11-08T19:30:05.295903+0000","last_fullsized":"2023-11-08T19:30:05.295903+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:12:24.483185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097653099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":44,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.066512+0000","last_change":"2023-11-08T19:25:47.289456+0000","last_active":"2023-11-08T19:30:03.066512+0000","last_peered":"2023-11-08T19:30:03.066512+0000","last_clean":"2023-11-08T19:30:03.066512+0000","last_became_active":"2023-11-08T19:25:47.289177+0000","last_became_peered":"2023-11-08T19:25:47.289177+0000","last_unstale":"2023-11-08T19:30:03.066512+0000","last_undegraded":"2023-11-08T19:30:03.066512+0000","last_fullsized":"2023-11-08T19:30:03.066512+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:07:11.838364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":86,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.746322+0000","last_change":"2023-11-08T19:24:32.141188+0000","last_active":"2023-11-08T19:30:04.746322+0000","last_peered":"2023-11-08T19:30:04.746322+0000","last_clean":"2023-11-08T19:30:04.746322+0000","last_became_active":"2023-11-08T19:24:31.148857+0000","last_became_peered":"2023-11-08T19:24:31.148857+0000","last_unstale":"2023-11-08T19:30:04.746322+0000","last_undegraded":"2023-11-08T19:30:04.746322+0000","last_fullsized":"2023-11-08T19:30:04.746322+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:45:34.425432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065078599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":52,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.295127+0000","last_change":"2023-11-08T19:25:48.277423+0000","last_active":"2023-11-08T19:30:05.295127+0000","last_peered":"2023-11-08T19:30:05.295127+0000","last_clean":"2023-11-08T19:30:05.295127+0000","last_became_active":"2023-11-08T19:25:46.286211+0000","last_became_peered":"2023-11-08T19:25:46.286211+0000","last_unstale":"2023-11-08T19:30:05.295127+0000","last_undegraded":"2023-11-08T19:30:05.295127+0000","last_fullsized":"2023-11-08T19:30:05.295127+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:44:05.347800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073775700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":44,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.065924+0000","last_change":"2023-11-08T19:25:47.286020+0000","last_active":"2023-11-08T19:30:03.065924+0000","last_peered":"2023-11-08T19:30:03.065924+0000","last_clean":"2023-11-08T19:30:03.065924+0000","last_became_active":"2023-11-08T19:25:47.285728+0000","last_became_peered":"2023-11-08T19:25:47.285728+0000","last_unstale":"2023-11-08T19:30:03.065924+0000","last_undegraded":"2023-11-08T19:30:03.065924+0000","last_fullsized":"2023-11-08T19:30:03.065924+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:26:02.147090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":86,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.745467+0000","last_change":"2023-11-08T19:24:32.140832+0000","last_active":"2023-11-08T19:30:04.745467+0000","last_peered":"2023-11-08T19:30:04.745467+0000","last_clean":"2023-11-08T19:30:04.745467+0000","last_became_active":"2023-11-08T19:24:31.146557+0000","last_became_peered":"2023-11-08T19:24:31.146557+0000","last_unstale":"2023-11-08T19:30:04.745467+0000","last_undegraded":"2023-11-08T19:30:04.745467+0000","last_fullsized":"2023-11-08T19:30:04.745467+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:40:04.258107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099450100000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":53,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:02.734608+0000","last_change":"2023-11-08T19:25:48.372913+0000","last_active":"2023-11-08T19:30:02.734608+0000","last_peered":"2023-11-08T19:30:02.734608+0000","last_clean":"2023-11-08T19:30:02.734608+0000","last_became_active":"2023-11-08T19:25:46.281273+0000","last_became_peered":"2023-11-08T19:25:46.281273+0000","last_unstale":"2023-11-08T19:30:02.734608+0000","last_undegraded":"2023-11-08T19:30:02.734608+0000","last_fullsized":"2023-11-08T19:30:02.734608+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:07:10.832480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020904819999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":45,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.065384+0000","last_change":"2023-11-08T19:25:47.288256+0000","last_active":"2023-11-08T19:30:03.065384+0000","last_peered":"2023-11-08T19:30:03.065384+0000","last_clean":"2023-11-08T19:30:03.065384+0000","last_became_active":"2023-11-08T19:25:47.287905+0000","last_became_peered":"2023-11-08T19:25:47.287905+0000","last_unstale":"2023-11-08T19:30:03.065384+0000","last_undegraded":"2023-11-08T19:30:03.065384+0000","last_fullsized":"2023-11-08T19:30:03.065384+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:50:12.309248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":76,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:02.735192+0000","last_change":"2023-11-08T19:24:32.530378+0000","last_active":"2023-11-08T19:30:02.735192+0000","last_peered":"2023-11-08T19:30:02.735192+0000","last_clean":"2023-11-08T19:30:02.735192+0000","last_became_active":"2023-11-08T19:24:31.144341+0000","last_became_peered":"2023-11-08T19:24:31.144341+0000","last_unstale":"2023-11-08T19:30:02.735192+0000","last_undegraded":"2023-11-08T19:30:02.735192+0000","last_fullsized":"2023-11-08T19:30:02.735192+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:30:21.946303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058308299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":51,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.065803+0000","last_change":"2023-11-08T19:25:48.277150+0000","last_active":"2023-11-08T19:30:03.065803+0000","last_peered":"2023-11-08T19:30:03.065803+0000","last_clean":"2023-11-08T19:30:03.065803+0000","last_became_active":"2023-11-08T19:25:46.286933+0000","last_became_peered":"2023-11-08T19:25:46.286933+0000","last_unstale":"2023-11-08T19:30:03.065803+0000","last_undegraded":"2023-11-08T19:30:03.065803+0000","last_fullsized":"2023-11-08T19:30:03.065803+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:38:38.890354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080507500000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":44,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.066287+0000","last_change":"2023-11-08T19:25:47.282986+0000","last_active":"2023-11-08T19:30:03.066287+0000","last_peered":"2023-11-08T19:30:03.066287+0000","last_clean":"2023-11-08T19:30:03.066287+0000","last_became_active":"2023-11-08T19:25:47.282705+0000","last_became_peered":"2023-11-08T19:25:47.282705+0000","last_unstale":"2023-11-08T19:30:03.066287+0000","last_undegraded":"2023-11-08T19:30:03.066287+0000","last_fullsized":"2023-11-08T19:30:03.066287+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:34:17.838942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":76,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.065508+0000","last_change":"2023-11-08T19:24:32.544108+0000","last_active":"2023-11-08T19:30:03.065508+0000","last_peered":"2023-11-08T19:30:03.065508+0000","last_clean":"2023-11-08T19:30:03.065508+0000","last_became_active":"2023-11-08T19:24:31.143812+0000","last_became_peered":"2023-11-08T19:24:31.143812+0000","last_unstale":"2023-11-08T19:30:03.065508+0000","last_undegraded":"2023-11-08T19:30:03.065508+0000","last_fullsized":"2023-11-08T19:30:03.065508+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:27:59.135977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014956126,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":59,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.745074+0000","last_change":"2023-11-08T19:25:48.284435+0000","last_active":"2023-11-08T19:30:04.745074+0000","last_peered":"2023-11-08T19:30:04.745074+0000","last_clean":"2023-11-08T19:30:04.745074+0000","last_became_active":"2023-11-08T19:25:46.284288+0000","last_became_peered":"2023-11-08T19:25:46.284288+0000","last_unstale":"2023-11-08T19:30:04.745074+0000","last_undegraded":"2023-11-08T19:30:04.745074+0000","last_fullsized":"2023-11-08T19:30:04.745074+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:57:53.083448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001250894,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":52,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.745027+0000","last_change":"2023-11-08T19:25:47.282612+0000","last_active":"2023-11-08T19:30:04.745027+0000","last_peered":"2023-11-08T19:30:04.745027+0000","last_clean":"2023-11-08T19:30:04.745027+0000","last_became_active":"2023-11-08T19:25:47.282299+0000","last_became_peered":"2023-11-08T19:25:47.282299+0000","last_unstale":"2023-11-08T19:30:04.745027+0000","last_undegraded":"2023-11-08T19:30:04.745027+0000","last_fullsized":"2023-11-08T19:30:04.745027+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:43:18.319773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":75,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.065897+0000","last_change":"2023-11-08T19:24:32.146639+0000","last_active":"2023-11-08T19:30:03.065897+0000","last_peered":"2023-11-08T19:30:03.065897+0000","last_clean":"2023-11-08T19:30:03.065897+0000","last_became_active":"2023-11-08T19:24:31.147384+0000","last_became_peered":"2023-11-08T19:24:31.147384+0000","last_unstale":"2023-11-08T19:30:03.065897+0000","last_undegraded":"2023-11-08T19:30:03.065897+0000","last_fullsized":"2023-11-08T19:30:03.065897+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:30:21.946303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043834899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":59,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.744165+0000","last_change":"2023-11-08T19:25:48.283541+0000","last_active":"2023-11-08T19:30:04.744165+0000","last_peered":"2023-11-08T19:30:04.744165+0000","last_clean":"2023-11-08T19:30:04.744165+0000","last_became_active":"2023-11-08T19:25:46.285626+0000","last_became_peered":"2023-11-08T19:25:46.285626+0000","last_unstale":"2023-11-08T19:30:04.744165+0000","last_undegraded":"2023-11-08T19:30:04.744165+0000","last_fullsized":"2023-11-08T19:30:04.744165+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:48:17.033319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019032459999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":52,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.743124+0000","last_change":"2023-11-08T19:25:47.287878+0000","last_active":"2023-11-08T19:30:04.743124+0000","last_peered":"2023-11-08T19:30:04.743124+0000","last_clean":"2023-11-08T19:30:04.743124+0000","last_became_active":"2023-11-08T19:25:47.287617+0000","last_became_peered":"2023-11-08T19:25:47.287617+0000","last_unstale":"2023-11-08T19:30:04.743124+0000","last_undegraded":"2023-11-08T19:30:04.743124+0000","last_fullsized":"2023-11-08T19:30:04.743124+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:20:50.791463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":87,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.744759+0000","last_change":"2023-11-08T19:24:32.142376+0000","last_active":"2023-11-08T19:30:04.744759+0000","last_peered":"2023-11-08T19:30:04.744759+0000","last_clean":"2023-11-08T19:30:04.744759+0000","last_became_active":"2023-11-08T19:24:31.144614+0000","last_became_peered":"2023-11-08T19:24:31.144614+0000","last_unstale":"2023-11-08T19:30:04.744759+0000","last_undegraded":"2023-11-08T19:30:04.744759+0000","last_fullsized":"2023-11-08T19:30:04.744759+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:09:04.880374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050362200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":53,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:02.735721+0000","last_change":"2023-11-08T19:25:48.373636+0000","last_active":"2023-11-08T19:30:02.735721+0000","last_peered":"2023-11-08T19:30:02.735721+0000","last_clean":"2023-11-08T19:30:02.735721+0000","last_became_active":"2023-11-08T19:25:46.283803+0000","last_became_peered":"2023-11-08T19:25:46.283803+0000","last_unstale":"2023-11-08T19:30:02.735721+0000","last_undegraded":"2023-11-08T19:30:02.735721+0000","last_fullsized":"2023-11-08T19:30:02.735721+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:00:34.691748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002404855,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":44,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.066383+0000","last_change":"2023-11-08T19:25:47.287741+0000","last_active":"2023-11-08T19:30:03.066383+0000","last_peered":"2023-11-08T19:30:03.066383+0000","last_clean":"2023-11-08T19:30:03.066383+0000","last_became_active":"2023-11-08T19:25:47.287428+0000","last_became_peered":"2023-11-08T19:25:47.287428+0000","last_unstale":"2023-11-08T19:30:03.066383+0000","last_undegraded":"2023-11-08T19:30:03.066383+0000","last_fullsized":"2023-11-08T19:30:03.066383+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:38:55.785104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":75,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.066583+0000","last_change":"2023-11-08T19:24:32.147235+0000","last_active":"2023-11-08T19:30:03.066583+0000","last_peered":"2023-11-08T19:30:03.066583+0000","last_clean":"2023-11-08T19:30:03.066583+0000","last_became_active":"2023-11-08T19:24:31.146176+0000","last_became_peered":"2023-11-08T19:24:31.146176+0000","last_unstale":"2023-11-08T19:30:03.066583+0000","last_undegraded":"2023-11-08T19:30:03.066583+0000","last_fullsized":"2023-11-08T19:30:03.066583+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:39.214888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048481000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":53,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:02.735676+0000","last_change":"2023-11-08T19:25:48.373345+0000","last_active":"2023-11-08T19:30:02.735676+0000","last_peered":"2023-11-08T19:30:02.735676+0000","last_clean":"2023-11-08T19:30:02.735676+0000","last_became_active":"2023-11-08T19:25:46.282460+0000","last_became_peered":"2023-11-08T19:25:46.282460+0000","last_unstale":"2023-11-08T19:30:02.735676+0000","last_undegraded":"2023-11-08T19:30:02.735676+0000","last_fullsized":"2023-11-08T19:30:02.735676+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:25:30.927920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001972863,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":53,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.744804+0000","last_change":"2023-11-08T19:25:47.283708+0000","last_active":"2023-11-08T19:30:04.744804+0000","last_peered":"2023-11-08T19:30:04.744804+0000","last_clean":"2023-11-08T19:30:04.744804+0000","last_became_active":"2023-11-08T19:25:47.283433+0000","last_became_peered":"2023-11-08T19:25:47.283433+0000","last_unstale":"2023-11-08T19:30:04.744804+0000","last_undegraded":"2023-11-08T19:30:04.744804+0000","last_fullsized":"2023-11-08T19:30:04.744804+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:30:17.627967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":76,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.066160+0000","last_change":"2023-11-08T19:24:32.543880+0000","last_active":"2023-11-08T19:30:03.066160+0000","last_peered":"2023-11-08T19:30:03.066160+0000","last_clean":"2023-11-08T19:30:03.066160+0000","last_became_active":"2023-11-08T19:24:31.142052+0000","last_became_peered":"2023-11-08T19:24:31.142052+0000","last_unstale":"2023-11-08T19:30:03.066160+0000","last_undegraded":"2023-11-08T19:30:03.066160+0000","last_fullsized":"2023-11-08T19:30:03.066160+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:18:42.371676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014881058000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":60,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.746318+0000","last_change":"2023-11-08T19:25:48.284890+0000","last_active":"2023-11-08T19:30:04.746318+0000","last_peered":"2023-11-08T19:30:04.746318+0000","last_clean":"2023-11-08T19:30:04.746318+0000","last_became_active":"2023-11-08T19:25:46.279287+0000","last_became_peered":"2023-11-08T19:25:46.279287+0000","last_unstale":"2023-11-08T19:30:04.746318+0000","last_undegraded":"2023-11-08T19:30:04.746318+0000","last_fullsized":"2023-11-08T19:30:04.746318+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:35:30.427172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076856899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":53,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.746191+0000","last_change":"2023-11-08T19:25:47.285867+0000","last_active":"2023-11-08T19:30:04.746191+0000","last_peered":"2023-11-08T19:30:04.746191+0000","last_clean":"2023-11-08T19:30:04.746191+0000","last_became_active":"2023-11-08T19:25:47.285533+0000","last_became_peered":"2023-11-08T19:25:47.285533+0000","last_unstale":"2023-11-08T19:30:04.746191+0000","last_undegraded":"2023-11-08T19:30:04.746191+0000","last_fullsized":"2023-11-08T19:30:04.746191+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:26:59.852338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":75,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.066493+0000","last_change":"2023-11-08T19:24:32.147011+0000","last_active":"2023-11-08T19:30:03.066493+0000","last_peered":"2023-11-08T19:30:03.066493+0000","last_clean":"2023-11-08T19:30:03.066493+0000","last_became_active":"2023-11-08T19:24:31.148250+0000","last_became_peered":"2023-11-08T19:24:31.148250+0000","last_unstale":"2023-11-08T19:30:03.066493+0000","last_undegraded":"2023-11-08T19:30:03.066493+0000","last_fullsized":"2023-11-08T19:30:03.066493+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:01:25.647952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043061299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":60,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.744846+0000","last_change":"2023-11-08T19:25:48.284869+0000","last_active":"2023-11-08T19:30:04.744846+0000","last_peered":"2023-11-08T19:30:04.744846+0000","last_clean":"2023-11-08T19:30:04.744846+0000","last_became_active":"2023-11-08T19:25:46.285478+0000","last_became_peered":"2023-11-08T19:25:46.285478+0000","last_unstale":"2023-11-08T19:30:04.744846+0000","last_undegraded":"2023-11-08T19:30:04.744846+0000","last_fullsized":"2023-11-08T19:30:04.744846+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:49:51.368808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000376339,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":44,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.065727+0000","last_change":"2023-11-08T19:25:47.284429+0000","last_active":"2023-11-08T19:30:03.065727+0000","last_peered":"2023-11-08T19:30:03.065727+0000","last_clean":"2023-11-08T19:30:03.065727+0000","last_became_active":"2023-11-08T19:25:47.283990+0000","last_became_peered":"2023-11-08T19:25:47.283990+0000","last_unstale":"2023-11-08T19:30:03.065727+0000","last_undegraded":"2023-11-08T19:30:03.065727+0000","last_fullsized":"2023-11-08T19:30:03.065727+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:59:08.628317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":87,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.744493+0000","last_change":"2023-11-08T19:24:32.141190+0000","last_active":"2023-11-08T19:30:04.744493+0000","last_peered":"2023-11-08T19:30:04.744493+0000","last_clean":"2023-11-08T19:30:04.744493+0000","last_became_active":"2023-11-08T19:24:31.147651+0000","last_became_peered":"2023-11-08T19:24:31.147651+0000","last_unstale":"2023-11-08T19:30:04.744493+0000","last_undegraded":"2023-11-08T19:30:04.744493+0000","last_fullsized":"2023-11-08T19:30:04.744493+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:21:55.985548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043673300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":54,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.292742+0000","last_change":"2023-11-08T19:25:48.320707+0000","last_active":"2023-11-08T19:30:05.292742+0000","last_peered":"2023-11-08T19:30:05.292742+0000","last_clean":"2023-11-08T19:30:05.292742+0000","last_became_active":"2023-11-08T19:25:46.282307+0000","last_became_peered":"2023-11-08T19:25:46.282307+0000","last_unstale":"2023-11-08T19:30:05.292742+0000","last_undegraded":"2023-11-08T19:30:05.292742+0000","last_fullsized":"2023-11-08T19:30:05.292742+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:53:36.476361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047078400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":44,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.066183+0000","last_change":"2023-11-08T19:25:47.284227+0000","last_active":"2023-11-08T19:30:03.066183+0000","last_peered":"2023-11-08T19:30:03.066183+0000","last_clean":"2023-11-08T19:30:03.066183+0000","last_became_active":"2023-11-08T19:25:47.283927+0000","last_became_peered":"2023-11-08T19:25:47.283927+0000","last_unstale":"2023-11-08T19:30:03.066183+0000","last_undegraded":"2023-11-08T19:30:03.066183+0000","last_fullsized":"2023-11-08T19:30:03.066183+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:15:23.188047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":76,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:02.735188+0000","last_change":"2023-11-08T19:24:32.530168+0000","last_active":"2023-11-08T19:30:02.735188+0000","last_peered":"2023-11-08T19:30:02.735188+0000","last_clean":"2023-11-08T19:30:02.735188+0000","last_became_active":"2023-11-08T19:24:31.144329+0000","last_became_peered":"2023-11-08T19:24:31.144329+0000","last_unstale":"2023-11-08T19:30:02.735188+0000","last_undegraded":"2023-11-08T19:30:02.735188+0000","last_fullsized":"2023-11-08T19:30:02.735188+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:05:36.085920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043484799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":53,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:02.734880+0000","last_change":"2023-11-08T19:25:48.371291+0000","last_active":"2023-11-08T19:30:02.734880+0000","last_peered":"2023-11-08T19:30:02.734880+0000","last_clean":"2023-11-08T19:30:02.734880+0000","last_became_active":"2023-11-08T19:25:46.281425+0000","last_became_peered":"2023-11-08T19:25:46.281425+0000","last_unstale":"2023-11-08T19:30:02.734880+0000","last_undegraded":"2023-11-08T19:30:02.734880+0000","last_fullsized":"2023-11-08T19:30:02.734880+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:23:12.422712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00124314,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":46,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:02.735040+0000","last_change":"2023-11-08T19:25:47.281724+0000","last_active":"2023-11-08T19:30:02.735040+0000","last_peered":"2023-11-08T19:30:02.735040+0000","last_clean":"2023-11-08T19:30:02.735040+0000","last_became_active":"2023-11-08T19:25:47.281425+0000","last_became_peered":"2023-11-08T19:25:47.281425+0000","last_unstale":"2023-11-08T19:30:02.735040+0000","last_undegraded":"2023-11-08T19:30:02.735040+0000","last_fullsized":"2023-11-08T19:30:02.735040+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:38:55.785104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":76,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:02.734938+0000","last_change":"2023-11-08T19:24:32.529486+0000","last_active":"2023-11-08T19:30:02.734938+0000","last_peered":"2023-11-08T19:30:02.734938+0000","last_clean":"2023-11-08T19:30:02.734938+0000","last_became_active":"2023-11-08T19:24:31.146260+0000","last_became_peered":"2023-11-08T19:24:31.146260+0000","last_unstale":"2023-11-08T19:30:02.734938+0000","last_undegraded":"2023-11-08T19:30:02.734938+0000","last_fullsized":"2023-11-08T19:30:02.734938+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:45:34.425432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059842900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":51,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.066586+0000","last_change":"2023-11-08T19:25:48.277457+0000","last_active":"2023-11-08T19:30:03.066586+0000","last_peered":"2023-11-08T19:30:03.066586+0000","last_clean":"2023-11-08T19:30:03.066586+0000","last_became_active":"2023-11-08T19:25:46.286239+0000","last_became_peered":"2023-11-08T19:25:46.286239+0000","last_unstale":"2023-11-08T19:30:03.066586+0000","last_undegraded":"2023-11-08T19:30:03.066586+0000","last_fullsized":"2023-11-08T19:30:03.066586+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:09:43.662108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000722421,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":44,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.066108+0000","last_change":"2023-11-08T19:25:47.287874+0000","last_active":"2023-11-08T19:30:03.066108+0000","last_peered":"2023-11-08T19:30:03.066108+0000","last_clean":"2023-11-08T19:30:03.066108+0000","last_became_active":"2023-11-08T19:25:47.287456+0000","last_became_peered":"2023-11-08T19:25:47.287456+0000","last_unstale":"2023-11-08T19:30:03.066108+0000","last_undegraded":"2023-11-08T19:30:03.066108+0000","last_fullsized":"2023-11-08T19:30:03.066108+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:26:59.852338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":86,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.744037+0000","last_change":"2023-11-08T19:24:32.141131+0000","last_active":"2023-11-08T19:30:04.744037+0000","last_peered":"2023-11-08T19:30:04.744037+0000","last_clean":"2023-11-08T19:30:04.744037+0000","last_became_active":"2023-11-08T19:24:31.146154+0000","last_became_peered":"2023-11-08T19:24:31.146154+0000","last_unstale":"2023-11-08T19:30:04.744037+0000","last_undegraded":"2023-11-08T19:30:04.744037+0000","last_fullsized":"2023-11-08T19:30:04.744037+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:18:40.271560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082432800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":52,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.065997+0000","last_change":"2023-11-08T19:25:48.372729+0000","last_active":"2023-11-08T19:30:03.065997+0000","last_peered":"2023-11-08T19:30:03.065997+0000","last_clean":"2023-11-08T19:30:03.065997+0000","last_became_active":"2023-11-08T19:25:46.290114+0000","last_became_peered":"2023-11-08T19:25:46.290114+0000","last_unstale":"2023-11-08T19:30:03.065997+0000","last_undegraded":"2023-11-08T19:30:03.065997+0000","last_fullsized":"2023-11-08T19:30:03.065997+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:49:36.208776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061009499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":46,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:02.735668+0000","last_change":"2023-11-08T19:25:47.283046+0000","last_active":"2023-11-08T19:30:02.735668+0000","last_peered":"2023-11-08T19:30:02.735668+0000","last_clean":"2023-11-08T19:30:02.735668+0000","last_became_active":"2023-11-08T19:25:47.282763+0000","last_became_peered":"2023-11-08T19:25:47.282763+0000","last_unstale":"2023-11-08T19:30:02.735668+0000","last_undegraded":"2023-11-08T19:30:02.735668+0000","last_fullsized":"2023-11-08T19:30:02.735668+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:12:51.389167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":76,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.066157+0000","last_change":"2023-11-08T19:24:32.263963+0000","last_active":"2023-11-08T19:30:03.066157+0000","last_peered":"2023-11-08T19:30:03.066157+0000","last_clean":"2023-11-08T19:30:03.066157+0000","last_became_active":"2023-11-08T19:24:31.139062+0000","last_became_peered":"2023-11-08T19:24:31.139062+0000","last_unstale":"2023-11-08T19:30:03.066157+0000","last_undegraded":"2023-11-08T19:30:03.066157+0000","last_fullsized":"2023-11-08T19:30:03.066157+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:26.080042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033682599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":59,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.746216+0000","last_change":"2023-11-08T19:25:48.283302+0000","last_active":"2023-11-08T19:30:04.746216+0000","last_peered":"2023-11-08T19:30:04.746216+0000","last_clean":"2023-11-08T19:30:04.746216+0000","last_became_active":"2023-11-08T19:25:46.284287+0000","last_became_peered":"2023-11-08T19:25:46.284287+0000","last_unstale":"2023-11-08T19:30:04.746216+0000","last_undegraded":"2023-11-08T19:30:04.746216+0000","last_fullsized":"2023-11-08T19:30:04.746216+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:39:27.217802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097880800000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":52,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.743835+0000","last_change":"2023-11-08T19:25:47.286434+0000","last_active":"2023-11-08T19:30:04.743835+0000","last_peered":"2023-11-08T19:30:04.743835+0000","last_clean":"2023-11-08T19:30:04.743835+0000","last_became_active":"2023-11-08T19:25:47.286181+0000","last_became_peered":"2023-11-08T19:25:47.286181+0000","last_unstale":"2023-11-08T19:30:04.743835+0000","last_undegraded":"2023-11-08T19:30:04.743835+0000","last_fullsized":"2023-11-08T19:30:04.743835+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:13:27.285648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":86,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.746426+0000","last_change":"2023-11-08T19:24:32.140514+0000","last_active":"2023-11-08T19:30:04.746426+0000","last_peered":"2023-11-08T19:30:04.746426+0000","last_clean":"2023-11-08T19:30:04.746426+0000","last_became_active":"2023-11-08T19:24:31.146668+0000","last_became_peered":"2023-11-08T19:24:31.146668+0000","last_unstale":"2023-11-08T19:30:04.746426+0000","last_undegraded":"2023-11-08T19:30:04.746426+0000","last_fullsized":"2023-11-08T19:30:04.746426+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:31:24.539374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071576699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":54,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.292979+0000","last_change":"2023-11-08T19:25:48.320667+0000","last_active":"2023-11-08T19:30:05.292979+0000","last_peered":"2023-11-08T19:30:05.292979+0000","last_clean":"2023-11-08T19:30:05.292979+0000","last_became_active":"2023-11-08T19:25:46.290246+0000","last_became_peered":"2023-11-08T19:25:46.290246+0000","last_unstale":"2023-11-08T19:30:05.292979+0000","last_undegraded":"2023-11-08T19:30:05.292979+0000","last_fullsized":"2023-11-08T19:30:05.292979+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:33:35.492889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000423211,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":45,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.066689+0000","last_change":"2023-11-08T19:25:47.287717+0000","last_active":"2023-11-08T19:30:03.066689+0000","last_peered":"2023-11-08T19:30:03.066689+0000","last_clean":"2023-11-08T19:30:03.066689+0000","last_became_active":"2023-11-08T19:25:47.287412+0000","last_became_peered":"2023-11-08T19:25:47.287412+0000","last_unstale":"2023-11-08T19:30:03.066689+0000","last_undegraded":"2023-11-08T19:30:03.066689+0000","last_fullsized":"2023-11-08T19:30:03.066689+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:18:04.478139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":78,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.293087+0000","last_change":"2023-11-08T19:24:32.142892+0000","last_active":"2023-11-08T19:30:05.293087+0000","last_peered":"2023-11-08T19:30:05.293087+0000","last_clean":"2023-11-08T19:30:05.293087+0000","last_became_active":"2023-11-08T19:24:31.144912+0000","last_became_peered":"2023-11-08T19:24:31.144912+0000","last_unstale":"2023-11-08T19:30:05.293087+0000","last_undegraded":"2023-11-08T19:30:05.293087+0000","last_fullsized":"2023-11-08T19:30:05.293087+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:04:21.151484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056686900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":59,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.746370+0000","last_change":"2023-11-08T19:25:48.285205+0000","last_active":"2023-11-08T19:30:04.746370+0000","last_peered":"2023-11-08T19:30:04.746370+0000","last_clean":"2023-11-08T19:30:04.746370+0000","last_became_active":"2023-11-08T19:25:46.285848+0000","last_became_peered":"2023-11-08T19:25:46.285848+0000","last_unstale":"2023-11-08T19:30:04.746370+0000","last_undegraded":"2023-11-08T19:30:04.746370+0000","last_fullsized":"2023-11-08T19:30:04.746370+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:07:10.832480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089732199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":47,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.293661+0000","last_change":"2023-11-08T19:25:47.280177+0000","last_active":"2023-11-08T19:30:05.293661+0000","last_peered":"2023-11-08T19:30:05.293661+0000","last_clean":"2023-11-08T19:30:05.293661+0000","last_became_active":"2023-11-08T19:25:47.279913+0000","last_became_peered":"2023-11-08T19:25:47.279913+0000","last_unstale":"2023-11-08T19:30:05.293661+0000","last_undegraded":"2023-11-08T19:30:05.293661+0000","last_fullsized":"2023-11-08T19:30:05.293661+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:26:02.147090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":76,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.067058+0000","last_change":"2023-11-08T19:24:32.263958+0000","last_active":"2023-11-08T19:30:03.067058+0000","last_peered":"2023-11-08T19:30:03.067058+0000","last_clean":"2023-11-08T19:30:03.067058+0000","last_became_active":"2023-11-08T19:24:31.149011+0000","last_became_peered":"2023-11-08T19:24:31.149011+0000","last_unstale":"2023-11-08T19:30:03.067058+0000","last_undegraded":"2023-11-08T19:30:03.067058+0000","last_fullsized":"2023-11-08T19:30:03.067058+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:09:04.880374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033496900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":59,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.746345+0000","last_change":"2023-11-08T19:25:48.285075+0000","last_active":"2023-11-08T19:30:04.746345+0000","last_peered":"2023-11-08T19:30:04.746345+0000","last_clean":"2023-11-08T19:30:04.746345+0000","last_became_active":"2023-11-08T19:25:46.272479+0000","last_became_peered":"2023-11-08T19:25:46.272479+0000","last_unstale":"2023-11-08T19:30:04.746345+0000","last_undegraded":"2023-11-08T19:30:04.746345+0000","last_fullsized":"2023-11-08T19:30:04.746345+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:23:12.422712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001158117,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574938,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28920,"kb_used_data":1900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342920,"statfs":{"total":96636764160,"available":96607150080,"internally_reserved":0,"allocated":1945600,"data_stored":1278562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:29:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.57599999999999996,"15min":0.54600000000000004},"min":{"1min":0.33800000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.75800000000000001,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58499999999999996,"15min":0.56899999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.377},"max":{"1min":0.747,"5min":0.75900000000000001,"15min":0.86699999999999999},"last":0.42899999999999999}]},{"osd":1,"last update":"Wed Nov 8 19:29:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55000000000000004,"15min":0.54800000000000004},"min":{"1min":0.36599999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.78500000000000003,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.502},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.55100000000000005,"15min":0.53600000000000003},"min":{"1min":0.42199999999999999,"5min":0.39200000000000002,"15min":0.37},"max":{"1min":0.78400000000000003,"5min":0.78900000000000003,"15min":0.79800000000000004},"last":0.47799999999999998}]},{"osd":2,"last update":"Wed Nov 8 19:29:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54000000000000004,"15min":0.51700000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.82599999999999996},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.55400000000000005,"15min":0.54100000000000004},"min":{"1min":0.38500000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76800000000000002,"5min":0.77800000000000002,"15min":0.81599999999999995},"last":0.56200000000000006}]},{"osd":3,"last update":"Wed Nov 8 19:29:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54100000000000004,"15min":0.53500000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.72699999999999998,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.746},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.59099999999999997,"15min":0.56699999999999995},"min":{"1min":0.45600000000000002,"5min":0.42399999999999999,"15min":0.36899999999999999},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.38400000000000001}]},{"osd":4,"last update":"Wed Nov 8 19:29:11 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.49399999999999999,"15min":0.48499999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.64700000000000002,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.497,"5min":0.51500000000000001,"15min":0.51700000000000002},"min":{"1min":0.35299999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.71499999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.83799999999999997}]},{"osd":5,"last update":"Wed Nov 8 19:29:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56200000000000006,"15min":0.54900000000000004},"min":{"1min":0.38400000000000001,"5min":0.35399999999999998,"15min":0.35099999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56899999999999995,"15min":0.57299999999999995},"min":{"1min":0.40400000000000003,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.76200000000000001,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.58799999999999997}]},{"osd":6,"last update":"Wed Nov 8 19:29:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59999999999999998,"15min":0.60799999999999998},"min":{"1min":0.40000000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.76100000000000001,"5min":0.82299999999999995,"15min":0.86399999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.58199999999999996,"15min":0.56699999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.874,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.79300000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574939,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28368,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343472,"statfs":{"total":96636764160,"available":96607715328,"internally_reserved":0,"allocated":1376256,"data_stored":703350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.53400000000000003,"15min":0.58399999999999996},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.81399999999999995,"5min":0.82199999999999995,"15min":1.7549999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.54300000000000004,"15min":0.58099999999999996},"min":{"1min":0.36599999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.76800000000000002,"5min":0.78800000000000003,"15min":1.478},"last":0.746}]},{"osd":1,"last update":"Wed Nov 8 19:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57699999999999996,"15min":0.59899999999999998},"min":{"1min":0.317,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.73699999999999999,"5min":0.80600000000000005,"15min":1.6619999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.622,"15min":0.65600000000000003},"min":{"1min":0.41799999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.77500000000000002,"5min":0.81699999999999995,"15min":1.649},"last":0.80900000000000005}]},{"osd":2,"last update":"Wed Nov 8 19:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.58499999999999996,"15min":0.56699999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76900000000000002,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.59499999999999997,"15min":0.623},"min":{"1min":0.40600000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.68999999999999995,"5min":0.77400000000000002,"15min":0.85399999999999998},"last":0.82599999999999996}]},{"osd":3,"last update":"Wed Nov 8 19:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55800000000000005,"15min":0.61399999999999999},"min":{"1min":0.38,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.68200000000000005,"5min":0.80300000000000005,"15min":1.766},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55400000000000005,"15min":0.60599999999999998},"min":{"1min":0.375,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73699999999999999,"5min":0.877,"15min":1.8580000000000001},"last":0.65400000000000003}]},{"osd":4,"last update":"Wed Nov 8 19:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.51800000000000002,"15min":0.53600000000000003},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.66600000000000004,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.755},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54500000000000004,"15min":0.57099999999999995},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.83499999999999996,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.56000000000000005}]},{"osd":5,"last update":"Wed Nov 8 19:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.52900000000000003,"15min":0.55900000000000005},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.79100000000000004,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57299999999999995,"15min":0.61899999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.72699999999999998,"5min":0.80200000000000005,"15min":0.82099999999999995},"last":0.89600000000000002}]},{"osd":7,"last update":"Wed Nov 8 19:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58299999999999996,"15min":0.60499999999999998},"min":{"1min":0.33400000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.873,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58899999999999997,"15min":0.63100000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.81299999999999994,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.83999999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28384,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343456,"statfs":{"total":96636764160,"available":96607698944,"internally_reserved":0,"allocated":1396736,"data_stored":714320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:30:02 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.35799999999999998},"min":{"1min":0.247,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.46899999999999997,"5min":0.51200000000000001,"15min":1.2090000000000001},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.376,"5min":0.35899999999999999,"15min":0.39700000000000002},"min":{"1min":0.23599999999999999,"5min":0.22900000000000001,"15min":0.19700000000000001},"max":{"1min":0.49299999999999999,"5min":0.61599999999999999,"15min":2.1850000000000001},"last":0.314}]},{"osd":2,"last update":"Wed Nov 8 19:30:02 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.35099999999999998,"15min":0.34799999999999998},"min":{"1min":0.26400000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.438,"5min":0.54400000000000004,"15min":0.59099999999999997},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.38700000000000001,"15min":0.39400000000000002},"min":{"1min":0.28299999999999997,"5min":0.253,"15min":0.24099999999999999},"max":{"1min":0.56000000000000005,"5min":0.623,"15min":1.2689999999999999},"last":0.252}]},{"osd":3,"last update":"Wed Nov 8 19:30:02 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.41199999999999998,"15min":0.41799999999999998},"min":{"1min":0.32400000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.622,"5min":0.63100000000000001,"15min":1.24},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.39900000000000002,"15min":0.44400000000000001},"min":{"1min":0.30599999999999999,"5min":0.26100000000000001,"15min":0.253},"max":{"1min":0.54500000000000004,"5min":0.68200000000000005,"15min":2.2120000000000002},"last":0.35399999999999998}]},{"osd":4,"last update":"Wed Nov 8 19:30:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.59299999999999997,"15min":0.60799999999999998},"min":{"1min":0.42399999999999999,"5min":0.36899999999999999,"15min":0.32100000000000001},"max":{"1min":0.82299999999999995,"5min":0.93400000000000005,"15min":2.1579999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.58899999999999997,"15min":0.57399999999999995},"min":{"1min":0.438,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.78200000000000003,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.45900000000000002}]},{"osd":5,"last update":"Wed Nov 8 19:30:02 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.59499999999999997,"15min":0.57099999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.38100000000000001},"max":{"1min":0.78300000000000003,"5min":0.82599999999999996,"15min":0.86399999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59599999999999997,"15min":0.60499999999999998},"min":{"1min":0.437,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77300000000000002,"5min":0.90800000000000003,"15min":1.115},"last":0.52700000000000002}]},{"osd":6,"last update":"Wed Nov 8 19:30:02 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.60099999999999998,"15min":0.628},"min":{"1min":0.40500000000000003,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.76800000000000002,"5min":0.88400000000000001,"15min":2.093},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.435,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.752,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.51200000000000001}]},{"osd":7,"last update":"Wed Nov 8 19:30:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.621,"15min":0.65700000000000003},"min":{"1min":0.44600000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.80300000000000005,"5min":0.876,"15min":1.591},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61099999999999999,"15min":0.66800000000000004},"min":{"1min":0.49299999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.77900000000000003,"5min":0.88400000000000001,"15min":2.1299999999999999},"last":0.44400000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574938,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33088,"kb_used_data":1908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338752,"statfs":{"total":96636764160,"available":96602882048,"internally_reserved":0,"allocated":1953792,"data_stored":1286063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:29:09 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.41099999999999998,"15min":0.96199999999999997},"min":{"1min":0.19500000000000001,"5min":0.192,"15min":0.192},"max":{"1min":0.56399999999999995,"5min":6.9509999999999996,"15min":19.295999999999999},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.371,"15min":0.874},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.55500000000000005,"5min":0.57399999999999995,"15min":17.204000000000001},"last":0.41799999999999998}]},{"osd":2,"last update":"Wed Nov 8 19:29:09 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.44500000000000001,"15min":0.58499999999999996},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.64100000000000001,"5min":6.8029999999999999,"15min":6.8029999999999999},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.40699999999999997,"15min":0.91500000000000004},"min":{"1min":0.28999999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.53900000000000003,"5min":1.3140000000000001,"15min":17.175000000000001},"last":0.32200000000000001}]},{"osd":3,"last update":"Wed Nov 8 19:29:09 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.52900000000000003,"15min":0.83799999999999997},"min":{"1min":0.27300000000000002,"5min":0.24399999999999999,"15min":0.22500000000000001},"max":{"1min":0.51400000000000001,"5min":16.661000000000001,"15min":16.661000000000001},"last":0.37},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.48799999999999999,"15min":0.43099999999999999},"min":{"1min":0.29899999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.73699999999999999,"5min":6.9859999999999998,"15min":6.9859999999999998},"last":0.47099999999999997}]},{"osd":4,"last update":"Wed Nov 8 19:29:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.60899999999999999,"15min":1.0720000000000001},"min":{"1min":0.373,"5min":0.313,"15min":0.313},"max":{"1min":0.72999999999999998,"5min":1.0029999999999999,"15min":17.056000000000001},"last":0.746},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.753,"15min":0.76100000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33000000000000002},"max":{"1min":0.72499999999999998,"5min":16.718,"15min":16.718},"last":0.56100000000000005}]},{"osd":5,"last update":"Wed Nov 8 19:29:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.746,"15min":0.76200000000000001},"min":{"1min":0.36199999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72899999999999998,"5min":16.609000000000002,"15min":16.609000000000002},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.65900000000000003,"15min":0.59499999999999997},"min":{"1min":0.40100000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77100000000000002,"5min":5.1639999999999997,"15min":5.1639999999999997},"last":0.58399999999999996}]},{"osd":6,"last update":"Wed Nov 8 19:29:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.68700000000000006,"15min":0.63300000000000001},"min":{"1min":0.45900000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.80600000000000005,"5min":6.6349999999999998,"15min":6.6349999999999998},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.65300000000000002,"15min":1.1220000000000001},"min":{"1min":0.42199999999999999,"5min":0.35499999999999998,"15min":0.34899999999999998},"max":{"1min":0.81599999999999995,"5min":3.1400000000000001,"15min":17.111999999999998},"last":0.70899999999999996}]},{"osd":7,"last update":"Wed Nov 8 19:29:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63900000000000001,"15min":1.127},"min":{"1min":0.49299999999999999,"5min":0.376,"15min":0.376},"max":{"1min":0.79300000000000004,"5min":1.0760000000000001,"15min":17.146000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.76000000000000001,"15min":0.77300000000000002},"min":{"1min":0.441,"5min":0.40899999999999997,"15min":0.38800000000000001},"max":{"1min":0.76900000000000002,"5min":16.690999999999999,"15min":16.690999999999999},"last":0.59699999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574938,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28348,"kb_used_data":1328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343492,"statfs":{"total":96636764160,"available":96607735808,"internally_reserved":0,"allocated":1359872,"data_stored":695695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.33900000000000002,"15min":0.44400000000000001},"min":{"1min":0.22500000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.54300000000000004,"5min":0.61299999999999999,"15min":3.4100000000000001},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.38600000000000001,"15min":0.48299999999999998},"min":{"1min":0.28199999999999997,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":1.8340000000000001,"5min":1.8340000000000001,"15min":3.4369999999999998},"last":0.22}]},{"osd":1,"last update":"Wed Nov 8 19:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.38,"15min":0.51200000000000001},"min":{"1min":0.26400000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":4.0679999999999996},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.442,"15min":0.56200000000000006},"min":{"1min":0.309,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.68000000000000005,"5min":0.72099999999999997,"15min":4.3499999999999996},"last":0.34499999999999997}]},{"osd":3,"last update":"Wed Nov 8 19:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.40799999999999997,"15min":0.50800000000000001},"min":{"1min":0.247,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.57199999999999995,"5min":0.82999999999999996,"15min":3.8580000000000001},"last":0.317},{"interface":"front","average":{"1min":0.436,"5min":0.378,"15min":0.48399999999999999},"min":{"1min":0.30299999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":3.476},"last":0.248}]},{"osd":4,"last update":"Wed Nov 8 19:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.65300000000000002,"15min":0.70599999999999996},"min":{"1min":0.40899999999999997,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":4.7990000000000004,"5min":4.7990000000000004,"15min":4.7990000000000004},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.629,"5min":0.58999999999999997,"15min":0.70099999999999996},"min":{"1min":0.48199999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.76300000000000001,"5min":0.92300000000000004,"15min":4.1040000000000001},"last":0.41999999999999998}]},{"osd":5,"last update":"Wed Nov 8 19:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.60099999999999998,"15min":0.71199999999999997},"min":{"1min":0.41199999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.875,"5min":0.88,"15min":4.0869999999999997},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.64500000000000002,"15min":0.72899999999999998},"min":{"1min":0.42899999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":4.8239999999999998,"5min":4.8239999999999998,"15min":4.8239999999999998},"last":0.48099999999999998}]},{"osd":6,"last update":"Wed Nov 8 19:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.61099999999999999,"15min":0.72699999999999998},"min":{"1min":0.48099999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.83999999999999997,"5min":1.1200000000000001,"15min":4.1399999999999997},"last":0.433},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.60099999999999998,"15min":0.70499999999999996},"min":{"1min":0.42099999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.82099999999999995,"5min":0.85599999999999998,"15min":4.0499999999999998},"last":0.38}]},{"osd":7,"last update":"Wed Nov 8 19:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.64300000000000002,"15min":0.73999999999999999},"min":{"1min":0.46400000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.82499999999999996,"5min":1.181,"15min":4.157},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.65700000000000003,"15min":0.76700000000000002},"min":{"1min":0.55700000000000005,"5min":0.433,"15min":0.433},"max":{"1min":0.78500000000000003,"5min":1.222,"15min":4.1710000000000003},"last":0.45300000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574938,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28352,"kb_used_data":1328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343488,"statfs":{"total":96636764160,"available":96607731712,"internally_reserved":0,"allocated":1359872,"data_stored":695695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:29:04 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.373,"15min":0.38300000000000001},"min":{"1min":0.217,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":1.458},"last":0.373},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.38500000000000001,"15min":0.39700000000000002},"min":{"1min":0.29699999999999999,"5min":0.192,"15min":0.192},"max":{"1min":0.56100000000000005,"5min":0.626,"15min":1.3939999999999999},"last":0.35699999999999998}]},{"osd":1,"last update":"Wed Nov 8 19:29:04 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.39700000000000002,"15min":0.40899999999999997},"min":{"1min":0.28899999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.55800000000000005,"5min":0.747,"15min":1.512},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.41499999999999998,"15min":0.44},"min":{"1min":0.32300000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":1.5580000000000001},"last":0.39300000000000002}]},{"osd":2,"last update":"Wed Nov 8 19:29:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.375,"15min":0.377},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.2030000000000001},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.40600000000000003,"15min":0.42199999999999999},"min":{"1min":0.27400000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":1.536},"last":0.314}]},{"osd":4,"last update":"Wed Nov 8 19:29:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.60499999999999998,"15min":0.61899999999999999},"min":{"1min":0.441,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":1.3400000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.624,"15min":0.61499999999999999},"min":{"1min":0.41299999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.82899999999999996,"5min":0.84999999999999998,"15min":1.153},"last":0.57999999999999996}]},{"osd":5,"last update":"Wed Nov 8 19:29:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.58699999999999997,"15min":0.58999999999999997},"min":{"1min":0.438,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.84999999999999998,"5min":0.86499999999999999,"15min":1.4870000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.57799999999999996,"15min":0.59999999999999998},"min":{"1min":0.39900000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.80200000000000005,"5min":0.82799999999999996,"15min":1.3129999999999999},"last":0.59399999999999997}]},{"osd":6,"last update":"Wed Nov 8 19:29:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57499999999999996,"15min":0.57999999999999996},"min":{"1min":0.38700000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":1.113},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60299999999999998,"15min":0.61099999999999999},"min":{"1min":0.439,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":1.4139999999999999},"last":0.51900000000000002}]},{"osd":7,"last update":"Wed Nov 8 19:29:04 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61299999999999999,"15min":0.63900000000000001},"min":{"1min":0.41799999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":1.3680000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.63900000000000001,"15min":0.624},"min":{"1min":0.46899999999999997,"5min":0.45700000000000002,"15min":0.42299999999999999},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":1.179},"last":0.54200000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574938,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28368,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343472,"statfs":{"total":96636764160,"available":96607715328,"internally_reserved":0,"allocated":1376256,"data_stored":703350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:29:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.56599999999999995,"15min":0.54500000000000004},"min":{"1min":0.34999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.72899999999999998,"5min":0.80100000000000005,"15min":1.399},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55200000000000005,"15min":0.58399999999999996},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.69999999999999996,"5min":0.89500000000000002,"15min":2.2090000000000001},"last":0.439}]},{"osd":1,"last update":"Wed Nov 8 19:29:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.54400000000000004,"15min":0.52100000000000002},"min":{"1min":0.45100000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.73699999999999999,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.52900000000000003,"15min":0.50600000000000001},"min":{"1min":0.36799999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.54800000000000004}]},{"osd":2,"last update":"Wed Nov 8 19:29:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.57799999999999996,"15min":0.622},"min":{"1min":0.44700000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.78200000000000003,"5min":0.80800000000000005,"15min":2.8490000000000002},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56799999999999995,"15min":0.53400000000000003},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.78500000000000003,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.72099999999999997}]},{"osd":3,"last update":"Wed Nov 8 19:29:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.60999999999999999,"15min":0.57699999999999996},"min":{"1min":0.39500000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.73799999999999999,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.749},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63200000000000001,"15min":0.70099999999999996},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.79300000000000004,"5min":0.86199999999999999,"15min":3.4849999999999999},"last":0.66600000000000004}]},{"osd":5,"last update":"Wed Nov 8 19:29:05 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.48799999999999999,"15min":0.51000000000000001},"min":{"1min":0.314,"5min":0.313,"15min":0.313},"max":{"1min":0.61599999999999999,"5min":0.746,"15min":0.91500000000000004},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.36799999999999999,"5min":0.36299999999999999,"15min":0.32300000000000001},"max":{"1min":0.58099999999999996,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.68000000000000005}]},{"osd":6,"last update":"Wed Nov 8 19:29:05 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.54300000000000004,"15min":0.67100000000000004},"min":{"1min":0.36499999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.621,"5min":0.83199999999999996,"15min":4.1529999999999996},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.58499999999999996,"15min":0.60299999999999998},"min":{"1min":0.41399999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.69799999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.77200000000000002}]},{"osd":7,"last update":"Wed Nov 8 19:29:05 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.55500000000000005,"15min":0.56499999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.34499999999999997},"max":{"1min":0.66100000000000003,"5min":0.80500000000000005,"15min":0.99399999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.65100000000000002,"15min":0.80100000000000005},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.79400000000000004,"5min":0.87,"15min":5.5359999999999996},"last":0.69699999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574938,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28348,"kb_used_data":1328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343492,"statfs":{"total":96636764160,"available":96607735808,"internally_reserved":0,"allocated":1359872,"data_stored":695695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.52500000000000002,"15min":0.54300000000000004},"min":{"1min":0.36799999999999999,"5min":0.30399999999999999,"15min":0.26000000000000001},"max":{"1min":0.71099999999999997,"5min":0.78100000000000003,"15min":2.2360000000000002},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.55200000000000005,"15min":0.52800000000000002},"min":{"1min":0.38900000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.878},"last":0.53700000000000003}]},{"osd":1,"last update":"Wed Nov 8 19:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.58799999999999997,"15min":0.55800000000000005},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.27600000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.85999999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56799999999999995,"15min":0.59799999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":2.2919999999999998},"last":0.48699999999999999}]},{"osd":2,"last update":"Wed Nov 8 19:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56499999999999995,"15min":0.55900000000000005},"min":{"1min":0.33800000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.73699999999999999,"5min":0.82299999999999995,"15min":0.83399999999999996},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.55900000000000005,"15min":0.53700000000000003},"min":{"1min":0.45000000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.69799999999999995,"5min":0.79100000000000004,"15min":0.81599999999999995},"last":0.747}]},{"osd":3,"last update":"Wed Nov 8 19:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57199999999999995,"15min":0.56100000000000005},"min":{"1min":0.36699999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73299999999999998,"5min":0.745,"15min":0.76900000000000002},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58899999999999997,"15min":0.57699999999999996},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.34399999999999997},"max":{"1min":0.71399999999999997,"5min":0.83699999999999997,"15min":0.89900000000000002},"last":0.64800000000000002}]},{"osd":4,"last update":"Wed Nov 8 19:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.495,"15min":0.57299999999999995},"min":{"1min":0.29999999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.68600000000000005,"5min":0.81200000000000006,"15min":2.3300000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.60699999999999998,"15min":0.625},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.77000000000000002,"5min":0.81999999999999995,"15min":0.92300000000000004},"last":0.61799999999999999}]},{"osd":6,"last update":"Wed Nov 8 19:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.53300000000000003,"15min":0.56299999999999994},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76300000000000001,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.54900000000000004,"15min":0.63700000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.72999999999999998,"5min":0.80500000000000005,"15min":2.3650000000000002},"last":0.66400000000000003}]},{"osd":7,"last update":"Wed Nov 8 19:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.58199999999999996,"15min":0.61499999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.88500000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.59999999999999998,"15min":0.63400000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.79000000000000004,"5min":0.871,"15min":0.873},"last":0.72399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:30:08.245 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:30:08.398 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.397+0000 7f3b289d9700 1 Processor -- start 2023-11-08T19:30:08.399 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.397+0000 7f3b289d9700 1 -- start start 2023-11-08T19:30:08.401 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.398+0000 7f3b289d9700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3b2415db70 0x7f3b24161dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:08.402 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.398+0000 7f3b289d9700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b24161940 con 0x7f3b2406ab80 2023-11-08T19:30:08.402 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.398+0000 7f3b289d9700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b2415e660 con 0x7f3b240b2c00 2023-11-08T19:30:08.402 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.398+0000 7f3b289d9700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b2415eeb0 con 0x7f3b2415db70 2023-11-08T19:30:08.403 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.398+0000 7f3b2259c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3b2415db70 0x7f3b24161dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:08.403 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.399+0000 7f3b2259c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3b2415db70 0x7f3b24161dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45892/0 (socket says 172.21.15.149:45892) 2023-11-08T19:30:08.403 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.399+0000 7f3b2259c700 1 -- 172.21.15.149:0/3722498524 learned_addr learned my addr 172.21.15.149:0/3722498524 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:30:08.403 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.399+0000 7f3b22d9d700 1 --1- 172.21.15.149:0/3722498524 >> v1:172.21.15.149:6789/0 conn(0x7f3b2406ab80 0x7f3b24071dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:47896/0 (socket says 172.21.15.149:47896) 2023-11-08T19:30:08.404 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.399+0000 7f3b2259c700 1 -- 172.21.15.149:0/3722498524 >> v1:172.21.15.160:6789/0 conn(0x7f3b240b2c00 legacy=0x7f3b2415df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:08.404 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.399+0000 7f3b2259c700 1 -- 172.21.15.149:0/3722498524 >> v1:172.21.15.149:6789/0 conn(0x7f3b2406ab80 legacy=0x7f3b24071dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:08.404 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.399+0000 7f3b2259c700 1 -- 172.21.15.149:0/3722498524 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b2415e8f0 con 0x7f3b2415db70 2023-11-08T19:30:08.405 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.399+0000 7f3b2259c700 1 --2- 172.21.15.149:0/3722498524 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b2415db70 0x7f3b24161dd0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f3b180098f0 tx=0x7f3b18009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e82f60f15c5118f6 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:08.405 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.399+0000 7f3b2159a700 1 -- 172.21.15.149:0/3722498524 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1800b8a0 con 0x7f3b2415db70 2023-11-08T19:30:08.405 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.399+0000 7f3b2159a700 1 -- 172.21.15.149:0/3722498524 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b1800ba00 con 0x7f3b2415db70 2023-11-08T19:30:08.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.399+0000 7f3b2159a700 1 -- 172.21.15.149:0/3722498524 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1800bd90 con 0x7f3b2415db70 2023-11-08T19:30:08.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.400+0000 7f3b289d9700 1 -- 172.21.15.149:0/3722498524 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b2415db70 msgr2=0x7f3b24161dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:08.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.400+0000 7f3b289d9700 1 --2- 172.21.15.149:0/3722498524 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b2415db70 0x7f3b24161dd0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f3b180098f0 tx=0x7f3b18009c00 comp rx=0 tx=0).stop 2023-11-08T19:30:08.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.400+0000 7f3b289d9700 1 -- 172.21.15.149:0/3722498524 shutdown_connections 2023-11-08T19:30:08.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.400+0000 7f3b289d9700 1 --2- 172.21.15.149:0/3722498524 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b2415db70 0x7f3b24161dd0 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:08.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.400+0000 7f3b289d9700 1 -- 172.21.15.149:0/3722498524 >> 172.21.15.149:0/3722498524 conn(0x7f3b240ccff0 msgr2=0x7f3b240cd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:08.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.400+0000 7f3b289d9700 1 -- 172.21.15.149:0/3722498524 shutdown_connections 2023-11-08T19:30:08.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.400+0000 7f3b289d9700 1 -- 172.21.15.149:0/3722498524 wait complete. 2023-11-08T19:30:08.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.401+0000 7f3b289d9700 1 Processor -- start 2023-11-08T19:30:08.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.401+0000 7f3b289d9700 1 -- start start 2023-11-08T19:30:08.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.402+0000 7f3b289d9700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b2406ab80 0x7f3b24145c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:08.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.402+0000 7f3b289d9700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b240b2c00 0x7f3b241464d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:08.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.402+0000 7f3b289d9700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3b2415db70 0x7f3b241572b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:08.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.402+0000 7f3b289d9700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b240ae480 con 0x7f3b2406ab80 2023-11-08T19:30:08.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.402+0000 7f3b289d9700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b241461c0 con 0x7f3b2415db70 2023-11-08T19:30:08.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.402+0000 7f3b289d9700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2415a590 con 0x7f3b240b2c00 2023-11-08T19:30:08.414 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.402+0000 7f3b2259c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b2406ab80 0x7f3b24145c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:08.414 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.402+0000 7f3b2259c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b2406ab80 0x7f3b24145c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45896/0 (socket says 172.21.15.149:45896) 2023-11-08T19:30:08.414 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.402+0000 7f3b2259c700 1 -- 172.21.15.149:0/613959326 learned_addr learned my addr 172.21.15.149:0/613959326 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:30:08.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.402+0000 7f3b21d9b700 1 --2- 172.21.15.149:0/613959326 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b240b2c00 0x7f3b241464d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:08.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.402+0000 7f3b22d9d700 1 --2- 172.21.15.149:0/613959326 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3b2415db70 0x7f3b241572b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:08.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.402+0000 7f3b2259c700 1 -- 172.21.15.149:0/613959326 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b240b2c00 msgr2=0x7f3b241464d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:08.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.402+0000 7f3b2259c700 1 --2- 172.21.15.149:0/613959326 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b240b2c00 0x7f3b241464d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:08.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.402+0000 7f3b2259c700 1 -- 172.21.15.149:0/613959326 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3b2415db70 msgr2=0x7f3b241572b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:08.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.402+0000 7f3b2259c700 1 --2- 172.21.15.149:0/613959326 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3b2415db70 0x7f3b241572b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:08.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.402+0000 7f3b2259c700 1 -- 172.21.15.149:0/613959326 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b18009550 con 0x7f3b2406ab80 2023-11-08T19:30:08.417 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.402+0000 7f3b21d9b700 1 --2- 172.21.15.149:0/613959326 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b240b2c00 0x7f3b241464d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:30:08.417 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.402+0000 7f3b22d9d700 1 --2- 172.21.15.149:0/613959326 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3b2415db70 0x7f3b241572b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:30:08.417 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.402+0000 7f3b2259c700 1 --2- 172.21.15.149:0/613959326 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b2406ab80 0x7f3b24145c80 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f3b18000c00 tx=0x7f3b18004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:08.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.403+0000 7f3b12ffd700 1 -- 172.21.15.149:0/613959326 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b18004570 con 0x7f3b2406ab80 2023-11-08T19:30:08.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.403+0000 7f3b12ffd700 1 -- 172.21.15.149:0/613959326 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b1801f070 con 0x7f3b2406ab80 2023-11-08T19:30:08.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.403+0000 7f3b12ffd700 1 -- 172.21.15.149:0/613959326 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b180038e0 con 0x7f3b2406ab80 2023-11-08T19:30:08.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.403+0000 7f3b289d9700 1 -- 172.21.15.149:0/613959326 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b240adae0 con 0x7f3b2406ab80 2023-11-08T19:30:08.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.403+0000 7f3b289d9700 1 -- 172.21.15.149:0/613959326 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b240ae0a0 con 0x7f3b2406ab80 2023-11-08T19:30:08.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.404+0000 7f3b289d9700 1 -- 172.21.15.149:0/613959326 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b240ae230 con 0x7f3b2406ab80 2023-11-08T19:30:08.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.404+0000 7f3b12ffd700 1 -- 172.21.15.149:0/613959326 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3b18021030 con 0x7f3b2406ab80 2023-11-08T19:30:08.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.404+0000 7f3b12ffd700 1 --2- 172.21.15.149:0/613959326 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3b0406af00 0x7f3b0406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:08.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.405+0000 7f3b12ffd700 1 -- 172.21.15.149:0/613959326 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6999+0+0 (secure 0 0 0) 0x7f3b1808af80 con 0x7f3b2406ab80 2023-11-08T19:30:08.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.405+0000 7f3b21d9b700 1 --2- 172.21.15.149:0/613959326 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3b0406af00 0x7f3b0406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:08.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.405+0000 7f3b21d9b700 1 --2- 172.21.15.149:0/613959326 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3b0406af00 0x7f3b0406d3c0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f3b240b6340 tx=0x7f3b14009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:08.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.410+0000 7f3b12ffd700 1 -- 172.21.15.149:0/613959326 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3b180bdca0 con 0x7f3b2406ab80 2023-11-08T19:30:08.598 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.597+0000 7f3b289d9700 1 -- 172.21.15.149:0/613959326 --> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3b241615d0 con 0x7f3b0406af00 2023-11-08T19:30:08.606 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.605+0000 7f3b12ffd700 1 -- 172.21.15.149:0/613959326 <== mgr.4104 v2:172.21.15.149:6832/1929837472 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+293755 (secure 0 0 0) 0x7f3b140050d0 con 0x7f3b0406af00 2023-11-08T19:30:08.610 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:30:08.612 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.608+0000 7f3b289d9700 1 -- 172.21.15.149:0/613959326 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3b0406af00 msgr2=0x7f3b0406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:08.613 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.608+0000 7f3b289d9700 1 --2- 172.21.15.149:0/613959326 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3b0406af00 0x7f3b0406d3c0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f3b240b6340 tx=0x7f3b14009040 comp rx=0 tx=0).stop 2023-11-08T19:30:08.613 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.608+0000 7f3b289d9700 1 -- 172.21.15.149:0/613959326 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b2406ab80 msgr2=0x7f3b24145c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:08.613 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.608+0000 7f3b289d9700 1 --2- 172.21.15.149:0/613959326 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b2406ab80 0x7f3b24145c80 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f3b18000c00 tx=0x7f3b18004750 comp rx=0 tx=0).stop 2023-11-08T19:30:08.614 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.609+0000 7f3b289d9700 1 -- 172.21.15.149:0/613959326 shutdown_connections 2023-11-08T19:30:08.614 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.609+0000 7f3b289d9700 1 --2- 172.21.15.149:0/613959326 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f3b0406af00 0x7f3b0406d3c0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:08.614 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.609+0000 7f3b289d9700 1 --2- 172.21.15.149:0/613959326 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3b2415db70 0x7f3b241572b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:08.615 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.609+0000 7f3b289d9700 1 --2- 172.21.15.149:0/613959326 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b2406ab80 0x7f3b24145c80 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:08.615 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.609+0000 7f3b289d9700 1 --2- 172.21.15.149:0/613959326 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b240b2c00 0x7f3b241464d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:08.615 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.609+0000 7f3b289d9700 1 -- 172.21.15.149:0/613959326 >> 172.21.15.149:0/613959326 conn(0x7f3b240ccff0 msgr2=0x7f3b24160240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:08.615 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.609+0000 7f3b289d9700 1 -- 172.21.15.149:0/613959326 shutdown_connections 2023-11-08T19:30:08.616 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.609+0000 7f3b289d9700 1 -- 172.21.15.149:0/613959326 wait complete. 2023-11-08T19:30:08.616 INFO:teuthology.orchestra.run.smithi149.stderr:dumped all 2023-11-08T19:30:08.622 INFO:teuthology.orchestra.run.smithi149.stdout:{"pg_ready":true,"pg_map":{"version":320,"stamp":"2023-11-08T19:30:08.097499+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":378,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":232176,"kb_used_data":11844,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754742544,"statfs":{"total":773094113280,"available":772856365056,"internally_reserved":0,"allocated":12128256,"data_stored":6772730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-75424,"num_objects":-41,"num_object_clones":0,"num_object_copies":-82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-41,"num_whiteouts":0,"num_read":-469,"num_read_kb":-619,"num_write":-181,"num_write_kb":-152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001505"},"pg_stats":[{"pgid":"13.c","version":"0'0","reported_seq":44,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.066566+0000","last_change":"2023-11-08T19:25:47.285071+0000","last_active":"2023-11-08T19:30:03.066566+0000","last_peered":"2023-11-08T19:30:03.066566+0000","last_clean":"2023-11-08T19:30:03.066566+0000","last_became_active":"2023-11-08T19:25:47.284788+0000","last_became_peered":"2023-11-08T19:25:47.284788+0000","last_unstale":"2023-11-08T19:30:03.066566+0000","last_undegraded":"2023-11-08T19:30:03.066566+0000","last_fullsized":"2023-11-08T19:30:03.066566+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:50:50.522780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":243,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.066125+0000","last_change":"2023-11-08T19:22:58.054283+0000","last_active":"2023-11-08T19:30:03.066125+0000","last_peered":"2023-11-08T19:30:03.066125+0000","last_clean":"2023-11-08T19:30:03.066125+0000","last_became_active":"2023-11-08T19:22:58.053337+0000","last_became_peered":"2023-11-08T19:22:58.053337+0000","last_unstale":"2023-11-08T19:30:03.066125+0000","last_undegraded":"2023-11-08T19:30:03.066125+0000","last_fullsized":"2023-11-08T19:30:03.066125+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:22:56.479654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:22:56.479654+0000","last_clean_scrub_stamp":"2023-11-08T19:22:56.479654+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:16:05.317001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":76,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:02.736304+0000","last_change":"2023-11-08T19:24:32.530665+0000","last_active":"2023-11-08T19:30:02.736304+0000","last_peered":"2023-11-08T19:30:02.736304+0000","last_clean":"2023-11-08T19:30:02.736304+0000","last_became_active":"2023-11-08T19:24:31.148363+0000","last_became_peered":"2023-11-08T19:24:31.148363+0000","last_unstale":"2023-11-08T19:30:02.736304+0000","last_undegraded":"2023-11-08T19:30:02.736304+0000","last_fullsized":"2023-11-08T19:30:02.736304+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:02:27.987795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075444200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":51,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.066383+0000","last_change":"2023-11-08T19:25:48.371346+0000","last_active":"2023-11-08T19:30:03.066383+0000","last_peered":"2023-11-08T19:30:03.066383+0000","last_clean":"2023-11-08T19:30:03.066383+0000","last_became_active":"2023-11-08T19:25:46.289470+0000","last_became_peered":"2023-11-08T19:25:46.289470+0000","last_unstale":"2023-11-08T19:30:03.066383+0000","last_undegraded":"2023-11-08T19:30:03.066383+0000","last_fullsized":"2023-11-08T19:30:03.066383+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:25:34.010085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000371219,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":48,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.068164+0000","last_change":"2023-11-08T19:25:47.283242+0000","last_active":"2023-11-08T19:30:03.068164+0000","last_peered":"2023-11-08T19:30:03.068164+0000","last_clean":"2023-11-08T19:30:03.068164+0000","last_became_active":"2023-11-08T19:25:47.282922+0000","last_became_peered":"2023-11-08T19:25:47.282922+0000","last_unstale":"2023-11-08T19:30:03.068164+0000","last_undegraded":"2023-11-08T19:30:03.068164+0000","last_fullsized":"2023-11-08T19:30:03.068164+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:26:23.400596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":76,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.065856+0000","last_change":"2023-11-08T19:24:32.544333+0000","last_active":"2023-11-08T19:30:03.065856+0000","last_peered":"2023-11-08T19:30:03.065856+0000","last_clean":"2023-11-08T19:30:03.065856+0000","last_became_active":"2023-11-08T19:24:31.138598+0000","last_became_peered":"2023-11-08T19:24:31.138598+0000","last_unstale":"2023-11-08T19:30:03.065856+0000","last_undegraded":"2023-11-08T19:30:03.065856+0000","last_fullsized":"2023-11-08T19:30:03.065856+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:11.860580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015114824000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":56,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.293214+0000","last_change":"2023-11-08T19:25:48.374357+0000","last_active":"2023-11-08T19:30:05.293214+0000","last_peered":"2023-11-08T19:30:05.293214+0000","last_clean":"2023-11-08T19:30:05.293214+0000","last_became_active":"2023-11-08T19:25:46.279007+0000","last_became_peered":"2023-11-08T19:25:46.279007+0000","last_unstale":"2023-11-08T19:30:05.293214+0000","last_undegraded":"2023-11-08T19:30:05.293214+0000","last_fullsized":"2023-11-08T19:30:05.293214+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:59:30.845191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036813240000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":47,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.292523+0000","last_change":"2023-11-08T19:25:47.285093+0000","last_active":"2023-11-08T19:30:05.292523+0000","last_peered":"2023-11-08T19:30:05.292523+0000","last_clean":"2023-11-08T19:30:05.292523+0000","last_became_active":"2023-11-08T19:25:47.284796+0000","last_became_peered":"2023-11-08T19:25:47.284796+0000","last_unstale":"2023-11-08T19:30:05.292523+0000","last_undegraded":"2023-11-08T19:30:05.292523+0000","last_fullsized":"2023-11-08T19:30:05.292523+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:46:36.504650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":76,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.065703+0000","last_change":"2023-11-08T19:24:32.544285+0000","last_active":"2023-11-08T19:30:03.065703+0000","last_peered":"2023-11-08T19:30:03.065703+0000","last_clean":"2023-11-08T19:30:03.065703+0000","last_became_active":"2023-11-08T19:24:31.142028+0000","last_became_peered":"2023-11-08T19:24:31.142028+0000","last_unstale":"2023-11-08T19:30:03.065703+0000","last_undegraded":"2023-11-08T19:30:03.065703+0000","last_fullsized":"2023-11-08T19:30:03.065703+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:01:24.198196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067537399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":53,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.291868+0000","last_change":"2023-11-08T19:25:48.372192+0000","last_active":"2023-11-08T19:30:05.291868+0000","last_peered":"2023-11-08T19:30:05.291868+0000","last_clean":"2023-11-08T19:30:05.291868+0000","last_became_active":"2023-11-08T19:25:46.288739+0000","last_became_peered":"2023-11-08T19:25:46.288739+0000","last_unstale":"2023-11-08T19:30:05.291868+0000","last_undegraded":"2023-11-08T19:30:05.291868+0000","last_fullsized":"2023-11-08T19:30:05.291868+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:45:04.839053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015057530000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":48,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.068129+0000","last_change":"2023-11-08T19:25:47.287920+0000","last_active":"2023-11-08T19:30:03.068129+0000","last_peered":"2023-11-08T19:30:03.068129+0000","last_clean":"2023-11-08T19:30:03.068129+0000","last_became_active":"2023-11-08T19:25:47.287494+0000","last_became_peered":"2023-11-08T19:25:47.287494+0000","last_unstale":"2023-11-08T19:30:03.068129+0000","last_undegraded":"2023-11-08T19:30:03.068129+0000","last_fullsized":"2023-11-08T19:30:03.068129+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:42:18.942062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":78,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.292283+0000","last_change":"2023-11-08T19:24:32.142836+0000","last_active":"2023-11-08T19:30:05.292283+0000","last_peered":"2023-11-08T19:30:05.292283+0000","last_clean":"2023-11-08T19:30:05.292283+0000","last_became_active":"2023-11-08T19:24:31.141367+0000","last_became_peered":"2023-11-08T19:24:31.141367+0000","last_unstale":"2023-11-08T19:30:05.292283+0000","last_undegraded":"2023-11-08T19:30:05.292283+0000","last_fullsized":"2023-11-08T19:30:05.292283+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:39.214888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001335136,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":52,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.065661+0000","last_change":"2023-11-08T19:25:48.372718+0000","last_active":"2023-11-08T19:30:03.065661+0000","last_peered":"2023-11-08T19:30:03.065661+0000","last_clean":"2023-11-08T19:30:03.065661+0000","last_became_active":"2023-11-08T19:25:46.289283+0000","last_became_peered":"2023-11-08T19:25:46.289283+0000","last_unstale":"2023-11-08T19:30:03.065661+0000","last_undegraded":"2023-11-08T19:30:03.065661+0000","last_fullsized":"2023-11-08T19:30:03.065661+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:15:51.881891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001274049,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":47,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.292492+0000","last_change":"2023-11-08T19:25:47.285353+0000","last_active":"2023-11-08T19:30:05.292492+0000","last_peered":"2023-11-08T19:30:05.292492+0000","last_clean":"2023-11-08T19:30:05.292492+0000","last_became_active":"2023-11-08T19:25:47.285075+0000","last_became_peered":"2023-11-08T19:25:47.285075+0000","last_unstale":"2023-11-08T19:30:05.292492+0000","last_undegraded":"2023-11-08T19:30:05.292492+0000","last_fullsized":"2023-11-08T19:30:05.292492+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:20:50.791463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":87,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.744154+0000","last_change":"2023-11-08T19:24:32.139885+0000","last_active":"2023-11-08T19:30:04.744154+0000","last_peered":"2023-11-08T19:30:04.744154+0000","last_clean":"2023-11-08T19:30:04.744154+0000","last_became_active":"2023-11-08T19:24:31.145329+0000","last_became_peered":"2023-11-08T19:24:31.145329+0000","last_unstale":"2023-11-08T19:30:04.744154+0000","last_undegraded":"2023-11-08T19:30:04.744154+0000","last_fullsized":"2023-11-08T19:30:04.744154+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:25:18.356784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049012999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":56,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.293375+0000","last_change":"2023-11-08T19:25:48.373848+0000","last_active":"2023-11-08T19:30:05.293375+0000","last_peered":"2023-11-08T19:30:05.293375+0000","last_clean":"2023-11-08T19:30:05.293375+0000","last_became_active":"2023-11-08T19:25:46.282174+0000","last_became_peered":"2023-11-08T19:25:46.282174+0000","last_unstale":"2023-11-08T19:30:05.293375+0000","last_undegraded":"2023-11-08T19:30:05.293375+0000","last_fullsized":"2023-11-08T19:30:05.293375+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:00:06.938052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000727792,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":52,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.743231+0000","last_change":"2023-11-08T19:25:47.287677+0000","last_active":"2023-11-08T19:30:04.743231+0000","last_peered":"2023-11-08T19:30:04.743231+0000","last_clean":"2023-11-08T19:30:04.743231+0000","last_became_active":"2023-11-08T19:25:47.287419+0000","last_became_peered":"2023-11-08T19:25:47.287419+0000","last_unstale":"2023-11-08T19:30:04.743231+0000","last_undegraded":"2023-11-08T19:30:04.743231+0000","last_fullsized":"2023-11-08T19:30:04.743231+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:22:08.770702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":86,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.746427+0000","last_change":"2023-11-08T19:24:32.140880+0000","last_active":"2023-11-08T19:30:04.746427+0000","last_peered":"2023-11-08T19:30:04.746427+0000","last_clean":"2023-11-08T19:30:04.746427+0000","last_became_active":"2023-11-08T19:24:31.146063+0000","last_became_peered":"2023-11-08T19:24:31.146063+0000","last_unstale":"2023-11-08T19:30:04.746427+0000","last_undegraded":"2023-11-08T19:30:04.746427+0000","last_fullsized":"2023-11-08T19:30:04.746427+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:54:08.985813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089896300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":53,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:02.735574+0000","last_change":"2023-11-08T19:25:48.374690+0000","last_active":"2023-11-08T19:30:02.735574+0000","last_peered":"2023-11-08T19:30:02.735574+0000","last_clean":"2023-11-08T19:30:02.735574+0000","last_became_active":"2023-11-08T19:25:46.281986+0000","last_became_peered":"2023-11-08T19:25:46.281986+0000","last_unstale":"2023-11-08T19:30:02.735574+0000","last_undegraded":"2023-11-08T19:30:02.735574+0000","last_fullsized":"2023-11-08T19:30:02.735574+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:21:00.981136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003067771,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":44,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.066376+0000","last_change":"2023-11-08T19:25:47.287986+0000","last_active":"2023-11-08T19:30:03.066376+0000","last_peered":"2023-11-08T19:30:03.066376+0000","last_clean":"2023-11-08T19:30:03.066376+0000","last_became_active":"2023-11-08T19:25:47.287560+0000","last_became_peered":"2023-11-08T19:25:47.287560+0000","last_unstale":"2023-11-08T19:30:03.066376+0000","last_undegraded":"2023-11-08T19:30:03.066376+0000","last_fullsized":"2023-11-08T19:30:03.066376+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:35:31.433056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":76,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:02.735507+0000","last_change":"2023-11-08T19:24:32.530620+0000","last_active":"2023-11-08T19:30:02.735507+0000","last_peered":"2023-11-08T19:30:02.735507+0000","last_clean":"2023-11-08T19:30:02.735507+0000","last_became_active":"2023-11-08T19:24:31.144223+0000","last_became_peered":"2023-11-08T19:24:31.144223+0000","last_unstale":"2023-11-08T19:30:02.735507+0000","last_undegraded":"2023-11-08T19:30:02.735507+0000","last_fullsized":"2023-11-08T19:30:02.735507+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:01:25.647952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071879799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":59,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.746498+0000","last_change":"2023-11-08T19:25:48.285326+0000","last_active":"2023-11-08T19:30:04.746498+0000","last_peered":"2023-11-08T19:30:04.746498+0000","last_clean":"2023-11-08T19:30:04.746498+0000","last_became_active":"2023-11-08T19:25:46.278686+0000","last_became_peered":"2023-11-08T19:25:46.278686+0000","last_unstale":"2023-11-08T19:30:04.746498+0000","last_undegraded":"2023-11-08T19:30:04.746498+0000","last_fullsized":"2023-11-08T19:30:04.746498+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:25:34.010085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078409499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":52,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.746273+0000","last_change":"2023-11-08T19:25:47.289726+0000","last_active":"2023-11-08T19:30:04.746273+0000","last_peered":"2023-11-08T19:30:04.746273+0000","last_clean":"2023-11-08T19:30:04.746273+0000","last_became_active":"2023-11-08T19:25:47.289362+0000","last_became_peered":"2023-11-08T19:25:47.289362+0000","last_unstale":"2023-11-08T19:30:04.746273+0000","last_undegraded":"2023-11-08T19:30:04.746273+0000","last_fullsized":"2023-11-08T19:30:04.746273+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:38:55.785104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":75,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.066507+0000","last_change":"2023-11-08T19:24:32.147025+0000","last_active":"2023-11-08T19:30:03.066507+0000","last_peered":"2023-11-08T19:30:03.066507+0000","last_clean":"2023-11-08T19:30:03.066507+0000","last_became_active":"2023-11-08T19:24:31.147082+0000","last_became_peered":"2023-11-08T19:24:31.147082+0000","last_unstale":"2023-11-08T19:30:03.066507+0000","last_undegraded":"2023-11-08T19:30:03.066507+0000","last_fullsized":"2023-11-08T19:30:03.066507+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:02:27.987795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043701599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":53,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:02.736356+0000","last_change":"2023-11-08T19:25:48.374739+0000","last_active":"2023-11-08T19:30:02.736356+0000","last_peered":"2023-11-08T19:30:02.736356+0000","last_clean":"2023-11-08T19:30:02.736356+0000","last_became_active":"2023-11-08T19:25:46.282071+0000","last_became_peered":"2023-11-08T19:25:46.282071+0000","last_unstale":"2023-11-08T19:30:02.736356+0000","last_undegraded":"2023-11-08T19:30:02.736356+0000","last_fullsized":"2023-11-08T19:30:02.736356+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:42:47.677504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023654909999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":76,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.065926+0000","last_change":"2023-11-08T19:24:32.544063+0000","last_active":"2023-11-08T19:30:03.065926+0000","last_peered":"2023-11-08T19:30:03.065926+0000","last_clean":"2023-11-08T19:30:03.065926+0000","last_became_active":"2023-11-08T19:24:31.144795+0000","last_became_peered":"2023-11-08T19:24:31.144795+0000","last_unstale":"2023-11-08T19:30:03.065926+0000","last_undegraded":"2023-11-08T19:30:03.065926+0000","last_fullsized":"2023-11-08T19:30:03.065926+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:12:42.248307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01495431,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":60,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.744117+0000","last_change":"2023-11-08T19:25:48.283673+0000","last_active":"2023-11-08T19:30:04.744117+0000","last_peered":"2023-11-08T19:30:04.744117+0000","last_clean":"2023-11-08T19:30:04.744117+0000","last_became_active":"2023-11-08T19:25:46.285766+0000","last_became_peered":"2023-11-08T19:25:46.285766+0000","last_unstale":"2023-11-08T19:30:04.744117+0000","last_undegraded":"2023-11-08T19:30:04.744117+0000","last_fullsized":"2023-11-08T19:30:04.744117+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:46:35.498766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001756748,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":45,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.066146+0000","last_change":"2023-11-08T19:25:47.288301+0000","last_active":"2023-11-08T19:30:03.066146+0000","last_peered":"2023-11-08T19:30:03.066146+0000","last_clean":"2023-11-08T19:30:03.066146+0000","last_became_active":"2023-11-08T19:25:47.288027+0000","last_became_peered":"2023-11-08T19:25:47.288027+0000","last_unstale":"2023-11-08T19:30:03.066146+0000","last_undegraded":"2023-11-08T19:30:03.066146+0000","last_fullsized":"2023-11-08T19:30:03.066146+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:23:13.428596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":76,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.066506+0000","last_change":"2023-11-08T19:24:32.263810+0000","last_active":"2023-11-08T19:30:03.066506+0000","last_peered":"2023-11-08T19:30:03.066506+0000","last_clean":"2023-11-08T19:30:03.066506+0000","last_became_active":"2023-11-08T19:24:31.138814+0000","last_became_peered":"2023-11-08T19:24:31.138814+0000","last_unstale":"2023-11-08T19:30:03.066506+0000","last_undegraded":"2023-11-08T19:30:03.066506+0000","last_fullsized":"2023-11-08T19:30:03.066506+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:21:55.985548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048136000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":60,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.742995+0000","last_change":"2023-11-08T19:25:48.283572+0000","last_active":"2023-11-08T19:30:04.742995+0000","last_peered":"2023-11-08T19:30:04.742995+0000","last_clean":"2023-11-08T19:30:04.742995+0000","last_became_active":"2023-11-08T19:25:46.271936+0000","last_became_peered":"2023-11-08T19:25:46.271936+0000","last_unstale":"2023-11-08T19:30:04.742995+0000","last_undegraded":"2023-11-08T19:30:04.742995+0000","last_fullsized":"2023-11-08T19:30:04.742995+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:46:11.541748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00186835,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":53,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.743957+0000","last_change":"2023-11-08T19:25:47.282856+0000","last_active":"2023-11-08T19:30:04.743957+0000","last_peered":"2023-11-08T19:30:04.743957+0000","last_clean":"2023-11-08T19:30:04.743957+0000","last_became_active":"2023-11-08T19:25:47.282594+0000","last_became_peered":"2023-11-08T19:25:47.282594+0000","last_unstale":"2023-11-08T19:30:04.743957+0000","last_undegraded":"2023-11-08T19:30:04.743957+0000","last_fullsized":"2023-11-08T19:30:04.743957+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:14:12.111756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":79,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.068077+0000","last_change":"2023-11-08T19:24:32.333096+0000","last_active":"2023-11-08T19:30:03.068077+0000","last_peered":"2023-11-08T19:30:03.068077+0000","last_clean":"2023-11-08T19:30:03.068077+0000","last_became_active":"2023-11-08T19:24:31.142985+0000","last_became_peered":"2023-11-08T19:24:31.142985+0000","last_unstale":"2023-11-08T19:30:03.068077+0000","last_undegraded":"2023-11-08T19:30:03.068077+0000","last_fullsized":"2023-11-08T19:30:03.068077+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:36:33.274496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000386048,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":54,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:02.735104+0000","last_change":"2023-11-08T19:25:48.372963+0000","last_active":"2023-11-08T19:30:02.735104+0000","last_peered":"2023-11-08T19:30:02.735104+0000","last_clean":"2023-11-08T19:30:02.735104+0000","last_became_active":"2023-11-08T19:25:46.283263+0000","last_became_peered":"2023-11-08T19:25:46.283263+0000","last_unstale":"2023-11-08T19:30:02.735104+0000","last_undegraded":"2023-11-08T19:30:02.735104+0000","last_fullsized":"2023-11-08T19:30:02.735104+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:25:34.010085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019848779999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":48,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.292775+0000","last_change":"2023-11-08T19:25:47.284816+0000","last_active":"2023-11-08T19:30:05.292775+0000","last_peered":"2023-11-08T19:30:05.292775+0000","last_clean":"2023-11-08T19:30:05.292775+0000","last_became_active":"2023-11-08T19:25:47.284522+0000","last_became_peered":"2023-11-08T19:25:47.284522+0000","last_unstale":"2023-11-08T19:30:05.292775+0000","last_undegraded":"2023-11-08T19:30:05.292775+0000","last_fullsized":"2023-11-08T19:30:05.292775+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:39:28.223686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":76,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:02.734732+0000","last_change":"2023-11-08T19:24:32.530333+0000","last_active":"2023-11-08T19:30:02.734732+0000","last_peered":"2023-11-08T19:30:02.734732+0000","last_clean":"2023-11-08T19:30:02.734732+0000","last_became_active":"2023-11-08T19:24:31.144838+0000","last_became_peered":"2023-11-08T19:24:31.144838+0000","last_unstale":"2023-11-08T19:30:02.734732+0000","last_undegraded":"2023-11-08T19:30:02.734732+0000","last_fullsized":"2023-11-08T19:30:02.734732+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:39:48.473183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081588799999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":60,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.744392+0000","last_change":"2023-11-08T19:25:48.284699+0000","last_active":"2023-11-08T19:30:04.744392+0000","last_peered":"2023-11-08T19:30:04.744392+0000","last_clean":"2023-11-08T19:30:04.744392+0000","last_became_active":"2023-11-08T19:25:46.285588+0000","last_became_peered":"2023-11-08T19:25:46.285588+0000","last_unstale":"2023-11-08T19:30:04.744392+0000","last_undegraded":"2023-11-08T19:30:04.744392+0000","last_fullsized":"2023-11-08T19:30:04.744392+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:43:02.001903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023282350000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":47,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:02.735054+0000","last_change":"2023-11-08T19:25:47.283526+0000","last_active":"2023-11-08T19:30:02.735054+0000","last_peered":"2023-11-08T19:30:02.735054+0000","last_clean":"2023-11-08T19:30:02.735054+0000","last_became_active":"2023-11-08T19:25:47.283266+0000","last_became_peered":"2023-11-08T19:25:47.283266+0000","last_unstale":"2023-11-08T19:30:02.735054+0000","last_undegraded":"2023-11-08T19:30:02.735054+0000","last_fullsized":"2023-11-08T19:30:02.735054+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:35:31.433056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":79,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.068573+0000","last_change":"2023-11-08T19:24:32.333430+0000","last_active":"2023-11-08T19:30:03.068573+0000","last_peered":"2023-11-08T19:30:03.068573+0000","last_clean":"2023-11-08T19:30:03.068573+0000","last_became_active":"2023-11-08T19:24:31.141710+0000","last_became_peered":"2023-11-08T19:24:31.141710+0000","last_unstale":"2023-11-08T19:30:03.068573+0000","last_undegraded":"2023-11-08T19:30:03.068573+0000","last_fullsized":"2023-11-08T19:30:03.068573+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:32:51.214551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000430438,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":60,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.746468+0000","last_change":"2023-11-08T19:25:48.283855+0000","last_active":"2023-11-08T19:30:04.746468+0000","last_peered":"2023-11-08T19:30:04.746468+0000","last_clean":"2023-11-08T19:30:04.746468+0000","last_became_active":"2023-11-08T19:25:46.273336+0000","last_became_peered":"2023-11-08T19:25:46.273336+0000","last_unstale":"2023-11-08T19:30:04.746468+0000","last_undegraded":"2023-11-08T19:30:04.746468+0000","last_fullsized":"2023-11-08T19:30:04.746468+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:33:35.492889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092577200000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":53,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.743373+0000","last_change":"2023-11-08T19:25:47.282840+0000","last_active":"2023-11-08T19:30:04.743373+0000","last_peered":"2023-11-08T19:30:04.743373+0000","last_clean":"2023-11-08T19:30:04.743373+0000","last_became_active":"2023-11-08T19:25:47.282600+0000","last_became_peered":"2023-11-08T19:25:47.282600+0000","last_unstale":"2023-11-08T19:30:04.743373+0000","last_undegraded":"2023-11-08T19:30:04.743373+0000","last_fullsized":"2023-11-08T19:30:04.743373+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:53:37.482245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":53,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.743282+0000","last_change":"2023-11-08T19:25:47.285890+0000","last_active":"2023-11-08T19:30:04.743282+0000","last_peered":"2023-11-08T19:30:04.743282+0000","last_clean":"2023-11-08T19:30:04.743282+0000","last_became_active":"2023-11-08T19:25:47.285641+0000","last_became_peered":"2023-11-08T19:25:47.285641+0000","last_unstale":"2023-11-08T19:30:04.743282+0000","last_undegraded":"2023-11-08T19:30:04.743282+0000","last_fullsized":"2023-11-08T19:30:04.743282+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:27:18.335142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":76,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:02.736362+0000","last_change":"2023-11-08T19:24:32.530895+0000","last_active":"2023-11-08T19:30:02.736362+0000","last_peered":"2023-11-08T19:30:02.736362+0000","last_clean":"2023-11-08T19:30:02.736362+0000","last_became_active":"2023-11-08T19:24:31.146715+0000","last_became_peered":"2023-11-08T19:24:31.146715+0000","last_unstale":"2023-11-08T19:30:02.736362+0000","last_undegraded":"2023-11-08T19:30:02.736362+0000","last_fullsized":"2023-11-08T19:30:02.736362+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:39.214888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081671599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":60,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.743568+0000","last_change":"2023-11-08T19:25:48.284137+0000","last_active":"2023-11-08T19:30:04.743568+0000","last_peered":"2023-11-08T19:30:04.743568+0000","last_clean":"2023-11-08T19:30:04.743568+0000","last_became_active":"2023-11-08T19:25:46.285960+0000","last_became_peered":"2023-11-08T19:25:46.285960+0000","last_unstale":"2023-11-08T19:30:04.743568+0000","last_undegraded":"2023-11-08T19:30:04.743568+0000","last_fullsized":"2023-11-08T19:30:04.743568+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:26:01.141206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091649099999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":52,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.744689+0000","last_change":"2023-11-08T19:25:47.283642+0000","last_active":"2023-11-08T19:30:04.744689+0000","last_peered":"2023-11-08T19:30:04.744689+0000","last_clean":"2023-11-08T19:30:04.744689+0000","last_became_active":"2023-11-08T19:25:47.283360+0000","last_became_peered":"2023-11-08T19:25:47.283360+0000","last_unstale":"2023-11-08T19:30:04.744689+0000","last_undegraded":"2023-11-08T19:30:04.744689+0000","last_fullsized":"2023-11-08T19:30:04.744689+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:02:27.950152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":86,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.743654+0000","last_change":"2023-11-08T19:24:32.140167+0000","last_active":"2023-11-08T19:30:04.743654+0000","last_peered":"2023-11-08T19:30:04.743654+0000","last_clean":"2023-11-08T19:30:04.743654+0000","last_became_active":"2023-11-08T19:24:31.147181+0000","last_became_peered":"2023-11-08T19:24:31.147181+0000","last_unstale":"2023-11-08T19:30:04.743654+0000","last_undegraded":"2023-11-08T19:30:04.743654+0000","last_fullsized":"2023-11-08T19:30:04.743654+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:26.080042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057135200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":52,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.295903+0000","last_change":"2023-11-08T19:25:48.277705+0000","last_active":"2023-11-08T19:30:05.295903+0000","last_peered":"2023-11-08T19:30:05.295903+0000","last_clean":"2023-11-08T19:30:05.295903+0000","last_became_active":"2023-11-08T19:25:46.288848+0000","last_became_peered":"2023-11-08T19:25:46.288848+0000","last_unstale":"2023-11-08T19:30:05.295903+0000","last_undegraded":"2023-11-08T19:30:05.295903+0000","last_fullsized":"2023-11-08T19:30:05.295903+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:12:24.483185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097653099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":44,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.066512+0000","last_change":"2023-11-08T19:25:47.289456+0000","last_active":"2023-11-08T19:30:03.066512+0000","last_peered":"2023-11-08T19:30:03.066512+0000","last_clean":"2023-11-08T19:30:03.066512+0000","last_became_active":"2023-11-08T19:25:47.289177+0000","last_became_peered":"2023-11-08T19:25:47.289177+0000","last_unstale":"2023-11-08T19:30:03.066512+0000","last_undegraded":"2023-11-08T19:30:03.066512+0000","last_fullsized":"2023-11-08T19:30:03.066512+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:07:11.838364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":86,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.746322+0000","last_change":"2023-11-08T19:24:32.141188+0000","last_active":"2023-11-08T19:30:04.746322+0000","last_peered":"2023-11-08T19:30:04.746322+0000","last_clean":"2023-11-08T19:30:04.746322+0000","last_became_active":"2023-11-08T19:24:31.148857+0000","last_became_peered":"2023-11-08T19:24:31.148857+0000","last_unstale":"2023-11-08T19:30:04.746322+0000","last_undegraded":"2023-11-08T19:30:04.746322+0000","last_fullsized":"2023-11-08T19:30:04.746322+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:45:34.425432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065078599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":52,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.295127+0000","last_change":"2023-11-08T19:25:48.277423+0000","last_active":"2023-11-08T19:30:05.295127+0000","last_peered":"2023-11-08T19:30:05.295127+0000","last_clean":"2023-11-08T19:30:05.295127+0000","last_became_active":"2023-11-08T19:25:46.286211+0000","last_became_peered":"2023-11-08T19:25:46.286211+0000","last_unstale":"2023-11-08T19:30:05.295127+0000","last_undegraded":"2023-11-08T19:30:05.295127+0000","last_fullsized":"2023-11-08T19:30:05.295127+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:44:05.347800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073775700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":44,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.065924+0000","last_change":"2023-11-08T19:25:47.286020+0000","last_active":"2023-11-08T19:30:03.065924+0000","last_peered":"2023-11-08T19:30:03.065924+0000","last_clean":"2023-11-08T19:30:03.065924+0000","last_became_active":"2023-11-08T19:25:47.285728+0000","last_became_peered":"2023-11-08T19:25:47.285728+0000","last_unstale":"2023-11-08T19:30:03.065924+0000","last_undegraded":"2023-11-08T19:30:03.065924+0000","last_fullsized":"2023-11-08T19:30:03.065924+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:26:02.147090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":86,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.745467+0000","last_change":"2023-11-08T19:24:32.140832+0000","last_active":"2023-11-08T19:30:04.745467+0000","last_peered":"2023-11-08T19:30:04.745467+0000","last_clean":"2023-11-08T19:30:04.745467+0000","last_became_active":"2023-11-08T19:24:31.146557+0000","last_became_peered":"2023-11-08T19:24:31.146557+0000","last_unstale":"2023-11-08T19:30:04.745467+0000","last_undegraded":"2023-11-08T19:30:04.745467+0000","last_fullsized":"2023-11-08T19:30:04.745467+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:40:04.258107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099450100000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":53,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:02.734608+0000","last_change":"2023-11-08T19:25:48.372913+0000","last_active":"2023-11-08T19:30:02.734608+0000","last_peered":"2023-11-08T19:30:02.734608+0000","last_clean":"2023-11-08T19:30:02.734608+0000","last_became_active":"2023-11-08T19:25:46.281273+0000","last_became_peered":"2023-11-08T19:25:46.281273+0000","last_unstale":"2023-11-08T19:30:02.734608+0000","last_undegraded":"2023-11-08T19:30:02.734608+0000","last_fullsized":"2023-11-08T19:30:02.734608+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:07:10.832480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020904819999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":45,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.065384+0000","last_change":"2023-11-08T19:25:47.288256+0000","last_active":"2023-11-08T19:30:03.065384+0000","last_peered":"2023-11-08T19:30:03.065384+0000","last_clean":"2023-11-08T19:30:03.065384+0000","last_became_active":"2023-11-08T19:25:47.287905+0000","last_became_peered":"2023-11-08T19:25:47.287905+0000","last_unstale":"2023-11-08T19:30:03.065384+0000","last_undegraded":"2023-11-08T19:30:03.065384+0000","last_fullsized":"2023-11-08T19:30:03.065384+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:50:12.309248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":76,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:02.735192+0000","last_change":"2023-11-08T19:24:32.530378+0000","last_active":"2023-11-08T19:30:02.735192+0000","last_peered":"2023-11-08T19:30:02.735192+0000","last_clean":"2023-11-08T19:30:02.735192+0000","last_became_active":"2023-11-08T19:24:31.144341+0000","last_became_peered":"2023-11-08T19:24:31.144341+0000","last_unstale":"2023-11-08T19:30:02.735192+0000","last_undegraded":"2023-11-08T19:30:02.735192+0000","last_fullsized":"2023-11-08T19:30:02.735192+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:30:21.946303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058308299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":51,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.065803+0000","last_change":"2023-11-08T19:25:48.277150+0000","last_active":"2023-11-08T19:30:03.065803+0000","last_peered":"2023-11-08T19:30:03.065803+0000","last_clean":"2023-11-08T19:30:03.065803+0000","last_became_active":"2023-11-08T19:25:46.286933+0000","last_became_peered":"2023-11-08T19:25:46.286933+0000","last_unstale":"2023-11-08T19:30:03.065803+0000","last_undegraded":"2023-11-08T19:30:03.065803+0000","last_fullsized":"2023-11-08T19:30:03.065803+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:38:38.890354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080507500000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":44,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.066287+0000","last_change":"2023-11-08T19:25:47.282986+0000","last_active":"2023-11-08T19:30:03.066287+0000","last_peered":"2023-11-08T19:30:03.066287+0000","last_clean":"2023-11-08T19:30:03.066287+0000","last_became_active":"2023-11-08T19:25:47.282705+0000","last_became_peered":"2023-11-08T19:25:47.282705+0000","last_unstale":"2023-11-08T19:30:03.066287+0000","last_undegraded":"2023-11-08T19:30:03.066287+0000","last_fullsized":"2023-11-08T19:30:03.066287+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:34:17.838942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":76,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.065508+0000","last_change":"2023-11-08T19:24:32.544108+0000","last_active":"2023-11-08T19:30:03.065508+0000","last_peered":"2023-11-08T19:30:03.065508+0000","last_clean":"2023-11-08T19:30:03.065508+0000","last_became_active":"2023-11-08T19:24:31.143812+0000","last_became_peered":"2023-11-08T19:24:31.143812+0000","last_unstale":"2023-11-08T19:30:03.065508+0000","last_undegraded":"2023-11-08T19:30:03.065508+0000","last_fullsized":"2023-11-08T19:30:03.065508+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:27:59.135977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014956126,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":59,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.745074+0000","last_change":"2023-11-08T19:25:48.284435+0000","last_active":"2023-11-08T19:30:04.745074+0000","last_peered":"2023-11-08T19:30:04.745074+0000","last_clean":"2023-11-08T19:30:04.745074+0000","last_became_active":"2023-11-08T19:25:46.284288+0000","last_became_peered":"2023-11-08T19:25:46.284288+0000","last_unstale":"2023-11-08T19:30:04.745074+0000","last_undegraded":"2023-11-08T19:30:04.745074+0000","last_fullsized":"2023-11-08T19:30:04.745074+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:57:53.083448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001250894,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":52,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.745027+0000","last_change":"2023-11-08T19:25:47.282612+0000","last_active":"2023-11-08T19:30:04.745027+0000","last_peered":"2023-11-08T19:30:04.745027+0000","last_clean":"2023-11-08T19:30:04.745027+0000","last_became_active":"2023-11-08T19:25:47.282299+0000","last_became_peered":"2023-11-08T19:25:47.282299+0000","last_unstale":"2023-11-08T19:30:04.745027+0000","last_undegraded":"2023-11-08T19:30:04.745027+0000","last_fullsized":"2023-11-08T19:30:04.745027+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:43:18.319773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":75,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.065897+0000","last_change":"2023-11-08T19:24:32.146639+0000","last_active":"2023-11-08T19:30:03.065897+0000","last_peered":"2023-11-08T19:30:03.065897+0000","last_clean":"2023-11-08T19:30:03.065897+0000","last_became_active":"2023-11-08T19:24:31.147384+0000","last_became_peered":"2023-11-08T19:24:31.147384+0000","last_unstale":"2023-11-08T19:30:03.065897+0000","last_undegraded":"2023-11-08T19:30:03.065897+0000","last_fullsized":"2023-11-08T19:30:03.065897+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:30:21.946303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043834899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":59,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.744165+0000","last_change":"2023-11-08T19:25:48.283541+0000","last_active":"2023-11-08T19:30:04.744165+0000","last_peered":"2023-11-08T19:30:04.744165+0000","last_clean":"2023-11-08T19:30:04.744165+0000","last_became_active":"2023-11-08T19:25:46.285626+0000","last_became_peered":"2023-11-08T19:25:46.285626+0000","last_unstale":"2023-11-08T19:30:04.744165+0000","last_undegraded":"2023-11-08T19:30:04.744165+0000","last_fullsized":"2023-11-08T19:30:04.744165+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:48:17.033319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019032459999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":52,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.743124+0000","last_change":"2023-11-08T19:25:47.287878+0000","last_active":"2023-11-08T19:30:04.743124+0000","last_peered":"2023-11-08T19:30:04.743124+0000","last_clean":"2023-11-08T19:30:04.743124+0000","last_became_active":"2023-11-08T19:25:47.287617+0000","last_became_peered":"2023-11-08T19:25:47.287617+0000","last_unstale":"2023-11-08T19:30:04.743124+0000","last_undegraded":"2023-11-08T19:30:04.743124+0000","last_fullsized":"2023-11-08T19:30:04.743124+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:20:50.791463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":87,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.744759+0000","last_change":"2023-11-08T19:24:32.142376+0000","last_active":"2023-11-08T19:30:04.744759+0000","last_peered":"2023-11-08T19:30:04.744759+0000","last_clean":"2023-11-08T19:30:04.744759+0000","last_became_active":"2023-11-08T19:24:31.144614+0000","last_became_peered":"2023-11-08T19:24:31.144614+0000","last_unstale":"2023-11-08T19:30:04.744759+0000","last_undegraded":"2023-11-08T19:30:04.744759+0000","last_fullsized":"2023-11-08T19:30:04.744759+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:09:04.880374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050362200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":53,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:02.735721+0000","last_change":"2023-11-08T19:25:48.373636+0000","last_active":"2023-11-08T19:30:02.735721+0000","last_peered":"2023-11-08T19:30:02.735721+0000","last_clean":"2023-11-08T19:30:02.735721+0000","last_became_active":"2023-11-08T19:25:46.283803+0000","last_became_peered":"2023-11-08T19:25:46.283803+0000","last_unstale":"2023-11-08T19:30:02.735721+0000","last_undegraded":"2023-11-08T19:30:02.735721+0000","last_fullsized":"2023-11-08T19:30:02.735721+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:00:34.691748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002404855,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":44,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.066383+0000","last_change":"2023-11-08T19:25:47.287741+0000","last_active":"2023-11-08T19:30:03.066383+0000","last_peered":"2023-11-08T19:30:03.066383+0000","last_clean":"2023-11-08T19:30:03.066383+0000","last_became_active":"2023-11-08T19:25:47.287428+0000","last_became_peered":"2023-11-08T19:25:47.287428+0000","last_unstale":"2023-11-08T19:30:03.066383+0000","last_undegraded":"2023-11-08T19:30:03.066383+0000","last_fullsized":"2023-11-08T19:30:03.066383+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:38:55.785104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":75,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.066583+0000","last_change":"2023-11-08T19:24:32.147235+0000","last_active":"2023-11-08T19:30:03.066583+0000","last_peered":"2023-11-08T19:30:03.066583+0000","last_clean":"2023-11-08T19:30:03.066583+0000","last_became_active":"2023-11-08T19:24:31.146176+0000","last_became_peered":"2023-11-08T19:24:31.146176+0000","last_unstale":"2023-11-08T19:30:03.066583+0000","last_undegraded":"2023-11-08T19:30:03.066583+0000","last_fullsized":"2023-11-08T19:30:03.066583+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:39.214888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048481000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":53,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:02.735676+0000","last_change":"2023-11-08T19:25:48.373345+0000","last_active":"2023-11-08T19:30:02.735676+0000","last_peered":"2023-11-08T19:30:02.735676+0000","last_clean":"2023-11-08T19:30:02.735676+0000","last_became_active":"2023-11-08T19:25:46.282460+0000","last_became_peered":"2023-11-08T19:25:46.282460+0000","last_unstale":"2023-11-08T19:30:02.735676+0000","last_undegraded":"2023-11-08T19:30:02.735676+0000","last_fullsized":"2023-11-08T19:30:02.735676+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:25:30.927920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001972863,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":53,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.744804+0000","last_change":"2023-11-08T19:25:47.283708+0000","last_active":"2023-11-08T19:30:04.744804+0000","last_peered":"2023-11-08T19:30:04.744804+0000","last_clean":"2023-11-08T19:30:04.744804+0000","last_became_active":"2023-11-08T19:25:47.283433+0000","last_became_peered":"2023-11-08T19:25:47.283433+0000","last_unstale":"2023-11-08T19:30:04.744804+0000","last_undegraded":"2023-11-08T19:30:04.744804+0000","last_fullsized":"2023-11-08T19:30:04.744804+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:30:17.627967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":76,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.066160+0000","last_change":"2023-11-08T19:24:32.543880+0000","last_active":"2023-11-08T19:30:03.066160+0000","last_peered":"2023-11-08T19:30:03.066160+0000","last_clean":"2023-11-08T19:30:03.066160+0000","last_became_active":"2023-11-08T19:24:31.142052+0000","last_became_peered":"2023-11-08T19:24:31.142052+0000","last_unstale":"2023-11-08T19:30:03.066160+0000","last_undegraded":"2023-11-08T19:30:03.066160+0000","last_fullsized":"2023-11-08T19:30:03.066160+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:18:42.371676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014881058000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":60,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.746318+0000","last_change":"2023-11-08T19:25:48.284890+0000","last_active":"2023-11-08T19:30:04.746318+0000","last_peered":"2023-11-08T19:30:04.746318+0000","last_clean":"2023-11-08T19:30:04.746318+0000","last_became_active":"2023-11-08T19:25:46.279287+0000","last_became_peered":"2023-11-08T19:25:46.279287+0000","last_unstale":"2023-11-08T19:30:04.746318+0000","last_undegraded":"2023-11-08T19:30:04.746318+0000","last_fullsized":"2023-11-08T19:30:04.746318+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:35:30.427172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076856899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":53,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.746191+0000","last_change":"2023-11-08T19:25:47.285867+0000","last_active":"2023-11-08T19:30:04.746191+0000","last_peered":"2023-11-08T19:30:04.746191+0000","last_clean":"2023-11-08T19:30:04.746191+0000","last_became_active":"2023-11-08T19:25:47.285533+0000","last_became_peered":"2023-11-08T19:25:47.285533+0000","last_unstale":"2023-11-08T19:30:04.746191+0000","last_undegraded":"2023-11-08T19:30:04.746191+0000","last_fullsized":"2023-11-08T19:30:04.746191+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:26:59.852338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":75,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.066493+0000","last_change":"2023-11-08T19:24:32.147011+0000","last_active":"2023-11-08T19:30:03.066493+0000","last_peered":"2023-11-08T19:30:03.066493+0000","last_clean":"2023-11-08T19:30:03.066493+0000","last_became_active":"2023-11-08T19:24:31.148250+0000","last_became_peered":"2023-11-08T19:24:31.148250+0000","last_unstale":"2023-11-08T19:30:03.066493+0000","last_undegraded":"2023-11-08T19:30:03.066493+0000","last_fullsized":"2023-11-08T19:30:03.066493+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:01:25.647952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043061299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":60,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.744846+0000","last_change":"2023-11-08T19:25:48.284869+0000","last_active":"2023-11-08T19:30:04.744846+0000","last_peered":"2023-11-08T19:30:04.744846+0000","last_clean":"2023-11-08T19:30:04.744846+0000","last_became_active":"2023-11-08T19:25:46.285478+0000","last_became_peered":"2023-11-08T19:25:46.285478+0000","last_unstale":"2023-11-08T19:30:04.744846+0000","last_undegraded":"2023-11-08T19:30:04.744846+0000","last_fullsized":"2023-11-08T19:30:04.744846+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:49:51.368808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000376339,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":44,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.065727+0000","last_change":"2023-11-08T19:25:47.284429+0000","last_active":"2023-11-08T19:30:03.065727+0000","last_peered":"2023-11-08T19:30:03.065727+0000","last_clean":"2023-11-08T19:30:03.065727+0000","last_became_active":"2023-11-08T19:25:47.283990+0000","last_became_peered":"2023-11-08T19:25:47.283990+0000","last_unstale":"2023-11-08T19:30:03.065727+0000","last_undegraded":"2023-11-08T19:30:03.065727+0000","last_fullsized":"2023-11-08T19:30:03.065727+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:59:08.628317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":87,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.744493+0000","last_change":"2023-11-08T19:24:32.141190+0000","last_active":"2023-11-08T19:30:04.744493+0000","last_peered":"2023-11-08T19:30:04.744493+0000","last_clean":"2023-11-08T19:30:04.744493+0000","last_became_active":"2023-11-08T19:24:31.147651+0000","last_became_peered":"2023-11-08T19:24:31.147651+0000","last_unstale":"2023-11-08T19:30:04.744493+0000","last_undegraded":"2023-11-08T19:30:04.744493+0000","last_fullsized":"2023-11-08T19:30:04.744493+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:21:55.985548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043673300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":54,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.292742+0000","last_change":"2023-11-08T19:25:48.320707+0000","last_active":"2023-11-08T19:30:05.292742+0000","last_peered":"2023-11-08T19:30:05.292742+0000","last_clean":"2023-11-08T19:30:05.292742+0000","last_became_active":"2023-11-08T19:25:46.282307+0000","last_became_peered":"2023-11-08T19:25:46.282307+0000","last_unstale":"2023-11-08T19:30:05.292742+0000","last_undegraded":"2023-11-08T19:30:05.292742+0000","last_fullsized":"2023-11-08T19:30:05.292742+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:53:36.476361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047078400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":44,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.066183+0000","last_change":"2023-11-08T19:25:47.284227+0000","last_active":"2023-11-08T19:30:03.066183+0000","last_peered":"2023-11-08T19:30:03.066183+0000","last_clean":"2023-11-08T19:30:03.066183+0000","last_became_active":"2023-11-08T19:25:47.283927+0000","last_became_peered":"2023-11-08T19:25:47.283927+0000","last_unstale":"2023-11-08T19:30:03.066183+0000","last_undegraded":"2023-11-08T19:30:03.066183+0000","last_fullsized":"2023-11-08T19:30:03.066183+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:15:23.188047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":76,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:02.735188+0000","last_change":"2023-11-08T19:24:32.530168+0000","last_active":"2023-11-08T19:30:02.735188+0000","last_peered":"2023-11-08T19:30:02.735188+0000","last_clean":"2023-11-08T19:30:02.735188+0000","last_became_active":"2023-11-08T19:24:31.144329+0000","last_became_peered":"2023-11-08T19:24:31.144329+0000","last_unstale":"2023-11-08T19:30:02.735188+0000","last_undegraded":"2023-11-08T19:30:02.735188+0000","last_fullsized":"2023-11-08T19:30:02.735188+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:05:36.085920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043484799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":53,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:02.734880+0000","last_change":"2023-11-08T19:25:48.371291+0000","last_active":"2023-11-08T19:30:02.734880+0000","last_peered":"2023-11-08T19:30:02.734880+0000","last_clean":"2023-11-08T19:30:02.734880+0000","last_became_active":"2023-11-08T19:25:46.281425+0000","last_became_peered":"2023-11-08T19:25:46.281425+0000","last_unstale":"2023-11-08T19:30:02.734880+0000","last_undegraded":"2023-11-08T19:30:02.734880+0000","last_fullsized":"2023-11-08T19:30:02.734880+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:23:12.422712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00124314,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":46,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:02.735040+0000","last_change":"2023-11-08T19:25:47.281724+0000","last_active":"2023-11-08T19:30:02.735040+0000","last_peered":"2023-11-08T19:30:02.735040+0000","last_clean":"2023-11-08T19:30:02.735040+0000","last_became_active":"2023-11-08T19:25:47.281425+0000","last_became_peered":"2023-11-08T19:25:47.281425+0000","last_unstale":"2023-11-08T19:30:02.735040+0000","last_undegraded":"2023-11-08T19:30:02.735040+0000","last_fullsized":"2023-11-08T19:30:02.735040+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:38:55.785104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":76,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:02.734938+0000","last_change":"2023-11-08T19:24:32.529486+0000","last_active":"2023-11-08T19:30:02.734938+0000","last_peered":"2023-11-08T19:30:02.734938+0000","last_clean":"2023-11-08T19:30:02.734938+0000","last_became_active":"2023-11-08T19:24:31.146260+0000","last_became_peered":"2023-11-08T19:24:31.146260+0000","last_unstale":"2023-11-08T19:30:02.734938+0000","last_undegraded":"2023-11-08T19:30:02.734938+0000","last_fullsized":"2023-11-08T19:30:02.734938+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:45:34.425432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059842900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":51,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.066586+0000","last_change":"2023-11-08T19:25:48.277457+0000","last_active":"2023-11-08T19:30:03.066586+0000","last_peered":"2023-11-08T19:30:03.066586+0000","last_clean":"2023-11-08T19:30:03.066586+0000","last_became_active":"2023-11-08T19:25:46.286239+0000","last_became_peered":"2023-11-08T19:25:46.286239+0000","last_unstale":"2023-11-08T19:30:03.066586+0000","last_undegraded":"2023-11-08T19:30:03.066586+0000","last_fullsized":"2023-11-08T19:30:03.066586+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:09:43.662108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000722421,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":44,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.066108+0000","last_change":"2023-11-08T19:25:47.287874+0000","last_active":"2023-11-08T19:30:03.066108+0000","last_peered":"2023-11-08T19:30:03.066108+0000","last_clean":"2023-11-08T19:30:03.066108+0000","last_became_active":"2023-11-08T19:25:47.287456+0000","last_became_peered":"2023-11-08T19:25:47.287456+0000","last_unstale":"2023-11-08T19:30:03.066108+0000","last_undegraded":"2023-11-08T19:30:03.066108+0000","last_fullsized":"2023-11-08T19:30:03.066108+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:26:59.852338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":86,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.744037+0000","last_change":"2023-11-08T19:24:32.141131+0000","last_active":"2023-11-08T19:30:04.744037+0000","last_peered":"2023-11-08T19:30:04.744037+0000","last_clean":"2023-11-08T19:30:04.744037+0000","last_became_active":"2023-11-08T19:24:31.146154+0000","last_became_peered":"2023-11-08T19:24:31.146154+0000","last_unstale":"2023-11-08T19:30:04.744037+0000","last_undegraded":"2023-11-08T19:30:04.744037+0000","last_fullsized":"2023-11-08T19:30:04.744037+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:18:40.271560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082432800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":52,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.065997+0000","last_change":"2023-11-08T19:25:48.372729+0000","last_active":"2023-11-08T19:30:03.065997+0000","last_peered":"2023-11-08T19:30:03.065997+0000","last_clean":"2023-11-08T19:30:03.065997+0000","last_became_active":"2023-11-08T19:25:46.290114+0000","last_became_peered":"2023-11-08T19:25:46.290114+0000","last_unstale":"2023-11-08T19:30:03.065997+0000","last_undegraded":"2023-11-08T19:30:03.065997+0000","last_fullsized":"2023-11-08T19:30:03.065997+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:49:36.208776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061009499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":46,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:02.735668+0000","last_change":"2023-11-08T19:25:47.283046+0000","last_active":"2023-11-08T19:30:02.735668+0000","last_peered":"2023-11-08T19:30:02.735668+0000","last_clean":"2023-11-08T19:30:02.735668+0000","last_became_active":"2023-11-08T19:25:47.282763+0000","last_became_peered":"2023-11-08T19:25:47.282763+0000","last_unstale":"2023-11-08T19:30:02.735668+0000","last_undegraded":"2023-11-08T19:30:02.735668+0000","last_fullsized":"2023-11-08T19:30:02.735668+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:12:51.389167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":76,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.066157+0000","last_change":"2023-11-08T19:24:32.263963+0000","last_active":"2023-11-08T19:30:03.066157+0000","last_peered":"2023-11-08T19:30:03.066157+0000","last_clean":"2023-11-08T19:30:03.066157+0000","last_became_active":"2023-11-08T19:24:31.139062+0000","last_became_peered":"2023-11-08T19:24:31.139062+0000","last_unstale":"2023-11-08T19:30:03.066157+0000","last_undegraded":"2023-11-08T19:30:03.066157+0000","last_fullsized":"2023-11-08T19:30:03.066157+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:26.080042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033682599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":59,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.746216+0000","last_change":"2023-11-08T19:25:48.283302+0000","last_active":"2023-11-08T19:30:04.746216+0000","last_peered":"2023-11-08T19:30:04.746216+0000","last_clean":"2023-11-08T19:30:04.746216+0000","last_became_active":"2023-11-08T19:25:46.284287+0000","last_became_peered":"2023-11-08T19:25:46.284287+0000","last_unstale":"2023-11-08T19:30:04.746216+0000","last_undegraded":"2023-11-08T19:30:04.746216+0000","last_fullsized":"2023-11-08T19:30:04.746216+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:39:27.217802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097880800000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":52,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.743835+0000","last_change":"2023-11-08T19:25:47.286434+0000","last_active":"2023-11-08T19:30:04.743835+0000","last_peered":"2023-11-08T19:30:04.743835+0000","last_clean":"2023-11-08T19:30:04.743835+0000","last_became_active":"2023-11-08T19:25:47.286181+0000","last_became_peered":"2023-11-08T19:25:47.286181+0000","last_unstale":"2023-11-08T19:30:04.743835+0000","last_undegraded":"2023-11-08T19:30:04.743835+0000","last_fullsized":"2023-11-08T19:30:04.743835+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:13:27.285648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":86,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.746426+0000","last_change":"2023-11-08T19:24:32.140514+0000","last_active":"2023-11-08T19:30:04.746426+0000","last_peered":"2023-11-08T19:30:04.746426+0000","last_clean":"2023-11-08T19:30:04.746426+0000","last_became_active":"2023-11-08T19:24:31.146668+0000","last_became_peered":"2023-11-08T19:24:31.146668+0000","last_unstale":"2023-11-08T19:30:04.746426+0000","last_undegraded":"2023-11-08T19:30:04.746426+0000","last_fullsized":"2023-11-08T19:30:04.746426+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:31:24.539374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071576699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":54,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.292979+0000","last_change":"2023-11-08T19:25:48.320667+0000","last_active":"2023-11-08T19:30:05.292979+0000","last_peered":"2023-11-08T19:30:05.292979+0000","last_clean":"2023-11-08T19:30:05.292979+0000","last_became_active":"2023-11-08T19:25:46.290246+0000","last_became_peered":"2023-11-08T19:25:46.290246+0000","last_unstale":"2023-11-08T19:30:05.292979+0000","last_undegraded":"2023-11-08T19:30:05.292979+0000","last_fullsized":"2023-11-08T19:30:05.292979+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:33:35.492889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000423211,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":45,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.066689+0000","last_change":"2023-11-08T19:25:47.287717+0000","last_active":"2023-11-08T19:30:03.066689+0000","last_peered":"2023-11-08T19:30:03.066689+0000","last_clean":"2023-11-08T19:30:03.066689+0000","last_became_active":"2023-11-08T19:25:47.287412+0000","last_became_peered":"2023-11-08T19:25:47.287412+0000","last_unstale":"2023-11-08T19:30:03.066689+0000","last_undegraded":"2023-11-08T19:30:03.066689+0000","last_fullsized":"2023-11-08T19:30:03.066689+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:18:04.478139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":78,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.293087+0000","last_change":"2023-11-08T19:24:32.142892+0000","last_active":"2023-11-08T19:30:05.293087+0000","last_peered":"2023-11-08T19:30:05.293087+0000","last_clean":"2023-11-08T19:30:05.293087+0000","last_became_active":"2023-11-08T19:24:31.144912+0000","last_became_peered":"2023-11-08T19:24:31.144912+0000","last_unstale":"2023-11-08T19:30:05.293087+0000","last_undegraded":"2023-11-08T19:30:05.293087+0000","last_fullsized":"2023-11-08T19:30:05.293087+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:04:21.151484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056686900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":59,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.746370+0000","last_change":"2023-11-08T19:25:48.285205+0000","last_active":"2023-11-08T19:30:04.746370+0000","last_peered":"2023-11-08T19:30:04.746370+0000","last_clean":"2023-11-08T19:30:04.746370+0000","last_became_active":"2023-11-08T19:25:46.285848+0000","last_became_peered":"2023-11-08T19:25:46.285848+0000","last_unstale":"2023-11-08T19:30:04.746370+0000","last_undegraded":"2023-11-08T19:30:04.746370+0000","last_fullsized":"2023-11-08T19:30:04.746370+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:07:10.832480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089732199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":47,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.293661+0000","last_change":"2023-11-08T19:25:47.280177+0000","last_active":"2023-11-08T19:30:05.293661+0000","last_peered":"2023-11-08T19:30:05.293661+0000","last_clean":"2023-11-08T19:30:05.293661+0000","last_became_active":"2023-11-08T19:25:47.279913+0000","last_became_peered":"2023-11-08T19:25:47.279913+0000","last_unstale":"2023-11-08T19:30:05.293661+0000","last_undegraded":"2023-11-08T19:30:05.293661+0000","last_fullsized":"2023-11-08T19:30:05.293661+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:26:02.147090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":76,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.067058+0000","last_change":"2023-11-08T19:24:32.263958+0000","last_active":"2023-11-08T19:30:03.067058+0000","last_peered":"2023-11-08T19:30:03.067058+0000","last_clean":"2023-11-08T19:30:03.067058+0000","last_became_active":"2023-11-08T19:24:31.149011+0000","last_became_peered":"2023-11-08T19:24:31.149011+0000","last_unstale":"2023-11-08T19:30:03.067058+0000","last_undegraded":"2023-11-08T19:30:03.067058+0000","last_fullsized":"2023-11-08T19:30:03.067058+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:09:04.880374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033496900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":59,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.746345+0000","last_change":"2023-11-08T19:25:48.285075+0000","last_active":"2023-11-08T19:30:04.746345+0000","last_peered":"2023-11-08T19:30:04.746345+0000","last_clean":"2023-11-08T19:30:04.746345+0000","last_became_active":"2023-11-08T19:25:46.272479+0000","last_became_peered":"2023-11-08T19:25:46.272479+0000","last_unstale":"2023-11-08T19:30:04.746345+0000","last_undegraded":"2023-11-08T19:30:04.746345+0000","last_fullsized":"2023-11-08T19:30:04.746345+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:23:12.422712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001158117,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574938,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28920,"kb_used_data":1900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342920,"statfs":{"total":96636764160,"available":96607150080,"internally_reserved":0,"allocated":1945600,"data_stored":1278562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:29:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.57599999999999996,"15min":0.54600000000000004},"min":{"1min":0.33800000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.75800000000000001,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58499999999999996,"15min":0.56899999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.377},"max":{"1min":0.747,"5min":0.75900000000000001,"15min":0.86699999999999999},"last":0.42899999999999999}]},{"osd":1,"last update":"Wed Nov 8 19:29:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55000000000000004,"15min":0.54800000000000004},"min":{"1min":0.36599999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.78500000000000003,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.502},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.55100000000000005,"15min":0.53600000000000003},"min":{"1min":0.42199999999999999,"5min":0.39200000000000002,"15min":0.37},"max":{"1min":0.78400000000000003,"5min":0.78900000000000003,"15min":0.79800000000000004},"last":0.47799999999999998}]},{"osd":2,"last update":"Wed Nov 8 19:29:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54000000000000004,"15min":0.51700000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.82599999999999996},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.55400000000000005,"15min":0.54100000000000004},"min":{"1min":0.38500000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76800000000000002,"5min":0.77800000000000002,"15min":0.81599999999999995},"last":0.56200000000000006}]},{"osd":3,"last update":"Wed Nov 8 19:29:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54100000000000004,"15min":0.53500000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.72699999999999998,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.746},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.59099999999999997,"15min":0.56699999999999995},"min":{"1min":0.45600000000000002,"5min":0.42399999999999999,"15min":0.36899999999999999},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.38400000000000001}]},{"osd":4,"last update":"Wed Nov 8 19:29:11 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.49399999999999999,"15min":0.48499999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.64700000000000002,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.497,"5min":0.51500000000000001,"15min":0.51700000000000002},"min":{"1min":0.35299999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.71499999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.83799999999999997}]},{"osd":5,"last update":"Wed Nov 8 19:29:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56200000000000006,"15min":0.54900000000000004},"min":{"1min":0.38400000000000001,"5min":0.35399999999999998,"15min":0.35099999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56899999999999995,"15min":0.57299999999999995},"min":{"1min":0.40400000000000003,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.76200000000000001,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.58799999999999997}]},{"osd":6,"last update":"Wed Nov 8 19:29:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59999999999999998,"15min":0.60799999999999998},"min":{"1min":0.40000000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.76100000000000001,"5min":0.82299999999999995,"15min":0.86399999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.58199999999999996,"15min":0.56699999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.874,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.79300000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574939,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28368,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343472,"statfs":{"total":96636764160,"available":96607715328,"internally_reserved":0,"allocated":1376256,"data_stored":703350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.53400000000000003,"15min":0.58399999999999996},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.81399999999999995,"5min":0.82199999999999995,"15min":1.7549999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.54300000000000004,"15min":0.58099999999999996},"min":{"1min":0.36599999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.76800000000000002,"5min":0.78800000000000003,"15min":1.478},"last":0.746}]},{"osd":1,"last update":"Wed Nov 8 19:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57699999999999996,"15min":0.59899999999999998},"min":{"1min":0.317,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.73699999999999999,"5min":0.80600000000000005,"15min":1.6619999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.622,"15min":0.65600000000000003},"min":{"1min":0.41799999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.77500000000000002,"5min":0.81699999999999995,"15min":1.649},"last":0.80900000000000005}]},{"osd":2,"last update":"Wed Nov 8 19:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.58499999999999996,"15min":0.56699999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76900000000000002,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.59499999999999997,"15min":0.623},"min":{"1min":0.40600000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.68999999999999995,"5min":0.77400000000000002,"15min":0.85399999999999998},"last":0.82599999999999996}]},{"osd":3,"last update":"Wed Nov 8 19:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55800000000000005,"15min":0.61399999999999999},"min":{"1min":0.38,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.68200000000000005,"5min":0.80300000000000005,"15min":1.766},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55400000000000005,"15min":0.60599999999999998},"min":{"1min":0.375,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73699999999999999,"5min":0.877,"15min":1.8580000000000001},"last":0.65400000000000003}]},{"osd":4,"last update":"Wed Nov 8 19:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.51800000000000002,"15min":0.53600000000000003},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.66600000000000004,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.755},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54500000000000004,"15min":0.57099999999999995},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.83499999999999996,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.56000000000000005}]},{"osd":5,"last update":"Wed Nov 8 19:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.52900000000000003,"15min":0.55900000000000005},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.79100000000000004,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57299999999999995,"15min":0.61899999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.72699999999999998,"5min":0.80200000000000005,"15min":0.82099999999999995},"last":0.89600000000000002}]},{"osd":7,"last update":"Wed Nov 8 19:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58299999999999996,"15min":0.60499999999999998},"min":{"1min":0.33400000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.873,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58899999999999997,"15min":0.63100000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.81299999999999994,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.83999999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28384,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343456,"statfs":{"total":96636764160,"available":96607698944,"internally_reserved":0,"allocated":1396736,"data_stored":714320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:30:02 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.35799999999999998},"min":{"1min":0.247,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.46899999999999997,"5min":0.51200000000000001,"15min":1.2090000000000001},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.376,"5min":0.35899999999999999,"15min":0.39700000000000002},"min":{"1min":0.23599999999999999,"5min":0.22900000000000001,"15min":0.19700000000000001},"max":{"1min":0.49299999999999999,"5min":0.61599999999999999,"15min":2.1850000000000001},"last":0.314}]},{"osd":2,"last update":"Wed Nov 8 19:30:02 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.35099999999999998,"15min":0.34799999999999998},"min":{"1min":0.26400000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.438,"5min":0.54400000000000004,"15min":0.59099999999999997},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.38700000000000001,"15min":0.39400000000000002},"min":{"1min":0.28299999999999997,"5min":0.253,"15min":0.24099999999999999},"max":{"1min":0.56000000000000005,"5min":0.623,"15min":1.2689999999999999},"last":0.252}]},{"osd":3,"last update":"Wed Nov 8 19:30:02 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.41199999999999998,"15min":0.41799999999999998},"min":{"1min":0.32400000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.622,"5min":0.63100000000000001,"15min":1.24},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.39900000000000002,"15min":0.44400000000000001},"min":{"1min":0.30599999999999999,"5min":0.26100000000000001,"15min":0.253},"max":{"1min":0.54500000000000004,"5min":0.68200000000000005,"15min":2.2120000000000002},"last":0.35399999999999998}]},{"osd":4,"last update":"Wed Nov 8 19:30:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.59299999999999997,"15min":0.60799999999999998},"min":{"1min":0.42399999999999999,"5min":0.36899999999999999,"15min":0.32100000000000001},"max":{"1min":0.82299999999999995,"5min":0.93400000000000005,"15min":2.1579999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.58899999999999997,"15min":0.57399999999999995},"min":{"1min":0.438,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.78200000000000003,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.45900000000000002}]},{"osd":5,"last update":"Wed Nov 8 19:30:02 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.59499999999999997,"15min":0.57099999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.38100000000000001},"max":{"1min":0.78300000000000003,"5min":0.82599999999999996,"15min":0.86399999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59599999999999997,"15min":0.60499999999999998},"min":{"1min":0.437,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77300000000000002,"5min":0.90800000000000003,"15min":1.115},"last":0.52700000000000002}]},{"osd":6,"last update":"Wed Nov 8 19:30:02 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.60099999999999998,"15min":0.628},"min":{"1min":0.40500000000000003,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.76800000000000002,"5min":0.88400000000000001,"15min":2.093},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.435,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.752,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.51200000000000001}]},{"osd":7,"last update":"Wed Nov 8 19:30:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.621,"15min":0.65700000000000003},"min":{"1min":0.44600000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.80300000000000005,"5min":0.876,"15min":1.591},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61099999999999999,"15min":0.66800000000000004},"min":{"1min":0.49299999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.77900000000000003,"5min":0.88400000000000001,"15min":2.1299999999999999},"last":0.44400000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574938,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33088,"kb_used_data":1908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338752,"statfs":{"total":96636764160,"available":96602882048,"internally_reserved":0,"allocated":1953792,"data_stored":1286063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:29:09 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.41099999999999998,"15min":0.96199999999999997},"min":{"1min":0.19500000000000001,"5min":0.192,"15min":0.192},"max":{"1min":0.56399999999999995,"5min":6.9509999999999996,"15min":19.295999999999999},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.371,"15min":0.874},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.55500000000000005,"5min":0.57399999999999995,"15min":17.204000000000001},"last":0.41799999999999998}]},{"osd":2,"last update":"Wed Nov 8 19:29:09 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.44500000000000001,"15min":0.58499999999999996},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.64100000000000001,"5min":6.8029999999999999,"15min":6.8029999999999999},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.40699999999999997,"15min":0.91500000000000004},"min":{"1min":0.28999999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.53900000000000003,"5min":1.3140000000000001,"15min":17.175000000000001},"last":0.32200000000000001}]},{"osd":3,"last update":"Wed Nov 8 19:29:09 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.52900000000000003,"15min":0.83799999999999997},"min":{"1min":0.27300000000000002,"5min":0.24399999999999999,"15min":0.22500000000000001},"max":{"1min":0.51400000000000001,"5min":16.661000000000001,"15min":16.661000000000001},"last":0.37},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.48799999999999999,"15min":0.43099999999999999},"min":{"1min":0.29899999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.73699999999999999,"5min":6.9859999999999998,"15min":6.9859999999999998},"last":0.47099999999999997}]},{"osd":4,"last update":"Wed Nov 8 19:29:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.60899999999999999,"15min":1.0720000000000001},"min":{"1min":0.373,"5min":0.313,"15min":0.313},"max":{"1min":0.72999999999999998,"5min":1.0029999999999999,"15min":17.056000000000001},"last":0.746},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.753,"15min":0.76100000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33000000000000002},"max":{"1min":0.72499999999999998,"5min":16.718,"15min":16.718},"last":0.56100000000000005}]},{"osd":5,"last update":"Wed Nov 8 19:29:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.746,"15min":0.76200000000000001},"min":{"1min":0.36199999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72899999999999998,"5min":16.609000000000002,"15min":16.609000000000002},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.65900000000000003,"15min":0.59499999999999997},"min":{"1min":0.40100000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77100000000000002,"5min":5.1639999999999997,"15min":5.1639999999999997},"last":0.58399999999999996}]},{"osd":6,"last update":"Wed Nov 8 19:29:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.68700000000000006,"15min":0.63300000000000001},"min":{"1min":0.45900000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.80600000000000005,"5min":6.6349999999999998,"15min":6.6349999999999998},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.65300000000000002,"15min":1.1220000000000001},"min":{"1min":0.42199999999999999,"5min":0.35499999999999998,"15min":0.34899999999999998},"max":{"1min":0.81599999999999995,"5min":3.1400000000000001,"15min":17.111999999999998},"last":0.70899999999999996}]},{"osd":7,"last update":"Wed Nov 8 19:29:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63900000000000001,"15min":1.127},"min":{"1min":0.49299999999999999,"5min":0.376,"15min":0.376},"max":{"1min":0.79300000000000004,"5min":1.0760000000000001,"15min":17.146000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.76000000000000001,"15min":0.77300000000000002},"min":{"1min":0.441,"5min":0.40899999999999997,"15min":0.38800000000000001},"max":{"1min":0.76900000000000002,"5min":16.690999999999999,"15min":16.690999999999999},"last":0.59699999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574938,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28348,"kb_used_data":1328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343492,"statfs":{"total":96636764160,"available":96607735808,"internally_reserved":0,"allocated":1359872,"data_stored":695695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.33900000000000002,"15min":0.44400000000000001},"min":{"1min":0.22500000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.54300000000000004,"5min":0.61299999999999999,"15min":3.4100000000000001},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.38600000000000001,"15min":0.48299999999999998},"min":{"1min":0.28199999999999997,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":1.8340000000000001,"5min":1.8340000000000001,"15min":3.4369999999999998},"last":0.22}]},{"osd":1,"last update":"Wed Nov 8 19:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.38,"15min":0.51200000000000001},"min":{"1min":0.26400000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":4.0679999999999996},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.442,"15min":0.56200000000000006},"min":{"1min":0.309,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.68000000000000005,"5min":0.72099999999999997,"15min":4.3499999999999996},"last":0.34499999999999997}]},{"osd":3,"last update":"Wed Nov 8 19:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.40799999999999997,"15min":0.50800000000000001},"min":{"1min":0.247,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.57199999999999995,"5min":0.82999999999999996,"15min":3.8580000000000001},"last":0.317},{"interface":"front","average":{"1min":0.436,"5min":0.378,"15min":0.48399999999999999},"min":{"1min":0.30299999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":3.476},"last":0.248}]},{"osd":4,"last update":"Wed Nov 8 19:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.65300000000000002,"15min":0.70599999999999996},"min":{"1min":0.40899999999999997,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":4.7990000000000004,"5min":4.7990000000000004,"15min":4.7990000000000004},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.629,"5min":0.58999999999999997,"15min":0.70099999999999996},"min":{"1min":0.48199999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.76300000000000001,"5min":0.92300000000000004,"15min":4.1040000000000001},"last":0.41999999999999998}]},{"osd":5,"last update":"Wed Nov 8 19:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.60099999999999998,"15min":0.71199999999999997},"min":{"1min":0.41199999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.875,"5min":0.88,"15min":4.0869999999999997},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.64500000000000002,"15min":0.72899999999999998},"min":{"1min":0.42899999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":4.8239999999999998,"5min":4.8239999999999998,"15min":4.8239999999999998},"last":0.48099999999999998}]},{"osd":6,"last update":"Wed Nov 8 19:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.61099999999999999,"15min":0.72699999999999998},"min":{"1min":0.48099999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.83999999999999997,"5min":1.1200000000000001,"15min":4.1399999999999997},"last":0.433},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.60099999999999998,"15min":0.70499999999999996},"min":{"1min":0.42099999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.82099999999999995,"5min":0.85599999999999998,"15min":4.0499999999999998},"last":0.38}]},{"osd":7,"last update":"Wed Nov 8 19:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.64300000000000002,"15min":0.73999999999999999},"min":{"1min":0.46400000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.82499999999999996,"5min":1.181,"15min":4.157},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.65700000000000003,"15min":0.76700000000000002},"min":{"1min":0.55700000000000005,"5min":0.433,"15min":0.433},"max":{"1min":0.78500000000000003,"5min":1.222,"15min":4.1710000000000003},"last":0.45300000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574938,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28352,"kb_used_data":1328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343488,"statfs":{"total":96636764160,"available":96607731712,"internally_reserved":0,"allocated":1359872,"data_stored":695695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:29:04 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.373,"15min":0.38300000000000001},"min":{"1min":0.217,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":1.458},"last":0.373},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.38500000000000001,"15min":0.39700000000000002},"min":{"1min":0.29699999999999999,"5min":0.192,"15min":0.192},"max":{"1min":0.56100000000000005,"5min":0.626,"15min":1.3939999999999999},"last":0.35699999999999998}]},{"osd":1,"last update":"Wed Nov 8 19:29:04 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.39700000000000002,"15min":0.40899999999999997},"min":{"1min":0.28899999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.55800000000000005,"5min":0.747,"15min":1.512},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.41499999999999998,"15min":0.44},"min":{"1min":0.32300000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":1.5580000000000001},"last":0.39300000000000002}]},{"osd":2,"last update":"Wed Nov 8 19:29:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.375,"15min":0.377},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.2030000000000001},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.40600000000000003,"15min":0.42199999999999999},"min":{"1min":0.27400000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":1.536},"last":0.314}]},{"osd":4,"last update":"Wed Nov 8 19:29:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.60499999999999998,"15min":0.61899999999999999},"min":{"1min":0.441,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":1.3400000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.624,"15min":0.61499999999999999},"min":{"1min":0.41299999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.82899999999999996,"5min":0.84999999999999998,"15min":1.153},"last":0.57999999999999996}]},{"osd":5,"last update":"Wed Nov 8 19:29:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.58699999999999997,"15min":0.58999999999999997},"min":{"1min":0.438,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.84999999999999998,"5min":0.86499999999999999,"15min":1.4870000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.57799999999999996,"15min":0.59999999999999998},"min":{"1min":0.39900000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.80200000000000005,"5min":0.82799999999999996,"15min":1.3129999999999999},"last":0.59399999999999997}]},{"osd":6,"last update":"Wed Nov 8 19:29:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57499999999999996,"15min":0.57999999999999996},"min":{"1min":0.38700000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":1.113},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60299999999999998,"15min":0.61099999999999999},"min":{"1min":0.439,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":1.4139999999999999},"last":0.51900000000000002}]},{"osd":7,"last update":"Wed Nov 8 19:29:04 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61299999999999999,"15min":0.63900000000000001},"min":{"1min":0.41799999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":1.3680000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.63900000000000001,"15min":0.624},"min":{"1min":0.46899999999999997,"5min":0.45700000000000002,"15min":0.42299999999999999},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":1.179},"last":0.54200000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574938,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28368,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343472,"statfs":{"total":96636764160,"available":96607715328,"internally_reserved":0,"allocated":1376256,"data_stored":703350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:29:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.56599999999999995,"15min":0.54500000000000004},"min":{"1min":0.34999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.72899999999999998,"5min":0.80100000000000005,"15min":1.399},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55200000000000005,"15min":0.58399999999999996},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.69999999999999996,"5min":0.89500000000000002,"15min":2.2090000000000001},"last":0.439}]},{"osd":1,"last update":"Wed Nov 8 19:29:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.54400000000000004,"15min":0.52100000000000002},"min":{"1min":0.45100000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.73699999999999999,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.52900000000000003,"15min":0.50600000000000001},"min":{"1min":0.36799999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.54800000000000004}]},{"osd":2,"last update":"Wed Nov 8 19:29:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.57799999999999996,"15min":0.622},"min":{"1min":0.44700000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.78200000000000003,"5min":0.80800000000000005,"15min":2.8490000000000002},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56799999999999995,"15min":0.53400000000000003},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.78500000000000003,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.72099999999999997}]},{"osd":3,"last update":"Wed Nov 8 19:29:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.60999999999999999,"15min":0.57699999999999996},"min":{"1min":0.39500000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.73799999999999999,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.749},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63200000000000001,"15min":0.70099999999999996},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.79300000000000004,"5min":0.86199999999999999,"15min":3.4849999999999999},"last":0.66600000000000004}]},{"osd":5,"last update":"Wed Nov 8 19:29:05 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.48799999999999999,"15min":0.51000000000000001},"min":{"1min":0.314,"5min":0.313,"15min":0.313},"max":{"1min":0.61599999999999999,"5min":0.746,"15min":0.91500000000000004},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.36799999999999999,"5min":0.36299999999999999,"15min":0.32300000000000001},"max":{"1min":0.58099999999999996,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.68000000000000005}]},{"osd":6,"last update":"Wed Nov 8 19:29:05 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.54300000000000004,"15min":0.67100000000000004},"min":{"1min":0.36499999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.621,"5min":0.83199999999999996,"15min":4.1529999999999996},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.58499999999999996,"15min":0.60299999999999998},"min":{"1min":0.41399999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.69799999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.77200000000000002}]},{"osd":7,"last update":"Wed Nov 8 19:29:05 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.55500000000000005,"15min":0.56499999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.34499999999999997},"max":{"1min":0.66100000000000003,"5min":0.80500000000000005,"15min":0.99399999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.65100000000000002,"15min":0.80100000000000005},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.79400000000000004,"5min":0.87,"15min":5.5359999999999996},"last":0.69699999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574938,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28348,"kb_used_data":1328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343492,"statfs":{"total":96636764160,"available":96607735808,"internally_reserved":0,"allocated":1359872,"data_stored":695695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.52500000000000002,"15min":0.54300000000000004},"min":{"1min":0.36799999999999999,"5min":0.30399999999999999,"15min":0.26000000000000001},"max":{"1min":0.71099999999999997,"5min":0.78100000000000003,"15min":2.2360000000000002},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.55200000000000005,"15min":0.52800000000000002},"min":{"1min":0.38900000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.878},"last":0.53700000000000003}]},{"osd":1,"last update":"Wed Nov 8 19:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.58799999999999997,"15min":0.55800000000000005},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.27600000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.85999999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56799999999999995,"15min":0.59799999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":2.2919999999999998},"last":0.48699999999999999}]},{"osd":2,"last update":"Wed Nov 8 19:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56499999999999995,"15min":0.55900000000000005},"min":{"1min":0.33800000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.73699999999999999,"5min":0.82299999999999995,"15min":0.83399999999999996},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.55900000000000005,"15min":0.53700000000000003},"min":{"1min":0.45000000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.69799999999999995,"5min":0.79100000000000004,"15min":0.81599999999999995},"last":0.747}]},{"osd":3,"last update":"Wed Nov 8 19:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57199999999999995,"15min":0.56100000000000005},"min":{"1min":0.36699999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73299999999999998,"5min":0.745,"15min":0.76900000000000002},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58899999999999997,"15min":0.57699999999999996},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.34399999999999997},"max":{"1min":0.71399999999999997,"5min":0.83699999999999997,"15min":0.89900000000000002},"last":0.64800000000000002}]},{"osd":4,"last update":"Wed Nov 8 19:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.495,"15min":0.57299999999999995},"min":{"1min":0.29999999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.68600000000000005,"5min":0.81200000000000006,"15min":2.3300000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.60699999999999998,"15min":0.625},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.77000000000000002,"5min":0.81999999999999995,"15min":0.92300000000000004},"last":0.61799999999999999}]},{"osd":6,"last update":"Wed Nov 8 19:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.53300000000000003,"15min":0.56299999999999994},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76300000000000001,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.54900000000000004,"15min":0.63700000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.72999999999999998,"5min":0.80500000000000005,"15min":2.3650000000000002},"last":0.66400000000000003}]},{"osd":7,"last update":"Wed Nov 8 19:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.58199999999999996,"15min":0.61499999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.88500000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.59999999999999998,"15min":0.63400000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.79000000000000004,"5min":0.871,"15min":0.873},"last":0.72399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:30:08.631 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-08T19:30:08.632 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:30:08.762 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T19:30:08.765 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T19:30:08.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.785+0000 7f36cb7b4700 1 Processor -- start 2023-11-08T19:30:08.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.785+0000 7f36cb7b4700 1 -- start start 2023-11-08T19:30:08.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.786+0000 7f36cb7b4700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f36c415b950 0x7f36c40ce130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:08.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.786+0000 7f36cb7b4700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f36c40cd5e0 0x7f36c40ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:08.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.786+0000 7f36cb7b4700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36c40cc2e0 con 0x7f36c40cfd20 2023-11-08T19:30:08.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.786+0000 7f36cb7b4700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36c40cc580 con 0x7f36c415b950 2023-11-08T19:30:08.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.786+0000 7f36cb7b4700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36c40cc820 con 0x7f36c40cd5e0 2023-11-08T19:30:08.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.786+0000 7f36c9550700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f36c415b950 0x7f36c40ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:08.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.786+0000 7f36c9550700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f36c415b950 0x7f36c40ce130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45904/0 (socket says 172.21.15.149:45904) 2023-11-08T19:30:08.791 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.786+0000 7f36c9550700 1 -- 172.21.15.149:0/317654378 learned_addr learned my addr 172.21.15.149:0/317654378 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:30:08.791 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.786+0000 7f36c8d4f700 1 --2- 172.21.15.149:0/317654378 >> v2:172.21.15.160:3300/0 conn(0x7f36c40cd5e0 0x7f36c40ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:08.791 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.786+0000 7f36c9550700 1 -- 172.21.15.149:0/317654378 >> v2:172.21.15.160:3300/0 conn(0x7f36c40cd5e0 msgr2=0x7f36c40ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:30:08.792 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.786+0000 7f36c9550700 1 --2- 172.21.15.149:0/317654378 >> v2:172.21.15.160:3300/0 conn(0x7f36c40cd5e0 0x7f36c40ce670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:08.792 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.786+0000 7f36c9550700 1 -- 172.21.15.149:0/317654378 >> v1:172.21.15.149:6789/0 conn(0x7f36c40cfd20 legacy=0x7f36c40d0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:08.792 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.786+0000 7f36c9550700 1 -- 172.21.15.149:0/317654378 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36c40ccb00 con 0x7f36c415b950 2023-11-08T19:30:08.792 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.787+0000 7f36c9550700 1 --2- 172.21.15.149:0/317654378 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36c415b950 0x7f36c40ce130 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f36c408bca0 tx=0x7f36c0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ad6b67ac174aeb server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:08.793 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.787+0000 7f36bbfff700 1 -- 172.21.15.149:0/317654378 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c0005e30 con 0x7f36c415b950 2023-11-08T19:30:08.793 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.787+0000 7f36bbfff700 1 -- 172.21.15.149:0/317654378 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36c0004030 con 0x7f36c415b950 2023-11-08T19:30:08.793 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.787+0000 7f36bbfff700 1 -- 172.21.15.149:0/317654378 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c00043e0 con 0x7f36c415b950 2023-11-08T19:30:08.794 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.787+0000 7f36cb7b4700 1 -- 172.21.15.149:0/317654378 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36c415b950 msgr2=0x7f36c40ce130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:08.794 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.787+0000 7f36cb7b4700 1 --2- 172.21.15.149:0/317654378 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36c415b950 0x7f36c40ce130 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f36c408bca0 tx=0x7f36c0009bd0 comp rx=0 tx=0).stop 2023-11-08T19:30:08.794 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.788+0000 7f36cb7b4700 1 -- 172.21.15.149:0/317654378 shutdown_connections 2023-11-08T19:30:08.794 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.788+0000 7f36cb7b4700 1 --2- 172.21.15.149:0/317654378 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36c415b950 0x7f36c40ce130 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:08.795 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.788+0000 7f36cb7b4700 1 --2- 172.21.15.149:0/317654378 >> v2:172.21.15.160:3300/0 conn(0x7f36c40cd5e0 0x7f36c40ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:08.795 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.788+0000 7f36cb7b4700 1 -- 172.21.15.149:0/317654378 >> 172.21.15.149:0/317654378 conn(0x7f36c408afd0 msgr2=0x7f36c40d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:08.795 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.788+0000 7f36cb7b4700 1 -- 172.21.15.149:0/317654378 shutdown_connections 2023-11-08T19:30:08.796 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.788+0000 7f36cb7b4700 1 -- 172.21.15.149:0/317654378 wait complete. 2023-11-08T19:30:08.799 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.789+0000 7f36cb7b4700 1 Processor -- start 2023-11-08T19:30:08.799 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.789+0000 7f36cb7b4700 1 -- start start 2023-11-08T19:30:08.799 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.790+0000 7f36cb7b4700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36c40cfd20 0x7f36c415ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:08.799 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.790+0000 7f36cb7b4700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f36c415b950 0x7f36c4150aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:08.800 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.790+0000 7f36cb7b4700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f36c40c5e60 0x7f36c415e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:08.800 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.790+0000 7f36cb7b4700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c415d3b0 con 0x7f36c40cfd20 2023-11-08T19:30:08.800 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.790+0000 7f36cb7b4700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c415d0d0 con 0x7f36c40c5e60 2023-11-08T19:30:08.801 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.790+0000 7f36cb7b4700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36c40b4500 con 0x7f36c415b950 2023-11-08T19:30:08.801 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.790+0000 7f36c9550700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36c40cfd20 0x7f36c415ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:08.801 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.790+0000 7f36c9550700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36c40cfd20 0x7f36c415ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45910/0 (socket says 172.21.15.149:45910) 2023-11-08T19:30:08.802 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.790+0000 7f36c9550700 1 -- 172.21.15.149:0/3940428442 learned_addr learned my addr 172.21.15.149:0/3940428442 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:30:08.802 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.790+0000 7f36c8d4f700 1 --2- 172.21.15.149:0/3940428442 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f36c415b950 0x7f36c4150aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:08.802 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.790+0000 7f36c9d51700 1 --2- 172.21.15.149:0/3940428442 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f36c40c5e60 0x7f36c415e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:08.803 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.790+0000 7f36c9550700 1 -- 172.21.15.149:0/3940428442 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f36c415b950 msgr2=0x7f36c4150aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:08.803 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.790+0000 7f36c9550700 1 --2- 172.21.15.149:0/3940428442 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f36c415b950 0x7f36c4150aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:08.803 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.790+0000 7f36c9550700 1 -- 172.21.15.149:0/3940428442 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f36c40c5e60 msgr2=0x7f36c415e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:08.803 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.790+0000 7f36c9550700 1 --2- 172.21.15.149:0/3940428442 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f36c40c5e60 0x7f36c415e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:08.804 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.790+0000 7f36c9550700 1 -- 172.21.15.149:0/3940428442 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36c0009500 con 0x7f36c40cfd20 2023-11-08T19:30:08.804 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.790+0000 7f36c8d4f700 1 --2- 172.21.15.149:0/3940428442 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f36c415b950 0x7f36c4150aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:30:08.804 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.790+0000 7f36c9550700 1 --2- 172.21.15.149:0/3940428442 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36c40cfd20 0x7f36c415ca40 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f36c0009c10 tx=0x7f36c0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:08.805 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.790+0000 7f36b9ffb700 1 -- 172.21.15.149:0/3940428442 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c0003ce0 con 0x7f36c40cfd20 2023-11-08T19:30:08.805 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.790+0000 7f36b9ffb700 1 -- 172.21.15.149:0/3940428442 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36c0003e40 con 0x7f36c40cfd20 2023-11-08T19:30:08.805 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.790+0000 7f36cb7b4700 1 -- 172.21.15.149:0/3940428442 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36c40b47e0 con 0x7f36c40cfd20 2023-11-08T19:30:08.805 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.791+0000 7f36b9ffb700 1 -- 172.21.15.149:0/3940428442 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c001c640 con 0x7f36c40cfd20 2023-11-08T19:30:08.806 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.791+0000 7f36cb7b4700 1 -- 172.21.15.149:0/3940428442 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36c4150fe0 con 0x7f36c40cfd20 2023-11-08T19:30:08.806 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.792+0000 7f36cb7b4700 1 -- 172.21.15.149:0/3940428442 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36c40b4360 con 0x7f36c40cfd20 2023-11-08T19:30:08.806 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.792+0000 7f36b9ffb700 1 -- 172.21.15.149:0/3940428442 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f36c001c7a0 con 0x7f36c40cfd20 2023-11-08T19:30:08.806 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.793+0000 7f36b9ffb700 1 --2- 172.21.15.149:0/3940428442 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f36a806af00 0x7f36a806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:08.807 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.793+0000 7f36b9ffb700 1 -- 172.21.15.149:0/3940428442 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6999+0+0 (secure 0 0 0) 0x7f36c008ab30 con 0x7f36c40cfd20 2023-11-08T19:30:08.807 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.793+0000 7f36c8d4f700 1 --2- 172.21.15.149:0/3940428442 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f36a806af00 0x7f36a806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:08.807 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.793+0000 7f36c8d4f700 1 --2- 172.21.15.149:0/3940428442 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f36a806af00 0x7f36a806d3c0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f36c415d740 tx=0x7f36b4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:08.808 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.797+0000 7f36b9ffb700 1 -- 172.21.15.149:0/3940428442 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f36c40b4360 con 0x7f36c40cfd20 2023-11-08T19:30:08.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.983+0000 7f36cb7b4700 1 -- 172.21.15.149:0/3940428442 --> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f36c40cd0c0 con 0x7f36a806af00 2023-11-08T19:30:08.992 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.991+0000 7f36b9ffb700 1 -- 172.21.15.149:0/3940428442 <== mgr.4104 v2:172.21.15.149:6832/1929837472 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+293755 (secure 0 0 0) 0x7f36b4004030 con 0x7f36a806af00 2023-11-08T19:30:08.996 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:30:08.999 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.995+0000 7f36cb7b4700 1 -- 172.21.15.149:0/3940428442 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f36a806af00 msgr2=0x7f36a806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:08.999 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.995+0000 7f36cb7b4700 1 --2- 172.21.15.149:0/3940428442 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f36a806af00 0x7f36a806d3c0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f36c415d740 tx=0x7f36b4008040 comp rx=0 tx=0).stop 2023-11-08T19:30:09.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.995+0000 7f36cb7b4700 1 -- 172.21.15.149:0/3940428442 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36c40cfd20 msgr2=0x7f36c415ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:09.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.995+0000 7f36cb7b4700 1 --2- 172.21.15.149:0/3940428442 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36c40cfd20 0x7f36c415ca40 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f36c0009c10 tx=0x7f36c0004750 comp rx=0 tx=0).stop 2023-11-08T19:30:09.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.995+0000 7f36cb7b4700 1 -- 172.21.15.149:0/3940428442 shutdown_connections 2023-11-08T19:30:09.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.995+0000 7f36cb7b4700 1 --2- 172.21.15.149:0/3940428442 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f36a806af00 0x7f36a806d3c0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:09.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.995+0000 7f36cb7b4700 1 --2- 172.21.15.149:0/3940428442 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f36c40c5e60 0x7f36c415e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:09.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.995+0000 7f36cb7b4700 1 --2- 172.21.15.149:0/3940428442 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36c40cfd20 0x7f36c415ca40 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:09.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.995+0000 7f36cb7b4700 1 --2- 172.21.15.149:0/3940428442 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f36c415b950 0x7f36c4150aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:09.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.995+0000 7f36cb7b4700 1 -- 172.21.15.149:0/3940428442 >> 172.21.15.149:0/3940428442 conn(0x7f36c408afd0 msgr2=0x7f36c406ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:09.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.995+0000 7f36cb7b4700 1 -- 172.21.15.149:0/3940428442 shutdown_connections 2023-11-08T19:30:09.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:08.995+0000 7f36cb7b4700 1 -- 172.21.15.149:0/3940428442 wait complete. 2023-11-08T19:30:09.003 INFO:teuthology.orchestra.run.smithi149.stderr:dumped all 2023-11-08T19:30:09.008 INFO:teuthology.orchestra.run.smithi149.stdout:{"pg_ready":true,"pg_map":{"version":320,"stamp":"2023-11-08T19:30:08.097499+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":378,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":232176,"kb_used_data":11844,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754742544,"statfs":{"total":773094113280,"available":772856365056,"internally_reserved":0,"allocated":12128256,"data_stored":6772730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-75424,"num_objects":-41,"num_object_clones":0,"num_object_copies":-82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-41,"num_whiteouts":0,"num_read":-469,"num_read_kb":-619,"num_write":-181,"num_write_kb":-152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001505"},"pg_stats":[{"pgid":"13.c","version":"0'0","reported_seq":44,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.066566+0000","last_change":"2023-11-08T19:25:47.285071+0000","last_active":"2023-11-08T19:30:03.066566+0000","last_peered":"2023-11-08T19:30:03.066566+0000","last_clean":"2023-11-08T19:30:03.066566+0000","last_became_active":"2023-11-08T19:25:47.284788+0000","last_became_peered":"2023-11-08T19:25:47.284788+0000","last_unstale":"2023-11-08T19:30:03.066566+0000","last_undegraded":"2023-11-08T19:30:03.066566+0000","last_fullsized":"2023-11-08T19:30:03.066566+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:50:50.522780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":243,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.066125+0000","last_change":"2023-11-08T19:22:58.054283+0000","last_active":"2023-11-08T19:30:03.066125+0000","last_peered":"2023-11-08T19:30:03.066125+0000","last_clean":"2023-11-08T19:30:03.066125+0000","last_became_active":"2023-11-08T19:22:58.053337+0000","last_became_peered":"2023-11-08T19:22:58.053337+0000","last_unstale":"2023-11-08T19:30:03.066125+0000","last_undegraded":"2023-11-08T19:30:03.066125+0000","last_fullsized":"2023-11-08T19:30:03.066125+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:22:56.479654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:22:56.479654+0000","last_clean_scrub_stamp":"2023-11-08T19:22:56.479654+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:16:05.317001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":76,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:02.736304+0000","last_change":"2023-11-08T19:24:32.530665+0000","last_active":"2023-11-08T19:30:02.736304+0000","last_peered":"2023-11-08T19:30:02.736304+0000","last_clean":"2023-11-08T19:30:02.736304+0000","last_became_active":"2023-11-08T19:24:31.148363+0000","last_became_peered":"2023-11-08T19:24:31.148363+0000","last_unstale":"2023-11-08T19:30:02.736304+0000","last_undegraded":"2023-11-08T19:30:02.736304+0000","last_fullsized":"2023-11-08T19:30:02.736304+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:02:27.987795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075444200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":51,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.066383+0000","last_change":"2023-11-08T19:25:48.371346+0000","last_active":"2023-11-08T19:30:03.066383+0000","last_peered":"2023-11-08T19:30:03.066383+0000","last_clean":"2023-11-08T19:30:03.066383+0000","last_became_active":"2023-11-08T19:25:46.289470+0000","last_became_peered":"2023-11-08T19:25:46.289470+0000","last_unstale":"2023-11-08T19:30:03.066383+0000","last_undegraded":"2023-11-08T19:30:03.066383+0000","last_fullsized":"2023-11-08T19:30:03.066383+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:25:34.010085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000371219,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":48,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.068164+0000","last_change":"2023-11-08T19:25:47.283242+0000","last_active":"2023-11-08T19:30:03.068164+0000","last_peered":"2023-11-08T19:30:03.068164+0000","last_clean":"2023-11-08T19:30:03.068164+0000","last_became_active":"2023-11-08T19:25:47.282922+0000","last_became_peered":"2023-11-08T19:25:47.282922+0000","last_unstale":"2023-11-08T19:30:03.068164+0000","last_undegraded":"2023-11-08T19:30:03.068164+0000","last_fullsized":"2023-11-08T19:30:03.068164+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:26:23.400596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":76,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.065856+0000","last_change":"2023-11-08T19:24:32.544333+0000","last_active":"2023-11-08T19:30:03.065856+0000","last_peered":"2023-11-08T19:30:03.065856+0000","last_clean":"2023-11-08T19:30:03.065856+0000","last_became_active":"2023-11-08T19:24:31.138598+0000","last_became_peered":"2023-11-08T19:24:31.138598+0000","last_unstale":"2023-11-08T19:30:03.065856+0000","last_undegraded":"2023-11-08T19:30:03.065856+0000","last_fullsized":"2023-11-08T19:30:03.065856+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:11.860580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015114824000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":56,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.293214+0000","last_change":"2023-11-08T19:25:48.374357+0000","last_active":"2023-11-08T19:30:05.293214+0000","last_peered":"2023-11-08T19:30:05.293214+0000","last_clean":"2023-11-08T19:30:05.293214+0000","last_became_active":"2023-11-08T19:25:46.279007+0000","last_became_peered":"2023-11-08T19:25:46.279007+0000","last_unstale":"2023-11-08T19:30:05.293214+0000","last_undegraded":"2023-11-08T19:30:05.293214+0000","last_fullsized":"2023-11-08T19:30:05.293214+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:59:30.845191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036813240000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":47,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.292523+0000","last_change":"2023-11-08T19:25:47.285093+0000","last_active":"2023-11-08T19:30:05.292523+0000","last_peered":"2023-11-08T19:30:05.292523+0000","last_clean":"2023-11-08T19:30:05.292523+0000","last_became_active":"2023-11-08T19:25:47.284796+0000","last_became_peered":"2023-11-08T19:25:47.284796+0000","last_unstale":"2023-11-08T19:30:05.292523+0000","last_undegraded":"2023-11-08T19:30:05.292523+0000","last_fullsized":"2023-11-08T19:30:05.292523+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:46:36.504650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":76,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.065703+0000","last_change":"2023-11-08T19:24:32.544285+0000","last_active":"2023-11-08T19:30:03.065703+0000","last_peered":"2023-11-08T19:30:03.065703+0000","last_clean":"2023-11-08T19:30:03.065703+0000","last_became_active":"2023-11-08T19:24:31.142028+0000","last_became_peered":"2023-11-08T19:24:31.142028+0000","last_unstale":"2023-11-08T19:30:03.065703+0000","last_undegraded":"2023-11-08T19:30:03.065703+0000","last_fullsized":"2023-11-08T19:30:03.065703+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:01:24.198196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067537399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":53,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.291868+0000","last_change":"2023-11-08T19:25:48.372192+0000","last_active":"2023-11-08T19:30:05.291868+0000","last_peered":"2023-11-08T19:30:05.291868+0000","last_clean":"2023-11-08T19:30:05.291868+0000","last_became_active":"2023-11-08T19:25:46.288739+0000","last_became_peered":"2023-11-08T19:25:46.288739+0000","last_unstale":"2023-11-08T19:30:05.291868+0000","last_undegraded":"2023-11-08T19:30:05.291868+0000","last_fullsized":"2023-11-08T19:30:05.291868+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:45:04.839053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015057530000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":48,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.068129+0000","last_change":"2023-11-08T19:25:47.287920+0000","last_active":"2023-11-08T19:30:03.068129+0000","last_peered":"2023-11-08T19:30:03.068129+0000","last_clean":"2023-11-08T19:30:03.068129+0000","last_became_active":"2023-11-08T19:25:47.287494+0000","last_became_peered":"2023-11-08T19:25:47.287494+0000","last_unstale":"2023-11-08T19:30:03.068129+0000","last_undegraded":"2023-11-08T19:30:03.068129+0000","last_fullsized":"2023-11-08T19:30:03.068129+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:42:18.942062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":78,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.292283+0000","last_change":"2023-11-08T19:24:32.142836+0000","last_active":"2023-11-08T19:30:05.292283+0000","last_peered":"2023-11-08T19:30:05.292283+0000","last_clean":"2023-11-08T19:30:05.292283+0000","last_became_active":"2023-11-08T19:24:31.141367+0000","last_became_peered":"2023-11-08T19:24:31.141367+0000","last_unstale":"2023-11-08T19:30:05.292283+0000","last_undegraded":"2023-11-08T19:30:05.292283+0000","last_fullsized":"2023-11-08T19:30:05.292283+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:39.214888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001335136,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":52,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.065661+0000","last_change":"2023-11-08T19:25:48.372718+0000","last_active":"2023-11-08T19:30:03.065661+0000","last_peered":"2023-11-08T19:30:03.065661+0000","last_clean":"2023-11-08T19:30:03.065661+0000","last_became_active":"2023-11-08T19:25:46.289283+0000","last_became_peered":"2023-11-08T19:25:46.289283+0000","last_unstale":"2023-11-08T19:30:03.065661+0000","last_undegraded":"2023-11-08T19:30:03.065661+0000","last_fullsized":"2023-11-08T19:30:03.065661+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:15:51.881891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001274049,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":47,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.292492+0000","last_change":"2023-11-08T19:25:47.285353+0000","last_active":"2023-11-08T19:30:05.292492+0000","last_peered":"2023-11-08T19:30:05.292492+0000","last_clean":"2023-11-08T19:30:05.292492+0000","last_became_active":"2023-11-08T19:25:47.285075+0000","last_became_peered":"2023-11-08T19:25:47.285075+0000","last_unstale":"2023-11-08T19:30:05.292492+0000","last_undegraded":"2023-11-08T19:30:05.292492+0000","last_fullsized":"2023-11-08T19:30:05.292492+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:20:50.791463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":87,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.744154+0000","last_change":"2023-11-08T19:24:32.139885+0000","last_active":"2023-11-08T19:30:04.744154+0000","last_peered":"2023-11-08T19:30:04.744154+0000","last_clean":"2023-11-08T19:30:04.744154+0000","last_became_active":"2023-11-08T19:24:31.145329+0000","last_became_peered":"2023-11-08T19:24:31.145329+0000","last_unstale":"2023-11-08T19:30:04.744154+0000","last_undegraded":"2023-11-08T19:30:04.744154+0000","last_fullsized":"2023-11-08T19:30:04.744154+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:25:18.356784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049012999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":56,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.293375+0000","last_change":"2023-11-08T19:25:48.373848+0000","last_active":"2023-11-08T19:30:05.293375+0000","last_peered":"2023-11-08T19:30:05.293375+0000","last_clean":"2023-11-08T19:30:05.293375+0000","last_became_active":"2023-11-08T19:25:46.282174+0000","last_became_peered":"2023-11-08T19:25:46.282174+0000","last_unstale":"2023-11-08T19:30:05.293375+0000","last_undegraded":"2023-11-08T19:30:05.293375+0000","last_fullsized":"2023-11-08T19:30:05.293375+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:00:06.938052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000727792,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":52,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.743231+0000","last_change":"2023-11-08T19:25:47.287677+0000","last_active":"2023-11-08T19:30:04.743231+0000","last_peered":"2023-11-08T19:30:04.743231+0000","last_clean":"2023-11-08T19:30:04.743231+0000","last_became_active":"2023-11-08T19:25:47.287419+0000","last_became_peered":"2023-11-08T19:25:47.287419+0000","last_unstale":"2023-11-08T19:30:04.743231+0000","last_undegraded":"2023-11-08T19:30:04.743231+0000","last_fullsized":"2023-11-08T19:30:04.743231+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:22:08.770702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":86,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.746427+0000","last_change":"2023-11-08T19:24:32.140880+0000","last_active":"2023-11-08T19:30:04.746427+0000","last_peered":"2023-11-08T19:30:04.746427+0000","last_clean":"2023-11-08T19:30:04.746427+0000","last_became_active":"2023-11-08T19:24:31.146063+0000","last_became_peered":"2023-11-08T19:24:31.146063+0000","last_unstale":"2023-11-08T19:30:04.746427+0000","last_undegraded":"2023-11-08T19:30:04.746427+0000","last_fullsized":"2023-11-08T19:30:04.746427+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:54:08.985813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089896300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":53,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:02.735574+0000","last_change":"2023-11-08T19:25:48.374690+0000","last_active":"2023-11-08T19:30:02.735574+0000","last_peered":"2023-11-08T19:30:02.735574+0000","last_clean":"2023-11-08T19:30:02.735574+0000","last_became_active":"2023-11-08T19:25:46.281986+0000","last_became_peered":"2023-11-08T19:25:46.281986+0000","last_unstale":"2023-11-08T19:30:02.735574+0000","last_undegraded":"2023-11-08T19:30:02.735574+0000","last_fullsized":"2023-11-08T19:30:02.735574+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:21:00.981136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003067771,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":44,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.066376+0000","last_change":"2023-11-08T19:25:47.287986+0000","last_active":"2023-11-08T19:30:03.066376+0000","last_peered":"2023-11-08T19:30:03.066376+0000","last_clean":"2023-11-08T19:30:03.066376+0000","last_became_active":"2023-11-08T19:25:47.287560+0000","last_became_peered":"2023-11-08T19:25:47.287560+0000","last_unstale":"2023-11-08T19:30:03.066376+0000","last_undegraded":"2023-11-08T19:30:03.066376+0000","last_fullsized":"2023-11-08T19:30:03.066376+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:35:31.433056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":76,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:02.735507+0000","last_change":"2023-11-08T19:24:32.530620+0000","last_active":"2023-11-08T19:30:02.735507+0000","last_peered":"2023-11-08T19:30:02.735507+0000","last_clean":"2023-11-08T19:30:02.735507+0000","last_became_active":"2023-11-08T19:24:31.144223+0000","last_became_peered":"2023-11-08T19:24:31.144223+0000","last_unstale":"2023-11-08T19:30:02.735507+0000","last_undegraded":"2023-11-08T19:30:02.735507+0000","last_fullsized":"2023-11-08T19:30:02.735507+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:01:25.647952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071879799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":59,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.746498+0000","last_change":"2023-11-08T19:25:48.285326+0000","last_active":"2023-11-08T19:30:04.746498+0000","last_peered":"2023-11-08T19:30:04.746498+0000","last_clean":"2023-11-08T19:30:04.746498+0000","last_became_active":"2023-11-08T19:25:46.278686+0000","last_became_peered":"2023-11-08T19:25:46.278686+0000","last_unstale":"2023-11-08T19:30:04.746498+0000","last_undegraded":"2023-11-08T19:30:04.746498+0000","last_fullsized":"2023-11-08T19:30:04.746498+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:25:34.010085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078409499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":52,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.746273+0000","last_change":"2023-11-08T19:25:47.289726+0000","last_active":"2023-11-08T19:30:04.746273+0000","last_peered":"2023-11-08T19:30:04.746273+0000","last_clean":"2023-11-08T19:30:04.746273+0000","last_became_active":"2023-11-08T19:25:47.289362+0000","last_became_peered":"2023-11-08T19:25:47.289362+0000","last_unstale":"2023-11-08T19:30:04.746273+0000","last_undegraded":"2023-11-08T19:30:04.746273+0000","last_fullsized":"2023-11-08T19:30:04.746273+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:38:55.785104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":75,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.066507+0000","last_change":"2023-11-08T19:24:32.147025+0000","last_active":"2023-11-08T19:30:03.066507+0000","last_peered":"2023-11-08T19:30:03.066507+0000","last_clean":"2023-11-08T19:30:03.066507+0000","last_became_active":"2023-11-08T19:24:31.147082+0000","last_became_peered":"2023-11-08T19:24:31.147082+0000","last_unstale":"2023-11-08T19:30:03.066507+0000","last_undegraded":"2023-11-08T19:30:03.066507+0000","last_fullsized":"2023-11-08T19:30:03.066507+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:02:27.987795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043701599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":53,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:02.736356+0000","last_change":"2023-11-08T19:25:48.374739+0000","last_active":"2023-11-08T19:30:02.736356+0000","last_peered":"2023-11-08T19:30:02.736356+0000","last_clean":"2023-11-08T19:30:02.736356+0000","last_became_active":"2023-11-08T19:25:46.282071+0000","last_became_peered":"2023-11-08T19:25:46.282071+0000","last_unstale":"2023-11-08T19:30:02.736356+0000","last_undegraded":"2023-11-08T19:30:02.736356+0000","last_fullsized":"2023-11-08T19:30:02.736356+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:42:47.677504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023654909999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":76,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.065926+0000","last_change":"2023-11-08T19:24:32.544063+0000","last_active":"2023-11-08T19:30:03.065926+0000","last_peered":"2023-11-08T19:30:03.065926+0000","last_clean":"2023-11-08T19:30:03.065926+0000","last_became_active":"2023-11-08T19:24:31.144795+0000","last_became_peered":"2023-11-08T19:24:31.144795+0000","last_unstale":"2023-11-08T19:30:03.065926+0000","last_undegraded":"2023-11-08T19:30:03.065926+0000","last_fullsized":"2023-11-08T19:30:03.065926+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:12:42.248307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01495431,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":60,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.744117+0000","last_change":"2023-11-08T19:25:48.283673+0000","last_active":"2023-11-08T19:30:04.744117+0000","last_peered":"2023-11-08T19:30:04.744117+0000","last_clean":"2023-11-08T19:30:04.744117+0000","last_became_active":"2023-11-08T19:25:46.285766+0000","last_became_peered":"2023-11-08T19:25:46.285766+0000","last_unstale":"2023-11-08T19:30:04.744117+0000","last_undegraded":"2023-11-08T19:30:04.744117+0000","last_fullsized":"2023-11-08T19:30:04.744117+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:46:35.498766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001756748,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":45,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.066146+0000","last_change":"2023-11-08T19:25:47.288301+0000","last_active":"2023-11-08T19:30:03.066146+0000","last_peered":"2023-11-08T19:30:03.066146+0000","last_clean":"2023-11-08T19:30:03.066146+0000","last_became_active":"2023-11-08T19:25:47.288027+0000","last_became_peered":"2023-11-08T19:25:47.288027+0000","last_unstale":"2023-11-08T19:30:03.066146+0000","last_undegraded":"2023-11-08T19:30:03.066146+0000","last_fullsized":"2023-11-08T19:30:03.066146+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:23:13.428596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":76,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.066506+0000","last_change":"2023-11-08T19:24:32.263810+0000","last_active":"2023-11-08T19:30:03.066506+0000","last_peered":"2023-11-08T19:30:03.066506+0000","last_clean":"2023-11-08T19:30:03.066506+0000","last_became_active":"2023-11-08T19:24:31.138814+0000","last_became_peered":"2023-11-08T19:24:31.138814+0000","last_unstale":"2023-11-08T19:30:03.066506+0000","last_undegraded":"2023-11-08T19:30:03.066506+0000","last_fullsized":"2023-11-08T19:30:03.066506+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:21:55.985548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048136000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":60,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.742995+0000","last_change":"2023-11-08T19:25:48.283572+0000","last_active":"2023-11-08T19:30:04.742995+0000","last_peered":"2023-11-08T19:30:04.742995+0000","last_clean":"2023-11-08T19:30:04.742995+0000","last_became_active":"2023-11-08T19:25:46.271936+0000","last_became_peered":"2023-11-08T19:25:46.271936+0000","last_unstale":"2023-11-08T19:30:04.742995+0000","last_undegraded":"2023-11-08T19:30:04.742995+0000","last_fullsized":"2023-11-08T19:30:04.742995+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:46:11.541748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00186835,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":53,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.743957+0000","last_change":"2023-11-08T19:25:47.282856+0000","last_active":"2023-11-08T19:30:04.743957+0000","last_peered":"2023-11-08T19:30:04.743957+0000","last_clean":"2023-11-08T19:30:04.743957+0000","last_became_active":"2023-11-08T19:25:47.282594+0000","last_became_peered":"2023-11-08T19:25:47.282594+0000","last_unstale":"2023-11-08T19:30:04.743957+0000","last_undegraded":"2023-11-08T19:30:04.743957+0000","last_fullsized":"2023-11-08T19:30:04.743957+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:14:12.111756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":79,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.068077+0000","last_change":"2023-11-08T19:24:32.333096+0000","last_active":"2023-11-08T19:30:03.068077+0000","last_peered":"2023-11-08T19:30:03.068077+0000","last_clean":"2023-11-08T19:30:03.068077+0000","last_became_active":"2023-11-08T19:24:31.142985+0000","last_became_peered":"2023-11-08T19:24:31.142985+0000","last_unstale":"2023-11-08T19:30:03.068077+0000","last_undegraded":"2023-11-08T19:30:03.068077+0000","last_fullsized":"2023-11-08T19:30:03.068077+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:36:33.274496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000386048,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":54,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:02.735104+0000","last_change":"2023-11-08T19:25:48.372963+0000","last_active":"2023-11-08T19:30:02.735104+0000","last_peered":"2023-11-08T19:30:02.735104+0000","last_clean":"2023-11-08T19:30:02.735104+0000","last_became_active":"2023-11-08T19:25:46.283263+0000","last_became_peered":"2023-11-08T19:25:46.283263+0000","last_unstale":"2023-11-08T19:30:02.735104+0000","last_undegraded":"2023-11-08T19:30:02.735104+0000","last_fullsized":"2023-11-08T19:30:02.735104+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:25:34.010085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019848779999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":48,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.292775+0000","last_change":"2023-11-08T19:25:47.284816+0000","last_active":"2023-11-08T19:30:05.292775+0000","last_peered":"2023-11-08T19:30:05.292775+0000","last_clean":"2023-11-08T19:30:05.292775+0000","last_became_active":"2023-11-08T19:25:47.284522+0000","last_became_peered":"2023-11-08T19:25:47.284522+0000","last_unstale":"2023-11-08T19:30:05.292775+0000","last_undegraded":"2023-11-08T19:30:05.292775+0000","last_fullsized":"2023-11-08T19:30:05.292775+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:39:28.223686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":76,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:02.734732+0000","last_change":"2023-11-08T19:24:32.530333+0000","last_active":"2023-11-08T19:30:02.734732+0000","last_peered":"2023-11-08T19:30:02.734732+0000","last_clean":"2023-11-08T19:30:02.734732+0000","last_became_active":"2023-11-08T19:24:31.144838+0000","last_became_peered":"2023-11-08T19:24:31.144838+0000","last_unstale":"2023-11-08T19:30:02.734732+0000","last_undegraded":"2023-11-08T19:30:02.734732+0000","last_fullsized":"2023-11-08T19:30:02.734732+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:39:48.473183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081588799999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":60,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.744392+0000","last_change":"2023-11-08T19:25:48.284699+0000","last_active":"2023-11-08T19:30:04.744392+0000","last_peered":"2023-11-08T19:30:04.744392+0000","last_clean":"2023-11-08T19:30:04.744392+0000","last_became_active":"2023-11-08T19:25:46.285588+0000","last_became_peered":"2023-11-08T19:25:46.285588+0000","last_unstale":"2023-11-08T19:30:04.744392+0000","last_undegraded":"2023-11-08T19:30:04.744392+0000","last_fullsized":"2023-11-08T19:30:04.744392+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:43:02.001903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023282350000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":47,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:02.735054+0000","last_change":"2023-11-08T19:25:47.283526+0000","last_active":"2023-11-08T19:30:02.735054+0000","last_peered":"2023-11-08T19:30:02.735054+0000","last_clean":"2023-11-08T19:30:02.735054+0000","last_became_active":"2023-11-08T19:25:47.283266+0000","last_became_peered":"2023-11-08T19:25:47.283266+0000","last_unstale":"2023-11-08T19:30:02.735054+0000","last_undegraded":"2023-11-08T19:30:02.735054+0000","last_fullsized":"2023-11-08T19:30:02.735054+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:35:31.433056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":79,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.068573+0000","last_change":"2023-11-08T19:24:32.333430+0000","last_active":"2023-11-08T19:30:03.068573+0000","last_peered":"2023-11-08T19:30:03.068573+0000","last_clean":"2023-11-08T19:30:03.068573+0000","last_became_active":"2023-11-08T19:24:31.141710+0000","last_became_peered":"2023-11-08T19:24:31.141710+0000","last_unstale":"2023-11-08T19:30:03.068573+0000","last_undegraded":"2023-11-08T19:30:03.068573+0000","last_fullsized":"2023-11-08T19:30:03.068573+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:32:51.214551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000430438,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":60,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.746468+0000","last_change":"2023-11-08T19:25:48.283855+0000","last_active":"2023-11-08T19:30:04.746468+0000","last_peered":"2023-11-08T19:30:04.746468+0000","last_clean":"2023-11-08T19:30:04.746468+0000","last_became_active":"2023-11-08T19:25:46.273336+0000","last_became_peered":"2023-11-08T19:25:46.273336+0000","last_unstale":"2023-11-08T19:30:04.746468+0000","last_undegraded":"2023-11-08T19:30:04.746468+0000","last_fullsized":"2023-11-08T19:30:04.746468+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:33:35.492889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092577200000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":53,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.743373+0000","last_change":"2023-11-08T19:25:47.282840+0000","last_active":"2023-11-08T19:30:04.743373+0000","last_peered":"2023-11-08T19:30:04.743373+0000","last_clean":"2023-11-08T19:30:04.743373+0000","last_became_active":"2023-11-08T19:25:47.282600+0000","last_became_peered":"2023-11-08T19:25:47.282600+0000","last_unstale":"2023-11-08T19:30:04.743373+0000","last_undegraded":"2023-11-08T19:30:04.743373+0000","last_fullsized":"2023-11-08T19:30:04.743373+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:53:37.482245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":53,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.743282+0000","last_change":"2023-11-08T19:25:47.285890+0000","last_active":"2023-11-08T19:30:04.743282+0000","last_peered":"2023-11-08T19:30:04.743282+0000","last_clean":"2023-11-08T19:30:04.743282+0000","last_became_active":"2023-11-08T19:25:47.285641+0000","last_became_peered":"2023-11-08T19:25:47.285641+0000","last_unstale":"2023-11-08T19:30:04.743282+0000","last_undegraded":"2023-11-08T19:30:04.743282+0000","last_fullsized":"2023-11-08T19:30:04.743282+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:27:18.335142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":76,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:02.736362+0000","last_change":"2023-11-08T19:24:32.530895+0000","last_active":"2023-11-08T19:30:02.736362+0000","last_peered":"2023-11-08T19:30:02.736362+0000","last_clean":"2023-11-08T19:30:02.736362+0000","last_became_active":"2023-11-08T19:24:31.146715+0000","last_became_peered":"2023-11-08T19:24:31.146715+0000","last_unstale":"2023-11-08T19:30:02.736362+0000","last_undegraded":"2023-11-08T19:30:02.736362+0000","last_fullsized":"2023-11-08T19:30:02.736362+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:39.214888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081671599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":60,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.743568+0000","last_change":"2023-11-08T19:25:48.284137+0000","last_active":"2023-11-08T19:30:04.743568+0000","last_peered":"2023-11-08T19:30:04.743568+0000","last_clean":"2023-11-08T19:30:04.743568+0000","last_became_active":"2023-11-08T19:25:46.285960+0000","last_became_peered":"2023-11-08T19:25:46.285960+0000","last_unstale":"2023-11-08T19:30:04.743568+0000","last_undegraded":"2023-11-08T19:30:04.743568+0000","last_fullsized":"2023-11-08T19:30:04.743568+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:26:01.141206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091649099999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":52,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.744689+0000","last_change":"2023-11-08T19:25:47.283642+0000","last_active":"2023-11-08T19:30:04.744689+0000","last_peered":"2023-11-08T19:30:04.744689+0000","last_clean":"2023-11-08T19:30:04.744689+0000","last_became_active":"2023-11-08T19:25:47.283360+0000","last_became_peered":"2023-11-08T19:25:47.283360+0000","last_unstale":"2023-11-08T19:30:04.744689+0000","last_undegraded":"2023-11-08T19:30:04.744689+0000","last_fullsized":"2023-11-08T19:30:04.744689+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:02:27.950152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":86,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.743654+0000","last_change":"2023-11-08T19:24:32.140167+0000","last_active":"2023-11-08T19:30:04.743654+0000","last_peered":"2023-11-08T19:30:04.743654+0000","last_clean":"2023-11-08T19:30:04.743654+0000","last_became_active":"2023-11-08T19:24:31.147181+0000","last_became_peered":"2023-11-08T19:24:31.147181+0000","last_unstale":"2023-11-08T19:30:04.743654+0000","last_undegraded":"2023-11-08T19:30:04.743654+0000","last_fullsized":"2023-11-08T19:30:04.743654+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:26.080042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057135200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":52,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.295903+0000","last_change":"2023-11-08T19:25:48.277705+0000","last_active":"2023-11-08T19:30:05.295903+0000","last_peered":"2023-11-08T19:30:05.295903+0000","last_clean":"2023-11-08T19:30:05.295903+0000","last_became_active":"2023-11-08T19:25:46.288848+0000","last_became_peered":"2023-11-08T19:25:46.288848+0000","last_unstale":"2023-11-08T19:30:05.295903+0000","last_undegraded":"2023-11-08T19:30:05.295903+0000","last_fullsized":"2023-11-08T19:30:05.295903+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:12:24.483185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097653099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":44,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.066512+0000","last_change":"2023-11-08T19:25:47.289456+0000","last_active":"2023-11-08T19:30:03.066512+0000","last_peered":"2023-11-08T19:30:03.066512+0000","last_clean":"2023-11-08T19:30:03.066512+0000","last_became_active":"2023-11-08T19:25:47.289177+0000","last_became_peered":"2023-11-08T19:25:47.289177+0000","last_unstale":"2023-11-08T19:30:03.066512+0000","last_undegraded":"2023-11-08T19:30:03.066512+0000","last_fullsized":"2023-11-08T19:30:03.066512+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:07:11.838364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":86,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.746322+0000","last_change":"2023-11-08T19:24:32.141188+0000","last_active":"2023-11-08T19:30:04.746322+0000","last_peered":"2023-11-08T19:30:04.746322+0000","last_clean":"2023-11-08T19:30:04.746322+0000","last_became_active":"2023-11-08T19:24:31.148857+0000","last_became_peered":"2023-11-08T19:24:31.148857+0000","last_unstale":"2023-11-08T19:30:04.746322+0000","last_undegraded":"2023-11-08T19:30:04.746322+0000","last_fullsized":"2023-11-08T19:30:04.746322+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:45:34.425432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065078599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":52,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.295127+0000","last_change":"2023-11-08T19:25:48.277423+0000","last_active":"2023-11-08T19:30:05.295127+0000","last_peered":"2023-11-08T19:30:05.295127+0000","last_clean":"2023-11-08T19:30:05.295127+0000","last_became_active":"2023-11-08T19:25:46.286211+0000","last_became_peered":"2023-11-08T19:25:46.286211+0000","last_unstale":"2023-11-08T19:30:05.295127+0000","last_undegraded":"2023-11-08T19:30:05.295127+0000","last_fullsized":"2023-11-08T19:30:05.295127+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:44:05.347800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073775700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":44,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.065924+0000","last_change":"2023-11-08T19:25:47.286020+0000","last_active":"2023-11-08T19:30:03.065924+0000","last_peered":"2023-11-08T19:30:03.065924+0000","last_clean":"2023-11-08T19:30:03.065924+0000","last_became_active":"2023-11-08T19:25:47.285728+0000","last_became_peered":"2023-11-08T19:25:47.285728+0000","last_unstale":"2023-11-08T19:30:03.065924+0000","last_undegraded":"2023-11-08T19:30:03.065924+0000","last_fullsized":"2023-11-08T19:30:03.065924+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:26:02.147090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":86,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.745467+0000","last_change":"2023-11-08T19:24:32.140832+0000","last_active":"2023-11-08T19:30:04.745467+0000","last_peered":"2023-11-08T19:30:04.745467+0000","last_clean":"2023-11-08T19:30:04.745467+0000","last_became_active":"2023-11-08T19:24:31.146557+0000","last_became_peered":"2023-11-08T19:24:31.146557+0000","last_unstale":"2023-11-08T19:30:04.745467+0000","last_undegraded":"2023-11-08T19:30:04.745467+0000","last_fullsized":"2023-11-08T19:30:04.745467+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:40:04.258107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099450100000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":53,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:02.734608+0000","last_change":"2023-11-08T19:25:48.372913+0000","last_active":"2023-11-08T19:30:02.734608+0000","last_peered":"2023-11-08T19:30:02.734608+0000","last_clean":"2023-11-08T19:30:02.734608+0000","last_became_active":"2023-11-08T19:25:46.281273+0000","last_became_peered":"2023-11-08T19:25:46.281273+0000","last_unstale":"2023-11-08T19:30:02.734608+0000","last_undegraded":"2023-11-08T19:30:02.734608+0000","last_fullsized":"2023-11-08T19:30:02.734608+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:07:10.832480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020904819999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":45,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.065384+0000","last_change":"2023-11-08T19:25:47.288256+0000","last_active":"2023-11-08T19:30:03.065384+0000","last_peered":"2023-11-08T19:30:03.065384+0000","last_clean":"2023-11-08T19:30:03.065384+0000","last_became_active":"2023-11-08T19:25:47.287905+0000","last_became_peered":"2023-11-08T19:25:47.287905+0000","last_unstale":"2023-11-08T19:30:03.065384+0000","last_undegraded":"2023-11-08T19:30:03.065384+0000","last_fullsized":"2023-11-08T19:30:03.065384+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:50:12.309248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":76,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:02.735192+0000","last_change":"2023-11-08T19:24:32.530378+0000","last_active":"2023-11-08T19:30:02.735192+0000","last_peered":"2023-11-08T19:30:02.735192+0000","last_clean":"2023-11-08T19:30:02.735192+0000","last_became_active":"2023-11-08T19:24:31.144341+0000","last_became_peered":"2023-11-08T19:24:31.144341+0000","last_unstale":"2023-11-08T19:30:02.735192+0000","last_undegraded":"2023-11-08T19:30:02.735192+0000","last_fullsized":"2023-11-08T19:30:02.735192+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:30:21.946303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058308299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":51,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.065803+0000","last_change":"2023-11-08T19:25:48.277150+0000","last_active":"2023-11-08T19:30:03.065803+0000","last_peered":"2023-11-08T19:30:03.065803+0000","last_clean":"2023-11-08T19:30:03.065803+0000","last_became_active":"2023-11-08T19:25:46.286933+0000","last_became_peered":"2023-11-08T19:25:46.286933+0000","last_unstale":"2023-11-08T19:30:03.065803+0000","last_undegraded":"2023-11-08T19:30:03.065803+0000","last_fullsized":"2023-11-08T19:30:03.065803+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:38:38.890354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080507500000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":44,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.066287+0000","last_change":"2023-11-08T19:25:47.282986+0000","last_active":"2023-11-08T19:30:03.066287+0000","last_peered":"2023-11-08T19:30:03.066287+0000","last_clean":"2023-11-08T19:30:03.066287+0000","last_became_active":"2023-11-08T19:25:47.282705+0000","last_became_peered":"2023-11-08T19:25:47.282705+0000","last_unstale":"2023-11-08T19:30:03.066287+0000","last_undegraded":"2023-11-08T19:30:03.066287+0000","last_fullsized":"2023-11-08T19:30:03.066287+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:34:17.838942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":76,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.065508+0000","last_change":"2023-11-08T19:24:32.544108+0000","last_active":"2023-11-08T19:30:03.065508+0000","last_peered":"2023-11-08T19:30:03.065508+0000","last_clean":"2023-11-08T19:30:03.065508+0000","last_became_active":"2023-11-08T19:24:31.143812+0000","last_became_peered":"2023-11-08T19:24:31.143812+0000","last_unstale":"2023-11-08T19:30:03.065508+0000","last_undegraded":"2023-11-08T19:30:03.065508+0000","last_fullsized":"2023-11-08T19:30:03.065508+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:27:59.135977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014956126,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":59,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.745074+0000","last_change":"2023-11-08T19:25:48.284435+0000","last_active":"2023-11-08T19:30:04.745074+0000","last_peered":"2023-11-08T19:30:04.745074+0000","last_clean":"2023-11-08T19:30:04.745074+0000","last_became_active":"2023-11-08T19:25:46.284288+0000","last_became_peered":"2023-11-08T19:25:46.284288+0000","last_unstale":"2023-11-08T19:30:04.745074+0000","last_undegraded":"2023-11-08T19:30:04.745074+0000","last_fullsized":"2023-11-08T19:30:04.745074+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:57:53.083448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001250894,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":52,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.745027+0000","last_change":"2023-11-08T19:25:47.282612+0000","last_active":"2023-11-08T19:30:04.745027+0000","last_peered":"2023-11-08T19:30:04.745027+0000","last_clean":"2023-11-08T19:30:04.745027+0000","last_became_active":"2023-11-08T19:25:47.282299+0000","last_became_peered":"2023-11-08T19:25:47.282299+0000","last_unstale":"2023-11-08T19:30:04.745027+0000","last_undegraded":"2023-11-08T19:30:04.745027+0000","last_fullsized":"2023-11-08T19:30:04.745027+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:43:18.319773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":75,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.065897+0000","last_change":"2023-11-08T19:24:32.146639+0000","last_active":"2023-11-08T19:30:03.065897+0000","last_peered":"2023-11-08T19:30:03.065897+0000","last_clean":"2023-11-08T19:30:03.065897+0000","last_became_active":"2023-11-08T19:24:31.147384+0000","last_became_peered":"2023-11-08T19:24:31.147384+0000","last_unstale":"2023-11-08T19:30:03.065897+0000","last_undegraded":"2023-11-08T19:30:03.065897+0000","last_fullsized":"2023-11-08T19:30:03.065897+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:30:21.946303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043834899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":59,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.744165+0000","last_change":"2023-11-08T19:25:48.283541+0000","last_active":"2023-11-08T19:30:04.744165+0000","last_peered":"2023-11-08T19:30:04.744165+0000","last_clean":"2023-11-08T19:30:04.744165+0000","last_became_active":"2023-11-08T19:25:46.285626+0000","last_became_peered":"2023-11-08T19:25:46.285626+0000","last_unstale":"2023-11-08T19:30:04.744165+0000","last_undegraded":"2023-11-08T19:30:04.744165+0000","last_fullsized":"2023-11-08T19:30:04.744165+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:48:17.033319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019032459999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":52,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.743124+0000","last_change":"2023-11-08T19:25:47.287878+0000","last_active":"2023-11-08T19:30:04.743124+0000","last_peered":"2023-11-08T19:30:04.743124+0000","last_clean":"2023-11-08T19:30:04.743124+0000","last_became_active":"2023-11-08T19:25:47.287617+0000","last_became_peered":"2023-11-08T19:25:47.287617+0000","last_unstale":"2023-11-08T19:30:04.743124+0000","last_undegraded":"2023-11-08T19:30:04.743124+0000","last_fullsized":"2023-11-08T19:30:04.743124+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:20:50.791463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":87,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.744759+0000","last_change":"2023-11-08T19:24:32.142376+0000","last_active":"2023-11-08T19:30:04.744759+0000","last_peered":"2023-11-08T19:30:04.744759+0000","last_clean":"2023-11-08T19:30:04.744759+0000","last_became_active":"2023-11-08T19:24:31.144614+0000","last_became_peered":"2023-11-08T19:24:31.144614+0000","last_unstale":"2023-11-08T19:30:04.744759+0000","last_undegraded":"2023-11-08T19:30:04.744759+0000","last_fullsized":"2023-11-08T19:30:04.744759+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:09:04.880374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050362200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":53,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:02.735721+0000","last_change":"2023-11-08T19:25:48.373636+0000","last_active":"2023-11-08T19:30:02.735721+0000","last_peered":"2023-11-08T19:30:02.735721+0000","last_clean":"2023-11-08T19:30:02.735721+0000","last_became_active":"2023-11-08T19:25:46.283803+0000","last_became_peered":"2023-11-08T19:25:46.283803+0000","last_unstale":"2023-11-08T19:30:02.735721+0000","last_undegraded":"2023-11-08T19:30:02.735721+0000","last_fullsized":"2023-11-08T19:30:02.735721+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:00:34.691748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002404855,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":44,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.066383+0000","last_change":"2023-11-08T19:25:47.287741+0000","last_active":"2023-11-08T19:30:03.066383+0000","last_peered":"2023-11-08T19:30:03.066383+0000","last_clean":"2023-11-08T19:30:03.066383+0000","last_became_active":"2023-11-08T19:25:47.287428+0000","last_became_peered":"2023-11-08T19:25:47.287428+0000","last_unstale":"2023-11-08T19:30:03.066383+0000","last_undegraded":"2023-11-08T19:30:03.066383+0000","last_fullsized":"2023-11-08T19:30:03.066383+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:38:55.785104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":75,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.066583+0000","last_change":"2023-11-08T19:24:32.147235+0000","last_active":"2023-11-08T19:30:03.066583+0000","last_peered":"2023-11-08T19:30:03.066583+0000","last_clean":"2023-11-08T19:30:03.066583+0000","last_became_active":"2023-11-08T19:24:31.146176+0000","last_became_peered":"2023-11-08T19:24:31.146176+0000","last_unstale":"2023-11-08T19:30:03.066583+0000","last_undegraded":"2023-11-08T19:30:03.066583+0000","last_fullsized":"2023-11-08T19:30:03.066583+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:39.214888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048481000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":53,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:02.735676+0000","last_change":"2023-11-08T19:25:48.373345+0000","last_active":"2023-11-08T19:30:02.735676+0000","last_peered":"2023-11-08T19:30:02.735676+0000","last_clean":"2023-11-08T19:30:02.735676+0000","last_became_active":"2023-11-08T19:25:46.282460+0000","last_became_peered":"2023-11-08T19:25:46.282460+0000","last_unstale":"2023-11-08T19:30:02.735676+0000","last_undegraded":"2023-11-08T19:30:02.735676+0000","last_fullsized":"2023-11-08T19:30:02.735676+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:25:30.927920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001972863,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":53,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.744804+0000","last_change":"2023-11-08T19:25:47.283708+0000","last_active":"2023-11-08T19:30:04.744804+0000","last_peered":"2023-11-08T19:30:04.744804+0000","last_clean":"2023-11-08T19:30:04.744804+0000","last_became_active":"2023-11-08T19:25:47.283433+0000","last_became_peered":"2023-11-08T19:25:47.283433+0000","last_unstale":"2023-11-08T19:30:04.744804+0000","last_undegraded":"2023-11-08T19:30:04.744804+0000","last_fullsized":"2023-11-08T19:30:04.744804+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:30:17.627967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":76,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.066160+0000","last_change":"2023-11-08T19:24:32.543880+0000","last_active":"2023-11-08T19:30:03.066160+0000","last_peered":"2023-11-08T19:30:03.066160+0000","last_clean":"2023-11-08T19:30:03.066160+0000","last_became_active":"2023-11-08T19:24:31.142052+0000","last_became_peered":"2023-11-08T19:24:31.142052+0000","last_unstale":"2023-11-08T19:30:03.066160+0000","last_undegraded":"2023-11-08T19:30:03.066160+0000","last_fullsized":"2023-11-08T19:30:03.066160+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:18:42.371676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014881058000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":60,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.746318+0000","last_change":"2023-11-08T19:25:48.284890+0000","last_active":"2023-11-08T19:30:04.746318+0000","last_peered":"2023-11-08T19:30:04.746318+0000","last_clean":"2023-11-08T19:30:04.746318+0000","last_became_active":"2023-11-08T19:25:46.279287+0000","last_became_peered":"2023-11-08T19:25:46.279287+0000","last_unstale":"2023-11-08T19:30:04.746318+0000","last_undegraded":"2023-11-08T19:30:04.746318+0000","last_fullsized":"2023-11-08T19:30:04.746318+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:35:30.427172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076856899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":53,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.746191+0000","last_change":"2023-11-08T19:25:47.285867+0000","last_active":"2023-11-08T19:30:04.746191+0000","last_peered":"2023-11-08T19:30:04.746191+0000","last_clean":"2023-11-08T19:30:04.746191+0000","last_became_active":"2023-11-08T19:25:47.285533+0000","last_became_peered":"2023-11-08T19:25:47.285533+0000","last_unstale":"2023-11-08T19:30:04.746191+0000","last_undegraded":"2023-11-08T19:30:04.746191+0000","last_fullsized":"2023-11-08T19:30:04.746191+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:26:59.852338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":75,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.066493+0000","last_change":"2023-11-08T19:24:32.147011+0000","last_active":"2023-11-08T19:30:03.066493+0000","last_peered":"2023-11-08T19:30:03.066493+0000","last_clean":"2023-11-08T19:30:03.066493+0000","last_became_active":"2023-11-08T19:24:31.148250+0000","last_became_peered":"2023-11-08T19:24:31.148250+0000","last_unstale":"2023-11-08T19:30:03.066493+0000","last_undegraded":"2023-11-08T19:30:03.066493+0000","last_fullsized":"2023-11-08T19:30:03.066493+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:01:25.647952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043061299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":60,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.744846+0000","last_change":"2023-11-08T19:25:48.284869+0000","last_active":"2023-11-08T19:30:04.744846+0000","last_peered":"2023-11-08T19:30:04.744846+0000","last_clean":"2023-11-08T19:30:04.744846+0000","last_became_active":"2023-11-08T19:25:46.285478+0000","last_became_peered":"2023-11-08T19:25:46.285478+0000","last_unstale":"2023-11-08T19:30:04.744846+0000","last_undegraded":"2023-11-08T19:30:04.744846+0000","last_fullsized":"2023-11-08T19:30:04.744846+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:49:51.368808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000376339,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":44,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.065727+0000","last_change":"2023-11-08T19:25:47.284429+0000","last_active":"2023-11-08T19:30:03.065727+0000","last_peered":"2023-11-08T19:30:03.065727+0000","last_clean":"2023-11-08T19:30:03.065727+0000","last_became_active":"2023-11-08T19:25:47.283990+0000","last_became_peered":"2023-11-08T19:25:47.283990+0000","last_unstale":"2023-11-08T19:30:03.065727+0000","last_undegraded":"2023-11-08T19:30:03.065727+0000","last_fullsized":"2023-11-08T19:30:03.065727+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:59:08.628317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":87,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.744493+0000","last_change":"2023-11-08T19:24:32.141190+0000","last_active":"2023-11-08T19:30:04.744493+0000","last_peered":"2023-11-08T19:30:04.744493+0000","last_clean":"2023-11-08T19:30:04.744493+0000","last_became_active":"2023-11-08T19:24:31.147651+0000","last_became_peered":"2023-11-08T19:24:31.147651+0000","last_unstale":"2023-11-08T19:30:04.744493+0000","last_undegraded":"2023-11-08T19:30:04.744493+0000","last_fullsized":"2023-11-08T19:30:04.744493+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:21:55.985548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043673300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":54,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.292742+0000","last_change":"2023-11-08T19:25:48.320707+0000","last_active":"2023-11-08T19:30:05.292742+0000","last_peered":"2023-11-08T19:30:05.292742+0000","last_clean":"2023-11-08T19:30:05.292742+0000","last_became_active":"2023-11-08T19:25:46.282307+0000","last_became_peered":"2023-11-08T19:25:46.282307+0000","last_unstale":"2023-11-08T19:30:05.292742+0000","last_undegraded":"2023-11-08T19:30:05.292742+0000","last_fullsized":"2023-11-08T19:30:05.292742+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:53:36.476361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047078400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":44,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.066183+0000","last_change":"2023-11-08T19:25:47.284227+0000","last_active":"2023-11-08T19:30:03.066183+0000","last_peered":"2023-11-08T19:30:03.066183+0000","last_clean":"2023-11-08T19:30:03.066183+0000","last_became_active":"2023-11-08T19:25:47.283927+0000","last_became_peered":"2023-11-08T19:25:47.283927+0000","last_unstale":"2023-11-08T19:30:03.066183+0000","last_undegraded":"2023-11-08T19:30:03.066183+0000","last_fullsized":"2023-11-08T19:30:03.066183+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:15:23.188047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":76,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:02.735188+0000","last_change":"2023-11-08T19:24:32.530168+0000","last_active":"2023-11-08T19:30:02.735188+0000","last_peered":"2023-11-08T19:30:02.735188+0000","last_clean":"2023-11-08T19:30:02.735188+0000","last_became_active":"2023-11-08T19:24:31.144329+0000","last_became_peered":"2023-11-08T19:24:31.144329+0000","last_unstale":"2023-11-08T19:30:02.735188+0000","last_undegraded":"2023-11-08T19:30:02.735188+0000","last_fullsized":"2023-11-08T19:30:02.735188+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:05:36.085920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043484799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":53,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:02.734880+0000","last_change":"2023-11-08T19:25:48.371291+0000","last_active":"2023-11-08T19:30:02.734880+0000","last_peered":"2023-11-08T19:30:02.734880+0000","last_clean":"2023-11-08T19:30:02.734880+0000","last_became_active":"2023-11-08T19:25:46.281425+0000","last_became_peered":"2023-11-08T19:25:46.281425+0000","last_unstale":"2023-11-08T19:30:02.734880+0000","last_undegraded":"2023-11-08T19:30:02.734880+0000","last_fullsized":"2023-11-08T19:30:02.734880+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:23:12.422712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00124314,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":46,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:02.735040+0000","last_change":"2023-11-08T19:25:47.281724+0000","last_active":"2023-11-08T19:30:02.735040+0000","last_peered":"2023-11-08T19:30:02.735040+0000","last_clean":"2023-11-08T19:30:02.735040+0000","last_became_active":"2023-11-08T19:25:47.281425+0000","last_became_peered":"2023-11-08T19:25:47.281425+0000","last_unstale":"2023-11-08T19:30:02.735040+0000","last_undegraded":"2023-11-08T19:30:02.735040+0000","last_fullsized":"2023-11-08T19:30:02.735040+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:38:55.785104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":76,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:02.734938+0000","last_change":"2023-11-08T19:24:32.529486+0000","last_active":"2023-11-08T19:30:02.734938+0000","last_peered":"2023-11-08T19:30:02.734938+0000","last_clean":"2023-11-08T19:30:02.734938+0000","last_became_active":"2023-11-08T19:24:31.146260+0000","last_became_peered":"2023-11-08T19:24:31.146260+0000","last_unstale":"2023-11-08T19:30:02.734938+0000","last_undegraded":"2023-11-08T19:30:02.734938+0000","last_fullsized":"2023-11-08T19:30:02.734938+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:45:34.425432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059842900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":51,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.066586+0000","last_change":"2023-11-08T19:25:48.277457+0000","last_active":"2023-11-08T19:30:03.066586+0000","last_peered":"2023-11-08T19:30:03.066586+0000","last_clean":"2023-11-08T19:30:03.066586+0000","last_became_active":"2023-11-08T19:25:46.286239+0000","last_became_peered":"2023-11-08T19:25:46.286239+0000","last_unstale":"2023-11-08T19:30:03.066586+0000","last_undegraded":"2023-11-08T19:30:03.066586+0000","last_fullsized":"2023-11-08T19:30:03.066586+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:09:43.662108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000722421,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":44,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.066108+0000","last_change":"2023-11-08T19:25:47.287874+0000","last_active":"2023-11-08T19:30:03.066108+0000","last_peered":"2023-11-08T19:30:03.066108+0000","last_clean":"2023-11-08T19:30:03.066108+0000","last_became_active":"2023-11-08T19:25:47.287456+0000","last_became_peered":"2023-11-08T19:25:47.287456+0000","last_unstale":"2023-11-08T19:30:03.066108+0000","last_undegraded":"2023-11-08T19:30:03.066108+0000","last_fullsized":"2023-11-08T19:30:03.066108+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:26:59.852338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":86,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.744037+0000","last_change":"2023-11-08T19:24:32.141131+0000","last_active":"2023-11-08T19:30:04.744037+0000","last_peered":"2023-11-08T19:30:04.744037+0000","last_clean":"2023-11-08T19:30:04.744037+0000","last_became_active":"2023-11-08T19:24:31.146154+0000","last_became_peered":"2023-11-08T19:24:31.146154+0000","last_unstale":"2023-11-08T19:30:04.744037+0000","last_undegraded":"2023-11-08T19:30:04.744037+0000","last_fullsized":"2023-11-08T19:30:04.744037+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:18:40.271560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082432800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":52,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.065997+0000","last_change":"2023-11-08T19:25:48.372729+0000","last_active":"2023-11-08T19:30:03.065997+0000","last_peered":"2023-11-08T19:30:03.065997+0000","last_clean":"2023-11-08T19:30:03.065997+0000","last_became_active":"2023-11-08T19:25:46.290114+0000","last_became_peered":"2023-11-08T19:25:46.290114+0000","last_unstale":"2023-11-08T19:30:03.065997+0000","last_undegraded":"2023-11-08T19:30:03.065997+0000","last_fullsized":"2023-11-08T19:30:03.065997+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:49:36.208776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061009499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":46,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:02.735668+0000","last_change":"2023-11-08T19:25:47.283046+0000","last_active":"2023-11-08T19:30:02.735668+0000","last_peered":"2023-11-08T19:30:02.735668+0000","last_clean":"2023-11-08T19:30:02.735668+0000","last_became_active":"2023-11-08T19:25:47.282763+0000","last_became_peered":"2023-11-08T19:25:47.282763+0000","last_unstale":"2023-11-08T19:30:02.735668+0000","last_undegraded":"2023-11-08T19:30:02.735668+0000","last_fullsized":"2023-11-08T19:30:02.735668+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:12:51.389167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":76,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.066157+0000","last_change":"2023-11-08T19:24:32.263963+0000","last_active":"2023-11-08T19:30:03.066157+0000","last_peered":"2023-11-08T19:30:03.066157+0000","last_clean":"2023-11-08T19:30:03.066157+0000","last_became_active":"2023-11-08T19:24:31.139062+0000","last_became_peered":"2023-11-08T19:24:31.139062+0000","last_unstale":"2023-11-08T19:30:03.066157+0000","last_undegraded":"2023-11-08T19:30:03.066157+0000","last_fullsized":"2023-11-08T19:30:03.066157+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:26.080042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033682599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":59,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.746216+0000","last_change":"2023-11-08T19:25:48.283302+0000","last_active":"2023-11-08T19:30:04.746216+0000","last_peered":"2023-11-08T19:30:04.746216+0000","last_clean":"2023-11-08T19:30:04.746216+0000","last_became_active":"2023-11-08T19:25:46.284287+0000","last_became_peered":"2023-11-08T19:25:46.284287+0000","last_unstale":"2023-11-08T19:30:04.746216+0000","last_undegraded":"2023-11-08T19:30:04.746216+0000","last_fullsized":"2023-11-08T19:30:04.746216+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:39:27.217802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097880800000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":52,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.743835+0000","last_change":"2023-11-08T19:25:47.286434+0000","last_active":"2023-11-08T19:30:04.743835+0000","last_peered":"2023-11-08T19:30:04.743835+0000","last_clean":"2023-11-08T19:30:04.743835+0000","last_became_active":"2023-11-08T19:25:47.286181+0000","last_became_peered":"2023-11-08T19:25:47.286181+0000","last_unstale":"2023-11-08T19:30:04.743835+0000","last_undegraded":"2023-11-08T19:30:04.743835+0000","last_fullsized":"2023-11-08T19:30:04.743835+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:13:27.285648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":86,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.746426+0000","last_change":"2023-11-08T19:24:32.140514+0000","last_active":"2023-11-08T19:30:04.746426+0000","last_peered":"2023-11-08T19:30:04.746426+0000","last_clean":"2023-11-08T19:30:04.746426+0000","last_became_active":"2023-11-08T19:24:31.146668+0000","last_became_peered":"2023-11-08T19:24:31.146668+0000","last_unstale":"2023-11-08T19:30:04.746426+0000","last_undegraded":"2023-11-08T19:30:04.746426+0000","last_fullsized":"2023-11-08T19:30:04.746426+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:31:24.539374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071576699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":54,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.292979+0000","last_change":"2023-11-08T19:25:48.320667+0000","last_active":"2023-11-08T19:30:05.292979+0000","last_peered":"2023-11-08T19:30:05.292979+0000","last_clean":"2023-11-08T19:30:05.292979+0000","last_became_active":"2023-11-08T19:25:46.290246+0000","last_became_peered":"2023-11-08T19:25:46.290246+0000","last_unstale":"2023-11-08T19:30:05.292979+0000","last_undegraded":"2023-11-08T19:30:05.292979+0000","last_fullsized":"2023-11-08T19:30:05.292979+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:33:35.492889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000423211,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":45,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.066689+0000","last_change":"2023-11-08T19:25:47.287717+0000","last_active":"2023-11-08T19:30:03.066689+0000","last_peered":"2023-11-08T19:30:03.066689+0000","last_clean":"2023-11-08T19:30:03.066689+0000","last_became_active":"2023-11-08T19:25:47.287412+0000","last_became_peered":"2023-11-08T19:25:47.287412+0000","last_unstale":"2023-11-08T19:30:03.066689+0000","last_undegraded":"2023-11-08T19:30:03.066689+0000","last_fullsized":"2023-11-08T19:30:03.066689+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:18:04.478139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":78,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.293087+0000","last_change":"2023-11-08T19:24:32.142892+0000","last_active":"2023-11-08T19:30:05.293087+0000","last_peered":"2023-11-08T19:30:05.293087+0000","last_clean":"2023-11-08T19:30:05.293087+0000","last_became_active":"2023-11-08T19:24:31.144912+0000","last_became_peered":"2023-11-08T19:24:31.144912+0000","last_unstale":"2023-11-08T19:30:05.293087+0000","last_undegraded":"2023-11-08T19:30:05.293087+0000","last_fullsized":"2023-11-08T19:30:05.293087+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:04:21.151484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056686900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":59,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.746370+0000","last_change":"2023-11-08T19:25:48.285205+0000","last_active":"2023-11-08T19:30:04.746370+0000","last_peered":"2023-11-08T19:30:04.746370+0000","last_clean":"2023-11-08T19:30:04.746370+0000","last_became_active":"2023-11-08T19:25:46.285848+0000","last_became_peered":"2023-11-08T19:25:46.285848+0000","last_unstale":"2023-11-08T19:30:04.746370+0000","last_undegraded":"2023-11-08T19:30:04.746370+0000","last_fullsized":"2023-11-08T19:30:04.746370+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:07:10.832480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089732199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":47,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.293661+0000","last_change":"2023-11-08T19:25:47.280177+0000","last_active":"2023-11-08T19:30:05.293661+0000","last_peered":"2023-11-08T19:30:05.293661+0000","last_clean":"2023-11-08T19:30:05.293661+0000","last_became_active":"2023-11-08T19:25:47.279913+0000","last_became_peered":"2023-11-08T19:25:47.279913+0000","last_unstale":"2023-11-08T19:30:05.293661+0000","last_undegraded":"2023-11-08T19:30:05.293661+0000","last_fullsized":"2023-11-08T19:30:05.293661+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:26:02.147090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":76,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-08T19:30:03.067058+0000","last_change":"2023-11-08T19:24:32.263958+0000","last_active":"2023-11-08T19:30:03.067058+0000","last_peered":"2023-11-08T19:30:03.067058+0000","last_clean":"2023-11-08T19:30:03.067058+0000","last_became_active":"2023-11-08T19:24:31.149011+0000","last_became_peered":"2023-11-08T19:24:31.149011+0000","last_unstale":"2023-11-08T19:30:03.067058+0000","last_undegraded":"2023-11-08T19:30:03.067058+0000","last_fullsized":"2023-11-08T19:30:03.067058+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:09:04.880374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033496900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":59,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.746345+0000","last_change":"2023-11-08T19:25:48.285075+0000","last_active":"2023-11-08T19:30:04.746345+0000","last_peered":"2023-11-08T19:30:04.746345+0000","last_clean":"2023-11-08T19:30:04.746345+0000","last_became_active":"2023-11-08T19:25:46.272479+0000","last_became_peered":"2023-11-08T19:25:46.272479+0000","last_unstale":"2023-11-08T19:30:04.746345+0000","last_undegraded":"2023-11-08T19:30:04.746345+0000","last_fullsized":"2023-11-08T19:30:04.746345+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:23:12.422712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001158117,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574938,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28920,"kb_used_data":1900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342920,"statfs":{"total":96636764160,"available":96607150080,"internally_reserved":0,"allocated":1945600,"data_stored":1278562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:29:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.57599999999999996,"15min":0.54600000000000004},"min":{"1min":0.33800000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.75800000000000001,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58499999999999996,"15min":0.56899999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.377},"max":{"1min":0.747,"5min":0.75900000000000001,"15min":0.86699999999999999},"last":0.42899999999999999}]},{"osd":1,"last update":"Wed Nov 8 19:29:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55000000000000004,"15min":0.54800000000000004},"min":{"1min":0.36599999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.78500000000000003,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.502},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.55100000000000005,"15min":0.53600000000000003},"min":{"1min":0.42199999999999999,"5min":0.39200000000000002,"15min":0.37},"max":{"1min":0.78400000000000003,"5min":0.78900000000000003,"15min":0.79800000000000004},"last":0.47799999999999998}]},{"osd":2,"last update":"Wed Nov 8 19:29:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54000000000000004,"15min":0.51700000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.82599999999999996},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.55400000000000005,"15min":0.54100000000000004},"min":{"1min":0.38500000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76800000000000002,"5min":0.77800000000000002,"15min":0.81599999999999995},"last":0.56200000000000006}]},{"osd":3,"last update":"Wed Nov 8 19:29:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54100000000000004,"15min":0.53500000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.72699999999999998,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.746},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.59099999999999997,"15min":0.56699999999999995},"min":{"1min":0.45600000000000002,"5min":0.42399999999999999,"15min":0.36899999999999999},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.38400000000000001}]},{"osd":4,"last update":"Wed Nov 8 19:29:11 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.49399999999999999,"15min":0.48499999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.64700000000000002,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.497,"5min":0.51500000000000001,"15min":0.51700000000000002},"min":{"1min":0.35299999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.71499999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.83799999999999997}]},{"osd":5,"last update":"Wed Nov 8 19:29:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56200000000000006,"15min":0.54900000000000004},"min":{"1min":0.38400000000000001,"5min":0.35399999999999998,"15min":0.35099999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56899999999999995,"15min":0.57299999999999995},"min":{"1min":0.40400000000000003,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.76200000000000001,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.58799999999999997}]},{"osd":6,"last update":"Wed Nov 8 19:29:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59999999999999998,"15min":0.60799999999999998},"min":{"1min":0.40000000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.76100000000000001,"5min":0.82299999999999995,"15min":0.86399999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.58199999999999996,"15min":0.56699999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.874,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.79300000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574939,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28368,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343472,"statfs":{"total":96636764160,"available":96607715328,"internally_reserved":0,"allocated":1376256,"data_stored":703350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.53400000000000003,"15min":0.58399999999999996},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.81399999999999995,"5min":0.82199999999999995,"15min":1.7549999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.54300000000000004,"15min":0.58099999999999996},"min":{"1min":0.36599999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.76800000000000002,"5min":0.78800000000000003,"15min":1.478},"last":0.746}]},{"osd":1,"last update":"Wed Nov 8 19:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57699999999999996,"15min":0.59899999999999998},"min":{"1min":0.317,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.73699999999999999,"5min":0.80600000000000005,"15min":1.6619999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.622,"15min":0.65600000000000003},"min":{"1min":0.41799999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.77500000000000002,"5min":0.81699999999999995,"15min":1.649},"last":0.80900000000000005}]},{"osd":2,"last update":"Wed Nov 8 19:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.58499999999999996,"15min":0.56699999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76900000000000002,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.59499999999999997,"15min":0.623},"min":{"1min":0.40600000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.68999999999999995,"5min":0.77400000000000002,"15min":0.85399999999999998},"last":0.82599999999999996}]},{"osd":3,"last update":"Wed Nov 8 19:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55800000000000005,"15min":0.61399999999999999},"min":{"1min":0.38,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.68200000000000005,"5min":0.80300000000000005,"15min":1.766},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55400000000000005,"15min":0.60599999999999998},"min":{"1min":0.375,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73699999999999999,"5min":0.877,"15min":1.8580000000000001},"last":0.65400000000000003}]},{"osd":4,"last update":"Wed Nov 8 19:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.51800000000000002,"15min":0.53600000000000003},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.66600000000000004,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.755},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54500000000000004,"15min":0.57099999999999995},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.83499999999999996,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.56000000000000005}]},{"osd":5,"last update":"Wed Nov 8 19:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.52900000000000003,"15min":0.55900000000000005},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.79100000000000004,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57299999999999995,"15min":0.61899999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.72699999999999998,"5min":0.80200000000000005,"15min":0.82099999999999995},"last":0.89600000000000002}]},{"osd":7,"last update":"Wed Nov 8 19:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58299999999999996,"15min":0.60499999999999998},"min":{"1min":0.33400000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.873,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58899999999999997,"15min":0.63100000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.81299999999999994,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.83999999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28384,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343456,"statfs":{"total":96636764160,"available":96607698944,"internally_reserved":0,"allocated":1396736,"data_stored":714320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:30:02 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.35799999999999998},"min":{"1min":0.247,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.46899999999999997,"5min":0.51200000000000001,"15min":1.2090000000000001},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.376,"5min":0.35899999999999999,"15min":0.39700000000000002},"min":{"1min":0.23599999999999999,"5min":0.22900000000000001,"15min":0.19700000000000001},"max":{"1min":0.49299999999999999,"5min":0.61599999999999999,"15min":2.1850000000000001},"last":0.314}]},{"osd":2,"last update":"Wed Nov 8 19:30:02 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.35099999999999998,"15min":0.34799999999999998},"min":{"1min":0.26400000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.438,"5min":0.54400000000000004,"15min":0.59099999999999997},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.38700000000000001,"15min":0.39400000000000002},"min":{"1min":0.28299999999999997,"5min":0.253,"15min":0.24099999999999999},"max":{"1min":0.56000000000000005,"5min":0.623,"15min":1.2689999999999999},"last":0.252}]},{"osd":3,"last update":"Wed Nov 8 19:30:02 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.41199999999999998,"15min":0.41799999999999998},"min":{"1min":0.32400000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.622,"5min":0.63100000000000001,"15min":1.24},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.39900000000000002,"15min":0.44400000000000001},"min":{"1min":0.30599999999999999,"5min":0.26100000000000001,"15min":0.253},"max":{"1min":0.54500000000000004,"5min":0.68200000000000005,"15min":2.2120000000000002},"last":0.35399999999999998}]},{"osd":4,"last update":"Wed Nov 8 19:30:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.59299999999999997,"15min":0.60799999999999998},"min":{"1min":0.42399999999999999,"5min":0.36899999999999999,"15min":0.32100000000000001},"max":{"1min":0.82299999999999995,"5min":0.93400000000000005,"15min":2.1579999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.58899999999999997,"15min":0.57399999999999995},"min":{"1min":0.438,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.78200000000000003,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.45900000000000002}]},{"osd":5,"last update":"Wed Nov 8 19:30:02 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.59499999999999997,"15min":0.57099999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.38100000000000001},"max":{"1min":0.78300000000000003,"5min":0.82599999999999996,"15min":0.86399999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59599999999999997,"15min":0.60499999999999998},"min":{"1min":0.437,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77300000000000002,"5min":0.90800000000000003,"15min":1.115},"last":0.52700000000000002}]},{"osd":6,"last update":"Wed Nov 8 19:30:02 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.60099999999999998,"15min":0.628},"min":{"1min":0.40500000000000003,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.76800000000000002,"5min":0.88400000000000001,"15min":2.093},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.435,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.752,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.51200000000000001}]},{"osd":7,"last update":"Wed Nov 8 19:30:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.621,"15min":0.65700000000000003},"min":{"1min":0.44600000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.80300000000000005,"5min":0.876,"15min":1.591},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61099999999999999,"15min":0.66800000000000004},"min":{"1min":0.49299999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.77900000000000003,"5min":0.88400000000000001,"15min":2.1299999999999999},"last":0.44400000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574938,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33088,"kb_used_data":1908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338752,"statfs":{"total":96636764160,"available":96602882048,"internally_reserved":0,"allocated":1953792,"data_stored":1286063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:29:09 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.41099999999999998,"15min":0.96199999999999997},"min":{"1min":0.19500000000000001,"5min":0.192,"15min":0.192},"max":{"1min":0.56399999999999995,"5min":6.9509999999999996,"15min":19.295999999999999},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.371,"15min":0.874},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.55500000000000005,"5min":0.57399999999999995,"15min":17.204000000000001},"last":0.41799999999999998}]},{"osd":2,"last update":"Wed Nov 8 19:29:09 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.44500000000000001,"15min":0.58499999999999996},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.64100000000000001,"5min":6.8029999999999999,"15min":6.8029999999999999},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.40699999999999997,"15min":0.91500000000000004},"min":{"1min":0.28999999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.53900000000000003,"5min":1.3140000000000001,"15min":17.175000000000001},"last":0.32200000000000001}]},{"osd":3,"last update":"Wed Nov 8 19:29:09 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.52900000000000003,"15min":0.83799999999999997},"min":{"1min":0.27300000000000002,"5min":0.24399999999999999,"15min":0.22500000000000001},"max":{"1min":0.51400000000000001,"5min":16.661000000000001,"15min":16.661000000000001},"last":0.37},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.48799999999999999,"15min":0.43099999999999999},"min":{"1min":0.29899999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.73699999999999999,"5min":6.9859999999999998,"15min":6.9859999999999998},"last":0.47099999999999997}]},{"osd":4,"last update":"Wed Nov 8 19:29:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.60899999999999999,"15min":1.0720000000000001},"min":{"1min":0.373,"5min":0.313,"15min":0.313},"max":{"1min":0.72999999999999998,"5min":1.0029999999999999,"15min":17.056000000000001},"last":0.746},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.753,"15min":0.76100000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33000000000000002},"max":{"1min":0.72499999999999998,"5min":16.718,"15min":16.718},"last":0.56100000000000005}]},{"osd":5,"last update":"Wed Nov 8 19:29:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.746,"15min":0.76200000000000001},"min":{"1min":0.36199999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72899999999999998,"5min":16.609000000000002,"15min":16.609000000000002},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.65900000000000003,"15min":0.59499999999999997},"min":{"1min":0.40100000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77100000000000002,"5min":5.1639999999999997,"15min":5.1639999999999997},"last":0.58399999999999996}]},{"osd":6,"last update":"Wed Nov 8 19:29:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.68700000000000006,"15min":0.63300000000000001},"min":{"1min":0.45900000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.80600000000000005,"5min":6.6349999999999998,"15min":6.6349999999999998},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.65300000000000002,"15min":1.1220000000000001},"min":{"1min":0.42199999999999999,"5min":0.35499999999999998,"15min":0.34899999999999998},"max":{"1min":0.81599999999999995,"5min":3.1400000000000001,"15min":17.111999999999998},"last":0.70899999999999996}]},{"osd":7,"last update":"Wed Nov 8 19:29:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63900000000000001,"15min":1.127},"min":{"1min":0.49299999999999999,"5min":0.376,"15min":0.376},"max":{"1min":0.79300000000000004,"5min":1.0760000000000001,"15min":17.146000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.76000000000000001,"15min":0.77300000000000002},"min":{"1min":0.441,"5min":0.40899999999999997,"15min":0.38800000000000001},"max":{"1min":0.76900000000000002,"5min":16.690999999999999,"15min":16.690999999999999},"last":0.59699999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574938,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28348,"kb_used_data":1328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343492,"statfs":{"total":96636764160,"available":96607735808,"internally_reserved":0,"allocated":1359872,"data_stored":695695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.33900000000000002,"15min":0.44400000000000001},"min":{"1min":0.22500000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.54300000000000004,"5min":0.61299999999999999,"15min":3.4100000000000001},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.38600000000000001,"15min":0.48299999999999998},"min":{"1min":0.28199999999999997,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":1.8340000000000001,"5min":1.8340000000000001,"15min":3.4369999999999998},"last":0.22}]},{"osd":1,"last update":"Wed Nov 8 19:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.38,"15min":0.51200000000000001},"min":{"1min":0.26400000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":4.0679999999999996},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.442,"15min":0.56200000000000006},"min":{"1min":0.309,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.68000000000000005,"5min":0.72099999999999997,"15min":4.3499999999999996},"last":0.34499999999999997}]},{"osd":3,"last update":"Wed Nov 8 19:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.40799999999999997,"15min":0.50800000000000001},"min":{"1min":0.247,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.57199999999999995,"5min":0.82999999999999996,"15min":3.8580000000000001},"last":0.317},{"interface":"front","average":{"1min":0.436,"5min":0.378,"15min":0.48399999999999999},"min":{"1min":0.30299999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":3.476},"last":0.248}]},{"osd":4,"last update":"Wed Nov 8 19:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.65300000000000002,"15min":0.70599999999999996},"min":{"1min":0.40899999999999997,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":4.7990000000000004,"5min":4.7990000000000004,"15min":4.7990000000000004},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.629,"5min":0.58999999999999997,"15min":0.70099999999999996},"min":{"1min":0.48199999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.76300000000000001,"5min":0.92300000000000004,"15min":4.1040000000000001},"last":0.41999999999999998}]},{"osd":5,"last update":"Wed Nov 8 19:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.60099999999999998,"15min":0.71199999999999997},"min":{"1min":0.41199999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.875,"5min":0.88,"15min":4.0869999999999997},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.64500000000000002,"15min":0.72899999999999998},"min":{"1min":0.42899999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":4.8239999999999998,"5min":4.8239999999999998,"15min":4.8239999999999998},"last":0.48099999999999998}]},{"osd":6,"last update":"Wed Nov 8 19:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.61099999999999999,"15min":0.72699999999999998},"min":{"1min":0.48099999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.83999999999999997,"5min":1.1200000000000001,"15min":4.1399999999999997},"last":0.433},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.60099999999999998,"15min":0.70499999999999996},"min":{"1min":0.42099999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.82099999999999995,"5min":0.85599999999999998,"15min":4.0499999999999998},"last":0.38}]},{"osd":7,"last update":"Wed Nov 8 19:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.64300000000000002,"15min":0.73999999999999999},"min":{"1min":0.46400000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.82499999999999996,"5min":1.181,"15min":4.157},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.65700000000000003,"15min":0.76700000000000002},"min":{"1min":0.55700000000000005,"5min":0.433,"15min":0.433},"max":{"1min":0.78500000000000003,"5min":1.222,"15min":4.1710000000000003},"last":0.45300000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574938,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28352,"kb_used_data":1328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343488,"statfs":{"total":96636764160,"available":96607731712,"internally_reserved":0,"allocated":1359872,"data_stored":695695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:29:04 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.373,"15min":0.38300000000000001},"min":{"1min":0.217,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":1.458},"last":0.373},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.38500000000000001,"15min":0.39700000000000002},"min":{"1min":0.29699999999999999,"5min":0.192,"15min":0.192},"max":{"1min":0.56100000000000005,"5min":0.626,"15min":1.3939999999999999},"last":0.35699999999999998}]},{"osd":1,"last update":"Wed Nov 8 19:29:04 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.39700000000000002,"15min":0.40899999999999997},"min":{"1min":0.28899999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.55800000000000005,"5min":0.747,"15min":1.512},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.41499999999999998,"15min":0.44},"min":{"1min":0.32300000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":1.5580000000000001},"last":0.39300000000000002}]},{"osd":2,"last update":"Wed Nov 8 19:29:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.375,"15min":0.377},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.2030000000000001},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.40600000000000003,"15min":0.42199999999999999},"min":{"1min":0.27400000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":1.536},"last":0.314}]},{"osd":4,"last update":"Wed Nov 8 19:29:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.60499999999999998,"15min":0.61899999999999999},"min":{"1min":0.441,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":1.3400000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.624,"15min":0.61499999999999999},"min":{"1min":0.41299999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.82899999999999996,"5min":0.84999999999999998,"15min":1.153},"last":0.57999999999999996}]},{"osd":5,"last update":"Wed Nov 8 19:29:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.58699999999999997,"15min":0.58999999999999997},"min":{"1min":0.438,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.84999999999999998,"5min":0.86499999999999999,"15min":1.4870000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.57799999999999996,"15min":0.59999999999999998},"min":{"1min":0.39900000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.80200000000000005,"5min":0.82799999999999996,"15min":1.3129999999999999},"last":0.59399999999999997}]},{"osd":6,"last update":"Wed Nov 8 19:29:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57499999999999996,"15min":0.57999999999999996},"min":{"1min":0.38700000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":1.113},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60299999999999998,"15min":0.61099999999999999},"min":{"1min":0.439,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":1.4139999999999999},"last":0.51900000000000002}]},{"osd":7,"last update":"Wed Nov 8 19:29:04 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61299999999999999,"15min":0.63900000000000001},"min":{"1min":0.41799999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":1.3680000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.63900000000000001,"15min":0.624},"min":{"1min":0.46899999999999997,"5min":0.45700000000000002,"15min":0.42299999999999999},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":1.179},"last":0.54200000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574938,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28368,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343472,"statfs":{"total":96636764160,"available":96607715328,"internally_reserved":0,"allocated":1376256,"data_stored":703350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:29:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.56599999999999995,"15min":0.54500000000000004},"min":{"1min":0.34999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.72899999999999998,"5min":0.80100000000000005,"15min":1.399},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55200000000000005,"15min":0.58399999999999996},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.69999999999999996,"5min":0.89500000000000002,"15min":2.2090000000000001},"last":0.439}]},{"osd":1,"last update":"Wed Nov 8 19:29:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.54400000000000004,"15min":0.52100000000000002},"min":{"1min":0.45100000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.73699999999999999,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.52900000000000003,"15min":0.50600000000000001},"min":{"1min":0.36799999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.54800000000000004}]},{"osd":2,"last update":"Wed Nov 8 19:29:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.57799999999999996,"15min":0.622},"min":{"1min":0.44700000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.78200000000000003,"5min":0.80800000000000005,"15min":2.8490000000000002},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56799999999999995,"15min":0.53400000000000003},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.78500000000000003,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.72099999999999997}]},{"osd":3,"last update":"Wed Nov 8 19:29:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.60999999999999999,"15min":0.57699999999999996},"min":{"1min":0.39500000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.73799999999999999,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.749},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63200000000000001,"15min":0.70099999999999996},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.79300000000000004,"5min":0.86199999999999999,"15min":3.4849999999999999},"last":0.66600000000000004}]},{"osd":5,"last update":"Wed Nov 8 19:29:05 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.48799999999999999,"15min":0.51000000000000001},"min":{"1min":0.314,"5min":0.313,"15min":0.313},"max":{"1min":0.61599999999999999,"5min":0.746,"15min":0.91500000000000004},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.36799999999999999,"5min":0.36299999999999999,"15min":0.32300000000000001},"max":{"1min":0.58099999999999996,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.68000000000000005}]},{"osd":6,"last update":"Wed Nov 8 19:29:05 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.54300000000000004,"15min":0.67100000000000004},"min":{"1min":0.36499999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.621,"5min":0.83199999999999996,"15min":4.1529999999999996},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.58499999999999996,"15min":0.60299999999999998},"min":{"1min":0.41399999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.69799999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.77200000000000002}]},{"osd":7,"last update":"Wed Nov 8 19:29:05 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.55500000000000005,"15min":0.56499999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.34499999999999997},"max":{"1min":0.66100000000000003,"5min":0.80500000000000005,"15min":0.99399999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.65100000000000002,"15min":0.80100000000000005},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.79400000000000004,"5min":0.87,"15min":5.5359999999999996},"last":0.69699999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574938,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28348,"kb_used_data":1328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343492,"statfs":{"total":96636764160,"available":96607735808,"internally_reserved":0,"allocated":1359872,"data_stored":695695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.52500000000000002,"15min":0.54300000000000004},"min":{"1min":0.36799999999999999,"5min":0.30399999999999999,"15min":0.26000000000000001},"max":{"1min":0.71099999999999997,"5min":0.78100000000000003,"15min":2.2360000000000002},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.55200000000000005,"15min":0.52800000000000002},"min":{"1min":0.38900000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.878},"last":0.53700000000000003}]},{"osd":1,"last update":"Wed Nov 8 19:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.58799999999999997,"15min":0.55800000000000005},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.27600000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.85999999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56799999999999995,"15min":0.59799999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":2.2919999999999998},"last":0.48699999999999999}]},{"osd":2,"last update":"Wed Nov 8 19:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56499999999999995,"15min":0.55900000000000005},"min":{"1min":0.33800000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.73699999999999999,"5min":0.82299999999999995,"15min":0.83399999999999996},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.55900000000000005,"15min":0.53700000000000003},"min":{"1min":0.45000000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.69799999999999995,"5min":0.79100000000000004,"15min":0.81599999999999995},"last":0.747}]},{"osd":3,"last update":"Wed Nov 8 19:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57199999999999995,"15min":0.56100000000000005},"min":{"1min":0.36699999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73299999999999998,"5min":0.745,"15min":0.76900000000000002},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58899999999999997,"15min":0.57699999999999996},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.34399999999999997},"max":{"1min":0.71399999999999997,"5min":0.83699999999999997,"15min":0.89900000000000002},"last":0.64800000000000002}]},{"osd":4,"last update":"Wed Nov 8 19:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.495,"15min":0.57299999999999995},"min":{"1min":0.29999999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.68600000000000005,"5min":0.81200000000000006,"15min":2.3300000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.60699999999999998,"15min":0.625},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.77000000000000002,"5min":0.81999999999999995,"15min":0.92300000000000004},"last":0.61799999999999999}]},{"osd":6,"last update":"Wed Nov 8 19:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.53300000000000003,"15min":0.56299999999999994},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76300000000000001,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.54900000000000004,"15min":0.63700000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.72999999999999998,"5min":0.80500000000000005,"15min":2.3650000000000002},"last":0.66400000000000003}]},{"osd":7,"last update":"Wed Nov 8 19:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.58199999999999996,"15min":0.61499999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.88500000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.59999999999999998,"15min":0.63400000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.79000000000000004,"5min":0.871,"15min":0.873},"last":0.72399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:30:09.015 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:30:09.171 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.169+0000 7ff890538700 1 Processor -- start 2023-11-08T19:30:09.171 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.170+0000 7ff890538700 1 -- start start 2023-11-08T19:30:09.177 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.171+0000 7ff890538700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8880b27c0 0x7ff8880ce380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:09.177 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.171+0000 7ff890538700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8880d1330 con 0x7ff8880b16b0 2023-11-08T19:30:09.178 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.171+0000 7ff890538700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8880cb490 con 0x7ff8880afb30 2023-11-08T19:30:09.178 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.171+0000 7ff890538700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8880cb770 con 0x7ff8880b27c0 2023-11-08T19:30:09.178 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.171+0000 7ff88dad3700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7ff8880b16b0 0x7ff8880b20b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:47922/0 (socket says 172.21.15.149:47922) 2023-11-08T19:30:09.179 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.171+0000 7ff88dad3700 1 -- 172.21.15.149:0/1762854401 learned_addr learned my addr 172.21.15.149:0/1762854401 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:30:09.179 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.171+0000 7ff88ead5700 1 --2- 172.21.15.149:0/1762854401 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8880b27c0 0x7ff8880ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:09.179 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.171+0000 7ff88d2d2700 1 -- 172.21.15.149:0/1762854401 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2130139725 0 0) 0x7ff8880d1330 con 0x7ff8880b16b0 2023-11-08T19:30:09.179 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.171+0000 7ff88d2d2700 1 -- 172.21.15.149:0/1762854401 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8740035b0 con 0x7ff8880b16b0 2023-11-08T19:30:09.180 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.171+0000 7ff88d2d2700 1 -- 172.21.15.149:0/1762854401 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2779642543 0 0) 0x7ff8880cb490 con 0x7ff8880afb30 2023-11-08T19:30:09.180 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.171+0000 7ff88d2d2700 1 -- 172.21.15.149:0/1762854401 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8880d1330 con 0x7ff8880afb30 2023-11-08T19:30:09.180 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.171+0000 7ff88d2d2700 1 -- 172.21.15.149:0/1762854401 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2251174043 0 0) 0x7ff8740035b0 con 0x7ff8880b16b0 2023-11-08T19:30:09.181 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.171+0000 7ff88d2d2700 1 -- 172.21.15.149:0/1762854401 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8880b27c0 msgr2=0x7ff8880ce380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:30:09.181 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.171+0000 7ff88d2d2700 1 --2- 172.21.15.149:0/1762854401 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8880b27c0 0x7ff8880ce380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:09.181 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.171+0000 7ff88d2d2700 1 -- 172.21.15.149:0/1762854401 >> v1:172.21.15.160:6789/0 conn(0x7ff8880afb30 legacy=0x7ff8880cbf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:09.182 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.171+0000 7ff88d2d2700 1 -- 172.21.15.149:0/1762854401 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8880cba50 con 0x7ff8880b16b0 2023-11-08T19:30:09.182 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.171+0000 7ff88d2d2700 1 -- 172.21.15.149:0/1762854401 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7ff884001670 con 0x7ff8880b16b0 2023-11-08T19:30:09.182 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.171+0000 7ff88d2d2700 1 -- 172.21.15.149:0/1762854401 >> v1:172.21.15.149:6789/0 conn(0x7ff8880b16b0 legacy=0x7ff8880b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:09.182 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.171+0000 7ff88d2d2700 1 --2- 172.21.15.149:0/1762854401 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff874003bc0 0x7ff874003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:09.183 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.171+0000 7ff88d2d2700 1 --2- 172.21.15.149:0/1762854401 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8880b27c0 0x7ff874004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:09.183 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.172+0000 7ff88d2d2700 1 --2- 172.21.15.149:0/1762854401 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff874004d90 0x7ff874005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:09.183 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.172+0000 7ff88d2d2700 1 -- 172.21.15.149:0/1762854401 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8880cb770 con 0x7ff874003bc0 2023-11-08T19:30:09.184 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.172+0000 7ff88d2d2700 1 -- 172.21.15.149:0/1762854401 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff87400bc50 con 0x7ff874004d90 2023-11-08T19:30:09.184 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.172+0000 7ff88d2d2700 1 -- 172.21.15.149:0/1762854401 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff87400be10 con 0x7ff8880b27c0 2023-11-08T19:30:09.184 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.172+0000 7ff88e2d4700 1 --2- 172.21.15.149:0/1762854401 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff874003bc0 0x7ff874003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:09.184 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.172+0000 7ff88dad3700 1 --2- 172.21.15.149:0/1762854401 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8880b27c0 0x7ff874004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:09.185 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.172+0000 7ff88ead5700 1 --2- 172.21.15.149:0/1762854401 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff874004d90 0x7ff874005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:09.185 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.172+0000 7ff88e2d4700 1 -- 172.21.15.149:0/1762854401 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8880b27c0 msgr2=0x7ff874004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:30:09.185 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.172+0000 7ff88e2d4700 1 --2- 172.21.15.149:0/1762854401 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8880b27c0 0x7ff874004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:09.186 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.172+0000 7ff88e2d4700 1 -- 172.21.15.149:0/1762854401 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff874004d90 msgr2=0x7ff874005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:30:09.186 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.172+0000 7ff88e2d4700 1 --2- 172.21.15.149:0/1762854401 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff874004d90 0x7ff874005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:09.186 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.172+0000 7ff88e2d4700 1 -- 172.21.15.149:0/1762854401 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8740035b0 con 0x7ff874003bc0 2023-11-08T19:30:09.187 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.172+0000 7ff88e2d4700 1 --2- 172.21.15.149:0/1762854401 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff874003bc0 0x7ff874003fc0 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7ff8780019e0 tx=0x7ff874005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca24b71638508e32 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:09.187 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.172+0000 7ff88d2d2700 1 -- 172.21.15.149:0/1762854401 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8780014a0 con 0x7ff874003bc0 2023-11-08T19:30:09.187 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.172+0000 7ff88d2d2700 1 -- 172.21.15.149:0/1762854401 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8780052d0 con 0x7ff874003bc0 2023-11-08T19:30:09.187 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.172+0000 7ff88d2d2700 1 -- 172.21.15.149:0/1762854401 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8780036d0 con 0x7ff874003bc0 2023-11-08T19:30:09.188 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.173+0000 7ff890538700 1 -- 172.21.15.149:0/1762854401 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff874003bc0 msgr2=0x7ff874003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:09.188 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.173+0000 7ff890538700 1 --2- 172.21.15.149:0/1762854401 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff874003bc0 0x7ff874003fc0 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7ff8780019e0 tx=0x7ff874005880 comp rx=0 tx=0).stop 2023-11-08T19:30:09.188 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.173+0000 7ff88ead5700 1 -- 172.21.15.149:0/1762854401 reap_dead start 2023-11-08T19:30:09.189 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.173+0000 7ff890538700 1 -- 172.21.15.149:0/1762854401 shutdown_connections 2023-11-08T19:30:09.189 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.173+0000 7ff890538700 1 -- 172.21.15.149:0/1762854401 >> 172.21.15.149:0/1762854401 conn(0x7ff888099a40 msgr2=0x7ff8880d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:09.189 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.173+0000 7ff890538700 1 -- 172.21.15.149:0/1762854401 shutdown_connections 2023-11-08T19:30:09.190 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.173+0000 7ff890538700 1 -- 172.21.15.149:0/1762854401 wait complete. 2023-11-08T19:30:09.190 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.174+0000 7ff890538700 1 Processor -- start 2023-11-08T19:30:09.190 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.174+0000 7ff890538700 1 -- start start 2023-11-08T19:30:09.191 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.175+0000 7ff890538700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff874003bc0 0x7ff8880b0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:09.191 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.175+0000 7ff890538700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff8880ca160 0x7ff888152da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:09.191 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.175+0000 7ff890538700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8880ae260 0x7ff8880ae6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:09.191 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.175+0000 7ff890538700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8881f4bc0 con 0x7ff8880ae260 2023-11-08T19:30:09.192 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.175+0000 7ff890538700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8880aec20 con 0x7ff8880ca160 2023-11-08T19:30:09.192 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.175+0000 7ff890538700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8880b0360 con 0x7ff874003bc0 2023-11-08T19:30:09.192 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.175+0000 7ff88ead5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8880ae260 0x7ff8880ae6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:09.193 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.175+0000 7ff88ead5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8880ae260 0x7ff8880ae6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45934/0 (socket says 172.21.15.149:45934) 2023-11-08T19:30:09.193 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.175+0000 7ff88ead5700 1 -- 172.21.15.149:0/679587247 learned_addr learned my addr 172.21.15.149:0/679587247 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:30:09.193 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.175+0000 7ff88e2d4700 1 --2- 172.21.15.149:0/679587247 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff874003bc0 0x7ff8880b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:09.193 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.175+0000 7ff88dad3700 1 --2- 172.21.15.149:0/679587247 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff8880ca160 0x7ff888152da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:09.194 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.175+0000 7ff88ead5700 1 -- 172.21.15.149:0/679587247 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff874003bc0 msgr2=0x7ff8880b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:09.194 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.175+0000 7ff88ead5700 1 --2- 172.21.15.149:0/679587247 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff874003bc0 0x7ff8880b0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:09.194 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.175+0000 7ff88ead5700 1 -- 172.21.15.149:0/679587247 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff8880ca160 msgr2=0x7ff888152da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:09.195 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.175+0000 7ff88ead5700 1 --2- 172.21.15.149:0/679587247 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff8880ca160 0x7ff888152da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:09.195 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.175+0000 7ff88ead5700 1 -- 172.21.15.149:0/679587247 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8880c44f0 con 0x7ff8880ae260 2023-11-08T19:30:09.195 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.175+0000 7ff88dad3700 1 --2- 172.21.15.149:0/679587247 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff8880ca160 0x7ff888152da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:30:09.196 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.175+0000 7ff88ead5700 1 --2- 172.21.15.149:0/679587247 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8880ae260 0x7ff8880ae6e0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7ff8880caf30 tx=0x7ff8800116a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:09.196 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.175+0000 7ff87effd700 1 -- 172.21.15.149:0/679587247 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88000e040 con 0x7ff8880ae260 2023-11-08T19:30:09.196 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.175+0000 7ff87effd700 1 -- 172.21.15.149:0/679587247 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff88000f040 con 0x7ff8880ae260 2023-11-08T19:30:09.196 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.175+0000 7ff87effd700 1 -- 172.21.15.149:0/679587247 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff880003ea0 con 0x7ff8880ae260 2023-11-08T19:30:09.197 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.175+0000 7ff890538700 1 -- 172.21.15.149:0/679587247 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8881f3f40 con 0x7ff8880ae260 2023-11-08T19:30:09.197 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.176+0000 7ff890538700 1 -- 172.21.15.149:0/679587247 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8881f4500 con 0x7ff8880ae260 2023-11-08T19:30:09.197 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.176+0000 7ff890538700 1 -- 172.21.15.149:0/679587247 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8880745f0 con 0x7ff8880ae260 2023-11-08T19:30:09.198 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.177+0000 7ff87effd700 1 -- 172.21.15.149:0/679587247 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff880004030 con 0x7ff8880ae260 2023-11-08T19:30:09.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.177+0000 7ff87effd700 1 --2- 172.21.15.149:0/679587247 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff86c06af00 0x7ff86c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:09.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.177+0000 7ff87effd700 1 -- 172.21.15.149:0/679587247 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6999+0+0 (secure 0 0 0) 0x7ff88008bfe0 con 0x7ff8880ae260 2023-11-08T19:30:09.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.177+0000 7ff88e2d4700 1 --2- 172.21.15.149:0/679587247 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff86c06af00 0x7ff86c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:09.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.178+0000 7ff88e2d4700 1 --2- 172.21.15.149:0/679587247 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff86c06af00 0x7ff86c06d3c0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7ff878008fd0 tx=0x7ff87800a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:09.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.182+0000 7ff87effd700 1 -- 172.21.15.149:0/679587247 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff880056c10 con 0x7ff8880ae260 2023-11-08T19:30:09.374 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.373+0000 7ff890538700 1 -- 172.21.15.149:0/679587247 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff8881f4d00 con 0x7ff8880ae260 2023-11-08T19:30:09.375 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.374+0000 7ff87effd700 1 -- 172.21.15.149:0/679587247 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) v1 ==== 74+0+19496 (secure 0 0 0) 0x7ff88005a230 con 0x7ff8880ae260 2023-11-08T19:30:09.376 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:30:09.376 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":111,"fsid":"0aba7c70-fe80-4446-a2f5-7502ac3adfb4","created":"2023-11-08T19:22:44.315577+0000","modified":"2023-11-08T19:30:05.740656+0000","last_up_change":"2023-11-08T19:22:55.108495+0000","last_in_change":"2023-11-08T19:22:46.810256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T19:22:56.023194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-08T19:24:29.516185+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-08T19:25:44.287064+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":71,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-08T19:25:45.623521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"11cd1da4-be4e-454c-9727-4747e428907c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6801","nonce":1925115369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6803","nonce":1925115369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6807","nonce":1925115369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1925115369},{"type":"v1","addr":"172.21.15.149:6805","nonce":1925115369}]},"public_addr":"172.21.15.149:6801/1925115369","cluster_addr":"172.21.15.149:6803/1925115369","heartbeat_back_addr":"172.21.15.149:6807/1925115369","heartbeat_front_addr":"172.21.15.149:6805/1925115369","state":["exists","up"]},{"osd":1,"uuid":"88cf49a1-c930-42c6-afdf-8b5baa8d5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6819","nonce":696424905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6824","nonce":696424905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6831","nonce":696424905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":696424905},{"type":"v1","addr":"172.21.15.149:6828","nonce":696424905}]},"public_addr":"172.21.15.149:6819/696424905","cluster_addr":"172.21.15.149:6824/696424905","heartbeat_back_addr":"172.21.15.149:6831/696424905","heartbeat_front_addr":"172.21.15.149:6828/696424905","state":["exists","up"]},{"osd":2,"uuid":"7ff48e7a-ff8f-4254-8c33-407ffc04b060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6818","nonce":3407229782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6821","nonce":3407229782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6827","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6829","nonce":3407229782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":3407229782},{"type":"v1","addr":"172.21.15.149:6825","nonce":3407229782}]},"public_addr":"172.21.15.149:6818/3407229782","cluster_addr":"172.21.15.149:6821/3407229782","heartbeat_back_addr":"172.21.15.149:6829/3407229782","heartbeat_front_addr":"172.21.15.149:6825/3407229782","state":["exists","up"]},{"osd":3,"uuid":"2ffa8dcb-e69e-47c2-9c46-bf3f61bedec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6809","nonce":856914938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6811","nonce":856914938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6815","nonce":856914938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":856914938},{"type":"v1","addr":"172.21.15.149:6813","nonce":856914938}]},"public_addr":"172.21.15.149:6809/856914938","cluster_addr":"172.21.15.149:6811/856914938","heartbeat_back_addr":"172.21.15.149:6815/856914938","heartbeat_front_addr":"172.21.15.149:6813/856914938","state":["exists","up"]},{"osd":4,"uuid":"7b9d5009-831c-4b7c-991d-78fa94ea6425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6825","nonce":2064905524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6827","nonce":2064905524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6831","nonce":2064905524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2064905524},{"type":"v1","addr":"172.21.15.160:6829","nonce":2064905524}]},"public_addr":"172.21.15.160:6825/2064905524","cluster_addr":"172.21.15.160:6827/2064905524","heartbeat_back_addr":"172.21.15.160:6831/2064905524","heartbeat_front_addr":"172.21.15.160:6829/2064905524","state":["exists","up"]},{"osd":5,"uuid":"58ab33fd-5b6e-465a-9f6a-76d713db83ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6802","nonce":3633365507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6807","nonce":3633365507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6815","nonce":3633365507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":3633365507},{"type":"v1","addr":"172.21.15.160:6812","nonce":3633365507}]},"public_addr":"172.21.15.160:6802/3633365507","cluster_addr":"172.21.15.160:6807/3633365507","heartbeat_back_addr":"172.21.15.160:6815/3633365507","heartbeat_front_addr":"172.21.15.160:6812/3633365507","state":["exists","up"]},{"osd":6,"uuid":"900eb7c4-8c4d-4e50-a2f9-30eded4e1158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6803","nonce":3344903775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6806","nonce":3344903775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6813","nonce":3344903775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":3344903775},{"type":"v1","addr":"172.21.15.160:6809","nonce":3344903775}]},"public_addr":"172.21.15.160:6803/3344903775","cluster_addr":"172.21.15.160:6806/3344903775","heartbeat_back_addr":"172.21.15.160:6813/3344903775","heartbeat_front_addr":"172.21.15.160:6809/3344903775","state":["exists","up"]},{"osd":7,"uuid":"258a808f-eb6e-4f16-ab36-204c340f2515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6817","nonce":3363831222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6819","nonce":3363831222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6823","nonce":3363831222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3363831222},{"type":"v1","addr":"172.21.15.160:6821","nonce":3363831222}]},"public_addr":"172.21.15.160:6817/3363831222","cluster_addr":"172.21.15.160:6819/3363831222","heartbeat_back_addr":"172.21.15.160:6823/3363831222","heartbeat_front_addr":"172.21.15.160:6821/3363831222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.968643+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.718935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.967988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.705324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.009161+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.027058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:51.980645+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T19:22:52.034901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.149:6836/2818321595":"2023-11-09T19:30:02.730707+0000","172.21.15.160:6834/2947079163":"2023-11-09T19:28:27.325108+0000","192.168.0.1:0/1017303916":"2023-11-08T20:29:42.437736+0000","172.21.15.160:6832/2947079163":"2023-11-09T19:28:27.325108+0000","172.21.15.160:6833/2714564224":"2023-11-09T19:27:34.046425+0000","172.21.15.149:6834/589971879":"2023-11-09T19:28:00.736319+0000","172.21.15.149:6836/589971879":"2023-11-09T19:28:00.736319+0000","172.21.15.149:6837/3917392643":"2023-11-09T19:29:34.481449+0000","172.21.15.160:6835/2714564224":"2023-11-09T19:27:34.046425+0000","172.21.15.149:6834/2818321595":"2023-11-09T19:30:02.730707+0000","172.21.15.160:6832/1313631099":"2023-11-09T19:29:27.322904+0000","172.21.15.149:6836/295381437":"2023-11-09T19:28:59.293725+0000","172.21.15.149:6835/3917392643":"2023-11-09T19:29:34.481449+0000","172.21.15.160:6832/2282522167":"2023-11-09T19:30:02.730689+0000","172.21.15.160:6834/1313631099":"2023-11-09T19:29:27.322904+0000","172.21.15.149:6834/295381437":"2023-11-09T19:28:59.293725+0000","172.21.15.160:6834/2282522167":"2023-11-09T19:30:02.730689+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:30:09.378 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.377+0000 7ff890538700 1 -- 172.21.15.149:0/679587247 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff86c06af00 msgr2=0x7ff86c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:09.378 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.377+0000 7ff890538700 1 --2- 172.21.15.149:0/679587247 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff86c06af00 0x7ff86c06d3c0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7ff878008fd0 tx=0x7ff87800a000 comp rx=0 tx=0).stop 2023-11-08T19:30:09.379 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.377+0000 7ff890538700 1 -- 172.21.15.149:0/679587247 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8880ae260 msgr2=0x7ff8880ae6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:09.379 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.377+0000 7ff890538700 1 --2- 172.21.15.149:0/679587247 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8880ae260 0x7ff8880ae6e0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7ff8880caf30 tx=0x7ff8800116a0 comp rx=0 tx=0).stop 2023-11-08T19:30:09.379 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.377+0000 7ff890538700 1 -- 172.21.15.149:0/679587247 shutdown_connections 2023-11-08T19:30:09.379 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.377+0000 7ff890538700 1 --2- 172.21.15.149:0/679587247 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ff86c06af00 0x7ff86c06d3c0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:09.380 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.377+0000 7ff890538700 1 --2- 172.21.15.149:0/679587247 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8880ae260 0x7ff8880ae6e0 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:09.380 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.377+0000 7ff890538700 1 --2- 172.21.15.149:0/679587247 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff874003bc0 0x7ff8880b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:09.380 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.377+0000 7ff890538700 1 --2- 172.21.15.149:0/679587247 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff8880ca160 0x7ff888152da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:09.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.377+0000 7ff890538700 1 -- 172.21.15.149:0/679587247 >> 172.21.15.149:0/679587247 conn(0x7ff888099a40 msgr2=0x7ff8880b20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:09.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.377+0000 7ff890538700 1 -- 172.21.15.149:0/679587247 shutdown_connections 2023-11-08T19:30:09.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:09.377+0000 7ff890538700 1 -- 172.21.15.149:0/679587247 wait complete. 2023-11-08T19:30:10.391 INFO:tasks.ceph:Scrubbing osd.0 2023-11-08T19:30:10.392 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-11-08T19:30:10.530 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.528+0000 7f90ffebb700 1 Processor -- start 2023-11-08T19:30:10.530 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.529+0000 7f90ffebb700 1 -- start start 2023-11-08T19:30:10.533 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.529+0000 7f90ffebb700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f90f815a9a0 0x7f90f80cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:10.533 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.529+0000 7f90ffebb700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f90f80cc750 0x7f90f8072050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:10.533 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.529+0000 7f90ffebb700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90f815e5b0 con 0x7f90f80cff30 2023-11-08T19:30:10.534 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.529+0000 7f90ffebb700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90f80d03b0 con 0x7f90f815a9a0 2023-11-08T19:30:10.534 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.529+0000 7f90ffebb700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90f80ccbe0 con 0x7f90f80cc750 2023-11-08T19:30:10.534 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.530+0000 7f90fdc57700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f90f815a9a0 0x7f90f80cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:10.535 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.530+0000 7f90fdc57700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f90f815a9a0 0x7f90f80cf9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45938/0 (socket says 172.21.15.149:45938) 2023-11-08T19:30:10.535 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.530+0000 7f90fdc57700 1 -- 172.21.15.149:0/3479537820 learned_addr learned my addr 172.21.15.149:0/3479537820 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:30:10.535 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.530+0000 7f90fd456700 1 --1- 172.21.15.149:0/3479537820 >> v1:172.21.15.149:6789/0 conn(0x7f90f80cff30 0x7f90f80cc040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:47942/0 (socket says 172.21.15.149:47942) 2023-11-08T19:30:10.535 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.530+0000 7f90fe458700 1 --2- 172.21.15.149:0/3479537820 >> v2:172.21.15.160:3300/0 conn(0x7f90f80cc750 0x7f90f8072050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:10.536 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.530+0000 7f90fdc57700 1 -- 172.21.15.149:0/3479537820 >> v2:172.21.15.160:3300/0 conn(0x7f90f80cc750 msgr2=0x7f90f8072050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:30:10.536 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.530+0000 7f90fdc57700 1 --2- 172.21.15.149:0/3479537820 >> v2:172.21.15.160:3300/0 conn(0x7f90f80cc750 0x7f90f8072050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:10.536 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.530+0000 7f90fdc57700 1 -- 172.21.15.149:0/3479537820 >> v1:172.21.15.149:6789/0 conn(0x7f90f80cff30 legacy=0x7f90f80cc040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:10.537 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.530+0000 7f90fdc57700 1 -- 172.21.15.149:0/3479537820 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f80cce00 con 0x7f90f815a9a0 2023-11-08T19:30:10.537 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.530+0000 7f90fdc57700 1 --2- 172.21.15.149:0/3479537820 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90f815a9a0 0x7f90f80cf9f0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f90f80b0170 tx=0x7f90e8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c464c48b55b74b1e server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:10.537 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.530+0000 7f90fcc55700 1 -- 172.21.15.149:0/3479537820 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e800b870 con 0x7f90f815a9a0 2023-11-08T19:30:10.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.530+0000 7f90fcc55700 1 -- 172.21.15.149:0/3479537820 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e800b9d0 con 0x7f90f815a9a0 2023-11-08T19:30:10.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.530+0000 7f90fcc55700 1 -- 172.21.15.149:0/3479537820 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e800bd60 con 0x7f90f815a9a0 2023-11-08T19:30:10.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.531+0000 7f90ffebb700 1 -- 172.21.15.149:0/3479537820 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90f815a9a0 msgr2=0x7f90f80cf9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:10.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.531+0000 7f90ffebb700 1 --2- 172.21.15.149:0/3479537820 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90f815a9a0 0x7f90f80cf9f0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f90f80b0170 tx=0x7f90e8009bd0 comp rx=0 tx=0).stop 2023-11-08T19:30:10.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.531+0000 7f90ffebb700 1 -- 172.21.15.149:0/3479537820 shutdown_connections 2023-11-08T19:30:10.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.531+0000 7f90ffebb700 1 --2- 172.21.15.149:0/3479537820 >> v2:172.21.15.160:3300/0 conn(0x7f90f80cc750 0x7f90f8072050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:10.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.531+0000 7f90ffebb700 1 --2- 172.21.15.149:0/3479537820 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90f815a9a0 0x7f90f80cf9f0 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:10.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.531+0000 7f90ffebb700 1 -- 172.21.15.149:0/3479537820 >> 172.21.15.149:0/3479537820 conn(0x7f90f80d0740 msgr2=0x7f90f80d0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:10.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.531+0000 7f90ffebb700 1 -- 172.21.15.149:0/3479537820 shutdown_connections 2023-11-08T19:30:10.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.531+0000 7f90ffebb700 1 -- 172.21.15.149:0/3479537820 wait complete. 2023-11-08T19:30:10.544 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.532+0000 7f90ffebb700 1 Processor -- start 2023-11-08T19:30:10.544 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.532+0000 7f90ffebb700 1 -- start start 2023-11-08T19:30:10.544 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.533+0000 7f90ffebb700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90f80cc750 0x7f90f81f0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:10.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.533+0000 7f90ffebb700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90f80cff30 0x7f90f81efbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:10.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.533+0000 7f90ffebb700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f90f815a9a0 0x7f90f80ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:10.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.533+0000 7f90ffebb700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f80c8d70 con 0x7f90f80cff30 2023-11-08T19:30:10.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.533+0000 7f90ffebb700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f80ca580 con 0x7f90f80cc750 2023-11-08T19:30:10.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.533+0000 7f90ffebb700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90f81f1320 con 0x7f90f815a9a0 2023-11-08T19:30:10.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.533+0000 7f90fd456700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90f80cff30 0x7f90f81efbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:10.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.533+0000 7f90fd456700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90f80cff30 0x7f90f81efbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45946/0 (socket says 172.21.15.149:45946) 2023-11-08T19:30:10.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.533+0000 7f90fd456700 1 -- 172.21.15.149:0/3229041599 learned_addr learned my addr 172.21.15.149:0/3229041599 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:30:10.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.533+0000 7f90fe458700 1 --2- 172.21.15.149:0/3229041599 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f90f815a9a0 0x7f90f80ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:10.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.533+0000 7f90fdc57700 1 --2- 172.21.15.149:0/3229041599 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90f80cc750 0x7f90f81f0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:10.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.533+0000 7f90fd456700 1 -- 172.21.15.149:0/3229041599 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f90f815a9a0 msgr2=0x7f90f80ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:10.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.533+0000 7f90fd456700 1 --2- 172.21.15.149:0/3229041599 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f90f815a9a0 0x7f90f80ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:10.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.533+0000 7f90fd456700 1 -- 172.21.15.149:0/3229041599 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90f80cc750 msgr2=0x7f90f81f0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:10.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.533+0000 7f90fd456700 1 --2- 172.21.15.149:0/3229041599 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90f80cc750 0x7f90f81f0de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:10.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.533+0000 7f90fd456700 1 -- 172.21.15.149:0/3229041599 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e8009550 con 0x7f90f80cff30 2023-11-08T19:30:10.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.533+0000 7f90fdc57700 1 --2- 172.21.15.149:0/3229041599 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90f80cc750 0x7f90f81f0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:30:10.551 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.533+0000 7f90fe458700 1 --2- 172.21.15.149:0/3229041599 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f90f815a9a0 0x7f90f80ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:30:10.551 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.533+0000 7f90fd456700 1 --2- 172.21.15.149:0/3229041599 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90f80cff30 0x7f90f81efbb0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f90f400c550 tx=0x7f90f400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:10.551 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.534+0000 7f90ee7fc700 1 -- 172.21.15.149:0/3229041599 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f4005cb0 con 0x7f90f80cff30 2023-11-08T19:30:10.551 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.534+0000 7f90ee7fc700 1 -- 172.21.15.149:0/3229041599 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90f4005e10 con 0x7f90f80cff30 2023-11-08T19:30:10.552 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.534+0000 7f90ffebb700 1 -- 172.21.15.149:0/3229041599 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90f80c7cd0 con 0x7f90f80cff30 2023-11-08T19:30:10.552 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.534+0000 7f90ee7fc700 1 -- 172.21.15.149:0/3229041599 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f40072d0 con 0x7f90f80cff30 2023-11-08T19:30:10.552 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.534+0000 7f90ffebb700 1 -- 172.21.15.149:0/3229041599 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90f80c8290 con 0x7f90f80cff30 2023-11-08T19:30:10.552 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.534+0000 7f90ffebb700 1 -- 172.21.15.149:0/3229041599 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f90f815eae0 con 0x7f90f80cff30 2023-11-08T19:30:10.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.535+0000 7f90ee7fc700 1 -- 172.21.15.149:0/3229041599 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f90f4007430 con 0x7f90f80cff30 2023-11-08T19:30:10.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.535+0000 7f90ee7fc700 1 --2- 172.21.15.149:0/3229041599 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f90dc06af00 0x7f90dc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:10.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.536+0000 7f90ee7fc700 1 -- 172.21.15.149:0/3229041599 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6999+0+0 (secure 0 0 0) 0x7f90f4089610 con 0x7f90f80cff30 2023-11-08T19:30:10.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.536+0000 7f90fdc57700 1 --2- 172.21.15.149:0/3229041599 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f90dc06af00 0x7f90dc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:10.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.536+0000 7f90ee7fc700 1 --2- 172.21.15.149:0/3229041599 >> [v2:172.21.15.149:6800/1925115369,v1:172.21.15.149:6801/1925115369] conn(0x7f90dc073e40 0x7f90dc0762c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:10.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.536+0000 7f90ee7fc700 1 -- 172.21.15.149:0/3229041599 --> [v2:172.21.15.149:6800/1925115369,v1:172.21.15.149:6801/1925115369] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f90dc076990 con 0x7f90dc073e40 2023-11-08T19:30:10.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.536+0000 7f90ee7fc700 1 -- 172.21.15.149:0/3229041599 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_get_version_reply(handle=1 version=111) v2 ==== 24+0+0 (secure 0 0 0) 0x7f90f4089a60 con 0x7f90f80cff30 2023-11-08T19:30:10.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.536+0000 7f90fe458700 1 --2- 172.21.15.149:0/3229041599 >> [v2:172.21.15.149:6800/1925115369,v1:172.21.15.149:6801/1925115369] conn(0x7f90dc073e40 0x7f90dc0762c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:10.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.536+0000 7f90fdc57700 1 --2- 172.21.15.149:0/3229041599 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f90dc06af00 0x7f90dc06d3c0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f90e8000c00 tx=0x7f90e8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:10.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.536+0000 7f90fe458700 1 --2- 172.21.15.149:0/3229041599 >> [v2:172.21.15.149:6800/1925115369,v1:172.21.15.149:6801/1925115369] conn(0x7f90dc073e40 0x7f90dc0762c0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:10.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.537+0000 7f90ee7fc700 1 -- 172.21.15.149:0/3229041599 <== osd.0 v2:172.21.15.149:6800/1925115369 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7f90dc076990 con 0x7f90dc073e40 2023-11-08T19:30:10.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.551+0000 7f90ffebb700 1 -- 172.21.15.149:0/3229041599 --> [v2:172.21.15.149:6800/1925115369,v1:172.21.15.149:6801/1925115369] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f90f815e800 con 0x7f90dc073e40 2023-11-08T19:30:10.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.552+0000 7f90ee7fc700 1 -- 172.21.15.149:0/3229041599 <== osd.0 v2:172.21.15.149:6800/1925115369 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f90f0009b90 con 0x7f90dc073e40 2023-11-08T19:30:10.557 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2023-11-08T19:30:10.557 INFO:teuthology.orchestra.run.smithi149.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-08T19:30:10.558 INFO:teuthology.orchestra.run.smithi149.stdout:} 2023-11-08T19:30:10.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.552+0000 7f90ffebb700 1 -- 172.21.15.149:0/3229041599 >> [v2:172.21.15.149:6800/1925115369,v1:172.21.15.149:6801/1925115369] conn(0x7f90dc073e40 msgr2=0x7f90dc0762c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:10.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.552+0000 7f90ffebb700 1 --2- 172.21.15.149:0/3229041599 >> [v2:172.21.15.149:6800/1925115369,v1:172.21.15.149:6801/1925115369] conn(0x7f90dc073e40 0x7f90dc0762c0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:10.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.552+0000 7f90ffebb700 1 -- 172.21.15.149:0/3229041599 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f90dc06af00 msgr2=0x7f90dc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:10.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.552+0000 7f90ffebb700 1 --2- 172.21.15.149:0/3229041599 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f90dc06af00 0x7f90dc06d3c0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f90e8000c00 tx=0x7f90e8008030 comp rx=0 tx=0).stop 2023-11-08T19:30:10.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.552+0000 7f90ffebb700 1 -- 172.21.15.149:0/3229041599 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90f80cff30 msgr2=0x7f90f81efbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:10.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.552+0000 7f90ffebb700 1 --2- 172.21.15.149:0/3229041599 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90f80cff30 0x7f90f81efbb0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f90f400c550 tx=0x7f90f400c910 comp rx=0 tx=0).stop 2023-11-08T19:30:10.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.552+0000 7f90fe458700 1 -- 172.21.15.149:0/3229041599 reap_dead start 2023-11-08T19:30:10.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.552+0000 7f90ffebb700 1 -- 172.21.15.149:0/3229041599 shutdown_connections 2023-11-08T19:30:10.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.552+0000 7f90ffebb700 1 -- 172.21.15.149:0/3229041599 >> 172.21.15.149:0/3229041599 conn(0x7f90f80d0740 msgr2=0x7f90f8159630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:10.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.552+0000 7f90ffebb700 1 -- 172.21.15.149:0/3229041599 shutdown_connections 2023-11-08T19:30:10.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.552+0000 7f90ffebb700 1 -- 172.21.15.149:0/3229041599 wait complete. 2023-11-08T19:30:10.565 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-11-08T19:30:10.687 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.685+0000 7ffb63374700 1 Processor -- start 2023-11-08T19:30:10.687 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.686+0000 7ffb63374700 1 -- start start 2023-11-08T19:30:10.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.686+0000 7ffb63374700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffb5c0cc140 0x7ffb5c0cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:10.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.686+0000 7ffb63374700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ffb5c0b2cd0 0x7ffb5c15d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:10.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.686+0000 7ffb63374700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb5c0cce50 con 0x7ffb5c0b2850 2023-11-08T19:30:10.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.686+0000 7ffb63374700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb5c0b2430 con 0x7ffb5c0b2cd0 2023-11-08T19:30:10.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.686+0000 7ffb63374700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5c0cc520 con 0x7ffb5c0cc140 2023-11-08T19:30:10.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.687+0000 7ffb61911700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ffb5c0b2cd0 0x7ffb5c15d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:10.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.687+0000 7ffb61911700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ffb5c0b2cd0 0x7ffb5c15d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45956/0 (socket says 172.21.15.149:45956) 2023-11-08T19:30:10.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.687+0000 7ffb61911700 1 -- 172.21.15.149:0/2011555017 learned_addr learned my addr 172.21.15.149:0/2011555017 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:30:10.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.687+0000 7ffb61110700 1 --2- 172.21.15.149:0/2011555017 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffb5c0cc140 0x7ffb5c0cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:10.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.687+0000 7ffb61911700 1 -- 172.21.15.149:0/2011555017 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffb5c0cc140 msgr2=0x7ffb5c0cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:30:10.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.687+0000 7ffb61911700 1 --2- 172.21.15.149:0/2011555017 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffb5c0cc140 0x7ffb5c0cc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:10.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.687+0000 7ffb61911700 1 -- 172.21.15.149:0/2011555017 >> v1:172.21.15.160:6789/0 conn(0x7ffb5c0b2850 legacy=0x7ffb5c0cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:10.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.687+0000 7ffb61911700 1 -- 172.21.15.149:0/2011555017 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb5c0b17b0 con 0x7ffb5c0b2cd0 2023-11-08T19:30:10.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.687+0000 7ffb61911700 1 --2- 172.21.15.149:0/2011555017 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb5c0b2cd0 0x7ffb5c15d2b0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7ffb54009e50 tx=0x7ffb5400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6febbc81fb9cbea0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:10.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.687+0000 7ffb53fff700 1 -- 172.21.15.149:0/2011555017 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb5400e070 con 0x7ffb5c0b2cd0 2023-11-08T19:30:10.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.687+0000 7ffb53fff700 1 -- 172.21.15.149:0/2011555017 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb5400b910 con 0x7ffb5c0b2cd0 2023-11-08T19:30:10.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.687+0000 7ffb53fff700 1 -- 172.21.15.149:0/2011555017 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb5400bcc0 con 0x7ffb5c0b2cd0 2023-11-08T19:30:10.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.688+0000 7ffb63374700 1 -- 172.21.15.149:0/2011555017 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb5c0b2cd0 msgr2=0x7ffb5c15d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:10.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.688+0000 7ffb63374700 1 --2- 172.21.15.149:0/2011555017 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb5c0b2cd0 0x7ffb5c15d2b0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7ffb54009e50 tx=0x7ffb5400b330 comp rx=0 tx=0).stop 2023-11-08T19:30:10.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.688+0000 7ffb63374700 1 -- 172.21.15.149:0/2011555017 shutdown_connections 2023-11-08T19:30:10.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.688+0000 7ffb63374700 1 --2- 172.21.15.149:0/2011555017 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb5c0b2cd0 0x7ffb5c15d2b0 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:10.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.688+0000 7ffb63374700 1 --2- 172.21.15.149:0/2011555017 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffb5c0cc140 0x7ffb5c0cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:10.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.688+0000 7ffb63374700 1 -- 172.21.15.149:0/2011555017 >> 172.21.15.149:0/2011555017 conn(0x7ffb5c099a40 msgr2=0x7ffb5c0d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:10.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.688+0000 7ffb63374700 1 -- 172.21.15.149:0/2011555017 shutdown_connections 2023-11-08T19:30:10.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.688+0000 7ffb63374700 1 -- 172.21.15.149:0/2011555017 wait complete. 2023-11-08T19:30:10.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.689+0000 7ffb63374700 1 Processor -- start 2023-11-08T19:30:10.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.689+0000 7ffb63374700 1 -- start start 2023-11-08T19:30:10.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.690+0000 7ffb63374700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb5c0b2850 0x7ffb5c1f72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:10.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.690+0000 7ffb63374700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffb5c0b2cd0 0x7ffb5c0c88f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:10.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.690+0000 7ffb63374700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffb5c0cc140 0x7ffb5c0af070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:10.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.690+0000 7ffb63374700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5c0b04e0 con 0x7ffb5c0b2850 2023-11-08T19:30:10.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.690+0000 7ffb63374700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5c0aec50 con 0x7ffb5c0b2cd0 2023-11-08T19:30:10.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.690+0000 7ffb63374700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5c1f7820 con 0x7ffb5c0cc140 2023-11-08T19:30:10.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.690+0000 7ffb61110700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb5c0b2850 0x7ffb5c1f72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:10.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.690+0000 7ffb61110700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb5c0b2850 0x7ffb5c1f72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45960/0 (socket says 172.21.15.149:45960) 2023-11-08T19:30:10.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.690+0000 7ffb61110700 1 -- 172.21.15.149:0/332529322 learned_addr learned my addr 172.21.15.149:0/332529322 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:30:10.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.690+0000 7ffb61911700 1 --2- 172.21.15.149:0/332529322 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffb5c0cc140 0x7ffb5c0af070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:10.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.690+0000 7ffb61110700 1 -- 172.21.15.149:0/332529322 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffb5c0cc140 msgr2=0x7ffb5c0af070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:10.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.690+0000 7ffb61110700 1 --2- 172.21.15.149:0/332529322 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffb5c0cc140 0x7ffb5c0af070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:10.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.690+0000 7ffb6090f700 1 --2- 172.21.15.149:0/332529322 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffb5c0b2cd0 0x7ffb5c0c88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:10.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.690+0000 7ffb61110700 1 -- 172.21.15.149:0/332529322 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffb5c0b2cd0 msgr2=0x7ffb5c0c88f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:10.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.690+0000 7ffb61110700 1 --2- 172.21.15.149:0/332529322 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffb5c0b2cd0 0x7ffb5c0c88f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:10.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.690+0000 7ffb61110700 1 -- 172.21.15.149:0/332529322 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb54009b30 con 0x7ffb5c0b2850 2023-11-08T19:30:10.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.690+0000 7ffb61110700 1 --2- 172.21.15.149:0/332529322 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb5c0b2850 0x7ffb5c1f72e0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c00e900 tx=0x7ffb4c00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:10.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.690+0000 7ffb51ffb700 1 -- 172.21.15.149:0/332529322 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4c009650 con 0x7ffb5c0b2850 2023-11-08T19:30:10.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.690+0000 7ffb51ffb700 1 -- 172.21.15.149:0/332529322 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb4c00c850 con 0x7ffb5c0b2850 2023-11-08T19:30:10.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.690+0000 7ffb63374700 1 -- 172.21.15.149:0/332529322 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb5c09ab40 con 0x7ffb5c0b2850 2023-11-08T19:30:10.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.690+0000 7ffb51ffb700 1 -- 172.21.15.149:0/332529322 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4c00cbc0 con 0x7ffb5c0b2850 2023-11-08T19:30:10.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.691+0000 7ffb63374700 1 -- 172.21.15.149:0/332529322 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb5c09b100 con 0x7ffb5c0b2850 2023-11-08T19:30:10.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.692+0000 7ffb63374700 1 -- 172.21.15.149:0/332529322 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb5c0aed90 con 0x7ffb5c0b2850 2023-11-08T19:30:10.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.692+0000 7ffb51ffb700 1 -- 172.21.15.149:0/332529322 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ffb4c00cd20 con 0x7ffb5c0b2850 2023-11-08T19:30:10.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.693+0000 7ffb51ffb700 1 --2- 172.21.15.149:0/332529322 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ffb4006af00 0x7ffb4006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:10.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.693+0000 7ffb51ffb700 1 -- 172.21.15.149:0/332529322 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6999+0+0 (secure 0 0 0) 0x7ffb4c089f00 con 0x7ffb5c0b2850 2023-11-08T19:30:10.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.693+0000 7ffb6090f700 1 --2- 172.21.15.149:0/332529322 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ffb4006af00 0x7ffb4006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:10.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.693+0000 7ffb6090f700 1 --2- 172.21.15.149:0/332529322 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ffb4006af00 0x7ffb4006d3c0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c0d1100 tx=0x7ffb58009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:10.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.697+0000 7ffb51ffb700 1 -- 172.21.15.149:0/332529322 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ffb5c0aed90 con 0x7ffb5c0b2850 2023-11-08T19:30:10.888 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.887+0000 7ffb63374700 1 -- 172.21.15.149:0/332529322 --> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7ffb5c0b1d70 con 0x7ffb4006af00 2023-11-08T19:30:10.889 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.887+0000 7ffb51ffb700 1 -- 172.21.15.149:0/332529322 <== mgr.4104 v2:172.21.15.149:6832/1929837472 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ffb580050d0 con 0x7ffb4006af00 2023-11-08T19:30:10.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.890+0000 7ffb63374700 1 -- 172.21.15.149:0/332529322 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ffb4006af00 msgr2=0x7ffb4006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:10.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.890+0000 7ffb63374700 1 --2- 172.21.15.149:0/332529322 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ffb4006af00 0x7ffb4006d3c0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c0d1100 tx=0x7ffb58009040 comp rx=0 tx=0).stop 2023-11-08T19:30:10.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.890+0000 7ffb63374700 1 -- 172.21.15.149:0/332529322 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb5c0b2850 msgr2=0x7ffb5c1f72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:10.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.890+0000 7ffb63374700 1 --2- 172.21.15.149:0/332529322 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb5c0b2850 0x7ffb5c1f72e0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c00e900 tx=0x7ffb4c00ecc0 comp rx=0 tx=0).stop 2023-11-08T19:30:10.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.890+0000 7ffb63374700 1 -- 172.21.15.149:0/332529322 shutdown_connections 2023-11-08T19:30:10.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.890+0000 7ffb63374700 1 --2- 172.21.15.149:0/332529322 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7ffb4006af00 0x7ffb4006d3c0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:10.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.890+0000 7ffb63374700 1 --2- 172.21.15.149:0/332529322 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffb5c0cc140 0x7ffb5c0af070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:10.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.890+0000 7ffb63374700 1 --2- 172.21.15.149:0/332529322 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb5c0b2850 0x7ffb5c1f72e0 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:10.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.890+0000 7ffb63374700 1 --2- 172.21.15.149:0/332529322 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffb5c0b2cd0 0x7ffb5c0c88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:10.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.890+0000 7ffb63374700 1 -- 172.21.15.149:0/332529322 >> 172.21.15.149:0/332529322 conn(0x7ffb5c099a40 msgr2=0x7ffb5c0c7670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:10.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.890+0000 7ffb63374700 1 -- 172.21.15.149:0/332529322 shutdown_connections 2023-11-08T19:30:10.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:10.890+0000 7ffb63374700 1 -- 172.21.15.149:0/332529322 wait complete. 2023-11-08T19:30:10.895 INFO:teuthology.orchestra.run.smithi149.stderr:instructed osd(s) 0 to deep-scrub 2023-11-08T19:30:10.903 INFO:tasks.ceph:Scrubbing osd.1 2023-11-08T19:30:10.904 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-11-08T19:30:11.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.028+0000 7fdd59474700 1 Processor -- start 2023-11-08T19:30:11.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.028+0000 7fdd59474700 1 -- start start 2023-11-08T19:30:11.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.029+0000 7fdd59474700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fdd5415da40 0x7fdd540ceb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:11.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.029+0000 7fdd59474700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fdd540d0360 0x7fdd540d0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:11.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.029+0000 7fdd59474700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd540d0ca0 con 0x7fdd540d2e70 2023-11-08T19:30:11.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.029+0000 7fdd59474700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd540d1520 con 0x7fdd5415da40 2023-11-08T19:30:11.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.029+0000 7fdd59474700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd540d3650 con 0x7fdd540d0360 2023-11-08T19:30:11.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.029+0000 7fdd52ffd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fdd5415da40 0x7fdd540ceb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:11.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.029+0000 7fdd52ffd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fdd5415da40 0x7fdd540ceb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45968/0 (socket says 172.21.15.149:45968) 2023-11-08T19:30:11.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.029+0000 7fdd52ffd700 1 -- 172.21.15.149:0/3356374369 learned_addr learned my addr 172.21.15.149:0/3356374369 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:30:11.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.029+0000 7fdd527fc700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fdd540d2e70 0x7fdd540d22c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:47972/0 (socket says 172.21.15.149:47972) 2023-11-08T19:30:11.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.029+0000 7fdd537fe700 1 --2- 172.21.15.149:0/3356374369 >> v2:172.21.15.160:3300/0 conn(0x7fdd540d0360 0x7fdd540d0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:11.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.029+0000 7fdd52ffd700 1 -- 172.21.15.149:0/3356374369 >> v2:172.21.15.160:3300/0 conn(0x7fdd540d0360 msgr2=0x7fdd540d0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:30:11.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.029+0000 7fdd52ffd700 1 --2- 172.21.15.149:0/3356374369 >> v2:172.21.15.160:3300/0 conn(0x7fdd540d0360 0x7fdd540d0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:11.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.029+0000 7fdd52ffd700 1 -- 172.21.15.149:0/3356374369 >> v1:172.21.15.149:6789/0 conn(0x7fdd540d2e70 legacy=0x7fdd540d22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:11.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.029+0000 7fdd52ffd700 1 -- 172.21.15.149:0/3356374369 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd540d17e0 con 0x7fdd5415da40 2023-11-08T19:30:11.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.029+0000 7fdd51ffb700 1 -- 172.21.15.149:0/3356374369 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 761882871 0 0) 0x7fdd540d0ca0 con 0x7fdd540d2e70 2023-11-08T19:30:11.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.030+0000 7fdd52ffd700 1 --2- 172.21.15.149:0/3356374369 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdd5415da40 0x7fdd540ceb40 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7fdd540ca9a0 tx=0x7fdd48009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e19b26119b909e server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:11.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.030+0000 7fdd51ffb700 1 -- 172.21.15.149:0/3356374369 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4800b870 con 0x7fdd5415da40 2023-11-08T19:30:11.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.030+0000 7fdd51ffb700 1 -- 172.21.15.149:0/3356374369 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd4800b9d0 con 0x7fdd5415da40 2023-11-08T19:30:11.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.030+0000 7fdd51ffb700 1 -- 172.21.15.149:0/3356374369 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4800bd60 con 0x7fdd5415da40 2023-11-08T19:30:11.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.030+0000 7fdd59474700 1 -- 172.21.15.149:0/3356374369 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdd5415da40 msgr2=0x7fdd540ceb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:11.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.030+0000 7fdd59474700 1 --2- 172.21.15.149:0/3356374369 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdd5415da40 0x7fdd540ceb40 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7fdd540ca9a0 tx=0x7fdd48009bd0 comp rx=0 tx=0).stop 2023-11-08T19:30:11.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.030+0000 7fdd59474700 1 -- 172.21.15.149:0/3356374369 shutdown_connections 2023-11-08T19:30:11.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.030+0000 7fdd59474700 1 --2- 172.21.15.149:0/3356374369 >> v2:172.21.15.160:3300/0 conn(0x7fdd540d0360 0x7fdd540d0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:11.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.030+0000 7fdd59474700 1 --2- 172.21.15.149:0/3356374369 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdd5415da40 0x7fdd540ceb40 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:11.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.030+0000 7fdd59474700 1 -- 172.21.15.149:0/3356374369 >> 172.21.15.149:0/3356374369 conn(0x7fdd5406bd80 msgr2=0x7fdd5406c190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:11.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.030+0000 7fdd59474700 1 -- 172.21.15.149:0/3356374369 shutdown_connections 2023-11-08T19:30:11.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.030+0000 7fdd59474700 1 -- 172.21.15.149:0/3356374369 wait complete. 2023-11-08T19:30:11.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.032+0000 7fdd59474700 1 Processor -- start 2023-11-08T19:30:11.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.032+0000 7fdd59474700 1 -- start start 2023-11-08T19:30:11.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.032+0000 7fdd59474700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdd540d0360 0x7fdd540b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:11.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.032+0000 7fdd59474700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdd540d2e70 0x7fdd541607f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:11.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.032+0000 7fdd59474700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdd5415da40 0x7fdd541f5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:11.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.032+0000 7fdd59474700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd541f62d0 con 0x7fdd5415da40 2023-11-08T19:30:11.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.032+0000 7fdd59474700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd540b3a70 con 0x7fdd540d2e70 2023-11-08T19:30:11.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.033+0000 7fdd59474700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd540b3d50 con 0x7fdd540d0360 2023-11-08T19:30:11.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.033+0000 7fdd537fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdd5415da40 0x7fdd541f5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:11.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.033+0000 7fdd537fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdd5415da40 0x7fdd541f5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45978/0 (socket says 172.21.15.149:45978) 2023-11-08T19:30:11.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.033+0000 7fdd537fe700 1 -- 172.21.15.149:0/3316256486 learned_addr learned my addr 172.21.15.149:0/3316256486 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:30:11.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.033+0000 7fdd527fc700 1 --2- 172.21.15.149:0/3316256486 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdd540d2e70 0x7fdd541607f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:11.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.033+0000 7fdd52ffd700 1 --2- 172.21.15.149:0/3316256486 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdd540d0360 0x7fdd540b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:11.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.033+0000 7fdd537fe700 1 -- 172.21.15.149:0/3316256486 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdd540d0360 msgr2=0x7fdd540b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:11.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.033+0000 7fdd537fe700 1 --2- 172.21.15.149:0/3316256486 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdd540d0360 0x7fdd540b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:11.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.033+0000 7fdd537fe700 1 -- 172.21.15.149:0/3316256486 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdd540d2e70 msgr2=0x7fdd541607f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:11.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.033+0000 7fdd537fe700 1 --2- 172.21.15.149:0/3316256486 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdd540d2e70 0x7fdd541607f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:11.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.033+0000 7fdd537fe700 1 -- 172.21.15.149:0/3316256486 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd48009550 con 0x7fdd5415da40 2023-11-08T19:30:11.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.033+0000 7fdd527fc700 1 --2- 172.21.15.149:0/3316256486 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdd540d2e70 0x7fdd541607f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:30:11.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.033+0000 7fdd52ffd700 1 --2- 172.21.15.149:0/3316256486 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdd540d0360 0x7fdd540b33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:30:11.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.033+0000 7fdd537fe700 1 --2- 172.21.15.149:0/3316256486 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdd5415da40 0x7fdd541f5d90 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c007e40 tx=0x7fdd4c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:11.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.033+0000 7fdd3b7fe700 1 -- 172.21.15.149:0/3316256486 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c00eea0 con 0x7fdd5415da40 2023-11-08T19:30:11.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.033+0000 7fdd3b7fe700 1 -- 172.21.15.149:0/3316256486 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd4c014420 con 0x7fdd5415da40 2023-11-08T19:30:11.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.033+0000 7fdd59474700 1 -- 172.21.15.149:0/3316256486 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd540b4030 con 0x7fdd5415da40 2023-11-08T19:30:11.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.033+0000 7fdd3b7fe700 1 -- 172.21.15.149:0/3316256486 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c0147b0 con 0x7fdd5415da40 2023-11-08T19:30:11.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.033+0000 7fdd59474700 1 -- 172.21.15.149:0/3316256486 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd540b45f0 con 0x7fdd5415da40 2023-11-08T19:30:11.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.034+0000 7fdd59474700 1 -- 172.21.15.149:0/3316256486 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdd540d1da0 con 0x7fdd5415da40 2023-11-08T19:30:11.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.035+0000 7fdd3b7fe700 1 -- 172.21.15.149:0/3316256486 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdd4c014910 con 0x7fdd5415da40 2023-11-08T19:30:11.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.035+0000 7fdd3b7fe700 1 --2- 172.21.15.149:0/3316256486 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fdd4006af00 0x7fdd4006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:11.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.035+0000 7fdd3b7fe700 1 -- 172.21.15.149:0/3316256486 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6999+0+0 (secure 0 0 0) 0x7fdd4c08a2b0 con 0x7fdd5415da40 2023-11-08T19:30:11.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.035+0000 7fdd52ffd700 1 --2- 172.21.15.149:0/3316256486 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fdd4006af00 0x7fdd4006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:11.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.035+0000 7fdd3b7fe700 1 --2- 172.21.15.149:0/3316256486 >> [v2:172.21.15.149:6817/696424905,v1:172.21.15.149:6819/696424905] conn(0x7fdd40073e40 0x7fdd400762c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:11.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.035+0000 7fdd3b7fe700 1 -- 172.21.15.149:0/3316256486 --> [v2:172.21.15.149:6817/696424905,v1:172.21.15.149:6819/696424905] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdd40076990 con 0x7fdd40073e40 2023-11-08T19:30:11.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.035+0000 7fdd3b7fe700 1 -- 172.21.15.149:0/3316256486 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_get_version_reply(handle=1 version=111) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd4c08c970 con 0x7fdd5415da40 2023-11-08T19:30:11.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.035+0000 7fdd527fc700 1 --2- 172.21.15.149:0/3316256486 >> [v2:172.21.15.149:6817/696424905,v1:172.21.15.149:6819/696424905] conn(0x7fdd40073e40 0x7fdd400762c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:11.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.036+0000 7fdd52ffd700 1 --2- 172.21.15.149:0/3316256486 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fdd4006af00 0x7fdd4006d3c0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fdd48014040 tx=0x7fdd48008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:11.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.036+0000 7fdd527fc700 1 --2- 172.21.15.149:0/3316256486 >> [v2:172.21.15.149:6817/696424905,v1:172.21.15.149:6819/696424905] conn(0x7fdd40073e40 0x7fdd400762c0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:11.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.036+0000 7fdd3b7fe700 1 -- 172.21.15.149:0/3316256486 <== osd.1 v2:172.21.15.149:6817/696424905 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7fdd40076990 con 0x7fdd40073e40 2023-11-08T19:30:11.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.051+0000 7fdd59474700 1 -- 172.21.15.149:0/3316256486 --> [v2:172.21.15.149:6817/696424905,v1:172.21.15.149:6819/696424905] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fdd540d1ac0 con 0x7fdd40073e40 2023-11-08T19:30:11.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.051+0000 7fdd3b7fe700 1 -- 172.21.15.149:0/3316256486 <== osd.1 v2:172.21.15.149:6817/696424905 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fdd44004870 con 0x7fdd40073e40 2023-11-08T19:30:11.057 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2023-11-08T19:30:11.058 INFO:teuthology.orchestra.run.smithi149.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-08T19:30:11.058 INFO:teuthology.orchestra.run.smithi149.stdout:} 2023-11-08T19:30:11.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.052+0000 7fdd59474700 1 -- 172.21.15.149:0/3316256486 >> [v2:172.21.15.149:6817/696424905,v1:172.21.15.149:6819/696424905] conn(0x7fdd40073e40 msgr2=0x7fdd400762c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:11.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.052+0000 7fdd59474700 1 --2- 172.21.15.149:0/3316256486 >> [v2:172.21.15.149:6817/696424905,v1:172.21.15.149:6819/696424905] conn(0x7fdd40073e40 0x7fdd400762c0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:11.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.052+0000 7fdd59474700 1 -- 172.21.15.149:0/3316256486 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fdd4006af00 msgr2=0x7fdd4006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:11.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.052+0000 7fdd59474700 1 --2- 172.21.15.149:0/3316256486 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fdd4006af00 0x7fdd4006d3c0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fdd48014040 tx=0x7fdd48008030 comp rx=0 tx=0).stop 2023-11-08T19:30:11.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.052+0000 7fdd59474700 1 -- 172.21.15.149:0/3316256486 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdd5415da40 msgr2=0x7fdd541f5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:11.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.052+0000 7fdd59474700 1 --2- 172.21.15.149:0/3316256486 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdd5415da40 0x7fdd541f5d90 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c007e40 tx=0x7fdd4c00e3c0 comp rx=0 tx=0).stop 2023-11-08T19:30:11.061 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.052+0000 7fdd537fe700 1 -- 172.21.15.149:0/3316256486 reap_dead start 2023-11-08T19:30:11.061 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.052+0000 7fdd59474700 1 -- 172.21.15.149:0/3316256486 shutdown_connections 2023-11-08T19:30:11.061 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.052+0000 7fdd59474700 1 -- 172.21.15.149:0/3316256486 >> 172.21.15.149:0/3316256486 conn(0x7fdd5406bd80 msgr2=0x7fdd54073930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:11.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.052+0000 7fdd59474700 1 -- 172.21.15.149:0/3316256486 shutdown_connections 2023-11-08T19:30:11.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.052+0000 7fdd59474700 1 -- 172.21.15.149:0/3316256486 wait complete. 2023-11-08T19:30:11.065 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-11-08T19:30:11.188 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.187+0000 7fa88be5b700 1 Processor -- start 2023-11-08T19:30:11.189 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.187+0000 7fa88be5b700 1 -- start start 2023-11-08T19:30:11.191 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.188+0000 7fa88be5b700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa884161670 0x7fa8840b5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:11.192 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.188+0000 7fa88be5b700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fa8840ce500 0x7fa8840ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:11.192 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.188+0000 7fa88be5b700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8840d1a10 con 0x7fa884161a50 2023-11-08T19:30:11.192 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.188+0000 7fa88be5b700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8840d1cf0 con 0x7fa884161670 2023-11-08T19:30:11.193 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.188+0000 7fa88be5b700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8840d1fd0 con 0x7fa8840ce500 2023-11-08T19:30:11.193 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.188+0000 7fa889bf7700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa884161670 0x7fa8840b5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:11.193 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.188+0000 7fa889bf7700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa884161670 0x7fa8840b5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45984/0 (socket says 172.21.15.149:45984) 2023-11-08T19:30:11.194 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.188+0000 7fa889bf7700 1 -- 172.21.15.149:0/4075580380 learned_addr learned my addr 172.21.15.149:0/4075580380 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:30:11.194 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.188+0000 7fa88a3f8700 1 --2- 172.21.15.149:0/4075580380 >> v2:172.21.15.160:3300/0 conn(0x7fa8840ce500 0x7fa8840ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:11.194 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.189+0000 7fa889bf7700 1 -- 172.21.15.149:0/4075580380 >> v2:172.21.15.160:3300/0 conn(0x7fa8840ce500 msgr2=0x7fa8840ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:30:11.195 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.189+0000 7fa889bf7700 1 --2- 172.21.15.149:0/4075580380 >> v2:172.21.15.160:3300/0 conn(0x7fa8840ce500 0x7fa8840ce970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:11.195 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.189+0000 7fa889bf7700 1 -- 172.21.15.149:0/4075580380 >> v1:172.21.15.149:6789/0 conn(0x7fa884161a50 legacy=0x7fa884161f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:11.195 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.189+0000 7fa889bf7700 1 -- 172.21.15.149:0/4075580380 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8840d22b0 con 0x7fa884161670 2023-11-08T19:30:11.195 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.189+0000 7fa889bf7700 1 --2- 172.21.15.149:0/4075580380 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa884161670 0x7fa8840b5e10 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7fa88406b590 tx=0x7fa874009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b933a2a07527ef0e server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:11.196 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.189+0000 7fa888bf5700 1 -- 172.21.15.149:0/4075580380 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa874005e30 con 0x7fa884161670 2023-11-08T19:30:11.196 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.189+0000 7fa888bf5700 1 -- 172.21.15.149:0/4075580380 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa874004030 con 0x7fa884161670 2023-11-08T19:30:11.196 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.189+0000 7fa888bf5700 1 -- 172.21.15.149:0/4075580380 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8740043e0 con 0x7fa884161670 2023-11-08T19:30:11.197 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.189+0000 7fa88be5b700 1 -- 172.21.15.149:0/4075580380 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa884161670 msgr2=0x7fa8840b5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:11.197 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.189+0000 7fa88be5b700 1 --2- 172.21.15.149:0/4075580380 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa884161670 0x7fa8840b5e10 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7fa88406b590 tx=0x7fa874009bd0 comp rx=0 tx=0).stop 2023-11-08T19:30:11.197 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.189+0000 7fa88be5b700 1 -- 172.21.15.149:0/4075580380 shutdown_connections 2023-11-08T19:30:11.197 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.189+0000 7fa88be5b700 1 --2- 172.21.15.149:0/4075580380 >> v2:172.21.15.160:3300/0 conn(0x7fa8840ce500 0x7fa8840ce970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:11.198 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.189+0000 7fa88be5b700 1 --2- 172.21.15.149:0/4075580380 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa884161670 0x7fa8840b5e10 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:11.198 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.189+0000 7fa88be5b700 1 -- 172.21.15.149:0/4075580380 >> 172.21.15.149:0/4075580380 conn(0x7fa8840d3980 msgr2=0x7fa8840d3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:11.198 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.190+0000 7fa88be5b700 1 -- 172.21.15.149:0/4075580380 shutdown_connections 2023-11-08T19:30:11.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.190+0000 7fa88be5b700 1 -- 172.21.15.149:0/4075580380 wait complete. 2023-11-08T19:30:11.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.191+0000 7fa88be5b700 1 Processor -- start 2023-11-08T19:30:11.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.191+0000 7fa88be5b700 1 -- start start 2023-11-08T19:30:11.202 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.191+0000 7fa88be5b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa8840ce500 0x7fa8840b8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:11.202 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.191+0000 7fa88be5b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa884161670 0x7fa8840cb810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:11.203 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.191+0000 7fa88be5b700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa884161a50 0x7fa8841f74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:11.203 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.191+0000 7fa88be5b700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8840cbd50 con 0x7fa884161670 2023-11-08T19:30:11.203 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.191+0000 7fa88be5b700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8840cd7e0 con 0x7fa8840ce500 2023-11-08T19:30:11.204 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.191+0000 7fa88be5b700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8840cc740 con 0x7fa884161a50 2023-11-08T19:30:11.204 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.192+0000 7fa8893f6700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa884161670 0x7fa8840cb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:11.204 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.192+0000 7fa8893f6700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa884161670 0x7fa8840cb810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45992/0 (socket says 172.21.15.149:45992) 2023-11-08T19:30:11.204 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.192+0000 7fa8893f6700 1 -- 172.21.15.149:0/2350189126 learned_addr learned my addr 172.21.15.149:0/2350189126 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:30:11.205 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.192+0000 7fa8893f6700 1 -- 172.21.15.149:0/2350189126 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa884161a50 msgr2=0x7fa8841f74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:11.205 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.192+0000 7fa8893f6700 1 --2- 172.21.15.149:0/2350189126 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa884161a50 0x7fa8841f74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:11.205 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.192+0000 7fa889bf7700 1 --2- 172.21.15.149:0/2350189126 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa8840ce500 0x7fa8840b8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:11.206 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.192+0000 7fa8893f6700 1 -- 172.21.15.149:0/2350189126 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa8840ce500 msgr2=0x7fa8840b8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:11.206 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.192+0000 7fa8893f6700 1 --2- 172.21.15.149:0/2350189126 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa8840ce500 0x7fa8840b8f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:11.207 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.192+0000 7fa8893f6700 1 -- 172.21.15.149:0/2350189126 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa874009500 con 0x7fa884161670 2023-11-08T19:30:11.207 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.192+0000 7fa8893f6700 1 --2- 172.21.15.149:0/2350189126 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa884161670 0x7fa8840cb810 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7fa88000c460 tx=0x7fa88000c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:11.207 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.192+0000 7fa87a7fc700 1 -- 172.21.15.149:0/2350189126 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8800052d0 con 0x7fa884161670 2023-11-08T19:30:11.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.192+0000 7fa87a7fc700 1 -- 172.21.15.149:0/2350189126 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa880005430 con 0x7fa884161670 2023-11-08T19:30:11.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.192+0000 7fa88be5b700 1 -- 172.21.15.149:0/2350189126 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8840cca20 con 0x7fa884161670 2023-11-08T19:30:11.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.192+0000 7fa87a7fc700 1 -- 172.21.15.149:0/2350189126 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8800038c0 con 0x7fa884161670 2023-11-08T19:30:11.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.192+0000 7fa88be5b700 1 -- 172.21.15.149:0/2350189126 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8840ccfe0 con 0x7fa884161670 2023-11-08T19:30:11.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.193+0000 7fa88be5b700 1 -- 172.21.15.149:0/2350189126 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8840cffd0 con 0x7fa884161670 2023-11-08T19:30:11.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.194+0000 7fa87a7fc700 1 -- 172.21.15.149:0/2350189126 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa880003a20 con 0x7fa884161670 2023-11-08T19:30:11.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.194+0000 7fa87a7fc700 1 --2- 172.21.15.149:0/2350189126 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa86806af00 0x7fa86806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:11.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.194+0000 7fa87a7fc700 1 -- 172.21.15.149:0/2350189126 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6999+0+0 (secure 0 0 0) 0x7fa880088f30 con 0x7fa884161670 2023-11-08T19:30:11.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.194+0000 7fa889bf7700 1 --2- 172.21.15.149:0/2350189126 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa86806af00 0x7fa86806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:11.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.194+0000 7fa889bf7700 1 --2- 172.21.15.149:0/2350189126 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa86806af00 0x7fa86806d3c0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fa874014040 tx=0x7fa874008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:11.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.199+0000 7fa87a7fc700 1 -- 172.21.15.149:0/2350189126 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa880053ad0 con 0x7fa884161670 2023-11-08T19:30:11.394 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.393+0000 7fa88be5b700 1 -- 172.21.15.149:0/2350189126 --> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fa8840d30f0 con 0x7fa86806af00 2023-11-08T19:30:11.395 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.393+0000 7fa87a7fc700 1 -- 172.21.15.149:0/2350189126 <== mgr.4104 v2:172.21.15.149:6832/1929837472 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa8840d30f0 con 0x7fa86806af00 2023-11-08T19:30:11.397 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.395+0000 7fa88be5b700 1 -- 172.21.15.149:0/2350189126 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa86806af00 msgr2=0x7fa86806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:11.398 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.395+0000 7fa88be5b700 1 --2- 172.21.15.149:0/2350189126 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa86806af00 0x7fa86806d3c0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fa874014040 tx=0x7fa874008070 comp rx=0 tx=0).stop 2023-11-08T19:30:11.398 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.395+0000 7fa88be5b700 1 -- 172.21.15.149:0/2350189126 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa884161670 msgr2=0x7fa8840cb810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:11.399 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.395+0000 7fa88be5b700 1 --2- 172.21.15.149:0/2350189126 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa884161670 0x7fa8840cb810 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7fa88000c460 tx=0x7fa88000c820 comp rx=0 tx=0).stop 2023-11-08T19:30:11.399 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.395+0000 7fa88be5b700 1 -- 172.21.15.149:0/2350189126 shutdown_connections 2023-11-08T19:30:11.399 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.395+0000 7fa88be5b700 1 --2- 172.21.15.149:0/2350189126 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fa86806af00 0x7fa86806d3c0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:11.399 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.395+0000 7fa88be5b700 1 --2- 172.21.15.149:0/2350189126 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa8840ce500 0x7fa8840b8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:11.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.395+0000 7fa88be5b700 1 --2- 172.21.15.149:0/2350189126 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa884161a50 0x7fa8841f74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:11.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.395+0000 7fa88be5b700 1 --2- 172.21.15.149:0/2350189126 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa884161670 0x7fa8840cb810 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:11.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.395+0000 7fa88be5b700 1 -- 172.21.15.149:0/2350189126 >> 172.21.15.149:0/2350189126 conn(0x7fa8840d3980 msgr2=0x7fa88415ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:11.401 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.396+0000 7fa88be5b700 1 -- 172.21.15.149:0/2350189126 shutdown_connections 2023-11-08T19:30:11.401 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.396+0000 7fa88be5b700 1 -- 172.21.15.149:0/2350189126 wait complete. 2023-11-08T19:30:11.401 INFO:teuthology.orchestra.run.smithi149.stderr:instructed osd(s) 1 to deep-scrub 2023-11-08T19:30:11.409 INFO:tasks.ceph:Scrubbing osd.2 2023-11-08T19:30:11.409 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-11-08T19:30:11.534 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.533+0000 7f163125f700 1 Processor -- start 2023-11-08T19:30:11.534 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.533+0000 7f163125f700 1 -- start start 2023-11-08T19:30:11.537 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.533+0000 7f163125f700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f162c06b290 0x7f162c168a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:11.537 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.533+0000 7f163125f700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f162c0700d0 con 0x7f162c15dcd0 2023-11-08T19:30:11.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.533+0000 7f163125f700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f162c06fdf0 con 0x7f162c072cd0 2023-11-08T19:30:11.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.533+0000 7f163125f700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f162c15e0b0 con 0x7f162c06b290 2023-11-08T19:30:11.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.534+0000 7f162b59e700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f162c06b290 0x7f162c168a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:11.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.534+0000 7f162b59e700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f162c06b290 0x7f162c168a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:46002/0 (socket says 172.21.15.149:46002) 2023-11-08T19:30:11.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.534+0000 7f162ad9d700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f162c15dcd0 0x7f162c070470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:48000/0 (socket says 172.21.15.149:48000) 2023-11-08T19:30:11.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.534+0000 7f162b59e700 1 -- 172.21.15.149:0/1436580810 learned_addr learned my addr 172.21.15.149:0/1436580810 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:30:11.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.534+0000 7f162b59e700 1 -- 172.21.15.149:0/1436580810 >> v1:172.21.15.160:6789/0 conn(0x7f162c072cd0 legacy=0x7f162c06ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:11.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.534+0000 7f162b59e700 1 -- 172.21.15.149:0/1436580810 >> v1:172.21.15.149:6789/0 conn(0x7f162c15dcd0 legacy=0x7f162c070470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:11.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.534+0000 7f162b59e700 1 -- 172.21.15.149:0/1436580810 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f162c0721f0 con 0x7f162c06b290 2023-11-08T19:30:11.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.534+0000 7f162b59e700 1 --2- 172.21.15.149:0/1436580810 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f162c06b290 0x7f162c168a60 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f1624009e50 tx=0x7f162400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be25a9743c9c27d server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:11.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.534+0000 7f1629d9b700 1 -- 172.21.15.149:0/1436580810 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162400e070 con 0x7f162c06b290 2023-11-08T19:30:11.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.534+0000 7f1629d9b700 1 -- 172.21.15.149:0/1436580810 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f162400b9c0 con 0x7f162c06b290 2023-11-08T19:30:11.542 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.534+0000 7f1629d9b700 1 -- 172.21.15.149:0/1436580810 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162400bd70 con 0x7f162c06b290 2023-11-08T19:30:11.542 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.535+0000 7f163125f700 1 -- 172.21.15.149:0/1436580810 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f162c06b290 msgr2=0x7f162c168a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:11.542 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.535+0000 7f163125f700 1 --2- 172.21.15.149:0/1436580810 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f162c06b290 0x7f162c168a60 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f1624009e50 tx=0x7f162400b330 comp rx=0 tx=0).stop 2023-11-08T19:30:11.543 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.535+0000 7f163125f700 1 -- 172.21.15.149:0/1436580810 shutdown_connections 2023-11-08T19:30:11.543 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.535+0000 7f163125f700 1 --2- 172.21.15.149:0/1436580810 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f162c06b290 0x7f162c168a60 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:11.543 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.535+0000 7f163125f700 1 -- 172.21.15.149:0/1436580810 >> 172.21.15.149:0/1436580810 conn(0x7f162c0cd0e0 msgr2=0x7f162c0cd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:11.544 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.535+0000 7f163125f700 1 -- 172.21.15.149:0/1436580810 shutdown_connections 2023-11-08T19:30:11.544 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.535+0000 7f163125f700 1 -- 172.21.15.149:0/1436580810 wait complete. 2023-11-08T19:30:11.544 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.536+0000 7f163125f700 1 Processor -- start 2023-11-08T19:30:11.545 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.536+0000 7f163125f700 1 -- start start 2023-11-08T19:30:11.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.537+0000 7f163125f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f162c06b290 0x7f162c1f2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:11.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.537+0000 7f163125f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f162c072cd0 0x7f162c0c9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:11.551 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.537+0000 7f163125f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f162c15dcd0 0x7f162c0b1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:11.551 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.537+0000 7f163125f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f162c0b23f0 con 0x7f162c072cd0 2023-11-08T19:30:11.552 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.537+0000 7f163125f700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f162c1f37d0 con 0x7f162c06b290 2023-11-08T19:30:11.552 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.537+0000 7f163125f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f162c1f3ab0 con 0x7f162c15dcd0 2023-11-08T19:30:11.552 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.537+0000 7f162a59c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f162c072cd0 0x7f162c0c9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:11.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.537+0000 7f162a59c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f162c072cd0 0x7f162c0c9760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:46006/0 (socket says 172.21.15.149:46006) 2023-11-08T19:30:11.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.537+0000 7f162a59c700 1 -- 172.21.15.149:0/2669748648 learned_addr learned my addr 172.21.15.149:0/2669748648 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:30:11.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.537+0000 7f162b59e700 1 --2- 172.21.15.149:0/2669748648 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f162c15dcd0 0x7f162c0b1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:11.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.537+0000 7f162ad9d700 1 --2- 172.21.15.149:0/2669748648 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f162c06b290 0x7f162c1f2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:11.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.537+0000 7f162a59c700 1 -- 172.21.15.149:0/2669748648 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f162c15dcd0 msgr2=0x7f162c0b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:11.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.537+0000 7f162a59c700 1 --2- 172.21.15.149:0/2669748648 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f162c15dcd0 0x7f162c0b1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:11.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.537+0000 7f162a59c700 1 -- 172.21.15.149:0/2669748648 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f162c06b290 msgr2=0x7f162c1f2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:11.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.537+0000 7f162a59c700 1 --2- 172.21.15.149:0/2669748648 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f162c06b290 0x7f162c1f2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:11.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.537+0000 7f162a59c700 1 -- 172.21.15.149:0/2669748648 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1624009b30 con 0x7f162c072cd0 2023-11-08T19:30:11.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.537+0000 7f162b59e700 1 --2- 172.21.15.149:0/2669748648 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f162c15dcd0 0x7f162c0b1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:30:11.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.537+0000 7f162ad9d700 1 --2- 172.21.15.149:0/2669748648 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f162c06b290 0x7f162c1f2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:30:11.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.538+0000 7f162a59c700 1 --2- 172.21.15.149:0/2669748648 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f162c072cd0 0x7f162c0c9760 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f161c00c4e0 tx=0x7f161c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:11.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.538+0000 7f16137fe700 1 -- 172.21.15.149:0/2669748648 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161c0052d0 con 0x7f162c072cd0 2023-11-08T19:30:11.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.538+0000 7f16137fe700 1 -- 172.21.15.149:0/2669748648 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f161c005430 con 0x7f162c072cd0 2023-11-08T19:30:11.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.538+0000 7f163125f700 1 -- 172.21.15.149:0/2669748648 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f162c1f3d90 con 0x7f162c072cd0 2023-11-08T19:30:11.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.538+0000 7f16137fe700 1 -- 172.21.15.149:0/2669748648 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161c0038c0 con 0x7f162c072cd0 2023-11-08T19:30:11.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.538+0000 7f163125f700 1 -- 172.21.15.149:0/2669748648 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f162c1f7910 con 0x7f162c072cd0 2023-11-08T19:30:11.558 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.539+0000 7f163125f700 1 -- 172.21.15.149:0/2669748648 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f162c0727b0 con 0x7f162c072cd0 2023-11-08T19:30:11.558 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.539+0000 7f16137fe700 1 -- 172.21.15.149:0/2669748648 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f161c003a20 con 0x7f162c072cd0 2023-11-08T19:30:11.558 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.540+0000 7f16137fe700 1 --2- 172.21.15.149:0/2669748648 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f161806af00 0x7f161806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:11.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.540+0000 7f16137fe700 1 -- 172.21.15.149:0/2669748648 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6999+0+0 (secure 0 0 0) 0x7f161c088fc0 con 0x7f162c072cd0 2023-11-08T19:30:11.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.540+0000 7f162ad9d700 1 --2- 172.21.15.149:0/2669748648 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f161806af00 0x7f161806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:11.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.540+0000 7f16137fe700 1 --2- 172.21.15.149:0/2669748648 >> [v2:172.21.15.149:6816/3407229782,v1:172.21.15.149:6818/3407229782] conn(0x7f1618073e40 0x7f16180762c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:11.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.540+0000 7f16137fe700 1 -- 172.21.15.149:0/2669748648 --> [v2:172.21.15.149:6816/3407229782,v1:172.21.15.149:6818/3407229782] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1618076990 con 0x7f1618073e40 2023-11-08T19:30:11.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.540+0000 7f16137fe700 1 -- 172.21.15.149:0/2669748648 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_get_version_reply(handle=1 version=111) v2 ==== 24+0+0 (secure 0 0 0) 0x7f161c08b620 con 0x7f162c072cd0 2023-11-08T19:30:11.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.540+0000 7f162b59e700 1 --2- 172.21.15.149:0/2669748648 >> [v2:172.21.15.149:6816/3407229782,v1:172.21.15.149:6818/3407229782] conn(0x7f1618073e40 0x7f16180762c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:11.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.540+0000 7f162ad9d700 1 --2- 172.21.15.149:0/2669748648 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f161806af00 0x7f161806d3c0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f1620000f60 tx=0x7f1620007df0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:11.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.540+0000 7f162b59e700 1 --2- 172.21.15.149:0/2669748648 >> [v2:172.21.15.149:6816/3407229782,v1:172.21.15.149:6818/3407229782] conn(0x7f1618073e40 0x7f16180762c0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:11.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.541+0000 7f16137fe700 1 -- 172.21.15.149:0/2669748648 <== osd.2 v2:172.21.15.149:6816/3407229782 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7f1618076990 con 0x7f1618073e40 2023-11-08T19:30:11.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.556+0000 7f163125f700 1 -- 172.21.15.149:0/2669748648 --> [v2:172.21.15.149:6816/3407229782,v1:172.21.15.149:6818/3407229782] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f162c0724d0 con 0x7f1618073e40 2023-11-08T19:30:11.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.556+0000 7f16137fe700 1 -- 172.21.15.149:0/2669748648 <== osd.2 v2:172.21.15.149:6816/3407229782 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f16240092e0 con 0x7f1618073e40 2023-11-08T19:30:11.563 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2023-11-08T19:30:11.563 INFO:teuthology.orchestra.run.smithi149.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-08T19:30:11.564 INFO:teuthology.orchestra.run.smithi149.stdout:} 2023-11-08T19:30:11.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.556+0000 7f163125f700 1 -- 172.21.15.149:0/2669748648 >> [v2:172.21.15.149:6816/3407229782,v1:172.21.15.149:6818/3407229782] conn(0x7f1618073e40 msgr2=0x7f16180762c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:11.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.556+0000 7f163125f700 1 --2- 172.21.15.149:0/2669748648 >> [v2:172.21.15.149:6816/3407229782,v1:172.21.15.149:6818/3407229782] conn(0x7f1618073e40 0x7f16180762c0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:11.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.556+0000 7f163125f700 1 -- 172.21.15.149:0/2669748648 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f161806af00 msgr2=0x7f161806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:11.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.556+0000 7f163125f700 1 --2- 172.21.15.149:0/2669748648 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f161806af00 0x7f161806d3c0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f1620000f60 tx=0x7f1620007df0 comp rx=0 tx=0).stop 2023-11-08T19:30:11.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.556+0000 7f163125f700 1 -- 172.21.15.149:0/2669748648 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f162c072cd0 msgr2=0x7f162c0c9760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:11.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.556+0000 7f163125f700 1 --2- 172.21.15.149:0/2669748648 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f162c072cd0 0x7f162c0c9760 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f161c00c4e0 tx=0x7f161c00c8a0 comp rx=0 tx=0).stop 2023-11-08T19:30:11.567 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.556+0000 7f162b59e700 1 -- 172.21.15.149:0/2669748648 reap_dead start 2023-11-08T19:30:11.567 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.556+0000 7f163125f700 1 -- 172.21.15.149:0/2669748648 shutdown_connections 2023-11-08T19:30:11.568 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.556+0000 7f163125f700 1 -- 172.21.15.149:0/2669748648 >> 172.21.15.149:0/2669748648 conn(0x7f162c0cd0e0 msgr2=0x7f162c0cbdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:11.568 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.556+0000 7f163125f700 1 -- 172.21.15.149:0/2669748648 shutdown_connections 2023-11-08T19:30:11.569 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.556+0000 7f163125f700 1 -- 172.21.15.149:0/2669748648 wait complete. 2023-11-08T19:30:11.571 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-11-08T19:30:11.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.692+0000 7f6d27d72700 1 Processor -- start 2023-11-08T19:30:11.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.692+0000 7f6d27d72700 1 -- start start 2023-11-08T19:30:11.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.693+0000 7f6d27d72700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f6d200ce840 0x7f6d200d0430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:11.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.693+0000 7f6d27d72700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d200cc2e0 con 0x7f6d200cd5e0 2023-11-08T19:30:11.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.693+0000 7f6d27d72700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d200cc580 con 0x7f6d2015b950 2023-11-08T19:30:11.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.693+0000 7f6d27d72700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d200cc820 con 0x7f6d200ce840 2023-11-08T19:30:11.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.693+0000 7f6d2530d700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f6d200cd5e0 0x7f6d200cfd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:48018/0 (socket says 172.21.15.149:48018) 2023-11-08T19:30:11.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.693+0000 7f6d2530d700 1 -- 172.21.15.149:0/3934164293 learned_addr learned my addr 172.21.15.149:0/3934164293 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:30:11.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.693+0000 7f6d2630f700 1 --2- 172.21.15.149:0/3934164293 >> v2:172.21.15.160:3300/0 conn(0x7f6d200ce840 0x7f6d200d0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:11.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.693+0000 7f6d24b0c700 1 -- 172.21.15.149:0/3934164293 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3306322921 0 0) 0x7f6d200cc2e0 con 0x7f6d200cd5e0 2023-11-08T19:30:11.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.693+0000 7f6d24b0c700 1 -- 172.21.15.149:0/3934164293 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d0c0035b0 con 0x7f6d200cd5e0 2023-11-08T19:30:11.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.693+0000 7f6d24b0c700 1 -- 172.21.15.149:0/3934164293 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1067036908 0 0) 0x7f6d0c0035b0 con 0x7f6d200cd5e0 2023-11-08T19:30:11.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.693+0000 7f6d24b0c700 1 -- 172.21.15.149:0/3934164293 >> v2:172.21.15.160:3300/0 conn(0x7f6d200ce840 msgr2=0x7f6d200d0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:30:11.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.693+0000 7f6d24b0c700 1 --2- 172.21.15.149:0/3934164293 >> v2:172.21.15.160:3300/0 conn(0x7f6d200ce840 0x7f6d200d0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:11.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.693+0000 7f6d24b0c700 1 -- 172.21.15.149:0/3934164293 >> v1:172.21.15.160:6789/0 conn(0x7f6d2015b950 legacy=0x7f6d200ce130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:11.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.693+0000 7f6d24b0c700 1 -- 172.21.15.149:0/3934164293 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d200ccb00 con 0x7f6d200cd5e0 2023-11-08T19:30:11.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.693+0000 7f6d24b0c700 1 -- 172.21.15.149:0/3934164293 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f6d10001670 con 0x7f6d200cd5e0 2023-11-08T19:30:11.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.693+0000 7f6d24b0c700 1 -- 172.21.15.149:0/3934164293 >> v1:172.21.15.149:6789/0 conn(0x7f6d200cd5e0 legacy=0x7f6d200cfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:11.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.693+0000 7f6d24b0c700 1 --2- 172.21.15.149:0/3934164293 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d0c003a00 0x7f6d0c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:11.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.693+0000 7f6d24b0c700 1 --2- 172.21.15.149:0/3934164293 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6d0c004850 0x7f6d0c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:11.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.693+0000 7f6d24b0c700 1 --2- 172.21.15.149:0/3934164293 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6d0c005210 0x7f6d0c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:11.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.693+0000 7f6d24b0c700 1 -- 172.21.15.149:0/3934164293 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d200cc820 con 0x7f6d0c003a00 2023-11-08T19:30:11.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.693+0000 7f6d24b0c700 1 -- 172.21.15.149:0/3934164293 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0c00c0b0 con 0x7f6d0c005210 2023-11-08T19:30:11.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.693+0000 7f6d24b0c700 1 -- 172.21.15.149:0/3934164293 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0c00c270 con 0x7f6d0c004850 2023-11-08T19:30:11.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.694+0000 7f6d25b0e700 1 --2- 172.21.15.149:0/3934164293 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d0c003a00 0x7f6d0c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:11.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.694+0000 7f6d2630f700 1 --2- 172.21.15.149:0/3934164293 >> v2:172.21.15.160:3300/0 conn(0x7f6d200ce840 0x7f6d200d0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:30:11.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.694+0000 7f6d2530d700 1 --2- 172.21.15.149:0/3934164293 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6d0c004850 0x7f6d0c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:11.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.694+0000 7f6d2630f700 1 --2- 172.21.15.149:0/3934164293 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6d0c005210 0x7f6d0c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:11.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.694+0000 7f6d25b0e700 1 -- 172.21.15.149:0/3934164293 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6d0c004850 msgr2=0x7f6d0c004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:30:11.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.694+0000 7f6d25b0e700 1 --2- 172.21.15.149:0/3934164293 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6d0c004850 0x7f6d0c004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:11.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.694+0000 7f6d25b0e700 1 -- 172.21.15.149:0/3934164293 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6d0c005210 msgr2=0x7f6d0c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:30:11.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.694+0000 7f6d25b0e700 1 --2- 172.21.15.149:0/3934164293 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6d0c005210 0x7f6d0c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:11.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.694+0000 7f6d2630f700 1 -- 172.21.15.149:0/3934164293 reap_dead start 2023-11-08T19:30:11.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.694+0000 7f6d25b0e700 1 -- 172.21.15.149:0/3934164293 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d0c0035b0 con 0x7f6d0c003a00 2023-11-08T19:30:11.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.694+0000 7f6d2530d700 1 --2- 172.21.15.149:0/3934164293 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6d0c004850 0x7f6d0c004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:30:11.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.694+0000 7f6d25b0e700 1 --2- 172.21.15.149:0/3934164293 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d0c003a00 0x7f6d0c003e20 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c001820 tx=0x7f6d0c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95b96e232af865e3 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:11.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.694+0000 7f6d24b0c700 1 -- 172.21.15.149:0/3934164293 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c0012e0 con 0x7f6d0c003a00 2023-11-08T19:30:11.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.694+0000 7f6d24b0c700 1 -- 172.21.15.149:0/3934164293 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d1c0052d0 con 0x7f6d0c003a00 2023-11-08T19:30:11.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.694+0000 7f6d24b0c700 1 -- 172.21.15.149:0/3934164293 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c0036d0 con 0x7f6d0c003a00 2023-11-08T19:30:11.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.695+0000 7f6d27d72700 1 -- 172.21.15.149:0/3934164293 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d0c003a00 msgr2=0x7f6d0c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:11.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.695+0000 7f6d27d72700 1 --2- 172.21.15.149:0/3934164293 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d0c003a00 0x7f6d0c003e20 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c001820 tx=0x7f6d0c005880 comp rx=0 tx=0).stop 2023-11-08T19:30:11.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.695+0000 7f6d27d72700 1 -- 172.21.15.149:0/3934164293 shutdown_connections 2023-11-08T19:30:11.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.695+0000 7f6d27d72700 1 --2- 172.21.15.149:0/3934164293 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d0c003a00 0x7f6d0c003e20 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:11.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.695+0000 7f6d27d72700 1 -- 172.21.15.149:0/3934164293 >> 172.21.15.149:0/3934164293 conn(0x7f6d2008afd0 msgr2=0x7f6d200d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:11.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.695+0000 7f6d27d72700 1 -- 172.21.15.149:0/3934164293 shutdown_connections 2023-11-08T19:30:11.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.695+0000 7f6d27d72700 1 -- 172.21.15.149:0/3934164293 wait complete. 2023-11-08T19:30:11.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.696+0000 7f6d27d72700 1 Processor -- start 2023-11-08T19:30:11.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.696+0000 7f6d27d72700 1 -- start start 2023-11-08T19:30:11.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.697+0000 7f6d27d72700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d0c003a00 0x7f6d201585b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:11.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.697+0000 7f6d27d72700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6d2015db20 0x7f6d200cf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:11.719 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.697+0000 7f6d27d72700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6d2015dfa0 0x7f6d200cf830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:11.719 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.697+0000 7f6d27d72700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d200b4020 con 0x7f6d0c003a00 2023-11-08T19:30:11.720 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.697+0000 7f6d27d72700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d20158af0 con 0x7f6d2015db20 2023-11-08T19:30:11.720 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.697+0000 7f6d27d72700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d200b24c0 con 0x7f6d2015dfa0 2023-11-08T19:30:11.721 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.697+0000 7f6d25b0e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d0c003a00 0x7f6d201585b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:11.721 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.697+0000 7f6d25b0e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d0c003a00 0x7f6d201585b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:46026/0 (socket says 172.21.15.149:46026) 2023-11-08T19:30:11.722 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.697+0000 7f6d25b0e700 1 -- 172.21.15.149:0/2342421368 learned_addr learned my addr 172.21.15.149:0/2342421368 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:30:11.722 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.697+0000 7f6d25b0e700 1 -- 172.21.15.149:0/2342421368 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6d2015dfa0 msgr2=0x7f6d200cf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:11.722 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.697+0000 7f6d25b0e700 1 --2- 172.21.15.149:0/2342421368 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6d2015dfa0 0x7f6d200cf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:11.723 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.697+0000 7f6d25b0e700 1 -- 172.21.15.149:0/2342421368 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6d2015db20 msgr2=0x7f6d200cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:11.724 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.697+0000 7f6d2530d700 1 --2- 172.21.15.149:0/2342421368 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6d2015db20 0x7f6d200cf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:11.724 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.697+0000 7f6d25b0e700 1 --2- 172.21.15.149:0/2342421368 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6d2015db20 0x7f6d200cf2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:11.725 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.697+0000 7f6d25b0e700 1 -- 172.21.15.149:0/2342421368 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d200b27a0 con 0x7f6d0c003a00 2023-11-08T19:30:11.725 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.697+0000 7f6d25b0e700 1 --2- 172.21.15.149:0/2342421368 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d0c003a00 0x7f6d201585b0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c000c00 tx=0x7f6d1c001170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:11.726 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.697+0000 7f6d167fc700 1 -- 172.21.15.149:0/2342421368 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c0012e0 con 0x7f6d0c003a00 2023-11-08T19:30:11.726 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.697+0000 7f6d167fc700 1 -- 172.21.15.149:0/2342421368 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d1c0050d0 con 0x7f6d0c003a00 2023-11-08T19:30:11.726 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.697+0000 7f6d27d72700 1 -- 172.21.15.149:0/2342421368 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d200b2a80 con 0x7f6d0c003a00 2023-11-08T19:30:11.727 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.697+0000 7f6d167fc700 1 -- 172.21.15.149:0/2342421368 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c01d420 con 0x7f6d0c003a00 2023-11-08T19:30:11.727 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.697+0000 7f6d27d72700 1 -- 172.21.15.149:0/2342421368 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d200b3040 con 0x7f6d0c003a00 2023-11-08T19:30:11.727 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.698+0000 7f6d27d72700 1 -- 172.21.15.149:0/2342421368 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d200b31d0 con 0x7f6d0c003a00 2023-11-08T19:30:11.727 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.699+0000 7f6d167fc700 1 -- 172.21.15.149:0/2342421368 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6d1c01d580 con 0x7f6d0c003a00 2023-11-08T19:30:11.728 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.699+0000 7f6d167fc700 1 --2- 172.21.15.149:0/2342421368 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6d0406af00 0x7f6d0406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:11.728 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.699+0000 7f6d167fc700 1 -- 172.21.15.149:0/2342421368 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6999+0+0 (secure 0 0 0) 0x7f6d1c08a2f0 con 0x7f6d0c003a00 2023-11-08T19:30:11.728 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.699+0000 7f6d2530d700 1 --2- 172.21.15.149:0/2342421368 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6d0406af00 0x7f6d0406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:11.729 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.700+0000 7f6d2530d700 1 --2- 172.21.15.149:0/2342421368 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6d0406af00 0x7f6d0406d3c0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f6d10001c90 tx=0x7f6d10000ed0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:11.729 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.704+0000 7f6d167fc700 1 -- 172.21.15.149:0/2342421368 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6d1c055040 con 0x7f6d0c003a00 2023-11-08T19:30:11.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.894+0000 7f6d27d72700 1 -- 172.21.15.149:0/2342421368 --> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f6d200cd2d0 con 0x7f6d0406af00 2023-11-08T19:30:11.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.894+0000 7f6d167fc700 1 -- 172.21.15.149:0/2342421368 <== mgr.4104 v2:172.21.15.149:6832/1929837472 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6d200cd2d0 con 0x7f6d0406af00 2023-11-08T19:30:11.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.896+0000 7f6d27d72700 1 -- 172.21.15.149:0/2342421368 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6d0406af00 msgr2=0x7f6d0406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:11.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.896+0000 7f6d27d72700 1 --2- 172.21.15.149:0/2342421368 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6d0406af00 0x7f6d0406d3c0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f6d10001c90 tx=0x7f6d10000ed0 comp rx=0 tx=0).stop 2023-11-08T19:30:11.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.896+0000 7f6d27d72700 1 -- 172.21.15.149:0/2342421368 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d0c003a00 msgr2=0x7f6d201585b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:11.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.896+0000 7f6d27d72700 1 --2- 172.21.15.149:0/2342421368 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d0c003a00 0x7f6d201585b0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c000c00 tx=0x7f6d1c001170 comp rx=0 tx=0).stop 2023-11-08T19:30:11.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.896+0000 7f6d27d72700 1 -- 172.21.15.149:0/2342421368 shutdown_connections 2023-11-08T19:30:11.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.896+0000 7f6d27d72700 1 --2- 172.21.15.149:0/2342421368 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6d0406af00 0x7f6d0406d3c0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:11.902 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.896+0000 7f6d27d72700 1 --2- 172.21.15.149:0/2342421368 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6d2015dfa0 0x7f6d200cf830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:11.902 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.896+0000 7f6d27d72700 1 --2- 172.21.15.149:0/2342421368 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d0c003a00 0x7f6d201585b0 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:11.902 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.896+0000 7f6d27d72700 1 --2- 172.21.15.149:0/2342421368 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6d2015db20 0x7f6d200cf2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:11.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.896+0000 7f6d27d72700 1 -- 172.21.15.149:0/2342421368 >> 172.21.15.149:0/2342421368 conn(0x7f6d2008afd0 msgr2=0x7f6d2015ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:11.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.896+0000 7f6d27d72700 1 -- 172.21.15.149:0/2342421368 shutdown_connections 2023-11-08T19:30:11.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:11.896+0000 7f6d27d72700 1 -- 172.21.15.149:0/2342421368 wait complete. 2023-11-08T19:30:11.904 INFO:teuthology.orchestra.run.smithi149.stderr:instructed osd(s) 2 to deep-scrub 2023-11-08T19:30:11.909 INFO:tasks.ceph:Scrubbing osd.3 2023-11-08T19:30:11.910 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-11-08T19:30:12.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.033+0000 7f2dacdd1700 1 Processor -- start 2023-11-08T19:30:12.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.033+0000 7f2dacdd1700 1 -- start start 2023-11-08T19:30:12.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.034+0000 7f2dacdd1700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f2da80cbdb0 0x7f2da80b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:12.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.034+0000 7f2dacdd1700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2da80cf330 con 0x7f2da815b8e0 2023-11-08T19:30:12.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.034+0000 7f2dacdd1700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2da80b3b00 con 0x7f2da80b3720 2023-11-08T19:30:12.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.034+0000 7f2dacdd1700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2da80b7290 con 0x7f2da80cbdb0 2023-11-08T19:30:12.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.035+0000 7f2da659c700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f2da815b8e0 0x7f2da815fe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:48036/0 (socket says 172.21.15.149:48036) 2023-11-08T19:30:12.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.035+0000 7f2da659c700 1 -- 172.21.15.149:0/3765173409 learned_addr learned my addr 172.21.15.149:0/3765173409 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:30:12.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.035+0000 7f2da5d9b700 1 --2- 172.21.15.149:0/3765173409 >> v2:172.21.15.160:3300/0 conn(0x7f2da80cbdb0 0x7f2da80b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:12.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.035+0000 7f2da559a700 1 -- 172.21.15.149:0/3765173409 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2109969525 0 0) 0x7f2da80cf330 con 0x7f2da815b8e0 2023-11-08T19:30:12.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.035+0000 7f2da559a700 1 -- 172.21.15.149:0/3765173409 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d900035b0 con 0x7f2da815b8e0 2023-11-08T19:30:12.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.035+0000 7f2da559a700 1 -- 172.21.15.149:0/3765173409 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1361069303 0 0) 0x7f2da80b3b00 con 0x7f2da80b3720 2023-11-08T19:30:12.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.035+0000 7f2da559a700 1 -- 172.21.15.149:0/3765173409 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2da80cf330 con 0x7f2da80b3720 2023-11-08T19:30:12.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.035+0000 7f2da559a700 1 -- 172.21.15.149:0/3765173409 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 505187071 0 0) 0x7f2d900035b0 con 0x7f2da815b8e0 2023-11-08T19:30:12.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.035+0000 7f2da5d9b700 1 -- 172.21.15.149:0/3765173409 >> v1:172.21.15.160:6789/0 conn(0x7f2da80b3720 legacy=0x7f2da80cfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:12.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.035+0000 7f2da5d9b700 1 -- 172.21.15.149:0/3765173409 >> v1:172.21.15.149:6789/0 conn(0x7f2da815b8e0 legacy=0x7f2da815fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:12.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.035+0000 7f2da5d9b700 1 -- 172.21.15.149:0/3765173409 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da815bcc0 con 0x7f2da80cbdb0 2023-11-08T19:30:12.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.035+0000 7f2da5d9b700 1 --2- 172.21.15.149:0/3765173409 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2da80cbdb0 0x7f2da80b31e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f2d98009840 tx=0x7f2d98009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14b90a03ad9d4811 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:12.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.035+0000 7f2da559a700 1 -- 172.21.15.149:0/3765173409 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9c001670 con 0x7f2da80cbdb0 2023-11-08T19:30:12.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.036+0000 7f2da559a700 1 -- 172.21.15.149:0/3765173409 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d98004030 con 0x7f2da80cbdb0 2023-11-08T19:30:12.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.036+0000 7f2da559a700 1 -- 172.21.15.149:0/3765173409 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d980043a0 con 0x7f2da80cbdb0 2023-11-08T19:30:12.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.036+0000 7f2dacdd1700 1 -- 172.21.15.149:0/3765173409 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2da80cbdb0 msgr2=0x7f2da80b31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:12.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.036+0000 7f2dacdd1700 1 --2- 172.21.15.149:0/3765173409 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2da80cbdb0 0x7f2da80b31e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f2d98009840 tx=0x7f2d98009b50 comp rx=0 tx=0).stop 2023-11-08T19:30:12.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.036+0000 7f2dacdd1700 1 -- 172.21.15.149:0/3765173409 shutdown_connections 2023-11-08T19:30:12.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.036+0000 7f2dacdd1700 1 --2- 172.21.15.149:0/3765173409 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2da80cbdb0 0x7f2da80b31e0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:12.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.036+0000 7f2dacdd1700 1 -- 172.21.15.149:0/3765173409 >> 172.21.15.149:0/3765173409 conn(0x7f2da80ce1e0 msgr2=0x7f2da80ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:12.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.036+0000 7f2dacdd1700 1 -- 172.21.15.149:0/3765173409 shutdown_connections 2023-11-08T19:30:12.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.036+0000 7f2dacdd1700 1 -- 172.21.15.149:0/3765173409 wait complete. 2023-11-08T19:30:12.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.038+0000 7f2dacdd1700 1 Processor -- start 2023-11-08T19:30:12.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.038+0000 7f2dacdd1700 1 -- start start 2023-11-08T19:30:12.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.038+0000 7f2dacdd1700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2da80b3720 0x7f2da8156c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:12.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.038+0000 7f2dacdd1700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2da80cbdb0 0x7f2da80c77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:12.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.038+0000 7f2dacdd1700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2da815b8e0 0x7f2da80c7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:12.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.038+0000 7f2dacdd1700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da80c60a0 con 0x7f2da80cbdb0 2023-11-08T19:30:12.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.038+0000 7f2dacdd1700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da80c6380 con 0x7f2da815b8e0 2023-11-08T19:30:12.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.038+0000 7f2dacdd1700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2da80c6660 con 0x7f2da80b3720 2023-11-08T19:30:12.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.038+0000 7f2da5d9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2da80cbdb0 0x7f2da80c77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:12.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.038+0000 7f2da5d9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2da80cbdb0 0x7f2da80c77a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:46042/0 (socket says 172.21.15.149:46042) 2023-11-08T19:30:12.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.038+0000 7f2da5d9b700 1 -- 172.21.15.149:0/3732179401 learned_addr learned my addr 172.21.15.149:0/3732179401 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:30:12.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.039+0000 7f2da659c700 1 --2- 172.21.15.149:0/3732179401 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2da80b3720 0x7f2da8156c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:12.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.039+0000 7f2da6d9d700 1 --2- 172.21.15.149:0/3732179401 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2da815b8e0 0x7f2da80c7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:12.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.039+0000 7f2da5d9b700 1 -- 172.21.15.149:0/3732179401 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2da80b3720 msgr2=0x7f2da8156c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:12.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.039+0000 7f2da5d9b700 1 --2- 172.21.15.149:0/3732179401 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2da80b3720 0x7f2da8156c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:12.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.039+0000 7f2da5d9b700 1 -- 172.21.15.149:0/3732179401 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2da815b8e0 msgr2=0x7f2da80c7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:12.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.039+0000 7f2da5d9b700 1 --2- 172.21.15.149:0/3732179401 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2da815b8e0 0x7f2da80c7ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:12.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.039+0000 7f2da5d9b700 1 -- 172.21.15.149:0/3732179401 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d980094a0 con 0x7f2da80cbdb0 2023-11-08T19:30:12.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.039+0000 7f2da5d9b700 1 --2- 172.21.15.149:0/3732179401 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2da80cbdb0 0x7f2da80c77a0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f2d980090b0 tx=0x7f2d98004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:12.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.039+0000 7f2d96ffd700 1 -- 172.21.15.149:0/3732179401 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d98004570 con 0x7f2da80cbdb0 2023-11-08T19:30:12.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.039+0000 7f2d96ffd700 1 -- 172.21.15.149:0/3732179401 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d9801f070 con 0x7f2da80cbdb0 2023-11-08T19:30:12.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.039+0000 7f2d96ffd700 1 -- 172.21.15.149:0/3732179401 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d98011870 con 0x7f2da80cbdb0 2023-11-08T19:30:12.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.039+0000 7f2dacdd1700 1 -- 172.21.15.149:0/3732179401 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2da80c6940 con 0x7f2da80cbdb0 2023-11-08T19:30:12.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.039+0000 7f2dacdd1700 1 -- 172.21.15.149:0/3732179401 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2da8157370 con 0x7f2da80cbdb0 2023-11-08T19:30:12.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.041+0000 7f2d96ffd700 1 -- 172.21.15.149:0/3732179401 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2d980119d0 con 0x7f2da80cbdb0 2023-11-08T19:30:12.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.041+0000 7f2dacdd1700 1 -- 172.21.15.149:0/3732179401 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2da80cc5c0 con 0x7f2da80cbdb0 2023-11-08T19:30:12.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.041+0000 7f2d96ffd700 1 --2- 172.21.15.149:0/3732179401 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2d8806af00 0x7f2d8806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:12.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.041+0000 7f2d96ffd700 1 -- 172.21.15.149:0/3732179401 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6999+0+0 (secure 0 0 0) 0x7f2d98021070 con 0x7f2da80cbdb0 2023-11-08T19:30:12.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.041+0000 7f2da659c700 1 --2- 172.21.15.149:0/3732179401 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2d8806af00 0x7f2d8806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:12.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.041+0000 7f2d96ffd700 1 --2- 172.21.15.149:0/3732179401 >> [v2:172.21.15.149:6808/856914938,v1:172.21.15.149:6809/856914938] conn(0x7f2d88073e40 0x7f2d880762c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:12.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.041+0000 7f2d96ffd700 1 -- 172.21.15.149:0/3732179401 --> [v2:172.21.15.149:6808/856914938,v1:172.21.15.149:6809/856914938] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2d88076990 con 0x7f2d88073e40 2023-11-08T19:30:12.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.041+0000 7f2d96ffd700 1 -- 172.21.15.149:0/3732179401 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_get_version_reply(handle=1 version=111) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2d9808d7e0 con 0x7f2da80cbdb0 2023-11-08T19:30:12.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.041+0000 7f2da6d9d700 1 --2- 172.21.15.149:0/3732179401 >> [v2:172.21.15.149:6808/856914938,v1:172.21.15.149:6809/856914938] conn(0x7f2d88073e40 0x7f2d880762c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:12.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.041+0000 7f2da659c700 1 --2- 172.21.15.149:0/3732179401 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2d8806af00 0x7f2d8806d3c0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c000fd0 tx=0x7f2d9c001690 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:12.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.042+0000 7f2da6d9d700 1 --2- 172.21.15.149:0/3732179401 >> [v2:172.21.15.149:6808/856914938,v1:172.21.15.149:6809/856914938] conn(0x7f2d88073e40 0x7f2d880762c0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:12.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.042+0000 7f2d96ffd700 1 -- 172.21.15.149:0/3732179401 <== osd.3 v2:172.21.15.149:6808/856914938 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7f2d88076990 con 0x7f2d88073e40 2023-11-08T19:30:12.061 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.057+0000 7f2dacdd1700 1 -- 172.21.15.149:0/3732179401 --> [v2:172.21.15.149:6808/856914938,v1:172.21.15.149:6809/856914938] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2da8159bb0 con 0x7f2d88073e40 2023-11-08T19:30:12.061 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.057+0000 7f2d96ffd700 1 -- 172.21.15.149:0/3732179401 <== osd.3 v2:172.21.15.149:6808/856914938 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f2da8159bb0 con 0x7f2d88073e40 2023-11-08T19:30:12.062 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2023-11-08T19:30:12.062 INFO:teuthology.orchestra.run.smithi149.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-08T19:30:12.063 INFO:teuthology.orchestra.run.smithi149.stdout:} 2023-11-08T19:30:12.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.057+0000 7f2dacdd1700 1 -- 172.21.15.149:0/3732179401 >> [v2:172.21.15.149:6808/856914938,v1:172.21.15.149:6809/856914938] conn(0x7f2d88073e40 msgr2=0x7f2d880762c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:12.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.057+0000 7f2dacdd1700 1 --2- 172.21.15.149:0/3732179401 >> [v2:172.21.15.149:6808/856914938,v1:172.21.15.149:6809/856914938] conn(0x7f2d88073e40 0x7f2d880762c0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:12.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.058+0000 7f2dacdd1700 1 -- 172.21.15.149:0/3732179401 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2d8806af00 msgr2=0x7f2d8806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:12.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.058+0000 7f2dacdd1700 1 --2- 172.21.15.149:0/3732179401 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2d8806af00 0x7f2d8806d3c0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c000fd0 tx=0x7f2d9c001690 comp rx=0 tx=0).stop 2023-11-08T19:30:12.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.058+0000 7f2dacdd1700 1 -- 172.21.15.149:0/3732179401 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2da80cbdb0 msgr2=0x7f2da80c77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:12.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.058+0000 7f2dacdd1700 1 --2- 172.21.15.149:0/3732179401 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2da80cbdb0 0x7f2da80c77a0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f2d980090b0 tx=0x7f2d98004750 comp rx=0 tx=0).stop 2023-11-08T19:30:12.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.058+0000 7f2da6d9d700 1 -- 172.21.15.149:0/3732179401 reap_dead start 2023-11-08T19:30:12.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.058+0000 7f2dacdd1700 1 -- 172.21.15.149:0/3732179401 shutdown_connections 2023-11-08T19:30:12.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.058+0000 7f2dacdd1700 1 -- 172.21.15.149:0/3732179401 >> 172.21.15.149:0/3732179401 conn(0x7f2da80ce1e0 msgr2=0x7f2da815f140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:12.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.058+0000 7f2dacdd1700 1 -- 172.21.15.149:0/3732179401 shutdown_connections 2023-11-08T19:30:12.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.058+0000 7f2dacdd1700 1 -- 172.21.15.149:0/3732179401 wait complete. 2023-11-08T19:30:12.070 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-11-08T19:30:12.192 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.191+0000 7f2d3cacf700 1 Processor -- start 2023-11-08T19:30:12.193 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.191+0000 7f2d3cacf700 1 -- start start 2023-11-08T19:30:12.196 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.192+0000 7f2d3cacf700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d3815a1a0 0x7f2d3806e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:12.196 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.192+0000 7f2d3cacf700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2d3806c2a0 0x7f2d380cdd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:12.196 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.192+0000 7f2d3cacf700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d380cb220 con 0x7f2d3806da50 2023-11-08T19:30:12.197 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.192+0000 7f2d3cacf700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d3815a580 con 0x7f2d3806c2a0 2023-11-08T19:30:12.197 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.192+0000 7f2d3cacf700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d380725a0 con 0x7f2d3815a1a0 2023-11-08T19:30:12.197 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.192+0000 7f2d36d9d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2d3806c2a0 0x7f2d380cdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:12.198 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.193+0000 7f2d36d9d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2d3806c2a0 0x7f2d380cdd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:46054/0 (socket says 172.21.15.149:46054) 2023-11-08T19:30:12.198 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.193+0000 7f2d36d9d700 1 -- 172.21.15.149:0/3576376919 learned_addr learned my addr 172.21.15.149:0/3576376919 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:30:12.198 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.193+0000 7f2d3659c700 1 --2- 172.21.15.149:0/3576376919 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d3815a1a0 0x7f2d3806e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:12.198 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.193+0000 7f2d36d9d700 1 -- 172.21.15.149:0/3576376919 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d3815a1a0 msgr2=0x7f2d3806e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:30:12.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.193+0000 7f2d36d9d700 1 --2- 172.21.15.149:0/3576376919 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d3815a1a0 0x7f2d3806e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:12.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.193+0000 7f2d36d9d700 1 -- 172.21.15.149:0/3576376919 >> v1:172.21.15.149:6789/0 conn(0x7f2d3806da50 legacy=0x7f2d3806bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:12.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.193+0000 7f2d36d9d700 1 -- 172.21.15.149:0/3576376919 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d380cb500 con 0x7f2d3806c2a0 2023-11-08T19:30:12.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.193+0000 7f2d3659c700 1 --2- 172.21.15.149:0/3576376919 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d3815a1a0 0x7f2d3806e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:30:12.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.193+0000 7f2d36d9d700 1 --2- 172.21.15.149:0/3576376919 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d3806c2a0 0x7f2d380cdd00 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f2d30009e80 tx=0x7f2d3000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a56abde97023f23 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:12.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.193+0000 7f2d3559a700 1 -- 172.21.15.149:0/3576376919 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3000b980 con 0x7f2d3806c2a0 2023-11-08T19:30:12.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.193+0000 7f2d3559a700 1 -- 172.21.15.149:0/3576376919 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d3000bae0 con 0x7f2d3806c2a0 2023-11-08T19:30:12.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.193+0000 7f2d3559a700 1 -- 172.21.15.149:0/3576376919 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3000be90 con 0x7f2d3806c2a0 2023-11-08T19:30:12.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.194+0000 7f2d3cacf700 1 -- 172.21.15.149:0/3576376919 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d3806c2a0 msgr2=0x7f2d380cdd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:12.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.194+0000 7f2d3cacf700 1 --2- 172.21.15.149:0/3576376919 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d3806c2a0 0x7f2d380cdd00 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f2d30009e80 tx=0x7f2d3000b330 comp rx=0 tx=0).stop 2023-11-08T19:30:12.202 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.194+0000 7f2d3cacf700 1 -- 172.21.15.149:0/3576376919 shutdown_connections 2023-11-08T19:30:12.202 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.194+0000 7f2d3cacf700 1 --2- 172.21.15.149:0/3576376919 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d3806c2a0 0x7f2d380cdd00 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:12.202 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.194+0000 7f2d3cacf700 1 --2- 172.21.15.149:0/3576376919 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d3815a1a0 0x7f2d3806e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:12.203 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.194+0000 7f2d3cacf700 1 -- 172.21.15.149:0/3576376919 >> 172.21.15.149:0/3576376919 conn(0x7f2d38071720 msgr2=0x7f2d38071b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:12.203 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.194+0000 7f2d3cacf700 1 -- 172.21.15.149:0/3576376919 shutdown_connections 2023-11-08T19:30:12.203 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.194+0000 7f2d3cacf700 1 -- 172.21.15.149:0/3576376919 wait complete. 2023-11-08T19:30:12.204 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.195+0000 7f2d3cacf700 1 Processor -- start 2023-11-08T19:30:12.204 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.195+0000 7f2d3cacf700 1 -- start start 2023-11-08T19:30:12.207 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.196+0000 7f2d3cacf700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2d3806c2a0 0x7f2d3815cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:12.207 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.196+0000 7f2d3cacf700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d3806da50 0x7f2d38153ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:12.207 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.196+0000 7f2d3cacf700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d3815a1a0 0x7f2d380b4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:12.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.196+0000 7f2d3cacf700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d380c9d50 con 0x7f2d3806da50 2023-11-08T19:30:12.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.196+0000 7f2d3cacf700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3814e960 con 0x7f2d3806c2a0 2023-11-08T19:30:12.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.196+0000 7f2d3cacf700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3815d320 con 0x7f2d3815a1a0 2023-11-08T19:30:12.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.196+0000 7f2d35d9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d3806da50 0x7f2d38153ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:12.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.196+0000 7f2d35d9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d3806da50 0x7f2d38153ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:46058/0 (socket says 172.21.15.149:46058) 2023-11-08T19:30:12.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.196+0000 7f2d35d9b700 1 -- 172.21.15.149:0/3763686112 learned_addr learned my addr 172.21.15.149:0/3763686112 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:30:12.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.196+0000 7f2d36d9d700 1 --2- 172.21.15.149:0/3763686112 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d3815a1a0 0x7f2d380b4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:12.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.196+0000 7f2d3659c700 1 --2- 172.21.15.149:0/3763686112 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2d3806c2a0 0x7f2d3815cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:12.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.196+0000 7f2d35d9b700 1 -- 172.21.15.149:0/3763686112 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d3815a1a0 msgr2=0x7f2d380b4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:12.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.196+0000 7f2d35d9b700 1 --2- 172.21.15.149:0/3763686112 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d3815a1a0 0x7f2d380b4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:12.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.196+0000 7f2d35d9b700 1 -- 172.21.15.149:0/3763686112 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2d3806c2a0 msgr2=0x7f2d3815cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:12.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.196+0000 7f2d35d9b700 1 --2- 172.21.15.149:0/3763686112 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2d3806c2a0 0x7f2d3815cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:12.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.196+0000 7f2d35d9b700 1 -- 172.21.15.149:0/3763686112 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d30009b30 con 0x7f2d3806da50 2023-11-08T19:30:12.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.196+0000 7f2d36d9d700 1 --2- 172.21.15.149:0/3763686112 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d3815a1a0 0x7f2d380b4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:30:12.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.196+0000 7f2d35d9b700 1 --2- 172.21.15.149:0/3763686112 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d3806da50 0x7f2d38153ec0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f2d2800c4e0 tx=0x7f2d2800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:12.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.197+0000 7f2d26ffd700 1 -- 172.21.15.149:0/3763686112 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d280052d0 con 0x7f2d3806da50 2023-11-08T19:30:12.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.197+0000 7f2d26ffd700 1 -- 172.21.15.149:0/3763686112 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d28005430 con 0x7f2d3806da50 2023-11-08T19:30:12.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.197+0000 7f2d3cacf700 1 -- 172.21.15.149:0/3763686112 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d3814dd50 con 0x7f2d3806da50 2023-11-08T19:30:12.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.197+0000 7f2d26ffd700 1 -- 172.21.15.149:0/3763686112 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d280038c0 con 0x7f2d3806da50 2023-11-08T19:30:12.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.197+0000 7f2d3cacf700 1 -- 172.21.15.149:0/3763686112 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d3814e310 con 0x7f2d3806da50 2023-11-08T19:30:12.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.198+0000 7f2d3cacf700 1 -- 172.21.15.149:0/3763686112 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d380745f0 con 0x7f2d3806da50 2023-11-08T19:30:12.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.198+0000 7f2d26ffd700 1 -- 172.21.15.149:0/3763686112 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2d28003a20 con 0x7f2d3806da50 2023-11-08T19:30:12.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.198+0000 7f2d26ffd700 1 --2- 172.21.15.149:0/3763686112 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2d1806af00 0x7f2d1806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:12.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.198+0000 7f2d26ffd700 1 -- 172.21.15.149:0/3763686112 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6999+0+0 (secure 0 0 0) 0x7f2d28088fa0 con 0x7f2d3806da50 2023-11-08T19:30:12.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.198+0000 7f2d3659c700 1 --2- 172.21.15.149:0/3763686112 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2d1806af00 0x7f2d1806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:12.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.199+0000 7f2d3659c700 1 --2- 172.21.15.149:0/3763686112 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2d1806af00 0x7f2d1806d3c0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c006fd0 tx=0x7f2d2c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:12.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.203+0000 7f2d26ffd700 1 -- 172.21.15.149:0/3763686112 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2d280bbca0 con 0x7f2d3806da50 2023-11-08T19:30:12.394 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.393+0000 7f2d3cacf700 1 -- 172.21.15.149:0/3763686112 --> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f2d380cbac0 con 0x7f2d1806af00 2023-11-08T19:30:12.395 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.393+0000 7f2d26ffd700 1 -- 172.21.15.149:0/3763686112 <== mgr.4104 v2:172.21.15.149:6832/1929837472 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2d2c00c050 con 0x7f2d1806af00 2023-11-08T19:30:12.397 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.396+0000 7f2d3cacf700 1 -- 172.21.15.149:0/3763686112 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2d1806af00 msgr2=0x7f2d1806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:12.398 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.396+0000 7f2d3cacf700 1 --2- 172.21.15.149:0/3763686112 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2d1806af00 0x7f2d1806d3c0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c006fd0 tx=0x7f2d2c008040 comp rx=0 tx=0).stop 2023-11-08T19:30:12.398 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.396+0000 7f2d3cacf700 1 -- 172.21.15.149:0/3763686112 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d3806da50 msgr2=0x7f2d38153ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:12.398 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.396+0000 7f2d3cacf700 1 --2- 172.21.15.149:0/3763686112 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d3806da50 0x7f2d38153ec0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f2d2800c4e0 tx=0x7f2d2800c8a0 comp rx=0 tx=0).stop 2023-11-08T19:30:12.398 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.396+0000 7f2d3cacf700 1 -- 172.21.15.149:0/3763686112 shutdown_connections 2023-11-08T19:30:12.399 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.396+0000 7f2d3cacf700 1 --2- 172.21.15.149:0/3763686112 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2d1806af00 0x7f2d1806d3c0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:12.399 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.396+0000 7f2d3cacf700 1 --2- 172.21.15.149:0/3763686112 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2d3806c2a0 0x7f2d3815cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:12.399 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.396+0000 7f2d3cacf700 1 --2- 172.21.15.149:0/3763686112 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d3815a1a0 0x7f2d380b4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:12.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.396+0000 7f2d3cacf700 1 --2- 172.21.15.149:0/3763686112 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d3806da50 0x7f2d38153ec0 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:12.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.396+0000 7f2d3cacf700 1 -- 172.21.15.149:0/3763686112 >> 172.21.15.149:0/3763686112 conn(0x7f2d38071720 msgr2=0x7f2d3815e460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:12.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.396+0000 7f2d3cacf700 1 -- 172.21.15.149:0/3763686112 shutdown_connections 2023-11-08T19:30:12.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.396+0000 7f2d3cacf700 1 -- 172.21.15.149:0/3763686112 wait complete. 2023-11-08T19:30:12.401 INFO:teuthology.orchestra.run.smithi149.stderr:instructed osd(s) 3 to deep-scrub 2023-11-08T19:30:12.409 INFO:tasks.ceph:Scrubbing osd.4 2023-11-08T19:30:12.410 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-11-08T19:30:12.535 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.534+0000 7f6b3e86c700 1 Processor -- start 2023-11-08T19:30:12.535 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.534+0000 7f6b3e86c700 1 -- start start 2023-11-08T19:30:12.537 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.534+0000 7f6b3e86c700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f6b3815dcd0 0x7f6b38070470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:12.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.534+0000 7f6b3e86c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6b38072cd0 0x7f6b3806ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:12.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.534+0000 7f6b3e86c700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b380700d0 con 0x7f6b3806b0c0 2023-11-08T19:30:12.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.534+0000 7f6b3e86c700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b3815e0b0 con 0x7f6b3815dcd0 2023-11-08T19:30:12.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.534+0000 7f6b3e86c700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3806b510 con 0x7f6b38072cd0 2023-11-08T19:30:12.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.535+0000 7f6b37fff700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f6b3815dcd0 0x7f6b38070470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:12.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.535+0000 7f6b377fe700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6b38072cd0 0x7f6b3806ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:12.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.535+0000 7f6b37fff700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f6b3815dcd0 0x7f6b38070470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.149:47056/0 (socket says 172.21.15.149:47056) 2023-11-08T19:30:12.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.535+0000 7f6b377fe700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6b38072cd0 0x7f6b3806ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.149:38120/0 (socket says 172.21.15.149:38120) 2023-11-08T19:30:12.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.535+0000 7f6b3ce09700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f6b3806b0c0 0x7f6b380b20e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.149:59736/0 (socket says 172.21.15.149:59736) 2023-11-08T19:30:12.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.535+0000 7f6b37fff700 1 -- 172.21.15.149:0/2155251892 learned_addr learned my addr 172.21.15.149:0/2155251892 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:30:12.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.535+0000 7f6b377fe700 1 -- 172.21.15.149:0/2155251892 >> v2:172.21.15.160:3300/0 conn(0x7f6b3815dcd0 msgr2=0x7f6b38070470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:30:12.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.535+0000 7f6b377fe700 1 --2- 172.21.15.149:0/2155251892 >> v2:172.21.15.160:3300/0 conn(0x7f6b3815dcd0 0x7f6b38070470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:12.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.535+0000 7f6b377fe700 1 -- 172.21.15.149:0/2155251892 >> v1:172.21.15.160:6789/0 conn(0x7f6b3806b0c0 legacy=0x7f6b380b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:12.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.535+0000 7f6b377fe700 1 -- 172.21.15.149:0/2155251892 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b380709b0 con 0x7f6b38072cd0 2023-11-08T19:30:12.542 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.535+0000 7f6b37fff700 1 --2- 172.21.15.149:0/2155251892 >> v2:172.21.15.160:3300/0 conn(0x7f6b3815dcd0 0x7f6b38070470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:30:12.542 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.535+0000 7f6b377fe700 1 --2- 172.21.15.149:0/2155251892 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6b38072cd0 0x7f6b3806ab80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c009840 tx=0x7f6b2c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84499bf9e81a15db server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:12.542 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.535+0000 7f6b36ffd700 1 -- 172.21.15.149:0/2155251892 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2c011830 con 0x7f6b38072cd0 2023-11-08T19:30:12.543 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.536+0000 7f6b36ffd700 1 -- 172.21.15.149:0/2155251892 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b2c011990 con 0x7f6b38072cd0 2023-11-08T19:30:12.543 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.536+0000 7f6b36ffd700 1 -- 172.21.15.149:0/2155251892 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2c011d20 con 0x7f6b38072cd0 2023-11-08T19:30:12.543 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.536+0000 7f6b3e86c700 1 -- 172.21.15.149:0/2155251892 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6b38072cd0 msgr2=0x7f6b3806ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:12.544 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.536+0000 7f6b3e86c700 1 --2- 172.21.15.149:0/2155251892 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6b38072cd0 0x7f6b3806ab80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c009840 tx=0x7f6b2c009b50 comp rx=0 tx=0).stop 2023-11-08T19:30:12.544 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.536+0000 7f6b3e86c700 1 -- 172.21.15.149:0/2155251892 shutdown_connections 2023-11-08T19:30:12.544 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.536+0000 7f6b3e86c700 1 --2- 172.21.15.149:0/2155251892 >> v2:172.21.15.160:3300/0 conn(0x7f6b3815dcd0 0x7f6b38070470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:12.545 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.536+0000 7f6b3e86c700 1 --2- 172.21.15.149:0/2155251892 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6b38072cd0 0x7f6b3806ab80 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:12.545 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.536+0000 7f6b3e86c700 1 -- 172.21.15.149:0/2155251892 >> 172.21.15.149:0/2155251892 conn(0x7f6b380cd0e0 msgr2=0x7f6b380cd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:12.545 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.536+0000 7f6b3e86c700 1 -- 172.21.15.149:0/2155251892 shutdown_connections 2023-11-08T19:30:12.545 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.536+0000 7f6b3e86c700 1 -- 172.21.15.149:0/2155251892 wait complete. 2023-11-08T19:30:12.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.538+0000 7f6b3e86c700 1 Processor -- start 2023-11-08T19:30:12.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.538+0000 7f6b3e86c700 1 -- start start 2023-11-08T19:30:12.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.539+0000 7f6b3e86c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6b3806b0c0 0x7f6b381f4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:12.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.539+0000 7f6b3e86c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b38072cd0 0x7f6b380b1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:12.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.539+0000 7f6b3e86c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6b3815dcd0 0x7f6b380c9680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:12.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.539+0000 7f6b3e86c700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b380ca000 con 0x7f6b38072cd0 2023-11-08T19:30:12.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.539+0000 7f6b3e86c700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b380c8200 con 0x7f6b3806b0c0 2023-11-08T19:30:12.551 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.539+0000 7f6b3e86c700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b381f4ff0 con 0x7f6b3815dcd0 2023-11-08T19:30:12.551 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.539+0000 7f6b377fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b38072cd0 0x7f6b380b1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:12.551 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.539+0000 7f6b377fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b38072cd0 0x7f6b380b1900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:46072/0 (socket says 172.21.15.149:46072) 2023-11-08T19:30:12.552 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.539+0000 7f6b377fe700 1 -- 172.21.15.149:0/4197163191 learned_addr learned my addr 172.21.15.149:0/4197163191 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:30:12.552 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.539+0000 7f6b3ce09700 1 --2- 172.21.15.149:0/4197163191 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6b3815dcd0 0x7f6b380c9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:12.552 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.539+0000 7f6b37fff700 1 --2- 172.21.15.149:0/4197163191 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6b3806b0c0 0x7f6b381f4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:12.552 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.539+0000 7f6b377fe700 1 -- 172.21.15.149:0/4197163191 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6b3815dcd0 msgr2=0x7f6b380c9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:12.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.539+0000 7f6b377fe700 1 --2- 172.21.15.149:0/4197163191 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6b3815dcd0 0x7f6b380c9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:12.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.539+0000 7f6b377fe700 1 -- 172.21.15.149:0/4197163191 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6b3806b0c0 msgr2=0x7f6b381f4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:12.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.539+0000 7f6b377fe700 1 --2- 172.21.15.149:0/4197163191 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6b3806b0c0 0x7f6b381f4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:12.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.539+0000 7f6b377fe700 1 -- 172.21.15.149:0/4197163191 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b28009550 con 0x7f6b38072cd0 2023-11-08T19:30:12.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.539+0000 7f6b377fe700 1 --2- 172.21.15.149:0/4197163191 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b38072cd0 0x7f6b380b1900 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c009fd0 tx=0x7f6b2c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:12.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.540+0000 7f6b34ff9700 1 -- 172.21.15.149:0/4197163191 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2c0036a0 con 0x7f6b38072cd0 2023-11-08T19:30:12.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.540+0000 7f6b34ff9700 1 -- 172.21.15.149:0/4197163191 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b2c01f070 con 0x7f6b38072cd0 2023-11-08T19:30:12.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.540+0000 7f6b3e86c700 1 -- 172.21.15.149:0/4197163191 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b2c0094a0 con 0x7f6b38072cd0 2023-11-08T19:30:12.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.540+0000 7f6b34ff9700 1 -- 172.21.15.149:0/4197163191 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2c003a60 con 0x7f6b38072cd0 2023-11-08T19:30:12.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.540+0000 7f6b3e86c700 1 -- 172.21.15.149:0/4197163191 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b380c7bb0 con 0x7f6b38072cd0 2023-11-08T19:30:12.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.541+0000 7f6b3e86c700 1 -- 172.21.15.149:0/4197163191 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6b380721f0 con 0x7f6b38072cd0 2023-11-08T19:30:12.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.541+0000 7f6b34ff9700 1 -- 172.21.15.149:0/4197163191 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6b2c003bc0 con 0x7f6b38072cd0 2023-11-08T19:30:12.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.541+0000 7f6b34ff9700 1 --2- 172.21.15.149:0/4197163191 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6b2406af00 0x7f6b2406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:12.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.541+0000 7f6b34ff9700 1 -- 172.21.15.149:0/4197163191 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6999+0+0 (secure 0 0 0) 0x7f6b2c021070 con 0x7f6b38072cd0 2023-11-08T19:30:12.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.541+0000 7f6b37fff700 1 --2- 172.21.15.149:0/4197163191 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6b2406af00 0x7f6b2406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:12.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.542+0000 7f6b34ff9700 1 --2- 172.21.15.149:0/4197163191 >> [v2:172.21.15.160:6824/2064905524,v1:172.21.15.160:6825/2064905524] conn(0x7f6b24073e40 0x7f6b240762c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:12.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.542+0000 7f6b34ff9700 1 -- 172.21.15.149:0/4197163191 --> [v2:172.21.15.160:6824/2064905524,v1:172.21.15.160:6825/2064905524] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6b24076990 con 0x7f6b24073e40 2023-11-08T19:30:12.558 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.542+0000 7f6b34ff9700 1 -- 172.21.15.149:0/4197163191 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_get_version_reply(handle=1 version=111) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6b2c08d7d0 con 0x7f6b38072cd0 2023-11-08T19:30:12.558 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.542+0000 7f6b3ce09700 1 --2- 172.21.15.149:0/4197163191 >> [v2:172.21.15.160:6824/2064905524,v1:172.21.15.160:6825/2064905524] conn(0x7f6b24073e40 0x7f6b240762c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:12.558 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.542+0000 7f6b37fff700 1 --2- 172.21.15.149:0/4197163191 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6b2406af00 0x7f6b2406d3c0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f6b28006d30 tx=0x7f6b280092c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:12.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.542+0000 7f6b3ce09700 1 --2- 172.21.15.149:0/4197163191 >> [v2:172.21.15.160:6824/2064905524,v1:172.21.15.160:6825/2064905524] conn(0x7f6b24073e40 0x7f6b240762c0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:12.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.543+0000 7f6b34ff9700 1 -- 172.21.15.149:0/4197163191 <== osd.4 v2:172.21.15.160:6824/2064905524 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7f6b24076990 con 0x7f6b24073e40 2023-11-08T19:30:12.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.557+0000 7f6b3e86c700 1 -- 172.21.15.149:0/4197163191 --> [v2:172.21.15.160:6824/2064905524,v1:172.21.15.160:6825/2064905524] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6b3806fdf0 con 0x7f6b24073e40 2023-11-08T19:30:12.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.558+0000 7f6b34ff9700 1 -- 172.21.15.149:0/4197163191 <== osd.4 v2:172.21.15.160:6824/2064905524 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f6b30007240 con 0x7f6b24073e40 2023-11-08T19:30:12.560 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2023-11-08T19:30:12.561 INFO:teuthology.orchestra.run.smithi149.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-08T19:30:12.561 INFO:teuthology.orchestra.run.smithi149.stdout:} 2023-11-08T19:30:12.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.558+0000 7f6b3e86c700 1 -- 172.21.15.149:0/4197163191 >> [v2:172.21.15.160:6824/2064905524,v1:172.21.15.160:6825/2064905524] conn(0x7f6b24073e40 msgr2=0x7f6b240762c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:12.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.558+0000 7f6b3e86c700 1 --2- 172.21.15.149:0/4197163191 >> [v2:172.21.15.160:6824/2064905524,v1:172.21.15.160:6825/2064905524] conn(0x7f6b24073e40 0x7f6b240762c0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:12.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.558+0000 7f6b3e86c700 1 -- 172.21.15.149:0/4197163191 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6b2406af00 msgr2=0x7f6b2406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:12.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.558+0000 7f6b3e86c700 1 --2- 172.21.15.149:0/4197163191 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6b2406af00 0x7f6b2406d3c0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f6b28006d30 tx=0x7f6b280092c0 comp rx=0 tx=0).stop 2023-11-08T19:30:12.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.558+0000 7f6b3e86c700 1 -- 172.21.15.149:0/4197163191 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b38072cd0 msgr2=0x7f6b380b1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:12.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.558+0000 7f6b3e86c700 1 --2- 172.21.15.149:0/4197163191 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b38072cd0 0x7f6b380b1900 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c009fd0 tx=0x7f6b2c004750 comp rx=0 tx=0).stop 2023-11-08T19:30:12.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.558+0000 7f6b3ce09700 1 -- 172.21.15.149:0/4197163191 reap_dead start 2023-11-08T19:30:12.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.558+0000 7f6b3e86c700 1 -- 172.21.15.149:0/4197163191 shutdown_connections 2023-11-08T19:30:12.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.558+0000 7f6b3e86c700 1 -- 172.21.15.149:0/4197163191 >> 172.21.15.149:0/4197163191 conn(0x7f6b380cd0e0 msgr2=0x7f6b381616c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:12.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.558+0000 7f6b3e86c700 1 -- 172.21.15.149:0/4197163191 shutdown_connections 2023-11-08T19:30:12.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.558+0000 7f6b3e86c700 1 -- 172.21.15.149:0/4197163191 wait complete. 2023-11-08T19:30:12.571 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-11-08T19:30:12.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.691+0000 7f3720eb5700 1 Processor -- start 2023-11-08T19:30:12.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.691+0000 7f3720eb5700 1 -- start start 2023-11-08T19:30:12.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.692+0000 7f3720eb5700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f371c1624c0 0x7f371c06bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:12.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.692+0000 7f3720eb5700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f371c0cedf0 0x7f371c06c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:12.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.692+0000 7f3720eb5700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f371c06e2a0 con 0x7f371c066c80 2023-11-08T19:30:12.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.692+0000 7f3720eb5700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f371c0cc5c0 con 0x7f371c0cedf0 2023-11-08T19:30:12.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.692+0000 7f3720eb5700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f371c06d970 con 0x7f371c1624c0 2023-11-08T19:30:12.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.692+0000 7f371ad9d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f371c0cedf0 0x7f371c06c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:12.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.692+0000 7f371ad9d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f371c0cedf0 0x7f371c06c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:46084/0 (socket says 172.21.15.149:46084) 2023-11-08T19:30:12.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.692+0000 7f371ad9d700 1 -- 172.21.15.149:0/4200019117 learned_addr learned my addr 172.21.15.149:0/4200019117 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:30:12.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.693+0000 7f371a59c700 1 --2- 172.21.15.149:0/4200019117 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f371c1624c0 0x7f371c06bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:12.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.693+0000 7f371ad9d700 1 -- 172.21.15.149:0/4200019117 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f371c1624c0 msgr2=0x7f371c06bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:30:12.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.693+0000 7f371ad9d700 1 --2- 172.21.15.149:0/4200019117 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f371c1624c0 0x7f371c06bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:12.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.693+0000 7f371ad9d700 1 -- 172.21.15.149:0/4200019117 >> v1:172.21.15.160:6789/0 conn(0x7f371c066c80 legacy=0x7f371c0ca630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:30:12.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.693+0000 7f371ad9d700 1 -- 172.21.15.149:0/4200019117 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f371c06dc50 con 0x7f371c0cedf0 2023-11-08T19:30:12.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.693+0000 7f371ad9d700 1 --2- 172.21.15.149:0/4200019117 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f371c0cedf0 0x7f371c06c0d0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f3714009e50 tx=0x7f371400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b62e57d2605fcef server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:12.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.693+0000 7f371959a700 1 -- 172.21.15.149:0/4200019117 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371400e070 con 0x7f371c0cedf0 2023-11-08T19:30:12.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.693+0000 7f371959a700 1 -- 172.21.15.149:0/4200019117 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3714003a20 con 0x7f371c0cedf0 2023-11-08T19:30:12.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.693+0000 7f371959a700 1 -- 172.21.15.149:0/4200019117 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3714003dd0 con 0x7f371c0cedf0 2023-11-08T19:30:12.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.694+0000 7f3720eb5700 1 -- 172.21.15.149:0/4200019117 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f371c0cedf0 msgr2=0x7f371c06c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:12.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.694+0000 7f3720eb5700 1 --2- 172.21.15.149:0/4200019117 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f371c0cedf0 0x7f371c06c0d0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f3714009e50 tx=0x7f371400b330 comp rx=0 tx=0).stop 2023-11-08T19:30:12.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.694+0000 7f3720eb5700 1 -- 172.21.15.149:0/4200019117 shutdown_connections 2023-11-08T19:30:12.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.694+0000 7f3720eb5700 1 --2- 172.21.15.149:0/4200019117 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f371c0cedf0 0x7f371c06c0d0 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:12.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.694+0000 7f3720eb5700 1 --2- 172.21.15.149:0/4200019117 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f371c1624c0 0x7f371c06bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:12.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.694+0000 7f3720eb5700 1 -- 172.21.15.149:0/4200019117 >> 172.21.15.149:0/4200019117 conn(0x7f371c071720 msgr2=0x7f371c071b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:12.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.694+0000 7f3720eb5700 1 -- 172.21.15.149:0/4200019117 shutdown_connections 2023-11-08T19:30:12.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.694+0000 7f3720eb5700 1 -- 172.21.15.149:0/4200019117 wait complete. 2023-11-08T19:30:12.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.695+0000 7f3720eb5700 1 Processor -- start 2023-11-08T19:30:12.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.695+0000 7f3720eb5700 1 -- start start 2023-11-08T19:30:12.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.696+0000 7f3720eb5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f371c066c80 0x7f371c0b56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:12.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.696+0000 7f3720eb5700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f371c0cedf0 0x7f371c0b2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:12.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.696+0000 7f3720eb5700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f371c1624c0 0x7f371c06b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:12.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.696+0000 7f3720eb5700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f371c1f3ca0 con 0x7f371c066c80 2023-11-08T19:30:12.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.696+0000 7f3720eb5700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f371c1f3f80 con 0x7f371c1624c0 2023-11-08T19:30:12.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.696+0000 7f3720eb5700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f371c1f4260 con 0x7f371c0cedf0 2023-11-08T19:30:12.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.696+0000 7f371a59c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f371c066c80 0x7f371c0b56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:12.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.696+0000 7f371a59c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f371c066c80 0x7f371c0b56e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:46088/0 (socket says 172.21.15.149:46088) 2023-11-08T19:30:12.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.696+0000 7f371a59c700 1 -- 172.21.15.149:0/2819683988 learned_addr learned my addr 172.21.15.149:0/2819683988 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:30:12.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.696+0000 7f371ad9d700 1 --2- 172.21.15.149:0/2819683988 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f371c1624c0 0x7f371c06b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:12.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.696+0000 7f3719d9b700 1 --2- 172.21.15.149:0/2819683988 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f371c0cedf0 0x7f371c0b2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:12.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.696+0000 7f371a59c700 1 -- 172.21.15.149:0/2819683988 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f371c0cedf0 msgr2=0x7f371c0b2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:12.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.696+0000 7f371a59c700 1 --2- 172.21.15.149:0/2819683988 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f371c0cedf0 0x7f371c0b2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:12.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.696+0000 7f371a59c700 1 -- 172.21.15.149:0/2819683988 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f371c1624c0 msgr2=0x7f371c06b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:12.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.696+0000 7f371a59c700 1 --2- 172.21.15.149:0/2819683988 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f371c1624c0 0x7f371c06b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:12.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.696+0000 7f371a59c700 1 -- 172.21.15.149:0/2819683988 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3714009b30 con 0x7f371c066c80 2023-11-08T19:30:12.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.696+0000 7f3719d9b700 1 --2- 172.21.15.149:0/2819683988 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f371c0cedf0 0x7f371c0b2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:30:12.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.696+0000 7f371a59c700 1 --2- 172.21.15.149:0/2819683988 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f371c066c80 0x7f371c0b56e0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f370c00c7f0 tx=0x7f370c00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:12.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.696+0000 7f3712ffd700 1 -- 172.21.15.149:0/2819683988 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370c011800 con 0x7f371c066c80 2023-11-08T19:30:12.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.696+0000 7f3712ffd700 1 -- 172.21.15.149:0/2819683988 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f370c011960 con 0x7f371c066c80 2023-11-08T19:30:12.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.696+0000 7f3720eb5700 1 -- 172.21.15.149:0/2819683988 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f371c1f4540 con 0x7f371c066c80 2023-11-08T19:30:12.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.697+0000 7f3712ffd700 1 -- 172.21.15.149:0/2819683988 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370c011cf0 con 0x7f371c066c80 2023-11-08T19:30:12.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.697+0000 7f3720eb5700 1 -- 172.21.15.149:0/2819683988 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f371c1f37a0 con 0x7f371c066c80 2023-11-08T19:30:12.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.697+0000 7f3720eb5700 1 -- 172.21.15.149:0/2819683988 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f371c1f3a20 con 0x7f371c066c80 2023-11-08T19:30:12.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.698+0000 7f3712ffd700 1 -- 172.21.15.149:0/2819683988 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f370c018360 con 0x7f371c066c80 2023-11-08T19:30:12.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.698+0000 7f3712ffd700 1 --2- 172.21.15.149:0/2819683988 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f36fc06af00 0x7f36fc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:12.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.698+0000 7f3712ffd700 1 -- 172.21.15.149:0/2819683988 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6999+0+0 (secure 0 0 0) 0x7f370c089a00 con 0x7f371c066c80 2023-11-08T19:30:12.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.698+0000 7f3719d9b700 1 --2- 172.21.15.149:0/2819683988 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f36fc06af00 0x7f36fc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:12.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.699+0000 7f3719d9b700 1 --2- 172.21.15.149:0/2819683988 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f36fc06af00 0x7f36fc06d3c0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f371c0b32a0 tx=0x7f3704009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:12.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.703+0000 7f3712ffd700 1 -- 172.21.15.149:0/2819683988 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f370c0545a0 con 0x7f371c066c80 2023-11-08T19:30:12.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.893+0000 7f3720eb5700 1 -- 172.21.15.149:0/2819683988 --> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f371c0b4eb0 con 0x7f36fc06af00 2023-11-08T19:30:12.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.894+0000 7f3712ffd700 1 -- 172.21.15.149:0/2819683988 <== mgr.4104 v2:172.21.15.149:6832/1929837472 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f371c0b4eb0 con 0x7f36fc06af00 2023-11-08T19:30:12.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.896+0000 7f3720eb5700 1 -- 172.21.15.149:0/2819683988 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f36fc06af00 msgr2=0x7f36fc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:12.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.896+0000 7f3720eb5700 1 --2- 172.21.15.149:0/2819683988 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f36fc06af00 0x7f36fc06d3c0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f371c0b32a0 tx=0x7f3704009040 comp rx=0 tx=0).stop 2023-11-08T19:30:12.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.896+0000 7f3720eb5700 1 -- 172.21.15.149:0/2819683988 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f371c066c80 msgr2=0x7f371c0b56e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:12.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.896+0000 7f3720eb5700 1 --2- 172.21.15.149:0/2819683988 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f371c066c80 0x7f371c0b56e0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f370c00c7f0 tx=0x7f370c00cbb0 comp rx=0 tx=0).stop 2023-11-08T19:30:12.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.896+0000 7f3720eb5700 1 -- 172.21.15.149:0/2819683988 shutdown_connections 2023-11-08T19:30:12.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.896+0000 7f3720eb5700 1 --2- 172.21.15.149:0/2819683988 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f36fc06af00 0x7f36fc06d3c0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:12.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.896+0000 7f3720eb5700 1 --2- 172.21.15.149:0/2819683988 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f371c1624c0 0x7f371c06b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:12.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.896+0000 7f3720eb5700 1 --2- 172.21.15.149:0/2819683988 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f371c066c80 0x7f371c0b56e0 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:12.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.896+0000 7f3720eb5700 1 --2- 172.21.15.149:0/2819683988 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f371c0cedf0 0x7f371c0b2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:12.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.896+0000 7f3720eb5700 1 -- 172.21.15.149:0/2819683988 >> 172.21.15.149:0/2819683988 conn(0x7f371c071720 msgr2=0x7f371c0ca5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:12.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.896+0000 7f3720eb5700 1 -- 172.21.15.149:0/2819683988 shutdown_connections 2023-11-08T19:30:12.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:12.896+0000 7f3720eb5700 1 -- 172.21.15.149:0/2819683988 wait complete. 2023-11-08T19:30:12.901 INFO:teuthology.orchestra.run.smithi149.stderr:instructed osd(s) 4 to deep-scrub 2023-11-08T19:30:12.909 INFO:tasks.ceph:Scrubbing osd.5 2023-11-08T19:30:12.909 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-11-08T19:30:13.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.034+0000 7f6d336f7700 1 Processor -- start 2023-11-08T19:30:13.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.034+0000 7f6d336f7700 1 -- start start 2023-11-08T19:30:13.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.035+0000 7f6d336f7700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f6d2c072cd0 0x7f6d2c06ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:13.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.035+0000 7f6d336f7700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6d2c06b0c0 0x7f6d2c161730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:13.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.035+0000 7f6d336f7700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d2c0700d0 con 0x7f6d2c15dcd0 2023-11-08T19:30:13.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.035+0000 7f6d336f7700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d2c15e0b0 con 0x7f6d2c072cd0 2023-11-08T19:30:13.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.035+0000 7f6d336f7700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2c06b510 con 0x7f6d2c06b0c0 2023-11-08T19:30:13.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.035+0000 7f6d31c94700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6d2c06b0c0 0x7f6d2c161730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:13.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.035+0000 7f6d30c92700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f6d2c072cd0 0x7f6d2c06ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:13.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.035+0000 7f6d31c94700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6d2c06b0c0 0x7f6d2c161730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.149:38154/0 (socket says 172.21.15.149:38154) 2023-11-08T19:30:13.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.035+0000 7f6d30c92700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f6d2c072cd0 0x7f6d2c06ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.149:47088/0 (socket says 172.21.15.149:47088) 2023-11-08T19:30:13.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.035+0000 7f6d31493700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f6d2c15dcd0 0x7f6d2c070470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.149:59762/0 (socket says 172.21.15.149:59762) 2023-11-08T19:30:13.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.035+0000 7f6d31c94700 1 -- 172.21.15.149:0/3936628162 learned_addr learned my addr 172.21.15.149:0/3936628162 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:30:13.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.036+0000 7f6d31c94700 1 -- 172.21.15.149:0/3936628162 >> v2:172.21.15.160:3300/0 conn(0x7f6d2c072cd0 msgr2=0x7f6d2c06ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:30:13.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.036+0000 7f6d31c94700 1 --2- 172.21.15.149:0/3936628162 >> v2:172.21.15.160:3300/0 conn(0x7f6d2c072cd0 0x7f6d2c06ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:13.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.036+0000 7f6d31c94700 1 -- 172.21.15.149:0/3936628162 >> v1:172.21.15.160:6789/0 conn(0x7f6d2c15dcd0 legacy=0x7f6d2c070470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:13.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.036+0000 7f6d31c94700 1 -- 172.21.15.149:0/3936628162 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d2c06fdf0 con 0x7f6d2c06b0c0 2023-11-08T19:30:13.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.036+0000 7f6d31c94700 1 --2- 172.21.15.149:0/3936628162 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6d2c06b0c0 0x7f6d2c161730 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6d24009e50 tx=0x7f6d2400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6ae27590c7d4703 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:13.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.036+0000 7f6d23fff700 1 -- 172.21.15.149:0/3936628162 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2400e070 con 0x7f6d2c06b0c0 2023-11-08T19:30:13.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.036+0000 7f6d23fff700 1 -- 172.21.15.149:0/3936628162 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d2400b910 con 0x7f6d2c06b0c0 2023-11-08T19:30:13.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.036+0000 7f6d23fff700 1 -- 172.21.15.149:0/3936628162 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2400bcc0 con 0x7f6d2c06b0c0 2023-11-08T19:30:13.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.036+0000 7f6d336f7700 1 -- 172.21.15.149:0/3936628162 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6d2c06b0c0 msgr2=0x7f6d2c161730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:13.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.036+0000 7f6d336f7700 1 --2- 172.21.15.149:0/3936628162 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6d2c06b0c0 0x7f6d2c161730 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6d24009e50 tx=0x7f6d2400b330 comp rx=0 tx=0).stop 2023-11-08T19:30:13.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.036+0000 7f6d336f7700 1 -- 172.21.15.149:0/3936628162 shutdown_connections 2023-11-08T19:30:13.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.036+0000 7f6d336f7700 1 --2- 172.21.15.149:0/3936628162 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6d2c06b0c0 0x7f6d2c161730 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:13.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.036+0000 7f6d336f7700 1 --2- 172.21.15.149:0/3936628162 >> v2:172.21.15.160:3300/0 conn(0x7f6d2c072cd0 0x7f6d2c06ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:13.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.036+0000 7f6d336f7700 1 -- 172.21.15.149:0/3936628162 >> 172.21.15.149:0/3936628162 conn(0x7f6d2c0cd0e0 msgr2=0x7f6d2c0cd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:13.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.037+0000 7f6d336f7700 1 -- 172.21.15.149:0/3936628162 shutdown_connections 2023-11-08T19:30:13.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.037+0000 7f6d336f7700 1 -- 172.21.15.149:0/3936628162 wait complete. 2023-11-08T19:30:13.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.038+0000 7f6d336f7700 1 Processor -- start 2023-11-08T19:30:13.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.038+0000 7f6d336f7700 1 -- start start 2023-11-08T19:30:13.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.038+0000 7f6d336f7700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6d2c06b0c0 0x7f6d2c0b2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:13.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.038+0000 7f6d336f7700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d2c072cd0 0x7f6d2c0ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:13.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.038+0000 7f6d336f7700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6d2c15dcd0 0x7f6d2c151490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:13.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.038+0000 7f6d336f7700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2c0b13d0 con 0x7f6d2c072cd0 2023-11-08T19:30:13.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.038+0000 7f6d336f7700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2c0b2e10 con 0x7f6d2c15dcd0 2023-11-08T19:30:13.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.038+0000 7f6d336f7700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2c0b0e10 con 0x7f6d2c06b0c0 2023-11-08T19:30:13.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.039+0000 7f6d30c92700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d2c072cd0 0x7f6d2c0ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:13.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.039+0000 7f6d30c92700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d2c072cd0 0x7f6d2c0ac8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:46102/0 (socket says 172.21.15.149:46102) 2023-11-08T19:30:13.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.039+0000 7f6d30c92700 1 -- 172.21.15.149:0/1561748343 learned_addr learned my addr 172.21.15.149:0/1561748343 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:30:13.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.039+0000 7f6d31c94700 1 --2- 172.21.15.149:0/1561748343 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6d2c15dcd0 0x7f6d2c151490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:13.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.039+0000 7f6d31493700 1 --2- 172.21.15.149:0/1561748343 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6d2c06b0c0 0x7f6d2c0b2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:13.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.039+0000 7f6d30c92700 1 -- 172.21.15.149:0/1561748343 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6d2c06b0c0 msgr2=0x7f6d2c0b2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:13.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.039+0000 7f6d30c92700 1 --2- 172.21.15.149:0/1561748343 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6d2c06b0c0 0x7f6d2c0b2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:13.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.039+0000 7f6d30c92700 1 -- 172.21.15.149:0/1561748343 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6d2c15dcd0 msgr2=0x7f6d2c151490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:13.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.039+0000 7f6d30c92700 1 --2- 172.21.15.149:0/1561748343 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6d2c15dcd0 0x7f6d2c151490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:13.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.039+0000 7f6d30c92700 1 -- 172.21.15.149:0/1561748343 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d24009b30 con 0x7f6d2c072cd0 2023-11-08T19:30:13.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.039+0000 7f6d31c94700 1 --2- 172.21.15.149:0/1561748343 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6d2c15dcd0 0x7f6d2c151490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T19:30:13.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.039+0000 7f6d30c92700 1 --2- 172.21.15.149:0/1561748343 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d2c072cd0 0x7f6d2c0ac8c0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c00e9b0 tx=0x7f6d1c00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:13.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.039+0000 7f6d21ffb700 1 -- 172.21.15.149:0/1561748343 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c009710 con 0x7f6d2c072cd0 2023-11-08T19:30:13.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.039+0000 7f6d21ffb700 1 -- 172.21.15.149:0/1561748343 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d1c00ee50 con 0x7f6d2c072cd0 2023-11-08T19:30:13.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.039+0000 7f6d336f7700 1 -- 172.21.15.149:0/1561748343 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d2c0b10f0 con 0x7f6d2c072cd0 2023-11-08T19:30:13.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.039+0000 7f6d21ffb700 1 -- 172.21.15.149:0/1561748343 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c00ca50 con 0x7f6d2c072cd0 2023-11-08T19:30:13.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.039+0000 7f6d336f7700 1 -- 172.21.15.149:0/1561748343 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d2c1519d0 con 0x7f6d2c072cd0 2023-11-08T19:30:13.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.040+0000 7f6d336f7700 1 -- 172.21.15.149:0/1561748343 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6d2c0724d0 con 0x7f6d2c072cd0 2023-11-08T19:30:13.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.041+0000 7f6d21ffb700 1 -- 172.21.15.149:0/1561748343 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6d1c00cbb0 con 0x7f6d2c072cd0 2023-11-08T19:30:13.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.041+0000 7f6d21ffb700 1 --2- 172.21.15.149:0/1561748343 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6d1006af00 0x7f6d1006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:13.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.041+0000 7f6d21ffb700 1 -- 172.21.15.149:0/1561748343 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6999+0+0 (secure 0 0 0) 0x7f6d1c089e00 con 0x7f6d2c072cd0 2023-11-08T19:30:13.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.041+0000 7f6d31493700 1 --2- 172.21.15.149:0/1561748343 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6d1006af00 0x7f6d1006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:13.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.042+0000 7f6d21ffb700 1 --2- 172.21.15.149:0/1561748343 >> [v2:172.21.15.160:6800/3633365507,v1:172.21.15.160:6802/3633365507] conn(0x7f6d10073e40 0x7f6d100762c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:13.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.042+0000 7f6d21ffb700 1 -- 172.21.15.149:0/1561748343 --> [v2:172.21.15.160:6800/3633365507,v1:172.21.15.160:6802/3633365507] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6d10076990 con 0x7f6d10073e40 2023-11-08T19:30:13.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.042+0000 7f6d21ffb700 1 -- 172.21.15.149:0/1561748343 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_get_version_reply(handle=1 version=111) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6d1c08a250 con 0x7f6d2c072cd0 2023-11-08T19:30:13.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.042+0000 7f6d31c94700 1 --2- 172.21.15.149:0/1561748343 >> [v2:172.21.15.160:6800/3633365507,v1:172.21.15.160:6802/3633365507] conn(0x7f6d10073e40 0x7f6d100762c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:13.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.042+0000 7f6d31493700 1 --2- 172.21.15.149:0/1561748343 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6d1006af00 0x7f6d1006d3c0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f6d28000f60 tx=0x7f6d28007ed0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:13.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.042+0000 7f6d31c94700 1 --2- 172.21.15.149:0/1561748343 >> [v2:172.21.15.160:6800/3633365507,v1:172.21.15.160:6802/3633365507] conn(0x7f6d10073e40 0x7f6d100762c0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:13.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.043+0000 7f6d21ffb700 1 -- 172.21.15.149:0/1561748343 <== osd.5 v2:172.21.15.160:6800/3633365507 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7f6d10076990 con 0x7f6d10073e40 2023-11-08T19:30:13.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.058+0000 7f6d336f7700 1 -- 172.21.15.149:0/1561748343 --> [v2:172.21.15.160:6800/3633365507,v1:172.21.15.160:6802/3633365507] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6d2c0721f0 con 0x7f6d10073e40 2023-11-08T19:30:13.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.058+0000 7f6d21ffb700 1 -- 172.21.15.149:0/1561748343 <== osd.5 v2:172.21.15.160:6800/3633365507 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f6d2400ba80 con 0x7f6d10073e40 2023-11-08T19:30:13.060 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2023-11-08T19:30:13.061 INFO:teuthology.orchestra.run.smithi149.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-08T19:30:13.061 INFO:teuthology.orchestra.run.smithi149.stdout:} 2023-11-08T19:30:13.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.058+0000 7f6d336f7700 1 -- 172.21.15.149:0/1561748343 >> [v2:172.21.15.160:6800/3633365507,v1:172.21.15.160:6802/3633365507] conn(0x7f6d10073e40 msgr2=0x7f6d100762c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:13.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.058+0000 7f6d336f7700 1 --2- 172.21.15.149:0/1561748343 >> [v2:172.21.15.160:6800/3633365507,v1:172.21.15.160:6802/3633365507] conn(0x7f6d10073e40 0x7f6d100762c0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:13.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.059+0000 7f6d336f7700 1 -- 172.21.15.149:0/1561748343 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6d1006af00 msgr2=0x7f6d1006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:13.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.059+0000 7f6d336f7700 1 --2- 172.21.15.149:0/1561748343 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f6d1006af00 0x7f6d1006d3c0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f6d28000f60 tx=0x7f6d28007ed0 comp rx=0 tx=0).stop 2023-11-08T19:30:13.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.059+0000 7f6d336f7700 1 -- 172.21.15.149:0/1561748343 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d2c072cd0 msgr2=0x7f6d2c0ac8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:13.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.059+0000 7f6d336f7700 1 --2- 172.21.15.149:0/1561748343 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d2c072cd0 0x7f6d2c0ac8c0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c00e9b0 tx=0x7f6d1c00ecc0 comp rx=0 tx=0).stop 2023-11-08T19:30:13.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.059+0000 7f6d31c94700 1 -- 172.21.15.149:0/1561748343 reap_dead start 2023-11-08T19:30:13.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.059+0000 7f6d336f7700 1 -- 172.21.15.149:0/1561748343 shutdown_connections 2023-11-08T19:30:13.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.059+0000 7f6d336f7700 1 -- 172.21.15.149:0/1561748343 >> 172.21.15.149:0/1561748343 conn(0x7f6d2c0cd0e0 msgr2=0x7f6d2c15fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:13.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.059+0000 7f6d336f7700 1 -- 172.21.15.149:0/1561748343 shutdown_connections 2023-11-08T19:30:13.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.059+0000 7f6d336f7700 1 -- 172.21.15.149:0/1561748343 wait complete. 2023-11-08T19:30:13.071 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-11-08T19:30:13.193 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.192+0000 7f3776866700 1 Processor -- start 2023-11-08T19:30:13.194 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.192+0000 7f3776866700 1 -- start start 2023-11-08T19:30:13.196 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.193+0000 7f3776866700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f37700cc140 0x7f37700cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:13.196 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.193+0000 7f3776866700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f37700b2850 0x7f37700cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:13.197 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.193+0000 7f3776866700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37700cce50 con 0x7f37700b2cd0 2023-11-08T19:30:13.197 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.193+0000 7f3776866700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37700b2430 con 0x7f37700cc140 2023-11-08T19:30:13.197 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.193+0000 7f3776866700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37700cc520 con 0x7f37700b2850 2023-11-08T19:30:13.198 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.193+0000 7f376ffff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f37700cc140 0x7f37700cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:13.198 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.193+0000 7f376ffff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f37700cc140 0x7f37700cc910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:46110/0 (socket says 172.21.15.149:46110) 2023-11-08T19:30:13.198 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.193+0000 7f376ffff700 1 -- 172.21.15.149:0/3677701121 learned_addr learned my addr 172.21.15.149:0/3677701121 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:30:13.198 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.194+0000 7f376f7fe700 1 --2- 172.21.15.149:0/3677701121 >> v2:172.21.15.160:3300/0 conn(0x7f37700b2850 0x7f37700cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:13.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.194+0000 7f376ffff700 1 -- 172.21.15.149:0/3677701121 >> v2:172.21.15.160:3300/0 conn(0x7f37700b2850 msgr2=0x7f37700cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:30:13.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.194+0000 7f376ffff700 1 --2- 172.21.15.149:0/3677701121 >> v2:172.21.15.160:3300/0 conn(0x7f37700b2850 0x7f37700cabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:13.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.194+0000 7f376ffff700 1 -- 172.21.15.149:0/3677701121 >> v1:172.21.15.149:6789/0 conn(0x7f37700b2cd0 legacy=0x7f377015d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:13.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.194+0000 7f376ffff700 1 -- 172.21.15.149:0/3677701121 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37700b17b0 con 0x7f37700cc140 2023-11-08T19:30:13.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.194+0000 7f376ffff700 1 --2- 172.21.15.149:0/3677701121 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f37700cc140 0x7f37700cc910 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f37700b1330 tx=0x7f3764009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7924da28e07f5ac server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:13.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.194+0000 7f376effd700 1 -- 172.21.15.149:0/3677701121 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3764005e30 con 0x7f37700cc140 2023-11-08T19:30:13.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.194+0000 7f376effd700 1 -- 172.21.15.149:0/3677701121 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3764004030 con 0x7f37700cc140 2023-11-08T19:30:13.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.194+0000 7f376effd700 1 -- 172.21.15.149:0/3677701121 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37640043c0 con 0x7f37700cc140 2023-11-08T19:30:13.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.195+0000 7f3776866700 1 -- 172.21.15.149:0/3677701121 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f37700cc140 msgr2=0x7f37700cc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:13.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.195+0000 7f3776866700 1 --2- 172.21.15.149:0/3677701121 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f37700cc140 0x7f37700cc910 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f37700b1330 tx=0x7f3764009bd0 comp rx=0 tx=0).stop 2023-11-08T19:30:13.202 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.195+0000 7f3776866700 1 -- 172.21.15.149:0/3677701121 shutdown_connections 2023-11-08T19:30:13.202 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.195+0000 7f3776866700 1 --2- 172.21.15.149:0/3677701121 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f37700cc140 0x7f37700cc910 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:13.202 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.195+0000 7f3776866700 1 --2- 172.21.15.149:0/3677701121 >> v2:172.21.15.160:3300/0 conn(0x7f37700b2850 0x7f37700cabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:13.203 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.195+0000 7f3776866700 1 -- 172.21.15.149:0/3677701121 >> 172.21.15.149:0/3677701121 conn(0x7f3770099a40 msgr2=0x7f37700d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:13.203 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.195+0000 7f3776866700 1 -- 172.21.15.149:0/3677701121 shutdown_connections 2023-11-08T19:30:13.204 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.195+0000 7f3776866700 1 -- 172.21.15.149:0/3677701121 wait complete. 2023-11-08T19:30:13.206 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.196+0000 7f3776866700 1 Processor -- start 2023-11-08T19:30:13.207 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.196+0000 7f3776866700 1 -- start start 2023-11-08T19:30:13.207 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.197+0000 7f3776866700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f37700b2850 0x7f377014ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:13.207 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.197+0000 7f3776866700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f37700b2cd0 0x7f37700c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:13.207 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.197+0000 7f3776866700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f37700cc140 0x7f37700c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:13.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.197+0000 7f3776866700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37701525f0 con 0x7f37700b2850 2023-11-08T19:30:13.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.197+0000 7f3776866700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377014f4b0 con 0x7f37700cc140 2023-11-08T19:30:13.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.197+0000 7f3776866700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3770151970 con 0x7f37700b2cd0 2023-11-08T19:30:13.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.197+0000 7f376ffff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f37700b2850 0x7f377014ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:13.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.197+0000 7f376ffff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f37700b2850 0x7f377014ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:46116/0 (socket says 172.21.15.149:46116) 2023-11-08T19:30:13.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.197+0000 7f376ffff700 1 -- 172.21.15.149:0/2059499604 learned_addr learned my addr 172.21.15.149:0/2059499604 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:30:13.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.197+0000 7f376f7fe700 1 --2- 172.21.15.149:0/2059499604 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f37700b2cd0 0x7f37700c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:13.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.198+0000 7f3774e03700 1 --2- 172.21.15.149:0/2059499604 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f37700cc140 0x7f37700c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:13.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.198+0000 7f376ffff700 1 -- 172.21.15.149:0/2059499604 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f37700b2cd0 msgr2=0x7f37700c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:13.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.198+0000 7f376ffff700 1 --2- 172.21.15.149:0/2059499604 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f37700b2cd0 0x7f37700c84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:13.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.198+0000 7f376ffff700 1 -- 172.21.15.149:0/2059499604 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f37700cc140 msgr2=0x7f37700c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:13.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.198+0000 7f376ffff700 1 --2- 172.21.15.149:0/2059499604 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f37700cc140 0x7f37700c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:13.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.198+0000 7f376ffff700 1 -- 172.21.15.149:0/2059499604 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3764009500 con 0x7f37700b2850 2023-11-08T19:30:13.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.198+0000 7f376f7fe700 1 --2- 172.21.15.149:0/2059499604 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f37700b2cd0 0x7f37700c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:30:13.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.198+0000 7f376ffff700 1 --2- 172.21.15.149:0/2059499604 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f37700b2850 0x7f377014ef70 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f3764004000 tx=0x7f3764004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:13.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.198+0000 7f376cff9700 1 -- 172.21.15.149:0/2059499604 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3764003e10 con 0x7f37700b2850 2023-11-08T19:30:13.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.198+0000 7f376cff9700 1 -- 172.21.15.149:0/2059499604 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f376401d430 con 0x7f37700b2850 2023-11-08T19:30:13.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.198+0000 7f3776866700 1 -- 172.21.15.149:0/2059499604 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3770151c50 con 0x7f37700b2850 2023-11-08T19:30:13.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.198+0000 7f376cff9700 1 -- 172.21.15.149:0/2059499604 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376401d7e0 con 0x7f37700b2850 2023-11-08T19:30:13.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.198+0000 7f3776866700 1 -- 172.21.15.149:0/2059499604 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3770152210 con 0x7f37700b2850 2023-11-08T19:30:13.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.199+0000 7f3776866700 1 -- 172.21.15.149:0/2059499604 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37700745f0 con 0x7f37700b2850 2023-11-08T19:30:13.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.199+0000 7f376cff9700 1 -- 172.21.15.149:0/2059499604 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f376401d940 con 0x7f37700b2850 2023-11-08T19:30:13.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.200+0000 7f376cff9700 1 --2- 172.21.15.149:0/2059499604 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f375c06af00 0x7f375c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:13.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.200+0000 7f376cff9700 1 -- 172.21.15.149:0/2059499604 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6999+0+0 (secure 0 0 0) 0x7f376408ae40 con 0x7f37700b2850 2023-11-08T19:30:13.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.200+0000 7f376f7fe700 1 --2- 172.21.15.149:0/2059499604 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f375c06af00 0x7f375c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:13.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.200+0000 7f376f7fe700 1 --2- 172.21.15.149:0/2059499604 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f375c06af00 0x7f375c06d3c0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f37700c9ea0 tx=0x7f3760008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:13.216 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.205+0000 7f376cff9700 1 -- 172.21.15.149:0/2059499604 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3764055a70 con 0x7f37700b2850 2023-11-08T19:30:13.396 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.395+0000 7f3776866700 1 -- 172.21.15.149:0/2059499604 --> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f37700b1d70 con 0x7f375c06af00 2023-11-08T19:30:13.397 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.396+0000 7f376cff9700 1 -- 172.21.15.149:0/2059499604 <== mgr.4104 v2:172.21.15.149:6832/1929837472 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3760004030 con 0x7f375c06af00 2023-11-08T19:30:13.399 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.398+0000 7f3776866700 1 -- 172.21.15.149:0/2059499604 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f375c06af00 msgr2=0x7f375c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:13.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.398+0000 7f3776866700 1 --2- 172.21.15.149:0/2059499604 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f375c06af00 0x7f375c06d3c0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f37700c9ea0 tx=0x7f3760008040 comp rx=0 tx=0).stop 2023-11-08T19:30:13.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.398+0000 7f3776866700 1 -- 172.21.15.149:0/2059499604 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f37700b2850 msgr2=0x7f377014ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:13.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.398+0000 7f3776866700 1 --2- 172.21.15.149:0/2059499604 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f37700b2850 0x7f377014ef70 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f3764004000 tx=0x7f3764004750 comp rx=0 tx=0).stop 2023-11-08T19:30:13.401 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.398+0000 7f3776866700 1 -- 172.21.15.149:0/2059499604 shutdown_connections 2023-11-08T19:30:13.401 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.398+0000 7f3776866700 1 --2- 172.21.15.149:0/2059499604 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f375c06af00 0x7f375c06d3c0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:13.401 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.398+0000 7f3776866700 1 --2- 172.21.15.149:0/2059499604 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f37700cc140 0x7f37700c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:13.402 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.398+0000 7f3776866700 1 --2- 172.21.15.149:0/2059499604 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f37700b2850 0x7f377014ef70 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:13.402 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.398+0000 7f3776866700 1 --2- 172.21.15.149:0/2059499604 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f37700b2cd0 0x7f37700c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:13.402 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.398+0000 7f3776866700 1 -- 172.21.15.149:0/2059499604 >> 172.21.15.149:0/2059499604 conn(0x7f3770099a40 msgr2=0x7f37700c7670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:13.402 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.398+0000 7f3776866700 1 -- 172.21.15.149:0/2059499604 shutdown_connections 2023-11-08T19:30:13.403 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.398+0000 7f3776866700 1 -- 172.21.15.149:0/2059499604 wait complete. 2023-11-08T19:30:13.403 INFO:teuthology.orchestra.run.smithi149.stderr:instructed osd(s) 5 to deep-scrub 2023-11-08T19:30:13.411 INFO:tasks.ceph:Scrubbing osd.6 2023-11-08T19:30:13.412 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-11-08T19:30:13.537 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.536+0000 7fbe057e8700 1 Processor -- start 2023-11-08T19:30:13.537 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.536+0000 7fbe057e8700 1 -- start start 2023-11-08T19:30:13.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.536+0000 7fbe057e8700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fbe0015dd00 0x7fbe000cebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:13.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.536+0000 7fbe057e8700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe000d0aa0 0x7fbe000b23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:13.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.536+0000 7fbe057e8700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe000d2b40 con 0x7fbe000d1ac0 2023-11-08T19:30:13.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.536+0000 7fbe057e8700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe000d22a0 con 0x7fbe0015dd00 2023-11-08T19:30:13.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.536+0000 7fbe057e8700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe000d2580 con 0x7fbe000d0aa0 2023-11-08T19:30:13.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.537+0000 7fbdfeffd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fbe0015dd00 0x7fbe000cebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:13.542 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.537+0000 7fbdfeffd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fbe0015dd00 0x7fbe000cebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:46124/0 (socket says 172.21.15.149:46124) 2023-11-08T19:30:13.542 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.537+0000 7fbdfeffd700 1 -- 172.21.15.149:0/1061660176 learned_addr learned my addr 172.21.15.149:0/1061660176 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:30:13.542 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.537+0000 7fbdfe7fc700 1 --1- 172.21.15.149:0/1061660176 >> v1:172.21.15.149:6789/0 conn(0x7fbe000d1ac0 0x7fbe000d0390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:48126/0 (socket says 172.21.15.149:48126) 2023-11-08T19:30:13.542 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.537+0000 7fbdff7fe700 1 --2- 172.21.15.149:0/1061660176 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe000d0aa0 0x7fbe000b23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:13.543 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.537+0000 7fbdfeffd700 1 -- 172.21.15.149:0/1061660176 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe000d0aa0 msgr2=0x7fbe000b23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:30:13.543 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.537+0000 7fbdfeffd700 1 --2- 172.21.15.149:0/1061660176 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe000d0aa0 0x7fbe000b23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:13.543 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.537+0000 7fbdfeffd700 1 -- 172.21.15.149:0/1061660176 >> v1:172.21.15.149:6789/0 conn(0x7fbe000d1ac0 legacy=0x7fbe000d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:13.544 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.537+0000 7fbdfeffd700 1 -- 172.21.15.149:0/1061660176 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe000d2860 con 0x7fbe0015dd00 2023-11-08T19:30:13.544 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.537+0000 7fbdfeffd700 1 --2- 172.21.15.149:0/1061660176 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe0015dd00 0x7fbe000cebf0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7fbdf00098f0 tx=0x7fbdf0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4cd0fa012481a7c server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:13.544 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.537+0000 7fbdfdffb700 1 -- 172.21.15.149:0/1061660176 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf0011830 con 0x7fbe0015dd00 2023-11-08T19:30:13.544 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.537+0000 7fbdfdffb700 1 -- 172.21.15.149:0/1061660176 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf0011990 con 0x7fbe0015dd00 2023-11-08T19:30:13.545 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.537+0000 7fbdfdffb700 1 -- 172.21.15.149:0/1061660176 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf0011d20 con 0x7fbe0015dd00 2023-11-08T19:30:13.545 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.538+0000 7fbe057e8700 1 -- 172.21.15.149:0/1061660176 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe0015dd00 msgr2=0x7fbe000cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:13.545 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.538+0000 7fbe057e8700 1 --2- 172.21.15.149:0/1061660176 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe0015dd00 0x7fbe000cebf0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7fbdf00098f0 tx=0x7fbdf0009c00 comp rx=0 tx=0).stop 2023-11-08T19:30:13.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.538+0000 7fbe057e8700 1 -- 172.21.15.149:0/1061660176 shutdown_connections 2023-11-08T19:30:13.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.538+0000 7fbe057e8700 1 --2- 172.21.15.149:0/1061660176 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe000d0aa0 0x7fbe000b23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:13.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.538+0000 7fbe057e8700 1 --2- 172.21.15.149:0/1061660176 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe0015dd00 0x7fbe000cebf0 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:13.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.538+0000 7fbe057e8700 1 -- 172.21.15.149:0/1061660176 >> 172.21.15.149:0/1061660176 conn(0x7fbe0006bd80 msgr2=0x7fbe0006c160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:13.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.538+0000 7fbe057e8700 1 -- 172.21.15.149:0/1061660176 shutdown_connections 2023-11-08T19:30:13.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.538+0000 7fbe057e8700 1 -- 172.21.15.149:0/1061660176 wait complete. 2023-11-08T19:30:13.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.539+0000 7fbe057e8700 1 Processor -- start 2023-11-08T19:30:13.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.539+0000 7fbe057e8700 1 -- start start 2023-11-08T19:30:13.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.540+0000 7fbe057e8700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe000d0aa0 0x7fbe001f7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:13.551 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.540+0000 7fbe057e8700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe000d1ac0 0x7fbe000cbc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:13.551 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.540+0000 7fbe057e8700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe0015dd00 0x7fbe000cc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:13.551 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.540+0000 7fbe057e8700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe001f7640 con 0x7fbe000d0aa0 2023-11-08T19:30:13.552 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.540+0000 7fbe057e8700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0015a730 con 0x7fbe000d1ac0 2023-11-08T19:30:13.552 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.540+0000 7fbe057e8700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe000cabf0 con 0x7fbe0015dd00 2023-11-08T19:30:13.552 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.540+0000 7fbdfeffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe000d0aa0 0x7fbe001f7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:13.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.540+0000 7fbdfeffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe000d0aa0 0x7fbe001f7100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:46130/0 (socket says 172.21.15.149:46130) 2023-11-08T19:30:13.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.540+0000 7fbdfeffd700 1 -- 172.21.15.149:0/3419889967 learned_addr learned my addr 172.21.15.149:0/3419889967 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:30:13.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.540+0000 7fbdfeffd700 1 -- 172.21.15.149:0/3419889967 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe0015dd00 msgr2=0x7fbe000cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:13.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.540+0000 7fbdfeffd700 1 --2- 172.21.15.149:0/3419889967 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe0015dd00 0x7fbe000cc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:13.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.540+0000 7fbdfeffd700 1 -- 172.21.15.149:0/3419889967 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe000d1ac0 msgr2=0x7fbe000cbc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:13.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.540+0000 7fbdfeffd700 1 --2- 172.21.15.149:0/3419889967 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe000d1ac0 0x7fbe000cbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:13.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.540+0000 7fbdfeffd700 1 -- 172.21.15.149:0/3419889967 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf0009550 con 0x7fbe000d0aa0 2023-11-08T19:30:13.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.540+0000 7fbdfeffd700 1 --2- 172.21.15.149:0/3419889967 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe000d0aa0 0x7fbe001f7100 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0009c40 tx=0x7fbdf0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:13.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.540+0000 7fbde77fe700 1 -- 172.21.15.149:0/3419889967 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf00036a0 con 0x7fbe000d0aa0 2023-11-08T19:30:13.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.540+0000 7fbde77fe700 1 -- 172.21.15.149:0/3419889967 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf001e070 con 0x7fbe000d0aa0 2023-11-08T19:30:13.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.541+0000 7fbe057e8700 1 -- 172.21.15.149:0/3419889967 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe000caed0 con 0x7fbe000d0aa0 2023-11-08T19:30:13.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.541+0000 7fbde77fe700 1 -- 172.21.15.149:0/3419889967 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf0003a60 con 0x7fbe000d0aa0 2023-11-08T19:30:13.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.541+0000 7fbe057e8700 1 -- 172.21.15.149:0/3419889967 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe000cb490 con 0x7fbe000d0aa0 2023-11-08T19:30:13.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.541+0000 7fbe057e8700 1 -- 172.21.15.149:0/3419889967 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbe000b7e90 con 0x7fbe000d0aa0 2023-11-08T19:30:13.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.542+0000 7fbde77fe700 1 -- 172.21.15.149:0/3419889967 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbdf0003bc0 con 0x7fbe000d0aa0 2023-11-08T19:30:13.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.542+0000 7fbde77fe700 1 --2- 172.21.15.149:0/3419889967 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fbdec06af00 0x7fbdec06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:13.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.542+0000 7fbde77fe700 1 -- 172.21.15.149:0/3419889967 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6999+0+0 (secure 0 0 0) 0x7fbdf008aa50 con 0x7fbe000d0aa0 2023-11-08T19:30:13.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.542+0000 7fbdfe7fc700 1 --2- 172.21.15.149:0/3419889967 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fbdec06af00 0x7fbdec06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:13.558 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.543+0000 7fbde77fe700 1 --2- 172.21.15.149:0/3419889967 >> [v2:172.21.15.160:6801/3344903775,v1:172.21.15.160:6803/3344903775] conn(0x7fbdec073e40 0x7fbdec0762c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:13.558 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.543+0000 7fbde77fe700 1 -- 172.21.15.149:0/3419889967 --> [v2:172.21.15.160:6801/3344903775,v1:172.21.15.160:6803/3344903775] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbdec076990 con 0x7fbdec073e40 2023-11-08T19:30:13.558 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.543+0000 7fbde77fe700 1 -- 172.21.15.149:0/3419889967 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_get_version_reply(handle=1 version=111) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbdf008f2a0 con 0x7fbe000d0aa0 2023-11-08T19:30:13.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.543+0000 7fbdfe7fc700 1 --2- 172.21.15.149:0/3419889967 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fbdec06af00 0x7fbdec06d3c0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fbe0015f8f0 tx=0x7fbdf4007a50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:13.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.543+0000 7fbdff7fe700 1 --2- 172.21.15.149:0/3419889967 >> [v2:172.21.15.160:6801/3344903775,v1:172.21.15.160:6803/3344903775] conn(0x7fbdec073e40 0x7fbdec0762c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:13.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.543+0000 7fbdff7fe700 1 --2- 172.21.15.149:0/3419889967 >> [v2:172.21.15.160:6801/3344903775,v1:172.21.15.160:6803/3344903775] conn(0x7fbdec073e40 0x7fbdec0762c0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:13.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.544+0000 7fbde77fe700 1 -- 172.21.15.149:0/3419889967 <== osd.6 v2:172.21.15.160:6801/3344903775 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7fbdec076990 con 0x7fbdec073e40 2023-11-08T19:30:13.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.559+0000 7fbe057e8700 1 -- 172.21.15.149:0/3419889967 --> [v2:172.21.15.160:6801/3344903775,v1:172.21.15.160:6803/3344903775] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fbe000d0ec0 con 0x7fbdec073e40 2023-11-08T19:30:13.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.559+0000 7fbde77fe700 1 -- 172.21.15.149:0/3419889967 <== osd.6 v2:172.21.15.160:6801/3344903775 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fbe000d0ec0 con 0x7fbdec073e40 2023-11-08T19:30:13.561 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2023-11-08T19:30:13.561 INFO:teuthology.orchestra.run.smithi149.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-08T19:30:13.562 INFO:teuthology.orchestra.run.smithi149.stdout:} 2023-11-08T19:30:13.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.559+0000 7fbe057e8700 1 -- 172.21.15.149:0/3419889967 >> [v2:172.21.15.160:6801/3344903775,v1:172.21.15.160:6803/3344903775] conn(0x7fbdec073e40 msgr2=0x7fbdec0762c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:13.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.559+0000 7fbe057e8700 1 --2- 172.21.15.149:0/3419889967 >> [v2:172.21.15.160:6801/3344903775,v1:172.21.15.160:6803/3344903775] conn(0x7fbdec073e40 0x7fbdec0762c0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:13.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.559+0000 7fbe057e8700 1 -- 172.21.15.149:0/3419889967 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fbdec06af00 msgr2=0x7fbdec06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:13.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.559+0000 7fbe057e8700 1 --2- 172.21.15.149:0/3419889967 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fbdec06af00 0x7fbdec06d3c0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fbe0015f8f0 tx=0x7fbdf4007a50 comp rx=0 tx=0).stop 2023-11-08T19:30:13.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.559+0000 7fbe057e8700 1 -- 172.21.15.149:0/3419889967 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe000d0aa0 msgr2=0x7fbe001f7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:13.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.559+0000 7fbe057e8700 1 --2- 172.21.15.149:0/3419889967 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe000d0aa0 0x7fbe001f7100 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0009c40 tx=0x7fbdf0004750 comp rx=0 tx=0).stop 2023-11-08T19:30:13.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.559+0000 7fbdff7fe700 1 -- 172.21.15.149:0/3419889967 reap_dead start 2023-11-08T19:30:13.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.560+0000 7fbe057e8700 1 -- 172.21.15.149:0/3419889967 shutdown_connections 2023-11-08T19:30:13.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.560+0000 7fbe057e8700 1 -- 172.21.15.149:0/3419889967 >> 172.21.15.149:0/3419889967 conn(0x7fbe0006bd80 msgr2=0x7fbe0015fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:13.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.560+0000 7fbe057e8700 1 -- 172.21.15.149:0/3419889967 shutdown_connections 2023-11-08T19:30:13.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.560+0000 7fbe057e8700 1 -- 172.21.15.149:0/3419889967 wait complete. 2023-11-08T19:30:13.572 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-11-08T19:30:13.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.693+0000 7f7caccd4700 1 Processor -- start 2023-11-08T19:30:13.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.693+0000 7f7caccd4700 1 -- start start 2023-11-08T19:30:13.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.694+0000 7f7caccd4700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7ca80cb300 0x7f7ca815d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:13.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.694+0000 7f7caccd4700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ca80b2f60 con 0x7f7ca80cc910 2023-11-08T19:30:13.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.694+0000 7f7caccd4700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ca80cc520 con 0x7f7ca80cc140 2023-11-08T19:30:13.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.694+0000 7f7caccd4700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca80b2430 con 0x7f7ca80cb300 2023-11-08T19:30:13.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.694+0000 7f7ca5d9b700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f7ca80cc910 0x7f7ca80cabf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:48142/0 (socket says 172.21.15.149:48142) 2023-11-08T19:30:13.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.694+0000 7f7ca5d9b700 1 -- 172.21.15.149:0/1686389505 learned_addr learned my addr 172.21.15.149:0/1686389505 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:30:13.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.695+0000 7f7ca6d9d700 1 --2- 172.21.15.149:0/1686389505 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7ca80cb300 0x7f7ca815d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:13.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.695+0000 7f7ca559a700 1 -- 172.21.15.149:0/1686389505 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2326728769 0 0) 0x7f7ca80b2f60 con 0x7f7ca80cc910 2023-11-08T19:30:13.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.695+0000 7f7ca559a700 1 -- 172.21.15.149:0/1686389505 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c900035b0 con 0x7f7ca80cc910 2023-11-08T19:30:13.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.695+0000 7f7ca559a700 1 -- 172.21.15.149:0/1686389505 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 22023807 0 0) 0x7f7c900035b0 con 0x7f7ca80cc910 2023-11-08T19:30:13.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.695+0000 7f7ca559a700 1 -- 172.21.15.149:0/1686389505 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7ca80cb300 msgr2=0x7f7ca815d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:30:13.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.695+0000 7f7ca559a700 1 --2- 172.21.15.149:0/1686389505 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7ca80cb300 0x7f7ca815d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:13.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.695+0000 7f7ca559a700 1 -- 172.21.15.149:0/1686389505 >> v1:172.21.15.160:6789/0 conn(0x7f7ca80cc140 legacy=0x7f7ca80b2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:13.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.695+0000 7f7ca559a700 1 -- 172.21.15.149:0/1686389505 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca80b17b0 con 0x7f7ca80cc910 2023-11-08T19:30:13.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.695+0000 7f7ca559a700 1 -- 172.21.15.149:0/1686389505 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f7c98001670 con 0x7f7ca80cc910 2023-11-08T19:30:13.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.695+0000 7f7ca559a700 1 -- 172.21.15.149:0/1686389505 >> v1:172.21.15.149:6789/0 conn(0x7f7ca80cc910 legacy=0x7f7ca80cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:13.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.695+0000 7f7ca559a700 1 --2- 172.21.15.149:0/1686389505 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c90003a30 0x7f7c90003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:13.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.695+0000 7f7ca559a700 1 --2- 172.21.15.149:0/1686389505 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7ca80cb300 0x7f7c90004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:13.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.695+0000 7f7ca559a700 1 --2- 172.21.15.149:0/1686389505 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c90004d90 0x7f7c90005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:13.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.695+0000 7f7ca559a700 1 -- 172.21.15.149:0/1686389505 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca80b2430 con 0x7f7c90003a30 2023-11-08T19:30:13.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.695+0000 7f7ca559a700 1 -- 172.21.15.149:0/1686389505 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9000ba40 con 0x7f7c90004d90 2023-11-08T19:30:13.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.695+0000 7f7ca559a700 1 -- 172.21.15.149:0/1686389505 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9000bc00 con 0x7f7ca80cb300 2023-11-08T19:30:13.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.695+0000 7f7ca659c700 1 --2- 172.21.15.149:0/1686389505 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c90003a30 0x7f7c90003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:13.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.695+0000 7f7ca5d9b700 1 --2- 172.21.15.149:0/1686389505 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7ca80cb300 0x7f7c90004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:13.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.695+0000 7f7ca6d9d700 1 --2- 172.21.15.149:0/1686389505 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c90004d90 0x7f7c90005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:13.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.695+0000 7f7ca659c700 1 -- 172.21.15.149:0/1686389505 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7ca80cb300 msgr2=0x7f7c90004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:30:13.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.695+0000 7f7ca659c700 1 --2- 172.21.15.149:0/1686389505 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7ca80cb300 0x7f7c90004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:13.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.695+0000 7f7ca659c700 1 -- 172.21.15.149:0/1686389505 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c90004d90 msgr2=0x7f7c90005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:30:13.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.695+0000 7f7ca659c700 1 --2- 172.21.15.149:0/1686389505 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c90004d90 0x7f7c90005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:13.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.695+0000 7f7ca659c700 1 -- 172.21.15.149:0/1686389505 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c900035b0 con 0x7f7c90003a30 2023-11-08T19:30:13.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.696+0000 7f7ca659c700 1 --2- 172.21.15.149:0/1686389505 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c90003a30 0x7f7c90003e10 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c001930 tx=0x7f7c90005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2859cdac9e35660d server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:13.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.696+0000 7f7ca559a700 1 -- 172.21.15.149:0/1686389505 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9c0013a0 con 0x7f7c90003a30 2023-11-08T19:30:13.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.696+0000 7f7ca559a700 1 -- 172.21.15.149:0/1686389505 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c9c012620 con 0x7f7c90003a30 2023-11-08T19:30:13.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.696+0000 7f7ca559a700 1 -- 172.21.15.149:0/1686389505 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9c0129d0 con 0x7f7c90003a30 2023-11-08T19:30:13.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.696+0000 7f7caccd4700 1 -- 172.21.15.149:0/1686389505 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c90003a30 msgr2=0x7f7c90003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:13.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.696+0000 7f7caccd4700 1 --2- 172.21.15.149:0/1686389505 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c90003a30 0x7f7c90003e10 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c001930 tx=0x7f7c90005880 comp rx=0 tx=0).stop 2023-11-08T19:30:13.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.696+0000 7f7ca6d9d700 1 -- 172.21.15.149:0/1686389505 reap_dead start 2023-11-08T19:30:13.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.696+0000 7f7caccd4700 1 -- 172.21.15.149:0/1686389505 shutdown_connections 2023-11-08T19:30:13.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.696+0000 7f7caccd4700 1 -- 172.21.15.149:0/1686389505 >> 172.21.15.149:0/1686389505 conn(0x7f7ca8099a40 msgr2=0x7f7ca80d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:13.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.696+0000 7f7caccd4700 1 -- 172.21.15.149:0/1686389505 shutdown_connections 2023-11-08T19:30:13.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.696+0000 7f7caccd4700 1 -- 172.21.15.149:0/1686389505 wait complete. 2023-11-08T19:30:13.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.698+0000 7f7caccd4700 1 Processor -- start 2023-11-08T19:30:13.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.698+0000 7f7caccd4700 1 -- start start 2023-11-08T19:30:13.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.698+0000 7f7caccd4700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c90003a30 0x7f7ca815d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:13.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.698+0000 7f7caccd4700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7ca80ae7b0 0x7f7ca80aec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:13.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.698+0000 7f7caccd4700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ca80b4050 0x7f7ca80b44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:13.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.699+0000 7f7caccd4700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca80af170 con 0x7f7c90003a30 2023-11-08T19:30:13.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.699+0000 7f7caccd4700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca81f7a80 con 0x7f7ca80b4050 2023-11-08T19:30:13.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.699+0000 7f7caccd4700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca80b4a10 con 0x7f7ca80ae7b0 2023-11-08T19:30:13.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.699+0000 7f7ca659c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c90003a30 0x7f7ca815d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:13.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.699+0000 7f7ca659c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c90003a30 0x7f7ca815d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:46152/0 (socket says 172.21.15.149:46152) 2023-11-08T19:30:13.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.699+0000 7f7ca659c700 1 -- 172.21.15.149:0/2013840945 learned_addr learned my addr 172.21.15.149:0/2013840945 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:30:13.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.699+0000 7f7ca659c700 1 -- 172.21.15.149:0/2013840945 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7ca80ae7b0 msgr2=0x7f7ca80aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:13.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.699+0000 7f7ca659c700 1 --2- 172.21.15.149:0/2013840945 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7ca80ae7b0 0x7f7ca80aec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:13.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.699+0000 7f7ca659c700 1 -- 172.21.15.149:0/2013840945 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ca80b4050 msgr2=0x7f7ca80b44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:13.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.699+0000 7f7ca659c700 1 --2- 172.21.15.149:0/2013840945 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ca80b4050 0x7f7ca80b44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:13.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.699+0000 7f7ca659c700 1 -- 172.21.15.149:0/2013840945 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca80b4c30 con 0x7f7c90003a30 2023-11-08T19:30:13.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.699+0000 7f7ca659c700 1 --2- 172.21.15.149:0/2013840945 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c90003a30 0x7f7ca815d400 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c00c0e0 tx=0x7f7c9c001280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:13.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.699+0000 7f7c96ffd700 1 -- 172.21.15.149:0/2013840945 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9c001320 con 0x7f7c90003a30 2023-11-08T19:30:13.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.699+0000 7f7c96ffd700 1 -- 172.21.15.149:0/2013840945 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c9c012db0 con 0x7f7c90003a30 2023-11-08T19:30:13.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.699+0000 7f7c96ffd700 1 -- 172.21.15.149:0/2013840945 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9c0052b0 con 0x7f7c90003a30 2023-11-08T19:30:13.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.699+0000 7f7caccd4700 1 -- 172.21.15.149:0/2013840945 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ca809e2a0 con 0x7f7c90003a30 2023-11-08T19:30:13.719 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.699+0000 7f7caccd4700 1 -- 172.21.15.149:0/2013840945 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ca81f6fa0 con 0x7f7c90003a30 2023-11-08T19:30:13.719 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.700+0000 7f7caccd4700 1 -- 172.21.15.149:0/2013840945 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ca80745f0 con 0x7f7c90003a30 2023-11-08T19:30:13.719 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.701+0000 7f7c96ffd700 1 -- 172.21.15.149:0/2013840945 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7c9c022070 con 0x7f7c90003a30 2023-11-08T19:30:13.720 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.701+0000 7f7c96ffd700 1 --2- 172.21.15.149:0/2013840945 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f7c8806af00 0x7f7c8806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:13.720 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.701+0000 7f7c96ffd700 1 -- 172.21.15.149:0/2013840945 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6999+0+0 (secure 0 0 0) 0x7f7c9c08add0 con 0x7f7c90003a30 2023-11-08T19:30:13.720 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.701+0000 7f7ca5d9b700 1 --2- 172.21.15.149:0/2013840945 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f7c8806af00 0x7f7c8806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:13.720 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.702+0000 7f7ca5d9b700 1 --2- 172.21.15.149:0/2013840945 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f7c8806af00 0x7f7c8806d3c0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f7c980011e0 tx=0x7f7c98001b40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:13.721 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.706+0000 7f7c96ffd700 1 -- 172.21.15.149:0/2013840945 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7c9c055a00 con 0x7f7c90003a30 2023-11-08T19:30:13.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.896+0000 7f7caccd4700 1 -- 172.21.15.149:0/2013840945 --> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f7ca80b1d70 con 0x7f7c8806af00 2023-11-08T19:30:13.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.897+0000 7f7c96ffd700 1 -- 172.21.15.149:0/2013840945 <== mgr.4104 v2:172.21.15.149:6832/1929837472 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7c98007da0 con 0x7f7c8806af00 2023-11-08T19:30:13.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.899+0000 7f7caccd4700 1 -- 172.21.15.149:0/2013840945 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f7c8806af00 msgr2=0x7f7c8806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:13.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.899+0000 7f7caccd4700 1 --2- 172.21.15.149:0/2013840945 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f7c8806af00 0x7f7c8806d3c0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f7c980011e0 tx=0x7f7c98001b40 comp rx=0 tx=0).stop 2023-11-08T19:30:13.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.899+0000 7f7caccd4700 1 -- 172.21.15.149:0/2013840945 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c90003a30 msgr2=0x7f7ca815d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:13.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.899+0000 7f7caccd4700 1 --2- 172.21.15.149:0/2013840945 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c90003a30 0x7f7ca815d400 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c00c0e0 tx=0x7f7c9c001280 comp rx=0 tx=0).stop 2023-11-08T19:30:13.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.899+0000 7f7caccd4700 1 -- 172.21.15.149:0/2013840945 shutdown_connections 2023-11-08T19:30:13.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.899+0000 7f7caccd4700 1 --2- 172.21.15.149:0/2013840945 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f7c8806af00 0x7f7c8806d3c0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:13.902 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.899+0000 7f7caccd4700 1 --2- 172.21.15.149:0/2013840945 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ca80b4050 0x7f7ca80b44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:13.902 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.899+0000 7f7caccd4700 1 --2- 172.21.15.149:0/2013840945 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c90003a30 0x7f7ca815d400 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:13.902 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.899+0000 7f7caccd4700 1 --2- 172.21.15.149:0/2013840945 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7ca80ae7b0 0x7f7ca80aec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:13.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.899+0000 7f7caccd4700 1 -- 172.21.15.149:0/2013840945 >> 172.21.15.149:0/2013840945 conn(0x7f7ca8099a40 msgr2=0x7f7ca806e040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:13.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.899+0000 7f7caccd4700 1 -- 172.21.15.149:0/2013840945 shutdown_connections 2023-11-08T19:30:13.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:13.899+0000 7f7caccd4700 1 -- 172.21.15.149:0/2013840945 wait complete. 2023-11-08T19:30:13.904 INFO:teuthology.orchestra.run.smithi149.stderr:instructed osd(s) 6 to deep-scrub 2023-11-08T19:30:13.912 INFO:tasks.ceph:Scrubbing osd.7 2023-11-08T19:30:13.912 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-11-08T19:30:14.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.036+0000 7f4a0ba11700 1 Processor -- start 2023-11-08T19:30:14.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.037+0000 7f4a0ba11700 1 -- start start 2023-11-08T19:30:14.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.037+0000 7f4a0ba11700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4a0406c2a0 0x7f4a0415aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:14.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.037+0000 7f4a0ba11700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a0415b090 con 0x7f4a0415a640 2023-11-08T19:30:14.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.037+0000 7f4a0ba11700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a0415b370 con 0x7f4a040cbe10 2023-11-08T19:30:14.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.037+0000 7f4a0ba11700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a040ca5c0 con 0x7f4a0406c2a0 2023-11-08T19:30:14.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.038+0000 7f4a08fac700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f4a0415a640 0x7f4a0406bb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:48164/0 (socket says 172.21.15.149:48164) 2023-11-08T19:30:14.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.038+0000 7f4a08fac700 1 -- 172.21.15.149:0/2057694801 learned_addr learned my addr 172.21.15.149:0/2057694801 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:30:14.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.038+0000 7f4a09fae700 1 --2- 172.21.15.149:0/2057694801 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4a0406c2a0 0x7f4a0415aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:14.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.038+0000 7f49fbfff700 1 -- 172.21.15.149:0/2057694801 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2825686176 0 0) 0x7f4a0415b090 con 0x7f4a0415a640 2023-11-08T19:30:14.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.038+0000 7f49fbfff700 1 -- 172.21.15.149:0/2057694801 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49f00035b0 con 0x7f4a0415a640 2023-11-08T19:30:14.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.038+0000 7f49fbfff700 1 -- 172.21.15.149:0/2057694801 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4040774102 0 0) 0x7f49f00035b0 con 0x7f4a0415a640 2023-11-08T19:30:14.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.038+0000 7f49fbfff700 1 -- 172.21.15.149:0/2057694801 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4a0406c2a0 msgr2=0x7f4a0415aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:30:14.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.038+0000 7f49fbfff700 1 --2- 172.21.15.149:0/2057694801 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4a0406c2a0 0x7f4a0415aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:14.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.038+0000 7f49fbfff700 1 -- 172.21.15.149:0/2057694801 >> v1:172.21.15.160:6789/0 conn(0x7f4a040cbe10 legacy=0x7f4a040cadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:14.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.038+0000 7f49fbfff700 1 -- 172.21.15.149:0/2057694801 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a040ca8a0 con 0x7f4a0415a640 2023-11-08T19:30:14.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.038+0000 7f49fbfff700 1 -- 172.21.15.149:0/2057694801 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f4a00001670 con 0x7f4a0415a640 2023-11-08T19:30:14.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.038+0000 7f49fbfff700 1 -- 172.21.15.149:0/2057694801 >> v1:172.21.15.149:6789/0 conn(0x7f4a0415a640 legacy=0x7f4a0406bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:14.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.038+0000 7f49fbfff700 1 --2- 172.21.15.149:0/2057694801 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49f0003a30 0x7f49f0003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:14.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.038+0000 7f49fbfff700 1 --2- 172.21.15.149:0/2057694801 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4a0406c2a0 0x7f49f0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:14.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.038+0000 7f49fbfff700 1 --2- 172.21.15.149:0/2057694801 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49f0004d90 0x7f49f0005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:14.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.038+0000 7f49fbfff700 1 -- 172.21.15.149:0/2057694801 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a040ca5c0 con 0x7f49f0003a30 2023-11-08T19:30:14.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.038+0000 7f49fbfff700 1 -- 172.21.15.149:0/2057694801 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f000baf0 con 0x7f49f0004d90 2023-11-08T19:30:14.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.038+0000 7f49fbfff700 1 -- 172.21.15.149:0/2057694801 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49f000bcb0 con 0x7f4a0406c2a0 2023-11-08T19:30:14.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.038+0000 7f4a097ad700 1 --2- 172.21.15.149:0/2057694801 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49f0003a30 0x7f49f0003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:14.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.038+0000 7f4a08fac700 1 --2- 172.21.15.149:0/2057694801 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4a0406c2a0 0x7f49f0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:14.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.038+0000 7f4a09fae700 1 --2- 172.21.15.149:0/2057694801 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49f0004d90 0x7f49f0005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:14.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.039+0000 7f4a097ad700 1 -- 172.21.15.149:0/2057694801 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4a0406c2a0 msgr2=0x7f49f0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:30:14.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.039+0000 7f4a097ad700 1 --2- 172.21.15.149:0/2057694801 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4a0406c2a0 0x7f49f0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:14.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.039+0000 7f4a097ad700 1 -- 172.21.15.149:0/2057694801 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49f0004d90 msgr2=0x7f49f0005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:30:14.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.039+0000 7f4a097ad700 1 --2- 172.21.15.149:0/2057694801 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49f0004d90 0x7f49f0005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:14.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.039+0000 7f4a097ad700 1 -- 172.21.15.149:0/2057694801 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49f00035b0 con 0x7f49f0003a30 2023-11-08T19:30:14.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.039+0000 7f4a097ad700 1 --2- 172.21.15.149:0/2057694801 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49f0003a30 0x7f49f0003e50 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f49f4007fd0 tx=0x7f49f0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1841ec0ebeda43df server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:14.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.039+0000 7f49fbfff700 1 -- 172.21.15.149:0/2057694801 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f40012f0 con 0x7f49f0003a30 2023-11-08T19:30:14.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.039+0000 7f49fbfff700 1 -- 172.21.15.149:0/2057694801 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49f40052f0 con 0x7f49f0003a30 2023-11-08T19:30:14.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.039+0000 7f49fbfff700 1 -- 172.21.15.149:0/2057694801 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f4006860 con 0x7f49f0003a30 2023-11-08T19:30:14.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.039+0000 7f4a0ba11700 1 -- 172.21.15.149:0/2057694801 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49f0003a30 msgr2=0x7f49f0003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:14.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.039+0000 7f4a0ba11700 1 --2- 172.21.15.149:0/2057694801 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49f0003a30 0x7f49f0003e50 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f49f4007fd0 tx=0x7f49f0005880 comp rx=0 tx=0).stop 2023-11-08T19:30:14.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.039+0000 7f4a09fae700 1 -- 172.21.15.149:0/2057694801 reap_dead start 2023-11-08T19:30:14.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.039+0000 7f4a0ba11700 1 -- 172.21.15.149:0/2057694801 shutdown_connections 2023-11-08T19:30:14.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.039+0000 7f4a0ba11700 1 -- 172.21.15.149:0/2057694801 >> 172.21.15.149:0/2057694801 conn(0x7f4a04071800 msgr2=0x7f4a04071c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:14.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.040+0000 7f4a0ba11700 1 -- 172.21.15.149:0/2057694801 shutdown_connections 2023-11-08T19:30:14.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.040+0000 7f4a0ba11700 1 -- 172.21.15.149:0/2057694801 wait complete. 2023-11-08T19:30:14.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.041+0000 7f4a0ba11700 1 Processor -- start 2023-11-08T19:30:14.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.041+0000 7f4a0ba11700 1 -- start start 2023-11-08T19:30:14.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.041+0000 7f4a0ba11700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49f0003a30 0x7f4a041f4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:14.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.041+0000 7f4a0ba11700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4a040c60c0 0x7f4a040c6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:14.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.042+0000 7f4a0ba11700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a040c3a70 0x7f4a040c3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:14.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.042+0000 7f4a0ba11700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a041f4b70 con 0x7f4a040c3a70 2023-11-08T19:30:14.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.042+0000 7f4a0ba11700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a040c6a80 con 0x7f49f0003a30 2023-11-08T19:30:14.061 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.042+0000 7f4a0ba11700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a040c47a0 con 0x7f4a040c60c0 2023-11-08T19:30:14.061 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.042+0000 7f4a09fae700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a040c3a70 0x7f4a040c3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:14.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.042+0000 7f4a09fae700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a040c3a70 0x7f4a040c3f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:46176/0 (socket says 172.21.15.149:46176) 2023-11-08T19:30:14.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.042+0000 7f4a09fae700 1 -- 172.21.15.149:0/3864208972 learned_addr learned my addr 172.21.15.149:0/3864208972 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:30:14.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.042+0000 7f4a097ad700 1 --2- 172.21.15.149:0/3864208972 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49f0003a30 0x7f4a041f4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:14.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.042+0000 7f4a08fac700 1 --2- 172.21.15.149:0/3864208972 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4a040c60c0 0x7f4a040c6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:14.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.042+0000 7f4a09fae700 1 -- 172.21.15.149:0/3864208972 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4a040c60c0 msgr2=0x7f4a040c6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:14.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.042+0000 7f4a09fae700 1 --2- 172.21.15.149:0/3864208972 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4a040c60c0 0x7f4a040c6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:14.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.042+0000 7f4a09fae700 1 -- 172.21.15.149:0/3864208972 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49f0003a30 msgr2=0x7f4a041f4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:14.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.042+0000 7f4a09fae700 1 --2- 172.21.15.149:0/3864208972 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49f0003a30 0x7f4a041f4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:14.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.042+0000 7f4a09fae700 1 -- 172.21.15.149:0/3864208972 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a040c4a80 con 0x7f4a040c3a70 2023-11-08T19:30:14.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.042+0000 7f4a09fae700 1 --2- 172.21.15.149:0/3864208972 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a040c3a70 0x7f4a040c3f00 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f4a0415db90 tx=0x7f49fc009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:14.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.042+0000 7f49f9ffb700 1 -- 172.21.15.149:0/3864208972 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49fc00f070 con 0x7f4a040c3a70 2023-11-08T19:30:14.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.042+0000 7f49f9ffb700 1 -- 172.21.15.149:0/3864208972 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49fc010040 con 0x7f4a040c3a70 2023-11-08T19:30:14.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.042+0000 7f4a0ba11700 1 -- 172.21.15.149:0/3864208972 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a040c4d60 con 0x7f4a040c3a70 2023-11-08T19:30:14.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.042+0000 7f49f9ffb700 1 -- 172.21.15.149:0/3864208972 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49fc007830 con 0x7f4a040c3a70 2023-11-08T19:30:14.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.042+0000 7f4a0ba11700 1 -- 172.21.15.149:0/3864208972 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a040c5320 con 0x7f4a040c3a70 2023-11-08T19:30:14.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.043+0000 7f4a0ba11700 1 -- 172.21.15.149:0/3864208972 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4a040cafb0 con 0x7f4a040c3a70 2023-11-08T19:30:14.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.044+0000 7f49f9ffb700 1 -- 172.21.15.149:0/3864208972 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f49fc007990 con 0x7f4a040c3a70 2023-11-08T19:30:14.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.044+0000 7f49f9ffb700 1 --2- 172.21.15.149:0/3864208972 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f49e806af00 0x7f49e806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:14.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.044+0000 7f49f9ffb700 1 -- 172.21.15.149:0/3864208972 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6999+0+0 (secure 0 0 0) 0x7f49fc089da0 con 0x7f4a040c3a70 2023-11-08T19:30:14.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.044+0000 7f4a097ad700 1 --2- 172.21.15.149:0/3864208972 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f49e806af00 0x7f49e806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:14.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.044+0000 7f49f9ffb700 1 --2- 172.21.15.149:0/3864208972 >> [v2:172.21.15.160:6816/3363831222,v1:172.21.15.160:6817/3363831222] conn(0x7f49e8073e40 0x7f49e80762c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:14.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.045+0000 7f49f9ffb700 1 -- 172.21.15.149:0/3864208972 --> [v2:172.21.15.160:6816/3363831222,v1:172.21.15.160:6817/3363831222] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f49e8076990 con 0x7f49e8073e40 2023-11-08T19:30:14.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.045+0000 7f49f9ffb700 1 -- 172.21.15.149:0/3864208972 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_get_version_reply(handle=1 version=111) v2 ==== 24+0+0 (secure 0 0 0) 0x7f49fc08c460 con 0x7f4a040c3a70 2023-11-08T19:30:14.070 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.045+0000 7f4a097ad700 1 --2- 172.21.15.149:0/3864208972 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f49e806af00 0x7f49e806d3c0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f49f4014040 tx=0x7f49f4011000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:14.070 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.045+0000 7f4a08fac700 1 --2- 172.21.15.149:0/3864208972 >> [v2:172.21.15.160:6816/3363831222,v1:172.21.15.160:6817/3363831222] conn(0x7f49e8073e40 0x7f49e80762c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:14.070 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.045+0000 7f4a08fac700 1 --2- 172.21.15.149:0/3864208972 >> [v2:172.21.15.160:6816/3363831222,v1:172.21.15.160:6817/3363831222] conn(0x7f49e8073e40 0x7f49e80762c0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:14.070 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.046+0000 7f49f9ffb700 1 -- 172.21.15.149:0/3864208972 <== osd.7 v2:172.21.15.160:6816/3363831222 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7f49e8076990 con 0x7f49e8073e40 2023-11-08T19:30:14.071 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.061+0000 7f4a0ba11700 1 -- 172.21.15.149:0/3864208972 --> [v2:172.21.15.160:6816/3363831222,v1:172.21.15.160:6817/3363831222] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4a040b5cb0 con 0x7f49e8073e40 2023-11-08T19:30:14.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.062+0000 7f49f9ffb700 1 -- 172.21.15.149:0/3864208972 <== osd.7 v2:172.21.15.160:6816/3363831222 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f4a040b5cb0 con 0x7f49e8073e40 2023-11-08T19:30:14.072 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2023-11-08T19:30:14.073 INFO:teuthology.orchestra.run.smithi149.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-08T19:30:14.073 INFO:teuthology.orchestra.run.smithi149.stdout:} 2023-11-08T19:30:14.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.062+0000 7f4a0ba11700 1 -- 172.21.15.149:0/3864208972 >> [v2:172.21.15.160:6816/3363831222,v1:172.21.15.160:6817/3363831222] conn(0x7f49e8073e40 msgr2=0x7f49e80762c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:14.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.062+0000 7f4a0ba11700 1 --2- 172.21.15.149:0/3864208972 >> [v2:172.21.15.160:6816/3363831222,v1:172.21.15.160:6817/3363831222] conn(0x7f49e8073e40 0x7f49e80762c0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:14.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.062+0000 7f4a0ba11700 1 -- 172.21.15.149:0/3864208972 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f49e806af00 msgr2=0x7f49e806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:14.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.062+0000 7f4a0ba11700 1 --2- 172.21.15.149:0/3864208972 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f49e806af00 0x7f49e806d3c0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f49f4014040 tx=0x7f49f4011000 comp rx=0 tx=0).stop 2023-11-08T19:30:14.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.062+0000 7f4a0ba11700 1 -- 172.21.15.149:0/3864208972 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a040c3a70 msgr2=0x7f4a040c3f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:14.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.062+0000 7f4a0ba11700 1 --2- 172.21.15.149:0/3864208972 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a040c3a70 0x7f4a040c3f00 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f4a0415db90 tx=0x7f49fc009cd0 comp rx=0 tx=0).stop 2023-11-08T19:30:14.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.062+0000 7f4a09fae700 1 -- 172.21.15.149:0/3864208972 reap_dead start 2023-11-08T19:30:14.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.062+0000 7f4a0ba11700 1 -- 172.21.15.149:0/3864208972 shutdown_connections 2023-11-08T19:30:14.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.062+0000 7f4a0ba11700 1 -- 172.21.15.149:0/3864208972 >> 172.21.15.149:0/3864208972 conn(0x7f4a04071800 msgr2=0x7f4a0406fa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:14.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.062+0000 7f4a0ba11700 1 -- 172.21.15.149:0/3864208972 shutdown_connections 2023-11-08T19:30:14.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.062+0000 7f4a0ba11700 1 -- 172.21.15.149:0/3864208972 wait complete. 2023-11-08T19:30:14.078 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-11-08T19:30:14.203 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.202+0000 7faddc72b700 1 Processor -- start 2023-11-08T19:30:14.203 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.202+0000 7faddc72b700 1 -- start start 2023-11-08T19:30:14.206 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.203+0000 7faddc72b700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fadd40668e0 0x7fadd406bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:14.206 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.203+0000 7faddc72b700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fadd40b5840 0x7fadd406c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:14.207 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.203+0000 7faddc72b700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadd415f390 con 0x7fadd415efb0 2023-11-08T19:30:14.207 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.203+0000 7faddc72b700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadd40b3460 con 0x7fadd40668e0 2023-11-08T19:30:14.207 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.203+0000 7faddc72b700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadd40ce0a0 con 0x7fadd40b5840 2023-11-08T19:30:14.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.203+0000 7fadd9cc6700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fadd40668e0 0x7fadd406bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:14.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.203+0000 7fadd9cc6700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fadd40668e0 0x7fadd406bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:46184/0 (socket says 172.21.15.149:46184) 2023-11-08T19:30:14.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.203+0000 7fadd9cc6700 1 -- 172.21.15.149:0/356854374 learned_addr learned my addr 172.21.15.149:0/356854374 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:30:14.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.203+0000 7faddacc8700 1 --2- 172.21.15.149:0/356854374 >> v2:172.21.15.160:3300/0 conn(0x7fadd40b5840 0x7fadd406c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:14.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.203+0000 7fadd9cc6700 1 -- 172.21.15.149:0/356854374 >> v2:172.21.15.160:3300/0 conn(0x7fadd40b5840 msgr2=0x7fadd406c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:30:14.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.203+0000 7fadd9cc6700 1 --2- 172.21.15.149:0/356854374 >> v2:172.21.15.160:3300/0 conn(0x7fadd40b5840 0x7fadd406c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:14.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.203+0000 7fadd9cc6700 1 -- 172.21.15.149:0/356854374 >> v1:172.21.15.149:6789/0 conn(0x7fadd415efb0 legacy=0x7fadd40b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:14.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.203+0000 7fadd9cc6700 1 -- 172.21.15.149:0/356854374 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd40ce380 con 0x7fadd40668e0 2023-11-08T19:30:14.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.203+0000 7fadd94c5700 1 -- 172.21.15.149:0/356854374 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3056519509 0 0) 0x7fadd0001110 con 0x7fadd415efb0 2023-11-08T19:30:14.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.203+0000 7faddacc8700 1 --2- 172.21.15.149:0/356854374 >> v2:172.21.15.160:3300/0 conn(0x7fadd40b5840 0x7fadd406c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:30:14.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.203+0000 7fadd9cc6700 1 --2- 172.21.15.149:0/356854374 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fadd40668e0 0x7fadd406bb90 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7fadd4067120 tx=0x7fadc4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7db2588518dbb045 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:14.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.203+0000 7fadd94c5700 1 -- 172.21.15.149:0/356854374 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc400b870 con 0x7fadd40668e0 2023-11-08T19:30:14.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.204+0000 7fadd94c5700 1 -- 172.21.15.149:0/356854374 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc400b9d0 con 0x7fadd40668e0 2023-11-08T19:30:14.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.204+0000 7fadd94c5700 1 -- 172.21.15.149:0/356854374 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc400bd60 con 0x7fadd40668e0 2023-11-08T19:30:14.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.204+0000 7faddc72b700 1 -- 172.21.15.149:0/356854374 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fadd40668e0 msgr2=0x7fadd406bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:14.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.204+0000 7faddc72b700 1 --2- 172.21.15.149:0/356854374 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fadd40668e0 0x7fadd406bb90 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7fadd4067120 tx=0x7fadc4009bd0 comp rx=0 tx=0).stop 2023-11-08T19:30:14.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.204+0000 7faddc72b700 1 -- 172.21.15.149:0/356854374 shutdown_connections 2023-11-08T19:30:14.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.204+0000 7faddc72b700 1 --2- 172.21.15.149:0/356854374 >> v2:172.21.15.160:3300/0 conn(0x7fadd40b5840 0x7fadd406c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:14.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.204+0000 7faddc72b700 1 --2- 172.21.15.149:0/356854374 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fadd40668e0 0x7fadd406bb90 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:14.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.204+0000 7faddc72b700 1 -- 172.21.15.149:0/356854374 >> 172.21.15.149:0/356854374 conn(0x7fadd4071720 msgr2=0x7fadd4071b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:14.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.204+0000 7faddc72b700 1 -- 172.21.15.149:0/356854374 shutdown_connections 2023-11-08T19:30:14.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.204+0000 7faddc72b700 1 -- 172.21.15.149:0/356854374 wait complete. 2023-11-08T19:30:14.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.205+0000 7faddc72b700 1 Processor -- start 2023-11-08T19:30:14.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.205+0000 7faddc72b700 1 -- start start 2023-11-08T19:30:14.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.206+0000 7faddc72b700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fadd40668e0 0x7fadd40c8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:14.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.206+0000 7faddc72b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fadd40b5840 0x7fadd40c6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:14.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.206+0000 7faddc72b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fadd415efb0 0x7fadd406d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:14.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.206+0000 7faddc72b700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd4148bd0 con 0x7fadd415efb0 2023-11-08T19:30:14.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.206+0000 7faddc72b700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd40c68a0 con 0x7fadd40b5840 2023-11-08T19:30:14.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.206+0000 7faddc72b700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadd40c9e60 con 0x7fadd40668e0 2023-11-08T19:30:14.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.206+0000 7faddacc8700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fadd415efb0 0x7fadd406d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:14.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.206+0000 7faddacc8700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fadd415efb0 0x7fadd406d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:46192/0 (socket says 172.21.15.149:46192) 2023-11-08T19:30:14.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.206+0000 7faddacc8700 1 -- 172.21.15.149:0/3049658073 learned_addr learned my addr 172.21.15.149:0/3049658073 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:30:14.221 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.206+0000 7fadda4c7700 1 --2- 172.21.15.149:0/3049658073 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fadd40668e0 0x7fadd40c8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:14.221 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.206+0000 7fadd9cc6700 1 --2- 172.21.15.149:0/3049658073 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fadd40b5840 0x7fadd40c6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:14.221 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.206+0000 7faddacc8700 1 -- 172.21.15.149:0/3049658073 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fadd40668e0 msgr2=0x7fadd40c8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:14.221 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.206+0000 7faddacc8700 1 --2- 172.21.15.149:0/3049658073 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fadd40668e0 0x7fadd40c8fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:14.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.206+0000 7faddacc8700 1 -- 172.21.15.149:0/3049658073 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fadd40b5840 msgr2=0x7fadd40c6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:14.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.206+0000 7faddacc8700 1 --2- 172.21.15.149:0/3049658073 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fadd40b5840 0x7fadd40c6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:14.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.206+0000 7faddacc8700 1 -- 172.21.15.149:0/3049658073 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc4009550 con 0x7fadd415efb0 2023-11-08T19:30:14.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.206+0000 7fadd9cc6700 1 --2- 172.21.15.149:0/3049658073 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fadd40b5840 0x7fadd40c6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:30:14.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.207+0000 7faddacc8700 1 --2- 172.21.15.149:0/3049658073 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fadd415efb0 0x7fadd406d4a0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7fadcc00cef0 tx=0x7fadcc00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:14.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.207+0000 7fadcaffd700 1 -- 172.21.15.149:0/3049658073 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadcc00ae50 con 0x7fadd415efb0 2023-11-08T19:30:14.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.207+0000 7fadcaffd700 1 -- 172.21.15.149:0/3049658073 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadcc015440 con 0x7fadd415efb0 2023-11-08T19:30:14.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.207+0000 7faddc72b700 1 -- 172.21.15.149:0/3049658073 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadd40c95c0 con 0x7fadd415efb0 2023-11-08T19:30:14.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.207+0000 7fadcaffd700 1 -- 172.21.15.149:0/3049658073 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadcc0157f0 con 0x7fadd415efb0 2023-11-08T19:30:14.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.207+0000 7faddc72b700 1 -- 172.21.15.149:0/3049658073 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadd40c9b80 con 0x7fadd415efb0 2023-11-08T19:30:14.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.208+0000 7faddc72b700 1 -- 172.21.15.149:0/3049658073 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadd41f3b00 con 0x7fadd415efb0 2023-11-08T19:30:14.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.208+0000 7fadcaffd700 1 -- 172.21.15.149:0/3049658073 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fadcc00d430 con 0x7fadd415efb0 2023-11-08T19:30:14.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.209+0000 7fadcaffd700 1 --2- 172.21.15.149:0/3049658073 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fadb806af00 0x7fadb806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:14.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.209+0000 7fadcaffd700 1 -- 172.21.15.149:0/3049658073 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6999+0+0 (secure 0 0 0) 0x7fadcc08a4a0 con 0x7fadd415efb0 2023-11-08T19:30:14.226 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.209+0000 7fadda4c7700 1 --2- 172.21.15.149:0/3049658073 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fadb806af00 0x7fadb806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:14.226 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.209+0000 7fadda4c7700 1 --2- 172.21.15.149:0/3049658073 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fadb806af00 0x7fadb806d3c0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fadd0000f60 tx=0x7fadd0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:14.226 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.213+0000 7fadcaffd700 1 -- 172.21.15.149:0/3049658073 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fadcc055120 con 0x7fadd415efb0 2023-11-08T19:30:14.405 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.404+0000 7faddc72b700 1 -- 172.21.15.149:0/3049658073 --> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fadd40ce940 con 0x7fadb806af00 2023-11-08T19:30:14.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.405+0000 7fadcaffd700 1 -- 172.21.15.149:0/3049658073 <== mgr.4104 v2:172.21.15.149:6832/1929837472 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fadd00050d0 con 0x7fadb806af00 2023-11-08T19:30:14.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.407+0000 7faddc72b700 1 -- 172.21.15.149:0/3049658073 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fadb806af00 msgr2=0x7fadb806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:14.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.407+0000 7faddc72b700 1 --2- 172.21.15.149:0/3049658073 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fadb806af00 0x7fadb806d3c0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fadd0000f60 tx=0x7fadd0009040 comp rx=0 tx=0).stop 2023-11-08T19:30:14.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.407+0000 7faddc72b700 1 -- 172.21.15.149:0/3049658073 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fadd415efb0 msgr2=0x7fadd406d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:14.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.407+0000 7faddc72b700 1 --2- 172.21.15.149:0/3049658073 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fadd415efb0 0x7fadd406d4a0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7fadcc00cef0 tx=0x7fadcc00a340 comp rx=0 tx=0).stop 2023-11-08T19:30:14.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.407+0000 7faddc72b700 1 -- 172.21.15.149:0/3049658073 shutdown_connections 2023-11-08T19:30:14.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.407+0000 7faddc72b700 1 --2- 172.21.15.149:0/3049658073 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fadb806af00 0x7fadb806d3c0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:14.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.407+0000 7faddc72b700 1 --2- 172.21.15.149:0/3049658073 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fadd415efb0 0x7fadd406d4a0 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:14.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.407+0000 7faddc72b700 1 --2- 172.21.15.149:0/3049658073 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fadd40668e0 0x7fadd40c8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:14.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.407+0000 7faddc72b700 1 --2- 172.21.15.149:0/3049658073 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fadd40b5840 0x7fadd40c6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:14.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.407+0000 7faddc72b700 1 -- 172.21.15.149:0/3049658073 >> 172.21.15.149:0/3049658073 conn(0x7fadd4071720 msgr2=0x7fadd4073720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:14.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.407+0000 7faddc72b700 1 -- 172.21.15.149:0/3049658073 shutdown_connections 2023-11-08T19:30:14.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.407+0000 7faddc72b700 1 -- 172.21.15.149:0/3049658073 wait complete. 2023-11-08T19:30:14.412 INFO:teuthology.orchestra.run.smithi149.stderr:instructed osd(s) 7 to deep-scrub 2023-11-08T19:30:14.420 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:30:14.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.539+0000 7f2832ca2700 1 Processor -- start 2023-11-08T19:30:14.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.539+0000 7f2832ca2700 1 -- start start 2023-11-08T19:30:14.544 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.540+0000 7f2832ca2700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f282c0cc140 0x7f282c0cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:14.544 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.540+0000 7f2832ca2700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f282c0b2850 0x7f282c0cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:14.544 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.540+0000 7f2832ca2700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f282c0cce50 con 0x7f282c0b2cd0 2023-11-08T19:30:14.545 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.540+0000 7f2832ca2700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f282c0b2430 con 0x7f282c0cc140 2023-11-08T19:30:14.545 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.540+0000 7f2832ca2700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f282c0cc520 con 0x7f282c0b2850 2023-11-08T19:30:14.545 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.540+0000 7f2830a3e700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f282c0cc140 0x7f282c0cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:14.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.540+0000 7f2830a3e700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f282c0cc140 0x7f282c0cc910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:46196/0 (socket says 172.21.15.149:46196) 2023-11-08T19:30:14.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.540+0000 7f2830a3e700 1 -- 172.21.15.149:0/3167056013 learned_addr learned my addr 172.21.15.149:0/3167056013 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:30:14.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.540+0000 7f282bfff700 1 --2- 172.21.15.149:0/3167056013 >> v2:172.21.15.160:3300/0 conn(0x7f282c0b2850 0x7f282c0cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:14.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.541+0000 7f2830a3e700 1 -- 172.21.15.149:0/3167056013 >> v2:172.21.15.160:3300/0 conn(0x7f282c0b2850 msgr2=0x7f282c0cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:30:14.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.541+0000 7f2830a3e700 1 --2- 172.21.15.149:0/3167056013 >> v2:172.21.15.160:3300/0 conn(0x7f282c0b2850 0x7f282c0cabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:14.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.541+0000 7f2830a3e700 1 -- 172.21.15.149:0/3167056013 >> v1:172.21.15.149:6789/0 conn(0x7f282c0b2cd0 legacy=0x7f282c15d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:14.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.541+0000 7f2830a3e700 1 -- 172.21.15.149:0/3167056013 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f282c0b17b0 con 0x7f282c0cc140 2023-11-08T19:30:14.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.541+0000 7f282b7fe700 1 -- 172.21.15.149:0/3167056013 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 214651269 0 0) 0x7f282c0cce50 con 0x7f282c0b2cd0 2023-11-08T19:30:14.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.541+0000 7f2830a3e700 1 --2- 172.21.15.149:0/3167056013 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f282c0cc140 0x7f282c0cc910 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f282c0b1330 tx=0x7f2820009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffa6d2b94411ae7e server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:14.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.541+0000 7f282b7fe700 1 -- 172.21.15.149:0/3167056013 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2820005e30 con 0x7f282c0cc140 2023-11-08T19:30:14.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.541+0000 7f282b7fe700 1 -- 172.21.15.149:0/3167056013 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2820004030 con 0x7f282c0cc140 2023-11-08T19:30:14.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.541+0000 7f282b7fe700 1 -- 172.21.15.149:0/3167056013 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28200043e0 con 0x7f282c0cc140 2023-11-08T19:30:14.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.541+0000 7f2832ca2700 1 -- 172.21.15.149:0/3167056013 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f282c0cc140 msgr2=0x7f282c0cc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:14.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.541+0000 7f2832ca2700 1 --2- 172.21.15.149:0/3167056013 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f282c0cc140 0x7f282c0cc910 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f282c0b1330 tx=0x7f2820009bd0 comp rx=0 tx=0).stop 2023-11-08T19:30:14.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.541+0000 7f2832ca2700 1 -- 172.21.15.149:0/3167056013 shutdown_connections 2023-11-08T19:30:14.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.541+0000 7f2832ca2700 1 --2- 172.21.15.149:0/3167056013 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f282c0cc140 0x7f282c0cc910 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:14.551 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.541+0000 7f2832ca2700 1 --2- 172.21.15.149:0/3167056013 >> v2:172.21.15.160:3300/0 conn(0x7f282c0b2850 0x7f282c0cabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:14.551 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.541+0000 7f2832ca2700 1 -- 172.21.15.149:0/3167056013 >> 172.21.15.149:0/3167056013 conn(0x7f282c099a40 msgr2=0x7f282c0d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:14.551 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.541+0000 7f2832ca2700 1 -- 172.21.15.149:0/3167056013 shutdown_connections 2023-11-08T19:30:14.552 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.542+0000 7f2832ca2700 1 -- 172.21.15.149:0/3167056013 wait complete. 2023-11-08T19:30:14.552 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.543+0000 7f2832ca2700 1 Processor -- start 2023-11-08T19:30:14.552 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.543+0000 7f2832ca2700 1 -- start start 2023-11-08T19:30:14.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.543+0000 7f2832ca2700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f282c0b2850 0x7f282c06adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:14.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.543+0000 7f2832ca2700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f282c0b2cd0 0x7f282c14da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:14.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.544+0000 7f2832ca2700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f282c0cc140 0x7f282c14df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:14.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.544+0000 7f2832ca2700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f282c14ffc0 con 0x7f282c0b2850 2023-11-08T19:30:14.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.544+0000 7f2832ca2700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f282c14f3b0 con 0x7f282c0cc140 2023-11-08T19:30:14.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.544+0000 7f2832ca2700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f282c14f690 con 0x7f282c0b2cd0 2023-11-08T19:30:14.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.544+0000 7f2830a3e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f282c0b2850 0x7f282c06adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:14.558 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.544+0000 7f2830a3e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f282c0b2850 0x7f282c06adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:46202/0 (socket says 172.21.15.149:46202) 2023-11-08T19:30:14.558 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.544+0000 7f2830a3e700 1 -- 172.21.15.149:0/4112795138 learned_addr learned my addr 172.21.15.149:0/4112795138 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:30:14.558 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.544+0000 7f283123f700 1 --2- 172.21.15.149:0/4112795138 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f282c0cc140 0x7f282c14df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:14.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.544+0000 7f282bfff700 1 --2- 172.21.15.149:0/4112795138 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f282c0b2cd0 0x7f282c14da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:14.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.544+0000 7f2830a3e700 1 -- 172.21.15.149:0/4112795138 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f282c0b2cd0 msgr2=0x7f282c14da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:14.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.544+0000 7f2830a3e700 1 --2- 172.21.15.149:0/4112795138 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f282c0b2cd0 0x7f282c14da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:14.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.544+0000 7f2830a3e700 1 -- 172.21.15.149:0/4112795138 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f282c0cc140 msgr2=0x7f282c14df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:14.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.544+0000 7f2830a3e700 1 --2- 172.21.15.149:0/4112795138 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f282c0cc140 0x7f282c14df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:14.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.544+0000 7f2830a3e700 1 -- 172.21.15.149:0/4112795138 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2820009500 con 0x7f282c0b2850 2023-11-08T19:30:14.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.544+0000 7f283123f700 1 --2- 172.21.15.149:0/4112795138 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f282c0cc140 0x7f282c14df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:30:14.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.544+0000 7f2830a3e700 1 --2- 172.21.15.149:0/4112795138 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f282c0b2850 0x7f282c06adf0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f2820009c10 tx=0x7f2820004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:14.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.544+0000 7f28297fa700 1 -- 172.21.15.149:0/4112795138 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282000b460 con 0x7f282c0b2850 2023-11-08T19:30:14.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.544+0000 7f28297fa700 1 -- 172.21.15.149:0/4112795138 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f282000b5c0 con 0x7f282c0b2850 2023-11-08T19:30:14.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.544+0000 7f28297fa700 1 -- 172.21.15.149:0/4112795138 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282000b970 con 0x7f282c0b2850 2023-11-08T19:30:14.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.544+0000 7f2832ca2700 1 -- 172.21.15.149:0/4112795138 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f282c14f970 con 0x7f282c0b2850 2023-11-08T19:30:14.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.544+0000 7f2832ca2700 1 -- 172.21.15.149:0/4112795138 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f282c06b330 con 0x7f282c0b2850 2023-11-08T19:30:14.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.545+0000 7f2832ca2700 1 -- 172.21.15.149:0/4112795138 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f282c06b4c0 con 0x7f282c0b2850 2023-11-08T19:30:14.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.545+0000 7f28297fa700 1 -- 172.21.15.149:0/4112795138 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2820018030 con 0x7f282c0b2850 2023-11-08T19:30:14.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.546+0000 7f28297fa700 1 --2- 172.21.15.149:0/4112795138 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f281006af30 0x7f281006d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:14.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.546+0000 7f28297fa700 1 -- 172.21.15.149:0/4112795138 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6999+0+0 (secure 0 0 0) 0x7f282008ae90 con 0x7f282c0b2850 2023-11-08T19:30:14.567 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.546+0000 7f282bfff700 1 --2- 172.21.15.149:0/4112795138 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f281006af30 0x7f281006d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:14.567 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.546+0000 7f282bfff700 1 --2- 172.21.15.149:0/4112795138 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f281006af30 0x7f281006d3f0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f282c0b5620 tx=0x7f2818008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:14.568 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.551+0000 7f28297fa700 1 -- 172.21.15.149:0/4112795138 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2820055be0 con 0x7f282c0b2850 2023-11-08T19:30:14.736 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.735+0000 7f2832ca2700 1 -- 172.21.15.149:0/4112795138 --> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f282c0b1d70 con 0x7f281006af30 2023-11-08T19:30:14.744 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.743+0000 7f28297fa700 1 -- 172.21.15.149:0/4112795138 <== mgr.4104 v2:172.21.15.149:6832/1929837472 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+293207 (secure 0 0 0) 0x7f28180095e0 con 0x7f281006af30 2023-11-08T19:30:14.748 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:30:14.751 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.747+0000 7f2832ca2700 1 -- 172.21.15.149:0/4112795138 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f281006af30 msgr2=0x7f281006d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:14.751 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.747+0000 7f2832ca2700 1 --2- 172.21.15.149:0/4112795138 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f281006af30 0x7f281006d3f0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f282c0b5620 tx=0x7f2818008040 comp rx=0 tx=0).stop 2023-11-08T19:30:14.751 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.747+0000 7f2832ca2700 1 -- 172.21.15.149:0/4112795138 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f282c0b2850 msgr2=0x7f282c06adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:14.751 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.747+0000 7f2832ca2700 1 --2- 172.21.15.149:0/4112795138 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f282c0b2850 0x7f282c06adf0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f2820009c10 tx=0x7f2820004750 comp rx=0 tx=0).stop 2023-11-08T19:30:14.752 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.747+0000 7f2832ca2700 1 -- 172.21.15.149:0/4112795138 shutdown_connections 2023-11-08T19:30:14.752 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.747+0000 7f2832ca2700 1 --2- 172.21.15.149:0/4112795138 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f281006af30 0x7f281006d3f0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:14.752 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.747+0000 7f2832ca2700 1 --2- 172.21.15.149:0/4112795138 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f282c0cc140 0x7f282c14df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:14.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.747+0000 7f2832ca2700 1 --2- 172.21.15.149:0/4112795138 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f282c0b2850 0x7f282c06adf0 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:14.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.747+0000 7f2832ca2700 1 --2- 172.21.15.149:0/4112795138 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f282c0b2cd0 0x7f282c14da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:14.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.747+0000 7f2832ca2700 1 -- 172.21.15.149:0/4112795138 >> 172.21.15.149:0/4112795138 conn(0x7f282c099a40 msgr2=0x7f282c0c7670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:14.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.747+0000 7f2832ca2700 1 -- 172.21.15.149:0/4112795138 shutdown_connections 2023-11-08T19:30:14.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:14.747+0000 7f2832ca2700 1 -- 172.21.15.149:0/4112795138 wait complete. 2023-11-08T19:30:14.754 INFO:teuthology.orchestra.run.smithi149.stderr:dumped all 2023-11-08T19:30:14.760 INFO:teuthology.orchestra.run.smithi149.stdout:{"pg_ready":true,"pg_map":{"version":323,"stamp":"2023-11-08T19:30:14.098937+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":215,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":232244,"kb_used_data":11912,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754742476,"statfs":{"total":773094113280,"available":772856295424,"internally_reserved":0,"allocated":12197888,"data_stored":6807536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.357442"},"pg_stats":[{"pgid":"13.c","version":"0'0","reported_seq":45,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.294913+0000","last_change":"2023-11-08T19:25:47.285071+0000","last_active":"2023-11-08T19:30:05.294913+0000","last_peered":"2023-11-08T19:30:05.294913+0000","last_clean":"2023-11-08T19:30:05.294913+0000","last_became_active":"2023-11-08T19:25:47.284788+0000","last_became_peered":"2023-11-08T19:25:47.284788+0000","last_unstale":"2023-11-08T19:30:05.294913+0000","last_undegraded":"2023-11-08T19:30:05.294913+0000","last_fullsized":"2023-11-08T19:30:05.294913+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:50:50.522780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":244,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.087224+0000","last_change":"2023-11-08T19:22:58.054283+0000","last_active":"2023-11-08T19:30:05.087224+0000","last_peered":"2023-11-08T19:30:05.087224+0000","last_clean":"2023-11-08T19:30:05.087224+0000","last_became_active":"2023-11-08T19:22:58.053337+0000","last_became_peered":"2023-11-08T19:22:58.053337+0000","last_unstale":"2023-11-08T19:30:05.087224+0000","last_undegraded":"2023-11-08T19:30:05.087224+0000","last_fullsized":"2023-11-08T19:30:05.087224+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:22:56.479654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:22:56.479654+0000","last_clean_scrub_stamp":"2023-11-08T19:22:56.479654+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:16:05.317001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":78,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:07.175677+0000","last_change":"2023-11-08T19:24:32.530665+0000","last_active":"2023-11-08T19:30:07.175677+0000","last_peered":"2023-11-08T19:30:07.175677+0000","last_clean":"2023-11-08T19:30:07.175677+0000","last_became_active":"2023-11-08T19:24:31.148363+0000","last_became_peered":"2023-11-08T19:24:31.148363+0000","last_unstale":"2023-11-08T19:30:07.175677+0000","last_undegraded":"2023-11-08T19:30:07.175677+0000","last_fullsized":"2023-11-08T19:30:07.175677+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075444200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":52,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.087364+0000","last_change":"2023-11-08T19:25:48.371346+0000","last_active":"2023-11-08T19:30:05.087364+0000","last_peered":"2023-11-08T19:30:05.087364+0000","last_clean":"2023-11-08T19:30:05.087364+0000","last_became_active":"2023-11-08T19:25:46.289470+0000","last_became_peered":"2023-11-08T19:25:46.289470+0000","last_unstale":"2023-11-08T19:30:05.087364+0000","last_undegraded":"2023-11-08T19:30:05.087364+0000","last_fullsized":"2023-11-08T19:30:05.087364+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:25:34.010085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000371219,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":50,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:07.075249+0000","last_change":"2023-11-08T19:25:47.283242+0000","last_active":"2023-11-08T19:30:07.075249+0000","last_peered":"2023-11-08T19:30:07.075249+0000","last_clean":"2023-11-08T19:30:07.075249+0000","last_became_active":"2023-11-08T19:25:47.282922+0000","last_became_peered":"2023-11-08T19:25:47.282922+0000","last_unstale":"2023-11-08T19:30:07.075249+0000","last_undegraded":"2023-11-08T19:30:07.075249+0000","last_fullsized":"2023-11-08T19:30:07.075249+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:26:23.400596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":77,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.295182+0000","last_change":"2023-11-08T19:24:32.544333+0000","last_active":"2023-11-08T19:30:05.295182+0000","last_peered":"2023-11-08T19:30:05.295182+0000","last_clean":"2023-11-08T19:30:05.295182+0000","last_became_active":"2023-11-08T19:24:31.138598+0000","last_became_peered":"2023-11-08T19:24:31.138598+0000","last_unstale":"2023-11-08T19:30:05.295182+0000","last_undegraded":"2023-11-08T19:30:05.295182+0000","last_fullsized":"2023-11-08T19:30:05.295182+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:11.860580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015114824000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":57,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:06.152254+0000","last_change":"2023-11-08T19:25:48.374357+0000","last_active":"2023-11-08T19:30:06.152254+0000","last_peered":"2023-11-08T19:30:06.152254+0000","last_clean":"2023-11-08T19:30:06.152254+0000","last_became_active":"2023-11-08T19:25:46.279007+0000","last_became_peered":"2023-11-08T19:25:46.279007+0000","last_unstale":"2023-11-08T19:30:06.152254+0000","last_undegraded":"2023-11-08T19:30:06.152254+0000","last_fullsized":"2023-11-08T19:30:06.152254+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:59:30.845191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036813240000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":48,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.754198+0000","last_change":"2023-11-08T19:25:47.285093+0000","last_active":"2023-11-08T19:30:05.754198+0000","last_peered":"2023-11-08T19:30:05.754198+0000","last_clean":"2023-11-08T19:30:05.754198+0000","last_became_active":"2023-11-08T19:25:47.284796+0000","last_became_peered":"2023-11-08T19:25:47.284796+0000","last_unstale":"2023-11-08T19:30:05.754198+0000","last_undegraded":"2023-11-08T19:30:05.754198+0000","last_fullsized":"2023-11-08T19:30:05.754198+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:46:36.504650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":77,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.296974+0000","last_change":"2023-11-08T19:24:32.544285+0000","last_active":"2023-11-08T19:30:05.296974+0000","last_peered":"2023-11-08T19:30:05.296974+0000","last_clean":"2023-11-08T19:30:05.296974+0000","last_became_active":"2023-11-08T19:24:31.142028+0000","last_became_peered":"2023-11-08T19:24:31.142028+0000","last_unstale":"2023-11-08T19:30:05.296974+0000","last_undegraded":"2023-11-08T19:30:05.296974+0000","last_fullsized":"2023-11-08T19:30:05.296974+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:01:24.198196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067537399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":54,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:06.166466+0000","last_change":"2023-11-08T19:25:48.372192+0000","last_active":"2023-11-08T19:30:06.166466+0000","last_peered":"2023-11-08T19:30:06.166466+0000","last_clean":"2023-11-08T19:30:06.166466+0000","last_became_active":"2023-11-08T19:25:46.288739+0000","last_became_peered":"2023-11-08T19:25:46.288739+0000","last_unstale":"2023-11-08T19:30:06.166466+0000","last_undegraded":"2023-11-08T19:30:06.166466+0000","last_fullsized":"2023-11-08T19:30:06.166466+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:45:04.839053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015057530000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":50,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:07.075605+0000","last_change":"2023-11-08T19:25:47.287920+0000","last_active":"2023-11-08T19:30:07.075605+0000","last_peered":"2023-11-08T19:30:07.075605+0000","last_clean":"2023-11-08T19:30:07.075605+0000","last_became_active":"2023-11-08T19:25:47.287494+0000","last_became_peered":"2023-11-08T19:25:47.287494+0000","last_unstale":"2023-11-08T19:30:07.075605+0000","last_undegraded":"2023-11-08T19:30:07.075605+0000","last_fullsized":"2023-11-08T19:30:07.075605+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:42:18.942062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":78,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.292283+0000","last_change":"2023-11-08T19:24:32.142836+0000","last_active":"2023-11-08T19:30:05.292283+0000","last_peered":"2023-11-08T19:30:05.292283+0000","last_clean":"2023-11-08T19:30:05.292283+0000","last_became_active":"2023-11-08T19:24:31.141367+0000","last_became_peered":"2023-11-08T19:24:31.141367+0000","last_unstale":"2023-11-08T19:30:05.292283+0000","last_undegraded":"2023-11-08T19:30:05.292283+0000","last_fullsized":"2023-11-08T19:30:05.292283+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:39.214888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001335136,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":53,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.296884+0000","last_change":"2023-11-08T19:25:48.372718+0000","last_active":"2023-11-08T19:30:05.296884+0000","last_peered":"2023-11-08T19:30:05.296884+0000","last_clean":"2023-11-08T19:30:05.296884+0000","last_became_active":"2023-11-08T19:25:46.289283+0000","last_became_peered":"2023-11-08T19:25:46.289283+0000","last_unstale":"2023-11-08T19:30:05.296884+0000","last_undegraded":"2023-11-08T19:30:05.296884+0000","last_fullsized":"2023-11-08T19:30:05.296884+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:15:51.881891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001274049,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":47,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.292492+0000","last_change":"2023-11-08T19:25:47.285353+0000","last_active":"2023-11-08T19:30:05.292492+0000","last_peered":"2023-11-08T19:30:05.292492+0000","last_clean":"2023-11-08T19:30:05.292492+0000","last_became_active":"2023-11-08T19:25:47.285075+0000","last_became_peered":"2023-11-08T19:25:47.285075+0000","last_unstale":"2023-11-08T19:30:05.292492+0000","last_undegraded":"2023-11-08T19:30:05.292492+0000","last_fullsized":"2023-11-08T19:30:05.292492+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:20:50.791463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":87,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.744154+0000","last_change":"2023-11-08T19:24:32.139885+0000","last_active":"2023-11-08T19:30:04.744154+0000","last_peered":"2023-11-08T19:30:04.744154+0000","last_clean":"2023-11-08T19:30:04.744154+0000","last_became_active":"2023-11-08T19:24:31.145329+0000","last_became_peered":"2023-11-08T19:24:31.145329+0000","last_unstale":"2023-11-08T19:30:04.744154+0000","last_undegraded":"2023-11-08T19:30:04.744154+0000","last_fullsized":"2023-11-08T19:30:04.744154+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:25:18.356784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049012999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":57,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:06.152287+0000","last_change":"2023-11-08T19:25:48.373848+0000","last_active":"2023-11-08T19:30:06.152287+0000","last_peered":"2023-11-08T19:30:06.152287+0000","last_clean":"2023-11-08T19:30:06.152287+0000","last_became_active":"2023-11-08T19:25:46.282174+0000","last_became_peered":"2023-11-08T19:25:46.282174+0000","last_unstale":"2023-11-08T19:30:06.152287+0000","last_undegraded":"2023-11-08T19:30:06.152287+0000","last_fullsized":"2023-11-08T19:30:06.152287+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:00:06.938052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000727792,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":52,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.743231+0000","last_change":"2023-11-08T19:25:47.287677+0000","last_active":"2023-11-08T19:30:04.743231+0000","last_peered":"2023-11-08T19:30:04.743231+0000","last_clean":"2023-11-08T19:30:04.743231+0000","last_became_active":"2023-11-08T19:25:47.287419+0000","last_became_peered":"2023-11-08T19:25:47.287419+0000","last_unstale":"2023-11-08T19:30:04.743231+0000","last_undegraded":"2023-11-08T19:30:04.743231+0000","last_fullsized":"2023-11-08T19:30:04.743231+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:22:08.770702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":86,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.746427+0000","last_change":"2023-11-08T19:24:32.140880+0000","last_active":"2023-11-08T19:30:04.746427+0000","last_peered":"2023-11-08T19:30:04.746427+0000","last_clean":"2023-11-08T19:30:04.746427+0000","last_became_active":"2023-11-08T19:24:31.146063+0000","last_became_peered":"2023-11-08T19:24:31.146063+0000","last_unstale":"2023-11-08T19:30:04.746427+0000","last_undegraded":"2023-11-08T19:30:04.746427+0000","last_fullsized":"2023-11-08T19:30:04.746427+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:54:08.985813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089896300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":55,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:07.175538+0000","last_change":"2023-11-08T19:25:48.374690+0000","last_active":"2023-11-08T19:30:07.175538+0000","last_peered":"2023-11-08T19:30:07.175538+0000","last_clean":"2023-11-08T19:30:07.175538+0000","last_became_active":"2023-11-08T19:25:46.281986+0000","last_became_peered":"2023-11-08T19:25:46.281986+0000","last_unstale":"2023-11-08T19:30:07.175538+0000","last_undegraded":"2023-11-08T19:30:07.175538+0000","last_fullsized":"2023-11-08T19:30:07.175538+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003067771,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":45,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.087166+0000","last_change":"2023-11-08T19:25:47.287986+0000","last_active":"2023-11-08T19:30:05.087166+0000","last_peered":"2023-11-08T19:30:05.087166+0000","last_clean":"2023-11-08T19:30:05.087166+0000","last_became_active":"2023-11-08T19:25:47.287560+0000","last_became_peered":"2023-11-08T19:25:47.287560+0000","last_unstale":"2023-11-08T19:30:05.087166+0000","last_undegraded":"2023-11-08T19:30:05.087166+0000","last_fullsized":"2023-11-08T19:30:05.087166+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:35:31.433056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":78,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:07.173035+0000","last_change":"2023-11-08T19:24:32.530620+0000","last_active":"2023-11-08T19:30:07.173035+0000","last_peered":"2023-11-08T19:30:07.173035+0000","last_clean":"2023-11-08T19:30:07.173035+0000","last_became_active":"2023-11-08T19:24:31.144223+0000","last_became_peered":"2023-11-08T19:24:31.144223+0000","last_unstale":"2023-11-08T19:30:07.173035+0000","last_undegraded":"2023-11-08T19:30:07.173035+0000","last_fullsized":"2023-11-08T19:30:07.173035+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071879799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":59,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.746498+0000","last_change":"2023-11-08T19:25:48.285326+0000","last_active":"2023-11-08T19:30:04.746498+0000","last_peered":"2023-11-08T19:30:04.746498+0000","last_clean":"2023-11-08T19:30:04.746498+0000","last_became_active":"2023-11-08T19:25:46.278686+0000","last_became_peered":"2023-11-08T19:25:46.278686+0000","last_unstale":"2023-11-08T19:30:04.746498+0000","last_undegraded":"2023-11-08T19:30:04.746498+0000","last_fullsized":"2023-11-08T19:30:04.746498+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:25:34.010085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078409499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":52,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.746273+0000","last_change":"2023-11-08T19:25:47.289726+0000","last_active":"2023-11-08T19:30:04.746273+0000","last_peered":"2023-11-08T19:30:04.746273+0000","last_clean":"2023-11-08T19:30:04.746273+0000","last_became_active":"2023-11-08T19:25:47.289362+0000","last_became_peered":"2023-11-08T19:25:47.289362+0000","last_unstale":"2023-11-08T19:30:04.746273+0000","last_undegraded":"2023-11-08T19:30:04.746273+0000","last_fullsized":"2023-11-08T19:30:04.746273+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:38:55.785104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":76,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.087461+0000","last_change":"2023-11-08T19:24:32.147025+0000","last_active":"2023-11-08T19:30:05.087461+0000","last_peered":"2023-11-08T19:30:05.087461+0000","last_clean":"2023-11-08T19:30:05.087461+0000","last_became_active":"2023-11-08T19:24:31.147082+0000","last_became_peered":"2023-11-08T19:24:31.147082+0000","last_unstale":"2023-11-08T19:30:05.087461+0000","last_undegraded":"2023-11-08T19:30:05.087461+0000","last_fullsized":"2023-11-08T19:30:05.087461+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:02:27.987795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043701599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":55,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:07.175744+0000","last_change":"2023-11-08T19:25:48.374739+0000","last_active":"2023-11-08T19:30:07.175744+0000","last_peered":"2023-11-08T19:30:07.175744+0000","last_clean":"2023-11-08T19:30:07.175744+0000","last_became_active":"2023-11-08T19:25:46.282071+0000","last_became_peered":"2023-11-08T19:25:46.282071+0000","last_unstale":"2023-11-08T19:30:07.175744+0000","last_undegraded":"2023-11-08T19:30:07.175744+0000","last_fullsized":"2023-11-08T19:30:07.175744+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023654909999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":77,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.295255+0000","last_change":"2023-11-08T19:24:32.544063+0000","last_active":"2023-11-08T19:30:05.295255+0000","last_peered":"2023-11-08T19:30:05.295255+0000","last_clean":"2023-11-08T19:30:05.295255+0000","last_became_active":"2023-11-08T19:24:31.144795+0000","last_became_peered":"2023-11-08T19:24:31.144795+0000","last_unstale":"2023-11-08T19:30:05.295255+0000","last_undegraded":"2023-11-08T19:30:05.295255+0000","last_fullsized":"2023-11-08T19:30:05.295255+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:12:42.248307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01495431,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":60,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.744117+0000","last_change":"2023-11-08T19:25:48.283673+0000","last_active":"2023-11-08T19:30:04.744117+0000","last_peered":"2023-11-08T19:30:04.744117+0000","last_clean":"2023-11-08T19:30:04.744117+0000","last_became_active":"2023-11-08T19:25:46.285766+0000","last_became_peered":"2023-11-08T19:25:46.285766+0000","last_unstale":"2023-11-08T19:30:04.744117+0000","last_undegraded":"2023-11-08T19:30:04.744117+0000","last_fullsized":"2023-11-08T19:30:04.744117+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:46:35.498766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001756748,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":46,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.087335+0000","last_change":"2023-11-08T19:25:47.288301+0000","last_active":"2023-11-08T19:30:05.087335+0000","last_peered":"2023-11-08T19:30:05.087335+0000","last_clean":"2023-11-08T19:30:05.087335+0000","last_became_active":"2023-11-08T19:25:47.288027+0000","last_became_peered":"2023-11-08T19:25:47.288027+0000","last_unstale":"2023-11-08T19:30:05.087335+0000","last_undegraded":"2023-11-08T19:30:05.087335+0000","last_fullsized":"2023-11-08T19:30:05.087335+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:23:13.428596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":77,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.294230+0000","last_change":"2023-11-08T19:24:32.263810+0000","last_active":"2023-11-08T19:30:05.294230+0000","last_peered":"2023-11-08T19:30:05.294230+0000","last_clean":"2023-11-08T19:30:05.294230+0000","last_became_active":"2023-11-08T19:24:31.138814+0000","last_became_peered":"2023-11-08T19:24:31.138814+0000","last_unstale":"2023-11-08T19:30:05.294230+0000","last_undegraded":"2023-11-08T19:30:05.294230+0000","last_fullsized":"2023-11-08T19:30:05.294230+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:21:55.985548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048136000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":60,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.742995+0000","last_change":"2023-11-08T19:25:48.283572+0000","last_active":"2023-11-08T19:30:04.742995+0000","last_peered":"2023-11-08T19:30:04.742995+0000","last_clean":"2023-11-08T19:30:04.742995+0000","last_became_active":"2023-11-08T19:25:46.271936+0000","last_became_peered":"2023-11-08T19:25:46.271936+0000","last_unstale":"2023-11-08T19:30:04.742995+0000","last_undegraded":"2023-11-08T19:30:04.742995+0000","last_fullsized":"2023-11-08T19:30:04.742995+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:46:11.541748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00186835,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":53,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.743957+0000","last_change":"2023-11-08T19:25:47.282856+0000","last_active":"2023-11-08T19:30:04.743957+0000","last_peered":"2023-11-08T19:30:04.743957+0000","last_clean":"2023-11-08T19:30:04.743957+0000","last_became_active":"2023-11-08T19:25:47.282594+0000","last_became_peered":"2023-11-08T19:25:47.282594+0000","last_unstale":"2023-11-08T19:30:04.743957+0000","last_undegraded":"2023-11-08T19:30:04.743957+0000","last_fullsized":"2023-11-08T19:30:04.743957+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:14:12.111756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":80,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.292761+0000","last_change":"2023-11-08T19:24:32.333096+0000","last_active":"2023-11-08T19:30:05.292761+0000","last_peered":"2023-11-08T19:30:05.292761+0000","last_clean":"2023-11-08T19:30:05.292761+0000","last_became_active":"2023-11-08T19:24:31.142985+0000","last_became_peered":"2023-11-08T19:24:31.142985+0000","last_unstale":"2023-11-08T19:30:05.292761+0000","last_undegraded":"2023-11-08T19:30:05.292761+0000","last_fullsized":"2023-11-08T19:30:05.292761+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:36:33.274496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000386048,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":56,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:07.174406+0000","last_change":"2023-11-08T19:25:48.372963+0000","last_active":"2023-11-08T19:30:07.174406+0000","last_peered":"2023-11-08T19:30:07.174406+0000","last_clean":"2023-11-08T19:30:07.174406+0000","last_became_active":"2023-11-08T19:25:46.283263+0000","last_became_peered":"2023-11-08T19:25:46.283263+0000","last_unstale":"2023-11-08T19:30:07.174406+0000","last_undegraded":"2023-11-08T19:30:07.174406+0000","last_fullsized":"2023-11-08T19:30:07.174406+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019848779999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":48,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.292775+0000","last_change":"2023-11-08T19:25:47.284816+0000","last_active":"2023-11-08T19:30:05.292775+0000","last_peered":"2023-11-08T19:30:05.292775+0000","last_clean":"2023-11-08T19:30:05.292775+0000","last_became_active":"2023-11-08T19:25:47.284522+0000","last_became_peered":"2023-11-08T19:25:47.284522+0000","last_unstale":"2023-11-08T19:30:05.292775+0000","last_undegraded":"2023-11-08T19:30:05.292775+0000","last_fullsized":"2023-11-08T19:30:05.292775+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:39:28.223686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":78,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:07.173791+0000","last_change":"2023-11-08T19:24:32.530333+0000","last_active":"2023-11-08T19:30:07.173791+0000","last_peered":"2023-11-08T19:30:07.173791+0000","last_clean":"2023-11-08T19:30:07.173791+0000","last_became_active":"2023-11-08T19:24:31.144838+0000","last_became_peered":"2023-11-08T19:24:31.144838+0000","last_unstale":"2023-11-08T19:30:07.173791+0000","last_undegraded":"2023-11-08T19:30:07.173791+0000","last_fullsized":"2023-11-08T19:30:07.173791+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081588799999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":60,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.744392+0000","last_change":"2023-11-08T19:25:48.284699+0000","last_active":"2023-11-08T19:30:04.744392+0000","last_peered":"2023-11-08T19:30:04.744392+0000","last_clean":"2023-11-08T19:30:04.744392+0000","last_became_active":"2023-11-08T19:25:46.285588+0000","last_became_peered":"2023-11-08T19:25:46.285588+0000","last_unstale":"2023-11-08T19:30:04.744392+0000","last_undegraded":"2023-11-08T19:30:04.744392+0000","last_fullsized":"2023-11-08T19:30:04.744392+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:43:02.001903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023282350000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":49,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:07.174217+0000","last_change":"2023-11-08T19:25:47.283526+0000","last_active":"2023-11-08T19:30:07.174217+0000","last_peered":"2023-11-08T19:30:07.174217+0000","last_clean":"2023-11-08T19:30:07.174217+0000","last_became_active":"2023-11-08T19:25:47.283266+0000","last_became_peered":"2023-11-08T19:25:47.283266+0000","last_unstale":"2023-11-08T19:30:07.174217+0000","last_undegraded":"2023-11-08T19:30:07.174217+0000","last_fullsized":"2023-11-08T19:30:07.174217+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":80,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.294891+0000","last_change":"2023-11-08T19:24:32.333430+0000","last_active":"2023-11-08T19:30:05.294891+0000","last_peered":"2023-11-08T19:30:05.294891+0000","last_clean":"2023-11-08T19:30:05.294891+0000","last_became_active":"2023-11-08T19:24:31.141710+0000","last_became_peered":"2023-11-08T19:24:31.141710+0000","last_unstale":"2023-11-08T19:30:05.294891+0000","last_undegraded":"2023-11-08T19:30:05.294891+0000","last_fullsized":"2023-11-08T19:30:05.294891+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:32:51.214551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000430438,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":60,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.746468+0000","last_change":"2023-11-08T19:25:48.283855+0000","last_active":"2023-11-08T19:30:04.746468+0000","last_peered":"2023-11-08T19:30:04.746468+0000","last_clean":"2023-11-08T19:30:04.746468+0000","last_became_active":"2023-11-08T19:25:46.273336+0000","last_became_peered":"2023-11-08T19:25:46.273336+0000","last_unstale":"2023-11-08T19:30:04.746468+0000","last_undegraded":"2023-11-08T19:30:04.746468+0000","last_fullsized":"2023-11-08T19:30:04.746468+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:33:35.492889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092577200000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":53,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.743373+0000","last_change":"2023-11-08T19:25:47.282840+0000","last_active":"2023-11-08T19:30:04.743373+0000","last_peered":"2023-11-08T19:30:04.743373+0000","last_clean":"2023-11-08T19:30:04.743373+0000","last_became_active":"2023-11-08T19:25:47.282600+0000","last_became_peered":"2023-11-08T19:25:47.282600+0000","last_unstale":"2023-11-08T19:30:04.743373+0000","last_undegraded":"2023-11-08T19:30:04.743373+0000","last_fullsized":"2023-11-08T19:30:04.743373+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:53:37.482245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":53,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.743282+0000","last_change":"2023-11-08T19:25:47.285890+0000","last_active":"2023-11-08T19:30:04.743282+0000","last_peered":"2023-11-08T19:30:04.743282+0000","last_clean":"2023-11-08T19:30:04.743282+0000","last_became_active":"2023-11-08T19:25:47.285641+0000","last_became_peered":"2023-11-08T19:25:47.285641+0000","last_unstale":"2023-11-08T19:30:04.743282+0000","last_undegraded":"2023-11-08T19:30:04.743282+0000","last_fullsized":"2023-11-08T19:30:04.743282+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:27:18.335142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":78,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:07.173092+0000","last_change":"2023-11-08T19:24:32.530895+0000","last_active":"2023-11-08T19:30:07.173092+0000","last_peered":"2023-11-08T19:30:07.173092+0000","last_clean":"2023-11-08T19:30:07.173092+0000","last_became_active":"2023-11-08T19:24:31.146715+0000","last_became_peered":"2023-11-08T19:24:31.146715+0000","last_unstale":"2023-11-08T19:30:07.173092+0000","last_undegraded":"2023-11-08T19:30:07.173092+0000","last_fullsized":"2023-11-08T19:30:07.173092+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081671599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":60,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.743568+0000","last_change":"2023-11-08T19:25:48.284137+0000","last_active":"2023-11-08T19:30:04.743568+0000","last_peered":"2023-11-08T19:30:04.743568+0000","last_clean":"2023-11-08T19:30:04.743568+0000","last_became_active":"2023-11-08T19:25:46.285960+0000","last_became_peered":"2023-11-08T19:25:46.285960+0000","last_unstale":"2023-11-08T19:30:04.743568+0000","last_undegraded":"2023-11-08T19:30:04.743568+0000","last_fullsized":"2023-11-08T19:30:04.743568+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:26:01.141206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091649099999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":53,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.747186+0000","last_change":"2023-11-08T19:25:47.283642+0000","last_active":"2023-11-08T19:30:05.747186+0000","last_peered":"2023-11-08T19:30:05.747186+0000","last_clean":"2023-11-08T19:30:05.747186+0000","last_became_active":"2023-11-08T19:25:47.283360+0000","last_became_peered":"2023-11-08T19:25:47.283360+0000","last_unstale":"2023-11-08T19:30:05.747186+0000","last_undegraded":"2023-11-08T19:30:05.747186+0000","last_fullsized":"2023-11-08T19:30:05.747186+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:02:27.950152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":86,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.743654+0000","last_change":"2023-11-08T19:24:32.140167+0000","last_active":"2023-11-08T19:30:04.743654+0000","last_peered":"2023-11-08T19:30:04.743654+0000","last_clean":"2023-11-08T19:30:04.743654+0000","last_became_active":"2023-11-08T19:24:31.147181+0000","last_became_peered":"2023-11-08T19:24:31.147181+0000","last_unstale":"2023-11-08T19:30:04.743654+0000","last_undegraded":"2023-11-08T19:30:04.743654+0000","last_fullsized":"2023-11-08T19:30:04.743654+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:26.080042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057135200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":53,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:06.167733+0000","last_change":"2023-11-08T19:25:48.277705+0000","last_active":"2023-11-08T19:30:06.167733+0000","last_peered":"2023-11-08T19:30:06.167733+0000","last_clean":"2023-11-08T19:30:06.167733+0000","last_became_active":"2023-11-08T19:25:46.288848+0000","last_became_peered":"2023-11-08T19:25:46.288848+0000","last_unstale":"2023-11-08T19:30:06.167733+0000","last_undegraded":"2023-11-08T19:30:06.167733+0000","last_fullsized":"2023-11-08T19:30:06.167733+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:12:24.483185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097653099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":46,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:07.389420+0000","last_change":"2023-11-08T19:25:47.289456+0000","last_active":"2023-11-08T19:30:07.389420+0000","last_peered":"2023-11-08T19:30:07.389420+0000","last_clean":"2023-11-08T19:30:07.389420+0000","last_became_active":"2023-11-08T19:25:47.289177+0000","last_became_peered":"2023-11-08T19:25:47.289177+0000","last_unstale":"2023-11-08T19:30:07.389420+0000","last_undegraded":"2023-11-08T19:30:07.389420+0000","last_fullsized":"2023-11-08T19:30:07.389420+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:07:11.838364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":86,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.746322+0000","last_change":"2023-11-08T19:24:32.141188+0000","last_active":"2023-11-08T19:30:04.746322+0000","last_peered":"2023-11-08T19:30:04.746322+0000","last_clean":"2023-11-08T19:30:04.746322+0000","last_became_active":"2023-11-08T19:24:31.148857+0000","last_became_peered":"2023-11-08T19:24:31.148857+0000","last_unstale":"2023-11-08T19:30:04.746322+0000","last_undegraded":"2023-11-08T19:30:04.746322+0000","last_fullsized":"2023-11-08T19:30:04.746322+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:45:34.425432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065078599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":53,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:06.167712+0000","last_change":"2023-11-08T19:25:48.277423+0000","last_active":"2023-11-08T19:30:06.167712+0000","last_peered":"2023-11-08T19:30:06.167712+0000","last_clean":"2023-11-08T19:30:06.167712+0000","last_became_active":"2023-11-08T19:25:46.286211+0000","last_became_peered":"2023-11-08T19:25:46.286211+0000","last_unstale":"2023-11-08T19:30:06.167712+0000","last_undegraded":"2023-11-08T19:30:06.167712+0000","last_fullsized":"2023-11-08T19:30:06.167712+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:44:05.347800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073775700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":45,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.086944+0000","last_change":"2023-11-08T19:25:47.286020+0000","last_active":"2023-11-08T19:30:05.086944+0000","last_peered":"2023-11-08T19:30:05.086944+0000","last_clean":"2023-11-08T19:30:05.086944+0000","last_became_active":"2023-11-08T19:25:47.285728+0000","last_became_peered":"2023-11-08T19:25:47.285728+0000","last_unstale":"2023-11-08T19:30:05.086944+0000","last_undegraded":"2023-11-08T19:30:05.086944+0000","last_fullsized":"2023-11-08T19:30:05.086944+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:26:02.147090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":86,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.745467+0000","last_change":"2023-11-08T19:24:32.140832+0000","last_active":"2023-11-08T19:30:04.745467+0000","last_peered":"2023-11-08T19:30:04.745467+0000","last_clean":"2023-11-08T19:30:04.745467+0000","last_became_active":"2023-11-08T19:24:31.146557+0000","last_became_peered":"2023-11-08T19:24:31.146557+0000","last_unstale":"2023-11-08T19:30:04.745467+0000","last_undegraded":"2023-11-08T19:30:04.745467+0000","last_fullsized":"2023-11-08T19:30:04.745467+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:40:04.258107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099450100000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":55,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:07.173290+0000","last_change":"2023-11-08T19:25:48.372913+0000","last_active":"2023-11-08T19:30:07.173290+0000","last_peered":"2023-11-08T19:30:07.173290+0000","last_clean":"2023-11-08T19:30:07.173290+0000","last_became_active":"2023-11-08T19:25:46.281273+0000","last_became_peered":"2023-11-08T19:25:46.281273+0000","last_unstale":"2023-11-08T19:30:07.173290+0000","last_undegraded":"2023-11-08T19:30:07.173290+0000","last_fullsized":"2023-11-08T19:30:07.173290+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020904819999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":46,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.292346+0000","last_change":"2023-11-08T19:25:47.288256+0000","last_active":"2023-11-08T19:30:05.292346+0000","last_peered":"2023-11-08T19:30:05.292346+0000","last_clean":"2023-11-08T19:30:05.292346+0000","last_became_active":"2023-11-08T19:25:47.287905+0000","last_became_peered":"2023-11-08T19:25:47.287905+0000","last_unstale":"2023-11-08T19:30:05.292346+0000","last_undegraded":"2023-11-08T19:30:05.292346+0000","last_fullsized":"2023-11-08T19:30:05.292346+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:50:12.309248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":78,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:07.174510+0000","last_change":"2023-11-08T19:24:32.530378+0000","last_active":"2023-11-08T19:30:07.174510+0000","last_peered":"2023-11-08T19:30:07.174510+0000","last_clean":"2023-11-08T19:30:07.174510+0000","last_became_active":"2023-11-08T19:24:31.144341+0000","last_became_peered":"2023-11-08T19:24:31.144341+0000","last_unstale":"2023-11-08T19:30:07.174510+0000","last_undegraded":"2023-11-08T19:30:07.174510+0000","last_fullsized":"2023-11-08T19:30:07.174510+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058308299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":52,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.292060+0000","last_change":"2023-11-08T19:25:48.277150+0000","last_active":"2023-11-08T19:30:05.292060+0000","last_peered":"2023-11-08T19:30:05.292060+0000","last_clean":"2023-11-08T19:30:05.292060+0000","last_became_active":"2023-11-08T19:25:46.286933+0000","last_became_peered":"2023-11-08T19:25:46.286933+0000","last_unstale":"2023-11-08T19:30:05.292060+0000","last_undegraded":"2023-11-08T19:30:05.292060+0000","last_fullsized":"2023-11-08T19:30:05.292060+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:38:38.890354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080507500000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":45,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.295573+0000","last_change":"2023-11-08T19:25:47.282986+0000","last_active":"2023-11-08T19:30:05.295573+0000","last_peered":"2023-11-08T19:30:05.295573+0000","last_clean":"2023-11-08T19:30:05.295573+0000","last_became_active":"2023-11-08T19:25:47.282705+0000","last_became_peered":"2023-11-08T19:25:47.282705+0000","last_unstale":"2023-11-08T19:30:05.295573+0000","last_undegraded":"2023-11-08T19:30:05.295573+0000","last_fullsized":"2023-11-08T19:30:05.295573+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:34:17.838942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":77,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.292026+0000","last_change":"2023-11-08T19:24:32.544108+0000","last_active":"2023-11-08T19:30:05.292026+0000","last_peered":"2023-11-08T19:30:05.292026+0000","last_clean":"2023-11-08T19:30:05.292026+0000","last_became_active":"2023-11-08T19:24:31.143812+0000","last_became_peered":"2023-11-08T19:24:31.143812+0000","last_unstale":"2023-11-08T19:30:05.292026+0000","last_undegraded":"2023-11-08T19:30:05.292026+0000","last_fullsized":"2023-11-08T19:30:05.292026+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:27:59.135977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014956126,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":59,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.745074+0000","last_change":"2023-11-08T19:25:48.284435+0000","last_active":"2023-11-08T19:30:04.745074+0000","last_peered":"2023-11-08T19:30:04.745074+0000","last_clean":"2023-11-08T19:30:04.745074+0000","last_became_active":"2023-11-08T19:25:46.284288+0000","last_became_peered":"2023-11-08T19:25:46.284288+0000","last_unstale":"2023-11-08T19:30:04.745074+0000","last_undegraded":"2023-11-08T19:30:04.745074+0000","last_fullsized":"2023-11-08T19:30:04.745074+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:57:53.083448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001250894,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":52,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.745027+0000","last_change":"2023-11-08T19:25:47.282612+0000","last_active":"2023-11-08T19:30:04.745027+0000","last_peered":"2023-11-08T19:30:04.745027+0000","last_clean":"2023-11-08T19:30:04.745027+0000","last_became_active":"2023-11-08T19:25:47.282299+0000","last_became_peered":"2023-11-08T19:25:47.282299+0000","last_unstale":"2023-11-08T19:30:04.745027+0000","last_undegraded":"2023-11-08T19:30:04.745027+0000","last_fullsized":"2023-11-08T19:30:04.745027+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:43:18.319773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":76,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.086840+0000","last_change":"2023-11-08T19:24:32.146639+0000","last_active":"2023-11-08T19:30:05.086840+0000","last_peered":"2023-11-08T19:30:05.086840+0000","last_clean":"2023-11-08T19:30:05.086840+0000","last_became_active":"2023-11-08T19:24:31.147384+0000","last_became_peered":"2023-11-08T19:24:31.147384+0000","last_unstale":"2023-11-08T19:30:05.086840+0000","last_undegraded":"2023-11-08T19:30:05.086840+0000","last_fullsized":"2023-11-08T19:30:05.086840+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:30:21.946303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043834899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":59,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.744165+0000","last_change":"2023-11-08T19:25:48.283541+0000","last_active":"2023-11-08T19:30:04.744165+0000","last_peered":"2023-11-08T19:30:04.744165+0000","last_clean":"2023-11-08T19:30:04.744165+0000","last_became_active":"2023-11-08T19:25:46.285626+0000","last_became_peered":"2023-11-08T19:25:46.285626+0000","last_unstale":"2023-11-08T19:30:04.744165+0000","last_undegraded":"2023-11-08T19:30:04.744165+0000","last_fullsized":"2023-11-08T19:30:04.744165+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:48:17.033319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019032459999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":52,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.743124+0000","last_change":"2023-11-08T19:25:47.287878+0000","last_active":"2023-11-08T19:30:04.743124+0000","last_peered":"2023-11-08T19:30:04.743124+0000","last_clean":"2023-11-08T19:30:04.743124+0000","last_became_active":"2023-11-08T19:25:47.287617+0000","last_became_peered":"2023-11-08T19:25:47.287617+0000","last_unstale":"2023-11-08T19:30:04.743124+0000","last_undegraded":"2023-11-08T19:30:04.743124+0000","last_fullsized":"2023-11-08T19:30:04.743124+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:20:50.791463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":87,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.744759+0000","last_change":"2023-11-08T19:24:32.142376+0000","last_active":"2023-11-08T19:30:04.744759+0000","last_peered":"2023-11-08T19:30:04.744759+0000","last_clean":"2023-11-08T19:30:04.744759+0000","last_became_active":"2023-11-08T19:24:31.144614+0000","last_became_peered":"2023-11-08T19:24:31.144614+0000","last_unstale":"2023-11-08T19:30:04.744759+0000","last_undegraded":"2023-11-08T19:30:04.744759+0000","last_fullsized":"2023-11-08T19:30:04.744759+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:09:04.880374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050362200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":55,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:07.175176+0000","last_change":"2023-11-08T19:25:48.373636+0000","last_active":"2023-11-08T19:30:07.175176+0000","last_peered":"2023-11-08T19:30:07.175176+0000","last_clean":"2023-11-08T19:30:07.175176+0000","last_became_active":"2023-11-08T19:25:46.283803+0000","last_became_peered":"2023-11-08T19:25:46.283803+0000","last_unstale":"2023-11-08T19:30:07.175176+0000","last_undegraded":"2023-11-08T19:30:07.175176+0000","last_fullsized":"2023-11-08T19:30:07.175176+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002404855,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":45,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.087301+0000","last_change":"2023-11-08T19:25:47.287741+0000","last_active":"2023-11-08T19:30:05.087301+0000","last_peered":"2023-11-08T19:30:05.087301+0000","last_clean":"2023-11-08T19:30:05.087301+0000","last_became_active":"2023-11-08T19:25:47.287428+0000","last_became_peered":"2023-11-08T19:25:47.287428+0000","last_unstale":"2023-11-08T19:30:05.087301+0000","last_undegraded":"2023-11-08T19:30:05.087301+0000","last_fullsized":"2023-11-08T19:30:05.087301+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:38:55.785104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":76,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.087692+0000","last_change":"2023-11-08T19:24:32.147235+0000","last_active":"2023-11-08T19:30:05.087692+0000","last_peered":"2023-11-08T19:30:05.087692+0000","last_clean":"2023-11-08T19:30:05.087692+0000","last_became_active":"2023-11-08T19:24:31.146176+0000","last_became_peered":"2023-11-08T19:24:31.146176+0000","last_unstale":"2023-11-08T19:30:05.087692+0000","last_undegraded":"2023-11-08T19:30:05.087692+0000","last_fullsized":"2023-11-08T19:30:05.087692+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:06:39.214888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048481000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":55,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:07.175611+0000","last_change":"2023-11-08T19:25:48.373345+0000","last_active":"2023-11-08T19:30:07.175611+0000","last_peered":"2023-11-08T19:30:07.175611+0000","last_clean":"2023-11-08T19:30:07.175611+0000","last_became_active":"2023-11-08T19:25:46.282460+0000","last_became_peered":"2023-11-08T19:25:46.282460+0000","last_unstale":"2023-11-08T19:30:07.175611+0000","last_undegraded":"2023-11-08T19:30:07.175611+0000","last_fullsized":"2023-11-08T19:30:07.175611+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001972863,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":53,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.744804+0000","last_change":"2023-11-08T19:25:47.283708+0000","last_active":"2023-11-08T19:30:04.744804+0000","last_peered":"2023-11-08T19:30:04.744804+0000","last_clean":"2023-11-08T19:30:04.744804+0000","last_became_active":"2023-11-08T19:25:47.283433+0000","last_became_peered":"2023-11-08T19:25:47.283433+0000","last_unstale":"2023-11-08T19:30:04.744804+0000","last_undegraded":"2023-11-08T19:30:04.744804+0000","last_fullsized":"2023-11-08T19:30:04.744804+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:30:17.627967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":77,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.297275+0000","last_change":"2023-11-08T19:24:32.543880+0000","last_active":"2023-11-08T19:30:05.297275+0000","last_peered":"2023-11-08T19:30:05.297275+0000","last_clean":"2023-11-08T19:30:05.297275+0000","last_became_active":"2023-11-08T19:24:31.142052+0000","last_became_peered":"2023-11-08T19:24:31.142052+0000","last_unstale":"2023-11-08T19:30:05.297275+0000","last_undegraded":"2023-11-08T19:30:05.297275+0000","last_fullsized":"2023-11-08T19:30:05.297275+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:18:42.371676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014881058000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":60,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.746318+0000","last_change":"2023-11-08T19:25:48.284890+0000","last_active":"2023-11-08T19:30:04.746318+0000","last_peered":"2023-11-08T19:30:04.746318+0000","last_clean":"2023-11-08T19:30:04.746318+0000","last_became_active":"2023-11-08T19:25:46.279287+0000","last_became_peered":"2023-11-08T19:25:46.279287+0000","last_unstale":"2023-11-08T19:30:04.746318+0000","last_undegraded":"2023-11-08T19:30:04.746318+0000","last_fullsized":"2023-11-08T19:30:04.746318+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:35:30.427172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076856899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":53,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.746191+0000","last_change":"2023-11-08T19:25:47.285867+0000","last_active":"2023-11-08T19:30:04.746191+0000","last_peered":"2023-11-08T19:30:04.746191+0000","last_clean":"2023-11-08T19:30:04.746191+0000","last_became_active":"2023-11-08T19:25:47.285533+0000","last_became_peered":"2023-11-08T19:25:47.285533+0000","last_unstale":"2023-11-08T19:30:04.746191+0000","last_undegraded":"2023-11-08T19:30:04.746191+0000","last_fullsized":"2023-11-08T19:30:04.746191+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:26:59.852338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":76,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.087406+0000","last_change":"2023-11-08T19:24:32.147011+0000","last_active":"2023-11-08T19:30:05.087406+0000","last_peered":"2023-11-08T19:30:05.087406+0000","last_clean":"2023-11-08T19:30:05.087406+0000","last_became_active":"2023-11-08T19:24:31.148250+0000","last_became_peered":"2023-11-08T19:24:31.148250+0000","last_unstale":"2023-11-08T19:30:05.087406+0000","last_undegraded":"2023-11-08T19:30:05.087406+0000","last_fullsized":"2023-11-08T19:30:05.087406+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:01:25.647952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043061299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":60,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.744846+0000","last_change":"2023-11-08T19:25:48.284869+0000","last_active":"2023-11-08T19:30:04.744846+0000","last_peered":"2023-11-08T19:30:04.744846+0000","last_clean":"2023-11-08T19:30:04.744846+0000","last_became_active":"2023-11-08T19:25:46.285478+0000","last_became_peered":"2023-11-08T19:25:46.285478+0000","last_unstale":"2023-11-08T19:30:04.744846+0000","last_undegraded":"2023-11-08T19:30:04.744846+0000","last_fullsized":"2023-11-08T19:30:04.744846+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:49:51.368808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000376339,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":45,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.291991+0000","last_change":"2023-11-08T19:25:47.284429+0000","last_active":"2023-11-08T19:30:05.291991+0000","last_peered":"2023-11-08T19:30:05.291991+0000","last_clean":"2023-11-08T19:30:05.291991+0000","last_became_active":"2023-11-08T19:25:47.283990+0000","last_became_peered":"2023-11-08T19:25:47.283990+0000","last_unstale":"2023-11-08T19:30:05.291991+0000","last_undegraded":"2023-11-08T19:30:05.291991+0000","last_fullsized":"2023-11-08T19:30:05.291991+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:59:08.628317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":87,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.744493+0000","last_change":"2023-11-08T19:24:32.141190+0000","last_active":"2023-11-08T19:30:04.744493+0000","last_peered":"2023-11-08T19:30:04.744493+0000","last_clean":"2023-11-08T19:30:04.744493+0000","last_became_active":"2023-11-08T19:24:31.147651+0000","last_became_peered":"2023-11-08T19:24:31.147651+0000","last_unstale":"2023-11-08T19:30:04.744493+0000","last_undegraded":"2023-11-08T19:30:04.744493+0000","last_fullsized":"2023-11-08T19:30:04.744493+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:21:55.985548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043673300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":54,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.292742+0000","last_change":"2023-11-08T19:25:48.320707+0000","last_active":"2023-11-08T19:30:05.292742+0000","last_peered":"2023-11-08T19:30:05.292742+0000","last_clean":"2023-11-08T19:30:05.292742+0000","last_became_active":"2023-11-08T19:25:46.282307+0000","last_became_peered":"2023-11-08T19:25:46.282307+0000","last_unstale":"2023-11-08T19:30:05.292742+0000","last_undegraded":"2023-11-08T19:30:05.292742+0000","last_fullsized":"2023-11-08T19:30:05.292742+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:53:36.476361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047078400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":45,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.293894+0000","last_change":"2023-11-08T19:25:47.284227+0000","last_active":"2023-11-08T19:30:05.293894+0000","last_peered":"2023-11-08T19:30:05.293894+0000","last_clean":"2023-11-08T19:30:05.293894+0000","last_became_active":"2023-11-08T19:25:47.283927+0000","last_became_peered":"2023-11-08T19:25:47.283927+0000","last_unstale":"2023-11-08T19:30:05.293894+0000","last_undegraded":"2023-11-08T19:30:05.293894+0000","last_fullsized":"2023-11-08T19:30:05.293894+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:15:23.188047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":78,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:07.173026+0000","last_change":"2023-11-08T19:24:32.530168+0000","last_active":"2023-11-08T19:30:07.173026+0000","last_peered":"2023-11-08T19:30:07.173026+0000","last_clean":"2023-11-08T19:30:07.173026+0000","last_became_active":"2023-11-08T19:24:31.144329+0000","last_became_peered":"2023-11-08T19:24:31.144329+0000","last_unstale":"2023-11-08T19:30:07.173026+0000","last_undegraded":"2023-11-08T19:30:07.173026+0000","last_fullsized":"2023-11-08T19:30:07.173026+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043484799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":55,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:07.173691+0000","last_change":"2023-11-08T19:25:48.371291+0000","last_active":"2023-11-08T19:30:07.173691+0000","last_peered":"2023-11-08T19:30:07.173691+0000","last_clean":"2023-11-08T19:30:07.173691+0000","last_became_active":"2023-11-08T19:25:46.281425+0000","last_became_peered":"2023-11-08T19:25:46.281425+0000","last_unstale":"2023-11-08T19:30:07.173691+0000","last_undegraded":"2023-11-08T19:30:07.173691+0000","last_fullsized":"2023-11-08T19:30:07.173691+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00124314,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":48,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:07.173886+0000","last_change":"2023-11-08T19:25:47.281724+0000","last_active":"2023-11-08T19:30:07.173886+0000","last_peered":"2023-11-08T19:30:07.173886+0000","last_clean":"2023-11-08T19:30:07.173886+0000","last_became_active":"2023-11-08T19:25:47.281425+0000","last_became_peered":"2023-11-08T19:25:47.281425+0000","last_unstale":"2023-11-08T19:30:07.173886+0000","last_undegraded":"2023-11-08T19:30:07.173886+0000","last_fullsized":"2023-11-08T19:30:07.173886+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":78,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:07.173026+0000","last_change":"2023-11-08T19:24:32.529486+0000","last_active":"2023-11-08T19:30:07.173026+0000","last_peered":"2023-11-08T19:30:07.173026+0000","last_clean":"2023-11-08T19:30:07.173026+0000","last_became_active":"2023-11-08T19:24:31.146260+0000","last_became_peered":"2023-11-08T19:24:31.146260+0000","last_unstale":"2023-11-08T19:30:07.173026+0000","last_undegraded":"2023-11-08T19:30:07.173026+0000","last_fullsized":"2023-11-08T19:30:07.173026+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059842900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":52,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.294318+0000","last_change":"2023-11-08T19:25:48.277457+0000","last_active":"2023-11-08T19:30:05.294318+0000","last_peered":"2023-11-08T19:30:05.294318+0000","last_clean":"2023-11-08T19:30:05.294318+0000","last_became_active":"2023-11-08T19:25:46.286239+0000","last_became_peered":"2023-11-08T19:25:46.286239+0000","last_unstale":"2023-11-08T19:30:05.294318+0000","last_undegraded":"2023-11-08T19:30:05.294318+0000","last_fullsized":"2023-11-08T19:30:05.294318+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:09:43.662108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000722421,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":45,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.087441+0000","last_change":"2023-11-08T19:25:47.287874+0000","last_active":"2023-11-08T19:30:05.087441+0000","last_peered":"2023-11-08T19:30:05.087441+0000","last_clean":"2023-11-08T19:30:05.087441+0000","last_became_active":"2023-11-08T19:25:47.287456+0000","last_became_peered":"2023-11-08T19:25:47.287456+0000","last_unstale":"2023-11-08T19:30:05.087441+0000","last_undegraded":"2023-11-08T19:30:05.087441+0000","last_fullsized":"2023-11-08T19:30:05.087441+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:26:59.852338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":86,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.744037+0000","last_change":"2023-11-08T19:24:32.141131+0000","last_active":"2023-11-08T19:30:04.744037+0000","last_peered":"2023-11-08T19:30:04.744037+0000","last_clean":"2023-11-08T19:30:04.744037+0000","last_became_active":"2023-11-08T19:24:31.146154+0000","last_became_peered":"2023-11-08T19:24:31.146154+0000","last_unstale":"2023-11-08T19:30:04.744037+0000","last_undegraded":"2023-11-08T19:30:04.744037+0000","last_fullsized":"2023-11-08T19:30:04.744037+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:18:40.271560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082432800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":53,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.295341+0000","last_change":"2023-11-08T19:25:48.372729+0000","last_active":"2023-11-08T19:30:05.295341+0000","last_peered":"2023-11-08T19:30:05.295341+0000","last_clean":"2023-11-08T19:30:05.295341+0000","last_became_active":"2023-11-08T19:25:46.290114+0000","last_became_peered":"2023-11-08T19:25:46.290114+0000","last_unstale":"2023-11-08T19:30:05.295341+0000","last_undegraded":"2023-11-08T19:30:05.295341+0000","last_fullsized":"2023-11-08T19:30:05.295341+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:49:36.208776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061009499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":48,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:07.175549+0000","last_change":"2023-11-08T19:25:47.283046+0000","last_active":"2023-11-08T19:30:07.175549+0000","last_peered":"2023-11-08T19:30:07.175549+0000","last_clean":"2023-11-08T19:30:07.175549+0000","last_became_active":"2023-11-08T19:25:47.282763+0000","last_became_peered":"2023-11-08T19:25:47.282763+0000","last_unstale":"2023-11-08T19:30:07.175549+0000","last_undegraded":"2023-11-08T19:30:07.175549+0000","last_fullsized":"2023-11-08T19:30:07.175549+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":77,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.295208+0000","last_change":"2023-11-08T19:24:32.263963+0000","last_active":"2023-11-08T19:30:05.295208+0000","last_peered":"2023-11-08T19:30:05.295208+0000","last_clean":"2023-11-08T19:30:05.295208+0000","last_became_active":"2023-11-08T19:24:31.139062+0000","last_became_peered":"2023-11-08T19:24:31.139062+0000","last_unstale":"2023-11-08T19:30:05.295208+0000","last_undegraded":"2023-11-08T19:30:05.295208+0000","last_fullsized":"2023-11-08T19:30:05.295208+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:26.080042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033682599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":59,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.746216+0000","last_change":"2023-11-08T19:25:48.283302+0000","last_active":"2023-11-08T19:30:04.746216+0000","last_peered":"2023-11-08T19:30:04.746216+0000","last_clean":"2023-11-08T19:30:04.746216+0000","last_became_active":"2023-11-08T19:25:46.284287+0000","last_became_peered":"2023-11-08T19:25:46.284287+0000","last_unstale":"2023-11-08T19:30:04.746216+0000","last_undegraded":"2023-11-08T19:30:04.746216+0000","last_fullsized":"2023-11-08T19:30:04.746216+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:39:27.217802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097880800000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":52,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.743835+0000","last_change":"2023-11-08T19:25:47.286434+0000","last_active":"2023-11-08T19:30:04.743835+0000","last_peered":"2023-11-08T19:30:04.743835+0000","last_clean":"2023-11-08T19:30:04.743835+0000","last_became_active":"2023-11-08T19:25:47.286181+0000","last_became_peered":"2023-11-08T19:25:47.286181+0000","last_unstale":"2023-11-08T19:30:04.743835+0000","last_undegraded":"2023-11-08T19:30:04.743835+0000","last_fullsized":"2023-11-08T19:30:04.743835+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:13:27.285648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":86,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.746426+0000","last_change":"2023-11-08T19:24:32.140514+0000","last_active":"2023-11-08T19:30:04.746426+0000","last_peered":"2023-11-08T19:30:04.746426+0000","last_clean":"2023-11-08T19:30:04.746426+0000","last_became_active":"2023-11-08T19:24:31.146668+0000","last_became_peered":"2023-11-08T19:24:31.146668+0000","last_unstale":"2023-11-08T19:30:04.746426+0000","last_undegraded":"2023-11-08T19:30:04.746426+0000","last_fullsized":"2023-11-08T19:30:04.746426+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:31:24.539374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071576699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":54,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.292979+0000","last_change":"2023-11-08T19:25:48.320667+0000","last_active":"2023-11-08T19:30:05.292979+0000","last_peered":"2023-11-08T19:30:05.292979+0000","last_clean":"2023-11-08T19:30:05.292979+0000","last_became_active":"2023-11-08T19:25:46.290246+0000","last_became_peered":"2023-11-08T19:25:46.290246+0000","last_unstale":"2023-11-08T19:30:05.292979+0000","last_undegraded":"2023-11-08T19:30:05.292979+0000","last_fullsized":"2023-11-08T19:30:05.292979+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:33:35.492889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000423211,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":46,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.296267+0000","last_change":"2023-11-08T19:25:47.287717+0000","last_active":"2023-11-08T19:30:05.296267+0000","last_peered":"2023-11-08T19:30:05.296267+0000","last_clean":"2023-11-08T19:30:05.296267+0000","last_became_active":"2023-11-08T19:25:47.287412+0000","last_became_peered":"2023-11-08T19:25:47.287412+0000","last_unstale":"2023-11-08T19:30:05.296267+0000","last_undegraded":"2023-11-08T19:30:05.296267+0000","last_fullsized":"2023-11-08T19:30:05.296267+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:18:04.478139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":78,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.293087+0000","last_change":"2023-11-08T19:24:32.142892+0000","last_active":"2023-11-08T19:30:05.293087+0000","last_peered":"2023-11-08T19:30:05.293087+0000","last_clean":"2023-11-08T19:30:05.293087+0000","last_became_active":"2023-11-08T19:24:31.144912+0000","last_became_peered":"2023-11-08T19:24:31.144912+0000","last_unstale":"2023-11-08T19:30:05.293087+0000","last_undegraded":"2023-11-08T19:30:05.293087+0000","last_fullsized":"2023-11-08T19:30:05.293087+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:04:21.151484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056686900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":59,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.746370+0000","last_change":"2023-11-08T19:25:48.285205+0000","last_active":"2023-11-08T19:30:04.746370+0000","last_peered":"2023-11-08T19:30:04.746370+0000","last_clean":"2023-11-08T19:30:04.746370+0000","last_became_active":"2023-11-08T19:25:46.285848+0000","last_became_peered":"2023-11-08T19:25:46.285848+0000","last_unstale":"2023-11-08T19:30:04.746370+0000","last_undegraded":"2023-11-08T19:30:04.746370+0000","last_fullsized":"2023-11-08T19:30:04.746370+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:07:10.832480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089732199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":47,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.293661+0000","last_change":"2023-11-08T19:25:47.280177+0000","last_active":"2023-11-08T19:30:05.293661+0000","last_peered":"2023-11-08T19:30:05.293661+0000","last_clean":"2023-11-08T19:30:05.293661+0000","last_became_active":"2023-11-08T19:25:47.279913+0000","last_became_peered":"2023-11-08T19:25:47.279913+0000","last_unstale":"2023-11-08T19:30:05.293661+0000","last_undegraded":"2023-11-08T19:30:05.293661+0000","last_fullsized":"2023-11-08T19:30:05.293661+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:26:02.147090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":77,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.295729+0000","last_change":"2023-11-08T19:24:32.263958+0000","last_active":"2023-11-08T19:30:05.295729+0000","last_peered":"2023-11-08T19:30:05.295729+0000","last_clean":"2023-11-08T19:30:05.295729+0000","last_became_active":"2023-11-08T19:24:31.149011+0000","last_became_peered":"2023-11-08T19:24:31.149011+0000","last_unstale":"2023-11-08T19:30:05.295729+0000","last_undegraded":"2023-11-08T19:30:05.295729+0000","last_fullsized":"2023-11-08T19:30:05.295729+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:09:04.880374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033496900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":59,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-08T19:30:04.746345+0000","last_change":"2023-11-08T19:25:48.285075+0000","last_active":"2023-11-08T19:30:04.746345+0000","last_peered":"2023-11-08T19:30:04.746345+0000","last_clean":"2023-11-08T19:30:04.746345+0000","last_became_active":"2023-11-08T19:25:46.272479+0000","last_became_peered":"2023-11-08T19:25:46.272479+0000","last_unstale":"2023-11-08T19:30:04.746345+0000","last_undegraded":"2023-11-08T19:30:04.746345+0000","last_fullsized":"2023-11-08T19:30:04.746345+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:23:12.422712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001158117,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574939,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28944,"kb_used_data":1924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342896,"statfs":{"total":96636764160,"available":96607125504,"internally_reserved":0,"allocated":1970176,"data_stored":1293718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:29:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.57599999999999996,"15min":0.54600000000000004},"min":{"1min":0.33800000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.75800000000000001,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58499999999999996,"15min":0.56899999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.377},"max":{"1min":0.747,"5min":0.75900000000000001,"15min":0.86699999999999999},"last":0.94799999999999995}]},{"osd":1,"last update":"Wed Nov 8 19:29:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55000000000000004,"15min":0.54800000000000004},"min":{"1min":0.36599999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.78500000000000003,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":1.006},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.55100000000000005,"15min":0.53600000000000003},"min":{"1min":0.42199999999999999,"5min":0.39200000000000002,"15min":0.37},"max":{"1min":0.78400000000000003,"5min":0.78900000000000003,"15min":0.79800000000000004},"last":0.85899999999999999}]},{"osd":2,"last update":"Wed Nov 8 19:29:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54000000000000004,"15min":0.51700000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.82599999999999996},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.55400000000000005,"15min":0.54100000000000004},"min":{"1min":0.38500000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76800000000000002,"5min":0.77800000000000002,"15min":0.81599999999999995},"last":0.92700000000000005}]},{"osd":3,"last update":"Wed Nov 8 19:29:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54100000000000004,"15min":0.53500000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.72699999999999998,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.59099999999999997,"15min":0.56699999999999995},"min":{"1min":0.45600000000000002,"5min":0.42399999999999999,"15min":0.36899999999999999},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.875}]},{"osd":4,"last update":"Wed Nov 8 19:29:11 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.49399999999999999,"15min":0.48499999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.64700000000000002,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.497,"5min":0.51500000000000001,"15min":0.51700000000000002},"min":{"1min":0.35299999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.71499999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.56299999999999994}]},{"osd":5,"last update":"Wed Nov 8 19:29:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56200000000000006,"15min":0.54900000000000004},"min":{"1min":0.38400000000000001,"5min":0.35399999999999998,"15min":0.35099999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56899999999999995,"15min":0.57299999999999995},"min":{"1min":0.40400000000000003,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.76200000000000001,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.54200000000000004}]},{"osd":6,"last update":"Wed Nov 8 19:29:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59999999999999998,"15min":0.60799999999999998},"min":{"1min":0.40000000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.76100000000000001,"5min":0.82299999999999995,"15min":0.86399999999999999},"last":0.626},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.58199999999999996,"15min":0.56699999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.874,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.61299999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574940,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28368,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343472,"statfs":{"total":96636764160,"available":96607715328,"internally_reserved":0,"allocated":1376256,"data_stored":703350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:30:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.54400000000000004,"15min":0.58399999999999996},"min":{"1min":0.33000000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.79300000000000004,"5min":0.82199999999999995,"15min":1.7549999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55000000000000004,"15min":0.57799999999999996},"min":{"1min":0.39100000000000001,"5min":0.313,"15min":0.28699999999999998},"max":{"1min":0.746,"5min":0.76800000000000002,"15min":1.478},"last":0.66200000000000003}]},{"osd":1,"last update":"Wed Nov 8 19:30:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57999999999999996,"15min":0.59799999999999998},"min":{"1min":0.372,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.76200000000000001,"5min":0.77500000000000002,"15min":1.6619999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.628,"15min":0.65500000000000003},"min":{"1min":0.46300000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":1.649},"last":0.70199999999999996}]},{"osd":2,"last update":"Wed Nov 8 19:30:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.58999999999999997,"15min":0.56999999999999995},"min":{"1min":0.38600000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.60099999999999998,"15min":0.623},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.85399999999999998},"last":0.72699999999999998}]},{"osd":3,"last update":"Wed Nov 8 19:30:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.57099999999999995,"15min":0.60999999999999999},"min":{"1min":0.41899999999999998,"5min":0.36699999999999999,"15min":0.33500000000000002},"max":{"1min":0.77500000000000002,"5min":0.80300000000000005,"15min":1.766},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.56799999999999995,"15min":0.60399999999999998},"min":{"1min":0.44900000000000001,"5min":0.375,"15min":0.36699999999999999},"max":{"1min":0.78600000000000003,"5min":0.84399999999999997,"15min":1.8580000000000001},"last":0.78600000000000003}]},{"osd":4,"last update":"Wed Nov 8 19:30:09 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.51800000000000002,"15min":0.53300000000000003},"min":{"1min":0.318,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.755,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54600000000000004,"15min":0.56899999999999995},"min":{"1min":0.35199999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.82299999999999995,"5min":0.83499999999999996,"15min":0.89100000000000001},"last":0.52300000000000002}]},{"osd":5,"last update":"Wed Nov 8 19:30:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.53000000000000003,"15min":0.55600000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.57099999999999995,"15min":0.61499999999999999},"min":{"1min":0.40200000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.61199999999999999}]},{"osd":7,"last update":"Wed Nov 8 19:30:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.58299999999999996,"15min":0.60399999999999998},"min":{"1min":0.374,"5min":0.312,"15min":0.312},"max":{"1min":0.85299999999999998,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.58699999999999997,"15min":0.628},"min":{"1min":0.46200000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.95099999999999996},"last":0.59099999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574939,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28364,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343476,"statfs":{"total":96636764160,"available":96607719424,"internally_reserved":0,"allocated":1376256,"data_stored":703350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:30:02 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.35799999999999998},"min":{"1min":0.247,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.46899999999999997,"5min":0.51200000000000001,"15min":1.2090000000000001},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.376,"5min":0.35899999999999999,"15min":0.39700000000000002},"min":{"1min":0.23599999999999999,"5min":0.22900000000000001,"15min":0.19700000000000001},"max":{"1min":0.49299999999999999,"5min":0.61599999999999999,"15min":2.1850000000000001},"last":0.32000000000000001}]},{"osd":2,"last update":"Wed Nov 8 19:30:02 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.35099999999999998,"15min":0.34799999999999998},"min":{"1min":0.26400000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.438,"5min":0.54400000000000004,"15min":0.59099999999999997},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.38700000000000001,"15min":0.39400000000000002},"min":{"1min":0.28299999999999997,"5min":0.253,"15min":0.24099999999999999},"max":{"1min":0.56000000000000005,"5min":0.623,"15min":1.2689999999999999},"last":0.308}]},{"osd":3,"last update":"Wed Nov 8 19:30:02 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.41199999999999998,"15min":0.41799999999999998},"min":{"1min":0.32400000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.622,"5min":0.63100000000000001,"15min":1.24},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.39900000000000002,"15min":0.44400000000000001},"min":{"1min":0.30599999999999999,"5min":0.26100000000000001,"15min":0.253},"max":{"1min":0.54500000000000004,"5min":0.68200000000000005,"15min":2.2120000000000002},"last":0.379}]},{"osd":4,"last update":"Wed Nov 8 19:30:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.59299999999999997,"15min":0.60799999999999998},"min":{"1min":0.42399999999999999,"5min":0.36899999999999999,"15min":0.32100000000000001},"max":{"1min":0.82299999999999995,"5min":0.93400000000000005,"15min":2.1579999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.58899999999999997,"15min":0.57399999999999995},"min":{"1min":0.438,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.78200000000000003,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.71099999999999997}]},{"osd":5,"last update":"Wed Nov 8 19:30:02 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.59499999999999997,"15min":0.57099999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.38100000000000001},"max":{"1min":0.78300000000000003,"5min":0.82599999999999996,"15min":0.86399999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59599999999999997,"15min":0.60499999999999998},"min":{"1min":0.437,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77300000000000002,"5min":0.90800000000000003,"15min":1.115},"last":0.753}]},{"osd":6,"last update":"Wed Nov 8 19:30:02 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.60099999999999998,"15min":0.628},"min":{"1min":0.40500000000000003,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.76800000000000002,"5min":0.88400000000000001,"15min":2.093},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.435,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.752,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.52700000000000002}]},{"osd":7,"last update":"Wed Nov 8 19:30:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.621,"15min":0.65700000000000003},"min":{"1min":0.44600000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.80300000000000005,"5min":0.876,"15min":1.591},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61099999999999999,"15min":0.66800000000000004},"min":{"1min":0.49299999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.77900000000000003,"5min":0.88400000000000001,"15min":2.1299999999999999},"last":0.69399999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574939,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33104,"kb_used_data":1924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338736,"statfs":{"total":96636764160,"available":96602865664,"internally_reserved":0,"allocated":1970176,"data_stored":1293718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:29:09 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.41099999999999998,"15min":0.96199999999999997},"min":{"1min":0.19500000000000001,"5min":0.192,"15min":0.192},"max":{"1min":0.56399999999999995,"5min":6.9509999999999996,"15min":19.295999999999999},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.371,"15min":0.874},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.55500000000000005,"5min":0.57399999999999995,"15min":17.204000000000001},"last":0.27400000000000002}]},{"osd":2,"last update":"Wed Nov 8 19:29:09 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.44500000000000001,"15min":0.58499999999999996},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.64100000000000001,"5min":6.8029999999999999,"15min":6.8029999999999999},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.40699999999999997,"15min":0.91500000000000004},"min":{"1min":0.28999999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.53900000000000003,"5min":1.3140000000000001,"15min":17.175000000000001},"last":0.311}]},{"osd":3,"last update":"Wed Nov 8 19:29:09 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.52900000000000003,"15min":0.83799999999999997},"min":{"1min":0.27300000000000002,"5min":0.24399999999999999,"15min":0.22500000000000001},"max":{"1min":0.51400000000000001,"5min":16.661000000000001,"15min":16.661000000000001},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.48799999999999999,"15min":0.43099999999999999},"min":{"1min":0.29899999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.73699999999999999,"5min":6.9859999999999998,"15min":6.9859999999999998},"last":0.32200000000000001}]},{"osd":4,"last update":"Wed Nov 8 19:29:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.60899999999999999,"15min":1.0720000000000001},"min":{"1min":0.373,"5min":0.313,"15min":0.313},"max":{"1min":0.72999999999999998,"5min":1.0029999999999999,"15min":17.056000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.753,"15min":0.76100000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33000000000000002},"max":{"1min":0.72499999999999998,"5min":16.718,"15min":16.718},"last":0.57699999999999996}]},{"osd":5,"last update":"Wed Nov 8 19:29:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.746,"15min":0.76200000000000001},"min":{"1min":0.36199999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72899999999999998,"5min":16.609000000000002,"15min":16.609000000000002},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.65900000000000003,"15min":0.59499999999999997},"min":{"1min":0.40100000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77100000000000002,"5min":5.1639999999999997,"15min":5.1639999999999997},"last":0.74199999999999999}]},{"osd":6,"last update":"Wed Nov 8 19:29:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.68700000000000006,"15min":0.63300000000000001},"min":{"1min":0.45900000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.80600000000000005,"5min":6.6349999999999998,"15min":6.6349999999999998},"last":0.624},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.65300000000000002,"15min":1.1220000000000001},"min":{"1min":0.42199999999999999,"5min":0.35499999999999998,"15min":0.34899999999999998},"max":{"1min":0.81599999999999995,"5min":3.1400000000000001,"15min":17.111999999999998},"last":0.56599999999999995}]},{"osd":7,"last update":"Wed Nov 8 19:29:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63900000000000001,"15min":1.127},"min":{"1min":0.49299999999999999,"5min":0.376,"15min":0.376},"max":{"1min":0.79300000000000004,"5min":1.0760000000000001,"15min":17.146000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.76000000000000001,"15min":0.77300000000000002},"min":{"1min":0.441,"5min":0.40899999999999997,"15min":0.38800000000000001},"max":{"1min":0.76900000000000002,"5min":16.690999999999999,"15min":16.690999999999999},"last":0.55600000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574939,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28364,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343476,"statfs":{"total":96636764160,"available":96607719424,"internally_reserved":0,"allocated":1376256,"data_stored":703350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.33900000000000002,"15min":0.44400000000000001},"min":{"1min":0.22500000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.54300000000000004,"5min":0.61299999999999999,"15min":3.4100000000000001},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.38600000000000001,"15min":0.48299999999999998},"min":{"1min":0.28199999999999997,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":1.8340000000000001,"5min":1.8340000000000001,"15min":3.4369999999999998},"last":0.42699999999999999}]},{"osd":1,"last update":"Wed Nov 8 19:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.38,"15min":0.51200000000000001},"min":{"1min":0.26400000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":4.0679999999999996},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.442,"15min":0.56200000000000006},"min":{"1min":0.309,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.68000000000000005,"5min":0.72099999999999997,"15min":4.3499999999999996},"last":0.47199999999999998}]},{"osd":3,"last update":"Wed Nov 8 19:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.40799999999999997,"15min":0.50800000000000001},"min":{"1min":0.247,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.57199999999999995,"5min":0.82999999999999996,"15min":3.8580000000000001},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.436,"5min":0.378,"15min":0.48399999999999999},"min":{"1min":0.30299999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":3.476},"last":0.40600000000000003}]},{"osd":4,"last update":"Wed Nov 8 19:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.65300000000000002,"15min":0.70599999999999996},"min":{"1min":0.40899999999999997,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":4.7990000000000004,"5min":4.7990000000000004,"15min":4.7990000000000004},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.58999999999999997,"15min":0.70099999999999996},"min":{"1min":0.48199999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.76300000000000001,"5min":0.92300000000000004,"15min":4.1040000000000001},"last":0.45000000000000001}]},{"osd":5,"last update":"Wed Nov 8 19:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.60099999999999998,"15min":0.71199999999999997},"min":{"1min":0.41199999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.875,"5min":0.88,"15min":4.0869999999999997},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.64500000000000002,"15min":0.72899999999999998},"min":{"1min":0.42899999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":4.8239999999999998,"5min":4.8239999999999998,"15min":4.8239999999999998},"last":0.46200000000000002}]},{"osd":6,"last update":"Wed Nov 8 19:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.61099999999999999,"15min":0.72699999999999998},"min":{"1min":0.48099999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.83999999999999997,"5min":1.1200000000000001,"15min":4.1399999999999997},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.60099999999999998,"15min":0.70499999999999996},"min":{"1min":0.42099999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.82099999999999995,"5min":0.85599999999999998,"15min":4.0499999999999998},"last":0.57099999999999995}]},{"osd":7,"last update":"Wed Nov 8 19:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.64300000000000002,"15min":0.73999999999999999},"min":{"1min":0.46400000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.82499999999999996,"5min":1.181,"15min":4.157},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.65700000000000003,"15min":0.76700000000000002},"min":{"1min":0.55700000000000005,"5min":0.433,"15min":0.433},"max":{"1min":0.78500000000000003,"5min":1.222,"15min":4.1710000000000003},"last":0.57799999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574939,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28364,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343476,"statfs":{"total":96636764160,"available":96607719424,"internally_reserved":0,"allocated":1376256,"data_stored":703350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:30:06 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.375,"15min":0.38200000000000001},"min":{"1min":0.24299999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.57599999999999996,"5min":0.67100000000000004,"15min":1.458},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39600000000000002},"min":{"1min":0.26900000000000002,"5min":0.192,"15min":0.192},"max":{"1min":0.57899999999999996,"5min":0.626,"15min":1.3939999999999999},"last":0.35199999999999998}]},{"osd":1,"last update":"Wed Nov 8 19:30:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.40100000000000002,"15min":0.40799999999999997},"min":{"1min":0.27200000000000002,"5min":0.25900000000000001,"15min":0.245},"max":{"1min":0.57099999999999995,"5min":0.61199999999999999,"15min":1.512},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.41599999999999998,"15min":0.437},"min":{"1min":0.29699999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.55800000000000005,"5min":0.59999999999999998,"15min":1.5580000000000001},"last":0.38500000000000001}]},{"osd":2,"last update":"Wed Nov 8 19:30:06 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.377,"15min":0.377},"min":{"1min":0.25600000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.50600000000000001,"5min":1.1100000000000001,"15min":1.2030000000000001},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.40100000000000002,"15min":0.41999999999999998},"min":{"1min":0.29599999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.54900000000000004,"5min":0.72399999999999998,"15min":1.536},"last":0.37}]},{"osd":4,"last update":"Wed Nov 8 19:30:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61499999999999999,"15min":0.61799999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.36799999999999999},"max":{"1min":0.77500000000000002,"5min":0.86199999999999999,"15min":1.3400000000000001},"last":0.5},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.628,"15min":0.61599999999999999},"min":{"1min":0.40500000000000003,"5min":0.371,"15min":0.371},"max":{"1min":0.81799999999999995,"5min":0.84999999999999998,"15min":1.153},"last":0.50600000000000001}]},{"osd":5,"last update":"Wed Nov 8 19:30:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.58999999999999997,"15min":0.59099999999999997},"min":{"1min":0.46899999999999997,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.78900000000000003,"5min":0.84999999999999998,"15min":1.4870000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.58399999999999996,"15min":0.59699999999999998},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.74199999999999999,"5min":0.82799999999999996,"15min":1.3129999999999999},"last":0.40799999999999997}]},{"osd":6,"last update":"Wed Nov 8 19:30:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58099999999999996,"15min":0.57999999999999996},"min":{"1min":0.38400000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.80700000000000005,"5min":0.86799999999999999,"15min":1.113},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60399999999999998,"15min":0.60999999999999999},"min":{"1min":0.442,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.82199999999999995,"5min":0.85899999999999999,"15min":1.4139999999999999},"last":0.45700000000000002}]},{"osd":7,"last update":"Wed Nov 8 19:30:06 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.61599999999999999,"15min":0.63700000000000001},"min":{"1min":0.42999999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.84799999999999998,"5min":0.89300000000000002,"15min":1.3680000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.64000000000000001,"15min":0.625},"min":{"1min":0.47799999999999998,"5min":0.45700000000000002,"15min":0.42299999999999999},"max":{"1min":0.86099999999999999,"5min":0.89000000000000001,"15min":1.179},"last":0.46899999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574939,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28368,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343472,"statfs":{"total":96636764160,"available":96607715328,"internally_reserved":0,"allocated":1376256,"data_stored":703350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:30:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.56200000000000006,"15min":0.54500000000000004},"min":{"1min":0.378,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.69699999999999995,"5min":0.80100000000000005,"15min":1.399},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.55700000000000005,"15min":0.58299999999999996},"min":{"1min":0.38800000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.84799999999999998,"5min":0.89500000000000002,"15min":2.2090000000000001},"last":0.38800000000000001}]},{"osd":1,"last update":"Wed Nov 8 19:30:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.54600000000000004,"15min":0.52200000000000002},"min":{"1min":0.34899999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.66000000000000003,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53500000000000003,"15min":0.50900000000000001},"min":{"1min":0.37,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.37}]},{"osd":2,"last update":"Wed Nov 8 19:30:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57999999999999996,"15min":0.61699999999999999},"min":{"1min":0.34000000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73099999999999998,"5min":0.80800000000000005,"15min":2.8490000000000002},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57399999999999995,"15min":0.53900000000000003},"min":{"1min":0.41799999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.752,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.50800000000000001}]},{"osd":3,"last update":"Wed Nov 8 19:30:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60899999999999999,"15min":0.57999999999999996},"min":{"1min":0.433,"5min":0.371,"15min":0.371},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.433},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.628,"15min":0.69399999999999995},"min":{"1min":0.41399999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.81899999999999995,"5min":0.86199999999999999,"15min":3.4849999999999999},"last":0.41399999999999998}]},{"osd":5,"last update":"Wed Nov 8 19:30:07 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.47799999999999998,"15min":0.50700000000000001},"min":{"1min":0.32900000000000001,"5min":0.314,"15min":0.313},"max":{"1min":0.63900000000000001,"5min":0.746,"15min":0.91500000000000004},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.54100000000000004,"15min":0.55300000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.32300000000000001},"max":{"1min":0.78900000000000003,"5min":0.79100000000000004,"15min":0.90500000000000003},"last":0.46800000000000003}]},{"osd":6,"last update":"Wed Nov 8 19:30:07 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.52900000000000003,"15min":0.65500000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.68700000000000006,"5min":0.80300000000000005,"15min":4.1529999999999996},"last":0.5},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.57399999999999995,"15min":0.59999999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.94099999999999995},"last":0.48899999999999999}]},{"osd":7,"last update":"Wed Nov 8 19:30:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54900000000000004,"15min":0.56399999999999995},"min":{"1min":0.40999999999999998,"5min":0.39500000000000002,"15min":0.34499999999999997},"max":{"1min":0.70099999999999996,"5min":0.77800000000000002,"15min":0.99399999999999999},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.63200000000000001,"15min":0.78300000000000003},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.76300000000000001,"5min":0.85199999999999998,"15min":5.5359999999999996},"last":0.44400000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574939,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28368,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343472,"statfs":{"total":96636764160,"available":96607715328,"internally_reserved":0,"allocated":1376256,"data_stored":703350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:30:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52900000000000003,"15min":0.54200000000000004},"min":{"1min":0.311,"5min":0.30399999999999999,"15min":0.26000000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":2.2360000000000002},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.54400000000000004,"15min":0.52800000000000002},"min":{"1min":0.371,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.71299999999999997,"5min":0.77900000000000003,"15min":0.878},"last":0.46899999999999997}]},{"osd":1,"last update":"Wed Nov 8 19:30:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.59099999999999997,"15min":0.56000000000000005},"min":{"1min":0.39400000000000002,"5min":0.28000000000000003,"15min":0.27600000000000002},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56699999999999995,"15min":0.59499999999999997},"min":{"1min":0.35999999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":2.2919999999999998},"last":0.41799999999999998}]},{"osd":2,"last update":"Wed Nov 8 19:30:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.55700000000000005,"15min":0.55800000000000005},"min":{"1min":0.39200000000000002,"5min":0.33800000000000002,"15min":0.33000000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56899999999999995,"15min":0.54100000000000004},"min":{"1min":0.39700000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.39700000000000002}]},{"osd":3,"last update":"Wed Nov 8 19:30:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.57099999999999995,"15min":0.56100000000000005},"min":{"1min":0.41099999999999998,"5min":0.36699999999999999,"15min":0.35099999999999998},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58699999999999997,"15min":0.57799999999999996},"min":{"1min":0.38800000000000001,"5min":0.35599999999999998,"15min":0.34399999999999997},"max":{"1min":0.71799999999999997,"5min":0.76500000000000001,"15min":0.89900000000000002},"last":0.495}]},{"osd":4,"last update":"Wed Nov 8 19:30:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.49399999999999999,"15min":0.56599999999999995},"min":{"1min":0.32300000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.753,"5min":0.81200000000000006,"15min":2.3300000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59899999999999998,"15min":0.623},"min":{"1min":0.41999999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.74099999999999999,"5min":0.77300000000000002,"15min":0.92300000000000004},"last":0.61599999999999999}]},{"osd":6,"last update":"Wed Nov 8 19:30:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.51600000000000001,"15min":0.56000000000000005},"min":{"1min":0.36599999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.68700000000000006,"5min":0.76300000000000001,"15min":0.89400000000000002},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.54600000000000004,"15min":0.629},"min":{"1min":0.38400000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.73799999999999999,"5min":0.80500000000000005,"15min":2.3650000000000002},"last":0.64000000000000001}]},{"osd":7,"last update":"Wed Nov 8 19:30:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57399999999999995,"15min":0.61099999999999999},"min":{"1min":0.34799999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.73399999999999999,"5min":0.84499999999999997,"15min":0.88500000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.59699999999999998,"15min":0.63100000000000001},"min":{"1min":0.40500000000000003,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76800000000000002,"5min":0.80700000000000005,"15min":0.873},"last":0.57199999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:30:14.772 INFO:tasks.ceph:pgid 13.c last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.773 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-08T19:22:56.479654+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=22, tm_sec=56, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.774 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2023-11-08T19:24:30.117708+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=24, tm_sec=30, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.774 INFO:tasks.ceph:pgid 12.d last_scrub_stamp 2023-11-08T19:25:45.252340+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=45, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.775 INFO:tasks.ceph:pgid 13.8 last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.775 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2023-11-08T19:24:30.117708+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=24, tm_sec=30, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.775 INFO:tasks.ceph:pgid 12.9 last_scrub_stamp 2023-11-08T19:25:45.252340+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=45, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.776 INFO:tasks.ceph:pgid 13.9 last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.776 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2023-11-08T19:24:30.117708+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=24, tm_sec=30, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.777 INFO:tasks.ceph:pgid 12.8 last_scrub_stamp 2023-11-08T19:25:45.252340+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=45, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.777 INFO:tasks.ceph:pgid 13.a last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.777 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2023-11-08T19:24:30.117708+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=24, tm_sec=30, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.778 INFO:tasks.ceph:pgid 12.b last_scrub_stamp 2023-11-08T19:25:45.252340+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=45, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.778 INFO:tasks.ceph:pgid 13.b last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.779 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2023-11-08T19:24:30.117708+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=24, tm_sec=30, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.779 INFO:tasks.ceph:pgid 12.a last_scrub_stamp 2023-11-08T19:25:45.252340+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=45, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.779 INFO:tasks.ceph:pgid 13.d last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.780 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2023-11-08T19:24:30.117708+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=24, tm_sec=30, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.780 INFO:tasks.ceph:pgid 12.c last_scrub_stamp 2023-11-08T19:25:45.252340+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=45, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.780 INFO:tasks.ceph:pgid 13.e last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.781 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2023-11-08T19:24:30.117708+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=24, tm_sec=30, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.781 INFO:tasks.ceph:pgid 12.f last_scrub_stamp 2023-11-08T19:25:45.252340+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=45, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.782 INFO:tasks.ceph:pgid 13.f last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.782 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2023-11-08T19:24:30.117708+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=24, tm_sec=30, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.782 INFO:tasks.ceph:pgid 12.e last_scrub_stamp 2023-11-08T19:25:45.252340+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=45, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.783 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2023-11-08T19:24:30.117708+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=24, tm_sec=30, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.783 INFO:tasks.ceph:pgid 12.1 last_scrub_stamp 2023-11-08T19:25:45.252340+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=45, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.784 INFO:tasks.ceph:pgid 13.0 last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.784 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2023-11-08T19:24:30.117708+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=24, tm_sec=30, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.784 INFO:tasks.ceph:pgid 12.0 last_scrub_stamp 2023-11-08T19:25:45.252340+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=45, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.785 INFO:tasks.ceph:pgid 13.1 last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.785 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2023-11-08T19:24:30.117708+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=24, tm_sec=30, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.785 INFO:tasks.ceph:pgid 12.3 last_scrub_stamp 2023-11-08T19:25:45.252340+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=45, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.786 INFO:tasks.ceph:pgid 13.2 last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.786 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2023-11-08T19:24:30.117708+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=24, tm_sec=30, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.787 INFO:tasks.ceph:pgid 12.2 last_scrub_stamp 2023-11-08T19:25:45.252340+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=45, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.787 INFO:tasks.ceph:pgid 13.3 last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.788 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2023-11-08T19:24:30.117708+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=24, tm_sec=30, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.788 INFO:tasks.ceph:pgid 12.5 last_scrub_stamp 2023-11-08T19:25:45.252340+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=45, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.788 INFO:tasks.ceph:pgid 13.4 last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.789 INFO:tasks.ceph:pgid 13.5 last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.789 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2023-11-08T19:24:30.117708+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=24, tm_sec=30, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.790 INFO:tasks.ceph:pgid 12.4 last_scrub_stamp 2023-11-08T19:25:45.252340+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=45, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.790 INFO:tasks.ceph:pgid 13.6 last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.790 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2023-11-08T19:24:30.117708+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=24, tm_sec=30, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.791 INFO:tasks.ceph:pgid 12.7 last_scrub_stamp 2023-11-08T19:25:45.252340+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=45, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.791 INFO:tasks.ceph:pgid 13.7 last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.791 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2023-11-08T19:24:30.117708+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=24, tm_sec=30, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.792 INFO:tasks.ceph:pgid 12.6 last_scrub_stamp 2023-11-08T19:25:45.252340+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=45, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.792 INFO:tasks.ceph:pgid 13.18 last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.793 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2023-11-08T19:24:30.117708+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=24, tm_sec=30, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.793 INFO:tasks.ceph:pgid 12.19 last_scrub_stamp 2023-11-08T19:25:45.252340+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=45, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.794 INFO:tasks.ceph:pgid 13.19 last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.794 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2023-11-08T19:24:30.117708+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=24, tm_sec=30, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.794 INFO:tasks.ceph:pgid 12.18 last_scrub_stamp 2023-11-08T19:25:45.252340+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=45, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.795 INFO:tasks.ceph:pgid 13.1a last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.795 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2023-11-08T19:24:30.117708+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=24, tm_sec=30, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.795 INFO:tasks.ceph:pgid 12.1b last_scrub_stamp 2023-11-08T19:25:45.252340+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=45, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.796 INFO:tasks.ceph:pgid 13.1b last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.796 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2023-11-08T19:24:30.117708+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=24, tm_sec=30, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.797 INFO:tasks.ceph:pgid 12.1a last_scrub_stamp 2023-11-08T19:25:45.252340+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=45, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.797 INFO:tasks.ceph:pgid 13.1c last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.797 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2023-11-08T19:24:30.117708+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=24, tm_sec=30, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.798 INFO:tasks.ceph:pgid 12.1d last_scrub_stamp 2023-11-08T19:25:45.252340+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=45, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.798 INFO:tasks.ceph:pgid 13.1d last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.799 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2023-11-08T19:24:30.117708+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=24, tm_sec=30, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.799 INFO:tasks.ceph:pgid 12.1c last_scrub_stamp 2023-11-08T19:25:45.252340+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=45, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.799 INFO:tasks.ceph:pgid 13.1e last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.800 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2023-11-08T19:24:30.117708+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=24, tm_sec=30, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.800 INFO:tasks.ceph:pgid 12.1f last_scrub_stamp 2023-11-08T19:25:45.252340+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=45, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.800 INFO:tasks.ceph:pgid 13.1f last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.801 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2023-11-08T19:24:30.117708+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=24, tm_sec=30, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.802 INFO:tasks.ceph:pgid 12.1e last_scrub_stamp 2023-11-08T19:25:45.252340+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=45, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.802 INFO:tasks.ceph:pgid 13.10 last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.802 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2023-11-08T19:24:30.117708+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=24, tm_sec=30, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.803 INFO:tasks.ceph:pgid 12.11 last_scrub_stamp 2023-11-08T19:25:45.252340+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=45, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.803 INFO:tasks.ceph:pgid 13.11 last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.804 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2023-11-08T19:24:30.117708+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=24, tm_sec=30, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.804 INFO:tasks.ceph:pgid 12.10 last_scrub_stamp 2023-11-08T19:25:45.252340+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=45, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.804 INFO:tasks.ceph:pgid 13.12 last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.805 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2023-11-08T19:24:30.117708+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=24, tm_sec=30, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.805 INFO:tasks.ceph:pgid 12.13 last_scrub_stamp 2023-11-08T19:25:45.252340+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=45, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.806 INFO:tasks.ceph:pgid 13.13 last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.806 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2023-11-08T19:24:30.117708+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=24, tm_sec=30, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.806 INFO:tasks.ceph:pgid 12.12 last_scrub_stamp 2023-11-08T19:25:45.252340+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=45, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.807 INFO:tasks.ceph:pgid 13.14 last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.807 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2023-11-08T19:24:30.117708+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=24, tm_sec=30, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.807 INFO:tasks.ceph:pgid 12.15 last_scrub_stamp 2023-11-08T19:25:45.252340+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=45, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.808 INFO:tasks.ceph:pgid 13.15 last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.808 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2023-11-08T19:24:30.117708+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=24, tm_sec=30, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.809 INFO:tasks.ceph:pgid 12.14 last_scrub_stamp 2023-11-08T19:25:45.252340+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=45, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.809 INFO:tasks.ceph:pgid 13.16 last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.809 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2023-11-08T19:24:30.117708+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=24, tm_sec=30, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.810 INFO:tasks.ceph:pgid 12.17 last_scrub_stamp 2023-11-08T19:25:45.252340+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=45, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.810 INFO:tasks.ceph:pgid 13.17 last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.811 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2023-11-08T19:24:30.117708+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=24, tm_sec=30, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.811 INFO:tasks.ceph:pgid 12.16 last_scrub_stamp 2023-11-08T19:25:45.252340+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=45, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:14.811 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-08T19:30:34.813 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:30:34.947 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:34.945+0000 7f1826acf700 1 Processor -- start 2023-11-08T19:30:34.948 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:34.945+0000 7f1826acf700 1 -- start start 2023-11-08T19:30:34.950 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:34.946+0000 7f1826acf700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f18200cc910 0x7f18200cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:34.951 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:34.946+0000 7f1826acf700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f18200cb130 0x7f182015d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:34.951 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:34.946+0000 7f1826acf700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18200b2f60 con 0x7f18200cc140 2023-11-08T19:30:34.951 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:34.946+0000 7f1826acf700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18200b2430 con 0x7f18200cc910 2023-11-08T19:30:34.952 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:34.946+0000 7f1826acf700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18200cc520 con 0x7f18200cb130 2023-11-08T19:30:34.952 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:34.946+0000 7f181ffff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f18200cc910 0x7f18200cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:34.952 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:34.946+0000 7f182486b700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f18200cc140 0x7f18200b2850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:48212/0 (socket says 172.21.15.149:48212) 2023-11-08T19:30:34.953 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:34.946+0000 7f182486b700 1 -- 172.21.15.149:0/4131370149 learned_addr learned my addr 172.21.15.149:0/4131370149 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:30:34.953 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:34.946+0000 7f181ffff700 1 --2- 172.21.15.149:0/4131370149 >> v2:172.21.15.149:3300/0 conn(0x7f18200cc910 0x7f18200cabf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:46212/0 (socket says 172.21.15.149:46212) 2023-11-08T19:30:34.953 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:34.946+0000 7f182506c700 1 --2- 172.21.15.149:0/4131370149 >> v2:172.21.15.160:3300/0 conn(0x7f18200cb130 0x7f182015d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:34.953 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:34.946+0000 7f181ffff700 1 -- 172.21.15.149:0/4131370149 >> v2:172.21.15.160:3300/0 conn(0x7f18200cb130 msgr2=0x7f182015d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:30:34.954 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:34.946+0000 7f181ffff700 1 --2- 172.21.15.149:0/4131370149 >> v2:172.21.15.160:3300/0 conn(0x7f18200cb130 0x7f182015d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:34.954 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:34.946+0000 7f181ffff700 1 -- 172.21.15.149:0/4131370149 >> v1:172.21.15.149:6789/0 conn(0x7f18200cc140 legacy=0x7f18200b2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:34.954 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:34.946+0000 7f181ffff700 1 -- 172.21.15.149:0/4131370149 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18200cb5e0 con 0x7f18200cc910 2023-11-08T19:30:34.955 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:34.946+0000 7f181ffff700 1 --2- 172.21.15.149:0/4131370149 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f18200cc910 0x7f18200cabf0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f1820071df0 tx=0x7f180c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44233151b46c917 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:34.955 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:34.947+0000 7f181f7fe700 1 -- 172.21.15.149:0/4131370149 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180c011830 con 0x7f18200cc910 2023-11-08T19:30:34.955 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:34.947+0000 7f181f7fe700 1 -- 172.21.15.149:0/4131370149 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f180c011990 con 0x7f18200cc910 2023-11-08T19:30:34.956 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:34.947+0000 7f181f7fe700 1 -- 172.21.15.149:0/4131370149 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180c011d20 con 0x7f18200cc910 2023-11-08T19:30:34.956 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:34.947+0000 7f1826acf700 1 -- 172.21.15.149:0/4131370149 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f18200cc910 msgr2=0x7f18200cabf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:34.956 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:34.947+0000 7f1826acf700 1 --2- 172.21.15.149:0/4131370149 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f18200cc910 0x7f18200cabf0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f1820071df0 tx=0x7f180c009b20 comp rx=0 tx=0).stop 2023-11-08T19:30:34.956 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:34.947+0000 7f1826acf700 1 -- 172.21.15.149:0/4131370149 shutdown_connections 2023-11-08T19:30:34.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:34.947+0000 7f1826acf700 1 --2- 172.21.15.149:0/4131370149 >> v2:172.21.15.160:3300/0 conn(0x7f18200cb130 0x7f182015d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:34.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:34.947+0000 7f1826acf700 1 --2- 172.21.15.149:0/4131370149 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f18200cc910 0x7f18200cabf0 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:34.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:34.947+0000 7f1826acf700 1 -- 172.21.15.149:0/4131370149 >> 172.21.15.149:0/4131370149 conn(0x7f1820099a40 msgr2=0x7f18200d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:34.958 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:34.947+0000 7f1826acf700 1 -- 172.21.15.149:0/4131370149 shutdown_connections 2023-11-08T19:30:34.958 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:34.947+0000 7f1826acf700 1 -- 172.21.15.149:0/4131370149 wait complete. 2023-11-08T19:30:34.958 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:34.949+0000 7f1826acf700 1 Processor -- start 2023-11-08T19:30:34.958 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:34.949+0000 7f1826acf700 1 -- start start 2023-11-08T19:30:34.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:34.950+0000 7f1826acf700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f18200cb130 0x7f18200aef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:34.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:34.950+0000 7f1826acf700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f18200cc140 0x7f18200af470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:34.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:34.950+0000 7f1826acf700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f18200cc910 0x7f18200adbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:34.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:34.950+0000 7f1826acf700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18200c4b30 con 0x7f18200cb130 2023-11-08T19:30:34.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:34.950+0000 7f1826acf700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18200ae7b0 con 0x7f18200cc910 2023-11-08T19:30:34.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:34.950+0000 7f1826acf700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18200c6f60 con 0x7f18200cc140 2023-11-08T19:30:34.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:34.950+0000 7f182486b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f18200cb130 0x7f18200aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:34.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:34.950+0000 7f182486b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f18200cb130 0x7f18200aef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:46216/0 (socket says 172.21.15.149:46216) 2023-11-08T19:30:34.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:34.950+0000 7f182486b700 1 -- 172.21.15.149:0/3888010549 learned_addr learned my addr 172.21.15.149:0/3888010549 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:30:34.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:34.950+0000 7f182506c700 1 --2- 172.21.15.149:0/3888010549 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f18200cc910 0x7f18200adbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:34.965 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:34.950+0000 7f181ffff700 1 --2- 172.21.15.149:0/3888010549 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f18200cc140 0x7f18200af470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:34.965 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:34.950+0000 7f182486b700 1 -- 172.21.15.149:0/3888010549 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f18200cc140 msgr2=0x7f18200af470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:34.965 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:34.950+0000 7f182486b700 1 --2- 172.21.15.149:0/3888010549 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f18200cc140 0x7f18200af470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:34.965 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:34.950+0000 7f182486b700 1 -- 172.21.15.149:0/3888010549 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f18200cc910 msgr2=0x7f18200adbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:34.966 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:34.950+0000 7f182486b700 1 --2- 172.21.15.149:0/3888010549 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f18200cc910 0x7f18200adbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:34.966 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:34.950+0000 7f182486b700 1 -- 172.21.15.149:0/3888010549 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f180c0094a0 con 0x7f18200cb130 2023-11-08T19:30:34.966 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:34.950+0000 7f182506c700 1 --2- 172.21.15.149:0/3888010549 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f18200cc910 0x7f18200adbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T19:30:34.967 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:34.951+0000 7f182486b700 1 --2- 172.21.15.149:0/3888010549 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f18200cb130 0x7f18200aef30 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f181400c700 tx=0x7f181400cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:34.967 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:34.951+0000 7f181d7fa700 1 -- 172.21.15.149:0/3888010549 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18140074e0 con 0x7f18200cb130 2023-11-08T19:30:34.967 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:34.951+0000 7f181d7fa700 1 -- 172.21.15.149:0/3888010549 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1814007640 con 0x7f18200cb130 2023-11-08T19:30:34.967 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:34.951+0000 7f1826acf700 1 -- 172.21.15.149:0/3888010549 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18200c4200 con 0x7f18200cb130 2023-11-08T19:30:34.968 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:34.951+0000 7f181d7fa700 1 -- 172.21.15.149:0/3888010549 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1814005a30 con 0x7f18200cb130 2023-11-08T19:30:34.968 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:34.951+0000 7f1826acf700 1 -- 172.21.15.149:0/3888010549 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18200c47c0 con 0x7f18200cb130 2023-11-08T19:30:34.968 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:34.952+0000 7f1826acf700 1 -- 172.21.15.149:0/3888010549 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18200b1230 con 0x7f18200cb130 2023-11-08T19:30:34.969 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:34.952+0000 7f181d7fa700 1 -- 172.21.15.149:0/3888010549 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1814005b90 con 0x7f18200cb130 2023-11-08T19:30:34.969 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:34.952+0000 7f181d7fa700 1 --2- 172.21.15.149:0/3888010549 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f180406af00 0x7f180406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:34.969 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:34.953+0000 7f181d7fa700 1 -- 172.21.15.149:0/3888010549 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6999+0+0 (secure 0 0 0) 0x7f1814088ea0 con 0x7f18200cb130 2023-11-08T19:30:34.969 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:34.953+0000 7f181ffff700 1 --2- 172.21.15.149:0/3888010549 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f180406af00 0x7f180406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:34.970 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:34.953+0000 7f181ffff700 1 --2- 172.21.15.149:0/3888010549 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f180406af00 0x7f180406d3c0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f1820071df0 tx=0x7f180c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:34.970 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:34.958+0000 7f181d7fa700 1 -- 172.21.15.149:0/3888010549 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1814053b00 con 0x7f18200cb130 2023-11-08T19:30:35.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:35.147+0000 7f1826acf700 1 -- 172.21.15.149:0/3888010549 --> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f18200b1a90 con 0x7f180406af00 2023-11-08T19:30:35.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:35.155+0000 7f181d7fa700 1 -- 172.21.15.149:0/3888010549 <== mgr.4104 v2:172.21.15.149:6832/1929837472 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+292084 (secure 0 0 0) 0x7f180c011b00 con 0x7f180406af00 2023-11-08T19:30:35.161 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:30:35.164 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:35.158+0000 7f1826acf700 1 -- 172.21.15.149:0/3888010549 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f180406af00 msgr2=0x7f180406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:35.164 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:35.158+0000 7f1826acf700 1 --2- 172.21.15.149:0/3888010549 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f180406af00 0x7f180406d3c0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f1820071df0 tx=0x7f180c008030 comp rx=0 tx=0).stop 2023-11-08T19:30:35.164 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:35.158+0000 7f1826acf700 1 -- 172.21.15.149:0/3888010549 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f18200cb130 msgr2=0x7f18200aef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:35.165 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:35.158+0000 7f1826acf700 1 --2- 172.21.15.149:0/3888010549 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f18200cb130 0x7f18200aef30 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f181400c700 tx=0x7f181400cac0 comp rx=0 tx=0).stop 2023-11-08T19:30:35.165 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:35.159+0000 7f1826acf700 1 -- 172.21.15.149:0/3888010549 shutdown_connections 2023-11-08T19:30:35.165 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:35.159+0000 7f1826acf700 1 --2- 172.21.15.149:0/3888010549 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f180406af00 0x7f180406d3c0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:35.166 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:35.159+0000 7f1826acf700 1 --2- 172.21.15.149:0/3888010549 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f18200cc910 0x7f18200adbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:35.166 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:35.159+0000 7f1826acf700 1 --2- 172.21.15.149:0/3888010549 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f18200cb130 0x7f18200aef30 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:35.166 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:35.159+0000 7f1826acf700 1 --2- 172.21.15.149:0/3888010549 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f18200cc140 0x7f18200af470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:35.167 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:35.159+0000 7f1826acf700 1 -- 172.21.15.149:0/3888010549 >> 172.21.15.149:0/3888010549 conn(0x7f1820099a40 msgr2=0x7f182006f670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:35.167 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:35.159+0000 7f1826acf700 1 -- 172.21.15.149:0/3888010549 shutdown_connections 2023-11-08T19:30:35.167 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:35.159+0000 7f1826acf700 1 -- 172.21.15.149:0/3888010549 wait complete. 2023-11-08T19:30:35.167 INFO:teuthology.orchestra.run.smithi149.stderr:dumped all 2023-11-08T19:30:35.173 INFO:teuthology.orchestra.run.smithi149.stdout:{"pg_ready":true,"pg_map":{"version":333,"stamp":"2023-11-08T19:30:34.104386+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":232200,"kb_used_data":11912,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754742520,"statfs":{"total":773094113280,"available":772856340480,"internally_reserved":0,"allocated":12197888,"data_stored":6807536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003309"},"pg_stats":[{"pgid":"13.c","version":"0'0","reported_seq":47,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:11.394514+0000","last_change":"2023-11-08T19:25:47.285071+0000","last_active":"2023-11-08T19:30:11.394514+0000","last_peered":"2023-11-08T19:30:11.394514+0000","last_clean":"2023-11-08T19:30:11.394514+0000","last_became_active":"2023-11-08T19:25:47.284788+0000","last_became_peered":"2023-11-08T19:25:47.284788+0000","last_unstale":"2023-11-08T19:30:11.394514+0000","last_undegraded":"2023-11-08T19:30:11.394514+0000","last_fullsized":"2023-11-08T19:30:11.394514+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"111'119","reported_seq":255,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:16.176739+0000","last_change":"2023-11-08T19:30:16.176798+0000","last_active":"2023-11-08T19:30:16.176739+0000","last_peered":"2023-11-08T19:30:16.176739+0000","last_clean":"2023-11-08T19:30:16.176739+0000","last_became_active":"2023-11-08T19:22:58.053337+0000","last_became_peered":"2023-11-08T19:22:58.053337+0000","last_unstale":"2023-11-08T19:30:16.176739+0000","last_undegraded":"2023-11-08T19:30:16.176739+0000","last_fullsized":"2023-11-08T19:30:16.176739+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'119","last_scrub_stamp":"2023-11-08T19:30:16.176632+0000","last_deep_scrub":"111'119","last_deep_scrub_stamp":"2023-11-08T19:30:16.176632+0000","last_clean_scrub_stamp":"2023-11-08T19:30:16.176632+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:41:41.655108+0000","scrub_duration":0.0052701320000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":78,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:07.175677+0000","last_change":"2023-11-08T19:24:32.530665+0000","last_active":"2023-11-08T19:30:07.175677+0000","last_peered":"2023-11-08T19:30:07.175677+0000","last_clean":"2023-11-08T19:30:07.175677+0000","last_became_active":"2023-11-08T19:24:31.148363+0000","last_became_peered":"2023-11-08T19:24:31.148363+0000","last_unstale":"2023-11-08T19:30:07.175677+0000","last_undegraded":"2023-11-08T19:30:07.175677+0000","last_fullsized":"2023-11-08T19:30:07.175677+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075444200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":54,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:14.406291+0000","last_change":"2023-11-08T19:25:48.371346+0000","last_active":"2023-11-08T19:30:14.406291+0000","last_peered":"2023-11-08T19:30:14.406291+0000","last_clean":"2023-11-08T19:30:14.406291+0000","last_became_active":"2023-11-08T19:25:46.289470+0000","last_became_peered":"2023-11-08T19:25:46.289470+0000","last_unstale":"2023-11-08T19:30:14.406291+0000","last_undegraded":"2023-11-08T19:30:14.406291+0000","last_fullsized":"2023-11-08T19:30:14.406291+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000371219,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":59,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:28.037056+0000","last_change":"2023-11-08T19:30:28.037082+0000","last_active":"2023-11-08T19:30:28.037056+0000","last_peered":"2023-11-08T19:30:28.037056+0000","last_clean":"2023-11-08T19:30:28.037056+0000","last_became_active":"2023-11-08T19:25:47.282922+0000","last_became_peered":"2023-11-08T19:25:47.282922+0000","last_unstale":"2023-11-08T19:30:28.037056+0000","last_undegraded":"2023-11-08T19:30:28.037056+0000","last_fullsized":"2023-11-08T19:30:28.037056+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:28.036969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:28.036969+0000","last_clean_scrub_stamp":"2023-11-08T19:30:28.036969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:26:53.908203+0000","scrub_duration":0.0019860609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":86,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:19.998962+0000","last_change":"2023-11-08T19:30:19.998985+0000","last_active":"2023-11-08T19:30:19.998962+0000","last_peered":"2023-11-08T19:30:19.998962+0000","last_clean":"2023-11-08T19:30:19.998962+0000","last_became_active":"2023-11-08T19:24:31.138598+0000","last_became_peered":"2023-11-08T19:24:31.138598+0000","last_unstale":"2023-11-08T19:30:19.998962+0000","last_undegraded":"2023-11-08T19:30:19.998962+0000","last_fullsized":"2023-11-08T19:30:19.998962+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:19.998879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:19.998879+0000","last_clean_scrub_stamp":"2023-11-08T19:30:19.998879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:18:08.731391+0000","scrub_duration":0.001419371,"objects_trimmed":0,"snaptrim_duration":0.015114824000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":66,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:19.886457+0000","last_change":"2023-11-08T19:30:19.886481+0000","last_active":"2023-11-08T19:30:19.886457+0000","last_peered":"2023-11-08T19:30:19.886457+0000","last_clean":"2023-11-08T19:30:19.886457+0000","last_became_active":"2023-11-08T19:25:46.279007+0000","last_became_peered":"2023-11-08T19:25:46.279007+0000","last_unstale":"2023-11-08T19:30:19.886457+0000","last_undegraded":"2023-11-08T19:30:19.886457+0000","last_fullsized":"2023-11-08T19:30:19.886457+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:19.886330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:19.886330+0000","last_clean_scrub_stamp":"2023-11-08T19:30:19.886330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:27:13.439557+0000","scrub_duration":0.001929435,"objects_trimmed":0,"snaptrim_duration":0.0036813240000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":57,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:29.504740+0000","last_change":"2023-11-08T19:30:29.504765+0000","last_active":"2023-11-08T19:30:29.504740+0000","last_peered":"2023-11-08T19:30:29.504740+0000","last_clean":"2023-11-08T19:30:29.504740+0000","last_became_active":"2023-11-08T19:25:47.284796+0000","last_became_peered":"2023-11-08T19:25:47.284796+0000","last_unstale":"2023-11-08T19:30:29.504740+0000","last_undegraded":"2023-11-08T19:30:29.504740+0000","last_fullsized":"2023-11-08T19:30:29.504740+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:29.504641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:29.504641+0000","last_clean_scrub_stamp":"2023-11-08T19:30:29.504641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:17:32.777171+0000","scrub_duration":0.002043577,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":86,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:14.999935+0000","last_change":"2023-11-08T19:30:14.999954+0000","last_active":"2023-11-08T19:30:14.999935+0000","last_peered":"2023-11-08T19:30:14.999935+0000","last_clean":"2023-11-08T19:30:14.999935+0000","last_became_active":"2023-11-08T19:24:31.142028+0000","last_became_peered":"2023-11-08T19:24:31.142028+0000","last_unstale":"2023-11-08T19:30:14.999935+0000","last_undegraded":"2023-11-08T19:30:14.999935+0000","last_fullsized":"2023-11-08T19:30:14.999935+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:14.999864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:14.999864+0000","last_clean_scrub_stamp":"2023-11-08T19:30:14.999864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:46:08.947796+0000","scrub_duration":0.001067143,"objects_trimmed":0,"snaptrim_duration":0.00067537399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":63,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:28.110765+0000","last_change":"2023-11-08T19:30:28.110801+0000","last_active":"2023-11-08T19:30:28.110765+0000","last_peered":"2023-11-08T19:30:28.110765+0000","last_clean":"2023-11-08T19:30:28.110765+0000","last_became_active":"2023-11-08T19:25:46.288739+0000","last_became_peered":"2023-11-08T19:25:46.288739+0000","last_unstale":"2023-11-08T19:30:28.110765+0000","last_undegraded":"2023-11-08T19:30:28.110765+0000","last_fullsized":"2023-11-08T19:30:28.110765+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:28.110672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:28.110672+0000","last_clean_scrub_stamp":"2023-11-08T19:30:28.110672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:49:10.857315+0000","scrub_duration":0.0014712219999999999,"objects_trimmed":0,"snaptrim_duration":0.0015057530000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":59,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:22.944958+0000","last_change":"2023-11-08T19:30:22.944994+0000","last_active":"2023-11-08T19:30:22.944958+0000","last_peered":"2023-11-08T19:30:22.944958+0000","last_clean":"2023-11-08T19:30:22.944958+0000","last_became_active":"2023-11-08T19:25:47.287494+0000","last_became_peered":"2023-11-08T19:25:47.287494+0000","last_unstale":"2023-11-08T19:30:22.944958+0000","last_undegraded":"2023-11-08T19:30:22.944958+0000","last_fullsized":"2023-11-08T19:30:22.944958+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:22.944836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:22.944836+0000","last_clean_scrub_stamp":"2023-11-08T19:30:22.944836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:13:58.622747+0000","scrub_duration":0.001547238,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":88,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:13.647703+0000","last_change":"2023-11-08T19:30:13.647703+0000","last_active":"2023-11-08T19:30:13.647703+0000","last_peered":"2023-11-08T19:30:13.647703+0000","last_clean":"2023-11-08T19:30:13.647703+0000","last_became_active":"2023-11-08T19:24:31.141367+0000","last_became_peered":"2023-11-08T19:24:31.141367+0000","last_unstale":"2023-11-08T19:30:13.647703+0000","last_undegraded":"2023-11-08T19:30:13.647703+0000","last_fullsized":"2023-11-08T19:30:13.647703+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:13.647567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:13.647567+0000","last_clean_scrub_stamp":"2023-11-08T19:30:13.647567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:51:59.112379+0000","scrub_duration":0.0017188710000000001,"objects_trimmed":0,"snaptrim_duration":0.001335136,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":63,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:30.067419+0000","last_change":"2023-11-08T19:30:30.067450+0000","last_active":"2023-11-08T19:30:30.067419+0000","last_peered":"2023-11-08T19:30:30.067419+0000","last_clean":"2023-11-08T19:30:30.067419+0000","last_became_active":"2023-11-08T19:25:46.289283+0000","last_became_peered":"2023-11-08T19:25:46.289283+0000","last_unstale":"2023-11-08T19:30:30.067419+0000","last_undegraded":"2023-11-08T19:30:30.067419+0000","last_fullsized":"2023-11-08T19:30:30.067419+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:30.067319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:30.067319+0000","last_clean_scrub_stamp":"2023-11-08T19:30:30.067319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:16:49.675631+0000","scrub_duration":0.001437668,"objects_trimmed":0,"snaptrim_duration":0.001274049,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":49,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:13.397290+0000","last_change":"2023-11-08T19:25:47.285353+0000","last_active":"2023-11-08T19:30:13.397290+0000","last_peered":"2023-11-08T19:30:13.397290+0000","last_clean":"2023-11-08T19:30:13.397290+0000","last_became_active":"2023-11-08T19:25:47.285075+0000","last_became_peered":"2023-11-08T19:25:47.285075+0000","last_unstale":"2023-11-08T19:30:13.397290+0000","last_undegraded":"2023-11-08T19:30:13.397290+0000","last_fullsized":"2023-11-08T19:30:13.397290+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":96,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:16.672677+0000","last_change":"2023-11-08T19:30:16.672700+0000","last_active":"2023-11-08T19:30:16.672677+0000","last_peered":"2023-11-08T19:30:16.672677+0000","last_clean":"2023-11-08T19:30:16.672677+0000","last_became_active":"2023-11-08T19:24:31.145329+0000","last_became_peered":"2023-11-08T19:24:31.145329+0000","last_unstale":"2023-11-08T19:30:16.672677+0000","last_undegraded":"2023-11-08T19:30:16.672677+0000","last_fullsized":"2023-11-08T19:30:16.672677+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:16.672581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:16.672581+0000","last_clean_scrub_stamp":"2023-11-08T19:30:16.672581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:23:01.900333+0000","scrub_duration":0.0018379830000000001,"objects_trimmed":0,"snaptrim_duration":0.00049012999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":66,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:20.921021+0000","last_change":"2023-11-08T19:30:20.921044+0000","last_active":"2023-11-08T19:30:20.921021+0000","last_peered":"2023-11-08T19:30:20.921021+0000","last_clean":"2023-11-08T19:30:20.921021+0000","last_became_active":"2023-11-08T19:25:46.282174+0000","last_became_peered":"2023-11-08T19:25:46.282174+0000","last_unstale":"2023-11-08T19:30:20.921021+0000","last_undegraded":"2023-11-08T19:30:20.921021+0000","last_fullsized":"2023-11-08T19:30:20.921021+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:20.920910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:20.920910+0000","last_clean_scrub_stamp":"2023-11-08T19:30:20.920910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:07:53.526415+0000","scrub_duration":0.0014780660000000001,"objects_trimmed":0,"snaptrim_duration":0.000727792,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":54,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:12.895524+0000","last_change":"2023-11-08T19:25:47.287677+0000","last_active":"2023-11-08T19:30:12.895524+0000","last_peered":"2023-11-08T19:30:12.895524+0000","last_clean":"2023-11-08T19:30:12.895524+0000","last_became_active":"2023-11-08T19:25:47.287419+0000","last_became_peered":"2023-11-08T19:25:47.287419+0000","last_unstale":"2023-11-08T19:30:12.895524+0000","last_undegraded":"2023-11-08T19:30:12.895524+0000","last_fullsized":"2023-11-08T19:30:12.895524+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":87,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.749076+0000","last_change":"2023-11-08T19:24:32.140880+0000","last_active":"2023-11-08T19:30:05.749076+0000","last_peered":"2023-11-08T19:30:05.749076+0000","last_clean":"2023-11-08T19:30:05.749076+0000","last_became_active":"2023-11-08T19:24:31.146063+0000","last_became_peered":"2023-11-08T19:24:31.146063+0000","last_unstale":"2023-11-08T19:30:05.749076+0000","last_undegraded":"2023-11-08T19:30:05.749076+0000","last_fullsized":"2023-11-08T19:30:05.749076+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089896300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":56,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:10.888792+0000","last_change":"2023-11-08T19:25:48.374690+0000","last_active":"2023-11-08T19:30:10.888792+0000","last_peered":"2023-11-08T19:30:10.888792+0000","last_clean":"2023-11-08T19:30:10.888792+0000","last_became_active":"2023-11-08T19:25:46.281986+0000","last_became_peered":"2023-11-08T19:25:46.281986+0000","last_unstale":"2023-11-08T19:30:10.888792+0000","last_undegraded":"2023-11-08T19:30:10.888792+0000","last_fullsized":"2023-11-08T19:30:10.888792+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003067771,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":47,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:14.406239+0000","last_change":"2023-11-08T19:25:47.287986+0000","last_active":"2023-11-08T19:30:14.406239+0000","last_peered":"2023-11-08T19:30:14.406239+0000","last_clean":"2023-11-08T19:30:14.406239+0000","last_became_active":"2023-11-08T19:25:47.287560+0000","last_became_peered":"2023-11-08T19:25:47.287560+0000","last_unstale":"2023-11-08T19:30:14.406239+0000","last_undegraded":"2023-11-08T19:30:14.406239+0000","last_fullsized":"2023-11-08T19:30:14.406239+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":78,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:07.173035+0000","last_change":"2023-11-08T19:24:32.530620+0000","last_active":"2023-11-08T19:30:07.173035+0000","last_peered":"2023-11-08T19:30:07.173035+0000","last_clean":"2023-11-08T19:30:07.173035+0000","last_became_active":"2023-11-08T19:24:31.144223+0000","last_became_peered":"2023-11-08T19:24:31.144223+0000","last_unstale":"2023-11-08T19:30:07.173035+0000","last_undegraded":"2023-11-08T19:30:07.173035+0000","last_fullsized":"2023-11-08T19:30:07.173035+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071879799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":69,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:21.808575+0000","last_change":"2023-11-08T19:30:21.808611+0000","last_active":"2023-11-08T19:30:21.808575+0000","last_peered":"2023-11-08T19:30:21.808575+0000","last_clean":"2023-11-08T19:30:21.808575+0000","last_became_active":"2023-11-08T19:25:46.278686+0000","last_became_peered":"2023-11-08T19:25:46.278686+0000","last_unstale":"2023-11-08T19:30:21.808575+0000","last_undegraded":"2023-11-08T19:30:21.808575+0000","last_fullsized":"2023-11-08T19:30:21.808575+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:21.808432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:21.808432+0000","last_clean_scrub_stamp":"2023-11-08T19:30:21.808432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:35:49.484450+0000","scrub_duration":0.0016393169999999999,"objects_trimmed":0,"snaptrim_duration":0.00078409499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":54,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:13.898522+0000","last_change":"2023-11-08T19:25:47.289726+0000","last_active":"2023-11-08T19:30:13.898522+0000","last_peered":"2023-11-08T19:30:13.898522+0000","last_clean":"2023-11-08T19:30:13.898522+0000","last_became_active":"2023-11-08T19:25:47.289362+0000","last_became_peered":"2023-11-08T19:25:47.289362+0000","last_unstale":"2023-11-08T19:30:13.898522+0000","last_undegraded":"2023-11-08T19:30:13.898522+0000","last_fullsized":"2023-11-08T19:30:13.898522+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":77,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:07.387382+0000","last_change":"2023-11-08T19:24:32.147025+0000","last_active":"2023-11-08T19:30:07.387382+0000","last_peered":"2023-11-08T19:30:07.387382+0000","last_clean":"2023-11-08T19:30:07.387382+0000","last_became_active":"2023-11-08T19:24:31.147082+0000","last_became_peered":"2023-11-08T19:24:31.147082+0000","last_unstale":"2023-11-08T19:30:07.387382+0000","last_undegraded":"2023-11-08T19:30:07.387382+0000","last_fullsized":"2023-11-08T19:30:07.387382+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043701599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":56,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:10.888728+0000","last_change":"2023-11-08T19:25:48.374739+0000","last_active":"2023-11-08T19:30:10.888728+0000","last_peered":"2023-11-08T19:30:10.888728+0000","last_clean":"2023-11-08T19:30:10.888728+0000","last_became_active":"2023-11-08T19:25:46.282071+0000","last_became_peered":"2023-11-08T19:25:46.282071+0000","last_unstale":"2023-11-08T19:30:10.888728+0000","last_undegraded":"2023-11-08T19:30:10.888728+0000","last_fullsized":"2023-11-08T19:30:10.888728+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023654909999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":86,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:24.116725+0000","last_change":"2023-11-08T19:30:24.116761+0000","last_active":"2023-11-08T19:30:24.116725+0000","last_peered":"2023-11-08T19:30:24.116725+0000","last_clean":"2023-11-08T19:30:24.116725+0000","last_became_active":"2023-11-08T19:24:31.144795+0000","last_became_peered":"2023-11-08T19:24:31.144795+0000","last_unstale":"2023-11-08T19:30:24.116725+0000","last_undegraded":"2023-11-08T19:30:24.116725+0000","last_fullsized":"2023-11-08T19:30:24.116725+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:24.116622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:24.116622+0000","last_clean_scrub_stamp":"2023-11-08T19:30:24.116622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:11:25.781444+0000","scrub_duration":0.0015405900000000001,"objects_trimmed":0,"snaptrim_duration":0.01495431,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":61,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.746896+0000","last_change":"2023-11-08T19:25:48.283673+0000","last_active":"2023-11-08T19:30:05.746896+0000","last_peered":"2023-11-08T19:30:05.746896+0000","last_clean":"2023-11-08T19:30:05.746896+0000","last_became_active":"2023-11-08T19:25:46.285766+0000","last_became_peered":"2023-11-08T19:25:46.285766+0000","last_unstale":"2023-11-08T19:30:05.746896+0000","last_undegraded":"2023-11-08T19:30:05.746896+0000","last_fullsized":"2023-11-08T19:30:05.746896+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001756748,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":47,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:07.390420+0000","last_change":"2023-11-08T19:25:47.288301+0000","last_active":"2023-11-08T19:30:07.390420+0000","last_peered":"2023-11-08T19:30:07.390420+0000","last_clean":"2023-11-08T19:30:07.390420+0000","last_became_active":"2023-11-08T19:25:47.288027+0000","last_became_peered":"2023-11-08T19:25:47.288027+0000","last_unstale":"2023-11-08T19:30:07.390420+0000","last_undegraded":"2023-11-08T19:30:07.390420+0000","last_fullsized":"2023-11-08T19:30:07.390420+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":86,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:14.200060+0000","last_change":"2023-11-08T19:30:14.200080+0000","last_active":"2023-11-08T19:30:14.200060+0000","last_peered":"2023-11-08T19:30:14.200060+0000","last_clean":"2023-11-08T19:30:14.200060+0000","last_became_active":"2023-11-08T19:24:31.138814+0000","last_became_peered":"2023-11-08T19:24:31.138814+0000","last_unstale":"2023-11-08T19:30:14.200060+0000","last_undegraded":"2023-11-08T19:30:14.200060+0000","last_fullsized":"2023-11-08T19:30:14.200060+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:14.199980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:14.199980+0000","last_clean_scrub_stamp":"2023-11-08T19:30:14.199980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:51:59.664792+0000","scrub_duration":0.0015028369999999999,"objects_trimmed":0,"snaptrim_duration":0.00048136000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":61,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.748336+0000","last_change":"2023-11-08T19:25:48.283572+0000","last_active":"2023-11-08T19:30:05.748336+0000","last_peered":"2023-11-08T19:30:05.748336+0000","last_clean":"2023-11-08T19:30:05.748336+0000","last_became_active":"2023-11-08T19:25:46.271936+0000","last_became_peered":"2023-11-08T19:25:46.271936+0000","last_unstale":"2023-11-08T19:30:05.748336+0000","last_undegraded":"2023-11-08T19:30:05.748336+0000","last_fullsized":"2023-11-08T19:30:05.748336+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00186835,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":54,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.746984+0000","last_change":"2023-11-08T19:25:47.282856+0000","last_active":"2023-11-08T19:30:05.746984+0000","last_peered":"2023-11-08T19:30:05.746984+0000","last_clean":"2023-11-08T19:30:05.746984+0000","last_became_active":"2023-11-08T19:25:47.282594+0000","last_became_peered":"2023-11-08T19:25:47.282594+0000","last_unstale":"2023-11-08T19:30:05.746984+0000","last_undegraded":"2023-11-08T19:30:05.746984+0000","last_fullsized":"2023-11-08T19:30:05.746984+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":89,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:14.808735+0000","last_change":"2023-11-08T19:30:14.808755+0000","last_active":"2023-11-08T19:30:14.808735+0000","last_peered":"2023-11-08T19:30:14.808735+0000","last_clean":"2023-11-08T19:30:14.808735+0000","last_became_active":"2023-11-08T19:24:31.142985+0000","last_became_peered":"2023-11-08T19:24:31.142985+0000","last_unstale":"2023-11-08T19:30:14.808735+0000","last_undegraded":"2023-11-08T19:30:14.808735+0000","last_fullsized":"2023-11-08T19:30:14.808735+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:14.808667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:14.808667+0000","last_clean_scrub_stamp":"2023-11-08T19:30:14.808667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:58:55.493702+0000","scrub_duration":0.0018409399999999999,"objects_trimmed":0,"snaptrim_duration":0.000386048,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":56,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:07.174406+0000","last_change":"2023-11-08T19:25:48.372963+0000","last_active":"2023-11-08T19:30:07.174406+0000","last_peered":"2023-11-08T19:30:07.174406+0000","last_clean":"2023-11-08T19:30:07.174406+0000","last_became_active":"2023-11-08T19:25:46.283263+0000","last_became_peered":"2023-11-08T19:25:46.283263+0000","last_unstale":"2023-11-08T19:30:07.174406+0000","last_undegraded":"2023-11-08T19:30:07.174406+0000","last_fullsized":"2023-11-08T19:30:07.174406+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019848779999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":57,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:25.443260+0000","last_change":"2023-11-08T19:30:25.443287+0000","last_active":"2023-11-08T19:30:25.443260+0000","last_peered":"2023-11-08T19:30:25.443260+0000","last_clean":"2023-11-08T19:30:25.443260+0000","last_became_active":"2023-11-08T19:25:47.284522+0000","last_became_peered":"2023-11-08T19:25:47.284522+0000","last_unstale":"2023-11-08T19:30:25.443260+0000","last_undegraded":"2023-11-08T19:30:25.443260+0000","last_fullsized":"2023-11-08T19:30:25.443260+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:25.443157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:25.443157+0000","last_clean_scrub_stamp":"2023-11-08T19:30:25.443157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:11:41.255817+0000","scrub_duration":0.002105778,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":86,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:30.241577+0000","last_change":"2023-11-08T19:30:30.241614+0000","last_active":"2023-11-08T19:30:30.241577+0000","last_peered":"2023-11-08T19:30:30.241577+0000","last_clean":"2023-11-08T19:30:30.241577+0000","last_became_active":"2023-11-08T19:24:31.144838+0000","last_became_peered":"2023-11-08T19:24:31.144838+0000","last_unstale":"2023-11-08T19:30:30.241577+0000","last_undegraded":"2023-11-08T19:30:30.241577+0000","last_fullsized":"2023-11-08T19:30:30.241577+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:30.241474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:30.241474+0000","last_clean_scrub_stamp":"2023-11-08T19:30:30.241474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:44:33.275938+0000","scrub_duration":0.0015211319999999999,"objects_trimmed":0,"snaptrim_duration":0.00081588799999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":69,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:30.668329+0000","last_change":"2023-11-08T19:30:30.668366+0000","last_active":"2023-11-08T19:30:30.668329+0000","last_peered":"2023-11-08T19:30:30.668329+0000","last_clean":"2023-11-08T19:30:30.668329+0000","last_became_active":"2023-11-08T19:25:46.285588+0000","last_became_peered":"2023-11-08T19:25:46.285588+0000","last_unstale":"2023-11-08T19:30:30.668329+0000","last_undegraded":"2023-11-08T19:30:30.668329+0000","last_fullsized":"2023-11-08T19:30:30.668329+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:30.668221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:30.668221+0000","last_clean_scrub_stamp":"2023-11-08T19:30:30.668221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:54:28.732108+0000","scrub_duration":0.0020941699999999998,"objects_trimmed":0,"snaptrim_duration":0.0023282350000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":49,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:07.174217+0000","last_change":"2023-11-08T19:25:47.283526+0000","last_active":"2023-11-08T19:30:07.174217+0000","last_peered":"2023-11-08T19:30:07.174217+0000","last_clean":"2023-11-08T19:30:07.174217+0000","last_became_active":"2023-11-08T19:25:47.283266+0000","last_became_peered":"2023-11-08T19:25:47.283266+0000","last_unstale":"2023-11-08T19:30:07.174217+0000","last_undegraded":"2023-11-08T19:30:07.174217+0000","last_fullsized":"2023-11-08T19:30:07.174217+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":89,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:15.843994+0000","last_change":"2023-11-08T19:30:15.844049+0000","last_active":"2023-11-08T19:30:15.843994+0000","last_peered":"2023-11-08T19:30:15.843994+0000","last_clean":"2023-11-08T19:30:15.843994+0000","last_became_active":"2023-11-08T19:24:31.141710+0000","last_became_peered":"2023-11-08T19:24:31.141710+0000","last_unstale":"2023-11-08T19:30:15.843994+0000","last_undegraded":"2023-11-08T19:30:15.843994+0000","last_fullsized":"2023-11-08T19:30:15.843994+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:15.843841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:15.843841+0000","last_clean_scrub_stamp":"2023-11-08T19:30:15.843841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:15:48.494842+0000","scrub_duration":0.0022065240000000001,"objects_trimmed":0,"snaptrim_duration":0.000430438,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":61,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.747977+0000","last_change":"2023-11-08T19:25:48.283855+0000","last_active":"2023-11-08T19:30:05.747977+0000","last_peered":"2023-11-08T19:30:05.747977+0000","last_clean":"2023-11-08T19:30:05.747977+0000","last_became_active":"2023-11-08T19:25:46.273336+0000","last_became_peered":"2023-11-08T19:25:46.273336+0000","last_unstale":"2023-11-08T19:30:05.747977+0000","last_undegraded":"2023-11-08T19:30:05.747977+0000","last_fullsized":"2023-11-08T19:30:05.747977+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092577200000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":54,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.745636+0000","last_change":"2023-11-08T19:25:47.282840+0000","last_active":"2023-11-08T19:30:05.745636+0000","last_peered":"2023-11-08T19:30:05.745636+0000","last_clean":"2023-11-08T19:30:05.745636+0000","last_became_active":"2023-11-08T19:25:47.282600+0000","last_became_peered":"2023-11-08T19:25:47.282600+0000","last_unstale":"2023-11-08T19:30:05.745636+0000","last_undegraded":"2023-11-08T19:30:05.745636+0000","last_fullsized":"2023-11-08T19:30:05.745636+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":54,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.748575+0000","last_change":"2023-11-08T19:25:47.285890+0000","last_active":"2023-11-08T19:30:05.748575+0000","last_peered":"2023-11-08T19:30:05.748575+0000","last_clean":"2023-11-08T19:30:05.748575+0000","last_became_active":"2023-11-08T19:25:47.285641+0000","last_became_peered":"2023-11-08T19:25:47.285641+0000","last_unstale":"2023-11-08T19:30:05.748575+0000","last_undegraded":"2023-11-08T19:30:05.748575+0000","last_fullsized":"2023-11-08T19:30:05.748575+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":78,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:07.173092+0000","last_change":"2023-11-08T19:24:32.530895+0000","last_active":"2023-11-08T19:30:07.173092+0000","last_peered":"2023-11-08T19:30:07.173092+0000","last_clean":"2023-11-08T19:30:07.173092+0000","last_became_active":"2023-11-08T19:24:31.146715+0000","last_became_peered":"2023-11-08T19:24:31.146715+0000","last_unstale":"2023-11-08T19:30:07.173092+0000","last_undegraded":"2023-11-08T19:30:07.173092+0000","last_fullsized":"2023-11-08T19:30:07.173092+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081671599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":69,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:19.767755+0000","last_change":"2023-11-08T19:30:19.767800+0000","last_active":"2023-11-08T19:30:19.767755+0000","last_peered":"2023-11-08T19:30:19.767755+0000","last_clean":"2023-11-08T19:30:19.767755+0000","last_became_active":"2023-11-08T19:25:46.285960+0000","last_became_peered":"2023-11-08T19:25:46.285960+0000","last_unstale":"2023-11-08T19:30:19.767755+0000","last_undegraded":"2023-11-08T19:30:19.767755+0000","last_fullsized":"2023-11-08T19:30:19.767755+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:19.767655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:19.767655+0000","last_clean_scrub_stamp":"2023-11-08T19:30:19.767655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:09:29.324502+0000","scrub_duration":0.0020017630000000002,"objects_trimmed":0,"snaptrim_duration":0.00091649099999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":54,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:11.173525+0000","last_change":"2023-11-08T19:25:47.283642+0000","last_active":"2023-11-08T19:30:11.173525+0000","last_peered":"2023-11-08T19:30:11.173525+0000","last_clean":"2023-11-08T19:30:11.173525+0000","last_became_active":"2023-11-08T19:25:47.283360+0000","last_became_peered":"2023-11-08T19:25:47.283360+0000","last_unstale":"2023-11-08T19:30:11.173525+0000","last_undegraded":"2023-11-08T19:30:11.173525+0000","last_fullsized":"2023-11-08T19:30:11.173525+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":87,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.747447+0000","last_change":"2023-11-08T19:24:32.140167+0000","last_active":"2023-11-08T19:30:05.747447+0000","last_peered":"2023-11-08T19:30:05.747447+0000","last_clean":"2023-11-08T19:30:05.747447+0000","last_became_active":"2023-11-08T19:24:31.147181+0000","last_became_peered":"2023-11-08T19:24:31.147181+0000","last_unstale":"2023-11-08T19:30:05.747447+0000","last_undegraded":"2023-11-08T19:30:05.747447+0000","last_fullsized":"2023-11-08T19:30:05.747447+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057135200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":54,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:07.179550+0000","last_change":"2023-11-08T19:25:48.277705+0000","last_active":"2023-11-08T19:30:07.179550+0000","last_peered":"2023-11-08T19:30:07.179550+0000","last_clean":"2023-11-08T19:30:07.179550+0000","last_became_active":"2023-11-08T19:25:46.288848+0000","last_became_peered":"2023-11-08T19:25:46.288848+0000","last_unstale":"2023-11-08T19:30:07.179550+0000","last_undegraded":"2023-11-08T19:30:07.179550+0000","last_fullsized":"2023-11-08T19:30:07.179550+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097653099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":47,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:10.181805+0000","last_change":"2023-11-08T19:25:47.289456+0000","last_active":"2023-11-08T19:30:10.181805+0000","last_peered":"2023-11-08T19:30:10.181805+0000","last_clean":"2023-11-08T19:30:10.181805+0000","last_became_active":"2023-11-08T19:25:47.289177+0000","last_became_peered":"2023-11-08T19:25:47.289177+0000","last_unstale":"2023-11-08T19:30:10.181805+0000","last_undegraded":"2023-11-08T19:30:10.181805+0000","last_fullsized":"2023-11-08T19:30:10.181805+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":87,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.747834+0000","last_change":"2023-11-08T19:24:32.141188+0000","last_active":"2023-11-08T19:30:05.747834+0000","last_peered":"2023-11-08T19:30:05.747834+0000","last_clean":"2023-11-08T19:30:05.747834+0000","last_became_active":"2023-11-08T19:24:31.148857+0000","last_became_peered":"2023-11-08T19:24:31.148857+0000","last_unstale":"2023-11-08T19:30:05.747834+0000","last_undegraded":"2023-11-08T19:30:05.747834+0000","last_fullsized":"2023-11-08T19:30:05.747834+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065078599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":62,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:27.077494+0000","last_change":"2023-11-08T19:30:27.077515+0000","last_active":"2023-11-08T19:30:27.077494+0000","last_peered":"2023-11-08T19:30:27.077494+0000","last_clean":"2023-11-08T19:30:27.077494+0000","last_became_active":"2023-11-08T19:25:46.286211+0000","last_became_peered":"2023-11-08T19:25:46.286211+0000","last_unstale":"2023-11-08T19:30:27.077494+0000","last_undegraded":"2023-11-08T19:30:27.077494+0000","last_fullsized":"2023-11-08T19:30:27.077494+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:27.077406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:27.077406+0000","last_clean_scrub_stamp":"2023-11-08T19:30:27.077406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:53:12.324357+0000","scrub_duration":0.0013463559999999999,"objects_trimmed":0,"snaptrim_duration":0.00073775700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":46,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:07.390065+0000","last_change":"2023-11-08T19:25:47.286020+0000","last_active":"2023-11-08T19:30:07.390065+0000","last_peered":"2023-11-08T19:30:07.390065+0000","last_clean":"2023-11-08T19:30:07.390065+0000","last_became_active":"2023-11-08T19:25:47.285728+0000","last_became_peered":"2023-11-08T19:25:47.285728+0000","last_unstale":"2023-11-08T19:30:07.390065+0000","last_undegraded":"2023-11-08T19:30:07.390065+0000","last_fullsized":"2023-11-08T19:30:07.390065+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":87,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.746599+0000","last_change":"2023-11-08T19:24:32.140832+0000","last_active":"2023-11-08T19:30:05.746599+0000","last_peered":"2023-11-08T19:30:05.746599+0000","last_clean":"2023-11-08T19:30:05.746599+0000","last_became_active":"2023-11-08T19:24:31.146557+0000","last_became_peered":"2023-11-08T19:24:31.146557+0000","last_unstale":"2023-11-08T19:30:05.746599+0000","last_undegraded":"2023-11-08T19:30:05.746599+0000","last_fullsized":"2023-11-08T19:30:05.746599+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099450100000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":63,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:17.302719+0000","last_change":"2023-11-08T19:30:17.302756+0000","last_active":"2023-11-08T19:30:17.302719+0000","last_peered":"2023-11-08T19:30:17.302719+0000","last_clean":"2023-11-08T19:30:17.302719+0000","last_became_active":"2023-11-08T19:25:46.281273+0000","last_became_peered":"2023-11-08T19:25:46.281273+0000","last_unstale":"2023-11-08T19:30:17.302719+0000","last_undegraded":"2023-11-08T19:30:17.302719+0000","last_fullsized":"2023-11-08T19:30:17.302719+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:17.302603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:17.302603+0000","last_clean_scrub_stamp":"2023-11-08T19:30:17.302603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:48:34.591057+0000","scrub_duration":0.002093204,"objects_trimmed":0,"snaptrim_duration":0.0020904819999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":47,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:06.620981+0000","last_change":"2023-11-08T19:25:47.288256+0000","last_active":"2023-11-08T19:30:06.620981+0000","last_peered":"2023-11-08T19:30:06.620981+0000","last_clean":"2023-11-08T19:30:06.620981+0000","last_became_active":"2023-11-08T19:25:47.287905+0000","last_became_peered":"2023-11-08T19:25:47.287905+0000","last_unstale":"2023-11-08T19:30:06.620981+0000","last_undegraded":"2023-11-08T19:30:06.620981+0000","last_fullsized":"2023-11-08T19:30:06.620981+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":78,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:07.174510+0000","last_change":"2023-11-08T19:24:32.530378+0000","last_active":"2023-11-08T19:30:07.174510+0000","last_peered":"2023-11-08T19:30:07.174510+0000","last_clean":"2023-11-08T19:30:07.174510+0000","last_became_active":"2023-11-08T19:24:31.144341+0000","last_became_peered":"2023-11-08T19:24:31.144341+0000","last_unstale":"2023-11-08T19:30:07.174510+0000","last_undegraded":"2023-11-08T19:30:07.174510+0000","last_fullsized":"2023-11-08T19:30:07.174510+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058308299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":61,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:19.065453+0000","last_change":"2023-11-08T19:30:19.065507+0000","last_active":"2023-11-08T19:30:19.065453+0000","last_peered":"2023-11-08T19:30:19.065453+0000","last_clean":"2023-11-08T19:30:19.065453+0000","last_became_active":"2023-11-08T19:25:46.286933+0000","last_became_peered":"2023-11-08T19:25:46.286933+0000","last_unstale":"2023-11-08T19:30:19.065453+0000","last_undegraded":"2023-11-08T19:30:19.065453+0000","last_fullsized":"2023-11-08T19:30:19.065453+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:19.065292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:19.065292+0000","last_clean_scrub_stamp":"2023-11-08T19:30:19.065292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:02:38.548129+0000","scrub_duration":0.0020157859999999999,"objects_trimmed":0,"snaptrim_duration":0.00080507500000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":46,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:07.178294+0000","last_change":"2023-11-08T19:25:47.282986+0000","last_active":"2023-11-08T19:30:07.178294+0000","last_peered":"2023-11-08T19:30:07.178294+0000","last_clean":"2023-11-08T19:30:07.178294+0000","last_became_active":"2023-11-08T19:25:47.282705+0000","last_became_peered":"2023-11-08T19:25:47.282705+0000","last_unstale":"2023-11-08T19:30:07.178294+0000","last_undegraded":"2023-11-08T19:30:07.178294+0000","last_fullsized":"2023-11-08T19:30:07.178294+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":86,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:13.025216+0000","last_change":"2023-11-08T19:30:13.025246+0000","last_active":"2023-11-08T19:30:13.025216+0000","last_peered":"2023-11-08T19:30:13.025216+0000","last_clean":"2023-11-08T19:30:13.025216+0000","last_became_active":"2023-11-08T19:24:31.143812+0000","last_became_peered":"2023-11-08T19:24:31.143812+0000","last_unstale":"2023-11-08T19:30:13.025216+0000","last_undegraded":"2023-11-08T19:30:13.025216+0000","last_fullsized":"2023-11-08T19:30:13.025216+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:13.025137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:13.025137+0000","last_clean_scrub_stamp":"2023-11-08T19:30:13.025137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:10:48.396169+0000","scrub_duration":0.0011907409999999999,"objects_trimmed":0,"snaptrim_duration":0.014956126,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":60,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.750453+0000","last_change":"2023-11-08T19:25:48.284435+0000","last_active":"2023-11-08T19:30:05.750453+0000","last_peered":"2023-11-08T19:30:05.750453+0000","last_clean":"2023-11-08T19:30:05.750453+0000","last_became_active":"2023-11-08T19:25:46.284288+0000","last_became_peered":"2023-11-08T19:25:46.284288+0000","last_unstale":"2023-11-08T19:30:05.750453+0000","last_undegraded":"2023-11-08T19:30:05.750453+0000","last_fullsized":"2023-11-08T19:30:05.750453+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001250894,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":53,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.750412+0000","last_change":"2023-11-08T19:25:47.282612+0000","last_active":"2023-11-08T19:30:05.750412+0000","last_peered":"2023-11-08T19:30:05.750412+0000","last_clean":"2023-11-08T19:30:05.750412+0000","last_became_active":"2023-11-08T19:25:47.282299+0000","last_became_peered":"2023-11-08T19:25:47.282299+0000","last_unstale":"2023-11-08T19:30:05.750412+0000","last_undegraded":"2023-11-08T19:30:05.750412+0000","last_fullsized":"2023-11-08T19:30:05.750412+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":85,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:19.177045+0000","last_change":"2023-11-08T19:30:19.177082+0000","last_active":"2023-11-08T19:30:19.177045+0000","last_peered":"2023-11-08T19:30:19.177045+0000","last_clean":"2023-11-08T19:30:19.177045+0000","last_became_active":"2023-11-08T19:24:31.147384+0000","last_became_peered":"2023-11-08T19:24:31.147384+0000","last_unstale":"2023-11-08T19:30:19.177045+0000","last_undegraded":"2023-11-08T19:30:19.177045+0000","last_fullsized":"2023-11-08T19:30:19.177045+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:19.176943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:19.176943+0000","last_clean_scrub_stamp":"2023-11-08T19:30:19.176943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:39:08.064436+0000","scrub_duration":0.00154301,"objects_trimmed":0,"snaptrim_duration":0.00043834899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":60,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.746749+0000","last_change":"2023-11-08T19:25:48.283541+0000","last_active":"2023-11-08T19:30:05.746749+0000","last_peered":"2023-11-08T19:30:05.746749+0000","last_clean":"2023-11-08T19:30:05.746749+0000","last_became_active":"2023-11-08T19:25:46.285626+0000","last_became_peered":"2023-11-08T19:25:46.285626+0000","last_unstale":"2023-11-08T19:30:05.746749+0000","last_undegraded":"2023-11-08T19:30:05.746749+0000","last_fullsized":"2023-11-08T19:30:05.746749+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019032459999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":53,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.745505+0000","last_change":"2023-11-08T19:25:47.287878+0000","last_active":"2023-11-08T19:30:05.745505+0000","last_peered":"2023-11-08T19:30:05.745505+0000","last_clean":"2023-11-08T19:30:05.745505+0000","last_became_active":"2023-11-08T19:25:47.287617+0000","last_became_peered":"2023-11-08T19:25:47.287617+0000","last_unstale":"2023-11-08T19:30:05.745505+0000","last_undegraded":"2023-11-08T19:30:05.745505+0000","last_fullsized":"2023-11-08T19:30:05.745505+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":96,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:28.670362+0000","last_change":"2023-11-08T19:30:28.670399+0000","last_active":"2023-11-08T19:30:28.670362+0000","last_peered":"2023-11-08T19:30:28.670362+0000","last_clean":"2023-11-08T19:30:28.670362+0000","last_became_active":"2023-11-08T19:24:31.144614+0000","last_became_peered":"2023-11-08T19:24:31.144614+0000","last_unstale":"2023-11-08T19:30:28.670362+0000","last_undegraded":"2023-11-08T19:30:28.670362+0000","last_fullsized":"2023-11-08T19:30:28.670362+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:28.670235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:28.670235+0000","last_clean_scrub_stamp":"2023-11-08T19:30:28.670235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:38:02.285835+0000","scrub_duration":0.0020853949999999999,"objects_trimmed":0,"snaptrim_duration":0.00050362200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":55,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:07.175176+0000","last_change":"2023-11-08T19:25:48.373636+0000","last_active":"2023-11-08T19:30:07.175176+0000","last_peered":"2023-11-08T19:30:07.175176+0000","last_clean":"2023-11-08T19:30:07.175176+0000","last_became_active":"2023-11-08T19:25:46.283803+0000","last_became_peered":"2023-11-08T19:25:46.283803+0000","last_unstale":"2023-11-08T19:30:07.175176+0000","last_undegraded":"2023-11-08T19:30:07.175176+0000","last_fullsized":"2023-11-08T19:30:07.175176+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002404855,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":46,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:07.390190+0000","last_change":"2023-11-08T19:25:47.287741+0000","last_active":"2023-11-08T19:30:07.390190+0000","last_peered":"2023-11-08T19:30:07.390190+0000","last_clean":"2023-11-08T19:30:07.390190+0000","last_became_active":"2023-11-08T19:25:47.287428+0000","last_became_peered":"2023-11-08T19:25:47.287428+0000","last_unstale":"2023-11-08T19:30:07.390190+0000","last_undegraded":"2023-11-08T19:30:07.390190+0000","last_fullsized":"2023-11-08T19:30:07.390190+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":85,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:21.174293+0000","last_change":"2023-11-08T19:30:21.174318+0000","last_active":"2023-11-08T19:30:21.174293+0000","last_peered":"2023-11-08T19:30:21.174293+0000","last_clean":"2023-11-08T19:30:21.174293+0000","last_became_active":"2023-11-08T19:24:31.146176+0000","last_became_peered":"2023-11-08T19:24:31.146176+0000","last_unstale":"2023-11-08T19:30:21.174293+0000","last_undegraded":"2023-11-08T19:30:21.174293+0000","last_fullsized":"2023-11-08T19:30:21.174293+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:21.174179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:21.174179+0000","last_clean_scrub_stamp":"2023-11-08T19:30:21.174179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:36:32.308961+0000","scrub_duration":0.001410056,"objects_trimmed":0,"snaptrim_duration":0.00048481000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":55,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:07.175611+0000","last_change":"2023-11-08T19:25:48.373345+0000","last_active":"2023-11-08T19:30:07.175611+0000","last_peered":"2023-11-08T19:30:07.175611+0000","last_clean":"2023-11-08T19:30:07.175611+0000","last_became_active":"2023-11-08T19:25:46.282460+0000","last_became_peered":"2023-11-08T19:25:46.282460+0000","last_unstale":"2023-11-08T19:30:07.175611+0000","last_undegraded":"2023-11-08T19:30:07.175611+0000","last_fullsized":"2023-11-08T19:30:07.175611+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001972863,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":54,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.747447+0000","last_change":"2023-11-08T19:25:47.283708+0000","last_active":"2023-11-08T19:30:05.747447+0000","last_peered":"2023-11-08T19:30:05.747447+0000","last_clean":"2023-11-08T19:30:05.747447+0000","last_became_active":"2023-11-08T19:25:47.283433+0000","last_became_peered":"2023-11-08T19:25:47.283433+0000","last_unstale":"2023-11-08T19:30:05.747447+0000","last_undegraded":"2023-11-08T19:30:05.747447+0000","last_fullsized":"2023-11-08T19:30:05.747447+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":86,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:18.021092+0000","last_change":"2023-11-08T19:30:18.021136+0000","last_active":"2023-11-08T19:30:18.021092+0000","last_peered":"2023-11-08T19:30:18.021092+0000","last_clean":"2023-11-08T19:30:18.021092+0000","last_became_active":"2023-11-08T19:24:31.142052+0000","last_became_peered":"2023-11-08T19:24:31.142052+0000","last_unstale":"2023-11-08T19:30:18.021092+0000","last_undegraded":"2023-11-08T19:30:18.021092+0000","last_fullsized":"2023-11-08T19:30:18.021092+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:18.020983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:18.020983+0000","last_clean_scrub_stamp":"2023-11-08T19:30:18.020983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:45.925711+0000","scrub_duration":0.001444657,"objects_trimmed":0,"snaptrim_duration":0.014881058000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":69,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:20.763205+0000","last_change":"2023-11-08T19:30:20.763230+0000","last_active":"2023-11-08T19:30:20.763205+0000","last_peered":"2023-11-08T19:30:20.763205+0000","last_clean":"2023-11-08T19:30:20.763205+0000","last_became_active":"2023-11-08T19:25:46.279287+0000","last_became_peered":"2023-11-08T19:25:46.279287+0000","last_unstale":"2023-11-08T19:30:20.763205+0000","last_undegraded":"2023-11-08T19:30:20.763205+0000","last_fullsized":"2023-11-08T19:30:20.763205+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:20.763104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:20.763104+0000","last_clean_scrub_stamp":"2023-11-08T19:30:20.763104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:14:02.974290+0000","scrub_duration":0.0021986850000000001,"objects_trimmed":0,"snaptrim_duration":0.00076856899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":54,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.748679+0000","last_change":"2023-11-08T19:25:47.285867+0000","last_active":"2023-11-08T19:30:05.748679+0000","last_peered":"2023-11-08T19:30:05.748679+0000","last_clean":"2023-11-08T19:30:05.748679+0000","last_became_active":"2023-11-08T19:25:47.285533+0000","last_became_peered":"2023-11-08T19:25:47.285533+0000","last_unstale":"2023-11-08T19:30:05.748679+0000","last_undegraded":"2023-11-08T19:30:05.748679+0000","last_fullsized":"2023-11-08T19:30:05.748679+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":85,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:28.080532+0000","last_change":"2023-11-08T19:30:28.080567+0000","last_active":"2023-11-08T19:30:28.080532+0000","last_peered":"2023-11-08T19:30:28.080532+0000","last_clean":"2023-11-08T19:30:28.080532+0000","last_became_active":"2023-11-08T19:24:31.148250+0000","last_became_peered":"2023-11-08T19:24:31.148250+0000","last_unstale":"2023-11-08T19:30:28.080532+0000","last_undegraded":"2023-11-08T19:30:28.080532+0000","last_fullsized":"2023-11-08T19:30:28.080532+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:28.080403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:28.080403+0000","last_clean_scrub_stamp":"2023-11-08T19:30:28.080403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:55.985131+0000","scrub_duration":0.0019137889999999999,"objects_trimmed":0,"snaptrim_duration":0.00043061299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":61,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.747447+0000","last_change":"2023-11-08T19:25:48.284869+0000","last_active":"2023-11-08T19:30:05.747447+0000","last_peered":"2023-11-08T19:30:05.747447+0000","last_clean":"2023-11-08T19:30:05.747447+0000","last_became_active":"2023-11-08T19:25:46.285478+0000","last_became_peered":"2023-11-08T19:25:46.285478+0000","last_unstale":"2023-11-08T19:30:05.747447+0000","last_undegraded":"2023-11-08T19:30:05.747447+0000","last_fullsized":"2023-11-08T19:30:05.747447+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000376339,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":47,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:11.394538+0000","last_change":"2023-11-08T19:25:47.284429+0000","last_active":"2023-11-08T19:30:11.394538+0000","last_peered":"2023-11-08T19:30:11.394538+0000","last_clean":"2023-11-08T19:30:11.394538+0000","last_became_active":"2023-11-08T19:25:47.283990+0000","last_became_peered":"2023-11-08T19:25:47.283990+0000","last_unstale":"2023-11-08T19:30:11.394538+0000","last_undegraded":"2023-11-08T19:30:11.394538+0000","last_fullsized":"2023-11-08T19:30:11.394538+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":96,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:17.692059+0000","last_change":"2023-11-08T19:30:17.692093+0000","last_active":"2023-11-08T19:30:17.692059+0000","last_peered":"2023-11-08T19:30:17.692059+0000","last_clean":"2023-11-08T19:30:17.692059+0000","last_became_active":"2023-11-08T19:24:31.147651+0000","last_became_peered":"2023-11-08T19:24:31.147651+0000","last_unstale":"2023-11-08T19:30:17.692059+0000","last_undegraded":"2023-11-08T19:30:17.692059+0000","last_fullsized":"2023-11-08T19:30:17.692059+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:17.691961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:17.691961+0000","last_clean_scrub_stamp":"2023-11-08T19:30:17.691961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:09:27.248808+0000","scrub_duration":0.001464531,"objects_trimmed":0,"snaptrim_duration":0.00043673300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":64,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:24.455713+0000","last_change":"2023-11-08T19:30:24.455713+0000","last_active":"2023-11-08T19:30:24.455713+0000","last_peered":"2023-11-08T19:30:24.455713+0000","last_clean":"2023-11-08T19:30:24.455713+0000","last_became_active":"2023-11-08T19:25:46.282307+0000","last_became_peered":"2023-11-08T19:25:46.282307+0000","last_unstale":"2023-11-08T19:30:24.455713+0000","last_undegraded":"2023-11-08T19:30:24.455713+0000","last_fullsized":"2023-11-08T19:30:24.455713+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:24.455579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:24.455579+0000","last_clean_scrub_stamp":"2023-11-08T19:30:24.455579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:54:59.466934+0000","scrub_duration":0.0015672119999999999,"objects_trimmed":0,"snaptrim_duration":0.00047078400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":47,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:11.394543+0000","last_change":"2023-11-08T19:25:47.284227+0000","last_active":"2023-11-08T19:30:11.394543+0000","last_peered":"2023-11-08T19:30:11.394543+0000","last_clean":"2023-11-08T19:30:11.394543+0000","last_became_active":"2023-11-08T19:25:47.283927+0000","last_became_peered":"2023-11-08T19:25:47.283927+0000","last_unstale":"2023-11-08T19:30:11.394543+0000","last_undegraded":"2023-11-08T19:30:11.394543+0000","last_fullsized":"2023-11-08T19:30:11.394543+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":78,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:07.173026+0000","last_change":"2023-11-08T19:24:32.530168+0000","last_active":"2023-11-08T19:30:07.173026+0000","last_peered":"2023-11-08T19:30:07.173026+0000","last_clean":"2023-11-08T19:30:07.173026+0000","last_became_active":"2023-11-08T19:24:31.144329+0000","last_became_peered":"2023-11-08T19:24:31.144329+0000","last_unstale":"2023-11-08T19:30:07.173026+0000","last_undegraded":"2023-11-08T19:30:07.173026+0000","last_fullsized":"2023-11-08T19:30:07.173026+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043484799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":56,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:10.888834+0000","last_change":"2023-11-08T19:25:48.371291+0000","last_active":"2023-11-08T19:30:10.888834+0000","last_peered":"2023-11-08T19:30:10.888834+0000","last_clean":"2023-11-08T19:30:10.888834+0000","last_became_active":"2023-11-08T19:25:46.281425+0000","last_became_peered":"2023-11-08T19:25:46.281425+0000","last_unstale":"2023-11-08T19:30:10.888834+0000","last_undegraded":"2023-11-08T19:30:10.888834+0000","last_fullsized":"2023-11-08T19:30:10.888834+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00124314,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":49,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:10.888808+0000","last_change":"2023-11-08T19:25:47.281724+0000","last_active":"2023-11-08T19:30:10.888808+0000","last_peered":"2023-11-08T19:30:10.888808+0000","last_clean":"2023-11-08T19:30:10.888808+0000","last_became_active":"2023-11-08T19:25:47.281425+0000","last_became_peered":"2023-11-08T19:25:47.281425+0000","last_unstale":"2023-11-08T19:30:10.888808+0000","last_undegraded":"2023-11-08T19:30:10.888808+0000","last_fullsized":"2023-11-08T19:30:10.888808+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":86,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:24.251328+0000","last_change":"2023-11-08T19:30:24.251351+0000","last_active":"2023-11-08T19:30:24.251328+0000","last_peered":"2023-11-08T19:30:24.251328+0000","last_clean":"2023-11-08T19:30:24.251328+0000","last_became_active":"2023-11-08T19:24:31.146260+0000","last_became_peered":"2023-11-08T19:24:31.146260+0000","last_unstale":"2023-11-08T19:30:24.251328+0000","last_undegraded":"2023-11-08T19:30:24.251328+0000","last_fullsized":"2023-11-08T19:30:24.251328+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:24.251241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:24.251241+0000","last_clean_scrub_stamp":"2023-11-08T19:30:24.251241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:48:47.364880+0000","scrub_duration":0.0021896609999999999,"objects_trimmed":0,"snaptrim_duration":0.00059842900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":62,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:21.078147+0000","last_change":"2023-11-08T19:30:21.078147+0000","last_active":"2023-11-08T19:30:21.078147+0000","last_peered":"2023-11-08T19:30:21.078147+0000","last_clean":"2023-11-08T19:30:21.078147+0000","last_became_active":"2023-11-08T19:25:46.286239+0000","last_became_peered":"2023-11-08T19:25:46.286239+0000","last_unstale":"2023-11-08T19:30:21.078147+0000","last_undegraded":"2023-11-08T19:30:21.078147+0000","last_fullsized":"2023-11-08T19:30:21.078147+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:21.078003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:21.078003+0000","last_clean_scrub_stamp":"2023-11-08T19:30:21.078003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:54:56.089359+0000","scrub_duration":0.001463238,"objects_trimmed":0,"snaptrim_duration":0.000722421,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":47,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:14.406240+0000","last_change":"2023-11-08T19:25:47.287874+0000","last_active":"2023-11-08T19:30:14.406240+0000","last_peered":"2023-11-08T19:30:14.406240+0000","last_clean":"2023-11-08T19:30:14.406240+0000","last_became_active":"2023-11-08T19:25:47.287456+0000","last_became_peered":"2023-11-08T19:25:47.287456+0000","last_unstale":"2023-11-08T19:30:14.406240+0000","last_undegraded":"2023-11-08T19:30:14.406240+0000","last_fullsized":"2023-11-08T19:30:14.406240+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":95,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:26.782952+0000","last_change":"2023-11-08T19:30:26.782978+0000","last_active":"2023-11-08T19:30:26.782952+0000","last_peered":"2023-11-08T19:30:26.782952+0000","last_clean":"2023-11-08T19:30:26.782952+0000","last_became_active":"2023-11-08T19:24:31.146154+0000","last_became_peered":"2023-11-08T19:24:31.146154+0000","last_unstale":"2023-11-08T19:30:26.782952+0000","last_undegraded":"2023-11-08T19:30:26.782952+0000","last_fullsized":"2023-11-08T19:30:26.782952+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:26.782839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:26.782839+0000","last_clean_scrub_stamp":"2023-11-08T19:30:26.782839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:28:53.767924+0000","scrub_duration":0.0015358430000000001,"objects_trimmed":0,"snaptrim_duration":0.00082432800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":55,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:12.394787+0000","last_change":"2023-11-08T19:25:48.372729+0000","last_active":"2023-11-08T19:30:12.394787+0000","last_peered":"2023-11-08T19:30:12.394787+0000","last_clean":"2023-11-08T19:30:12.394787+0000","last_became_active":"2023-11-08T19:25:46.290114+0000","last_became_peered":"2023-11-08T19:25:46.290114+0000","last_unstale":"2023-11-08T19:30:12.394787+0000","last_undegraded":"2023-11-08T19:30:12.394787+0000","last_fullsized":"2023-11-08T19:30:12.394787+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061009499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":49,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:10.888842+0000","last_change":"2023-11-08T19:25:47.283046+0000","last_active":"2023-11-08T19:30:10.888842+0000","last_peered":"2023-11-08T19:30:10.888842+0000","last_clean":"2023-11-08T19:30:10.888842+0000","last_became_active":"2023-11-08T19:25:47.282763+0000","last_became_peered":"2023-11-08T19:25:47.282763+0000","last_unstale":"2023-11-08T19:30:10.888842+0000","last_undegraded":"2023-11-08T19:30:10.888842+0000","last_fullsized":"2023-11-08T19:30:10.888842+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":87,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:16.159719+0000","last_change":"2023-11-08T19:30:16.159719+0000","last_active":"2023-11-08T19:30:16.159719+0000","last_peered":"2023-11-08T19:30:16.159719+0000","last_clean":"2023-11-08T19:30:16.159719+0000","last_became_active":"2023-11-08T19:24:31.139062+0000","last_became_peered":"2023-11-08T19:24:31.139062+0000","last_unstale":"2023-11-08T19:30:16.159719+0000","last_undegraded":"2023-11-08T19:30:16.159719+0000","last_fullsized":"2023-11-08T19:30:16.159719+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:16.159602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:16.159602+0000","last_clean_scrub_stamp":"2023-11-08T19:30:16.159602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:23:15.468689+0000","scrub_duration":0.00144932,"objects_trimmed":0,"snaptrim_duration":0.00033682599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":60,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.747753+0000","last_change":"2023-11-08T19:25:48.283302+0000","last_active":"2023-11-08T19:30:05.747753+0000","last_peered":"2023-11-08T19:30:05.747753+0000","last_clean":"2023-11-08T19:30:05.747753+0000","last_became_active":"2023-11-08T19:25:46.284287+0000","last_became_peered":"2023-11-08T19:25:46.284287+0000","last_unstale":"2023-11-08T19:30:05.747753+0000","last_undegraded":"2023-11-08T19:30:05.747753+0000","last_fullsized":"2023-11-08T19:30:05.747753+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097880800000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":53,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.748725+0000","last_change":"2023-11-08T19:25:47.286434+0000","last_active":"2023-11-08T19:30:05.748725+0000","last_peered":"2023-11-08T19:30:05.748725+0000","last_clean":"2023-11-08T19:30:05.748725+0000","last_became_active":"2023-11-08T19:25:47.286181+0000","last_became_peered":"2023-11-08T19:25:47.286181+0000","last_unstale":"2023-11-08T19:30:05.748725+0000","last_undegraded":"2023-11-08T19:30:05.748725+0000","last_fullsized":"2023-11-08T19:30:05.748725+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":87,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.749165+0000","last_change":"2023-11-08T19:24:32.140514+0000","last_active":"2023-11-08T19:30:05.749165+0000","last_peered":"2023-11-08T19:30:05.749165+0000","last_clean":"2023-11-08T19:30:05.749165+0000","last_became_active":"2023-11-08T19:24:31.146668+0000","last_became_peered":"2023-11-08T19:24:31.146668+0000","last_unstale":"2023-11-08T19:30:05.749165+0000","last_undegraded":"2023-11-08T19:30:05.749165+0000","last_fullsized":"2023-11-08T19:30:05.749165+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:24:30.117708+0000","last_clean_scrub_stamp":"2023-11-08T19:24:30.117708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071576699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":64,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:20.518808+0000","last_change":"2023-11-08T19:30:20.518808+0000","last_active":"2023-11-08T19:30:20.518808+0000","last_peered":"2023-11-08T19:30:20.518808+0000","last_clean":"2023-11-08T19:30:20.518808+0000","last_became_active":"2023-11-08T19:25:46.290246+0000","last_became_peered":"2023-11-08T19:25:46.290246+0000","last_unstale":"2023-11-08T19:30:20.518808+0000","last_undegraded":"2023-11-08T19:30:20.518808+0000","last_fullsized":"2023-11-08T19:30:20.518808+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:20.518679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:20.518679+0000","last_clean_scrub_stamp":"2023-11-08T19:30:20.518679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:17:45.315742+0000","scrub_duration":0.0021647609999999999,"objects_trimmed":0,"snaptrim_duration":0.000423211,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":47,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:06.621216+0000","last_change":"2023-11-08T19:25:47.287717+0000","last_active":"2023-11-08T19:30:06.621216+0000","last_peered":"2023-11-08T19:30:06.621216+0000","last_clean":"2023-11-08T19:30:06.621216+0000","last_became_active":"2023-11-08T19:25:47.287412+0000","last_became_peered":"2023-11-08T19:25:47.287412+0000","last_unstale":"2023-11-08T19:30:06.621216+0000","last_undegraded":"2023-11-08T19:30:06.621216+0000","last_fullsized":"2023-11-08T19:30:06.621216+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":87,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:17.588716+0000","last_change":"2023-11-08T19:30:17.588739+0000","last_active":"2023-11-08T19:30:17.588716+0000","last_peered":"2023-11-08T19:30:17.588716+0000","last_clean":"2023-11-08T19:30:17.588716+0000","last_became_active":"2023-11-08T19:24:31.144912+0000","last_became_peered":"2023-11-08T19:24:31.144912+0000","last_unstale":"2023-11-08T19:30:17.588716+0000","last_undegraded":"2023-11-08T19:30:17.588716+0000","last_fullsized":"2023-11-08T19:30:17.588716+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:17.588625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:17.588625+0000","last_clean_scrub_stamp":"2023-11-08T19:30:17.588625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:23:16.897713+0000","scrub_duration":0.0017421800000000001,"objects_trimmed":0,"snaptrim_duration":0.00056686900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":60,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.749166+0000","last_change":"2023-11-08T19:25:48.285205+0000","last_active":"2023-11-08T19:30:05.749166+0000","last_peered":"2023-11-08T19:30:05.749166+0000","last_clean":"2023-11-08T19:30:05.749166+0000","last_became_active":"2023-11-08T19:25:46.285848+0000","last_became_peered":"2023-11-08T19:25:46.285848+0000","last_unstale":"2023-11-08T19:30:05.749166+0000","last_undegraded":"2023-11-08T19:30:05.749166+0000","last_fullsized":"2023-11-08T19:30:05.749166+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089732199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":48,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.755365+0000","last_change":"2023-11-08T19:25:47.280177+0000","last_active":"2023-11-08T19:30:05.755365+0000","last_peered":"2023-11-08T19:30:05.755365+0000","last_clean":"2023-11-08T19:30:05.755365+0000","last_became_active":"2023-11-08T19:25:47.279913+0000","last_became_peered":"2023-11-08T19:25:47.279913+0000","last_unstale":"2023-11-08T19:30:05.755365+0000","last_undegraded":"2023-11-08T19:30:05.755365+0000","last_fullsized":"2023-11-08T19:30:05.755365+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":86,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:17.139218+0000","last_change":"2023-11-08T19:30:17.139240+0000","last_active":"2023-11-08T19:30:17.139218+0000","last_peered":"2023-11-08T19:30:17.139218+0000","last_clean":"2023-11-08T19:30:17.139218+0000","last_became_active":"2023-11-08T19:24:31.149011+0000","last_became_peered":"2023-11-08T19:24:31.149011+0000","last_unstale":"2023-11-08T19:30:17.139218+0000","last_undegraded":"2023-11-08T19:30:17.139218+0000","last_fullsized":"2023-11-08T19:30:17.139218+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:17.139115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:17.139115+0000","last_clean_scrub_stamp":"2023-11-08T19:30:17.139115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:46:23.961331+0000","scrub_duration":0.0019318580000000001,"objects_trimmed":0,"snaptrim_duration":0.00033496900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":60,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.747041+0000","last_change":"2023-11-08T19:25:48.285075+0000","last_active":"2023-11-08T19:30:05.747041+0000","last_peered":"2023-11-08T19:30:05.747041+0000","last_clean":"2023-11-08T19:30:05.747041+0000","last_became_active":"2023-11-08T19:25:46.272479+0000","last_became_peered":"2023-11-08T19:25:46.272479+0000","last_unstale":"2023-11-08T19:30:05.747041+0000","last_undegraded":"2023-11-08T19:30:05.747041+0000","last_fullsized":"2023-11-08T19:30:05.747041+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001158117,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574943,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28940,"kb_used_data":1924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342900,"statfs":{"total":96636764160,"available":96607129600,"internally_reserved":0,"allocated":1970176,"data_stored":1293718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:30:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.58199999999999996,"15min":0.55300000000000005},"min":{"1min":0.51500000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.502},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.59599999999999997,"15min":0.57399999999999995},"min":{"1min":0.42899999999999999,"5min":0.38500000000000001,"15min":0.377},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.67900000000000005}]},{"osd":1,"last update":"Wed Nov 8 19:30:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.56299999999999994,"15min":0.55100000000000005},"min":{"1min":0.48699999999999999,"5min":0.309,"15min":0.309},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56000000000000005,"15min":0.54000000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.37},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.57899999999999996}]},{"osd":2,"last update":"Wed Nov 8 19:30:14 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55300000000000005,"15min":0.52200000000000002},"min":{"1min":0.45400000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.56999999999999995,"15min":0.54500000000000004},"min":{"1min":0.42899999999999999,"5min":0.379,"15min":0.32400000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.76600000000000001}]},{"osd":3,"last update":"Wed Nov 8 19:30:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.55600000000000005,"15min":0.54000000000000004},"min":{"1min":0.42599999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.58899999999999997,"15min":0.56799999999999995},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.36899999999999999},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.71699999999999997}]},{"osd":4,"last update":"Wed Nov 8 19:30:14 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48899999999999999,"15min":0.48499999999999999},"min":{"1min":0.36099999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70499999999999996,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51300000000000001,"15min":0.51600000000000001},"min":{"1min":0.39500000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.66300000000000003}]},{"osd":5,"last update":"Wed Nov 8 19:30:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.35499999999999998,"5min":0.35399999999999998,"15min":0.35099999999999998},"max":{"1min":0.79100000000000004,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.55100000000000005,"15min":0.56999999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.91100000000000003},"last":0.748}]},{"osd":6,"last update":"Wed Nov 8 19:30:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.59299999999999997,"15min":0.60599999999999998},"min":{"1min":0.42299999999999999,"5min":0.40000000000000002,"15min":0.39300000000000002},"max":{"1min":0.72199999999999998,"5min":0.80400000000000005,"15min":0.86399999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57799999999999996,"15min":0.56799999999999995},"min":{"1min":0.378,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.80800000000000005,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.73599999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574944,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28360,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343480,"statfs":{"total":96636764160,"available":96607723520,"internally_reserved":0,"allocated":1376256,"data_stored":703350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:30:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.54400000000000004,"15min":0.58399999999999996},"min":{"1min":0.33000000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.79300000000000004,"5min":0.82199999999999995,"15min":1.7549999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55000000000000004,"15min":0.57799999999999996},"min":{"1min":0.39100000000000001,"5min":0.313,"15min":0.28699999999999998},"max":{"1min":0.746,"5min":0.76800000000000002,"15min":1.478},"last":0.64000000000000001}]},{"osd":1,"last update":"Wed Nov 8 19:30:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57999999999999996,"15min":0.59799999999999998},"min":{"1min":0.372,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.76200000000000001,"5min":0.77500000000000002,"15min":1.6619999999999999},"last":0.443},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.628,"15min":0.65500000000000003},"min":{"1min":0.46300000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":1.649},"last":0.67100000000000004}]},{"osd":2,"last update":"Wed Nov 8 19:30:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.58999999999999997,"15min":0.56999999999999995},"min":{"1min":0.38600000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.60099999999999998,"15min":0.623},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.85399999999999998},"last":0.65500000000000003}]},{"osd":3,"last update":"Wed Nov 8 19:30:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.57099999999999995,"15min":0.60999999999999999},"min":{"1min":0.41899999999999998,"5min":0.36699999999999999,"15min":0.33500000000000002},"max":{"1min":0.77500000000000002,"5min":0.80300000000000005,"15min":1.766},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.56799999999999995,"15min":0.60399999999999998},"min":{"1min":0.44900000000000001,"5min":0.375,"15min":0.36699999999999999},"max":{"1min":0.78600000000000003,"5min":0.84399999999999997,"15min":1.8580000000000001},"last":0.68300000000000005}]},{"osd":4,"last update":"Wed Nov 8 19:30:09 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.51800000000000002,"15min":0.53300000000000003},"min":{"1min":0.318,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.755,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54600000000000004,"15min":0.56899999999999995},"min":{"1min":0.35199999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.82299999999999995,"5min":0.83499999999999996,"15min":0.89100000000000001},"last":0.58599999999999997}]},{"osd":5,"last update":"Wed Nov 8 19:30:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.53000000000000003,"15min":0.55600000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.57099999999999995,"15min":0.61499999999999999},"min":{"1min":0.40200000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.60799999999999998}]},{"osd":7,"last update":"Wed Nov 8 19:30:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.58299999999999996,"15min":0.60399999999999998},"min":{"1min":0.374,"5min":0.312,"15min":0.312},"max":{"1min":0.85299999999999998,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.58699999999999997,"15min":0.628},"min":{"1min":0.46200000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.95099999999999996},"last":0.56999999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574943,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28360,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343480,"statfs":{"total":96636764160,"available":96607723520,"internally_reserved":0,"allocated":1376256,"data_stored":703350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:30:02 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.35799999999999998},"min":{"1min":0.247,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.46899999999999997,"5min":0.51200000000000001,"15min":1.2090000000000001},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.376,"5min":0.35899999999999999,"15min":0.39700000000000002},"min":{"1min":0.23599999999999999,"5min":0.22900000000000001,"15min":0.19700000000000001},"max":{"1min":0.49299999999999999,"5min":0.61599999999999999,"15min":2.1850000000000001},"last":0.33600000000000002}]},{"osd":2,"last update":"Wed Nov 8 19:30:02 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.35099999999999998,"15min":0.34799999999999998},"min":{"1min":0.26400000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.438,"5min":0.54400000000000004,"15min":0.59099999999999997},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.38700000000000001,"15min":0.39400000000000002},"min":{"1min":0.28299999999999997,"5min":0.253,"15min":0.24099999999999999},"max":{"1min":0.56000000000000005,"5min":0.623,"15min":1.2689999999999999},"last":0.377}]},{"osd":3,"last update":"Wed Nov 8 19:30:02 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.41199999999999998,"15min":0.41799999999999998},"min":{"1min":0.32400000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.622,"5min":0.63100000000000001,"15min":1.24},"last":0.433},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.39900000000000002,"15min":0.44400000000000001},"min":{"1min":0.30599999999999999,"5min":0.26100000000000001,"15min":0.253},"max":{"1min":0.54500000000000004,"5min":0.68200000000000005,"15min":2.2120000000000002},"last":0.45500000000000002}]},{"osd":4,"last update":"Wed Nov 8 19:30:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.59299999999999997,"15min":0.60799999999999998},"min":{"1min":0.42399999999999999,"5min":0.36899999999999999,"15min":0.32100000000000001},"max":{"1min":0.82299999999999995,"5min":0.93400000000000005,"15min":2.1579999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.58899999999999997,"15min":0.57399999999999995},"min":{"1min":0.438,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.78200000000000003,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.54100000000000004}]},{"osd":5,"last update":"Wed Nov 8 19:30:02 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.59499999999999997,"15min":0.57099999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.38100000000000001},"max":{"1min":0.78300000000000003,"5min":0.82599999999999996,"15min":0.86399999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59599999999999997,"15min":0.60499999999999998},"min":{"1min":0.437,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77300000000000002,"5min":0.90800000000000003,"15min":1.115},"last":0.505}]},{"osd":6,"last update":"Wed Nov 8 19:30:02 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.60099999999999998,"15min":0.628},"min":{"1min":0.40500000000000003,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.76800000000000002,"5min":0.88400000000000001,"15min":2.093},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.435,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.752,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.57099999999999995}]},{"osd":7,"last update":"Wed Nov 8 19:30:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.621,"15min":0.65700000000000003},"min":{"1min":0.44600000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.80300000000000005,"5min":0.876,"15min":1.591},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61099999999999999,"15min":0.66800000000000004},"min":{"1min":0.49299999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.77900000000000003,"5min":0.88400000000000001,"15min":2.1299999999999999},"last":0.63200000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574943,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33100,"kb_used_data":1924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338740,"statfs":{"total":96636764160,"available":96602869760,"internally_reserved":0,"allocated":1970176,"data_stored":1293718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:30:11 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.42399999999999999,"15min":0.90400000000000003},"min":{"1min":0.25700000000000001,"5min":0.19500000000000001,"15min":0.192},"max":{"1min":0.53100000000000003,"5min":6.9509999999999996,"15min":19.295999999999999},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.372,"15min":0.82199999999999995},"min":{"1min":0.27400000000000002,"5min":0.222,"15min":0.222},"max":{"1min":0.54900000000000004,"5min":0.57399999999999995,"15min":17.204000000000001},"last":0.46200000000000002}]},{"osd":2,"last update":"Wed Nov 8 19:30:11 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.45300000000000001,"15min":0.56799999999999995},"min":{"1min":0.26500000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.503,"5min":6.8029999999999999,"15min":6.8029999999999999},"last":0.442},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.41499999999999998,"15min":0.86399999999999999},"min":{"1min":0.311,"5min":0.28999999999999998,"15min":0.23100000000000001},"max":{"1min":0.59799999999999998,"5min":1.3140000000000001,"15min":17.175000000000001},"last":0.52500000000000002}]},{"osd":3,"last update":"Wed Nov 8 19:30:11 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.53500000000000003,"15min":0.79700000000000004},"min":{"1min":0.26400000000000001,"5min":0.24399999999999999,"15min":0.22500000000000001},"max":{"1min":0.52200000000000002,"5min":16.661000000000001,"15min":16.661000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.432,"5min":0.496,"15min":0.433},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.255},"max":{"1min":0.57499999999999996,"5min":6.9859999999999998,"15min":6.9859999999999998},"last":0.50600000000000001}]},{"osd":4,"last update":"Wed Nov 8 19:30:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.61199999999999999,"15min":1.0249999999999999},"min":{"1min":0.49099999999999999,"5min":0.36699999999999999,"15min":0.313},"max":{"1min":0.755,"5min":1.0029999999999999,"15min":17.056000000000001},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.75700000000000001,"15min":0.75},"min":{"1min":0.438,"5min":0.33100000000000002,"15min":0.33000000000000002},"max":{"1min":0.75600000000000001,"5min":16.718,"15min":16.718},"last":0.74399999999999999}]},{"osd":5,"last update":"Wed Nov 8 19:30:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.752,"15min":0.75},"min":{"1min":0.45300000000000001,"5min":0.36199999999999999,"15min":0.35799999999999998},"max":{"1min":0.79400000000000004,"5min":16.609000000000002,"15min":16.609000000000002},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.67200000000000004,"15min":0.60099999999999998},"min":{"1min":0.42799999999999999,"5min":0.40100000000000002,"15min":0.34599999999999997},"max":{"1min":0.76700000000000002,"5min":5.1639999999999997,"15min":5.1639999999999997},"last":0.89700000000000002}]},{"osd":6,"last update":"Wed Nov 8 19:30:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.69499999999999995,"15min":0.63500000000000001},"min":{"1min":0.47999999999999998,"5min":0.42699999999999999,"15min":0.36599999999999999},"max":{"1min":0.74099999999999999,"5min":6.6349999999999998,"15min":6.6349999999999998},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.66500000000000004,"15min":1.0740000000000001},"min":{"1min":0.52400000000000002,"5min":0.42199999999999999,"15min":0.34899999999999998},"max":{"1min":0.74299999999999999,"5min":3.1400000000000001,"15min":17.111999999999998},"last":0.88300000000000001}]},{"osd":7,"last update":"Wed Nov 8 19:30:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65000000000000002,"15min":1.079},"min":{"1min":0.55400000000000005,"5min":0.43099999999999999,"15min":0.376},"max":{"1min":0.77700000000000002,"5min":1.0760000000000001,"15min":17.146000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.622,"5min":0.76700000000000002,"15min":0.76200000000000001},"min":{"1min":0.495,"5min":0.441,"15min":0.38800000000000001},"max":{"1min":0.78100000000000003,"5min":16.690999999999999,"15min":16.690999999999999},"last":0.76800000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574943,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28360,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343480,"statfs":{"total":96636764160,"available":96607723520,"internally_reserved":0,"allocated":1376256,"data_stored":703350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:30:17 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.33700000000000002,"15min":0.432},"min":{"1min":0.253,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.436,"5min":0.61299999999999999,"15min":3.4100000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.39000000000000001,"15min":0.47399999999999998},"min":{"1min":0.22,"5min":0.219,"15min":0.21199999999999999},"max":{"1min":0.68000000000000005,"5min":1.8340000000000001,"15min":3.4369999999999998},"last":0.49099999999999999}]},{"osd":1,"last update":"Wed Nov 8 19:30:17 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.38100000000000001,"15min":0.498},"min":{"1min":0.27400000000000002,"5min":0.24299999999999999,"15min":0.23599999999999999},"max":{"1min":0.504,"5min":0.60699999999999998,"15min":4.0679999999999996},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.44,"15min":0.54900000000000004},"min":{"1min":0.34499999999999997,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.59399999999999997,"5min":0.71899999999999997,"15min":4.3499999999999996},"last":0.56999999999999995}]},{"osd":3,"last update":"Wed Nov 8 19:30:17 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.40300000000000002,"15min":0.497},"min":{"1min":0.28799999999999998,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.53200000000000003,"5min":0.82999999999999996,"15min":3.8580000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.38,"5min":0.38500000000000001,"15min":0.47299999999999998},"min":{"1min":0.248,"5min":0.217,"15min":0.217},"max":{"1min":0.52700000000000002,"5min":0.78500000000000003,"15min":3.476},"last":0.64300000000000002}]},{"osd":4,"last update":"Wed Nov 8 19:30:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.64200000000000002,"15min":0.69499999999999995},"min":{"1min":0.41099999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.79400000000000004,"5min":4.7990000000000004,"15min":4.7990000000000004},"last":0.879},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.57799999999999996,"15min":0.68700000000000006},"min":{"1min":0.41999999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.753,"5min":0.872,"15min":4.1040000000000001},"last":0.76800000000000002}]},{"osd":5,"last update":"Wed Nov 8 19:30:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.59799999999999998,"15min":0.69899999999999995},"min":{"1min":0.38900000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.80800000000000005,"5min":0.88,"15min":4.0869999999999997},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.63800000000000001,"15min":0.71399999999999997},"min":{"1min":0.39700000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.71899999999999997,"5min":4.8239999999999998,"15min":4.8239999999999998},"last":0.86399999999999999}]},{"osd":6,"last update":"Wed Nov 8 19:30:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.60299999999999998,"15min":0.71199999999999997},"min":{"1min":0.379,"5min":0.375,"15min":0.375},"max":{"1min":0.755,"5min":1.1200000000000001,"15min":4.1399999999999997},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.59899999999999998,"15min":0.69199999999999995},"min":{"1min":0.38,"5min":0.374,"15min":0.374},"max":{"1min":0.80600000000000005,"5min":0.85599999999999998,"15min":4.0499999999999998},"last":0.72599999999999998}]},{"osd":7,"last update":"Wed Nov 8 19:30:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.626,"15min":0.72699999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.78800000000000003,"5min":0.877,"15min":4.157},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.64500000000000002,"15min":0.753},"min":{"1min":0.45300000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.77300000000000002,"5min":0.95599999999999996,"15min":4.1710000000000003},"last":0.78600000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574943,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28360,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343480,"statfs":{"total":96636764160,"available":96607723520,"internally_reserved":0,"allocated":1376256,"data_stored":703350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:30:06 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.375,"15min":0.38200000000000001},"min":{"1min":0.24299999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.57599999999999996,"5min":0.67100000000000004,"15min":1.458},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39600000000000002},"min":{"1min":0.26900000000000002,"5min":0.192,"15min":0.192},"max":{"1min":0.57899999999999996,"5min":0.626,"15min":1.3939999999999999},"last":0.41299999999999998}]},{"osd":1,"last update":"Wed Nov 8 19:30:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.40100000000000002,"15min":0.40799999999999997},"min":{"1min":0.27200000000000002,"5min":0.25900000000000001,"15min":0.245},"max":{"1min":0.57099999999999995,"5min":0.61199999999999999,"15min":1.512},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.41599999999999998,"15min":0.437},"min":{"1min":0.29699999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.55800000000000005,"5min":0.59999999999999998,"15min":1.5580000000000001},"last":0.46100000000000002}]},{"osd":2,"last update":"Wed Nov 8 19:30:06 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.377,"15min":0.377},"min":{"1min":0.25600000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.50600000000000001,"5min":1.1100000000000001,"15min":1.2030000000000001},"last":0.371},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.40100000000000002,"15min":0.41999999999999998},"min":{"1min":0.29599999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.54900000000000004,"5min":0.72399999999999998,"15min":1.536},"last":0.434}]},{"osd":4,"last update":"Wed Nov 8 19:30:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61499999999999999,"15min":0.61799999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.36799999999999999},"max":{"1min":0.77500000000000002,"5min":0.86199999999999999,"15min":1.3400000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.628,"15min":0.61599999999999999},"min":{"1min":0.40500000000000003,"5min":0.371,"15min":0.371},"max":{"1min":0.81799999999999995,"5min":0.84999999999999998,"15min":1.153},"last":0.60399999999999998}]},{"osd":5,"last update":"Wed Nov 8 19:30:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.58999999999999997,"15min":0.59099999999999997},"min":{"1min":0.46899999999999997,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.78900000000000003,"5min":0.84999999999999998,"15min":1.4870000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.58399999999999996,"15min":0.59699999999999998},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.74199999999999999,"5min":0.82799999999999996,"15min":1.3129999999999999},"last":0.66800000000000004}]},{"osd":6,"last update":"Wed Nov 8 19:30:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58099999999999996,"15min":0.57999999999999996},"min":{"1min":0.38400000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.80700000000000005,"5min":0.86799999999999999,"15min":1.113},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60399999999999998,"15min":0.60999999999999999},"min":{"1min":0.442,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.82199999999999995,"5min":0.85899999999999999,"15min":1.4139999999999999},"last":0.56100000000000005}]},{"osd":7,"last update":"Wed Nov 8 19:30:06 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.61599999999999999,"15min":0.63700000000000001},"min":{"1min":0.42999999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.84799999999999998,"5min":0.89300000000000002,"15min":1.3680000000000001},"last":0.622},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.64000000000000001,"15min":0.625},"min":{"1min":0.47799999999999998,"5min":0.45700000000000002,"15min":0.42299999999999999},"max":{"1min":0.86099999999999999,"5min":0.89000000000000001,"15min":1.179},"last":0.495}]}]},{"osd":4,"up_from":13,"seq":55834574943,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28360,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343480,"statfs":{"total":96636764160,"available":96607723520,"internally_reserved":0,"allocated":1376256,"data_stored":703350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:30:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.56200000000000006,"15min":0.54500000000000004},"min":{"1min":0.378,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.69699999999999995,"5min":0.80100000000000005,"15min":1.399},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.55700000000000005,"15min":0.58299999999999996},"min":{"1min":0.38800000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.84799999999999998,"5min":0.89500000000000002,"15min":2.2090000000000001},"last":0.629}]},{"osd":1,"last update":"Wed Nov 8 19:30:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.54600000000000004,"15min":0.52200000000000002},"min":{"1min":0.34899999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.66000000000000003,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53500000000000003,"15min":0.50900000000000001},"min":{"1min":0.37,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.57899999999999996}]},{"osd":2,"last update":"Wed Nov 8 19:30:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57999999999999996,"15min":0.61699999999999999},"min":{"1min":0.34000000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73099999999999998,"5min":0.80800000000000005,"15min":2.8490000000000002},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57399999999999995,"15min":0.53900000000000003},"min":{"1min":0.41799999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.752,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.61499999999999999}]},{"osd":3,"last update":"Wed Nov 8 19:30:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60899999999999999,"15min":0.57999999999999996},"min":{"1min":0.433,"5min":0.371,"15min":0.371},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.628,"15min":0.69399999999999995},"min":{"1min":0.41399999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.81899999999999995,"5min":0.86199999999999999,"15min":3.4849999999999999},"last":0.59399999999999997}]},{"osd":5,"last update":"Wed Nov 8 19:30:07 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.47799999999999998,"15min":0.50700000000000001},"min":{"1min":0.32900000000000001,"5min":0.314,"15min":0.313},"max":{"1min":0.63900000000000001,"5min":0.746,"15min":0.91500000000000004},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.54100000000000004,"15min":0.55300000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.32300000000000001},"max":{"1min":0.78900000000000003,"5min":0.79100000000000004,"15min":0.90500000000000003},"last":0.49299999999999999}]},{"osd":6,"last update":"Wed Nov 8 19:30:07 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.52900000000000003,"15min":0.65500000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.68700000000000006,"5min":0.80300000000000005,"15min":4.1529999999999996},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.57399999999999995,"15min":0.59999999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.94099999999999995},"last":0.65000000000000002}]},{"osd":7,"last update":"Wed Nov 8 19:30:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54900000000000004,"15min":0.56399999999999995},"min":{"1min":0.40999999999999998,"5min":0.39500000000000002,"15min":0.34499999999999997},"max":{"1min":0.70099999999999996,"5min":0.77800000000000002,"15min":0.99399999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.63200000000000001,"15min":0.78300000000000003},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.76300000000000001,"5min":0.85199999999999998,"15min":5.5359999999999996},"last":0.66400000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574943,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28360,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343480,"statfs":{"total":96636764160,"available":96607723520,"internally_reserved":0,"allocated":1376256,"data_stored":703350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:30:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52900000000000003,"15min":0.54200000000000004},"min":{"1min":0.311,"5min":0.30399999999999999,"15min":0.26000000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":2.2360000000000002},"last":0.31},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.54400000000000004,"15min":0.52800000000000002},"min":{"1min":0.371,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.71299999999999997,"5min":0.77900000000000003,"15min":0.878},"last":0.58699999999999997}]},{"osd":1,"last update":"Wed Nov 8 19:30:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.59099999999999997,"15min":0.56000000000000005},"min":{"1min":0.39400000000000002,"5min":0.28000000000000003,"15min":0.27600000000000002},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56699999999999995,"15min":0.59499999999999997},"min":{"1min":0.35999999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":2.2919999999999998},"last":0.54100000000000004}]},{"osd":2,"last update":"Wed Nov 8 19:30:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.55700000000000005,"15min":0.55800000000000005},"min":{"1min":0.39200000000000002,"5min":0.33800000000000002,"15min":0.33000000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56899999999999995,"15min":0.54100000000000004},"min":{"1min":0.39700000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.51000000000000001}]},{"osd":3,"last update":"Wed Nov 8 19:30:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.57099999999999995,"15min":0.56100000000000005},"min":{"1min":0.41099999999999998,"5min":0.36699999999999999,"15min":0.35099999999999998},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58699999999999997,"15min":0.57799999999999996},"min":{"1min":0.38800000000000001,"5min":0.35599999999999998,"15min":0.34399999999999997},"max":{"1min":0.71799999999999997,"5min":0.76500000000000001,"15min":0.89900000000000002},"last":0.63500000000000001}]},{"osd":4,"last update":"Wed Nov 8 19:30:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.49399999999999999,"15min":0.56599999999999995},"min":{"1min":0.32300000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.753,"5min":0.81200000000000006,"15min":2.3300000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59899999999999998,"15min":0.623},"min":{"1min":0.41999999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.74099999999999999,"5min":0.77300000000000002,"15min":0.92300000000000004},"last":0.65800000000000003}]},{"osd":6,"last update":"Wed Nov 8 19:30:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.51600000000000001,"15min":0.56000000000000005},"min":{"1min":0.36599999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.68700000000000006,"5min":0.76300000000000001,"15min":0.89400000000000002},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.54600000000000004,"15min":0.629},"min":{"1min":0.38400000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.73799999999999999,"5min":0.80500000000000005,"15min":2.3650000000000002},"last":0.67200000000000004}]},{"osd":7,"last update":"Wed Nov 8 19:30:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57399999999999995,"15min":0.61099999999999999},"min":{"1min":0.34799999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.73399999999999999,"5min":0.84499999999999997,"15min":0.88500000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.59699999999999998,"15min":0.63100000000000001},"min":{"1min":0.40500000000000003,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76800000000000002,"5min":0.80700000000000005,"15min":0.873},"last":0.68600000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:30:35.180 INFO:tasks.ceph:pgid 13.c last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:35.181 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2023-11-08T19:24:30.117708+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=24, tm_sec=30, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:35.181 INFO:tasks.ceph:pgid 12.d last_scrub_stamp 2023-11-08T19:25:45.252340+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=45, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:35.182 INFO:tasks.ceph:pgid 13.b last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:35.182 INFO:tasks.ceph:pgid 13.d last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:35.183 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2023-11-08T19:24:30.117708+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=24, tm_sec=30, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:35.183 INFO:tasks.ceph:pgid 12.c last_scrub_stamp 2023-11-08T19:25:45.252340+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=45, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:35.183 INFO:tasks.ceph:pgid 13.e last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:35.184 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2023-11-08T19:24:30.117708+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=24, tm_sec=30, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:35.184 INFO:tasks.ceph:pgid 13.f last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:35.185 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2023-11-08T19:24:30.117708+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=24, tm_sec=30, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:35.185 INFO:tasks.ceph:pgid 12.e last_scrub_stamp 2023-11-08T19:25:45.252340+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=45, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:35.186 INFO:tasks.ceph:pgid 12.1 last_scrub_stamp 2023-11-08T19:25:45.252340+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=45, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:35.186 INFO:tasks.ceph:pgid 13.0 last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:35.187 INFO:tasks.ceph:pgid 12.0 last_scrub_stamp 2023-11-08T19:25:45.252340+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=45, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:35.187 INFO:tasks.ceph:pgid 13.1 last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:35.187 INFO:tasks.ceph:pgid 12.3 last_scrub_stamp 2023-11-08T19:25:45.252340+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=45, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:35.188 INFO:tasks.ceph:pgid 13.3 last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:35.188 INFO:tasks.ceph:pgid 12.5 last_scrub_stamp 2023-11-08T19:25:45.252340+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=45, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:35.189 INFO:tasks.ceph:pgid 13.4 last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:35.189 INFO:tasks.ceph:pgid 13.5 last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:35.189 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2023-11-08T19:24:30.117708+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=24, tm_sec=30, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:35.190 INFO:tasks.ceph:pgid 13.6 last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:35.190 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2023-11-08T19:24:30.117708+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=24, tm_sec=30, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:35.191 INFO:tasks.ceph:pgid 12.7 last_scrub_stamp 2023-11-08T19:25:45.252340+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=45, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:35.191 INFO:tasks.ceph:pgid 13.7 last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:35.191 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2023-11-08T19:24:30.117708+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=24, tm_sec=30, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:35.192 INFO:tasks.ceph:pgid 13.18 last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:35.192 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2023-11-08T19:24:30.117708+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=24, tm_sec=30, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:35.193 INFO:tasks.ceph:pgid 13.19 last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:35.193 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2023-11-08T19:24:30.117708+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=24, tm_sec=30, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:35.194 INFO:tasks.ceph:pgid 13.1a last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:35.194 INFO:tasks.ceph:pgid 12.1b last_scrub_stamp 2023-11-08T19:25:45.252340+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=45, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:35.194 INFO:tasks.ceph:pgid 13.1b last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:35.195 INFO:tasks.ceph:pgid 12.1a last_scrub_stamp 2023-11-08T19:25:45.252340+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=45, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:35.195 INFO:tasks.ceph:pgid 13.1c last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:35.196 INFO:tasks.ceph:pgid 12.1d last_scrub_stamp 2023-11-08T19:25:45.252340+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=45, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:35.196 INFO:tasks.ceph:pgid 13.1d last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:35.196 INFO:tasks.ceph:pgid 12.1c last_scrub_stamp 2023-11-08T19:25:45.252340+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=45, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:35.197 INFO:tasks.ceph:pgid 13.1e last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:35.197 INFO:tasks.ceph:pgid 13.1f last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:35.198 INFO:tasks.ceph:pgid 12.1e last_scrub_stamp 2023-11-08T19:25:45.252340+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=45, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:35.198 INFO:tasks.ceph:pgid 13.10 last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:35.199 INFO:tasks.ceph:pgid 13.11 last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:35.199 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2023-11-08T19:24:30.117708+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=24, tm_sec=30, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:35.199 INFO:tasks.ceph:pgid 12.10 last_scrub_stamp 2023-11-08T19:25:45.252340+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=45, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:35.200 INFO:tasks.ceph:pgid 13.12 last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:35.200 INFO:tasks.ceph:pgid 13.13 last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:35.201 INFO:tasks.ceph:pgid 12.12 last_scrub_stamp 2023-11-08T19:25:45.252340+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=45, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:35.201 INFO:tasks.ceph:pgid 13.14 last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:35.202 INFO:tasks.ceph:pgid 12.15 last_scrub_stamp 2023-11-08T19:25:45.252340+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=45, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:35.202 INFO:tasks.ceph:pgid 13.15 last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:35.202 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2023-11-08T19:24:30.117708+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=24, tm_sec=30, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:35.203 INFO:tasks.ceph:pgid 13.16 last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:35.203 INFO:tasks.ceph:pgid 12.17 last_scrub_stamp 2023-11-08T19:25:45.252340+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=45, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:35.204 INFO:tasks.ceph:pgid 13.17 last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:35.204 INFO:tasks.ceph:pgid 12.16 last_scrub_stamp 2023-11-08T19:25:45.252340+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=45, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:35.205 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-08T19:30:38.852 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T19:30:38.855 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T19:30:55.206 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:30:55.342 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.341+0000 7fb286166700 1 Processor -- start 2023-11-08T19:30:55.343 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.341+0000 7fb286166700 1 -- start start 2023-11-08T19:30:55.345 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.342+0000 7fb286166700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb28015db70 0x7fb280161dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:55.345 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.342+0000 7fb286166700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb280161940 con 0x7fb2800b2c00 2023-11-08T19:30:55.345 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.342+0000 7fb286166700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb28015e660 con 0x7fb28006ab80 2023-11-08T19:30:55.346 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.342+0000 7fb286166700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb28015eeb0 con 0x7fb28015db70 2023-11-08T19:30:55.346 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.342+0000 7fb27f7fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb28015db70 0x7fb280161dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:55.346 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.342+0000 7fb27effd700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fb2800b2c00 0x7fb28015df50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:48226/0 (socket says 172.21.15.149:48226) 2023-11-08T19:30:55.347 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.342+0000 7fb27effd700 1 -- 172.21.15.149:0/3141489263 learned_addr learned my addr 172.21.15.149:0/3141489263 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:30:55.347 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.342+0000 7fb27f7fe700 1 -- 172.21.15.149:0/3141489263 >> v1:172.21.15.160:6789/0 conn(0x7fb28006ab80 legacy=0x7fb280071dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:55.347 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.342+0000 7fb27e7fc700 1 -- 172.21.15.149:0/3141489263 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4050550668 0 0) 0x7fb280161940 con 0x7fb2800b2c00 2023-11-08T19:30:55.347 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.342+0000 7fb27f7fe700 1 -- 172.21.15.149:0/3141489263 >> v1:172.21.15.149:6789/0 conn(0x7fb2800b2c00 legacy=0x7fb28015df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:55.348 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.342+0000 7fb27f7fe700 1 -- 172.21.15.149:0/3141489263 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb28015e8f0 con 0x7fb28015db70 2023-11-08T19:30:55.348 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.343+0000 7fb27f7fe700 1 --2- 172.21.15.149:0/3141489263 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb28015db70 0x7fb280161dd0 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7fb274009840 tx=0x7fb274009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=912aabb3cc351e7b server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:55.348 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.343+0000 7fb27e7fc700 1 -- 172.21.15.149:0/3141489263 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb274011830 con 0x7fb28015db70 2023-11-08T19:30:55.348 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.343+0000 7fb27e7fc700 1 -- 172.21.15.149:0/3141489263 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb274011990 con 0x7fb28015db70 2023-11-08T19:30:55.349 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.343+0000 7fb27e7fc700 1 -- 172.21.15.149:0/3141489263 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb274011d20 con 0x7fb28015db70 2023-11-08T19:30:55.349 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.343+0000 7fb286166700 1 -- 172.21.15.149:0/3141489263 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb28015db70 msgr2=0x7fb280161dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:55.349 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.343+0000 7fb286166700 1 --2- 172.21.15.149:0/3141489263 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb28015db70 0x7fb280161dd0 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7fb274009840 tx=0x7fb274009b50 comp rx=0 tx=0).stop 2023-11-08T19:30:55.350 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.343+0000 7fb286166700 1 -- 172.21.15.149:0/3141489263 shutdown_connections 2023-11-08T19:30:55.350 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.343+0000 7fb286166700 1 --2- 172.21.15.149:0/3141489263 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb28015db70 0x7fb280161dd0 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:55.350 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.343+0000 7fb286166700 1 -- 172.21.15.149:0/3141489263 >> 172.21.15.149:0/3141489263 conn(0x7fb2800ccff0 msgr2=0x7fb2800cd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:55.350 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.343+0000 7fb286166700 1 -- 172.21.15.149:0/3141489263 shutdown_connections 2023-11-08T19:30:55.351 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.343+0000 7fb286166700 1 -- 172.21.15.149:0/3141489263 wait complete. 2023-11-08T19:30:55.354 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.345+0000 7fb286166700 1 Processor -- start 2023-11-08T19:30:55.354 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.345+0000 7fb286166700 1 -- start start 2023-11-08T19:30:55.354 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.346+0000 7fb286166700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb28006ab80 0x7fb280149450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:55.355 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.346+0000 7fb286166700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2800b2c00 0x7fb2800c5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:55.355 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.346+0000 7fb286166700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb28015db70 0x7fb2800af250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:55.355 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.346+0000 7fb286166700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2800c6480 con 0x7fb2800b2c00 2023-11-08T19:30:55.356 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.346+0000 7fb286166700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2801478a0 con 0x7fb28006ab80 2023-11-08T19:30:55.356 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.346+0000 7fb286166700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2800c55a0 con 0x7fb28015db70 2023-11-08T19:30:55.356 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.346+0000 7fb27effd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2800b2c00 0x7fb2800c5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:55.356 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.346+0000 7fb27effd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2800b2c00 0x7fb2800c5060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:46232/0 (socket says 172.21.15.149:46232) 2023-11-08T19:30:55.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.346+0000 7fb27effd700 1 -- 172.21.15.149:0/3166543050 learned_addr learned my addr 172.21.15.149:0/3166543050 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:30:55.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.346+0000 7fb27ffff700 1 --2- 172.21.15.149:0/3166543050 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb28015db70 0x7fb2800af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:55.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.346+0000 7fb27f7fe700 1 --2- 172.21.15.149:0/3166543050 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb28006ab80 0x7fb280149450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:55.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.347+0000 7fb27effd700 1 -- 172.21.15.149:0/3166543050 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb28015db70 msgr2=0x7fb2800af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:55.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.347+0000 7fb27effd700 1 --2- 172.21.15.149:0/3166543050 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb28015db70 0x7fb2800af250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:55.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.347+0000 7fb27effd700 1 -- 172.21.15.149:0/3166543050 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb28006ab80 msgr2=0x7fb280149450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:55.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.347+0000 7fb27effd700 1 --2- 172.21.15.149:0/3166543050 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb28006ab80 0x7fb280149450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:55.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.347+0000 7fb27effd700 1 -- 172.21.15.149:0/3166543050 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2740094a0 con 0x7fb2800b2c00 2023-11-08T19:30:55.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.347+0000 7fb27f7fe700 1 --2- 172.21.15.149:0/3166543050 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb28006ab80 0x7fb280149450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T19:30:55.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.347+0000 7fb27effd700 1 --2- 172.21.15.149:0/3166543050 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2800b2c00 0x7fb2800c5060 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7fb27000c450 tx=0x7fb27000c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:55.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.347+0000 7fb267fff700 1 -- 172.21.15.149:0/3166543050 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb270004c80 con 0x7fb2800b2c00 2023-11-08T19:30:55.360 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.347+0000 7fb267fff700 1 -- 172.21.15.149:0/3166543050 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb270004e00 con 0x7fb2800b2c00 2023-11-08T19:30:55.360 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.347+0000 7fb286166700 1 -- 172.21.15.149:0/3166543050 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2800c5870 con 0x7fb2800b2c00 2023-11-08T19:30:55.360 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.347+0000 7fb267fff700 1 -- 172.21.15.149:0/3166543050 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb270007310 con 0x7fb2800b2c00 2023-11-08T19:30:55.361 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.347+0000 7fb286166700 1 -- 172.21.15.149:0/3166543050 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2800c5e30 con 0x7fb2800b2c00 2023-11-08T19:30:55.361 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.348+0000 7fb286166700 1 -- 172.21.15.149:0/3166543050 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2800745f0 con 0x7fb2800b2c00 2023-11-08T19:30:55.361 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.348+0000 7fb267fff700 1 -- 172.21.15.149:0/3166543050 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb270007470 con 0x7fb2800b2c00 2023-11-08T19:30:55.361 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.349+0000 7fb267fff700 1 --2- 172.21.15.149:0/3166543050 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb26c06af00 0x7fb26c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:30:55.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.349+0000 7fb27f7fe700 1 --2- 172.21.15.149:0/3166543050 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb26c06af00 0x7fb26c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:30:55.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.349+0000 7fb267fff700 1 -- 172.21.15.149:0/3166543050 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6999+0+0 (secure 0 0 0) 0x7fb270089720 con 0x7fb2800b2c00 2023-11-08T19:30:55.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.349+0000 7fb27f7fe700 1 --2- 172.21.15.149:0/3166543050 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb26c06af00 0x7fb26c06d3c0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fb274000c00 tx=0x7fb27401c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:30:55.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.354+0000 7fb267fff700 1 -- 172.21.15.149:0/3166543050 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb2700542d0 con 0x7fb2800b2c00 2023-11-08T19:30:55.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.539+0000 7fb286166700 1 -- 172.21.15.149:0/3166543050 --> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb2801615d0 con 0x7fb26c06af00 2023-11-08T19:30:55.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.547+0000 7fb267fff700 1 -- 172.21.15.149:0/3166543050 <== mgr.4104 v2:172.21.15.149:6832/1929837472 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+294173 (secure 0 0 0) 0x7fb274011cb0 con 0x7fb26c06af00 2023-11-08T19:30:55.552 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:30:55.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.551+0000 7fb286166700 1 -- 172.21.15.149:0/3166543050 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb26c06af00 msgr2=0x7fb26c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:55.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.551+0000 7fb286166700 1 --2- 172.21.15.149:0/3166543050 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb26c06af00 0x7fb26c06d3c0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fb274000c00 tx=0x7fb27401c040 comp rx=0 tx=0).stop 2023-11-08T19:30:55.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.551+0000 7fb286166700 1 -- 172.21.15.149:0/3166543050 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2800b2c00 msgr2=0x7fb2800c5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:30:55.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.551+0000 7fb286166700 1 --2- 172.21.15.149:0/3166543050 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2800b2c00 0x7fb2800c5060 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7fb27000c450 tx=0x7fb27000c760 comp rx=0 tx=0).stop 2023-11-08T19:30:55.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.551+0000 7fb286166700 1 -- 172.21.15.149:0/3166543050 shutdown_connections 2023-11-08T19:30:55.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.551+0000 7fb286166700 1 --2- 172.21.15.149:0/3166543050 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fb26c06af00 0x7fb26c06d3c0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:55.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.551+0000 7fb286166700 1 --2- 172.21.15.149:0/3166543050 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb28006ab80 0x7fb280149450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:55.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.551+0000 7fb286166700 1 --2- 172.21.15.149:0/3166543050 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb28015db70 0x7fb2800af250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:55.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.551+0000 7fb286166700 1 --2- 172.21.15.149:0/3166543050 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2800b2c00 0x7fb2800c5060 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:30:55.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.551+0000 7fb286166700 1 -- 172.21.15.149:0/3166543050 >> 172.21.15.149:0/3166543050 conn(0x7fb2800ccff0 msgr2=0x7fb28006ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:30:55.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.551+0000 7fb286166700 1 -- 172.21.15.149:0/3166543050 shutdown_connections 2023-11-08T19:30:55.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:30:55.551+0000 7fb286166700 1 -- 172.21.15.149:0/3166543050 wait complete. 2023-11-08T19:30:55.558 INFO:teuthology.orchestra.run.smithi149.stderr:dumped all 2023-11-08T19:30:55.564 INFO:teuthology.orchestra.run.smithi149.stdout:{"pg_ready":true,"pg_map":{"version":343,"stamp":"2023-11-08T19:30:54.110173+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":232200,"kb_used_data":11912,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754742520,"statfs":{"total":773094113280,"available":772856340480,"internally_reserved":0,"allocated":12197888,"data_stored":6807536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003619"},"pg_stats":[{"pgid":"13.c","version":"0'0","reported_seq":55,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:39.195724+0000","last_change":"2023-11-08T19:30:39.195764+0000","last_active":"2023-11-08T19:30:39.195724+0000","last_peered":"2023-11-08T19:30:39.195724+0000","last_clean":"2023-11-08T19:30:39.195724+0000","last_became_active":"2023-11-08T19:25:47.284788+0000","last_became_peered":"2023-11-08T19:25:47.284788+0000","last_unstale":"2023-11-08T19:30:39.195724+0000","last_undegraded":"2023-11-08T19:30:39.195724+0000","last_fullsized":"2023-11-08T19:30:39.195724+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:39.195588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:39.195588+0000","last_clean_scrub_stamp":"2023-11-08T19:30:39.195588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:38:12.811188+0000","scrub_duration":0.0017506209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"111'119","reported_seq":255,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:16.176739+0000","last_change":"2023-11-08T19:30:16.176798+0000","last_active":"2023-11-08T19:30:16.176739+0000","last_peered":"2023-11-08T19:30:16.176739+0000","last_clean":"2023-11-08T19:30:16.176739+0000","last_became_active":"2023-11-08T19:22:58.053337+0000","last_became_peered":"2023-11-08T19:22:58.053337+0000","last_unstale":"2023-11-08T19:30:16.176739+0000","last_undegraded":"2023-11-08T19:30:16.176739+0000","last_fullsized":"2023-11-08T19:30:16.176739+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'119","last_scrub_stamp":"2023-11-08T19:30:16.176632+0000","last_deep_scrub":"111'119","last_deep_scrub_stamp":"2023-11-08T19:30:16.176632+0000","last_clean_scrub_stamp":"2023-11-08T19:30:16.176632+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:41:41.655108+0000","scrub_duration":0.0052701320000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":86,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:42.247503+0000","last_change":"2023-11-08T19:30:42.247526+0000","last_active":"2023-11-08T19:30:42.247503+0000","last_peered":"2023-11-08T19:30:42.247503+0000","last_clean":"2023-11-08T19:30:42.247503+0000","last_became_active":"2023-11-08T19:24:31.148363+0000","last_became_peered":"2023-11-08T19:24:31.148363+0000","last_unstale":"2023-11-08T19:30:42.247503+0000","last_undegraded":"2023-11-08T19:30:42.247503+0000","last_fullsized":"2023-11-08T19:30:42.247503+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:42.247410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:42.247410+0000","last_clean_scrub_stamp":"2023-11-08T19:30:42.247410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:42:17.743190+0000","scrub_duration":0.00190854,"objects_trimmed":0,"snaptrim_duration":0.00075444200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":62,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:36.139925+0000","last_change":"2023-11-08T19:30:36.139962+0000","last_active":"2023-11-08T19:30:36.139925+0000","last_peered":"2023-11-08T19:30:36.139925+0000","last_clean":"2023-11-08T19:30:36.139925+0000","last_became_active":"2023-11-08T19:25:46.289470+0000","last_became_peered":"2023-11-08T19:25:46.289470+0000","last_unstale":"2023-11-08T19:30:36.139925+0000","last_undegraded":"2023-11-08T19:30:36.139925+0000","last_fullsized":"2023-11-08T19:30:36.139925+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:36.139832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:36.139832+0000","last_clean_scrub_stamp":"2023-11-08T19:30:36.139832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:31:31.135502+0000","scrub_duration":0.001942477,"objects_trimmed":0,"snaptrim_duration":0.000371219,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":59,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:28.037056+0000","last_change":"2023-11-08T19:30:28.037082+0000","last_active":"2023-11-08T19:30:28.037056+0000","last_peered":"2023-11-08T19:30:28.037056+0000","last_clean":"2023-11-08T19:30:28.037056+0000","last_became_active":"2023-11-08T19:25:47.282922+0000","last_became_peered":"2023-11-08T19:25:47.282922+0000","last_unstale":"2023-11-08T19:30:28.037056+0000","last_undegraded":"2023-11-08T19:30:28.037056+0000","last_fullsized":"2023-11-08T19:30:28.037056+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:28.036969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:28.036969+0000","last_clean_scrub_stamp":"2023-11-08T19:30:28.036969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:26:53.908203+0000","scrub_duration":0.0019860609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":87,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:19.998985+0000","last_change":"2023-11-08T19:30:19.998985+0000","last_active":"2023-11-08T19:30:19.998985+0000","last_peered":"2023-11-08T19:30:19.998985+0000","last_clean":"2023-11-08T19:30:19.998985+0000","last_became_active":"2023-11-08T19:24:31.138598+0000","last_became_peered":"2023-11-08T19:24:31.138598+0000","last_unstale":"2023-11-08T19:30:19.998985+0000","last_undegraded":"2023-11-08T19:30:19.998985+0000","last_fullsized":"2023-11-08T19:30:19.998985+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:19.998879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:19.998879+0000","last_clean_scrub_stamp":"2023-11-08T19:30:19.998879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:18:08.731391+0000","scrub_duration":0.001419371,"objects_trimmed":0,"snaptrim_duration":0.015114824000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":66,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:19.886457+0000","last_change":"2023-11-08T19:30:19.886481+0000","last_active":"2023-11-08T19:30:19.886457+0000","last_peered":"2023-11-08T19:30:19.886457+0000","last_clean":"2023-11-08T19:30:19.886457+0000","last_became_active":"2023-11-08T19:25:46.279007+0000","last_became_peered":"2023-11-08T19:25:46.279007+0000","last_unstale":"2023-11-08T19:30:19.886457+0000","last_undegraded":"2023-11-08T19:30:19.886457+0000","last_fullsized":"2023-11-08T19:30:19.886457+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:19.886330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:19.886330+0000","last_clean_scrub_stamp":"2023-11-08T19:30:19.886330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:27:13.439557+0000","scrub_duration":0.001929435,"objects_trimmed":0,"snaptrim_duration":0.0036813240000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":57,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:29.504740+0000","last_change":"2023-11-08T19:30:29.504765+0000","last_active":"2023-11-08T19:30:29.504740+0000","last_peered":"2023-11-08T19:30:29.504740+0000","last_clean":"2023-11-08T19:30:29.504740+0000","last_became_active":"2023-11-08T19:25:47.284796+0000","last_became_peered":"2023-11-08T19:25:47.284796+0000","last_unstale":"2023-11-08T19:30:29.504740+0000","last_undegraded":"2023-11-08T19:30:29.504740+0000","last_fullsized":"2023-11-08T19:30:29.504740+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:29.504641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:29.504641+0000","last_clean_scrub_stamp":"2023-11-08T19:30:29.504641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:17:32.777171+0000","scrub_duration":0.002043577,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":87,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:14.999954+0000","last_change":"2023-11-08T19:30:14.999954+0000","last_active":"2023-11-08T19:30:14.999954+0000","last_peered":"2023-11-08T19:30:14.999954+0000","last_clean":"2023-11-08T19:30:14.999954+0000","last_became_active":"2023-11-08T19:24:31.142028+0000","last_became_peered":"2023-11-08T19:24:31.142028+0000","last_unstale":"2023-11-08T19:30:14.999954+0000","last_undegraded":"2023-11-08T19:30:14.999954+0000","last_fullsized":"2023-11-08T19:30:14.999954+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:14.999864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:14.999864+0000","last_clean_scrub_stamp":"2023-11-08T19:30:14.999864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:46:08.947796+0000","scrub_duration":0.001067143,"objects_trimmed":0,"snaptrim_duration":0.00067537399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":63,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:28.110765+0000","last_change":"2023-11-08T19:30:28.110801+0000","last_active":"2023-11-08T19:30:28.110765+0000","last_peered":"2023-11-08T19:30:28.110765+0000","last_clean":"2023-11-08T19:30:28.110765+0000","last_became_active":"2023-11-08T19:25:46.288739+0000","last_became_peered":"2023-11-08T19:25:46.288739+0000","last_unstale":"2023-11-08T19:30:28.110765+0000","last_undegraded":"2023-11-08T19:30:28.110765+0000","last_fullsized":"2023-11-08T19:30:28.110765+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:28.110672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:28.110672+0000","last_clean_scrub_stamp":"2023-11-08T19:30:28.110672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:49:10.857315+0000","scrub_duration":0.0014712219999999999,"objects_trimmed":0,"snaptrim_duration":0.0015057530000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":59,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:22.944958+0000","last_change":"2023-11-08T19:30:22.944994+0000","last_active":"2023-11-08T19:30:22.944958+0000","last_peered":"2023-11-08T19:30:22.944958+0000","last_clean":"2023-11-08T19:30:22.944958+0000","last_became_active":"2023-11-08T19:25:47.287494+0000","last_became_peered":"2023-11-08T19:25:47.287494+0000","last_unstale":"2023-11-08T19:30:22.944958+0000","last_undegraded":"2023-11-08T19:30:22.944958+0000","last_fullsized":"2023-11-08T19:30:22.944958+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:22.944836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:22.944836+0000","last_clean_scrub_stamp":"2023-11-08T19:30:22.944836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:13:58.622747+0000","scrub_duration":0.001547238,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":88,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:13.647703+0000","last_change":"2023-11-08T19:30:13.647703+0000","last_active":"2023-11-08T19:30:13.647703+0000","last_peered":"2023-11-08T19:30:13.647703+0000","last_clean":"2023-11-08T19:30:13.647703+0000","last_became_active":"2023-11-08T19:24:31.141367+0000","last_became_peered":"2023-11-08T19:24:31.141367+0000","last_unstale":"2023-11-08T19:30:13.647703+0000","last_undegraded":"2023-11-08T19:30:13.647703+0000","last_fullsized":"2023-11-08T19:30:13.647703+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:13.647567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:13.647567+0000","last_clean_scrub_stamp":"2023-11-08T19:30:13.647567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:51:59.112379+0000","scrub_duration":0.0017188710000000001,"objects_trimmed":0,"snaptrim_duration":0.001335136,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":63,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:30.067419+0000","last_change":"2023-11-08T19:30:30.067450+0000","last_active":"2023-11-08T19:30:30.067419+0000","last_peered":"2023-11-08T19:30:30.067419+0000","last_clean":"2023-11-08T19:30:30.067419+0000","last_became_active":"2023-11-08T19:25:46.289283+0000","last_became_peered":"2023-11-08T19:25:46.289283+0000","last_unstale":"2023-11-08T19:30:30.067419+0000","last_undegraded":"2023-11-08T19:30:30.067419+0000","last_fullsized":"2023-11-08T19:30:30.067419+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:30.067319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:30.067319+0000","last_clean_scrub_stamp":"2023-11-08T19:30:30.067319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:16:49.675631+0000","scrub_duration":0.001437668,"objects_trimmed":0,"snaptrim_duration":0.001274049,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":57,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:36.471693+0000","last_change":"2023-11-08T19:30:36.471717+0000","last_active":"2023-11-08T19:30:36.471693+0000","last_peered":"2023-11-08T19:30:36.471693+0000","last_clean":"2023-11-08T19:30:36.471693+0000","last_became_active":"2023-11-08T19:25:47.285075+0000","last_became_peered":"2023-11-08T19:25:47.285075+0000","last_unstale":"2023-11-08T19:30:36.471693+0000","last_undegraded":"2023-11-08T19:30:36.471693+0000","last_fullsized":"2023-11-08T19:30:36.471693+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:36.471601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:36.471601+0000","last_clean_scrub_stamp":"2023-11-08T19:30:36.471601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:10:24.384726+0000","scrub_duration":0.002370937,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":97,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:16.672700+0000","last_change":"2023-11-08T19:30:16.672700+0000","last_active":"2023-11-08T19:30:16.672700+0000","last_peered":"2023-11-08T19:30:16.672700+0000","last_clean":"2023-11-08T19:30:16.672700+0000","last_became_active":"2023-11-08T19:24:31.145329+0000","last_became_peered":"2023-11-08T19:24:31.145329+0000","last_unstale":"2023-11-08T19:30:16.672700+0000","last_undegraded":"2023-11-08T19:30:16.672700+0000","last_fullsized":"2023-11-08T19:30:16.672700+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:16.672581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:16.672581+0000","last_clean_scrub_stamp":"2023-11-08T19:30:16.672581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:23:01.900333+0000","scrub_duration":0.0018379830000000001,"objects_trimmed":0,"snaptrim_duration":0.00049012999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":66,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:20.921021+0000","last_change":"2023-11-08T19:30:20.921044+0000","last_active":"2023-11-08T19:30:20.921021+0000","last_peered":"2023-11-08T19:30:20.921021+0000","last_clean":"2023-11-08T19:30:20.921021+0000","last_became_active":"2023-11-08T19:25:46.282174+0000","last_became_peered":"2023-11-08T19:25:46.282174+0000","last_unstale":"2023-11-08T19:30:20.921021+0000","last_undegraded":"2023-11-08T19:30:20.921021+0000","last_fullsized":"2023-11-08T19:30:20.921021+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:20.920910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:20.920910+0000","last_clean_scrub_stamp":"2023-11-08T19:30:20.920910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:07:53.526415+0000","scrub_duration":0.0014780660000000001,"objects_trimmed":0,"snaptrim_duration":0.000727792,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":62,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:48.540579+0000","last_change":"2023-11-08T19:30:48.540606+0000","last_active":"2023-11-08T19:30:48.540579+0000","last_peered":"2023-11-08T19:30:48.540579+0000","last_clean":"2023-11-08T19:30:48.540579+0000","last_became_active":"2023-11-08T19:25:47.287419+0000","last_became_peered":"2023-11-08T19:25:47.287419+0000","last_unstale":"2023-11-08T19:30:48.540579+0000","last_undegraded":"2023-11-08T19:30:48.540579+0000","last_fullsized":"2023-11-08T19:30:48.540579+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:48.540462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:48.540462+0000","last_clean_scrub_stamp":"2023-11-08T19:30:48.540462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:58:16.445190+0000","scrub_duration":0.0024177930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":95,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:34.850946+0000","last_change":"2023-11-08T19:30:34.850967+0000","last_active":"2023-11-08T19:30:34.850946+0000","last_peered":"2023-11-08T19:30:34.850946+0000","last_clean":"2023-11-08T19:30:34.850946+0000","last_became_active":"2023-11-08T19:24:31.146063+0000","last_became_peered":"2023-11-08T19:24:31.146063+0000","last_unstale":"2023-11-08T19:30:34.850946+0000","last_undegraded":"2023-11-08T19:30:34.850946+0000","last_fullsized":"2023-11-08T19:30:34.850946+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:34.850866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:34.850866+0000","last_clean_scrub_stamp":"2023-11-08T19:30:34.850866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:36:22.019388+0000","scrub_duration":0.00177243,"objects_trimmed":0,"snaptrim_duration":0.00089896300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":56,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:10.888792+0000","last_change":"2023-11-08T19:25:48.374690+0000","last_active":"2023-11-08T19:30:10.888792+0000","last_peered":"2023-11-08T19:30:10.888792+0000","last_clean":"2023-11-08T19:30:10.888792+0000","last_became_active":"2023-11-08T19:25:46.281986+0000","last_became_peered":"2023-11-08T19:25:46.281986+0000","last_unstale":"2023-11-08T19:30:10.888792+0000","last_undegraded":"2023-11-08T19:30:10.888792+0000","last_fullsized":"2023-11-08T19:30:10.888792+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003067771,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":55,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:45.947469+0000","last_change":"2023-11-08T19:30:45.947492+0000","last_active":"2023-11-08T19:30:45.947469+0000","last_peered":"2023-11-08T19:30:45.947469+0000","last_clean":"2023-11-08T19:30:45.947469+0000","last_became_active":"2023-11-08T19:25:47.287560+0000","last_became_peered":"2023-11-08T19:25:47.287560+0000","last_unstale":"2023-11-08T19:30:45.947469+0000","last_undegraded":"2023-11-08T19:30:45.947469+0000","last_fullsized":"2023-11-08T19:30:45.947469+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:45.947375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:45.947375+0000","last_clean_scrub_stamp":"2023-11-08T19:30:45.947375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:46:08.051257+0000","scrub_duration":0.001481039,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":87,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:37.159886+0000","last_change":"2023-11-08T19:30:37.159886+0000","last_active":"2023-11-08T19:30:37.159886+0000","last_peered":"2023-11-08T19:30:37.159886+0000","last_clean":"2023-11-08T19:30:37.159886+0000","last_became_active":"2023-11-08T19:24:31.144223+0000","last_became_peered":"2023-11-08T19:24:31.144223+0000","last_unstale":"2023-11-08T19:30:37.159886+0000","last_undegraded":"2023-11-08T19:30:37.159886+0000","last_fullsized":"2023-11-08T19:30:37.159886+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:37.159760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:37.159760+0000","last_clean_scrub_stamp":"2023-11-08T19:30:37.159760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:30:10.933513+0000","scrub_duration":0.00183394,"objects_trimmed":0,"snaptrim_duration":0.00071879799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":69,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:21.808575+0000","last_change":"2023-11-08T19:30:21.808611+0000","last_active":"2023-11-08T19:30:21.808575+0000","last_peered":"2023-11-08T19:30:21.808575+0000","last_clean":"2023-11-08T19:30:21.808575+0000","last_became_active":"2023-11-08T19:25:46.278686+0000","last_became_peered":"2023-11-08T19:25:46.278686+0000","last_unstale":"2023-11-08T19:30:21.808575+0000","last_undegraded":"2023-11-08T19:30:21.808575+0000","last_fullsized":"2023-11-08T19:30:21.808575+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:21.808432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:21.808432+0000","last_clean_scrub_stamp":"2023-11-08T19:30:21.808432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:35:49.484450+0000","scrub_duration":0.0016393169999999999,"objects_trimmed":0,"snaptrim_duration":0.00078409499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":54,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:13.898522+0000","last_change":"2023-11-08T19:25:47.289726+0000","last_active":"2023-11-08T19:30:13.898522+0000","last_peered":"2023-11-08T19:30:13.898522+0000","last_clean":"2023-11-08T19:30:13.898522+0000","last_became_active":"2023-11-08T19:25:47.289362+0000","last_became_peered":"2023-11-08T19:25:47.289362+0000","last_unstale":"2023-11-08T19:30:13.898522+0000","last_undegraded":"2023-11-08T19:30:13.898522+0000","last_fullsized":"2023-11-08T19:30:13.898522+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":86,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:32.188564+0000","last_change":"2023-11-08T19:30:32.188564+0000","last_active":"2023-11-08T19:30:32.188564+0000","last_peered":"2023-11-08T19:30:32.188564+0000","last_clean":"2023-11-08T19:30:32.188564+0000","last_became_active":"2023-11-08T19:24:31.147082+0000","last_became_peered":"2023-11-08T19:24:31.147082+0000","last_unstale":"2023-11-08T19:30:32.188564+0000","last_undegraded":"2023-11-08T19:30:32.188564+0000","last_fullsized":"2023-11-08T19:30:32.188564+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:32.188459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:32.188459+0000","last_clean_scrub_stamp":"2023-11-08T19:30:32.188459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:25:59.508112+0000","scrub_duration":0.001809777,"objects_trimmed":0,"snaptrim_duration":0.00043701599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":56,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:10.888728+0000","last_change":"2023-11-08T19:25:48.374739+0000","last_active":"2023-11-08T19:30:10.888728+0000","last_peered":"2023-11-08T19:30:10.888728+0000","last_clean":"2023-11-08T19:30:10.888728+0000","last_became_active":"2023-11-08T19:25:46.282071+0000","last_became_peered":"2023-11-08T19:25:46.282071+0000","last_unstale":"2023-11-08T19:30:10.888728+0000","last_undegraded":"2023-11-08T19:30:10.888728+0000","last_fullsized":"2023-11-08T19:30:10.888728+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023654909999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":86,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:24.116725+0000","last_change":"2023-11-08T19:30:24.116761+0000","last_active":"2023-11-08T19:30:24.116725+0000","last_peered":"2023-11-08T19:30:24.116725+0000","last_clean":"2023-11-08T19:30:24.116725+0000","last_became_active":"2023-11-08T19:24:31.144795+0000","last_became_peered":"2023-11-08T19:24:31.144795+0000","last_unstale":"2023-11-08T19:30:24.116725+0000","last_undegraded":"2023-11-08T19:30:24.116725+0000","last_fullsized":"2023-11-08T19:30:24.116725+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:24.116622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:24.116622+0000","last_clean_scrub_stamp":"2023-11-08T19:30:24.116622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:11:25.781444+0000","scrub_duration":0.0015405900000000001,"objects_trimmed":0,"snaptrim_duration":0.01495431,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":69,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:46.739832+0000","last_change":"2023-11-08T19:30:46.739872+0000","last_active":"2023-11-08T19:30:46.739832+0000","last_peered":"2023-11-08T19:30:46.739832+0000","last_clean":"2023-11-08T19:30:46.739832+0000","last_became_active":"2023-11-08T19:25:46.285766+0000","last_became_peered":"2023-11-08T19:25:46.285766+0000","last_unstale":"2023-11-08T19:30:46.739832+0000","last_undegraded":"2023-11-08T19:30:46.739832+0000","last_fullsized":"2023-11-08T19:30:46.739832+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:46.739670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:46.739670+0000","last_clean_scrub_stamp":"2023-11-08T19:30:46.739670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:39:25.915335+0000","scrub_duration":0.001977244,"objects_trimmed":0,"snaptrim_duration":0.001756748,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":55,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:44.946783+0000","last_change":"2023-11-08T19:30:44.946827+0000","last_active":"2023-11-08T19:30:44.946783+0000","last_peered":"2023-11-08T19:30:44.946783+0000","last_clean":"2023-11-08T19:30:44.946783+0000","last_became_active":"2023-11-08T19:25:47.288027+0000","last_became_peered":"2023-11-08T19:25:47.288027+0000","last_unstale":"2023-11-08T19:30:44.946783+0000","last_undegraded":"2023-11-08T19:30:44.946783+0000","last_fullsized":"2023-11-08T19:30:44.946783+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:44.946674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:44.946674+0000","last_clean_scrub_stamp":"2023-11-08T19:30:44.946674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:32:49.215775+0000","scrub_duration":0.0020628539999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":86,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:14.200060+0000","last_change":"2023-11-08T19:30:14.200080+0000","last_active":"2023-11-08T19:30:14.200060+0000","last_peered":"2023-11-08T19:30:14.200060+0000","last_clean":"2023-11-08T19:30:14.200060+0000","last_became_active":"2023-11-08T19:24:31.138814+0000","last_became_peered":"2023-11-08T19:24:31.138814+0000","last_unstale":"2023-11-08T19:30:14.200060+0000","last_undegraded":"2023-11-08T19:30:14.200060+0000","last_fullsized":"2023-11-08T19:30:14.200060+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:14.199980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:14.199980+0000","last_clean_scrub_stamp":"2023-11-08T19:30:14.199980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:51:59.664792+0000","scrub_duration":0.0015028369999999999,"objects_trimmed":0,"snaptrim_duration":0.00048136000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":69,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:36.507501+0000","last_change":"2023-11-08T19:30:36.507522+0000","last_active":"2023-11-08T19:30:36.507501+0000","last_peered":"2023-11-08T19:30:36.507501+0000","last_clean":"2023-11-08T19:30:36.507501+0000","last_became_active":"2023-11-08T19:25:46.271936+0000","last_became_peered":"2023-11-08T19:25:46.271936+0000","last_unstale":"2023-11-08T19:30:36.507501+0000","last_undegraded":"2023-11-08T19:30:36.507501+0000","last_fullsized":"2023-11-08T19:30:36.507501+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:36.507418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:36.507418+0000","last_clean_scrub_stamp":"2023-11-08T19:30:36.507418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:49:25.737651+0000","scrub_duration":0.0014739589999999999,"objects_trimmed":0,"snaptrim_duration":0.00186835,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":54,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.746984+0000","last_change":"2023-11-08T19:25:47.282856+0000","last_active":"2023-11-08T19:30:05.746984+0000","last_peered":"2023-11-08T19:30:05.746984+0000","last_clean":"2023-11-08T19:30:05.746984+0000","last_became_active":"2023-11-08T19:25:47.282594+0000","last_became_peered":"2023-11-08T19:25:47.282594+0000","last_unstale":"2023-11-08T19:30:05.746984+0000","last_undegraded":"2023-11-08T19:30:05.746984+0000","last_fullsized":"2023-11-08T19:30:05.746984+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":89,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:14.808735+0000","last_change":"2023-11-08T19:30:14.808755+0000","last_active":"2023-11-08T19:30:14.808735+0000","last_peered":"2023-11-08T19:30:14.808735+0000","last_clean":"2023-11-08T19:30:14.808735+0000","last_became_active":"2023-11-08T19:24:31.142985+0000","last_became_peered":"2023-11-08T19:24:31.142985+0000","last_unstale":"2023-11-08T19:30:14.808735+0000","last_undegraded":"2023-11-08T19:30:14.808735+0000","last_fullsized":"2023-11-08T19:30:14.808735+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:14.808667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:14.808667+0000","last_clean_scrub_stamp":"2023-11-08T19:30:14.808667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:58:55.493702+0000","scrub_duration":0.0018409399999999999,"objects_trimmed":0,"snaptrim_duration":0.000386048,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":56,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:07.174406+0000","last_change":"2023-11-08T19:25:48.372963+0000","last_active":"2023-11-08T19:30:07.174406+0000","last_peered":"2023-11-08T19:30:07.174406+0000","last_clean":"2023-11-08T19:30:07.174406+0000","last_became_active":"2023-11-08T19:25:46.283263+0000","last_became_peered":"2023-11-08T19:25:46.283263+0000","last_unstale":"2023-11-08T19:30:07.174406+0000","last_undegraded":"2023-11-08T19:30:07.174406+0000","last_fullsized":"2023-11-08T19:30:07.174406+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019848779999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":57,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:25.443260+0000","last_change":"2023-11-08T19:30:25.443287+0000","last_active":"2023-11-08T19:30:25.443260+0000","last_peered":"2023-11-08T19:30:25.443260+0000","last_clean":"2023-11-08T19:30:25.443260+0000","last_became_active":"2023-11-08T19:25:47.284522+0000","last_became_peered":"2023-11-08T19:25:47.284522+0000","last_unstale":"2023-11-08T19:30:25.443260+0000","last_undegraded":"2023-11-08T19:30:25.443260+0000","last_fullsized":"2023-11-08T19:30:25.443260+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:25.443157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:25.443157+0000","last_clean_scrub_stamp":"2023-11-08T19:30:25.443157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:11:41.255817+0000","scrub_duration":0.002105778,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":86,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:30.241577+0000","last_change":"2023-11-08T19:30:30.241614+0000","last_active":"2023-11-08T19:30:30.241577+0000","last_peered":"2023-11-08T19:30:30.241577+0000","last_clean":"2023-11-08T19:30:30.241577+0000","last_became_active":"2023-11-08T19:24:31.144838+0000","last_became_peered":"2023-11-08T19:24:31.144838+0000","last_unstale":"2023-11-08T19:30:30.241577+0000","last_undegraded":"2023-11-08T19:30:30.241577+0000","last_fullsized":"2023-11-08T19:30:30.241577+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:30.241474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:30.241474+0000","last_clean_scrub_stamp":"2023-11-08T19:30:30.241474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:44:33.275938+0000","scrub_duration":0.0015211319999999999,"objects_trimmed":0,"snaptrim_duration":0.00081588799999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":69,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:30.668329+0000","last_change":"2023-11-08T19:30:30.668366+0000","last_active":"2023-11-08T19:30:30.668329+0000","last_peered":"2023-11-08T19:30:30.668329+0000","last_clean":"2023-11-08T19:30:30.668329+0000","last_became_active":"2023-11-08T19:25:46.285588+0000","last_became_peered":"2023-11-08T19:25:46.285588+0000","last_unstale":"2023-11-08T19:30:30.668329+0000","last_undegraded":"2023-11-08T19:30:30.668329+0000","last_fullsized":"2023-11-08T19:30:30.668329+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:30.668221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:30.668221+0000","last_clean_scrub_stamp":"2023-11-08T19:30:30.668221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:54:28.732108+0000","scrub_duration":0.0020941699999999998,"objects_trimmed":0,"snaptrim_duration":0.0023282350000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":49,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:07.174217+0000","last_change":"2023-11-08T19:25:47.283526+0000","last_active":"2023-11-08T19:30:07.174217+0000","last_peered":"2023-11-08T19:30:07.174217+0000","last_clean":"2023-11-08T19:30:07.174217+0000","last_became_active":"2023-11-08T19:25:47.283266+0000","last_became_peered":"2023-11-08T19:25:47.283266+0000","last_unstale":"2023-11-08T19:30:07.174217+0000","last_undegraded":"2023-11-08T19:30:07.174217+0000","last_fullsized":"2023-11-08T19:30:07.174217+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":89,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:15.843994+0000","last_change":"2023-11-08T19:30:15.844049+0000","last_active":"2023-11-08T19:30:15.843994+0000","last_peered":"2023-11-08T19:30:15.843994+0000","last_clean":"2023-11-08T19:30:15.843994+0000","last_became_active":"2023-11-08T19:24:31.141710+0000","last_became_peered":"2023-11-08T19:24:31.141710+0000","last_unstale":"2023-11-08T19:30:15.843994+0000","last_undegraded":"2023-11-08T19:30:15.843994+0000","last_fullsized":"2023-11-08T19:30:15.843994+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:15.843841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:15.843841+0000","last_clean_scrub_stamp":"2023-11-08T19:30:15.843841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:15:48.494842+0000","scrub_duration":0.0022065240000000001,"objects_trimmed":0,"snaptrim_duration":0.000430438,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":69,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:47.740964+0000","last_change":"2023-11-08T19:30:47.741009+0000","last_active":"2023-11-08T19:30:47.740964+0000","last_peered":"2023-11-08T19:30:47.740964+0000","last_clean":"2023-11-08T19:30:47.740964+0000","last_became_active":"2023-11-08T19:25:46.273336+0000","last_became_peered":"2023-11-08T19:25:46.273336+0000","last_unstale":"2023-11-08T19:30:47.740964+0000","last_undegraded":"2023-11-08T19:30:47.740964+0000","last_fullsized":"2023-11-08T19:30:47.740964+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:47.740857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:47.740857+0000","last_clean_scrub_stamp":"2023-11-08T19:30:47.740857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:42:32.849324+0000","scrub_duration":0.0020745569999999999,"objects_trimmed":0,"snaptrim_duration":0.00092577200000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":54,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.745636+0000","last_change":"2023-11-08T19:25:47.282840+0000","last_active":"2023-11-08T19:30:05.745636+0000","last_peered":"2023-11-08T19:30:05.745636+0000","last_clean":"2023-11-08T19:30:05.745636+0000","last_became_active":"2023-11-08T19:25:47.282600+0000","last_became_peered":"2023-11-08T19:25:47.282600+0000","last_unstale":"2023-11-08T19:30:05.745636+0000","last_undegraded":"2023-11-08T19:30:05.745636+0000","last_fullsized":"2023-11-08T19:30:05.745636+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":62,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:41.482806+0000","last_change":"2023-11-08T19:30:41.482842+0000","last_active":"2023-11-08T19:30:41.482806+0000","last_peered":"2023-11-08T19:30:41.482806+0000","last_clean":"2023-11-08T19:30:41.482806+0000","last_became_active":"2023-11-08T19:25:47.285641+0000","last_became_peered":"2023-11-08T19:25:47.285641+0000","last_unstale":"2023-11-08T19:30:41.482806+0000","last_undegraded":"2023-11-08T19:30:41.482806+0000","last_fullsized":"2023-11-08T19:30:41.482806+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:41.482669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:41.482669+0000","last_clean_scrub_stamp":"2023-11-08T19:30:41.482669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:11:16.853701+0000","scrub_duration":0.0021664090000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":86,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:34.218129+0000","last_change":"2023-11-08T19:30:34.218157+0000","last_active":"2023-11-08T19:30:34.218129+0000","last_peered":"2023-11-08T19:30:34.218129+0000","last_clean":"2023-11-08T19:30:34.218129+0000","last_became_active":"2023-11-08T19:24:31.146715+0000","last_became_peered":"2023-11-08T19:24:31.146715+0000","last_unstale":"2023-11-08T19:30:34.218129+0000","last_undegraded":"2023-11-08T19:30:34.218129+0000","last_fullsized":"2023-11-08T19:30:34.218129+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:34.218032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:34.218032+0000","last_clean_scrub_stamp":"2023-11-08T19:30:34.218032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:44:54.228901+0000","scrub_duration":0.001686608,"objects_trimmed":0,"snaptrim_duration":0.00081671599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":69,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:19.767755+0000","last_change":"2023-11-08T19:30:19.767800+0000","last_active":"2023-11-08T19:30:19.767755+0000","last_peered":"2023-11-08T19:30:19.767755+0000","last_clean":"2023-11-08T19:30:19.767755+0000","last_became_active":"2023-11-08T19:25:46.285960+0000","last_became_peered":"2023-11-08T19:25:46.285960+0000","last_unstale":"2023-11-08T19:30:19.767755+0000","last_undegraded":"2023-11-08T19:30:19.767755+0000","last_fullsized":"2023-11-08T19:30:19.767755+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:19.767655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:19.767655+0000","last_clean_scrub_stamp":"2023-11-08T19:30:19.767655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:09:29.324502+0000","scrub_duration":0.0020017630000000002,"objects_trimmed":0,"snaptrim_duration":0.00091649099999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":62,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:50.533606+0000","last_change":"2023-11-08T19:30:50.533630+0000","last_active":"2023-11-08T19:30:50.533606+0000","last_peered":"2023-11-08T19:30:50.533606+0000","last_clean":"2023-11-08T19:30:50.533606+0000","last_became_active":"2023-11-08T19:25:47.283360+0000","last_became_peered":"2023-11-08T19:25:47.283360+0000","last_unstale":"2023-11-08T19:30:50.533606+0000","last_undegraded":"2023-11-08T19:30:50.533606+0000","last_fullsized":"2023-11-08T19:30:50.533606+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:50.533508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:50.533508+0000","last_clean_scrub_stamp":"2023-11-08T19:30:50.533508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:04:18.582751+0000","scrub_duration":0.001541892,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":95,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:35.806226+0000","last_change":"2023-11-08T19:30:35.806271+0000","last_active":"2023-11-08T19:30:35.806226+0000","last_peered":"2023-11-08T19:30:35.806226+0000","last_clean":"2023-11-08T19:30:35.806226+0000","last_became_active":"2023-11-08T19:24:31.147181+0000","last_became_peered":"2023-11-08T19:24:31.147181+0000","last_unstale":"2023-11-08T19:30:35.806226+0000","last_undegraded":"2023-11-08T19:30:35.806226+0000","last_fullsized":"2023-11-08T19:30:35.806226+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:35.806133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:35.806133+0000","last_clean_scrub_stamp":"2023-11-08T19:30:35.806133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:42:01.284608+0000","scrub_duration":0.0014898750000000001,"objects_trimmed":0,"snaptrim_duration":0.00057135200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":62,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:34.037408+0000","last_change":"2023-11-08T19:30:34.037436+0000","last_active":"2023-11-08T19:30:34.037408+0000","last_peered":"2023-11-08T19:30:34.037408+0000","last_clean":"2023-11-08T19:30:34.037408+0000","last_became_active":"2023-11-08T19:25:46.288848+0000","last_became_peered":"2023-11-08T19:25:46.288848+0000","last_unstale":"2023-11-08T19:30:34.037408+0000","last_undegraded":"2023-11-08T19:30:34.037408+0000","last_fullsized":"2023-11-08T19:30:34.037408+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:34.037323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:34.037323+0000","last_clean_scrub_stamp":"2023-11-08T19:30:34.037323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:25:01.213113+0000","scrub_duration":0.0018533829999999999,"objects_trimmed":0,"snaptrim_duration":0.00097653099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":47,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:10.181805+0000","last_change":"2023-11-08T19:25:47.289456+0000","last_active":"2023-11-08T19:30:10.181805+0000","last_peered":"2023-11-08T19:30:10.181805+0000","last_clean":"2023-11-08T19:30:10.181805+0000","last_became_active":"2023-11-08T19:25:47.289177+0000","last_became_peered":"2023-11-08T19:25:47.289177+0000","last_unstale":"2023-11-08T19:30:10.181805+0000","last_undegraded":"2023-11-08T19:30:10.181805+0000","last_fullsized":"2023-11-08T19:30:10.181805+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":95,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:32.836983+0000","last_change":"2023-11-08T19:30:32.837006+0000","last_active":"2023-11-08T19:30:32.836983+0000","last_peered":"2023-11-08T19:30:32.836983+0000","last_clean":"2023-11-08T19:30:32.836983+0000","last_became_active":"2023-11-08T19:24:31.148857+0000","last_became_peered":"2023-11-08T19:24:31.148857+0000","last_unstale":"2023-11-08T19:30:32.836983+0000","last_undegraded":"2023-11-08T19:30:32.836983+0000","last_fullsized":"2023-11-08T19:30:32.836983+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:32.836889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:32.836889+0000","last_clean_scrub_stamp":"2023-11-08T19:30:32.836889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:55:04.192751+0000","scrub_duration":0.0021433870000000001,"objects_trimmed":0,"snaptrim_duration":0.00065078599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":62,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:27.077494+0000","last_change":"2023-11-08T19:30:27.077515+0000","last_active":"2023-11-08T19:30:27.077494+0000","last_peered":"2023-11-08T19:30:27.077494+0000","last_clean":"2023-11-08T19:30:27.077494+0000","last_became_active":"2023-11-08T19:25:46.286211+0000","last_became_peered":"2023-11-08T19:25:46.286211+0000","last_unstale":"2023-11-08T19:30:27.077494+0000","last_undegraded":"2023-11-08T19:30:27.077494+0000","last_fullsized":"2023-11-08T19:30:27.077494+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:27.077406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:27.077406+0000","last_clean_scrub_stamp":"2023-11-08T19:30:27.077406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:53:12.324357+0000","scrub_duration":0.0013463559999999999,"objects_trimmed":0,"snaptrim_duration":0.00073775700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":55,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:39.102569+0000","last_change":"2023-11-08T19:30:39.102569+0000","last_active":"2023-11-08T19:30:39.102569+0000","last_peered":"2023-11-08T19:30:39.102569+0000","last_clean":"2023-11-08T19:30:39.102569+0000","last_became_active":"2023-11-08T19:25:47.285728+0000","last_became_peered":"2023-11-08T19:25:47.285728+0000","last_unstale":"2023-11-08T19:30:39.102569+0000","last_undegraded":"2023-11-08T19:30:39.102569+0000","last_fullsized":"2023-11-08T19:30:39.102569+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:39.102407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:39.102407+0000","last_clean_scrub_stamp":"2023-11-08T19:30:39.102407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:30:01.083142+0000","scrub_duration":0.002129307,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":95,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:31.834768+0000","last_change":"2023-11-08T19:30:31.834805+0000","last_active":"2023-11-08T19:30:31.834768+0000","last_peered":"2023-11-08T19:30:31.834768+0000","last_clean":"2023-11-08T19:30:31.834768+0000","last_became_active":"2023-11-08T19:24:31.146557+0000","last_became_peered":"2023-11-08T19:24:31.146557+0000","last_unstale":"2023-11-08T19:30:31.834768+0000","last_undegraded":"2023-11-08T19:30:31.834768+0000","last_fullsized":"2023-11-08T19:30:31.834768+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:31.834620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:31.834620+0000","last_clean_scrub_stamp":"2023-11-08T19:30:31.834620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:30:28.179127+0000","scrub_duration":0.0020209350000000002,"objects_trimmed":0,"snaptrim_duration":0.00099450100000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":64,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:17.302756+0000","last_change":"2023-11-08T19:30:17.302756+0000","last_active":"2023-11-08T19:30:17.302756+0000","last_peered":"2023-11-08T19:30:17.302756+0000","last_clean":"2023-11-08T19:30:17.302756+0000","last_became_active":"2023-11-08T19:25:46.281273+0000","last_became_peered":"2023-11-08T19:25:46.281273+0000","last_unstale":"2023-11-08T19:30:17.302756+0000","last_undegraded":"2023-11-08T19:30:17.302756+0000","last_fullsized":"2023-11-08T19:30:17.302756+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:17.302603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:17.302603+0000","last_clean_scrub_stamp":"2023-11-08T19:30:17.302603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:48:34.591057+0000","scrub_duration":0.002093204,"objects_trimmed":0,"snaptrim_duration":0.0020904819999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":56,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:38.085343+0000","last_change":"2023-11-08T19:30:38.085343+0000","last_active":"2023-11-08T19:30:38.085343+0000","last_peered":"2023-11-08T19:30:38.085343+0000","last_clean":"2023-11-08T19:30:38.085343+0000","last_became_active":"2023-11-08T19:25:47.287905+0000","last_became_peered":"2023-11-08T19:25:47.287905+0000","last_unstale":"2023-11-08T19:30:38.085343+0000","last_undegraded":"2023-11-08T19:30:38.085343+0000","last_fullsized":"2023-11-08T19:30:38.085343+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:38.085222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:38.085222+0000","last_clean_scrub_stamp":"2023-11-08T19:30:38.085222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:11:34.653580+0000","scrub_duration":0.0021335199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":86,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:32.258156+0000","last_change":"2023-11-08T19:30:32.258190+0000","last_active":"2023-11-08T19:30:32.258156+0000","last_peered":"2023-11-08T19:30:32.258156+0000","last_clean":"2023-11-08T19:30:32.258156+0000","last_became_active":"2023-11-08T19:24:31.144341+0000","last_became_peered":"2023-11-08T19:24:31.144341+0000","last_unstale":"2023-11-08T19:30:32.258156+0000","last_undegraded":"2023-11-08T19:30:32.258156+0000","last_fullsized":"2023-11-08T19:30:32.258156+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:32.258018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:32.258018+0000","last_clean_scrub_stamp":"2023-11-08T19:30:32.258018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:03:25.085742+0000","scrub_duration":0.0022325040000000002,"objects_trimmed":0,"snaptrim_duration":0.00058308299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":62,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:19.065507+0000","last_change":"2023-11-08T19:30:19.065507+0000","last_active":"2023-11-08T19:30:19.065507+0000","last_peered":"2023-11-08T19:30:19.065507+0000","last_clean":"2023-11-08T19:30:19.065507+0000","last_became_active":"2023-11-08T19:25:46.286933+0000","last_became_peered":"2023-11-08T19:25:46.286933+0000","last_unstale":"2023-11-08T19:30:19.065507+0000","last_undegraded":"2023-11-08T19:30:19.065507+0000","last_fullsized":"2023-11-08T19:30:19.065507+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:19.065292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:19.065292+0000","last_clean_scrub_stamp":"2023-11-08T19:30:19.065292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:02:38.548129+0000","scrub_duration":0.0020157859999999999,"objects_trimmed":0,"snaptrim_duration":0.00080507500000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":55,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:35.078757+0000","last_change":"2023-11-08T19:30:35.078757+0000","last_active":"2023-11-08T19:30:35.078757+0000","last_peered":"2023-11-08T19:30:35.078757+0000","last_clean":"2023-11-08T19:30:35.078757+0000","last_became_active":"2023-11-08T19:25:47.282705+0000","last_became_peered":"2023-11-08T19:25:47.282705+0000","last_unstale":"2023-11-08T19:30:35.078757+0000","last_undegraded":"2023-11-08T19:30:35.078757+0000","last_fullsized":"2023-11-08T19:30:35.078757+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:35.078670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:35.078670+0000","last_clean_scrub_stamp":"2023-11-08T19:30:35.078670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:23:20.306422+0000","scrub_duration":0.001194697,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":86,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:13.025216+0000","last_change":"2023-11-08T19:30:13.025246+0000","last_active":"2023-11-08T19:30:13.025216+0000","last_peered":"2023-11-08T19:30:13.025216+0000","last_clean":"2023-11-08T19:30:13.025216+0000","last_became_active":"2023-11-08T19:24:31.143812+0000","last_became_peered":"2023-11-08T19:24:31.143812+0000","last_unstale":"2023-11-08T19:30:13.025216+0000","last_undegraded":"2023-11-08T19:30:13.025216+0000","last_fullsized":"2023-11-08T19:30:13.025216+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:13.025137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:13.025137+0000","last_clean_scrub_stamp":"2023-11-08T19:30:13.025137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:10:48.396169+0000","scrub_duration":0.0011907409999999999,"objects_trimmed":0,"snaptrim_duration":0.014956126,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":69,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:37.506805+0000","last_change":"2023-11-08T19:30:37.506805+0000","last_active":"2023-11-08T19:30:37.506805+0000","last_peered":"2023-11-08T19:30:37.506805+0000","last_clean":"2023-11-08T19:30:37.506805+0000","last_became_active":"2023-11-08T19:25:46.284288+0000","last_became_peered":"2023-11-08T19:25:46.284288+0000","last_unstale":"2023-11-08T19:30:37.506805+0000","last_undegraded":"2023-11-08T19:30:37.506805+0000","last_fullsized":"2023-11-08T19:30:37.506805+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:37.506674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:37.506674+0000","last_clean_scrub_stamp":"2023-11-08T19:30:37.506674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:19:17.738199+0000","scrub_duration":0.0020640739999999999,"objects_trimmed":0,"snaptrim_duration":0.001250894,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":62,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:38.480895+0000","last_change":"2023-11-08T19:30:38.480895+0000","last_active":"2023-11-08T19:30:38.480895+0000","last_peered":"2023-11-08T19:30:38.480895+0000","last_clean":"2023-11-08T19:30:38.480895+0000","last_became_active":"2023-11-08T19:25:47.282299+0000","last_became_peered":"2023-11-08T19:25:47.282299+0000","last_unstale":"2023-11-08T19:30:38.480895+0000","last_undegraded":"2023-11-08T19:30:38.480895+0000","last_fullsized":"2023-11-08T19:30:38.480895+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:38.480725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:38.480725+0000","last_clean_scrub_stamp":"2023-11-08T19:30:38.480725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:56:12.945221+0000","scrub_duration":0.0020465769999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":85,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:19.177045+0000","last_change":"2023-11-08T19:30:19.177082+0000","last_active":"2023-11-08T19:30:19.177045+0000","last_peered":"2023-11-08T19:30:19.177045+0000","last_clean":"2023-11-08T19:30:19.177045+0000","last_became_active":"2023-11-08T19:24:31.147384+0000","last_became_peered":"2023-11-08T19:24:31.147384+0000","last_unstale":"2023-11-08T19:30:19.177045+0000","last_undegraded":"2023-11-08T19:30:19.177045+0000","last_fullsized":"2023-11-08T19:30:19.177045+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:19.176943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:19.176943+0000","last_clean_scrub_stamp":"2023-11-08T19:30:19.176943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:39:08.064436+0000","scrub_duration":0.00154301,"objects_trimmed":0,"snaptrim_duration":0.00043834899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":69,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:34.554450+0000","last_change":"2023-11-08T19:30:34.554450+0000","last_active":"2023-11-08T19:30:34.554450+0000","last_peered":"2023-11-08T19:30:34.554450+0000","last_clean":"2023-11-08T19:30:34.554450+0000","last_became_active":"2023-11-08T19:25:46.285626+0000","last_became_peered":"2023-11-08T19:25:46.285626+0000","last_unstale":"2023-11-08T19:30:34.554450+0000","last_undegraded":"2023-11-08T19:30:34.554450+0000","last_fullsized":"2023-11-08T19:30:34.554450+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:34.554326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:34.554326+0000","last_clean_scrub_stamp":"2023-11-08T19:30:34.554326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:59:52.362317+0000","scrub_duration":0.0021201129999999999,"objects_trimmed":0,"snaptrim_duration":0.0019032459999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":54,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:13.898526+0000","last_change":"2023-11-08T19:25:47.287878+0000","last_active":"2023-11-08T19:30:13.898526+0000","last_peered":"2023-11-08T19:30:13.898526+0000","last_clean":"2023-11-08T19:30:13.898526+0000","last_became_active":"2023-11-08T19:25:47.287617+0000","last_became_peered":"2023-11-08T19:25:47.287617+0000","last_unstale":"2023-11-08T19:30:13.898526+0000","last_undegraded":"2023-11-08T19:30:13.898526+0000","last_fullsized":"2023-11-08T19:30:13.898526+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":96,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:28.670362+0000","last_change":"2023-11-08T19:30:28.670399+0000","last_active":"2023-11-08T19:30:28.670362+0000","last_peered":"2023-11-08T19:30:28.670362+0000","last_clean":"2023-11-08T19:30:28.670362+0000","last_became_active":"2023-11-08T19:24:31.144614+0000","last_became_peered":"2023-11-08T19:24:31.144614+0000","last_unstale":"2023-11-08T19:30:28.670362+0000","last_undegraded":"2023-11-08T19:30:28.670362+0000","last_fullsized":"2023-11-08T19:30:28.670362+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:28.670235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:28.670235+0000","last_clean_scrub_stamp":"2023-11-08T19:30:28.670235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:38:02.285835+0000","scrub_duration":0.0020853949999999999,"objects_trimmed":0,"snaptrim_duration":0.00050362200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":56,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:10.888804+0000","last_change":"2023-11-08T19:25:48.373636+0000","last_active":"2023-11-08T19:30:10.888804+0000","last_peered":"2023-11-08T19:30:10.888804+0000","last_clean":"2023-11-08T19:30:10.888804+0000","last_became_active":"2023-11-08T19:25:46.283803+0000","last_became_peered":"2023-11-08T19:25:46.283803+0000","last_unstale":"2023-11-08T19:30:10.888804+0000","last_undegraded":"2023-11-08T19:30:10.888804+0000","last_fullsized":"2023-11-08T19:30:10.888804+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002404855,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":55,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:47.906923+0000","last_change":"2023-11-08T19:30:47.906923+0000","last_active":"2023-11-08T19:30:47.906923+0000","last_peered":"2023-11-08T19:30:47.906923+0000","last_clean":"2023-11-08T19:30:47.906923+0000","last_became_active":"2023-11-08T19:25:47.287428+0000","last_became_peered":"2023-11-08T19:25:47.287428+0000","last_unstale":"2023-11-08T19:30:47.906923+0000","last_undegraded":"2023-11-08T19:30:47.906923+0000","last_fullsized":"2023-11-08T19:30:47.906923+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:47.906785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:47.906785+0000","last_clean_scrub_stamp":"2023-11-08T19:30:47.906785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:47:22.383967+0000","scrub_duration":0.0021926699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":85,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:21.174293+0000","last_change":"2023-11-08T19:30:21.174318+0000","last_active":"2023-11-08T19:30:21.174293+0000","last_peered":"2023-11-08T19:30:21.174293+0000","last_clean":"2023-11-08T19:30:21.174293+0000","last_became_active":"2023-11-08T19:24:31.146176+0000","last_became_peered":"2023-11-08T19:24:31.146176+0000","last_unstale":"2023-11-08T19:30:21.174293+0000","last_undegraded":"2023-11-08T19:30:21.174293+0000","last_fullsized":"2023-11-08T19:30:21.174293+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:21.174179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:21.174179+0000","last_clean_scrub_stamp":"2023-11-08T19:30:21.174179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:36:32.308961+0000","scrub_duration":0.001410056,"objects_trimmed":0,"snaptrim_duration":0.00048481000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":56,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:10.888763+0000","last_change":"2023-11-08T19:25:48.373345+0000","last_active":"2023-11-08T19:30:10.888763+0000","last_peered":"2023-11-08T19:30:10.888763+0000","last_clean":"2023-11-08T19:30:10.888763+0000","last_became_active":"2023-11-08T19:25:46.282460+0000","last_became_peered":"2023-11-08T19:25:46.282460+0000","last_unstale":"2023-11-08T19:30:10.888763+0000","last_undegraded":"2023-11-08T19:30:10.888763+0000","last_fullsized":"2023-11-08T19:30:10.888763+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001972863,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":62,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:43.580139+0000","last_change":"2023-11-08T19:30:43.580175+0000","last_active":"2023-11-08T19:30:43.580139+0000","last_peered":"2023-11-08T19:30:43.580139+0000","last_clean":"2023-11-08T19:30:43.580139+0000","last_became_active":"2023-11-08T19:25:47.283433+0000","last_became_peered":"2023-11-08T19:25:47.283433+0000","last_unstale":"2023-11-08T19:30:43.580139+0000","last_undegraded":"2023-11-08T19:30:43.580139+0000","last_fullsized":"2023-11-08T19:30:43.580139+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:43.580022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:43.580022+0000","last_clean_scrub_stamp":"2023-11-08T19:30:43.580022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:36:54.714804+0000","scrub_duration":0.001575403,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":86,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:18.021092+0000","last_change":"2023-11-08T19:30:18.021136+0000","last_active":"2023-11-08T19:30:18.021092+0000","last_peered":"2023-11-08T19:30:18.021092+0000","last_clean":"2023-11-08T19:30:18.021092+0000","last_became_active":"2023-11-08T19:24:31.142052+0000","last_became_peered":"2023-11-08T19:24:31.142052+0000","last_unstale":"2023-11-08T19:30:18.021092+0000","last_undegraded":"2023-11-08T19:30:18.021092+0000","last_fullsized":"2023-11-08T19:30:18.021092+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:18.020983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:18.020983+0000","last_clean_scrub_stamp":"2023-11-08T19:30:18.020983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:45.925711+0000","scrub_duration":0.001444657,"objects_trimmed":0,"snaptrim_duration":0.014881058000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":69,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:20.763205+0000","last_change":"2023-11-08T19:30:20.763230+0000","last_active":"2023-11-08T19:30:20.763205+0000","last_peered":"2023-11-08T19:30:20.763205+0000","last_clean":"2023-11-08T19:30:20.763205+0000","last_became_active":"2023-11-08T19:25:46.279287+0000","last_became_peered":"2023-11-08T19:25:46.279287+0000","last_unstale":"2023-11-08T19:30:20.763205+0000","last_undegraded":"2023-11-08T19:30:20.763205+0000","last_fullsized":"2023-11-08T19:30:20.763205+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:20.763104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:20.763104+0000","last_clean_scrub_stamp":"2023-11-08T19:30:20.763104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:14:02.974290+0000","scrub_duration":0.0021986850000000001,"objects_trimmed":0,"snaptrim_duration":0.00076856899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":54,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.748679+0000","last_change":"2023-11-08T19:25:47.285867+0000","last_active":"2023-11-08T19:30:05.748679+0000","last_peered":"2023-11-08T19:30:05.748679+0000","last_clean":"2023-11-08T19:30:05.748679+0000","last_became_active":"2023-11-08T19:25:47.285533+0000","last_became_peered":"2023-11-08T19:25:47.285533+0000","last_unstale":"2023-11-08T19:30:05.748679+0000","last_undegraded":"2023-11-08T19:30:05.748679+0000","last_fullsized":"2023-11-08T19:30:05.748679+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":85,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:28.080532+0000","last_change":"2023-11-08T19:30:28.080567+0000","last_active":"2023-11-08T19:30:28.080532+0000","last_peered":"2023-11-08T19:30:28.080532+0000","last_clean":"2023-11-08T19:30:28.080532+0000","last_became_active":"2023-11-08T19:24:31.148250+0000","last_became_peered":"2023-11-08T19:24:31.148250+0000","last_unstale":"2023-11-08T19:30:28.080532+0000","last_undegraded":"2023-11-08T19:30:28.080532+0000","last_fullsized":"2023-11-08T19:30:28.080532+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:28.080403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:28.080403+0000","last_clean_scrub_stamp":"2023-11-08T19:30:28.080403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:55.985131+0000","scrub_duration":0.0019137889999999999,"objects_trimmed":0,"snaptrim_duration":0.00043061299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":69,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:35.532680+0000","last_change":"2023-11-08T19:30:35.532724+0000","last_active":"2023-11-08T19:30:35.532680+0000","last_peered":"2023-11-08T19:30:35.532680+0000","last_clean":"2023-11-08T19:30:35.532680+0000","last_became_active":"2023-11-08T19:25:46.285478+0000","last_became_peered":"2023-11-08T19:25:46.285478+0000","last_unstale":"2023-11-08T19:30:35.532680+0000","last_undegraded":"2023-11-08T19:30:35.532680+0000","last_fullsized":"2023-11-08T19:30:35.532680+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:35.532556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:35.532556+0000","last_clean_scrub_stamp":"2023-11-08T19:30:35.532556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:30:31.877062+0000","scrub_duration":0.0023281920000000002,"objects_trimmed":0,"snaptrim_duration":0.000376339,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":55,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:37.148513+0000","last_change":"2023-11-08T19:30:37.148535+0000","last_active":"2023-11-08T19:30:37.148513+0000","last_peered":"2023-11-08T19:30:37.148513+0000","last_clean":"2023-11-08T19:30:37.148513+0000","last_became_active":"2023-11-08T19:25:47.283990+0000","last_became_peered":"2023-11-08T19:25:47.283990+0000","last_unstale":"2023-11-08T19:30:37.148513+0000","last_undegraded":"2023-11-08T19:30:37.148513+0000","last_fullsized":"2023-11-08T19:30:37.148513+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:37.148426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:37.148426+0000","last_clean_scrub_stamp":"2023-11-08T19:30:37.148426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:36:37.292961+0000","scrub_duration":0.001288958,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":96,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:17.692059+0000","last_change":"2023-11-08T19:30:17.692093+0000","last_active":"2023-11-08T19:30:17.692059+0000","last_peered":"2023-11-08T19:30:17.692059+0000","last_clean":"2023-11-08T19:30:17.692059+0000","last_became_active":"2023-11-08T19:24:31.147651+0000","last_became_peered":"2023-11-08T19:24:31.147651+0000","last_unstale":"2023-11-08T19:30:17.692059+0000","last_undegraded":"2023-11-08T19:30:17.692059+0000","last_fullsized":"2023-11-08T19:30:17.692059+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:17.691961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:17.691961+0000","last_clean_scrub_stamp":"2023-11-08T19:30:17.691961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:09:27.248808+0000","scrub_duration":0.001464531,"objects_trimmed":0,"snaptrim_duration":0.00043673300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":64,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:24.455713+0000","last_change":"2023-11-08T19:30:24.455713+0000","last_active":"2023-11-08T19:30:24.455713+0000","last_peered":"2023-11-08T19:30:24.455713+0000","last_clean":"2023-11-08T19:30:24.455713+0000","last_became_active":"2023-11-08T19:25:46.282307+0000","last_became_peered":"2023-11-08T19:25:46.282307+0000","last_unstale":"2023-11-08T19:30:24.455713+0000","last_undegraded":"2023-11-08T19:30:24.455713+0000","last_fullsized":"2023-11-08T19:30:24.455713+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:24.455579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:24.455579+0000","last_clean_scrub_stamp":"2023-11-08T19:30:24.455579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:54:59.466934+0000","scrub_duration":0.0015672119999999999,"objects_trimmed":0,"snaptrim_duration":0.00047078400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":55,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:36.116332+0000","last_change":"2023-11-08T19:30:36.116369+0000","last_active":"2023-11-08T19:30:36.116332+0000","last_peered":"2023-11-08T19:30:36.116332+0000","last_clean":"2023-11-08T19:30:36.116332+0000","last_became_active":"2023-11-08T19:25:47.283927+0000","last_became_peered":"2023-11-08T19:25:47.283927+0000","last_unstale":"2023-11-08T19:30:36.116332+0000","last_undegraded":"2023-11-08T19:30:36.116332+0000","last_fullsized":"2023-11-08T19:30:36.116332+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:36.116210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:36.116210+0000","last_clean_scrub_stamp":"2023-11-08T19:30:36.116210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:53:44.424059+0000","scrub_duration":0.0024934250000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":86,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:33.211437+0000","last_change":"2023-11-08T19:30:33.211479+0000","last_active":"2023-11-08T19:30:33.211437+0000","last_peered":"2023-11-08T19:30:33.211437+0000","last_clean":"2023-11-08T19:30:33.211437+0000","last_became_active":"2023-11-08T19:24:31.144329+0000","last_became_peered":"2023-11-08T19:24:31.144329+0000","last_unstale":"2023-11-08T19:30:33.211437+0000","last_undegraded":"2023-11-08T19:30:33.211437+0000","last_fullsized":"2023-11-08T19:30:33.211437+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:33.211330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:33.211330+0000","last_clean_scrub_stamp":"2023-11-08T19:30:33.211330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:58:45.837341+0000","scrub_duration":0.001523457,"objects_trimmed":0,"snaptrim_duration":0.00043484799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":64,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:45.247269+0000","last_change":"2023-11-08T19:30:45.247292+0000","last_active":"2023-11-08T19:30:45.247269+0000","last_peered":"2023-11-08T19:30:45.247269+0000","last_clean":"2023-11-08T19:30:45.247269+0000","last_became_active":"2023-11-08T19:25:46.281425+0000","last_became_peered":"2023-11-08T19:25:46.281425+0000","last_unstale":"2023-11-08T19:30:45.247269+0000","last_undegraded":"2023-11-08T19:30:45.247269+0000","last_fullsized":"2023-11-08T19:30:45.247269+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:45.247176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:45.247176+0000","last_clean_scrub_stamp":"2023-11-08T19:30:45.247176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:58:55.220138+0000","scrub_duration":0.0018807120000000001,"objects_trimmed":0,"snaptrim_duration":0.00124314,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":49,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:10.888808+0000","last_change":"2023-11-08T19:25:47.281724+0000","last_active":"2023-11-08T19:30:10.888808+0000","last_peered":"2023-11-08T19:30:10.888808+0000","last_clean":"2023-11-08T19:30:10.888808+0000","last_became_active":"2023-11-08T19:25:47.281425+0000","last_became_peered":"2023-11-08T19:25:47.281425+0000","last_unstale":"2023-11-08T19:30:10.888808+0000","last_undegraded":"2023-11-08T19:30:10.888808+0000","last_fullsized":"2023-11-08T19:30:10.888808+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":86,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:24.251328+0000","last_change":"2023-11-08T19:30:24.251351+0000","last_active":"2023-11-08T19:30:24.251328+0000","last_peered":"2023-11-08T19:30:24.251328+0000","last_clean":"2023-11-08T19:30:24.251328+0000","last_became_active":"2023-11-08T19:24:31.146260+0000","last_became_peered":"2023-11-08T19:24:31.146260+0000","last_unstale":"2023-11-08T19:30:24.251328+0000","last_undegraded":"2023-11-08T19:30:24.251328+0000","last_fullsized":"2023-11-08T19:30:24.251328+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:24.251241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:24.251241+0000","last_clean_scrub_stamp":"2023-11-08T19:30:24.251241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:48:47.364880+0000","scrub_duration":0.0021896609999999999,"objects_trimmed":0,"snaptrim_duration":0.00059842900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":62,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:21.078147+0000","last_change":"2023-11-08T19:30:21.078147+0000","last_active":"2023-11-08T19:30:21.078147+0000","last_peered":"2023-11-08T19:30:21.078147+0000","last_clean":"2023-11-08T19:30:21.078147+0000","last_became_active":"2023-11-08T19:25:46.286239+0000","last_became_peered":"2023-11-08T19:25:46.286239+0000","last_unstale":"2023-11-08T19:30:21.078147+0000","last_undegraded":"2023-11-08T19:30:21.078147+0000","last_fullsized":"2023-11-08T19:30:21.078147+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:21.078003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:21.078003+0000","last_clean_scrub_stamp":"2023-11-08T19:30:21.078003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:54:56.089359+0000","scrub_duration":0.001463238,"objects_trimmed":0,"snaptrim_duration":0.000722421,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":47,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:14.406240+0000","last_change":"2023-11-08T19:25:47.287874+0000","last_active":"2023-11-08T19:30:14.406240+0000","last_peered":"2023-11-08T19:30:14.406240+0000","last_clean":"2023-11-08T19:30:14.406240+0000","last_became_active":"2023-11-08T19:25:47.287456+0000","last_became_peered":"2023-11-08T19:25:47.287456+0000","last_unstale":"2023-11-08T19:30:14.406240+0000","last_undegraded":"2023-11-08T19:30:14.406240+0000","last_fullsized":"2023-11-08T19:30:14.406240+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":95,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:26.782952+0000","last_change":"2023-11-08T19:30:26.782978+0000","last_active":"2023-11-08T19:30:26.782952+0000","last_peered":"2023-11-08T19:30:26.782952+0000","last_clean":"2023-11-08T19:30:26.782952+0000","last_became_active":"2023-11-08T19:24:31.146154+0000","last_became_peered":"2023-11-08T19:24:31.146154+0000","last_unstale":"2023-11-08T19:30:26.782952+0000","last_undegraded":"2023-11-08T19:30:26.782952+0000","last_fullsized":"2023-11-08T19:30:26.782952+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:26.782839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:26.782839+0000","last_clean_scrub_stamp":"2023-11-08T19:30:26.782839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:28:53.767924+0000","scrub_duration":0.0015358430000000001,"objects_trimmed":0,"snaptrim_duration":0.00082432800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":63,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:35.060282+0000","last_change":"2023-11-08T19:30:35.060301+0000","last_active":"2023-11-08T19:30:35.060282+0000","last_peered":"2023-11-08T19:30:35.060282+0000","last_clean":"2023-11-08T19:30:35.060282+0000","last_became_active":"2023-11-08T19:25:46.290114+0000","last_became_peered":"2023-11-08T19:25:46.290114+0000","last_unstale":"2023-11-08T19:30:35.060282+0000","last_undegraded":"2023-11-08T19:30:35.060282+0000","last_fullsized":"2023-11-08T19:30:35.060282+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:35.060205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:35.060205+0000","last_clean_scrub_stamp":"2023-11-08T19:30:35.060205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:34:38.053321+0000","scrub_duration":0.0012027590000000001,"objects_trimmed":0,"snaptrim_duration":0.00061009499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":49,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:10.888842+0000","last_change":"2023-11-08T19:25:47.283046+0000","last_active":"2023-11-08T19:30:10.888842+0000","last_peered":"2023-11-08T19:30:10.888842+0000","last_clean":"2023-11-08T19:30:10.888842+0000","last_became_active":"2023-11-08T19:25:47.282763+0000","last_became_peered":"2023-11-08T19:25:47.282763+0000","last_unstale":"2023-11-08T19:30:10.888842+0000","last_undegraded":"2023-11-08T19:30:10.888842+0000","last_fullsized":"2023-11-08T19:30:10.888842+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":87,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:16.159719+0000","last_change":"2023-11-08T19:30:16.159719+0000","last_active":"2023-11-08T19:30:16.159719+0000","last_peered":"2023-11-08T19:30:16.159719+0000","last_clean":"2023-11-08T19:30:16.159719+0000","last_became_active":"2023-11-08T19:24:31.139062+0000","last_became_peered":"2023-11-08T19:24:31.139062+0000","last_unstale":"2023-11-08T19:30:16.159719+0000","last_undegraded":"2023-11-08T19:30:16.159719+0000","last_fullsized":"2023-11-08T19:30:16.159719+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:16.159602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:16.159602+0000","last_clean_scrub_stamp":"2023-11-08T19:30:16.159602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:23:15.468689+0000","scrub_duration":0.00144932,"objects_trimmed":0,"snaptrim_duration":0.00033682599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":61,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:13.898430+0000","last_change":"2023-11-08T19:25:48.283302+0000","last_active":"2023-11-08T19:30:13.898430+0000","last_peered":"2023-11-08T19:30:13.898430+0000","last_clean":"2023-11-08T19:30:13.898430+0000","last_became_active":"2023-11-08T19:25:46.284287+0000","last_became_peered":"2023-11-08T19:25:46.284287+0000","last_unstale":"2023-11-08T19:30:13.898430+0000","last_undegraded":"2023-11-08T19:30:13.898430+0000","last_fullsized":"2023-11-08T19:30:13.898430+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097880800000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":54,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:12.895566+0000","last_change":"2023-11-08T19:25:47.286434+0000","last_active":"2023-11-08T19:30:12.895566+0000","last_peered":"2023-11-08T19:30:12.895566+0000","last_clean":"2023-11-08T19:30:12.895566+0000","last_became_active":"2023-11-08T19:25:47.286181+0000","last_became_peered":"2023-11-08T19:25:47.286181+0000","last_unstale":"2023-11-08T19:30:12.895566+0000","last_undegraded":"2023-11-08T19:30:12.895566+0000","last_fullsized":"2023-11-08T19:30:12.895566+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":96,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:39.738027+0000","last_change":"2023-11-08T19:30:39.738027+0000","last_active":"2023-11-08T19:30:39.738027+0000","last_peered":"2023-11-08T19:30:39.738027+0000","last_clean":"2023-11-08T19:30:39.738027+0000","last_became_active":"2023-11-08T19:24:31.146668+0000","last_became_peered":"2023-11-08T19:24:31.146668+0000","last_unstale":"2023-11-08T19:30:39.738027+0000","last_undegraded":"2023-11-08T19:30:39.738027+0000","last_fullsized":"2023-11-08T19:30:39.738027+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:39.737903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:39.737903+0000","last_clean_scrub_stamp":"2023-11-08T19:30:39.737903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:39:28.625396+0000","scrub_duration":0.0015030569999999999,"objects_trimmed":0,"snaptrim_duration":0.00071576699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":64,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:20.518808+0000","last_change":"2023-11-08T19:30:20.518808+0000","last_active":"2023-11-08T19:30:20.518808+0000","last_peered":"2023-11-08T19:30:20.518808+0000","last_clean":"2023-11-08T19:30:20.518808+0000","last_became_active":"2023-11-08T19:25:46.290246+0000","last_became_peered":"2023-11-08T19:25:46.290246+0000","last_unstale":"2023-11-08T19:30:20.518808+0000","last_undegraded":"2023-11-08T19:30:20.518808+0000","last_fullsized":"2023-11-08T19:30:20.518808+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:20.518679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:20.518679+0000","last_clean_scrub_stamp":"2023-11-08T19:30:20.518679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:17:45.315742+0000","scrub_duration":0.0021647609999999999,"objects_trimmed":0,"snaptrim_duration":0.000423211,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":56,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:37.043659+0000","last_change":"2023-11-08T19:30:37.043659+0000","last_active":"2023-11-08T19:30:37.043659+0000","last_peered":"2023-11-08T19:30:37.043659+0000","last_clean":"2023-11-08T19:30:37.043659+0000","last_became_active":"2023-11-08T19:25:47.287412+0000","last_became_peered":"2023-11-08T19:25:47.287412+0000","last_unstale":"2023-11-08T19:30:37.043659+0000","last_undegraded":"2023-11-08T19:30:37.043659+0000","last_fullsized":"2023-11-08T19:30:37.043659+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:37.043522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:37.043522+0000","last_clean_scrub_stamp":"2023-11-08T19:30:37.043522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:23:20.268184+0000","scrub_duration":0.001539185,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":87,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:17.588716+0000","last_change":"2023-11-08T19:30:17.588739+0000","last_active":"2023-11-08T19:30:17.588716+0000","last_peered":"2023-11-08T19:30:17.588716+0000","last_clean":"2023-11-08T19:30:17.588716+0000","last_became_active":"2023-11-08T19:24:31.144912+0000","last_became_peered":"2023-11-08T19:24:31.144912+0000","last_unstale":"2023-11-08T19:30:17.588716+0000","last_undegraded":"2023-11-08T19:30:17.588716+0000","last_fullsized":"2023-11-08T19:30:17.588716+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:17.588625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:17.588625+0000","last_clean_scrub_stamp":"2023-11-08T19:30:17.588625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:23:16.897713+0000","scrub_duration":0.0017421800000000001,"objects_trimmed":0,"snaptrim_duration":0.00056686900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":69,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:49.695152+0000","last_change":"2023-11-08T19:30:49.695175+0000","last_active":"2023-11-08T19:30:49.695152+0000","last_peered":"2023-11-08T19:30:49.695152+0000","last_clean":"2023-11-08T19:30:49.695152+0000","last_became_active":"2023-11-08T19:25:46.285848+0000","last_became_peered":"2023-11-08T19:25:46.285848+0000","last_unstale":"2023-11-08T19:30:49.695152+0000","last_undegraded":"2023-11-08T19:30:49.695152+0000","last_fullsized":"2023-11-08T19:30:49.695152+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:49.695018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:49.695018+0000","last_clean_scrub_stamp":"2023-11-08T19:30:49.695018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:26:17.014670+0000","scrub_duration":0.0022179819999999999,"objects_trimmed":0,"snaptrim_duration":0.00089732199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":57,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:33.491295+0000","last_change":"2023-11-08T19:30:33.491295+0000","last_active":"2023-11-08T19:30:33.491295+0000","last_peered":"2023-11-08T19:30:33.491295+0000","last_clean":"2023-11-08T19:30:33.491295+0000","last_became_active":"2023-11-08T19:25:47.279913+0000","last_became_peered":"2023-11-08T19:25:47.279913+0000","last_unstale":"2023-11-08T19:30:33.491295+0000","last_undegraded":"2023-11-08T19:30:33.491295+0000","last_fullsized":"2023-11-08T19:30:33.491295+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:33.491165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:33.491165+0000","last_clean_scrub_stamp":"2023-11-08T19:30:33.491165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:25:00.666954+0000","scrub_duration":0.0021655239999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":86,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:17.139218+0000","last_change":"2023-11-08T19:30:17.139240+0000","last_active":"2023-11-08T19:30:17.139218+0000","last_peered":"2023-11-08T19:30:17.139218+0000","last_clean":"2023-11-08T19:30:17.139218+0000","last_became_active":"2023-11-08T19:24:31.149011+0000","last_became_peered":"2023-11-08T19:24:31.149011+0000","last_unstale":"2023-11-08T19:30:17.139218+0000","last_undegraded":"2023-11-08T19:30:17.139218+0000","last_fullsized":"2023-11-08T19:30:17.139218+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:17.139115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:17.139115+0000","last_clean_scrub_stamp":"2023-11-08T19:30:17.139115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:46:23.961331+0000","scrub_duration":0.0019318580000000001,"objects_trimmed":0,"snaptrim_duration":0.00033496900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":61,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:13.898433+0000","last_change":"2023-11-08T19:25:48.285075+0000","last_active":"2023-11-08T19:30:13.898433+0000","last_peered":"2023-11-08T19:30:13.898433+0000","last_clean":"2023-11-08T19:30:13.898433+0000","last_became_active":"2023-11-08T19:25:46.272479+0000","last_became_peered":"2023-11-08T19:25:46.272479+0000","last_unstale":"2023-11-08T19:30:13.898433+0000","last_undegraded":"2023-11-08T19:30:13.898433+0000","last_fullsized":"2023-11-08T19:30:13.898433+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:45.252340+0000","last_clean_scrub_stamp":"2023-11-08T19:25:45.252340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001158117,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574947,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28940,"kb_used_data":1924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342900,"statfs":{"total":96636764160,"available":96607129600,"internally_reserved":0,"allocated":1970176,"data_stored":1293718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:30:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.58199999999999996,"15min":0.55300000000000005},"min":{"1min":0.51500000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.59599999999999997,"15min":0.57399999999999995},"min":{"1min":0.42899999999999999,"5min":0.38500000000000001,"15min":0.377},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.66700000000000004}]},{"osd":1,"last update":"Wed Nov 8 19:30:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.56299999999999994,"15min":0.55100000000000005},"min":{"1min":0.48699999999999999,"5min":0.309,"15min":0.309},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56000000000000005,"15min":0.54000000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.37},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.72099999999999997}]},{"osd":2,"last update":"Wed Nov 8 19:30:14 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55300000000000005,"15min":0.52200000000000002},"min":{"1min":0.45400000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.56999999999999995,"15min":0.54500000000000004},"min":{"1min":0.42899999999999999,"5min":0.379,"15min":0.32400000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.622}]},{"osd":3,"last update":"Wed Nov 8 19:30:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.55600000000000005,"15min":0.54000000000000004},"min":{"1min":0.42599999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.58899999999999997,"15min":0.56799999999999995},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.36899999999999999},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.69199999999999995}]},{"osd":4,"last update":"Wed Nov 8 19:30:14 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48899999999999999,"15min":0.48499999999999999},"min":{"1min":0.36099999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70499999999999996,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51300000000000001,"15min":0.51600000000000001},"min":{"1min":0.39500000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.42999999999999999}]},{"osd":5,"last update":"Wed Nov 8 19:30:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.35499999999999998,"5min":0.35399999999999998,"15min":0.35099999999999998},"max":{"1min":0.79100000000000004,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.55100000000000005,"15min":0.56999999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.91100000000000003},"last":0.58699999999999997}]},{"osd":6,"last update":"Wed Nov 8 19:30:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.59299999999999997,"15min":0.60599999999999998},"min":{"1min":0.42299999999999999,"5min":0.40000000000000002,"15min":0.39300000000000002},"max":{"1min":0.72199999999999998,"5min":0.80400000000000005,"15min":0.86399999999999999},"last":0.496},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57799999999999996,"15min":0.56799999999999995},"min":{"1min":0.378,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.80800000000000005,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.56899999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574948,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28360,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343480,"statfs":{"total":96636764160,"available":96607723520,"internally_reserved":0,"allocated":1376256,"data_stored":703350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:30:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.54400000000000004,"15min":0.58399999999999996},"min":{"1min":0.33000000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.79300000000000004,"5min":0.82199999999999995,"15min":1.7549999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55000000000000004,"15min":0.57799999999999996},"min":{"1min":0.39100000000000001,"5min":0.313,"15min":0.28699999999999998},"max":{"1min":0.746,"5min":0.76800000000000002,"15min":1.478},"last":0.504}]},{"osd":1,"last update":"Wed Nov 8 19:30:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57999999999999996,"15min":0.59799999999999998},"min":{"1min":0.372,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.76200000000000001,"5min":0.77500000000000002,"15min":1.6619999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.628,"15min":0.65500000000000003},"min":{"1min":0.46300000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":1.649},"last":0.38300000000000001}]},{"osd":2,"last update":"Wed Nov 8 19:30:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.58999999999999997,"15min":0.56999999999999995},"min":{"1min":0.38600000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.60099999999999998,"15min":0.623},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.85399999999999998},"last":0.48799999999999999}]},{"osd":3,"last update":"Wed Nov 8 19:30:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.57099999999999995,"15min":0.60999999999999999},"min":{"1min":0.41899999999999998,"5min":0.36699999999999999,"15min":0.33500000000000002},"max":{"1min":0.77500000000000002,"5min":0.80300000000000005,"15min":1.766},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.56799999999999995,"15min":0.60399999999999998},"min":{"1min":0.44900000000000001,"5min":0.375,"15min":0.36699999999999999},"max":{"1min":0.78600000000000003,"5min":0.84399999999999997,"15min":1.8580000000000001},"last":0.51500000000000001}]},{"osd":4,"last update":"Wed Nov 8 19:30:09 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.51800000000000002,"15min":0.53300000000000003},"min":{"1min":0.318,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.755,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54600000000000004,"15min":0.56899999999999995},"min":{"1min":0.35199999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.82299999999999995,"5min":0.83499999999999996,"15min":0.89100000000000001},"last":0.56499999999999995}]},{"osd":5,"last update":"Wed Nov 8 19:30:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.53000000000000003,"15min":0.55600000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.57099999999999995,"15min":0.61499999999999999},"min":{"1min":0.40200000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.441}]},{"osd":7,"last update":"Wed Nov 8 19:30:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.58299999999999996,"15min":0.60399999999999998},"min":{"1min":0.374,"5min":0.312,"15min":0.312},"max":{"1min":0.85299999999999998,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.58699999999999997,"15min":0.628},"min":{"1min":0.46200000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.95099999999999996},"last":0.42199999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574947,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28360,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343480,"statfs":{"total":96636764160,"available":96607723520,"internally_reserved":0,"allocated":1376256,"data_stored":703350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:30:02 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.35799999999999998},"min":{"1min":0.247,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.46899999999999997,"5min":0.51200000000000001,"15min":1.2090000000000001},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.376,"5min":0.35899999999999999,"15min":0.39700000000000002},"min":{"1min":0.23599999999999999,"5min":0.22900000000000001,"15min":0.19700000000000001},"max":{"1min":0.49299999999999999,"5min":0.61599999999999999,"15min":2.1850000000000001},"last":0.35799999999999998}]},{"osd":2,"last update":"Wed Nov 8 19:30:02 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.35099999999999998,"15min":0.34799999999999998},"min":{"1min":0.26400000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.438,"5min":0.54400000000000004,"15min":0.59099999999999997},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.38700000000000001,"15min":0.39400000000000002},"min":{"1min":0.28299999999999997,"5min":0.253,"15min":0.24099999999999999},"max":{"1min":0.56000000000000005,"5min":0.623,"15min":1.2689999999999999},"last":0.38300000000000001}]},{"osd":3,"last update":"Wed Nov 8 19:30:02 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.41199999999999998,"15min":0.41799999999999998},"min":{"1min":0.32400000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.622,"5min":0.63100000000000001,"15min":1.24},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.39900000000000002,"15min":0.44400000000000001},"min":{"1min":0.30599999999999999,"5min":0.26100000000000001,"15min":0.253},"max":{"1min":0.54500000000000004,"5min":0.68200000000000005,"15min":2.2120000000000002},"last":0.40500000000000003}]},{"osd":4,"last update":"Wed Nov 8 19:30:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.59299999999999997,"15min":0.60799999999999998},"min":{"1min":0.42399999999999999,"5min":0.36899999999999999,"15min":0.32100000000000001},"max":{"1min":0.82299999999999995,"5min":0.93400000000000005,"15min":2.1579999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.58899999999999997,"15min":0.57399999999999995},"min":{"1min":0.438,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.78200000000000003,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.49299999999999999}]},{"osd":5,"last update":"Wed Nov 8 19:30:02 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.59499999999999997,"15min":0.57099999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.38100000000000001},"max":{"1min":0.78300000000000003,"5min":0.82599999999999996,"15min":0.86399999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59599999999999997,"15min":0.60499999999999998},"min":{"1min":0.437,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77300000000000002,"5min":0.90800000000000003,"15min":1.115},"last":0.45100000000000001}]},{"osd":6,"last update":"Wed Nov 8 19:30:02 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.60099999999999998,"15min":0.628},"min":{"1min":0.40500000000000003,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.76800000000000002,"5min":0.88400000000000001,"15min":2.093},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.435,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.752,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.58099999999999996}]},{"osd":7,"last update":"Wed Nov 8 19:30:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.621,"15min":0.65700000000000003},"min":{"1min":0.44600000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.80300000000000005,"5min":0.876,"15min":1.591},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61099999999999999,"15min":0.66800000000000004},"min":{"1min":0.49299999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.77900000000000003,"5min":0.88400000000000001,"15min":2.1299999999999999},"last":0.56399999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574947,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33100,"kb_used_data":1924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338740,"statfs":{"total":96636764160,"available":96602869760,"internally_reserved":0,"allocated":1970176,"data_stored":1293718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:30:11 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.42399999999999999,"15min":0.90400000000000003},"min":{"1min":0.25700000000000001,"5min":0.19500000000000001,"15min":0.192},"max":{"1min":0.53100000000000003,"5min":6.9509999999999996,"15min":19.295999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.372,"15min":0.82199999999999995},"min":{"1min":0.27400000000000002,"5min":0.222,"15min":0.222},"max":{"1min":0.54900000000000004,"5min":0.57399999999999995,"15min":17.204000000000001},"last":0.40000000000000002}]},{"osd":2,"last update":"Wed Nov 8 19:30:11 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.45300000000000001,"15min":0.56799999999999995},"min":{"1min":0.26500000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.503,"5min":6.8029999999999999,"15min":6.8029999999999999},"last":0.307},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.41499999999999998,"15min":0.86399999999999999},"min":{"1min":0.311,"5min":0.28999999999999998,"15min":0.23100000000000001},"max":{"1min":0.59799999999999998,"5min":1.3140000000000001,"15min":17.175000000000001},"last":0.53200000000000003}]},{"osd":3,"last update":"Wed Nov 8 19:30:11 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.53500000000000003,"15min":0.79700000000000004},"min":{"1min":0.26400000000000001,"5min":0.24399999999999999,"15min":0.22500000000000001},"max":{"1min":0.52200000000000002,"5min":16.661000000000001,"15min":16.661000000000001},"last":0.432},{"interface":"front","average":{"1min":0.432,"5min":0.496,"15min":0.433},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.255},"max":{"1min":0.57499999999999996,"5min":6.9859999999999998,"15min":6.9859999999999998},"last":0.56299999999999994}]},{"osd":4,"last update":"Wed Nov 8 19:30:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.61199999999999999,"15min":1.0249999999999999},"min":{"1min":0.49099999999999999,"5min":0.36699999999999999,"15min":0.313},"max":{"1min":0.755,"5min":1.0029999999999999,"15min":17.056000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.75700000000000001,"15min":0.75},"min":{"1min":0.438,"5min":0.33100000000000002,"15min":0.33000000000000002},"max":{"1min":0.75600000000000001,"5min":16.718,"15min":16.718},"last":0.55300000000000005}]},{"osd":5,"last update":"Wed Nov 8 19:30:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.752,"15min":0.75},"min":{"1min":0.45300000000000001,"5min":0.36199999999999999,"15min":0.35799999999999998},"max":{"1min":0.79400000000000004,"5min":16.609000000000002,"15min":16.609000000000002},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.67200000000000004,"15min":0.60099999999999998},"min":{"1min":0.42799999999999999,"5min":0.40100000000000002,"15min":0.34599999999999997},"max":{"1min":0.76700000000000002,"5min":5.1639999999999997,"15min":5.1639999999999997},"last":0.60399999999999998}]},{"osd":6,"last update":"Wed Nov 8 19:30:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.69499999999999995,"15min":0.63500000000000001},"min":{"1min":0.47999999999999998,"5min":0.42699999999999999,"15min":0.36599999999999999},"max":{"1min":0.74099999999999999,"5min":6.6349999999999998,"15min":6.6349999999999998},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.66500000000000004,"15min":1.0740000000000001},"min":{"1min":0.52400000000000002,"5min":0.42199999999999999,"15min":0.34899999999999998},"max":{"1min":0.74299999999999999,"5min":3.1400000000000001,"15min":17.111999999999998},"last":0.59199999999999997}]},{"osd":7,"last update":"Wed Nov 8 19:30:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65000000000000002,"15min":1.079},"min":{"1min":0.55400000000000005,"5min":0.43099999999999999,"15min":0.376},"max":{"1min":0.77700000000000002,"5min":1.0760000000000001,"15min":17.146000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.76700000000000002,"15min":0.76200000000000001},"min":{"1min":0.495,"5min":0.441,"15min":0.38800000000000001},"max":{"1min":0.78100000000000003,"5min":16.690999999999999,"15min":16.690999999999999},"last":0.57999999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574947,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28360,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343480,"statfs":{"total":96636764160,"available":96607723520,"internally_reserved":0,"allocated":1376256,"data_stored":703350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:30:17 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.33700000000000002,"15min":0.432},"min":{"1min":0.253,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.436,"5min":0.61299999999999999,"15min":3.4100000000000001},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.39000000000000001,"15min":0.47399999999999998},"min":{"1min":0.22,"5min":0.219,"15min":0.21199999999999999},"max":{"1min":0.68000000000000005,"5min":1.8340000000000001,"15min":3.4369999999999998},"last":0.44900000000000001}]},{"osd":1,"last update":"Wed Nov 8 19:30:17 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.38100000000000001,"15min":0.498},"min":{"1min":0.27400000000000002,"5min":0.24299999999999999,"15min":0.23599999999999999},"max":{"1min":0.504,"5min":0.60699999999999998,"15min":4.0679999999999996},"last":0.374},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.44,"15min":0.54900000000000004},"min":{"1min":0.34499999999999997,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.59399999999999997,"5min":0.71899999999999997,"15min":4.3499999999999996},"last":0.42299999999999999}]},{"osd":3,"last update":"Wed Nov 8 19:30:17 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.40300000000000002,"15min":0.497},"min":{"1min":0.28799999999999998,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.53200000000000003,"5min":0.82999999999999996,"15min":3.8580000000000001},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.38,"5min":0.38500000000000001,"15min":0.47299999999999998},"min":{"1min":0.248,"5min":0.217,"15min":0.217},"max":{"1min":0.52700000000000002,"5min":0.78500000000000003,"15min":3.476},"last":0.35499999999999998}]},{"osd":4,"last update":"Wed Nov 8 19:30:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.64200000000000002,"15min":0.69499999999999995},"min":{"1min":0.41099999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.79400000000000004,"5min":4.7990000000000004,"15min":4.7990000000000004},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.57799999999999996,"15min":0.68700000000000006},"min":{"1min":0.41999999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.753,"5min":0.872,"15min":4.1040000000000001},"last":0.58699999999999997}]},{"osd":5,"last update":"Wed Nov 8 19:30:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.59799999999999998,"15min":0.69899999999999995},"min":{"1min":0.38900000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.80800000000000005,"5min":0.88,"15min":4.0869999999999997},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.63800000000000001,"15min":0.71399999999999997},"min":{"1min":0.39700000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.71899999999999997,"5min":4.8239999999999998,"15min":4.8239999999999998},"last":0.57499999999999996}]},{"osd":6,"last update":"Wed Nov 8 19:30:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.60299999999999998,"15min":0.71199999999999997},"min":{"1min":0.379,"5min":0.375,"15min":0.375},"max":{"1min":0.755,"5min":1.1200000000000001,"15min":4.1399999999999997},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.59899999999999998,"15min":0.69199999999999995},"min":{"1min":0.38,"5min":0.374,"15min":0.374},"max":{"1min":0.80600000000000005,"5min":0.85599999999999998,"15min":4.0499999999999998},"last":0.66200000000000003}]},{"osd":7,"last update":"Wed Nov 8 19:30:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.626,"15min":0.72699999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.78800000000000003,"5min":0.877,"15min":4.157},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.64500000000000002,"15min":0.753},"min":{"1min":0.45300000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.77300000000000002,"5min":0.95599999999999996,"15min":4.1710000000000003},"last":0.71699999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574947,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28360,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343480,"statfs":{"total":96636764160,"available":96607723520,"internally_reserved":0,"allocated":1376256,"data_stored":703350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:30:06 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.375,"15min":0.38200000000000001},"min":{"1min":0.24299999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.57599999999999996,"5min":0.67100000000000004,"15min":1.458},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39600000000000002},"min":{"1min":0.26900000000000002,"5min":0.192,"15min":0.192},"max":{"1min":0.57899999999999996,"5min":0.626,"15min":1.3939999999999999},"last":0.58299999999999996}]},{"osd":1,"last update":"Wed Nov 8 19:30:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.40100000000000002,"15min":0.40799999999999997},"min":{"1min":0.27200000000000002,"5min":0.25900000000000001,"15min":0.245},"max":{"1min":0.57099999999999995,"5min":0.61199999999999999,"15min":1.512},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.41599999999999998,"15min":0.437},"min":{"1min":0.29699999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.55800000000000005,"5min":0.59999999999999998,"15min":1.5580000000000001},"last":0.52500000000000002}]},{"osd":2,"last update":"Wed Nov 8 19:30:06 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.377,"15min":0.377},"min":{"1min":0.25600000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.50600000000000001,"5min":1.1100000000000001,"15min":1.2030000000000001},"last":0.629},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.40100000000000002,"15min":0.41999999999999998},"min":{"1min":0.29599999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.54900000000000004,"5min":0.72399999999999998,"15min":1.536},"last":0.49299999999999999}]},{"osd":4,"last update":"Wed Nov 8 19:30:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61499999999999999,"15min":0.61799999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.36799999999999999},"max":{"1min":0.77500000000000002,"5min":0.86199999999999999,"15min":1.3400000000000001},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.628,"15min":0.61599999999999999},"min":{"1min":0.40500000000000003,"5min":0.371,"15min":0.371},"max":{"1min":0.81799999999999995,"5min":0.84999999999999998,"15min":1.153},"last":0.754}]},{"osd":5,"last update":"Wed Nov 8 19:30:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.58999999999999997,"15min":0.59099999999999997},"min":{"1min":0.46899999999999997,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.78900000000000003,"5min":0.84999999999999998,"15min":1.4870000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.58399999999999996,"15min":0.59699999999999998},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.74199999999999999,"5min":0.82799999999999996,"15min":1.3129999999999999},"last":0.65500000000000003}]},{"osd":6,"last update":"Wed Nov 8 19:30:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58099999999999996,"15min":0.57999999999999996},"min":{"1min":0.38400000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.80700000000000005,"5min":0.86799999999999999,"15min":1.113},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60399999999999998,"15min":0.60999999999999999},"min":{"1min":0.442,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.82199999999999995,"5min":0.85899999999999999,"15min":1.4139999999999999},"last":0.72399999999999998}]},{"osd":7,"last update":"Wed Nov 8 19:30:06 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.61599999999999999,"15min":0.63700000000000001},"min":{"1min":0.42999999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.84799999999999998,"5min":0.89300000000000002,"15min":1.3680000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.64000000000000001,"15min":0.625},"min":{"1min":0.47799999999999998,"5min":0.45700000000000002,"15min":0.42299999999999999},"max":{"1min":0.86099999999999999,"5min":0.89000000000000001,"15min":1.179},"last":0.81299999999999994}]}]},{"osd":4,"up_from":13,"seq":55834574947,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28360,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343480,"statfs":{"total":96636764160,"available":96607723520,"internally_reserved":0,"allocated":1376256,"data_stored":703350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:30:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.56200000000000006,"15min":0.54500000000000004},"min":{"1min":0.378,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.69699999999999995,"5min":0.80100000000000005,"15min":1.399},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.55700000000000005,"15min":0.58299999999999996},"min":{"1min":0.38800000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.84799999999999998,"5min":0.89500000000000002,"15min":2.2090000000000001},"last":0.60099999999999998}]},{"osd":1,"last update":"Wed Nov 8 19:30:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.54600000000000004,"15min":0.52200000000000002},"min":{"1min":0.34899999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.66000000000000003,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53500000000000003,"15min":0.50900000000000001},"min":{"1min":0.37,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.68000000000000005}]},{"osd":2,"last update":"Wed Nov 8 19:30:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57999999999999996,"15min":0.61699999999999999},"min":{"1min":0.34000000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73099999999999998,"5min":0.80800000000000005,"15min":2.8490000000000002},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57399999999999995,"15min":0.53900000000000003},"min":{"1min":0.41799999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.752,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.69499999999999995}]},{"osd":3,"last update":"Wed Nov 8 19:30:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60899999999999999,"15min":0.57999999999999996},"min":{"1min":0.433,"5min":0.371,"15min":0.371},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.628,"15min":0.69399999999999995},"min":{"1min":0.41399999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.81899999999999995,"5min":0.86199999999999999,"15min":3.4849999999999999},"last":0.76700000000000002}]},{"osd":5,"last update":"Wed Nov 8 19:30:07 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.47799999999999998,"15min":0.50700000000000001},"min":{"1min":0.32900000000000001,"5min":0.314,"15min":0.313},"max":{"1min":0.63900000000000001,"5min":0.746,"15min":0.91500000000000004},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.54100000000000004,"15min":0.55300000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.32300000000000001},"max":{"1min":0.78900000000000003,"5min":0.79100000000000004,"15min":0.90500000000000003},"last":0.47199999999999998}]},{"osd":6,"last update":"Wed Nov 8 19:30:07 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.52900000000000003,"15min":0.65500000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.68700000000000006,"5min":0.80300000000000005,"15min":4.1529999999999996},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.57399999999999995,"15min":0.59999999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.94099999999999995},"last":0.61399999999999999}]},{"osd":7,"last update":"Wed Nov 8 19:30:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54900000000000004,"15min":0.56399999999999995},"min":{"1min":0.40999999999999998,"5min":0.39500000000000002,"15min":0.34499999999999997},"max":{"1min":0.70099999999999996,"5min":0.77800000000000002,"15min":0.99399999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.63200000000000001,"15min":0.78300000000000003},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.76300000000000001,"5min":0.85199999999999998,"15min":5.5359999999999996},"last":0.70799999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574947,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28360,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343480,"statfs":{"total":96636764160,"available":96607723520,"internally_reserved":0,"allocated":1376256,"data_stored":703350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:30:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52900000000000003,"15min":0.54200000000000004},"min":{"1min":0.311,"5min":0.30399999999999999,"15min":0.26000000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":2.2360000000000002},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.54400000000000004,"15min":0.52800000000000002},"min":{"1min":0.371,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.71299999999999997,"5min":0.77900000000000003,"15min":0.878},"last":0.63800000000000001}]},{"osd":1,"last update":"Wed Nov 8 19:30:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.59099999999999997,"15min":0.56000000000000005},"min":{"1min":0.39400000000000002,"5min":0.28000000000000003,"15min":0.27600000000000002},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56699999999999995,"15min":0.59499999999999997},"min":{"1min":0.35999999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":2.2919999999999998},"last":0.621}]},{"osd":2,"last update":"Wed Nov 8 19:30:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.55700000000000005,"15min":0.55800000000000005},"min":{"1min":0.39200000000000002,"5min":0.33800000000000002,"15min":0.33000000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.435},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56899999999999995,"15min":0.54100000000000004},"min":{"1min":0.39700000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.65600000000000003}]},{"osd":3,"last update":"Wed Nov 8 19:30:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.57099999999999995,"15min":0.56100000000000005},"min":{"1min":0.41099999999999998,"5min":0.36699999999999999,"15min":0.35099999999999998},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58699999999999997,"15min":0.57799999999999996},"min":{"1min":0.38800000000000001,"5min":0.35599999999999998,"15min":0.34399999999999997},"max":{"1min":0.71799999999999997,"5min":0.76500000000000001,"15min":0.89900000000000002},"last":0.69699999999999995}]},{"osd":4,"last update":"Wed Nov 8 19:30:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.49399999999999999,"15min":0.56599999999999995},"min":{"1min":0.32300000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.753,"5min":0.81200000000000006,"15min":2.3300000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59899999999999998,"15min":0.623},"min":{"1min":0.41999999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.74099999999999999,"5min":0.77300000000000002,"15min":0.92300000000000004},"last":0.67500000000000004}]},{"osd":6,"last update":"Wed Nov 8 19:30:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.51600000000000001,"15min":0.56000000000000005},"min":{"1min":0.36599999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.68700000000000006,"5min":0.76300000000000001,"15min":0.89400000000000002},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.54600000000000004,"15min":0.629},"min":{"1min":0.38400000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.73799999999999999,"5min":0.80500000000000005,"15min":2.3650000000000002},"last":0.505}]},{"osd":7,"last update":"Wed Nov 8 19:30:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57399999999999995,"15min":0.61099999999999999},"min":{"1min":0.34799999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.73399999999999999,"5min":0.84499999999999997,"15min":0.88500000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.59699999999999998,"15min":0.63100000000000001},"min":{"1min":0.40500000000000003,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76800000000000002,"5min":0.80700000000000005,"15min":0.873},"last":0.60299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:30:55.571 INFO:tasks.ceph:pgid 12.c last_scrub_stamp 2023-11-08T19:25:45.252340+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=45, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:55.572 INFO:tasks.ceph:pgid 13.f last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:55.572 INFO:tasks.ceph:pgid 12.e last_scrub_stamp 2023-11-08T19:25:45.252340+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=45, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:55.572 INFO:tasks.ceph:pgid 13.1 last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:55.573 INFO:tasks.ceph:pgid 12.3 last_scrub_stamp 2023-11-08T19:25:45.252340+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=45, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:55.573 INFO:tasks.ceph:pgid 13.3 last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:55.574 INFO:tasks.ceph:pgid 13.4 last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:55.574 INFO:tasks.ceph:pgid 13.7 last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:55.575 INFO:tasks.ceph:pgid 13.1c last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:55.575 INFO:tasks.ceph:pgid 12.1d last_scrub_stamp 2023-11-08T19:25:45.252340+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=45, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:55.576 INFO:tasks.ceph:pgid 12.1c last_scrub_stamp 2023-11-08T19:25:45.252340+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=45, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:55.576 INFO:tasks.ceph:pgid 13.1f last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:55.577 INFO:tasks.ceph:pgid 13.12 last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:55.577 INFO:tasks.ceph:pgid 13.13 last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:55.578 INFO:tasks.ceph:pgid 13.14 last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:55.578 INFO:tasks.ceph:pgid 12.15 last_scrub_stamp 2023-11-08T19:25:45.252340+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=45, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:55.578 INFO:tasks.ceph:pgid 13.15 last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:55.579 INFO:tasks.ceph:pgid 12.16 last_scrub_stamp 2023-11-08T19:25:45.252340+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=45, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:30:55.579 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-08T19:31:08.925 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T19:31:08.928 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T19:31:15.582 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:31:15.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.710+0000 7f2a9b160700 1 Processor -- start 2023-11-08T19:31:15.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.710+0000 7f2a9b160700 1 -- start start 2023-11-08T19:31:15.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.711+0000 7f2a9b160700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2a940cc140 0x7f2a940cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:31:15.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.711+0000 7f2a9b160700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f2a940b2cd0 0x7f2a9415d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:31:15.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.711+0000 7f2a9b160700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a940cce50 con 0x7f2a940b2850 2023-11-08T19:31:15.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.711+0000 7f2a9b160700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a940b2430 con 0x7f2a940b2cd0 2023-11-08T19:31:15.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.711+0000 7f2a9b160700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a940cc520 con 0x7f2a940cc140 2023-11-08T19:31:15.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.711+0000 7f2a93fff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f2a940b2850 0x7f2a940cabf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:48240/0 (socket says 172.21.15.149:48240) 2023-11-08T19:31:15.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.711+0000 7f2a93fff700 1 -- 172.21.15.149:0/2130722914 learned_addr learned my addr 172.21.15.149:0/2130722914 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-11-08T19:31:15.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.711+0000 7f2a98efc700 1 --2- 172.21.15.149:0/2130722914 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2a940cc140 0x7f2a940cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:31:15.719 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.711+0000 7f2a996fd700 1 --2- 172.21.15.149:0/2130722914 >> v2:172.21.15.160:3300/0 conn(0x7f2a940b2cd0 0x7f2a9415d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:31:15.719 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.711+0000 7f2a937fe700 1 -- 172.21.15.149:0/2130722914 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1896019804 0 0) 0x7f2a940cce50 con 0x7f2a940b2850 2023-11-08T19:31:15.720 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.711+0000 7f2a937fe700 1 -- 172.21.15.149:0/2130722914 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a840035b0 con 0x7f2a940b2850 2023-11-08T19:31:15.720 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.711+0000 7f2a937fe700 1 -- 172.21.15.149:0/2130722914 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2264458478 0 0) 0x7f2a840035b0 con 0x7f2a940b2850 2023-11-08T19:31:15.720 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.711+0000 7f2a937fe700 1 -- 172.21.15.149:0/2130722914 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2a940cc140 msgr2=0x7f2a940cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:31:15.720 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.711+0000 7f2a937fe700 1 --2- 172.21.15.149:0/2130722914 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2a940cc140 0x7f2a940cc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:31:15.721 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.711+0000 7f2a937fe700 1 -- 172.21.15.149:0/2130722914 >> v2:172.21.15.160:3300/0 conn(0x7f2a940b2cd0 msgr2=0x7f2a9415d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:31:15.721 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.711+0000 7f2a937fe700 1 --2- 172.21.15.149:0/2130722914 >> v2:172.21.15.160:3300/0 conn(0x7f2a940b2cd0 0x7f2a9415d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:31:15.721 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.711+0000 7f2a937fe700 1 -- 172.21.15.149:0/2130722914 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a940b17b0 con 0x7f2a940b2850 2023-11-08T19:31:15.722 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.711+0000 7f2a937fe700 1 -- 172.21.15.149:0/2130722914 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1604066078 0 0) 0x7f2a80001670 con 0x7f2a940b2850 2023-11-08T19:31:15.722 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.711+0000 7f2a937fe700 1 -- 172.21.15.149:0/2130722914 >> v1:172.21.15.149:6789/0 conn(0x7f2a940b2850 legacy=0x7f2a940cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:31:15.722 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.711+0000 7f2a937fe700 1 --2- 172.21.15.149:0/2130722914 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a84003a00 0x7f2a84003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:31:15.723 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.711+0000 7f2a937fe700 1 --2- 172.21.15.149:0/2130722914 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2a940cc140 0x7f2a84004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:31:15.723 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.711+0000 7f2a937fe700 1 --2- 172.21.15.149:0/2130722914 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a84004d90 0x7f2a84005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:31:15.723 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.711+0000 7f2a937fe700 1 -- 172.21.15.149:0/2130722914 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a940b2430 con 0x7f2a84003a00 2023-11-08T19:31:15.723 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.711+0000 7f2a937fe700 1 -- 172.21.15.149:0/2130722914 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a940cc520 con 0x7f2a84004d90 2023-11-08T19:31:15.724 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.711+0000 7f2a937fe700 1 -- 172.21.15.149:0/2130722914 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8400ba10 con 0x7f2a940cc140 2023-11-08T19:31:15.724 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.712+0000 7f2a98efc700 1 --2- 172.21.15.149:0/2130722914 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a84003a00 0x7f2a84003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:31:15.724 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.712+0000 7f2a93fff700 1 --2- 172.21.15.149:0/2130722914 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2a940cc140 0x7f2a84004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:31:15.724 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.712+0000 7f2a996fd700 1 --2- 172.21.15.149:0/2130722914 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a84004d90 0x7f2a84005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:31:15.725 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.712+0000 7f2a98efc700 1 -- 172.21.15.149:0/2130722914 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2a940cc140 msgr2=0x7f2a84004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:31:15.725 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.712+0000 7f2a98efc700 1 --2- 172.21.15.149:0/2130722914 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2a940cc140 0x7f2a84004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:31:15.725 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.712+0000 7f2a98efc700 1 -- 172.21.15.149:0/2130722914 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a84004d90 msgr2=0x7f2a84005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:31:15.726 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.712+0000 7f2a98efc700 1 --2- 172.21.15.149:0/2130722914 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a84004d90 0x7f2a84005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:31:15.726 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.712+0000 7f2a98efc700 1 -- 172.21.15.149:0/2130722914 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a840035b0 con 0x7f2a84003a00 2023-11-08T19:31:15.726 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.712+0000 7f2a98efc700 1 --2- 172.21.15.149:0/2130722914 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a84003a00 0x7f2a84003e20 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f2a88009b40 tx=0x7f2a84005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc6d985f0ca976ee server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:31:15.726 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.712+0000 7f2a937fe700 1 -- 172.21.15.149:0/2130722914 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a88005a20 con 0x7f2a84003a00 2023-11-08T19:31:15.727 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.712+0000 7f2a937fe700 1 -- 172.21.15.149:0/2130722914 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a88005b80 con 0x7f2a84003a00 2023-11-08T19:31:15.727 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.712+0000 7f2a937fe700 1 -- 172.21.15.149:0/2130722914 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8800e6c0 con 0x7f2a84003a00 2023-11-08T19:31:15.727 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.713+0000 7f2a9b160700 1 -- 172.21.15.149:0/2130722914 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a84003a00 msgr2=0x7f2a84003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:31:15.728 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.713+0000 7f2a9b160700 1 --2- 172.21.15.149:0/2130722914 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a84003a00 0x7f2a84003e20 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f2a88009b40 tx=0x7f2a84005880 comp rx=0 tx=0).stop 2023-11-08T19:31:15.728 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.713+0000 7f2a996fd700 1 -- 172.21.15.149:0/2130722914 reap_dead start 2023-11-08T19:31:15.728 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.713+0000 7f2a9b160700 1 -- 172.21.15.149:0/2130722914 shutdown_connections 2023-11-08T19:31:15.728 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.713+0000 7f2a9b160700 1 -- 172.21.15.149:0/2130722914 >> 172.21.15.149:0/2130722914 conn(0x7f2a94099a40 msgr2=0x7f2a940d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:31:15.729 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.713+0000 7f2a9b160700 1 -- 172.21.15.149:0/2130722914 shutdown_connections 2023-11-08T19:31:15.729 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.713+0000 7f2a9b160700 1 -- 172.21.15.149:0/2130722914 wait complete. 2023-11-08T19:31:15.729 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.714+0000 7f2a9b160700 1 Processor -- start 2023-11-08T19:31:15.730 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.714+0000 7f2a9b160700 1 -- start start 2023-11-08T19:31:15.732 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.715+0000 7f2a9b160700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a84003a00 0x7f2a94154aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:31:15.733 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.715+0000 7f2a9b160700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2a941f45b0 0x7f2a940d0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:31:15.733 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.715+0000 7f2a9b160700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a941f4a30 0x7f2a940d0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:31:15.733 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.715+0000 7f2a9b160700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a94154fe0 con 0x7f2a941f4a30 2023-11-08T19:31:15.733 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.715+0000 7f2a9b160700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a940ad260 con 0x7f2a84003a00 2023-11-08T19:31:15.734 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.715+0000 7f2a9b160700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a940ad540 con 0x7f2a941f45b0 2023-11-08T19:31:15.734 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.715+0000 7f2a996fd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a941f4a30 0x7f2a940d0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:31:15.734 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.715+0000 7f2a996fd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a941f4a30 0x7f2a940d0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:46254/0 (socket says 172.21.15.149:46254) 2023-11-08T19:31:15.735 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.715+0000 7f2a996fd700 1 -- 172.21.15.149:0/92067538 learned_addr learned my addr 172.21.15.149:0/92067538 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:31:15.735 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.715+0000 7f2a93fff700 1 --2- 172.21.15.149:0/92067538 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2a941f45b0 0x7f2a940d0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:31:15.735 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.715+0000 7f2a98efc700 1 --2- 172.21.15.149:0/92067538 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a84003a00 0x7f2a94154aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:31:15.735 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.715+0000 7f2a996fd700 1 -- 172.21.15.149:0/92067538 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2a941f45b0 msgr2=0x7f2a940d0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:31:15.736 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.715+0000 7f2a996fd700 1 --2- 172.21.15.149:0/92067538 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2a941f45b0 0x7f2a940d0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:31:15.736 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.715+0000 7f2a996fd700 1 -- 172.21.15.149:0/92067538 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a84003a00 msgr2=0x7f2a94154aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:31:15.736 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.715+0000 7f2a996fd700 1 --2- 172.21.15.149:0/92067538 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a84003a00 0x7f2a94154aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:31:15.736 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.715+0000 7f2a996fd700 1 -- 172.21.15.149:0/92067538 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a940ad820 con 0x7f2a941f4a30 2023-11-08T19:31:15.737 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.715+0000 7f2a996fd700 1 --2- 172.21.15.149:0/92067538 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a941f4a30 0x7f2a940d0b70 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f2a940b3190 tx=0x7f2a8c011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:31:15.737 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.716+0000 7f2a917fa700 1 -- 172.21.15.149:0/92067538 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c00e040 con 0x7f2a941f4a30 2023-11-08T19:31:15.737 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.716+0000 7f2a917fa700 1 -- 172.21.15.149:0/92067538 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a8c00f040 con 0x7f2a941f4a30 2023-11-08T19:31:15.738 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.716+0000 7f2a9b160700 1 -- 172.21.15.149:0/92067538 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a940adb00 con 0x7f2a941f4a30 2023-11-08T19:31:15.738 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.716+0000 7f2a917fa700 1 -- 172.21.15.149:0/92067538 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c00fc40 con 0x7f2a941f4a30 2023-11-08T19:31:15.738 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.716+0000 7f2a9b160700 1 -- 172.21.15.149:0/92067538 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a940ae300 con 0x7f2a941f4a30 2023-11-08T19:31:15.738 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.717+0000 7f2a9b160700 1 -- 172.21.15.149:0/92067538 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a940ae020 con 0x7f2a941f4a30 2023-11-08T19:31:15.739 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.717+0000 7f2a917fa700 1 -- 172.21.15.149:0/92067538 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2a8c022460 con 0x7f2a941f4a30 2023-11-08T19:31:15.739 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.717+0000 7f2a917fa700 1 --2- 172.21.15.149:0/92067538 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2a7806af00 0x7f2a7806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:31:15.739 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.718+0000 7f2a917fa700 1 -- 172.21.15.149:0/92067538 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6999+0+0 (secure 0 0 0) 0x7f2a8c089ed0 con 0x7f2a941f4a30 2023-11-08T19:31:15.740 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.718+0000 7f2a98efc700 1 --2- 172.21.15.149:0/92067538 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2a7806af00 0x7f2a7806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:31:15.740 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.718+0000 7f2a98efc700 1 --2- 172.21.15.149:0/92067538 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2a7806af00 0x7f2a7806d3c0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f2a941f6940 tx=0x7f2a88008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:31:15.740 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.722+0000 7f2a917fa700 1 -- 172.21.15.149:0/92067538 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2a940ae020 con 0x7f2a941f4a30 2023-11-08T19:31:15.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.911+0000 7f2a9b160700 1 -- 172.21.15.149:0/92067538 --> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2a940b1d70 con 0x7f2a7806af00 2023-11-08T19:31:15.921 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.919+0000 7f2a917fa700 1 -- 172.21.15.149:0/92067538 <== mgr.4104 v2:172.21.15.149:6832/1929837472 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+294641 (secure 0 0 0) 0x7f2a88021040 con 0x7f2a7806af00 2023-11-08T19:31:15.925 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:31:15.928 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.922+0000 7f2a9b160700 1 -- 172.21.15.149:0/92067538 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2a7806af00 msgr2=0x7f2a7806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:31:15.928 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.922+0000 7f2a9b160700 1 --2- 172.21.15.149:0/92067538 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2a7806af00 0x7f2a7806d3c0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f2a941f6940 tx=0x7f2a88008030 comp rx=0 tx=0).stop 2023-11-08T19:31:15.928 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.922+0000 7f2a9b160700 1 -- 172.21.15.149:0/92067538 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a941f4a30 msgr2=0x7f2a940d0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:31:15.929 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.922+0000 7f2a9b160700 1 --2- 172.21.15.149:0/92067538 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a941f4a30 0x7f2a940d0b70 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f2a940b3190 tx=0x7f2a8c011ed0 comp rx=0 tx=0).stop 2023-11-08T19:31:15.929 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.923+0000 7f2a9b160700 1 -- 172.21.15.149:0/92067538 shutdown_connections 2023-11-08T19:31:15.929 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.923+0000 7f2a9b160700 1 --2- 172.21.15.149:0/92067538 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f2a7806af00 0x7f2a7806d3c0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:31:15.929 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.923+0000 7f2a9b160700 1 --2- 172.21.15.149:0/92067538 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a84003a00 0x7f2a94154aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:31:15.930 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.923+0000 7f2a9b160700 1 --2- 172.21.15.149:0/92067538 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a941f4a30 0x7f2a940d0b70 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:31:15.930 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.923+0000 7f2a9b160700 1 --2- 172.21.15.149:0/92067538 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2a941f45b0 0x7f2a940d0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:31:15.931 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.923+0000 7f2a9b160700 1 -- 172.21.15.149:0/92067538 >> 172.21.15.149:0/92067538 conn(0x7f2a94099a40 msgr2=0x7f2a9406f900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:31:15.931 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.923+0000 7f2a9b160700 1 -- 172.21.15.149:0/92067538 shutdown_connections 2023-11-08T19:31:15.931 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:15.923+0000 7f2a9b160700 1 -- 172.21.15.149:0/92067538 wait complete. 2023-11-08T19:31:15.931 INFO:teuthology.orchestra.run.smithi149.stderr:dumped all 2023-11-08T19:31:15.937 INFO:teuthology.orchestra.run.smithi149.stdout:{"pg_ready":true,"pg_map":{"version":353,"stamp":"2023-11-08T19:31:14.116227+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":232200,"kb_used_data":11912,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754742520,"statfs":{"total":773094113280,"available":772856340480,"internally_reserved":0,"allocated":12197888,"data_stored":6807536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003924"},"pg_stats":[{"pgid":"13.c","version":"0'0","reported_seq":55,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:39.195724+0000","last_change":"2023-11-08T19:30:39.195764+0000","last_active":"2023-11-08T19:30:39.195724+0000","last_peered":"2023-11-08T19:30:39.195724+0000","last_clean":"2023-11-08T19:30:39.195724+0000","last_became_active":"2023-11-08T19:25:47.284788+0000","last_became_peered":"2023-11-08T19:25:47.284788+0000","last_unstale":"2023-11-08T19:30:39.195724+0000","last_undegraded":"2023-11-08T19:30:39.195724+0000","last_fullsized":"2023-11-08T19:30:39.195724+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:39.195588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:39.195588+0000","last_clean_scrub_stamp":"2023-11-08T19:30:39.195588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:38:12.811188+0000","scrub_duration":0.0017506209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"111'119","reported_seq":256,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:16.176798+0000","last_change":"2023-11-08T19:30:16.176798+0000","last_active":"2023-11-08T19:30:16.176798+0000","last_peered":"2023-11-08T19:30:16.176798+0000","last_clean":"2023-11-08T19:30:16.176798+0000","last_became_active":"2023-11-08T19:22:58.053337+0000","last_became_peered":"2023-11-08T19:22:58.053337+0000","last_unstale":"2023-11-08T19:30:16.176798+0000","last_undegraded":"2023-11-08T19:30:16.176798+0000","last_fullsized":"2023-11-08T19:30:16.176798+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'119","last_scrub_stamp":"2023-11-08T19:30:16.176632+0000","last_deep_scrub":"111'119","last_deep_scrub_stamp":"2023-11-08T19:30:16.176632+0000","last_clean_scrub_stamp":"2023-11-08T19:30:16.176632+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:41:41.655108+0000","scrub_duration":0.0052701320000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":87,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:42.247526+0000","last_change":"2023-11-08T19:30:42.247526+0000","last_active":"2023-11-08T19:30:42.247526+0000","last_peered":"2023-11-08T19:30:42.247526+0000","last_clean":"2023-11-08T19:30:42.247526+0000","last_became_active":"2023-11-08T19:24:31.148363+0000","last_became_peered":"2023-11-08T19:24:31.148363+0000","last_unstale":"2023-11-08T19:30:42.247526+0000","last_undegraded":"2023-11-08T19:30:42.247526+0000","last_fullsized":"2023-11-08T19:30:42.247526+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:42.247410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:42.247410+0000","last_clean_scrub_stamp":"2023-11-08T19:30:42.247410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:42:17.743190+0000","scrub_duration":0.00190854,"objects_trimmed":0,"snaptrim_duration":0.00075444200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":62,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:36.139925+0000","last_change":"2023-11-08T19:30:36.139962+0000","last_active":"2023-11-08T19:30:36.139925+0000","last_peered":"2023-11-08T19:30:36.139925+0000","last_clean":"2023-11-08T19:30:36.139925+0000","last_became_active":"2023-11-08T19:25:46.289470+0000","last_became_peered":"2023-11-08T19:25:46.289470+0000","last_unstale":"2023-11-08T19:30:36.139925+0000","last_undegraded":"2023-11-08T19:30:36.139925+0000","last_fullsized":"2023-11-08T19:30:36.139925+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:36.139832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:36.139832+0000","last_clean_scrub_stamp":"2023-11-08T19:30:36.139832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:31:31.135502+0000","scrub_duration":0.001942477,"objects_trimmed":0,"snaptrim_duration":0.000371219,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":59,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:28.037056+0000","last_change":"2023-11-08T19:30:28.037082+0000","last_active":"2023-11-08T19:30:28.037056+0000","last_peered":"2023-11-08T19:30:28.037056+0000","last_clean":"2023-11-08T19:30:28.037056+0000","last_became_active":"2023-11-08T19:25:47.282922+0000","last_became_peered":"2023-11-08T19:25:47.282922+0000","last_unstale":"2023-11-08T19:30:28.037056+0000","last_undegraded":"2023-11-08T19:30:28.037056+0000","last_fullsized":"2023-11-08T19:30:28.037056+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:28.036969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:28.036969+0000","last_clean_scrub_stamp":"2023-11-08T19:30:28.036969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:26:53.908203+0000","scrub_duration":0.0019860609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":87,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:19.998985+0000","last_change":"2023-11-08T19:30:19.998985+0000","last_active":"2023-11-08T19:30:19.998985+0000","last_peered":"2023-11-08T19:30:19.998985+0000","last_clean":"2023-11-08T19:30:19.998985+0000","last_became_active":"2023-11-08T19:24:31.138598+0000","last_became_peered":"2023-11-08T19:24:31.138598+0000","last_unstale":"2023-11-08T19:30:19.998985+0000","last_undegraded":"2023-11-08T19:30:19.998985+0000","last_fullsized":"2023-11-08T19:30:19.998985+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:19.998879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:19.998879+0000","last_clean_scrub_stamp":"2023-11-08T19:30:19.998879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:18:08.731391+0000","scrub_duration":0.001419371,"objects_trimmed":0,"snaptrim_duration":0.015114824000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":66,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:19.886457+0000","last_change":"2023-11-08T19:30:19.886481+0000","last_active":"2023-11-08T19:30:19.886457+0000","last_peered":"2023-11-08T19:30:19.886457+0000","last_clean":"2023-11-08T19:30:19.886457+0000","last_became_active":"2023-11-08T19:25:46.279007+0000","last_became_peered":"2023-11-08T19:25:46.279007+0000","last_unstale":"2023-11-08T19:30:19.886457+0000","last_undegraded":"2023-11-08T19:30:19.886457+0000","last_fullsized":"2023-11-08T19:30:19.886457+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:19.886330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:19.886330+0000","last_clean_scrub_stamp":"2023-11-08T19:30:19.886330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:27:13.439557+0000","scrub_duration":0.001929435,"objects_trimmed":0,"snaptrim_duration":0.0036813240000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":57,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:29.504740+0000","last_change":"2023-11-08T19:30:29.504765+0000","last_active":"2023-11-08T19:30:29.504740+0000","last_peered":"2023-11-08T19:30:29.504740+0000","last_clean":"2023-11-08T19:30:29.504740+0000","last_became_active":"2023-11-08T19:25:47.284796+0000","last_became_peered":"2023-11-08T19:25:47.284796+0000","last_unstale":"2023-11-08T19:30:29.504740+0000","last_undegraded":"2023-11-08T19:30:29.504740+0000","last_fullsized":"2023-11-08T19:30:29.504740+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:29.504641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:29.504641+0000","last_clean_scrub_stamp":"2023-11-08T19:30:29.504641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:17:32.777171+0000","scrub_duration":0.002043577,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":87,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:14.999954+0000","last_change":"2023-11-08T19:30:14.999954+0000","last_active":"2023-11-08T19:30:14.999954+0000","last_peered":"2023-11-08T19:30:14.999954+0000","last_clean":"2023-11-08T19:30:14.999954+0000","last_became_active":"2023-11-08T19:24:31.142028+0000","last_became_peered":"2023-11-08T19:24:31.142028+0000","last_unstale":"2023-11-08T19:30:14.999954+0000","last_undegraded":"2023-11-08T19:30:14.999954+0000","last_fullsized":"2023-11-08T19:30:14.999954+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:14.999864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:14.999864+0000","last_clean_scrub_stamp":"2023-11-08T19:30:14.999864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:46:08.947796+0000","scrub_duration":0.001067143,"objects_trimmed":0,"snaptrim_duration":0.00067537399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":63,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:28.110765+0000","last_change":"2023-11-08T19:30:28.110801+0000","last_active":"2023-11-08T19:30:28.110765+0000","last_peered":"2023-11-08T19:30:28.110765+0000","last_clean":"2023-11-08T19:30:28.110765+0000","last_became_active":"2023-11-08T19:25:46.288739+0000","last_became_peered":"2023-11-08T19:25:46.288739+0000","last_unstale":"2023-11-08T19:30:28.110765+0000","last_undegraded":"2023-11-08T19:30:28.110765+0000","last_fullsized":"2023-11-08T19:30:28.110765+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:28.110672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:28.110672+0000","last_clean_scrub_stamp":"2023-11-08T19:30:28.110672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:49:10.857315+0000","scrub_duration":0.0014712219999999999,"objects_trimmed":0,"snaptrim_duration":0.0015057530000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":59,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:22.944958+0000","last_change":"2023-11-08T19:30:22.944994+0000","last_active":"2023-11-08T19:30:22.944958+0000","last_peered":"2023-11-08T19:30:22.944958+0000","last_clean":"2023-11-08T19:30:22.944958+0000","last_became_active":"2023-11-08T19:25:47.287494+0000","last_became_peered":"2023-11-08T19:25:47.287494+0000","last_unstale":"2023-11-08T19:30:22.944958+0000","last_undegraded":"2023-11-08T19:30:22.944958+0000","last_fullsized":"2023-11-08T19:30:22.944958+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:22.944836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:22.944836+0000","last_clean_scrub_stamp":"2023-11-08T19:30:22.944836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:13:58.622747+0000","scrub_duration":0.001547238,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":88,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:13.647703+0000","last_change":"2023-11-08T19:30:13.647703+0000","last_active":"2023-11-08T19:30:13.647703+0000","last_peered":"2023-11-08T19:30:13.647703+0000","last_clean":"2023-11-08T19:30:13.647703+0000","last_became_active":"2023-11-08T19:24:31.141367+0000","last_became_peered":"2023-11-08T19:24:31.141367+0000","last_unstale":"2023-11-08T19:30:13.647703+0000","last_undegraded":"2023-11-08T19:30:13.647703+0000","last_fullsized":"2023-11-08T19:30:13.647703+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:13.647567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:13.647567+0000","last_clean_scrub_stamp":"2023-11-08T19:30:13.647567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:51:59.112379+0000","scrub_duration":0.0017188710000000001,"objects_trimmed":0,"snaptrim_duration":0.001335136,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":63,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:30.067419+0000","last_change":"2023-11-08T19:30:30.067450+0000","last_active":"2023-11-08T19:30:30.067419+0000","last_peered":"2023-11-08T19:30:30.067419+0000","last_clean":"2023-11-08T19:30:30.067419+0000","last_became_active":"2023-11-08T19:25:46.289283+0000","last_became_peered":"2023-11-08T19:25:46.289283+0000","last_unstale":"2023-11-08T19:30:30.067419+0000","last_undegraded":"2023-11-08T19:30:30.067419+0000","last_fullsized":"2023-11-08T19:30:30.067419+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:30.067319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:30.067319+0000","last_clean_scrub_stamp":"2023-11-08T19:30:30.067319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:16:49.675631+0000","scrub_duration":0.001437668,"objects_trimmed":0,"snaptrim_duration":0.001274049,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":57,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:36.471693+0000","last_change":"2023-11-08T19:30:36.471717+0000","last_active":"2023-11-08T19:30:36.471693+0000","last_peered":"2023-11-08T19:30:36.471693+0000","last_clean":"2023-11-08T19:30:36.471693+0000","last_became_active":"2023-11-08T19:25:47.285075+0000","last_became_peered":"2023-11-08T19:25:47.285075+0000","last_unstale":"2023-11-08T19:30:36.471693+0000","last_undegraded":"2023-11-08T19:30:36.471693+0000","last_fullsized":"2023-11-08T19:30:36.471693+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:36.471601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:36.471601+0000","last_clean_scrub_stamp":"2023-11-08T19:30:36.471601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:10:24.384726+0000","scrub_duration":0.002370937,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":97,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:16.672700+0000","last_change":"2023-11-08T19:30:16.672700+0000","last_active":"2023-11-08T19:30:16.672700+0000","last_peered":"2023-11-08T19:30:16.672700+0000","last_clean":"2023-11-08T19:30:16.672700+0000","last_became_active":"2023-11-08T19:24:31.145329+0000","last_became_peered":"2023-11-08T19:24:31.145329+0000","last_unstale":"2023-11-08T19:30:16.672700+0000","last_undegraded":"2023-11-08T19:30:16.672700+0000","last_fullsized":"2023-11-08T19:30:16.672700+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:16.672581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:16.672581+0000","last_clean_scrub_stamp":"2023-11-08T19:30:16.672581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:23:01.900333+0000","scrub_duration":0.0018379830000000001,"objects_trimmed":0,"snaptrim_duration":0.00049012999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":66,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:20.921021+0000","last_change":"2023-11-08T19:30:20.921044+0000","last_active":"2023-11-08T19:30:20.921021+0000","last_peered":"2023-11-08T19:30:20.921021+0000","last_clean":"2023-11-08T19:30:20.921021+0000","last_became_active":"2023-11-08T19:25:46.282174+0000","last_became_peered":"2023-11-08T19:25:46.282174+0000","last_unstale":"2023-11-08T19:30:20.921021+0000","last_undegraded":"2023-11-08T19:30:20.921021+0000","last_fullsized":"2023-11-08T19:30:20.921021+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:20.920910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:20.920910+0000","last_clean_scrub_stamp":"2023-11-08T19:30:20.920910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:07:53.526415+0000","scrub_duration":0.0014780660000000001,"objects_trimmed":0,"snaptrim_duration":0.000727792,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":62,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:48.540579+0000","last_change":"2023-11-08T19:30:48.540606+0000","last_active":"2023-11-08T19:30:48.540579+0000","last_peered":"2023-11-08T19:30:48.540579+0000","last_clean":"2023-11-08T19:30:48.540579+0000","last_became_active":"2023-11-08T19:25:47.287419+0000","last_became_peered":"2023-11-08T19:25:47.287419+0000","last_unstale":"2023-11-08T19:30:48.540579+0000","last_undegraded":"2023-11-08T19:30:48.540579+0000","last_fullsized":"2023-11-08T19:30:48.540579+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:48.540462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:48.540462+0000","last_clean_scrub_stamp":"2023-11-08T19:30:48.540462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:58:16.445190+0000","scrub_duration":0.0024177930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":96,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:34.850967+0000","last_change":"2023-11-08T19:30:34.850967+0000","last_active":"2023-11-08T19:30:34.850967+0000","last_peered":"2023-11-08T19:30:34.850967+0000","last_clean":"2023-11-08T19:30:34.850967+0000","last_became_active":"2023-11-08T19:24:31.146063+0000","last_became_peered":"2023-11-08T19:24:31.146063+0000","last_unstale":"2023-11-08T19:30:34.850967+0000","last_undegraded":"2023-11-08T19:30:34.850967+0000","last_fullsized":"2023-11-08T19:30:34.850967+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:34.850866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:34.850866+0000","last_clean_scrub_stamp":"2023-11-08T19:30:34.850866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:36:22.019388+0000","scrub_duration":0.00177243,"objects_trimmed":0,"snaptrim_duration":0.00089896300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":64,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:55.429492+0000","last_change":"2023-11-08T19:30:55.429510+0000","last_active":"2023-11-08T19:30:55.429492+0000","last_peered":"2023-11-08T19:30:55.429492+0000","last_clean":"2023-11-08T19:30:55.429492+0000","last_became_active":"2023-11-08T19:25:46.281986+0000","last_became_peered":"2023-11-08T19:25:46.281986+0000","last_unstale":"2023-11-08T19:30:55.429492+0000","last_undegraded":"2023-11-08T19:30:55.429492+0000","last_fullsized":"2023-11-08T19:30:55.429492+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:55.429420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:55.429420+0000","last_clean_scrub_stamp":"2023-11-08T19:30:55.429420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:26:44.126324+0000","scrub_duration":0.001670782,"objects_trimmed":0,"snaptrim_duration":0.003067771,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":55,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:45.947469+0000","last_change":"2023-11-08T19:30:45.947492+0000","last_active":"2023-11-08T19:30:45.947469+0000","last_peered":"2023-11-08T19:30:45.947469+0000","last_clean":"2023-11-08T19:30:45.947469+0000","last_became_active":"2023-11-08T19:25:47.287560+0000","last_became_peered":"2023-11-08T19:25:47.287560+0000","last_unstale":"2023-11-08T19:30:45.947469+0000","last_undegraded":"2023-11-08T19:30:45.947469+0000","last_fullsized":"2023-11-08T19:30:45.947469+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:45.947375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:45.947375+0000","last_clean_scrub_stamp":"2023-11-08T19:30:45.947375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:46:08.051257+0000","scrub_duration":0.001481039,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":87,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:37.159886+0000","last_change":"2023-11-08T19:30:37.159886+0000","last_active":"2023-11-08T19:30:37.159886+0000","last_peered":"2023-11-08T19:30:37.159886+0000","last_clean":"2023-11-08T19:30:37.159886+0000","last_became_active":"2023-11-08T19:24:31.144223+0000","last_became_peered":"2023-11-08T19:24:31.144223+0000","last_unstale":"2023-11-08T19:30:37.159886+0000","last_undegraded":"2023-11-08T19:30:37.159886+0000","last_fullsized":"2023-11-08T19:30:37.159886+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:37.159760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:37.159760+0000","last_clean_scrub_stamp":"2023-11-08T19:30:37.159760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:30:10.933513+0000","scrub_duration":0.00183394,"objects_trimmed":0,"snaptrim_duration":0.00071879799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":69,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:21.808575+0000","last_change":"2023-11-08T19:30:21.808611+0000","last_active":"2023-11-08T19:30:21.808575+0000","last_peered":"2023-11-08T19:30:21.808575+0000","last_clean":"2023-11-08T19:30:21.808575+0000","last_became_active":"2023-11-08T19:25:46.278686+0000","last_became_peered":"2023-11-08T19:25:46.278686+0000","last_unstale":"2023-11-08T19:30:21.808575+0000","last_undegraded":"2023-11-08T19:30:21.808575+0000","last_fullsized":"2023-11-08T19:30:21.808575+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:21.808432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:21.808432+0000","last_clean_scrub_stamp":"2023-11-08T19:30:21.808432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:35:49.484450+0000","scrub_duration":0.0016393169999999999,"objects_trimmed":0,"snaptrim_duration":0.00078409499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":62,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:31:09.586287+0000","last_change":"2023-11-08T19:31:09.586314+0000","last_active":"2023-11-08T19:31:09.586287+0000","last_peered":"2023-11-08T19:31:09.586287+0000","last_clean":"2023-11-08T19:31:09.586287+0000","last_became_active":"2023-11-08T19:25:47.289362+0000","last_became_peered":"2023-11-08T19:25:47.289362+0000","last_unstale":"2023-11-08T19:31:09.586287+0000","last_undegraded":"2023-11-08T19:31:09.586287+0000","last_fullsized":"2023-11-08T19:31:09.586287+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:31:09.586172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:31:09.586172+0000","last_clean_scrub_stamp":"2023-11-08T19:31:09.586172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:41:56.894832+0000","scrub_duration":0.0016733010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":86,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:32.188564+0000","last_change":"2023-11-08T19:30:32.188564+0000","last_active":"2023-11-08T19:30:32.188564+0000","last_peered":"2023-11-08T19:30:32.188564+0000","last_clean":"2023-11-08T19:30:32.188564+0000","last_became_active":"2023-11-08T19:24:31.147082+0000","last_became_peered":"2023-11-08T19:24:31.147082+0000","last_unstale":"2023-11-08T19:30:32.188564+0000","last_undegraded":"2023-11-08T19:30:32.188564+0000","last_fullsized":"2023-11-08T19:30:32.188564+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:32.188459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:32.188459+0000","last_clean_scrub_stamp":"2023-11-08T19:30:32.188459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:25:59.508112+0000","scrub_duration":0.001809777,"objects_trimmed":0,"snaptrim_duration":0.00043701599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":64,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:58.429599+0000","last_change":"2023-11-08T19:30:58.429624+0000","last_active":"2023-11-08T19:30:58.429599+0000","last_peered":"2023-11-08T19:30:58.429599+0000","last_clean":"2023-11-08T19:30:58.429599+0000","last_became_active":"2023-11-08T19:25:46.282071+0000","last_became_peered":"2023-11-08T19:25:46.282071+0000","last_unstale":"2023-11-08T19:30:58.429599+0000","last_undegraded":"2023-11-08T19:30:58.429599+0000","last_fullsized":"2023-11-08T19:30:58.429599+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:58.429503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:58.429503+0000","last_clean_scrub_stamp":"2023-11-08T19:30:58.429503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:25:29.520870+0000","scrub_duration":0.0021116139999999999,"objects_trimmed":0,"snaptrim_duration":0.0023654909999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":87,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:24.116761+0000","last_change":"2023-11-08T19:30:24.116761+0000","last_active":"2023-11-08T19:30:24.116761+0000","last_peered":"2023-11-08T19:30:24.116761+0000","last_clean":"2023-11-08T19:30:24.116761+0000","last_became_active":"2023-11-08T19:24:31.144795+0000","last_became_peered":"2023-11-08T19:24:31.144795+0000","last_unstale":"2023-11-08T19:30:24.116761+0000","last_undegraded":"2023-11-08T19:30:24.116761+0000","last_fullsized":"2023-11-08T19:30:24.116761+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:24.116622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:24.116622+0000","last_clean_scrub_stamp":"2023-11-08T19:30:24.116622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:11:25.781444+0000","scrub_duration":0.0015405900000000001,"objects_trimmed":0,"snaptrim_duration":0.01495431,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":69,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:46.739832+0000","last_change":"2023-11-08T19:30:46.739872+0000","last_active":"2023-11-08T19:30:46.739832+0000","last_peered":"2023-11-08T19:30:46.739832+0000","last_clean":"2023-11-08T19:30:46.739832+0000","last_became_active":"2023-11-08T19:25:46.285766+0000","last_became_peered":"2023-11-08T19:25:46.285766+0000","last_unstale":"2023-11-08T19:30:46.739832+0000","last_undegraded":"2023-11-08T19:30:46.739832+0000","last_fullsized":"2023-11-08T19:30:46.739832+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:46.739670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:46.739670+0000","last_clean_scrub_stamp":"2023-11-08T19:30:46.739670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:39:25.915335+0000","scrub_duration":0.001977244,"objects_trimmed":0,"snaptrim_duration":0.001756748,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":55,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:44.946783+0000","last_change":"2023-11-08T19:30:44.946827+0000","last_active":"2023-11-08T19:30:44.946783+0000","last_peered":"2023-11-08T19:30:44.946783+0000","last_clean":"2023-11-08T19:30:44.946783+0000","last_became_active":"2023-11-08T19:25:47.288027+0000","last_became_peered":"2023-11-08T19:25:47.288027+0000","last_unstale":"2023-11-08T19:30:44.946783+0000","last_undegraded":"2023-11-08T19:30:44.946783+0000","last_fullsized":"2023-11-08T19:30:44.946783+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:44.946674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:44.946674+0000","last_clean_scrub_stamp":"2023-11-08T19:30:44.946674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:32:49.215775+0000","scrub_duration":0.0020628539999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":86,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:14.200060+0000","last_change":"2023-11-08T19:30:14.200080+0000","last_active":"2023-11-08T19:30:14.200060+0000","last_peered":"2023-11-08T19:30:14.200060+0000","last_clean":"2023-11-08T19:30:14.200060+0000","last_became_active":"2023-11-08T19:24:31.138814+0000","last_became_peered":"2023-11-08T19:24:31.138814+0000","last_unstale":"2023-11-08T19:30:14.200060+0000","last_undegraded":"2023-11-08T19:30:14.200060+0000","last_fullsized":"2023-11-08T19:30:14.200060+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:14.199980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:14.199980+0000","last_clean_scrub_stamp":"2023-11-08T19:30:14.199980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:51:59.664792+0000","scrub_duration":0.0015028369999999999,"objects_trimmed":0,"snaptrim_duration":0.00048136000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":69,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:36.507501+0000","last_change":"2023-11-08T19:30:36.507522+0000","last_active":"2023-11-08T19:30:36.507501+0000","last_peered":"2023-11-08T19:30:36.507501+0000","last_clean":"2023-11-08T19:30:36.507501+0000","last_became_active":"2023-11-08T19:25:46.271936+0000","last_became_peered":"2023-11-08T19:25:46.271936+0000","last_unstale":"2023-11-08T19:30:36.507501+0000","last_undegraded":"2023-11-08T19:30:36.507501+0000","last_fullsized":"2023-11-08T19:30:36.507501+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:36.507418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:36.507418+0000","last_clean_scrub_stamp":"2023-11-08T19:30:36.507418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:49:25.737651+0000","scrub_duration":0.0014739589999999999,"objects_trimmed":0,"snaptrim_duration":0.00186835,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":54,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.746984+0000","last_change":"2023-11-08T19:25:47.282856+0000","last_active":"2023-11-08T19:30:05.746984+0000","last_peered":"2023-11-08T19:30:05.746984+0000","last_clean":"2023-11-08T19:30:05.746984+0000","last_became_active":"2023-11-08T19:25:47.282594+0000","last_became_peered":"2023-11-08T19:25:47.282594+0000","last_unstale":"2023-11-08T19:30:05.746984+0000","last_undegraded":"2023-11-08T19:30:05.746984+0000","last_fullsized":"2023-11-08T19:30:05.746984+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":90,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:14.808755+0000","last_change":"2023-11-08T19:30:14.808755+0000","last_active":"2023-11-08T19:30:14.808755+0000","last_peered":"2023-11-08T19:30:14.808755+0000","last_clean":"2023-11-08T19:30:14.808755+0000","last_became_active":"2023-11-08T19:24:31.142985+0000","last_became_peered":"2023-11-08T19:24:31.142985+0000","last_unstale":"2023-11-08T19:30:14.808755+0000","last_undegraded":"2023-11-08T19:30:14.808755+0000","last_fullsized":"2023-11-08T19:30:14.808755+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:14.808667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:14.808667+0000","last_clean_scrub_stamp":"2023-11-08T19:30:14.808667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:58:55.493702+0000","scrub_duration":0.0018409399999999999,"objects_trimmed":0,"snaptrim_duration":0.000386048,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":64,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:51.347115+0000","last_change":"2023-11-08T19:30:51.347152+0000","last_active":"2023-11-08T19:30:51.347115+0000","last_peered":"2023-11-08T19:30:51.347115+0000","last_clean":"2023-11-08T19:30:51.347115+0000","last_became_active":"2023-11-08T19:25:46.283263+0000","last_became_peered":"2023-11-08T19:25:46.283263+0000","last_unstale":"2023-11-08T19:30:51.347115+0000","last_undegraded":"2023-11-08T19:30:51.347115+0000","last_fullsized":"2023-11-08T19:30:51.347115+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:51.346997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:51.346997+0000","last_clean_scrub_stamp":"2023-11-08T19:30:51.346997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:08:26.238174+0000","scrub_duration":0.0023000680000000002,"objects_trimmed":0,"snaptrim_duration":0.0019848779999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":57,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:25.443260+0000","last_change":"2023-11-08T19:30:25.443287+0000","last_active":"2023-11-08T19:30:25.443260+0000","last_peered":"2023-11-08T19:30:25.443260+0000","last_clean":"2023-11-08T19:30:25.443260+0000","last_became_active":"2023-11-08T19:25:47.284522+0000","last_became_peered":"2023-11-08T19:25:47.284522+0000","last_unstale":"2023-11-08T19:30:25.443260+0000","last_undegraded":"2023-11-08T19:30:25.443260+0000","last_fullsized":"2023-11-08T19:30:25.443260+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:25.443157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:25.443157+0000","last_clean_scrub_stamp":"2023-11-08T19:30:25.443157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:11:41.255817+0000","scrub_duration":0.002105778,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":87,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:30.241614+0000","last_change":"2023-11-08T19:30:30.241614+0000","last_active":"2023-11-08T19:30:30.241614+0000","last_peered":"2023-11-08T19:30:30.241614+0000","last_clean":"2023-11-08T19:30:30.241614+0000","last_became_active":"2023-11-08T19:24:31.144838+0000","last_became_peered":"2023-11-08T19:24:31.144838+0000","last_unstale":"2023-11-08T19:30:30.241614+0000","last_undegraded":"2023-11-08T19:30:30.241614+0000","last_fullsized":"2023-11-08T19:30:30.241614+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:30.241474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:30.241474+0000","last_clean_scrub_stamp":"2023-11-08T19:30:30.241474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:44:33.275938+0000","scrub_duration":0.0015211319999999999,"objects_trimmed":0,"snaptrim_duration":0.00081588799999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":69,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:30.668329+0000","last_change":"2023-11-08T19:30:30.668366+0000","last_active":"2023-11-08T19:30:30.668329+0000","last_peered":"2023-11-08T19:30:30.668329+0000","last_clean":"2023-11-08T19:30:30.668329+0000","last_became_active":"2023-11-08T19:25:46.285588+0000","last_became_peered":"2023-11-08T19:25:46.285588+0000","last_unstale":"2023-11-08T19:30:30.668329+0000","last_undegraded":"2023-11-08T19:30:30.668329+0000","last_fullsized":"2023-11-08T19:30:30.668329+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:30.668221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:30.668221+0000","last_clean_scrub_stamp":"2023-11-08T19:30:30.668221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:54:28.732108+0000","scrub_duration":0.0020941699999999998,"objects_trimmed":0,"snaptrim_duration":0.0023282350000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":57,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:31:01.445790+0000","last_change":"2023-11-08T19:31:01.445818+0000","last_active":"2023-11-08T19:31:01.445790+0000","last_peered":"2023-11-08T19:31:01.445790+0000","last_clean":"2023-11-08T19:31:01.445790+0000","last_became_active":"2023-11-08T19:25:47.283266+0000","last_became_peered":"2023-11-08T19:25:47.283266+0000","last_unstale":"2023-11-08T19:31:01.445790+0000","last_undegraded":"2023-11-08T19:31:01.445790+0000","last_fullsized":"2023-11-08T19:31:01.445790+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:31:01.445687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:31:01.445687+0000","last_clean_scrub_stamp":"2023-11-08T19:31:01.445687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:06:19.498171+0000","scrub_duration":0.0020608139999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":89,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:15.843994+0000","last_change":"2023-11-08T19:30:15.844049+0000","last_active":"2023-11-08T19:30:15.843994+0000","last_peered":"2023-11-08T19:30:15.843994+0000","last_clean":"2023-11-08T19:30:15.843994+0000","last_became_active":"2023-11-08T19:24:31.141710+0000","last_became_peered":"2023-11-08T19:24:31.141710+0000","last_unstale":"2023-11-08T19:30:15.843994+0000","last_undegraded":"2023-11-08T19:30:15.843994+0000","last_fullsized":"2023-11-08T19:30:15.843994+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:15.843841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:15.843841+0000","last_clean_scrub_stamp":"2023-11-08T19:30:15.843841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:15:48.494842+0000","scrub_duration":0.0022065240000000001,"objects_trimmed":0,"snaptrim_duration":0.000430438,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":69,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:47.740964+0000","last_change":"2023-11-08T19:30:47.741009+0000","last_active":"2023-11-08T19:30:47.740964+0000","last_peered":"2023-11-08T19:30:47.740964+0000","last_clean":"2023-11-08T19:30:47.740964+0000","last_became_active":"2023-11-08T19:25:46.273336+0000","last_became_peered":"2023-11-08T19:25:46.273336+0000","last_unstale":"2023-11-08T19:30:47.740964+0000","last_undegraded":"2023-11-08T19:30:47.740964+0000","last_fullsized":"2023-11-08T19:30:47.740964+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:47.740857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:47.740857+0000","last_clean_scrub_stamp":"2023-11-08T19:30:47.740857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:42:32.849324+0000","scrub_duration":0.0020745569999999999,"objects_trimmed":0,"snaptrim_duration":0.00092577200000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":54,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.745636+0000","last_change":"2023-11-08T19:25:47.282840+0000","last_active":"2023-11-08T19:30:05.745636+0000","last_peered":"2023-11-08T19:30:05.745636+0000","last_clean":"2023-11-08T19:30:05.745636+0000","last_became_active":"2023-11-08T19:25:47.282600+0000","last_became_peered":"2023-11-08T19:25:47.282600+0000","last_unstale":"2023-11-08T19:30:05.745636+0000","last_undegraded":"2023-11-08T19:30:05.745636+0000","last_fullsized":"2023-11-08T19:30:05.745636+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":62,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:41.482806+0000","last_change":"2023-11-08T19:30:41.482842+0000","last_active":"2023-11-08T19:30:41.482806+0000","last_peered":"2023-11-08T19:30:41.482806+0000","last_clean":"2023-11-08T19:30:41.482806+0000","last_became_active":"2023-11-08T19:25:47.285641+0000","last_became_peered":"2023-11-08T19:25:47.285641+0000","last_unstale":"2023-11-08T19:30:41.482806+0000","last_undegraded":"2023-11-08T19:30:41.482806+0000","last_fullsized":"2023-11-08T19:30:41.482806+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:41.482669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:41.482669+0000","last_clean_scrub_stamp":"2023-11-08T19:30:41.482669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:11:16.853701+0000","scrub_duration":0.0021664090000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":86,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:34.218129+0000","last_change":"2023-11-08T19:30:34.218157+0000","last_active":"2023-11-08T19:30:34.218129+0000","last_peered":"2023-11-08T19:30:34.218129+0000","last_clean":"2023-11-08T19:30:34.218129+0000","last_became_active":"2023-11-08T19:24:31.146715+0000","last_became_peered":"2023-11-08T19:24:31.146715+0000","last_unstale":"2023-11-08T19:30:34.218129+0000","last_undegraded":"2023-11-08T19:30:34.218129+0000","last_fullsized":"2023-11-08T19:30:34.218129+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:34.218032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:34.218032+0000","last_clean_scrub_stamp":"2023-11-08T19:30:34.218032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:44:54.228901+0000","scrub_duration":0.001686608,"objects_trimmed":0,"snaptrim_duration":0.00081671599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":69,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:19.767755+0000","last_change":"2023-11-08T19:30:19.767800+0000","last_active":"2023-11-08T19:30:19.767755+0000","last_peered":"2023-11-08T19:30:19.767755+0000","last_clean":"2023-11-08T19:30:19.767755+0000","last_became_active":"2023-11-08T19:25:46.285960+0000","last_became_peered":"2023-11-08T19:25:46.285960+0000","last_unstale":"2023-11-08T19:30:19.767755+0000","last_undegraded":"2023-11-08T19:30:19.767755+0000","last_fullsized":"2023-11-08T19:30:19.767755+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:19.767655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:19.767655+0000","last_clean_scrub_stamp":"2023-11-08T19:30:19.767655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:09:29.324502+0000","scrub_duration":0.0020017630000000002,"objects_trimmed":0,"snaptrim_duration":0.00091649099999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":62,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:50.533606+0000","last_change":"2023-11-08T19:30:50.533630+0000","last_active":"2023-11-08T19:30:50.533606+0000","last_peered":"2023-11-08T19:30:50.533606+0000","last_clean":"2023-11-08T19:30:50.533606+0000","last_became_active":"2023-11-08T19:25:47.283360+0000","last_became_peered":"2023-11-08T19:25:47.283360+0000","last_unstale":"2023-11-08T19:30:50.533606+0000","last_undegraded":"2023-11-08T19:30:50.533606+0000","last_fullsized":"2023-11-08T19:30:50.533606+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:50.533508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:50.533508+0000","last_clean_scrub_stamp":"2023-11-08T19:30:50.533508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:04:18.582751+0000","scrub_duration":0.001541892,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":95,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:35.806226+0000","last_change":"2023-11-08T19:30:35.806271+0000","last_active":"2023-11-08T19:30:35.806226+0000","last_peered":"2023-11-08T19:30:35.806226+0000","last_clean":"2023-11-08T19:30:35.806226+0000","last_became_active":"2023-11-08T19:24:31.147181+0000","last_became_peered":"2023-11-08T19:24:31.147181+0000","last_unstale":"2023-11-08T19:30:35.806226+0000","last_undegraded":"2023-11-08T19:30:35.806226+0000","last_fullsized":"2023-11-08T19:30:35.806226+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:35.806133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:35.806133+0000","last_clean_scrub_stamp":"2023-11-08T19:30:35.806133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:42:01.284608+0000","scrub_duration":0.0014898750000000001,"objects_trimmed":0,"snaptrim_duration":0.00057135200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":62,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:34.037408+0000","last_change":"2023-11-08T19:30:34.037436+0000","last_active":"2023-11-08T19:30:34.037408+0000","last_peered":"2023-11-08T19:30:34.037408+0000","last_clean":"2023-11-08T19:30:34.037408+0000","last_became_active":"2023-11-08T19:25:46.288848+0000","last_became_peered":"2023-11-08T19:25:46.288848+0000","last_unstale":"2023-11-08T19:30:34.037408+0000","last_undegraded":"2023-11-08T19:30:34.037408+0000","last_fullsized":"2023-11-08T19:30:34.037408+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:34.037323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:34.037323+0000","last_clean_scrub_stamp":"2023-11-08T19:30:34.037323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:25:01.213113+0000","scrub_duration":0.0018533829999999999,"objects_trimmed":0,"snaptrim_duration":0.00097653099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":55,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:51.893635+0000","last_change":"2023-11-08T19:30:51.893659+0000","last_active":"2023-11-08T19:30:51.893635+0000","last_peered":"2023-11-08T19:30:51.893635+0000","last_clean":"2023-11-08T19:30:51.893635+0000","last_became_active":"2023-11-08T19:25:47.289177+0000","last_became_peered":"2023-11-08T19:25:47.289177+0000","last_unstale":"2023-11-08T19:30:51.893635+0000","last_undegraded":"2023-11-08T19:30:51.893635+0000","last_fullsized":"2023-11-08T19:30:51.893635+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:51.893540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:51.893540+0000","last_clean_scrub_stamp":"2023-11-08T19:30:51.893540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:15:35.967709+0000","scrub_duration":0.0014277199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":95,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:32.836983+0000","last_change":"2023-11-08T19:30:32.837006+0000","last_active":"2023-11-08T19:30:32.836983+0000","last_peered":"2023-11-08T19:30:32.836983+0000","last_clean":"2023-11-08T19:30:32.836983+0000","last_became_active":"2023-11-08T19:24:31.148857+0000","last_became_peered":"2023-11-08T19:24:31.148857+0000","last_unstale":"2023-11-08T19:30:32.836983+0000","last_undegraded":"2023-11-08T19:30:32.836983+0000","last_fullsized":"2023-11-08T19:30:32.836983+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:32.836889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:32.836889+0000","last_clean_scrub_stamp":"2023-11-08T19:30:32.836889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:55:04.192751+0000","scrub_duration":0.0021433870000000001,"objects_trimmed":0,"snaptrim_duration":0.00065078599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":62,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:27.077494+0000","last_change":"2023-11-08T19:30:27.077515+0000","last_active":"2023-11-08T19:30:27.077494+0000","last_peered":"2023-11-08T19:30:27.077494+0000","last_clean":"2023-11-08T19:30:27.077494+0000","last_became_active":"2023-11-08T19:25:46.286211+0000","last_became_peered":"2023-11-08T19:25:46.286211+0000","last_unstale":"2023-11-08T19:30:27.077494+0000","last_undegraded":"2023-11-08T19:30:27.077494+0000","last_fullsized":"2023-11-08T19:30:27.077494+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:27.077406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:27.077406+0000","last_clean_scrub_stamp":"2023-11-08T19:30:27.077406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:53:12.324357+0000","scrub_duration":0.0013463559999999999,"objects_trimmed":0,"snaptrim_duration":0.00073775700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":55,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:39.102569+0000","last_change":"2023-11-08T19:30:39.102569+0000","last_active":"2023-11-08T19:30:39.102569+0000","last_peered":"2023-11-08T19:30:39.102569+0000","last_clean":"2023-11-08T19:30:39.102569+0000","last_became_active":"2023-11-08T19:25:47.285728+0000","last_became_peered":"2023-11-08T19:25:47.285728+0000","last_unstale":"2023-11-08T19:30:39.102569+0000","last_undegraded":"2023-11-08T19:30:39.102569+0000","last_fullsized":"2023-11-08T19:30:39.102569+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:39.102407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:39.102407+0000","last_clean_scrub_stamp":"2023-11-08T19:30:39.102407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:30:01.083142+0000","scrub_duration":0.002129307,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":95,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:31.834768+0000","last_change":"2023-11-08T19:30:31.834805+0000","last_active":"2023-11-08T19:30:31.834768+0000","last_peered":"2023-11-08T19:30:31.834768+0000","last_clean":"2023-11-08T19:30:31.834768+0000","last_became_active":"2023-11-08T19:24:31.146557+0000","last_became_peered":"2023-11-08T19:24:31.146557+0000","last_unstale":"2023-11-08T19:30:31.834768+0000","last_undegraded":"2023-11-08T19:30:31.834768+0000","last_fullsized":"2023-11-08T19:30:31.834768+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:31.834620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:31.834620+0000","last_clean_scrub_stamp":"2023-11-08T19:30:31.834620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:30:28.179127+0000","scrub_duration":0.0020209350000000002,"objects_trimmed":0,"snaptrim_duration":0.00099450100000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":64,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:17.302756+0000","last_change":"2023-11-08T19:30:17.302756+0000","last_active":"2023-11-08T19:30:17.302756+0000","last_peered":"2023-11-08T19:30:17.302756+0000","last_clean":"2023-11-08T19:30:17.302756+0000","last_became_active":"2023-11-08T19:25:46.281273+0000","last_became_peered":"2023-11-08T19:25:46.281273+0000","last_unstale":"2023-11-08T19:30:17.302756+0000","last_undegraded":"2023-11-08T19:30:17.302756+0000","last_fullsized":"2023-11-08T19:30:17.302756+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:17.302603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:17.302603+0000","last_clean_scrub_stamp":"2023-11-08T19:30:17.302603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:48:34.591057+0000","scrub_duration":0.002093204,"objects_trimmed":0,"snaptrim_duration":0.0020904819999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":56,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:38.085343+0000","last_change":"2023-11-08T19:30:38.085343+0000","last_active":"2023-11-08T19:30:38.085343+0000","last_peered":"2023-11-08T19:30:38.085343+0000","last_clean":"2023-11-08T19:30:38.085343+0000","last_became_active":"2023-11-08T19:25:47.287905+0000","last_became_peered":"2023-11-08T19:25:47.287905+0000","last_unstale":"2023-11-08T19:30:38.085343+0000","last_undegraded":"2023-11-08T19:30:38.085343+0000","last_fullsized":"2023-11-08T19:30:38.085343+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:38.085222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:38.085222+0000","last_clean_scrub_stamp":"2023-11-08T19:30:38.085222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:11:34.653580+0000","scrub_duration":0.0021335199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":86,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:32.258156+0000","last_change":"2023-11-08T19:30:32.258190+0000","last_active":"2023-11-08T19:30:32.258156+0000","last_peered":"2023-11-08T19:30:32.258156+0000","last_clean":"2023-11-08T19:30:32.258156+0000","last_became_active":"2023-11-08T19:24:31.144341+0000","last_became_peered":"2023-11-08T19:24:31.144341+0000","last_unstale":"2023-11-08T19:30:32.258156+0000","last_undegraded":"2023-11-08T19:30:32.258156+0000","last_fullsized":"2023-11-08T19:30:32.258156+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:32.258018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:32.258018+0000","last_clean_scrub_stamp":"2023-11-08T19:30:32.258018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:03:25.085742+0000","scrub_duration":0.0022325040000000002,"objects_trimmed":0,"snaptrim_duration":0.00058308299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":62,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:19.065507+0000","last_change":"2023-11-08T19:30:19.065507+0000","last_active":"2023-11-08T19:30:19.065507+0000","last_peered":"2023-11-08T19:30:19.065507+0000","last_clean":"2023-11-08T19:30:19.065507+0000","last_became_active":"2023-11-08T19:25:46.286933+0000","last_became_peered":"2023-11-08T19:25:46.286933+0000","last_unstale":"2023-11-08T19:30:19.065507+0000","last_undegraded":"2023-11-08T19:30:19.065507+0000","last_fullsized":"2023-11-08T19:30:19.065507+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:19.065292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:19.065292+0000","last_clean_scrub_stamp":"2023-11-08T19:30:19.065292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:02:38.548129+0000","scrub_duration":0.0020157859999999999,"objects_trimmed":0,"snaptrim_duration":0.00080507500000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":55,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:35.078757+0000","last_change":"2023-11-08T19:30:35.078757+0000","last_active":"2023-11-08T19:30:35.078757+0000","last_peered":"2023-11-08T19:30:35.078757+0000","last_clean":"2023-11-08T19:30:35.078757+0000","last_became_active":"2023-11-08T19:25:47.282705+0000","last_became_peered":"2023-11-08T19:25:47.282705+0000","last_unstale":"2023-11-08T19:30:35.078757+0000","last_undegraded":"2023-11-08T19:30:35.078757+0000","last_fullsized":"2023-11-08T19:30:35.078757+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:35.078670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:35.078670+0000","last_clean_scrub_stamp":"2023-11-08T19:30:35.078670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:23:20.306422+0000","scrub_duration":0.001194697,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":86,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:13.025216+0000","last_change":"2023-11-08T19:30:13.025246+0000","last_active":"2023-11-08T19:30:13.025216+0000","last_peered":"2023-11-08T19:30:13.025216+0000","last_clean":"2023-11-08T19:30:13.025216+0000","last_became_active":"2023-11-08T19:24:31.143812+0000","last_became_peered":"2023-11-08T19:24:31.143812+0000","last_unstale":"2023-11-08T19:30:13.025216+0000","last_undegraded":"2023-11-08T19:30:13.025216+0000","last_fullsized":"2023-11-08T19:30:13.025216+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:13.025137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:13.025137+0000","last_clean_scrub_stamp":"2023-11-08T19:30:13.025137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:10:48.396169+0000","scrub_duration":0.0011907409999999999,"objects_trimmed":0,"snaptrim_duration":0.014956126,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":69,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:37.506805+0000","last_change":"2023-11-08T19:30:37.506805+0000","last_active":"2023-11-08T19:30:37.506805+0000","last_peered":"2023-11-08T19:30:37.506805+0000","last_clean":"2023-11-08T19:30:37.506805+0000","last_became_active":"2023-11-08T19:25:46.284288+0000","last_became_peered":"2023-11-08T19:25:46.284288+0000","last_unstale":"2023-11-08T19:30:37.506805+0000","last_undegraded":"2023-11-08T19:30:37.506805+0000","last_fullsized":"2023-11-08T19:30:37.506805+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:37.506674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:37.506674+0000","last_clean_scrub_stamp":"2023-11-08T19:30:37.506674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:19:17.738199+0000","scrub_duration":0.0020640739999999999,"objects_trimmed":0,"snaptrim_duration":0.001250894,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":62,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:38.480895+0000","last_change":"2023-11-08T19:30:38.480895+0000","last_active":"2023-11-08T19:30:38.480895+0000","last_peered":"2023-11-08T19:30:38.480895+0000","last_clean":"2023-11-08T19:30:38.480895+0000","last_became_active":"2023-11-08T19:25:47.282299+0000","last_became_peered":"2023-11-08T19:25:47.282299+0000","last_unstale":"2023-11-08T19:30:38.480895+0000","last_undegraded":"2023-11-08T19:30:38.480895+0000","last_fullsized":"2023-11-08T19:30:38.480895+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:38.480725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:38.480725+0000","last_clean_scrub_stamp":"2023-11-08T19:30:38.480725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:56:12.945221+0000","scrub_duration":0.0020465769999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":85,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:19.177045+0000","last_change":"2023-11-08T19:30:19.177082+0000","last_active":"2023-11-08T19:30:19.177045+0000","last_peered":"2023-11-08T19:30:19.177045+0000","last_clean":"2023-11-08T19:30:19.177045+0000","last_became_active":"2023-11-08T19:24:31.147384+0000","last_became_peered":"2023-11-08T19:24:31.147384+0000","last_unstale":"2023-11-08T19:30:19.177045+0000","last_undegraded":"2023-11-08T19:30:19.177045+0000","last_fullsized":"2023-11-08T19:30:19.177045+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:19.176943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:19.176943+0000","last_clean_scrub_stamp":"2023-11-08T19:30:19.176943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:39:08.064436+0000","scrub_duration":0.00154301,"objects_trimmed":0,"snaptrim_duration":0.00043834899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":69,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:34.554450+0000","last_change":"2023-11-08T19:30:34.554450+0000","last_active":"2023-11-08T19:30:34.554450+0000","last_peered":"2023-11-08T19:30:34.554450+0000","last_clean":"2023-11-08T19:30:34.554450+0000","last_became_active":"2023-11-08T19:25:46.285626+0000","last_became_peered":"2023-11-08T19:25:46.285626+0000","last_unstale":"2023-11-08T19:30:34.554450+0000","last_undegraded":"2023-11-08T19:30:34.554450+0000","last_fullsized":"2023-11-08T19:30:34.554450+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:34.554326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:34.554326+0000","last_clean_scrub_stamp":"2023-11-08T19:30:34.554326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:59:52.362317+0000","scrub_duration":0.0021201129999999999,"objects_trimmed":0,"snaptrim_duration":0.0019032459999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":54,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:13.898526+0000","last_change":"2023-11-08T19:25:47.287878+0000","last_active":"2023-11-08T19:30:13.898526+0000","last_peered":"2023-11-08T19:30:13.898526+0000","last_clean":"2023-11-08T19:30:13.898526+0000","last_became_active":"2023-11-08T19:25:47.287617+0000","last_became_peered":"2023-11-08T19:25:47.287617+0000","last_unstale":"2023-11-08T19:30:13.898526+0000","last_undegraded":"2023-11-08T19:30:13.898526+0000","last_fullsized":"2023-11-08T19:30:13.898526+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":96,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:28.670362+0000","last_change":"2023-11-08T19:30:28.670399+0000","last_active":"2023-11-08T19:30:28.670362+0000","last_peered":"2023-11-08T19:30:28.670362+0000","last_clean":"2023-11-08T19:30:28.670362+0000","last_became_active":"2023-11-08T19:24:31.144614+0000","last_became_peered":"2023-11-08T19:24:31.144614+0000","last_unstale":"2023-11-08T19:30:28.670362+0000","last_undegraded":"2023-11-08T19:30:28.670362+0000","last_fullsized":"2023-11-08T19:30:28.670362+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:28.670235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:28.670235+0000","last_clean_scrub_stamp":"2023-11-08T19:30:28.670235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:38:02.285835+0000","scrub_duration":0.0020853949999999999,"objects_trimmed":0,"snaptrim_duration":0.00050362200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":64,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:31:00.405500+0000","last_change":"2023-11-08T19:31:00.405525+0000","last_active":"2023-11-08T19:31:00.405500+0000","last_peered":"2023-11-08T19:31:00.405500+0000","last_clean":"2023-11-08T19:31:00.405500+0000","last_became_active":"2023-11-08T19:25:46.283803+0000","last_became_peered":"2023-11-08T19:25:46.283803+0000","last_unstale":"2023-11-08T19:31:00.405500+0000","last_undegraded":"2023-11-08T19:31:00.405500+0000","last_fullsized":"2023-11-08T19:31:00.405500+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:31:00.405401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:31:00.405401+0000","last_clean_scrub_stamp":"2023-11-08T19:31:00.405401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:22:21.573281+0000","scrub_duration":0.0014623450000000001,"objects_trimmed":0,"snaptrim_duration":0.002404855,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":55,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:47.906923+0000","last_change":"2023-11-08T19:30:47.906923+0000","last_active":"2023-11-08T19:30:47.906923+0000","last_peered":"2023-11-08T19:30:47.906923+0000","last_clean":"2023-11-08T19:30:47.906923+0000","last_became_active":"2023-11-08T19:25:47.287428+0000","last_became_peered":"2023-11-08T19:25:47.287428+0000","last_unstale":"2023-11-08T19:30:47.906923+0000","last_undegraded":"2023-11-08T19:30:47.906923+0000","last_fullsized":"2023-11-08T19:30:47.906923+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:47.906785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:47.906785+0000","last_clean_scrub_stamp":"2023-11-08T19:30:47.906785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:47:22.383967+0000","scrub_duration":0.0021926699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":85,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:21.174293+0000","last_change":"2023-11-08T19:30:21.174318+0000","last_active":"2023-11-08T19:30:21.174293+0000","last_peered":"2023-11-08T19:30:21.174293+0000","last_clean":"2023-11-08T19:30:21.174293+0000","last_became_active":"2023-11-08T19:24:31.146176+0000","last_became_peered":"2023-11-08T19:24:31.146176+0000","last_unstale":"2023-11-08T19:30:21.174293+0000","last_undegraded":"2023-11-08T19:30:21.174293+0000","last_fullsized":"2023-11-08T19:30:21.174293+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:21.174179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:21.174179+0000","last_clean_scrub_stamp":"2023-11-08T19:30:21.174179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:36:32.308961+0000","scrub_duration":0.001410056,"objects_trimmed":0,"snaptrim_duration":0.00048481000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":64,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:57.411661+0000","last_change":"2023-11-08T19:30:57.411702+0000","last_active":"2023-11-08T19:30:57.411661+0000","last_peered":"2023-11-08T19:30:57.411661+0000","last_clean":"2023-11-08T19:30:57.411661+0000","last_became_active":"2023-11-08T19:25:46.282460+0000","last_became_peered":"2023-11-08T19:25:46.282460+0000","last_unstale":"2023-11-08T19:30:57.411661+0000","last_undegraded":"2023-11-08T19:30:57.411661+0000","last_fullsized":"2023-11-08T19:30:57.411661+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:57.411534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:57.411534+0000","last_clean_scrub_stamp":"2023-11-08T19:30:57.411534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:07:05.389261+0000","scrub_duration":0.001549531,"objects_trimmed":0,"snaptrim_duration":0.001972863,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":62,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:43.580139+0000","last_change":"2023-11-08T19:30:43.580175+0000","last_active":"2023-11-08T19:30:43.580139+0000","last_peered":"2023-11-08T19:30:43.580139+0000","last_clean":"2023-11-08T19:30:43.580139+0000","last_became_active":"2023-11-08T19:25:47.283433+0000","last_became_peered":"2023-11-08T19:25:47.283433+0000","last_unstale":"2023-11-08T19:30:43.580139+0000","last_undegraded":"2023-11-08T19:30:43.580139+0000","last_fullsized":"2023-11-08T19:30:43.580139+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:43.580022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:43.580022+0000","last_clean_scrub_stamp":"2023-11-08T19:30:43.580022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:36:54.714804+0000","scrub_duration":0.001575403,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":86,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:18.021092+0000","last_change":"2023-11-08T19:30:18.021136+0000","last_active":"2023-11-08T19:30:18.021092+0000","last_peered":"2023-11-08T19:30:18.021092+0000","last_clean":"2023-11-08T19:30:18.021092+0000","last_became_active":"2023-11-08T19:24:31.142052+0000","last_became_peered":"2023-11-08T19:24:31.142052+0000","last_unstale":"2023-11-08T19:30:18.021092+0000","last_undegraded":"2023-11-08T19:30:18.021092+0000","last_fullsized":"2023-11-08T19:30:18.021092+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:18.020983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:18.020983+0000","last_clean_scrub_stamp":"2023-11-08T19:30:18.020983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:45.925711+0000","scrub_duration":0.001444657,"objects_trimmed":0,"snaptrim_duration":0.014881058000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":69,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:20.763205+0000","last_change":"2023-11-08T19:30:20.763230+0000","last_active":"2023-11-08T19:30:20.763205+0000","last_peered":"2023-11-08T19:30:20.763205+0000","last_clean":"2023-11-08T19:30:20.763205+0000","last_became_active":"2023-11-08T19:25:46.279287+0000","last_became_peered":"2023-11-08T19:25:46.279287+0000","last_unstale":"2023-11-08T19:30:20.763205+0000","last_undegraded":"2023-11-08T19:30:20.763205+0000","last_fullsized":"2023-11-08T19:30:20.763205+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:20.763104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:20.763104+0000","last_clean_scrub_stamp":"2023-11-08T19:30:20.763104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:14:02.974290+0000","scrub_duration":0.0021986850000000001,"objects_trimmed":0,"snaptrim_duration":0.00076856899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":54,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:05.748679+0000","last_change":"2023-11-08T19:25:47.285867+0000","last_active":"2023-11-08T19:30:05.748679+0000","last_peered":"2023-11-08T19:30:05.748679+0000","last_clean":"2023-11-08T19:30:05.748679+0000","last_became_active":"2023-11-08T19:25:47.285533+0000","last_became_peered":"2023-11-08T19:25:47.285533+0000","last_unstale":"2023-11-08T19:30:05.748679+0000","last_undegraded":"2023-11-08T19:30:05.748679+0000","last_fullsized":"2023-11-08T19:30:05.748679+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:25:46.258224+0000","last_clean_scrub_stamp":"2023-11-08T19:25:46.258224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":85,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:28.080532+0000","last_change":"2023-11-08T19:30:28.080567+0000","last_active":"2023-11-08T19:30:28.080532+0000","last_peered":"2023-11-08T19:30:28.080532+0000","last_clean":"2023-11-08T19:30:28.080532+0000","last_became_active":"2023-11-08T19:24:31.148250+0000","last_became_peered":"2023-11-08T19:24:31.148250+0000","last_unstale":"2023-11-08T19:30:28.080532+0000","last_undegraded":"2023-11-08T19:30:28.080532+0000","last_fullsized":"2023-11-08T19:30:28.080532+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:28.080403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:28.080403+0000","last_clean_scrub_stamp":"2023-11-08T19:30:28.080403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:55.985131+0000","scrub_duration":0.0019137889999999999,"objects_trimmed":0,"snaptrim_duration":0.00043061299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":69,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:35.532680+0000","last_change":"2023-11-08T19:30:35.532724+0000","last_active":"2023-11-08T19:30:35.532680+0000","last_peered":"2023-11-08T19:30:35.532680+0000","last_clean":"2023-11-08T19:30:35.532680+0000","last_became_active":"2023-11-08T19:25:46.285478+0000","last_became_peered":"2023-11-08T19:25:46.285478+0000","last_unstale":"2023-11-08T19:30:35.532680+0000","last_undegraded":"2023-11-08T19:30:35.532680+0000","last_fullsized":"2023-11-08T19:30:35.532680+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:35.532556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:35.532556+0000","last_clean_scrub_stamp":"2023-11-08T19:30:35.532556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:30:31.877062+0000","scrub_duration":0.0023281920000000002,"objects_trimmed":0,"snaptrim_duration":0.000376339,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":55,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:37.148513+0000","last_change":"2023-11-08T19:30:37.148535+0000","last_active":"2023-11-08T19:30:37.148513+0000","last_peered":"2023-11-08T19:30:37.148513+0000","last_clean":"2023-11-08T19:30:37.148513+0000","last_became_active":"2023-11-08T19:25:47.283990+0000","last_became_peered":"2023-11-08T19:25:47.283990+0000","last_unstale":"2023-11-08T19:30:37.148513+0000","last_undegraded":"2023-11-08T19:30:37.148513+0000","last_fullsized":"2023-11-08T19:30:37.148513+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:37.148426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:37.148426+0000","last_clean_scrub_stamp":"2023-11-08T19:30:37.148426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:36:37.292961+0000","scrub_duration":0.001288958,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":96,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:17.692059+0000","last_change":"2023-11-08T19:30:17.692093+0000","last_active":"2023-11-08T19:30:17.692059+0000","last_peered":"2023-11-08T19:30:17.692059+0000","last_clean":"2023-11-08T19:30:17.692059+0000","last_became_active":"2023-11-08T19:24:31.147651+0000","last_became_peered":"2023-11-08T19:24:31.147651+0000","last_unstale":"2023-11-08T19:30:17.692059+0000","last_undegraded":"2023-11-08T19:30:17.692059+0000","last_fullsized":"2023-11-08T19:30:17.692059+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:17.691961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:17.691961+0000","last_clean_scrub_stamp":"2023-11-08T19:30:17.691961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:09:27.248808+0000","scrub_duration":0.001464531,"objects_trimmed":0,"snaptrim_duration":0.00043673300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":64,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:24.455713+0000","last_change":"2023-11-08T19:30:24.455713+0000","last_active":"2023-11-08T19:30:24.455713+0000","last_peered":"2023-11-08T19:30:24.455713+0000","last_clean":"2023-11-08T19:30:24.455713+0000","last_became_active":"2023-11-08T19:25:46.282307+0000","last_became_peered":"2023-11-08T19:25:46.282307+0000","last_unstale":"2023-11-08T19:30:24.455713+0000","last_undegraded":"2023-11-08T19:30:24.455713+0000","last_fullsized":"2023-11-08T19:30:24.455713+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:24.455579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:24.455579+0000","last_clean_scrub_stamp":"2023-11-08T19:30:24.455579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:54:59.466934+0000","scrub_duration":0.0015672119999999999,"objects_trimmed":0,"snaptrim_duration":0.00047078400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":55,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:36.116332+0000","last_change":"2023-11-08T19:30:36.116369+0000","last_active":"2023-11-08T19:30:36.116332+0000","last_peered":"2023-11-08T19:30:36.116332+0000","last_clean":"2023-11-08T19:30:36.116332+0000","last_became_active":"2023-11-08T19:25:47.283927+0000","last_became_peered":"2023-11-08T19:25:47.283927+0000","last_unstale":"2023-11-08T19:30:36.116332+0000","last_undegraded":"2023-11-08T19:30:36.116332+0000","last_fullsized":"2023-11-08T19:30:36.116332+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:36.116210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:36.116210+0000","last_clean_scrub_stamp":"2023-11-08T19:30:36.116210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:53:44.424059+0000","scrub_duration":0.0024934250000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":86,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:33.211437+0000","last_change":"2023-11-08T19:30:33.211479+0000","last_active":"2023-11-08T19:30:33.211437+0000","last_peered":"2023-11-08T19:30:33.211437+0000","last_clean":"2023-11-08T19:30:33.211437+0000","last_became_active":"2023-11-08T19:24:31.144329+0000","last_became_peered":"2023-11-08T19:24:31.144329+0000","last_unstale":"2023-11-08T19:30:33.211437+0000","last_undegraded":"2023-11-08T19:30:33.211437+0000","last_fullsized":"2023-11-08T19:30:33.211437+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:33.211330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:33.211330+0000","last_clean_scrub_stamp":"2023-11-08T19:30:33.211330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:58:45.837341+0000","scrub_duration":0.001523457,"objects_trimmed":0,"snaptrim_duration":0.00043484799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":64,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:45.247269+0000","last_change":"2023-11-08T19:30:45.247292+0000","last_active":"2023-11-08T19:30:45.247269+0000","last_peered":"2023-11-08T19:30:45.247269+0000","last_clean":"2023-11-08T19:30:45.247269+0000","last_became_active":"2023-11-08T19:25:46.281425+0000","last_became_peered":"2023-11-08T19:25:46.281425+0000","last_unstale":"2023-11-08T19:30:45.247269+0000","last_undegraded":"2023-11-08T19:30:45.247269+0000","last_fullsized":"2023-11-08T19:30:45.247269+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:45.247176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:45.247176+0000","last_clean_scrub_stamp":"2023-11-08T19:30:45.247176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:58:55.220138+0000","scrub_duration":0.0018807120000000001,"objects_trimmed":0,"snaptrim_duration":0.00124314,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":57,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:31:04.452350+0000","last_change":"2023-11-08T19:31:04.452373+0000","last_active":"2023-11-08T19:31:04.452350+0000","last_peered":"2023-11-08T19:31:04.452350+0000","last_clean":"2023-11-08T19:31:04.452350+0000","last_became_active":"2023-11-08T19:25:47.281425+0000","last_became_peered":"2023-11-08T19:25:47.281425+0000","last_unstale":"2023-11-08T19:31:04.452350+0000","last_undegraded":"2023-11-08T19:31:04.452350+0000","last_fullsized":"2023-11-08T19:31:04.452350+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:31:04.452252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:31:04.452252+0000","last_clean_scrub_stamp":"2023-11-08T19:31:04.452252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:17:25.012548+0000","scrub_duration":0.0020989400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":86,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:24.251328+0000","last_change":"2023-11-08T19:30:24.251351+0000","last_active":"2023-11-08T19:30:24.251328+0000","last_peered":"2023-11-08T19:30:24.251328+0000","last_clean":"2023-11-08T19:30:24.251328+0000","last_became_active":"2023-11-08T19:24:31.146260+0000","last_became_peered":"2023-11-08T19:24:31.146260+0000","last_unstale":"2023-11-08T19:30:24.251328+0000","last_undegraded":"2023-11-08T19:30:24.251328+0000","last_fullsized":"2023-11-08T19:30:24.251328+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:24.251241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:24.251241+0000","last_clean_scrub_stamp":"2023-11-08T19:30:24.251241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:48:47.364880+0000","scrub_duration":0.0021896609999999999,"objects_trimmed":0,"snaptrim_duration":0.00059842900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":62,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:21.078147+0000","last_change":"2023-11-08T19:30:21.078147+0000","last_active":"2023-11-08T19:30:21.078147+0000","last_peered":"2023-11-08T19:30:21.078147+0000","last_clean":"2023-11-08T19:30:21.078147+0000","last_became_active":"2023-11-08T19:25:46.286239+0000","last_became_peered":"2023-11-08T19:25:46.286239+0000","last_unstale":"2023-11-08T19:30:21.078147+0000","last_undegraded":"2023-11-08T19:30:21.078147+0000","last_fullsized":"2023-11-08T19:30:21.078147+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:21.078003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:21.078003+0000","last_clean_scrub_stamp":"2023-11-08T19:30:21.078003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:54:56.089359+0000","scrub_duration":0.001463238,"objects_trimmed":0,"snaptrim_duration":0.000722421,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":55,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:50.899235+0000","last_change":"2023-11-08T19:30:50.899275+0000","last_active":"2023-11-08T19:30:50.899235+0000","last_peered":"2023-11-08T19:30:50.899235+0000","last_clean":"2023-11-08T19:30:50.899235+0000","last_became_active":"2023-11-08T19:25:47.287456+0000","last_became_peered":"2023-11-08T19:25:47.287456+0000","last_unstale":"2023-11-08T19:30:50.899235+0000","last_undegraded":"2023-11-08T19:30:50.899235+0000","last_fullsized":"2023-11-08T19:30:50.899235+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:50.899097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:50.899097+0000","last_clean_scrub_stamp":"2023-11-08T19:30:50.899097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:34:59.602214+0000","scrub_duration":0.0018975470000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":95,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:26.782952+0000","last_change":"2023-11-08T19:30:26.782978+0000","last_active":"2023-11-08T19:30:26.782952+0000","last_peered":"2023-11-08T19:30:26.782952+0000","last_clean":"2023-11-08T19:30:26.782952+0000","last_became_active":"2023-11-08T19:24:31.146154+0000","last_became_peered":"2023-11-08T19:24:31.146154+0000","last_unstale":"2023-11-08T19:30:26.782952+0000","last_undegraded":"2023-11-08T19:30:26.782952+0000","last_fullsized":"2023-11-08T19:30:26.782952+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:26.782839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:26.782839+0000","last_clean_scrub_stamp":"2023-11-08T19:30:26.782839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:28:53.767924+0000","scrub_duration":0.0015358430000000001,"objects_trimmed":0,"snaptrim_duration":0.00082432800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":63,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:35.060282+0000","last_change":"2023-11-08T19:30:35.060301+0000","last_active":"2023-11-08T19:30:35.060282+0000","last_peered":"2023-11-08T19:30:35.060282+0000","last_clean":"2023-11-08T19:30:35.060282+0000","last_became_active":"2023-11-08T19:25:46.290114+0000","last_became_peered":"2023-11-08T19:25:46.290114+0000","last_unstale":"2023-11-08T19:30:35.060282+0000","last_undegraded":"2023-11-08T19:30:35.060282+0000","last_fullsized":"2023-11-08T19:30:35.060282+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:35.060205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:35.060205+0000","last_clean_scrub_stamp":"2023-11-08T19:30:35.060205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:34:38.053321+0000","scrub_duration":0.0012027590000000001,"objects_trimmed":0,"snaptrim_duration":0.00061009499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":57,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:31:03.479158+0000","last_change":"2023-11-08T19:31:03.479186+0000","last_active":"2023-11-08T19:31:03.479158+0000","last_peered":"2023-11-08T19:31:03.479158+0000","last_clean":"2023-11-08T19:31:03.479158+0000","last_became_active":"2023-11-08T19:25:47.282763+0000","last_became_peered":"2023-11-08T19:25:47.282763+0000","last_unstale":"2023-11-08T19:31:03.479158+0000","last_undegraded":"2023-11-08T19:31:03.479158+0000","last_fullsized":"2023-11-08T19:31:03.479158+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:31:03.479037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:31:03.479037+0000","last_clean_scrub_stamp":"2023-11-08T19:31:03.479037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:21:19.561654+0000","scrub_duration":0.0020613720000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":87,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:16.159719+0000","last_change":"2023-11-08T19:30:16.159719+0000","last_active":"2023-11-08T19:30:16.159719+0000","last_peered":"2023-11-08T19:30:16.159719+0000","last_clean":"2023-11-08T19:30:16.159719+0000","last_became_active":"2023-11-08T19:24:31.139062+0000","last_became_peered":"2023-11-08T19:24:31.139062+0000","last_unstale":"2023-11-08T19:30:16.159719+0000","last_undegraded":"2023-11-08T19:30:16.159719+0000","last_fullsized":"2023-11-08T19:30:16.159719+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:16.159602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:16.159602+0000","last_clean_scrub_stamp":"2023-11-08T19:30:16.159602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:23:15.468689+0000","scrub_duration":0.00144932,"objects_trimmed":0,"snaptrim_duration":0.00033682599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":69,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:57.745235+0000","last_change":"2023-11-08T19:30:57.745280+0000","last_active":"2023-11-08T19:30:57.745235+0000","last_peered":"2023-11-08T19:30:57.745235+0000","last_clean":"2023-11-08T19:30:57.745235+0000","last_became_active":"2023-11-08T19:25:46.284287+0000","last_became_peered":"2023-11-08T19:25:46.284287+0000","last_unstale":"2023-11-08T19:30:57.745235+0000","last_undegraded":"2023-11-08T19:30:57.745235+0000","last_fullsized":"2023-11-08T19:30:57.745235+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:57.745099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:57.745099+0000","last_clean_scrub_stamp":"2023-11-08T19:30:57.745099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:25:10.395697+0000","scrub_duration":0.001971619,"objects_trimmed":0,"snaptrim_duration":0.00097880800000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":62,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:52.610321+0000","last_change":"2023-11-08T19:30:52.610350+0000","last_active":"2023-11-08T19:30:52.610321+0000","last_peered":"2023-11-08T19:30:52.610321+0000","last_clean":"2023-11-08T19:30:52.610321+0000","last_became_active":"2023-11-08T19:25:47.286181+0000","last_became_peered":"2023-11-08T19:25:47.286181+0000","last_unstale":"2023-11-08T19:30:52.610321+0000","last_undegraded":"2023-11-08T19:30:52.610321+0000","last_fullsized":"2023-11-08T19:30:52.610321+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:52.610210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:52.610210+0000","last_clean_scrub_stamp":"2023-11-08T19:30:52.610210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:11:54.275032+0000","scrub_duration":0.0021868320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":96,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:39.738027+0000","last_change":"2023-11-08T19:30:39.738027+0000","last_active":"2023-11-08T19:30:39.738027+0000","last_peered":"2023-11-08T19:30:39.738027+0000","last_clean":"2023-11-08T19:30:39.738027+0000","last_became_active":"2023-11-08T19:24:31.146668+0000","last_became_peered":"2023-11-08T19:24:31.146668+0000","last_unstale":"2023-11-08T19:30:39.738027+0000","last_undegraded":"2023-11-08T19:30:39.738027+0000","last_fullsized":"2023-11-08T19:30:39.738027+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:39.737903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:39.737903+0000","last_clean_scrub_stamp":"2023-11-08T19:30:39.737903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:39:28.625396+0000","scrub_duration":0.0015030569999999999,"objects_trimmed":0,"snaptrim_duration":0.00071576699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":64,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:20.518808+0000","last_change":"2023-11-08T19:30:20.518808+0000","last_active":"2023-11-08T19:30:20.518808+0000","last_peered":"2023-11-08T19:30:20.518808+0000","last_clean":"2023-11-08T19:30:20.518808+0000","last_became_active":"2023-11-08T19:25:46.290246+0000","last_became_peered":"2023-11-08T19:25:46.290246+0000","last_unstale":"2023-11-08T19:30:20.518808+0000","last_undegraded":"2023-11-08T19:30:20.518808+0000","last_fullsized":"2023-11-08T19:30:20.518808+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:20.518679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:20.518679+0000","last_clean_scrub_stamp":"2023-11-08T19:30:20.518679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:17:45.315742+0000","scrub_duration":0.0021647609999999999,"objects_trimmed":0,"snaptrim_duration":0.000423211,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":56,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:37.043659+0000","last_change":"2023-11-08T19:30:37.043659+0000","last_active":"2023-11-08T19:30:37.043659+0000","last_peered":"2023-11-08T19:30:37.043659+0000","last_clean":"2023-11-08T19:30:37.043659+0000","last_became_active":"2023-11-08T19:25:47.287412+0000","last_became_peered":"2023-11-08T19:25:47.287412+0000","last_unstale":"2023-11-08T19:30:37.043659+0000","last_undegraded":"2023-11-08T19:30:37.043659+0000","last_fullsized":"2023-11-08T19:30:37.043659+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:37.043522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:37.043522+0000","last_clean_scrub_stamp":"2023-11-08T19:30:37.043522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:23:20.268184+0000","scrub_duration":0.001539185,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":87,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:17.588716+0000","last_change":"2023-11-08T19:30:17.588739+0000","last_active":"2023-11-08T19:30:17.588716+0000","last_peered":"2023-11-08T19:30:17.588716+0000","last_clean":"2023-11-08T19:30:17.588716+0000","last_became_active":"2023-11-08T19:24:31.144912+0000","last_became_peered":"2023-11-08T19:24:31.144912+0000","last_unstale":"2023-11-08T19:30:17.588716+0000","last_undegraded":"2023-11-08T19:30:17.588716+0000","last_fullsized":"2023-11-08T19:30:17.588716+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:17.588625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:17.588625+0000","last_clean_scrub_stamp":"2023-11-08T19:30:17.588625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:23:16.897713+0000","scrub_duration":0.0017421800000000001,"objects_trimmed":0,"snaptrim_duration":0.00056686900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":69,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:49.695152+0000","last_change":"2023-11-08T19:30:49.695175+0000","last_active":"2023-11-08T19:30:49.695152+0000","last_peered":"2023-11-08T19:30:49.695152+0000","last_clean":"2023-11-08T19:30:49.695152+0000","last_became_active":"2023-11-08T19:25:46.285848+0000","last_became_peered":"2023-11-08T19:25:46.285848+0000","last_unstale":"2023-11-08T19:30:49.695152+0000","last_undegraded":"2023-11-08T19:30:49.695152+0000","last_fullsized":"2023-11-08T19:30:49.695152+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:49.695018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:49.695018+0000","last_clean_scrub_stamp":"2023-11-08T19:30:49.695018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:26:17.014670+0000","scrub_duration":0.0022179819999999999,"objects_trimmed":0,"snaptrim_duration":0.00089732199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":57,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:33.491295+0000","last_change":"2023-11-08T19:30:33.491295+0000","last_active":"2023-11-08T19:30:33.491295+0000","last_peered":"2023-11-08T19:30:33.491295+0000","last_clean":"2023-11-08T19:30:33.491295+0000","last_became_active":"2023-11-08T19:25:47.279913+0000","last_became_peered":"2023-11-08T19:25:47.279913+0000","last_unstale":"2023-11-08T19:30:33.491295+0000","last_undegraded":"2023-11-08T19:30:33.491295+0000","last_fullsized":"2023-11-08T19:30:33.491295+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:33.491165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:33.491165+0000","last_clean_scrub_stamp":"2023-11-08T19:30:33.491165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:25:00.666954+0000","scrub_duration":0.0021655239999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":86,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:17.139218+0000","last_change":"2023-11-08T19:30:17.139240+0000","last_active":"2023-11-08T19:30:17.139218+0000","last_peered":"2023-11-08T19:30:17.139218+0000","last_clean":"2023-11-08T19:30:17.139218+0000","last_became_active":"2023-11-08T19:24:31.149011+0000","last_became_peered":"2023-11-08T19:24:31.149011+0000","last_unstale":"2023-11-08T19:30:17.139218+0000","last_undegraded":"2023-11-08T19:30:17.139218+0000","last_fullsized":"2023-11-08T19:30:17.139218+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:17.139115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:17.139115+0000","last_clean_scrub_stamp":"2023-11-08T19:30:17.139115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:46:23.961331+0000","scrub_duration":0.0019318580000000001,"objects_trimmed":0,"snaptrim_duration":0.00033496900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":69,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:31:06.670328+0000","last_change":"2023-11-08T19:31:06.670351+0000","last_active":"2023-11-08T19:31:06.670328+0000","last_peered":"2023-11-08T19:31:06.670328+0000","last_clean":"2023-11-08T19:31:06.670328+0000","last_became_active":"2023-11-08T19:25:46.272479+0000","last_became_peered":"2023-11-08T19:25:46.272479+0000","last_unstale":"2023-11-08T19:31:06.670328+0000","last_undegraded":"2023-11-08T19:31:06.670328+0000","last_fullsized":"2023-11-08T19:31:06.670328+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:31:06.670216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:31:06.670216+0000","last_clean_scrub_stamp":"2023-11-08T19:31:06.670216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:16:20.433119+0000","scrub_duration":0.001528555,"objects_trimmed":0,"snaptrim_duration":0.001158117,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574951,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28940,"kb_used_data":1924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342900,"statfs":{"total":96636764160,"available":96607129600,"internally_reserved":0,"allocated":1970176,"data_stored":1293718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:30:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.58199999999999996,"15min":0.55300000000000005},"min":{"1min":0.51500000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.59599999999999997,"15min":0.57399999999999995},"min":{"1min":0.42899999999999999,"5min":0.38500000000000001,"15min":0.377},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.65100000000000002}]},{"osd":1,"last update":"Wed Nov 8 19:30:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.56299999999999994,"15min":0.55100000000000005},"min":{"1min":0.48699999999999999,"5min":0.309,"15min":0.309},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56000000000000005,"15min":0.54000000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.37},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.56699999999999995}]},{"osd":2,"last update":"Wed Nov 8 19:30:14 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55300000000000005,"15min":0.52200000000000002},"min":{"1min":0.45400000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.62},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.56999999999999995,"15min":0.54500000000000004},"min":{"1min":0.42899999999999999,"5min":0.379,"15min":0.32400000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.58799999999999997}]},{"osd":3,"last update":"Wed Nov 8 19:30:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.55600000000000005,"15min":0.54000000000000004},"min":{"1min":0.42599999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.58899999999999997,"15min":0.56799999999999995},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.36899999999999999},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.54800000000000004}]},{"osd":4,"last update":"Wed Nov 8 19:30:14 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48899999999999999,"15min":0.48499999999999999},"min":{"1min":0.36099999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70499999999999996,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51300000000000001,"15min":0.51600000000000001},"min":{"1min":0.39500000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.503}]},{"osd":5,"last update":"Wed Nov 8 19:30:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.35499999999999998,"5min":0.35399999999999998,"15min":0.35099999999999998},"max":{"1min":0.79100000000000004,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.438},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.55100000000000005,"15min":0.56999999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.91100000000000003},"last":0.60399999999999998}]},{"osd":6,"last update":"Wed Nov 8 19:30:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.59299999999999997,"15min":0.60599999999999998},"min":{"1min":0.42299999999999999,"5min":0.40000000000000002,"15min":0.39300000000000002},"max":{"1min":0.72199999999999998,"5min":0.80400000000000005,"15min":0.86399999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57799999999999996,"15min":0.56799999999999995},"min":{"1min":0.378,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.80800000000000005,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.57499999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574952,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28360,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343480,"statfs":{"total":96636764160,"available":96607723520,"internally_reserved":0,"allocated":1376256,"data_stored":703350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:30:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.54400000000000004,"15min":0.58399999999999996},"min":{"1min":0.33000000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.79300000000000004,"5min":0.82199999999999995,"15min":1.7549999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55000000000000004,"15min":0.57799999999999996},"min":{"1min":0.39100000000000001,"5min":0.313,"15min":0.28699999999999998},"max":{"1min":0.746,"5min":0.76800000000000002,"15min":1.478},"last":0.53900000000000003}]},{"osd":1,"last update":"Wed Nov 8 19:30:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57999999999999996,"15min":0.59799999999999998},"min":{"1min":0.372,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.76200000000000001,"5min":0.77500000000000002,"15min":1.6619999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.628,"15min":0.65500000000000003},"min":{"1min":0.46300000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":1.649},"last":0.65800000000000003}]},{"osd":2,"last update":"Wed Nov 8 19:30:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.58999999999999997,"15min":0.56999999999999995},"min":{"1min":0.38600000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.60099999999999998,"15min":0.623},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.85399999999999998},"last":0.63600000000000001}]},{"osd":3,"last update":"Wed Nov 8 19:30:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.57099999999999995,"15min":0.60999999999999999},"min":{"1min":0.41899999999999998,"5min":0.36699999999999999,"15min":0.33500000000000002},"max":{"1min":0.77500000000000002,"5min":0.80300000000000005,"15min":1.766},"last":0.621},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.56799999999999995,"15min":0.60399999999999998},"min":{"1min":0.44900000000000001,"5min":0.375,"15min":0.36699999999999999},"max":{"1min":0.78600000000000003,"5min":0.84399999999999997,"15min":1.8580000000000001},"last":0.52200000000000002}]},{"osd":4,"last update":"Wed Nov 8 19:30:09 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.51800000000000002,"15min":0.53300000000000003},"min":{"1min":0.318,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.755,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54600000000000004,"15min":0.56899999999999995},"min":{"1min":0.35199999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.82299999999999995,"5min":0.83499999999999996,"15min":0.89100000000000001},"last":0.42399999999999999}]},{"osd":5,"last update":"Wed Nov 8 19:30:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.53000000000000003,"15min":0.55600000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.57099999999999995,"15min":0.61499999999999999},"min":{"1min":0.40200000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.44700000000000001}]},{"osd":7,"last update":"Wed Nov 8 19:30:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.58299999999999996,"15min":0.60399999999999998},"min":{"1min":0.374,"5min":0.312,"15min":0.312},"max":{"1min":0.85299999999999998,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.58699999999999997,"15min":0.628},"min":{"1min":0.46200000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.95099999999999996},"last":0.40000000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574951,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28360,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343480,"statfs":{"total":96636764160,"available":96607723520,"internally_reserved":0,"allocated":1376256,"data_stored":703350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35199999999999998,"15min":0.35799999999999998},"min":{"1min":0.27500000000000002,"5min":0.214,"15min":0.20200000000000001},"max":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":1.2090000000000001},"last":0.31},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.378,"15min":0.39700000000000002},"min":{"1min":0.251,"5min":0.23300000000000001,"15min":0.19700000000000001},"max":{"1min":0.58699999999999997,"5min":0.61599999999999999,"15min":2.1850000000000001},"last":0.34699999999999998}]},{"osd":2,"last update":"Wed Nov 8 19:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.36699999999999999,"15min":0.35099999999999998},"min":{"1min":0.29499999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.59099999999999997},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.44,"5min":0.40799999999999997,"15min":0.39700000000000002},"min":{"1min":0.252,"5min":0.252,"15min":0.24099999999999999},"max":{"1min":0.58399999999999996,"5min":0.623,"15min":1.2689999999999999},"last":0.36899999999999999}]},{"osd":3,"last update":"Wed Nov 8 19:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.43099999999999999,"15min":0.41999999999999998},"min":{"1min":0.28999999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":1.24},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.41899999999999998,"15min":0.443},"min":{"1min":0.35399999999999998,"5min":0.29399999999999998,"15min":0.253},"max":{"1min":0.61099999999999999,"5min":0.68200000000000005,"15min":2.2120000000000002},"last":0.39500000000000002}]},{"osd":4,"last update":"Wed Nov 8 19:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.60699999999999998,"15min":0.60999999999999999},"min":{"1min":0.45400000000000001,"5min":0.36899999999999999,"15min":0.32100000000000001},"max":{"1min":0.873,"5min":0.93400000000000005,"15min":2.1579999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.628,"5min":0.59999999999999998,"15min":0.57899999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.36299999999999999},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.48299999999999998}]},{"osd":5,"last update":"Wed Nov 8 19:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.60799999999999998,"15min":0.57699999999999996},"min":{"1min":0.44,"5min":0.40899999999999997,"15min":0.38100000000000001},"max":{"1min":0.79400000000000004,"5min":0.82599999999999996,"15min":0.86399999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.61499999999999999,"15min":0.60899999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.36099999999999999},"max":{"1min":0.88,"5min":0.90800000000000003,"15min":1.115},"last":0.50600000000000001}]},{"osd":6,"last update":"Wed Nov 8 19:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.61199999999999999,"15min":0.628},"min":{"1min":0.42299999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":2.093},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.626,"15min":0.60999999999999999},"min":{"1min":0.497,"5min":0.41399999999999998,"15min":0.40699999999999997},"max":{"1min":0.86499999999999999,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.52900000000000003}]},{"osd":7,"last update":"Wed Nov 8 19:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.64100000000000001,"15min":0.65700000000000003},"min":{"1min":0.439,"5min":0.437,"15min":0.379},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":1.591},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.626,"15min":0.66600000000000004},"min":{"1min":0.44400000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":2.1299999999999999},"last":0.628}]}]},{"osd":0,"up_from":13,"seq":55834574951,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33100,"kb_used_data":1924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338740,"statfs":{"total":96636764160,"available":96602869760,"internally_reserved":0,"allocated":1970176,"data_stored":1293718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:30:11 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.42399999999999999,"15min":0.90400000000000003},"min":{"1min":0.25700000000000001,"5min":0.19500000000000001,"15min":0.192},"max":{"1min":0.53100000000000003,"5min":6.9509999999999996,"15min":19.295999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.372,"15min":0.82199999999999995},"min":{"1min":0.27400000000000002,"5min":0.222,"15min":0.222},"max":{"1min":0.54900000000000004,"5min":0.57399999999999995,"15min":17.204000000000001},"last":0.44600000000000001}]},{"osd":2,"last update":"Wed Nov 8 19:30:11 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.45300000000000001,"15min":0.56799999999999995},"min":{"1min":0.26500000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.503,"5min":6.8029999999999999,"15min":6.8029999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.41499999999999998,"15min":0.86399999999999999},"min":{"1min":0.311,"5min":0.28999999999999998,"15min":0.23100000000000001},"max":{"1min":0.59799999999999998,"5min":1.3140000000000001,"15min":17.175000000000001},"last":0.51600000000000001}]},{"osd":3,"last update":"Wed Nov 8 19:30:11 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.53500000000000003,"15min":0.79700000000000004},"min":{"1min":0.26400000000000001,"5min":0.24399999999999999,"15min":0.22500000000000001},"max":{"1min":0.52200000000000002,"5min":16.661000000000001,"15min":16.661000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.432,"5min":0.496,"15min":0.433},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.255},"max":{"1min":0.57499999999999996,"5min":6.9859999999999998,"15min":6.9859999999999998},"last":0.46899999999999997}]},{"osd":4,"last update":"Wed Nov 8 19:30:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.61199999999999999,"15min":1.0249999999999999},"min":{"1min":0.49099999999999999,"5min":0.36699999999999999,"15min":0.313},"max":{"1min":0.755,"5min":1.0029999999999999,"15min":17.056000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.75700000000000001,"15min":0.75},"min":{"1min":0.438,"5min":0.33100000000000002,"15min":0.33000000000000002},"max":{"1min":0.75600000000000001,"5min":16.718,"15min":16.718},"last":0.81999999999999995}]},{"osd":5,"last update":"Wed Nov 8 19:30:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.752,"15min":0.75},"min":{"1min":0.45300000000000001,"5min":0.36199999999999999,"15min":0.35799999999999998},"max":{"1min":0.79400000000000004,"5min":16.609000000000002,"15min":16.609000000000002},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.67200000000000004,"15min":0.60099999999999998},"min":{"1min":0.42799999999999999,"5min":0.40100000000000002,"15min":0.34599999999999997},"max":{"1min":0.76700000000000002,"5min":5.1639999999999997,"15min":5.1639999999999997},"last":0.84499999999999997}]},{"osd":6,"last update":"Wed Nov 8 19:30:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.69499999999999995,"15min":0.63500000000000001},"min":{"1min":0.47999999999999998,"5min":0.42699999999999999,"15min":0.36599999999999999},"max":{"1min":0.74099999999999999,"5min":6.6349999999999998,"15min":6.6349999999999998},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.66500000000000004,"15min":1.0740000000000001},"min":{"1min":0.52400000000000002,"5min":0.42199999999999999,"15min":0.34899999999999998},"max":{"1min":0.74299999999999999,"5min":3.1400000000000001,"15min":17.111999999999998},"last":0.68899999999999995}]},{"osd":7,"last update":"Wed Nov 8 19:30:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65000000000000002,"15min":1.079},"min":{"1min":0.55400000000000005,"5min":0.43099999999999999,"15min":0.376},"max":{"1min":0.77700000000000002,"5min":1.0760000000000001,"15min":17.146000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.622,"5min":0.76700000000000002,"15min":0.76200000000000001},"min":{"1min":0.495,"5min":0.441,"15min":0.38800000000000001},"max":{"1min":0.78100000000000003,"5min":16.690999999999999,"15min":16.690999999999999},"last":0.86099999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574951,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28360,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343480,"statfs":{"total":96636764160,"available":96607723520,"internally_reserved":0,"allocated":1376256,"data_stored":703350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:30:17 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.33700000000000002,"15min":0.432},"min":{"1min":0.253,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.436,"5min":0.61299999999999999,"15min":3.4100000000000001},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.39000000000000001,"15min":0.47399999999999998},"min":{"1min":0.22,"5min":0.219,"15min":0.21199999999999999},"max":{"1min":0.68000000000000005,"5min":1.8340000000000001,"15min":3.4369999999999998},"last":0.28599999999999998}]},{"osd":1,"last update":"Wed Nov 8 19:30:17 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.38100000000000001,"15min":0.498},"min":{"1min":0.27400000000000002,"5min":0.24299999999999999,"15min":0.23599999999999999},"max":{"1min":0.504,"5min":0.60699999999999998,"15min":4.0679999999999996},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.44,"15min":0.54900000000000004},"min":{"1min":0.34499999999999997,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.59399999999999997,"5min":0.71899999999999997,"15min":4.3499999999999996},"last":0.434}]},{"osd":3,"last update":"Wed Nov 8 19:30:17 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.40300000000000002,"15min":0.497},"min":{"1min":0.28799999999999998,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.53200000000000003,"5min":0.82999999999999996,"15min":3.8580000000000001},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.38,"5min":0.38500000000000001,"15min":0.47299999999999998},"min":{"1min":0.248,"5min":0.217,"15min":0.217},"max":{"1min":0.52700000000000002,"5min":0.78500000000000003,"15min":3.476},"last":0.313}]},{"osd":4,"last update":"Wed Nov 8 19:30:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.64200000000000002,"15min":0.69499999999999995},"min":{"1min":0.41099999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.79400000000000004,"5min":4.7990000000000004,"15min":4.7990000000000004},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.57799999999999996,"15min":0.68700000000000006},"min":{"1min":0.41999999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.753,"5min":0.872,"15min":4.1040000000000001},"last":0.65600000000000003}]},{"osd":5,"last update":"Wed Nov 8 19:30:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.59799999999999998,"15min":0.69899999999999995},"min":{"1min":0.38900000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.80800000000000005,"5min":0.88,"15min":4.0869999999999997},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.63800000000000001,"15min":0.71399999999999997},"min":{"1min":0.39700000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.71899999999999997,"5min":4.8239999999999998,"15min":4.8239999999999998},"last":0.64400000000000002}]},{"osd":6,"last update":"Wed Nov 8 19:30:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.60299999999999998,"15min":0.71199999999999997},"min":{"1min":0.379,"5min":0.375,"15min":0.375},"max":{"1min":0.755,"5min":1.1200000000000001,"15min":4.1399999999999997},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.59899999999999998,"15min":0.69199999999999995},"min":{"1min":0.38,"5min":0.374,"15min":0.374},"max":{"1min":0.80600000000000005,"5min":0.85599999999999998,"15min":4.0499999999999998},"last":0.70799999999999996}]},{"osd":7,"last update":"Wed Nov 8 19:30:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.626,"15min":0.72699999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.78800000000000003,"5min":0.877,"15min":4.157},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.64500000000000002,"15min":0.753},"min":{"1min":0.45300000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.77300000000000002,"5min":0.95599999999999996,"15min":4.1710000000000003},"last":0.73999999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574951,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28360,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343480,"statfs":{"total":96636764160,"available":96607723520,"internally_reserved":0,"allocated":1376256,"data_stored":703350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:31:08 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.378,"15min":0.38200000000000001},"min":{"1min":0.26500000000000001,"5min":0.217,"15min":0.20399999999999999},"max":{"1min":0.55400000000000005,"5min":0.67100000000000004,"15min":1.458},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.39800000000000002,"15min":0.39700000000000002},"min":{"1min":0.33700000000000002,"5min":0.192,"15min":0.192},"max":{"1min":0.58299999999999996,"5min":0.626,"15min":1.3939999999999999},"last":0.33700000000000002}]},{"osd":1,"last update":"Wed Nov 8 19:31:08 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.40600000000000003,"15min":0.40799999999999997},"min":{"1min":0.246,"5min":0.246,"15min":0.245},"max":{"1min":0.53600000000000003,"5min":0.59099999999999997,"15min":1.512},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.42299999999999999,"15min":0.437},"min":{"1min":0.32500000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.53900000000000003,"5min":0.59999999999999998,"15min":1.5580000000000001},"last":0.39700000000000002}]},{"osd":2,"last update":"Wed Nov 8 19:31:08 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.38600000000000001,"15min":0.379},"min":{"1min":0.28299999999999997,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.629,"5min":1.1100000000000001,"15min":1.2030000000000001},"last":0.37},{"interface":"front","average":{"1min":0.433,"5min":0.40999999999999998,"15min":0.41999999999999998},"min":{"1min":0.318,"5min":0.245,"15min":0.245},"max":{"1min":0.53500000000000003,"5min":0.72399999999999998,"15min":1.536},"last":0.35199999999999998}]},{"osd":4,"last update":"Wed Nov 8 19:31:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.629,"15min":0.621},"min":{"1min":0.495,"5min":0.39600000000000002,"15min":0.36799999999999999},"max":{"1min":0.84999999999999998,"5min":0.86199999999999999,"15min":1.3400000000000001},"last":0.495},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.63500000000000001,"15min":0.61899999999999999},"min":{"1min":0.50600000000000001,"5min":0.40500000000000003,"15min":0.371},"max":{"1min":0.82599999999999996,"5min":0.84999999999999998,"15min":1.153},"last":0.63}]},{"osd":5,"last update":"Wed Nov 8 19:31:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.60199999999999998,"15min":0.59399999999999997},"min":{"1min":0.48499999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":1.4870000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.59699999999999998,"15min":0.59899999999999998},"min":{"1min":0.40799999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.81799999999999995,"5min":0.82799999999999996,"15min":1.3129999999999999},"last":0.60999999999999999}]},{"osd":6,"last update":"Wed Nov 8 19:31:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.59099999999999997,"15min":0.58299999999999996},"min":{"1min":0.42699999999999999,"5min":0.38400000000000001,"15min":0.34100000000000003},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":1.113},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.61199999999999999,"15min":0.61099999999999999},"min":{"1min":0.45700000000000002,"5min":0.439,"15min":0.36899999999999999},"max":{"1min":0.81999999999999995,"5min":0.85899999999999999,"15min":1.4139999999999999},"last":0.48299999999999998}]},{"osd":7,"last update":"Wed Nov 8 19:31:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.624,"15min":0.63700000000000001},"min":{"1min":0.47799999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.871,"5min":0.89300000000000002,"15min":1.3680000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.65100000000000002,"15min":0.629},"min":{"1min":0.46899999999999997,"5min":0.45700000000000002,"15min":0.42299999999999999},"max":{"1min":0.83299999999999996,"5min":0.89000000000000001,"15min":1.179},"last":0.59699999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574951,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28360,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343480,"statfs":{"total":96636764160,"available":96607723520,"internally_reserved":0,"allocated":1376256,"data_stored":703350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:31:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55900000000000005,"15min":0.54600000000000004},"min":{"1min":0.39900000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.74399999999999999,"5min":0.77600000000000002,"15min":1.399},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.55100000000000005,"15min":0.57899999999999996},"min":{"1min":0.43099999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.629,"5min":0.89500000000000002,"15min":2.2090000000000001},"last":0.43099999999999999}]},{"osd":1,"last update":"Wed Nov 8 19:31:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54600000000000004,"15min":0.52300000000000002},"min":{"1min":0.32000000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.68500000000000005,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54200000000000004,"15min":0.51300000000000001},"min":{"1min":0.38600000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.71499999999999997,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.47799999999999998}]},{"osd":2,"last update":"Wed Nov 8 19:31:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.57899999999999996,"15min":0.61399999999999999},"min":{"1min":0.40500000000000003,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.69899999999999995,"5min":0.78200000000000003,"15min":2.8490000000000002},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.56799999999999995,"15min":0.54100000000000004},"min":{"1min":0.36799999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.70699999999999996,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.51000000000000001}]},{"osd":3,"last update":"Wed Nov 8 19:31:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60999999999999999,"15min":0.58299999999999996},"min":{"1min":0.437,"5min":0.371,"15min":0.371},"max":{"1min":0.69899999999999995,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.622,"15min":0.68600000000000005},"min":{"1min":0.46000000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.76700000000000002,"5min":0.86199999999999999,"15min":3.4849999999999999},"last":0.52100000000000002}]},{"osd":5,"last update":"Wed Nov 8 19:31:08 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.46300000000000002,"15min":0.501},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.55700000000000005,"5min":0.746,"15min":0.91500000000000004},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.52100000000000002,"15min":0.54900000000000004},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.32300000000000001},"max":{"1min":0.625,"5min":0.78900000000000003,"15min":0.90500000000000003},"last":0.44500000000000001}]},{"osd":6,"last update":"Wed Nov 8 19:31:08 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.50600000000000001,"15min":0.63800000000000001},"min":{"1min":0.35799999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.72399999999999998,"5min":0.80300000000000005,"15min":4.1529999999999996},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.55300000000000005,"15min":0.59399999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.67200000000000004,"5min":0.77200000000000002,"15min":0.94099999999999995},"last":0.38400000000000001}]},{"osd":7,"last update":"Wed Nov 8 19:31:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.53500000000000003,"15min":0.56000000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.63600000000000001,"5min":0.77800000000000002,"15min":0.99399999999999999},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61699999999999999,"15min":0.76500000000000001},"min":{"1min":0.42499999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.751,"5min":0.85199999999999998,"15min":5.5359999999999996},"last":0.497}]}]},{"osd":5,"up_from":13,"seq":55834574951,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28360,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343480,"statfs":{"total":96636764160,"available":96607723520,"internally_reserved":0,"allocated":1376256,"data_stored":703350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:31:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.53000000000000003,"15min":0.53900000000000003},"min":{"1min":0.31,"5min":0.30399999999999999,"15min":0.26000000000000001},"max":{"1min":0.77400000000000002,"5min":0.80600000000000005,"15min":2.2360000000000002},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.56299999999999994,"15min":0.53400000000000003},"min":{"1min":0.38100000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.70099999999999996,"5min":0.77900000000000003,"15min":0.878},"last":0.63100000000000001}]},{"osd":1,"last update":"Wed Nov 8 19:31:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59899999999999998,"15min":0.56499999999999995},"min":{"1min":0.40500000000000003,"5min":0.28000000000000003,"15min":0.27600000000000002},"max":{"1min":0.74399999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.57599999999999996,"15min":0.59399999999999997},"min":{"1min":0.36399999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.78000000000000003,"5min":0.85499999999999998,"15min":2.2919999999999998},"last":0.61499999999999999}]},{"osd":2,"last update":"Wed Nov 8 19:31:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.57199999999999995,"15min":0.56000000000000005},"min":{"1min":0.34100000000000003,"5min":0.33800000000000002,"15min":0.33000000000000002},"max":{"1min":0.81000000000000005,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57099999999999995,"15min":0.54500000000000004},"min":{"1min":0.39000000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.76500000000000001,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.76500000000000001}]},{"osd":3,"last update":"Wed Nov 8 19:31:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58399999999999996,"15min":0.56399999999999995},"min":{"1min":0.41199999999999998,"5min":0.36699999999999999,"15min":0.35099999999999998},"max":{"1min":0.75700000000000001,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.627,"5min":0.59499999999999997,"15min":0.58099999999999996},"min":{"1min":0.52400000000000002,"5min":0.35599999999999998,"15min":0.34399999999999997},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.89900000000000002},"last":0.73899999999999999}]},{"osd":4,"last update":"Wed Nov 8 19:31:09 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48599999999999999,"15min":0.55800000000000005},"min":{"1min":0.36199999999999999,"5min":0.29999999999999999,"15min":0.29199999999999998},"max":{"1min":0.69499999999999995,"5min":0.81200000000000006,"15min":2.3300000000000001},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.59099999999999997,"15min":0.621},"min":{"1min":0.45900000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.92300000000000004},"last":0.47199999999999998}]},{"osd":6,"last update":"Wed Nov 8 19:31:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.51300000000000001,"15min":0.55700000000000005},"min":{"1min":0.39000000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.71699999999999997,"5min":0.76300000000000001,"15min":0.89400000000000002},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54100000000000004,"15min":0.62},"min":{"1min":0.41899999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":2.3650000000000002},"last":0.432}]},{"osd":7,"last update":"Wed Nov 8 19:31:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.56799999999999995,"15min":0.60799999999999998},"min":{"1min":0.372,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.77900000000000003,"5min":0.84499999999999997,"15min":0.88500000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59199999999999997,"15min":0.628},"min":{"1min":0.41699999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.75,"5min":0.80200000000000005,"15min":0.873},"last":0.64300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:31:15.944 INFO:tasks.ceph:pgid 13.1 last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:31:15.944 INFO:tasks.ceph:pgid 13.4 last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:31:15.945 INFO:tasks.ceph:pgid 13.1c last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:31:15.945 INFO:tasks.ceph:pgid 13.1f last_scrub_stamp 2023-11-08T19:25:46.258224+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=25, tm_sec=46, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=30, tm_sec=9, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:31:15.946 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-08T19:31:35.948 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:31:36.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.081+0000 7f8684326700 1 Processor -- start 2023-11-08T19:31:36.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.081+0000 7f8684326700 1 -- start start 2023-11-08T19:31:36.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.082+0000 7f8684326700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f867c1624c0 0x7f867c06bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:31:36.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.082+0000 7f8684326700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f867c066c80 0x7f867c06c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:31:36.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.082+0000 7f8684326700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f867c06e2a0 con 0x7f867c0ca630 2023-11-08T19:31:36.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.082+0000 7f8684326700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f867c0cc5c0 con 0x7f867c1624c0 2023-11-08T19:31:36.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.082+0000 7f8684326700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f867c06d970 con 0x7f867c066c80 2023-11-08T19:31:36.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.082+0000 7f86820c2700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f867c1624c0 0x7f867c06bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:31:36.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.082+0000 7f86820c2700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f867c1624c0 0x7f867c06bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:46258/0 (socket says 172.21.15.149:46258) 2023-11-08T19:31:36.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.082+0000 7f86820c2700 1 -- 172.21.15.149:0/3790183000 learned_addr learned my addr 172.21.15.149:0/3790183000 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:31:36.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.083+0000 7f86818c1700 1 --2- 172.21.15.149:0/3790183000 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f867c066c80 0x7f867c06c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:31:36.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.083+0000 7f86820c2700 1 -- 172.21.15.149:0/3790183000 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f867c066c80 msgr2=0x7f867c06c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:31:36.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.083+0000 7f86820c2700 1 --2- 172.21.15.149:0/3790183000 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f867c066c80 0x7f867c06c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:31:36.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.083+0000 7f86820c2700 1 -- 172.21.15.149:0/3790183000 >> v1:172.21.15.160:6789/0 conn(0x7f867c0ca630 legacy=0x7f867c0caac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:31:36.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.083+0000 7f86820c2700 1 -- 172.21.15.149:0/3790183000 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f867c06dc50 con 0x7f867c1624c0 2023-11-08T19:31:36.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.083+0000 7f86820c2700 1 --2- 172.21.15.149:0/3790183000 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f867c1624c0 0x7f867c06bb90 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f866c0098f0 tx=0x7f866c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4959ac0496f358a3 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:31:36.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.083+0000 7f86810c0700 1 -- 172.21.15.149:0/3790183000 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f866c004230 con 0x7f867c1624c0 2023-11-08T19:31:36.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.083+0000 7f86810c0700 1 -- 172.21.15.149:0/3790183000 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f866c004390 con 0x7f867c1624c0 2023-11-08T19:31:36.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.083+0000 7f86810c0700 1 -- 172.21.15.149:0/3790183000 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f866c0036a0 con 0x7f867c1624c0 2023-11-08T19:31:36.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.083+0000 7f8684326700 1 -- 172.21.15.149:0/3790183000 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f867c1624c0 msgr2=0x7f867c06bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:31:36.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.083+0000 7f8684326700 1 --2- 172.21.15.149:0/3790183000 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f867c1624c0 0x7f867c06bb90 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f866c0098f0 tx=0x7f866c009c00 comp rx=0 tx=0).stop 2023-11-08T19:31:36.092 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.084+0000 7f8684326700 1 -- 172.21.15.149:0/3790183000 shutdown_connections 2023-11-08T19:31:36.092 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.084+0000 7f8684326700 1 --2- 172.21.15.149:0/3790183000 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f867c1624c0 0x7f867c06bb90 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:31:36.092 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.084+0000 7f8684326700 1 --2- 172.21.15.149:0/3790183000 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f867c066c80 0x7f867c06c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:31:36.092 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.084+0000 7f8684326700 1 -- 172.21.15.149:0/3790183000 >> 172.21.15.149:0/3790183000 conn(0x7f867c071720 msgr2=0x7f867c071b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:31:36.093 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.084+0000 7f8684326700 1 -- 172.21.15.149:0/3790183000 shutdown_connections 2023-11-08T19:31:36.093 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.084+0000 7f8684326700 1 -- 172.21.15.149:0/3790183000 wait complete. 2023-11-08T19:31:36.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.085+0000 7f8684326700 1 Processor -- start 2023-11-08T19:31:36.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.085+0000 7f8684326700 1 -- start start 2023-11-08T19:31:36.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.086+0000 7f8684326700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f867c066c80 0x7f867c156420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:31:36.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.086+0000 7f8684326700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f867c0ca630 0x7f867c0c6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:31:36.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.086+0000 7f8684326700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f867c1624c0 0x7f867c0c3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:31:36.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.086+0000 7f8684326700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867c0c49b0 con 0x7f867c1624c0 2023-11-08T19:31:36.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.086+0000 7f8684326700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867c0b2a90 con 0x7f867c066c80 2023-11-08T19:31:36.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.086+0000 7f8684326700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f867c0c5720 con 0x7f867c0ca630 2023-11-08T19:31:36.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.086+0000 7f86828c3700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f867c1624c0 0x7f867c0c3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:31:36.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.086+0000 7f86828c3700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f867c1624c0 0x7f867c0c3930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:46266/0 (socket says 172.21.15.149:46266) 2023-11-08T19:31:36.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.086+0000 7f86828c3700 1 -- 172.21.15.149:0/4105989654 learned_addr learned my addr 172.21.15.149:0/4105989654 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:31:36.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.086+0000 7f86820c2700 1 --2- 172.21.15.149:0/4105989654 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f867c066c80 0x7f867c156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:31:36.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.086+0000 7f86818c1700 1 --2- 172.21.15.149:0/4105989654 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f867c0ca630 0x7f867c0c6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:31:36.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.086+0000 7f86828c3700 1 -- 172.21.15.149:0/4105989654 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f867c0ca630 msgr2=0x7f867c0c6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:31:36.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.086+0000 7f86828c3700 1 --2- 172.21.15.149:0/4105989654 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f867c0ca630 0x7f867c0c6ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:31:36.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.086+0000 7f86828c3700 1 -- 172.21.15.149:0/4105989654 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f867c066c80 msgr2=0x7f867c156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:31:36.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.086+0000 7f86828c3700 1 --2- 172.21.15.149:0/4105989654 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f867c066c80 0x7f867c156420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:31:36.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.086+0000 7f86828c3700 1 -- 172.21.15.149:0/4105989654 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f866c009550 con 0x7f867c1624c0 2023-11-08T19:31:36.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.086+0000 7f86828c3700 1 --2- 172.21.15.149:0/4105989654 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f867c1624c0 0x7f867c0c3930 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f867400cc10 tx=0x7f867400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:31:36.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.086+0000 7f8672ffd700 1 -- 172.21.15.149:0/4105989654 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867400abb0 con 0x7f867c1624c0 2023-11-08T19:31:36.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.086+0000 7f8672ffd700 1 -- 172.21.15.149:0/4105989654 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f867400ad10 con 0x7f867c1624c0 2023-11-08T19:31:36.103 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.086+0000 7f8684326700 1 -- 172.21.15.149:0/4105989654 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f867c156960 con 0x7f867c1624c0 2023-11-08T19:31:36.103 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.086+0000 7f8672ffd700 1 -- 172.21.15.149:0/4105989654 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8674012660 con 0x7f867c1624c0 2023-11-08T19:31:36.103 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.086+0000 7f8684326700 1 -- 172.21.15.149:0/4105989654 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f867c0c46d0 con 0x7f867c1624c0 2023-11-08T19:31:36.103 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.087+0000 7f8684326700 1 -- 172.21.15.149:0/4105989654 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f867c0c5890 con 0x7f867c1624c0 2023-11-08T19:31:36.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.088+0000 7f8672ffd700 1 -- 172.21.15.149:0/4105989654 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f86740127c0 con 0x7f867c1624c0 2023-11-08T19:31:36.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.088+0000 7f8672ffd700 1 --2- 172.21.15.149:0/4105989654 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f866006af00 0x7f866006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:31:36.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.088+0000 7f8672ffd700 1 -- 172.21.15.149:0/4105989654 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6999+0+0 (secure 0 0 0) 0x7f867408a2d0 con 0x7f867c1624c0 2023-11-08T19:31:36.105 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.088+0000 7f86820c2700 1 --2- 172.21.15.149:0/4105989654 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f866006af00 0x7f866006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:31:36.105 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.089+0000 7f86820c2700 1 --2- 172.21.15.149:0/4105989654 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f866006af00 0x7f866006d3c0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f866c009c40 tx=0x7f866c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:31:36.105 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.093+0000 7f8672ffd700 1 -- 172.21.15.149:0/4105989654 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8674054e70 con 0x7f867c1624c0 2023-11-08T19:31:36.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.281+0000 7f8684326700 1 -- 172.21.15.149:0/4105989654 --> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f867c0722b0 con 0x7f866006af00 2023-11-08T19:31:36.290 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.289+0000 7f8672ffd700 1 -- 172.21.15.149:0/4105989654 <== mgr.4104 v2:172.21.15.149:6832/1929837472 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+295049 (secure 0 0 0) 0x7f867c0722b0 con 0x7f866006af00 2023-11-08T19:31:36.294 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:31:36.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.292+0000 7f8684326700 1 -- 172.21.15.149:0/4105989654 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f866006af00 msgr2=0x7f866006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:31:36.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.292+0000 7f8684326700 1 --2- 172.21.15.149:0/4105989654 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f866006af00 0x7f866006d3c0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f866c009c40 tx=0x7f866c008030 comp rx=0 tx=0).stop 2023-11-08T19:31:36.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.292+0000 7f8684326700 1 -- 172.21.15.149:0/4105989654 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f867c1624c0 msgr2=0x7f867c0c3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:31:36.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.292+0000 7f8684326700 1 --2- 172.21.15.149:0/4105989654 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f867c1624c0 0x7f867c0c3930 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f867400cc10 tx=0x7f867400a060 comp rx=0 tx=0).stop 2023-11-08T19:31:36.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.292+0000 7f8684326700 1 -- 172.21.15.149:0/4105989654 shutdown_connections 2023-11-08T19:31:36.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.292+0000 7f8684326700 1 --2- 172.21.15.149:0/4105989654 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f866006af00 0x7f866006d3c0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:31:36.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.292+0000 7f8684326700 1 --2- 172.21.15.149:0/4105989654 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f867c066c80 0x7f867c156420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:31:36.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.292+0000 7f8684326700 1 --2- 172.21.15.149:0/4105989654 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f867c1624c0 0x7f867c0c3930 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:31:36.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.292+0000 7f8684326700 1 --2- 172.21.15.149:0/4105989654 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f867c0ca630 0x7f867c0c6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:31:36.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.292+0000 7f8684326700 1 -- 172.21.15.149:0/4105989654 >> 172.21.15.149:0/4105989654 conn(0x7f867c071720 msgr2=0x7f867c0af860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:31:36.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.292+0000 7f8684326700 1 -- 172.21.15.149:0/4105989654 shutdown_connections 2023-11-08T19:31:36.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.292+0000 7f8684326700 1 -- 172.21.15.149:0/4105989654 wait complete. 2023-11-08T19:31:36.300 INFO:teuthology.orchestra.run.smithi149.stderr:dumped all 2023-11-08T19:31:36.305 INFO:teuthology.orchestra.run.smithi149.stdout:{"pg_ready":true,"pg_map":{"version":364,"stamp":"2023-11-08T19:31:36.122163+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":232200,"kb_used_data":11912,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754742520,"statfs":{"total":773094113280,"available":772856340480,"internally_reserved":0,"allocated":12197888,"data_stored":6807536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003060"},"pg_stats":[{"pgid":"13.c","version":"0'0","reported_seq":55,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:39.195724+0000","last_change":"2023-11-08T19:30:39.195764+0000","last_active":"2023-11-08T19:30:39.195724+0000","last_peered":"2023-11-08T19:30:39.195724+0000","last_clean":"2023-11-08T19:30:39.195724+0000","last_became_active":"2023-11-08T19:25:47.284788+0000","last_became_peered":"2023-11-08T19:25:47.284788+0000","last_unstale":"2023-11-08T19:30:39.195724+0000","last_undegraded":"2023-11-08T19:30:39.195724+0000","last_fullsized":"2023-11-08T19:30:39.195724+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:39.195588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:39.195588+0000","last_clean_scrub_stamp":"2023-11-08T19:30:39.195588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:38:12.811188+0000","scrub_duration":0.0017506209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"111'119","reported_seq":256,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:16.176798+0000","last_change":"2023-11-08T19:30:16.176798+0000","last_active":"2023-11-08T19:30:16.176798+0000","last_peered":"2023-11-08T19:30:16.176798+0000","last_clean":"2023-11-08T19:30:16.176798+0000","last_became_active":"2023-11-08T19:22:58.053337+0000","last_became_peered":"2023-11-08T19:22:58.053337+0000","last_unstale":"2023-11-08T19:30:16.176798+0000","last_undegraded":"2023-11-08T19:30:16.176798+0000","last_fullsized":"2023-11-08T19:30:16.176798+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'119","last_scrub_stamp":"2023-11-08T19:30:16.176632+0000","last_deep_scrub":"111'119","last_deep_scrub_stamp":"2023-11-08T19:30:16.176632+0000","last_clean_scrub_stamp":"2023-11-08T19:30:16.176632+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:41:41.655108+0000","scrub_duration":0.0052701320000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":87,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:42.247526+0000","last_change":"2023-11-08T19:30:42.247526+0000","last_active":"2023-11-08T19:30:42.247526+0000","last_peered":"2023-11-08T19:30:42.247526+0000","last_clean":"2023-11-08T19:30:42.247526+0000","last_became_active":"2023-11-08T19:24:31.148363+0000","last_became_peered":"2023-11-08T19:24:31.148363+0000","last_unstale":"2023-11-08T19:30:42.247526+0000","last_undegraded":"2023-11-08T19:30:42.247526+0000","last_fullsized":"2023-11-08T19:30:42.247526+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:42.247410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:42.247410+0000","last_clean_scrub_stamp":"2023-11-08T19:30:42.247410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:42:17.743190+0000","scrub_duration":0.00190854,"objects_trimmed":0,"snaptrim_duration":0.00075444200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":62,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:36.139925+0000","last_change":"2023-11-08T19:30:36.139962+0000","last_active":"2023-11-08T19:30:36.139925+0000","last_peered":"2023-11-08T19:30:36.139925+0000","last_clean":"2023-11-08T19:30:36.139925+0000","last_became_active":"2023-11-08T19:25:46.289470+0000","last_became_peered":"2023-11-08T19:25:46.289470+0000","last_unstale":"2023-11-08T19:30:36.139925+0000","last_undegraded":"2023-11-08T19:30:36.139925+0000","last_fullsized":"2023-11-08T19:30:36.139925+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:36.139832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:36.139832+0000","last_clean_scrub_stamp":"2023-11-08T19:30:36.139832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:31:31.135502+0000","scrub_duration":0.001942477,"objects_trimmed":0,"snaptrim_duration":0.000371219,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":59,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:28.037056+0000","last_change":"2023-11-08T19:30:28.037082+0000","last_active":"2023-11-08T19:30:28.037056+0000","last_peered":"2023-11-08T19:30:28.037056+0000","last_clean":"2023-11-08T19:30:28.037056+0000","last_became_active":"2023-11-08T19:25:47.282922+0000","last_became_peered":"2023-11-08T19:25:47.282922+0000","last_unstale":"2023-11-08T19:30:28.037056+0000","last_undegraded":"2023-11-08T19:30:28.037056+0000","last_fullsized":"2023-11-08T19:30:28.037056+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:28.036969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:28.036969+0000","last_clean_scrub_stamp":"2023-11-08T19:30:28.036969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:26:53.908203+0000","scrub_duration":0.0019860609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":87,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:19.998985+0000","last_change":"2023-11-08T19:30:19.998985+0000","last_active":"2023-11-08T19:30:19.998985+0000","last_peered":"2023-11-08T19:30:19.998985+0000","last_clean":"2023-11-08T19:30:19.998985+0000","last_became_active":"2023-11-08T19:24:31.138598+0000","last_became_peered":"2023-11-08T19:24:31.138598+0000","last_unstale":"2023-11-08T19:30:19.998985+0000","last_undegraded":"2023-11-08T19:30:19.998985+0000","last_fullsized":"2023-11-08T19:30:19.998985+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:19.998879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:19.998879+0000","last_clean_scrub_stamp":"2023-11-08T19:30:19.998879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:18:08.731391+0000","scrub_duration":0.001419371,"objects_trimmed":0,"snaptrim_duration":0.015114824000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":66,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:19.886457+0000","last_change":"2023-11-08T19:30:19.886481+0000","last_active":"2023-11-08T19:30:19.886457+0000","last_peered":"2023-11-08T19:30:19.886457+0000","last_clean":"2023-11-08T19:30:19.886457+0000","last_became_active":"2023-11-08T19:25:46.279007+0000","last_became_peered":"2023-11-08T19:25:46.279007+0000","last_unstale":"2023-11-08T19:30:19.886457+0000","last_undegraded":"2023-11-08T19:30:19.886457+0000","last_fullsized":"2023-11-08T19:30:19.886457+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:19.886330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:19.886330+0000","last_clean_scrub_stamp":"2023-11-08T19:30:19.886330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:27:13.439557+0000","scrub_duration":0.001929435,"objects_trimmed":0,"snaptrim_duration":0.0036813240000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":57,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:29.504740+0000","last_change":"2023-11-08T19:30:29.504765+0000","last_active":"2023-11-08T19:30:29.504740+0000","last_peered":"2023-11-08T19:30:29.504740+0000","last_clean":"2023-11-08T19:30:29.504740+0000","last_became_active":"2023-11-08T19:25:47.284796+0000","last_became_peered":"2023-11-08T19:25:47.284796+0000","last_unstale":"2023-11-08T19:30:29.504740+0000","last_undegraded":"2023-11-08T19:30:29.504740+0000","last_fullsized":"2023-11-08T19:30:29.504740+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:29.504641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:29.504641+0000","last_clean_scrub_stamp":"2023-11-08T19:30:29.504641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:17:32.777171+0000","scrub_duration":0.002043577,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":87,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:14.999954+0000","last_change":"2023-11-08T19:30:14.999954+0000","last_active":"2023-11-08T19:30:14.999954+0000","last_peered":"2023-11-08T19:30:14.999954+0000","last_clean":"2023-11-08T19:30:14.999954+0000","last_became_active":"2023-11-08T19:24:31.142028+0000","last_became_peered":"2023-11-08T19:24:31.142028+0000","last_unstale":"2023-11-08T19:30:14.999954+0000","last_undegraded":"2023-11-08T19:30:14.999954+0000","last_fullsized":"2023-11-08T19:30:14.999954+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:14.999864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:14.999864+0000","last_clean_scrub_stamp":"2023-11-08T19:30:14.999864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:46:08.947796+0000","scrub_duration":0.001067143,"objects_trimmed":0,"snaptrim_duration":0.00067537399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":63,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:28.110765+0000","last_change":"2023-11-08T19:30:28.110801+0000","last_active":"2023-11-08T19:30:28.110765+0000","last_peered":"2023-11-08T19:30:28.110765+0000","last_clean":"2023-11-08T19:30:28.110765+0000","last_became_active":"2023-11-08T19:25:46.288739+0000","last_became_peered":"2023-11-08T19:25:46.288739+0000","last_unstale":"2023-11-08T19:30:28.110765+0000","last_undegraded":"2023-11-08T19:30:28.110765+0000","last_fullsized":"2023-11-08T19:30:28.110765+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:28.110672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:28.110672+0000","last_clean_scrub_stamp":"2023-11-08T19:30:28.110672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:49:10.857315+0000","scrub_duration":0.0014712219999999999,"objects_trimmed":0,"snaptrim_duration":0.0015057530000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":59,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:22.944958+0000","last_change":"2023-11-08T19:30:22.944994+0000","last_active":"2023-11-08T19:30:22.944958+0000","last_peered":"2023-11-08T19:30:22.944958+0000","last_clean":"2023-11-08T19:30:22.944958+0000","last_became_active":"2023-11-08T19:25:47.287494+0000","last_became_peered":"2023-11-08T19:25:47.287494+0000","last_unstale":"2023-11-08T19:30:22.944958+0000","last_undegraded":"2023-11-08T19:30:22.944958+0000","last_fullsized":"2023-11-08T19:30:22.944958+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:22.944836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:22.944836+0000","last_clean_scrub_stamp":"2023-11-08T19:30:22.944836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:13:58.622747+0000","scrub_duration":0.001547238,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":88,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:13.647703+0000","last_change":"2023-11-08T19:30:13.647703+0000","last_active":"2023-11-08T19:30:13.647703+0000","last_peered":"2023-11-08T19:30:13.647703+0000","last_clean":"2023-11-08T19:30:13.647703+0000","last_became_active":"2023-11-08T19:24:31.141367+0000","last_became_peered":"2023-11-08T19:24:31.141367+0000","last_unstale":"2023-11-08T19:30:13.647703+0000","last_undegraded":"2023-11-08T19:30:13.647703+0000","last_fullsized":"2023-11-08T19:30:13.647703+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:13.647567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:13.647567+0000","last_clean_scrub_stamp":"2023-11-08T19:30:13.647567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:51:59.112379+0000","scrub_duration":0.0017188710000000001,"objects_trimmed":0,"snaptrim_duration":0.001335136,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":63,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:30.067419+0000","last_change":"2023-11-08T19:30:30.067450+0000","last_active":"2023-11-08T19:30:30.067419+0000","last_peered":"2023-11-08T19:30:30.067419+0000","last_clean":"2023-11-08T19:30:30.067419+0000","last_became_active":"2023-11-08T19:25:46.289283+0000","last_became_peered":"2023-11-08T19:25:46.289283+0000","last_unstale":"2023-11-08T19:30:30.067419+0000","last_undegraded":"2023-11-08T19:30:30.067419+0000","last_fullsized":"2023-11-08T19:30:30.067419+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:30.067319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:30.067319+0000","last_clean_scrub_stamp":"2023-11-08T19:30:30.067319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:16:49.675631+0000","scrub_duration":0.001437668,"objects_trimmed":0,"snaptrim_duration":0.001274049,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":57,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:36.471693+0000","last_change":"2023-11-08T19:30:36.471717+0000","last_active":"2023-11-08T19:30:36.471693+0000","last_peered":"2023-11-08T19:30:36.471693+0000","last_clean":"2023-11-08T19:30:36.471693+0000","last_became_active":"2023-11-08T19:25:47.285075+0000","last_became_peered":"2023-11-08T19:25:47.285075+0000","last_unstale":"2023-11-08T19:30:36.471693+0000","last_undegraded":"2023-11-08T19:30:36.471693+0000","last_fullsized":"2023-11-08T19:30:36.471693+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:36.471601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:36.471601+0000","last_clean_scrub_stamp":"2023-11-08T19:30:36.471601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:10:24.384726+0000","scrub_duration":0.002370937,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":97,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:16.672700+0000","last_change":"2023-11-08T19:30:16.672700+0000","last_active":"2023-11-08T19:30:16.672700+0000","last_peered":"2023-11-08T19:30:16.672700+0000","last_clean":"2023-11-08T19:30:16.672700+0000","last_became_active":"2023-11-08T19:24:31.145329+0000","last_became_peered":"2023-11-08T19:24:31.145329+0000","last_unstale":"2023-11-08T19:30:16.672700+0000","last_undegraded":"2023-11-08T19:30:16.672700+0000","last_fullsized":"2023-11-08T19:30:16.672700+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:16.672581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:16.672581+0000","last_clean_scrub_stamp":"2023-11-08T19:30:16.672581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:23:01.900333+0000","scrub_duration":0.0018379830000000001,"objects_trimmed":0,"snaptrim_duration":0.00049012999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":66,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:20.921021+0000","last_change":"2023-11-08T19:30:20.921044+0000","last_active":"2023-11-08T19:30:20.921021+0000","last_peered":"2023-11-08T19:30:20.921021+0000","last_clean":"2023-11-08T19:30:20.921021+0000","last_became_active":"2023-11-08T19:25:46.282174+0000","last_became_peered":"2023-11-08T19:25:46.282174+0000","last_unstale":"2023-11-08T19:30:20.921021+0000","last_undegraded":"2023-11-08T19:30:20.921021+0000","last_fullsized":"2023-11-08T19:30:20.921021+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:20.920910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:20.920910+0000","last_clean_scrub_stamp":"2023-11-08T19:30:20.920910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:07:53.526415+0000","scrub_duration":0.0014780660000000001,"objects_trimmed":0,"snaptrim_duration":0.000727792,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":62,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:48.540579+0000","last_change":"2023-11-08T19:30:48.540606+0000","last_active":"2023-11-08T19:30:48.540579+0000","last_peered":"2023-11-08T19:30:48.540579+0000","last_clean":"2023-11-08T19:30:48.540579+0000","last_became_active":"2023-11-08T19:25:47.287419+0000","last_became_peered":"2023-11-08T19:25:47.287419+0000","last_unstale":"2023-11-08T19:30:48.540579+0000","last_undegraded":"2023-11-08T19:30:48.540579+0000","last_fullsized":"2023-11-08T19:30:48.540579+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:48.540462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:48.540462+0000","last_clean_scrub_stamp":"2023-11-08T19:30:48.540462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:58:16.445190+0000","scrub_duration":0.0024177930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":96,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:34.850967+0000","last_change":"2023-11-08T19:30:34.850967+0000","last_active":"2023-11-08T19:30:34.850967+0000","last_peered":"2023-11-08T19:30:34.850967+0000","last_clean":"2023-11-08T19:30:34.850967+0000","last_became_active":"2023-11-08T19:24:31.146063+0000","last_became_peered":"2023-11-08T19:24:31.146063+0000","last_unstale":"2023-11-08T19:30:34.850967+0000","last_undegraded":"2023-11-08T19:30:34.850967+0000","last_fullsized":"2023-11-08T19:30:34.850967+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:34.850866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:34.850866+0000","last_clean_scrub_stamp":"2023-11-08T19:30:34.850866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:36:22.019388+0000","scrub_duration":0.00177243,"objects_trimmed":0,"snaptrim_duration":0.00089896300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":64,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:55.429492+0000","last_change":"2023-11-08T19:30:55.429510+0000","last_active":"2023-11-08T19:30:55.429492+0000","last_peered":"2023-11-08T19:30:55.429492+0000","last_clean":"2023-11-08T19:30:55.429492+0000","last_became_active":"2023-11-08T19:25:46.281986+0000","last_became_peered":"2023-11-08T19:25:46.281986+0000","last_unstale":"2023-11-08T19:30:55.429492+0000","last_undegraded":"2023-11-08T19:30:55.429492+0000","last_fullsized":"2023-11-08T19:30:55.429492+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:55.429420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:55.429420+0000","last_clean_scrub_stamp":"2023-11-08T19:30:55.429420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:26:44.126324+0000","scrub_duration":0.001670782,"objects_trimmed":0,"snaptrim_duration":0.003067771,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":55,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:45.947469+0000","last_change":"2023-11-08T19:30:45.947492+0000","last_active":"2023-11-08T19:30:45.947469+0000","last_peered":"2023-11-08T19:30:45.947469+0000","last_clean":"2023-11-08T19:30:45.947469+0000","last_became_active":"2023-11-08T19:25:47.287560+0000","last_became_peered":"2023-11-08T19:25:47.287560+0000","last_unstale":"2023-11-08T19:30:45.947469+0000","last_undegraded":"2023-11-08T19:30:45.947469+0000","last_fullsized":"2023-11-08T19:30:45.947469+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:45.947375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:45.947375+0000","last_clean_scrub_stamp":"2023-11-08T19:30:45.947375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:46:08.051257+0000","scrub_duration":0.001481039,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":87,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:37.159886+0000","last_change":"2023-11-08T19:30:37.159886+0000","last_active":"2023-11-08T19:30:37.159886+0000","last_peered":"2023-11-08T19:30:37.159886+0000","last_clean":"2023-11-08T19:30:37.159886+0000","last_became_active":"2023-11-08T19:24:31.144223+0000","last_became_peered":"2023-11-08T19:24:31.144223+0000","last_unstale":"2023-11-08T19:30:37.159886+0000","last_undegraded":"2023-11-08T19:30:37.159886+0000","last_fullsized":"2023-11-08T19:30:37.159886+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:37.159760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:37.159760+0000","last_clean_scrub_stamp":"2023-11-08T19:30:37.159760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:30:10.933513+0000","scrub_duration":0.00183394,"objects_trimmed":0,"snaptrim_duration":0.00071879799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":69,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:21.808575+0000","last_change":"2023-11-08T19:30:21.808611+0000","last_active":"2023-11-08T19:30:21.808575+0000","last_peered":"2023-11-08T19:30:21.808575+0000","last_clean":"2023-11-08T19:30:21.808575+0000","last_became_active":"2023-11-08T19:25:46.278686+0000","last_became_peered":"2023-11-08T19:25:46.278686+0000","last_unstale":"2023-11-08T19:30:21.808575+0000","last_undegraded":"2023-11-08T19:30:21.808575+0000","last_fullsized":"2023-11-08T19:30:21.808575+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:21.808432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:21.808432+0000","last_clean_scrub_stamp":"2023-11-08T19:30:21.808432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:35:49.484450+0000","scrub_duration":0.0016393169999999999,"objects_trimmed":0,"snaptrim_duration":0.00078409499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":62,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:31:09.586287+0000","last_change":"2023-11-08T19:31:09.586314+0000","last_active":"2023-11-08T19:31:09.586287+0000","last_peered":"2023-11-08T19:31:09.586287+0000","last_clean":"2023-11-08T19:31:09.586287+0000","last_became_active":"2023-11-08T19:25:47.289362+0000","last_became_peered":"2023-11-08T19:25:47.289362+0000","last_unstale":"2023-11-08T19:31:09.586287+0000","last_undegraded":"2023-11-08T19:31:09.586287+0000","last_fullsized":"2023-11-08T19:31:09.586287+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:31:09.586172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:31:09.586172+0000","last_clean_scrub_stamp":"2023-11-08T19:31:09.586172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:41:56.894832+0000","scrub_duration":0.0016733010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":86,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:32.188564+0000","last_change":"2023-11-08T19:30:32.188564+0000","last_active":"2023-11-08T19:30:32.188564+0000","last_peered":"2023-11-08T19:30:32.188564+0000","last_clean":"2023-11-08T19:30:32.188564+0000","last_became_active":"2023-11-08T19:24:31.147082+0000","last_became_peered":"2023-11-08T19:24:31.147082+0000","last_unstale":"2023-11-08T19:30:32.188564+0000","last_undegraded":"2023-11-08T19:30:32.188564+0000","last_fullsized":"2023-11-08T19:30:32.188564+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:32.188459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:32.188459+0000","last_clean_scrub_stamp":"2023-11-08T19:30:32.188459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:25:59.508112+0000","scrub_duration":0.001809777,"objects_trimmed":0,"snaptrim_duration":0.00043701599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":64,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:58.429599+0000","last_change":"2023-11-08T19:30:58.429624+0000","last_active":"2023-11-08T19:30:58.429599+0000","last_peered":"2023-11-08T19:30:58.429599+0000","last_clean":"2023-11-08T19:30:58.429599+0000","last_became_active":"2023-11-08T19:25:46.282071+0000","last_became_peered":"2023-11-08T19:25:46.282071+0000","last_unstale":"2023-11-08T19:30:58.429599+0000","last_undegraded":"2023-11-08T19:30:58.429599+0000","last_fullsized":"2023-11-08T19:30:58.429599+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:58.429503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:58.429503+0000","last_clean_scrub_stamp":"2023-11-08T19:30:58.429503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:25:29.520870+0000","scrub_duration":0.0021116139999999999,"objects_trimmed":0,"snaptrim_duration":0.0023654909999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":87,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:24.116761+0000","last_change":"2023-11-08T19:30:24.116761+0000","last_active":"2023-11-08T19:30:24.116761+0000","last_peered":"2023-11-08T19:30:24.116761+0000","last_clean":"2023-11-08T19:30:24.116761+0000","last_became_active":"2023-11-08T19:24:31.144795+0000","last_became_peered":"2023-11-08T19:24:31.144795+0000","last_unstale":"2023-11-08T19:30:24.116761+0000","last_undegraded":"2023-11-08T19:30:24.116761+0000","last_fullsized":"2023-11-08T19:30:24.116761+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:24.116622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:24.116622+0000","last_clean_scrub_stamp":"2023-11-08T19:30:24.116622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:11:25.781444+0000","scrub_duration":0.0015405900000000001,"objects_trimmed":0,"snaptrim_duration":0.01495431,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":69,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:46.739832+0000","last_change":"2023-11-08T19:30:46.739872+0000","last_active":"2023-11-08T19:30:46.739832+0000","last_peered":"2023-11-08T19:30:46.739832+0000","last_clean":"2023-11-08T19:30:46.739832+0000","last_became_active":"2023-11-08T19:25:46.285766+0000","last_became_peered":"2023-11-08T19:25:46.285766+0000","last_unstale":"2023-11-08T19:30:46.739832+0000","last_undegraded":"2023-11-08T19:30:46.739832+0000","last_fullsized":"2023-11-08T19:30:46.739832+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:46.739670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:46.739670+0000","last_clean_scrub_stamp":"2023-11-08T19:30:46.739670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:39:25.915335+0000","scrub_duration":0.001977244,"objects_trimmed":0,"snaptrim_duration":0.001756748,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":55,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:44.946783+0000","last_change":"2023-11-08T19:30:44.946827+0000","last_active":"2023-11-08T19:30:44.946783+0000","last_peered":"2023-11-08T19:30:44.946783+0000","last_clean":"2023-11-08T19:30:44.946783+0000","last_became_active":"2023-11-08T19:25:47.288027+0000","last_became_peered":"2023-11-08T19:25:47.288027+0000","last_unstale":"2023-11-08T19:30:44.946783+0000","last_undegraded":"2023-11-08T19:30:44.946783+0000","last_fullsized":"2023-11-08T19:30:44.946783+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:44.946674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:44.946674+0000","last_clean_scrub_stamp":"2023-11-08T19:30:44.946674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:32:49.215775+0000","scrub_duration":0.0020628539999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":87,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:14.200080+0000","last_change":"2023-11-08T19:30:14.200080+0000","last_active":"2023-11-08T19:30:14.200080+0000","last_peered":"2023-11-08T19:30:14.200080+0000","last_clean":"2023-11-08T19:30:14.200080+0000","last_became_active":"2023-11-08T19:24:31.138814+0000","last_became_peered":"2023-11-08T19:24:31.138814+0000","last_unstale":"2023-11-08T19:30:14.200080+0000","last_undegraded":"2023-11-08T19:30:14.200080+0000","last_fullsized":"2023-11-08T19:30:14.200080+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:14.199980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:14.199980+0000","last_clean_scrub_stamp":"2023-11-08T19:30:14.199980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:51:59.664792+0000","scrub_duration":0.0015028369999999999,"objects_trimmed":0,"snaptrim_duration":0.00048136000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":69,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:36.507501+0000","last_change":"2023-11-08T19:30:36.507522+0000","last_active":"2023-11-08T19:30:36.507501+0000","last_peered":"2023-11-08T19:30:36.507501+0000","last_clean":"2023-11-08T19:30:36.507501+0000","last_became_active":"2023-11-08T19:25:46.271936+0000","last_became_peered":"2023-11-08T19:25:46.271936+0000","last_unstale":"2023-11-08T19:30:36.507501+0000","last_undegraded":"2023-11-08T19:30:36.507501+0000","last_fullsized":"2023-11-08T19:30:36.507501+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:36.507418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:36.507418+0000","last_clean_scrub_stamp":"2023-11-08T19:30:36.507418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:49:25.737651+0000","scrub_duration":0.0014739589999999999,"objects_trimmed":0,"snaptrim_duration":0.00186835,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":62,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:31:16.689594+0000","last_change":"2023-11-08T19:31:16.689649+0000","last_active":"2023-11-08T19:31:16.689594+0000","last_peered":"2023-11-08T19:31:16.689594+0000","last_clean":"2023-11-08T19:31:16.689594+0000","last_became_active":"2023-11-08T19:25:47.282594+0000","last_became_peered":"2023-11-08T19:25:47.282594+0000","last_unstale":"2023-11-08T19:31:16.689594+0000","last_undegraded":"2023-11-08T19:31:16.689594+0000","last_fullsized":"2023-11-08T19:31:16.689594+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:31:16.689483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:31:16.689483+0000","last_clean_scrub_stamp":"2023-11-08T19:31:16.689483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:35:25.392600+0000","scrub_duration":0.0026237370000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":90,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:14.808755+0000","last_change":"2023-11-08T19:30:14.808755+0000","last_active":"2023-11-08T19:30:14.808755+0000","last_peered":"2023-11-08T19:30:14.808755+0000","last_clean":"2023-11-08T19:30:14.808755+0000","last_became_active":"2023-11-08T19:24:31.142985+0000","last_became_peered":"2023-11-08T19:24:31.142985+0000","last_unstale":"2023-11-08T19:30:14.808755+0000","last_undegraded":"2023-11-08T19:30:14.808755+0000","last_fullsized":"2023-11-08T19:30:14.808755+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:14.808667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:14.808667+0000","last_clean_scrub_stamp":"2023-11-08T19:30:14.808667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:58:55.493702+0000","scrub_duration":0.0018409399999999999,"objects_trimmed":0,"snaptrim_duration":0.000386048,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":64,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:51.347115+0000","last_change":"2023-11-08T19:30:51.347152+0000","last_active":"2023-11-08T19:30:51.347115+0000","last_peered":"2023-11-08T19:30:51.347115+0000","last_clean":"2023-11-08T19:30:51.347115+0000","last_became_active":"2023-11-08T19:25:46.283263+0000","last_became_peered":"2023-11-08T19:25:46.283263+0000","last_unstale":"2023-11-08T19:30:51.347115+0000","last_undegraded":"2023-11-08T19:30:51.347115+0000","last_fullsized":"2023-11-08T19:30:51.347115+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:51.346997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:51.346997+0000","last_clean_scrub_stamp":"2023-11-08T19:30:51.346997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:08:26.238174+0000","scrub_duration":0.0023000680000000002,"objects_trimmed":0,"snaptrim_duration":0.0019848779999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":57,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:25.443260+0000","last_change":"2023-11-08T19:30:25.443287+0000","last_active":"2023-11-08T19:30:25.443260+0000","last_peered":"2023-11-08T19:30:25.443260+0000","last_clean":"2023-11-08T19:30:25.443260+0000","last_became_active":"2023-11-08T19:25:47.284522+0000","last_became_peered":"2023-11-08T19:25:47.284522+0000","last_unstale":"2023-11-08T19:30:25.443260+0000","last_undegraded":"2023-11-08T19:30:25.443260+0000","last_fullsized":"2023-11-08T19:30:25.443260+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:25.443157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:25.443157+0000","last_clean_scrub_stamp":"2023-11-08T19:30:25.443157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:11:41.255817+0000","scrub_duration":0.002105778,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":87,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:30.241614+0000","last_change":"2023-11-08T19:30:30.241614+0000","last_active":"2023-11-08T19:30:30.241614+0000","last_peered":"2023-11-08T19:30:30.241614+0000","last_clean":"2023-11-08T19:30:30.241614+0000","last_became_active":"2023-11-08T19:24:31.144838+0000","last_became_peered":"2023-11-08T19:24:31.144838+0000","last_unstale":"2023-11-08T19:30:30.241614+0000","last_undegraded":"2023-11-08T19:30:30.241614+0000","last_fullsized":"2023-11-08T19:30:30.241614+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:30.241474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:30.241474+0000","last_clean_scrub_stamp":"2023-11-08T19:30:30.241474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:44:33.275938+0000","scrub_duration":0.0015211319999999999,"objects_trimmed":0,"snaptrim_duration":0.00081588799999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":69,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:30.668329+0000","last_change":"2023-11-08T19:30:30.668366+0000","last_active":"2023-11-08T19:30:30.668329+0000","last_peered":"2023-11-08T19:30:30.668329+0000","last_clean":"2023-11-08T19:30:30.668329+0000","last_became_active":"2023-11-08T19:25:46.285588+0000","last_became_peered":"2023-11-08T19:25:46.285588+0000","last_unstale":"2023-11-08T19:30:30.668329+0000","last_undegraded":"2023-11-08T19:30:30.668329+0000","last_fullsized":"2023-11-08T19:30:30.668329+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:30.668221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:30.668221+0000","last_clean_scrub_stamp":"2023-11-08T19:30:30.668221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:54:28.732108+0000","scrub_duration":0.0020941699999999998,"objects_trimmed":0,"snaptrim_duration":0.0023282350000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":57,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:31:01.445790+0000","last_change":"2023-11-08T19:31:01.445818+0000","last_active":"2023-11-08T19:31:01.445790+0000","last_peered":"2023-11-08T19:31:01.445790+0000","last_clean":"2023-11-08T19:31:01.445790+0000","last_became_active":"2023-11-08T19:25:47.283266+0000","last_became_peered":"2023-11-08T19:25:47.283266+0000","last_unstale":"2023-11-08T19:31:01.445790+0000","last_undegraded":"2023-11-08T19:31:01.445790+0000","last_fullsized":"2023-11-08T19:31:01.445790+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:31:01.445687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:31:01.445687+0000","last_clean_scrub_stamp":"2023-11-08T19:31:01.445687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:06:19.498171+0000","scrub_duration":0.0020608139999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":90,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:15.844049+0000","last_change":"2023-11-08T19:30:15.844049+0000","last_active":"2023-11-08T19:30:15.844049+0000","last_peered":"2023-11-08T19:30:15.844049+0000","last_clean":"2023-11-08T19:30:15.844049+0000","last_became_active":"2023-11-08T19:24:31.141710+0000","last_became_peered":"2023-11-08T19:24:31.141710+0000","last_unstale":"2023-11-08T19:30:15.844049+0000","last_undegraded":"2023-11-08T19:30:15.844049+0000","last_fullsized":"2023-11-08T19:30:15.844049+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:15.843841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:15.843841+0000","last_clean_scrub_stamp":"2023-11-08T19:30:15.843841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:15:48.494842+0000","scrub_duration":0.0022065240000000001,"objects_trimmed":0,"snaptrim_duration":0.000430438,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":69,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:47.740964+0000","last_change":"2023-11-08T19:30:47.741009+0000","last_active":"2023-11-08T19:30:47.740964+0000","last_peered":"2023-11-08T19:30:47.740964+0000","last_clean":"2023-11-08T19:30:47.740964+0000","last_became_active":"2023-11-08T19:25:46.273336+0000","last_became_peered":"2023-11-08T19:25:46.273336+0000","last_unstale":"2023-11-08T19:30:47.740964+0000","last_undegraded":"2023-11-08T19:30:47.740964+0000","last_fullsized":"2023-11-08T19:30:47.740964+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:47.740857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:47.740857+0000","last_clean_scrub_stamp":"2023-11-08T19:30:47.740857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:42:32.849324+0000","scrub_duration":0.0020745569999999999,"objects_trimmed":0,"snaptrim_duration":0.00092577200000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":62,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:31:19.674213+0000","last_change":"2023-11-08T19:31:19.674240+0000","last_active":"2023-11-08T19:31:19.674213+0000","last_peered":"2023-11-08T19:31:19.674213+0000","last_clean":"2023-11-08T19:31:19.674213+0000","last_became_active":"2023-11-08T19:25:47.282600+0000","last_became_peered":"2023-11-08T19:25:47.282600+0000","last_unstale":"2023-11-08T19:31:19.674213+0000","last_undegraded":"2023-11-08T19:31:19.674213+0000","last_fullsized":"2023-11-08T19:31:19.674213+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:31:19.674119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:31:19.674119+0000","last_clean_scrub_stamp":"2023-11-08T19:31:19.674119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:16:03.748288+0000","scrub_duration":0.0019021330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":62,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:41.482806+0000","last_change":"2023-11-08T19:30:41.482842+0000","last_active":"2023-11-08T19:30:41.482806+0000","last_peered":"2023-11-08T19:30:41.482806+0000","last_clean":"2023-11-08T19:30:41.482806+0000","last_became_active":"2023-11-08T19:25:47.285641+0000","last_became_peered":"2023-11-08T19:25:47.285641+0000","last_unstale":"2023-11-08T19:30:41.482806+0000","last_undegraded":"2023-11-08T19:30:41.482806+0000","last_fullsized":"2023-11-08T19:30:41.482806+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:41.482669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:41.482669+0000","last_clean_scrub_stamp":"2023-11-08T19:30:41.482669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:11:16.853701+0000","scrub_duration":0.0021664090000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":87,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:34.218157+0000","last_change":"2023-11-08T19:30:34.218157+0000","last_active":"2023-11-08T19:30:34.218157+0000","last_peered":"2023-11-08T19:30:34.218157+0000","last_clean":"2023-11-08T19:30:34.218157+0000","last_became_active":"2023-11-08T19:24:31.146715+0000","last_became_peered":"2023-11-08T19:24:31.146715+0000","last_unstale":"2023-11-08T19:30:34.218157+0000","last_undegraded":"2023-11-08T19:30:34.218157+0000","last_fullsized":"2023-11-08T19:30:34.218157+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:34.218032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:34.218032+0000","last_clean_scrub_stamp":"2023-11-08T19:30:34.218032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:44:54.228901+0000","scrub_duration":0.001686608,"objects_trimmed":0,"snaptrim_duration":0.00081671599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":69,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:19.767755+0000","last_change":"2023-11-08T19:30:19.767800+0000","last_active":"2023-11-08T19:30:19.767755+0000","last_peered":"2023-11-08T19:30:19.767755+0000","last_clean":"2023-11-08T19:30:19.767755+0000","last_became_active":"2023-11-08T19:25:46.285960+0000","last_became_peered":"2023-11-08T19:25:46.285960+0000","last_unstale":"2023-11-08T19:30:19.767755+0000","last_undegraded":"2023-11-08T19:30:19.767755+0000","last_fullsized":"2023-11-08T19:30:19.767755+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:19.767655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:19.767655+0000","last_clean_scrub_stamp":"2023-11-08T19:30:19.767655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:09:29.324502+0000","scrub_duration":0.0020017630000000002,"objects_trimmed":0,"snaptrim_duration":0.00091649099999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":62,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:50.533606+0000","last_change":"2023-11-08T19:30:50.533630+0000","last_active":"2023-11-08T19:30:50.533606+0000","last_peered":"2023-11-08T19:30:50.533606+0000","last_clean":"2023-11-08T19:30:50.533606+0000","last_became_active":"2023-11-08T19:25:47.283360+0000","last_became_peered":"2023-11-08T19:25:47.283360+0000","last_unstale":"2023-11-08T19:30:50.533606+0000","last_undegraded":"2023-11-08T19:30:50.533606+0000","last_fullsized":"2023-11-08T19:30:50.533606+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:50.533508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:50.533508+0000","last_clean_scrub_stamp":"2023-11-08T19:30:50.533508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:04:18.582751+0000","scrub_duration":0.001541892,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":96,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:35.806271+0000","last_change":"2023-11-08T19:30:35.806271+0000","last_active":"2023-11-08T19:30:35.806271+0000","last_peered":"2023-11-08T19:30:35.806271+0000","last_clean":"2023-11-08T19:30:35.806271+0000","last_became_active":"2023-11-08T19:24:31.147181+0000","last_became_peered":"2023-11-08T19:24:31.147181+0000","last_unstale":"2023-11-08T19:30:35.806271+0000","last_undegraded":"2023-11-08T19:30:35.806271+0000","last_fullsized":"2023-11-08T19:30:35.806271+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:35.806133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:35.806133+0000","last_clean_scrub_stamp":"2023-11-08T19:30:35.806133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:42:01.284608+0000","scrub_duration":0.0014898750000000001,"objects_trimmed":0,"snaptrim_duration":0.00057135200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":62,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:34.037408+0000","last_change":"2023-11-08T19:30:34.037436+0000","last_active":"2023-11-08T19:30:34.037408+0000","last_peered":"2023-11-08T19:30:34.037408+0000","last_clean":"2023-11-08T19:30:34.037408+0000","last_became_active":"2023-11-08T19:25:46.288848+0000","last_became_peered":"2023-11-08T19:25:46.288848+0000","last_unstale":"2023-11-08T19:30:34.037408+0000","last_undegraded":"2023-11-08T19:30:34.037408+0000","last_fullsized":"2023-11-08T19:30:34.037408+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:34.037323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:34.037323+0000","last_clean_scrub_stamp":"2023-11-08T19:30:34.037323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:25:01.213113+0000","scrub_duration":0.0018533829999999999,"objects_trimmed":0,"snaptrim_duration":0.00097653099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":55,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:51.893635+0000","last_change":"2023-11-08T19:30:51.893659+0000","last_active":"2023-11-08T19:30:51.893635+0000","last_peered":"2023-11-08T19:30:51.893635+0000","last_clean":"2023-11-08T19:30:51.893635+0000","last_became_active":"2023-11-08T19:25:47.289177+0000","last_became_peered":"2023-11-08T19:25:47.289177+0000","last_unstale":"2023-11-08T19:30:51.893635+0000","last_undegraded":"2023-11-08T19:30:51.893635+0000","last_fullsized":"2023-11-08T19:30:51.893635+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:51.893540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:51.893540+0000","last_clean_scrub_stamp":"2023-11-08T19:30:51.893540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:15:35.967709+0000","scrub_duration":0.0014277199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":96,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:32.837006+0000","last_change":"2023-11-08T19:30:32.837006+0000","last_active":"2023-11-08T19:30:32.837006+0000","last_peered":"2023-11-08T19:30:32.837006+0000","last_clean":"2023-11-08T19:30:32.837006+0000","last_became_active":"2023-11-08T19:24:31.148857+0000","last_became_peered":"2023-11-08T19:24:31.148857+0000","last_unstale":"2023-11-08T19:30:32.837006+0000","last_undegraded":"2023-11-08T19:30:32.837006+0000","last_fullsized":"2023-11-08T19:30:32.837006+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:32.836889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:32.836889+0000","last_clean_scrub_stamp":"2023-11-08T19:30:32.836889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:55:04.192751+0000","scrub_duration":0.0021433870000000001,"objects_trimmed":0,"snaptrim_duration":0.00065078599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":62,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:27.077494+0000","last_change":"2023-11-08T19:30:27.077515+0000","last_active":"2023-11-08T19:30:27.077494+0000","last_peered":"2023-11-08T19:30:27.077494+0000","last_clean":"2023-11-08T19:30:27.077494+0000","last_became_active":"2023-11-08T19:25:46.286211+0000","last_became_peered":"2023-11-08T19:25:46.286211+0000","last_unstale":"2023-11-08T19:30:27.077494+0000","last_undegraded":"2023-11-08T19:30:27.077494+0000","last_fullsized":"2023-11-08T19:30:27.077494+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:27.077406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:27.077406+0000","last_clean_scrub_stamp":"2023-11-08T19:30:27.077406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:53:12.324357+0000","scrub_duration":0.0013463559999999999,"objects_trimmed":0,"snaptrim_duration":0.00073775700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":55,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:39.102569+0000","last_change":"2023-11-08T19:30:39.102569+0000","last_active":"2023-11-08T19:30:39.102569+0000","last_peered":"2023-11-08T19:30:39.102569+0000","last_clean":"2023-11-08T19:30:39.102569+0000","last_became_active":"2023-11-08T19:25:47.285728+0000","last_became_peered":"2023-11-08T19:25:47.285728+0000","last_unstale":"2023-11-08T19:30:39.102569+0000","last_undegraded":"2023-11-08T19:30:39.102569+0000","last_fullsized":"2023-11-08T19:30:39.102569+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:39.102407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:39.102407+0000","last_clean_scrub_stamp":"2023-11-08T19:30:39.102407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:30:01.083142+0000","scrub_duration":0.002129307,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":96,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:31.834805+0000","last_change":"2023-11-08T19:30:31.834805+0000","last_active":"2023-11-08T19:30:31.834805+0000","last_peered":"2023-11-08T19:30:31.834805+0000","last_clean":"2023-11-08T19:30:31.834805+0000","last_became_active":"2023-11-08T19:24:31.146557+0000","last_became_peered":"2023-11-08T19:24:31.146557+0000","last_unstale":"2023-11-08T19:30:31.834805+0000","last_undegraded":"2023-11-08T19:30:31.834805+0000","last_fullsized":"2023-11-08T19:30:31.834805+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:31.834620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:31.834620+0000","last_clean_scrub_stamp":"2023-11-08T19:30:31.834620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:30:28.179127+0000","scrub_duration":0.0020209350000000002,"objects_trimmed":0,"snaptrim_duration":0.00099450100000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":64,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:17.302756+0000","last_change":"2023-11-08T19:30:17.302756+0000","last_active":"2023-11-08T19:30:17.302756+0000","last_peered":"2023-11-08T19:30:17.302756+0000","last_clean":"2023-11-08T19:30:17.302756+0000","last_became_active":"2023-11-08T19:25:46.281273+0000","last_became_peered":"2023-11-08T19:25:46.281273+0000","last_unstale":"2023-11-08T19:30:17.302756+0000","last_undegraded":"2023-11-08T19:30:17.302756+0000","last_fullsized":"2023-11-08T19:30:17.302756+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:17.302603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:17.302603+0000","last_clean_scrub_stamp":"2023-11-08T19:30:17.302603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:48:34.591057+0000","scrub_duration":0.002093204,"objects_trimmed":0,"snaptrim_duration":0.0020904819999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":56,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:38.085343+0000","last_change":"2023-11-08T19:30:38.085343+0000","last_active":"2023-11-08T19:30:38.085343+0000","last_peered":"2023-11-08T19:30:38.085343+0000","last_clean":"2023-11-08T19:30:38.085343+0000","last_became_active":"2023-11-08T19:25:47.287905+0000","last_became_peered":"2023-11-08T19:25:47.287905+0000","last_unstale":"2023-11-08T19:30:38.085343+0000","last_undegraded":"2023-11-08T19:30:38.085343+0000","last_fullsized":"2023-11-08T19:30:38.085343+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:38.085222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:38.085222+0000","last_clean_scrub_stamp":"2023-11-08T19:30:38.085222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:11:34.653580+0000","scrub_duration":0.0021335199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":87,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:32.258190+0000","last_change":"2023-11-08T19:30:32.258190+0000","last_active":"2023-11-08T19:30:32.258190+0000","last_peered":"2023-11-08T19:30:32.258190+0000","last_clean":"2023-11-08T19:30:32.258190+0000","last_became_active":"2023-11-08T19:24:31.144341+0000","last_became_peered":"2023-11-08T19:24:31.144341+0000","last_unstale":"2023-11-08T19:30:32.258190+0000","last_undegraded":"2023-11-08T19:30:32.258190+0000","last_fullsized":"2023-11-08T19:30:32.258190+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:32.258018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:32.258018+0000","last_clean_scrub_stamp":"2023-11-08T19:30:32.258018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:03:25.085742+0000","scrub_duration":0.0022325040000000002,"objects_trimmed":0,"snaptrim_duration":0.00058308299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":62,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:19.065507+0000","last_change":"2023-11-08T19:30:19.065507+0000","last_active":"2023-11-08T19:30:19.065507+0000","last_peered":"2023-11-08T19:30:19.065507+0000","last_clean":"2023-11-08T19:30:19.065507+0000","last_became_active":"2023-11-08T19:25:46.286933+0000","last_became_peered":"2023-11-08T19:25:46.286933+0000","last_unstale":"2023-11-08T19:30:19.065507+0000","last_undegraded":"2023-11-08T19:30:19.065507+0000","last_fullsized":"2023-11-08T19:30:19.065507+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:19.065292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:19.065292+0000","last_clean_scrub_stamp":"2023-11-08T19:30:19.065292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:02:38.548129+0000","scrub_duration":0.0020157859999999999,"objects_trimmed":0,"snaptrim_duration":0.00080507500000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":55,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:35.078757+0000","last_change":"2023-11-08T19:30:35.078757+0000","last_active":"2023-11-08T19:30:35.078757+0000","last_peered":"2023-11-08T19:30:35.078757+0000","last_clean":"2023-11-08T19:30:35.078757+0000","last_became_active":"2023-11-08T19:25:47.282705+0000","last_became_peered":"2023-11-08T19:25:47.282705+0000","last_unstale":"2023-11-08T19:30:35.078757+0000","last_undegraded":"2023-11-08T19:30:35.078757+0000","last_fullsized":"2023-11-08T19:30:35.078757+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:35.078670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:35.078670+0000","last_clean_scrub_stamp":"2023-11-08T19:30:35.078670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:23:20.306422+0000","scrub_duration":0.001194697,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":87,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:13.025246+0000","last_change":"2023-11-08T19:30:13.025246+0000","last_active":"2023-11-08T19:30:13.025246+0000","last_peered":"2023-11-08T19:30:13.025246+0000","last_clean":"2023-11-08T19:30:13.025246+0000","last_became_active":"2023-11-08T19:24:31.143812+0000","last_became_peered":"2023-11-08T19:24:31.143812+0000","last_unstale":"2023-11-08T19:30:13.025246+0000","last_undegraded":"2023-11-08T19:30:13.025246+0000","last_fullsized":"2023-11-08T19:30:13.025246+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:13.025137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:13.025137+0000","last_clean_scrub_stamp":"2023-11-08T19:30:13.025137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:10:48.396169+0000","scrub_duration":0.0011907409999999999,"objects_trimmed":0,"snaptrim_duration":0.014956126,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":69,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:37.506805+0000","last_change":"2023-11-08T19:30:37.506805+0000","last_active":"2023-11-08T19:30:37.506805+0000","last_peered":"2023-11-08T19:30:37.506805+0000","last_clean":"2023-11-08T19:30:37.506805+0000","last_became_active":"2023-11-08T19:25:46.284288+0000","last_became_peered":"2023-11-08T19:25:46.284288+0000","last_unstale":"2023-11-08T19:30:37.506805+0000","last_undegraded":"2023-11-08T19:30:37.506805+0000","last_fullsized":"2023-11-08T19:30:37.506805+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:37.506674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:37.506674+0000","last_clean_scrub_stamp":"2023-11-08T19:30:37.506674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:19:17.738199+0000","scrub_duration":0.0020640739999999999,"objects_trimmed":0,"snaptrim_duration":0.001250894,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":62,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:38.480895+0000","last_change":"2023-11-08T19:30:38.480895+0000","last_active":"2023-11-08T19:30:38.480895+0000","last_peered":"2023-11-08T19:30:38.480895+0000","last_clean":"2023-11-08T19:30:38.480895+0000","last_became_active":"2023-11-08T19:25:47.282299+0000","last_became_peered":"2023-11-08T19:25:47.282299+0000","last_unstale":"2023-11-08T19:30:38.480895+0000","last_undegraded":"2023-11-08T19:30:38.480895+0000","last_fullsized":"2023-11-08T19:30:38.480895+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:38.480725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:38.480725+0000","last_clean_scrub_stamp":"2023-11-08T19:30:38.480725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:56:12.945221+0000","scrub_duration":0.0020465769999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":86,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:19.177082+0000","last_change":"2023-11-08T19:30:19.177082+0000","last_active":"2023-11-08T19:30:19.177082+0000","last_peered":"2023-11-08T19:30:19.177082+0000","last_clean":"2023-11-08T19:30:19.177082+0000","last_became_active":"2023-11-08T19:24:31.147384+0000","last_became_peered":"2023-11-08T19:24:31.147384+0000","last_unstale":"2023-11-08T19:30:19.177082+0000","last_undegraded":"2023-11-08T19:30:19.177082+0000","last_fullsized":"2023-11-08T19:30:19.177082+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:19.176943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:19.176943+0000","last_clean_scrub_stamp":"2023-11-08T19:30:19.176943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:39:08.064436+0000","scrub_duration":0.00154301,"objects_trimmed":0,"snaptrim_duration":0.00043834899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":69,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:34.554450+0000","last_change":"2023-11-08T19:30:34.554450+0000","last_active":"2023-11-08T19:30:34.554450+0000","last_peered":"2023-11-08T19:30:34.554450+0000","last_clean":"2023-11-08T19:30:34.554450+0000","last_became_active":"2023-11-08T19:25:46.285626+0000","last_became_peered":"2023-11-08T19:25:46.285626+0000","last_unstale":"2023-11-08T19:30:34.554450+0000","last_undegraded":"2023-11-08T19:30:34.554450+0000","last_fullsized":"2023-11-08T19:30:34.554450+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:34.554326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:34.554326+0000","last_clean_scrub_stamp":"2023-11-08T19:30:34.554326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:59:52.362317+0000","scrub_duration":0.0021201129999999999,"objects_trimmed":0,"snaptrim_duration":0.0019032459999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":62,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:31:25.760641+0000","last_change":"2023-11-08T19:31:25.760678+0000","last_active":"2023-11-08T19:31:25.760641+0000","last_peered":"2023-11-08T19:31:25.760641+0000","last_clean":"2023-11-08T19:31:25.760641+0000","last_became_active":"2023-11-08T19:25:47.287617+0000","last_became_peered":"2023-11-08T19:25:47.287617+0000","last_unstale":"2023-11-08T19:31:25.760641+0000","last_undegraded":"2023-11-08T19:31:25.760641+0000","last_fullsized":"2023-11-08T19:31:25.760641+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:31:25.760531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:31:25.760531+0000","last_clean_scrub_stamp":"2023-11-08T19:31:25.760531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:38:16.366876+0000","scrub_duration":0.0024839369999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":96,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:28.670362+0000","last_change":"2023-11-08T19:30:28.670399+0000","last_active":"2023-11-08T19:30:28.670362+0000","last_peered":"2023-11-08T19:30:28.670362+0000","last_clean":"2023-11-08T19:30:28.670362+0000","last_became_active":"2023-11-08T19:24:31.144614+0000","last_became_peered":"2023-11-08T19:24:31.144614+0000","last_unstale":"2023-11-08T19:30:28.670362+0000","last_undegraded":"2023-11-08T19:30:28.670362+0000","last_fullsized":"2023-11-08T19:30:28.670362+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:28.670235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:28.670235+0000","last_clean_scrub_stamp":"2023-11-08T19:30:28.670235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:38:02.285835+0000","scrub_duration":0.0020853949999999999,"objects_trimmed":0,"snaptrim_duration":0.00050362200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":64,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:31:00.405500+0000","last_change":"2023-11-08T19:31:00.405525+0000","last_active":"2023-11-08T19:31:00.405500+0000","last_peered":"2023-11-08T19:31:00.405500+0000","last_clean":"2023-11-08T19:31:00.405500+0000","last_became_active":"2023-11-08T19:25:46.283803+0000","last_became_peered":"2023-11-08T19:25:46.283803+0000","last_unstale":"2023-11-08T19:31:00.405500+0000","last_undegraded":"2023-11-08T19:31:00.405500+0000","last_fullsized":"2023-11-08T19:31:00.405500+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:31:00.405401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:31:00.405401+0000","last_clean_scrub_stamp":"2023-11-08T19:31:00.405401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:22:21.573281+0000","scrub_duration":0.0014623450000000001,"objects_trimmed":0,"snaptrim_duration":0.002404855,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":55,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:47.906923+0000","last_change":"2023-11-08T19:30:47.906923+0000","last_active":"2023-11-08T19:30:47.906923+0000","last_peered":"2023-11-08T19:30:47.906923+0000","last_clean":"2023-11-08T19:30:47.906923+0000","last_became_active":"2023-11-08T19:25:47.287428+0000","last_became_peered":"2023-11-08T19:25:47.287428+0000","last_unstale":"2023-11-08T19:30:47.906923+0000","last_undegraded":"2023-11-08T19:30:47.906923+0000","last_fullsized":"2023-11-08T19:30:47.906923+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:47.906785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:47.906785+0000","last_clean_scrub_stamp":"2023-11-08T19:30:47.906785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:47:22.383967+0000","scrub_duration":0.0021926699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":85,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:21.174293+0000","last_change":"2023-11-08T19:30:21.174318+0000","last_active":"2023-11-08T19:30:21.174293+0000","last_peered":"2023-11-08T19:30:21.174293+0000","last_clean":"2023-11-08T19:30:21.174293+0000","last_became_active":"2023-11-08T19:24:31.146176+0000","last_became_peered":"2023-11-08T19:24:31.146176+0000","last_unstale":"2023-11-08T19:30:21.174293+0000","last_undegraded":"2023-11-08T19:30:21.174293+0000","last_fullsized":"2023-11-08T19:30:21.174293+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:21.174179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:21.174179+0000","last_clean_scrub_stamp":"2023-11-08T19:30:21.174179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:36:32.308961+0000","scrub_duration":0.001410056,"objects_trimmed":0,"snaptrim_duration":0.00048481000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":64,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:57.411661+0000","last_change":"2023-11-08T19:30:57.411702+0000","last_active":"2023-11-08T19:30:57.411661+0000","last_peered":"2023-11-08T19:30:57.411661+0000","last_clean":"2023-11-08T19:30:57.411661+0000","last_became_active":"2023-11-08T19:25:46.282460+0000","last_became_peered":"2023-11-08T19:25:46.282460+0000","last_unstale":"2023-11-08T19:30:57.411661+0000","last_undegraded":"2023-11-08T19:30:57.411661+0000","last_fullsized":"2023-11-08T19:30:57.411661+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:57.411534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:57.411534+0000","last_clean_scrub_stamp":"2023-11-08T19:30:57.411534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:07:05.389261+0000","scrub_duration":0.001549531,"objects_trimmed":0,"snaptrim_duration":0.001972863,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":62,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:43.580139+0000","last_change":"2023-11-08T19:30:43.580175+0000","last_active":"2023-11-08T19:30:43.580139+0000","last_peered":"2023-11-08T19:30:43.580139+0000","last_clean":"2023-11-08T19:30:43.580139+0000","last_became_active":"2023-11-08T19:25:47.283433+0000","last_became_peered":"2023-11-08T19:25:47.283433+0000","last_unstale":"2023-11-08T19:30:43.580139+0000","last_undegraded":"2023-11-08T19:30:43.580139+0000","last_fullsized":"2023-11-08T19:30:43.580139+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:43.580022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:43.580022+0000","last_clean_scrub_stamp":"2023-11-08T19:30:43.580022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:36:54.714804+0000","scrub_duration":0.001575403,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":87,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:18.021136+0000","last_change":"2023-11-08T19:30:18.021136+0000","last_active":"2023-11-08T19:30:18.021136+0000","last_peered":"2023-11-08T19:30:18.021136+0000","last_clean":"2023-11-08T19:30:18.021136+0000","last_became_active":"2023-11-08T19:24:31.142052+0000","last_became_peered":"2023-11-08T19:24:31.142052+0000","last_unstale":"2023-11-08T19:30:18.021136+0000","last_undegraded":"2023-11-08T19:30:18.021136+0000","last_fullsized":"2023-11-08T19:30:18.021136+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:18.020983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:18.020983+0000","last_clean_scrub_stamp":"2023-11-08T19:30:18.020983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:45.925711+0000","scrub_duration":0.001444657,"objects_trimmed":0,"snaptrim_duration":0.014881058000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":69,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:20.763205+0000","last_change":"2023-11-08T19:30:20.763230+0000","last_active":"2023-11-08T19:30:20.763205+0000","last_peered":"2023-11-08T19:30:20.763205+0000","last_clean":"2023-11-08T19:30:20.763205+0000","last_became_active":"2023-11-08T19:25:46.279287+0000","last_became_peered":"2023-11-08T19:25:46.279287+0000","last_unstale":"2023-11-08T19:30:20.763205+0000","last_undegraded":"2023-11-08T19:30:20.763205+0000","last_fullsized":"2023-11-08T19:30:20.763205+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:20.763104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:20.763104+0000","last_clean_scrub_stamp":"2023-11-08T19:30:20.763104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:14:02.974290+0000","scrub_duration":0.0021986850000000001,"objects_trimmed":0,"snaptrim_duration":0.00076856899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":62,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:31:11.623454+0000","last_change":"2023-11-08T19:31:11.623480+0000","last_active":"2023-11-08T19:31:11.623454+0000","last_peered":"2023-11-08T19:31:11.623454+0000","last_clean":"2023-11-08T19:31:11.623454+0000","last_became_active":"2023-11-08T19:25:47.285533+0000","last_became_peered":"2023-11-08T19:25:47.285533+0000","last_unstale":"2023-11-08T19:31:11.623454+0000","last_undegraded":"2023-11-08T19:31:11.623454+0000","last_fullsized":"2023-11-08T19:31:11.623454+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:31:11.623359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:31:11.623359+0000","last_clean_scrub_stamp":"2023-11-08T19:31:11.623359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:47:46.100541+0000","scrub_duration":0.002098684,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":85,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:28.080532+0000","last_change":"2023-11-08T19:30:28.080567+0000","last_active":"2023-11-08T19:30:28.080532+0000","last_peered":"2023-11-08T19:30:28.080532+0000","last_clean":"2023-11-08T19:30:28.080532+0000","last_became_active":"2023-11-08T19:24:31.148250+0000","last_became_peered":"2023-11-08T19:24:31.148250+0000","last_unstale":"2023-11-08T19:30:28.080532+0000","last_undegraded":"2023-11-08T19:30:28.080532+0000","last_fullsized":"2023-11-08T19:30:28.080532+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:28.080403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:28.080403+0000","last_clean_scrub_stamp":"2023-11-08T19:30:28.080403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:57:55.985131+0000","scrub_duration":0.0019137889999999999,"objects_trimmed":0,"snaptrim_duration":0.00043061299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":69,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:35.532680+0000","last_change":"2023-11-08T19:30:35.532724+0000","last_active":"2023-11-08T19:30:35.532680+0000","last_peered":"2023-11-08T19:30:35.532680+0000","last_clean":"2023-11-08T19:30:35.532680+0000","last_became_active":"2023-11-08T19:25:46.285478+0000","last_became_peered":"2023-11-08T19:25:46.285478+0000","last_unstale":"2023-11-08T19:30:35.532680+0000","last_undegraded":"2023-11-08T19:30:35.532680+0000","last_fullsized":"2023-11-08T19:30:35.532680+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:35.532556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:35.532556+0000","last_clean_scrub_stamp":"2023-11-08T19:30:35.532556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:30:31.877062+0000","scrub_duration":0.0023281920000000002,"objects_trimmed":0,"snaptrim_duration":0.000376339,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":55,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:37.148513+0000","last_change":"2023-11-08T19:30:37.148535+0000","last_active":"2023-11-08T19:30:37.148513+0000","last_peered":"2023-11-08T19:30:37.148513+0000","last_clean":"2023-11-08T19:30:37.148513+0000","last_became_active":"2023-11-08T19:25:47.283990+0000","last_became_peered":"2023-11-08T19:25:47.283990+0000","last_unstale":"2023-11-08T19:30:37.148513+0000","last_undegraded":"2023-11-08T19:30:37.148513+0000","last_fullsized":"2023-11-08T19:30:37.148513+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:37.148426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:37.148426+0000","last_clean_scrub_stamp":"2023-11-08T19:30:37.148426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T02:36:37.292961+0000","scrub_duration":0.001288958,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":96,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:17.692059+0000","last_change":"2023-11-08T19:30:17.692093+0000","last_active":"2023-11-08T19:30:17.692059+0000","last_peered":"2023-11-08T19:30:17.692059+0000","last_clean":"2023-11-08T19:30:17.692059+0000","last_became_active":"2023-11-08T19:24:31.147651+0000","last_became_peered":"2023-11-08T19:24:31.147651+0000","last_unstale":"2023-11-08T19:30:17.692059+0000","last_undegraded":"2023-11-08T19:30:17.692059+0000","last_fullsized":"2023-11-08T19:30:17.692059+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:17.691961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:17.691961+0000","last_clean_scrub_stamp":"2023-11-08T19:30:17.691961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:09:27.248808+0000","scrub_duration":0.001464531,"objects_trimmed":0,"snaptrim_duration":0.00043673300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":64,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:24.455713+0000","last_change":"2023-11-08T19:30:24.455713+0000","last_active":"2023-11-08T19:30:24.455713+0000","last_peered":"2023-11-08T19:30:24.455713+0000","last_clean":"2023-11-08T19:30:24.455713+0000","last_became_active":"2023-11-08T19:25:46.282307+0000","last_became_peered":"2023-11-08T19:25:46.282307+0000","last_unstale":"2023-11-08T19:30:24.455713+0000","last_undegraded":"2023-11-08T19:30:24.455713+0000","last_fullsized":"2023-11-08T19:30:24.455713+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:24.455579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:24.455579+0000","last_clean_scrub_stamp":"2023-11-08T19:30:24.455579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:54:59.466934+0000","scrub_duration":0.0015672119999999999,"objects_trimmed":0,"snaptrim_duration":0.00047078400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":55,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:36.116332+0000","last_change":"2023-11-08T19:30:36.116369+0000","last_active":"2023-11-08T19:30:36.116332+0000","last_peered":"2023-11-08T19:30:36.116332+0000","last_clean":"2023-11-08T19:30:36.116332+0000","last_became_active":"2023-11-08T19:25:47.283927+0000","last_became_peered":"2023-11-08T19:25:47.283927+0000","last_unstale":"2023-11-08T19:30:36.116332+0000","last_undegraded":"2023-11-08T19:30:36.116332+0000","last_fullsized":"2023-11-08T19:30:36.116332+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:36.116210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:36.116210+0000","last_clean_scrub_stamp":"2023-11-08T19:30:36.116210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:53:44.424059+0000","scrub_duration":0.0024934250000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":86,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:33.211437+0000","last_change":"2023-11-08T19:30:33.211479+0000","last_active":"2023-11-08T19:30:33.211437+0000","last_peered":"2023-11-08T19:30:33.211437+0000","last_clean":"2023-11-08T19:30:33.211437+0000","last_became_active":"2023-11-08T19:24:31.144329+0000","last_became_peered":"2023-11-08T19:24:31.144329+0000","last_unstale":"2023-11-08T19:30:33.211437+0000","last_undegraded":"2023-11-08T19:30:33.211437+0000","last_fullsized":"2023-11-08T19:30:33.211437+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:33.211330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:33.211330+0000","last_clean_scrub_stamp":"2023-11-08T19:30:33.211330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:58:45.837341+0000","scrub_duration":0.001523457,"objects_trimmed":0,"snaptrim_duration":0.00043484799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":64,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:45.247269+0000","last_change":"2023-11-08T19:30:45.247292+0000","last_active":"2023-11-08T19:30:45.247269+0000","last_peered":"2023-11-08T19:30:45.247269+0000","last_clean":"2023-11-08T19:30:45.247269+0000","last_became_active":"2023-11-08T19:25:46.281425+0000","last_became_peered":"2023-11-08T19:25:46.281425+0000","last_unstale":"2023-11-08T19:30:45.247269+0000","last_undegraded":"2023-11-08T19:30:45.247269+0000","last_fullsized":"2023-11-08T19:30:45.247269+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:45.247176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:45.247176+0000","last_clean_scrub_stamp":"2023-11-08T19:30:45.247176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:58:55.220138+0000","scrub_duration":0.0018807120000000001,"objects_trimmed":0,"snaptrim_duration":0.00124314,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":57,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:31:04.452350+0000","last_change":"2023-11-08T19:31:04.452373+0000","last_active":"2023-11-08T19:31:04.452350+0000","last_peered":"2023-11-08T19:31:04.452350+0000","last_clean":"2023-11-08T19:31:04.452350+0000","last_became_active":"2023-11-08T19:25:47.281425+0000","last_became_peered":"2023-11-08T19:25:47.281425+0000","last_unstale":"2023-11-08T19:31:04.452350+0000","last_undegraded":"2023-11-08T19:31:04.452350+0000","last_fullsized":"2023-11-08T19:31:04.452350+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:31:04.452252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:31:04.452252+0000","last_clean_scrub_stamp":"2023-11-08T19:31:04.452252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:17:25.012548+0000","scrub_duration":0.0020989400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":86,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:24.251328+0000","last_change":"2023-11-08T19:30:24.251351+0000","last_active":"2023-11-08T19:30:24.251328+0000","last_peered":"2023-11-08T19:30:24.251328+0000","last_clean":"2023-11-08T19:30:24.251328+0000","last_became_active":"2023-11-08T19:24:31.146260+0000","last_became_peered":"2023-11-08T19:24:31.146260+0000","last_unstale":"2023-11-08T19:30:24.251328+0000","last_undegraded":"2023-11-08T19:30:24.251328+0000","last_fullsized":"2023-11-08T19:30:24.251328+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:24.251241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:24.251241+0000","last_clean_scrub_stamp":"2023-11-08T19:30:24.251241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:48:47.364880+0000","scrub_duration":0.0021896609999999999,"objects_trimmed":0,"snaptrim_duration":0.00059842900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":62,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:21.078147+0000","last_change":"2023-11-08T19:30:21.078147+0000","last_active":"2023-11-08T19:30:21.078147+0000","last_peered":"2023-11-08T19:30:21.078147+0000","last_clean":"2023-11-08T19:30:21.078147+0000","last_became_active":"2023-11-08T19:25:46.286239+0000","last_became_peered":"2023-11-08T19:25:46.286239+0000","last_unstale":"2023-11-08T19:30:21.078147+0000","last_undegraded":"2023-11-08T19:30:21.078147+0000","last_fullsized":"2023-11-08T19:30:21.078147+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:21.078003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:21.078003+0000","last_clean_scrub_stamp":"2023-11-08T19:30:21.078003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:54:56.089359+0000","scrub_duration":0.001463238,"objects_trimmed":0,"snaptrim_duration":0.000722421,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":55,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:50.899235+0000","last_change":"2023-11-08T19:30:50.899275+0000","last_active":"2023-11-08T19:30:50.899235+0000","last_peered":"2023-11-08T19:30:50.899235+0000","last_clean":"2023-11-08T19:30:50.899235+0000","last_became_active":"2023-11-08T19:25:47.287456+0000","last_became_peered":"2023-11-08T19:25:47.287456+0000","last_unstale":"2023-11-08T19:30:50.899235+0000","last_undegraded":"2023-11-08T19:30:50.899235+0000","last_fullsized":"2023-11-08T19:30:50.899235+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:50.899097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:50.899097+0000","last_clean_scrub_stamp":"2023-11-08T19:30:50.899097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:34:59.602214+0000","scrub_duration":0.0018975470000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":95,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:26.782952+0000","last_change":"2023-11-08T19:30:26.782978+0000","last_active":"2023-11-08T19:30:26.782952+0000","last_peered":"2023-11-08T19:30:26.782952+0000","last_clean":"2023-11-08T19:30:26.782952+0000","last_became_active":"2023-11-08T19:24:31.146154+0000","last_became_peered":"2023-11-08T19:24:31.146154+0000","last_unstale":"2023-11-08T19:30:26.782952+0000","last_undegraded":"2023-11-08T19:30:26.782952+0000","last_fullsized":"2023-11-08T19:30:26.782952+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:26.782839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:26.782839+0000","last_clean_scrub_stamp":"2023-11-08T19:30:26.782839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:28:53.767924+0000","scrub_duration":0.0015358430000000001,"objects_trimmed":0,"snaptrim_duration":0.00082432800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":63,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:35.060282+0000","last_change":"2023-11-08T19:30:35.060301+0000","last_active":"2023-11-08T19:30:35.060282+0000","last_peered":"2023-11-08T19:30:35.060282+0000","last_clean":"2023-11-08T19:30:35.060282+0000","last_became_active":"2023-11-08T19:25:46.290114+0000","last_became_peered":"2023-11-08T19:25:46.290114+0000","last_unstale":"2023-11-08T19:30:35.060282+0000","last_undegraded":"2023-11-08T19:30:35.060282+0000","last_fullsized":"2023-11-08T19:30:35.060282+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:35.060205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:35.060205+0000","last_clean_scrub_stamp":"2023-11-08T19:30:35.060205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:34:38.053321+0000","scrub_duration":0.0012027590000000001,"objects_trimmed":0,"snaptrim_duration":0.00061009499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":57,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:31:03.479158+0000","last_change":"2023-11-08T19:31:03.479186+0000","last_active":"2023-11-08T19:31:03.479158+0000","last_peered":"2023-11-08T19:31:03.479158+0000","last_clean":"2023-11-08T19:31:03.479158+0000","last_became_active":"2023-11-08T19:25:47.282763+0000","last_became_peered":"2023-11-08T19:25:47.282763+0000","last_unstale":"2023-11-08T19:31:03.479158+0000","last_undegraded":"2023-11-08T19:31:03.479158+0000","last_fullsized":"2023-11-08T19:31:03.479158+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:31:03.479037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:31:03.479037+0000","last_clean_scrub_stamp":"2023-11-08T19:31:03.479037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T01:21:19.561654+0000","scrub_duration":0.0020613720000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":87,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:16.159719+0000","last_change":"2023-11-08T19:30:16.159719+0000","last_active":"2023-11-08T19:30:16.159719+0000","last_peered":"2023-11-08T19:30:16.159719+0000","last_clean":"2023-11-08T19:30:16.159719+0000","last_became_active":"2023-11-08T19:24:31.139062+0000","last_became_peered":"2023-11-08T19:24:31.139062+0000","last_unstale":"2023-11-08T19:30:16.159719+0000","last_undegraded":"2023-11-08T19:30:16.159719+0000","last_fullsized":"2023-11-08T19:30:16.159719+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:16.159602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:16.159602+0000","last_clean_scrub_stamp":"2023-11-08T19:30:16.159602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:23:15.468689+0000","scrub_duration":0.00144932,"objects_trimmed":0,"snaptrim_duration":0.00033682599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":69,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:57.745235+0000","last_change":"2023-11-08T19:30:57.745280+0000","last_active":"2023-11-08T19:30:57.745235+0000","last_peered":"2023-11-08T19:30:57.745235+0000","last_clean":"2023-11-08T19:30:57.745235+0000","last_became_active":"2023-11-08T19:25:46.284287+0000","last_became_peered":"2023-11-08T19:25:46.284287+0000","last_unstale":"2023-11-08T19:30:57.745235+0000","last_undegraded":"2023-11-08T19:30:57.745235+0000","last_fullsized":"2023-11-08T19:30:57.745235+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:57.745099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:57.745099+0000","last_clean_scrub_stamp":"2023-11-08T19:30:57.745099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T06:25:10.395697+0000","scrub_duration":0.001971619,"objects_trimmed":0,"snaptrim_duration":0.00097880800000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":62,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:52.610321+0000","last_change":"2023-11-08T19:30:52.610350+0000","last_active":"2023-11-08T19:30:52.610321+0000","last_peered":"2023-11-08T19:30:52.610321+0000","last_clean":"2023-11-08T19:30:52.610321+0000","last_became_active":"2023-11-08T19:25:47.286181+0000","last_became_peered":"2023-11-08T19:25:47.286181+0000","last_unstale":"2023-11-08T19:30:52.610321+0000","last_undegraded":"2023-11-08T19:30:52.610321+0000","last_fullsized":"2023-11-08T19:30:52.610321+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:52.610210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:52.610210+0000","last_clean_scrub_stamp":"2023-11-08T19:30:52.610210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:11:54.275032+0000","scrub_duration":0.0021868320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":96,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:39.738027+0000","last_change":"2023-11-08T19:30:39.738027+0000","last_active":"2023-11-08T19:30:39.738027+0000","last_peered":"2023-11-08T19:30:39.738027+0000","last_clean":"2023-11-08T19:30:39.738027+0000","last_became_active":"2023-11-08T19:24:31.146668+0000","last_became_peered":"2023-11-08T19:24:31.146668+0000","last_unstale":"2023-11-08T19:30:39.738027+0000","last_undegraded":"2023-11-08T19:30:39.738027+0000","last_fullsized":"2023-11-08T19:30:39.738027+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:39.737903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:39.737903+0000","last_clean_scrub_stamp":"2023-11-08T19:30:39.737903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:39:28.625396+0000","scrub_duration":0.0015030569999999999,"objects_trimmed":0,"snaptrim_duration":0.00071576699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":64,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:20.518808+0000","last_change":"2023-11-08T19:30:20.518808+0000","last_active":"2023-11-08T19:30:20.518808+0000","last_peered":"2023-11-08T19:30:20.518808+0000","last_clean":"2023-11-08T19:30:20.518808+0000","last_became_active":"2023-11-08T19:25:46.290246+0000","last_became_peered":"2023-11-08T19:25:46.290246+0000","last_unstale":"2023-11-08T19:30:20.518808+0000","last_undegraded":"2023-11-08T19:30:20.518808+0000","last_fullsized":"2023-11-08T19:30:20.518808+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:20.518679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:20.518679+0000","last_clean_scrub_stamp":"2023-11-08T19:30:20.518679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:17:45.315742+0000","scrub_duration":0.0021647609999999999,"objects_trimmed":0,"snaptrim_duration":0.000423211,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":56,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:37.043659+0000","last_change":"2023-11-08T19:30:37.043659+0000","last_active":"2023-11-08T19:30:37.043659+0000","last_peered":"2023-11-08T19:30:37.043659+0000","last_clean":"2023-11-08T19:30:37.043659+0000","last_became_active":"2023-11-08T19:25:47.287412+0000","last_became_peered":"2023-11-08T19:25:47.287412+0000","last_unstale":"2023-11-08T19:30:37.043659+0000","last_undegraded":"2023-11-08T19:30:37.043659+0000","last_fullsized":"2023-11-08T19:30:37.043659+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:37.043522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:37.043522+0000","last_clean_scrub_stamp":"2023-11-08T19:30:37.043522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T05:23:20.268184+0000","scrub_duration":0.001539185,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":87,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:17.588716+0000","last_change":"2023-11-08T19:30:17.588739+0000","last_active":"2023-11-08T19:30:17.588716+0000","last_peered":"2023-11-08T19:30:17.588716+0000","last_clean":"2023-11-08T19:30:17.588716+0000","last_became_active":"2023-11-08T19:24:31.144912+0000","last_became_peered":"2023-11-08T19:24:31.144912+0000","last_unstale":"2023-11-08T19:30:17.588716+0000","last_undegraded":"2023-11-08T19:30:17.588716+0000","last_fullsized":"2023-11-08T19:30:17.588716+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:17.588625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:17.588625+0000","last_clean_scrub_stamp":"2023-11-08T19:30:17.588625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T03:23:16.897713+0000","scrub_duration":0.0017421800000000001,"objects_trimmed":0,"snaptrim_duration":0.00056686900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":69,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:49.695152+0000","last_change":"2023-11-08T19:30:49.695175+0000","last_active":"2023-11-08T19:30:49.695152+0000","last_peered":"2023-11-08T19:30:49.695152+0000","last_clean":"2023-11-08T19:30:49.695152+0000","last_became_active":"2023-11-08T19:25:46.285848+0000","last_became_peered":"2023-11-08T19:25:46.285848+0000","last_unstale":"2023-11-08T19:30:49.695152+0000","last_undegraded":"2023-11-08T19:30:49.695152+0000","last_fullsized":"2023-11-08T19:30:49.695152+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:49.695018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:49.695018+0000","last_clean_scrub_stamp":"2023-11-08T19:30:49.695018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:26:17.014670+0000","scrub_duration":0.0022179819999999999,"objects_trimmed":0,"snaptrim_duration":0.00089732199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":57,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:33.491295+0000","last_change":"2023-11-08T19:30:33.491295+0000","last_active":"2023-11-08T19:30:33.491295+0000","last_peered":"2023-11-08T19:30:33.491295+0000","last_clean":"2023-11-08T19:30:33.491295+0000","last_became_active":"2023-11-08T19:25:47.279913+0000","last_became_peered":"2023-11-08T19:25:47.279913+0000","last_unstale":"2023-11-08T19:30:33.491295+0000","last_undegraded":"2023-11-08T19:30:33.491295+0000","last_fullsized":"2023-11-08T19:30:33.491295+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:33.491165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:33.491165+0000","last_clean_scrub_stamp":"2023-11-08T19:30:33.491165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T04:25:00.666954+0000","scrub_duration":0.0021655239999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":86,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:30:17.139218+0000","last_change":"2023-11-08T19:30:17.139240+0000","last_active":"2023-11-08T19:30:17.139218+0000","last_peered":"2023-11-08T19:30:17.139218+0000","last_clean":"2023-11-08T19:30:17.139218+0000","last_became_active":"2023-11-08T19:24:31.149011+0000","last_became_peered":"2023-11-08T19:24:31.149011+0000","last_unstale":"2023-11-08T19:30:17.139218+0000","last_undegraded":"2023-11-08T19:30:17.139218+0000","last_fullsized":"2023-11-08T19:30:17.139218+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:30:17.139115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:30:17.139115+0000","last_clean_scrub_stamp":"2023-11-08T19:30:17.139115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:46:23.961331+0000","scrub_duration":0.0019318580000000001,"objects_trimmed":0,"snaptrim_duration":0.00033496900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":69,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-11-08T19:31:06.670328+0000","last_change":"2023-11-08T19:31:06.670351+0000","last_active":"2023-11-08T19:31:06.670328+0000","last_peered":"2023-11-08T19:31:06.670328+0000","last_clean":"2023-11-08T19:31:06.670328+0000","last_became_active":"2023-11-08T19:25:46.272479+0000","last_became_peered":"2023-11-08T19:25:46.272479+0000","last_unstale":"2023-11-08T19:31:06.670328+0000","last_undegraded":"2023-11-08T19:31:06.670328+0000","last_fullsized":"2023-11-08T19:31:06.670328+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T19:31:06.670216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T19:31:06.670216+0000","last_clean_scrub_stamp":"2023-11-08T19:31:06.670216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T07:16:20.433119+0000","scrub_duration":0.001528555,"objects_trimmed":0,"snaptrim_duration":0.001158117,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574956,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28940,"kb_used_data":1924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342900,"statfs":{"total":96636764160,"available":96607129600,"internally_reserved":0,"allocated":1970176,"data_stored":1293718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:31:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.59099999999999997,"15min":0.55800000000000005},"min":{"1min":0.45700000000000002,"5min":0.33800000000000002,"15min":0.32800000000000001},"max":{"1min":0.81499999999999995,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.61099999999999999,"15min":0.57999999999999996},"min":{"1min":0.50800000000000001,"5min":0.38500000000000001,"15min":0.377},"max":{"1min":0.79800000000000004,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.68700000000000006}]},{"osd":1,"last update":"Wed Nov 8 19:31:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.56499999999999995,"15min":0.55300000000000005},"min":{"1min":0.39300000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.84399999999999997,"5min":1.006,"15min":1.006},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56599999999999995,"15min":0.54400000000000004},"min":{"1min":0.40899999999999997,"5min":0.39100000000000001,"15min":0.37},"max":{"1min":0.72099999999999997,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.65700000000000003}]},{"osd":2,"last update":"Wed Nov 8 19:31:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.56200000000000006,"15min":0.52700000000000002},"min":{"1min":0.373,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.751,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.57799999999999996,"15min":0.55100000000000005},"min":{"1min":0.51400000000000001,"5min":0.38500000000000001,"15min":0.32400000000000001},"max":{"1min":0.76600000000000001,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.75900000000000001}]},{"osd":3,"last update":"Wed Nov 8 19:31:18 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.57099999999999995,"15min":0.54700000000000004},"min":{"1min":0.50900000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.78500000000000003,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.59499999999999997,"15min":0.57299999999999995},"min":{"1min":0.42399999999999999,"5min":0.38400000000000001,"15min":0.36899999999999999},"max":{"1min":0.86899999999999999,"5min":0.875,"15min":0.875},"last":0.70099999999999996}]},{"osd":4,"last update":"Wed Nov 8 19:31:18 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47899999999999998,"15min":0.48499999999999999},"min":{"1min":0.33900000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.79500000000000004},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51000000000000001,"15min":0.51600000000000001},"min":{"1min":0.35599999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.79000000000000004,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.45000000000000001}]},{"osd":5,"last update":"Wed Nov 8 19:31:18 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.53000000000000003,"15min":0.54400000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.80800000000000005,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.502},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55300000000000005,"15min":0.56999999999999995},"min":{"1min":0.41699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.755,"5min":0.77700000000000002,"15min":0.91100000000000003},"last":0.47999999999999998}]},{"osd":6,"last update":"Wed Nov 8 19:31:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.59099999999999997,"15min":0.60499999999999998},"min":{"1min":0.438,"5min":0.40000000000000002,"15min":0.39300000000000002},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.86399999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57699999999999996,"15min":0.56999999999999995},"min":{"1min":0.434,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.82199999999999995,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.53700000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574956,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28360,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343480,"statfs":{"total":96636764160,"available":96607723520,"internally_reserved":0,"allocated":1376256,"data_stored":703350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:31:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56399999999999995,"15min":0.58199999999999996},"min":{"1min":0.434,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.747,"5min":0.82199999999999995,"15min":1.7549999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.55900000000000005,"15min":0.57699999999999996},"min":{"1min":0.436,"5min":0.33800000000000002,"15min":0.28699999999999998},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":1.478},"last":0.627}]},{"osd":1,"last update":"Wed Nov 8 19:31:11 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.58999999999999997,"15min":0.59899999999999998},"min":{"1min":0.443,"5min":0.317,"15min":0.28899999999999998},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":1.6619999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.63300000000000001,"15min":0.65300000000000002},"min":{"1min":0.38300000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.83699999999999997,"5min":0.86099999999999999,"15min":1.649},"last":0.64700000000000002}]},{"osd":2,"last update":"Wed Nov 8 19:31:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.60199999999999998,"15min":0.57299999999999995},"min":{"1min":0.46400000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.79600000000000004,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.60999999999999999,"15min":0.623},"min":{"1min":0.48799999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.80800000000000005,"5min":0.82599999999999996,"15min":0.85399999999999998},"last":0.73999999999999999}]},{"osd":3,"last update":"Wed Nov 8 19:31:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.57699999999999996,"15min":0.60799999999999998},"min":{"1min":0.46500000000000002,"5min":0.36699999999999999,"15min":0.33500000000000002},"max":{"1min":0.77900000000000003,"5min":0.80300000000000005,"15min":1.766},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.57999999999999996,"15min":0.60199999999999998},"min":{"1min":0.48199999999999998,"5min":0.375,"15min":0.36699999999999999},"max":{"1min":0.76400000000000001,"5min":0.84399999999999997,"15min":1.8580000000000001},"last":0.59199999999999997}]},{"osd":4,"last update":"Wed Nov 8 19:31:11 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51000000000000001,"15min":0.53000000000000003},"min":{"1min":0.34499999999999997,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.69299999999999995,"5min":0.755,"15min":0.83499999999999996},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.53800000000000003,"15min":0.56499999999999995},"min":{"1min":0.38600000000000001,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.68600000000000005,"5min":0.83499999999999996,"15min":0.89100000000000001},"last":0.47099999999999997}]},{"osd":5,"last update":"Wed Nov 8 19:31:11 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.52500000000000002,"15min":0.55200000000000005},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.69399999999999995,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.497},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56399999999999995,"15min":0.60999999999999999},"min":{"1min":0.40999999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.78300000000000003,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.51700000000000002}]},{"osd":7,"last update":"Wed Nov 8 19:31:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57999999999999996,"15min":0.60099999999999998},"min":{"1min":0.40300000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.75700000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58399999999999996,"15min":0.624},"min":{"1min":0.40000000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.78200000000000003,"5min":0.83999999999999997,"15min":0.95099999999999996},"last":0.54000000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574955,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28360,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343480,"statfs":{"total":96636764160,"available":96607723520,"internally_reserved":0,"allocated":1376256,"data_stored":703350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35199999999999998,"15min":0.35799999999999998},"min":{"1min":0.27500000000000002,"5min":0.214,"15min":0.20200000000000001},"max":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":1.2090000000000001},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.378,"15min":0.39700000000000002},"min":{"1min":0.251,"5min":0.23300000000000001,"15min":0.19700000000000001},"max":{"1min":0.58699999999999997,"5min":0.61599999999999999,"15min":2.1850000000000001},"last":0.41399999999999998}]},{"osd":2,"last update":"Wed Nov 8 19:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.36699999999999999,"15min":0.35099999999999998},"min":{"1min":0.29499999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.59099999999999997},"last":0.254},{"interface":"front","average":{"1min":0.44,"5min":0.40799999999999997,"15min":0.39700000000000002},"min":{"1min":0.252,"5min":0.252,"15min":0.24099999999999999},"max":{"1min":0.58399999999999996,"5min":0.623,"15min":1.2689999999999999},"last":0.39300000000000002}]},{"osd":3,"last update":"Wed Nov 8 19:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.43099999999999999,"15min":0.41999999999999998},"min":{"1min":0.28999999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":1.24},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.41899999999999998,"15min":0.443},"min":{"1min":0.35399999999999998,"5min":0.29399999999999998,"15min":0.253},"max":{"1min":0.61099999999999999,"5min":0.68200000000000005,"15min":2.2120000000000002},"last":0.374}]},{"osd":4,"last update":"Wed Nov 8 19:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.60699999999999998,"15min":0.60999999999999999},"min":{"1min":0.45400000000000001,"5min":0.36899999999999999,"15min":0.32100000000000001},"max":{"1min":0.873,"5min":0.93400000000000005,"15min":2.1579999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.628,"5min":0.59999999999999998,"15min":0.57899999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.36299999999999999},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.77900000000000003}]},{"osd":5,"last update":"Wed Nov 8 19:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.60799999999999998,"15min":0.57699999999999996},"min":{"1min":0.44,"5min":0.40899999999999997,"15min":0.38100000000000001},"max":{"1min":0.79400000000000004,"5min":0.82599999999999996,"15min":0.86399999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.61499999999999999,"15min":0.60899999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.36099999999999999},"max":{"1min":0.88,"5min":0.90800000000000003,"15min":1.115},"last":0.66800000000000004}]},{"osd":6,"last update":"Wed Nov 8 19:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.61199999999999999,"15min":0.628},"min":{"1min":0.42299999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":2.093},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.626,"15min":0.60999999999999999},"min":{"1min":0.497,"5min":0.41399999999999998,"15min":0.40699999999999997},"max":{"1min":0.86499999999999999,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.72399999999999998}]},{"osd":7,"last update":"Wed Nov 8 19:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.64100000000000001,"15min":0.65700000000000003},"min":{"1min":0.439,"5min":0.437,"15min":0.379},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":1.591},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.626,"15min":0.66600000000000004},"min":{"1min":0.44400000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":2.1299999999999999},"last":0.50700000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574955,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33100,"kb_used_data":1924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338740,"statfs":{"total":96636764160,"available":96602869760,"internally_reserved":0,"allocated":1970176,"data_stored":1293718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:31:11 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.42299999999999999,"15min":0.84699999999999998},"min":{"1min":0.26600000000000001,"5min":0.19500000000000001,"15min":0.192},"max":{"1min":0.47999999999999998,"5min":6.9509999999999996,"15min":19.295999999999999},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.435,"5min":0.38400000000000001,"15min":0.77600000000000002},"min":{"1min":0.318,"5min":0.222,"15min":0.222},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":17.204000000000001},"last":0.32600000000000001}]},{"osd":2,"last update":"Wed Nov 8 19:31:11 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.45800000000000002,"15min":0.55200000000000005},"min":{"1min":0.30399999999999999,"5min":0.251,"15min":0.251},"max":{"1min":0.53700000000000003,"5min":6.8029999999999999,"15min":6.8029999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.42899999999999999,"15min":0.81699999999999995},"min":{"1min":0.312,"5min":0.28999999999999998,"15min":0.23100000000000001},"max":{"1min":0.61199999999999999,"5min":1.3140000000000001,"15min":17.175000000000001},"last":0.38400000000000001}]},{"osd":3,"last update":"Wed Nov 8 19:31:11 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.54500000000000004,"15min":0.76100000000000001},"min":{"1min":0.29999999999999999,"5min":0.24399999999999999,"15min":0.22500000000000001},"max":{"1min":0.58099999999999996,"5min":16.661000000000001,"15min":16.661000000000001},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.504,"15min":0.438},"min":{"1min":0.34699999999999998,"5min":0.28799999999999998,"15min":0.255},"max":{"1min":0.58199999999999996,"5min":6.9859999999999998,"15min":6.9859999999999998},"last":0.57099999999999995}]},{"osd":4,"last update":"Wed Nov 8 19:31:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.61299999999999999,"15min":0.98099999999999998},"min":{"1min":0.53700000000000003,"5min":0.36699999999999999,"15min":0.313},"max":{"1min":0.79100000000000004,"5min":1.0029999999999999,"15min":17.056000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.753,"15min":0.74199999999999999},"min":{"1min":0.52500000000000002,"5min":0.33100000000000002,"15min":0.33000000000000002},"max":{"1min":0.81999999999999995,"5min":16.718,"15min":16.718},"last":0.46800000000000003}]},{"osd":5,"last update":"Wed Nov 8 19:31:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.75700000000000001,"15min":0.74199999999999999},"min":{"1min":0.502,"5min":0.36199999999999999,"15min":0.35799999999999998},"max":{"1min":0.79200000000000004,"5min":16.609000000000002,"15min":16.609000000000002},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.67300000000000004,"15min":0.60699999999999998},"min":{"1min":0.51500000000000001,"5min":0.40100000000000002,"15min":0.34599999999999997},"max":{"1min":0.89700000000000002,"5min":5.1639999999999997,"15min":5.1639999999999997},"last":0.627}]},{"osd":6,"last update":"Wed Nov 8 19:31:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.69699999999999995,"15min":0.63800000000000001},"min":{"1min":0.55400000000000005,"5min":0.42699999999999999,"15min":0.36599999999999999},"max":{"1min":0.80700000000000005,"5min":6.6349999999999998,"15min":6.6349999999999998},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65900000000000003,"15min":1.0269999999999999},"min":{"1min":0.48099999999999998,"5min":0.42199999999999999,"15min":0.34899999999999998},"max":{"1min":0.88300000000000001,"5min":3.1400000000000001,"15min":17.111999999999998},"last":0.54200000000000004}]},{"osd":7,"last update":"Wed Nov 8 19:31:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.64200000000000002,"15min":1.0309999999999999},"min":{"1min":0.50700000000000001,"5min":0.43099999999999999,"15min":0.376},"max":{"1min":0.83199999999999996,"5min":1.0649999999999999,"15min":17.146000000000001},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.78100000000000003,"15min":0.75700000000000001},"min":{"1min":0.54300000000000004,"5min":0.441,"15min":0.38800000000000001},"max":{"1min":0.86099999999999999,"5min":16.690999999999999,"15min":16.690999999999999},"last":0.52600000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574955,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28360,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343480,"statfs":{"total":96636764160,"available":96607723520,"internally_reserved":0,"allocated":1376256,"data_stored":703350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:31:22 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.34100000000000003,"15min":0.42299999999999999},"min":{"1min":0.25,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":3.4100000000000001},"last":0.441},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.40400000000000003,"15min":0.46600000000000003},"min":{"1min":0.28599999999999998,"5min":0.219,"15min":0.21199999999999999},"max":{"1min":0.60999999999999999,"5min":1.8340000000000001,"15min":3.4369999999999998},"last":0.35399999999999998}]},{"osd":1,"last update":"Wed Nov 8 19:31:22 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.39200000000000002,"15min":0.48699999999999999},"min":{"1min":0.34399999999999997,"5min":0.24299999999999999,"15min":0.23599999999999999},"max":{"1min":0.57099999999999995,"5min":0.60699999999999998,"15min":4.0679999999999996},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.45200000000000001,"15min":0.53900000000000003},"min":{"1min":0.39200000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.66700000000000004,"5min":0.71899999999999997,"15min":4.3499999999999996},"last":0.42399999999999999}]},{"osd":3,"last update":"Wed Nov 8 19:31:22 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.41799999999999998,"15min":0.48999999999999999},"min":{"1min":0.34999999999999998,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.60599999999999998,"5min":0.82999999999999996,"15min":3.8580000000000001},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39100000000000001,"15min":0.46300000000000002},"min":{"1min":0.29599999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.64300000000000002,"5min":0.78500000000000003,"15min":3.476},"last":0.38700000000000001}]},{"osd":4,"last update":"Wed Nov 8 19:31:22 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.64400000000000002,"15min":0.68799999999999994},"min":{"1min":0.51100000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.879,"5min":4.7990000000000004,"15min":4.7990000000000004},"last":0.753},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58499999999999996,"15min":0.67700000000000005},"min":{"1min":0.49099999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.81999999999999995,"5min":0.872,"15min":4.1040000000000001},"last":0.60599999999999998}]},{"osd":5,"last update":"Wed Nov 8 19:31:22 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.60999999999999999,"15min":0.68999999999999995},"min":{"1min":0.50800000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.83299999999999996,"5min":0.88,"15min":4.0869999999999997},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.628,"5min":0.64800000000000002,"15min":0.70499999999999996},"min":{"1min":0.49099999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.86399999999999999,"5min":4.8239999999999998,"15min":4.8239999999999998},"last":0.56699999999999995}]},{"osd":6,"last update":"Wed Nov 8 19:31:22 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61099999999999999,"15min":0.70099999999999996},"min":{"1min":0.46100000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.80000000000000004,"5min":1.1200000000000001,"15min":4.1399999999999997},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60199999999999998,"15min":0.68200000000000005},"min":{"1min":0.44800000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.746,"5min":0.85599999999999998,"15min":4.0499999999999998},"last":0.63100000000000001}]},{"osd":7,"last update":"Wed Nov 8 19:31:22 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.63600000000000001,"15min":0.71699999999999997},"min":{"1min":0.54300000000000004,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.84499999999999997,"5min":0.877,"15min":4.157},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.65500000000000003,"15min":0.74399999999999999},"min":{"1min":0.56299999999999994,"5min":0.433,"15min":0.433},"max":{"1min":0.80800000000000005,"5min":0.95599999999999996,"15min":4.1710000000000003},"last":0.68200000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574955,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28360,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343480,"statfs":{"total":96636764160,"available":96607723520,"internally_reserved":0,"allocated":1376256,"data_stored":703350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:31:08 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.378,"15min":0.38200000000000001},"min":{"1min":0.26500000000000001,"5min":0.217,"15min":0.20399999999999999},"max":{"1min":0.55400000000000005,"5min":0.67100000000000004,"15min":1.458},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.39800000000000002,"15min":0.39700000000000002},"min":{"1min":0.33700000000000002,"5min":0.192,"15min":0.192},"max":{"1min":0.58299999999999996,"5min":0.626,"15min":1.3939999999999999},"last":0.59599999999999997}]},{"osd":1,"last update":"Wed Nov 8 19:31:08 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.40600000000000003,"15min":0.40799999999999997},"min":{"1min":0.246,"5min":0.246,"15min":0.245},"max":{"1min":0.53600000000000003,"5min":0.59099999999999997,"15min":1.512},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.42299999999999999,"15min":0.437},"min":{"1min":0.32500000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.53900000000000003,"5min":0.59999999999999998,"15min":1.5580000000000001},"last":0.54600000000000004}]},{"osd":2,"last update":"Wed Nov 8 19:31:08 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.38600000000000001,"15min":0.379},"min":{"1min":0.28299999999999997,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.629,"5min":1.1100000000000001,"15min":1.2030000000000001},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.433,"5min":0.40999999999999998,"15min":0.41999999999999998},"min":{"1min":0.318,"5min":0.245,"15min":0.245},"max":{"1min":0.53500000000000003,"5min":0.72399999999999998,"15min":1.536},"last":0.45900000000000002}]},{"osd":4,"last update":"Wed Nov 8 19:31:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.629,"15min":0.621},"min":{"1min":0.495,"5min":0.39600000000000002,"15min":0.36799999999999999},"max":{"1min":0.84999999999999998,"5min":0.86199999999999999,"15min":1.3400000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.63500000000000001,"15min":0.61899999999999999},"min":{"1min":0.50600000000000001,"5min":0.40500000000000003,"15min":0.371},"max":{"1min":0.82599999999999996,"5min":0.84999999999999998,"15min":1.153},"last":0.56399999999999995}]},{"osd":5,"last update":"Wed Nov 8 19:31:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.60199999999999998,"15min":0.59399999999999997},"min":{"1min":0.48499999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":1.4870000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.59699999999999998,"15min":0.59899999999999998},"min":{"1min":0.40799999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.81799999999999995,"5min":0.82799999999999996,"15min":1.3129999999999999},"last":0.496}]},{"osd":6,"last update":"Wed Nov 8 19:31:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.59099999999999997,"15min":0.58299999999999996},"min":{"1min":0.42699999999999999,"5min":0.38400000000000001,"15min":0.34100000000000003},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":1.113},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.61199999999999999,"15min":0.61099999999999999},"min":{"1min":0.45700000000000002,"5min":0.439,"15min":0.36899999999999999},"max":{"1min":0.81999999999999995,"5min":0.85899999999999999,"15min":1.4139999999999999},"last":0.61199999999999999}]},{"osd":7,"last update":"Wed Nov 8 19:31:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.624,"15min":0.63700000000000001},"min":{"1min":0.47799999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.871,"5min":0.89300000000000002,"15min":1.3680000000000001},"last":0.629},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.65100000000000002,"15min":0.629},"min":{"1min":0.46899999999999997,"5min":0.45700000000000002,"15min":0.42299999999999999},"max":{"1min":0.83299999999999996,"5min":0.89000000000000001,"15min":1.179},"last":0.48099999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574955,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28360,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343480,"statfs":{"total":96636764160,"available":96607723520,"internally_reserved":0,"allocated":1376256,"data_stored":703350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:31:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55900000000000005,"15min":0.54600000000000004},"min":{"1min":0.39900000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.74399999999999999,"5min":0.77600000000000002,"15min":1.399},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.55100000000000005,"15min":0.57899999999999996},"min":{"1min":0.43099999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.629,"5min":0.89500000000000002,"15min":2.2090000000000001},"last":0.66800000000000004}]},{"osd":1,"last update":"Wed Nov 8 19:31:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54600000000000004,"15min":0.52300000000000002},"min":{"1min":0.32000000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.68500000000000005,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54200000000000004,"15min":0.51300000000000001},"min":{"1min":0.38600000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.71499999999999997,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.54000000000000004}]},{"osd":2,"last update":"Wed Nov 8 19:31:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.57899999999999996,"15min":0.61399999999999999},"min":{"1min":0.40500000000000003,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.69899999999999995,"5min":0.78200000000000003,"15min":2.8490000000000002},"last":0.621},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.56799999999999995,"15min":0.54100000000000004},"min":{"1min":0.36799999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.70699999999999996,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.69399999999999995}]},{"osd":3,"last update":"Wed Nov 8 19:31:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60999999999999999,"15min":0.58299999999999996},"min":{"1min":0.437,"5min":0.371,"15min":0.371},"max":{"1min":0.69899999999999995,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.754},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.622,"15min":0.68600000000000005},"min":{"1min":0.46000000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.76700000000000002,"5min":0.86199999999999999,"15min":3.4849999999999999},"last":0.71199999999999997}]},{"osd":5,"last update":"Wed Nov 8 19:31:08 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.46300000000000002,"15min":0.501},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.55700000000000005,"5min":0.746,"15min":0.91500000000000004},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.52100000000000002,"15min":0.54900000000000004},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.32300000000000001},"max":{"1min":0.625,"5min":0.78900000000000003,"15min":0.90500000000000003},"last":0.57599999999999996}]},{"osd":6,"last update":"Wed Nov 8 19:31:08 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.50600000000000001,"15min":0.63800000000000001},"min":{"1min":0.35799999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.72399999999999998,"5min":0.80300000000000005,"15min":4.1529999999999996},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.55300000000000005,"15min":0.59399999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.67200000000000004,"5min":0.77200000000000002,"15min":0.94099999999999995},"last":0.72599999999999998}]},{"osd":7,"last update":"Wed Nov 8 19:31:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.53500000000000003,"15min":0.56000000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.63600000000000001,"5min":0.77800000000000002,"15min":0.99399999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61699999999999999,"15min":0.76500000000000001},"min":{"1min":0.42499999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.751,"5min":0.85199999999999998,"15min":5.5359999999999996},"last":0.64500000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574955,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28360,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343480,"statfs":{"total":96636764160,"available":96607723520,"internally_reserved":0,"allocated":1376256,"data_stored":703350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:31:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.53000000000000003,"15min":0.53900000000000003},"min":{"1min":0.31,"5min":0.30399999999999999,"15min":0.26000000000000001},"max":{"1min":0.77400000000000002,"5min":0.80600000000000005,"15min":2.2360000000000002},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.56299999999999994,"15min":0.53400000000000003},"min":{"1min":0.38100000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.70099999999999996,"5min":0.77900000000000003,"15min":0.878},"last":0.65500000000000003}]},{"osd":1,"last update":"Wed Nov 8 19:31:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59899999999999998,"15min":0.56499999999999995},"min":{"1min":0.40500000000000003,"5min":0.28000000000000003,"15min":0.27600000000000002},"max":{"1min":0.74399999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.57599999999999996,"15min":0.59399999999999997},"min":{"1min":0.36399999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.78000000000000003,"5min":0.85499999999999998,"15min":2.2919999999999998},"last":0.57899999999999996}]},{"osd":2,"last update":"Wed Nov 8 19:31:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.57199999999999995,"15min":0.56000000000000005},"min":{"1min":0.34100000000000003,"5min":0.33800000000000002,"15min":0.33000000000000002},"max":{"1min":0.81000000000000005,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57099999999999995,"15min":0.54500000000000004},"min":{"1min":0.39000000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.76500000000000001,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.60599999999999998}]},{"osd":3,"last update":"Wed Nov 8 19:31:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58399999999999996,"15min":0.56399999999999995},"min":{"1min":0.41199999999999998,"5min":0.36699999999999999,"15min":0.35099999999999998},"max":{"1min":0.75700000000000001,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.626},{"interface":"front","average":{"1min":0.627,"5min":0.59499999999999997,"15min":0.58099999999999996},"min":{"1min":0.52400000000000002,"5min":0.35599999999999998,"15min":0.34399999999999997},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.89900000000000002},"last":0.67500000000000004}]},{"osd":4,"last update":"Wed Nov 8 19:31:09 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48599999999999999,"15min":0.55800000000000005},"min":{"1min":0.36199999999999999,"5min":0.29999999999999999,"15min":0.29199999999999998},"max":{"1min":0.69499999999999995,"5min":0.81200000000000006,"15min":2.3300000000000001},"last":0.371},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.59099999999999997,"15min":0.621},"min":{"1min":0.45900000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.92300000000000004},"last":0.59199999999999997}]},{"osd":6,"last update":"Wed Nov 8 19:31:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.51300000000000001,"15min":0.55700000000000005},"min":{"1min":0.39000000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.71699999999999997,"5min":0.76300000000000001,"15min":0.89400000000000002},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54100000000000004,"15min":0.62},"min":{"1min":0.41899999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":2.3650000000000002},"last":0.42899999999999999}]},{"osd":7,"last update":"Wed Nov 8 19:31:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.56799999999999995,"15min":0.60799999999999998},"min":{"1min":0.372,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.77900000000000003,"5min":0.84499999999999997,"15min":0.88500000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59199999999999997,"15min":0.628},"min":{"1min":0.41699999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.75,"5min":0.80200000000000005,"15min":0.873},"last":0.47499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:31:36.315 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-11-08T19:31:36.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.465+0000 7f8588e61700 1 Processor -- start 2023-11-08T19:31:36.467 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.466+0000 7f8588e61700 1 -- start start 2023-11-08T19:31:36.470 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.466+0000 7f8588e61700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f85840722a0 0x7f858406ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:31:36.470 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.466+0000 7f8588e61700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f85840cb610 0x7f85840b4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:31:36.470 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.466+0000 7f8588e61700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85840b3710 con 0x7f85840c7250 2023-11-08T19:31:36.471 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.466+0000 7f8588e61700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f858406cc00 con 0x7f85840722a0 2023-11-08T19:31:36.471 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.466+0000 7f8588e61700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f858406c640 con 0x7f85840cb610 2023-11-08T19:31:36.471 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.467+0000 7f8582d9d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f85840cb610 0x7f85840b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:31:36.472 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.467+0000 7f858259c700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f85840722a0 0x7f858406ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:31:36.472 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.467+0000 7f8582d9d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f85840cb610 0x7f85840b4140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.149:38330/0 (socket says 172.21.15.149:38330) 2023-11-08T19:31:36.472 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.467+0000 7f8582d9d700 1 -- 172.21.15.149:0/1970698205 learned_addr learned my addr 172.21.15.149:0/1970698205 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:31:36.473 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.467+0000 7f8582d9d700 1 -- 172.21.15.149:0/1970698205 >> v2:172.21.15.160:3300/0 conn(0x7f85840722a0 msgr2=0x7f858406ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:31:36.473 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.467+0000 7f8582d9d700 1 --2- 172.21.15.149:0/1970698205 >> v2:172.21.15.160:3300/0 conn(0x7f85840722a0 0x7f858406ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:31:36.473 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.467+0000 7f8582d9d700 1 -- 172.21.15.149:0/1970698205 >> v1:172.21.15.160:6789/0 conn(0x7f85840c7250 legacy=0x7f858406b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:31:36.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.467+0000 7f8582d9d700 1 -- 172.21.15.149:0/1970698205 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f858406c920 con 0x7f85840cb610 2023-11-08T19:31:36.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.467+0000 7f8582d9d700 1 --2- 172.21.15.149:0/1970698205 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f85840cb610 0x7f85840b4140 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f857c009e50 tx=0x7f857c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e0c50ea1cf7d42c server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:31:36.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.468+0000 7f858159a700 1 -- 172.21.15.149:0/1970698205 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f857c00e070 con 0x7f85840cb610 2023-11-08T19:31:36.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.468+0000 7f858159a700 1 -- 172.21.15.149:0/1970698205 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f857c00b910 con 0x7f85840cb610 2023-11-08T19:31:36.475 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.468+0000 7f858159a700 1 -- 172.21.15.149:0/1970698205 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f857c00bcc0 con 0x7f85840cb610 2023-11-08T19:31:36.475 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.468+0000 7f8588e61700 1 -- 172.21.15.149:0/1970698205 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f85840cb610 msgr2=0x7f85840b4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:31:36.475 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.468+0000 7f8588e61700 1 --2- 172.21.15.149:0/1970698205 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f85840cb610 0x7f85840b4140 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f857c009e50 tx=0x7f857c00b330 comp rx=0 tx=0).stop 2023-11-08T19:31:36.476 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.468+0000 7f8588e61700 1 -- 172.21.15.149:0/1970698205 shutdown_connections 2023-11-08T19:31:36.476 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.468+0000 7f8588e61700 1 --2- 172.21.15.149:0/1970698205 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f85840cb610 0x7f85840b4140 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:31:36.476 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.468+0000 7f8588e61700 1 --2- 172.21.15.149:0/1970698205 >> v2:172.21.15.160:3300/0 conn(0x7f85840722a0 0x7f858406ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:31:36.476 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.468+0000 7f8588e61700 1 -- 172.21.15.149:0/1970698205 >> 172.21.15.149:0/1970698205 conn(0x7f85840d0640 msgr2=0x7f85840d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:31:36.477 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.468+0000 7f8588e61700 1 -- 172.21.15.149:0/1970698205 shutdown_connections 2023-11-08T19:31:36.477 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.468+0000 7f8588e61700 1 -- 172.21.15.149:0/1970698205 wait complete. 2023-11-08T19:31:36.480 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.470+0000 7f8588e61700 1 Processor -- start 2023-11-08T19:31:36.480 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.470+0000 7f8588e61700 1 -- start start 2023-11-08T19:31:36.480 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.470+0000 7f8588e61700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f85840722a0 0x7f858415cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:31:36.481 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.470+0000 7f8588e61700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f85840c7250 0x7f85840c7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:31:36.481 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.470+0000 7f8588e61700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85840cb610 0x7f85840c25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:31:36.481 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.470+0000 7f8588e61700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85840c80d0 con 0x7f85840cb610 2023-11-08T19:31:36.481 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.470+0000 7f8588e61700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85840c83b0 con 0x7f85840722a0 2023-11-08T19:31:36.482 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.470+0000 7f8588e61700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85840c8690 con 0x7f85840c7250 2023-11-08T19:31:36.482 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.470+0000 7f8582d9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85840cb610 0x7f85840c25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:31:36.482 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.470+0000 7f8582d9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85840cb610 0x7f85840c25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:46280/0 (socket says 172.21.15.149:46280) 2023-11-08T19:31:36.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.470+0000 7f8582d9d700 1 -- 172.21.15.149:0/1871280058 learned_addr learned my addr 172.21.15.149:0/1871280058 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:31:36.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.471+0000 7f858259c700 1 --2- 172.21.15.149:0/1871280058 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f85840722a0 0x7f858415cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:31:36.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.471+0000 7f8581d9b700 1 --2- 172.21.15.149:0/1871280058 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f85840c7250 0x7f85840c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:31:36.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.471+0000 7f8582d9d700 1 -- 172.21.15.149:0/1871280058 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f85840c7250 msgr2=0x7f85840c7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:31:36.484 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.471+0000 7f8582d9d700 1 --2- 172.21.15.149:0/1871280058 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f85840c7250 0x7f85840c7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:31:36.484 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.471+0000 7f8582d9d700 1 -- 172.21.15.149:0/1871280058 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f85840722a0 msgr2=0x7f858415cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:31:36.484 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.471+0000 7f8582d9d700 1 --2- 172.21.15.149:0/1871280058 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f85840722a0 0x7f858415cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:31:36.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.471+0000 7f8582d9d700 1 -- 172.21.15.149:0/1871280058 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f857c009b30 con 0x7f85840cb610 2023-11-08T19:31:36.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.471+0000 7f8582d9d700 1 --2- 172.21.15.149:0/1871280058 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85840cb610 0x7f85840c25c0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f858406cd40 tx=0x7f857c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:31:36.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.471+0000 7f8572ffd700 1 -- 172.21.15.149:0/1871280058 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f857c004960 con 0x7f85840cb610 2023-11-08T19:31:36.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.471+0000 7f8572ffd700 1 -- 172.21.15.149:0/1871280058 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f857c0099b0 con 0x7f85840cb610 2023-11-08T19:31:36.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.471+0000 7f8588e61700 1 -- 172.21.15.149:0/1871280058 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85840c8970 con 0x7f85840cb610 2023-11-08T19:31:36.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.471+0000 7f8572ffd700 1 -- 172.21.15.149:0/1871280058 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f857c01c680 con 0x7f85840cb610 2023-11-08T19:31:36.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.471+0000 7f8588e61700 1 -- 172.21.15.149:0/1871280058 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f858415d4c0 con 0x7f85840cb610 2023-11-08T19:31:36.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.472+0000 7f8588e61700 1 -- 172.21.15.149:0/1871280058 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f858415d680 con 0x7f85840cb610 2023-11-08T19:31:36.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.473+0000 7f8572ffd700 1 -- 172.21.15.149:0/1871280058 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f857c01c7e0 con 0x7f85840cb610 2023-11-08T19:31:36.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.473+0000 7f8572ffd700 1 --2- 172.21.15.149:0/1871280058 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f856406af00 0x7f856406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:31:36.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.473+0000 7f8572ffd700 1 -- 172.21.15.149:0/1871280058 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6999+0+0 (secure 0 0 0) 0x7f857c08b3f0 con 0x7f85840cb610 2023-11-08T19:31:36.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.473+0000 7f858259c700 1 --2- 172.21.15.149:0/1871280058 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f856406af00 0x7f856406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:31:36.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.473+0000 7f858259c700 1 --2- 172.21.15.149:0/1871280058 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f856406af00 0x7f856406d3c0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f8578009b70 tx=0x7f8578008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:31:36.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.478+0000 7f8572ffd700 1 -- 172.21.15.149:0/1871280058 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f857c055f90 con 0x7f85840cb610 2023-11-08T19:31:36.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.666+0000 7f8588e61700 1 -- 172.21.15.149:0/1871280058 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f85840c8e30 con 0x7f85840cb610 2023-11-08T19:31:36.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.669+0000 7f8572ffd700 1 -- 172.21.15.149:0/1871280058 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v21)=0 v21) v1 ==== 123+0+0 (secure 0 0 0) 0x7f857c0595b0 con 0x7f85840cb610 2023-11-08T19:31:36.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.670+0000 7f8572ffd700 1 -- 172.21.15.149:0/1871280058 <== mon.0 v2:172.21.15.149:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f857c055f90 con 0x7f85840cb610 2023-11-08T19:31:36.675 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.672+0000 7f8588e61700 1 -- 172.21.15.149:0/1871280058 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f856406af00 msgr2=0x7f856406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:31:36.675 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.672+0000 7f8588e61700 1 --2- 172.21.15.149:0/1871280058 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f856406af00 0x7f856406d3c0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f8578009b70 tx=0x7f8578008040 comp rx=0 tx=0).stop 2023-11-08T19:31:36.675 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.672+0000 7f8588e61700 1 -- 172.21.15.149:0/1871280058 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85840cb610 msgr2=0x7f85840c25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:31:36.676 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.672+0000 7f8588e61700 1 --2- 172.21.15.149:0/1871280058 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85840cb610 0x7f85840c25c0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f858406cd40 tx=0x7f857c004ad0 comp rx=0 tx=0).stop 2023-11-08T19:31:36.676 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.672+0000 7f8588e61700 1 -- 172.21.15.149:0/1871280058 shutdown_connections 2023-11-08T19:31:36.676 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.672+0000 7f8588e61700 1 --2- 172.21.15.149:0/1871280058 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7f856406af00 0x7f856406d3c0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:31:36.677 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.672+0000 7f8588e61700 1 --2- 172.21.15.149:0/1871280058 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f85840722a0 0x7f858415cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:31:36.677 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.672+0000 7f8588e61700 1 --2- 172.21.15.149:0/1871280058 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85840cb610 0x7f85840c25c0 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:31:36.677 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.672+0000 7f8588e61700 1 --2- 172.21.15.149:0/1871280058 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f85840c7250 0x7f85840c7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:31:36.677 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.672+0000 7f8588e61700 1 -- 172.21.15.149:0/1871280058 >> 172.21.15.149:0/1871280058 conn(0x7f85840d0640 msgr2=0x7f858415e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:31:36.678 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.672+0000 7f8588e61700 1 -- 172.21.15.149:0/1871280058 shutdown_connections 2023-11-08T19:31:36.678 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.673+0000 7f8588e61700 1 -- 172.21.15.149:0/1871280058 wait complete. 2023-11-08T19:31:36.686 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-08T19:31:36.687 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T19:31:36.809 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.808+0000 7fe814cc3700 1 Processor -- start 2023-11-08T19:31:36.809 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.808+0000 7fe814cc3700 1 -- start start 2023-11-08T19:31:36.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.808+0000 7fe814cc3700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe8100cc140 0x7fe8100cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:31:36.812 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.808+0000 7fe814cc3700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe8100b2850 0x7fe8100cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:31:36.812 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.809+0000 7fe814cc3700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8100cce50 con 0x7fe8100b2cd0 2023-11-08T19:31:36.812 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.809+0000 7fe814cc3700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8100b2430 con 0x7fe8100cc140 2023-11-08T19:31:36.813 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.809+0000 7fe814cc3700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8100cc520 con 0x7fe8100b2850 2023-11-08T19:31:36.813 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.809+0000 7fe80e59c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe8100cc140 0x7fe8100cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:31:36.813 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.809+0000 7fe80e59c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe8100cc140 0x7fe8100cc910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:46284/0 (socket says 172.21.15.149:46284) 2023-11-08T19:31:36.814 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.809+0000 7fe80e59c700 1 -- 172.21.15.149:0/975287781 learned_addr learned my addr 172.21.15.149:0/975287781 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:31:36.814 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.809+0000 7fe80dd9b700 1 --2- 172.21.15.149:0/975287781 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe8100b2850 0x7fe8100cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:31:36.814 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.809+0000 7fe80e59c700 1 -- 172.21.15.149:0/975287781 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe8100b2850 msgr2=0x7fe8100cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:31:36.814 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.809+0000 7fe80e59c700 1 --2- 172.21.15.149:0/975287781 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe8100b2850 0x7fe8100cabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:31:36.815 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.809+0000 7fe80e59c700 1 -- 172.21.15.149:0/975287781 >> v1:172.21.15.160:6789/0 conn(0x7fe8100b2cd0 legacy=0x7fe81015d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T19:31:36.815 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.809+0000 7fe80e59c700 1 -- 172.21.15.149:0/975287781 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8100b17b0 con 0x7fe8100cc140 2023-11-08T19:31:36.815 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.809+0000 7fe80e59c700 1 --2- 172.21.15.149:0/975287781 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe8100cc140 0x7fe8100cc910 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7fe800006fd0 tx=0x7fe800009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acc42d7953fd1007 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:31:36.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.809+0000 7fe80d59a700 1 -- 172.21.15.149:0/975287781 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe800005e30 con 0x7fe8100cc140 2023-11-08T19:31:36.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.809+0000 7fe80d59a700 1 -- 172.21.15.149:0/975287781 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe800006030 con 0x7fe8100cc140 2023-11-08T19:31:36.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.809+0000 7fe80d59a700 1 -- 172.21.15.149:0/975287781 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8000063e0 con 0x7fe8100cc140 2023-11-08T19:31:36.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.810+0000 7fe814cc3700 1 -- 172.21.15.149:0/975287781 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe8100cc140 msgr2=0x7fe8100cc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:31:36.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.810+0000 7fe814cc3700 1 --2- 172.21.15.149:0/975287781 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe8100cc140 0x7fe8100cc910 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7fe800006fd0 tx=0x7fe800009bd0 comp rx=0 tx=0).stop 2023-11-08T19:31:36.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.810+0000 7fe814cc3700 1 -- 172.21.15.149:0/975287781 shutdown_connections 2023-11-08T19:31:36.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.810+0000 7fe814cc3700 1 --2- 172.21.15.149:0/975287781 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe8100cc140 0x7fe8100cc910 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:31:36.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.810+0000 7fe814cc3700 1 --2- 172.21.15.149:0/975287781 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe8100b2850 0x7fe8100cabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:31:36.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.810+0000 7fe814cc3700 1 -- 172.21.15.149:0/975287781 >> 172.21.15.149:0/975287781 conn(0x7fe810099a40 msgr2=0x7fe8100d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:31:36.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.810+0000 7fe814cc3700 1 -- 172.21.15.149:0/975287781 shutdown_connections 2023-11-08T19:31:36.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.810+0000 7fe814cc3700 1 -- 172.21.15.149:0/975287781 wait complete. 2023-11-08T19:31:36.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.811+0000 7fe814cc3700 1 Processor -- start 2023-11-08T19:31:36.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.811+0000 7fe814cc3700 1 -- start start 2023-11-08T19:31:36.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.812+0000 7fe814cc3700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe8100b2850 0x7fe8100af460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:31:36.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.812+0000 7fe814cc3700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe8100b2cd0 0x7fe81006e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:31:36.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.812+0000 7fe814cc3700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe8100cc140 0x7fe81006e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:31:36.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.812+0000 7fe814cc3700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8101f3210 con 0x7fe8100b2cd0 2023-11-08T19:31:36.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.812+0000 7fe814cc3700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8100b0930 con 0x7fe8100cc140 2023-11-08T19:31:36.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.812+0000 7fe814cc3700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8100afdb0 con 0x7fe8100b2850 2023-11-08T19:31:36.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.812+0000 7fe80dd9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe8100b2cd0 0x7fe81006e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:31:36.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.812+0000 7fe80dd9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe8100b2cd0 0x7fe81006e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:46292/0 (socket says 172.21.15.149:46292) 2023-11-08T19:31:36.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.812+0000 7fe80dd9b700 1 -- 172.21.15.149:0/3650035503 learned_addr learned my addr 172.21.15.149:0/3650035503 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-11-08T19:31:36.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.812+0000 7fe80e59c700 1 --2- 172.21.15.149:0/3650035503 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe8100b2850 0x7fe8100af460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:31:36.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.812+0000 7fe80ed9d700 1 --2- 172.21.15.149:0/3650035503 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe8100cc140 0x7fe81006e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:31:36.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.813+0000 7fe80dd9b700 1 -- 172.21.15.149:0/3650035503 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe8100b2850 msgr2=0x7fe8100af460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:31:36.826 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.813+0000 7fe80dd9b700 1 --2- 172.21.15.149:0/3650035503 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe8100b2850 0x7fe8100af460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:31:36.826 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.813+0000 7fe80dd9b700 1 -- 172.21.15.149:0/3650035503 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe8100cc140 msgr2=0x7fe81006e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:31:36.826 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.813+0000 7fe80dd9b700 1 --2- 172.21.15.149:0/3650035503 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe8100cc140 0x7fe81006e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:31:36.827 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.813+0000 7fe80dd9b700 1 -- 172.21.15.149:0/3650035503 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe800009500 con 0x7fe8100b2cd0 2023-11-08T19:31:36.827 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.813+0000 7fe80dd9b700 1 --2- 172.21.15.149:0/3650035503 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe8100b2cd0 0x7fe81006e040 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7fe80400e810 tx=0x7fe80400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:31:36.827 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.813+0000 7fe7feffd700 1 -- 172.21.15.149:0/3650035503 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80400c070 con 0x7fe8100b2cd0 2023-11-08T19:31:36.827 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.813+0000 7fe7feffd700 1 -- 172.21.15.149:0/3650035503 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe804013610 con 0x7fe8100b2cd0 2023-11-08T19:31:36.828 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.813+0000 7fe814cc3700 1 -- 172.21.15.149:0/3650035503 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8100b0090 con 0x7fe8100b2cd0 2023-11-08T19:31:36.828 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.813+0000 7fe7feffd700 1 -- 172.21.15.149:0/3650035503 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8040139e0 con 0x7fe8100b2cd0 2023-11-08T19:31:36.828 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.813+0000 7fe814cc3700 1 -- 172.21.15.149:0/3650035503 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8100b0650 con 0x7fe8100b2cd0 2023-11-08T19:31:36.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.814+0000 7fe814cc3700 1 -- 172.21.15.149:0/3650035503 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe81014ea70 con 0x7fe8100b2cd0 2023-11-08T19:31:36.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.814+0000 7fe7feffd700 1 -- 172.21.15.149:0/3650035503 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe804013b40 con 0x7fe8100b2cd0 2023-11-08T19:31:36.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.815+0000 7fe7feffd700 1 --2- 172.21.15.149:0/3650035503 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe7f006af00 0x7fe7f006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T19:31:36.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.815+0000 7fe7feffd700 1 -- 172.21.15.149:0/3650035503 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6999+0+0 (secure 0 0 0) 0x7fe8040898d0 con 0x7fe8100b2cd0 2023-11-08T19:31:36.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.815+0000 7fe80e59c700 1 --2- 172.21.15.149:0/3650035503 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe7f006af00 0x7fe7f006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T19:31:36.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.815+0000 7fe80e59c700 1 --2- 172.21.15.149:0/3650035503 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe7f006af00 0x7fe7f006d3c0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fe800013040 tx=0x7fe800008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T19:31:36.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:36.819+0000 7fe7feffd700 1 -- 172.21.15.149:0/3650035503 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe8040543f0 con 0x7fe8100b2cd0 2023-11-08T19:31:37.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:37.051+0000 7fe814cc3700 1 -- 172.21.15.149:0/3650035503 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe8100b1d50 con 0x7fe8100b2cd0 2023-11-08T19:31:37.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:37.051+0000 7fe7feffd700 1 -- 172.21.15.149:0/3650035503 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 105 v105) v1 ==== 95+0+3712 (secure 0 0 0) 0x7fe8100b1d50 con 0x7fe8100b2cd0 2023-11-08T19:31:37.053 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-11-08T19:31:37.053 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":105,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6095,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/852710262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6833","nonce":852710262},{"type":"v1","addr":"172.21.15.160:6835","nonce":852710262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64},{"gid":6425,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/2137508069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":2137508069},{"type":"v1","addr":"172.21.15.149:6837","nonce":2137508069}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":100},{"gid":6566,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/1213253623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":1213253623},{"type":"v1","addr":"172.21.15.160:6834","nonce":1213253623}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":105},{"gid":8187,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/3195341668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3195341668},{"type":"v1","addr":"172.21.15.149:6836","nonce":3195341668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":105}],"filesystems":[]} 2023-11-08T19:31:37.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:37.053+0000 7fe814cc3700 1 -- 172.21.15.149:0/3650035503 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe7f006af00 msgr2=0x7fe7f006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:31:37.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:37.053+0000 7fe814cc3700 1 --2- 172.21.15.149:0/3650035503 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe7f006af00 0x7fe7f006d3c0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fe800013040 tx=0x7fe800008070 comp rx=0 tx=0).stop 2023-11-08T19:31:37.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:37.053+0000 7fe814cc3700 1 -- 172.21.15.149:0/3650035503 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe8100b2cd0 msgr2=0x7fe81006e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T19:31:37.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:37.053+0000 7fe814cc3700 1 --2- 172.21.15.149:0/3650035503 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe8100b2cd0 0x7fe81006e040 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7fe80400e810 tx=0x7fe80400eb20 comp rx=0 tx=0).stop 2023-11-08T19:31:37.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:37.053+0000 7fe814cc3700 1 -- 172.21.15.149:0/3650035503 shutdown_connections 2023-11-08T19:31:37.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:37.053+0000 7fe814cc3700 1 --2- 172.21.15.149:0/3650035503 >> [v2:172.21.15.149:6832/1929837472,v1:172.21.15.149:6833/1929837472] conn(0x7fe7f006af00 0x7fe7f006d3c0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:31:37.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:37.053+0000 7fe814cc3700 1 --2- 172.21.15.149:0/3650035503 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe8100cc140 0x7fe81006e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:31:37.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:37.053+0000 7fe814cc3700 1 --2- 172.21.15.149:0/3650035503 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe8100b2850 0x7fe8100af460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:31:37.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:37.053+0000 7fe814cc3700 1 --2- 172.21.15.149:0/3650035503 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe8100b2cd0 0x7fe81006e040 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T19:31:37.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:37.053+0000 7fe814cc3700 1 -- 172.21.15.149:0/3650035503 >> 172.21.15.149:0/3650035503 conn(0x7fe810099a40 msgr2=0x7fe810160cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T19:31:37.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:37.053+0000 7fe814cc3700 1 -- 172.21.15.149:0/3650035503 shutdown_connections 2023-11-08T19:31:37.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-11-08T19:31:37.053+0000 7fe814cc3700 1 -- 172.21.15.149:0/3650035503 wait complete. 2023-11-08T19:31:37.058 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 105 2023-11-08T19:31:37.066 DEBUG:tasks.cephfs.filesystem:already dead... 2023-11-08T19:31:37.067 INFO:teuthology.misc:Shutting down mds daemons... 2023-11-08T19:31:37.068 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-08T19:31:37.068 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T19:31:37.076 INFO:tasks.ceph.mds.a:Stopped 2023-11-08T19:31:37.077 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-08T19:31:37.077 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T19:31:37.126 INFO:tasks.ceph.mds.c:Stopped 2023-11-08T19:31:37.126 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-08T19:31:37.127 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T19:31:37.137 INFO:tasks.ceph.mds.b:Stopped 2023-11-08T19:31:37.138 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-08T19:31:37.138 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T19:31:37.188 INFO:tasks.ceph.mds.d:Stopped 2023-11-08T19:31:37.189 INFO:teuthology.misc:Shutting down osd daemons... 2023-11-08T19:31:37.189 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-11-08T19:31:37.190 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T19:31:37.232 INFO:tasks.ceph.osd.0:Stopped 2023-11-08T19:31:37.233 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-11-08T19:31:37.233 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T19:31:37.267 INFO:tasks.ceph.osd.1:Stopped 2023-11-08T19:31:37.267 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-11-08T19:31:37.268 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T19:31:37.342 INFO:tasks.ceph.osd.2:Stopped 2023-11-08T19:31:37.342 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-11-08T19:31:37.343 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T19:31:37.407 INFO:tasks.ceph.osd.3:Stopped 2023-11-08T19:31:37.408 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-11-08T19:31:37.408 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T19:31:37.442 INFO:tasks.ceph.osd.4:Stopped 2023-11-08T19:31:37.443 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-11-08T19:31:37.443 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T19:31:37.525 INFO:tasks.ceph.osd.5:Stopped 2023-11-08T19:31:37.525 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-11-08T19:31:37.526 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T19:31:37.558 INFO:tasks.ceph.osd.6:Stopped 2023-11-08T19:31:37.558 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-11-08T19:31:37.559 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T19:31:37.634 INFO:tasks.ceph.osd.7:Stopped 2023-11-08T19:31:37.635 INFO:teuthology.misc:Shutting down mgr daemons... 2023-11-08T19:31:37.635 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-11-08T19:31:37.636 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T19:31:37.659 INFO:tasks.ceph.mgr.y:Stopped 2023-11-08T19:31:37.660 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-11-08T19:31:37.660 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T19:31:37.699 INFO:tasks.ceph.mgr.x:Stopped 2023-11-08T19:31:37.699 INFO:teuthology.misc:Shutting down mon daemons... 2023-11-08T19:31:37.700 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-11-08T19:31:37.700 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T19:31:37.711 INFO:tasks.ceph.mon.a:Stopped 2023-11-08T19:31:37.711 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-11-08T19:31:37.712 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T19:31:37.751 INFO:tasks.ceph.mon.b:Stopped 2023-11-08T19:31:37.751 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-11-08T19:31:37.752 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T19:31:37.803 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2023-11-08T19:31:37.803 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2023-11-08T19:31:37.804 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2023-11-08T19:31:37.804 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2023-11-08T19:31:37.805 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2023-11-08T19:31:37.805 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-11-08T19:31:37.805 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-11-08T19:31:37.805 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2023-11-08T19:31:37.806 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2023-11-08T19:31:37.806 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2023-11-08T19:31:37.807 INFO:tasks.ceph.mon.c:Stopped 2023-11-08T19:31:37.807 INFO:tasks.ceph:Checking cluster log for badness... 2023-11-08T19:31:37.808 DEBUG:teuthology.orchestra.run.smithi149:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'evicting unresponsive client' | egrep -v RECENT_CRASH | head -n 1 2023-11-08T19:31:37.840 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi149.front.sepia.ceph.com 2023-11-08T19:31:37.841 DEBUG:teuthology.orchestra.run.smithi149:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-11-08T19:31:38.082 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi149.front.sepia.ceph.com 2023-11-08T19:31:38.082 DEBUG:teuthology.orchestra.run.smithi149:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-11-08T19:31:38.184 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi149.front.sepia.ceph.com 2023-11-08T19:31:38.185 DEBUG:teuthology.orchestra.run.smithi149:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-11-08T19:31:38.276 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi149.front.sepia.ceph.com 2023-11-08T19:31:38.277 DEBUG:teuthology.orchestra.run.smithi149:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-11-08T19:31:38.358 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi160.front.sepia.ceph.com 2023-11-08T19:31:38.359 DEBUG:teuthology.orchestra.run.smithi160:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-11-08T19:31:38.523 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi160.front.sepia.ceph.com 2023-11-08T19:31:38.523 DEBUG:teuthology.orchestra.run.smithi160:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-11-08T19:31:38.616 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi160.front.sepia.ceph.com 2023-11-08T19:31:38.617 DEBUG:teuthology.orchestra.run.smithi160:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-11-08T19:31:38.688 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi160.front.sepia.ceph.com 2023-11-08T19:31:38.688 DEBUG:teuthology.orchestra.run.smithi160:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-11-08T19:31:38.786 INFO:tasks.ceph:Archiving mon data... 2023-11-08T19:31:38.790 DEBUG:teuthology.misc:Transferring archived files from smithi149:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2023-11-08_19:01:12-fs:functional-main-distro-default-smithi/7452102/data/mon.a.tgz 2023-11-08T19:31:38.790 DEBUG:teuthology.orchestra.run.smithi149:> mktemp 2023-11-08T19:31:38.808 INFO:teuthology.orchestra.run.smithi149.stdout:/tmp/tmp.CYcBJ5ZkW2 2023-11-08T19:31:38.809 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.CYcBJ5ZkW2 2023-11-08T19:31:38.971 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 0666 /tmp/tmp.CYcBJ5ZkW2 2023-11-08T19:31:38.997 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T19:31:39.041 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T19:31:39.086 DEBUG:teuthology.orchestra.remote:smithi149:/tmp/tmp.CYcBJ5ZkW2 is 370KB 2023-11-08T19:31:39.210 DEBUG:teuthology.orchestra.run.smithi149:> rm -fr /tmp/tmp.CYcBJ5ZkW2 2023-11-08T19:31:39.227 DEBUG:teuthology.misc:Transferring archived files from smithi160:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2023-11-08_19:01:12-fs:functional-main-distro-default-smithi/7452102/data/mon.b.tgz 2023-11-08T19:31:39.227 DEBUG:teuthology.orchestra.run.smithi160:> mktemp 2023-11-08T19:31:39.245 INFO:teuthology.orchestra.run.smithi160.stdout:/tmp/tmp.lRfEMK1Jtp 2023-11-08T19:31:39.246 DEBUG:teuthology.orchestra.run.smithi160:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.lRfEMK1Jtp 2023-11-08T19:31:39.385 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod 0666 /tmp/tmp.lRfEMK1Jtp 2023-11-08T19:31:39.471 DEBUG:teuthology.orchestra.remote:smithi160:/tmp/tmp.lRfEMK1Jtp is 371KB 2023-11-08T19:31:39.568 DEBUG:teuthology.orchestra.run.smithi160:> rm -fr /tmp/tmp.lRfEMK1Jtp 2023-11-08T19:31:39.585 DEBUG:teuthology.misc:Transferring archived files from smithi160:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2023-11-08_19:01:12-fs:functional-main-distro-default-smithi/7452102/data/mon.c.tgz 2023-11-08T19:31:39.585 DEBUG:teuthology.orchestra.run.smithi160:> mktemp 2023-11-08T19:31:39.641 INFO:teuthology.orchestra.run.smithi160.stdout:/tmp/tmp.lUzRatFIx8 2023-11-08T19:31:39.641 DEBUG:teuthology.orchestra.run.smithi160:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.lUzRatFIx8 2023-11-08T19:31:39.771 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod 0666 /tmp/tmp.lUzRatFIx8 2023-11-08T19:31:39.857 DEBUG:teuthology.orchestra.remote:smithi160:/tmp/tmp.lUzRatFIx8 is 371KB 2023-11-08T19:31:39.954 DEBUG:teuthology.orchestra.run.smithi160:> rm -fr /tmp/tmp.lUzRatFIx8 2023-11-08T19:31:39.971 INFO:tasks.ceph:Cleaning ceph cluster... 2023-11-08T19:31:39.972 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-08T19:31:39.974 DEBUG:teuthology.orchestra.run.smithi160:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-08T19:31:40.036 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-11-08T19:31:40.037 DEBUG:teuthology.orchestra.run.smithi149:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-08T19:31:40.042 DEBUG:teuthology.orchestra.run.smithi160:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-08T19:31:40.078 INFO:teuthology.orchestra.run.smithi149.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-08T19:31:40.111 INFO:teuthology.orchestra.run.smithi160.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-08T19:31:40.116 INFO:tasks.ceph:Archiving crash dumps... 2023-11-08T19:31:40.118 DEBUG:teuthology.misc:Transferring archived files from smithi149:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2023-11-08_19:01:12-fs:functional-main-distro-default-smithi/7452102/remote/smithi149/crash 2023-11-08T19:31:40.119 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-08T19:31:40.174 DEBUG:teuthology.misc:Transferring archived files from smithi160:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2023-11-08_19:01:12-fs:functional-main-distro-default-smithi/7452102/remote/smithi160/crash 2023-11-08T19:31:40.175 DEBUG:teuthology.orchestra.run.smithi160:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-08T19:31:40.258 INFO:tasks.ceph:Shutting down logrotate 2023-11-08T19:31:40.258 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T19:31:40.261 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T19:31:40.369 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-08T19:31:40.397 DEBUG:teuthology.orchestra.run.smithi160:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-08T19:31:40.423 INFO:tasks.ceph:Compressing logs... 2023-11-08T19:31:40.423 DEBUG:teuthology.orchestra.run.smithi149:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-08T19:31:40.440 DEBUG:teuthology.orchestra.run.smithi160:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-08T19:31:40.463 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123214.log 2023-11-08T19:31:40.464 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124348.log 2023-11-08T19:31:40.464 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.123214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112934.log 2023-11-08T19:31:40.497 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-11-08T19:31:40.497 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104114.log 2023-11-08T19:31:40.497 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104067.log 2023-11-08T19:31:40.498 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.admin.104114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104204.log 2023-11-08T19:31:40.498 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.admin.104067.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.104114.log.gz 2023-11-08T19:31:40.498 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-08T19:31:40.499 INFO:teuthology.orchestra.run.smithi160.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.104067.log.gz 2023-11-08T19:31:40.499 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.admin.104204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104302.log 2023-11-08T19:31:40.499 INFO:teuthology.orchestra.run.smithi160.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.104204.log.gz 2023-11-08T19:31:40.499 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.111846.log 2023-11-08T19:31:40.500 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 /var/log/ceph/ceph-client.admin.104302.log: --verbose -- /var/log/ceph/ceph-osd.6.log 2023-11-08T19:31:40.500 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.3.111846.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.111846.log.gz 2023-11-08T19:31:40.500 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.111239.log 2023-11-08T19:31:40.501 INFO:teuthology.orchestra.run.smithi160.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.104302.log.gz 2023-11-08T19:31:40.501 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104249.log 2023-11-08T19:31:40.501 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-client.1.111239.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-11-08T19:31:40.501 INFO:teuthology.orchestra.run.smithi160.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.111239.log.gz 2023-11-08T19:31:40.502 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.admin.104249.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-08T19:31:40.502 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-mds.d.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.104249.log.gz 2023-11-08T19:31:40.502 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph.audit.log: 92.5% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-08T19:31:40.507 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-11-08T19:31:40.507 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.111850.log 2023-11-08T19:31:40.508 INFO:teuthology.orchestra.run.smithi160.stderr: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-08T19:31:40.508 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-11-08T19:31:40.508 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.3.111850.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.111850.log.gz 2023-11-08T19:31:40.509 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-11-08T19:31:40.509 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104022.log 2023-11-08T19:31:40.509 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-mon.c.log: /var/log/ceph/ceph-client.admin.104022.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.104022.log.gz 2023-11-08T19:31:40.510 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-11-08T19:31:40.510 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-11-08T19:31:40.510 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103975.log 2023-11-08T19:31:40.510 INFO:teuthology.orchestra.run.smithi160.stderr: 94.0% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-11-08T19:31:40.512 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.admin.103975.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.103975.log.gz 2023-11-08T19:31:40.513 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-11-08T19:31:40.525 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.111231.log 2023-11-08T19:31:40.539 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.1.111231.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.111231.log.gz 2023-11-08T19:31:40.547 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.124348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122285.log 2023-11-08T19:31:40.547 INFO:teuthology.orchestra.run.smithi149.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.123214.log.gz 2023-11-08T19:31:40.547 INFO:teuthology.orchestra.run.smithi149.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.124348.log.gz 2023-11-08T19:31:40.548 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.112934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128642.log 2023-11-08T19:31:40.548 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.122285.log: -- /var/log/ceph/ceph-client.admin.117384.log 2023-11-08T19:31:40.548 INFO:teuthology.orchestra.run.smithi149.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.112934.log.gz 2023-11-08T19:31:40.549 INFO:teuthology.orchestra.run.smithi149.stderr:gzip /var/log/ceph/ceph-client.admin.128642.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.118760.log 2023-11-08T19:31:40.549 INFO:teuthology.orchestra.run.smithi149.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.122285.log.gz 2023-11-08T19:31:40.549 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.117384.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.128642.log.gz 2023-11-08T19:31:40.550 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138927.log 2023-11-08T19:31:40.550 INFO:teuthology.orchestra.run.smithi149.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.117384.log.gz 2023-11-08T19:31:40.550 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134590.log 2023-11-08T19:31:40.551 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.118760.log: /var/log/ceph/ceph-client.admin.138927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142599.log 2023-11-08T19:31:40.551 INFO:teuthology.orchestra.run.smithi149.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.118760.log.gz 2023-11-08T19:31:40.551 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.134590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136098.log 2023-11-08T19:31:40.551 INFO:teuthology.orchestra.run.smithi149.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.138927.log.gz 2023-11-08T19:31:40.552 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.142599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143624.log 2023-11-08T19:31:40.552 INFO:teuthology.orchestra.run.smithi149.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.134590.log.gz 2023-11-08T19:31:40.552 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.136098.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.142599.log.gz 2023-11-08T19:31:40.553 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142227.log 2023-11-08T19:31:40.553 INFO:teuthology.orchestra.run.smithi149.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.136098.log.gz 2023-11-08T19:31:40.553 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.143624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123452.log 2023-11-08T19:31:40.554 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.142227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125949.log 2023-11-08T19:31:40.554 INFO:teuthology.orchestra.run.smithi149.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.143624.log.gz 2023-11-08T19:31:40.554 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.123452.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.142227.log.gz 2023-11-08T19:31:40.555 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130519.log 2023-11-08T19:31:40.555 INFO:teuthology.orchestra.run.smithi149.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.123452.log.gz 2023-11-08T19:31:40.555 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141181.log 2023-11-08T19:31:40.555 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.125949.log: /var/log/ceph/ceph-client.admin.130519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128860.log 2023-11-08T19:31:40.556 INFO:teuthology.orchestra.run.smithi149.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.125949.log.gz 2023-11-08T19:31:40.556 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.141181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113073.log 2023-11-08T19:31:40.556 INFO:teuthology.orchestra.run.smithi149.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.130519.log.gz 2023-11-08T19:31:40.556 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.128860.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.141181.log.gz 2023-11-08T19:31:40.557 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144087.log 2023-11-08T19:31:40.557 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.113073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118990.log 2023-11-08T19:31:40.557 INFO:teuthology.orchestra.run.smithi149.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.128860.log.gz 2023-11-08T19:31:40.558 INFO:teuthology.orchestra.run.smithi149.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.113073.log.gz 2023-11-08T19:31:40.558 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 /var/log/ceph/ceph-client.admin.144087.log: --verbose -- /var/log/ceph/ceph-client.admin.115963.log 2023-11-08T19:31:40.558 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.118990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129013.log 2023-11-08T19:31:40.558 INFO:teuthology.orchestra.run.smithi149.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.144087.log.gz 2023-11-08T19:31:40.559 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.115963.log: 89.5%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.118990.log.gz--verbose 2023-11-08T19:31:40.559 INFO:teuthology.orchestra.run.smithi149.stderr:-- /var/log/ceph/ceph-client.admin.133660.log 2023-11-08T19:31:40.559 INFO:teuthology.orchestra.run.smithi149.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.115963.log.gz 2023-11-08T19:31:40.559 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.129013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126225.log 2023-11-08T19:31:40.560 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.133660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142429.log 2023-11-08T19:31:40.560 INFO:teuthology.orchestra.run.smithi149.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.129013.log.gz 2023-11-08T19:31:40.560 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.126225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134298.log 2023-11-08T19:31:40.561 INFO:teuthology.orchestra.run.smithi149.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.133660.log.gz 2023-11-08T19:31:40.561 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.142429.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.126225.log.gz 2023-11-08T19:31:40.561 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130940.log 2023-11-08T19:31:40.561 INFO:teuthology.orchestra.run.smithi149.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.142429.log.gz 2023-11-08T19:31:40.562 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.134298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117844.log 2023-11-08T19:31:40.562 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.130940.log: 88.7%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.134298.log.gz--verbose 2023-11-08T19:31:40.562 INFO:teuthology.orchestra.run.smithi149.stderr:-- /var/log/ceph/ceph-client.admin.114407.log 2023-11-08T19:31:40.563 INFO:teuthology.orchestra.run.smithi149.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.130940.log.gz 2023-11-08T19:31:40.563 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.117844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136991.log 2023-11-08T19:31:40.563 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126179.log /var/log/ceph/ceph-client.admin.114407.log: 2023-11-08T19:31:40.563 INFO:teuthology.orchestra.run.smithi149.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.117844.log.gz 2023-11-08T19:31:40.564 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.136991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133522.log 2023-11-08T19:31:40.564 INFO:teuthology.orchestra.run.smithi149.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.114407.log.gz 2023-11-08T19:31:40.564 INFO:teuthology.orchestra.run.smithi149.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.136991.log.gz 2023-11-08T19:31:40.565 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.126179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128035.log 2023-11-08T19:31:40.565 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.133522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119676.log 2023-11-08T19:31:40.565 INFO:teuthology.orchestra.run.smithi149.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.126179.log.gz 2023-11-08T19:31:40.565 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.128035.log: 89.3%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.133522.log.gz--verbose 2023-11-08T19:31:40.566 INFO:teuthology.orchestra.run.smithi149.stderr:-- /var/log/ceph/ceph-client.admin.128243.log 2023-11-08T19:31:40.566 INFO:teuthology.orchestra.run.smithi149.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.128035.log.gz 2023-11-08T19:31:40.566 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.119676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114959.log 2023-11-08T19:31:40.567 INFO:teuthology.orchestra.run.smithi149.stderr: 88.8%/var/log/ceph/ceph-client.admin.128243.log: -- replaced with /var/log/ceph/ceph-client.admin.119676.log.gz 2023-11-08T19:31:40.567 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130987.log 2023-11-08T19:31:40.567 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.114959.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.128243.log.gz 2023-11-08T19:31:40.568 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117200.log 2023-11-08T19:31:40.568 INFO:teuthology.orchestra.run.smithi149.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.114959.log.gz 2023-11-08T19:31:40.568 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113119.log 2023-11-08T19:31:40.568 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.130987.log: /var/log/ceph/ceph-client.admin.117200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136144.log 2023-11-08T19:31:40.569 INFO:teuthology.orchestra.run.smithi149.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.130987.log.gz 2023-11-08T19:31:40.569 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.113119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112615.log 2023-11-08T19:31:40.569 INFO:teuthology.orchestra.run.smithi149.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.117200.log.gz 2023-11-08T19:31:40.570 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.136144.log: 88.8%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.113119.log.gz--verbose 2023-11-08T19:31:40.570 INFO:teuthology.orchestra.run.smithi149.stderr:-- /var/log/ceph/ceph-client.admin.141610.log 2023-11-08T19:31:40.570 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.112615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119584.log 2023-11-08T19:31:40.570 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.141610.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.112615.log.gz 2023-11-08T19:31:40.571 INFO:teuthology.orchestra.run.smithi149.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.136144.log.gz 2023-11-08T19:31:40.571 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132771.log 2023-11-08T19:31:40.571 INFO:teuthology.orchestra.run.smithi149.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.141610.log.gz 2023-11-08T19:31:40.571 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119584.log: /var/log/ceph/ceph-client.admin.136464.log 2023-11-08T19:31:40.572 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.132771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143348.log 2023-11-08T19:31:40.572 INFO:teuthology.orchestra.run.smithi149.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.119584.log.gz 2023-11-08T19:31:40.572 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.136464.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.132771.log.gz 2023-11-08T19:31:40.573 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-11-08T19:31:40.573 INFO:teuthology.orchestra.run.smithi149.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.136464.log.gz 2023-11-08T19:31:40.573 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117614.log 2023-11-08T19:31:40.574 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.143348.log: /var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126704.log 2023-11-08T19:31:40.574 INFO:teuthology.orchestra.run.smithi149.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.143348.log.gz 2023-11-08T19:31:40.574 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.117614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133246.log 2023-11-08T19:31:40.575 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.126704.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.117614.log.gz 2023-11-08T19:31:40.575 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118898.log 2023-11-08T19:31:40.575 INFO:teuthology.orchestra.run.smithi149.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.126704.log.gz 2023-11-08T19:31:40.576 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.133246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140963.log 2023-11-08T19:31:40.576 INFO:teuthology.orchestra.run.smithi149.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.133246.log.gz 2023-11-08T19:31:40.576 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.118898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122622.log 2023-11-08T19:31:40.576 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141518.log 2023-11-08T19:31:40.577 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.140963.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.118898.log.gz 2023-11-08T19:31:40.577 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.122622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127404.log 2023-11-08T19:31:40.577 INFO:teuthology.orchestra.run.smithi149.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.140963.log.gz 2023-11-08T19:31:40.578 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.141518.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.122622.log.gz 2023-11-08T19:31:40.578 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134636.log 2023-11-08T19:31:40.578 INFO:teuthology.orchestra.run.smithi149.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.141518.log.gz/var/log/ceph/ceph-client.admin.127404.log: 2023-11-08T19:31:40.578 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134022.log 2023-11-08T19:31:40.579 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.134636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134114.log 2023-11-08T19:31:40.579 INFO:teuthology.orchestra.run.smithi149.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.127404.log.gz 2023-11-08T19:31:40.579 INFO:teuthology.orchestra.run.smithi149.stderr: 89.4%/var/log/ceph/ceph-client.admin.134022.log: -- replaced with /var/log/ceph/ceph-client.admin.134636.log.gz 2023-11-08T19:31:40.580 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139665.log 2023-11-08T19:31:40.580 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.134114.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.134022.log.gz 2023-11-08T19:31:40.580 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128127.log 2023-11-08T19:31:40.580 INFO:teuthology.orchestra.run.smithi149.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.134114.log.gz 2023-11-08T19:31:40.581 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.139665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110266.log 2023-11-08T19:31:40.581 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.128127.log: 88.6%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.139665.log.gz--verbose 2023-11-08T19:31:40.581 INFO:teuthology.orchestra.run.smithi149.stderr:-- /var/log/ceph/ceph-client.0.135817.log 2023-11-08T19:31:40.582 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.110266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131388.log 2023-11-08T19:31:40.582 INFO:teuthology.orchestra.run.smithi149.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.128127.log.gz 2023-11-08T19:31:40.582 INFO:teuthology.orchestra.run.smithi149.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.110266.log.gz 2023-11-08T19:31:40.582 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.0.135817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142135.log 2023-11-08T19:31:40.583 INFO:teuthology.orchestra.run.smithi149.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.135817.log.gz 2023-11-08T19:31:40.583 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.131388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136051.log 2023-11-08T19:31:40.583 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.142135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124012.log 2023-11-08T19:31:40.584 INFO:teuthology.orchestra.run.smithi149.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.131388.log.gz 2023-11-08T19:31:40.584 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.136051.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.142135.log.gz 2023-11-08T19:31:40.584 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110823.log 2023-11-08T19:31:40.584 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.124012.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.136051.log.gz 2023-11-08T19:31:40.585 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122423.log 2023-11-08T19:31:40.585 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.110823.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.124012.log.gz 2023-11-08T19:31:40.585 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140600.log 2023-11-08T19:31:40.586 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.122423.log: 88.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.110823.log.gz 2023-11-08T19:31:40.586 INFO:teuthology.orchestra.run.smithi149.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.125995.log 2023-11-08T19:31:40.586 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.140600.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-08T19:31:40.587 INFO:teuthology.orchestra.run.smithi149.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.122423.log.gz 2023-11-08T19:31:40.587 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.125995.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.140600.log.gz 2023-11-08T19:31:40.587 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114545.log 2023-11-08T19:31:40.588 INFO:teuthology.orchestra.run.smithi149.stderr: 88.9%/var/log/ceph/ceph.log: -- replaced with /var/log/ceph/ceph-client.admin.125995.log.gz 2023-11-08T19:31:40.588 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120288.log 2023-11-08T19:31:40.588 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.114545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143808.log 2023-11-08T19:31:40.588 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.120288.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.114545.log.gz 2023-11-08T19:31:40.589 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116961.log 2023-11-08T19:31:40.589 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137348.log 2023-11-08T19:31:40.589 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.143808.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.120288.log.gz 2023-11-08T19:31:40.590 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.116961.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.143808.log.gz 2023-11-08T19:31:40.590 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123544.log 2023-11-08T19:31:40.590 INFO:teuthology.orchestra.run.smithi149.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.116961.log.gz 2023-11-08T19:31:40.591 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.137348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128668.log 2023-11-08T19:31:40.591 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.123544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129810.log 2023-11-08T19:31:40.591 INFO:teuthology.orchestra.run.smithi149.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.137348.log.gz 2023-11-08T19:31:40.591 INFO:teuthology.orchestra.run.smithi149.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.123544.log.gz 2023-11-08T19:31:40.592 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.128668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120472.log 2023-11-08T19:31:40.592 INFO:teuthology.orchestra.run.smithi149.stderr: 86.4% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-08T19:31:40.592 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132679.log 2023-11-08T19:31:40.593 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.129810.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.128668.log.gz 2023-11-08T19:31:40.593 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.120472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141763.log 2023-11-08T19:31:40.593 INFO:teuthology.orchestra.run.smithi149.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.129810.log.gz 2023-11-08T19:31:40.593 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.132679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118155.log 2023-11-08T19:31:40.594 INFO:teuthology.orchestra.run.smithi149.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.120472.log.gz 2023-11-08T19:31:40.594 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.141763.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.132679.log.gz 2023-11-08T19:31:40.594 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136324.log 2023-11-08T19:31:40.595 INFO:teuthology.orchestra.run.smithi149.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.141763.log.gz 2023-11-08T19:31:40.595 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.118155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139278.log 2023-11-08T19:31:40.595 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.136324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121568.log 2023-11-08T19:31:40.595 INFO:teuthology.orchestra.run.smithi149.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.118155.log.gz 2023-11-08T19:31:40.596 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.139278.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.136324.log.gzgzip 2023-11-08T19:31:40.596 INFO:teuthology.orchestra.run.smithi149.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.131482.log 2023-11-08T19:31:40.596 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.121568.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.139278.log.gz 2023-11-08T19:31:40.597 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111030.log 2023-11-08T19:31:40.597 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.131482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126271.log 2023-11-08T19:31:40.597 INFO:teuthology.orchestra.run.smithi149.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.121568.log.gz 2023-11-08T19:31:40.598 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.111030.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.131482.log.gz 2023-11-08T19:31:40.598 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120380.log 2023-11-08T19:31:40.598 INFO:teuthology.orchestra.run.smithi149.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.111030.log.gz 2023-11-08T19:31:40.598 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143394.log 2023-11-08T19:31:40.599 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.126271.log: /var/log/ceph/ceph-client.admin.120380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143670.log 2023-11-08T19:31:40.599 INFO:teuthology.orchestra.run.smithi149.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.126271.log.gz 2023-11-08T19:31:40.599 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.143394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143302.log 2023-11-08T19:31:40.600 INFO:teuthology.orchestra.run.smithi149.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.120380.log.gz 2023-11-08T19:31:40.600 INFO:teuthology.orchestra.run.smithi149.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.143394.log.gz 2023-11-08T19:31:40.600 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.143670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138134.log 2023-11-08T19:31:40.600 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.143302.log: 88.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.143670.log.gz-5 2023-11-08T19:31:40.601 INFO:teuthology.orchestra.run.smithi149.stderr:--verbose -- /var/log/ceph/ceph-client.admin.119768.log 2023-11-08T19:31:40.601 INFO:teuthology.orchestra.run.smithi149.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.143302.log.gz 2023-11-08T19:31:40.601 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.138134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118944.log 2023-11-08T19:31:40.602 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.119768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128173.log 2023-11-08T19:31:40.602 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.118944.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.119768.log.gz 2023-11-08T19:31:40.602 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130381.log 2023-11-08T19:31:40.603 INFO:teuthology.orchestra.run.smithi149.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.138134.log.gz 2023-11-08T19:31:40.603 INFO:teuthology.orchestra.run.smithi149.stderr:gzip /var/log/ceph/ceph-client.admin.128173.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.140406.log 2023-11-08T19:31:40.603 INFO:teuthology.orchestra.run.smithi149.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.118944.log.gz 2023-11-08T19:31:40.604 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.130381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131712.log 2023-11-08T19:31:40.604 INFO:teuthology.orchestra.run.smithi149.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.130381.log.gz 2023-11-08T19:31:40.604 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.140406.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.128173.log.gz 2023-11-08T19:31:40.605 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120155.log 2023-11-08T19:31:40.605 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.131712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128081.log 2023-11-08T19:31:40.605 INFO:teuthology.orchestra.run.smithi149.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.140406.log.gz 2023-11-08T19:31:40.605 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.120155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131146.log 2023-11-08T19:31:40.606 INFO:teuthology.orchestra.run.smithi149.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.131712.log.gz 2023-11-08T19:31:40.606 INFO:teuthology.orchestra.run.smithi149.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.120155.log.gz 2023-11-08T19:31:40.606 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.128081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133909.log 2023-11-08T19:31:40.607 INFO:teuthology.orchestra.run.smithi149.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.128081.log.gz 2023-11-08T19:31:40.607 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133338.log 2023-11-08T19:31:40.607 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.131146.log: /var/log/ceph/ceph-client.admin.133909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122965.log 2023-11-08T19:31:40.608 INFO:teuthology.orchestra.run.smithi149.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.131146.log.gz 2023-11-08T19:31:40.608 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.133338.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.133909.log.gz 2023-11-08T19:31:40.608 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137632.log 2023-11-08T19:31:40.608 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113365.log 2023-11-08T19:31:40.609 INFO:teuthology.orchestra.run.smithi149.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.133338.log.gz 2023-11-08T19:31:40.609 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.122965.log: /var/log/ceph/ceph-client.admin.137632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112182.log 2023-11-08T19:31:40.609 INFO:teuthology.orchestra.run.smithi149.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.122965.log.gz 2023-11-08T19:31:40.609 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129534.log 89.1% 2023-11-08T19:31:40.610 INFO:teuthology.orchestra.run.smithi149.stderr: -- replaced with /var/log/ceph/ceph-client.admin.137632.log.gz 2023-11-08T19:31:40.610 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.113365.log: /var/log/ceph/ceph-client.admin.112182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129105.log 2023-11-08T19:31:40.610 INFO:teuthology.orchestra.run.smithi149.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.113365.log.gz 2023-11-08T19:31:40.611 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.129534.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.112182.log.gz 2023-11-08T19:31:40.611 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140245.log 2023-11-08T19:31:40.611 INFO:teuthology.orchestra.run.smithi149.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.129534.log.gz 2023-11-08T19:31:40.612 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.129105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120798.log 2023-11-08T19:31:40.612 INFO:teuthology.orchestra.run.smithi149.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.129105.log.gz 2023-11-08T19:31:40.612 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118806.log 2023-11-08T19:31:40.612 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.140245.log: /var/log/ceph/ceph-client.admin.120798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130151.log 2023-11-08T19:31:40.613 INFO:teuthology.orchestra.run.smithi149.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.140245.log.gz 2023-11-08T19:31:40.613 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.118806.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.120798.log.gz 2023-11-08T19:31:40.613 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132058.log 2023-11-08T19:31:40.614 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136945.log 2023-11-08T19:31:40.614 INFO:teuthology.orchestra.run.smithi149.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.118806.log.gz 2023-11-08T19:31:40.614 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.130151.log: /var/log/ceph/ceph-client.admin.132058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129442.log 2023-11-08T19:31:40.614 INFO:teuthology.orchestra.run.smithi149.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.130151.log.gz 2023-11-08T19:31:40.615 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.136945.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.132058.log.gz 2023-11-08T19:31:40.615 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124106.log 2023-11-08T19:31:40.615 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.129442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138499.log 2023-11-08T19:31:40.616 INFO:teuthology.orchestra.run.smithi149.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.136945.log.gz 2023-11-08T19:31:40.616 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.124106.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.129442.log.gz 2023-11-08T19:31:40.616 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135238.log 2023-11-08T19:31:40.616 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.138499.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.124106.log.gz 2023-11-08T19:31:40.617 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137162.log 2023-11-08T19:31:40.617 INFO:teuthology.orchestra.run.smithi149.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.138499.log.gz 2023-11-08T19:31:40.617 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130289.log 2023-11-08T19:31:40.618 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.135238.log: /var/log/ceph/ceph-client.admin.137162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113731.log 2023-11-08T19:31:40.618 INFO:teuthology.orchestra.run.smithi149.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.135238.log.gz 2023-11-08T19:31:40.618 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.130289.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.137162.log.gz 2023-11-08T19:31:40.619 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112228.log 2023-11-08T19:31:40.619 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.113731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140554.log 2023-11-08T19:31:40.619 INFO:teuthology.orchestra.run.smithi149.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.130289.log.gz 2023-11-08T19:31:40.619 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143716.log 2023-11-08T19:31:40.620 INFO:teuthology.orchestra.run.smithi149.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.113731.log.gz 2023-11-08T19:31:40.620 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.112228.log: /var/log/ceph/ceph-client.admin.140554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138545.log 2023-11-08T19:31:40.620 INFO:teuthology.orchestra.run.smithi149.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.112228.log.gz 2023-11-08T19:31:40.621 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.143716.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.140554.log.gz 2023-11-08T19:31:40.621 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133200.log 2023-11-08T19:31:40.621 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-11-08T19:31:40.621 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.138545.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.143716.log.gz 2023-11-08T19:31:40.622 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.133200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112796.log 2023-11-08T19:31:40.622 INFO:teuthology.orchestra.run.smithi149.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.138545.log.gz 2023-11-08T19:31:40.622 INFO:teuthology.orchestra.run.smithi149.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.133200.log.gz 2023-11-08T19:31:40.622 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131434.log 2023-11-08T19:31:40.623 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.112796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110963.log 2023-11-08T19:31:40.623 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.131434.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.112796.log.gz 2023-11-08T19:31:40.623 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112477.log 2023-11-08T19:31:40.624 INFO:teuthology.orchestra.run.smithi149.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.131434.log.gz 2023-11-08T19:31:40.624 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.110963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143072.log 2023-11-08T19:31:40.624 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131342.log 2023-11-08T19:31:40.624 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.112477.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.110963.log.gz 2023-11-08T19:31:40.625 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.143072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134252.log 2023-11-08T19:31:40.625 INFO:teuthology.orchestra.run.smithi149.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.112477.log.gz 2023-11-08T19:31:40.625 INFO:teuthology.orchestra.run.smithi149.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.143072.log.gz 2023-11-08T19:31:40.625 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129243.log 2023-11-08T19:31:40.626 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.131342.log: /var/log/ceph/ceph-client.admin.134252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.132291.log 2023-11-08T19:31:40.626 INFO:teuthology.orchestra.run.smithi149.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.131342.log.gz 2023-11-08T19:31:40.626 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.129243.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.134252.log.gz 2023-11-08T19:31:40.627 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139157.log 2023-11-08T19:31:40.627 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.0.132291.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.129243.log.gz 2023-11-08T19:31:40.627 INFO:teuthology.orchestra.run.smithi149.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.132291.log.gz 2023-11-08T19:31:40.627 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131192.log 2023-11-08T19:31:40.628 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127552.log 2023-11-08T19:31:40.628 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.139157.log: /var/log/ceph/ceph-client.admin.131192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132817.log 2023-11-08T19:31:40.628 INFO:teuthology.orchestra.run.smithi149.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.139157.log.gz 2023-11-08T19:31:40.629 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.127552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138250.log 2023-11-08T19:31:40.629 INFO:teuthology.orchestra.run.smithi149.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.131192.log.gz 2023-11-08T19:31:40.629 INFO:teuthology.orchestra.run.smithi149.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.127552.log.gz 2023-11-08T19:31:40.629 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.132817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127922.log 2023-11-08T19:31:40.630 INFO:teuthology.orchestra.run.smithi149.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.132817.log.gz 2023-11-08T19:31:40.630 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123652.log 2023-11-08T19:31:40.630 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.138250.log: /var/log/ceph/ceph-client.admin.127922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135100.log 2023-11-08T19:31:40.631 INFO:teuthology.orchestra.run.smithi149.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.138250.log.gz 2023-11-08T19:31:40.631 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.123652.log: 89.2%gzip -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.127922.log.gz-- 2023-11-08T19:31:40.631 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.137208.log 2023-11-08T19:31:40.631 INFO:teuthology.orchestra.run.smithi149.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.123652.log.gz/var/log/ceph/ceph-client.admin.135100.log: 2023-11-08T19:31:40.632 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.97613.log 2023-11-08T19:31:40.632 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.137208.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.135100.log.gz 2023-11-08T19:31:40.632 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135376.log 2023-11-08T19:31:40.632 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph.tmp-client.admin.97613.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.97613.log.gz 2023-11-08T19:31:40.633 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117012.log 2023-11-08T19:31:40.633 INFO:teuthology.orchestra.run.smithi149.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.137208.log.gz 2023-11-08T19:31:40.633 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137116.log 2023-11-08T19:31:40.634 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.135376.log: /var/log/ceph/ceph-client.admin.117012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114867.log 2023-11-08T19:31:40.634 INFO:teuthology.orchestra.run.smithi149.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.135376.log.gz 2023-11-08T19:31:40.634 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.137116.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.117012.log.gz 2023-11-08T19:31:40.635 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132511.log 2023-11-08T19:31:40.635 INFO:teuthology.orchestra.run.smithi149.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.137116.log.gz 2023-11-08T19:31:40.635 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.114867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125499.log 2023-11-08T19:31:40.636 INFO:teuthology.orchestra.run.smithi149.stderr:gzip /var/log/ceph/ceph-client.admin.132511.log: -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-11-08T19:31:40.636 INFO:teuthology.orchestra.run.smithi149.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.114867.log.gz 2023-11-08T19:31:40.636 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.125499.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.132511.log.gz 2023-11-08T19:31:40.636 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131033.log 2023-11-08T19:31:40.637 INFO:teuthology.orchestra.run.smithi149.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.125499.log.gz 2023-11-08T19:31:40.637 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113363.log 2023-11-08T19:31:40.637 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.131033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130565.log 2023-11-08T19:31:40.637 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.113363.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.131033.log.gz 2023-11-08T19:31:40.638 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.130565.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.113363.log.gz 2023-11-08T19:31:40.638 INFO:teuthology.orchestra.run.smithi149.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.130565.log.gz 2023-11-08T19:31:40.638 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110535.log 2023-11-08T19:31:40.639 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137586.log 2023-11-08T19:31:40.639 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111076.log 2023-11-08T19:31:40.639 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.110535.log: /var/log/ceph/ceph-client.admin.137586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142319.log 2023-11-08T19:31:40.640 INFO:teuthology.orchestra.run.smithi149.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.110535.log.gz 2023-11-08T19:31:40.640 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.111076.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.137586.log.gz 2023-11-08T19:31:40.640 INFO:teuthology.orchestra.run.smithi149.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.111076.log.gz 2023-11-08T19:31:40.640 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114821.log 2023-11-08T19:31:40.641 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.142319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126796.log 2023-11-08T19:31:40.641 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.114821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137278.log 2023-11-08T19:31:40.641 INFO:teuthology.orchestra.run.smithi149.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.142319.log.gz 2023-11-08T19:31:40.642 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.126796.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.114821.log.gz 2023-11-08T19:31:40.642 INFO:teuthology.orchestra.run.smithi149.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.126796.log.gz 2023-11-08T19:31:40.642 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142867.log 2023-11-08T19:31:40.642 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.137278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120944.log 2023-11-08T19:31:40.643 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.142867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119262.log 2023-11-08T19:31:40.643 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.120944.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.142867.log.gz 2023-11-08T19:31:40.643 INFO:teuthology.orchestra.run.smithi149.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.137278.log.gz 2023-11-08T19:31:40.644 INFO:teuthology.orchestra.run.smithi149.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.120944.log.gz 2023-11-08T19:31:40.644 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104286.log 2023-11-08T19:31:40.644 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.119262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133955.log 2023-11-08T19:31:40.644 INFO:teuthology.orchestra.run.smithi149.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.119262.log.gz 2023-11-08T19:31:40.645 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.104286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143026.log 2023-11-08T19:31:40.645 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.133955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124716.log 2023-11-08T19:31:40.645 INFO:teuthology.orchestra.run.smithi149.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.104286.log.gz 2023-11-08T19:31:40.646 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.143026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140670.log 2023-11-08T19:31:40.646 INFO:teuthology.orchestra.run.smithi149.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.133955.log.gz 2023-11-08T19:31:40.646 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.124716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143164.log 2023-11-08T19:31:40.646 INFO:teuthology.orchestra.run.smithi149.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.143026.log.gz 2023-11-08T19:31:40.647 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.140670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130894.log 2023-11-08T19:31:40.647 INFO:teuthology.orchestra.run.smithi149.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.124716.log.gz 2023-11-08T19:31:40.647 INFO:teuthology.orchestra.run.smithi149.stderr:gzip /var/log/ceph/ceph-client.admin.143164.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.117338.log 2023-11-08T19:31:40.648 INFO:teuthology.orchestra.run.smithi149.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.140670.log.gz 2023-11-08T19:31:40.648 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.130894.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.143164.log.gz 2023-11-08T19:31:40.648 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.117338.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.130894.log.gz 2023-11-08T19:31:40.648 INFO:teuthology.orchestra.run.smithi149.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.117338.log.gz 2023-11-08T19:31:40.649 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137724.log 2023-11-08T19:31:40.649 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140040.log 2023-11-08T19:31:40.649 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.137724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111168.log 2023-11-08T19:31:40.650 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.140040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.132295.log 2023-11-08T19:31:40.650 INFO:teuthology.orchestra.run.smithi149.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.137724.log.gz 2023-11-08T19:31:40.650 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.111168.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.140040.log.gz 2023-11-08T19:31:40.650 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133384.log 2023-11-08T19:31:40.651 INFO:teuthology.orchestra.run.smithi149.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.111168.log.gz 2023-11-08T19:31:40.651 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.0.132295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142273.log 2023-11-08T19:31:40.651 INFO:teuthology.orchestra.run.smithi149.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.132295.log.gz 2023-11-08T19:31:40.651 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.133384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121911.log 2023-11-08T19:31:40.652 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.142273.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.133384.log.gz 2023-11-08T19:31:40.652 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141334.log 2023-11-08T19:31:40.652 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.121911.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.142273.log.gz 2023-11-08T19:31:40.653 INFO:teuthology.orchestra.run.smithi149.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.121911.log.gz 2023-11-08T19:31:40.653 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121176.log 2023-11-08T19:31:40.653 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.141334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130105.log 2023-11-08T19:31:40.653 INFO:teuthology.orchestra.run.smithi149.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.141334.log.gz 2023-11-08T19:31:40.654 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.121176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112888.log 2023-11-08T19:31:40.654 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.130105.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.121176.log.gz 2023-11-08T19:31:40.654 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-11-08T19:31:40.655 INFO:teuthology.orchestra.run.smithi149.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.130105.log.gz 2023-11-08T19:31:40.655 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.112888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130335.log 2023-11-08T19:31:40.655 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-osd.3.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.112888.log.gz 2023-11-08T19:31:40.655 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128815.log 2023-11-08T19:31:40.656 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.130335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119216.log 2023-11-08T19:31:40.656 INFO:teuthology.orchestra.run.smithi149.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.130335.log.gz 2023-11-08T19:31:40.656 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.128815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125882.log 2023-11-08T19:31:40.657 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.119216.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.128815.log.gz 2023-11-08T19:31:40.657 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.125882.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.119216.log.gz 2023-11-08T19:31:40.657 INFO:teuthology.orchestra.run.smithi149.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.125882.log.gz 2023-11-08T19:31:40.657 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142039.log 2023-11-08T19:31:40.658 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131574.log 2023-11-08T19:31:40.658 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.142039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112750.log 2023-11-08T19:31:40.658 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.131574.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.142039.log.gz 2023-11-08T19:31:40.659 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.112750.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.131574.log.gz 2023-11-08T19:31:40.659 INFO:teuthology.orchestra.run.smithi149.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.112750.log.gz 2023-11-08T19:31:40.659 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131850.log 2023-11-08T19:31:40.660 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122239.log 2023-11-08T19:31:40.660 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.131850.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.131850.log.gz 2023-11-08T19:31:40.660 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.122239.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.122239.log.gz 2023-11-08T19:31:40.660 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134068.log 2023-11-08T19:31:40.661 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127218.log 2023-11-08T19:31:40.661 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.134068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114083.log 2023-11-08T19:31:40.661 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.127218.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.134068.log.gz 2023-11-08T19:31:40.662 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.114083.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.127218.log.gz 2023-11-08T19:31:40.662 INFO:teuthology.orchestra.run.smithi149.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.114083.log.gz 2023-11-08T19:31:40.662 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118427.log 2023-11-08T19:31:40.663 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120564.log 2023-11-08T19:31:40.663 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.118427.log: /var/log/ceph/ceph-client.admin.120564.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.118427.log.gz 2023-11-08T19:31:40.663 INFO:teuthology.orchestra.run.smithi149.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.120564.log.gz 2023-11-08T19:31:40.663 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127452.log 2023-11-08T19:31:40.664 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141564.log 2023-11-08T19:31:40.664 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.127452.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.127452.log.gz 2023-11-08T19:31:40.664 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.141564.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.141564.log.gz 2023-11-08T19:31:40.665 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139371.log 2023-11-08T19:31:40.665 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132725.log 2023-11-08T19:31:40.666 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.139371.log: /var/log/ceph/ceph-client.admin.132725.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.139371.log.gz 2023-11-08T19:31:40.666 INFO:teuthology.orchestra.run.smithi149.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.132725.log.gz 2023-11-08T19:31:40.666 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117798.log 2023-11-08T19:31:40.667 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134774.log 2023-11-08T19:31:40.667 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.117798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.121801.log 2023-11-08T19:31:40.667 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.134774.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.117798.log.gz 2023-11-08T19:31:40.667 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.0.121801.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.134774.log.gz 2023-11-08T19:31:40.668 INFO:teuthology.orchestra.run.smithi149.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.121801.log.gz 2023-11-08T19:31:40.668 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138591.log 2023-11-08T19:31:40.669 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123742.log 2023-11-08T19:31:40.669 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.138591.log: /var/log/ceph/ceph-client.admin.123742.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.138591.log.gz 2023-11-08T19:31:40.669 INFO:teuthology.orchestra.run.smithi149.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.123742.log.gz 2023-11-08T19:31:40.670 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136214.log 2023-11-08T19:31:40.670 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141947.log 2023-11-08T19:31:40.670 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.136214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121038.log 2023-11-08T19:31:40.670 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.141947.log: /var/log/ceph/ceph-client.admin.121038.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.141947.log.gz 2023-11-08T19:31:40.671 INFO:teuthology.orchestra.run.smithi149.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.136214.log.gz 2023-11-08T19:31:40.671 INFO:teuthology.orchestra.run.smithi149.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.121038.log.gz 2023-11-08T19:31:40.671 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132445.log 2023-11-08T19:31:40.672 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.115733.log 2023-11-08T19:31:40.672 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.132445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123966.log 2023-11-08T19:31:40.672 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.0.115733.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.132445.log.gz 2023-11-08T19:31:40.673 INFO:teuthology.orchestra.run.smithi149.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.115733.log.gz 2023-11-08T19:31:40.673 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.123966.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.123966.log.gz 2023-11-08T19:31:40.673 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127310.log 2023-11-08T19:31:40.674 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.125157.log 2023-11-08T19:31:40.674 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.127310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130058.log 2023-11-08T19:31:40.674 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.0.125157.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.127310.log.gz 2023-11-08T19:31:40.675 INFO:teuthology.orchestra.run.smithi149.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.125157.log.gz 2023-11-08T19:31:40.675 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.130058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103861.log 2023-11-08T19:31:40.675 INFO:teuthology.orchestra.run.smithi149.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.130058.log.gz 2023-11-08T19:31:40.676 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139711.log 2023-11-08T19:31:40.676 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.103861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131528.log 2023-11-08T19:31:40.676 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.139711.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.103861.log.gz 2023-11-08T19:31:40.677 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.131528.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.131528.log.gz 2023-11-08T19:31:40.677 INFO:teuthology.orchestra.run.smithi149.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.139711.log.gz 2023-11-08T19:31:40.677 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126566.log 2023-11-08T19:31:40.677 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127506.log 2023-11-08T19:31:40.678 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.126566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117476.log 2023-11-08T19:31:40.678 INFO:teuthology.orchestra.run.smithi149.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.126566.log.gz 2023-11-08T19:31:40.678 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.127506.log: /var/log/ceph/ceph-client.admin.117476.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.127506.log.gz 2023-11-08T19:31:40.679 INFO:teuthology.orchestra.run.smithi149.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.117476.log.gz 2023-11-08T19:31:40.679 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117890.log 2023-11-08T19:31:40.679 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126041.log 2023-11-08T19:31:40.680 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.117890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113732.log 2023-11-08T19:31:40.680 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.126041.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.117890.log.gz 2023-11-08T19:31:40.680 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.113732.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.126041.log.gz 2023-11-08T19:31:40.681 INFO:teuthology.orchestra.run.smithi149.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.113732.log.gz 2023-11-08T19:31:40.681 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140291.log 2023-11-08T19:31:40.681 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125245.log 2023-11-08T19:31:40.681 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.140291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111122.log 2023-11-08T19:31:40.682 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.125245.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.140291.log.gz 2023-11-08T19:31:40.682 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.111122.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.125245.log.gz 2023-11-08T19:31:40.682 INFO:teuthology.orchestra.run.smithi149.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.111122.log.gz 2023-11-08T19:31:40.683 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119124.log 2023-11-08T19:31:40.683 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116620.log 2023-11-08T19:31:40.683 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.119124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122714.log 2023-11-08T19:31:40.684 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.116620.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.119124.log.gz 2023-11-08T19:31:40.684 INFO:teuthology.orchestra.run.smithi149.stderr: 87.8%gzip -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.116620.log.gz-- 2023-11-08T19:31:40.684 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.136899.log 2023-11-08T19:31:40.684 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.122714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135422.log 2023-11-08T19:31:40.685 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.136899.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.122714.log.gz 2023-11-08T19:31:40.685 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.135422.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.136899.log.gz 2023-11-08T19:31:40.685 INFO:teuthology.orchestra.run.smithi149.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.135422.log.gz 2023-11-08T19:31:40.685 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127598.log 2023-11-08T19:31:40.686 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141855.log 2023-11-08T19:31:40.686 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.127598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143930.log 2023-11-08T19:31:40.686 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.141855.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.127598.log.gz 2023-11-08T19:31:40.687 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.143930.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.141855.log.gz 2023-11-08T19:31:40.687 INFO:teuthology.orchestra.run.smithi149.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.143930.log.gz 2023-11-08T19:31:40.687 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126950.log 2023-11-08T19:31:40.687 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128594.log 2023-11-08T19:31:40.688 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.126950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124440.log 2023-11-08T19:31:40.688 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.128594.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.126950.log.gz 2023-11-08T19:31:40.688 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.124440.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.128594.log.gz 2023-11-08T19:31:40.688 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141380.log 2023-11-08T19:31:40.689 INFO:teuthology.orchestra.run.smithi149.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.124440.log.gz 2023-11-08T19:31:40.689 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129856.log 2023-11-08T19:31:40.689 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129902.log 2023-11-08T19:31:40.691 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104159.log 2023-11-08T19:31:40.691 INFO:teuthology.orchestra.run.smithi160.stderr: 93.2% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-11-08T19:31:40.692 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.admin.104159.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.104159.log.gz 2023-11-08T19:31:40.692 INFO:teuthology.orchestra.run.smithi160.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-11-08T19:31:40.733 INFO:teuthology.orchestra.run.smithi160.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-11-08T19:31:40.769 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.141380.log: /var/log/ceph/ceph-client.admin.129856.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.141380.log.gz 2023-11-08T19:31:40.769 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.129902.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.129856.log.gz 2023-11-08T19:31:40.769 INFO:teuthology.orchestra.run.smithi149.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.129902.log.gz 2023-11-08T19:31:40.770 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117292.log 2023-11-08T19:31:40.770 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135054.log 2023-11-08T19:31:40.770 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.117292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138204.log 2023-11-08T19:31:40.770 INFO:teuthology.orchestra.run.smithi149.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.117292.log.gz 2023-11-08T19:31:40.771 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.135054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131288.log 2023-11-08T19:31:40.771 INFO:teuthology.orchestra.run.smithi149.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.135054.log.gz 2023-11-08T19:31:40.771 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.138204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133430.log 2023-11-08T19:31:40.772 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.131288.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.138204.log.gz 2023-11-08T19:31:40.772 INFO:teuthology.orchestra.run.smithi149.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.131288.log.gz 2023-11-08T19:31:40.772 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126133.log 2023-11-08T19:31:40.772 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.133430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121452.log 2023-11-08T19:31:40.773 INFO:teuthology.orchestra.run.smithi149.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.133430.log.gz 2023-11-08T19:31:40.773 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.126133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121999.log 2023-11-08T19:31:40.773 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.121452.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.126133.log.gz 2023-11-08T19:31:40.774 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.121999.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.121452.log.gz 2023-11-08T19:31:40.774 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose 88.0%-- /var/log/ceph/ceph-client.admin.124254.log -- replaced with /var/log/ceph/ceph-client.admin.121999.log.gz 2023-11-08T19:31:40.774 INFO:teuthology.orchestra.run.smithi149.stderr: 2023-11-08T19:31:40.775 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125392.log 2023-11-08T19:31:40.775 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.124254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127692.log 2023-11-08T19:31:40.775 INFO:teuthology.orchestra.run.smithi149.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.124254.log.gz 2023-11-08T19:31:40.775 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.125392.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.125392.log.gz 2023-11-08T19:31:40.776 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-11-08T19:31:40.776 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.127692.log: /var/log/ceph/ceph-mds.c.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.127692.log.gz 2023-11-08T19:31:40.776 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139324.log 2023-11-08T19:31:40.777 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114775.log 2023-11-08T19:31:40.777 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.139324.log: /var/log/ceph/ceph-client.admin.114775.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.139324.log.gz 2023-11-08T19:31:40.777 INFO:teuthology.orchestra.run.smithi149.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.114775.log.gz 2023-11-08T19:31:40.777 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113366.log 2023-11-08T19:31:40.778 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138857.log 2023-11-08T19:31:40.778 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.113366.log: /var/log/ceph/ceph-client.admin.138857.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.113366.log.gz 2023-11-08T19:31:40.778 INFO:teuthology.orchestra.run.smithi149.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.138857.log.gz 2023-11-08T19:31:40.779 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124300.log 2023-11-08T19:31:40.779 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126317.log 2023-11-08T19:31:40.779 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.124300.log: /var/log/ceph/ceph-client.admin.126317.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.124300.log.gz 2023-11-08T19:31:40.779 INFO:teuthology.orchestra.run.smithi149.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.126317.log.gz 2023-11-08T19:31:40.780 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138407.log 2023-11-08T19:31:40.780 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112842.log 2023-11-08T19:31:40.780 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.138407.log: /var/log/ceph/ceph-client.admin.112842.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.138407.log.gz 2023-11-08T19:31:40.781 INFO:teuthology.orchestra.run.smithi149.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.112842.log.gz 2023-11-08T19:31:40.781 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119814.log 2023-11-08T19:31:40.781 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113165.log 2023-11-08T19:31:40.781 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.119814.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.119814.log.gz/var/log/ceph/ceph-client.admin.113165.log: 2023-11-08T19:31:40.782 INFO:teuthology.orchestra.run.smithi149.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.113165.log.gz 2023-11-08T19:31:40.782 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131988.log 2023-11-08T19:31:40.782 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.131988.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.131988.log.gz 2023-11-08T19:31:40.783 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119906.log 2023-11-08T19:31:40.783 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133108.log 2023-11-08T19:31:40.783 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.119906.log: /var/log/ceph/ceph-client.admin.133108.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.119906.log.gz 2023-11-08T19:31:40.784 INFO:teuthology.orchestra.run.smithi149.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.133108.log.gz 2023-11-08T19:31:40.784 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129764.log 2023-11-08T19:31:40.784 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133770.log 2023-11-08T19:31:40.784 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.129764.log: /var/log/ceph/ceph-client.admin.133770.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.129764.log.gz 2023-11-08T19:31:40.785 INFO:teuthology.orchestra.run.smithi149.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.133770.log.gz 2023-11-08T19:31:40.785 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143855.log 2023-11-08T19:31:40.785 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134160.log 2023-11-08T19:31:40.786 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.143855.log: /var/log/ceph/ceph-client.admin.134160.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.143855.log.gz 2023-11-08T19:31:40.786 INFO:teuthology.orchestra.run.smithi149.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.134160.log.gz 2023-11-08T19:31:40.786 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137678.log 2023-11-08T19:31:40.787 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141426.log 2023-11-08T19:31:40.787 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.137678.log: /var/log/ceph/ceph-client.admin.141426.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.137678.log.gz 2023-11-08T19:31:40.787 INFO:teuthology.orchestra.run.smithi149.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.141426.log.gz 2023-11-08T19:31:40.787 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113947.log 2023-11-08T19:31:40.788 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125285.log 2023-11-08T19:31:40.788 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.113947.log: /var/log/ceph/ceph-client.admin.125285.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.113947.log.gz 2023-11-08T19:31:40.788 INFO:teuthology.orchestra.run.smithi149.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.125285.log.gz 2023-11-08T19:31:40.789 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126520.log 2023-11-08T19:31:40.789 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138647.log 2023-11-08T19:31:40.789 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.126520.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.126520.log.gz 2023-11-08T19:31:40.789 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119308.log 2023-11-08T19:31:40.790 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.138647.log: /var/log/ceph/ceph-client.admin.119308.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.138647.log.gz 2023-11-08T19:31:40.790 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.115741.log 2023-11-08T19:31:40.790 INFO:teuthology.orchestra.run.smithi149.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.119308.log.gz 2023-11-08T19:31:40.791 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.0.115741.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.115741.log.gz 2023-11-08T19:31:40.791 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129059.log 2023-11-08T19:31:40.791 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.129059.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.129059.log.gz 2023-11-08T19:31:40.791 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116731.log 2023-11-08T19:31:40.792 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141901.log 2023-11-08T19:31:40.792 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.116731.log: /var/log/ceph/ceph-client.admin.141901.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.116731.log.gz 2023-11-08T19:31:40.792 INFO:teuthology.orchestra.run.smithi149.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.141901.log.gz 2023-11-08T19:31:40.793 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111284.log 2023-11-08T19:31:40.793 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133001.log 2023-11-08T19:31:40.793 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.111284.log: /var/log/ceph/ceph-client.admin.133001.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.111284.log.gz 2023-11-08T19:31:40.793 INFO:teuthology.orchestra.run.smithi149.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.133001.log.gz 2023-11-08T19:31:40.794 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113738.log 2023-11-08T19:31:40.794 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133706.log 2023-11-08T19:31:40.794 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.113738.log: /var/log/ceph/ceph-client.admin.133706.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.113738.log.gz 2023-11-08T19:31:40.794 INFO:teuthology.orchestra.run.smithi149.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.133706.log.gz 2023-11-08T19:31:40.795 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114315.log 2023-11-08T19:31:40.795 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142913.log 2023-11-08T19:31:40.795 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.114315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110917.log 2023-11-08T19:31:40.796 INFO:teuthology.orchestra.run.smithi149.stderr: 87.4%/var/log/ceph/ceph-client.admin.142913.log: -- replaced with /var/log/ceph/ceph-client.admin.114315.log.gz 2023-11-08T19:31:40.796 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.110917.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.142913.log.gz 2023-11-08T19:31:40.796 INFO:teuthology.orchestra.run.smithi149.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.110917.log.gz 2023-11-08T19:31:40.796 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122668.log 2023-11-08T19:31:40.797 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137972.log 2023-11-08T19:31:40.797 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.122668.log: /var/log/ceph/ceph-client.admin.137972.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.122668.log.gz 2023-11-08T19:31:40.797 INFO:teuthology.orchestra.run.smithi149.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.137972.log.gz 2023-11-08T19:31:40.798 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114361.log 2023-11-08T19:31:40.798 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122530.log 2023-11-08T19:31:40.798 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.114361.log: /var/log/ceph/ceph-client.admin.122530.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.114361.log.gz 2023-11-08T19:31:40.798 INFO:teuthology.orchestra.run.smithi149.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.122530.log.gz 2023-11-08T19:31:40.799 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110400.log 2023-11-08T19:31:40.799 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120518.log 2023-11-08T19:31:40.799 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.110400.log: /var/log/ceph/ceph-client.admin.120518.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.110400.log.gz 2023-11-08T19:31:40.799 INFO:teuthology.orchestra.run.smithi149.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.120518.log.gz 2023-11-08T19:31:40.800 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139619.log 2023-11-08T19:31:40.800 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119722.log 2023-11-08T19:31:40.800 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.139619.log: /var/log/ceph/ceph-client.admin.119722.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.139619.log.gz 2023-11-08T19:31:40.801 INFO:teuthology.orchestra.run.smithi149.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.119722.log.gz 2023-11-08T19:31:40.801 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130197.log 2023-11-08T19:31:40.801 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131942.log 2023-11-08T19:31:40.801 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.130197.log: /var/log/ceph/ceph-client.admin.131942.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.130197.log.gz 2023-11-08T19:31:40.802 INFO:teuthology.orchestra.run.smithi149.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.131942.log.gz 2023-11-08T19:31:40.802 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129718.log 2023-11-08T19:31:40.802 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123874.log 2023-11-08T19:31:40.803 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.129718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110635.log 2023-11-08T19:31:40.803 INFO:teuthology.orchestra.run.smithi149.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.129718.log.gz 2023-11-08T19:31:40.803 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.123874.log: /var/log/ceph/ceph-client.admin.110635.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.123874.log.gz 2023-11-08T19:31:40.803 INFO:teuthology.orchestra.run.smithi149.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.110635.log.gz 2023-11-08T19:31:40.804 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117430.log 2023-11-08T19:31:40.804 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124854.log 2023-11-08T19:31:40.804 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.117430.log: /var/log/ceph/ceph-client.admin.124854.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.117430.log.gz 2023-11-08T19:31:40.805 INFO:teuthology.orchestra.run.smithi149.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.124854.log.gz 2023-11-08T19:31:40.805 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115097.log 2023-11-08T19:31:40.805 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116869.log 2023-11-08T19:31:40.805 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.115097.log: /var/log/ceph/ceph-client.admin.116869.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.116869.log.gz 2023-11-08T19:31:40.806 INFO:teuthology.orchestra.run.smithi149.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.115097.log.gz 2023-11-08T19:31:40.806 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-08T19:31:40.806 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111848.log 2023-11-08T19:31:40.806 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.111848.log: 89.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-08T19:31:40.807 INFO:teuthology.orchestra.run.smithi149.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.111848.log.gz 2023-11-08T19:31:40.807 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113368.log 2023-11-08T19:31:40.807 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121406.log 2023-11-08T19:31:40.808 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.113368.log: /var/log/ceph/ceph-client.admin.121406.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.113368.log.gz 2023-11-08T19:31:40.808 INFO:teuthology.orchestra.run.smithi149.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.121406.log.gz 2023-11-08T19:31:40.808 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133568.log 2023-11-08T19:31:40.808 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129672.log 2023-11-08T19:31:40.809 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.133568.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.133568.log.gz/var/log/ceph/ceph-client.admin.129672.log: 2023-11-08T19:31:40.809 INFO:teuthology.orchestra.run.smithi149.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.129672.log.gz 2023-11-08T19:31:40.809 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127646.log 2023-11-08T19:31:40.810 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136761.log 2023-11-08T19:31:40.810 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.127646.log: /var/log/ceph/ceph-client.admin.136761.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.127646.log.gz 2023-11-08T19:31:40.810 INFO:teuthology.orchestra.run.smithi149.stderr: 93.0% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-11-08T19:31:40.811 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119446.log 2023-11-08T19:31:40.811 INFO:teuthology.orchestra.run.smithi149.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.136761.log.gz 2023-11-08T19:31:40.811 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117154.log 2023-11-08T19:31:40.811 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.119446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135997.log 2023-11-08T19:31:40.812 INFO:teuthology.orchestra.run.smithi149.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.119446.log.gz 2023-11-08T19:31:40.812 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.117154.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.117154.log.gz 2023-11-08T19:31:40.812 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122898.log 2023-11-08T19:31:40.812 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.135997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113734.log 2023-11-08T19:31:40.813 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.122898.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.135997.log.gz 2023-11-08T19:31:40.813 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.113734.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.122898.log.gz 2023-11-08T19:31:40.813 INFO:teuthology.orchestra.run.smithi149.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.113734.log.gz 2023-11-08T19:31:40.814 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123057.log 2023-11-08T19:31:40.814 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134682.log 2023-11-08T19:31:40.814 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.123057.log: /var/log/ceph/ceph-client.admin.134682.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.123057.log.gz 2023-11-08T19:31:40.815 INFO:teuthology.orchestra.run.smithi149.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.134682.log.gz 2023-11-08T19:31:40.815 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113369.log 2023-11-08T19:31:40.815 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135192.log 2023-11-08T19:31:40.815 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.113369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112523.log 2023-11-08T19:31:40.816 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.135192.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.113369.log.gz 2023-11-08T19:31:40.816 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.112523.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.135192.log.gz 2023-11-08T19:31:40.816 INFO:teuthology.orchestra.run.smithi149.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.112523.log.gz 2023-11-08T19:31:40.817 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141111.log 2023-11-08T19:31:40.817 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129994.log 2023-11-08T19:31:40.817 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.141111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124532.log 2023-11-08T19:31:40.818 INFO:teuthology.orchestra.run.smithi149.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.141111.log.gz/var/log/ceph/ceph-client.admin.129994.log: 2023-11-08T19:31:40.818 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.124532.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.129994.log.gz 2023-11-08T19:31:40.818 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143997.log 2023-11-08T19:31:40.819 INFO:teuthology.orchestra.run.smithi149.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.124532.log.gz 2023-11-08T19:31:40.819 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140825.log 2023-11-08T19:31:40.819 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144133.log 2023-11-08T19:31:40.819 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.143997.log: /var/log/ceph/ceph-client.admin.140825.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.143997.log.gz 2023-11-08T19:31:40.820 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.144133.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.140825.log.gz 2023-11-08T19:31:40.820 INFO:teuthology.orchestra.run.smithi149.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.144133.log.gz 2023-11-08T19:31:40.820 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125545.log 2023-11-08T19:31:40.821 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118201.log 2023-11-08T19:31:40.821 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.125545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118611.log 2023-11-08T19:31:40.821 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.118201.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.125545.log.gz 2023-11-08T19:31:40.821 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.118611.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.118201.log.gz 2023-11-08T19:31:40.822 INFO:teuthology.orchestra.run.smithi149.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.118611.log.gz 2023-11-08T19:31:40.822 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126612.log 2023-11-08T19:31:40.822 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129151.log 2023-11-08T19:31:40.823 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.126612.log: /var/log/ceph/ceph-client.admin.129151.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.126612.log.gz 2023-11-08T19:31:40.823 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140151.log 2023-11-08T19:31:40.823 INFO:teuthology.orchestra.run.smithi149.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.129151.log.gz 2023-11-08T19:31:40.823 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123260.log 2023-11-08T19:31:40.824 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.140151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134728.log 2023-11-08T19:31:40.824 INFO:teuthology.orchestra.run.smithi149.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.140151.log.gz 2023-11-08T19:31:40.824 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.123260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138695.log 2023-11-08T19:31:40.825 INFO:teuthology.orchestra.run.smithi149.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.123260.log.gz 2023-11-08T19:31:40.825 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.134728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114084.log 2023-11-08T19:31:40.825 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.138695.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.134728.log.gz 2023-11-08T19:31:40.825 INFO:teuthology.orchestra.run.smithi149.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.138695.log.gz 2023-11-08T19:31:40.826 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.114084.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.114084.log.gz 2023-11-08T19:31:40.826 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117522.log 2023-11-08T19:31:40.826 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123406.log 2023-11-08T19:31:40.827 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.117522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112320.log 2023-11-08T19:31:40.827 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.123406.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.117522.log.gz 2023-11-08T19:31:40.827 INFO:teuthology.orchestra.run.smithi149.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.123406.log.gz 2023-11-08T19:31:40.828 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.112320.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.112320.log.gz 2023-11-08T19:31:40.828 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118473.log 2023-11-08T19:31:40.828 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113735.log 2023-11-08T19:31:40.828 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.118473.log: /var/log/ceph/ceph-client.admin.113735.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.118473.log.gz 2023-11-08T19:31:40.829 INFO:teuthology.orchestra.run.smithi149.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.113735.log.gz 2023-11-08T19:31:40.829 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123920.log 2023-11-08T19:31:40.829 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119860.log 2023-11-08T19:31:40.830 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.123920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112704.log 2023-11-08T19:31:40.830 INFO:teuthology.orchestra.run.smithi149.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.123920.log.gz 2023-11-08T19:31:40.830 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.119860.log: /var/log/ceph/ceph-client.admin.112704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128730.log 2023-11-08T19:31:40.831 INFO:teuthology.orchestra.run.smithi149.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.119860.log.gz 2023-11-08T19:31:40.831 INFO:teuthology.orchestra.run.smithi149.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.112704.log.gz 2023-11-08T19:31:40.831 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117936.log 2023-11-08T19:31:40.832 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.128730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119400.log 2023-11-08T19:31:40.832 INFO:teuthology.orchestra.run.smithi149.stderr: 86.6%/var/log/ceph/ceph-client.admin.117936.log: -- replaced with /var/log/ceph/ceph-client.admin.128730.log.gz 2023-11-08T19:31:40.832 INFO:teuthology.orchestra.run.smithi149.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.117936.log.gz 2023-11-08T19:31:40.832 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.119400.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.119400.log.gz 2023-11-08T19:31:40.833 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123168.log 2023-11-08T19:31:40.833 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118339.log 2023-11-08T19:31:40.833 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.123168.log: /var/log/ceph/ceph-client.admin.118339.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.123168.log.gz 2023-11-08T19:31:40.833 INFO:teuthology.orchestra.run.smithi149.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.118339.log.gz 2023-11-08T19:31:40.834 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136807.log 2023-11-08T19:31:40.834 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114082.log 2023-11-08T19:31:40.834 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.136807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127830.log 2023-11-08T19:31:40.835 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.114082.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.136807.log.gz 2023-11-08T19:31:40.835 INFO:teuthology.orchestra.run.smithi149.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.114082.log.gz 2023-11-08T19:31:40.835 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.127830.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.127830.log.gz 2023-11-08T19:31:40.835 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118565.log 2023-11-08T19:31:40.836 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136853.log 2023-11-08T19:31:40.836 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.118565.log: /var/log/ceph/ceph-client.admin.136853.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.118565.log.gz 2023-11-08T19:31:40.836 INFO:teuthology.orchestra.run.smithi149.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.136853.log.gz 2023-11-08T19:31:40.836 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126427.log 2023-11-08T19:31:40.837 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122760.log 2023-11-08T19:31:40.837 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.126427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113729.log 2023-11-08T19:31:40.837 INFO:teuthology.orchestra.run.smithi149.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.126427.log.gz 2023-11-08T19:31:40.838 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.122760.log: /var/log/ceph/ceph-client.admin.113729.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.122760.log.gz 2023-11-08T19:31:40.838 INFO:teuthology.orchestra.run.smithi149.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.113729.log.gz 2023-11-08T19:31:40.838 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137464.log 2023-11-08T19:31:40.838 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121314.log 2023-11-08T19:31:40.839 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.137464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120334.log 2023-11-08T19:31:40.839 INFO:teuthology.orchestra.run.smithi149.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.137464.log.gz 2023-11-08T19:31:40.839 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.121314.log: /var/log/ceph/ceph-client.admin.120334.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.121314.log.gz 2023-11-08T19:31:40.840 INFO:teuthology.orchestra.run.smithi149.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.120334.log.gz 2023-11-08T19:31:40.840 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131758.log 2023-11-08T19:31:40.840 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112981.log 2023-11-08T19:31:40.840 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.131758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116777.log 2023-11-08T19:31:40.841 INFO:teuthology.orchestra.run.smithi149.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.131758.log.gz 2023-11-08T19:31:40.841 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.112981.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.112981.log.gz 2023-11-08T19:31:40.841 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126842.log 2023-11-08T19:31:40.841 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.116777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138317.log 2023-11-08T19:31:40.842 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.126842.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.116777.log.gz 2023-11-08T19:31:40.842 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.138317.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.126842.log.gz 2023-11-08T19:31:40.842 INFO:teuthology.orchestra.run.smithi149.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.138317.log.gz 2023-11-08T19:31:40.843 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123360.log 2023-11-08T19:31:40.843 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110777.log 2023-11-08T19:31:40.843 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.123360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139781.log 2023-11-08T19:31:40.843 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.110777.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.123360.log.gz 2023-11-08T19:31:40.844 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.139781.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.110777.log.gz 2023-11-08T19:31:40.844 INFO:teuthology.orchestra.run.smithi149.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.139781.log.gz 2023-11-08T19:31:40.844 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135284.log 2023-11-08T19:31:40.844 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130848.log 2023-11-08T19:31:40.845 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.135284.log: /var/log/ceph/ceph-client.admin.130848.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.135284.log.gz 2023-11-08T19:31:40.845 INFO:teuthology.orchestra.run.smithi149.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.130848.log.gz 2023-11-08T19:31:40.845 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117568.log 2023-11-08T19:31:40.846 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118247.log 2023-11-08T19:31:40.846 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.117568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125591.log 2023-11-08T19:31:40.846 INFO:teuthology.orchestra.run.smithi149.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.117568.log.gz 2023-11-08T19:31:40.846 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.118247.log: /var/log/ceph/ceph-client.admin.125591.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.118247.log.gz 2023-11-08T19:31:40.847 INFO:teuthology.orchestra.run.smithi149.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.125591.log.gz 2023-11-08T19:31:40.847 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120898.log 2023-11-08T19:31:40.847 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141656.log 2023-11-08T19:31:40.848 INFO:teuthology.orchestra.run.smithi149.stderr: 92.9% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-11-08T19:31:40.848 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.120898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117706.log 2023-11-08T19:31:40.848 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.141656.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.120898.log.gz 2023-11-08T19:31:40.849 INFO:teuthology.orchestra.run.smithi149.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.141656.log.gz 2023-11-08T19:31:40.849 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.117706.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.117706.log.gz 2023-11-08T19:31:40.849 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122806.log 2023-11-08T19:31:40.850 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122377.log 2023-11-08T19:31:40.850 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.122806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124058.log 2023-11-08T19:31:40.850 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.122377.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.122806.log.gz 2023-11-08T19:31:40.851 INFO:teuthology.orchestra.run.smithi149.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.122377.log.gz 2023-11-08T19:31:40.851 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.124058.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.124058.log.gz 2023-11-08T19:31:40.851 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116823.log 2023-11-08T19:31:40.851 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130243.log 2023-11-08T19:31:40.852 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.116823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133292.log 2023-11-08T19:31:40.852 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.130243.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.116823.log.gz 2023-11-08T19:31:40.852 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.133292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110871.log 2023-11-08T19:31:40.853 INFO:teuthology.orchestra.run.smithi149.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.130243.log.gz 2023-11-08T19:31:40.853 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122193.log 2023-11-08T19:31:40.853 INFO:teuthology.orchestra.run.smithi149.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.133292.log.gz 2023-11-08T19:31:40.854 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.110871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139948.log 2023-11-08T19:31:40.854 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.122193.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.110871.log.gz 2023-11-08T19:31:40.854 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114108.log 2023-11-08T19:31:40.855 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.139948.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.122193.log.gz 2023-11-08T19:31:40.855 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129948.log 2023-11-08T19:31:40.855 INFO:teuthology.orchestra.run.smithi149.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.139948.log.gz 2023-11-08T19:31:40.856 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142181.log 2023-11-08T19:31:40.856 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.114108.log: /var/log/ceph/ceph-client.admin.129948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114683.log 2023-11-08T19:31:40.856 INFO:teuthology.orchestra.run.smithi149.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.114108.log.gz 2023-11-08T19:31:40.857 INFO:teuthology.orchestra.run.smithi149.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.129948.log.gz 2023-11-08T19:31:40.857 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.142181.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-11-08T19:31:40.857 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.114683.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.142181.log.gz 2023-11-08T19:31:40.857 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141017.log 2023-11-08T19:31:40.858 INFO:teuthology.orchestra.run.smithi149.stderr: 89.4%/var/log/ceph/ceph-osd.1.log: -- replaced with /var/log/ceph/ceph-client.admin.114683.log.gz 2023-11-08T19:31:40.858 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120656.log 2023-11-08T19:31:40.858 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.141017.log: /var/log/ceph/ceph-client.admin.120656.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.141017.log.gz 2023-11-08T19:31:40.858 INFO:teuthology.orchestra.run.smithi149.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.120656.log.gz 2023-11-08T19:31:40.859 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118109.log 2023-11-08T19:31:40.859 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119998.log 2023-11-08T19:31:40.859 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.118109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139043.log 2023-11-08T19:31:40.860 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.119998.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.118109.log.gz 2023-11-08T19:31:40.860 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.139043.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.119998.log.gz 2023-11-08T19:31:40.860 INFO:teuthology.orchestra.run.smithi149.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.139043.log.gz 2023-11-08T19:31:40.860 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124486.log 2023-11-08T19:31:40.861 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120852.log 2023-11-08T19:31:40.861 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.124486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125729.log 2023-11-08T19:31:40.861 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.120852.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.124486.log.gz 2023-11-08T19:31:40.862 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.125729.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.120852.log.gz 2023-11-08T19:31:40.862 INFO:teuthology.orchestra.run.smithi149.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.125729.log.gz 2023-11-08T19:31:40.862 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119630.log 2023-11-08T19:31:40.862 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120426.log 2023-11-08T19:31:40.863 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.119630.log: /var/log/ceph/ceph-client.admin.120426.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.119630.log.gz 2023-11-08T19:31:40.863 INFO:teuthology.orchestra.run.smithi149.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.120426.log.gz 2023-11-08T19:31:40.863 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114086.log 2023-11-08T19:31:40.863 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138018.log 2023-11-08T19:31:40.864 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.114086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129197.log 2023-11-08T19:31:40.864 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.138018.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.114086.log.gz 2023-11-08T19:31:40.864 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.129197.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.138018.log.gz 2023-11-08T19:31:40.865 INFO:teuthology.orchestra.run.smithi149.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.129197.log.gz 2023-11-08T19:31:40.865 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131240.log 2023-11-08T19:31:40.865 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117246.log 2023-11-08T19:31:40.865 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.131240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122022.log 2023-11-08T19:31:40.866 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.117246.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.131240.log.gz 2023-11-08T19:31:40.866 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.122022.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.117246.log.gz 2023-11-08T19:31:40.866 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141065.log 2023-11-08T19:31:40.866 INFO:teuthology.orchestra.run.smithi149.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.122022.log.gz 2023-11-08T19:31:40.867 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125683.log 2023-11-08T19:31:40.867 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.141065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120992.log 2023-11-08T19:31:40.867 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.125683.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.141065.log.gz 2023-11-08T19:31:40.868 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.120992.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.125683.log.gz 2023-11-08T19:31:40.868 INFO:teuthology.orchestra.run.smithi149.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.120992.log.gz 2023-11-08T19:31:40.868 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114080.log 2023-11-08T19:31:40.868 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137906.log 2023-11-08T19:31:40.869 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.114080.log: /var/log/ceph/ceph-client.admin.137906.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.114080.log.gz 2023-11-08T19:31:40.869 INFO:teuthology.orchestra.run.smithi149.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.137906.log.gz 2023-11-08T19:31:40.869 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140871.log 2023-11-08T19:31:40.869 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120702.log 2023-11-08T19:31:40.870 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.140871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131666.log 2023-11-08T19:31:40.870 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.120702.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.140871.log.gz 2023-11-08T19:31:40.870 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.131666.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.120702.log.gz 2023-11-08T19:31:40.871 INFO:teuthology.orchestra.run.smithi149.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.131666.log.gz 2023-11-08T19:31:40.871 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124154.log 2023-11-08T19:31:40.871 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135008.log 2023-11-08T19:31:40.871 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.124154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114453.log 2023-11-08T19:31:40.872 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.135008.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.124154.log.gz 2023-11-08T19:31:40.872 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.114453.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.135008.log.gz 2023-11-08T19:31:40.872 INFO:teuthology.orchestra.run.smithi149.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.114453.log.gz 2023-11-08T19:31:40.873 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141993.log 2023-11-08T19:31:40.873 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134496.log 2023-11-08T19:31:40.873 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.141993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140917.log 2023-11-08T19:31:40.874 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.134496.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.141993.log.gz 2023-11-08T19:31:40.874 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.140917.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.134496.log.gz 2023-11-08T19:31:40.874 INFO:teuthology.orchestra.run.smithi149.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.140917.log.gz 2023-11-08T19:31:40.875 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117752.log 2023-11-08T19:31:40.875 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132863.log 2023-11-08T19:31:40.875 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.117752.log: /var/log/ceph/ceph-client.admin.132863.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.117752.log.gz 2023-11-08T19:31:40.876 INFO:teuthology.orchestra.run.smithi149.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.132863.log.gz 2023-11-08T19:31:40.876 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115051.log 2023-11-08T19:31:40.876 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135951.log 2023-11-08T19:31:40.876 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.115051.log: /var/log/ceph/ceph-client.admin.135951.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.115051.log.gz 2023-11-08T19:31:40.877 INFO:teuthology.orchestra.run.smithi149.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.135951.log.gz 2023-11-08T19:31:40.877 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140337.log 2023-11-08T19:31:40.877 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133614.log 2023-11-08T19:31:40.878 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.140337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112090.log 2023-11-08T19:31:40.878 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.133614.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.140337.log.gz 2023-11-08T19:31:40.878 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.112090.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.133614.log.gz 2023-11-08T19:31:40.878 INFO:teuthology.orchestra.run.smithi149.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.112090.log.gz 2023-11-08T19:31:40.879 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131100.log 2023-11-08T19:31:40.879 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119952.log 2023-11-08T19:31:40.879 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.131100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118657.log 2023-11-08T19:31:40.880 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.119952.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.131100.log.gz 2023-11-08T19:31:40.880 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.118657.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.119952.log.gz 2023-11-08T19:31:40.880 INFO:teuthology.orchestra.run.smithi149.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.118657.log.gz 2023-11-08T19:31:40.880 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143210.log 2023-11-08T19:31:40.881 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110157.log 2023-11-08T19:31:40.881 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.143210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140508.log 2023-11-08T19:31:40.881 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.110157.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.143210.log.gz 2023-11-08T19:31:40.882 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.140508.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.110157.log.gz 2023-11-08T19:31:40.882 INFO:teuthology.orchestra.run.smithi149.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.140508.log.gz 2023-11-08T19:31:40.882 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104169.log 2023-11-08T19:31:40.882 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122331.log 2023-11-08T19:31:40.883 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.104169.log: /var/log/ceph/ceph-client.admin.122331.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.104169.log.gz 2023-11-08T19:31:40.883 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129289.log 2023-11-08T19:31:40.883 INFO:teuthology.orchestra.run.smithi149.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.122331.log.gz 2023-11-08T19:31:40.884 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110589.log 2023-11-08T19:31:40.884 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.129289.log: /var/log/ceph/ceph-client.admin.110589.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.129289.log.gz 2023-11-08T19:31:40.884 INFO:teuthology.orchestra.run.smithi149.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.110589.log.gz 2023-11-08T19:31:40.884 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114637.log 2023-11-08T19:31:40.885 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124808.log 2023-11-08T19:31:40.885 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.114637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122084.log 2023-11-08T19:31:40.885 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.124808.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.114637.log.gz 2023-11-08T19:31:40.885 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.122084.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.124808.log.gz 2023-11-08T19:31:40.886 INFO:teuthology.orchestra.run.smithi149.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.122084.log.gz 2023-11-08T19:31:40.886 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135146.log 2023-11-08T19:31:40.886 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133476.log 2023-11-08T19:31:40.887 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.135146.log: /var/log/ceph/ceph-client.admin.133476.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.135146.log.gz 2023-11-08T19:31:40.887 INFO:teuthology.orchestra.run.smithi149.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.133476.log.gz 2023-11-08T19:31:40.887 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123498.log 2023-11-08T19:31:40.887 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142645.log 2023-11-08T19:31:40.888 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.123498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119492.log 2023-11-08T19:31:40.888 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.142645.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.123498.log.gz 2023-11-08T19:31:40.888 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.119492.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.142645.log.gz 2023-11-08T19:31:40.889 INFO:teuthology.orchestra.run.smithi149.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.119492.log.gz 2023-11-08T19:31:40.889 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123306.log 2023-11-08T19:31:40.889 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120750.log 2023-11-08T19:31:40.889 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.123306.log: /var/log/ceph/ceph-client.admin.120750.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.123306.log.gz 2023-11-08T19:31:40.890 INFO:teuthology.orchestra.run.smithi149.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.120750.log.gz 2023-11-08T19:31:40.890 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135330.log 2023-11-08T19:31:40.890 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119170.log 2023-11-08T19:31:40.890 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.135330.log: /var/log/ceph/ceph-client.admin.119170.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.135330.log.gz 2023-11-08T19:31:40.891 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127356.log 2023-11-08T19:31:40.891 INFO:teuthology.orchestra.run.smithi149.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.119170.log.gz 2023-11-08T19:31:40.891 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140462.log 2023-11-08T19:31:40.892 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.127356.log: /var/log/ceph/ceph-client.admin.140462.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.127356.log.gz 2023-11-08T19:31:40.892 INFO:teuthology.orchestra.run.smithi149.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.140462.log.gz 2023-11-08T19:31:40.892 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125637.log 2023-11-08T19:31:40.892 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113027.log 2023-11-08T19:31:40.893 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.125637.log: /var/log/ceph/ceph-client.admin.113027.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.125637.log.gz 2023-11-08T19:31:40.893 INFO:teuthology.orchestra.run.smithi149.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.113027.log.gz 2023-11-08T19:31:40.893 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129488.log 2023-11-08T19:31:40.894 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135584.log 2023-11-08T19:31:40.894 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.129488.log: /var/log/ceph/ceph-client.admin.135584.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.129488.log.gz 2023-11-08T19:31:40.894 INFO:teuthology.orchestra.run.smithi149.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.135584.log.gz 2023-11-08T19:31:40.895 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140197.log 2023-11-08T19:31:40.895 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136394.log 2023-11-08T19:31:40.895 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.140197.log: /var/log/ceph/ceph-client.admin.136394.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.140197.log.gz 2023-11-08T19:31:40.895 INFO:teuthology.orchestra.run.smithi149.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.136394.log.gz 2023-11-08T19:31:40.896 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143762.log 2023-11-08T19:31:40.896 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114081.log 2023-11-08T19:31:40.896 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.143762.log: /var/log/ceph/ceph-client.admin.114081.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.143762.log.gz 2023-11-08T19:31:40.897 INFO:teuthology.orchestra.run.smithi149.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.114081.log.gz 2023-11-08T19:31:40.897 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.128488.log 2023-11-08T19:31:40.897 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116687.log 2023-11-08T19:31:40.897 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.0.128488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132955.log 2023-11-08T19:31:40.898 INFO:teuthology.orchestra.run.smithi149.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.128488.log.gz 2023-11-08T19:31:40.898 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.116687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131896.log 2023-11-08T19:31:40.898 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.132955.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.116687.log.gz 2023-11-08T19:31:40.898 INFO:teuthology.orchestra.run.smithi149.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.132955.log.gz 2023-11-08T19:31:40.899 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116915.log 2023-11-08T19:31:40.899 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.131896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134960.log 2023-11-08T19:31:40.899 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.116915.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.131896.log.gz 2023-11-08T19:31:40.900 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.134960.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.116915.log.gz 2023-11-08T19:31:40.900 INFO:teuthology.orchestra.run.smithi149.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.134960.log.gz 2023-11-08T19:31:40.900 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139994.log 2023-11-08T19:31:40.900 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115281.log 2023-11-08T19:31:40.901 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.139994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142365.log 2023-11-08T19:31:40.901 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.115281.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.139994.log.gz 2023-11-08T19:31:40.901 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.142365.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.115281.log.gz 2023-11-08T19:31:40.901 INFO:teuthology.orchestra.run.smithi149.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.142365.log.gz 2023-11-08T19:31:40.902 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.121805.log 2023-11-08T19:31:40.902 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112274.log 2023-11-08T19:31:40.902 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.0.121805.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.121805.log.gz 2023-11-08T19:31:40.903 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.112274.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.112274.log.gz 2023-11-08T19:31:40.903 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138997.log 2023-11-08T19:31:40.903 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134206.log 2023-11-08T19:31:40.903 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.138997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114499.log 2023-11-08T19:31:40.904 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.134206.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.138997.log.gz 2023-11-08T19:31:40.904 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.114499.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.134206.log.gz 2023-11-08T19:31:40.904 INFO:teuthology.orchestra.run.smithi149.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.114499.log.gz 2023-11-08T19:31:40.905 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127264.log 2023-11-08T19:31:40.905 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114913.log 2023-11-08T19:31:40.905 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.127264.log: /var/log/ceph/ceph-client.admin.114913.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.127264.log.gz 2023-11-08T19:31:40.906 INFO:teuthology.orchestra.run.smithi149.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.114913.log.gz 2023-11-08T19:31:40.906 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112569.log 2023-11-08T19:31:40.906 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142476.log 2023-11-08T19:31:40.907 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.112569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143532.log 2023-11-08T19:31:40.907 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.142476.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.112569.log.gz 2023-11-08T19:31:40.907 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.143532.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.142476.log.gz 2023-11-08T19:31:40.907 INFO:teuthology.orchestra.run.smithi149.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.143532.log.gz 2023-11-08T19:31:40.908 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127126.log 2023-11-08T19:31:40.908 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125347.log 2023-11-08T19:31:40.908 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.127126.log: /var/log/ceph/ceph-client.admin.125347.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.127126.log.gz 2023-11-08T19:31:40.908 INFO:teuthology.orchestra.run.smithi149.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.125347.log.gz 2023-11-08T19:31:40.909 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137838.log 2023-11-08T19:31:40.909 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121084.log 2023-11-08T19:31:40.909 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.137838.log: /var/log/ceph/ceph-client.admin.121084.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.137838.log.gz 2023-11-08T19:31:40.910 INFO:teuthology.orchestra.run.smithi149.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.121084.log.gz 2023-11-08T19:31:40.910 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118852.log 2023-11-08T19:31:40.910 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143486.log 2023-11-08T19:31:40.910 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.118852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119078.log 2023-11-08T19:31:40.911 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.143486.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.118852.log.gz 2023-11-08T19:31:40.911 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.119078.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.143486.log.gz 2023-11-08T19:31:40.911 INFO:teuthology.orchestra.run.smithi149.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.119078.log.gz 2023-11-08T19:31:40.912 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136625.log 2023-11-08T19:31:40.912 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138453.log 2023-11-08T19:31:40.912 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.136625.log: /var/log/ceph/ceph-client.admin.138453.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.136625.log.gz 2023-11-08T19:31:40.912 INFO:teuthology.orchestra.run.smithi149.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.138453.log.gz 2023-11-08T19:31:40.913 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121360.log 2023-11-08T19:31:40.913 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135514.log 2023-11-08T19:31:40.913 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.121360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130473.log 2023-11-08T19:31:40.913 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.135514.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.121360.log.gz 2023-11-08T19:31:40.914 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.130473.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.130473.log.gz 2023-11-08T19:31:40.914 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121937.log 2023-11-08T19:31:40.914 INFO:teuthology.orchestra.run.smithi149.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.135514.log.gz 2023-11-08T19:31:40.914 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119354.log 2023-11-08T19:31:40.915 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.121937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117982.log 2023-11-08T19:31:40.915 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.119354.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.121937.log.gz 2023-11-08T19:31:40.915 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.117982.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.119354.log.gz 2023-11-08T19:31:40.915 INFO:teuthology.orchestra.run.smithi149.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.117982.log.gz 2023-11-08T19:31:40.916 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111214.log 2023-11-08T19:31:40.916 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124762.log 2023-11-08T19:31:40.916 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.111214.log: /var/log/ceph/ceph-client.admin.124762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139224.log 2023-11-08T19:31:40.917 INFO:teuthology.orchestra.run.smithi149.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.124762.log.gz 2023-11-08T19:31:40.917 INFO:teuthology.orchestra.run.smithi149.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.111214.log.gz 2023-11-08T19:31:40.917 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.139224.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.139224.log.gz 2023-11-08T19:31:40.917 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120241.log 2023-11-08T19:31:40.918 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128967.log 2023-11-08T19:31:40.918 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.120241.log: /var/log/ceph/ceph-client.admin.128967.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.120241.log.gz 2023-11-08T19:31:40.918 INFO:teuthology.orchestra.run.smithi149.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.128967.log.gz 2023-11-08T19:31:40.919 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124578.log 2023-11-08T19:31:40.919 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122576.log 2023-11-08T19:31:40.919 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.124578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127876.log 2023-11-08T19:31:40.919 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.122576.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.124578.log.gz 2023-11-08T19:31:40.920 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.127876.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.122576.log.gz 2023-11-08T19:31:40.920 INFO:teuthology.orchestra.run.smithi149.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.127876.log.gz 2023-11-08T19:31:40.920 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134912.log 2023-11-08T19:31:40.921 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114591.log 2023-11-08T19:31:40.921 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.134912.log: /var/log/ceph/ceph-client.admin.114591.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.134912.log.gz 2023-11-08T19:31:40.921 INFO:teuthology.orchestra.run.smithi149.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.114591.log.gz 2023-11-08T19:31:40.921 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127968.log 2023-11-08T19:31:40.922 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143256.log 2023-11-08T19:31:40.922 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.127968.log: /var/log/ceph/ceph-client.admin.143256.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.127968.log.gz 2023-11-08T19:31:40.922 INFO:teuthology.orchestra.run.smithi149.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.143256.log.gz 2023-11-08T19:31:40.923 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130673.log 2023-11-08T19:31:40.923 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135468.log 2023-11-08T19:31:40.923 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.130673.log: /var/log/ceph/ceph-client.admin.135468.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.130673.log.gz 2023-11-08T19:31:40.923 INFO:teuthology.orchestra.run.smithi149.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.135468.log.gz 2023-11-08T19:31:40.924 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136555.log 2023-11-08T19:31:40.924 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113367.log 2023-11-08T19:31:40.924 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.136555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139851.log 2023-11-08T19:31:40.925 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.113367.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.136555.log.gz 2023-11-08T19:31:40.925 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.139851.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.113367.log.gz 2023-11-08T19:31:40.925 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121498.log 2023-11-08T19:31:40.926 INFO:teuthology.orchestra.run.smithi149.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.139851.log.gz 2023-11-08T19:31:40.926 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110482.log 2023-11-08T19:31:40.926 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.121498.log: /var/log/ceph/ceph-client.admin.110482.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.110482.log.gz 2023-11-08T19:31:40.926 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 91.1%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.121498.log.gz/var/log/ceph/ceph-client.admin.110683.log 2023-11-08T19:31:40.927 INFO:teuthology.orchestra.run.smithi149.stderr: 2023-11-08T19:31:40.927 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.125161.log 2023-11-08T19:31:40.927 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.110683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117108.log 2023-11-08T19:31:40.928 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.0.125161.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.125161.log.gz 2023-11-08T19:31:40.928 INFO:teuthology.orchestra.run.smithi149.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.110683.log.gz 2023-11-08T19:31:40.928 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141472.log 2023-11-08T19:31:40.928 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.117108.log: /var/log/ceph/ceph-client.admin.141472.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.117108.log.gz 2023-11-08T19:31:40.929 INFO:teuthology.orchestra.run.smithi149.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.141472.log.gz 2023-11-08T19:31:40.929 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130427.log 2023-11-08T19:31:40.929 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127060.log 2023-11-08T19:31:40.930 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.130427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126658.log 2023-11-08T19:31:40.930 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.127060.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.130427.log.gz 2023-11-08T19:31:40.930 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.126658.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.127060.log.gz 2023-11-08T19:31:40.930 INFO:teuthology.orchestra.run.smithi149.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.126658.log.gz 2023-11-08T19:31:40.931 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129626.log 2023-11-08T19:31:40.931 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126474.log 2023-11-08T19:31:40.931 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.129626.log: /var/log/ceph/ceph-client.admin.126474.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.129626.log.gz 2023-11-08T19:31:40.932 INFO:teuthology.orchestra.run.smithi149.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.126474.log.gz 2023-11-08T19:31:40.932 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117062.log 2023-11-08T19:31:40.932 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115005.log 2023-11-08T19:31:40.932 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.117062.log: /var/log/ceph/ceph-client.admin.115005.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.117062.log.gz 2023-11-08T19:31:40.933 INFO:teuthology.orchestra.run.smithi149.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.115005.log.gz 2023-11-08T19:31:40.933 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138787.log 2023-11-08T19:31:40.933 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143578.log 2023-11-08T19:31:40.933 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.138787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133863.log 2023-11-08T19:31:40.934 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.143578.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.143578.log.gz 2023-11-08T19:31:40.934 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.133863.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.138787.log.gz 2023-11-08T19:31:40.934 INFO:teuthology.orchestra.run.smithi149.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.133863.log.gz 2023-11-08T19:31:40.935 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.135821.log 2023-11-08T19:31:40.935 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129396.log 2023-11-08T19:31:40.935 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.0.135821.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.135821.log.gz 2023-11-08T19:31:40.935 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.129396.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.129396.log.gz 2023-11-08T19:31:40.936 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.128484.log 2023-11-08T19:31:40.936 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131620.log 2023-11-08T19:31:40.936 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.0.128484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127172.log 2023-11-08T19:31:40.937 INFO:teuthology.orchestra.run.smithi149.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.128484.log.gz 2023-11-08T19:31:40.937 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.131620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121268.log 2023-11-08T19:31:40.937 INFO:teuthology.orchestra.run.smithi149.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.131620.log.gz/var/log/ceph/ceph-client.admin.127172.log: 2023-11-08T19:31:40.937 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.116398.log 2023-11-08T19:31:40.938 INFO:teuthology.orchestra.run.smithi149.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.127172.log.gz 2023-11-08T19:31:40.938 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.121268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133154.log 2023-11-08T19:31:40.938 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.2.116398.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.121268.log.gz 2023-11-08T19:31:40.939 INFO:teuthology.orchestra.run.smithi149.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.116398.log.gz 2023-11-08T19:31:40.939 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.133154.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.133154.log.gz 2023-11-08T19:31:40.939 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124670.log 2023-11-08T19:31:40.939 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117660.log 2023-11-08T19:31:40.940 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.124670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127738.log 2023-11-08T19:31:40.940 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.117660.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.124670.log.gz 2023-11-08T19:31:40.940 INFO:teuthology.orchestra.run.smithi149.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.117660.log.gz 2023-11-08T19:31:40.940 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.127738.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.127738.log.gz 2023-11-08T19:31:40.941 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130763.log 2023-11-08T19:31:40.941 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134406.log 2023-11-08T19:31:40.941 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.130763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136671.log 2023-11-08T19:31:40.942 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.134406.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.130763.log.gz 2023-11-08T19:31:40.942 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.136671.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.134406.log.gz 2023-11-08T19:31:40.942 INFO:teuthology.orchestra.run.smithi149.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.136671.log.gz 2023-11-08T19:31:40.942 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140738.log 2023-11-08T19:31:40.943 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143440.log 2023-11-08T19:31:40.943 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.140738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124208.log 2023-11-08T19:31:40.943 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.143440.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.140738.log.gz 2023-11-08T19:31:40.944 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.124208.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.143440.log.gz 2023-11-08T19:31:40.944 INFO:teuthology.orchestra.run.smithi149.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.124208.log.gz 2023-11-08T19:31:40.944 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128753.log 2023-11-08T19:31:40.944 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134820.log 2023-11-08T19:31:40.945 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.128753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138741.log 2023-11-08T19:31:40.945 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.134820.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.128753.log.gz 2023-11-08T19:31:40.945 INFO:teuthology.orchestra.run.smithi149.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.134820.log.gz 2023-11-08T19:31:40.946 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.138741.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.138741.log.gz 2023-11-08T19:31:40.946 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121222.log 2023-11-08T19:31:40.946 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121130.log 2023-11-08T19:31:40.946 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143118.log /var/log/ceph/ceph-client.admin.121222.log: 2023-11-08T19:31:40.947 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.121130.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.121222.log.gz 2023-11-08T19:31:40.947 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.143118.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.121130.log.gz 2023-11-08T19:31:40.947 INFO:teuthology.orchestra.run.smithi149.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.143118.log.gz 2023-11-08T19:31:40.948 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112136.log 2023-11-08T19:31:40.948 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139485.log 2023-11-08T19:31:40.948 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.112136.log: /var/log/ceph/ceph-client.admin.139485.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.112136.log.gz 2023-11-08T19:31:40.948 INFO:teuthology.orchestra.run.smithi149.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.139485.log.gz 2023-11-08T19:31:40.949 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112385.log 2023-11-08T19:31:40.949 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126363.log 2023-11-08T19:31:40.949 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.112385.log: /var/log/ceph/ceph-client.admin.126363.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.112385.log.gz 2023-11-08T19:31:40.949 INFO:teuthology.orchestra.run.smithi149.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.126363.log.gz 2023-11-08T19:31:40.950 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131804.log 2023-11-08T19:31:40.950 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114729.log 2023-11-08T19:31:40.950 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.131804.log: /var/log/ceph/ceph-client.admin.114729.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.131804.log.gz 2023-11-08T19:31:40.951 INFO:teuthology.orchestra.run.smithi149.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.114729.log.gz 2023-11-08T19:31:40.951 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110351.log 2023-11-08T19:31:40.951 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123121.log 2023-11-08T19:31:40.951 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.110351.log: /var/log/ceph/ceph-client.admin.123121.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.110351.log.gz 2023-11-08T19:31:40.952 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-11-08T19:31:40.952 INFO:teuthology.orchestra.run.smithi149.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.123121.log.gz 2023-11-08T19:31:40.952 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112431.log 2023-11-08T19:31:40.952 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.112431.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.112431.log.gz 2023-11-08T19:31:40.953 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134866.log 2023-11-08T19:31:40.953 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127784.log 2023-11-08T19:31:40.953 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.134866.log: /var/log/ceph/ceph-client.admin.127784.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.134866.log.gz 2023-11-08T19:31:40.954 INFO:teuthology.orchestra.run.smithi149.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.127784.log.gz 2023-11-08T19:31:40.954 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142959.log 2023-11-08T19:31:40.954 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138064.log 2023-11-08T19:31:40.954 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.142959.log: /var/log/ceph/ceph-client.admin.138064.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.142959.log.gz 2023-11-08T19:31:40.955 INFO:teuthology.orchestra.run.smithi149.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.138064.log.gz 2023-11-08T19:31:40.955 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.116394.log 2023-11-08T19:31:40.955 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123828.log 2023-11-08T19:31:40.955 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.2.116394.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.116394.log.gz 2023-11-08T19:31:40.956 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.123828.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.123828.log.gz 2023-11-08T19:31:40.956 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124924.log 2023-11-08T19:31:40.956 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113372.log 2023-11-08T19:31:40.957 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.124924.log: /var/log/ceph/ceph-client.admin.113372.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.124924.log.gz 2023-11-08T19:31:40.957 INFO:teuthology.orchestra.run.smithi149.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.113372.log.gz 2023-11-08T19:31:40.957 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129580.log 2023-11-08T19:31:40.957 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120044.log 2023-11-08T19:31:40.958 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.129580.log: /var/log/ceph/ceph-client.admin.120044.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.129580.log.gz 2023-11-08T19:31:40.958 INFO:teuthology.orchestra.run.smithi149.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.120044.log.gz 2023-11-08T19:31:40.958 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137418.log 2023-11-08T19:31:40.958 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118293.log 2023-11-08T19:31:40.959 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.137418.log: /var/log/ceph/ceph-client.admin.118293.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.137418.log.gz 2023-11-08T19:31:40.959 INFO:teuthology.orchestra.run.smithi149.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.118293.log.gz 2023-11-08T19:31:40.959 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113737.log 2023-11-08T19:31:40.960 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113358.log 2023-11-08T19:31:40.960 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.113737.log: /var/log/ceph/ceph-client.admin.113358.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.113737.log.gz 2023-11-08T19:31:40.960 INFO:teuthology.orchestra.run.smithi149.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.113358.log.gz 2023-11-08T19:31:40.960 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120610.log 2023-11-08T19:31:40.961 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119538.log 2023-11-08T19:31:40.961 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.120610.log: /var/log/ceph/ceph-client.admin.119538.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.120610.log.gz 2023-11-08T19:31:40.961 INFO:teuthology.orchestra.run.smithi149.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.119538.log.gz 2023-11-08T19:31:40.962 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141809.log 2023-11-08T19:31:40.962 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142522.log 2023-11-08T19:31:40.962 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.141809.log: /var/log/ceph/ceph-client.admin.142522.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.141809.log.gz 2023-11-08T19:31:40.962 INFO:teuthology.orchestra.run.smithi149.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.142522.log.gz 2023-11-08T19:31:40.963 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126750.log 2023-11-08T19:31:40.963 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-11-08T19:31:40.963 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.126750.log: /var/log/ceph/ceph-mgr.y.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.126750.log.gz 2023-11-08T19:31:40.964 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126087.log 2023-11-08T19:31:40.964 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.126087.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.126087.log.gz 2023-11-08T19:31:40.964 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124624.log 2023-11-08T19:31:40.965 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.124624.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.124624.log.gz 2023-11-08T19:31:40.965 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113740.log 2023-11-08T19:31:40.965 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.113740.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.113740.log.gz 2023-11-08T19:31:40.966 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133817.log 2023-11-08T19:31:40.966 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.133817.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.133817.log.gz 2023-11-08T19:31:40.966 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118519.log 2023-11-08T19:31:40.967 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.118519.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.118519.log.gz 2023-11-08T19:31:40.967 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132909.log 2023-11-08T19:31:40.967 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.132909.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.132909.log.gz 2023-11-08T19:31:40.967 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144043.log 2023-11-08T19:31:40.967 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.144043.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.144043.log.gz 2023-11-08T19:31:40.968 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123011.log 2023-11-08T19:31:40.968 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.123011.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.123011.log.gz 2023-11-08T19:31:40.968 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110731.log 2023-11-08T19:31:40.969 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.110731.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.110731.log.gz 2023-11-08T19:31:40.969 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139553.log 2023-11-08T19:31:40.969 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.139553.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.139553.log.gz 2023-11-08T19:31:40.970 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122852.log 2023-11-08T19:31:40.970 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.122852.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.122852.log.gz 2023-11-08T19:31:40.970 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124394.log 2023-11-08T19:31:40.970 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.124394.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.124394.log.gz 2023-11-08T19:31:40.971 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125836.log 2023-11-08T19:31:40.971 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.125836.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.125836.log.gz 2023-11-08T19:31:40.971 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142087.log 2023-11-08T19:31:40.972 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.142087.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.142087.log.gz 2023-11-08T19:31:40.972 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137047.log 2023-11-08T19:31:40.972 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.137047.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.137047.log.gz 2023-11-08T19:31:40.973 INFO:teuthology.orchestra.run.smithi149.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-11-08T19:31:40.973 INFO:teuthology.orchestra.run.smithi160.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-11-08T19:31:41.506 INFO:teuthology.orchestra.run.smithi160.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-11-08T19:31:41.555 INFO:teuthology.orchestra.run.smithi149.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-11-08T19:31:41.607 INFO:teuthology.orchestra.run.smithi149.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-11-08T19:31:41.618 INFO:teuthology.orchestra.run.smithi149.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-11-08T19:31:41.623 INFO:teuthology.orchestra.run.smithi160.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-11-08T19:31:41.641 INFO:teuthology.orchestra.run.smithi160.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-11-08T19:31:41.649 INFO:teuthology.orchestra.run.smithi160.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-11-08T19:31:41.650 INFO:teuthology.orchestra.run.smithi160.stderr: 2023-11-08T19:31:41.651 INFO:teuthology.orchestra.run.smithi160.stderr:real 0m1.170s 2023-11-08T19:31:41.651 INFO:teuthology.orchestra.run.smithi160.stderr:user 0m4.899s 2023-11-08T19:31:41.651 INFO:teuthology.orchestra.run.smithi160.stderr:sys 0m0.198s 2023-11-08T19:31:41.681 INFO:teuthology.orchestra.run.smithi149.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-11-08T19:31:41.931 INFO:teuthology.orchestra.run.smithi149.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-11-08T19:31:41.932 INFO:teuthology.orchestra.run.smithi149.stderr: 2023-11-08T19:31:41.933 INFO:teuthology.orchestra.run.smithi149.stderr:real 0m1.479s 2023-11-08T19:31:41.933 INFO:teuthology.orchestra.run.smithi149.stderr:user 0m5.915s 2023-11-08T19:31:41.933 INFO:teuthology.orchestra.run.smithi149.stderr:sys 0m0.481s 2023-11-08T19:31:41.934 INFO:tasks.ceph:Archiving logs... 2023-11-08T19:31:41.934 DEBUG:teuthology.misc:Transferring archived files from smithi149:/var/log/ceph to /home/teuthworker/archive/pdonnell-2023-11-08_19:01:12-fs:functional-main-distro-default-smithi/7452102/remote/smithi149/log 2023-11-08T19:31:41.935 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-08T19:31:42.810 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2023-11-08T19:31:42.811 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2023-11-08T19:31:42.811 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2023-11-08T19:31:42.811 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2023-11-08T19:31:42.812 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2023-11-08T19:31:42.812 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2023-11-08T19:31:42.812 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-11-08T19:31:42.812 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2023-11-08T19:31:42.813 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2023-11-08T19:31:42.813 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2023-11-08T19:31:43.214 DEBUG:teuthology.misc:Transferring archived files from smithi160:/var/log/ceph to /home/teuthworker/archive/pdonnell-2023-11-08_19:01:12-fs:functional-main-distro-default-smithi/7452102/remote/smithi160/log 2023-11-08T19:31:43.215 DEBUG:teuthology.orchestra.run.smithi160:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-08T19:31:43.957 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-11-08T19:31:43.967 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-11-08T19:31:43.968 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-08T19:31:43.971 DEBUG:teuthology.orchestra.run.smithi160:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-08T19:31:44.061 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-11-08T19:31:44.070 INFO:teuthology.task.clock:Checking final clock skew... 2023-11-08T19:31:44.071 DEBUG:teuthology.orchestra.run.smithi149:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-08T19:31:44.074 DEBUG:teuthology.orchestra.run.smithi160:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-08T19:31:44.089 INFO:teuthology.orchestra.run.smithi149.stderr:bash: ntpq: command not found 2023-11-08T19:31:44.091 INFO:teuthology.orchestra.run.smithi160.stderr:bash: ntpq: command not found 2023-11-08T19:31:44.094 INFO:teuthology.orchestra.run.smithi149.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-08T19:31:44.095 INFO:teuthology.orchestra.run.smithi149.stdout:=============================================================================== 2023-11-08T19:31:44.095 INFO:teuthology.orchestra.run.smithi149.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 59 +1935us[+1935us] +/- 82ms 2023-11-08T19:31:44.095 INFO:teuthology.orchestra.run.smithi149.stdout:^* hv02.front.sepia.ceph.com 3 6 377 60 -232us[ -373us] +/- 69ms 2023-11-08T19:31:44.096 INFO:teuthology.orchestra.run.smithi149.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 61 -1360us[-1501us] +/- 61ms 2023-11-08T19:31:44.096 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-11-08T19:31:44.097 INFO:teuthology.orchestra.run.smithi160.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-08T19:31:44.098 INFO:teuthology.orchestra.run.smithi160.stdout:=============================================================================== 2023-11-08T19:31:44.098 INFO:teuthology.orchestra.run.smithi160.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 60 +1776us[+1776us] +/- 82ms 2023-11-08T19:31:44.099 INFO:teuthology.orchestra.run.smithi160.stdout:^* hv02.front.sepia.ceph.com 3 6 377 61 -384us[ -373us] +/- 69ms 2023-11-08T19:31:44.099 INFO:teuthology.orchestra.run.smithi160.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 58 -1521us[-1521us] +/- 61ms 2023-11-08T19:31:44.099 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-11-08T19:31:44.099 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-11-08T19:31:44.157 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-11-08T19:31:44.158 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-11-08T19:31:44.216 DEBUG:teuthology.orchestra.run.smithi149:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-11-08T19:31:44.332 DEBUG:teuthology.orchestra.run.smithi160:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-11-08T19:31:44.431 DEBUG:teuthology.orchestra.run.smithi149:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-08T19:31:44.466 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-08T19:31:44.467 DEBUG:teuthology.orchestra.run.smithi160:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-08T19:31:44.499 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-08T19:31:44.500 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-11-08T19:31:44.510 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-11-08T19:31:44.548 INFO:teuthology.task.internal:Duration was 1263.238843 seconds 2023-11-08T19:31:44.548 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-11-08T19:31:44.569 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-11-08T19:31:44.570 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-08T19:31:44.573 DEBUG:teuthology.orchestra.run.smithi160:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-08T19:31:44.617 INFO:teuthology.orchestra.run.smithi149.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-08T19:31:44.620 INFO:teuthology.orchestra.run.smithi160.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-08T19:31:45.050 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-11-08T19:31:45.050 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi149.front.sepia.ceph.com 2023-11-08T19:31:45.051 DEBUG:teuthology.orchestra.run.smithi149:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-08T19:31:45.073 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi160.front.sepia.ceph.com 2023-11-08T19:31:45.073 DEBUG:teuthology.orchestra.run.smithi160:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-08T19:31:45.096 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-11-08T19:31:45.096 DEBUG:teuthology.orchestra.run.smithi149:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-08T19:31:45.115 DEBUG:teuthology.orchestra.run.smithi160:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-08T19:31:45.179 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-11-08T19:31:45.179 DEBUG:teuthology.orchestra.run.smithi149:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-08T19:31:45.182 DEBUG:teuthology.orchestra.run.smithi160:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-08T19:31:45.297 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-11-08T19:31:45.309 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-11-08T19:31:45.309 DEBUG:teuthology.orchestra.run.smithi149:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-08T19:31:45.337 DEBUG:teuthology.orchestra.run.smithi160:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-08T19:31:45.364 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-11-08T19:31:45.375 DEBUG:teuthology.orchestra.run.smithi149:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-08T19:31:45.380 DEBUG:teuthology.orchestra.run.smithi160:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-08T19:31:45.404 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern = core 2023-11-08T19:31:45.430 INFO:teuthology.orchestra.run.smithi160.stdout:kernel.core_pattern = core 2023-11-08T19:31:45.444 DEBUG:teuthology.orchestra.run.smithi149:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-08T19:31:45.474 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-08T19:31:45.474 DEBUG:teuthology.orchestra.run.smithi160:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-08T19:31:45.499 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-08T19:31:45.500 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-11-08T19:31:45.511 INFO:teuthology.task.internal:Transferring archived files... 2023-11-08T19:31:45.512 DEBUG:teuthology.misc:Transferring archived files from smithi149:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-11-08_19:01:12-fs:functional-main-distro-default-smithi/7452102/remote/smithi149 2023-11-08T19:31:45.512 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-08T19:31:45.556 DEBUG:teuthology.misc:Transferring archived files from smithi160:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-11-08_19:01:12-fs:functional-main-distro-default-smithi/7452102/remote/smithi160 2023-11-08T19:31:45.556 DEBUG:teuthology.orchestra.run.smithi160:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-08T19:31:45.594 INFO:teuthology.task.internal:Removing archive directory... 2023-11-08T19:31:45.595 DEBUG:teuthology.orchestra.run.smithi149:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-08T19:31:45.597 DEBUG:teuthology.orchestra.run.smithi160:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-08T19:31:45.645 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-11-08T19:31:45.658 INFO:teuthology.task.internal:Not uploading archives. 2023-11-08T19:31:45.658 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-11-08T19:31:45.679 INFO:teuthology.task.internal:Tidying up after the test... 2023-11-08T19:31:45.679 DEBUG:teuthology.orchestra.run.smithi149:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-08T19:31:45.681 DEBUG:teuthology.orchestra.run.smithi160:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-08T19:31:45.695 INFO:teuthology.orchestra.run.smithi149.stdout: 262320 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 8 19:31 /home/ubuntu/cephtest 2023-11-08T19:31:45.701 INFO:teuthology.orchestra.run.smithi160.stdout: 262320 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 8 19:31 /home/ubuntu/cephtest 2023-11-08T19:31:45.702 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-11-08T19:31:45.749 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-11-08T19:31:45.866 INFO:teuthology.nuke:Checking targets against current locks 2023-11-08T19:31:45.895 DEBUG:teuthology.nuke:shortname: smithi149 2023-11-08T19:31:45.895 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-08T19:31:45.921 DEBUG:teuthology.nuke:shortname: smithi160 2023-11-08T19:31:45.922 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-08T19:31:45.925 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi149.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-11-08_19:01:12-fs:functional-main-distro-default-smithi/7452102', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-08 19:05:12.021944', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-11-08T19:31:45.948 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi160.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-11-08_19:01:12-fs:functional-main-distro-default-smithi/7452102', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-08 19:05:12.023391', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-11-08T19:31:45.972 INFO:teuthology.orchestra.console.smithi149:Power off 2023-11-08T19:31:45.973 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-08T19:31:45.996 DEBUG:teuthology.orchestra.console.smithi149:power off output: Chassis Power Control: Down/Off 2023-11-08T19:31:45.997 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T19:31:46.015 INFO:teuthology.orchestra.console.smithi160:Power off 2023-11-08T19:31:46.016 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-08T19:31:46.026 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is on 2023-11-08T19:31:46.041 DEBUG:teuthology.orchestra.console.smithi160:power off output: Chassis Power Control: Down/Off 2023-11-08T19:31:46.042 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T19:31:46.065 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is on 2023-11-08T19:31:50.027 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T19:31:50.066 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T19:31:50.139 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is on 2023-11-08T19:31:50.177 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is on 2023-11-08T19:31:54.141 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T19:31:54.178 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T19:31:54.253 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is on 2023-11-08T19:31:54.289 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is on 2023-11-08T19:31:58.256 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T19:31:58.291 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T19:31:58.368 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is off 2023-11-08T19:31:58.401 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is off 2023-11-08T19:31:58.470 INFO:teuthology.orchestra.console.smithi149:Power off completed 2023-11-08T19:31:58.502 INFO:teuthology.orchestra.console.smithi160:Power off completed 2023-11-08T19:31:58.607 INFO:teuthology.run:Summary data: description: fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snapshots} duration: 1263.2388434410095 failure_reason: 'Test failure: test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots)' flavor: default owner: scheduled_pdonnell@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=29d22ec5852948c3a881d39d0ce52a5b status: fail success: false 2023-11-08T19:31:58.608 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T19:31:58.682 INFO:teuthology.run:FAIL